2024-04-02T07:04:36.537 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-04-02T07:04:36.537 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/forward-scrub} --verbose --name vshankar-2024-04-02_06:51:51-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi --archive /home/teuthworker/archive/vshankar-2024-04-02_06:51:51-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7635440 --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2024-04-02_06:51:51-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7635440/orig.config.yaml 2024-04-02T07:04:36.584 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-02T07:04:36.669 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-04-02_06:51:51-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7635440 branch: wip-vshankar-testing-20240326.105515-reef description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/forward-scrub} email: vshankar@redhat.com first_in_suite: false job_id: '7635440' kernel: flavor: default kdb: true sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: vshankar-2024-04-02_06:51:51-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-vshankar-testing-20240326.105515-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - inode wrongly marked free - bad backtrace on inode - inode table repaired for inode - Scrub error on inode - Scrub error on dir - Metadata damage detected sha1: d0e392d9aee635f2b65768c460c7a151ead7a5e2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d0e392d9aee635f2b65768c460c7a151ead7a5e2 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240326.105515-reef sha1: d46289a69430c98a5ee030c7aba50d0c7af4ad4b owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7327 sha1: d0e392d9aee635f2b65768c460c7a151ead7a5e2 sleep_before_teardown: 0 subset: 990/1024 suite: fs suite_branch: wip-vshankar-testing-20240326.105515-reef suite_path: /home/teuthworker/src/github.com_vshankar_ceph_d46289a69430c98a5ee030c7aba50d0c7af4ad4b/qa suite_relpath: qa suite_repo: https://github.com/vshankar/ceph.git suite_sha1: d46289a69430c98a5ee030c7aba50d0c7af4ad4b syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi055.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO6L5qqJVjl+wGJ6iypG0pgb3Ctz9was79i+AjRSRCDDAWyA14GWLgcGtfZ4+idn4jhxovYpd4eqXIibb6AVkKA= smithi106.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF6tOml1IjfQtFLvItNq+tTnYPUSm7I737Q4RNrNug/va7UfjaigktfN2Af2qj3qeHvF1o1/7xBY1hXO0I5ehlY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_forward_scrub teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-04-02_06:51:51 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-02T07:04:36.669 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_vshankar_ceph_d46289a69430c98a5ee030c7aba50d0c7af4ad4b/qa; will attempt to use it 2024-04-02T07:04:36.671 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_vshankar_ceph_d46289a69430c98a5ee030c7aba50d0c7af4ad4b/qa/tasks 2024-04-02T07:04:36.671 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-02T07:04:36.672 INFO:teuthology.task.internal:Checking packages... 2024-04-02T07:04:36.698 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd0e392d9aee635f2b65768c460c7a151ead7a5e2' 2024-04-02T07:04:36.698 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-02T07:04:36.698 INFO:teuthology.packaging:ref: None 2024-04-02T07:04:36.698 INFO:teuthology.packaging:tag: None 2024-04-02T07:04:36.698 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240326.105515-reef 2024-04-02T07:04:36.698 INFO:teuthology.packaging:sha1: d0e392d9aee635f2b65768c460c7a151ead7a5e2 2024-04-02T07:04:36.699 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-vshankar-testing-20240326.105515-reef 2024-04-02T07:04:36.845 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-1015-gd0e392d9-1jammy 2024-04-02T07:04:36.846 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-02T07:04:36.853 INFO:teuthology.task.internal:no buildpackages task found 2024-04-02T07:04:36.853 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-02T07:04:36.860 INFO:teuthology.task.internal:Saving configuration 2024-04-02T07:04:36.877 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-02T07:04:36.883 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-02T07:04:36.909 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-02_06:51:51-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7635440', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-02 06:58:45.766428', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMzfwjBseSW1Y/MgTsA51cAPNk+2qd0tDnDK+iAeeU7P'} 2024-04-02T07:04:36.933 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-02_06:51:51-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7635440', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-02 06:58:45.767678', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIL+0DKvtGYRZxU9CcgEKT/uPXgRxj9ZTz9JFbYrn0B6O'} 2024-04-02T07:04:36.933 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-02T07:04:36.940 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-04-02T07:04:36.940 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-04-02T07:04:36.940 INFO:teuthology.run_tasks:Running task console_log... 2024-04-02T07:04:37.007 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd8a2955f70>, signals=[15]) 2024-04-02T07:04:37.008 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-02T07:04:37.014 INFO:teuthology.task.internal:Opening connections... 2024-04-02T07:04:37.014 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:04:37.016 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T07:04:37.096 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:04:37.097 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T07:04:37.174 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-02T07:04:37.180 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2024-04-02T07:04:37.186 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2024-04-02T07:04:37.187 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2024-04-02T07:04:37.234 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-02T07:04:37.234 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Ubuntu" 2024-04-02T07:04:37.234 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="22.04" 2024-04-02T07:04:37.234 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-02T07:04:37.234 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_CODENAME=jammy 2024-04-02T07:04:37.235 INFO:teuthology.orchestra.run.smithi055.stdout:ID=ubuntu 2024-04-02T07:04:37.235 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE=debian 2024-04-02T07:04:37.235 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-02T07:04:37.235 INFO:teuthology.orchestra.run.smithi055.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-02T07:04:37.235 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-02T07:04:37.235 INFO:teuthology.orchestra.run.smithi055.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-02T07:04:37.235 INFO:teuthology.orchestra.run.smithi055.stdout:UBUNTU_CODENAME=jammy 2024-04-02T07:04:37.236 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2024-04-02T07:04:37.259 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2024-04-02T07:04:37.263 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2024-04-02T07:04:37.264 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-04-02T07:04:37.310 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-02T07:04:37.311 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="Ubuntu" 2024-04-02T07:04:37.311 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="22.04" 2024-04-02T07:04:37.311 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-02T07:04:37.311 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_CODENAME=jammy 2024-04-02T07:04:37.311 INFO:teuthology.orchestra.run.smithi106.stdout:ID=ubuntu 2024-04-02T07:04:37.311 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE=debian 2024-04-02T07:04:37.311 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-02T07:04:37.311 INFO:teuthology.orchestra.run.smithi106.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-02T07:04:37.311 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-02T07:04:37.311 INFO:teuthology.orchestra.run.smithi106.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-02T07:04:37.311 INFO:teuthology.orchestra.run.smithi106.stdout:UBUNTU_CODENAME=jammy 2024-04-02T07:04:37.312 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-04-02T07:04:37.333 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-02T07:04:37.345 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-02T07:04:37.350 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-02T07:04:37.350 DEBUG:teuthology.orchestra.run.smithi055:> test '!' -e /home/ubuntu/cephtest 2024-04-02T07:04:37.353 DEBUG:teuthology.orchestra.run.smithi106:> test '!' -e /home/ubuntu/cephtest 2024-04-02T07:04:37.357 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-02T07:04:37.363 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-02T07:04:37.363 DEBUG:teuthology.orchestra.run.smithi055:> test -z $(ls -A /var/lib/ceph) 2024-04-02T07:04:37.399 DEBUG:teuthology.orchestra.run.smithi106:> test -z $(ls -A /var/lib/ceph) 2024-04-02T07:04:37.407 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-02T07:04:37.464 INFO:teuthology.run_tasks:Running task kernel... 2024-04-02T07:04:37.479 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'} 2024-04-02T07:04:37.479 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}}, timeout 300 2024-04-02T07:04:37.479 DEBUG:teuthology.orchestra.run.smithi055:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-02T07:04:37.480 DEBUG:teuthology.orchestra.run.smithi106:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-02T07:04:37.484 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:04:37.484 DEBUG:teuthology.task.kernel:sha1 for mon.a is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-02T07:04:37.485 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-04-02T07:04:37.485 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2024-04-02T07:04:37.485 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:04:37.486 DEBUG:teuthology.task.kernel:sha1 for mon.b is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-02T07:04:37.486 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-04-02T07:04:37.486 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2024-04-02T07:04:37.531 INFO:teuthology.orchestra.run.smithi055.stdout:5.15.0-56-generic 2024-04-02T07:04:37.531 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-02T07:04:37.531 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-02T07:04:37.531 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-02T07:04:37.535 INFO:teuthology.orchestra.run.smithi106.stdout:5.15.0-56-generic 2024-04-02T07:04:37.536 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-02T07:04:37.536 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-02T07:04:37.536 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-02T07:04:37.686 INFO:teuthology.task.kernel:Installing linux-firmware on mon.b... 2024-04-02T07:04:37.686 DEBUG:teuthology.orchestra.run.smithi106:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-02T07:04:37.697 INFO:teuthology.orchestra.run.smithi106.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-02T07:04:37.752 INFO:teuthology.task.kernel:Installing linux-firmware on mon.a... 2024-04-02T07:04:37.752 DEBUG:teuthology.orchestra.run.smithi055:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2024-04-02T07:04:37.770 INFO:teuthology.orchestra.run.smithi055.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2024-04-02T07:04:37.838 INFO:teuthology.orchestra.run.smithi106.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-02T07:04:37.838 INFO:teuthology.orchestra.run.smithi106.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-02T07:04:37.838 INFO:teuthology.orchestra.run.smithi106.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-02T07:04:37.838 INFO:teuthology.orchestra.run.smithi106.stderr:hint: 2024-04-02T07:04:37.838 INFO:teuthology.orchestra.run.smithi106.stderr:hint: git config --global init.defaultBranch 2024-04-02T07:04:37.838 INFO:teuthology.orchestra.run.smithi106.stderr:hint: 2024-04-02T07:04:37.838 INFO:teuthology.orchestra.run.smithi106.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-02T07:04:37.838 INFO:teuthology.orchestra.run.smithi106.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-02T07:04:37.839 INFO:teuthology.orchestra.run.smithi106.stderr:hint: 2024-04-02T07:04:37.839 INFO:teuthology.orchestra.run.smithi106.stderr:hint: git branch -m 2024-04-02T07:04:37.841 INFO:teuthology.orchestra.run.smithi106.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-02T07:04:37.844 DEBUG:teuthology.orchestra.run.smithi106:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-02T07:04:37.910 INFO:teuthology.orchestra.run.smithi055.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2024-04-02T07:04:37.910 INFO:teuthology.orchestra.run.smithi055.stderr:hint: is subject to change. To configure the initial branch name to use in all 2024-04-02T07:04:37.911 INFO:teuthology.orchestra.run.smithi055.stderr:hint: of your new repositories, which will suppress this warning, call: 2024-04-02T07:04:37.911 INFO:teuthology.orchestra.run.smithi055.stderr:hint: 2024-04-02T07:04:37.911 INFO:teuthology.orchestra.run.smithi055.stderr:hint: git config --global init.defaultBranch 2024-04-02T07:04:37.911 INFO:teuthology.orchestra.run.smithi055.stderr:hint: 2024-04-02T07:04:37.911 INFO:teuthology.orchestra.run.smithi055.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2024-04-02T07:04:37.911 INFO:teuthology.orchestra.run.smithi055.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2024-04-02T07:04:37.911 INFO:teuthology.orchestra.run.smithi055.stderr:hint: 2024-04-02T07:04:37.911 INFO:teuthology.orchestra.run.smithi055.stderr:hint: git branch -m 2024-04-02T07:04:37.912 INFO:teuthology.orchestra.run.smithi055.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2024-04-02T07:04:37.913 DEBUG:teuthology.orchestra.run.smithi106:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-02T07:04:37.914 DEBUG:teuthology.orchestra.run.smithi055:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2024-04-02T07:04:37.970 DEBUG:teuthology.orchestra.run.smithi106:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-02T07:04:37.984 DEBUG:teuthology.orchestra.run.smithi055:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2024-04-02T07:04:38.040 DEBUG:teuthology.orchestra.run.smithi055:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2024-04-02T07:07:40.555 INFO:teuthology.orchestra.run.smithi106.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-02T07:07:40.555 INFO:teuthology.orchestra.run.smithi106.stderr: * [new branch] main -> origin/main 2024-04-02T07:07:40.580 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20190312 -> 20190312 2024-04-02T07:07:40.580 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20190416 -> 20190416 2024-04-02T07:07:40.580 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20190514 -> 20190514 2024-04-02T07:07:40.580 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20190618 -> 20190618 2024-04-02T07:07:40.580 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20190717 -> 20190717 2024-04-02T07:07:40.581 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20190815 -> 20190815 2024-04-02T07:07:40.582 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20190923 -> 20190923 2024-04-02T07:07:40.582 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20191022 -> 20191022 2024-04-02T07:07:40.582 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20191215 -> 20191215 2024-04-02T07:07:40.582 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20200122 -> 20200122 2024-04-02T07:07:40.583 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20200316 -> 20200316 2024-04-02T07:07:40.583 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20200421 -> 20200421 2024-04-02T07:07:40.583 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20200519 -> 20200519 2024-04-02T07:07:40.583 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20200619 -> 20200619 2024-04-02T07:07:40.583 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20200721 -> 20200721 2024-04-02T07:07:40.583 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20200817 -> 20200817 2024-04-02T07:07:40.583 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20200918 -> 20200918 2024-04-02T07:07:40.583 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20201022 -> 20201022 2024-04-02T07:07:40.583 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20201118 -> 20201118 2024-04-02T07:07:40.583 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20201218 -> 20201218 2024-04-02T07:07:40.583 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20210208 -> 20210208 2024-04-02T07:07:40.585 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20210315 -> 20210315 2024-04-02T07:07:40.585 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20210511 -> 20210511 2024-04-02T07:07:40.586 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20210716 -> 20210716 2024-04-02T07:07:40.586 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20210818 -> 20210818 2024-04-02T07:07:40.586 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20210919 -> 20210919 2024-04-02T07:07:40.586 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20211027 -> 20211027 2024-04-02T07:07:40.586 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20211216 -> 20211216 2024-04-02T07:07:40.586 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20220209 -> 20220209 2024-04-02T07:07:40.586 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20220310 -> 20220310 2024-04-02T07:07:40.586 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20220411 -> 20220411 2024-04-02T07:07:40.586 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20220509 -> 20220509 2024-04-02T07:07:40.586 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20220610 -> 20220610 2024-04-02T07:07:40.586 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20220708 -> 20220708 2024-04-02T07:07:40.586 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20220815 -> 20220815 2024-04-02T07:07:40.586 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20220913 -> 20220913 2024-04-02T07:07:40.586 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20221012 -> 20221012 2024-04-02T07:07:40.587 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20221109 -> 20221109 2024-04-02T07:07:40.587 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20221214 -> 20221214 2024-04-02T07:07:40.587 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20230117 -> 20230117 2024-04-02T07:07:40.587 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20230210 -> 20230210 2024-04-02T07:07:40.587 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20230310 -> 20230310 2024-04-02T07:07:40.588 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20230404 -> 20230404 2024-04-02T07:07:40.588 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20230515 -> 20230515 2024-04-02T07:07:40.588 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20230625 -> 20230625 2024-04-02T07:07:40.588 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20230804 -> 20230804 2024-04-02T07:07:40.588 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20230919 -> 20230919 2024-04-02T07:07:40.588 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20231030 -> 20231030 2024-04-02T07:07:40.588 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20231111 -> 20231111 2024-04-02T07:07:40.588 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20231211 -> 20231211 2024-04-02T07:07:40.588 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20240115 -> 20240115 2024-04-02T07:07:40.589 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20240220 -> 20240220 2024-04-02T07:07:40.589 INFO:teuthology.orchestra.run.smithi106.stderr: * [new tag] 20240312 -> 20240312 2024-04-02T07:07:41.797 INFO:teuthology.orchestra.run.smithi055.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2024-04-02T07:07:41.797 INFO:teuthology.orchestra.run.smithi055.stderr: * [new branch] main -> origin/main 2024-04-02T07:07:41.824 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190312 -> 20190312 2024-04-02T07:07:41.824 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190416 -> 20190416 2024-04-02T07:07:41.824 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190514 -> 20190514 2024-04-02T07:07:41.824 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190618 -> 20190618 2024-04-02T07:07:41.824 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190717 -> 20190717 2024-04-02T07:07:41.824 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190815 -> 20190815 2024-04-02T07:07:41.826 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20190923 -> 20190923 2024-04-02T07:07:41.826 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20191022 -> 20191022 2024-04-02T07:07:41.826 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20191215 -> 20191215 2024-04-02T07:07:41.826 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200122 -> 20200122 2024-04-02T07:07:41.826 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200316 -> 20200316 2024-04-02T07:07:41.826 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200421 -> 20200421 2024-04-02T07:07:41.826 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200519 -> 20200519 2024-04-02T07:07:41.826 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200619 -> 20200619 2024-04-02T07:07:41.826 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200721 -> 20200721 2024-04-02T07:07:41.826 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200817 -> 20200817 2024-04-02T07:07:41.826 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20200918 -> 20200918 2024-04-02T07:07:41.826 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20201022 -> 20201022 2024-04-02T07:07:41.829 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20201118 -> 20201118 2024-04-02T07:07:41.829 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20201218 -> 20201218 2024-04-02T07:07:41.829 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20210208 -> 20210208 2024-04-02T07:07:41.829 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20210315 -> 20210315 2024-04-02T07:07:41.829 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20210511 -> 20210511 2024-04-02T07:07:41.829 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20210716 -> 20210716 2024-04-02T07:07:41.829 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20210818 -> 20210818 2024-04-02T07:07:41.829 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20210919 -> 20210919 2024-04-02T07:07:41.829 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20211027 -> 20211027 2024-04-02T07:07:41.829 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20211216 -> 20211216 2024-04-02T07:07:41.829 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220209 -> 20220209 2024-04-02T07:07:41.830 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220310 -> 20220310 2024-04-02T07:07:41.830 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220411 -> 20220411 2024-04-02T07:07:41.830 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220509 -> 20220509 2024-04-02T07:07:41.830 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220610 -> 20220610 2024-04-02T07:07:41.830 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220708 -> 20220708 2024-04-02T07:07:41.830 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220815 -> 20220815 2024-04-02T07:07:41.830 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20220913 -> 20220913 2024-04-02T07:07:41.830 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20221012 -> 20221012 2024-04-02T07:07:41.830 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20221109 -> 20221109 2024-04-02T07:07:41.830 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20221214 -> 20221214 2024-04-02T07:07:41.832 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230117 -> 20230117 2024-04-02T07:07:41.832 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230210 -> 20230210 2024-04-02T07:07:41.832 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230310 -> 20230310 2024-04-02T07:07:41.832 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230404 -> 20230404 2024-04-02T07:07:41.832 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230515 -> 20230515 2024-04-02T07:07:41.832 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230625 -> 20230625 2024-04-02T07:07:41.832 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230804 -> 20230804 2024-04-02T07:07:41.832 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20230919 -> 20230919 2024-04-02T07:07:41.832 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20231030 -> 20231030 2024-04-02T07:07:41.832 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20231111 -> 20231111 2024-04-02T07:07:41.833 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20231211 -> 20231211 2024-04-02T07:07:41.833 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20240115 -> 20240115 2024-04-02T07:07:41.833 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20240220 -> 20240220 2024-04-02T07:07:41.833 INFO:teuthology.orchestra.run.smithi055.stderr: * [new tag] 20240312 -> 20240312 2024-04-02T07:07:44.772 INFO:teuthology.orchestra.run.smithi106.stderr:Updating files: 51% (1851/3598) Updating files: 52% (1871/3598) Updating files: 53% (1907/3598) Updating files: 54% (1943/3598) Updating files: 55% (1979/3598) Updating files: 56% (2015/3598) Updating files: 57% (2051/3598) Updating files: 58% (2087/3598) Updating files: 59% (2123/3598) Updating files: 60% (2159/3598) Updating files: 61% (2195/3598) Updating files: 62% (2231/3598) Updating files: 63% (2267/3598) Updating files: 64% (2303/3598) Updating files: 64% (2327/3598) Updating files: 65% (2339/3598) Updating files: 66% (2375/3598) Updating files: 67% (2411/3598) Updating files: 68% (2447/3598) Updating files: 69% (2483/3598) Updating files: 70% (2519/3598) Updating files: 71% (2555/3598) Updating files: 72% (2591/3598) Updating files: 73% (2627/3598) Updating files: 74% (2663/3598) Updating files: 75% (2699/3598) Updating files: 76% (2735/3598) Updating files: 77% (2771/3598) Updating files: 77% (2785/3598) Updating files: 78% (2807/3598) Updating files: 79% (2843/3598) Updating files: 80% (2879/3598) Updating files: 81% (2915/3598) Updating files: 82% (2951/3598) Updating files: 83% (2987/3598) Updating files: 84% (3023/3598) Updating files: 85% (3059/3598) Updating files: 86% (3095/3598) Updating files: 87% (3131/3598) Updating files: 88% (3167/3598) Updating files: 89% (3203/3598) Updating files: 90% (3239/3598) Updating files: 91% (3275/3598) Updating files: 91% (3277/3598) Updating files: 92% (3311/3598) Updating files: 93% (3347/3598) Updating files: 94% (3383/3598) Updating files: 95% (3419/3598) Updating files: 96% (3455/3598) Updating files: 97% (3491/3598) Updating files: 98% (3527/3598) Updating files: 99% (3563/3598) Updating files: 100% (3598/3598) Updating files: 100% (3598/3598), done. 2024-04-02T07:07:44.777 INFO:teuthology.orchestra.run.smithi106.stdout:HEAD is now at e068ccf0 Merge branch 'robot/pr-0-1711100280' into 'main' 2024-04-02T07:07:44.797 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.b... 2024-04-02T07:07:44.798 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-02T07:07:44.955 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g1df0c7e8a235/ 2024-04-02T07:07:44.955 DEBUG:teuthology.orchestra.run.smithi106:> rm -f /tmp/linux-image.deb && echo linux-image-6.8.0-g1df0c7e8a235_6.8.0-g1df0c7e8a235-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g1df0c7e8a235/ --input-file=- 2024-04-02T07:07:44.958 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi106.front.sepia.ceph.com to complete... 2024-04-02T07:07:46.264 INFO:teuthology.orchestra.run.smithi055.stderr:Updating files: 48% (1756/3598) Updating files: 49% (1764/3598) Updating files: 50% (1799/3598) Updating files: 51% (1835/3598) Updating files: 52% (1871/3598) Updating files: 53% (1907/3598) Updating files: 54% (1943/3598) Updating files: 55% (1979/3598) Updating files: 56% (2015/3598) Updating files: 57% (2051/3598) Updating files: 58% (2087/3598) Updating files: 59% (2123/3598) Updating files: 60% (2159/3598) Updating files: 61% (2195/3598) Updating files: 61% (2224/3598) Updating files: 62% (2231/3598) Updating files: 63% (2267/3598) Updating files: 64% (2303/3598) Updating files: 65% (2339/3598) Updating files: 66% (2375/3598) Updating files: 67% (2411/3598) Updating files: 68% (2447/3598) Updating files: 69% (2483/3598) Updating files: 70% (2519/3598) Updating files: 71% (2555/3598) Updating files: 71% (2580/3598) Updating files: 72% (2591/3598) Updating files: 73% (2627/3598) Updating files: 74% (2663/3598) Updating files: 75% (2699/3598) Updating files: 76% (2735/3598) Updating files: 77% (2771/3598) Updating files: 78% (2807/3598) Updating files: 79% (2843/3598) Updating files: 80% (2879/3598) Updating files: 81% (2915/3598) Updating files: 82% (2951/3598) Updating files: 83% (2987/3598) Updating files: 83% (3008/3598) Updating files: 84% (3023/3598) Updating files: 85% (3059/3598) Updating files: 86% (3095/3598) Updating files: 87% (3131/3598) Updating files: 88% (3167/3598) Updating files: 89% (3203/3598) Updating files: 90% (3239/3598) Updating files: 91% (3275/3598) Updating files: 92% (3311/3598) Updating files: 93% (3347/3598) Updating files: 94% (3383/3598) Updating files: 95% (3419/3598) Updating files: 96% (3455/3598) Updating files: 97% (3491/3598) Updating files: 98% (3527/3598) Updating files: 99% (3563/3598) Updating files: 100% (3598/3598) Updating files: 100% (3598/3598), done. 2024-04-02T07:07:46.269 INFO:teuthology.orchestra.run.smithi055.stdout:HEAD is now at e068ccf0 Merge branch 'robot/pr-0-1711100280' into 'main' 2024-04-02T07:07:46.291 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.a... 2024-04-02T07:07:46.291 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-04-02T07:07:46.539 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g1df0c7e8a235/ 2024-04-02T07:07:46.539 DEBUG:teuthology.orchestra.run.smithi055:> rm -f /tmp/linux-image.deb && echo linux-image-6.8.0-g1df0c7e8a235_6.8.0-g1df0c7e8a235-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://4.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g1df0c7e8a235/ --input-file=- 2024-04-02T07:07:46.542 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi055.front.sepia.ceph.com to complete... 2024-04-02T07:07:46.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02 07:07:46 URL:https://4.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g1df0c7e8a235/linux-image-6.8.0-g1df0c7e8a235_6.8.0-g1df0c7e8a235-1_amd64.deb [39278344/39278344] -> "/tmp/linux-image.deb" [1] 2024-04-02T07:07:46.769 INFO:teuthology.orchestra.run.smithi106.stderr:FINISHED --2024-04-02 07:07:46-- 2024-04-02T07:07:46.769 INFO:teuthology.orchestra.run.smithi106.stderr:Total wall clock time: 1.8s 2024-04-02T07:07:46.769 INFO:teuthology.orchestra.run.smithi106.stderr:Downloaded: 1 files, 37M in 1.7s (22.6 MB/s) 2024-04-02T07:07:46.774 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.b... 2024-04-02T07:07:46.774 DEBUG:teuthology.orchestra.run.smithi106:> sudo dpkg -i /tmp/linux-image.deb 2024-04-02T07:07:47.047 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-image-6.8.0-g1df0c7e8a235. 2024-04-02T07:07:48.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02 07:07:48 URL:https://4.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/ubuntu/jammy/flavors/default/pool/main/l/linux-6.8.0-g1df0c7e8a235/linux-image-6.8.0-g1df0c7e8a235_6.8.0-g1df0c7e8a235-1_amd64.deb [39278344/39278344] -> "/tmp/linux-image.deb" [1] 2024-04-02T07:07:48.556 INFO:teuthology.orchestra.run.smithi055.stderr:FINISHED --2024-04-02 07:07:48-- 2024-04-02T07:07:48.556 INFO:teuthology.orchestra.run.smithi055.stderr:Total wall clock time: 2.0s 2024-04-02T07:07:48.556 INFO:teuthology.orchestra.run.smithi055.stderr:Downloaded: 1 files, 37M in 1.8s (21.2 MB/s) 2024-04-02T07:07:48.561 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.a... 2024-04-02T07:07:48.561 DEBUG:teuthology.orchestra.run.smithi055:> sudo dpkg -i /tmp/linux-image.deb 2024-04-02T07:07:48.853 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package linux-image-6.8.0-g1df0c7e8a235. 2024-04-02T07:07:49.051 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-02T07:07:49.056 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-02T07:07:49.148 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-image-6.8.0-g1df0c7e8a235 (6.8.0-g1df0c7e8a235-1) ... 2024-04-02T07:07:50.892 INFO:teuthology.orchestra.run.smithi055.stdout:(Reading database ... 129542 files and directories currently installed.) 2024-04-02T07:07:50.897 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack /tmp/linux-image.deb ... 2024-04-02T07:07:50.990 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking linux-image-6.8.0-g1df0c7e8a235 (6.8.0-g1df0c7e8a235-1) ... 2024-04-02T07:07:52.437 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-image-6.8.0-g1df0c7e8a235 (6.8.0-g1df0c7e8a235-1) ... 2024-04-02T07:07:52.540 INFO:teuthology.orchestra.run.smithi106.stderr:update-initramfs: Generating /boot/initrd.img-6.8.0-g1df0c7e8a235 2024-04-02T07:07:54.520 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up linux-image-6.8.0-g1df0c7e8a235 (6.8.0-g1df0c7e8a235-1) ... 2024-04-02T07:07:54.625 INFO:teuthology.orchestra.run.smithi055.stderr:update-initramfs: Generating /boot/initrd.img-6.8.0-g1df0c7e8a235 2024-04-02T07:08:13.923 INFO:teuthology.orchestra.run.smithi106.stderr:Sourcing file `/etc/default/grub' 2024-04-02T07:08:13.936 INFO:teuthology.orchestra.run.smithi106.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-02T07:08:13.978 INFO:teuthology.orchestra.run.smithi106.stderr:Generating grub configuration file ... 2024-04-02T07:08:14.271 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-6.8.0-g1df0c7e8a235 2024-04-02T07:08:14.296 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-6.8.0-g1df0c7e8a235 2024-04-02T07:08:14.553 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-02T07:08:14.564 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-02T07:08:14.626 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-02T07:08:14.632 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-02T07:08:14.763 INFO:teuthology.orchestra.run.smithi106.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-02T07:08:14.763 INFO:teuthology.orchestra.run.smithi106.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-02T07:08:14.763 INFO:teuthology.orchestra.run.smithi106.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-02T07:08:14.804 INFO:teuthology.orchestra.run.smithi106.stderr:done 2024-04-02T07:08:14.963 DEBUG:teuthology.orchestra.run.smithi106:> dpkg-deb -c /tmp/linux-image.deb 2024-04-02T07:08:14.970 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./ 2024-04-02T07:08:14.971 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./boot/ 2024-04-02T07:08:14.971 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 4474334 2024-03-25 03:29 ./boot/System.map-6.8.0-g1df0c7e8a235 2024-04-02T07:08:14.983 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 170899 2024-03-25 03:29 ./boot/config-6.8.0-g1df0c7e8a235 2024-04-02T07:08:14.983 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11551744 2024-03-25 03:29 ./boot/vmlinuz-6.8.0-g1df0c7e8a235 2024-04-02T07:08:15.002 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./etc/ 2024-04-02T07:08:15.002 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./etc/kernel/ 2024-04-02T07:08:15.002 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./etc/kernel/postinst.d/ 2024-04-02T07:08:15.002 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./etc/kernel/postrm.d/ 2024-04-02T07:08:15.002 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./etc/kernel/preinst.d/ 2024-04-02T07:08:15.003 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./etc/kernel/prerm.d/ 2024-04-02T07:08:15.003 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/ 2024-04-02T07:08:15.003 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/ 2024-04-02T07:08:15.003 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/ 2024-04-02T07:08:15.003 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/ 2024-04-02T07:08:15.003 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/ 2024-04-02T07:08:15.003 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/ 2024-04-02T07:08:15.003 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ 2024-04-02T07:08:15.003 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 490441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-02T07:08:15.006 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-02T07:08:15.006 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-02T07:08:15.006 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-02T07:08:15.006 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 93073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-02T07:08:15.006 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 106689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-02T07:08:15.006 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 152137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-02T07:08:15.006 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-02T07:08:15.006 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-02T07:08:15.006 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 83849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-02T07:08:15.006 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-02T07:08:15.006 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-02T07:08:15.006 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-02T07:08:15.007 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 51689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-02T07:08:15.007 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-02T07:08:15.007 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-02T07:08:15.007 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 58481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-02T07:08:15.007 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-02T07:08:15.007 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-02T07:08:15.007 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-02T07:08:15.007 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/ 2024-04-02T07:08:15.007 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/ 2024-04-02T07:08:15.007 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/ 2024-04-02T07:08:15.007 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-02T07:08:15.007 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpuid.ko 2024-04-02T07:08:15.007 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/msr.ko 2024-04-02T07:08:15.008 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/ 2024-04-02T07:08:15.008 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 354225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-02T07:08:15.008 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 886129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-02T07:08:15.008 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 2294793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-04-02T07:08:15.020 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ 2024-04-02T07:08:15.020 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 53833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/af_alg.ko 2024-04-02T07:08:15.021 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/algif_hash.ko 2024-04-02T07:08:15.021 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/algif_skcipher.ko 2024-04-02T07:08:15.021 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-04-02T07:08:15.021 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-04-02T07:08:15.021 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-04-02T07:08:15.021 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/asymmetric_keys/ 2024-04-02T07:08:15.021 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-02T07:08:15.021 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/ 2024-04-02T07:08:15.021 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-04-02T07:08:15.021 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-04-02T07:08:15.021 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-02T07:08:15.021 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-04-02T07:08:15.022 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-04-02T07:08:15.022 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-04-02T07:08:15.022 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-04-02T07:08:15.022 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-04-02T07:08:15.022 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-04-02T07:08:15.022 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-04-02T07:08:15.022 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-04-02T07:08:15.022 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-04-02T07:08:15.022 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-04-02T07:08:15.022 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-04-02T07:08:15.022 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-04-02T07:08:15.022 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-04-02T07:08:15.022 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-04-02T07:08:15.023 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-04-02T07:08:15.023 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cryptd.ko 2024-04-02T07:08:15.023 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-04-02T07:08:15.023 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_simd.ko 2024-04-02T07:08:15.023 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-04-02T07:08:15.023 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-04-02T07:08:15.023 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-04-02T07:08:15.023 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-04-02T07:08:15.023 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-04-02T07:08:15.023 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-04-02T07:08:15.023 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-04-02T07:08:15.023 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-04-02T07:08:15.023 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lrw.ko 2024-04-02T07:08:15.023 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-04-02T07:08:15.024 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-04-02T07:08:15.024 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-04-02T07:08:15.024 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-04-02T07:08:15.024 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-04-02T07:08:15.024 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-04-02T07:08:15.024 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-04-02T07:08:15.024 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-04-02T07:08:15.024 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-04-02T07:08:15.024 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 143025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-04-02T07:08:15.024 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-04-02T07:08:15.024 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-04-02T07:08:15.024 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-04-02T07:08:15.024 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-04-02T07:08:15.025 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-04-02T07:08:15.025 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-04-02T07:08:15.025 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-04-02T07:08:15.025 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xts.ko 2024-04-02T07:08:15.025 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-04-02T07:08:15.025 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ 2024-04-02T07:08:15.025 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ 2024-04-02T07:08:15.025 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_extlog.ko 2024-04-02T07:08:15.025 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-02T07:08:15.025 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-04-02T07:08:15.025 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/apei/ 2024-04-02T07:08:15.025 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/apei/einj.ko 2024-04-02T07:08:15.025 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-04-02T07:08:15.025 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-04-02T07:08:15.026 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-04-02T07:08:15.026 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-04-02T07:08:15.026 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 104417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-04-02T07:08:15.026 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ 2024-04-02T07:08:15.026 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-04-02T07:08:15.026 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 89929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci.ko 2024-04-02T07:08:15.026 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-04-02T07:08:15.026 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 88305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci.ko 2024-04-02T07:08:15.026 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-04-02T07:08:15.026 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-04-02T07:08:15.026 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-04-02T07:08:15.026 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-04-02T07:08:15.026 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-04-02T07:08:15.027 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-04-02T07:08:15.027 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-04-02T07:08:15.027 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-04-02T07:08:15.027 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-04-02T07:08:15.027 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-04-02T07:08:15.027 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-04-02T07:08:15.027 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-04-02T07:08:15.027 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-04-02T07:08:15.027 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-02T07:08:15.027 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-02T07:08:15.027 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-04-02T07:08:15.027 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-04-02T07:08:15.027 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-04-02T07:08:15.027 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 52169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_legacy.ko 2024-04-02T07:08:15.028 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-04-02T07:08:15.028 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-04-02T07:08:15.028 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-04-02T07:08:15.028 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-04-02T07:08:15.028 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-04-02T07:08:15.028 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-04-02T07:08:15.028 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-04-02T07:08:15.028 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-04-02T07:08:15.028 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-04-02T07:08:15.028 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-04-02T07:08:15.028 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-02T07:08:15.028 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-02T07:08:15.029 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-04-02T07:08:15.029 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_radisys.ko 2024-04-02T07:08:15.029 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-04-02T07:08:15.029 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rz1000.ko 2024-04-02T07:08:15.029 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-04-02T07:08:15.029 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-04-02T07:08:15.029 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-04-02T07:08:15.029 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-04-02T07:08:15.029 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-04-02T07:08:15.029 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-04-02T07:08:15.029 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-04-02T07:08:15.029 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-04-02T07:08:15.029 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 83249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-04-02T07:08:15.029 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 70297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-04-02T07:08:15.030 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-04-02T07:08:15.030 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-04-02T07:08:15.030 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-04-02T07:08:15.030 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-04-02T07:08:15.030 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-04-02T07:08:15.030 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-04-02T07:08:15.030 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-04-02T07:08:15.030 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-04-02T07:08:15.030 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-04-02T07:08:15.030 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-04-02T07:08:15.030 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ 2024-04-02T07:08:15.030 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-04-02T07:08:15.030 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/ 2024-04-02T07:08:15.031 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 124385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-04-02T07:08:15.031 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/ 2024-04-02T07:08:15.031 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/ 2024-04-02T07:08:15.031 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 113801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-04-02T07:08:15.031 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/ 2024-04-02T07:08:15.031 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 964745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-04-02T07:08:15.087 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 169697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-04-02T07:08:15.087 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/ 2024-04-02T07:08:15.087 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 94209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-02T07:08:15.087 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 116329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-04-02T07:08:15.087 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/ 2024-04-02T07:08:15.087 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 110321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-04-02T07:08:15.087 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 98185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-04-02T07:08:15.087 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 263633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-04-02T07:08:15.087 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/ 2024-04-02T07:08:15.087 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 98105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-02T07:08:15.087 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/ 2024-04-02T07:08:15.087 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 58761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-04-02T07:08:15.088 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ 2024-04-02T07:08:15.088 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/applicom.ko 2024-04-02T07:08:15.088 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-04-02T07:08:15.088 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/ 2024-04-02T07:08:15.088 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-02T07:08:15.088 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-02T07:08:15.088 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-02T07:08:15.088 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-04-02T07:08:15.088 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-02T07:08:15.088 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ 2024-04-02T07:08:15.088 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-02T07:08:15.088 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 148513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-02T07:08:15.088 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-02T07:08:15.089 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 139305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-02T07:08:15.089 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 70865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-02T07:08:15.089 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 53409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-02T07:08:15.089 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-04-02T07:08:15.089 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/ 2024-04-02T07:08:15.089 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 84001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-04-02T07:08:15.089 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/nvram.ko 2024-04-02T07:08:15.089 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-04-02T07:08:15.089 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 51017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-04-02T07:08:15.089 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/ 2024-04-02T07:08:15.089 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-02T07:08:15.089 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-02T07:08:15.089 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-02T07:08:15.090 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-02T07:08:15.090 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-02T07:08:15.090 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-02T07:08:15.090 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-02T07:08:15.090 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/xillybus/ 2024-04-02T07:08:15.090 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-02T07:08:15.090 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-02T07:08:15.090 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-02T07:08:15.090 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/clk/ 2024-04-02T07:08:15.090 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/clk/clk-palmas.ko 2024-04-02T07:08:15.090 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/clk/clk-si5351.ko 2024-04-02T07:08:15.090 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/clk/clk-twl6040.ko 2024-04-02T07:08:15.091 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/clk/clk-wm831x.ko 2024-04-02T07:08:15.091 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/ 2024-04-02T07:08:15.091 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-02T07:08:15.091 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-02T07:08:15.091 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-02T07:08:15.091 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ 2024-04-02T07:08:15.091 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ 2024-04-02T07:08:15.091 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 70425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-02T07:08:15.091 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 246777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-04-02T07:08:15.091 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/ 2024-04-02T07:08:15.091 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/ 2024-04-02T07:08:15.091 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-02T07:08:15.091 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 570217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-02T07:08:15.091 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-02T07:08:15.091 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-02T07:08:15.092 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-04-02T07:08:15.092 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-04-02T07:08:15.092 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/ 2024-04-02T07:08:15.092 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 70409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-02T07:08:15.092 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/ 2024-04-02T07:08:15.092 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-04-02T07:08:15.092 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ 2024-04-02T07:08:15.092 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/ 2024-04-02T07:08:15.092 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-02T07:08:15.092 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ 2024-04-02T07:08:15.092 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 122793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-02T07:08:15.092 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ 2024-04-02T07:08:15.092 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 80297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-04-02T07:08:15.093 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-04-02T07:08:15.093 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-04-02T07:08:15.093 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-04-02T07:08:15.093 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-04-02T07:08:15.093 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-04-02T07:08:15.093 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-04-02T07:08:15.093 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-04-02T07:08:15.093 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 51937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-04-02T07:08:15.093 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-04-02T07:08:15.093 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-04-02T07:08:15.093 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 56729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-04-02T07:08:15.093 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-04-02T07:08:15.094 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/ 2024-04-02T07:08:15.094 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-gpio.ko 2024-04-02T07:08:15.094 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-max14577.ko 2024-04-02T07:08:15.094 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-max77693.ko 2024-04-02T07:08:15.094 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-max8997.ko 2024-04-02T07:08:15.094 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-palmas.ko 2024-04-02T07:08:15.094 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-02T07:08:15.094 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-02T07:08:15.094 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/ 2024-04-02T07:08:15.094 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-02T07:08:15.094 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/efi/ 2024-04-02T07:08:15.094 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-02T07:08:15.094 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-02T07:08:15.095 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/ 2024-04-02T07:08:15.095 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-02T07:08:15.095 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-02T07:08:15.095 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-arizona.ko 2024-04-02T07:08:15.095 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-da9052.ko 2024-04-02T07:08:15.095 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-da9055.ko 2024-04-02T07:08:15.095 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-dln2.ko 2024-04-02T07:08:15.095 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 77745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-02T07:08:15.095 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-generic.ko 2024-04-02T07:08:15.095 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-04-02T07:08:15.095 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-02T07:08:15.095 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-kempld.ko 2024-04-02T07:08:15.095 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-02T07:08:15.095 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-max7300.ko 2024-04-02T07:08:15.095 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-max730x.ko 2024-04-02T07:08:15.096 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-max732x.ko 2024-04-02T07:08:15.096 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-02T07:08:15.096 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-02T07:08:15.096 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-02T07:08:15.096 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-02T07:08:15.096 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-sch.ko 2024-04-02T07:08:15.096 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-02T07:08:15.096 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-02T07:08:15.096 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-02T07:08:15.096 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-02T07:08:15.096 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-02T07:08:15.096 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-vx855.ko 2024-04-02T07:08:15.096 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-02T07:08:15.097 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-02T07:08:15.097 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-02T07:08:15.097 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/ 2024-04-02T07:08:15.097 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-a4tech.ko 2024-04-02T07:08:15.097 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-apple.ko 2024-04-02T07:08:15.097 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-04-02T07:08:15.097 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-04-02T07:08:15.097 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-04-02T07:08:15.097 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-belkin.ko 2024-04-02T07:08:15.097 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-cherry.ko 2024-04-02T07:08:15.097 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-chicony.ko 2024-04-02T07:08:15.097 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 60657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-cp2112.ko 2024-04-02T07:08:15.097 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-cypress.ko 2024-04-02T07:08:15.097 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-04-02T07:08:15.098 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-04-02T07:08:15.098 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-04-02T07:08:15.098 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-04-02T07:08:15.098 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ezkey.ko 2024-04-02T07:08:15.098 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-04-02T07:08:15.098 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-generic.ko 2024-04-02T07:08:15.098 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-04-02T07:08:15.098 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-04-02T07:08:15.098 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-02T07:08:15.098 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-02T07:08:15.098 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-04-02T07:08:15.098 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-04-02T07:08:15.098 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-04-02T07:08:15.099 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kensington.ko 2024-04-02T07:08:15.099 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-04-02T07:08:15.099 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-04-02T07:08:15.099 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-04-02T07:08:15.099 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-04-02T07:08:15.099 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-04-02T07:08:15.099 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lg-g15.ko 2024-04-02T07:08:15.099 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 57969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-02T07:08:15.099 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 101537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-02T07:08:15.099 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 80897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech.ko 2024-04-02T07:08:15.099 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-magicmouse.ko 2024-04-02T07:08:15.099 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-microsoft.ko 2024-04-02T07:08:15.099 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-monterey.ko 2024-04-02T07:08:15.100 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-04-02T07:08:15.100 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ntrig.ko 2024-04-02T07:08:15.100 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-04-02T07:08:15.100 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-04-02T07:08:15.100 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-04-02T07:08:15.100 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 72841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-04-02T07:08:15.100 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-04-02T07:08:15.100 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-04-02T07:08:15.100 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-04-02T07:08:15.100 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-04-02T07:08:15.100 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-02T07:08:15.100 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-04-02T07:08:15.100 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-02T07:08:15.100 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-02T07:08:15.101 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-02T07:08:15.101 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-02T07:08:15.101 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-02T07:08:15.101 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-02T07:08:15.101 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-02T07:08:15.101 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-02T07:08:15.101 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-02T07:08:15.101 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-04-02T07:08:15.101 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-04-02T07:08:15.101 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-04-02T07:08:15.101 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-02T07:08:15.101 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-04-02T07:08:15.101 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 51153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-04-02T07:08:15.101 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-04-02T07:08:15.102 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-04-02T07:08:15.102 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-04-02T07:08:15.102 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-02T07:08:15.102 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-04-02T07:08:15.102 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-04-02T07:08:15.102 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-04-02T07:08:15.102 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-04-02T07:08:15.102 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 70977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-04-02T07:08:15.102 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-04-02T07:08:15.102 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 143377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-04-02T07:08:15.102 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-04-02T07:08:15.102 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-04-02T07:08:15.102 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-04-02T07:08:15.103 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 269209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid.ko 2024-04-02T07:08:15.103 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-04-02T07:08:15.103 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/usbhid/ 2024-04-02T07:08:15.103 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 125625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-02T07:08:15.103 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-02T07:08:15.103 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-02T07:08:15.103 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 218865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-04-02T07:08:15.103 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/ 2024-04-02T07:08:15.103 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 64297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-04-02T07:08:15.103 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 90089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-04-02T07:08:15.103 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 304913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-04-02T07:08:15.103 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ 2024-04-02T07:08:15.103 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 66793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-04-02T07:08:15.103 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 61809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-04-02T07:08:15.104 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-02T07:08:15.104 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-04-02T07:08:15.104 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-04-02T07:08:15.104 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-04-02T07:08:15.104 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-04-02T07:08:15.104 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 97881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-04-02T07:08:15.104 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-04-02T07:08:15.104 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 45457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-04-02T07:08:15.104 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-04-02T07:08:15.104 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-04-02T07:08:15.104 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-04-02T07:08:15.104 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-04-02T07:08:15.104 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 74313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-04-02T07:08:15.105 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-04-02T07:08:15.105 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 69305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-04-02T07:08:15.105 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-04-02T07:08:15.105 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-04-02T07:08:15.105 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-04-02T07:08:15.105 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-04-02T07:08:15.105 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 58521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-04-02T07:08:15.105 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-02T07:08:15.105 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-04-02T07:08:15.105 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-04-02T07:08:15.105 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-02T07:08:15.105 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-02T07:08:15.105 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-02T07:08:15.105 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 99505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-04-02T07:08:15.106 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-04-02T07:08:15.106 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-04-02T07:08:15.106 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-04-02T07:08:15.106 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc2103.ko 2024-04-02T07:08:15.106 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-04-02T07:08:15.106 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 66889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-04-02T07:08:15.106 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 94593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-04-02T07:08:15.106 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-04-02T07:08:15.106 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-04-02T07:08:15.106 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-04-02T07:08:15.106 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-04-02T07:08:15.106 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-04-02T07:08:15.106 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 46705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-04-02T07:08:15.106 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 45433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-04-02T07:08:15.107 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hih6130.ko 2024-04-02T07:08:15.107 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-02T07:08:15.107 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-04-02T07:08:15.107 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-04-02T07:08:15.107 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-04-02T07:08:15.107 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-04-02T07:08:15.107 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-04-02T07:08:15.107 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-04-02T07:08:15.107 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 140129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-04-02T07:08:15.107 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/jc42.ko 2024-04-02T07:08:15.107 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-04-02T07:08:15.107 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-04-02T07:08:15.107 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-04-02T07:08:15.108 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 48505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-04-02T07:08:15.108 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-04-02T07:08:15.108 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-04-02T07:08:15.108 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-04-02T07:08:15.108 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-04-02T07:08:15.108 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-04-02T07:08:15.108 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-04-02T07:08:15.108 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 72737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-04-02T07:08:15.108 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 46057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-04-02T07:08:15.108 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-04-02T07:08:15.108 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-04-02T07:08:15.108 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 108745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-04-02T07:08:15.108 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-04-02T07:08:15.109 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-04-02T07:08:15.109 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-04-02T07:08:15.109 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-04-02T07:08:15.109 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-04-02T07:08:15.109 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-04-02T07:08:15.109 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-04-02T07:08:15.109 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-04-02T07:08:15.109 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-04-02T07:08:15.109 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-04-02T07:08:15.109 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-04-02T07:08:15.109 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-04-02T07:08:15.109 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-04-02T07:08:15.109 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-04-02T07:08:15.109 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-04-02T07:08:15.110 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-04-02T07:08:15.110 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-04-02T07:08:15.110 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-02T07:08:15.110 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-04-02T07:08:15.110 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-02T07:08:15.110 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-04-02T07:08:15.110 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 119841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-04-02T07:08:15.110 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 61433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-04-02T07:08:15.110 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-04-02T07:08:15.110 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 82713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-04-02T07:08:15.110 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 54337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-04-02T07:08:15.110 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-04-02T07:08:15.111 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ 2024-04-02T07:08:15.111 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-02T07:08:15.111 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-02T07:08:15.111 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-02T07:08:15.111 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-02T07:08:15.111 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-02T07:08:15.111 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-02T07:08:15.111 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-02T07:08:15.111 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 82473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-02T07:08:15.111 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-02T07:08:15.111 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-02T07:08:15.111 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-02T07:08:15.111 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-02T07:08:15.111 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-04-02T07:08:15.112 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-04-02T07:08:15.112 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-04-02T07:08:15.112 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-02T07:08:15.112 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-04-02T07:08:15.112 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-04-02T07:08:15.112 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-04-02T07:08:15.112 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-04-02T07:08:15.112 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-04-02T07:08:15.112 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-04-02T07:08:15.112 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-04-02T07:08:15.112 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-04-02T07:08:15.112 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-04-02T07:08:15.112 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-04-02T07:08:15.112 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-04-02T07:08:15.113 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-04-02T07:08:15.113 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-04-02T07:08:15.113 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-04-02T07:08:15.113 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 52361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-04-02T07:08:15.113 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 53201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-04-02T07:08:15.113 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 58257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-04-02T07:08:15.113 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 79833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-04-02T07:08:15.113 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 71249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-04-02T07:08:15.113 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 63129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-04-02T07:08:15.113 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 71225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-04-02T07:08:15.113 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 101377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-04-02T07:08:15.113 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 119409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-04-02T07:08:15.113 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-04-02T07:08:15.114 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-04-02T07:08:15.114 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-02T07:08:15.114 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-02T07:08:15.114 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/ 2024-04-02T07:08:15.114 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/ 2024-04-02T07:08:15.114 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-02T07:08:15.114 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-02T07:08:15.114 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/ 2024-04-02T07:08:15.114 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-02T07:08:15.114 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-02T07:08:15.114 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-02T07:08:15.114 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-02T07:08:15.114 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-02T07:08:15.115 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-02T07:08:15.115 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-02T07:08:15.115 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 6825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-02T07:08:15.115 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-02T07:08:15.115 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-02T07:08:15.115 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-02T07:08:15.115 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-02T07:08:15.115 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-02T07:08:15.115 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-02T07:08:15.115 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-02T07:08:15.115 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 67681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-02T07:08:15.115 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-02T07:08:15.115 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-02T07:08:15.115 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-02T07:08:15.116 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-02T07:08:15.116 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-02T07:08:15.116 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-02T07:08:15.116 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-02T07:08:15.116 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-02T07:08:15.116 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-02T07:08:15.116 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-02T07:08:15.116 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-02T07:08:15.116 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-02T07:08:15.116 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-02T07:08:15.116 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-02T07:08:15.116 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-02T07:08:15.116 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-02T07:08:15.116 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-02T07:08:15.117 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-02T07:08:15.117 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-02T07:08:15.117 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-02T07:08:15.117 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-02T07:08:15.117 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-04-02T07:08:15.117 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-04-02T07:08:15.117 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-04-02T07:08:15.117 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/muxes/ 2024-04-02T07:08:15.117 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-02T07:08:15.117 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-02T07:08:15.117 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-02T07:08:15.117 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ 2024-04-02T07:08:15.117 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ 2024-04-02T07:08:15.117 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 273513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-02T07:08:15.118 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 883777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-04-02T07:08:15.118 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 69177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-02T07:08:15.118 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 324233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-02T07:08:15.118 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 97825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-02T07:08:15.118 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 282329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-02T07:08:15.118 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 66049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-02T07:08:15.118 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/ 2024-04-02T07:08:15.118 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-02T07:08:15.118 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 493129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-02T07:08:15.118 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/ 2024-04-02T07:08:15.118 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 420529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-02T07:08:15.118 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/ 2024-04-02T07:08:15.118 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 741609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-02T07:08:15.119 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ 2024-04-02T07:08:15.119 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 296785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-02T07:08:15.119 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-02T07:08:15.119 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 153705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-02T07:08:15.119 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/usnic/ 2024-04-02T07:08:15.119 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 169089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-02T07:08:15.119 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ 2024-04-02T07:08:15.119 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-02T07:08:15.119 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 266529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-02T07:08:15.119 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ 2024-04-02T07:08:15.119 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 100257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-02T07:08:15.119 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ 2024-04-02T07:08:15.119 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 111329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-02T07:08:15.119 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ 2024-04-02T07:08:15.120 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 128657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-02T07:08:15.120 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ 2024-04-02T07:08:15.120 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 129793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-02T07:08:15.120 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/ 2024-04-02T07:08:15.120 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/evbug.ko 2024-04-02T07:08:15.120 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/ff-memless.ko 2024-04-02T07:08:15.120 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/ 2024-04-02T07:08:15.120 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-02T07:08:15.120 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-02T07:08:15.120 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-04-02T07:08:15.120 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-04-02T07:08:15.120 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/ 2024-04-02T07:08:15.120 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-02T07:08:15.121 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-02T07:08:15.121 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-02T07:08:15.121 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-02T07:08:15.121 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-02T07:08:15.121 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-02T07:08:15.121 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-02T07:08:15.121 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/lm8323.ko 2024-04-02T07:08:15.121 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/lm8333.ko 2024-04-02T07:08:15.121 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-02T07:08:15.121 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-02T07:08:15.121 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-02T07:08:15.121 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-02T07:08:15.121 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-02T07:08:15.122 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-02T07:08:15.122 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/qt1070.ko 2024-04-02T07:08:15.122 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/qt2160.ko 2024-04-02T07:08:15.122 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-02T07:08:15.122 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/stowaway.ko 2024-04-02T07:08:15.122 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-02T07:08:15.122 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-02T07:08:15.122 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-02T07:08:15.122 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-02T07:08:15.122 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-02T07:08:15.122 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/matrix-keymap.ko 2024-04-02T07:08:15.122 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/ 2024-04-02T07:08:15.122 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-04-02T07:08:15.123 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-04-02T07:08:15.123 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 123177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-04-02T07:08:15.123 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 89377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-02T07:08:15.123 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-02T07:08:15.123 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 335857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/psmouse.ko 2024-04-02T07:08:15.123 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-04-02T07:08:15.123 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-02T07:08:15.123 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-02T07:08:15.123 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-02T07:08:15.123 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/ 2024-04-02T07:08:15.123 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 109553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-02T07:08:15.123 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/ 2024-04-02T07:08:15.123 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-04-02T07:08:15.124 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-04-02T07:08:15.124 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/ct82c710.ko 2024-04-02T07:08:15.124 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-02T07:08:15.124 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/parkbd.ko 2024-04-02T07:08:15.124 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/pcips2.ko 2024-04-02T07:08:15.124 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/ps2mult.ko 2024-04-02T07:08:15.124 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-04-02T07:08:15.124 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serport.ko 2024-04-02T07:08:15.124 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-04-02T07:08:15.124 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/ 2024-04-02T07:08:15.124 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-88pm860x.ko 2024-04-02T07:08:15.124 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-adp5520.ko 2024-04-02T07:08:15.124 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-bd2802.ko 2024-04-02T07:08:15.124 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-04-02T07:08:15.124 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-da903x.ko 2024-04-02T07:08:15.125 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-da9052.ko 2024-04-02T07:08:15.125 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-gpio.ko 2024-04-02T07:08:15.125 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-04-02T07:08:15.125 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3533.ko 2024-04-02T07:08:15.125 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm355x.ko 2024-04-02T07:08:15.125 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3642.ko 2024-04-02T07:08:15.125 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-04-02T07:08:15.125 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp8788.ko 2024-04-02T07:08:15.125 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-max8997.ko 2024-04-02T07:08:15.125 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-mc13783.ko 2024-04-02T07:08:15.125 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-02T07:08:15.125 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-pca9532.ko 2024-04-02T07:08:15.125 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-pca955x.ko 2024-04-02T07:08:15.126 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-pca963x.ko 2024-04-02T07:08:15.126 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-04-02T07:08:15.126 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-tca6507.ko 2024-04-02T07:08:15.126 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-02T07:08:15.126 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-wm8350.ko 2024-04-02T07:08:15.126 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ 2024-04-02T07:08:15.126 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-02T07:08:15.126 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-02T07:08:15.126 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-02T07:08:15.126 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-02T07:08:15.126 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-02T07:08:15.126 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-02T07:08:15.126 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-02T07:08:15.127 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-02T07:08:15.127 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-02T07:08:15.127 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/ 2024-04-02T07:08:15.127 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/ 2024-04-02T07:08:15.127 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 647033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-04-02T07:08:15.127 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-04-02T07:08:15.127 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 93313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bufio.ko 2024-04-02T07:08:15.127 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-04-02T07:08:15.127 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 155801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-04-02T07:08:15.127 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 107929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-04-02T07:08:15.127 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-04-02T07:08:15.127 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 53761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-era.ko 2024-04-02T07:08:15.127 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-04-02T07:08:15.127 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-04-02T07:08:15.128 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log.ko 2024-04-02T07:08:15.128 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-mirror.ko 2024-04-02T07:08:15.128 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 77865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-04-02T07:08:15.128 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-04-02T07:08:15.128 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 70977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-04-02T07:08:15.128 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-region-hash.ko 2024-04-02T07:08:15.128 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-04-02T07:08:15.128 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-04-02T07:08:15.128 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 109433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-snapshot.ko 2024-04-02T07:08:15.128 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-04-02T07:08:15.128 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 181761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-04-02T07:08:15.128 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 53729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-04-02T07:08:15.128 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-zero.ko 2024-04-02T07:08:15.128 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/ 2024-04-02T07:08:15.129 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 199825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-02T07:08:15.129 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-04-02T07:08:15.129 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 100833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-04-02T07:08:15.129 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 126361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-04-02T07:08:15.129 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 368481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-04-02T07:08:15.129 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/ 2024-04-02T07:08:15.129 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/ 2024-04-02T07:08:15.129 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 178041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-04-02T07:08:15.129 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 63233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-04-02T07:08:15.129 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 46241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-04-02T07:08:15.129 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-04-02T07:08:15.129 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 123225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-04-02T07:08:15.129 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 80913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-04-02T07:08:15.129 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 52857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-04-02T07:08:15.129 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/ 2024-04-02T07:08:15.130 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/88pm800.ko 2024-04-02T07:08:15.130 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/88pm805.ko 2024-04-02T07:08:15.130 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/88pm80x.ko 2024-04-02T07:08:15.130 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/arizona-i2c.ko 2024-04-02T07:08:15.130 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 123625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/arizona.ko 2024-04-02T07:08:15.130 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/bcm590xx.ko 2024-04-02T07:08:15.130 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-02T07:08:15.130 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/dln2.ko 2024-04-02T07:08:15.130 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/janz-cmodio.ko 2024-04-02T07:08:15.130 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 53481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/kempld-core.ko 2024-04-02T07:08:15.130 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lm3533-core.ko 2024-04-02T07:08:15.130 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-02T07:08:15.130 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lp3943.ko 2024-04-02T07:08:15.131 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 56961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-04-02T07:08:15.131 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-04-02T07:08:15.131 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/max8907.ko 2024-04-02T07:08:15.131 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-02T07:08:15.131 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-02T07:08:15.131 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/menf21bmc.ko 2024-04-02T07:08:15.131 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-02T07:08:15.131 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-02T07:08:15.131 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/pcf50633.ko 2024-04-02T07:08:15.131 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-02T07:08:15.131 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/retu-mfd.ko 2024-04-02T07:08:15.131 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 80329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/si476x-core.ko 2024-04-02T07:08:15.131 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 48361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-04-02T07:08:15.131 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 51201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/tps65010.ko 2024-04-02T07:08:15.132 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/tps6507x.ko 2024-04-02T07:08:15.132 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-04-02T07:08:15.132 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-04-02T07:08:15.132 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-04-02T07:08:15.132 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wm8994.ko 2024-04-02T07:08:15.132 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ 2024-04-02T07:08:15.132 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-02T07:08:15.132 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 48385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ad525x_dpot.ko 2024-04-02T07:08:15.132 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/ 2024-04-02T07:08:15.132 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 46489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-02T07:08:15.132 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-04-02T07:08:15.132 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-04-02T07:08:15.132 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 45489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-04-02T07:08:15.132 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/c2port/ 2024-04-02T07:08:15.133 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-02T07:08:15.133 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/c2port/core.ko 2024-04-02T07:08:15.133 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/ 2024-04-02T07:08:15.133 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-04-02T07:08:15.133 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ds1682.ko 2024-04-02T07:08:15.133 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/dummy-irq.ko 2024-04-02T07:08:15.133 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/echo/ 2024-04-02T07:08:15.133 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/echo/echo.ko 2024-04-02T07:08:15.133 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/ 2024-04-02T07:08:15.133 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-04-02T07:08:15.133 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-02T07:08:15.133 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-04-02T07:08:15.133 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-04-02T07:08:15.133 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/genwqe/ 2024-04-02T07:08:15.134 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 152041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-02T07:08:15.134 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hmc6352.ko 2024-04-02T07:08:15.134 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-04-02T07:08:15.134 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ibmasm/ 2024-04-02T07:08:15.134 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 72505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-02T07:08:15.134 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ics932s401.ko 2024-04-02T07:08:15.134 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-04-02T07:08:15.134 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-04-02T07:08:15.134 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/ 2024-04-02T07:08:15.134 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-02T07:08:15.134 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-02T07:08:15.134 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/ 2024-04-02T07:08:15.134 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 126137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-04-02T07:08:15.135 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 56361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-04-02T07:08:15.135 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 313545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-04-02T07:08:15.135 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/phantom.ko 2024-04-02T07:08:15.135 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ti-st/ 2024-04-02T07:08:15.135 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 74289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-02T07:08:15.135 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-04-02T07:08:15.135 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-04-02T07:08:15.135 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-04-02T07:08:15.135 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 48337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-04-02T07:08:15.135 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/ 2024-04-02T07:08:15.135 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 183513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-02T07:08:15.135 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ 2024-04-02T07:08:15.135 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/ 2024-04-02T07:08:15.135 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 491561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-04-02T07:08:15.136 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/ 2024-04-02T07:08:15.136 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/ 2024-04-02T07:08:15.136 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 105929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-02T07:08:15.136 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-02T07:08:15.136 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-02T07:08:15.136 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-02T07:08:15.136 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 458905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-02T07:08:15.136 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-04-02T07:08:15.136 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-04-02T07:08:15.136 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ 2024-04-02T07:08:15.136 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/ 2024-04-02T07:08:15.136 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 45953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-02T07:08:15.136 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-02T07:08:15.136 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 130657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-02T07:08:15.137 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 68777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-02T07:08:15.137 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ 2024-04-02T07:08:15.137 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-02T07:08:15.137 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 64609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-02T07:08:15.137 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-02T07:08:15.137 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 101609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-02T07:08:15.137 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/ 2024-04-02T07:08:15.137 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 54617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-02T07:08:15.137 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/ 2024-04-02T07:08:15.137 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 69161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-02T07:08:15.137 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/ 2024-04-02T07:08:15.137 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-02T07:08:15.137 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/ 2024-04-02T07:08:15.137 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-02T07:08:15.138 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/ 2024-04-02T07:08:15.138 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 54609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-02T07:08:15.138 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-02T07:08:15.138 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 87449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-02T07:08:15.138 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/ 2024-04-02T07:08:15.138 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-02T07:08:15.138 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 97185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-02T07:08:15.138 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-02T07:08:15.138 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 102481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-02T07:08:15.138 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-02T07:08:15.138 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 90185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-02T07:08:15.138 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-02T07:08:15.138 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 81313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-02T07:08:15.138 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 69537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-02T07:08:15.139 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/ 2024-04-02T07:08:15.139 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 78377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-02T07:08:15.139 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 176689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-02T07:08:15.139 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-02T07:08:15.139 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1434449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-02T07:08:15.139 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 128361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-02T07:08:15.139 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-02T07:08:15.139 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 131265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-02T07:08:15.139 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 314321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-02T07:08:15.139 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/ 2024-04-02T07:08:15.139 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-02T07:08:15.139 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 323681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-02T07:08:15.139 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/ 2024-04-02T07:08:15.139 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-02T07:08:15.140 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 193537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-02T07:08:15.140 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-02T07:08:15.140 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 347161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-02T07:08:15.140 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-02T07:08:15.140 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1045321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-02T07:08:15.220 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-02T07:08:15.220 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 166129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-02T07:08:15.220 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-02T07:08:15.220 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-02T07:08:15.220 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/ 2024-04-02T07:08:15.220 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-02T07:08:15.220 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 204185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-02T07:08:15.220 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/ 2024-04-02T07:08:15.221 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-02T07:08:15.221 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 69425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-02T07:08:15.221 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 61417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-02T07:08:15.221 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 141153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-02T07:08:15.221 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 51361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-02T07:08:15.221 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 62825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-02T07:08:15.221 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-02T07:08:15.221 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/ 2024-04-02T07:08:15.221 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 60665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-02T07:08:15.221 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 62825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-02T07:08:15.221 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 45481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-04-02T07:08:15.221 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-02T07:08:15.221 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/ 2024-04-02T07:08:15.221 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-02T07:08:15.222 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 281193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-02T07:08:15.222 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-04-02T07:08:15.222 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 51777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-04-02T07:08:15.222 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fujitsu/ 2024-04-02T07:08:15.222 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 45545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-02T07:08:15.222 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ 2024-04-02T07:08:15.222 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 90297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-02T07:08:15.222 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-02T07:08:15.222 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 295673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-02T07:08:15.222 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-02T07:08:15.222 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 584297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-02T07:08:15.222 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-02T07:08:15.222 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 245977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-02T07:08:15.223 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-02T07:08:15.223 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 944449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-02T07:08:15.223 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-02T07:08:15.223 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 288481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-02T07:08:15.223 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/ 2024-04-02T07:08:15.223 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 514337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-02T07:08:15.223 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-02T07:08:15.223 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 93465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-02T07:08:15.223 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-02T07:08:15.223 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 735129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-02T07:08:15.223 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-02T07:08:15.223 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 151649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-02T07:08:15.223 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 86985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-04-02T07:08:15.223 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/ 2024-04-02T07:08:15.223 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-02T07:08:15.224 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 102433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-02T07:08:15.224 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 122601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-02T07:08:15.224 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/ 2024-04-02T07:08:15.224 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-02T07:08:15.224 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 727377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-02T07:08:15.224 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 278825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-02T07:08:15.224 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-02T07:08:15.224 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-02T07:08:15.224 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1122065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-02T07:08:15.224 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ 2024-04-02T07:08:15.224 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 52977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-02T07:08:15.224 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-02T07:08:15.224 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-02T07:08:15.224 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 95569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-02T07:08:15.225 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/ 2024-04-02T07:08:15.225 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-02T07:08:15.225 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 108401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-02T07:08:15.225 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ 2024-04-02T07:08:15.225 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 73609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-02T07:08:15.225 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-02T07:08:15.225 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/ 2024-04-02T07:08:15.225 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 151193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-02T07:08:15.225 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/ 2024-04-02T07:08:15.225 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 136793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-02T07:08:15.225 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/ 2024-04-02T07:08:15.225 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-02T07:08:15.225 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-02T07:08:15.225 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/ 2024-04-02T07:08:15.226 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-02T07:08:15.226 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 227841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-02T07:08:15.226 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 87009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-02T07:08:15.226 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-02T07:08:15.226 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 671985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-02T07:08:15.226 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/ 2024-04-02T07:08:15.226 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-02T07:08:15.226 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/ 2024-04-02T07:08:15.226 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 67273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-02T07:08:15.226 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 83801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-02T07:08:15.226 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-02T07:08:15.226 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 194057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-02T07:08:15.226 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/samsung/ 2024-04-02T07:08:15.227 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-02T07:08:15.227 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 104001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-02T07:08:15.227 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/ 2024-04-02T07:08:15.227 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1066817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-02T07:08:15.227 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/ 2024-04-02T07:08:15.227 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-02T07:08:15.227 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/ 2024-04-02T07:08:15.227 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 54721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-02T07:08:15.227 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 63193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-02T07:08:15.227 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/ 2024-04-02T07:08:15.227 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 61417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-02T07:08:15.227 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 67289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-02T07:08:15.227 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 73249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-02T07:08:15.227 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 68041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-02T07:08:15.228 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/ 2024-04-02T07:08:15.228 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-02T07:08:15.228 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-02T07:08:15.228 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-02T07:08:15.228 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-02T07:08:15.228 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 495641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-02T07:08:15.228 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/ 2024-04-02T07:08:15.228 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 103177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-02T07:08:15.228 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 166041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-02T07:08:15.228 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 66265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-02T07:08:15.228 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 78713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-02T07:08:15.228 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/ 2024-04-02T07:08:15.228 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-02T07:08:15.228 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/ 2024-04-02T07:08:15.229 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 92337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-02T07:08:15.229 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/ 2024-04-02T07:08:15.229 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 79929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-02T07:08:15.229 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 83713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-02T07:08:15.229 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/ 2024-04-02T07:08:15.229 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 46305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-02T07:08:15.229 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-02T07:08:15.229 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/ 2024-04-02T07:08:15.229 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-02T07:08:15.229 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/fddi/ 2024-04-02T07:08:15.229 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/fddi/defxx.ko 2024-04-02T07:08:15.229 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/fddi/skfp/ 2024-04-02T07:08:15.229 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 217025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-02T07:08:15.229 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 74985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-04-02T07:08:15.229 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/ 2024-04-02T07:08:15.230 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 237241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-02T07:08:15.230 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/ 2024-04-02T07:08:15.230 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-02T07:08:15.230 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-04-02T07:08:15.230 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ 2024-04-02T07:08:15.230 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 85841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-02T07:08:15.230 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 62889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-04-02T07:08:15.230 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-04-02T07:08:15.230 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/ 2024-04-02T07:08:15.230 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-02T07:08:15.230 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-02T07:08:15.230 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-02T07:08:15.230 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-02T07:08:15.231 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-04-02T07:08:15.231 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-04-02T07:08:15.231 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 45049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-04-02T07:08:15.231 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-04-02T07:08:15.231 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/ 2024-04-02T07:08:15.231 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-02T07:08:15.231 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-02T07:08:15.231 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ 2024-04-02T07:08:15.231 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-04-02T07:08:15.231 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-02T07:08:15.231 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-02T07:08:15.231 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-04-02T07:08:15.231 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-04-02T07:08:15.232 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-04-02T07:08:15.232 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-04-02T07:08:15.232 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-04-02T07:08:15.232 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-04-02T07:08:15.232 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-04-02T07:08:15.232 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 81953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-04-02T07:08:15.232 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 76561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-04-02T07:08:15.232 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-04-02T07:08:15.232 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 99001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-04-02T07:08:15.232 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-04-02T07:08:15.232 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-04-02T07:08:15.232 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-04-02T07:08:15.232 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-04-02T07:08:15.232 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-04-02T07:08:15.233 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/plip/ 2024-04-02T07:08:15.233 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/plip/plip.ko 2024-04-02T07:08:15.233 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ 2024-04-02T07:08:15.233 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-02T07:08:15.233 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-04-02T07:08:15.233 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-02T07:08:15.233 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-02T07:08:15.233 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-02T07:08:15.233 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-04-02T07:08:15.233 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-04-02T07:08:15.233 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-04-02T07:08:15.233 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sb1000.ko 2024-04-02T07:08:15.233 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/ 2024-04-02T07:08:15.233 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-04-02T07:08:15.233 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-04-02T07:08:15.234 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 64553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-04-02T07:08:15.234 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/ 2024-04-02T07:08:15.234 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 107225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-04-02T07:08:15.234 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-02T07:08:15.234 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-02T07:08:15.234 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-02T07:08:15.234 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-04-02T07:08:15.234 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-02T07:08:15.234 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 86817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-04-02T07:08:15.234 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/ 2024-04-02T07:08:15.234 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 144345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-02T07:08:15.234 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/ 2024-04-02T07:08:15.234 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 307169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-04-02T07:08:15.234 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/ 2024-04-02T07:08:15.235 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 143993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-02T07:08:15.235 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ 2024-04-02T07:08:15.235 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-04-02T07:08:15.235 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/ 2024-04-02T07:08:15.235 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/ 2024-04-02T07:08:15.235 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 267721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-04-02T07:08:15.235 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 103353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-04-02T07:08:15.235 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/ 2024-04-02T07:08:15.235 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 131297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-04-02T07:08:15.235 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-04-02T07:08:15.235 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 85209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-04-02T07:08:15.235 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-04-02T07:08:15.235 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/ 2024-04-02T07:08:15.235 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/ 2024-04-02T07:08:15.236 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-02T07:08:15.236 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-02T07:08:15.236 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-02T07:08:15.236 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pci-stub.ko 2024-04-02T07:08:15.236 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 46361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-04-02T07:08:15.236 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/ 2024-04-02T07:08:15.236 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-04-02T07:08:15.236 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 146129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pcmcia.ko 2024-04-02T07:08:15.236 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 62065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-02T07:08:15.236 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-02T07:08:15.236 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-04-02T07:08:15.236 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 112785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-02T07:08:15.236 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/phy/ 2024-04-02T07:08:15.236 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/phy/broadcom/ 2024-04-02T07:08:15.237 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-02T07:08:15.237 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/phy/samsung/ 2024-04-02T07:08:15.237 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-02T07:08:15.237 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/ 2024-04-02T07:08:15.237 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/ 2024-04-02T07:08:15.237 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 69025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-02T07:08:15.237 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/ 2024-04-02T07:08:15.237 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/ 2024-04-02T07:08:15.237 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 51217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-02T07:08:15.237 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-02T07:08:15.237 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-02T07:08:15.237 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-02T07:08:15.237 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-02T07:08:15.237 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-02T07:08:15.238 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-02T07:08:15.238 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/ 2024-04-02T07:08:15.238 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 73593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-02T07:08:15.238 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-04-02T07:08:15.238 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-02T07:08:15.238 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-02T07:08:15.238 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-02T07:08:15.238 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 131937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-02T07:08:15.238 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-02T07:08:15.238 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-02T07:08:15.238 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-02T07:08:15.238 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-02T07:08:15.238 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-02T07:08:15.238 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-04-02T07:08:15.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-02T07:08:15.239 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/ 2024-04-02T07:08:15.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-02T07:08:15.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-02T07:08:15.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-04-02T07:08:15.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-02T07:08:15.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-02T07:08:15.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-02T07:08:15.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-02T07:08:15.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-02T07:08:15.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-02T07:08:15.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-02T07:08:15.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-02T07:08:15.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-02T07:08:15.239 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 48473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-04-02T07:08:15.240 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/ 2024-04-02T07:08:15.240 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/ 2024-04-02T07:08:15.240 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-02T07:08:15.240 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-02T07:08:15.240 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 54953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-02T07:08:15.240 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-02T07:08:15.240 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-02T07:08:15.240 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-02T07:08:15.240 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/da9030_battery.ko 2024-04-02T07:08:15.240 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/da9052-battery.ko 2024-04-02T07:08:15.240 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-02T07:08:15.240 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-02T07:08:15.240 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-02T07:08:15.240 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-02T07:08:15.241 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/gpio-charger.ko 2024-04-02T07:08:15.241 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-02T07:08:15.241 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-02T07:08:15.241 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/max14577_charger.ko 2024-04-02T07:08:15.241 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/max17042_battery.ko 2024-04-02T07:08:15.241 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/max8903_charger.ko 2024-04-02T07:08:15.241 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/max8925_power.ko 2024-04-02T07:08:15.241 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-02T07:08:15.241 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/sbs-battery.ko 2024-04-02T07:08:15.241 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/test_power.ko 2024-04-02T07:08:15.241 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-02T07:08:15.241 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-02T07:08:15.241 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/wm831x_power.ko 2024-04-02T07:08:15.241 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/wm8350_power.ko 2024-04-02T07:08:15.241 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/ 2024-04-02T07:08:15.242 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 58097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-02T07:08:15.242 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-02T07:08:15.242 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/ 2024-04-02T07:08:15.242 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/ 2024-04-02T07:08:15.242 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-02T07:08:15.242 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-02T07:08:15.242 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-04-02T07:08:15.242 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-04-02T07:08:15.242 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ 2024-04-02T07:08:15.242 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 70849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-04-02T07:08:15.242 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-04-02T07:08:15.242 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/ 2024-04-02T07:08:15.242 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-02T07:08:15.242 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-02T07:08:15.243 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-02T07:08:15.243 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-da9052.ko 2024-04-02T07:08:15.243 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-da9055.ko 2024-04-02T07:08:15.243 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-da9063.ko 2024-04-02T07:08:15.243 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-02T07:08:15.243 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 68473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-02T07:08:15.243 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-02T07:08:15.243 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-02T07:08:15.243 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-02T07:08:15.243 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-02T07:08:15.243 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-02T07:08:15.243 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-02T07:08:15.243 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-02T07:08:15.243 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-04-02T07:08:15.244 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-02T07:08:15.244 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-02T07:08:15.244 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-02T07:08:15.244 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-02T07:08:15.244 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-02T07:08:15.244 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-02T07:08:15.244 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-02T07:08:15.244 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-02T07:08:15.244 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-04-02T07:08:15.244 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max8907.ko 2024-04-02T07:08:15.244 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max8925.ko 2024-04-02T07:08:15.244 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max8997.ko 2024-04-02T07:08:15.244 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max8998.ko 2024-04-02T07:08:15.244 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-02T07:08:15.244 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-02T07:08:15.245 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-palmas.ko 2024-04-02T07:08:15.245 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 46529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-02T07:08:15.245 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-02T07:08:15.245 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-02T07:08:15.245 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-02T07:08:15.245 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-02T07:08:15.245 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-02T07:08:15.245 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-02T07:08:15.245 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-02T07:08:15.245 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-02T07:08:15.245 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-02T07:08:15.245 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-02T07:08:15.245 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-02T07:08:15.245 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-02T07:08:15.246 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-02T07:08:15.246 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-02T07:08:15.246 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-02T07:08:15.246 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-02T07:08:15.246 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-02T07:08:15.246 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-04-02T07:08:15.246 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ 2024-04-02T07:08:15.246 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 77521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-04-02T07:08:15.246 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 57713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-04-02T07:08:15.246 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-04-02T07:08:15.246 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 135249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-04-02T07:08:15.246 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-04-02T07:08:15.246 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/ 2024-04-02T07:08:15.246 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 271385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-02T07:08:15.247 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 100529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-04-02T07:08:15.247 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/ 2024-04-02T07:08:15.247 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 356833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-02T07:08:15.247 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 295889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-02T07:08:15.247 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic94xx/ 2024-04-02T07:08:15.247 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 189089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-02T07:08:15.247 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-04-02T07:08:15.247 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/ 2024-04-02T07:08:15.247 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 108193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-02T07:08:15.247 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-04-02T07:08:15.247 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/ 2024-04-02T07:08:15.247 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 246913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-02T07:08:15.247 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/ 2024-04-02T07:08:15.247 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1171857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-04-02T07:08:15.247 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/ 2024-04-02T07:08:15.248 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 238369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-02T07:08:15.248 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/ 2024-04-02T07:08:15.248 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 115305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-02T07:08:15.248 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-04-02T07:08:15.248 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/ 2024-04-02T07:08:15.248 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 308905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-02T07:08:15.248 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/ 2024-04-02T07:08:15.248 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-02T07:08:15.248 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 76033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-02T07:08:15.248 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-02T07:08:15.248 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 101417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-02T07:08:15.248 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 146745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-02T07:08:15.248 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 75969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-04-02T07:08:15.248 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-04-02T07:08:15.249 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/ 2024-04-02T07:08:15.249 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 212329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-02T07:08:15.249 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 60497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-04-02T07:08:15.249 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/ 2024-04-02T07:08:15.249 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 78217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-02T07:08:15.249 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 157713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-02T07:08:15.249 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fdomain.ko 2024-04-02T07:08:15.249 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/ 2024-04-02T07:08:15.249 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 294881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-04-02T07:08:15.249 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 201721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-04-02T07:08:15.249 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 51113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-04-02T07:08:15.249 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 48937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-04-02T07:08:15.249 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/imm.ko 2024-04-02T07:08:15.249 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-04-02T07:08:15.250 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 265937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-04-02T07:08:15.250 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 101873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-04-02T07:08:15.250 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/ 2024-04-02T07:08:15.250 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 317129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-04-02T07:08:15.250 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-02T07:08:15.250 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 52857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-02T07:08:15.250 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/ 2024-04-02T07:08:15.250 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 315273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-04-02T07:08:15.250 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 145489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-04-02T07:08:15.250 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 53801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-02T07:08:15.250 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/ 2024-04-02T07:08:15.250 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 216345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-04-02T07:08:15.250 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/ 2024-04-02T07:08:15.250 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 2193953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-02T07:08:15.251 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/ 2024-04-02T07:08:15.251 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 73465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-02T07:08:15.251 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-02T07:08:15.251 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 310665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-02T07:08:15.251 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 85513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-04-02T07:08:15.251 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/ 2024-04-02T07:08:15.251 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 659585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-02T07:08:15.251 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/ 2024-04-02T07:08:15.251 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 119465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-02T07:08:15.251 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 78033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-04-02T07:08:15.251 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pcmcia/ 2024-04-02T07:08:15.251 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 81545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-02T07:08:15.251 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-02T07:08:15.251 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-02T07:08:15.251 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-02T07:08:15.252 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/ 2024-04-02T07:08:15.252 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 366305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-02T07:08:15.252 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 124593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-04-02T07:08:15.252 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ppa.ko 2024-04-02T07:08:15.252 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-04-02T07:08:15.252 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/ 2024-04-02T07:08:15.252 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1876657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-02T07:08:15.252 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 85185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-02T07:08:15.252 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/ 2024-04-02T07:08:15.252 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 558897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-02T07:08:15.252 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qlogicfas408.ko 2024-04-02T07:08:15.252 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-04-02T07:08:15.252 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 261073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-04-02T07:08:15.252 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 173921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-02T07:08:15.253 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 280105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-02T07:08:15.253 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 97617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-02T07:08:15.253 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 73857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-02T07:08:15.253 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-02T07:08:15.253 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-04-02T07:08:15.253 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 115641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-04-02T07:08:15.253 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 46729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-04-02T07:08:15.253 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-02T07:08:15.253 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 164865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-02T07:08:15.253 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-04-02T07:08:15.253 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-02T07:08:15.253 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-04-02T07:08:15.253 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/xen-scsifront.ko 2024-04-02T07:08:15.253 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ 2024-04-02T07:08:15.253 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 129345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-04-02T07:08:15.254 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/ 2024-04-02T07:08:15.254 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/ 2024-04-02T07:08:15.254 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 736665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-02T07:08:15.254 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/ 2024-04-02T07:08:15.254 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-02T07:08:15.254 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-04-02T07:08:15.254 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-04-02T07:08:15.254 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 931433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-04-02T07:08:15.254 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-04-02T07:08:15.254 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 122481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-04-02T07:08:15.254 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/ 2024-04-02T07:08:15.254 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 75497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-02T07:08:15.254 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/ 2024-04-02T07:08:15.254 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/ 2024-04-02T07:08:15.255 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-02T07:08:15.255 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-02T07:08:15.255 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-02T07:08:15.255 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-02T07:08:15.255 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-02T07:08:15.255 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-02T07:08:15.255 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-02T07:08:15.255 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-02T07:08:15.255 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-02T07:08:15.255 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-02T07:08:15.255 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-02T07:08:15.255 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-02T07:08:15.255 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-02T07:08:15.255 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-02T07:08:15.256 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-02T07:08:15.256 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-02T07:08:15.256 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-02T07:08:15.256 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-02T07:08:15.256 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-02T07:08:15.256 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-02T07:08:15.256 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ 2024-04-02T07:08:15.256 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ 2024-04-02T07:08:15.256 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 78329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-02T07:08:15.256 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 57769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/moxa.ko 2024-04-02T07:08:15.256 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/mxser.ko 2024-04-02T07:08:15.256 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 108481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-04-02T07:08:15.256 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-04-02T07:08:15.256 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 67833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-04-02T07:08:15.256 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/ 2024-04-02T07:08:15.257 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/ 2024-04-02T07:08:15.257 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-02T07:08:15.257 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-02T07:08:15.257 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-02T07:08:15.257 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/altera_uart.ko 2024-04-02T07:08:15.257 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-04-02T07:08:15.257 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 72545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-02T07:08:15.257 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/ 2024-04-02T07:08:15.257 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 101969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-02T07:08:15.257 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/rp2.ko 2024-04-02T07:08:15.257 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 53169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-02T07:08:15.257 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/ 2024-04-02T07:08:15.257 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ 2024-04-02T07:08:15.257 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 545377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-02T07:08:15.258 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ 2024-04-02T07:08:15.258 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-02T07:08:15.258 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-02T07:08:15.258 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/ 2024-04-02T07:08:15.258 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-04-02T07:08:15.258 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-04-02T07:08:15.258 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-04-02T07:08:15.258 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-02T07:08:15.258 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_mf624.ko 2024-04-02T07:08:15.258 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_netx.ko 2024-04-02T07:08:15.258 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-04-02T07:08:15.258 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-02T07:08:15.258 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-04-02T07:08:15.258 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/ 2024-04-02T07:08:15.259 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/c67x00/ 2024-04-02T07:08:15.259 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 73201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-02T07:08:15.259 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/chipidea/ 2024-04-02T07:08:15.259 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 145753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-02T07:08:15.259 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-02T07:08:15.259 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-02T07:08:15.259 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-02T07:08:15.259 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-02T07:08:15.259 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/ 2024-04-02T07:08:15.259 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 87001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-04-02T07:08:15.259 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 51249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-02T07:08:15.259 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-04-02T07:08:15.259 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 89761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-04-02T07:08:15.259 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/common/ 2024-04-02T07:08:15.259 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/common/ulpi.ko 2024-04-02T07:08:15.260 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/dwc2/ 2024-04-02T07:08:15.260 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-02T07:08:15.260 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/dwc3/ 2024-04-02T07:08:15.260 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-02T07:08:15.260 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-02T07:08:15.260 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 452785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-02T07:08:15.260 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/ 2024-04-02T07:08:15.260 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/ 2024-04-02T07:08:15.260 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 60321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-02T07:08:15.260 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 51785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-02T07:08:15.260 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-02T07:08:15.260 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-02T07:08:15.260 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-02T07:08:15.260 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-02T07:08:15.261 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 92401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-02T07:08:15.261 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 50937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-02T07:08:15.261 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 122241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-02T07:08:15.261 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-02T07:08:15.261 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-02T07:08:15.261 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-02T07:08:15.261 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 57625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-02T07:08:15.261 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 85505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-02T07:08:15.261 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-02T07:08:15.261 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 58009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-02T07:08:15.261 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 67345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-02T07:08:15.261 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/ 2024-04-02T07:08:15.261 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-02T07:08:15.261 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-02T07:08:15.262 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-02T07:08:15.262 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-02T07:08:15.262 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-02T07:08:15.262 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-02T07:08:15.262 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-02T07:08:15.262 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-02T07:08:15.262 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-02T07:08:15.262 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-02T07:08:15.262 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-02T07:08:15.262 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-02T07:08:15.262 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 62361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-02T07:08:15.262 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-02T07:08:15.262 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 161193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-02T07:08:15.263 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/ 2024-04-02T07:08:15.263 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-02T07:08:15.263 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-02T07:08:15.263 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 157593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-02T07:08:15.263 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-02T07:08:15.263 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 52921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-02T07:08:15.263 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 69609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-02T07:08:15.263 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-02T07:08:15.263 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 75961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-02T07:08:15.263 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 74977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-02T07:08:15.263 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 73009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-02T07:08:15.263 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 65873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-02T07:08:15.263 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 65993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-02T07:08:15.263 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 81401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-02T07:08:15.264 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 156321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-02T07:08:15.264 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/ 2024-04-02T07:08:15.264 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-02T07:08:15.264 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 80009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-02T07:08:15.264 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 87249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-02T07:08:15.264 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 78769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-02T07:08:15.264 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 51385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-02T07:08:15.264 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811_cs.ko 2024-04-02T07:08:15.264 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-02T07:08:15.264 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-02T07:08:15.264 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/ 2024-04-02T07:08:15.264 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-04-02T07:08:15.264 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-04-02T07:08:15.264 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ 2024-04-02T07:08:15.265 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-04-02T07:08:15.265 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-04-02T07:08:15.265 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-02T07:08:15.265 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/cytherm.ko 2024-04-02T07:08:15.265 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ehset.ko 2024-04-02T07:08:15.265 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-04-02T07:08:15.265 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-04-02T07:08:15.265 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-04-02T07:08:15.265 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-04-02T07:08:15.265 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-04-02T07:08:15.265 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-02T07:08:15.265 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-04-02T07:08:15.265 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-04-02T07:08:15.265 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/lvstest.ko 2024-04-02T07:08:15.266 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/ 2024-04-02T07:08:15.266 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 64737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-02T07:08:15.266 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-02T07:08:15.266 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-04-02T07:08:15.266 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-04-02T07:08:15.266 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-02T07:08:15.266 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 70713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbtest.ko 2024-04-02T07:08:15.266 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-04-02T07:08:15.266 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-04-02T07:08:15.266 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/mon/ 2024-04-02T07:08:15.266 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 72801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/mon/usbmon.ko 2024-04-02T07:08:15.266 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/musb/ 2024-04-02T07:08:15.266 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 301593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-02T07:08:15.266 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/ 2024-04-02T07:08:15.267 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-04-02T07:08:15.267 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-02T07:08:15.267 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-02T07:08:15.267 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-02T07:08:15.267 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ 2024-04-02T07:08:15.267 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-04-02T07:08:15.267 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-04-02T07:08:15.267 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-02T07:08:15.267 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-04-02T07:08:15.267 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 70273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-04-02T07:08:15.267 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-04-02T07:08:15.267 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 58113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-02T07:08:15.267 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-02T07:08:15.267 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-04-02T07:08:15.268 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/f81232.ko 2024-04-02T07:08:15.268 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 175097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-02T07:08:15.268 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 53009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-02T07:08:15.268 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 136977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-02T07:08:15.268 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 124737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-04-02T07:08:15.268 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 67673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-04-02T07:08:15.268 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-04-02T07:08:15.268 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-04-02T07:08:15.268 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 58129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-02T07:08:15.268 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 107425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-04-02T07:08:15.268 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-02T07:08:15.268 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-02T07:08:15.268 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-02T07:08:15.268 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-04-02T07:08:15.269 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/metro-usb.ko 2024-04-02T07:08:15.269 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 66353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-04-02T07:08:15.269 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 78121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-04-02T07:08:15.269 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 56241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mxuport.ko 2024-04-02T07:08:15.269 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-04-02T07:08:15.269 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-04-02T07:08:15.269 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-04-02T07:08:15.269 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 191817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-04-02T07:08:15.269 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-04-02T07:08:15.269 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 54257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-04-02T07:08:15.269 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-04-02T07:08:15.269 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-04-02T07:08:15.269 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-04-02T07:08:15.269 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-04-02T07:08:15.269 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 51529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-04-02T07:08:15.270 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-02T07:08:15.270 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-04-02T07:08:15.270 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-04-02T07:08:15.270 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 61385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-02T07:08:15.270 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-02T07:08:15.270 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-04-02T07:08:15.270 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-02T07:08:15.270 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 125513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usbserial.ko 2024-04-02T07:08:15.270 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-04-02T07:08:15.270 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-04-02T07:08:15.270 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-02T07:08:15.270 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-02T07:08:15.270 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ 2024-04-02T07:08:15.270 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 52753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-04-02T07:08:15.271 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-02T07:08:15.271 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-02T07:08:15.271 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-02T07:08:15.271 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-02T07:08:15.271 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-02T07:08:15.271 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-02T07:08:15.271 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-02T07:08:15.271 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-04-02T07:08:15.271 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-02T07:08:15.271 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-02T07:08:15.271 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-02T07:08:15.271 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-02T07:08:15.271 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-02T07:08:15.271 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 180281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-04-02T07:08:15.271 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/ 2024-04-02T07:08:15.272 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 67385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-02T07:08:15.272 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 71001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-02T07:08:15.272 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 103977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-02T07:08:15.272 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/ 2024-04-02T07:08:15.272 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/ 2024-04-02T07:08:15.272 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 162841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-02T07:08:15.272 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-02T07:08:15.272 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 103649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-04-02T07:08:15.272 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 76433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-02T07:08:15.272 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/ 2024-04-02T07:08:15.272 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 113657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-04-02T07:08:15.272 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-02T07:08:15.272 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 57993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-04-02T07:08:15.272 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 89049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-04-02T07:08:15.273 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/ 2024-04-02T07:08:15.273 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/ 2024-04-02T07:08:15.273 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-02T07:08:15.273 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-02T07:08:15.273 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-02T07:08:15.273 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-02T07:08:15.273 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-02T07:08:15.273 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-04-02T07:08:15.273 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-02T07:08:15.273 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/bd6107.ko 2024-04-02T07:08:15.273 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-02T07:08:15.273 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-02T07:08:15.273 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-02T07:08:15.273 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-02T07:08:15.274 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-04-02T07:08:15.274 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-02T07:08:15.274 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-02T07:08:15.274 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-02T07:08:15.274 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-02T07:08:15.274 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-02T07:08:15.274 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-02T07:08:15.274 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-02T07:08:15.274 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-02T07:08:15.274 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/ 2024-04-02T07:08:15.274 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ 2024-04-02T07:08:15.274 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-04-02T07:08:15.274 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-04-02T07:08:15.275 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-02T07:08:15.275 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-02T07:08:15.275 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/ 2024-04-02T07:08:15.275 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-02T07:08:15.275 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-02T07:08:15.275 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-02T07:08:15.275 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-02T07:08:15.275 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-02T07:08:15.275 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-02T07:08:15.275 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-02T07:08:15.275 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-02T07:08:15.275 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-02T07:08:15.275 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-02T07:08:15.275 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 56329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-02T07:08:15.276 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 103025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-04-02T07:08:15.276 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ 2024-04-02T07:08:15.276 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/acquirewdt.ko 2024-04-02T07:08:15.276 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/advantechwdt.ko 2024-04-02T07:08:15.276 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-02T07:08:15.276 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-02T07:08:15.276 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-02T07:08:15.276 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-02T07:08:15.276 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-02T07:08:15.276 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-02T07:08:15.276 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/dw_wdt.ko 2024-04-02T07:08:15.276 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-02T07:08:15.276 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-02T07:08:15.276 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-04-02T07:08:15.277 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-04-02T07:08:15.277 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-02T07:08:15.277 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-02T07:08:15.277 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-04-02T07:08:15.277 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-04-02T07:08:15.277 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-02T07:08:15.277 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-02T07:08:15.277 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-04-02T07:08:15.277 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-02T07:08:15.277 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-04-02T07:08:15.277 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-02T07:08:15.277 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-02T07:08:15.277 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-04-02T07:08:15.277 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-02T07:08:15.277 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-02T07:08:15.278 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-02T07:08:15.278 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-02T07:08:15.278 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/retu_wdt.ko 2024-04-02T07:08:15.278 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-02T07:08:15.278 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-02T07:08:15.278 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-02T07:08:15.278 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-02T07:08:15.278 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-02T07:08:15.278 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-02T07:08:15.278 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-04-02T07:08:15.278 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-02T07:08:15.279 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-02T07:08:15.279 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-04-02T07:08:15.279 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-02T07:08:15.279 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-02T07:08:15.279 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-02T07:08:15.279 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-02T07:08:15.279 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-04-02T07:08:15.279 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-02T07:08:15.279 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-02T07:08:15.279 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-04-02T07:08:15.279 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/ 2024-04-02T07:08:15.279 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-04-02T07:08:15.279 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-04-02T07:08:15.279 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-04-02T07:08:15.279 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/ 2024-04-02T07:08:15.280 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 176337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-02T07:08:15.280 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-04-02T07:08:15.280 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 71145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-scsiback.ko 2024-04-02T07:08:15.280 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/ 2024-04-02T07:08:15.280 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-02T07:08:15.280 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ 2024-04-02T07:08:15.280 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/ 2024-04-02T07:08:15.280 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 158217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-04-02T07:08:15.280 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/adfs/ 2024-04-02T07:08:15.280 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 61681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/adfs/adfs.ko 2024-04-02T07:08:15.280 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/ 2024-04-02T07:08:15.280 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 163369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-04-02T07:08:15.280 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/afs/ 2024-04-02T07:08:15.280 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1019049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/afs/kafs.ko 2024-04-02T07:08:15.281 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/autofs/ 2024-04-02T07:08:15.281 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 103185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/autofs/autofs4.ko 2024-04-02T07:08:15.281 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/ 2024-04-02T07:08:15.281 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 64585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-04-02T07:08:15.281 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/bfs/ 2024-04-02T07:08:15.281 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 41001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/bfs/bfs.ko 2024-04-02T07:08:15.281 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-04-02T07:08:15.281 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/ 2024-04-02T07:08:15.281 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 3487249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-04-02T07:08:15.281 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/ 2024-04-02T07:08:15.281 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 305841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-04-02T07:08:15.281 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ 2024-04-02T07:08:15.281 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1335577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-04-02T07:08:15.281 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/ 2024-04-02T07:08:15.282 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 97713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-04-02T07:08:15.282 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/configfs/ 2024-04-02T07:08:15.282 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 108545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/configfs/configfs.ko 2024-04-02T07:08:15.282 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/ 2024-04-02T07:08:15.282 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-04-02T07:08:15.282 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/ 2024-04-02T07:08:15.282 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 644161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-04-02T07:08:15.282 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/efs/ 2024-04-02T07:08:15.282 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/efs/efs.ko 2024-04-02T07:08:15.282 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/ 2024-04-02T07:08:15.282 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1527561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-04-02T07:08:15.282 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/ 2024-04-02T07:08:15.282 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-04-02T07:08:15.283 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/freevxfs/ 2024-04-02T07:08:15.283 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/freevxfs/freevxfs.ko 2024-04-02T07:08:15.283 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/ 2024-04-02T07:08:15.283 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-04-02T07:08:15.283 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/ 2024-04-02T07:08:15.283 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1231233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-04-02T07:08:15.283 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/ 2024-04-02T07:08:15.283 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 141625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-04-02T07:08:15.283 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/ 2024-04-02T07:08:15.283 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 223177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-04-02T07:08:15.283 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hpfs/ 2024-04-02T07:08:15.283 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 193481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hpfs/hpfs.ko 2024-04-02T07:08:15.283 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/ 2024-04-02T07:08:15.284 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 74689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-04-02T07:08:15.284 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/ 2024-04-02T07:08:15.284 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 420329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-04-02T07:08:15.284 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/ 2024-04-02T07:08:15.284 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 281617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-04-02T07:08:15.284 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/ 2024-04-02T07:08:15.284 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 88897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-04-02T07:08:15.284 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/ 2024-04-02T07:08:15.284 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 490409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-04-02T07:08:15.284 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/ 2024-04-02T07:08:15.284 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/ 2024-04-02T07:08:15.284 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 81433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-02T07:08:15.284 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/ 2024-04-02T07:08:15.284 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-02T07:08:15.285 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/ 2024-04-02T07:08:15.285 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 117361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-02T07:08:15.285 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1058273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-04-02T07:08:15.285 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 66345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv2.ko 2024-04-02T07:08:15.285 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 120169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-04-02T07:08:15.285 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 2041705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-04-02T07:08:15.285 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/ 2024-04-02T07:08:15.285 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-04-02T07:08:15.285 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-04-02T07:08:15.285 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/ 2024-04-02T07:08:15.285 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1511641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-04-02T07:08:15.285 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/ 2024-04-02T07:08:15.285 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 582409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-04-02T07:08:15.285 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/ 2024-04-02T07:08:15.286 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-04-02T07:08:15.286 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-04-02T07:08:15.286 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-04-02T07:08:15.286 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-04-02T07:08:15.286 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-04-02T07:08:15.286 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-04-02T07:08:15.286 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-04-02T07:08:15.286 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-04-02T07:08:15.286 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-04-02T07:08:15.286 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-04-02T07:08:15.286 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-04-02T07:08:15.286 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ascii.ko 2024-04-02T07:08:15.286 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-04-02T07:08:15.286 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-04-02T07:08:15.287 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-04-02T07:08:15.287 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-04-02T07:08:15.287 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-04-02T07:08:15.287 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-04-02T07:08:15.287 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-04-02T07:08:15.287 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-04-02T07:08:15.287 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-04-02T07:08:15.287 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-04-02T07:08:15.287 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-04-02T07:08:15.287 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-04-02T07:08:15.287 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-04-02T07:08:15.287 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-04-02T07:08:15.287 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-04-02T07:08:15.287 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-04-02T07:08:15.288 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-04-02T07:08:15.288 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-04-02T07:08:15.288 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 94033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-04-02T07:08:15.288 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 142569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-04-02T07:08:15.288 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 165641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-04-02T07:08:15.288 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 118017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-04-02T07:08:15.288 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-04-02T07:08:15.288 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-04-02T07:08:15.288 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-04-02T07:08:15.288 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-04-02T07:08:15.288 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-04-02T07:08:15.288 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-04-02T07:08:15.288 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-04-02T07:08:15.288 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-04-02T07:08:15.289 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-04-02T07:08:15.289 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-04-02T07:08:15.289 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-04-02T07:08:15.289 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-04-02T07:08:15.289 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-04-02T07:08:15.289 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-04-02T07:08:15.289 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-04-02T07:08:15.289 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-02T07:08:15.289 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-04-02T07:08:15.289 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ntfs/ 2024-04-02T07:08:15.289 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 220457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ntfs/ntfs.ko 2024-04-02T07:08:15.289 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ 2024-04-02T07:08:15.289 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ 2024-04-02T07:08:15.289 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 244633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-02T07:08:15.290 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ 2024-04-02T07:08:15.290 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 440633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-02T07:08:15.290 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ 2024-04-02T07:08:15.290 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 54161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-02T07:08:15.290 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 2590681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-04-02T07:08:15.329 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-02T07:08:15.329 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-02T07:08:15.329 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-02T07:08:15.329 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/omfs/ 2024-04-02T07:08:15.329 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 53681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/omfs/omfs.ko 2024-04-02T07:08:15.329 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/ 2024-04-02T07:08:15.329 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 360897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-04-02T07:08:15.329 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ 2024-04-02T07:08:15.329 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 56929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-04-02T07:08:15.329 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/qnx4/ 2024-04-02T07:08:15.329 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/qnx4/qnx4.ko 2024-04-02T07:08:15.329 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/qnx6/ 2024-04-02T07:08:15.330 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 46601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/qnx6/qnx6.ko 2024-04-02T07:08:15.330 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/quota/ 2024-04-02T07:08:15.330 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/quota/quota_tree.ko 2024-04-02T07:08:15.330 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/quota/quota_v1.ko 2024-04-02T07:08:15.330 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/quota/quota_v2.ko 2024-04-02T07:08:15.330 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/ 2024-04-02T07:08:15.330 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 532161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-04-02T07:08:15.330 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/ 2024-04-02T07:08:15.330 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-04-02T07:08:15.330 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/ 2024-04-02T07:08:15.330 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/ 2024-04-02T07:08:15.330 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 2712385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-04-02T07:08:15.330 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/ 2024-04-02T07:08:15.331 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-04-02T07:08:15.331 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-04-02T07:08:15.331 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/ 2024-04-02T07:08:15.331 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 134705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-04-02T07:08:15.331 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/ 2024-04-02T07:08:15.331 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 91281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-04-02T07:08:15.331 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/ 2024-04-02T07:08:15.331 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 248329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-04-02T07:08:15.331 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ 2024-04-02T07:08:15.331 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 162737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-04-02T07:08:15.331 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/ 2024-04-02T07:08:15.331 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 4035417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-04-02T07:08:15.331 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/ 2024-04-02T07:08:15.331 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/locking/ 2024-04-02T07:08:15.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 80481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/locking/locktorture.ko 2024-04-02T07:08:15.332 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/time/ 2024-04-02T07:08:15.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/time/test_udelay.ko 2024-04-02T07:08:15.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 60257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-04-02T07:08:15.332 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ 2024-04-02T07:08:15.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 6729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-04-02T07:08:15.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 6433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc7.ko 2024-04-02T07:08:15.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 6929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-04-02T07:08:15.332 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/ 2024-04-02T07:08:15.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-04-02T07:08:15.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-04-02T07:08:15.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/interval_tree_test.ko 2024-04-02T07:08:15.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-04-02T07:08:15.332 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-04-02T07:08:15.333 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/ 2024-04-02T07:08:15.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-04-02T07:08:15.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-04-02T07:08:15.333 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/ 2024-04-02T07:08:15.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 6521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-04-02T07:08:15.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/memory-notifier-error-inject.ko 2024-04-02T07:08:15.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/notifier-error-inject.ko 2024-04-02T07:08:15.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/percpu_test.ko 2024-04-02T07:08:15.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/pm-notifier-error-inject.ko 2024-04-02T07:08:15.333 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/ 2024-04-02T07:08:15.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 143257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-04-02T07:08:15.333 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/rbtree_test.ko 2024-04-02T07:08:15.333 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/ 2024-04-02T07:08:15.334 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-02T07:08:15.334 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/test-kstrtox.ko 2024-04-02T07:08:15.334 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/test-string_helpers.ko 2024-04-02T07:08:15.334 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 4863217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/test_bpf.ko 2024-04-02T07:08:15.334 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 48985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/test_firmware.ko 2024-04-02T07:08:15.334 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 6273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/test_module.ko 2024-04-02T07:08:15.334 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/test_user_copy.ko 2024-04-02T07:08:15.334 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-04-02T07:08:15.334 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-04-02T07:08:15.334 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-04-02T07:08:15.334 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/xz/ 2024-04-02T07:08:15.334 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/xz/xz_dec_test.ko 2024-04-02T07:08:15.334 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/ 2024-04-02T07:08:15.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-04-02T07:08:15.335 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ 2024-04-02T07:08:15.335 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/ 2024-04-02T07:08:15.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-04-02T07:08:15.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 6953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-04-02T07:08:15.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 6961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-04-02T07:08:15.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 6953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-04-02T07:08:15.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 6889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-02T07:08:15.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 6961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-04-02T07:08:15.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 6897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-04-02T07:08:15.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-04-02T07:08:15.335 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/ 2024-04-02T07:08:15.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-04-02T07:08:15.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-04-02T07:08:15.335 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-04-02T07:08:15.336 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-04-02T07:08:15.336 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-04-02T07:08:15.336 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/ 2024-04-02T07:08:15.336 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 82865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-04-02T07:08:15.336 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/ 2024-04-02T07:08:15.336 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 198809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-04-02T07:08:15.336 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-04-02T07:08:15.336 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-04-02T07:08:15.336 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-04-02T07:08:15.336 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/ 2024-04-02T07:08:15.336 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 667353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-04-02T07:08:15.336 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/ 2024-04-02T07:08:15.336 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 67753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-04-02T07:08:15.336 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 790545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-04-02T07:08:15.337 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ 2024-04-02T07:08:15.337 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-02T07:08:15.337 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-02T07:08:15.337 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-02T07:08:15.337 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-02T07:08:15.337 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-02T07:08:15.337 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-02T07:08:15.337 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-02T07:08:15.337 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-02T07:08:15.337 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-02T07:08:15.337 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-02T07:08:15.337 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-02T07:08:15.337 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-02T07:08:15.337 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-02T07:08:15.338 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-02T07:08:15.338 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-02T07:08:15.338 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-02T07:08:15.338 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-02T07:08:15.338 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-02T07:08:15.338 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-02T07:08:15.338 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-02T07:08:15.338 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-04-02T07:08:15.338 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-02T07:08:15.338 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-02T07:08:15.338 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/ 2024-04-02T07:08:15.338 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1046689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-04-02T07:08:15.338 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/ 2024-04-02T07:08:15.338 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 125697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-04-02T07:08:15.339 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/ 2024-04-02T07:08:15.339 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 194441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-04-02T07:08:15.339 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-04-02T07:08:15.339 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 58737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-04-02T07:08:15.339 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 61393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-04-02T07:08:15.339 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/ 2024-04-02T07:08:15.339 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 390033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-04-02T07:08:15.339 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-04-02T07:08:15.339 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-04-02T07:08:15.339 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-04-02T07:08:15.339 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-04-02T07:08:15.339 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/hsr/ 2024-04-02T07:08:15.339 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 102033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/hsr/hsr.ko 2024-04-02T07:08:15.339 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ 2024-04-02T07:08:15.340 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ 2024-04-02T07:08:15.340 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 45481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-02T07:08:15.340 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 284665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-04-02T07:08:15.340 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 47873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-02T07:08:15.340 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ 2024-04-02T07:08:15.340 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-04-02T07:08:15.340 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-04-02T07:08:15.340 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 48233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-04-02T07:08:15.340 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-04-02T07:08:15.340 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 51209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-04-02T07:08:15.340 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 61129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-04-02T07:08:15.340 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 61505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-04-02T07:08:15.340 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-04-02T07:08:15.340 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-04-02T07:08:15.341 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-04-02T07:08:15.341 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ 2024-04-02T07:08:15.341 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-02T07:08:15.341 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-02T07:08:15.341 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-02T07:08:15.341 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-02T07:08:15.341 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-02T07:08:15.341 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-02T07:08:15.341 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-02T07:08:15.341 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-02T07:08:15.341 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-02T07:08:15.341 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-02T07:08:15.341 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-02T07:08:15.341 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-02T07:08:15.341 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-02T07:08:15.342 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-02T07:08:15.342 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-02T07:08:15.342 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-02T07:08:15.342 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-02T07:08:15.342 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-02T07:08:15.342 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-02T07:08:15.342 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-02T07:08:15.342 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-02T07:08:15.342 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-02T07:08:15.342 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-02T07:08:15.342 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-02T07:08:15.342 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-02T07:08:15.342 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-04-02T07:08:15.343 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-04-02T07:08:15.343 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-04-02T07:08:15.343 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-04-02T07:08:15.343 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-04-02T07:08:15.343 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-04-02T07:08:15.343 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-04-02T07:08:15.343 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-04-02T07:08:15.343 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-04-02T07:08:15.343 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-04-02T07:08:15.343 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-04-02T07:08:15.343 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-04-02T07:08:15.343 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-04-02T07:08:15.343 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-04-02T07:08:15.343 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-04-02T07:08:15.343 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 45041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-04-02T07:08:15.344 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-02T07:08:15.344 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ 2024-04-02T07:08:15.344 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-04-02T07:08:15.344 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-04-02T07:08:15.344 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-04-02T07:08:15.344 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 79921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_gre.ko 2024-04-02T07:08:15.344 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 94161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-04-02T07:08:15.344 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-02T07:08:15.344 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 54265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-04-02T07:08:15.344 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-04-02T07:08:15.344 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/mip6.ko 2024-04-02T07:08:15.344 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ 2024-04-02T07:08:15.344 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-02T07:08:15.344 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-02T07:08:15.345 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-02T07:08:15.345 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-02T07:08:15.345 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-02T07:08:15.345 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-02T07:08:15.345 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-02T07:08:15.345 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-02T07:08:15.345 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-02T07:08:15.345 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-02T07:08:15.345 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-02T07:08:15.345 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-02T07:08:15.345 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-02T07:08:15.345 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-02T07:08:15.345 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-02T07:08:15.345 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-02T07:08:15.346 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-02T07:08:15.346 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-02T07:08:15.346 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-02T07:08:15.346 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-02T07:08:15.346 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-02T07:08:15.346 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-02T07:08:15.346 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-02T07:08:15.346 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-02T07:08:15.346 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-02T07:08:15.346 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 74873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-04-02T07:08:15.346 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-04-02T07:08:15.346 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-02T07:08:15.346 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/ 2024-04-02T07:08:15.347 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 84393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-04-02T07:08:15.347 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/ 2024-04-02T07:08:15.347 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 125201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-04-02T07:08:15.347 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-02T07:08:15.347 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 25809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-04-02T07:08:15.347 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-04-02T07:08:15.347 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-04-02T07:08:15.347 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-04-02T07:08:15.347 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 53225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-04-02T07:08:15.347 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/lapb/ 2024-04-02T07:08:15.347 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 48097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/lapb/lapb.ko 2024-04-02T07:08:15.347 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/ 2024-04-02T07:08:15.347 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-04-02T07:08:15.347 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 268449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc2.ko 2024-04-02T07:08:15.348 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/ 2024-04-02T07:08:15.348 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 309361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-04-02T07:08:15.348 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/ 2024-04-02T07:08:15.348 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-04-02T07:08:15.348 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ 2024-04-02T07:08:15.348 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ 2024-04-02T07:08:15.348 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 119689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-04-02T07:08:15.348 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-02T07:08:15.348 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-02T07:08:15.348 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-02T07:08:15.348 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 99985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-02T07:08:15.348 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 100273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-02T07:08:15.348 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 102545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-02T07:08:15.348 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 102337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-02T07:08:15.349 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 111665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-02T07:08:15.349 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 59185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-02T07:08:15.349 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 108337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-02T07:08:15.349 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 112137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-02T07:08:15.349 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 112401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-02T07:08:15.349 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 110329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-02T07:08:15.349 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 113281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-02T07:08:15.349 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-02T07:08:15.349 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ 2024-04-02T07:08:15.349 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 412433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-02T07:08:15.349 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-02T07:08:15.349 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-02T07:08:15.349 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-02T07:08:15.349 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-02T07:08:15.349 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-02T07:08:15.350 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-02T07:08:15.350 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-02T07:08:15.350 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-02T07:08:15.350 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-02T07:08:15.350 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-02T07:08:15.350 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-02T07:08:15.350 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-02T07:08:15.350 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-02T07:08:15.350 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-04-02T07:08:15.350 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 411665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-04-02T07:08:15.350 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-02T07:08:15.350 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-02T07:08:15.350 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-02T07:08:15.351 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 118145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-02T07:08:15.351 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-02T07:08:15.351 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-02T07:08:15.351 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 108305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-02T07:08:15.351 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-02T07:08:15.351 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-02T07:08:15.351 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 66529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-02T07:08:15.351 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-02T07:08:15.351 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-02T07:08:15.351 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-02T07:08:15.351 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 92217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-04-02T07:08:15.351 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-02T07:08:15.351 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-04-02T07:08:15.352 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 96489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-04-02T07:08:15.352 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-02T07:08:15.352 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-02T07:08:15.352 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-04-02T07:08:15.352 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-04-02T07:08:15.352 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-02T07:08:15.352 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 44129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-02T07:08:15.352 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 623337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-04-02T07:08:15.352 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 42505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-04-02T07:08:15.352 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-02T07:08:15.352 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-02T07:08:15.352 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-04-02T07:08:15.352 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 22929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-02T07:08:15.352 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-02T07:08:15.353 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-04-02T07:08:15.353 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-04-02T07:08:15.353 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 40801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-04-02T07:08:15.353 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-02T07:08:15.353 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-04-02T07:08:15.353 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-02T07:08:15.353 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-04-02T07:08:15.353 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-04-02T07:08:15.353 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-04-02T07:08:15.353 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-04-02T07:08:15.353 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-04-02T07:08:15.353 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-04-02T07:08:15.353 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_osf.ko 2024-04-02T07:08:15.353 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-04-02T07:08:15.354 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-04-02T07:08:15.354 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-04-02T07:08:15.354 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-04-02T07:08:15.354 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-04-02T07:08:15.354 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_synproxy.ko 2024-04-02T07:08:15.354 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tproxy.ko 2024-04-02T07:08:15.354 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 89225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/x_tables.ko 2024-04-02T07:08:15.354 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-04-02T07:08:15.354 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-02T07:08:15.354 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-02T07:08:15.354 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-02T07:08:15.354 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 18073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-04-02T07:08:15.354 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-04-02T07:08:15.354 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-04-02T07:08:15.355 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-04-02T07:08:15.355 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 38769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-02T07:08:15.355 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-04-02T07:08:15.355 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-04-02T07:08:15.355 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-02T07:08:15.355 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-04-02T07:08:15.355 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-04-02T07:08:15.355 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-02T07:08:15.355 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-04-02T07:08:15.355 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-02T07:08:15.355 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-04-02T07:08:15.355 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-02T07:08:15.355 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-02T07:08:15.356 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-04-02T07:08:15.356 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-04-02T07:08:15.356 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-04-02T07:08:15.356 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-04-02T07:08:15.356 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-04-02T07:08:15.356 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-04-02T07:08:15.356 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-04-02T07:08:15.356 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-04-02T07:08:15.356 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-04-02T07:08:15.356 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-04-02T07:08:15.356 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-04-02T07:08:15.356 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-04-02T07:08:15.356 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-04-02T07:08:15.356 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-04-02T07:08:15.357 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-04-02T07:08:15.357 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-04-02T07:08:15.357 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-04-02T07:08:15.357 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-04-02T07:08:15.357 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-04-02T07:08:15.357 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-04-02T07:08:15.357 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-04-02T07:08:15.357 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-04-02T07:08:15.357 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-04-02T07:08:15.357 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-04-02T07:08:15.357 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-04-02T07:08:15.357 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-04-02T07:08:15.357 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-04-02T07:08:15.357 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-04-02T07:08:15.358 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-04-02T07:08:15.358 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-04-02T07:08:15.358 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-04-02T07:08:15.358 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-04-02T07:08:15.358 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-04-02T07:08:15.358 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-04-02T07:08:15.358 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-04-02T07:08:15.358 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-04-02T07:08:15.358 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-04-02T07:08:15.358 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-04-02T07:08:15.358 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-04-02T07:08:15.358 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-04-02T07:08:15.358 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-04-02T07:08:15.358 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-04-02T07:08:15.359 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-04-02T07:08:15.359 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 29993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-04-02T07:08:15.359 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 16809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-04-02T07:08:15.359 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-04-02T07:08:15.359 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-04-02T07:08:15.359 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-04-02T07:08:15.359 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 8449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-04-02T07:08:15.359 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpudp.ko 2024-04-02T07:08:15.359 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-04-02T07:08:15.359 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-04-02T07:08:15.359 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/ 2024-04-02T07:08:15.359 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 14433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-04-02T07:08:15.359 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/ 2024-04-02T07:08:15.359 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 12329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-04-02T07:08:15.359 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/ 2024-04-02T07:08:15.360 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 384137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-04-02T07:08:15.360 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-04-02T07:08:15.360 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-04-02T07:08:15.360 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-04-02T07:08:15.360 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/ 2024-04-02T07:08:15.360 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-04-02T07:08:15.360 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/phonet/ 2024-04-02T07:08:15.360 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 112521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/phonet/phonet.ko 2024-04-02T07:08:15.360 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/phonet/pn_pep.ko 2024-04-02T07:08:15.360 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/ 2024-04-02T07:08:15.360 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 253881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-04-02T07:08:15.360 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 165049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-04-02T07:08:15.360 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 68065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-04-02T07:08:15.360 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rxrpc/ 2024-04-02T07:08:15.361 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 828145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rxrpc/rxrpc.ko 2024-04-02T07:08:15.361 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/ 2024-04-02T07:08:15.361 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-04-02T07:08:15.361 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-04-02T07:08:15.361 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 37081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-04-02T07:08:15.361 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-04-02T07:08:15.361 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 43345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-04-02T07:08:15.361 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-04-02T07:08:15.361 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-04-02T07:08:15.361 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-04-02T07:08:15.361 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-04-02T07:08:15.361 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-04-02T07:08:15.361 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-04-02T07:08:15.361 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 19177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_cgroup.ko 2024-04-02T07:08:15.362 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-04-02T07:08:15.362 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-04-02T07:08:15.362 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 39513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-04-02T07:08:15.362 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 62649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-04-02T07:08:15.362 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-04-02T07:08:15.362 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 13313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-04-02T07:08:15.362 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 33417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-04-02T07:08:15.362 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-04-02T07:08:15.362 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-04-02T07:08:15.362 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-04-02T07:08:15.362 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-04-02T07:08:15.362 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-04-02T07:08:15.362 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 34585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-04-02T07:08:15.363 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-04-02T07:08:15.363 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq_codel.ko 2024-04-02T07:08:15.363 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 35449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-04-02T07:08:15.363 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 49841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-04-02T07:08:15.363 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 21969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-04-02T07:08:15.363 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 66441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-04-02T07:08:15.363 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-04-02T07:08:15.363 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 30217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-04-02T07:08:15.363 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-04-02T07:08:15.363 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-04-02T07:08:15.363 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 36145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-04-02T07:08:15.363 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 27401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-04-02T07:08:15.363 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-04-02T07:08:15.363 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 24769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-04-02T07:08:15.364 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 48529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-04-02T07:08:15.364 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 32809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-04-02T07:08:15.364 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 26785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-04-02T07:08:15.364 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 31313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-04-02T07:08:15.364 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-04-02T07:08:15.364 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 28265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-04-02T07:08:15.364 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/ 2024-04-02T07:08:15.364 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 932785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-04-02T07:08:15.364 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-04-02T07:08:15.364 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/ 2024-04-02T07:08:15.364 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/ 2024-04-02T07:08:15.364 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 336969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-02T07:08:15.364 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 55009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-02T07:08:15.364 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 1513769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-04-02T07:08:15.365 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/ 2024-04-02T07:08:15.365 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 704697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-02T07:08:15.365 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/ 2024-04-02T07:08:15.365 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 10393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-04-02T07:08:15.365 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 867121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-04-02T07:08:15.365 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/ 2024-04-02T07:08:15.365 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-04-02T07:08:15.365 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/ 2024-04-02T07:08:15.365 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 87737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-02T07:08:15.365 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 67937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-02T07:08:15.365 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 98089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-04-02T07:08:15.365 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 11073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-02T07:08:15.365 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 17809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-02T07:08:15.365 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/x25/ 2024-04-02T07:08:15.366 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 131209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/x25/x25.ko 2024-04-02T07:08:15.366 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/ 2024-04-02T07:08:15.366 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_algo.ko 2024-04-02T07:08:15.366 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 20545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-02T07:08:15.366 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 105209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_user.ko 2024-04-02T07:08:15.366 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/ 2024-04-02T07:08:15.366 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/ 2024-04-02T07:08:15.366 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 15433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-04-02T07:08:15.366 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 642383 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-04-02T07:08:15.366 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 625850 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-04-02T07:08:15.366 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 7677 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-04-02T07:08:15.366 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 23498 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-04-02T07:08:15.366 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 9916 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-04-02T07:08:15.366 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 70732 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-04-02T07:08:15.367 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 147214 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-04-02T07:08:15.367 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 233213 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-04-02T07:08:15.367 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 210 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-04-02T07:08:15.367 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 72614 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-04-02T07:08:15.367 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 879 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-04-02T07:08:15.367 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 257955 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-04-02T07:08:15.367 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 312782 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-04-02T07:08:15.367 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./usr/ 2024-04-02T07:08:15.367 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./usr/share/ 2024-04-02T07:08:15.367 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./usr/share/doc/ 2024-04-02T07:08:15.367 INFO:teuthology.orchestra.run.smithi106.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./usr/share/doc/linux-image-6.8.0-g1df0c7e8a235/ 2024-04-02T07:08:15.367 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 169 2024-03-25 03:29 ./usr/share/doc/linux-image-6.8.0-g1df0c7e8a235/changelog.Debian.gz 2024-04-02T07:08:15.367 INFO:teuthology.orchestra.run.smithi106.stdout:-rw-r--r-- root/root 691 2024-03-25 03:29 ./usr/share/doc/linux-image-6.8.0-g1df0c7e8a235/copyright 2024-04-02T07:08:15.372 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-04-02T07:08:15.372 INFO:teuthology.task.kernel:searching for kernel 6.8.0-g1df0c7e8a235 2024-04-02T07:08:15.373 DEBUG:teuthology.orchestra.run.smithi106:> egrep '(submenu|menuentry.*6.8.0-g1df0c7e8a235).*{' /boot/grub/grub.cfg 2024-04-02T07:08:15.379 INFO:teuthology.orchestra.run.smithi106.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-02T07:08:15.379 INFO:teuthology.orchestra.run.smithi106.stdout: menuentry 'Ubuntu, with Linux 6.8.0-g1df0c7e8a235' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-g1df0c7e8a235-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-02T07:08:15.379 INFO:teuthology.orchestra.run.smithi106.stdout: menuentry 'Ubuntu, with Linux 6.8.0-g1df0c7e8a235 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-g1df0c7e8a235-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-02T07:08:15.380 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-02T07:08:15.380 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.8.0-g1df0c7e8a235 2024-04-02T07:08:15.380 DEBUG:teuthology.orchestra.run.smithi106:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-02T07:08:15.424 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi106.front.sepia.ceph.com to complete... 2024-04-02T07:08:15.787 INFO:teuthology.orchestra.run.smithi106.stderr:Sourcing file `/etc/default/grub' 2024-04-02T07:08:15.789 INFO:teuthology.orchestra.run.smithi106.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-02T07:08:15.814 INFO:teuthology.orchestra.run.smithi106.stderr:Generating grub configuration file ... 2024-04-02T07:08:15.977 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-6.8.0-g1df0c7e8a235 2024-04-02T07:08:15.983 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-6.8.0-g1df0c7e8a235 2024-04-02T07:08:16.231 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-02T07:08:16.236 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-02T07:08:16.280 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-02T07:08:16.285 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-02T07:08:16.408 INFO:teuthology.orchestra.run.smithi106.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-02T07:08:16.408 INFO:teuthology.orchestra.run.smithi106.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-02T07:08:16.408 INFO:teuthology.orchestra.run.smithi106.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-02T07:08:16.430 INFO:teuthology.orchestra.run.smithi106.stderr:done 2024-04-02T07:08:16.438 INFO:teuthology.orchestra.run.smithi055.stderr:Sourcing file `/etc/default/grub' 2024-04-02T07:08:16.450 INFO:teuthology.orchestra.run.smithi055.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-02T07:08:16.472 INFO:teuthology.orchestra.run.smithi055.stderr:Generating grub configuration file ... 2024-04-02T07:08:16.746 INFO:teuthology.orchestra.run.smithi055.stderr:Found linux image: /boot/vmlinuz-6.8.0-g1df0c7e8a235 2024-04-02T07:08:16.764 INFO:teuthology.orchestra.run.smithi055.stderr:Found initrd image: /boot/initrd.img-6.8.0-g1df0c7e8a235 2024-04-02T07:08:17.041 INFO:teuthology.orchestra.run.smithi055.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-02T07:08:17.047 INFO:teuthology.orchestra.run.smithi055.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-02T07:08:17.116 INFO:teuthology.orchestra.run.smithi055.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-02T07:08:17.122 INFO:teuthology.orchestra.run.smithi055.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-02T07:08:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-02T07:08:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-02T07:08:17.272 INFO:teuthology.orchestra.run.smithi055.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-02T07:08:17.313 INFO:teuthology.orchestra.run.smithi055.stderr:done 2024-04-02T07:08:17.466 DEBUG:teuthology.orchestra.run.smithi055:> dpkg-deb -c /tmp/linux-image.deb 2024-04-02T07:08:17.473 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./ 2024-04-02T07:08:17.473 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./boot/ 2024-04-02T07:08:17.473 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 4474334 2024-03-25 03:29 ./boot/System.map-6.8.0-g1df0c7e8a235 2024-04-02T07:08:17.487 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 170899 2024-03-25 03:29 ./boot/config-6.8.0-g1df0c7e8a235 2024-04-02T07:08:17.487 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11551744 2024-03-25 03:29 ./boot/vmlinuz-6.8.0-g1df0c7e8a235 2024-04-02T07:08:17.507 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./etc/ 2024-04-02T07:08:17.508 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./etc/kernel/ 2024-04-02T07:08:17.508 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./etc/kernel/postinst.d/ 2024-04-02T07:08:17.508 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./etc/kernel/postrm.d/ 2024-04-02T07:08:17.508 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./etc/kernel/preinst.d/ 2024-04-02T07:08:17.508 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./etc/kernel/prerm.d/ 2024-04-02T07:08:17.508 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/ 2024-04-02T07:08:17.508 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/ 2024-04-02T07:08:17.508 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/ 2024-04-02T07:08:17.508 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/ 2024-04-02T07:08:17.508 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/ 2024-04-02T07:08:17.508 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/ 2024-04-02T07:08:17.508 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ 2024-04-02T07:08:17.508 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 490441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/aesni-intel.ko 2024-04-02T07:08:17.511 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-02T07:08:17.511 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-02T07:08:17.511 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-02T07:08:17.511 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 93073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-02T07:08:17.511 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 106689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-02T07:08:17.511 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 152137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-02T07:08:17.511 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-02T07:08:17.511 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-02T07:08:17.511 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 83849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-02T07:08:17.511 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-02T07:08:17.511 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-02T07:08:17.512 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-02T07:08:17.512 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-02T07:08:17.512 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-02T07:08:17.512 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-02T07:08:17.512 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 58481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-02T07:08:17.512 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-02T07:08:17.512 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-02T07:08:17.512 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-02T07:08:17.512 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/ 2024-04-02T07:08:17.512 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/ 2024-04-02T07:08:17.512 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/ 2024-04-02T07:08:17.512 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-02T07:08:17.512 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpuid.ko 2024-04-02T07:08:17.512 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/msr.ko 2024-04-02T07:08:17.512 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/ 2024-04-02T07:08:17.512 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 354225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-02T07:08:17.513 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 886129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-02T07:08:17.513 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 2294793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-04-02T07:08:17.530 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ 2024-04-02T07:08:17.531 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/af_alg.ko 2024-04-02T07:08:17.531 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/algif_hash.ko 2024-04-02T07:08:17.531 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/algif_skcipher.ko 2024-04-02T07:08:17.531 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-04-02T07:08:17.531 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-04-02T07:08:17.531 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-04-02T07:08:17.531 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/asymmetric_keys/ 2024-04-02T07:08:17.531 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2024-04-02T07:08:17.531 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/ 2024-04-02T07:08:17.531 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-04-02T07:08:17.531 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-04-02T07:08:17.531 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-02T07:08:17.531 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-04-02T07:08:17.532 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-04-02T07:08:17.532 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-04-02T07:08:17.532 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-04-02T07:08:17.532 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-04-02T07:08:17.532 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-04-02T07:08:17.532 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-04-02T07:08:17.532 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-04-02T07:08:17.532 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-04-02T07:08:17.532 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-04-02T07:08:17.532 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-04-02T07:08:17.532 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-04-02T07:08:17.532 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-04-02T07:08:17.532 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-04-02T07:08:17.532 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-04-02T07:08:17.533 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cryptd.ko 2024-04-02T07:08:17.533 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-04-02T07:08:17.533 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_simd.ko 2024-04-02T07:08:17.533 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-04-02T07:08:17.533 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-04-02T07:08:17.533 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-04-02T07:08:17.533 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-04-02T07:08:17.533 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-04-02T07:08:17.533 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-04-02T07:08:17.533 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-04-02T07:08:17.533 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-04-02T07:08:17.533 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lrw.ko 2024-04-02T07:08:17.533 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-04-02T07:08:17.534 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-04-02T07:08:17.534 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-04-02T07:08:17.534 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-04-02T07:08:17.534 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-04-02T07:08:17.534 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-04-02T07:08:17.534 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-04-02T07:08:17.534 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-04-02T07:08:17.534 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-04-02T07:08:17.534 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 143025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-04-02T07:08:17.534 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-04-02T07:08:17.534 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-04-02T07:08:17.534 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-04-02T07:08:17.534 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-04-02T07:08:17.535 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-04-02T07:08:17.535 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-04-02T07:08:17.535 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-04-02T07:08:17.535 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xts.ko 2024-04-02T07:08:17.535 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-04-02T07:08:17.535 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ 2024-04-02T07:08:17.535 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ 2024-04-02T07:08:17.535 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_extlog.ko 2024-04-02T07:08:17.535 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-02T07:08:17.535 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-04-02T07:08:17.535 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/apei/ 2024-04-02T07:08:17.535 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/apei/einj.ko 2024-04-02T07:08:17.535 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-04-02T07:08:17.535 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-04-02T07:08:17.535 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-04-02T07:08:17.536 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-04-02T07:08:17.536 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 104417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-04-02T07:08:17.536 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ 2024-04-02T07:08:17.536 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-04-02T07:08:17.536 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 89929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci.ko 2024-04-02T07:08:17.536 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-04-02T07:08:17.536 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 88305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci.ko 2024-04-02T07:08:17.536 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-04-02T07:08:17.536 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-04-02T07:08:17.536 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-04-02T07:08:17.536 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-04-02T07:08:17.536 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-04-02T07:08:17.536 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-04-02T07:08:17.536 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-04-02T07:08:17.536 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-04-02T07:08:17.537 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-04-02T07:08:17.537 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-04-02T07:08:17.537 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-04-02T07:08:17.537 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-04-02T07:08:17.537 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-04-02T07:08:17.537 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-02T07:08:17.537 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-02T07:08:17.537 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-04-02T07:08:17.537 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-04-02T07:08:17.537 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-04-02T07:08:17.537 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_legacy.ko 2024-04-02T07:08:17.537 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-04-02T07:08:17.537 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-04-02T07:08:17.537 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-04-02T07:08:17.537 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-04-02T07:08:17.538 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-04-02T07:08:17.538 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-04-02T07:08:17.538 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-04-02T07:08:17.538 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-04-02T07:08:17.538 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-04-02T07:08:17.538 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-04-02T07:08:17.538 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-02T07:08:17.538 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-02T07:08:17.538 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-04-02T07:08:17.538 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_radisys.ko 2024-04-02T07:08:17.538 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-04-02T07:08:17.538 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rz1000.ko 2024-04-02T07:08:17.538 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-04-02T07:08:17.538 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-04-02T07:08:17.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-04-02T07:08:17.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-04-02T07:08:17.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-04-02T07:08:17.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-04-02T07:08:17.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-04-02T07:08:17.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-04-02T07:08:17.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 83249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-04-02T07:08:17.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-04-02T07:08:17.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-04-02T07:08:17.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-04-02T07:08:17.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-04-02T07:08:17.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-04-02T07:08:17.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-04-02T07:08:17.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-04-02T07:08:17.539 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-04-02T07:08:17.540 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-04-02T07:08:17.540 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-04-02T07:08:17.540 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-04-02T07:08:17.540 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ 2024-04-02T07:08:17.540 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-04-02T07:08:17.540 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/ 2024-04-02T07:08:17.540 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 124385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-04-02T07:08:17.540 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/ 2024-04-02T07:08:17.540 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/ 2024-04-02T07:08:17.540 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 113801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-04-02T07:08:17.540 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/ 2024-04-02T07:08:17.540 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 964745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-04-02T07:08:17.540 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 169697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-04-02T07:08:17.540 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/ 2024-04-02T07:08:17.540 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 94209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-02T07:08:17.540 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 116329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-04-02T07:08:17.541 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/ 2024-04-02T07:08:17.541 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 110321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-04-02T07:08:17.541 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 98185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-04-02T07:08:17.541 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 263633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-04-02T07:08:17.572 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/ 2024-04-02T07:08:17.572 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 98105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-02T07:08:17.572 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/ 2024-04-02T07:08:17.572 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 58761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-04-02T07:08:17.572 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ 2024-04-02T07:08:17.572 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/applicom.ko 2024-04-02T07:08:17.572 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-04-02T07:08:17.573 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/ 2024-04-02T07:08:17.573 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-02T07:08:17.573 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-02T07:08:17.573 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-02T07:08:17.573 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-04-02T07:08:17.573 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-02T07:08:17.573 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ 2024-04-02T07:08:17.573 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-02T07:08:17.573 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 148513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-02T07:08:17.573 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-02T07:08:17.573 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 139305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-02T07:08:17.573 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-02T07:08:17.573 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-02T07:08:17.573 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-04-02T07:08:17.574 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/ 2024-04-02T07:08:17.574 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 84001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-04-02T07:08:17.574 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/nvram.ko 2024-04-02T07:08:17.574 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-04-02T07:08:17.574 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-04-02T07:08:17.574 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/ 2024-04-02T07:08:17.574 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-02T07:08:17.574 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2024-04-02T07:08:17.574 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2024-04-02T07:08:17.574 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2024-04-02T07:08:17.574 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-02T07:08:17.574 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-02T07:08:17.574 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/xen-tpmfront.ko 2024-04-02T07:08:17.575 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/xillybus/ 2024-04-02T07:08:17.575 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/xillybus/xillybus_class.ko 2024-04-02T07:08:17.575 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/xillybus/xillybus_core.ko 2024-04-02T07:08:17.575 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/xillybus/xillybus_pcie.ko 2024-04-02T07:08:17.575 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/clk/ 2024-04-02T07:08:17.575 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/clk/clk-palmas.ko 2024-04-02T07:08:17.575 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/clk/clk-si5351.ko 2024-04-02T07:08:17.575 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/clk/clk-twl6040.ko 2024-04-02T07:08:17.575 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/clk/clk-wm831x.ko 2024-04-02T07:08:17.575 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/ 2024-04-02T07:08:17.575 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-02T07:08:17.575 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-02T07:08:17.575 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-02T07:08:17.575 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ 2024-04-02T07:08:17.575 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ 2024-04-02T07:08:17.576 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-02T07:08:17.576 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 246777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-04-02T07:08:17.576 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/ 2024-04-02T07:08:17.576 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/ 2024-04-02T07:08:17.576 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/ 2024-04-02T07:08:17.576 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 570217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-02T07:08:17.576 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/ 2024-04-02T07:08:17.576 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-02T07:08:17.576 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-04-02T07:08:17.576 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-04-02T07:08:17.576 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/ 2024-04-02T07:08:17.576 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-02T07:08:17.576 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/ 2024-04-02T07:08:17.576 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-04-02T07:08:17.577 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ 2024-04-02T07:08:17.577 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/ 2024-04-02T07:08:17.577 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-02T07:08:17.577 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ 2024-04-02T07:08:17.577 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 122793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-02T07:08:17.577 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ 2024-04-02T07:08:17.577 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 80297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-04-02T07:08:17.577 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-04-02T07:08:17.577 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-04-02T07:08:17.577 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-04-02T07:08:17.577 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-04-02T07:08:17.577 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-04-02T07:08:17.577 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-04-02T07:08:17.577 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-04-02T07:08:17.578 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-04-02T07:08:17.578 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-04-02T07:08:17.578 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-04-02T07:08:17.578 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 56729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-04-02T07:08:17.578 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-04-02T07:08:17.578 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/ 2024-04-02T07:08:17.578 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-gpio.ko 2024-04-02T07:08:17.578 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-max14577.ko 2024-04-02T07:08:17.578 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-max77693.ko 2024-04-02T07:08:17.578 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-max8997.ko 2024-04-02T07:08:17.578 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-palmas.ko 2024-04-02T07:08:17.578 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-rt8973a.ko 2024-04-02T07:08:17.578 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/extcon/extcon-sm5502.ko 2024-04-02T07:08:17.578 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/ 2024-04-02T07:08:17.579 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/dmi-sysfs.ko 2024-04-02T07:08:17.579 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/efi/ 2024-04-02T07:08:17.579 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/efi/efi-pstore.ko 2024-04-02T07:08:17.579 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-02T07:08:17.579 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/ 2024-04-02T07:08:17.579 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-adp5520.ko 2024-04-02T07:08:17.579 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-amd8111.ko 2024-04-02T07:08:17.579 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-arizona.ko 2024-04-02T07:08:17.579 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-da9052.ko 2024-04-02T07:08:17.579 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-da9055.ko 2024-04-02T07:08:17.579 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-dln2.ko 2024-04-02T07:08:17.579 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 77745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-f7188x.ko 2024-04-02T07:08:17.579 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-generic.ko 2024-04-02T07:08:17.580 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-04-02T07:08:17.580 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-janz-ttl.ko 2024-04-02T07:08:17.580 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-kempld.ko 2024-04-02T07:08:17.580 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-lp3943.ko 2024-04-02T07:08:17.580 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-max7300.ko 2024-04-02T07:08:17.580 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-max730x.ko 2024-04-02T07:08:17.580 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-max732x.ko 2024-04-02T07:08:17.580 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ml-ioh.ko 2024-04-02T07:08:17.580 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-pca953x.ko 2024-04-02T07:08:17.580 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-pcf857x.ko 2024-04-02T07:08:17.580 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-rdc321x.ko 2024-04-02T07:08:17.580 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-sch.ko 2024-04-02T07:08:17.580 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-sch311x.ko 2024-04-02T07:08:17.580 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-tps65912.ko 2024-04-02T07:08:17.580 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-twl4030.ko 2024-04-02T07:08:17.581 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-twl6040.ko 2024-04-02T07:08:17.581 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-02T07:08:17.581 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-vx855.ko 2024-04-02T07:08:17.581 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-wm831x.ko 2024-04-02T07:08:17.581 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-wm8350.ko 2024-04-02T07:08:17.581 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-wm8994.ko 2024-04-02T07:08:17.581 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/ 2024-04-02T07:08:17.581 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-a4tech.ko 2024-04-02T07:08:17.581 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-apple.ko 2024-04-02T07:08:17.581 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-04-02T07:08:17.581 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-04-02T07:08:17.581 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-04-02T07:08:17.581 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-belkin.ko 2024-04-02T07:08:17.581 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-cherry.ko 2024-04-02T07:08:17.582 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-chicony.ko 2024-04-02T07:08:17.582 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 60657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-cp2112.ko 2024-04-02T07:08:17.582 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-cypress.ko 2024-04-02T07:08:17.582 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-04-02T07:08:17.582 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-04-02T07:08:17.582 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-04-02T07:08:17.582 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-04-02T07:08:17.582 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ezkey.ko 2024-04-02T07:08:17.582 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-04-02T07:08:17.582 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-generic.ko 2024-04-02T07:08:17.582 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-04-02T07:08:17.582 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-04-02T07:08:17.582 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-02T07:08:17.582 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-02T07:08:17.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-04-02T07:08:17.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-04-02T07:08:17.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-04-02T07:08:17.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kensington.ko 2024-04-02T07:08:17.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-04-02T07:08:17.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-04-02T07:08:17.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-04-02T07:08:17.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-04-02T07:08:17.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-04-02T07:08:17.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lg-g15.ko 2024-04-02T07:08:17.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-02T07:08:17.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 101537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-02T07:08:17.583 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 80897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech.ko 2024-04-02T07:08:17.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-magicmouse.ko 2024-04-02T07:08:17.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-microsoft.ko 2024-04-02T07:08:17.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-monterey.ko 2024-04-02T07:08:17.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-04-02T07:08:17.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ntrig.ko 2024-04-02T07:08:17.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-04-02T07:08:17.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-04-02T07:08:17.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-04-02T07:08:17.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 72841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-04-02T07:08:17.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-04-02T07:08:17.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-04-02T07:08:17.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-04-02T07:08:17.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-04-02T07:08:17.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-02T07:08:17.584 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-04-02T07:08:17.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-02T07:08:17.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-02T07:08:17.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-02T07:08:17.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-02T07:08:17.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-02T07:08:17.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-02T07:08:17.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-02T07:08:17.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-02T07:08:17.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-02T07:08:17.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-04-02T07:08:17.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-04-02T07:08:17.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-04-02T07:08:17.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-02T07:08:17.585 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-04-02T07:08:17.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-04-02T07:08:17.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-04-02T07:08:17.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-04-02T07:08:17.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-04-02T07:08:17.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-02T07:08:17.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-04-02T07:08:17.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-04-02T07:08:17.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-04-02T07:08:17.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-04-02T07:08:17.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-04-02T07:08:17.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-04-02T07:08:17.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 143377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-04-02T07:08:17.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-04-02T07:08:17.586 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-04-02T07:08:17.587 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-04-02T07:08:17.587 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 269209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid.ko 2024-04-02T07:08:17.587 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-04-02T07:08:17.587 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/usbhid/ 2024-04-02T07:08:17.587 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 125625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/usbhid/usbhid.ko 2024-04-02T07:08:17.587 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/usbhid/usbkbd.ko 2024-04-02T07:08:17.587 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/usbhid/usbmouse.ko 2024-04-02T07:08:17.587 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 218865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-04-02T07:08:17.587 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/ 2024-04-02T07:08:17.587 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 64297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-04-02T07:08:17.587 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 90089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-04-02T07:08:17.587 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 304913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-04-02T07:08:17.587 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ 2024-04-02T07:08:17.587 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-04-02T07:08:17.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-04-02T07:08:17.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-02T07:08:17.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-04-02T07:08:17.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-04-02T07:08:17.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-04-02T07:08:17.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-04-02T07:08:17.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 97881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-04-02T07:08:17.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-04-02T07:08:17.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-04-02T07:08:17.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-04-02T07:08:17.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-04-02T07:08:17.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-04-02T07:08:17.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-04-02T07:08:17.588 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 74313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-04-02T07:08:17.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-04-02T07:08:17.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 69305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-04-02T07:08:17.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-04-02T07:08:17.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-04-02T07:08:17.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-04-02T07:08:17.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-04-02T07:08:17.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 58521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-04-02T07:08:17.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-02T07:08:17.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-04-02T07:08:17.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-04-02T07:08:17.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/da9052-hwmon.ko 2024-04-02T07:08:17.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/da9055-hwmon.ko 2024-04-02T07:08:17.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-02T07:08:17.589 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 99505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-04-02T07:08:17.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-04-02T07:08:17.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-04-02T07:08:17.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-04-02T07:08:17.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc2103.ko 2024-04-02T07:08:17.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-04-02T07:08:17.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-04-02T07:08:17.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 94593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-04-02T07:08:17.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-04-02T07:08:17.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-04-02T07:08:17.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-04-02T07:08:17.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-04-02T07:08:17.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-04-02T07:08:17.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-04-02T07:08:17.590 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-04-02T07:08:17.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hih6130.ko 2024-04-02T07:08:17.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-02T07:08:17.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-04-02T07:08:17.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-04-02T07:08:17.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-04-02T07:08:17.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-04-02T07:08:17.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-04-02T07:08:17.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-04-02T07:08:17.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 140129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-04-02T07:08:17.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/jc42.ko 2024-04-02T07:08:17.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-04-02T07:08:17.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-04-02T07:08:17.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-04-02T07:08:17.591 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-04-02T07:08:17.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-04-02T07:08:17.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-04-02T07:08:17.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-04-02T07:08:17.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-04-02T07:08:17.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-04-02T07:08:17.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-04-02T07:08:17.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 72737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-04-02T07:08:17.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-04-02T07:08:17.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-04-02T07:08:17.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-04-02T07:08:17.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 108745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-04-02T07:08:17.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-04-02T07:08:17.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-04-02T07:08:17.592 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-04-02T07:08:17.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-04-02T07:08:17.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-04-02T07:08:17.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-04-02T07:08:17.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-04-02T07:08:17.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-04-02T07:08:17.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-04-02T07:08:17.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-04-02T07:08:17.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-04-02T07:08:17.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-04-02T07:08:17.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-04-02T07:08:17.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-04-02T07:08:17.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-04-02T07:08:17.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-04-02T07:08:17.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-04-02T07:08:17.593 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mc13783-adc.ko 2024-04-02T07:08:17.594 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-04-02T07:08:17.594 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2024-04-02T07:08:17.594 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-04-02T07:08:17.594 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 119841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-04-02T07:08:17.594 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-04-02T07:08:17.594 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-04-02T07:08:17.594 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 82713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-04-02T07:08:17.594 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-04-02T07:08:17.594 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-04-02T07:08:17.594 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ 2024-04-02T07:08:17.594 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-02T07:08:17.594 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-02T07:08:17.594 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-02T07:08:17.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-02T07:08:17.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-02T07:08:17.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-02T07:08:17.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-02T07:08:17.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 82473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-02T07:08:17.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-02T07:08:17.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-02T07:08:17.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-02T07:08:17.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-02T07:08:17.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-04-02T07:08:17.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-04-02T07:08:17.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-04-02T07:08:17.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-02T07:08:17.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-04-02T07:08:17.595 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-04-02T07:08:17.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-04-02T07:08:17.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-04-02T07:08:17.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-04-02T07:08:17.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-04-02T07:08:17.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-04-02T07:08:17.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-04-02T07:08:17.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-04-02T07:08:17.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-04-02T07:08:17.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-04-02T07:08:17.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-04-02T07:08:17.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-04-02T07:08:17.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-04-02T07:08:17.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-04-02T07:08:17.596 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-04-02T07:08:17.597 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 58257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-04-02T07:08:17.597 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 79833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-04-02T07:08:17.597 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 71249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-04-02T07:08:17.597 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 63129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-04-02T07:08:17.597 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 71225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-04-02T07:08:17.597 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 101377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-04-02T07:08:17.597 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 119409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-04-02T07:08:17.597 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-04-02T07:08:17.597 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-04-02T07:08:17.597 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/wm831x-hwmon.ko 2024-04-02T07:08:17.597 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/wm8350-hwmon.ko 2024-04-02T07:08:17.597 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/ 2024-04-02T07:08:17.597 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/ 2024-04-02T07:08:17.597 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-02T07:08:17.598 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-02T07:08:17.598 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/ 2024-04-02T07:08:17.598 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ali1535.ko 2024-04-02T07:08:17.598 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ali1563.ko 2024-04-02T07:08:17.598 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2024-04-02T07:08:17.598 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-02T07:08:17.598 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-02T07:08:17.598 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-02T07:08:17.598 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2024-04-02T07:08:17.598 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-02T07:08:17.598 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2024-04-02T07:08:17.598 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-02T07:08:17.598 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-02T07:08:17.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-02T07:08:17.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-02T07:08:17.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-dln2.ko 2024-04-02T07:08:17.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-gpio.ko 2024-04-02T07:08:17.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-02T07:08:17.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-02T07:08:17.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-02T07:08:17.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-kempld.ko 2024-04-02T07:08:17.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-02T07:08:17.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-02T07:08:17.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ocores.ko 2024-04-02T07:08:17.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-02T07:08:17.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-02T07:08:17.599 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-02T07:08:17.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2024-04-02T07:08:17.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-02T07:08:17.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-02T07:08:17.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis5595.ko 2024-04-02T07:08:17.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis630.ko 2024-04-02T07:08:17.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-02T07:08:17.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2024-04-02T07:08:17.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-02T07:08:17.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-02T07:08:17.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-02T07:08:17.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-02T07:08:17.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-xiic.ko 2024-04-02T07:08:17.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-04-02T07:08:17.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-04-02T07:08:17.600 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-04-02T07:08:17.601 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/muxes/ 2024-04-02T07:08:17.601 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2024-04-02T07:08:17.601 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2024-04-02T07:08:17.601 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2024-04-02T07:08:17.601 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ 2024-04-02T07:08:17.601 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ 2024-04-02T07:08:17.601 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 273513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-02T07:08:17.601 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 883777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-04-02T07:08:17.601 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 69177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-02T07:08:17.601 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 324233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-02T07:08:17.601 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 97825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-02T07:08:17.601 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 282329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-02T07:08:17.601 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-02T07:08:17.602 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/ 2024-04-02T07:08:17.602 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/ 2024-04-02T07:08:17.602 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 493129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-02T07:08:17.602 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/ 2024-04-02T07:08:17.602 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 420529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-02T07:08:17.628 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/ 2024-04-02T07:08:17.628 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 741609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-02T07:08:17.628 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ 2024-04-02T07:08:17.628 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 296785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-02T07:08:17.628 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/ocrdma/ 2024-04-02T07:08:17.628 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 153705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2024-04-02T07:08:17.628 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/usnic/ 2024-04-02T07:08:17.628 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 169089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2024-04-02T07:08:17.628 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ 2024-04-02T07:08:17.628 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ 2024-04-02T07:08:17.629 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 266529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-02T07:08:17.629 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ 2024-04-02T07:08:17.629 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 100257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-02T07:08:17.629 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ 2024-04-02T07:08:17.629 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 111329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-02T07:08:17.629 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ 2024-04-02T07:08:17.629 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 128657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-02T07:08:17.629 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ 2024-04-02T07:08:17.629 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 129793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-02T07:08:17.629 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/ 2024-04-02T07:08:17.629 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/evbug.ko 2024-04-02T07:08:17.629 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/ff-memless.ko 2024-04-02T07:08:17.629 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/ 2024-04-02T07:08:17.629 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-02T07:08:17.630 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-02T07:08:17.630 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-04-02T07:08:17.630 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-04-02T07:08:17.630 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/ 2024-04-02T07:08:17.630 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/adp5520-keys.ko 2024-04-02T07:08:17.630 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/adp5588-keys.ko 2024-04-02T07:08:17.630 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/adp5589-keys.ko 2024-04-02T07:08:17.630 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2024-04-02T07:08:17.630 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-02T07:08:17.630 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2024-04-02T07:08:17.630 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/lkkbd.ko 2024-04-02T07:08:17.630 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/lm8323.ko 2024-04-02T07:08:17.631 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/lm8333.ko 2024-04-02T07:08:17.631 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/matrix_keypad.ko 2024-04-02T07:08:17.631 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/max7359_keypad.ko 2024-04-02T07:08:17.631 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/mcs_touchkey.ko 2024-04-02T07:08:17.631 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2024-04-02T07:08:17.631 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/newtonkbd.ko 2024-04-02T07:08:17.631 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/opencores-kbd.ko 2024-04-02T07:08:17.631 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/qt1070.ko 2024-04-02T07:08:17.631 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/qt2160.ko 2024-04-02T07:08:17.631 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/samsung-keypad.ko 2024-04-02T07:08:17.631 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/stowaway.ko 2024-04-02T07:08:17.631 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/sunkbd.ko 2024-04-02T07:08:17.631 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/tca6416-keypad.ko 2024-04-02T07:08:17.631 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/tca8418_keypad.ko 2024-04-02T07:08:17.632 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/twl4030_keypad.ko 2024-04-02T07:08:17.632 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/xtkbd.ko 2024-04-02T07:08:17.632 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/matrix-keymap.ko 2024-04-02T07:08:17.632 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/ 2024-04-02T07:08:17.632 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-04-02T07:08:17.632 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-04-02T07:08:17.632 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 123177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-04-02T07:08:17.632 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 89377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-02T07:08:17.632 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/gpio_mouse.ko 2024-04-02T07:08:17.632 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 335857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/psmouse.ko 2024-04-02T07:08:17.632 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-04-02T07:08:17.632 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-02T07:08:17.632 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-02T07:08:17.633 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-02T07:08:17.633 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/ 2024-04-02T07:08:17.633 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 109553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-02T07:08:17.633 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/ 2024-04-02T07:08:17.633 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-04-02T07:08:17.633 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-04-02T07:08:17.633 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/ct82c710.ko 2024-04-02T07:08:17.633 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-02T07:08:17.633 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/parkbd.ko 2024-04-02T07:08:17.633 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/pcips2.ko 2024-04-02T07:08:17.633 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/ps2mult.ko 2024-04-02T07:08:17.633 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-04-02T07:08:17.633 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serport.ko 2024-04-02T07:08:17.633 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-04-02T07:08:17.634 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/ 2024-04-02T07:08:17.634 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-88pm860x.ko 2024-04-02T07:08:17.634 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-adp5520.ko 2024-04-02T07:08:17.634 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-bd2802.ko 2024-04-02T07:08:17.634 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-04-02T07:08:17.634 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-da903x.ko 2024-04-02T07:08:17.634 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-da9052.ko 2024-04-02T07:08:17.634 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-gpio.ko 2024-04-02T07:08:17.634 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-04-02T07:08:17.634 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3533.ko 2024-04-02T07:08:17.634 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm355x.ko 2024-04-02T07:08:17.634 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3642.ko 2024-04-02T07:08:17.634 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-04-02T07:08:17.635 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp8788.ko 2024-04-02T07:08:17.635 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-max8997.ko 2024-04-02T07:08:17.635 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-mc13783.ko 2024-04-02T07:08:17.635 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-menf21bmc.ko 2024-04-02T07:08:17.635 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-pca9532.ko 2024-04-02T07:08:17.635 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-pca955x.ko 2024-04-02T07:08:17.635 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-pca963x.ko 2024-04-02T07:08:17.635 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-04-02T07:08:17.635 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-tca6507.ko 2024-04-02T07:08:17.635 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-wm831x-status.ko 2024-04-02T07:08:17.635 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-wm8350.ko 2024-04-02T07:08:17.635 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ 2024-04-02T07:08:17.635 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-02T07:08:17.635 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-02T07:08:17.636 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-02T07:08:17.636 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-02T07:08:17.636 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-02T07:08:17.636 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-02T07:08:17.636 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-02T07:08:17.636 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-02T07:08:17.636 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-02T07:08:17.636 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/ 2024-04-02T07:08:17.636 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/ 2024-04-02T07:08:17.636 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 647033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-04-02T07:08:17.636 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-04-02T07:08:17.636 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 93313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bufio.ko 2024-04-02T07:08:17.636 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-04-02T07:08:17.636 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 155801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-04-02T07:08:17.637 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 107929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-04-02T07:08:17.637 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-04-02T07:08:17.637 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-era.ko 2024-04-02T07:08:17.637 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-04-02T07:08:17.637 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-04-02T07:08:17.637 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log.ko 2024-04-02T07:08:17.637 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-mirror.ko 2024-04-02T07:08:17.637 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 77865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-04-02T07:08:17.637 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-04-02T07:08:17.637 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-04-02T07:08:17.637 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-region-hash.ko 2024-04-02T07:08:17.637 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-04-02T07:08:17.637 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-04-02T07:08:17.637 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 109433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-snapshot.ko 2024-04-02T07:08:17.637 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-04-02T07:08:17.638 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 181761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-04-02T07:08:17.638 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-04-02T07:08:17.638 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-zero.ko 2024-04-02T07:08:17.638 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/ 2024-04-02T07:08:17.638 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 199825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-02T07:08:17.638 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-04-02T07:08:17.638 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 100833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-04-02T07:08:17.638 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 126361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-04-02T07:08:17.638 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 368481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-04-02T07:08:17.638 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/ 2024-04-02T07:08:17.638 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/ 2024-04-02T07:08:17.638 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 178041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-04-02T07:08:17.639 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 63233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-04-02T07:08:17.639 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-04-02T07:08:17.639 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-04-02T07:08:17.639 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 123225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-04-02T07:08:17.639 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 80913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-04-02T07:08:17.639 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-04-02T07:08:17.639 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/ 2024-04-02T07:08:17.639 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/88pm800.ko 2024-04-02T07:08:17.639 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/88pm805.ko 2024-04-02T07:08:17.639 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/88pm80x.ko 2024-04-02T07:08:17.639 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/arizona-i2c.ko 2024-04-02T07:08:17.639 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 123625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/arizona.ko 2024-04-02T07:08:17.639 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/bcm590xx.ko 2024-04-02T07:08:17.639 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/cros_ec_dev.ko 2024-04-02T07:08:17.639 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/dln2.ko 2024-04-02T07:08:17.640 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/janz-cmodio.ko 2024-04-02T07:08:17.640 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/kempld-core.ko 2024-04-02T07:08:17.640 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lm3533-core.ko 2024-04-02T07:08:17.640 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lm3533-ctrlbank.ko 2024-04-02T07:08:17.640 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lp3943.ko 2024-04-02T07:08:17.640 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 56961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-04-02T07:08:17.640 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-04-02T07:08:17.640 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/max8907.ko 2024-04-02T07:08:17.640 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mc13xxx-core.ko 2024-04-02T07:08:17.640 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mc13xxx-i2c.ko 2024-04-02T07:08:17.640 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/menf21bmc.ko 2024-04-02T07:08:17.640 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/pcf50633-adc.ko 2024-04-02T07:08:17.640 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/pcf50633-gpio.ko 2024-04-02T07:08:17.641 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/pcf50633.ko 2024-04-02T07:08:17.641 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/rdc321x-southbridge.ko 2024-04-02T07:08:17.641 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/retu-mfd.ko 2024-04-02T07:08:17.641 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 80329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/si476x-core.ko 2024-04-02T07:08:17.641 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-04-02T07:08:17.641 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/tps65010.ko 2024-04-02T07:08:17.641 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/tps6507x.ko 2024-04-02T07:08:17.641 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-04-02T07:08:17.641 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-04-02T07:08:17.641 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-04-02T07:08:17.641 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wm8994.ko 2024-04-02T07:08:17.641 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ 2024-04-02T07:08:17.641 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ad525x_dpot-i2c.ko 2024-04-02T07:08:17.641 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ad525x_dpot.ko 2024-04-02T07:08:17.641 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/ 2024-04-02T07:08:17.642 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-02T07:08:17.642 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-04-02T07:08:17.642 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-04-02T07:08:17.642 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-04-02T07:08:17.642 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/c2port/ 2024-04-02T07:08:17.642 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2024-04-02T07:08:17.642 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/c2port/core.ko 2024-04-02T07:08:17.642 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/ 2024-04-02T07:08:17.642 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-04-02T07:08:17.642 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ds1682.ko 2024-04-02T07:08:17.642 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/dummy-irq.ko 2024-04-02T07:08:17.642 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/echo/ 2024-04-02T07:08:17.642 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/echo/echo.ko 2024-04-02T07:08:17.643 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/ 2024-04-02T07:08:17.643 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-04-02T07:08:17.643 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-02T07:08:17.643 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-04-02T07:08:17.643 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-04-02T07:08:17.643 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/genwqe/ 2024-04-02T07:08:17.643 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 152041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/genwqe/genwqe_card.ko 2024-04-02T07:08:17.643 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hmc6352.ko 2024-04-02T07:08:17.643 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-04-02T07:08:17.643 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ibmasm/ 2024-04-02T07:08:17.643 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 72505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ibmasm/ibmasm.ko 2024-04-02T07:08:17.643 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ics932s401.ko 2024-04-02T07:08:17.643 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-04-02T07:08:17.643 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-04-02T07:08:17.644 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/ 2024-04-02T07:08:17.644 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-02T07:08:17.644 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-02T07:08:17.644 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/ 2024-04-02T07:08:17.644 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 126137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-04-02T07:08:17.644 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 56361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-04-02T07:08:17.644 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 313545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-04-02T07:08:17.644 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/phantom.ko 2024-04-02T07:08:17.644 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ti-st/ 2024-04-02T07:08:17.644 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 74289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/ti-st/st_drv.ko 2024-04-02T07:08:17.644 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-04-02T07:08:17.644 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-04-02T07:08:17.644 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-04-02T07:08:17.644 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-04-02T07:08:17.645 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/ 2024-04-02T07:08:17.645 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 183513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-02T07:08:17.645 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ 2024-04-02T07:08:17.645 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/ 2024-04-02T07:08:17.645 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 491561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-04-02T07:08:17.645 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/ 2024-04-02T07:08:17.645 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/ 2024-04-02T07:08:17.645 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 105929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-02T07:08:17.645 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-02T07:08:17.645 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-02T07:08:17.645 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/ 2024-04-02T07:08:17.645 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 458905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-02T07:08:17.645 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-04-02T07:08:17.645 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-04-02T07:08:17.646 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ 2024-04-02T07:08:17.646 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/ 2024-04-02T07:08:17.646 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-02T07:08:17.646 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-02T07:08:17.646 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 130657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-02T07:08:17.646 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 68777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-02T07:08:17.646 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ 2024-04-02T07:08:17.646 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-02T07:08:17.646 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 64609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-02T07:08:17.646 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-02T07:08:17.646 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 101609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-02T07:08:17.646 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/ 2024-04-02T07:08:17.646 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-02T07:08:17.647 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/ 2024-04-02T07:08:17.647 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 69161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-02T07:08:17.647 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/ 2024-04-02T07:08:17.647 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-02T07:08:17.647 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/ 2024-04-02T07:08:17.647 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-02T07:08:17.647 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/ 2024-04-02T07:08:17.647 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-02T07:08:17.647 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-02T07:08:17.647 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 87449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-02T07:08:17.647 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/ 2024-04-02T07:08:17.647 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/ 2024-04-02T07:08:17.647 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 97185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-02T07:08:17.647 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/ 2024-04-02T07:08:17.647 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 102481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-02T07:08:17.648 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/ 2024-04-02T07:08:17.648 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 90185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-02T07:08:17.648 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/ 2024-04-02T07:08:17.648 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 81313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-02T07:08:17.648 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 69537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-02T07:08:17.648 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/ 2024-04-02T07:08:17.648 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-02T07:08:17.648 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 176689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-02T07:08:17.648 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2024-04-02T07:08:17.648 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1434449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-02T07:08:17.648 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 128361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-02T07:08:17.648 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/ 2024-04-02T07:08:17.648 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 131265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-02T07:08:17.648 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 314321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-02T07:08:17.649 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/ 2024-04-02T07:08:17.649 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/ 2024-04-02T07:08:17.649 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 323681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-02T07:08:17.649 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/ 2024-04-02T07:08:17.649 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/ 2024-04-02T07:08:17.649 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 193537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-02T07:08:17.649 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2024-04-02T07:08:17.649 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 347161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-02T07:08:17.649 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2024-04-02T07:08:17.649 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1045321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-02T07:08:17.649 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2024-04-02T07:08:17.649 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 166129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-02T07:08:17.649 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2024-04-02T07:08:17.649 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-02T07:08:17.650 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/ 2024-04-02T07:08:17.650 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/ 2024-04-02T07:08:17.650 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 204185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-02T07:08:17.650 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/ 2024-04-02T07:08:17.650 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/ 2024-04-02T07:08:17.650 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 69425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-02T07:08:17.650 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-02T07:08:17.650 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 141153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-02T07:08:17.650 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-02T07:08:17.650 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 62825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-02T07:08:17.650 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-02T07:08:17.650 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/ 2024-04-02T07:08:17.650 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 60665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-02T07:08:17.651 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 62825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-02T07:08:17.651 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-04-02T07:08:17.651 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ec_bhf.ko 2024-04-02T07:08:17.651 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/ 2024-04-02T07:08:17.651 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/ 2024-04-02T07:08:17.651 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 281193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-02T07:08:17.651 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-04-02T07:08:17.651 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-04-02T07:08:17.651 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fujitsu/ 2024-04-02T07:08:17.651 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2024-04-02T07:08:17.651 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ 2024-04-02T07:08:17.651 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 90297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-02T07:08:17.651 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/ 2024-04-02T07:08:17.651 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 295673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-02T07:08:17.651 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/ 2024-04-02T07:08:17.652 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 584297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-02T07:08:17.652 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/ 2024-04-02T07:08:17.652 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 245977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-02T07:08:17.652 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/ 2024-04-02T07:08:17.652 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 944449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-02T07:08:17.680 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/ 2024-04-02T07:08:17.680 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 288481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-02T07:08:17.680 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/ 2024-04-02T07:08:17.680 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 514337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-02T07:08:17.680 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/ 2024-04-02T07:08:17.680 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 93465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-02T07:08:17.680 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ 2024-04-02T07:08:17.680 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 735129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-02T07:08:17.680 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ 2024-04-02T07:08:17.680 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 151649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-02T07:08:17.680 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 86985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-04-02T07:08:17.681 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/ 2024-04-02T07:08:17.681 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-02T07:08:17.681 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 102433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-02T07:08:17.681 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 122601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-02T07:08:17.681 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/ 2024-04-02T07:08:17.681 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/ 2024-04-02T07:08:17.681 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 727377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-02T07:08:17.681 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 278825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-02T07:08:17.681 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/ 2024-04-02T07:08:17.681 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2024-04-02T07:08:17.681 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1122065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-02T07:08:17.681 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ 2024-04-02T07:08:17.681 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ks8842.ko 2024-04-02T07:08:17.681 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2024-04-02T07:08:17.682 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2024-04-02T07:08:17.682 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 95569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-02T07:08:17.682 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/ 2024-04-02T07:08:17.682 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/ 2024-04-02T07:08:17.682 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 108401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-02T07:08:17.682 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ 2024-04-02T07:08:17.682 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-02T07:08:17.682 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-02T07:08:17.682 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/ 2024-04-02T07:08:17.682 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 151193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-02T07:08:17.682 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/ 2024-04-02T07:08:17.682 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 136793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-02T07:08:17.682 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/ 2024-04-02T07:08:17.682 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-02T07:08:17.683 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-02T07:08:17.683 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/ 2024-04-02T07:08:17.683 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/ 2024-04-02T07:08:17.683 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 227841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-02T07:08:17.683 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 87009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-02T07:08:17.683 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2024-04-02T07:08:17.683 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 671985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-02T07:08:17.683 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/ 2024-04-02T07:08:17.683 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-02T07:08:17.683 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/ 2024-04-02T07:08:17.683 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-02T07:08:17.683 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 83801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-02T07:08:17.683 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-02T07:08:17.683 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 194057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-02T07:08:17.684 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/samsung/ 2024-04-02T07:08:17.684 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/samsung/sxgbe/ 2024-04-02T07:08:17.684 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 104001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2024-04-02T07:08:17.684 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/ 2024-04-02T07:08:17.684 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1066817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-02T07:08:17.684 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/ 2024-04-02T07:08:17.684 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-02T07:08:17.684 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/ 2024-04-02T07:08:17.684 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-02T07:08:17.684 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 63193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-02T07:08:17.684 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/ 2024-04-02T07:08:17.684 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-02T07:08:17.684 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-02T07:08:17.684 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-02T07:08:17.684 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 68041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-02T07:08:17.685 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/ 2024-04-02T07:08:17.685 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/ 2024-04-02T07:08:17.685 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2024-04-02T07:08:17.685 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-02T07:08:17.685 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2024-04-02T07:08:17.685 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 495641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-02T07:08:17.685 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/ 2024-04-02T07:08:17.685 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 103177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-02T07:08:17.685 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 166041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-02T07:08:17.685 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-02T07:08:17.685 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-02T07:08:17.685 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/ 2024-04-02T07:08:17.685 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-02T07:08:17.685 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/ 2024-04-02T07:08:17.686 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 92337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-02T07:08:17.686 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/ 2024-04-02T07:08:17.686 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 79929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-02T07:08:17.686 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 83713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-02T07:08:17.686 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/ 2024-04-02T07:08:17.686 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-02T07:08:17.686 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-02T07:08:17.686 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/ 2024-04-02T07:08:17.686 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-02T07:08:17.686 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/fddi/ 2024-04-02T07:08:17.686 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/fddi/defxx.ko 2024-04-02T07:08:17.686 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/fddi/skfp/ 2024-04-02T07:08:17.686 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 217025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/fddi/skfp/skfp.ko 2024-04-02T07:08:17.686 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 74985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-04-02T07:08:17.687 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/ 2024-04-02T07:08:17.687 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 237241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-02T07:08:17.687 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/ 2024-04-02T07:08:17.687 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-02T07:08:17.687 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-04-02T07:08:17.687 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ 2024-04-02T07:08:17.687 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 85841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-02T07:08:17.687 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 62889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-04-02T07:08:17.687 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-04-02T07:08:17.687 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/ 2024-04-02T07:08:17.687 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-02T07:08:17.687 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-02T07:08:17.687 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-gpio.ko 2024-04-02T07:08:17.688 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-02T07:08:17.688 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-04-02T07:08:17.688 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-04-02T07:08:17.688 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-04-02T07:08:17.688 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-04-02T07:08:17.688 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/ 2024-04-02T07:08:17.688 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-02T07:08:17.688 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-02T07:08:17.688 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ 2024-04-02T07:08:17.688 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-04-02T07:08:17.688 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-02T07:08:17.688 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-02T07:08:17.688 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-04-02T07:08:17.688 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-04-02T07:08:17.688 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-04-02T07:08:17.689 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-04-02T07:08:17.689 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-04-02T07:08:17.689 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-04-02T07:08:17.689 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-04-02T07:08:17.689 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 81953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-04-02T07:08:17.689 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 76561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-04-02T07:08:17.689 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-04-02T07:08:17.689 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 99001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-04-02T07:08:17.689 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-04-02T07:08:17.689 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-04-02T07:08:17.689 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-04-02T07:08:17.689 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-04-02T07:08:17.689 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-04-02T07:08:17.689 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/plip/ 2024-04-02T07:08:17.689 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/plip/plip.ko 2024-04-02T07:08:17.690 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ 2024-04-02T07:08:17.690 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-02T07:08:17.690 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-04-02T07:08:17.690 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-02T07:08:17.690 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-02T07:08:17.690 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-02T07:08:17.690 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-04-02T07:08:17.690 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-04-02T07:08:17.690 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-04-02T07:08:17.690 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sb1000.ko 2024-04-02T07:08:17.690 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/ 2024-04-02T07:08:17.690 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-04-02T07:08:17.690 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-04-02T07:08:17.690 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 64553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-04-02T07:08:17.691 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/ 2024-04-02T07:08:17.691 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 107225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-04-02T07:08:17.691 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-02T07:08:17.691 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-02T07:08:17.691 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-02T07:08:17.691 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-04-02T07:08:17.691 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-02T07:08:17.691 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 86817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-04-02T07:08:17.691 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/ 2024-04-02T07:08:17.691 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 144345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-02T07:08:17.691 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/ 2024-04-02T07:08:17.691 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 307169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-04-02T07:08:17.691 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/ 2024-04-02T07:08:17.691 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 143993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-02T07:08:17.691 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ 2024-04-02T07:08:17.692 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-04-02T07:08:17.692 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/ 2024-04-02T07:08:17.692 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/ 2024-04-02T07:08:17.692 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 267721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-04-02T07:08:17.692 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 103353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-04-02T07:08:17.692 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/ 2024-04-02T07:08:17.692 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 131297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-04-02T07:08:17.692 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-04-02T07:08:17.692 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 85209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-04-02T07:08:17.692 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-04-02T07:08:17.692 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/ 2024-04-02T07:08:17.692 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/ 2024-04-02T07:08:17.692 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-02T07:08:17.692 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2024-04-02T07:08:17.693 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2024-04-02T07:08:17.693 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pci-stub.ko 2024-04-02T07:08:17.693 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-04-02T07:08:17.693 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/ 2024-04-02T07:08:17.693 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-04-02T07:08:17.693 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 146129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pcmcia.ko 2024-04-02T07:08:17.693 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 62065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pcmcia_core.ko 2024-04-02T07:08:17.693 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2024-04-02T07:08:17.693 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-04-02T07:08:17.693 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 112785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-02T07:08:17.693 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/phy/ 2024-04-02T07:08:17.693 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/phy/broadcom/ 2024-04-02T07:08:17.693 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2024-04-02T07:08:17.693 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/phy/samsung/ 2024-04-02T07:08:17.693 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2024-04-02T07:08:17.694 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/ 2024-04-02T07:08:17.694 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/ 2024-04-02T07:08:17.694 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 69025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-02T07:08:17.694 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/ 2024-04-02T07:08:17.694 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/ 2024-04-02T07:08:17.694 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2024-04-02T07:08:17.694 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros_ec.ko 2024-04-02T07:08:17.694 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2024-04-02T07:08:17.694 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2024-04-02T07:08:17.694 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2024-04-02T07:08:17.694 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2024-04-02T07:08:17.694 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2024-04-02T07:08:17.694 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/ 2024-04-02T07:08:17.694 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-02T07:08:17.695 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-04-02T07:08:17.695 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-02T07:08:17.695 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-02T07:08:17.695 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-02T07:08:17.695 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 131937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-02T07:08:17.695 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-02T07:08:17.695 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-02T07:08:17.695 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-02T07:08:17.695 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-02T07:08:17.695 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-02T07:08:17.695 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-04-02T07:08:17.695 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/ibm_rtl.ko 2024-04-02T07:08:17.695 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/ 2024-04-02T07:08:17.695 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-02T07:08:17.696 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2024-04-02T07:08:17.696 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-04-02T07:08:17.696 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-02T07:08:17.696 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-02T07:08:17.696 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-02T07:08:17.696 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-02T07:08:17.696 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-02T07:08:17.696 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-02T07:08:17.696 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-02T07:08:17.696 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-02T07:08:17.696 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-02T07:08:17.696 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-04-02T07:08:17.696 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/ 2024-04-02T07:08:17.696 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/ 2024-04-02T07:08:17.697 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/88pm860x_battery.ko 2024-04-02T07:08:17.697 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/88pm860x_charger.ko 2024-04-02T07:08:17.697 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/bq2415x_charger.ko 2024-04-02T07:08:17.697 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/bq24190_charger.ko 2024-04-02T07:08:17.697 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/bq24735-charger.ko 2024-04-02T07:08:17.697 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/cros_peripheral_charger.ko 2024-04-02T07:08:17.697 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/da9030_battery.ko 2024-04-02T07:08:17.697 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/da9052-battery.ko 2024-04-02T07:08:17.697 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/ds2760_battery.ko 2024-04-02T07:08:17.697 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/ds2780_battery.ko 2024-04-02T07:08:17.697 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/ds2781_battery.ko 2024-04-02T07:08:17.697 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/ds2782_battery.ko 2024-04-02T07:08:17.697 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/gpio-charger.ko 2024-04-02T07:08:17.697 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/isp1704_charger.ko 2024-04-02T07:08:17.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/lp8727_charger.ko 2024-04-02T07:08:17.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/max14577_charger.ko 2024-04-02T07:08:17.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/max17042_battery.ko 2024-04-02T07:08:17.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/max8903_charger.ko 2024-04-02T07:08:17.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/max8925_power.ko 2024-04-02T07:08:17.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/pcf50633-charger.ko 2024-04-02T07:08:17.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/sbs-battery.ko 2024-04-02T07:08:17.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/test_power.ko 2024-04-02T07:08:17.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/tps65090-charger.ko 2024-04-02T07:08:17.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/wm831x_backup.ko 2024-04-02T07:08:17.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/wm831x_power.ko 2024-04-02T07:08:17.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/power/supply/wm8350_power.ko 2024-04-02T07:08:17.698 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/ 2024-04-02T07:08:17.698 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 58097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-02T07:08:17.699 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-02T07:08:17.699 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/ 2024-04-02T07:08:17.699 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/ 2024-04-02T07:08:17.699 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-02T07:08:17.699 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-02T07:08:17.699 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-04-02T07:08:17.699 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-04-02T07:08:17.699 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ 2024-04-02T07:08:17.699 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-04-02T07:08:17.699 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-04-02T07:08:17.699 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/ 2024-04-02T07:08:17.699 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-88pm80x.ko 2024-04-02T07:08:17.699 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-88pm860x.ko 2024-04-02T07:08:17.699 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-02T07:08:17.699 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-da9052.ko 2024-04-02T07:08:17.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-da9055.ko 2024-04-02T07:08:17.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-da9063.ko 2024-04-02T07:08:17.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-02T07:08:17.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 68473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-02T07:08:17.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-02T07:08:17.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-02T07:08:17.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-02T07:08:17.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-02T07:08:17.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-02T07:08:17.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-02T07:08:17.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-02T07:08:17.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-04-02T07:08:17.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-02T07:08:17.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-02T07:08:17.700 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-02T07:08:17.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-lp8788.ko 2024-04-02T07:08:17.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-02T07:08:17.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-02T07:08:17.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-02T07:08:17.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t86.ko 2024-04-02T07:08:17.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-04-02T07:08:17.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max8907.ko 2024-04-02T07:08:17.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max8925.ko 2024-04-02T07:08:17.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max8997.ko 2024-04-02T07:08:17.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max8998.ko 2024-04-02T07:08:17.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-mc13xxx.ko 2024-04-02T07:08:17.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-02T07:08:17.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-palmas.ko 2024-04-02T07:08:17.701 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-02T07:08:17.702 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf50633.ko 2024-04-02T07:08:17.702 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-02T07:08:17.702 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-02T07:08:17.702 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-02T07:08:17.702 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-02T07:08:17.702 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rc5t583.ko 2024-04-02T07:08:17.702 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-02T07:08:17.702 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-02T07:08:17.702 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-02T07:08:17.702 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-02T07:08:17.702 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-02T07:08:17.702 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-s35390a.ko 2024-04-02T07:08:17.702 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-02T07:08:17.702 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-tps6586x.ko 2024-04-02T07:08:17.702 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-tps65910.ko 2024-04-02T07:08:17.703 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-wm831x.ko 2024-04-02T07:08:17.703 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-wm8350.ko 2024-04-02T07:08:17.703 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-04-02T07:08:17.703 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ 2024-04-02T07:08:17.703 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 77521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-04-02T07:08:17.703 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-04-02T07:08:17.703 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-04-02T07:08:17.703 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 135249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-04-02T07:08:17.703 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-04-02T07:08:17.703 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/ 2024-04-02T07:08:17.703 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 271385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-02T07:08:17.703 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 100529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-04-02T07:08:17.703 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/ 2024-04-02T07:08:17.704 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 356833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-02T07:08:17.704 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 295889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-02T07:08:17.704 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic94xx/ 2024-04-02T07:08:17.704 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 189089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic94xx/aic94xx.ko 2024-04-02T07:08:17.704 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-04-02T07:08:17.704 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/ 2024-04-02T07:08:17.704 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 108193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-02T07:08:17.704 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-04-02T07:08:17.704 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/ 2024-04-02T07:08:17.704 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 246913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-02T07:08:17.704 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/ 2024-04-02T07:08:17.704 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1171857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-04-02T07:08:17.704 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/ 2024-04-02T07:08:17.704 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 238369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-02T07:08:17.712 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/ 2024-04-02T07:08:17.712 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 115305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-02T07:08:17.712 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-04-02T07:08:17.712 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/ 2024-04-02T07:08:17.712 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 308905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-02T07:08:17.713 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/ 2024-04-02T07:08:17.713 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/ 2024-04-02T07:08:17.713 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 76033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-02T07:08:17.713 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/ 2024-04-02T07:08:17.713 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 101417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-02T07:08:17.713 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 146745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-02T07:08:17.713 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 75969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-04-02T07:08:17.713 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-04-02T07:08:17.713 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/ 2024-04-02T07:08:17.713 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 212329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-02T07:08:17.713 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 60497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-04-02T07:08:17.713 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/ 2024-04-02T07:08:17.713 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-02T07:08:17.713 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 157713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-02T07:08:17.714 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fdomain.ko 2024-04-02T07:08:17.714 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/ 2024-04-02T07:08:17.714 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 294881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-04-02T07:08:17.714 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 201721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-04-02T07:08:17.714 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-04-02T07:08:17.714 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-04-02T07:08:17.714 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/imm.ko 2024-04-02T07:08:17.714 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-04-02T07:08:17.714 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 265937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-04-02T07:08:17.714 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 101873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-04-02T07:08:17.714 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/ 2024-04-02T07:08:17.714 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 317129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-04-02T07:08:17.714 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-02T07:08:17.715 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-02T07:08:17.715 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/ 2024-04-02T07:08:17.715 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 315273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-04-02T07:08:17.715 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 145489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-04-02T07:08:17.715 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-02T07:08:17.715 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/ 2024-04-02T07:08:17.715 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 216345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-04-02T07:08:17.715 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/ 2024-04-02T07:08:17.715 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 2193953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-02T07:08:17.715 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/ 2024-04-02T07:08:17.715 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-02T07:08:17.715 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-02T07:08:17.715 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 310665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-02T07:08:17.715 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 85513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-04-02T07:08:17.716 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/ 2024-04-02T07:08:17.716 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 659585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-02T07:08:17.716 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/ 2024-04-02T07:08:17.716 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 119465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-02T07:08:17.716 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-04-02T07:08:17.716 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pcmcia/ 2024-04-02T07:08:17.716 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 81545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2024-04-02T07:08:17.716 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2024-04-02T07:08:17.716 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2024-04-02T07:08:17.716 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2024-04-02T07:08:17.716 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/ 2024-04-02T07:08:17.716 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 366305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-02T07:08:17.716 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 124593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-04-02T07:08:17.716 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ppa.ko 2024-04-02T07:08:17.716 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-04-02T07:08:17.717 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/ 2024-04-02T07:08:17.717 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1876657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-02T07:08:17.717 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 85185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-02T07:08:17.717 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/ 2024-04-02T07:08:17.717 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 558897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-02T07:08:17.717 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qlogicfas408.ko 2024-04-02T07:08:17.717 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-04-02T07:08:17.717 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 261073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-04-02T07:08:17.717 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 173921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-02T07:08:17.717 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 280105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-02T07:08:17.717 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 97617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-02T07:08:17.717 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-02T07:08:17.717 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-02T07:08:17.717 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-04-02T07:08:17.718 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 115641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-04-02T07:08:17.718 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-04-02T07:08:17.718 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/ 2024-04-02T07:08:17.718 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 164865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-02T07:08:17.718 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-04-02T07:08:17.718 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-02T07:08:17.718 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-04-02T07:08:17.718 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/xen-scsifront.ko 2024-04-02T07:08:17.718 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ 2024-04-02T07:08:17.718 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 129345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-04-02T07:08:17.718 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/ 2024-04-02T07:08:17.718 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/ 2024-04-02T07:08:17.718 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 736665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-02T07:08:17.718 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/ 2024-04-02T07:08:17.719 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-02T07:08:17.719 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-04-02T07:08:17.719 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-04-02T07:08:17.719 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 931433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-04-02T07:08:17.719 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-04-02T07:08:17.719 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 122481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-04-02T07:08:17.746 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/ 2024-04-02T07:08:17.747 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 75497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-02T07:08:17.747 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/ 2024-04-02T07:08:17.747 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/ 2024-04-02T07:08:17.747 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/ 2024-04-02T07:08:17.747 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-02T07:08:17.747 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-02T07:08:17.747 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-02T07:08:17.747 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-02T07:08:17.747 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-02T07:08:17.747 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-02T07:08:17.747 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-02T07:08:17.747 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-02T07:08:17.747 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-02T07:08:17.747 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-02T07:08:17.748 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-02T07:08:17.748 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-02T07:08:17.748 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-02T07:08:17.748 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-02T07:08:17.748 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-02T07:08:17.748 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_powerclamp.ko 2024-04-02T07:08:17.748 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-02T07:08:17.748 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-02T07:08:17.748 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-02T07:08:17.748 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ 2024-04-02T07:08:17.748 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ 2024-04-02T07:08:17.748 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-02T07:08:17.748 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/moxa.ko 2024-04-02T07:08:17.748 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/mxser.ko 2024-04-02T07:08:17.748 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 108481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-04-02T07:08:17.749 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-04-02T07:08:17.749 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-04-02T07:08:17.749 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/ 2024-04-02T07:08:17.749 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/ 2024-04-02T07:08:17.749 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/8250_dw.ko 2024-04-02T07:08:17.749 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-02T07:08:17.749 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/altera_jtaguart.ko 2024-04-02T07:08:17.749 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/altera_uart.ko 2024-04-02T07:08:17.749 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-04-02T07:08:17.749 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 72545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/fsl_lpuart.ko 2024-04-02T07:08:17.749 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/ 2024-04-02T07:08:17.749 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 101969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-02T07:08:17.749 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/rp2.ko 2024-04-02T07:08:17.749 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/sc16is7xx.ko 2024-04-02T07:08:17.750 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/ 2024-04-02T07:08:17.750 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ 2024-04-02T07:08:17.750 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 545377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-02T07:08:17.750 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ 2024-04-02T07:08:17.750 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-02T07:08:17.750 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2024-04-02T07:08:17.750 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/ 2024-04-02T07:08:17.750 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-04-02T07:08:17.750 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-04-02T07:08:17.750 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-04-02T07:08:17.750 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_dmem_genirq.ko 2024-04-02T07:08:17.750 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_mf624.ko 2024-04-02T07:08:17.750 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_netx.ko 2024-04-02T07:08:17.750 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-04-02T07:08:17.751 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pdrv_genirq.ko 2024-04-02T07:08:17.751 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-04-02T07:08:17.751 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/ 2024-04-02T07:08:17.751 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/c67x00/ 2024-04-02T07:08:17.751 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/c67x00/c67x00.ko 2024-04-02T07:08:17.751 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/chipidea/ 2024-04-02T07:08:17.751 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 145753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/chipidea/ci_hdrc.ko 2024-04-02T07:08:17.751 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2024-04-02T07:08:17.751 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/chipidea/ci_hdrc_npcm.ko 2024-04-02T07:08:17.751 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2024-04-02T07:08:17.751 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2024-04-02T07:08:17.751 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/ 2024-04-02T07:08:17.751 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 87001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-04-02T07:08:17.751 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-02T07:08:17.751 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-04-02T07:08:17.752 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 89761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-04-02T07:08:17.752 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/common/ 2024-04-02T07:08:17.752 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/common/ulpi.ko 2024-04-02T07:08:17.752 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/dwc2/ 2024-04-02T07:08:17.752 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/dwc2/dwc2_pci.ko 2024-04-02T07:08:17.752 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/dwc3/ 2024-04-02T07:08:17.752 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/dwc3/dwc3-haps.ko 2024-04-02T07:08:17.752 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/dwc3/dwc3-pci.ko 2024-04-02T07:08:17.752 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 452785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/dwc3/dwc3.ko 2024-04-02T07:08:17.752 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/ 2024-04-02T07:08:17.752 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/ 2024-04-02T07:08:17.752 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 60321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/u_ether.ko 2024-04-02T07:08:17.752 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/u_serial.ko 2024-04-02T07:08:17.752 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2024-04-02T07:08:17.753 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2024-04-02T07:08:17.753 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2024-04-02T07:08:17.753 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2024-04-02T07:08:17.753 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 92401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2024-04-02T07:08:17.753 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 50937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2024-04-02T07:08:17.753 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 122241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2024-04-02T07:08:17.753 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2024-04-02T07:08:17.753 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2024-04-02T07:08:17.753 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2024-04-02T07:08:17.753 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2024-04-02T07:08:17.753 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 85505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2024-04-02T07:08:17.753 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2024-04-02T07:08:17.753 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 58009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2024-04-02T07:08:17.753 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2024-04-02T07:08:17.753 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/ 2024-04-02T07:08:17.754 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2024-04-02T07:08:17.754 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2024-04-02T07:08:17.754 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2024-04-02T07:08:17.754 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_ether.ko 2024-04-02T07:08:17.754 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2024-04-02T07:08:17.754 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_hid.ko 2024-04-02T07:08:17.754 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2024-04-02T07:08:17.754 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2024-04-02T07:08:17.754 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2024-04-02T07:08:17.754 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_printer.ko 2024-04-02T07:08:17.754 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_serial.ko 2024-04-02T07:08:17.754 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/g_zero.ko 2024-04-02T07:08:17.754 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 62361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2024-04-02T07:08:17.754 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2024-04-02T07:08:17.754 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 161193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/libcomposite.ko 2024-04-02T07:08:17.755 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/ 2024-04-02T07:08:17.755 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2024-04-02T07:08:17.755 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/bdc/ 2024-04-02T07:08:17.755 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 157593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2024-04-02T07:08:17.755 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/goku_udc.ko 2024-04-02T07:08:17.755 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/gr_udc.ko 2024-04-02T07:08:17.755 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 69609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2024-04-02T07:08:17.755 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/mv_udc.ko 2024-04-02T07:08:17.755 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 75961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/net2272.ko 2024-04-02T07:08:17.755 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 74977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/net2280.ko 2024-04-02T07:08:17.755 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 73009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/pch_udc.ko 2024-04-02T07:08:17.755 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 65873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2024-04-02T07:08:17.755 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 65993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2024-04-02T07:08:17.755 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 81401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2024-04-02T07:08:17.755 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 156321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/gadget/udc/udc-core.ko 2024-04-02T07:08:17.756 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/ 2024-04-02T07:08:17.756 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/bcma-hcd.ko 2024-04-02T07:08:17.756 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 80009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/isp116x-hcd.ko 2024-04-02T07:08:17.756 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 87249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/oxu210hp-hcd.ko 2024-04-02T07:08:17.756 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/r8a66597-hcd.ko 2024-04-02T07:08:17.756 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-02T07:08:17.756 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811_cs.ko 2024-04-02T07:08:17.756 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/ssb-hcd.ko 2024-04-02T07:08:17.756 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/xhci-plat-hcd.ko 2024-04-02T07:08:17.756 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/ 2024-04-02T07:08:17.756 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-04-02T07:08:17.756 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-04-02T07:08:17.756 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ 2024-04-02T07:08:17.756 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-04-02T07:08:17.756 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-04-02T07:08:17.757 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/cypress_cy7c63.ko 2024-04-02T07:08:17.757 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/cytherm.ko 2024-04-02T07:08:17.757 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ehset.ko 2024-04-02T07:08:17.757 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-04-02T07:08:17.757 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-04-02T07:08:17.757 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-04-02T07:08:17.757 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-04-02T07:08:17.757 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-04-02T07:08:17.757 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-02T07:08:17.757 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-04-02T07:08:17.757 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-04-02T07:08:17.757 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/lvstest.ko 2024-04-02T07:08:17.757 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/ 2024-04-02T07:08:17.757 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 64737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-02T07:08:17.757 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-02T07:08:17.758 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-04-02T07:08:17.758 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-04-02T07:08:17.758 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-02T07:08:17.758 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbtest.ko 2024-04-02T07:08:17.758 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-04-02T07:08:17.758 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-04-02T07:08:17.758 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/mon/ 2024-04-02T07:08:17.758 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 72801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/mon/usbmon.ko 2024-04-02T07:08:17.758 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/musb/ 2024-04-02T07:08:17.758 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 301593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/musb/musb_hdrc.ko 2024-04-02T07:08:17.758 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/ 2024-04-02T07:08:17.758 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-04-02T07:08:17.758 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2024-04-02T07:08:17.758 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-isp1301.ko 2024-04-02T07:08:17.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-tahvo.ko 2024-04-02T07:08:17.759 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ 2024-04-02T07:08:17.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-04-02T07:08:17.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-04-02T07:08:17.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-02T07:08:17.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-04-02T07:08:17.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-04-02T07:08:17.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-04-02T07:08:17.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 58113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-02T07:08:17.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-02T07:08:17.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-04-02T07:08:17.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/f81232.ko 2024-04-02T07:08:17.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 175097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-02T07:08:17.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-02T07:08:17.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 136977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-02T07:08:17.759 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 124737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-04-02T07:08:17.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-04-02T07:08:17.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-04-02T07:08:17.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-04-02T07:08:17.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 58129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-02T07:08:17.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 107425 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-04-02T07:08:17.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-02T07:08:17.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-02T07:08:17.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-02T07:08:17.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-04-02T07:08:17.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/metro-usb.ko 2024-04-02T07:08:17.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-04-02T07:08:17.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 78121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-04-02T07:08:17.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 56241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mxuport.ko 2024-04-02T07:08:17.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-04-02T07:08:17.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-04-02T07:08:17.760 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-04-02T07:08:17.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 191817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-04-02T07:08:17.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-04-02T07:08:17.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-04-02T07:08:17.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-04-02T07:08:17.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-04-02T07:08:17.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-04-02T07:08:17.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-04-02T07:08:17.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-04-02T07:08:17.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-02T07:08:17.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-04-02T07:08:17.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-04-02T07:08:17.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-02T07:08:17.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-02T07:08:17.761 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-04-02T07:08:17.762 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-02T07:08:17.762 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 125513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usbserial.ko 2024-04-02T07:08:17.762 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-04-02T07:08:17.762 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-04-02T07:08:17.762 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/wishbone-serial.ko 2024-04-02T07:08:17.762 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-02T07:08:17.762 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ 2024-04-02T07:08:17.762 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 52753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-04-02T07:08:17.762 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-02T07:08:17.762 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-02T07:08:17.762 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-02T07:08:17.762 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-02T07:08:17.763 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-02T07:08:17.763 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-02T07:08:17.763 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-02T07:08:17.763 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-04-02T07:08:17.763 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-02T07:08:17.763 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-02T07:08:17.763 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-02T07:08:17.763 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-02T07:08:17.763 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-02T07:08:17.763 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 180281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-04-02T07:08:17.763 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/ 2024-04-02T07:08:17.763 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-02T07:08:17.763 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 71001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-02T07:08:17.763 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 103977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-02T07:08:17.763 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/ 2024-04-02T07:08:17.764 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/ 2024-04-02T07:08:17.764 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 162841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-02T07:08:17.764 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-02T07:08:17.764 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 103649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-04-02T07:08:17.764 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 76433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-02T07:08:17.764 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/ 2024-04-02T07:08:17.764 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 113657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-04-02T07:08:17.764 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-02T07:08:17.764 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 57993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-04-02T07:08:17.764 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 89049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-04-02T07:08:17.764 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/ 2024-04-02T07:08:17.764 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/ 2024-04-02T07:08:17.764 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/88pm860x_bl.ko 2024-04-02T07:08:17.764 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/aat2870_bl.ko 2024-04-02T07:08:17.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/adp5520_bl.ko 2024-04-02T07:08:17.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/adp8860_bl.ko 2024-04-02T07:08:17.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/adp8870_bl.ko 2024-04-02T07:08:17.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-04-02T07:08:17.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/as3711_bl.ko 2024-04-02T07:08:17.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/bd6107.ko 2024-04-02T07:08:17.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/da903x_bl.ko 2024-04-02T07:08:17.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/da9052_bl.ko 2024-04-02T07:08:17.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/gpio_backlight.ko 2024-04-02T07:08:17.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/kb3886_bl.ko 2024-04-02T07:08:17.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-04-02T07:08:17.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lm3533_bl.ko 2024-04-02T07:08:17.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lm3639_bl.ko 2024-04-02T07:08:17.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lv5207lp.ko 2024-04-02T07:08:17.765 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/max8925_bl.ko 2024-04-02T07:08:17.766 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/pandora_bl.ko 2024-04-02T07:08:17.766 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/pcf50633-backlight.ko 2024-04-02T07:08:17.766 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-02T07:08:17.766 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/wm831x_bl.ko 2024-04-02T07:08:17.766 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/ 2024-04-02T07:08:17.766 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ 2024-04-02T07:08:17.766 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-04-02T07:08:17.766 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-04-02T07:08:17.766 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/matrox_w1.ko 2024-04-02T07:08:17.766 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/w1-gpio.ko 2024-04-02T07:08:17.766 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/ 2024-04-02T07:08:17.766 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-02T07:08:17.766 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-02T07:08:17.766 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-02T07:08:17.767 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-02T07:08:17.767 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-02T07:08:17.767 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-02T07:08:17.767 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-02T07:08:17.767 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-02T07:08:17.767 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-02T07:08:17.767 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-02T07:08:17.767 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 56329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-02T07:08:17.767 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 103025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-04-02T07:08:17.767 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ 2024-04-02T07:08:17.767 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/acquirewdt.ko 2024-04-02T07:08:17.767 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/advantechwdt.ko 2024-04-02T07:08:17.767 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-02T07:08:17.767 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-02T07:08:17.767 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/cpu5wdt.ko 2024-04-02T07:08:17.768 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/da9052_wdt.ko 2024-04-02T07:08:17.768 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/da9055_wdt.ko 2024-04-02T07:08:17.768 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/da9063_wdt.ko 2024-04-02T07:08:17.768 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/dw_wdt.ko 2024-04-02T07:08:17.768 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/eurotechwdt.ko 2024-04-02T07:08:17.768 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-02T07:08:17.768 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-04-02T07:08:17.768 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-04-02T07:08:17.768 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-02T07:08:17.768 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-02T07:08:17.768 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-04-02T07:08:17.768 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-04-02T07:08:17.768 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-02T07:08:17.768 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-02T07:08:17.768 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-04-02T07:08:17.769 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/kempld_wdt.ko 2024-04-02T07:08:17.769 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-04-02T07:08:17.769 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/mena21_wdt.ko 2024-04-02T07:08:17.769 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/menf21bmc_wdt.ko 2024-04-02T07:08:17.769 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-04-02T07:08:17.769 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/of_xilinx_wdt.ko 2024-04-02T07:08:17.769 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pc87413_wdt.ko 2024-04-02T07:08:17.769 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-02T07:08:17.769 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-02T07:08:17.769 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/retu_wdt.ko 2024-04-02T07:08:17.769 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc60xxwdt.ko 2024-04-02T07:08:17.769 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_epx_c3.ko 2024-04-02T07:08:17.769 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-02T07:08:17.769 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sc1200wdt.ko 2024-04-02T07:08:17.769 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-02T07:08:17.770 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21473 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/smsc37b787_wdt.ko 2024-04-02T07:08:17.770 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-04-02T07:08:17.770 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-02T07:08:17.770 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/twl4030_wdt.ko 2024-04-02T07:08:17.770 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-04-02T07:08:17.770 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-02T07:08:17.770 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-02T07:08:17.770 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-02T07:08:17.770 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wafer5823wdt.ko 2024-04-02T07:08:17.770 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-04-02T07:08:17.770 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wm831x_wdt.ko 2024-04-02T07:08:17.770 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wm8350_wdt.ko 2024-04-02T07:08:17.770 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-04-02T07:08:17.770 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/ 2024-04-02T07:08:17.771 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-04-02T07:08:17.771 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-04-02T07:08:17.771 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-04-02T07:08:17.771 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/ 2024-04-02T07:08:17.771 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 176337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-02T07:08:17.771 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-04-02T07:08:17.771 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 71145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-scsiback.ko 2024-04-02T07:08:17.771 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/ 2024-04-02T07:08:17.771 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-02T07:08:17.771 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ 2024-04-02T07:08:17.771 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/ 2024-04-02T07:08:17.771 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 158217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-04-02T07:08:17.771 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/adfs/ 2024-04-02T07:08:17.771 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/adfs/adfs.ko 2024-04-02T07:08:17.772 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/ 2024-04-02T07:08:17.772 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 163369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-04-02T07:08:17.772 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/afs/ 2024-04-02T07:08:17.772 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1019049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/afs/kafs.ko 2024-04-02T07:08:17.772 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/autofs/ 2024-04-02T07:08:17.772 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 103185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/autofs/autofs4.ko 2024-04-02T07:08:17.772 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/ 2024-04-02T07:08:17.772 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 64585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-04-02T07:08:17.772 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/bfs/ 2024-04-02T07:08:17.772 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 41001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/bfs/bfs.ko 2024-04-02T07:08:17.772 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-04-02T07:08:17.772 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/ 2024-04-02T07:08:17.772 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 3487249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-04-02T07:08:17.777 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/ 2024-04-02T07:08:17.777 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 305841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-04-02T07:08:17.777 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ 2024-04-02T07:08:17.777 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1335577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-04-02T07:08:17.777 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/ 2024-04-02T07:08:17.777 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 97713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-04-02T07:08:17.777 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/configfs/ 2024-04-02T07:08:17.777 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 108545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/configfs/configfs.ko 2024-04-02T07:08:17.777 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/ 2024-04-02T07:08:17.777 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-04-02T07:08:17.777 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/ 2024-04-02T07:08:17.777 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 644161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-04-02T07:08:17.777 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/efs/ 2024-04-02T07:08:17.778 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/efs/efs.ko 2024-04-02T07:08:17.778 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/ 2024-04-02T07:08:17.778 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1527561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-04-02T07:08:17.778 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/ 2024-04-02T07:08:17.778 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-04-02T07:08:17.778 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/freevxfs/ 2024-04-02T07:08:17.778 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/freevxfs/freevxfs.ko 2024-04-02T07:08:17.778 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/ 2024-04-02T07:08:17.778 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-04-02T07:08:17.778 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/ 2024-04-02T07:08:17.778 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1231233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-04-02T07:08:17.778 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/ 2024-04-02T07:08:17.778 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 141625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-04-02T07:08:17.779 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/ 2024-04-02T07:08:17.779 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 223177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-04-02T07:08:17.779 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hpfs/ 2024-04-02T07:08:17.779 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 193481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hpfs/hpfs.ko 2024-04-02T07:08:17.779 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/ 2024-04-02T07:08:17.779 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 74689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-04-02T07:08:17.779 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/ 2024-04-02T07:08:17.779 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 420329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-04-02T07:08:17.779 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/ 2024-04-02T07:08:17.779 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 281617 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-04-02T07:08:17.779 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/ 2024-04-02T07:08:17.779 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 88897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-04-02T07:08:17.779 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/ 2024-04-02T07:08:17.779 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 490409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-04-02T07:08:17.779 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/ 2024-04-02T07:08:17.780 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/ 2024-04-02T07:08:17.780 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 81433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-02T07:08:17.780 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/ 2024-04-02T07:08:17.780 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-02T07:08:17.780 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/ 2024-04-02T07:08:17.780 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 117361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-02T07:08:17.780 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1058273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-04-02T07:08:17.780 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv2.ko 2024-04-02T07:08:17.780 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 120169 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-04-02T07:08:17.780 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 2041705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-04-02T07:08:17.780 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/ 2024-04-02T07:08:17.780 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-04-02T07:08:17.780 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-04-02T07:08:17.780 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/ 2024-04-02T07:08:17.780 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1511641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-04-02T07:08:17.784 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/ 2024-04-02T07:08:17.784 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 582409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-04-02T07:08:17.785 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/ 2024-04-02T07:08:17.785 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-04-02T07:08:17.785 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-04-02T07:08:17.785 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-04-02T07:08:17.785 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-04-02T07:08:17.785 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-04-02T07:08:17.785 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-04-02T07:08:17.785 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-04-02T07:08:17.785 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-04-02T07:08:17.785 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-04-02T07:08:17.785 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-04-02T07:08:17.785 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-04-02T07:08:17.785 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ascii.ko 2024-04-02T07:08:17.785 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-04-02T07:08:17.785 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-04-02T07:08:17.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-04-02T07:08:17.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-04-02T07:08:17.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-04-02T07:08:17.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-04-02T07:08:17.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-04-02T07:08:17.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-04-02T07:08:17.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-04-02T07:08:17.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-04-02T07:08:17.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-04-02T07:08:17.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-04-02T07:08:17.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-04-02T07:08:17.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-04-02T07:08:17.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-04-02T07:08:17.786 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-04-02T07:08:17.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-04-02T07:08:17.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-04-02T07:08:17.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 94033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-04-02T07:08:17.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 142569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-04-02T07:08:17.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 165641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-04-02T07:08:17.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 118017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-04-02T07:08:17.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-04-02T07:08:17.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-04-02T07:08:17.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-04-02T07:08:17.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-04-02T07:08:17.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-04-02T07:08:17.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-04-02T07:08:17.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-04-02T07:08:17.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-04-02T07:08:17.787 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-04-02T07:08:17.788 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-04-02T07:08:17.788 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-04-02T07:08:17.788 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-04-02T07:08:17.788 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-04-02T07:08:17.788 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-04-02T07:08:17.788 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-04-02T07:08:17.788 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-02T07:08:17.788 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-04-02T07:08:17.788 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ntfs/ 2024-04-02T07:08:17.788 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 220457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ntfs/ntfs.ko 2024-04-02T07:08:17.788 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ 2024-04-02T07:08:17.788 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ 2024-04-02T07:08:17.788 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 244633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-02T07:08:17.788 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ 2024-04-02T07:08:17.789 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 440633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-02T07:08:17.789 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ 2024-04-02T07:08:17.789 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-02T07:08:17.789 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 2590681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-04-02T07:08:17.790 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-02T07:08:17.790 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-02T07:08:17.790 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-02T07:08:17.791 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/omfs/ 2024-04-02T07:08:17.791 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53681 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/omfs/omfs.ko 2024-04-02T07:08:17.791 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/ 2024-04-02T07:08:17.791 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 360897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-04-02T07:08:17.792 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ 2024-04-02T07:08:17.792 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 56929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-04-02T07:08:17.792 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/qnx4/ 2024-04-02T07:08:17.792 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/qnx4/qnx4.ko 2024-04-02T07:08:17.792 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/qnx6/ 2024-04-02T07:08:17.792 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 46601 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/qnx6/qnx6.ko 2024-04-02T07:08:17.792 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/quota/ 2024-04-02T07:08:17.792 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/quota/quota_tree.ko 2024-04-02T07:08:17.792 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/quota/quota_v1.ko 2024-04-02T07:08:17.792 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/quota/quota_v2.ko 2024-04-02T07:08:17.792 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/ 2024-04-02T07:08:17.792 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 532161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-04-02T07:08:17.793 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/ 2024-04-02T07:08:17.793 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-04-02T07:08:17.793 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/ 2024-04-02T07:08:17.793 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/ 2024-04-02T07:08:17.793 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 2712385 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-04-02T07:08:17.798 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/ 2024-04-02T07:08:17.798 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-04-02T07:08:17.798 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-04-02T07:08:17.798 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/ 2024-04-02T07:08:17.798 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 134705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-04-02T07:08:17.798 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/ 2024-04-02T07:08:17.798 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 91281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-04-02T07:08:17.799 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/ 2024-04-02T07:08:17.799 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 248329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-04-02T07:08:17.799 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ 2024-04-02T07:08:17.799 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 162737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-04-02T07:08:17.799 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/ 2024-04-02T07:08:17.799 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 4035417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-04-02T07:08:17.808 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/ 2024-04-02T07:08:17.808 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/locking/ 2024-04-02T07:08:17.808 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 80481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/locking/locktorture.ko 2024-04-02T07:08:17.808 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/time/ 2024-04-02T07:08:17.808 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/time/test_udelay.ko 2024-04-02T07:08:17.808 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 60257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-04-02T07:08:17.808 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ 2024-04-02T07:08:17.809 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-04-02T07:08:17.809 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc7.ko 2024-04-02T07:08:17.809 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-04-02T07:08:17.809 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/ 2024-04-02T07:08:17.809 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-04-02T07:08:17.809 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-04-02T07:08:17.809 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/interval_tree_test.ko 2024-04-02T07:08:17.809 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-04-02T07:08:17.809 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-04-02T07:08:17.809 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/ 2024-04-02T07:08:17.809 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-04-02T07:08:17.809 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-04-02T07:08:17.809 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/ 2024-04-02T07:08:17.809 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-04-02T07:08:17.809 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/memory-notifier-error-inject.ko 2024-04-02T07:08:17.810 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/notifier-error-inject.ko 2024-04-02T07:08:17.810 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/percpu_test.ko 2024-04-02T07:08:17.810 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/pm-notifier-error-inject.ko 2024-04-02T07:08:17.810 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/ 2024-04-02T07:08:17.810 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 143257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-04-02T07:08:17.810 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/rbtree_test.ko 2024-04-02T07:08:17.810 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/ 2024-04-02T07:08:17.810 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-02T07:08:17.810 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/test-kstrtox.ko 2024-04-02T07:08:17.810 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/test-string_helpers.ko 2024-04-02T07:08:17.810 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 4863217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/test_bpf.ko 2024-04-02T07:08:17.813 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/test_firmware.ko 2024-04-02T07:08:17.813 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/test_module.ko 2024-04-02T07:08:17.813 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/test_user_copy.ko 2024-04-02T07:08:17.813 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-04-02T07:08:17.813 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-04-02T07:08:17.813 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-04-02T07:08:17.814 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/xz/ 2024-04-02T07:08:17.814 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/xz/xz_dec_test.ko 2024-04-02T07:08:17.814 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/ 2024-04-02T07:08:17.814 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-04-02T07:08:17.814 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ 2024-04-02T07:08:17.814 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/ 2024-04-02T07:08:17.814 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-04-02T07:08:17.814 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-04-02T07:08:17.814 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-04-02T07:08:17.814 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6953 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-04-02T07:08:17.814 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-02T07:08:17.814 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-04-02T07:08:17.814 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 6897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-04-02T07:08:17.814 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-04-02T07:08:17.815 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/ 2024-04-02T07:08:17.815 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-04-02T07:08:17.815 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-04-02T07:08:17.815 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-04-02T07:08:17.815 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-04-02T07:08:17.815 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-04-02T07:08:17.815 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/ 2024-04-02T07:08:17.815 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 82865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-04-02T07:08:17.815 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/ 2024-04-02T07:08:17.815 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 198809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-04-02T07:08:17.815 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-04-02T07:08:17.815 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-04-02T07:08:17.815 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-04-02T07:08:17.815 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/ 2024-04-02T07:08:17.815 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 667353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-04-02T07:08:17.817 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/ 2024-04-02T07:08:17.817 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-04-02T07:08:17.817 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 790545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-04-02T07:08:17.817 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ 2024-04-02T07:08:17.817 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-02T07:08:17.817 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-02T07:08:17.817 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-02T07:08:17.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-02T07:08:17.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-02T07:08:17.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-02T07:08:17.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-02T07:08:17.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-02T07:08:17.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-02T07:08:17.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-02T07:08:17.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-02T07:08:17.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-02T07:08:17.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-02T07:08:17.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-02T07:08:17.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-02T07:08:17.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-02T07:08:17.818 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-02T07:08:17.819 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-02T07:08:17.819 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-02T07:08:17.819 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-02T07:08:17.819 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-04-02T07:08:17.819 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-02T07:08:17.819 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-02T07:08:17.819 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/ 2024-04-02T07:08:17.819 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1046689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-04-02T07:08:17.832 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/ 2024-04-02T07:08:17.832 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 125697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-04-02T07:08:17.832 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/ 2024-04-02T07:08:17.832 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 194441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-04-02T07:08:17.832 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-04-02T07:08:17.833 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 58737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-04-02T07:08:17.833 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-04-02T07:08:17.833 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/ 2024-04-02T07:08:17.833 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 390033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-04-02T07:08:17.833 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-04-02T07:08:17.833 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12593 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-04-02T07:08:17.833 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-04-02T07:08:17.833 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-04-02T07:08:17.833 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/hsr/ 2024-04-02T07:08:17.833 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 102033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/hsr/hsr.ko 2024-04-02T07:08:17.833 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ 2024-04-02T07:08:17.833 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ 2024-04-02T07:08:17.833 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-02T07:08:17.833 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 284665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-04-02T07:08:17.834 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 47873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-02T07:08:17.834 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ 2024-04-02T07:08:17.834 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-04-02T07:08:17.834 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-04-02T07:08:17.834 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-04-02T07:08:17.834 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-04-02T07:08:17.834 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 51209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-04-02T07:08:17.834 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-04-02T07:08:17.834 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 61505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-04-02T07:08:17.834 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-04-02T07:08:17.834 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-04-02T07:08:17.834 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-04-02T07:08:17.834 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ 2024-04-02T07:08:17.834 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-02T07:08:17.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-02T07:08:17.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-02T07:08:17.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ip_tables.ko 2024-04-02T07:08:17.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-02T07:08:17.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9577 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2024-04-02T07:08:17.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-02T07:08:17.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-02T07:08:17.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14777 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-02T07:08:17.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_filter.ko 2024-04-02T07:08:17.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-02T07:08:17.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-02T07:08:17.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-02T07:08:17.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-02T07:08:17.835 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-02T07:08:17.836 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-02T07:08:17.836 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-02T07:08:17.836 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-02T07:08:17.836 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-02T07:08:17.836 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2024-04-02T07:08:17.836 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-02T07:08:17.836 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-02T07:08:17.836 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-02T07:08:17.836 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-02T07:08:17.836 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-02T07:08:17.836 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-04-02T07:08:17.836 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-04-02T07:08:17.836 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15961 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-04-02T07:08:17.836 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-04-02T07:08:17.836 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-04-02T07:08:17.837 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-04-02T07:08:17.837 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-04-02T07:08:17.837 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-04-02T07:08:17.837 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-04-02T07:08:17.837 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-04-02T07:08:17.837 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-04-02T07:08:17.837 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10849 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-04-02T07:08:17.837 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-04-02T07:08:17.837 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-04-02T07:08:17.837 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-04-02T07:08:17.837 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 45041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-04-02T07:08:17.837 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-02T07:08:17.837 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ 2024-04-02T07:08:17.837 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-04-02T07:08:17.837 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-04-02T07:08:17.838 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-04-02T07:08:17.838 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 79921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_gre.ko 2024-04-02T07:08:17.838 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 94161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-04-02T07:08:17.838 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-02T07:08:17.838 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 54265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-04-02T07:08:17.838 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-04-02T07:08:17.838 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/mip6.ko 2024-04-02T07:08:17.838 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ 2024-04-02T07:08:17.838 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-02T07:08:17.838 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2024-04-02T07:08:17.838 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-02T07:08:17.838 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14033 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-02T07:08:17.838 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-02T07:08:17.838 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-02T07:08:17.838 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16105 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-02T07:08:17.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-02T07:08:17.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-02T07:08:17.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-02T07:08:17.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-02T07:08:17.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-02T07:08:17.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-02T07:08:17.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-02T07:08:17.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15017 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-02T07:08:17.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-02T07:08:17.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-02T07:08:17.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-02T07:08:17.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-02T07:08:17.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-02T07:08:17.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-02T07:08:17.839 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-02T07:08:17.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-02T07:08:17.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-02T07:08:17.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8905 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-02T07:08:17.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 74873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-04-02T07:08:17.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-04-02T07:08:17.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-02T07:08:17.840 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/ 2024-04-02T07:08:17.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 84393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-04-02T07:08:17.840 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/ 2024-04-02T07:08:17.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 125201 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-04-02T07:08:17.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-02T07:08:17.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 25809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-04-02T07:08:17.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-04-02T07:08:17.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-04-02T07:08:17.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-04-02T07:08:17.840 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 53225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-04-02T07:08:17.841 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/lapb/ 2024-04-02T07:08:17.841 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48097 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/lapb/lapb.ko 2024-04-02T07:08:17.841 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/ 2024-04-02T07:08:17.841 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-04-02T07:08:17.841 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 268449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc2.ko 2024-04-02T07:08:17.841 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/ 2024-04-02T07:08:17.841 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 309361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-04-02T07:08:17.841 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/ 2024-04-02T07:08:17.841 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-04-02T07:08:17.841 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ 2024-04-02T07:08:17.841 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ 2024-04-02T07:08:17.841 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 119689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-04-02T07:08:17.841 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28609 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-02T07:08:17.841 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-02T07:08:17.841 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-02T07:08:17.842 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 99985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-02T07:08:17.842 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 100273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-02T07:08:17.842 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 102545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-02T07:08:17.842 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 102337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-02T07:08:17.842 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 111665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-02T07:08:17.842 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 59185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-02T07:08:17.842 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 108337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-02T07:08:17.842 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 112137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-02T07:08:17.842 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 112401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-02T07:08:17.842 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 110329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-02T07:08:17.842 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 113281 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-02T07:08:17.842 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-02T07:08:17.842 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ 2024-04-02T07:08:17.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 412433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-02T07:08:17.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11985 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-02T07:08:17.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-02T07:08:17.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-02T07:08:17.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-02T07:08:17.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-02T07:08:17.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-02T07:08:17.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-02T07:08:17.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10633 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-02T07:08:17.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9257 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-02T07:08:17.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-02T07:08:17.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13537 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-02T07:08:17.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7713 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-02T07:08:17.843 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-02T07:08:17.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-04-02T07:08:17.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 411665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-04-02T07:08:17.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15873 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-02T07:08:17.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-02T07:08:17.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-02T07:08:17.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 118145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-02T07:08:17.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-02T07:08:17.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-02T07:08:17.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 108305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-02T07:08:17.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-02T07:08:17.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17289 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-02T07:08:17.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-02T07:08:17.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-02T07:08:17.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-02T07:08:17.844 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-02T07:08:17.845 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 92217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-04-02T07:08:17.845 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-02T07:08:17.845 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-04-02T07:08:17.845 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 96489 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-04-02T07:08:17.845 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-02T07:08:17.845 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-02T07:08:17.845 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11753 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-04-02T07:08:17.845 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-04-02T07:08:17.845 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-02T07:08:17.845 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 44129 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-02T07:08:17.845 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 623337 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-04-02T07:08:17.860 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 42505 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-04-02T07:08:17.860 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30153 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-02T07:08:17.860 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_cttimeout.ko 2024-04-02T07:08:17.860 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-04-02T07:08:17.860 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 22929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-02T07:08:17.860 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49641 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-02T07:08:17.860 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-04-02T07:08:17.861 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-04-02T07:08:17.861 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 40801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-04-02T07:08:17.861 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9497 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-02T07:08:17.861 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-04-02T07:08:17.861 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-02T07:08:17.861 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-04-02T07:08:17.861 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20025 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-04-02T07:08:17.861 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-04-02T07:08:17.861 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-04-02T07:08:17.861 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14321 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-04-02T07:08:17.861 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-04-02T07:08:17.861 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11745 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_osf.ko 2024-04-02T07:08:17.861 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-04-02T07:08:17.861 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-04-02T07:08:17.862 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-04-02T07:08:17.862 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9977 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-04-02T07:08:17.862 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12833 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-04-02T07:08:17.862 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_synproxy.ko 2024-04-02T07:08:17.862 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tproxy.ko 2024-04-02T07:08:17.862 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 89225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/x_tables.ko 2024-04-02T07:08:17.862 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-04-02T07:08:17.862 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-02T07:08:17.862 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7625 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-02T07:08:17.862 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-02T07:08:17.862 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 18073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-04-02T07:08:17.862 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-04-02T07:08:17.862 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-04-02T07:08:17.863 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13273 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-04-02T07:08:17.863 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 38769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-02T07:08:17.863 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13793 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-04-02T07:08:17.863 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-04-02T07:08:17.863 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-02T07:08:17.863 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11553 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-04-02T07:08:17.863 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-04-02T07:08:17.863 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-02T07:08:17.863 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-04-02T07:08:17.863 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-02T07:08:17.863 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-04-02T07:08:17.863 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-02T07:08:17.863 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-02T07:08:17.863 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-04-02T07:08:17.864 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-04-02T07:08:17.864 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8225 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-04-02T07:08:17.864 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-04-02T07:08:17.864 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-04-02T07:08:17.864 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-04-02T07:08:17.864 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-04-02T07:08:17.864 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-04-02T07:08:17.864 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-04-02T07:08:17.864 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11249 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-04-02T07:08:17.864 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-04-02T07:08:17.864 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-04-02T07:08:17.864 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12297 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-04-02T07:08:17.864 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-04-02T07:08:17.864 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-04-02T07:08:17.864 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7761 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-04-02T07:08:17.865 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-04-02T07:08:17.865 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10561 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-04-02T07:08:17.865 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-04-02T07:08:17.865 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-04-02T07:08:17.865 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-04-02T07:08:17.865 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-04-02T07:08:17.865 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11817 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-04-02T07:08:17.865 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-04-02T07:08:17.865 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11689 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-04-02T07:08:17.865 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15945 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-04-02T07:08:17.865 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7897 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-04-02T07:08:17.865 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10113 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-04-02T07:08:17.865 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-04-02T07:08:17.865 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-04-02T07:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11721 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-04-02T07:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13729 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-04-02T07:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10001 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-04-02T07:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-04-02T07:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-04-02T07:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-04-02T07:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-04-02T07:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11889 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-04-02T07:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9377 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-04-02T07:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-04-02T07:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8161 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-04-02T07:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36353 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-04-02T07:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13233 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-04-02T07:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 29993 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-04-02T07:08:17.866 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 16809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-04-02T07:08:17.867 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9409 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-04-02T07:08:17.867 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-04-02T07:08:17.867 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8705 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-04-02T07:08:17.867 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 8449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-04-02T07:08:17.867 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15673 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpudp.ko 2024-04-02T07:08:17.867 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-04-02T07:08:17.867 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9305 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-04-02T07:08:17.867 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/ 2024-04-02T07:08:17.867 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 14433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-04-02T07:08:17.867 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/ 2024-04-02T07:08:17.867 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 12329 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-04-02T07:08:17.867 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/ 2024-04-02T07:08:17.867 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 384137 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-04-02T07:08:17.867 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10361 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-04-02T07:08:17.867 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-04-02T07:08:17.868 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11825 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-04-02T07:08:17.868 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/ 2024-04-02T07:08:17.868 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13465 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-04-02T07:08:17.868 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/phonet/ 2024-04-02T07:08:17.868 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 112521 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/phonet/phonet.ko 2024-04-02T07:08:17.868 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55041 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/phonet/pn_pep.ko 2024-04-02T07:08:17.868 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/ 2024-04-02T07:08:17.868 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 253881 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-04-02T07:08:17.868 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 165049 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-04-02T07:08:17.868 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 68065 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-04-02T07:08:17.868 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rxrpc/ 2024-04-02T07:08:17.868 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 828145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rxrpc/rxrpc.ko 2024-04-02T07:08:17.868 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/ 2024-04-02T07:08:17.868 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-04-02T07:08:17.869 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23481 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-04-02T07:08:17.869 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 37081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-04-02T07:08:17.869 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23369 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-04-02T07:08:17.869 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 43345 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-04-02T07:08:17.869 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-04-02T07:08:17.869 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20185 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-04-02T07:08:17.869 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35193 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-04-02T07:08:17.869 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36569 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-04-02T07:08:17.869 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-04-02T07:08:17.869 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33865 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-04-02T07:08:17.869 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 19177 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_cgroup.ko 2024-04-02T07:08:17.869 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-04-02T07:08:17.869 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-04-02T07:08:17.869 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 39513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-04-02T07:08:17.869 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 62649 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-04-02T07:08:17.870 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7457 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-04-02T07:08:17.870 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 13313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-04-02T07:08:17.870 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 33417 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-04-02T07:08:17.870 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7913 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-04-02T07:08:17.870 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10921 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-04-02T07:08:17.870 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-04-02T07:08:17.870 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21665 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-04-02T07:08:17.870 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20857 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-04-02T07:08:17.870 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 34585 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-04-02T07:08:17.870 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-04-02T07:08:17.870 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31513 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq_codel.ko 2024-04-02T07:08:17.870 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 35449 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-04-02T07:08:17.870 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 49841 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-04-02T07:08:17.870 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 21969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-04-02T07:08:17.870 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 66441 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-04-02T07:08:17.871 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-04-02T07:08:17.871 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 30217 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-04-02T07:08:17.871 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10801 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-04-02T07:08:17.871 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26081 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-04-02T07:08:17.871 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 36145 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-04-02T07:08:17.871 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 27401 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-04-02T07:08:17.871 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10657 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-04-02T07:08:17.871 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 24769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-04-02T07:08:17.871 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 48529 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-04-02T07:08:17.873 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 32809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-04-02T07:08:17.873 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 26785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-04-02T07:08:17.873 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 31313 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-04-02T07:08:17.873 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-04-02T07:08:17.873 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 28265 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-04-02T07:08:17.873 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/ 2024-04-02T07:08:17.873 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 932785 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-04-02T07:08:17.873 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20241 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-04-02T07:08:17.873 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/ 2024-04-02T07:08:17.874 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/ 2024-04-02T07:08:17.874 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 336969 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-02T07:08:17.874 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 55009 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-02T07:08:17.874 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 1513769 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-04-02T07:08:17.874 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/ 2024-04-02T07:08:17.874 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 704697 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-02T07:08:17.874 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/ 2024-04-02T07:08:17.874 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 10393 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-04-02T07:08:17.874 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 867121 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-04-02T07:08:17.874 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/ 2024-04-02T07:08:17.874 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15929 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-04-02T07:08:17.874 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/ 2024-04-02T07:08:17.874 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 87737 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-02T07:08:17.874 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 67937 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-02T07:08:17.875 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 98089 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-04-02T07:08:17.875 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 11073 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-02T07:08:17.875 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 17809 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-02T07:08:17.875 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/x25/ 2024-04-02T07:08:17.875 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 131209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/x25/x25.ko 2024-04-02T07:08:17.875 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/ 2024-04-02T07:08:17.875 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23057 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_algo.ko 2024-04-02T07:08:17.875 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 20545 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-02T07:08:17.875 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 105209 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_user.ko 2024-04-02T07:08:17.875 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/ 2024-04-02T07:08:17.875 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/ 2024-04-02T07:08:17.875 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 15433 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-04-02T07:08:17.875 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 642383 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-04-02T07:08:17.875 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 625850 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-04-02T07:08:17.875 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 7677 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-04-02T07:08:17.875 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 23498 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-04-02T07:08:17.876 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 9916 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-04-02T07:08:17.876 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 70732 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-04-02T07:08:17.876 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 147214 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-04-02T07:08:17.876 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 233213 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-04-02T07:08:17.876 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 210 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-04-02T07:08:17.876 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 72614 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-04-02T07:08:17.876 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 879 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-04-02T07:08:17.876 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 257955 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-04-02T07:08:17.876 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 312782 2024-03-25 03:29 ./lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-04-02T07:08:17.876 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./usr/ 2024-04-02T07:08:17.876 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./usr/share/ 2024-04-02T07:08:17.876 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./usr/share/doc/ 2024-04-02T07:08:17.876 INFO:teuthology.orchestra.run.smithi055.stdout:drwxr-xr-x root/root 0 2024-03-25 03:29 ./usr/share/doc/linux-image-6.8.0-g1df0c7e8a235/ 2024-04-02T07:08:17.876 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 169 2024-03-25 03:29 ./usr/share/doc/linux-image-6.8.0-g1df0c7e8a235/changelog.Debian.gz 2024-04-02T07:08:17.876 INFO:teuthology.orchestra.run.smithi055.stdout:-rw-r--r-- root/root 691 2024-03-25 03:29 ./usr/share/doc/linux-image-6.8.0-g1df0c7e8a235/copyright 2024-04-02T07:08:17.881 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-04-02T07:08:17.881 INFO:teuthology.task.kernel:searching for kernel 6.8.0-g1df0c7e8a235 2024-04-02T07:08:17.881 DEBUG:teuthology.orchestra.run.smithi055:> egrep '(submenu|menuentry.*6.8.0-g1df0c7e8a235).*{' /boot/grub/grub.cfg 2024-04-02T07:08:17.910 INFO:teuthology.orchestra.run.smithi055.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-02T07:08:17.910 INFO:teuthology.orchestra.run.smithi055.stdout: menuentry 'Ubuntu, with Linux 6.8.0-g1df0c7e8a235' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-g1df0c7e8a235-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-02T07:08:17.910 INFO:teuthology.orchestra.run.smithi055.stdout: menuentry 'Ubuntu, with Linux 6.8.0-g1df0c7e8a235 (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.8.0-g1df0c7e8a235-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2024-04-02T07:08:17.910 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2024-04-02T07:08:17.910 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.8.0-g1df0c7e8a235 2024-04-02T07:08:17.911 DEBUG:teuthology.orchestra.run.smithi055:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2024-04-02T07:08:17.953 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi055.front.sepia.ceph.com to complete... 2024-04-02T07:08:18.317 INFO:teuthology.orchestra.run.smithi055.stderr:Sourcing file `/etc/default/grub' 2024-04-02T07:08:18.318 INFO:teuthology.orchestra.run.smithi055.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-02T07:08:18.325 INFO:teuthology.orchestra.run.smithi055.stderr:Generating grub configuration file ... 2024-04-02T07:08:18.573 INFO:teuthology.orchestra.run.smithi055.stderr:Found linux image: /boot/vmlinuz-6.8.0-g1df0c7e8a235 2024-04-02T07:08:18.580 INFO:teuthology.orchestra.run.smithi055.stderr:Found initrd image: /boot/initrd.img-6.8.0-g1df0c7e8a235 2024-04-02T07:08:18.824 INFO:teuthology.orchestra.run.smithi055.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-02T07:08:18.829 INFO:teuthology.orchestra.run.smithi055.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-02T07:08:18.879 INFO:teuthology.orchestra.run.smithi055.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-02T07:08:18.885 INFO:teuthology.orchestra.run.smithi055.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-02T07:08:19.014 INFO:teuthology.orchestra.run.smithi055.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-02T07:08:19.014 INFO:teuthology.orchestra.run.smithi055.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-02T07:08:19.015 INFO:teuthology.orchestra.run.smithi055.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-02T07:08:19.025 INFO:teuthology.orchestra.run.smithi055.stderr:done 2024-04-02T07:08:47.646 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-02T07:08:47.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-02T07:08:47.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T07:08:50.198 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-02T07:08:50.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-04-02T07:08:50.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T07:09:06.207 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-02T07:09:08.770 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.55 2024-04-02T07:09:15.214 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-02T07:09:15.215 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T07:09:17.773 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-04-02T07:09:17.774 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T07:09:18.270 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-02T07:09:30.282 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-02T07:09:30.283 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T07:09:48.702 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-02T07:10:03.710 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-02T07:10:03.712 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T07:10:04.676 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-04-02T07:10:05.824 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-02T07:10:05.824 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.8.0-g1df0c7e8a235"... 2024-04-02T07:10:05.824 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2024-04-02T07:10:05.874 INFO:teuthology.orchestra.run.smithi106.stdout:6.8.0-g1df0c7e8a235 2024-04-02T07:10:05.874 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-04-02T07:10:05.874 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-02T07:10:05.874 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-02T07:10:06.875 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-02T07:10:06.875 DEBUG:teuthology.orchestra.run.smithi106:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-02T07:10:07.016 INFO:teuthology.orchestra.run.smithi106.stdout:ttyS1 2024-04-02T07:10:07.103 DEBUG:teuthology.parallel:result is None 2024-04-02T07:10:17.777 DEBUG:teuthology.orchestra.remote:timed out 2024-04-02T07:10:29.777 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-04-02T07:10:29.778 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T07:10:30.072 DEBUG:teuthology.orchestra.run.smithi055:> true 2024-04-02T07:10:30.807 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-04-02T07:10:30.807 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.8.0-g1df0c7e8a235"... 2024-04-02T07:10:30.808 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2024-04-02T07:10:30.856 INFO:teuthology.orchestra.run.smithi055.stdout:6.8.0-g1df0c7e8a235 2024-04-02T07:10:30.856 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-04-02T07:10:30.856 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-02T07:10:30.856 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-02T07:10:31.857 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-02T07:10:31.857 DEBUG:teuthology.orchestra.run.smithi055:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-02T07:10:31.936 INFO:teuthology.orchestra.run.smithi055.stdout:ttyS1 2024-04-02T07:10:31.979 DEBUG:teuthology.parallel:result is None 2024-04-02T07:10:31.979 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-02T07:10:31.987 INFO:teuthology.task.internal:Creating test directory... 2024-04-02T07:10:31.988 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-02T07:10:31.991 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-02T07:10:32.000 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-02T07:10:32.012 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-02T07:10:32.019 INFO:teuthology.task.internal:Creating archive directory... 2024-04-02T07:10:32.019 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-02T07:10:32.043 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-02T07:10:32.374 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-02T07:10:32.381 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-02T07:10:32.381 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-02T07:10:32.384 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-02T07:10:32.407 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-02T07:10:32.418 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-02T07:10:32.421 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-02T07:10:32.432 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-02T07:10:32.434 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-02T07:10:32.441 INFO:teuthology.task.internal:Configuring sudo... 2024-04-02T07:10:32.441 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-02T07:10:32.474 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-02T07:10:32.494 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-02T07:10:32.510 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-02T07:10:32.510 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-02T07:10:32.538 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-02T07:10:32.546 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-02T07:10:32.596 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-02T07:10:32.648 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:10:32.648 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-02T07:10:32.720 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-02T07:10:32.728 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-02T07:10:32.779 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:10:32.779 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-02T07:10:32.859 DEBUG:teuthology.orchestra.run.smithi055:> sudo service rsyslog restart 2024-04-02T07:10:32.862 DEBUG:teuthology.orchestra.run.smithi106:> sudo service rsyslog restart 2024-04-02T07:10:32.997 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-02T07:10:33.004 INFO:teuthology.task.internal:Starting timer... 2024-04-02T07:10:33.005 INFO:teuthology.run_tasks:Running task pcp... 2024-04-02T07:10:33.015 INFO:teuthology.run_tasks:Running task selinux... 2024-04-02T07:10:33.024 DEBUG:teuthology.task.selinux:Excluding smithi055: OS 'ubuntu' does not support SELinux 2024-04-02T07:10:33.024 DEBUG:teuthology.task.selinux:Excluding smithi106: OS 'ubuntu' does not support SELinux 2024-04-02T07:10:33.024 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-02T07:10:33.024 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-02T07:10:33.025 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-02T07:10:33.025 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-02T07:10:33.033 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-02T07:10:33.039 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-02T07:10:33.205 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-02T07:10:33.221 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-02T07:10:33.222 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi055.front.sepia.ceph.com,smithi106.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-02T07:18:17.551 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi055.front.sepia.ceph.com'), Remote(name='ubuntu@smithi106.front.sepia.ceph.com')] 2024-04-02T07:18:17.552 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-04-02T07:18:17.554 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T07:18:17.637 DEBUG:teuthology.orchestra.run.smithi055:> true 2024-04-02T07:18:17.749 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2024-04-02T07:18:17.749 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-02T07:18:17.750 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-02T07:18:17.832 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-04-02T07:18:17.977 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-02T07:18:17.978 INFO:teuthology.run_tasks:Running task clock... 2024-04-02T07:18:17.989 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-02T07:18:17.989 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-02T07:18:17.989 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-02T07:18:17.993 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-02T07:18:17.993 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-02T07:18:18.031 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:18 ntpd[17075]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-02T07:18:18.031 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:18 ntpd[17075]: Command line: ntpd -gq 2024-04-02T07:18:18.031 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:18 ntpd[17075]: ---------------------------------------------------- 2024-04-02T07:18:18.031 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:18 ntpd[17075]: ntp-4 is maintained by Network Time Foundation, 2024-04-02T07:18:18.031 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:18 ntpd[17075]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-02T07:18:18.031 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:18 ntpd[17075]: corporation. Support and training for ntp-4 are 2024-04-02T07:18:18.031 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:18 ntpd[17075]: available at https://www.nwtime.org/support 2024-04-02T07:18:18.031 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:18 ntpd[17075]: ---------------------------------------------------- 2024-04-02T07:18:18.032 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:18 ntpd[17075]: proto: precision = 0.043 usec (-24) 2024-04-02T07:18:18.032 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:18 ntpd[17075]: basedate set to 2022-02-04 2024-04-02T07:18:18.032 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:18 ntpd[17075]: gps base set to 2022-02-06 (week 2196) 2024-04-02T07:18:18.032 INFO:teuthology.orchestra.run.smithi055.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-02T07:18:18.033 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:18 ntpd[17075]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-02T07:18:18.033 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:18 ntpd[17075]: restrict ::: KOD does nothing without LIMITED. 2024-04-02T07:18:18.033 INFO:teuthology.orchestra.run.smithi055.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-02T07:18:18.034 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:18 ntpd[17075]: Listen and drop on 0 v6wildcard [::]:123 2024-04-02T07:18:18.034 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:18 ntpd[17075]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-02T07:18:18.034 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:18 ntpd[17075]: Listen normally on 2 lo 127.0.0.1:123 2024-04-02T07:18:18.034 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:18 ntpd[17075]: Listen normally on 3 ens1f0 172.21.15.55:123 2024-04-02T07:18:18.034 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:18 ntpd[17075]: Listen normally on 4 lo [::1]:123 2024-04-02T07:18:18.034 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:18 ntpd[17075]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:2606%4]:123 2024-04-02T07:18:18.034 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:18 ntpd[17075]: Listening on routing socket on fd #22 for interface updates 2024-04-02T07:18:18.060 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:18 ntpd[17173]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-02T07:18:18.060 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:18 ntpd[17173]: Command line: ntpd -gq 2024-04-02T07:18:18.060 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:18 ntpd[17173]: ---------------------------------------------------- 2024-04-02T07:18:18.060 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:18 ntpd[17173]: ntp-4 is maintained by Network Time Foundation, 2024-04-02T07:18:18.060 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:18 ntpd[17173]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-02T07:18:18.061 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:18 ntpd[17173]: corporation. Support and training for ntp-4 are 2024-04-02T07:18:18.061 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:18 ntpd[17173]: available at https://www.nwtime.org/support 2024-04-02T07:18:18.061 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:18 ntpd[17173]: ---------------------------------------------------- 2024-04-02T07:18:18.061 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:18 ntpd[17173]: proto: precision = 0.042 usec (-24) 2024-04-02T07:18:18.062 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:18 ntpd[17173]: basedate set to 2022-02-04 2024-04-02T07:18:18.062 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:18 ntpd[17173]: gps base set to 2022-02-06 (week 2196) 2024-04-02T07:18:18.062 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:18 ntpd[17173]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-02T07:18:18.062 INFO:teuthology.orchestra.run.smithi106.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-02T07:18:18.062 INFO:teuthology.orchestra.run.smithi106.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-02T07:18:18.062 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:18 ntpd[17173]: restrict ::: KOD does nothing without LIMITED. 2024-04-02T07:18:18.063 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:18 ntpd[17173]: Listen and drop on 0 v6wildcard [::]:123 2024-04-02T07:18:18.063 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:18 ntpd[17173]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-02T07:18:18.064 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:18 ntpd[17173]: Listen normally on 2 lo 127.0.0.1:123 2024-04-02T07:18:18.064 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:18 ntpd[17173]: Listen normally on 3 enp3s0f1 172.21.15.106:123 2024-04-02T07:18:18.064 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:18 ntpd[17173]: Listen normally on 4 lo [::1]:123 2024-04-02T07:18:18.064 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:18 ntpd[17173]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce6d%5]:123 2024-04-02T07:18:18.064 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:18 ntpd[17173]: Listening on routing socket on fd #22 for interface updates 2024-04-02T07:18:19.032 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:19 ntpd[17075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:19.032 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:19 ntpd[17075]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:19.032 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:19 ntpd[17075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:19.032 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:19 ntpd[17075]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:19.032 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:19 ntpd[17075]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-02T07:18:19.032 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:19 ntpd[17075]: can't open /var/log/ntpstats/peerstats.20240402: Permission denied 2024-04-02T07:18:19.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:19 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:19.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:19 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:19.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:19 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:19.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:19 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:19.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:19 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:19.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:19 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:19.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:19 ntpd[17173]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-02T07:18:19.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:19 ntpd[17173]: can't open /var/log/ntpstats/peerstats.20240402: Permission denied 2024-04-02T07:18:19.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:19 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:19.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:19 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:19.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:19 ntpd[17173]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-02T07:18:19.063 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:19 ntpd[17173]: can't open /var/log/ntpstats/peerstats.20240402: Permission denied 2024-04-02T07:18:20.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:20 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:20.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:20 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:20.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:20 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:20.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:20 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:20.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:20 ntpd[17173]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-02T07:18:20.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:20 ntpd[17173]: can't open /var/log/ntpstats/peerstats.20240402: Permission denied 2024-04-02T07:18:21.032 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:21 ntpd[17075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:21.032 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:21 ntpd[17075]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:21.032 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:21 ntpd[17075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:21.032 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:21 ntpd[17075]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:21.032 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:21 ntpd[17075]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-02T07:18:21.032 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:21 ntpd[17075]: can't open /var/log/ntpstats/peerstats.20240402: Permission denied 2024-04-02T07:18:21.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:21 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:21.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:21 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:21.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:21 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:21.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:21 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:21.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:21 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:21.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:21 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:21.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:21 ntpd[17173]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-02T07:18:21.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:21 ntpd[17173]: can't open /var/log/ntpstats/peerstats.20240402: Permission denied 2024-04-02T07:18:21.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:21 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:21.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:21 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:21.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:21 ntpd[17173]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-02T07:18:21.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:21 ntpd[17173]: can't open /var/log/ntpstats/peerstats.20240402: Permission denied 2024-04-02T07:18:22.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:22 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:22.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:22 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:22.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:22 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:22.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:22 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:22.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:22 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:22.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:22 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:22.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:22 ntpd[17173]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-02T07:18:22.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:22 ntpd[17173]: can't open /var/log/ntpstats/peerstats.20240402: Permission denied 2024-04-02T07:18:23.033 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:23 ntpd[17075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:23.033 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:23 ntpd[17075]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:23.033 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:23 ntpd[17075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:23.034 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:23 ntpd[17075]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:23.034 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:23 ntpd[17075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:23.034 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:23 ntpd[17075]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:23.034 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:23 ntpd[17075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:23.034 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:23 ntpd[17075]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:23.034 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:23 ntpd[17075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:23.034 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:23 ntpd[17075]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:23.034 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:23 ntpd[17075]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-02T07:18:23.034 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:23 ntpd[17075]: can't open /var/log/ntpstats/peerstats.20240402: Permission denied 2024-04-02T07:18:23.034 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:23 ntpd[17075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:23.037 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:23 ntpd[17075]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:23.037 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:23 ntpd[17075]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-02T07:18:23.037 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:23 ntpd[17075]: can't open /var/log/ntpstats/peerstats.20240402: Permission denied 2024-04-02T07:18:23.038 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:23 ntpd[17075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:23.038 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:23 ntpd[17075]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:23.038 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:23 ntpd[17075]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-02T07:18:23.038 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:23 ntpd[17075]: can't open /var/log/ntpstats/peerstats.20240402: Permission denied 2024-04-02T07:18:23.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:23 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:23.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:23 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:23.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:23 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:23.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:23 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:23.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:23 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:23.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:23 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:23.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:23 ntpd[17173]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-02T07:18:23.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:23 ntpd[17173]: can't open /var/log/ntpstats/peerstats.20240402: Permission denied 2024-04-02T07:18:23.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:23 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:23.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:23 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:23.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:23 ntpd[17173]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-02T07:18:23.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:23 ntpd[17173]: can't open /var/log/ntpstats/peerstats.20240402: Permission denied 2024-04-02T07:18:24.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:24 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:24.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:24 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:24.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:24 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:24.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:24 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:24.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:24 ntpd[17173]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-02T07:18:24.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:24 ntpd[17173]: can't open /var/log/ntpstats/peerstats.20240402: Permission denied 2024-04-02T07:18:25.032 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:25 ntpd[17075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:25.033 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:25 ntpd[17075]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:25.033 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:25 ntpd[17075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:25.033 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:25 ntpd[17075]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:25.033 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:25 ntpd[17075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:25.033 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:25 ntpd[17075]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:25.033 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:25 ntpd[17075]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:25.033 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:25 ntpd[17075]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:25.033 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:25 ntpd[17075]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-02T07:18:25.033 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:25 ntpd[17075]: can't open /var/log/ntpstats/peerstats.20240402: Permission denied 2024-04-02T07:18:25.033 INFO:teuthology.orchestra.run.smithi055.stdout: 2 Apr 07:18:25 ntpd[17075]: ntpd: time slew -0.000395 s 2024-04-02T07:18:25.034 INFO:teuthology.orchestra.run.smithi055.stdout:ntpd: time slew -0.000395s 2024-04-02T07:18:25.034 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:25 ntpd[17075]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-02T07:18:25.034 INFO:teuthology.orchestra.run.smithi055.stderr: 2 Apr 07:18:25 ntpd[17075]: can't open /var/log/ntpstats/loopstats.20240402: Permission denied 2024-04-02T07:18:25.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:25 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:25.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:25 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:25.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:25 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:25.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:25 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:25.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:25 ntpd[17173]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-02T07:18:25.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:25 ntpd[17173]: can't open /var/log/ntpstats/rawstats.20240402: Permission denied 2024-04-02T07:18:25.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:25 ntpd[17173]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-02T07:18:25.062 INFO:teuthology.orchestra.run.smithi106.stdout: 2 Apr 07:18:25 ntpd[17173]: ntpd: time slew -0.000595 s 2024-04-02T07:18:25.062 INFO:teuthology.orchestra.run.smithi106.stdout:ntpd: time slew -0.000595s 2024-04-02T07:18:25.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:25 ntpd[17173]: can't open /var/log/ntpstats/peerstats.20240402: Permission denied 2024-04-02T07:18:25.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:25 ntpd[17173]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-02T07:18:25.063 INFO:teuthology.orchestra.run.smithi106.stderr: 2 Apr 07:18:25 ntpd[17173]: can't open /var/log/ntpstats/loopstats.20240402: Permission denied 2024-04-02T07:18:25.127 INFO:teuthology.orchestra.run.smithi055.stdout: remote refid st t when poll reach delay offset jitter 2024-04-02T07:18:25.127 INFO:teuthology.orchestra.run.smithi055.stdout:============================================================================== 2024-04-02T07:18:25.127 INFO:teuthology.orchestra.run.smithi055.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-02T07:18:25.127 INFO:teuthology.orchestra.run.smithi055.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-02T07:18:25.127 INFO:teuthology.orchestra.run.smithi055.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-02T07:18:25.127 INFO:teuthology.orchestra.run.smithi055.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-02T07:18:25.166 INFO:teuthology.orchestra.run.smithi106.stdout: remote refid st t when poll reach delay offset jitter 2024-04-02T07:18:25.166 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================== 2024-04-02T07:18:25.166 INFO:teuthology.orchestra.run.smithi106.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-02T07:18:25.166 INFO:teuthology.orchestra.run.smithi106.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-02T07:18:25.166 INFO:teuthology.orchestra.run.smithi106.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-02T07:18:25.166 INFO:teuthology.orchestra.run.smithi106.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-02T07:18:25.167 INFO:teuthology.run_tasks:Running task install... 2024-04-02T07:18:25.177 DEBUG:teuthology.task.install:project ceph 2024-04-02T07:18:25.177 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd0e392d9aee635f2b65768c460c7a151ead7a5e2'}} 2024-04-02T07:18:25.178 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd0e392d9aee635f2b65768c460c7a151ead7a5e2'} 2024-04-02T07:18:25.178 INFO:teuthology.task.install:Using flavor: default 2024-04-02T07:18:25.184 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-02T07:18:25.184 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2024-04-02T07:18:25.185 DEBUG:teuthology.orchestra.run.smithi055:> sudo apt-key list | grep Ceph 2024-04-02T07:18:25.185 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-key list | grep Ceph 2024-04-02T07:18:25.290 INFO:teuthology.orchestra.run.smithi055.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-02T07:18:25.316 INFO:teuthology.orchestra.run.smithi106.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-02T07:18:25.342 INFO:teuthology.orchestra.run.smithi055.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-02T07:18:25.342 INFO:teuthology.orchestra.run.smithi055.stdout:uid [ unknown] Ceph.com (release key) 2024-04-02T07:18:25.343 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-02T07:18:25.343 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-02T07:18:25.344 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d0e392d9aee635f2b65768c460c7a151ead7a5e2 2024-04-02T07:18:25.366 INFO:teuthology.orchestra.run.smithi106.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-02T07:18:25.367 INFO:teuthology.orchestra.run.smithi106.stdout:uid [ unknown] Ceph.com (release key) 2024-04-02T07:18:25.368 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-02T07:18:25.368 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-02T07:18:25.368 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d0e392d9aee635f2b65768c460c7a151ead7a5e2 2024-04-02T07:18:25.496 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default/ 2024-04-02T07:18:25.496 INFO:teuthology.task.install.deb:Package version is 18.2.2-1015-gd0e392d9-1jammy 2024-04-02T07:18:25.584 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default/ 2024-04-02T07:18:25.584 INFO:teuthology.task.install.deb:Package version is 18.2.2-1015-gd0e392d9-1jammy 2024-04-02T07:18:25.608 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:18:25.608 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-02T07:18:25.632 DEBUG:teuthology.orchestra.run.smithi055:> sudo apt-get update 2024-04-02T07:18:25.754 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:18:25.754 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-02T07:18:25.773 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2024-04-02T07:18:25.848 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-02T07:18:25.938 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-02T07:18:25.951 INFO:teuthology.orchestra.run.smithi055.stdout:Ign:3 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy InRelease 2024-04-02T07:18:25.959 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-02T07:18:25.969 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-02T07:18:25.988 INFO:teuthology.orchestra.run.smithi055.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-02T07:18:25.990 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-02T07:18:26.003 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy InRelease 2024-04-02T07:18:26.020 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-02T07:18:26.024 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-02T07:18:26.025 INFO:teuthology.orchestra.run.smithi055.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-02T07:18:26.047 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-02T07:18:26.072 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:7 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-02T07:18:26.075 INFO:teuthology.orchestra.run.smithi055.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2024-04-02T07:18:26.086 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,407 B] 2024-04-02T07:18:26.101 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-02T07:18:26.118 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.5 kB] 2024-04-02T07:18:26.122 INFO:teuthology.orchestra.run.smithi055.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,407 B] 2024-04-02T07:18:26.452 INFO:teuthology.orchestra.run.smithi055.stdout:Fetched 28.5 kB in 1s (48.4 kB/s) 2024-04-02T07:18:26.543 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 28.5 kB in 1s (51.9 kB/s) 2024-04-02T07:18:27.453 INFO:teuthology.orchestra.run.smithi055.stdout:Reading package lists... 2024-04-02T07:18:27.469 DEBUG:teuthology.orchestra.run.smithi055:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1015-gd0e392d9-1jammy cephadm=18.2.2-1015-gd0e392d9-1jammy ceph-mds=18.2.2-1015-gd0e392d9-1jammy ceph-mgr=18.2.2-1015-gd0e392d9-1jammy ceph-common=18.2.2-1015-gd0e392d9-1jammy ceph-fuse=18.2.2-1015-gd0e392d9-1jammy ceph-test=18.2.2-1015-gd0e392d9-1jammy ceph-volume=18.2.2-1015-gd0e392d9-1jammy radosgw=18.2.2-1015-gd0e392d9-1jammy python3-rados=18.2.2-1015-gd0e392d9-1jammy python3-rgw=18.2.2-1015-gd0e392d9-1jammy python3-cephfs=18.2.2-1015-gd0e392d9-1jammy python3-rbd=18.2.2-1015-gd0e392d9-1jammy libcephfs2=18.2.2-1015-gd0e392d9-1jammy libcephfs-dev=18.2.2-1015-gd0e392d9-1jammy librados2=18.2.2-1015-gd0e392d9-1jammy librbd1=18.2.2-1015-gd0e392d9-1jammy rbd-fuse=18.2.2-1015-gd0e392d9-1jammy python3-cephfs=18.2.2-1015-gd0e392d9-1jammy cephfs-shell=18.2.2-1015-gd0e392d9-1jammy cephfs-top=18.2.2-1015-gd0e392d9-1jammy cephfs-mirror=18.2.2-1015-gd0e392d9-1jammy 2024-04-02T07:18:27.496 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-04-02T07:18:27.510 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.2.2-1015-gd0e392d9-1jammy cephadm=18.2.2-1015-gd0e392d9-1jammy ceph-mds=18.2.2-1015-gd0e392d9-1jammy ceph-mgr=18.2.2-1015-gd0e392d9-1jammy ceph-common=18.2.2-1015-gd0e392d9-1jammy ceph-fuse=18.2.2-1015-gd0e392d9-1jammy ceph-test=18.2.2-1015-gd0e392d9-1jammy ceph-volume=18.2.2-1015-gd0e392d9-1jammy radosgw=18.2.2-1015-gd0e392d9-1jammy python3-rados=18.2.2-1015-gd0e392d9-1jammy python3-rgw=18.2.2-1015-gd0e392d9-1jammy python3-cephfs=18.2.2-1015-gd0e392d9-1jammy python3-rbd=18.2.2-1015-gd0e392d9-1jammy libcephfs2=18.2.2-1015-gd0e392d9-1jammy libcephfs-dev=18.2.2-1015-gd0e392d9-1jammy librados2=18.2.2-1015-gd0e392d9-1jammy librbd1=18.2.2-1015-gd0e392d9-1jammy rbd-fuse=18.2.2-1015-gd0e392d9-1jammy python3-cephfs=18.2.2-1015-gd0e392d9-1jammy cephfs-shell=18.2.2-1015-gd0e392d9-1jammy cephfs-top=18.2.2-1015-gd0e392d9-1jammy cephfs-mirror=18.2.2-1015-gd0e392d9-1jammy 2024-04-02T07:18:27.545 INFO:teuthology.orchestra.run.smithi055.stdout:Reading package lists... 2024-04-02T07:18:27.584 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-04-02T07:18:27.719 INFO:teuthology.orchestra.run.smithi055.stdout:Building dependency tree... 2024-04-02T07:18:27.720 INFO:teuthology.orchestra.run.smithi055.stdout:Reading state information... 2024-04-02T07:18:27.755 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2024-04-02T07:18:27.755 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2024-04-02T07:18:27.895 INFO:teuthology.orchestra.run.smithi055.stdout:The following packages were automatically installed and are no longer required: 2024-04-02T07:18:27.895 INFO:teuthology.orchestra.run.smithi055.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-02T07:18:27.895 INFO:teuthology.orchestra.run.smithi055.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-02T07:18:27.895 INFO:teuthology.orchestra.run.smithi055.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-02T07:18:27.895 INFO:teuthology.orchestra.run.smithi055.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-02T07:18:27.896 INFO:teuthology.orchestra.run.smithi055.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-02T07:18:27.896 INFO:teuthology.orchestra.run.smithi055.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-02T07:18:27.896 INFO:teuthology.orchestra.run.smithi055.stdout:The following additional packages will be installed: 2024-04-02T07:18:27.896 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-02T07:18:27.896 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-02T07:18:27.896 INFO:teuthology.orchestra.run.smithi055.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-02T07:18:27.896 INFO:teuthology.orchestra.run.smithi055.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-02T07:18:27.897 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-04-02T07:18:27.898 INFO:teuthology.orchestra.run.smithi055.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-02T07:18:27.898 INFO:teuthology.orchestra.run.smithi055.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-02T07:18:27.898 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-02T07:18:27.898 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-02T07:18:27.898 INFO:teuthology.orchestra.run.smithi055.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-02T07:18:27.898 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-02T07:18:27.898 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-02T07:18:27.898 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-02T07:18:27.898 INFO:teuthology.orchestra.run.smithi055.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-02T07:18:27.898 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-02T07:18:27.898 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-02T07:18:27.898 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-02T07:18:27.899 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-02T07:18:27.899 INFO:teuthology.orchestra.run.smithi055.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-02T07:18:27.899 INFO:teuthology.orchestra.run.smithi055.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-02T07:18:27.899 INFO:teuthology.orchestra.run.smithi055.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-02T07:18:27.899 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-02T07:18:27.899 INFO:teuthology.orchestra.run.smithi055.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-02T07:18:27.899 INFO:teuthology.orchestra.run.smithi055.stdout:Suggested packages: 2024-04-02T07:18:27.899 INFO:teuthology.orchestra.run.smithi055.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-04-02T07:18:27.899 INFO:teuthology.orchestra.run.smithi055.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-04-02T07:18:27.899 INFO:teuthology.orchestra.run.smithi055.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-04-02T07:18:27.900 INFO:teuthology.orchestra.run.smithi055.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-04-02T07:18:27.900 INFO:teuthology.orchestra.run.smithi055.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-04-02T07:18:27.900 INFO:teuthology.orchestra.run.smithi055.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-04-02T07:18:27.900 INFO:teuthology.orchestra.run.smithi055.stdout: python3-watchdog 2024-04-02T07:18:27.900 INFO:teuthology.orchestra.run.smithi055.stdout:Recommended packages: 2024-04-02T07:18:27.900 INFO:teuthology.orchestra.run.smithi055.stdout: btrfs-tools 2024-04-02T07:18:27.922 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages were automatically installed and are no longer required: 2024-04-02T07:18:27.922 INFO:teuthology.orchestra.run.smithi106.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-02T07:18:27.922 INFO:teuthology.orchestra.run.smithi106.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-02T07:18:27.922 INFO:teuthology.orchestra.run.smithi106.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-02T07:18:27.922 INFO:teuthology.orchestra.run.smithi106.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-02T07:18:27.924 INFO:teuthology.orchestra.run.smithi106.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-02T07:18:27.924 INFO:teuthology.orchestra.run.smithi106.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-02T07:18:27.924 INFO:teuthology.orchestra.run.smithi106.stdout:The following additional packages will be installed: 2024-04-02T07:18:27.924 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-02T07:18:27.924 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-02T07:18:27.924 INFO:teuthology.orchestra.run.smithi106.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-02T07:18:27.924 INFO:teuthology.orchestra.run.smithi106.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-02T07:18:27.925 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2024-04-02T07:18:27.925 INFO:teuthology.orchestra.run.smithi106.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-02T07:18:27.925 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-02T07:18:27.925 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-02T07:18:27.925 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-02T07:18:27.925 INFO:teuthology.orchestra.run.smithi106.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-02T07:18:27.925 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-02T07:18:27.925 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-02T07:18:27.925 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-02T07:18:27.925 INFO:teuthology.orchestra.run.smithi106.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-02T07:18:27.925 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-02T07:18:27.925 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-02T07:18:27.925 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-02T07:18:27.925 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-02T07:18:27.926 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-02T07:18:27.926 INFO:teuthology.orchestra.run.smithi106.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-02T07:18:27.926 INFO:teuthology.orchestra.run.smithi106.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-02T07:18:27.926 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-02T07:18:27.926 INFO:teuthology.orchestra.run.smithi106.stdout: qttranslations5-l10n socat xmlstarlet 2024-04-02T07:18:27.926 INFO:teuthology.orchestra.run.smithi106.stdout:Suggested packages: 2024-04-02T07:18:27.926 INFO:teuthology.orchestra.run.smithi106.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2024-04-02T07:18:27.926 INFO:teuthology.orchestra.run.smithi106.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2024-04-02T07:18:27.926 INFO:teuthology.orchestra.run.smithi106.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2024-04-02T07:18:27.927 INFO:teuthology.orchestra.run.smithi106.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2024-04-02T07:18:27.927 INFO:teuthology.orchestra.run.smithi106.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2024-04-02T07:18:27.927 INFO:teuthology.orchestra.run.smithi106.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2024-04-02T07:18:27.927 INFO:teuthology.orchestra.run.smithi106.stdout: python3-watchdog 2024-04-02T07:18:27.927 INFO:teuthology.orchestra.run.smithi106.stdout:Recommended packages: 2024-04-02T07:18:27.927 INFO:teuthology.orchestra.run.smithi106.stdout: btrfs-tools 2024-04-02T07:18:28.051 INFO:teuthology.orchestra.run.smithi055.stdout:The following NEW packages will be installed: 2024-04-02T07:18:28.051 INFO:teuthology.orchestra.run.smithi055.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-02T07:18:28.051 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-02T07:18:28.051 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-02T07:18:28.051 INFO:teuthology.orchestra.run.smithi055.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-02T07:18:28.051 INFO:teuthology.orchestra.run.smithi055.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-02T07:18:28.051 INFO:teuthology.orchestra.run.smithi055.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-02T07:18:28.051 INFO:teuthology.orchestra.run.smithi055.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-04-02T07:18:28.053 INFO:teuthology.orchestra.run.smithi055.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-04-02T07:18:28.053 INFO:teuthology.orchestra.run.smithi055.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-02T07:18:28.053 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-02T07:18:28.053 INFO:teuthology.orchestra.run.smithi055.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-02T07:18:28.053 INFO:teuthology.orchestra.run.smithi055.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-02T07:18:28.053 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-02T07:18:28.053 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-02T07:18:28.053 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-02T07:18:28.053 INFO:teuthology.orchestra.run.smithi055.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-02T07:18:28.053 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-02T07:18:28.053 INFO:teuthology.orchestra.run.smithi055.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-02T07:18:28.053 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-02T07:18:28.053 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-02T07:18:28.053 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-02T07:18:28.054 INFO:teuthology.orchestra.run.smithi055.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-02T07:18:28.054 INFO:teuthology.orchestra.run.smithi055.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-02T07:18:28.054 INFO:teuthology.orchestra.run.smithi055.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-02T07:18:28.054 INFO:teuthology.orchestra.run.smithi055.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-02T07:18:28.054 INFO:teuthology.orchestra.run.smithi055.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-02T07:18:28.054 INFO:teuthology.orchestra.run.smithi055.stdout: socat xmlstarlet 2024-04-02T07:18:28.071 INFO:teuthology.orchestra.run.smithi106.stdout:The following NEW packages will be installed: 2024-04-02T07:18:28.072 INFO:teuthology.orchestra.run.smithi106.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-02T07:18:28.072 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-02T07:18:28.072 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-02T07:18:28.072 INFO:teuthology.orchestra.run.smithi106.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-02T07:18:28.073 INFO:teuthology.orchestra.run.smithi106.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2024-04-02T07:18:28.073 INFO:teuthology.orchestra.run.smithi106.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-02T07:18:28.073 INFO:teuthology.orchestra.run.smithi106.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2024-04-02T07:18:28.073 INFO:teuthology.orchestra.run.smithi106.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2024-04-02T07:18:28.074 INFO:teuthology.orchestra.run.smithi106.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-02T07:18:28.074 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-02T07:18:28.074 INFO:teuthology.orchestra.run.smithi106.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-02T07:18:28.074 INFO:teuthology.orchestra.run.smithi106.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-02T07:18:28.074 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-02T07:18:28.074 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-02T07:18:28.074 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-02T07:18:28.074 INFO:teuthology.orchestra.run.smithi106.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-02T07:18:28.074 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-02T07:18:28.074 INFO:teuthology.orchestra.run.smithi106.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-02T07:18:28.074 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-02T07:18:28.074 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-02T07:18:28.074 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-02T07:18:28.075 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-02T07:18:28.075 INFO:teuthology.orchestra.run.smithi106.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-02T07:18:28.075 INFO:teuthology.orchestra.run.smithi106.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-02T07:18:28.075 INFO:teuthology.orchestra.run.smithi106.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-02T07:18:28.075 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-02T07:18:28.075 INFO:teuthology.orchestra.run.smithi106.stdout: socat xmlstarlet 2024-04-02T07:18:28.248 INFO:teuthology.orchestra.run.smithi055.stdout:0 upgraded, 115 newly installed, 0 to remove and 302 not upgraded. 2024-04-02T07:18:28.248 INFO:teuthology.orchestra.run.smithi055.stdout:Need to get 162 MB of archives. 2024-04-02T07:18:28.248 INFO:teuthology.orchestra.run.smithi055.stdout:After this operation, 664 MB of additional disk space will be used. 2024-04-02T07:18:28.248 INFO:teuthology.orchestra.run.smithi055.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-02T07:18:28.268 INFO:teuthology.orchestra.run.smithi106.stdout:0 upgraded, 115 newly installed, 0 to remove and 302 not upgraded. 2024-04-02T07:18:28.269 INFO:teuthology.orchestra.run.smithi106.stdout:Need to get 162 MB of archives. 2024-04-02T07:18:28.269 INFO:teuthology.orchestra.run.smithi106.stdout:After this operation, 664 MB of additional disk space will be used. 2024-04-02T07:18:28.269 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-02T07:18:28.288 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.2-1015-gd0e392d9-1jammy [3,419 kB] 2024-04-02T07:18:28.326 INFO:teuthology.orchestra.run.smithi055.stdout:Get:2 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.2.2-1015-gd0e392d9-1jammy [3,419 kB] 2024-04-02T07:18:28.330 INFO:teuthology.orchestra.run.smithi055.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-02T07:18:28.351 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-02T07:18:28.376 INFO:teuthology.orchestra.run.smithi055.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-02T07:18:28.396 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-02T07:18:28.509 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.2-1015-gd0e392d9-1jammy [3,105 kB] 2024-04-02T07:18:28.578 INFO:teuthology.orchestra.run.smithi055.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-04-02T07:18:28.603 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2024-04-02T07:18:28.617 INFO:teuthology.orchestra.run.smithi055.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-02T07:18:28.623 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.2-1015-gd0e392d9-1jammy [674 kB] 2024-04-02T07:18:28.646 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-02T07:18:28.647 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.2-1015-gd0e392d9-1jammy [356 kB] 2024-04-02T07:18:28.663 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.2-1015-gd0e392d9-1jammy [32.8 kB] 2024-04-02T07:18:28.688 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.2-1015-gd0e392d9-1jammy [180 kB] 2024-04-02T07:18:28.692 INFO:teuthology.orchestra.run.smithi055.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-02T07:18:28.703 INFO:teuthology.orchestra.run.smithi055.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-02T07:18:28.714 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.2-1015-gd0e392d9-1jammy [63.7 kB] 2024-04-02T07:18:28.722 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-02T07:18:28.728 INFO:teuthology.orchestra.run.smithi106.stdout:Get:14 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.2-1015-gd0e392d9-1jammy [330 kB] 2024-04-02T07:18:28.733 INFO:teuthology.orchestra.run.smithi106.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-02T07:18:28.749 INFO:teuthology.orchestra.run.smithi055.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-02T07:18:28.774 INFO:teuthology.orchestra.run.smithi106.stdout:Get:16 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.2-1015-gd0e392d9-1jammy [5,892 kB] 2024-04-02T07:18:28.780 INFO:teuthology.orchestra.run.smithi106.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-02T07:18:28.915 INFO:teuthology.orchestra.run.smithi055.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-02T07:18:28.924 INFO:teuthology.orchestra.run.smithi055.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-02T07:18:28.947 INFO:teuthology.orchestra.run.smithi106.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-02T07:18:28.950 INFO:teuthology.orchestra.run.smithi055.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-02T07:18:28.955 INFO:teuthology.orchestra.run.smithi106.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-02T07:18:28.976 INFO:teuthology.orchestra.run.smithi106.stdout:Get:20 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.2-1015-gd0e392d9-1jammy [112 kB] 2024-04-02T07:18:28.977 INFO:teuthology.orchestra.run.smithi106.stdout:Get:21 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.2-1015-gd0e392d9-1jammy [441 kB] 2024-04-02T07:18:28.982 INFO:teuthology.orchestra.run.smithi106.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-02T07:18:28.992 INFO:teuthology.orchestra.run.smithi106.stdout:Get:23 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.2-1015-gd0e392d9-1jammy [22.0 MB] 2024-04-02T07:18:29.124 INFO:teuthology.orchestra.run.smithi055.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-02T07:18:29.154 INFO:teuthology.orchestra.run.smithi106.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-02T07:18:29.335 INFO:teuthology.orchestra.run.smithi055.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-02T07:18:29.359 INFO:teuthology.orchestra.run.smithi106.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-02T07:18:29.735 INFO:teuthology.orchestra.run.smithi055.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-02T07:18:29.742 INFO:teuthology.orchestra.run.smithi055.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-02T07:18:29.743 INFO:teuthology.orchestra.run.smithi055.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-02T07:18:29.755 INFO:teuthology.orchestra.run.smithi055.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-02T07:18:29.755 INFO:teuthology.orchestra.run.smithi055.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-02T07:18:29.756 INFO:teuthology.orchestra.run.smithi106.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-02T07:18:29.757 INFO:teuthology.orchestra.run.smithi055.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-02T07:18:29.758 INFO:teuthology.orchestra.run.smithi055.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-02T07:18:29.761 INFO:teuthology.orchestra.run.smithi055.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-02T07:18:29.762 INFO:teuthology.orchestra.run.smithi055.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-02T07:18:29.764 INFO:teuthology.orchestra.run.smithi106.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-02T07:18:29.764 INFO:teuthology.orchestra.run.smithi106.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-02T07:18:29.775 INFO:teuthology.orchestra.run.smithi106.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-02T07:18:29.776 INFO:teuthology.orchestra.run.smithi106.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-02T07:18:29.778 INFO:teuthology.orchestra.run.smithi106.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-02T07:18:29.780 INFO:teuthology.orchestra.run.smithi106.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-02T07:18:29.782 INFO:teuthology.orchestra.run.smithi106.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-02T07:18:29.783 INFO:teuthology.orchestra.run.smithi106.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-02T07:18:29.790 INFO:teuthology.orchestra.run.smithi106.stdout:Get:35 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.2-1015-gd0e392d9-1jammy [5,001 kB] 2024-04-02T07:18:29.927 INFO:teuthology.orchestra.run.smithi055.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-02T07:18:29.948 INFO:teuthology.orchestra.run.smithi106.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-02T07:18:29.955 INFO:teuthology.orchestra.run.smithi106.stdout:Get:37 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.2-1015-gd0e392d9-1jammy [241 kB] 2024-04-02T07:18:29.960 INFO:teuthology.orchestra.run.smithi106.stdout:Get:38 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1015-gd0e392d9-1jammy [130 kB] 2024-04-02T07:18:29.964 INFO:teuthology.orchestra.run.smithi106.stdout:Get:39 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.2-1015-gd0e392d9-1jammy [1,485 kB] 2024-04-02T07:18:30.014 INFO:teuthology.orchestra.run.smithi106.stdout:Get:40 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.2-1015-gd0e392d9-1jammy [6,078 kB] 2024-04-02T07:18:30.112 INFO:teuthology.orchestra.run.smithi055.stdout:Get:25 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.2.2-1015-gd0e392d9-1jammy [3,105 kB] 2024-04-02T07:18:30.227 INFO:teuthology.orchestra.run.smithi106.stdout:Get:41 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.2-1015-gd0e392d9-1jammy [22.3 MB] 2024-04-02T07:18:30.374 INFO:teuthology.orchestra.run.smithi055.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-02T07:18:30.384 INFO:teuthology.orchestra.run.smithi055.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-02T07:18:30.390 INFO:teuthology.orchestra.run.smithi055.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-02T07:18:30.394 INFO:teuthology.orchestra.run.smithi055.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-02T07:18:30.399 INFO:teuthology.orchestra.run.smithi106.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-02T07:18:30.410 INFO:teuthology.orchestra.run.smithi106.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-02T07:18:30.413 INFO:teuthology.orchestra.run.smithi055.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-02T07:18:30.416 INFO:teuthology.orchestra.run.smithi106.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-02T07:18:30.416 INFO:teuthology.orchestra.run.smithi055.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-02T07:18:30.418 INFO:teuthology.orchestra.run.smithi055.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-02T07:18:30.420 INFO:teuthology.orchestra.run.smithi106.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-02T07:18:30.439 INFO:teuthology.orchestra.run.smithi106.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-02T07:18:30.443 INFO:teuthology.orchestra.run.smithi106.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-02T07:18:30.445 INFO:teuthology.orchestra.run.smithi106.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-02T07:18:30.459 INFO:teuthology.orchestra.run.smithi055.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-02T07:18:30.473 INFO:teuthology.orchestra.run.smithi055.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-02T07:18:30.478 INFO:teuthology.orchestra.run.smithi055.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-02T07:18:30.484 INFO:teuthology.orchestra.run.smithi106.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-02T07:18:30.499 INFO:teuthology.orchestra.run.smithi106.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-02T07:18:30.504 INFO:teuthology.orchestra.run.smithi106.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-02T07:18:30.732 INFO:teuthology.orchestra.run.smithi055.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-02T07:18:30.758 INFO:teuthology.orchestra.run.smithi106.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-02T07:18:30.816 INFO:teuthology.orchestra.run.smithi055.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-02T07:18:30.841 INFO:teuthology.orchestra.run.smithi106.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-02T07:18:30.909 INFO:teuthology.orchestra.run.smithi055.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-02T07:18:30.938 INFO:teuthology.orchestra.run.smithi106.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-02T07:18:30.985 INFO:teuthology.orchestra.run.smithi055.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-02T07:18:31.009 INFO:teuthology.orchestra.run.smithi106.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-02T07:18:31.036 INFO:teuthology.orchestra.run.smithi106.stdout:Get:56 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.2-1015-gd0e392d9-1jammy [14.1 kB] 2024-04-02T07:18:31.036 INFO:teuthology.orchestra.run.smithi106.stdout:Get:57 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.2-1015-gd0e392d9-1jammy [826 kB] 2024-04-02T07:18:31.061 INFO:teuthology.orchestra.run.smithi106.stdout:Get:58 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.2-1015-gd0e392d9-1jammy [2,175 kB] 2024-04-02T07:18:31.087 INFO:teuthology.orchestra.run.smithi055.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-02T07:18:31.116 INFO:teuthology.orchestra.run.smithi106.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-02T07:18:31.139 INFO:teuthology.orchestra.run.smithi106.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.2-1015-gd0e392d9-1jammy [238 kB] 2024-04-02T07:18:31.147 INFO:teuthology.orchestra.run.smithi106.stdout:Get:61 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.2-1015-gd0e392d9-1jammy [144 kB] 2024-04-02T07:18:31.153 INFO:teuthology.orchestra.run.smithi106.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.2-1015-gd0e392d9-1jammy [1,931 kB] 2024-04-02T07:18:31.175 INFO:teuthology.orchestra.run.smithi055.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-02T07:18:31.193 INFO:teuthology.orchestra.run.smithi055.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-02T07:18:31.200 INFO:teuthology.orchestra.run.smithi106.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-02T07:18:31.218 INFO:teuthology.orchestra.run.smithi106.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-02T07:18:31.223 INFO:teuthology.orchestra.run.smithi055.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-02T07:18:31.225 INFO:teuthology.orchestra.run.smithi106.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1015-gd0e392d9-1jammy [8,625 kB] 2024-04-02T07:18:31.231 INFO:teuthology.orchestra.run.smithi055.stdout:Get:44 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.2.2-1015-gd0e392d9-1jammy [674 kB] 2024-04-02T07:18:31.236 INFO:teuthology.orchestra.run.smithi055.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-02T07:18:31.247 INFO:teuthology.orchestra.run.smithi106.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-02T07:18:31.259 INFO:teuthology.orchestra.run.smithi106.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-02T07:18:31.273 INFO:teuthology.orchestra.run.smithi055.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-02T07:18:31.281 INFO:teuthology.orchestra.run.smithi055.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-02T07:18:31.296 INFO:teuthology.orchestra.run.smithi106.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-02T07:18:31.304 INFO:teuthology.orchestra.run.smithi106.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-02T07:18:31.472 INFO:teuthology.orchestra.run.smithi055.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-02T07:18:31.474 INFO:teuthology.orchestra.run.smithi055.stdout:Get:49 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.2.2-1015-gd0e392d9-1jammy [356 kB] 2024-04-02T07:18:31.495 INFO:teuthology.orchestra.run.smithi106.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-02T07:18:31.535 INFO:teuthology.orchestra.run.smithi106.stdout:Get:71 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.2-1015-gd0e392d9-1jammy [14.3 kB] 2024-04-02T07:18:31.535 INFO:teuthology.orchestra.run.smithi106.stdout:Get:72 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.2-1015-gd0e392d9-1jammy [42.7 MB] 2024-04-02T07:18:31.579 INFO:teuthology.orchestra.run.smithi055.stdout:Get:50 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.2.2-1015-gd0e392d9-1jammy [32.8 kB] 2024-04-02T07:18:31.630 INFO:teuthology.orchestra.run.smithi055.stdout:Get:51 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.2.2-1015-gd0e392d9-1jammy [180 kB] 2024-04-02T07:18:31.663 INFO:teuthology.orchestra.run.smithi055.stdout:Get:52 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.2.2-1015-gd0e392d9-1jammy [63.7 kB] 2024-04-02T07:18:31.708 INFO:teuthology.orchestra.run.smithi055.stdout:Get:53 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.2.2-1015-gd0e392d9-1jammy [330 kB] 2024-04-02T07:18:31.792 INFO:teuthology.orchestra.run.smithi055.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.2.2-1015-gd0e392d9-1jammy [5,892 kB] 2024-04-02T07:18:32.303 INFO:teuthology.orchestra.run.smithi055.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-02T07:18:32.304 INFO:teuthology.orchestra.run.smithi055.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-02T07:18:32.305 INFO:teuthology.orchestra.run.smithi055.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-02T07:18:32.306 INFO:teuthology.orchestra.run.smithi055.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-02T07:18:32.307 INFO:teuthology.orchestra.run.smithi055.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-02T07:18:32.308 INFO:teuthology.orchestra.run.smithi055.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-02T07:18:32.308 INFO:teuthology.orchestra.run.smithi055.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-02T07:18:32.309 INFO:teuthology.orchestra.run.smithi055.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-02T07:18:32.311 INFO:teuthology.orchestra.run.smithi055.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-02T07:18:32.318 INFO:teuthology.orchestra.run.smithi106.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-02T07:18:32.319 INFO:teuthology.orchestra.run.smithi106.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-02T07:18:32.321 INFO:teuthology.orchestra.run.smithi106.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-02T07:18:32.321 INFO:teuthology.orchestra.run.smithi106.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-02T07:18:32.322 INFO:teuthology.orchestra.run.smithi106.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-02T07:18:32.323 INFO:teuthology.orchestra.run.smithi106.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-02T07:18:32.323 INFO:teuthology.orchestra.run.smithi106.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-02T07:18:32.324 INFO:teuthology.orchestra.run.smithi106.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-02T07:18:32.326 INFO:teuthology.orchestra.run.smithi106.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-02T07:18:32.384 INFO:teuthology.orchestra.run.smithi055.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-02T07:18:32.399 INFO:teuthology.orchestra.run.smithi106.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-02T07:18:32.549 INFO:teuthology.orchestra.run.smithi055.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-02T07:18:32.565 INFO:teuthology.orchestra.run.smithi106.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-02T07:18:33.275 INFO:teuthology.orchestra.run.smithi055.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-02T07:18:33.280 INFO:teuthology.orchestra.run.smithi055.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-02T07:18:33.281 INFO:teuthology.orchestra.run.smithi055.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-02T07:18:33.284 INFO:teuthology.orchestra.run.smithi106.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-02T07:18:33.290 INFO:teuthology.orchestra.run.smithi106.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-02T07:18:33.291 INFO:teuthology.orchestra.run.smithi106.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-02T07:18:33.333 INFO:teuthology.orchestra.run.smithi055.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-02T07:18:33.333 INFO:teuthology.orchestra.run.smithi055.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-02T07:18:33.342 INFO:teuthology.orchestra.run.smithi106.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-02T07:18:33.350 INFO:teuthology.orchestra.run.smithi106.stdout:Get:88 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.2-1015-gd0e392d9-1jammy [121 kB] 2024-04-02T07:18:33.351 INFO:teuthology.orchestra.run.smithi106.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.2-1015-gd0e392d9-1jammy [231 kB] 2024-04-02T07:18:33.357 INFO:teuthology.orchestra.run.smithi055.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-02T07:18:33.358 INFO:teuthology.orchestra.run.smithi055.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-02T07:18:33.358 INFO:teuthology.orchestra.run.smithi055.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-02T07:18:33.360 INFO:teuthology.orchestra.run.smithi055.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-02T07:18:33.360 INFO:teuthology.orchestra.run.smithi055.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-02T07:18:33.365 INFO:teuthology.orchestra.run.smithi106.stdout:Get:90 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.2-1015-gd0e392d9-1jammy [34.1 kB] 2024-04-02T07:18:33.365 INFO:teuthology.orchestra.run.smithi106.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-02T07:18:33.366 INFO:teuthology.orchestra.run.smithi106.stdout:Get:92 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.2-1015-gd0e392d9-1jammy [23.5 kB] 2024-04-02T07:18:33.367 INFO:teuthology.orchestra.run.smithi106.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-02T07:18:33.367 INFO:teuthology.orchestra.run.smithi106.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-02T07:18:33.368 INFO:teuthology.orchestra.run.smithi106.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.2-1015-gd0e392d9-1jammy [38.3 kB] 2024-04-02T07:18:33.368 INFO:teuthology.orchestra.run.smithi106.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-02T07:18:33.369 INFO:teuthology.orchestra.run.smithi106.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-02T07:18:33.370 INFO:teuthology.orchestra.run.smithi106.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-02T07:18:33.395 INFO:teuthology.orchestra.run.smithi106.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.2-1015-gd0e392d9-1jammy [11.6 MB] 2024-04-02T07:18:33.525 INFO:teuthology.orchestra.run.smithi055.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-02T07:18:33.535 INFO:teuthology.orchestra.run.smithi106.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-02T07:18:34.039 INFO:teuthology.orchestra.run.smithi055.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-02T07:18:34.045 INFO:teuthology.orchestra.run.smithi106.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-02T07:18:34.068 INFO:teuthology.orchestra.run.smithi055.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-02T07:18:34.072 INFO:teuthology.orchestra.run.smithi106.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-02T07:18:34.091 INFO:teuthology.orchestra.run.smithi055.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-02T07:18:34.095 INFO:teuthology.orchestra.run.smithi106.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-02T07:18:34.099 INFO:teuthology.orchestra.run.smithi055.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-02T07:18:34.104 INFO:teuthology.orchestra.run.smithi106.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-02T07:18:34.176 INFO:teuthology.orchestra.run.smithi055.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-02T07:18:34.182 INFO:teuthology.orchestra.run.smithi106.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-02T07:18:34.208 INFO:teuthology.orchestra.run.smithi055.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-02T07:18:34.210 INFO:teuthology.orchestra.run.smithi055.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-02T07:18:34.211 INFO:teuthology.orchestra.run.smithi106.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.2-1015-gd0e392d9-1jammy [93.1 kB] 2024-04-02T07:18:34.214 INFO:teuthology.orchestra.run.smithi106.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-02T07:18:34.216 INFO:teuthology.orchestra.run.smithi106.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-02T07:18:34.222 INFO:teuthology.orchestra.run.smithi055.stdout:Get:84 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.2.2-1015-gd0e392d9-1jammy [112 kB] 2024-04-02T07:18:34.227 INFO:teuthology.orchestra.run.smithi055.stdout:Get:85 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.2.2-1015-gd0e392d9-1jammy [441 kB] 2024-04-02T07:18:34.247 INFO:teuthology.orchestra.run.smithi055.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-02T07:18:34.253 INFO:teuthology.orchestra.run.smithi106.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-02T07:18:34.271 INFO:teuthology.orchestra.run.smithi055.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-02T07:18:34.274 INFO:teuthology.orchestra.run.smithi055.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-02T07:18:34.277 INFO:teuthology.orchestra.run.smithi106.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-02T07:18:34.281 INFO:teuthology.orchestra.run.smithi106.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-02T07:18:34.308 INFO:teuthology.orchestra.run.smithi055.stdout:Get:89 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.2.2-1015-gd0e392d9-1jammy [22.0 MB] 2024-04-02T07:18:34.449 INFO:teuthology.orchestra.run.smithi055.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-02T07:18:34.456 INFO:teuthology.orchestra.run.smithi106.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-02T07:18:35.053 INFO:teuthology.orchestra.run.smithi055.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-02T07:18:35.055 INFO:teuthology.orchestra.run.smithi055.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-02T07:18:35.058 INFO:teuthology.orchestra.run.smithi055.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-02T07:18:35.059 INFO:teuthology.orchestra.run.smithi106.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-02T07:18:35.062 INFO:teuthology.orchestra.run.smithi106.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-02T07:18:35.064 INFO:teuthology.orchestra.run.smithi106.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-02T07:18:35.797 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 162 MB in 7s (22.7 MB/s) 2024-04-02T07:18:35.942 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-02T07:18:36.009 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132923 files and directories currently installed.) 2024-04-02T07:18:36.012 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-02T07:18:36.066 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-02T07:18:36.352 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-02T07:18:36.365 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-02T07:18:36.402 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-02T07:18:36.663 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cmd2. 2024-04-02T07:18:36.676 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-02T07:18:36.722 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-02T07:18:37.049 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libfmt8:amd64. 2024-04-02T07:18:37.063 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-04-02T07:18:37.150 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-02T07:18:37.502 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-02T07:18:37.516 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-02T07:18:37.561 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-02T07:18:37.882 INFO:teuthology.orchestra.run.smithi055.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.2.2-1015-gd0e392d9-1jammy [5,001 kB] 2024-04-02T07:18:37.914 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-02T07:18:37.928 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-02T07:18:37.972 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-02T07:18:38.276 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-02T07:18:38.290 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-02T07:18:38.326 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-02T07:18:38.663 INFO:teuthology.orchestra.run.smithi055.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.2.2-1015-gd0e392d9-1jammy [241 kB] 2024-04-02T07:18:38.701 INFO:teuthology.orchestra.run.smithi055.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.2.2-1015-gd0e392d9-1jammy [130 kB] 2024-04-02T07:18:38.720 INFO:teuthology.orchestra.run.smithi055.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.2.2-1015-gd0e392d9-1jammy [1,485 kB] 2024-04-02T07:18:38.779 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-02T07:18:38.794 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-02T07:18:38.845 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-02T07:18:38.949 INFO:teuthology.orchestra.run.smithi055.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.2.2-1015-gd0e392d9-1jammy [6,078 kB] 2024-04-02T07:18:39.274 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-02T07:18:39.289 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-02T07:18:39.324 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-02T07:18:39.702 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-02T07:18:39.717 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-02T07:18:39.752 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-02T07:18:39.934 INFO:teuthology.orchestra.run.smithi055.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.2.2-1015-gd0e392d9-1jammy [22.3 MB] 2024-04-02T07:18:40.272 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-02T07:18:40.286 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-02T07:18:40.330 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-02T07:18:40.675 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librados2. 2024-04-02T07:18:40.689 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../011-librados2_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:40.733 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librados2 (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:41.161 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librbd1. 2024-04-02T07:18:41.174 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../012-librbd1_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:41.219 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librbd1 (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:41.589 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs2. 2024-04-02T07:18:41.602 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../013-libcephfs2_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:41.647 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs2 (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:41.917 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rados. 2024-04-02T07:18:41.929 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../014-python3-rados_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:41.966 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rados (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:42.286 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-02T07:18:42.299 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.2-1015-gd0e392d9-1jammy_all.deb ... 2024-04-02T07:18:42.344 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-ceph-argparse (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:42.597 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cephfs. 2024-04-02T07:18:42.610 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../016-python3-cephfs_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:42.655 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cephfs (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:42.714 INFO:teuthology.orchestra.run.smithi055.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.2.2-1015-gd0e392d9-1jammy [14.1 kB] 2024-04-02T07:18:42.714 INFO:teuthology.orchestra.run.smithi055.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.2.2-1015-gd0e392d9-1jammy [826 kB] 2024-04-02T07:18:42.791 INFO:teuthology.orchestra.run.smithi055.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.2.2-1015-gd0e392d9-1jammy [2,175 kB] 2024-04-02T07:18:42.966 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-02T07:18:42.980 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.2-1015-gd0e392d9-1jammy_all.deb ... 2024-04-02T07:18:43.014 INFO:teuthology.orchestra.run.smithi055.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.2.2-1015-gd0e392d9-1jammy [238 kB] 2024-04-02T07:18:43.016 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-ceph-common (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:43.037 INFO:teuthology.orchestra.run.smithi055.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.2.2-1015-gd0e392d9-1jammy [144 kB] 2024-04-02T07:18:43.066 INFO:teuthology.orchestra.run.smithi055.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.2.2-1015-gd0e392d9-1jammy [1,931 kB] 2024-04-02T07:18:43.311 INFO:teuthology.orchestra.run.smithi055.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.2.2-1015-gd0e392d9-1jammy [8,625 kB] 2024-04-02T07:18:43.342 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-prettytable. 2024-04-02T07:18:43.342 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-04-02T07:18:43.369 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-02T07:18:43.622 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rbd. 2024-04-02T07:18:43.636 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../019-python3-rbd_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:43.671 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rbd (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:43.958 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-02T07:18:43.972 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-02T07:18:44.024 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-02T07:18:44.101 INFO:teuthology.orchestra.run.smithi055.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.2.2-1015-gd0e392d9-1jammy [14.3 kB] 2024-04-02T07:18:44.101 INFO:teuthology.orchestra.run.smithi055.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.2.2-1015-gd0e392d9-1jammy [42.7 MB] 2024-04-02T07:18:44.369 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librgw2. 2024-04-02T07:18:44.384 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../021-librgw2_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:44.427 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librgw2 (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:44.888 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rgw. 2024-04-02T07:18:44.902 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../022-python3-rgw_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:44.946 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rgw (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:45.325 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-02T07:18:45.339 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-02T07:18:45.375 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-02T07:18:45.669 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libradosstriper1. 2024-04-02T07:18:45.684 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../024-libradosstriper1_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:45.728 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libradosstriper1 (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:46.139 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-common. 2024-04-02T07:18:46.154 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../025-ceph-common_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:46.197 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-common (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:47.215 INFO:teuthology.orchestra.run.smithi055.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.2.2-1015-gd0e392d9-1jammy [121 kB] 2024-04-02T07:18:47.216 INFO:teuthology.orchestra.run.smithi055.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.2.2-1015-gd0e392d9-1jammy [231 kB] 2024-04-02T07:18:47.223 INFO:teuthology.orchestra.run.smithi055.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.2.2-1015-gd0e392d9-1jammy [34.1 kB] 2024-04-02T07:18:47.225 INFO:teuthology.orchestra.run.smithi055.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.2.2-1015-gd0e392d9-1jammy [23.5 kB] 2024-04-02T07:18:47.227 INFO:teuthology.orchestra.run.smithi055.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.2.2-1015-gd0e392d9-1jammy [38.3 kB] 2024-04-02T07:18:47.228 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-base. 2024-04-02T07:18:47.229 INFO:teuthology.orchestra.run.smithi055.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.2.2-1015-gd0e392d9-1jammy [11.6 MB] 2024-04-02T07:18:47.243 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../026-ceph-base_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:47.287 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-base (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:47.866 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-02T07:18:47.879 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-02T07:18:47.916 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-02T07:18:47.954 INFO:teuthology.orchestra.run.smithi055.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240326.105515-reef/d0e392d9aee635f2b65768c460c7a151ead7a5e2/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.2.2-1015-gd0e392d9-1jammy [93.1 kB] 2024-04-02T07:18:48.218 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cheroot. 2024-04-02T07:18:48.232 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-02T07:18:48.285 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-02T07:18:48.546 INFO:teuthology.orchestra.run.smithi055.stdout:Fetched 162 MB in 20s (8,164 kB/s) 2024-04-02T07:18:48.614 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-02T07:18:48.629 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-02T07:18:48.672 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-02T07:18:48.727 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-02T07:18:48.796 INFO:teuthology.orchestra.run.smithi055.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132923 files and directories currently installed.) 2024-04-02T07:18:48.799 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-02T07:18:48.851 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-02T07:18:48.974 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-02T07:18:48.988 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-02T07:18:49.033 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-02T07:18:49.170 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-02T07:18:49.184 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-02T07:18:49.228 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-02T07:18:49.311 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-02T07:18:49.325 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-02T07:18:49.369 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-02T07:18:49.623 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-cmd2. 2024-04-02T07:18:49.637 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-02T07:18:49.657 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-tempora. 2024-04-02T07:18:49.670 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-04-02T07:18:49.689 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-02T07:18:49.714 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-02T07:18:50.025 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-portend. 2024-04-02T07:18:50.038 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-04-02T07:18:50.059 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libfmt8:amd64. 2024-04-02T07:18:50.074 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2024-04-02T07:18:50.083 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-02T07:18:50.207 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-02T07:18:50.546 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-02T07:18:50.561 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-02T07:18:50.578 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-02T07:18:50.592 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-02T07:18:50.604 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-02T07:18:50.636 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-02T07:18:50.939 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-02T07:18:50.952 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-02T07:18:50.966 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-02T07:18:50.982 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-02T07:18:50.997 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-02T07:18:51.049 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-02T07:18:51.350 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-natsort. 2024-04-02T07:18:51.352 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-02T07:18:51.364 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-04-02T07:18:51.368 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-02T07:18:51.402 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-02T07:18:51.409 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-02T07:18:51.722 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-logutils. 2024-04-02T07:18:51.736 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-04-02T07:18:51.780 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-02T07:18:51.990 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-02T07:18:52.004 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-02T07:18:52.050 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-02T07:18:52.055 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-02T07:18:52.064 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-02T07:18:52.100 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-02T07:18:52.411 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-mako. 2024-04-02T07:18:52.425 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-02T07:18:52.470 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-02T07:18:52.534 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-02T07:18:52.549 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-02T07:18:52.600 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-02T07:18:52.798 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-02T07:18:52.812 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-02T07:18:52.856 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-02T07:18:53.020 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-02T07:18:53.036 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-02T07:18:53.087 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-02T07:18:53.159 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-02T07:18:53.173 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-02T07:18:53.217 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-02T07:18:53.470 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webob. 2024-04-02T07:18:53.484 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-02T07:18:53.528 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-02T07:18:53.673 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-02T07:18:53.689 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-02T07:18:53.731 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-02T07:18:53.906 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-waitress. 2024-04-02T07:18:53.921 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-02T07:18:53.967 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-02T07:18:54.101 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package librados2. 2024-04-02T07:18:54.117 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../011-librados2_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:54.168 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking librados2 (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:54.276 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-tempita. 2024-04-02T07:18:54.291 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-02T07:18:54.334 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-02T07:18:54.637 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-paste. 2024-04-02T07:18:54.651 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-02T07:18:54.679 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package librbd1. 2024-04-02T07:18:54.695 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../012-librbd1_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:54.695 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-02T07:18:54.745 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking librbd1 (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:55.023 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-02T07:18:55.037 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-02T07:18:55.082 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-02T07:18:55.257 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libcephfs2. 2024-04-02T07:18:55.272 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../013-libcephfs2_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:55.323 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libcephfs2 (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:55.401 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-02T07:18:55.415 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-02T07:18:55.459 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-02T07:18:55.609 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-rados. 2024-04-02T07:18:55.624 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../014-python3-rados_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:55.676 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-rados (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:55.771 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webtest. 2024-04-02T07:18:55.785 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-04-02T07:18:55.829 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-02T07:18:56.104 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-02T07:18:56.119 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.2.2-1015-gd0e392d9-1jammy_all.deb ... 2024-04-02T07:18:56.132 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pecan. 2024-04-02T07:18:56.147 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-02T07:18:56.170 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-ceph-argparse (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:56.182 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-02T07:18:56.456 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-cephfs. 2024-04-02T07:18:56.471 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../016-python3-cephfs_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:56.520 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-certifi. 2024-04-02T07:18:56.522 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-cephfs (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:56.535 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-04-02T07:18:56.570 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-02T07:18:56.890 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-idna. 2024-04-02T07:18:56.905 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2024-04-02T07:18:56.934 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-02T07:18:56.948 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-02T07:18:56.949 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../017-python3-ceph-common_18.2.2-1015-gd0e392d9-1jammy_all.deb ... 2024-04-02T07:18:56.992 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-ceph-common (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:57.301 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-urllib3. 2024-04-02T07:18:57.316 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-02T07:18:57.320 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-prettytable. 2024-04-02T07:18:57.337 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2024-04-02T07:18:57.359 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-02T07:18:57.370 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-02T07:18:57.615 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-rbd. 2024-04-02T07:18:57.630 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../019-python3-rbd_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:57.662 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-requests. 2024-04-02T07:18:57.673 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-rbd (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:57.677 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-02T07:18:57.721 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-02T07:18:57.992 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-02T07:18:58.008 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-02T07:18:58.032 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-02T07:18:58.042 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-02T07:18:58.047 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-02T07:18:58.090 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-02T07:18:58.320 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package librgw2. 2024-04-02T07:18:58.335 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../021-librgw2_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:58.378 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking librgw2 (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:58.418 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-02T07:18:58.433 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.2-1015-gd0e392d9-1jammy_all.deb ... 2024-04-02T07:18:58.477 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:58.822 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-rgw. 2024-04-02T07:18:58.838 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../022-python3-rgw_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:58.865 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-02T07:18:58.872 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-rgw (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:58.881 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:58.923 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:59.234 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-02T07:18:59.243 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-openssl. 2024-04-02T07:18:59.249 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-02T07:18:59.258 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2024-04-02T07:18:59.293 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-02T07:18:59.301 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-02T07:18:59.613 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr. 2024-04-02T07:18:59.627 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../058-ceph-mgr_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:59.636 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libradosstriper1. 2024-04-02T07:18:59.652 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../024-libradosstriper1_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:18:59.662 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:18:59.720 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libradosstriper1 (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:00.066 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mon. 2024-04-02T07:19:00.081 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../059-ceph-mon_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:00.098 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-common. 2024-04-02T07:19:00.114 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../025-ceph-common_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:00.124 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mon (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:00.148 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-common (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:00.753 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-osd. 2024-04-02T07:19:00.768 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../060-ceph-osd_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:00.810 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-osd (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:02.088 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-base. 2024-04-02T07:19:02.103 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../026-ceph-base_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:02.155 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-base (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:02.315 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph. 2024-04-02T07:19:02.330 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../061-ceph_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:02.373 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:02.725 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-02T07:19:02.740 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-02T07:19:02.759 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-fuse. 2024-04-02T07:19:02.773 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../062-ceph-fuse_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:02.817 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-02T07:19:02.817 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-fuse (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:03.120 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-cheroot. 2024-04-02T07:19:03.135 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-02T07:19:03.178 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-02T07:19:03.212 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mds. 2024-04-02T07:19:03.227 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../063-ceph-mds_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:03.270 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mds (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:03.489 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-02T07:19:03.505 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-02T07:19:03.539 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-02T07:19:03.607 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package cephadm. 2024-04-02T07:19:03.622 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../064-cephadm_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:03.656 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking cephadm (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:03.970 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-02T07:19:03.983 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-02T07:19:04.026 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-02T07:19:04.042 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-02T07:19:04.058 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-02T07:19:04.109 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-02T07:19:04.371 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-02T07:19:04.386 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-02T07:19:04.429 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-02T07:19:04.478 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-02T07:19:04.494 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-02T07:19:04.545 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-02T07:19:04.923 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-tempora. 2024-04-02T07:19:04.939 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2024-04-02T07:19:04.989 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-02T07:19:05.343 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-portend. 2024-04-02T07:19:05.358 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2024-04-02T07:19:05.384 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-babel. 2024-04-02T07:19:05.398 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-02T07:19:05.401 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-02T07:19:05.459 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-02T07:19:05.770 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-02T07:19:05.771 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jinja2. 2024-04-02T07:19:05.784 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-02T07:19:05.786 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-02T07:19:05.829 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-02T07:19:05.837 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-02T07:19:06.190 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-02T07:19:06.205 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.2-1015-gd0e392d9-1jammy_all.deb ... 2024-04-02T07:19:06.206 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-02T07:19:06.222 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-02T07:19:06.249 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:06.306 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-02T07:19:06.604 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-02T07:19:06.619 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-02T07:19:06.660 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-natsort. 2024-04-02T07:19:06.661 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-02T07:19:06.676 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2024-04-02T07:19:06.726 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-02T07:19:06.963 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pluggy. 2024-04-02T07:19:06.978 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-02T07:19:07.021 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-02T07:19:07.130 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-logutils. 2024-04-02T07:19:07.146 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2024-04-02T07:19:07.196 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-02T07:19:07.300 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-py. 2024-04-02T07:19:07.315 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-04-02T07:19:07.358 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-02T07:19:07.566 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-02T07:19:07.582 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-02T07:19:07.632 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-02T07:19:07.670 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-02T07:19:07.685 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-02T07:19:07.728 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-02T07:19:07.986 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-mako. 2024-04-02T07:19:08.001 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-02T07:19:08.044 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-02T07:19:08.056 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-toml. 2024-04-02T07:19:08.072 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-04-02T07:19:08.115 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-02T07:19:08.372 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-02T07:19:08.387 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-02T07:19:08.400 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pytest. 2024-04-02T07:19:08.416 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-02T07:19:08.430 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-02T07:19:08.451 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-02T07:19:08.737 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-02T07:19:08.752 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-04-02T07:19:08.767 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-02T07:19:08.783 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-02T07:19:08.796 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-02T07:19:08.833 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-02T07:19:09.132 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-routes. 2024-04-02T07:19:09.147 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-02T07:19:09.190 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-02T07:19:09.219 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-webob. 2024-04-02T07:19:09.235 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-02T07:19:09.277 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-02T07:19:09.544 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-02T07:19:09.559 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.2-1015-gd0e392d9-1jammy_all.deb ... 2024-04-02T07:19:09.602 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:09.647 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-waitress. 2024-04-02T07:19:09.663 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-02T07:19:09.708 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-02T07:19:10.014 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-02T07:19:10.017 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-tempita. 2024-04-02T07:19:10.028 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-02T07:19:10.033 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-02T07:19:10.064 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-02T07:19:10.075 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-02T07:19:10.411 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-paste. 2024-04-02T07:19:10.427 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-02T07:19:10.470 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-02T07:19:10.567 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-joblib. 2024-04-02T07:19:10.576 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-02T07:19:10.617 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-02T07:19:10.790 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-02T07:19:10.805 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-02T07:19:10.848 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-02T07:19:10.979 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-02T07:19:10.989 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-02T07:19:11.029 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-02T07:19:11.142 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-02T07:19:11.158 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-02T07:19:11.237 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-02T07:19:11.324 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sklearn. 2024-04-02T07:19:11.335 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-02T07:19:11.374 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-02T07:19:11.545 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-webtest. 2024-04-02T07:19:11.561 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2024-04-02T07:19:11.603 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-02T07:19:11.856 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pecan. 2024-04-02T07:19:11.872 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-02T07:19:11.906 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-02T07:19:12.167 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-02T07:19:12.177 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.2-1015-gd0e392d9-1jammy_all.deb ... 2024-04-02T07:19:12.217 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:12.244 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-certifi. 2024-04-02T07:19:12.260 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2024-04-02T07:19:12.294 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-02T07:19:12.614 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-idna. 2024-04-02T07:19:12.630 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2024-04-02T07:19:12.672 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-02T07:19:13.000 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-urllib3. 2024-04-02T07:19:13.015 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-02T07:19:13.058 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-02T07:19:13.370 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-requests. 2024-04-02T07:19:13.370 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cachetools. 2024-04-02T07:19:13.381 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-04-02T07:19:13.385 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-02T07:19:13.428 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-02T07:19:13.437 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-02T07:19:13.673 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-02T07:19:13.683 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-02T07:19:13.723 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-02T07:19:13.764 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-02T07:19:13.776 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-02T07:19:13.814 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-02T07:19:14.068 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-02T07:19:14.079 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-02T07:19:14.118 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-02T07:19:14.217 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-02T07:19:14.228 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.2.2-1015-gd0e392d9-1jammy_all.deb ... 2024-04-02T07:19:14.267 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr-modules-core (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:14.429 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rsa. 2024-04-02T07:19:14.440 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-04-02T07:19:14.479 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-02T07:19:14.689 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-02T07:19:14.703 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:14.747 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libsqlite3-mod-ceph (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:14.783 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-google-auth. 2024-04-02T07:19:14.793 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-04-02T07:19:14.833 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-02T07:19:15.016 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-openssl. 2024-04-02T07:19:15.029 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2024-04-02T07:19:15.058 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-02T07:19:15.178 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-02T07:19:15.188 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-02T07:19:15.228 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-02T07:19:15.419 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr. 2024-04-02T07:19:15.431 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../058-ceph-mgr_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:15.469 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:15.497 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-websocket. 2024-04-02T07:19:15.508 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-04-02T07:19:15.539 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-02T07:19:15.851 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-02T07:19:15.856 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mon. 2024-04-02T07:19:15.860 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-02T07:19:15.867 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../059-ceph-mon_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:15.900 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-02T07:19:15.906 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mon (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:16.476 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-osd. 2024-04-02T07:19:16.488 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../060-ceph-osd_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:16.534 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-osd (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:16.573 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-02T07:19:16.582 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.2-1015-gd0e392d9-1jammy_all.deb ... 2024-04-02T07:19:16.622 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:16.942 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-02T07:19:16.952 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-02T07:19:16.992 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-02T07:19:17.279 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-02T07:19:17.289 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-02T07:19:17.320 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-02T07:19:17.338 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph. 2024-04-02T07:19:17.349 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../061-ceph_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:17.388 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:17.623 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package jq. 2024-04-02T07:19:17.636 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-02T07:19:17.681 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-02T07:19:17.690 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-fuse. 2024-04-02T07:19:17.702 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../062-ceph-fuse_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:17.740 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-fuse (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:17.917 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package socat. 2024-04-02T07:19:17.928 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-02T07:19:17.967 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-02T07:19:18.160 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mds. 2024-04-02T07:19:18.172 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../063-ceph-mds_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:18.210 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mds (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:18.279 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package xmlstarlet. 2024-04-02T07:19:18.290 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-02T07:19:18.328 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-02T07:19:18.572 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package cephadm. 2024-04-02T07:19:18.583 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../064-cephadm_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:18.613 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking cephadm (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:18.716 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-test. 2024-04-02T07:19:18.727 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../098-ceph-test_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:18.766 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-test (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:18.949 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-02T07:19:18.962 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-02T07:19:18.999 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-02T07:19:19.294 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-02T07:19:19.306 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-02T07:19:19.344 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-02T07:19:20.415 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-babel. 2024-04-02T07:19:20.426 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-02T07:19:20.454 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-volume. 2024-04-02T07:19:20.465 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-02T07:19:20.466 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../099-ceph-volume_18.2.2-1015-gd0e392d9-1jammy_all.deb ... 2024-04-02T07:19:20.503 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-volume (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:20.795 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-jinja2. 2024-04-02T07:19:20.809 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-02T07:19:20.854 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-02T07:19:20.892 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-02T07:19:20.902 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:20.941 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking cephfs-mirror (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:21.207 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-02T07:19:21.219 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.2.2-1015-gd0e392d9-1jammy_all.deb ... 2024-04-02T07:19:21.257 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr-cephadm (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:21.261 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-colorama. 2024-04-02T07:19:21.272 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-04-02T07:19:21.311 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-02T07:19:21.564 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package cephfs-shell. 2024-04-02T07:19:21.573 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../102-cephfs-shell_18.2.2-1015-gd0e392d9-1jammy_all.deb ... 2024-04-02T07:19:21.593 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-02T07:19:21.605 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking cephfs-shell (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:21.606 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-02T07:19:21.643 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-02T07:19:21.883 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package cephfs-top. 2024-04-02T07:19:21.892 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../103-cephfs-top_18.2.2-1015-gd0e392d9-1jammy_all.deb ... 2024-04-02T07:19:21.933 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking cephfs-top (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:21.980 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pluggy. 2024-04-02T07:19:21.993 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-02T07:19:22.038 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-02T07:19:22.169 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-02T07:19:22.178 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:22.219 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs-dev (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:22.441 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-py. 2024-04-02T07:19:22.455 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2024-04-02T07:19:22.491 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-02T07:19:22.705 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package nvme-cli. 2024-04-02T07:19:22.714 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-02T07:19:22.755 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-02T07:19:22.853 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-02T07:19:22.866 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-02T07:19:22.911 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-02T07:19:23.085 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-02T07:19:23.093 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-02T07:19:23.135 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-02T07:19:23.156 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-toml. 2024-04-02T07:19:23.169 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2024-04-02T07:19:23.206 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-02T07:19:23.484 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pytest. 2024-04-02T07:19:23.497 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-02T07:19:23.533 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-02T07:19:23.805 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pastescript. 2024-04-02T07:19:23.816 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-04-02T07:19:23.846 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-02T07:19:23.879 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-02T07:19:23.888 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-04-02T07:19:23.920 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-02T07:19:24.150 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-psutil. 2024-04-02T07:19:24.160 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-02T07:19:24.182 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-routes. 2024-04-02T07:19:24.191 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-02T07:19:24.200 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-02T07:19:24.231 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-02T07:19:24.578 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pygments. 2024-04-02T07:19:24.588 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-02T07:19:24.627 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-02T07:19:24.760 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-02T07:19:24.772 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.2.2-1015-gd0e392d9-1jammy_all.deb ... 2024-04-02T07:19:24.810 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr-dashboard (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:25.090 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-02T07:19:25.099 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-02T07:19:25.140 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-02T07:19:25.280 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-02T07:19:25.292 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-02T07:19:25.330 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-02T07:19:25.451 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-simplejson. 2024-04-02T07:19:25.461 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-02T07:19:25.501 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-02T07:19:25.770 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-02T07:19:25.780 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-02T07:19:25.808 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-joblib. 2024-04-02T07:19:25.819 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-02T07:19:25.820 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-02T07:19:25.850 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-02T07:19:26.245 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-02T07:19:26.256 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-02T07:19:26.295 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-02T07:19:26.541 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package radosgw. 2024-04-02T07:19:26.550 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../113-radosgw_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:26.591 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking radosgw (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:26.598 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-sklearn. 2024-04-02T07:19:26.609 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-02T07:19:26.647 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-02T07:19:27.169 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package rbd-fuse. 2024-04-02T07:19:27.178 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../114-rbd-fuse_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:27.219 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking rbd-fuse (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:27.416 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-02T07:19:27.426 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.2.2-1015-gd0e392d9-1jammy_all.deb ... 2024-04-02T07:19:27.466 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr-diskprediction-local (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:27.534 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-02T07:19:27.807 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-02T07:19:27.926 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-02T07:19:28.178 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-02T07:19:28.428 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-cachetools. 2024-04-02T07:19:28.439 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-04-02T07:19:28.494 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-02T07:19:28.605 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-02T07:19:28.764 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-02T07:19:28.775 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-02T07:19:28.814 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-02T07:19:29.151 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-02T07:19:29.162 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-02T07:19:29.189 INFO:teuthology.orchestra.run.smithi106.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-02T07:19:29.202 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-02T07:19:29.225 INFO:teuthology.orchestra.run.smithi106.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-02T07:19:29.270 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up cephadm (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:29.529 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-rsa. 2024-04-02T07:19:29.540 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-04-02T07:19:29.578 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-02T07:19:29.822 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user cephadm....done 2024-04-02T07:19:29.932 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-google-auth. 2024-04-02T07:19:29.943 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-04-02T07:19:29.950 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-02T07:19:29.982 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-02T07:19:30.227 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-02T07:19:30.302 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-02T07:19:30.313 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-02T07:19:30.343 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-02T07:19:30.487 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-02T07:19:30.605 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-websocket. 2024-04-02T07:19:30.612 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-02T07:19:30.616 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-04-02T07:19:30.655 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-02T07:19:30.872 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-02T07:19:31.008 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-02T07:19:31.019 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-02T07:19:31.058 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-02T07:19:31.165 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-02T07:19:31.291 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-02T07:19:31.601 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-02T07:19:31.805 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-02T07:19:31.815 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.2.2-1015-gd0e392d9-1jammy_all.deb ... 2024-04-02T07:19:31.855 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr-k8sevents (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:31.986 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-02T07:19:32.141 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-02T07:19:32.151 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-02T07:19:32.193 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-02T07:19:32.254 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-02T07:19:32.511 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-02T07:19:32.522 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-02T07:19:32.522 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-02T07:19:32.586 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-02T07:19:32.798 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-02T07:19:32.856 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package jq. 2024-04-02T07:19:32.867 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-02T07:19:32.905 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-02T07:19:33.066 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-02T07:19:33.158 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package socat. 2024-04-02T07:19:33.169 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-02T07:19:33.207 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-02T07:19:33.334 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-02T07:19:33.511 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package xmlstarlet. 2024-04-02T07:19:33.522 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-02T07:19:33.552 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-02T07:19:33.701 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-ceph-argparse (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:33.907 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-test. 2024-04-02T07:19:33.917 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../098-ceph-test_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:33.956 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-test (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:33.961 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-02T07:19:34.087 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-02T07:19:34.355 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-02T07:19:34.623 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-02T07:19:34.748 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-02T07:19:35.108 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-02T07:19:35.242 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-02T07:19:35.510 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-02T07:19:35.636 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-volume. 2024-04-02T07:19:35.647 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../099-ceph-volume_18.2.2-1015-gd0e392d9-1jammy_all.deb ... 2024-04-02T07:19:35.677 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-volume (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:35.786 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-02T07:19:36.015 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-02T07:19:36.026 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../100-cephfs-mirror_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:36.057 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking cephfs-mirror (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:36.104 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-02T07:19:36.377 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-colorama. 2024-04-02T07:19:36.388 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2024-04-02T07:19:36.426 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-02T07:19:36.687 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package cephfs-shell. 2024-04-02T07:19:36.698 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../102-cephfs-shell_18.2.2-1015-gd0e392d9-1jammy_all.deb ... 2024-04-02T07:19:36.737 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking cephfs-shell (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:36.798 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-02T07:19:37.032 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package cephfs-top. 2024-04-02T07:19:37.043 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../103-cephfs-top_18.2.2-1015-gd0e392d9-1jammy_all.deb ... 2024-04-02T07:19:37.081 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking cephfs-top (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:37.107 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-02T07:19:37.233 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-02T07:19:37.310 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-02T07:19:37.321 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../104-libcephfs-dev_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:37.342 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-02T07:19:37.351 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libcephfs-dev (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:37.660 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-02T07:19:37.696 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package nvme-cli. 2024-04-02T07:19:37.707 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-02T07:19:37.745 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-02T07:19:38.070 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-02T07:19:38.109 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-02T07:19:38.120 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-02T07:19:38.159 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-02T07:19:38.338 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-02T07:19:38.562 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pastescript. 2024-04-02T07:19:38.573 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-04-02T07:19:38.611 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-02T07:19:38.949 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-psutil. 2024-04-02T07:19:38.963 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-02T07:19:38.967 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-02T07:19:39.007 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-02T07:19:39.299 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-02T07:19:39.343 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pygments. 2024-04-02T07:19:39.355 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-02T07:19:39.392 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-02T07:19:39.608 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-02T07:19:39.822 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-02T07:19:39.834 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-02T07:19:39.863 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-02T07:19:39.959 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-02T07:19:40.219 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-02T07:19:40.345 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-ceph-common (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:40.408 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-simplejson. 2024-04-02T07:19:40.420 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-02T07:19:40.458 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-02T07:19:40.679 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-idna (3.3-1) ... 2024-04-02T07:19:40.685 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-02T07:19:40.698 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-02T07:19:40.727 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-02T07:19:41.022 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-02T07:19:41.539 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package radosgw. 2024-04-02T07:19:41.551 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../113-radosgw_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:41.589 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking radosgw (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:42.209 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package rbd-fuse. 2024-04-02T07:19:42.221 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../114-rbd-fuse_18.2.2-1015-gd0e392d9-1jammy_amd64.deb ... 2024-04-02T07:19:42.236 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-02T07:19:42.258 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking rbd-fuse (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:42.370 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-02T07:19:42.567 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-02T07:19:42.646 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-02T07:19:42.797 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-02T07:19:42.872 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-02T07:19:42.924 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-02T07:19:42.973 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-02T07:19:43.216 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-02T07:19:43.233 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-02T07:19:43.492 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-02T07:19:43.640 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-02T07:19:43.744 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-02T07:19:43.995 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-02T07:19:44.121 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-02T07:19:44.228 INFO:teuthology.orchestra.run.smithi055.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-02T07:19:44.277 INFO:teuthology.orchestra.run.smithi055.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2024-04-02T07:19:44.316 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up cephadm (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:44.439 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-02T07:19:44.681 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-02T07:19:44.843 INFO:teuthology.orchestra.run.smithi055.stdout:Adding system user cephadm....done 2024-04-02T07:19:44.957 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-02T07:19:45.047 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-02T07:19:45.225 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-02T07:19:45.485 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-02T07:19:45.498 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-02T07:19:45.741 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-02T07:19:45.769 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-02T07:19:45.868 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-02T07:19:45.895 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-02T07:19:46.180 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-02T07:19:46.202 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-02T07:19:46.306 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-02T07:19:46.478 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-02T07:19:46.621 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-02T07:19:46.642 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-02T07:19:46.941 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-02T07:19:46.956 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-02T07:19:47.200 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-02T07:19:47.316 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-02T07:19:47.584 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-02T07:19:47.617 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-02T07:19:47.885 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-02T07:19:47.887 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-02T07:19:48.030 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-02T07:19:48.178 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-02T07:19:48.423 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-02T07:19:48.446 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-02T07:19:48.690 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-02T07:19:48.747 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-02T07:19:48.983 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-02T07:19:48.999 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-ceph-argparse (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:49.109 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-02T07:19:49.250 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-02T07:19:49.409 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-02T07:19:49.452 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-02T07:19:49.677 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-02T07:19:49.762 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-02T07:19:49.944 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-02T07:19:50.054 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-02T07:19:50.070 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-02T07:19:50.180 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-02T07:19:50.456 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-02T07:19:50.480 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-02T07:19:50.581 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-02T07:19:50.732 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-02T07:19:50.840 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-02T07:19:51.008 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-02T07:19:51.100 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-02T07:19:51.402 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-02T07:19:51.409 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-02T07:19:51.695 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-02T07:19:52.055 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-02T07:19:52.128 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-02T07:19:52.156 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librados2 (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:52.282 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librgw2 (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:52.404 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-02T07:19:52.485 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:52.538 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-02T07:19:52.611 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs2 (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:52.681 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-02T07:19:52.737 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libradosstriper1 (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:52.863 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-02T07:19:52.990 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-02T07:19:53.156 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librbd1 (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:53.257 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-modules-core (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:53.375 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-fuse (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:53.392 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-02T07:19:53.610 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-02T07:19:53.610 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-02T07:19:53.676 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-02T07:19:54.070 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-02T07:19:54.244 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs-dev (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:54.379 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-02T07:19:54.394 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rados (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:54.520 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up cephfs-top (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:54.672 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-02T07:19:54.705 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-02T07:19:55.048 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-02T07:19:55.324 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-02T07:19:55.450 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-ceph-common (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:55.760 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-idna (3.3-1) ... 2024-04-02T07:19:55.934 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rbd (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:56.060 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up rbd-fuse (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:56.111 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-02T07:19:56.186 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rgw (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:56.313 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cephfs (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:56.447 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up cephfs-shell (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:56.573 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-common (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:57.101 INFO:teuthology.orchestra.run.smithi106.stdout:Adding group ceph....done 2024-04-02T07:19:57.400 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-02T07:19:57.494 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user ceph....done 2024-04-02T07:19:57.535 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-02T07:19:57.654 INFO:teuthology.orchestra.run.smithi106.stdout:Setting system user ceph properties....done 2024-04-02T07:19:57.675 INFO:teuthology.orchestra.run.smithi106.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-02T07:19:57.818 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-02T07:19:57.835 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-02T07:19:57.961 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-02T07:19:58.088 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-02T07:19:58.232 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-02T07:19:58.431 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-02T07:19:58.682 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-02T07:19:58.882 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up cephfs-mirror (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:58.933 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-02T07:19:59.059 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2024-04-02T07:19:59.074 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-02T07:19:59.075 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-02T07:19:59.185 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-02T07:19:59.528 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-02T07:19:59.700 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-test (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:19:59.804 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-02T07:19:59.826 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up radosgw (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:00.089 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-02T07:20:00.339 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-02T07:20:00.400 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-02T07:20:00.400 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-02T07:20:00.582 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-02T07:20:01.036 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-base (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:01.075 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-02T07:20:01.186 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-02T07:20:01.394 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-02T07:20:01.477 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-02T07:20:01.603 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-02T07:20:01.938 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-02T07:20:02.046 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mds (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:02.256 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-02T07:20:02.261 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-02T07:20:02.261 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-02T07:20:02.532 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-02T07:20:02.890 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:02.926 INFO:teuthology.orchestra.run.smithi055.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-02T07:20:03.127 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-02T07:20:03.127 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-02T07:20:03.168 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-02T07:20:03.294 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-02T07:20:03.737 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-02T07:20:03.774 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-osd (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:04.013 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-02T07:20:04.067 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-02T07:20:04.067 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-02T07:20:04.289 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-02T07:20:04.407 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-02T07:20:04.710 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:04.725 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-02T07:20:04.861 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:05.004 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mon (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:05.017 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-02T07:20:05.213 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-02T07:20:05.213 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-02T07:20:05.311 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-02T07:20:05.437 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-02T07:20:05.721 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-02T07:20:05.863 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-cephadm (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:06.006 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:06.039 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-02T07:20:06.132 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-dashboard (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:06.275 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-volume (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:06.299 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-02T07:20:06.636 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-02T07:20:06.683 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-02T07:20:06.984 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-02T07:20:07.345 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-02T07:20:07.496 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up librados2 (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:07.622 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up librgw2 (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:07.695 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-02T07:20:07.817 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libsqlite3-mod-ceph (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:07.918 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libcephfs2 (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:08.044 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libradosstriper1 (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:08.151 INFO:teuthology.orchestra.run.smithi106.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-02T07:20:08.155 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-02T07:20:08.170 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-02T07:20:08.228 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-04-02T07:20:08.400 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2024-04-02T07:20:08.401 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2024-04-02T07:20:08.505 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up librbd1 (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:08.572 INFO:teuthology.orchestra.run.smithi106.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-02T07:20:08.572 INFO:teuthology.orchestra.run.smithi106.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-02T07:20:08.572 INFO:teuthology.orchestra.run.smithi106.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-02T07:20:08.572 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages were automatically installed and are no longer required: 2024-04-02T07:20:08.572 INFO:teuthology.orchestra.run.smithi106.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-02T07:20:08.573 INFO:teuthology.orchestra.run.smithi106.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-02T07:20:08.573 INFO:teuthology.orchestra.run.smithi106.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-02T07:20:08.573 INFO:teuthology.orchestra.run.smithi106.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-02T07:20:08.573 INFO:teuthology.orchestra.run.smithi106.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-02T07:20:08.573 INFO:teuthology.orchestra.run.smithi106.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-02T07:20:08.575 INFO:teuthology.orchestra.run.smithi106.stdout:The following additional packages will be installed: 2024-04-02T07:20:08.575 INFO:teuthology.orchestra.run.smithi106.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-02T07:20:08.575 INFO:teuthology.orchestra.run.smithi106.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-02T07:20:08.575 INFO:teuthology.orchestra.run.smithi106.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-02T07:20:08.576 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-02T07:20:08.576 INFO:teuthology.orchestra.run.smithi106.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-02T07:20:08.576 INFO:teuthology.orchestra.run.smithi106.stdout:Suggested packages: 2024-04-02T07:20:08.576 INFO:teuthology.orchestra.run.smithi106.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-02T07:20:08.576 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-02T07:20:08.576 INFO:teuthology.orchestra.run.smithi106.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-02T07:20:08.606 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr-modules-core (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:08.628 INFO:teuthology.orchestra.run.smithi106.stdout:The following NEW packages will be installed: 2024-04-02T07:20:08.629 INFO:teuthology.orchestra.run.smithi106.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-02T07:20:08.629 INFO:teuthology.orchestra.run.smithi106.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-02T07:20:08.630 INFO:teuthology.orchestra.run.smithi106.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-02T07:20:08.630 INFO:teuthology.orchestra.run.smithi106.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-02T07:20:08.630 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-02T07:20:08.630 INFO:teuthology.orchestra.run.smithi106.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-02T07:20:08.630 INFO:teuthology.orchestra.run.smithi106.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-02T07:20:08.631 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages will be upgraded: 2024-04-02T07:20:08.631 INFO:teuthology.orchestra.run.smithi106.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-02T07:20:08.692 INFO:teuthology.orchestra.run.smithi106.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-02T07:20:08.692 INFO:teuthology.orchestra.run.smithi106.stdout:Need to get 55.7 MB of archives. 2024-04-02T07:20:08.692 INFO:teuthology.orchestra.run.smithi106.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-02T07:20:08.692 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.3 [1,063 kB] 2024-04-02T07:20:08.707 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-fuse (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:08.848 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-02T07:20:08.852 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-02T07:20:08.885 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.3 [33.1 kB] 2024-04-02T07:20:08.885 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.3 [24.4 kB] 2024-04-02T07:20:08.885 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-02T07:20:08.892 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-02T07:20:08.893 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-02T07:20:08.894 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-02T07:20:08.896 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-02T07:20:08.896 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-02T07:20:08.897 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-02T07:20:08.909 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-02T07:20:08.909 INFO:teuthology.orchestra.run.smithi106.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-02T07:20:08.909 INFO:teuthology.orchestra.run.smithi106.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-02T07:20:08.925 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-02T07:20:08.925 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-02T07:20:08.928 INFO:teuthology.orchestra.run.smithi106.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-02T07:20:09.151 INFO:teuthology.orchestra.run.smithi106.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-02T07:20:09.152 INFO:teuthology.orchestra.run.smithi106.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-02T07:20:09.152 INFO:teuthology.orchestra.run.smithi106.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-02T07:20:09.155 INFO:teuthology.orchestra.run.smithi106.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-02T07:20:09.156 INFO:teuthology.orchestra.run.smithi106.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-02T07:20:09.160 INFO:teuthology.orchestra.run.smithi106.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-02T07:20:09.162 INFO:teuthology.orchestra.run.smithi106.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-02T07:20:09.169 INFO:teuthology.orchestra.run.smithi106.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-02T07:20:09.169 INFO:teuthology.orchestra.run.smithi106.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-02T07:20:09.190 INFO:teuthology.orchestra.run.smithi106.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-02T07:20:09.191 INFO:teuthology.orchestra.run.smithi106.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-02T07:20:09.201 INFO:teuthology.orchestra.run.smithi106.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-02T07:20:09.221 INFO:teuthology.orchestra.run.smithi106.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-02T07:20:09.225 INFO:teuthology.orchestra.run.smithi106.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-02T07:20:09.226 INFO:teuthology.orchestra.run.smithi106.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-02T07:20:09.226 INFO:teuthology.orchestra.run.smithi106.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-02T07:20:09.227 INFO:teuthology.orchestra.run.smithi106.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-02T07:20:09.238 INFO:teuthology.orchestra.run.smithi106.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-02T07:20:09.240 INFO:teuthology.orchestra.run.smithi106.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-02T07:20:09.384 INFO:teuthology.orchestra.run.smithi106.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-02T07:20:09.385 INFO:teuthology.orchestra.run.smithi106.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-02T07:20:09.385 INFO:teuthology.orchestra.run.smithi106.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-02T07:20:09.385 INFO:teuthology.orchestra.run.smithi106.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-02T07:20:09.385 INFO:teuthology.orchestra.run.smithi106.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-02T07:20:09.385 INFO:teuthology.orchestra.run.smithi106.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-02T07:20:09.398 INFO:teuthology.orchestra.run.smithi106.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-02T07:20:09.398 INFO:teuthology.orchestra.run.smithi106.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-02T07:20:09.542 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libcephfs-dev (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:09.651 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-rados (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:09.769 INFO:teuthology.orchestra.run.smithi106.stdout:Preconfiguring packages ... 2024-04-02T07:20:09.777 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up cephfs-top (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:09.926 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 55.7 MB in 1s (73.3 MB/s) 2024-04-02T07:20:09.928 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-02T07:20:10.206 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139840 files and directories currently installed.) 2024-04-02T07:20:10.209 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.3_amd64.deb ... 2024-04-02T07:20:10.352 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking util-linux (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-04-02T07:20:11.000 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up util-linux (2.37.2-4ubuntu3.3) ... 2024-04-02T07:20:11.285 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-rbd (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:11.412 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up rbd-fuse (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:11.571 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-rgw (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:11.680 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-cephfs (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:11.782 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up cephfs-shell (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:11.900 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-common (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:12.142 INFO:teuthology.orchestra.run.smithi106.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-02T07:20:12.431 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package flex. 2024-04-02T07:20:12.461 INFO:teuthology.orchestra.run.smithi055.stdout:Adding group ceph....done 2024-04-02T07:20:12.504 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139840 files and directories currently installed.) 2024-04-02T07:20:12.507 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-02T07:20:12.555 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-02T07:20:12.863 INFO:teuthology.orchestra.run.smithi055.stdout:Adding system user ceph....done 2024-04-02T07:20:13.033 INFO:teuthology.orchestra.run.smithi055.stdout:Setting system user ceph properties....done 2024-04-02T07:20:13.050 INFO:teuthology.orchestra.run.smithi055.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-02T07:20:13.082 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-02T07:20:13.202 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-02T07:20:13.222 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-02T07:20:13.600 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-02T07:20:13.642 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-02T07:20:14.163 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139913 files and directories currently installed.) 2024-04-02T07:20:14.167 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.3_amd64.deb ... 2024-04-02T07:20:14.235 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up cephfs-mirror (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:14.285 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-04-02T07:20:14.451 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-02T07:20:14.451 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-02T07:20:14.680 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.3_amd64.deb ... 2024-04-02T07:20:14.833 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-04-02T07:20:15.037 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-test (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:15.163 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up radosgw (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:15.558 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.3) ... 2024-04-02T07:20:15.690 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-02T07:20:15.690 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-02T07:20:15.986 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package bison. 2024-04-02T07:20:16.062 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139913 files and directories currently installed.) 2024-04-02T07:20:16.066 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-02T07:20:16.112 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-02T07:20:16.473 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-base (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:16.538 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-02T07:20:16.553 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-02T07:20:16.597 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-02T07:20:16.904 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-02T07:20:16.916 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package dump. 2024-04-02T07:20:16.931 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-02T07:20:16.975 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking dump (0.4b47-3) ... 2024-04-02T07:20:17.262 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package indent. 2024-04-02T07:20:17.277 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-02T07:20:17.312 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-02T07:20:17.542 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mds (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:17.581 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-02T07:20:17.596 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-02T07:20:17.640 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-02T07:20:17.773 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-02T07:20:17.773 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-02T07:20:17.968 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-02T07:20:17.983 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-02T07:20:18.026 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-02T07:20:18.313 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-02T07:20:18.329 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-02T07:20:18.371 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-02T07:20:18.378 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:18.607 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-02T07:20:18.607 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-02T07:20:18.666 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-02T07:20:18.682 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-02T07:20:18.716 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-02T07:20:18.935 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-02T07:20:18.950 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-02T07:20:18.993 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-02T07:20:19.229 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-osd (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:19.246 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjson-perl. 2024-04-02T07:20:19.261 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-02T07:20:19.304 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-02T07:20:19.558 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-02T07:20:19.558 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-02T07:20:19.658 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-02T07:20:19.672 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-02T07:20:19.716 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-02T07:20:20.206 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr-k8sevents (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:20.332 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr-diskprediction-local (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:20.475 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mon (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:20.700 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-02T07:20:20.700 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-02T07:20:21.095 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-02T07:20:21.110 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-02T07:20:21.153 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-02T07:20:21.351 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr-cephadm (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:21.423 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-02T07:20:21.438 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-02T07:20:21.481 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-02T07:20:21.503 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:21.669 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr-dashboard (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:21.809 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-02T07:20:21.824 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-02T07:20:21.830 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-volume (18.2.2-1015-gd0e392d9-1jammy) ... 2024-04-02T07:20:21.867 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-02T07:20:22.200 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-02T07:20:22.214 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-02T07:20:22.229 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-02T07:20:22.273 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-02T07:20:22.608 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-02T07:20:22.623 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-02T07:20:22.666 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-02T07:20:22.994 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-02T07:20:23.009 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-02T07:20:23.044 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-02T07:20:23.294 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-02T07:20:23.414 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-02T07:20:23.429 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-02T07:20:23.472 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-02T07:20:23.774 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-02T07:20:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-02T07:20:23.789 DEBUG:teuthology.orchestra.run.smithi055:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-02T07:20:23.789 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-02T07:20:23.833 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-02T07:20:23.865 INFO:teuthology.orchestra.run.smithi055.stdout:Reading package lists... 2024-04-02T07:20:24.049 INFO:teuthology.orchestra.run.smithi055.stdout:Building dependency tree... 2024-04-02T07:20:24.049 INFO:teuthology.orchestra.run.smithi055.stdout:Reading state information... 2024-04-02T07:20:24.076 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-02T07:20:24.092 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-02T07:20:24.135 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-02T07:20:24.231 INFO:teuthology.orchestra.run.smithi055.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-02T07:20:24.232 INFO:teuthology.orchestra.run.smithi055.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-02T07:20:24.232 INFO:teuthology.orchestra.run.smithi055.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-02T07:20:24.232 INFO:teuthology.orchestra.run.smithi055.stdout:The following packages were automatically installed and are no longer required: 2024-04-02T07:20:24.232 INFO:teuthology.orchestra.run.smithi055.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-02T07:20:24.232 INFO:teuthology.orchestra.run.smithi055.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-02T07:20:24.232 INFO:teuthology.orchestra.run.smithi055.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-02T07:20:24.232 INFO:teuthology.orchestra.run.smithi055.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-02T07:20:24.233 INFO:teuthology.orchestra.run.smithi055.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-02T07:20:24.233 INFO:teuthology.orchestra.run.smithi055.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-02T07:20:24.233 INFO:teuthology.orchestra.run.smithi055.stdout:The following additional packages will be installed: 2024-04-02T07:20:24.233 INFO:teuthology.orchestra.run.smithi055.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-02T07:20:24.234 INFO:teuthology.orchestra.run.smithi055.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-02T07:20:24.234 INFO:teuthology.orchestra.run.smithi055.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-02T07:20:24.234 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-02T07:20:24.234 INFO:teuthology.orchestra.run.smithi055.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-02T07:20:24.235 INFO:teuthology.orchestra.run.smithi055.stdout:Suggested packages: 2024-04-02T07:20:24.235 INFO:teuthology.orchestra.run.smithi055.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-02T07:20:24.235 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-02T07:20:24.235 INFO:teuthology.orchestra.run.smithi055.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-02T07:20:24.290 INFO:teuthology.orchestra.run.smithi055.stdout:The following NEW packages will be installed: 2024-04-02T07:20:24.290 INFO:teuthology.orchestra.run.smithi055.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-02T07:20:24.291 INFO:teuthology.orchestra.run.smithi055.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-02T07:20:24.291 INFO:teuthology.orchestra.run.smithi055.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-02T07:20:24.291 INFO:teuthology.orchestra.run.smithi055.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-02T07:20:24.291 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-02T07:20:24.291 INFO:teuthology.orchestra.run.smithi055.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-02T07:20:24.291 INFO:teuthology.orchestra.run.smithi055.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-02T07:20:24.292 INFO:teuthology.orchestra.run.smithi055.stdout:The following packages will be upgraded: 2024-04-02T07:20:24.293 INFO:teuthology.orchestra.run.smithi055.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-02T07:20:24.355 INFO:teuthology.orchestra.run.smithi055.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-02T07:20:24.355 INFO:teuthology.orchestra.run.smithi055.stdout:Need to get 55.7 MB of archives. 2024-04-02T07:20:24.355 INFO:teuthology.orchestra.run.smithi055.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-02T07:20:24.356 INFO:teuthology.orchestra.run.smithi055.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.3 [1,063 kB] 2024-04-02T07:20:24.521 INFO:teuthology.orchestra.run.smithi055.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-02T07:20:24.525 INFO:teuthology.orchestra.run.smithi055.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-02T07:20:24.558 INFO:teuthology.orchestra.run.smithi055.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.3 [33.1 kB] 2024-04-02T07:20:24.558 INFO:teuthology.orchestra.run.smithi055.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.3 [24.4 kB] 2024-04-02T07:20:24.559 INFO:teuthology.orchestra.run.smithi055.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-02T07:20:24.566 INFO:teuthology.orchestra.run.smithi055.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-02T07:20:24.566 INFO:teuthology.orchestra.run.smithi055.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-02T07:20:24.568 INFO:teuthology.orchestra.run.smithi055.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-02T07:20:24.569 INFO:teuthology.orchestra.run.smithi055.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-02T07:20:24.570 INFO:teuthology.orchestra.run.smithi055.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-02T07:20:24.571 INFO:teuthology.orchestra.run.smithi055.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-02T07:20:24.584 INFO:teuthology.orchestra.run.smithi055.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-02T07:20:24.585 INFO:teuthology.orchestra.run.smithi055.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-02T07:20:24.585 INFO:teuthology.orchestra.run.smithi055.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-02T07:20:24.605 INFO:teuthology.orchestra.run.smithi055.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-02T07:20:24.613 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-02T07:20:24.628 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-02T07:20:24.663 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-02T07:20:24.826 INFO:teuthology.orchestra.run.smithi055.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-02T07:20:24.829 INFO:teuthology.orchestra.run.smithi055.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-02T07:20:24.829 INFO:teuthology.orchestra.run.smithi055.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-02T07:20:24.831 INFO:teuthology.orchestra.run.smithi055.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-02T07:20:24.831 INFO:teuthology.orchestra.run.smithi055.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-02T07:20:24.836 INFO:teuthology.orchestra.run.smithi055.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-02T07:20:24.837 INFO:teuthology.orchestra.run.smithi055.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-02T07:20:24.845 INFO:teuthology.orchestra.run.smithi055.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-02T07:20:24.845 INFO:teuthology.orchestra.run.smithi055.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-02T07:20:24.867 INFO:teuthology.orchestra.run.smithi055.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-02T07:20:24.868 INFO:teuthology.orchestra.run.smithi055.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-02T07:20:24.879 INFO:teuthology.orchestra.run.smithi055.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-02T07:20:24.901 INFO:teuthology.orchestra.run.smithi055.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-02T07:20:24.904 INFO:teuthology.orchestra.run.smithi055.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-02T07:20:24.905 INFO:teuthology.orchestra.run.smithi055.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-02T07:20:24.906 INFO:teuthology.orchestra.run.smithi055.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-02T07:20:24.906 INFO:teuthology.orchestra.run.smithi055.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-02T07:20:24.918 INFO:teuthology.orchestra.run.smithi055.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-02T07:20:24.919 INFO:teuthology.orchestra.run.smithi055.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-02T07:20:25.008 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package modemmanager. 2024-04-02T07:20:25.023 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-02T07:20:25.066 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-02T07:20:25.072 INFO:teuthology.orchestra.run.smithi055.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-02T07:20:25.073 INFO:teuthology.orchestra.run.smithi055.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-02T07:20:25.073 INFO:teuthology.orchestra.run.smithi055.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-02T07:20:25.073 INFO:teuthology.orchestra.run.smithi055.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-02T07:20:25.073 INFO:teuthology.orchestra.run.smithi055.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-02T07:20:25.073 INFO:teuthology.orchestra.run.smithi055.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-02T07:20:25.087 INFO:teuthology.orchestra.run.smithi055.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-02T07:20:25.087 INFO:teuthology.orchestra.run.smithi055.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-02T07:20:25.480 INFO:teuthology.orchestra.run.smithi055.stdout:Preconfiguring packages ... 2024-04-02T07:20:25.636 INFO:teuthology.orchestra.run.smithi055.stdout:Fetched 55.7 MB in 1s (70.9 MB/s) 2024-04-02T07:20:25.715 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package network-manager. 2024-04-02T07:20:25.729 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-02T07:20:25.780 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-02T07:20:25.926 INFO:teuthology.orchestra.run.smithi055.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139840 files and directories currently installed.) 2024-04-02T07:20:25.930 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.3_amd64.deb ... 2024-04-02T07:20:26.077 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking util-linux (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-04-02T07:20:26.516 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ppp. 2024-04-02T07:20:26.532 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-02T07:20:26.719 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up util-linux (2.37.2-4ubuntu3.3) ... 2024-04-02T07:20:26.879 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-02T07:20:27.229 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package pptp-linux. 2024-04-02T07:20:27.243 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-02T07:20:27.287 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-02T07:20:27.532 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-02T07:20:27.546 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-02T07:20:27.591 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-02T07:20:27.918 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-02T07:20:27.932 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-02T07:20:27.942 INFO:teuthology.orchestra.run.smithi055.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-02T07:20:27.976 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql-client-common (238) ... 2024-04-02T07:20:28.211 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package flex. 2024-04-02T07:20:28.230 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-02T07:20:28.244 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-02T07:20:28.283 INFO:teuthology.orchestra.run.smithi055.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139840 files and directories currently installed.) 2024-04-02T07:20:28.287 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-02T07:20:28.288 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-02T07:20:28.334 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-02T07:20:28.826 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql-common. 2024-04-02T07:20:28.840 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-02T07:20:28.888 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-02T07:20:28.902 INFO:teuthology.orchestra.run.smithi106.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-02T07:20:28.933 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql-common (238) ... 2024-04-02T07:20:29.075 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-02T07:20:29.433 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql-14. 2024-04-02T07:20:29.448 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-02T07:20:29.457 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-02T07:20:29.494 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-02T07:20:30.032 INFO:teuthology.orchestra.run.smithi055.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139913 files and directories currently installed.) 2024-04-02T07:20:30.035 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.3_amd64.deb ... 2024-04-02T07:20:30.158 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-04-02T07:20:30.588 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.3_amd64.deb ... 2024-04-02T07:20:30.619 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql. 2024-04-02T07:20:30.633 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-02T07:20:30.677 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql (14+238) ... 2024-04-02T07:20:30.724 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.3) over (2.37.2-4ubuntu3) ... 2024-04-02T07:20:30.904 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql-client. 2024-04-02T07:20:30.919 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-02T07:20:31.004 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql-client (14+238) ... 2024-04-02T07:20:31.030 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.3) ... 2024-04-02T07:20:31.257 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-02T07:20:31.274 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-02T07:20:31.315 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-02T07:20:31.442 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package bison. 2024-04-02T07:20:31.518 INFO:teuthology.orchestra.run.smithi055.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139913 files and directories currently installed.) 2024-04-02T07:20:31.522 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-02T07:20:31.569 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-02T07:20:31.601 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package tcl8.6. 2024-04-02T07:20:31.616 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-02T07:20:31.651 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-02T07:20:31.920 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package tcl. 2024-04-02T07:20:31.935 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-02T07:20:31.982 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-02T07:20:32.047 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-02T07:20:32.062 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-02T07:20:32.097 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-02T07:20:32.331 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package wpasupplicant. 2024-04-02T07:20:32.346 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-02T07:20:32.389 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-02T07:20:32.425 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package dump. 2024-04-02T07:20:32.440 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-02T07:20:32.484 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking dump (0.4b47-3) ... 2024-04-02T07:20:32.777 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-02T07:20:32.793 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-02T07:20:32.796 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package indent. 2024-04-02T07:20:32.811 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-02T07:20:32.826 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-02T07:20:32.854 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-02T07:20:33.082 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-02T07:20:33.097 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-02T07:20:33.132 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-02T07:20:33.163 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-02T07:20:33.178 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-02T07:20:33.229 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-02T07:20:33.487 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-02T07:20:33.503 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-02T07:20:33.521 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql-client-common (238) ... 2024-04-02T07:20:33.545 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-02T07:20:33.710 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-02T07:20:33.790 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-02T07:20:33.806 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-02T07:20:33.845 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-02T07:20:33.848 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-02T07:20:34.012 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-02T07:20:34.163 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-02T07:20:34.177 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-02T07:20:34.194 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-02T07:20:34.235 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-02T07:20:34.314 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-02T07:20:34.449 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-02T07:20:34.522 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-02T07:20:34.538 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-02T07:20:34.580 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-02T07:20:34.833 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libjson-perl. 2024-04-02T07:20:34.849 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-02T07:20:34.891 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-02T07:20:35.270 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-02T07:20:35.286 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-02T07:20:35.320 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-02T07:20:35.403 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-02T07:20:35.496 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-02T07:20:35.848 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-02T07:20:35.848 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-02T07:20:36.549 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.3) ... 2024-04-02T07:20:36.675 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-02T07:20:36.699 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-02T07:20:36.716 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-02T07:20:36.756 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-02T07:20:36.817 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-02T07:20:36.968 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-02T07:20:37.069 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-02T07:20:37.085 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-02T07:20:37.119 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-02T07:20:37.127 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-02T07:20:37.270 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-02T07:20:37.446 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-02T07:20:37.472 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-02T07:20:37.488 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-02T07:20:37.522 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-02T07:20:37.617 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-02T07:20:37.867 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-02T07:20:37.883 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-02T07:20:37.925 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-02T07:20:38.295 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-02T07:20:38.312 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-02T07:20:38.353 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-02T07:20:38.361 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-02T07:20:38.512 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up dump (0.4b47-3) ... 2024-04-02T07:20:38.640 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-02T07:20:38.656 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-02T07:20:38.673 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-02T07:20:38.706 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-02T07:20:38.713 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-02T07:20:38.873 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-02T07:20:39.007 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-02T07:20:39.077 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-02T07:20:39.093 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-02T07:20:39.133 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-02T07:20:39.135 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-02T07:20:39.268 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-02T07:20:39.374 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-02T07:20:39.430 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-02T07:20:39.446 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-02T07:20:39.452 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-02T07:20:39.488 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-02T07:20:39.604 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-02T07:20:39.749 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-02T07:20:39.766 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-02T07:20:39.808 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-02T07:20:39.846 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-02T07:20:39.997 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-02T07:20:40.149 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-02T07:20:40.270 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-02T07:20:40.286 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-02T07:20:40.317 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql-client (14+238) ... 2024-04-02T07:20:40.320 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-02T07:20:40.443 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-02T07:20:40.690 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package modemmanager. 2024-04-02T07:20:40.707 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-02T07:20:40.749 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-02T07:20:41.086 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:20:41.087 INFO:teuthology.orchestra.run.smithi106.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-02T07:20:41.087 INFO:teuthology.orchestra.run.smithi106.stdout:which means they are currently configured by ifupdown: 2024-04-02T07:20:41.087 INFO:teuthology.orchestra.run.smithi106.stdout:- enp3s0f1 2024-04-02T07:20:41.087 INFO:teuthology.orchestra.run.smithi106.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-02T07:20:41.087 INFO:teuthology.orchestra.run.smithi106.stdout:remove their configuration from /etc/network/interfaces. 2024-04-02T07:20:41.087 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:20:41.220 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-02T07:20:41.390 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package network-manager. 2024-04-02T07:20:41.406 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-02T07:20:41.456 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-02T07:20:41.635 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-02T07:20:42.042 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-02T07:20:42.098 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ppp. 2024-04-02T07:20:42.114 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-02T07:20:42.599 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-02T07:20:42.746 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-02T07:20:42.922 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-02T07:20:42.957 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package pptp-linux. 2024-04-02T07:20:42.972 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-02T07:20:43.015 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-02T07:20:43.073 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-02T07:20:43.216 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql-common (238) ... 2024-04-02T07:20:43.268 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-02T07:20:43.284 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-02T07:20:43.326 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-02T07:20:43.613 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-02T07:20:43.630 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-02T07:20:43.664 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql-client-common (238) ... 2024-04-02T07:20:43.984 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-02T07:20:44.001 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-02T07:20:44.043 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-02T07:20:44.123 INFO:teuthology.orchestra.run.smithi106.stdout:Adding user postgres to group ssl-cert 2024-04-02T07:20:44.334 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:20:44.334 INFO:teuthology.orchestra.run.smithi106.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-02T07:20:44.573 INFO:teuthology.orchestra.run.smithi106.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-02T07:20:44.573 INFO:teuthology.orchestra.run.smithi106.stdout:Removing obsolete dictionary files: 2024-04-02T07:20:44.606 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql-common. 2024-04-02T07:20:44.622 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-02T07:20:44.684 INFO:teuthology.orchestra.run.smithi055.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-02T07:20:44.714 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql-common (238) ... 2024-04-02T07:20:45.164 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql-14. 2024-04-02T07:20:45.181 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-02T07:20:45.226 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-02T07:20:45.296 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-02T07:20:45.783 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-02T07:20:46.114 INFO:teuthology.orchestra.run.smithi106.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-02T07:20:46.140 INFO:teuthology.orchestra.run.smithi106.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-02T07:20:46.196 INFO:teuthology.orchestra.run.smithi106.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-02T07:20:46.196 INFO:teuthology.orchestra.run.smithi106.stdout:This user must also own the server process. 2024-04-02T07:20:46.196 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:20:46.196 INFO:teuthology.orchestra.run.smithi106.stdout:The database cluster will be initialized with locale "en_US". 2024-04-02T07:20:46.196 INFO:teuthology.orchestra.run.smithi106.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-02T07:20:46.196 INFO:teuthology.orchestra.run.smithi106.stdout:The default text search configuration will be set to "english". 2024-04-02T07:20:46.196 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:20:46.196 INFO:teuthology.orchestra.run.smithi106.stdout:Data page checksums are disabled. 2024-04-02T07:20:46.196 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:20:46.196 INFO:teuthology.orchestra.run.smithi106.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-02T07:20:46.197 INFO:teuthology.orchestra.run.smithi106.stdout:creating subdirectories ... ok 2024-04-02T07:20:46.197 INFO:teuthology.orchestra.run.smithi106.stdout:selecting dynamic shared memory implementation ... posix 2024-04-02T07:20:46.221 INFO:teuthology.orchestra.run.smithi106.stdout:selecting default max_connections ... 100 2024-04-02T07:20:46.254 INFO:teuthology.orchestra.run.smithi106.stdout:selecting default shared_buffers ... 128MB 2024-04-02T07:20:46.269 INFO:teuthology.orchestra.run.smithi106.stdout:selecting default time zone ... Etc/UTC 2024-04-02T07:20:46.269 INFO:teuthology.orchestra.run.smithi106.stdout:creating configuration files ... ok 2024-04-02T07:20:46.419 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql. 2024-04-02T07:20:46.437 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-02T07:20:46.437 INFO:teuthology.orchestra.run.smithi106.stdout:running bootstrap script ... ok 2024-04-02T07:20:46.477 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql (14+238) ... 2024-04-02T07:20:46.721 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql-client. 2024-04-02T07:20:46.736 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-02T07:20:46.779 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql-client (14+238) ... 2024-04-02T07:20:46.982 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-02T07:20:46.998 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-02T07:20:47.032 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-02T07:20:47.063 INFO:teuthology.orchestra.run.smithi106.stdout:performing post-bootstrap initialization ... ok 2024-04-02T07:20:47.600 INFO:teuthology.orchestra.run.smithi106.stdout:syncing data to disk ... ok 2024-04-02T07:20:47.710 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package tcl8.6. 2024-04-02T07:20:47.727 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-02T07:20:47.768 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-02T07:20:48.065 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package tcl. 2024-04-02T07:20:48.081 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-02T07:20:48.110 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-02T07:20:48.128 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-02T07:20:48.392 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package wpasupplicant. 2024-04-02T07:20:48.409 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-02T07:20:48.442 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-02T07:20:48.830 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-02T07:20:48.846 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-02T07:20:48.888 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-02T07:20:49.216 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-02T07:20:49.232 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-02T07:20:49.274 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-02T07:20:49.559 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql-client-common (238) ... 2024-04-02T07:20:49.773 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-02T07:20:49.899 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-02T07:20:50.015 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-02T07:20:50.117 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-02T07:20:50.226 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-02T07:20:50.354 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-02T07:20:51.107 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-02T07:20:51.234 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-02T07:20:51.350 INFO:teuthology.orchestra.run.smithi055.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-02T07:20:51.359 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up postgresql (14+238) ... 2024-04-02T07:20:51.458 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-02T07:20:51.477 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-02T07:20:51.603 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-02T07:20:51.837 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-02T07:20:51.837 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-02T07:20:51.837 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-02T07:20:51.837 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-02T07:20:52.536 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.3) ... 2024-04-02T07:20:52.606 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-02T07:20:52.671 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-02T07:20:52.814 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-02T07:20:52.840 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-02T07:20:52.948 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-02T07:20:53.073 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-02T07:20:53.158 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-02T07:20:53.174 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-02T07:20:53.275 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-02T07:20:53.310 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-02T07:20:53.394 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-02T07:20:54.190 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-02T07:20:54.308 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up dump (0.4b47-3) ... 2024-04-02T07:20:54.395 INFO:teuthology.orchestra.run.smithi055.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-02T07:20:54.484 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-02T07:20:54.602 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-02T07:20:54.728 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-02T07:20:54.762 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-02T07:20:54.854 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-02T07:20:54.879 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-02T07:20:54.980 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-02T07:20:55.070 INFO:teuthology.orchestra.run.smithi055.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-02T07:20:55.140 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-02T07:20:55.291 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-02T07:20:55.442 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-02T07:20:55.543 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-02T07:20:55.591 INFO:teuthology.orchestra.run.smithi106.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-02T07:20:55.598 DEBUG:teuthology.parallel:result is None 2024-04-02T07:20:55.669 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-02T07:20:55.837 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql-client (14+238) ... 2024-04-02T07:20:55.980 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-02T07:20:56.586 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:20:56.586 INFO:teuthology.orchestra.run.smithi055.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-02T07:20:56.586 INFO:teuthology.orchestra.run.smithi055.stdout:which means they are currently configured by ifupdown: 2024-04-02T07:20:56.586 INFO:teuthology.orchestra.run.smithi055.stdout:- ens1f0 2024-04-02T07:20:56.587 INFO:teuthology.orchestra.run.smithi055.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-02T07:20:56.587 INFO:teuthology.orchestra.run.smithi055.stdout:remove their configuration from /etc/network/interfaces. 2024-04-02T07:20:56.587 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:20:56.727 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-02T07:20:57.124 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-02T07:20:57.527 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-02T07:20:58.424 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-02T07:20:58.575 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-02T07:20:58.677 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-02T07:20:58.802 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql-common (238) ... 2024-04-02T07:20:59.853 INFO:teuthology.orchestra.run.smithi055.stdout:Adding user postgres to group ssl-cert 2024-04-02T07:21:00.130 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:00.130 INFO:teuthology.orchestra.run.smithi055.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-02T07:21:00.374 INFO:teuthology.orchestra.run.smithi055.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-02T07:21:00.374 INFO:teuthology.orchestra.run.smithi055.stdout:Removing obsolete dictionary files: 2024-04-02T07:21:01.087 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-02T07:21:01.604 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-02T07:21:01.960 INFO:teuthology.orchestra.run.smithi055.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-02T07:21:01.981 INFO:teuthology.orchestra.run.smithi055.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-02T07:21:02.027 INFO:teuthology.orchestra.run.smithi055.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-02T07:21:02.028 INFO:teuthology.orchestra.run.smithi055.stdout:This user must also own the server process. 2024-04-02T07:21:02.028 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:02.028 INFO:teuthology.orchestra.run.smithi055.stdout:The database cluster will be initialized with locale "en_US". 2024-04-02T07:21:02.028 INFO:teuthology.orchestra.run.smithi055.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-02T07:21:02.028 INFO:teuthology.orchestra.run.smithi055.stdout:The default text search configuration will be set to "english". 2024-04-02T07:21:02.028 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:02.028 INFO:teuthology.orchestra.run.smithi055.stdout:Data page checksums are disabled. 2024-04-02T07:21:02.028 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:02.028 INFO:teuthology.orchestra.run.smithi055.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-02T07:21:02.029 INFO:teuthology.orchestra.run.smithi055.stdout:creating subdirectories ... ok 2024-04-02T07:21:02.029 INFO:teuthology.orchestra.run.smithi055.stdout:selecting dynamic shared memory implementation ... posix 2024-04-02T07:21:02.053 INFO:teuthology.orchestra.run.smithi055.stdout:selecting default max_connections ... 100 2024-04-02T07:21:02.089 INFO:teuthology.orchestra.run.smithi055.stdout:selecting default shared_buffers ... 128MB 2024-04-02T07:21:02.103 INFO:teuthology.orchestra.run.smithi055.stdout:selecting default time zone ... Etc/UTC 2024-04-02T07:21:02.105 INFO:teuthology.orchestra.run.smithi055.stdout:creating configuration files ... ok 2024-04-02T07:21:02.277 INFO:teuthology.orchestra.run.smithi055.stdout:running bootstrap script ... ok 2024-04-02T07:21:02.934 INFO:teuthology.orchestra.run.smithi055.stdout:performing post-bootstrap initialization ... ok 2024-04-02T07:21:03.559 INFO:teuthology.orchestra.run.smithi055.stdout:syncing data to disk ... ok 2024-04-02T07:21:04.065 INFO:teuthology.orchestra.run.smithi055.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-02T07:21:07.037 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-02T07:21:07.171 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-02T07:21:07.314 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up postgresql (14+238) ... 2024-04-02T07:21:07.465 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-02T07:21:07.591 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-02T07:21:07.859 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-02T07:21:07.859 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-02T07:21:08.601 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-02T07:21:08.794 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-02T07:21:09.138 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-02T07:21:09.290 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-02T07:21:10.717 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-02T07:21:10.826 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-02T07:21:11.535 INFO:teuthology.orchestra.run.smithi055.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-02T07:21:11.542 DEBUG:teuthology.parallel:result is None 2024-04-02T07:21:11.543 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d0e392d9aee635f2b65768c460c7a151ead7a5e2 2024-04-02T07:21:11.767 DEBUG:teuthology.orchestra.run.smithi055:> dpkg-query -W -f '${Version}' ceph 2024-04-02T07:21:11.790 INFO:teuthology.orchestra.run.smithi055.stdout:18.2.2-1015-gd0e392d9-1jammy 2024-04-02T07:21:11.790 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1015-gd0e392d9-1jammy 2024-04-02T07:21:11.791 INFO:teuthology.task.install:The correct ceph version 18.2.2-1015-gd0e392d9-1jammy is installed. 2024-04-02T07:21:11.792 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d0e392d9aee635f2b65768c460c7a151ead7a5e2 2024-04-02T07:21:11.933 DEBUG:teuthology.orchestra.run.smithi106:> dpkg-query -W -f '${Version}' ceph 2024-04-02T07:21:11.957 INFO:teuthology.orchestra.run.smithi106.stdout:18.2.2-1015-gd0e392d9-1jammy 2024-04-02T07:21:11.957 INFO:teuthology.packaging:The installed version of ceph is 18.2.2-1015-gd0e392d9-1jammy 2024-04-02T07:21:11.957 INFO:teuthology.task.install:The correct ceph version 18.2.2-1015-gd0e392d9-1jammy is installed. 2024-04-02T07:21:11.959 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-02T07:21:11.959 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:11.959 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-02T07:21:11.979 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:12.034 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-02T07:21:12.055 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-02T07:21:12.056 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:12.056 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/daemon-helper 2024-04-02T07:21:12.076 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-02T07:21:12.137 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:12.137 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/daemon-helper 2024-04-02T07:21:12.158 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-02T07:21:12.218 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-02T07:21:12.218 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:12.218 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-02T07:21:12.237 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-02T07:21:12.300 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:12.301 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-02T07:21:12.321 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-02T07:21:12.385 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-02T07:21:12.386 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:12.386 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/stdin-killer 2024-04-02T07:21:12.405 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-02T07:21:12.468 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:12.468 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/stdin-killer 2024-04-02T07:21:12.488 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-02T07:21:12.549 INFO:teuthology.run_tasks:Running task ceph... 2024-04-02T07:21:12.631 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-02T07:21:12.632 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 777 /var/log/ceph 2024-04-02T07:21:12.635 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 777 /var/log/ceph 2024-04-02T07:21:12.657 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-02T07:21:12.658 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-02T07:21:12.696 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-02T07:21:12.717 INFO:tasks.ceph:Creating extra log directories... 2024-04-02T07:21:12.717 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-02T07:21:12.756 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-02T07:21:12.784 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-02T07:21:12.785 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-02T07:21:12.785 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-02T07:21:12.785 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:12.785 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-02T07:21:12.825 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-02T07:21:12.919 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:12.919 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-02T07:21:12.928 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-02T07:21:13.025 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-02T07:21:13.025 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-02T07:21:13.025 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-04-02_06:51:51-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7635440', 'branch': 'wip-vshankar-testing-20240326.105515-reef', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/forward-scrub}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7635440', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'vshankar-2024-04-02_06:51:51-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240326.105515-reef'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': 'd0e392d9aee635f2b65768c460c7a151ead7a5e2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd0e392d9aee635f2b65768c460c7a151ead7a5e2'}}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240326.105515-reef', 'sha1': 'd46289a69430c98a5ee030c7aba50d0c7af4ad4b'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7327, 'sha1': 'd0e392d9aee635f2b65768c460c7a151ead7a5e2', 'sleep_before_teardown': 0, 'subset': '990/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240326.105515-reef', 'suite_path': '/home/teuthworker/src/github.com_vshankar_ceph_d46289a69430c98a5ee030c7aba50d0c7af4ad4b/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/vshankar/ceph.git', 'suite_sha1': 'd46289a69430c98a5ee030c7aba50d0c7af4ad4b', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi055.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO6L5qqJVjl+wGJ6iypG0pgb3Ctz9was79i+AjRSRCDDAWyA14GWLgcGtfZ4+idn4jhxovYpd4eqXIibb6AVkKA=', 'smithi106.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF6tOml1IjfQtFLvItNq+tTnYPUSm7I737Q4RNrNug/va7UfjaigktfN2Af2qj3qeHvF1o1/7xBY1hXO0I5ehlY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd0e392d9aee635f2b65768c460c7a151ead7a5e2'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'inode wrongly marked free', 'bad backtrace on inode', 'inode table repaired for inode', 'Scrub error on inode', 'Scrub error on dir', 'Metadata damage detected'], 'sha1': 'd0e392d9aee635f2b65768c460c7a151ead7a5e2', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_forward_scrub']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-04-02_06:51:51', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-02T07:21:13.026 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-02T07:21:13.029 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-02T07:21:13.037 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/run/ceph 2024-04-02T07:21:13.081 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/run/ceph 2024-04-02T07:21:13.101 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:13.101 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/scratch_devs of=/dev/stdout 2024-04-02T07:21:13.146 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-02T07:21:13.146 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_1 2024-04-02T07:21:13.198 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-02T07:21:13.198 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-02T07:21:13.198 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 868 Links: 1 2024-04-02T07:21:13.198 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-02T07:21:13.198 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-04-02 07:14:45.659050119 +0000 2024-04-02T07:21:13.198 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-04-02 07:14:45.407052370 +0000 2024-04-02T07:21:13.199 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-04-02 07:14:45.407052370 +0000 2024-04-02T07:21:13.199 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-04-02 07:14:45.407052370 +0000 2024-04-02T07:21:13.199 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-02T07:21:13.259 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-04-02T07:21:13.259 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-04-02T07:21:13.259 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000430139 s, 1.2 MB/s 2024-04-02T07:21:13.261 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-02T07:21:13.315 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_2 2024-04-02T07:21:13.366 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-02T07:21:13.366 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-02T07:21:13.366 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-04-02T07:21:13.366 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-02T07:21:13.366 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-04-02 07:14:46.219045117 +0000 2024-04-02T07:21:13.366 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-04-02 07:14:45.935047654 +0000 2024-04-02T07:21:13.367 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-04-02 07:14:45.935047654 +0000 2024-04-02T07:21:13.367 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-04-02 07:14:45.935047654 +0000 2024-04-02T07:21:13.367 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-02T07:21:13.427 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-04-02T07:21:13.427 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-04-02T07:21:13.427 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000653638 s, 783 kB/s 2024-04-02T07:21:13.429 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-02T07:21:13.480 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_3 2024-04-02T07:21:13.534 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-02T07:21:13.535 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-02T07:21:13.535 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 901 Links: 1 2024-04-02T07:21:13.535 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-02T07:21:13.535 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-04-02 07:14:46.763040259 +0000 2024-04-02T07:21:13.535 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-04-02 07:14:46.491042688 +0000 2024-04-02T07:21:13.535 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-04-02 07:14:46.491042688 +0000 2024-04-02T07:21:13.535 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-04-02 07:14:46.491042688 +0000 2024-04-02T07:21:13.535 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-02T07:21:13.600 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-04-02T07:21:13.600 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-04-02T07:21:13.600 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.00048252 s, 1.1 MB/s 2024-04-02T07:21:13.605 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-02T07:21:13.655 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_4 2024-04-02T07:21:13.706 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-02T07:21:13.706 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-02T07:21:13.706 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 5h/5d Inode: 920 Links: 1 2024-04-02T07:21:13.707 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-02T07:21:13.707 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2024-04-02 07:14:47.311035363 +0000 2024-04-02T07:21:13.707 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2024-04-02 07:14:47.043037757 +0000 2024-04-02T07:21:13.707 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2024-04-02 07:14:47.043037757 +0000 2024-04-02T07:21:13.707 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: 2024-04-02 07:14:47.043037757 +0000 2024-04-02T07:21:13.707 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-02T07:21:13.767 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2024-04-02T07:21:13.767 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2024-04-02T07:21:13.768 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000714225 s, 717 kB/s 2024-04-02T07:21:13.769 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-02T07:21:13.824 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-02T07:21:13.824 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:13.825 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/scratch_devs of=/dev/stdout 2024-04-02T07:21:13.834 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-02T07:21:13.835 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_1 2024-04-02T07:21:13.887 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-02T07:21:13.887 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-02T07:21:13.887 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 887 Links: 1 2024-04-02T07:21:13.887 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-02T07:21:13.887 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-04-02 07:14:43.557890810 +0000 2024-04-02T07:21:13.887 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-04-02 07:14:43.293893162 +0000 2024-04-02T07:21:13.887 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-04-02 07:14:43.293893162 +0000 2024-04-02T07:21:13.888 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-04-02 07:14:43.293893162 +0000 2024-04-02T07:21:13.888 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-02T07:21:13.948 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-04-02T07:21:13.948 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-04-02T07:21:13.949 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000412686 s, 1.2 MB/s 2024-04-02T07:21:13.950 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-02T07:21:14.009 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_2 2024-04-02T07:21:14.062 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-02T07:21:14.063 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-02T07:21:14.063 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 905 Links: 1 2024-04-02T07:21:14.063 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-02T07:21:14.063 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-04-02 07:14:44.085886104 +0000 2024-04-02T07:21:14.063 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-04-02 07:14:43.817888493 +0000 2024-04-02T07:21:14.063 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-04-02 07:14:43.817888493 +0000 2024-04-02T07:21:14.063 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-04-02 07:14:43.817888493 +0000 2024-04-02T07:21:14.063 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-02T07:21:14.125 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-04-02T07:21:14.125 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-04-02T07:21:14.125 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000641781 s, 798 kB/s 2024-04-02T07:21:14.127 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-02T07:21:14.180 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_3 2024-04-02T07:21:14.234 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-02T07:21:14.234 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-02T07:21:14.234 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 922 Links: 1 2024-04-02T07:21:14.234 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-02T07:21:14.234 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-04-02 07:14:44.605881472 +0000 2024-04-02T07:21:14.235 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-04-02 07:14:44.341883825 +0000 2024-04-02T07:21:14.235 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-04-02 07:14:44.341883825 +0000 2024-04-02T07:21:14.235 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-04-02 07:14:44.341883825 +0000 2024-04-02T07:21:14.235 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-02T07:21:14.297 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-04-02T07:21:14.297 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-04-02T07:21:14.297 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000401467 s, 1.3 MB/s 2024-04-02T07:21:14.299 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-02T07:21:14.352 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_4 2024-04-02T07:21:14.403 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-02T07:21:14.403 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-02T07:21:14.403 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 939 Links: 1 2024-04-02T07:21:14.403 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-02T07:21:14.404 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-04-02 07:14:45.133876767 +0000 2024-04-02T07:21:14.404 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-04-02 07:14:44.873879084 +0000 2024-04-02T07:21:14.404 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-04-02 07:14:44.873879084 +0000 2024-04-02T07:21:14.404 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: 2024-04-02 07:14:44.873879084 +0000 2024-04-02T07:21:14.404 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-02T07:21:14.464 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-04-02T07:21:14.465 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-04-02T07:21:14.465 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000389633 s, 1.3 MB/s 2024-04-02T07:21:14.466 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-02T07:21:14.520 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-02T07:21:14.520 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-02T07:21:14.520 INFO:tasks.ceph:Generating config... 2024-04-02T07:21:14.521 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-02T07:21:14.521 INFO:tasks.ceph:[client] debug client = 20 2024-04-02T07:21:14.522 INFO:tasks.ceph:[client] debug ms = 1 2024-04-02T07:21:14.522 INFO:tasks.ceph:[client] pid file = 2024-04-02T07:21:14.522 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-02T07:21:14.522 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-02T07:21:14.522 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-02T07:21:14.522 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-02T07:21:14.522 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-02T07:21:14.522 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-02T07:21:14.522 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-02T07:21:14.522 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-02T07:21:14.522 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-02T07:21:14.522 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-02T07:21:14.522 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-02T07:21:14.522 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-02T07:21:14.523 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-02T07:21:14.523 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-02T07:21:14.523 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-02T07:21:14.523 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-02T07:21:14.523 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-02T07:21:14.523 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-02T07:21:14.523 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-02T07:21:14.523 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-02T07:21:14.523 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-02T07:21:14.523 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-02T07:21:14.523 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-02T07:21:14.523 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-02T07:21:14.523 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-02T07:21:14.523 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-02T07:21:14.523 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-02T07:21:14.524 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-02T07:21:14.524 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-02T07:21:14.524 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-02T07:21:14.524 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-02T07:21:14.524 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-02T07:21:14.524 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-02T07:21:14.524 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-02T07:21:14.524 INFO:tasks.ceph:Setting up mon.a... 2024-04-02T07:21:14.524 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-02T07:21:14.570 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.keyring 2024-04-02T07:21:14.586 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-02T07:21:14.633 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-02T07:21:14.701 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.55'), ('mon.b', '172.21.15.106'), ('mon.c', '[v2:172.21.15.106:3301,v1:172.21.15.106:6790]')] 2024-04-02T07:21:14.702 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.55,172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-02T07:21:14.702 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:14.703 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-02T07:21:14.750 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.55 --add b 172.21.15.106 --addv c '[v2:172.21.15.106:3301,v1:172.21.15.106:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-02T07:21:14.840 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-02T07:21:14.841 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: generated fsid 642a0456-a2ac-49a4-91a5-3b3449b512da 2024-04-02T07:21:14.841 INFO:teuthology.orchestra.run.smithi055.stdout:setting min_mon_release = pacific 2024-04-02T07:21:14.841 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 0 2024-04-02T07:21:14.841 INFO:teuthology.orchestra.run.smithi055.stdout:fsid 642a0456-a2ac-49a4-91a5-3b3449b512da 2024-04-02T07:21:14.841 INFO:teuthology.orchestra.run.smithi055.stdout:last_changed 2024-04-02T07:21:14.842265+0000 2024-04-02T07:21:14.841 INFO:teuthology.orchestra.run.smithi055.stdout:created 2024-04-02T07:21:14.842265+0000 2024-04-02T07:21:14.841 INFO:teuthology.orchestra.run.smithi055.stdout:min_mon_release 16 (pacific) 2024-04-02T07:21:14.841 INFO:teuthology.orchestra.run.smithi055.stdout:election_strategy: 1 2024-04-02T07:21:14.841 INFO:teuthology.orchestra.run.smithi055.stdout:0: [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] mon.a 2024-04-02T07:21:14.841 INFO:teuthology.orchestra.run.smithi055.stdout:1: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.b 2024-04-02T07:21:14.841 INFO:teuthology.orchestra.run.smithi055.stdout:2: [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] mon.c 2024-04-02T07:21:14.841 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-02T07:21:14.843 DEBUG:teuthology.orchestra.run.smithi055:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-02T07:21:14.852 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 642a0456-a2ac-49a4-91a5-3b3449b512da... 2024-04-02T07:21:14.853 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-02T07:21:14.897 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-02T07:21:14.937 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2024-04-02T07:21:14.937 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2024-04-02T07:21:14.937 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-02T07:21:14.937 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2024-04-02T07:21:14.937 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.937 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2024-04-02T07:21:14.937 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.937 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2024-04-02T07:21:14.938 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.938 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2024-04-02T07:21:14.938 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2024-04-02T07:21:14.938 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.938 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2024-04-02T07:21:14.938 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2024-04-02T07:21:14.938 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.938 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-02T07:21:14.938 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2024-04-02T07:21:14.938 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.938 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2024-04-02T07:21:14.938 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-02T07:21:14.938 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.938 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2024-04-02T07:21:14.939 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.939 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2024-04-02T07:21:14.939 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2024-04-02T07:21:14.939 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2024-04-02T07:21:14.939 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2024-04-02T07:21:14.939 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2024-04-02T07:21:14.939 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2024-04-02T07:21:14.939 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2024-04-02T07:21:14.939 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-02T07:21:14.939 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-02T07:21:14.939 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2024-04-02T07:21:14.939 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.939 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-02T07:21:14.939 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.940 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2024-04-02T07:21:14.940 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.940 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2024-04-02T07:21:14.940 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.940 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2024-04-02T07:21:14.940 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2024-04-02T07:21:14.940 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2024-04-02T07:21:14.940 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.55,172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790]" 2024-04-02T07:21:14.940 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = 642a0456-a2ac-49a4-91a5-3b3449b512da 2024-04-02T07:21:14.940 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.940 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2024-04-02T07:21:14.940 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2024-04-02T07:21:14.940 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.940 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2024-04-02T07:21:14.940 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2024-04-02T07:21:14.941 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2024-04-02T07:21:14.941 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.941 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2024-04-02T07:21:14.941 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2024-04-02T07:21:14.941 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.941 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2024-04-02T07:21:14.941 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2024-04-02T07:21:14.941 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2024-04-02T07:21:14.941 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.941 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2024-04-02T07:21:14.941 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2024-04-02T07:21:14.941 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.941 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2024-04-02T07:21:14.941 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.941 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2024-04-02T07:21:14.942 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.942 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2024-04-02T07:21:14.942 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.942 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2024-04-02T07:21:14.942 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2024-04-02T07:21:14.942 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.942 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2024-04-02T07:21:14.942 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2024-04-02T07:21:14.942 INFO:teuthology.orchestra.run.smithi055.stdout: bdev async discard = True 2024-04-02T07:21:14.942 INFO:teuthology.orchestra.run.smithi055.stdout: bdev enable discard = True 2024-04-02T07:21:14.942 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore allocator = bitmap 2024-04-02T07:21:14.942 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2024-04-02T07:21:14.942 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2024-04-02T07:21:14.942 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 1/20 2024-04-02T07:21:14.943 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 1/20 2024-04-02T07:21:14.943 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:21:14.943 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2024-04-02T07:21:14.943 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 4/10 2024-04-02T07:21:14.943 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2024-04-02T07:21:14.943 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2024-04-02T07:21:14.943 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2024-04-02T07:21:14.943 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2024-04-02T07:21:14.943 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2024-04-02T07:21:14.943 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-02T07:21:14.943 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.943 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2024-04-02T07:21:14.943 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:21:14.943 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2024-04-02T07:21:14.943 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-02T07:21:14.944 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-02T07:21:14.944 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-02T07:21:14.944 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-02T07:21:14.944 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2024-04-02T07:21:14.944 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.944 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2024-04-02T07:21:14.944 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:21:14.944 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-02T07:21:14.944 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2024-04-02T07:21:14.944 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-02T07:21:14.944 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2024-04-02T07:21:14.944 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2024-04-02T07:21:14.944 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-02T07:21:14.944 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2024-04-02T07:21:14.944 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2024-04-02T07:21:14.945 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-02T07:21:14.945 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.945 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-02T07:21:14.945 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2024-04-02T07:21:14.945 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2024-04-02T07:21:14.945 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.945 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2024-04-02T07:21:14.945 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-02T07:21:14.945 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-02T07:21:14.945 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.945 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2024-04-02T07:21:14.945 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2024-04-02T07:21:14.945 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.945 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2024-04-02T07:21:14.945 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2024-04-02T07:21:14.946 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:14.946 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2024-04-02T07:21:14.946 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2024-04-02T07:21:14.946 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2024-04-02T07:21:14.946 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2024-04-02T07:21:14.946 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-02T07:21:14.947 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-02T07:21:14.947 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2024-04-02T07:21:14.947 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2024-04-02T07:21:14.947 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:21:14.947 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2024-04-02T07:21:14.947 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-02T07:21:14.947 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-02T07:21:14.947 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2024-04-02T07:21:14.947 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2024-04-02T07:21:14.947 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2024-04-02T07:21:14.947 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-04-02T07:21:14.947 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-04-02T07:21:14.947 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-04-02T07:21:14.947 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-04-02T07:21:14.947 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2024-04-02T07:21:14.948 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2024-04-02T07:21:14.948 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2024-04-02T07:21:14.948 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:21:14.948 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2024-04-02T07:21:14.948 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = True 2024-04-02T07:21:14.948 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2024-04-02T07:21:14.948 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = True 2024-04-02T07:21:14.948 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-02T07:21:14.948 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-02T07:21:14.948 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-02T07:21:14.949 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2024-04-02T07:21:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: chdir = "" 2024-04-02T07:21:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-02T07:21:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: auth supported = cephx 2024-04-02T07:21:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: filestore xattr use omap = true 2024-04-02T07:21:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: mon clock drift allowed = 1.000 2024-04-02T07:21:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: osd crush chooseleaf type = 0 2024-04-02T07:21:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: auth debug = true 2024-04-02T07:21:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on old message = true 2024-04-02T07:21:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on bug = true 2024-04-02T07:21:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-02T07:21:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: mon pg warn max object skew = 0 2024-04-02T07:21:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: # disable pg_autoscaler by default for new pools 2024-04-02T07:21:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-02T07:21:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default size = 2 2024-04-02T07:21:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow primary affinity = true 2024-04-02T07:21:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow pg remap = true 2024-04-02T07:21:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on legacy crush tunables = false 2024-04-02T07:21:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on crush straw calc version zero = false 2024-04-02T07:21:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on no sortbitwise = false 2024-04-02T07:21:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on osd down out interval zero = false 2024-04-02T07:21:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on too few osds = false 2024-04-02T07:21:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-02T07:21:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-02T07:21:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: mon_allow_pool_size_one = true 2024-04-02T07:21:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-02T07:21:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: osd default data pool replay window = 5 2024-04-02T07:21:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: mon allow pool delete = true 2024-04-02T07:21:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: mon cluster log file level = debug 2024-04-02T07:21:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: debug asserts on shutdown = true 2024-04-02T07:21:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: mon health detail to clog = false 2024-04-02T07:21:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: mon host = "172.21.15.55,172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790]" 2024-04-02T07:21:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = 642a0456-a2ac-49a4-91a5-3b3449b512da 2024-04-02T07:21:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.952 INFO:teuthology.orchestra.run.smithi106.stdout:[osd] 2024-04-02T07:21:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: osd journal size = 100 2024-04-02T07:21:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub load threshold = 5.0 2024-04-02T07:21:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub max interval = 600 2024-04-02T07:21:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: osd mclock profile = high_recovery_ops 2024-04-02T07:21:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: osd recover clone overlap = true 2024-04-02T07:21:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: osd recovery max chunk = 1048576 2024-04-02T07:21:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug shutdown = true 2024-04-02T07:21:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug op order = true 2024-04-02T07:21:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify stray on activate = true 2024-04-02T07:21:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: osd open classes on start = true 2024-04-02T07:21:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug pg log writeout = true 2024-04-02T07:21:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: osd deep scrub update digest min age = 30 2024-04-02T07:21:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: osd map max advance = 10 2024-04-02T07:21:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: journal zero on create = true 2024-04-02T07:21:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: filestore ondisk finisher threads = 3 2024-04-02T07:21:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: filestore apply finisher threads = 3 2024-04-02T07:21:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: bdev debug aio = true 2024-04-02T07:21:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug misdirected ops = true 2024-04-02T07:21:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: bdev async discard = True 2024-04-02T07:21:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: bdev enable discard = True 2024-04-02T07:21:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore allocator = bitmap 2024-04-02T07:21:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore block size = 96636764160 2024-04-02T07:21:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore fsck on mount = True 2024-04-02T07:21:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluefs = 1/20 2024-04-02T07:21:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluestore = 1/20 2024-04-02T07:21:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:21:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: debug osd = 20 2024-04-02T07:21:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: debug rocksdb = 4/10 2024-04-02T07:21:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd backfillfull_ratio = 0.85 2024-04-02T07:21:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd full ratio = 0.9 2024-04-02T07:21:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd nearfull ratio = 0.8 2024-04-02T07:21:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: osd failsafe full ratio = 0.95 2024-04-02T07:21:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: osd objectstore = bluestore 2024-04-02T07:21:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2024-04-02T07:21:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.955 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr] 2024-04-02T07:21:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:21:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: debug mgr = 20 2024-04-02T07:21:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-04-02T07:21:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-04-02T07:21:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-04-02T07:21:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-04-02T07:21:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: mgr/telemetry/nag = false 2024-04-02T07:21:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.955 INFO:teuthology.orchestra.run.smithi106.stdout:[mon] 2024-04-02T07:21:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:21:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-04-02T07:21:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: debug paxos = 20 2024-04-02T07:21:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-04-02T07:21:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: mon data avail warn = 5 2024-04-02T07:21:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: mon mgr mkfs grace = 240 2024-04-02T07:21:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-04-02T07:21:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd reporter subtree level = osd 2024-04-02T07:21:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd prime pg temp = true 2024-04-02T07:21:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-04-02T07:21:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-02T07:21:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: auth mon ticket ttl = 660 # 11m 2024-04-02T07:21:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: auth service ticket ttl = 240 # 4m 2024-04-02T07:21:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: # don't complain about insecure global_id in the test suite 2024-04-02T07:21:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-02T07:21:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-02T07:21:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: # 1m isn't quite enough 2024-04-02T07:21:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: mon_down_mkfs_grace = 2m 2024-04-02T07:21:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_filestore_osds = false 2024-04-02T07:21:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: mon op complaint time = 120 2024-04-02T07:21:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:21:14.958 INFO:teuthology.orchestra.run.smithi106.stdout:[client] 2024-04-02T07:21:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: rgw cache enabled = true 2024-04-02T07:21:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable ops log = true 2024-04-02T07:21:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable usage log = true 2024-04-02T07:21:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-02T07:21:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-02T07:21:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: client mount timeout = 600 2024-04-02T07:21:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: debug client = 20 2024-04-02T07:21:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:21:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = "" 2024-04-02T07:21:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2024-04-02T07:21:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2024-04-02T07:21:14.959 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.a] 2024-04-02T07:21:14.959 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.b] 2024-04-02T07:21:14.959 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.c] 2024-04-02T07:21:14.959 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2024-04-02T07:21:14.959 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.c] 2024-04-02T07:21:14.959 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2024-04-02T07:21:14.959 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.d] 2024-04-02T07:21:14.959 INFO:teuthology.orchestra.run.smithi106.stdout:[mds] 2024-04-02T07:21:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds = 20 2024-04-02T07:21:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds balancer = 20 2024-04-02T07:21:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:21:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug frag = True 2024-04-02T07:21:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug scatterstat = True 2024-04-02T07:21:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: mds op complaint time = 180 2024-04-02T07:21:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: mds verify scatter = True 2024-04-02T07:21:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2024-04-02T07:21:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2024-04-02T07:21:14.960 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2024-04-02T07:21:14.962 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-02T07:21:14.962 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-02T07:21:15.062 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-02T07:21:15.062 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:15.062 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-02T07:21:15.071 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:15.071 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-02T07:21:15.121 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:21:15.122 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:15.122 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-02T07:21:15.122 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-02T07:21:15.197 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:15.197 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-02T07:21:15.247 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:21:15.247 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:15.247 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-02T07:21:15.247 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-02T07:21:15.282 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:15.282 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-02T07:21:15.334 INFO:tasks.ceph:Setting up mon nodes... 2024-04-02T07:21:15.334 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-02T07:21:15.334 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-02T07:21:15.389 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-02T07:21:15.394 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-02T07:21:15.453 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-02T07:21:15.466 INFO:tasks.ceph:Setting up mds nodes... 2024-04-02T07:21:15.467 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-02T07:21:15.522 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-02T07:21:15.527 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-02T07:21:15.547 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-02T07:21:15.644 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-02T07:21:15.648 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-02T07:21:15.669 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-02T07:21:15.727 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-02T07:21:15.732 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-02T07:21:15.752 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-02T07:21:15.847 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-02T07:21:15.851 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-02T07:21:15.871 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-02T07:21:15.871 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-02T07:21:15.913 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-02T07:21:15.930 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-04-02T07:21:16.019 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-04-02T07:21:16.036 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-02T07:21:16.078 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-02T07:21:16.094 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-04-02T07:21:16.179 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-04-02T07:21:16.196 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-02T07:21:16.196 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-02T07:21:16.196 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-02T07:21:16.217 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-02T07:21:16.217 INFO:tasks.ceph:role: osd.0 2024-04-02T07:21:16.217 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:21:16.217 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-02T07:21:16.304 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-02T07:21:16.305 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-02T07:21:16.305 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-02T07:21:16.305 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-02T07:21:16.305 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-02T07:21:16.305 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2024-04-02T07:21:16.305 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-02T07:21:16.305 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-02T07:21:16.305 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-02T07:21:16.305 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-02T07:21:17.602 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2024-04-02T07:21:17.605 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2024-04-02T07:21:17.605 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-02T07:21:17.679 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-02T07:21:17.738 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: /sbin/restorecon: command not found 2024-04-02T07:21:17.739 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:21:17.740 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-02T07:21:17.806 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-02T07:21:17.806 INFO:tasks.ceph:role: osd.1 2024-04-02T07:21:17.806 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:21:17.806 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-02T07:21:17.897 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-02T07:21:17.897 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-02T07:21:17.897 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-02T07:21:17.897 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-02T07:21:17.898 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-02T07:21:17.898 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2024-04-02T07:21:17.898 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-02T07:21:17.898 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-02T07:21:17.898 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-02T07:21:17.898 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-02T07:21:19.201 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2024-04-02T07:21:19.204 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2024-04-02T07:21:19.204 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-02T07:21:19.281 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-02T07:21:19.338 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: /sbin/restorecon: command not found 2024-04-02T07:21:19.339 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:21:19.339 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-02T07:21:19.402 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-02T07:21:19.402 INFO:tasks.ceph:role: osd.2 2024-04-02T07:21:19.402 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:21:19.403 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-02T07:21:19.494 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-02T07:21:19.494 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-02T07:21:19.494 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-02T07:21:19.494 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-02T07:21:19.494 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-02T07:21:19.494 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2024-04-02T07:21:19.494 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-02T07:21:19.494 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-02T07:21:19.494 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-02T07:21:19.495 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-02T07:21:20.791 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2024-04-02T07:21:20.795 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2024-04-02T07:21:20.795 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-02T07:21:20.825 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-02T07:21:20.886 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: /sbin/restorecon: command not found 2024-04-02T07:21:20.887 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:21:20.888 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-02T07:21:20.949 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-02T07:21:20.949 INFO:tasks.ceph:role: osd.3 2024-04-02T07:21:20.949 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:21:20.949 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-02T07:21:21.038 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-02T07:21:21.038 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-02T07:21:21.038 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-02T07:21:21.038 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-02T07:21:21.038 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-02T07:21:21.038 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2024-04-02T07:21:21.038 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-02T07:21:21.039 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-02T07:21:21.039 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-02T07:21:21.039 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-02T07:21:22.356 INFO:teuthology.orchestra.run.smithi055.stdout:Discarding blocks...Done. 2024-04-02T07:21:22.360 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2024-04-02T07:21:22.360 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-02T07:21:22.394 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-02T07:21:22.466 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:21:22.466 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: /sbin/restorecon: command not found 2024-04-02T07:21:22.466 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-02T07:21:22.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:22.587+0000 7f70d1719640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-02T07:21:22.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:22.591+0000 7f70d1719640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-02T07:21:22.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:22.591+0000 7f70d1719640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-02T07:21:22.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:22.591+0000 7f70d1719640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-02T07:21:22.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:22.591+0000 7f70d1719640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-02T07:21:22.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:22.591+0000 7f70d1719640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-02T07:21:25.579 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-02T07:21:25.602 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-02T07:21:25.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:25.703+0000 7faa9e212640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-02T07:21:25.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:25.707+0000 7faa9e212640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-02T07:21:25.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:25.707+0000 7faa9e212640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-02T07:21:25.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:25.707+0000 7faa9e212640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-02T07:21:25.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:25.707+0000 7faa9e212640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-02T07:21:25.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:25.707+0000 7faa9e212640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-02T07:21:28.723 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-02T07:21:28.746 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-02T07:21:28.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:28.843+0000 7f2ce7863640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-02T07:21:28.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:28.843+0000 7f2ce7863640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-02T07:21:28.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:28.843+0000 7f2ce7863640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-02T07:21:28.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:28.843+0000 7f2ce7863640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-02T07:21:28.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:28.843+0000 7f2ce7863640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-02T07:21:28.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:28.847+0000 7f2ce7863640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-02T07:21:31.839 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-02T07:21:31.862 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-02T07:21:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:31.963+0000 7f98c7707640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-02T07:21:31.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:31.963+0000 7f98c7707640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-02T07:21:31.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:31.963+0000 7f98c7707640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-02T07:21:31.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:31.963+0000 7f98c7707640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-02T07:21:31.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:31.963+0000 7f98c7707640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-02T07:21:31.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:31.967+0000 7f98c7707640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-02T07:21:34.966 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-02T07:21:34.988 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-02T07:21:35.011 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-02T07:21:35.011 INFO:tasks.ceph:role: osd.4 2024-04-02T07:21:35.011 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:21:35.011 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-02T07:21:35.082 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-02T07:21:35.082 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-02T07:21:35.082 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-02T07:21:35.082 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-02T07:21:35.083 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-02T07:21:35.083 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-04-02T07:21:35.083 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-02T07:21:35.083 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-02T07:21:35.083 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-02T07:21:35.083 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-02T07:21:35.545 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-04-02T07:21:35.548 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-04-02T07:21:35.548 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-02T07:21:35.646 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-02T07:21:35.663 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2024-04-02T07:21:35.663 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:21:35.664 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-02T07:21:35.729 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-02T07:21:35.729 INFO:tasks.ceph:role: osd.5 2024-04-02T07:21:35.730 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:21:35.730 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-02T07:21:35.801 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-02T07:21:35.801 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-02T07:21:35.801 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-02T07:21:35.801 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-02T07:21:35.801 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-02T07:21:35.802 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-04-02T07:21:35.802 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-02T07:21:35.802 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-02T07:21:35.802 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-02T07:21:35.802 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-02T07:21:36.279 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-04-02T07:21:36.282 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-04-02T07:21:36.282 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-02T07:21:36.453 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-02T07:21:36.469 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2024-04-02T07:21:36.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:21:36.471 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-02T07:21:36.534 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-02T07:21:36.534 INFO:tasks.ceph:role: osd.6 2024-04-02T07:21:36.534 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:21:36.534 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-02T07:21:36.605 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-02T07:21:36.606 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-02T07:21:36.606 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-02T07:21:36.606 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-02T07:21:36.606 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-02T07:21:36.606 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-04-02T07:21:36.606 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-02T07:21:36.606 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-02T07:21:36.606 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-02T07:21:36.606 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-02T07:21:37.083 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-04-02T07:21:37.086 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-04-02T07:21:37.086 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-02T07:21:37.212 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-02T07:21:37.228 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2024-04-02T07:21:37.229 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:21:37.229 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-02T07:21:37.293 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-02T07:21:37.293 INFO:tasks.ceph:role: osd.7 2024-04-02T07:21:37.293 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:21:37.293 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-02T07:21:37.361 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-02T07:21:37.361 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-02T07:21:37.361 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-02T07:21:37.361 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-02T07:21:37.361 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-02T07:21:37.361 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-04-02T07:21:37.361 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-02T07:21:37.361 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-02T07:21:37.361 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-02T07:21:37.362 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-02T07:21:37.809 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-04-02T07:21:37.812 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-04-02T07:21:37.813 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-02T07:21:37.916 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-02T07:21:37.933 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2024-04-02T07:21:37.934 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:21:37.935 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-02T07:21:38.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:38.055+0000 7f0fe2aa9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-02T07:21:38.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:38.059+0000 7f0fe2aa9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-02T07:21:38.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:38.059+0000 7f0fe2aa9640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-02T07:21:38.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:38.059+0000 7f0fe2aa9640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-02T07:21:38.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:38.059+0000 7f0fe2aa9640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-02T07:21:38.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:38.063+0000 7f0fe2aa9640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-02T07:21:41.045 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-02T07:21:41.065 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-02T07:21:41.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:41.159+0000 7fea3dcba640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-02T07:21:41.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:41.159+0000 7fea3dcba640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-02T07:21:41.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:41.159+0000 7fea3dcba640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-02T07:21:41.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:41.159+0000 7fea3dcba640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-02T07:21:41.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:41.159+0000 7fea3dcba640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-02T07:21:41.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:41.163+0000 7fea3dcba640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-02T07:21:43.027 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:21:43.031 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:21:44.136 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-02T07:21:44.156 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-02T07:21:44.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:44.247+0000 7f03ae9ab640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-02T07:21:44.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:44.247+0000 7f03ae9ab640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-02T07:21:44.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:44.247+0000 7f03ae9ab640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-02T07:21:44.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:44.247+0000 7f03ae9ab640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-02T07:21:44.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:44.247+0000 7f03ae9ab640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-02T07:21:44.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:44.247+0000 7f03ae9ab640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-02T07:21:47.219 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-02T07:21:47.239 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-02T07:21:47.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:47.330+0000 7fedd96a0640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-02T07:21:47.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:47.330+0000 7fedd96a0640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-02T07:21:47.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:47.330+0000 7fedd96a0640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-02T07:21:47.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:47.330+0000 7fedd96a0640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-02T07:21:47.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:47.330+0000 7fedd96a0640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-02T07:21:47.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:47.330+0000 7fedd96a0640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-02T07:21:50.300 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-02T07:21:50.320 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-02T07:21:50.320 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:50.320 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-02T07:21:50.342 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:50.342 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-02T07:21:50.410 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:50.410 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-02T07:21:50.477 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:50.478 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-02T07:21:50.538 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:50.538 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-02T07:21:50.598 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:50.598 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-02T07:21:50.662 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:50.662 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-02T07:21:50.726 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:50.726 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-02T07:21:50.746 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:50.746 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-02T07:21:50.809 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:50.809 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-02T07:21:50.869 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:50.869 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-02T07:21:50.928 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:50.929 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-02T07:21:50.989 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:50.989 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-02T07:21:51.048 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:51.049 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-02T07:21:51.108 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:51.108 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-02T07:21:51.117 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:51.117 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-04-02T07:21:51.167 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:51.168 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-02T07:21:51.176 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:51.176 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-04-02T07:21:51.225 INFO:tasks.ceph:Adding keys to all mons... 2024-04-02T07:21:51.226 DEBUG:teuthology.orchestra.run.smithi055:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-02T07:21:51.229 DEBUG:teuthology.orchestra.run.smithi106:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-02T07:21:51.269 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.y] 2024-04-02T07:21:51.270 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDrsQtmUcxUFxAA8NUHdxhUfp3/AILMIbS1fw== 2024-04-02T07:21:51.270 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-04-02T07:21:51.270 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDrsQtmFL1DHxAAuUs47l42sADNRgxi4BeNrA== 2024-04-02T07:21:51.270 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-04-02T07:21:51.270 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDrsQtmUQR/JhAA9LNK5gHJ1NiiqNrfxL4mIA== 2024-04-02T07:21:51.270 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.0] 2024-04-02T07:21:51.270 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDysQtmsM9JIxAAZNjTGYW74kqz5NM9NyPSWQ== 2024-04-02T07:21:51.270 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.1] 2024-04-02T07:21:51.270 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQD1sQtmJaorKhAAtujPXPmQVX3QUG1ANqEphQ== 2024-04-02T07:21:51.271 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.2] 2024-04-02T07:21:51.271 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQD4sQtm1fdwMhAAOxlYwaBnPKhSQODMLVbaSQ== 2024-04-02T07:21:51.271 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.3] 2024-04-02T07:21:51.271 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQD7sQtmo9OaORAAsjpiVkG9vZV1QxpvgbrFmg== 2024-04-02T07:21:51.271 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.x] 2024-04-02T07:21:51.271 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDrsQtmFyktGxAAJC7ezewbXwDQue+qjpTfYw== 2024-04-02T07:21:51.271 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-04-02T07:21:51.271 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDrsQtmFZB+KxAAeKnfP4Z1UkLura+bQrG5mA== 2024-04-02T07:21:51.271 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-04-02T07:21:51.271 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDrsQtmotumMhAASI1PogpVSHXWIv9xq3qs4Q== 2024-04-02T07:21:51.271 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.4] 2024-04-02T07:21:51.271 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQACsgtmTyOkAxAARfxuj/YCM6FWNDhCkLQV3g== 2024-04-02T07:21:51.271 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.5] 2024-04-02T07:21:51.271 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAFsgtmimDECRAAh/XVN7rICihc8NlxhDJB6Q== 2024-04-02T07:21:51.272 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.6] 2024-04-02T07:21:51.272 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAIsgtmreHiDhAAISQbxixad17TRrz7MHQTxA== 2024-04-02T07:21:51.272 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.7] 2024-04-02T07:21:51.272 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQALsgtmHVTlExAAT/6jK+czOZ3+4nwpgZOmow== 2024-04-02T07:21:51.272 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2024-04-02T07:21:51.272 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDrsQtmkS2QNhAAt+q0y1TDn03hqM/Y6uKq6g== 2024-04-02T07:21:51.272 INFO:teuthology.orchestra.run.smithi055.stdout:[client.2] 2024-04-02T07:21:51.272 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDssQtmq45FARAAY6/caSeqvTn7/BThOodYIA== 2024-04-02T07:21:51.272 INFO:teuthology.orchestra.run.smithi055.stdout:[client.1] 2024-04-02T07:21:51.272 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDssQtmjCzTBBAAVYyat2dGZSTquRQoB+7JMg== 2024-04-02T07:21:51.272 INFO:teuthology.orchestra.run.smithi055.stdout:[client.3] 2024-04-02T07:21:51.272 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQDssQtmmjDeChAAL2RsY5VlAy/KZ5go5ZJoBA== 2024-04-02T07:21:51.282 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.y] 2024-04-02T07:21:51.282 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDrsQtmUcxUFxAA8NUHdxhUfp3/AILMIbS1fw== 2024-04-02T07:21:51.282 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2024-04-02T07:21:51.282 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDrsQtmFL1DHxAAuUs47l42sADNRgxi4BeNrA== 2024-04-02T07:21:51.282 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.c] 2024-04-02T07:21:51.282 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDrsQtmUQR/JhAA9LNK5gHJ1NiiqNrfxL4mIA== 2024-04-02T07:21:51.283 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.0] 2024-04-02T07:21:51.283 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDysQtmsM9JIxAAZNjTGYW74kqz5NM9NyPSWQ== 2024-04-02T07:21:51.283 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.1] 2024-04-02T07:21:51.283 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQD1sQtmJaorKhAAtujPXPmQVX3QUG1ANqEphQ== 2024-04-02T07:21:51.283 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.2] 2024-04-02T07:21:51.283 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQD4sQtm1fdwMhAAOxlYwaBnPKhSQODMLVbaSQ== 2024-04-02T07:21:51.283 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.3] 2024-04-02T07:21:51.283 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQD7sQtmo9OaORAAsjpiVkG9vZV1QxpvgbrFmg== 2024-04-02T07:21:51.283 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.x] 2024-04-02T07:21:51.283 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDrsQtmFyktGxAAJC7ezewbXwDQue+qjpTfYw== 2024-04-02T07:21:51.283 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2024-04-02T07:21:51.283 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDrsQtmFZB+KxAAeKnfP4Z1UkLura+bQrG5mA== 2024-04-02T07:21:51.283 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.d] 2024-04-02T07:21:51.283 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDrsQtmotumMhAASI1PogpVSHXWIv9xq3qs4Q== 2024-04-02T07:21:51.283 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.4] 2024-04-02T07:21:51.284 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQACsgtmTyOkAxAARfxuj/YCM6FWNDhCkLQV3g== 2024-04-02T07:21:51.284 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.5] 2024-04-02T07:21:51.284 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAFsgtmimDECRAAh/XVN7rICihc8NlxhDJB6Q== 2024-04-02T07:21:51.284 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.6] 2024-04-02T07:21:51.284 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAIsgtmreHiDhAAISQbxixad17TRrz7MHQTxA== 2024-04-02T07:21:51.284 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.7] 2024-04-02T07:21:51.284 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQALsgtmHVTlExAAT/6jK+czOZ3+4nwpgZOmow== 2024-04-02T07:21:51.284 INFO:teuthology.orchestra.run.smithi106.stdout:[client.0] 2024-04-02T07:21:51.284 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDrsQtmkS2QNhAAt+q0y1TDn03hqM/Y6uKq6g== 2024-04-02T07:21:51.284 INFO:teuthology.orchestra.run.smithi106.stdout:[client.2] 2024-04-02T07:21:51.284 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDssQtmq45FARAAY6/caSeqvTn7/BThOodYIA== 2024-04-02T07:21:51.284 INFO:teuthology.orchestra.run.smithi106.stdout:[client.1] 2024-04-02T07:21:51.284 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDssQtmjCzTBBAAVYyat2dGZSTquRQoB+7JMg== 2024-04-02T07:21:51.284 INFO:teuthology.orchestra.run.smithi106.stdout:[client.3] 2024-04-02T07:21:51.284 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQDssQtmmjDeChAAL2RsY5VlAy/KZ5go5ZJoBA== 2024-04-02T07:21:51.285 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-02T07:21:51.317 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-02T07:21:51.382 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-02T07:21:51.386 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-02T07:21:51.443 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-02T07:21:51.446 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-02T07:21:51.502 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-02T07:21:51.505 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-02T07:21:51.559 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-02T07:21:51.562 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-02T07:21:51.616 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-02T07:21:51.619 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-02T07:21:51.672 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-02T07:21:51.676 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-02T07:21:51.729 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-02T07:21:51.732 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-02T07:21:51.784 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-02T07:21:51.787 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-02T07:21:51.842 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-02T07:21:51.845 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-02T07:21:51.900 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-02T07:21:51.903 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-02T07:21:51.955 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-02T07:21:51.958 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-02T07:21:52.011 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-02T07:21:52.014 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-02T07:21:52.067 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-02T07:21:52.070 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-02T07:21:52.123 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-02T07:21:52.127 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-02T07:21:52.183 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-02T07:21:52.186 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-02T07:21:52.242 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-02T07:21:52.246 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-02T07:21:52.302 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-02T07:21:52.306 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-02T07:21:52.361 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-02T07:21:52.362 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-02T07:21:52.381 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-02T07:21:52.495 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-02T07:21:52.515 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-02T07:21:52.534 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-02T07:21:52.643 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-02T07:21:52.662 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-02T07:21:52.725 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-02T07:21:52.830 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-02T07:21:52.852 DEBUG:teuthology.orchestra.run.smithi055:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-02T07:21:52.856 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-02T07:21:52.901 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-02T07:21:52.902 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-02T07:21:52.902 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-02T07:21:52.905 INFO:tasks.ceph.mon.a:Started 2024-04-02T07:21:52.905 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-02T07:21:52.905 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-02T07:21:52.945 INFO:tasks.ceph.mon.b:Started 2024-04-02T07:21:52.945 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-02T07:21:52.945 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-02T07:21:52.948 INFO:tasks.ceph.mon.c:Started 2024-04-02T07:21:52.948 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-02T07:21:52.948 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-02T07:21:52.948 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-02T07:21:52.951 INFO:tasks.ceph.mgr.y:Started 2024-04-02T07:21:52.951 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-02T07:21:52.952 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-02T07:21:52.954 INFO:tasks.ceph.mgr.x:Started 2024-04-02T07:21:52.954 INFO:tasks.ceph:Setting crush tunables to default 2024-04-02T07:21:52.955 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd crush tunables default 2024-04-02T07:21:53.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.094+0000 7fb597a00640 1 Processor -- start 2024-04-02T07:21:53.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.094+0000 7fb597a00640 1 -- start start 2024-04-02T07:21:53.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.098+0000 7fb597a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb5900709b0 0x7fb5900b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:53.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.098+0000 7fb597a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5900b2fd0 0x7fb5900b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:53.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.098+0000 7fb597a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb59015e3a0 con 0x7fb590144260 2024-04-02T07:21:53.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.098+0000 7fb597a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5900b37c0 con 0x7fb5900709b0 2024-04-02T07:21:53.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.098+0000 7fb597a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59015e5f0 con 0x7fb5900b2fd0 2024-04-02T07:21:53.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.098+0000 7fb595a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5900b2fd0 0x7fb5900b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:53.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.098+0000 7fb595a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5900b2fd0 0x7fb5900b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:36964/0 (socket says 172.21.15.55:36964) 2024-04-02T07:21:53.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.098+0000 7fb595a00640 1 -- 172.21.15.55:0/4223863638 learned_addr learned my addr 172.21.15.55:0/4223863638 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:21:53.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.098+0000 7fb595a00640 1 -- 172.21.15.55:0/4223863638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5900b2fd0 msgr2=0x7fb5900b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-02T07:21:53.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.098+0000 7fb595a00640 1 -- 172.21.15.55:0/4223863638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5900b2fd0 msgr2=0x7fb5900b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-02T07:21:53.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.098+0000 7fb595a00640 1 --2- 172.21.15.55:0/4223863638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5900b2fd0 0x7fb5900b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-02T07:21:53.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.098+0000 7fb595a00640 1 --2- 172.21.15.55:0/4223863638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5900b2fd0 0x7fb5900b1670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-02T07:21:53.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.130+0000 7fb587e00640 1 --2- 172.21.15.55:0/4223863638 >> v2:172.21.15.55:3300/0 conn(0x7fb5900709b0 0x7fb5900b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:53.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.130+0000 7fb587e00640 1 -- 172.21.15.55:0/4223863638 >> v2:172.21.15.55:3300/0 conn(0x7fb5900709b0 msgr2=0x7fb5900b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-02T07:21:53.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.130+0000 7fb587e00640 1 -- 172.21.15.55:0/4223863638 >> v2:172.21.15.55:3300/0 conn(0x7fb5900709b0 msgr2=0x7fb5900b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-02T07:21:53.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.130+0000 7fb587e00640 1 --2- 172.21.15.55:0/4223863638 >> v2:172.21.15.55:3300/0 conn(0x7fb5900709b0 0x7fb5900b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-02T07:21:53.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.130+0000 7fb587e00640 1 --2- 172.21.15.55:0/4223863638 >> v2:172.21.15.55:3300/0 conn(0x7fb5900709b0 0x7fb5900b2a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-02T07:21:53.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.286+0000 7fb58fe00640 1 -- 172.21.15.55:0/4223863638 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3582532363 0 0) 0x7fb59015e3a0 con 0x7fb590144260 2024-04-02T07:21:53.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.286+0000 7fb58fe00640 1 -- 172.21.15.55:0/4223863638 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb574003530 con 0x7fb590144260 2024-04-02T07:21:53.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb58fe00640 1 -- 172.21.15.55:0/4223863638 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 992334827 0 0) 0x7fb574003530 con 0x7fb590144260 2024-04-02T07:21:53.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb58fe00640 1 -- 172.21.15.55:0/4223863638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5900b2fd0 msgr2=0x7fb5900b1670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-02T07:21:53.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb58fe00640 1 --2- 172.21.15.55:0/4223863638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5900b2fd0 0x7fb5900b1670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:53.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb58fe00640 1 -- 172.21.15.55:0/4223863638 >> v2:172.21.15.55:3300/0 conn(0x7fb5900709b0 msgr2=0x7fb5900b2a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-02T07:21:53.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb58fe00640 1 --2- 172.21.15.55:0/4223863638 >> v2:172.21.15.55:3300/0 conn(0x7fb5900709b0 0x7fb5900b2a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:53.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb58fe00640 1 -- 172.21.15.55:0/4223863638 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb59015e8d0 con 0x7fb590144260 2024-04-02T07:21:53.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb58fe00640 1 -- 172.21.15.55:0/4223863638 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fb580001680 con 0x7fb590144260 2024-04-02T07:21:53.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb58fe00640 1 -- 172.21.15.55:0/4223863638 >> v1:172.21.15.55:6789/0 conn(0x7fb590144260 legacy=0x7fb5900702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:53.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb58fe00640 1 --2- 172.21.15.55:0/4223863638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb574003980 0x7fb574003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:53.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb58fe00640 1 --2- 172.21.15.55:0/4223863638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5740047d0 0x7fb574004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:53.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb58fe00640 1 --2- 172.21.15.55:0/4223863638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5900b2fd0 0x7fb574005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:53.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb58fe00640 1 -- 172.21.15.55:0/4223863638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5900b37c0 con 0x7fb574003980 2024-04-02T07:21:53.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb58fe00640 1 -- 172.21.15.55:0/4223863638 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59015e5f0 con 0x7fb5740047d0 2024-04-02T07:21:53.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb58fe00640 1 -- 172.21.15.55:0/4223863638 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57400ba40 con 0x7fb5900b2fd0 2024-04-02T07:21:53.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb595000640 1 --2- 172.21.15.55:0/4223863638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb574003980 0x7fb574003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:53.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb587e00640 1 --2- 172.21.15.55:0/4223863638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5740047d0 0x7fb574004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:53.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb595a00640 1 --2- 172.21.15.55:0/4223863638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5900b2fd0 0x7fb574005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:53.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb595000640 1 -- 172.21.15.55:0/4223863638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5900b2fd0 msgr2=0x7fb574005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:21:53.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb595000640 1 --2- 172.21.15.55:0/4223863638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5900b2fd0 0x7fb574005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:53.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb595000640 1 -- 172.21.15.55:0/4223863638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5740047d0 msgr2=0x7fb574004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:21:53.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb595000640 1 --2- 172.21.15.55:0/4223863638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5740047d0 0x7fb574004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:53.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.290+0000 7fb595000640 1 -- 172.21.15.55:0/4223863638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb574003530 con 0x7fb574003980 2024-04-02T07:21:53.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.294+0000 7fb595000640 1 --2- 172.21.15.55:0/4223863638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb574003980 0x7fb574003da0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb58000c0e0 tx=0x7fb58001cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981c43ac6ecf3cef server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:53.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.294+0000 7fb58fe00640 1 -- 172.21.15.55:0/4223863638 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5800a5930 con 0x7fb574003980 2024-04-02T07:21:53.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.294+0000 7fb58fe00640 1 -- 172.21.15.55:0/4223863638 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5800a5ab0 con 0x7fb574003980 2024-04-02T07:21:53.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.294+0000 7fb58fe00640 1 -- 172.21.15.55:0/4223863638 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5800a5e60 con 0x7fb574003980 2024-04-02T07:21:53.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.294+0000 7fb597a00640 1 -- 172.21.15.55:0/4223863638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb574003980 msgr2=0x7fb574003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:53.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.294+0000 7fb597a00640 1 --2- 172.21.15.55:0/4223863638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb574003980 0x7fb574003da0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb58000c0e0 tx=0x7fb58001cb60 comp rx=0 tx=0).stop 2024-04-02T07:21:53.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.294+0000 7fb595a00640 1 -- 172.21.15.55:0/4223863638 reap_dead start 2024-04-02T07:21:53.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.294+0000 7fb597a00640 1 -- 172.21.15.55:0/4223863638 shutdown_connections 2024-04-02T07:21:53.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.294+0000 7fb597a00640 1 -- 172.21.15.55:0/4223863638 >> 172.21.15.55:0/4223863638 conn(0x7fb59006a390 msgr2=0x7fb5900b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:53.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.294+0000 7fb597a00640 1 -- 172.21.15.55:0/4223863638 shutdown_connections 2024-04-02T07:21:53.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.294+0000 7fb597a00640 1 -- 172.21.15.55:0/4223863638 wait complete. 2024-04-02T07:21:53.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.298+0000 7fb597a00640 1 Processor -- start 2024-04-02T07:21:53.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.298+0000 7fb597a00640 1 -- start start 2024-04-02T07:21:53.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.298+0000 7fb597a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb574003980 0x7fb590136cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:53.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.298+0000 7fb597a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5901f5f20 0x7fb59006d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:53.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.298+0000 7fb597a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb59006df20 0x7fb590140760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:53.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.298+0000 7fb597a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5901f5250 con 0x7fb59006df20 2024-04-02T07:21:53.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.298+0000 7fb597a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb59006e3d0 con 0x7fb574003980 2024-04-02T07:21:53.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.298+0000 7fb597a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb59013eed0 con 0x7fb5901f5f20 2024-04-02T07:21:53.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.298+0000 7fb595a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb59006df20 0x7fb590140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:53.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.298+0000 7fb587e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5901f5f20 0x7fb59006d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:53.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.298+0000 7fb595000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb574003980 0x7fb590136cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:53.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.298+0000 7fb587e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5901f5f20 0x7fb59006d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:37024/0 (socket says 172.21.15.55:37024) 2024-04-02T07:21:53.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.298+0000 7fb587e00640 1 -- 172.21.15.55:0/164183521 learned_addr learned my addr 172.21.15.55:0/164183521 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:21:53.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.298+0000 7fb587e00640 1 -- 172.21.15.55:0/164183521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb574003980 msgr2=0x7fb590136cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:53.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.298+0000 7fb587e00640 1 --2- 172.21.15.55:0/164183521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb574003980 0x7fb590136cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:53.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.298+0000 7fb587e00640 1 -- 172.21.15.55:0/164183521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb59006df20 msgr2=0x7fb590140760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:53.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.298+0000 7fb587e00640 1 --2- 172.21.15.55:0/164183521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb59006df20 0x7fb590140760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:53.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.298+0000 7fb587e00640 1 -- 172.21.15.55:0/164183521 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb590141440 con 0x7fb5901f5f20 2024-04-02T07:21:53.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.298+0000 7fb595a00640 1 --2- 172.21.15.55:0/164183521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb59006df20 0x7fb590140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:21:53.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.298+0000 7fb587e00640 1 --2- 172.21.15.55:0/164183521 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5901f5f20 0x7fb59006d9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb5780116d0 tx=0x7fb578011b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:53.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.302+0000 7fb58d600640 1 -- 172.21.15.55:0/164183521 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb578004220 con 0x7fb5901f5f20 2024-04-02T07:21:53.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.302+0000 7fb58d600640 1 -- 172.21.15.55:0/164183521 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb578004380 con 0x7fb5901f5f20 2024-04-02T07:21:53.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.302+0000 7fb58d600640 1 -- 172.21.15.55:0/164183521 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57800f980 con 0x7fb5901f5f20 2024-04-02T07:21:53.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.302+0000 7fb597a00640 1 -- 172.21.15.55:0/164183521 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5901f5440 con 0x7fb5901f5f20 2024-04-02T07:21:53.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.302+0000 7fb597a00640 1 -- 172.21.15.55:0/164183521 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5901f5a00 con 0x7fb5901f5f20 2024-04-02T07:21:53.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.302+0000 7fb58d600640 1 -- 172.21.15.55:0/164183521 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fb57800fae0 con 0x7fb5901f5f20 2024-04-02T07:21:53.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.302+0000 7fb58d600640 1 -- 172.21.15.55:0/164183521 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7fb578003bf0 con 0x7fb5901f5f20 2024-04-02T07:21:53.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.302+0000 7fb597a00640 1 -- 172.21.15.55:0/164183521 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb590073530 con 0x7fb5901f5f20 2024-04-02T07:21:53.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.306+0000 7fb58d600640 1 -- 172.21.15.55:0/164183521 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7fb578022060 con 0x7fb5901f5f20 2024-04-02T07:21:53.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.366+0000 7fb597a00640 1 -- 172.21.15.55:0/164183521 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fb590066c90 con 0x7fb5901f5f20 2024-04-02T07:21:53.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.374+0000 7fb58d600640 1 -- 172.21.15.55:0/164183521 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fb578019070 con 0x7fb5901f5f20 2024-04-02T07:21:53.378 INFO:teuthology.orchestra.run.smithi055.stderr:adjusted tunables profile to default 2024-04-02T07:21:53.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.378+0000 7fb597a00640 1 -- 172.21.15.55:0/164183521 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5901f5f20 msgr2=0x7fb59006d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:53.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.378+0000 7fb597a00640 1 --2- 172.21.15.55:0/164183521 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5901f5f20 0x7fb59006d9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fb5780116d0 tx=0x7fb578011b90 comp rx=0 tx=0).stop 2024-04-02T07:21:53.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.378+0000 7fb597a00640 1 -- 172.21.15.55:0/164183521 shutdown_connections 2024-04-02T07:21:53.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.378+0000 7fb597a00640 1 --2- 172.21.15.55:0/164183521 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb59006df20 0x7fb590140760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:53.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.378+0000 7fb597a00640 1 --2- 172.21.15.55:0/164183521 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5901f5f20 0x7fb59006d9e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:53.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.378+0000 7fb597a00640 1 --2- 172.21.15.55:0/164183521 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb574003980 0x7fb590136cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:53.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.378+0000 7fb597a00640 1 -- 172.21.15.55:0/164183521 >> 172.21.15.55:0/164183521 conn(0x7fb59006a390 msgr2=0x7fb590159060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:53.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.378+0000 7fb597a00640 1 -- 172.21.15.55:0/164183521 shutdown_connections 2024-04-02T07:21:53.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:53.378+0000 7fb597a00640 1 -- 172.21.15.55:0/164183521 wait complete. 2024-04-02T07:21:53.397 INFO:tasks.ceph:check_enable_crimson: False 2024-04-02T07:21:53.397 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-02T07:21:53.397 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:53.397 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-02T07:21:53.416 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:53.417 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-02T07:21:53.481 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:53.481 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-02T07:21:53.512 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:53.510+0000 7f16af436180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-02T07:21:53.541 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:21:53.541 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-02T07:21:53.603 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:53.603 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-02T07:21:53.623 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:53.623 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-02T07:21:53.685 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:53.685 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-02T07:21:53.686 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:53.682+0000 7fbb845a6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-02T07:21:53.745 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:21:53.745 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-02T07:21:53.809 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 0748a6ad-e07b-4192-be51-783e3eb662e7 0 2024-04-02T07:21:53.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.986+0000 7f81e8e00640 1 Processor -- start 2024-04-02T07:21:53.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.986+0000 7f81e8e00640 1 -- start start 2024-04-02T07:21:53.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.986+0000 7f81e8e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81e40cd4d0 0x7f81e415d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:53.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.986+0000 7f81e8e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e415cfe0 con 0x7f81e406ada0 2024-04-02T07:21:53.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.986+0000 7f81e8e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81e415c9b0 con 0x7f81e4158d70 2024-04-02T07:21:53.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.986+0000 7f81e8e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e415d9b0 con 0x7f81e40cd4d0 2024-04-02T07:21:53.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.986+0000 7f81e1e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f81e4158d70 0x7f81e40acdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:56360/0 (socket says 172.21.15.106:56360) 2024-04-02T07:21:53.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.986+0000 7f81e1e00640 1 -- 172.21.15.106:0/1975702840 learned_addr learned my addr 172.21.15.106:0/1975702840 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-02T07:21:53.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.986+0000 7f81dbe00640 1 --2- 172.21.15.106:0/1975702840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81e40cd4d0 0x7f81e415d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:53.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.986+0000 7f81dbe00640 1 -- 172.21.15.106:0/1975702840 >> v1:172.21.15.106:6789/0 conn(0x7f81e4158d70 legacy=0x7f81e40acdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:53.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.986+0000 7f81dbe00640 1 -- 172.21.15.106:0/1975702840 >> v1:172.21.15.55:6789/0 conn(0x7f81e406ada0 legacy=0x7f81e406d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:53.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.986+0000 7f81e1400640 1 -- 172.21.15.106:0/1975702840 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 897078572 0 0) 0x7f81e415c9b0 con 0x7f81e4158d70 2024-04-02T07:21:53.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.986+0000 7f81dbe00640 1 -- 172.21.15.106:0/1975702840 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81e40ad630 con 0x7f81e40cd4d0 2024-04-02T07:21:53.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.990+0000 7f81dbe00640 1 --2- 172.21.15.106:0/1975702840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81e40cd4d0 0x7f81e415d470 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0097f0 tx=0x7f81cc01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1eeadfb92060f97d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:53.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.990+0000 7f81e1400640 1 -- 172.21.15.106:0/1975702840 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0aa5f0 con 0x7f81e40cd4d0 2024-04-02T07:21:53.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.990+0000 7f81e1400640 1 -- 172.21.15.106:0/1975702840 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81cc0aa750 con 0x7f81e40cd4d0 2024-04-02T07:21:53.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.990+0000 7f81e1400640 1 -- 172.21.15.106:0/1975702840 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0aaae0 con 0x7f81e40cd4d0 2024-04-02T07:21:53.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.990+0000 7f81e8e00640 1 -- 172.21.15.106:0/1975702840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81e40cd4d0 msgr2=0x7f81e415d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:53.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.990+0000 7f81e8e00640 1 --2- 172.21.15.106:0/1975702840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81e40cd4d0 0x7f81e415d470 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0097f0 tx=0x7f81cc01c4b0 comp rx=0 tx=0).stop 2024-04-02T07:21:53.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.990+0000 7f81e8e00640 1 -- 172.21.15.106:0/1975702840 shutdown_connections 2024-04-02T07:21:53.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.990+0000 7f81e8e00640 1 --2- 172.21.15.106:0/1975702840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81e40cd4d0 0x7f81e415d470 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:53.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.990+0000 7f81e8e00640 1 -- 172.21.15.106:0/1975702840 >> 172.21.15.106:0/1975702840 conn(0x7f81e4070b60 msgr2=0x7f81e4070f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:53.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.990+0000 7f81e8e00640 1 -- 172.21.15.106:0/1975702840 shutdown_connections 2024-04-02T07:21:53.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.990+0000 7f81e8e00640 1 -- 172.21.15.106:0/1975702840 wait complete. 2024-04-02T07:21:53.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81e8e00640 1 Processor -- start 2024-04-02T07:21:53.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81e8e00640 1 -- start start 2024-04-02T07:21:53.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81e8e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81e406ada0 0x7f81e4157d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:53.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81e8e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81e40cd4d0 0x7f81e414bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:53.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81e8e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81e4158d70 0x7f81e4156520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:53.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81e8e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e4146c60 con 0x7f81e4158d70 2024-04-02T07:21:53.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81e8e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81e40b40d0 con 0x7f81e40cd4d0 2024-04-02T07:21:53.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81e8e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81e40b4560 con 0x7f81e406ada0 2024-04-02T07:21:53.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81e1e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81e406ada0 0x7f81e4157d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:53.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81dbe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81e40cd4d0 0x7f81e414bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:53.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81e1e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81e406ada0 0x7f81e4157d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:59116/0 (socket says 172.21.15.106:59116) 2024-04-02T07:21:53.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81e1e00640 1 -- 172.21.15.106:0/1483062787 learned_addr learned my addr 172.21.15.106:0/1483062787 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-02T07:21:53.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81dbe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81e40cd4d0 0x7f81e414bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:44264/0 (socket says 172.21.15.106:44264) 2024-04-02T07:21:53.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81e2800640 1 --2- 172.21.15.106:0/1483062787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81e4158d70 0x7f81e4156520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:53.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81dbe00640 1 -- 172.21.15.106:0/1483062787 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81e406ada0 msgr2=0x7f81e4157d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:53.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81dbe00640 1 --2- 172.21.15.106:0/1483062787 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81e406ada0 0x7f81e4157d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:53.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81dbe00640 1 -- 172.21.15.106:0/1483062787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81e4158d70 msgr2=0x7f81e4156520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:53.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81dbe00640 1 --2- 172.21.15.106:0/1483062787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81e4158d70 0x7f81e4156520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:53.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81dbe00640 1 -- 172.21.15.106:0/1483062787 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81cc009420 con 0x7f81e40cd4d0 2024-04-02T07:21:53.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81e1e00640 1 --2- 172.21.15.106:0/1483062787 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81e406ada0 0x7f81e4157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:21:53.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81dbe00640 1 --2- 172.21.15.106:0/1483062787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81e40cd4d0 0x7f81e414bf30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0ab000 tx=0x7f81cc01acf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:53.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81da000640 1 -- 172.21.15.106:0/1483062787 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0b4810 con 0x7f81e40cd4d0 2024-04-02T07:21:53.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81da000640 1 -- 172.21.15.106:0/1483062787 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81cc0b4970 con 0x7f81e40cd4d0 2024-04-02T07:21:53.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81e8e00640 1 -- 172.21.15.106:0/1483062787 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81e406b740 con 0x7f81e40cd4d0 2024-04-02T07:21:53.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81da000640 1 -- 172.21.15.106:0/1483062787 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81cc0b4d20 con 0x7f81e40cd4d0 2024-04-02T07:21:53.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81e8e00640 1 -- 172.21.15.106:0/1483062787 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81e40b37a0 con 0x7f81e40cd4d0 2024-04-02T07:21:53.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81da000640 1 -- 172.21.15.106:0/1483062787 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f81cc0be710 con 0x7f81e40cd4d0 2024-04-02T07:21:54.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.994+0000 7f81da000640 1 -- 172.21.15.106:0/1483062787 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f81cc0a7070 con 0x7f81e40cd4d0 2024-04-02T07:21:54.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.998+0000 7f81e8e00640 1 -- 172.21.15.106:0/1483062787 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81e40673a0 con 0x7f81e40cd4d0 2024-04-02T07:21:54.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:53.998+0000 7f81da000640 1 -- 172.21.15.106:0/1483062787 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f81cc0bea60 con 0x7f81e40cd4d0 2024-04-02T07:21:54.040 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:54.038+0000 7f16af436180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-02T07:21:54.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.066+0000 7f81e8e00640 1 -- 172.21.15.106:0/1483062787 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0748a6ad-e07b-4192-be51-783e3eb662e7", "id": 0} v 0) v1 -- 0x7f81e40ae2d0 con 0x7f81e40cd4d0 2024-04-02T07:21:54.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.078+0000 7f81da000640 1 -- 172.21.15.106:0/1483062787 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0748a6ad-e07b-4192-be51-783e3eb662e7", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f81cc0becd0 con 0x7f81e40cd4d0 2024-04-02T07:21:54.080 INFO:teuthology.orchestra.run.smithi106.stdout:0 2024-04-02T07:21:54.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.078+0000 7f81e8e00640 1 -- 172.21.15.106:0/1483062787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81e40cd4d0 msgr2=0x7f81e414bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:54.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.078+0000 7f81e8e00640 1 --2- 172.21.15.106:0/1483062787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81e40cd4d0 0x7f81e414bf30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f81cc0ab000 tx=0x7f81cc01acf0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.078+0000 7f81e8e00640 1 -- 172.21.15.106:0/1483062787 shutdown_connections 2024-04-02T07:21:54.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.078+0000 7f81e8e00640 1 --2- 172.21.15.106:0/1483062787 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81e4158d70 0x7f81e4156520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.078+0000 7f81e8e00640 1 --2- 172.21.15.106:0/1483062787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81e40cd4d0 0x7f81e414bf30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.078+0000 7f81e8e00640 1 --2- 172.21.15.106:0/1483062787 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81e406ada0 0x7f81e4157d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.078+0000 7f81e8e00640 1 -- 172.21.15.106:0/1483062787 >> 172.21.15.106:0/1483062787 conn(0x7f81e4070b60 msgr2=0x7f81e4072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:54.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.078+0000 7f81e8e00640 1 -- 172.21.15.106:0/1483062787 shutdown_connections 2024-04-02T07:21:54.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.078+0000 7f81e8e00640 1 -- 172.21.15.106:0/1483062787 wait complete. 2024-04-02T07:21:54.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 97e40d7e-77c8-4eea-91c8-24ab9f5f36ca 1 2024-04-02T07:21:54.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.234+0000 7f6a21e00640 1 Processor -- start 2024-04-02T07:21:54.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.234+0000 7f6a21e00640 1 -- start start 2024-04-02T07:21:54.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.234+0000 7f6a21e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6a1c06a220 0x7f6a1c165700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:54.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.234+0000 7f6a21e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1c0cb180 con 0x7f6a1c1583d0 2024-04-02T07:21:54.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.234+0000 7f6a21e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a1c06a6c0 con 0x7f6a1c069d90 2024-04-02T07:21:54.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.234+0000 7f6a21e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a1c1587b0 con 0x7f6a1c06a220 2024-04-02T07:21:54.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.234+0000 7f6a13e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6a1c069d90 0x7f6a1c0b03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33704/0 (socket says 172.21.15.106:33704) 2024-04-02T07:21:54.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.234+0000 7f6a13e00640 1 -- 172.21.15.106:0/272396390 learned_addr learned my addr 172.21.15.106:0/272396390 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-02T07:21:54.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.234+0000 7f6a1b400640 1 --2- 172.21.15.106:0/272396390 >> v2:172.21.15.106:3300/0 conn(0x7f6a1c06a220 0x7f6a1c165700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:54.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.234+0000 7f6a1b400640 1 -- 172.21.15.106:0/272396390 >> v1:172.21.15.106:6789/0 conn(0x7f6a1c069d90 legacy=0x7f6a1c0b03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:54.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.234+0000 7f6a1b400640 1 -- 172.21.15.106:0/272396390 >> v1:172.21.15.55:6789/0 conn(0x7f6a1c1583d0 legacy=0x7f6a1c15ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:54.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.234+0000 7f6a1b400640 1 -- 172.21.15.106:0/272396390 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a1c0cb400 con 0x7f6a1c06a220 2024-04-02T07:21:54.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.238+0000 7f6a1b400640 1 --2- 172.21.15.106:0/272396390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a1c06a220 0x7f6a1c165700 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009d90 tx=0x7f6a1401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34127a1801d24ba6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:54.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.238+0000 7f6a1a000640 1 -- 172.21.15.106:0/272396390 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a140a5920 con 0x7f6a1c06a220 2024-04-02T07:21:54.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.238+0000 7f6a1a000640 1 -- 172.21.15.106:0/272396390 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a140a5a80 con 0x7f6a1c06a220 2024-04-02T07:21:54.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.238+0000 7f6a1a000640 1 -- 172.21.15.106:0/272396390 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a140a5e10 con 0x7f6a1c06a220 2024-04-02T07:21:54.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.238+0000 7f6a21e00640 1 -- 172.21.15.106:0/272396390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a1c06a220 msgr2=0x7f6a1c165700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:54.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.238+0000 7f6a21e00640 1 --2- 172.21.15.106:0/272396390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a1c06a220 0x7f6a1c165700 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009d90 tx=0x7f6a1401c970 comp rx=0 tx=0).stop 2024-04-02T07:21:54.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.238+0000 7f6a21e00640 1 -- 172.21.15.106:0/272396390 shutdown_connections 2024-04-02T07:21:54.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.238+0000 7f6a21e00640 1 --2- 172.21.15.106:0/272396390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a1c06a220 0x7f6a1c165700 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.238+0000 7f6a21e00640 1 -- 172.21.15.106:0/272396390 >> 172.21.15.106:0/272396390 conn(0x7f6a1c0cf550 msgr2=0x7f6a1c0cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:54.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.238+0000 7f6a21e00640 1 -- 172.21.15.106:0/272396390 shutdown_connections 2024-04-02T07:21:54.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.238+0000 7f6a21e00640 1 -- 172.21.15.106:0/272396390 wait complete. 2024-04-02T07:21:54.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a21e00640 1 Processor -- start 2024-04-02T07:21:54.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a21e00640 1 -- start start 2024-04-02T07:21:54.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a21e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a1c069d90 0x7f6a1c163ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:54.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a21e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a1c06a220 0x7f6a1c1390a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:54.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a21e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a1c1583d0 0x7f6a1c1395e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:54.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a21e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c1644f0 con 0x7f6a1c06a220 2024-04-02T07:21:54.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a21e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c1647d0 con 0x7f6a1c1583d0 2024-04-02T07:21:54.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a21e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a1c164ab0 con 0x7f6a1c069d90 2024-04-02T07:21:54.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a1b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a1c1583d0 0x7f6a1c1395e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:54.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a1aa00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a1c069d90 0x7f6a1c163ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:54.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a1b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a1c1583d0 0x7f6a1c1395e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34906/0 (socket says 172.21.15.106:34906) 2024-04-02T07:21:54.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a1b400640 1 -- 172.21.15.106:0/1067475463 learned_addr learned my addr 172.21.15.106:0/1067475463 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-02T07:21:54.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a13e00640 1 --2- 172.21.15.106:0/1067475463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a1c06a220 0x7f6a1c1390a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:54.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a1aa00640 1 -- 172.21.15.106:0/1067475463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a1c1583d0 msgr2=0x7f6a1c1395e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:54.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a1aa00640 1 --2- 172.21.15.106:0/1067475463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a1c1583d0 0x7f6a1c1395e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a1aa00640 1 -- 172.21.15.106:0/1067475463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a1c06a220 msgr2=0x7f6a1c1390a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:54.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a1aa00640 1 --2- 172.21.15.106:0/1067475463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a1c06a220 0x7f6a1c1390a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a1aa00640 1 -- 172.21.15.106:0/1067475463 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a14009a70 con 0x7f6a1c069d90 2024-04-02T07:21:54.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a1b400640 1 --2- 172.21.15.106:0/1067475463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a1c1583d0 0x7f6a1c1395e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:21:54.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a1aa00640 1 --2- 172.21.15.106:0/1067475463 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a1c069d90 0x7f6a1c163ac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00c3c0 tx=0x7f6a0c00c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:54.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a13400640 1 -- 172.21.15.106:0/1067475463 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c0052d0 con 0x7f6a1c069d90 2024-04-02T07:21:54.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a13400640 1 -- 172.21.15.106:0/1067475463 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a0c005430 con 0x7f6a1c069d90 2024-04-02T07:21:54.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a21e00640 1 -- 172.21.15.106:0/1067475463 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a1c164d90 con 0x7f6a1c069d90 2024-04-02T07:21:54.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a13400640 1 -- 172.21.15.106:0/1067475463 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a0c007260 con 0x7f6a1c069d90 2024-04-02T07:21:54.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a21e00640 1 -- 172.21.15.106:0/1067475463 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a1c164000 con 0x7f6a1c069d90 2024-04-02T07:21:54.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a13400640 1 -- 172.21.15.106:0/1067475463 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6a0c0067e0 con 0x7f6a1c069d90 2024-04-02T07:21:54.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.242+0000 7f6a13400640 1 -- 172.21.15.106:0/1067475463 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f6a0c0039f0 con 0x7f6a1c069d90 2024-04-02T07:21:54.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.246+0000 7f6a21e00640 1 -- 172.21.15.106:0/1067475463 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a1c164630 con 0x7f6a1c069d90 2024-04-02T07:21:54.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.246+0000 7f6a13400640 1 -- 172.21.15.106:0/1067475463 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f6a1c164630 con 0x7f6a1c069d90 2024-04-02T07:21:54.256 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:54.254+0000 7f16af436180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-02T07:21:54.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.314+0000 7f6a21e00640 1 -- 172.21.15.106:0/1067475463 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd new", "uuid": "97e40d7e-77c8-4eea-91c8-24ab9f5f36ca", "id": 1} v 0) v1 -- 0x7f6a1c164280 con 0x7f6a1c069d90 2024-04-02T07:21:54.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.318+0000 7f6a13400640 1 -- 172.21.15.106:0/1067475463 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "97e40d7e-77c8-4eea-91c8-24ab9f5f36ca", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6a0c020060 con 0x7f6a1c069d90 2024-04-02T07:21:54.323 INFO:teuthology.orchestra.run.smithi106.stdout:1 2024-04-02T07:21:54.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.322+0000 7f6a21e00640 1 -- 172.21.15.106:0/1067475463 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a1c069d90 msgr2=0x7f6a1c163ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:54.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.322+0000 7f6a21e00640 1 --2- 172.21.15.106:0/1067475463 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a1c069d90 0x7f6a1c163ac0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c00c3c0 tx=0x7f6a0c00c880 comp rx=0 tx=0).stop 2024-04-02T07:21:54.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.322+0000 7f6a21e00640 1 -- 172.21.15.106:0/1067475463 shutdown_connections 2024-04-02T07:21:54.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.322+0000 7f6a21e00640 1 --2- 172.21.15.106:0/1067475463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a1c1583d0 0x7f6a1c1395e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.322+0000 7f6a21e00640 1 --2- 172.21.15.106:0/1067475463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a1c06a220 0x7f6a1c1390a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.322+0000 7f6a21e00640 1 --2- 172.21.15.106:0/1067475463 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a1c069d90 0x7f6a1c163ac0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.322+0000 7f6a21e00640 1 -- 172.21.15.106:0/1067475463 >> 172.21.15.106:0/1067475463 conn(0x7f6a1c0cf550 msgr2=0x7f6a1c0cf930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.322+0000 7f6a21e00640 1 -- 172.21.15.106:0/1067475463 shutdown_connections 2024-04-02T07:21:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.322+0000 7f6a21e00640 1 -- 172.21.15.106:0/1067475463 wait complete. 2024-04-02T07:21:54.336 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:54.334+0000 7fbb845a6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-02T07:21:54.341 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 6124d994-e78c-4c14-a0b7-3fb3543763ac 2 2024-04-02T07:21:54.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.474+0000 7f8914200640 1 Processor -- start 2024-04-02T07:21:54.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.474+0000 7f8914200640 1 -- start start 2024-04-02T07:21:54.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.474+0000 7f8914200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f890c0cf010 0x7f890c06eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:54.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.474+0000 7f8914200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f890c06f050 0x7f890c069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:54.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.474+0000 7f8914200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f890c15d3d0 con 0x7f890c06a2d0 2024-04-02T07:21:54.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.474+0000 7f8914200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f890c15e050 con 0x7f890c0cf010 2024-04-02T07:21:54.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.474+0000 7f8914200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f890c15d1f0 con 0x7f890c06f050 2024-04-02T07:21:54.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.474+0000 7f8910e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f890c06f050 0x7f890c069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:54.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.474+0000 7f8910e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f890c06f050 0x7f890c069d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34920/0 (socket says 172.21.15.106:34920) 2024-04-02T07:21:54.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.474+0000 7f8910e00640 1 -- 172.21.15.106:0/3986603532 learned_addr learned my addr 172.21.15.106:0/3986603532 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-02T07:21:54.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.474+0000 7f8911800640 1 --2- 172.21.15.106:0/3986603532 >> v2:172.21.15.55:3300/0 conn(0x7f890c0cf010 0x7f890c06eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:54.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.474+0000 7f8910e00640 1 -- 172.21.15.106:0/3986603532 >> v2:172.21.15.55:3300/0 conn(0x7f890c0cf010 msgr2=0x7f890c06eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:21:54.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.474+0000 7f8910e00640 1 --2- 172.21.15.106:0/3986603532 >> v2:172.21.15.55:3300/0 conn(0x7f890c0cf010 0x7f890c06eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.474+0000 7f8910e00640 1 -- 172.21.15.106:0/3986603532 >> v1:172.21.15.106:6789/0 conn(0x7f890c06a2d0 legacy=0x7f890c1606c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:54.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.474+0000 7f8910e00640 1 -- 172.21.15.106:0/3986603532 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f890c15d6b0 con 0x7f890c06f050 2024-04-02T07:21:54.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.478+0000 7f8910e00640 1 --2- 172.21.15.106:0/3986603532 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f890c06f050 0x7f890c069d90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f890c071f00 tx=0x7f88f801c520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57434670a67f8fc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:54.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.478+0000 7f890be00640 1 -- 172.21.15.106:0/3986603532 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f80ab600 con 0x7f890c06f050 2024-04-02T07:21:54.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.478+0000 7f890be00640 1 -- 172.21.15.106:0/3986603532 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f80a7050 con 0x7f890c06f050 2024-04-02T07:21:54.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.478+0000 7f890be00640 1 -- 172.21.15.106:0/3986603532 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f80ab980 con 0x7f890c06f050 2024-04-02T07:21:54.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.478+0000 7f8914200640 1 -- 172.21.15.106:0/3986603532 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f890c06f050 msgr2=0x7f890c069d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:54.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.478+0000 7f8914200640 1 --2- 172.21.15.106:0/3986603532 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f890c06f050 0x7f890c069d90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f890c071f00 tx=0x7f88f801c520 comp rx=0 tx=0).stop 2024-04-02T07:21:54.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.478+0000 7f8914200640 1 -- 172.21.15.106:0/3986603532 shutdown_connections 2024-04-02T07:21:54.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.478+0000 7f8914200640 1 --2- 172.21.15.106:0/3986603532 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f890c06f050 0x7f890c069d90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.478+0000 7f8914200640 1 --2- 172.21.15.106:0/3986603532 >> v2:172.21.15.55:3300/0 conn(0x7f890c0cf010 0x7f890c06eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.478+0000 7f8914200640 1 -- 172.21.15.106:0/3986603532 >> 172.21.15.106:0/3986603532 conn(0x7f890c098a10 msgr2=0x7f890c0b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:54.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.478+0000 7f8914200640 1 -- 172.21.15.106:0/3986603532 shutdown_connections 2024-04-02T07:21:54.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.478+0000 7f8914200640 1 -- 172.21.15.106:0/3986603532 wait complete. 2024-04-02T07:21:54.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8914200640 1 Processor -- start 2024-04-02T07:21:54.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8914200640 1 -- start start 2024-04-02T07:21:54.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8914200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f890c06a2d0 0x7f890c153320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:54.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8914200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f890c06f050 0x7f890c15fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:54.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8914200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f890c0cf010 0x7f890c0af070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:54.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8914200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890c155c60 con 0x7f890c0cf010 2024-04-02T07:21:54.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8914200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f890c1539f0 con 0x7f890c06f050 2024-04-02T07:21:54.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8914200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f890c160420 con 0x7f890c06a2d0 2024-04-02T07:21:54.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8911800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f890c06a2d0 0x7f890c153320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:54.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8910e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f890c06f050 0x7f890c15fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:54.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8910e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f890c06f050 0x7f890c15fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34934/0 (socket says 172.21.15.106:34934) 2024-04-02T07:21:54.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8910e00640 1 -- 172.21.15.106:0/2134387206 learned_addr learned my addr 172.21.15.106:0/2134387206 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-02T07:21:54.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8912200640 1 --2- 172.21.15.106:0/2134387206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f890c0cf010 0x7f890c0af070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:54.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8910e00640 1 -- 172.21.15.106:0/2134387206 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f890c06a2d0 msgr2=0x7f890c153320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:54.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8910e00640 1 --2- 172.21.15.106:0/2134387206 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f890c06a2d0 0x7f890c153320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8910e00640 1 -- 172.21.15.106:0/2134387206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f890c0cf010 msgr2=0x7f890c0af070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:54.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8910e00640 1 --2- 172.21.15.106:0/2134387206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f890c0cf010 0x7f890c0af070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8910e00640 1 -- 172.21.15.106:0/2134387206 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f80094d0 con 0x7f890c06f050 2024-04-02T07:21:54.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8910e00640 1 --2- 172.21.15.106:0/2134387206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f890c06f050 0x7f890c15fee0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f88f8019130 tx=0x7f88f80192c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:54.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8909600640 1 -- 172.21.15.106:0/2134387206 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f80b4420 con 0x7f890c06f050 2024-04-02T07:21:54.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8909600640 1 -- 172.21.15.106:0/2134387206 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f80b4580 con 0x7f890c06f050 2024-04-02T07:21:54.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8909600640 1 -- 172.21.15.106:0/2134387206 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f80b48f0 con 0x7f890c06f050 2024-04-02T07:21:54.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8914200640 1 -- 172.21.15.106:0/2134387206 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f890c0b3c90 con 0x7f890c06f050 2024-04-02T07:21:54.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8914200640 1 -- 172.21.15.106:0/2134387206 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f890c0b4250 con 0x7f890c06f050 2024-04-02T07:21:54.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8909600640 1 -- 172.21.15.106:0/2134387206 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f88f80b2070 con 0x7f890c06f050 2024-04-02T07:21:54.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8909600640 1 -- 172.21.15.106:0/2134387206 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f88f80b4d50 con 0x7f890c06f050 2024-04-02T07:21:54.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.482+0000 7f8914200640 1 -- 172.21.15.106:0/2134387206 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f890c0673a0 con 0x7f890c06f050 2024-04-02T07:21:54.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.486+0000 7f8909600640 1 -- 172.21.15.106:0/2134387206 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f88f80b0070 con 0x7f890c06f050 2024-04-02T07:21:54.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.550+0000 7f8914200640 1 -- 172.21.15.106:0/2134387206 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd new", "uuid": "6124d994-e78c-4c14-a0b7-3fb3543763ac", "id": 2} v 0) v1 -- 0x7f890c06a990 con 0x7f890c06f050 2024-04-02T07:21:54.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.558+0000 7f8909600640 1 -- 172.21.15.106:0/2134387206 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "6124d994-e78c-4c14-a0b7-3fb3543763ac", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f88f80bdb30 con 0x7f890c06f050 2024-04-02T07:21:54.560 INFO:teuthology.orchestra.run.smithi106.stdout:2 2024-04-02T07:21:54.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.558+0000 7f8914200640 1 -- 172.21.15.106:0/2134387206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f890c06f050 msgr2=0x7f890c15fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:54.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.558+0000 7f8914200640 1 --2- 172.21.15.106:0/2134387206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f890c06f050 0x7f890c15fee0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f88f8019130 tx=0x7f88f80192c0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.558+0000 7f8914200640 1 -- 172.21.15.106:0/2134387206 shutdown_connections 2024-04-02T07:21:54.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.558+0000 7f8914200640 1 --2- 172.21.15.106:0/2134387206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f890c0cf010 0x7f890c0af070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.558+0000 7f8914200640 1 --2- 172.21.15.106:0/2134387206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f890c06f050 0x7f890c15fee0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.558+0000 7f8914200640 1 --2- 172.21.15.106:0/2134387206 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f890c06a2d0 0x7f890c153320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.558+0000 7f8914200640 1 -- 172.21.15.106:0/2134387206 >> 172.21.15.106:0/2134387206 conn(0x7f890c098a10 msgr2=0x7f890c0b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:54.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.558+0000 7f8914200640 1 -- 172.21.15.106:0/2134387206 shutdown_connections 2024-04-02T07:21:54.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.558+0000 7f8914200640 1 -- 172.21.15.106:0/2134387206 wait complete. 2024-04-02T07:21:54.579 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new c1093431-a105-4a56-bdd7-a24ac995ee78 3 2024-04-02T07:21:54.580 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:54.578+0000 7fbb845a6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-02T07:21:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.710+0000 7f6552e00640 1 Processor -- start 2024-04-02T07:21:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.710+0000 7f6552e00640 1 -- start start 2024-04-02T07:21:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.714+0000 7f6552e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f654c0cc5b0 0x7f654c0b0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.714+0000 7f6552e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f654c0b0d40 0x7f654c164390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.714+0000 7f6552e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f654c0cb0e0 con 0x7f654c0ceb50 2024-04-02T07:21:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.714+0000 7f6552e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f654c0b1560 con 0x7f654c0cc5b0 2024-04-02T07:21:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.714+0000 7f6552e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654c0b1840 con 0x7f654c0b0d40 2024-04-02T07:21:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.714+0000 7f6543e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f654c0cc5b0 0x7f654c0b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.714+0000 7f6543e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f654c0cc5b0 0x7f654c0b0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34942/0 (socket says 172.21.15.106:34942) 2024-04-02T07:21:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.714+0000 7f6543e00640 1 -- 172.21.15.106:0/3488369753 learned_addr learned my addr 172.21.15.106:0/3488369753 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-02T07:21:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.714+0000 7f6550e00640 1 --2- 172.21.15.106:0/3488369753 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f654c0b0d40 0x7f654c164390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.714+0000 7f6543e00640 1 -- 172.21.15.106:0/3488369753 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f654c0b0d40 msgr2=0x7f654c164390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:21:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.714+0000 7f6543e00640 1 --2- 172.21.15.106:0/3488369753 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f654c0b0d40 0x7f654c164390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.714+0000 7f6543e00640 1 -- 172.21.15.106:0/3488369753 >> v1:172.21.15.55:6789/0 conn(0x7f654c0ceb50 legacy=0x7f654c0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:54.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.714+0000 7f6543e00640 1 -- 172.21.15.106:0/3488369753 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654c0b1b20 con 0x7f654c0cc5b0 2024-04-02T07:21:54.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.718+0000 7f6543e00640 1 --2- 172.21.15.106:0/3488369753 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f654c0cc5b0 0x7f654c0b0800 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6534009870 tx=0x7f653401c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3aae302d1901f525 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:54.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.718+0000 7f654b400640 1 -- 172.21.15.106:0/3488369753 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65340ab600 con 0x7f654c0cc5b0 2024-04-02T07:21:54.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.718+0000 7f654b400640 1 -- 172.21.15.106:0/3488369753 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65340a7050 con 0x7f654c0cc5b0 2024-04-02T07:21:54.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.718+0000 7f654b400640 1 -- 172.21.15.106:0/3488369753 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65340ab980 con 0x7f654c0cc5b0 2024-04-02T07:21:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.718+0000 7f6552e00640 1 -- 172.21.15.106:0/3488369753 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f654c0cc5b0 msgr2=0x7f654c0b0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.718+0000 7f6552e00640 1 --2- 172.21.15.106:0/3488369753 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f654c0cc5b0 0x7f654c0b0800 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f6534009870 tx=0x7f653401c4d0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.718+0000 7f6552e00640 1 -- 172.21.15.106:0/3488369753 shutdown_connections 2024-04-02T07:21:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.718+0000 7f6552e00640 1 --2- 172.21.15.106:0/3488369753 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f654c0b0d40 0x7f654c164390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.718+0000 7f6552e00640 1 --2- 172.21.15.106:0/3488369753 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f654c0cc5b0 0x7f654c0b0800 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.718+0000 7f6552e00640 1 -- 172.21.15.106:0/3488369753 >> 172.21.15.106:0/3488369753 conn(0x7f654c0d0700 msgr2=0x7f654c0d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.718+0000 7f6552e00640 1 -- 172.21.15.106:0/3488369753 shutdown_connections 2024-04-02T07:21:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.718+0000 7f6552e00640 1 -- 172.21.15.106:0/3488369753 wait complete. 2024-04-02T07:21:54.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.718+0000 7f6552e00640 1 Processor -- start 2024-04-02T07:21:54.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.718+0000 7f6552e00640 1 -- start start 2024-04-02T07:21:54.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.718+0000 7f6552e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f654c0b0d40 0x7f654c1f4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6552e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f654c0cc5b0 0x7f654c1537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6552e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f654c0ceb50 0x7f654c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6552e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c06af40 con 0x7f654c0cc5b0 2024-04-02T07:21:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6552e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f654c06b220 con 0x7f654c0b0d40 2024-04-02T07:21:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6552e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f654c06b500 con 0x7f654c0ceb50 2024-04-02T07:21:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f654be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f654c0b0d40 0x7f654c1f4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6550e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f654c0ceb50 0x7f654c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6543e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f654c0cc5b0 0x7f654c1537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6543e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f654c0cc5b0 0x7f654c1537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.106:58614/0 (socket says 172.21.15.106:58614) 2024-04-02T07:21:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6550e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f654c0ceb50 0x7f654c1587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:52326/0 (socket says 172.21.15.106:52326) 2024-04-02T07:21:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6543e00640 1 -- 172.21.15.106:0/1754265754 learned_addr learned my addr 172.21.15.106:0/1754265754 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-02T07:21:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6543e00640 1 -- 172.21.15.106:0/1754265754 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f654c0ceb50 msgr2=0x7f654c1587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6543e00640 1 --2- 172.21.15.106:0/1754265754 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f654c0ceb50 0x7f654c1587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6543e00640 1 -- 172.21.15.106:0/1754265754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f654c0b0d40 msgr2=0x7f654c1f4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6543e00640 1 --2- 172.21.15.106:0/1754265754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f654c0b0d40 0x7f654c1f4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6543e00640 1 -- 172.21.15.106:0/1754265754 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65340094d0 con 0x7f654c0cc5b0 2024-04-02T07:21:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6550e00640 1 --2- 172.21.15.106:0/1754265754 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f654c0ceb50 0x7f654c1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:21:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6543e00640 1 --2- 172.21.15.106:0/1754265754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f654c0cc5b0 0x7f654c1537a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f65340ae040 tx=0x7f6534019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6548c00640 1 -- 172.21.15.106:0/1754265754 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65340b4440 con 0x7f654c0cc5b0 2024-04-02T07:21:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6548c00640 1 -- 172.21.15.106:0/1754265754 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65340b45a0 con 0x7f654c0cc5b0 2024-04-02T07:21:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6552e00640 1 -- 172.21.15.106:0/1754265754 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f654c06b7e0 con 0x7f654c0cc5b0 2024-04-02T07:21:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6548c00640 1 -- 172.21.15.106:0/1754265754 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65340b4930 con 0x7f654c0cc5b0 2024-04-02T07:21:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6552e00640 1 -- 172.21.15.106:0/1754265754 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f654c153ce0 con 0x7f654c0cc5b0 2024-04-02T07:21:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6548c00640 1 -- 172.21.15.106:0/1754265754 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f65340b2070 con 0x7f654c0cc5b0 2024-04-02T07:21:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6548c00640 1 -- 172.21.15.106:0/1754265754 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f65340b33a0 con 0x7f654c0cc5b0 2024-04-02T07:21:54.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.722+0000 7f6552e00640 1 -- 172.21.15.106:0/1754265754 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f654c066c90 con 0x7f654c0cc5b0 2024-04-02T07:21:54.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.802+0000 7f6548c00640 1 -- 172.21.15.106:0/1754265754 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f65340dbb50 con 0x7f654c0cc5b0 2024-04-02T07:21:54.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.866+0000 7f6552e00640 1 -- 172.21.15.106:0/1754265754 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c1093431-a105-4a56-bdd7-a24ac995ee78", "id": 3} v 0) v1 -- 0x7f654c0d1320 con 0x7f654c0cc5b0 2024-04-02T07:21:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.874+0000 7f6548c00640 1 -- 172.21.15.106:0/1754265754 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c1093431-a105-4a56-bdd7-a24ac995ee78", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f65340ca030 con 0x7f654c0cc5b0 2024-04-02T07:21:54.877 INFO:teuthology.orchestra.run.smithi106.stdout:3 2024-04-02T07:21:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.874+0000 7f6552e00640 1 -- 172.21.15.106:0/1754265754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f654c0cc5b0 msgr2=0x7f654c1537a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.874+0000 7f6552e00640 1 --2- 172.21.15.106:0/1754265754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f654c0cc5b0 0x7f654c1537a0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f65340ae040 tx=0x7f6534019270 comp rx=0 tx=0).stop 2024-04-02T07:21:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.874+0000 7f6552e00640 1 -- 172.21.15.106:0/1754265754 shutdown_connections 2024-04-02T07:21:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.874+0000 7f6552e00640 1 --2- 172.21.15.106:0/1754265754 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f654c0ceb50 0x7f654c1587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.874+0000 7f6552e00640 1 --2- 172.21.15.106:0/1754265754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f654c0cc5b0 0x7f654c1537a0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.874+0000 7f6552e00640 1 --2- 172.21.15.106:0/1754265754 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f654c0b0d40 0x7f654c1f4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.874+0000 7f6552e00640 1 -- 172.21.15.106:0/1754265754 >> 172.21.15.106:0/1754265754 conn(0x7f654c0d0700 msgr2=0x7f654c0d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.874+0000 7f6552e00640 1 -- 172.21.15.106:0/1754265754 shutdown_connections 2024-04-02T07:21:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:54.874+0000 7f6552e00640 1 -- 172.21.15.106:0/1754265754 wait complete. 2024-04-02T07:21:54.896 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 650f11d6-7798-4508-8dc6-4ecd9911979f 4 2024-04-02T07:21:54.905 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:54.902+0000 7f16af436180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-02T07:21:54.968 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:54.966+0000 7f16af436180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-02T07:21:55.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.026+0000 7f1bf4c00640 1 Processor -- start 2024-04-02T07:21:55.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.026+0000 7f1bf4c00640 1 -- start start 2024-04-02T07:21:55.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.026+0000 7f1bf4c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1bf013f480 0x7f1bf0159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:55.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.026+0000 7f1bf4c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1bf015cb00 0x7f1bf015cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:55.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.026+0000 7f1bf4c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bf0070fa0 0x7f1bf0071410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:55.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.026+0000 7f1bf4c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf0159510 con 0x7f1bf015cb00 2024-04-02T07:21:55.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.026+0000 7f1bf4c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bf0071950 con 0x7f1bf013f480 2024-04-02T07:21:55.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.026+0000 7f1bf4c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf015d550 con 0x7f1bf0070fa0 2024-04-02T07:21:55.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.026+0000 7f1bede00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1bf013f480 0x7f1bf0159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:55.031 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:55.026+0000 7f16af436180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-02T07:21:55.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.026+0000 7f1bede00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1bf013f480 0x7f1bf0159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34960/0 (socket says 172.21.15.106:34960) 2024-04-02T07:21:55.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.026+0000 7f1bede00640 1 -- 172.21.15.106:0/1104080956 learned_addr learned my addr 172.21.15.106:0/1104080956 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-02T07:21:55.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.026+0000 7f1bee800640 1 --2- 172.21.15.106:0/1104080956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bf0070fa0 0x7f1bf0071410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:55.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.026+0000 7f1be7e00640 1 --2- 172.21.15.106:0/1104080956 >> v2:172.21.15.55:3300/0 conn(0x7f1bf015cb00 0x7f1bf015cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:55.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.030+0000 7f1bee800640 1 -- 172.21.15.106:0/1104080956 >> v2:172.21.15.106:3300/0 conn(0x7f1bf013f480 msgr2=0x7f1bf0159f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:21:55.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.030+0000 7f1bee800640 1 --2- 172.21.15.106:0/1104080956 >> v2:172.21.15.106:3300/0 conn(0x7f1bf013f480 0x7f1bf0159f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.030+0000 7f1bee800640 1 -- 172.21.15.106:0/1104080956 >> v2:172.21.15.55:3300/0 conn(0x7f1bf015cb00 msgr2=0x7f1bf015cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:21:55.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.030+0000 7f1bee800640 1 --2- 172.21.15.106:0/1104080956 >> v2:172.21.15.55:3300/0 conn(0x7f1bf015cb00 0x7f1bf015cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.030+0000 7f1bee800640 1 -- 172.21.15.106:0/1104080956 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf015d830 con 0x7f1bf0070fa0 2024-04-02T07:21:55.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.030+0000 7f1bede00640 1 --2- 172.21.15.106:0/1104080956 >> v2:172.21.15.106:3300/0 conn(0x7f1bf013f480 0x7f1bf0159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:21:55.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.030+0000 7f1bee800640 1 --2- 172.21.15.106:0/1104080956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bf0070fa0 0x7f1bf0071410 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0071b30 tx=0x7f1be801c930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2db537f5f205c14b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:55.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.030+0000 7f1bed400640 1 -- 172.21.15.106:0/1104080956 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be80a5840 con 0x7f1bf0070fa0 2024-04-02T07:21:55.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.030+0000 7f1bed400640 1 -- 172.21.15.106:0/1104080956 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1be80a59a0 con 0x7f1bf0070fa0 2024-04-02T07:21:55.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.030+0000 7f1bed400640 1 -- 172.21.15.106:0/1104080956 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1be80a5d30 con 0x7f1bf0070fa0 2024-04-02T07:21:55.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.030+0000 7f1bf4c00640 1 -- 172.21.15.106:0/1104080956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bf0070fa0 msgr2=0x7f1bf0071410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:55.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.030+0000 7f1bf4c00640 1 --2- 172.21.15.106:0/1104080956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bf0070fa0 0x7f1bf0071410 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f1bf0071b30 tx=0x7f1be801c930 comp rx=0 tx=0).stop 2024-04-02T07:21:55.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.030+0000 7f1bf4c00640 1 -- 172.21.15.106:0/1104080956 shutdown_connections 2024-04-02T07:21:55.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1bf4c00640 1 --2- 172.21.15.106:0/1104080956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bf0070fa0 0x7f1bf0071410 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1bf4c00640 1 --2- 172.21.15.106:0/1104080956 >> v2:172.21.15.55:3300/0 conn(0x7f1bf015cb00 0x7f1bf015cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1bf4c00640 1 --2- 172.21.15.106:0/1104080956 >> v2:172.21.15.106:3300/0 conn(0x7f1bf013f480 0x7f1bf0159f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1bf4c00640 1 -- 172.21.15.106:0/1104080956 >> 172.21.15.106:0/1104080956 conn(0x7f1bf00b06f0 msgr2=0x7f1bf00b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:55.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1bf4c00640 1 -- 172.21.15.106:0/1104080956 shutdown_connections 2024-04-02T07:21:55.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1bf4c00640 1 -- 172.21.15.106:0/1104080956 wait complete. 2024-04-02T07:21:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1bf4c00640 1 Processor -- start 2024-04-02T07:21:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1bf4c00640 1 -- start start 2024-04-02T07:21:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1bf4c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bf0070fa0 0x7f1bf0136240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1bf4c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bf013f480 0x7f1bf00aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1bf4c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf015cb00 0x7f1bf013b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1bf4c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf013b390 con 0x7f1bf015cb00 2024-04-02T07:21:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1bf4c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf00af800 con 0x7f1bf0070fa0 2024-04-02T07:21:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1bf4c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bf00afae0 con 0x7f1bf013f480 2024-04-02T07:21:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1bede00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bf0070fa0 0x7f1bf0136240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1be7e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bf013f480 0x7f1bf00aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1bede00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bf0070fa0 0x7f1bf0136240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34970/0 (socket says 172.21.15.106:34970) 2024-04-02T07:21:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1bede00640 1 -- 172.21.15.106:0/1030436509 learned_addr learned my addr 172.21.15.106:0/1030436509 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-02T07:21:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1bee800640 1 --2- 172.21.15.106:0/1030436509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf015cb00 0x7f1bf013b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1be7e00640 1 -- 172.21.15.106:0/1030436509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bf0070fa0 msgr2=0x7f1bf0136240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1be7e00640 1 --2- 172.21.15.106:0/1030436509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bf0070fa0 0x7f1bf0136240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1be7e00640 1 -- 172.21.15.106:0/1030436509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf015cb00 msgr2=0x7f1bf013b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1be7e00640 1 --2- 172.21.15.106:0/1030436509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf015cb00 0x7f1bf013b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1be7e00640 1 -- 172.21.15.106:0/1030436509 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be00094d0 con 0x7f1bf013f480 2024-04-02T07:21:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1bede00640 1 --2- 172.21.15.106:0/1030436509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bf0070fa0 0x7f1bf0136240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:21:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.034+0000 7f1be7e00640 1 --2- 172.21.15.106:0/1030436509 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bf013f480 0x7f1bf00aed60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800e870 tx=0x7f1bd800ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.038+0000 7f1be6000640 1 -- 172.21.15.106:0/1030436509 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800ee60 con 0x7f1bf013f480 2024-04-02T07:21:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.038+0000 7f1be6000640 1 -- 172.21.15.106:0/1030436509 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd800c940 con 0x7f1bf013f480 2024-04-02T07:21:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.038+0000 7f1be6000640 1 -- 172.21.15.106:0/1030436509 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800ccd0 con 0x7f1bf013f480 2024-04-02T07:21:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.038+0000 7f1bf4c00640 1 -- 172.21.15.106:0/1030436509 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be8009a70 con 0x7f1bf013f480 2024-04-02T07:21:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.038+0000 7f1bf4c00640 1 -- 172.21.15.106:0/1030436509 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bf00b00a0 con 0x7f1bf013f480 2024-04-02T07:21:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.038+0000 7f1be6000640 1 -- 172.21.15.106:0/1030436509 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1bd8005ca0 con 0x7f1bf013f480 2024-04-02T07:21:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.038+0000 7f1be6000640 1 -- 172.21.15.106:0/1030436509 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f1bd8006750 con 0x7f1bf013f480 2024-04-02T07:21:55.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.038+0000 7f1bf4c00640 1 -- 172.21.15.106:0/1030436509 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bf013b4d0 con 0x7f1bf013f480 2024-04-02T07:21:55.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.038+0000 7f1be6000640 1 -- 172.21.15.106:0/1030436509 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f1bf013b4d0 con 0x7f1bf013f480 2024-04-02T07:21:55.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.122+0000 7f1bf4c00640 1 -- 172.21.15.106:0/1030436509 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd new", "uuid": "650f11d6-7798-4508-8dc6-4ecd9911979f", "id": 4} v 0) v1 -- 0x7f1bf00673a0 con 0x7f1bf013f480 2024-04-02T07:21:55.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.130+0000 7f1be6000640 1 -- 172.21.15.106:0/1030436509 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "650f11d6-7798-4508-8dc6-4ecd9911979f", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1bd8021060 con 0x7f1bf013f480 2024-04-02T07:21:55.132 INFO:teuthology.orchestra.run.smithi106.stdout:4 2024-04-02T07:21:55.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.130+0000 7f1bf4c00640 1 -- 172.21.15.106:0/1030436509 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bf013f480 msgr2=0x7f1bf00aed60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:55.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.130+0000 7f1bf4c00640 1 --2- 172.21.15.106:0/1030436509 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bf013f480 0x7f1bf00aed60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800e870 tx=0x7f1bd800ed30 comp rx=0 tx=0).stop 2024-04-02T07:21:55.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.130+0000 7f1bf4c00640 1 -- 172.21.15.106:0/1030436509 shutdown_connections 2024-04-02T07:21:55.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.130+0000 7f1bf4c00640 1 --2- 172.21.15.106:0/1030436509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1bf015cb00 0x7f1bf013b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.130+0000 7f1bf4c00640 1 --2- 172.21.15.106:0/1030436509 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1bf013f480 0x7f1bf00aed60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.130+0000 7f1bf4c00640 1 --2- 172.21.15.106:0/1030436509 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1bf0070fa0 0x7f1bf0136240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.130+0000 7f1bf4c00640 1 -- 172.21.15.106:0/1030436509 >> 172.21.15.106:0/1030436509 conn(0x7f1bf00b06f0 msgr2=0x7f1bf013a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:55.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.130+0000 7f1bf4c00640 1 -- 172.21.15.106:0/1030436509 shutdown_connections 2024-04-02T07:21:55.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.130+0000 7f1bf4c00640 1 -- 172.21.15.106:0/1030436509 wait complete. 2024-04-02T07:21:55.137 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:55.134+0000 7f16af436180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-02T07:21:55.151 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 318d8c96-f7a0-42d5-acec-ceb5ce34876d 5 2024-04-02T07:21:55.199 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:55.198+0000 7f16af436180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-02T07:21:55.220 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:55.218+0000 7fbb845a6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-02T07:21:55.284 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:55.282+0000 7fbb845a6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-02T07:21:55.290 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:55.286+0000 7f16af436180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-02T07:21:55.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.326+0000 7f3a4cc00640 1 Processor -- start 2024-04-02T07:21:55.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.326+0000 7f3a4cc00640 1 -- start start 2024-04-02T07:21:55.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.326+0000 7f3a4cc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3a4815c920 0x7f3a480b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:55.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.326+0000 7f3a4cc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a480afa70 0x7f3a480ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:55.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.330+0000 7f3a4cc00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a480cd910 con 0x7f3a480cd4c0 2024-04-02T07:21:55.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.330+0000 7f3a4cc00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a4806beb0 con 0x7f3a4815c920 2024-04-02T07:21:55.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.330+0000 7f3a4cc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4815de30 con 0x7f3a480afa70 2024-04-02T07:21:55.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.330+0000 7f3a45400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a480afa70 0x7f3a480ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:55.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.330+0000 7f3a45400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a480afa70 0x7f3a480ccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:52350/0 (socket says 172.21.15.106:52350) 2024-04-02T07:21:55.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.330+0000 7f3a45400640 1 -- 172.21.15.106:0/2117693054 learned_addr learned my addr 172.21.15.106:0/2117693054 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-02T07:21:55.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.330+0000 7f3a45e00640 1 --2- 172.21.15.106:0/2117693054 >> v2:172.21.15.55:3300/0 conn(0x7f3a4815c920 0x7f3a480b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:55.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.330+0000 7f3a45400640 1 -- 172.21.15.106:0/2117693054 >> v2:172.21.15.55:3300/0 conn(0x7f3a4815c920 msgr2=0x7f3a480b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:21:55.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.330+0000 7f3a45400640 1 --2- 172.21.15.106:0/2117693054 >> v2:172.21.15.55:3300/0 conn(0x7f3a4815c920 0x7f3a480b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.330+0000 7f3a45400640 1 -- 172.21.15.106:0/2117693054 >> v1:172.21.15.55:6789/0 conn(0x7f3a480cd4c0 legacy=0x7f3a48160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:55.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.330+0000 7f3a45400640 1 -- 172.21.15.106:0/2117693054 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a48098ab0 con 0x7f3a480afa70 2024-04-02T07:21:55.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.330+0000 7f3a45e00640 1 --2- 172.21.15.106:0/2117693054 >> v2:172.21.15.55:3300/0 conn(0x7f3a4815c920 0x7f3a480b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:21:55.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.330+0000 7f3a45400640 1 --2- 172.21.15.106:0/2117693054 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a480afa70 0x7f3a480ccf80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3a34009870 tx=0x7f3a3401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40f511d9aefabe99 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:55.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.330+0000 7f3a44a00640 1 -- 172.21.15.106:0/2117693054 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a340ab650 con 0x7f3a480afa70 2024-04-02T07:21:55.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.330+0000 7f3a44a00640 1 -- 172.21.15.106:0/2117693054 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a340ab7b0 con 0x7f3a480afa70 2024-04-02T07:21:55.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.330+0000 7f3a44a00640 1 -- 172.21.15.106:0/2117693054 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a340abb40 con 0x7f3a480afa70 2024-04-02T07:21:55.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a4cc00640 1 -- 172.21.15.106:0/2117693054 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a480afa70 msgr2=0x7f3a480ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:55.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a4cc00640 1 --2- 172.21.15.106:0/2117693054 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a480afa70 0x7f3a480ccf80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3a34009870 tx=0x7f3a3401c530 comp rx=0 tx=0).stop 2024-04-02T07:21:55.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a4cc00640 1 -- 172.21.15.106:0/2117693054 shutdown_connections 2024-04-02T07:21:55.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a4cc00640 1 --2- 172.21.15.106:0/2117693054 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a480afa70 0x7f3a480ccf80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a4cc00640 1 --2- 172.21.15.106:0/2117693054 >> v2:172.21.15.55:3300/0 conn(0x7f3a4815c920 0x7f3a480b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a4cc00640 1 -- 172.21.15.106:0/2117693054 >> 172.21.15.106:0/2117693054 conn(0x7f3a480d0700 msgr2=0x7f3a480d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:55.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a4cc00640 1 -- 172.21.15.106:0/2117693054 shutdown_connections 2024-04-02T07:21:55.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a4cc00640 1 -- 172.21.15.106:0/2117693054 wait complete. 2024-04-02T07:21:55.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a4cc00640 1 Processor -- start 2024-04-02T07:21:55.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a4cc00640 1 -- start start 2024-04-02T07:21:55.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a4cc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a480afa70 0x7f3a480ae5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:55.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a4cc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a480cd4c0 0x7f3a480cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a4cc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a4815c920 0x7f3a48154a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a4cc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4815bc40 con 0x7f3a4815c920 2024-04-02T07:21:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a4cc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4815b030 con 0x7f3a480afa70 2024-04-02T07:21:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a4cc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4815b310 con 0x7f3a480cd4c0 2024-04-02T07:21:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a45e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a480afa70 0x7f3a480ae5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a45e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a480afa70 0x7f3a480ae5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34982/0 (socket says 172.21.15.106:34982) 2024-04-02T07:21:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a45e00640 1 -- 172.21.15.106:0/142153451 learned_addr learned my addr 172.21.15.106:0/142153451 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-02T07:21:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a45400640 1 --2- 172.21.15.106:0/142153451 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a480cd4c0 0x7f3a480cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.334+0000 7f3a46800640 1 --2- 172.21.15.106:0/142153451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a4815c920 0x7f3a48154a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.338+0000 7f3a45e00640 1 -- 172.21.15.106:0/142153451 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a480cd4c0 msgr2=0x7f3a480cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.338+0000 7f3a45e00640 1 --2- 172.21.15.106:0/142153451 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a480cd4c0 0x7f3a480cb740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.338+0000 7f3a45e00640 1 -- 172.21.15.106:0/142153451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a4815c920 msgr2=0x7f3a48154a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.338+0000 7f3a45e00640 1 --2- 172.21.15.106:0/142153451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a4815c920 0x7f3a48154a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.338+0000 7f3a45e00640 1 -- 172.21.15.106:0/142153451 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a340094d0 con 0x7f3a480afa70 2024-04-02T07:21:55.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.338+0000 7f3a45400640 1 --2- 172.21.15.106:0/142153451 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a480cd4c0 0x7f3a480cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:21:55.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.338+0000 7f3a45e00640 1 --2- 172.21.15.106:0/142153451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a480afa70 0x7f3a480ae5b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800e810 tx=0x7f3a3800ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:55.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.338+0000 7f3a3e000640 1 -- 172.21.15.106:0/142153451 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3800c8d0 con 0x7f3a480afa70 2024-04-02T07:21:55.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.338+0000 7f3a3e000640 1 -- 172.21.15.106:0/142153451 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a3800ca30 con 0x7f3a480afa70 2024-04-02T07:21:55.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.338+0000 7f3a4cc00640 1 -- 172.21.15.106:0/142153451 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4815b5f0 con 0x7f3a480afa70 2024-04-02T07:21:55.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.338+0000 7f3a3e000640 1 -- 172.21.15.106:0/142153451 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a3800cde0 con 0x7f3a480afa70 2024-04-02T07:21:55.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.338+0000 7f3a4cc00640 1 -- 172.21.15.106:0/142153451 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4815c0d0 con 0x7f3a480afa70 2024-04-02T07:21:55.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.338+0000 7f3a3e000640 1 -- 172.21.15.106:0/142153451 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3a3801c750 con 0x7f3a480afa70 2024-04-02T07:21:55.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.338+0000 7f3a3e000640 1 -- 172.21.15.106:0/142153451 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f3a380135f0 con 0x7f3a480afa70 2024-04-02T07:21:55.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.338+0000 7f3a4cc00640 1 -- 172.21.15.106:0/142153451 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a48066c90 con 0x7f3a480afa70 2024-04-02T07:21:55.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.342+0000 7f3a3e000640 1 -- 172.21.15.106:0/142153451 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f3a38021060 con 0x7f3a480afa70 2024-04-02T07:21:55.348 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:55.346+0000 7fbb845a6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-02T07:21:55.353 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:55.350+0000 7f16af436180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-02T07:21:55.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.406+0000 7f3a4cc00640 1 -- 172.21.15.106:0/142153451 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd new", "uuid": "318d8c96-f7a0-42d5-acec-ceb5ce34876d", "id": 5} v 0) v1 -- 0x7f3a480d1220 con 0x7f3a480afa70 2024-04-02T07:21:55.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.414+0000 7f3a3e000640 1 -- 172.21.15.106:0/142153451 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "318d8c96-f7a0-42d5-acec-ceb5ce34876d", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3a38017070 con 0x7f3a480afa70 2024-04-02T07:21:55.415 INFO:teuthology.orchestra.run.smithi106.stdout:5 2024-04-02T07:21:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.414+0000 7f3a4cc00640 1 -- 172.21.15.106:0/142153451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a480afa70 msgr2=0x7f3a480ae5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.414+0000 7f3a4cc00640 1 --2- 172.21.15.106:0/142153451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a480afa70 0x7f3a480ae5b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800e810 tx=0x7f3a3800ecd0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.414+0000 7f3a4cc00640 1 -- 172.21.15.106:0/142153451 shutdown_connections 2024-04-02T07:21:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.414+0000 7f3a4cc00640 1 --2- 172.21.15.106:0/142153451 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a4815c920 0x7f3a48154a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.414+0000 7f3a4cc00640 1 --2- 172.21.15.106:0/142153451 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a480cd4c0 0x7f3a480cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.414+0000 7f3a4cc00640 1 --2- 172.21.15.106:0/142153451 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a480afa70 0x7f3a480ae5b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.414+0000 7f3a4cc00640 1 -- 172.21.15.106:0/142153451 >> 172.21.15.106:0/142153451 conn(0x7f3a480d0700 msgr2=0x7f3a480cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:55.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.414+0000 7f3a4cc00640 1 -- 172.21.15.106:0/142153451 shutdown_connections 2024-04-02T07:21:55.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.414+0000 7f3a4cc00640 1 -- 172.21.15.106:0/142153451 wait complete. 2024-04-02T07:21:55.434 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e 6 2024-04-02T07:21:55.442 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:55.438+0000 7fbb845a6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-02T07:21:55.504 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:55.502+0000 7fbb845a6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-02T07:21:55.525 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:55.521+0000 7f16af436180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-02T07:21:55.595 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:55.593+0000 7f16af436180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-02T07:21:55.596 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:55.594+0000 7fbb845a6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-02T07:21:55.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.605+0000 7f6d3da00640 1 Processor -- start 2024-04-02T07:21:55.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.605+0000 7f6d3da00640 1 -- start start 2024-04-02T07:21:55.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.605+0000 7f6d3da00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6d380ceb50 0x7f6d380cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:55.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.605+0000 7f6d3da00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6d380b0800 0x7f6d380b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:55.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.605+0000 7f6d3da00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d380cb0e0 con 0x7f6d380cb5a0 2024-04-02T07:21:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.605+0000 7f6d3da00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d380cf470 con 0x7f6d380b0800 2024-04-02T07:21:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.605+0000 7f6d3da00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d380b1560 con 0x7f6d380ceb50 2024-04-02T07:21:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.605+0000 7f6d36a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6d380ceb50 0x7f6d380cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.605+0000 7f6d36a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6d380ceb50 0x7f6d380cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:34994/0 (socket says 172.21.15.106:34994) 2024-04-02T07:21:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.605+0000 7f6d36a00640 1 -- 172.21.15.106:0/27369860 learned_addr learned my addr 172.21.15.106:0/27369860 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-02T07:21:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.605+0000 7f6d2fe00640 1 --2- 172.21.15.106:0/27369860 >> v2:172.21.15.55:3300/0 conn(0x7f6d380b0800 0x7f6d380b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.605+0000 7f6d36a00640 1 -- 172.21.15.106:0/27369860 >> v2:172.21.15.55:3300/0 conn(0x7f6d380b0800 msgr2=0x7f6d380b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:21:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.605+0000 7f6d36a00640 1 --2- 172.21.15.106:0/27369860 >> v2:172.21.15.55:3300/0 conn(0x7f6d380b0800 0x7f6d380b0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.605+0000 7f6d36a00640 1 -- 172.21.15.106:0/27369860 >> v1:172.21.15.55:6789/0 conn(0x7f6d380cb5a0 legacy=0x7f6d380cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:55.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.605+0000 7f6d36a00640 1 -- 172.21.15.106:0/27369860 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d380b1840 con 0x7f6d380ceb50 2024-04-02T07:21:55.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.609+0000 7f6d36a00640 1 --2- 172.21.15.106:0/27369860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d380ceb50 0x7f6d380cef30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6d380cde60 tx=0x7f6d2801c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8feb076a5ebe0374 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:55.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.609+0000 7f6d36000640 1 -- 172.21.15.106:0/27369860 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d280ad680 con 0x7f6d380ceb50 2024-04-02T07:21:55.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.609+0000 7f6d36000640 1 -- 172.21.15.106:0/27369860 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d280ad7e0 con 0x7f6d380ceb50 2024-04-02T07:21:55.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.609+0000 7f6d36000640 1 -- 172.21.15.106:0/27369860 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d280adb70 con 0x7f6d380ceb50 2024-04-02T07:21:55.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.609+0000 7f6d3da00640 1 -- 172.21.15.106:0/27369860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d380ceb50 msgr2=0x7f6d380cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:55.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.609+0000 7f6d3da00640 1 --2- 172.21.15.106:0/27369860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d380ceb50 0x7f6d380cef30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6d380cde60 tx=0x7f6d2801c490 comp rx=0 tx=0).stop 2024-04-02T07:21:55.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.609+0000 7f6d3da00640 1 -- 172.21.15.106:0/27369860 shutdown_connections 2024-04-02T07:21:55.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.609+0000 7f6d3da00640 1 --2- 172.21.15.106:0/27369860 >> v2:172.21.15.55:3300/0 conn(0x7f6d380b0800 0x7f6d380b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.609+0000 7f6d3da00640 1 --2- 172.21.15.106:0/27369860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d380ceb50 0x7f6d380cef30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.609+0000 7f6d3da00640 1 -- 172.21.15.106:0/27369860 >> 172.21.15.106:0/27369860 conn(0x7f6d380d0700 msgr2=0x7f6d380d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:55.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.609+0000 7f6d3da00640 1 -- 172.21.15.106:0/27369860 shutdown_connections 2024-04-02T07:21:55.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.609+0000 7f6d3da00640 1 -- 172.21.15.106:0/27369860 wait complete. 2024-04-02T07:21:55.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d3da00640 1 Processor -- start 2024-04-02T07:21:55.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d3da00640 1 -- start start 2024-04-02T07:21:55.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d3da00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d380b0800 0x7f6d3814bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:55.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d3da00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d380cb5a0 0x7f6d380c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:55.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d3da00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d380ceb50 0x7f6d380ae350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:55.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d3da00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d381f5480 con 0x7f6d380cb5a0 2024-04-02T07:21:55.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d3da00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3814c080 con 0x7f6d380ceb50 2024-04-02T07:21:55.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d3da00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d380c9b80 con 0x7f6d380b0800 2024-04-02T07:21:55.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d36a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d380b0800 0x7f6d3814bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:55.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d36a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d380b0800 0x7f6d3814bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:52356/0 (socket says 172.21.15.106:52356) 2024-04-02T07:21:55.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d2fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d380cb5a0 0x7f6d380c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:55.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d36a00640 1 -- 172.21.15.106:0/751836219 learned_addr learned my addr 172.21.15.106:0/751836219 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-02T07:21:55.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d37400640 1 --2- 172.21.15.106:0/751836219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d380ceb50 0x7f6d380ae350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:55.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d36a00640 1 -- 172.21.15.106:0/751836219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d380ceb50 msgr2=0x7f6d380ae350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:55.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d36a00640 1 --2- 172.21.15.106:0/751836219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d380ceb50 0x7f6d380ae350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d36a00640 1 -- 172.21.15.106:0/751836219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d380cb5a0 msgr2=0x7f6d380c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:55.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d36a00640 1 --2- 172.21.15.106:0/751836219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d380cb5a0 0x7f6d380c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d36a00640 1 -- 172.21.15.106:0/751836219 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d280094d0 con 0x7f6d380b0800 2024-04-02T07:21:55.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d36a00640 1 --2- 172.21.15.106:0/751836219 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d380b0800 0x7f6d3814bb40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6d280190a0 tx=0x7f6d2801acd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:55.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d2ea00640 1 -- 172.21.15.106:0/751836219 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d280ade20 con 0x7f6d380b0800 2024-04-02T07:21:55.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d2ea00640 1 -- 172.21.15.106:0/751836219 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d280b8420 con 0x7f6d380b0800 2024-04-02T07:21:55.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d2ea00640 1 -- 172.21.15.106:0/751836219 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d280b8790 con 0x7f6d380b0800 2024-04-02T07:21:55.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d3da00640 1 -- 172.21.15.106:0/751836219 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d380c9e60 con 0x7f6d380b0800 2024-04-02T07:21:55.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d3da00640 1 -- 172.21.15.106:0/751836219 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d380ca420 con 0x7f6d380b0800 2024-04-02T07:21:55.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d2ea00640 1 -- 172.21.15.106:0/751836219 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6d280b4040 con 0x7f6d380b0800 2024-04-02T07:21:55.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d2ea00640 1 -- 172.21.15.106:0/751836219 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f6d280c1450 con 0x7f6d380b0800 2024-04-02T07:21:55.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.613+0000 7f6d3da00640 1 -- 172.21.15.106:0/751836219 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d38066c90 con 0x7f6d380b0800 2024-04-02T07:21:55.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.617+0000 7f6d2ea00640 1 -- 172.21.15.106:0/751836219 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f6d280c6060 con 0x7f6d380b0800 2024-04-02T07:21:55.658 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:55.658+0000 7fbb845a6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-02T07:21:55.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.685+0000 7f6d3da00640 1 -- 172.21.15.106:0/751836219 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd new", "uuid": "1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e", "id": 6} v 0) v1 -- 0x7f6d380cefc0 con 0x7f6d380b0800 2024-04-02T07:21:55.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.689+0000 7f6d2ea00640 1 -- 172.21.15.106:0/751836219 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6d280cf0b0 con 0x7f6d380b0800 2024-04-02T07:21:55.694 INFO:teuthology.orchestra.run.smithi106.stdout:6 2024-04-02T07:21:55.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.689+0000 7f6d3da00640 1 -- 172.21.15.106:0/751836219 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d380b0800 msgr2=0x7f6d3814bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:55.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.689+0000 7f6d3da00640 1 --2- 172.21.15.106:0/751836219 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d380b0800 0x7f6d3814bb40 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f6d280190a0 tx=0x7f6d2801acd0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.689+0000 7f6d3da00640 1 -- 172.21.15.106:0/751836219 shutdown_connections 2024-04-02T07:21:55.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.689+0000 7f6d3da00640 1 --2- 172.21.15.106:0/751836219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d380ceb50 0x7f6d380ae350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.689+0000 7f6d3da00640 1 --2- 172.21.15.106:0/751836219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d380cb5a0 0x7f6d380c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.689+0000 7f6d3da00640 1 --2- 172.21.15.106:0/751836219 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d380b0800 0x7f6d3814bb40 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.689+0000 7f6d3da00640 1 -- 172.21.15.106:0/751836219 >> 172.21.15.106:0/751836219 conn(0x7f6d380d0700 msgr2=0x7f6d3806b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:55.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.689+0000 7f6d3da00640 1 -- 172.21.15.106:0/751836219 shutdown_connections 2024-04-02T07:21:55.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.689+0000 7f6d3da00640 1 -- 172.21.15.106:0/751836219 wait complete. 2024-04-02T07:21:55.712 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd new 26a25e9f-5f83-4989-8845-d0a6cbaef5f7 7 2024-04-02T07:21:55.835 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:55.834+0000 7fbb845a6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-02T07:21:55.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.841+0000 7f53ca800640 1 Processor -- start 2024-04-02T07:21:55.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.841+0000 7f53ca800640 1 -- start start 2024-04-02T07:21:55.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.845+0000 7f53ca800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c40ceb50 0x7f53c40cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:55.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.845+0000 7f53ca800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c40cb0e0 con 0x7f53c40cc5b0 2024-04-02T07:21:55.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.845+0000 7f53ca800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c40cf470 con 0x7f53c40b0800 2024-04-02T07:21:55.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.845+0000 7f53ca800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c40b1560 con 0x7f53c40ceb50 2024-04-02T07:21:55.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.845+0000 7f53c2a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f53c40b0800 0x7f53c40b0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:33728/0 (socket says 172.21.15.106:33728) 2024-04-02T07:21:55.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.845+0000 7f53c2a00640 1 -- 172.21.15.106:0/2767015796 learned_addr learned my addr 172.21.15.106:0/2767015796 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-02T07:21:55.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.845+0000 7f53c3400640 1 --2- 172.21.15.106:0/2767015796 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c40ceb50 0x7f53c40cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:55.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.845+0000 7f53c2000640 1 -- 172.21.15.106:0/2767015796 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3329114712 0 0) 0x7f53c40cf470 con 0x7f53c40b0800 2024-04-02T07:21:55.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.845+0000 7f53c2000640 1 -- 172.21.15.106:0/2767015796 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f53a8003530 con 0x7f53c40b0800 2024-04-02T07:21:55.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.845+0000 7f53c3400640 1 -- 172.21.15.106:0/2767015796 >> v1:172.21.15.106:6789/0 conn(0x7f53c40b0800 legacy=0x7f53c40b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:55.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.845+0000 7f53c3400640 1 -- 172.21.15.106:0/2767015796 >> v1:172.21.15.55:6789/0 conn(0x7f53c40cc5b0 legacy=0x7f53c4164390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:55.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.845+0000 7f53c3400640 1 -- 172.21.15.106:0/2767015796 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c40b1840 con 0x7f53c40ceb50 2024-04-02T07:21:55.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.849+0000 7f53c3400640 1 --2- 172.21.15.106:0/2767015796 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c40ceb50 0x7f53c40cef30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f53b40097f0 tx=0x7f53b401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc1b39bc6e6d87d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:55.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.849+0000 7f53c2000640 1 -- 172.21.15.106:0/2767015796 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b40ab600 con 0x7f53c40ceb50 2024-04-02T07:21:55.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.849+0000 7f53c2000640 1 -- 172.21.15.106:0/2767015796 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b40a7050 con 0x7f53c40ceb50 2024-04-02T07:21:55.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.849+0000 7f53c2000640 1 -- 172.21.15.106:0/2767015796 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b40ab980 con 0x7f53c40ceb50 2024-04-02T07:21:55.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.849+0000 7f53ca800640 1 -- 172.21.15.106:0/2767015796 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c40ceb50 msgr2=0x7f53c40cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:55.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.849+0000 7f53ca800640 1 --2- 172.21.15.106:0/2767015796 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c40ceb50 0x7f53c40cef30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f53b40097f0 tx=0x7f53b401c450 comp rx=0 tx=0).stop 2024-04-02T07:21:55.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.849+0000 7f53ca800640 1 -- 172.21.15.106:0/2767015796 shutdown_connections 2024-04-02T07:21:55.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.849+0000 7f53ca800640 1 --2- 172.21.15.106:0/2767015796 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c40ceb50 0x7f53c40cef30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.849+0000 7f53ca800640 1 -- 172.21.15.106:0/2767015796 >> 172.21.15.106:0/2767015796 conn(0x7f53c40d0700 msgr2=0x7f53c40d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:55.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.849+0000 7f53ca800640 1 -- 172.21.15.106:0/2767015796 shutdown_connections 2024-04-02T07:21:55.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.849+0000 7f53ca800640 1 -- 172.21.15.106:0/2767015796 wait complete. 2024-04-02T07:21:55.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.849+0000 7f53ca800640 1 Processor -- start 2024-04-02T07:21:55.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.849+0000 7f53ca800640 1 -- start start 2024-04-02T07:21:55.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53ca800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53c40b0800 0x7f53c415b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:55.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53ca800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53c40cc5b0 0x7f53c4150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:55.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53ca800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c40ceb50 0x7f53c4156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:55.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53ca800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c4150a50 con 0x7f53c40b0800 2024-04-02T07:21:55.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53ca800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c40c8730 con 0x7f53c40cc5b0 2024-04-02T07:21:55.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53ca800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c40c7180 con 0x7f53c40ceb50 2024-04-02T07:21:55.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53c2a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53c40cc5b0 0x7f53c4150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:55.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53c3e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c40ceb50 0x7f53c4156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:55.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53c3e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c40ceb50 0x7f53c4156e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.106:52384/0 (socket says 172.21.15.106:52384) 2024-04-02T07:21:55.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53c2a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53c40cc5b0 0x7f53c4150510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.106:35016/0 (socket says 172.21.15.106:35016) 2024-04-02T07:21:55.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53c3e00640 1 -- 172.21.15.106:0/1120330202 learned_addr learned my addr 172.21.15.106:0/1120330202 (peer_addr_for_me v2:172.21.15.106:0/0) 2024-04-02T07:21:55.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53c3400640 1 --2- 172.21.15.106:0/1120330202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53c40b0800 0x7f53c415b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:55.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53c3e00640 1 -- 172.21.15.106:0/1120330202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53c40cc5b0 msgr2=0x7f53c4150510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:55.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53c3e00640 1 --2- 172.21.15.106:0/1120330202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53c40cc5b0 0x7f53c4150510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53c3e00640 1 -- 172.21.15.106:0/1120330202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53c40b0800 msgr2=0x7f53c415b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:55.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53c3e00640 1 --2- 172.21.15.106:0/1120330202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53c40b0800 0x7f53c415b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53c3e00640 1 -- 172.21.15.106:0/1120330202 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b4009420 con 0x7f53c40ceb50 2024-04-02T07:21:55.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53c3e00640 1 --2- 172.21.15.106:0/1120330202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c40ceb50 0x7f53c4156e80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00c730 tx=0x7f53bc00cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:55.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53bb400640 1 -- 172.21.15.106:0/1120330202 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc003b80 con 0x7f53c40ceb50 2024-04-02T07:21:55.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53bb400640 1 -- 172.21.15.106:0/1120330202 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53bc003ce0 con 0x7f53c40ceb50 2024-04-02T07:21:55.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53bb400640 1 -- 172.21.15.106:0/1120330202 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53bc00aa30 con 0x7f53c40ceb50 2024-04-02T07:21:55.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53ca800640 1 -- 172.21.15.106:0/1120330202 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c40c7970 con 0x7f53c40ceb50 2024-04-02T07:21:55.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53ca800640 1 -- 172.21.15.106:0/1120330202 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c40c7f30 con 0x7f53c40ceb50 2024-04-02T07:21:55.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53bb400640 1 -- 172.21.15.106:0/1120330202 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f53bc0050d0 con 0x7f53c40ceb50 2024-04-02T07:21:55.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53bb400640 1 -- 172.21.15.106:0/1120330202 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f53bc012420 con 0x7f53c40ceb50 2024-04-02T07:21:55.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.853+0000 7f53ca800640 1 -- 172.21.15.106:0/1120330202 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c4066c90 con 0x7f53c40ceb50 2024-04-02T07:21:55.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.857+0000 7f53bb400640 1 -- 172.21.15.106:0/1120330202 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f53bc005380 con 0x7f53c40ceb50 2024-04-02T07:21:55.907 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:55.906+0000 7fbb845a6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-02T07:21:55.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.965+0000 7f53ca800640 1 -- 172.21.15.106:0/1120330202 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd new", "uuid": "26a25e9f-5f83-4989-8845-d0a6cbaef5f7", "id": 7} v 0) v1 -- 0x7f53c40d1320 con 0x7f53c40ceb50 2024-04-02T07:21:55.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.969+0000 7f53bb400640 1 -- 172.21.15.106:0/1120330202 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "26a25e9f-5f83-4989-8845-d0a6cbaef5f7", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f53bc005520 con 0x7f53c40ceb50 2024-04-02T07:21:55.974 INFO:teuthology.orchestra.run.smithi106.stdout:7 2024-04-02T07:21:55.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.973+0000 7f53ca800640 1 -- 172.21.15.106:0/1120330202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c40ceb50 msgr2=0x7f53c4156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:55.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.973+0000 7f53ca800640 1 --2- 172.21.15.106:0/1120330202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c40ceb50 0x7f53c4156e80 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f53bc00c730 tx=0x7f53bc00cbf0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.973+0000 7f53ca800640 1 -- 172.21.15.106:0/1120330202 shutdown_connections 2024-04-02T07:21:55.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.973+0000 7f53ca800640 1 --2- 172.21.15.106:0/1120330202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c40ceb50 0x7f53c4156e80 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.973+0000 7f53ca800640 1 --2- 172.21.15.106:0/1120330202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53c40cc5b0 0x7f53c4150510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.973+0000 7f53ca800640 1 --2- 172.21.15.106:0/1120330202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53c40b0800 0x7f53c415b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:55.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.973+0000 7f53ca800640 1 -- 172.21.15.106:0/1120330202 >> 172.21.15.106:0/1120330202 conn(0x7f53c40d0700 msgr2=0x7f53c40ad6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:55.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.973+0000 7f53ca800640 1 -- 172.21.15.106:0/1120330202 shutdown_connections 2024-04-02T07:21:55.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-02T07:21:55.973+0000 7f53ca800640 1 -- 172.21.15.106:0/1120330202 wait complete. 2024-04-02T07:21:55.993 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-02T07:21:55.993 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-02T07:21:55.997 INFO:tasks.ceph.osd.0:Started 2024-04-02T07:21:55.997 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-02T07:21:55.997 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-02T07:21:56.001 INFO:tasks.ceph.osd.1:Started 2024-04-02T07:21:56.001 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-02T07:21:56.002 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-02T07:21:56.005 INFO:tasks.ceph.osd.2:Started 2024-04-02T07:21:56.006 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-02T07:21:56.006 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-02T07:21:56.010 INFO:tasks.ceph.osd.3:Started 2024-04-02T07:21:56.010 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-02T07:21:56.010 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-02T07:21:56.013 INFO:tasks.ceph.osd.4:Started 2024-04-02T07:21:56.013 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-02T07:21:56.013 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-02T07:21:56.016 INFO:tasks.ceph.osd.5:Started 2024-04-02T07:21:56.016 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-02T07:21:56.016 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-02T07:21:56.019 INFO:tasks.ceph.osd.6:Started 2024-04-02T07:21:56.019 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-02T07:21:56.019 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-02T07:21:56.022 INFO:tasks.ceph.osd.7:Started 2024-04-02T07:21:56.023 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:21:56.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.186+0000 7f0738c00640 1 Processor -- start 2024-04-02T07:21:56.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.186+0000 7f0738c00640 1 -- start start 2024-04-02T07:21:56.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.186+0000 7f0738c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f073415ca70 0x7f07340b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:56.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.186+0000 7f0738c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0734098a10 0x7f0734098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:56.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.186+0000 7f0738c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07340993b0 con 0x7f073406aff0 2024-04-02T07:21:56.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.186+0000 7f0738c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f073415ce50 con 0x7f0734098a10 2024-04-02T07:21:56.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.186+0000 7f0738c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07340cef60 con 0x7f073415ca70 2024-04-02T07:21:56.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.186+0000 7f072be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0734098a10 0x7f0734098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:56.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.186+0000 7f072be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0734098a10 0x7f0734098e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:54296/0 (socket says 172.21.15.55:54296) 2024-04-02T07:21:56.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.186+0000 7f0731e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f073415ca70 0x7f07340b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:56.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.186+0000 7f072be00640 1 -- 172.21.15.55:0/1918893698 learned_addr learned my addr 172.21.15.55:0/1918893698 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:21:56.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.186+0000 7f072be00640 1 -- 172.21.15.55:0/1918893698 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f073415ca70 msgr2=0x7f07340b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:21:56.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.186+0000 7f072be00640 1 --2- 172.21.15.55:0/1918893698 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f073415ca70 0x7f07340b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:56.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.186+0000 7f072be00640 1 -- 172.21.15.55:0/1918893698 >> v1:172.21.15.106:6789/0 conn(0x7f073406aff0 legacy=0x7f073406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:56.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.186+0000 7f072be00640 1 -- 172.21.15.55:0/1918893698 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f073406bd60 con 0x7f0734098a10 2024-04-02T07:21:56.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.190+0000 7f072be00640 1 --2- 172.21.15.55:0/1918893698 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0734098a10 0x7f0734098e70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f071c009870 tx=0x7f071c01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f59e180de605ec20 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:56.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.190+0000 7f0731400640 1 -- 172.21.15.55:0/1918893698 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0ab650 con 0x7f0734098a10 2024-04-02T07:21:56.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.190+0000 7f0731400640 1 -- 172.21.15.55:0/1918893698 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f071c0ab7b0 con 0x7f0734098a10 2024-04-02T07:21:56.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.190+0000 7f0731400640 1 -- 172.21.15.55:0/1918893698 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f071c0abb40 con 0x7f0734098a10 2024-04-02T07:21:56.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.190+0000 7f0738c00640 1 -- 172.21.15.55:0/1918893698 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0734098a10 msgr2=0x7f0734098e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:56.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.190+0000 7f0738c00640 1 --2- 172.21.15.55:0/1918893698 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0734098a10 0x7f0734098e70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f071c009870 tx=0x7f071c01c560 comp rx=0 tx=0).stop 2024-04-02T07:21:56.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.190+0000 7f0738c00640 1 -- 172.21.15.55:0/1918893698 shutdown_connections 2024-04-02T07:21:56.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.190+0000 7f0738c00640 1 --2- 172.21.15.55:0/1918893698 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0734098a10 0x7f0734098e70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:56.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.190+0000 7f0738c00640 1 --2- 172.21.15.55:0/1918893698 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f073415ca70 0x7f07340b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:56.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.190+0000 7f0738c00640 1 -- 172.21.15.55:0/1918893698 >> 172.21.15.55:0/1918893698 conn(0x7f07340b21d0 msgr2=0x7f07340b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:56.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.190+0000 7f0738c00640 1 -- 172.21.15.55:0/1918893698 shutdown_connections 2024-04-02T07:21:56.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.190+0000 7f0738c00640 1 -- 172.21.15.55:0/1918893698 wait complete. 2024-04-02T07:21:56.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f0738c00640 1 Processor -- start 2024-04-02T07:21:56.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f0738c00640 1 -- start start 2024-04-02T07:21:56.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f0738c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f073406aff0 0x7f07341545a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:56.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f0738c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0734098a10 0x7f0734154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:56.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f0738c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f073415ca70 0x7f07341f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:56.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f0738c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07341570b0 con 0x7f073406aff0 2024-04-02T07:21:56.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f0738c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07340b09d0 con 0x7f0734098a10 2024-04-02T07:21:56.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f0738c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07340b0cb0 con 0x7f073415ca70 2024-04-02T07:21:56.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f0731e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f073406aff0 0x7f07341545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:56.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f0731e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f073406aff0 0x7f07341545a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43802/0 (socket says 172.21.15.55:43802) 2024-04-02T07:21:56.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f0731e00640 1 -- 172.21.15.55:0/2240703711 learned_addr learned my addr 172.21.15.55:0/2240703711 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:21:56.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f072be00640 1 --2- 172.21.15.55:0/2240703711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0734098a10 0x7f0734154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:56.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f0732800640 1 --2- 172.21.15.55:0/2240703711 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f073415ca70 0x7f07341f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:56.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f0731e00640 1 -- 172.21.15.55:0/2240703711 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f073415ca70 msgr2=0x7f07341f5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:56.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f0731e00640 1 --2- 172.21.15.55:0/2240703711 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f073415ca70 0x7f07341f5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:56.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f0731e00640 1 -- 172.21.15.55:0/2240703711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0734098a10 msgr2=0x7f0734154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:56.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f0731e00640 1 --2- 172.21.15.55:0/2240703711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0734098a10 0x7f0734154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:56.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f0731e00640 1 -- 172.21.15.55:0/2240703711 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071c0094d0 con 0x7f073406aff0 2024-04-02T07:21:56.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f0731e00640 1 --2- 172.21.15.55:0/2240703711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f073406aff0 0x7f07341545a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f072400e930 tx=0x7f072400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:56.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f072a000640 1 -- 172.21.15.55:0/2240703711 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0724009690 con 0x7f073406aff0 2024-04-02T07:21:56.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f072a000640 1 -- 172.21.15.55:0/2240703711 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f072400ca00 con 0x7f073406aff0 2024-04-02T07:21:56.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f072a000640 1 -- 172.21.15.55:0/2240703711 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f072400cd70 con 0x7f073406aff0 2024-04-02T07:21:56.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f0738c00640 1 -- 172.21.15.55:0/2240703711 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07340b0f90 con 0x7f073406aff0 2024-04-02T07:21:56.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f0738c00640 1 -- 172.21.15.55:0/2240703711 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07340b1550 con 0x7f073406aff0 2024-04-02T07:21:56.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f072a000640 1 -- 172.21.15.55:0/2240703711 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0724005ca0 con 0x7f073406aff0 2024-04-02T07:21:56.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.194+0000 7f072a000640 1 -- 172.21.15.55:0/2240703711 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f0724013b80 con 0x7f073406aff0 2024-04-02T07:21:56.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.198+0000 7f0738c00640 1 -- 172.21.15.55:0/2240703711 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0734066c90 con 0x7f073406aff0 2024-04-02T07:21:56.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.198+0000 7f072a000640 1 -- 172.21.15.55:0/2240703711 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f0724021060 con 0x7f073406aff0 2024-04-02T07:21:56.256 INFO:tasks.ceph.mgr.x.smithi106.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-02T07:21:56.256 INFO:tasks.ceph.mgr.x.smithi106.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-02T07:21:56.256 INFO:tasks.ceph.mgr.x.smithi106.stderr: from numpy import show_config as show_numpy_config 2024-04-02T07:21:56.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.254+0000 7f0738c00640 1 -- 172.21.15.55:0/2240703711 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07340af290 con 0x7f073406aff0 2024-04-02T07:21:56.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.258+0000 7f072a000640 1 -- 172.21.15.55:0/2240703711 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f0724017070 con 0x7f073406aff0 2024-04-02T07:21:56.259 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:21:56.259 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":10,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:21:55.970457+0000","last_up_change":"0.000000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:21:56.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.258+0000 7f0738c00640 1 -- 172.21.15.55:0/2240703711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f073406aff0 msgr2=0x7f07341545a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:56.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.258+0000 7f0738c00640 1 --2- 172.21.15.55:0/2240703711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f073406aff0 0x7f07341545a0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f072400e930 tx=0x7f072400edf0 comp rx=0 tx=0).stop 2024-04-02T07:21:56.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.258+0000 7f0738c00640 1 -- 172.21.15.55:0/2240703711 shutdown_connections 2024-04-02T07:21:56.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.258+0000 7f0738c00640 1 --2- 172.21.15.55:0/2240703711 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f073415ca70 0x7f07341f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:56.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.258+0000 7f0738c00640 1 --2- 172.21.15.55:0/2240703711 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0734098a10 0x7f0734154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:56.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.258+0000 7f0738c00640 1 --2- 172.21.15.55:0/2240703711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f073406aff0 0x7f07341545a0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:56.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.258+0000 7f0738c00640 1 -- 172.21.15.55:0/2240703711 >> 172.21.15.55:0/2240703711 conn(0x7f07340b21d0 msgr2=0x7f07340b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:56.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.258+0000 7f0738c00640 1 -- 172.21.15.55:0/2240703711 shutdown_connections 2024-04-02T07:21:56.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:21:56.258+0000 7f0738c00640 1 -- 172.21.15.55:0/2240703711 wait complete. 2024-04-02T07:21:56.278 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-02T07:21:56.278 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-02T07:21:56.320 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:56.317+0000 7f16af436180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-02T07:21:56.466 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:56.461+0000 7f16af436180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-02T07:21:56.638 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:56.633+0000 7f16af436180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-02T07:21:56.656 INFO:tasks.ceph.osd.5.smithi106.stderr:2024-04-02T07:21:56.653+0000 7f227922b640 -1 Falling back to public interface 2024-04-02T07:21:56.656 INFO:tasks.ceph.osd.4.smithi106.stderr:2024-04-02T07:21:56.653+0000 7f00d705d640 -1 Falling back to public interface 2024-04-02T07:21:56.668 INFO:tasks.ceph.osd.0.smithi055.stderr:2024-04-02T07:21:56.666+0000 7f3e3bab8640 -1 Falling back to public interface 2024-04-02T07:21:56.668 INFO:tasks.ceph.mgr.y.smithi055.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-02T07:21:56.668 INFO:tasks.ceph.mgr.y.smithi055.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-02T07:21:56.668 INFO:tasks.ceph.mgr.y.smithi055.stderr: from numpy import show_config as show_numpy_config 2024-04-02T07:21:56.671 INFO:tasks.ceph.osd.2.smithi055.stderr:2024-04-02T07:21:56.670+0000 7f8a47280640 -1 Falling back to public interface 2024-04-02T07:21:56.672 INFO:tasks.ceph.osd.1.smithi055.stderr:2024-04-02T07:21:56.670+0000 7f304f596640 -1 Falling back to public interface 2024-04-02T07:21:56.672 INFO:tasks.ceph.osd.6.smithi106.stderr:2024-04-02T07:21:56.669+0000 7fc71082f640 -1 Falling back to public interface 2024-04-02T07:21:56.683 INFO:tasks.ceph.osd.3.smithi055.stderr:2024-04-02T07:21:56.682+0000 7f9e2bbe1640 -1 Falling back to public interface 2024-04-02T07:21:56.684 INFO:tasks.ceph.osd.7.smithi106.stderr:2024-04-02T07:21:56.681+0000 7f609d467640 -1 Falling back to public interface 2024-04-02T07:21:56.713 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:56.710+0000 7fbb845a6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-02T07:21:56.713 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:56.709+0000 7f16af436180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-02T07:21:56.860 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:56.857+0000 7f16af436180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-02T07:21:56.866 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:56.862+0000 7fbb845a6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-02T07:21:57.084 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-02T07:21:57.088 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:57.086+0000 7fbb845a6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-02T07:21:57.165 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:57.162+0000 7fbb845a6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-02T07:21:57.217 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.214+0000 7f0cf7a00640 1 Processor -- start 2024-04-02T07:21:57.217 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.214+0000 7f0cf7a00640 1 -- start start 2024-04-02T07:21:57.218 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.214+0000 7f0cf7a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0cf00afaf0 0x7f0cf0160770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:57.218 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.214+0000 7f0cf7a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0cf0160cb0 0x7f0cf00b0400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:57.219 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.214+0000 7f0cf7a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf01615f0 con 0x7f0cf00b0940 2024-04-02T07:21:57.219 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.214+0000 7f0cf7a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf00cb1f0 con 0x7f0cf00afaf0 2024-04-02T07:21:57.219 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.214+0000 7f0cf7a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf01610f0 con 0x7f0cf0160cb0 2024-04-02T07:21:57.219 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.214+0000 7f0cf5a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0cf00b0940 0x7f0cf015c400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42330/0 (socket says 172.21.15.55:42330) 2024-04-02T07:21:57.219 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.214+0000 7f0cf5a00640 1 -- 172.21.15.55:0/879869879 learned_addr learned my addr 172.21.15.55:0/879869879 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:21:57.219 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.214+0000 7f0cf5000640 1 --2- 172.21.15.55:0/879869879 >> v2:172.21.15.106:3300/0 conn(0x7f0cf00afaf0 0x7f0cf0160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:57.219 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.214+0000 7f0cefe00640 1 --2- 172.21.15.55:0/879869879 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0cf0160cb0 0x7f0cf00b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:57.219 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.214+0000 7f0cef400640 1 -- 172.21.15.55:0/879869879 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 110693295 0 0) 0x7f0cf01615f0 con 0x7f0cf00b0940 2024-04-02T07:21:57.219 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.214+0000 7f0cef400640 1 -- 172.21.15.55:0/879869879 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0cd8003530 con 0x7f0cf00b0940 2024-04-02T07:21:57.219 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.218+0000 7f0cf5000640 1 -- 172.21.15.55:0/879869879 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0cf0160cb0 msgr2=0x7f0cf00b0400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:21:57.219 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.218+0000 7f0cf5000640 1 --2- 172.21.15.55:0/879869879 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0cf0160cb0 0x7f0cf00b0400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:57.219 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.218+0000 7f0cf5000640 1 -- 172.21.15.55:0/879869879 >> v1:172.21.15.55:6789/0 conn(0x7f0cf00b0940 legacy=0x7f0cf015c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:57.219 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.218+0000 7f0cf5000640 1 -- 172.21.15.55:0/879869879 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf00b0db0 con 0x7f0cf00afaf0 2024-04-02T07:21:57.220 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.218+0000 7f0cefe00640 1 --2- 172.21.15.55:0/879869879 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0cf0160cb0 0x7f0cf00b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:21:57.221 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.218+0000 7f0cf5000640 1 --2- 172.21.15.55:0/879869879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cf00afaf0 0x7f0cf0160770 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0ce40097c0 tx=0x7f0ce401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0fd82bce330c12 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:57.222 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.218+0000 7f0cef400640 1 -- 172.21.15.55:0/879869879 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40ad640 con 0x7f0cf00afaf0 2024-04-02T07:21:57.222 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.218+0000 7f0cef400640 1 -- 172.21.15.55:0/879869879 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce40ad7a0 con 0x7f0cf00afaf0 2024-04-02T07:21:57.222 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.218+0000 7f0cef400640 1 -- 172.21.15.55:0/879869879 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40adb30 con 0x7f0cf00afaf0 2024-04-02T07:21:57.223 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.222+0000 7f0cf7a00640 1 -- 172.21.15.55:0/879869879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cf00afaf0 msgr2=0x7f0cf0160770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:57.223 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.222+0000 7f0cf7a00640 1 --2- 172.21.15.55:0/879869879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cf00afaf0 0x7f0cf0160770 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0ce40097c0 tx=0x7f0ce401c4a0 comp rx=0 tx=0).stop 2024-04-02T07:21:57.223 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.222+0000 7f0cf7a00640 1 -- 172.21.15.55:0/879869879 shutdown_connections 2024-04-02T07:21:57.223 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.222+0000 7f0cf7a00640 1 --2- 172.21.15.55:0/879869879 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0cf0160cb0 0x7f0cf00b0400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:57.223 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.222+0000 7f0cf7a00640 1 --2- 172.21.15.55:0/879869879 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cf00afaf0 0x7f0cf0160770 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:57.223 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.222+0000 7f0cf7a00640 1 -- 172.21.15.55:0/879869879 >> 172.21.15.55:0/879869879 conn(0x7f0cf0089fa0 msgr2=0x7f0cf008a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:57.223 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.222+0000 7f0cf7a00640 1 -- 172.21.15.55:0/879869879 shutdown_connections 2024-04-02T07:21:57.223 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.222+0000 7f0cf7a00640 1 -- 172.21.15.55:0/879869879 wait complete. 2024-04-02T07:21:57.225 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.222+0000 7f0cf7a00640 1 Processor -- start 2024-04-02T07:21:57.225 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.222+0000 7f0cf7a00640 1 -- start start 2024-04-02T07:21:57.228 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cf7a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf00afaf0 0x7f0cf0155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:57.229 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cf7a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0cf00b0940 0x7f0cf00c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:57.229 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cf7a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cf0160cb0 0x7f0cf00c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:21:57.229 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cf7a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf00d0310 con 0x7f0cf00afaf0 2024-04-02T07:21:57.229 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cf7a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf00d05f0 con 0x7f0cf0160cb0 2024-04-02T07:21:57.229 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cf7a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf00d08d0 con 0x7f0cf00b0940 2024-04-02T07:21:57.229 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cf5000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf00afaf0 0x7f0cf0155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:57.229 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cf5000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf00afaf0 0x7f0cf0155b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43814/0 (socket says 172.21.15.55:43814) 2024-04-02T07:21:57.229 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cf5000640 1 -- 172.21.15.55:0/4032690761 learned_addr learned my addr 172.21.15.55:0/4032690761 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:21:57.229 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cefe00640 1 --2- 172.21.15.55:0/4032690761 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0cf00b0940 0x7f0cf00c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:57.229 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cf5a00640 1 --2- 172.21.15.55:0/4032690761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cf0160cb0 0x7f0cf00c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:21:57.229 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cf5000640 1 -- 172.21.15.55:0/4032690761 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0cf00b0940 msgr2=0x7f0cf00c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:57.229 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cf5000640 1 --2- 172.21.15.55:0/4032690761 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0cf00b0940 0x7f0cf00c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:57.229 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cf5000640 1 -- 172.21.15.55:0/4032690761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cf0160cb0 msgr2=0x7f0cf00c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:57.229 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cf5000640 1 --2- 172.21.15.55:0/4032690761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cf0160cb0 0x7f0cf00c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:57.230 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cf5000640 1 -- 172.21.15.55:0/4032690761 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc009420 con 0x7f0cf00afaf0 2024-04-02T07:21:57.230 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cf5a00640 1 --2- 172.21.15.55:0/4032690761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cf0160cb0 0x7f0cf00c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:21:57.230 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cf5000640 1 --2- 172.21.15.55:0/4032690761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf00afaf0 0x7f0cf0155b40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0ce401a0d0 tx=0x7f0ce4019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:21:57.230 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cecc00640 1 -- 172.21.15.55:0/4032690761 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40b6610 con 0x7f0cf00afaf0 2024-04-02T07:21:57.230 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cecc00640 1 -- 172.21.15.55:0/4032690761 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce40a6040 con 0x7f0cf00afaf0 2024-04-02T07:21:57.230 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cf7a00640 1 -- 172.21.15.55:0/4032690761 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ce4009420 con 0x7f0cf00afaf0 2024-04-02T07:21:57.230 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cecc00640 1 -- 172.21.15.55:0/4032690761 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40b69d0 con 0x7f0cf00afaf0 2024-04-02T07:21:57.230 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cf7a00640 1 -- 172.21.15.55:0/4032690761 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf00d0e90 con 0x7f0cf00afaf0 2024-04-02T07:21:57.231 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cecc00640 1 -- 172.21.15.55:0/4032690761 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f0ce40b4040 con 0x7f0cf00afaf0 2024-04-02T07:21:57.231 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cecc00640 1 -- 172.21.15.55:0/4032690761 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f0ce40bfa80 con 0x7f0cf00afaf0 2024-04-02T07:21:57.231 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.226+0000 7f0cf7a00640 1 -- 172.21.15.55:0/4032690761 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf00d1080 con 0x7f0cf00afaf0 2024-04-02T07:21:57.232 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.230+0000 7f0cecc00640 1 -- 172.21.15.55:0/4032690761 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72508 (secure 0 0 0) 0x7f0ce40c4060 con 0x7f0cf00afaf0 2024-04-02T07:21:57.290 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.286+0000 7f0cf7a00640 1 -- 172.21.15.55:0/4032690761 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cf0073fa0 con 0x7f0cf00afaf0 2024-04-02T07:21:57.291 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.290+0000 7f0cecc00640 1 -- 172.21.15.55:0/4032690761 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f0ce40ba070 con 0x7f0cf00afaf0 2024-04-02T07:21:57.291 INFO:teuthology.misc.health.smithi055.stdout: 2024-04-02T07:21:57.291 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":10,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:21:55.970457+0000","last_up_change":"0.000000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:21:57.292 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.290+0000 7f0cf7a00640 1 -- 172.21.15.55:0/4032690761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf00afaf0 msgr2=0x7f0cf0155b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:21:57.292 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.290+0000 7f0cf7a00640 1 --2- 172.21.15.55:0/4032690761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf00afaf0 0x7f0cf0155b40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0ce401a0d0 tx=0x7f0ce4019240 comp rx=0 tx=0).stop 2024-04-02T07:21:57.292 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.290+0000 7f0cf7a00640 1 -- 172.21.15.55:0/4032690761 shutdown_connections 2024-04-02T07:21:57.293 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.290+0000 7f0cf7a00640 1 --2- 172.21.15.55:0/4032690761 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0cf0160cb0 0x7f0cf00c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:57.293 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.290+0000 7f0cf7a00640 1 --2- 172.21.15.55:0/4032690761 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0cf00b0940 0x7f0cf00c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:57.293 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.290+0000 7f0cf7a00640 1 --2- 172.21.15.55:0/4032690761 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0cf00afaf0 0x7f0cf0155b40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:21:57.293 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.290+0000 7f0cf7a00640 1 -- 172.21.15.55:0/4032690761 >> 172.21.15.55:0/4032690761 conn(0x7f0cf0089fa0 msgr2=0x7f0cf00aee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:21:57.293 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.290+0000 7f0cf7a00640 1 -- 172.21.15.55:0/4032690761 shutdown_connections 2024-04-02T07:21:57.294 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:21:57.290+0000 7f0cf7a00640 1 -- 172.21.15.55:0/4032690761 wait complete. 2024-04-02T07:21:57.309 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-02T07:21:57.331 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:57.330+0000 7fbb845a6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-02T07:21:57.549 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:57.545+0000 7f16af436180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-02T07:21:57.635 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:57.633+0000 7f16af436180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-02T07:21:57.833 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:57.829+0000 7f16af436180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-02T07:21:57.918 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:57.913+0000 7f16af436180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-02T07:21:58.188 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:58.186+0000 7fbb845a6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-02T07:21:58.245 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:58.241+0000 7f16af436180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-02T07:21:58.278 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:58.274+0000 7fbb845a6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-02T07:21:58.316 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:58.313+0000 7f16af436180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-02T07:21:58.498 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:58.494+0000 7fbb845a6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-02T07:21:58.586 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:58.582+0000 7fbb845a6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-02T07:21:58.930 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:58.926+0000 7fbb845a6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-02T07:21:59.003 INFO:tasks.ceph.mgr.y.smithi055.stderr:2024-04-02T07:21:59.002+0000 7fbb845a6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-02T07:21:59.343 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:59.337+0000 7f1654800640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-02T07:21:59.343 INFO:tasks.ceph.mgr.x.smithi106.stderr:2024-04-02T07:21:59.341+0000 7f1654800640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-02T07:22:00.458 INFO:tasks.ceph.osd.4.smithi106.stderr:2024-04-02T07:22:00.453+0000 7f00d705d640 -1 osd.4 0 log_to_monitors true 2024-04-02T07:22:00.502 INFO:tasks.ceph.osd.5.smithi106.stderr:2024-04-02T07:22:00.497+0000 7f227922b640 -1 osd.5 0 log_to_monitors true 2024-04-02T07:22:00.570 INFO:tasks.ceph.osd.2.smithi055.stderr:2024-04-02T07:22:00.566+0000 7f8a47280640 -1 osd.2 0 log_to_monitors true 2024-04-02T07:22:00.602 INFO:tasks.ceph.osd.6.smithi106.stderr:2024-04-02T07:22:00.597+0000 7fc71082f640 -1 osd.6 0 log_to_monitors true 2024-04-02T07:22:00.604 INFO:tasks.ceph.osd.1.smithi055.stderr:2024-04-02T07:22:00.602+0000 7f304f596640 -1 osd.1 0 log_to_monitors true 2024-04-02T07:22:00.624 INFO:tasks.ceph.osd.3.smithi055.stderr:2024-04-02T07:22:00.622+0000 7f9e2bbe1640 -1 osd.3 0 log_to_monitors true 2024-04-02T07:22:00.655 INFO:tasks.ceph.osd.7.smithi106.stderr:2024-04-02T07:22:00.653+0000 7f609d467640 -1 osd.7 0 log_to_monitors true 2024-04-02T07:22:00.662 INFO:tasks.ceph.osd.0.smithi055.stderr:2024-04-02T07:22:00.658+0000 7f3e3bab8640 -1 osd.0 0 log_to_monitors true 2024-04-02T07:22:04.116 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:04.325 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.318+0000 7fe1d3200640 1 Processor -- start 2024-04-02T07:22:04.326 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.318+0000 7fe1d3200640 1 -- start start 2024-04-02T07:22:04.326 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.322+0000 7fe1d3200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe1cc15cb60 0x7fe1cc0b8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:04.326 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.322+0000 7fe1d3200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1cc0cf370 0x7fe1cc0cf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:04.326 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.322+0000 7fe1d3200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1cc0cfd10 con 0x7fe1cc0d0d10 2024-04-02T07:22:04.326 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.322+0000 7fe1d3200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1cc0b89c0 con 0x7fe1cc15cb60 2024-04-02T07:22:04.326 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.322+0000 7fe1d3200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc15cf40 con 0x7fe1cc0cf370 2024-04-02T07:22:04.326 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.322+0000 7fe1cbe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe1cc15cb60 0x7fe1cc0b8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:04.326 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.322+0000 7fe1d1200640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe1cc0d0d10 0x7fe1cc0d11a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:59670/0 (socket says 172.21.15.55:59670) 2024-04-02T07:22:04.326 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.322+0000 7fe1d1200640 1 -- 172.21.15.55:0/2091672827 learned_addr learned my addr 172.21.15.55:0/2091672827 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:04.326 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.322+0000 7fe1cb400640 1 --2- 172.21.15.55:0/2091672827 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1cc0cf370 0x7fe1cc0cf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:04.328 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.322+0000 7fe1cb400640 1 -- 172.21.15.55:0/2091672827 >> v2:172.21.15.55:3300/0 conn(0x7fe1cc15cb60 msgr2=0x7fe1cc0b8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:04.329 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.322+0000 7fe1cb400640 1 --2- 172.21.15.55:0/2091672827 >> v2:172.21.15.55:3300/0 conn(0x7fe1cc15cb60 0x7fe1cc0b8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:04.329 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.322+0000 7fe1cb400640 1 -- 172.21.15.55:0/2091672827 >> v1:172.21.15.106:6789/0 conn(0x7fe1cc0d0d10 legacy=0x7fe1cc0d11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:04.329 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.322+0000 7fe1cb400640 1 -- 172.21.15.55:0/2091672827 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc0b7190 con 0x7fe1cc0cf370 2024-04-02T07:22:04.332 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.330+0000 7fe1cb400640 1 --2- 172.21.15.55:0/2091672827 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1cc0cf370 0x7fe1cc0cf7d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80097c0 tx=0x7fe1b801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fcad2d75a8565b6e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:04.333 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.330+0000 7fe1caa00640 1 -- 172.21.15.55:0/2091672827 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b80a8990 con 0x7fe1cc0cf370 2024-04-02T07:22:04.333 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.330+0000 7fe1caa00640 1 -- 172.21.15.55:0/2091672827 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1b80a8af0 con 0x7fe1cc0cf370 2024-04-02T07:22:04.333 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.330+0000 7fe1caa00640 1 -- 172.21.15.55:0/2091672827 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b80a8e80 con 0x7fe1cc0cf370 2024-04-02T07:22:04.333 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.330+0000 7fe1d3200640 1 -- 172.21.15.55:0/2091672827 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1cc0cf370 msgr2=0x7fe1cc0cf7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:04.333 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.330+0000 7fe1d3200640 1 --2- 172.21.15.55:0/2091672827 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1cc0cf370 0x7fe1cc0cf7d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80097c0 tx=0x7fe1b801ec90 comp rx=0 tx=0).stop 2024-04-02T07:22:04.334 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.330+0000 7fe1d3200640 1 -- 172.21.15.55:0/2091672827 shutdown_connections 2024-04-02T07:22:04.334 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.330+0000 7fe1d3200640 1 --2- 172.21.15.55:0/2091672827 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1cc0cf370 0x7fe1cc0cf7d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:04.334 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.330+0000 7fe1d3200640 1 --2- 172.21.15.55:0/2091672827 >> v2:172.21.15.55:3300/0 conn(0x7fe1cc15cb60 0x7fe1cc0b8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:04.334 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.330+0000 7fe1d3200640 1 -- 172.21.15.55:0/2091672827 >> 172.21.15.55:0/2091672827 conn(0x7fe1cc06b150 msgr2=0x7fe1cc06b560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:04.334 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.330+0000 7fe1d3200640 1 -- 172.21.15.55:0/2091672827 shutdown_connections 2024-04-02T07:22:04.335 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.330+0000 7fe1d3200640 1 -- 172.21.15.55:0/2091672827 wait complete. 2024-04-02T07:22:04.338 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.334+0000 7fe1d3200640 1 Processor -- start 2024-04-02T07:22:04.338 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.334+0000 7fe1d3200640 1 -- start start 2024-04-02T07:22:04.339 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1d3200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1cc0cf370 0x7fe1cc152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:04.339 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1d3200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1cc0d0d10 0x7fe1cc0cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:04.339 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1d3200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1cc15cb60 0x7fe1cc06b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:04.339 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1d3200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc15d110 con 0x7fe1cc0d0d10 2024-04-02T07:22:04.339 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1d3200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc1533a0 con 0x7fe1cc0cf370 2024-04-02T07:22:04.339 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1d3200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc1f28f0 con 0x7fe1cc15cb60 2024-04-02T07:22:04.340 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1cbe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1cc0cf370 0x7fe1cc152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:04.340 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1d1200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1cc15cb60 0x7fe1cc06b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:04.340 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1d1200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1cc15cb60 0x7fe1cc06b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:59592/0 (socket says 172.21.15.55:59592) 2024-04-02T07:22:04.340 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1d1200640 1 -- 172.21.15.55:0/2373216460 learned_addr learned my addr 172.21.15.55:0/2373216460 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:04.341 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1d1200640 1 -- 172.21.15.55:0/2373216460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1cc0cf370 msgr2=0x7fe1cc152e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:04.341 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1d1200640 1 --2- 172.21.15.55:0/2373216460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1cc0cf370 0x7fe1cc152e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:04.341 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1d1200640 1 -- 172.21.15.55:0/2373216460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1cc0d0d10 msgr2=0x7fe1cc0cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:04.341 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1d1200640 1 --2- 172.21.15.55:0/2373216460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1cc0d0d10 0x7fe1cc0cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:04.341 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1d1200640 1 -- 172.21.15.55:0/2373216460 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b8009420 con 0x7fe1cc15cb60 2024-04-02T07:22:04.341 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1d1200640 1 --2- 172.21.15.55:0/2373216460 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1cc15cb60 0x7fe1cc06b530 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00c400 tx=0x7fe1bc00c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:04.342 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1c3e00640 1 -- 172.21.15.55:0/2373216460 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc005cf0 con 0x7fe1cc15cb60 2024-04-02T07:22:04.342 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1c3e00640 1 -- 172.21.15.55:0/2373216460 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1bc005e50 con 0x7fe1cc15cb60 2024-04-02T07:22:04.343 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1c3e00640 1 -- 172.21.15.55:0/2373216460 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1bc0072d0 con 0x7fe1cc15cb60 2024-04-02T07:22:04.343 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1d3200640 1 -- 172.21.15.55:0/2373216460 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1cc1f2bd0 con 0x7fe1cc15cb60 2024-04-02T07:22:04.343 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.338+0000 7fe1d3200640 1 -- 172.21.15.55:0/2373216460 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc1f3190 con 0x7fe1cc15cb60 2024-04-02T07:22:04.345 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.342+0000 7fe1d3200640 1 -- 172.21.15.55:0/2373216460 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1a4005260 con 0x7fe1cc15cb60 2024-04-02T07:22:04.346 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.342+0000 7fe1c3e00640 1 -- 172.21.15.55:0/2373216460 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 4) v1 ==== 86028+0+0 (secure 0 0 0) 0x7fe1bc007430 con 0x7fe1cc15cb60 2024-04-02T07:22:04.348 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.346+0000 7fe1c3e00640 1 --2- 172.21.15.55:0/2373216460 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe1ac0666d0 0x7fe1ac068b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:04.348 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.346+0000 7fe1c3e00640 1 -- 172.21.15.55:0/2373216460 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7fe1bc0827c0 con 0x7fe1cc15cb60 2024-04-02T07:22:04.349 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.346+0000 7fe1cbe00640 1 --2- 172.21.15.55:0/2373216460 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe1ac0666d0 0x7fe1ac068b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:04.350 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.346+0000 7fe1cbe00640 1 --2- 172.21.15.55:0/2373216460 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe1ac0666d0 0x7fe1ac068b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4011340 tx=0x7fe1c400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:04.359 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.358+0000 7fe1c3e00640 1 -- 172.21.15.55:0/2373216460 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe1bc050ac0 con 0x7fe1cc15cb60 2024-04-02T07:22:04.639 INFO:tasks.ceph.osd.5.smithi106.stderr:2024-04-02T07:22:04.641+0000 7f2272c00640 -1 osd.5 0 waiting for initial osdmap 2024-04-02T07:22:04.673 INFO:tasks.ceph.osd.5.smithi106.stderr:2024-04-02T07:22:04.673+0000 7f2269600640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-02T07:22:04.677 INFO:tasks.ceph.osd.7.smithi106.stderr:2024-04-02T07:22:04.677+0000 7f6097a00640 -1 osd.7 0 waiting for initial osdmap 2024-04-02T07:22:04.680 INFO:tasks.ceph.osd.1.smithi055.stderr:2024-04-02T07:22:04.678+0000 7f3049a00640 -1 osd.1 0 waiting for initial osdmap 2024-04-02T07:22:04.683 INFO:tasks.ceph.osd.6.smithi106.stderr:2024-04-02T07:22:04.685+0000 7fc70ac00640 -1 osd.6 0 waiting for initial osdmap 2024-04-02T07:22:04.690 INFO:tasks.ceph.osd.3.smithi055.stderr:2024-04-02T07:22:04.686+0000 7f9e26000640 -1 osd.3 0 waiting for initial osdmap 2024-04-02T07:22:04.690 INFO:tasks.ceph.osd.0.smithi055.stderr:2024-04-02T07:22:04.686+0000 7f3e36000640 -1 osd.0 0 waiting for initial osdmap 2024-04-02T07:22:04.703 INFO:tasks.ceph.osd.4.smithi106.stderr:2024-04-02T07:22:04.701+0000 7f00d1600640 -1 osd.4 0 waiting for initial osdmap 2024-04-02T07:22:04.712 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.710+0000 7fe1d3200640 1 -- 172.21.15.55:0/2373216460 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1a40050d0 con 0x7fe1cc15cb60 2024-04-02T07:22:04.712 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.710+0000 7fe1c3e00640 1 -- 172.21.15.55:0/2373216460 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fe1bc017090 con 0x7fe1cc15cb60 2024-04-02T07:22:04.713 INFO:teuthology.misc.health.smithi055.stdout: 2024-04-02T07:22:04.713 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":12,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:02.349787+0000","last_up_change":"0.000000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:04.713 INFO:tasks.ceph.osd.1.smithi055.stderr:2024-04-02T07:22:04.710+0000 7f3040400640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-02T07:22:04.715 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.714+0000 7fe1d3200640 1 -- 172.21.15.55:0/2373216460 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe1ac0666d0 msgr2=0x7fe1ac068b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:04.715 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.714+0000 7fe1d3200640 1 --2- 172.21.15.55:0/2373216460 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe1ac0666d0 0x7fe1ac068b90 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe1c4011340 tx=0x7fe1c400b040 comp rx=0 tx=0).stop 2024-04-02T07:22:04.715 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.714+0000 7fe1d3200640 1 -- 172.21.15.55:0/2373216460 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1cc15cb60 msgr2=0x7fe1cc06b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:04.715 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.714+0000 7fe1d3200640 1 --2- 172.21.15.55:0/2373216460 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1cc15cb60 0x7fe1cc06b530 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe1bc00c400 tx=0x7fe1bc00c8c0 comp rx=0 tx=0).stop 2024-04-02T07:22:04.715 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.714+0000 7fe1d3200640 1 -- 172.21.15.55:0/2373216460 shutdown_connections 2024-04-02T07:22:04.715 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.714+0000 7fe1d3200640 1 --2- 172.21.15.55:0/2373216460 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe1cc15cb60 0x7fe1cc06b530 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:04.716 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.714+0000 7fe1d3200640 1 --2- 172.21.15.55:0/2373216460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1cc0d0d10 0x7fe1cc0cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:04.716 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.714+0000 7fe1d3200640 1 --2- 172.21.15.55:0/2373216460 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe1ac0666d0 0x7fe1ac068b90 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:04.716 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.714+0000 7fe1d3200640 1 --2- 172.21.15.55:0/2373216460 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1cc0cf370 0x7fe1cc152e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:04.716 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.714+0000 7fe1d3200640 1 -- 172.21.15.55:0/2373216460 >> 172.21.15.55:0/2373216460 conn(0x7fe1cc06b150 msgr2=0x7fe1cc0b2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:04.716 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.714+0000 7fe1d3200640 1 -- 172.21.15.55:0/2373216460 shutdown_connections 2024-04-02T07:22:04.716 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:04.714+0000 7fe1d3200640 1 -- 172.21.15.55:0/2373216460 wait complete. 2024-04-02T07:22:04.719 INFO:tasks.ceph.osd.2.smithi055.stderr:2024-04-02T07:22:04.718+0000 7f8a41800640 -1 osd.2 0 waiting for initial osdmap 2024-04-02T07:22:04.721 INFO:tasks.ceph.osd.7.smithi106.stderr:2024-04-02T07:22:04.721+0000 7f608e400640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-02T07:22:04.724 INFO:tasks.ceph.osd.0.smithi055.stderr:2024-04-02T07:22:04.722+0000 7f3e2ca00640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-02T07:22:04.732 INFO:tasks.ceph.osd.3.smithi055.stderr:2024-04-02T07:22:04.730+0000 7f9e1ca00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-02T07:22:04.733 INFO:tasks.ceph.osd.6.smithi106.stderr:2024-04-02T07:22:04.733+0000 7fc701600640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-02T07:22:04.734 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-02T07:22:04.740 INFO:tasks.ceph.osd.4.smithi106.stderr:2024-04-02T07:22:04.741+0000 7f00c8000640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-02T07:22:04.748 INFO:tasks.ceph.osd.2.smithi055.stderr:2024-04-02T07:22:04.746+0000 7f8a38200640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-02T07:22:11.542 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:11.683 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.681+0000 7f1a62200640 1 Processor -- start 2024-04-02T07:22:11.683 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.681+0000 7f1a62200640 1 -- start start 2024-04-02T07:22:11.684 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.681+0000 7f1a62200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1a5c15b170 0x7f1a5c0b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:11.684 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.681+0000 7f1a62200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a5c0ac670 0x7f1a5c150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:11.685 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.681+0000 7f1a62200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a5c0cb380 con 0x7f1a5c15b550 2024-04-02T07:22:11.685 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.681+0000 7f1a62200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a5c0b2420 con 0x7f1a5c15b170 2024-04-02T07:22:11.685 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.681+0000 7f1a62200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c0b2700 con 0x7f1a5c0ac670 2024-04-02T07:22:11.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.681+0000 7f1a5b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1a5c15b170 0x7f1a5c0b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:11.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.681+0000 7f1a5be00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a5c0ac670 0x7f1a5c150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:11.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.681+0000 7f1a5b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1a5c15b170 0x7f1a5c0b3db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:38620/0 (socket says 172.21.15.55:38620) 2024-04-02T07:22:11.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.681+0000 7f1a5aa00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1a5c15b550 0x7f1a5c0abf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:51846/0 (socket says 172.21.15.55:51846) 2024-04-02T07:22:11.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.681+0000 7f1a5b400640 1 -- 172.21.15.55:0/2385866663 learned_addr learned my addr 172.21.15.55:0/2385866663 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:11.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.681+0000 7f1a5be00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a5c0ac670 0x7f1a5c150fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:51850/0 (socket says 172.21.15.55:51850) 2024-04-02T07:22:11.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.681+0000 7f1a5b400640 1 -- 172.21.15.55:0/2385866663 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a5c0ac670 msgr2=0x7f1a5c150fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:11.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.681+0000 7f1a5b400640 1 --2- 172.21.15.55:0/2385866663 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a5c0ac670 0x7f1a5c150fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:11.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.681+0000 7f1a5b400640 1 -- 172.21.15.55:0/2385866663 >> v1:172.21.15.106:6789/0 conn(0x7f1a5c15b550 legacy=0x7f1a5c0abf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:11.686 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.681+0000 7f1a5b400640 1 -- 172.21.15.55:0/2385866663 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c0b29e0 con 0x7f1a5c15b170 2024-04-02T07:22:11.687 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.681+0000 7f1a5a000640 1 -- 172.21.15.55:0/2385866663 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127310417 0 0) 0x7f1a5c0cb380 con 0x7f1a5c15b550 2024-04-02T07:22:11.689 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.685+0000 7f1a5b400640 1 --2- 172.21.15.55:0/2385866663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a5c15b170 0x7f1a5c0b3db0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009870 tx=0x7f1a4c01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca62f6ff250342cc server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:11.691 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.685+0000 7f1a5a000640 1 -- 172.21.15.55:0/2385866663 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c0ab670 con 0x7f1a5c15b170 2024-04-02T07:22:11.692 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.685+0000 7f1a5a000640 1 -- 172.21.15.55:0/2385866663 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c0ab7d0 con 0x7f1a5c15b170 2024-04-02T07:22:11.692 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.685+0000 7f1a5a000640 1 -- 172.21.15.55:0/2385866663 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c0abb60 con 0x7f1a5c15b170 2024-04-02T07:22:11.692 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.685+0000 7f1a62200640 1 -- 172.21.15.55:0/2385866663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a5c15b170 msgr2=0x7f1a5c0b3db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:11.692 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.685+0000 7f1a62200640 1 --2- 172.21.15.55:0/2385866663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a5c15b170 0x7f1a5c0b3db0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c009870 tx=0x7f1a4c01c560 comp rx=0 tx=0).stop 2024-04-02T07:22:11.692 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.685+0000 7f1a62200640 1 -- 172.21.15.55:0/2385866663 shutdown_connections 2024-04-02T07:22:11.692 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.685+0000 7f1a62200640 1 --2- 172.21.15.55:0/2385866663 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a5c0ac670 0x7f1a5c150fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:11.692 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.685+0000 7f1a62200640 1 --2- 172.21.15.55:0/2385866663 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a5c15b170 0x7f1a5c0b3db0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:11.692 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.685+0000 7f1a62200640 1 -- 172.21.15.55:0/2385866663 >> 172.21.15.55:0/2385866663 conn(0x7f1a5c0b14c0 msgr2=0x7f1a5c0ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:11.693 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.685+0000 7f1a62200640 1 -- 172.21.15.55:0/2385866663 shutdown_connections 2024-04-02T07:22:11.693 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.685+0000 7f1a62200640 1 -- 172.21.15.55:0/2385866663 wait complete. 2024-04-02T07:22:11.693 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a62200640 1 Processor -- start 2024-04-02T07:22:11.693 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a62200640 1 -- start start 2024-04-02T07:22:11.697 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a62200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a5c0ac670 0x7f1a5c14b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:11.697 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a62200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a5c15b170 0x7f1a5c0cb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:11.697 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a62200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a5c15b550 0x7f1a5c0cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:11.697 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a62200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c0ae860 con 0x7f1a5c15b170 2024-04-02T07:22:11.697 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a62200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c0ce750 con 0x7f1a5c0ac670 2024-04-02T07:22:11.697 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a62200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a5c158060 con 0x7f1a5c15b550 2024-04-02T07:22:11.697 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a5aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a5c15b170 0x7f1a5c0cb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:11.697 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a5aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a5c15b170 0x7f1a5c0cb8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35978/0 (socket says 172.21.15.55:35978) 2024-04-02T07:22:11.697 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a5aa00640 1 -- 172.21.15.55:0/4056150737 learned_addr learned my addr 172.21.15.55:0/4056150737 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:11.697 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a5b400640 1 --2- 172.21.15.55:0/4056150737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a5c0ac670 0x7f1a5c14b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:11.698 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a5be00640 1 --2- 172.21.15.55:0/4056150737 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a5c15b550 0x7f1a5c0cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:11.698 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a5aa00640 1 -- 172.21.15.55:0/4056150737 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a5c15b550 msgr2=0x7f1a5c0cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:11.698 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a5aa00640 1 --2- 172.21.15.55:0/4056150737 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a5c15b550 0x7f1a5c0cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:11.698 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a5aa00640 1 -- 172.21.15.55:0/4056150737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a5c0ac670 msgr2=0x7f1a5c14b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:11.698 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a5aa00640 1 --2- 172.21.15.55:0/4056150737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a5c0ac670 0x7f1a5c14b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:11.698 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a5aa00640 1 -- 172.21.15.55:0/4056150737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a4c0094d0 con 0x7f1a5c15b170 2024-04-02T07:22:11.698 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a5aa00640 1 --2- 172.21.15.55:0/4056150737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a5c15b170 0x7f1a5c0cb8b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800c480 tx=0x7f1a4800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:11.698 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a53400640 1 -- 172.21.15.55:0/4056150737 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a480074e0 con 0x7f1a5c15b170 2024-04-02T07:22:11.698 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a53400640 1 -- 172.21.15.55:0/4056150737 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a48007660 con 0x7f1a5c15b170 2024-04-02T07:22:11.698 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a53400640 1 -- 172.21.15.55:0/4056150737 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a48004a30 con 0x7f1a5c15b170 2024-04-02T07:22:11.698 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a62200640 1 -- 172.21.15.55:0/4056150737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5c158340 con 0x7f1a5c15b170 2024-04-02T07:22:11.698 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.689+0000 7f1a62200640 1 -- 172.21.15.55:0/4056150737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a5c0ce3e0 con 0x7f1a5c15b170 2024-04-02T07:22:11.698 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.693+0000 7f1a62200640 1 -- 172.21.15.55:0/4056150737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a5c158860 con 0x7f1a5c15b170 2024-04-02T07:22:11.699 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.693+0000 7f1a53400640 1 -- 172.21.15.55:0/4056150737 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1a48004b90 con 0x7f1a5c15b170 2024-04-02T07:22:11.699 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.693+0000 7f1a53400640 1 --2- 172.21.15.55:0/4056150737 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1a3c066690 0x7f1a3c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:11.699 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.693+0000 7f1a53400640 1 -- 172.21.15.55:0/4056150737 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1a48082fb0 con 0x7f1a5c15b170 2024-04-02T07:22:11.699 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.693+0000 7f1a5b400640 1 --2- 172.21.15.55:0/4056150737 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1a3c066690 0x7f1a3c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:11.700 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.693+0000 7f1a5b400640 1 --2- 172.21.15.55:0/4056150737 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1a3c066690 0x7f1a3c068b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0af000 tx=0x7f1a4c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:11.704 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.701+0000 7f1a53400640 1 -- 172.21.15.55:0/4056150737 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f1a48050710 con 0x7f1a5c15b170 2024-04-02T07:22:11.865 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.861+0000 7f1a62200640 1 -- 172.21.15.55:0/4056150737 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a5c073fa0 con 0x7f1a5c15b170 2024-04-02T07:22:11.866 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.861+0000 7f1a53400640 1 -- 172.21.15.55:0/4056150737 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f1a48018020 con 0x7f1a5c15b170 2024-04-02T07:22:11.866 INFO:teuthology.misc.health.smithi055.stdout: 2024-04-02T07:22:11.866 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":16,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:08.683227+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:11.868 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.865+0000 7f1a62200640 1 -- 172.21.15.55:0/4056150737 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1a3c066690 msgr2=0x7f1a3c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:11.868 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.865+0000 7f1a62200640 1 --2- 172.21.15.55:0/4056150737 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1a3c066690 0x7f1a3c068b50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c0af000 tx=0x7f1a4c0a7000 comp rx=0 tx=0).stop 2024-04-02T07:22:11.868 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.865+0000 7f1a62200640 1 -- 172.21.15.55:0/4056150737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a5c15b170 msgr2=0x7f1a5c0cb8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:11.868 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.865+0000 7f1a62200640 1 --2- 172.21.15.55:0/4056150737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a5c15b170 0x7f1a5c0cb8b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800c480 tx=0x7f1a4800c940 comp rx=0 tx=0).stop 2024-04-02T07:22:11.868 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.865+0000 7f1a62200640 1 -- 172.21.15.55:0/4056150737 shutdown_connections 2024-04-02T07:22:11.869 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.865+0000 7f1a62200640 1 --2- 172.21.15.55:0/4056150737 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a5c15b550 0x7f1a5c0cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:11.869 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.865+0000 7f1a62200640 1 --2- 172.21.15.55:0/4056150737 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a5c15b170 0x7f1a5c0cb8b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:11.869 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.865+0000 7f1a62200640 1 --2- 172.21.15.55:0/4056150737 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1a3c066690 0x7f1a3c068b50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:11.869 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.865+0000 7f1a62200640 1 --2- 172.21.15.55:0/4056150737 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a5c0ac670 0x7f1a5c14b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:11.869 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.865+0000 7f1a62200640 1 -- 172.21.15.55:0/4056150737 >> 172.21.15.55:0/4056150737 conn(0x7f1a5c0b14c0 msgr2=0x7f1a5c15d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:11.869 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.865+0000 7f1a62200640 1 -- 172.21.15.55:0/4056150737 shutdown_connections 2024-04-02T07:22:11.869 INFO:teuthology.misc.health.smithi055.stderr:2024-04-02T07:22:11.865+0000 7f1a62200640 1 -- 172.21.15.55:0/4056150737 wait complete. 2024-04-02T07:22:11.885 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-02T07:22:11.885 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-02T07:22:11.885 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-02T07:22:11.885 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-02T07:22:11.888 INFO:tasks.ceph.mds.a:Started 2024-04-02T07:22:11.889 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-02T07:22:11.889 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-02T07:22:11.891 INFO:tasks.ceph.mds.c:Started 2024-04-02T07:22:11.892 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-02T07:22:11.892 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-02T07:22:11.895 INFO:tasks.ceph.mds.b:Started 2024-04-02T07:22:11.895 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-02T07:22:11.895 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-02T07:22:11.899 INFO:tasks.ceph.mds.d:Started 2024-04-02T07:22:11.899 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-02T07:22:11.899 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:11.983 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-02T07:22:11.984 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-02T07:22:12.016 INFO:tasks.ceph.mds.b.smithi106.stdout:starting mds.b at 2024-04-02T07:22:12.017 INFO:tasks.ceph.mds.d.smithi106.stdout:starting mds.d at 2024-04-02T07:22:12.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.041+0000 7f6543e00640 1 Processor -- start 2024-04-02T07:22:12.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.041+0000 7f6543e00640 1 -- start start 2024-04-02T07:22:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.041+0000 7f6543e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f653c0b19d0 0x7f653c0ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.041+0000 7f6543e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f653c06c0d0 0x7f653c098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.041+0000 7f6543e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f653c0cf3d0 con 0x7f653c0cef10 2024-04-02T07:22:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.041+0000 7f6543e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f653c0cf6b0 con 0x7f653c0b19d0 2024-04-02T07:22:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.041+0000 7f6543e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653c0cf990 con 0x7f653c06c0d0 2024-04-02T07:22:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.045+0000 7f6541400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f653c0b19d0 0x7f653c0ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.045+0000 7f6541400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f653c0b19d0 0x7f653c0ce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36030/0 (socket says 172.21.15.55:36030) 2024-04-02T07:22:12.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.045+0000 7f6541400640 1 -- 172.21.15.55:0/1889117491 learned_addr learned my addr 172.21.15.55:0/1889117491 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.045+0000 7f6541400640 1 -- 172.21.15.55:0/1889117491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f653c06c0d0 msgr2=0x7f653c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.045+0000 7f6540a00640 1 --2- 172.21.15.55:0/1889117491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f653c06c0d0 0x7f653c098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.045+0000 7f6541400640 1 --2- 172.21.15.55:0/1889117491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f653c06c0d0 0x7f653c098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.045+0000 7f6541400640 1 -- 172.21.15.55:0/1889117491 >> v1:172.21.15.106:6789/0 conn(0x7f653c0cef10 legacy=0x7f653c15c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.045+0000 7f6541400640 1 -- 172.21.15.55:0/1889117491 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f653c0cfc70 con 0x7f653c0b19d0 2024-04-02T07:22:12.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.045+0000 7f6540a00640 1 --2- 172.21.15.55:0/1889117491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f653c06c0d0 0x7f653c098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:12.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.045+0000 7f6541400640 1 --2- 172.21.15.55:0/1889117491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f653c0b19d0 0x7f653c0ce9d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6530009870 tx=0x7f653001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c4885f849864897 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:12.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.045+0000 7f653be00640 1 -- 172.21.15.55:0/1889117491 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65300ab600 con 0x7f653c0b19d0 2024-04-02T07:22:12.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.045+0000 7f653be00640 1 -- 172.21.15.55:0/1889117491 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65300a7050 con 0x7f653c0b19d0 2024-04-02T07:22:12.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f653be00640 1 -- 172.21.15.55:0/1889117491 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65300ab980 con 0x7f653c0b19d0 2024-04-02T07:22:12.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6543e00640 1 -- 172.21.15.55:0/1889117491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f653c0b19d0 msgr2=0x7f653c0ce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:12.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6543e00640 1 --2- 172.21.15.55:0/1889117491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f653c0b19d0 0x7f653c0ce9d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f6530009870 tx=0x7f653001c520 comp rx=0 tx=0).stop 2024-04-02T07:22:12.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6543e00640 1 -- 172.21.15.55:0/1889117491 shutdown_connections 2024-04-02T07:22:12.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6543e00640 1 --2- 172.21.15.55:0/1889117491 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f653c06c0d0 0x7f653c098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6543e00640 1 --2- 172.21.15.55:0/1889117491 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f653c0b19d0 0x7f653c0ce9d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6543e00640 1 -- 172.21.15.55:0/1889117491 >> 172.21.15.55:0/1889117491 conn(0x7f653c0b2150 msgr2=0x7f653c0b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:12.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6543e00640 1 -- 172.21.15.55:0/1889117491 shutdown_connections 2024-04-02T07:22:12.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6543e00640 1 -- 172.21.15.55:0/1889117491 wait complete. 2024-04-02T07:22:12.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6543e00640 1 Processor -- start 2024-04-02T07:22:12.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6543e00640 1 -- start start 2024-04-02T07:22:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6543e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f653c06c0d0 0x7f653c150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6543e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f653c0b19d0 0x7f653c157db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6543e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f653c0cef10 0x7f653c1582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6543e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c0c8370 con 0x7f653c0b19d0 2024-04-02T07:22:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6543e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f653c0c77d0 con 0x7f653c0cef10 2024-04-02T07:22:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6543e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f653c0c7a40 con 0x7f653c06c0d0 2024-04-02T07:22:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6540a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f653c0b19d0 0x7f653c157db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:12.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6540a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f653c0b19d0 0x7f653c157db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36044/0 (socket says 172.21.15.55:36044) 2024-04-02T07:22:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6540a00640 1 -- 172.21.15.55:0/1874438131 learned_addr learned my addr 172.21.15.55:0/1874438131 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6541400640 1 --2- 172.21.15.55:0/1874438131 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f653c06c0d0 0x7f653c150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.049+0000 7f6541e00640 1 --2- 172.21.15.55:0/1874438131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f653c0cef10 0x7f653c1582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.053+0000 7f6540a00640 1 -- 172.21.15.55:0/1874438131 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f653c06c0d0 msgr2=0x7f653c150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.053+0000 7f6540a00640 1 --2- 172.21.15.55:0/1874438131 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f653c06c0d0 0x7f653c150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.053+0000 7f6540a00640 1 -- 172.21.15.55:0/1874438131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f653c0cef10 msgr2=0x7f653c1582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.053+0000 7f6540a00640 1 --2- 172.21.15.55:0/1874438131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f653c0cef10 0x7f653c1582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.053+0000 7f6540a00640 1 -- 172.21.15.55:0/1874438131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65300094d0 con 0x7f653c0b19d0 2024-04-02T07:22:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.053+0000 7f6541e00640 1 --2- 172.21.15.55:0/1874438131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f653c0cef10 0x7f653c1582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:12.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.053+0000 7f6540a00640 1 --2- 172.21.15.55:0/1874438131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f653c0b19d0 0x7f653c157db0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f652800c820 tx=0x7f652800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.053+0000 7f6539600640 1 -- 172.21.15.55:0/1874438131 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6528007a30 con 0x7f653c0b19d0 2024-04-02T07:22:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.053+0000 7f6539600640 1 -- 172.21.15.55:0/1874438131 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6528007b90 con 0x7f653c0b19d0 2024-04-02T07:22:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.053+0000 7f6543e00640 1 -- 172.21.15.55:0/1874438131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f653c0c7d20 con 0x7f653c0b19d0 2024-04-02T07:22:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.053+0000 7f6539600640 1 -- 172.21.15.55:0/1874438131 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65280113f0 con 0x7f653c0b19d0 2024-04-02T07:22:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.053+0000 7f6543e00640 1 -- 172.21.15.55:0/1874438131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f653c150fc0 con 0x7f653c0b19d0 2024-04-02T07:22:12.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.053+0000 7f6543e00640 1 -- 172.21.15.55:0/1874438131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f653c15d220 con 0x7f653c0b19d0 2024-04-02T07:22:12.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.053+0000 7f6539600640 1 -- 172.21.15.55:0/1874438131 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6528011550 con 0x7f653c0b19d0 2024-04-02T07:22:12.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.057+0000 7f6539600640 1 --2- 172.21.15.55:0/1874438131 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f651c066690 0x7f651c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:12.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.057+0000 7f6539600640 1 -- 172.21.15.55:0/1874438131 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6528083fb0 con 0x7f653c0b19d0 2024-04-02T07:22:12.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.057+0000 7f6541400640 1 --2- 172.21.15.55:0/1874438131 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f651c066690 0x7f651c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:12.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.057+0000 7f6541400640 1 --2- 172.21.15.55:0/1874438131 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f651c066690 0x7f651c068b50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f65300ad000 tx=0x7f65300a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:12.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.061+0000 7f6539600640 1 -- 172.21.15.55:0/1874438131 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f65280b5980 con 0x7f653c0b19d0 2024-04-02T07:22:12.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.221+0000 7f6543e00640 1 -- 172.21.15.55:0/1874438131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f653c066c90 con 0x7f653c0b19d0 2024-04-02T07:22:12.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.221+0000 7f6539600640 1 -- 172.21.15.55:0/1874438131 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f652801f090 con 0x7f653c0b19d0 2024-04-02T07:22:12.226 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:12.226 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":16,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:08.683227+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.225+0000 7f6543e00640 1 -- 172.21.15.55:0/1874438131 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f651c066690 msgr2=0x7f651c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.225+0000 7f6543e00640 1 --2- 172.21.15.55:0/1874438131 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f651c066690 0x7f651c068b50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f65300ad000 tx=0x7f65300a6000 comp rx=0 tx=0).stop 2024-04-02T07:22:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.225+0000 7f6543e00640 1 -- 172.21.15.55:0/1874438131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f653c0b19d0 msgr2=0x7f653c157db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.225+0000 7f6543e00640 1 --2- 172.21.15.55:0/1874438131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f653c0b19d0 0x7f653c157db0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f652800c820 tx=0x7f652800cce0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.225+0000 7f6543e00640 1 -- 172.21.15.55:0/1874438131 shutdown_connections 2024-04-02T07:22:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.225+0000 7f6543e00640 1 --2- 172.21.15.55:0/1874438131 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f651c066690 0x7f651c068b50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.225+0000 7f6543e00640 1 --2- 172.21.15.55:0/1874438131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f653c0cef10 0x7f653c1582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.225+0000 7f6543e00640 1 --2- 172.21.15.55:0/1874438131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f653c0b19d0 0x7f653c157db0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.225+0000 7f6543e00640 1 --2- 172.21.15.55:0/1874438131 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f653c06c0d0 0x7f653c150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.225+0000 7f6543e00640 1 -- 172.21.15.55:0/1874438131 >> 172.21.15.55:0/1874438131 conn(0x7f653c0b2150 msgr2=0x7f653c06f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.225+0000 7f6543e00640 1 -- 172.21.15.55:0/1874438131 shutdown_connections 2024-04-02T07:22:12.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.225+0000 7f6543e00640 1 -- 172.21.15.55:0/1874438131 wait complete. 2024-04-02T07:22:12.247 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:22:12.247 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:22:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.385+0000 7f2067c00640 1 Processor -- start 2024-04-02T07:22:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.385+0000 7f2067c00640 1 -- start start 2024-04-02T07:22:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.385+0000 7f2067c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f206015cd50 0x7f20600cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.385+0000 7f2067c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2060099120 0x7f20600b5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.385+0000 7f2067c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f206006c2a0 con 0x7f206006bac0 2024-04-02T07:22:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.389+0000 7f2067c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20600ccb30 con 0x7f2060099120 2024-04-02T07:22:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.389+0000 7f2067c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20600cad60 con 0x7f206015cd50 2024-04-02T07:22:12.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.389+0000 7f205fe00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f206006bac0 0x7f2060098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55918/0 (socket says 172.21.15.55:55918) 2024-04-02T07:22:12.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.389+0000 7f205fe00640 1 -- 172.21.15.55:0/3944112367 learned_addr learned my addr 172.21.15.55:0/3944112367 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:12.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.389+0000 7f2065c00640 1 --2- 172.21.15.55:0/3944112367 >> v2:172.21.15.55:3300/0 conn(0x7f2060099120 0x7f20600b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:12.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.389+0000 7f2065200640 1 --2- 172.21.15.55:0/3944112367 >> v2:172.21.15.106:3300/0 conn(0x7f206015cd50 0x7f20600cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:12.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.389+0000 7f2065c00640 1 -- 172.21.15.55:0/3944112367 >> v2:172.21.15.106:3300/0 conn(0x7f206015cd50 msgr2=0x7f20600cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:12.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.389+0000 7f2065c00640 1 --2- 172.21.15.55:0/3944112367 >> v2:172.21.15.106:3300/0 conn(0x7f206015cd50 0x7f20600cfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.389+0000 7f2065c00640 1 -- 172.21.15.55:0/3944112367 >> v1:172.21.15.55:6789/0 conn(0x7f206006bac0 legacy=0x7f2060098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:12.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.389+0000 7f2065c00640 1 -- 172.21.15.55:0/3944112367 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20600cb040 con 0x7f2060099120 2024-04-02T07:22:12.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.389+0000 7f2065200640 1 --2- 172.21.15.55:0/3944112367 >> v2:172.21.15.106:3300/0 conn(0x7f206015cd50 0x7f20600cfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:12.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.389+0000 7f2065c00640 1 --2- 172.21.15.55:0/3944112367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2060099120 0x7f20600b5880 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f206006e210 tx=0x7f205801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5beee9b154a6c6b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:12.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.389+0000 7f205f400640 1 -- 172.21.15.55:0/3944112367 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20580a5930 con 0x7f2060099120 2024-04-02T07:22:12.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.389+0000 7f205f400640 1 -- 172.21.15.55:0/3944112367 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20580a5a90 con 0x7f2060099120 2024-04-02T07:22:12.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.389+0000 7f205f400640 1 -- 172.21.15.55:0/3944112367 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20580a5e20 con 0x7f2060099120 2024-04-02T07:22:12.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2067c00640 1 -- 172.21.15.55:0/3944112367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2060099120 msgr2=0x7f20600b5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:12.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2067c00640 1 --2- 172.21.15.55:0/3944112367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2060099120 0x7f20600b5880 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f206006e210 tx=0x7f205801c870 comp rx=0 tx=0).stop 2024-04-02T07:22:12.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2067c00640 1 -- 172.21.15.55:0/3944112367 shutdown_connections 2024-04-02T07:22:12.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2067c00640 1 --2- 172.21.15.55:0/3944112367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2060099120 0x7f20600b5880 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2067c00640 1 --2- 172.21.15.55:0/3944112367 >> v2:172.21.15.106:3300/0 conn(0x7f206015cd50 0x7f20600cfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2067c00640 1 -- 172.21.15.55:0/3944112367 >> 172.21.15.55:0/3944112367 conn(0x7f20600b2160 msgr2=0x7f20600b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:12.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2067c00640 1 -- 172.21.15.55:0/3944112367 shutdown_connections 2024-04-02T07:22:12.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2067c00640 1 -- 172.21.15.55:0/3944112367 wait complete. 2024-04-02T07:22:12.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2067c00640 1 Processor -- start 2024-04-02T07:22:12.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2067c00640 1 -- start start 2024-04-02T07:22:12.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2067c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f206006bac0 0x7f20600c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:12.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2067c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2060099120 0x7f206015f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:12.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2067c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f206015cd50 0x7f206013e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:12.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2067c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2060156c30 con 0x7f206006bac0 2024-04-02T07:22:12.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2067c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2060157050 con 0x7f2060099120 2024-04-02T07:22:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2067c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2060155fb0 con 0x7f206015cd50 2024-04-02T07:22:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2065200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f206006bac0 0x7f20600c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2065200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f206006bac0 0x7f20600c41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36068/0 (socket says 172.21.15.55:36068) 2024-04-02T07:22:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2065200640 1 -- 172.21.15.55:0/3745699445 learned_addr learned my addr 172.21.15.55:0/3745699445 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f205fe00640 1 --2- 172.21.15.55:0/3745699445 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2060099120 0x7f206015f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2065200640 1 -- 172.21.15.55:0/3745699445 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f206015cd50 msgr2=0x7f206013e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2065200640 1 --2- 172.21.15.55:0/3745699445 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f206015cd50 0x7f206013e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2065200640 1 -- 172.21.15.55:0/3745699445 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2060099120 msgr2=0x7f206015f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2065200640 1 --2- 172.21.15.55:0/3745699445 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2060099120 0x7f206015f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2065200640 1 -- 172.21.15.55:0/3745699445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2058009a70 con 0x7f206006bac0 2024-04-02T07:22:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f205fe00640 1 --2- 172.21.15.55:0/3745699445 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2060099120 0x7f206015f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.393+0000 7f2065200640 1 --2- 172.21.15.55:0/3745699445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f206006bac0 0x7f20600c41a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f205400d800 tx=0x7f205400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.397+0000 7f205cc00640 1 -- 172.21.15.55:0/3745699445 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20540096c0 con 0x7f206006bac0 2024-04-02T07:22:12.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.397+0000 7f205cc00640 1 -- 172.21.15.55:0/3745699445 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2054009820 con 0x7f206006bac0 2024-04-02T07:22:12.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.397+0000 7f205cc00640 1 -- 172.21.15.55:0/3745699445 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2054009bd0 con 0x7f206006bac0 2024-04-02T07:22:12.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.397+0000 7f2067c00640 1 -- 172.21.15.55:0/3745699445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2060156290 con 0x7f206006bac0 2024-04-02T07:22:12.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.397+0000 7f2067c00640 1 -- 172.21.15.55:0/3745699445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2060156850 con 0x7f206006bac0 2024-04-02T07:22:12.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.397+0000 7f2067c00640 1 -- 172.21.15.55:0/3745699445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2060156ea0 con 0x7f206006bac0 2024-04-02T07:22:12.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.397+0000 7f205cc00640 1 -- 172.21.15.55:0/3745699445 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2054009d30 con 0x7f206006bac0 2024-04-02T07:22:12.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.397+0000 7f205cc00640 1 --2- 172.21.15.55:0/3745699445 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2040066690 0x7f2040068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:12.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.397+0000 7f205cc00640 1 -- 172.21.15.55:0/3745699445 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2054084640 con 0x7f206006bac0 2024-04-02T07:22:12.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.397+0000 7f205fe00640 1 --2- 172.21.15.55:0/3745699445 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2040066690 0x7f2040068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:12.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.401+0000 7f205fe00640 1 --2- 172.21.15.55:0/3745699445 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2040066690 0x7f2040068b50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f20600b5cb0 tx=0x7f204c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:12.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.401+0000 7f205cc00640 1 -- 172.21.15.55:0/3745699445 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2054051c60 con 0x7f206006bac0 2024-04-02T07:22:12.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.561+0000 7f2067c00640 1 -- 172.21.15.55:0/3745699445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f20601569e0 con 0x7f206006bac0 2024-04-02T07:22:12.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.561+0000 7f205cc00640 1 -- 172.21.15.55:0/3745699445 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2054055280 con 0x7f206006bac0 2024-04-02T07:22:12.567 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:22:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.565+0000 7f2067c00640 1 -- 172.21.15.55:0/3745699445 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2040066690 msgr2=0x7f2040068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.565+0000 7f2067c00640 1 --2- 172.21.15.55:0/3745699445 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2040066690 0x7f2040068b50 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f20600b5cb0 tx=0x7f204c009040 comp rx=0 tx=0).stop 2024-04-02T07:22:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.565+0000 7f2067c00640 1 -- 172.21.15.55:0/3745699445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f206006bac0 msgr2=0x7f20600c41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.565+0000 7f2067c00640 1 --2- 172.21.15.55:0/3745699445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f206006bac0 0x7f20600c41a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f205400d800 tx=0x7f205400dcc0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.565+0000 7f2067c00640 1 -- 172.21.15.55:0/3745699445 shutdown_connections 2024-04-02T07:22:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.565+0000 7f2067c00640 1 --2- 172.21.15.55:0/3745699445 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f206015cd50 0x7f206013e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.565+0000 7f2067c00640 1 --2- 172.21.15.55:0/3745699445 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2040066690 0x7f2040068b50 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.565+0000 7f2067c00640 1 --2- 172.21.15.55:0/3745699445 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2060099120 0x7f206015f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.565+0000 7f2067c00640 1 --2- 172.21.15.55:0/3745699445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f206006bac0 0x7f20600c41a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.565+0000 7f2067c00640 1 -- 172.21.15.55:0/3745699445 >> 172.21.15.55:0/3745699445 conn(0x7f20600b2160 msgr2=0x7f206006ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:12.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.565+0000 7f2067c00640 1 -- 172.21.15.55:0/3745699445 shutdown_connections 2024-04-02T07:22:12.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.565+0000 7f2067c00640 1 -- 172.21.15.55:0/3745699445 wait complete. 2024-04-02T07:22:12.588 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:22:12.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.725+0000 7fb1b1600640 1 Processor -- start 2024-04-02T07:22:12.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.725+0000 7fb1b1600640 1 -- start start 2024-04-02T07:22:12.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.725+0000 7fb1b1600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1ac099120 0x7fb1ac099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:12.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.725+0000 7fb1b1600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ac15f250 0x7fb1ac0b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:12.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.725+0000 7fb1b1600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1ac0ad270 con 0x7fb1ac15ee70 2024-04-02T07:22:12.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.725+0000 7fb1b1600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ac0b0840 con 0x7fb1ac099120 2024-04-02T07:22:12.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.725+0000 7fb1b1600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac0cf6a0 con 0x7fb1ac15f250 2024-04-02T07:22:12.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.725+0000 7fb1a3e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1ac099120 0x7fb1ac099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:12.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.725+0000 7fb1a3e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1ac099120 0x7fb1ac099830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36082/0 (socket says 172.21.15.55:36082) 2024-04-02T07:22:12.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.725+0000 7fb1a3e00640 1 -- 172.21.15.55:0/2889812169 learned_addr learned my addr 172.21.15.55:0/2889812169 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:12.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.725+0000 7fb1ab400640 1 --2- 172.21.15.55:0/2889812169 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ac15f250 0x7fb1ac0b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:12.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.725+0000 7fb1a3e00640 1 -- 172.21.15.55:0/2889812169 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ac15f250 msgr2=0x7fb1ac0b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:12.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.725+0000 7fb1a3e00640 1 --2- 172.21.15.55:0/2889812169 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ac15f250 0x7fb1ac0b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.725+0000 7fb1a3e00640 1 -- 172.21.15.55:0/2889812169 >> v1:172.21.15.106:6789/0 conn(0x7fb1ac15ee70 legacy=0x7fb1ac098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:12.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.725+0000 7fb1a3e00640 1 -- 172.21.15.55:0/2889812169 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ac0b0a50 con 0x7fb1ac099120 2024-04-02T07:22:12.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.725+0000 7fb1ab400640 1 --2- 172.21.15.55:0/2889812169 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ac15f250 0x7fb1ac0b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:12.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.729+0000 7fb1a3e00640 1 --2- 172.21.15.55:0/2889812169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ac099120 0x7fb1ac099830 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb194009870 tx=0x7fb19401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d618e8ec22678451 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:12.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.729+0000 7fb1aa000640 1 -- 172.21.15.55:0/2889812169 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1940a9620 con 0x7fb1ac099120 2024-04-02T07:22:12.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.729+0000 7fb1aa000640 1 -- 172.21.15.55:0/2889812169 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1940a9780 con 0x7fb1ac099120 2024-04-02T07:22:12.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.729+0000 7fb1aa000640 1 -- 172.21.15.55:0/2889812169 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1940a9b10 con 0x7fb1ac099120 2024-04-02T07:22:12.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.729+0000 7fb1b1600640 1 -- 172.21.15.55:0/2889812169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ac099120 msgr2=0x7fb1ac099830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:12.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.729+0000 7fb1b1600640 1 --2- 172.21.15.55:0/2889812169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ac099120 0x7fb1ac099830 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb194009870 tx=0x7fb19401c560 comp rx=0 tx=0).stop 2024-04-02T07:22:12.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.729+0000 7fb1b1600640 1 -- 172.21.15.55:0/2889812169 shutdown_connections 2024-04-02T07:22:12.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.729+0000 7fb1b1600640 1 --2- 172.21.15.55:0/2889812169 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ac15f250 0x7fb1ac0b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.729+0000 7fb1b1600640 1 --2- 172.21.15.55:0/2889812169 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ac099120 0x7fb1ac099830 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.729+0000 7fb1b1600640 1 -- 172.21.15.55:0/2889812169 >> 172.21.15.55:0/2889812169 conn(0x7fb1ac0b21d0 msgr2=0x7fb1ac0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:12.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.729+0000 7fb1b1600640 1 -- 172.21.15.55:0/2889812169 shutdown_connections 2024-04-02T07:22:12.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.729+0000 7fb1b1600640 1 -- 172.21.15.55:0/2889812169 wait complete. 2024-04-02T07:22:12.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1b1600640 1 Processor -- start 2024-04-02T07:22:12.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1b1600640 1 -- start start 2024-04-02T07:22:12.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1b1600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ac099120 0x7fb1ac1514e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:12.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1b1600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ac15ee70 0x7fb1ac15c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:12.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1b1600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1ac15f250 0x7fb1ac15cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:12.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1b1600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac151a20 con 0x7fb1ac15ee70 2024-04-02T07:22:12.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1b1600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac15be90 con 0x7fb1ac15f250 2024-04-02T07:22:12.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1b1600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ac15b5f0 con 0x7fb1ac099120 2024-04-02T07:22:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1a3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ac15ee70 0x7fb1ac15c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1a3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ac15ee70 0x7fb1ac15c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36088/0 (socket says 172.21.15.55:36088) 2024-04-02T07:22:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1a3e00640 1 -- 172.21.15.55:0/991919056 learned_addr learned my addr 172.21.15.55:0/991919056 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1ab400640 1 --2- 172.21.15.55:0/991919056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1ac15f250 0x7fb1ac15cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1aaa00640 1 --2- 172.21.15.55:0/991919056 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ac099120 0x7fb1ac1514e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1a3e00640 1 -- 172.21.15.55:0/991919056 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ac099120 msgr2=0x7fb1ac1514e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1a3e00640 1 --2- 172.21.15.55:0/991919056 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ac099120 0x7fb1ac1514e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1a3e00640 1 -- 172.21.15.55:0/991919056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1ac15f250 msgr2=0x7fb1ac15cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1a3e00640 1 --2- 172.21.15.55:0/991919056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1ac15f250 0x7fb1ac15cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1a3e00640 1 -- 172.21.15.55:0/991919056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1940094d0 con 0x7fb1ac15ee70 2024-04-02T07:22:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1a3e00640 1 --2- 172.21.15.55:0/991919056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ac15ee70 0x7fb1ac15c620 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb1940ab040 tx=0x7fb19401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1a2a00640 1 -- 172.21.15.55:0/991919056 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1940bc450 con 0x7fb1ac15ee70 2024-04-02T07:22:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1a2a00640 1 -- 172.21.15.55:0/991919056 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1940bc5b0 con 0x7fb1ac15ee70 2024-04-02T07:22:12.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1a2a00640 1 -- 172.21.15.55:0/991919056 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1940bc960 con 0x7fb1ac15ee70 2024-04-02T07:22:12.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1b1600640 1 -- 172.21.15.55:0/991919056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ac15b8d0 con 0x7fb1ac15ee70 2024-04-02T07:22:12.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.733+0000 7fb1b1600640 1 -- 172.21.15.55:0/991919056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ac163d20 con 0x7fb1ac15ee70 2024-04-02T07:22:12.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.737+0000 7fb1b1600640 1 -- 172.21.15.55:0/991919056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ac163f10 con 0x7fb1ac15ee70 2024-04-02T07:22:12.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.737+0000 7fb1a2a00640 1 -- 172.21.15.55:0/991919056 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb1940bcac0 con 0x7fb1ac15ee70 2024-04-02T07:22:12.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.737+0000 7fb1a2a00640 1 --2- 172.21.15.55:0/991919056 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb188066690 0x7fb188068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:12.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.737+0000 7fb1a2a00640 1 -- 172.21.15.55:0/991919056 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb19411e300 con 0x7fb1ac15ee70 2024-04-02T07:22:12.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.737+0000 7fb1aaa00640 1 --2- 172.21.15.55:0/991919056 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb188066690 0x7fb188068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:12.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.737+0000 7fb1aaa00640 1 --2- 172.21.15.55:0/991919056 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb188066690 0x7fb188068b50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb19c007fd0 tx=0x7fb19c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:12.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.741+0000 7fb1a2a00640 1 -- 172.21.15.55:0/991919056 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fb1940ebaf0 con 0x7fb1ac15ee70 2024-04-02T07:22:12.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.933+0000 7fb1b1600640 1 -- 172.21.15.55:0/991919056 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb1ac066c90 con 0x7fb1ac15ee70 2024-04-02T07:22:12.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.933+0000 7fb1a2a00640 1 -- 172.21.15.55:0/991919056 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1253 (secure 0 0 0) 0x7fb1940ef110 con 0x7fb1ac15ee70 2024-04-02T07:22:12.939 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:12.939 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/342047131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":342047131},{"type":"v1","addr":"172.21.15.55:6833","nonce":342047131}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2024-04-02T07:22:12.939 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 2 2024-04-02T07:22:12.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.937+0000 7fb1b1600640 1 -- 172.21.15.55:0/991919056 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb188066690 msgr2=0x7fb188068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:12.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.937+0000 7fb1b1600640 1 --2- 172.21.15.55:0/991919056 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb188066690 0x7fb188068b50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb19c007fd0 tx=0x7fb19c009040 comp rx=0 tx=0).stop 2024-04-02T07:22:12.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.937+0000 7fb1b1600640 1 -- 172.21.15.55:0/991919056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ac15ee70 msgr2=0x7fb1ac15c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:12.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.937+0000 7fb1b1600640 1 --2- 172.21.15.55:0/991919056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ac15ee70 0x7fb1ac15c620 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb1940ab040 tx=0x7fb19401ada0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.937+0000 7fb1b1600640 1 -- 172.21.15.55:0/991919056 shutdown_connections 2024-04-02T07:22:12.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.937+0000 7fb1b1600640 1 --2- 172.21.15.55:0/991919056 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb188066690 0x7fb188068b50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.937+0000 7fb1b1600640 1 --2- 172.21.15.55:0/991919056 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1ac15f250 0x7fb1ac15cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.937+0000 7fb1b1600640 1 --2- 172.21.15.55:0/991919056 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ac15ee70 0x7fb1ac15c620 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.937+0000 7fb1b1600640 1 --2- 172.21.15.55:0/991919056 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ac099120 0x7fb1ac1514e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:12.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.937+0000 7fb1b1600640 1 -- 172.21.15.55:0/991919056 >> 172.21.15.55:0/991919056 conn(0x7fb1ac0b21d0 msgr2=0x7fb1ac1592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:12.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.937+0000 7fb1b1600640 1 -- 172.21.15.55:0/991919056 shutdown_connections 2024-04-02T07:22:12.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:12.937+0000 7fb1b1600640 1 -- 172.21.15.55:0/991919056 wait complete. 2024-04-02T07:22:13.114 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:22:13.118 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:22:14.960 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:22:15.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.109+0000 7f0de4000640 1 Processor -- start 2024-04-02T07:22:15.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.109+0000 7f0de4000640 1 -- start start 2024-04-02T07:22:15.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.109+0000 7f0de4000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0ddc153ea0 0x7f0ddc0c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:15.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.109+0000 7f0de4000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ddc15a070 0x7f0ddc13d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:15.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.109+0000 7f0de4000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ddc13d0c0 con 0x7f0ddc159be0 2024-04-02T07:22:15.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.109+0000 7f0de4000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ddc15a4f0 con 0x7f0ddc153ea0 2024-04-02T07:22:15.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.109+0000 7f0de4000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc15a7d0 con 0x7f0ddc15a070 2024-04-02T07:22:15.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.109+0000 7f0de2000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ddc15a070 0x7f0ddc13d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:15.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.109+0000 7f0de1600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0ddc153ea0 0x7f0ddc0c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:15.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.109+0000 7f0de1600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0ddc153ea0 0x7f0ddc0c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:38700/0 (socket says 172.21.15.55:38700) 2024-04-02T07:22:15.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.109+0000 7f0de2000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ddc15a070 0x7f0ddc13d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:51920/0 (socket says 172.21.15.55:51920) 2024-04-02T07:22:15.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.109+0000 7f0de1600640 1 -- 172.21.15.55:0/3893810454 learned_addr learned my addr 172.21.15.55:0/3893810454 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:15.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.113+0000 7f0de1600640 1 -- 172.21.15.55:0/3893810454 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ddc15a070 msgr2=0x7f0ddc13d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:15.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.113+0000 7f0de1600640 1 --2- 172.21.15.55:0/3893810454 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ddc15a070 0x7f0ddc13d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.113+0000 7f0de1600640 1 -- 172.21.15.55:0/3893810454 >> v1:172.21.15.106:6789/0 conn(0x7f0ddc159be0 legacy=0x7f0ddc0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:15.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.113+0000 7f0de1600640 1 -- 172.21.15.55:0/3893810454 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ddc15aab0 con 0x7f0ddc153ea0 2024-04-02T07:22:15.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.113+0000 7f0de1600640 1 --2- 172.21.15.55:0/3893810454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ddc153ea0 0x7f0ddc0c4120 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0009870 tx=0x7f0dd001c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8c95c5054745972 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:15.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.113+0000 7f0ddbe00640 1 -- 172.21.15.55:0/3893810454 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd00a9640 con 0x7f0ddc153ea0 2024-04-02T07:22:15.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.113+0000 7f0ddbe00640 1 -- 172.21.15.55:0/3893810454 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dd00a97a0 con 0x7f0ddc153ea0 2024-04-02T07:22:15.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.113+0000 7f0ddbe00640 1 -- 172.21.15.55:0/3893810454 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dd00a9b30 con 0x7f0ddc153ea0 2024-04-02T07:22:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de4000640 1 -- 172.21.15.55:0/3893810454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ddc153ea0 msgr2=0x7f0ddc0c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de4000640 1 --2- 172.21.15.55:0/3893810454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ddc153ea0 0x7f0ddc0c4120 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0dd0009870 tx=0x7f0dd001c560 comp rx=0 tx=0).stop 2024-04-02T07:22:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de4000640 1 -- 172.21.15.55:0/3893810454 shutdown_connections 2024-04-02T07:22:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de4000640 1 --2- 172.21.15.55:0/3893810454 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ddc15a070 0x7f0ddc13d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de4000640 1 --2- 172.21.15.55:0/3893810454 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ddc153ea0 0x7f0ddc0c4120 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de4000640 1 -- 172.21.15.55:0/3893810454 >> 172.21.15.55:0/3893810454 conn(0x7f0ddc066080 msgr2=0x7f0ddc069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de4000640 1 -- 172.21.15.55:0/3893810454 shutdown_connections 2024-04-02T07:22:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de4000640 1 -- 172.21.15.55:0/3893810454 wait complete. 2024-04-02T07:22:15.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de4000640 1 Processor -- start 2024-04-02T07:22:15.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de4000640 1 -- start start 2024-04-02T07:22:15.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de4000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ddc153ea0 0x7f0ddc13f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:15.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de4000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ddc159be0 0x7f0ddc15bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:15.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de4000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ddc15a070 0x7f0ddc14e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:15.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de4000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc142b90 con 0x7f0ddc159be0 2024-04-02T07:22:15.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de4000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc152660 con 0x7f0ddc153ea0 2024-04-02T07:22:15.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de4000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ddc152380 con 0x7f0ddc15a070 2024-04-02T07:22:15.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de0c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ddc159be0 0x7f0ddc15bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:15.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de0c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ddc159be0 0x7f0ddc15bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36090/0 (socket says 172.21.15.55:36090) 2024-04-02T07:22:15.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de0c00640 1 -- 172.21.15.55:0/3518946855 learned_addr learned my addr 172.21.15.55:0/3518946855 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:15.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de1600640 1 --2- 172.21.15.55:0/3518946855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ddc153ea0 0x7f0ddc13f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:15.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de2000640 1 --2- 172.21.15.55:0/3518946855 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ddc15a070 0x7f0ddc14e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:15.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de0c00640 1 -- 172.21.15.55:0/3518946855 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ddc15a070 msgr2=0x7f0ddc14e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:15.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de0c00640 1 --2- 172.21.15.55:0/3518946855 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ddc15a070 0x7f0ddc14e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de0c00640 1 -- 172.21.15.55:0/3518946855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ddc153ea0 msgr2=0x7f0ddc13f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:15.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de0c00640 1 --2- 172.21.15.55:0/3518946855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ddc153ea0 0x7f0ddc13f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.117+0000 7f0de0c00640 1 -- 172.21.15.55:0/3518946855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dd00094d0 con 0x7f0ddc159be0 2024-04-02T07:22:15.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.121+0000 7f0de0c00640 1 --2- 172.21.15.55:0/3518946855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ddc159be0 0x7f0ddc15bfc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0dc800c500 tx=0x7f0dc800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:15.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.121+0000 7f0dd9600640 1 -- 172.21.15.55:0/3518946855 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8005220 con 0x7f0ddc159be0 2024-04-02T07:22:15.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.121+0000 7f0dd9600640 1 -- 172.21.15.55:0/3518946855 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dc8005380 con 0x7f0ddc159be0 2024-04-02T07:22:15.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.121+0000 7f0dd9600640 1 -- 172.21.15.55:0/3518946855 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8007270 con 0x7f0ddc159be0 2024-04-02T07:22:15.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.121+0000 7f0de4000640 1 -- 172.21.15.55:0/3518946855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ddc13ee70 con 0x7f0ddc159be0 2024-04-02T07:22:15.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.121+0000 7f0de4000640 1 -- 172.21.15.55:0/3518946855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ddc13f430 con 0x7f0ddc159be0 2024-04-02T07:22:15.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.121+0000 7f0de4000640 1 -- 172.21.15.55:0/3518946855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ddc066c90 con 0x7f0ddc159be0 2024-04-02T07:22:15.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.121+0000 7f0dd9600640 1 -- 172.21.15.55:0/3518946855 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f0dc80073d0 con 0x7f0ddc159be0 2024-04-02T07:22:15.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.121+0000 7f0dd9600640 1 --2- 172.21.15.55:0/3518946855 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0dbc066690 0x7f0dbc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:15.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.121+0000 7f0dd9600640 1 -- 172.21.15.55:0/3518946855 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0dc8083690 con 0x7f0ddc159be0 2024-04-02T07:22:15.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.121+0000 7f0de1600640 1 --2- 172.21.15.55:0/3518946855 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0dbc066690 0x7f0dbc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:15.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.125+0000 7f0de1600640 1 --2- 172.21.15.55:0/3518946855 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0dbc066690 0x7f0dbc068b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00ae000 tx=0x7f0dd00b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:15.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.125+0000 7f0dd9600640 1 -- 172.21.15.55:0/3518946855 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0dc8050d70 con 0x7f0ddc159be0 2024-04-02T07:22:15.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.321+0000 7f0de4000640 1 -- 172.21.15.55:0/3518946855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ddc13f5f0 con 0x7f0ddc159be0 2024-04-02T07:22:15.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.321+0000 7f0dd9600640 1 -- 172.21.15.55:0/3518946855 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3521 (secure 0 0 0) 0x7f0dc8054390 con 0x7f0ddc159be0 2024-04-02T07:22:15.327 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:15.327 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1468533802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1468533802},{"type":"v1","addr":"172.21.15.106:6837","nonce":1468533802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/342047131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":342047131},{"type":"v1","addr":"172.21.15.55:6833","nonce":342047131}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/50847499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":50847499},{"type":"v1","addr":"172.21.15.55:6835","nonce":50847499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4288,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/3829467285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3829467285},{"type":"v1","addr":"172.21.15.106:6836","nonce":3829467285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2024-04-02T07:22:15.328 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 3 2024-04-02T07:22:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.325+0000 7f0de4000640 1 -- 172.21.15.55:0/3518946855 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0dbc066690 msgr2=0x7f0dbc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.325+0000 7f0de4000640 1 --2- 172.21.15.55:0/3518946855 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0dbc066690 0x7f0dbc068b50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f0dd00ae000 tx=0x7f0dd00b3040 comp rx=0 tx=0).stop 2024-04-02T07:22:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.325+0000 7f0de4000640 1 -- 172.21.15.55:0/3518946855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ddc159be0 msgr2=0x7f0ddc15bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.325+0000 7f0de4000640 1 --2- 172.21.15.55:0/3518946855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ddc159be0 0x7f0ddc15bfc0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0dc800c500 tx=0x7f0dc800c9c0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.325+0000 7f0de4000640 1 -- 172.21.15.55:0/3518946855 shutdown_connections 2024-04-02T07:22:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.325+0000 7f0de4000640 1 --2- 172.21.15.55:0/3518946855 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ddc15a070 0x7f0ddc14e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.325+0000 7f0de4000640 1 --2- 172.21.15.55:0/3518946855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ddc159be0 0x7f0ddc15bfc0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.325+0000 7f0de4000640 1 --2- 172.21.15.55:0/3518946855 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0dbc066690 0x7f0dbc068b50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.325+0000 7f0de4000640 1 --2- 172.21.15.55:0/3518946855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ddc153ea0 0x7f0ddc13f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.325+0000 7f0de4000640 1 -- 172.21.15.55:0/3518946855 >> 172.21.15.55:0/3518946855 conn(0x7f0ddc066080 msgr2=0x7f0ddc0b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:15.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.325+0000 7f0de4000640 1 -- 172.21.15.55:0/3518946855 shutdown_connections 2024-04-02T07:22:15.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.325+0000 7f0de4000640 1 -- 172.21.15.55:0/3518946855 wait complete. 2024-04-02T07:22:15.348 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:15.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.485+0000 7f0e5a200640 1 Processor -- start 2024-04-02T07:22:15.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.485+0000 7f0e5a200640 1 -- start start 2024-04-02T07:22:15.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.485+0000 7f0e5a200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0e540c4120 0x7f0e540b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:15.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.485+0000 7f0e5a200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0e540b36f0 0x7f0e5413d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:15.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.485+0000 7f0e5a200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5413d0c0 con 0x7f0e54153ea0 2024-04-02T07:22:15.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.485+0000 7f0e5a200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e5415a2f0 con 0x7f0e540b36f0 2024-04-02T07:22:15.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.485+0000 7f0e5a200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e540b3b20 con 0x7f0e540c4120 2024-04-02T07:22:15.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.485+0000 7f0e53400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0e54153ea0 0x7f0e54159be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55926/0 (socket says 172.21.15.55:55926) 2024-04-02T07:22:15.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.485+0000 7f0e53400640 1 -- 172.21.15.55:0/1060890020 learned_addr learned my addr 172.21.15.55:0/1060890020 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:15.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.485+0000 7f0e53e00640 1 --2- 172.21.15.55:0/1060890020 >> v2:172.21.15.55:3300/0 conn(0x7f0e540b36f0 0x7f0e5413d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:15.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.485+0000 7f0e4aa00640 1 --2- 172.21.15.55:0/1060890020 >> v2:172.21.15.106:3300/0 conn(0x7f0e540c4120 0x7f0e540b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:15.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.485+0000 7f0e52a00640 1 -- 172.21.15.55:0/1060890020 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2107566467 0 0) 0x7f0e5413d0c0 con 0x7f0e54153ea0 2024-04-02T07:22:15.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.485+0000 7f0e52a00640 1 -- 172.21.15.55:0/1060890020 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e38005740 con 0x7f0e54153ea0 2024-04-02T07:22:15.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.485+0000 7f0e53e00640 1 -- 172.21.15.55:0/1060890020 >> v2:172.21.15.106:3300/0 conn(0x7f0e540c4120 msgr2=0x7f0e540b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:15.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.485+0000 7f0e53e00640 1 --2- 172.21.15.55:0/1060890020 >> v2:172.21.15.106:3300/0 conn(0x7f0e540c4120 0x7f0e540b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.485+0000 7f0e53e00640 1 -- 172.21.15.55:0/1060890020 >> v1:172.21.15.55:6789/0 conn(0x7f0e54153ea0 legacy=0x7f0e54159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:15.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.485+0000 7f0e53e00640 1 -- 172.21.15.55:0/1060890020 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e5415a4f0 con 0x7f0e540b36f0 2024-04-02T07:22:15.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.489+0000 7f0e53e00640 1 --2- 172.21.15.55:0/1060890020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e540b36f0 0x7f0e5413d550 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0e5406d470 tx=0x7f0e4c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=139453ec0fd25bf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:15.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.489+0000 7f0e52a00640 1 -- 172.21.15.55:0/1060890020 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c0a5900 con 0x7f0e540b36f0 2024-04-02T07:22:15.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.489+0000 7f0e52a00640 1 -- 172.21.15.55:0/1060890020 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4c0a5a60 con 0x7f0e540b36f0 2024-04-02T07:22:15.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.489+0000 7f0e52a00640 1 -- 172.21.15.55:0/1060890020 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c0a5df0 con 0x7f0e540b36f0 2024-04-02T07:22:15.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.489+0000 7f0e5a200640 1 -- 172.21.15.55:0/1060890020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e540b36f0 msgr2=0x7f0e5413d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:15.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.489+0000 7f0e5a200640 1 --2- 172.21.15.55:0/1060890020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e540b36f0 0x7f0e5413d550 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f0e5406d470 tx=0x7f0e4c01c930 comp rx=0 tx=0).stop 2024-04-02T07:22:15.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.489+0000 7f0e5a200640 1 -- 172.21.15.55:0/1060890020 shutdown_connections 2024-04-02T07:22:15.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.489+0000 7f0e5a200640 1 --2- 172.21.15.55:0/1060890020 >> v2:172.21.15.106:3300/0 conn(0x7f0e540c4120 0x7f0e540b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.489+0000 7f0e5a200640 1 --2- 172.21.15.55:0/1060890020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e540b36f0 0x7f0e5413d550 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.489+0000 7f0e5a200640 1 -- 172.21.15.55:0/1060890020 >> 172.21.15.55:0/1060890020 conn(0x7f0e54066080 msgr2=0x7f0e54069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:15.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.489+0000 7f0e5a200640 1 -- 172.21.15.55:0/1060890020 shutdown_connections 2024-04-02T07:22:15.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.489+0000 7f0e5a200640 1 -- 172.21.15.55:0/1060890020 wait complete. 2024-04-02T07:22:15.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e5a200640 1 Processor -- start 2024-04-02T07:22:15.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e5a200640 1 -- start start 2024-04-02T07:22:15.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e5a200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e540b36f0 0x7f0e540cbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:15.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e5a200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e540c4120 0x7f0e541383b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:15.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e5a200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e54153ea0 0x7f0e5413bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:15.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e5a200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e541f5c40 con 0x7f0e540c4120 2024-04-02T07:22:15.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e5a200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e541f5030 con 0x7f0e540b36f0 2024-04-02T07:22:15.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e5a200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e541f5310 con 0x7f0e54153ea0 2024-04-02T07:22:15.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e4aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e540c4120 0x7f0e541383b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:15.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e4aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e540c4120 0x7f0e541383b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36112/0 (socket says 172.21.15.55:36112) 2024-04-02T07:22:15.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e4aa00640 1 -- 172.21.15.55:0/1808102444 learned_addr learned my addr 172.21.15.55:0/1808102444 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:15.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e53400640 1 --2- 172.21.15.55:0/1808102444 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e540b36f0 0x7f0e540cbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:15.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e53e00640 1 --2- 172.21.15.55:0/1808102444 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e54153ea0 0x7f0e5413bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:15.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e4aa00640 1 -- 172.21.15.55:0/1808102444 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e54153ea0 msgr2=0x7f0e5413bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:15.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e4aa00640 1 --2- 172.21.15.55:0/1808102444 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e54153ea0 0x7f0e5413bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e4aa00640 1 -- 172.21.15.55:0/1808102444 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e540b36f0 msgr2=0x7f0e540cbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:15.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e4aa00640 1 --2- 172.21.15.55:0/1808102444 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e540b36f0 0x7f0e540cbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e4aa00640 1 -- 172.21.15.55:0/1808102444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4c009a70 con 0x7f0e540c4120 2024-04-02T07:22:15.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e4aa00640 1 --2- 172.21.15.55:0/1808102444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e540c4120 0x7f0e541383b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00e930 tx=0x7f0e3c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:15.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e4be00640 1 -- 172.21.15.55:0/1808102444 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c009690 con 0x7f0e540c4120 2024-04-02T07:22:15.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e4be00640 1 -- 172.21.15.55:0/1808102444 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c00ca00 con 0x7f0e540c4120 2024-04-02T07:22:15.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e5a200640 1 -- 172.21.15.55:0/1808102444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e541f55f0 con 0x7f0e540c4120 2024-04-02T07:22:15.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e4be00640 1 -- 172.21.15.55:0/1808102444 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c00cd70 con 0x7f0e540c4120 2024-04-02T07:22:15.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e5a200640 1 -- 172.21.15.55:0/1808102444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e540cc330 con 0x7f0e540c4120 2024-04-02T07:22:15.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.493+0000 7f0e5a200640 1 -- 172.21.15.55:0/1808102444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e541f82d0 con 0x7f0e540c4120 2024-04-02T07:22:15.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.497+0000 7f0e4be00640 1 -- 172.21.15.55:0/1808102444 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f0e3c013470 con 0x7f0e540c4120 2024-04-02T07:22:15.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.497+0000 7f0e4be00640 1 --2- 172.21.15.55:0/1808102444 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0e30066690 0x7f0e30068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:15.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.497+0000 7f0e4be00640 1 -- 172.21.15.55:0/1808102444 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0e3c084120 con 0x7f0e540c4120 2024-04-02T07:22:15.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.497+0000 7f0e53400640 1 --2- 172.21.15.55:0/1808102444 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0e30066690 0x7f0e30068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:15.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.497+0000 7f0e53400640 1 --2- 172.21.15.55:0/1808102444 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0e30066690 0x7f0e30068b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0e440011f0 tx=0x7f0e44009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:15.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.501+0000 7f0e4be00640 1 -- 172.21.15.55:0/1808102444 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0e541f82d0 con 0x7f0e540c4120 2024-04-02T07:22:15.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.661+0000 7f0e5a200640 1 -- 172.21.15.55:0/1808102444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e541f82d0 con 0x7f0e540c4120 2024-04-02T07:22:15.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.661+0000 7f0e4be00640 1 -- 172.21.15.55:0/1808102444 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f0e541f82d0 con 0x7f0e540c4120 2024-04-02T07:22:15.666 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:15.667 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":16,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:08.683227+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.665+0000 7f0e5a200640 1 -- 172.21.15.55:0/1808102444 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0e30066690 msgr2=0x7f0e30068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.665+0000 7f0e5a200640 1 --2- 172.21.15.55:0/1808102444 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0e30066690 0x7f0e30068b50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0e440011f0 tx=0x7f0e44009040 comp rx=0 tx=0).stop 2024-04-02T07:22:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.665+0000 7f0e5a200640 1 -- 172.21.15.55:0/1808102444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e540c4120 msgr2=0x7f0e541383b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.665+0000 7f0e5a200640 1 --2- 172.21.15.55:0/1808102444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e540c4120 0x7f0e541383b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0e3c00e930 tx=0x7f0e3c00edf0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.665+0000 7f0e5a200640 1 -- 172.21.15.55:0/1808102444 shutdown_connections 2024-04-02T07:22:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.665+0000 7f0e5a200640 1 --2- 172.21.15.55:0/1808102444 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e54153ea0 0x7f0e5413bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.665+0000 7f0e5a200640 1 --2- 172.21.15.55:0/1808102444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e540c4120 0x7f0e541383b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.665+0000 7f0e5a200640 1 --2- 172.21.15.55:0/1808102444 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0e30066690 0x7f0e30068b50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.665+0000 7f0e5a200640 1 --2- 172.21.15.55:0/1808102444 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e540b36f0 0x7f0e540cbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.665+0000 7f0e5a200640 1 -- 172.21.15.55:0/1808102444 >> 172.21.15.55:0/1808102444 conn(0x7f0e54066080 msgr2=0x7f0e5415adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.665+0000 7f0e5a200640 1 -- 172.21.15.55:0/1808102444 shutdown_connections 2024-04-02T07:22:15.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.665+0000 7f0e5a200640 1 -- 172.21.15.55:0/1808102444 wait complete. 2024-04-02T07:22:15.688 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:22:15.689 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:22:15.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.829+0000 7f2eafc00640 1 Processor -- start 2024-04-02T07:22:15.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.829+0000 7f2eafc00640 1 -- start start 2024-04-02T07:22:15.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.829+0000 7f2eafc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2ea815ded0 0x7f2ea80b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:15.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.829+0000 7f2eafc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2ea8099120 0x7f2ea80b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:15.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.829+0000 7f2eafc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ea80b1ae0 con 0x7f2ea8099750 2024-04-02T07:22:15.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.829+0000 7f2eafc00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea80ce240 con 0x7f2ea8099120 2024-04-02T07:22:15.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.829+0000 7f2eafc00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ea815e2b0 con 0x7f2ea815ded0 2024-04-02T07:22:15.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.829+0000 7f2eadc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2ea8099120 0x7f2ea80b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:15.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.829+0000 7f2eadc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2ea8099120 0x7f2ea80b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51366/0 (socket says 172.21.15.55:51366) 2024-04-02T07:22:15.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.829+0000 7f2eadc00640 1 -- 172.21.15.55:0/1401910015 learned_addr learned my addr 172.21.15.55:0/1401910015 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:15.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.829+0000 7f2ead200640 1 --2- 172.21.15.55:0/1401910015 >> v2:172.21.15.106:3300/0 conn(0x7f2ea815ded0 0x7f2ea80b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:15.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.829+0000 7f2eadc00640 1 -- 172.21.15.55:0/1401910015 >> v2:172.21.15.106:3300/0 conn(0x7f2ea815ded0 msgr2=0x7f2ea80b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:15.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.829+0000 7f2eadc00640 1 --2- 172.21.15.55:0/1401910015 >> v2:172.21.15.106:3300/0 conn(0x7f2ea815ded0 0x7f2ea80b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.829+0000 7f2eadc00640 1 -- 172.21.15.55:0/1401910015 >> v1:172.21.15.106:6789/0 conn(0x7f2ea8099750 legacy=0x7f2ea8098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:15.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.829+0000 7f2eadc00640 1 -- 172.21.15.55:0/1401910015 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea80cbf30 con 0x7f2ea8099120 2024-04-02T07:22:15.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.833+0000 7f2eadc00640 1 --2- 172.21.15.55:0/1401910015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea8099120 0x7f2ea80b34c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8070d00 tx=0x7f2ea001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311908c600ba90e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:15.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.833+0000 7f2ea7e00640 1 -- 172.21.15.55:0/1401910015 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00a56c0 con 0x7f2ea8099120 2024-04-02T07:22:15.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.833+0000 7f2ea7e00640 1 -- 172.21.15.55:0/1401910015 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ea00a5820 con 0x7f2ea8099120 2024-04-02T07:22:15.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.833+0000 7f2ea7e00640 1 -- 172.21.15.55:0/1401910015 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ea00a5bb0 con 0x7f2ea8099120 2024-04-02T07:22:15.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.833+0000 7f2eafc00640 1 -- 172.21.15.55:0/1401910015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea8099120 msgr2=0x7f2ea80b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:15.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.833+0000 7f2eafc00640 1 --2- 172.21.15.55:0/1401910015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea8099120 0x7f2ea80b34c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2ea8070d00 tx=0x7f2ea001c9f0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.833+0000 7f2eafc00640 1 -- 172.21.15.55:0/1401910015 shutdown_connections 2024-04-02T07:22:15.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.833+0000 7f2eafc00640 1 --2- 172.21.15.55:0/1401910015 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea8099120 0x7f2ea80b34c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.833+0000 7f2eafc00640 1 --2- 172.21.15.55:0/1401910015 >> v2:172.21.15.106:3300/0 conn(0x7f2ea815ded0 0x7f2ea80b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.833+0000 7f2eafc00640 1 -- 172.21.15.55:0/1401910015 >> 172.21.15.55:0/1401910015 conn(0x7f2ea80b2160 msgr2=0x7f2ea80b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:15.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.833+0000 7f2eafc00640 1 -- 172.21.15.55:0/1401910015 shutdown_connections 2024-04-02T07:22:15.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.833+0000 7f2eafc00640 1 -- 172.21.15.55:0/1401910015 wait complete. 2024-04-02T07:22:15.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2eafc00640 1 Processor -- start 2024-04-02T07:22:15.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2eafc00640 1 -- start start 2024-04-02T07:22:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2eafc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2ea8099120 0x7f2ea81f4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2eafc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea8099750 0x7f2ea8158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2eafc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ea815ded0 0x7f2ea8155fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2eafc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea80c7740 con 0x7f2ea8099750 2024-04-02T07:22:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2eafc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea806b190 con 0x7f2ea815ded0 2024-04-02T07:22:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2eafc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea806ae60 con 0x7f2ea8099120 2024-04-02T07:22:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2e9fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea8099750 0x7f2ea8158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2e9fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea8099750 0x7f2ea8158ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51376/0 (socket says 172.21.15.55:51376) 2024-04-02T07:22:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2e9fe00640 1 -- 172.21.15.55:0/560193283 learned_addr learned my addr 172.21.15.55:0/560193283 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2ead200640 1 --2- 172.21.15.55:0/560193283 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2ea8099120 0x7f2ea81f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2eadc00640 1 --2- 172.21.15.55:0/560193283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ea815ded0 0x7f2ea8155fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2e9fe00640 1 -- 172.21.15.55:0/560193283 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2ea8099120 msgr2=0x7f2ea81f4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2e9fe00640 1 --2- 172.21.15.55:0/560193283 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2ea8099120 0x7f2ea81f4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2e9fe00640 1 -- 172.21.15.55:0/560193283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ea815ded0 msgr2=0x7f2ea8155fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2e9fe00640 1 --2- 172.21.15.55:0/560193283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ea815ded0 0x7f2ea8155fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2e9fe00640 1 -- 172.21.15.55:0/560193283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea0009b30 con 0x7f2ea8099750 2024-04-02T07:22:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2e9fe00640 1 --2- 172.21.15.55:0/560193283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea8099750 0x7f2ea8158ee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000c500 tx=0x7f2e9000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2ea5600640 1 -- 172.21.15.55:0/560193283 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90005220 con 0x7f2ea8099750 2024-04-02T07:22:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2ea5600640 1 -- 172.21.15.55:0/560193283 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e90005380 con 0x7f2ea8099750 2024-04-02T07:22:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2ea5600640 1 -- 172.21.15.55:0/560193283 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e90007270 con 0x7f2ea8099750 2024-04-02T07:22:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2eafc00640 1 -- 172.21.15.55:0/560193283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea815d010 con 0x7f2ea8099750 2024-04-02T07:22:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2eafc00640 1 -- 172.21.15.55:0/560193283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea815d5d0 con 0x7f2ea8099750 2024-04-02T07:22:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.837+0000 7f2eafc00640 1 -- 172.21.15.55:0/560193283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea8066c90 con 0x7f2ea8099750 2024-04-02T07:22:15.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.841+0000 7f2ea5600640 1 -- 172.21.15.55:0/560193283 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2e900073d0 con 0x7f2ea8099750 2024-04-02T07:22:15.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.841+0000 7f2ea5600640 1 --2- 172.21.15.55:0/560193283 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2e84066690 0x7f2e84068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:15.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.841+0000 7f2ea5600640 1 -- 172.21.15.55:0/560193283 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2e900836a0 con 0x7f2ea8099750 2024-04-02T07:22:15.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.841+0000 7f2ead200640 1 --2- 172.21.15.55:0/560193283 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2e84066690 0x7f2e84068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.841+0000 7f2ead200640 1 --2- 172.21.15.55:0/560193283 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2e84066690 0x7f2e84068b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009ac0 tx=0x7f2e98009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:15.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:15.845+0000 7f2ea5600640 1 -- 172.21.15.55:0/560193283 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2e90050d80 con 0x7f2ea8099750 2024-04-02T07:22:16.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.005+0000 7f2eafc00640 1 -- 172.21.15.55:0/560193283 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2ea80b2f60 con 0x7f2ea8099750 2024-04-02T07:22:16.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.005+0000 7f2ea5600640 1 -- 172.21.15.55:0/560193283 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2e900543a0 con 0x7f2ea8099750 2024-04-02T07:22:16.008 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:22:16.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.005+0000 7f2eafc00640 1 -- 172.21.15.55:0/560193283 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2e84066690 msgr2=0x7f2e84068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:16.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.005+0000 7f2eafc00640 1 --2- 172.21.15.55:0/560193283 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2e84066690 0x7f2e84068b50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009ac0 tx=0x7f2e98009190 comp rx=0 tx=0).stop 2024-04-02T07:22:16.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.005+0000 7f2eafc00640 1 -- 172.21.15.55:0/560193283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea8099750 msgr2=0x7f2ea8158ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:16.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.005+0000 7f2eafc00640 1 --2- 172.21.15.55:0/560193283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea8099750 0x7f2ea8158ee0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2e9000c500 tx=0x7f2e9000c9c0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.005+0000 7f2eafc00640 1 -- 172.21.15.55:0/560193283 shutdown_connections 2024-04-02T07:22:16.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.005+0000 7f2eafc00640 1 --2- 172.21.15.55:0/560193283 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2e84066690 0x7f2e84068b50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.005+0000 7f2eafc00640 1 --2- 172.21.15.55:0/560193283 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2ea815ded0 0x7f2ea8155fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.005+0000 7f2eafc00640 1 --2- 172.21.15.55:0/560193283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2ea8099750 0x7f2ea8158ee0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.005+0000 7f2eafc00640 1 --2- 172.21.15.55:0/560193283 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2ea8099120 0x7f2ea81f4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.005+0000 7f2eafc00640 1 -- 172.21.15.55:0/560193283 >> 172.21.15.55:0/560193283 conn(0x7f2ea80b2160 msgr2=0x7f2ea80cb240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:16.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.005+0000 7f2eafc00640 1 -- 172.21.15.55:0/560193283 shutdown_connections 2024-04-02T07:22:16.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.005+0000 7f2eafc00640 1 -- 172.21.15.55:0/560193283 wait complete. 2024-04-02T07:22:16.029 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-02T07:22:16.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.165+0000 7f724d800640 1 Processor -- start 2024-04-02T07:22:16.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.165+0000 7f724d800640 1 -- start start 2024-04-02T07:22:16.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.165+0000 7f724d800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f724815ca70 0x7f72480b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:16.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.165+0000 7f724d800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7248098a10 0x7f7248098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:16.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.165+0000 7f724d800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72480993b0 con 0x7f724806aff0 2024-04-02T07:22:16.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.165+0000 7f724d800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f724815ce50 con 0x7f7248098a10 2024-04-02T07:22:16.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.165+0000 7f724d800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72480cef60 con 0x7f724815ca70 2024-04-02T07:22:16.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.165+0000 7f723e000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7248098a10 0x7f7248098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:16.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.165+0000 7f7246a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f724815ca70 0x7f72480b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:16.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.165+0000 7f7247400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f724806aff0 0x7f724806b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:53030/0 (socket says 172.21.15.55:53030) 2024-04-02T07:22:16.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.165+0000 7f723e000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7248098a10 0x7f7248098e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:35952/0 (socket says 172.21.15.55:35952) 2024-04-02T07:22:16.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.165+0000 7f7247400640 1 -- 172.21.15.55:0/1630539165 learned_addr learned my addr 172.21.15.55:0/1630539165 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:16.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.165+0000 7f7246a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f724815ca70 0x7f72480b0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:47954/0 (socket says 172.21.15.55:47954) 2024-04-02T07:22:16.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.165+0000 7f7246000640 1 -- 172.21.15.55:0/1630539165 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2081542824 0 0) 0x7f72480993b0 con 0x7f724806aff0 2024-04-02T07:22:16.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.165+0000 7f7246000640 1 -- 172.21.15.55:0/1630539165 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f722c003530 con 0x7f724806aff0 2024-04-02T07:22:16.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.165+0000 7f723e000640 1 -- 172.21.15.55:0/1630539165 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f724815ca70 msgr2=0x7f72480b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:16.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.165+0000 7f723e000640 1 --2- 172.21.15.55:0/1630539165 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f724815ca70 0x7f72480b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.165+0000 7f723e000640 1 -- 172.21.15.55:0/1630539165 >> v1:172.21.15.106:6789/0 conn(0x7f724806aff0 legacy=0x7f724806b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:16.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.165+0000 7f723e000640 1 -- 172.21.15.55:0/1630539165 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f724806bd60 con 0x7f7248098a10 2024-04-02T07:22:16.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.165+0000 7f7246a00640 1 --2- 172.21.15.55:0/1630539165 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f724815ca70 0x7f72480b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:16.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.169+0000 7f723e000640 1 --2- 172.21.15.55:0/1630539165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7248098a10 0x7f7248098e70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f72300097c0 tx=0x7f723001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0c81329dba77f33 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.169+0000 7f7246000640 1 -- 172.21.15.55:0/1630539165 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72300ad640 con 0x7f7248098a10 2024-04-02T07:22:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.169+0000 7f7246000640 1 -- 172.21.15.55:0/1630539165 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72300ad7a0 con 0x7f7248098a10 2024-04-02T07:22:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.169+0000 7f7246000640 1 -- 172.21.15.55:0/1630539165 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72300adb30 con 0x7f7248098a10 2024-04-02T07:22:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.169+0000 7f724d800640 1 -- 172.21.15.55:0/1630539165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7248098a10 msgr2=0x7f7248098e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:16.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.169+0000 7f724d800640 1 --2- 172.21.15.55:0/1630539165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7248098a10 0x7f7248098e70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f72300097c0 tx=0x7f723001c4a0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.169+0000 7f724d800640 1 -- 172.21.15.55:0/1630539165 shutdown_connections 2024-04-02T07:22:16.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.169+0000 7f724d800640 1 --2- 172.21.15.55:0/1630539165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7248098a10 0x7f7248098e70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.169+0000 7f724d800640 1 --2- 172.21.15.55:0/1630539165 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f724815ca70 0x7f72480b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.169+0000 7f724d800640 1 -- 172.21.15.55:0/1630539165 >> 172.21.15.55:0/1630539165 conn(0x7f72480b21d0 msgr2=0x7f72480b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:16.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.169+0000 7f724d800640 1 -- 172.21.15.55:0/1630539165 shutdown_connections 2024-04-02T07:22:16.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.169+0000 7f724d800640 1 -- 172.21.15.55:0/1630539165 wait complete. 2024-04-02T07:22:16.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f724d800640 1 Processor -- start 2024-04-02T07:22:16.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f724d800640 1 -- start start 2024-04-02T07:22:16.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f724d800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f724806aff0 0x7f7248154540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:16.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f724d800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7248098a10 0x7f72481529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:16.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f724d800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f724815ca70 0x7f724806f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:16.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f724d800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724815b9d0 con 0x7f724815ca70 2024-04-02T07:22:16.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f724d800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f724815aee0 con 0x7f724806aff0 2024-04-02T07:22:16.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f724d800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f724815b130 con 0x7f7248098a10 2024-04-02T07:22:16.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f7247400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f724815ca70 0x7f724806f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:16.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f7247400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f724815ca70 0x7f724806f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51386/0 (socket says 172.21.15.55:51386) 2024-04-02T07:22:16.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f7247400640 1 -- 172.21.15.55:0/3087837963 learned_addr learned my addr 172.21.15.55:0/3087837963 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:16.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f723e000640 1 --2- 172.21.15.55:0/3087837963 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7248098a10 0x7f72481529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:16.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f7246a00640 1 --2- 172.21.15.55:0/3087837963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f724806aff0 0x7f7248154540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:16.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f7247400640 1 -- 172.21.15.55:0/3087837963 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7248098a10 msgr2=0x7f72481529d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:16.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f7247400640 1 --2- 172.21.15.55:0/3087837963 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7248098a10 0x7f72481529d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f7247400640 1 -- 172.21.15.55:0/3087837963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f724806aff0 msgr2=0x7f7248154540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:16.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f7247400640 1 --2- 172.21.15.55:0/3087837963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f724806aff0 0x7f7248154540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f7247400640 1 -- 172.21.15.55:0/3087837963 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7238009420 con 0x7f724815ca70 2024-04-02T07:22:16.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f7247400640 1 --2- 172.21.15.55:0/3087837963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f724815ca70 0x7f724806f370 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f724000caa0 tx=0x7f724000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:16.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f723f400640 1 -- 172.21.15.55:0/3087837963 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724000ac00 con 0x7f724815ca70 2024-04-02T07:22:16.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f723f400640 1 -- 172.21.15.55:0/3087837963 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724000ad60 con 0x7f724815ca70 2024-04-02T07:22:16.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f724d800640 1 -- 172.21.15.55:0/3087837963 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7230009420 con 0x7f724815ca70 2024-04-02T07:22:16.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f723f400640 1 -- 172.21.15.55:0/3087837963 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7240012620 con 0x7f724815ca70 2024-04-02T07:22:16.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.173+0000 7f724d800640 1 -- 172.21.15.55:0/3087837963 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f724815b6f0 con 0x7f724815ca70 2024-04-02T07:22:16.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.177+0000 7f724d800640 1 -- 172.21.15.55:0/3087837963 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7248066c90 con 0x7f724815ca70 2024-04-02T07:22:16.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.177+0000 7f723f400640 1 -- 172.21.15.55:0/3087837963 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7240007070 con 0x7f724815ca70 2024-04-02T07:22:16.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.177+0000 7f723f400640 1 --2- 172.21.15.55:0/3087837963 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f72240666c0 0x7f7224068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:16.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.177+0000 7f723f400640 1 -- 172.21.15.55:0/3087837963 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7240083d10 con 0x7f724815ca70 2024-04-02T07:22:16.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.177+0000 7f7246a00640 1 --2- 172.21.15.55:0/3087837963 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f72240666c0 0x7f7224068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:16.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.177+0000 7f7246a00640 1 --2- 172.21.15.55:0/3087837963 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f72240666c0 0x7f7224068b80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f72480af700 tx=0x7f7238009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:16.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.181+0000 7f723f400640 1 -- 172.21.15.55:0/3087837963 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7240089020 con 0x7f724815ca70 2024-04-02T07:22:16.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.345+0000 7f724d800640 1 -- 172.21.15.55:0/3087837963 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f72480b6660 con 0x7f724815ca70 2024-04-02T07:22:16.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.345+0000 7f723f400640 1 -- 172.21.15.55:0/3087837963 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f7240051470 con 0x7f724815ca70 2024-04-02T07:22:16.349 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:16.349 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-02T07:22:16.349 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:22:16.349 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-04-02T07:22:16.349 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-04-02T07:22:16.349 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:22:16.350 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-02T07:22:16.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.345+0000 7f724d800640 1 -- 172.21.15.55:0/3087837963 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f72240666c0 msgr2=0x7f7224068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:16.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.345+0000 7f724d800640 1 --2- 172.21.15.55:0/3087837963 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f72240666c0 0x7f7224068b80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f72480af700 tx=0x7f7238009190 comp rx=0 tx=0).stop 2024-04-02T07:22:16.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.345+0000 7f724d800640 1 -- 172.21.15.55:0/3087837963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f724815ca70 msgr2=0x7f724806f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:16.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.345+0000 7f724d800640 1 --2- 172.21.15.55:0/3087837963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f724815ca70 0x7f724806f370 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f724000caa0 tx=0x7f724000cf60 comp rx=0 tx=0).stop 2024-04-02T07:22:16.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.349+0000 7f724d800640 1 -- 172.21.15.55:0/3087837963 shutdown_connections 2024-04-02T07:22:16.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.349+0000 7f724d800640 1 --2- 172.21.15.55:0/3087837963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f724815ca70 0x7f724806f370 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.349+0000 7f724d800640 1 --2- 172.21.15.55:0/3087837963 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7248098a10 0x7f72481529d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.349+0000 7f724d800640 1 --2- 172.21.15.55:0/3087837963 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f72240666c0 0x7f7224068b80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.349+0000 7f724d800640 1 --2- 172.21.15.55:0/3087837963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f724806aff0 0x7f7248154540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.349+0000 7f724d800640 1 -- 172.21.15.55:0/3087837963 >> 172.21.15.55:0/3087837963 conn(0x7f72480b21d0 msgr2=0x7f7248159160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:16.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.349+0000 7f724d800640 1 -- 172.21.15.55:0/3087837963 shutdown_connections 2024-04-02T07:22:16.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.349+0000 7f724d800640 1 -- 172.21.15.55:0/3087837963 wait complete. 2024-04-02T07:22:16.370 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-02T07:22:16.371 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-02T07:22:16.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.509+0000 7f780fe00640 1 Processor -- start 2024-04-02T07:22:16.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.509+0000 7f780fe00640 1 -- start start 2024-04-02T07:22:16.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f780fe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78080afe70 0x7f78080b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f780fe00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78080b1d60 con 0x7f780815ce40 2024-04-02T07:22:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f780fe00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780806c400 con 0x7f780806d1c0 2024-04-02T07:22:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f780fe00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780806cda0 con 0x7f78080afe70 2024-04-02T07:22:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f780d400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f780815ce40 0x7f78080b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57234/0 (socket says 172.21.15.55:57234) 2024-04-02T07:22:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f780d400640 1 -- 172.21.15.55:0/3290658911 learned_addr learned my addr 172.21.15.55:0/3290658911 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f780de00640 1 --2- 172.21.15.55:0/3290658911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78080afe70 0x7f78080b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f7807e00640 1 -- 172.21.15.55:0/3290658911 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3087721695 0 0) 0x7f78080b1d60 con 0x7f780815ce40 2024-04-02T07:22:16.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f7807e00640 1 -- 172.21.15.55:0/3290658911 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f77f0005740 con 0x7f780815ce40 2024-04-02T07:22:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f7807e00640 1 -- 172.21.15.55:0/3290658911 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1209450800 0 0) 0x7f780806c400 con 0x7f780806d1c0 2024-04-02T07:22:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f7807e00640 1 -- 172.21.15.55:0/3290658911 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f78080b1d60 con 0x7f780806d1c0 2024-04-02T07:22:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f7807e00640 1 -- 172.21.15.55:0/3290658911 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 993680048 0 0) 0x7f77f0005740 con 0x7f780815ce40 2024-04-02T07:22:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f7807e00640 1 -- 172.21.15.55:0/3290658911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78080afe70 msgr2=0x7f78080b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f7807e00640 1 --2- 172.21.15.55:0/3290658911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78080afe70 0x7f78080b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f7807e00640 1 -- 172.21.15.55:0/3290658911 >> v1:172.21.15.106:6789/0 conn(0x7f780806d1c0 legacy=0x7f78080c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f7807e00640 1 -- 172.21.15.55:0/3290658911 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780806c6e0 con 0x7f780815ce40 2024-04-02T07:22:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f7807e00640 1 -- 172.21.15.55:0/3290658911 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f77fc0016a0 con 0x7f780815ce40 2024-04-02T07:22:16.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f780de00640 1 --2- 172.21.15.55:0/3290658911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78080afe70 0x7f78080b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:16.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f7807e00640 1 -- 172.21.15.55:0/3290658911 >> v1:172.21.15.55:6789/0 conn(0x7f780815ce40 legacy=0x7f78080b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:16.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f7807e00640 1 --2- 172.21.15.55:0/3290658911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77f0005d50 0x7f77f0006150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:16.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f7807e00640 1 --2- 172.21.15.55:0/3290658911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f00069e0 0x7f77f0006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:16.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f7807e00640 1 --2- 172.21.15.55:0/3290658911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78080afe70 0x7f77f00073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:16.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f7807e00640 1 -- 172.21.15.55:0/3290658911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780806cda0 con 0x7f77f00069e0 2024-04-02T07:22:16.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f7807e00640 1 -- 172.21.15.55:0/3290658911 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77f000dc80 con 0x7f77f0005d50 2024-04-02T07:22:16.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f7807e00640 1 -- 172.21.15.55:0/3290658911 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77f000de40 con 0x7f78080afe70 2024-04-02T07:22:16.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f780ca00640 1 --2- 172.21.15.55:0/3290658911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f00069e0 0x7f77f0006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:16.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f780de00640 1 --2- 172.21.15.55:0/3290658911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78080afe70 0x7f77f00073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:16.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f780d400640 1 --2- 172.21.15.55:0/3290658911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77f0005d50 0x7f77f0006150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:16.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f780ca00640 1 -- 172.21.15.55:0/3290658911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78080afe70 msgr2=0x7f77f00073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:16.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f780ca00640 1 --2- 172.21.15.55:0/3290658911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78080afe70 0x7f77f00073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f780ca00640 1 -- 172.21.15.55:0/3290658911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77f0005d50 msgr2=0x7f77f0006150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:16.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f780ca00640 1 --2- 172.21.15.55:0/3290658911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77f0005d50 0x7f77f0006150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.513+0000 7f780ca00640 1 -- 172.21.15.55:0/3290658911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7800009a70 con 0x7f77f00069e0 2024-04-02T07:22:16.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.517+0000 7f780ca00640 1 --2- 172.21.15.55:0/3290658911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f00069e0 0x7f77f0006e60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f77f4007fd0 tx=0x7f77f401c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb2ec03ee80b37c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:16.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.517+0000 7f7807e00640 1 -- 172.21.15.55:0/3290658911 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f40052d0 con 0x7f77f00069e0 2024-04-02T07:22:16.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.517+0000 7f7807e00640 1 -- 172.21.15.55:0/3290658911 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f40a7050 con 0x7f77f00069e0 2024-04-02T07:22:16.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.517+0000 7f7807e00640 1 -- 172.21.15.55:0/3290658911 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f4003600 con 0x7f77f00069e0 2024-04-02T07:22:16.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.517+0000 7f780fe00640 1 -- 172.21.15.55:0/3290658911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f00069e0 msgr2=0x7f77f0006e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:16.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.517+0000 7f780fe00640 1 --2- 172.21.15.55:0/3290658911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f77f00069e0 0x7f77f0006e60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f77f4007fd0 tx=0x7f77f401c540 comp rx=0 tx=0).stop 2024-04-02T07:22:16.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.517+0000 7f780de00640 1 -- 172.21.15.55:0/3290658911 reap_dead start 2024-04-02T07:22:16.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.517+0000 7f780fe00640 1 -- 172.21.15.55:0/3290658911 shutdown_connections 2024-04-02T07:22:16.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.517+0000 7f780fe00640 1 -- 172.21.15.55:0/3290658911 >> 172.21.15.55:0/3290658911 conn(0x7f7808069d90 msgr2=0x7f780806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:16.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.517+0000 7f780fe00640 1 -- 172.21.15.55:0/3290658911 shutdown_connections 2024-04-02T07:22:16.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.517+0000 7f780fe00640 1 -- 172.21.15.55:0/3290658911 wait complete. 2024-04-02T07:22:16.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.517+0000 7f780fe00640 1 Processor -- start 2024-04-02T07:22:16.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.517+0000 7f780fe00640 1 -- start start 2024-04-02T07:22:16.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f780fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77f00069e0 0x7f7808154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:16.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f780fe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7808153940 0x7f78081503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:16.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f780fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78081497c0 0x7f7808155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:16.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f780fe00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7808150920 con 0x7f78081497c0 2024-04-02T07:22:16.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f780fe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780814a290 con 0x7f77f00069e0 2024-04-02T07:22:16.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f780fe00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7808153de0 con 0x7f7808153940 2024-04-02T07:22:16.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f780de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78081497c0 0x7f7808155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:16.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f780de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78081497c0 0x7f7808155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51400/0 (socket says 172.21.15.55:51400) 2024-04-02T07:22:16.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f780de00640 1 -- 172.21.15.55:0/3511714720 learned_addr learned my addr 172.21.15.55:0/3511714720 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:16.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f780ca00640 1 --2- 172.21.15.55:0/3511714720 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7808153940 0x7f78081503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:16.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f780de00640 1 -- 172.21.15.55:0/3511714720 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7808153940 msgr2=0x7f78081503e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:16.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f780de00640 1 --2- 172.21.15.55:0/3511714720 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7808153940 0x7f78081503e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f780de00640 1 -- 172.21.15.55:0/3511714720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77f00069e0 msgr2=0x7f7808154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:16.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f780de00640 1 --2- 172.21.15.55:0/3511714720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77f00069e0 0x7f7808154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f780de00640 1 -- 172.21.15.55:0/3511714720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78080c9ff0 con 0x7f78081497c0 2024-04-02T07:22:16.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f780de00640 1 --2- 172.21.15.55:0/3511714720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78081497c0 0x7f7808155c00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7808071790 tx=0x7f780000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:16.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f7805600640 1 -- 172.21.15.55:0/3511714720 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780001c070 con 0x7f78081497c0 2024-04-02T07:22:16.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f7805600640 1 -- 172.21.15.55:0/3511714720 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f780000f040 con 0x7f78081497c0 2024-04-02T07:22:16.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f7805600640 1 -- 172.21.15.55:0/3511714720 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f780000e040 con 0x7f78081497c0 2024-04-02T07:22:16.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f780fe00640 1 -- 172.21.15.55:0/3511714720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78081540c0 con 0x7f78081497c0 2024-04-02T07:22:16.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f780fe00640 1 -- 172.21.15.55:0/3511714720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7808154680 con 0x7f78081497c0 2024-04-02T07:22:16.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f780fe00640 1 -- 172.21.15.55:0/3511714720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f780806e270 con 0x7f78081497c0 2024-04-02T07:22:16.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.521+0000 7f7805600640 1 -- 172.21.15.55:0/3511714720 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7800015430 con 0x7f78081497c0 2024-04-02T07:22:16.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.525+0000 7f7805600640 1 --2- 172.21.15.55:0/3511714720 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f77e80666c0 0x7f77e8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:16.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.525+0000 7f7805600640 1 -- 172.21.15.55:0/3511714720 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7800084150 con 0x7f78081497c0 2024-04-02T07:22:16.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.525+0000 7f780d400640 1 --2- 172.21.15.55:0/3511714720 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f77e80666c0 0x7f77e8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:16.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.525+0000 7f780d400640 1 --2- 172.21.15.55:0/3511714720 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f77e80666c0 0x7f77e8068b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0017d0 tx=0x7f77fc001640 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:16.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.529+0000 7f7805600640 1 -- 172.21.15.55:0/3511714720 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7800051770 con 0x7f78081497c0 2024-04-02T07:22:16.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.689+0000 7f780fe00640 1 -- 172.21.15.55:0/3511714720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f7808066c90 con 0x7f78081497c0 2024-04-02T07:22:16.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.789+0000 7f7805600640 1 -- 172.21.15.55:0/3511714720 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f7800054d90 con 0x7f78081497c0 2024-04-02T07:22:16.792 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-04-02T07:22:16.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.793+0000 7f780fe00640 1 -- 172.21.15.55:0/3511714720 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f77e80666c0 msgr2=0x7f77e8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:16.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.793+0000 7f780fe00640 1 --2- 172.21.15.55:0/3511714720 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f77e80666c0 0x7f77e8068b80 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f77fc0017d0 tx=0x7f77fc001640 comp rx=0 tx=0).stop 2024-04-02T07:22:16.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.793+0000 7f780fe00640 1 -- 172.21.15.55:0/3511714720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78081497c0 msgr2=0x7f7808155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:16.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.793+0000 7f780fe00640 1 --2- 172.21.15.55:0/3511714720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78081497c0 0x7f7808155c00 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7808071790 tx=0x7f780000f580 comp rx=0 tx=0).stop 2024-04-02T07:22:16.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.793+0000 7f780fe00640 1 -- 172.21.15.55:0/3511714720 shutdown_connections 2024-04-02T07:22:16.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.793+0000 7f780fe00640 1 --2- 172.21.15.55:0/3511714720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78081497c0 0x7f7808155c00 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.793+0000 7f780fe00640 1 --2- 172.21.15.55:0/3511714720 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7808153940 0x7f78081503e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.793+0000 7f780fe00640 1 --2- 172.21.15.55:0/3511714720 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f77e80666c0 0x7f77e8068b80 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.793+0000 7f780fe00640 1 --2- 172.21.15.55:0/3511714720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f77f00069e0 0x7f7808154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.793+0000 7f780fe00640 1 -- 172.21.15.55:0/3511714720 >> 172.21.15.55:0/3511714720 conn(0x7f7808069d90 msgr2=0x7f78080cc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.793+0000 7f780fe00640 1 -- 172.21.15.55:0/3511714720 shutdown_connections 2024-04-02T07:22:16.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.793+0000 7f780fe00640 1 -- 172.21.15.55:0/3511714720 wait complete. 2024-04-02T07:22:16.820 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-02T07:22:16.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.961+0000 7f9c25600640 1 Processor -- start 2024-04-02T07:22:16.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.961+0000 7f9c25600640 1 -- start start 2024-04-02T07:22:16.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.965+0000 7f9c25600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9c2015a980 0x7f9c200d03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:16.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.965+0000 7f9c25600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9c200cb930 0x7f9c200b0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:16.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.965+0000 7f9c25600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c200ce6c0 con 0x7f9c200d0900 2024-04-02T07:22:16.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.965+0000 7f9c25600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c200cc7a0 con 0x7f9c200cb930 2024-04-02T07:22:16.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.965+0000 7f9c25600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c200d0d90 con 0x7f9c2015a980 2024-04-02T07:22:16.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.965+0000 7f9c1f400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9c200cb930 0x7f9c200b0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:16.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.965+0000 7f9c16000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9c200d0900 0x7f9c200cb220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57236/0 (socket says 172.21.15.55:57236) 2024-04-02T07:22:16.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.965+0000 7f9c16000640 1 -- 172.21.15.55:0/2370071777 learned_addr learned my addr 172.21.15.55:0/2370071777 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:16.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.965+0000 7f9c1ea00640 1 --2- 172.21.15.55:0/2370071777 >> v2:172.21.15.106:3300/0 conn(0x7f9c2015a980 0x7f9c200d03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:16.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.965+0000 7f9c1f400640 1 -- 172.21.15.55:0/2370071777 >> v2:172.21.15.106:3300/0 conn(0x7f9c2015a980 msgr2=0x7f9c200d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:16.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.965+0000 7f9c1f400640 1 --2- 172.21.15.55:0/2370071777 >> v2:172.21.15.106:3300/0 conn(0x7f9c2015a980 0x7f9c200d03c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.965+0000 7f9c1f400640 1 -- 172.21.15.55:0/2370071777 >> v1:172.21.15.55:6789/0 conn(0x7f9c200d0900 legacy=0x7f9c200cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:16.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.965+0000 7f9c1f400640 1 -- 172.21.15.55:0/2370071777 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c200cbf00 con 0x7f9c200cb930 2024-04-02T07:22:16.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.965+0000 7f9c1e000640 1 -- 172.21.15.55:0/2370071777 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4049893502 0 0) 0x7f9c08001120 con 0x7f9c200d0900 2024-04-02T07:22:16.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.965+0000 7f9c1f400640 1 --2- 172.21.15.55:0/2370071777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c200cb930 0x7f9c200b0ab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c200b3310 tx=0x7f9c1801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4231ec42ae5768d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:16.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c1e000640 1 -- 172.21.15.55:0/2370071777 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c180ab680 con 0x7f9c200cb930 2024-04-02T07:22:16.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c1e000640 1 -- 172.21.15.55:0/2370071777 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c180ab7e0 con 0x7f9c200cb930 2024-04-02T07:22:16.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c1e000640 1 -- 172.21.15.55:0/2370071777 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c180abb70 con 0x7f9c200cb930 2024-04-02T07:22:16.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c25600640 1 -- 172.21.15.55:0/2370071777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c200cb930 msgr2=0x7f9c200b0ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:16.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c25600640 1 --2- 172.21.15.55:0/2370071777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c200cb930 0x7f9c200b0ab0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9c200b3310 tx=0x7f9c1801c480 comp rx=0 tx=0).stop 2024-04-02T07:22:16.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c25600640 1 -- 172.21.15.55:0/2370071777 shutdown_connections 2024-04-02T07:22:16.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c25600640 1 --2- 172.21.15.55:0/2370071777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c200cb930 0x7f9c200b0ab0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c25600640 1 --2- 172.21.15.55:0/2370071777 >> v2:172.21.15.106:3300/0 conn(0x7f9c2015a980 0x7f9c200d03c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c25600640 1 -- 172.21.15.55:0/2370071777 >> 172.21.15.55:0/2370071777 conn(0x7f9c20089fa0 msgr2=0x7f9c2008a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:16.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c25600640 1 -- 172.21.15.55:0/2370071777 shutdown_connections 2024-04-02T07:22:16.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c25600640 1 -- 172.21.15.55:0/2370071777 wait complete. 2024-04-02T07:22:16.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c25600640 1 Processor -- start 2024-04-02T07:22:16.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c25600640 1 -- start start 2024-04-02T07:22:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c25600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9c200cb930 0x7f9c2015b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c25600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c200d0900 0x7f9c201f8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c25600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c2015a980 0x7f9c2006aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c25600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2006e400 con 0x7f9c2015a980 2024-04-02T07:22:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c25600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c201f9290 con 0x7f9c200d0900 2024-04-02T07:22:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c25600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c2015b640 con 0x7f9c200cb930 2024-04-02T07:22:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c1f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c2015a980 0x7f9c2006aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c1f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c2015a980 0x7f9c2006aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51422/0 (socket says 172.21.15.55:51422) 2024-04-02T07:22:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c1f400640 1 -- 172.21.15.55:0/898988151 learned_addr learned my addr 172.21.15.55:0/898988151 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c1ea00640 1 --2- 172.21.15.55:0/898988151 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9c200cb930 0x7f9c2015b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.969+0000 7f9c16000640 1 --2- 172.21.15.55:0/898988151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c200d0900 0x7f9c201f8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.973+0000 7f9c1f400640 1 -- 172.21.15.55:0/898988151 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9c200cb930 msgr2=0x7f9c2015b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:16.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.973+0000 7f9c1f400640 1 --2- 172.21.15.55:0/898988151 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9c200cb930 0x7f9c2015b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.973+0000 7f9c1f400640 1 -- 172.21.15.55:0/898988151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c200d0900 msgr2=0x7f9c201f8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.973+0000 7f9c1f400640 1 --2- 172.21.15.55:0/898988151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c200d0900 0x7f9c201f8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.973+0000 7f9c1f400640 1 -- 172.21.15.55:0/898988151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c18009420 con 0x7f9c2015a980 2024-04-02T07:22:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.973+0000 7f9c16000640 1 --2- 172.21.15.55:0/898988151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c200d0900 0x7f9c201f8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.973+0000 7f9c1f400640 1 --2- 172.21.15.55:0/898988151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c2015a980 0x7f9c2006aea0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9c18019090 tx=0x7f9c1801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.973+0000 7f9c17400640 1 -- 172.21.15.55:0/898988151 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c180bf610 con 0x7f9c2015a980 2024-04-02T07:22:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.973+0000 7f9c17400640 1 -- 172.21.15.55:0/898988151 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c180bf770 con 0x7f9c2015a980 2024-04-02T07:22:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.973+0000 7f9c25600640 1 -- 172.21.15.55:0/898988151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c2006e650 con 0x7f9c2015a980 2024-04-02T07:22:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.973+0000 7f9c17400640 1 -- 172.21.15.55:0/898988151 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c180bfb00 con 0x7f9c2015a980 2024-04-02T07:22:16.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.973+0000 7f9c25600640 1 -- 172.21.15.55:0/898988151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c2006ec10 con 0x7f9c2015a980 2024-04-02T07:22:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.973+0000 7f9c25600640 1 -- 172.21.15.55:0/898988151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c2006ee00 con 0x7f9c2015a980 2024-04-02T07:22:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.973+0000 7f9c17400640 1 -- 172.21.15.55:0/898988151 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f9c180b5610 con 0x7f9c2015a980 2024-04-02T07:22:16.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.973+0000 7f9c17400640 1 --2- 172.21.15.55:0/898988151 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9bfc066690 0x7f9bfc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:16.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.973+0000 7f9c17400640 1 -- 172.21.15.55:0/898988151 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f9c1811f480 con 0x7f9c2015a980 2024-04-02T07:22:16.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.977+0000 7f9c1ea00640 1 --2- 172.21.15.55:0/898988151 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9bfc066690 0x7f9bfc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:16.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.977+0000 7f9c1ea00640 1 --2- 172.21.15.55:0/898988151 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9bfc066690 0x7f9bfc068b50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9c100073f0 tx=0x7f9c1000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:16.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:16.977+0000 7f9c17400640 1 -- 172.21.15.55:0/898988151 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f9c180ecab0 con 0x7f9c2015a980 2024-04-02T07:22:17.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.141+0000 7f9c25600640 1 -- 172.21.15.55:0/898988151 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9c20066c90 con 0x7f9c2015a980 2024-04-02T07:22:17.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.793+0000 7f9c17400640 1 -- 172.21.15.55:0/898988151 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9c180f00d0 con 0x7f9c2015a980 2024-04-02T07:22:17.796 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-04-02T07:22:17.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.797+0000 7f9c25600640 1 -- 172.21.15.55:0/898988151 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9bfc066690 msgr2=0x7f9bfc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:17.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.797+0000 7f9c25600640 1 --2- 172.21.15.55:0/898988151 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9bfc066690 0x7f9bfc068b50 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9c100073f0 tx=0x7f9c1000b040 comp rx=0 tx=0).stop 2024-04-02T07:22:17.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.797+0000 7f9c25600640 1 -- 172.21.15.55:0/898988151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c2015a980 msgr2=0x7f9c2006aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:17.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.797+0000 7f9c25600640 1 --2- 172.21.15.55:0/898988151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c2015a980 0x7f9c2006aea0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9c18019090 tx=0x7f9c1801acc0 comp rx=0 tx=0).stop 2024-04-02T07:22:17.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.797+0000 7f9c25600640 1 -- 172.21.15.55:0/898988151 shutdown_connections 2024-04-02T07:22:17.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.797+0000 7f9c25600640 1 --2- 172.21.15.55:0/898988151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c2015a980 0x7f9c2006aea0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:17.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.797+0000 7f9c25600640 1 --2- 172.21.15.55:0/898988151 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9bfc066690 0x7f9bfc068b50 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:17.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.797+0000 7f9c25600640 1 --2- 172.21.15.55:0/898988151 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c200d0900 0x7f9c201f8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:17.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.797+0000 7f9c25600640 1 --2- 172.21.15.55:0/898988151 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9c200cb930 0x7f9c2015b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:17.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.797+0000 7f9c25600640 1 -- 172.21.15.55:0/898988151 >> 172.21.15.55:0/898988151 conn(0x7f9c20089fa0 msgr2=0x7f9c200cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:17.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.797+0000 7f9c25600640 1 -- 172.21.15.55:0/898988151 shutdown_connections 2024-04-02T07:22:17.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.797+0000 7f9c25600640 1 -- 172.21.15.55:0/898988151 wait complete. 2024-04-02T07:22:17.840 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-02T07:22:17.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.981+0000 7f2924c00640 1 Processor -- start 2024-04-02T07:22:17.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.981+0000 7f2924c00640 1 -- start start 2024-04-02T07:22:17.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.981+0000 7f2924c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2920098a10 0x7f2920098ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:17.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.985+0000 7f2924c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f292015c130 0x7f292015c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:17.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.985+0000 7f2924c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2920099a70 con 0x7f29200cc880 2024-04-02T07:22:17.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.985+0000 7f2924c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29200993e0 con 0x7f2920098a10 2024-04-02T07:22:17.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.985+0000 7f2924c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f292006bc90 con 0x7f292015c130 2024-04-02T07:22:17.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.985+0000 7f2916a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2920098a10 0x7f2920098ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:17.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.985+0000 7f2916a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2920098a10 0x7f2920098ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51426/0 (socket says 172.21.15.55:51426) 2024-04-02T07:22:17.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.985+0000 7f2916a00640 1 -- 172.21.15.55:0/2986773767 learned_addr learned my addr 172.21.15.55:0/2986773767 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:17.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.985+0000 7f291f400640 1 --1- 172.21.15.55:0/2986773767 >> v1:172.21.15.55:6789/0 conn(0x7f29200cc880 0x7f292006b0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57244/0 (socket says 172.21.15.55:57244) 2024-04-02T07:22:17.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.985+0000 7f291fe00640 1 --2- 172.21.15.55:0/2986773767 >> v2:172.21.15.106:3300/0 conn(0x7f292015c130 0x7f292015c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:17.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.985+0000 7f2916a00640 1 -- 172.21.15.55:0/2986773767 >> v2:172.21.15.106:3300/0 conn(0x7f292015c130 msgr2=0x7f292015c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:17.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.985+0000 7f2916a00640 1 --2- 172.21.15.55:0/2986773767 >> v2:172.21.15.106:3300/0 conn(0x7f292015c130 0x7f292015c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:17.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.985+0000 7f2916a00640 1 -- 172.21.15.55:0/2986773767 >> v1:172.21.15.55:6789/0 conn(0x7f29200cc880 legacy=0x7f292006b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:17.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.985+0000 7f2916a00640 1 -- 172.21.15.55:0/2986773767 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f292006bf70 con 0x7f2920098a10 2024-04-02T07:22:17.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.985+0000 7f291ea00640 1 -- 172.21.15.55:0/2986773767 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4187424639 0 0) 0x7f2920099a70 con 0x7f29200cc880 2024-04-02T07:22:17.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.985+0000 7f2916a00640 1 --2- 172.21.15.55:0/2986773767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2920098a10 0x7f2920098ea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2920161540 tx=0x7f290801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=932778193be0265c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:17.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.985+0000 7f291ea00640 1 -- 172.21.15.55:0/2986773767 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29080aa650 con 0x7f2920098a10 2024-04-02T07:22:17.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.985+0000 7f291ea00640 1 -- 172.21.15.55:0/2986773767 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29080aa7b0 con 0x7f2920098a10 2024-04-02T07:22:17.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.985+0000 7f291ea00640 1 -- 172.21.15.55:0/2986773767 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29080aab40 con 0x7f2920098a10 2024-04-02T07:22:17.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2924c00640 1 -- 172.21.15.55:0/2986773767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2920098a10 msgr2=0x7f2920098ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:17.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2924c00640 1 --2- 172.21.15.55:0/2986773767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2920098a10 0x7f2920098ea0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2920161540 tx=0x7f290801c4f0 comp rx=0 tx=0).stop 2024-04-02T07:22:17.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2924c00640 1 -- 172.21.15.55:0/2986773767 shutdown_connections 2024-04-02T07:22:17.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2924c00640 1 --2- 172.21.15.55:0/2986773767 >> v2:172.21.15.106:3300/0 conn(0x7f292015c130 0x7f292015c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:17.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2924c00640 1 --2- 172.21.15.55:0/2986773767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2920098a10 0x7f2920098ea0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:17.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2924c00640 1 -- 172.21.15.55:0/2986773767 >> 172.21.15.55:0/2986773767 conn(0x7f29200b1fb0 msgr2=0x7f29200b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:17.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2924c00640 1 -- 172.21.15.55:0/2986773767 shutdown_connections 2024-04-02T07:22:17.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2924c00640 1 -- 172.21.15.55:0/2986773767 wait complete. 2024-04-02T07:22:17.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2924c00640 1 Processor -- start 2024-04-02T07:22:17.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2924c00640 1 -- start start 2024-04-02T07:22:17.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2924c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2920098a10 0x7f29200c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:17.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2924c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29200cc880 0x7f29201533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:17.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2924c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292015c130 0x7f292014a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:17.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2924c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f292014b110 con 0x7f29200cc880 2024-04-02T07:22:17.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2924c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29200c89f0 con 0x7f292015c130 2024-04-02T07:22:17.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2924c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29200c8c40 con 0x7f2920098a10 2024-04-02T07:22:17.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2916a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29200cc880 0x7f29201533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:17.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2916a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29200cc880 0x7f29201533e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51430/0 (socket says 172.21.15.55:51430) 2024-04-02T07:22:17.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2916a00640 1 -- 172.21.15.55:0/2108087810 learned_addr learned my addr 172.21.15.55:0/2108087810 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:17.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f291f400640 1 --2- 172.21.15.55:0/2108087810 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2920098a10 0x7f29200c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:17.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f291fe00640 1 --2- 172.21.15.55:0/2108087810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292015c130 0x7f292014a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:17.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2916a00640 1 -- 172.21.15.55:0/2108087810 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2920098a10 msgr2=0x7f29200c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:17.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2916a00640 1 --2- 172.21.15.55:0/2108087810 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2920098a10 0x7f29200c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:17.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2916a00640 1 -- 172.21.15.55:0/2108087810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292015c130 msgr2=0x7f292014a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:17.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2916a00640 1 --2- 172.21.15.55:0/2108087810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292015c130 0x7f292014a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:17.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.989+0000 7f2916a00640 1 -- 172.21.15.55:0/2108087810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29080094d0 con 0x7f29200cc880 2024-04-02T07:22:17.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.993+0000 7f2916a00640 1 --2- 172.21.15.55:0/2108087810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29200cc880 0x7f29201533e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f290801c9d0 tx=0x7f290801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:17.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.993+0000 7f2917e00640 1 -- 172.21.15.55:0/2108087810 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29080b3800 con 0x7f29200cc880 2024-04-02T07:22:17.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.993+0000 7f2917e00640 1 -- 172.21.15.55:0/2108087810 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29080b3960 con 0x7f29200cc880 2024-04-02T07:22:17.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.993+0000 7f2917e00640 1 -- 172.21.15.55:0/2108087810 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29080b3d10 con 0x7f29200cc880 2024-04-02T07:22:17.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.993+0000 7f2924c00640 1 -- 172.21.15.55:0/2108087810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29200c8f20 con 0x7f29200cc880 2024-04-02T07:22:17.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.993+0000 7f2924c00640 1 -- 172.21.15.55:0/2108087810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29200c94e0 con 0x7f29200cc880 2024-04-02T07:22:17.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.993+0000 7f2924c00640 1 -- 172.21.15.55:0/2108087810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f292006cf00 con 0x7f29200cc880 2024-04-02T07:22:17.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.993+0000 7f2917e00640 1 -- 172.21.15.55:0/2108087810 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f29080b2380 con 0x7f29200cc880 2024-04-02T07:22:17.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.993+0000 7f2917e00640 1 --2- 172.21.15.55:0/2108087810 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f28fc066690 0x7f28fc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:17.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.993+0000 7f2917e00640 1 -- 172.21.15.55:0/2108087810 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f290811e850 con 0x7f29200cc880 2024-04-02T07:22:17.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.993+0000 7f291f400640 1 --2- 172.21.15.55:0/2108087810 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f28fc066690 0x7f28fc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:17.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:17.997+0000 7f291f400640 1 --2- 172.21.15.55:0/2108087810 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f28fc066690 0x7f28fc068b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2910000f70 tx=0x7f2910007b60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:18.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.001+0000 7f2917e00640 1 -- 172.21.15.55:0/2108087810 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f29080ebc30 con 0x7f29200cc880 2024-04-02T07:22:18.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.197+0000 7f2924c00640 1 -- 172.21.15.55:0/2108087810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2920073fa0 con 0x7f29200cc880 2024-04-02T07:22:18.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.209+0000 7f2917e00640 1 -- 172.21.15.55:0/2108087810 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f29080ef250 con 0x7f29200cc880 2024-04-02T07:22:18.215 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 2 and data pool 3 2024-04-02T07:22:18.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.217+0000 7f2924c00640 1 -- 172.21.15.55:0/2108087810 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f28fc066690 msgr2=0x7f28fc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:18.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.217+0000 7f2924c00640 1 --2- 172.21.15.55:0/2108087810 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f28fc066690 0x7f28fc068b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2910000f70 tx=0x7f2910007b60 comp rx=0 tx=0).stop 2024-04-02T07:22:18.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.217+0000 7f2924c00640 1 -- 172.21.15.55:0/2108087810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29200cc880 msgr2=0x7f29201533e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:18.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.217+0000 7f2924c00640 1 --2- 172.21.15.55:0/2108087810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29200cc880 0x7f29201533e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f290801c9d0 tx=0x7f290801ad30 comp rx=0 tx=0).stop 2024-04-02T07:22:18.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.217+0000 7f2924c00640 1 -- 172.21.15.55:0/2108087810 shutdown_connections 2024-04-02T07:22:18.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.217+0000 7f2924c00640 1 --2- 172.21.15.55:0/2108087810 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f28fc066690 0x7f28fc068b50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.217+0000 7f2924c00640 1 --2- 172.21.15.55:0/2108087810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f292015c130 0x7f292014a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.217+0000 7f2924c00640 1 --2- 172.21.15.55:0/2108087810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29200cc880 0x7f29201533e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.217+0000 7f2924c00640 1 --2- 172.21.15.55:0/2108087810 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2920098a10 0x7f29200c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.217+0000 7f2924c00640 1 -- 172.21.15.55:0/2108087810 >> 172.21.15.55:0/2108087810 conn(0x7f29200b1fb0 msgr2=0x7f292006ae50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:18.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.221+0000 7f2924c00640 1 -- 172.21.15.55:0/2108087810 shutdown_connections 2024-04-02T07:22:18.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.221+0000 7f2924c00640 1 -- 172.21.15.55:0/2108087810 wait complete. 2024-04-02T07:22:18.257 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:18.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.393+0000 7f70d7400640 1 Processor -- start 2024-04-02T07:22:18.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.393+0000 7f70d7400640 1 -- start start 2024-04-02T07:22:18.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.393+0000 7f70d7400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70d00b19d0 0x7f70d00ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:18.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.393+0000 7f70d7400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f70d006c0d0 0x7f70d0098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:18.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.393+0000 7f70d7400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f70d00cef10 0x7f70d0098f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:18.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.393+0000 7f70d7400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d00cf3d0 con 0x7f70d00cef10 2024-04-02T07:22:18.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.393+0000 7f70d7400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d00cf6b0 con 0x7f70d006c0d0 2024-04-02T07:22:18.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.393+0000 7f70d7400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00cf990 con 0x7f70d00b19d0 2024-04-02T07:22:18.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.393+0000 7f70d5400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f70d00cef10 0x7f70d0098f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:18.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.393+0000 7f70d5400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f70d00cef10 0x7f70d0098f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51434/0 (socket says 172.21.15.55:51434) 2024-04-02T07:22:18.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.393+0000 7f70d5400640 1 -- 172.21.15.55:0/4154990653 learned_addr learned my addr 172.21.15.55:0/4154990653 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:18.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.393+0000 7f70cfe00640 1 --2- 172.21.15.55:0/4154990653 >> v2:172.21.15.106:3300/0 conn(0x7f70d006c0d0 0x7f70d0098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:18.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.393+0000 7f70d4a00640 1 --2- 172.21.15.55:0/4154990653 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70d00b19d0 0x7f70d00ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:18.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.393+0000 7f70d5400640 1 -- 172.21.15.55:0/4154990653 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70d00b19d0 msgr2=0x7f70d00ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:18.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.393+0000 7f70d5400640 1 --2- 172.21.15.55:0/4154990653 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70d00b19d0 0x7f70d00ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.393+0000 7f70d5400640 1 -- 172.21.15.55:0/4154990653 >> v2:172.21.15.106:3300/0 conn(0x7f70d006c0d0 msgr2=0x7f70d0098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:18.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.393+0000 7f70d5400640 1 --2- 172.21.15.55:0/4154990653 >> v2:172.21.15.106:3300/0 conn(0x7f70d006c0d0 0x7f70d0098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.393+0000 7f70d5400640 1 -- 172.21.15.55:0/4154990653 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d00cfc70 con 0x7f70d00cef10 2024-04-02T07:22:18.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.393+0000 7f70cfe00640 1 --2- 172.21.15.55:0/4154990653 >> v2:172.21.15.106:3300/0 conn(0x7f70d006c0d0 0x7f70d0098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:18.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.397+0000 7f70d5400640 1 --2- 172.21.15.55:0/4154990653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70d00cef10 0x7f70d0098f50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f70d00719b0 tx=0x7f70c801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca18e041a5f5b739 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:18.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.397+0000 7f70cf400640 1 -- 172.21.15.55:0/4154990653 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c80a5780 con 0x7f70d00cef10 2024-04-02T07:22:18.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.397+0000 7f70cf400640 1 -- 172.21.15.55:0/4154990653 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c80a58e0 con 0x7f70d00cef10 2024-04-02T07:22:18.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.397+0000 7f70cf400640 1 -- 172.21.15.55:0/4154990653 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c80a5c70 con 0x7f70d00cef10 2024-04-02T07:22:18.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.397+0000 7f70d7400640 1 -- 172.21.15.55:0/4154990653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70d00cef10 msgr2=0x7f70d0098f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:18.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.397+0000 7f70d7400640 1 --2- 172.21.15.55:0/4154990653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70d00cef10 0x7f70d0098f50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f70d00719b0 tx=0x7f70c801c9f0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.397+0000 7f70d7400640 1 -- 172.21.15.55:0/4154990653 shutdown_connections 2024-04-02T07:22:18.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.397+0000 7f70d7400640 1 --2- 172.21.15.55:0/4154990653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70d00cef10 0x7f70d0098f50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.397+0000 7f70d7400640 1 --2- 172.21.15.55:0/4154990653 >> v2:172.21.15.106:3300/0 conn(0x7f70d006c0d0 0x7f70d0098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.397+0000 7f70d7400640 1 --2- 172.21.15.55:0/4154990653 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70d00b19d0 0x7f70d00ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.397+0000 7f70d7400640 1 -- 172.21.15.55:0/4154990653 >> 172.21.15.55:0/4154990653 conn(0x7f70d00b2150 msgr2=0x7f70d00b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:18.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.397+0000 7f70d7400640 1 -- 172.21.15.55:0/4154990653 shutdown_connections 2024-04-02T07:22:18.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.397+0000 7f70d7400640 1 -- 172.21.15.55:0/4154990653 wait complete. 2024-04-02T07:22:18.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70d7400640 1 Processor -- start 2024-04-02T07:22:18.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70d7400640 1 -- start start 2024-04-02T07:22:18.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70d7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70d006c0d0 0x7f70d015f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:18.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70d7400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70d00b19d0 0x7f70d01f88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:18.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70d7400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70d00cef10 0x7f70d01f8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:18.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70d7400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00b5450 con 0x7f70d006c0d0 2024-04-02T07:22:18.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70d7400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d0151e50 con 0x7f70d00cef10 2024-04-02T07:22:18.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70d7400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d00b56a0 con 0x7f70d00b19d0 2024-04-02T07:22:18.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70d4a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70d006c0d0 0x7f70d015f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:18.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70d4a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70d006c0d0 0x7f70d015f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51442/0 (socket says 172.21.15.55:51442) 2024-04-02T07:22:18.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70d4a00640 1 -- 172.21.15.55:0/2169286272 learned_addr learned my addr 172.21.15.55:0/2169286272 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:18.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70d5400640 1 --2- 172.21.15.55:0/2169286272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70d00cef10 0x7f70d01f8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:18.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70cfe00640 1 --2- 172.21.15.55:0/2169286272 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70d00b19d0 0x7f70d01f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:18.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70d4a00640 1 -- 172.21.15.55:0/2169286272 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70d00b19d0 msgr2=0x7f70d01f88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:18.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70d4a00640 1 --2- 172.21.15.55:0/2169286272 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70d00b19d0 0x7f70d01f88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70d4a00640 1 -- 172.21.15.55:0/2169286272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70d00cef10 msgr2=0x7f70d01f8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:18.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70d4a00640 1 --2- 172.21.15.55:0/2169286272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70d00cef10 0x7f70d01f8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70d4a00640 1 -- 172.21.15.55:0/2169286272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c8009b30 con 0x7f70d006c0d0 2024-04-02T07:22:18.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70d4a00640 1 --2- 172.21.15.55:0/2169286272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70d006c0d0 0x7f70d015f040 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f70c400d830 tx=0x7f70c400dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:18.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70ccc00640 1 -- 172.21.15.55:0/2169286272 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c400b6c0 con 0x7f70d006c0d0 2024-04-02T07:22:18.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70ccc00640 1 -- 172.21.15.55:0/2169286272 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c400b820 con 0x7f70d006c0d0 2024-04-02T07:22:18.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70ccc00640 1 -- 172.21.15.55:0/2169286272 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c400bb90 con 0x7f70d006c0d0 2024-04-02T07:22:18.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70d7400640 1 -- 172.21.15.55:0/2169286272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d00b5980 con 0x7f70d006c0d0 2024-04-02T07:22:18.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.401+0000 7f70d7400640 1 -- 172.21.15.55:0/2169286272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d015e6d0 con 0x7f70d006c0d0 2024-04-02T07:22:18.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.405+0000 7f70d7400640 1 -- 172.21.15.55:0/2169286272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d0066c90 con 0x7f70d006c0d0 2024-04-02T07:22:18.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.405+0000 7f70ccc00640 1 -- 172.21.15.55:0/2169286272 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f70c401e460 con 0x7f70d006c0d0 2024-04-02T07:22:18.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.405+0000 7f70ccc00640 1 --2- 172.21.15.55:0/2169286272 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f70b0066690 0x7f70b0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:18.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.405+0000 7f70ccc00640 1 -- 172.21.15.55:0/2169286272 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70c4084960 con 0x7f70d006c0d0 2024-04-02T07:22:18.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.405+0000 7f70cfe00640 1 --2- 172.21.15.55:0/2169286272 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f70b0066690 0x7f70b0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:18.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.405+0000 7f70cfe00640 1 --2- 172.21.15.55:0/2169286272 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f70b0066690 0x7f70b0068b50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f70d00b13f0 tx=0x7f70bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:18.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.409+0000 7f70ccc00640 1 -- 172.21.15.55:0/2169286272 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f70c4051cd0 con 0x7f70d006c0d0 2024-04-02T07:22:18.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.569+0000 7f70d7400640 1 -- 172.21.15.55:0/2169286272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70d006b320 con 0x7f70d006c0d0 2024-04-02T07:22:18.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.573+0000 7f70ccc00640 1 -- 172.21.15.55:0/2169286272 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16050 (secure 0 0 0) 0x7f70c40552f0 con 0x7f70d006c0d0 2024-04-02T07:22:18.576 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:18.576 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:18.200710+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:18.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.573+0000 7f70d7400640 1 -- 172.21.15.55:0/2169286272 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f70b0066690 msgr2=0x7f70b0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:18.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.573+0000 7f70d7400640 1 --2- 172.21.15.55:0/2169286272 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f70b0066690 0x7f70b0068b50 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f70d00b13f0 tx=0x7f70bc008040 comp rx=0 tx=0).stop 2024-04-02T07:22:18.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.573+0000 7f70d7400640 1 -- 172.21.15.55:0/2169286272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70d006c0d0 msgr2=0x7f70d015f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:18.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.573+0000 7f70d7400640 1 --2- 172.21.15.55:0/2169286272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70d006c0d0 0x7f70d015f040 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f70c400d830 tx=0x7f70c400dcf0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.573+0000 7f70d7400640 1 -- 172.21.15.55:0/2169286272 shutdown_connections 2024-04-02T07:22:18.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.573+0000 7f70d7400640 1 --2- 172.21.15.55:0/2169286272 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f70b0066690 0x7f70b0068b50 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.573+0000 7f70d7400640 1 --2- 172.21.15.55:0/2169286272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70d00cef10 0x7f70d01f8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.573+0000 7f70d7400640 1 --2- 172.21.15.55:0/2169286272 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70d00b19d0 0x7f70d01f88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.573+0000 7f70d7400640 1 --2- 172.21.15.55:0/2169286272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70d006c0d0 0x7f70d015f040 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.573+0000 7f70d7400640 1 -- 172.21.15.55:0/2169286272 >> 172.21.15.55:0/2169286272 conn(0x7f70d00b2150 msgr2=0x7f70d0157fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:18.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.573+0000 7f70d7400640 1 -- 172.21.15.55:0/2169286272 shutdown_connections 2024-04-02T07:22:18.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.573+0000 7f70d7400640 1 -- 172.21.15.55:0/2169286272 wait complete. 2024-04-02T07:22:18.596 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:18.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.733+0000 7fec9c400640 1 Processor -- start 2024-04-02T07:22:18.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.733+0000 7fec9c400640 1 -- start start 2024-04-02T07:22:18.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.733+0000 7fec9c400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fec9415ee70 0x7fec94099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:18.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.733+0000 7fec9c400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fec9415f250 0x7fec940b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:18.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.733+0000 7fec9c400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec940ad270 con 0x7fec94098a10 2024-04-02T07:22:18.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.733+0000 7fec9c400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec940b0840 con 0x7fec9415f250 2024-04-02T07:22:18.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.733+0000 7fec9c400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec940cf6a0 con 0x7fec9415ee70 2024-04-02T07:22:18.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.733+0000 7fec99000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fec9415f250 0x7fec940b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:18.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.733+0000 7fec9a400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fec94098a10 0x7fec94098e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57248/0 (socket says 172.21.15.55:57248) 2024-04-02T07:22:18.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.733+0000 7fec99000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fec9415f250 0x7fec940b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51444/0 (socket says 172.21.15.55:51444) 2024-04-02T07:22:18.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.733+0000 7fec9a400640 1 -- 172.21.15.55:0/2505944152 learned_addr learned my addr 172.21.15.55:0/2505944152 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:18.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.733+0000 7fec99a00640 1 --2- 172.21.15.55:0/2505944152 >> v2:172.21.15.106:3300/0 conn(0x7fec9415ee70 0x7fec94099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:18.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.733+0000 7fec99000640 1 -- 172.21.15.55:0/2505944152 >> v2:172.21.15.106:3300/0 conn(0x7fec9415ee70 msgr2=0x7fec94099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:18.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.733+0000 7fec99000640 1 --2- 172.21.15.55:0/2505944152 >> v2:172.21.15.106:3300/0 conn(0x7fec9415ee70 0x7fec94099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.733+0000 7fec99000640 1 -- 172.21.15.55:0/2505944152 >> v1:172.21.15.55:6789/0 conn(0x7fec94098a10 legacy=0x7fec94098e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:18.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.733+0000 7fec99000640 1 -- 172.21.15.55:0/2505944152 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec940b0a50 con 0x7fec9415f250 2024-04-02T07:22:18.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.733+0000 7fec93e00640 1 -- 172.21.15.55:0/2505944152 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 138582289 0 0) 0x7fec940ad270 con 0x7fec94098a10 2024-04-02T07:22:18.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.733+0000 7fec99a00640 1 --2- 172.21.15.55:0/2505944152 >> v2:172.21.15.106:3300/0 conn(0x7fec9415ee70 0x7fec94099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:18.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.737+0000 7fec99000640 1 --2- 172.21.15.55:0/2505944152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec9415f250 0x7fec940b12f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fec940719c0 tx=0x7fec8001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=302dcd755d61fe3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:18.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.737+0000 7fec93e00640 1 -- 172.21.15.55:0/2505944152 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec800ab680 con 0x7fec9415f250 2024-04-02T07:22:18.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.737+0000 7fec93e00640 1 -- 172.21.15.55:0/2505944152 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec800ab7e0 con 0x7fec9415f250 2024-04-02T07:22:18.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.737+0000 7fec93e00640 1 -- 172.21.15.55:0/2505944152 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec800abb70 con 0x7fec9415f250 2024-04-02T07:22:18.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.737+0000 7fec9c400640 1 -- 172.21.15.55:0/2505944152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec9415f250 msgr2=0x7fec940b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:18.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.737+0000 7fec9c400640 1 --2- 172.21.15.55:0/2505944152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec9415f250 0x7fec940b12f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fec940719c0 tx=0x7fec8001c480 comp rx=0 tx=0).stop 2024-04-02T07:22:18.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.737+0000 7fec9c400640 1 -- 172.21.15.55:0/2505944152 shutdown_connections 2024-04-02T07:22:18.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.737+0000 7fec9c400640 1 --2- 172.21.15.55:0/2505944152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec9415f250 0x7fec940b12f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.737+0000 7fec9c400640 1 --2- 172.21.15.55:0/2505944152 >> v2:172.21.15.106:3300/0 conn(0x7fec9415ee70 0x7fec94099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.737+0000 7fec9c400640 1 -- 172.21.15.55:0/2505944152 >> 172.21.15.55:0/2505944152 conn(0x7fec940b21d0 msgr2=0x7fec940b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:18.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.737+0000 7fec9c400640 1 -- 172.21.15.55:0/2505944152 shutdown_connections 2024-04-02T07:22:18.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.737+0000 7fec9c400640 1 -- 172.21.15.55:0/2505944152 wait complete. 2024-04-02T07:22:18.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec9c400640 1 Processor -- start 2024-04-02T07:22:18.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec9c400640 1 -- start start 2024-04-02T07:22:18.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec9c400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec94098a10 0x7fec940af1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:18.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec9c400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec9415ee70 0x7fec940ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:18.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec9c400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec9415f250 0x7fec9415da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:18.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec9c400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9415a910 con 0x7fec94098a10 2024-04-02T07:22:18.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec9c400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec9415c130 con 0x7fec9415ee70 2024-04-02T07:22:18.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec9c400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec940ad490 con 0x7fec9415f250 2024-04-02T07:22:18.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec99a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec94098a10 0x7fec940af1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:18.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec99a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec94098a10 0x7fec940af1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51450/0 (socket says 172.21.15.55:51450) 2024-04-02T07:22:18.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec99a00640 1 -- 172.21.15.55:0/87272638 learned_addr learned my addr 172.21.15.55:0/87272638 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:18.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec9a400640 1 --2- 172.21.15.55:0/87272638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec9415f250 0x7fec9415da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:18.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec99000640 1 --2- 172.21.15.55:0/87272638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec9415ee70 0x7fec940ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:18.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec99a00640 1 -- 172.21.15.55:0/87272638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec9415f250 msgr2=0x7fec9415da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:18.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec99a00640 1 --2- 172.21.15.55:0/87272638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec9415f250 0x7fec9415da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec99a00640 1 -- 172.21.15.55:0/87272638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec9415ee70 msgr2=0x7fec940ae180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:18.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec99a00640 1 --2- 172.21.15.55:0/87272638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec9415ee70 0x7fec940ae180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec99a00640 1 -- 172.21.15.55:0/87272638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec80009420 con 0x7fec94098a10 2024-04-02T07:22:18.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec99000640 1 --2- 172.21.15.55:0/87272638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec9415ee70 0x7fec940ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:18.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec9a400640 1 --2- 172.21.15.55:0/87272638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec9415f250 0x7fec9415da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:18.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec99a00640 1 --2- 172.21.15.55:0/87272638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec94098a10 0x7fec940af1b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fec8800c7c0 tx=0x7fec8800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:18.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec91600640 1 -- 172.21.15.55:0/87272638 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec88007a30 con 0x7fec94098a10 2024-04-02T07:22:18.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec91600640 1 -- 172.21.15.55:0/87272638 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec88007b90 con 0x7fec94098a10 2024-04-02T07:22:18.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec91600640 1 -- 172.21.15.55:0/87272638 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8800ce70 con 0x7fec94098a10 2024-04-02T07:22:18.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec9c400640 1 -- 172.21.15.55:0/87272638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec940adcf0 con 0x7fec94098a10 2024-04-02T07:22:18.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec9c400640 1 -- 172.21.15.55:0/87272638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec940ad6a0 con 0x7fec94098a10 2024-04-02T07:22:18.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.741+0000 7fec9c400640 1 -- 172.21.15.55:0/87272638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec940c4050 con 0x7fec94098a10 2024-04-02T07:22:18.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.745+0000 7fec91600640 1 -- 172.21.15.55:0/87272638 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fec880113f0 con 0x7fec94098a10 2024-04-02T07:22:18.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.745+0000 7fec91600640 1 --2- 172.21.15.55:0/87272638 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec740666c0 0x7fec74068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:18.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.745+0000 7fec91600640 1 -- 172.21.15.55:0/87272638 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec88084600 con 0x7fec94098a10 2024-04-02T07:22:18.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.745+0000 7fec99000640 1 --2- 172.21.15.55:0/87272638 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec740666c0 0x7fec74068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:18.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.745+0000 7fec99000640 1 --2- 172.21.15.55:0/87272638 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec740666c0 0x7fec74068b80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fec800af000 tx=0x7fec80008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:18.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.749+0000 7fec91600640 1 -- 172.21.15.55:0/87272638 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fec88051960 con 0x7fec94098a10 2024-04-02T07:22:18.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.913+0000 7fec9c400640 1 -- 172.21.15.55:0/87272638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec94066c90 con 0x7fec94098a10 2024-04-02T07:22:18.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.913+0000 7fec91600640 1 -- 172.21.15.55:0/87272638 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16050 (secure 0 0 0) 0x7fec88054f80 con 0x7fec94098a10 2024-04-02T07:22:18.917 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:18.917 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:18.200710+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:18.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.913+0000 7fec9c400640 1 -- 172.21.15.55:0/87272638 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec740666c0 msgr2=0x7fec74068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:18.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.913+0000 7fec9c400640 1 --2- 172.21.15.55:0/87272638 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec740666c0 0x7fec74068b80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fec800af000 tx=0x7fec80008040 comp rx=0 tx=0).stop 2024-04-02T07:22:18.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.913+0000 7fec9c400640 1 -- 172.21.15.55:0/87272638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec94098a10 msgr2=0x7fec940af1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:18.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.913+0000 7fec9c400640 1 --2- 172.21.15.55:0/87272638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec94098a10 0x7fec940af1b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fec8800c7c0 tx=0x7fec8800cc80 comp rx=0 tx=0).stop 2024-04-02T07:22:18.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.913+0000 7fec9c400640 1 -- 172.21.15.55:0/87272638 shutdown_connections 2024-04-02T07:22:18.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.913+0000 7fec9c400640 1 --2- 172.21.15.55:0/87272638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec9415f250 0x7fec9415da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.913+0000 7fec9c400640 1 --2- 172.21.15.55:0/87272638 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec740666c0 0x7fec74068b80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.913+0000 7fec9c400640 1 --2- 172.21.15.55:0/87272638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec9415ee70 0x7fec940ae180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.913+0000 7fec9c400640 1 --2- 172.21.15.55:0/87272638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec94098a10 0x7fec940af1b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:18.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.913+0000 7fec9c400640 1 -- 172.21.15.55:0/87272638 >> 172.21.15.55:0/87272638 conn(0x7fec940b21d0 msgr2=0x7fec940cd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:18.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.913+0000 7fec9c400640 1 -- 172.21.15.55:0/87272638 shutdown_connections 2024-04-02T07:22:18.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:18.913+0000 7fec9c400640 1 -- 172.21.15.55:0/87272638 wait complete. 2024-04-02T07:22:18.938 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-02T07:22:19.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.077+0000 7fd7e7800640 1 Processor -- start 2024-04-02T07:22:19.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.077+0000 7fd7e7800640 1 -- start start 2024-04-02T07:22:19.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.077+0000 7fd7e7800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd7e015c920 0x7fd7e00b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:19.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.077+0000 7fd7e7800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd7e00cd690 0x7fd7e006aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:19.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.077+0000 7fd7e7800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7e015de30 con 0x7fd7e00afa70 2024-04-02T07:22:19.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.077+0000 7fd7e7800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e0098ab0 con 0x7fd7e00cd690 2024-04-02T07:22:19.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.077+0000 7fd7e7800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e0098d90 con 0x7fd7e015c920 2024-04-02T07:22:19.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.077+0000 7fd7e5800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd7e00cd690 0x7fd7e006aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:19.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.077+0000 7fd7d7e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd7e00afa70 0x7fd7e00ccf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57264/0 (socket says 172.21.15.55:57264) 2024-04-02T07:22:19.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.077+0000 7fd7d7e00640 1 -- 172.21.15.55:0/1264889553 learned_addr learned my addr 172.21.15.55:0/1264889553 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:19.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.077+0000 7fd7e4e00640 1 --2- 172.21.15.55:0/1264889553 >> v2:172.21.15.106:3300/0 conn(0x7fd7e015c920 0x7fd7e00b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:19.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.077+0000 7fd7e5800640 1 -- 172.21.15.55:0/1264889553 >> v2:172.21.15.106:3300/0 conn(0x7fd7e015c920 msgr2=0x7fd7e00b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:19.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.077+0000 7fd7e5800640 1 --2- 172.21.15.55:0/1264889553 >> v2:172.21.15.106:3300/0 conn(0x7fd7e015c920 0x7fd7e00b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:19.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.077+0000 7fd7e5800640 1 -- 172.21.15.55:0/1264889553 >> v1:172.21.15.55:6789/0 conn(0x7fd7e00afa70 legacy=0x7fd7e00ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:19.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.077+0000 7fd7e5800640 1 -- 172.21.15.55:0/1264889553 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e0099070 con 0x7fd7e00cd690 2024-04-02T07:22:19.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.081+0000 7fd7e5800640 1 --2- 172.21.15.55:0/1264889553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7e00cd690 0x7fd7e006aea0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00b3230 tx=0x7fd7d801c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=180f2cdeb8596fcb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:19.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.081+0000 7fd7dfe00640 1 -- 172.21.15.55:0/1264889553 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80a5920 con 0x7fd7e00cd690 2024-04-02T07:22:19.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.081+0000 7fd7dfe00640 1 -- 172.21.15.55:0/1264889553 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d80a5a80 con 0x7fd7e00cd690 2024-04-02T07:22:19.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.081+0000 7fd7dfe00640 1 -- 172.21.15.55:0/1264889553 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d80a5e10 con 0x7fd7e00cd690 2024-04-02T07:22:19.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.081+0000 7fd7e7800640 1 -- 172.21.15.55:0/1264889553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7e00cd690 msgr2=0x7fd7e006aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:19.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.081+0000 7fd7e7800640 1 --2- 172.21.15.55:0/1264889553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7e00cd690 0x7fd7e006aea0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd7e00b3230 tx=0x7fd7d801c900 comp rx=0 tx=0).stop 2024-04-02T07:22:19.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.081+0000 7fd7e7800640 1 -- 172.21.15.55:0/1264889553 shutdown_connections 2024-04-02T07:22:19.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.081+0000 7fd7e7800640 1 --2- 172.21.15.55:0/1264889553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7e00cd690 0x7fd7e006aea0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:19.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.081+0000 7fd7e7800640 1 --2- 172.21.15.55:0/1264889553 >> v2:172.21.15.106:3300/0 conn(0x7fd7e015c920 0x7fd7e00b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:19.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.081+0000 7fd7e7800640 1 -- 172.21.15.55:0/1264889553 >> 172.21.15.55:0/1264889553 conn(0x7fd7e00d0700 msgr2=0x7fd7e00d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:19.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.081+0000 7fd7e7800640 1 -- 172.21.15.55:0/1264889553 shutdown_connections 2024-04-02T07:22:19.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.081+0000 7fd7e7800640 1 -- 172.21.15.55:0/1264889553 wait complete. 2024-04-02T07:22:19.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7e7800640 1 Processor -- start 2024-04-02T07:22:19.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7e7800640 1 -- start start 2024-04-02T07:22:19.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7e7800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7e00afa70 0x7fd7e0149760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:19.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7e7800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7e00cd690 0x7fd7e0154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:19.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7e7800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7e015c920 0x7fd7e00cccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:19.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7e7800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e00cd230 con 0x7fd7e00cd690 2024-04-02T07:22:19.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7e7800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e00cd460 con 0x7fd7e015c920 2024-04-02T07:22:19.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7e7800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e0156380 con 0x7fd7e00afa70 2024-04-02T07:22:19.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7d7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7e00cd690 0x7fd7e0154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:19.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7d7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7e00cd690 0x7fd7e0154720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51474/0 (socket says 172.21.15.55:51474) 2024-04-02T07:22:19.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7d7e00640 1 -- 172.21.15.55:0/1030988083 learned_addr learned my addr 172.21.15.55:0/1030988083 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:19.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7e5800640 1 --2- 172.21.15.55:0/1030988083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7e015c920 0x7fd7e00cccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:19.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7e4e00640 1 --2- 172.21.15.55:0/1030988083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7e00afa70 0x7fd7e0149760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:19.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7d7e00640 1 -- 172.21.15.55:0/1030988083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7e00afa70 msgr2=0x7fd7e0149760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:19.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7d7e00640 1 --2- 172.21.15.55:0/1030988083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7e00afa70 0x7fd7e0149760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:19.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7d7e00640 1 -- 172.21.15.55:0/1030988083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7e015c920 msgr2=0x7fd7e00cccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:19.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7d7e00640 1 --2- 172.21.15.55:0/1030988083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7e015c920 0x7fd7e00cccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:19.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7d7e00640 1 -- 172.21.15.55:0/1030988083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d8009a70 con 0x7fd7e00cd690 2024-04-02T07:22:19.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7d7e00640 1 --2- 172.21.15.55:0/1030988083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7e00cd690 0x7fd7e0154720 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800c400 tx=0x7fd7c800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:19.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7dd600640 1 -- 172.21.15.55:0/1030988083 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8005cf0 con 0x7fd7e00cd690 2024-04-02T07:22:19.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7dd600640 1 -- 172.21.15.55:0/1030988083 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7c8005e50 con 0x7fd7e00cd690 2024-04-02T07:22:19.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7dd600640 1 -- 172.21.15.55:0/1030988083 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8007310 con 0x7fd7e00cd690 2024-04-02T07:22:19.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7e7800640 1 -- 172.21.15.55:0/1030988083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e0159a30 con 0x7fd7e00cd690 2024-04-02T07:22:19.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.085+0000 7fd7e7800640 1 -- 172.21.15.55:0/1030988083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e0159ff0 con 0x7fd7e00cd690 2024-04-02T07:22:19.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.089+0000 7fd7e7800640 1 -- 172.21.15.55:0/1030988083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e0066c90 con 0x7fd7e00cd690 2024-04-02T07:22:19.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.089+0000 7fd7dd600640 1 -- 172.21.15.55:0/1030988083 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd7c8007470 con 0x7fd7e00cd690 2024-04-02T07:22:19.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.089+0000 7fd7dd600640 1 --2- 172.21.15.55:0/1030988083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd7bc066690 0x7fd7bc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:19.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.089+0000 7fd7dd600640 1 -- 172.21.15.55:0/1030988083 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd7c80836f0 con 0x7fd7e00cd690 2024-04-02T07:22:19.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.089+0000 7fd7e4e00640 1 --2- 172.21.15.55:0/1030988083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd7bc066690 0x7fd7bc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:19.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.089+0000 7fd7e4e00640 1 --2- 172.21.15.55:0/1030988083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd7bc066690 0x7fd7bc068b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00079c0 tx=0x7fd7d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:19.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.093+0000 7fd7dd600640 1 -- 172.21.15.55:0/1030988083 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd7c8050b00 con 0x7fd7e00cd690 2024-04-02T07:22:19.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:19.293+0000 7fd7e7800640 1 -- 172.21.15.55:0/1030988083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd7e00c7590 con 0x7fd7e00cd690 2024-04-02T07:22:20.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.221+0000 7fd7dd600640 1 -- 172.21.15.55:0/1030988083 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd7c8054120 con 0x7fd7e00cd690 2024-04-02T07:22:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.225+0000 7fd7e7800640 1 -- 172.21.15.55:0/1030988083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd7bc066690 msgr2=0x7fd7bc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.225+0000 7fd7e7800640 1 --2- 172.21.15.55:0/1030988083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd7bc066690 0x7fd7bc068b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7d00079c0 tx=0x7fd7d0008040 comp rx=0 tx=0).stop 2024-04-02T07:22:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.225+0000 7fd7e7800640 1 -- 172.21.15.55:0/1030988083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7e00cd690 msgr2=0x7fd7e0154720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.225+0000 7fd7e7800640 1 --2- 172.21.15.55:0/1030988083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7e00cd690 0x7fd7e0154720 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800c400 tx=0x7fd7c800c8c0 comp rx=0 tx=0).stop 2024-04-02T07:22:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.225+0000 7fd7e7800640 1 -- 172.21.15.55:0/1030988083 shutdown_connections 2024-04-02T07:22:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.225+0000 7fd7e7800640 1 --2- 172.21.15.55:0/1030988083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd7bc066690 0x7fd7bc068b50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.225+0000 7fd7e7800640 1 --2- 172.21.15.55:0/1030988083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd7e015c920 0x7fd7e00cccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.225+0000 7fd7e7800640 1 --2- 172.21.15.55:0/1030988083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd7e00cd690 0x7fd7e0154720 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.225+0000 7fd7e7800640 1 --2- 172.21.15.55:0/1030988083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd7e00afa70 0x7fd7e0149760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.225+0000 7fd7e7800640 1 -- 172.21.15.55:0/1030988083 >> 172.21.15.55:0/1030988083 conn(0x7fd7e00d0700 msgr2=0x7fd7e006ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.225+0000 7fd7e7800640 1 -- 172.21.15.55:0/1030988083 shutdown_connections 2024-04-02T07:22:20.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.225+0000 7fd7e7800640 1 -- 172.21.15.55:0/1030988083 wait complete. 2024-04-02T07:22:20.251 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-02T07:22:20.251 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-02T07:22:20.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.397+0000 7f53e1800640 1 Processor -- start 2024-04-02T07:22:20.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.397+0000 7f53e1800640 1 -- start start 2024-04-02T07:22:20.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.397+0000 7f53e1800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53dc142f70 0x7f53dc0702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:20.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.397+0000 7f53e1800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f53dc1611f0 0x7f53dc0707e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:20.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.397+0000 7f53e1800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53dc15dc70 con 0x7f53dc15cf50 2024-04-02T07:22:20.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.397+0000 7f53e1800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53dc15df50 con 0x7f53dc1611f0 2024-04-02T07:22:20.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.397+0000 7f53e1800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc160710 con 0x7f53dc142f70 2024-04-02T07:22:20.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.397+0000 7f53daa00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53dc142f70 0x7f53dc0702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:20.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.397+0000 7f53d2000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f53dc1611f0 0x7f53dc0707e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:20.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.397+0000 7f53daa00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53dc142f70 0x7f53dc0702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:48070/0 (socket says 172.21.15.55:48070) 2024-04-02T07:22:20.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.397+0000 7f53daa00640 1 -- 172.21.15.55:0/4065129855 learned_addr learned my addr 172.21.15.55:0/4065129855 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:20.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.397+0000 7f53db400640 1 --1- 172.21.15.55:0/4065129855 >> v1:172.21.15.106:6789/0 conn(0x7f53dc15cf50 0x7f53dc15d400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:53052/0 (socket says 172.21.15.55:53052) 2024-04-02T07:22:20.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.397+0000 7f53daa00640 1 -- 172.21.15.55:0/4065129855 >> v2:172.21.15.106:3300/0 conn(0x7f53dc1611f0 msgr2=0x7f53dc0707e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:20.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.397+0000 7f53daa00640 1 --2- 172.21.15.55:0/4065129855 >> v2:172.21.15.106:3300/0 conn(0x7f53dc1611f0 0x7f53dc0707e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:20.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.397+0000 7f53daa00640 1 -- 172.21.15.55:0/4065129855 >> v1:172.21.15.106:6789/0 conn(0x7f53dc15cf50 legacy=0x7f53dc15d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:20.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.397+0000 7f53daa00640 1 -- 172.21.15.55:0/4065129855 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53dc1609f0 con 0x7f53dc142f70 2024-04-02T07:22:20.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.401+0000 7f53daa00640 1 --2- 172.21.15.55:0/4065129855 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53dc142f70 0x7f53dc0702a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009870 tx=0x7f53cc01c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb520fcf03d50df server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:20.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.401+0000 7f53da000640 1 -- 172.21.15.55:0/4065129855 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc0a9610 con 0x7f53dc142f70 2024-04-02T07:22:20.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.401+0000 7f53da000640 1 -- 172.21.15.55:0/4065129855 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc0a9770 con 0x7f53dc142f70 2024-04-02T07:22:20.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.401+0000 7f53da000640 1 -- 172.21.15.55:0/4065129855 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc0a9b00 con 0x7f53dc142f70 2024-04-02T07:22:20.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.401+0000 7f53e1800640 1 -- 172.21.15.55:0/4065129855 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53dc142f70 msgr2=0x7f53dc0702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:20.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.401+0000 7f53e1800640 1 --2- 172.21.15.55:0/4065129855 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53dc142f70 0x7f53dc0702a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f53cc009870 tx=0x7f53cc01c530 comp rx=0 tx=0).stop 2024-04-02T07:22:20.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.401+0000 7f53e1800640 1 -- 172.21.15.55:0/4065129855 shutdown_connections 2024-04-02T07:22:20.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.401+0000 7f53e1800640 1 --2- 172.21.15.55:0/4065129855 >> v2:172.21.15.106:3300/0 conn(0x7f53dc1611f0 0x7f53dc0707e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:20.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.401+0000 7f53e1800640 1 --2- 172.21.15.55:0/4065129855 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53dc142f70 0x7f53dc0702a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:20.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.401+0000 7f53e1800640 1 -- 172.21.15.55:0/4065129855 >> 172.21.15.55:0/4065129855 conn(0x7f53dc06a390 msgr2=0x7f53dc0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:20.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.401+0000 7f53e1800640 1 -- 172.21.15.55:0/4065129855 shutdown_connections 2024-04-02T07:22:20.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.401+0000 7f53e1800640 1 -- 172.21.15.55:0/4065129855 wait complete. 2024-04-02T07:22:20.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53e1800640 1 Processor -- start 2024-04-02T07:22:20.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53e1800640 1 -- start start 2024-04-02T07:22:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53e1800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53dc142f70 0x7f53dc1f7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53e1800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53dc15cf50 0x7f53dc13c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53e1800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53dc1611f0 0x7f53dc13ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53e1800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc0afc90 con 0x7f53dc142f70 2024-04-02T07:22:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53e1800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc0b2e10 con 0x7f53dc1611f0 2024-04-02T07:22:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53e1800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53dc1f8070 con 0x7f53dc15cf50 2024-04-02T07:22:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53daa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53dc142f70 0x7f53dc1f7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53daa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53dc142f70 0x7f53dc1f7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51478/0 (socket says 172.21.15.55:51478) 2024-04-02T07:22:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53daa00640 1 -- 172.21.15.55:0/3928826531 learned_addr learned my addr 172.21.15.55:0/3928826531 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53db400640 1 --2- 172.21.15.55:0/3928826531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53dc1611f0 0x7f53dc13ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53d2000640 1 --2- 172.21.15.55:0/3928826531 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53dc15cf50 0x7f53dc13c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:20.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53daa00640 1 -- 172.21.15.55:0/3928826531 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53dc15cf50 msgr2=0x7f53dc13c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:20.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53daa00640 1 --2- 172.21.15.55:0/3928826531 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53dc15cf50 0x7f53dc13c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:20.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53daa00640 1 -- 172.21.15.55:0/3928826531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53dc1611f0 msgr2=0x7f53dc13ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:20.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53daa00640 1 --2- 172.21.15.55:0/3928826531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53dc1611f0 0x7f53dc13ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:20.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53daa00640 1 -- 172.21.15.55:0/3928826531 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc0094d0 con 0x7f53dc142f70 2024-04-02T07:22:20.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53db400640 1 --2- 172.21.15.55:0/3928826531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53dc1611f0 0x7f53dc13ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:20.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53daa00640 1 --2- 172.21.15.55:0/3928826531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53dc142f70 0x7f53dc1f7b30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0ab040 tx=0x7f53cc01ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53d3400640 1 -- 172.21.15.55:0/3928826531 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc0bc450 con 0x7f53dc142f70 2024-04-02T07:22:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53d3400640 1 -- 172.21.15.55:0/3928826531 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc0bc5d0 con 0x7f53dc142f70 2024-04-02T07:22:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53d3400640 1 -- 172.21.15.55:0/3928826531 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53cc0bc980 con 0x7f53dc142f70 2024-04-02T07:22:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53e1800640 1 -- 172.21.15.55:0/3928826531 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53dc0af110 con 0x7f53dc142f70 2024-04-02T07:22:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.405+0000 7f53e1800640 1 -- 172.21.15.55:0/3928826531 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53dc0af6d0 con 0x7f53dc142f70 2024-04-02T07:22:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.409+0000 7f53e1800640 1 -- 172.21.15.55:0/3928826531 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53dc073530 con 0x7f53dc142f70 2024-04-02T07:22:20.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.409+0000 7f53d3400640 1 -- 172.21.15.55:0/3928826531 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f53cc0b13f0 con 0x7f53dc142f70 2024-04-02T07:22:20.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.409+0000 7f53d3400640 1 --2- 172.21.15.55:0/3928826531 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f53b8066690 0x7f53b8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:20.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.409+0000 7f53d3400640 1 -- 172.21.15.55:0/3928826531 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53cc11e910 con 0x7f53dc142f70 2024-04-02T07:22:20.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.409+0000 7f53d2000640 1 --2- 172.21.15.55:0/3928826531 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f53b8066690 0x7f53b8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:20.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.409+0000 7f53d2000640 1 --2- 172.21.15.55:0/3928826531 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f53b8066690 0x7f53b8068b50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53dc0cd9f0 tx=0x7f53c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:20.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.413+0000 7f53d3400640 1 -- 172.21.15.55:0/3928826531 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f53cc0ebb50 con 0x7f53dc142f70 2024-04-02T07:22:20.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:20.609+0000 7f53e1800640 1 -- 172.21.15.55:0/3928826531 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f53dc066c90 con 0x7f53dc142f70 2024-04-02T07:22:21.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.233+0000 7f53d3400640 1 -- 172.21.15.55:0/3928826531 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f53cc0ef170 con 0x7f53dc142f70 2024-04-02T07:22:21.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.233+0000 7f53e1800640 1 -- 172.21.15.55:0/3928826531 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f53b8066690 msgr2=0x7f53b8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:21.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.233+0000 7f53e1800640 1 --2- 172.21.15.55:0/3928826531 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f53b8066690 0x7f53b8068b50 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53dc0cd9f0 tx=0x7f53c4008040 comp rx=0 tx=0).stop 2024-04-02T07:22:21.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.233+0000 7f53e1800640 1 -- 172.21.15.55:0/3928826531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53dc142f70 msgr2=0x7f53dc1f7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:21.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.233+0000 7f53e1800640 1 --2- 172.21.15.55:0/3928826531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53dc142f70 0x7f53dc1f7b30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0ab040 tx=0x7f53cc01ad70 comp rx=0 tx=0).stop 2024-04-02T07:22:21.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.233+0000 7f53e1800640 1 -- 172.21.15.55:0/3928826531 shutdown_connections 2024-04-02T07:22:21.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.233+0000 7f53e1800640 1 --2- 172.21.15.55:0/3928826531 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f53b8066690 0x7f53b8068b50 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:21.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.233+0000 7f53e1800640 1 --2- 172.21.15.55:0/3928826531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53dc1611f0 0x7f53dc13ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:21.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.233+0000 7f53e1800640 1 --2- 172.21.15.55:0/3928826531 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53dc15cf50 0x7f53dc13c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:21.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.233+0000 7f53e1800640 1 --2- 172.21.15.55:0/3928826531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53dc142f70 0x7f53dc1f7b30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:21.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.233+0000 7f53e1800640 1 -- 172.21.15.55:0/3928826531 >> 172.21.15.55:0/3928826531 conn(0x7f53dc06a390 msgr2=0x7f53dc15e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:21.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.233+0000 7f53e1800640 1 -- 172.21.15.55:0/3928826531 shutdown_connections 2024-04-02T07:22:21.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.233+0000 7f53e1800640 1 -- 172.21.15.55:0/3928826531 wait complete. 2024-04-02T07:22:21.261 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-02T07:22:21.262 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:22:21.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.401+0000 7fd0abc00640 1 Processor -- start 2024-04-02T07:22:21.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.401+0000 7fd0abc00640 1 -- start start 2024-04-02T07:22:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.405+0000 7fd0abc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd0a415ee70 0x7fd0a4099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.405+0000 7fd0abc00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a40ad270 con 0x7fd0a415f250 2024-04-02T07:22:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.405+0000 7fd0abc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0a40b0a50 con 0x7fd0a4099120 2024-04-02T07:22:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.405+0000 7fd0abc00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0a40b0840 con 0x7fd0a415ee70 2024-04-02T07:22:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.405+0000 7fd0a3e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd0a415f250 0x7fd0a4098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57274/0 (socket says 172.21.15.55:57274) 2024-04-02T07:22:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.405+0000 7fd0a3e00640 1 -- 172.21.15.55:0/2511125360 learned_addr learned my addr 172.21.15.55:0/2511125360 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.405+0000 7fd0a9200640 1 --2- 172.21.15.55:0/2511125360 >> v2:172.21.15.106:3300/0 conn(0x7fd0a415ee70 0x7fd0a4099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.405+0000 7fd0a3400640 1 -- 172.21.15.55:0/2511125360 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197204826 0 0) 0x7fd0a40ad270 con 0x7fd0a415f250 2024-04-02T07:22:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.405+0000 7fd0a3400640 1 -- 172.21.15.55:0/2511125360 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd08c003530 con 0x7fd0a415f250 2024-04-02T07:22:21.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.405+0000 7fd0a9200640 1 -- 172.21.15.55:0/2511125360 >> v1:172.21.15.106:6789/0 conn(0x7fd0a4099120 legacy=0x7fd0a40ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:21.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.405+0000 7fd0a9200640 1 -- 172.21.15.55:0/2511125360 >> v1:172.21.15.55:6789/0 conn(0x7fd0a415f250 legacy=0x7fd0a4098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:21.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.405+0000 7fd0a3400640 1 -- 172.21.15.55:0/2511125360 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2515469336 0 0) 0x7fd08c003530 con 0x7fd0a415f250 2024-04-02T07:22:21.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.405+0000 7fd0a9200640 1 -- 172.21.15.55:0/2511125360 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0a40b0d30 con 0x7fd0a415ee70 2024-04-02T07:22:21.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.409+0000 7fd0a9200640 1 --2- 172.21.15.55:0/2511125360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0a415ee70 0x7fd0a4099830 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd0980097c0 tx=0x7fd09801c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd7492598a997d9b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:21.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.409+0000 7fd0a3400640 1 -- 172.21.15.55:0/2511125360 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd090001680 con 0x7fd0a415ee70 2024-04-02T07:22:21.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.409+0000 7fd0a3400640 1 -- 172.21.15.55:0/2511125360 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0980a7050 con 0x7fd0a415ee70 2024-04-02T07:22:21.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.409+0000 7fd0a3400640 1 -- 172.21.15.55:0/2511125360 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0980ab600 con 0x7fd0a415ee70 2024-04-02T07:22:21.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.409+0000 7fd0abc00640 1 -- 172.21.15.55:0/2511125360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0a415ee70 msgr2=0x7fd0a4099830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:21.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.409+0000 7fd0abc00640 1 --2- 172.21.15.55:0/2511125360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0a415ee70 0x7fd0a4099830 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd0980097c0 tx=0x7fd09801c390 comp rx=0 tx=0).stop 2024-04-02T07:22:21.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.409+0000 7fd0abc00640 1 -- 172.21.15.55:0/2511125360 shutdown_connections 2024-04-02T07:22:21.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.409+0000 7fd0abc00640 1 --2- 172.21.15.55:0/2511125360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0a415ee70 0x7fd0a4099830 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:21.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.409+0000 7fd0abc00640 1 -- 172.21.15.55:0/2511125360 >> 172.21.15.55:0/2511125360 conn(0x7fd0a40b21d0 msgr2=0x7fd0a40b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:21.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.409+0000 7fd0abc00640 1 -- 172.21.15.55:0/2511125360 shutdown_connections 2024-04-02T07:22:21.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.409+0000 7fd0abc00640 1 -- 172.21.15.55:0/2511125360 wait complete. 2024-04-02T07:22:21.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.409+0000 7fd0abc00640 1 Processor -- start 2024-04-02T07:22:21.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.409+0000 7fd0abc00640 1 -- start start 2024-04-02T07:22:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0abc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0a4099120 0x7fd0a40b4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:21.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0abc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0a415ee70 0x7fd0a40ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0abc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0a415f250 0x7fd0a40b58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0abc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40ca670 con 0x7fd0a415f250 2024-04-02T07:22:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0abc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40b4850 con 0x7fd0a415ee70 2024-04-02T07:22:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0abc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0a40b4b30 con 0x7fd0a4099120 2024-04-02T07:22:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0a9c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0a415f250 0x7fd0a40b58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0a9c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0a415f250 0x7fd0a40b58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51482/0 (socket says 172.21.15.55:51482) 2024-04-02T07:22:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0a9c00640 1 -- 172.21.15.55:0/914144172 learned_addr learned my addr 172.21.15.55:0/914144172 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0a3e00640 1 --2- 172.21.15.55:0/914144172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0a415ee70 0x7fd0a40ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0a9200640 1 --2- 172.21.15.55:0/914144172 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0a4099120 0x7fd0a40b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0a9c00640 1 -- 172.21.15.55:0/914144172 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0a4099120 msgr2=0x7fd0a40b4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:21.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0a9c00640 1 --2- 172.21.15.55:0/914144172 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0a4099120 0x7fd0a40b4220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0a9c00640 1 -- 172.21.15.55:0/914144172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0a415ee70 msgr2=0x7fd0a40ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0a9c00640 1 --2- 172.21.15.55:0/914144172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0a415ee70 0x7fd0a40ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0a9c00640 1 -- 172.21.15.55:0/914144172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd098009420 con 0x7fd0a415f250 2024-04-02T07:22:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0a9c00640 1 --2- 172.21.15.55:0/914144172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0a415f250 0x7fd0a40b58d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00c730 tx=0x7fd09c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0a0c00640 1 -- 172.21.15.55:0/914144172 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c003b80 con 0x7fd0a415f250 2024-04-02T07:22:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0a0c00640 1 -- 172.21.15.55:0/914144172 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd09c003ce0 con 0x7fd0a415f250 2024-04-02T07:22:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0abc00640 1 -- 172.21.15.55:0/914144172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0a40b4e10 con 0x7fd0a415f250 2024-04-02T07:22:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0a0c00640 1 -- 172.21.15.55:0/914144172 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd09c00aa30 con 0x7fd0a415f250 2024-04-02T07:22:21.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0abc00640 1 -- 172.21.15.55:0/914144172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0a40b53d0 con 0x7fd0a415f250 2024-04-02T07:22:21.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.413+0000 7fd0abc00640 1 -- 172.21.15.55:0/914144172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0a4066c90 con 0x7fd0a415f250 2024-04-02T07:22:21.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.417+0000 7fd0a0c00640 1 -- 172.21.15.55:0/914144172 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd09c00ab90 con 0x7fd0a415f250 2024-04-02T07:22:21.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.417+0000 7fd0a0c00640 1 --2- 172.21.15.55:0/914144172 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd084066690 0x7fd084068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:21.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.417+0000 7fd0a0c00640 1 -- 172.21.15.55:0/914144172 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd09c083ea0 con 0x7fd0a415f250 2024-04-02T07:22:21.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.417+0000 7fd0a9200640 1 --2- 172.21.15.55:0/914144172 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd084066690 0x7fd084068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:21.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.417+0000 7fd0a9200640 1 --2- 172.21.15.55:0/914144172 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd084066690 0x7fd084068b50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd0980ad000 tx=0x7fd0980a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:21.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.421+0000 7fd0a0c00640 1 -- 172.21.15.55:0/914144172 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd09c051220 con 0x7fd0a415f250 2024-04-02T07:22:21.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.617+0000 7fd0abc00640 1 -- 172.21.15.55:0/914144172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd0a4099910 con 0x7fd0a415f250 2024-04-02T07:22:21.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.617+0000 7fd0a0c00640 1 -- 172.21.15.55:0/914144172 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4725 (secure 0 0 0) 0x7fd09c054840 con 0x7fd0a415f250 2024-04-02T07:22:21.623 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:21.623 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1468533802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1468533802},{"type":"v1","addr":"172.21.15.106:6837","nonce":1468533802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/342047131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":342047131},{"type":"v1","addr":"172.21.15.55:6833","nonce":342047131}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/50847499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":50847499},{"type":"v1","addr":"172.21.15.55:6835","nonce":50847499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:22:18.201059+0000","modified":"2024-04-02T07:22:21.225641+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6836/3829467285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3829467285},{"type":"v1","addr":"172.21.15.106:6836","nonce":3829467285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-02T07:22:21.623 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2024-04-02T07:22:21.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.621+0000 7fd0abc00640 1 -- 172.21.15.55:0/914144172 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd084066690 msgr2=0x7fd084068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:21.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.621+0000 7fd0abc00640 1 --2- 172.21.15.55:0/914144172 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd084066690 0x7fd084068b50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd0980ad000 tx=0x7fd0980a6000 comp rx=0 tx=0).stop 2024-04-02T07:22:21.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.621+0000 7fd0abc00640 1 -- 172.21.15.55:0/914144172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0a415f250 msgr2=0x7fd0a40b58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:21.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.621+0000 7fd0abc00640 1 --2- 172.21.15.55:0/914144172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0a415f250 0x7fd0a40b58d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd09c00c730 tx=0x7fd09c00cbf0 comp rx=0 tx=0).stop 2024-04-02T07:22:21.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.621+0000 7fd0abc00640 1 -- 172.21.15.55:0/914144172 shutdown_connections 2024-04-02T07:22:21.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.621+0000 7fd0abc00640 1 --2- 172.21.15.55:0/914144172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd0a415f250 0x7fd0a40b58d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:21.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.621+0000 7fd0abc00640 1 --2- 172.21.15.55:0/914144172 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd084066690 0x7fd084068b50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:21.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.621+0000 7fd0abc00640 1 --2- 172.21.15.55:0/914144172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd0a415ee70 0x7fd0a40ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:21.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.621+0000 7fd0abc00640 1 --2- 172.21.15.55:0/914144172 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd0a4099120 0x7fd0a40b4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:21.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.621+0000 7fd0abc00640 1 -- 172.21.15.55:0/914144172 >> 172.21.15.55:0/914144172 conn(0x7fd0a40b21d0 msgr2=0x7fd0a40af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:21.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.621+0000 7fd0abc00640 1 -- 172.21.15.55:0/914144172 shutdown_connections 2024-04-02T07:22:21.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.621+0000 7fd0abc00640 1 -- 172.21.15.55:0/914144172 wait complete. 2024-04-02T07:22:21.644 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:21.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.781+0000 7feee2e00640 1 Processor -- start 2024-04-02T07:22:21.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.781+0000 7feee2e00640 1 -- start start 2024-04-02T07:22:21.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.781+0000 7feee2e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feedc09faa0 0x7feedc069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:21.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.781+0000 7feee2e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feedc06cba0 con 0x7feedc0ca9c0 2024-04-02T07:22:21.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.781+0000 7feee2e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feedc0cb610 con 0x7feedc15dbe0 2024-04-02T07:22:21.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.781+0000 7feee2e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feedc0ca570 con 0x7feedc09faa0 2024-04-02T07:22:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.781+0000 7feee2400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feedc0ca9c0 0x7feedc06e580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57276/0 (socket says 172.21.15.55:57276) 2024-04-02T07:22:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.781+0000 7feee2400640 1 -- 172.21.15.55:0/2431164867 learned_addr learned my addr 172.21.15.55:0/2431164867 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.781+0000 7feee1000640 1 --2- 172.21.15.55:0/2431164867 >> v2:172.21.15.106:3300/0 conn(0x7feedc09faa0 0x7feedc069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.781+0000 7feedbe00640 1 -- 172.21.15.55:0/2431164867 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4149726685 0 0) 0x7feedc06cba0 con 0x7feedc0ca9c0 2024-04-02T07:22:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.781+0000 7feedbe00640 1 -- 172.21.15.55:0/2431164867 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feec4003530 con 0x7feedc0ca9c0 2024-04-02T07:22:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.781+0000 7feedbe00640 1 -- 172.21.15.55:0/2431164867 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1596455335 0 0) 0x7feedc0cb610 con 0x7feedc15dbe0 2024-04-02T07:22:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.781+0000 7feedbe00640 1 -- 172.21.15.55:0/2431164867 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feedc06cba0 con 0x7feedc15dbe0 2024-04-02T07:22:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.781+0000 7feee1000640 1 -- 172.21.15.55:0/2431164867 >> v1:172.21.15.106:6789/0 conn(0x7feedc15dbe0 legacy=0x7feedc0caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.781+0000 7feee1000640 1 -- 172.21.15.55:0/2431164867 >> v1:172.21.15.55:6789/0 conn(0x7feedc0ca9c0 legacy=0x7feedc06e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.781+0000 7feee1000640 1 -- 172.21.15.55:0/2431164867 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feedc15ee50 con 0x7feedc09faa0 2024-04-02T07:22:21.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.785+0000 7feee1000640 1 --2- 172.21.15.55:0/2431164867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feedc09faa0 0x7feedc069d90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feec80097c0 tx=0x7feec801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=796d3a23fe54ff34 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:21.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.785+0000 7feedbe00640 1 -- 172.21.15.55:0/2431164867 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feedc06f4a0 con 0x7feedc09faa0 2024-04-02T07:22:21.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.785+0000 7feedbe00640 1 -- 172.21.15.55:0/2431164867 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec80ad680 con 0x7feedc09faa0 2024-04-02T07:22:21.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.785+0000 7feedbe00640 1 -- 172.21.15.55:0/2431164867 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec80ada10 con 0x7feedc09faa0 2024-04-02T07:22:21.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.785+0000 7feee2e00640 1 -- 172.21.15.55:0/2431164867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feedc09faa0 msgr2=0x7feedc069d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:21.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.785+0000 7feee2e00640 1 --2- 172.21.15.55:0/2431164867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feedc09faa0 0x7feedc069d90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7feec80097c0 tx=0x7feec801c470 comp rx=0 tx=0).stop 2024-04-02T07:22:21.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.785+0000 7feee2e00640 1 -- 172.21.15.55:0/2431164867 shutdown_connections 2024-04-02T07:22:21.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.785+0000 7feee2e00640 1 --2- 172.21.15.55:0/2431164867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feedc09faa0 0x7feedc069d90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:21.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.785+0000 7feee2e00640 1 -- 172.21.15.55:0/2431164867 >> 172.21.15.55:0/2431164867 conn(0x7feedc0b0900 msgr2=0x7feedc0b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:21.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.785+0000 7feee2e00640 1 -- 172.21.15.55:0/2431164867 shutdown_connections 2024-04-02T07:22:21.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.785+0000 7feee2e00640 1 -- 172.21.15.55:0/2431164867 wait complete. 2024-04-02T07:22:21.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee2e00640 1 Processor -- start 2024-04-02T07:22:21.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee2e00640 1 -- start start 2024-04-02T07:22:21.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee2e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feedc09faa0 0x7feedc154c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:21.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee2e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feedc0ca9c0 0x7feedc159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:21.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee2e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feedc15dbe0 0x7feedc0aece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:21.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee2e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feedc15a0a0 con 0x7feedc0ca9c0 2024-04-02T07:22:21.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee2e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feedc15a350 con 0x7feedc15dbe0 2024-04-02T07:22:21.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee2e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feedc15a630 con 0x7feedc09faa0 2024-04-02T07:22:21.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee1000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feedc0ca9c0 0x7feedc159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:21.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee1000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feedc0ca9c0 0x7feedc159b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51486/0 (socket says 172.21.15.55:51486) 2024-04-02T07:22:21.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee1000640 1 -- 172.21.15.55:0/2386833691 learned_addr learned my addr 172.21.15.55:0/2386833691 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:21.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee2400640 1 --2- 172.21.15.55:0/2386833691 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feedc15dbe0 0x7feedc0aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:21.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee1a00640 1 --2- 172.21.15.55:0/2386833691 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feedc09faa0 0x7feedc154c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:21.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee1000640 1 -- 172.21.15.55:0/2386833691 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feedc09faa0 msgr2=0x7feedc154c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:21.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee1000640 1 --2- 172.21.15.55:0/2386833691 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feedc09faa0 0x7feedc154c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:21.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee1000640 1 -- 172.21.15.55:0/2386833691 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feedc15dbe0 msgr2=0x7feedc0aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:21.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee1000640 1 --2- 172.21.15.55:0/2386833691 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feedc15dbe0 0x7feedc0aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:21.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee1000640 1 -- 172.21.15.55:0/2386833691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec8009420 con 0x7feedc0ca9c0 2024-04-02T07:22:21.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee2400640 1 --2- 172.21.15.55:0/2386833691 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feedc15dbe0 0x7feedc0aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:21.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee1000640 1 --2- 172.21.15.55:0/2386833691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feedc0ca9c0 0x7feedc159b60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feec801a0a0 tx=0x7feec8019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:21.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feed9600640 1 -- 172.21.15.55:0/2386833691 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec80addc0 con 0x7feedc0ca9c0 2024-04-02T07:22:21.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feed9600640 1 -- 172.21.15.55:0/2386833691 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec80b6410 con 0x7feedc0ca9c0 2024-04-02T07:22:21.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feed9600640 1 -- 172.21.15.55:0/2386833691 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec80b67c0 con 0x7feedc0ca9c0 2024-04-02T07:22:21.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee2e00640 1 -- 172.21.15.55:0/2386833691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feedc15a910 con 0x7feedc0ca9c0 2024-04-02T07:22:21.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.789+0000 7feee2e00640 1 -- 172.21.15.55:0/2386833691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feedc15aed0 con 0x7feedc0ca9c0 2024-04-02T07:22:21.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.793+0000 7feee2e00640 1 -- 172.21.15.55:0/2386833691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feedc073fa0 con 0x7feedc0ca9c0 2024-04-02T07:22:21.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.793+0000 7feed9600640 1 -- 172.21.15.55:0/2386833691 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7feec80b4040 con 0x7feedc0ca9c0 2024-04-02T07:22:21.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.793+0000 7feed9600640 1 --2- 172.21.15.55:0/2386833691 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feebc0666c0 0x7feebc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:21.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.793+0000 7feed9600640 1 -- 172.21.15.55:0/2386833691 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feec811dfe0 con 0x7feedc0ca9c0 2024-04-02T07:22:21.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.793+0000 7feee1a00640 1 --2- 172.21.15.55:0/2386833691 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feebc0666c0 0x7feebc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:21.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.793+0000 7feee1a00640 1 --2- 172.21.15.55:0/2386833691 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feebc0666c0 0x7feebc068b80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feed00011f0 tx=0x7feed0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:21.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.797+0000 7feed9600640 1 -- 172.21.15.55:0/2386833691 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7feec80eb380 con 0x7feedc0ca9c0 2024-04-02T07:22:21.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.961+0000 7feee2e00640 1 -- 172.21.15.55:0/2386833691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feedc0b4d90 con 0x7feedc0ca9c0 2024-04-02T07:22:21.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.961+0000 7feed9600640 1 -- 172.21.15.55:0/2386833691 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7feec80ee9a0 con 0x7feedc0ca9c0 2024-04-02T07:22:21.966 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:21.966 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:19.207279+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:21.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.965+0000 7feee2e00640 1 -- 172.21.15.55:0/2386833691 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feebc0666c0 msgr2=0x7feebc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:21.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.965+0000 7feee2e00640 1 --2- 172.21.15.55:0/2386833691 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feebc0666c0 0x7feebc068b80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7feed00011f0 tx=0x7feed0009040 comp rx=0 tx=0).stop 2024-04-02T07:22:21.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.965+0000 7feee2e00640 1 -- 172.21.15.55:0/2386833691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feedc0ca9c0 msgr2=0x7feedc159b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:21.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.965+0000 7feee2e00640 1 --2- 172.21.15.55:0/2386833691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feedc0ca9c0 0x7feedc159b60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7feec801a0a0 tx=0x7feec8019210 comp rx=0 tx=0).stop 2024-04-02T07:22:21.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.965+0000 7feee2e00640 1 -- 172.21.15.55:0/2386833691 shutdown_connections 2024-04-02T07:22:21.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.965+0000 7feee2e00640 1 --2- 172.21.15.55:0/2386833691 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feebc0666c0 0x7feebc068b80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:21.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.965+0000 7feee2e00640 1 --2- 172.21.15.55:0/2386833691 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feedc15dbe0 0x7feedc0aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:21.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.965+0000 7feee2e00640 1 --2- 172.21.15.55:0/2386833691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feedc0ca9c0 0x7feedc159b60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:21.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.965+0000 7feee2e00640 1 --2- 172.21.15.55:0/2386833691 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feedc09faa0 0x7feedc154c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:21.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.965+0000 7feee2e00640 1 -- 172.21.15.55:0/2386833691 >> 172.21.15.55:0/2386833691 conn(0x7feedc0b0900 msgr2=0x7feedc0ccbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:21.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.965+0000 7feee2e00640 1 -- 172.21.15.55:0/2386833691 shutdown_connections 2024-04-02T07:22:21.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:21.965+0000 7feee2e00640 1 -- 172.21.15.55:0/2386833691 wait complete. 2024-04-02T07:22:21.987 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-02T07:22:21.988 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:22:22.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.125+0000 7f1943000640 1 Processor -- start 2024-04-02T07:22:22.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.125+0000 7f1943000640 1 -- start start 2024-04-02T07:22:22.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.125+0000 7f1943000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f193c099120 0x7f193c0b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:22.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.125+0000 7f1943000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f193c06aff0 0x7f193c06b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:22.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.125+0000 7f1943000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f193c15ce50 con 0x7f193c15ca70 2024-04-02T07:22:22.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.125+0000 7f1943000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f193c0cef60 con 0x7f193c06aff0 2024-04-02T07:22:22.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.125+0000 7f1943000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c06bd60 con 0x7f193c099120 2024-04-02T07:22:22.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.125+0000 7f193be00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f193c15ca70 0x7f193c098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57282/0 (socket says 172.21.15.55:57282) 2024-04-02T07:22:22.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.125+0000 7f193be00640 1 -- 172.21.15.55:0/3042033565 learned_addr learned my addr 172.21.15.55:0/3042033565 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:22.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.125+0000 7f1933e00640 1 --2- 172.21.15.55:0/3042033565 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f193c099120 0x7f193c0b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:22.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.125+0000 7f1941000640 1 --2- 172.21.15.55:0/3042033565 >> v2:172.21.15.106:3300/0 conn(0x7f193c06aff0 0x7f193c06b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:22.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.125+0000 7f193b400640 1 -- 172.21.15.55:0/3042033565 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4291852461 0 0) 0x7f193c15ce50 con 0x7f193c15ca70 2024-04-02T07:22:22.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.125+0000 7f193b400640 1 -- 172.21.15.55:0/3042033565 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1920003530 con 0x7f193c15ca70 2024-04-02T07:22:22.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.125+0000 7f1941000640 1 -- 172.21.15.55:0/3042033565 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f193c099120 msgr2=0x7f193c0b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:22.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.125+0000 7f1941000640 1 --2- 172.21.15.55:0/3042033565 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f193c099120 0x7f193c0b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.125+0000 7f1941000640 1 -- 172.21.15.55:0/3042033565 >> v1:172.21.15.55:6789/0 conn(0x7f193c15ca70 legacy=0x7f193c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:22.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.125+0000 7f1941000640 1 -- 172.21.15.55:0/3042033565 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f193c06c040 con 0x7f193c06aff0 2024-04-02T07:22:22.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.125+0000 7f1933e00640 1 --2- 172.21.15.55:0/3042033565 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f193c099120 0x7f193c0b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.129+0000 7f1941000640 1 --2- 172.21.15.55:0/3042033565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f193c06aff0 0x7f193c06b480 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1934009d90 tx=0x7f193401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1e19374e1a9788b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.129+0000 7f193b400640 1 -- 172.21.15.55:0/3042033565 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19340a5a20 con 0x7f193c06aff0 2024-04-02T07:22:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.129+0000 7f193b400640 1 -- 172.21.15.55:0/3042033565 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19340a5b80 con 0x7f193c06aff0 2024-04-02T07:22:22.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.129+0000 7f193b400640 1 -- 172.21.15.55:0/3042033565 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19340ad440 con 0x7f193c06aff0 2024-04-02T07:22:22.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.129+0000 7f1943000640 1 -- 172.21.15.55:0/3042033565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f193c06aff0 msgr2=0x7f193c06b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:22.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.129+0000 7f1943000640 1 --2- 172.21.15.55:0/3042033565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f193c06aff0 0x7f193c06b480 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f1934009d90 tx=0x7f193401c940 comp rx=0 tx=0).stop 2024-04-02T07:22:22.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.129+0000 7f1943000640 1 -- 172.21.15.55:0/3042033565 shutdown_connections 2024-04-02T07:22:22.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.129+0000 7f1943000640 1 --2- 172.21.15.55:0/3042033565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f193c06aff0 0x7f193c06b480 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.129+0000 7f1943000640 1 --2- 172.21.15.55:0/3042033565 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f193c099120 0x7f193c0b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.129+0000 7f1943000640 1 -- 172.21.15.55:0/3042033565 >> 172.21.15.55:0/3042033565 conn(0x7f193c0b21d0 msgr2=0x7f193c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:22.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.129+0000 7f1943000640 1 -- 172.21.15.55:0/3042033565 shutdown_connections 2024-04-02T07:22:22.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.129+0000 7f1943000640 1 -- 172.21.15.55:0/3042033565 wait complete. 2024-04-02T07:22:22.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1943000640 1 Processor -- start 2024-04-02T07:22:22.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1943000640 1 -- start start 2024-04-02T07:22:22.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1943000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f193c06aff0 0x7f193c141730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:22.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1943000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f193c099120 0x7f193c155ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:22.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1943000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f193c15ca70 0x7f193c13fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:22.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1943000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c156220 con 0x7f193c15ca70 2024-04-02T07:22:22.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1943000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f193c140690 con 0x7f193c06aff0 2024-04-02T07:22:22.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1943000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f193c140970 con 0x7f193c099120 2024-04-02T07:22:22.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1941000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f193c15ca70 0x7f193c13fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:22.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1941000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f193c15ca70 0x7f193c13fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51496/0 (socket says 172.21.15.55:51496) 2024-04-02T07:22:22.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1941000640 1 -- 172.21.15.55:0/1595826438 learned_addr learned my addr 172.21.15.55:0/1595826438 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:22.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1933e00640 1 --2- 172.21.15.55:0/1595826438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f193c099120 0x7f193c155ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:22.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f193be00640 1 --2- 172.21.15.55:0/1595826438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f193c06aff0 0x7f193c141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:22.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1941000640 1 -- 172.21.15.55:0/1595826438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f193c099120 msgr2=0x7f193c155ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:22.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1941000640 1 --2- 172.21.15.55:0/1595826438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f193c099120 0x7f193c155ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1941000640 1 -- 172.21.15.55:0/1595826438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f193c06aff0 msgr2=0x7f193c141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:22.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1941000640 1 --2- 172.21.15.55:0/1595826438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f193c06aff0 0x7f193c141730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1941000640 1 -- 172.21.15.55:0/1595826438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1924009420 con 0x7f193c15ca70 2024-04-02T07:22:22.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1933e00640 1 --2- 172.21.15.55:0/1595826438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f193c099120 0x7f193c155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:22.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1941000640 1 --2- 172.21.15.55:0/1595826438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f193c15ca70 0x7f193c13fcf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f19340b0040 tx=0x7f19340196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:22.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1938c00640 1 -- 172.21.15.55:0/1595826438 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19340adce0 con 0x7f193c15ca70 2024-04-02T07:22:22.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1938c00640 1 -- 172.21.15.55:0/1595826438 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19340ade40 con 0x7f193c15ca70 2024-04-02T07:22:22.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1938c00640 1 -- 172.21.15.55:0/1595826438 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19340b7650 con 0x7f193c15ca70 2024-04-02T07:22:22.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1943000640 1 -- 172.21.15.55:0/1595826438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1934009a70 con 0x7f193c15ca70 2024-04-02T07:22:22.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.133+0000 7f1943000640 1 -- 172.21.15.55:0/1595826438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f193c140f30 con 0x7f193c15ca70 2024-04-02T07:22:22.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.137+0000 7f1943000640 1 -- 172.21.15.55:0/1595826438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f193c066c90 con 0x7f193c15ca70 2024-04-02T07:22:22.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.137+0000 7f1938c00640 1 -- 172.21.15.55:0/1595826438 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f19340b4050 con 0x7f193c15ca70 2024-04-02T07:22:22.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.137+0000 7f1938c00640 1 --2- 172.21.15.55:0/1595826438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1918066690 0x7f1918068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:22.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.137+0000 7f1938c00640 1 -- 172.21.15.55:0/1595826438 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f193411f2f0 con 0x7f193c15ca70 2024-04-02T07:22:22.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.137+0000 7f193be00640 1 --2- 172.21.15.55:0/1595826438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1918066690 0x7f1918068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:22.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.137+0000 7f193be00640 1 --2- 172.21.15.55:0/1595826438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1918066690 0x7f1918068b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f192c0011f0 tx=0x7f192c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:22.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.141+0000 7f1938c00640 1 -- 172.21.15.55:0/1595826438 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f19340ec5c0 con 0x7f193c15ca70 2024-04-02T07:22:22.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.301+0000 7f1943000640 1 -- 172.21.15.55:0/1595826438 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f193c0b6660 con 0x7f1918066690 2024-04-02T07:22:22.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.309+0000 7f1938c00640 1 -- 172.21.15.55:0/1595826438 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+249839 (secure 0 0 0) 0x7f193c0b6660 con 0x7f1918066690 2024-04-02T07:22:22.314 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:22.317 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:22:22.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.313+0000 7f1943000640 1 -- 172.21.15.55:0/1595826438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1918066690 msgr2=0x7f1918068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:22.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.313+0000 7f1943000640 1 --2- 172.21.15.55:0/1595826438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1918066690 0x7f1918068b50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f192c0011f0 tx=0x7f192c009040 comp rx=0 tx=0).stop 2024-04-02T07:22:22.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.313+0000 7f1943000640 1 -- 172.21.15.55:0/1595826438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f193c15ca70 msgr2=0x7f193c13fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:22.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.313+0000 7f1943000640 1 --2- 172.21.15.55:0/1595826438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f193c15ca70 0x7f193c13fcf0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f19340b0040 tx=0x7f19340196e0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.313+0000 7f1943000640 1 -- 172.21.15.55:0/1595826438 shutdown_connections 2024-04-02T07:22:22.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.313+0000 7f1943000640 1 --2- 172.21.15.55:0/1595826438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f193c15ca70 0x7f193c13fcf0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.313+0000 7f1943000640 1 --2- 172.21.15.55:0/1595826438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f193c099120 0x7f193c155ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.313+0000 7f1943000640 1 --2- 172.21.15.55:0/1595826438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1918066690 0x7f1918068b50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.313+0000 7f1943000640 1 --2- 172.21.15.55:0/1595826438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f193c06aff0 0x7f193c141730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.313+0000 7f1943000640 1 -- 172.21.15.55:0/1595826438 >> 172.21.15.55:0/1595826438 conn(0x7f193c0b21d0 msgr2=0x7f193c0b14d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:22.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.313+0000 7f1943000640 1 -- 172.21.15.55:0/1595826438 shutdown_connections 2024-04-02T07:22:22.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.313+0000 7f1943000640 1 -- 172.21.15.55:0/1595826438 wait complete. 2024-04-02T07:22:22.337 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2024-04-02T07:22:20.335365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":231732,"kb_used_data":2376,"kb_used_omap":12,"kb_used_meta":228339,"kb_avail":754742988,"statfs":{"total":773094113280,"available":772856819712,"internally_reserved":0,"allocated":2433024,"data_stored":1546584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":233819704},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001016"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2024-04-02T07:22:09.528165+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:22:09.528165+0000","last_peered":"2024-04-02T07:22:09.528165+0000","last_clean":"2024-04-02T07:22:09.528165+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:22:09.528165+0000","last_undegraded":"2024-04-02T07:22:09.528165+0000","last_fullsized":"2024-04-02T07:22:09.528165+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:17.791096+0000","last_change":"2024-04-02T07:22:17.791096+0000","last_active":"2024-04-02T07:22:17.791096+0000","last_peered":"2024-04-02T07:22:17.791096+0000","last_clean":"2024-04-02T07:22:17.791096+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:17.791096+0000","last_undegraded":"2024-04-02T07:22:17.791096+0000","last_fullsized":"2024-04-02T07:22:17.791096+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:22:16.788521+0000","last_change":"2024-04-02T07:22:16.788521+0000","last_active":"2024-04-02T07:22:16.788521+0000","last_peered":"2024-04-02T07:22:16.788521+0000","last_clean":"2024-04-02T07:22:16.788521+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:22:16.788521+0000","last_undegraded":"2024-04-02T07:22:16.788521+0000","last_fullsized":"2024-04-02T07:22:16.788521+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28000,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343840,"statfs":{"total":96636764160,"available":96608092160,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0189999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82299999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93600000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0209999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27176,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344664,"statfs":{"total":96636764160,"available":96608935936,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0089999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90300000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.365}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2509999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2949999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2689999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27180,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31276,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340564,"statfs":{"total":96636764160,"available":96604737536,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31268,"kb_used_data":152,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340572,"statfs":{"total":96636764160,"available":96604745728,"internally_reserved":0,"allocated":155648,"data_stored":45731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76600000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93799999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2729999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0940000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32472,"kb_used_data":732,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339368,"statfs":{"total":96636764160,"available":96603512832,"internally_reserved":0,"allocated":749568,"data_stored":636099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80800000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:22:22.342 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:22:22.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.517+0000 7f4b68e00640 1 Processor -- start 2024-04-02T07:22:22.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.517+0000 7f4b68e00640 1 -- start start 2024-04-02T07:22:22.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.521+0000 7f4b68e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b64153ea0 0x7f4b640c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:22.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.521+0000 7f4b68e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4b64159be0 0x7f4b640b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:22.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.521+0000 7f4b68e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4b6415a040 0x7f4b640b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:22.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.521+0000 7f4b68e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6413d0c0 con 0x7f4b64159be0 2024-04-02T07:22:22.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.521+0000 7f4b68e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6415a4f0 con 0x7f4b6415a040 2024-04-02T07:22:22.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.521+0000 7f4b68e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6415a7d0 con 0x7f4b64153ea0 2024-04-02T07:22:22.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.521+0000 7f4b5be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4b64159be0 0x7f4b640b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:22.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.521+0000 7f4b5be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4b64159be0 0x7f4b640b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51506/0 (socket says 172.21.15.55:51506) 2024-04-02T07:22:22.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.521+0000 7f4b5be00640 1 -- 172.21.15.55:0/3054055118 learned_addr learned my addr 172.21.15.55:0/3054055118 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:22.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.521+0000 7f4b61e00640 1 --2- 172.21.15.55:0/3054055118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b64153ea0 0x7f4b640c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:22.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.521+0000 7f4b62800640 1 --2- 172.21.15.55:0/3054055118 >> v2:172.21.15.106:3300/0 conn(0x7f4b6415a040 0x7f4b640b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:22.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.521+0000 7f4b5be00640 1 -- 172.21.15.55:0/3054055118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b64153ea0 msgr2=0x7f4b640c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:22.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.521+0000 7f4b5be00640 1 --2- 172.21.15.55:0/3054055118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b64153ea0 0x7f4b640c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.521+0000 7f4b5be00640 1 -- 172.21.15.55:0/3054055118 >> v2:172.21.15.106:3300/0 conn(0x7f4b6415a040 msgr2=0x7f4b640b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:22.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.521+0000 7f4b5be00640 1 --2- 172.21.15.55:0/3054055118 >> v2:172.21.15.106:3300/0 conn(0x7f4b6415a040 0x7f4b640b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.521+0000 7f4b5be00640 1 -- 172.21.15.55:0/3054055118 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6415aab0 con 0x7f4b64159be0 2024-04-02T07:22:22.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.521+0000 7f4b62800640 1 --2- 172.21.15.55:0/3054055118 >> v2:172.21.15.106:3300/0 conn(0x7f4b6415a040 0x7f4b640b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:22.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b5be00640 1 --2- 172.21.15.55:0/3054055118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b64159be0 0x7f4b640b31b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4b64072500 tx=0x7f4b4c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d5e9b25a6f52fb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:22.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b61400640 1 -- 172.21.15.55:0/3054055118 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c0aa660 con 0x7f4b64159be0 2024-04-02T07:22:22.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b61400640 1 -- 172.21.15.55:0/3054055118 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b4c0aa7c0 con 0x7f4b64159be0 2024-04-02T07:22:22.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b61400640 1 -- 172.21.15.55:0/3054055118 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c0aab50 con 0x7f4b64159be0 2024-04-02T07:22:22.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b68e00640 1 -- 172.21.15.55:0/3054055118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b64159be0 msgr2=0x7f4b640b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:22.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b68e00640 1 --2- 172.21.15.55:0/3054055118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b64159be0 0x7f4b640b31b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f4b64072500 tx=0x7f4b4c01c520 comp rx=0 tx=0).stop 2024-04-02T07:22:22.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b68e00640 1 -- 172.21.15.55:0/3054055118 shutdown_connections 2024-04-02T07:22:22.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b68e00640 1 --2- 172.21.15.55:0/3054055118 >> v2:172.21.15.106:3300/0 conn(0x7f4b6415a040 0x7f4b640b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b68e00640 1 --2- 172.21.15.55:0/3054055118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b64159be0 0x7f4b640b31b0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b68e00640 1 --2- 172.21.15.55:0/3054055118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b64153ea0 0x7f4b640c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b68e00640 1 -- 172.21.15.55:0/3054055118 >> 172.21.15.55:0/3054055118 conn(0x7f4b64066080 msgr2=0x7f4b64069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:22.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b68e00640 1 -- 172.21.15.55:0/3054055118 shutdown_connections 2024-04-02T07:22:22.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b68e00640 1 -- 172.21.15.55:0/3054055118 wait complete. 2024-04-02T07:22:22.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b68e00640 1 Processor -- start 2024-04-02T07:22:22.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b68e00640 1 -- start start 2024-04-02T07:22:22.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b68e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b64153ea0 0x7f4b6415c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:22.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b68e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b64159be0 0x7f4b641351c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:22.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b68e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b6415a040 0x7f4b64140be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:22.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b68e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6414e7c0 con 0x7f4b64153ea0 2024-04-02T07:22:22.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b68e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b64135700 con 0x7f4b64159be0 2024-04-02T07:22:22.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.525+0000 7f4b68e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b64141120 con 0x7f4b6415a040 2024-04-02T07:22:22.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.529+0000 7f4b61e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b64153ea0 0x7f4b6415c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:22.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.529+0000 7f4b61e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b64153ea0 0x7f4b6415c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51518/0 (socket says 172.21.15.55:51518) 2024-04-02T07:22:22.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.529+0000 7f4b61e00640 1 -- 172.21.15.55:0/2466477252 learned_addr learned my addr 172.21.15.55:0/2466477252 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:22.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.529+0000 7f4b5be00640 1 --2- 172.21.15.55:0/2466477252 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b64159be0 0x7f4b641351c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:22.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.529+0000 7f4b62800640 1 --2- 172.21.15.55:0/2466477252 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b6415a040 0x7f4b64140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:22.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.529+0000 7f4b61e00640 1 -- 172.21.15.55:0/2466477252 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b6415a040 msgr2=0x7f4b64140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:22.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.529+0000 7f4b61e00640 1 --2- 172.21.15.55:0/2466477252 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b6415a040 0x7f4b64140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.529+0000 7f4b61e00640 1 -- 172.21.15.55:0/2466477252 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b64159be0 msgr2=0x7f4b641351c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:22.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.529+0000 7f4b61e00640 1 --2- 172.21.15.55:0/2466477252 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b64159be0 0x7f4b641351c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.529+0000 7f4b61e00640 1 -- 172.21.15.55:0/2466477252 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b4c0094d0 con 0x7f4b64153ea0 2024-04-02T07:22:22.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.529+0000 7f4b61e00640 1 --2- 172.21.15.55:0/2466477252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b64153ea0 0x7f4b6415c920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400e8b0 tx=0x7f4b5400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:22.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.529+0000 7f4b5a000640 1 -- 172.21.15.55:0/2466477252 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5400c940 con 0x7f4b64153ea0 2024-04-02T07:22:22.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.529+0000 7f4b5a000640 1 -- 172.21.15.55:0/2466477252 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5400caa0 con 0x7f4b64153ea0 2024-04-02T07:22:22.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.529+0000 7f4b5a000640 1 -- 172.21.15.55:0/2466477252 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5400ce30 con 0x7f4b64153ea0 2024-04-02T07:22:22.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.529+0000 7f4b68e00640 1 -- 172.21.15.55:0/2466477252 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6414ea10 con 0x7f4b64153ea0 2024-04-02T07:22:22.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.529+0000 7f4b68e00640 1 -- 172.21.15.55:0/2466477252 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6414efd0 con 0x7f4b64153ea0 2024-04-02T07:22:22.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.529+0000 7f4b68e00640 1 -- 172.21.15.55:0/2466477252 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b64066c90 con 0x7f4b64153ea0 2024-04-02T07:22:22.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.529+0000 7f4b5a000640 1 -- 172.21.15.55:0/2466477252 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f4b54013470 con 0x7f4b64153ea0 2024-04-02T07:22:22.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.529+0000 7f4b5a000640 1 --2- 172.21.15.55:0/2466477252 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4b40066690 0x7f4b40068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:22.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.529+0000 7f4b5a000640 1 -- 172.21.15.55:0/2466477252 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b54084420 con 0x7f4b64153ea0 2024-04-02T07:22:22.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.533+0000 7f4b5be00640 1 --2- 172.21.15.55:0/2466477252 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4b40066690 0x7f4b40068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:22.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.533+0000 7f4b5be00640 1 --2- 172.21.15.55:0/2466477252 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4b40066690 0x7f4b40068b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c0ae000 tx=0x7f4b4c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:22.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.533+0000 7f4b5a000640 1 -- 172.21.15.55:0/2466477252 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f4b54051780 con 0x7f4b64153ea0 2024-04-02T07:22:22.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.693+0000 7f4b68e00640 1 -- 172.21.15.55:0/2466477252 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b6413b760 con 0x7f4b40066690 2024-04-02T07:22:22.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.701+0000 7f4b5a000640 1 -- 172.21.15.55:0/2466477252 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264685 (secure 0 0 0) 0x7f4b6413b760 con 0x7f4b40066690 2024-04-02T07:22:22.707 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:22.708 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:22:22.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.705+0000 7f4b68e00640 1 -- 172.21.15.55:0/2466477252 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4b40066690 msgr2=0x7f4b40068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.705+0000 7f4b68e00640 1 --2- 172.21.15.55:0/2466477252 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4b40066690 0x7f4b40068b50 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4b4c0ae000 tx=0x7f4b4c0a7000 comp rx=0 tx=0).stop 2024-04-02T07:22:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.705+0000 7f4b68e00640 1 -- 172.21.15.55:0/2466477252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b64153ea0 msgr2=0x7f4b6415c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.705+0000 7f4b68e00640 1 --2- 172.21.15.55:0/2466477252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b64153ea0 0x7f4b6415c920 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f4b5400e8b0 tx=0x7f4b5400ed70 comp rx=0 tx=0).stop 2024-04-02T07:22:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.705+0000 7f4b68e00640 1 -- 172.21.15.55:0/2466477252 shutdown_connections 2024-04-02T07:22:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.705+0000 7f4b68e00640 1 --2- 172.21.15.55:0/2466477252 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b6415a040 0x7f4b64140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.705+0000 7f4b68e00640 1 --2- 172.21.15.55:0/2466477252 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4b40066690 0x7f4b40068b50 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.705+0000 7f4b68e00640 1 --2- 172.21.15.55:0/2466477252 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b64159be0 0x7f4b641351c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.705+0000 7f4b68e00640 1 --2- 172.21.15.55:0/2466477252 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b64153ea0 0x7f4b6415c920 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.705+0000 7f4b68e00640 1 -- 172.21.15.55:0/2466477252 >> 172.21.15.55:0/2466477252 conn(0x7f4b64066080 msgr2=0x7f4b64071440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.705+0000 7f4b68e00640 1 -- 172.21.15.55:0/2466477252 shutdown_connections 2024-04-02T07:22:22.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.705+0000 7f4b68e00640 1 -- 172.21.15.55:0/2466477252 wait complete. 2024-04-02T07:22:22.726 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-04-02T07:22:22.335981+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":138,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235376,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739344,"statfs":{"total":773094113280,"available":772853088256,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.543367"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371828+0000","last_change":"2024-04-02T07:22:18.242427+0000","last_active":"2024-04-02T07:22:20.371828+0000","last_peered":"2024-04-02T07:22:20.371828+0000","last_clean":"2024-04-02T07:22:20.371828+0000","last_became_active":"2024-04-02T07:22:18.241587+0000","last_became_peered":"2024-04-02T07:22:18.241587+0000","last_unstale":"2024-04-02T07:22:20.371828+0000","last_undegraded":"2024-04-02T07:22:20.371828+0000","last_fullsized":"2024-04-02T07:22:20.371828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:17:53.201974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369937+0000","last_change":"2024-04-02T07:22:18.231108+0000","last_active":"2024-04-02T07:22:20.369937+0000","last_peered":"2024-04-02T07:22:20.369937+0000","last_clean":"2024-04-02T07:22:20.369937+0000","last_became_active":"2024-04-02T07:22:18.230786+0000","last_became_peered":"2024-04-02T07:22:18.230786+0000","last_unstale":"2024-04-02T07:22:20.369937+0000","last_undegraded":"2024-04-02T07:22:20.369937+0000","last_fullsized":"2024-04-02T07:22:20.369937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:12.939631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.219986+0000","last_change":"2024-04-02T07:22:18.232786+0000","last_active":"2024-04-02T07:22:19.219986+0000","last_peered":"2024-04-02T07:22:19.219986+0000","last_clean":"2024-04-02T07:22:19.219986+0000","last_became_active":"2024-04-02T07:22:18.232534+0000","last_became_peered":"2024-04-02T07:22:18.232534+0000","last_unstale":"2024-04-02T07:22:19.219986+0000","last_undegraded":"2024-04-02T07:22:19.219986+0000","last_fullsized":"2024-04-02T07:22:19.219986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:12.939631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370409+0000","last_change":"2024-04-02T07:22:18.249344+0000","last_active":"2024-04-02T07:22:20.370409+0000","last_peered":"2024-04-02T07:22:20.370409+0000","last_clean":"2024-04-02T07:22:20.370409+0000","last_became_active":"2024-04-02T07:22:18.249100+0000","last_became_peered":"2024-04-02T07:22:18.249100+0000","last_unstale":"2024-04-02T07:22:20.370409+0000","last_undegraded":"2024-04-02T07:22:20.370409+0000","last_fullsized":"2024-04-02T07:22:20.370409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:12:09.974224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371672+0000","last_change":"2024-04-02T07:22:18.248933+0000","last_active":"2024-04-02T07:22:20.371672+0000","last_peered":"2024-04-02T07:22:20.371672+0000","last_clean":"2024-04-02T07:22:20.371672+0000","last_became_active":"2024-04-02T07:22:18.248668+0000","last_became_peered":"2024-04-02T07:22:18.248668+0000","last_unstale":"2024-04-02T07:22:20.371672+0000","last_undegraded":"2024-04-02T07:22:20.371672+0000","last_fullsized":"2024-04-02T07:22:20.371672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:14:27.524425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370104+0000","last_change":"2024-04-02T07:22:18.231406+0000","last_active":"2024-04-02T07:22:20.370104+0000","last_peered":"2024-04-02T07:22:20.370104+0000","last_clean":"2024-04-02T07:22:20.370104+0000","last_became_active":"2024-04-02T07:22:18.231169+0000","last_became_peered":"2024-04-02T07:22:18.231169+0000","last_unstale":"2024-04-02T07:22:20.370104+0000","last_undegraded":"2024-04-02T07:22:20.370104+0000","last_fullsized":"2024-04-02T07:22:20.370104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:43:52.871035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371173+0000","last_change":"2024-04-02T07:22:18.240447+0000","last_active":"2024-04-02T07:22:20.371173+0000","last_peered":"2024-04-02T07:22:20.371173+0000","last_clean":"2024-04-02T07:22:20.371173+0000","last_became_active":"2024-04-02T07:22:18.239731+0000","last_became_peered":"2024-04-02T07:22:18.239731+0000","last_unstale":"2024-04-02T07:22:20.371173+0000","last_undegraded":"2024-04-02T07:22:20.371173+0000","last_fullsized":"2024-04-02T07:22:20.371173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:18:24.609373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221004+0000","last_change":"2024-04-02T07:22:18.237786+0000","last_active":"2024-04-02T07:22:19.221004+0000","last_peered":"2024-04-02T07:22:19.221004+0000","last_clean":"2024-04-02T07:22:19.221004+0000","last_became_active":"2024-04-02T07:22:18.237504+0000","last_became_peered":"2024-04-02T07:22:18.237504+0000","last_unstale":"2024-04-02T07:22:19.221004+0000","last_undegraded":"2024-04-02T07:22:19.221004+0000","last_fullsized":"2024-04-02T07:22:19.221004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:17:53.201974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371931+0000","last_change":"2024-04-02T07:22:18.242614+0000","last_active":"2024-04-02T07:22:20.371931+0000","last_peered":"2024-04-02T07:22:20.371931+0000","last_clean":"2024-04-02T07:22:20.371931+0000","last_became_active":"2024-04-02T07:22:18.242136+0000","last_became_peered":"2024-04-02T07:22:18.242136+0000","last_unstale":"2024-04-02T07:22:20.371931+0000","last_undegraded":"2024-04-02T07:22:20.371931+0000","last_fullsized":"2024-04-02T07:22:20.371931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:27:50.468893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371061+0000","last_change":"2024-04-02T07:22:18.232563+0000","last_active":"2024-04-02T07:22:20.371061+0000","last_peered":"2024-04-02T07:22:20.371061+0000","last_clean":"2024-04-02T07:22:20.371061+0000","last_became_active":"2024-04-02T07:22:18.232213+0000","last_became_peered":"2024-04-02T07:22:18.232213+0000","last_unstale":"2024-04-02T07:22:20.371061+0000","last_undegraded":"2024-04-02T07:22:20.371061+0000","last_fullsized":"2024-04-02T07:22:20.371061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:12.939631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370781+0000","last_change":"2024-04-02T07:22:18.232430+0000","last_active":"2024-04-02T07:22:20.370781+0000","last_peered":"2024-04-02T07:22:20.370781+0000","last_clean":"2024-04-02T07:22:20.370781+0000","last_became_active":"2024-04-02T07:22:18.232147+0000","last_became_peered":"2024-04-02T07:22:18.232147+0000","last_unstale":"2024-04-02T07:22:20.370781+0000","last_undegraded":"2024-04-02T07:22:20.370781+0000","last_fullsized":"2024-04-02T07:22:20.370781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:36:43.798159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.222736+0000","last_change":"2024-04-02T07:22:18.235518+0000","last_active":"2024-04-02T07:22:19.222736+0000","last_peered":"2024-04-02T07:22:19.222736+0000","last_clean":"2024-04-02T07:22:19.222736+0000","last_became_active":"2024-04-02T07:22:18.235232+0000","last_became_peered":"2024-04-02T07:22:18.235232+0000","last_unstale":"2024-04-02T07:22:19.222736+0000","last_undegraded":"2024-04-02T07:22:19.222736+0000","last_fullsized":"2024-04-02T07:22:19.222736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:28:35.572801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221398+0000","last_change":"2024-04-02T07:22:18.242642+0000","last_active":"2024-04-02T07:22:19.221398+0000","last_peered":"2024-04-02T07:22:19.221398+0000","last_clean":"2024-04-02T07:22:19.221398+0000","last_became_active":"2024-04-02T07:22:18.242350+0000","last_became_peered":"2024-04-02T07:22:18.242350+0000","last_unstale":"2024-04-02T07:22:19.221398+0000","last_undegraded":"2024-04-02T07:22:19.221398+0000","last_fullsized":"2024-04-02T07:22:19.221398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:40:34.209765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.219577+0000","last_change":"2024-04-02T07:22:18.240215+0000","last_active":"2024-04-02T07:22:19.219577+0000","last_peered":"2024-04-02T07:22:19.219577+0000","last_clean":"2024-04-02T07:22:19.219577+0000","last_became_active":"2024-04-02T07:22:18.239918+0000","last_became_peered":"2024-04-02T07:22:18.239918+0000","last_unstale":"2024-04-02T07:22:19.219577+0000","last_undegraded":"2024-04-02T07:22:19.219577+0000","last_fullsized":"2024-04-02T07:22:19.219577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:07:43.747365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369667+0000","last_change":"2024-04-02T07:22:18.244474+0000","last_active":"2024-04-02T07:22:20.369667+0000","last_peered":"2024-04-02T07:22:20.369667+0000","last_clean":"2024-04-02T07:22:20.369667+0000","last_became_active":"2024-04-02T07:22:18.244222+0000","last_became_peered":"2024-04-02T07:22:18.244222+0000","last_unstale":"2024-04-02T07:22:20.369667+0000","last_undegraded":"2024-04-02T07:22:20.369667+0000","last_fullsized":"2024-04-02T07:22:20.369667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:47:20.129295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369896+0000","last_change":"2024-04-02T07:22:18.231427+0000","last_active":"2024-04-02T07:22:20.369896+0000","last_peered":"2024-04-02T07:22:20.369896+0000","last_clean":"2024-04-02T07:22:20.369896+0000","last_became_active":"2024-04-02T07:22:18.230966+0000","last_became_peered":"2024-04-02T07:22:18.230966+0000","last_unstale":"2024-04-02T07:22:20.369896+0000","last_undegraded":"2024-04-02T07:22:20.369896+0000","last_fullsized":"2024-04-02T07:22:20.369896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:25.644846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370768+0000","last_change":"2024-04-02T07:22:18.247729+0000","last_active":"2024-04-02T07:22:20.370768+0000","last_peered":"2024-04-02T07:22:20.370768+0000","last_clean":"2024-04-02T07:22:20.370768+0000","last_became_active":"2024-04-02T07:22:18.247488+0000","last_became_peered":"2024-04-02T07:22:18.247488+0000","last_unstale":"2024-04-02T07:22:20.370768+0000","last_undegraded":"2024-04-02T07:22:20.370768+0000","last_fullsized":"2024-04-02T07:22:20.370768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:10:08.342854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369749+0000","last_change":"2024-04-02T07:22:18.238472+0000","last_active":"2024-04-02T07:22:20.369749+0000","last_peered":"2024-04-02T07:22:20.369749+0000","last_clean":"2024-04-02T07:22:20.369749+0000","last_became_active":"2024-04-02T07:22:18.238254+0000","last_became_peered":"2024-04-02T07:22:18.238254+0000","last_unstale":"2024-04-02T07:22:20.369749+0000","last_undegraded":"2024-04-02T07:22:20.369749+0000","last_fullsized":"2024-04-02T07:22:20.369749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:55:47.475859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371682+0000","last_change":"2024-04-02T07:22:18.247532+0000","last_active":"2024-04-02T07:22:20.371682+0000","last_peered":"2024-04-02T07:22:20.371682+0000","last_clean":"2024-04-02T07:22:20.371682+0000","last_became_active":"2024-04-02T07:22:18.247218+0000","last_became_peered":"2024-04-02T07:22:18.247218+0000","last_unstale":"2024-04-02T07:22:20.371682+0000","last_undegraded":"2024-04-02T07:22:20.371682+0000","last_fullsized":"2024-04-02T07:22:20.371682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:43:52.871035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370136+0000","last_change":"2024-04-02T07:22:18.238253+0000","last_active":"2024-04-02T07:22:20.370136+0000","last_peered":"2024-04-02T07:22:20.370136+0000","last_clean":"2024-04-02T07:22:20.370136+0000","last_became_active":"2024-04-02T07:22:18.237955+0000","last_became_peered":"2024-04-02T07:22:18.237955+0000","last_unstale":"2024-04-02T07:22:20.370136+0000","last_undegraded":"2024-04-02T07:22:20.370136+0000","last_fullsized":"2024-04-02T07:22:20.370136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:40:34.209765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.219847+0000","last_change":"2024-04-02T07:22:18.240034+0000","last_active":"2024-04-02T07:22:19.219847+0000","last_peered":"2024-04-02T07:22:19.219847+0000","last_clean":"2024-04-02T07:22:19.219847+0000","last_became_active":"2024-04-02T07:22:18.239673+0000","last_became_peered":"2024-04-02T07:22:18.239673+0000","last_unstale":"2024-04-02T07:22:19.219847+0000","last_undegraded":"2024-04-02T07:22:19.219847+0000","last_fullsized":"2024-04-02T07:22:19.219847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:40:34.209765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370287+0000","last_change":"2024-04-02T07:22:18.250123+0000","last_active":"2024-04-02T07:22:20.370287+0000","last_peered":"2024-04-02T07:22:20.370287+0000","last_clean":"2024-04-02T07:22:20.370287+0000","last_became_active":"2024-04-02T07:22:18.249705+0000","last_became_peered":"2024-04-02T07:22:18.249705+0000","last_unstale":"2024-04-02T07:22:20.370287+0000","last_undegraded":"2024-04-02T07:22:20.370287+0000","last_fullsized":"2024-04-02T07:22:20.370287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:14:27.524425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221095+0000","last_change":"2024-04-02T07:22:18.220352+0000","last_active":"2024-04-02T07:22:19.221095+0000","last_peered":"2024-04-02T07:22:19.221095+0000","last_clean":"2024-04-02T07:22:19.221095+0000","last_became_active":"2024-04-02T07:22:18.219970+0000","last_became_peered":"2024-04-02T07:22:18.219970+0000","last_unstale":"2024-04-02T07:22:19.221095+0000","last_undegraded":"2024-04-02T07:22:19.221095+0000","last_fullsized":"2024-04-02T07:22:19.221095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:47:20.129295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369974+0000","last_change":"2024-04-02T07:22:18.243492+0000","last_active":"2024-04-02T07:22:20.369974+0000","last_peered":"2024-04-02T07:22:20.369974+0000","last_clean":"2024-04-02T07:22:20.369974+0000","last_became_active":"2024-04-02T07:22:18.241420+0000","last_became_peered":"2024-04-02T07:22:18.241420+0000","last_unstale":"2024-04-02T07:22:20.369974+0000","last_undegraded":"2024-04-02T07:22:20.369974+0000","last_fullsized":"2024-04-02T07:22:20.369974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:40:34.209765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221583+0000","last_change":"2024-04-02T07:22:18.220417+0000","last_active":"2024-04-02T07:22:19.221583+0000","last_peered":"2024-04-02T07:22:19.221583+0000","last_clean":"2024-04-02T07:22:19.221583+0000","last_became_active":"2024-04-02T07:22:18.220172+0000","last_became_peered":"2024-04-02T07:22:18.220172+0000","last_unstale":"2024-04-02T07:22:19.221583+0000","last_undegraded":"2024-04-02T07:22:19.221583+0000","last_fullsized":"2024-04-02T07:22:19.221583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:04:59.919960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371096+0000","last_change":"2024-04-02T07:22:18.248792+0000","last_active":"2024-04-02T07:22:20.371096+0000","last_peered":"2024-04-02T07:22:20.371096+0000","last_clean":"2024-04-02T07:22:20.371096+0000","last_became_active":"2024-04-02T07:22:18.248524+0000","last_became_peered":"2024-04-02T07:22:18.248524+0000","last_unstale":"2024-04-02T07:22:20.371096+0000","last_undegraded":"2024-04-02T07:22:20.371096+0000","last_fullsized":"2024-04-02T07:22:20.371096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:59:52.607949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369918+0000","last_change":"2024-04-02T07:22:18.247315+0000","last_active":"2024-04-02T07:22:20.369918+0000","last_peered":"2024-04-02T07:22:20.369918+0000","last_clean":"2024-04-02T07:22:20.369918+0000","last_became_active":"2024-04-02T07:22:18.247031+0000","last_became_peered":"2024-04-02T07:22:18.247031+0000","last_unstale":"2024-04-02T07:22:20.369918+0000","last_undegraded":"2024-04-02T07:22:20.369918+0000","last_fullsized":"2024-04-02T07:22:20.369918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:59:52.607949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221415+0000","last_change":"2024-04-02T07:22:18.220991+0000","last_active":"2024-04-02T07:22:19.221415+0000","last_peered":"2024-04-02T07:22:19.221415+0000","last_clean":"2024-04-02T07:22:19.221415+0000","last_became_active":"2024-04-02T07:22:18.219487+0000","last_became_peered":"2024-04-02T07:22:18.219487+0000","last_unstale":"2024-04-02T07:22:19.221415+0000","last_undegraded":"2024-04-02T07:22:19.221415+0000","last_fullsized":"2024-04-02T07:22:19.221415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:14:02.133890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.219941+0000","last_change":"2024-04-02T07:22:18.226337+0000","last_active":"2024-04-02T07:22:19.219941+0000","last_peered":"2024-04-02T07:22:19.219941+0000","last_clean":"2024-04-02T07:22:19.219941+0000","last_became_active":"2024-04-02T07:22:18.225219+0000","last_became_peered":"2024-04-02T07:22:18.225219+0000","last_unstale":"2024-04-02T07:22:19.219941+0000","last_undegraded":"2024-04-02T07:22:19.219941+0000","last_fullsized":"2024-04-02T07:22:19.219941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:57:25.335137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370381+0000","last_change":"2024-04-02T07:22:18.248548+0000","last_active":"2024-04-02T07:22:20.370381+0000","last_peered":"2024-04-02T07:22:20.370381+0000","last_clean":"2024-04-02T07:22:20.370381+0000","last_became_active":"2024-04-02T07:22:18.248275+0000","last_became_peered":"2024-04-02T07:22:18.248275+0000","last_unstale":"2024-04-02T07:22:20.370381+0000","last_undegraded":"2024-04-02T07:22:20.370381+0000","last_fullsized":"2024-04-02T07:22:20.370381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:14:02.133890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369484+0000","last_change":"2024-04-02T07:22:18.239465+0000","last_active":"2024-04-02T07:22:20.369484+0000","last_peered":"2024-04-02T07:22:20.369484+0000","last_clean":"2024-04-02T07:22:20.369484+0000","last_became_active":"2024-04-02T07:22:18.239184+0000","last_became_peered":"2024-04-02T07:22:18.239184+0000","last_unstale":"2024-04-02T07:22:20.369484+0000","last_undegraded":"2024-04-02T07:22:20.369484+0000","last_fullsized":"2024-04-02T07:22:20.369484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:08:21.191481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370012+0000","last_change":"2024-04-02T07:22:18.234263+0000","last_active":"2024-04-02T07:22:20.370012+0000","last_peered":"2024-04-02T07:22:20.370012+0000","last_clean":"2024-04-02T07:22:20.370012+0000","last_became_active":"2024-04-02T07:22:18.233927+0000","last_became_peered":"2024-04-02T07:22:18.233927+0000","last_unstale":"2024-04-02T07:22:20.370012+0000","last_undegraded":"2024-04-02T07:22:20.370012+0000","last_fullsized":"2024-04-02T07:22:20.370012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:04:59.919960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.222575+0000","last_change":"2024-04-02T07:22:18.233666+0000","last_active":"2024-04-02T07:22:19.222575+0000","last_peered":"2024-04-02T07:22:19.222575+0000","last_clean":"2024-04-02T07:22:19.222575+0000","last_became_active":"2024-04-02T07:22:18.233403+0000","last_became_peered":"2024-04-02T07:22:18.233403+0000","last_unstale":"2024-04-02T07:22:19.222575+0000","last_undegraded":"2024-04-02T07:22:19.222575+0000","last_fullsized":"2024-04-02T07:22:19.222575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:57:55.129547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221437+0000","last_change":"2024-04-02T07:22:17.816995+0000","last_active":"2024-04-02T07:22:19.221437+0000","last_peered":"2024-04-02T07:22:19.221437+0000","last_clean":"2024-04-02T07:22:19.221437+0000","last_became_active":"2024-04-02T07:22:17.816648+0000","last_became_peered":"2024-04-02T07:22:17.816648+0000","last_unstale":"2024-04-02T07:22:19.221437+0000","last_undegraded":"2024-04-02T07:22:19.221437+0000","last_fullsized":"2024-04-02T07:22:19.221437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:26:13.873489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.220049+0000","last_change":"2024-04-02T07:22:18.238198+0000","last_active":"2024-04-02T07:22:19.220049+0000","last_peered":"2024-04-02T07:22:19.220049+0000","last_clean":"2024-04-02T07:22:19.220049+0000","last_became_active":"2024-04-02T07:22:18.236795+0000","last_became_peered":"2024-04-02T07:22:18.236795+0000","last_unstale":"2024-04-02T07:22:19.220049+0000","last_undegraded":"2024-04-02T07:22:19.220049+0000","last_fullsized":"2024-04-02T07:22:19.220049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:14:02.133890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370281+0000","last_change":"2024-04-02T07:22:17.818491+0000","last_active":"2024-04-02T07:22:20.370281+0000","last_peered":"2024-04-02T07:22:20.370281+0000","last_clean":"2024-04-02T07:22:20.370281+0000","last_became_active":"2024-04-02T07:22:17.817664+0000","last_became_peered":"2024-04-02T07:22:17.817664+0000","last_unstale":"2024-04-02T07:22:20.370281+0000","last_undegraded":"2024-04-02T07:22:20.370281+0000","last_fullsized":"2024-04-02T07:22:20.370281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:10:54.215675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221161+0000","last_change":"2024-04-02T07:22:17.819716+0000","last_active":"2024-04-02T07:22:19.221161+0000","last_peered":"2024-04-02T07:22:19.221161+0000","last_clean":"2024-04-02T07:22:19.221161+0000","last_became_active":"2024-04-02T07:22:17.819392+0000","last_became_peered":"2024-04-02T07:22:17.819392+0000","last_unstale":"2024-04-02T07:22:19.221161+0000","last_undegraded":"2024-04-02T07:22:19.221161+0000","last_fullsized":"2024-04-02T07:22:19.221161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:11:57.231785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221071+0000","last_change":"2024-04-02T07:22:18.234279+0000","last_active":"2024-04-02T07:22:19.221071+0000","last_peered":"2024-04-02T07:22:19.221071+0000","last_clean":"2024-04-02T07:22:19.221071+0000","last_became_active":"2024-04-02T07:22:18.233854+0000","last_became_peered":"2024-04-02T07:22:18.233854+0000","last_unstale":"2024-04-02T07:22:19.221071+0000","last_undegraded":"2024-04-02T07:22:19.221071+0000","last_fullsized":"2024-04-02T07:22:19.221071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:12.939631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369992+0000","last_change":"2024-04-02T07:22:17.826560+0000","last_active":"2024-04-02T07:22:20.369992+0000","last_peered":"2024-04-02T07:22:20.369992+0000","last_clean":"2024-04-02T07:22:20.369992+0000","last_became_active":"2024-04-02T07:22:17.826211+0000","last_became_peered":"2024-04-02T07:22:17.826211+0000","last_unstale":"2024-04-02T07:22:20.369992+0000","last_undegraded":"2024-04-02T07:22:20.369992+0000","last_fullsized":"2024-04-02T07:22:20.369992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:26:13.873489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369564+0000","last_change":"2024-04-02T07:22:18.229986+0000","last_active":"2024-04-02T07:22:20.369564+0000","last_peered":"2024-04-02T07:22:20.369564+0000","last_clean":"2024-04-02T07:22:20.369564+0000","last_became_active":"2024-04-02T07:22:18.223834+0000","last_became_peered":"2024-04-02T07:22:18.223834+0000","last_unstale":"2024-04-02T07:22:20.369564+0000","last_undegraded":"2024-04-02T07:22:20.369564+0000","last_fullsized":"2024-04-02T07:22:20.369564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:04:59.919960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371334+0000","last_change":"2024-04-02T07:22:17.829273+0000","last_active":"2024-04-02T07:22:20.371334+0000","last_peered":"2024-04-02T07:22:20.371334+0000","last_clean":"2024-04-02T07:22:20.371334+0000","last_became_active":"2024-04-02T07:22:17.829016+0000","last_became_peered":"2024-04-02T07:22:17.829016+0000","last_unstale":"2024-04-02T07:22:20.371334+0000","last_undegraded":"2024-04-02T07:22:20.371334+0000","last_fullsized":"2024-04-02T07:22:20.371334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:28:34.570227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370788+0000","last_change":"2024-04-02T07:22:18.245393+0000","last_active":"2024-04-02T07:22:20.370788+0000","last_peered":"2024-04-02T07:22:20.370788+0000","last_clean":"2024-04-02T07:22:20.370788+0000","last_became_active":"2024-04-02T07:22:18.245061+0000","last_became_peered":"2024-04-02T07:22:18.245061+0000","last_unstale":"2024-04-02T07:22:20.370788+0000","last_undegraded":"2024-04-02T07:22:20.370788+0000","last_fullsized":"2024-04-02T07:22:20.370788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:46:42.176195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370581+0000","last_change":"2024-04-02T07:22:17.828107+0000","last_active":"2024-04-02T07:22:20.370581+0000","last_peered":"2024-04-02T07:22:20.370581+0000","last_clean":"2024-04-02T07:22:20.370581+0000","last_became_active":"2024-04-02T07:22:17.825331+0000","last_became_peered":"2024-04-02T07:22:17.825331+0000","last_unstale":"2024-04-02T07:22:20.370581+0000","last_undegraded":"2024-04-02T07:22:20.370581+0000","last_fullsized":"2024-04-02T07:22:20.370581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:28:39.704218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.220251+0000","last_change":"2024-04-02T07:22:18.232172+0000","last_active":"2024-04-02T07:22:19.220251+0000","last_peered":"2024-04-02T07:22:19.220251+0000","last_clean":"2024-04-02T07:22:19.220251+0000","last_became_active":"2024-04-02T07:22:18.231924+0000","last_became_peered":"2024-04-02T07:22:18.231924+0000","last_unstale":"2024-04-02T07:22:19.220251+0000","last_undegraded":"2024-04-02T07:22:19.220251+0000","last_fullsized":"2024-04-02T07:22:19.220251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:36:43.798159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369928+0000","last_change":"2024-04-02T07:22:17.825495+0000","last_active":"2024-04-02T07:22:20.369928+0000","last_peered":"2024-04-02T07:22:20.369928+0000","last_clean":"2024-04-02T07:22:20.369928+0000","last_became_active":"2024-04-02T07:22:17.825231+0000","last_became_peered":"2024-04-02T07:22:17.825231+0000","last_unstale":"2024-04-02T07:22:20.369928+0000","last_undegraded":"2024-04-02T07:22:20.369928+0000","last_fullsized":"2024-04-02T07:22:20.369928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:55:46.473285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.222760+0000","last_change":"2024-04-02T07:22:18.239881+0000","last_active":"2024-04-02T07:22:19.222760+0000","last_peered":"2024-04-02T07:22:19.222760+0000","last_clean":"2024-04-02T07:22:19.222760+0000","last_became_active":"2024-04-02T07:22:18.239628+0000","last_became_peered":"2024-04-02T07:22:18.239628+0000","last_unstale":"2024-04-02T07:22:19.222760+0000","last_undegraded":"2024-04-02T07:22:19.222760+0000","last_fullsized":"2024-04-02T07:22:19.222760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:55:47.475859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370670+0000","last_change":"2024-04-02T07:22:17.823545+0000","last_active":"2024-04-02T07:22:20.370670+0000","last_peered":"2024-04-02T07:22:20.370670+0000","last_clean":"2024-04-02T07:22:20.370670+0000","last_became_active":"2024-04-02T07:22:17.823161+0000","last_became_peered":"2024-04-02T07:22:17.823161+0000","last_unstale":"2024-04-02T07:22:20.370670+0000","last_undegraded":"2024-04-02T07:22:20.370670+0000","last_fullsized":"2024-04-02T07:22:20.370670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:26:13.873489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371371+0000","last_change":"2024-04-02T07:22:18.244914+0000","last_active":"2024-04-02T07:22:20.371371+0000","last_peered":"2024-04-02T07:22:20.371371+0000","last_clean":"2024-04-02T07:22:20.371371+0000","last_became_active":"2024-04-02T07:22:18.244584+0000","last_became_peered":"2024-04-02T07:22:18.244584+0000","last_unstale":"2024-04-02T07:22:20.371371+0000","last_undegraded":"2024-04-02T07:22:20.371371+0000","last_fullsized":"2024-04-02T07:22:20.371371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:03:59.884565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.220140+0000","last_change":"2024-04-02T07:22:17.821147+0000","last_active":"2024-04-02T07:22:19.220140+0000","last_peered":"2024-04-02T07:22:19.220140+0000","last_clean":"2024-04-02T07:22:19.220140+0000","last_became_active":"2024-04-02T07:22:17.820136+0000","last_became_peered":"2024-04-02T07:22:17.820136+0000","last_unstale":"2024-04-02T07:22:19.220140+0000","last_undegraded":"2024-04-02T07:22:19.220140+0000","last_fullsized":"2024-04-02T07:22:19.220140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:48:32.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.219747+0000","last_change":"2024-04-02T07:22:18.240463+0000","last_active":"2024-04-02T07:22:19.219747+0000","last_peered":"2024-04-02T07:22:19.219747+0000","last_clean":"2024-04-02T07:22:19.219747+0000","last_became_active":"2024-04-02T07:22:18.239421+0000","last_became_peered":"2024-04-02T07:22:18.239421+0000","last_unstale":"2024-04-02T07:22:19.219747+0000","last_undegraded":"2024-04-02T07:22:19.219747+0000","last_fullsized":"2024-04-02T07:22:19.219747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:04:59.919960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370434+0000","last_change":"2024-04-02T07:22:17.829944+0000","last_active":"2024-04-02T07:22:20.370434+0000","last_peered":"2024-04-02T07:22:20.370434+0000","last_clean":"2024-04-02T07:22:20.370434+0000","last_became_active":"2024-04-02T07:22:17.829678+0000","last_became_peered":"2024-04-02T07:22:17.829678+0000","last_unstale":"2024-04-02T07:22:20.370434+0000","last_undegraded":"2024-04-02T07:22:20.370434+0000","last_fullsized":"2024-04-02T07:22:20.370434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:11:57.231785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371674+0000","last_change":"2024-04-02T07:22:18.246326+0000","last_active":"2024-04-02T07:22:20.371674+0000","last_peered":"2024-04-02T07:22:20.371674+0000","last_clean":"2024-04-02T07:22:20.371674+0000","last_became_active":"2024-04-02T07:22:18.243050+0000","last_became_peered":"2024-04-02T07:22:18.243050+0000","last_unstale":"2024-04-02T07:22:20.371674+0000","last_undegraded":"2024-04-02T07:22:20.371674+0000","last_fullsized":"2024-04-02T07:22:20.371674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:38:10.025630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370083+0000","last_change":"2024-04-02T07:22:17.819199+0000","last_active":"2024-04-02T07:22:20.370083+0000","last_peered":"2024-04-02T07:22:20.370083+0000","last_clean":"2024-04-02T07:22:20.370083+0000","last_became_active":"2024-04-02T07:22:17.818035+0000","last_became_peered":"2024-04-02T07:22:17.818035+0000","last_unstale":"2024-04-02T07:22:20.370083+0000","last_undegraded":"2024-04-02T07:22:20.370083+0000","last_fullsized":"2024-04-02T07:22:20.370083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:57:54.126973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370133+0000","last_change":"2024-04-02T07:22:18.232716+0000","last_active":"2024-04-02T07:22:20.370133+0000","last_peered":"2024-04-02T07:22:20.370133+0000","last_clean":"2024-04-02T07:22:20.370133+0000","last_became_active":"2024-04-02T07:22:18.232422+0000","last_became_peered":"2024-04-02T07:22:18.232422+0000","last_unstale":"2024-04-02T07:22:20.370133+0000","last_undegraded":"2024-04-02T07:22:20.370133+0000","last_fullsized":"2024-04-02T07:22:20.370133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:47:20.129295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369346+0000","last_change":"2024-04-02T07:22:17.817739+0000","last_active":"2024-04-02T07:22:20.369346+0000","last_peered":"2024-04-02T07:22:20.369346+0000","last_clean":"2024-04-02T07:22:20.369346+0000","last_became_active":"2024-04-02T07:22:17.817227+0000","last_became_peered":"2024-04-02T07:22:17.817227+0000","last_unstale":"2024-04-02T07:22:20.369346+0000","last_undegraded":"2024-04-02T07:22:20.369346+0000","last_fullsized":"2024-04-02T07:22:20.369346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:23:23.466281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371572+0000","last_change":"2024-04-02T07:22:18.240642+0000","last_active":"2024-04-02T07:22:20.371572+0000","last_peered":"2024-04-02T07:22:20.371572+0000","last_clean":"2024-04-02T07:22:20.371572+0000","last_became_active":"2024-04-02T07:22:18.240165+0000","last_became_peered":"2024-04-02T07:22:18.240165+0000","last_unstale":"2024-04-02T07:22:20.371572+0000","last_undegraded":"2024-04-02T07:22:20.371572+0000","last_fullsized":"2024-04-02T07:22:20.371572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:46:42.176195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.223000+0000","last_change":"2024-04-02T07:22:17.822782+0000","last_active":"2024-04-02T07:22:19.223000+0000","last_peered":"2024-04-02T07:22:19.223000+0000","last_clean":"2024-04-02T07:22:19.223000+0000","last_became_active":"2024-04-02T07:22:17.822505+0000","last_became_peered":"2024-04-02T07:22:17.822505+0000","last_unstale":"2024-04-02T07:22:19.223000+0000","last_undegraded":"2024-04-02T07:22:19.223000+0000","last_fullsized":"2024-04-02T07:22:19.223000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:17:18.668101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371519+0000","last_change":"2024-04-02T07:22:18.242686+0000","last_active":"2024-04-02T07:22:20.371519+0000","last_peered":"2024-04-02T07:22:20.371519+0000","last_clean":"2024-04-02T07:22:20.371519+0000","last_became_active":"2024-04-02T07:22:18.241019+0000","last_became_peered":"2024-04-02T07:22:18.241019+0000","last_unstale":"2024-04-02T07:22:20.371519+0000","last_undegraded":"2024-04-02T07:22:20.371519+0000","last_fullsized":"2024-04-02T07:22:20.371519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:25.644846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369835+0000","last_change":"2024-04-02T07:22:17.812835+0000","last_active":"2024-04-02T07:22:20.369835+0000","last_peered":"2024-04-02T07:22:20.369835+0000","last_clean":"2024-04-02T07:22:20.369835+0000","last_became_active":"2024-04-02T07:22:17.812523+0000","last_became_peered":"2024-04-02T07:22:17.812523+0000","last_unstale":"2024-04-02T07:22:20.369835+0000","last_undegraded":"2024-04-02T07:22:20.369835+0000","last_fullsized":"2024-04-02T07:22:20.369835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:28:39.704218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371903+0000","last_change":"2024-04-02T07:22:18.244574+0000","last_active":"2024-04-02T07:22:20.371903+0000","last_peered":"2024-04-02T07:22:20.371903+0000","last_clean":"2024-04-02T07:22:20.371903+0000","last_became_active":"2024-04-02T07:22:18.242790+0000","last_became_peered":"2024-04-02T07:22:18.242790+0000","last_unstale":"2024-04-02T07:22:20.371903+0000","last_undegraded":"2024-04-02T07:22:20.371903+0000","last_fullsized":"2024-04-02T07:22:20.371903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:10:08.342854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369995+0000","last_change":"2024-04-02T07:22:17.817479+0000","last_active":"2024-04-02T07:22:20.369995+0000","last_peered":"2024-04-02T07:22:20.369995+0000","last_clean":"2024-04-02T07:22:20.369995+0000","last_became_active":"2024-04-02T07:22:17.815303+0000","last_became_peered":"2024-04-02T07:22:17.815303+0000","last_unstale":"2024-04-02T07:22:20.369995+0000","last_undegraded":"2024-04-02T07:22:20.369995+0000","last_fullsized":"2024-04-02T07:22:20.369995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:28:34.570227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370553+0000","last_change":"2024-04-02T07:22:18.249350+0000","last_active":"2024-04-02T07:22:20.370553+0000","last_peered":"2024-04-02T07:22:20.370553+0000","last_clean":"2024-04-02T07:22:20.370553+0000","last_became_active":"2024-04-02T07:22:18.248787+0000","last_became_peered":"2024-04-02T07:22:18.248787+0000","last_unstale":"2024-04-02T07:22:20.370553+0000","last_undegraded":"2024-04-02T07:22:20.370553+0000","last_fullsized":"2024-04-02T07:22:20.370553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:12.939631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369552+0000","last_change":"2024-04-02T07:22:17.829125+0000","last_active":"2024-04-02T07:22:20.369552+0000","last_peered":"2024-04-02T07:22:20.369552+0000","last_clean":"2024-04-02T07:22:20.369552+0000","last_became_active":"2024-04-02T07:22:17.828816+0000","last_became_peered":"2024-04-02T07:22:17.828816+0000","last_unstale":"2024-04-02T07:22:20.369552+0000","last_undegraded":"2024-04-02T07:22:20.369552+0000","last_fullsized":"2024-04-02T07:22:20.369552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:11:57.231785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371611+0000","last_change":"2024-04-02T07:22:18.241645+0000","last_active":"2024-04-02T07:22:20.371611+0000","last_peered":"2024-04-02T07:22:20.371611+0000","last_clean":"2024-04-02T07:22:20.371611+0000","last_became_active":"2024-04-02T07:22:18.241397+0000","last_became_peered":"2024-04-02T07:22:18.241397+0000","last_unstale":"2024-04-02T07:22:20.371611+0000","last_undegraded":"2024-04-02T07:22:20.371611+0000","last_fullsized":"2024-04-02T07:22:20.371611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:16:31.258551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-02T07:22:18.219421+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:22:18.219421+0000","last_peered":"2024-04-02T07:22:18.219421+0000","last_clean":"2024-04-02T07:22:18.219421+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:22:18.219421+0000","last_undegraded":"2024-04-02T07:22:18.219421+0000","last_fullsized":"2024-04-02T07:22:18.219421+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370214+0000","last_change":"2024-04-02T07:22:17.824525+0000","last_active":"2024-04-02T07:22:20.370214+0000","last_peered":"2024-04-02T07:22:20.370214+0000","last_clean":"2024-04-02T07:22:20.370214+0000","last_became_active":"2024-04-02T07:22:17.824210+0000","last_became_peered":"2024-04-02T07:22:17.824210+0000","last_unstale":"2024-04-02T07:22:20.370214+0000","last_undegraded":"2024-04-02T07:22:20.370214+0000","last_fullsized":"2024-04-02T07:22:20.370214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:57:54.126973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221206+0000","last_change":"2024-04-02T07:22:18.242097+0000","last_active":"2024-04-02T07:22:19.221206+0000","last_peered":"2024-04-02T07:22:19.221206+0000","last_clean":"2024-04-02T07:22:19.221206+0000","last_became_active":"2024-04-02T07:22:18.241770+0000","last_became_peered":"2024-04-02T07:22:18.241770+0000","last_unstale":"2024-04-02T07:22:19.221206+0000","last_undegraded":"2024-04-02T07:22:19.221206+0000","last_fullsized":"2024-04-02T07:22:19.221206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:25.644846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371666+0000","last_change":"2024-04-02T07:22:17.824891+0000","last_active":"2024-04-02T07:22:20.371666+0000","last_peered":"2024-04-02T07:22:20.371666+0000","last_clean":"2024-04-02T07:22:20.371666+0000","last_became_active":"2024-04-02T07:22:17.824638+0000","last_became_peered":"2024-04-02T07:22:17.824638+0000","last_unstale":"2024-04-02T07:22:20.371666+0000","last_undegraded":"2024-04-02T07:22:20.371666+0000","last_fullsized":"2024-04-02T07:22:20.371666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:57:54.126973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.219520+0000","last_change":"2024-04-02T07:22:18.234896+0000","last_active":"2024-04-02T07:22:19.219520+0000","last_peered":"2024-04-02T07:22:19.219520+0000","last_clean":"2024-04-02T07:22:19.219520+0000","last_became_active":"2024-04-02T07:22:18.234660+0000","last_became_peered":"2024-04-02T07:22:18.234660+0000","last_unstale":"2024-04-02T07:22:19.219520+0000","last_undegraded":"2024-04-02T07:22:19.219520+0000","last_fullsized":"2024-04-02T07:22:19.219520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:59:52.607949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369565+0000","last_change":"2024-04-02T07:22:17.817464+0000","last_active":"2024-04-02T07:22:20.369565+0000","last_peered":"2024-04-02T07:22:20.369565+0000","last_clean":"2024-04-02T07:22:20.369565+0000","last_became_active":"2024-04-02T07:22:17.816972+0000","last_became_peered":"2024-04-02T07:22:17.816972+0000","last_unstale":"2024-04-02T07:22:20.369565+0000","last_undegraded":"2024-04-02T07:22:20.369565+0000","last_fullsized":"2024-04-02T07:22:20.369565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:26:13.873489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369566+0000","last_change":"2024-04-02T07:22:18.235644+0000","last_active":"2024-04-02T07:22:20.369566+0000","last_peered":"2024-04-02T07:22:20.369566+0000","last_clean":"2024-04-02T07:22:20.369566+0000","last_became_active":"2024-04-02T07:22:18.235180+0000","last_became_peered":"2024-04-02T07:22:18.235180+0000","last_unstale":"2024-04-02T07:22:20.369566+0000","last_undegraded":"2024-04-02T07:22:20.369566+0000","last_fullsized":"2024-04-02T07:22:20.369566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:14:02.133890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370710+0000","last_change":"2024-04-02T07:22:17.823676+0000","last_active":"2024-04-02T07:22:20.370710+0000","last_peered":"2024-04-02T07:22:20.370710+0000","last_clean":"2024-04-02T07:22:20.370710+0000","last_became_active":"2024-04-02T07:22:17.823161+0000","last_became_peered":"2024-04-02T07:22:17.823161+0000","last_unstale":"2024-04-02T07:22:20.370710+0000","last_undegraded":"2024-04-02T07:22:20.370710+0000","last_fullsized":"2024-04-02T07:22:20.370710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:23:23.466281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.222657+0000","last_change":"2024-04-02T07:22:18.228040+0000","last_active":"2024-04-02T07:22:19.222657+0000","last_peered":"2024-04-02T07:22:19.222657+0000","last_clean":"2024-04-02T07:22:19.222657+0000","last_became_active":"2024-04-02T07:22:18.227742+0000","last_became_peered":"2024-04-02T07:22:18.227742+0000","last_unstale":"2024-04-02T07:22:19.222657+0000","last_undegraded":"2024-04-02T07:22:19.222657+0000","last_fullsized":"2024-04-02T07:22:19.222657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:08:21.191481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369894+0000","last_change":"2024-04-02T07:22:17.817997+0000","last_active":"2024-04-02T07:22:20.369894+0000","last_peered":"2024-04-02T07:22:20.369894+0000","last_clean":"2024-04-02T07:22:20.369894+0000","last_became_active":"2024-04-02T07:22:17.816065+0000","last_became_peered":"2024-04-02T07:22:17.816065+0000","last_unstale":"2024-04-02T07:22:20.369894+0000","last_undegraded":"2024-04-02T07:22:20.369894+0000","last_fullsized":"2024-04-02T07:22:20.369894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:57:54.126973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371335+0000","last_change":"2024-04-02T07:22:18.250113+0000","last_active":"2024-04-02T07:22:20.371335+0000","last_peered":"2024-04-02T07:22:20.371335+0000","last_clean":"2024-04-02T07:22:20.371335+0000","last_became_active":"2024-04-02T07:22:18.249884+0000","last_became_peered":"2024-04-02T07:22:18.249884+0000","last_unstale":"2024-04-02T07:22:20.371335+0000","last_undegraded":"2024-04-02T07:22:20.371335+0000","last_fullsized":"2024-04-02T07:22:20.371335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:36:43.798159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371775+0000","last_change":"2024-04-02T07:22:17.828935+0000","last_active":"2024-04-02T07:22:20.371775+0000","last_peered":"2024-04-02T07:22:20.371775+0000","last_clean":"2024-04-02T07:22:20.371775+0000","last_became_active":"2024-04-02T07:22:17.828207+0000","last_became_peered":"2024-04-02T07:22:17.828207+0000","last_unstale":"2024-04-02T07:22:20.371775+0000","last_undegraded":"2024-04-02T07:22:20.371775+0000","last_fullsized":"2024-04-02T07:22:20.371775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:55:46.473285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369735+0000","last_change":"2024-04-02T07:22:18.229329+0000","last_active":"2024-04-02T07:22:20.369735+0000","last_peered":"2024-04-02T07:22:20.369735+0000","last_clean":"2024-04-02T07:22:20.369735+0000","last_became_active":"2024-04-02T07:22:18.228161+0000","last_became_peered":"2024-04-02T07:22:18.228161+0000","last_unstale":"2024-04-02T07:22:20.369735+0000","last_undegraded":"2024-04-02T07:22:20.369735+0000","last_fullsized":"2024-04-02T07:22:20.369735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:40:34.209765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370098+0000","last_change":"2024-04-02T07:22:17.818709+0000","last_active":"2024-04-02T07:22:20.370098+0000","last_peered":"2024-04-02T07:22:20.370098+0000","last_clean":"2024-04-02T07:22:20.370098+0000","last_became_active":"2024-04-02T07:22:17.817235+0000","last_became_peered":"2024-04-02T07:22:17.817235+0000","last_unstale":"2024-04-02T07:22:20.370098+0000","last_undegraded":"2024-04-02T07:22:20.370098+0000","last_fullsized":"2024-04-02T07:22:20.370098+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:10:54.215675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221561+0000","last_change":"2024-04-02T07:22:18.245016+0000","last_active":"2024-04-02T07:22:19.221561+0000","last_peered":"2024-04-02T07:22:19.221561+0000","last_clean":"2024-04-02T07:22:19.221561+0000","last_became_active":"2024-04-02T07:22:18.244613+0000","last_became_peered":"2024-04-02T07:22:18.244613+0000","last_unstale":"2024-04-02T07:22:19.221561+0000","last_undegraded":"2024-04-02T07:22:19.221561+0000","last_fullsized":"2024-04-02T07:22:19.221561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:12:09.974224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371212+0000","last_change":"2024-04-02T07:22:17.819790+0000","last_active":"2024-04-02T07:22:20.371212+0000","last_peered":"2024-04-02T07:22:20.371212+0000","last_clean":"2024-04-02T07:22:20.371212+0000","last_became_active":"2024-04-02T07:22:17.818108+0000","last_became_peered":"2024-04-02T07:22:17.818108+0000","last_unstale":"2024-04-02T07:22:20.371212+0000","last_undegraded":"2024-04-02T07:22:20.371212+0000","last_fullsized":"2024-04-02T07:22:20.371212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:23:23.466281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.220036+0000","last_change":"2024-04-02T07:22:18.228791+0000","last_active":"2024-04-02T07:22:19.220036+0000","last_peered":"2024-04-02T07:22:19.220036+0000","last_clean":"2024-04-02T07:22:19.220036+0000","last_became_active":"2024-04-02T07:22:18.228473+0000","last_became_peered":"2024-04-02T07:22:18.228473+0000","last_unstale":"2024-04-02T07:22:19.220036+0000","last_undegraded":"2024-04-02T07:22:19.220036+0000","last_fullsized":"2024-04-02T07:22:19.220036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:10:03.944538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371839+0000","last_change":"2024-04-02T07:22:17.825367+0000","last_active":"2024-04-02T07:22:20.371839+0000","last_peered":"2024-04-02T07:22:20.371839+0000","last_clean":"2024-04-02T07:22:20.371839+0000","last_became_active":"2024-04-02T07:22:17.825104+0000","last_became_peered":"2024-04-02T07:22:17.825104+0000","last_unstale":"2024-04-02T07:22:20.371839+0000","last_undegraded":"2024-04-02T07:22:20.371839+0000","last_fullsized":"2024-04-02T07:22:20.371839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:10:54.215675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.222586+0000","last_change":"2024-04-02T07:22:18.233413+0000","last_active":"2024-04-02T07:22:19.222586+0000","last_peered":"2024-04-02T07:22:19.222586+0000","last_clean":"2024-04-02T07:22:19.222586+0000","last_became_active":"2024-04-02T07:22:18.233117+0000","last_became_peered":"2024-04-02T07:22:18.233117+0000","last_unstale":"2024-04-02T07:22:19.222586+0000","last_undegraded":"2024-04-02T07:22:19.222586+0000","last_fullsized":"2024-04-02T07:22:19.222586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:10:55.218249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369809+0000","last_change":"2024-04-02T07:22:17.814952+0000","last_active":"2024-04-02T07:22:20.369809+0000","last_peered":"2024-04-02T07:22:20.369809+0000","last_clean":"2024-04-02T07:22:20.369809+0000","last_became_active":"2024-04-02T07:22:17.814563+0000","last_became_peered":"2024-04-02T07:22:17.814563+0000","last_unstale":"2024-04-02T07:22:20.369809+0000","last_undegraded":"2024-04-02T07:22:20.369809+0000","last_fullsized":"2024-04-02T07:22:20.369809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:23:23.466281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221101+0000","last_change":"2024-04-02T07:22:18.234123+0000","last_active":"2024-04-02T07:22:19.221101+0000","last_peered":"2024-04-02T07:22:19.221101+0000","last_clean":"2024-04-02T07:22:19.221101+0000","last_became_active":"2024-04-02T07:22:18.233486+0000","last_became_peered":"2024-04-02T07:22:18.233486+0000","last_unstale":"2024-04-02T07:22:19.221101+0000","last_undegraded":"2024-04-02T07:22:19.221101+0000","last_fullsized":"2024-04-02T07:22:19.221101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:59:52.607949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370124+0000","last_change":"2024-04-02T07:22:17.812302+0000","last_active":"2024-04-02T07:22:20.370124+0000","last_peered":"2024-04-02T07:22:20.370124+0000","last_clean":"2024-04-02T07:22:20.370124+0000","last_became_active":"2024-04-02T07:22:17.812047+0000","last_became_peered":"2024-04-02T07:22:17.812047+0000","last_unstale":"2024-04-02T07:22:20.370124+0000","last_undegraded":"2024-04-02T07:22:20.370124+0000","last_fullsized":"2024-04-02T07:22:20.370124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:11:57.231785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221351+0000","last_change":"2024-04-02T07:22:18.233906+0000","last_active":"2024-04-02T07:22:19.221351+0000","last_peered":"2024-04-02T07:22:19.221351+0000","last_clean":"2024-04-02T07:22:19.221351+0000","last_became_active":"2024-04-02T07:22:18.233651+0000","last_became_peered":"2024-04-02T07:22:18.233651+0000","last_unstale":"2024-04-02T07:22:19.221351+0000","last_undegraded":"2024-04-02T07:22:19.221351+0000","last_fullsized":"2024-04-02T07:22:19.221351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:03:59.884565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371794+0000","last_change":"2024-04-02T07:22:17.828556+0000","last_active":"2024-04-02T07:22:20.371794+0000","last_peered":"2024-04-02T07:22:20.371794+0000","last_clean":"2024-04-02T07:22:20.371794+0000","last_became_active":"2024-04-02T07:22:17.828231+0000","last_became_peered":"2024-04-02T07:22:17.828231+0000","last_unstale":"2024-04-02T07:22:20.371794+0000","last_undegraded":"2024-04-02T07:22:20.371794+0000","last_fullsized":"2024-04-02T07:22:20.371794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:08:20.188906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370077+0000","last_change":"2024-04-02T07:22:18.238093+0000","last_active":"2024-04-02T07:22:20.370077+0000","last_peered":"2024-04-02T07:22:20.370077+0000","last_clean":"2024-04-02T07:22:20.370077+0000","last_became_active":"2024-04-02T07:22:18.237834+0000","last_became_peered":"2024-04-02T07:22:18.237834+0000","last_unstale":"2024-04-02T07:22:20.370077+0000","last_undegraded":"2024-04-02T07:22:20.370077+0000","last_fullsized":"2024-04-02T07:22:20.370077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:14:02.133890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370610+0000","last_change":"2024-04-02T07:22:18.237467+0000","last_active":"2024-04-02T07:22:20.370610+0000","last_peered":"2024-04-02T07:22:20.370610+0000","last_clean":"2024-04-02T07:22:20.370610+0000","last_became_active":"2024-04-02T07:22:18.237207+0000","last_became_peered":"2024-04-02T07:22:18.237207+0000","last_unstale":"2024-04-02T07:22:20.370610+0000","last_undegraded":"2024-04-02T07:22:20.370610+0000","last_fullsized":"2024-04-02T07:22:20.370610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:17:53.201974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371339+0000","last_change":"2024-04-02T07:22:17.829386+0000","last_active":"2024-04-02T07:22:20.371339+0000","last_peered":"2024-04-02T07:22:20.371339+0000","last_clean":"2024-04-02T07:22:20.371339+0000","last_became_active":"2024-04-02T07:22:17.829068+0000","last_became_peered":"2024-04-02T07:22:17.829068+0000","last_unstale":"2024-04-02T07:22:20.371339+0000","last_undegraded":"2024-04-02T07:22:20.371339+0000","last_fullsized":"2024-04-02T07:22:20.371339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:24:06.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370454+0000","last_change":"2024-04-02T07:22:18.237780+0000","last_active":"2024-04-02T07:22:20.370454+0000","last_peered":"2024-04-02T07:22:20.370454+0000","last_clean":"2024-04-02T07:22:20.370454+0000","last_became_active":"2024-04-02T07:22:18.237463+0000","last_became_peered":"2024-04-02T07:22:18.237463+0000","last_unstale":"2024-04-02T07:22:20.370454+0000","last_undegraded":"2024-04-02T07:22:20.370454+0000","last_fullsized":"2024-04-02T07:22:20.370454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:03:59.884565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371531+0000","last_change":"2024-04-02T07:22:17.825046+0000","last_active":"2024-04-02T07:22:20.371531+0000","last_peered":"2024-04-02T07:22:20.371531+0000","last_clean":"2024-04-02T07:22:20.371531+0000","last_became_active":"2024-04-02T07:22:17.824764+0000","last_became_peered":"2024-04-02T07:22:17.824764+0000","last_unstale":"2024-04-02T07:22:20.371531+0000","last_undegraded":"2024-04-02T07:22:20.371531+0000","last_fullsized":"2024-04-02T07:22:20.371531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:28:34.570227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.220221+0000","last_change":"2024-04-02T07:22:18.232920+0000","last_active":"2024-04-02T07:22:19.220221+0000","last_peered":"2024-04-02T07:22:19.220221+0000","last_clean":"2024-04-02T07:22:19.220221+0000","last_became_active":"2024-04-02T07:22:18.232676+0000","last_became_peered":"2024-04-02T07:22:18.232676+0000","last_unstale":"2024-04-02T07:22:19.220221+0000","last_undegraded":"2024-04-02T07:22:19.220221+0000","last_fullsized":"2024-04-02T07:22:19.220221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:12:09.974224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221499+0000","last_change":"2024-04-02T07:22:17.815381+0000","last_active":"2024-04-02T07:22:19.221499+0000","last_peered":"2024-04-02T07:22:19.221499+0000","last_clean":"2024-04-02T07:22:19.221499+0000","last_became_active":"2024-04-02T07:22:17.814994+0000","last_became_peered":"2024-04-02T07:22:17.814994+0000","last_unstale":"2024-04-02T07:22:19.221499+0000","last_undegraded":"2024-04-02T07:22:19.221499+0000","last_fullsized":"2024-04-02T07:22:19.221499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:28:39.704218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221449+0000","last_change":"2024-04-02T07:22:18.242114+0000","last_active":"2024-04-02T07:22:19.221449+0000","last_peered":"2024-04-02T07:22:19.221449+0000","last_clean":"2024-04-02T07:22:19.221449+0000","last_became_active":"2024-04-02T07:22:18.241865+0000","last_became_peered":"2024-04-02T07:22:18.241865+0000","last_unstale":"2024-04-02T07:22:19.221449+0000","last_undegraded":"2024-04-02T07:22:19.221449+0000","last_fullsized":"2024-04-02T07:22:19.221449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:36:43.798159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.220294+0000","last_change":"2024-04-02T07:22:17.827269+0000","last_active":"2024-04-02T07:22:19.220294+0000","last_peered":"2024-04-02T07:22:19.220294+0000","last_clean":"2024-04-02T07:22:19.220294+0000","last_became_active":"2024-04-02T07:22:17.826815+0000","last_became_peered":"2024-04-02T07:22:17.826815+0000","last_unstale":"2024-04-02T07:22:19.220294+0000","last_undegraded":"2024-04-02T07:22:19.220294+0000","last_fullsized":"2024-04-02T07:22:19.220294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:17:18.668101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55600000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.022}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1259999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90100000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31328,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340512,"statfs":{"total":96636764160,"available":96604684288,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70799999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:22:22.730 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-02T07:22:22.731 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-02T07:22:22.731 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-02T07:22:22.731 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-02T07:22:22.732 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-02T07:22:22.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.901+0000 7f4542c00640 1 Processor -- start 2024-04-02T07:22:22.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.901+0000 7f4542c00640 1 -- start start 2024-04-02T07:22:22.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.905+0000 7f4542c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f453c15ca70 0x7f453c0b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:22.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.905+0000 7f4542c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f453c06b700 0x7f453c098ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:22.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.905+0000 7f4542c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f453c15ce50 con 0x7f453c098a10 2024-04-02T07:22:22.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.905+0000 7f4542c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f453c0993e0 con 0x7f453c15ca70 2024-04-02T07:22:22.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.905+0000 7f4542c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453c0cef60 con 0x7f453c06b700 2024-04-02T07:22:22.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.905+0000 7f4533400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f453c098a10 0x7f453c06aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57298/0 (socket says 172.21.15.55:57298) 2024-04-02T07:22:22.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.905+0000 7f4533400640 1 -- 172.21.15.55:0/3651046413 learned_addr learned my addr 172.21.15.55:0/3651046413 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:22.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.905+0000 7f4540c00640 1 --2- 172.21.15.55:0/3651046413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f453c06b700 0x7f453c098ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:22.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.905+0000 7f453be00640 1 --2- 172.21.15.55:0/3651046413 >> v2:172.21.15.106:3300/0 conn(0x7f453c15ca70 0x7f453c0b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:22.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.905+0000 7f453b400640 1 -- 172.21.15.55:0/3651046413 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 982454060 0 0) 0x7f453c15ce50 con 0x7f453c098a10 2024-04-02T07:22:22.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.905+0000 7f453b400640 1 -- 172.21.15.55:0/3651046413 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4520003530 con 0x7f453c098a10 2024-04-02T07:22:22.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.905+0000 7f4540c00640 1 -- 172.21.15.55:0/3651046413 >> v2:172.21.15.106:3300/0 conn(0x7f453c15ca70 msgr2=0x7f453c0b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:22.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.905+0000 7f4540c00640 1 --2- 172.21.15.55:0/3651046413 >> v2:172.21.15.106:3300/0 conn(0x7f453c15ca70 0x7f453c0b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.905+0000 7f4540c00640 1 -- 172.21.15.55:0/3651046413 >> v1:172.21.15.55:6789/0 conn(0x7f453c098a10 legacy=0x7f453c06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:22.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.905+0000 7f4540c00640 1 -- 172.21.15.55:0/3651046413 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f453c06bd60 con 0x7f453c06b700 2024-04-02T07:22:22.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.909+0000 7f4540c00640 1 --2- 172.21.15.55:0/3651046413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f453c06b700 0x7f453c098ea0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4534009d90 tx=0x7f453401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a46af1f040d41a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:22.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.909+0000 7f453b400640 1 -- 172.21.15.55:0/3651046413 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45340a5920 con 0x7f453c06b700 2024-04-02T07:22:22.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.909+0000 7f453b400640 1 -- 172.21.15.55:0/3651046413 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45340a5a80 con 0x7f453c06b700 2024-04-02T07:22:22.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.909+0000 7f453b400640 1 -- 172.21.15.55:0/3651046413 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45340a5e10 con 0x7f453c06b700 2024-04-02T07:22:22.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.909+0000 7f4542c00640 1 -- 172.21.15.55:0/3651046413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f453c06b700 msgr2=0x7f453c098ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:22.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.909+0000 7f4542c00640 1 --2- 172.21.15.55:0/3651046413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f453c06b700 0x7f453c098ea0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f4534009d90 tx=0x7f453401c970 comp rx=0 tx=0).stop 2024-04-02T07:22:22.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.909+0000 7f4542c00640 1 -- 172.21.15.55:0/3651046413 shutdown_connections 2024-04-02T07:22:22.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.909+0000 7f4542c00640 1 --2- 172.21.15.55:0/3651046413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f453c06b700 0x7f453c098ea0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.909+0000 7f4542c00640 1 --2- 172.21.15.55:0/3651046413 >> v2:172.21.15.106:3300/0 conn(0x7f453c15ca70 0x7f453c0b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.909+0000 7f4542c00640 1 -- 172.21.15.55:0/3651046413 >> 172.21.15.55:0/3651046413 conn(0x7f453c0b21d0 msgr2=0x7f453c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:22.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.909+0000 7f4542c00640 1 -- 172.21.15.55:0/3651046413 shutdown_connections 2024-04-02T07:22:22.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.909+0000 7f4542c00640 1 -- 172.21.15.55:0/3651046413 wait complete. 2024-04-02T07:22:22.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.909+0000 7f4542c00640 1 Processor -- start 2024-04-02T07:22:22.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.909+0000 7f4542c00640 1 -- start start 2024-04-02T07:22:22.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.909+0000 7f4542c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f453c06b700 0x7f453c1578c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:22.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.909+0000 7f4542c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f453c098a10 0x7f453c1542d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:22.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.909+0000 7f4542c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f453c15ca70 0x7f453c1526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:22.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.909+0000 7f4542c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c0af720 con 0x7f453c06b700 2024-04-02T07:22:22.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.909+0000 7f4542c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c0adc80 con 0x7f453c098a10 2024-04-02T07:22:22.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.909+0000 7f4542c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f453c0adf60 con 0x7f453c15ca70 2024-04-02T07:22:22.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.913+0000 7f453be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f453c06b700 0x7f453c1578c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.913+0000 7f453be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f453c06b700 0x7f453c1578c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51534/0 (socket says 172.21.15.55:51534) 2024-04-02T07:22:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.913+0000 7f453be00640 1 -- 172.21.15.55:0/552290338 learned_addr learned my addr 172.21.15.55:0/552290338 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.913+0000 7f4533400640 1 --2- 172.21.15.55:0/552290338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f453c098a10 0x7f453c1542d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.913+0000 7f4540c00640 1 --2- 172.21.15.55:0/552290338 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f453c15ca70 0x7f453c1526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.913+0000 7f453be00640 1 -- 172.21.15.55:0/552290338 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f453c15ca70 msgr2=0x7f453c1526e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.913+0000 7f453be00640 1 --2- 172.21.15.55:0/552290338 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f453c15ca70 0x7f453c1526e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.913+0000 7f453be00640 1 -- 172.21.15.55:0/552290338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f453c098a10 msgr2=0x7f453c1542d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.913+0000 7f453be00640 1 --2- 172.21.15.55:0/552290338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f453c098a10 0x7f453c1542d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.913+0000 7f453be00640 1 -- 172.21.15.55:0/552290338 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4534009a70 con 0x7f453c06b700 2024-04-02T07:22:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.913+0000 7f453be00640 1 --2- 172.21.15.55:0/552290338 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f453c06b700 0x7f453c1578c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f452c00e870 tx=0x7f452c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.913+0000 7f4538c00640 1 -- 172.21.15.55:0/552290338 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c009510 con 0x7f453c06b700 2024-04-02T07:22:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.913+0000 7f4538c00640 1 -- 172.21.15.55:0/552290338 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452c00eec0 con 0x7f453c06b700 2024-04-02T07:22:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.913+0000 7f4538c00640 1 -- 172.21.15.55:0/552290338 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452c00cb40 con 0x7f453c06b700 2024-04-02T07:22:22.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.913+0000 7f4542c00640 1 -- 172.21.15.55:0/552290338 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453c0ae240 con 0x7f453c06b700 2024-04-02T07:22:22.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.913+0000 7f4542c00640 1 -- 172.21.15.55:0/552290338 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453c157e00 con 0x7f453c06b700 2024-04-02T07:22:22.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.913+0000 7f4542c00640 1 -- 172.21.15.55:0/552290338 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453c066c90 con 0x7f453c06b700 2024-04-02T07:22:22.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.913+0000 7f4538c00640 1 -- 172.21.15.55:0/552290338 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f452c00cca0 con 0x7f453c06b700 2024-04-02T07:22:22.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.913+0000 7f4538c00640 1 --2- 172.21.15.55:0/552290338 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f45180666c0 0x7f4518068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:22.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.913+0000 7f4538c00640 1 -- 172.21.15.55:0/552290338 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f452c084200 con 0x7f453c06b700 2024-04-02T07:22:22.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.917+0000 7f4533400640 1 --2- 172.21.15.55:0/552290338 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f45180666c0 0x7f4518068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:22.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.917+0000 7f4533400640 1 --2- 172.21.15.55:0/552290338 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f45180666c0 0x7f4518068b80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f453c158a30 tx=0x7f4524009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:22.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:22.917+0000 7f4538c00640 1 -- 172.21.15.55:0/552290338 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f452c051560 con 0x7f453c06b700 2024-04-02T07:22:23.004 INFO:tasks.ceph.mds.b.smithi106.stderr:2024-04-02T07:22:23.000+0000 7f6954200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:22:23.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.113+0000 7f4542c00640 1 -- 172.21.15.55:0/552290338 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f453c0c72e0 con 0x7f453c06b700 2024-04-02T07:22:23.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.117+0000 7f4538c00640 1 -- 172.21.15.55:0/552290338 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+164880 (secure 0 0 0) 0x7f452c054b80 con 0x7f453c06b700 2024-04-02T07:22:23.124 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:23.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.121+0000 7f4542c00640 1 -- 172.21.15.55:0/552290338 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f45180666c0 msgr2=0x7f4518068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:23.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.121+0000 7f4542c00640 1 --2- 172.21.15.55:0/552290338 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f45180666c0 0x7f4518068b80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f453c158a30 tx=0x7f4524009040 comp rx=0 tx=0).stop 2024-04-02T07:22:23.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.121+0000 7f4542c00640 1 -- 172.21.15.55:0/552290338 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f453c06b700 msgr2=0x7f453c1578c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:23.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.121+0000 7f4542c00640 1 --2- 172.21.15.55:0/552290338 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f453c06b700 0x7f453c1578c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f452c00e870 tx=0x7f452c00ec70 comp rx=0 tx=0).stop 2024-04-02T07:22:23.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.121+0000 7f4542c00640 1 -- 172.21.15.55:0/552290338 shutdown_connections 2024-04-02T07:22:23.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.121+0000 7f4542c00640 1 --2- 172.21.15.55:0/552290338 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f453c15ca70 0x7f453c1526e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:23.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.121+0000 7f4542c00640 1 --2- 172.21.15.55:0/552290338 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f45180666c0 0x7f4518068b80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:23.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.121+0000 7f4542c00640 1 --2- 172.21.15.55:0/552290338 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f453c098a10 0x7f453c1542d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:23.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.121+0000 7f4542c00640 1 --2- 172.21.15.55:0/552290338 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f453c06b700 0x7f453c1578c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:23.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.121+0000 7f4542c00640 1 -- 172.21.15.55:0/552290338 >> 172.21.15.55:0/552290338 conn(0x7f453c0b21d0 msgr2=0x7f453c1592f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:23.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.121+0000 7f4542c00640 1 -- 172.21.15.55:0/552290338 shutdown_connections 2024-04-02T07:22:23.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.121+0000 7f4542c00640 1 -- 172.21.15.55:0/552290338 wait complete. 2024-04-02T07:22:23.145 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":5,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6832","nonce":27356},{"type":"v1","addr":"172.21.15.106:6833","nonce":27356}]},"active_addr":"172.21.15.106:6833/27356","active_change":"2024-04-02T07:21:58.319487+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":2244986602}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":3640689078}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":3830884070}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.106:0","nonce":18482031}]}]} 2024-04-02T07:22:23.150 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-02T07:22:23.150 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-02T07:22:23.150 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:23.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.285+0000 7f5608a00640 1 Processor -- start 2024-04-02T07:22:23.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.285+0000 7f5608a00640 1 -- start start 2024-04-02T07:22:23.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.289+0000 7f5608a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56040b3590 0x7f560415c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:23.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.289+0000 7f5608a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560415d250 con 0x7f56040b0cb0 2024-04-02T07:22:23.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.289+0000 7f5608a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56040cac90 con 0x7f560415ce40 2024-04-02T07:22:23.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.289+0000 7f5608a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56040b1090 con 0x7f56040b3590 2024-04-02T07:22:23.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.289+0000 7f55fbe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56040b3590 0x7f560415c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:23.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.289+0000 7f5601e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f56040b0cb0 0x7f56040c3680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57308/0 (socket says 172.21.15.55:57308) 2024-04-02T07:22:23.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.289+0000 7f55fbe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56040b3590 0x7f560415c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51538/0 (socket says 172.21.15.55:51538) 2024-04-02T07:22:23.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.289+0000 7f5601e00640 1 -- 172.21.15.55:0/1498565341 learned_addr learned my addr 172.21.15.55:0/1498565341 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:23.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.289+0000 7f55fbe00640 1 -- 172.21.15.55:0/1498565341 >> v1:172.21.15.106:6789/0 conn(0x7f560415ce40 legacy=0x7f56040cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:23.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.289+0000 7f55fbe00640 1 -- 172.21.15.55:0/1498565341 >> v1:172.21.15.55:6789/0 conn(0x7f56040b0cb0 legacy=0x7f56040c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:23.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.289+0000 7f55fbe00640 1 -- 172.21.15.55:0/1498565341 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56040caf70 con 0x7f56040b3590 2024-04-02T07:22:23.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.289+0000 7f5601400640 1 -- 172.21.15.55:0/1498565341 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047100776 0 0) 0x7f560415d250 con 0x7f56040b0cb0 2024-04-02T07:22:23.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.293+0000 7f55fbe00640 1 --2- 172.21.15.55:0/1498565341 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56040b3590 0x7f560415c900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0097c0 tx=0x7f55ec01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3c7c1284f98a6df server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:23.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.293+0000 7f5601400640 1 -- 172.21.15.55:0/1498565341 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec0ab600 con 0x7f56040b3590 2024-04-02T07:22:23.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.293+0000 7f5601400640 1 -- 172.21.15.55:0/1498565341 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec0a7050 con 0x7f56040b3590 2024-04-02T07:22:23.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.293+0000 7f5601400640 1 -- 172.21.15.55:0/1498565341 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec0ab980 con 0x7f56040b3590 2024-04-02T07:22:23.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.293+0000 7f5608a00640 1 -- 172.21.15.55:0/1498565341 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56040b3590 msgr2=0x7f560415c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:23.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.293+0000 7f5608a00640 1 --2- 172.21.15.55:0/1498565341 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56040b3590 0x7f560415c900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0097c0 tx=0x7f55ec01c460 comp rx=0 tx=0).stop 2024-04-02T07:22:23.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.293+0000 7f5608a00640 1 -- 172.21.15.55:0/1498565341 shutdown_connections 2024-04-02T07:22:23.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.293+0000 7f5608a00640 1 --2- 172.21.15.55:0/1498565341 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56040b3590 0x7f560415c900 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:23.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.293+0000 7f5608a00640 1 -- 172.21.15.55:0/1498565341 >> 172.21.15.55:0/1498565341 conn(0x7f5604066080 msgr2=0x7f5604069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:23.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.293+0000 7f5608a00640 1 -- 172.21.15.55:0/1498565341 shutdown_connections 2024-04-02T07:22:23.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.293+0000 7f5608a00640 1 -- 172.21.15.55:0/1498565341 wait complete. 2024-04-02T07:22:23.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.293+0000 7f5608a00640 1 Processor -- start 2024-04-02T07:22:23.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.293+0000 7f5608a00640 1 -- start start 2024-04-02T07:22:23.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f5608a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56040b0cb0 0x7f560413ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:23.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f5608a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56040b3590 0x7f5604140880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:23.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f5608a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f560415ce40 0x7f5604141c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:23.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f5608a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560413b3d0 con 0x7f56040b0cb0 2024-04-02T07:22:23.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f5608a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5604167260 con 0x7f560415ce40 2024-04-02T07:22:23.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f5608a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560413d6c0 con 0x7f56040b3590 2024-04-02T07:22:23.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f5601e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56040b0cb0 0x7f560413ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:23.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f5601e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56040b0cb0 0x7f560413ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51542/0 (socket says 172.21.15.55:51542) 2024-04-02T07:22:23.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f5601e00640 1 -- 172.21.15.55:0/2158127218 learned_addr learned my addr 172.21.15.55:0/2158127218 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:23.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f55fbe00640 1 --2- 172.21.15.55:0/2158127218 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56040b3590 0x7f5604140880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:23.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f5602800640 1 --2- 172.21.15.55:0/2158127218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f560415ce40 0x7f5604141c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:23.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f5601e00640 1 -- 172.21.15.55:0/2158127218 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56040b3590 msgr2=0x7f5604140880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:23.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f5601e00640 1 --2- 172.21.15.55:0/2158127218 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56040b3590 0x7f5604140880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:23.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f5601e00640 1 -- 172.21.15.55:0/2158127218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f560415ce40 msgr2=0x7f5604141c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:23.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f5601e00640 1 --2- 172.21.15.55:0/2158127218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f560415ce40 0x7f5604141c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:23.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f5601e00640 1 -- 172.21.15.55:0/2158127218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec009420 con 0x7f56040b0cb0 2024-04-02T07:22:23.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f5602800640 1 --2- 172.21.15.55:0/2158127218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f560415ce40 0x7f5604141c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:23.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f5601e00640 1 --2- 172.21.15.55:0/2158127218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56040b0cb0 0x7f560413ab30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f55f4007fd0 tx=0x7f55f400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:23.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f55fa000640 1 -- 172.21.15.55:0/2158127218 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f4005cf0 con 0x7f56040b0cb0 2024-04-02T07:22:23.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f55fa000640 1 -- 172.21.15.55:0/2158127218 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f4005e70 con 0x7f56040b0cb0 2024-04-02T07:22:23.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f55fa000640 1 -- 172.21.15.55:0/2158127218 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f40072f0 con 0x7f56040b0cb0 2024-04-02T07:22:23.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f5608a00640 1 -- 172.21.15.55:0/2158127218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560413d9a0 con 0x7f56040b0cb0 2024-04-02T07:22:23.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f5608a00640 1 -- 172.21.15.55:0/2158127218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56041677e0 con 0x7f56040b0cb0 2024-04-02T07:22:23.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f5608a00640 1 -- 172.21.15.55:0/2158127218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5604066c90 con 0x7f56040b0cb0 2024-04-02T07:22:23.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.297+0000 7f55fa000640 1 -- 172.21.15.55:0/2158127218 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f55f4007450 con 0x7f56040b0cb0 2024-04-02T07:22:23.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.301+0000 7f55fa000640 1 --2- 172.21.15.55:0/2158127218 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f55e0066690 0x7f55e0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:23.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.301+0000 7f55fa000640 1 -- 172.21.15.55:0/2158127218 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55f4083650 con 0x7f56040b0cb0 2024-04-02T07:22:23.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.301+0000 7f55fbe00640 1 --2- 172.21.15.55:0/2158127218 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f55e0066690 0x7f55e0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:23.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.301+0000 7f55fbe00640 1 --2- 172.21.15.55:0/2158127218 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f55e0066690 0x7f55e0068b50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0ad000 tx=0x7f55ec0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:23.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.305+0000 7f55fa000640 1 -- 172.21.15.55:0/2158127218 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f55f4050b00 con 0x7f56040b0cb0 2024-04-02T07:22:23.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.465+0000 7f5608a00640 1 -- 172.21.15.55:0/2158127218 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5604167bb0 con 0x7f56040b0cb0 2024-04-02T07:22:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.465+0000 7f55fa000640 1 -- 172.21.15.55:0/2158127218 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f55f4054120 con 0x7f56040b0cb0 2024-04-02T07:22:23.469 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:23.469 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:19.207279+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.465+0000 7f5608a00640 1 -- 172.21.15.55:0/2158127218 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f55e0066690 msgr2=0x7f55e0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.465+0000 7f5608a00640 1 --2- 172.21.15.55:0/2158127218 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f55e0066690 0x7f55e0068b50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f55ec0ad000 tx=0x7f55ec0a6000 comp rx=0 tx=0).stop 2024-04-02T07:22:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.465+0000 7f5608a00640 1 -- 172.21.15.55:0/2158127218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56040b0cb0 msgr2=0x7f560413ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.465+0000 7f5608a00640 1 --2- 172.21.15.55:0/2158127218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56040b0cb0 0x7f560413ab30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f55f4007fd0 tx=0x7f55f400c8e0 comp rx=0 tx=0).stop 2024-04-02T07:22:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.465+0000 7f5608a00640 1 -- 172.21.15.55:0/2158127218 shutdown_connections 2024-04-02T07:22:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.465+0000 7f5608a00640 1 --2- 172.21.15.55:0/2158127218 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f55e0066690 0x7f55e0068b50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.465+0000 7f5608a00640 1 --2- 172.21.15.55:0/2158127218 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f560415ce40 0x7f5604141c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.465+0000 7f5608a00640 1 --2- 172.21.15.55:0/2158127218 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56040b3590 0x7f5604140880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.465+0000 7f5608a00640 1 --2- 172.21.15.55:0/2158127218 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56040b0cb0 0x7f560413ab30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.465+0000 7f5608a00640 1 -- 172.21.15.55:0/2158127218 >> 172.21.15.55:0/2158127218 conn(0x7f5604066080 msgr2=0x7f5604069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:23.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.465+0000 7f5608a00640 1 -- 172.21.15.55:0/2158127218 shutdown_connections 2024-04-02T07:22:23.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.465+0000 7f5608a00640 1 -- 172.21.15.55:0/2158127218 wait complete. 2024-04-02T07:22:23.490 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-02T07:22:23.490 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:23.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.625+0000 7f5bd0e00640 1 Processor -- start 2024-04-02T07:22:23.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.625+0000 7f5bd0e00640 1 -- start start 2024-04-02T07:22:23.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.629+0000 7f5bd0e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bcc0c4120 0x7f5bcc0b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:23.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.629+0000 7f5bd0e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bcc13d0c0 con 0x7f5bcc0b36f0 2024-04-02T07:22:23.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.629+0000 7f5bd0e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bcc15a4f0 con 0x7f5bcc153ea0 2024-04-02T07:22:23.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.629+0000 7f5bd0e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc0c4580 con 0x7f5bcc0c4120 2024-04-02T07:22:23.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.629+0000 7f5bca800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5bcc0b36f0 0x7f5bcc13d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57318/0 (socket says 172.21.15.55:57318) 2024-04-02T07:22:23.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.629+0000 7f5bca800640 1 -- 172.21.15.55:0/925165161 learned_addr learned my addr 172.21.15.55:0/925165161 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:23.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.629+0000 7f5bc1400640 1 --2- 172.21.15.55:0/925165161 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bcc0c4120 0x7f5bcc0b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:23.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.629+0000 7f5bc9400640 1 -- 172.21.15.55:0/925165161 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1643556777 0 0) 0x7f5bcc13d0c0 con 0x7f5bcc0b36f0 2024-04-02T07:22:23.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.629+0000 7f5bc9400640 1 -- 172.21.15.55:0/925165161 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bb0003530 con 0x7f5bcc0b36f0 2024-04-02T07:22:23.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.629+0000 7f5bc1400640 1 -- 172.21.15.55:0/925165161 >> v1:172.21.15.106:6789/0 conn(0x7f5bcc153ea0 legacy=0x7f5bcc159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:23.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.629+0000 7f5bc1400640 1 -- 172.21.15.55:0/925165161 >> v1:172.21.15.55:6789/0 conn(0x7f5bcc0b36f0 legacy=0x7f5bcc13d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:23.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.629+0000 7f5bc9400640 1 -- 172.21.15.55:0/925165161 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334008500 0 0) 0x7f5bcc15a4f0 con 0x7f5bcc153ea0 2024-04-02T07:22:23.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.629+0000 7f5bc1400640 1 -- 172.21.15.55:0/925165161 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bcc15a7d0 con 0x7f5bcc0c4120 2024-04-02T07:22:23.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.633+0000 7f5bc1400640 1 --2- 172.21.15.55:0/925165161 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bcc0c4120 0x7f5bcc0b31b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5bb40097f0 tx=0x7f5bb401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dda4525fa7aa6397 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:23.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.633+0000 7f5bc9400640 1 -- 172.21.15.55:0/925165161 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb40ab5f0 con 0x7f5bcc0c4120 2024-04-02T07:22:23.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.633+0000 7f5bc9400640 1 -- 172.21.15.55:0/925165161 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb40ab750 con 0x7f5bcc0c4120 2024-04-02T07:22:23.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.633+0000 7f5bc9400640 1 -- 172.21.15.55:0/925165161 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb40abac0 con 0x7f5bcc0c4120 2024-04-02T07:22:23.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.633+0000 7f5bd0e00640 1 -- 172.21.15.55:0/925165161 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bcc0c4120 msgr2=0x7f5bcc0b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:23.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.633+0000 7f5bd0e00640 1 --2- 172.21.15.55:0/925165161 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bcc0c4120 0x7f5bcc0b31b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5bb40097f0 tx=0x7f5bb401c4e0 comp rx=0 tx=0).stop 2024-04-02T07:22:23.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.633+0000 7f5bd0e00640 1 -- 172.21.15.55:0/925165161 shutdown_connections 2024-04-02T07:22:23.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.633+0000 7f5bd0e00640 1 --2- 172.21.15.55:0/925165161 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bcc0c4120 0x7f5bcc0b31b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:23.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.633+0000 7f5bd0e00640 1 -- 172.21.15.55:0/925165161 >> 172.21.15.55:0/925165161 conn(0x7f5bcc066080 msgr2=0x7f5bcc069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:23.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.633+0000 7f5bd0e00640 1 -- 172.21.15.55:0/925165161 shutdown_connections 2024-04-02T07:22:23.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.633+0000 7f5bd0e00640 1 -- 172.21.15.55:0/925165161 wait complete. 2024-04-02T07:22:23.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.633+0000 7f5bd0e00640 1 Processor -- start 2024-04-02T07:22:23.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.633+0000 7f5bd0e00640 1 -- start start 2024-04-02T07:22:23.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.633+0000 7f5bd0e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5bcc0b36f0 0x7f5bcc140300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:23.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.633+0000 7f5bd0e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5bcc0c4120 0x7f5bcc152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:23.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bd0e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bcc153ea0 0x7f5bcc137d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:23.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bd0e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc1f8f50 con 0x7f5bcc0b36f0 2024-04-02T07:22:23.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bd0e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc1f8380 con 0x7f5bcc0c4120 2024-04-02T07:22:23.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bd0e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bcc1f8620 con 0x7f5bcc153ea0 2024-04-02T07:22:23.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bc9e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5bcc0b36f0 0x7f5bcc140300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:23.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bc9e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5bcc0b36f0 0x7f5bcc140300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51552/0 (socket says 172.21.15.55:51552) 2024-04-02T07:22:23.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bc9e00640 1 -- 172.21.15.55:0/10676364 learned_addr learned my addr 172.21.15.55:0/10676364 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:23.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bc1400640 1 --2- 172.21.15.55:0/10676364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5bcc0c4120 0x7f5bcc152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:23.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bca800640 1 --2- 172.21.15.55:0/10676364 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bcc153ea0 0x7f5bcc137d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:23.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bc9e00640 1 -- 172.21.15.55:0/10676364 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bcc153ea0 msgr2=0x7f5bcc137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:23.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bc9e00640 1 --2- 172.21.15.55:0/10676364 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bcc153ea0 0x7f5bcc137d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:23.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bc9e00640 1 -- 172.21.15.55:0/10676364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5bcc0c4120 msgr2=0x7f5bcc152cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:23.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bc9e00640 1 --2- 172.21.15.55:0/10676364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5bcc0c4120 0x7f5bcc152cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:23.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bc9e00640 1 -- 172.21.15.55:0/10676364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb4009420 con 0x7f5bcc0b36f0 2024-04-02T07:22:23.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bc9e00640 1 --2- 172.21.15.55:0/10676364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5bcc0b36f0 0x7f5bcc140300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00c7a0 tx=0x7f5bbc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bc2a00640 1 -- 172.21.15.55:0/10676364 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc003db0 con 0x7f5bcc0b36f0 2024-04-02T07:22:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bc2a00640 1 -- 172.21.15.55:0/10676364 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bbc005070 con 0x7f5bcc0b36f0 2024-04-02T07:22:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bd0e00640 1 -- 172.21.15.55:0/10676364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bcc1f8900 con 0x7f5bcc0b36f0 2024-04-02T07:22:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bc2a00640 1 -- 172.21.15.55:0/10676364 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc005420 con 0x7f5bcc0b36f0 2024-04-02T07:22:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bd0e00640 1 -- 172.21.15.55:0/10676364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bcc153210 con 0x7f5bcc0b36f0 2024-04-02T07:22:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bd0e00640 1 -- 172.21.15.55:0/10676364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bcc066c90 con 0x7f5bcc0b36f0 2024-04-02T07:22:23.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.637+0000 7f5bc2a00640 1 -- 172.21.15.55:0/10676364 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5bbc005580 con 0x7f5bcc0b36f0 2024-04-02T07:22:23.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.641+0000 7f5bc2a00640 1 --2- 172.21.15.55:0/10676364 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ba8066690 0x7f5ba8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:23.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.641+0000 7f5bc2a00640 1 -- 172.21.15.55:0/10676364 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5bbc0838f0 con 0x7f5bcc0b36f0 2024-04-02T07:22:23.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.641+0000 7f5bc1400640 1 --2- 172.21.15.55:0/10676364 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ba8066690 0x7f5ba8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:23.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.641+0000 7f5bc1400640 1 --2- 172.21.15.55:0/10676364 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ba8066690 0x7f5ba8068b50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5bb40af000 tx=0x7f5bb40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:23.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.645+0000 7f5bc2a00640 1 -- 172.21.15.55:0/10676364 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5bbc050d10 con 0x7f5bcc0b36f0 2024-04-02T07:22:23.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.805+0000 7f5bd0e00640 1 -- 172.21.15.55:0/10676364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5bcc13d8d0 con 0x7f5bcc0b36f0 2024-04-02T07:22:23.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.805+0000 7f5bc2a00640 1 -- 172.21.15.55:0/10676364 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f5bbc017070 con 0x7f5bcc0b36f0 2024-04-02T07:22:23.811 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:23.811 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:19.207279+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:23.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.809+0000 7f5bd0e00640 1 -- 172.21.15.55:0/10676364 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ba8066690 msgr2=0x7f5ba8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:23.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.809+0000 7f5bd0e00640 1 --2- 172.21.15.55:0/10676364 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ba8066690 0x7f5ba8068b50 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5bb40af000 tx=0x7f5bb40a7000 comp rx=0 tx=0).stop 2024-04-02T07:22:23.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.809+0000 7f5bd0e00640 1 -- 172.21.15.55:0/10676364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5bcc0b36f0 msgr2=0x7f5bcc140300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:23.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.809+0000 7f5bd0e00640 1 --2- 172.21.15.55:0/10676364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5bcc0b36f0 0x7f5bcc140300 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00c7a0 tx=0x7f5bbc00cc60 comp rx=0 tx=0).stop 2024-04-02T07:22:23.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.809+0000 7f5bd0e00640 1 -- 172.21.15.55:0/10676364 shutdown_connections 2024-04-02T07:22:23.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.809+0000 7f5bd0e00640 1 --2- 172.21.15.55:0/10676364 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5bcc153ea0 0x7f5bcc137d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:23.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.809+0000 7f5bd0e00640 1 --2- 172.21.15.55:0/10676364 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ba8066690 0x7f5ba8068b50 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:23.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.809+0000 7f5bd0e00640 1 --2- 172.21.15.55:0/10676364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5bcc0c4120 0x7f5bcc152cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:23.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.809+0000 7f5bd0e00640 1 --2- 172.21.15.55:0/10676364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5bcc0b36f0 0x7f5bcc140300 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:23.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.809+0000 7f5bd0e00640 1 -- 172.21.15.55:0/10676364 >> 172.21.15.55:0/10676364 conn(0x7f5bcc066080 msgr2=0x7f5bcc0b2d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:23.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.809+0000 7f5bd0e00640 1 -- 172.21.15.55:0/10676364 shutdown_connections 2024-04-02T07:22:23.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:23.809+0000 7f5bd0e00640 1 -- 172.21.15.55:0/10676364 wait complete. 2024-04-02T07:22:23.832 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-02T07:22:23.833 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-02T07:22:23.833 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-02T07:22:23.834 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-02T07:22:23.834 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-02T07:22:23.834 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-02T07:22:23.835 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-02T07:22:23.835 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-02T07:22:24.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.069+0000 7f1985800640 1 Processor -- start 2024-04-02T07:22:24.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.069+0000 7f1985800640 1 -- start start 2024-04-02T07:22:24.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f1985800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1980158b70 0x7f19800cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f1985800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f19800afae0 0x7f19800cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f1985800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19800caa30 con 0x7f1980158f50 2024-04-02T07:22:24.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f197e000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1980158f50 0x7f198015c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57320/0 (socket says 172.21.15.55:57320) 2024-04-02T07:22:24.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f197e000640 1 -- 172.21.15.55:0/2333533072 learned_addr learned my addr 172.21.15.55:0/2333533072 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:24.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f197ea00640 1 --2- 172.21.15.55:0/2333533072 >> v2:172.21.15.55:3300/0 conn(0x7f1980158b70 0x7f19800cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f1985800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19800c9690 con 0x7f1980158b70 2024-04-02T07:22:24.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f1985800640 1 -- 172.21.15.55:0/2333533072 --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19800c90d0 con 0x7f19800afae0 2024-04-02T07:22:24.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f197d600640 1 -- 172.21.15.55:0/2333533072 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1232599211 0 0) 0x7f19800caa30 con 0x7f1980158f50 2024-04-02T07:22:24.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f197d600640 1 -- 172.21.15.55:0/2333533072 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1964003530 con 0x7f1980158f50 2024-04-02T07:22:24.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f197f400640 1 --2- 172.21.15.55:0/2333533072 >> v2:172.21.15.106:3300/0 conn(0x7f19800afae0 0x7f19800cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f197d600640 1 -- 172.21.15.55:0/2333533072 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2819067781 0 0) 0x7f1964003530 con 0x7f1980158f50 2024-04-02T07:22:24.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f197d600640 1 -- 172.21.15.55:0/2333533072 >> v2:172.21.15.106:3300/0 conn(0x7f19800afae0 msgr2=0x7f19800cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f197d600640 1 --2- 172.21.15.55:0/2333533072 >> v2:172.21.15.106:3300/0 conn(0x7f19800afae0 0x7f19800cb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f197d600640 1 -- 172.21.15.55:0/2333533072 >> v2:172.21.15.55:3300/0 conn(0x7f1980158b70 msgr2=0x7f19800cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f197d600640 1 --2- 172.21.15.55:0/2333533072 >> v2:172.21.15.55:3300/0 conn(0x7f1980158b70 0x7f19800cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f197d600640 1 -- 172.21.15.55:0/2333533072 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19800c93b0 con 0x7f1980158f50 2024-04-02T07:22:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f197d600640 1 -- 172.21.15.55:0/2333533072 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f196c000ee0 con 0x7f1980158f50 2024-04-02T07:22:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f197d600640 1 -- 172.21.15.55:0/2333533072 >> v1:172.21.15.55:6789/0 conn(0x7f1980158f50 legacy=0x7f198015c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f197d600640 1 --2- 172.21.15.55:0/2333533072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1964003980 0x7f1964003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f197d600640 1 --2- 172.21.15.55:0/2333533072 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f19640047d0 0x7f1964004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f197d600640 1 --2- 172.21.15.55:0/2333533072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1964005190 0x7f1964014590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f197d600640 1 -- 172.21.15.55:0/2333533072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19800c9690 con 0x7f1964005190 2024-04-02T07:22:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f197d600640 1 -- 172.21.15.55:0/2333533072 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19800c90d0 con 0x7f1964003980 2024-04-02T07:22:24.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.073+0000 7f197d600640 1 -- 172.21.15.55:0/2333533072 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1964009b60 con 0x7f19640047d0 2024-04-02T07:22:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f9acfa00640 1 Processor -- start 2024-04-02T07:22:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f9acfa00640 1 -- start start 2024-04-02T07:22:24.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f197f400640 1 --2- 172.21.15.55:0/2333533072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1964005190 0x7f1964014590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f197e000640 1 --2- 172.21.15.55:0/2333533072 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f19640047d0 0x7f1964004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f197f400640 1 -- 172.21.15.55:0/2333533072 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f19640047d0 msgr2=0x7f1964004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f197f400640 1 --2- 172.21.15.55:0/2333533072 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f19640047d0 0x7f1964004c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f197f400640 1 -- 172.21.15.55:0/2333533072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1964003980 msgr2=0x7f1964003da0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-02T07:22:24.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f197f400640 1 --2- 172.21.15.55:0/2333533072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1964003980 0x7f1964003da0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f197f400640 1 -- 172.21.15.55:0/2333533072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19800c93b0 con 0x7f1964005190 2024-04-02T07:22:24.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f197ea00640 1 --2- 172.21.15.55:0/2333533072 >> v2:172.21.15.55:3300/0 conn(0x7f1980158b70 0x7f19800cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:24.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f9acfa00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ac80b0d60 0x7f9ac815ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f9acfa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9ac80ca910 0x7f9ac80b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f9acfa00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac806d910 con 0x7f9ac815a760 2024-04-02T07:22:24.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f9acfa00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac8150e30 con 0x7f9ac80ca910 2024-04-02T07:22:24.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f9acfa00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac80cae40 con 0x7f9ac80b0d60 2024-04-02T07:22:24.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f9ac7e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ac80b0d60 0x7f9ac815ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f9ac7e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ac80b0d60 0x7f9ac815ab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:48192/0 (socket says 172.21.15.55:48192) 2024-04-02T07:22:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f9ac7e00640 1 -- 172.21.15.55:0/1810841615 learned_addr learned my addr 172.21.15.55:0/1810841615 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f9acda00640 1 --2- 172.21.15.55:0/1810841615 >> v2:172.21.15.106:3300/0 conn(0x7f9ac80ca910 0x7f9ac80b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f9ac7e00640 1 -- 172.21.15.55:0/1810841615 >> v2:172.21.15.106:3300/0 conn(0x7f9ac80ca910 msgr2=0x7f9ac80b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f9ac7e00640 1 --2- 172.21.15.55:0/1810841615 >> v2:172.21.15.106:3300/0 conn(0x7f9ac80ca910 0x7f9ac80b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f9ac7e00640 1 -- 172.21.15.55:0/1810841615 >> v1:172.21.15.106:6789/0 conn(0x7f9ac815a760 legacy=0x7f9ac80b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.077+0000 7f9ac7e00640 1 -- 172.21.15.55:0/1810841615 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac80b32f0 con 0x7f9ac80b0d60 2024-04-02T07:22:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f6f7aa00640 1 Processor -- start 2024-04-02T07:22:24.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f6f7aa00640 1 -- start start 2024-04-02T07:22:24.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f197f400640 1 --2- 172.21.15.55:0/2333533072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1964005190 0x7f1964014590 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f19800aff50 tx=0x7f197001c5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62835f4133b97915 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f197f400640 1 -- 172.21.15.55:0/2333533072 reap_dead start 2024-04-02T07:22:24.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f6f7aa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f740ab6d0 0x7f6f740704a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f6f7aa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6f740709e0 0x7f6f7406ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f6f7aa00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f740b3230 con 0x7f6f740700c0 2024-04-02T07:22:24.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f6f7aa00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f740b2f50 con 0x7f6f740ab6d0 2024-04-02T07:22:24.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f6f7aa00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f7406c210 con 0x7f6f740709e0 2024-04-02T07:22:24.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f197d600640 1 -- 172.21.15.55:0/2333533072 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1970004220 con 0x7f1964005190 2024-04-02T07:22:24.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f9ac7e00640 1 --2- 172.21.15.55:0/1810841615 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ac80b0d60 0x7f9ac815ab40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009870 tx=0x7f9abc01c580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36b387d2ae66f767 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f197d600640 1 -- 172.21.15.55:0/2333533072 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19700043a0 con 0x7f1964005190 2024-04-02T07:22:24.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f197d600640 1 -- 172.21.15.55:0/2333533072 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1970004510 con 0x7f1964005190 2024-04-02T07:22:24.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f6f73400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f740ab6d0 0x7f6f740704a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f6f73400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f740ab6d0 0x7f6f740704a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51582/0 (socket says 172.21.15.55:51582) 2024-04-02T07:22:24.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f6f73400640 1 -- 172.21.15.55:0/479637654 learned_addr learned my addr 172.21.15.55:0/479637654 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f9ac7400640 1 -- 172.21.15.55:0/1810841615 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0ab650 con 0x7f9ac80b0d60 2024-04-02T07:22:24.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f9ac7400640 1 -- 172.21.15.55:0/1810841615 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc0ab7b0 con 0x7f9ac80b0d60 2024-04-02T07:22:24.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f9ac7400640 1 -- 172.21.15.55:0/1810841615 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc0abb40 con 0x7f9ac80b0d60 2024-04-02T07:22:24.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f6f73400640 1 -- 172.21.15.55:0/479637654 >> v2:172.21.15.106:3300/0 conn(0x7f6f740709e0 msgr2=0x7f6f7406ccf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-02T07:22:24.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f6f73400640 1 --2- 172.21.15.55:0/479637654 >> v2:172.21.15.106:3300/0 conn(0x7f6f740709e0 0x7f6f7406ccf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f6f73400640 1 -- 172.21.15.55:0/479637654 >> v1:172.21.15.106:6789/0 conn(0x7f6f740700c0 legacy=0x7f6f740b24d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-02T07:22:24.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.081+0000 7f6f73400640 1 -- 172.21.15.55:0/479637654 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f7406c4f0 con 0x7f6f740ab6d0 2024-04-02T07:22:24.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.085+0000 7f9acfa00640 1 -- 172.21.15.55:0/1810841615 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ac80b0d60 msgr2=0x7f9ac815ab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.085+0000 7f9acfa00640 1 --2- 172.21.15.55:0/1810841615 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ac80b0d60 0x7f9ac815ab40 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009870 tx=0x7f9abc01c580 comp rx=0 tx=0).stop 2024-04-02T07:22:24.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.085+0000 7f9acfa00640 1 -- 172.21.15.55:0/1810841615 shutdown_connections 2024-04-02T07:22:24.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.085+0000 7f9acfa00640 1 --2- 172.21.15.55:0/1810841615 >> v2:172.21.15.106:3300/0 conn(0x7f9ac80ca910 0x7f9ac80b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.085+0000 7f9acfa00640 1 --2- 172.21.15.55:0/1810841615 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ac80b0d60 0x7f9ac815ab40 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.085+0000 7f9acfa00640 1 -- 172.21.15.55:0/1810841615 >> 172.21.15.55:0/1810841615 conn(0x7f9ac8065a80 msgr2=0x7f9ac8065e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.085+0000 7f9acfa00640 1 -- 172.21.15.55:0/1810841615 shutdown_connections 2024-04-02T07:22:24.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.085+0000 7f9acfa00640 1 -- 172.21.15.55:0/1810841615 wait complete. 2024-04-02T07:22:24.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.085+0000 7f1985800640 1 -- 172.21.15.55:0/2333533072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1964005190 msgr2=0x7f1964014590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.085+0000 7f1985800640 1 --2- 172.21.15.55:0/2333533072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1964005190 0x7f1964014590 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f19800aff50 tx=0x7f197001c5b0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.085+0000 7f1985800640 1 -- 172.21.15.55:0/2333533072 shutdown_connections 2024-04-02T07:22:24.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.085+0000 7f1985800640 1 --2- 172.21.15.55:0/2333533072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1964005190 0x7f1964014590 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.085+0000 7f1985800640 1 -- 172.21.15.55:0/2333533072 >> 172.21.15.55:0/2333533072 conn(0x7f1980065a80 msgr2=0x7f1980065e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.085+0000 7f1985800640 1 -- 172.21.15.55:0/2333533072 shutdown_connections 2024-04-02T07:22:24.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.085+0000 7f1985800640 1 -- 172.21.15.55:0/2333533072 wait complete. 2024-04-02T07:22:24.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.085+0000 7f9acfa00640 1 Processor -- start 2024-04-02T07:22:24.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.085+0000 7fdf32600640 1 Processor -- start 2024-04-02T07:22:24.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.085+0000 7f9acfa00640 1 -- start start 2024-04-02T07:22:24.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f1985800640 1 Processor -- start 2024-04-02T07:22:24.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f1985800640 1 -- start start 2024-04-02T07:22:24.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f9acfa00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ac80b0d60 0x7f9ac81f9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f9acfa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ac80ca910 0x7f9ac8145860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f9acfa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ac815a760 0x7f9ac81fcb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f9acfa00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac81fa400 con 0x7f9ac815a760 2024-04-02T07:22:24.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f9acfa00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac8148fa0 con 0x7f9ac80ca910 2024-04-02T07:22:24.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f9acfa00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac8146950 con 0x7f9ac80b0d60 2024-04-02T07:22:24.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.085+0000 7fdf32600640 1 -- start start 2024-04-02T07:22:24.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f53cfe00640 1 Processor -- start 2024-04-02T07:22:24.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f53cfe00640 1 -- start start 2024-04-02T07:22:24.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f9ac7e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ac80ca910 0x7f9ac8145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f9ac7e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ac80ca910 0x7f9ac8145860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:36232/0 (socket says 172.21.15.55:36232) 2024-04-02T07:22:24.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f9ac7e00640 1 -- 172.21.15.55:0/3558406311 learned_addr learned my addr 172.21.15.55:0/3558406311 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f9acd000640 1 --2- 172.21.15.55:0/3558406311 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ac80b0d60 0x7f9ac81f9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf32600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdf2c158ae0 0x7fdf2c0cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf32600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdf2c0b0480 0x7fdf2c0cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f5e3a600640 1 Processor -- start 2024-04-02T07:22:24.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f9acda00640 1 --2- 172.21.15.55:0/3558406311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ac815a760 0x7f9ac81fcb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf32600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf2c0caa30 con 0x7fdf2c0afae0 2024-04-02T07:22:24.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf32600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2c0c9690 con 0x7fdf2c0b0480 2024-04-02T07:22:24.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf32600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf2c0c90d0 con 0x7fdf2c158ae0 2024-04-02T07:22:24.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f5e3a600640 1 -- start start 2024-04-02T07:22:24.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdf2c158ae0 0x7fdf2c0cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f9acd000640 1 -- 172.21.15.55:0/3558406311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ac80ca910 msgr2=0x7f9ac8145860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f9acd000640 1 --2- 172.21.15.55:0/3558406311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ac80ca910 0x7f9ac8145860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f9acd000640 1 -- 172.21.15.55:0/3558406311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ac815a760 msgr2=0x7f9ac81fcb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f9acd000640 1 --2- 172.21.15.55:0/3558406311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ac815a760 0x7f9ac81fcb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f9acd000640 1 -- 172.21.15.55:0/3558406311 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc0094d0 con 0x7f9ac80b0d60 2024-04-02T07:22:24.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2be00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fdf2c0afae0 0x7fdf2c15c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:53114/0 (socket says 172.21.15.55:53114) 2024-04-02T07:22:24.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2be00640 1 -- 172.21.15.55:0/2935013775 learned_addr learned my addr 172.21.15.55:0/2935013775 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:24.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2aa00640 1 --2- 172.21.15.55:0/2935013775 >> v2:172.21.15.55:3300/0 conn(0x7fdf2c0b0480 0x7fdf2c0cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2a000640 1 -- 172.21.15.55:0/2935013775 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3508307742 0 0) 0x7fdf2c0caa30 con 0x7fdf2c0afae0 2024-04-02T07:22:24.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2a000640 1 -- 172.21.15.55:0/2935013775 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf10003530 con 0x7fdf2c0afae0 2024-04-02T07:22:24.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdf2c158ae0 0x7fdf2c0cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:36246/0 (socket says 172.21.15.55:36246) 2024-04-02T07:22:24.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f1985800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1964005190 0x7f198014a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f53cfe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c815c8d0 0x7f53c80ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f53cfe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53c815ccb0 0x7f53c80d0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f53cfe00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53c80cd230 con 0x7f53c80cfc80 2024-04-02T07:22:24.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f53cfe00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53c80d1710 con 0x7f53c815ccb0 2024-04-02T07:22:24.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f53cfe00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80cd4d0 con 0x7f53c815c8d0 2024-04-02T07:22:24.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2a000640 1 -- 172.21.15.55:0/2935013775 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1929378405 0 0) 0x7fdf10003530 con 0x7fdf2c0afae0 2024-04-02T07:22:24.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2a000640 1 -- 172.21.15.55:0/2935013775 >> v2:172.21.15.106:3300/0 conn(0x7fdf2c158ae0 msgr2=0x7fdf2c0cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2a000640 1 --2- 172.21.15.55:0/2935013775 >> v2:172.21.15.106:3300/0 conn(0x7fdf2c158ae0 0x7fdf2c0cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2a000640 1 -- 172.21.15.55:0/2935013775 >> v2:172.21.15.55:3300/0 conn(0x7fdf2c0b0480 msgr2=0x7fdf2c0cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2a000640 1 --2- 172.21.15.55:0/2935013775 >> v2:172.21.15.55:3300/0 conn(0x7fdf2c0b0480 0x7fdf2c0cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2a000640 1 -- 172.21.15.55:0/2935013775 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c0c93b0 con 0x7fdf2c0afae0 2024-04-02T07:22:24.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f1985800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1980153b30 0x7f1980153fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f6f73400640 1 --2- 172.21.15.55:0/479637654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f740ab6d0 0x7f6f740704a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6f7406e3b0 tx=0x7f6f6001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e5237e4b675bbf server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f1985800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19800cb750 0x7f19800cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f1985800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19800cc110 con 0x7f1964005190 2024-04-02T07:22:24.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f1985800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198015a8c0 con 0x7f19800cb750 2024-04-02T07:22:24.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f1985800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1980155e10 con 0x7f1980153b30 2024-04-02T07:22:24.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f197ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1964005190 0x7f198014a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7f9acd000640 1 --2- 172.21.15.55:0/3558406311 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ac80b0d60 0x7f9ac81f9ec0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800c390 tx=0x7f9ab800c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f53cca00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53c815ccb0 0x7f53c80d0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f6f72a00640 1 -- 172.21.15.55:0/479637654 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f600ab660 con 0x7f6f740ab6d0 2024-04-02T07:22:24.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f6f72a00640 1 -- 172.21.15.55:0/479637654 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f600ab7c0 con 0x7f6f740ab6d0 2024-04-02T07:22:24.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f6f72a00640 1 -- 172.21.15.55:0/479637654 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f600abb50 con 0x7f6f740ab6d0 2024-04-02T07:22:24.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f197f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19800cb750 0x7f19800cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f197f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19800cb750 0x7f19800cbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:36270/0 (socket says 172.21.15.55:36270) 2024-04-02T07:22:24.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f197f400640 1 -- 172.21.15.55:0/976052162 learned_addr learned my addr 172.21.15.55:0/976052162 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2a000640 1 -- 172.21.15.55:0/2935013775 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fdf24001a00 con 0x7fdf2c0afae0 2024-04-02T07:22:24.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2a000640 1 -- 172.21.15.55:0/2935013775 >> v1:172.21.15.106:6789/0 conn(0x7fdf2c0afae0 legacy=0x7fdf2c15c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2a000640 1 --2- 172.21.15.55:0/2935013775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf10003980 0x7fdf10003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2a000640 1 --2- 172.21.15.55:0/2935013775 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf100047d0 0x7fdf10004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2a000640 1 --2- 172.21.15.55:0/2935013775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf10005190 0x7fdf1000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2a000640 1 -- 172.21.15.55:0/2935013775 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0c9690 con 0x7fdf10003980 2024-04-02T07:22:24.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2a000640 1 -- 172.21.15.55:0/2935013775 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0c90d0 con 0x7fdf10005190 2024-04-02T07:22:24.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.089+0000 7fdf2a000640 1 -- 172.21.15.55:0/2935013775 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1000bfe0 con 0x7fdf100047d0 2024-04-02T07:22:24.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7fdf2be00640 1 --2- 172.21.15.55:0/2935013775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf10005190 0x7fdf1000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f197e000640 1 --2- 172.21.15.55:0/976052162 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1980153b30 0x7f1980153fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f9ac4c00640 1 -- 172.21.15.55:0/3558406311 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab80052d0 con 0x7f9ac80b0d60 2024-04-02T07:22:24.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f9ac4c00640 1 -- 172.21.15.55:0/3558406311 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab8005430 con 0x7f9ac80b0d60 2024-04-02T07:22:24.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f9ac4c00640 1 -- 172.21.15.55:0/3558406311 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab80052d0 con 0x7f9ac80b0d60 2024-04-02T07:22:24.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f53cca00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f53c815ccb0 0x7f53c80d0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51618/0 (socket says 172.21.15.55:51618) 2024-04-02T07:22:24.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f53cca00640 1 -- 172.21.15.55:0/2104870117 learned_addr learned my addr 172.21.15.55:0/2104870117 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f53cd400640 1 --2- 172.21.15.55:0/2104870117 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c815c8d0 0x7f53c80ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f53cca00640 1 -- 172.21.15.55:0/2104870117 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c815c8d0 msgr2=0x7f53c80ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7fdf2aa00640 1 --2- 172.21.15.55:0/2935013775 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf100047d0 0x7fdf10004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7fdf2be00640 1 -- 172.21.15.55:0/2935013775 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf100047d0 msgr2=0x7fdf10004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7fdf2be00640 1 --2- 172.21.15.55:0/2935013775 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf100047d0 0x7fdf10004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7fdf2be00640 1 -- 172.21.15.55:0/2935013775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf10003980 msgr2=0x7fdf10003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7fdf2be00640 1 --2- 172.21.15.55:0/2935013775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf10003980 0x7fdf10003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7fdf2be00640 1 -- 172.21.15.55:0/2935013775 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c0c93b0 con 0x7fdf10005190 2024-04-02T07:22:24.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f5e3a600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5e340b0480 0x7f5e34158b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f197ea00640 1 -- 172.21.15.55:0/976052162 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1980153b30 msgr2=0x7f1980153fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f197ea00640 1 --2- 172.21.15.55:0/976052162 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1980153b30 0x7f1980153fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f197ea00640 1 -- 172.21.15.55:0/976052162 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19800cb750 msgr2=0x7f19800cbbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f197ea00640 1 --2- 172.21.15.55:0/976052162 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f19800cb750 0x7f19800cbbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f5e3a600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5e340cb870 0x7f5e3415c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f197ea00640 1 -- 172.21.15.55:0/976052162 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1980154fb0 con 0x7f1964005190 2024-04-02T07:22:24.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f976e800640 1 Processor -- start 2024-04-02T07:22:24.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f6f7aa00640 1 -- 172.21.15.55:0/479637654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f740ab6d0 msgr2=0x7f6f740704a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f6f7aa00640 1 --2- 172.21.15.55:0/479637654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f740ab6d0 0x7f6f740704a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6f7406e3b0 tx=0x7f6f6001c440 comp rx=0 tx=0).stop 2024-04-02T07:22:24.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f53cca00640 1 --2- 172.21.15.55:0/2104870117 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c815c8d0 0x7f53c80ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f53cca00640 1 -- 172.21.15.55:0/2104870117 >> v1:172.21.15.55:6789/0 conn(0x7f53c80cfc80 legacy=0x7f53c80d25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f53cca00640 1 -- 172.21.15.55:0/2104870117 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c80cd7b0 con 0x7f53c815ccb0 2024-04-02T07:22:24.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f5e32a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5e340afae0 0x7f5e340cb160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:53120/0 (socket says 172.21.15.55:53120) 2024-04-02T07:22:24.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f5e3a600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e340caa30 con 0x7f5e340afae0 2024-04-02T07:22:24.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f5e3a600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e340c9690 con 0x7f5e340b0480 2024-04-02T07:22:24.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f5e3a600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e340c90d0 con 0x7f5e340cb870 2024-04-02T07:22:24.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f5e32a00640 1 -- 172.21.15.55:0/3088114869 learned_addr learned my addr 172.21.15.55:0/3088114869 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:24.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f976e800640 1 -- start start 2024-04-02T07:22:24.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f9acfa00640 1 -- 172.21.15.55:0/3558406311 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac81460b0 con 0x7f9ac80b0d60 2024-04-02T07:22:24.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f9acfa00640 1 -- 172.21.15.55:0/3558406311 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac8146670 con 0x7f9ac80b0d60 2024-04-02T07:22:24.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f6f7aa00640 1 -- 172.21.15.55:0/479637654 shutdown_connections 2024-04-02T07:22:24.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f6f7aa00640 1 --2- 172.21.15.55:0/479637654 >> v2:172.21.15.106:3300/0 conn(0x7f6f740709e0 0x7f6f7406ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f6f7aa00640 1 --2- 172.21.15.55:0/479637654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f740ab6d0 0x7f6f740704a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f6f7aa00640 1 -- 172.21.15.55:0/479637654 >> 172.21.15.55:0/479637654 conn(0x7f6f74069f60 msgr2=0x7f6f7406a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f53cd400640 1 --2- 172.21.15.55:0/2104870117 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c815c8d0 0x7f53c80ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:24.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f5e33e00640 1 --2- 172.21.15.55:0/3088114869 >> v2:172.21.15.106:3300/0 conn(0x7f5e340cb870 0x7f5e3415c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f5e32000640 1 -- 172.21.15.55:0/3088114869 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3759053004 0 0) 0x7f5e340caa30 con 0x7f5e340afae0 2024-04-02T07:22:24.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f5e32000640 1 -- 172.21.15.55:0/3088114869 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e18003530 con 0x7f5e340afae0 2024-04-02T07:22:24.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f00a5400640 1 Processor -- start 2024-04-02T07:22:24.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f00a5400640 1 -- start start 2024-04-02T07:22:24.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f6f7aa00640 1 -- 172.21.15.55:0/479637654 shutdown_connections 2024-04-02T07:22:24.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f9acfa00640 1 -- 172.21.15.55:0/3558406311 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9ac815a3c0 con 0x7f9ac80b0d60 2024-04-02T07:22:24.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f6f7aa00640 1 -- 172.21.15.55:0/479637654 wait complete. 2024-04-02T07:22:24.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f197ea00640 1 --2- 172.21.15.55:0/976052162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1964005190 0x7f198014a020 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f197800efc0 tx=0x7f197800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f5e32000640 1 -- 172.21.15.55:0/3088114869 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1917127171 0 0) 0x7f5e18003530 con 0x7f5e340afae0 2024-04-02T07:22:24.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f5e32000640 1 -- 172.21.15.55:0/3088114869 >> v2:172.21.15.106:3300/0 conn(0x7f5e340cb870 msgr2=0x7f5e3415c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f5e32000640 1 --2- 172.21.15.55:0/3088114869 >> v2:172.21.15.106:3300/0 conn(0x7f5e340cb870 0x7f5e3415c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f5e32000640 1 -- 172.21.15.55:0/3088114869 >> v2:172.21.15.55:3300/0 conn(0x7f5e340b0480 msgr2=0x7f5e34158b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f5e32000640 1 --2- 172.21.15.55:0/3088114869 >> v2:172.21.15.55:3300/0 conn(0x7f5e340b0480 0x7f5e34158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f5e32000640 1 -- 172.21.15.55:0/3088114869 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e340c93b0 con 0x7f5e340afae0 2024-04-02T07:22:24.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f5e32000640 1 -- 172.21.15.55:0/3088114869 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f5e20001660 con 0x7f5e340afae0 2024-04-02T07:22:24.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f5e32000640 1 -- 172.21.15.55:0/3088114869 >> v1:172.21.15.106:6789/0 conn(0x7f5e340afae0 legacy=0x7f5e340cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.093+0000 7f5e32000640 1 --2- 172.21.15.55:0/3088114869 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e180039a0 0x7f5e18003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f5e32000640 1 --2- 172.21.15.55:0/3088114869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e180047d0 0x7f5e18004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f5e32000640 1 --2- 172.21.15.55:0/3088114869 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e18005190 0x7f5e1800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f5e32000640 1 -- 172.21.15.55:0/3088114869 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e340c9690 con 0x7f5e180047d0 2024-04-02T07:22:24.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f5e32000640 1 -- 172.21.15.55:0/3088114869 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e340c90d0 con 0x7f5e18005190 2024-04-02T07:22:24.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f5e32000640 1 -- 172.21.15.55:0/3088114869 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e1800c120 con 0x7f5e180039a0 2024-04-02T07:22:24.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f5e33e00640 1 --2- 172.21.15.55:0/3088114869 >> v2:172.21.15.106:3300/0 conn(0x7f5e340cb870 0x7f5e3415c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:24.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f5e33e00640 1 --2- 172.21.15.55:0/3088114869 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e18005190 0x7f5e1800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f5e32a00640 1 --2- 172.21.15.55:0/3088114869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e180047d0 0x7f5e18004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f5e33e00640 1 -- 172.21.15.55:0/3088114869 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e180039a0 msgr2=0x7f5e18003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f5e33e00640 1 --2- 172.21.15.55:0/3088114869 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e180039a0 0x7f5e18003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f5e33e00640 1 -- 172.21.15.55:0/3088114869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e180047d0 msgr2=0x7f5e18004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f00a5400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00a006d1c0 0x7f00a00b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f00a5400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f00a00b38f0 0x7f00a00c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f00a5400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00a00b1d60 con 0x7f00a01599c0 2024-04-02T07:22:24.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f00a5400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00a006cda0 con 0x7f00a00b38f0 2024-04-02T07:22:24.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f00a5400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a006c400 con 0x7f00a006d1c0 2024-04-02T07:22:24.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f5e33e00640 1 --2- 172.21.15.55:0/3088114869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e180047d0 0x7f5e18004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f5e33e00640 1 -- 172.21.15.55:0/3088114869 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e340c93b0 con 0x7f5e18005190 2024-04-02T07:22:24.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f976e800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f97680cb810 0x7f97680c8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f976e800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9768070310 con 0x7f9768161620 2024-04-02T07:22:24.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f976e800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9768161b70 con 0x7f976815eb10 2024-04-02T07:22:24.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f976e800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9768161e50 con 0x7f97680cb810 2024-04-02T07:22:24.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f9767400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f976815eb10 0x7f97680b1a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:53136/0 (socket says 172.21.15.55:53136) 2024-04-02T07:22:24.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f9767400640 1 -- 172.21.15.55:0/3667369535 learned_addr learned my addr 172.21.15.55:0/3667369535 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:24.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f5e32a00640 1 --2- 172.21.15.55:0/3088114869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e180047d0 0x7f5e18004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:24.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f9767e00640 1 --2- 172.21.15.55:0/3667369535 >> v2:172.21.15.106:3300/0 conn(0x7f97680cb810 0x7f97680c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f1976a00640 1 -- 172.21.15.55:0/976052162 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978014480 con 0x7f1964005190 2024-04-02T07:22:24.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f1976a00640 1 -- 172.21.15.55:0/976052162 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f197800f040 con 0x7f1964005190 2024-04-02T07:22:24.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f1985800640 1 -- 172.21.15.55:0/976052162 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1980155290 con 0x7f1964005190 2024-04-02T07:22:24.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f9ac4c00640 1 -- 172.21.15.55:0/3558406311 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f9ab8003620 con 0x7f9ac80b0d60 2024-04-02T07:22:24.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f9767e00640 1 -- 172.21.15.55:0/3667369535 >> v1:172.21.15.106:6789/0 conn(0x7f976815eb10 legacy=0x7f97680b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f1976a00640 1 -- 172.21.15.55:0/976052162 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1978014820 con 0x7f1964005190 2024-04-02T07:22:24.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f1985800640 1 -- 172.21.15.55:0/976052162 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1980155850 con 0x7f1964005190 2024-04-02T07:22:24.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f1985800640 1 -- 172.21.15.55:0/976052162 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1958000fd0 con 0x7f1964005190 2024-04-02T07:22:24.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f9ac4c00640 1 --2- 172.21.15.55:0/3558406311 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9aac0666f0 0x7f9aac068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f9ac4c00640 1 -- 172.21.15.55:0/3558406311 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ab8083170 con 0x7f9ac80b0d60 2024-04-02T07:22:24.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f9ac4c00640 1 --2- 172.21.15.55:0/3558406311 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x7f9aac06e910 0x7f9aac070d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f9ac4c00640 1 -- 172.21.15.55:0/3558406311 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9aac0713e0 con 0x7f9aac06e910 2024-04-02T07:22:24.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f9ac4c00640 1 -- 172.21.15.55:0/3558406311 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ab80856d0 con 0x7f9ac80b0d60 2024-04-02T07:22:24.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f6f7aa00640 1 Processor -- start 2024-04-02T07:22:24.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f6f7aa00640 1 -- start start 2024-04-02T07:22:24.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f6f7aa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f740700c0 0x7f6f7415bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f6f7aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f740709e0 0x7f6f7414ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f6f7aa00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f740ab6d0 0x7f6f7414b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f6f7aa00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f740cead0 con 0x7f6f740709e0 2024-04-02T07:22:24.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f6f7aa00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f74159850 con 0x7f6f740700c0 2024-04-02T07:22:24.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f6f7aa00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f7414c290 con 0x7f6f740ab6d0 2024-04-02T07:22:24.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f6f73e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f740700c0 0x7f6f7415bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f6f73e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f740700c0 0x7f6f7415bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:36330/0 (socket says 172.21.15.55:36330) 2024-04-02T07:22:24.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f6f73e00640 1 -- 172.21.15.55:0/568375965 learned_addr learned my addr 172.21.15.55:0/568375965 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f53cca00640 1 --2- 172.21.15.55:0/2104870117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53c815ccb0 0x7f53c80d0e30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f53b4006fd0 tx=0x7f53b401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d9ad9520c0c8ad server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7fdf2be00640 1 -- 172.21.15.55:0/2935013775 reap_dead start 2024-04-02T07:22:24.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7fdf2be00640 1 --2- 172.21.15.55:0/2935013775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf10005190 0x7fdf1000b990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdf2400a8d0 tx=0x7fdf2401fb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=217c7f7ae3392e8e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7fdf2a000640 1 -- 172.21.15.55:0/2935013775 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf240a9740 con 0x7fdf10005190 2024-04-02T07:22:24.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7fdf2a000640 1 -- 172.21.15.55:0/2935013775 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf240a98c0 con 0x7fdf10005190 2024-04-02T07:22:24.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7fdf2a000640 1 -- 172.21.15.55:0/2935013775 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf240a9c70 con 0x7fdf10005190 2024-04-02T07:22:24.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7fdf32600640 1 -- 172.21.15.55:0/2935013775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf10005190 msgr2=0x7fdf1000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7fdf32600640 1 --2- 172.21.15.55:0/2935013775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf10005190 0x7fdf1000b990 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdf2400a8d0 tx=0x7fdf2401fb20 comp rx=0 tx=0).stop 2024-04-02T07:22:24.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7fdf32600640 1 -- 172.21.15.55:0/2935013775 shutdown_connections 2024-04-02T07:22:24.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7fdf32600640 1 --2- 172.21.15.55:0/2935013775 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf10005190 0x7fdf1000b990 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7fdf32600640 1 -- 172.21.15.55:0/2935013775 >> 172.21.15.55:0/2935013775 conn(0x7fdf2c065a80 msgr2=0x7fdf2c065e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7fdf32600640 1 -- 172.21.15.55:0/2935013775 shutdown_connections 2024-04-02T07:22:24.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7fdf32600640 1 -- 172.21.15.55:0/2935013775 wait complete. 2024-04-02T07:22:24.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f9767e00640 1 -- 172.21.15.55:0/3667369535 >> v1:172.21.15.55:6789/0 conn(0x7f9768161620 legacy=0x7f97680cb100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f9767e00640 1 -- 172.21.15.55:0/3667369535 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9768162130 con 0x7f97680cb810 2024-04-02T07:22:24.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f009e800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f00a01599c0 0x7f00a00b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:53132/0 (socket says 172.21.15.55:53132) 2024-04-02T07:22:24.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f009e800640 1 -- 172.21.15.55:0/3514280667 learned_addr learned my addr 172.21.15.55:0/3514280667 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:24.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f009f200640 1 --2- 172.21.15.55:0/3514280667 >> v2:172.21.15.106:3300/0 conn(0x7f00a00b38f0 0x7f00a00c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f009d400640 1 -- 172.21.15.55:0/3514280667 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 944217216 0 0) 0x7f00a00b1d60 con 0x7f00a01599c0 2024-04-02T07:22:24.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f009d400640 1 -- 172.21.15.55:0/3514280667 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0084005740 con 0x7f00a01599c0 2024-04-02T07:22:24.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f009de00640 1 --2- 172.21.15.55:0/3514280667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00a006d1c0 0x7f00a00b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f009d400640 1 -- 172.21.15.55:0/3514280667 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3980319351 0 0) 0x7f0084005740 con 0x7f00a01599c0 2024-04-02T07:22:24.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.097+0000 7f009d400640 1 -- 172.21.15.55:0/3514280667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00a006d1c0 msgr2=0x7f00a00b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009d400640 1 --2- 172.21.15.55:0/3514280667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00a006d1c0 0x7f00a00b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009d400640 1 -- 172.21.15.55:0/3514280667 >> v2:172.21.15.106:3300/0 conn(0x7f00a00b38f0 msgr2=0x7f00a00c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009d400640 1 --2- 172.21.15.55:0/3514280667 >> v2:172.21.15.106:3300/0 conn(0x7f00a00b38f0 0x7f00a00c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009d400640 1 -- 172.21.15.55:0/3514280667 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a006c6e0 con 0x7f00a01599c0 2024-04-02T07:22:24.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009d400640 1 -- 172.21.15.55:0/3514280667 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f0098001a00 con 0x7f00a01599c0 2024-04-02T07:22:24.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009d400640 1 -- 172.21.15.55:0/3514280667 >> v1:172.21.15.106:6789/0 conn(0x7f00a01599c0 legacy=0x7f00a00b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009d400640 1 --2- 172.21.15.55:0/3514280667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0084005b90 0x7f0084005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009d400640 1 --2- 172.21.15.55:0/3514280667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00840064f0 0x7f00840069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009d400640 1 --2- 172.21.15.55:0/3514280667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0084006f70 0x7f0084007420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009d400640 1 -- 172.21.15.55:0/3514280667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a006cda0 con 0x7f0084006f70 2024-04-02T07:22:24.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009d400640 1 -- 172.21.15.55:0/3514280667 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a006c400 con 0x7f0084005b90 2024-04-02T07:22:24.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009d400640 1 -- 172.21.15.55:0/3514280667 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f008400bf40 con 0x7f00840064f0 2024-04-02T07:22:24.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009de00640 1 --2- 172.21.15.55:0/3514280667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00a006d1c0 0x7f00a00b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:24.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009f200640 1 --2- 172.21.15.55:0/3514280667 >> v2:172.21.15.106:3300/0 conn(0x7f00a00b38f0 0x7f00a00c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:24.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009de00640 1 --2- 172.21.15.55:0/3514280667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00840064f0 0x7f00840069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009e800640 1 --2- 172.21.15.55:0/3514280667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0084005b90 0x7f0084005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009de00640 1 -- 172.21.15.55:0/3514280667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0084005b90 msgr2=0x7f0084005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009de00640 1 --2- 172.21.15.55:0/3514280667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0084005b90 0x7f0084005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009de00640 1 -- 172.21.15.55:0/3514280667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0084006f70 msgr2=0x7f0084007420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009de00640 1 --2- 172.21.15.55:0/3514280667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0084006f70 0x7f0084007420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009de00640 1 -- 172.21.15.55:0/3514280667 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a006c6e0 con 0x7f00840064f0 2024-04-02T07:22:24.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f009e800640 1 --2- 172.21.15.55:0/3514280667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0084005b90 0x7f0084005fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:24.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f6f73e00640 1 -- 172.21.15.55:0/568375965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f740ab6d0 msgr2=0x7f6f7414b090 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-02T07:22:24.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f6f73e00640 1 --2- 172.21.15.55:0/568375965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f740ab6d0 0x7f6f7414b090 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f6f73e00640 1 -- 172.21.15.55:0/568375965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f740709e0 msgr2=0x7f6f7414ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f6f73e00640 1 --2- 172.21.15.55:0/568375965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f740709e0 0x7f6f7414ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f6f73e00640 1 -- 172.21.15.55:0/568375965 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f600094d0 con 0x7f6f740700c0 2024-04-02T07:22:24.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f9767e00640 1 --2- 172.21.15.55:0/3667369535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97680cb810 0x7f97680c8950 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9760009d90 tx=0x7f976001c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa97a5df69ba0d48 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f1976a00640 1 -- 172.21.15.55:0/976052162 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1978014980 con 0x7f1964005190 2024-04-02T07:22:24.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f9ac7e00640 1 --2- 172.21.15.55:0/3558406311 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9aac0666f0 0x7f9aac068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f9766000640 1 -- 172.21.15.55:0/3667369535 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97600a5a20 con 0x7f97680cb810 2024-04-02T07:22:24.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f9766000640 1 -- 172.21.15.55:0/3667369535 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97600a5b80 con 0x7f97680cb810 2024-04-02T07:22:24.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.101+0000 7f9766000640 1 -- 172.21.15.55:0/3667369535 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97600ad440 con 0x7f97680cb810 2024-04-02T07:22:24.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f9ac7e00640 1 --2- 172.21.15.55:0/3558406311 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9aac0666f0 0x7f9aac068bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009870 tx=0x7f9abc0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f9acda00640 1 --2- 172.21.15.55:0/3558406311 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x7f9aac06e910 0x7f9aac070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f5e33e00640 1 -- 172.21.15.55:0/3088114869 reap_dead start 2024-04-02T07:22:24.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f976e800640 1 -- 172.21.15.55:0/3667369535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97680cb810 msgr2=0x7f97680c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f976e800640 1 --2- 172.21.15.55:0/3667369535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97680cb810 0x7f97680c8950 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9760009d90 tx=0x7f976001c940 comp rx=0 tx=0).stop 2024-04-02T07:22:24.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7fdf32600640 1 Processor -- start 2024-04-02T07:22:24.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f5e33e00640 1 --2- 172.21.15.55:0/3088114869 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e18005190 0x7f5e1800b990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00e350 tx=0x7f5e2c01ce80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=782d85e208aee87 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f53c7e00640 1 -- 172.21.15.55:0/2104870117 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b40aa5f0 con 0x7f53c815ccb0 2024-04-02T07:22:24.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f976e800640 1 -- 172.21.15.55:0/3667369535 shutdown_connections 2024-04-02T07:22:24.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f976e800640 1 --2- 172.21.15.55:0/3667369535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97680cb810 0x7f97680c8950 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f976e800640 1 -- 172.21.15.55:0/3667369535 >> 172.21.15.55:0/3667369535 conn(0x7f9768069d90 msgr2=0x7f976806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f6f73e00640 1 --2- 172.21.15.55:0/568375965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f740700c0 0x7f6f7415bb80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00ba50 tx=0x7f6f6c00bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f976e800640 1 -- 172.21.15.55:0/3667369535 shutdown_connections 2024-04-02T07:22:24.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f976e800640 1 -- 172.21.15.55:0/3667369535 wait complete. 2024-04-02T07:22:24.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f53c7e00640 1 -- 172.21.15.55:0/2104870117 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b40aa750 con 0x7f53c815ccb0 2024-04-02T07:22:24.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f53c7e00640 1 -- 172.21.15.55:0/2104870117 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b40aaae0 con 0x7f53c815ccb0 2024-04-02T07:22:24.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7fdf32600640 1 -- start start 2024-04-02T07:22:24.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f1976a00640 1 --2- 172.21.15.55:0/976052162 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1960066710 0x7f1960068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f1976a00640 1 -- 172.21.15.55:0/976052162 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19780842d0 con 0x7f1964005190 2024-04-02T07:22:24.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f009de00640 1 --2- 172.21.15.55:0/3514280667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00840064f0 0x7f00840069e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f00a006aad0 tx=0x7f008c020b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0f30731e2f221af server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f197e000640 1 --2- 172.21.15.55:0/976052162 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1960066710 0x7f1960068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f1976a00640 1 --2- 172.21.15.55:0/976052162 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x7f196006e930 0x7f1960070d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f1976a00640 1 -- 172.21.15.55:0/976052162 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1960071400 con 0x7f196006e930 2024-04-02T07:22:24.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f1976a00640 1 -- 172.21.15.55:0/976052162 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1978084650 con 0x7f1964005190 2024-04-02T07:22:24.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f5e32000640 1 -- 172.21.15.55:0/3088114869 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c0a5e90 con 0x7f5e18005190 2024-04-02T07:22:24.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f5e32000640 1 -- 172.21.15.55:0/3088114869 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e2c00f040 con 0x7f5e18005190 2024-04-02T07:22:24.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f5e32000640 1 -- 172.21.15.55:0/3088114869 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e2c0ad660 con 0x7f5e18005190 2024-04-02T07:22:24.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f9acda00640 1 --2- 172.21.15.55:0/3558406311 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x7f9aac06e910 0x7f9aac070d30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f197f400640 1 --2- 172.21.15.55:0/976052162 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x7f196006e930 0x7f1960070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f5e3a600640 1 -- 172.21.15.55:0/3088114869 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e18005190 msgr2=0x7f5e1800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f5e3a600640 1 --2- 172.21.15.55:0/3088114869 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e18005190 0x7f5e1800b990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5e2c00e350 tx=0x7f5e2c01ce80 comp rx=0 tx=0).stop 2024-04-02T07:22:24.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f009d400640 1 -- 172.21.15.55:0/3514280667 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c004030 con 0x7f00840064f0 2024-04-02T07:22:24.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f009d400640 1 -- 172.21.15.55:0/3514280667 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c013040 con 0x7f00840064f0 2024-04-02T07:22:24.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f009d400640 1 -- 172.21.15.55:0/3514280667 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c004470 con 0x7f00840064f0 2024-04-02T07:22:24.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f00a5400640 1 -- 172.21.15.55:0/3514280667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00840064f0 msgr2=0x7f00840069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f00a5400640 1 --2- 172.21.15.55:0/3514280667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00840064f0 0x7f00840069e0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f00a006aad0 tx=0x7f008c020b60 comp rx=0 tx=0).stop 2024-04-02T07:22:24.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f6f6be00640 1 -- 172.21.15.55:0/568375965 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c00cc10 con 0x7f6f740700c0 2024-04-02T07:22:24.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f6f6be00640 1 -- 172.21.15.55:0/568375965 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f6c00cd70 con 0x7f6f740700c0 2024-04-02T07:22:24.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f6f6be00640 1 -- 172.21.15.55:0/568375965 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f6c014680 con 0x7f6f740700c0 2024-04-02T07:22:24.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7fdf32600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf10005190 0x7fdf2c156450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7fdf32600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf2c157d40 0x7fdf2c0ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7fdf32600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf2c152190 0x7fdf2c146c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f009f200640 1 -- 172.21.15.55:0/3514280667 reap_dead start 2024-04-02T07:22:24.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7fdf2b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf10005190 0x7fdf2c156450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7fdf2b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf10005190 0x7fdf2c156450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51658/0 (socket says 172.21.15.55:51658) 2024-04-02T07:22:24.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7fdf2aa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf2c157d40 0x7fdf2c0ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7fdf2aa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf2c157d40 0x7fdf2c0ca350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:36340/0 (socket says 172.21.15.55:36340) 2024-04-02T07:22:24.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7fdf2aa00640 1 -- 172.21.15.55:0/2488201197 learned_addr learned my addr 172.21.15.55:0/2488201197 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f00a5400640 1 -- 172.21.15.55:0/3514280667 shutdown_connections 2024-04-02T07:22:24.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f00a5400640 1 -- 172.21.15.55:0/3514280667 >> 172.21.15.55:0/3514280667 conn(0x7f00a0069d90 msgr2=0x7f00a006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f197e000640 1 --2- 172.21.15.55:0/976052162 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1960066710 0x7f1960068bd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f196c004f90 tx=0x7f196c004e00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7fdf2be00640 1 --2- 172.21.15.55:0/2488201197 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf2c152190 0x7fdf2c146c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7fdf32600640 1 -- 172.21.15.55:0/2488201197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c0c4e10 con 0x7fdf10005190 2024-04-02T07:22:24.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7fdf32600640 1 -- 172.21.15.55:0/2488201197 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c156ca0 con 0x7fdf2c157d40 2024-04-02T07:22:24.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7fdf32600640 1 -- 172.21.15.55:0/2488201197 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf2c156f80 con 0x7fdf2c152190 2024-04-02T07:22:24.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f53cfe00640 1 -- 172.21.15.55:0/2104870117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53c815ccb0 msgr2=0x7f53c80d0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.105+0000 7f53cfe00640 1 --2- 172.21.15.55:0/2104870117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53c815ccb0 0x7f53c80d0e30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f53b4006fd0 tx=0x7f53b401c4f0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f5e3a600640 1 -- 172.21.15.55:0/3088114869 shutdown_connections 2024-04-02T07:22:24.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f5e3a600640 1 --2- 172.21.15.55:0/3088114869 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e18005190 0x7f5e1800b990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f5e3a600640 1 -- 172.21.15.55:0/3088114869 >> 172.21.15.55:0/3088114869 conn(0x7f5e34065a80 msgr2=0x7f5e34065e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f976e800640 1 Processor -- start 2024-04-02T07:22:24.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f00a5400640 1 -- 172.21.15.55:0/3514280667 shutdown_connections 2024-04-02T07:22:24.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f00a5400640 1 -- 172.21.15.55:0/3514280667 wait complete. 2024-04-02T07:22:24.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f9ac4c00640 1 -- 172.21.15.55:0/3558406311 <== osd.1 v2:172.21.15.55:6809/27391 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f9aac0713e0 con 0x7f9aac06e910 2024-04-02T07:22:24.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f6f7aa00640 1 -- 172.21.15.55:0/568375965 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f74159570 con 0x7f6f740700c0 2024-04-02T07:22:24.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f6f7aa00640 1 -- 172.21.15.55:0/568375965 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f74153ad0 con 0x7f6f740700c0 2024-04-02T07:22:24.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f197f400640 1 --2- 172.21.15.55:0/976052162 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x7f196006e930 0x7f1960070d50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f976e800640 1 -- start start 2024-04-02T07:22:24.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7fdf2be00640 1 -- 172.21.15.55:0/2488201197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf2c157d40 msgr2=0x7fdf2c0ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7fdf2be00640 1 --2- 172.21.15.55:0/2488201197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf2c157d40 0x7fdf2c0ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7fdf2be00640 1 -- 172.21.15.55:0/2488201197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf10005190 msgr2=0x7fdf2c156450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7fdf2be00640 1 --2- 172.21.15.55:0/2488201197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf10005190 0x7fdf2c156450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7fdf2be00640 1 -- 172.21.15.55:0/2488201197 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf2c157260 con 0x7fdf2c152190 2024-04-02T07:22:24.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f6f7aa00640 1 -- 172.21.15.55:0/568375965 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6f74070de0 con 0x7f6f740700c0 2024-04-02T07:22:24.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7fdf2be00640 1 --2- 172.21.15.55:0/2488201197 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf2c152190 0x7fdf2c146c10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0b1180 tx=0x7fdf10005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7fdf23400640 1 -- 172.21.15.55:0/2488201197 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf240b7070 con 0x7fdf2c152190 2024-04-02T07:22:24.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7fdf23400640 1 -- 172.21.15.55:0/2488201197 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf240a9540 con 0x7fdf2c152190 2024-04-02T07:22:24.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f5e3a600640 1 -- 172.21.15.55:0/3088114869 shutdown_connections 2024-04-02T07:22:24.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f53cfe00640 1 -- 172.21.15.55:0/2104870117 shutdown_connections 2024-04-02T07:22:24.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f53cfe00640 1 --2- 172.21.15.55:0/2104870117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53c815ccb0 0x7f53c80d0e30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f53cfe00640 1 --2- 172.21.15.55:0/2104870117 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c815c8d0 0x7f53c80ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f976e800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cb810 0x7f976806dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f976e800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f976815eb10 0x7f9768153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f976e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9768161620 0x7f9768160200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f976e800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976806d170 con 0x7f97680cb810 2024-04-02T07:22:24.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f53cfe00640 1 -- 172.21.15.55:0/2104870117 >> 172.21.15.55:0/2104870117 conn(0x7f53c809ba30 msgr2=0x7f53c8089fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f5e3a600640 1 -- 172.21.15.55:0/3088114869 wait complete. 2024-04-02T07:22:24.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f976e800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976806c280 con 0x7f9768161620 2024-04-02T07:22:24.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f976e800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f976806c560 con 0x7f976815eb10 2024-04-02T07:22:24.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f53cfe00640 1 -- 172.21.15.55:0/2104870117 shutdown_connections 2024-04-02T07:22:24.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f1976a00640 1 -- 172.21.15.55:0/976052162 <== osd.0 v2:172.21.15.55:6800/27392 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f1960071400 con 0x7f196006e930 2024-04-02T07:22:24.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f53cfe00640 1 -- 172.21.15.55:0/2104870117 wait complete. 2024-04-02T07:22:24.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f9767e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9768161620 0x7f9768160200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f9767e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9768161620 0x7f9768160200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:36344/0 (socket says 172.21.15.55:36344) 2024-04-02T07:22:24.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f9767e00640 1 -- 172.21.15.55:0/1697082555 learned_addr learned my addr 172.21.15.55:0/1697082555 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7fdf23400640 1 -- 172.21.15.55:0/2488201197 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf240a9a30 con 0x7fdf2c152190 2024-04-02T07:22:24.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f9766a00640 1 --2- 172.21.15.55:0/1697082555 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f976815eb10 0x7f9768153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f00a5400640 1 Processor -- start 2024-04-02T07:22:24.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f00a5400640 1 -- start start 2024-04-02T07:22:24.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f9766a00640 1 -- 172.21.15.55:0/1697082555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9768161620 msgr2=0x7f9768160200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f9766a00640 1 --2- 172.21.15.55:0/1697082555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9768161620 0x7f9768160200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f9766a00640 1 -- 172.21.15.55:0/1697082555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cb810 msgr2=0x7f976806dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f9766a00640 1 --2- 172.21.15.55:0/1697082555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97680cb810 0x7f976806dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f9766a00640 1 -- 172.21.15.55:0/1697082555 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9760009a70 con 0x7f976815eb10 2024-04-02T07:22:24.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f00a5400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00a014d770 0x7f00a01ef080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f00a5400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00a015c250 0x7f00a015c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f00a5400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00a01ee030 0x7f00a01ee4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f00a5400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a01ef5c0 con 0x7f00a01ee030 2024-04-02T07:22:24.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f00a5400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a015cc10 con 0x7f00a014d770 2024-04-02T07:22:24.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.109+0000 7f00a5400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00a01eedf0 con 0x7f00a015c250 2024-04-02T07:22:24.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f9766a00640 1 --2- 172.21.15.55:0/1697082555 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f976815eb10 0x7f9768153690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f975800c3c0 tx=0x7f975800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f009e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00a014d770 0x7f00a01ef080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f009de00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00a015c250 0x7f00a015c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f975f400640 1 -- 172.21.15.55:0/1697082555 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97580052d0 con 0x7f976815eb10 2024-04-02T07:22:24.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f009de00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00a015c250 0x7f00a015c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:48292/0 (socket says 172.21.15.55:48292) 2024-04-02T07:22:24.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f009de00640 1 -- 172.21.15.55:0/726346494 learned_addr learned my addr 172.21.15.55:0/726346494 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f5e3a600640 1 Processor -- start 2024-04-02T07:22:24.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f975f400640 1 -- 172.21.15.55:0/1697082555 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9758005430 con 0x7f976815eb10 2024-04-02T07:22:24.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f975f400640 1 -- 172.21.15.55:0/1697082555 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97580052d0 con 0x7f976815eb10 2024-04-02T07:22:24.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f976e800640 1 -- 172.21.15.55:0/1697082555 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f976806c840 con 0x7f976815eb10 2024-04-02T07:22:24.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f53cfe00640 1 Processor -- start 2024-04-02T07:22:24.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f5e3a600640 1 -- start start 2024-04-02T07:22:24.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f976e800640 1 -- 172.21.15.55:0/1697082555 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f976806ce00 con 0x7f976815eb10 2024-04-02T07:22:24.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f53cfe00640 1 -- start start 2024-04-02T07:22:24.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f009f200640 1 --2- 172.21.15.55:0/726346494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00a01ee030 0x7f00a01ee4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f009e800640 1 -- 172.21.15.55:0/726346494 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00a015c250 msgr2=0x7f00a015c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f009e800640 1 --2- 172.21.15.55:0/726346494 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00a015c250 0x7f00a015c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f009e800640 1 -- 172.21.15.55:0/726346494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00a01ee030 msgr2=0x7f00a01ee4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f009e800640 1 --2- 172.21.15.55:0/726346494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00a01ee030 0x7f00a01ee4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f009e800640 1 -- 172.21.15.55:0/726346494 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00a0159fc0 con 0x7f00a014d770 2024-04-02T07:22:24.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f009e800640 1 --2- 172.21.15.55:0/726346494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00a014d770 0x7f00a01ef080 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f00980013e0 tx=0x7f009800e4c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f0096a00640 1 -- 172.21.15.55:0/726346494 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009801a070 con 0x7f00a014d770 2024-04-02T07:22:24.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f0096a00640 1 -- 172.21.15.55:0/726346494 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0098010da0 con 0x7f00a014d770 2024-04-02T07:22:24.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f0096a00640 1 -- 172.21.15.55:0/726346494 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00980072f0 con 0x7f00a014d770 2024-04-02T07:22:24.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f00a5400640 1 -- 172.21.15.55:0/726346494 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a015a2a0 con 0x7f00a014d770 2024-04-02T07:22:24.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f976e800640 1 -- 172.21.15.55:0/1697082555 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f97681645a0 con 0x7f976815eb10 2024-04-02T07:22:24.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f00a5400640 1 -- 172.21.15.55:0/726346494 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a015a860 con 0x7f00a014d770 2024-04-02T07:22:24.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f53cfe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53c80cfc80 0x7f53c80b7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f53cfe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c815c8d0 0x7f53c8070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f53cfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53c815ccb0 0x7f53c80c9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f53cfe00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80b58a0 con 0x7f53c815ccb0 2024-04-02T07:22:24.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f53cfe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80b55c0 con 0x7f53c80cfc80 2024-04-02T07:22:24.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f53cfe00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80caaf0 con 0x7f53c815c8d0 2024-04-02T07:22:24.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f53cca00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c815c8d0 0x7f53c8070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f53cca00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c815c8d0 0x7f53c8070700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:48308/0 (socket says 172.21.15.55:48308) 2024-04-02T07:22:24.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f53cca00640 1 -- 172.21.15.55:0/1323169362 learned_addr learned my addr 172.21.15.55:0/1323169362 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f53cca00640 1 -- 172.21.15.55:0/1323169362 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53c80cfc80 msgr2=0x7f53c80b7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f53cca00640 1 --2- 172.21.15.55:0/1323169362 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f53c80cfc80 0x7f53c80b7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f53cca00640 1 -- 172.21.15.55:0/1323169362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53c815ccb0 msgr2=0x7f53c80c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f53cca00640 1 --2- 172.21.15.55:0/1323169362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f53c815ccb0 0x7f53c80c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f53cca00640 1 -- 172.21.15.55:0/1323169362 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b4009480 con 0x7f53c815c8d0 2024-04-02T07:22:24.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7f00a5400640 1 -- 172.21.15.55:0/726346494 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0078000fd0 con 0x7f00a014d770 2024-04-02T07:22:24.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f53cca00640 1 --2- 172.21.15.55:0/1323169362 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c815c8d0 0x7f53c8070700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f53b401aba0 tx=0x7f53b4019290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e3a600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e18005190 0x7f5e341faa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e3a600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e34145950 0x7f5e34145120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e3a600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e3415c8e0 0x7f5e3415cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e3a600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e341faf60 con 0x7f5e18005190 2024-04-02T07:22:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e3a600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e3415d2a0 con 0x7f5e3415c8e0 2024-04-02T07:22:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e3a600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e341f68e0 con 0x7f5e34145950 2024-04-02T07:22:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f975f400640 1 -- 172.21.15.55:0/1697082555 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f9758003600 con 0x7f976815eb10 2024-04-02T07:22:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e32a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e34145950 0x7f5e34145120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e32a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e34145950 0x7f5e34145120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:48318/0 (socket says 172.21.15.55:48318) 2024-04-02T07:22:24.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e32a00640 1 -- 172.21.15.55:0/1071065985 learned_addr learned my addr 172.21.15.55:0/1071065985 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e33e00640 1 --2- 172.21.15.55:0/1071065985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e3415c8e0 0x7f5e3415cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e33400640 1 --2- 172.21.15.55:0/1071065985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e18005190 0x7f5e341faa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e32a00640 1 -- 172.21.15.55:0/1071065985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e3415c8e0 msgr2=0x7f5e3415cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e32a00640 1 --2- 172.21.15.55:0/1071065985 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e3415c8e0 0x7f5e3415cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e32a00640 1 -- 172.21.15.55:0/1071065985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e18005190 msgr2=0x7f5e341faa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e32a00640 1 --2- 172.21.15.55:0/1071065985 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e18005190 0x7f5e341faa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e32a00640 1 -- 172.21.15.55:0/1071065985 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3414e370 con 0x7f5e34145950 2024-04-02T07:22:24.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f0096a00640 1 -- 172.21.15.55:0/726346494 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f009800ebd0 con 0x7f00a014d770 2024-04-02T07:22:24.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f975f400640 1 --2- 172.21.15.55:0/1697082555 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97440666f0 0x7f9744068bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e32a00640 1 --2- 172.21.15.55:0/1071065985 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e34145950 0x7f5e34145120 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000d880 tx=0x7f5e2000dd40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f975f400640 1 -- 172.21.15.55:0/1697082555 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9758083020 con 0x7f976815eb10 2024-04-02T07:22:24.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f9767400640 1 --2- 172.21.15.55:0/1697082555 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97440666f0 0x7f9744068bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e2b400640 1 -- 172.21.15.55:0/1071065985 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e200074e0 con 0x7f5e34145950 2024-04-02T07:22:24.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e2b400640 1 -- 172.21.15.55:0/1071065985 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e20007640 con 0x7f5e34145950 2024-04-02T07:22:24.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e2b400640 1 -- 172.21.15.55:0/1071065985 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e20004a30 con 0x7f5e34145950 2024-04-02T07:22:24.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e3a600640 1 -- 172.21.15.55:0/1071065985 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e3414e650 con 0x7f5e34145950 2024-04-02T07:22:24.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f975f400640 1 --2- 172.21.15.55:0/1697082555 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x7f974406e890 0x7f9744070cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f975f400640 1 -- 172.21.15.55:0/1697082555 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9744071360 con 0x7f974406e890 2024-04-02T07:22:24.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f975f400640 1 -- 172.21.15.55:0/1697082555 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97580503b0 con 0x7f976815eb10 2024-04-02T07:22:24.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e3a600640 1 -- 172.21.15.55:0/1071065985 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e34152c90 con 0x7f5e34145950 2024-04-02T07:22:24.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f9767e00640 1 --2- 172.21.15.55:0/1697082555 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x7f974406e890 0x7f9744070cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f0096a00640 1 --2- 172.21.15.55:0/726346494 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0080066790 0x7f0080068c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f9767400640 1 --2- 172.21.15.55:0/1697082555 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97440666f0 0x7f9744068bb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9750001560 tx=0x7f9750007a50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f5e3a600640 1 -- 172.21.15.55:0/1071065985 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5e3406ceb0 con 0x7f5e34145950 2024-04-02T07:22:24.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f0096a00640 1 -- 172.21.15.55:0/726346494 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0098087400 con 0x7f00a014d770 2024-04-02T07:22:24.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f0096a00640 1 --2- 172.21.15.55:0/726346494 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x7f008006e9b0 0x7f0080070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f009de00640 1 --2- 172.21.15.55:0/726346494 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0080066790 0x7f0080068c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f0096a00640 1 -- 172.21.15.55:0/726346494 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0080071480 con 0x7f008006e9b0 2024-04-02T07:22:24.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f0096a00640 1 -- 172.21.15.55:0/726346494 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00980877b0 con 0x7f00a014d770 2024-04-02T07:22:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f6f6be00640 1 -- 172.21.15.55:0/568375965 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6f6c01d3b0 con 0x7f6f740700c0 2024-04-02T07:22:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f6f6be00640 1 --2- 172.21.15.55:0/568375965 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6f54066760 0x7f6f54068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7fdf32600640 1 -- 172.21.15.55:0/2488201197 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf2c157540 con 0x7fdf2c152190 2024-04-02T07:22:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7fdf32600640 1 -- 172.21.15.55:0/2488201197 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf2c156990 con 0x7fdf2c152190 2024-04-02T07:22:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.113+0000 7fdf23400640 1 -- 172.21.15.55:0/2488201197 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fdf240ba070 con 0x7fdf2c152190 2024-04-02T07:22:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7fdf23400640 1 --2- 172.21.15.55:0/2488201197 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf0c066710 0x7fdf0c068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7fdf23400640 1 -- 172.21.15.55:0/2488201197 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf24120920 con 0x7fdf2c152190 2024-04-02T07:22:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7fdf2b400640 1 --2- 172.21.15.55:0/2488201197 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf0c066710 0x7fdf0c068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7f6f6be00640 1 -- 172.21.15.55:0/568375965 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f6c084180 con 0x7f6f740700c0 2024-04-02T07:22:24.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f6f6be00640 1 --2- 172.21.15.55:0/568375965 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x7f6f5406e900 0x7f6f54070d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f6f6be00640 1 -- 172.21.15.55:0/568375965 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f540713d0 con 0x7f6f5406e900 2024-04-02T07:22:24.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.117+0000 7fdf2b400640 1 --2- 172.21.15.55:0/2488201197 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf0c066710 0x7fdf0c068bd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0047c0 tx=0x7fdf1c00f930 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f9767e00640 1 --2- 172.21.15.55:0/1697082555 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x7f974406e890 0x7f9744070cb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f53c5600640 1 -- 172.21.15.55:0/1323169362 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b40aacd0 con 0x7f53c815c8d0 2024-04-02T07:22:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f53c5600640 1 -- 172.21.15.55:0/1323169362 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53b40aae30 con 0x7f53c815c8d0 2024-04-02T07:22:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f53c5600640 1 -- 172.21.15.55:0/1323169362 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53b4003840 con 0x7f53c815c8d0 2024-04-02T07:22:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f6f78a00640 1 --2- 172.21.15.55:0/568375965 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x7f6f5406e900 0x7f6f54070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f6f73400640 1 --2- 172.21.15.55:0/568375965 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6f54066760 0x7f6f54068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f6f6be00640 1 -- 172.21.15.55:0/568375965 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f6c051560 con 0x7f6f740700c0 2024-04-02T07:22:24.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f6f78a00640 1 --2- 172.21.15.55:0/568375965 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x7f6f5406e900 0x7f6f54070d20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f53cfe00640 1 -- 172.21.15.55:0/1323169362 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c80cadd0 con 0x7f53c815c8d0 2024-04-02T07:22:24.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f53cfe00640 1 -- 172.21.15.55:0/1323169362 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c80b6840 con 0x7f53c815c8d0 2024-04-02T07:22:24.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7fdf20c00640 1 --2- 172.21.15.55:0/2488201197 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x7fdf2c15aed0 0x7fdf2c15b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7fdf20c00640 1 -- 172.21.15.55:0/2488201197 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf2c0c9210 con 0x7fdf2c15aed0 2024-04-02T07:22:24.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7fdf2aa00640 1 --2- 172.21.15.55:0/2488201197 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x7fdf2c15aed0 0x7fdf2c15b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7fdf2aa00640 1 --2- 172.21.15.55:0/2488201197 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x7fdf2c15aed0 0x7fdf2c15b2b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f5e2b400640 1 -- 172.21.15.55:0/1071065985 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5e20004b90 con 0x7f5e34145950 2024-04-02T07:22:24.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f975f400640 1 -- 172.21.15.55:0/1697082555 <== osd.6 v2:172.21.15.106:6816/27678 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f9744071360 con 0x7f974406e890 2024-04-02T07:22:24.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f53cfe00640 1 -- 172.21.15.55:0/1323169362 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f53c8073fa0 con 0x7f53c815c8d0 2024-04-02T07:22:24.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f009f200640 1 --2- 172.21.15.55:0/726346494 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x7f008006e9b0 0x7f0080070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f009f200640 1 --2- 172.21.15.55:0/726346494 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x7f008006e9b0 0x7f0080070dd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f6f73400640 1 --2- 172.21.15.55:0/568375965 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6f54066760 0x7f6f54068c20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6f600af000 tx=0x7f6f60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f5e2b400640 1 --2- 172.21.15.55:0/1071065985 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e140666e0 0x7f5e14068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f009de00640 1 --2- 172.21.15.55:0/726346494 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0080066790 0x7f0080068c50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f008c020ba0 tx=0x7f008c004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7fdf23400640 1 -- 172.21.15.55:0/2488201197 <== osd.4 v2:172.21.15.106:6801/27677 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fdf18009890 con 0x7fdf2c15aed0 2024-04-02T07:22:24.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f5e2b400640 1 -- 172.21.15.55:0/1071065985 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e20084600 con 0x7f5e34145950 2024-04-02T07:22:24.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f5e2b400640 1 --2- 172.21.15.55:0/1071065985 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x7f5e1406e900 0x7f5e14070d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f5e2b400640 1 -- 172.21.15.55:0/1071065985 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e140713d0 con 0x7f5e1406e900 2024-04-02T07:22:24.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f5e2b400640 1 -- 172.21.15.55:0/1071065985 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e20084970 con 0x7f5e34145950 2024-04-02T07:22:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f0096a00640 1 -- 172.21.15.55:0/726346494 <== osd.7 v2:172.21.15.106:6824/27679 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f0080071480 con 0x7f008006e9b0 2024-04-02T07:22:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f6f6be00640 1 -- 172.21.15.55:0/568375965 <== osd.2 v2:172.21.15.55:6808/27394 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f6f540713d0 con 0x7f6f5406e900 2024-04-02T07:22:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.121+0000 7f5e33e00640 1 --2- 172.21.15.55:0/1071065985 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x7f5e1406e900 0x7f5e14070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.125+0000 7f5e33e00640 1 --2- 172.21.15.55:0/1071065985 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x7f5e1406e900 0x7f5e14070d20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.125+0000 7f53c5600640 1 -- 172.21.15.55:0/1323169362 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f53b40039a0 con 0x7f53c815c8d0 2024-04-02T07:22:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.125+0000 7f53c5600640 1 --2- 172.21.15.55:0/1323169362 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f53a80666e0 0x7f53a8068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.125+0000 7f53c5600640 1 -- 172.21.15.55:0/1323169362 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f53b40a7070 con 0x7f53c815c8d0 2024-04-02T07:22:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.125+0000 7f53c5600640 1 --2- 172.21.15.55:0/1323169362 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x7f53a806e900 0x7f53a8070d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.125+0000 7f53c5600640 1 -- 172.21.15.55:0/1323169362 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53a80713d0 con 0x7f53a806e900 2024-04-02T07:22:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.125+0000 7f53c5600640 1 -- 172.21.15.55:0/1323169362 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53b411f1a0 con 0x7f53c815c8d0 2024-04-02T07:22:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.125+0000 7f5e33400640 1 --2- 172.21.15.55:0/1071065985 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e140666e0 0x7f5e14068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.125+0000 7f53cde00640 1 --2- 172.21.15.55:0/1323169362 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x7f53a806e900 0x7f53a8070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.125+0000 7f53cd400640 1 --2- 172.21.15.55:0/1323169362 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f53a80666e0 0x7f53a8068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.125+0000 7f5e33400640 1 --2- 172.21.15.55:0/1071065985 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e140666e0 0x7f5e14068ba0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5e24006fd0 tx=0x7f5e24008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.125+0000 7f53cde00640 1 --2- 172.21.15.55:0/1323169362 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x7f53a806e900 0x7f53a8070d20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.129+0000 7f5e2b400640 1 -- 172.21.15.55:0/1071065985 <== osd.5 v2:172.21.15.106:6800/27676 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f5e140713d0 con 0x7f5e1406e900 2024-04-02T07:22:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.129+0000 7f53c5600640 1 -- 172.21.15.55:0/1323169362 <== osd.3 v2:172.21.15.55:6824/27393 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f53a80713d0 con 0x7f53a806e900 2024-04-02T07:22:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.133+0000 7f53cd400640 1 --2- 172.21.15.55:0/1323169362 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f53a80666e0 0x7f53a8068ba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f53bc006fd0 tx=0x7f53bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.141+0000 7fdf20c00640 1 -- 172.21.15.55:0/2488201197 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdf2c06ceb0 con 0x7fdf2c15aed0 2024-04-02T07:22:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.141+0000 7f9acfa00640 1 -- 172.21.15.55:0/3558406311 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9ac8066c90 con 0x7f9aac06e910 2024-04-02T07:22:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.141+0000 7fdf23400640 1 -- 172.21.15.55:0/2488201197 <== osd.4 v2:172.21.15.106:6801/27677 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdf18009d50 con 0x7fdf2c15aed0 2024-04-02T07:22:24.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.141+0000 7f9ac4c00640 1 -- 172.21.15.55:0/3558406311 <== osd.1 v2:172.21.15.55:6809/27391 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9ac8066c90 con 0x7f9aac06e910 2024-04-02T07:22:24.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7fdf20c00640 1 -- 172.21.15.55:0/2488201197 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x7fdf2c15aed0 msgr2=0x7fdf2c15b2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7fdf20c00640 1 --2- 172.21.15.55:0/2488201197 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x7fdf2c15aed0 0x7fdf2c15b2b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7fdf20c00640 1 -- 172.21.15.55:0/2488201197 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf0c066710 msgr2=0x7fdf0c068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7fdf20c00640 1 --2- 172.21.15.55:0/2488201197 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf0c066710 0x7fdf0c068bd0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c0047c0 tx=0x7fdf1c00f930 comp rx=0 tx=0).stop 2024-04-02T07:22:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7fdf20c00640 1 -- 172.21.15.55:0/2488201197 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf2c152190 msgr2=0x7fdf2c146c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7fdf20c00640 1 --2- 172.21.15.55:0/2488201197 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf2c152190 0x7fdf2c146c10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c0b1180 tx=0x7fdf10005800 comp rx=0 tx=0).stop 2024-04-02T07:22:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7fdf2be00640 1 -- 172.21.15.55:0/2488201197 reap_dead start 2024-04-02T07:22:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f9acfa00640 1 -- 172.21.15.55:0/3558406311 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x7f9aac06e910 msgr2=0x7f9aac070d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7fdf20c00640 1 -- 172.21.15.55:0/2488201197 shutdown_connections 2024-04-02T07:22:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7fdf20c00640 1 -- 172.21.15.55:0/2488201197 >> 172.21.15.55:0/2488201197 conn(0x7fdf2c065a80 msgr2=0x7fdf2c065e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f9acfa00640 1 --2- 172.21.15.55:0/3558406311 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x7f9aac06e910 0x7f9aac070d30 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f1985800640 1 -- 172.21.15.55:0/976052162 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1958002cc0 con 0x7f196006e930 2024-04-02T07:22:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f9acfa00640 1 -- 172.21.15.55:0/3558406311 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9aac0666f0 msgr2=0x7f9aac068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f9acfa00640 1 --2- 172.21.15.55:0/3558406311 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9aac0666f0 0x7f9aac068bb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009870 tx=0x7f9abc0a7000 comp rx=0 tx=0).stop 2024-04-02T07:22:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f9acfa00640 1 -- 172.21.15.55:0/3558406311 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ac80b0d60 msgr2=0x7f9ac81f9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f9acfa00640 1 --2- 172.21.15.55:0/3558406311 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ac80b0d60 0x7f9ac81f9ec0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9ab800c390 tx=0x7f9ab800c850 comp rx=0 tx=0).stop 2024-04-02T07:22:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f9acda00640 1 -- 172.21.15.55:0/3558406311 reap_dead start 2024-04-02T07:22:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f1976a00640 1 -- 172.21.15.55:0/976052162 <== osd.0 v2:172.21.15.55:6800/27392 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1958002cc0 con 0x7f196006e930 2024-04-02T07:22:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f9acfa00640 1 -- 172.21.15.55:0/3558406311 shutdown_connections 2024-04-02T07:22:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f9acfa00640 1 -- 172.21.15.55:0/3558406311 >> 172.21.15.55:0/3558406311 conn(0x7f9ac8065a80 msgr2=0x7f9ac814b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f1985800640 1 -- 172.21.15.55:0/976052162 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x7f196006e930 msgr2=0x7f1960070d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f1985800640 1 --2- 172.21.15.55:0/976052162 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x7f196006e930 0x7f1960070d50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f9acfa00640 1 -- 172.21.15.55:0/3558406311 shutdown_connections 2024-04-02T07:22:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f9acfa00640 1 -- 172.21.15.55:0/3558406311 wait complete. 2024-04-02T07:22:24.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f1985800640 1 -- 172.21.15.55:0/976052162 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1960066710 msgr2=0x7f1960068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f1985800640 1 --2- 172.21.15.55:0/976052162 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1960066710 0x7f1960068bd0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f196c004f90 tx=0x7f196c004e00 comp rx=0 tx=0).stop 2024-04-02T07:22:24.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f1985800640 1 -- 172.21.15.55:0/976052162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1964005190 msgr2=0x7f198014a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f1985800640 1 --2- 172.21.15.55:0/976052162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1964005190 0x7f198014a020 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f197800efc0 tx=0x7f197800c490 comp rx=0 tx=0).stop 2024-04-02T07:22:24.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f197f400640 1 -- 172.21.15.55:0/976052162 reap_dead start 2024-04-02T07:22:24.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f1985800640 1 -- 172.21.15.55:0/976052162 shutdown_connections 2024-04-02T07:22:24.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7f1985800640 1 -- 172.21.15.55:0/976052162 >> 172.21.15.55:0/976052162 conn(0x7f1980065a80 msgr2=0x7f19800cdb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7fdf20c00640 1 -- 172.21.15.55:0/2488201197 shutdown_connections 2024-04-02T07:22:24.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.145+0000 7fdf20c00640 1 -- 172.21.15.55:0/2488201197 wait complete. 2024-04-02T07:22:24.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.149+0000 7f1985800640 1 -- 172.21.15.55:0/976052162 shutdown_connections 2024-04-02T07:22:24.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.149+0000 7f1985800640 1 -- 172.21.15.55:0/976052162 wait complete. 2024-04-02T07:22:24.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f976e800640 1 -- 172.21.15.55:0/1697082555 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f976806cf90 con 0x7f974406e890 2024-04-02T07:22:24.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f00a5400640 1 -- 172.21.15.55:0/726346494 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f0078002cc0 con 0x7f008006e9b0 2024-04-02T07:22:24.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f6f7aa00640 1 -- 172.21.15.55:0/568375965 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6f740712f0 con 0x7f6f5406e900 2024-04-02T07:22:24.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f0096a00640 1 -- 172.21.15.55:0/726346494 <== osd.7 v2:172.21.15.106:6824/27679 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f0078002cc0 con 0x7f008006e9b0 2024-04-02T07:22:24.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f975f400640 1 -- 172.21.15.55:0/1697082555 <== osd.6 v2:172.21.15.106:6816/27678 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f976806cf90 con 0x7f974406e890 2024-04-02T07:22:24.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f6f6be00640 1 -- 172.21.15.55:0/568375965 <== osd.2 v2:172.21.15.55:6808/27394 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6f64009280 con 0x7f6f5406e900 2024-04-02T07:22:24.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f6f7aa00640 1 -- 172.21.15.55:0/568375965 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x7f6f5406e900 msgr2=0x7f6f54070d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f6f7aa00640 1 --2- 172.21.15.55:0/568375965 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x7f6f5406e900 0x7f6f54070d20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f6f7aa00640 1 -- 172.21.15.55:0/568375965 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6f54066760 msgr2=0x7f6f54068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f6f7aa00640 1 --2- 172.21.15.55:0/568375965 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6f54066760 0x7f6f54068c20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6f600af000 tx=0x7f6f60008040 comp rx=0 tx=0).stop 2024-04-02T07:22:24.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f6f7aa00640 1 -- 172.21.15.55:0/568375965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f740700c0 msgr2=0x7f6f7415bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f6f7aa00640 1 --2- 172.21.15.55:0/568375965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f740700c0 0x7f6f7415bb80 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c00ba50 tx=0x7f6f6c00bf10 comp rx=0 tx=0).stop 2024-04-02T07:22:24.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f6f78a00640 1 -- 172.21.15.55:0/568375965 reap_dead start 2024-04-02T07:22:24.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f976e800640 1 -- 172.21.15.55:0/1697082555 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x7f974406e890 msgr2=0x7f9744070cb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f976e800640 1 --2- 172.21.15.55:0/1697082555 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x7f974406e890 0x7f9744070cb0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f976e800640 1 -- 172.21.15.55:0/1697082555 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97440666f0 msgr2=0x7f9744068bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f976e800640 1 --2- 172.21.15.55:0/1697082555 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97440666f0 0x7f9744068bb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9750001560 tx=0x7f9750007a50 comp rx=0 tx=0).stop 2024-04-02T07:22:24.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f976e800640 1 -- 172.21.15.55:0/1697082555 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f976815eb10 msgr2=0x7f9768153690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f976e800640 1 --2- 172.21.15.55:0/1697082555 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f976815eb10 0x7f9768153690 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f975800c3c0 tx=0x7f975800c880 comp rx=0 tx=0).stop 2024-04-02T07:22:24.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f9767e00640 1 -- 172.21.15.55:0/1697082555 reap_dead start 2024-04-02T07:22:24.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f976e800640 1 -- 172.21.15.55:0/1697082555 shutdown_connections 2024-04-02T07:22:24.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f976e800640 1 -- 172.21.15.55:0/1697082555 >> 172.21.15.55:0/1697082555 conn(0x7f9768069d90 msgr2=0x7f9768163760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f976e800640 1 -- 172.21.15.55:0/1697082555 shutdown_connections 2024-04-02T07:22:24.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f976e800640 1 -- 172.21.15.55:0/1697082555 wait complete. 2024-04-02T07:22:24.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f6f7aa00640 1 -- 172.21.15.55:0/568375965 shutdown_connections 2024-04-02T07:22:24.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f6f7aa00640 1 -- 172.21.15.55:0/568375965 >> 172.21.15.55:0/568375965 conn(0x7f6f74069f60 msgr2=0x7f6f74154740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f6f7aa00640 1 -- 172.21.15.55:0/568375965 shutdown_connections 2024-04-02T07:22:24.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f00a5400640 1 -- 172.21.15.55:0/726346494 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x7f008006e9b0 msgr2=0x7f0080070dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f00a5400640 1 --2- 172.21.15.55:0/726346494 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x7f008006e9b0 0x7f0080070dd0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.153+0000 7f6f7aa00640 1 -- 172.21.15.55:0/568375965 wait complete. 2024-04-02T07:22:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.157+0000 7f00a5400640 1 -- 172.21.15.55:0/726346494 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0080066790 msgr2=0x7f0080068c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.157+0000 7f00a5400640 1 --2- 172.21.15.55:0/726346494 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0080066790 0x7f0080068c50 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f008c020ba0 tx=0x7f008c004740 comp rx=0 tx=0).stop 2024-04-02T07:22:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.157+0000 7f00a5400640 1 -- 172.21.15.55:0/726346494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00a014d770 msgr2=0x7f00a01ef080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.157+0000 7f00a5400640 1 --2- 172.21.15.55:0/726346494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00a014d770 0x7f00a01ef080 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f00980013e0 tx=0x7f009800e4c0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.157+0000 7f009f200640 1 -- 172.21.15.55:0/726346494 reap_dead start 2024-04-02T07:22:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.157+0000 7f00a5400640 1 -- 172.21.15.55:0/726346494 shutdown_connections 2024-04-02T07:22:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.157+0000 7f00a5400640 1 -- 172.21.15.55:0/726346494 >> 172.21.15.55:0/726346494 conn(0x7f00a0069d90 msgr2=0x7f00a0070310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.157+0000 7f00a5400640 1 -- 172.21.15.55:0/726346494 shutdown_connections 2024-04-02T07:22:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.157+0000 7f00a5400640 1 -- 172.21.15.55:0/726346494 wait complete. 2024-04-02T07:22:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.161+0000 7f53cfe00640 1 -- 172.21.15.55:0/1323169362 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f53c80b3300 con 0x7f53a806e900 2024-04-02T07:22:24.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.161+0000 7f53c5600640 1 -- 172.21.15.55:0/1323169362 <== osd.3 v2:172.21.15.55:6824/27393 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f53c80b3300 con 0x7f53a806e900 2024-04-02T07:22:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.165+0000 7f5e3a600640 1 -- 172.21.15.55:0/1071065985 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5e3406cbd0 con 0x7f5e1406e900 2024-04-02T07:22:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.165+0000 7f53baa00640 1 -- 172.21.15.55:0/1323169362 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x7f53a806e900 msgr2=0x7f53a8070d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.165+0000 7f53baa00640 1 --2- 172.21.15.55:0/1323169362 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x7f53a806e900 0x7f53a8070d20 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.165+0000 7f53baa00640 1 -- 172.21.15.55:0/1323169362 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f53a80666e0 msgr2=0x7f53a8068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.165+0000 7f53baa00640 1 --2- 172.21.15.55:0/1323169362 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f53a80666e0 0x7f53a8068ba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f53bc006fd0 tx=0x7f53bc008040 comp rx=0 tx=0).stop 2024-04-02T07:22:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.165+0000 7f53baa00640 1 -- 172.21.15.55:0/1323169362 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c815c8d0 msgr2=0x7f53c8070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.165+0000 7f53baa00640 1 --2- 172.21.15.55:0/1323169362 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f53c815c8d0 0x7f53c8070700 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f53b401aba0 tx=0x7f53b4019290 comp rx=0 tx=0).stop 2024-04-02T07:22:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.165+0000 7f53cde00640 1 -- 172.21.15.55:0/1323169362 reap_dead start 2024-04-02T07:22:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.165+0000 7f5e2b400640 1 -- 172.21.15.55:0/1071065985 <== osd.5 v2:172.21.15.106:6800/27676 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5e2c0ad5a0 con 0x7f5e1406e900 2024-04-02T07:22:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.165+0000 7f5e3a600640 1 -- 172.21.15.55:0/1071065985 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x7f5e1406e900 msgr2=0x7f5e14070d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.165+0000 7f5e3a600640 1 --2- 172.21.15.55:0/1071065985 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x7f5e1406e900 0x7f5e14070d20 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.165+0000 7f5e3a600640 1 -- 172.21.15.55:0/1071065985 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e140666e0 msgr2=0x7f5e14068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.165+0000 7f5e3a600640 1 --2- 172.21.15.55:0/1071065985 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e140666e0 0x7f5e14068ba0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5e24006fd0 tx=0x7f5e24008040 comp rx=0 tx=0).stop 2024-04-02T07:22:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.165+0000 7f5e3a600640 1 -- 172.21.15.55:0/1071065985 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e34145950 msgr2=0x7f5e34145120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.165+0000 7f5e3a600640 1 --2- 172.21.15.55:0/1071065985 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e34145950 0x7f5e34145120 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5e2000d880 tx=0x7f5e2000dd40 comp rx=0 tx=0).stop 2024-04-02T07:22:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.165+0000 7f5e33e00640 1 -- 172.21.15.55:0/1071065985 reap_dead start 2024-04-02T07:22:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.165+0000 7f5e3a600640 1 -- 172.21.15.55:0/1071065985 shutdown_connections 2024-04-02T07:22:24.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.165+0000 7f5e3a600640 1 -- 172.21.15.55:0/1071065985 >> 172.21.15.55:0/1071065985 conn(0x7f5e34065a80 msgr2=0x7f5e34065e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.169+0000 7f5e3a600640 1 -- 172.21.15.55:0/1071065985 shutdown_connections 2024-04-02T07:22:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.169+0000 7f5e3a600640 1 -- 172.21.15.55:0/1071065985 wait complete. 2024-04-02T07:22:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.169+0000 7f53baa00640 1 -- 172.21.15.55:0/1323169362 shutdown_connections 2024-04-02T07:22:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.169+0000 7f53baa00640 1 -- 172.21.15.55:0/1323169362 >> 172.21.15.55:0/1323169362 conn(0x7f53c809ba30 msgr2=0x7f53c806f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.169+0000 7f53baa00640 1 -- 172.21.15.55:0/1323169362 shutdown_connections 2024-04-02T07:22:24.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.169+0000 7f53baa00640 1 -- 172.21.15.55:0/1323169362 wait complete. 2024-04-02T07:22:24.199 INFO:teuthology.orchestra.run.smithi055.stdout:55834574853 2024-04-02T07:22:24.199 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-02T07:22:24.205 INFO:teuthology.orchestra.run.smithi055.stdout:55834574856 2024-04-02T07:22:24.205 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-02T07:22:24.206 INFO:teuthology.orchestra.run.smithi055.stdout:55834574854 2024-04-02T07:22:24.206 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-02T07:22:24.207 INFO:teuthology.orchestra.run.smithi055.stdout:55834574854 2024-04-02T07:22:24.207 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-02T07:22:24.208 INFO:teuthology.orchestra.run.smithi055.stdout:55834574854 2024-04-02T07:22:24.209 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-02T07:22:24.209 INFO:teuthology.orchestra.run.smithi055.stdout:55834574853 2024-04-02T07:22:24.209 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-02T07:22:24.214 INFO:teuthology.orchestra.run.smithi055.stdout:55834574854 2024-04-02T07:22:24.214 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-02T07:22:24.215 INFO:teuthology.orchestra.run.smithi055.stdout:55834574854 2024-04-02T07:22:24.215 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-02T07:22:24.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.441+0000 7f6b7e000640 1 Processor -- start 2024-04-02T07:22:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.445+0000 7f6b7e000640 1 -- start start 2024-04-02T07:22:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.445+0000 7f6b7e000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b70050180 0x7f6b70006510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.445+0000 7f6b7e000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6b70033cd0 0x7f6b70006a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.445+0000 7f6b7e000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b700540f0 con 0x7f6b700df280 2024-04-02T07:22:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.445+0000 7f6b7e000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b70038060 con 0x7f6b70033cd0 2024-04-02T07:22:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.445+0000 7f6b7e000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b700df660 con 0x7f6b70050180 2024-04-02T07:22:24.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.445+0000 7f6b7d600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6b70033cd0 0x7f6b70006a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.445+0000 7f6b7cc00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6b700df280 0x7f6b7004fa70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:53138/0 (socket says 172.21.15.55:53138) 2024-04-02T07:22:24.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.445+0000 7f6b7cc00640 1 -- 172.21.15.55:0/582506226 learned_addr learned my addr 172.21.15.55:0/582506226 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:24.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.445+0000 7f6b77e00640 1 --2- 172.21.15.55:0/582506226 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b70050180 0x7f6b70006510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.445+0000 7f6b77400640 1 -- 172.21.15.55:0/582506226 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1322469812 0 0) 0x7f6b700540f0 con 0x7f6b700df280 2024-04-02T07:22:24.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.445+0000 7f6b77400640 1 -- 172.21.15.55:0/582506226 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b60003530 con 0x7f6b700df280 2024-04-02T07:22:24.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.445+0000 7f6b77e00640 1 -- 172.21.15.55:0/582506226 >> v2:172.21.15.106:3300/0 conn(0x7f6b70033cd0 msgr2=0x7f6b70006a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.449+0000 7f6b77e00640 1 --2- 172.21.15.55:0/582506226 >> v2:172.21.15.106:3300/0 conn(0x7f6b70033cd0 0x7f6b70006a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.449+0000 7f6b77e00640 1 -- 172.21.15.55:0/582506226 >> v1:172.21.15.106:6789/0 conn(0x7f6b700df280 legacy=0x7f6b7004fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.449+0000 7f6b77e00640 1 -- 172.21.15.55:0/582506226 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b700543d0 con 0x7f6b70050180 2024-04-02T07:22:24.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.449+0000 7f6b7d600640 1 --2- 172.21.15.55:0/582506226 >> v2:172.21.15.106:3300/0 conn(0x7f6b70033cd0 0x7f6b70006a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:24.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.453+0000 7f6b77e00640 1 --2- 172.21.15.55:0/582506226 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b70050180 0x7f6b70006510 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00a860 tx=0x7f6b6c01c6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7c27055bdb076830 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.453+0000 7f6b77400640 1 -- 172.21.15.55:0/582506226 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c0a5790 con 0x7f6b70050180 2024-04-02T07:22:24.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.453+0000 7f6b77400640 1 -- 172.21.15.55:0/582506226 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6c0a9070 con 0x7f6b70050180 2024-04-02T07:22:24.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.453+0000 7f6b77400640 1 -- 172.21.15.55:0/582506226 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c0a5790 con 0x7f6b70050180 2024-04-02T07:22:24.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.457+0000 7f6b7e000640 1 -- 172.21.15.55:0/582506226 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b70050180 msgr2=0x7f6b70006510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.457+0000 7f6b7e000640 1 --2- 172.21.15.55:0/582506226 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b70050180 0x7f6b70006510 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00a860 tx=0x7f6b6c01c6d0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.457+0000 7f2e32600640 1 Processor -- start 2024-04-02T07:22:24.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.457+0000 7f2e32600640 1 -- start start 2024-04-02T07:22:24.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.457+0000 7f6b7e000640 1 -- 172.21.15.55:0/582506226 shutdown_connections 2024-04-02T07:22:24.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.457+0000 7f6b7e000640 1 --2- 172.21.15.55:0/582506226 >> v2:172.21.15.106:3300/0 conn(0x7f6b70033cd0 0x7f6b70006a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.457+0000 7f6b7e000640 1 --2- 172.21.15.55:0/582506226 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b70050180 0x7f6b70006510 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.457+0000 7f6b7e000640 1 -- 172.21.15.55:0/582506226 >> 172.21.15.55:0/582506226 conn(0x7f6b70009f90 msgr2=0x7f6b7000a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.457+0000 7f6b7e000640 1 -- 172.21.15.55:0/582506226 shutdown_connections 2024-04-02T07:22:24.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.457+0000 7f6b7e000640 1 -- 172.21.15.55:0/582506226 wait complete. 2024-04-02T07:22:24.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.457+0000 7f2e32600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e2c15cda0 0x7f2e2c0ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.457+0000 7f2e32600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0abf30 0x7f2e2c0706a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.457+0000 7f2e32600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e2c070210 con 0x7f2e2c0acc60 2024-04-02T07:22:24.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.457+0000 7f2e32600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e2c0b2580 con 0x7f2e2c15cda0 2024-04-02T07:22:24.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.457+0000 7f2e32600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c15d340 con 0x7f2e2c0abf30 2024-04-02T07:22:24.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f6b7e000640 1 Processor -- start 2024-04-02T07:22:24.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f6b7e000640 1 -- start start 2024-04-02T07:22:24.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f2e31200640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2e2c0acc60 0x7f2e2c0b1e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:53148/0 (socket says 172.21.15.55:53148) 2024-04-02T07:22:24.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f2e31200640 1 -- 172.21.15.55:0/501361961 learned_addr learned my addr 172.21.15.55:0/501361961 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:24.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f2e31c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0abf30 0x7f2e2c0706a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f6b7e000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b70033cd0 0x7f6b70180bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f2e2be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e2c15cda0 0x7f2e2c0ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f6b7e000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b70050180 0x7f6b70039220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f6b7cc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b70033cd0 0x7f6b70180bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f2e2b400640 1 -- 172.21.15.55:0/501361961 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3254346318 0 0) 0x7f2e2c070210 con 0x7f2e2c0acc60 2024-04-02T07:22:24.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f2e2be00640 1 -- 172.21.15.55:0/501361961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0abf30 msgr2=0x7f2e2c0706a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f2e2be00640 1 --2- 172.21.15.55:0/501361961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0abf30 0x7f2e2c0706a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f6b7cc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b70033cd0 0x7f6b70180bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:36402/0 (socket says 172.21.15.55:36402) 2024-04-02T07:22:24.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f2e2be00640 1 -- 172.21.15.55:0/501361961 >> v1:172.21.15.106:6789/0 conn(0x7f2e2c0acc60 legacy=0x7f2e2c0b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f2e2be00640 1 -- 172.21.15.55:0/501361961 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e2c15d620 con 0x7f2e2c15cda0 2024-04-02T07:22:24.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f2e31c00640 1 --2- 172.21.15.55:0/501361961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0abf30 0x7f2e2c0706a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:24.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f6b77e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b70050180 0x7f6b70039220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f6b77e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b70050180 0x7f6b70039220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51722/0 (socket says 172.21.15.55:51722) 2024-04-02T07:22:24.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f6b7e000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b700df280 0x7f6b70039760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7feceda00640 1 Processor -- start 2024-04-02T07:22:24.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7feceda00640 1 -- start start 2024-04-02T07:22:24.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f6b77e00640 1 -- 172.21.15.55:0/93868470 learned_addr learned my addr 172.21.15.55:0/93868470 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f6b7e000640 1 -- 172.21.15.55:0/93868470 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b70181110 con 0x7f6b70050180 2024-04-02T07:22:24.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f6b7e000640 1 -- 172.21.15.55:0/93868470 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b700d9080 con 0x7f6b70033cd0 2024-04-02T07:22:24.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f6b7e000640 1 -- 172.21.15.55:0/93868470 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b700d9360 con 0x7f6b700df280 2024-04-02T07:22:24.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.461+0000 7f6b7d600640 1 --2- 172.21.15.55:0/93868470 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b700df280 0x7f6b70039760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7f6b7d600640 1 -- 172.21.15.55:0/93868470 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b70033cd0 msgr2=0x7f6b70180bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7feceda00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fece80cb880 0x7fece80b06b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7feceda00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fece80cbd10 0x7fece80b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7feceda00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece80cb3f0 con 0x7fece80c9730 2024-04-02T07:22:24.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7fece7400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fece80cbd10 0x7fece80b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7fece7400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fece80cbd10 0x7fece80b0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:48344/0 (socket says 172.21.15.55:48344) 2024-04-02T07:22:24.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7fece7400640 1 -- 172.21.15.55:0/2761217435 learned_addr learned my addr 172.21.15.55:0/2761217435 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7fecdfe00640 1 --2- 172.21.15.55:0/2761217435 >> v2:172.21.15.106:3300/0 conn(0x7fece80cb880 0x7fece80b06b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7feceda00640 1 -- 172.21.15.55:0/2761217435 --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece80ca180 con 0x7fece80cb880 2024-04-02T07:22:24.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7feceda00640 1 -- 172.21.15.55:0/2761217435 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece80cb080 con 0x7fece80cbd10 2024-04-02T07:22:24.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7fece7400640 1 -- 172.21.15.55:0/2761217435 >> v2:172.21.15.106:3300/0 conn(0x7fece80cb880 msgr2=0x7fece80b06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7fece7400640 1 --2- 172.21.15.55:0/2761217435 >> v2:172.21.15.106:3300/0 conn(0x7fece80cb880 0x7fece80b06b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7fece7400640 1 -- 172.21.15.55:0/2761217435 >> v1:172.21.15.106:6789/0 conn(0x7fece80c9730 legacy=0x7fece80897f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7fece7400640 1 -- 172.21.15.55:0/2761217435 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece80ca460 con 0x7fece80cbd10 2024-04-02T07:22:24.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7f6b7d600640 1 --2- 172.21.15.55:0/93868470 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b70033cd0 0x7f6b70180bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7f6b7d600640 1 -- 172.21.15.55:0/93868470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b70050180 msgr2=0x7f6b70039220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7f6b7d600640 1 --2- 172.21.15.55:0/93868470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b70050180 0x7f6b70039220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7f6b7d600640 1 -- 172.21.15.55:0/93868470 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b6400d8c0 con 0x7f6b700df280 2024-04-02T07:22:24.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7f6b7d600640 1 --2- 172.21.15.55:0/93868470 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b700df280 0x7f6b70039760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400ba70 tx=0x7f6b6400bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7f6b74c00640 1 -- 172.21.15.55:0/93868470 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64004220 con 0x7f6b700df280 2024-04-02T07:22:24.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7f6b74c00640 1 -- 172.21.15.55:0/93868470 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b640043a0 con 0x7f6b700df280 2024-04-02T07:22:24.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7f6b74c00640 1 -- 172.21.15.55:0/93868470 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b64004510 con 0x7f6b700df280 2024-04-02T07:22:24.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7f6b7e000640 1 -- 172.21.15.55:0/93868470 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6c00a4c0 con 0x7f6b700df280 2024-04-02T07:22:24.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7f6b7e000640 1 -- 172.21.15.55:0/93868470 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b700d9920 con 0x7f6b700df280 2024-04-02T07:22:24.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7fecdfe00640 1 --2- 172.21.15.55:0/2761217435 >> v2:172.21.15.106:3300/0 conn(0x7fece80cb880 0x7fece80b06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:24.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.465+0000 7f6f42800640 1 Processor -- start 2024-04-02T07:22:24.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7f2e2be00640 1 --2- 172.21.15.55:0/501361961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e2c15cda0 0x7f2e2c0ab9f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2e180097c0 tx=0x7f2e1801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f626c1eefc752ab6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7f6b7e000640 1 -- 172.21.15.55:0/93868470 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b700089b0 con 0x7f6b700df280 2024-04-02T07:22:24.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7f6f42800640 1 -- start start 2024-04-02T07:22:24.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7f2e2b400640 1 -- 172.21.15.55:0/501361961 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e180a4ea0 con 0x7f2e2c15cda0 2024-04-02T07:22:24.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7ff221c00640 1 Processor -- start 2024-04-02T07:22:24.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7ff221c00640 1 -- start start 2024-04-02T07:22:24.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7f6f42800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f3c15c8d0 0x7f6f3c0ce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7f6f42800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6f3c0cfc80 0x7f6f3c0d25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7f6f42800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3c0cd230 con 0x7f6f3c15ccb0 2024-04-02T07:22:24.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7f6f42800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3c0d1710 con 0x7f6f3c15c8d0 2024-04-02T07:22:24.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7f6f42800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3c0cd4d0 con 0x7f6f3c0cfc80 2024-04-02T07:22:24.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7f6f3b400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f3c15c8d0 0x7f6f3c0ce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7f6f3b400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6f3c15c8d0 0x7f6f3c0ce290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51730/0 (socket says 172.21.15.55:51730) 2024-04-02T07:22:24.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7f6f3aa00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6f3c15ccb0 0x7f6f3c0d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:53164/0 (socket says 172.21.15.55:53164) 2024-04-02T07:22:24.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7f6f3aa00640 1 -- 172.21.15.55:0/1549456527 learned_addr learned my addr 172.21.15.55:0/1549456527 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:24.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7f6b74c00640 1 -- 172.21.15.55:0/93868470 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6b64014070 con 0x7f6b700df280 2024-04-02T07:22:24.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7f6b74c00640 1 --2- 172.21.15.55:0/93868470 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6b58066710 0x7f6b58068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7f6b74c00640 1 -- 172.21.15.55:0/93868470 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b64083600 con 0x7f6b700df280 2024-04-02T07:22:24.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7f6b7cc00640 1 --2- 172.21.15.55:0/93868470 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6b58066710 0x7f6b58068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7fece7400640 1 --2- 172.21.15.55:0/2761217435 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fece80cbd10 0x7fece80b0bf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fece00078f0 tx=0x7fece001ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=87671370e2c6af server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7ff221c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff21c15ce70 0x7ff21c0cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7ff221c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21c0c9d10 con 0x7ff21c15ca90 2024-04-02T07:22:24.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7ff221c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21c0ca2b0 con 0x7ff21c0d0210 2024-04-02T07:22:24.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7ff221c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21c0ce170 con 0x7ff21c15ce70 2024-04-02T07:22:24.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff221200640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff21c0d0210 0x7ff21c069d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:53176/0 (socket says 172.21.15.55:53176) 2024-04-02T07:22:24.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff221200640 1 -- 172.21.15.55:0/2017699468 learned_addr learned my addr 172.21.15.55:0/2017699468 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:24.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7f6f3be00640 1 --2- 172.21.15.55:0/1549456527 >> v2:172.21.15.106:3300/0 conn(0x7f6f3c0cfc80 0x7f6f3c0d25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7f6b7cc00640 1 --2- 172.21.15.55:0/93868470 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6b58066710 0x7f6b58068bd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6b78000b70 tx=0x7f6b78072940 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21b400640 1 --2- 172.21.15.55:0/2017699468 >> v2:172.21.15.55:3300/0 conn(0x7ff21c15ce70 0x7ff21c0cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21aa00640 1 -- 172.21.15.55:0/2017699468 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4031508700 0 0) 0x7ff21c0ca2b0 con 0x7ff21c0d0210 2024-04-02T07:22:24.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21aa00640 1 -- 172.21.15.55:0/2017699468 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff200003530 con 0x7ff21c0d0210 2024-04-02T07:22:24.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7f6f3a000640 1 -- 172.21.15.55:0/1549456527 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4094902944 0 0) 0x7f6f3c0cd230 con 0x7f6f3c15ccb0 2024-04-02T07:22:24.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7f6f3a000640 1 -- 172.21.15.55:0/1549456527 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f20003530 con 0x7f6f3c15ccb0 2024-04-02T07:22:24.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7f6f3be00640 1 -- 172.21.15.55:0/1549456527 >> v2:172.21.15.55:3300/0 conn(0x7f6f3c15c8d0 msgr2=0x7f6f3c0ce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7f6f3be00640 1 --2- 172.21.15.55:0/1549456527 >> v2:172.21.15.55:3300/0 conn(0x7f6f3c15c8d0 0x7f6f3c0ce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7f6f3be00640 1 -- 172.21.15.55:0/1549456527 >> v1:172.21.15.106:6789/0 conn(0x7f6f3c15ccb0 legacy=0x7f6f3c0d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7f6f3be00640 1 -- 172.21.15.55:0/1549456527 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c0cd7b0 con 0x7f6f3c0cfc80 2024-04-02T07:22:24.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.469+0000 7f2e2b400640 1 -- 172.21.15.55:0/501361961 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e180a7050 con 0x7f2e2c15cda0 2024-04-02T07:22:24.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7f2e2b400640 1 -- 172.21.15.55:0/501361961 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e180a4ea0 con 0x7f2e2c15cda0 2024-04-02T07:22:24.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7f2e32600640 1 -- 172.21.15.55:0/501361961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e2c15cda0 msgr2=0x7f2e2c0ab9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7f2e32600640 1 --2- 172.21.15.55:0/501361961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e2c15cda0 0x7f2e2c0ab9f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2e180097c0 tx=0x7f2e1801c410 comp rx=0 tx=0).stop 2024-04-02T07:22:24.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7f2e32600640 1 -- 172.21.15.55:0/501361961 shutdown_connections 2024-04-02T07:22:24.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7f2e32600640 1 --2- 172.21.15.55:0/501361961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0abf30 0x7f2e2c0706a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7f2e32600640 1 --2- 172.21.15.55:0/501361961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e2c15cda0 0x7f2e2c0ab9f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7f2e32600640 1 -- 172.21.15.55:0/501361961 >> 172.21.15.55:0/501361961 conn(0x7f2e2c069d90 msgr2=0x7f2e2c06a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21aa00640 1 -- 172.21.15.55:0/2017699468 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2622902413 0 0) 0x7ff200003530 con 0x7ff21c0d0210 2024-04-02T07:22:24.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21aa00640 1 -- 172.21.15.55:0/2017699468 >> v2:172.21.15.55:3300/0 conn(0x7ff21c15ce70 msgr2=0x7ff21c0cbc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21aa00640 1 --2- 172.21.15.55:0/2017699468 >> v2:172.21.15.55:3300/0 conn(0x7ff21c15ce70 0x7ff21c0cbc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21aa00640 1 -- 172.21.15.55:0/2017699468 >> v1:172.21.15.55:6789/0 conn(0x7ff21c15ca90 legacy=0x7ff21c06ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7f2e32600640 1 -- 172.21.15.55:0/501361961 shutdown_connections 2024-04-02T07:22:24.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7f2e32600640 1 -- 172.21.15.55:0/501361961 wait complete. 2024-04-02T07:22:24.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21aa00640 1 -- 172.21.15.55:0/2017699468 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c0cdbb0 con 0x7ff21c0d0210 2024-04-02T07:22:24.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21aa00640 1 -- 172.21.15.55:0/2017699468 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7ff214001a00 con 0x7ff21c0d0210 2024-04-02T07:22:24.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21aa00640 1 -- 172.21.15.55:0/2017699468 >> v1:172.21.15.106:6789/0 conn(0x7ff21c0d0210 legacy=0x7ff21c069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21aa00640 1 --2- 172.21.15.55:0/2017699468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2000039d0 0x7ff200003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21aa00640 1 --2- 172.21.15.55:0/2017699468 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff2000047d0 0x7ff200004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21aa00640 1 --2- 172.21.15.55:0/2017699468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2000051e0 0x7ff20000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21aa00640 1 -- 172.21.15.55:0/2017699468 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c0ce170 con 0x7ff2000051e0 2024-04-02T07:22:24.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21aa00640 1 -- 172.21.15.55:0/2017699468 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20000c0f0 con 0x7ff2000039d0 2024-04-02T07:22:24.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21aa00640 1 -- 172.21.15.55:0/2017699468 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff20000c2b0 con 0x7ff2000047d0 2024-04-02T07:22:24.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff221200640 1 --2- 172.21.15.55:0/2017699468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2000051e0 0x7ff20000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21b400640 1 --2- 172.21.15.55:0/2017699468 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff2000047d0 0x7ff200004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21be00640 1 --2- 172.21.15.55:0/2017699468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2000039d0 0x7ff200003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21b400640 1 -- 172.21.15.55:0/2017699468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2000039d0 msgr2=0x7ff200003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21b400640 1 --2- 172.21.15.55:0/2017699468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2000039d0 0x7ff200003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21b400640 1 -- 172.21.15.55:0/2017699468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2000051e0 msgr2=0x7ff20000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21b400640 1 --2- 172.21.15.55:0/2017699468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2000051e0 0x7ff20000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21b400640 1 -- 172.21.15.55:0/2017699468 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff200003530 con 0x7ff2000047d0 2024-04-02T07:22:24.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff21be00640 1 --2- 172.21.15.55:0/2017699468 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2000039d0 0x7ff200003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:24.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.473+0000 7ff221200640 1 -- 172.21.15.55:0/2017699468 reap_dead start 2024-04-02T07:22:24.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f2e32600640 1 Processor -- start 2024-04-02T07:22:24.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f2e32600640 1 -- start start 2024-04-02T07:22:24.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f6b74c00640 1 -- 172.21.15.55:0/93868470 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6b64050a00 con 0x7f6b700df280 2024-04-02T07:22:24.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7fece6000640 1 -- 172.21.15.55:0/2761217435 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece0007d30 con 0x7fece80cbd10 2024-04-02T07:22:24.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7fece6000640 1 -- 172.21.15.55:0/2761217435 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece0007e90 con 0x7fece80cbd10 2024-04-02T07:22:24.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f2e32600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0abf30 0x7f2e2c1486b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f2e32600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e2c0acc60 0x7f2e2c1526d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f2e31200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0abf30 0x7f2e2c1486b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f2e32600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e2c15cda0 0x7f2e2c148cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f2e31200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0abf30 0x7f2e2c1486b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:48366/0 (socket says 172.21.15.55:48366) 2024-04-02T07:22:24.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f2e31200640 1 -- 172.21.15.55:0/547328075 learned_addr learned my addr 172.21.15.55:0/547328075 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f2e32600640 1 -- 172.21.15.55:0/547328075 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c1581c0 con 0x7f2e2c15cda0 2024-04-02T07:22:24.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f2e32600640 1 -- 172.21.15.55:0/547328075 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c152c10 con 0x7f2e2c0acc60 2024-04-02T07:22:24.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f2e32600640 1 -- 172.21.15.55:0/547328075 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e2c153420 con 0x7f2e2c0abf30 2024-04-02T07:22:24.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f2e2be00640 1 --2- 172.21.15.55:0/547328075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e2c0acc60 0x7f2e2c1526d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7fece6000640 1 -- 172.21.15.55:0/2761217435 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece00a5920 con 0x7fece80cbd10 2024-04-02T07:22:24.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7feceda00640 1 -- 172.21.15.55:0/2761217435 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fece80cbd10 msgr2=0x7fece80b0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7feceda00640 1 --2- 172.21.15.55:0/2761217435 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fece80cbd10 0x7fece80b0bf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fece00078f0 tx=0x7fece001ca30 comp rx=0 tx=0).stop 2024-04-02T07:22:24.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f2e2be00640 1 -- 172.21.15.55:0/547328075 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0abf30 msgr2=0x7f2e2c1486b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f2e31c00640 1 --2- 172.21.15.55:0/547328075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e2c15cda0 0x7f2e2c148cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7feceda00640 1 -- 172.21.15.55:0/2761217435 shutdown_connections 2024-04-02T07:22:24.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7feceda00640 1 --2- 172.21.15.55:0/2761217435 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fece80cbd10 0x7fece80b0bf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f2e2be00640 1 --2- 172.21.15.55:0/547328075 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0abf30 0x7f2e2c1486b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f2e2be00640 1 -- 172.21.15.55:0/547328075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e2c15cda0 msgr2=0x7f2e2c148cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f2e2be00640 1 --2- 172.21.15.55:0/547328075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e2c15cda0 0x7f2e2c148cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f2e2be00640 1 -- 172.21.15.55:0/547328075 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e18009420 con 0x7f2e2c0acc60 2024-04-02T07:22:24.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f2e31c00640 1 --2- 172.21.15.55:0/547328075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e2c15cda0 0x7f2e2c148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:24.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.477+0000 7f2e31200640 1 --2- 172.21.15.55:0/547328075 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0abf30 0x7f2e2c1486b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:24.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7feceda00640 1 --2- 172.21.15.55:0/2761217435 >> v2:172.21.15.106:3300/0 conn(0x7fece80cb880 0x7fece80b06b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7feceda00640 1 -- 172.21.15.55:0/2761217435 >> 172.21.15.55:0/2761217435 conn(0x7fece8065a80 msgr2=0x7fece8065e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7f6f3be00640 1 --2- 172.21.15.55:0/1549456527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f3c0cfc80 0x7f6f3c0d25a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c08a9c0 tx=0x7f6f3401c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d81141e749b9f18a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7feceda00640 1 -- 172.21.15.55:0/2761217435 shutdown_connections 2024-04-02T07:22:24.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7f2e2be00640 1 --2- 172.21.15.55:0/547328075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e2c0acc60 0x7f2e2c1526d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2e180ab000 tx=0x7f2e180191b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7feceda00640 1 -- 172.21.15.55:0/2761217435 wait complete. 2024-04-02T07:22:24.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7f6f3a000640 1 -- 172.21.15.55:0/1549456527 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f340a58c0 con 0x7f6f3c0cfc80 2024-04-02T07:22:24.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7f6f3a000640 1 -- 172.21.15.55:0/1549456527 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f340a5a20 con 0x7f6f3c0cfc80 2024-04-02T07:22:24.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7f6f3a000640 1 -- 172.21.15.55:0/1549456527 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f340a5db0 con 0x7f6f3c0cfc80 2024-04-02T07:22:24.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7ff21b400640 1 --2- 172.21.15.55:0/2017699468 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff2000047d0 0x7ff200004c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00ba00 tx=0x7ff20c01c660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed7db5f9fa794e02 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7f2e28c00640 1 -- 172.21.15.55:0/547328075 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e18003af0 con 0x7f2e2c0acc60 2024-04-02T07:22:24.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7f6f42800640 1 -- 172.21.15.55:0/1549456527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f3c0cfc80 msgr2=0x7f6f3c0d25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7f6f42800640 1 --2- 172.21.15.55:0/1549456527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f3c0cfc80 0x7f6f3c0d25a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c08a9c0 tx=0x7f6f3401c8f0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7ff21aa00640 1 -- 172.21.15.55:0/2017699468 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c0ab670 con 0x7ff2000047d0 2024-04-02T07:22:24.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7ff21aa00640 1 -- 172.21.15.55:0/2017699468 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20c0ab7d0 con 0x7ff2000047d0 2024-04-02T07:22:24.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7ff21aa00640 1 -- 172.21.15.55:0/2017699468 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20c0abb80 con 0x7ff2000047d0 2024-04-02T07:22:24.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7f2e32600640 1 -- 172.21.15.55:0/547328075 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e2c152e60 con 0x7f2e2c0acc60 2024-04-02T07:22:24.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7f2e32600640 1 -- 172.21.15.55:0/547328075 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e2c157e50 con 0x7f2e2c0acc60 2024-04-02T07:22:24.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7f2e28c00640 1 -- 172.21.15.55:0/547328075 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e18003c70 con 0x7f2e2c0acc60 2024-04-02T07:22:24.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7f2e28c00640 1 -- 172.21.15.55:0/547328075 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e180b4430 con 0x7f2e2c0acc60 2024-04-02T07:22:24.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7ff221c00640 1 -- 172.21.15.55:0/2017699468 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff2000047d0 msgr2=0x7ff200004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7ff221c00640 1 --2- 172.21.15.55:0/2017699468 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff2000047d0 0x7ff200004c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff20c00ba00 tx=0x7ff20c01c660 comp rx=0 tx=0).stop 2024-04-02T07:22:24.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7f6f42800640 1 -- 172.21.15.55:0/1549456527 shutdown_connections 2024-04-02T07:22:24.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7f6f42800640 1 --2- 172.21.15.55:0/1549456527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f3c0cfc80 0x7f6f3c0d25a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7f6f42800640 1 --2- 172.21.15.55:0/1549456527 >> v2:172.21.15.55:3300/0 conn(0x7f6f3c15c8d0 0x7f6f3c0ce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7f6f42800640 1 -- 172.21.15.55:0/1549456527 >> 172.21.15.55:0/1549456527 conn(0x7f6f3c09ba30 msgr2=0x7f6f3c089fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7feceda00640 1 Processor -- start 2024-04-02T07:22:24.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7feceda00640 1 -- start start 2024-04-02T07:22:24.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7ff221c00640 1 -- 172.21.15.55:0/2017699468 shutdown_connections 2024-04-02T07:22:24.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7ff221c00640 1 --2- 172.21.15.55:0/2017699468 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff2000047d0 0x7ff200004c50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.481+0000 7ff221c00640 1 -- 172.21.15.55:0/2017699468 >> 172.21.15.55:0/2017699468 conn(0x7ff21c098a10 msgr2=0x7ff21c0cf5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7ff221c00640 1 -- 172.21.15.55:0/2017699468 shutdown_connections 2024-04-02T07:22:24.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7ff221c00640 1 -- 172.21.15.55:0/2017699468 wait complete. 2024-04-02T07:22:24.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7f6f42800640 1 -- 172.21.15.55:0/1549456527 shutdown_connections 2024-04-02T07:22:24.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7f2e32600640 1 -- 172.21.15.55:0/547328075 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e08005260 con 0x7f2e2c0acc60 2024-04-02T07:22:24.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7f6f42800640 1 -- 172.21.15.55:0/1549456527 wait complete. 2024-04-02T07:22:24.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7f2e28c00640 1 -- 172.21.15.55:0/547328075 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2e180b2040 con 0x7f2e2c0acc60 2024-04-02T07:22:24.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7feceda00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fece80c9730 0x7fece815b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7feceda00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fece80cb880 0x7fece81660d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7feceda00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fece80cbd10 0x7fece806c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7fecdfe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fece80cb880 0x7fece81660d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7fecdfe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fece80cb880 0x7fece81660d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:48370/0 (socket says 172.21.15.55:48370) 2024-04-02T07:22:24.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7fecdfe00640 1 -- 172.21.15.55:0/3294310929 learned_addr learned my addr 172.21.15.55:0/3294310929 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7fece7400640 1 --2- 172.21.15.55:0/3294310929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fece80cbd10 0x7fece806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7feceda00640 1 -- 172.21.15.55:0/3294310929 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece815ba60 con 0x7fece80cbd10 2024-04-02T07:22:24.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7feceda00640 1 -- 172.21.15.55:0/3294310929 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece8162cd0 con 0x7fece80c9730 2024-04-02T07:22:24.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7fece6a00640 1 --2- 172.21.15.55:0/3294310929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fece80c9730 0x7fece815b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7ff221c00640 1 Processor -- start 2024-04-02T07:22:24.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7feceda00640 1 -- 172.21.15.55:0/3294310929 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece8162fb0 con 0x7fece80cb880 2024-04-02T07:22:24.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7f2e28c00640 1 --2- 172.21.15.55:0/547328075 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2e0c066760 0x7f2e0c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7f2e28c00640 1 -- 172.21.15.55:0/547328075 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e1811dd10 con 0x7f2e2c0acc60 2024-04-02T07:22:24.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7f2e31200640 1 --2- 172.21.15.55:0/547328075 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2e0c066760 0x7f2e0c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7ff221c00640 1 -- start start 2024-04-02T07:22:24.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7f6f42800640 1 Processor -- start 2024-04-02T07:22:24.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7f1acd000640 1 Processor -- start 2024-04-02T07:22:24.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7f1acd000640 1 -- start start 2024-04-02T07:22:24.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7fecdfe00640 1 -- 172.21.15.55:0/3294310929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fece80c9730 msgr2=0x7fece815b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7fecdfe00640 1 --2- 172.21.15.55:0/3294310929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fece80c9730 0x7fece815b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7fecdfe00640 1 -- 172.21.15.55:0/3294310929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fece80cbd10 msgr2=0x7fece806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.485+0000 7fecdfe00640 1 --2- 172.21.15.55:0/3294310929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fece80cbd10 0x7fece806c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7fecdfe00640 1 -- 172.21.15.55:0/3294310929 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece00075d0 con 0x7fece80cb880 2024-04-02T07:22:24.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f2e31200640 1 --2- 172.21.15.55:0/547328075 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2e0c066760 0x7f2e0c068c20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2e20000f70 tx=0x7f2e20007e20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f6f42800640 1 -- start start 2024-04-02T07:22:24.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7fecdfe00640 1 --2- 172.21.15.55:0/3294310929 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fece80cb880 0x7fece81660d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fecd000e810 tx=0x7fecd000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7fecdea00640 1 -- 172.21.15.55:0/3294310929 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd000c8d0 con 0x7fece80cb880 2024-04-02T07:22:24.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7fecdea00640 1 -- 172.21.15.55:0/3294310929 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd000ca30 con 0x7fece80cb880 2024-04-02T07:22:24.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7fecdea00640 1 -- 172.21.15.55:0/3294310929 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd000cde0 con 0x7fece80cb880 2024-04-02T07:22:24.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7feceda00640 1 -- 172.21.15.55:0/3294310929 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece8163290 con 0x7fece80cb880 2024-04-02T07:22:24.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7feceda00640 1 -- 172.21.15.55:0/3294310929 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece8163850 con 0x7fece80cb880 2024-04-02T07:22:24.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f1acd000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ac80c8510 0x7f1ac80caa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f1acd000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1ac80afa20 0x7f1ac80cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f6f42800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f3c0cfc80 0x7f6f3c14abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7ff221c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2000047d0 0x7ff21c15bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7ff221c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff21c14d9b0 0x7ff21c0c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7ff221c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff21c0c7b70 0x7ff21c0c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7ff221c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c14e430 con 0x7ff2000047d0 2024-04-02T07:22:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7ff221c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c15c2e0 con 0x7ff21c0c7b70 2024-04-02T07:22:24.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7ff221c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21c14de70 con 0x7ff21c14d9b0 2024-04-02T07:22:24.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7ff221200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff21c0c7b70 0x7ff21c0c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f6f42800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f3c15c8d0 0x7f6f3c0cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f6f42800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f3c15ccb0 0x7f6f3c1564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f6f42800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c0cbc60 con 0x7f6f3c15c8d0 2024-04-02T07:22:24.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f6f42800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c15d130 con 0x7f6f3c15ccb0 2024-04-02T07:22:24.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f6f42800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c15d410 con 0x7f6f3c0cfc80 2024-04-02T07:22:24.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f6f3aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f3c15c8d0 0x7f6f3c0cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7ff221200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff21c0c7b70 0x7ff21c0c74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:36452/0 (socket says 172.21.15.55:36452) 2024-04-02T07:22:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7ff221200640 1 -- 172.21.15.55:0/2741922809 learned_addr learned my addr 172.21.15.55:0/2741922809 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7ff21b400640 1 --2- 172.21.15.55:0/2741922809 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff21c14d9b0 0x7ff21c0c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7ff21be00640 1 --2- 172.21.15.55:0/2741922809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2000047d0 0x7ff21c15bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f1acd000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac806c420 con 0x7f1ac815cc90 2024-04-02T07:22:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7feceda00640 1 -- 172.21.15.55:0/3294310929 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece8163a70 con 0x7fece80cb880 2024-04-02T07:22:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7ff221200640 1 -- 172.21.15.55:0/2741922809 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff21c14d9b0 msgr2=0x7ff21c0c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7ff221200640 1 --2- 172.21.15.55:0/2741922809 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff21c14d9b0 0x7ff21c0c6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7ff221200640 1 -- 172.21.15.55:0/2741922809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2000047d0 msgr2=0x7ff21c15bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7ff221200640 1 --2- 172.21.15.55:0/2741922809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2000047d0 0x7ff21c15bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7ff221200640 1 -- 172.21.15.55:0/2741922809 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21c14e150 con 0x7ff21c0c7b70 2024-04-02T07:22:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f6f3be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f3c15ccb0 0x7f6f3c1564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f6f3be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f3c15ccb0 0x7f6f3c1564e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:36466/0 (socket says 172.21.15.55:36466) 2024-04-02T07:22:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f6f3be00640 1 -- 172.21.15.55:0/1678779190 learned_addr learned my addr 172.21.15.55:0/1678779190 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f6f3b400640 1 --2- 172.21.15.55:0/1678779190 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f3c0cfc80 0x7f6f3c14abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f6f3be00640 1 -- 172.21.15.55:0/1678779190 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f3c0cfc80 msgr2=0x7f6f3c14abe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f6f3be00640 1 --2- 172.21.15.55:0/1678779190 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f3c0cfc80 0x7f6f3c14abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f6f3be00640 1 -- 172.21.15.55:0/1678779190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f3c15c8d0 msgr2=0x7f6f3c0cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f6f3be00640 1 --2- 172.21.15.55:0/1678779190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f3c15c8d0 0x7f6f3c0cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f6f3be00640 1 -- 172.21.15.55:0/1678779190 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f34009a70 con 0x7f6f3c15ccb0 2024-04-02T07:22:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7f6f3be00640 1 --2- 172.21.15.55:0/1678779190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f3c15ccb0 0x7f6f3c1564e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6f3401a520 tx=0x7f6f34019690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7f6f33400640 1 -- 172.21.15.55:0/1678779190 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f340ad850 con 0x7f6f3c15ccb0 2024-04-02T07:22:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7f6f33400640 1 -- 172.21.15.55:0/1678779190 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f340ad9b0 con 0x7f6f3c15ccb0 2024-04-02T07:22:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7ff221200640 1 --2- 172.21.15.55:0/2741922809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff21c0c7b70 0x7ff21c0c74a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0cfe10 tx=0x7ff214007bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7ff213e00640 1 -- 172.21.15.55:0/2741922809 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21400ab90 con 0x7ff21c0c7b70 2024-04-02T07:22:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7ff221c00640 1 -- 172.21.15.55:0/2741922809 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff21c0ac970 con 0x7ff21c0c7b70 2024-04-02T07:22:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7ff221c00640 1 -- 172.21.15.55:0/2741922809 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff21c14cac0 con 0x7ff21c0c7b70 2024-04-02T07:22:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7ff213e00640 1 -- 172.21.15.55:0/2741922809 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff21400acf0 con 0x7ff21c0c7b70 2024-04-02T07:22:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7ff213e00640 1 -- 172.21.15.55:0/2741922809 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff21400ab90 con 0x7ff21c0c7b70 2024-04-02T07:22:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f1acd000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac80c89a0 con 0x7f1ac80afa20 2024-04-02T07:22:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f1acd000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac80b1780 con 0x7f1ac80c8510 2024-04-02T07:22:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f1ac6800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1ac80afa20 0x7f1ac80cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f1ac6800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1ac80afa20 0x7f1ac80cafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51812/0 (socket says 172.21.15.55:51812) 2024-04-02T07:22:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f1ac6800640 1 -- 172.21.15.55:0/3734359275 learned_addr learned my addr 172.21.15.55:0/3734359275 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.489+0000 7f1ac5400640 1 --2- 172.21.15.55:0/3734359275 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ac80c8510 0x7f1ac80caa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7f1ac6800640 1 -- 172.21.15.55:0/3734359275 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ac80c8510 msgr2=0x7f1ac80caa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7f1ac6800640 1 --2- 172.21.15.55:0/3734359275 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ac80c8510 0x7f1ac80caa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7f1ac6800640 1 -- 172.21.15.55:0/3734359275 >> v1:172.21.15.106:6789/0 conn(0x7f1ac815cc90 legacy=0x7f1ac806ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7f1ac6800640 1 -- 172.21.15.55:0/3734359275 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac806c700 con 0x7f1ac80afa20 2024-04-02T07:22:24.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7f2e28c00640 1 -- 172.21.15.55:0/547328075 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2e180eeb80 con 0x7f2e2c0acc60 2024-04-02T07:22:24.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7f6f33400640 1 -- 172.21.15.55:0/1678779190 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f340add40 con 0x7f6f3c15ccb0 2024-04-02T07:22:24.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7f6f42800640 1 -- 172.21.15.55:0/1678779190 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3c15d6f0 con 0x7f6f3c15ccb0 2024-04-02T07:22:24.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7f6f42800640 1 -- 172.21.15.55:0/1678779190 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3c0cb950 con 0x7f6f3c15ccb0 2024-04-02T07:22:24.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7f0967c00640 1 Processor -- start 2024-04-02T07:22:24.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7f0967c00640 1 -- start start 2024-04-02T07:22:24.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7fecdea00640 1 -- 172.21.15.55:0/3294310929 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fecd0013410 con 0x7fece80cb880 2024-04-02T07:22:24.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7ff211600640 1 -- 172.21.15.55:0/2741922809 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21c073fa0 con 0x7ff21c0c7b70 2024-04-02T07:22:24.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7f6f30c00640 1 -- 172.21.15.55:0/1678779190 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3c0cfaf0 con 0x7f6f3c15ccb0 2024-04-02T07:22:24.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7f1a09e00640 1 Processor -- start 2024-04-02T07:22:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7f1a09e00640 1 -- start start 2024-04-02T07:22:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7ff213e00640 1 -- 172.21.15.55:0/2741922809 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff21401e460 con 0x7ff21c0c7b70 2024-04-02T07:22:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7fecdea00640 1 --2- 172.21.15.55:0/3294310929 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fecc4066760 0x7fecc4068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.493+0000 7fecdea00640 1 -- 172.21.15.55:0/3294310929 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fecd0083e90 con 0x7fece80cb880 2024-04-02T07:22:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7fece6a00640 1 --2- 172.21.15.55:0/3294310929 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fecc4066760 0x7fecc4068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f0967c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0960069d90 0x7f096006a210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f0967c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f096015c1e0 0x7f096015c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f0967c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f096015d2b0 con 0x7f09600ae9b0 2024-04-02T07:22:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f0967c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f096015df30 con 0x7f096015c1e0 2024-04-02T07:22:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f0967c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096006a750 con 0x7f0960069d90 2024-04-02T07:22:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f095fe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0960069d90 0x7f096006a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f095fe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0960069d90 0x7f096006a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:48394/0 (socket says 172.21.15.55:48394) 2024-04-02T07:22:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f095fe00640 1 -- 172.21.15.55:0/469666817 learned_addr learned my addr 172.21.15.55:0/469666817 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f0965c00640 1 --2- 172.21.15.55:0/469666817 >> v2:172.21.15.55:3300/0 conn(0x7f096015c1e0 0x7f096015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f1a09e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1a0415b480 0x7f1a040cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f1ac6800640 1 --2- 172.21.15.55:0/3734359275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ac80afa20 0x7f1ac80cafc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0009870 tx=0x7f1ac001c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29faa9cb6792155 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f1a09e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a040cf760 0x7f1a040cfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f1a09e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a04165580 con 0x7f1a04146540 2024-04-02T07:22:24.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f1a09e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a040d0120 con 0x7f1a0415b480 2024-04-02T07:22:24.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f1a09e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0415b860 con 0x7f1a040cf760 2024-04-02T07:22:24.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f1a02a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1a0415b480 0x7f1a040cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f1a02a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1a0415b480 0x7f1a040cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:36482/0 (socket says 172.21.15.55:36482) 2024-04-02T07:22:24.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f1a02a00640 1 -- 172.21.15.55:0/4080193274 learned_addr learned my addr 172.21.15.55:0/4080193274 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7fece6a00640 1 --2- 172.21.15.55:0/3294310929 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fecc4066760 0x7fecc4068c20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fecd8007fd0 tx=0x7fecd8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f1a02000640 1 --2- 172.21.15.55:0/4080193274 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a040cf760 0x7f1a040cfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f095fe00640 1 -- 172.21.15.55:0/469666817 >> v2:172.21.15.55:3300/0 conn(0x7f096015c1e0 msgr2=0x7f096015c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f095fe00640 1 --2- 172.21.15.55:0/469666817 >> v2:172.21.15.55:3300/0 conn(0x7f096015c1e0 0x7f096015c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f6f33400640 1 -- 172.21.15.55:0/1678779190 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6f340b4070 con 0x7f6f3c15ccb0 2024-04-02T07:22:24.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f1a02a00640 1 -- 172.21.15.55:0/4080193274 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a040cf760 msgr2=0x7f1a040cfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:24.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f1a02a00640 1 --2- 172.21.15.55:0/4080193274 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a040cf760 0x7f1a040cfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f1a02a00640 1 -- 172.21.15.55:0/4080193274 >> v1:172.21.15.106:6789/0 conn(0x7f1a04146540 legacy=0x7f1a041469d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f1a02a00640 1 -- 172.21.15.55:0/4080193274 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a04164970 con 0x7f1a0415b480 2024-04-02T07:22:24.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f1a02000640 1 --2- 172.21.15.55:0/4080193274 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a040cf760 0x7f1a040cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:24.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7ff213e00640 1 --2- 172.21.15.55:0/2741922809 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff1fc066710 0x7ff1fc068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7ff213e00640 1 -- 172.21.15.55:0/2741922809 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff214084470 con 0x7ff21c0c7b70 2024-04-02T07:22:24.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7fecdea00640 1 -- 172.21.15.55:0/3294310929 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fecd0051290 con 0x7fece80cb880 2024-04-02T07:22:24.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f095fe00640 1 -- 172.21.15.55:0/469666817 >> v1:172.21.15.106:6789/0 conn(0x7f09600ae9b0 legacy=0x7f09600b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.497+0000 7f095fe00640 1 -- 172.21.15.55:0/469666817 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096015d590 con 0x7f0960069d90 2024-04-02T07:22:24.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7f6f33400640 1 --2- 172.21.15.55:0/1678779190 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6f1c066760 0x7f6f1c068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7f6f33400640 1 -- 172.21.15.55:0/1678779190 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f3411ed10 con 0x7f6f3c15ccb0 2024-04-02T07:22:24.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7f6f3b400640 1 --2- 172.21.15.55:0/1678779190 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6f1c066760 0x7f6f1c068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7ff21be00640 1 --2- 172.21.15.55:0/2741922809 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff1fc066710 0x7ff1fc068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7f1ac4a00640 1 -- 172.21.15.55:0/3734359275 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac00ab5f0 con 0x7f1ac80afa20 2024-04-02T07:22:24.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7f1ac4a00640 1 -- 172.21.15.55:0/3734359275 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac00ab750 con 0x7f1ac80afa20 2024-04-02T07:22:24.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7f1ac4a00640 1 -- 172.21.15.55:0/3734359275 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac00abae0 con 0x7f1ac80afa20 2024-04-02T07:22:24.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7ff21be00640 1 --2- 172.21.15.55:0/2741922809 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff1fc066710 0x7ff1fc068bd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff21c067340 tx=0x7ff208009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7f6f3b400640 1 --2- 172.21.15.55:0/1678779190 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6f1c066760 0x7f6f1c068c20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6f28006fd0 tx=0x7f6f28008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7f1acd000640 1 -- 172.21.15.55:0/3734359275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ac80afa20 msgr2=0x7f1ac80cafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7f1acd000640 1 --2- 172.21.15.55:0/3734359275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ac80afa20 0x7f1ac80cafc0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0009870 tx=0x7f1ac001c580 comp rx=0 tx=0).stop 2024-04-02T07:22:24.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7f1acd000640 1 -- 172.21.15.55:0/3734359275 shutdown_connections 2024-04-02T07:22:24.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7f1acd000640 1 --2- 172.21.15.55:0/3734359275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ac80afa20 0x7f1ac80cafc0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7f1acd000640 1 --2- 172.21.15.55:0/3734359275 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ac80c8510 0x7f1ac80caa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7f1acd000640 1 -- 172.21.15.55:0/3734359275 >> 172.21.15.55:0/3734359275 conn(0x7f1ac8065a80 msgr2=0x7f1ac8065e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7f095fe00640 1 --2- 172.21.15.55:0/469666817 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0960069d90 0x7f096006a210 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0950009870 tx=0x7f095001c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8eb3313ff2025a6b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7f1acd000640 1 -- 172.21.15.55:0/3734359275 shutdown_connections 2024-04-02T07:22:24.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7f1acd000640 1 -- 172.21.15.55:0/3734359275 wait complete. 2024-04-02T07:22:24.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7f095f400640 1 -- 172.21.15.55:0/469666817 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09500ac620 con 0x7f0960069d90 2024-04-02T07:22:24.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7ff213e00640 1 -- 172.21.15.55:0/2741922809 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff214051740 con 0x7ff21c0c7b70 2024-04-02T07:22:24.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7f095f400640 1 -- 172.21.15.55:0/469666817 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09500ac780 con 0x7f0960069d90 2024-04-02T07:22:24.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.501+0000 7f095f400640 1 -- 172.21.15.55:0/469666817 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09500ac620 con 0x7f0960069d90 2024-04-02T07:22:24.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f0967c00640 1 -- 172.21.15.55:0/469666817 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0960069d90 msgr2=0x7f096006a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f0967c00640 1 --2- 172.21.15.55:0/469666817 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0960069d90 0x7f096006a210 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f0950009870 tx=0x7f095001c4f0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1a02a00640 1 --2- 172.21.15.55:0/4080193274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a0415b480 0x7f1a040cd050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009e50 tx=0x7f19fc01ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c5160cd1410ebab server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f0967c00640 1 -- 172.21.15.55:0/469666817 shutdown_connections 2024-04-02T07:22:24.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f0967c00640 1 --2- 172.21.15.55:0/469666817 >> v2:172.21.15.55:3300/0 conn(0x7f096015c1e0 0x7f096015c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f0967c00640 1 --2- 172.21.15.55:0/469666817 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0960069d90 0x7f096006a210 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f0967c00640 1 -- 172.21.15.55:0/469666817 >> 172.21.15.55:0/469666817 conn(0x7f0960098a10 msgr2=0x7f09600b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1acd000640 1 Processor -- start 2024-04-02T07:22:24.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f0967c00640 1 -- 172.21.15.55:0/469666817 shutdown_connections 2024-04-02T07:22:24.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f0967c00640 1 -- 172.21.15.55:0/469666817 wait complete. 2024-04-02T07:22:24.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1acd000640 1 -- start start 2024-04-02T07:22:24.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1acd000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ac80afa20 0x7f1ac815e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1acd000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ac815cc90 0x7f1ac8143f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1ac5e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ac80afa20 0x7f1ac815e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f6f33400640 1 -- 172.21.15.55:0/1678779190 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6f340ec060 con 0x7f6f3c15ccb0 2024-04-02T07:22:24.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1acd000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ac80cd8b0 0x7f1ac80cdd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1acd000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac80ce280 con 0x7f1ac80afa20 2024-04-02T07:22:24.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1ac5e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ac80afa20 0x7f1ac815e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51828/0 (socket says 172.21.15.55:51828) 2024-04-02T07:22:24.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1ac5e00640 1 -- 172.21.15.55:0/976573712 learned_addr learned my addr 172.21.15.55:0/976573712 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1acd000640 1 -- 172.21.15.55:0/976573712 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac815e680 con 0x7f1ac815cc90 2024-04-02T07:22:24.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1acd000640 1 -- 172.21.15.55:0/976573712 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac815d380 con 0x7f1ac80cd8b0 2024-04-02T07:22:24.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1a01600640 1 -- 172.21.15.55:0/4080193274 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0a58d0 con 0x7f1a0415b480 2024-04-02T07:22:24.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1ac6800640 1 --2- 172.21.15.55:0/976573712 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ac80cd8b0 0x7f1ac80cdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1ac5400640 1 --2- 172.21.15.55:0/976573712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ac815cc90 0x7f1ac8143f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1ac5e00640 1 -- 172.21.15.55:0/976573712 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ac80cd8b0 msgr2=0x7f1ac80cdd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1ac5e00640 1 --2- 172.21.15.55:0/976573712 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ac80cd8b0 0x7f1ac80cdd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1ac5e00640 1 -- 172.21.15.55:0/976573712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ac815cc90 msgr2=0x7f1ac8143f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1ac5e00640 1 --2- 172.21.15.55:0/976573712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ac815cc90 0x7f1ac8143f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1ac5e00640 1 -- 172.21.15.55:0/976573712 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac00094d0 con 0x7f1ac80afa20 2024-04-02T07:22:24.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.509+0000 7f1ac5e00640 1 --2- 172.21.15.55:0/976573712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ac80afa20 0x7f1ac815e140 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1ab400c3c0 tx=0x7f1ab400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1a01600640 1 -- 172.21.15.55:0/4080193274 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19fc0a5a30 con 0x7f1a0415b480 2024-04-02T07:22:24.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1a01600640 1 -- 172.21.15.55:0/4080193274 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0a5dc0 con 0x7f1a0415b480 2024-04-02T07:22:24.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1a09e00640 1 -- 172.21.15.55:0/4080193274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a0415b480 msgr2=0x7f1a040cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.505+0000 7f1a09e00640 1 --2- 172.21.15.55:0/4080193274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a0415b480 0x7f1a040cd050 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009e50 tx=0x7f19fc01ca00 comp rx=0 tx=0).stop 2024-04-02T07:22:24.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.509+0000 7f1abe000640 1 -- 172.21.15.55:0/976573712 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab40052d0 con 0x7f1ac80afa20 2024-04-02T07:22:24.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.509+0000 7f1acd000640 1 -- 172.21.15.55:0/976573712 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac815d660 con 0x7f1ac80afa20 2024-04-02T07:22:24.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.509+0000 7f1acd000640 1 -- 172.21.15.55:0/976573712 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac815dc20 con 0x7f1ac80afa20 2024-04-02T07:22:24.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.509+0000 7f0967c00640 1 Processor -- start 2024-04-02T07:22:24.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.509+0000 7f1abe000640 1 -- 172.21.15.55:0/976573712 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ab4005430 con 0x7f1ac80afa20 2024-04-02T07:22:24.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.509+0000 7f1abe000640 1 -- 172.21.15.55:0/976573712 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ab4003840 con 0x7f1ac80afa20 2024-04-02T07:22:24.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.509+0000 7f0967c00640 1 -- start start 2024-04-02T07:22:24.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.509+0000 7f1abe000640 1 -- 172.21.15.55:0/976573712 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1ab40039a0 con 0x7f1ac80afa20 2024-04-02T07:22:24.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f0967c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0960069d90 0x7f096015aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f0967c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09600ae9b0 0x7f0960158250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f0967c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f096015c1e0 0x7f096006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f1a09e00640 1 -- 172.21.15.55:0/4080193274 shutdown_connections 2024-04-02T07:22:24.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f1a09e00640 1 --2- 172.21.15.55:0/4080193274 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a040cf760 0x7f1a040cfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f1a09e00640 1 --2- 172.21.15.55:0/4080193274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a0415b480 0x7f1a040cd050 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f1a09e00640 1 -- 172.21.15.55:0/4080193274 >> 172.21.15.55:0/4080193274 conn(0x7f1a04065e80 msgr2=0x7f1a04066290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f0967c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0960158da0 con 0x7f09600ae9b0 2024-04-02T07:22:24.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f0967c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09600c7520 con 0x7f0960069d90 2024-04-02T07:22:24.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f0967c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09600c7240 con 0x7f096015c1e0 2024-04-02T07:22:24.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f0965c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f096015c1e0 0x7f096006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f0965c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f096015c1e0 0x7f096006d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:48418/0 (socket says 172.21.15.55:48418) 2024-04-02T07:22:24.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f0965c00640 1 -- 172.21.15.55:0/3007880305 learned_addr learned my addr 172.21.15.55:0/3007880305 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f095fe00640 1 --2- 172.21.15.55:0/3007880305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09600ae9b0 0x7f0960158250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f0965c00640 1 -- 172.21.15.55:0/3007880305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0960069d90 msgr2=0x7f096015aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f0965200640 1 --2- 172.21.15.55:0/3007880305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0960069d90 0x7f096015aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f0965c00640 1 --2- 172.21.15.55:0/3007880305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0960069d90 0x7f096015aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f0965c00640 1 -- 172.21.15.55:0/3007880305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09600ae9b0 msgr2=0x7f0960158250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f0965c00640 1 --2- 172.21.15.55:0/3007880305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09600ae9b0 0x7f0960158250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f0965c00640 1 -- 172.21.15.55:0/3007880305 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09500094d0 con 0x7f096015c1e0 2024-04-02T07:22:24.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f0965c00640 1 --2- 172.21.15.55:0/3007880305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f096015c1e0 0x7f096006d390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f094c00d560 tx=0x7f094c00da20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f0965200640 1 --2- 172.21.15.55:0/3007880305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0960069d90 0x7f096015aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:24.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f095cc00640 1 -- 172.21.15.55:0/3007880305 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c0125f0 con 0x7f096015c1e0 2024-04-02T07:22:24.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f095cc00640 1 -- 172.21.15.55:0/3007880305 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f094c012750 con 0x7f096015c1e0 2024-04-02T07:22:24.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f095cc00640 1 -- 172.21.15.55:0/3007880305 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f094c012b00 con 0x7f096015c1e0 2024-04-02T07:22:24.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f1abe000640 1 --2- 172.21.15.55:0/976573712 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1aa8066690 0x7f1aa8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f1abe000640 1 -- 172.21.15.55:0/976573712 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1ab4083810 con 0x7f1ac80afa20 2024-04-02T07:22:24.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f1ac5400640 1 --2- 172.21.15.55:0/976573712 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1aa8066690 0x7f1aa8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f1acd000640 1 -- 172.21.15.55:0/976573712 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aa0005260 con 0x7f1ac80afa20 2024-04-02T07:22:24.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f1a09e00640 1 -- 172.21.15.55:0/4080193274 shutdown_connections 2024-04-02T07:22:24.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f1a09e00640 1 -- 172.21.15.55:0/4080193274 wait complete. 2024-04-02T07:22:24.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f1a09e00640 1 Processor -- start 2024-04-02T07:22:24.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.513+0000 7f1a09e00640 1 -- start start 2024-04-02T07:22:24.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.517+0000 7f0967c00640 1 -- 172.21.15.55:0/3007880305 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f096015a410 con 0x7f096015c1e0 2024-04-02T07:22:24.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.517+0000 7f0967c00640 1 -- 172.21.15.55:0/3007880305 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f096015a9d0 con 0x7f096015c1e0 2024-04-02T07:22:24.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.517+0000 7f1ac5400640 1 --2- 172.21.15.55:0/976573712 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1aa8066690 0x7f1aa8068b50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1ac815b6e0 tx=0x7f1ab8011040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.517+0000 7f1a09e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a040cf760 0x7f1a0415a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.517+0000 7f1a09e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a04146540 0x7f1a04162b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.517+0000 7f1a02a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a040cf760 0x7f1a0415a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.517+0000 7f1a02a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a040cf760 0x7f1a0415a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:36510/0 (socket says 172.21.15.55:36510) 2024-04-02T07:22:24.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.517+0000 7f1a02000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a04146540 0x7f1a04162b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.517+0000 7f1a02000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a04146540 0x7f1a04162b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51846/0 (socket says 172.21.15.55:51846) 2024-04-02T07:22:24.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.517+0000 7f1a02a00640 1 -- 172.21.15.55:0/2998652119 learned_addr learned my addr 172.21.15.55:0/2998652119 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:24.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.517+0000 7f1a09e00640 1 --2- 172.21.15.55:0/2998652119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a0415b480 0x7f1a041630d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.517+0000 7f1a09e00640 1 -- 172.21.15.55:0/2998652119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0415ad50 con 0x7f1a04146540 2024-04-02T07:22:24.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.517+0000 7f1abe000640 1 -- 172.21.15.55:0/976573712 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f1ab4017080 con 0x7f1ac80afa20 2024-04-02T07:22:24.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.517+0000 7f1a03400640 1 --2- 172.21.15.55:0/2998652119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a0415b480 0x7f1a041630d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.521+0000 7f0967c00640 1 -- 172.21.15.55:0/3007880305 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f096015abc0 con 0x7f096015c1e0 2024-04-02T07:22:24.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.521+0000 7f1a09e00640 1 -- 172.21.15.55:0/2998652119 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a040b3f70 con 0x7f1a040cf760 2024-04-02T07:22:24.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.521+0000 7f1a09e00640 1 -- 172.21.15.55:0/2998652119 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a040b33d0 con 0x7f1a0415b480 2024-04-02T07:22:24.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.521+0000 7f1a03400640 1 -- 172.21.15.55:0/2998652119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a040cf760 msgr2=0x7f1a0415a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.521+0000 7f1a03400640 1 --2- 172.21.15.55:0/2998652119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a040cf760 0x7f1a0415a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.521+0000 7f1a03400640 1 -- 172.21.15.55:0/2998652119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a04146540 msgr2=0x7f1a04162b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.521+0000 7f1a03400640 1 --2- 172.21.15.55:0/2998652119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a04146540 0x7f1a04162b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.521+0000 7f1a03400640 1 -- 172.21.15.55:0/2998652119 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f4009420 con 0x7f1a0415b480 2024-04-02T07:22:24.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.521+0000 7f1a03400640 1 --2- 172.21.15.55:0/2998652119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a0415b480 0x7f1a041630d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f19f000c3f0 tx=0x7f19f000c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.521+0000 7f095cc00640 1 -- 172.21.15.55:0/3007880305 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f094c012c60 con 0x7f096015c1e0 2024-04-02T07:22:24.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.521+0000 7f095cc00640 1 --2- 172.21.15.55:0/3007880305 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0940066690 0x7f0940068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.521+0000 7f095cc00640 1 -- 172.21.15.55:0/3007880305 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f094c0850f0 con 0x7f096015c1e0 2024-04-02T07:22:24.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.525+0000 7f0965200640 1 --2- 172.21.15.55:0/3007880305 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0940066690 0x7f0940068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.525+0000 7f0965200640 1 --2- 172.21.15.55:0/3007880305 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0940066690 0x7f0940068b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0958007fd0 tx=0x7f0958009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.525+0000 7f19fb400640 1 -- 172.21.15.55:0/2998652119 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f00052d0 con 0x7f1a0415b480 2024-04-02T07:22:24.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.525+0000 7f19fb400640 1 -- 172.21.15.55:0/2998652119 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f0005430 con 0x7f1a0415b480 2024-04-02T07:22:24.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.525+0000 7f19fb400640 1 -- 172.21.15.55:0/2998652119 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f0007260 con 0x7f1a0415b480 2024-04-02T07:22:24.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.525+0000 7f1a09e00640 1 -- 172.21.15.55:0/2998652119 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19fc009b30 con 0x7f1a0415b480 2024-04-02T07:22:24.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.525+0000 7f1a09e00640 1 -- 172.21.15.55:0/2998652119 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a040b3920 con 0x7f1a0415b480 2024-04-02T07:22:24.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.525+0000 7f095cc00640 1 -- 172.21.15.55:0/3007880305 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f094c0524d0 con 0x7f096015c1e0 2024-04-02T07:22:24.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.529+0000 7f19fb400640 1 -- 172.21.15.55:0/2998652119 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f19f00073c0 con 0x7f1a0415b480 2024-04-02T07:22:24.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.529+0000 7f19fb400640 1 --2- 172.21.15.55:0/2998652119 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f19e40666e0 0x7f19e4068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:24.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.529+0000 7f19fb400640 1 -- 172.21.15.55:0/2998652119 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19f00543f0 con 0x7f1a0415b480 2024-04-02T07:22:24.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.529+0000 7f1a02a00640 1 --2- 172.21.15.55:0/2998652119 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f19e40666e0 0x7f19e4068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:24.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.533+0000 7f1a09e00640 1 -- 172.21.15.55:0/2998652119 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a040673a0 con 0x7f1a0415b480 2024-04-02T07:22:24.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.537+0000 7f1a02a00640 1 --2- 172.21.15.55:0/2998652119 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f19e40666e0 0x7f19e4068ba0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009e50 tx=0x7f19fc0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:24.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.537+0000 7f19fb400640 1 -- 172.21.15.55:0/2998652119 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f19f0050ec0 con 0x7f1a0415b480 2024-04-02T07:22:24.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.817+0000 7f6b7e000640 1 -- 172.21.15.55:0/93868470 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f6b700d94a0 con 0x7f6b700df280 2024-04-02T07:22:24.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.821+0000 7f6b74c00640 1 -- 172.21.15.55:0/93868470 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6b700d94a0 con 0x7f6b700df280 2024-04-02T07:22:24.824 INFO:teuthology.orchestra.run.smithi055.stdout:55834574852 2024-04-02T07:22:24.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.821+0000 7f6b7e000640 1 -- 172.21.15.55:0/93868470 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6b58066710 msgr2=0x7f6b58068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.821+0000 7f6b7e000640 1 --2- 172.21.15.55:0/93868470 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6b58066710 0x7f6b58068bd0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6b78000b70 tx=0x7f6b78072940 comp rx=0 tx=0).stop 2024-04-02T07:22:24.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.825+0000 7f6b7e000640 1 -- 172.21.15.55:0/93868470 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b700df280 msgr2=0x7f6b70039760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.825+0000 7f6b7e000640 1 --2- 172.21.15.55:0/93868470 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b700df280 0x7f6b70039760 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6b6400ba70 tx=0x7f6b6400bf30 comp rx=0 tx=0).stop 2024-04-02T07:22:24.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.825+0000 7f6b7e000640 1 -- 172.21.15.55:0/93868470 shutdown_connections 2024-04-02T07:22:24.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.825+0000 7f6b7e000640 1 --2- 172.21.15.55:0/93868470 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b700df280 0x7f6b70039760 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.825+0000 7f6b7e000640 1 --2- 172.21.15.55:0/93868470 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b70050180 0x7f6b70039220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.825+0000 7f6b7e000640 1 --2- 172.21.15.55:0/93868470 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6b58066710 0x7f6b58068bd0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.825+0000 7f6b7e000640 1 --2- 172.21.15.55:0/93868470 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b70033cd0 0x7f6b70180bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.825+0000 7f6b7e000640 1 -- 172.21.15.55:0/93868470 >> 172.21.15.55:0/93868470 conn(0x7f6b70009f90 msgr2=0x7f6b7000a370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.829+0000 7f6b7e000640 1 -- 172.21.15.55:0/93868470 shutdown_connections 2024-04-02T07:22:24.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.829+0000 7f6b7e000640 1 -- 172.21.15.55:0/93868470 wait complete. 2024-04-02T07:22:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.837+0000 7f2e32600640 1 -- 172.21.15.55:0/547328075 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f2e08005510 con 0x7f2e2c0acc60 2024-04-02T07:22:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.837+0000 7feceda00640 1 -- 172.21.15.55:0/3294310929 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fece8066c90 con 0x7fece80cb880 2024-04-02T07:22:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.837+0000 7f2e28c00640 1 -- 172.21.15.55:0/547328075 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2e180b0090 con 0x7f2e2c0acc60 2024-04-02T07:22:24.841 INFO:teuthology.orchestra.run.smithi055.stdout:55834574855 2024-04-02T07:22:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.837+0000 7fecdea00640 1 -- 172.21.15.55:0/3294310929 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fecd00548b0 con 0x7fece80cb880 2024-04-02T07:22:24.842 INFO:teuthology.orchestra.run.smithi055.stdout:55834574853 2024-04-02T07:22:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7f2e32600640 1 -- 172.21.15.55:0/547328075 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2e0c066760 msgr2=0x7f2e0c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7f2e32600640 1 --2- 172.21.15.55:0/547328075 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2e0c066760 0x7f2e0c068c20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2e20000f70 tx=0x7f2e20007e20 comp rx=0 tx=0).stop 2024-04-02T07:22:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7f2e32600640 1 -- 172.21.15.55:0/547328075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e2c0acc60 msgr2=0x7f2e2c1526d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7f2e32600640 1 --2- 172.21.15.55:0/547328075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e2c0acc60 0x7f2e2c1526d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2e180ab000 tx=0x7f2e180191b0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7f2e32600640 1 -- 172.21.15.55:0/547328075 shutdown_connections 2024-04-02T07:22:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7f2e32600640 1 --2- 172.21.15.55:0/547328075 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e2c15cda0 0x7f2e2c148cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7f2e32600640 1 --2- 172.21.15.55:0/547328075 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2e0c066760 0x7f2e0c068c20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7f2e32600640 1 --2- 172.21.15.55:0/547328075 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e2c0acc60 0x7f2e2c1526d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7f2e32600640 1 --2- 172.21.15.55:0/547328075 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e2c0abf30 0x7f2e2c1486b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7f2e32600640 1 -- 172.21.15.55:0/547328075 >> 172.21.15.55:0/547328075 conn(0x7f2e2c069d90 msgr2=0x7f2e2c15ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7f2e32600640 1 -- 172.21.15.55:0/547328075 shutdown_connections 2024-04-02T07:22:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7f2e32600640 1 -- 172.21.15.55:0/547328075 wait complete. 2024-04-02T07:22:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7feceda00640 1 -- 172.21.15.55:0/3294310929 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fecc4066760 msgr2=0x7fecc4068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7feceda00640 1 --2- 172.21.15.55:0/3294310929 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fecc4066760 0x7fecc4068c20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fecd8007fd0 tx=0x7fecd8009040 comp rx=0 tx=0).stop 2024-04-02T07:22:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7feceda00640 1 -- 172.21.15.55:0/3294310929 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fece80cb880 msgr2=0x7fece81660d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7feceda00640 1 --2- 172.21.15.55:0/3294310929 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fece80cb880 0x7fece81660d0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fecd000e810 tx=0x7fecd000ecd0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7feceda00640 1 -- 172.21.15.55:0/3294310929 shutdown_connections 2024-04-02T07:22:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7feceda00640 1 --2- 172.21.15.55:0/3294310929 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fece80cbd10 0x7fece806c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7feceda00640 1 --2- 172.21.15.55:0/3294310929 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fece80cb880 0x7fece81660d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7feceda00640 1 --2- 172.21.15.55:0/3294310929 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fecc4066760 0x7fecc4068c20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7feceda00640 1 --2- 172.21.15.55:0/3294310929 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fece80c9730 0x7fece815b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.841+0000 7feceda00640 1 -- 172.21.15.55:0/3294310929 >> 172.21.15.55:0/3294310929 conn(0x7fece8065a80 msgr2=0x7fece80cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.845+0000 7feceda00640 1 -- 172.21.15.55:0/3294310929 shutdown_connections 2024-04-02T07:22:24.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.845+0000 7feceda00640 1 -- 172.21.15.55:0/3294310929 wait complete. 2024-04-02T07:22:24.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.849+0000 7ff211600640 1 -- 172.21.15.55:0/2741922809 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff21c0ace20 con 0x7ff21c0c7b70 2024-04-02T07:22:24.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.853+0000 7f6f30c00640 1 -- 172.21.15.55:0/1678779190 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6f3c0cfaf0 con 0x7f6f3c15ccb0 2024-04-02T07:22:24.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.857+0000 7ff213e00640 1 -- 172.21.15.55:0/2741922809 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff21400ae60 con 0x7ff21c0c7b70 2024-04-02T07:22:24.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.857+0000 7f6f33400640 1 -- 172.21.15.55:0/1678779190 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6f340b2020 con 0x7f6f3c15ccb0 2024-04-02T07:22:24.863 INFO:teuthology.orchestra.run.smithi055.stdout:55834574853 2024-04-02T07:22:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.857+0000 7ff211600640 1 -- 172.21.15.55:0/2741922809 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff1fc066710 msgr2=0x7ff1fc068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.857+0000 7ff211600640 1 --2- 172.21.15.55:0/2741922809 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff1fc066710 0x7ff1fc068bd0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff21c067340 tx=0x7ff208009040 comp rx=0 tx=0).stop 2024-04-02T07:22:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.857+0000 7ff211600640 1 -- 172.21.15.55:0/2741922809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff21c0c7b70 msgr2=0x7ff21c0c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.857+0000 7ff211600640 1 --2- 172.21.15.55:0/2741922809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff21c0c7b70 0x7ff21c0c74a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff21c0cfe10 tx=0x7ff214007bd0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.864 INFO:teuthology.orchestra.run.smithi055.stdout:55834574853 2024-04-02T07:22:24.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7ff211600640 1 -- 172.21.15.55:0/2741922809 shutdown_connections 2024-04-02T07:22:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7f1acd000640 1 -- 172.21.15.55:0/976573712 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f1aa0005510 con 0x7f1ac80afa20 2024-04-02T07:22:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7ff211600640 1 --2- 172.21.15.55:0/2741922809 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff1fc066710 0x7ff1fc068bd0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7ff211600640 1 --2- 172.21.15.55:0/2741922809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff21c0c7b70 0x7ff21c0c74a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7ff211600640 1 --2- 172.21.15.55:0/2741922809 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff21c14d9b0 0x7ff21c0c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7ff211600640 1 --2- 172.21.15.55:0/2741922809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2000047d0 0x7ff21c15bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7ff211600640 1 -- 172.21.15.55:0/2741922809 >> 172.21.15.55:0/2741922809 conn(0x7ff21c098a10 msgr2=0x7ff21c0b0910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.1 2024-04-02T07:22:24.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7f1abe000640 1 -- 172.21.15.55:0/976573712 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1ab4050a50 con 0x7f1ac80afa20 2024-04-02T07:22:24.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7ff211600640 1 -- 172.21.15.55:0/2741922809 shutdown_connections 2024-04-02T07:22:24.869 INFO:teuthology.orchestra.run.smithi055.stdout:55834574853 2024-04-02T07:22:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7f6f30c00640 1 -- 172.21.15.55:0/1678779190 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6f1c066760 msgr2=0x7f6f1c068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7f6f30c00640 1 --2- 172.21.15.55:0/1678779190 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6f1c066760 0x7f6f1c068c20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6f28006fd0 tx=0x7f6f28008040 comp rx=0 tx=0).stop 2024-04-02T07:22:24.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7f6f30c00640 1 -- 172.21.15.55:0/1678779190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f3c15ccb0 msgr2=0x7f6f3c1564e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7ff211600640 1 -- 172.21.15.55:0/2741922809 wait complete. 2024-04-02T07:22:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7f6f30c00640 1 --2- 172.21.15.55:0/1678779190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f3c15ccb0 0x7f6f3c1564e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6f3401a520 tx=0x7f6f34019690 comp rx=0 tx=0).stop 2024-04-02T07:22:24.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7f6f30c00640 1 -- 172.21.15.55:0/1678779190 shutdown_connections 2024-04-02T07:22:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7f0967c00640 1 -- 172.21.15.55:0/3007880305 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0960066c90 con 0x7f096015c1e0 2024-04-02T07:22:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7f6f30c00640 1 --2- 172.21.15.55:0/1678779190 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6f1c066760 0x7f6f1c068c20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7f6f30c00640 1 --2- 172.21.15.55:0/1678779190 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f3c15ccb0 0x7f6f3c1564e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7f6f30c00640 1 --2- 172.21.15.55:0/1678779190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f3c15c8d0 0x7f6f3c0cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7f6f30c00640 1 --2- 172.21.15.55:0/1678779190 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f3c0cfc80 0x7f6f3c14abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7f6f30c00640 1 -- 172.21.15.55:0/1678779190 >> 172.21.15.55:0/1678779190 conn(0x7f6f3c09ba30 msgr2=0x7f6f3c0ce190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.861+0000 7f095cc00640 1 -- 172.21.15.55:0/3007880305 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f094c055af0 con 0x7f096015c1e0 2024-04-02T07:22:24.874 INFO:teuthology.orchestra.run.smithi055.stdout:55834574852 2024-04-02T07:22:24.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f6f30c00640 1 -- 172.21.15.55:0/1678779190 shutdown_connections 2024-04-02T07:22:24.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f6f30c00640 1 -- 172.21.15.55:0/1678779190 wait complete. 2024-04-02T07:22:24.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f1acd000640 1 -- 172.21.15.55:0/976573712 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1aa8066690 msgr2=0x7f1aa8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f1acd000640 1 --2- 172.21.15.55:0/976573712 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1aa8066690 0x7f1aa8068b50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f1ac815b6e0 tx=0x7f1ab8011040 comp rx=0 tx=0).stop 2024-04-02T07:22:24.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f1acd000640 1 -- 172.21.15.55:0/976573712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ac80afa20 msgr2=0x7f1ac815e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f1acd000640 1 --2- 172.21.15.55:0/976573712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ac80afa20 0x7f1ac815e140 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1ab400c3c0 tx=0x7f1ab400c880 comp rx=0 tx=0).stop 2024-04-02T07:22:24.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f0967c00640 1 -- 172.21.15.55:0/3007880305 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0940066690 msgr2=0x7f0940068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f0967c00640 1 --2- 172.21.15.55:0/3007880305 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0940066690 0x7f0940068b50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0958007fd0 tx=0x7f0958009040 comp rx=0 tx=0).stop 2024-04-02T07:22:24.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f0967c00640 1 -- 172.21.15.55:0/3007880305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f096015c1e0 msgr2=0x7f096006d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f0967c00640 1 --2- 172.21.15.55:0/3007880305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f096015c1e0 0x7f096006d390 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f094c00d560 tx=0x7f094c00da20 comp rx=0 tx=0).stop 2024-04-02T07:22:24.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f0967c00640 1 -- 172.21.15.55:0/3007880305 shutdown_connections 2024-04-02T07:22:24.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f0967c00640 1 --2- 172.21.15.55:0/3007880305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f096015c1e0 0x7f096006d390 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f0967c00640 1 --2- 172.21.15.55:0/3007880305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09600ae9b0 0x7f0960158250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f0967c00640 1 --2- 172.21.15.55:0/3007880305 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0940066690 0x7f0940068b50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f0967c00640 1 --2- 172.21.15.55:0/3007880305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0960069d90 0x7f096015aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f0967c00640 1 -- 172.21.15.55:0/3007880305 >> 172.21.15.55:0/3007880305 conn(0x7f0960098a10 msgr2=0x7f09600ac350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f1acd000640 1 -- 172.21.15.55:0/976573712 shutdown_connections 2024-04-02T07:22:24.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f1acd000640 1 --2- 172.21.15.55:0/976573712 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ac80cd8b0 0x7f1ac80cdd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f1acd000640 1 --2- 172.21.15.55:0/976573712 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1aa8066690 0x7f1aa8068b50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f1acd000640 1 --2- 172.21.15.55:0/976573712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ac815cc90 0x7f1ac8143f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f1acd000640 1 --2- 172.21.15.55:0/976573712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ac80afa20 0x7f1ac815e140 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1ab400c3c0 tx=0x7f1ab400c880 comp rx=0 tx=0).stop 2024-04-02T07:22:24.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f1acd000640 1 -- 172.21.15.55:0/976573712 >> 172.21.15.55:0/976573712 conn(0x7f1ac8065a80 msgr2=0x7f1ac80b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f1acd000640 1 -- 172.21.15.55:0/976573712 shutdown_connections 2024-04-02T07:22:24.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f1acd000640 1 -- 172.21.15.55:0/976573712 wait complete. 2024-04-02T07:22:24.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.865+0000 7f0967c00640 1 -- 172.21.15.55:0/3007880305 shutdown_connections 2024-04-02T07:22:24.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.869+0000 7f0967c00640 1 -- 172.21.15.55:0/3007880305 wait complete. 2024-04-02T07:22:24.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.873+0000 7f1a09e00640 1 -- 172.21.15.55:0/2998652119 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1a040b40b0 con 0x7f1a0415b480 2024-04-02T07:22:24.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.873+0000 7f19fb400640 1 -- 172.21.15.55:0/2998652119 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f19f0051060 con 0x7f1a0415b480 2024-04-02T07:22:24.881 INFO:teuthology.orchestra.run.smithi055.stdout:55834574853 2024-04-02T07:22:24.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.877+0000 7f1a09e00640 1 -- 172.21.15.55:0/2998652119 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f19e40666e0 msgr2=0x7f19e4068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.877+0000 7f1a09e00640 1 --2- 172.21.15.55:0/2998652119 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f19e40666e0 0x7f19e4068ba0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f19fc009e50 tx=0x7f19fc0a7070 comp rx=0 tx=0).stop 2024-04-02T07:22:24.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.877+0000 7f1a09e00640 1 -- 172.21.15.55:0/2998652119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a0415b480 msgr2=0x7f1a041630d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:24.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.877+0000 7f1a09e00640 1 --2- 172.21.15.55:0/2998652119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a0415b480 0x7f1a041630d0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f19f000c3f0 tx=0x7f19f000c8b0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.877+0000 7f1a09e00640 1 -- 172.21.15.55:0/2998652119 shutdown_connections 2024-04-02T07:22:24.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.877+0000 7f1a09e00640 1 --2- 172.21.15.55:0/2998652119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a0415b480 0x7f1a041630d0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.877+0000 7f1a09e00640 1 --2- 172.21.15.55:0/2998652119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a04146540 0x7f1a04162b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.877+0000 7f1a09e00640 1 --2- 172.21.15.55:0/2998652119 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f19e40666e0 0x7f19e4068ba0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.877+0000 7f1a09e00640 1 --2- 172.21.15.55:0/2998652119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a040cf760 0x7f1a0415a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:24.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.877+0000 7f1a09e00640 1 -- 172.21.15.55:0/2998652119 >> 172.21.15.55:0/2998652119 conn(0x7f1a04065e80 msgr2=0x7f1a04163760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:24.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.881+0000 7f1a09e00640 1 -- 172.21.15.55:0/2998652119 shutdown_connections 2024-04-02T07:22:24.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:24.881+0000 7f1a09e00640 1 -- 172.21.15.55:0/2998652119 wait complete. 2024-04-02T07:22:24.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2024-04-02T07:22:24.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2024-04-02T07:22:24.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-04-02T07:22:24.904 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.2 2024-04-02T07:22:24.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2024-04-02T07:22:24.913 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2024-04-02T07:22:24.918 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.3 2024-04-02T07:22:25.870 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-02T07:22:25.887 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-02T07:22:25.889 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-02T07:22:25.904 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-02T07:22:25.905 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-02T07:22:25.907 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-02T07:22:25.913 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-02T07:22:25.918 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-02T07:22:26.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.097+0000 7f3859200640 1 Processor -- start 2024-04-02T07:22:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.097+0000 7f3859200640 1 -- start start 2024-04-02T07:22:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.097+0000 7f3859200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f384c0e30a0 0x7f384c054200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.097+0000 7f3859200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384c037b00 con 0x7f384c0e77f0 2024-04-02T07:22:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.097+0000 7f3859200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f384c04fb10 con 0x7f384c0e6c00 2024-04-02T07:22:26.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.097+0000 7f3859200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f384c04f770 con 0x7f384c0e30a0 2024-04-02T07:22:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.101+0000 7f3852a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f384c0e77f0 0x7f384c04f060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49120/0 (socket says 172.21.15.55:49120) 2024-04-02T07:22:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.101+0000 7f3852a00640 1 -- 172.21.15.55:0/524369537 learned_addr learned my addr 172.21.15.55:0/524369537 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.105+0000 7f3853400640 1 --2- 172.21.15.55:0/524369537 >> v2:172.21.15.55:3300/0 conn(0x7f384c0e30a0 0x7f384c054200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.105+0000 7f3852000640 1 -- 172.21.15.55:0/524369537 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4081695477 0 0) 0x7f384c037b00 con 0x7f384c0e77f0 2024-04-02T07:22:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.105+0000 7f3852000640 1 -- 172.21.15.55:0/524369537 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f383c003530 con 0x7f384c0e77f0 2024-04-02T07:22:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.105+0000 7f3852000640 1 -- 172.21.15.55:0/524369537 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2014387972 0 0) 0x7f384c04fb10 con 0x7f384c0e6c00 2024-04-02T07:22:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.105+0000 7f3852000640 1 -- 172.21.15.55:0/524369537 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f384c037b00 con 0x7f384c0e6c00 2024-04-02T07:22:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.105+0000 7f3853400640 1 -- 172.21.15.55:0/524369537 >> v1:172.21.15.106:6789/0 conn(0x7f384c0e6c00 legacy=0x7f384c006880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.105+0000 7f3853400640 1 -- 172.21.15.55:0/524369537 >> v1:172.21.15.55:6789/0 conn(0x7f384c0e77f0 legacy=0x7f384c04f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.105+0000 7f3853400640 1 -- 172.21.15.55:0/524369537 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f384c03a420 con 0x7f384c0e30a0 2024-04-02T07:22:26.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.109+0000 7f3853400640 1 --2- 172.21.15.55:0/524369537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f384c0e30a0 0x7f384c054200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f38400097c0 tx=0x7f384001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bc1f8e2486f3db1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.109+0000 7f3852000640 1 -- 172.21.15.55:0/524369537 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38400a8990 con 0x7f384c0e30a0 2024-04-02T07:22:26.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.109+0000 7f3852000640 1 -- 172.21.15.55:0/524369537 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38400a8af0 con 0x7f384c0e30a0 2024-04-02T07:22:26.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.109+0000 7f3852000640 1 -- 172.21.15.55:0/524369537 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38400a8e80 con 0x7f384c0e30a0 2024-04-02T07:22:26.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.109+0000 7f3859200640 1 -- 172.21.15.55:0/524369537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f384c0e30a0 msgr2=0x7f384c054200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.109+0000 7f3859200640 1 --2- 172.21.15.55:0/524369537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f384c0e30a0 0x7f384c054200 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f38400097c0 tx=0x7f384001ec90 comp rx=0 tx=0).stop 2024-04-02T07:22:26.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.109+0000 7f3859200640 1 -- 172.21.15.55:0/524369537 shutdown_connections 2024-04-02T07:22:26.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.113+0000 7f3859200640 1 --2- 172.21.15.55:0/524369537 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f384c0e30a0 0x7f384c054200 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.113+0000 7f3859200640 1 -- 172.21.15.55:0/524369537 >> 172.21.15.55:0/524369537 conn(0x7f384c009f90 msgr2=0x7f384c00a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:26.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.113+0000 7f3859200640 1 -- 172.21.15.55:0/524369537 shutdown_connections 2024-04-02T07:22:26.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.113+0000 7f3859200640 1 -- 172.21.15.55:0/524369537 wait complete. 2024-04-02T07:22:26.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.113+0000 7f3859200640 1 Processor -- start 2024-04-02T07:22:26.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.117+0000 7f3859200640 1 -- start start 2024-04-02T07:22:26.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.117+0000 7f3859200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f384c0e30a0 0x7f384c036130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.117+0000 7f3859200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f384c0e6c00 0x7f384c049c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.117+0000 7f3859200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f384c0e77f0 0x7f384c04d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.117+0000 7f3859200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c04c110 con 0x7f384c0e30a0 2024-04-02T07:22:26.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.117+0000 7f3859200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f384c04c3f0 con 0x7f384c0e6c00 2024-04-02T07:22:26.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.117+0000 7f3859200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f384c04c6d0 con 0x7f384c0e77f0 2024-04-02T07:22:26.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.117+0000 7f3853e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f384c0e77f0 0x7f384c04d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.117+0000 7f3852a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f384c0e6c00 0x7f384c049c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.117+0000 7f3853e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f384c0e77f0 0x7f384c04d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:34694/0 (socket says 172.21.15.55:34694) 2024-04-02T07:22:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.117+0000 7f3852a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f384c0e6c00 0x7f384c049c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:49284/0 (socket says 172.21.15.55:49284) 2024-04-02T07:22:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.117+0000 7f3853e00640 1 -- 172.21.15.55:0/3479064309 learned_addr learned my addr 172.21.15.55:0/3479064309 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.121+0000 7f3853400640 1 --2- 172.21.15.55:0/3479064309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f384c0e30a0 0x7f384c036130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.121+0000 7f3853e00640 1 -- 172.21.15.55:0/3479064309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f384c0e6c00 msgr2=0x7f384c049c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.121+0000 7f3853e00640 1 --2- 172.21.15.55:0/3479064309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f384c0e6c00 0x7f384c049c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.121+0000 7f3853e00640 1 -- 172.21.15.55:0/3479064309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f384c0e30a0 msgr2=0x7f384c036130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.121+0000 7f3853e00640 1 --2- 172.21.15.55:0/3479064309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f384c0e30a0 0x7f384c036130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.121+0000 7f3853e00640 1 -- 172.21.15.55:0/3479064309 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3840009420 con 0x7f384c0e77f0 2024-04-02T07:22:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.121+0000 7f3853400640 1 --2- 172.21.15.55:0/3479064309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f384c0e30a0 0x7f384c036130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:26.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.121+0000 7f3853e00640 1 --2- 172.21.15.55:0/3479064309 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f384c0e77f0 0x7f384c04d1b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f384800c340 tx=0x7f384800c800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.121+0000 7f3847400640 1 -- 172.21.15.55:0/3479064309 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38480052d0 con 0x7f384c0e77f0 2024-04-02T07:22:26.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.121+0000 7f3847400640 1 -- 172.21.15.55:0/3479064309 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3848005450 con 0x7f384c0e77f0 2024-04-02T07:22:26.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.121+0000 7f3847400640 1 -- 172.21.15.55:0/3479064309 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3848003840 con 0x7f384c0e77f0 2024-04-02T07:22:26.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.121+0000 7f3859200640 1 -- 172.21.15.55:0/3479064309 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f384c04c9b0 con 0x7f384c0e77f0 2024-04-02T07:22:26.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.121+0000 7f3859200640 1 -- 172.21.15.55:0/3479064309 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f384c036670 con 0x7f384c0e77f0 2024-04-02T07:22:26.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.121+0000 7f3844c00640 1 -- 172.21.15.55:0/3479064309 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f384c0089b0 con 0x7f384c0e77f0 2024-04-02T07:22:26.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.125+0000 7f3847400640 1 -- 172.21.15.55:0/3479064309 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f38480039a0 con 0x7f384c0e77f0 2024-04-02T07:22:26.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.125+0000 7f3847400640 1 --2- 172.21.15.55:0/3479064309 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3834066690 0x7f3834068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.125+0000 7f3847400640 1 -- 172.21.15.55:0/3479064309 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3848054700 con 0x7f384c0e77f0 2024-04-02T07:22:26.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.125+0000 7f3853400640 1 --2- 172.21.15.55:0/3479064309 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3834066690 0x7f3834068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.129+0000 7f3853400640 1 --2- 172.21.15.55:0/3479064309 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3834066690 0x7f3834068b50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f38400b2000 tx=0x7f38400aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.133+0000 7f3847400640 1 -- 172.21.15.55:0/3479064309 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f38480511d0 con 0x7f384c0e77f0 2024-04-02T07:22:26.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.141+0000 7f970fe00640 1 Processor -- start 2024-04-02T07:22:26.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.141+0000 7f970fe00640 1 -- start start 2024-04-02T07:22:26.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.145+0000 7f970fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9708158b70 0x7f97080cb160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.145+0000 7f970d400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9708158b70 0x7f97080cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.145+0000 7f970d400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9708158b70 0x7f97080cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60828/0 (socket says 172.21.15.55:60828) 2024-04-02T07:22:26.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.145+0000 7f970fe00640 1 -- 172.21.15.55:0/3991476900 --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97080caa30 con 0x7f9708158f50 2024-04-02T07:22:26.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.145+0000 7f970d400640 1 -- 172.21.15.55:0/3991476900 learned_addr learned my addr 172.21.15.55:0/3991476900 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:26.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.145+0000 7f970fe00640 1 -- 172.21.15.55:0/3991476900 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97080c9690 con 0x7f97080afae0 2024-04-02T07:22:26.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.145+0000 7f970fe00640 1 -- 172.21.15.55:0/3991476900 --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970815d720 con 0x7f9708158b70 2024-04-02T07:22:26.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.149+0000 7f970d400640 1 -- 172.21.15.55:0/3991476900 >> v1:172.21.15.106:6789/0 conn(0x7f97080afae0 legacy=0x7f970815d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.149+0000 7f970d400640 1 -- 172.21.15.55:0/3991476900 >> v1:172.21.15.55:6789/0 conn(0x7f9708158f50 legacy=0x7f970815c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:26.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.149+0000 7f970d400640 1 -- 172.21.15.55:0/3991476900 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97080c90d0 con 0x7f9708158b70 2024-04-02T07:22:26.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.153+0000 7f970d400640 1 --2- 172.21.15.55:0/3991476900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9708158b70 0x7f97080cb160 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9700009e50 tx=0x7f970001c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=268575826db66a09 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.153+0000 7f9707e00640 1 -- 172.21.15.55:0/3991476900 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97000a5720 con 0x7f9708158b70 2024-04-02T07:22:26.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.153+0000 7f9707e00640 1 -- 172.21.15.55:0/3991476900 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97000a5880 con 0x7f9708158b70 2024-04-02T07:22:26.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.153+0000 7f9707e00640 1 -- 172.21.15.55:0/3991476900 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97000a5c10 con 0x7f9708158b70 2024-04-02T07:22:26.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.153+0000 7f970fe00640 1 -- 172.21.15.55:0/3991476900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9708158b70 msgr2=0x7f97080cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.153+0000 7f970fe00640 1 --2- 172.21.15.55:0/3991476900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9708158b70 0x7f97080cb160 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9700009e50 tx=0x7f970001c880 comp rx=0 tx=0).stop 2024-04-02T07:22:26.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.157+0000 7f970fe00640 1 -- 172.21.15.55:0/3991476900 shutdown_connections 2024-04-02T07:22:26.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.157+0000 7f970fe00640 1 --2- 172.21.15.55:0/3991476900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9708158b70 0x7f97080cb160 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.157+0000 7f970fe00640 1 -- 172.21.15.55:0/3991476900 >> 172.21.15.55:0/3991476900 conn(0x7f9708065a80 msgr2=0x7f9708065e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:26.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.161+0000 7f970fe00640 1 -- 172.21.15.55:0/3991476900 shutdown_connections 2024-04-02T07:22:26.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.161+0000 7f970fe00640 1 -- 172.21.15.55:0/3991476900 wait complete. 2024-04-02T07:22:26.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.161+0000 7f970fe00640 1 Processor -- start 2024-04-02T07:22:26.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.161+0000 7f970fe00640 1 -- start start 2024-04-02T07:22:26.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.161+0000 7efdd9800640 1 Processor -- start 2024-04-02T07:22:26.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f970fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97080afae0 0x7f97081403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f970fe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9708158b70 0x7f970814cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f970fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9708158f50 0x7f9708142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f970fe00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97081427f0 con 0x7f9708158f50 2024-04-02T07:22:26.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f970fe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970813f6e0 con 0x7f97080afae0 2024-04-02T07:22:26.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f970fe00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9708142510 con 0x7f9708158b70 2024-04-02T07:22:26.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f970ca00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9708158b70 0x7f970814cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f970ca00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9708158b70 0x7f970814cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:34706/0 (socket says 172.21.15.55:34706) 2024-04-02T07:22:26.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f970ca00640 1 -- 172.21.15.55:0/3847681802 learned_addr learned my addr 172.21.15.55:0/3847681802 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:26.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f970d400640 1 --2- 172.21.15.55:0/3847681802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97080afae0 0x7f97081403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.161+0000 7efdd9800640 1 -- start start 2024-04-02T07:22:26.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f970de00640 1 --2- 172.21.15.55:0/3847681802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9708158f50 0x7f9708142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f970ca00640 1 -- 172.21.15.55:0/3847681802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97080afae0 msgr2=0x7f97081403d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f970ca00640 1 --2- 172.21.15.55:0/3847681802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97080afae0 0x7f97081403d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f970ca00640 1 -- 172.21.15.55:0/3847681802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9708158f50 msgr2=0x7f9708142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f970ca00640 1 --2- 172.21.15.55:0/3847681802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9708158f50 0x7f9708142b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f970ca00640 1 -- 172.21.15.55:0/3847681802 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9700009b30 con 0x7f9708158b70 2024-04-02T07:22:26.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f970ca00640 1 --2- 172.21.15.55:0/3847681802 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9708158b70 0x7f970814cbf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f96f400b460 tx=0x7f96f400b920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7efdd9800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efdd40b00d0 0x7efdd40cbde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7efdd9800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd40ae6e0 con 0x7efdd4070a70 2024-04-02T07:22:26.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7efdd9800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdd40ae9c0 con 0x7efdd4160c70 2024-04-02T07:22:26.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7efdd9800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdd40aeca0 con 0x7efdd40b00d0 2024-04-02T07:22:26.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f9705600640 1 -- 172.21.15.55:0/3847681802 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f401c440 con 0x7f9708158b70 2024-04-02T07:22:26.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f9705600640 1 -- 172.21.15.55:0/3847681802 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f401c5c0 con 0x7f9708158b70 2024-04-02T07:22:26.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f9705600640 1 -- 172.21.15.55:0/3847681802 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96f401c970 con 0x7f9708158b70 2024-04-02T07:22:26.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f970fe00640 1 -- 172.21.15.55:0/3847681802 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970813f8f0 con 0x7f9708158b70 2024-04-02T07:22:26.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7efdd3e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7efdd4160c70 0x7efdd4070360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:38220/0 (socket says 172.21.15.55:38220) 2024-04-02T07:22:26.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7efdd3e00640 1 -- 172.21.15.55:0/264952764 learned_addr learned my addr 172.21.15.55:0/264952764 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:26.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7f970fe00640 1 -- 172.21.15.55:0/3847681802 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970813feb0 con 0x7f9708158b70 2024-04-02T07:22:26.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7efdd2a00640 1 -- 172.21.15.55:0/264952764 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3208478337 0 0) 0x7efdd40ae9c0 con 0x7efdd4160c70 2024-04-02T07:22:26.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7efdd2a00640 1 -- 172.21.15.55:0/264952764 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdb8003530 con 0x7efdd4160c70 2024-04-02T07:22:26.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7efdd2a00640 1 -- 172.21.15.55:0/264952764 <== mon.1 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1908907938 0 0) 0x7efdb8003530 con 0x7efdd4160c70 2024-04-02T07:22:26.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7efdd2a00640 1 -- 172.21.15.55:0/264952764 >> v2:172.21.15.106:3300/0 conn(0x7efdd40b00d0 msgr2=0x7efdd40cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:26.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7efdd2a00640 1 --2- 172.21.15.55:0/264952764 >> v2:172.21.15.106:3300/0 conn(0x7efdd40b00d0 0x7efdd40cbde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7efdd2a00640 1 -- 172.21.15.55:0/264952764 >> v1:172.21.15.55:6789/0 conn(0x7efdd4070a70 legacy=0x7efdd40cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7efdd2a00640 1 -- 172.21.15.55:0/264952764 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd40aef80 con 0x7efdd4160c70 2024-04-02T07:22:26.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.165+0000 7efdd2a00640 1 -- 172.21.15.55:0/264952764 <== mon.1 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7efdc0001680 con 0x7efdd4160c70 2024-04-02T07:22:26.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7efdd2a00640 1 -- 172.21.15.55:0/264952764 >> v1:172.21.15.106:6789/0 conn(0x7efdd4160c70 legacy=0x7efdd4070360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7efdd2a00640 1 --2- 172.21.15.55:0/264952764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdb8003980 0x7efdb8003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7efdd2a00640 1 --2- 172.21.15.55:0/264952764 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb80047d0 0x7efdb8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7efdd2a00640 1 --2- 172.21.15.55:0/264952764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdb80052b0 0x7efdb800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7efdd2a00640 1 -- 172.21.15.55:0/264952764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd40aeca0 con 0x7efdb80052b0 2024-04-02T07:22:26.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7efdd2a00640 1 -- 172.21.15.55:0/264952764 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb800c180 con 0x7efdb8003980 2024-04-02T07:22:26.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7efdd2a00640 1 -- 172.21.15.55:0/264952764 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb800c340 con 0x7efdb80047d0 2024-04-02T07:22:26.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7efdd3e00640 1 --2- 172.21.15.55:0/264952764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdb8003980 0x7efdb8003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7efdd3400640 1 --2- 172.21.15.55:0/264952764 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb80047d0 0x7efdb8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7efdd3e00640 1 -- 172.21.15.55:0/264952764 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb80047d0 msgr2=0x7efdb8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:26.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7efdd3e00640 1 --2- 172.21.15.55:0/264952764 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb80047d0 0x7efdb8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7efdd3e00640 1 -- 172.21.15.55:0/264952764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdb80052b0 msgr2=0x7efdb800b990 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-02T07:22:26.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7efdd3e00640 1 --2- 172.21.15.55:0/264952764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdb80052b0 0x7efdb800b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7efdd3e00640 1 -- 172.21.15.55:0/264952764 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb8003530 con 0x7efdb8003980 2024-04-02T07:22:26.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7efdd8e00640 1 -- 172.21.15.55:0/264952764 reap_dead start 2024-04-02T07:22:26.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7f970fe00640 1 -- 172.21.15.55:0/3847681802 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97081400d0 con 0x7f9708158b70 2024-04-02T07:22:26.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7fbd27000640 1 Processor -- start 2024-04-02T07:22:26.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7f9705600640 1 -- 172.21.15.55:0/3847681802 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f96f401cad0 con 0x7f9708158b70 2024-04-02T07:22:26.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7fbd27000640 1 -- start start 2024-04-02T07:22:26.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7fbd27000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbd2015c9f0 0x7fbd200cd930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7fbd27000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbd200cf2f0 0x7fbd200cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7fbd27000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd200cfca0 con 0x7fbd200b5be0 2024-04-02T07:22:26.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7fbd27000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd200ce1f0 con 0x7fbd2015c9f0 2024-04-02T07:22:26.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7fbd27000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd200d1390 con 0x7fbd200cf2f0 2024-04-02T07:22:26.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7f9705600640 1 --2- 172.21.15.55:0/3847681802 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f96e80666e0 0x7f96e8068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7f9705600640 1 -- 172.21.15.55:0/3847681802 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96f408bf00 con 0x7f9708158b70 2024-04-02T07:22:26.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.169+0000 7f970d400640 1 --2- 172.21.15.55:0/3847681802 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f96e80666e0 0x7f96e8068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7fbd1f400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fbd200b5be0 0x7fbd201610e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:38230/0 (socket says 172.21.15.55:38230) 2024-04-02T07:22:26.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7fbd1f400640 1 -- 172.21.15.55:0/2959098818 learned_addr learned my addr 172.21.15.55:0/2959098818 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:26.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7fbd1fe00640 1 --2- 172.21.15.55:0/2959098818 >> v2:172.21.15.55:3300/0 conn(0x7fbd2015c9f0 0x7fbd200cd930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7fbd25000640 1 --2- 172.21.15.55:0/2959098818 >> v2:172.21.15.106:3300/0 conn(0x7fbd200cf2f0 0x7fbd200cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7fc1a0c00640 1 Processor -- start 2024-04-02T07:22:26.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7fc1a0c00640 1 -- start start 2024-04-02T07:22:26.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7fbd25000640 1 -- 172.21.15.55:0/2959098818 >> v2:172.21.15.55:3300/0 conn(0x7fbd2015c9f0 msgr2=0x7fbd200cd930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:26.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7fbd25000640 1 --2- 172.21.15.55:0/2959098818 >> v2:172.21.15.55:3300/0 conn(0x7fbd2015c9f0 0x7fbd200cd930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7fbd25000640 1 -- 172.21.15.55:0/2959098818 >> v1:172.21.15.106:6789/0 conn(0x7fbd200b5be0 legacy=0x7fbd201610e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7fbd25000640 1 -- 172.21.15.55:0/2959098818 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd200cdf10 con 0x7fbd200cf2f0 2024-04-02T07:22:26.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7f970d400640 1 --2- 172.21.15.55:0/3847681802 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f96e80666e0 0x7f96e8068ba0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f97000ae000 tx=0x7f97000a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7efdd3e00640 1 --2- 172.21.15.55:0/264952764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdb8003980 0x7efdb8003d60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efdc000c160 tx=0x7efdc001f2f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=818857e13663da73 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7fc1a0c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc19400aae0 0x7fc1940df2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7fc1a0c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc194033d00 0x7fc19404faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7fc1a0c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc194054120 con 0x7fc19404ffe0 2024-04-02T07:22:26.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7fc1a0c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc194050470 con 0x7fc19400aae0 2024-04-02T07:22:26.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7fc1a0c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc194038090 con 0x7fc194033d00 2024-04-02T07:22:26.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7fc199e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc19400aae0 0x7fc1940df2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7fc19a800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc19404ffe0 0x7fc1940e2d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49148/0 (socket says 172.21.15.55:49148) 2024-04-02T07:22:26.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7fc19a800640 1 -- 172.21.15.55:0/392694306 learned_addr learned my addr 172.21.15.55:0/392694306 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:26.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7efdd2a00640 1 -- 172.21.15.55:0/264952764 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc0005ae0 con 0x7efdb8003980 2024-04-02T07:22:26.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7efdd2a00640 1 -- 172.21.15.55:0/264952764 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc00ab070 con 0x7efdb8003980 2024-04-02T07:22:26.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7efdd2a00640 1 -- 172.21.15.55:0/264952764 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc0007070 con 0x7efdb8003980 2024-04-02T07:22:26.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7fc199e00640 1 -- 172.21.15.55:0/392694306 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc194033d00 msgr2=0x7fc19404faa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-02T07:22:26.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7efdd9800640 1 -- 172.21.15.55:0/264952764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdb8003980 msgr2=0x7efdb8003d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7efdd9800640 1 --2- 172.21.15.55:0/264952764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdb8003980 0x7efdb8003d60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efdc000c160 tx=0x7efdc001f2f0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7fc198a00640 1 -- 172.21.15.55:0/392694306 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 97877097 0 0) 0x7fc194054120 con 0x7fc19404ffe0 2024-04-02T07:22:26.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7efdd9800640 1 -- 172.21.15.55:0/264952764 shutdown_connections 2024-04-02T07:22:26.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7efdd9800640 1 --2- 172.21.15.55:0/264952764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdb8003980 0x7efdb8003d60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7efdd9800640 1 -- 172.21.15.55:0/264952764 >> 172.21.15.55:0/264952764 conn(0x7efdd4065e80 msgr2=0x7efdd4069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:26.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.173+0000 7f9705600640 1 -- 172.21.15.55:0/3847681802 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f96f4059390 con 0x7f9708158b70 2024-04-02T07:22:26.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7efdd9800640 1 -- 172.21.15.55:0/264952764 shutdown_connections 2024-04-02T07:22:26.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7efdd9800640 1 -- 172.21.15.55:0/264952764 wait complete. 2024-04-02T07:22:26.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7fb749600640 1 Processor -- start 2024-04-02T07:22:26.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7fb749600640 1 -- start start 2024-04-02T07:22:26.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7fbd25000640 1 --2- 172.21.15.55:0/2959098818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd200cf2f0 0x7fbd200cf760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd200b8580 tx=0x7fbd1801c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58bdf7755c8c0a17 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7fc199e00640 1 --2- 172.21.15.55:0/392694306 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc194033d00 0x7fc19404faa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7fc199e00640 1 -- 172.21.15.55:0/392694306 >> v1:172.21.15.55:6789/0 conn(0x7fc19404ffe0 legacy=0x7fc1940e2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7fc199e00640 1 -- 172.21.15.55:0/392694306 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc194054400 con 0x7fc19400aae0 2024-04-02T07:22:26.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7fbd1ea00640 1 -- 172.21.15.55:0/2959098818 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd180a59c0 con 0x7fbd200cf2f0 2024-04-02T07:22:26.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7fbd1ea00640 1 -- 172.21.15.55:0/2959098818 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd180a5b20 con 0x7fbd200cf2f0 2024-04-02T07:22:26.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.177+0000 7fbd1ea00640 1 -- 172.21.15.55:0/2959098818 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd180ad440 con 0x7fbd200cf2f0 2024-04-02T07:22:26.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fbd27000640 1 -- 172.21.15.55:0/2959098818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd200cf2f0 msgr2=0x7fbd200cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fbd27000640 1 --2- 172.21.15.55:0/2959098818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd200cf2f0 0x7fbd200cf760 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fbd200b8580 tx=0x7fbd1801c940 comp rx=0 tx=0).stop 2024-04-02T07:22:26.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7efdd9800640 1 Processor -- start 2024-04-02T07:22:26.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fb749600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb744161620 0x7fb7440c8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fb749600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb7440cb100 0x7fb7440cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fb749600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7440cba90 con 0x7fb74415eb10 2024-04-02T07:22:26.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fb749600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb744070310 con 0x7fb7440cb100 2024-04-02T07:22:26.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fb749600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb744161b70 con 0x7fb744161620 2024-04-02T07:22:26.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7efdd9800640 1 -- start start 2024-04-02T07:22:26.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fb742000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb744161620 0x7fb7440c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fb742000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb744161620 0x7fb7440c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:34722/0 (socket says 172.21.15.55:34722) 2024-04-02T07:22:26.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fb742000640 1 -- 172.21.15.55:0/3319782291 learned_addr learned my addr 172.21.15.55:0/3319782291 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:26.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fc199e00640 1 --2- 172.21.15.55:0/392694306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc19400aae0 0x7fc1940df2b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc1880097c0 tx=0x7fc18801c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b4386e3cf8cbc0f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7f7644200640 1 Processor -- start 2024-04-02T07:22:26.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7efdd9800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb8003980 0x7efdd40cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7efdd9800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdd4154d40 0x7efdd40cd210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fc198a00640 1 -- 172.21.15.55:0/392694306 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1880ad640 con 0x7fc19400aae0 2024-04-02T07:22:26.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fc198a00640 1 -- 172.21.15.55:0/392694306 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1880ad7a0 con 0x7fc19400aae0 2024-04-02T07:22:26.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fc198a00640 1 -- 172.21.15.55:0/392694306 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1880adb30 con 0x7fc19400aae0 2024-04-02T07:22:26.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7efdd9800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdd4162440 0x7efdd41628c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7efdd9800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4155e00 con 0x7efdd4154d40 2024-04-02T07:22:26.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7efdd9800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4163450 con 0x7efdd4162440 2024-04-02T07:22:26.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7efdd9800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdd4163170 con 0x7efdb8003980 2024-04-02T07:22:26.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fb742000640 1 -- 172.21.15.55:0/3319782291 >> v2:172.21.15.55:3300/0 conn(0x7fb7440cb100 msgr2=0x7fb7440cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:26.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fb742000640 1 --2- 172.21.15.55:0/3319782291 >> v2:172.21.15.55:3300/0 conn(0x7fb7440cb100 0x7fb7440cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fb742000640 1 -- 172.21.15.55:0/3319782291 >> v1:172.21.15.55:6789/0 conn(0x7fb74415eb10 legacy=0x7fb7440b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fb742000640 1 -- 172.21.15.55:0/3319782291 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb744161e50 con 0x7fb744161620 2024-04-02T07:22:26.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7efdd3e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb8003980 0x7efdd40cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7efdd3e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb8003980 0x7efdd40cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:34732/0 (socket says 172.21.15.55:34732) 2024-04-02T07:22:26.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7efdd3e00640 1 -- 172.21.15.55:0/209323733 learned_addr learned my addr 172.21.15.55:0/209323733 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:26.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7efdd3400640 1 --2- 172.21.15.55:0/209323733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdd4154d40 0x7efdd40cd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7efdd3e00640 1 -- 172.21.15.55:0/209323733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdd4162440 msgr2=0x7efdd41628c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7efdd3e00640 1 --2- 172.21.15.55:0/209323733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdd4162440 0x7efdd41628c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7efdd3e00640 1 -- 172.21.15.55:0/209323733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdd4154d40 msgr2=0x7efdd40cd210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7efdd3e00640 1 --2- 172.21.15.55:0/209323733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdd4154d40 0x7efdd40cd210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7efdd3e00640 1 -- 172.21.15.55:0/209323733 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd4155740 con 0x7efdb8003980 2024-04-02T07:22:26.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fc1a0c00640 1 -- 172.21.15.55:0/392694306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc19400aae0 msgr2=0x7fc1940df2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fc1a0c00640 1 --2- 172.21.15.55:0/392694306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc19400aae0 0x7fc1940df2b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc1880097c0 tx=0x7fc18801c390 comp rx=0 tx=0).stop 2024-04-02T07:22:26.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fbd27000640 1 -- 172.21.15.55:0/2959098818 shutdown_connections 2024-04-02T07:22:26.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fbd27000640 1 --2- 172.21.15.55:0/2959098818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd200cf2f0 0x7fbd200cf760 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fbd27000640 1 --2- 172.21.15.55:0/2959098818 >> v2:172.21.15.55:3300/0 conn(0x7fbd2015c9f0 0x7fbd200cd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fbd27000640 1 -- 172.21.15.55:0/2959098818 >> 172.21.15.55:0/2959098818 conn(0x7fbd20065a80 msgr2=0x7fbd20065e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:26.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fc1a0c00640 1 -- 172.21.15.55:0/392694306 shutdown_connections 2024-04-02T07:22:26.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fc1a0c00640 1 --2- 172.21.15.55:0/392694306 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc194033d00 0x7fc19404faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fc1a0c00640 1 --2- 172.21.15.55:0/392694306 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc19400aae0 0x7fc1940df2b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fc1a0c00640 1 -- 172.21.15.55:0/392694306 >> 172.21.15.55:0/392694306 conn(0x7fc194009fc0 msgr2=0x7fc19400a3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:26.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7f7644200640 1 -- start start 2024-04-02T07:22:26.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7f7644200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f763c161620 0x7f763c0c8950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7f7644200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f763c0cb100 0x7f763c0cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7f7644200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f763c0cba90 con 0x7f763c15eb10 2024-04-02T07:22:26.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7f7644200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f763c070310 con 0x7f763c0cb100 2024-04-02T07:22:26.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7f7644200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c161b70 con 0x7f763c161620 2024-04-02T07:22:26.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7fc1a0c00640 1 -- 172.21.15.55:0/392694306 shutdown_connections 2024-04-02T07:22:26.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7f7640e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f763c161620 0x7f763c0c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.181+0000 7efdd3e00640 1 --2- 172.21.15.55:0/209323733 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb8003980 0x7efdd40cccd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efdc0025f60 tx=0x7efdb8005800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.185+0000 7f7640e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f763c161620 0x7f763c0c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:34734/0 (socket says 172.21.15.55:34734) 2024-04-02T07:22:26.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.185+0000 7f7640e00640 1 -- 172.21.15.55:0/3834105889 learned_addr learned my addr 172.21.15.55:0/3834105889 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:26.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.185+0000 7efdcbe00640 1 -- 172.21.15.55:0/209323733 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc00b4050 con 0x7efdb8003980 2024-04-02T07:22:26.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.185+0000 7efdcbe00640 1 -- 172.21.15.55:0/209323733 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdc00b5040 con 0x7efdb8003980 2024-04-02T07:22:26.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.185+0000 7efdcbe00640 1 -- 172.21.15.55:0/209323733 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdc0001680 con 0x7efdb8003980 2024-04-02T07:22:26.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.185+0000 7efdd9800640 1 -- 172.21.15.55:0/209323733 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd4155a20 con 0x7efdb8003980 2024-04-02T07:22:26.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.185+0000 7f7642200640 1 --2- 172.21.15.55:0/3834105889 >> v2:172.21.15.106:3300/0 conn(0x7f763c0cb100 0x7f763c0cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.185+0000 7f7640e00640 1 -- 172.21.15.55:0/3834105889 >> v2:172.21.15.106:3300/0 conn(0x7f763c0cb100 msgr2=0x7f763c0cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:26.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.185+0000 7f7640e00640 1 --2- 172.21.15.55:0/3834105889 >> v2:172.21.15.106:3300/0 conn(0x7f763c0cb100 0x7f763c0cb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.185+0000 7f7640e00640 1 -- 172.21.15.55:0/3834105889 >> v1:172.21.15.55:6789/0 conn(0x7f763c15eb10 legacy=0x7f763c0b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.185+0000 7f7640e00640 1 -- 172.21.15.55:0/3834105889 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f763c161e50 con 0x7f763c161620 2024-04-02T07:22:26.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.185+0000 7f7642200640 1 --2- 172.21.15.55:0/3834105889 >> v2:172.21.15.106:3300/0 conn(0x7f763c0cb100 0x7f763c0cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:26.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.185+0000 7efdd9800640 1 -- 172.21.15.55:0/209323733 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd41f9ba0 con 0x7efdb8003980 2024-04-02T07:22:26.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.185+0000 7fbd27000640 1 -- 172.21.15.55:0/2959098818 shutdown_connections 2024-04-02T07:22:26.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.185+0000 7fbd27000640 1 -- 172.21.15.55:0/2959098818 wait complete. 2024-04-02T07:22:26.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.185+0000 7efdd9800640 1 -- 172.21.15.55:0/209323733 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd41555a0 con 0x7efdb8003980 2024-04-02T07:22:26.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.185+0000 7fc1a0c00640 1 -- 172.21.15.55:0/392694306 wait complete. 2024-04-02T07:22:26.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.189+0000 7fb742000640 1 --2- 172.21.15.55:0/3319782291 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb744161620 0x7fb7440c8950 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb730009870 tx=0x7fb73001c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51496dd3926e539d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.189+0000 7fbd27000640 1 Processor -- start 2024-04-02T07:22:26.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.189+0000 7fc1a0c00640 1 Processor -- start 2024-04-02T07:22:26.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.189+0000 7fc1a0c00640 1 -- start start 2024-04-02T07:22:26.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.189+0000 7efdcbe00640 1 -- 172.21.15.55:0/209323733 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7efdc0007270 con 0x7efdb8003980 2024-04-02T07:22:26.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.189+0000 7efdcbe00640 1 --2- 172.21.15.55:0/209323733 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdb4066690 0x7efdb4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.189+0000 7efdcbe00640 1 -- 172.21.15.55:0/209323733 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdc01212b0 con 0x7efdb8003980 2024-04-02T07:22:26.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.189+0000 7fbd27000640 1 -- start start 2024-04-02T07:22:26.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.189+0000 7efdd3400640 1 --2- 172.21.15.55:0/209323733 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdb4066690 0x7efdb4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.189+0000 7fc1a0c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc19400aae0 0x7fc194047c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.189+0000 7efdd3400640 1 --2- 172.21.15.55:0/209323733 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdb4066690 0x7efdb4068b50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efdc4000c10 tx=0x7efdc4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd27000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd200b5be0 0x7fbd20158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7f7640e00640 1 --2- 172.21.15.55:0/3834105889 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f763c161620 0x7f763c0c8950 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7628009870 tx=0x7f762801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=66b0539fe9c4bdd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fc1a0c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc194033d00 0x7fc1940d29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd27000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbd200cf2f0 0x7fbd20160990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fc1a0c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc19404ffe0 0x7fc1940d2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd27000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd2015c9f0 0x7fbd2015ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fc1a0c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1940d7730 con 0x7fc19400aae0 2024-04-02T07:22:26.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd27000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd20158e70 con 0x7fbd2015c9f0 2024-04-02T07:22:26.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd27000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd20156210 con 0x7fbd200b5be0 2024-04-02T07:22:26.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd27000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd201564f0 con 0x7fbd200cf2f0 2024-04-02T07:22:26.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd1fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd200b5be0 0x7fbd20158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd1fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd200b5be0 0x7fbd20158930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:49336/0 (socket says 172.21.15.55:49336) 2024-04-02T07:22:26.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd1fe00640 1 -- 172.21.15.55:0/3157173436 learned_addr learned my addr 172.21.15.55:0/3157173436 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:26.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fc199400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc194033d00 0x7fc1940d29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd1f400640 1 --2- 172.21.15.55:0/3157173436 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbd200cf2f0 0x7fbd20160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fc199e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc19400aae0 0x7fc194047c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fc199400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc194033d00 0x7fc1940d29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:34746/0 (socket says 172.21.15.55:34746) 2024-04-02T07:22:26.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fc199400640 1 -- 172.21.15.55:0/114314309 learned_addr learned my addr 172.21.15.55:0/114314309 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:26.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fc19a800640 1 --2- 172.21.15.55:0/114314309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc19404ffe0 0x7fc1940d2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd25000640 1 --2- 172.21.15.55:0/3157173436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd2015c9f0 0x7fbd2015ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fc1a0c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1940d6bb0 con 0x7fc19404ffe0 2024-04-02T07:22:26.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd1fe00640 1 -- 172.21.15.55:0/3157173436 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbd200cf2f0 msgr2=0x7fbd20160990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fc1a0c00640 1 -- 172.21.15.55:0/114314309 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1940d6e90 con 0x7fc194033d00 2024-04-02T07:22:26.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd1fe00640 1 --2- 172.21.15.55:0/3157173436 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbd200cf2f0 0x7fbd20160990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd1fe00640 1 -- 172.21.15.55:0/3157173436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd2015c9f0 msgr2=0x7fbd2015ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd1fe00640 1 --2- 172.21.15.55:0/3157173436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd2015c9f0 0x7fbd2015ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fb741600640 1 -- 172.21.15.55:0/3319782291 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7300a95f0 con 0x7fb744161620 2024-04-02T07:22:26.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fb741600640 1 -- 172.21.15.55:0/3319782291 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7300a9750 con 0x7fb744161620 2024-04-02T07:22:26.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fb741600640 1 -- 172.21.15.55:0/3319782291 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7300a9ae0 con 0x7fb744161620 2024-04-02T07:22:26.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd1fe00640 1 -- 172.21.15.55:0/3157173436 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd18009a70 con 0x7fbd200b5be0 2024-04-02T07:22:26.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7f763be00640 1 -- 172.21.15.55:0/3834105889 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76280a95f0 con 0x7f763c161620 2024-04-02T07:22:26.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd25000640 1 --2- 172.21.15.55:0/3157173436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd2015c9f0 0x7fbd2015ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:26.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd1fe00640 1 --2- 172.21.15.55:0/3157173436 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd200b5be0 0x7fbd20158930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800e870 tx=0x7fbd0800ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7efdcbe00640 1 -- 172.21.15.55:0/209323733 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7efdd41555a0 con 0x7efdb8003980 2024-04-02T07:22:26.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd17e00640 1 -- 172.21.15.55:0/3157173436 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd08009510 con 0x7fbd200b5be0 2024-04-02T07:22:26.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd17e00640 1 -- 172.21.15.55:0/3157173436 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd0800eec0 con 0x7fbd200b5be0 2024-04-02T07:22:26.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd17e00640 1 -- 172.21.15.55:0/3157173436 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd0800cb40 con 0x7fbd200b5be0 2024-04-02T07:22:26.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd27000640 1 -- 172.21.15.55:0/3157173436 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd201567d0 con 0x7fbd200b5be0 2024-04-02T07:22:26.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fb749600640 1 -- 172.21.15.55:0/3319782291 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb744161620 msgr2=0x7fb7440c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fb749600640 1 --2- 172.21.15.55:0/3319782291 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb744161620 0x7fb7440c8950 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fb730009870 tx=0x7fb73001c530 comp rx=0 tx=0).stop 2024-04-02T07:22:26.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fc199e00640 1 -- 172.21.15.55:0/114314309 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc194033d00 msgr2=0x7fc1940d29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fc199e00640 1 --2- 172.21.15.55:0/114314309 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc194033d00 0x7fc1940d29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fc199e00640 1 -- 172.21.15.55:0/114314309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc19404ffe0 msgr2=0x7fc1940d2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fc199e00640 1 --2- 172.21.15.55:0/114314309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc19404ffe0 0x7fc1940d2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fc199e00640 1 -- 172.21.15.55:0/114314309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc188009420 con 0x7fc19400aae0 2024-04-02T07:22:26.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7f763be00640 1 -- 172.21.15.55:0/3834105889 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76280a9750 con 0x7f763c161620 2024-04-02T07:22:26.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7f763be00640 1 -- 172.21.15.55:0/3834105889 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76280a9ae0 con 0x7f763c161620 2024-04-02T07:22:26.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fbd27000640 1 -- 172.21.15.55:0/3157173436 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd20156d90 con 0x7fbd200b5be0 2024-04-02T07:22:26.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fb749600640 1 -- 172.21.15.55:0/3319782291 shutdown_connections 2024-04-02T07:22:26.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fb749600640 1 --2- 172.21.15.55:0/3319782291 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb744161620 0x7fb7440c8950 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fb749600640 1 --2- 172.21.15.55:0/3319782291 >> v2:172.21.15.55:3300/0 conn(0x7fb7440cb100 0x7fb7440cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fb749600640 1 -- 172.21.15.55:0/3319782291 >> 172.21.15.55:0/3319782291 conn(0x7fb744069d90 msgr2=0x7fb74406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:26.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fb749600640 1 -- 172.21.15.55:0/3319782291 shutdown_connections 2024-04-02T07:22:26.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fb749600640 1 -- 172.21.15.55:0/3319782291 wait complete. 2024-04-02T07:22:26.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fc199e00640 1 --2- 172.21.15.55:0/114314309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc19400aae0 0x7fc194047c80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc1880ac000 tx=0x7fc188019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fc192000640 1 -- 172.21.15.55:0/114314309 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1880b6810 con 0x7fc19400aae0 2024-04-02T07:22:26.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.193+0000 7fc192000640 1 -- 172.21.15.55:0/114314309 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1880a6040 con 0x7fc19400aae0 2024-04-02T07:22:26.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.197+0000 7fc192000640 1 -- 172.21.15.55:0/114314309 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1880b6bb0 con 0x7fc19400aae0 2024-04-02T07:22:26.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.197+0000 7fc1a0c00640 1 -- 172.21.15.55:0/114314309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1940d7170 con 0x7fc19400aae0 2024-04-02T07:22:26.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.197+0000 7fc1a0c00640 1 -- 172.21.15.55:0/114314309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1940481c0 con 0x7fc19400aae0 2024-04-02T07:22:26.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.197+0000 7fbd27000640 1 -- 172.21.15.55:0/3157173436 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd20072410 con 0x7fbd200b5be0 2024-04-02T07:22:26.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.197+0000 7fb749600640 1 Processor -- start 2024-04-02T07:22:26.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.197+0000 7fb749600640 1 -- start start 2024-04-02T07:22:26.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.197+0000 7fc1a0c00640 1 -- 172.21.15.55:0/114314309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1940089e0 con 0x7fc19400aae0 2024-04-02T07:22:26.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.197+0000 7fc192000640 1 -- 172.21.15.55:0/114314309 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc1880b4040 con 0x7fc19400aae0 2024-04-02T07:22:26.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fc192000640 1 --2- 172.21.15.55:0/114314309 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc17c066710 0x7fc17c068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fb749600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7440cb100 0x7fb744157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7f7644200640 1 -- 172.21.15.55:0/3834105889 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f763c161620 msgr2=0x7f763c0c8950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7f7644200640 1 --2- 172.21.15.55:0/3834105889 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f763c161620 0x7f763c0c8950 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7628009870 tx=0x7f762801c530 comp rx=0 tx=0).stop 2024-04-02T07:22:26.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fb749600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb74415eb10 0x7fb74406d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fc192000640 1 -- 172.21.15.55:0/114314309 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc18811d780 con 0x7fc19400aae0 2024-04-02T07:22:26.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7f7644200640 1 -- 172.21.15.55:0/3834105889 shutdown_connections 2024-04-02T07:22:26.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7f7644200640 1 --2- 172.21.15.55:0/3834105889 >> v2:172.21.15.106:3300/0 conn(0x7f763c0cb100 0x7f763c0cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7f7644200640 1 --2- 172.21.15.55:0/3834105889 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f763c161620 0x7f763c0c8950 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7f7644200640 1 -- 172.21.15.55:0/3834105889 >> 172.21.15.55:0/3834105889 conn(0x7f763c069d90 msgr2=0x7f763c06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:26.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fb749600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb744161620 0x7fb7440cd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fc199400640 1 --2- 172.21.15.55:0/114314309 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc17c066710 0x7fc17c068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fb742000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb74415eb10 0x7fb74406d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fb742000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb74415eb10 0x7fb74406d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:34768/0 (socket says 172.21.15.55:34768) 2024-04-02T07:22:26.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fb742000640 1 -- 172.21.15.55:0/1506788916 learned_addr learned my addr 172.21.15.55:0/1506788916 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:26.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fb743400640 1 --2- 172.21.15.55:0/1506788916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb744161620 0x7fb7440cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fb749600640 1 -- 172.21.15.55:0/1506788916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74415c110 con 0x7fb7440cb100 2024-04-02T07:22:26.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fb749600640 1 -- 172.21.15.55:0/1506788916 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74415c6d0 con 0x7fb744161620 2024-04-02T07:22:26.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fb749600640 1 -- 172.21.15.55:0/1506788916 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb74415ffa0 con 0x7fb74415eb10 2024-04-02T07:22:26.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fc199400640 1 --2- 172.21.15.55:0/114314309 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc17c066710 0x7fc17c068bd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc1940d4450 tx=0x7fc18c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fb742a00640 1 --2- 172.21.15.55:0/1506788916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7440cb100 0x7fb744157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fb743400640 1 -- 172.21.15.55:0/1506788916 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb74415eb10 msgr2=0x7fb74406d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fb743400640 1 --2- 172.21.15.55:0/1506788916 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb74415eb10 0x7fb74406d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fb743400640 1 -- 172.21.15.55:0/1506788916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7440cb100 msgr2=0x7fb744157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fb743400640 1 --2- 172.21.15.55:0/1506788916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7440cb100 0x7fb744157ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fb743400640 1 -- 172.21.15.55:0/1506788916 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7300094d0 con 0x7fb744161620 2024-04-02T07:22:26.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fb742a00640 1 --2- 172.21.15.55:0/1506788916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7440cb100 0x7fb744157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:26.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fbd17e00640 1 -- 172.21.15.55:0/3157173436 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fbd0800cca0 con 0x7fbd200b5be0 2024-04-02T07:22:26.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fbd17e00640 1 --2- 172.21.15.55:0/3157173436 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbcfc066760 0x7fbcfc068c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7fbd17e00640 1 -- 172.21.15.55:0/3157173436 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd080845e0 con 0x7fbd200b5be0 2024-04-02T07:22:26.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.205+0000 7fb743400640 1 --2- 172.21.15.55:0/1506788916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb744161620 0x7fb7440cd620 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb73400b3e0 tx=0x7fb734009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.201+0000 7f7644200640 1 -- 172.21.15.55:0/3834105889 shutdown_connections 2024-04-02T07:22:26.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.205+0000 7f7644200640 1 -- 172.21.15.55:0/3834105889 wait complete. 2024-04-02T07:22:26.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.205+0000 7fb73aa00640 1 -- 172.21.15.55:0/1506788916 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb734011830 con 0x7fb744161620 2024-04-02T07:22:26.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.205+0000 7fb749600640 1 -- 172.21.15.55:0/1506788916 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7440b3c40 con 0x7fb744161620 2024-04-02T07:22:26.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.205+0000 7fb749600640 1 -- 172.21.15.55:0/1506788916 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb74415c360 con 0x7fb744161620 2024-04-02T07:22:26.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.205+0000 7fb73aa00640 1 -- 172.21.15.55:0/1506788916 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb734011990 con 0x7fb744161620 2024-04-02T07:22:26.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.205+0000 7fb73aa00640 1 -- 172.21.15.55:0/1506788916 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb734011d20 con 0x7fb744161620 2024-04-02T07:22:26.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.205+0000 7fb749600640 1 -- 172.21.15.55:0/1506788916 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71c005260 con 0x7fb744161620 2024-04-02T07:22:26.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.205+0000 7fbd1f400640 1 --2- 172.21.15.55:0/3157173436 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbcfc066760 0x7fbcfc068c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.205+0000 7fbd17e00640 1 -- 172.21.15.55:0/3157173436 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fbd080519e0 con 0x7fbd200b5be0 2024-04-02T07:22:26.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.205+0000 7f7644200640 1 Processor -- start 2024-04-02T07:22:26.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7f7644200640 1 -- start start 2024-04-02T07:22:26.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7fbd1f400640 1 --2- 172.21.15.55:0/3157173436 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbcfc066760 0x7fbcfc068c20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbd200ceed0 tx=0x7fbd10009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.205+0000 7fb73aa00640 1 -- 172.21.15.55:0/1506788916 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb73401a400 con 0x7fb744161620 2024-04-02T07:22:26.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7fb73aa00640 1 --2- 172.21.15.55:0/1506788916 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7240666e0 0x7fb724068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7fb73aa00640 1 -- 172.21.15.55:0/1506788916 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb734084000 con 0x7fb744161620 2024-04-02T07:22:26.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7fb742a00640 1 --2- 172.21.15.55:0/1506788916 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7240666e0 0x7fb724068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7f7644200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f763c0cb100 0x7f763c14ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7f7644200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f763c15eb10 0x7f763c06d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7f7644200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f763c161620 0x7f763c15f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7f7644200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c14ecb0 con 0x7f763c15eb10 2024-04-02T07:22:26.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7f7644200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763c14cfa0 con 0x7f763c0cb100 2024-04-02T07:22:26.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7f7644200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763c14b6f0 con 0x7f763c161620 2024-04-02T07:22:26.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7f7640e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f763c15eb10 0x7f763c06d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7f7640e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f763c15eb10 0x7f763c06d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60922/0 (socket says 172.21.15.55:60922) 2024-04-02T07:22:26.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7f7640e00640 1 -- 172.21.15.55:0/1165818892 learned_addr learned my addr 172.21.15.55:0/1165818892 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:26.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7fb742a00640 1 --2- 172.21.15.55:0/1506788916 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7240666e0 0x7fb724068ba0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb73c007fd0 tx=0x7fb73c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7fc192000640 1 -- 172.21.15.55:0/114314309 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc1880eabf0 con 0x7fc19400aae0 2024-04-02T07:22:26.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7f7642200640 1 --2- 172.21.15.55:0/1165818892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f763c161620 0x7f763c15f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7f7640e00640 1 -- 172.21.15.55:0/1165818892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f763c161620 msgr2=0x7f763c15f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7f7640e00640 1 --2- 172.21.15.55:0/1165818892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f763c161620 0x7f763c15f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7f7641800640 1 --2- 172.21.15.55:0/1165818892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f763c0cb100 0x7f763c14ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7f7640e00640 1 -- 172.21.15.55:0/1165818892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f763c0cb100 msgr2=0x7f763c14ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7f7640e00640 1 --2- 172.21.15.55:0/1165818892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f763c0cb100 0x7f763c14ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7f7640e00640 1 -- 172.21.15.55:0/1165818892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76280094d0 con 0x7f763c15eb10 2024-04-02T07:22:26.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.209+0000 7f7641800640 1 --2- 172.21.15.55:0/1165818892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f763c0cb100 0x7f763c14ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:26.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.213+0000 7f7640e00640 1 --2- 172.21.15.55:0/1165818892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f763c15eb10 0x7f763c06d620 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f762801a160 tx=0x7f76280192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.213+0000 7fb73aa00640 1 -- 172.21.15.55:0/1506788916 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fb7340514e0 con 0x7fb744161620 2024-04-02T07:22:26.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.213+0000 7f7639600640 1 -- 172.21.15.55:0/1165818892 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76280b1800 con 0x7f763c15eb10 2024-04-02T07:22:26.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.213+0000 7f7644200640 1 -- 172.21.15.55:0/1165818892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f763c0b3c40 con 0x7f763c15eb10 2024-04-02T07:22:26.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.213+0000 7f7644200640 1 -- 172.21.15.55:0/1165818892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f763c15d370 con 0x7f763c15eb10 2024-04-02T07:22:26.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.213+0000 7f7639600640 1 -- 172.21.15.55:0/1165818892 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76280b1960 con 0x7f763c15eb10 2024-04-02T07:22:26.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.213+0000 7f7639600640 1 -- 172.21.15.55:0/1165818892 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76280b1cd0 con 0x7f763c15eb10 2024-04-02T07:22:26.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.217+0000 7f7639600640 1 -- 172.21.15.55:0/1165818892 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f76280bb3f0 con 0x7f763c15eb10 2024-04-02T07:22:26.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.221+0000 7f7639600640 1 --2- 172.21.15.55:0/1165818892 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f761c066690 0x7f761c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.221+0000 7f7639600640 1 -- 172.21.15.55:0/1165818892 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f762811e5b0 con 0x7f763c15eb10 2024-04-02T07:22:26.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.221+0000 7f7644200640 1 -- 172.21.15.55:0/1165818892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7618005260 con 0x7f763c15eb10 2024-04-02T07:22:26.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.221+0000 7f7641800640 1 --2- 172.21.15.55:0/1165818892 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f761c066690 0x7f761c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.221+0000 7f7641800640 1 --2- 172.21.15.55:0/1165818892 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f761c066690 0x7f761c068b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7630000f70 tx=0x7f7630009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.233+0000 7f7639600640 1 -- 172.21.15.55:0/1165818892 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f76280eb990 con 0x7f763c15eb10 2024-04-02T07:22:26.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.249+0000 7fe0f2800640 1 Processor -- start 2024-04-02T07:22:26.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.249+0000 7fe0f2800640 1 -- start start 2024-04-02T07:22:26.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.249+0000 7fe0f2800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe0ec0b0650 0x7fe0ec0b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.249+0000 7fe0f2800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0ec0cb100 0x7fe0ec0cb520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.249+0000 7fe0f2800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0ec0b3b30 con 0x7fe0ec06ce40 2024-04-02T07:22:26.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.249+0000 7fe0f2800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0ec06c280 con 0x7fe0ec0b0650 2024-04-02T07:22:26.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.249+0000 7fe0f2800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec06d220 con 0x7fe0ec0cb100 2024-04-02T07:22:26.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.249+0000 7fe0eb400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe0ec06ce40 0x7fe0ec0c90d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:38234/0 (socket says 172.21.15.55:38234) 2024-04-02T07:22:26.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.249+0000 7fe0eb400640 1 -- 172.21.15.55:0/2010198423 learned_addr learned my addr 172.21.15.55:0/2010198423 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:26.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.249+0000 7fe0ebe00640 1 --2- 172.21.15.55:0/2010198423 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0ec0cb100 0x7fe0ec0cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.249+0000 7fe0eaa00640 1 --2- 172.21.15.55:0/2010198423 >> v2:172.21.15.106:3300/0 conn(0x7fe0ec0b0650 0x7fe0ec0b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.253+0000 7fe0eaa00640 1 -- 172.21.15.55:0/2010198423 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0ec0cb100 msgr2=0x7fe0ec0cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:26.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.253+0000 7fe0eaa00640 1 --2- 172.21.15.55:0/2010198423 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0ec0cb100 0x7fe0ec0cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.253+0000 7fe0eaa00640 1 -- 172.21.15.55:0/2010198423 >> v1:172.21.15.106:6789/0 conn(0x7fe0ec06ce40 legacy=0x7fe0ec0c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.253+0000 7fe0eaa00640 1 -- 172.21.15.55:0/2010198423 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0ec0c9c20 con 0x7fe0ec0b0650 2024-04-02T07:22:26.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.257+0000 7fe0eaa00640 1 --2- 172.21.15.55:0/2010198423 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0ec0b0650 0x7fe0ec0b0ac0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe0d80097c0 tx=0x7fe0d801c350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5617ee8b21fd7416 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.257+0000 7fe0ea000640 1 -- 172.21.15.55:0/2010198423 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d80ab600 con 0x7fe0ec0b0650 2024-04-02T07:22:26.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.257+0000 7fe0ea000640 1 -- 172.21.15.55:0/2010198423 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d80a7050 con 0x7fe0ec0b0650 2024-04-02T07:22:26.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.257+0000 7fe0ea000640 1 -- 172.21.15.55:0/2010198423 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d80ab980 con 0x7fe0ec0b0650 2024-04-02T07:22:26.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.261+0000 7fe0f2800640 1 -- 172.21.15.55:0/2010198423 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0ec0b0650 msgr2=0x7fe0ec0b0ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.261+0000 7fe0f2800640 1 --2- 172.21.15.55:0/2010198423 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0ec0b0650 0x7fe0ec0b0ac0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fe0d80097c0 tx=0x7fe0d801c350 comp rx=0 tx=0).stop 2024-04-02T07:22:26.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.261+0000 7fe0f2800640 1 -- 172.21.15.55:0/2010198423 shutdown_connections 2024-04-02T07:22:26.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.261+0000 7fe0f2800640 1 --2- 172.21.15.55:0/2010198423 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0ec0cb100 0x7fe0ec0cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.261+0000 7fe0f2800640 1 --2- 172.21.15.55:0/2010198423 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0ec0b0650 0x7fe0ec0b0ac0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.261+0000 7fe0f2800640 1 -- 172.21.15.55:0/2010198423 >> 172.21.15.55:0/2010198423 conn(0x7fe0ec065a80 msgr2=0x7fe0ec065e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:26.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.261+0000 7fe0f2800640 1 -- 172.21.15.55:0/2010198423 shutdown_connections 2024-04-02T07:22:26.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.261+0000 7fe0f2800640 1 -- 172.21.15.55:0/2010198423 wait complete. 2024-04-02T07:22:26.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.265+0000 7fe0f2800640 1 Processor -- start 2024-04-02T07:22:26.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.265+0000 7fe0f2800640 1 -- start start 2024-04-02T07:22:26.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.269+0000 7fe0f2800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0ec06ce40 0x7fe0ec164f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.269+0000 7fe0f2800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0ec0b0650 0x7fe0ec152b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.269+0000 7fe0f2800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0ec0cb100 0x7fe0ec1fd710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.269+0000 7fe0eb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0ec06ce40 0x7fe0ec164f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.269+0000 7fe0eb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0ec06ce40 0x7fe0ec164f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60924/0 (socket says 172.21.15.55:60924) 2024-04-02T07:22:26.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.269+0000 7fe0eb400640 1 -- 172.21.15.55:0/3860371244 learned_addr learned my addr 172.21.15.55:0/3860371244 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:26.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.269+0000 7fe0ebe00640 1 --2- 172.21.15.55:0/3860371244 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0ec0cb100 0x7fe0ec1fd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.269+0000 7fe0f2800640 1 -- 172.21.15.55:0/3860371244 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec165730 con 0x7fe0ec06ce40 2024-04-02T07:22:26.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.269+0000 7fe0f2800640 1 -- 172.21.15.55:0/3860371244 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec15e580 con 0x7fe0ec0b0650 2024-04-02T07:22:26.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.269+0000 7fe0f2800640 1 -- 172.21.15.55:0/3860371244 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0ec15e820 con 0x7fe0ec0cb100 2024-04-02T07:22:26.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.269+0000 7fe0ebe00640 1 -- 172.21.15.55:0/3860371244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0ec0b0650 msgr2=0x7fe0ec152b70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-02T07:22:26.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.273+0000 7fe0eaa00640 1 --2- 172.21.15.55:0/3860371244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0ec0b0650 0x7fe0ec152b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.273+0000 7fe0ebe00640 1 --2- 172.21.15.55:0/3860371244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0ec0b0650 0x7fe0ec152b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.273+0000 7fe0ebe00640 1 -- 172.21.15.55:0/3860371244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0ec06ce40 msgr2=0x7fe0ec164f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.273+0000 7fe0ebe00640 1 --2- 172.21.15.55:0/3860371244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0ec06ce40 0x7fe0ec164f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.273+0000 7fe0ebe00640 1 -- 172.21.15.55:0/3860371244 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d8009420 con 0x7fe0ec0cb100 2024-04-02T07:22:26.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.273+0000 7fe0ebe00640 1 --2- 172.21.15.55:0/3860371244 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0ec0cb100 0x7fe0ec1fd710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400ebb0 tx=0x7fe0e400c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.273+0000 7fe0e3400640 1 -- 172.21.15.55:0/3860371244 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e400cd20 con 0x7fe0ec0cb100 2024-04-02T07:22:26.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.273+0000 7fe0e3400640 1 -- 172.21.15.55:0/3860371244 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0e400f040 con 0x7fe0ec0cb100 2024-04-02T07:22:26.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.273+0000 7fe0e3400640 1 -- 172.21.15.55:0/3860371244 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0e40146c0 con 0x7fe0ec0cb100 2024-04-02T07:22:26.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.273+0000 7fe0f2800640 1 -- 172.21.15.55:0/3860371244 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0ec15eb00 con 0x7fe0ec0cb100 2024-04-02T07:22:26.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.273+0000 7fe0f2800640 1 -- 172.21.15.55:0/3860371244 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0ec1530b0 con 0x7fe0ec0cb100 2024-04-02T07:22:26.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.277+0000 7fe0f2800640 1 -- 172.21.15.55:0/3860371244 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0ec0c8e40 con 0x7fe0ec0cb100 2024-04-02T07:22:26.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.277+0000 7fe0e3400640 1 -- 172.21.15.55:0/3860371244 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe0e4014820 con 0x7fe0ec0cb100 2024-04-02T07:22:26.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.277+0000 7fe0e3400640 1 --2- 172.21.15.55:0/3860371244 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe0cc066690 0x7fe0cc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.277+0000 7fe0e3400640 1 -- 172.21.15.55:0/3860371244 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0e4084a70 con 0x7fe0ec0cb100 2024-04-02T07:22:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.281+0000 7fe0eb400640 1 --2- 172.21.15.55:0/3860371244 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe0cc066690 0x7fe0cc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.281+0000 7fe0eb400640 1 --2- 172.21.15.55:0/3860371244 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe0cc066690 0x7fe0cc068b50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc000f70 tx=0x7fe0dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.285+0000 7fe0e3400640 1 -- 172.21.15.55:0/3860371244 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe0e4051dd0 con 0x7fe0ec0cb100 2024-04-02T07:22:26.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.501+0000 7f3844c00640 1 -- 172.21.15.55:0/3479064309 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f384c04c810 con 0x7f384c0e77f0 2024-04-02T07:22:26.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.501+0000 7f3847400640 1 -- 172.21.15.55:0/3479064309 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3848017030 con 0x7f384c0e77f0 2024-04-02T07:22:26.505 INFO:teuthology.orchestra.run.smithi055.stdout:55834574853 2024-04-02T07:22:26.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.505+0000 7f3844c00640 1 -- 172.21.15.55:0/3479064309 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3834066690 msgr2=0x7f3834068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.505+0000 7f3844c00640 1 --2- 172.21.15.55:0/3479064309 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3834066690 0x7f3834068b50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f38400b2000 tx=0x7f38400aa070 comp rx=0 tx=0).stop 2024-04-02T07:22:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.505+0000 7f3844c00640 1 -- 172.21.15.55:0/3479064309 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f384c0e77f0 msgr2=0x7f384c04d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.505+0000 7f3844c00640 1 --2- 172.21.15.55:0/3479064309 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f384c0e77f0 0x7f384c04d1b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f384800c340 tx=0x7f384800c800 comp rx=0 tx=0).stop 2024-04-02T07:22:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.505+0000 7f3844c00640 1 -- 172.21.15.55:0/3479064309 shutdown_connections 2024-04-02T07:22:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.505+0000 7f3844c00640 1 --2- 172.21.15.55:0/3479064309 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f384c0e77f0 0x7f384c04d1b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.505+0000 7f3844c00640 1 --2- 172.21.15.55:0/3479064309 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3834066690 0x7f3834068b50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.505+0000 7f3844c00640 1 --2- 172.21.15.55:0/3479064309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f384c0e6c00 0x7f384c049c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.505+0000 7f3844c00640 1 --2- 172.21.15.55:0/3479064309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f384c0e30a0 0x7f384c036130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.505+0000 7f3844c00640 1 -- 172.21.15.55:0/3479064309 >> 172.21.15.55:0/3479064309 conn(0x7f384c009f90 msgr2=0x7f384c038630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:26.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.505+0000 7f3844c00640 1 -- 172.21.15.55:0/3479064309 shutdown_connections 2024-04-02T07:22:26.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.505+0000 7f3844c00640 1 -- 172.21.15.55:0/3479064309 wait complete. 2024-04-02T07:22:26.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.513+0000 7f970fe00640 1 -- 172.21.15.55:0/3847681802 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f9708066c90 con 0x7f9708158b70 2024-04-02T07:22:26.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.513+0000 7f9705600640 1 -- 172.21.15.55:0/3847681802 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f96f4021090 con 0x7f9708158b70 2024-04-02T07:22:26.520 INFO:teuthology.orchestra.run.smithi055.stdout:55834574856 2024-04-02T07:22:26.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.517+0000 7fc1a0c00640 1 -- 172.21.15.55:0/114314309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc1940053a0 con 0x7fc19400aae0 2024-04-02T07:22:26.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.517+0000 7fc192000640 1 -- 172.21.15.55:0/114314309 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc1880ee210 con 0x7fc19400aae0 2024-04-02T07:22:26.523 INFO:teuthology.orchestra.run.smithi055.stdout:55834574854 2024-04-02T07:22:26.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.517+0000 7f970fe00640 1 -- 172.21.15.55:0/3847681802 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f96e80666e0 msgr2=0x7f96e8068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.517+0000 7f970fe00640 1 --2- 172.21.15.55:0/3847681802 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f96e80666e0 0x7f96e8068ba0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f97000ae000 tx=0x7f97000a7070 comp rx=0 tx=0).stop 2024-04-02T07:22:26.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.517+0000 7f970fe00640 1 -- 172.21.15.55:0/3847681802 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9708158b70 msgr2=0x7f970814cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.517+0000 7f970fe00640 1 --2- 172.21.15.55:0/3847681802 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9708158b70 0x7f970814cbf0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f96f400b460 tx=0x7f96f400b920 comp rx=0 tx=0).stop 2024-04-02T07:22:26.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.517+0000 7f970fe00640 1 -- 172.21.15.55:0/3847681802 shutdown_connections 2024-04-02T07:22:26.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.517+0000 7f970fe00640 1 --2- 172.21.15.55:0/3847681802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9708158f50 0x7f9708142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.517+0000 7f970fe00640 1 --2- 172.21.15.55:0/3847681802 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9708158b70 0x7f970814cbf0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.517+0000 7f970fe00640 1 --2- 172.21.15.55:0/3847681802 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f96e80666e0 0x7f96e8068ba0 secure :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f97000ae000 tx=0x7f97000a7070 comp rx=0 tx=0).stop 2024-04-02T07:22:26.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.517+0000 7f970fe00640 1 --2- 172.21.15.55:0/3847681802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97080afae0 0x7f97081403d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.517+0000 7f970fe00640 1 -- 172.21.15.55:0/3847681802 >> 172.21.15.55:0/3847681802 conn(0x7f9708065a80 msgr2=0x7f970814a6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:26.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.521+0000 7f970fe00640 1 -- 172.21.15.55:0/3847681802 shutdown_connections 2024-04-02T07:22:26.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.521+0000 7f970fe00640 1 -- 172.21.15.55:0/3847681802 wait complete. 2024-04-02T07:22:26.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.521+0000 7fc1a0c00640 1 -- 172.21.15.55:0/114314309 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc17c066710 msgr2=0x7fc17c068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.521+0000 7fc1a0c00640 1 --2- 172.21.15.55:0/114314309 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc17c066710 0x7fc17c068bd0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc1940d4450 tx=0x7fc18c008040 comp rx=0 tx=0).stop 2024-04-02T07:22:26.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.521+0000 7fc1a0c00640 1 -- 172.21.15.55:0/114314309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc19400aae0 msgr2=0x7fc194047c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.521+0000 7fc1a0c00640 1 --2- 172.21.15.55:0/114314309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc19400aae0 0x7fc194047c80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc1880ac000 tx=0x7fc188019130 comp rx=0 tx=0).stop 2024-04-02T07:22:26.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.521+0000 7fc1a0c00640 1 -- 172.21.15.55:0/114314309 shutdown_connections 2024-04-02T07:22:26.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.521+0000 7fc1a0c00640 1 --2- 172.21.15.55:0/114314309 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc17c066710 0x7fc17c068bd0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.521+0000 7fc1a0c00640 1 --2- 172.21.15.55:0/114314309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc19404ffe0 0x7fc1940d2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.521+0000 7fc1a0c00640 1 --2- 172.21.15.55:0/114314309 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc194033d00 0x7fc1940d29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.521+0000 7fc1a0c00640 1 --2- 172.21.15.55:0/114314309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc19400aae0 0x7fc194047c80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.521+0000 7fc1a0c00640 1 -- 172.21.15.55:0/114314309 >> 172.21.15.55:0/114314309 conn(0x7fc194009fc0 msgr2=0x7fc1940365a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:26.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.529+0000 7fc1a0c00640 1 -- 172.21.15.55:0/114314309 shutdown_connections 2024-04-02T07:22:26.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.529+0000 7fc1a0c00640 1 -- 172.21.15.55:0/114314309 wait complete. 2024-04-02T07:22:26.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.537+0000 7efdd9800640 1 -- 172.21.15.55:0/209323733 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7efdd41555a0 con 0x7efdb8003980 2024-04-02T07:22:26.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.541+0000 7efdcbe00640 1 -- 172.21.15.55:0/209323733 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7efdd41555a0 con 0x7efdb8003980 2024-04-02T07:22:26.544 INFO:teuthology.orchestra.run.smithi055.stdout:55834574854 2024-04-02T07:22:26.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2024-04-02T07:22:26.545 DEBUG:teuthology.parallel:result is None 2024-04-02T07:22:26.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.545+0000 7efdd9800640 1 -- 172.21.15.55:0/209323733 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdb4066690 msgr2=0x7efdb4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.545+0000 7efdd9800640 1 --2- 172.21.15.55:0/209323733 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdb4066690 0x7efdb4068b50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efdc4000c10 tx=0x7efdc4009040 comp rx=0 tx=0).stop 2024-04-02T07:22:26.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.545+0000 7efdd9800640 1 -- 172.21.15.55:0/209323733 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb8003980 msgr2=0x7efdd40cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.545+0000 7efdd9800640 1 --2- 172.21.15.55:0/209323733 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb8003980 0x7efdd40cccd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efdc0025f60 tx=0x7efdb8005800 comp rx=0 tx=0).stop 2024-04-02T07:22:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.545+0000 7efdd9800640 1 -- 172.21.15.55:0/209323733 shutdown_connections 2024-04-02T07:22:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.545+0000 7efdd9800640 1 --2- 172.21.15.55:0/209323733 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdb4066690 0x7efdb4068b50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.545+0000 7efdd9800640 1 --2- 172.21.15.55:0/209323733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdd4162440 0x7efdd41628c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.545+0000 7efdd9800640 1 --2- 172.21.15.55:0/209323733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdd4154d40 0x7efdd40cd210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.545+0000 7efdd9800640 1 --2- 172.21.15.55:0/209323733 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb8003980 0x7efdd40cccd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.545+0000 7efdd9800640 1 -- 172.21.15.55:0/209323733 >> 172.21.15.55:0/209323733 conn(0x7efdd4065e80 msgr2=0x7efdd415f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.545+0000 7efdd9800640 1 -- 172.21.15.55:0/209323733 shutdown_connections 2024-04-02T07:22:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.545+0000 7efdd9800640 1 -- 172.21.15.55:0/209323733 wait complete. 2024-04-02T07:22:26.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.549+0000 7fb749600640 1 -- 172.21.15.55:0/1506788916 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fb71c0057e0 con 0x7fb744161620 2024-04-02T07:22:26.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.549+0000 7fb73aa00640 1 -- 172.21.15.55:0/1506788916 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb734015020 con 0x7fb744161620 2024-04-02T07:22:26.554 INFO:teuthology.orchestra.run.smithi055.stdout:55834574854 2024-04-02T07:22:26.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.557+0000 7fb749600640 1 -- 172.21.15.55:0/1506788916 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7240666e0 msgr2=0x7fb724068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.557+0000 7fb749600640 1 --2- 172.21.15.55:0/1506788916 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7240666e0 0x7fb724068ba0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb73c007fd0 tx=0x7fb73c009040 comp rx=0 tx=0).stop 2024-04-02T07:22:26.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.557+0000 7fb749600640 1 -- 172.21.15.55:0/1506788916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb744161620 msgr2=0x7fb7440cd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.557+0000 7fb749600640 1 --2- 172.21.15.55:0/1506788916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb744161620 0x7fb7440cd620 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fb73400b3e0 tx=0x7fb734009f90 comp rx=0 tx=0).stop 2024-04-02T07:22:26.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.557+0000 7fb749600640 1 -- 172.21.15.55:0/1506788916 shutdown_connections 2024-04-02T07:22:26.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.557+0000 7fb749600640 1 --2- 172.21.15.55:0/1506788916 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7240666e0 0x7fb724068ba0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.557+0000 7fb749600640 1 --2- 172.21.15.55:0/1506788916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb744161620 0x7fb7440cd620 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.557+0000 7fb749600640 1 --2- 172.21.15.55:0/1506788916 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb74415eb10 0x7fb74406d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.557+0000 7fb749600640 1 --2- 172.21.15.55:0/1506788916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7440cb100 0x7fb744157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.557+0000 7fb749600640 1 -- 172.21.15.55:0/1506788916 >> 172.21.15.55:0/1506788916 conn(0x7fb744069d90 msgr2=0x7fb744165410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:26.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.557+0000 7fb749600640 1 -- 172.21.15.55:0/1506788916 shutdown_connections 2024-04-02T07:22:26.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.557+0000 7fb749600640 1 -- 172.21.15.55:0/1506788916 wait complete. 2024-04-02T07:22:26.567 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2024-04-02T07:22:26.567 DEBUG:teuthology.parallel:result is None 2024-04-02T07:22:26.568 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2024-04-02T07:22:26.568 DEBUG:teuthology.parallel:result is None 2024-04-02T07:22:26.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.565+0000 7fbd27000640 1 -- 172.21.15.55:0/3157173436 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fbd20066900 con 0x7fbd200b5be0 2024-04-02T07:22:26.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.565+0000 7fbd17e00640 1 -- 172.21.15.55:0/3157173436 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbd08055000 con 0x7fbd200b5be0 2024-04-02T07:22:26.570 INFO:teuthology.orchestra.run.smithi055.stdout:55834574854 2024-04-02T07:22:26.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.569+0000 7fbd27000640 1 -- 172.21.15.55:0/3157173436 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbcfc066760 msgr2=0x7fbcfc068c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.569+0000 7fbd27000640 1 --2- 172.21.15.55:0/3157173436 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbcfc066760 0x7fbcfc068c20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fbd200ceed0 tx=0x7fbd10009040 comp rx=0 tx=0).stop 2024-04-02T07:22:26.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.569+0000 7fbd27000640 1 -- 172.21.15.55:0/3157173436 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd200b5be0 msgr2=0x7fbd20158930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.569+0000 7fbd27000640 1 --2- 172.21.15.55:0/3157173436 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd200b5be0 0x7fbd20158930 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fbd0800e870 tx=0x7fbd0800ec70 comp rx=0 tx=0).stop 2024-04-02T07:22:26.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.569+0000 7fbd27000640 1 -- 172.21.15.55:0/3157173436 shutdown_connections 2024-04-02T07:22:26.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.569+0000 7fbd27000640 1 --2- 172.21.15.55:0/3157173436 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbd2015c9f0 0x7fbd2015ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.569+0000 7fbd27000640 1 --2- 172.21.15.55:0/3157173436 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbd200cf2f0 0x7fbd20160990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.569+0000 7fbd27000640 1 --2- 172.21.15.55:0/3157173436 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbcfc066760 0x7fbcfc068c20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.569+0000 7fbd27000640 1 --2- 172.21.15.55:0/3157173436 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbd200b5be0 0x7fbd20158930 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.569+0000 7fbd27000640 1 -- 172.21.15.55:0/3157173436 >> 172.21.15.55:0/3157173436 conn(0x7fbd20065a80 msgr2=0x7fbd200b60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:26.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.569+0000 7fbd27000640 1 -- 172.21.15.55:0/3157173436 shutdown_connections 2024-04-02T07:22:26.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.569+0000 7fbd27000640 1 -- 172.21.15.55:0/3157173436 wait complete. 2024-04-02T07:22:26.581 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-04-02T07:22:26.581 DEBUG:teuthology.parallel:result is None 2024-04-02T07:22:26.587 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2024-04-02T07:22:26.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.585+0000 7f7644200640 1 -- 172.21.15.55:0/1165818892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f76180057e0 con 0x7f763c15eb10 2024-04-02T07:22:26.588 DEBUG:teuthology.parallel:result is None 2024-04-02T07:22:26.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.585+0000 7f7639600640 1 -- 172.21.15.55:0/1165818892 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f76280c0070 con 0x7f763c15eb10 2024-04-02T07:22:26.588 INFO:teuthology.orchestra.run.smithi055.stdout:55834574853 2024-04-02T07:22:26.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.585+0000 7f7644200640 1 -- 172.21.15.55:0/1165818892 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f761c066690 msgr2=0x7f761c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.585+0000 7f7644200640 1 --2- 172.21.15.55:0/1165818892 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f761c066690 0x7f761c068b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7630000f70 tx=0x7f7630009040 comp rx=0 tx=0).stop 2024-04-02T07:22:26.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.585+0000 7f7644200640 1 -- 172.21.15.55:0/1165818892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f763c15eb10 msgr2=0x7f763c06d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.585+0000 7f7644200640 1 --2- 172.21.15.55:0/1165818892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f763c15eb10 0x7f763c06d620 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f762801a160 tx=0x7f76280192d0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.585+0000 7f7644200640 1 -- 172.21.15.55:0/1165818892 shutdown_connections 2024-04-02T07:22:26.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.585+0000 7f7644200640 1 --2- 172.21.15.55:0/1165818892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f763c161620 0x7f763c15f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.585+0000 7f7644200640 1 --2- 172.21.15.55:0/1165818892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f763c15eb10 0x7f763c06d620 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.585+0000 7f7644200640 1 --2- 172.21.15.55:0/1165818892 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f761c066690 0x7f761c068b50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.585+0000 7f7644200640 1 --2- 172.21.15.55:0/1165818892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f763c0cb100 0x7f763c14ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.585+0000 7f7644200640 1 -- 172.21.15.55:0/1165818892 >> 172.21.15.55:0/1165818892 conn(0x7f763c069d90 msgr2=0x7f763c164ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:26.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.585+0000 7f7644200640 1 -- 172.21.15.55:0/1165818892 shutdown_connections 2024-04-02T07:22:26.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.585+0000 7f7644200640 1 -- 172.21.15.55:0/1165818892 wait complete. 2024-04-02T07:22:26.604 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2024-04-02T07:22:26.604 DEBUG:teuthology.parallel:result is None 2024-04-02T07:22:26.612 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2024-04-02T07:22:26.612 DEBUG:teuthology.parallel:result is None 2024-04-02T07:22:26.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.617+0000 7fe0f2800640 1 -- 172.21.15.55:0/3860371244 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe0ec1532a0 con 0x7fe0ec0cb100 2024-04-02T07:22:26.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.621+0000 7fe0e3400640 1 -- 172.21.15.55:0/3860371244 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe0ec1532a0 con 0x7fe0ec0cb100 2024-04-02T07:22:26.624 INFO:teuthology.orchestra.run.smithi055.stdout:55834574854 2024-04-02T07:22:26.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.621+0000 7fe0f2800640 1 -- 172.21.15.55:0/3860371244 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe0cc066690 msgr2=0x7fe0cc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.621+0000 7fe0f2800640 1 --2- 172.21.15.55:0/3860371244 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe0cc066690 0x7fe0cc068b50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe0dc000f70 tx=0x7fe0dc009040 comp rx=0 tx=0).stop 2024-04-02T07:22:26.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.621+0000 7fe0f2800640 1 -- 172.21.15.55:0/3860371244 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0ec0cb100 msgr2=0x7fe0ec1fd710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.621+0000 7fe0f2800640 1 --2- 172.21.15.55:0/3860371244 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0ec0cb100 0x7fe0ec1fd710 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe0e400ebb0 tx=0x7fe0e400c490 comp rx=0 tx=0).stop 2024-04-02T07:22:26.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.621+0000 7fe0f2800640 1 -- 172.21.15.55:0/3860371244 shutdown_connections 2024-04-02T07:22:26.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.621+0000 7fe0f2800640 1 --2- 172.21.15.55:0/3860371244 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0ec0cb100 0x7fe0ec1fd710 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.621+0000 7fe0f2800640 1 --2- 172.21.15.55:0/3860371244 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe0cc066690 0x7fe0cc068b50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.621+0000 7fe0f2800640 1 --2- 172.21.15.55:0/3860371244 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0ec0b0650 0x7fe0ec152b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.621+0000 7fe0f2800640 1 --2- 172.21.15.55:0/3860371244 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0ec06ce40 0x7fe0ec164f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.621+0000 7fe0f2800640 1 -- 172.21.15.55:0/3860371244 >> 172.21.15.55:0/3860371244 conn(0x7fe0ec065a80 msgr2=0x7fe0ec0c90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:26.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.621+0000 7fe0f2800640 1 -- 172.21.15.55:0/3860371244 shutdown_connections 2024-04-02T07:22:26.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.621+0000 7fe0f2800640 1 -- 172.21.15.55:0/3860371244 wait complete. 2024-04-02T07:22:26.646 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2024-04-02T07:22:26.646 DEBUG:teuthology.parallel:result is None 2024-04-02T07:22:26.647 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-02T07:22:26.647 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:22:26.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.825+0000 7f3f88800640 1 Processor -- start 2024-04-02T07:22:26.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.825+0000 7f3f88800640 1 -- start start 2024-04-02T07:22:26.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.825+0000 7f3f88800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f80159a00 0x7f3f800cb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.825+0000 7f3f88800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3f800cc780 0x7f3f800cd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.825+0000 7f3f88800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f800ca070 con 0x7f3f800cdb20 2024-04-02T07:22:26.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.825+0000 7f3f88800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f80159de0 con 0x7f3f800cc780 2024-04-02T07:22:26.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.825+0000 7f3f88800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f800cd670 con 0x7f3f80159a00 2024-04-02T07:22:26.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.825+0000 7f3f85400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3f800cc780 0x7f3f800cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.825+0000 7f3f85400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3f800cc780 0x7f3f800cd130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60934/0 (socket says 172.21.15.55:60934) 2024-04-02T07:22:26.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.825+0000 7f3f85400640 1 -- 172.21.15.55:0/2695902473 learned_addr learned my addr 172.21.15.55:0/2695902473 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:26.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.825+0000 7f3f85e00640 1 --2- 172.21.15.55:0/2695902473 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f80159a00 0x7f3f800cb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.825+0000 7f3f85e00640 1 -- 172.21.15.55:0/2695902473 >> v2:172.21.15.55:3300/0 conn(0x7f3f800cc780 msgr2=0x7f3f800cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:26.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.825+0000 7f3f85e00640 1 --2- 172.21.15.55:0/2695902473 >> v2:172.21.15.55:3300/0 conn(0x7f3f800cc780 0x7f3f800cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.825+0000 7f3f85e00640 1 -- 172.21.15.55:0/2695902473 >> v1:172.21.15.106:6789/0 conn(0x7f3f800cdb20 legacy=0x7f3f8006d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.825+0000 7f3f85e00640 1 -- 172.21.15.55:0/2695902473 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f800cd8f0 con 0x7f3f80159a00 2024-04-02T07:22:26.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.825+0000 7f3f85400640 1 --2- 172.21.15.55:0/2695902473 >> v2:172.21.15.55:3300/0 conn(0x7f3f800cc780 0x7f3f800cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:26.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.829+0000 7f3f85e00640 1 --2- 172.21.15.55:0/2695902473 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f80159a00 0x7f3f800cb060 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3f740097c0 tx=0x7f3f7401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c543839c91e07b92 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.829+0000 7f3f84a00640 1 -- 172.21.15.55:0/2695902473 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f740ab600 con 0x7f3f80159a00 2024-04-02T07:22:26.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.829+0000 7f3f84a00640 1 -- 172.21.15.55:0/2695902473 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f740a7050 con 0x7f3f80159a00 2024-04-02T07:22:26.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.829+0000 7f3f84a00640 1 -- 172.21.15.55:0/2695902473 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f740ab980 con 0x7f3f80159a00 2024-04-02T07:22:26.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.829+0000 7f3f88800640 1 -- 172.21.15.55:0/2695902473 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f80159a00 msgr2=0x7f3f800cb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.829+0000 7f3f88800640 1 --2- 172.21.15.55:0/2695902473 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f80159a00 0x7f3f800cb060 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f3f740097c0 tx=0x7f3f7401c4a0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.829+0000 7f3f88800640 1 -- 172.21.15.55:0/2695902473 shutdown_connections 2024-04-02T07:22:26.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.829+0000 7f3f88800640 1 --2- 172.21.15.55:0/2695902473 >> v2:172.21.15.55:3300/0 conn(0x7f3f800cc780 0x7f3f800cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.829+0000 7f3f88800640 1 --2- 172.21.15.55:0/2695902473 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f80159a00 0x7f3f800cb060 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.829+0000 7f3f88800640 1 -- 172.21.15.55:0/2695902473 >> 172.21.15.55:0/2695902473 conn(0x7f3f80098a10 msgr2=0x7f3f800b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:26.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.829+0000 7f3f88800640 1 -- 172.21.15.55:0/2695902473 shutdown_connections 2024-04-02T07:22:26.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.829+0000 7f3f88800640 1 -- 172.21.15.55:0/2695902473 wait complete. 2024-04-02T07:22:26.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f88800640 1 Processor -- start 2024-04-02T07:22:26.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f88800640 1 -- start start 2024-04-02T07:22:26.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f88800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f800cc780 0x7f3f80151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f88800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f800cdb20 0x7f3f800af8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f88800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f80159a00 0x7f3f800afe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f88800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f800c66d0 con 0x7f3f80159a00 2024-04-02T07:22:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f88800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f800c69b0 con 0x7f3f800cdb20 2024-04-02T07:22:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f88800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f800c6c90 con 0x7f3f800cc780 2024-04-02T07:22:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f86800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f80159a00 0x7f3f800afe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f86800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f80159a00 0x7f3f800afe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60944/0 (socket says 172.21.15.55:60944) 2024-04-02T07:22:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f86800640 1 -- 172.21.15.55:0/919798631 learned_addr learned my addr 172.21.15.55:0/919798631 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f85400640 1 --2- 172.21.15.55:0/919798631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f800cdb20 0x7f3f800af8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f85e00640 1 --2- 172.21.15.55:0/919798631 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f800cc780 0x7f3f80151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f86800640 1 -- 172.21.15.55:0/919798631 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f800cc780 msgr2=0x7f3f80151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f86800640 1 --2- 172.21.15.55:0/919798631 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f800cc780 0x7f3f80151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f86800640 1 -- 172.21.15.55:0/919798631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f800cdb20 msgr2=0x7f3f800af8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f86800640 1 --2- 172.21.15.55:0/919798631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f800cdb20 0x7f3f800af8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f86800640 1 -- 172.21.15.55:0/919798631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f700094d0 con 0x7f3f80159a00 2024-04-02T07:22:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f85400640 1 --2- 172.21.15.55:0/919798631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f800cdb20 0x7f3f800af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f86800640 1 --2- 172.21.15.55:0/919798631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f80159a00 0x7f3f800afe00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00c770 tx=0x7f3f7c00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f7a000640 1 -- 172.21.15.55:0/919798631 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c003b80 con 0x7f3f80159a00 2024-04-02T07:22:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f7a000640 1 -- 172.21.15.55:0/919798631 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7c003ce0 con 0x7f3f80159a00 2024-04-02T07:22:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f88800640 1 -- 172.21.15.55:0/919798631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f74009420 con 0x7f3f80159a00 2024-04-02T07:22:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f7a000640 1 -- 172.21.15.55:0/919798631 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c00aa90 con 0x7f3f80159a00 2024-04-02T07:22:26.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.833+0000 7f3f88800640 1 -- 172.21.15.55:0/919798631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f800ce4c0 con 0x7f3f80159a00 2024-04-02T07:22:26.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.837+0000 7f3f88800640 1 -- 172.21.15.55:0/919798631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f80066c90 con 0x7f3f80159a00 2024-04-02T07:22:26.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.837+0000 7f3f7a000640 1 -- 172.21.15.55:0/919798631 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3f7c00abf0 con 0x7f3f80159a00 2024-04-02T07:22:26.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.837+0000 7f3f7a000640 1 --2- 172.21.15.55:0/919798631 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f64066690 0x7f3f64068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:26.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.837+0000 7f3f7a000640 1 -- 172.21.15.55:0/919798631 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f7c083ff0 con 0x7f3f80159a00 2024-04-02T07:22:26.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.837+0000 7f3f85e00640 1 --2- 172.21.15.55:0/919798631 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f64066690 0x7f3f64068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:26.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.837+0000 7f3f85e00640 1 --2- 172.21.15.55:0/919798631 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f64066690 0x7f3f64068b50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3f740ad000 tx=0x7f3f740a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:26.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:26.841+0000 7f3f7a000640 1 -- 172.21.15.55:0/919798631 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3f7c0b5980 con 0x7f3f80159a00 2024-04-02T07:22:27.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.001+0000 7f3f88800640 1 -- 172.21.15.55:0/919798631 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f800ce340 con 0x7f3f64066690 2024-04-02T07:22:27.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.009+0000 7f3f7a000640 1 -- 172.21.15.55:0/919798631 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264631 (secure 0 0 0) 0x7f3f740bf450 con 0x7f3f64066690 2024-04-02T07:22:27.017 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:27.018 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:22:27.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.013+0000 7f3f88800640 1 -- 172.21.15.55:0/919798631 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f64066690 msgr2=0x7f3f64068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.013+0000 7f3f88800640 1 --2- 172.21.15.55:0/919798631 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f64066690 0x7f3f64068b50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3f740ad000 tx=0x7f3f740a6000 comp rx=0 tx=0).stop 2024-04-02T07:22:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.013+0000 7f3f88800640 1 -- 172.21.15.55:0/919798631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f80159a00 msgr2=0x7f3f800afe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.013+0000 7f3f88800640 1 --2- 172.21.15.55:0/919798631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f80159a00 0x7f3f800afe00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c00c770 tx=0x7f3f7c00cc30 comp rx=0 tx=0).stop 2024-04-02T07:22:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.013+0000 7f3f88800640 1 -- 172.21.15.55:0/919798631 shutdown_connections 2024-04-02T07:22:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.013+0000 7f3f88800640 1 --2- 172.21.15.55:0/919798631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f80159a00 0x7f3f800afe00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.013+0000 7f3f88800640 1 --2- 172.21.15.55:0/919798631 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f64066690 0x7f3f64068b50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.013+0000 7f3f88800640 1 --2- 172.21.15.55:0/919798631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f800cdb20 0x7f3f800af8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.013+0000 7f3f88800640 1 --2- 172.21.15.55:0/919798631 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f800cc780 0x7f3f80151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.013+0000 7f3f88800640 1 -- 172.21.15.55:0/919798631 >> 172.21.15.55:0/919798631 conn(0x7f3f80098a10 msgr2=0x7f3f800b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.013+0000 7f3f88800640 1 -- 172.21.15.55:0/919798631 shutdown_connections 2024-04-02T07:22:27.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.013+0000 7f3f88800640 1 -- 172.21.15.55:0/919798631 wait complete. 2024-04-02T07:22:27.036 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-02T07:22:26.337094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235376,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739344,"statfs":{"total":773094113280,"available":772853088256,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.128333"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371828+0000","last_change":"2024-04-02T07:22:18.242427+0000","last_active":"2024-04-02T07:22:20.371828+0000","last_peered":"2024-04-02T07:22:20.371828+0000","last_clean":"2024-04-02T07:22:20.371828+0000","last_became_active":"2024-04-02T07:22:18.241587+0000","last_became_peered":"2024-04-02T07:22:18.241587+0000","last_unstale":"2024-04-02T07:22:20.371828+0000","last_undegraded":"2024-04-02T07:22:20.371828+0000","last_fullsized":"2024-04-02T07:22:20.371828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:17:53.201974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369937+0000","last_change":"2024-04-02T07:22:18.231108+0000","last_active":"2024-04-02T07:22:20.369937+0000","last_peered":"2024-04-02T07:22:20.369937+0000","last_clean":"2024-04-02T07:22:20.369937+0000","last_became_active":"2024-04-02T07:22:18.230786+0000","last_became_peered":"2024-04-02T07:22:18.230786+0000","last_unstale":"2024-04-02T07:22:20.369937+0000","last_undegraded":"2024-04-02T07:22:20.369937+0000","last_fullsized":"2024-04-02T07:22:20.369937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:12.939631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.219986+0000","last_change":"2024-04-02T07:22:18.232786+0000","last_active":"2024-04-02T07:22:19.219986+0000","last_peered":"2024-04-02T07:22:19.219986+0000","last_clean":"2024-04-02T07:22:19.219986+0000","last_became_active":"2024-04-02T07:22:18.232534+0000","last_became_peered":"2024-04-02T07:22:18.232534+0000","last_unstale":"2024-04-02T07:22:19.219986+0000","last_undegraded":"2024-04-02T07:22:19.219986+0000","last_fullsized":"2024-04-02T07:22:19.219986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:12.939631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370409+0000","last_change":"2024-04-02T07:22:18.249344+0000","last_active":"2024-04-02T07:22:20.370409+0000","last_peered":"2024-04-02T07:22:20.370409+0000","last_clean":"2024-04-02T07:22:20.370409+0000","last_became_active":"2024-04-02T07:22:18.249100+0000","last_became_peered":"2024-04-02T07:22:18.249100+0000","last_unstale":"2024-04-02T07:22:20.370409+0000","last_undegraded":"2024-04-02T07:22:20.370409+0000","last_fullsized":"2024-04-02T07:22:20.370409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:12:09.974224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371672+0000","last_change":"2024-04-02T07:22:18.248933+0000","last_active":"2024-04-02T07:22:20.371672+0000","last_peered":"2024-04-02T07:22:20.371672+0000","last_clean":"2024-04-02T07:22:20.371672+0000","last_became_active":"2024-04-02T07:22:18.248668+0000","last_became_peered":"2024-04-02T07:22:18.248668+0000","last_unstale":"2024-04-02T07:22:20.371672+0000","last_undegraded":"2024-04-02T07:22:20.371672+0000","last_fullsized":"2024-04-02T07:22:20.371672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:14:27.524425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370104+0000","last_change":"2024-04-02T07:22:18.231406+0000","last_active":"2024-04-02T07:22:20.370104+0000","last_peered":"2024-04-02T07:22:20.370104+0000","last_clean":"2024-04-02T07:22:20.370104+0000","last_became_active":"2024-04-02T07:22:18.231169+0000","last_became_peered":"2024-04-02T07:22:18.231169+0000","last_unstale":"2024-04-02T07:22:20.370104+0000","last_undegraded":"2024-04-02T07:22:20.370104+0000","last_fullsized":"2024-04-02T07:22:20.370104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:43:52.871035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371173+0000","last_change":"2024-04-02T07:22:18.240447+0000","last_active":"2024-04-02T07:22:20.371173+0000","last_peered":"2024-04-02T07:22:20.371173+0000","last_clean":"2024-04-02T07:22:20.371173+0000","last_became_active":"2024-04-02T07:22:18.239731+0000","last_became_peered":"2024-04-02T07:22:18.239731+0000","last_unstale":"2024-04-02T07:22:20.371173+0000","last_undegraded":"2024-04-02T07:22:20.371173+0000","last_fullsized":"2024-04-02T07:22:20.371173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:18:24.609373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221004+0000","last_change":"2024-04-02T07:22:18.237786+0000","last_active":"2024-04-02T07:22:19.221004+0000","last_peered":"2024-04-02T07:22:19.221004+0000","last_clean":"2024-04-02T07:22:19.221004+0000","last_became_active":"2024-04-02T07:22:18.237504+0000","last_became_peered":"2024-04-02T07:22:18.237504+0000","last_unstale":"2024-04-02T07:22:19.221004+0000","last_undegraded":"2024-04-02T07:22:19.221004+0000","last_fullsized":"2024-04-02T07:22:19.221004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:17:53.201974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371931+0000","last_change":"2024-04-02T07:22:18.242614+0000","last_active":"2024-04-02T07:22:20.371931+0000","last_peered":"2024-04-02T07:22:20.371931+0000","last_clean":"2024-04-02T07:22:20.371931+0000","last_became_active":"2024-04-02T07:22:18.242136+0000","last_became_peered":"2024-04-02T07:22:18.242136+0000","last_unstale":"2024-04-02T07:22:20.371931+0000","last_undegraded":"2024-04-02T07:22:20.371931+0000","last_fullsized":"2024-04-02T07:22:20.371931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:27:50.468893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371061+0000","last_change":"2024-04-02T07:22:18.232563+0000","last_active":"2024-04-02T07:22:20.371061+0000","last_peered":"2024-04-02T07:22:20.371061+0000","last_clean":"2024-04-02T07:22:20.371061+0000","last_became_active":"2024-04-02T07:22:18.232213+0000","last_became_peered":"2024-04-02T07:22:18.232213+0000","last_unstale":"2024-04-02T07:22:20.371061+0000","last_undegraded":"2024-04-02T07:22:20.371061+0000","last_fullsized":"2024-04-02T07:22:20.371061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:12.939631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370781+0000","last_change":"2024-04-02T07:22:18.232430+0000","last_active":"2024-04-02T07:22:20.370781+0000","last_peered":"2024-04-02T07:22:20.370781+0000","last_clean":"2024-04-02T07:22:20.370781+0000","last_became_active":"2024-04-02T07:22:18.232147+0000","last_became_peered":"2024-04-02T07:22:18.232147+0000","last_unstale":"2024-04-02T07:22:20.370781+0000","last_undegraded":"2024-04-02T07:22:20.370781+0000","last_fullsized":"2024-04-02T07:22:20.370781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:36:43.798159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.222736+0000","last_change":"2024-04-02T07:22:18.235518+0000","last_active":"2024-04-02T07:22:19.222736+0000","last_peered":"2024-04-02T07:22:19.222736+0000","last_clean":"2024-04-02T07:22:19.222736+0000","last_became_active":"2024-04-02T07:22:18.235232+0000","last_became_peered":"2024-04-02T07:22:18.235232+0000","last_unstale":"2024-04-02T07:22:19.222736+0000","last_undegraded":"2024-04-02T07:22:19.222736+0000","last_fullsized":"2024-04-02T07:22:19.222736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:28:35.572801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221398+0000","last_change":"2024-04-02T07:22:18.242642+0000","last_active":"2024-04-02T07:22:19.221398+0000","last_peered":"2024-04-02T07:22:19.221398+0000","last_clean":"2024-04-02T07:22:19.221398+0000","last_became_active":"2024-04-02T07:22:18.242350+0000","last_became_peered":"2024-04-02T07:22:18.242350+0000","last_unstale":"2024-04-02T07:22:19.221398+0000","last_undegraded":"2024-04-02T07:22:19.221398+0000","last_fullsized":"2024-04-02T07:22:19.221398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:40:34.209765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.219577+0000","last_change":"2024-04-02T07:22:18.240215+0000","last_active":"2024-04-02T07:22:19.219577+0000","last_peered":"2024-04-02T07:22:19.219577+0000","last_clean":"2024-04-02T07:22:19.219577+0000","last_became_active":"2024-04-02T07:22:18.239918+0000","last_became_peered":"2024-04-02T07:22:18.239918+0000","last_unstale":"2024-04-02T07:22:19.219577+0000","last_undegraded":"2024-04-02T07:22:19.219577+0000","last_fullsized":"2024-04-02T07:22:19.219577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:07:43.747365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369667+0000","last_change":"2024-04-02T07:22:18.244474+0000","last_active":"2024-04-02T07:22:20.369667+0000","last_peered":"2024-04-02T07:22:20.369667+0000","last_clean":"2024-04-02T07:22:20.369667+0000","last_became_active":"2024-04-02T07:22:18.244222+0000","last_became_peered":"2024-04-02T07:22:18.244222+0000","last_unstale":"2024-04-02T07:22:20.369667+0000","last_undegraded":"2024-04-02T07:22:20.369667+0000","last_fullsized":"2024-04-02T07:22:20.369667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:47:20.129295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369896+0000","last_change":"2024-04-02T07:22:18.231427+0000","last_active":"2024-04-02T07:22:20.369896+0000","last_peered":"2024-04-02T07:22:20.369896+0000","last_clean":"2024-04-02T07:22:20.369896+0000","last_became_active":"2024-04-02T07:22:18.230966+0000","last_became_peered":"2024-04-02T07:22:18.230966+0000","last_unstale":"2024-04-02T07:22:20.369896+0000","last_undegraded":"2024-04-02T07:22:20.369896+0000","last_fullsized":"2024-04-02T07:22:20.369896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:25.644846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370768+0000","last_change":"2024-04-02T07:22:18.247729+0000","last_active":"2024-04-02T07:22:20.370768+0000","last_peered":"2024-04-02T07:22:20.370768+0000","last_clean":"2024-04-02T07:22:20.370768+0000","last_became_active":"2024-04-02T07:22:18.247488+0000","last_became_peered":"2024-04-02T07:22:18.247488+0000","last_unstale":"2024-04-02T07:22:20.370768+0000","last_undegraded":"2024-04-02T07:22:20.370768+0000","last_fullsized":"2024-04-02T07:22:20.370768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:10:08.342854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369749+0000","last_change":"2024-04-02T07:22:18.238472+0000","last_active":"2024-04-02T07:22:20.369749+0000","last_peered":"2024-04-02T07:22:20.369749+0000","last_clean":"2024-04-02T07:22:20.369749+0000","last_became_active":"2024-04-02T07:22:18.238254+0000","last_became_peered":"2024-04-02T07:22:18.238254+0000","last_unstale":"2024-04-02T07:22:20.369749+0000","last_undegraded":"2024-04-02T07:22:20.369749+0000","last_fullsized":"2024-04-02T07:22:20.369749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:55:47.475859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371682+0000","last_change":"2024-04-02T07:22:18.247532+0000","last_active":"2024-04-02T07:22:20.371682+0000","last_peered":"2024-04-02T07:22:20.371682+0000","last_clean":"2024-04-02T07:22:20.371682+0000","last_became_active":"2024-04-02T07:22:18.247218+0000","last_became_peered":"2024-04-02T07:22:18.247218+0000","last_unstale":"2024-04-02T07:22:20.371682+0000","last_undegraded":"2024-04-02T07:22:20.371682+0000","last_fullsized":"2024-04-02T07:22:20.371682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:43:52.871035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370136+0000","last_change":"2024-04-02T07:22:18.238253+0000","last_active":"2024-04-02T07:22:20.370136+0000","last_peered":"2024-04-02T07:22:20.370136+0000","last_clean":"2024-04-02T07:22:20.370136+0000","last_became_active":"2024-04-02T07:22:18.237955+0000","last_became_peered":"2024-04-02T07:22:18.237955+0000","last_unstale":"2024-04-02T07:22:20.370136+0000","last_undegraded":"2024-04-02T07:22:20.370136+0000","last_fullsized":"2024-04-02T07:22:20.370136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:40:34.209765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.219847+0000","last_change":"2024-04-02T07:22:18.240034+0000","last_active":"2024-04-02T07:22:19.219847+0000","last_peered":"2024-04-02T07:22:19.219847+0000","last_clean":"2024-04-02T07:22:19.219847+0000","last_became_active":"2024-04-02T07:22:18.239673+0000","last_became_peered":"2024-04-02T07:22:18.239673+0000","last_unstale":"2024-04-02T07:22:19.219847+0000","last_undegraded":"2024-04-02T07:22:19.219847+0000","last_fullsized":"2024-04-02T07:22:19.219847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:40:34.209765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370287+0000","last_change":"2024-04-02T07:22:18.250123+0000","last_active":"2024-04-02T07:22:20.370287+0000","last_peered":"2024-04-02T07:22:20.370287+0000","last_clean":"2024-04-02T07:22:20.370287+0000","last_became_active":"2024-04-02T07:22:18.249705+0000","last_became_peered":"2024-04-02T07:22:18.249705+0000","last_unstale":"2024-04-02T07:22:20.370287+0000","last_undegraded":"2024-04-02T07:22:20.370287+0000","last_fullsized":"2024-04-02T07:22:20.370287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:14:27.524425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221095+0000","last_change":"2024-04-02T07:22:18.220352+0000","last_active":"2024-04-02T07:22:19.221095+0000","last_peered":"2024-04-02T07:22:19.221095+0000","last_clean":"2024-04-02T07:22:19.221095+0000","last_became_active":"2024-04-02T07:22:18.219970+0000","last_became_peered":"2024-04-02T07:22:18.219970+0000","last_unstale":"2024-04-02T07:22:19.221095+0000","last_undegraded":"2024-04-02T07:22:19.221095+0000","last_fullsized":"2024-04-02T07:22:19.221095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:47:20.129295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369974+0000","last_change":"2024-04-02T07:22:18.243492+0000","last_active":"2024-04-02T07:22:20.369974+0000","last_peered":"2024-04-02T07:22:20.369974+0000","last_clean":"2024-04-02T07:22:20.369974+0000","last_became_active":"2024-04-02T07:22:18.241420+0000","last_became_peered":"2024-04-02T07:22:18.241420+0000","last_unstale":"2024-04-02T07:22:20.369974+0000","last_undegraded":"2024-04-02T07:22:20.369974+0000","last_fullsized":"2024-04-02T07:22:20.369974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:40:34.209765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221583+0000","last_change":"2024-04-02T07:22:18.220417+0000","last_active":"2024-04-02T07:22:19.221583+0000","last_peered":"2024-04-02T07:22:19.221583+0000","last_clean":"2024-04-02T07:22:19.221583+0000","last_became_active":"2024-04-02T07:22:18.220172+0000","last_became_peered":"2024-04-02T07:22:18.220172+0000","last_unstale":"2024-04-02T07:22:19.221583+0000","last_undegraded":"2024-04-02T07:22:19.221583+0000","last_fullsized":"2024-04-02T07:22:19.221583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:04:59.919960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371096+0000","last_change":"2024-04-02T07:22:18.248792+0000","last_active":"2024-04-02T07:22:20.371096+0000","last_peered":"2024-04-02T07:22:20.371096+0000","last_clean":"2024-04-02T07:22:20.371096+0000","last_became_active":"2024-04-02T07:22:18.248524+0000","last_became_peered":"2024-04-02T07:22:18.248524+0000","last_unstale":"2024-04-02T07:22:20.371096+0000","last_undegraded":"2024-04-02T07:22:20.371096+0000","last_fullsized":"2024-04-02T07:22:20.371096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:59:52.607949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369918+0000","last_change":"2024-04-02T07:22:18.247315+0000","last_active":"2024-04-02T07:22:20.369918+0000","last_peered":"2024-04-02T07:22:20.369918+0000","last_clean":"2024-04-02T07:22:20.369918+0000","last_became_active":"2024-04-02T07:22:18.247031+0000","last_became_peered":"2024-04-02T07:22:18.247031+0000","last_unstale":"2024-04-02T07:22:20.369918+0000","last_undegraded":"2024-04-02T07:22:20.369918+0000","last_fullsized":"2024-04-02T07:22:20.369918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:59:52.607949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221415+0000","last_change":"2024-04-02T07:22:18.220991+0000","last_active":"2024-04-02T07:22:19.221415+0000","last_peered":"2024-04-02T07:22:19.221415+0000","last_clean":"2024-04-02T07:22:19.221415+0000","last_became_active":"2024-04-02T07:22:18.219487+0000","last_became_peered":"2024-04-02T07:22:18.219487+0000","last_unstale":"2024-04-02T07:22:19.221415+0000","last_undegraded":"2024-04-02T07:22:19.221415+0000","last_fullsized":"2024-04-02T07:22:19.221415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:14:02.133890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.219941+0000","last_change":"2024-04-02T07:22:18.226337+0000","last_active":"2024-04-02T07:22:19.219941+0000","last_peered":"2024-04-02T07:22:19.219941+0000","last_clean":"2024-04-02T07:22:19.219941+0000","last_became_active":"2024-04-02T07:22:18.225219+0000","last_became_peered":"2024-04-02T07:22:18.225219+0000","last_unstale":"2024-04-02T07:22:19.219941+0000","last_undegraded":"2024-04-02T07:22:19.219941+0000","last_fullsized":"2024-04-02T07:22:19.219941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:57:25.335137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370381+0000","last_change":"2024-04-02T07:22:18.248548+0000","last_active":"2024-04-02T07:22:20.370381+0000","last_peered":"2024-04-02T07:22:20.370381+0000","last_clean":"2024-04-02T07:22:20.370381+0000","last_became_active":"2024-04-02T07:22:18.248275+0000","last_became_peered":"2024-04-02T07:22:18.248275+0000","last_unstale":"2024-04-02T07:22:20.370381+0000","last_undegraded":"2024-04-02T07:22:20.370381+0000","last_fullsized":"2024-04-02T07:22:20.370381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:14:02.133890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369484+0000","last_change":"2024-04-02T07:22:18.239465+0000","last_active":"2024-04-02T07:22:20.369484+0000","last_peered":"2024-04-02T07:22:20.369484+0000","last_clean":"2024-04-02T07:22:20.369484+0000","last_became_active":"2024-04-02T07:22:18.239184+0000","last_became_peered":"2024-04-02T07:22:18.239184+0000","last_unstale":"2024-04-02T07:22:20.369484+0000","last_undegraded":"2024-04-02T07:22:20.369484+0000","last_fullsized":"2024-04-02T07:22:20.369484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:08:21.191481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370012+0000","last_change":"2024-04-02T07:22:18.234263+0000","last_active":"2024-04-02T07:22:20.370012+0000","last_peered":"2024-04-02T07:22:20.370012+0000","last_clean":"2024-04-02T07:22:20.370012+0000","last_became_active":"2024-04-02T07:22:18.233927+0000","last_became_peered":"2024-04-02T07:22:18.233927+0000","last_unstale":"2024-04-02T07:22:20.370012+0000","last_undegraded":"2024-04-02T07:22:20.370012+0000","last_fullsized":"2024-04-02T07:22:20.370012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:04:59.919960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.222575+0000","last_change":"2024-04-02T07:22:18.233666+0000","last_active":"2024-04-02T07:22:19.222575+0000","last_peered":"2024-04-02T07:22:19.222575+0000","last_clean":"2024-04-02T07:22:19.222575+0000","last_became_active":"2024-04-02T07:22:18.233403+0000","last_became_peered":"2024-04-02T07:22:18.233403+0000","last_unstale":"2024-04-02T07:22:19.222575+0000","last_undegraded":"2024-04-02T07:22:19.222575+0000","last_fullsized":"2024-04-02T07:22:19.222575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:57:55.129547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221437+0000","last_change":"2024-04-02T07:22:17.816995+0000","last_active":"2024-04-02T07:22:19.221437+0000","last_peered":"2024-04-02T07:22:19.221437+0000","last_clean":"2024-04-02T07:22:19.221437+0000","last_became_active":"2024-04-02T07:22:17.816648+0000","last_became_peered":"2024-04-02T07:22:17.816648+0000","last_unstale":"2024-04-02T07:22:19.221437+0000","last_undegraded":"2024-04-02T07:22:19.221437+0000","last_fullsized":"2024-04-02T07:22:19.221437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:26:13.873489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.220049+0000","last_change":"2024-04-02T07:22:18.238198+0000","last_active":"2024-04-02T07:22:19.220049+0000","last_peered":"2024-04-02T07:22:19.220049+0000","last_clean":"2024-04-02T07:22:19.220049+0000","last_became_active":"2024-04-02T07:22:18.236795+0000","last_became_peered":"2024-04-02T07:22:18.236795+0000","last_unstale":"2024-04-02T07:22:19.220049+0000","last_undegraded":"2024-04-02T07:22:19.220049+0000","last_fullsized":"2024-04-02T07:22:19.220049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:14:02.133890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370281+0000","last_change":"2024-04-02T07:22:17.818491+0000","last_active":"2024-04-02T07:22:20.370281+0000","last_peered":"2024-04-02T07:22:20.370281+0000","last_clean":"2024-04-02T07:22:20.370281+0000","last_became_active":"2024-04-02T07:22:17.817664+0000","last_became_peered":"2024-04-02T07:22:17.817664+0000","last_unstale":"2024-04-02T07:22:20.370281+0000","last_undegraded":"2024-04-02T07:22:20.370281+0000","last_fullsized":"2024-04-02T07:22:20.370281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:10:54.215675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221161+0000","last_change":"2024-04-02T07:22:17.819716+0000","last_active":"2024-04-02T07:22:19.221161+0000","last_peered":"2024-04-02T07:22:19.221161+0000","last_clean":"2024-04-02T07:22:19.221161+0000","last_became_active":"2024-04-02T07:22:17.819392+0000","last_became_peered":"2024-04-02T07:22:17.819392+0000","last_unstale":"2024-04-02T07:22:19.221161+0000","last_undegraded":"2024-04-02T07:22:19.221161+0000","last_fullsized":"2024-04-02T07:22:19.221161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:11:57.231785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221071+0000","last_change":"2024-04-02T07:22:18.234279+0000","last_active":"2024-04-02T07:22:19.221071+0000","last_peered":"2024-04-02T07:22:19.221071+0000","last_clean":"2024-04-02T07:22:19.221071+0000","last_became_active":"2024-04-02T07:22:18.233854+0000","last_became_peered":"2024-04-02T07:22:18.233854+0000","last_unstale":"2024-04-02T07:22:19.221071+0000","last_undegraded":"2024-04-02T07:22:19.221071+0000","last_fullsized":"2024-04-02T07:22:19.221071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:12.939631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369992+0000","last_change":"2024-04-02T07:22:17.826560+0000","last_active":"2024-04-02T07:22:20.369992+0000","last_peered":"2024-04-02T07:22:20.369992+0000","last_clean":"2024-04-02T07:22:20.369992+0000","last_became_active":"2024-04-02T07:22:17.826211+0000","last_became_peered":"2024-04-02T07:22:17.826211+0000","last_unstale":"2024-04-02T07:22:20.369992+0000","last_undegraded":"2024-04-02T07:22:20.369992+0000","last_fullsized":"2024-04-02T07:22:20.369992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:26:13.873489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369564+0000","last_change":"2024-04-02T07:22:18.229986+0000","last_active":"2024-04-02T07:22:20.369564+0000","last_peered":"2024-04-02T07:22:20.369564+0000","last_clean":"2024-04-02T07:22:20.369564+0000","last_became_active":"2024-04-02T07:22:18.223834+0000","last_became_peered":"2024-04-02T07:22:18.223834+0000","last_unstale":"2024-04-02T07:22:20.369564+0000","last_undegraded":"2024-04-02T07:22:20.369564+0000","last_fullsized":"2024-04-02T07:22:20.369564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:04:59.919960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371334+0000","last_change":"2024-04-02T07:22:17.829273+0000","last_active":"2024-04-02T07:22:20.371334+0000","last_peered":"2024-04-02T07:22:20.371334+0000","last_clean":"2024-04-02T07:22:20.371334+0000","last_became_active":"2024-04-02T07:22:17.829016+0000","last_became_peered":"2024-04-02T07:22:17.829016+0000","last_unstale":"2024-04-02T07:22:20.371334+0000","last_undegraded":"2024-04-02T07:22:20.371334+0000","last_fullsized":"2024-04-02T07:22:20.371334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:28:34.570227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370788+0000","last_change":"2024-04-02T07:22:18.245393+0000","last_active":"2024-04-02T07:22:20.370788+0000","last_peered":"2024-04-02T07:22:20.370788+0000","last_clean":"2024-04-02T07:22:20.370788+0000","last_became_active":"2024-04-02T07:22:18.245061+0000","last_became_peered":"2024-04-02T07:22:18.245061+0000","last_unstale":"2024-04-02T07:22:20.370788+0000","last_undegraded":"2024-04-02T07:22:20.370788+0000","last_fullsized":"2024-04-02T07:22:20.370788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:46:42.176195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370581+0000","last_change":"2024-04-02T07:22:17.828107+0000","last_active":"2024-04-02T07:22:20.370581+0000","last_peered":"2024-04-02T07:22:20.370581+0000","last_clean":"2024-04-02T07:22:20.370581+0000","last_became_active":"2024-04-02T07:22:17.825331+0000","last_became_peered":"2024-04-02T07:22:17.825331+0000","last_unstale":"2024-04-02T07:22:20.370581+0000","last_undegraded":"2024-04-02T07:22:20.370581+0000","last_fullsized":"2024-04-02T07:22:20.370581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:28:39.704218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.220251+0000","last_change":"2024-04-02T07:22:18.232172+0000","last_active":"2024-04-02T07:22:19.220251+0000","last_peered":"2024-04-02T07:22:19.220251+0000","last_clean":"2024-04-02T07:22:19.220251+0000","last_became_active":"2024-04-02T07:22:18.231924+0000","last_became_peered":"2024-04-02T07:22:18.231924+0000","last_unstale":"2024-04-02T07:22:19.220251+0000","last_undegraded":"2024-04-02T07:22:19.220251+0000","last_fullsized":"2024-04-02T07:22:19.220251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:36:43.798159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369928+0000","last_change":"2024-04-02T07:22:17.825495+0000","last_active":"2024-04-02T07:22:20.369928+0000","last_peered":"2024-04-02T07:22:20.369928+0000","last_clean":"2024-04-02T07:22:20.369928+0000","last_became_active":"2024-04-02T07:22:17.825231+0000","last_became_peered":"2024-04-02T07:22:17.825231+0000","last_unstale":"2024-04-02T07:22:20.369928+0000","last_undegraded":"2024-04-02T07:22:20.369928+0000","last_fullsized":"2024-04-02T07:22:20.369928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:55:46.473285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.222760+0000","last_change":"2024-04-02T07:22:18.239881+0000","last_active":"2024-04-02T07:22:19.222760+0000","last_peered":"2024-04-02T07:22:19.222760+0000","last_clean":"2024-04-02T07:22:19.222760+0000","last_became_active":"2024-04-02T07:22:18.239628+0000","last_became_peered":"2024-04-02T07:22:18.239628+0000","last_unstale":"2024-04-02T07:22:19.222760+0000","last_undegraded":"2024-04-02T07:22:19.222760+0000","last_fullsized":"2024-04-02T07:22:19.222760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:55:47.475859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370670+0000","last_change":"2024-04-02T07:22:17.823545+0000","last_active":"2024-04-02T07:22:20.370670+0000","last_peered":"2024-04-02T07:22:20.370670+0000","last_clean":"2024-04-02T07:22:20.370670+0000","last_became_active":"2024-04-02T07:22:17.823161+0000","last_became_peered":"2024-04-02T07:22:17.823161+0000","last_unstale":"2024-04-02T07:22:20.370670+0000","last_undegraded":"2024-04-02T07:22:20.370670+0000","last_fullsized":"2024-04-02T07:22:20.370670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:26:13.873489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371371+0000","last_change":"2024-04-02T07:22:18.244914+0000","last_active":"2024-04-02T07:22:20.371371+0000","last_peered":"2024-04-02T07:22:20.371371+0000","last_clean":"2024-04-02T07:22:20.371371+0000","last_became_active":"2024-04-02T07:22:18.244584+0000","last_became_peered":"2024-04-02T07:22:18.244584+0000","last_unstale":"2024-04-02T07:22:20.371371+0000","last_undegraded":"2024-04-02T07:22:20.371371+0000","last_fullsized":"2024-04-02T07:22:20.371371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:03:59.884565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.220140+0000","last_change":"2024-04-02T07:22:17.821147+0000","last_active":"2024-04-02T07:22:19.220140+0000","last_peered":"2024-04-02T07:22:19.220140+0000","last_clean":"2024-04-02T07:22:19.220140+0000","last_became_active":"2024-04-02T07:22:17.820136+0000","last_became_peered":"2024-04-02T07:22:17.820136+0000","last_unstale":"2024-04-02T07:22:19.220140+0000","last_undegraded":"2024-04-02T07:22:19.220140+0000","last_fullsized":"2024-04-02T07:22:19.220140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:48:32.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.219747+0000","last_change":"2024-04-02T07:22:18.240463+0000","last_active":"2024-04-02T07:22:19.219747+0000","last_peered":"2024-04-02T07:22:19.219747+0000","last_clean":"2024-04-02T07:22:19.219747+0000","last_became_active":"2024-04-02T07:22:18.239421+0000","last_became_peered":"2024-04-02T07:22:18.239421+0000","last_unstale":"2024-04-02T07:22:19.219747+0000","last_undegraded":"2024-04-02T07:22:19.219747+0000","last_fullsized":"2024-04-02T07:22:19.219747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:04:59.919960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370434+0000","last_change":"2024-04-02T07:22:17.829944+0000","last_active":"2024-04-02T07:22:20.370434+0000","last_peered":"2024-04-02T07:22:20.370434+0000","last_clean":"2024-04-02T07:22:20.370434+0000","last_became_active":"2024-04-02T07:22:17.829678+0000","last_became_peered":"2024-04-02T07:22:17.829678+0000","last_unstale":"2024-04-02T07:22:20.370434+0000","last_undegraded":"2024-04-02T07:22:20.370434+0000","last_fullsized":"2024-04-02T07:22:20.370434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:11:57.231785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371674+0000","last_change":"2024-04-02T07:22:18.246326+0000","last_active":"2024-04-02T07:22:20.371674+0000","last_peered":"2024-04-02T07:22:20.371674+0000","last_clean":"2024-04-02T07:22:20.371674+0000","last_became_active":"2024-04-02T07:22:18.243050+0000","last_became_peered":"2024-04-02T07:22:18.243050+0000","last_unstale":"2024-04-02T07:22:20.371674+0000","last_undegraded":"2024-04-02T07:22:20.371674+0000","last_fullsized":"2024-04-02T07:22:20.371674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:38:10.025630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370083+0000","last_change":"2024-04-02T07:22:17.819199+0000","last_active":"2024-04-02T07:22:20.370083+0000","last_peered":"2024-04-02T07:22:20.370083+0000","last_clean":"2024-04-02T07:22:20.370083+0000","last_became_active":"2024-04-02T07:22:17.818035+0000","last_became_peered":"2024-04-02T07:22:17.818035+0000","last_unstale":"2024-04-02T07:22:20.370083+0000","last_undegraded":"2024-04-02T07:22:20.370083+0000","last_fullsized":"2024-04-02T07:22:20.370083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:57:54.126973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370133+0000","last_change":"2024-04-02T07:22:18.232716+0000","last_active":"2024-04-02T07:22:20.370133+0000","last_peered":"2024-04-02T07:22:20.370133+0000","last_clean":"2024-04-02T07:22:20.370133+0000","last_became_active":"2024-04-02T07:22:18.232422+0000","last_became_peered":"2024-04-02T07:22:18.232422+0000","last_unstale":"2024-04-02T07:22:20.370133+0000","last_undegraded":"2024-04-02T07:22:20.370133+0000","last_fullsized":"2024-04-02T07:22:20.370133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:47:20.129295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369346+0000","last_change":"2024-04-02T07:22:17.817739+0000","last_active":"2024-04-02T07:22:20.369346+0000","last_peered":"2024-04-02T07:22:20.369346+0000","last_clean":"2024-04-02T07:22:20.369346+0000","last_became_active":"2024-04-02T07:22:17.817227+0000","last_became_peered":"2024-04-02T07:22:17.817227+0000","last_unstale":"2024-04-02T07:22:20.369346+0000","last_undegraded":"2024-04-02T07:22:20.369346+0000","last_fullsized":"2024-04-02T07:22:20.369346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:23:23.466281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371572+0000","last_change":"2024-04-02T07:22:18.240642+0000","last_active":"2024-04-02T07:22:20.371572+0000","last_peered":"2024-04-02T07:22:20.371572+0000","last_clean":"2024-04-02T07:22:20.371572+0000","last_became_active":"2024-04-02T07:22:18.240165+0000","last_became_peered":"2024-04-02T07:22:18.240165+0000","last_unstale":"2024-04-02T07:22:20.371572+0000","last_undegraded":"2024-04-02T07:22:20.371572+0000","last_fullsized":"2024-04-02T07:22:20.371572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:46:42.176195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.223000+0000","last_change":"2024-04-02T07:22:17.822782+0000","last_active":"2024-04-02T07:22:19.223000+0000","last_peered":"2024-04-02T07:22:19.223000+0000","last_clean":"2024-04-02T07:22:19.223000+0000","last_became_active":"2024-04-02T07:22:17.822505+0000","last_became_peered":"2024-04-02T07:22:17.822505+0000","last_unstale":"2024-04-02T07:22:19.223000+0000","last_undegraded":"2024-04-02T07:22:19.223000+0000","last_fullsized":"2024-04-02T07:22:19.223000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:17:18.668101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371519+0000","last_change":"2024-04-02T07:22:18.242686+0000","last_active":"2024-04-02T07:22:20.371519+0000","last_peered":"2024-04-02T07:22:20.371519+0000","last_clean":"2024-04-02T07:22:20.371519+0000","last_became_active":"2024-04-02T07:22:18.241019+0000","last_became_peered":"2024-04-02T07:22:18.241019+0000","last_unstale":"2024-04-02T07:22:20.371519+0000","last_undegraded":"2024-04-02T07:22:20.371519+0000","last_fullsized":"2024-04-02T07:22:20.371519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:25.644846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369835+0000","last_change":"2024-04-02T07:22:17.812835+0000","last_active":"2024-04-02T07:22:20.369835+0000","last_peered":"2024-04-02T07:22:20.369835+0000","last_clean":"2024-04-02T07:22:20.369835+0000","last_became_active":"2024-04-02T07:22:17.812523+0000","last_became_peered":"2024-04-02T07:22:17.812523+0000","last_unstale":"2024-04-02T07:22:20.369835+0000","last_undegraded":"2024-04-02T07:22:20.369835+0000","last_fullsized":"2024-04-02T07:22:20.369835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:28:39.704218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371903+0000","last_change":"2024-04-02T07:22:18.244574+0000","last_active":"2024-04-02T07:22:20.371903+0000","last_peered":"2024-04-02T07:22:20.371903+0000","last_clean":"2024-04-02T07:22:20.371903+0000","last_became_active":"2024-04-02T07:22:18.242790+0000","last_became_peered":"2024-04-02T07:22:18.242790+0000","last_unstale":"2024-04-02T07:22:20.371903+0000","last_undegraded":"2024-04-02T07:22:20.371903+0000","last_fullsized":"2024-04-02T07:22:20.371903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:10:08.342854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369995+0000","last_change":"2024-04-02T07:22:17.817479+0000","last_active":"2024-04-02T07:22:20.369995+0000","last_peered":"2024-04-02T07:22:20.369995+0000","last_clean":"2024-04-02T07:22:20.369995+0000","last_became_active":"2024-04-02T07:22:17.815303+0000","last_became_peered":"2024-04-02T07:22:17.815303+0000","last_unstale":"2024-04-02T07:22:20.369995+0000","last_undegraded":"2024-04-02T07:22:20.369995+0000","last_fullsized":"2024-04-02T07:22:20.369995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:28:34.570227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370553+0000","last_change":"2024-04-02T07:22:18.249350+0000","last_active":"2024-04-02T07:22:20.370553+0000","last_peered":"2024-04-02T07:22:20.370553+0000","last_clean":"2024-04-02T07:22:20.370553+0000","last_became_active":"2024-04-02T07:22:18.248787+0000","last_became_peered":"2024-04-02T07:22:18.248787+0000","last_unstale":"2024-04-02T07:22:20.370553+0000","last_undegraded":"2024-04-02T07:22:20.370553+0000","last_fullsized":"2024-04-02T07:22:20.370553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:12.939631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369552+0000","last_change":"2024-04-02T07:22:17.829125+0000","last_active":"2024-04-02T07:22:20.369552+0000","last_peered":"2024-04-02T07:22:20.369552+0000","last_clean":"2024-04-02T07:22:20.369552+0000","last_became_active":"2024-04-02T07:22:17.828816+0000","last_became_peered":"2024-04-02T07:22:17.828816+0000","last_unstale":"2024-04-02T07:22:20.369552+0000","last_undegraded":"2024-04-02T07:22:20.369552+0000","last_fullsized":"2024-04-02T07:22:20.369552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:11:57.231785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371611+0000","last_change":"2024-04-02T07:22:18.241645+0000","last_active":"2024-04-02T07:22:20.371611+0000","last_peered":"2024-04-02T07:22:20.371611+0000","last_clean":"2024-04-02T07:22:20.371611+0000","last_became_active":"2024-04-02T07:22:18.241397+0000","last_became_peered":"2024-04-02T07:22:18.241397+0000","last_unstale":"2024-04-02T07:22:20.371611+0000","last_undegraded":"2024-04-02T07:22:20.371611+0000","last_fullsized":"2024-04-02T07:22:20.371611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:16:31.258551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-02T07:22:18.219421+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:22:18.219421+0000","last_peered":"2024-04-02T07:22:18.219421+0000","last_clean":"2024-04-02T07:22:18.219421+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:22:18.219421+0000","last_undegraded":"2024-04-02T07:22:18.219421+0000","last_fullsized":"2024-04-02T07:22:18.219421+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370214+0000","last_change":"2024-04-02T07:22:17.824525+0000","last_active":"2024-04-02T07:22:20.370214+0000","last_peered":"2024-04-02T07:22:20.370214+0000","last_clean":"2024-04-02T07:22:20.370214+0000","last_became_active":"2024-04-02T07:22:17.824210+0000","last_became_peered":"2024-04-02T07:22:17.824210+0000","last_unstale":"2024-04-02T07:22:20.370214+0000","last_undegraded":"2024-04-02T07:22:20.370214+0000","last_fullsized":"2024-04-02T07:22:20.370214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:57:54.126973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221206+0000","last_change":"2024-04-02T07:22:18.242097+0000","last_active":"2024-04-02T07:22:19.221206+0000","last_peered":"2024-04-02T07:22:19.221206+0000","last_clean":"2024-04-02T07:22:19.221206+0000","last_became_active":"2024-04-02T07:22:18.241770+0000","last_became_peered":"2024-04-02T07:22:18.241770+0000","last_unstale":"2024-04-02T07:22:19.221206+0000","last_undegraded":"2024-04-02T07:22:19.221206+0000","last_fullsized":"2024-04-02T07:22:19.221206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:25.644846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371666+0000","last_change":"2024-04-02T07:22:17.824891+0000","last_active":"2024-04-02T07:22:20.371666+0000","last_peered":"2024-04-02T07:22:20.371666+0000","last_clean":"2024-04-02T07:22:20.371666+0000","last_became_active":"2024-04-02T07:22:17.824638+0000","last_became_peered":"2024-04-02T07:22:17.824638+0000","last_unstale":"2024-04-02T07:22:20.371666+0000","last_undegraded":"2024-04-02T07:22:20.371666+0000","last_fullsized":"2024-04-02T07:22:20.371666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:57:54.126973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.219520+0000","last_change":"2024-04-02T07:22:18.234896+0000","last_active":"2024-04-02T07:22:19.219520+0000","last_peered":"2024-04-02T07:22:19.219520+0000","last_clean":"2024-04-02T07:22:19.219520+0000","last_became_active":"2024-04-02T07:22:18.234660+0000","last_became_peered":"2024-04-02T07:22:18.234660+0000","last_unstale":"2024-04-02T07:22:19.219520+0000","last_undegraded":"2024-04-02T07:22:19.219520+0000","last_fullsized":"2024-04-02T07:22:19.219520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:59:52.607949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369565+0000","last_change":"2024-04-02T07:22:17.817464+0000","last_active":"2024-04-02T07:22:20.369565+0000","last_peered":"2024-04-02T07:22:20.369565+0000","last_clean":"2024-04-02T07:22:20.369565+0000","last_became_active":"2024-04-02T07:22:17.816972+0000","last_became_peered":"2024-04-02T07:22:17.816972+0000","last_unstale":"2024-04-02T07:22:20.369565+0000","last_undegraded":"2024-04-02T07:22:20.369565+0000","last_fullsized":"2024-04-02T07:22:20.369565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:26:13.873489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369566+0000","last_change":"2024-04-02T07:22:18.235644+0000","last_active":"2024-04-02T07:22:20.369566+0000","last_peered":"2024-04-02T07:22:20.369566+0000","last_clean":"2024-04-02T07:22:20.369566+0000","last_became_active":"2024-04-02T07:22:18.235180+0000","last_became_peered":"2024-04-02T07:22:18.235180+0000","last_unstale":"2024-04-02T07:22:20.369566+0000","last_undegraded":"2024-04-02T07:22:20.369566+0000","last_fullsized":"2024-04-02T07:22:20.369566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:14:02.133890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370710+0000","last_change":"2024-04-02T07:22:17.823676+0000","last_active":"2024-04-02T07:22:20.370710+0000","last_peered":"2024-04-02T07:22:20.370710+0000","last_clean":"2024-04-02T07:22:20.370710+0000","last_became_active":"2024-04-02T07:22:17.823161+0000","last_became_peered":"2024-04-02T07:22:17.823161+0000","last_unstale":"2024-04-02T07:22:20.370710+0000","last_undegraded":"2024-04-02T07:22:20.370710+0000","last_fullsized":"2024-04-02T07:22:20.370710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:23:23.466281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.222657+0000","last_change":"2024-04-02T07:22:18.228040+0000","last_active":"2024-04-02T07:22:19.222657+0000","last_peered":"2024-04-02T07:22:19.222657+0000","last_clean":"2024-04-02T07:22:19.222657+0000","last_became_active":"2024-04-02T07:22:18.227742+0000","last_became_peered":"2024-04-02T07:22:18.227742+0000","last_unstale":"2024-04-02T07:22:19.222657+0000","last_undegraded":"2024-04-02T07:22:19.222657+0000","last_fullsized":"2024-04-02T07:22:19.222657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:08:21.191481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369894+0000","last_change":"2024-04-02T07:22:17.817997+0000","last_active":"2024-04-02T07:22:20.369894+0000","last_peered":"2024-04-02T07:22:20.369894+0000","last_clean":"2024-04-02T07:22:20.369894+0000","last_became_active":"2024-04-02T07:22:17.816065+0000","last_became_peered":"2024-04-02T07:22:17.816065+0000","last_unstale":"2024-04-02T07:22:20.369894+0000","last_undegraded":"2024-04-02T07:22:20.369894+0000","last_fullsized":"2024-04-02T07:22:20.369894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:57:54.126973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371335+0000","last_change":"2024-04-02T07:22:18.250113+0000","last_active":"2024-04-02T07:22:20.371335+0000","last_peered":"2024-04-02T07:22:20.371335+0000","last_clean":"2024-04-02T07:22:20.371335+0000","last_became_active":"2024-04-02T07:22:18.249884+0000","last_became_peered":"2024-04-02T07:22:18.249884+0000","last_unstale":"2024-04-02T07:22:20.371335+0000","last_undegraded":"2024-04-02T07:22:20.371335+0000","last_fullsized":"2024-04-02T07:22:20.371335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:36:43.798159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371775+0000","last_change":"2024-04-02T07:22:17.828935+0000","last_active":"2024-04-02T07:22:20.371775+0000","last_peered":"2024-04-02T07:22:20.371775+0000","last_clean":"2024-04-02T07:22:20.371775+0000","last_became_active":"2024-04-02T07:22:17.828207+0000","last_became_peered":"2024-04-02T07:22:17.828207+0000","last_unstale":"2024-04-02T07:22:20.371775+0000","last_undegraded":"2024-04-02T07:22:20.371775+0000","last_fullsized":"2024-04-02T07:22:20.371775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:55:46.473285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369735+0000","last_change":"2024-04-02T07:22:18.229329+0000","last_active":"2024-04-02T07:22:20.369735+0000","last_peered":"2024-04-02T07:22:20.369735+0000","last_clean":"2024-04-02T07:22:20.369735+0000","last_became_active":"2024-04-02T07:22:18.228161+0000","last_became_peered":"2024-04-02T07:22:18.228161+0000","last_unstale":"2024-04-02T07:22:20.369735+0000","last_undegraded":"2024-04-02T07:22:20.369735+0000","last_fullsized":"2024-04-02T07:22:20.369735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:40:34.209765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:21.369684+0000","last_change":"2024-04-02T07:22:17.818709+0000","last_active":"2024-04-02T07:22:21.369684+0000","last_peered":"2024-04-02T07:22:21.369684+0000","last_clean":"2024-04-02T07:22:21.369684+0000","last_became_active":"2024-04-02T07:22:17.817235+0000","last_became_peered":"2024-04-02T07:22:17.817235+0000","last_unstale":"2024-04-02T07:22:21.369684+0000","last_undegraded":"2024-04-02T07:22:21.369684+0000","last_fullsized":"2024-04-02T07:22:21.369684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:10:54.215675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221561+0000","last_change":"2024-04-02T07:22:18.245016+0000","last_active":"2024-04-02T07:22:19.221561+0000","last_peered":"2024-04-02T07:22:19.221561+0000","last_clean":"2024-04-02T07:22:19.221561+0000","last_became_active":"2024-04-02T07:22:18.244613+0000","last_became_peered":"2024-04-02T07:22:18.244613+0000","last_unstale":"2024-04-02T07:22:19.221561+0000","last_undegraded":"2024-04-02T07:22:19.221561+0000","last_fullsized":"2024-04-02T07:22:19.221561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:12:09.974224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371212+0000","last_change":"2024-04-02T07:22:17.819790+0000","last_active":"2024-04-02T07:22:20.371212+0000","last_peered":"2024-04-02T07:22:20.371212+0000","last_clean":"2024-04-02T07:22:20.371212+0000","last_became_active":"2024-04-02T07:22:17.818108+0000","last_became_peered":"2024-04-02T07:22:17.818108+0000","last_unstale":"2024-04-02T07:22:20.371212+0000","last_undegraded":"2024-04-02T07:22:20.371212+0000","last_fullsized":"2024-04-02T07:22:20.371212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:23:23.466281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.220036+0000","last_change":"2024-04-02T07:22:18.228791+0000","last_active":"2024-04-02T07:22:19.220036+0000","last_peered":"2024-04-02T07:22:19.220036+0000","last_clean":"2024-04-02T07:22:19.220036+0000","last_became_active":"2024-04-02T07:22:18.228473+0000","last_became_peered":"2024-04-02T07:22:18.228473+0000","last_unstale":"2024-04-02T07:22:19.220036+0000","last_undegraded":"2024-04-02T07:22:19.220036+0000","last_fullsized":"2024-04-02T07:22:19.220036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:10:03.944538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371839+0000","last_change":"2024-04-02T07:22:17.825367+0000","last_active":"2024-04-02T07:22:20.371839+0000","last_peered":"2024-04-02T07:22:20.371839+0000","last_clean":"2024-04-02T07:22:20.371839+0000","last_became_active":"2024-04-02T07:22:17.825104+0000","last_became_peered":"2024-04-02T07:22:17.825104+0000","last_unstale":"2024-04-02T07:22:20.371839+0000","last_undegraded":"2024-04-02T07:22:20.371839+0000","last_fullsized":"2024-04-02T07:22:20.371839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:10:54.215675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.222586+0000","last_change":"2024-04-02T07:22:18.233413+0000","last_active":"2024-04-02T07:22:19.222586+0000","last_peered":"2024-04-02T07:22:19.222586+0000","last_clean":"2024-04-02T07:22:19.222586+0000","last_became_active":"2024-04-02T07:22:18.233117+0000","last_became_peered":"2024-04-02T07:22:18.233117+0000","last_unstale":"2024-04-02T07:22:19.222586+0000","last_undegraded":"2024-04-02T07:22:19.222586+0000","last_fullsized":"2024-04-02T07:22:19.222586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:10:55.218249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369809+0000","last_change":"2024-04-02T07:22:17.814952+0000","last_active":"2024-04-02T07:22:20.369809+0000","last_peered":"2024-04-02T07:22:20.369809+0000","last_clean":"2024-04-02T07:22:20.369809+0000","last_became_active":"2024-04-02T07:22:17.814563+0000","last_became_peered":"2024-04-02T07:22:17.814563+0000","last_unstale":"2024-04-02T07:22:20.369809+0000","last_undegraded":"2024-04-02T07:22:20.369809+0000","last_fullsized":"2024-04-02T07:22:20.369809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:23:23.466281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221101+0000","last_change":"2024-04-02T07:22:18.234123+0000","last_active":"2024-04-02T07:22:19.221101+0000","last_peered":"2024-04-02T07:22:19.221101+0000","last_clean":"2024-04-02T07:22:19.221101+0000","last_became_active":"2024-04-02T07:22:18.233486+0000","last_became_peered":"2024-04-02T07:22:18.233486+0000","last_unstale":"2024-04-02T07:22:19.221101+0000","last_undegraded":"2024-04-02T07:22:19.221101+0000","last_fullsized":"2024-04-02T07:22:19.221101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:59:52.607949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370124+0000","last_change":"2024-04-02T07:22:17.812302+0000","last_active":"2024-04-02T07:22:20.370124+0000","last_peered":"2024-04-02T07:22:20.370124+0000","last_clean":"2024-04-02T07:22:20.370124+0000","last_became_active":"2024-04-02T07:22:17.812047+0000","last_became_peered":"2024-04-02T07:22:17.812047+0000","last_unstale":"2024-04-02T07:22:20.370124+0000","last_undegraded":"2024-04-02T07:22:20.370124+0000","last_fullsized":"2024-04-02T07:22:20.370124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:11:57.231785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221351+0000","last_change":"2024-04-02T07:22:18.233906+0000","last_active":"2024-04-02T07:22:19.221351+0000","last_peered":"2024-04-02T07:22:19.221351+0000","last_clean":"2024-04-02T07:22:19.221351+0000","last_became_active":"2024-04-02T07:22:18.233651+0000","last_became_peered":"2024-04-02T07:22:18.233651+0000","last_unstale":"2024-04-02T07:22:19.221351+0000","last_undegraded":"2024-04-02T07:22:19.221351+0000","last_fullsized":"2024-04-02T07:22:19.221351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:03:59.884565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371794+0000","last_change":"2024-04-02T07:22:17.828556+0000","last_active":"2024-04-02T07:22:20.371794+0000","last_peered":"2024-04-02T07:22:20.371794+0000","last_clean":"2024-04-02T07:22:20.371794+0000","last_became_active":"2024-04-02T07:22:17.828231+0000","last_became_peered":"2024-04-02T07:22:17.828231+0000","last_unstale":"2024-04-02T07:22:20.371794+0000","last_undegraded":"2024-04-02T07:22:20.371794+0000","last_fullsized":"2024-04-02T07:22:20.371794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:08:20.188906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370077+0000","last_change":"2024-04-02T07:22:18.238093+0000","last_active":"2024-04-02T07:22:20.370077+0000","last_peered":"2024-04-02T07:22:20.370077+0000","last_clean":"2024-04-02T07:22:20.370077+0000","last_became_active":"2024-04-02T07:22:18.237834+0000","last_became_peered":"2024-04-02T07:22:18.237834+0000","last_unstale":"2024-04-02T07:22:20.370077+0000","last_undegraded":"2024-04-02T07:22:20.370077+0000","last_fullsized":"2024-04-02T07:22:20.370077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:14:02.133890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370610+0000","last_change":"2024-04-02T07:22:18.237467+0000","last_active":"2024-04-02T07:22:20.370610+0000","last_peered":"2024-04-02T07:22:20.370610+0000","last_clean":"2024-04-02T07:22:20.370610+0000","last_became_active":"2024-04-02T07:22:18.237207+0000","last_became_peered":"2024-04-02T07:22:18.237207+0000","last_unstale":"2024-04-02T07:22:20.370610+0000","last_undegraded":"2024-04-02T07:22:20.370610+0000","last_fullsized":"2024-04-02T07:22:20.370610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:17:53.201974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371339+0000","last_change":"2024-04-02T07:22:17.829386+0000","last_active":"2024-04-02T07:22:20.371339+0000","last_peered":"2024-04-02T07:22:20.371339+0000","last_clean":"2024-04-02T07:22:20.371339+0000","last_became_active":"2024-04-02T07:22:17.829068+0000","last_became_peered":"2024-04-02T07:22:17.829068+0000","last_unstale":"2024-04-02T07:22:20.371339+0000","last_undegraded":"2024-04-02T07:22:20.371339+0000","last_fullsized":"2024-04-02T07:22:20.371339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:24:06.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370454+0000","last_change":"2024-04-02T07:22:18.237780+0000","last_active":"2024-04-02T07:22:20.370454+0000","last_peered":"2024-04-02T07:22:20.370454+0000","last_clean":"2024-04-02T07:22:20.370454+0000","last_became_active":"2024-04-02T07:22:18.237463+0000","last_became_peered":"2024-04-02T07:22:18.237463+0000","last_unstale":"2024-04-02T07:22:20.370454+0000","last_undegraded":"2024-04-02T07:22:20.370454+0000","last_fullsized":"2024-04-02T07:22:20.370454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:03:59.884565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371531+0000","last_change":"2024-04-02T07:22:17.825046+0000","last_active":"2024-04-02T07:22:20.371531+0000","last_peered":"2024-04-02T07:22:20.371531+0000","last_clean":"2024-04-02T07:22:20.371531+0000","last_became_active":"2024-04-02T07:22:17.824764+0000","last_became_peered":"2024-04-02T07:22:17.824764+0000","last_unstale":"2024-04-02T07:22:20.371531+0000","last_undegraded":"2024-04-02T07:22:20.371531+0000","last_fullsized":"2024-04-02T07:22:20.371531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:28:34.570227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.220221+0000","last_change":"2024-04-02T07:22:18.232920+0000","last_active":"2024-04-02T07:22:19.220221+0000","last_peered":"2024-04-02T07:22:19.220221+0000","last_clean":"2024-04-02T07:22:19.220221+0000","last_became_active":"2024-04-02T07:22:18.232676+0000","last_became_peered":"2024-04-02T07:22:18.232676+0000","last_unstale":"2024-04-02T07:22:19.220221+0000","last_undegraded":"2024-04-02T07:22:19.220221+0000","last_fullsized":"2024-04-02T07:22:19.220221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:12:09.974224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221499+0000","last_change":"2024-04-02T07:22:17.815381+0000","last_active":"2024-04-02T07:22:19.221499+0000","last_peered":"2024-04-02T07:22:19.221499+0000","last_clean":"2024-04-02T07:22:19.221499+0000","last_became_active":"2024-04-02T07:22:17.814994+0000","last_became_peered":"2024-04-02T07:22:17.814994+0000","last_unstale":"2024-04-02T07:22:19.221499+0000","last_undegraded":"2024-04-02T07:22:19.221499+0000","last_fullsized":"2024-04-02T07:22:19.221499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:28:39.704218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221449+0000","last_change":"2024-04-02T07:22:18.242114+0000","last_active":"2024-04-02T07:22:19.221449+0000","last_peered":"2024-04-02T07:22:19.221449+0000","last_clean":"2024-04-02T07:22:19.221449+0000","last_became_active":"2024-04-02T07:22:18.241865+0000","last_became_peered":"2024-04-02T07:22:18.241865+0000","last_unstale":"2024-04-02T07:22:19.221449+0000","last_undegraded":"2024-04-02T07:22:19.221449+0000","last_fullsized":"2024-04-02T07:22:19.221449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:36:43.798159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.220294+0000","last_change":"2024-04-02T07:22:17.827269+0000","last_active":"2024-04-02T07:22:19.220294+0000","last_peered":"2024-04-02T07:22:19.220294+0000","last_clean":"2024-04-02T07:22:19.220294+0000","last_became_active":"2024-04-02T07:22:17.826815+0000","last_became_peered":"2024-04-02T07:22:17.826815+0000","last_unstale":"2024-04-02T07:22:19.220294+0000","last_undegraded":"2024-04-02T07:22:19.220294+0000","last_fullsized":"2024-04-02T07:22:19.220294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:17:18.668101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4929999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9180000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31328,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340512,"statfs":{"total":96636764160,"available":96604684288,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:22:27.041 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:22:27.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.213+0000 7f6220400640 1 Processor -- start 2024-04-02T07:22:27.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.213+0000 7f6220400640 1 -- start start 2024-04-02T07:22:27.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.217+0000 7f6220400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62180b38c0 0x7f6218164210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:27.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.217+0000 7f6220400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f621813d0c0 con 0x7f62180c4120 2024-04-02T07:22:27.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.217+0000 7f6220400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f621815a4f0 con 0x7f6218153ea0 2024-04-02T07:22:27.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.217+0000 7f6220400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f621815a2f0 con 0x7f62180b38c0 2024-04-02T07:22:27.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.217+0000 7f621d000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f62180c4120 0x7f62180b31b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49184/0 (socket says 172.21.15.55:49184) 2024-04-02T07:22:27.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.217+0000 7f621d000640 1 -- 172.21.15.55:0/2280900065 learned_addr learned my addr 172.21.15.55:0/2280900065 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:27.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.217+0000 7f621e400640 1 --2- 172.21.15.55:0/2280900065 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62180b38c0 0x7f6218164210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:27.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.217+0000 7f6217e00640 1 -- 172.21.15.55:0/2280900065 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1897834993 0 0) 0x7f621813d0c0 con 0x7f62180c4120 2024-04-02T07:22:27.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.217+0000 7f6217e00640 1 -- 172.21.15.55:0/2280900065 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6200003530 con 0x7f62180c4120 2024-04-02T07:22:27.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.217+0000 7f6217e00640 1 -- 172.21.15.55:0/2280900065 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3145519137 0 0) 0x7f621815a4f0 con 0x7f6218153ea0 2024-04-02T07:22:27.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.217+0000 7f6217e00640 1 -- 172.21.15.55:0/2280900065 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f621813d0c0 con 0x7f6218153ea0 2024-04-02T07:22:27.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.217+0000 7f621e400640 1 -- 172.21.15.55:0/2280900065 >> v1:172.21.15.106:6789/0 conn(0x7f6218153ea0 legacy=0x7f6218159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:27.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.217+0000 7f621e400640 1 -- 172.21.15.55:0/2280900065 >> v1:172.21.15.55:6789/0 conn(0x7f62180c4120 legacy=0x7f62180b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:27.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.217+0000 7f621e400640 1 -- 172.21.15.55:0/2280900065 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f621815a7d0 con 0x7f62180b38c0 2024-04-02T07:22:27.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.221+0000 7f621e400640 1 --2- 172.21.15.55:0/2280900065 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62180b38c0 0x7f6218164210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6210009dc0 tx=0x7f621001c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5681201b94c2b9c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:27.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.221+0000 7f6217e00640 1 -- 172.21.15.55:0/2280900065 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62100a5960 con 0x7f62180b38c0 2024-04-02T07:22:27.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.221+0000 7f6217e00640 1 -- 172.21.15.55:0/2280900065 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62100a5ac0 con 0x7f62180b38c0 2024-04-02T07:22:27.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.221+0000 7f6217e00640 1 -- 172.21.15.55:0/2280900065 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62100a5e30 con 0x7f62180b38c0 2024-04-02T07:22:27.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.221+0000 7f6220400640 1 -- 172.21.15.55:0/2280900065 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62180b38c0 msgr2=0x7f6218164210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:27.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.221+0000 7f6220400640 1 --2- 172.21.15.55:0/2280900065 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62180b38c0 0x7f6218164210 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6210009dc0 tx=0x7f621001c990 comp rx=0 tx=0).stop 2024-04-02T07:22:27.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.221+0000 7f6220400640 1 -- 172.21.15.55:0/2280900065 shutdown_connections 2024-04-02T07:22:27.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.221+0000 7f6220400640 1 --2- 172.21.15.55:0/2280900065 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62180b38c0 0x7f6218164210 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.221+0000 7f6220400640 1 -- 172.21.15.55:0/2280900065 >> 172.21.15.55:0/2280900065 conn(0x7f6218066080 msgr2=0x7f6218069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:27.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.221+0000 7f6220400640 1 -- 172.21.15.55:0/2280900065 shutdown_connections 2024-04-02T07:22:27.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.221+0000 7f6220400640 1 -- 172.21.15.55:0/2280900065 wait complete. 2024-04-02T07:22:27.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.221+0000 7f6220400640 1 Processor -- start 2024-04-02T07:22:27.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.221+0000 7f6220400640 1 -- start start 2024-04-02T07:22:27.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f6220400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62180b38c0 0x7f62181366d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:27.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f6220400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62180c4120 0x7f621815c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:27.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f6220400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6218153ea0 0x7f62180c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:27.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f6220400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6218152e50 con 0x7f62180c4120 2024-04-02T07:22:27.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f6220400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62180cd2a0 con 0x7f6218153ea0 2024-04-02T07:22:27.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f6220400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62180cc690 con 0x7f62180b38c0 2024-04-02T07:22:27.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f621d000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62180c4120 0x7f621815c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:27.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f621d000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62180c4120 0x7f621815c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60950/0 (socket says 172.21.15.55:60950) 2024-04-02T07:22:27.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f621d000640 1 -- 172.21.15.55:0/3962076187 learned_addr learned my addr 172.21.15.55:0/3962076187 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:27.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f621da00640 1 --2- 172.21.15.55:0/3962076187 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62180b38c0 0x7f62181366d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:27.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f621e400640 1 --2- 172.21.15.55:0/3962076187 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6218153ea0 0x7f62180c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:27.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f621d000640 1 -- 172.21.15.55:0/3962076187 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62180b38c0 msgr2=0x7f62181366d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:27.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f621d000640 1 --2- 172.21.15.55:0/3962076187 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62180b38c0 0x7f62181366d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f621d000640 1 -- 172.21.15.55:0/3962076187 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6218153ea0 msgr2=0x7f62180c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:27.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f621d000640 1 --2- 172.21.15.55:0/3962076187 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6218153ea0 0x7f62180c9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f621d000640 1 -- 172.21.15.55:0/3962076187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6210009a70 con 0x7f62180c4120 2024-04-02T07:22:27.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f621da00640 1 --2- 172.21.15.55:0/3962076187 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62180b38c0 0x7f62181366d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:27.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f621d000640 1 --2- 172.21.15.55:0/3962076187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62180c4120 0x7f621815c600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f620400c500 tx=0x7f620400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:27.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f6215600640 1 -- 172.21.15.55:0/3962076187 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204005cf0 con 0x7f62180c4120 2024-04-02T07:22:27.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f6215600640 1 -- 172.21.15.55:0/3962076187 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6204005e50 con 0x7f62180c4120 2024-04-02T07:22:27.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f6215600640 1 -- 172.21.15.55:0/3962076187 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204007330 con 0x7f62180c4120 2024-04-02T07:22:27.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f6220400640 1 -- 172.21.15.55:0/3962076187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62180cc970 con 0x7f62180c4120 2024-04-02T07:22:27.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f6220400640 1 -- 172.21.15.55:0/3962076187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62180ccf30 con 0x7f62180c4120 2024-04-02T07:22:27.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.225+0000 7f6220400640 1 -- 172.21.15.55:0/3962076187 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6218066c90 con 0x7f62180c4120 2024-04-02T07:22:27.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.229+0000 7f6215600640 1 -- 172.21.15.55:0/3962076187 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6204007490 con 0x7f62180c4120 2024-04-02T07:22:27.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.229+0000 7f6215600640 1 --2- 172.21.15.55:0/3962076187 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f61f80666c0 0x7f61f8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:27.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.229+0000 7f6215600640 1 -- 172.21.15.55:0/3962076187 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6204083740 con 0x7f62180c4120 2024-04-02T07:22:27.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.229+0000 7f621da00640 1 --2- 172.21.15.55:0/3962076187 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f61f80666c0 0x7f61f8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:27.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.229+0000 7f621da00640 1 --2- 172.21.15.55:0/3962076187 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f61f80666c0 0x7f61f8068b80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f620c0016a0 tx=0x7f620c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:27.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.233+0000 7f6215600640 1 -- 172.21.15.55:0/3962076187 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6204050b50 con 0x7f62180c4120 2024-04-02T07:22:27.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.389+0000 7f6220400640 1 -- 172.21.15.55:0/3962076187 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6218072e40 con 0x7f61f80666c0 2024-04-02T07:22:27.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.397+0000 7f6215600640 1 -- 172.21.15.55:0/3962076187 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264631 (secure 0 0 0) 0x7f6218072e40 con 0x7f61f80666c0 2024-04-02T07:22:27.405 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:27.406 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:22:27.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.401+0000 7f6220400640 1 -- 172.21.15.55:0/3962076187 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f61f80666c0 msgr2=0x7f61f8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:27.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.401+0000 7f6220400640 1 --2- 172.21.15.55:0/3962076187 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f61f80666c0 0x7f61f8068b80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f620c0016a0 tx=0x7f620c009040 comp rx=0 tx=0).stop 2024-04-02T07:22:27.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.401+0000 7f6220400640 1 -- 172.21.15.55:0/3962076187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62180c4120 msgr2=0x7f621815c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:27.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.401+0000 7f6220400640 1 --2- 172.21.15.55:0/3962076187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62180c4120 0x7f621815c600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f620400c500 tx=0x7f620400c9c0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.401+0000 7f6220400640 1 -- 172.21.15.55:0/3962076187 shutdown_connections 2024-04-02T07:22:27.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.401+0000 7f6220400640 1 --2- 172.21.15.55:0/3962076187 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f61f80666c0 0x7f61f8068b80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.401+0000 7f6220400640 1 --2- 172.21.15.55:0/3962076187 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6218153ea0 0x7f62180c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.401+0000 7f6220400640 1 --2- 172.21.15.55:0/3962076187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62180c4120 0x7f621815c600 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.401+0000 7f6220400640 1 --2- 172.21.15.55:0/3962076187 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62180b38c0 0x7f62181366d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.401+0000 7f6220400640 1 -- 172.21.15.55:0/3962076187 >> 172.21.15.55:0/3962076187 conn(0x7f6218066080 msgr2=0x7f62180cde30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:27.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.401+0000 7f6220400640 1 -- 172.21.15.55:0/3962076187 shutdown_connections 2024-04-02T07:22:27.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.401+0000 7f6220400640 1 -- 172.21.15.55:0/3962076187 wait complete. 2024-04-02T07:22:27.424 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-02T07:22:26.337094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235376,"kb_used_data":2824,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754739344,"statfs":{"total":773094113280,"available":772853088256,"internally_reserved":0,"allocated":2891776,"data_stored":1752644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.128333"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371828+0000","last_change":"2024-04-02T07:22:18.242427+0000","last_active":"2024-04-02T07:22:20.371828+0000","last_peered":"2024-04-02T07:22:20.371828+0000","last_clean":"2024-04-02T07:22:20.371828+0000","last_became_active":"2024-04-02T07:22:18.241587+0000","last_became_peered":"2024-04-02T07:22:18.241587+0000","last_unstale":"2024-04-02T07:22:20.371828+0000","last_undegraded":"2024-04-02T07:22:20.371828+0000","last_fullsized":"2024-04-02T07:22:20.371828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:17:53.201974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369937+0000","last_change":"2024-04-02T07:22:18.231108+0000","last_active":"2024-04-02T07:22:20.369937+0000","last_peered":"2024-04-02T07:22:20.369937+0000","last_clean":"2024-04-02T07:22:20.369937+0000","last_became_active":"2024-04-02T07:22:18.230786+0000","last_became_peered":"2024-04-02T07:22:18.230786+0000","last_unstale":"2024-04-02T07:22:20.369937+0000","last_undegraded":"2024-04-02T07:22:20.369937+0000","last_fullsized":"2024-04-02T07:22:20.369937+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:12.939631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.219986+0000","last_change":"2024-04-02T07:22:18.232786+0000","last_active":"2024-04-02T07:22:19.219986+0000","last_peered":"2024-04-02T07:22:19.219986+0000","last_clean":"2024-04-02T07:22:19.219986+0000","last_became_active":"2024-04-02T07:22:18.232534+0000","last_became_peered":"2024-04-02T07:22:18.232534+0000","last_unstale":"2024-04-02T07:22:19.219986+0000","last_undegraded":"2024-04-02T07:22:19.219986+0000","last_fullsized":"2024-04-02T07:22:19.219986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:12.939631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370409+0000","last_change":"2024-04-02T07:22:18.249344+0000","last_active":"2024-04-02T07:22:20.370409+0000","last_peered":"2024-04-02T07:22:20.370409+0000","last_clean":"2024-04-02T07:22:20.370409+0000","last_became_active":"2024-04-02T07:22:18.249100+0000","last_became_peered":"2024-04-02T07:22:18.249100+0000","last_unstale":"2024-04-02T07:22:20.370409+0000","last_undegraded":"2024-04-02T07:22:20.370409+0000","last_fullsized":"2024-04-02T07:22:20.370409+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:12:09.974224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371672+0000","last_change":"2024-04-02T07:22:18.248933+0000","last_active":"2024-04-02T07:22:20.371672+0000","last_peered":"2024-04-02T07:22:20.371672+0000","last_clean":"2024-04-02T07:22:20.371672+0000","last_became_active":"2024-04-02T07:22:18.248668+0000","last_became_peered":"2024-04-02T07:22:18.248668+0000","last_unstale":"2024-04-02T07:22:20.371672+0000","last_undegraded":"2024-04-02T07:22:20.371672+0000","last_fullsized":"2024-04-02T07:22:20.371672+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:14:27.524425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370104+0000","last_change":"2024-04-02T07:22:18.231406+0000","last_active":"2024-04-02T07:22:20.370104+0000","last_peered":"2024-04-02T07:22:20.370104+0000","last_clean":"2024-04-02T07:22:20.370104+0000","last_became_active":"2024-04-02T07:22:18.231169+0000","last_became_peered":"2024-04-02T07:22:18.231169+0000","last_unstale":"2024-04-02T07:22:20.370104+0000","last_undegraded":"2024-04-02T07:22:20.370104+0000","last_fullsized":"2024-04-02T07:22:20.370104+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:43:52.871035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371173+0000","last_change":"2024-04-02T07:22:18.240447+0000","last_active":"2024-04-02T07:22:20.371173+0000","last_peered":"2024-04-02T07:22:20.371173+0000","last_clean":"2024-04-02T07:22:20.371173+0000","last_became_active":"2024-04-02T07:22:18.239731+0000","last_became_peered":"2024-04-02T07:22:18.239731+0000","last_unstale":"2024-04-02T07:22:20.371173+0000","last_undegraded":"2024-04-02T07:22:20.371173+0000","last_fullsized":"2024-04-02T07:22:20.371173+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:18:24.609373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221004+0000","last_change":"2024-04-02T07:22:18.237786+0000","last_active":"2024-04-02T07:22:19.221004+0000","last_peered":"2024-04-02T07:22:19.221004+0000","last_clean":"2024-04-02T07:22:19.221004+0000","last_became_active":"2024-04-02T07:22:18.237504+0000","last_became_peered":"2024-04-02T07:22:18.237504+0000","last_unstale":"2024-04-02T07:22:19.221004+0000","last_undegraded":"2024-04-02T07:22:19.221004+0000","last_fullsized":"2024-04-02T07:22:19.221004+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:17:53.201974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371931+0000","last_change":"2024-04-02T07:22:18.242614+0000","last_active":"2024-04-02T07:22:20.371931+0000","last_peered":"2024-04-02T07:22:20.371931+0000","last_clean":"2024-04-02T07:22:20.371931+0000","last_became_active":"2024-04-02T07:22:18.242136+0000","last_became_peered":"2024-04-02T07:22:18.242136+0000","last_unstale":"2024-04-02T07:22:20.371931+0000","last_undegraded":"2024-04-02T07:22:20.371931+0000","last_fullsized":"2024-04-02T07:22:20.371931+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:27:50.468893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371061+0000","last_change":"2024-04-02T07:22:18.232563+0000","last_active":"2024-04-02T07:22:20.371061+0000","last_peered":"2024-04-02T07:22:20.371061+0000","last_clean":"2024-04-02T07:22:20.371061+0000","last_became_active":"2024-04-02T07:22:18.232213+0000","last_became_peered":"2024-04-02T07:22:18.232213+0000","last_unstale":"2024-04-02T07:22:20.371061+0000","last_undegraded":"2024-04-02T07:22:20.371061+0000","last_fullsized":"2024-04-02T07:22:20.371061+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:12.939631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370781+0000","last_change":"2024-04-02T07:22:18.232430+0000","last_active":"2024-04-02T07:22:20.370781+0000","last_peered":"2024-04-02T07:22:20.370781+0000","last_clean":"2024-04-02T07:22:20.370781+0000","last_became_active":"2024-04-02T07:22:18.232147+0000","last_became_peered":"2024-04-02T07:22:18.232147+0000","last_unstale":"2024-04-02T07:22:20.370781+0000","last_undegraded":"2024-04-02T07:22:20.370781+0000","last_fullsized":"2024-04-02T07:22:20.370781+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:36:43.798159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.222736+0000","last_change":"2024-04-02T07:22:18.235518+0000","last_active":"2024-04-02T07:22:19.222736+0000","last_peered":"2024-04-02T07:22:19.222736+0000","last_clean":"2024-04-02T07:22:19.222736+0000","last_became_active":"2024-04-02T07:22:18.235232+0000","last_became_peered":"2024-04-02T07:22:18.235232+0000","last_unstale":"2024-04-02T07:22:19.222736+0000","last_undegraded":"2024-04-02T07:22:19.222736+0000","last_fullsized":"2024-04-02T07:22:19.222736+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:28:35.572801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221398+0000","last_change":"2024-04-02T07:22:18.242642+0000","last_active":"2024-04-02T07:22:19.221398+0000","last_peered":"2024-04-02T07:22:19.221398+0000","last_clean":"2024-04-02T07:22:19.221398+0000","last_became_active":"2024-04-02T07:22:18.242350+0000","last_became_peered":"2024-04-02T07:22:18.242350+0000","last_unstale":"2024-04-02T07:22:19.221398+0000","last_undegraded":"2024-04-02T07:22:19.221398+0000","last_fullsized":"2024-04-02T07:22:19.221398+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:40:34.209765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.219577+0000","last_change":"2024-04-02T07:22:18.240215+0000","last_active":"2024-04-02T07:22:19.219577+0000","last_peered":"2024-04-02T07:22:19.219577+0000","last_clean":"2024-04-02T07:22:19.219577+0000","last_became_active":"2024-04-02T07:22:18.239918+0000","last_became_peered":"2024-04-02T07:22:18.239918+0000","last_unstale":"2024-04-02T07:22:19.219577+0000","last_undegraded":"2024-04-02T07:22:19.219577+0000","last_fullsized":"2024-04-02T07:22:19.219577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:07:43.747365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369667+0000","last_change":"2024-04-02T07:22:18.244474+0000","last_active":"2024-04-02T07:22:20.369667+0000","last_peered":"2024-04-02T07:22:20.369667+0000","last_clean":"2024-04-02T07:22:20.369667+0000","last_became_active":"2024-04-02T07:22:18.244222+0000","last_became_peered":"2024-04-02T07:22:18.244222+0000","last_unstale":"2024-04-02T07:22:20.369667+0000","last_undegraded":"2024-04-02T07:22:20.369667+0000","last_fullsized":"2024-04-02T07:22:20.369667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:47:20.129295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369896+0000","last_change":"2024-04-02T07:22:18.231427+0000","last_active":"2024-04-02T07:22:20.369896+0000","last_peered":"2024-04-02T07:22:20.369896+0000","last_clean":"2024-04-02T07:22:20.369896+0000","last_became_active":"2024-04-02T07:22:18.230966+0000","last_became_peered":"2024-04-02T07:22:18.230966+0000","last_unstale":"2024-04-02T07:22:20.369896+0000","last_undegraded":"2024-04-02T07:22:20.369896+0000","last_fullsized":"2024-04-02T07:22:20.369896+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:25.644846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370768+0000","last_change":"2024-04-02T07:22:18.247729+0000","last_active":"2024-04-02T07:22:20.370768+0000","last_peered":"2024-04-02T07:22:20.370768+0000","last_clean":"2024-04-02T07:22:20.370768+0000","last_became_active":"2024-04-02T07:22:18.247488+0000","last_became_peered":"2024-04-02T07:22:18.247488+0000","last_unstale":"2024-04-02T07:22:20.370768+0000","last_undegraded":"2024-04-02T07:22:20.370768+0000","last_fullsized":"2024-04-02T07:22:20.370768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:10:08.342854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369749+0000","last_change":"2024-04-02T07:22:18.238472+0000","last_active":"2024-04-02T07:22:20.369749+0000","last_peered":"2024-04-02T07:22:20.369749+0000","last_clean":"2024-04-02T07:22:20.369749+0000","last_became_active":"2024-04-02T07:22:18.238254+0000","last_became_peered":"2024-04-02T07:22:18.238254+0000","last_unstale":"2024-04-02T07:22:20.369749+0000","last_undegraded":"2024-04-02T07:22:20.369749+0000","last_fullsized":"2024-04-02T07:22:20.369749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:55:47.475859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371682+0000","last_change":"2024-04-02T07:22:18.247532+0000","last_active":"2024-04-02T07:22:20.371682+0000","last_peered":"2024-04-02T07:22:20.371682+0000","last_clean":"2024-04-02T07:22:20.371682+0000","last_became_active":"2024-04-02T07:22:18.247218+0000","last_became_peered":"2024-04-02T07:22:18.247218+0000","last_unstale":"2024-04-02T07:22:20.371682+0000","last_undegraded":"2024-04-02T07:22:20.371682+0000","last_fullsized":"2024-04-02T07:22:20.371682+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:43:52.871035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370136+0000","last_change":"2024-04-02T07:22:18.238253+0000","last_active":"2024-04-02T07:22:20.370136+0000","last_peered":"2024-04-02T07:22:20.370136+0000","last_clean":"2024-04-02T07:22:20.370136+0000","last_became_active":"2024-04-02T07:22:18.237955+0000","last_became_peered":"2024-04-02T07:22:18.237955+0000","last_unstale":"2024-04-02T07:22:20.370136+0000","last_undegraded":"2024-04-02T07:22:20.370136+0000","last_fullsized":"2024-04-02T07:22:20.370136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:40:34.209765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.219847+0000","last_change":"2024-04-02T07:22:18.240034+0000","last_active":"2024-04-02T07:22:19.219847+0000","last_peered":"2024-04-02T07:22:19.219847+0000","last_clean":"2024-04-02T07:22:19.219847+0000","last_became_active":"2024-04-02T07:22:18.239673+0000","last_became_peered":"2024-04-02T07:22:18.239673+0000","last_unstale":"2024-04-02T07:22:19.219847+0000","last_undegraded":"2024-04-02T07:22:19.219847+0000","last_fullsized":"2024-04-02T07:22:19.219847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:40:34.209765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370287+0000","last_change":"2024-04-02T07:22:18.250123+0000","last_active":"2024-04-02T07:22:20.370287+0000","last_peered":"2024-04-02T07:22:20.370287+0000","last_clean":"2024-04-02T07:22:20.370287+0000","last_became_active":"2024-04-02T07:22:18.249705+0000","last_became_peered":"2024-04-02T07:22:18.249705+0000","last_unstale":"2024-04-02T07:22:20.370287+0000","last_undegraded":"2024-04-02T07:22:20.370287+0000","last_fullsized":"2024-04-02T07:22:20.370287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:14:27.524425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221095+0000","last_change":"2024-04-02T07:22:18.220352+0000","last_active":"2024-04-02T07:22:19.221095+0000","last_peered":"2024-04-02T07:22:19.221095+0000","last_clean":"2024-04-02T07:22:19.221095+0000","last_became_active":"2024-04-02T07:22:18.219970+0000","last_became_peered":"2024-04-02T07:22:18.219970+0000","last_unstale":"2024-04-02T07:22:19.221095+0000","last_undegraded":"2024-04-02T07:22:19.221095+0000","last_fullsized":"2024-04-02T07:22:19.221095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:47:20.129295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369974+0000","last_change":"2024-04-02T07:22:18.243492+0000","last_active":"2024-04-02T07:22:20.369974+0000","last_peered":"2024-04-02T07:22:20.369974+0000","last_clean":"2024-04-02T07:22:20.369974+0000","last_became_active":"2024-04-02T07:22:18.241420+0000","last_became_peered":"2024-04-02T07:22:18.241420+0000","last_unstale":"2024-04-02T07:22:20.369974+0000","last_undegraded":"2024-04-02T07:22:20.369974+0000","last_fullsized":"2024-04-02T07:22:20.369974+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:40:34.209765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221583+0000","last_change":"2024-04-02T07:22:18.220417+0000","last_active":"2024-04-02T07:22:19.221583+0000","last_peered":"2024-04-02T07:22:19.221583+0000","last_clean":"2024-04-02T07:22:19.221583+0000","last_became_active":"2024-04-02T07:22:18.220172+0000","last_became_peered":"2024-04-02T07:22:18.220172+0000","last_unstale":"2024-04-02T07:22:19.221583+0000","last_undegraded":"2024-04-02T07:22:19.221583+0000","last_fullsized":"2024-04-02T07:22:19.221583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:04:59.919960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371096+0000","last_change":"2024-04-02T07:22:18.248792+0000","last_active":"2024-04-02T07:22:20.371096+0000","last_peered":"2024-04-02T07:22:20.371096+0000","last_clean":"2024-04-02T07:22:20.371096+0000","last_became_active":"2024-04-02T07:22:18.248524+0000","last_became_peered":"2024-04-02T07:22:18.248524+0000","last_unstale":"2024-04-02T07:22:20.371096+0000","last_undegraded":"2024-04-02T07:22:20.371096+0000","last_fullsized":"2024-04-02T07:22:20.371096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:59:52.607949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369918+0000","last_change":"2024-04-02T07:22:18.247315+0000","last_active":"2024-04-02T07:22:20.369918+0000","last_peered":"2024-04-02T07:22:20.369918+0000","last_clean":"2024-04-02T07:22:20.369918+0000","last_became_active":"2024-04-02T07:22:18.247031+0000","last_became_peered":"2024-04-02T07:22:18.247031+0000","last_unstale":"2024-04-02T07:22:20.369918+0000","last_undegraded":"2024-04-02T07:22:20.369918+0000","last_fullsized":"2024-04-02T07:22:20.369918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:59:52.607949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221415+0000","last_change":"2024-04-02T07:22:18.220991+0000","last_active":"2024-04-02T07:22:19.221415+0000","last_peered":"2024-04-02T07:22:19.221415+0000","last_clean":"2024-04-02T07:22:19.221415+0000","last_became_active":"2024-04-02T07:22:18.219487+0000","last_became_peered":"2024-04-02T07:22:18.219487+0000","last_unstale":"2024-04-02T07:22:19.221415+0000","last_undegraded":"2024-04-02T07:22:19.221415+0000","last_fullsized":"2024-04-02T07:22:19.221415+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:14:02.133890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.219941+0000","last_change":"2024-04-02T07:22:18.226337+0000","last_active":"2024-04-02T07:22:19.219941+0000","last_peered":"2024-04-02T07:22:19.219941+0000","last_clean":"2024-04-02T07:22:19.219941+0000","last_became_active":"2024-04-02T07:22:18.225219+0000","last_became_peered":"2024-04-02T07:22:18.225219+0000","last_unstale":"2024-04-02T07:22:19.219941+0000","last_undegraded":"2024-04-02T07:22:19.219941+0000","last_fullsized":"2024-04-02T07:22:19.219941+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:57:25.335137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370381+0000","last_change":"2024-04-02T07:22:18.248548+0000","last_active":"2024-04-02T07:22:20.370381+0000","last_peered":"2024-04-02T07:22:20.370381+0000","last_clean":"2024-04-02T07:22:20.370381+0000","last_became_active":"2024-04-02T07:22:18.248275+0000","last_became_peered":"2024-04-02T07:22:18.248275+0000","last_unstale":"2024-04-02T07:22:20.370381+0000","last_undegraded":"2024-04-02T07:22:20.370381+0000","last_fullsized":"2024-04-02T07:22:20.370381+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:14:02.133890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369484+0000","last_change":"2024-04-02T07:22:18.239465+0000","last_active":"2024-04-02T07:22:20.369484+0000","last_peered":"2024-04-02T07:22:20.369484+0000","last_clean":"2024-04-02T07:22:20.369484+0000","last_became_active":"2024-04-02T07:22:18.239184+0000","last_became_peered":"2024-04-02T07:22:18.239184+0000","last_unstale":"2024-04-02T07:22:20.369484+0000","last_undegraded":"2024-04-02T07:22:20.369484+0000","last_fullsized":"2024-04-02T07:22:20.369484+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:08:21.191481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370012+0000","last_change":"2024-04-02T07:22:18.234263+0000","last_active":"2024-04-02T07:22:20.370012+0000","last_peered":"2024-04-02T07:22:20.370012+0000","last_clean":"2024-04-02T07:22:20.370012+0000","last_became_active":"2024-04-02T07:22:18.233927+0000","last_became_peered":"2024-04-02T07:22:18.233927+0000","last_unstale":"2024-04-02T07:22:20.370012+0000","last_undegraded":"2024-04-02T07:22:20.370012+0000","last_fullsized":"2024-04-02T07:22:20.370012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:04:59.919960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.222575+0000","last_change":"2024-04-02T07:22:18.233666+0000","last_active":"2024-04-02T07:22:19.222575+0000","last_peered":"2024-04-02T07:22:19.222575+0000","last_clean":"2024-04-02T07:22:19.222575+0000","last_became_active":"2024-04-02T07:22:18.233403+0000","last_became_peered":"2024-04-02T07:22:18.233403+0000","last_unstale":"2024-04-02T07:22:19.222575+0000","last_undegraded":"2024-04-02T07:22:19.222575+0000","last_fullsized":"2024-04-02T07:22:19.222575+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:57:55.129547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221437+0000","last_change":"2024-04-02T07:22:17.816995+0000","last_active":"2024-04-02T07:22:19.221437+0000","last_peered":"2024-04-02T07:22:19.221437+0000","last_clean":"2024-04-02T07:22:19.221437+0000","last_became_active":"2024-04-02T07:22:17.816648+0000","last_became_peered":"2024-04-02T07:22:17.816648+0000","last_unstale":"2024-04-02T07:22:19.221437+0000","last_undegraded":"2024-04-02T07:22:19.221437+0000","last_fullsized":"2024-04-02T07:22:19.221437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:26:13.873489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.220049+0000","last_change":"2024-04-02T07:22:18.238198+0000","last_active":"2024-04-02T07:22:19.220049+0000","last_peered":"2024-04-02T07:22:19.220049+0000","last_clean":"2024-04-02T07:22:19.220049+0000","last_became_active":"2024-04-02T07:22:18.236795+0000","last_became_peered":"2024-04-02T07:22:18.236795+0000","last_unstale":"2024-04-02T07:22:19.220049+0000","last_undegraded":"2024-04-02T07:22:19.220049+0000","last_fullsized":"2024-04-02T07:22:19.220049+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:14:02.133890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370281+0000","last_change":"2024-04-02T07:22:17.818491+0000","last_active":"2024-04-02T07:22:20.370281+0000","last_peered":"2024-04-02T07:22:20.370281+0000","last_clean":"2024-04-02T07:22:20.370281+0000","last_became_active":"2024-04-02T07:22:17.817664+0000","last_became_peered":"2024-04-02T07:22:17.817664+0000","last_unstale":"2024-04-02T07:22:20.370281+0000","last_undegraded":"2024-04-02T07:22:20.370281+0000","last_fullsized":"2024-04-02T07:22:20.370281+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:10:54.215675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221161+0000","last_change":"2024-04-02T07:22:17.819716+0000","last_active":"2024-04-02T07:22:19.221161+0000","last_peered":"2024-04-02T07:22:19.221161+0000","last_clean":"2024-04-02T07:22:19.221161+0000","last_became_active":"2024-04-02T07:22:17.819392+0000","last_became_peered":"2024-04-02T07:22:17.819392+0000","last_unstale":"2024-04-02T07:22:19.221161+0000","last_undegraded":"2024-04-02T07:22:19.221161+0000","last_fullsized":"2024-04-02T07:22:19.221161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:11:57.231785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221071+0000","last_change":"2024-04-02T07:22:18.234279+0000","last_active":"2024-04-02T07:22:19.221071+0000","last_peered":"2024-04-02T07:22:19.221071+0000","last_clean":"2024-04-02T07:22:19.221071+0000","last_became_active":"2024-04-02T07:22:18.233854+0000","last_became_peered":"2024-04-02T07:22:18.233854+0000","last_unstale":"2024-04-02T07:22:19.221071+0000","last_undegraded":"2024-04-02T07:22:19.221071+0000","last_fullsized":"2024-04-02T07:22:19.221071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:12.939631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369992+0000","last_change":"2024-04-02T07:22:17.826560+0000","last_active":"2024-04-02T07:22:20.369992+0000","last_peered":"2024-04-02T07:22:20.369992+0000","last_clean":"2024-04-02T07:22:20.369992+0000","last_became_active":"2024-04-02T07:22:17.826211+0000","last_became_peered":"2024-04-02T07:22:17.826211+0000","last_unstale":"2024-04-02T07:22:20.369992+0000","last_undegraded":"2024-04-02T07:22:20.369992+0000","last_fullsized":"2024-04-02T07:22:20.369992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:26:13.873489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369564+0000","last_change":"2024-04-02T07:22:18.229986+0000","last_active":"2024-04-02T07:22:20.369564+0000","last_peered":"2024-04-02T07:22:20.369564+0000","last_clean":"2024-04-02T07:22:20.369564+0000","last_became_active":"2024-04-02T07:22:18.223834+0000","last_became_peered":"2024-04-02T07:22:18.223834+0000","last_unstale":"2024-04-02T07:22:20.369564+0000","last_undegraded":"2024-04-02T07:22:20.369564+0000","last_fullsized":"2024-04-02T07:22:20.369564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:04:59.919960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371334+0000","last_change":"2024-04-02T07:22:17.829273+0000","last_active":"2024-04-02T07:22:20.371334+0000","last_peered":"2024-04-02T07:22:20.371334+0000","last_clean":"2024-04-02T07:22:20.371334+0000","last_became_active":"2024-04-02T07:22:17.829016+0000","last_became_peered":"2024-04-02T07:22:17.829016+0000","last_unstale":"2024-04-02T07:22:20.371334+0000","last_undegraded":"2024-04-02T07:22:20.371334+0000","last_fullsized":"2024-04-02T07:22:20.371334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:28:34.570227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370788+0000","last_change":"2024-04-02T07:22:18.245393+0000","last_active":"2024-04-02T07:22:20.370788+0000","last_peered":"2024-04-02T07:22:20.370788+0000","last_clean":"2024-04-02T07:22:20.370788+0000","last_became_active":"2024-04-02T07:22:18.245061+0000","last_became_peered":"2024-04-02T07:22:18.245061+0000","last_unstale":"2024-04-02T07:22:20.370788+0000","last_undegraded":"2024-04-02T07:22:20.370788+0000","last_fullsized":"2024-04-02T07:22:20.370788+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:46:42.176195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370581+0000","last_change":"2024-04-02T07:22:17.828107+0000","last_active":"2024-04-02T07:22:20.370581+0000","last_peered":"2024-04-02T07:22:20.370581+0000","last_clean":"2024-04-02T07:22:20.370581+0000","last_became_active":"2024-04-02T07:22:17.825331+0000","last_became_peered":"2024-04-02T07:22:17.825331+0000","last_unstale":"2024-04-02T07:22:20.370581+0000","last_undegraded":"2024-04-02T07:22:20.370581+0000","last_fullsized":"2024-04-02T07:22:20.370581+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:28:39.704218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.220251+0000","last_change":"2024-04-02T07:22:18.232172+0000","last_active":"2024-04-02T07:22:19.220251+0000","last_peered":"2024-04-02T07:22:19.220251+0000","last_clean":"2024-04-02T07:22:19.220251+0000","last_became_active":"2024-04-02T07:22:18.231924+0000","last_became_peered":"2024-04-02T07:22:18.231924+0000","last_unstale":"2024-04-02T07:22:19.220251+0000","last_undegraded":"2024-04-02T07:22:19.220251+0000","last_fullsized":"2024-04-02T07:22:19.220251+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:36:43.798159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369928+0000","last_change":"2024-04-02T07:22:17.825495+0000","last_active":"2024-04-02T07:22:20.369928+0000","last_peered":"2024-04-02T07:22:20.369928+0000","last_clean":"2024-04-02T07:22:20.369928+0000","last_became_active":"2024-04-02T07:22:17.825231+0000","last_became_peered":"2024-04-02T07:22:17.825231+0000","last_unstale":"2024-04-02T07:22:20.369928+0000","last_undegraded":"2024-04-02T07:22:20.369928+0000","last_fullsized":"2024-04-02T07:22:20.369928+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:55:46.473285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.222760+0000","last_change":"2024-04-02T07:22:18.239881+0000","last_active":"2024-04-02T07:22:19.222760+0000","last_peered":"2024-04-02T07:22:19.222760+0000","last_clean":"2024-04-02T07:22:19.222760+0000","last_became_active":"2024-04-02T07:22:18.239628+0000","last_became_peered":"2024-04-02T07:22:18.239628+0000","last_unstale":"2024-04-02T07:22:19.222760+0000","last_undegraded":"2024-04-02T07:22:19.222760+0000","last_fullsized":"2024-04-02T07:22:19.222760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:55:47.475859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370670+0000","last_change":"2024-04-02T07:22:17.823545+0000","last_active":"2024-04-02T07:22:20.370670+0000","last_peered":"2024-04-02T07:22:20.370670+0000","last_clean":"2024-04-02T07:22:20.370670+0000","last_became_active":"2024-04-02T07:22:17.823161+0000","last_became_peered":"2024-04-02T07:22:17.823161+0000","last_unstale":"2024-04-02T07:22:20.370670+0000","last_undegraded":"2024-04-02T07:22:20.370670+0000","last_fullsized":"2024-04-02T07:22:20.370670+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:26:13.873489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371371+0000","last_change":"2024-04-02T07:22:18.244914+0000","last_active":"2024-04-02T07:22:20.371371+0000","last_peered":"2024-04-02T07:22:20.371371+0000","last_clean":"2024-04-02T07:22:20.371371+0000","last_became_active":"2024-04-02T07:22:18.244584+0000","last_became_peered":"2024-04-02T07:22:18.244584+0000","last_unstale":"2024-04-02T07:22:20.371371+0000","last_undegraded":"2024-04-02T07:22:20.371371+0000","last_fullsized":"2024-04-02T07:22:20.371371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:03:59.884565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.220140+0000","last_change":"2024-04-02T07:22:17.821147+0000","last_active":"2024-04-02T07:22:19.220140+0000","last_peered":"2024-04-02T07:22:19.220140+0000","last_clean":"2024-04-02T07:22:19.220140+0000","last_became_active":"2024-04-02T07:22:17.820136+0000","last_became_peered":"2024-04-02T07:22:17.820136+0000","last_unstale":"2024-04-02T07:22:19.220140+0000","last_undegraded":"2024-04-02T07:22:19.220140+0000","last_fullsized":"2024-04-02T07:22:19.220140+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:48:32.260361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.219747+0000","last_change":"2024-04-02T07:22:18.240463+0000","last_active":"2024-04-02T07:22:19.219747+0000","last_peered":"2024-04-02T07:22:19.219747+0000","last_clean":"2024-04-02T07:22:19.219747+0000","last_became_active":"2024-04-02T07:22:18.239421+0000","last_became_peered":"2024-04-02T07:22:18.239421+0000","last_unstale":"2024-04-02T07:22:19.219747+0000","last_undegraded":"2024-04-02T07:22:19.219747+0000","last_fullsized":"2024-04-02T07:22:19.219747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:04:59.919960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370434+0000","last_change":"2024-04-02T07:22:17.829944+0000","last_active":"2024-04-02T07:22:20.370434+0000","last_peered":"2024-04-02T07:22:20.370434+0000","last_clean":"2024-04-02T07:22:20.370434+0000","last_became_active":"2024-04-02T07:22:17.829678+0000","last_became_peered":"2024-04-02T07:22:17.829678+0000","last_unstale":"2024-04-02T07:22:20.370434+0000","last_undegraded":"2024-04-02T07:22:20.370434+0000","last_fullsized":"2024-04-02T07:22:20.370434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:11:57.231785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371674+0000","last_change":"2024-04-02T07:22:18.246326+0000","last_active":"2024-04-02T07:22:20.371674+0000","last_peered":"2024-04-02T07:22:20.371674+0000","last_clean":"2024-04-02T07:22:20.371674+0000","last_became_active":"2024-04-02T07:22:18.243050+0000","last_became_peered":"2024-04-02T07:22:18.243050+0000","last_unstale":"2024-04-02T07:22:20.371674+0000","last_undegraded":"2024-04-02T07:22:20.371674+0000","last_fullsized":"2024-04-02T07:22:20.371674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:38:10.025630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370083+0000","last_change":"2024-04-02T07:22:17.819199+0000","last_active":"2024-04-02T07:22:20.370083+0000","last_peered":"2024-04-02T07:22:20.370083+0000","last_clean":"2024-04-02T07:22:20.370083+0000","last_became_active":"2024-04-02T07:22:17.818035+0000","last_became_peered":"2024-04-02T07:22:17.818035+0000","last_unstale":"2024-04-02T07:22:20.370083+0000","last_undegraded":"2024-04-02T07:22:20.370083+0000","last_fullsized":"2024-04-02T07:22:20.370083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:57:54.126973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370133+0000","last_change":"2024-04-02T07:22:18.232716+0000","last_active":"2024-04-02T07:22:20.370133+0000","last_peered":"2024-04-02T07:22:20.370133+0000","last_clean":"2024-04-02T07:22:20.370133+0000","last_became_active":"2024-04-02T07:22:18.232422+0000","last_became_peered":"2024-04-02T07:22:18.232422+0000","last_unstale":"2024-04-02T07:22:20.370133+0000","last_undegraded":"2024-04-02T07:22:20.370133+0000","last_fullsized":"2024-04-02T07:22:20.370133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:47:20.129295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369346+0000","last_change":"2024-04-02T07:22:17.817739+0000","last_active":"2024-04-02T07:22:20.369346+0000","last_peered":"2024-04-02T07:22:20.369346+0000","last_clean":"2024-04-02T07:22:20.369346+0000","last_became_active":"2024-04-02T07:22:17.817227+0000","last_became_peered":"2024-04-02T07:22:17.817227+0000","last_unstale":"2024-04-02T07:22:20.369346+0000","last_undegraded":"2024-04-02T07:22:20.369346+0000","last_fullsized":"2024-04-02T07:22:20.369346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:23:23.466281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371572+0000","last_change":"2024-04-02T07:22:18.240642+0000","last_active":"2024-04-02T07:22:20.371572+0000","last_peered":"2024-04-02T07:22:20.371572+0000","last_clean":"2024-04-02T07:22:20.371572+0000","last_became_active":"2024-04-02T07:22:18.240165+0000","last_became_peered":"2024-04-02T07:22:18.240165+0000","last_unstale":"2024-04-02T07:22:20.371572+0000","last_undegraded":"2024-04-02T07:22:20.371572+0000","last_fullsized":"2024-04-02T07:22:20.371572+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:46:42.176195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.223000+0000","last_change":"2024-04-02T07:22:17.822782+0000","last_active":"2024-04-02T07:22:19.223000+0000","last_peered":"2024-04-02T07:22:19.223000+0000","last_clean":"2024-04-02T07:22:19.223000+0000","last_became_active":"2024-04-02T07:22:17.822505+0000","last_became_peered":"2024-04-02T07:22:17.822505+0000","last_unstale":"2024-04-02T07:22:19.223000+0000","last_undegraded":"2024-04-02T07:22:19.223000+0000","last_fullsized":"2024-04-02T07:22:19.223000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:17:18.668101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371519+0000","last_change":"2024-04-02T07:22:18.242686+0000","last_active":"2024-04-02T07:22:20.371519+0000","last_peered":"2024-04-02T07:22:20.371519+0000","last_clean":"2024-04-02T07:22:20.371519+0000","last_became_active":"2024-04-02T07:22:18.241019+0000","last_became_peered":"2024-04-02T07:22:18.241019+0000","last_unstale":"2024-04-02T07:22:20.371519+0000","last_undegraded":"2024-04-02T07:22:20.371519+0000","last_fullsized":"2024-04-02T07:22:20.371519+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:25.644846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369835+0000","last_change":"2024-04-02T07:22:17.812835+0000","last_active":"2024-04-02T07:22:20.369835+0000","last_peered":"2024-04-02T07:22:20.369835+0000","last_clean":"2024-04-02T07:22:20.369835+0000","last_became_active":"2024-04-02T07:22:17.812523+0000","last_became_peered":"2024-04-02T07:22:17.812523+0000","last_unstale":"2024-04-02T07:22:20.369835+0000","last_undegraded":"2024-04-02T07:22:20.369835+0000","last_fullsized":"2024-04-02T07:22:20.369835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:28:39.704218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371903+0000","last_change":"2024-04-02T07:22:18.244574+0000","last_active":"2024-04-02T07:22:20.371903+0000","last_peered":"2024-04-02T07:22:20.371903+0000","last_clean":"2024-04-02T07:22:20.371903+0000","last_became_active":"2024-04-02T07:22:18.242790+0000","last_became_peered":"2024-04-02T07:22:18.242790+0000","last_unstale":"2024-04-02T07:22:20.371903+0000","last_undegraded":"2024-04-02T07:22:20.371903+0000","last_fullsized":"2024-04-02T07:22:20.371903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:10:08.342854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369995+0000","last_change":"2024-04-02T07:22:17.817479+0000","last_active":"2024-04-02T07:22:20.369995+0000","last_peered":"2024-04-02T07:22:20.369995+0000","last_clean":"2024-04-02T07:22:20.369995+0000","last_became_active":"2024-04-02T07:22:17.815303+0000","last_became_peered":"2024-04-02T07:22:17.815303+0000","last_unstale":"2024-04-02T07:22:20.369995+0000","last_undegraded":"2024-04-02T07:22:20.369995+0000","last_fullsized":"2024-04-02T07:22:20.369995+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:28:34.570227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370553+0000","last_change":"2024-04-02T07:22:18.249350+0000","last_active":"2024-04-02T07:22:20.370553+0000","last_peered":"2024-04-02T07:22:20.370553+0000","last_clean":"2024-04-02T07:22:20.370553+0000","last_became_active":"2024-04-02T07:22:18.248787+0000","last_became_peered":"2024-04-02T07:22:18.248787+0000","last_unstale":"2024-04-02T07:22:20.370553+0000","last_undegraded":"2024-04-02T07:22:20.370553+0000","last_fullsized":"2024-04-02T07:22:20.370553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:12.939631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369552+0000","last_change":"2024-04-02T07:22:17.829125+0000","last_active":"2024-04-02T07:22:20.369552+0000","last_peered":"2024-04-02T07:22:20.369552+0000","last_clean":"2024-04-02T07:22:20.369552+0000","last_became_active":"2024-04-02T07:22:17.828816+0000","last_became_peered":"2024-04-02T07:22:17.828816+0000","last_unstale":"2024-04-02T07:22:20.369552+0000","last_undegraded":"2024-04-02T07:22:20.369552+0000","last_fullsized":"2024-04-02T07:22:20.369552+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:11:57.231785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371611+0000","last_change":"2024-04-02T07:22:18.241645+0000","last_active":"2024-04-02T07:22:20.371611+0000","last_peered":"2024-04-02T07:22:20.371611+0000","last_clean":"2024-04-02T07:22:20.371611+0000","last_became_active":"2024-04-02T07:22:18.241397+0000","last_became_peered":"2024-04-02T07:22:18.241397+0000","last_unstale":"2024-04-02T07:22:20.371611+0000","last_undegraded":"2024-04-02T07:22:20.371611+0000","last_fullsized":"2024-04-02T07:22:20.371611+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:16:31.258551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-02T07:22:18.219421+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:22:18.219421+0000","last_peered":"2024-04-02T07:22:18.219421+0000","last_clean":"2024-04-02T07:22:18.219421+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:22:18.219421+0000","last_undegraded":"2024-04-02T07:22:18.219421+0000","last_fullsized":"2024-04-02T07:22:18.219421+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370214+0000","last_change":"2024-04-02T07:22:17.824525+0000","last_active":"2024-04-02T07:22:20.370214+0000","last_peered":"2024-04-02T07:22:20.370214+0000","last_clean":"2024-04-02T07:22:20.370214+0000","last_became_active":"2024-04-02T07:22:17.824210+0000","last_became_peered":"2024-04-02T07:22:17.824210+0000","last_unstale":"2024-04-02T07:22:20.370214+0000","last_undegraded":"2024-04-02T07:22:20.370214+0000","last_fullsized":"2024-04-02T07:22:20.370214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:57:54.126973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221206+0000","last_change":"2024-04-02T07:22:18.242097+0000","last_active":"2024-04-02T07:22:19.221206+0000","last_peered":"2024-04-02T07:22:19.221206+0000","last_clean":"2024-04-02T07:22:19.221206+0000","last_became_active":"2024-04-02T07:22:18.241770+0000","last_became_peered":"2024-04-02T07:22:18.241770+0000","last_unstale":"2024-04-02T07:22:19.221206+0000","last_undegraded":"2024-04-02T07:22:19.221206+0000","last_fullsized":"2024-04-02T07:22:19.221206+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:25.644846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371666+0000","last_change":"2024-04-02T07:22:17.824891+0000","last_active":"2024-04-02T07:22:20.371666+0000","last_peered":"2024-04-02T07:22:20.371666+0000","last_clean":"2024-04-02T07:22:20.371666+0000","last_became_active":"2024-04-02T07:22:17.824638+0000","last_became_peered":"2024-04-02T07:22:17.824638+0000","last_unstale":"2024-04-02T07:22:20.371666+0000","last_undegraded":"2024-04-02T07:22:20.371666+0000","last_fullsized":"2024-04-02T07:22:20.371666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:57:54.126973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.219520+0000","last_change":"2024-04-02T07:22:18.234896+0000","last_active":"2024-04-02T07:22:19.219520+0000","last_peered":"2024-04-02T07:22:19.219520+0000","last_clean":"2024-04-02T07:22:19.219520+0000","last_became_active":"2024-04-02T07:22:18.234660+0000","last_became_peered":"2024-04-02T07:22:18.234660+0000","last_unstale":"2024-04-02T07:22:19.219520+0000","last_undegraded":"2024-04-02T07:22:19.219520+0000","last_fullsized":"2024-04-02T07:22:19.219520+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:59:52.607949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369565+0000","last_change":"2024-04-02T07:22:17.817464+0000","last_active":"2024-04-02T07:22:20.369565+0000","last_peered":"2024-04-02T07:22:20.369565+0000","last_clean":"2024-04-02T07:22:20.369565+0000","last_became_active":"2024-04-02T07:22:17.816972+0000","last_became_peered":"2024-04-02T07:22:17.816972+0000","last_unstale":"2024-04-02T07:22:20.369565+0000","last_undegraded":"2024-04-02T07:22:20.369565+0000","last_fullsized":"2024-04-02T07:22:20.369565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:26:13.873489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369566+0000","last_change":"2024-04-02T07:22:18.235644+0000","last_active":"2024-04-02T07:22:20.369566+0000","last_peered":"2024-04-02T07:22:20.369566+0000","last_clean":"2024-04-02T07:22:20.369566+0000","last_became_active":"2024-04-02T07:22:18.235180+0000","last_became_peered":"2024-04-02T07:22:18.235180+0000","last_unstale":"2024-04-02T07:22:20.369566+0000","last_undegraded":"2024-04-02T07:22:20.369566+0000","last_fullsized":"2024-04-02T07:22:20.369566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:14:02.133890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370710+0000","last_change":"2024-04-02T07:22:17.823676+0000","last_active":"2024-04-02T07:22:20.370710+0000","last_peered":"2024-04-02T07:22:20.370710+0000","last_clean":"2024-04-02T07:22:20.370710+0000","last_became_active":"2024-04-02T07:22:17.823161+0000","last_became_peered":"2024-04-02T07:22:17.823161+0000","last_unstale":"2024-04-02T07:22:20.370710+0000","last_undegraded":"2024-04-02T07:22:20.370710+0000","last_fullsized":"2024-04-02T07:22:20.370710+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:23:23.466281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.222657+0000","last_change":"2024-04-02T07:22:18.228040+0000","last_active":"2024-04-02T07:22:19.222657+0000","last_peered":"2024-04-02T07:22:19.222657+0000","last_clean":"2024-04-02T07:22:19.222657+0000","last_became_active":"2024-04-02T07:22:18.227742+0000","last_became_peered":"2024-04-02T07:22:18.227742+0000","last_unstale":"2024-04-02T07:22:19.222657+0000","last_undegraded":"2024-04-02T07:22:19.222657+0000","last_fullsized":"2024-04-02T07:22:19.222657+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:08:21.191481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369894+0000","last_change":"2024-04-02T07:22:17.817997+0000","last_active":"2024-04-02T07:22:20.369894+0000","last_peered":"2024-04-02T07:22:20.369894+0000","last_clean":"2024-04-02T07:22:20.369894+0000","last_became_active":"2024-04-02T07:22:17.816065+0000","last_became_peered":"2024-04-02T07:22:17.816065+0000","last_unstale":"2024-04-02T07:22:20.369894+0000","last_undegraded":"2024-04-02T07:22:20.369894+0000","last_fullsized":"2024-04-02T07:22:20.369894+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:57:54.126973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371335+0000","last_change":"2024-04-02T07:22:18.250113+0000","last_active":"2024-04-02T07:22:20.371335+0000","last_peered":"2024-04-02T07:22:20.371335+0000","last_clean":"2024-04-02T07:22:20.371335+0000","last_became_active":"2024-04-02T07:22:18.249884+0000","last_became_peered":"2024-04-02T07:22:18.249884+0000","last_unstale":"2024-04-02T07:22:20.371335+0000","last_undegraded":"2024-04-02T07:22:20.371335+0000","last_fullsized":"2024-04-02T07:22:20.371335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:36:43.798159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371775+0000","last_change":"2024-04-02T07:22:17.828935+0000","last_active":"2024-04-02T07:22:20.371775+0000","last_peered":"2024-04-02T07:22:20.371775+0000","last_clean":"2024-04-02T07:22:20.371775+0000","last_became_active":"2024-04-02T07:22:17.828207+0000","last_became_peered":"2024-04-02T07:22:17.828207+0000","last_unstale":"2024-04-02T07:22:20.371775+0000","last_undegraded":"2024-04-02T07:22:20.371775+0000","last_fullsized":"2024-04-02T07:22:20.371775+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:55:46.473285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369735+0000","last_change":"2024-04-02T07:22:18.229329+0000","last_active":"2024-04-02T07:22:20.369735+0000","last_peered":"2024-04-02T07:22:20.369735+0000","last_clean":"2024-04-02T07:22:20.369735+0000","last_became_active":"2024-04-02T07:22:18.228161+0000","last_became_peered":"2024-04-02T07:22:18.228161+0000","last_unstale":"2024-04-02T07:22:20.369735+0000","last_undegraded":"2024-04-02T07:22:20.369735+0000","last_fullsized":"2024-04-02T07:22:20.369735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:40:34.209765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:21.369684+0000","last_change":"2024-04-02T07:22:17.818709+0000","last_active":"2024-04-02T07:22:21.369684+0000","last_peered":"2024-04-02T07:22:21.369684+0000","last_clean":"2024-04-02T07:22:21.369684+0000","last_became_active":"2024-04-02T07:22:17.817235+0000","last_became_peered":"2024-04-02T07:22:17.817235+0000","last_unstale":"2024-04-02T07:22:21.369684+0000","last_undegraded":"2024-04-02T07:22:21.369684+0000","last_fullsized":"2024-04-02T07:22:21.369684+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:10:54.215675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221561+0000","last_change":"2024-04-02T07:22:18.245016+0000","last_active":"2024-04-02T07:22:19.221561+0000","last_peered":"2024-04-02T07:22:19.221561+0000","last_clean":"2024-04-02T07:22:19.221561+0000","last_became_active":"2024-04-02T07:22:18.244613+0000","last_became_peered":"2024-04-02T07:22:18.244613+0000","last_unstale":"2024-04-02T07:22:19.221561+0000","last_undegraded":"2024-04-02T07:22:19.221561+0000","last_fullsized":"2024-04-02T07:22:19.221561+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:12:09.974224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371212+0000","last_change":"2024-04-02T07:22:17.819790+0000","last_active":"2024-04-02T07:22:20.371212+0000","last_peered":"2024-04-02T07:22:20.371212+0000","last_clean":"2024-04-02T07:22:20.371212+0000","last_became_active":"2024-04-02T07:22:17.818108+0000","last_became_peered":"2024-04-02T07:22:17.818108+0000","last_unstale":"2024-04-02T07:22:20.371212+0000","last_undegraded":"2024-04-02T07:22:20.371212+0000","last_fullsized":"2024-04-02T07:22:20.371212+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:23:23.466281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.220036+0000","last_change":"2024-04-02T07:22:18.228791+0000","last_active":"2024-04-02T07:22:19.220036+0000","last_peered":"2024-04-02T07:22:19.220036+0000","last_clean":"2024-04-02T07:22:19.220036+0000","last_became_active":"2024-04-02T07:22:18.228473+0000","last_became_peered":"2024-04-02T07:22:18.228473+0000","last_unstale":"2024-04-02T07:22:19.220036+0000","last_undegraded":"2024-04-02T07:22:19.220036+0000","last_fullsized":"2024-04-02T07:22:19.220036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:10:03.944538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371839+0000","last_change":"2024-04-02T07:22:17.825367+0000","last_active":"2024-04-02T07:22:20.371839+0000","last_peered":"2024-04-02T07:22:20.371839+0000","last_clean":"2024-04-02T07:22:20.371839+0000","last_became_active":"2024-04-02T07:22:17.825104+0000","last_became_peered":"2024-04-02T07:22:17.825104+0000","last_unstale":"2024-04-02T07:22:20.371839+0000","last_undegraded":"2024-04-02T07:22:20.371839+0000","last_fullsized":"2024-04-02T07:22:20.371839+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:10:54.215675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.222586+0000","last_change":"2024-04-02T07:22:18.233413+0000","last_active":"2024-04-02T07:22:19.222586+0000","last_peered":"2024-04-02T07:22:19.222586+0000","last_clean":"2024-04-02T07:22:19.222586+0000","last_became_active":"2024-04-02T07:22:18.233117+0000","last_became_peered":"2024-04-02T07:22:18.233117+0000","last_unstale":"2024-04-02T07:22:19.222586+0000","last_undegraded":"2024-04-02T07:22:19.222586+0000","last_fullsized":"2024-04-02T07:22:19.222586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:10:55.218249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.369809+0000","last_change":"2024-04-02T07:22:17.814952+0000","last_active":"2024-04-02T07:22:20.369809+0000","last_peered":"2024-04-02T07:22:20.369809+0000","last_clean":"2024-04-02T07:22:20.369809+0000","last_became_active":"2024-04-02T07:22:17.814563+0000","last_became_peered":"2024-04-02T07:22:17.814563+0000","last_unstale":"2024-04-02T07:22:20.369809+0000","last_undegraded":"2024-04-02T07:22:20.369809+0000","last_fullsized":"2024-04-02T07:22:20.369809+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:23:23.466281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221101+0000","last_change":"2024-04-02T07:22:18.234123+0000","last_active":"2024-04-02T07:22:19.221101+0000","last_peered":"2024-04-02T07:22:19.221101+0000","last_clean":"2024-04-02T07:22:19.221101+0000","last_became_active":"2024-04-02T07:22:18.233486+0000","last_became_peered":"2024-04-02T07:22:18.233486+0000","last_unstale":"2024-04-02T07:22:19.221101+0000","last_undegraded":"2024-04-02T07:22:19.221101+0000","last_fullsized":"2024-04-02T07:22:19.221101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:59:52.607949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370124+0000","last_change":"2024-04-02T07:22:17.812302+0000","last_active":"2024-04-02T07:22:20.370124+0000","last_peered":"2024-04-02T07:22:20.370124+0000","last_clean":"2024-04-02T07:22:20.370124+0000","last_became_active":"2024-04-02T07:22:17.812047+0000","last_became_peered":"2024-04-02T07:22:17.812047+0000","last_unstale":"2024-04-02T07:22:20.370124+0000","last_undegraded":"2024-04-02T07:22:20.370124+0000","last_fullsized":"2024-04-02T07:22:20.370124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:11:57.231785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221351+0000","last_change":"2024-04-02T07:22:18.233906+0000","last_active":"2024-04-02T07:22:19.221351+0000","last_peered":"2024-04-02T07:22:19.221351+0000","last_clean":"2024-04-02T07:22:19.221351+0000","last_became_active":"2024-04-02T07:22:18.233651+0000","last_became_peered":"2024-04-02T07:22:18.233651+0000","last_unstale":"2024-04-02T07:22:19.221351+0000","last_undegraded":"2024-04-02T07:22:19.221351+0000","last_fullsized":"2024-04-02T07:22:19.221351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:03:59.884565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371794+0000","last_change":"2024-04-02T07:22:17.828556+0000","last_active":"2024-04-02T07:22:20.371794+0000","last_peered":"2024-04-02T07:22:20.371794+0000","last_clean":"2024-04-02T07:22:20.371794+0000","last_became_active":"2024-04-02T07:22:17.828231+0000","last_became_peered":"2024-04-02T07:22:17.828231+0000","last_unstale":"2024-04-02T07:22:20.371794+0000","last_undegraded":"2024-04-02T07:22:20.371794+0000","last_fullsized":"2024-04-02T07:22:20.371794+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:08:20.188906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370077+0000","last_change":"2024-04-02T07:22:18.238093+0000","last_active":"2024-04-02T07:22:20.370077+0000","last_peered":"2024-04-02T07:22:20.370077+0000","last_clean":"2024-04-02T07:22:20.370077+0000","last_became_active":"2024-04-02T07:22:18.237834+0000","last_became_peered":"2024-04-02T07:22:18.237834+0000","last_unstale":"2024-04-02T07:22:20.370077+0000","last_undegraded":"2024-04-02T07:22:20.370077+0000","last_fullsized":"2024-04-02T07:22:20.370077+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:14:02.133890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370610+0000","last_change":"2024-04-02T07:22:18.237467+0000","last_active":"2024-04-02T07:22:20.370610+0000","last_peered":"2024-04-02T07:22:20.370610+0000","last_clean":"2024-04-02T07:22:20.370610+0000","last_became_active":"2024-04-02T07:22:18.237207+0000","last_became_peered":"2024-04-02T07:22:18.237207+0000","last_unstale":"2024-04-02T07:22:20.370610+0000","last_undegraded":"2024-04-02T07:22:20.370610+0000","last_fullsized":"2024-04-02T07:22:20.370610+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:17:53.201974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371339+0000","last_change":"2024-04-02T07:22:17.829386+0000","last_active":"2024-04-02T07:22:20.371339+0000","last_peered":"2024-04-02T07:22:20.371339+0000","last_clean":"2024-04-02T07:22:20.371339+0000","last_became_active":"2024-04-02T07:22:17.829068+0000","last_became_peered":"2024-04-02T07:22:17.829068+0000","last_unstale":"2024-04-02T07:22:20.371339+0000","last_undegraded":"2024-04-02T07:22:20.371339+0000","last_fullsized":"2024-04-02T07:22:20.371339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:24:06.150055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.370454+0000","last_change":"2024-04-02T07:22:18.237780+0000","last_active":"2024-04-02T07:22:20.370454+0000","last_peered":"2024-04-02T07:22:20.370454+0000","last_clean":"2024-04-02T07:22:20.370454+0000","last_became_active":"2024-04-02T07:22:18.237463+0000","last_became_peered":"2024-04-02T07:22:18.237463+0000","last_unstale":"2024-04-02T07:22:20.370454+0000","last_undegraded":"2024-04-02T07:22:20.370454+0000","last_fullsized":"2024-04-02T07:22:20.370454+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:03:59.884565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:20.371531+0000","last_change":"2024-04-02T07:22:17.825046+0000","last_active":"2024-04-02T07:22:20.371531+0000","last_peered":"2024-04-02T07:22:20.371531+0000","last_clean":"2024-04-02T07:22:20.371531+0000","last_became_active":"2024-04-02T07:22:17.824764+0000","last_became_peered":"2024-04-02T07:22:17.824764+0000","last_unstale":"2024-04-02T07:22:20.371531+0000","last_undegraded":"2024-04-02T07:22:20.371531+0000","last_fullsized":"2024-04-02T07:22:20.371531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:28:34.570227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.220221+0000","last_change":"2024-04-02T07:22:18.232920+0000","last_active":"2024-04-02T07:22:19.220221+0000","last_peered":"2024-04-02T07:22:19.220221+0000","last_clean":"2024-04-02T07:22:19.220221+0000","last_became_active":"2024-04-02T07:22:18.232676+0000","last_became_peered":"2024-04-02T07:22:18.232676+0000","last_unstale":"2024-04-02T07:22:19.220221+0000","last_undegraded":"2024-04-02T07:22:19.220221+0000","last_fullsized":"2024-04-02T07:22:19.220221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:12:09.974224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221499+0000","last_change":"2024-04-02T07:22:17.815381+0000","last_active":"2024-04-02T07:22:19.221499+0000","last_peered":"2024-04-02T07:22:19.221499+0000","last_clean":"2024-04-02T07:22:19.221499+0000","last_became_active":"2024-04-02T07:22:17.814994+0000","last_became_peered":"2024-04-02T07:22:17.814994+0000","last_unstale":"2024-04-02T07:22:19.221499+0000","last_undegraded":"2024-04-02T07:22:19.221499+0000","last_fullsized":"2024-04-02T07:22:19.221499+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:28:39.704218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.221449+0000","last_change":"2024-04-02T07:22:18.242114+0000","last_active":"2024-04-02T07:22:19.221449+0000","last_peered":"2024-04-02T07:22:19.221449+0000","last_clean":"2024-04-02T07:22:19.221449+0000","last_became_active":"2024-04-02T07:22:18.241865+0000","last_became_peered":"2024-04-02T07:22:18.241865+0000","last_unstale":"2024-04-02T07:22:19.221449+0000","last_undegraded":"2024-04-02T07:22:19.221449+0000","last_fullsized":"2024-04-02T07:22:19.221449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:17.791096+0000","last_clean_scrub_stamp":"2024-04-02T07:22:17.791096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:36:43.798159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-02T07:22:19.220294+0000","last_change":"2024-04-02T07:22:17.827269+0000","last_active":"2024-04-02T07:22:19.220294+0000","last_peered":"2024-04-02T07:22:19.220294+0000","last_clean":"2024-04-02T07:22:19.220294+0000","last_became_active":"2024-04-02T07:22:17.826815+0000","last_became_peered":"2024-04-02T07:22:17.826815+0000","last_unstale":"2024-04-02T07:22:19.220294+0000","last_undegraded":"2024-04-02T07:22:19.220294+0000","last_fullsized":"2024-04-02T07:22:19.220294+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:16.788521+0000","last_clean_scrub_stamp":"2024-04-02T07:22:16.788521+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:17:18.668101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":784,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":802816,"data_stored":661848,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.747}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69899999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":70988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71899999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.873}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4929999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.9180000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31328,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340512,"statfs":{"total":96636764160,"available":96604684288,"internally_reserved":0,"allocated":217088,"data_stored":72462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56200000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31316,"kb_used_data":200,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340524,"statfs":{"total":96636764160,"available":96604696576,"internally_reserved":0,"allocated":204800,"data_stored":70898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31324,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340516,"statfs":{"total":96636764160,"available":96604688384,"internally_reserved":0,"allocated":212992,"data_stored":71058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73899999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0580000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31908,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339932,"statfs":{"total":96636764160,"available":96604090368,"internally_reserved":0,"allocated":811008,"data_stored":661904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81899999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:22:27.428 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-02T07:22:27.428 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-02T07:22:27.428 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-02T07:22:27.429 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-02T07:22:27.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea14000640 1 Processor -- start 2024-04-02T07:22:27.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea14000640 1 -- start start 2024-04-02T07:22:27.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea14000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea0c15ee70 0x7fea0c099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:27.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea14000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fea0c099120 0x7fea0c0b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:27.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea14000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea0c0ad270 con 0x7fea0c15f250 2024-04-02T07:22:27.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea14000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea0c0b0840 con 0x7fea0c099120 2024-04-02T07:22:27.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea14000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c0cf6a0 con 0x7fea0c15ee70 2024-04-02T07:22:27.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea10c00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fea0c15f250 0x7fea0c098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49194/0 (socket says 172.21.15.55:49194) 2024-04-02T07:22:27.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea10c00640 1 -- 172.21.15.55:0/1512865396 learned_addr learned my addr 172.21.15.55:0/1512865396 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:27.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea11600640 1 --2- 172.21.15.55:0/1512865396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea0c15ee70 0x7fea0c099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:27.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea0be00640 1 -- 172.21.15.55:0/1512865396 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096535958 0 0) 0x7fea0c0ad270 con 0x7fea0c15f250 2024-04-02T07:22:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea12000640 1 --2- 172.21.15.55:0/1512865396 >> v2:172.21.15.106:3300/0 conn(0x7fea0c099120 0x7fea0c0b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea0be00640 1 -- 172.21.15.55:0/1512865396 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9f4003530 con 0x7fea0c15f250 2024-04-02T07:22:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea0be00640 1 -- 172.21.15.55:0/1512865396 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3201923465 0 0) 0x7fe9f4003530 con 0x7fea0c15f250 2024-04-02T07:22:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea0be00640 1 -- 172.21.15.55:0/1512865396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea0c15ee70 msgr2=0x7fea0c099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea0be00640 1 --2- 172.21.15.55:0/1512865396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea0c15ee70 0x7fea0c099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea0be00640 1 -- 172.21.15.55:0/1512865396 >> v2:172.21.15.106:3300/0 conn(0x7fea0c099120 msgr2=0x7fea0c0b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea0be00640 1 --2- 172.21.15.55:0/1512865396 >> v2:172.21.15.106:3300/0 conn(0x7fea0c099120 0x7fea0c0b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea0be00640 1 -- 172.21.15.55:0/1512865396 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0c0b0a50 con 0x7fea0c15f250 2024-04-02T07:22:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea0be00640 1 -- 172.21.15.55:0/1512865396 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fe9f8001680 con 0x7fea0c15f250 2024-04-02T07:22:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea0be00640 1 -- 172.21.15.55:0/1512865396 >> v1:172.21.15.55:6789/0 conn(0x7fea0c15f250 legacy=0x7fea0c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea0be00640 1 --2- 172.21.15.55:0/1512865396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea0c15ee70 0x7fe9f4003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea0be00640 1 --2- 172.21.15.55:0/1512865396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9f4003f50 0x7fe9f40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:27.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea0be00640 1 --2- 172.21.15.55:0/1512865396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9f4004d10 0x7fe9f4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea0be00640 1 -- 172.21.15.55:0/1512865396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c0b0840 con 0x7fe9f4003f50 2024-04-02T07:22:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea0be00640 1 -- 172.21.15.55:0/1512865396 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c0cf6a0 con 0x7fe9f4004d10 2024-04-02T07:22:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.605+0000 7fea0be00640 1 -- 172.21.15.55:0/1512865396 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9f400b990 con 0x7fea0c15ee70 2024-04-02T07:22:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.609+0000 7fea10c00640 1 --2- 172.21.15.55:0/1512865396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9f4003f50 0x7fe9f40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.609+0000 7fea11600640 1 --2- 172.21.15.55:0/1512865396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea0c15ee70 0x7fe9f4003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.609+0000 7fea12000640 1 --2- 172.21.15.55:0/1512865396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9f4004d10 0x7fe9f4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.609+0000 7fea11600640 1 -- 172.21.15.55:0/1512865396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9f4004d10 msgr2=0x7fe9f4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.609+0000 7fea11600640 1 --2- 172.21.15.55:0/1512865396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9f4004d10 0x7fe9f4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.609+0000 7fea11600640 1 -- 172.21.15.55:0/1512865396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9f4003f50 msgr2=0x7fe9f40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.609+0000 7fea11600640 1 --2- 172.21.15.55:0/1512865396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9f4003f50 0x7fe9f40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.609+0000 7fea11600640 1 -- 172.21.15.55:0/1512865396 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f4003530 con 0x7fea0c15ee70 2024-04-02T07:22:27.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.609+0000 7fea11600640 1 --2- 172.21.15.55:0/1512865396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea0c15ee70 0x7fe9f4003980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea00009b10 tx=0x7fea0001cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4972782e4e97993b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:27.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.609+0000 7fea0be00640 1 -- 172.21.15.55:0/1512865396 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea000a5590 con 0x7fea0c15ee70 2024-04-02T07:22:27.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.609+0000 7fea0be00640 1 -- 172.21.15.55:0/1512865396 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea000a56f0 con 0x7fea0c15ee70 2024-04-02T07:22:27.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.609+0000 7fea0be00640 1 -- 172.21.15.55:0/1512865396 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea000a5aa0 con 0x7fea0c15ee70 2024-04-02T07:22:27.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea14000640 1 -- 172.21.15.55:0/1512865396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea0c15ee70 msgr2=0x7fe9f4003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:27.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea14000640 1 --2- 172.21.15.55:0/1512865396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea0c15ee70 0x7fe9f4003980 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fea00009b10 tx=0x7fea0001cab0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea12000640 1 -- 172.21.15.55:0/1512865396 reap_dead start 2024-04-02T07:22:27.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea14000640 1 -- 172.21.15.55:0/1512865396 shutdown_connections 2024-04-02T07:22:27.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea14000640 1 -- 172.21.15.55:0/1512865396 >> 172.21.15.55:0/1512865396 conn(0x7fea0c0b21d0 msgr2=0x7fea0c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:27.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea14000640 1 -- 172.21.15.55:0/1512865396 shutdown_connections 2024-04-02T07:22:27.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea14000640 1 -- 172.21.15.55:0/1512865396 wait complete. 2024-04-02T07:22:27.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea14000640 1 Processor -- start 2024-04-02T07:22:27.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea14000640 1 -- start start 2024-04-02T07:22:27.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea14000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea0c15ee70 0x7fea0c150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:27.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea14000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea0c0c5ed0 0x7fea0c0ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:27.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea14000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea0c0c80a0 0x7fea0c0c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:27.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea14000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c15e0a0 con 0x7fea0c0c5ed0 2024-04-02T07:22:27.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea14000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c0c8a60 con 0x7fea0c15ee70 2024-04-02T07:22:27.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea14000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea0c1511b0 con 0x7fea0c0c80a0 2024-04-02T07:22:27.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea10c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea0c0c5ed0 0x7fea0c0ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:27.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea11600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea0c15ee70 0x7fea0c150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:27.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea10c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea0c0c5ed0 0x7fea0c0ca140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60974/0 (socket says 172.21.15.55:60974) 2024-04-02T07:22:27.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea10c00640 1 -- 172.21.15.55:0/1392034776 learned_addr learned my addr 172.21.15.55:0/1392034776 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:27.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea12000640 1 --2- 172.21.15.55:0/1392034776 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea0c0c80a0 0x7fea0c0c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:27.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea10c00640 1 -- 172.21.15.55:0/1392034776 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea0c0c80a0 msgr2=0x7fea0c0c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:27.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea10c00640 1 --2- 172.21.15.55:0/1392034776 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea0c0c80a0 0x7fea0c0c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea10c00640 1 -- 172.21.15.55:0/1392034776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea0c15ee70 msgr2=0x7fea0c150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:27.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea10c00640 1 --2- 172.21.15.55:0/1392034776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea0c15ee70 0x7fea0c150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea10c00640 1 -- 172.21.15.55:0/1392034776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea0c0c6470 con 0x7fea0c0c5ed0 2024-04-02T07:22:27.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.613+0000 7fea11600640 1 --2- 172.21.15.55:0/1392034776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea0c15ee70 0x7fea0c150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:27.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.617+0000 7fea10c00640 1 --2- 172.21.15.55:0/1392034776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea0c0c5ed0 0x7fea0c0ca140 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8012510 tx=0x7fe9f80129d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.617+0000 7fea09600640 1 -- 172.21.15.55:0/1392034776 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8014810 con 0x7fea0c0c5ed0 2024-04-02T07:22:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.617+0000 7fea09600640 1 -- 172.21.15.55:0/1392034776 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f8014970 con 0x7fea0c0c5ed0 2024-04-02T07:22:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.617+0000 7fea09600640 1 -- 172.21.15.55:0/1392034776 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8014d00 con 0x7fea0c0c5ed0 2024-04-02T07:22:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.617+0000 7fea14000640 1 -- 172.21.15.55:0/1392034776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea0c0c6750 con 0x7fea0c0c5ed0 2024-04-02T07:22:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.617+0000 7fea14000640 1 -- 172.21.15.55:0/1392034776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea0c0c6d10 con 0x7fea0c0c5ed0 2024-04-02T07:22:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.617+0000 7fea14000640 1 -- 172.21.15.55:0/1392034776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea0c0c6ed0 con 0x7fea0c0c5ed0 2024-04-02T07:22:27.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.617+0000 7fea09600640 1 -- 172.21.15.55:0/1392034776 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe9f80153e0 con 0x7fea0c0c5ed0 2024-04-02T07:22:27.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.617+0000 7fea09600640 1 --2- 172.21.15.55:0/1392034776 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe9ec066690 0x7fe9ec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:27.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.617+0000 7fea09600640 1 -- 172.21.15.55:0/1392034776 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9f8086b70 con 0x7fea0c0c5ed0 2024-04-02T07:22:27.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.617+0000 7fea11600640 1 --2- 172.21.15.55:0/1392034776 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe9ec066690 0x7fe9ec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:27.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.621+0000 7fea11600640 1 --2- 172.21.15.55:0/1392034776 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe9ec066690 0x7fe9ec068b50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fea000af000 tx=0x7fea000046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:27.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.621+0000 7fea09600640 1 -- 172.21.15.55:0/1392034776 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe9f8053ef0 con 0x7fea0c0c5ed0 2024-04-02T07:22:27.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.813+0000 7fea14000640 1 -- 172.21.15.55:0/1392034776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fea0c0cab80 con 0x7fea0c0c5ed0 2024-04-02T07:22:27.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.817+0000 7fea09600640 1 -- 172.21.15.55:0/1392034776 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fe9f801c080 con 0x7fea0c0c5ed0 2024-04-02T07:22:27.820 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:27.820 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-02T07:22:27.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.817+0000 7fea14000640 1 -- 172.21.15.55:0/1392034776 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe9ec066690 msgr2=0x7fe9ec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:27.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.817+0000 7fea14000640 1 --2- 172.21.15.55:0/1392034776 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe9ec066690 0x7fe9ec068b50 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fea000af000 tx=0x7fea000046d0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.817+0000 7fea14000640 1 -- 172.21.15.55:0/1392034776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea0c0c5ed0 msgr2=0x7fea0c0ca140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:27.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.817+0000 7fea14000640 1 --2- 172.21.15.55:0/1392034776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea0c0c5ed0 0x7fea0c0ca140 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe9f8012510 tx=0x7fe9f80129d0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.817+0000 7fea14000640 1 -- 172.21.15.55:0/1392034776 shutdown_connections 2024-04-02T07:22:27.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.817+0000 7fea14000640 1 --2- 172.21.15.55:0/1392034776 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fea0c0c80a0 0x7fea0c0c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.817+0000 7fea14000640 1 --2- 172.21.15.55:0/1392034776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fea0c0c5ed0 0x7fea0c0ca140 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.817+0000 7fea14000640 1 --2- 172.21.15.55:0/1392034776 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe9ec066690 0x7fe9ec068b50 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.817+0000 7fea14000640 1 --2- 172.21.15.55:0/1392034776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fea0c15ee70 0x7fea0c150c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.817+0000 7fea14000640 1 -- 172.21.15.55:0/1392034776 >> 172.21.15.55:0/1392034776 conn(0x7fea0c0b21d0 msgr2=0x7fea0c0af4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:27.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.817+0000 7fea14000640 1 -- 172.21.15.55:0/1392034776 shutdown_connections 2024-04-02T07:22:27.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.817+0000 7fea14000640 1 -- 172.21.15.55:0/1392034776 wait complete. 2024-04-02T07:22:27.840 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-02T07:22:27.841 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:27.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.977+0000 7ffafc600640 1 Processor -- start 2024-04-02T07:22:27.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.977+0000 7ffafc600640 1 -- start start 2024-04-02T07:22:27.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.977+0000 7ffafc600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffaf415f250 0x7ffaf4099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:27.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.977+0000 7ffafc600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf40ad270 con 0x7ffaf4099120 2024-04-02T07:22:27.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.977+0000 7ffafc600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaf40b0a50 con 0x7ffaf415ee70 2024-04-02T07:22:27.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.977+0000 7ffafc600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaf40b0840 con 0x7ffaf415f250 2024-04-02T07:22:27.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.977+0000 7ffaf9200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ffaf4099120 0x7ffaf40ce690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49196/0 (socket says 172.21.15.55:49196) 2024-04-02T07:22:27.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.977+0000 7ffaf9200640 1 -- 172.21.15.55:0/1892966176 learned_addr learned my addr 172.21.15.55:0/1892966176 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:27.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.977+0000 7ffafa600640 1 --2- 172.21.15.55:0/1892966176 >> v2:172.21.15.55:3300/0 conn(0x7ffaf415f250 0x7ffaf4099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:27.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.977+0000 7ffafa600640 1 -- 172.21.15.55:0/1892966176 >> v1:172.21.15.106:6789/0 conn(0x7ffaf415ee70 legacy=0x7ffaf4098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:27.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.977+0000 7ffafa600640 1 -- 172.21.15.55:0/1892966176 >> v1:172.21.15.55:6789/0 conn(0x7ffaf4099120 legacy=0x7ffaf40ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:27.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.977+0000 7ffafa600640 1 -- 172.21.15.55:0/1892966176 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf40b0d30 con 0x7ffaf415f250 2024-04-02T07:22:27.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.981+0000 7ffafa600640 1 --2- 172.21.15.55:0/1892966176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf415f250 0x7ffaf4099830 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009d90 tx=0x7ffaec01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6031b26ebcadca5b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:27.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.981+0000 7ffaf3e00640 1 -- 172.21.15.55:0/1892966176 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec0a59e0 con 0x7ffaf415f250 2024-04-02T07:22:27.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.981+0000 7ffaf3e00640 1 -- 172.21.15.55:0/1892966176 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaec0a5b40 con 0x7ffaf415f250 2024-04-02T07:22:27.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.981+0000 7ffaf3e00640 1 -- 172.21.15.55:0/1892966176 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaec0ad440 con 0x7ffaf415f250 2024-04-02T07:22:27.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.981+0000 7ffafc600640 1 -- 172.21.15.55:0/1892966176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf415f250 msgr2=0x7ffaf4099830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:27.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.981+0000 7ffafc600640 1 --2- 172.21.15.55:0/1892966176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf415f250 0x7ffaf4099830 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ffaec009d90 tx=0x7ffaec01c940 comp rx=0 tx=0).stop 2024-04-02T07:22:27.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.981+0000 7ffafc600640 1 -- 172.21.15.55:0/1892966176 shutdown_connections 2024-04-02T07:22:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.981+0000 7ffafc600640 1 --2- 172.21.15.55:0/1892966176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf415f250 0x7ffaf4099830 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.981+0000 7ffafc600640 1 -- 172.21.15.55:0/1892966176 >> 172.21.15.55:0/1892966176 conn(0x7ffaf40b21d0 msgr2=0x7ffaf40b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.981+0000 7ffafc600640 1 -- 172.21.15.55:0/1892966176 shutdown_connections 2024-04-02T07:22:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.981+0000 7ffafc600640 1 -- 172.21.15.55:0/1892966176 wait complete. 2024-04-02T07:22:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffafc600640 1 Processor -- start 2024-04-02T07:22:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffafc600640 1 -- start start 2024-04-02T07:22:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffafc600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf4099120 0x7ffaf40b30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffafc600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffaf415ee70 0x7ffaf4153a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffafc600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaf415f250 0x7ffaf4164400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffafc600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf4153fb0 con 0x7ffaf4099120 2024-04-02T07:22:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffafc600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf4164fa0 con 0x7ffaf415f250 2024-04-02T07:22:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffafc600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaf4155ec0 con 0x7ffaf415ee70 2024-04-02T07:22:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffaf9c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf4099120 0x7ffaf40b30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffaf9c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf4099120 0x7ffaf40b30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60998/0 (socket says 172.21.15.55:60998) 2024-04-02T07:22:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffaf9c00640 1 -- 172.21.15.55:0/3789721846 learned_addr learned my addr 172.21.15.55:0/3789721846 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffaf9200640 1 --2- 172.21.15.55:0/3789721846 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffaf415ee70 0x7ffaf4153a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffafa600640 1 --2- 172.21.15.55:0/3789721846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaf415f250 0x7ffaf4164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffaf9c00640 1 -- 172.21.15.55:0/3789721846 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffaf415ee70 msgr2=0x7ffaf4153a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffaf9c00640 1 --2- 172.21.15.55:0/3789721846 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffaf415ee70 0x7ffaf4153a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffaf9c00640 1 -- 172.21.15.55:0/3789721846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaf415f250 msgr2=0x7ffaf4164400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffaf9c00640 1 --2- 172.21.15.55:0/3789721846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaf415f250 0x7ffaf4164400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffaf9c00640 1 -- 172.21.15.55:0/3789721846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaec009a70 con 0x7ffaf4099120 2024-04-02T07:22:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffafa600640 1 --2- 172.21.15.55:0/3789721846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaf415f250 0x7ffaf4164400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffaf9c00640 1 --2- 172.21.15.55:0/3789721846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf4099120 0x7ffaf40b30b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ffae800c3c0 tx=0x7ffae800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffaf1600640 1 -- 172.21.15.55:0/3789721846 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae80052d0 con 0x7ffaf4099120 2024-04-02T07:22:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffaf1600640 1 -- 172.21.15.55:0/3789721846 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffae8005430 con 0x7ffaf4099120 2024-04-02T07:22:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffaf1600640 1 -- 172.21.15.55:0/3789721846 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffae8003840 con 0x7ffaf4099120 2024-04-02T07:22:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffafc600640 1 -- 172.21.15.55:0/3789721846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaf41561a0 con 0x7ffaf4099120 2024-04-02T07:22:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffafc600640 1 -- 172.21.15.55:0/3789721846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaf40b5a30 con 0x7ffaf4099120 2024-04-02T07:22:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.985+0000 7ffafc600640 1 -- 172.21.15.55:0/3789721846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaf41566c0 con 0x7ffaf4099120 2024-04-02T07:22:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.989+0000 7ffaf1600640 1 -- 172.21.15.55:0/3789721846 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ffae80039a0 con 0x7ffaf4099120 2024-04-02T07:22:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.989+0000 7ffaf1600640 1 --2- 172.21.15.55:0/3789721846 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffad4066690 0x7ffad4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.989+0000 7ffaf1600640 1 -- 172.21.15.55:0/3789721846 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffae8083620 con 0x7ffaf4099120 2024-04-02T07:22:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.989+0000 7ffaf9200640 1 --2- 172.21.15.55:0/3789721846 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffad4066690 0x7ffad4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.989+0000 7ffaf9200640 1 --2- 172.21.15.55:0/3789721846 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffad4066690 0x7ffad4068b50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40b60b0 tx=0x7ffae0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:27.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:27.993+0000 7ffaf1600640 1 -- 172.21.15.55:0/3789721846 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ffaf41566c0 con 0x7ffaf4099120 2024-04-02T07:22:28.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.157+0000 7ffafc600640 1 -- 172.21.15.55:0/3789721846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffaf41566c0 con 0x7ffaf4099120 2024-04-02T07:22:28.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.157+0000 7ffaf1600640 1 -- 172.21.15.55:0/3789721846 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7ffaf41566c0 con 0x7ffaf4099120 2024-04-02T07:22:28.161 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:28.161 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:19.207279+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:28.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.157+0000 7ffafc600640 1 -- 172.21.15.55:0/3789721846 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffad4066690 msgr2=0x7ffad4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:28.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.157+0000 7ffafc600640 1 --2- 172.21.15.55:0/3789721846 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffad4066690 0x7ffad4068b50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ffaf40b60b0 tx=0x7ffae0009040 comp rx=0 tx=0).stop 2024-04-02T07:22:28.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.157+0000 7ffafc600640 1 -- 172.21.15.55:0/3789721846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf4099120 msgr2=0x7ffaf40b30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:28.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.157+0000 7ffafc600640 1 --2- 172.21.15.55:0/3789721846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf4099120 0x7ffaf40b30b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ffae800c3c0 tx=0x7ffae800c880 comp rx=0 tx=0).stop 2024-04-02T07:22:28.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.157+0000 7ffafc600640 1 -- 172.21.15.55:0/3789721846 shutdown_connections 2024-04-02T07:22:28.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.157+0000 7ffafc600640 1 --2- 172.21.15.55:0/3789721846 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffad4066690 0x7ffad4068b50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.157+0000 7ffafc600640 1 --2- 172.21.15.55:0/3789721846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaf415f250 0x7ffaf4164400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.157+0000 7ffafc600640 1 --2- 172.21.15.55:0/3789721846 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffaf415ee70 0x7ffaf4153a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.157+0000 7ffafc600640 1 --2- 172.21.15.55:0/3789721846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaf4099120 0x7ffaf40b30b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.157+0000 7ffafc600640 1 -- 172.21.15.55:0/3789721846 >> 172.21.15.55:0/3789721846 conn(0x7ffaf40b21d0 msgr2=0x7ffaf415c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:28.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.157+0000 7ffafc600640 1 -- 172.21.15.55:0/3789721846 shutdown_connections 2024-04-02T07:22:28.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.157+0000 7ffafc600640 1 -- 172.21.15.55:0/3789721846 wait complete. 2024-04-02T07:22:28.183 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:22:16.738297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:22:17.190496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:22:28.184 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:22:28.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.321+0000 7fd390800640 1 Processor -- start 2024-04-02T07:22:28.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.325+0000 7fd390800640 1 -- start start 2024-04-02T07:22:28.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.325+0000 7fd390800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd38815ca60 0x7fd3880cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:28.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.325+0000 7fd390800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd38806c030 0x7fd388098ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:28.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.325+0000 7fd390800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd38815ce40 con 0x7fd388098a10 2024-04-02T07:22:28.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.325+0000 7fd390800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3880993e0 con 0x7fd38815ca60 2024-04-02T07:22:28.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.325+0000 7fd390800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38806c440 con 0x7fd38806c030 2024-04-02T07:22:28.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.325+0000 7fd38de00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd38815ca60 0x7fd3880cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:28.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.325+0000 7fd38e800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd38806c030 0x7fd388098ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:28.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.325+0000 7fd38de00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd38815ca60 0x7fd3880cfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:49462/0 (socket says 172.21.15.55:49462) 2024-04-02T07:22:28.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.325+0000 7fd38de00640 1 -- 172.21.15.55:0/3311423649 learned_addr learned my addr 172.21.15.55:0/3311423649 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:28.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.325+0000 7fd38e800640 1 -- 172.21.15.55:0/3311423649 >> v2:172.21.15.106:3300/0 conn(0x7fd38815ca60 msgr2=0x7fd3880cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:28.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.325+0000 7fd38e800640 1 --2- 172.21.15.55:0/3311423649 >> v2:172.21.15.106:3300/0 conn(0x7fd38815ca60 0x7fd3880cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.325+0000 7fd38e800640 1 -- 172.21.15.55:0/3311423649 >> v1:172.21.15.55:6789/0 conn(0x7fd388098a10 legacy=0x7fd38806b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:28.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.325+0000 7fd38e800640 1 -- 172.21.15.55:0/3311423649 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3880d01b0 con 0x7fd38806c030 2024-04-02T07:22:28.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.325+0000 7fd38de00640 1 --2- 172.21.15.55:0/3311423649 >> v2:172.21.15.106:3300/0 conn(0x7fd38815ca60 0x7fd3880cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:28.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.329+0000 7fd38e800640 1 --2- 172.21.15.55:0/3311423649 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd38806c030 0x7fd388098ea0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd384009d90 tx=0x7fd38401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f193a51a6249c52 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:28.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.329+0000 7fd38ca00640 1 -- 172.21.15.55:0/3311423649 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3840a5970 con 0x7fd38806c030 2024-04-02T07:22:28.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.329+0000 7fd38ca00640 1 -- 172.21.15.55:0/3311423649 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3840a5ad0 con 0x7fd38806c030 2024-04-02T07:22:28.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.329+0000 7fd38ca00640 1 -- 172.21.15.55:0/3311423649 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3840a5e60 con 0x7fd38806c030 2024-04-02T07:22:28.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.329+0000 7fd390800640 1 -- 172.21.15.55:0/3311423649 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd38806c030 msgr2=0x7fd388098ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:28.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.329+0000 7fd390800640 1 --2- 172.21.15.55:0/3311423649 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd38806c030 0x7fd388098ea0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd384009d90 tx=0x7fd38401c8b0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.329+0000 7fd390800640 1 -- 172.21.15.55:0/3311423649 shutdown_connections 2024-04-02T07:22:28.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.329+0000 7fd390800640 1 --2- 172.21.15.55:0/3311423649 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd38806c030 0x7fd388098ea0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.329+0000 7fd390800640 1 --2- 172.21.15.55:0/3311423649 >> v2:172.21.15.106:3300/0 conn(0x7fd38815ca60 0x7fd3880cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.329+0000 7fd390800640 1 -- 172.21.15.55:0/3311423649 >> 172.21.15.55:0/3311423649 conn(0x7fd3880b2150 msgr2=0x7fd3880b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:28.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.329+0000 7fd390800640 1 -- 172.21.15.55:0/3311423649 shutdown_connections 2024-04-02T07:22:28.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.329+0000 7fd390800640 1 -- 172.21.15.55:0/3311423649 wait complete. 2024-04-02T07:22:28.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.329+0000 7fd390800640 1 Processor -- start 2024-04-02T07:22:28.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.329+0000 7fd390800640 1 -- start start 2024-04-02T07:22:28.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd390800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd38806c030 0x7fd388152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:28.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd390800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd388098a10 0x7fd3880c6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:28.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd390800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd38815ca60 0x7fd3880b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:28.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd390800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880b46e0 con 0x7fd38815ca60 2024-04-02T07:22:28.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd390800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880c5ac0 con 0x7fd388098a10 2024-04-02T07:22:28.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd390800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3880c5da0 con 0x7fd38806c030 2024-04-02T07:22:28.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd38e800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd38815ca60 0x7fd3880b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:28.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd38e800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd38815ca60 0x7fd3880b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32772/0 (socket says 172.21.15.55:32772) 2024-04-02T07:22:28.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd38e800640 1 -- 172.21.15.55:0/3539961684 learned_addr learned my addr 172.21.15.55:0/3539961684 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:28.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd38de00640 1 --2- 172.21.15.55:0/3539961684 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd38806c030 0x7fd388152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:28.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd38d400640 1 --2- 172.21.15.55:0/3539961684 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd388098a10 0x7fd3880c6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:28.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd38e800640 1 -- 172.21.15.55:0/3539961684 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd38806c030 msgr2=0x7fd388152970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:28.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd38e800640 1 --2- 172.21.15.55:0/3539961684 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd38806c030 0x7fd388152970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd38e800640 1 -- 172.21.15.55:0/3539961684 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd388098a10 msgr2=0x7fd3880c6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:28.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd38e800640 1 --2- 172.21.15.55:0/3539961684 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd388098a10 0x7fd3880c6880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd38e800640 1 -- 172.21.15.55:0/3539961684 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c0094d0 con 0x7fd38815ca60 2024-04-02T07:22:28.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd38e800640 1 --2- 172.21.15.55:0/3539961684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd38815ca60 0x7fd3880b3c90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd38401a4e0 tx=0x7fd384019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:28.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd382000640 1 -- 172.21.15.55:0/3539961684 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3840aece0 con 0x7fd38815ca60 2024-04-02T07:22:28.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd382000640 1 -- 172.21.15.55:0/3539961684 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3840aee40 con 0x7fd38815ca60 2024-04-02T07:22:28.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd382000640 1 -- 172.21.15.55:0/3539961684 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3840b7650 con 0x7fd38815ca60 2024-04-02T07:22:28.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd390800640 1 -- 172.21.15.55:0/3539961684 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd384009a70 con 0x7fd38815ca60 2024-04-02T07:22:28.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd390800640 1 -- 172.21.15.55:0/3539961684 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3880c6360 con 0x7fd38815ca60 2024-04-02T07:22:28.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.333+0000 7fd390800640 1 -- 172.21.15.55:0/3539961684 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3880c6550 con 0x7fd38815ca60 2024-04-02T07:22:28.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.337+0000 7fd382000640 1 -- 172.21.15.55:0/3539961684 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd3840b4050 con 0x7fd38815ca60 2024-04-02T07:22:28.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.337+0000 7fd382000640 1 --2- 172.21.15.55:0/3539961684 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd36c0666c0 0x7fd36c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:28.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.337+0000 7fd382000640 1 -- 172.21.15.55:0/3539961684 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd38411f5e0 con 0x7fd38815ca60 2024-04-02T07:22:28.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.337+0000 7fd38de00640 1 --2- 172.21.15.55:0/3539961684 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd36c0666c0 0x7fd36c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:28.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.337+0000 7fd38de00640 1 --2- 172.21.15.55:0/3539961684 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd36c0666c0 0x7fd36c068b80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009bd0 tx=0x7fd37c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.341+0000 7fd382000640 1 -- 172.21.15.55:0/3539961684 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd3840ec950 con 0x7fd38815ca60 2024-04-02T07:22:28.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.501+0000 7fd390800640 1 -- 172.21.15.55:0/3539961684 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd388066c90 con 0x7fd38815ca60 2024-04-02T07:22:28.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.501+0000 7fd382000640 1 -- 172.21.15.55:0/3539961684 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3840eff70 con 0x7fd38815ca60 2024-04-02T07:22:28.504 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:22:28.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.501+0000 7fd390800640 1 -- 172.21.15.55:0/3539961684 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd36c0666c0 msgr2=0x7fd36c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:28.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.501+0000 7fd390800640 1 --2- 172.21.15.55:0/3539961684 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd36c0666c0 0x7fd36c068b80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd37c009bd0 tx=0x7fd37c008040 comp rx=0 tx=0).stop 2024-04-02T07:22:28.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.501+0000 7fd390800640 1 -- 172.21.15.55:0/3539961684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd38815ca60 msgr2=0x7fd3880b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:28.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.501+0000 7fd390800640 1 --2- 172.21.15.55:0/3539961684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd38815ca60 0x7fd3880b3c90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd38401a4e0 tx=0x7fd384019650 comp rx=0 tx=0).stop 2024-04-02T07:22:28.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.501+0000 7fd390800640 1 -- 172.21.15.55:0/3539961684 shutdown_connections 2024-04-02T07:22:28.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.501+0000 7fd390800640 1 --2- 172.21.15.55:0/3539961684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd38815ca60 0x7fd3880b3c90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.501+0000 7fd390800640 1 --2- 172.21.15.55:0/3539961684 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd36c0666c0 0x7fd36c068b80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.501+0000 7fd390800640 1 --2- 172.21.15.55:0/3539961684 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd388098a10 0x7fd3880c6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.501+0000 7fd390800640 1 --2- 172.21.15.55:0/3539961684 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd38806c030 0x7fd388152970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.501+0000 7fd390800640 1 -- 172.21.15.55:0/3539961684 >> 172.21.15.55:0/3539961684 conn(0x7fd3880b2150 msgr2=0x7fd388155590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:28.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.501+0000 7fd390800640 1 -- 172.21.15.55:0/3539961684 shutdown_connections 2024-04-02T07:22:28.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.501+0000 7fd390800640 1 -- 172.21.15.55:0/3539961684 wait complete. 2024-04-02T07:22:28.525 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:22:28.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.665+0000 7f7a40a00640 1 Processor -- start 2024-04-02T07:22:28.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.665+0000 7f7a40a00640 1 -- start start 2024-04-02T07:22:28.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.665+0000 7f7a40a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a3c15e230 0x7f7a3c098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:28.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.665+0000 7f7a40a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7a3c098f50 0x7f7a3c0b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:28.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.665+0000 7f7a40a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a3c0afbc0 con 0x7f7a3c15de50 2024-04-02T07:22:28.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.665+0000 7f7a40a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3c099390 con 0x7f7a3c098f50 2024-04-02T07:22:28.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.665+0000 7f7a40a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c099be0 con 0x7f7a3c15e230 2024-04-02T07:22:28.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.665+0000 7f7a3a800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7a3c098f50 0x7f7a3c0b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:28.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.665+0000 7f7a39e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7a3c15de50 0x7f7a3c0cebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:38272/0 (socket says 172.21.15.55:38272) 2024-04-02T07:22:28.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.665+0000 7f7a31400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a3c15e230 0x7f7a3c098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:28.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.665+0000 7f7a39e00640 1 -- 172.21.15.55:0/456916948 learned_addr learned my addr 172.21.15.55:0/456916948 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:28.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.665+0000 7f7a31400640 1 -- 172.21.15.55:0/456916948 >> v2:172.21.15.106:3300/0 conn(0x7f7a3c098f50 msgr2=0x7f7a3c0b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:28.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.665+0000 7f7a31400640 1 --2- 172.21.15.55:0/456916948 >> v2:172.21.15.106:3300/0 conn(0x7f7a3c098f50 0x7f7a3c0b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.665+0000 7f7a31400640 1 -- 172.21.15.55:0/456916948 >> v1:172.21.15.106:6789/0 conn(0x7f7a3c15de50 legacy=0x7f7a3c0cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:28.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.665+0000 7f7a31400640 1 -- 172.21.15.55:0/456916948 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a3c0cf740 con 0x7f7a3c15e230 2024-04-02T07:22:28.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.665+0000 7f7a3a800640 1 --2- 172.21.15.55:0/456916948 >> v2:172.21.15.106:3300/0 conn(0x7f7a3c098f50 0x7f7a3c0b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:28.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.665+0000 7f7a39400640 1 -- 172.21.15.55:0/456916948 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3095581729 0 0) 0x7f7a3c0afbc0 con 0x7f7a3c15de50 2024-04-02T07:22:28.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.669+0000 7f7a31400640 1 --2- 172.21.15.55:0/456916948 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a3c15e230 0x7f7a3c098a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7a240097c0 tx=0x7f7a2401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c072461b1aeb6ab2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:28.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.669+0000 7f7a39400640 1 -- 172.21.15.55:0/456916948 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a240ab600 con 0x7f7a3c15e230 2024-04-02T07:22:28.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.669+0000 7f7a39400640 1 -- 172.21.15.55:0/456916948 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a240a7050 con 0x7f7a3c15e230 2024-04-02T07:22:28.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.669+0000 7f7a39400640 1 -- 172.21.15.55:0/456916948 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a240ab980 con 0x7f7a3c15e230 2024-04-02T07:22:28.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.669+0000 7f7a40a00640 1 -- 172.21.15.55:0/456916948 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a3c15e230 msgr2=0x7f7a3c098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:28.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.669+0000 7f7a40a00640 1 --2- 172.21.15.55:0/456916948 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a3c15e230 0x7f7a3c098a10 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7a240097c0 tx=0x7f7a2401c4a0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.669+0000 7f7a40a00640 1 -- 172.21.15.55:0/456916948 shutdown_connections 2024-04-02T07:22:28.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.669+0000 7f7a40a00640 1 --2- 172.21.15.55:0/456916948 >> v2:172.21.15.106:3300/0 conn(0x7f7a3c098f50 0x7f7a3c0b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.669+0000 7f7a40a00640 1 --2- 172.21.15.55:0/456916948 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a3c15e230 0x7f7a3c098a10 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.669+0000 7f7a40a00640 1 -- 172.21.15.55:0/456916948 >> 172.21.15.55:0/456916948 conn(0x7f7a3c0b2150 msgr2=0x7f7a3c0b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:28.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.669+0000 7f7a40a00640 1 -- 172.21.15.55:0/456916948 shutdown_connections 2024-04-02T07:22:28.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.669+0000 7f7a40a00640 1 -- 172.21.15.55:0/456916948 wait complete. 2024-04-02T07:22:28.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a40a00640 1 Processor -- start 2024-04-02T07:22:28.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a40a00640 1 -- start start 2024-04-02T07:22:28.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a40a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a3c098f50 0x7f7a3c157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:28.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a40a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a3c15de50 0x7f7a3c1585a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:28.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a40a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a3c155a10 0x7f7a3c0b4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:28.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a40a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c158ae0 con 0x7f7a3c098f50 2024-04-02T07:22:28.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a40a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c1592d0 con 0x7f7a3c15de50 2024-04-02T07:22:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a40a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3c158d10 con 0x7f7a3c155a10 2024-04-02T07:22:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a39e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a3c098f50 0x7f7a3c157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a39e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a3c098f50 0x7f7a3c157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32788/0 (socket says 172.21.15.55:32788) 2024-04-02T07:22:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a39e00640 1 -- 172.21.15.55:0/4100541311 learned_addr learned my addr 172.21.15.55:0/4100541311 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a31400640 1 --2- 172.21.15.55:0/4100541311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a3c15de50 0x7f7a3c1585a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a3a800640 1 --2- 172.21.15.55:0/4100541311 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a3c155a10 0x7f7a3c0b4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a39e00640 1 -- 172.21.15.55:0/4100541311 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a3c155a10 msgr2=0x7f7a3c0b4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a39e00640 1 --2- 172.21.15.55:0/4100541311 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a3c155a10 0x7f7a3c0b4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a39e00640 1 -- 172.21.15.55:0/4100541311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a3c15de50 msgr2=0x7f7a3c1585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a39e00640 1 --2- 172.21.15.55:0/4100541311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a3c15de50 0x7f7a3c1585a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a39e00640 1 -- 172.21.15.55:0/4100541311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a34009a70 con 0x7f7a3c098f50 2024-04-02T07:22:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a39e00640 1 --2- 172.21.15.55:0/4100541311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a3c098f50 0x7f7a3c157960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0011f0 tx=0x7f7a2c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a32a00640 1 -- 172.21.15.55:0/4100541311 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c0074e0 con 0x7f7a3c098f50 2024-04-02T07:22:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a32a00640 1 -- 172.21.15.55:0/4100541311 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2c007640 con 0x7f7a3c098f50 2024-04-02T07:22:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a32a00640 1 -- 172.21.15.55:0/4100541311 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c0049f0 con 0x7f7a3c098f50 2024-04-02T07:22:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a40a00640 1 -- 172.21.15.55:0/4100541311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a24009420 con 0x7f7a3c098f50 2024-04-02T07:22:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.673+0000 7f7a40a00640 1 -- 172.21.15.55:0/4100541311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a3c0b4430 con 0x7f7a3c098f50 2024-04-02T07:22:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.677+0000 7f7a40a00640 1 -- 172.21.15.55:0/4100541311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a3c0723d0 con 0x7f7a3c098f50 2024-04-02T07:22:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.677+0000 7f7a32a00640 1 -- 172.21.15.55:0/4100541311 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7a2c004b50 con 0x7f7a3c098f50 2024-04-02T07:22:28.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.677+0000 7f7a32a00640 1 --2- 172.21.15.55:0/4100541311 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7a18066690 0x7f7a18068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:28.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.677+0000 7f7a32a00640 1 -- 172.21.15.55:0/4100541311 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a2c083f00 con 0x7f7a3c098f50 2024-04-02T07:22:28.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.677+0000 7f7a31400640 1 --2- 172.21.15.55:0/4100541311 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7a18066690 0x7f7a18068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:28.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.677+0000 7f7a31400640 1 --2- 172.21.15.55:0/4100541311 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7a18066690 0x7f7a18068b50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7a240ad000 tx=0x7f7a24008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:28.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.681+0000 7f7a32a00640 1 -- 172.21.15.55:0/4100541311 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7a2c051260 con 0x7f7a3c098f50 2024-04-02T07:22:28.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.841+0000 7f7a40a00640 1 -- 172.21.15.55:0/4100541311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7a3c066c90 con 0x7f7a3c098f50 2024-04-02T07:22:28.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.841+0000 7f7a32a00640 1 -- 172.21.15.55:0/4100541311 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7a2c054880 con 0x7f7a3c098f50 2024-04-02T07:22:28.846 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:22:28.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.845+0000 7f7a40a00640 1 -- 172.21.15.55:0/4100541311 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7a18066690 msgr2=0x7f7a18068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:28.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.845+0000 7f7a40a00640 1 --2- 172.21.15.55:0/4100541311 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7a18066690 0x7f7a18068b50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7a240ad000 tx=0x7f7a24008040 comp rx=0 tx=0).stop 2024-04-02T07:22:28.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.845+0000 7f7a40a00640 1 -- 172.21.15.55:0/4100541311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a3c098f50 msgr2=0x7f7a3c157960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:28.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.845+0000 7f7a40a00640 1 --2- 172.21.15.55:0/4100541311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a3c098f50 0x7f7a3c157960 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c0011f0 tx=0x7f7a2c00c8f0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.845+0000 7f7a40a00640 1 -- 172.21.15.55:0/4100541311 shutdown_connections 2024-04-02T07:22:28.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.845+0000 7f7a40a00640 1 --2- 172.21.15.55:0/4100541311 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a3c155a10 0x7f7a3c0b4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.845+0000 7f7a40a00640 1 --2- 172.21.15.55:0/4100541311 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7a18066690 0x7f7a18068b50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.845+0000 7f7a40a00640 1 --2- 172.21.15.55:0/4100541311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a3c15de50 0x7f7a3c1585a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.845+0000 7f7a40a00640 1 --2- 172.21.15.55:0/4100541311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a3c098f50 0x7f7a3c157960 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:28.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.845+0000 7f7a40a00640 1 -- 172.21.15.55:0/4100541311 >> 172.21.15.55:0/4100541311 conn(0x7f7a3c0b2150 msgr2=0x7f7a3c15cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:28.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.845+0000 7f7a40a00640 1 -- 172.21.15.55:0/4100541311 shutdown_connections 2024-04-02T07:22:28.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:28.845+0000 7f7a40a00640 1 -- 172.21.15.55:0/4100541311 wait complete. 2024-04-02T07:22:28.867 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:22:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.005+0000 7f6806a00640 1 Processor -- start 2024-04-02T07:22:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.005+0000 7f6806a00640 1 -- start start 2024-04-02T07:22:29.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.005+0000 7f6806a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f680015ded0 0x7f68000b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:29.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.005+0000 7f6806a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6800099120 0x7f68000b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:29.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.005+0000 7f6806a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68000b1ae0 con 0x7f6800099750 2024-04-02T07:22:29.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.005+0000 7f6806a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68000ce240 con 0x7f680015ded0 2024-04-02T07:22:29.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.005+0000 7f6806a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f680015e2b0 con 0x7f6800099120 2024-04-02T07:22:29.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.005+0000 7f67ffe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f680015ded0 0x7f68000b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:29.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.005+0000 7f6804a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6800099120 0x7f68000b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:29.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.005+0000 7f67f7400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6800099750 0x7f6800098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:38276/0 (socket says 172.21.15.55:38276) 2024-04-02T07:22:29.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.005+0000 7f67ffe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f680015ded0 0x7f68000b1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:49488/0 (socket says 172.21.15.55:49488) 2024-04-02T07:22:29.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.005+0000 7f67f7400640 1 -- 172.21.15.55:0/3954615466 learned_addr learned my addr 172.21.15.55:0/3954615466 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:29.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.005+0000 7f67ffe00640 1 -- 172.21.15.55:0/3954615466 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6800099120 msgr2=0x7f68000b34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:29.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.005+0000 7f67ffe00640 1 --2- 172.21.15.55:0/3954615466 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6800099120 0x7f68000b34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.005+0000 7f67ffe00640 1 -- 172.21.15.55:0/3954615466 >> v1:172.21.15.106:6789/0 conn(0x7f6800099750 legacy=0x7f6800098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:29.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.005+0000 7f67ffe00640 1 -- 172.21.15.55:0/3954615466 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68000cbf30 con 0x7f680015ded0 2024-04-02T07:22:29.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.005+0000 7f67ff400640 1 -- 172.21.15.55:0/3954615466 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 565334446 0 0) 0x7f68000b1ae0 con 0x7f6800099750 2024-04-02T07:22:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.009+0000 7f67ffe00640 1 --2- 172.21.15.55:0/3954615466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f680015ded0 0x7f68000b1320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009d90 tx=0x7f67f001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e33094c8883156a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.009+0000 7f67ff400640 1 -- 172.21.15.55:0/3954615466 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f00a5830 con 0x7f680015ded0 2024-04-02T07:22:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.009+0000 7f67ff400640 1 -- 172.21.15.55:0/3954615466 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f00a5990 con 0x7f680015ded0 2024-04-02T07:22:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.009+0000 7f67ff400640 1 -- 172.21.15.55:0/3954615466 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f00a5d20 con 0x7f680015ded0 2024-04-02T07:22:29.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.009+0000 7f6806a00640 1 -- 172.21.15.55:0/3954615466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f680015ded0 msgr2=0x7f68000b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:29.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.009+0000 7f6806a00640 1 --2- 172.21.15.55:0/3954615466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f680015ded0 0x7f68000b1320 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009d90 tx=0x7f67f001c970 comp rx=0 tx=0).stop 2024-04-02T07:22:29.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.009+0000 7f6806a00640 1 -- 172.21.15.55:0/3954615466 shutdown_connections 2024-04-02T07:22:29.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.009+0000 7f6806a00640 1 --2- 172.21.15.55:0/3954615466 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6800099120 0x7f68000b34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.009+0000 7f6806a00640 1 --2- 172.21.15.55:0/3954615466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f680015ded0 0x7f68000b1320 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.009+0000 7f6806a00640 1 -- 172.21.15.55:0/3954615466 >> 172.21.15.55:0/3954615466 conn(0x7f68000b2160 msgr2=0x7f68000b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:29.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.009+0000 7f6806a00640 1 -- 172.21.15.55:0/3954615466 shutdown_connections 2024-04-02T07:22:29.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.009+0000 7f6806a00640 1 -- 172.21.15.55:0/3954615466 wait complete. 2024-04-02T07:22:29.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f6806a00640 1 Processor -- start 2024-04-02T07:22:29.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f6806a00640 1 -- start start 2024-04-02T07:22:29.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f6806a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6800099120 0x7f680009de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:29.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f6806a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6800099750 0x7f68001402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:29.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f6806a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f680015ded0 0x7f68000b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:29.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f6806a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68000c77d0 con 0x7f680015ded0 2024-04-02T07:22:29.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f6806a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f680009e3b0 con 0x7f6800099750 2024-04-02T07:22:29.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f6806a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6800140cf0 con 0x7f6800099120 2024-04-02T07:22:29.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f6804a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f680015ded0 0x7f68000b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:29.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f6804a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f680015ded0 0x7f68000b4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32790/0 (socket says 172.21.15.55:32790) 2024-04-02T07:22:29.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f6804a00640 1 -- 172.21.15.55:0/546977650 learned_addr learned my addr 172.21.15.55:0/546977650 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:29.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f67ffe00640 1 --2- 172.21.15.55:0/546977650 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6800099120 0x7f680009de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:29.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f67f7400640 1 --2- 172.21.15.55:0/546977650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6800099750 0x7f68001402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:29.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f6804a00640 1 -- 172.21.15.55:0/546977650 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6800099120 msgr2=0x7f680009de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:29.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f6804a00640 1 --2- 172.21.15.55:0/546977650 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6800099120 0x7f680009de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f6804a00640 1 -- 172.21.15.55:0/546977650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6800099750 msgr2=0x7f68001402c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f6804a00640 1 --2- 172.21.15.55:0/546977650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6800099750 0x7f68001402c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f6804a00640 1 -- 172.21.15.55:0/546977650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67f0009a70 con 0x7f680015ded0 2024-04-02T07:22:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f67f7400640 1 --2- 172.21.15.55:0/546977650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6800099750 0x7f68001402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f6804a00640 1 --2- 172.21.15.55:0/546977650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f680015ded0 0x7f68000b4360 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f67f800e7c0 tx=0x7f67f800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.013+0000 7f67fcc00640 1 -- 172.21.15.55:0/546977650 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f80094d0 con 0x7f680015ded0 2024-04-02T07:22:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.017+0000 7f67fcc00640 1 -- 172.21.15.55:0/546977650 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67f800ee70 con 0x7f680015ded0 2024-04-02T07:22:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.017+0000 7f67fcc00640 1 -- 172.21.15.55:0/546977650 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67f800cb60 con 0x7f680015ded0 2024-04-02T07:22:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.017+0000 7f6806a00640 1 -- 172.21.15.55:0/546977650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6800140fd0 con 0x7f680015ded0 2024-04-02T07:22:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.017+0000 7f6806a00640 1 -- 172.21.15.55:0/546977650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6800141590 con 0x7f680015ded0 2024-04-02T07:22:29.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.017+0000 7f6806a00640 1 -- 172.21.15.55:0/546977650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68000b65c0 con 0x7f680015ded0 2024-04-02T07:22:29.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.017+0000 7f67fcc00640 1 -- 172.21.15.55:0/546977650 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f67f800ccc0 con 0x7f680015ded0 2024-04-02T07:22:29.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.017+0000 7f67fcc00640 1 --2- 172.21.15.55:0/546977650 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f67dc0666c0 0x7f67dc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:29.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.017+0000 7f67fcc00640 1 -- 172.21.15.55:0/546977650 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67f80840d0 con 0x7f680015ded0 2024-04-02T07:22:29.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.017+0000 7f67ffe00640 1 --2- 172.21.15.55:0/546977650 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f67dc0666c0 0x7f67dc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:29.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.017+0000 7f67ffe00640 1 --2- 172.21.15.55:0/546977650 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f67dc0666c0 0x7f67dc068b80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f67f00af000 tx=0x7f67f00a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:29.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.021+0000 7f67fcc00640 1 -- 172.21.15.55:0/546977650 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f67f80514f0 con 0x7f680015ded0 2024-04-02T07:22:29.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.181+0000 7f6806a00640 1 -- 172.21.15.55:0/546977650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f68000c7980 con 0x7f680015ded0 2024-04-02T07:22:29.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.181+0000 7f67fcc00640 1 -- 172.21.15.55:0/546977650 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f68000c7980 con 0x7f680015ded0 2024-04-02T07:22:29.186 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:22:29.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.185+0000 7f6806a00640 1 -- 172.21.15.55:0/546977650 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f67dc0666c0 msgr2=0x7f67dc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:29.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.185+0000 7f6806a00640 1 --2- 172.21.15.55:0/546977650 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f67dc0666c0 0x7f67dc068b80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f67f00af000 tx=0x7f67f00a7070 comp rx=0 tx=0).stop 2024-04-02T07:22:29.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.185+0000 7f6806a00640 1 -- 172.21.15.55:0/546977650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f680015ded0 msgr2=0x7f68000b4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:29.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.185+0000 7f6806a00640 1 --2- 172.21.15.55:0/546977650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f680015ded0 0x7f68000b4360 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f67f800e7c0 tx=0x7f67f800ec80 comp rx=0 tx=0).stop 2024-04-02T07:22:29.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.185+0000 7f6806a00640 1 -- 172.21.15.55:0/546977650 shutdown_connections 2024-04-02T07:22:29.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.185+0000 7f6806a00640 1 --2- 172.21.15.55:0/546977650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f680015ded0 0x7f68000b4360 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.185+0000 7f6806a00640 1 --2- 172.21.15.55:0/546977650 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f67dc0666c0 0x7f67dc068b80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.185+0000 7f6806a00640 1 --2- 172.21.15.55:0/546977650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6800099750 0x7f68001402c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.185+0000 7f6806a00640 1 --2- 172.21.15.55:0/546977650 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6800099120 0x7f680009de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.185+0000 7f6806a00640 1 -- 172.21.15.55:0/546977650 >> 172.21.15.55:0/546977650 conn(0x7f68000b2160 msgr2=0x7f6800098a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:29.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.185+0000 7f6806a00640 1 -- 172.21.15.55:0/546977650 shutdown_connections 2024-04-02T07:22:29.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.185+0000 7f6806a00640 1 -- 172.21.15.55:0/546977650 wait complete. 2024-04-02T07:22:29.207 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:22:29.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.345+0000 7f1f92600640 1 Processor -- start 2024-04-02T07:22:29.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.345+0000 7f1f92600640 1 -- start start 2024-04-02T07:22:29.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.345+0000 7f1f92600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f8c15ca70 0x7f1f8c0b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:29.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.345+0000 7f1f92600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1f8c098a10 0x7f1f8c098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:29.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.345+0000 7f1f92600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1f8c06aff0 0x7f1f8c06b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:29.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.345+0000 7f1f92600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8c0993b0 con 0x7f1f8c06aff0 2024-04-02T07:22:29.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.345+0000 7f1f92600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f8c15ce50 con 0x7f1f8c098a10 2024-04-02T07:22:29.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.345+0000 7f1f92600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0cef60 con 0x7f1f8c15ca70 2024-04-02T07:22:29.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.345+0000 7f1f8be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1f8c06aff0 0x7f1f8c06b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:29.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.345+0000 7f1f8be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1f8c06aff0 0x7f1f8c06b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32804/0 (socket says 172.21.15.55:32804) 2024-04-02T07:22:29.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.345+0000 7f1f8be00640 1 -- 172.21.15.55:0/126884646 learned_addr learned my addr 172.21.15.55:0/126884646 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:29.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.345+0000 7f1f8aa00640 1 --2- 172.21.15.55:0/126884646 >> v2:172.21.15.106:3300/0 conn(0x7f1f8c098a10 0x7f1f8c098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:29.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.345+0000 7f1f8be00640 1 -- 172.21.15.55:0/126884646 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f8c15ca70 msgr2=0x7f1f8c0b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:29.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.345+0000 7f1f8be00640 1 --2- 172.21.15.55:0/126884646 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f8c15ca70 0x7f1f8c0b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.345+0000 7f1f8be00640 1 -- 172.21.15.55:0/126884646 >> v2:172.21.15.106:3300/0 conn(0x7f1f8c098a10 msgr2=0x7f1f8c098e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:29.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.345+0000 7f1f8be00640 1 --2- 172.21.15.55:0/126884646 >> v2:172.21.15.106:3300/0 conn(0x7f1f8c098a10 0x7f1f8c098e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.345+0000 7f1f8be00640 1 -- 172.21.15.55:0/126884646 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c06bd60 con 0x7f1f8c06aff0 2024-04-02T07:22:29.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.345+0000 7f1f8aa00640 1 --2- 172.21.15.55:0/126884646 >> v2:172.21.15.106:3300/0 conn(0x7f1f8c098a10 0x7f1f8c098e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:29.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.349+0000 7f1f8be00640 1 --2- 172.21.15.55:0/126884646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f8c06aff0 0x7f1f8c06b480 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c073bd0 tx=0x7f1f8401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704f289978aa0451 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:29.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.349+0000 7f1f8a000640 1 -- 172.21.15.55:0/126884646 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f840a5840 con 0x7f1f8c06aff0 2024-04-02T07:22:29.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.349+0000 7f1f8a000640 1 -- 172.21.15.55:0/126884646 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f840a59a0 con 0x7f1f8c06aff0 2024-04-02T07:22:29.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.349+0000 7f1f8a000640 1 -- 172.21.15.55:0/126884646 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f840a5d30 con 0x7f1f8c06aff0 2024-04-02T07:22:29.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.349+0000 7f1f92600640 1 -- 172.21.15.55:0/126884646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f8c06aff0 msgr2=0x7f1f8c06b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:29.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.349+0000 7f1f92600640 1 --2- 172.21.15.55:0/126884646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f8c06aff0 0x7f1f8c06b480 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c073bd0 tx=0x7f1f8401c9c0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.349+0000 7f1f92600640 1 -- 172.21.15.55:0/126884646 shutdown_connections 2024-04-02T07:22:29.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.349+0000 7f1f92600640 1 --2- 172.21.15.55:0/126884646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f8c06aff0 0x7f1f8c06b480 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.349+0000 7f1f92600640 1 --2- 172.21.15.55:0/126884646 >> v2:172.21.15.106:3300/0 conn(0x7f1f8c098a10 0x7f1f8c098e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.349+0000 7f1f92600640 1 --2- 172.21.15.55:0/126884646 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f8c15ca70 0x7f1f8c0b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.349+0000 7f1f92600640 1 -- 172.21.15.55:0/126884646 >> 172.21.15.55:0/126884646 conn(0x7f1f8c0b21d0 msgr2=0x7f1f8c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:29.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.349+0000 7f1f92600640 1 -- 172.21.15.55:0/126884646 shutdown_connections 2024-04-02T07:22:29.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.349+0000 7f1f92600640 1 -- 172.21.15.55:0/126884646 wait complete. 2024-04-02T07:22:29.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.349+0000 7f1f92600640 1 Processor -- start 2024-04-02T07:22:29.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.349+0000 7f1f92600640 1 -- start start 2024-04-02T07:22:29.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f92600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f8c06aff0 0x7f1f8c15dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:29.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f92600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c098a10 0x7f1f8c0c6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:29.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f92600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f8c15ca70 0x7f1f8c0b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:29.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f92600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0b3d10 con 0x7f1f8c06aff0 2024-04-02T07:22:29.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f92600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c15e2a0 con 0x7f1f8c098a10 2024-04-02T07:22:29.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f92600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8c0c6c70 con 0x7f1f8c15ca70 2024-04-02T07:22:29.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f8b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f8c06aff0 0x7f1f8c15dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:29.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f8b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f8c06aff0 0x7f1f8c15dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32814/0 (socket says 172.21.15.55:32814) 2024-04-02T07:22:29.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f8b400640 1 -- 172.21.15.55:0/523896301 learned_addr learned my addr 172.21.15.55:0/523896301 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:29.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f8b400640 1 -- 172.21.15.55:0/523896301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f8c15ca70 msgr2=0x7f1f8c0b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:29.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f8b400640 1 --2- 172.21.15.55:0/523896301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f8c15ca70 0x7f1f8c0b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f8aa00640 1 --2- 172.21.15.55:0/523896301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c098a10 0x7f1f8c0c6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:29.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f8b400640 1 -- 172.21.15.55:0/523896301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c098a10 msgr2=0x7f1f8c0c6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:29.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f8b400640 1 --2- 172.21.15.55:0/523896301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c098a10 0x7f1f8c0c6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f8b400640 1 -- 172.21.15.55:0/523896301 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f84009b30 con 0x7f1f8c06aff0 2024-04-02T07:22:29.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f8aa00640 1 --2- 172.21.15.55:0/523896301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c098a10 0x7f1f8c0c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:29.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f8b400640 1 --2- 172.21.15.55:0/523896301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f8c06aff0 0x7f1f8c15dd60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00b470 tx=0x7f1f7c00b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:29.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f83400640 1 -- 172.21.15.55:0/523896301 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c011890 con 0x7f1f8c06aff0 2024-04-02T07:22:29.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f83400640 1 -- 172.21.15.55:0/523896301 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f7c0119f0 con 0x7f1f8c06aff0 2024-04-02T07:22:29.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f92600640 1 -- 172.21.15.55:0/523896301 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8c0b3370 con 0x7f1f8c06aff0 2024-04-02T07:22:29.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f83400640 1 -- 172.21.15.55:0/523896301 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c011da0 con 0x7f1f8c06aff0 2024-04-02T07:22:29.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f92600640 1 -- 172.21.15.55:0/523896301 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8c0b3930 con 0x7f1f8c06aff0 2024-04-02T07:22:29.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f92600640 1 -- 172.21.15.55:0/523896301 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f8c066c90 con 0x7f1f8c06aff0 2024-04-02T07:22:29.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.353+0000 7f1f83400640 1 -- 172.21.15.55:0/523896301 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1f7c01a400 con 0x7f1f8c06aff0 2024-04-02T07:22:29.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.357+0000 7f1f83400640 1 --2- 172.21.15.55:0/523896301 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1f6c066690 0x7f1f6c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:29.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.357+0000 7f1f83400640 1 -- 172.21.15.55:0/523896301 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1f7c084450 con 0x7f1f8c06aff0 2024-04-02T07:22:29.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.357+0000 7f1f8aa00640 1 --2- 172.21.15.55:0/523896301 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1f6c066690 0x7f1f6c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:29.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.357+0000 7f1f8aa00640 1 --2- 172.21.15.55:0/523896301 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1f6c066690 0x7f1f6c068b50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c0b07a0 tx=0x7f1f78008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:29.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.361+0000 7f1f83400640 1 -- 172.21.15.55:0/523896301 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f1f7c0517c0 con 0x7f1f8c06aff0 2024-04-02T07:22:29.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.557+0000 7f1f92600640 1 -- 172.21.15.55:0/523896301 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1f8c0b6660 con 0x7f1f8c06aff0 2024-04-02T07:22:29.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.557+0000 7f1f83400640 1 -- 172.21.15.55:0/523896301 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4725 (secure 0 0 0) 0x7f1f7c054de0 con 0x7f1f8c06aff0 2024-04-02T07:22:29.562 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:29.562 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1468533802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1468533802},{"type":"v1","addr":"172.21.15.106:6837","nonce":1468533802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/342047131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":342047131},{"type":"v1","addr":"172.21.15.55:6833","nonce":342047131}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/50847499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":50847499},{"type":"v1","addr":"172.21.15.55:6835","nonce":50847499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:22:18.201059+0000","modified":"2024-04-02T07:22:21.225641+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6836/3829467285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3829467285},{"type":"v1","addr":"172.21.15.106:6836","nonce":3829467285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-02T07:22:29.562 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2024-04-02T07:22:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.561+0000 7f1f92600640 1 -- 172.21.15.55:0/523896301 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1f6c066690 msgr2=0x7f1f6c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.561+0000 7f1f92600640 1 --2- 172.21.15.55:0/523896301 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1f6c066690 0x7f1f6c068b50 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c0b07a0 tx=0x7f1f78008040 comp rx=0 tx=0).stop 2024-04-02T07:22:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.561+0000 7f1f92600640 1 -- 172.21.15.55:0/523896301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f8c06aff0 msgr2=0x7f1f8c15dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.561+0000 7f1f92600640 1 --2- 172.21.15.55:0/523896301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f8c06aff0 0x7f1f8c15dd60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c00b470 tx=0x7f1f7c00b930 comp rx=0 tx=0).stop 2024-04-02T07:22:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.561+0000 7f1f92600640 1 -- 172.21.15.55:0/523896301 shutdown_connections 2024-04-02T07:22:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.561+0000 7f1f92600640 1 --2- 172.21.15.55:0/523896301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1f8c15ca70 0x7f1f8c0b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.561+0000 7f1f92600640 1 --2- 172.21.15.55:0/523896301 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1f6c066690 0x7f1f6c068b50 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.561+0000 7f1f92600640 1 --2- 172.21.15.55:0/523896301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1f8c098a10 0x7f1f8c0c6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.561+0000 7f1f92600640 1 --2- 172.21.15.55:0/523896301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f8c06aff0 0x7f1f8c15dd60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.561+0000 7f1f92600640 1 -- 172.21.15.55:0/523896301 >> 172.21.15.55:0/523896301 conn(0x7f1f8c0b21d0 msgr2=0x7f1f8c0b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:29.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.561+0000 7f1f92600640 1 -- 172.21.15.55:0/523896301 shutdown_connections 2024-04-02T07:22:29.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.561+0000 7f1f92600640 1 -- 172.21.15.55:0/523896301 wait complete. 2024-04-02T07:22:29.583 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:29.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.717+0000 7f4363e00640 1 Processor -- start 2024-04-02T07:22:29.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.717+0000 7f4363e00640 1 -- start start 2024-04-02T07:22:29.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.721+0000 7f4363e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f435c06d8e0 0x7f435c0b3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:29.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.721+0000 7f4363e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435c071510 con 0x7f435c15acb0 2024-04-02T07:22:29.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.721+0000 7f4363e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f435c15b140 con 0x7f435c0cbef0 2024-04-02T07:22:29.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.721+0000 7f4363e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c0b1d40 con 0x7f435c06d8e0 2024-04-02T07:22:29.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.721+0000 7f4361e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f435c15acb0 0x7f435c069fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49212/0 (socket says 172.21.15.55:49212) 2024-04-02T07:22:29.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.721+0000 7f4361e00640 1 -- 172.21.15.55:0/4010759086 learned_addr learned my addr 172.21.15.55:0/4010759086 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:29.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.721+0000 7f4361400640 1 --2- 172.21.15.55:0/4010759086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f435c06d8e0 0x7f435c0b3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:29.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.721+0000 7f4361400640 1 -- 172.21.15.55:0/4010759086 >> v1:172.21.15.106:6789/0 conn(0x7f435c0cbef0 legacy=0x7f435c06dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:29.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.721+0000 7f4361400640 1 -- 172.21.15.55:0/4010759086 >> v1:172.21.15.55:6789/0 conn(0x7f435c15acb0 legacy=0x7f435c069fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:29.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.721+0000 7f435be00640 1 -- 172.21.15.55:0/4010759086 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 619022186 0 0) 0x7f435c15b140 con 0x7f435c0cbef0 2024-04-02T07:22:29.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.721+0000 7f4361400640 1 -- 172.21.15.55:0/4010759086 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c070660 con 0x7f435c06d8e0 2024-04-02T07:22:29.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.725+0000 7f4361400640 1 --2- 172.21.15.55:0/4010759086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f435c06d8e0 0x7f435c0b3940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f43500097f0 tx=0x7f435001c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be737c3725f51f17 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:29.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.725+0000 7f435be00640 1 -- 172.21.15.55:0/4010759086 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43500ab600 con 0x7f435c06d8e0 2024-04-02T07:22:29.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.725+0000 7f435be00640 1 -- 172.21.15.55:0/4010759086 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43500a7050 con 0x7f435c06d8e0 2024-04-02T07:22:29.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.725+0000 7f435be00640 1 -- 172.21.15.55:0/4010759086 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43500ab980 con 0x7f435c06d8e0 2024-04-02T07:22:29.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.725+0000 7f4363e00640 1 -- 172.21.15.55:0/4010759086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f435c06d8e0 msgr2=0x7f435c0b3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:29.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.725+0000 7f4363e00640 1 --2- 172.21.15.55:0/4010759086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f435c06d8e0 0x7f435c0b3940 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f43500097f0 tx=0x7f435001c2e0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.725+0000 7f4363e00640 1 -- 172.21.15.55:0/4010759086 shutdown_connections 2024-04-02T07:22:29.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.725+0000 7f4363e00640 1 --2- 172.21.15.55:0/4010759086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f435c06d8e0 0x7f435c0b3940 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.725+0000 7f4363e00640 1 -- 172.21.15.55:0/4010759086 >> 172.21.15.55:0/4010759086 conn(0x7f435c0cb3d0 msgr2=0x7f435c0cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:29.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.725+0000 7f4363e00640 1 -- 172.21.15.55:0/4010759086 shutdown_connections 2024-04-02T07:22:29.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.725+0000 7f4363e00640 1 -- 172.21.15.55:0/4010759086 wait complete. 2024-04-02T07:22:29.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.725+0000 7f4363e00640 1 Processor -- start 2024-04-02T07:22:29.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.725+0000 7f4363e00640 1 -- start start 2024-04-02T07:22:29.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4363e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f435c06d8e0 0x7f435c14e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:29.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4363e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f435c0cbef0 0x7f435c151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:29.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4363e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f435c15acb0 0x7f435c159870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:29.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4363e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c14eb10 con 0x7f435c15acb0 2024-04-02T07:22:29.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4363e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f435c151b10 con 0x7f435c06d8e0 2024-04-02T07:22:29.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4363e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f435c158d90 con 0x7f435c0cbef0 2024-04-02T07:22:29.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4361e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f435c15acb0 0x7f435c159870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:29.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4361e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f435c15acb0 0x7f435c159870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32830/0 (socket says 172.21.15.55:32830) 2024-04-02T07:22:29.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4361e00640 1 -- 172.21.15.55:0/2484361589 learned_addr learned my addr 172.21.15.55:0/2484361589 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:29.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4360a00640 1 --2- 172.21.15.55:0/2484361589 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f435c0cbef0 0x7f435c151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:29.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4361400640 1 --2- 172.21.15.55:0/2484361589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f435c06d8e0 0x7f435c14e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:29.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4361e00640 1 -- 172.21.15.55:0/2484361589 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f435c0cbef0 msgr2=0x7f435c151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:29.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4361e00640 1 --2- 172.21.15.55:0/2484361589 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f435c0cbef0 0x7f435c151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4361e00640 1 -- 172.21.15.55:0/2484361589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f435c06d8e0 msgr2=0x7f435c14e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:29.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4361e00640 1 --2- 172.21.15.55:0/2484361589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f435c06d8e0 0x7f435c14e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4361e00640 1 -- 172.21.15.55:0/2484361589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4350009420 con 0x7f435c15acb0 2024-04-02T07:22:29.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4361e00640 1 --2- 172.21.15.55:0/2484361589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f435c15acb0 0x7f435c159870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f435400e550 tx=0x7f435400ea10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:29.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4359600640 1 -- 172.21.15.55:0/2484361589 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4354012810 con 0x7f435c15acb0 2024-04-02T07:22:29.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4359600640 1 -- 172.21.15.55:0/2484361589 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4354012970 con 0x7f435c15acb0 2024-04-02T07:22:29.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4359600640 1 -- 172.21.15.55:0/2484361589 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4354012d20 con 0x7f435c15acb0 2024-04-02T07:22:29.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4363e00640 1 -- 172.21.15.55:0/2484361589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f435c159070 con 0x7f435c15acb0 2024-04-02T07:22:29.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4363e00640 1 -- 172.21.15.55:0/2484361589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f435c158a40 con 0x7f435c15acb0 2024-04-02T07:22:29.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4363e00640 1 -- 172.21.15.55:0/2484361589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f435c066c90 con 0x7f435c15acb0 2024-04-02T07:22:29.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.729+0000 7f4359600640 1 -- 172.21.15.55:0/2484361589 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f4354009070 con 0x7f435c15acb0 2024-04-02T07:22:29.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.733+0000 7f4359600640 1 --2- 172.21.15.55:0/2484361589 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f433c066690 0x7f433c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:29.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.733+0000 7f4359600640 1 -- 172.21.15.55:0/2484361589 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4354086ea0 con 0x7f435c15acb0 2024-04-02T07:22:29.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.733+0000 7f4361400640 1 --2- 172.21.15.55:0/2484361589 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f433c066690 0x7f433c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:29.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.733+0000 7f4361400640 1 --2- 172.21.15.55:0/2484361589 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f433c066690 0x7f433c068b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43500ad000 tx=0x7f43500a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:29.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.737+0000 7f4359600640 1 -- 172.21.15.55:0/2484361589 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f43540542b0 con 0x7f435c15acb0 2024-04-02T07:22:29.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.897+0000 7f4363e00640 1 -- 172.21.15.55:0/2484361589 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f435c159520 con 0x7f435c15acb0 2024-04-02T07:22:29.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.897+0000 7f4359600640 1 -- 172.21.15.55:0/2484361589 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f4354016090 con 0x7f435c15acb0 2024-04-02T07:22:29.901 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:29.901 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:19.207279+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:29.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.897+0000 7f4363e00640 1 -- 172.21.15.55:0/2484361589 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f433c066690 msgr2=0x7f433c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:29.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.897+0000 7f4363e00640 1 --2- 172.21.15.55:0/2484361589 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f433c066690 0x7f433c068b50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f43500ad000 tx=0x7f43500a6000 comp rx=0 tx=0).stop 2024-04-02T07:22:29.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.897+0000 7f4363e00640 1 -- 172.21.15.55:0/2484361589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f435c15acb0 msgr2=0x7f435c159870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:29.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.897+0000 7f4363e00640 1 --2- 172.21.15.55:0/2484361589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f435c15acb0 0x7f435c159870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f435400e550 tx=0x7f435400ea10 comp rx=0 tx=0).stop 2024-04-02T07:22:29.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.901+0000 7f4363e00640 1 -- 172.21.15.55:0/2484361589 shutdown_connections 2024-04-02T07:22:29.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.901+0000 7f4363e00640 1 --2- 172.21.15.55:0/2484361589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f435c15acb0 0x7f435c159870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.901+0000 7f4363e00640 1 --2- 172.21.15.55:0/2484361589 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f435c0cbef0 0x7f435c151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.901+0000 7f4363e00640 1 --2- 172.21.15.55:0/2484361589 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f433c066690 0x7f433c068b50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.901+0000 7f4363e00640 1 --2- 172.21.15.55:0/2484361589 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f435c06d8e0 0x7f435c14e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:29.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.901+0000 7f4363e00640 1 -- 172.21.15.55:0/2484361589 >> 172.21.15.55:0/2484361589 conn(0x7f435c0cb3d0 msgr2=0x7f435c0cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:29.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.901+0000 7f4363e00640 1 -- 172.21.15.55:0/2484361589 shutdown_connections 2024-04-02T07:22:29.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:29.901+0000 7f4363e00640 1 -- 172.21.15.55:0/2484361589 wait complete. 2024-04-02T07:22:29.923 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:22:16.738297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:22:17.190496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:22:29.923 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:22:30.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.061+0000 7f5d98600640 1 Processor -- start 2024-04-02T07:22:30.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.061+0000 7f5d98600640 1 -- start start 2024-04-02T07:22:30.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.061+0000 7f5d98600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d900b3dc0 0x7f5d900ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:30.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.061+0000 7f5d98600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5d900ade90 0x7f5d9006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:30.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.061+0000 7f5d98600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d9006c630 con 0x7f5d900b41a0 2024-04-02T07:22:30.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.061+0000 7f5d98600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d9006c8f0 con 0x7f5d900ade90 2024-04-02T07:22:30.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.061+0000 7f5d98600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9006cbd0 con 0x7f5d900b3dc0 2024-04-02T07:22:30.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.065+0000 7f5d95200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5d900ade90 0x7f5d9006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:30.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.065+0000 7f5d96600640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5d900b41a0 0x7f5d90142ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:38290/0 (socket says 172.21.15.55:38290) 2024-04-02T07:22:30.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.065+0000 7f5d95c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d900b3dc0 0x7f5d900ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:30.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.065+0000 7f5d96600640 1 -- 172.21.15.55:0/88939483 learned_addr learned my addr 172.21.15.55:0/88939483 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:30.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.065+0000 7f5d95200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5d900ade90 0x7f5d9006d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:49528/0 (socket says 172.21.15.55:49528) 2024-04-02T07:22:30.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.065+0000 7f5d95200640 1 -- 172.21.15.55:0/88939483 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d900b3dc0 msgr2=0x7f5d900ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:30.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.065+0000 7f5d95200640 1 --2- 172.21.15.55:0/88939483 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d900b3dc0 0x7f5d900ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.065+0000 7f5d95200640 1 -- 172.21.15.55:0/88939483 >> v1:172.21.15.106:6789/0 conn(0x7f5d900b41a0 legacy=0x7f5d90142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:30.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.065+0000 7f5d95200640 1 -- 172.21.15.55:0/88939483 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d9006ceb0 con 0x7f5d900ade90 2024-04-02T07:22:30.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.065+0000 7f5d8fe00640 1 -- 172.21.15.55:0/88939483 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 699162418 0 0) 0x7f5d9006c630 con 0x7f5d900b41a0 2024-04-02T07:22:30.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.065+0000 7f5d95200640 1 --2- 172.21.15.55:0/88939483 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d900ade90 0x7f5d9006d6b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c0097c0 tx=0x7f5d7c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb7e3cfacbb4df11 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:30.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d8fe00640 1 -- 172.21.15.55:0/88939483 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c0ab600 con 0x7f5d900ade90 2024-04-02T07:22:30.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d8fe00640 1 -- 172.21.15.55:0/88939483 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d7c0ab760 con 0x7f5d900ade90 2024-04-02T07:22:30.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d8fe00640 1 -- 172.21.15.55:0/88939483 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c0abaf0 con 0x7f5d900ade90 2024-04-02T07:22:30.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d98600640 1 -- 172.21.15.55:0/88939483 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d900ade90 msgr2=0x7f5d9006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:30.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d98600640 1 --2- 172.21.15.55:0/88939483 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d900ade90 0x7f5d9006d6b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5d7c0097c0 tx=0x7f5d7c01c3e0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d98600640 1 -- 172.21.15.55:0/88939483 shutdown_connections 2024-04-02T07:22:30.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d98600640 1 --2- 172.21.15.55:0/88939483 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d900ade90 0x7f5d9006d6b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d98600640 1 --2- 172.21.15.55:0/88939483 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d900b3dc0 0x7f5d900ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d98600640 1 -- 172.21.15.55:0/88939483 >> 172.21.15.55:0/88939483 conn(0x7f5d9006a390 msgr2=0x7f5d900b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:30.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d98600640 1 -- 172.21.15.55:0/88939483 shutdown_connections 2024-04-02T07:22:30.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d98600640 1 -- 172.21.15.55:0/88939483 wait complete. 2024-04-02T07:22:30.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d98600640 1 Processor -- start 2024-04-02T07:22:30.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d98600640 1 -- start start 2024-04-02T07:22:30.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d98600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d900ade90 0x7f5d901389f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:30.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d98600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d900b3dc0 0x7f5d9014f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:30.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d98600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d900b41a0 0x7f5d901f4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:30.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d98600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d901f6170 con 0x7f5d900b41a0 2024-04-02T07:22:30.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d98600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d901f5210 con 0x7f5d900ade90 2024-04-02T07:22:30.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d98600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d901f54f0 con 0x7f5d900b3dc0 2024-04-02T07:22:30.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d96600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d900b41a0 0x7f5d901f4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:30.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d96600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d900b41a0 0x7f5d901f4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32846/0 (socket says 172.21.15.55:32846) 2024-04-02T07:22:30.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d96600640 1 -- 172.21.15.55:0/3412871464 learned_addr learned my addr 172.21.15.55:0/3412871464 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:30.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d95c00640 1 --2- 172.21.15.55:0/3412871464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d900ade90 0x7f5d901389f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:30.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d95200640 1 --2- 172.21.15.55:0/3412871464 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d900b3dc0 0x7f5d9014f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:30.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d96600640 1 -- 172.21.15.55:0/3412871464 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d900b3dc0 msgr2=0x7f5d9014f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:30.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d96600640 1 --2- 172.21.15.55:0/3412871464 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d900b3dc0 0x7f5d9014f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d96600640 1 -- 172.21.15.55:0/3412871464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d900ade90 msgr2=0x7f5d901389f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:30.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.069+0000 7f5d96600640 1 --2- 172.21.15.55:0/3412871464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d900ade90 0x7f5d901389f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.073+0000 7f5d96600640 1 -- 172.21.15.55:0/3412871464 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c009420 con 0x7f5d900b41a0 2024-04-02T07:22:30.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.073+0000 7f5d96600640 1 --2- 172.21.15.55:0/3412871464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d900b41a0 0x7f5d901f4820 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800c700 tx=0x7f5d8800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:30.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.073+0000 7f5d8d600640 1 -- 172.21.15.55:0/3412871464 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8800ce10 con 0x7f5d900b41a0 2024-04-02T07:22:30.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.073+0000 7f5d8d600640 1 -- 172.21.15.55:0/3412871464 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8800a640 con 0x7f5d900b41a0 2024-04-02T07:22:30.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.073+0000 7f5d8d600640 1 -- 172.21.15.55:0/3412871464 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8800aa30 con 0x7f5d900b41a0 2024-04-02T07:22:30.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.073+0000 7f5d98600640 1 -- 172.21.15.55:0/3412871464 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d9006de00 con 0x7f5d900b41a0 2024-04-02T07:22:30.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.073+0000 7f5d98600640 1 -- 172.21.15.55:0/3412871464 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d901f5ab0 con 0x7f5d900b41a0 2024-04-02T07:22:30.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.073+0000 7f5d98600640 1 -- 172.21.15.55:0/3412871464 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d90073530 con 0x7f5d900b41a0 2024-04-02T07:22:30.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.073+0000 7f5d8d600640 1 -- 172.21.15.55:0/3412871464 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5d8800ab90 con 0x7f5d900b41a0 2024-04-02T07:22:30.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.073+0000 7f5d8d600640 1 --2- 172.21.15.55:0/3412871464 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d70066690 0x7f5d70068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:30.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.073+0000 7f5d8d600640 1 -- 172.21.15.55:0/3412871464 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d880835d0 con 0x7f5d900b41a0 2024-04-02T07:22:30.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.073+0000 7f5d95c00640 1 --2- 172.21.15.55:0/3412871464 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d70066690 0x7f5d70068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:30.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.077+0000 7f5d95c00640 1 --2- 172.21.15.55:0/3412871464 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d70066690 0x7f5d70068b50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5d90142540 tx=0x7f5d84009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:30.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.077+0000 7f5d8d600640 1 -- 172.21.15.55:0/3412871464 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5d880509e0 con 0x7f5d900b41a0 2024-04-02T07:22:30.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.241+0000 7f5d98600640 1 -- 172.21.15.55:0/3412871464 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5d901f62b0 con 0x7f5d900b41a0 2024-04-02T07:22:30.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.241+0000 7f5d8d600640 1 -- 172.21.15.55:0/3412871464 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5d901f62b0 con 0x7f5d900b41a0 2024-04-02T07:22:30.244 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:22:30.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.241+0000 7f5d98600640 1 -- 172.21.15.55:0/3412871464 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d70066690 msgr2=0x7f5d70068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:30.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.241+0000 7f5d98600640 1 --2- 172.21.15.55:0/3412871464 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d70066690 0x7f5d70068b50 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5d90142540 tx=0x7f5d84009190 comp rx=0 tx=0).stop 2024-04-02T07:22:30.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.241+0000 7f5d98600640 1 -- 172.21.15.55:0/3412871464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d900b41a0 msgr2=0x7f5d901f4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:30.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.241+0000 7f5d98600640 1 --2- 172.21.15.55:0/3412871464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d900b41a0 0x7f5d901f4820 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5d8800c700 tx=0x7f5d8800cbc0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.241+0000 7f5d98600640 1 -- 172.21.15.55:0/3412871464 shutdown_connections 2024-04-02T07:22:30.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.241+0000 7f5d98600640 1 --2- 172.21.15.55:0/3412871464 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d900b41a0 0x7f5d901f4820 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.241+0000 7f5d98600640 1 --2- 172.21.15.55:0/3412871464 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d900b3dc0 0x7f5d9014f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.241+0000 7f5d98600640 1 --2- 172.21.15.55:0/3412871464 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d70066690 0x7f5d70068b50 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.241+0000 7f5d98600640 1 --2- 172.21.15.55:0/3412871464 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d900ade90 0x7f5d901389f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.241+0000 7f5d98600640 1 -- 172.21.15.55:0/3412871464 >> 172.21.15.55:0/3412871464 conn(0x7f5d9006a390 msgr2=0x7f5d90155180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:30.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.241+0000 7f5d98600640 1 -- 172.21.15.55:0/3412871464 shutdown_connections 2024-04-02T07:22:30.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.241+0000 7f5d98600640 1 -- 172.21.15.55:0/3412871464 wait complete. 2024-04-02T07:22:30.266 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:22:30.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.405+0000 7efc55600640 1 Processor -- start 2024-04-02T07:22:30.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.405+0000 7efc55600640 1 -- start start 2024-04-02T07:22:30.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.409+0000 7efc55600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc5015a850 0x7efc500cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:30.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.409+0000 7efc55600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc500ce090 con 0x7efc50099120 2024-04-02T07:22:30.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.409+0000 7efc55600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc5015ac30 con 0x7efc500cc070 2024-04-02T07:22:30.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.409+0000 7efc55600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc500cc4b0 con 0x7efc5015a850 2024-04-02T07:22:30.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.409+0000 7efc54c00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efc50099120 0x7efc500b3310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49216/0 (socket says 172.21.15.55:49216) 2024-04-02T07:22:30.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.409+0000 7efc54c00640 1 -- 172.21.15.55:0/3612127192 learned_addr learned my addr 172.21.15.55:0/3612127192 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:30.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.409+0000 7efc4fe00640 1 --2- 172.21.15.55:0/3612127192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc5015a850 0x7efc500cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:30.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.409+0000 7efc4f400640 1 -- 172.21.15.55:0/3612127192 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1934569789 0 0) 0x7efc500ce090 con 0x7efc50099120 2024-04-02T07:22:30.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.409+0000 7efc4f400640 1 -- 172.21.15.55:0/3612127192 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc34003530 con 0x7efc50099120 2024-04-02T07:22:30.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.409+0000 7efc4f400640 1 -- 172.21.15.55:0/3612127192 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1180048941 0 0) 0x7efc5015ac30 con 0x7efc500cc070 2024-04-02T07:22:30.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.409+0000 7efc4f400640 1 -- 172.21.15.55:0/3612127192 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc500ce090 con 0x7efc500cc070 2024-04-02T07:22:30.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.409+0000 7efc4fe00640 1 -- 172.21.15.55:0/3612127192 >> v1:172.21.15.106:6789/0 conn(0x7efc500cc070 legacy=0x7efc50098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:30.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.409+0000 7efc4fe00640 1 -- 172.21.15.55:0/3612127192 >> v1:172.21.15.55:6789/0 conn(0x7efc50099120 legacy=0x7efc500b3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:30.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.409+0000 7efc4fe00640 1 -- 172.21.15.55:0/3612127192 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc500ce2e0 con 0x7efc5015a850 2024-04-02T07:22:30.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.413+0000 7efc4fe00640 1 --2- 172.21.15.55:0/3612127192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc5015a850 0x7efc500cbb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efc400097f0 tx=0x7efc4001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ce20bdaa568edff server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:30.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.413+0000 7efc4f400640 1 -- 172.21.15.55:0/3612127192 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc400ab620 con 0x7efc5015a850 2024-04-02T07:22:30.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.413+0000 7efc4f400640 1 -- 172.21.15.55:0/3612127192 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc400ab780 con 0x7efc5015a850 2024-04-02T07:22:30.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.413+0000 7efc4f400640 1 -- 172.21.15.55:0/3612127192 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc400abb10 con 0x7efc5015a850 2024-04-02T07:22:30.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.413+0000 7efc55600640 1 -- 172.21.15.55:0/3612127192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc5015a850 msgr2=0x7efc500cbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:30.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.413+0000 7efc55600640 1 --2- 172.21.15.55:0/3612127192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc5015a850 0x7efc500cbb30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efc400097f0 tx=0x7efc4001c420 comp rx=0 tx=0).stop 2024-04-02T07:22:30.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.413+0000 7efc55600640 1 -- 172.21.15.55:0/3612127192 shutdown_connections 2024-04-02T07:22:30.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.413+0000 7efc55600640 1 --2- 172.21.15.55:0/3612127192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc5015a850 0x7efc500cbb30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.413+0000 7efc55600640 1 -- 172.21.15.55:0/3612127192 >> 172.21.15.55:0/3612127192 conn(0x7efc500b1fb0 msgr2=0x7efc500b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:30.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.413+0000 7efc55600640 1 -- 172.21.15.55:0/3612127192 shutdown_connections 2024-04-02T07:22:30.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.413+0000 7efc55600640 1 -- 172.21.15.55:0/3612127192 wait complete. 2024-04-02T07:22:30.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.413+0000 7efc55600640 1 Processor -- start 2024-04-02T07:22:30.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.413+0000 7efc55600640 1 -- start start 2024-04-02T07:22:30.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.413+0000 7efc55600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc50099120 0x7efc501508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:30.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.413+0000 7efc55600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc500cc070 0x7efc501526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:30.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.413+0000 7efc55600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc5015a850 0x7efc5014c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:30.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.413+0000 7efc55600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc50152bf0 con 0x7efc50099120 2024-04-02T07:22:30.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.413+0000 7efc55600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc50151880 con 0x7efc5015a850 2024-04-02T07:22:30.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.413+0000 7efc55600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc50150fe0 con 0x7efc500cc070 2024-04-02T07:22:30.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.413+0000 7efc4fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc50099120 0x7efc501508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:30.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.417+0000 7efc4fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc50099120 0x7efc501508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32848/0 (socket says 172.21.15.55:32848) 2024-04-02T07:22:30.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.417+0000 7efc4fe00640 1 -- 172.21.15.55:0/2730971273 learned_addr learned my addr 172.21.15.55:0/2730971273 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:30.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.417+0000 7efc54c00640 1 --2- 172.21.15.55:0/2730971273 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc5015a850 0x7efc5014c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:30.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.417+0000 7efc47e00640 1 --2- 172.21.15.55:0/2730971273 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc500cc070 0x7efc501526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:30.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.417+0000 7efc4fe00640 1 -- 172.21.15.55:0/2730971273 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc500cc070 msgr2=0x7efc501526b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:30.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.417+0000 7efc4fe00640 1 --2- 172.21.15.55:0/2730971273 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc500cc070 0x7efc501526b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.417+0000 7efc4fe00640 1 -- 172.21.15.55:0/2730971273 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc5015a850 msgr2=0x7efc5014c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:30.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.417+0000 7efc4fe00640 1 --2- 172.21.15.55:0/2730971273 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc5015a850 0x7efc5014c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.417+0000 7efc4fe00640 1 -- 172.21.15.55:0/2730971273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc40009420 con 0x7efc50099120 2024-04-02T07:22:30.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.417+0000 7efc47e00640 1 --2- 172.21.15.55:0/2730971273 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc500cc070 0x7efc501526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:30.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.417+0000 7efc4fe00640 1 --2- 172.21.15.55:0/2730971273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc50099120 0x7efc501508e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efc40019030 tx=0x7efc400191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:30.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.417+0000 7efc4cc00640 1 -- 172.21.15.55:0/2730971273 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc400abdc0 con 0x7efc50099120 2024-04-02T07:22:30.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.417+0000 7efc4cc00640 1 -- 172.21.15.55:0/2730971273 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc400bf450 con 0x7efc50099120 2024-04-02T07:22:30.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.417+0000 7efc4cc00640 1 -- 172.21.15.55:0/2730971273 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc400bf800 con 0x7efc50099120 2024-04-02T07:22:30.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.417+0000 7efc55600640 1 -- 172.21.15.55:0/2730971273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc501512c0 con 0x7efc50099120 2024-04-02T07:22:30.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.417+0000 7efc55600640 1 -- 172.21.15.55:0/2730971273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc5014d400 con 0x7efc50099120 2024-04-02T07:22:30.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.417+0000 7efc55600640 1 -- 172.21.15.55:0/2730971273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc5014d5f0 con 0x7efc50099120 2024-04-02T07:22:30.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.417+0000 7efc4cc00640 1 -- 172.21.15.55:0/2730971273 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7efc400bf960 con 0x7efc50099120 2024-04-02T07:22:30.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.417+0000 7efc4cc00640 1 --2- 172.21.15.55:0/2730971273 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efc2c066690 0x7efc2c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:30.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.417+0000 7efc4cc00640 1 -- 172.21.15.55:0/2730971273 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc4011ed30 con 0x7efc50099120 2024-04-02T07:22:30.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.421+0000 7efc47e00640 1 --2- 172.21.15.55:0/2730971273 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efc2c066690 0x7efc2c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:30.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.421+0000 7efc47e00640 1 --2- 172.21.15.55:0/2730971273 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efc2c066690 0x7efc2c068b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efc500b1940 tx=0x7efc38009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:30.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.421+0000 7efc4cc00640 1 -- 172.21.15.55:0/2730971273 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7efc400ec120 con 0x7efc50099120 2024-04-02T07:22:30.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.585+0000 7efc55600640 1 -- 172.21.15.55:0/2730971273 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7efc50073fa0 con 0x7efc50099120 2024-04-02T07:22:30.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.585+0000 7efc4cc00640 1 -- 172.21.15.55:0/2730971273 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7efc400ef740 con 0x7efc50099120 2024-04-02T07:22:30.588 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:22:30.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.585+0000 7efc55600640 1 -- 172.21.15.55:0/2730971273 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efc2c066690 msgr2=0x7efc2c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:30.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.585+0000 7efc55600640 1 --2- 172.21.15.55:0/2730971273 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efc2c066690 0x7efc2c068b50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7efc500b1940 tx=0x7efc38009040 comp rx=0 tx=0).stop 2024-04-02T07:22:30.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.585+0000 7efc55600640 1 -- 172.21.15.55:0/2730971273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc50099120 msgr2=0x7efc501508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:30.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.585+0000 7efc55600640 1 --2- 172.21.15.55:0/2730971273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc50099120 0x7efc501508e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efc40019030 tx=0x7efc400191c0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.585+0000 7efc55600640 1 -- 172.21.15.55:0/2730971273 shutdown_connections 2024-04-02T07:22:30.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.585+0000 7efc55600640 1 --2- 172.21.15.55:0/2730971273 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efc2c066690 0x7efc2c068b50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.585+0000 7efc55600640 1 --2- 172.21.15.55:0/2730971273 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc5015a850 0x7efc5014c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.585+0000 7efc55600640 1 --2- 172.21.15.55:0/2730971273 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc500cc070 0x7efc501526b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.585+0000 7efc55600640 1 --2- 172.21.15.55:0/2730971273 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc50099120 0x7efc501508e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.585+0000 7efc55600640 1 -- 172.21.15.55:0/2730971273 >> 172.21.15.55:0/2730971273 conn(0x7efc500b1fb0 msgr2=0x7efc500b4540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:30.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.585+0000 7efc55600640 1 -- 172.21.15.55:0/2730971273 shutdown_connections 2024-04-02T07:22:30.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.585+0000 7efc55600640 1 -- 172.21.15.55:0/2730971273 wait complete. 2024-04-02T07:22:30.608 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:22:30.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.745+0000 7fcf86400640 1 Processor -- start 2024-04-02T07:22:30.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.745+0000 7fcf86400640 1 -- start start 2024-04-02T07:22:30.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.749+0000 7fcf86400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcf80098a10 0x7fcf80098df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:30.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.749+0000 7fcf86400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf8015dc80 0x7fcf8006aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:30.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.749+0000 7fcf86400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcf8006b3e0 0x7fcf8015f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:30.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.749+0000 7fcf86400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf800cec60 con 0x7fcf8006b3e0 2024-04-02T07:22:30.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.749+0000 7fcf86400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf8015d2c0 con 0x7fcf80098a10 2024-04-02T07:22:30.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.749+0000 7fcf86400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf80099330 con 0x7fcf8015dc80 2024-04-02T07:22:30.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.749+0000 7fcf7fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcf8006b3e0 0x7fcf8015f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:30.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.749+0000 7fcf7fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcf8006b3e0 0x7fcf8015f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32864/0 (socket says 172.21.15.55:32864) 2024-04-02T07:22:30.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.749+0000 7fcf7fe00640 1 -- 172.21.15.55:0/3109955558 learned_addr learned my addr 172.21.15.55:0/3109955558 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:30.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.749+0000 7fcf7f400640 1 --2- 172.21.15.55:0/3109955558 >> v2:172.21.15.106:3300/0 conn(0x7fcf80098a10 0x7fcf80098df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:30.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.749+0000 7fcf77e00640 1 --2- 172.21.15.55:0/3109955558 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf8015dc80 0x7fcf8006aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:30.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.749+0000 7fcf7fe00640 1 -- 172.21.15.55:0/3109955558 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf8015dc80 msgr2=0x7fcf8006aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:30.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.749+0000 7fcf7fe00640 1 --2- 172.21.15.55:0/3109955558 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf8015dc80 0x7fcf8006aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.749+0000 7fcf7fe00640 1 -- 172.21.15.55:0/3109955558 >> v2:172.21.15.106:3300/0 conn(0x7fcf80098a10 msgr2=0x7fcf80098df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:30.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.749+0000 7fcf7fe00640 1 --2- 172.21.15.55:0/3109955558 >> v2:172.21.15.106:3300/0 conn(0x7fcf80098a10 0x7fcf80098df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.749+0000 7fcf7fe00640 1 -- 172.21.15.55:0/3109955558 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8006ba10 con 0x7fcf8006b3e0 2024-04-02T07:22:30.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf7fe00640 1 --2- 172.21.15.55:0/3109955558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf8006b3e0 0x7fcf8015f650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcf80071930 tx=0x7fcf7801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09007c01d9d35fb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:30.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf7ea00640 1 -- 172.21.15.55:0/3109955558 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf780a5840 con 0x7fcf8006b3e0 2024-04-02T07:22:30.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf7ea00640 1 -- 172.21.15.55:0/3109955558 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf780a59a0 con 0x7fcf8006b3e0 2024-04-02T07:22:30.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf7ea00640 1 -- 172.21.15.55:0/3109955558 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf780a5d30 con 0x7fcf8006b3e0 2024-04-02T07:22:30.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf86400640 1 -- 172.21.15.55:0/3109955558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf8006b3e0 msgr2=0x7fcf8015f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:30.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf86400640 1 --2- 172.21.15.55:0/3109955558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf8006b3e0 0x7fcf8015f650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fcf80071930 tx=0x7fcf7801c9c0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf86400640 1 -- 172.21.15.55:0/3109955558 shutdown_connections 2024-04-02T07:22:30.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf86400640 1 --2- 172.21.15.55:0/3109955558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf8006b3e0 0x7fcf8015f650 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf86400640 1 --2- 172.21.15.55:0/3109955558 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf8015dc80 0x7fcf8006aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf86400640 1 --2- 172.21.15.55:0/3109955558 >> v2:172.21.15.106:3300/0 conn(0x7fcf80098a10 0x7fcf80098df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf86400640 1 -- 172.21.15.55:0/3109955558 >> 172.21.15.55:0/3109955558 conn(0x7fcf800b21d0 msgr2=0x7fcf800b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:30.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf86400640 1 -- 172.21.15.55:0/3109955558 shutdown_connections 2024-04-02T07:22:30.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf86400640 1 -- 172.21.15.55:0/3109955558 wait complete. 2024-04-02T07:22:30.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf86400640 1 Processor -- start 2024-04-02T07:22:30.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf86400640 1 -- start start 2024-04-02T07:22:30.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf86400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf8006b3e0 0x7fcf801538e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:30.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf86400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf80098a10 0x7fcf80153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:30.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf86400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf80156ab0 0x7fcf80159b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:30.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf86400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf801564f0 con 0x7fcf80098a10 2024-04-02T07:22:30.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf86400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8015c5a0 con 0x7fcf80156ab0 2024-04-02T07:22:30.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.753+0000 7fcf86400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8015f640 con 0x7fcf8006b3e0 2024-04-02T07:22:30.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.757+0000 7fcf77e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf80098a10 0x7fcf80153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:30.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.757+0000 7fcf77e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf80098a10 0x7fcf80153ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32874/0 (socket says 172.21.15.55:32874) 2024-04-02T07:22:30.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.757+0000 7fcf77e00640 1 -- 172.21.15.55:0/2845714750 learned_addr learned my addr 172.21.15.55:0/2845714750 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:30.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.757+0000 7fcf7f400640 1 --2- 172.21.15.55:0/2845714750 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf8006b3e0 0x7fcf801538e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:30.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.757+0000 7fcf7fe00640 1 --2- 172.21.15.55:0/2845714750 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf80156ab0 0x7fcf80159b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:30.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.757+0000 7fcf77e00640 1 -- 172.21.15.55:0/2845714750 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf8006b3e0 msgr2=0x7fcf801538e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:30.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.757+0000 7fcf77e00640 1 --2- 172.21.15.55:0/2845714750 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf8006b3e0 0x7fcf801538e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.757+0000 7fcf77e00640 1 -- 172.21.15.55:0/2845714750 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf80156ab0 msgr2=0x7fcf80159b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:30.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.757+0000 7fcf77e00640 1 --2- 172.21.15.55:0/2845714750 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf80156ab0 0x7fcf80159b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.757+0000 7fcf77e00640 1 -- 172.21.15.55:0/2845714750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf78009b30 con 0x7fcf80098a10 2024-04-02T07:22:30.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.757+0000 7fcf77e00640 1 --2- 172.21.15.55:0/2845714750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf80098a10 0x7fcf80153ff0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800e870 tx=0x7fcf6800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:30.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.757+0000 7fcf77400640 1 -- 172.21.15.55:0/2845714750 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf68009510 con 0x7fcf80098a10 2024-04-02T07:22:30.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.757+0000 7fcf77400640 1 -- 172.21.15.55:0/2845714750 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6800eec0 con 0x7fcf80098a10 2024-04-02T07:22:30.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.757+0000 7fcf86400640 1 -- 172.21.15.55:0/2845714750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf80153e20 con 0x7fcf80098a10 2024-04-02T07:22:30.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.757+0000 7fcf77400640 1 -- 172.21.15.55:0/2845714750 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6800cae0 con 0x7fcf80098a10 2024-04-02T07:22:30.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.757+0000 7fcf86400640 1 -- 172.21.15.55:0/2845714750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf800b32e0 con 0x7fcf80098a10 2024-04-02T07:22:30.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.757+0000 7fcf86400640 1 -- 172.21.15.55:0/2845714750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf800b3500 con 0x7fcf80098a10 2024-04-02T07:22:30.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.757+0000 7fcf77400640 1 -- 172.21.15.55:0/2845714750 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fcf6800cc40 con 0x7fcf80098a10 2024-04-02T07:22:30.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.757+0000 7fcf77400640 1 --2- 172.21.15.55:0/2845714750 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf5c066690 0x7fcf5c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:30.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.761+0000 7fcf77400640 1 -- 172.21.15.55:0/2845714750 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf68084190 con 0x7fcf80098a10 2024-04-02T07:22:30.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.761+0000 7fcf7f400640 1 --2- 172.21.15.55:0/2845714750 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf5c066690 0x7fcf5c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:30.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.761+0000 7fcf7f400640 1 --2- 172.21.15.55:0/2845714750 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf5c066690 0x7fcf5c068b50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcf800b63c0 tx=0x7fcf70009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:30.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.761+0000 7fcf77400640 1 -- 172.21.15.55:0/2845714750 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fcf800b3500 con 0x7fcf80098a10 2024-04-02T07:22:30.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.921+0000 7fcf86400640 1 -- 172.21.15.55:0/2845714750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcf800b3500 con 0x7fcf80098a10 2024-04-02T07:22:30.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.921+0000 7fcf77400640 1 -- 172.21.15.55:0/2845714750 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcf800b3500 con 0x7fcf80098a10 2024-04-02T07:22:30.927 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:22:30.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.925+0000 7fcf86400640 1 -- 172.21.15.55:0/2845714750 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf5c066690 msgr2=0x7fcf5c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:30.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.925+0000 7fcf86400640 1 --2- 172.21.15.55:0/2845714750 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf5c066690 0x7fcf5c068b50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fcf800b63c0 tx=0x7fcf70009190 comp rx=0 tx=0).stop 2024-04-02T07:22:30.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.925+0000 7fcf86400640 1 -- 172.21.15.55:0/2845714750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf80098a10 msgr2=0x7fcf80153ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:30.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.925+0000 7fcf86400640 1 --2- 172.21.15.55:0/2845714750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf80098a10 0x7fcf80153ff0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcf6800e870 tx=0x7fcf6800ec70 comp rx=0 tx=0).stop 2024-04-02T07:22:30.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.925+0000 7fcf86400640 1 -- 172.21.15.55:0/2845714750 shutdown_connections 2024-04-02T07:22:30.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.925+0000 7fcf86400640 1 --2- 172.21.15.55:0/2845714750 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf5c066690 0x7fcf5c068b50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.925+0000 7fcf86400640 1 --2- 172.21.15.55:0/2845714750 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf80156ab0 0x7fcf80159b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.925+0000 7fcf86400640 1 --2- 172.21.15.55:0/2845714750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf80098a10 0x7fcf80153ff0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.925+0000 7fcf86400640 1 --2- 172.21.15.55:0/2845714750 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf8006b3e0 0x7fcf801538e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:30.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.925+0000 7fcf86400640 1 -- 172.21.15.55:0/2845714750 >> 172.21.15.55:0/2845714750 conn(0x7fcf800b21d0 msgr2=0x7fcf8015c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:30.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.925+0000 7fcf86400640 1 -- 172.21.15.55:0/2845714750 shutdown_connections 2024-04-02T07:22:30.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:30.925+0000 7fcf86400640 1 -- 172.21.15.55:0/2845714750 wait complete. 2024-04-02T07:22:30.949 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:22:31.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.085+0000 7fd6f3800640 1 Processor -- start 2024-04-02T07:22:31.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.085+0000 7fd6f3800640 1 -- start start 2024-04-02T07:22:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.085+0000 7fd6f3800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd6ec099120 0x7fd6ec165890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.085+0000 7fd6f3800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6ec0cb250 con 0x7fd6ec0cc520 2024-04-02T07:22:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.085+0000 7fd6f3800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6ec15ae40 con 0x7fd6ec15aa60 2024-04-02T07:22:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.085+0000 7fd6f3800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ec0cb480 con 0x7fd6ec099120 2024-04-02T07:22:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.085+0000 7fd6e3e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd6ec0cc520 0x7fd6ec098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49230/0 (socket says 172.21.15.55:49230) 2024-04-02T07:22:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.085+0000 7fd6e3e00640 1 -- 172.21.15.55:0/2510937830 learned_addr learned my addr 172.21.15.55:0/2510937830 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.085+0000 7fd6f1800640 1 --2- 172.21.15.55:0/2510937830 >> v2:172.21.15.106:3300/0 conn(0x7fd6ec099120 0x7fd6ec165890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.085+0000 7fd6ebe00640 1 -- 172.21.15.55:0/2510937830 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2441749546 0 0) 0x7fd6ec0cb250 con 0x7fd6ec0cc520 2024-04-02T07:22:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.085+0000 7fd6ebe00640 1 -- 172.21.15.55:0/2510937830 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6d0003530 con 0x7fd6ec0cc520 2024-04-02T07:22:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.085+0000 7fd6f1800640 1 -- 172.21.15.55:0/2510937830 >> v1:172.21.15.106:6789/0 conn(0x7fd6ec15aa60 legacy=0x7fd6ec099750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.085+0000 7fd6f1800640 1 -- 172.21.15.55:0/2510937830 >> v1:172.21.15.55:6789/0 conn(0x7fd6ec0cc520 legacy=0x7fd6ec098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.085+0000 7fd6f1800640 1 -- 172.21.15.55:0/2510937830 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ec0cb760 con 0x7fd6ec099120 2024-04-02T07:22:31.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.089+0000 7fd6f1800640 1 --2- 172.21.15.55:0/2510937830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6ec099120 0x7fd6ec165890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009d90 tx=0x7fd6e401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d701c5190e623142 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:31.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.089+0000 7fd6ebe00640 1 -- 172.21.15.55:0/2510937830 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40a5920 con 0x7fd6ec099120 2024-04-02T07:22:31.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.089+0000 7fd6ebe00640 1 -- 172.21.15.55:0/2510937830 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e40a5a80 con 0x7fd6ec099120 2024-04-02T07:22:31.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.089+0000 7fd6ebe00640 1 -- 172.21.15.55:0/2510937830 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40a5e10 con 0x7fd6ec099120 2024-04-02T07:22:31.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.089+0000 7fd6f3800640 1 -- 172.21.15.55:0/2510937830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6ec099120 msgr2=0x7fd6ec165890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:31.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.089+0000 7fd6f3800640 1 --2- 172.21.15.55:0/2510937830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6ec099120 0x7fd6ec165890 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd6e4009d90 tx=0x7fd6e401c970 comp rx=0 tx=0).stop 2024-04-02T07:22:31.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.089+0000 7fd6f3800640 1 -- 172.21.15.55:0/2510937830 shutdown_connections 2024-04-02T07:22:31.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.089+0000 7fd6f3800640 1 --2- 172.21.15.55:0/2510937830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6ec099120 0x7fd6ec165890 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.089+0000 7fd6f3800640 1 -- 172.21.15.55:0/2510937830 >> 172.21.15.55:0/2510937830 conn(0x7fd6ec0b2150 msgr2=0x7fd6ec0b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:31.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.089+0000 7fd6f3800640 1 -- 172.21.15.55:0/2510937830 shutdown_connections 2024-04-02T07:22:31.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.089+0000 7fd6f3800640 1 -- 172.21.15.55:0/2510937830 wait complete. 2024-04-02T07:22:31.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6f3800640 1 Processor -- start 2024-04-02T07:22:31.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6f3800640 1 -- start start 2024-04-02T07:22:31.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6f3800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6ec099120 0x7fd6ec151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:31.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6f3800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6ec0cc520 0x7fd6ec06c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:31.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6f3800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6ec15aa60 0x7fd6ec06f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:31.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6f3800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec06c550 con 0x7fd6ec15aa60 2024-04-02T07:22:31.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6f3800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec06c780 con 0x7fd6ec0cc520 2024-04-02T07:22:31.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6f3800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ec0c4310 con 0x7fd6ec099120 2024-04-02T07:22:31.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6f1800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6ec15aa60 0x7fd6ec06f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:31.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6f1800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6ec15aa60 0x7fd6ec06f030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32888/0 (socket says 172.21.15.55:32888) 2024-04-02T07:22:31.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6f1800640 1 -- 172.21.15.55:0/3597324220 learned_addr learned my addr 172.21.15.55:0/3597324220 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:31.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6f0e00640 1 --2- 172.21.15.55:0/3597324220 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6ec099120 0x7fd6ec151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:31.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6e3e00640 1 --2- 172.21.15.55:0/3597324220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6ec0cc520 0x7fd6ec06c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:31.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6f1800640 1 -- 172.21.15.55:0/3597324220 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6ec099120 msgr2=0x7fd6ec151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:31.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6f1800640 1 --2- 172.21.15.55:0/3597324220 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6ec099120 0x7fd6ec151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6f1800640 1 -- 172.21.15.55:0/3597324220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6ec0cc520 msgr2=0x7fd6ec06c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:31.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6f1800640 1 --2- 172.21.15.55:0/3597324220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6ec0cc520 0x7fd6ec06c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6f1800640 1 -- 172.21.15.55:0/3597324220 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e4009a70 con 0x7fd6ec15aa60 2024-04-02T07:22:31.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6f1800640 1 --2- 172.21.15.55:0/3597324220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6ec15aa60 0x7fd6ec06f030 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd6e401a5a0 tx=0x7fd6e4019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:31.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6e9600640 1 -- 172.21.15.55:0/3597324220 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40ad850 con 0x7fd6ec15aa60 2024-04-02T07:22:31.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6e9600640 1 -- 172.21.15.55:0/3597324220 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6e40ad9b0 con 0x7fd6ec15aa60 2024-04-02T07:22:31.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6e9600640 1 -- 172.21.15.55:0/3597324220 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6e40add20 con 0x7fd6ec15aa60 2024-04-02T07:22:31.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6f3800640 1 -- 172.21.15.55:0/3597324220 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ec0c45f0 con 0x7fd6ec15aa60 2024-04-02T07:22:31.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.093+0000 7fd6f3800640 1 -- 172.21.15.55:0/3597324220 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ec06f570 con 0x7fd6ec15aa60 2024-04-02T07:22:31.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.097+0000 7fd6f3800640 1 -- 172.21.15.55:0/3597324220 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ec06f760 con 0x7fd6ec15aa60 2024-04-02T07:22:31.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.097+0000 7fd6e9600640 1 -- 172.21.15.55:0/3597324220 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd6e40b4050 con 0x7fd6ec15aa60 2024-04-02T07:22:31.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.097+0000 7fd6e9600640 1 --2- 172.21.15.55:0/3597324220 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd6c8066690 0x7fd6c8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:31.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.097+0000 7fd6e9600640 1 -- 172.21.15.55:0/3597324220 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6e411f3c0 con 0x7fd6ec15aa60 2024-04-02T07:22:31.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.097+0000 7fd6f0e00640 1 --2- 172.21.15.55:0/3597324220 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd6c8066690 0x7fd6c8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:31.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.097+0000 7fd6f0e00640 1 --2- 172.21.15.55:0/3597324220 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd6c8066690 0x7fd6c8068b50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc007fd0 tx=0x7fd6dc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:31.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.101+0000 7fd6e9600640 1 -- 172.21.15.55:0/3597324220 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd6e40ec8f0 con 0x7fd6ec15aa60 2024-04-02T07:22:31.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.293+0000 7fd6f3800640 1 -- 172.21.15.55:0/3597324220 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6ec0c4110 con 0x7fd6ec15aa60 2024-04-02T07:22:31.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.297+0000 7fd6e9600640 1 -- 172.21.15.55:0/3597324220 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4725 (secure 0 0 0) 0x7fd6e40eff10 con 0x7fd6ec15aa60 2024-04-02T07:22:31.300 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:31.300 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1468533802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1468533802},{"type":"v1","addr":"172.21.15.106:6837","nonce":1468533802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/342047131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":342047131},{"type":"v1","addr":"172.21.15.55:6833","nonce":342047131}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/50847499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":50847499},{"type":"v1","addr":"172.21.15.55:6835","nonce":50847499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:22:18.201059+0000","modified":"2024-04-02T07:22:21.225641+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6836/3829467285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3829467285},{"type":"v1","addr":"172.21.15.106:6836","nonce":3829467285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-02T07:22:31.300 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2024-04-02T07:22:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.297+0000 7fd6f3800640 1 -- 172.21.15.55:0/3597324220 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd6c8066690 msgr2=0x7fd6c8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.297+0000 7fd6f3800640 1 --2- 172.21.15.55:0/3597324220 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd6c8066690 0x7fd6c8068b50 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc007fd0 tx=0x7fd6dc009040 comp rx=0 tx=0).stop 2024-04-02T07:22:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.297+0000 7fd6f3800640 1 -- 172.21.15.55:0/3597324220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6ec15aa60 msgr2=0x7fd6ec06f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.297+0000 7fd6f3800640 1 --2- 172.21.15.55:0/3597324220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6ec15aa60 0x7fd6ec06f030 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fd6e401a5a0 tx=0x7fd6e4019710 comp rx=0 tx=0).stop 2024-04-02T07:22:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.297+0000 7fd6f3800640 1 -- 172.21.15.55:0/3597324220 shutdown_connections 2024-04-02T07:22:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.297+0000 7fd6f3800640 1 --2- 172.21.15.55:0/3597324220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6ec15aa60 0x7fd6ec06f030 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.297+0000 7fd6f3800640 1 --2- 172.21.15.55:0/3597324220 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd6c8066690 0x7fd6c8068b50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.297+0000 7fd6f3800640 1 --2- 172.21.15.55:0/3597324220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6ec0cc520 0x7fd6ec06c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.297+0000 7fd6f3800640 1 --2- 172.21.15.55:0/3597324220 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6ec099120 0x7fd6ec151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.297+0000 7fd6f3800640 1 -- 172.21.15.55:0/3597324220 >> 172.21.15.55:0/3597324220 conn(0x7fd6ec0b2150 msgr2=0x7fd6ec098a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.297+0000 7fd6f3800640 1 -- 172.21.15.55:0/3597324220 shutdown_connections 2024-04-02T07:22:31.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.297+0000 7fd6f3800640 1 -- 172.21.15.55:0/3597324220 wait complete. 2024-04-02T07:22:31.321 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:31.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.457+0000 7fc734a00640 1 Processor -- start 2024-04-02T07:22:31.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.457+0000 7fc734a00640 1 -- start start 2024-04-02T07:22:31.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.457+0000 7fc734a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc730153ea0 0x7fc7300c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:31.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.457+0000 7fc734a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc73015a070 0x7fc73013d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:31.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.457+0000 7fc734a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc73013d0c0 con 0x7fc730159be0 2024-04-02T07:22:31.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.457+0000 7fc734a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc73015a4f0 con 0x7fc730153ea0 2024-04-02T07:22:31.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.457+0000 7fc734a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc73015a7d0 con 0x7fc73015a070 2024-04-02T07:22:31.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.457+0000 7fc72de00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc730153ea0 0x7fc7300c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.457+0000 7fc72de00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc730153ea0 0x7fc7300c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32892/0 (socket says 172.21.15.55:32892) 2024-04-02T07:22:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.457+0000 7fc72de00640 1 -- 172.21.15.55:0/4062540553 learned_addr learned my addr 172.21.15.55:0/4062540553 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.457+0000 7fc72e800640 1 --2- 172.21.15.55:0/4062540553 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc73015a070 0x7fc73013d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.457+0000 7fc72de00640 1 -- 172.21.15.55:0/4062540553 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc73015a070 msgr2=0x7fc73013d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.457+0000 7fc72de00640 1 --2- 172.21.15.55:0/4062540553 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc73015a070 0x7fc73013d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.457+0000 7fc72de00640 1 -- 172.21.15.55:0/4062540553 >> v1:172.21.15.106:6789/0 conn(0x7fc730159be0 legacy=0x7fc7300b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.457+0000 7fc72de00640 1 -- 172.21.15.55:0/4062540553 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73015aab0 con 0x7fc730153ea0 2024-04-02T07:22:31.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.461+0000 7fc72de00640 1 --2- 172.21.15.55:0/4062540553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc730153ea0 0x7fc7300c4120 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc720009870 tx=0x7fc72001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd1395cc2d58e2c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:31.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.461+0000 7fc72d400640 1 -- 172.21.15.55:0/4062540553 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7200aa660 con 0x7fc730153ea0 2024-04-02T07:22:31.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.461+0000 7fc72d400640 1 -- 172.21.15.55:0/4062540553 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7200aa7c0 con 0x7fc730153ea0 2024-04-02T07:22:31.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.461+0000 7fc72d400640 1 -- 172.21.15.55:0/4062540553 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7200aab50 con 0x7fc730153ea0 2024-04-02T07:22:31.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.461+0000 7fc734a00640 1 -- 172.21.15.55:0/4062540553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc730153ea0 msgr2=0x7fc7300c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:31.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.461+0000 7fc734a00640 1 --2- 172.21.15.55:0/4062540553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc730153ea0 0x7fc7300c4120 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc720009870 tx=0x7fc72001c520 comp rx=0 tx=0).stop 2024-04-02T07:22:31.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.461+0000 7fc734a00640 1 -- 172.21.15.55:0/4062540553 shutdown_connections 2024-04-02T07:22:31.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.461+0000 7fc734a00640 1 --2- 172.21.15.55:0/4062540553 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc73015a070 0x7fc73013d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.461+0000 7fc734a00640 1 --2- 172.21.15.55:0/4062540553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc730153ea0 0x7fc7300c4120 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.461+0000 7fc734a00640 1 -- 172.21.15.55:0/4062540553 >> 172.21.15.55:0/4062540553 conn(0x7fc730066080 msgr2=0x7fc730069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:31.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.461+0000 7fc734a00640 1 -- 172.21.15.55:0/4062540553 shutdown_connections 2024-04-02T07:22:31.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.461+0000 7fc734a00640 1 -- 172.21.15.55:0/4062540553 wait complete. 2024-04-02T07:22:31.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc734a00640 1 Processor -- start 2024-04-02T07:22:31.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc734a00640 1 -- start start 2024-04-02T07:22:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc734a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc730153ea0 0x7fc73012f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc734a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc730159be0 0x7fc73014f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc734a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc73015a070 0x7fc730132a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc734a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73012fbb0 con 0x7fc730159be0 2024-04-02T07:22:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc734a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc73012fde0 con 0x7fc73015a070 2024-04-02T07:22:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc734a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7301300c0 con 0x7fc730153ea0 2024-04-02T07:22:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc725400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc730159be0 0x7fc73014f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc725400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc730159be0 0x7fc73014f430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32896/0 (socket says 172.21.15.55:32896) 2024-04-02T07:22:31.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc725400640 1 -- 172.21.15.55:0/838094814 learned_addr learned my addr 172.21.15.55:0/838094814 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc72de00640 1 --2- 172.21.15.55:0/838094814 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc730153ea0 0x7fc73012f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc72e800640 1 --2- 172.21.15.55:0/838094814 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc73015a070 0x7fc730132a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc725400640 1 -- 172.21.15.55:0/838094814 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc730153ea0 msgr2=0x7fc73012f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc725400640 1 --2- 172.21.15.55:0/838094814 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc730153ea0 0x7fc73012f670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc725400640 1 -- 172.21.15.55:0/838094814 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc73015a070 msgr2=0x7fc730132a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc725400640 1 --2- 172.21.15.55:0/838094814 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc73015a070 0x7fc730132a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc725400640 1 -- 172.21.15.55:0/838094814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7200094d0 con 0x7fc730159be0 2024-04-02T07:22:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc725400640 1 --2- 172.21.15.55:0/838094814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc730159be0 0x7fc73014f430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc71800c450 tx=0x7fc71800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc726a00640 1 -- 172.21.15.55:0/838094814 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718012830 con 0x7fc730159be0 2024-04-02T07:22:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc726a00640 1 -- 172.21.15.55:0/838094814 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7180129b0 con 0x7fc730159be0 2024-04-02T07:22:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc734a00640 1 -- 172.21.15.55:0/838094814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7301303a0 con 0x7fc730159be0 2024-04-02T07:22:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc726a00640 1 -- 172.21.15.55:0/838094814 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718012d60 con 0x7fc730159be0 2024-04-02T07:22:31.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.465+0000 7fc734a00640 1 -- 172.21.15.55:0/838094814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc730130960 con 0x7fc730159be0 2024-04-02T07:22:31.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.469+0000 7fc734a00640 1 -- 172.21.15.55:0/838094814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc730130b80 con 0x7fc730159be0 2024-04-02T07:22:31.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.469+0000 7fc726a00640 1 -- 172.21.15.55:0/838094814 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc71801c460 con 0x7fc730159be0 2024-04-02T07:22:31.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.469+0000 7fc726a00640 1 --2- 172.21.15.55:0/838094814 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc70c066690 0x7fc70c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:31.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.469+0000 7fc726a00640 1 -- 172.21.15.55:0/838094814 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc718083ee0 con 0x7fc730159be0 2024-04-02T07:22:31.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.469+0000 7fc72de00640 1 --2- 172.21.15.55:0/838094814 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc70c066690 0x7fc70c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:31.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.469+0000 7fc72de00640 1 --2- 172.21.15.55:0/838094814 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc70c066690 0x7fc70c068b50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc7200ae000 tx=0x7fc7200b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:31.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.473+0000 7fc726a00640 1 -- 172.21.15.55:0/838094814 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc718051240 con 0x7fc730159be0 2024-04-02T07:22:31.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.637+0000 7fc734a00640 1 -- 172.21.15.55:0/838094814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc730066c90 con 0x7fc730159be0 2024-04-02T07:22:31.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.637+0000 7fc726a00640 1 -- 172.21.15.55:0/838094814 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7fc718054860 con 0x7fc730159be0 2024-04-02T07:22:31.643 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:31.643 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:19.207279+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:31.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.641+0000 7fc734a00640 1 -- 172.21.15.55:0/838094814 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc70c066690 msgr2=0x7fc70c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:31.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.641+0000 7fc734a00640 1 --2- 172.21.15.55:0/838094814 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc70c066690 0x7fc70c068b50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc7200ae000 tx=0x7fc7200b5040 comp rx=0 tx=0).stop 2024-04-02T07:22:31.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.641+0000 7fc734a00640 1 -- 172.21.15.55:0/838094814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc730159be0 msgr2=0x7fc73014f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:31.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.641+0000 7fc734a00640 1 --2- 172.21.15.55:0/838094814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc730159be0 0x7fc73014f430 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc71800c450 tx=0x7fc71800c910 comp rx=0 tx=0).stop 2024-04-02T07:22:31.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.641+0000 7fc734a00640 1 -- 172.21.15.55:0/838094814 shutdown_connections 2024-04-02T07:22:31.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.641+0000 7fc734a00640 1 --2- 172.21.15.55:0/838094814 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc70c066690 0x7fc70c068b50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.641+0000 7fc734a00640 1 --2- 172.21.15.55:0/838094814 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc73015a070 0x7fc730132a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.641+0000 7fc734a00640 1 --2- 172.21.15.55:0/838094814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc730159be0 0x7fc73014f430 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.641+0000 7fc734a00640 1 --2- 172.21.15.55:0/838094814 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc730153ea0 0x7fc73012f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.641+0000 7fc734a00640 1 -- 172.21.15.55:0/838094814 >> 172.21.15.55:0/838094814 conn(0x7fc730066080 msgr2=0x7fc730071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:31.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.641+0000 7fc734a00640 1 -- 172.21.15.55:0/838094814 shutdown_connections 2024-04-02T07:22:31.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.641+0000 7fc734a00640 1 -- 172.21.15.55:0/838094814 wait complete. 2024-04-02T07:22:31.664 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:22:31.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.801+0000 7fbbb5800640 1 Processor -- start 2024-04-02T07:22:31.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.801+0000 7fbbb5800640 1 -- start start 2024-04-02T07:22:31.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.801+0000 7fbbb5800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbbb015ee70 0x7fbbb0099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:31.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.801+0000 7fbbb5800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbbb015f250 0x7fbbb00b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:31.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.801+0000 7fbbb5800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb00ad270 con 0x7fbbb0098a10 2024-04-02T07:22:31.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.801+0000 7fbbb5800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb00b0840 con 0x7fbbb015ee70 2024-04-02T07:22:31.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.801+0000 7fbbb5800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb00cf6a0 con 0x7fbbb015f250 2024-04-02T07:22:31.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.801+0000 7fbbaea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbbb015ee70 0x7fbbb0099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:31.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.801+0000 7fbbaea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbbb015ee70 0x7fbbb0099830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32902/0 (socket says 172.21.15.55:32902) 2024-04-02T07:22:31.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.801+0000 7fbbaea00640 1 -- 172.21.15.55:0/1553747007 learned_addr learned my addr 172.21.15.55:0/1553747007 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:31.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.801+0000 7fbba6000640 1 --2- 172.21.15.55:0/1553747007 >> v2:172.21.15.106:3300/0 conn(0x7fbbb015f250 0x7fbbb00b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:31.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.801+0000 7fbbaea00640 1 -- 172.21.15.55:0/1553747007 >> v2:172.21.15.106:3300/0 conn(0x7fbbb015f250 msgr2=0x7fbbb00b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:31.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.801+0000 7fbbaea00640 1 --2- 172.21.15.55:0/1553747007 >> v2:172.21.15.106:3300/0 conn(0x7fbbb015f250 0x7fbbb00b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.801+0000 7fbbaea00640 1 -- 172.21.15.55:0/1553747007 >> v1:172.21.15.106:6789/0 conn(0x7fbbb0098a10 legacy=0x7fbbb0098e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:31.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.801+0000 7fbbaea00640 1 -- 172.21.15.55:0/1553747007 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb00b0a50 con 0x7fbbb015ee70 2024-04-02T07:22:31.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.801+0000 7fbba6000640 1 --2- 172.21.15.55:0/1553747007 >> v2:172.21.15.106:3300/0 conn(0x7fbbb015f250 0x7fbbb00b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:31.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.805+0000 7fbbaea00640 1 --2- 172.21.15.55:0/1553747007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb015ee70 0x7fbbb0099830 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0073b60 tx=0x7fbba001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d748f96092da000 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:31.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.805+0000 7fbbae000640 1 -- 172.21.15.55:0/1553747007 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba00aa640 con 0x7fbbb015ee70 2024-04-02T07:22:31.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.805+0000 7fbbae000640 1 -- 172.21.15.55:0/1553747007 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba00aa7a0 con 0x7fbbb015ee70 2024-04-02T07:22:31.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.805+0000 7fbbae000640 1 -- 172.21.15.55:0/1553747007 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba00aab30 con 0x7fbbb015ee70 2024-04-02T07:22:31.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.805+0000 7fbbb5800640 1 -- 172.21.15.55:0/1553747007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb015ee70 msgr2=0x7fbbb0099830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:31.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.805+0000 7fbbb5800640 1 --2- 172.21.15.55:0/1553747007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb015ee70 0x7fbbb0099830 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0073b60 tx=0x7fbba001c4e0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.805+0000 7fbbb5800640 1 -- 172.21.15.55:0/1553747007 shutdown_connections 2024-04-02T07:22:31.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.805+0000 7fbbb5800640 1 --2- 172.21.15.55:0/1553747007 >> v2:172.21.15.106:3300/0 conn(0x7fbbb015f250 0x7fbbb00b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.805+0000 7fbbb5800640 1 --2- 172.21.15.55:0/1553747007 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb015ee70 0x7fbbb0099830 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.805+0000 7fbbb5800640 1 -- 172.21.15.55:0/1553747007 >> 172.21.15.55:0/1553747007 conn(0x7fbbb00b21d0 msgr2=0x7fbbb00b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:31.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.805+0000 7fbbb5800640 1 -- 172.21.15.55:0/1553747007 shutdown_connections 2024-04-02T07:22:31.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.805+0000 7fbbb5800640 1 -- 172.21.15.55:0/1553747007 wait complete. 2024-04-02T07:22:31.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.805+0000 7fbbb5800640 1 Processor -- start 2024-04-02T07:22:31.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbbb5800640 1 -- start start 2024-04-02T07:22:31.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbbb5800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb0098a10 0x7fbbb0156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:31.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbbb5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb015ee70 0x7fbbb00b5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:31.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbbb5800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbbb015f250 0x7fbbb006bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:31.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbbb5800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb0157530 con 0x7fbbb015ee70 2024-04-02T07:22:31.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbbb5800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb01649c0 con 0x7fbbb0098a10 2024-04-02T07:22:31.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbbb5800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb0164ca0 con 0x7fbbb015f250 2024-04-02T07:22:31.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbba6000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb015ee70 0x7fbbb00b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:31.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbba6000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb015ee70 0x7fbbb00b5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32914/0 (socket says 172.21.15.55:32914) 2024-04-02T07:22:31.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbba6000640 1 -- 172.21.15.55:0/2219114357 learned_addr learned my addr 172.21.15.55:0/2219114357 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:31.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbbaea00640 1 --2- 172.21.15.55:0/2219114357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb0098a10 0x7fbbb0156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:31.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbbaf400640 1 --2- 172.21.15.55:0/2219114357 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbbb015f250 0x7fbbb006bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:31.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbba6000640 1 -- 172.21.15.55:0/2219114357 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbbb015f250 msgr2=0x7fbbb006bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:31.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbba6000640 1 --2- 172.21.15.55:0/2219114357 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbbb015f250 0x7fbbb006bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbba6000640 1 -- 172.21.15.55:0/2219114357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb0098a10 msgr2=0x7fbbb0156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:31.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbba6000640 1 --2- 172.21.15.55:0/2219114357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb0098a10 0x7fbbb0156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:31.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbba6000640 1 -- 172.21.15.55:0/2219114357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba00094d0 con 0x7fbbb015ee70 2024-04-02T07:22:31.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbba6000640 1 --2- 172.21.15.55:0/2219114357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb015ee70 0x7fbbb00b5890 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800c7f0 tx=0x7fbb9800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:31.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbba7400640 1 -- 172.21.15.55:0/2219114357 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98007820 con 0x7fbbb015ee70 2024-04-02T07:22:31.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbba7400640 1 -- 172.21.15.55:0/2219114357 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb98007980 con 0x7fbbb015ee70 2024-04-02T07:22:31.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbba7400640 1 -- 172.21.15.55:0/2219114357 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb98007d30 con 0x7fbbb015ee70 2024-04-02T07:22:31.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbbb5800640 1 -- 172.21.15.55:0/2219114357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb0164f80 con 0x7fbbb015ee70 2024-04-02T07:22:31.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbbb5800640 1 -- 172.21.15.55:0/2219114357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb0159710 con 0x7fbbb015ee70 2024-04-02T07:22:31.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.809+0000 7fbbb5800640 1 -- 172.21.15.55:0/2219114357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb01654a0 con 0x7fbbb015ee70 2024-04-02T07:22:31.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.813+0000 7fbba7400640 1 -- 172.21.15.55:0/2219114357 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fbb980113f0 con 0x7fbbb015ee70 2024-04-02T07:22:31.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.813+0000 7fbba7400640 1 --2- 172.21.15.55:0/2219114357 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb8c066690 0x7fbb8c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:31.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.813+0000 7fbba7400640 1 -- 172.21.15.55:0/2219114357 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb98084550 con 0x7fbbb015ee70 2024-04-02T07:22:31.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.813+0000 7fbbaea00640 1 --2- 172.21.15.55:0/2219114357 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb8c066690 0x7fbb8c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:31.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.813+0000 7fbbaea00640 1 --2- 172.21.15.55:0/2219114357 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb8c066690 0x7fbb8c068b50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbba00ae000 tx=0x7fbba00b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:31.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:31.817+0000 7fbba7400640 1 -- 172.21.15.55:0/2219114357 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fbbb01654a0 con 0x7fbbb015ee70 2024-04-02T07:22:32.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.009+0000 7fbbb5800640 1 -- 172.21.15.55:0/2219114357 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbb01654a0 con 0x7fbbb015ee70 2024-04-02T07:22:32.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.009+0000 7fbba7400640 1 -- 172.21.15.55:0/2219114357 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4725 (secure 0 0 0) 0x7fbbb01654a0 con 0x7fbbb015ee70 2024-04-02T07:22:32.013 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:32.013 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1468533802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1468533802},{"type":"v1","addr":"172.21.15.106:6837","nonce":1468533802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/342047131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":342047131},{"type":"v1","addr":"172.21.15.55:6833","nonce":342047131}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/50847499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":50847499},{"type":"v1","addr":"172.21.15.55:6835","nonce":50847499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:22:18.201059+0000","modified":"2024-04-02T07:22:21.225641+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6836/3829467285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3829467285},{"type":"v1","addr":"172.21.15.106:6836","nonce":3829467285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-02T07:22:32.014 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2024-04-02T07:22:32.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.009+0000 7fbbb5800640 1 -- 172.21.15.55:0/2219114357 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb8c066690 msgr2=0x7fbb8c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:32.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.009+0000 7fbbb5800640 1 --2- 172.21.15.55:0/2219114357 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb8c066690 0x7fbb8c068b50 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbba00ae000 tx=0x7fbba00b5040 comp rx=0 tx=0).stop 2024-04-02T07:22:32.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.009+0000 7fbbb5800640 1 -- 172.21.15.55:0/2219114357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb015ee70 msgr2=0x7fbbb00b5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:32.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.009+0000 7fbbb5800640 1 --2- 172.21.15.55:0/2219114357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb015ee70 0x7fbbb00b5890 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbb9800c7f0 tx=0x7fbb9800ccb0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.009+0000 7fbbb5800640 1 -- 172.21.15.55:0/2219114357 shutdown_connections 2024-04-02T07:22:32.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.009+0000 7fbbb5800640 1 --2- 172.21.15.55:0/2219114357 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbbb015f250 0x7fbbb006bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.009+0000 7fbbb5800640 1 --2- 172.21.15.55:0/2219114357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbb015ee70 0x7fbbb00b5890 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.009+0000 7fbbb5800640 1 --2- 172.21.15.55:0/2219114357 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb8c066690 0x7fbb8c068b50 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.009+0000 7fbbb5800640 1 --2- 172.21.15.55:0/2219114357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbb0098a10 0x7fbbb0156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.009+0000 7fbbb5800640 1 -- 172.21.15.55:0/2219114357 >> 172.21.15.55:0/2219114357 conn(0x7fbbb00b21d0 msgr2=0x7fbbb006f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:32.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.009+0000 7fbbb5800640 1 -- 172.21.15.55:0/2219114357 shutdown_connections 2024-04-02T07:22:32.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.009+0000 7fbbb5800640 1 -- 172.21.15.55:0/2219114357 wait complete. 2024-04-02T07:22:32.436 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:22:18.201059+0000', 'modified': '2024-04-02T07:22:21.225641+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4288}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4288': {'gid': 4288, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.106:6836/3829467285', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6834', 'nonce': 3829467285}, {'type': 'v1', 'addr': '172.21.15.106:6836', 'nonce': 3829467285}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:22:32.437 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-02T07:22:32.437 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-02T07:22:32.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.577+0000 7f7b6e600640 1 Processor -- start 2024-04-02T07:22:32.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.577+0000 7f7b6e600640 1 -- start start 2024-04-02T07:22:32.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.577+0000 7f7b6e600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7b6806d1c0 0x7f7b680b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:32.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.577+0000 7f7b6e600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b680b1d60 con 0x7f7b680b38f0 2024-04-02T07:22:32.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.577+0000 7f7b6e600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b6806c400 con 0x7f7b681599c0 2024-04-02T07:22:32.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.577+0000 7f7b6e600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b6806cda0 con 0x7f7b6806d1c0 2024-04-02T07:22:32.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.577+0000 7f7b67e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7b680b38f0 0x7f7b680c90d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49238/0 (socket says 172.21.15.55:49238) 2024-04-02T07:22:32.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.577+0000 7f7b67e00640 1 -- 172.21.15.55:0/3922274154 learned_addr learned my addr 172.21.15.55:0/3922274154 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:32.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.577+0000 7f7b66a00640 1 --2- 172.21.15.55:0/3922274154 >> v2:172.21.15.106:3300/0 conn(0x7f7b6806d1c0 0x7f7b680b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:32.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.577+0000 7f7b66000640 1 -- 172.21.15.55:0/3922274154 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2600191362 0 0) 0x7f7b680b1d60 con 0x7f7b680b38f0 2024-04-02T07:22:32.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.577+0000 7f7b66000640 1 -- 172.21.15.55:0/3922274154 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b4c003530 con 0x7f7b680b38f0 2024-04-02T07:22:32.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.577+0000 7f7b66a00640 1 -- 172.21.15.55:0/3922274154 >> v1:172.21.15.106:6789/0 conn(0x7f7b681599c0 legacy=0x7f7b680b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:32.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.577+0000 7f7b66a00640 1 -- 172.21.15.55:0/3922274154 >> v1:172.21.15.55:6789/0 conn(0x7f7b680b38f0 legacy=0x7f7b680c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:32.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.577+0000 7f7b66a00640 1 -- 172.21.15.55:0/3922274154 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b6806c6e0 con 0x7f7b6806d1c0 2024-04-02T07:22:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.581+0000 7f7b66a00640 1 --2- 172.21.15.55:0/3922274154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b6806d1c0 0x7f7b680b1780 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7b540097c0 tx=0x7f7b5401e6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c97c4ea4da339db server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.581+0000 7f7b66000640 1 -- 172.21.15.55:0/3922274154 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b540ac620 con 0x7f7b6806d1c0 2024-04-02T07:22:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.581+0000 7f7b66000640 1 -- 172.21.15.55:0/3922274154 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b540ac780 con 0x7f7b6806d1c0 2024-04-02T07:22:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.581+0000 7f7b66000640 1 -- 172.21.15.55:0/3922274154 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b540acb10 con 0x7f7b6806d1c0 2024-04-02T07:22:32.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.581+0000 7f7b6e600640 1 -- 172.21.15.55:0/3922274154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b6806d1c0 msgr2=0x7f7b680b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:32.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.581+0000 7f7b6e600640 1 --2- 172.21.15.55:0/3922274154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b6806d1c0 0x7f7b680b1780 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7b540097c0 tx=0x7f7b5401e6b0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.581+0000 7f7b6e600640 1 -- 172.21.15.55:0/3922274154 shutdown_connections 2024-04-02T07:22:32.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.581+0000 7f7b6e600640 1 --2- 172.21.15.55:0/3922274154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b6806d1c0 0x7f7b680b1780 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.581+0000 7f7b6e600640 1 -- 172.21.15.55:0/3922274154 >> 172.21.15.55:0/3922274154 conn(0x7f7b68069d90 msgr2=0x7f7b6806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:32.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.581+0000 7f7b6e600640 1 -- 172.21.15.55:0/3922274154 shutdown_connections 2024-04-02T07:22:32.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.581+0000 7f7b6e600640 1 -- 172.21.15.55:0/3922274154 wait complete. 2024-04-02T07:22:32.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b6e600640 1 Processor -- start 2024-04-02T07:22:32.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b6e600640 1 -- start start 2024-04-02T07:22:32.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b6e600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b6806d1c0 0x7f7b681497a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b6e600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7b680b38f0 0x7f7b68145be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b6e600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b681599c0 0x7f7b68146970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b6e600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b68149310 con 0x7f7b6806d1c0 2024-04-02T07:22:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b6e600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b68149ce0 con 0x7f7b681599c0 2024-04-02T07:22:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b6e600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b681489e0 con 0x7f7b680b38f0 2024-04-02T07:22:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b67400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b6806d1c0 0x7f7b681497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b67400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b6806d1c0 0x7f7b681497a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32920/0 (socket says 172.21.15.55:32920) 2024-04-02T07:22:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b67400640 1 -- 172.21.15.55:0/3299268348 learned_addr learned my addr 172.21.15.55:0/3299268348 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b66a00640 1 --2- 172.21.15.55:0/3299268348 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7b680b38f0 0x7f7b68145be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b67e00640 1 --2- 172.21.15.55:0/3299268348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b681599c0 0x7f7b68146970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b67400640 1 -- 172.21.15.55:0/3299268348 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7b680b38f0 msgr2=0x7f7b68145be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:32.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b67400640 1 --2- 172.21.15.55:0/3299268348 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7b680b38f0 0x7f7b68145be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b67400640 1 -- 172.21.15.55:0/3299268348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b681599c0 msgr2=0x7f7b68146970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:32.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b67400640 1 --2- 172.21.15.55:0/3299268348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b681599c0 0x7f7b68146970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b67400640 1 -- 172.21.15.55:0/3299268348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b54009420 con 0x7f7b6806d1c0 2024-04-02T07:22:32.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b67400640 1 --2- 172.21.15.55:0/3299268348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b6806d1c0 0x7f7b681497a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800c3c0 tx=0x7f7b5800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:32.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b5f400640 1 -- 172.21.15.55:0/3299268348 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b580052d0 con 0x7f7b6806d1c0 2024-04-02T07:22:32.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b5f400640 1 -- 172.21.15.55:0/3299268348 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b58005430 con 0x7f7b6806d1c0 2024-04-02T07:22:32.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b5f400640 1 -- 172.21.15.55:0/3299268348 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b58003840 con 0x7f7b6806d1c0 2024-04-02T07:22:32.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b6e600640 1 -- 172.21.15.55:0/3299268348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b68148cc0 con 0x7f7b6806d1c0 2024-04-02T07:22:32.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.585+0000 7f7b6e600640 1 -- 172.21.15.55:0/3299268348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b68146120 con 0x7f7b6806d1c0 2024-04-02T07:22:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b5f400640 1 -- 172.21.15.55:0/3299268348 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7b580039a0 con 0x7f7b6806d1c0 2024-04-02T07:22:32.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b5f400640 1 --2- 172.21.15.55:0/3299268348 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b48066690 0x7f7b48068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:32.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b5f400640 1 -- 172.21.15.55:0/3299268348 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b580836b0 con 0x7f7b6806d1c0 2024-04-02T07:22:32.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b71aba000 1 Processor -- start 2024-04-02T07:22:32.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b66a00640 1 --2- 172.21.15.55:0/3299268348 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b48066690 0x7f7b48068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:32.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b71aba000 1 -- start start 2024-04-02T07:22:32.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b66a00640 1 --2- 172.21.15.55:0/3299268348 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b48066690 0x7f7b48068b50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7b540b0000 tx=0x7f7b540a9000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:32.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b71aba000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc20624db0 0x55cc20625190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:32.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b71aba000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc206256d0 0x55cc205daf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:32.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b71aba000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc205db4c0 0x55cc205db8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:32.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b71aba000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc204a35a0 con 0x55cc206256d0 2024-04-02T07:22:32.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b71aba000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc20430af0 con 0x55cc205db4c0 2024-04-02T07:22:32.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b71aba000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc2042e0c0 con 0x55cc20624db0 2024-04-02T07:22:32.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b66a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc206256d0 0x55cc205daf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:32.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b66a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc206256d0 0x55cc205daf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32930/0 (socket says 172.21.15.55:32930) 2024-04-02T07:22:32.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b66a00640 1 -- 172.21.15.55:0/63949733 learned_addr learned my addr 172.21.15.55:0/63949733 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:32.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b67400640 1 --2- 172.21.15.55:0/63949733 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc20624db0 0x55cc20625190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:32.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b67e00640 1 --2- 172.21.15.55:0/63949733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc205db4c0 0x55cc205db8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:32.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b66a00640 1 -- 172.21.15.55:0/63949733 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc20624db0 msgr2=0x55cc20625190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:32.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b66a00640 1 --2- 172.21.15.55:0/63949733 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc20624db0 0x55cc20625190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b66a00640 1 -- 172.21.15.55:0/63949733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc205db4c0 msgr2=0x55cc205db8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:32.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b66a00640 1 --2- 172.21.15.55:0/63949733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc205db4c0 0x55cc205db8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b66a00640 1 -- 172.21.15.55:0/63949733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc20125890 con 0x55cc206256d0 2024-04-02T07:22:32.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b67e00640 1 --2- 172.21.15.55:0/63949733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc205db4c0 0x55cc205db8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:32.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.589+0000 7f7b66a00640 1 --2- 172.21.15.55:0/63949733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc206256d0 0x55cc205daf80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400e330 tx=0x7f7b54004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430ec600f198c906 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:32.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b53e00640 1 -- 172.21.15.55:0/63949733 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b540acc70 con 0x55cc206256d0 2024-04-02T07:22:32.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b53e00640 1 -- 172.21.15.55:0/63949733 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b540c6070 con 0x55cc206256d0 2024-04-02T07:22:32.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b53e00640 1 -- 172.21.15.55:0/63949733 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54003620 con 0x55cc206256d0 2024-04-02T07:22:32.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b71aba000 1 -- 172.21.15.55:0/63949733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc206256d0 msgr2=0x55cc205daf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:32.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b71aba000 1 --2- 172.21.15.55:0/63949733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc206256d0 0x55cc205daf80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400e330 tx=0x7f7b54004740 comp rx=0 tx=0).stop 2024-04-02T07:22:32.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b71aba000 1 -- 172.21.15.55:0/63949733 shutdown_connections 2024-04-02T07:22:32.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b71aba000 1 --2- 172.21.15.55:0/63949733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc205db4c0 0x55cc205db8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b71aba000 1 --2- 172.21.15.55:0/63949733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc206256d0 0x55cc205daf80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b71aba000 1 --2- 172.21.15.55:0/63949733 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc20624db0 0x55cc20625190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b71aba000 1 -- 172.21.15.55:0/63949733 >> 172.21.15.55:0/63949733 conn(0x55cc205e1830 msgr2=0x55cc205d9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:32.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b71aba000 1 -- 172.21.15.55:0/63949733 shutdown_connections 2024-04-02T07:22:32.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b71aba000 1 -- 172.21.15.55:0/63949733 wait complete. 2024-04-02T07:22:32.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b71aba000 1 -- start start 2024-04-02T07:22:32.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b71aba000 1 Processor -- start 2024-04-02T07:22:32.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b71aba000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc205db4c0 0x55cc20624770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:32.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b71aba000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc20624db0 0x55cc205df230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:32.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b71aba000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc206256d0 0x55cc205df770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:32.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b71aba000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc204299b0 con 0x55cc20624db0 2024-04-02T07:22:32.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b71aba000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc203c8c00 con 0x55cc205db4c0 2024-04-02T07:22:32.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b71aba000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc203e7070 con 0x55cc206256d0 2024-04-02T07:22:32.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b71aba000 10 client.0 _ll_register_callbacks cb 0x55cc205c70e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:22:32.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b66a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc20624db0 0x55cc205df230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:32.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b66a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc20624db0 0x55cc205df230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32934/0 (socket says 172.21.15.55:32934) 2024-04-02T07:22:32.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b66a00640 1 -- 172.21.15.55:0/3929303955 learned_addr learned my addr 172.21.15.55:0/3929303955 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:32.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b67400640 1 --2- 172.21.15.55:0/3929303955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc205db4c0 0x55cc20624770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:32.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b67e00640 1 --2- 172.21.15.55:0/3929303955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc206256d0 0x55cc205df770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:32.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b66a00640 1 -- 172.21.15.55:0/3929303955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc206256d0 msgr2=0x55cc205df770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:32.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b66a00640 1 --2- 172.21.15.55:0/3929303955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc206256d0 0x55cc205df770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b66a00640 1 -- 172.21.15.55:0/3929303955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc205db4c0 msgr2=0x55cc20624770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:32.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b66a00640 1 --2- 172.21.15.55:0/3929303955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc205db4c0 0x55cc20624770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b66a00640 1 -- 172.21.15.55:0/3929303955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b540bc070 con 0x55cc20624db0 2024-04-02T07:22:32.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b66a00640 1 --2- 172.21.15.55:0/3929303955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc20624db0 0x55cc205df230 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7b54006f10 tx=0x7f7b5401cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e6a590a9668952 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b50c00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:22:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b50c00640 1 -- 172.21.15.55:0/3929303955 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b540acb70 con 0x55cc20624db0 2024-04-02T07:22:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b50c00640 1 -- 172.21.15.55:0/3929303955 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b540accd0 con 0x55cc20624db0 2024-04-02T07:22:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.593+0000 7f7b71aba000 1 -- 172.21.15.55:0/3929303955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc203e65f0 con 0x55cc20624db0 2024-04-02T07:22:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b50c00640 1 -- 172.21.15.55:0/3929303955 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b540aced0 con 0x55cc20624db0 2024-04-02T07:22:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b71aba000 10 client.4626 fetch_fsmap learned FSMap version 8 2024-04-02T07:22:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b71aba000 1 -- 172.21.15.55:0/3929303955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55cc203eeab0 con 0x55cc20624db0 2024-04-02T07:22:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b50c00640 1 -- 172.21.15.55:0/3929303955 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cc203e65f0 con 0x55cc20624db0 2024-04-02T07:22:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b50c00640 1 -- 172.21.15.55:0/3929303955 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7b54003620 con 0x55cc20624db0 2024-04-02T07:22:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b71aba000 10 client.4626 fetch_fsmap finished waiting for FSMap version 8 2024-04-02T07:22:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b71aba000 10 client.4626 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-02T07:22:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b71aba000 20 client.4626 populate_metadata read hostname 'smithi055' 2024-04-02T07:22:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b71aba000 1 --2- 172.21.15.55:0/3929303955 >> [v2:172.21.15.106:6834/3829467285,v1:172.21.15.106:6836/3829467285] conn(0x55cc205e0510 0x55cc20636240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:32.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b71aba000 4 client.4626 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:22:32.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b71aba000 1 -- 172.21.15.55:0/3929303955 --> [v2:172.21.15.106:6834/3829467285,v1:172.21.15.106:6836/3829467285] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cc20426790 con 0x55cc205e0510 2024-04-02T07:22:32.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b67400640 1 --2- 172.21.15.55:0/3929303955 >> [v2:172.21.15.106:6834/3829467285,v1:172.21.15.106:6836/3829467285] conn(0x55cc205e0510 0x55cc20636240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:32.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b67400640 1 --2- 172.21.15.55:0/3929303955 >> [v2:172.21.15.106:6834/3829467285,v1:172.21.15.106:6836/3829467285] conn(0x55cc205e0510 0x55cc20636240 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14abf269f6c379b server_cookie=c5eb08517b357790 in_seq=0 out_seq=0 2024-04-02T07:22:32.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b50c00640 10 client.4626 ms_handle_connect on v2:172.21.15.106:6834/3829467285 2024-04-02T07:22:32.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b50c00640 1 -- 172.21.15.55:0/3929303955 <== mds.0 v2:172.21.15.106:6834/3829467285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55cc20426790 con 0x55cc205e0510 2024-04-02T07:22:32.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b50c00640 10 client.4626 handle_command_reply: tid=0 2024-04-02T07:22:32.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b71aba000 1 client.4626 shutdown 2024-04-02T07:22:32.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b71aba000 1 -- 172.21.15.55:0/3929303955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc20624db0 msgr2=0x55cc205df230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:32.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b71aba000 1 --2- 172.21.15.55:0/3929303955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc20624db0 0x55cc205df230 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7b54006f10 tx=0x7f7b5401cef0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b71aba000 1 -- 172.21.15.55:0/3929303955 shutdown_connections 2024-04-02T07:22:32.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b71aba000 1 --2- 172.21.15.55:0/3929303955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc206256d0 0x55cc205df770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b71aba000 1 --2- 172.21.15.55:0/3929303955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc20624db0 0x55cc205df230 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b71aba000 1 --2- 172.21.15.55:0/3929303955 >> [v2:172.21.15.106:6834/3829467285,v1:172.21.15.106:6836/3829467285] conn(0x55cc205e0510 0x55cc20636240 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b71aba000 1 --2- 172.21.15.55:0/3929303955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc205db4c0 0x55cc20624770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b71aba000 1 -- 172.21.15.55:0/3929303955 >> 172.21.15.55:0/3929303955 conn(0x55cc205e1830 msgr2=0x55cc205d9f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:32.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b50c00640 0 client.4626 ms_handle_reset on v2:172.21.15.106:6834/3829467285 2024-04-02T07:22:32.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b71aba000 1 -- 172.21.15.55:0/3929303955 shutdown_connections 2024-04-02T07:22:32.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b71aba000 1 -- 172.21.15.55:0/3929303955 wait complete. 2024-04-02T07:22:32.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.597+0000 7f7b71aba000 20 client.4626 trim_cache size 0 max 16384 2024-04-02T07:22:32.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.613+0000 7f7b71aba000 1 Processor -- start 2024-04-02T07:22:32.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.613+0000 7f7b71aba000 1 -- start start 2024-04-02T07:22:32.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.613+0000 7f7b71aba000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc205e1830 0x55cc2061e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:32.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.613+0000 7f7b71aba000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc205db4c0 0x55cc2061ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:32.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.613+0000 7f7b71aba000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc20624db0 0x55cc2061f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:32.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.613+0000 7f7b71aba000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc200e6940 con 0x55cc20624db0 2024-04-02T07:22:32.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.613+0000 7f7b71aba000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc2042d9b0 con 0x55cc205e1830 2024-04-02T07:22:32.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.613+0000 7f7b71aba000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc203e2f80 con 0x55cc205db4c0 2024-04-02T07:22:32.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.613+0000 7f7b67e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc20624db0 0x55cc2061f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:32.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.613+0000 7f7b67e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc20624db0 0x55cc2061f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32936/0 (socket says 172.21.15.55:32936) 2024-04-02T07:22:32.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.613+0000 7f7b67e00640 1 -- 172.21.15.55:0/3133067475 learned_addr learned my addr 172.21.15.55:0/3133067475 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:32.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.613+0000 7f7b67400640 1 --2- 172.21.15.55:0/3133067475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc205e1830 0x55cc2061e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:32.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.613+0000 7f7b66a00640 1 --2- 172.21.15.55:0/3133067475 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc205db4c0 0x55cc2061ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:32.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.613+0000 7f7b67e00640 1 -- 172.21.15.55:0/3133067475 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc205db4c0 msgr2=0x55cc2061ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:32.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.613+0000 7f7b67e00640 1 --2- 172.21.15.55:0/3133067475 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc205db4c0 0x55cc2061ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.613+0000 7f7b67e00640 1 -- 172.21.15.55:0/3133067475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc205e1830 msgr2=0x55cc2061e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:32.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.613+0000 7f7b67e00640 1 --2- 172.21.15.55:0/3133067475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc205e1830 0x55cc2061e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.613+0000 7f7b67e00640 1 -- 172.21.15.55:0/3133067475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cc203d4c00 con 0x55cc20624db0 2024-04-02T07:22:32.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.613+0000 7f7b67400640 1 --2- 172.21.15.55:0/3133067475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc205e1830 0x55cc2061e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:32.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b67e00640 1 --2- 172.21.15.55:0/3133067475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc20624db0 0x55cc2061f1f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7b60007120 tx=0x7f7b60001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9810fee1a759badb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:32.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b5cc00640 1 -- 172.21.15.55:0/3133067475 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b600166f0 con 0x55cc20624db0 2024-04-02T07:22:32.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b5cc00640 1 -- 172.21.15.55:0/3133067475 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b60016850 con 0x55cc20624db0 2024-04-02T07:22:32.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b5cc00640 1 -- 172.21.15.55:0/3133067475 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b60016bc0 con 0x55cc20624db0 2024-04-02T07:22:32.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b71aba000 1 -- 172.21.15.55:0/3133067475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc20624db0 msgr2=0x55cc2061f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:32.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b71aba000 1 --2- 172.21.15.55:0/3133067475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc20624db0 0x55cc2061f1f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7b60007120 tx=0x7f7b60001a20 comp rx=0 tx=0).stop 2024-04-02T07:22:32.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b71aba000 1 -- 172.21.15.55:0/3133067475 shutdown_connections 2024-04-02T07:22:32.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b71aba000 1 --2- 172.21.15.55:0/3133067475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc20624db0 0x55cc2061f1f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b71aba000 1 --2- 172.21.15.55:0/3133067475 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc205db4c0 0x55cc2061ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b71aba000 1 --2- 172.21.15.55:0/3133067475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc205e1830 0x55cc2061e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b71aba000 1 -- 172.21.15.55:0/3133067475 >> 172.21.15.55:0/3133067475 conn(0x55cc2063aad0 msgr2=0x55cc20636ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:32.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b71aba000 1 -- 172.21.15.55:0/3133067475 shutdown_connections 2024-04-02T07:22:32.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b71aba000 1 -- 172.21.15.55:0/3133067475 wait complete. 2024-04-02T07:22:32.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b71aba000 1 -- start start 2024-04-02T07:22:32.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b71aba000 1 Processor -- start 2024-04-02T07:22:32.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b71aba000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc205db4c0 0x55cc20683630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:32.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b71aba000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc205e1830 0x55cc20683b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:32.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b71aba000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc20624db0 0x55cc20621f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:32.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b71aba000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc2046cac0 con 0x55cc205e1830 2024-04-02T07:22:32.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b71aba000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cc203f0c60 con 0x55cc20624db0 2024-04-02T07:22:32.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b71aba000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cc205e0b20 con 0x55cc205db4c0 2024-04-02T07:22:32.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b71aba000 10 client.0 _ll_register_callbacks cb 0x55cc203ee590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:22:32.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b66a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc205e1830 0x55cc20683b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:32.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b66a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc205e1830 0x55cc20683b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32940/0 (socket says 172.21.15.55:32940) 2024-04-02T07:22:32.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b66a00640 1 -- 172.21.15.55:0/3997136309 learned_addr learned my addr 172.21.15.55:0/3997136309 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:32.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b67e00640 1 --2- 172.21.15.55:0/3997136309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc20624db0 0x55cc20621f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:32.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b66a00640 1 -- 172.21.15.55:0/3997136309 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc205db4c0 msgr2=0x55cc20683630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:32.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b67400640 1 --2- 172.21.15.55:0/3997136309 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc205db4c0 0x55cc20683630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:32.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b66a00640 1 --2- 172.21.15.55:0/3997136309 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc205db4c0 0x55cc20683630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b66a00640 1 -- 172.21.15.55:0/3997136309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc20624db0 msgr2=0x55cc20621f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:32.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b66a00640 1 --2- 172.21.15.55:0/3997136309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc20624db0 0x55cc20621f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b66a00640 1 -- 172.21.15.55:0/3997136309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4c003530 con 0x55cc205e1830 2024-04-02T07:22:32.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b67400640 1 --2- 172.21.15.55:0/3997136309 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc205db4c0 0x55cc20683630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:32.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b67e00640 1 --2- 172.21.15.55:0/3997136309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc20624db0 0x55cc20621f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:32.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b66a00640 1 --2- 172.21.15.55:0/3997136309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc205e1830 0x55cc20683b70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7b540bb040 tx=0x7f7b54009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdfdc93ec95b3fe1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:32.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.617+0000 7f7b50c00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:22:32.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b50c00640 1 -- 172.21.15.55:0/3997136309 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b54003b30 con 0x55cc205e1830 2024-04-02T07:22:32.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b50c00640 1 -- 172.21.15.55:0/3997136309 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b540ac420 con 0x55cc205e1830 2024-04-02T07:22:32.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 1 -- 172.21.15.55:0/3997136309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cc203f9460 con 0x55cc205e1830 2024-04-02T07:22:32.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b50c00640 1 -- 172.21.15.55:0/3997136309 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b540ac5e0 con 0x55cc205e1830 2024-04-02T07:22:32.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 10 client.4632 fetch_fsmap learned FSMap version 8 2024-04-02T07:22:32.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 1 -- 172.21.15.55:0/3997136309 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x55cc20125cc0 con 0x55cc205e1830 2024-04-02T07:22:32.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b50c00640 1 -- 172.21.15.55:0/3997136309 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55cc203f9460 con 0x55cc205e1830 2024-04-02T07:22:32.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b50c00640 1 -- 172.21.15.55:0/3997136309 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 8) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7b540059a0 con 0x55cc205e1830 2024-04-02T07:22:32.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 10 client.4632 fetch_fsmap finished waiting for FSMap version 8 2024-04-02T07:22:32.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 10 client.4632 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-02T07:22:32.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 20 client.4632 populate_metadata read hostname 'smithi055' 2024-04-02T07:22:32.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 1 --2- 172.21.15.55:0/3997136309 >> [v2:172.21.15.106:6834/3829467285,v1:172.21.15.106:6836/3829467285] conn(0x55cc206256d0 0x55cc206228c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:32.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 4 client.4632 mds_command: new command op to 4288 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-02T07:22:32.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 1 -- 172.21.15.55:0/3997136309 --> [v2:172.21.15.106:6834/3829467285,v1:172.21.15.106:6836/3829467285] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cc203f29c0 con 0x55cc206256d0 2024-04-02T07:22:32.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b67400640 1 --2- 172.21.15.55:0/3997136309 >> [v2:172.21.15.106:6834/3829467285,v1:172.21.15.106:6836/3829467285] conn(0x55cc206256d0 0x55cc206228c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:32.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b67400640 1 --2- 172.21.15.55:0/3997136309 >> [v2:172.21.15.106:6834/3829467285,v1:172.21.15.106:6836/3829467285] conn(0x55cc206256d0 0x55cc206228c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96a526038e332d94 server_cookie=2935f6dc86ecdecf in_seq=0 out_seq=0 2024-04-02T07:22:32.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b50c00640 10 client.4632 ms_handle_connect on v2:172.21.15.106:6834/3829467285 2024-04-02T07:22:32.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b50c00640 1 -- 172.21.15.55:0/3997136309 <== mds.0 v2:172.21.15.106:6834/3829467285 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x55cc203f29c0 con 0x55cc206256d0 2024-04-02T07:22:32.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b50c00640 10 client.4632 handle_command_reply: tid=0 2024-04-02T07:22:32.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 1 client.4632 shutdown 2024-04-02T07:22:32.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 1 -- 172.21.15.55:0/3997136309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc205e1830 msgr2=0x55cc20683b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:32.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 1 --2- 172.21.15.55:0/3997136309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc205e1830 0x55cc20683b70 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7b540bb040 tx=0x7f7b54009190 comp rx=0 tx=0).stop 2024-04-02T07:22:32.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 1 -- 172.21.15.55:0/3997136309 shutdown_connections 2024-04-02T07:22:32.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 1 --2- 172.21.15.55:0/3997136309 >> [v2:172.21.15.106:6834/3829467285,v1:172.21.15.106:6836/3829467285] conn(0x55cc206256d0 0x55cc206228c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 1 --2- 172.21.15.55:0/3997136309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cc20624db0 0x55cc20621f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 1 --2- 172.21.15.55:0/3997136309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cc205e1830 0x55cc20683b70 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b50c00640 0 client.4632 ms_handle_reset on v2:172.21.15.106:6834/3829467285 2024-04-02T07:22:32.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 1 --2- 172.21.15.55:0/3997136309 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cc205db4c0 0x55cc20683630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 1 -- 172.21.15.55:0/3997136309 >> 172.21.15.55:0/3997136309 conn(0x55cc2063aad0 msgr2=0x55cc206371d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:32.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 1 -- 172.21.15.55:0/3997136309 shutdown_connections 2024-04-02T07:22:32.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 1 -- 172.21.15.55:0/3997136309 wait complete. 2024-04-02T07:22:32.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b71aba000 20 client.4632 trim_cache size 0 max 16384 2024-04-02T07:22:32.630 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:22:32.630 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "642a0456-a2ac-49a4-91a5-3b3449b512da", 2024-04-02T07:22:32.630 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-02T07:22:32.630 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 4288, 2024-04-02T07:22:32.630 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-02T07:22:32.630 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-02T07:22:32.630 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-02T07:22:32.630 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 14.417239708, 2024-04-02T07:22:32.630 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 8, 2024-04-02T07:22:32.630 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 20, 2024-04-02T07:22:32.630 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 20, 2024-04-02T07:22:32.631 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 20.604966804 2024-04-02T07:22:32.631 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:22:32.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b6e600640 1 -- 172.21.15.55:0/3299268348 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b48066690 msgr2=0x7f7b48068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:32.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b6e600640 1 --2- 172.21.15.55:0/3299268348 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b48066690 0x7f7b48068b50 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7b540b0000 tx=0x7f7b540a9000 comp rx=0 tx=0).stop 2024-04-02T07:22:32.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b6e600640 1 -- 172.21.15.55:0/3299268348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b6806d1c0 msgr2=0x7f7b681497a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:32.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b6e600640 1 --2- 172.21.15.55:0/3299268348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b6806d1c0 0x7f7b681497a0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7b5800c3c0 tx=0x7f7b5800c880 comp rx=0 tx=0).stop 2024-04-02T07:22:32.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b6e600640 1 -- 172.21.15.55:0/3299268348 shutdown_connections 2024-04-02T07:22:32.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b6e600640 1 --2- 172.21.15.55:0/3299268348 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b48066690 0x7f7b48068b50 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b6e600640 1 --2- 172.21.15.55:0/3299268348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b681599c0 0x7f7b68146970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b6e600640 1 --2- 172.21.15.55:0/3299268348 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7b680b38f0 0x7f7b68145be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b6e600640 1 --2- 172.21.15.55:0/3299268348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b6806d1c0 0x7f7b681497a0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:32.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b6e600640 1 -- 172.21.15.55:0/3299268348 >> 172.21.15.55:0/3299268348 conn(0x7f7b68069d90 msgr2=0x7f7b680b0c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:32.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b6e600640 1 -- 172.21.15.55:0/3299268348 shutdown_connections 2024-04-02T07:22:32.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:32.621+0000 7f7b6e600640 1 -- 172.21.15.55:0/3299268348 wait complete. 2024-04-02T07:22:32.645 INFO:teuthology.run_tasks:Running task sequential... 2024-04-02T07:22:32.656 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-02T07:22:32.657 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-02T07:22:32.657 INFO:teuthology.task.print:Enabling mgr modules 2024-04-02T07:22:32.657 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-02T07:22:32.713 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-02T07:22:32.713 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-04-02T07:22:32.713 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-02T07:22:32.714 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-02T07:22:32.714 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-02T07:22:32.714 INFO:tasks.ceph_fuse:client.2 config is {} 2024-04-02T07:22:32.714 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-02T07:22:32.714 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-02T07:22:32.714 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-02T07:22:32.714 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-02T07:22:32.714 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-02T07:22:32.714 INFO:tasks.ceph_fuse:client.3 config is {} 2024-04-02T07:22:32.714 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-02T07:22:32.714 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-02T07:22:32.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:32.715 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-02T07:22:32.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:32.725 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2024-04-02T07:22:32.793 INFO:teuthology.orchestra.run.smithi055.stderr:Cannot find device "ceph-brx" 2024-04-02T07:22:32.795 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:22:32.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:32.796 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-04-02T07:22:32.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:32.806 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2024-04-02T07:22:32.873 INFO:teuthology.orchestra.run.smithi106.stderr:Cannot find device "ceph-brx" 2024-04-02T07:22:32.875 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:22:32.876 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-02T07:22:32.876 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-02T07:22:33.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.009+0000 7f300a800640 1 Processor -- start 2024-04-02T07:22:33.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f300a800640 1 -- start start 2024-04-02T07:22:33.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f300a800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30040b0700 0x7f300415d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:33.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f300a800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f300415dec0 con 0x7f30040cc030 2024-04-02T07:22:33.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f300a800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30040b35e0 con 0x7f3004159480 2024-04-02T07:22:33.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f300a800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3004159860 con 0x7f30040b0700 2024-04-02T07:22:33.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3008a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f30040cc030 0x7f30040b1460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49252/0 (socket says 172.21.15.55:49252) 2024-04-02T07:22:33.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3008a00640 1 -- 172.21.15.55:0/1689128314 learned_addr learned my addr 172.21.15.55:0/1689128314 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:33.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3009e00640 1 --2- 172.21.15.55:0/1689128314 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30040b0700 0x7f300415d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:33.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3003e00640 1 -- 172.21.15.55:0/1689128314 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221084953 0 0) 0x7f2ff0001120 con 0x7f30040cc030 2024-04-02T07:22:33.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3003e00640 1 -- 172.21.15.55:0/1689128314 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fec003530 con 0x7f30040cc030 2024-04-02T07:22:33.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3003e00640 1 -- 172.21.15.55:0/1689128314 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685727000 0 0) 0x7f30040b35e0 con 0x7f3004159480 2024-04-02T07:22:33.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3003e00640 1 -- 172.21.15.55:0/1689128314 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ff0001120 con 0x7f3004159480 2024-04-02T07:22:33.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3003e00640 1 -- 172.21.15.55:0/1689128314 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 289341296 0 0) 0x7f2fec003530 con 0x7f30040cc030 2024-04-02T07:22:33.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3003e00640 1 -- 172.21.15.55:0/1689128314 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30040b0700 msgr2=0x7f300415d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:33.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3003e00640 1 --2- 172.21.15.55:0/1689128314 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30040b0700 0x7f300415d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:33.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3003e00640 1 -- 172.21.15.55:0/1689128314 >> v1:172.21.15.106:6789/0 conn(0x7f3004159480 legacy=0x7f30040afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:33.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3003e00640 1 -- 172.21.15.55:0/1689128314 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30040b29d0 con 0x7f30040cc030 2024-04-02T07:22:33.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3003e00640 1 -- 172.21.15.55:0/1689128314 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f2ff0001790 con 0x7f30040cc030 2024-04-02T07:22:33.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3003e00640 1 -- 172.21.15.55:0/1689128314 >> v1:172.21.15.55:6789/0 conn(0x7f30040cc030 legacy=0x7f30040b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:33.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3003e00640 1 --2- 172.21.15.55:0/1689128314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fec003b40 0x7f2fec003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:33.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3003e00640 1 --2- 172.21.15.55:0/1689128314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fec0047d0 0x7f2fec004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:33.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3003e00640 1 --2- 172.21.15.55:0/1689128314 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30040b0700 0x7f2fec005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:33.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3003e00640 1 -- 172.21.15.55:0/1689128314 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3004159860 con 0x7f2fec003b40 2024-04-02T07:22:33.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3003e00640 1 -- 172.21.15.55:0/1689128314 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec00baa0 con 0x7f2fec0047d0 2024-04-02T07:22:33.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3003e00640 1 -- 172.21.15.55:0/1689128314 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fec00bc60 con 0x7f30040b0700 2024-04-02T07:22:33.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3009400640 1 --2- 172.21.15.55:0/1689128314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fec003b40 0x7f2fec003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:33.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3008a00640 1 --2- 172.21.15.55:0/1689128314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fec0047d0 0x7f2fec004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:33.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3009e00640 1 --2- 172.21.15.55:0/1689128314 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30040b0700 0x7f2fec005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:33.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3009400640 1 -- 172.21.15.55:0/1689128314 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30040b0700 msgr2=0x7f2fec005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:33.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3009400640 1 --2- 172.21.15.55:0/1689128314 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30040b0700 0x7f2fec005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:33.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3009400640 1 -- 172.21.15.55:0/1689128314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fec0047d0 msgr2=0x7f2fec004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:33.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3009400640 1 --2- 172.21.15.55:0/1689128314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fec0047d0 0x7f2fec004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:33.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3009400640 1 -- 172.21.15.55:0/1689128314 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fec003530 con 0x7f2fec003b40 2024-04-02T07:22:33.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.013+0000 7f3008a00640 1 --2- 172.21.15.55:0/1689128314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fec0047d0 0x7f2fec004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:33.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.017+0000 7f3009400640 1 --2- 172.21.15.55:0/1689128314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fec003b40 0x7f2fec003f40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80018d0 tx=0x7f2ff801c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6779ca273bd36d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:33.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.017+0000 7f3003e00640 1 -- 172.21.15.55:0/1689128314 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80052d0 con 0x7f2fec003b40 2024-04-02T07:22:33.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.017+0000 7f3003e00640 1 -- 172.21.15.55:0/1689128314 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff8005450 con 0x7f2fec003b40 2024-04-02T07:22:33.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.017+0000 7f3003e00640 1 -- 172.21.15.55:0/1689128314 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8003840 con 0x7f2fec003b40 2024-04-02T07:22:33.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.017+0000 7f300a800640 1 -- 172.21.15.55:0/1689128314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fec003b40 msgr2=0x7f2fec003f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:33.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.017+0000 7f300a800640 1 --2- 172.21.15.55:0/1689128314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fec003b40 0x7f2fec003f40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80018d0 tx=0x7f2ff801c550 comp rx=0 tx=0).stop 2024-04-02T07:22:33.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.017+0000 7f3009e00640 1 -- 172.21.15.55:0/1689128314 reap_dead start 2024-04-02T07:22:33.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.017+0000 7f300a800640 1 -- 172.21.15.55:0/1689128314 shutdown_connections 2024-04-02T07:22:33.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.017+0000 7f300a800640 1 -- 172.21.15.55:0/1689128314 >> 172.21.15.55:0/1689128314 conn(0x7f3004066080 msgr2=0x7f3004069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:33.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.017+0000 7f300a800640 1 -- 172.21.15.55:0/1689128314 shutdown_connections 2024-04-02T07:22:33.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.017+0000 7f300a800640 1 -- 172.21.15.55:0/1689128314 wait complete. 2024-04-02T07:22:33.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f300a800640 1 Processor -- start 2024-04-02T07:22:33.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f300a800640 1 -- start start 2024-04-02T07:22:33.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f300a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fec003b40 0x7f300414f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:33.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f300a800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30041f5130 0x7f3004150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:33.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f300a800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30041f55b0 0x7f30041510e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:33.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f300a800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3004151620 con 0x7f2fec003b40 2024-04-02T07:22:33.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f300a800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3004158130 con 0x7f30041f55b0 2024-04-02T07:22:33.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f300a800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300413db20 con 0x7f30041f5130 2024-04-02T07:22:33.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f3009400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fec003b40 0x7f300414f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:33.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f3009400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fec003b40 0x7f300414f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32968/0 (socket says 172.21.15.55:32968) 2024-04-02T07:22:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f3009400640 1 -- 172.21.15.55:0/3047108886 learned_addr learned my addr 172.21.15.55:0/3047108886 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f3008a00640 1 --2- 172.21.15.55:0/3047108886 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30041f5130 0x7f3004150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f3009e00640 1 --2- 172.21.15.55:0/3047108886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30041f55b0 0x7f30041510e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f3009400640 1 -- 172.21.15.55:0/3047108886 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30041f5130 msgr2=0x7f3004150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f3009400640 1 --2- 172.21.15.55:0/3047108886 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30041f5130 0x7f3004150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f3009400640 1 -- 172.21.15.55:0/3047108886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30041f55b0 msgr2=0x7f30041510e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f3009400640 1 --2- 172.21.15.55:0/3047108886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30041f55b0 0x7f30041510e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f3009400640 1 -- 172.21.15.55:0/3047108886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300413de00 con 0x7f2fec003b40 2024-04-02T07:22:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f3009e00640 1 --2- 172.21.15.55:0/3047108886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30041f55b0 0x7f30041510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f3009400640 1 --2- 172.21.15.55:0/3047108886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fec003b40 0x7f300414f2c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80ae040 tx=0x7f2fec005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f3001600640 1 -- 172.21.15.55:0/3047108886 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff80050d0 con 0x7f2fec003b40 2024-04-02T07:22:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f3001600640 1 -- 172.21.15.55:0/3047108886 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff8005230 con 0x7f2fec003b40 2024-04-02T07:22:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f3001600640 1 -- 172.21.15.55:0/3047108886 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff8006a00 con 0x7f2fec003b40 2024-04-02T07:22:33.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f300a800640 1 -- 172.21.15.55:0/3047108886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300413e0e0 con 0x7f2fec003b40 2024-04-02T07:22:33.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f300a800640 1 -- 172.21.15.55:0/3047108886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300415bdb0 con 0x7f2fec003b40 2024-04-02T07:22:33.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.021+0000 7f300a800640 1 -- 172.21.15.55:0/3047108886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30040738f0 con 0x7f2fec003b40 2024-04-02T07:22:33.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.025+0000 7f3001600640 1 -- 172.21.15.55:0/3047108886 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2ff80b2040 con 0x7f2fec003b40 2024-04-02T07:22:33.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.025+0000 7f3001600640 1 --2- 172.21.15.55:0/3047108886 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2fe4066680 0x7f2fe4068b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:33.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.025+0000 7f3001600640 1 -- 172.21.15.55:0/3047108886 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ff811da40 con 0x7f2fec003b40 2024-04-02T07:22:33.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.025+0000 7f3008a00640 1 --2- 172.21.15.55:0/3047108886 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2fe4066680 0x7f2fe4068b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:33.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.025+0000 7f3008a00640 1 --2- 172.21.15.55:0/3047108886 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2fe4066680 0x7f2fe4068b40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f30040cef50 tx=0x7f2ff0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:33.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.029+0000 7f3001600640 1 -- 172.21.15.55:0/3047108886 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2ff80ead30 con 0x7f2fec003b40 2024-04-02T07:22:33.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.225+0000 7f300a800640 1 -- 172.21.15.55:0/3047108886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3004073fa0 con 0x7f2fec003b40 2024-04-02T07:22:33.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.225+0000 7f3001600640 1 -- 172.21.15.55:0/3047108886 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2ff80c0020 con 0x7f2fec003b40 2024-04-02T07:22:33.229 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-02T07:22:33.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.225+0000 7f300a800640 1 -- 172.21.15.55:0/3047108886 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2fe4066680 msgr2=0x7f2fe4068b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:33.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.225+0000 7f300a800640 1 --2- 172.21.15.55:0/3047108886 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2fe4066680 0x7f2fe4068b40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f30040cef50 tx=0x7f2ff0009040 comp rx=0 tx=0).stop 2024-04-02T07:22:33.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.225+0000 7f300a800640 1 -- 172.21.15.55:0/3047108886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fec003b40 msgr2=0x7f300414f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:33.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.225+0000 7f300a800640 1 --2- 172.21.15.55:0/3047108886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fec003b40 0x7f300414f2c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2ff80ae040 tx=0x7f2fec005800 comp rx=0 tx=0).stop 2024-04-02T07:22:33.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.225+0000 7f300a800640 1 -- 172.21.15.55:0/3047108886 shutdown_connections 2024-04-02T07:22:33.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.225+0000 7f300a800640 1 --2- 172.21.15.55:0/3047108886 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2fe4066680 0x7f2fe4068b40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:33.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.225+0000 7f300a800640 1 --2- 172.21.15.55:0/3047108886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f30041f55b0 0x7f30041510e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:33.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.225+0000 7f300a800640 1 --2- 172.21.15.55:0/3047108886 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30041f5130 0x7f3004150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:33.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.225+0000 7f300a800640 1 --2- 172.21.15.55:0/3047108886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fec003b40 0x7f300414f2c0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:33.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.225+0000 7f300a800640 1 -- 172.21.15.55:0/3047108886 >> 172.21.15.55:0/3047108886 conn(0x7f3004066080 msgr2=0x7f3004154f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:33.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.225+0000 7f300a800640 1 -- 172.21.15.55:0/3047108886 shutdown_connections 2024-04-02T07:22:33.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:33.225+0000 7f300a800640 1 -- 172.21.15.55:0/3047108886 wait complete. 2024-04-02T07:22:33.251 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-02T07:22:33.251 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-02T07:22:33.251 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-02T07:22:33.251 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-02T07:22:33.251 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-02T07:22:33.251 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-02T07:22:33.251 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-02T07:22:33.251 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-02T07:22:33.251 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:22:33.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:33.252 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-02T07:22:33.260 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:22:33.260 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:22:33.260 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:22:33.261 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:33.261 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-02T07:22:33.261 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:33.261 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:22:33.261 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:33.261 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-02T07:22:33.261 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:22:33.261 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:33.261 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-02T07:22:33.261 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-02T07:22:33.261 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:33.261 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-02T07:22:33.261 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-02T07:22:33.262 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42441sec preferred_lft 42441sec 2024-04-02T07:22:33.262 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2024-04-02T07:22:33.262 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:33.262 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:22:33.262 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:33.262 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-02T07:22:33.262 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-02T07:22:33.262 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:81:5a:89:17 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:33.262 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-02T07:22:33.262 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:33.263 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-02T07:22:33.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:33.263 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:22:33.264 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:22:33.264 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add name ceph-brx type bridge 2024-04-02T07:22:33.264 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr flush dev ceph-brx 2024-04-02T07:22:33.264 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set ceph-brx up 2024-04-02T07:22:33.264 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-02T07:22:33.264 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:22:33.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:33.379 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-02T07:22:33.398 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:22:33.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:33.400 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-02T07:22:33.462 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-02T07:22:33.462 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-02T07:22:33.462 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-02T07:22:33.462 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-02T07:22:33.462 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-02T07:22:33.462 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-02T07:22:33.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:33.463 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:22:33.463 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:22:33.463 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-02T07:22:33.463 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-02T07:22:33.463 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-02T07:22:33.463 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:22:33.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:33.552 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-02T07:22:33.562 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:33.562 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list-id 2024-04-02T07:22:33.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:33.612 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:22:33.612 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:22:33.612 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-02T07:22:33.612 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-02T07:22:33.613 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:22:33.694 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-02T07:22:33.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:33.695 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:22:33.695 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:22:33.695 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-02T07:22:33.695 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-02T07:22:33.695 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-02T07:22:33.695 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-02T07:22:33.695 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-02T07:22:33.695 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:22:33.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:33.882 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:22:33.882 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:22:33.882 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-02T07:22:33.882 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set dev brx.0 master ceph-brx 2024-04-02T07:22:33.882 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:22:33.922 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-02T07:22:33.923 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:22:33.923 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-02T07:22:33.971 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:22:33.971 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:22:33.971 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:22:34.026 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:22:34.092 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:22:34.092 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:22:34.157 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:22:34.159 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:22:34.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:34.159 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:22:34.215 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-02T07:22:34.215 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-02T07:22:34.265 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:22:34.286 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:22:34.286 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:22:34.345 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:22:34.347 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:22:34.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:34.347 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:22:34.361 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:2024-04-02T07:22:34.357+0000 7f66ddfa0580 -1 init, newargv = 0x56340f91dd40 newargc=15 2024-04-02T07:22:34.361 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[34719]: starting ceph client 2024-04-02T07:22:34.369 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[34719]: starting fuse 2024-04-02T07:22:35.470 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:22:35.495 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:22:35.495 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:22:35.559 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:22:35.560 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:22:35.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:35.561 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:22:35.616 INFO:teuthology.orchestra.run.smithi055.stdout:43 2024-04-02T07:22:35.616 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-02T07:22:35.616 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:22:35.617 DEBUG:teuthology.orchestra.run.smithi055:> import glob 2024-04-02T07:22:35.617 DEBUG:teuthology.orchestra.run.smithi055:> import re 2024-04-02T07:22:35.617 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:22:35.617 DEBUG:teuthology.orchestra.run.smithi055:> import subprocess 2024-04-02T07:22:35.617 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:22:35.617 DEBUG:teuthology.orchestra.run.smithi055:> def _find_admin_socket(client_name): 2024-04-02T07:22:35.617 DEBUG:teuthology.orchestra.run.smithi055:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-02T07:22:35.617 DEBUG:teuthology.orchestra.run.smithi055:> files = glob.glob(asok_path) 2024-04-02T07:22:35.617 DEBUG:teuthology.orchestra.run.smithi055:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-02T07:22:35.617 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:22:35.617 DEBUG:teuthology.orchestra.run.smithi055:> # Given a non-glob path, it better be there 2024-04-02T07:22:35.617 DEBUG:teuthology.orchestra.run.smithi055:> if "*" not in asok_path: 2024-04-02T07:22:35.617 DEBUG:teuthology.orchestra.run.smithi055:> assert(len(files) == 1) 2024-04-02T07:22:35.617 DEBUG:teuthology.orchestra.run.smithi055:> return files[0] 2024-04-02T07:22:35.617 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:22:35.617 DEBUG:teuthology.orchestra.run.smithi055:> for f in files: 2024-04-02T07:22:35.618 DEBUG:teuthology.orchestra.run.smithi055:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-02T07:22:35.618 DEBUG:teuthology.orchestra.run.smithi055:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-02T07:22:35.618 DEBUG:teuthology.orchestra.run.smithi055:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-02T07:22:35.618 DEBUG:teuthology.orchestra.run.smithi055:> contents = proc_f.read() 2024-04-02T07:22:35.618 DEBUG:teuthology.orchestra.run.smithi055:> if mountpoint in contents: 2024-04-02T07:22:35.618 DEBUG:teuthology.orchestra.run.smithi055:> return f 2024-04-02T07:22:35.618 DEBUG:teuthology.orchestra.run.smithi055:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-02T07:22:35.618 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:22:35.618 DEBUG:teuthology.orchestra.run.smithi055:> print(_find_admin_socket("client.0")) 2024-04-02T07:22:35.618 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:22:35.747 INFO:teuthology.orchestra.run.smithi055.stdout:/var/run/ceph/ceph-client.0.34719.asok 2024-04-02T07:22:35.930 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.34719.asok 2024-04-02T07:22:35.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:35.930 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.34719.asok status 2024-04-02T07:22:36.112 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:22:36.112 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": { 2024-04-02T07:22:36.112 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_sha1": "d0e392d9aee635f2b65768c460c7a151ead7a5e2", 2024-04-02T07:22:36.112 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)", 2024-04-02T07:22:36.112 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "0", 2024-04-02T07:22:36.112 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2024-04-02T07:22:36.112 INFO:teuthology.orchestra.run.smithi055.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-02T07:22:36.112 INFO:teuthology.orchestra.run.smithi055.stdout: "pid": "34719", 2024-04-02T07:22:36.112 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2024-04-02T07:22:36.113 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:22:36.113 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_count": 0, 2024-04-02T07:22:36.113 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_pinned_count": 0, 2024-04-02T07:22:36.113 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 4647, 2024-04-02T07:22:36.113 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": { 2024-04-02T07:22:36.113 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2024-04-02T07:22:36.113 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2024-04-02T07:22:36.113 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 4647 2024-04-02T07:22:36.113 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:22:36.113 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:22:36.113 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:22:36.113 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:22:36.114 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 2680757387 2024-04-02T07:22:36.114 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:22:36.114 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:22:36.114 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:22:36.114 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:22:36.114 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:22:36.114 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 2680757387 2024-04-02T07:22:36.114 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:22:36.114 INFO:teuthology.orchestra.run.smithi055.stdout: "inst_str": "client.4647 192.168.0.1:0/2680757387", 2024-04-02T07:22:36.114 INFO:teuthology.orchestra.run.smithi055.stdout: "addr_str": "192.168.0.1:0/2680757387", 2024-04-02T07:22:36.114 INFO:teuthology.orchestra.run.smithi055.stdout: "inode_count": 1, 2024-04-02T07:22:36.114 INFO:teuthology.orchestra.run.smithi055.stdout: "mds_epoch": 8, 2024-04-02T07:22:36.114 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch": 20, 2024-04-02T07:22:36.114 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch_barrier": 0, 2024-04-02T07:22:36.115 INFO:teuthology.orchestra.run.smithi055.stdout: "blocklisted": false, 2024-04-02T07:22:36.115 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs" 2024-04-02T07:22:36.115 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:22:36.128 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-02T07:22:36.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f62c00640 1 Processor -- start 2024-04-02T07:22:36.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f62c00640 1 -- start start 2024-04-02T07:22:36.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f62c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f5c099120 0x7f6f5c0b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:36.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f62c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5c15ce50 con 0x7f6f5c15ca70 2024-04-02T07:22:36.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f62c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f5c0cef60 con 0x7f6f5c06aff0 2024-04-02T07:22:36.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f62c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c06bd60 con 0x7f6f5c099120 2024-04-02T07:22:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f5be00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6f5c15ca70 0x7f6f5c098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49140/0 (socket says 172.21.15.55:49140) 2024-04-02T07:22:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f5be00640 1 -- 172.21.15.55:0/581978029 learned_addr learned my addr 172.21.15.55:0/581978029 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f5b400640 1 --2- 172.21.15.55:0/581978029 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f5c099120 0x7f6f5c0b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f5aa00640 1 -- 172.21.15.55:0/581978029 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606906585 0 0) 0x7f6f5c15ce50 con 0x7f6f5c15ca70 2024-04-02T07:22:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f5aa00640 1 -- 172.21.15.55:0/581978029 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f40003530 con 0x7f6f5c15ca70 2024-04-02T07:22:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f5aa00640 1 -- 172.21.15.55:0/581978029 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2202740534 0 0) 0x7f6f5c0cef60 con 0x7f6f5c06aff0 2024-04-02T07:22:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f5aa00640 1 -- 172.21.15.55:0/581978029 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6f5c15ce50 con 0x7f6f5c06aff0 2024-04-02T07:22:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f5aa00640 1 -- 172.21.15.55:0/581978029 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 909531895 0 0) 0x7f6f40003530 con 0x7f6f5c15ca70 2024-04-02T07:22:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f5aa00640 1 -- 172.21.15.55:0/581978029 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f5c099120 msgr2=0x7f6f5c0b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f5aa00640 1 --2- 172.21.15.55:0/581978029 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f5c099120 0x7f6f5c0b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f5aa00640 1 -- 172.21.15.55:0/581978029 >> v1:172.21.15.106:6789/0 conn(0x7f6f5c06aff0 legacy=0x7f6f5c06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f5aa00640 1 -- 172.21.15.55:0/581978029 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c06c040 con 0x7f6f5c15ca70 2024-04-02T07:22:36.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f5aa00640 1 -- 172.21.15.55:0/581978029 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f6f4c001680 con 0x7f6f5c15ca70 2024-04-02T07:22:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f5aa00640 1 -- 172.21.15.55:0/581978029 >> v1:172.21.15.55:6789/0 conn(0x7f6f5c15ca70 legacy=0x7f6f5c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f5aa00640 1 --2- 172.21.15.55:0/581978029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f40003b40 0x7f6f40003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f5aa00640 1 --2- 172.21.15.55:0/581978029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f400047d0 0x7f6f40004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f5aa00640 1 --2- 172.21.15.55:0/581978029 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f5c099120 0x7f6f40005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f5aa00640 1 -- 172.21.15.55:0/581978029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c06bd60 con 0x7f6f400047d0 2024-04-02T07:22:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f5aa00640 1 -- 172.21.15.55:0/581978029 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4000ba40 con 0x7f6f40003b40 2024-04-02T07:22:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.265+0000 7f6f5aa00640 1 -- 172.21.15.55:0/581978029 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f4000bbd0 con 0x7f6f5c099120 2024-04-02T07:22:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.269+0000 7f6f5b400640 1 --2- 172.21.15.55:0/581978029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f400047d0 0x7f6f40004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.269+0000 7f6f5be00640 1 --2- 172.21.15.55:0/581978029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f40003b40 0x7f6f40003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.269+0000 7f6f60c00640 1 --2- 172.21.15.55:0/581978029 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f5c099120 0x7f6f40005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.269+0000 7f6f5b400640 1 -- 172.21.15.55:0/581978029 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f5c099120 msgr2=0x7f6f40005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.269+0000 7f6f5b400640 1 --2- 172.21.15.55:0/581978029 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f5c099120 0x7f6f40005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.269+0000 7f6f5b400640 1 -- 172.21.15.55:0/581978029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f40003b40 msgr2=0x7f6f40003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.269+0000 7f6f5b400640 1 --2- 172.21.15.55:0/581978029 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f40003b40 0x7f6f40003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:36.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.269+0000 7f6f5b400640 1 -- 172.21.15.55:0/581978029 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f40003530 con 0x7f6f400047d0 2024-04-02T07:22:36.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.273+0000 7f6f5b400640 1 --2- 172.21.15.55:0/581978029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f400047d0 0x7f6f40004c50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009ae0 tx=0x7f6f4801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12682d182130a578 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.273+0000 7f6f5aa00640 1 -- 172.21.15.55:0/581978029 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f480a5600 con 0x7f6f400047d0 2024-04-02T07:22:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.273+0000 7f6f5aa00640 1 -- 172.21.15.55:0/581978029 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f480a5760 con 0x7f6f400047d0 2024-04-02T07:22:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.273+0000 7f6f5aa00640 1 -- 172.21.15.55:0/581978029 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f480a5b10 con 0x7f6f400047d0 2024-04-02T07:22:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.273+0000 7f6f62c00640 1 -- 172.21.15.55:0/581978029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f400047d0 msgr2=0x7f6f40004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.273+0000 7f6f62c00640 1 --2- 172.21.15.55:0/581978029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f400047d0 0x7f6f40004c50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009ae0 tx=0x7f6f4801ca10 comp rx=0 tx=0).stop 2024-04-02T07:22:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.273+0000 7f6f60c00640 1 -- 172.21.15.55:0/581978029 reap_dead start 2024-04-02T07:22:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.273+0000 7f6f62c00640 1 -- 172.21.15.55:0/581978029 shutdown_connections 2024-04-02T07:22:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.273+0000 7f6f62c00640 1 -- 172.21.15.55:0/581978029 >> 172.21.15.55:0/581978029 conn(0x7f6f5c0b21d0 msgr2=0x7f6f5c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.273+0000 7f6f62c00640 1 -- 172.21.15.55:0/581978029 shutdown_connections 2024-04-02T07:22:36.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.273+0000 7f6f62c00640 1 -- 172.21.15.55:0/581978029 wait complete. 2024-04-02T07:22:36.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.273+0000 7f6f62c00640 1 Processor -- start 2024-04-02T07:22:36.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.273+0000 7f6f62c00640 1 -- start start 2024-04-02T07:22:36.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.273+0000 7f6f62c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f400047d0 0x7f6f5c15db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:36.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.273+0000 7f6f62c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f5c15e370 0x7f6f5c151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:36.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.273+0000 7f6f62c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f5c1595f0 0x7f6f5c159a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:36.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.273+0000 7f6f62c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c159fb0 con 0x7f6f5c15e370 2024-04-02T07:22:36.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.273+0000 7f6f62c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c152350 con 0x7f6f400047d0 2024-04-02T07:22:36.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.273+0000 7f6f62c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5c15e7f0 con 0x7f6f5c1595f0 2024-04-02T07:22:36.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.273+0000 7f6f5b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f5c15e370 0x7f6f5c151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:36.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.277+0000 7f6f5b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f5c15e370 0x7f6f5c151e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53618/0 (socket says 172.21.15.55:53618) 2024-04-02T07:22:36.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.277+0000 7f6f5b400640 1 -- 172.21.15.55:0/671147687 learned_addr learned my addr 172.21.15.55:0/671147687 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:36.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.277+0000 7f6f5be00640 1 --2- 172.21.15.55:0/671147687 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f400047d0 0x7f6f5c15db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:36.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.277+0000 7f6f60c00640 1 --2- 172.21.15.55:0/671147687 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f5c1595f0 0x7f6f5c159a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:36.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.277+0000 7f6f5b400640 1 -- 172.21.15.55:0/671147687 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f5c1595f0 msgr2=0x7f6f5c159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:36.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.277+0000 7f6f5b400640 1 --2- 172.21.15.55:0/671147687 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f5c1595f0 0x7f6f5c159a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:36.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.277+0000 7f6f5b400640 1 -- 172.21.15.55:0/671147687 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f400047d0 msgr2=0x7f6f5c15db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:36.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.277+0000 7f6f5b400640 1 --2- 172.21.15.55:0/671147687 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f400047d0 0x7f6f5c15db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:36.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.277+0000 7f6f5b400640 1 -- 172.21.15.55:0/671147687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f5c15eac0 con 0x7f6f5c15e370 2024-04-02T07:22:36.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.277+0000 7f6f5b400640 1 --2- 172.21.15.55:0/671147687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f5c15e370 0x7f6f5c151e10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009ae0 tx=0x7f6f40005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:36.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.277+0000 7f6f53e00640 1 -- 172.21.15.55:0/671147687 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f48004230 con 0x7f6f5c15e370 2024-04-02T07:22:36.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.277+0000 7f6f53e00640 1 -- 172.21.15.55:0/671147687 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f48004390 con 0x7f6f5c15e370 2024-04-02T07:22:36.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.277+0000 7f6f62c00640 1 -- 172.21.15.55:0/671147687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5c155b80 con 0x7f6f5c15e370 2024-04-02T07:22:36.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.277+0000 7f6f53e00640 1 -- 172.21.15.55:0/671147687 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f480ad850 con 0x7f6f5c15e370 2024-04-02T07:22:36.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.277+0000 7f6f62c00640 1 -- 172.21.15.55:0/671147687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5c156140 con 0x7f6f5c15e370 2024-04-02T07:22:36.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.277+0000 7f6f62c00640 1 -- 172.21.15.55:0/671147687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5c066c90 con 0x7f6f5c15e370 2024-04-02T07:22:36.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.277+0000 7f6f53e00640 1 -- 172.21.15.55:0/671147687 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6f480b4040 con 0x7f6f5c15e370 2024-04-02T07:22:36.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.277+0000 7f6f53e00640 1 --2- 172.21.15.55:0/671147687 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6f3c066690 0x7f6f3c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:36.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.277+0000 7f6f53e00640 1 -- 172.21.15.55:0/671147687 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6f4811dff0 con 0x7f6f5c15e370 2024-04-02T07:22:36.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.281+0000 7f6f5be00640 1 --2- 172.21.15.55:0/671147687 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6f3c066690 0x7f6f3c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:36.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.281+0000 7f6f5be00640 1 --2- 172.21.15.55:0/671147687 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6f3c066690 0x7f6f3c068b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c15be90 tx=0x7f6f4c001e30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:36.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.285+0000 7f6f53e00640 1 -- 172.21.15.55:0/671147687 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6f480eb3d0 con 0x7f6f5c15e370 2024-04-02T07:22:36.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.481+0000 7f6f62c00640 1 -- 172.21.15.55:0/671147687 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f6f5c15c2a0 con 0x7f6f5c15e370 2024-04-02T07:22:36.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.481+0000 7f6f53e00640 1 -- 172.21.15.55:0/671147687 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f6f480ee9f0 con 0x7f6f5c15e370 2024-04-02T07:22:36.484 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-02T07:22:36.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.481+0000 7f6f62c00640 1 -- 172.21.15.55:0/671147687 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6f3c066690 msgr2=0x7f6f3c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:36.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.481+0000 7f6f62c00640 1 --2- 172.21.15.55:0/671147687 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6f3c066690 0x7f6f3c068b50 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6f5c15be90 tx=0x7f6f4c001e30 comp rx=0 tx=0).stop 2024-04-02T07:22:36.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.481+0000 7f6f62c00640 1 -- 172.21.15.55:0/671147687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f5c15e370 msgr2=0x7f6f5c151e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:36.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.481+0000 7f6f62c00640 1 --2- 172.21.15.55:0/671147687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f5c15e370 0x7f6f5c151e10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6f48009ae0 tx=0x7f6f40005800 comp rx=0 tx=0).stop 2024-04-02T07:22:36.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.481+0000 7f6f62c00640 1 -- 172.21.15.55:0/671147687 shutdown_connections 2024-04-02T07:22:36.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.481+0000 7f6f62c00640 1 --2- 172.21.15.55:0/671147687 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6f5c1595f0 0x7f6f5c159a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:36.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.481+0000 7f6f62c00640 1 --2- 172.21.15.55:0/671147687 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6f5c15e370 0x7f6f5c151e10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:36.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.481+0000 7f6f62c00640 1 --2- 172.21.15.55:0/671147687 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6f3c066690 0x7f6f3c068b50 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:36.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.481+0000 7f6f62c00640 1 --2- 172.21.15.55:0/671147687 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6f400047d0 0x7f6f5c15db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:36.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.481+0000 7f6f62c00640 1 -- 172.21.15.55:0/671147687 >> 172.21.15.55:0/671147687 conn(0x7f6f5c0b21d0 msgr2=0x7f6f5c0b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:36.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.481+0000 7f6f62c00640 1 -- 172.21.15.55:0/671147687 shutdown_connections 2024-04-02T07:22:36.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:36.481+0000 7f6f62c00640 1 -- 172.21.15.55:0/671147687 wait complete. 2024-04-02T07:22:36.505 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-02T07:22:36.505 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-02T07:22:36.505 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-02T07:22:36.505 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-04-02T07:22:36.506 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-04-02T07:22:36.506 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-02T07:22:36.506 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-02T07:22:36.506 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-02T07:22:36.506 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-04-02T07:22:36.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:36.506 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-02T07:22:36.515 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:22:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:22:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:22:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-02T07:22:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:36.516 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:22:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-02T07:22:36.516 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:22:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-02T07:22:36.516 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-02T07:22:36.516 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-02T07:22:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-02T07:22:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42438sec preferred_lft 42438sec 2024-04-02T07:22:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2024-04-02T07:22:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:36.517 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:22:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-02T07:22:36.517 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-02T07:22:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:81:5a:89:17 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-02T07:22:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:36.517 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:22:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:36.517 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-02T07:22:36.518 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:36.518 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-02T07:22:36.518 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:36.518 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:22:36.518 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-02T07:22:36.518 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-02T07:22:36.518 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:36.518 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:36.518 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-02T07:22:36.579 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:22:36.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:36.581 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-02T07:22:36.632 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-02T07:22:36.632 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-02T07:22:36.632 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-02T07:22:36.632 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-02T07:22:36.632 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-02T07:22:36.632 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-02T07:22:36.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:36.633 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:22:36.633 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:22:36.633 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-02T07:22:36.633 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-02T07:22:36.633 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-02T07:22:36.633 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:22:36.725 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:36.725 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-02T07:22:36.734 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-02T07:22:36.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:36.734 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list-id 2024-04-02T07:22:36.788 INFO:teuthology.orchestra.run.smithi055.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-04-02T07:22:36.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:36.788 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:22:36.788 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:22:36.788 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-02T07:22:36.788 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-04-02T07:22:36.788 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:22:36.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:36.871 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-02T07:22:36.939 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:22:36.939 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:22:36.939 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:22:36.940 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:36.940 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-02T07:22:36.940 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:36.940 INFO:teuthology.orchestra.run.smithi055.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:22:36.940 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 2e:a7:d7:8f:84:f5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-02T07:22:36.940 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-02T07:22:36.940 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:36.940 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::2ca7:d7ff:fe8f:84f5/64 scope link 2024-04-02T07:22:36.940 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:36.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:36.942 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-04-02T07:22:37.003 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:22:37.003 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:22:37.003 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:22:37.003 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:37.003 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-02T07:22:37.003 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:37.003 INFO:teuthology.orchestra.run.smithi055.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:22:37.004 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 2e:a7:d7:8f:84:f5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-02T07:22:37.004 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-02T07:22:37.004 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:37.004 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::2ca7:d7ff:fe8f:84f5/64 scope link 2024-04-02T07:22:37.004 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:37.005 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-04-02T07:22:37.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:37.005 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:22:37.005 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:22:37.005 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-04-02T07:22:37.005 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-02T07:22:37.006 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-04-02T07:22:37.006 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-04-02T07:22:37.006 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-04-02T07:22:37.006 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:22:37.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:37.143 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:22:37.143 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:22:37.143 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.1 up 2024-04-02T07:22:37.143 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set dev brx.1 master ceph-brx 2024-04-02T07:22:37.143 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:22:37.182 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-04-02T07:22:37.182 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:22:37.182 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-04-02T07:22:37.231 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-04-02T07:22:37.231 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:22:37.231 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-04-02T07:22:37.282 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:22:37.343 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:22:37.343 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:22:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:22:37.407 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:22:37.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:37.407 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:22:37.459 INFO:teuthology.orchestra.run.smithi055.stdout:43 2024-04-02T07:22:37.459 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2024-04-02T07:22:37.459 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-04-02T07:22:37.505 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:22:37.526 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:22:37.526 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:22:37.585 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:22:37.587 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:22:37.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:37.587 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:22:37.602 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi055.stderr:2024-04-02T07:22:37.597+0000 7f9d2b3f8580 -1 init, newargv = 0x5651b1dd9d70 newargc=15 2024-04-02T07:22:37.602 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi055.stderr:ceph-fuse[34858]: starting ceph client 2024-04-02T07:22:37.609 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi055.stderr:ceph-fuse[34858]: starting fuse 2024-04-02T07:22:37.610 INFO:teuthology.orchestra.run.smithi055.stdout:43 2024-04-02T07:22:37.611 INFO:teuthology.orchestra.run.smithi055.stdout:44 2024-04-02T07:22:37.612 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2024-04-02T07:22:37.612 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:22:37.612 DEBUG:teuthology.orchestra.run.smithi055:> import glob 2024-04-02T07:22:37.612 DEBUG:teuthology.orchestra.run.smithi055:> import re 2024-04-02T07:22:37.612 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:22:37.612 DEBUG:teuthology.orchestra.run.smithi055:> import subprocess 2024-04-02T07:22:37.612 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:22:37.612 DEBUG:teuthology.orchestra.run.smithi055:> def _find_admin_socket(client_name): 2024-04-02T07:22:37.612 DEBUG:teuthology.orchestra.run.smithi055:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-04-02T07:22:37.613 DEBUG:teuthology.orchestra.run.smithi055:> files = glob.glob(asok_path) 2024-04-02T07:22:37.613 DEBUG:teuthology.orchestra.run.smithi055:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-04-02T07:22:37.613 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:22:37.613 DEBUG:teuthology.orchestra.run.smithi055:> # Given a non-glob path, it better be there 2024-04-02T07:22:37.613 DEBUG:teuthology.orchestra.run.smithi055:> if "*" not in asok_path: 2024-04-02T07:22:37.613 DEBUG:teuthology.orchestra.run.smithi055:> assert(len(files) == 1) 2024-04-02T07:22:37.613 DEBUG:teuthology.orchestra.run.smithi055:> return files[0] 2024-04-02T07:22:37.613 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:22:37.613 DEBUG:teuthology.orchestra.run.smithi055:> for f in files: 2024-04-02T07:22:37.613 DEBUG:teuthology.orchestra.run.smithi055:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-02T07:22:37.613 DEBUG:teuthology.orchestra.run.smithi055:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-02T07:22:37.613 DEBUG:teuthology.orchestra.run.smithi055:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-02T07:22:37.613 DEBUG:teuthology.orchestra.run.smithi055:> contents = proc_f.read() 2024-04-02T07:22:37.613 DEBUG:teuthology.orchestra.run.smithi055:> if mountpoint in contents: 2024-04-02T07:22:37.613 DEBUG:teuthology.orchestra.run.smithi055:> return f 2024-04-02T07:22:37.613 DEBUG:teuthology.orchestra.run.smithi055:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-02T07:22:37.614 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:22:37.614 DEBUG:teuthology.orchestra.run.smithi055:> print(_find_admin_socket("client.2")) 2024-04-02T07:22:37.614 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:22:37.731 INFO:teuthology.orchestra.run.smithi055.stdout:/var/run/ceph/ceph-client.2.34858.asok 2024-04-02T07:22:37.916 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.34858.asok 2024-04-02T07:22:37.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:37.916 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.34858.asok status 2024-04-02T07:22:38.091 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:22:38.092 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": { 2024-04-02T07:22:38.092 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_sha1": "d0e392d9aee635f2b65768c460c7a151ead7a5e2", 2024-04-02T07:22:38.092 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)", 2024-04-02T07:22:38.092 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "2", 2024-04-02T07:22:38.092 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2024-04-02T07:22:38.092 INFO:teuthology.orchestra.run.smithi055.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-04-02T07:22:38.092 INFO:teuthology.orchestra.run.smithi055.stdout: "pid": "34858", 2024-04-02T07:22:38.092 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2024-04-02T07:22:38.092 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:22:38.092 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_count": 0, 2024-04-02T07:22:38.092 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_pinned_count": 0, 2024-04-02T07:22:38.092 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 4662, 2024-04-02T07:22:38.092 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": { 2024-04-02T07:22:38.093 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2024-04-02T07:22:38.093 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2024-04-02T07:22:38.093 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 4662 2024-04-02T07:22:38.093 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:22:38.093 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:22:38.093 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:22:38.093 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.2:0", 2024-04-02T07:22:38.093 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 2004277737 2024-04-02T07:22:38.093 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:22:38.093 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:22:38.093 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:22:38.093 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:22:38.093 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.2:0", 2024-04-02T07:22:38.093 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 2004277737 2024-04-02T07:22:38.094 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:22:38.094 INFO:teuthology.orchestra.run.smithi055.stdout: "inst_str": "client.4662 192.168.0.2:0/2004277737", 2024-04-02T07:22:38.094 INFO:teuthology.orchestra.run.smithi055.stdout: "addr_str": "192.168.0.2:0/2004277737", 2024-04-02T07:22:38.094 INFO:teuthology.orchestra.run.smithi055.stdout: "inode_count": 1, 2024-04-02T07:22:38.094 INFO:teuthology.orchestra.run.smithi055.stdout: "mds_epoch": 8, 2024-04-02T07:22:38.094 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch": 20, 2024-04-02T07:22:38.094 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch_barrier": 0, 2024-04-02T07:22:38.094 INFO:teuthology.orchestra.run.smithi055.stdout: "blocklisted": false, 2024-04-02T07:22:38.094 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs" 2024-04-02T07:22:38.094 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:22:38.106 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-02T07:22:38.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.241+0000 7f89bd000640 1 Processor -- start 2024-04-02T07:22:38.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.241+0000 7f89bd000640 1 -- start start 2024-04-02T07:22:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.245+0000 7f89bd000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89b80c4120 0x7f89b80b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.245+0000 7f89bd000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b813d0c0 con 0x7f89b80b36f0 2024-04-02T07:22:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.245+0000 7f89bd000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b80b3b20 con 0x7f89b8153ea0 2024-04-02T07:22:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.245+0000 7f89bd000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b815a2f0 con 0x7f89b80c4120 2024-04-02T07:22:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.245+0000 7f89afe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89b80c4120 0x7f89b80b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.245+0000 7f89afe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f89b80c4120 0x7f89b80b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53624/0 (socket says 172.21.15.55:53624) 2024-04-02T07:22:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.245+0000 7f89afe00640 1 -- 172.21.15.55:0/2367612689 learned_addr learned my addr 172.21.15.55:0/2367612689 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:38.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.245+0000 7f89afe00640 1 -- 172.21.15.55:0/2367612689 >> v1:172.21.15.106:6789/0 conn(0x7f89b8153ea0 legacy=0x7f89b8159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:38.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.245+0000 7f89afe00640 1 -- 172.21.15.55:0/2367612689 >> v1:172.21.15.55:6789/0 conn(0x7f89b80b36f0 legacy=0x7f89b813d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:38.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.245+0000 7f89afe00640 1 -- 172.21.15.55:0/2367612689 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b815a4f0 con 0x7f89b80c4120 2024-04-02T07:22:38.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.249+0000 7f89afe00640 1 --2- 172.21.15.55:0/2367612689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89b80c4120 0x7f89b80b31b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f89a0009870 tx=0x7f89a001e730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=891557258bc5b97f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:38.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.249+0000 7f89b5400640 1 -- 172.21.15.55:0/2367612689 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a00a8610 con 0x7f89b80c4120 2024-04-02T07:22:38.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.249+0000 7f89b5400640 1 -- 172.21.15.55:0/2367612689 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a00a8770 con 0x7f89b80c4120 2024-04-02T07:22:38.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.249+0000 7f89b5400640 1 -- 172.21.15.55:0/2367612689 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a00a8b00 con 0x7f89b80c4120 2024-04-02T07:22:38.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.249+0000 7f89bd000640 1 -- 172.21.15.55:0/2367612689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89b80c4120 msgr2=0x7f89b80b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:38.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.249+0000 7f89bd000640 1 --2- 172.21.15.55:0/2367612689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89b80c4120 0x7f89b80b31b0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f89a0009870 tx=0x7f89a001e730 comp rx=0 tx=0).stop 2024-04-02T07:22:38.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.249+0000 7f89bd000640 1 -- 172.21.15.55:0/2367612689 shutdown_connections 2024-04-02T07:22:38.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.249+0000 7f89bd000640 1 --2- 172.21.15.55:0/2367612689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89b80c4120 0x7f89b80b31b0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:38.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.249+0000 7f89bd000640 1 -- 172.21.15.55:0/2367612689 >> 172.21.15.55:0/2367612689 conn(0x7f89b8066080 msgr2=0x7f89b8069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:38.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.249+0000 7f89bd000640 1 -- 172.21.15.55:0/2367612689 shutdown_connections 2024-04-02T07:22:38.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.249+0000 7f89bd000640 1 -- 172.21.15.55:0/2367612689 wait complete. 2024-04-02T07:22:38.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.249+0000 7f89bd000640 1 Processor -- start 2024-04-02T07:22:38.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.249+0000 7f89bd000640 1 -- start start 2024-04-02T07:22:38.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.249+0000 7f89bd000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89b80b36f0 0x7f89b8154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:38.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.249+0000 7f89bd000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89b80c4120 0x7f89b8134aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:38.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.249+0000 7f89bd000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89b8153ea0 0x7f89b8134fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:38.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.249+0000 7f89bd000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b8154710 con 0x7f89b80c4120 2024-04-02T07:22:38.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.249+0000 7f89bd000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b8159080 con 0x7f89b8153ea0 2024-04-02T07:22:38.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.249+0000 7f89bd000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b81587e0 con 0x7f89b80b36f0 2024-04-02T07:22:38.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.253+0000 7f89afe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89b80c4120 0x7f89b8134aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:38.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.253+0000 7f89afe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89b80c4120 0x7f89b8134aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53628/0 (socket says 172.21.15.55:53628) 2024-04-02T07:22:38.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.253+0000 7f89afe00640 1 -- 172.21.15.55:0/2467116789 learned_addr learned my addr 172.21.15.55:0/2467116789 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:38.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.253+0000 7f89b5e00640 1 --2- 172.21.15.55:0/2467116789 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89b80b36f0 0x7f89b8154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:38.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.253+0000 7f89b6800640 1 --2- 172.21.15.55:0/2467116789 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89b8153ea0 0x7f89b8134fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:38.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.253+0000 7f89afe00640 1 -- 172.21.15.55:0/2467116789 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89b80b36f0 msgr2=0x7f89b8154e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:38.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.253+0000 7f89afe00640 1 --2- 172.21.15.55:0/2467116789 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89b80b36f0 0x7f89b8154e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:38.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.253+0000 7f89afe00640 1 -- 172.21.15.55:0/2467116789 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89b8153ea0 msgr2=0x7f89b8134fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:38.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.253+0000 7f89afe00640 1 --2- 172.21.15.55:0/2467116789 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89b8153ea0 0x7f89b8134fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:38.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.253+0000 7f89afe00640 1 -- 172.21.15.55:0/2467116789 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a00094d0 con 0x7f89b80c4120 2024-04-02T07:22:38.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.253+0000 7f89b6800640 1 --2- 172.21.15.55:0/2467116789 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89b8153ea0 0x7f89b8134fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:38.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.253+0000 7f89afe00640 1 --2- 172.21.15.55:0/2467116789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89b80c4120 0x7f89b8134aa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f89a001c360 tx=0x7f89a001b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:38.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.253+0000 7f89ae000640 1 -- 172.21.15.55:0/2467116789 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a00bb430 con 0x7f89b80c4120 2024-04-02T07:22:38.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.253+0000 7f89ae000640 1 -- 172.21.15.55:0/2467116789 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a00b6070 con 0x7f89b80c4120 2024-04-02T07:22:38.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.253+0000 7f89ae000640 1 -- 172.21.15.55:0/2467116789 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a00bb7d0 con 0x7f89b80c4120 2024-04-02T07:22:38.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.253+0000 7f89bd000640 1 -- 172.21.15.55:0/2467116789 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b8158ac0 con 0x7f89b80c4120 2024-04-02T07:22:38.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.253+0000 7f89bd000640 1 -- 172.21.15.55:0/2467116789 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b81553b0 con 0x7f89b80c4120 2024-04-02T07:22:38.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.253+0000 7f89bd000640 1 -- 172.21.15.55:0/2467116789 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b81555a0 con 0x7f89b80c4120 2024-04-02T07:22:38.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.253+0000 7f89ae000640 1 -- 172.21.15.55:0/2467116789 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f89a00b8030 con 0x7f89b80c4120 2024-04-02T07:22:38.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.257+0000 7f89ae000640 1 --2- 172.21.15.55:0/2467116789 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8994066690 0x7f8994068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:38.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.257+0000 7f89ae000640 1 -- 172.21.15.55:0/2467116789 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89a011dac0 con 0x7f89b80c4120 2024-04-02T07:22:38.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.257+0000 7f89b5e00640 1 --2- 172.21.15.55:0/2467116789 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8994066690 0x7f8994068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:38.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.257+0000 7f89b5e00640 1 --2- 172.21.15.55:0/2467116789 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8994066690 0x7f8994068b50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f89a8007fd0 tx=0x7f89a8007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:38.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.261+0000 7f89ae000640 1 -- 172.21.15.55:0/2467116789 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f89b81555a0 con 0x7f89b80c4120 2024-04-02T07:22:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.457+0000 7f89bd000640 1 -- 172.21.15.55:0/2467116789 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f89b81555a0 con 0x7f89b80c4120 2024-04-02T07:22:38.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.457+0000 7f89ae000640 1 -- 172.21.15.55:0/2467116789 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f89b81555a0 con 0x7f89b80c4120 2024-04-02T07:22:38.462 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-02T07:22:38.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.461+0000 7f89bd000640 1 -- 172.21.15.55:0/2467116789 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8994066690 msgr2=0x7f8994068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:38.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.461+0000 7f89bd000640 1 --2- 172.21.15.55:0/2467116789 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8994066690 0x7f8994068b50 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f89a8007fd0 tx=0x7f89a8007e40 comp rx=0 tx=0).stop 2024-04-02T07:22:38.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.461+0000 7f89bd000640 1 -- 172.21.15.55:0/2467116789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89b80c4120 msgr2=0x7f89b8134aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:38.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.461+0000 7f89bd000640 1 --2- 172.21.15.55:0/2467116789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89b80c4120 0x7f89b8134aa0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f89a001c360 tx=0x7f89a001b4d0 comp rx=0 tx=0).stop 2024-04-02T07:22:38.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.461+0000 7f89bd000640 1 -- 172.21.15.55:0/2467116789 shutdown_connections 2024-04-02T07:22:38.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.461+0000 7f89bd000640 1 --2- 172.21.15.55:0/2467116789 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8994066690 0x7f8994068b50 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:38.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.461+0000 7f89bd000640 1 --2- 172.21.15.55:0/2467116789 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89b8153ea0 0x7f89b8134fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:38.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.461+0000 7f89bd000640 1 --2- 172.21.15.55:0/2467116789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89b80c4120 0x7f89b8134aa0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:38.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.461+0000 7f89bd000640 1 --2- 172.21.15.55:0/2467116789 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89b80b36f0 0x7f89b8154e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:38.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.461+0000 7f89bd000640 1 -- 172.21.15.55:0/2467116789 >> 172.21.15.55:0/2467116789 conn(0x7f89b8066080 msgr2=0x7f89b80b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:38.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.461+0000 7f89bd000640 1 -- 172.21.15.55:0/2467116789 shutdown_connections 2024-04-02T07:22:38.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:38.461+0000 7f89bd000640 1 -- 172.21.15.55:0/2467116789 wait complete. 2024-04-02T07:22:38.484 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-02T07:22:38.484 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-02T07:22:38.484 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2024-04-02T07:22:38.484 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-02T07:22:38.484 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-02T07:22:38.484 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-02T07:22:38.484 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-02T07:22:38.485 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-02T07:22:38.485 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-02T07:22:38.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:38.485 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2024-04-02T07:22:38.495 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:22:38.495 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:22:38.495 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:22:38.495 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:38.495 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-04-02T07:22:38.495 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:38.495 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:22:38.496 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:38.496 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f0 2024-04-02T07:22:38.496 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:22:38.496 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:38.496 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f1 2024-04-02T07:22:38.496 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:22:38.496 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:38.496 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-02T07:22:38.496 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:38.496 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-02T07:22:38.496 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42445sec preferred_lft 42445sec 2024-04-02T07:22:38.496 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::ec4:7aff:fe8f:ce6d/64 scope link 2024-04-02T07:22:38.496 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:38.496 INFO:teuthology.orchestra.run.smithi106.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-02T07:22:38.496 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 02:42:a5:0e:5f:06 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:38.497 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-02T07:22:38.497 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:38.498 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-02T07:22:38.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:38.498 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-04-02T07:22:38.498 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-02T07:22:38.498 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add name ceph-brx type bridge 2024-04-02T07:22:38.498 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip addr flush dev ceph-brx 2024-04-02T07:22:38.499 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set ceph-brx up 2024-04-02T07:22:38.499 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-02T07:22:38.499 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-02T07:22:38.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:38.614 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-02T07:22:38.633 INFO:teuthology.orchestra.run.smithi106.stdout:1 2024-04-02T07:22:38.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:38.636 DEBUG:teuthology.orchestra.run.smithi106:> route 2024-04-02T07:22:38.703 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2024-04-02T07:22:38.704 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-02T07:22:38.704 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-02T07:22:38.704 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-02T07:22:38.704 INFO:teuthology.orchestra.run.smithi106.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-02T07:22:38.704 INFO:teuthology.orchestra.run.smithi106.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-02T07:22:38.704 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-02T07:22:38.704 INFO:teuthology.orchestra.run.smithi106.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-02T07:22:38.704 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-02T07:22:38.704 INFO:teuthology.orchestra.run.smithi106.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-02T07:22:38.704 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-02T07:22:38.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:38.705 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-04-02T07:22:38.705 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-02T07:22:38.705 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-02T07:22:38.705 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-02T07:22:38.705 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-02T07:22:38.705 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-02T07:22:38.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:38.793 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-04-02T07:22:38.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:38.802 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list-id 2024-04-02T07:22:38.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:38.857 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-04-02T07:22:38.857 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-02T07:22:38.857 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-02T07:22:38.857 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-02T07:22:38.857 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-02T07:22:38.938 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-02T07:22:38.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:38.939 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-04-02T07:22:38.939 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-02T07:22:38.939 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-02T07:22:38.939 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-02T07:22:38.939 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-02T07:22:38.939 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-02T07:22:38.939 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-02T07:22:38.939 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-02T07:22:39.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:39.099 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-04-02T07:22:39.099 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-02T07:22:39.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.0 up 2024-04-02T07:22:39.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set dev brx.0 master ceph-brx 2024-04-02T07:22:39.099 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-02T07:22:39.138 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-02T07:22:39.138 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:22:39.138 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-02T07:22:39.189 INFO:teuthology.orchestra.run.smithi106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-02T07:22:39.189 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:22:39.189 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-02T07:22:39.239 DEBUG:teuthology.orchestra.run.smithi106:> sudo modprobe fuse 2024-04-02T07:22:39.299 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:22:39.300 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:22:39.358 INFO:teuthology.orchestra.run.smithi106.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:22:39.359 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:22:39.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:39.360 DEBUG:teuthology.orchestra.run.smithi106:> ls /sys/fs/fuse/connections 2024-04-02T07:22:39.412 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-02T07:22:39.412 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-02T07:22:39.459 DEBUG:teuthology.orchestra.run.smithi106:> sudo modprobe fuse 2024-04-02T07:22:39.479 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:22:39.479 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:22:39.539 INFO:teuthology.orchestra.run.smithi106.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:22:39.541 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:22:39.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:39.541 DEBUG:teuthology.orchestra.run.smithi106:> ls /sys/fs/fuse/connections 2024-04-02T07:22:39.552 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi106.stderr:2024-04-02T07:22:39.547+0000 7f96c6248580 -1 init, newargv = 0x55fae17f6f90 newargc=15 2024-04-02T07:22:39.552 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi106.stderr:ceph-fuse[33046]: starting ceph client 2024-04-02T07:22:39.562 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi106.stderr:ceph-fuse[33046]: starting fuse 2024-04-02T07:22:40.662 DEBUG:teuthology.orchestra.run.smithi106:> sudo modprobe fuse 2024-04-02T07:22:40.684 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:22:40.684 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:22:40.746 INFO:teuthology.orchestra.run.smithi106.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:22:40.748 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:22:40.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:40.748 DEBUG:teuthology.orchestra.run.smithi106:> ls /sys/fs/fuse/connections 2024-04-02T07:22:40.800 INFO:teuthology.orchestra.run.smithi106.stdout:43 2024-04-02T07:22:40.800 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-02T07:22:40.801 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:22:40.801 DEBUG:teuthology.orchestra.run.smithi106:> import glob 2024-04-02T07:22:40.801 DEBUG:teuthology.orchestra.run.smithi106:> import re 2024-04-02T07:22:40.801 DEBUG:teuthology.orchestra.run.smithi106:> import os 2024-04-02T07:22:40.801 DEBUG:teuthology.orchestra.run.smithi106:> import subprocess 2024-04-02T07:22:40.801 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-02T07:22:40.801 DEBUG:teuthology.orchestra.run.smithi106:> def _find_admin_socket(client_name): 2024-04-02T07:22:40.801 DEBUG:teuthology.orchestra.run.smithi106:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-02T07:22:40.801 DEBUG:teuthology.orchestra.run.smithi106:> files = glob.glob(asok_path) 2024-04-02T07:22:40.801 DEBUG:teuthology.orchestra.run.smithi106:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-02T07:22:40.801 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-02T07:22:40.801 DEBUG:teuthology.orchestra.run.smithi106:> # Given a non-glob path, it better be there 2024-04-02T07:22:40.802 DEBUG:teuthology.orchestra.run.smithi106:> if "*" not in asok_path: 2024-04-02T07:22:40.802 DEBUG:teuthology.orchestra.run.smithi106:> assert(len(files) == 1) 2024-04-02T07:22:40.802 DEBUG:teuthology.orchestra.run.smithi106:> return files[0] 2024-04-02T07:22:40.802 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-02T07:22:40.802 DEBUG:teuthology.orchestra.run.smithi106:> for f in files: 2024-04-02T07:22:40.802 DEBUG:teuthology.orchestra.run.smithi106:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-02T07:22:40.802 DEBUG:teuthology.orchestra.run.smithi106:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-02T07:22:40.802 DEBUG:teuthology.orchestra.run.smithi106:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-02T07:22:40.803 DEBUG:teuthology.orchestra.run.smithi106:> contents = proc_f.read() 2024-04-02T07:22:40.803 DEBUG:teuthology.orchestra.run.smithi106:> if mountpoint in contents: 2024-04-02T07:22:40.803 DEBUG:teuthology.orchestra.run.smithi106:> return f 2024-04-02T07:22:40.803 DEBUG:teuthology.orchestra.run.smithi106:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-02T07:22:40.803 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-02T07:22:40.803 DEBUG:teuthology.orchestra.run.smithi106:> print(_find_admin_socket("client.1")) 2024-04-02T07:22:40.803 DEBUG:teuthology.orchestra.run.smithi106:> ' 2024-04-02T07:22:40.924 INFO:teuthology.orchestra.run.smithi106.stdout:/var/run/ceph/ceph-client.1.33046.asok 2024-04-02T07:22:41.109 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.33046.asok 2024-04-02T07:22:41.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:41.109 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.33046.asok status 2024-04-02T07:22:41.285 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-02T07:22:41.285 INFO:teuthology.orchestra.run.smithi106.stdout: "metadata": { 2024-04-02T07:22:41.285 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_sha1": "d0e392d9aee635f2b65768c460c7a151ead7a5e2", 2024-04-02T07:22:41.285 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_version": "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)", 2024-04-02T07:22:41.285 INFO:teuthology.orchestra.run.smithi106.stdout: "entity_id": "1", 2024-04-02T07:22:41.286 INFO:teuthology.orchestra.run.smithi106.stdout: "hostname": "smithi106", 2024-04-02T07:22:41.286 INFO:teuthology.orchestra.run.smithi106.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-02T07:22:41.286 INFO:teuthology.orchestra.run.smithi106.stdout: "pid": "33046", 2024-04-02T07:22:41.286 INFO:teuthology.orchestra.run.smithi106.stdout: "root": "/" 2024-04-02T07:22:41.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-02T07:22:41.286 INFO:teuthology.orchestra.run.smithi106.stdout: "dentry_count": 0, 2024-04-02T07:22:41.286 INFO:teuthology.orchestra.run.smithi106.stdout: "dentry_pinned_count": 0, 2024-04-02T07:22:41.286 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 4547, 2024-04-02T07:22:41.286 INFO:teuthology.orchestra.run.smithi106.stdout: "inst": { 2024-04-02T07:22:41.286 INFO:teuthology.orchestra.run.smithi106.stdout: "name": { 2024-04-02T07:22:41.286 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "client", 2024-04-02T07:22:41.286 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 4547 2024-04-02T07:22:41.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-02T07:22:41.286 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": { 2024-04-02T07:22:41.287 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-02T07:22:41.287 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:0", 2024-04-02T07:22:41.287 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1692607810 2024-04-02T07:22:41.287 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-02T07:22:41.287 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-02T07:22:41.287 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": { 2024-04-02T07:22:41.287 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-02T07:22:41.287 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:0", 2024-04-02T07:22:41.287 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 1692607810 2024-04-02T07:22:41.287 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-02T07:22:41.287 INFO:teuthology.orchestra.run.smithi106.stdout: "inst_str": "client.4547 172.21.15.106:0/1692607810", 2024-04-02T07:22:41.287 INFO:teuthology.orchestra.run.smithi106.stdout: "addr_str": "172.21.15.106:0/1692607810", 2024-04-02T07:22:41.287 INFO:teuthology.orchestra.run.smithi106.stdout: "inode_count": 1, 2024-04-02T07:22:41.287 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_epoch": 8, 2024-04-02T07:22:41.287 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_epoch": 20, 2024-04-02T07:22:41.288 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_epoch_barrier": 0, 2024-04-02T07:22:41.288 INFO:teuthology.orchestra.run.smithi106.stdout: "blocklisted": false, 2024-04-02T07:22:41.288 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs" 2024-04-02T07:22:41.288 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-02T07:22:41.301 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-02T07:22:41.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.449+0000 7fecbb400640 1 Processor -- start 2024-04-02T07:22:41.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.449+0000 7fecbb400640 1 -- start start 2024-04-02T07:22:41.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.449+0000 7fecbb400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fecb40cfdf0 0x7fecb406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:41.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.449+0000 7fecbb400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fecb40b16e0 0x7fecb40b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.449+0000 7fecbb400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb40d01d0 con 0x7fecb40b11f0 2024-04-02T07:22:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.449+0000 7fecbb400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb406c0e0 con 0x7fecb40b16e0 2024-04-02T07:22:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.449+0000 7fecbb400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40b01d0 con 0x7fecb40cfdf0 2024-04-02T07:22:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.453+0000 7fecabe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fecb40b16e0 0x7fecb40b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.453+0000 7fecabe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fecb40b16e0 0x7fecb40b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53634/0 (socket says 172.21.15.55:53634) 2024-04-02T07:22:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.453+0000 7fecabe00640 1 -- 172.21.15.55:0/1805751549 learned_addr learned my addr 172.21.15.55:0/1805751549 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.453+0000 7fecb8a00640 1 --2- 172.21.15.55:0/1805751549 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fecb40cfdf0 0x7fecb406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.453+0000 7fecabe00640 1 -- 172.21.15.55:0/1805751549 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fecb40cfdf0 msgr2=0x7fecb406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.453+0000 7fecabe00640 1 --2- 172.21.15.55:0/1805751549 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fecb40cfdf0 0x7fecb406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.453+0000 7fecb3e00640 1 -- 172.21.15.55:0/1805751549 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2273048566 0 0) 0x7fecac0014a0 con 0x7fecb40b11f0 2024-04-02T07:22:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.453+0000 7fecabe00640 1 -- 172.21.15.55:0/1805751549 >> v1:172.21.15.106:6789/0 conn(0x7fecb40b11f0 legacy=0x7fecb4098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:41.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.453+0000 7fecabe00640 1 -- 172.21.15.55:0/1805751549 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb40b04b0 con 0x7fecb40b16e0 2024-04-02T07:22:41.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.453+0000 7fecabe00640 1 --2- 172.21.15.55:0/1805751549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb40b16e0 0x7fecb40b0cb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fec9c009870 tx=0x7fec9c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edd2b0770f37ad7b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:41.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.453+0000 7fecb3e00640 1 -- 172.21.15.55:0/1805751549 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c0aa670 con 0x7fecb40b16e0 2024-04-02T07:22:41.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecb3e00640 1 -- 172.21.15.55:0/1805751549 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c0aa7d0 con 0x7fecb40b16e0 2024-04-02T07:22:41.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecb3e00640 1 -- 172.21.15.55:0/1805751549 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c0aab60 con 0x7fecb40b16e0 2024-04-02T07:22:41.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecbb400640 1 -- 172.21.15.55:0/1805751549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb40b16e0 msgr2=0x7fecb40b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:41.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecbb400640 1 --2- 172.21.15.55:0/1805751549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb40b16e0 0x7fecb40b0cb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fec9c009870 tx=0x7fec9c01c530 comp rx=0 tx=0).stop 2024-04-02T07:22:41.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecbb400640 1 -- 172.21.15.55:0/1805751549 shutdown_connections 2024-04-02T07:22:41.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecbb400640 1 --2- 172.21.15.55:0/1805751549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb40b16e0 0x7fecb40b0cb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:41.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecbb400640 1 --2- 172.21.15.55:0/1805751549 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fecb40cfdf0 0x7fecb406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:41.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecbb400640 1 -- 172.21.15.55:0/1805751549 >> 172.21.15.55:0/1805751549 conn(0x7fecb40b2210 msgr2=0x7fecb40b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:41.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecbb400640 1 -- 172.21.15.55:0/1805751549 shutdown_connections 2024-04-02T07:22:41.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecbb400640 1 -- 172.21.15.55:0/1805751549 wait complete. 2024-04-02T07:22:41.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecbb400640 1 Processor -- start 2024-04-02T07:22:41.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecbb400640 1 -- start start 2024-04-02T07:22:41.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecbb400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fecb40b11f0 0x7fecb4156850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:41.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecbb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb40b16e0 0x7fecb40c9cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:41.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecbb400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecb40cfdf0 0x7fecb40ca230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:41.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecbb400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40c88e0 con 0x7fecb40b16e0 2024-04-02T07:22:41.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecbb400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb415eb30 con 0x7fecb40cfdf0 2024-04-02T07:22:41.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecbb400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb40ca770 con 0x7fecb40b11f0 2024-04-02T07:22:41.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecabe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb40b16e0 0x7fecb40c9cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:41.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecabe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb40b16e0 0x7fecb40c9cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53636/0 (socket says 172.21.15.55:53636) 2024-04-02T07:22:41.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecabe00640 1 -- 172.21.15.55:0/1448835904 learned_addr learned my addr 172.21.15.55:0/1448835904 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:41.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecb9400640 1 --2- 172.21.15.55:0/1448835904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecb40cfdf0 0x7fecb40ca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:41.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecb8a00640 1 --2- 172.21.15.55:0/1448835904 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fecb40b11f0 0x7fecb4156850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:41.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecabe00640 1 -- 172.21.15.55:0/1448835904 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fecb40b11f0 msgr2=0x7fecb4156850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:41.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecabe00640 1 --2- 172.21.15.55:0/1448835904 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fecb40b11f0 0x7fecb4156850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:41.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecabe00640 1 -- 172.21.15.55:0/1448835904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecb40cfdf0 msgr2=0x7fecb40ca230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:41.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecabe00640 1 --2- 172.21.15.55:0/1448835904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecb40cfdf0 0x7fecb40ca230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:41.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecabe00640 1 -- 172.21.15.55:0/1448835904 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9c0094d0 con 0x7fecb40b16e0 2024-04-02T07:22:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecb9400640 1 --2- 172.21.15.55:0/1448835904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecb40cfdf0 0x7fecb40ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.457+0000 7fecb8a00640 1 --2- 172.21.15.55:0/1448835904 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fecb40b11f0 0x7fecb4156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.461+0000 7fecabe00640 1 --2- 172.21.15.55:0/1448835904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb40b16e0 0x7fecb40c9cf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fec9c01a160 tx=0x7fec9c01ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.461+0000 7fecb1600640 1 -- 172.21.15.55:0/1448835904 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c0b3800 con 0x7fecb40b16e0 2024-04-02T07:22:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.461+0000 7fecb1600640 1 -- 172.21.15.55:0/1448835904 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9c0b3980 con 0x7fecb40b16e0 2024-04-02T07:22:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.461+0000 7fecb1600640 1 -- 172.21.15.55:0/1448835904 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec9c0b3d30 con 0x7fecb40b16e0 2024-04-02T07:22:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.461+0000 7fecbb400640 1 -- 172.21.15.55:0/1448835904 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb40c8600 con 0x7fecb40b16e0 2024-04-02T07:22:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.461+0000 7fecbb400640 1 -- 172.21.15.55:0/1448835904 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb415f060 con 0x7fecb40b16e0 2024-04-02T07:22:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.461+0000 7fecbb400640 1 -- 172.21.15.55:0/1448835904 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb4066c90 con 0x7fecb40b16e0 2024-04-02T07:22:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.461+0000 7fecb1600640 1 -- 172.21.15.55:0/1448835904 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fec9c0b2380 con 0x7fecb40b16e0 2024-04-02T07:22:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.461+0000 7fecb1600640 1 --2- 172.21.15.55:0/1448835904 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec90066690 0x7fec90068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.461+0000 7fecb1600640 1 -- 172.21.15.55:0/1448835904 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec9c11e880 con 0x7fecb40b16e0 2024-04-02T07:22:41.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.461+0000 7fecb8a00640 1 --2- 172.21.15.55:0/1448835904 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec90066690 0x7fec90068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:41.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.465+0000 7fecb8a00640 1 --2- 172.21.15.55:0/1448835904 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec90066690 0x7fec90068b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feca4009a40 tx=0x7feca4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:41.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.465+0000 7fecb1600640 1 -- 172.21.15.55:0/1448835904 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fec9c0ebc60 con 0x7fecb40b16e0 2024-04-02T07:22:41.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.665+0000 7fecbb400640 1 -- 172.21.15.55:0/1448835904 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fecb40b3020 con 0x7fecb40b16e0 2024-04-02T07:22:41.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.665+0000 7fecb1600640 1 -- 172.21.15.55:0/1448835904 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fec9c0aa630 con 0x7fecb40b16e0 2024-04-02T07:22:41.671 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-02T07:22:41.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.669+0000 7fecbb400640 1 -- 172.21.15.55:0/1448835904 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec90066690 msgr2=0x7fec90068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:41.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.669+0000 7fecbb400640 1 --2- 172.21.15.55:0/1448835904 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec90066690 0x7fec90068b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feca4009a40 tx=0x7feca4008040 comp rx=0 tx=0).stop 2024-04-02T07:22:41.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.669+0000 7fecbb400640 1 -- 172.21.15.55:0/1448835904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb40b16e0 msgr2=0x7fecb40c9cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:41.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.669+0000 7fecbb400640 1 --2- 172.21.15.55:0/1448835904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb40b16e0 0x7fecb40c9cf0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fec9c01a160 tx=0x7fec9c01ad70 comp rx=0 tx=0).stop 2024-04-02T07:22:41.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.669+0000 7fecbb400640 1 -- 172.21.15.55:0/1448835904 shutdown_connections 2024-04-02T07:22:41.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.669+0000 7fecbb400640 1 --2- 172.21.15.55:0/1448835904 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec90066690 0x7fec90068b50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:41.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.669+0000 7fecbb400640 1 --2- 172.21.15.55:0/1448835904 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fecb40cfdf0 0x7fecb40ca230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:41.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.669+0000 7fecbb400640 1 --2- 172.21.15.55:0/1448835904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecb40b16e0 0x7fecb40c9cf0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:41.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.669+0000 7fecbb400640 1 --2- 172.21.15.55:0/1448835904 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fecb40b11f0 0x7fecb4156850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:41.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.669+0000 7fecbb400640 1 -- 172.21.15.55:0/1448835904 >> 172.21.15.55:0/1448835904 conn(0x7fecb40b2210 msgr2=0x7fecb40ad3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:41.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.669+0000 7fecbb400640 1 -- 172.21.15.55:0/1448835904 shutdown_connections 2024-04-02T07:22:41.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:41.669+0000 7fecbb400640 1 -- 172.21.15.55:0/1448835904 wait complete. 2024-04-02T07:22:41.691 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-02T07:22:41.692 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-02T07:22:41.692 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi106.front.sepia.ceph.com 2024-04-02T07:22:41.692 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-04-02T07:22:41.692 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-04-02T07:22:41.692 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-02T07:22:41.692 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-02T07:22:41.692 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-02T07:22:41.692 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-04-02T07:22:41.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:41.692 DEBUG:teuthology.orchestra.run.smithi106:> ip addr 2024-04-02T07:22:41.701 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:22:41.701 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:22:41.701 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:22:41.702 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:41.702 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-04-02T07:22:41.702 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:41.702 INFO:teuthology.orchestra.run.smithi106.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:22:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2a brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f0 2024-04-02T07:22:41.703 INFO:teuthology.orchestra.run.smithi106.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:22:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:d8:a1:2b brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: altname enp7s0f1 2024-04-02T07:22:41.703 INFO:teuthology.orchestra.run.smithi106.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:22:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6c brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:41.703 INFO:teuthology.orchestra.run.smithi106.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-02T07:22:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0c:c4:7a:8f:ce:6d brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.21.15.106/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-02T07:22:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft 42442sec preferred_lft 42442sec 2024-04-02T07:22:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::ec4:7aff:fe8f:ce6d/64 scope link 2024-04-02T07:22:41.703 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:41.704 INFO:teuthology.orchestra.run.smithi106.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-02T07:22:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 02:42:a5:0e:5f:06 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-02T07:22:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:41.704 INFO:teuthology.orchestra.run.smithi106.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:22:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-02T07:22:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-02T07:22:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-02T07:22:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:41.704 INFO:teuthology.orchestra.run.smithi106.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:22:41.704 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-02T07:22:41.705 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-02T07:22:41.705 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:41.706 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:41.706 DEBUG:teuthology.orchestra.run.smithi106:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-02T07:22:41.766 INFO:teuthology.orchestra.run.smithi106.stdout:1 2024-04-02T07:22:41.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:41.768 DEBUG:teuthology.orchestra.run.smithi106:> route 2024-04-02T07:22:41.824 INFO:teuthology.orchestra.run.smithi106.stdout:Kernel IP routing table 2024-04-02T07:22:41.824 INFO:teuthology.orchestra.run.smithi106.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-02T07:22:41.824 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2024-04-02T07:22:41.824 INFO:teuthology.orchestra.run.smithi106.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-02T07:22:41.824 INFO:teuthology.orchestra.run.smithi106.stdout:158.69.67.47 _gateway 255.255.255.255 UGH 100 0 0 enp3s0f1 2024-04-02T07:22:41.824 INFO:teuthology.orchestra.run.smithi106.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-02T07:22:41.824 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-02T07:22:41.824 INFO:teuthology.orchestra.run.smithi106.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-02T07:22:41.824 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.0.2 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-02T07:22:41.824 INFO:teuthology.orchestra.run.smithi106.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2024-04-02T07:22:41.824 INFO:teuthology.orchestra.run.smithi106.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-02T07:22:41.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:41.825 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-04-02T07:22:41.825 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-02T07:22:41.825 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-02T07:22:41.825 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-02T07:22:41.825 DEBUG:teuthology.orchestra.run.smithi106:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-02T07:22:41.825 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-02T07:22:41.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:41.913 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-04-02T07:22:41.922 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-02T07:22:41.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:41.922 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list-id 2024-04-02T07:22:41.975 INFO:teuthology.orchestra.run.smithi106.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-04-02T07:22:41.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:41.976 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-04-02T07:22:41.976 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-02T07:22:41.976 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-02T07:22:41.976 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-04-02T07:22:41.976 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-02T07:22:42.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:42.057 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-02T07:22:42.119 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:22:42.120 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:22:42.120 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:22:42.120 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:42.120 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-04-02T07:22:42.120 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:42.120 INFO:teuthology.orchestra.run.smithi106.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:22:42.120 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 62:c6:ff:52:65:cf brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-02T07:22:42.120 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-02T07:22:42.120 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:42.120 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::60c6:ffff:fe52:65cf/64 scope link 2024-04-02T07:22:42.120 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:42.121 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:42.121 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-04-02T07:22:42.187 INFO:teuthology.orchestra.run.smithi106.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:22:42.187 INFO:teuthology.orchestra.run.smithi106.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:22:42.188 INFO:teuthology.orchestra.run.smithi106.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:22:42.188 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:42.188 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 ::1/128 scope host 2024-04-02T07:22:42.188 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:42.188 INFO:teuthology.orchestra.run.smithi106.stdout:2: veth0@if8: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:22:42.188 INFO:teuthology.orchestra.run.smithi106.stdout: link/ether 62:c6:ff:52:65:cf brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-04-02T07:22:42.188 INFO:teuthology.orchestra.run.smithi106.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-04-02T07:22:42.188 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:42.188 INFO:teuthology.orchestra.run.smithi106.stdout: inet6 fe80::60c6:ffff:fe52:65cf/64 scope link 2024-04-02T07:22:42.188 INFO:teuthology.orchestra.run.smithi106.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:22:42.190 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-04-02T07:22:42.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:42.190 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-04-02T07:22:42.190 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-02T07:22:42.190 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-04-02T07:22:42.190 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-04-02T07:22:42.190 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-04-02T07:22:42.190 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-04-02T07:22:42.190 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-04-02T07:22:42.190 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-02T07:22:42.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:42.329 DEBUG:teuthology.orchestra.run.smithi106:> (cd / && exec bash -c ' 2024-04-02T07:22:42.329 DEBUG:teuthology.orchestra.run.smithi106:> set -e 2024-04-02T07:22:42.329 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set brx.1 up 2024-04-02T07:22:42.329 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link set dev brx.1 master ceph-brx 2024-04-02T07:22:42.329 DEBUG:teuthology.orchestra.run.smithi106:> ') 2024-04-02T07:22:42.367 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-04-02T07:22:42.367 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:22:42.367 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-04-02T07:22:42.417 INFO:teuthology.orchestra.run.smithi106.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-04-02T07:22:42.418 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:22:42.418 DEBUG:teuthology.orchestra.run.smithi106:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-04-02T07:22:42.467 DEBUG:teuthology.orchestra.run.smithi106:> sudo modprobe fuse 2024-04-02T07:22:42.527 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:22:42.528 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:22:42.585 INFO:teuthology.orchestra.run.smithi106.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:22:42.587 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:22:42.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:42.587 DEBUG:teuthology.orchestra.run.smithi106:> ls /sys/fs/fuse/connections 2024-04-02T07:22:42.636 INFO:teuthology.orchestra.run.smithi106.stdout:43 2024-04-02T07:22:42.636 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [43] 2024-04-02T07:22:42.636 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-04-02T07:22:42.683 DEBUG:teuthology.orchestra.run.smithi106:> sudo modprobe fuse 2024-04-02T07:22:42.704 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:22:42.704 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:22:42.766 INFO:teuthology.orchestra.run.smithi106.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:22:42.767 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:22:42.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:42.768 DEBUG:teuthology.orchestra.run.smithi106:> ls /sys/fs/fuse/connections 2024-04-02T07:22:42.775 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi106.stderr:2024-04-02T07:22:42.771+0000 7fb2fa2ed580 -1 init, newargv = 0x560751686140 newargc=15 2024-04-02T07:22:42.775 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi106.stderr:ceph-fuse[33159]: starting ceph client 2024-04-02T07:22:42.782 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi106.stderr:ceph-fuse[33159]: starting fuse 2024-04-02T07:22:42.784 INFO:teuthology.orchestra.run.smithi106.stdout:43 2024-04-02T07:22:42.784 INFO:teuthology.orchestra.run.smithi106.stdout:44 2024-04-02T07:22:42.784 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43, 44] 2024-04-02T07:22:42.784 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:22:42.784 DEBUG:teuthology.orchestra.run.smithi106:> import glob 2024-04-02T07:22:42.784 DEBUG:teuthology.orchestra.run.smithi106:> import re 2024-04-02T07:22:42.784 DEBUG:teuthology.orchestra.run.smithi106:> import os 2024-04-02T07:22:42.784 DEBUG:teuthology.orchestra.run.smithi106:> import subprocess 2024-04-02T07:22:42.784 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-02T07:22:42.785 DEBUG:teuthology.orchestra.run.smithi106:> def _find_admin_socket(client_name): 2024-04-02T07:22:42.785 DEBUG:teuthology.orchestra.run.smithi106:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-04-02T07:22:42.785 DEBUG:teuthology.orchestra.run.smithi106:> files = glob.glob(asok_path) 2024-04-02T07:22:42.785 DEBUG:teuthology.orchestra.run.smithi106:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-04-02T07:22:42.785 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-02T07:22:42.785 DEBUG:teuthology.orchestra.run.smithi106:> # Given a non-glob path, it better be there 2024-04-02T07:22:42.785 DEBUG:teuthology.orchestra.run.smithi106:> if "*" not in asok_path: 2024-04-02T07:22:42.785 DEBUG:teuthology.orchestra.run.smithi106:> assert(len(files) == 1) 2024-04-02T07:22:42.785 DEBUG:teuthology.orchestra.run.smithi106:> return files[0] 2024-04-02T07:22:42.785 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-02T07:22:42.785 DEBUG:teuthology.orchestra.run.smithi106:> for f in files: 2024-04-02T07:22:42.785 DEBUG:teuthology.orchestra.run.smithi106:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-02T07:22:42.785 DEBUG:teuthology.orchestra.run.smithi106:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-02T07:22:42.785 DEBUG:teuthology.orchestra.run.smithi106:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-02T07:22:42.785 DEBUG:teuthology.orchestra.run.smithi106:> contents = proc_f.read() 2024-04-02T07:22:42.785 DEBUG:teuthology.orchestra.run.smithi106:> if mountpoint in contents: 2024-04-02T07:22:42.786 DEBUG:teuthology.orchestra.run.smithi106:> return f 2024-04-02T07:22:42.786 DEBUG:teuthology.orchestra.run.smithi106:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-02T07:22:42.786 DEBUG:teuthology.orchestra.run.smithi106:> 2024-04-02T07:22:42.786 DEBUG:teuthology.orchestra.run.smithi106:> print(_find_admin_socket("client.3")) 2024-04-02T07:22:42.786 DEBUG:teuthology.orchestra.run.smithi106:> ' 2024-04-02T07:22:42.905 INFO:teuthology.orchestra.run.smithi106.stdout:/var/run/ceph/ceph-client.3.33159.asok 2024-04-02T07:22:43.091 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.33159.asok 2024-04-02T07:22:43.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:43.091 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.33159.asok status 2024-04-02T07:22:43.171 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:22:43.175 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:22:43.260 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-02T07:22:43.260 INFO:teuthology.orchestra.run.smithi106.stdout: "metadata": { 2024-04-02T07:22:43.260 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_sha1": "d0e392d9aee635f2b65768c460c7a151ead7a5e2", 2024-04-02T07:22:43.261 INFO:teuthology.orchestra.run.smithi106.stdout: "ceph_version": "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)", 2024-04-02T07:22:43.261 INFO:teuthology.orchestra.run.smithi106.stdout: "entity_id": "3", 2024-04-02T07:22:43.261 INFO:teuthology.orchestra.run.smithi106.stdout: "hostname": "smithi106", 2024-04-02T07:22:43.261 INFO:teuthology.orchestra.run.smithi106.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-04-02T07:22:43.261 INFO:teuthology.orchestra.run.smithi106.stdout: "pid": "33159", 2024-04-02T07:22:43.261 INFO:teuthology.orchestra.run.smithi106.stdout: "root": "/" 2024-04-02T07:22:43.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-02T07:22:43.261 INFO:teuthology.orchestra.run.smithi106.stdout: "dentry_count": 0, 2024-04-02T07:22:43.261 INFO:teuthology.orchestra.run.smithi106.stdout: "dentry_pinned_count": 0, 2024-04-02T07:22:43.261 INFO:teuthology.orchestra.run.smithi106.stdout: "id": 4693, 2024-04-02T07:22:43.261 INFO:teuthology.orchestra.run.smithi106.stdout: "inst": { 2024-04-02T07:22:43.261 INFO:teuthology.orchestra.run.smithi106.stdout: "name": { 2024-04-02T07:22:43.261 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "client", 2024-04-02T07:22:43.261 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 4693 2024-04-02T07:22:43.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-02T07:22:43.262 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": { 2024-04-02T07:22:43.262 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-02T07:22:43.262 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "192.168.0.2:0", 2024-04-02T07:22:43.262 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 4025491929 2024-04-02T07:22:43.262 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-02T07:22:43.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-02T07:22:43.262 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": { 2024-04-02T07:22:43.262 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-02T07:22:43.262 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "192.168.0.2:0", 2024-04-02T07:22:43.262 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 4025491929 2024-04-02T07:22:43.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-02T07:22:43.262 INFO:teuthology.orchestra.run.smithi106.stdout: "inst_str": "client.4693 192.168.0.2:0/4025491929", 2024-04-02T07:22:43.262 INFO:teuthology.orchestra.run.smithi106.stdout: "addr_str": "192.168.0.2:0/4025491929", 2024-04-02T07:22:43.262 INFO:teuthology.orchestra.run.smithi106.stdout: "inode_count": 1, 2024-04-02T07:22:43.263 INFO:teuthology.orchestra.run.smithi106.stdout: "mds_epoch": 8, 2024-04-02T07:22:43.263 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_epoch": 20, 2024-04-02T07:22:43.263 INFO:teuthology.orchestra.run.smithi106.stdout: "osd_epoch_barrier": 0, 2024-04-02T07:22:43.263 INFO:teuthology.orchestra.run.smithi106.stdout: "blocklisted": false, 2024-04-02T07:22:43.263 INFO:teuthology.orchestra.run.smithi106.stdout: "fs_name": "cephfs" 2024-04-02T07:22:43.263 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-02T07:22:43.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:43.276 DEBUG:teuthology.orchestra.run.smithi055:> stat --file-system '--printf=%T 2024-04-02T07:22:43.276 DEBUG:teuthology.orchestra.run.smithi055:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-02T07:22:43.286 INFO:teuthology.orchestra.run.smithi055.stdout:fuseblk 2024-04-02T07:22:43.286 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-02T07:22:43.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:43.286 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:22:43.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:43.352 DEBUG:teuthology.orchestra.run.smithi055:> stat --file-system '--printf=%T 2024-04-02T07:22:43.352 DEBUG:teuthology.orchestra.run.smithi055:> ' -- /home/ubuntu/cephtest/mnt.2 2024-04-02T07:22:43.405 INFO:teuthology.orchestra.run.smithi055.stdout:fuseblk 2024-04-02T07:22:43.405 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-04-02T07:22:43.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:43.405 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-04-02T07:22:43.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:43.472 DEBUG:teuthology.orchestra.run.smithi106:> stat --file-system '--printf=%T 2024-04-02T07:22:43.472 DEBUG:teuthology.orchestra.run.smithi106:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-02T07:22:43.482 INFO:teuthology.orchestra.run.smithi106.stdout:fuseblk 2024-04-02T07:22:43.483 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-02T07:22:43.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:43.483 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-02T07:22:43.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:43.544 DEBUG:teuthology.orchestra.run.smithi106:> stat --file-system '--printf=%T 2024-04-02T07:22:43.544 DEBUG:teuthology.orchestra.run.smithi106:> ' -- /home/ubuntu/cephtest/mnt.3 2024-04-02T07:22:43.593 INFO:teuthology.orchestra.run.smithi106.stdout:fuseblk 2024-04-02T07:22:43.594 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-04-02T07:22:43.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:43.594 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-04-02T07:22:43.655 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-04-02T07:22:43.690 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:43.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.837+0000 7fbb99a00640 1 Processor -- start 2024-04-02T07:22:43.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.837+0000 7fbb99a00640 1 -- start start 2024-04-02T07:22:43.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.837+0000 7fbb99a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbb9415a480 0x7fbb940ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:43.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.837+0000 7fbb99a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940b1070 0x7fbb940c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:43.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.837+0000 7fbb99a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb9415a860 con 0x7fbb940ca9a0 2024-04-02T07:22:43.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.837+0000 7fbb99a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb9415ce20 con 0x7fbb9415a480 2024-04-02T07:22:43.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.837+0000 7fbb99a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940cade0 con 0x7fbb940b1070 2024-04-02T07:22:43.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.837+0000 7fbb92a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbb9415a480 0x7fbb940ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:43.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.837+0000 7fbb92a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbb9415a480 0x7fbb940ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53644/0 (socket says 172.21.15.55:53644) 2024-04-02T07:22:43.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.837+0000 7fbb92a00640 1 -- 172.21.15.55:0/754293760 learned_addr learned my addr 172.21.15.55:0/754293760 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:43.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.837+0000 7fbb93400640 1 --2- 172.21.15.55:0/754293760 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940b1070 0x7fbb940c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:43.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.841+0000 7fbb92a00640 1 -- 172.21.15.55:0/754293760 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940b1070 msgr2=0x7fbb940c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:43.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.841+0000 7fbb92a00640 1 --2- 172.21.15.55:0/754293760 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940b1070 0x7fbb940c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:43.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.841+0000 7fbb92a00640 1 -- 172.21.15.55:0/754293760 >> v1:172.21.15.106:6789/0 conn(0x7fbb940ca9a0 legacy=0x7fbb940b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:43.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.841+0000 7fbb92a00640 1 -- 172.21.15.55:0/754293760 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb940cb570 con 0x7fbb9415a480 2024-04-02T07:22:43.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.841+0000 7fbb92000640 1 -- 172.21.15.55:0/754293760 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4042138349 0 0) 0x7fbb7c001120 con 0x7fbb940ca9a0 2024-04-02T07:22:43.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.841+0000 7fbb92a00640 1 --2- 172.21.15.55:0/754293760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9415a480 0x7fbb940ca460 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009870 tx=0x7fbb8401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f931cc06863273 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:43.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.841+0000 7fbb92000640 1 -- 172.21.15.55:0/754293760 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb840ab650 con 0x7fbb9415a480 2024-04-02T07:22:43.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.841+0000 7fbb92000640 1 -- 172.21.15.55:0/754293760 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb840ab7b0 con 0x7fbb9415a480 2024-04-02T07:22:43.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.841+0000 7fbb92000640 1 -- 172.21.15.55:0/754293760 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb840abb40 con 0x7fbb9415a480 2024-04-02T07:22:43.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb99a00640 1 -- 172.21.15.55:0/754293760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9415a480 msgr2=0x7fbb940ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:43.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb99a00640 1 --2- 172.21.15.55:0/754293760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9415a480 0x7fbb940ca460 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fbb84009870 tx=0x7fbb8401c560 comp rx=0 tx=0).stop 2024-04-02T07:22:43.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb99a00640 1 -- 172.21.15.55:0/754293760 shutdown_connections 2024-04-02T07:22:43.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb99a00640 1 --2- 172.21.15.55:0/754293760 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940b1070 0x7fbb940c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:43.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb99a00640 1 --2- 172.21.15.55:0/754293760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9415a480 0x7fbb940ca460 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:43.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb99a00640 1 -- 172.21.15.55:0/754293760 >> 172.21.15.55:0/754293760 conn(0x7fbb94066080 msgr2=0x7fbb94069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:43.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb99a00640 1 -- 172.21.15.55:0/754293760 shutdown_connections 2024-04-02T07:22:43.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb99a00640 1 -- 172.21.15.55:0/754293760 wait complete. 2024-04-02T07:22:43.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb99a00640 1 Processor -- start 2024-04-02T07:22:43.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb99a00640 1 -- start start 2024-04-02T07:22:43.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb99a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940b1070 0x7fbb94146410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:43.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb99a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb940ca9a0 0x7fbb94136f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:43.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb99a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9415a480 0x7fbb941517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:43.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb99a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940b2150 con 0x7fbb9415a480 2024-04-02T07:22:43.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb99a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94137490 con 0x7fbb940ca9a0 2024-04-02T07:22:43.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb99a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb940b17f0 con 0x7fbb940b1070 2024-04-02T07:22:43.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb93400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9415a480 0x7fbb941517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:43.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb93400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9415a480 0x7fbb941517e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53650/0 (socket says 172.21.15.55:53650) 2024-04-02T07:22:43.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb93400640 1 -- 172.21.15.55:0/2192304066 learned_addr learned my addr 172.21.15.55:0/2192304066 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:43.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb92a00640 1 --2- 172.21.15.55:0/2192304066 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940b1070 0x7fbb94146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:43.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb8be00640 1 --2- 172.21.15.55:0/2192304066 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb940ca9a0 0x7fbb94136f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:43.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb93400640 1 -- 172.21.15.55:0/2192304066 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940b1070 msgr2=0x7fbb94146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:43.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb93400640 1 --2- 172.21.15.55:0/2192304066 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940b1070 0x7fbb94146410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:43.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb93400640 1 -- 172.21.15.55:0/2192304066 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb940ca9a0 msgr2=0x7fbb94136f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:43.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb93400640 1 --2- 172.21.15.55:0/2192304066 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb940ca9a0 0x7fbb94136f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:43.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb93400640 1 -- 172.21.15.55:0/2192304066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb840094d0 con 0x7fbb9415a480 2024-04-02T07:22:43.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb8be00640 1 --2- 172.21.15.55:0/2192304066 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb940ca9a0 0x7fbb94136f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:43.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.845+0000 7fbb93400640 1 --2- 172.21.15.55:0/2192304066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9415a480 0x7fbb941517e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009dd0 tx=0x7fbb8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:43.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.849+0000 7fbb8aa00640 1 -- 172.21.15.55:0/2192304066 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c014480 con 0x7fbb9415a480 2024-04-02T07:22:43.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.849+0000 7fbb8aa00640 1 -- 172.21.15.55:0/2192304066 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb8c00f040 con 0x7fbb9415a480 2024-04-02T07:22:43.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.849+0000 7fbb8aa00640 1 -- 172.21.15.55:0/2192304066 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb8c014840 con 0x7fbb9415a480 2024-04-02T07:22:43.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.849+0000 7fbb99a00640 1 -- 172.21.15.55:0/2192304066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb940b1a90 con 0x7fbb9415a480 2024-04-02T07:22:43.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.849+0000 7fbb99a00640 1 -- 172.21.15.55:0/2192304066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb94151d20 con 0x7fbb9415a480 2024-04-02T07:22:43.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.849+0000 7fbb99a00640 1 -- 172.21.15.55:0/2192304066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb940b2290 con 0x7fbb9415a480 2024-04-02T07:22:43.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.849+0000 7fbb8aa00640 1 -- 172.21.15.55:0/2192304066 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fbb8c0149a0 con 0x7fbb9415a480 2024-04-02T07:22:43.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.849+0000 7fbb8aa00640 1 --2- 172.21.15.55:0/2192304066 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb700666c0 0x7fbb70068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:43.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.849+0000 7fbb8aa00640 1 -- 172.21.15.55:0/2192304066 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb8c084c50 con 0x7fbb9415a480 2024-04-02T07:22:43.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.849+0000 7fbb92a00640 1 --2- 172.21.15.55:0/2192304066 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb700666c0 0x7fbb70068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:43.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.849+0000 7fbb92a00640 1 --2- 172.21.15.55:0/2192304066 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb700666c0 0x7fbb70068b80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbb840af000 tx=0x7fbb840b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:43.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:43.853+0000 7fbb8aa00640 1 -- 172.21.15.55:0/2192304066 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fbb940b2290 con 0x7fbb9415a480 2024-04-02T07:22:44.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.017+0000 7fbb99a00640 1 -- 172.21.15.55:0/2192304066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb940b2290 con 0x7fbb9415a480 2024-04-02T07:22:44.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.017+0000 7fbb8aa00640 1 -- 172.21.15.55:0/2192304066 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7fbb940b2290 con 0x7fbb9415a480 2024-04-02T07:22:44.021 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:44.022 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:19.207279+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:44.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.017+0000 7fbb99a00640 1 -- 172.21.15.55:0/2192304066 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb700666c0 msgr2=0x7fbb70068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:44.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.017+0000 7fbb99a00640 1 --2- 172.21.15.55:0/2192304066 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb700666c0 0x7fbb70068b80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fbb840af000 tx=0x7fbb840b6040 comp rx=0 tx=0).stop 2024-04-02T07:22:44.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.017+0000 7fbb99a00640 1 -- 172.21.15.55:0/2192304066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9415a480 msgr2=0x7fbb941517e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:44.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.017+0000 7fbb99a00640 1 --2- 172.21.15.55:0/2192304066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9415a480 0x7fbb941517e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbb8c009dd0 tx=0x7fbb8c00c490 comp rx=0 tx=0).stop 2024-04-02T07:22:44.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.021+0000 7fbb99a00640 1 -- 172.21.15.55:0/2192304066 shutdown_connections 2024-04-02T07:22:44.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.021+0000 7fbb99a00640 1 --2- 172.21.15.55:0/2192304066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb9415a480 0x7fbb941517e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.021+0000 7fbb99a00640 1 --2- 172.21.15.55:0/2192304066 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb700666c0 0x7fbb70068b80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.021+0000 7fbb99a00640 1 --2- 172.21.15.55:0/2192304066 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb940ca9a0 0x7fbb94136f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.021+0000 7fbb99a00640 1 --2- 172.21.15.55:0/2192304066 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb940b1070 0x7fbb94146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.021+0000 7fbb99a00640 1 -- 172.21.15.55:0/2192304066 >> 172.21.15.55:0/2192304066 conn(0x7fbb94066080 msgr2=0x7fbb941603f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:44.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.021+0000 7fbb99a00640 1 -- 172.21.15.55:0/2192304066 shutdown_connections 2024-04-02T07:22:44.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.021+0000 7fbb99a00640 1 -- 172.21.15.55:0/2192304066 wait complete. 2024-04-02T07:22:44.044 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:22:16.738297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:22:17.190496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:22:44.044 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:22:44.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.181+0000 7fe64da00640 1 Processor -- start 2024-04-02T07:22:44.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.181+0000 7fe64da00640 1 -- start start 2024-04-02T07:22:44.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.185+0000 7fe64da00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe648144260 0x7fe6480702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:44.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.185+0000 7fe64da00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6480b31a0 0x7fe6480b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:44.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.185+0000 7fe64da00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe648070c90 con 0x7fe6480707e0 2024-04-02T07:22:44.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.185+0000 7fe64da00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6480b37c0 con 0x7fe6480b31a0 2024-04-02T07:22:44.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.185+0000 7fe64da00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6480b3580 con 0x7fe648144260 2024-04-02T07:22:44.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.185+0000 7fe647400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6480b31a0 0x7fe6480b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:44.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.185+0000 7fe647400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe6480b31a0 0x7fe6480b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53662/0 (socket says 172.21.15.55:53662) 2024-04-02T07:22:44.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.185+0000 7fe647400640 1 -- 172.21.15.55:0/2491267587 learned_addr learned my addr 172.21.15.55:0/2491267587 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:44.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.185+0000 7fe646a00640 1 --2- 172.21.15.55:0/2491267587 >> v2:172.21.15.106:3300/0 conn(0x7fe648144260 0x7fe6480702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:44.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.185+0000 7fe647400640 1 -- 172.21.15.55:0/2491267587 >> v2:172.21.15.106:3300/0 conn(0x7fe648144260 msgr2=0x7fe6480702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:44.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.185+0000 7fe647400640 1 --2- 172.21.15.55:0/2491267587 >> v2:172.21.15.106:3300/0 conn(0x7fe648144260 0x7fe6480702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.185+0000 7fe647400640 1 -- 172.21.15.55:0/2491267587 >> v1:172.21.15.106:6789/0 conn(0x7fe6480707e0 legacy=0x7fe6480b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:44.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.185+0000 7fe647400640 1 -- 172.21.15.55:0/2491267587 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64815e3a0 con 0x7fe6480b31a0 2024-04-02T07:22:44.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.185+0000 7fe646a00640 1 --2- 172.21.15.55:0/2491267587 >> v2:172.21.15.106:3300/0 conn(0x7fe648144260 0x7fe6480702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:44.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.189+0000 7fe647400640 1 --2- 172.21.15.55:0/2491267587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6480b31a0 0x7fe6480b1670 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe64806aa30 tx=0x7fe64001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c590c3362fc922d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:44.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.189+0000 7fe646000640 1 -- 172.21.15.55:0/2491267587 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6400a57a0 con 0x7fe6480b31a0 2024-04-02T07:22:44.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.189+0000 7fe646000640 1 -- 172.21.15.55:0/2491267587 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6400a5900 con 0x7fe6480b31a0 2024-04-02T07:22:44.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.189+0000 7fe646000640 1 -- 172.21.15.55:0/2491267587 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6400a5c90 con 0x7fe6480b31a0 2024-04-02T07:22:44.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.189+0000 7fe64da00640 1 -- 172.21.15.55:0/2491267587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6480b31a0 msgr2=0x7fe6480b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:44.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.189+0000 7fe64da00640 1 --2- 172.21.15.55:0/2491267587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6480b31a0 0x7fe6480b1670 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fe64806aa30 tx=0x7fe64001c9f0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.189+0000 7fe64da00640 1 -- 172.21.15.55:0/2491267587 shutdown_connections 2024-04-02T07:22:44.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.189+0000 7fe64da00640 1 --2- 172.21.15.55:0/2491267587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6480b31a0 0x7fe6480b1670 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.189+0000 7fe64da00640 1 --2- 172.21.15.55:0/2491267587 >> v2:172.21.15.106:3300/0 conn(0x7fe648144260 0x7fe6480702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.189+0000 7fe64da00640 1 -- 172.21.15.55:0/2491267587 >> 172.21.15.55:0/2491267587 conn(0x7fe64806a390 msgr2=0x7fe6480b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:44.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.189+0000 7fe64da00640 1 -- 172.21.15.55:0/2491267587 shutdown_connections 2024-04-02T07:22:44.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.189+0000 7fe64da00640 1 -- 172.21.15.55:0/2491267587 wait complete. 2024-04-02T07:22:44.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.189+0000 7fe64da00640 1 Processor -- start 2024-04-02T07:22:44.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.189+0000 7fe64da00640 1 -- start start 2024-04-02T07:22:44.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.189+0000 7fe64da00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6480707e0 0x7fe648139c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:44.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.189+0000 7fe64da00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6480b31a0 0x7fe648154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:44.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.189+0000 7fe64da00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe648144260 0x7fe648157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:44.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.189+0000 7fe64da00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe648155110 con 0x7fe6480b31a0 2024-04-02T07:22:44.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.189+0000 7fe64da00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe648155590 con 0x7fe648144260 2024-04-02T07:22:44.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.189+0000 7fe64da00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe648158260 con 0x7fe6480707e0 2024-04-02T07:22:44.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.193+0000 7fe63fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6480b31a0 0x7fe648154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:44.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.193+0000 7fe63fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6480b31a0 0x7fe648154bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53672/0 (socket says 172.21.15.55:53672) 2024-04-02T07:22:44.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.193+0000 7fe63fe00640 1 -- 172.21.15.55:0/4195041728 learned_addr learned my addr 172.21.15.55:0/4195041728 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:44.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.193+0000 7fe647400640 1 --2- 172.21.15.55:0/4195041728 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe648144260 0x7fe648157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:44.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.193+0000 7fe646a00640 1 --2- 172.21.15.55:0/4195041728 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6480707e0 0x7fe648139c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:44.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.193+0000 7fe63fe00640 1 -- 172.21.15.55:0/4195041728 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6480707e0 msgr2=0x7fe648139c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:44.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.193+0000 7fe63fe00640 1 --2- 172.21.15.55:0/4195041728 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6480707e0 0x7fe648139c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.193+0000 7fe63fe00640 1 -- 172.21.15.55:0/4195041728 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe648144260 msgr2=0x7fe648157d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:44.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.193+0000 7fe63fe00640 1 --2- 172.21.15.55:0/4195041728 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe648144260 0x7fe648157d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.193+0000 7fe63fe00640 1 -- 172.21.15.55:0/4195041728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe640009b30 con 0x7fe6480b31a0 2024-04-02T07:22:44.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.193+0000 7fe63fe00640 1 --2- 172.21.15.55:0/4195041728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6480b31a0 0x7fe648154bd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe63000c500 tx=0x7fe63000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:44.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.193+0000 7fe63ea00640 1 -- 172.21.15.55:0/4195041728 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630005220 con 0x7fe6480b31a0 2024-04-02T07:22:44.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.193+0000 7fe63ea00640 1 -- 172.21.15.55:0/4195041728 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe630005380 con 0x7fe6480b31a0 2024-04-02T07:22:44.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.193+0000 7fe63ea00640 1 -- 172.21.15.55:0/4195041728 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe630007270 con 0x7fe6480b31a0 2024-04-02T07:22:44.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.193+0000 7fe64da00640 1 -- 172.21.15.55:0/4195041728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe64813a230 con 0x7fe6480b31a0 2024-04-02T07:22:44.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.193+0000 7fe64da00640 1 -- 172.21.15.55:0/4195041728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe64813a7f0 con 0x7fe6480b31a0 2024-04-02T07:22:44.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.193+0000 7fe64da00640 1 -- 172.21.15.55:0/4195041728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe648073530 con 0x7fe6480b31a0 2024-04-02T07:22:44.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.193+0000 7fe63ea00640 1 -- 172.21.15.55:0/4195041728 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe6300073d0 con 0x7fe6480b31a0 2024-04-02T07:22:44.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.197+0000 7fe63ea00640 1 --2- 172.21.15.55:0/4195041728 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe6240666c0 0x7fe624068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:44.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.197+0000 7fe63ea00640 1 -- 172.21.15.55:0/4195041728 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe630083980 con 0x7fe6480b31a0 2024-04-02T07:22:44.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.197+0000 7fe646a00640 1 --2- 172.21.15.55:0/4195041728 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe6240666c0 0x7fe624068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:44.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.197+0000 7fe646a00640 1 --2- 172.21.15.55:0/4195041728 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe6240666c0 0x7fe624068b80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe638006fd0 tx=0x7fe638008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:44.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.201+0000 7fe63ea00640 1 -- 172.21.15.55:0/4195041728 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe630050d10 con 0x7fe6480b31a0 2024-04-02T07:22:44.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.361+0000 7fe64da00640 1 -- 172.21.15.55:0/4195041728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe648155700 con 0x7fe6480b31a0 2024-04-02T07:22:44.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.361+0000 7fe63ea00640 1 -- 172.21.15.55:0/4195041728 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe630054330 con 0x7fe6480b31a0 2024-04-02T07:22:44.366 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:22:44.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.365+0000 7fe64da00640 1 -- 172.21.15.55:0/4195041728 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe6240666c0 msgr2=0x7fe624068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:44.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.365+0000 7fe64da00640 1 --2- 172.21.15.55:0/4195041728 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe6240666c0 0x7fe624068b80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe638006fd0 tx=0x7fe638008040 comp rx=0 tx=0).stop 2024-04-02T07:22:44.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.365+0000 7fe64da00640 1 -- 172.21.15.55:0/4195041728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6480b31a0 msgr2=0x7fe648154bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:44.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.365+0000 7fe64da00640 1 --2- 172.21.15.55:0/4195041728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6480b31a0 0x7fe648154bd0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe63000c500 tx=0x7fe63000c9c0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.365+0000 7fe64da00640 1 -- 172.21.15.55:0/4195041728 shutdown_connections 2024-04-02T07:22:44.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.365+0000 7fe64da00640 1 --2- 172.21.15.55:0/4195041728 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe6240666c0 0x7fe624068b80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.365+0000 7fe64da00640 1 --2- 172.21.15.55:0/4195041728 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe648144260 0x7fe648157d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.365+0000 7fe64da00640 1 --2- 172.21.15.55:0/4195041728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6480b31a0 0x7fe648154bd0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.365+0000 7fe64da00640 1 --2- 172.21.15.55:0/4195041728 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6480707e0 0x7fe648139c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.365+0000 7fe64da00640 1 -- 172.21.15.55:0/4195041728 >> 172.21.15.55:0/4195041728 conn(0x7fe64806a390 msgr2=0x7fe6481432c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:44.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.365+0000 7fe64da00640 1 -- 172.21.15.55:0/4195041728 shutdown_connections 2024-04-02T07:22:44.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.365+0000 7fe64da00640 1 -- 172.21.15.55:0/4195041728 wait complete. 2024-04-02T07:22:44.387 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:22:44.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.529+0000 7f1072000640 1 Processor -- start 2024-04-02T07:22:44.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.529+0000 7f1072000640 1 -- start start 2024-04-02T07:22:44.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.529+0000 7f1072000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f106c0709b0 0x7f106c0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:44.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.529+0000 7f1072000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106c15e3a0 con 0x7f106c0b2fd0 2024-04-02T07:22:44.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.529+0000 7f1072000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f106c15e5f0 con 0x7f106c144260 2024-04-02T07:22:44.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.529+0000 7f1072000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f106c0b37c0 con 0x7f106c0709b0 2024-04-02T07:22:44.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.529+0000 7f106be00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f106c0b2fd0 0x7f106c0b1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49160/0 (socket says 172.21.15.55:49160) 2024-04-02T07:22:44.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.529+0000 7f106be00640 1 -- 172.21.15.55:0/1484380116 learned_addr learned my addr 172.21.15.55:0/1484380116 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:44.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.529+0000 7f106aa00640 1 --2- 172.21.15.55:0/1484380116 >> v2:172.21.15.106:3300/0 conn(0x7f106c0709b0 0x7f106c0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:44.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.529+0000 7f106a000640 1 -- 172.21.15.55:0/1484380116 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359712383 0 0) 0x7f106c15e3a0 con 0x7f106c0b2fd0 2024-04-02T07:22:44.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.529+0000 7f106a000640 1 -- 172.21.15.55:0/1484380116 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1050003530 con 0x7f106c0b2fd0 2024-04-02T07:22:44.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.529+0000 7f106a000640 1 -- 172.21.15.55:0/1484380116 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3754669098 0 0) 0x7f106c15e5f0 con 0x7f106c144260 2024-04-02T07:22:44.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.529+0000 7f106a000640 1 -- 172.21.15.55:0/1484380116 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f106c15e3a0 con 0x7f106c144260 2024-04-02T07:22:44.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.529+0000 7f106aa00640 1 -- 172.21.15.55:0/1484380116 >> v1:172.21.15.106:6789/0 conn(0x7f106c144260 legacy=0x7f106c0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:44.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.529+0000 7f106aa00640 1 -- 172.21.15.55:0/1484380116 >> v1:172.21.15.55:6789/0 conn(0x7f106c0b2fd0 legacy=0x7f106c0b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:44.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.529+0000 7f106aa00640 1 -- 172.21.15.55:0/1484380116 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c15e8d0 con 0x7f106c0709b0 2024-04-02T07:22:44.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.533+0000 7f106aa00640 1 --2- 172.21.15.55:0/1484380116 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f106c0709b0 0x7f106c0b2a90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f10580097c0 tx=0x7f105801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=828a84521dc28726 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:44.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.533+0000 7f106a000640 1 -- 172.21.15.55:0/1484380116 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10580a8050 con 0x7f106c0709b0 2024-04-02T07:22:44.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.533+0000 7f106a000640 1 -- 172.21.15.55:0/1484380116 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10580ac5f0 con 0x7f106c0709b0 2024-04-02T07:22:44.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.533+0000 7f106a000640 1 -- 172.21.15.55:0/1484380116 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10580ac980 con 0x7f106c0709b0 2024-04-02T07:22:44.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.533+0000 7f1072000640 1 -- 172.21.15.55:0/1484380116 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f106c0709b0 msgr2=0x7f106c0b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:44.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.533+0000 7f1072000640 1 --2- 172.21.15.55:0/1484380116 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f106c0709b0 0x7f106c0b2a90 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f10580097c0 tx=0x7f105801c4a0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.533+0000 7f1072000640 1 -- 172.21.15.55:0/1484380116 shutdown_connections 2024-04-02T07:22:44.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.533+0000 7f1072000640 1 --2- 172.21.15.55:0/1484380116 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f106c0709b0 0x7f106c0b2a90 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.533+0000 7f1072000640 1 -- 172.21.15.55:0/1484380116 >> 172.21.15.55:0/1484380116 conn(0x7f106c06a390 msgr2=0x7f106c0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:44.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.533+0000 7f1072000640 1 -- 172.21.15.55:0/1484380116 shutdown_connections 2024-04-02T07:22:44.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.533+0000 7f1072000640 1 -- 172.21.15.55:0/1484380116 wait complete. 2024-04-02T07:22:44.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.533+0000 7f1072000640 1 Processor -- start 2024-04-02T07:22:44.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f1072000640 1 -- start start 2024-04-02T07:22:44.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f1072000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f106c0709b0 0x7f106c1588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:44.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f1072000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f106c0b2fd0 0x7f106c13d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:44.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f1072000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f106c144260 0x7f106c06c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:44.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f1072000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c1438b0 con 0x7f106c0709b0 2024-04-02T07:22:44.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f1072000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106c142480 con 0x7f106c0b2fd0 2024-04-02T07:22:44.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f1072000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106c142760 con 0x7f106c144260 2024-04-02T07:22:44.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f106b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f106c0709b0 0x7f106c1588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:44.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f106b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f106c0709b0 0x7f106c1588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53684/0 (socket says 172.21.15.55:53684) 2024-04-02T07:22:44.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f106b400640 1 -- 172.21.15.55:0/3314135997 learned_addr learned my addr 172.21.15.55:0/3314135997 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:44.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f106be00640 1 --2- 172.21.15.55:0/3314135997 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f106c144260 0x7f106c06c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:44.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f106aa00640 1 --2- 172.21.15.55:0/3314135997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f106c0b2fd0 0x7f106c13d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:44.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f106b400640 1 -- 172.21.15.55:0/3314135997 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f106c144260 msgr2=0x7f106c06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:44.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f106b400640 1 --2- 172.21.15.55:0/3314135997 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f106c144260 0x7f106c06c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f106b400640 1 -- 172.21.15.55:0/3314135997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f106c0b2fd0 msgr2=0x7f106c13d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:44.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f106b400640 1 --2- 172.21.15.55:0/3314135997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f106c0b2fd0 0x7f106c13d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f106b400640 1 -- 172.21.15.55:0/3314135997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1058009420 con 0x7f106c0709b0 2024-04-02T07:22:44.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f106be00640 1 --2- 172.21.15.55:0/3314135997 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f106c144260 0x7f106c06c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:44.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f106aa00640 1 --2- 172.21.15.55:0/3314135997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f106c0b2fd0 0x7f106c13d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:44.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f106b400640 1 --2- 172.21.15.55:0/3314135997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f106c0709b0 0x7f106c1588b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f105c00c430 tx=0x7f105c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:44.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f1063400640 1 -- 172.21.15.55:0/3314135997 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c0052d0 con 0x7f106c0709b0 2024-04-02T07:22:44.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f1063400640 1 -- 172.21.15.55:0/3314135997 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c005450 con 0x7f106c0709b0 2024-04-02T07:22:44.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f1072000640 1 -- 172.21.15.55:0/3314135997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106c142a40 con 0x7f106c0709b0 2024-04-02T07:22:44.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f1063400640 1 -- 172.21.15.55:0/3314135997 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c003840 con 0x7f106c0709b0 2024-04-02T07:22:44.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f1072000640 1 -- 172.21.15.55:0/3314135997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f106c136d00 con 0x7f106c0709b0 2024-04-02T07:22:44.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.537+0000 7f1072000640 1 -- 172.21.15.55:0/3314135997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f106c073530 con 0x7f106c0709b0 2024-04-02T07:22:44.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.541+0000 7f1063400640 1 -- 172.21.15.55:0/3314135997 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f105c0039a0 con 0x7f106c0709b0 2024-04-02T07:22:44.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.541+0000 7f1063400640 1 --2- 172.21.15.55:0/3314135997 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f104c066690 0x7f104c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:44.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.541+0000 7f1063400640 1 -- 172.21.15.55:0/3314135997 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f105c083800 con 0x7f106c0709b0 2024-04-02T07:22:44.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.541+0000 7f106aa00640 1 --2- 172.21.15.55:0/3314135997 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f104c066690 0x7f104c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:44.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.541+0000 7f106aa00640 1 --2- 172.21.15.55:0/3314135997 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f104c066690 0x7f104c068b50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f10580ae000 tx=0x7f1058008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:44.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.545+0000 7f1063400640 1 -- 172.21.15.55:0/3314135997 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f105c050b60 con 0x7f106c0709b0 2024-04-02T07:22:44.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.705+0000 7f1072000640 1 -- 172.21.15.55:0/3314135997 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f106c066c90 con 0x7f106c0709b0 2024-04-02T07:22:44.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.705+0000 7f1063400640 1 -- 172.21.15.55:0/3314135997 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f105c054180 con 0x7f106c0709b0 2024-04-02T07:22:44.712 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:22:44.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.709+0000 7f1072000640 1 -- 172.21.15.55:0/3314135997 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f104c066690 msgr2=0x7f104c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:44.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.709+0000 7f1072000640 1 --2- 172.21.15.55:0/3314135997 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f104c066690 0x7f104c068b50 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f10580ae000 tx=0x7f1058008040 comp rx=0 tx=0).stop 2024-04-02T07:22:44.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.709+0000 7f1072000640 1 -- 172.21.15.55:0/3314135997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f106c0709b0 msgr2=0x7f106c1588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:44.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.709+0000 7f1072000640 1 --2- 172.21.15.55:0/3314135997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f106c0709b0 0x7f106c1588b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f105c00c430 tx=0x7f105c00c8f0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.709+0000 7f1072000640 1 -- 172.21.15.55:0/3314135997 shutdown_connections 2024-04-02T07:22:44.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.709+0000 7f1072000640 1 --2- 172.21.15.55:0/3314135997 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f106c144260 0x7f106c06c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.709+0000 7f1072000640 1 --2- 172.21.15.55:0/3314135997 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f104c066690 0x7f104c068b50 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.709+0000 7f1072000640 1 --2- 172.21.15.55:0/3314135997 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f106c0b2fd0 0x7f106c13d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.709+0000 7f1072000640 1 --2- 172.21.15.55:0/3314135997 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f106c0709b0 0x7f106c1588b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.709+0000 7f1072000640 1 -- 172.21.15.55:0/3314135997 >> 172.21.15.55:0/3314135997 conn(0x7f106c06a390 msgr2=0x7f106c15a410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:44.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.709+0000 7f1072000640 1 -- 172.21.15.55:0/3314135997 shutdown_connections 2024-04-02T07:22:44.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.709+0000 7f1072000640 1 -- 172.21.15.55:0/3314135997 wait complete. 2024-04-02T07:22:44.732 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:22:44.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.869+0000 7f2dd0400640 1 Processor -- start 2024-04-02T07:22:44.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.869+0000 7f2dd0400640 1 -- start start 2024-04-02T07:22:44.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.873+0000 7f2dd0400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dc80cf2d0 0x7f2dc8098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:44.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.873+0000 7f2dd0400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc80ce230 con 0x7f2dc8098f50 2024-04-02T07:22:44.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.873+0000 7f2dd0400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dc80ce510 con 0x7f2dc815a9f0 2024-04-02T07:22:44.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.873+0000 7f2dd0400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc80993e0 con 0x7f2dc80cf2d0 2024-04-02T07:22:44.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.873+0000 7f2dce400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2dc8098f50 0x7f2dc80afec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49176/0 (socket says 172.21.15.55:49176) 2024-04-02T07:22:44.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.873+0000 7f2dce400640 1 -- 172.21.15.55:0/4072885234 learned_addr learned my addr 172.21.15.55:0/4072885234 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:44.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.873+0000 7f2dcd000640 1 --2- 172.21.15.55:0/4072885234 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dc80cf2d0 0x7f2dc8098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:44.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.873+0000 7f2dc7e00640 1 -- 172.21.15.55:0/4072885234 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4267429582 0 0) 0x7f2dc80ce230 con 0x7f2dc8098f50 2024-04-02T07:22:44.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.873+0000 7f2dc7e00640 1 -- 172.21.15.55:0/4072885234 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2db0003530 con 0x7f2dc8098f50 2024-04-02T07:22:44.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.873+0000 7f2dc7e00640 1 -- 172.21.15.55:0/4072885234 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3657920246 0 0) 0x7f2dc80ce510 con 0x7f2dc815a9f0 2024-04-02T07:22:44.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.873+0000 7f2dc7e00640 1 -- 172.21.15.55:0/4072885234 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2dc80ce230 con 0x7f2dc815a9f0 2024-04-02T07:22:44.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.873+0000 7f2dcd000640 1 -- 172.21.15.55:0/4072885234 >> v1:172.21.15.106:6789/0 conn(0x7f2dc815a9f0 legacy=0x7f2dc80cbd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:44.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.873+0000 7f2dcd000640 1 -- 172.21.15.55:0/4072885234 >> v1:172.21.15.55:6789/0 conn(0x7f2dc8098f50 legacy=0x7f2dc80afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:44.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.873+0000 7f2dcd000640 1 -- 172.21.15.55:0/4072885234 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dc80ce7f0 con 0x7f2dc80cf2d0 2024-04-02T07:22:44.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.877+0000 7f2dcd000640 1 --2- 172.21.15.55:0/4072885234 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dc80cf2d0 0x7f2dc8098a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2db40097f0 tx=0x7f2db401c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17b37257ad626f67 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:44.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.877+0000 7f2dc7e00640 1 -- 172.21.15.55:0/4072885234 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db40ac630 con 0x7f2dc80cf2d0 2024-04-02T07:22:44.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.877+0000 7f2dc7e00640 1 -- 172.21.15.55:0/4072885234 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2db40ac790 con 0x7f2dc80cf2d0 2024-04-02T07:22:44.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.877+0000 7f2dc7e00640 1 -- 172.21.15.55:0/4072885234 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2db40acb20 con 0x7f2dc80cf2d0 2024-04-02T07:22:44.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.877+0000 7f2dd0400640 1 -- 172.21.15.55:0/4072885234 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dc80cf2d0 msgr2=0x7f2dc8098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:44.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.877+0000 7f2dd0400640 1 --2- 172.21.15.55:0/4072885234 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dc80cf2d0 0x7f2dc8098a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2db40097f0 tx=0x7f2db401c4e0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.877+0000 7f2dd0400640 1 -- 172.21.15.55:0/4072885234 shutdown_connections 2024-04-02T07:22:44.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.877+0000 7f2dd0400640 1 --2- 172.21.15.55:0/4072885234 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dc80cf2d0 0x7f2dc8098a10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.877+0000 7f2dd0400640 1 -- 172.21.15.55:0/4072885234 >> 172.21.15.55:0/4072885234 conn(0x7f2dc80b2150 msgr2=0x7f2dc80b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:44.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.877+0000 7f2dd0400640 1 -- 172.21.15.55:0/4072885234 shutdown_connections 2024-04-02T07:22:44.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.877+0000 7f2dd0400640 1 -- 172.21.15.55:0/4072885234 wait complete. 2024-04-02T07:22:44.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.877+0000 7f2dd0400640 1 Processor -- start 2024-04-02T07:22:44.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.877+0000 7f2dd0400640 1 -- start start 2024-04-02T07:22:44.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dd0400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dc8098f50 0x7f2dc8153bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:44.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dd0400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dc80cf2d0 0x7f2dc8156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:44.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dd0400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dc815a9f0 0x7f2dc806b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:44.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dd0400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc8154450 con 0x7f2dc815a9f0 2024-04-02T07:22:44.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dd0400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc81646c0 con 0x7f2dc8098f50 2024-04-02T07:22:44.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dd0400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc81546a0 con 0x7f2dc80cf2d0 2024-04-02T07:22:44.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dce400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dc815a9f0 0x7f2dc806b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:44.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dce400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dc815a9f0 0x7f2dc806b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53700/0 (socket says 172.21.15.55:53700) 2024-04-02T07:22:44.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dce400640 1 -- 172.21.15.55:0/3028549256 learned_addr learned my addr 172.21.15.55:0/3028549256 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:44.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dcd000640 1 --2- 172.21.15.55:0/3028549256 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dc80cf2d0 0x7f2dc8156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:44.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dcda00640 1 --2- 172.21.15.55:0/3028549256 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dc8098f50 0x7f2dc8153bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:44.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dce400640 1 -- 172.21.15.55:0/3028549256 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dc80cf2d0 msgr2=0x7f2dc8156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:44.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dce400640 1 --2- 172.21.15.55:0/3028549256 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dc80cf2d0 0x7f2dc8156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dce400640 1 -- 172.21.15.55:0/3028549256 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dc8098f50 msgr2=0x7f2dc8153bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:44.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dce400640 1 --2- 172.21.15.55:0/3028549256 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dc8098f50 0x7f2dc8153bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:44.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dce400640 1 -- 172.21.15.55:0/3028549256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2db4009420 con 0x7f2dc815a9f0 2024-04-02T07:22:44.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dce400640 1 --2- 172.21.15.55:0/3028549256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dc815a9f0 0x7f2dc806b840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2dc000cb40 tx=0x7f2dc000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:44.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dc5600640 1 -- 172.21.15.55:0/3028549256 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc000aca0 con 0x7f2dc815a9f0 2024-04-02T07:22:44.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dc5600640 1 -- 172.21.15.55:0/3028549256 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dc000ae00 con 0x7f2dc815a9f0 2024-04-02T07:22:44.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dd0400640 1 -- 172.21.15.55:0/3028549256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc806caf0 con 0x7f2dc815a9f0 2024-04-02T07:22:44.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dc5600640 1 -- 172.21.15.55:0/3028549256 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dc0012620 con 0x7f2dc815a9f0 2024-04-02T07:22:44.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dd0400640 1 -- 172.21.15.55:0/3028549256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc8164350 con 0x7f2dc815a9f0 2024-04-02T07:22:44.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dd0400640 1 -- 172.21.15.55:0/3028549256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc8066c90 con 0x7f2dc815a9f0 2024-04-02T07:22:44.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.881+0000 7f2dc5600640 1 -- 172.21.15.55:0/3028549256 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2dc0007070 con 0x7f2dc815a9f0 2024-04-02T07:22:44.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.885+0000 7f2dc5600640 1 --2- 172.21.15.55:0/3028549256 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2da80666c0 0x7f2da8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:44.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.885+0000 7f2dc5600640 1 -- 172.21.15.55:0/3028549256 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2dc00840f0 con 0x7f2dc815a9f0 2024-04-02T07:22:44.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.885+0000 7f2dcda00640 1 --2- 172.21.15.55:0/3028549256 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2da80666c0 0x7f2da8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:44.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.885+0000 7f2dcda00640 1 --2- 172.21.15.55:0/3028549256 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2da80666c0 0x7f2da8068b80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc0011f0 tx=0x7f2dbc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:44.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:44.889+0000 7f2dc5600640 1 -- 172.21.15.55:0/3028549256 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2dc0051500 con 0x7f2dc815a9f0 2024-04-02T07:22:45.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.049+0000 7f2dd0400640 1 -- 172.21.15.55:0/3028549256 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2dc8099ca0 con 0x7f2dc815a9f0 2024-04-02T07:22:45.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.049+0000 7f2dc5600640 1 -- 172.21.15.55:0/3028549256 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2dc0059e60 con 0x7f2dc815a9f0 2024-04-02T07:22:45.053 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:22:45.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.049+0000 7f2dd0400640 1 -- 172.21.15.55:0/3028549256 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2da80666c0 msgr2=0x7f2da8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:45.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.049+0000 7f2dd0400640 1 --2- 172.21.15.55:0/3028549256 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2da80666c0 0x7f2da8068b80 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2dbc0011f0 tx=0x7f2dbc009040 comp rx=0 tx=0).stop 2024-04-02T07:22:45.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.049+0000 7f2dd0400640 1 -- 172.21.15.55:0/3028549256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dc815a9f0 msgr2=0x7f2dc806b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:45.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.049+0000 7f2dd0400640 1 --2- 172.21.15.55:0/3028549256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dc815a9f0 0x7f2dc806b840 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2dc000cb40 tx=0x7f2dc000a060 comp rx=0 tx=0).stop 2024-04-02T07:22:45.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.049+0000 7f2dd0400640 1 -- 172.21.15.55:0/3028549256 shutdown_connections 2024-04-02T07:22:45.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.049+0000 7f2dd0400640 1 --2- 172.21.15.55:0/3028549256 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2dc815a9f0 0x7f2dc806b840 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.049+0000 7f2dd0400640 1 --2- 172.21.15.55:0/3028549256 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2dc80cf2d0 0x7f2dc8156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.049+0000 7f2dd0400640 1 --2- 172.21.15.55:0/3028549256 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2da80666c0 0x7f2da8068b80 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.049+0000 7f2dd0400640 1 --2- 172.21.15.55:0/3028549256 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2dc8098f50 0x7f2dc8153bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.049+0000 7f2dd0400640 1 -- 172.21.15.55:0/3028549256 >> 172.21.15.55:0/3028549256 conn(0x7f2dc80b2150 msgr2=0x7f2dc806ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:45.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.049+0000 7f2dd0400640 1 -- 172.21.15.55:0/3028549256 shutdown_connections 2024-04-02T07:22:45.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.049+0000 7f2dd0400640 1 -- 172.21.15.55:0/3028549256 wait complete. 2024-04-02T07:22:45.075 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:45.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.213+0000 7f5619a00640 1 Processor -- start 2024-04-02T07:22:45.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.213+0000 7f5619a00640 1 -- start start 2024-04-02T07:22:45.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.213+0000 7f5619a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f56140b0040 0x7f561406b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:45.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.213+0000 7f5619a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f561415ce50 con 0x7f5614099120 2024-04-02T07:22:45.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.213+0000 7f5619a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56140cef60 con 0x7f561415ca70 2024-04-02T07:22:45.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.213+0000 7f5619a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f561406bd60 con 0x7f56140b0040 2024-04-02T07:22:45.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.213+0000 7f560be00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5614099120 0x7f561406aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49192/0 (socket says 172.21.15.55:49192) 2024-04-02T07:22:45.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.213+0000 7f560be00640 1 -- 172.21.15.55:0/3280689594 learned_addr learned my addr 172.21.15.55:0/3280689594 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:45.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.213+0000 7f5613400640 1 --2- 172.21.15.55:0/3280689594 >> v2:172.21.15.106:3300/0 conn(0x7f56140b0040 0x7f561406b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:45.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.213+0000 7f5612000640 1 -- 172.21.15.55:0/3280689594 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3583635600 0 0) 0x7f561415ce50 con 0x7f5614099120 2024-04-02T07:22:45.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.213+0000 7f5612000640 1 -- 172.21.15.55:0/3280689594 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55f8003530 con 0x7f5614099120 2024-04-02T07:22:45.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.213+0000 7f5612000640 1 -- 172.21.15.55:0/3280689594 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270494776 0 0) 0x7f56140cef60 con 0x7f561415ca70 2024-04-02T07:22:45.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.213+0000 7f5612000640 1 -- 172.21.15.55:0/3280689594 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f561415ce50 con 0x7f561415ca70 2024-04-02T07:22:45.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.213+0000 7f5613400640 1 -- 172.21.15.55:0/3280689594 >> v1:172.21.15.106:6789/0 conn(0x7f561415ca70 legacy=0x7f5614098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:45.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.213+0000 7f5613400640 1 -- 172.21.15.55:0/3280689594 >> v1:172.21.15.55:6789/0 conn(0x7f5614099120 legacy=0x7f561406aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:45.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.213+0000 7f5613400640 1 -- 172.21.15.55:0/3280689594 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561406c040 con 0x7f56140b0040 2024-04-02T07:22:45.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.217+0000 7f5613400640 1 --2- 172.21.15.55:0/3280689594 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56140b0040 0x7f561406b700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f560c009d90 tx=0x7f560c01c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=843fe9b2ef133ef server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:45.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.217+0000 7f5612000640 1 -- 172.21.15.55:0/3280689594 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c0a5940 con 0x7f56140b0040 2024-04-02T07:22:45.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.217+0000 7f5612000640 1 -- 172.21.15.55:0/3280689594 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560c0a5aa0 con 0x7f56140b0040 2024-04-02T07:22:45.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.217+0000 7f5612000640 1 -- 172.21.15.55:0/3280689594 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c0a5e10 con 0x7f56140b0040 2024-04-02T07:22:45.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.217+0000 7f5619a00640 1 -- 172.21.15.55:0/3280689594 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56140b0040 msgr2=0x7f561406b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:45.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.217+0000 7f5619a00640 1 --2- 172.21.15.55:0/3280689594 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56140b0040 0x7f561406b700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f560c009d90 tx=0x7f560c01c970 comp rx=0 tx=0).stop 2024-04-02T07:22:45.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.217+0000 7f5619a00640 1 -- 172.21.15.55:0/3280689594 shutdown_connections 2024-04-02T07:22:45.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.217+0000 7f5619a00640 1 --2- 172.21.15.55:0/3280689594 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56140b0040 0x7f561406b700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.217+0000 7f5619a00640 1 -- 172.21.15.55:0/3280689594 >> 172.21.15.55:0/3280689594 conn(0x7f56140b21d0 msgr2=0x7f56140b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:45.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.217+0000 7f5619a00640 1 -- 172.21.15.55:0/3280689594 shutdown_connections 2024-04-02T07:22:45.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.217+0000 7f5619a00640 1 -- 172.21.15.55:0/3280689594 wait complete. 2024-04-02T07:22:45.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f5619a00640 1 Processor -- start 2024-04-02T07:22:45.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f5619a00640 1 -- start start 2024-04-02T07:22:45.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f5619a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5614099120 0x7f56140b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f5619a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56140b0040 0x7f5614157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f5619a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f561415ca70 0x7f5614149b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f5619a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5614158390 con 0x7f561415ca70 2024-04-02T07:22:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f5619a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56140b3d60 con 0x7f5614099120 2024-04-02T07:22:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f5619a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56140b3470 con 0x7f56140b0040 2024-04-02T07:22:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f5613400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f561415ca70 0x7f5614149b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f5613400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f561415ca70 0x7f5614149b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53716/0 (socket says 172.21.15.55:53716) 2024-04-02T07:22:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f5613400640 1 -- 172.21.15.55:0/2496730672 learned_addr learned my addr 172.21.15.55:0/2496730672 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f5612a00640 1 --2- 172.21.15.55:0/2496730672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5614099120 0x7f56140b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f560be00640 1 --2- 172.21.15.55:0/2496730672 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56140b0040 0x7f5614157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f5613400640 1 -- 172.21.15.55:0/2496730672 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56140b0040 msgr2=0x7f5614157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f5613400640 1 --2- 172.21.15.55:0/2496730672 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56140b0040 0x7f5614157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f5613400640 1 -- 172.21.15.55:0/2496730672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5614099120 msgr2=0x7f56140b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:45.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f5613400640 1 --2- 172.21.15.55:0/2496730672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5614099120 0x7f56140b0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f5613400640 1 -- 172.21.15.55:0/2496730672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c009a70 con 0x7f561415ca70 2024-04-02T07:22:45.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f5613400640 1 --2- 172.21.15.55:0/2496730672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f561415ca70 0x7f5614149b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f560c009d90 tx=0x7f560c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:45.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f560aa00640 1 -- 172.21.15.55:0/2496730672 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c0aed10 con 0x7f561415ca70 2024-04-02T07:22:45.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f560aa00640 1 -- 172.21.15.55:0/2496730672 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f560c0aee70 con 0x7f561415ca70 2024-04-02T07:22:45.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f560aa00640 1 -- 172.21.15.55:0/2496730672 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f560c0b7610 con 0x7f561415ca70 2024-04-02T07:22:45.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f5619a00640 1 -- 172.21.15.55:0/2496730672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56140b3710 con 0x7f561415ca70 2024-04-02T07:22:45.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.221+0000 7f5619a00640 1 -- 172.21.15.55:0/2496730672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f561414a8d0 con 0x7f561415ca70 2024-04-02T07:22:45.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.225+0000 7f5619a00640 1 -- 172.21.15.55:0/2496730672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56140b3ed0 con 0x7f561415ca70 2024-04-02T07:22:45.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.225+0000 7f560aa00640 1 -- 172.21.15.55:0/2496730672 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f560c0b4050 con 0x7f561415ca70 2024-04-02T07:22:45.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.225+0000 7f560aa00640 1 --2- 172.21.15.55:0/2496730672 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f55f0066690 0x7f55f0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:45.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.225+0000 7f560aa00640 1 -- 172.21.15.55:0/2496730672 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f560c11f230 con 0x7f561415ca70 2024-04-02T07:22:45.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.225+0000 7f5612a00640 1 --2- 172.21.15.55:0/2496730672 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f55f0066690 0x7f55f0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:45.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.225+0000 7f5612a00640 1 --2- 172.21.15.55:0/2496730672 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f55f0066690 0x7f55f0068b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f56140b1b10 tx=0x7f5604009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:45.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.229+0000 7f560aa00640 1 -- 172.21.15.55:0/2496730672 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f560c0ec6d0 con 0x7f561415ca70 2024-04-02T07:22:45.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.393+0000 7f5619a00640 1 -- 172.21.15.55:0/2496730672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5614066c90 con 0x7f561415ca70 2024-04-02T07:22:45.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.393+0000 7f560aa00640 1 -- 172.21.15.55:0/2496730672 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f560c009450 con 0x7f561415ca70 2024-04-02T07:22:45.398 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:45.398 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:19.207279+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:45.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.397+0000 7f5619a00640 1 -- 172.21.15.55:0/2496730672 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f55f0066690 msgr2=0x7f55f0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:45.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.397+0000 7f5619a00640 1 --2- 172.21.15.55:0/2496730672 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f55f0066690 0x7f55f0068b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f56140b1b10 tx=0x7f5604009040 comp rx=0 tx=0).stop 2024-04-02T07:22:45.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.397+0000 7f5619a00640 1 -- 172.21.15.55:0/2496730672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f561415ca70 msgr2=0x7f5614149b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:45.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.397+0000 7f5619a00640 1 --2- 172.21.15.55:0/2496730672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f561415ca70 0x7f5614149b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f560c009d90 tx=0x7f560c019710 comp rx=0 tx=0).stop 2024-04-02T07:22:45.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.397+0000 7f5619a00640 1 -- 172.21.15.55:0/2496730672 shutdown_connections 2024-04-02T07:22:45.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.397+0000 7f5619a00640 1 --2- 172.21.15.55:0/2496730672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f561415ca70 0x7f5614149b50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.397+0000 7f5619a00640 1 --2- 172.21.15.55:0/2496730672 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56140b0040 0x7f5614157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.397+0000 7f5619a00640 1 --2- 172.21.15.55:0/2496730672 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f55f0066690 0x7f55f0068b50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.397+0000 7f5619a00640 1 --2- 172.21.15.55:0/2496730672 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5614099120 0x7f56140b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.397+0000 7f5619a00640 1 -- 172.21.15.55:0/2496730672 >> 172.21.15.55:0/2496730672 conn(0x7f56140b21d0 msgr2=0x7f561406e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:45.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.397+0000 7f5619a00640 1 -- 172.21.15.55:0/2496730672 shutdown_connections 2024-04-02T07:22:45.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.397+0000 7f5619a00640 1 -- 172.21.15.55:0/2496730672 wait complete. 2024-04-02T07:22:45.419 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:22:16.738297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:22:17.190496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:22:45.420 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:22:45.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.557+0000 7ff73f200640 1 Processor -- start 2024-04-02T07:22:45.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.557+0000 7ff73f200640 1 -- start start 2024-04-02T07:22:45.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.557+0000 7ff73f200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7381601a0 0x7ff7380cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:45.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff73f200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7380cfee0 con 0x7ff738099120 2024-04-02T07:22:45.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff73f200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7380d01c0 con 0x7ff738160580 2024-04-02T07:22:45.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff73f200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380d04a0 con 0x7ff7381601a0 2024-04-02T07:22:45.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff73d200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff738099120 0x7ff7380cb5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37222/0 (socket says 172.21.15.55:37222) 2024-04-02T07:22:45.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff73d200640 1 -- 172.21.15.55:0/4070663322 learned_addr learned my addr 172.21.15.55:0/4070663322 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:45.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737e00640 1 --2- 172.21.15.55:0/4070663322 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7381601a0 0x7ff7380cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:45.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737400640 1 -- 172.21.15.55:0/4070663322 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013735226 0 0) 0x7ff7380cfee0 con 0x7ff738099120 2024-04-02T07:22:45.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737400640 1 -- 172.21.15.55:0/4070663322 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff71c003530 con 0x7ff738099120 2024-04-02T07:22:45.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737400640 1 -- 172.21.15.55:0/4070663322 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393479355 0 0) 0x7ff7380d01c0 con 0x7ff738160580 2024-04-02T07:22:45.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737400640 1 -- 172.21.15.55:0/4070663322 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7380cfee0 con 0x7ff738160580 2024-04-02T07:22:45.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737400640 1 -- 172.21.15.55:0/4070663322 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3719589587 0 0) 0x7ff71c003530 con 0x7ff738099120 2024-04-02T07:22:45.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737400640 1 -- 172.21.15.55:0/4070663322 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7381601a0 msgr2=0x7ff7380cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:45.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737400640 1 --2- 172.21.15.55:0/4070663322 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7381601a0 0x7ff7380cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737400640 1 -- 172.21.15.55:0/4070663322 >> v1:172.21.15.106:6789/0 conn(0x7ff738160580 legacy=0x7ff738098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:45.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737400640 1 -- 172.21.15.55:0/4070663322 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7380cade0 con 0x7ff738099120 2024-04-02T07:22:45.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737400640 1 -- 172.21.15.55:0/4070663322 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7ff730001a00 con 0x7ff738099120 2024-04-02T07:22:45.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737e00640 1 --2- 172.21.15.55:0/4070663322 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7381601a0 0x7ff7380cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:45.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737400640 1 -- 172.21.15.55:0/4070663322 >> v1:172.21.15.55:6789/0 conn(0x7ff738099120 legacy=0x7ff7380cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:45.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737400640 1 --2- 172.21.15.55:0/4070663322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff71c003b40 0x7ff71c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:45.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737400640 1 --2- 172.21.15.55:0/4070663322 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7381601a0 0x7ff71c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:45.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737400640 1 --2- 172.21.15.55:0/4070663322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71c004d10 0x7ff71c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:45.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737400640 1 -- 172.21.15.55:0/4070663322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380d04a0 con 0x7ff71c004d10 2024-04-02T07:22:45.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737400640 1 -- 172.21.15.55:0/4070663322 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c00bb20 con 0x7ff71c003b40 2024-04-02T07:22:45.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737400640 1 -- 172.21.15.55:0/4070663322 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c00bce0 con 0x7ff7381601a0 2024-04-02T07:22:45.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737e00640 1 --2- 172.21.15.55:0/4070663322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff71c003b40 0x7ff71c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:45.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff73d200640 1 --2- 172.21.15.55:0/4070663322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71c004d10 0x7ff71c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:45.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff72fe00640 1 --2- 172.21.15.55:0/4070663322 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7381601a0 0x7ff71c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:45.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff73d200640 1 -- 172.21.15.55:0/4070663322 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7381601a0 msgr2=0x7ff71c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:45.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff73d200640 1 --2- 172.21.15.55:0/4070663322 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7381601a0 0x7ff71c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff73d200640 1 -- 172.21.15.55:0/4070663322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff71c003b40 msgr2=0x7ff71c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:45.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff73d200640 1 --2- 172.21.15.55:0/4070663322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff71c003b40 0x7ff71c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff73d200640 1 -- 172.21.15.55:0/4070663322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff728009420 con 0x7ff71c004d10 2024-04-02T07:22:45.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.561+0000 7ff737e00640 1 --2- 172.21.15.55:0/4070663322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff71c003b40 0x7ff71c003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:45.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.565+0000 7ff73d200640 1 --2- 172.21.15.55:0/4070663322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71c004d10 0x7ff71c005190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff7380b2db0 tx=0x7ff73001d230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb40ed8ada569f0a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:45.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.565+0000 7ff737400640 1 -- 172.21.15.55:0/4070663322 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7300ad630 con 0x7ff71c004d10 2024-04-02T07:22:45.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.565+0000 7ff737400640 1 -- 172.21.15.55:0/4070663322 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7300a8070 con 0x7ff71c004d10 2024-04-02T07:22:45.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.565+0000 7ff737400640 1 -- 172.21.15.55:0/4070663322 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7300ada70 con 0x7ff71c004d10 2024-04-02T07:22:45.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.565+0000 7ff73f200640 1 -- 172.21.15.55:0/4070663322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71c004d10 msgr2=0x7ff71c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:45.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.565+0000 7ff73f200640 1 --2- 172.21.15.55:0/4070663322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71c004d10 0x7ff71c005190 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff7380b2db0 tx=0x7ff73001d230 comp rx=0 tx=0).stop 2024-04-02T07:22:45.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.565+0000 7ff73d200640 1 -- 172.21.15.55:0/4070663322 reap_dead start 2024-04-02T07:22:45.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.565+0000 7ff73f200640 1 -- 172.21.15.55:0/4070663322 shutdown_connections 2024-04-02T07:22:45.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.565+0000 7ff73f200640 1 -- 172.21.15.55:0/4070663322 >> 172.21.15.55:0/4070663322 conn(0x7ff7380b2150 msgr2=0x7ff7380b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:45.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.565+0000 7ff73f200640 1 -- 172.21.15.55:0/4070663322 shutdown_connections 2024-04-02T07:22:45.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.565+0000 7ff73f200640 1 -- 172.21.15.55:0/4070663322 wait complete. 2024-04-02T07:22:45.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.565+0000 7ff73f200640 1 Processor -- start 2024-04-02T07:22:45.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.565+0000 7ff73f200640 1 -- start start 2024-04-02T07:22:45.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff73f200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71c004d10 0x7ff7380c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:45.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff73f200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7380c7730 0x7ff73815aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:45.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff73f200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7380b0550 0x7ff7380b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:45.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff73f200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380b3790 con 0x7ff71c004d10 2024-04-02T07:22:45.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff73f200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7380c92c0 con 0x7ff7380b0550 2024-04-02T07:22:45.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff73f200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73815afa0 con 0x7ff7380c7730 2024-04-02T07:22:45.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff737e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71c004d10 0x7ff7380c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:45.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff737e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71c004d10 0x7ff7380c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34010/0 (socket says 172.21.15.55:34010) 2024-04-02T07:22:45.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff737e00640 1 -- 172.21.15.55:0/3651792346 learned_addr learned my addr 172.21.15.55:0/3651792346 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:45.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff73d200640 1 --2- 172.21.15.55:0/3651792346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7380b0550 0x7ff7380b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:45.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff72fe00640 1 --2- 172.21.15.55:0/3651792346 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7380c7730 0x7ff73815aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:45.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff737e00640 1 -- 172.21.15.55:0/3651792346 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7380c7730 msgr2=0x7ff73815aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:45.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff737e00640 1 --2- 172.21.15.55:0/3651792346 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7380c7730 0x7ff73815aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff737e00640 1 -- 172.21.15.55:0/3651792346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7380b0550 msgr2=0x7ff7380b09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:45.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff737e00640 1 --2- 172.21.15.55:0/3651792346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7380b0550 0x7ff7380b09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff737e00640 1 -- 172.21.15.55:0/3651792346 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7380caa20 con 0x7ff71c004d10 2024-04-02T07:22:45.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff737e00640 1 --2- 172.21.15.55:0/3651792346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71c004d10 0x7ff7380c8d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff728011cd0 tx=0x7ff72800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:45.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff734c00640 1 -- 172.21.15.55:0/3651792346 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff728014440 con 0x7ff71c004d10 2024-04-02T07:22:45.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff734c00640 1 -- 172.21.15.55:0/3651792346 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7280145a0 con 0x7ff71c004d10 2024-04-02T07:22:45.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff734c00640 1 -- 172.21.15.55:0/3651792346 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff728014910 con 0x7ff71c004d10 2024-04-02T07:22:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff73f200640 1 -- 172.21.15.55:0/3651792346 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7380b5ef0 con 0x7ff71c004d10 2024-04-02T07:22:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff73f200640 1 -- 172.21.15.55:0/3651792346 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7380b30d0 con 0x7ff71c004d10 2024-04-02T07:22:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff73f200640 1 -- 172.21.15.55:0/3651792346 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7380723d0 con 0x7ff71c004d10 2024-04-02T07:22:45.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.569+0000 7ff734c00640 1 -- 172.21.15.55:0/3651792346 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff728014a70 con 0x7ff71c004d10 2024-04-02T07:22:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.573+0000 7ff734c00640 1 --2- 172.21.15.55:0/3651792346 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff7140666c0 0x7ff714068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.573+0000 7ff734c00640 1 -- 172.21.15.55:0/3651792346 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff728084cc0 con 0x7ff71c004d10 2024-04-02T07:22:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.573+0000 7ff72fe00640 1 --2- 172.21.15.55:0/3651792346 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff7140666c0 0x7ff714068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:45.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.573+0000 7ff72fe00640 1 --2- 172.21.15.55:0/3651792346 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff7140666c0 0x7ff714068b80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff7380b1830 tx=0x7ff720009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:45.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.577+0000 7ff734c00640 1 -- 172.21.15.55:0/3651792346 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff72808b080 con 0x7ff71c004d10 2024-04-02T07:22:45.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.737+0000 7ff73f200640 1 -- 172.21.15.55:0/3651792346 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff738066c90 con 0x7ff71c004d10 2024-04-02T07:22:45.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.737+0000 7ff734c00640 1 -- 172.21.15.55:0/3651792346 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff728022020 con 0x7ff71c004d10 2024-04-02T07:22:45.742 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:22:45.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.741+0000 7ff73f200640 1 -- 172.21.15.55:0/3651792346 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff7140666c0 msgr2=0x7ff714068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:45.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.741+0000 7ff73f200640 1 --2- 172.21.15.55:0/3651792346 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff7140666c0 0x7ff714068b80 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff7380b1830 tx=0x7ff720009040 comp rx=0 tx=0).stop 2024-04-02T07:22:45.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.741+0000 7ff73f200640 1 -- 172.21.15.55:0/3651792346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71c004d10 msgr2=0x7ff7380c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:45.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.741+0000 7ff73f200640 1 --2- 172.21.15.55:0/3651792346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71c004d10 0x7ff7380c8d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff728011cd0 tx=0x7ff72800f610 comp rx=0 tx=0).stop 2024-04-02T07:22:45.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.741+0000 7ff73f200640 1 -- 172.21.15.55:0/3651792346 shutdown_connections 2024-04-02T07:22:45.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.741+0000 7ff73f200640 1 --2- 172.21.15.55:0/3651792346 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff7140666c0 0x7ff714068b80 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.741+0000 7ff73f200640 1 --2- 172.21.15.55:0/3651792346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7380b0550 0x7ff7380b09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.741+0000 7ff73f200640 1 --2- 172.21.15.55:0/3651792346 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7380c7730 0x7ff73815aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.741+0000 7ff73f200640 1 --2- 172.21.15.55:0/3651792346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71c004d10 0x7ff7380c8d80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.741+0000 7ff73f200640 1 -- 172.21.15.55:0/3651792346 >> 172.21.15.55:0/3651792346 conn(0x7ff7380b2150 msgr2=0x7ff73806edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:45.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.741+0000 7ff73f200640 1 -- 172.21.15.55:0/3651792346 shutdown_connections 2024-04-02T07:22:45.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.741+0000 7ff73f200640 1 -- 172.21.15.55:0/3651792346 wait complete. 2024-04-02T07:22:45.764 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:22:45.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.901+0000 7f87a5800640 1 Processor -- start 2024-04-02T07:22:45.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.901+0000 7f87a5800640 1 -- start start 2024-04-02T07:22:45.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.905+0000 7f87a5800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87a0144260 0x7f87a00702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:45.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.905+0000 7f87a5800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87a00707e0 0x7f87a00b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:45.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.905+0000 7f87a5800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a015e3a0 con 0x7f87a00b2fd0 2024-04-02T07:22:45.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.905+0000 7f87a5800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a00b37c0 con 0x7f87a0144260 2024-04-02T07:22:45.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.905+0000 7f87a5800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a0070c60 con 0x7f87a00707e0 2024-04-02T07:22:45.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.905+0000 7f879ea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87a0144260 0x7f87a00702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:45.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.905+0000 7f879ea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87a0144260 0x7f87a00702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34012/0 (socket says 172.21.15.55:34012) 2024-04-02T07:22:45.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.905+0000 7f879ea00640 1 -- 172.21.15.55:0/3650757086 learned_addr learned my addr 172.21.15.55:0/3650757086 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:45.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.905+0000 7f8797e00640 1 --2- 172.21.15.55:0/3650757086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87a00707e0 0x7f87a00b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:45.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.905+0000 7f879ea00640 1 -- 172.21.15.55:0/3650757086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87a00707e0 msgr2=0x7f87a00b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:45.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.905+0000 7f879ea00640 1 --2- 172.21.15.55:0/3650757086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87a00707e0 0x7f87a00b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.905+0000 7f879ea00640 1 -- 172.21.15.55:0/3650757086 >> v1:172.21.15.106:6789/0 conn(0x7f87a00b2fd0 legacy=0x7f87a00cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:45.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.905+0000 7f879ea00640 1 -- 172.21.15.55:0/3650757086 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a015e5f0 con 0x7f87a0144260 2024-04-02T07:22:45.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.909+0000 7f879ea00640 1 --2- 172.21.15.55:0/3650757086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87a0144260 0x7f87a00702a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8790009870 tx=0x7f879001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d54df7b60e4f27e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:45.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.909+0000 7f879e000640 1 -- 172.21.15.55:0/3650757086 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87900ab600 con 0x7f87a0144260 2024-04-02T07:22:45.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.909+0000 7f879e000640 1 -- 172.21.15.55:0/3650757086 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87900a7050 con 0x7f87a0144260 2024-04-02T07:22:45.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.909+0000 7f879e000640 1 -- 172.21.15.55:0/3650757086 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87900ab980 con 0x7f87a0144260 2024-04-02T07:22:45.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.909+0000 7f87a5800640 1 -- 172.21.15.55:0/3650757086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87a0144260 msgr2=0x7f87a00702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:45.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.909+0000 7f87a5800640 1 --2- 172.21.15.55:0/3650757086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87a0144260 0x7f87a00702a0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8790009870 tx=0x7f879001c560 comp rx=0 tx=0).stop 2024-04-02T07:22:45.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.909+0000 7f87a5800640 1 -- 172.21.15.55:0/3650757086 shutdown_connections 2024-04-02T07:22:45.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.909+0000 7f87a5800640 1 --2- 172.21.15.55:0/3650757086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87a00707e0 0x7f87a00b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.909+0000 7f87a5800640 1 --2- 172.21.15.55:0/3650757086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87a0144260 0x7f87a00702a0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.909+0000 7f87a5800640 1 -- 172.21.15.55:0/3650757086 >> 172.21.15.55:0/3650757086 conn(0x7f87a006a390 msgr2=0x7f87a00b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:45.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.909+0000 7f87a5800640 1 -- 172.21.15.55:0/3650757086 shutdown_connections 2024-04-02T07:22:45.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.909+0000 7f87a5800640 1 -- 172.21.15.55:0/3650757086 wait complete. 2024-04-02T07:22:45.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.909+0000 7f87a5800640 1 Processor -- start 2024-04-02T07:22:45.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.909+0000 7f87a5800640 1 -- start start 2024-04-02T07:22:45.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f87a5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87a00707e0 0x7f87a013bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:45.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f87a5800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87a00b2fd0 0x7f87a01402f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:45.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f87a5800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87a0144260 0x7f87a0139930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:45.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f87a5800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a013fe60 con 0x7f87a00707e0 2024-04-02T07:22:45.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f87a5800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a013f250 con 0x7f87a0144260 2024-04-02T07:22:45.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f87a5800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a013f530 con 0x7f87a00b2fd0 2024-04-02T07:22:45.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f879ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87a00707e0 0x7f87a013bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:45.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f879ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87a00707e0 0x7f87a013bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34028/0 (socket says 172.21.15.55:34028) 2024-04-02T07:22:45.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f879ea00640 1 -- 172.21.15.55:0/1908577809 learned_addr learned my addr 172.21.15.55:0/1908577809 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:45.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f8797e00640 1 --2- 172.21.15.55:0/1908577809 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87a00b2fd0 0x7f87a01402f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:45.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f879f400640 1 --2- 172.21.15.55:0/1908577809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87a0144260 0x7f87a0139930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:45.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f879ea00640 1 -- 172.21.15.55:0/1908577809 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87a00b2fd0 msgr2=0x7f87a01402f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:45.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f879ea00640 1 --2- 172.21.15.55:0/1908577809 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87a00b2fd0 0x7f87a01402f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f879ea00640 1 -- 172.21.15.55:0/1908577809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87a0144260 msgr2=0x7f87a0139930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:45.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f879ea00640 1 --2- 172.21.15.55:0/1908577809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87a0144260 0x7f87a0139930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:45.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f879ea00640 1 -- 172.21.15.55:0/1908577809 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87900094d0 con 0x7f87a00707e0 2024-04-02T07:22:45.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f879f400640 1 --2- 172.21.15.55:0/1908577809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87a0144260 0x7f87a0139930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:45.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f879ea00640 1 --2- 172.21.15.55:0/1908577809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87a00707e0 0x7f87a013bc30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f87900ae040 tx=0x7f879001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:45.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f8796a00640 1 -- 172.21.15.55:0/1908577809 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87900b6620 con 0x7f87a00707e0 2024-04-02T07:22:45.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f8796a00640 1 -- 172.21.15.55:0/1908577809 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87900b67a0 con 0x7f87a00707e0 2024-04-02T07:22:45.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f8796a00640 1 -- 172.21.15.55:0/1908577809 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87900b6b50 con 0x7f87a00707e0 2024-04-02T07:22:45.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f87a5800640 1 -- 172.21.15.55:0/1908577809 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a013f810 con 0x7f87a00707e0 2024-04-02T07:22:45.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f87a5800640 1 -- 172.21.15.55:0/1908577809 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a0140830 con 0x7f87a00707e0 2024-04-02T07:22:45.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f87a5800640 1 -- 172.21.15.55:0/1908577809 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a0073530 con 0x7f87a00707e0 2024-04-02T07:22:45.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.913+0000 7f8796a00640 1 -- 172.21.15.55:0/1908577809 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f87900b2040 con 0x7f87a00707e0 2024-04-02T07:22:45.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.917+0000 7f8796a00640 1 --2- 172.21.15.55:0/1908577809 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f877c0666c0 0x7f877c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:45.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.917+0000 7f8796a00640 1 -- 172.21.15.55:0/1908577809 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f879011e450 con 0x7f87a00707e0 2024-04-02T07:22:45.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.917+0000 7f8797e00640 1 --2- 172.21.15.55:0/1908577809 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f877c0666c0 0x7f877c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:45.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.917+0000 7f8797e00640 1 --2- 172.21.15.55:0/1908577809 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f877c0666c0 0x7f877c068b80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f87a015dd70 tx=0x7f8788008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:45.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:45.921+0000 7f8796a00640 1 -- 172.21.15.55:0/1908577809 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f87900eb720 con 0x7f87a00707e0 2024-04-02T07:22:46.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.081+0000 7f87a5800640 1 -- 172.21.15.55:0/1908577809 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f87a0066c90 con 0x7f87a00707e0 2024-04-02T07:22:46.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.081+0000 7f8796a00640 1 -- 172.21.15.55:0/1908577809 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f87900eed40 con 0x7f87a00707e0 2024-04-02T07:22:46.085 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:22:46.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.081+0000 7f87a5800640 1 -- 172.21.15.55:0/1908577809 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f877c0666c0 msgr2=0x7f877c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:46.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.081+0000 7f87a5800640 1 --2- 172.21.15.55:0/1908577809 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f877c0666c0 0x7f877c068b80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f87a015dd70 tx=0x7f8788008040 comp rx=0 tx=0).stop 2024-04-02T07:22:46.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.081+0000 7f87a5800640 1 -- 172.21.15.55:0/1908577809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87a00707e0 msgr2=0x7f87a013bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:46.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.081+0000 7f87a5800640 1 --2- 172.21.15.55:0/1908577809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87a00707e0 0x7f87a013bc30 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f87900ae040 tx=0x7f879001ada0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.081+0000 7f87a5800640 1 -- 172.21.15.55:0/1908577809 shutdown_connections 2024-04-02T07:22:46.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.081+0000 7f87a5800640 1 --2- 172.21.15.55:0/1908577809 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f877c0666c0 0x7f877c068b80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.081+0000 7f87a5800640 1 --2- 172.21.15.55:0/1908577809 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87a0144260 0x7f87a0139930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.081+0000 7f87a5800640 1 --2- 172.21.15.55:0/1908577809 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87a00b2fd0 0x7f87a01402f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.081+0000 7f87a5800640 1 --2- 172.21.15.55:0/1908577809 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87a00707e0 0x7f87a013bc30 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.081+0000 7f87a5800640 1 -- 172.21.15.55:0/1908577809 >> 172.21.15.55:0/1908577809 conn(0x7f87a006a390 msgr2=0x7f87a0072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:46.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.085+0000 7f87a5800640 1 -- 172.21.15.55:0/1908577809 shutdown_connections 2024-04-02T07:22:46.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.085+0000 7f87a5800640 1 -- 172.21.15.55:0/1908577809 wait complete. 2024-04-02T07:22:46.106 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:22:46.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.245+0000 7ff167200640 1 Processor -- start 2024-04-02T07:22:46.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.245+0000 7ff167200640 1 -- start start 2024-04-02T07:22:46.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.249+0000 7ff167200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff16815c8f0 0x7ff1680cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:46.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.249+0000 7ff167200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16815ccd0 con 0x7ff1680b2300 2024-04-02T07:22:46.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.249+0000 7ff167200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1680b2e10 con 0x7ff1680d2ae0 2024-04-02T07:22:46.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.249+0000 7ff167200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680b30f0 con 0x7ff16815c8f0 2024-04-02T07:22:46.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.249+0000 7ff15d400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff1680b2300 0x7ff1680d23d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37228/0 (socket says 172.21.15.55:37228) 2024-04-02T07:22:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.249+0000 7ff15d400640 1 -- 172.21.15.55:0/3793432955 learned_addr learned my addr 172.21.15.55:0/3793432955 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.249+0000 7ff165e00640 1 --2- 172.21.15.55:0/3793432955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff16815c8f0 0x7ff1680cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.249+0000 7ff165400640 1 -- 172.21.15.55:0/3793432955 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512180759 0 0) 0x7ff16815ccd0 con 0x7ff1680b2300 2024-04-02T07:22:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.249+0000 7ff165400640 1 -- 172.21.15.55:0/3793432955 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff14c003530 con 0x7ff1680b2300 2024-04-02T07:22:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.249+0000 7ff165400640 1 -- 172.21.15.55:0/3793432955 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393494856 0 0) 0x7ff1680b2e10 con 0x7ff1680d2ae0 2024-04-02T07:22:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.249+0000 7ff165400640 1 -- 172.21.15.55:0/3793432955 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff16815ccd0 con 0x7ff1680d2ae0 2024-04-02T07:22:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.249+0000 7ff165e00640 1 -- 172.21.15.55:0/3793432955 >> v1:172.21.15.106:6789/0 conn(0x7ff1680d2ae0 legacy=0x7ff1680d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.249+0000 7ff165e00640 1 -- 172.21.15.55:0/3793432955 >> v1:172.21.15.55:6789/0 conn(0x7ff1680b2300 legacy=0x7ff1680d23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:46.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.249+0000 7ff165e00640 1 -- 172.21.15.55:0/3793432955 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1680b33d0 con 0x7ff16815c8f0 2024-04-02T07:22:46.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.253+0000 7ff165e00640 1 --2- 172.21.15.55:0/3793432955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff16815c8f0 0x7ff1680cd200 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff158009dc0 tx=0x7ff15801c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b674dd698b17c557 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:46.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.253+0000 7ff165400640 1 -- 172.21.15.55:0/3793432955 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1580a5a20 con 0x7ff16815c8f0 2024-04-02T07:22:46.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.253+0000 7ff165400640 1 -- 172.21.15.55:0/3793432955 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1580a5b80 con 0x7ff16815c8f0 2024-04-02T07:22:46.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.253+0000 7ff165400640 1 -- 172.21.15.55:0/3793432955 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1580ad440 con 0x7ff16815c8f0 2024-04-02T07:22:46.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.253+0000 7ff167200640 1 -- 172.21.15.55:0/3793432955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff16815c8f0 msgr2=0x7ff1680cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:46.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.253+0000 7ff167200640 1 --2- 172.21.15.55:0/3793432955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff16815c8f0 0x7ff1680cd200 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff158009dc0 tx=0x7ff15801c960 comp rx=0 tx=0).stop 2024-04-02T07:22:46.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.253+0000 7ff167200640 1 -- 172.21.15.55:0/3793432955 shutdown_connections 2024-04-02T07:22:46.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.253+0000 7ff167200640 1 --2- 172.21.15.55:0/3793432955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff16815c8f0 0x7ff1680cd200 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.253+0000 7ff167200640 1 -- 172.21.15.55:0/3793432955 >> 172.21.15.55:0/3793432955 conn(0x7ff16809b9f0 msgr2=0x7ff168089fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:46.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.253+0000 7ff167200640 1 -- 172.21.15.55:0/3793432955 shutdown_connections 2024-04-02T07:22:46.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.253+0000 7ff167200640 1 -- 172.21.15.55:0/3793432955 wait complete. 2024-04-02T07:22:46.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.253+0000 7ff167200640 1 Processor -- start 2024-04-02T07:22:46.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.253+0000 7ff167200640 1 -- start start 2024-04-02T07:22:46.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.253+0000 7ff167200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1680b2300 0x7ff1680cc190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:46.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.253+0000 7ff167200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff1680d2ae0 0x7ff1680b54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:46.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.253+0000 7ff167200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff16815c8f0 0x7ff16815f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:46.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.253+0000 7ff167200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16815ba10 con 0x7ff16815c8f0 2024-04-02T07:22:46.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.253+0000 7ff167200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16815b0e0 con 0x7ff1680b2300 2024-04-02T07:22:46.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.253+0000 7ff167200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16815b3c0 con 0x7ff1680d2ae0 2024-04-02T07:22:46.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.253+0000 7ff166800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff16815c8f0 0x7ff16815f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:46.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.257+0000 7ff166800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff16815c8f0 0x7ff16815f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34044/0 (socket says 172.21.15.55:34044) 2024-04-02T07:22:46.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.257+0000 7ff166800640 1 -- 172.21.15.55:0/2406831202 learned_addr learned my addr 172.21.15.55:0/2406831202 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:46.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.257+0000 7ff165e00640 1 --2- 172.21.15.55:0/2406831202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1680b2300 0x7ff1680cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:46.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.257+0000 7ff15d400640 1 --2- 172.21.15.55:0/2406831202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff1680d2ae0 0x7ff1680b54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:46.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.257+0000 7ff166800640 1 -- 172.21.15.55:0/2406831202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff1680d2ae0 msgr2=0x7ff1680b54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:46.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.257+0000 7ff166800640 1 --2- 172.21.15.55:0/2406831202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff1680d2ae0 0x7ff1680b54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.257+0000 7ff166800640 1 -- 172.21.15.55:0/2406831202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1680b2300 msgr2=0x7ff1680cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:46.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.257+0000 7ff166800640 1 --2- 172.21.15.55:0/2406831202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1680b2300 0x7ff1680cc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.257+0000 7ff166800640 1 -- 172.21.15.55:0/2406831202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff158009a70 con 0x7ff16815c8f0 2024-04-02T07:22:46.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.257+0000 7ff15d400640 1 --2- 172.21.15.55:0/2406831202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff1680d2ae0 0x7ff1680b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:46.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.257+0000 7ff166800640 1 --2- 172.21.15.55:0/2406831202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff16815c8f0 0x7ff16815f3e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff16000c3c0 tx=0x7ff16000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:46.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.257+0000 7ff15ea00640 1 -- 172.21.15.55:0/2406831202 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1600052d0 con 0x7ff16815c8f0 2024-04-02T07:22:46.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.257+0000 7ff15ea00640 1 -- 172.21.15.55:0/2406831202 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff160005430 con 0x7ff16815c8f0 2024-04-02T07:22:46.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.257+0000 7ff15ea00640 1 -- 172.21.15.55:0/2406831202 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff160003840 con 0x7ff16815c8f0 2024-04-02T07:22:46.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.257+0000 7ff167200640 1 -- 172.21.15.55:0/2406831202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff16815b6a0 con 0x7ff16815c8f0 2024-04-02T07:22:46.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.257+0000 7ff167200640 1 -- 172.21.15.55:0/2406831202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1680cc6d0 con 0x7ff16815c8f0 2024-04-02T07:22:46.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.257+0000 7ff167200640 1 -- 172.21.15.55:0/2406831202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff16815be80 con 0x7ff16815c8f0 2024-04-02T07:22:46.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.257+0000 7ff15ea00640 1 -- 172.21.15.55:0/2406831202 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff1600039a0 con 0x7ff16815c8f0 2024-04-02T07:22:46.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.257+0000 7ff15ea00640 1 --2- 172.21.15.55:0/2406831202 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff144066690 0x7ff144068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:46.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.257+0000 7ff15ea00640 1 -- 172.21.15.55:0/2406831202 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff160083600 con 0x7ff16815c8f0 2024-04-02T07:22:46.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.261+0000 7ff165e00640 1 --2- 172.21.15.55:0/2406831202 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff144066690 0x7ff144068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:46.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.261+0000 7ff165e00640 1 --2- 172.21.15.55:0/2406831202 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff144066690 0x7ff144068b50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff1580af000 tx=0x7ff1580a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:46.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.261+0000 7ff15ea00640 1 -- 172.21.15.55:0/2406831202 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff160050ab0 con 0x7ff16815c8f0 2024-04-02T07:22:46.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.424+0000 7ff167200640 1 -- 172.21.15.55:0/2406831202 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff1680b4d30 con 0x7ff16815c8f0 2024-04-02T07:22:46.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.424+0000 7ff15ea00640 1 -- 172.21.15.55:0/2406831202 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff1600540d0 con 0x7ff16815c8f0 2024-04-02T07:22:46.429 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:22:46.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.424+0000 7ff167200640 1 -- 172.21.15.55:0/2406831202 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff144066690 msgr2=0x7ff144068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:46.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.424+0000 7ff167200640 1 --2- 172.21.15.55:0/2406831202 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff144066690 0x7ff144068b50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff1580af000 tx=0x7ff1580a7070 comp rx=0 tx=0).stop 2024-04-02T07:22:46.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.424+0000 7ff167200640 1 -- 172.21.15.55:0/2406831202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff16815c8f0 msgr2=0x7ff16815f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:46.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.424+0000 7ff167200640 1 --2- 172.21.15.55:0/2406831202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff16815c8f0 0x7ff16815f3e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ff16000c3c0 tx=0x7ff16000c880 comp rx=0 tx=0).stop 2024-04-02T07:22:46.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.424+0000 7ff167200640 1 -- 172.21.15.55:0/2406831202 shutdown_connections 2024-04-02T07:22:46.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.424+0000 7ff167200640 1 --2- 172.21.15.55:0/2406831202 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff16815c8f0 0x7ff16815f3e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.424+0000 7ff167200640 1 --2- 172.21.15.55:0/2406831202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff1680d2ae0 0x7ff1680b54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.424+0000 7ff167200640 1 --2- 172.21.15.55:0/2406831202 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff144066690 0x7ff144068b50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.424+0000 7ff167200640 1 --2- 172.21.15.55:0/2406831202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff1680b2300 0x7ff1680cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.424+0000 7ff167200640 1 -- 172.21.15.55:0/2406831202 >> 172.21.15.55:0/2406831202 conn(0x7ff16809b9f0 msgr2=0x7ff1680d23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:46.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.424+0000 7ff167200640 1 -- 172.21.15.55:0/2406831202 shutdown_connections 2024-04-02T07:22:46.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.424+0000 7ff167200640 1 -- 172.21.15.55:0/2406831202 wait complete. 2024-04-02T07:22:46.451 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:46.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.584+0000 7f0524000640 1 Processor -- start 2024-04-02T07:22:46.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.584+0000 7f0524000640 1 -- start start 2024-04-02T07:22:46.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f0524000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f051c0b0cb0 0x7f051c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:46.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f0524000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f051c15d010 0x7f051c0cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:46.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f0524000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f051c0cac90 con 0x7f051c0c3680 2024-04-02T07:22:46.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f0524000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f051c0b1090 con 0x7f051c15d010 2024-04-02T07:22:46.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f0524000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051c0caf70 con 0x7f051c0b0cb0 2024-04-02T07:22:46.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f0520c00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f051c0c3680 0x7f051c15c900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37232/0 (socket says 172.21.15.55:37232) 2024-04-02T07:22:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f0520c00640 1 -- 172.21.15.55:0/1568449319 learned_addr learned my addr 172.21.15.55:0/1568449319 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f0522000640 1 --2- 172.21.15.55:0/1568449319 >> v2:172.21.15.106:3300/0 conn(0x7f051c15d010 0x7f051c0cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f0521600640 1 --2- 172.21.15.55:0/1568449319 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f051c0b0cb0 0x7f051c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f051be00640 1 -- 172.21.15.55:0/1568449319 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2496458994 0 0) 0x7f051c0cac90 con 0x7f051c0c3680 2024-04-02T07:22:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f051be00640 1 -- 172.21.15.55:0/1568449319 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0504003530 con 0x7f051c0c3680 2024-04-02T07:22:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f051be00640 1 -- 172.21.15.55:0/1568449319 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 965046796 0 0) 0x7f0504003530 con 0x7f051c0c3680 2024-04-02T07:22:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f051be00640 1 -- 172.21.15.55:0/1568449319 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f051c0b0cb0 msgr2=0x7f051c0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f051be00640 1 --2- 172.21.15.55:0/1568449319 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f051c0b0cb0 0x7f051c0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f051be00640 1 -- 172.21.15.55:0/1568449319 >> v2:172.21.15.106:3300/0 conn(0x7f051c15d010 msgr2=0x7f051c0cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f051be00640 1 --2- 172.21.15.55:0/1568449319 >> v2:172.21.15.106:3300/0 conn(0x7f051c15d010 0x7f051c0cbe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f051be00640 1 -- 172.21.15.55:0/1568449319 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051c0b2d90 con 0x7f051c0c3680 2024-04-02T07:22:46.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f051be00640 1 -- 172.21.15.55:0/1568449319 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f0508001680 con 0x7f051c0c3680 2024-04-02T07:22:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f051be00640 1 -- 172.21.15.55:0/1568449319 >> v1:172.21.15.55:6789/0 conn(0x7f051c0c3680 legacy=0x7f051c15c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f051be00640 1 --2- 172.21.15.55:0/1568449319 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0504003980 0x7f0504003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f051be00640 1 --2- 172.21.15.55:0/1568449319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05040047d0 0x7f0504004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f051be00640 1 --2- 172.21.15.55:0/1568449319 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f051c0b0cb0 0x7f0504005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f051be00640 1 -- 172.21.15.55:0/1568449319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051c0b1090 con 0x7f05040047d0 2024-04-02T07:22:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f051be00640 1 -- 172.21.15.55:0/1568449319 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051c0caf70 con 0x7f0504003980 2024-04-02T07:22:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f051be00640 1 -- 172.21.15.55:0/1568449319 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f050400b990 con 0x7f051c0b0cb0 2024-04-02T07:22:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f0520c00640 1 --2- 172.21.15.55:0/1568449319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05040047d0 0x7f0504004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f0521600640 1 --2- 172.21.15.55:0/1568449319 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0504003980 0x7f0504003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f0522000640 1 --2- 172.21.15.55:0/1568449319 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f051c0b0cb0 0x7f0504005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f0520c00640 1 -- 172.21.15.55:0/1568449319 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f051c0b0cb0 msgr2=0x7f0504005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f0520c00640 1 --2- 172.21.15.55:0/1568449319 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f051c0b0cb0 0x7f0504005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f0520c00640 1 -- 172.21.15.55:0/1568449319 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0504003980 msgr2=0x7f0504003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:46.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f0520c00640 1 --2- 172.21.15.55:0/1568449319 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0504003980 0x7f0504003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f0520c00640 1 -- 172.21.15.55:0/1568449319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0504003530 con 0x7f05040047d0 2024-04-02T07:22:46.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.588+0000 7f0521600640 1 --2- 172.21.15.55:0/1568449319 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0504003980 0x7f0504003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:46.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.592+0000 7f0520c00640 1 --2- 172.21.15.55:0/1568449319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05040047d0 0x7f0504004c50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f050800c240 tx=0x7f050801f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b448fdf577248e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:46.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.592+0000 7f051be00640 1 -- 172.21.15.55:0/1568449319 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508005ae0 con 0x7f05040047d0 2024-04-02T07:22:46.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.592+0000 7f051be00640 1 -- 172.21.15.55:0/1568449319 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05080ab070 con 0x7f05040047d0 2024-04-02T07:22:46.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.592+0000 7f051be00640 1 -- 172.21.15.55:0/1568449319 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508005ea0 con 0x7f05040047d0 2024-04-02T07:22:46.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.592+0000 7f0524000640 1 -- 172.21.15.55:0/1568449319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05040047d0 msgr2=0x7f0504004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.592+0000 7f0524000640 1 --2- 172.21.15.55:0/1568449319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05040047d0 0x7f0504004c50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f050800c240 tx=0x7f050801f3f0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.592+0000 7f0522000640 1 -- 172.21.15.55:0/1568449319 reap_dead start 2024-04-02T07:22:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.592+0000 7f0524000640 1 -- 172.21.15.55:0/1568449319 shutdown_connections 2024-04-02T07:22:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.592+0000 7f0524000640 1 -- 172.21.15.55:0/1568449319 >> 172.21.15.55:0/1568449319 conn(0x7f051c066080 msgr2=0x7f051c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.592+0000 7f0524000640 1 -- 172.21.15.55:0/1568449319 shutdown_connections 2024-04-02T07:22:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.592+0000 7f0524000640 1 -- 172.21.15.55:0/1568449319 wait complete. 2024-04-02T07:22:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0524000640 1 Processor -- start 2024-04-02T07:22:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0524000640 1 -- start start 2024-04-02T07:22:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0524000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05040047d0 0x7f051c0c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0524000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f051c1f6400 0x7f051c0afb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0524000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f051c0cce80 0x7f051c0cd300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0524000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051c0cd840 con 0x7f051c1f6400 2024-04-02T07:22:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0524000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051c0c82e0 con 0x7f05040047d0 2024-04-02T07:22:46.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0524000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f051c0c85c0 con 0x7f051c0cce80 2024-04-02T07:22:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0520c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f051c1f6400 0x7f051c0afb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0520c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f051c1f6400 0x7f051c0afb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34070/0 (socket says 172.21.15.55:34070) 2024-04-02T07:22:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0520c00640 1 -- 172.21.15.55:0/1541714830 learned_addr learned my addr 172.21.15.55:0/1541714830 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0521600640 1 --2- 172.21.15.55:0/1541714830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05040047d0 0x7f051c0c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0522000640 1 --2- 172.21.15.55:0/1541714830 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f051c0cce80 0x7f051c0cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0520c00640 1 -- 172.21.15.55:0/1541714830 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f051c0cce80 msgr2=0x7f051c0cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0520c00640 1 --2- 172.21.15.55:0/1541714830 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f051c0cce80 0x7f051c0cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0520c00640 1 -- 172.21.15.55:0/1541714830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05040047d0 msgr2=0x7f051c0c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0520c00640 1 --2- 172.21.15.55:0/1541714830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05040047d0 0x7f051c0c7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0520c00640 1 -- 172.21.15.55:0/1541714830 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f051c0c88a0 con 0x7f051c1f6400 2024-04-02T07:22:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0520c00640 1 --2- 172.21.15.55:0/1541714830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f051c1f6400 0x7f051c0afb80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f050801f220 tx=0x7f0504005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0519600640 1 -- 172.21.15.55:0/1541714830 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05080b7070 con 0x7f051c1f6400 2024-04-02T07:22:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0519600640 1 -- 172.21.15.55:0/1541714830 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0508005940 con 0x7f051c1f6400 2024-04-02T07:22:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0519600640 1 -- 172.21.15.55:0/1541714830 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508005cd0 con 0x7f051c1f6400 2024-04-02T07:22:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0524000640 1 -- 172.21.15.55:0/1541714830 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f051c0c8b80 con 0x7f051c1f6400 2024-04-02T07:22:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0524000640 1 -- 172.21.15.55:0/1541714830 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f051c1f6860 con 0x7f051c1f6400 2024-04-02T07:22:46.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.596+0000 7f0524000640 1 -- 172.21.15.55:0/1541714830 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f051c066c90 con 0x7f051c1f6400 2024-04-02T07:22:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.600+0000 7f0519600640 1 -- 172.21.15.55:0/1541714830 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f05080ad020 con 0x7f051c1f6400 2024-04-02T07:22:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.600+0000 7f0519600640 1 --2- 172.21.15.55:0/1541714830 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f04fc066650 0x7f04fc068b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.600+0000 7f0519600640 1 -- 172.21.15.55:0/1541714830 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0508120b30 con 0x7f051c1f6400 2024-04-02T07:22:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.600+0000 7f0521600640 1 --2- 172.21.15.55:0/1541714830 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f04fc066650 0x7f04fc068b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:46.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.600+0000 7f0521600640 1 --2- 172.21.15.55:0/1541714830 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f04fc066650 0x7f04fc068b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0510009b60 tx=0x7f0510008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:46.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.604+0000 7f0519600640 1 -- 172.21.15.55:0/1541714830 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f05080f1890 con 0x7f051c1f6400 2024-04-02T07:22:46.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.764+0000 7f0524000640 1 -- 172.21.15.55:0/1541714830 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f051c15c2a0 con 0x7f051c1f6400 2024-04-02T07:22:46.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.768+0000 7f0519600640 1 -- 172.21.15.55:0/1541714830 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f05080f1420 con 0x7f051c1f6400 2024-04-02T07:22:46.771 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:46.772 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:19.207279+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:46.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.768+0000 7f0524000640 1 -- 172.21.15.55:0/1541714830 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f04fc066650 msgr2=0x7f04fc068b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:46.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.768+0000 7f0524000640 1 --2- 172.21.15.55:0/1541714830 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f04fc066650 0x7f04fc068b10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0510009b60 tx=0x7f0510008040 comp rx=0 tx=0).stop 2024-04-02T07:22:46.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.768+0000 7f0524000640 1 -- 172.21.15.55:0/1541714830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f051c1f6400 msgr2=0x7f051c0afb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.768+0000 7f0524000640 1 --2- 172.21.15.55:0/1541714830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f051c1f6400 0x7f051c0afb80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f050801f220 tx=0x7f0504005800 comp rx=0 tx=0).stop 2024-04-02T07:22:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.768+0000 7f0524000640 1 -- 172.21.15.55:0/1541714830 shutdown_connections 2024-04-02T07:22:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.768+0000 7f0524000640 1 --2- 172.21.15.55:0/1541714830 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f051c0cce80 0x7f051c0cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.768+0000 7f0524000640 1 --2- 172.21.15.55:0/1541714830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f051c1f6400 0x7f051c0afb80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.768+0000 7f0524000640 1 --2- 172.21.15.55:0/1541714830 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f04fc066650 0x7f04fc068b10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.768+0000 7f0524000640 1 --2- 172.21.15.55:0/1541714830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05040047d0 0x7f051c0c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.768+0000 7f0524000640 1 -- 172.21.15.55:0/1541714830 >> 172.21.15.55:0/1541714830 conn(0x7f051c066080 msgr2=0x7f051c13fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.768+0000 7f0524000640 1 -- 172.21.15.55:0/1541714830 shutdown_connections 2024-04-02T07:22:46.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.768+0000 7f0524000640 1 -- 172.21.15.55:0/1541714830 wait complete. 2024-04-02T07:22:46.792 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:22:16.738297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:22:17.190496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:22:46.793 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:22:46.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.932+0000 7fae05800640 1 Processor -- start 2024-04-02T07:22:46.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.932+0000 7fae05800640 1 -- start start 2024-04-02T07:22:46.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.932+0000 7fae05800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fae0015ccf0 0x7fae00160840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:46.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.932+0000 7fae05800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae000b5d00 0x7fae000b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:46.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.932+0000 7fae05800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae000b6160 con 0x7fae000cd8c0 2024-04-02T07:22:46.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.932+0000 7fae05800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae000b52c0 con 0x7fae000b5d00 2024-04-02T07:22:46.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.932+0000 7fae05800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae00160eb0 con 0x7fae0015ccf0 2024-04-02T07:22:46.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.932+0000 7fadf7e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae000b5d00 0x7fae000b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:46.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.932+0000 7fadf7e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fae000b5d00 0x7fae000b4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34072/0 (socket says 172.21.15.55:34072) 2024-04-02T07:22:46.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.932+0000 7fadf7e00640 1 -- 172.21.15.55:0/1232208676 learned_addr learned my addr 172.21.15.55:0/1232208676 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:46.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.932+0000 7fadfea00640 1 --2- 172.21.15.55:0/1232208676 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fae0015ccf0 0x7fae00160840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:46.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.932+0000 7fadf7e00640 1 -- 172.21.15.55:0/1232208676 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fae0015ccf0 msgr2=0x7fae00160840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:46.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.932+0000 7fadf7e00640 1 --2- 172.21.15.55:0/1232208676 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fae0015ccf0 0x7fae00160840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.932+0000 7fadf7e00640 1 -- 172.21.15.55:0/1232208676 >> v1:172.21.15.106:6789/0 conn(0x7fae000cd8c0 legacy=0x7fae000d11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:46.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.932+0000 7fadf7e00640 1 -- 172.21.15.55:0/1232208676 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae00161190 con 0x7fae000b5d00 2024-04-02T07:22:46.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.936+0000 7fadf7e00640 1 --2- 172.21.15.55:0/1232208676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae000b5d00 0x7fae000b4d80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fade8009870 tx=0x7fade801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5dfe3ef245efe6d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.936+0000 7fadfe000640 1 -- 172.21.15.55:0/1232208676 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade80ab620 con 0x7fae000b5d00 2024-04-02T07:22:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.936+0000 7fadfe000640 1 -- 172.21.15.55:0/1232208676 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade80ab780 con 0x7fae000b5d00 2024-04-02T07:22:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.936+0000 7fadfe000640 1 -- 172.21.15.55:0/1232208676 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade80abb10 con 0x7fae000b5d00 2024-04-02T07:22:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.936+0000 7fae05800640 1 -- 172.21.15.55:0/1232208676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae000b5d00 msgr2=0x7fae000b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.936+0000 7fae05800640 1 --2- 172.21.15.55:0/1232208676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae000b5d00 0x7fae000b4d80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fade8009870 tx=0x7fade801c4a0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.936+0000 7fae05800640 1 -- 172.21.15.55:0/1232208676 shutdown_connections 2024-04-02T07:22:46.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.936+0000 7fae05800640 1 --2- 172.21.15.55:0/1232208676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae000b5d00 0x7fae000b4d80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.936+0000 7fae05800640 1 --2- 172.21.15.55:0/1232208676 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fae0015ccf0 0x7fae00160840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.936+0000 7fae05800640 1 -- 172.21.15.55:0/1232208676 >> 172.21.15.55:0/1232208676 conn(0x7fae0006b210 msgr2=0x7fae0006b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:46.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.936+0000 7fae05800640 1 -- 172.21.15.55:0/1232208676 shutdown_connections 2024-04-02T07:22:46.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.936+0000 7fae05800640 1 -- 172.21.15.55:0/1232208676 wait complete. 2024-04-02T07:22:46.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fae05800640 1 Processor -- start 2024-04-02T07:22:46.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fae05800640 1 -- start start 2024-04-02T07:22:46.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fae05800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae000b5d00 0x7fae001528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:46.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fae05800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae000cd8c0 0x7fae001551f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:46.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fae05800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fae0015ccf0 0x7fae000b2350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:46.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fae05800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae001543c0 con 0x7fae000b5d00 2024-04-02T07:22:46.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fae05800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae00152de0 con 0x7fae000cd8c0 2024-04-02T07:22:46.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fae05800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae00155730 con 0x7fae0015ccf0 2024-04-02T07:22:46.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fadfea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae000b5d00 0x7fae001528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:46.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fadfea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae000b5d00 0x7fae001528a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34088/0 (socket says 172.21.15.55:34088) 2024-04-02T07:22:46.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fadfea00640 1 -- 172.21.15.55:0/658022224 learned_addr learned my addr 172.21.15.55:0/658022224 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:46.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fadf7e00640 1 --2- 172.21.15.55:0/658022224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae000cd8c0 0x7fae001551f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:46.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fadff400640 1 --2- 172.21.15.55:0/658022224 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fae0015ccf0 0x7fae000b2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:46.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fadfea00640 1 -- 172.21.15.55:0/658022224 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fae0015ccf0 msgr2=0x7fae000b2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:46.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fadfea00640 1 --2- 172.21.15.55:0/658022224 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fae0015ccf0 0x7fae000b2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fadfea00640 1 -- 172.21.15.55:0/658022224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae000cd8c0 msgr2=0x7fae001551f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:46.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fadfea00640 1 --2- 172.21.15.55:0/658022224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae000cd8c0 0x7fae001551f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:46.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fadfea00640 1 -- 172.21.15.55:0/658022224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade80094d0 con 0x7fae000b5d00 2024-04-02T07:22:46.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fadfea00640 1 --2- 172.21.15.55:0/658022224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae000b5d00 0x7fae001528a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fadf000d830 tx=0x7fadf000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:46.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fadf6a00640 1 -- 172.21.15.55:0/658022224 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf000b6c0 con 0x7fae000b5d00 2024-04-02T07:22:46.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fadf6a00640 1 -- 172.21.15.55:0/658022224 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf000b820 con 0x7fae000b5d00 2024-04-02T07:22:46.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fadf6a00640 1 -- 172.21.15.55:0/658022224 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf000bb90 con 0x7fae000b5d00 2024-04-02T07:22:46.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fae05800640 1 -- 172.21.15.55:0/658022224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae000ce260 con 0x7fae000b5d00 2024-04-02T07:22:46.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fae05800640 1 -- 172.21.15.55:0/658022224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae00153600 con 0x7fae000b5d00 2024-04-02T07:22:46.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.940+0000 7fae05800640 1 -- 172.21.15.55:0/658022224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae00072410 con 0x7fae000b5d00 2024-04-02T07:22:46.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.944+0000 7fadf6a00640 1 -- 172.21.15.55:0/658022224 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fadf001e460 con 0x7fae000b5d00 2024-04-02T07:22:46.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.944+0000 7fadf6a00640 1 --2- 172.21.15.55:0/658022224 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faddc0666c0 0x7faddc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:46.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.944+0000 7fadf6a00640 1 -- 172.21.15.55:0/658022224 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadf0084870 con 0x7fae000b5d00 2024-04-02T07:22:46.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.944+0000 7fadf7e00640 1 --2- 172.21.15.55:0/658022224 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faddc0666c0 0x7faddc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:46.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.944+0000 7fadf7e00640 1 --2- 172.21.15.55:0/658022224 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faddc0666c0 0x7faddc068b80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fade80af000 tx=0x7fade80b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:46.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:46.948+0000 7fadf6a00640 1 -- 172.21.15.55:0/658022224 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fadf0051bd0 con 0x7fae000b5d00 2024-04-02T07:22:47.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.108+0000 7fae05800640 1 -- 172.21.15.55:0/658022224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae0006c380 con 0x7fae000b5d00 2024-04-02T07:22:47.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.108+0000 7fadf6a00640 1 -- 172.21.15.55:0/658022224 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fadf00551f0 con 0x7fae000b5d00 2024-04-02T07:22:47.113 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:22:47.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.112+0000 7fae05800640 1 -- 172.21.15.55:0/658022224 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faddc0666c0 msgr2=0x7faddc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:47.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.112+0000 7fae05800640 1 --2- 172.21.15.55:0/658022224 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faddc0666c0 0x7faddc068b80 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fade80af000 tx=0x7fade80b6040 comp rx=0 tx=0).stop 2024-04-02T07:22:47.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.112+0000 7fae05800640 1 -- 172.21.15.55:0/658022224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae000b5d00 msgr2=0x7fae001528a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:47.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.112+0000 7fae05800640 1 --2- 172.21.15.55:0/658022224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae000b5d00 0x7fae001528a0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fadf000d830 tx=0x7fadf000dcf0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.112+0000 7fae05800640 1 -- 172.21.15.55:0/658022224 shutdown_connections 2024-04-02T07:22:47.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.112+0000 7fae05800640 1 --2- 172.21.15.55:0/658022224 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fae0015ccf0 0x7fae000b2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.112+0000 7fae05800640 1 --2- 172.21.15.55:0/658022224 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faddc0666c0 0x7faddc068b80 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.112+0000 7fae05800640 1 --2- 172.21.15.55:0/658022224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fae000cd8c0 0x7fae001551f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.112+0000 7fae05800640 1 --2- 172.21.15.55:0/658022224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fae000b5d00 0x7fae001528a0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.112+0000 7fae05800640 1 -- 172.21.15.55:0/658022224 >> 172.21.15.55:0/658022224 conn(0x7fae0006b210 msgr2=0x7fae000cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:47.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.112+0000 7fae05800640 1 -- 172.21.15.55:0/658022224 shutdown_connections 2024-04-02T07:22:47.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.112+0000 7fae05800640 1 -- 172.21.15.55:0/658022224 wait complete. 2024-04-02T07:22:47.136 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:22:47.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.272+0000 7faf7b800640 1 Processor -- start 2024-04-02T07:22:47.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.272+0000 7faf7b800640 1 -- start start 2024-04-02T07:22:47.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.276+0000 7faf7b800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faf74144260 0x7faf740702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:47.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.276+0000 7faf7b800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf74070c90 con 0x7faf740b31a0 2024-04-02T07:22:47.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.276+0000 7faf7b800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf740b3580 con 0x7faf740707e0 2024-04-02T07:22:47.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.276+0000 7faf7b800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf740b37c0 con 0x7faf74144260 2024-04-02T07:22:47.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.276+0000 7faf79800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faf740b31a0 0x7faf740b1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37238/0 (socket says 172.21.15.55:37238) 2024-04-02T07:22:47.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.276+0000 7faf79800640 1 -- 172.21.15.55:0/2409732023 learned_addr learned my addr 172.21.15.55:0/2409732023 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:47.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.276+0000 7faf78e00640 1 --2- 172.21.15.55:0/2409732023 >> v2:172.21.15.106:3300/0 conn(0x7faf74144260 0x7faf740702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:47.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.276+0000 7faf73400640 1 -- 172.21.15.55:0/2409732023 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1419925239 0 0) 0x7faf74070c90 con 0x7faf740b31a0 2024-04-02T07:22:47.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.276+0000 7faf73400640 1 -- 172.21.15.55:0/2409732023 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf5c003530 con 0x7faf740b31a0 2024-04-02T07:22:47.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.276+0000 7faf78e00640 1 -- 172.21.15.55:0/2409732023 >> v1:172.21.15.106:6789/0 conn(0x7faf740707e0 legacy=0x7faf740b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:47.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.276+0000 7faf78e00640 1 -- 172.21.15.55:0/2409732023 >> v1:172.21.15.55:6789/0 conn(0x7faf740b31a0 legacy=0x7faf740b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:47.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.276+0000 7faf78e00640 1 -- 172.21.15.55:0/2409732023 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7415e3a0 con 0x7faf74144260 2024-04-02T07:22:47.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.280+0000 7faf78e00640 1 --2- 172.21.15.55:0/2409732023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf74144260 0x7faf740702a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faf680097c0 tx=0x7faf6801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deed4d53df41cd server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:47.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.280+0000 7faf73400640 1 -- 172.21.15.55:0/2409732023 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf680a8050 con 0x7faf74144260 2024-04-02T07:22:47.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.280+0000 7faf73400640 1 -- 172.21.15.55:0/2409732023 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf680ac5f0 con 0x7faf74144260 2024-04-02T07:22:47.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.280+0000 7faf73400640 1 -- 172.21.15.55:0/2409732023 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf680ac960 con 0x7faf74144260 2024-04-02T07:22:47.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.280+0000 7faf7b800640 1 -- 172.21.15.55:0/2409732023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf74144260 msgr2=0x7faf740702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:47.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.280+0000 7faf7b800640 1 --2- 172.21.15.55:0/2409732023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf74144260 0x7faf740702a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faf680097c0 tx=0x7faf6801c4a0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.280+0000 7faf7b800640 1 -- 172.21.15.55:0/2409732023 shutdown_connections 2024-04-02T07:22:47.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.280+0000 7faf7b800640 1 --2- 172.21.15.55:0/2409732023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf74144260 0x7faf740702a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.280+0000 7faf7b800640 1 -- 172.21.15.55:0/2409732023 >> 172.21.15.55:0/2409732023 conn(0x7faf7406a390 msgr2=0x7faf740b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:47.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.280+0000 7faf7b800640 1 -- 172.21.15.55:0/2409732023 shutdown_connections 2024-04-02T07:22:47.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.280+0000 7faf7b800640 1 -- 172.21.15.55:0/2409732023 wait complete. 2024-04-02T07:22:47.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.280+0000 7faf7b800640 1 Processor -- start 2024-04-02T07:22:47.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.280+0000 7faf7b800640 1 -- start start 2024-04-02T07:22:47.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.280+0000 7faf7b800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf740707e0 0x7faf741560c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:47.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.280+0000 7faf7b800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf740b31a0 0x7faf74142910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:47.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf7b800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf74144260 0x7faf74152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:47.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf7b800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf741593e0 con 0x7faf74144260 2024-04-02T07:22:47.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf7b800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf74158e20 con 0x7faf740b31a0 2024-04-02T07:22:47.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf7b800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf74159100 con 0x7faf740707e0 2024-04-02T07:22:47.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf79800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf74144260 0x7faf74152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:47.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf79800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf74144260 0x7faf74152ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34090/0 (socket says 172.21.15.55:34090) 2024-04-02T07:22:47.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf79800640 1 -- 172.21.15.55:0/2906333439 learned_addr learned my addr 172.21.15.55:0/2906333439 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:47.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf78e00640 1 --2- 172.21.15.55:0/2906333439 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf740707e0 0x7faf741560c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:47.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf73e00640 1 --2- 172.21.15.55:0/2906333439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf740b31a0 0x7faf74142910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:47.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf79800640 1 -- 172.21.15.55:0/2906333439 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf740707e0 msgr2=0x7faf741560c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:47.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf79800640 1 --2- 172.21.15.55:0/2906333439 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf740707e0 0x7faf741560c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf79800640 1 -- 172.21.15.55:0/2906333439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf740b31a0 msgr2=0x7faf74142910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:47.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf79800640 1 --2- 172.21.15.55:0/2906333439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf740b31a0 0x7faf74142910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf79800640 1 -- 172.21.15.55:0/2906333439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf68009420 con 0x7faf74144260 2024-04-02T07:22:47.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf79800640 1 --2- 172.21.15.55:0/2906333439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf74144260 0x7faf74152ed0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00cb40 tx=0x7faf6c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:47.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf70c00640 1 -- 172.21.15.55:0/2906333439 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c00aca0 con 0x7faf74144260 2024-04-02T07:22:47.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf70c00640 1 -- 172.21.15.55:0/2906333439 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6c00ae00 con 0x7faf74144260 2024-04-02T07:22:47.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf70c00640 1 -- 172.21.15.55:0/2906333439 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c012620 con 0x7faf74144260 2024-04-02T07:22:47.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf7b800640 1 -- 172.21.15.55:0/2906333439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf74153ce0 con 0x7faf74144260 2024-04-02T07:22:47.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf7b800640 1 -- 172.21.15.55:0/2906333439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7413a600 con 0x7faf74144260 2024-04-02T07:22:47.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf7b800640 1 -- 172.21.15.55:0/2906333439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf74073530 con 0x7faf74144260 2024-04-02T07:22:47.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.284+0000 7faf70c00640 1 -- 172.21.15.55:0/2906333439 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7faf6c007070 con 0x7faf74144260 2024-04-02T07:22:47.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.288+0000 7faf70c00640 1 --2- 172.21.15.55:0/2906333439 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faf54066690 0x7faf54068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:47.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.288+0000 7faf70c00640 1 -- 172.21.15.55:0/2906333439 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf6c084120 con 0x7faf74144260 2024-04-02T07:22:47.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.288+0000 7faf78e00640 1 --2- 172.21.15.55:0/2906333439 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faf54066690 0x7faf54068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:47.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.288+0000 7faf78e00640 1 --2- 172.21.15.55:0/2906333439 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faf54066690 0x7faf54068b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faf680ae000 tx=0x7faf680a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:47.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.292+0000 7faf70c00640 1 -- 172.21.15.55:0/2906333439 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7faf6c051530 con 0x7faf74144260 2024-04-02T07:22:47.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.448+0000 7faf7b800640 1 -- 172.21.15.55:0/2906333439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faf74066c90 con 0x7faf74144260 2024-04-02T07:22:47.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.448+0000 7faf70c00640 1 -- 172.21.15.55:0/2906333439 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7faf6c054b50 con 0x7faf74144260 2024-04-02T07:22:47.455 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:22:47.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.452+0000 7faf7b800640 1 -- 172.21.15.55:0/2906333439 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faf54066690 msgr2=0x7faf54068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:47.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.452+0000 7faf7b800640 1 --2- 172.21.15.55:0/2906333439 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faf54066690 0x7faf54068b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7faf680ae000 tx=0x7faf680a7000 comp rx=0 tx=0).stop 2024-04-02T07:22:47.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.452+0000 7faf7b800640 1 -- 172.21.15.55:0/2906333439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf74144260 msgr2=0x7faf74152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:47.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.452+0000 7faf7b800640 1 --2- 172.21.15.55:0/2906333439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf74144260 0x7faf74152ed0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00cb40 tx=0x7faf6c00a060 comp rx=0 tx=0).stop 2024-04-02T07:22:47.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.452+0000 7faf7b800640 1 -- 172.21.15.55:0/2906333439 shutdown_connections 2024-04-02T07:22:47.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.452+0000 7faf7b800640 1 --2- 172.21.15.55:0/2906333439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf74144260 0x7faf74152ed0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.452+0000 7faf7b800640 1 --2- 172.21.15.55:0/2906333439 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faf54066690 0x7faf54068b50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.452+0000 7faf7b800640 1 --2- 172.21.15.55:0/2906333439 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf740b31a0 0x7faf74142910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.452+0000 7faf7b800640 1 --2- 172.21.15.55:0/2906333439 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf740707e0 0x7faf741560c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.452+0000 7faf7b800640 1 -- 172.21.15.55:0/2906333439 >> 172.21.15.55:0/2906333439 conn(0x7faf7406a390 msgr2=0x7faf74072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:47.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.452+0000 7faf7b800640 1 -- 172.21.15.55:0/2906333439 shutdown_connections 2024-04-02T07:22:47.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.452+0000 7faf7b800640 1 -- 172.21.15.55:0/2906333439 wait complete. 2024-04-02T07:22:47.476 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:22:47.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.616+0000 7ff2b5000640 1 Processor -- start 2024-04-02T07:22:47.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.616+0000 7ff2b5000640 1 -- start start 2024-04-02T07:22:47.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.616+0000 7ff2b5000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2b0144260 0x7ff2b00702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:47.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.616+0000 7ff2b5000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff2b00707e0 0x7ff2b00b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:47.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.616+0000 7ff2b5000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b015e3a0 con 0x7ff2b00b2fd0 2024-04-02T07:22:47.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.616+0000 7ff2b5000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b00b37c0 con 0x7ff2b0144260 2024-04-02T07:22:47.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.616+0000 7ff2b5000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b0070c60 con 0x7ff2b00707e0 2024-04-02T07:22:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.616+0000 7ff2ade00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff2b0144260 0x7ff2b00702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.616+0000 7ff2ae800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff2b00b2fd0 0x7ff2b00cc4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37248/0 (socket says 172.21.15.55:37248) 2024-04-02T07:22:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.616+0000 7ff2ae800640 1 -- 172.21.15.55:0/2360034149 learned_addr learned my addr 172.21.15.55:0/2360034149 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.616+0000 7ff2a7e00640 1 --2- 172.21.15.55:0/2360034149 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff2b00707e0 0x7ff2b00b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.616+0000 7ff2ade00640 1 -- 172.21.15.55:0/2360034149 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff2b00707e0 msgr2=0x7ff2b00b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.616+0000 7ff2ade00640 1 --2- 172.21.15.55:0/2360034149 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff2b00707e0 0x7ff2b00b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.616+0000 7ff2ade00640 1 -- 172.21.15.55:0/2360034149 >> v1:172.21.15.55:6789/0 conn(0x7ff2b00b2fd0 legacy=0x7ff2b00cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.616+0000 7ff2ade00640 1 -- 172.21.15.55:0/2360034149 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b015e5f0 con 0x7ff2b0144260 2024-04-02T07:22:47.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.616+0000 7ff2ad400640 1 -- 172.21.15.55:0/2360034149 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252473255 0 0) 0x7ff2b015e3a0 con 0x7ff2b00b2fd0 2024-04-02T07:22:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.620+0000 7ff2ade00640 1 --2- 172.21.15.55:0/2360034149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2b0144260 0x7ff2b00702a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00097c0 tx=0x7ff2a001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b56503ed20535f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.620+0000 7ff2ad400640 1 -- 172.21.15.55:0/2360034149 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a00ab600 con 0x7ff2b0144260 2024-04-02T07:22:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.620+0000 7ff2ad400640 1 -- 172.21.15.55:0/2360034149 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a00a7050 con 0x7ff2b0144260 2024-04-02T07:22:47.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.620+0000 7ff2ad400640 1 -- 172.21.15.55:0/2360034149 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a00ab980 con 0x7ff2b0144260 2024-04-02T07:22:47.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.620+0000 7ff2b5000640 1 -- 172.21.15.55:0/2360034149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2b0144260 msgr2=0x7ff2b00702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:47.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.620+0000 7ff2b5000640 1 --2- 172.21.15.55:0/2360034149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2b0144260 0x7ff2b00702a0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00097c0 tx=0x7ff2a001c4a0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.620+0000 7ff2b5000640 1 -- 172.21.15.55:0/2360034149 shutdown_connections 2024-04-02T07:22:47.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.620+0000 7ff2b5000640 1 --2- 172.21.15.55:0/2360034149 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff2b00707e0 0x7ff2b00b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.620+0000 7ff2b5000640 1 --2- 172.21.15.55:0/2360034149 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2b0144260 0x7ff2b00702a0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.620+0000 7ff2b5000640 1 -- 172.21.15.55:0/2360034149 >> 172.21.15.55:0/2360034149 conn(0x7ff2b006a390 msgr2=0x7ff2b00b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:47.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.620+0000 7ff2b5000640 1 -- 172.21.15.55:0/2360034149 shutdown_connections 2024-04-02T07:22:47.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.620+0000 7ff2b5000640 1 -- 172.21.15.55:0/2360034149 wait complete. 2024-04-02T07:22:47.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.620+0000 7ff2b5000640 1 Processor -- start 2024-04-02T07:22:47.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.620+0000 7ff2b5000640 1 -- start start 2024-04-02T07:22:47.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2b5000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff2b00707e0 0x7ff2b015f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:47.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2b5000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2b00b2fd0 0x7ff2b0141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:47.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2b5000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2b0144260 0x7ff2b013a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:47.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2b5000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b0158b40 con 0x7ff2b0144260 2024-04-02T07:22:47.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2b5000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b01572a0 con 0x7ff2b00b2fd0 2024-04-02T07:22:47.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2b5000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b0157580 con 0x7ff2b00707e0 2024-04-02T07:22:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2ae800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2b0144260 0x7ff2b013a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2ae800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2b0144260 0x7ff2b013a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34120/0 (socket says 172.21.15.55:34120) 2024-04-02T07:22:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2ae800640 1 -- 172.21.15.55:0/2747941741 learned_addr learned my addr 172.21.15.55:0/2747941741 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2ae800640 1 -- 172.21.15.55:0/2747941741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff2b00707e0 msgr2=0x7ff2b015f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2ae800640 1 --2- 172.21.15.55:0/2747941741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff2b00707e0 0x7ff2b015f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2ae800640 1 -- 172.21.15.55:0/2747941741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2b00b2fd0 msgr2=0x7ff2b0141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2ae800640 1 --2- 172.21.15.55:0/2747941741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2b00b2fd0 0x7ff2b0141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2ae800640 1 -- 172.21.15.55:0/2747941741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a0009420 con 0x7ff2b0144260 2024-04-02T07:22:47.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2ae800640 1 --2- 172.21.15.55:0/2747941741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2b0144260 0x7ff2b013a1b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800c7a0 tx=0x7ff2a800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2a6000640 1 -- 172.21.15.55:0/2747941741 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a800a640 con 0x7ff2b0144260 2024-04-02T07:22:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2a6000640 1 -- 172.21.15.55:0/2747941741 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a800a7a0 con 0x7ff2b0144260 2024-04-02T07:22:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2a6000640 1 -- 172.21.15.55:0/2747941741 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a800abd0 con 0x7ff2b0144260 2024-04-02T07:22:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2b5000640 1 -- 172.21.15.55:0/2747941741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2b0157860 con 0x7ff2b0144260 2024-04-02T07:22:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2b5000640 1 -- 172.21.15.55:0/2747941741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b0157e20 con 0x7ff2b0144260 2024-04-02T07:22:47.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2b5000640 1 -- 172.21.15.55:0/2747941741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b0073530 con 0x7ff2b0144260 2024-04-02T07:22:47.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.624+0000 7ff2a6000640 1 -- 172.21.15.55:0/2747941741 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff2a800ad30 con 0x7ff2b0144260 2024-04-02T07:22:47.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.628+0000 7ff2a6000640 1 --2- 172.21.15.55:0/2747941741 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff28c066690 0x7ff28c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:47.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.628+0000 7ff2a6000640 1 -- 172.21.15.55:0/2747941741 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff2a80837d0 con 0x7ff2b0144260 2024-04-02T07:22:47.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.628+0000 7ff2ade00640 1 --2- 172.21.15.55:0/2747941741 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff28c066690 0x7ff28c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:47.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.628+0000 7ff2ade00640 1 --2- 172.21.15.55:0/2747941741 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff28c066690 0x7ff28c068b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00ad000 tx=0x7ff2a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:47.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.632+0000 7ff2a6000640 1 -- 172.21.15.55:0/2747941741 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff2a8050aa0 con 0x7ff2b0144260 2024-04-02T07:22:47.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.792+0000 7ff2b5000640 1 -- 172.21.15.55:0/2747941741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff2b0066c90 con 0x7ff2b0144260 2024-04-02T07:22:47.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.792+0000 7ff2a6000640 1 -- 172.21.15.55:0/2747941741 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff2a8018020 con 0x7ff2b0144260 2024-04-02T07:22:47.798 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:22:47.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.796+0000 7ff2b5000640 1 -- 172.21.15.55:0/2747941741 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff28c066690 msgr2=0x7ff28c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:47.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.796+0000 7ff2b5000640 1 --2- 172.21.15.55:0/2747941741 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff28c066690 0x7ff28c068b50 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff2a00ad000 tx=0x7ff2a0008040 comp rx=0 tx=0).stop 2024-04-02T07:22:47.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.796+0000 7ff2b5000640 1 -- 172.21.15.55:0/2747941741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2b0144260 msgr2=0x7ff2b013a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:47.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.796+0000 7ff2b5000640 1 --2- 172.21.15.55:0/2747941741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2b0144260 0x7ff2b013a1b0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7ff2a800c7a0 tx=0x7ff2a800cc60 comp rx=0 tx=0).stop 2024-04-02T07:22:47.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.796+0000 7ff2b5000640 1 -- 172.21.15.55:0/2747941741 shutdown_connections 2024-04-02T07:22:47.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.796+0000 7ff2b5000640 1 --2- 172.21.15.55:0/2747941741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff2b0144260 0x7ff2b013a1b0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.796+0000 7ff2b5000640 1 --2- 172.21.15.55:0/2747941741 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff28c066690 0x7ff28c068b50 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.796+0000 7ff2b5000640 1 --2- 172.21.15.55:0/2747941741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff2b00b2fd0 0x7ff2b0141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.796+0000 7ff2b5000640 1 --2- 172.21.15.55:0/2747941741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff2b00707e0 0x7ff2b015f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.796+0000 7ff2b5000640 1 -- 172.21.15.55:0/2747941741 >> 172.21.15.55:0/2747941741 conn(0x7ff2b006a390 msgr2=0x7ff2b015d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:47.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.796+0000 7ff2b5000640 1 -- 172.21.15.55:0/2747941741 shutdown_connections 2024-04-02T07:22:47.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.796+0000 7ff2b5000640 1 -- 172.21.15.55:0/2747941741 wait complete. 2024-04-02T07:22:47.819 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:47.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.952+0000 7fcf9a200640 1 Processor -- start 2024-04-02T07:22:47.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.952+0000 7fcf9a200640 1 -- start start 2024-04-02T07:22:47.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf9a200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf940d0050 0x7fcf94099120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:47.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf9a200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf940af460 con 0x7fcf9415ff90 2024-04-02T07:22:47.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf9a200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf940cf0f0 con 0x7fcf940cadf0 2024-04-02T07:22:47.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf9a200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940af690 con 0x7fcf940d0050 2024-04-02T07:22:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf98e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcf9415ff90 0x7fcf94098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37254/0 (socket says 172.21.15.55:37254) 2024-04-02T07:22:47.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf98e00640 1 -- 172.21.15.55:0/3807739866 learned_addr learned my addr 172.21.15.55:0/3807739866 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:47.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf93e00640 1 --2- 172.21.15.55:0/3807739866 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf940d0050 0x7fcf94099120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf93400640 1 -- 172.21.15.55:0/3807739866 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3499589344 0 0) 0x7fcf940af460 con 0x7fcf9415ff90 2024-04-02T07:22:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf93400640 1 -- 172.21.15.55:0/3807739866 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf7c003530 con 0x7fcf9415ff90 2024-04-02T07:22:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf93400640 1 -- 172.21.15.55:0/3807739866 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1245859779 0 0) 0x7fcf7c003530 con 0x7fcf9415ff90 2024-04-02T07:22:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf93400640 1 -- 172.21.15.55:0/3807739866 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf940d0050 msgr2=0x7fcf94099120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf93400640 1 --2- 172.21.15.55:0/3807739866 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf940d0050 0x7fcf94099120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf93400640 1 -- 172.21.15.55:0/3807739866 >> v1:172.21.15.106:6789/0 conn(0x7fcf940cadf0 legacy=0x7fcf940cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf93400640 1 -- 172.21.15.55:0/3807739866 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf940cf3b0 con 0x7fcf9415ff90 2024-04-02T07:22:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf93400640 1 -- 172.21.15.55:0/3807739866 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fcf88001680 con 0x7fcf9415ff90 2024-04-02T07:22:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf93400640 1 -- 172.21.15.55:0/3807739866 >> v1:172.21.15.55:6789/0 conn(0x7fcf9415ff90 legacy=0x7fcf94098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf93400640 1 --2- 172.21.15.55:0/3807739866 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf940d0050 0x7fcf7c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf93400640 1 --2- 172.21.15.55:0/3807739866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf7c003ef0 0x7fcf7c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf93400640 1 --2- 172.21.15.55:0/3807739866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf7c004d10 0x7fcf7c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:47.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf93400640 1 -- 172.21.15.55:0/3807739866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940af690 con 0x7fcf7c004d10 2024-04-02T07:22:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf93400640 1 -- 172.21.15.55:0/3807739866 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c00b9f0 con 0x7fcf7c003ef0 2024-04-02T07:22:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf93400640 1 -- 172.21.15.55:0/3807739866 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7c00bbb0 con 0x7fcf940d0050 2024-04-02T07:22:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf99800640 1 --2- 172.21.15.55:0/3807739866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf7c004d10 0x7fcf7c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf98e00640 1 --2- 172.21.15.55:0/3807739866 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf940d0050 0x7fcf7c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf93e00640 1 --2- 172.21.15.55:0/3807739866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf7c003ef0 0x7fcf7c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf99800640 1 -- 172.21.15.55:0/3807739866 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf940d0050 msgr2=0x7fcf7c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf99800640 1 --2- 172.21.15.55:0/3807739866 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf940d0050 0x7fcf7c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf99800640 1 -- 172.21.15.55:0/3807739866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf7c003ef0 msgr2=0x7fcf7c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf99800640 1 --2- 172.21.15.55:0/3807739866 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf7c003ef0 0x7fcf7c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.956+0000 7fcf99800640 1 -- 172.21.15.55:0/3807739866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c003530 con 0x7fcf7c004d10 2024-04-02T07:22:47.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.960+0000 7fcf99800640 1 --2- 172.21.15.55:0/3807739866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf7c004d10 0x7fcf7c005190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c002010 tx=0x7fcf8c01c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb8c2d2af1cc5ae server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:47.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.960+0000 7fcf93400640 1 -- 172.21.15.55:0/3807739866 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf88007ea0 con 0x7fcf7c004d10 2024-04-02T07:22:47.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.960+0000 7fcf93400640 1 -- 172.21.15.55:0/3807739866 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c0a57f0 con 0x7fcf7c004d10 2024-04-02T07:22:47.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.960+0000 7fcf93400640 1 -- 172.21.15.55:0/3807739866 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c0a5ba0 con 0x7fcf7c004d10 2024-04-02T07:22:47.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.960+0000 7fcf9a200640 1 -- 172.21.15.55:0/3807739866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf7c004d10 msgr2=0x7fcf7c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:47.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.960+0000 7fcf9a200640 1 --2- 172.21.15.55:0/3807739866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf7c004d10 0x7fcf7c005190 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c002010 tx=0x7fcf8c01c8e0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.960+0000 7fcf99800640 1 -- 172.21.15.55:0/3807739866 reap_dead start 2024-04-02T07:22:47.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.960+0000 7fcf9a200640 1 -- 172.21.15.55:0/3807739866 shutdown_connections 2024-04-02T07:22:47.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.960+0000 7fcf9a200640 1 -- 172.21.15.55:0/3807739866 >> 172.21.15.55:0/3807739866 conn(0x7fcf940b1fb0 msgr2=0x7fcf940b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:47.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.960+0000 7fcf9a200640 1 -- 172.21.15.55:0/3807739866 shutdown_connections 2024-04-02T07:22:47.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.960+0000 7fcf9a200640 1 -- 172.21.15.55:0/3807739866 wait complete. 2024-04-02T07:22:47.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf9a200640 1 Processor -- start 2024-04-02T07:22:47.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf9a200640 1 -- start start 2024-04-02T07:22:47.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf9a200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf7c004d10 0x7fcf940cce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:47.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf9a200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf940b5600 0x7fcf941f53e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:47.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf9a200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf941f5920 0x7fcf941f1df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:47.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf9a200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf941f5da0 con 0x7fcf941f5920 2024-04-02T07:22:47.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf9a200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940ae670 con 0x7fcf940b5600 2024-04-02T07:22:47.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf9a200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940ae950 con 0x7fcf7c004d10 2024-04-02T07:22:47.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf99800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf941f5920 0x7fcf941f1df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:47.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf99800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf941f5920 0x7fcf941f1df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34132/0 (socket says 172.21.15.55:34132) 2024-04-02T07:22:47.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf98e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf7c004d10 0x7fcf940cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:47.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf99800640 1 -- 172.21.15.55:0/4186997865 learned_addr learned my addr 172.21.15.55:0/4186997865 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:47.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf93e00640 1 --2- 172.21.15.55:0/4186997865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf940b5600 0x7fcf941f53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:47.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf99800640 1 -- 172.21.15.55:0/4186997865 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf7c004d10 msgr2=0x7fcf940cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:47.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf99800640 1 --2- 172.21.15.55:0/4186997865 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf7c004d10 0x7fcf940cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf99800640 1 -- 172.21.15.55:0/4186997865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf940b5600 msgr2=0x7fcf941f53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:47.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf99800640 1 --2- 172.21.15.55:0/4186997865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf940b5600 0x7fcf941f53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:47.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf99800640 1 -- 172.21.15.55:0/4186997865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf940c4fa0 con 0x7fcf941f5920 2024-04-02T07:22:47.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf99800640 1 --2- 172.21.15.55:0/4186997865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf941f5920 0x7fcf941f1df0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c002010 tx=0x7fcf7c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:47.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf90c00640 1 -- 172.21.15.55:0/4186997865 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c006d60 con 0x7fcf941f5920 2024-04-02T07:22:47.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf90c00640 1 -- 172.21.15.55:0/4186997865 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c007e00 con 0x7fcf941f5920 2024-04-02T07:22:47.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf90c00640 1 -- 172.21.15.55:0/4186997865 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c0a5b80 con 0x7fcf941f5920 2024-04-02T07:22:47.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf9a200640 1 -- 172.21.15.55:0/4186997865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf940c5280 con 0x7fcf941f5920 2024-04-02T07:22:47.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf9a200640 1 -- 172.21.15.55:0/4186997865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf941f60d0 con 0x7fcf941f5920 2024-04-02T07:22:47.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.964+0000 7fcf9a200640 1 -- 172.21.15.55:0/4186997865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf94073fa0 con 0x7fcf941f5920 2024-04-02T07:22:47.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.968+0000 7fcf90c00640 1 -- 172.21.15.55:0/4186997865 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fcf8c0b4040 con 0x7fcf941f5920 2024-04-02T07:22:47.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.968+0000 7fcf90c00640 1 --2- 172.21.15.55:0/4186997865 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf74066690 0x7fcf74068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:47.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.968+0000 7fcf90c00640 1 -- 172.21.15.55:0/4186997865 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf8c11d630 con 0x7fcf941f5920 2024-04-02T07:22:47.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.968+0000 7fcf98e00640 1 --2- 172.21.15.55:0/4186997865 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf74066690 0x7fcf74068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:47.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.968+0000 7fcf98e00640 1 --2- 172.21.15.55:0/4186997865 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf74066690 0x7fcf74068b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcf88000f70 tx=0x7fcf88000ee0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:47.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:47.972+0000 7fcf90c00640 1 -- 172.21.15.55:0/4186997865 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fcf8c0eaa70 con 0x7fcf941f5920 2024-04-02T07:22:48.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.136+0000 7fcf9a200640 1 -- 172.21.15.55:0/4186997865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf9415e640 con 0x7fcf941f5920 2024-04-02T07:22:48.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.136+0000 7fcf90c00640 1 -- 172.21.15.55:0/4186997865 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7fcf8c0ee090 con 0x7fcf941f5920 2024-04-02T07:22:48.142 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:48.142 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:19.207279+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:48.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.140+0000 7fcf9a200640 1 -- 172.21.15.55:0/4186997865 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf74066690 msgr2=0x7fcf74068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:48.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.140+0000 7fcf9a200640 1 --2- 172.21.15.55:0/4186997865 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf74066690 0x7fcf74068b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcf88000f70 tx=0x7fcf88000ee0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.140+0000 7fcf9a200640 1 -- 172.21.15.55:0/4186997865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf941f5920 msgr2=0x7fcf941f1df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:48.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.140+0000 7fcf9a200640 1 --2- 172.21.15.55:0/4186997865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf941f5920 0x7fcf941f1df0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c002010 tx=0x7fcf7c005800 comp rx=0 tx=0).stop 2024-04-02T07:22:48.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.140+0000 7fcf9a200640 1 -- 172.21.15.55:0/4186997865 shutdown_connections 2024-04-02T07:22:48.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.140+0000 7fcf9a200640 1 --2- 172.21.15.55:0/4186997865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf941f5920 0x7fcf941f1df0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.140+0000 7fcf9a200640 1 --2- 172.21.15.55:0/4186997865 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf74066690 0x7fcf74068b50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.140+0000 7fcf9a200640 1 --2- 172.21.15.55:0/4186997865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf940b5600 0x7fcf941f53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.140+0000 7fcf9a200640 1 --2- 172.21.15.55:0/4186997865 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf7c004d10 0x7fcf940cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.140+0000 7fcf9a200640 1 -- 172.21.15.55:0/4186997865 >> 172.21.15.55:0/4186997865 conn(0x7fcf940b1fb0 msgr2=0x7fcf9406b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:48.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.140+0000 7fcf9a200640 1 -- 172.21.15.55:0/4186997865 shutdown_connections 2024-04-02T07:22:48.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.140+0000 7fcf9a200640 1 -- 172.21.15.55:0/4186997865 wait complete. 2024-04-02T07:22:48.164 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:22:16.738297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:22:17.190496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:22:48.164 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:22:48.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.300+0000 7fbc13000640 1 Processor -- start 2024-04-02T07:22:48.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.300+0000 7fbc13000640 1 -- start start 2024-04-02T07:22:48.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.304+0000 7fbc13000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbc0c0b41a0 0x7fbc0c142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:48.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.304+0000 7fbc13000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc0c06ddc0 con 0x7fbc0c0ade90 2024-04-02T07:22:48.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.304+0000 7fbc13000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc0c06c630 con 0x7fbc0c0b3dc0 2024-04-02T07:22:48.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.304+0000 7fbc13000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc0c0cae80 con 0x7fbc0c0b41a0 2024-04-02T07:22:48.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.304+0000 7fbc03e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbc0c0ade90 0x7fbc0c06d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37258/0 (socket says 172.21.15.55:37258) 2024-04-02T07:22:48.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.304+0000 7fbc03e00640 1 -- 172.21.15.55:0/3388746016 learned_addr learned my addr 172.21.15.55:0/3388746016 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:48.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.304+0000 7fbc11000640 1 --2- 172.21.15.55:0/3388746016 >> v2:172.21.15.55:3300/0 conn(0x7fbc0c0b41a0 0x7fbc0c142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:48.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.304+0000 7fbc0b400640 1 -- 172.21.15.55:0/3388746016 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2439101565 0 0) 0x7fbc0c06ddc0 con 0x7fbc0c0ade90 2024-04-02T07:22:48.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.304+0000 7fbc11000640 1 -- 172.21.15.55:0/3388746016 >> v1:172.21.15.106:6789/0 conn(0x7fbc0c0b3dc0 legacy=0x7fbc0c0ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:48.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.304+0000 7fbc11000640 1 -- 172.21.15.55:0/3388746016 >> v1:172.21.15.55:6789/0 conn(0x7fbc0c0ade90 legacy=0x7fbc0c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:48.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.304+0000 7fbc11000640 1 -- 172.21.15.55:0/3388746016 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0c06c8f0 con 0x7fbc0c0b41a0 2024-04-02T07:22:48.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.308+0000 7fbc11000640 1 --2- 172.21.15.55:0/3388746016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc0c0b41a0 0x7fbc0c142ac0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009d90 tx=0x7fbc0401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3de04f5daf5b61 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:48.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.308+0000 7fbc0b400640 1 -- 172.21.15.55:0/3388746016 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc040a5910 con 0x7fbc0c0b41a0 2024-04-02T07:22:48.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.308+0000 7fbc0b400640 1 -- 172.21.15.55:0/3388746016 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc040a5a70 con 0x7fbc0c0b41a0 2024-04-02T07:22:48.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.308+0000 7fbc0b400640 1 -- 172.21.15.55:0/3388746016 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc040a5e00 con 0x7fbc0c0b41a0 2024-04-02T07:22:48.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.308+0000 7fbc13000640 1 -- 172.21.15.55:0/3388746016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc0c0b41a0 msgr2=0x7fbc0c142ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:48.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.308+0000 7fbc13000640 1 --2- 172.21.15.55:0/3388746016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc0c0b41a0 0x7fbc0c142ac0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbc04009d90 tx=0x7fbc0401c940 comp rx=0 tx=0).stop 2024-04-02T07:22:48.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.308+0000 7fbc13000640 1 -- 172.21.15.55:0/3388746016 shutdown_connections 2024-04-02T07:22:48.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.308+0000 7fbc13000640 1 --2- 172.21.15.55:0/3388746016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc0c0b41a0 0x7fbc0c142ac0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.308+0000 7fbc13000640 1 -- 172.21.15.55:0/3388746016 >> 172.21.15.55:0/3388746016 conn(0x7fbc0c06a390 msgr2=0x7fbc0c0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:48.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.308+0000 7fbc13000640 1 -- 172.21.15.55:0/3388746016 shutdown_connections 2024-04-02T07:22:48.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.308+0000 7fbc13000640 1 -- 172.21.15.55:0/3388746016 wait complete. 2024-04-02T07:22:48.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.308+0000 7fbc13000640 1 Processor -- start 2024-04-02T07:22:48.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.308+0000 7fbc13000640 1 -- start start 2024-04-02T07:22:48.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc13000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbc0c0ade90 0x7fbc0c1505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:48.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc13000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc0c0b3dc0 0x7fbc0c0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:48.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc13000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc0c0b41a0 0x7fbc0c132500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:48.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc13000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c150120 con 0x7fbc0c0b3dc0 2024-04-02T07:22:48.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc13000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c0aff30 con 0x7fbc0c0b41a0 2024-04-02T07:22:48.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc13000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0c0afc50 con 0x7fbc0c0ade90 2024-04-02T07:22:48.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc03e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc0c0b3dc0 0x7fbc0c0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:48.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc03e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc0c0b3dc0 0x7fbc0c0af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34146/0 (socket says 172.21.15.55:34146) 2024-04-02T07:22:48.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc03e00640 1 -- 172.21.15.55:0/4129042820 learned_addr learned my addr 172.21.15.55:0/4129042820 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:48.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc0be00640 1 --2- 172.21.15.55:0/4129042820 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbc0c0ade90 0x7fbc0c1505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:48.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc11000640 1 --2- 172.21.15.55:0/4129042820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc0c0b41a0 0x7fbc0c132500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:48.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc03e00640 1 -- 172.21.15.55:0/4129042820 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbc0c0ade90 msgr2=0x7fbc0c1505b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:48.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc03e00640 1 --2- 172.21.15.55:0/4129042820 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbc0c0ade90 0x7fbc0c1505b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc03e00640 1 -- 172.21.15.55:0/4129042820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc0c0b41a0 msgr2=0x7fbc0c132500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:48.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc03e00640 1 --2- 172.21.15.55:0/4129042820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc0c0b41a0 0x7fbc0c132500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc03e00640 1 -- 172.21.15.55:0/4129042820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc04009a70 con 0x7fbc0c0b3dc0 2024-04-02T07:22:48.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc03e00640 1 --2- 172.21.15.55:0/4129042820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc0c0b3dc0 0x7fbc0c0af2e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400c4a0 tx=0x7fbbf400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:48.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc08c00640 1 -- 172.21.15.55:0/4129042820 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf40074e0 con 0x7fbc0c0b3dc0 2024-04-02T07:22:48.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc08c00640 1 -- 172.21.15.55:0/4129042820 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf4007640 con 0x7fbc0c0b3dc0 2024-04-02T07:22:48.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc13000640 1 -- 172.21.15.55:0/4129042820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc0c14fad0 con 0x7fbc0c0b3dc0 2024-04-02T07:22:48.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc08c00640 1 -- 172.21.15.55:0/4129042820 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf4004a30 con 0x7fbc0c0b3dc0 2024-04-02T07:22:48.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc13000640 1 -- 172.21.15.55:0/4129042820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc0c150af0 con 0x7fbc0c0b3dc0 2024-04-02T07:22:48.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc13000640 1 -- 172.21.15.55:0/4129042820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc0c1502d0 con 0x7fbc0c0b3dc0 2024-04-02T07:22:48.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.312+0000 7fbc08c00640 1 -- 172.21.15.55:0/4129042820 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fbbf4004b90 con 0x7fbc0c0b3dc0 2024-04-02T07:22:48.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.316+0000 7fbc08c00640 1 --2- 172.21.15.55:0/4129042820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbbe80666c0 0x7fbbe8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:48.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.316+0000 7fbc08c00640 1 -- 172.21.15.55:0/4129042820 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbf4083730 con 0x7fbc0c0b3dc0 2024-04-02T07:22:48.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.316+0000 7fbc0be00640 1 --2- 172.21.15.55:0/4129042820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbbe80666c0 0x7fbbe8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:48.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.316+0000 7fbc0be00640 1 --2- 172.21.15.55:0/4129042820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbbe80666c0 0x7fbbe8068b80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc007fd0 tx=0x7fbbfc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:48.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.320+0000 7fbc08c00640 1 -- 172.21.15.55:0/4129042820 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fbc0c1502d0 con 0x7fbc0c0b3dc0 2024-04-02T07:22:48.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.480+0000 7fbc13000640 1 -- 172.21.15.55:0/4129042820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbc0c066c90 con 0x7fbc0c0b3dc0 2024-04-02T07:22:48.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.480+0000 7fbc08c00640 1 -- 172.21.15.55:0/4129042820 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbbf4050a20 con 0x7fbc0c0b3dc0 2024-04-02T07:22:48.487 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:22:48.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.484+0000 7fbc13000640 1 -- 172.21.15.55:0/4129042820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbbe80666c0 msgr2=0x7fbbe8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:48.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.484+0000 7fbc13000640 1 --2- 172.21.15.55:0/4129042820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbbe80666c0 0x7fbbe8068b80 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc007fd0 tx=0x7fbbfc009040 comp rx=0 tx=0).stop 2024-04-02T07:22:48.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.484+0000 7fbc13000640 1 -- 172.21.15.55:0/4129042820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc0c0b3dc0 msgr2=0x7fbc0c0af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:48.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.484+0000 7fbc13000640 1 --2- 172.21.15.55:0/4129042820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc0c0b3dc0 0x7fbc0c0af2e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fbbf400c4a0 tx=0x7fbbf400c960 comp rx=0 tx=0).stop 2024-04-02T07:22:48.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.484+0000 7fbc13000640 1 -- 172.21.15.55:0/4129042820 shutdown_connections 2024-04-02T07:22:48.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.484+0000 7fbc13000640 1 --2- 172.21.15.55:0/4129042820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbbe80666c0 0x7fbbe8068b80 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.484+0000 7fbc13000640 1 --2- 172.21.15.55:0/4129042820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbc0c0b41a0 0x7fbc0c132500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.484+0000 7fbc13000640 1 --2- 172.21.15.55:0/4129042820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc0c0b3dc0 0x7fbc0c0af2e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.484+0000 7fbc13000640 1 --2- 172.21.15.55:0/4129042820 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbc0c0ade90 0x7fbc0c1505b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.484+0000 7fbc13000640 1 -- 172.21.15.55:0/4129042820 >> 172.21.15.55:0/4129042820 conn(0x7fbc0c06a390 msgr2=0x7fbc0c0b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:48.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.484+0000 7fbc13000640 1 -- 172.21.15.55:0/4129042820 shutdown_connections 2024-04-02T07:22:48.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.484+0000 7fbc13000640 1 -- 172.21.15.55:0/4129042820 wait complete. 2024-04-02T07:22:48.508 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:22:48.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.644+0000 7f723be00640 1 Processor -- start 2024-04-02T07:22:48.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.644+0000 7f723be00640 1 -- start start 2024-04-02T07:22:48.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.644+0000 7f723be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7234144260 0x7f72340702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:48.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.648+0000 7f723be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f72340b31a0 0x7f72340b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:48.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.648+0000 7f723be00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7234070c90 con 0x7f72340707e0 2024-04-02T07:22:48.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.648+0000 7f723be00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72340b37c0 con 0x7f7234144260 2024-04-02T07:22:48.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.648+0000 7f723be00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72340b3580 con 0x7f72340b31a0 2024-04-02T07:22:48.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.648+0000 7f7239400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7234144260 0x7f72340702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:48.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.648+0000 7f7238a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f72340707e0 0x7f72340b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37266/0 (socket says 172.21.15.55:37266) 2024-04-02T07:22:48.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.648+0000 7f7238a00640 1 -- 172.21.15.55:0/2445736031 learned_addr learned my addr 172.21.15.55:0/2445736031 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:48.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.648+0000 7f7239e00640 1 --2- 172.21.15.55:0/2445736031 >> v2:172.21.15.106:3300/0 conn(0x7f72340b31a0 0x7f72340b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.648+0000 7f7239400640 1 -- 172.21.15.55:0/2445736031 >> v2:172.21.15.106:3300/0 conn(0x7f72340b31a0 msgr2=0x7f72340b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.648+0000 7f7239400640 1 --2- 172.21.15.55:0/2445736031 >> v2:172.21.15.106:3300/0 conn(0x7f72340b31a0 0x7f72340b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.648+0000 7f7239400640 1 -- 172.21.15.55:0/2445736031 >> v1:172.21.15.55:6789/0 conn(0x7f72340707e0 legacy=0x7f72340b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.648+0000 7f7239400640 1 -- 172.21.15.55:0/2445736031 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723415e3a0 con 0x7f7234144260 2024-04-02T07:22:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.648+0000 7f7233e00640 1 -- 172.21.15.55:0/2445736031 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 237602609 0 0) 0x7f7234070c90 con 0x7f72340707e0 2024-04-02T07:22:48.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.648+0000 7f7239e00640 1 --2- 172.21.15.55:0/2445736031 >> v2:172.21.15.106:3300/0 conn(0x7f72340b31a0 0x7f72340b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:48.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.648+0000 7f7239400640 1 --2- 172.21.15.55:0/2445736031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7234144260 0x7f72340702a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f723406ac10 tx=0x7f722801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f4e8114b8c17e06 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:48.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.648+0000 7f7233e00640 1 -- 172.21.15.55:0/2445736031 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72280ab600 con 0x7f7234144260 2024-04-02T07:22:48.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.648+0000 7f7233e00640 1 -- 172.21.15.55:0/2445736031 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72280a7050 con 0x7f7234144260 2024-04-02T07:22:48.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.648+0000 7f7233e00640 1 -- 172.21.15.55:0/2445736031 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72280ab980 con 0x7f7234144260 2024-04-02T07:22:48.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f723be00640 1 -- 172.21.15.55:0/2445736031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7234144260 msgr2=0x7f72340702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:48.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f723be00640 1 --2- 172.21.15.55:0/2445736031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7234144260 0x7f72340702a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f723406ac10 tx=0x7f722801c480 comp rx=0 tx=0).stop 2024-04-02T07:22:48.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f723be00640 1 -- 172.21.15.55:0/2445736031 shutdown_connections 2024-04-02T07:22:48.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f723be00640 1 --2- 172.21.15.55:0/2445736031 >> v2:172.21.15.106:3300/0 conn(0x7f72340b31a0 0x7f72340b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f723be00640 1 --2- 172.21.15.55:0/2445736031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7234144260 0x7f72340702a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f723be00640 1 -- 172.21.15.55:0/2445736031 >> 172.21.15.55:0/2445736031 conn(0x7f723406a390 msgr2=0x7f72340b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:48.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f723be00640 1 -- 172.21.15.55:0/2445736031 shutdown_connections 2024-04-02T07:22:48.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f723be00640 1 -- 172.21.15.55:0/2445736031 wait complete. 2024-04-02T07:22:48.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f723be00640 1 Processor -- start 2024-04-02T07:22:48.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f723be00640 1 -- start start 2024-04-02T07:22:48.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f723be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72340707e0 0x7f723413a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f723be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72340b31a0 0x7f723415b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f723be00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7234144260 0x7f723406d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f723be00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72341f4f50 con 0x7f72340b31a0 2024-04-02T07:22:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f723be00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f723415f4c0 con 0x7f72340707e0 2024-04-02T07:22:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f723be00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72341653e0 con 0x7f7234144260 2024-04-02T07:22:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f7238a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72340b31a0 0x7f723415b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f7238a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72340b31a0 0x7f723415b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34164/0 (socket says 172.21.15.55:34164) 2024-04-02T07:22:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f7238a00640 1 -- 172.21.15.55:0/2473264545 learned_addr learned my addr 172.21.15.55:0/2473264545 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f7239e00640 1 --2- 172.21.15.55:0/2473264545 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7234144260 0x7f723406d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f7239400640 1 --2- 172.21.15.55:0/2473264545 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72340707e0 0x7f723413a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f7238a00640 1 -- 172.21.15.55:0/2473264545 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7234144260 msgr2=0x7f723406d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f7238a00640 1 --2- 172.21.15.55:0/2473264545 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7234144260 0x7f723406d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f7238a00640 1 -- 172.21.15.55:0/2473264545 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72340707e0 msgr2=0x7f723413a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:48.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f7238a00640 1 --2- 172.21.15.55:0/2473264545 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72340707e0 0x7f723413a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f7238a00640 1 -- 172.21.15.55:0/2473264545 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7228009420 con 0x7f72340b31a0 2024-04-02T07:22:48.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f7239e00640 1 --2- 172.21.15.55:0/2473264545 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7234144260 0x7f723406d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:48.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.652+0000 7f7239400640 1 --2- 172.21.15.55:0/2473264545 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72340707e0 0x7f723413a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:48.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.656+0000 7f7238a00640 1 --2- 172.21.15.55:0/2473264545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72340b31a0 0x7f723415b9d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f72200011f0 tx=0x7f722000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:48.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.656+0000 7f7231600640 1 -- 172.21.15.55:0/2473264545 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72200074e0 con 0x7f72340b31a0 2024-04-02T07:22:48.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.656+0000 7f7231600640 1 -- 172.21.15.55:0/2473264545 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7220007640 con 0x7f72340b31a0 2024-04-02T07:22:48.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.656+0000 7f723be00640 1 -- 172.21.15.55:0/2473264545 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72341408c0 con 0x7f72340b31a0 2024-04-02T07:22:48.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.656+0000 7f7231600640 1 -- 172.21.15.55:0/2473264545 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7220004a10 con 0x7f72340b31a0 2024-04-02T07:22:48.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.656+0000 7f723be00640 1 -- 172.21.15.55:0/2473264545 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7234140e80 con 0x7f72340b31a0 2024-04-02T07:22:48.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.656+0000 7f723be00640 1 -- 172.21.15.55:0/2473264545 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7234073530 con 0x7f72340b31a0 2024-04-02T07:22:48.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.656+0000 7f7231600640 1 -- 172.21.15.55:0/2473264545 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7220004b70 con 0x7f72340b31a0 2024-04-02T07:22:48.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.656+0000 7f7231600640 1 --2- 172.21.15.55:0/2473264545 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7214066690 0x7f7214068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:48.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.656+0000 7f7231600640 1 -- 172.21.15.55:0/2473264545 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72200837d0 con 0x7f72340b31a0 2024-04-02T07:22:48.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.656+0000 7f7239400640 1 --2- 172.21.15.55:0/2473264545 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7214066690 0x7f7214068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:48.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.660+0000 7f7239400640 1 --2- 172.21.15.55:0/2473264545 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7214066690 0x7f7214068b50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f72280ad000 tx=0x7f7228008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.660+0000 7f7231600640 1 -- 172.21.15.55:0/2473264545 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7220050aa0 con 0x7f72340b31a0 2024-04-02T07:22:48.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.824+0000 7f723be00640 1 -- 172.21.15.55:0/2473264545 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7234066c90 con 0x7f72340b31a0 2024-04-02T07:22:48.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.824+0000 7f7231600640 1 -- 172.21.15.55:0/2473264545 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7220018020 con 0x7f72340b31a0 2024-04-02T07:22:48.829 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:22:48.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.824+0000 7f723be00640 1 -- 172.21.15.55:0/2473264545 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7214066690 msgr2=0x7f7214068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:48.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.824+0000 7f723be00640 1 --2- 172.21.15.55:0/2473264545 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7214066690 0x7f7214068b50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f72280ad000 tx=0x7f7228008040 comp rx=0 tx=0).stop 2024-04-02T07:22:48.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.824+0000 7f723be00640 1 -- 172.21.15.55:0/2473264545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72340b31a0 msgr2=0x7f723415b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:48.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.824+0000 7f723be00640 1 --2- 172.21.15.55:0/2473264545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72340b31a0 0x7f723415b9d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f72200011f0 tx=0x7f722000c9b0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.824+0000 7f723be00640 1 -- 172.21.15.55:0/2473264545 shutdown_connections 2024-04-02T07:22:48.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.824+0000 7f723be00640 1 --2- 172.21.15.55:0/2473264545 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7234144260 0x7f723406d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.824+0000 7f723be00640 1 --2- 172.21.15.55:0/2473264545 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f72340b31a0 0x7f723415b9d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.824+0000 7f723be00640 1 --2- 172.21.15.55:0/2473264545 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7214066690 0x7f7214068b50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.824+0000 7f723be00640 1 --2- 172.21.15.55:0/2473264545 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f72340707e0 0x7f723413a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.824+0000 7f723be00640 1 -- 172.21.15.55:0/2473264545 >> 172.21.15.55:0/2473264545 conn(0x7f723406a390 msgr2=0x7f72340cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:48.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.824+0000 7f723be00640 1 -- 172.21.15.55:0/2473264545 shutdown_connections 2024-04-02T07:22:48.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.824+0000 7f723be00640 1 -- 172.21.15.55:0/2473264545 wait complete. 2024-04-02T07:22:48.850 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:22:48.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.988+0000 7f59c3a00640 1 Processor -- start 2024-04-02T07:22:48.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.988+0000 7f59c3a00640 1 -- start start 2024-04-02T07:22:48.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.988+0000 7f59c3a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f59bc15e230 0x7f59bc098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:48.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.988+0000 7f59c3a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f59bc098f50 0x7f59bc0b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:48.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.988+0000 7f59c3a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59bc0afbc0 con 0x7f59bc15de50 2024-04-02T07:22:48.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.988+0000 7f59c3a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59bc0993c0 con 0x7f59bc15e230 2024-04-02T07:22:48.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.988+0000 7f59c3a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59bc099be0 con 0x7f59bc098f50 2024-04-02T07:22:48.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.988+0000 7f59bbe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f59bc15e230 0x7f59bc098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:48.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.988+0000 7f59bbe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f59bc15e230 0x7f59bc098a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34176/0 (socket says 172.21.15.55:34176) 2024-04-02T07:22:48.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.988+0000 7f59bbe00640 1 -- 172.21.15.55:0/2033121755 learned_addr learned my addr 172.21.15.55:0/2033121755 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:48.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.988+0000 7f59c1a00640 1 --2- 172.21.15.55:0/2033121755 >> v2:172.21.15.106:3300/0 conn(0x7f59bc098f50 0x7f59bc0b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:48.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.988+0000 7f59bbe00640 1 -- 172.21.15.55:0/2033121755 >> v2:172.21.15.106:3300/0 conn(0x7f59bc098f50 msgr2=0x7f59bc0b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:48.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.988+0000 7f59bbe00640 1 --2- 172.21.15.55:0/2033121755 >> v2:172.21.15.106:3300/0 conn(0x7f59bc098f50 0x7f59bc0b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.988+0000 7f59bbe00640 1 -- 172.21.15.55:0/2033121755 >> v1:172.21.15.106:6789/0 conn(0x7f59bc15de50 legacy=0x7f59bc0cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:48.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.988+0000 7f59bbe00640 1 -- 172.21.15.55:0/2033121755 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59bc0cf740 con 0x7f59bc15e230 2024-04-02T07:22:48.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.992+0000 7f59bbe00640 1 --2- 172.21.15.55:0/2033121755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59bc15e230 0x7f59bc098a10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f59bc0b2120 tx=0x7f59a801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e939ba7bf520585 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:48.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.992+0000 7f59bb400640 1 -- 172.21.15.55:0/2033121755 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a80ab600 con 0x7f59bc15e230 2024-04-02T07:22:48.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.992+0000 7f59bb400640 1 -- 172.21.15.55:0/2033121755 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a80a7050 con 0x7f59bc15e230 2024-04-02T07:22:48.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.992+0000 7f59bb400640 1 -- 172.21.15.55:0/2033121755 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a80ab980 con 0x7f59bc15e230 2024-04-02T07:22:48.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.992+0000 7f59c3a00640 1 -- 172.21.15.55:0/2033121755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59bc15e230 msgr2=0x7f59bc098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:48.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.992+0000 7f59c3a00640 1 --2- 172.21.15.55:0/2033121755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59bc15e230 0x7f59bc098a10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f59bc0b2120 tx=0x7f59a801c490 comp rx=0 tx=0).stop 2024-04-02T07:22:48.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.992+0000 7f59c3a00640 1 -- 172.21.15.55:0/2033121755 shutdown_connections 2024-04-02T07:22:48.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.992+0000 7f59c3a00640 1 --2- 172.21.15.55:0/2033121755 >> v2:172.21.15.106:3300/0 conn(0x7f59bc098f50 0x7f59bc0b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.992+0000 7f59c3a00640 1 --2- 172.21.15.55:0/2033121755 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59bc15e230 0x7f59bc098a10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:48.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.992+0000 7f59c3a00640 1 -- 172.21.15.55:0/2033121755 >> 172.21.15.55:0/2033121755 conn(0x7f59bc0b2150 msgr2=0x7f59bc0b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:48.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.992+0000 7f59c3a00640 1 -- 172.21.15.55:0/2033121755 shutdown_connections 2024-04-02T07:22:48.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.992+0000 7f59c3a00640 1 -- 172.21.15.55:0/2033121755 wait complete. 2024-04-02T07:22:48.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59c3a00640 1 Processor -- start 2024-04-02T07:22:49.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59c3a00640 1 -- start start 2024-04-02T07:22:49.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59c3a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59bc098f50 0x7f59bc14aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:49.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59c3a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59bc15de50 0x7f59bc15ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:49.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59c3a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59bc15cfb0 0x7f59bc0ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:49.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59c3a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc15d460 con 0x7f59bc15de50 2024-04-02T07:22:49.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59c3a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc1f8f20 con 0x7f59bc15cfb0 2024-04-02T07:22:49.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59c3a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59bc1f9a60 con 0x7f59bc098f50 2024-04-02T07:22:49.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59bbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59bc15de50 0x7f59bc15ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:49.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59bbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59bc15de50 0x7f59bc15ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34180/0 (socket says 172.21.15.55:34180) 2024-04-02T07:22:49.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59bbe00640 1 -- 172.21.15.55:0/413290077 learned_addr learned my addr 172.21.15.55:0/413290077 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:49.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59c1000640 1 --2- 172.21.15.55:0/413290077 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59bc098f50 0x7f59bc14aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:49.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59c1a00640 1 --2- 172.21.15.55:0/413290077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59bc15cfb0 0x7f59bc0ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:49.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59bbe00640 1 -- 172.21.15.55:0/413290077 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59bc098f50 msgr2=0x7f59bc14aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:49.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59bbe00640 1 --2- 172.21.15.55:0/413290077 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59bc098f50 0x7f59bc14aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:49.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59bbe00640 1 -- 172.21.15.55:0/413290077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59bc15cfb0 msgr2=0x7f59bc0ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:49.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59bbe00640 1 --2- 172.21.15.55:0/413290077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59bc15cfb0 0x7f59bc0ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:49.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59bbe00640 1 -- 172.21.15.55:0/413290077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a80094d0 con 0x7f59bc15de50 2024-04-02T07:22:49.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59bbe00640 1 --2- 172.21.15.55:0/413290077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59bc15de50 0x7f59bc15ca70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f59a80ae040 tx=0x7f59a8019230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:49.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59b8c00640 1 -- 172.21.15.55:0/413290077 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a80b4640 con 0x7f59bc15de50 2024-04-02T07:22:49.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59b8c00640 1 -- 172.21.15.55:0/413290077 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a80b47c0 con 0x7f59bc15de50 2024-04-02T07:22:49.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59b8c00640 1 -- 172.21.15.55:0/413290077 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a80b4b70 con 0x7f59bc15de50 2024-04-02T07:22:49.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59c3a00640 1 -- 172.21.15.55:0/413290077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59bc14b020 con 0x7f59bc15de50 2024-04-02T07:22:49.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59c3a00640 1 -- 172.21.15.55:0/413290077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59bc1f9410 con 0x7f59bc15de50 2024-04-02T07:22:49.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:48.996+0000 7f59c3a00640 1 -- 172.21.15.55:0/413290077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59bc0cd720 con 0x7f59bc15de50 2024-04-02T07:22:49.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.000+0000 7f59b8c00640 1 -- 172.21.15.55:0/413290077 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f59a80b2070 con 0x7f59bc15de50 2024-04-02T07:22:49.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.000+0000 7f59b8c00640 1 --2- 172.21.15.55:0/413290077 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f599c0666c0 0x7f599c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:49.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.000+0000 7f59b8c00640 1 -- 172.21.15.55:0/413290077 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f59a811e0c0 con 0x7f59bc15de50 2024-04-02T07:22:49.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.000+0000 7f59c1000640 1 --2- 172.21.15.55:0/413290077 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f599c0666c0 0x7f599c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:49.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.000+0000 7f59c1000640 1 --2- 172.21.15.55:0/413290077 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f599c0666c0 0x7f599c068b80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f59b0000f70 tx=0x7f59b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:49.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.004+0000 7f59b8c00640 1 -- 172.21.15.55:0/413290077 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f59a80eb420 con 0x7f59bc15de50 2024-04-02T07:22:49.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.164+0000 7f59c3a00640 1 -- 172.21.15.55:0/413290077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f59bc0723d0 con 0x7f59bc15de50 2024-04-02T07:22:49.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.164+0000 7f59b8c00640 1 -- 172.21.15.55:0/413290077 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f59a80eea40 con 0x7f59bc15de50 2024-04-02T07:22:49.169 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:22:49.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.164+0000 7f59c3a00640 1 -- 172.21.15.55:0/413290077 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f599c0666c0 msgr2=0x7f599c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.164+0000 7f59c3a00640 1 --2- 172.21.15.55:0/413290077 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f599c0666c0 0x7f599c068b80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f59b0000f70 tx=0x7f59b0009040 comp rx=0 tx=0).stop 2024-04-02T07:22:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.164+0000 7f59c3a00640 1 -- 172.21.15.55:0/413290077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59bc15de50 msgr2=0x7f59bc15ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.164+0000 7f59c3a00640 1 --2- 172.21.15.55:0/413290077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59bc15de50 0x7f59bc15ca70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f59a80ae040 tx=0x7f59a8019230 comp rx=0 tx=0).stop 2024-04-02T07:22:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.168+0000 7f59c3a00640 1 -- 172.21.15.55:0/413290077 shutdown_connections 2024-04-02T07:22:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.168+0000 7f59c3a00640 1 --2- 172.21.15.55:0/413290077 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f599c0666c0 0x7f599c068b80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.168+0000 7f59c3a00640 1 --2- 172.21.15.55:0/413290077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59bc15cfb0 0x7f59bc0ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.168+0000 7f59c3a00640 1 --2- 172.21.15.55:0/413290077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59bc15de50 0x7f59bc15ca70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.168+0000 7f59c3a00640 1 --2- 172.21.15.55:0/413290077 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59bc098f50 0x7f59bc14aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.168+0000 7f59c3a00640 1 -- 172.21.15.55:0/413290077 >> 172.21.15.55:0/413290077 conn(0x7f59bc0b2150 msgr2=0x7f59bc0cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.168+0000 7f59c3a00640 1 -- 172.21.15.55:0/413290077 shutdown_connections 2024-04-02T07:22:49.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.168+0000 7f59c3a00640 1 -- 172.21.15.55:0/413290077 wait complete. 2024-04-02T07:22:49.201 INFO:tasks.cephfs_test_runner:Starting test: test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-02T07:22:49.202 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-04-02T07:22:49.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.336+0000 7f2c52200640 1 Processor -- start 2024-04-02T07:22:49.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.336+0000 7f2c52200640 1 -- start start 2024-04-02T07:22:49.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.336+0000 7f2c52200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c4c143f90 0x7f2c4c15ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:49.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.336+0000 7f2c52200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2c4c0cda80 0x7f2c4c0c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:49.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.336+0000 7f2c52200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c4c15b270 con 0x7f2c4c0b34f0 2024-04-02T07:22:49.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.336+0000 7f2c52200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c4c144370 con 0x7f2c4c0cda80 2024-04-02T07:22:49.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.336+0000 7f2c52200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c0c37b0 con 0x7f2c4c143f90 2024-04-02T07:22:49.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.336+0000 7f2c4be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2c4c0cda80 0x7f2c4c0c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:49.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.336+0000 7f2c4be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2c4c0cda80 0x7f2c4c0c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34190/0 (socket says 172.21.15.55:34190) 2024-04-02T07:22:49.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.336+0000 7f2c4be00640 1 -- 172.21.15.55:0/1169655688 learned_addr learned my addr 172.21.15.55:0/1169655688 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:49.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.336+0000 7f2c43e00640 1 --1- 172.21.15.55:0/1169655688 >> v1:172.21.15.55:6789/0 conn(0x7f2c4c0b34f0 0x7f2c4c0cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37274/0 (socket says 172.21.15.55:37274) 2024-04-02T07:22:49.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.336+0000 7f2c4b400640 1 --2- 172.21.15.55:0/1169655688 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c4c143f90 0x7f2c4c15ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:49.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.336+0000 7f2c4be00640 1 -- 172.21.15.55:0/1169655688 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c4c143f90 msgr2=0x7f2c4c15ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:49.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.336+0000 7f2c4be00640 1 --2- 172.21.15.55:0/1169655688 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c4c143f90 0x7f2c4c15ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:49.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.336+0000 7f2c4be00640 1 -- 172.21.15.55:0/1169655688 >> v1:172.21.15.55:6789/0 conn(0x7f2c4c0b34f0 legacy=0x7f2c4c0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:49.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.336+0000 7f2c4be00640 1 -- 172.21.15.55:0/1169655688 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c4c0c3a90 con 0x7f2c4c0cda80 2024-04-02T07:22:49.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.340+0000 7f2c4be00640 1 --2- 172.21.15.55:0/1169655688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c4c0cda80 0x7f2c4c0c4850 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009e50 tx=0x7f2c4401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691d820ffc177cb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:49.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.340+0000 7f2c4aa00640 1 -- 172.21.15.55:0/1169655688 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c440a5740 con 0x7f2c4c0cda80 2024-04-02T07:22:49.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.340+0000 7f2c4aa00640 1 -- 172.21.15.55:0/1169655688 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c440a58a0 con 0x7f2c4c0cda80 2024-04-02T07:22:49.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.340+0000 7f2c4aa00640 1 -- 172.21.15.55:0/1169655688 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c440a5c30 con 0x7f2c4c0cda80 2024-04-02T07:22:49.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.340+0000 7f2c52200640 1 -- 172.21.15.55:0/1169655688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c4c0cda80 msgr2=0x7f2c4c0c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:49.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.340+0000 7f2c52200640 1 --2- 172.21.15.55:0/1169655688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c4c0cda80 0x7f2c4c0c4850 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009e50 tx=0x7f2c4401c970 comp rx=0 tx=0).stop 2024-04-02T07:22:49.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.340+0000 7f2c52200640 1 -- 172.21.15.55:0/1169655688 shutdown_connections 2024-04-02T07:22:49.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.340+0000 7f2c52200640 1 --2- 172.21.15.55:0/1169655688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c4c0cda80 0x7f2c4c0c4850 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:49.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.340+0000 7f2c52200640 1 --2- 172.21.15.55:0/1169655688 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c4c143f90 0x7f2c4c15ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:49.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.340+0000 7f2c52200640 1 -- 172.21.15.55:0/1169655688 >> 172.21.15.55:0/1169655688 conn(0x7f2c4c066080 msgr2=0x7f2c4c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:49.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.340+0000 7f2c52200640 1 -- 172.21.15.55:0/1169655688 shutdown_connections 2024-04-02T07:22:49.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.340+0000 7f2c52200640 1 -- 172.21.15.55:0/1169655688 wait complete. 2024-04-02T07:22:49.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c52200640 1 Processor -- start 2024-04-02T07:22:49.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c52200640 1 -- start start 2024-04-02T07:22:49.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c52200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c4c0b34f0 0x7f2c4c141cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:49.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c52200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c4c0cda80 0x7f2c4c0715e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:49.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c52200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c4c143f90 0x7f2c4c071b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:49.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c52200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c142620 con 0x7f2c4c143f90 2024-04-02T07:22:49.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c52200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c142900 con 0x7f2c4c0b34f0 2024-04-02T07:22:49.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c52200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c4c142be0 con 0x7f2c4c0cda80 2024-04-02T07:22:49.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c4be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c4c143f90 0x7f2c4c071b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:49.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c4be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c4c143f90 0x7f2c4c071b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34192/0 (socket says 172.21.15.55:34192) 2024-04-02T07:22:49.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c4be00640 1 -- 172.21.15.55:0/4199090631 learned_addr learned my addr 172.21.15.55:0/4199090631 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:49.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c43e00640 1 --2- 172.21.15.55:0/4199090631 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c4c0cda80 0x7f2c4c0715e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:49.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c4b400640 1 --2- 172.21.15.55:0/4199090631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c4c0b34f0 0x7f2c4c141cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:49.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c4be00640 1 -- 172.21.15.55:0/4199090631 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c4c0cda80 msgr2=0x7f2c4c0715e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:49.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c4be00640 1 --2- 172.21.15.55:0/4199090631 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c4c0cda80 0x7f2c4c0715e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:49.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c4be00640 1 -- 172.21.15.55:0/4199090631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c4c0b34f0 msgr2=0x7f2c4c141cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:49.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c4be00640 1 --2- 172.21.15.55:0/4199090631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c4c0b34f0 0x7f2c4c141cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:49.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c4be00640 1 -- 172.21.15.55:0/4199090631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c44009b30 con 0x7f2c4c143f90 2024-04-02T07:22:49.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c43e00640 1 --2- 172.21.15.55:0/4199090631 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c4c0cda80 0x7f2c4c0715e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:49.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c4be00640 1 --2- 172.21.15.55:0/4199090631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c4c143f90 0x7f2c4c071b20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2c440af040 tx=0x7f2c44019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:49.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c43400640 1 -- 172.21.15.55:0/4199090631 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c440b8670 con 0x7f2c4c143f90 2024-04-02T07:22:49.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c43400640 1 -- 172.21.15.55:0/4199090631 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c440b87d0 con 0x7f2c4c143f90 2024-04-02T07:22:49.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c52200640 1 -- 172.21.15.55:0/4199090631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c4c142ec0 con 0x7f2c4c143f90 2024-04-02T07:22:49.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c43400640 1 -- 172.21.15.55:0/4199090631 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c440b8b80 con 0x7f2c4c143f90 2024-04-02T07:22:49.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.344+0000 7f2c52200640 1 -- 172.21.15.55:0/4199090631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c4c142230 con 0x7f2c4c143f90 2024-04-02T07:22:49.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.348+0000 7f2c52200640 1 -- 172.21.15.55:0/4199090631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c4c066c90 con 0x7f2c4c143f90 2024-04-02T07:22:49.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.348+0000 7f2c43400640 1 -- 172.21.15.55:0/4199090631 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2c440b8ce0 con 0x7f2c4c143f90 2024-04-02T07:22:49.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.348+0000 7f2c43400640 1 --2- 172.21.15.55:0/4199090631 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2c28066690 0x7f2c28068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:49.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.348+0000 7f2c43400640 1 -- 172.21.15.55:0/4199090631 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c4c0c55a0 con 0x7f2c4c143f90 2024-04-02T07:22:49.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.348+0000 7f2c4b400640 1 --2- 172.21.15.55:0/4199090631 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2c28066690 0x7f2c28068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:49.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.348+0000 7f2c4b400640 1 --2- 172.21.15.55:0/4199090631 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2c28066690 0x7f2c28068b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c15dce0 tx=0x7f2c3c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:49.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.352+0000 7f2c43400640 1 -- 172.21.15.55:0/4199090631 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2c440ecfd0 con 0x7f2c4c143f90 2024-04-02T07:22:49.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:49.572+0000 7f2c52200640 1 -- 172.21.15.55:0/4199090631 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7f2c4c143370 con 0x7f2c4c143f90 2024-04-02T07:22:50.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.132+0000 7f2c43400640 1 -- 172.21.15.55:0/4199090631 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v51) v1 ==== 145+0+0 (secure 0 0 0) 0x7f2c440bc020 con 0x7f2c4c143f90 2024-04-02T07:22:50.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.132+0000 7f2c52200640 1 -- 172.21.15.55:0/4199090631 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2c28066690 msgr2=0x7f2c28068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:50.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.132+0000 7f2c52200640 1 --2- 172.21.15.55:0/4199090631 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2c28066690 0x7f2c28068b50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c15dce0 tx=0x7f2c3c008040 comp rx=0 tx=0).stop 2024-04-02T07:22:50.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.132+0000 7f2c52200640 1 -- 172.21.15.55:0/4199090631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c4c143f90 msgr2=0x7f2c4c071b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:50.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.132+0000 7f2c52200640 1 --2- 172.21.15.55:0/4199090631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c4c143f90 0x7f2c4c071b20 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2c440af040 tx=0x7f2c44019710 comp rx=0 tx=0).stop 2024-04-02T07:22:50.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.136+0000 7f2c52200640 1 -- 172.21.15.55:0/4199090631 shutdown_connections 2024-04-02T07:22:50.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.136+0000 7f2c52200640 1 --2- 172.21.15.55:0/4199090631 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2c4c143f90 0x7f2c4c071b20 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:50.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.136+0000 7f2c52200640 1 --2- 172.21.15.55:0/4199090631 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2c4c0cda80 0x7f2c4c0715e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:50.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.136+0000 7f2c52200640 1 --2- 172.21.15.55:0/4199090631 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2c28066690 0x7f2c28068b50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:50.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.136+0000 7f2c52200640 1 --2- 172.21.15.55:0/4199090631 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2c4c0b34f0 0x7f2c4c141cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:50.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.136+0000 7f2c52200640 1 -- 172.21.15.55:0/4199090631 >> 172.21.15.55:0/4199090631 conn(0x7f2c4c066080 msgr2=0x7f2c4c15ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:50.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.136+0000 7f2c52200640 1 -- 172.21.15.55:0/4199090631 shutdown_connections 2024-04-02T07:22:50.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.136+0000 7f2c52200640 1 -- 172.21.15.55:0/4199090631 wait complete. 2024-04-02T07:22:50.161 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-02T07:22:50.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.304+0000 7fda49e00640 1 Processor -- start 2024-04-02T07:22:50.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.304+0000 7fda49e00640 1 -- start start 2024-04-02T07:22:50.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.304+0000 7fda49e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda440afa70 0x7fda440b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:50.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.304+0000 7fda49e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fda440cd690 0x7fda4406aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:50.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.304+0000 7fda49e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda4415de30 con 0x7fda4415c920 2024-04-02T07:22:50.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.304+0000 7fda49e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda44098ab0 con 0x7fda440cd690 2024-04-02T07:22:50.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.304+0000 7fda49e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda44098d90 con 0x7fda440afa70 2024-04-02T07:22:50.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.304+0000 7fda43400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fda440cd690 0x7fda4406aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:50.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.304+0000 7fda43400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fda440cd690 0x7fda4406aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34198/0 (socket says 172.21.15.55:34198) 2024-04-02T07:22:50.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.304+0000 7fda43400640 1 -- 172.21.15.55:0/4256112283 learned_addr learned my addr 172.21.15.55:0/4256112283 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:50.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.304+0000 7fda42a00640 1 --1- 172.21.15.55:0/4256112283 >> v1:172.21.15.106:6789/0 conn(0x7fda4415c920 0x7fda440ccf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:55898/0 (socket says 172.21.15.55:55898) 2024-04-02T07:22:50.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.304+0000 7fda3be00640 1 --2- 172.21.15.55:0/4256112283 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda440afa70 0x7fda440b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:50.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.304+0000 7fda43400640 1 -- 172.21.15.55:0/4256112283 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda440afa70 msgr2=0x7fda440b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:50.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.304+0000 7fda43400640 1 --2- 172.21.15.55:0/4256112283 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda440afa70 0x7fda440b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:50.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.304+0000 7fda43400640 1 -- 172.21.15.55:0/4256112283 >> v1:172.21.15.106:6789/0 conn(0x7fda4415c920 legacy=0x7fda440ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:50.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.304+0000 7fda43400640 1 -- 172.21.15.55:0/4256112283 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda44099070 con 0x7fda440cd690 2024-04-02T07:22:50.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.304+0000 7fda42000640 1 -- 172.21.15.55:0/4256112283 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401648069 0 0) 0x7fda4415de30 con 0x7fda4415c920 2024-04-02T07:22:50.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.308+0000 7fda43400640 1 --2- 172.21.15.55:0/4256112283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda440cd690 0x7fda4406aea0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fda3c009e50 tx=0x7fda3c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4e8c1f7e6a6a6f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:50.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.308+0000 7fda42000640 1 -- 172.21.15.55:0/4256112283 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c0a5830 con 0x7fda440cd690 2024-04-02T07:22:50.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.308+0000 7fda42000640 1 -- 172.21.15.55:0/4256112283 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3c0a5990 con 0x7fda440cd690 2024-04-02T07:22:50.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.308+0000 7fda42000640 1 -- 172.21.15.55:0/4256112283 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c0a5d20 con 0x7fda440cd690 2024-04-02T07:22:50.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.308+0000 7fda49e00640 1 -- 172.21.15.55:0/4256112283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda440cd690 msgr2=0x7fda4406aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:50.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.308+0000 7fda49e00640 1 --2- 172.21.15.55:0/4256112283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda440cd690 0x7fda4406aea0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fda3c009e50 tx=0x7fda3c01ca00 comp rx=0 tx=0).stop 2024-04-02T07:22:50.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.308+0000 7fda49e00640 1 -- 172.21.15.55:0/4256112283 shutdown_connections 2024-04-02T07:22:50.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.308+0000 7fda49e00640 1 --2- 172.21.15.55:0/4256112283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda440cd690 0x7fda4406aea0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:50.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.308+0000 7fda49e00640 1 --2- 172.21.15.55:0/4256112283 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda440afa70 0x7fda440b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:50.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.308+0000 7fda49e00640 1 -- 172.21.15.55:0/4256112283 >> 172.21.15.55:0/4256112283 conn(0x7fda440d0700 msgr2=0x7fda440d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:50.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.308+0000 7fda49e00640 1 -- 172.21.15.55:0/4256112283 shutdown_connections 2024-04-02T07:22:50.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.308+0000 7fda49e00640 1 -- 172.21.15.55:0/4256112283 wait complete. 2024-04-02T07:22:50.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda49e00640 1 Processor -- start 2024-04-02T07:22:50.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda49e00640 1 -- start start 2024-04-02T07:22:50.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda49e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda440afa70 0x7fda44156a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:50.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda49e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda440cd690 0x7fda440cccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:50.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda49e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda4415c920 0x7fda44155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:50.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda49e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda440cd300 con 0x7fda4415c920 2024-04-02T07:22:50.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda49e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda44157a30 con 0x7fda440afa70 2024-04-02T07:22:50.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda49e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda44157d10 con 0x7fda440cd690 2024-04-02T07:22:50.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda43400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda4415c920 0x7fda44155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:50.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda42a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda440afa70 0x7fda44156a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:50.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda43400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda4415c920 0x7fda44155810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34202/0 (socket says 172.21.15.55:34202) 2024-04-02T07:22:50.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda43400640 1 -- 172.21.15.55:0/1728226742 learned_addr learned my addr 172.21.15.55:0/1728226742 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:50.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda3be00640 1 --2- 172.21.15.55:0/1728226742 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda440cd690 0x7fda440cccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:50.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda43400640 1 -- 172.21.15.55:0/1728226742 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda440cd690 msgr2=0x7fda440cccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:50.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda43400640 1 --2- 172.21.15.55:0/1728226742 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda440cd690 0x7fda440cccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:50.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda43400640 1 -- 172.21.15.55:0/1728226742 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda440afa70 msgr2=0x7fda44156a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:50.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda43400640 1 --2- 172.21.15.55:0/1728226742 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda440afa70 0x7fda44156a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:50.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda43400640 1 -- 172.21.15.55:0/1728226742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3c009b30 con 0x7fda4415c920 2024-04-02T07:22:50.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda43400640 1 --2- 172.21.15.55:0/1728226742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda4415c920 0x7fda44155810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fda3c009e50 tx=0x7fda3c0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:50.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda3b400640 1 -- 172.21.15.55:0/1728226742 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c0b8470 con 0x7fda4415c920 2024-04-02T07:22:50.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda3b400640 1 -- 172.21.15.55:0/1728226742 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3c0b85d0 con 0x7fda4415c920 2024-04-02T07:22:50.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda3b400640 1 -- 172.21.15.55:0/1728226742 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3c0b8940 con 0x7fda4415c920 2024-04-02T07:22:50.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda49e00640 1 -- 172.21.15.55:0/1728226742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda44157ff0 con 0x7fda4415c920 2024-04-02T07:22:50.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.312+0000 7fda49e00640 1 -- 172.21.15.55:0/1728226742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda4415c010 con 0x7fda4415c920 2024-04-02T07:22:50.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.316+0000 7fda49e00640 1 -- 172.21.15.55:0/1728226742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda44066c90 con 0x7fda4415c920 2024-04-02T07:22:50.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.316+0000 7fda3b400640 1 -- 172.21.15.55:0/1728226742 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fda3c0b8aa0 con 0x7fda4415c920 2024-04-02T07:22:50.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.316+0000 7fda3b400640 1 --2- 172.21.15.55:0/1728226742 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fda200666c0 0x7fda20068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:50.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.316+0000 7fda3b400640 1 -- 172.21.15.55:0/1728226742 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda3c11f0d0 con 0x7fda4415c920 2024-04-02T07:22:50.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.316+0000 7fda42a00640 1 --2- 172.21.15.55:0/1728226742 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fda200666c0 0x7fda20068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:50.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.316+0000 7fda42a00640 1 --2- 172.21.15.55:0/1728226742 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fda200666c0 0x7fda20068b80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fda34000f70 tx=0x7fda34007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:50.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.320+0000 7fda3b400640 1 -- 172.21.15.55:0/1728226742 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fda3c0ec460 con 0x7fda4415c920 2024-04-02T07:22:50.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.480+0000 7fda49e00640 1 -- 172.21.15.55:0/1728226742 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fda44157e50 con 0x7fda4415c920 2024-04-02T07:22:50.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.488+0000 7fda3b400640 1 -- 172.21.15.55:0/1728226742 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fda44157e50 con 0x7fda4415c920 2024-04-02T07:22:50.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.492+0000 7fda49e00640 1 -- 172.21.15.55:0/1728226742 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fda200666c0 msgr2=0x7fda20068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:50.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.492+0000 7fda49e00640 1 --2- 172.21.15.55:0/1728226742 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fda200666c0 0x7fda20068b80 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fda34000f70 tx=0x7fda34007df0 comp rx=0 tx=0).stop 2024-04-02T07:22:50.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.492+0000 7fda49e00640 1 -- 172.21.15.55:0/1728226742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda4415c920 msgr2=0x7fda44155810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:50.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.492+0000 7fda49e00640 1 --2- 172.21.15.55:0/1728226742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda4415c920 0x7fda44155810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fda3c009e50 tx=0x7fda3c0197a0 comp rx=0 tx=0).stop 2024-04-02T07:22:50.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.492+0000 7fda49e00640 1 -- 172.21.15.55:0/1728226742 shutdown_connections 2024-04-02T07:22:50.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.492+0000 7fda49e00640 1 --2- 172.21.15.55:0/1728226742 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda4415c920 0x7fda44155810 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:50.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.492+0000 7fda49e00640 1 --2- 172.21.15.55:0/1728226742 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda440cd690 0x7fda440cccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:50.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.492+0000 7fda49e00640 1 --2- 172.21.15.55:0/1728226742 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fda200666c0 0x7fda20068b80 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:50.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.492+0000 7fda49e00640 1 --2- 172.21.15.55:0/1728226742 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda440afa70 0x7fda44156a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:50.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.492+0000 7fda49e00640 1 -- 172.21.15.55:0/1728226742 >> 172.21.15.55:0/1728226742 conn(0x7fda440d0700 msgr2=0x7fda4406f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:50.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.492+0000 7fda49e00640 1 -- 172.21.15.55:0/1728226742 shutdown_connections 2024-04-02T07:22:50.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.492+0000 7fda49e00640 1 -- 172.21.15.55:0/1728226742 wait complete. 2024-04-02T07:22:50.516 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-02T07:22:50.516 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:22:50.599 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:22:50.663 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-02T07:22:50.663 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:22:50.663 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:22:50.673 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:22:50.673 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:22:50.727 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:50.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.904+0000 7fc012600640 1 Processor -- start 2024-04-02T07:22:50.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.904+0000 7fc012600640 1 -- start start 2024-04-02T07:22:50.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.904+0000 7fc012600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc00c0c4120 0x7fc00c0b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:50.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.904+0000 7fc012600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc00c0b36f0 0x7fc00c13d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:50.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.904+0000 7fc012600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00c13d0c0 con 0x7fc00c153ea0 2024-04-02T07:22:50.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.904+0000 7fc012600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00c0c4580 con 0x7fc00c0b36f0 2024-04-02T07:22:50.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.904+0000 7fc012600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c15a2f0 con 0x7fc00c0c4120 2024-04-02T07:22:50.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.908+0000 7fc00b400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc00c153ea0 0x7fc00c159be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:55912/0 (socket says 172.21.15.55:55912) 2024-04-02T07:22:50.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.908+0000 7fc00b400640 1 -- 172.21.15.55:0/706646268 learned_addr learned my addr 172.21.15.55:0/706646268 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:50.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.908+0000 7fc00be00640 1 --2- 172.21.15.55:0/706646268 >> v2:172.21.15.55:3300/0 conn(0x7fc00c0b36f0 0x7fc00c13d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:50.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.908+0000 7fc003e00640 1 --2- 172.21.15.55:0/706646268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc00c0c4120 0x7fc00c0b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:50.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.908+0000 7fc00be00640 1 -- 172.21.15.55:0/706646268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc00c0c4120 msgr2=0x7fc00c0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:50.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.908+0000 7fc00be00640 1 --2- 172.21.15.55:0/706646268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc00c0c4120 0x7fc00c0b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:50.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.908+0000 7fc00aa00640 1 -- 172.21.15.55:0/706646268 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1386961924 0 0) 0x7fc00c13d0c0 con 0x7fc00c153ea0 2024-04-02T07:22:50.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.908+0000 7fc00be00640 1 -- 172.21.15.55:0/706646268 >> v1:172.21.15.106:6789/0 conn(0x7fc00c153ea0 legacy=0x7fc00c159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:50.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.908+0000 7fc00be00640 1 -- 172.21.15.55:0/706646268 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c15a4f0 con 0x7fc00c0b36f0 2024-04-02T07:22:50.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.908+0000 7fc00be00640 1 --2- 172.21.15.55:0/706646268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c0b36f0 0x7fc00c13d550 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc004009d90 tx=0x7fc00401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8a5139c18c3edce server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:50.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.908+0000 7fc00aa00640 1 -- 172.21.15.55:0/706646268 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0040a5940 con 0x7fc00c0b36f0 2024-04-02T07:22:50.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.908+0000 7fc00aa00640 1 -- 172.21.15.55:0/706646268 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0040a5aa0 con 0x7fc00c0b36f0 2024-04-02T07:22:50.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.908+0000 7fc00aa00640 1 -- 172.21.15.55:0/706646268 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0040a5e30 con 0x7fc00c0b36f0 2024-04-02T07:22:50.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc012600640 1 -- 172.21.15.55:0/706646268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c0b36f0 msgr2=0x7fc00c13d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:50.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc012600640 1 --2- 172.21.15.55:0/706646268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c0b36f0 0x7fc00c13d550 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc004009d90 tx=0x7fc00401c970 comp rx=0 tx=0).stop 2024-04-02T07:22:50.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc012600640 1 -- 172.21.15.55:0/706646268 shutdown_connections 2024-04-02T07:22:50.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc012600640 1 --2- 172.21.15.55:0/706646268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c0b36f0 0x7fc00c13d550 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:50.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc012600640 1 --2- 172.21.15.55:0/706646268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc00c0c4120 0x7fc00c0b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:50.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc012600640 1 -- 172.21.15.55:0/706646268 >> 172.21.15.55:0/706646268 conn(0x7fc00c066080 msgr2=0x7fc00c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:50.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc012600640 1 -- 172.21.15.55:0/706646268 shutdown_connections 2024-04-02T07:22:50.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc012600640 1 -- 172.21.15.55:0/706646268 wait complete. 2024-04-02T07:22:50.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc012600640 1 Processor -- start 2024-04-02T07:22:50.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc012600640 1 -- start start 2024-04-02T07:22:50.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc012600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc00c0b36f0 0x7fc00c0cbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:50.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc012600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c0c4120 0x7fc00c135e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:50.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc012600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc00c153ea0 0x7fc00c1f8460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:50.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc012600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c15b4c0 con 0x7fc00c0c4120 2024-04-02T07:22:50.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc012600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c1f8f20 con 0x7fc00c0b36f0 2024-04-02T07:22:50.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc012600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c1f9200 con 0x7fc00c153ea0 2024-04-02T07:22:50.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc003e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c0c4120 0x7fc00c135e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:50.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc003e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c0c4120 0x7fc00c135e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34220/0 (socket says 172.21.15.55:34220) 2024-04-02T07:22:50.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc003e00640 1 -- 172.21.15.55:0/974967416 learned_addr learned my addr 172.21.15.55:0/974967416 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:50.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc00be00640 1 --2- 172.21.15.55:0/974967416 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc00c153ea0 0x7fc00c1f8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:50.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc00b400640 1 --2- 172.21.15.55:0/974967416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc00c0b36f0 0x7fc00c0cbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:50.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc003e00640 1 -- 172.21.15.55:0/974967416 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc00c153ea0 msgr2=0x7fc00c1f8460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:50.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc003e00640 1 --2- 172.21.15.55:0/974967416 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc00c153ea0 0x7fc00c1f8460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:50.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc003e00640 1 -- 172.21.15.55:0/974967416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc00c0b36f0 msgr2=0x7fc00c0cbeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:50.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc003e00640 1 --2- 172.21.15.55:0/974967416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc00c0b36f0 0x7fc00c0cbeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:50.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc003e00640 1 -- 172.21.15.55:0/974967416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc004009a70 con 0x7fc00c0c4120 2024-04-02T07:22:50.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.912+0000 7fc003e00640 1 --2- 172.21.15.55:0/974967416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c0c4120 0x7fc00c135e40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbff400e930 tx=0x7fbff400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:50.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.916+0000 7fc003400640 1 -- 172.21.15.55:0/974967416 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff4009690 con 0x7fc00c0c4120 2024-04-02T07:22:50.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.916+0000 7fc003400640 1 -- 172.21.15.55:0/974967416 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbff400ca00 con 0x7fc00c0c4120 2024-04-02T07:22:50.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.916+0000 7fc003400640 1 -- 172.21.15.55:0/974967416 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbff400cd70 con 0x7fc00c0c4120 2024-04-02T07:22:50.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.916+0000 7fc012600640 1 -- 172.21.15.55:0/974967416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00c15b760 con 0x7fc00c0c4120 2024-04-02T07:22:50.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.916+0000 7fc012600640 1 -- 172.21.15.55:0/974967416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00c1522c0 con 0x7fc00c0c4120 2024-04-02T07:22:50.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.916+0000 7fc012600640 1 -- 172.21.15.55:0/974967416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc00c066c90 con 0x7fc00c0c4120 2024-04-02T07:22:50.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.916+0000 7fc003400640 1 -- 172.21.15.55:0/974967416 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fbff4013470 con 0x7fc00c0c4120 2024-04-02T07:22:50.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.916+0000 7fc003400640 1 --2- 172.21.15.55:0/974967416 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbfe8066690 0x7fbfe8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:50.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.916+0000 7fc003400640 1 -- 172.21.15.55:0/974967416 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbff40843a0 con 0x7fc00c0c4120 2024-04-02T07:22:50.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.916+0000 7fc00b400640 1 --2- 172.21.15.55:0/974967416 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbfe8066690 0x7fbfe8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:50.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.920+0000 7fc00b400640 1 --2- 172.21.15.55:0/974967416 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbfe8066690 0x7fbfe8068b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbffc000f70 tx=0x7fbffc007d10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:50.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:50.920+0000 7fc003400640 1 -- 172.21.15.55:0/974967416 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fbff4051870 con 0x7fc00c0c4120 2024-04-02T07:22:51.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.084+0000 7fc012600640 1 -- 172.21.15.55:0/974967416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc00c0cb950 con 0x7fc00c0c4120 2024-04-02T07:22:51.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.084+0000 7fc003400640 1 -- 172.21.15.55:0/974967416 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7fbff4054e90 con 0x7fc00c0c4120 2024-04-02T07:22:51.089 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:51.089 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:19.207279+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:51.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.084+0000 7fc012600640 1 -- 172.21.15.55:0/974967416 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbfe8066690 msgr2=0x7fbfe8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:51.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.084+0000 7fc012600640 1 --2- 172.21.15.55:0/974967416 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbfe8066690 0x7fbfe8068b50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fbffc000f70 tx=0x7fbffc007d10 comp rx=0 tx=0).stop 2024-04-02T07:22:51.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.084+0000 7fc012600640 1 -- 172.21.15.55:0/974967416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c0c4120 msgr2=0x7fc00c135e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:51.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.084+0000 7fc012600640 1 --2- 172.21.15.55:0/974967416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c0c4120 0x7fc00c135e40 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbff400e930 tx=0x7fbff400edf0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.084+0000 7fc012600640 1 -- 172.21.15.55:0/974967416 shutdown_connections 2024-04-02T07:22:51.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.084+0000 7fc012600640 1 --2- 172.21.15.55:0/974967416 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc00c153ea0 0x7fc00c1f8460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.084+0000 7fc012600640 1 --2- 172.21.15.55:0/974967416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c0c4120 0x7fc00c135e40 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.084+0000 7fc012600640 1 --2- 172.21.15.55:0/974967416 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbfe8066690 0x7fbfe8068b50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.084+0000 7fc012600640 1 --2- 172.21.15.55:0/974967416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc00c0b36f0 0x7fc00c0cbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.084+0000 7fc012600640 1 -- 172.21.15.55:0/974967416 >> 172.21.15.55:0/974967416 conn(0x7fc00c066080 msgr2=0x7fc00c0cb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:51.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.084+0000 7fc012600640 1 -- 172.21.15.55:0/974967416 shutdown_connections 2024-04-02T07:22:51.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.084+0000 7fc012600640 1 -- 172.21.15.55:0/974967416 wait complete. 2024-04-02T07:22:51.110 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:22:16.738297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:22:17.190496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:22:51.110 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:22:51.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.248+0000 7f4445a00640 1 Processor -- start 2024-04-02T07:22:51.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.248+0000 7f4445a00640 1 -- start start 2024-04-02T07:22:51.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.248+0000 7f4445a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f444015ca60 0x7f44400cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:51.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.248+0000 7f4445a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f444015ce40 con 0x7f444006c030 2024-04-02T07:22:51.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.248+0000 7f4445a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44400d01b0 con 0x7f4440098a10 2024-04-02T07:22:51.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.248+0000 7f4445a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444006c460 con 0x7f444015ca60 2024-04-02T07:22:51.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.252+0000 7f443f400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f444006c030 0x7f44400cacb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37278/0 (socket says 172.21.15.55:37278) 2024-04-02T07:22:51.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.252+0000 7f443f400640 1 -- 172.21.15.55:0/305704371 learned_addr learned my addr 172.21.15.55:0/305704371 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:51.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.252+0000 7f443ea00640 1 --2- 172.21.15.55:0/305704371 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f444015ca60 0x7f44400cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:51.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.252+0000 7f443e000640 1 -- 172.21.15.55:0/305704371 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079281878 0 0) 0x7f44400d01b0 con 0x7f4440098a10 2024-04-02T07:22:51.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.252+0000 7f443e000640 1 -- 172.21.15.55:0/305704371 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4424003530 con 0x7f4440098a10 2024-04-02T07:22:51.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.252+0000 7f443e000640 1 -- 172.21.15.55:0/305704371 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1664550103 0 0) 0x7f444015ce40 con 0x7f444006c030 2024-04-02T07:22:51.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.252+0000 7f443e000640 1 -- 172.21.15.55:0/305704371 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44400d01b0 con 0x7f444006c030 2024-04-02T07:22:51.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.252+0000 7f443ea00640 1 -- 172.21.15.55:0/305704371 >> v1:172.21.15.106:6789/0 conn(0x7f4440098a10 legacy=0x7f444006b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:51.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.252+0000 7f443ea00640 1 -- 172.21.15.55:0/305704371 >> v1:172.21.15.55:6789/0 conn(0x7f444006c030 legacy=0x7f44400cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:51.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.252+0000 7f443ea00640 1 -- 172.21.15.55:0/305704371 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44400ceeb0 con 0x7f444015ca60 2024-04-02T07:22:51.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.252+0000 7f443ea00640 1 --2- 172.21.15.55:0/305704371 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f444015ca60 0x7f44400cfc70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f44300097f0 tx=0x7f443001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2886b12a23986102 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:51.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.252+0000 7f443e000640 1 -- 172.21.15.55:0/305704371 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44300ab620 con 0x7f444015ca60 2024-04-02T07:22:51.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.252+0000 7f443e000640 1 -- 172.21.15.55:0/305704371 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44300ab780 con 0x7f444015ca60 2024-04-02T07:22:51.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.252+0000 7f443e000640 1 -- 172.21.15.55:0/305704371 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44300abb10 con 0x7f444015ca60 2024-04-02T07:22:51.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4445a00640 1 -- 172.21.15.55:0/305704371 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f444015ca60 msgr2=0x7f44400cfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:51.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4445a00640 1 --2- 172.21.15.55:0/305704371 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f444015ca60 0x7f44400cfc70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f44300097f0 tx=0x7f443001c420 comp rx=0 tx=0).stop 2024-04-02T07:22:51.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4445a00640 1 -- 172.21.15.55:0/305704371 shutdown_connections 2024-04-02T07:22:51.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4445a00640 1 --2- 172.21.15.55:0/305704371 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f444015ca60 0x7f44400cfc70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4445a00640 1 -- 172.21.15.55:0/305704371 >> 172.21.15.55:0/305704371 conn(0x7f44400b2150 msgr2=0x7f44400b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:51.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4445a00640 1 -- 172.21.15.55:0/305704371 shutdown_connections 2024-04-02T07:22:51.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4445a00640 1 -- 172.21.15.55:0/305704371 wait complete. 2024-04-02T07:22:51.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4445a00640 1 Processor -- start 2024-04-02T07:22:51.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4445a00640 1 -- start start 2024-04-02T07:22:51.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4445a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f444006c030 0x7f44400c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:51.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4445a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4440098a10 0x7f44400c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4445a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f444015ca60 0x7f44400c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4445a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44400c6ca0 con 0x7f4440098a10 2024-04-02T07:22:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4445a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4440151750 con 0x7f444006c030 2024-04-02T07:22:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4445a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44400b6380 con 0x7f444015ca60 2024-04-02T07:22:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4437e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4440098a10 0x7f44400c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4437e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4440098a10 0x7f44400c7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34224/0 (socket says 172.21.15.55:34224) 2024-04-02T07:22:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4437e00640 1 -- 172.21.15.55:0/2600573279 learned_addr learned my addr 172.21.15.55:0/2600573279 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f443f400640 1 --2- 172.21.15.55:0/2600573279 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f444015ca60 0x7f44400c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f443ea00640 1 --2- 172.21.15.55:0/2600573279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f444006c030 0x7f44400c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4437e00640 1 -- 172.21.15.55:0/2600573279 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f444015ca60 msgr2=0x7f44400c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4437e00640 1 --2- 172.21.15.55:0/2600573279 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f444015ca60 0x7f44400c52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4437e00640 1 -- 172.21.15.55:0/2600573279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f444006c030 msgr2=0x7f44400c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4437e00640 1 --2- 172.21.15.55:0/2600573279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f444006c030 0x7f44400c7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.256+0000 7f4437e00640 1 -- 172.21.15.55:0/2600573279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4430009420 con 0x7f4440098a10 2024-04-02T07:22:51.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.260+0000 7f4437e00640 1 --2- 172.21.15.55:0/2600573279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4440098a10 0x7f44400c7c70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f442800c450 tx=0x7f442800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:51.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.260+0000 7f4436a00640 1 -- 172.21.15.55:0/2600573279 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44280052d0 con 0x7f4440098a10 2024-04-02T07:22:51.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.260+0000 7f4436a00640 1 -- 172.21.15.55:0/2600573279 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4428005430 con 0x7f4440098a10 2024-04-02T07:22:51.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.260+0000 7f4436a00640 1 -- 172.21.15.55:0/2600573279 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4428012850 con 0x7f4440098a10 2024-04-02T07:22:51.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.260+0000 7f4445a00640 1 -- 172.21.15.55:0/2600573279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44400c6400 con 0x7f4440098a10 2024-04-02T07:22:51.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.260+0000 7f4445a00640 1 -- 172.21.15.55:0/2600573279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44400c69c0 con 0x7f4440098a10 2024-04-02T07:22:51.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.260+0000 7f4445a00640 1 -- 172.21.15.55:0/2600573279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44401514b0 con 0x7f4440098a10 2024-04-02T07:22:51.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.260+0000 7f4436a00640 1 -- 172.21.15.55:0/2600573279 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f44280129b0 con 0x7f4440098a10 2024-04-02T07:22:51.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.260+0000 7f4436a00640 1 --2- 172.21.15.55:0/2600573279 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f441c066690 0x7f441c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:51.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.260+0000 7f4436a00640 1 -- 172.21.15.55:0/2600573279 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4428083cb0 con 0x7f4440098a10 2024-04-02T07:22:51.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.260+0000 7f443ea00640 1 --2- 172.21.15.55:0/2600573279 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f441c066690 0x7f441c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:51.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.264+0000 7f443ea00640 1 --2- 172.21.15.55:0/2600573279 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f441c066690 0x7f441c068b50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f44300af000 tx=0x7f44300a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:51.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.264+0000 7f4436a00640 1 -- 172.21.15.55:0/2600573279 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f44401514b0 con 0x7f4440098a10 2024-04-02T07:22:51.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.428+0000 7f4445a00640 1 -- 172.21.15.55:0/2600573279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4440151890 con 0x7f4440098a10 2024-04-02T07:22:51.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.432+0000 7f4436a00640 1 -- 172.21.15.55:0/2600573279 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4440151890 con 0x7f4440098a10 2024-04-02T07:22:51.436 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:22:51.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.432+0000 7f4445a00640 1 -- 172.21.15.55:0/2600573279 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f441c066690 msgr2=0x7f441c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:51.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.432+0000 7f4445a00640 1 --2- 172.21.15.55:0/2600573279 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f441c066690 0x7f441c068b50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f44300af000 tx=0x7f44300a7000 comp rx=0 tx=0).stop 2024-04-02T07:22:51.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.432+0000 7f4445a00640 1 -- 172.21.15.55:0/2600573279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4440098a10 msgr2=0x7f44400c7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:51.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.432+0000 7f4445a00640 1 --2- 172.21.15.55:0/2600573279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4440098a10 0x7f44400c7c70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f442800c450 tx=0x7f442800c910 comp rx=0 tx=0).stop 2024-04-02T07:22:51.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.432+0000 7f4445a00640 1 -- 172.21.15.55:0/2600573279 shutdown_connections 2024-04-02T07:22:51.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.432+0000 7f4445a00640 1 --2- 172.21.15.55:0/2600573279 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f444015ca60 0x7f44400c52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.432+0000 7f4445a00640 1 --2- 172.21.15.55:0/2600573279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4440098a10 0x7f44400c7c70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.432+0000 7f4445a00640 1 --2- 172.21.15.55:0/2600573279 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f441c066690 0x7f441c068b50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.432+0000 7f4445a00640 1 --2- 172.21.15.55:0/2600573279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f444006c030 0x7f44400c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.432+0000 7f4445a00640 1 -- 172.21.15.55:0/2600573279 >> 172.21.15.55:0/2600573279 conn(0x7f44400b2150 msgr2=0x7f444006ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:51.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.432+0000 7f4445a00640 1 -- 172.21.15.55:0/2600573279 shutdown_connections 2024-04-02T07:22:51.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.432+0000 7f4445a00640 1 -- 172.21.15.55:0/2600573279 wait complete. 2024-04-02T07:22:51.457 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:22:51.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.596+0000 7f6fe4600640 1 Processor -- start 2024-04-02T07:22:51.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.596+0000 7f6fe4600640 1 -- start start 2024-04-02T07:22:51.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.596+0000 7f6fe4600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6fdc098a10 0x7f6fdc098e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:51.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.596+0000 7f6fe4600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6fdc06b920 0x7f6fdc06bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:51.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.596+0000 7f6fe4600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fdc15ce40 con 0x7f6fdc15ca60 2024-04-02T07:22:51.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.596+0000 7f6fe4600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fdc0993c0 con 0x7f6fdc098a10 2024-04-02T07:22:51.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.596+0000 7f6fe4600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc0ceeb0 con 0x7f6fdc06b920 2024-04-02T07:22:51.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.596+0000 7f6fe1200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6fdc098a10 0x7f6fdc098e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:51.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.596+0000 7f6fe1200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6fdc098a10 0x7f6fdc098e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34234/0 (socket says 172.21.15.55:34234) 2024-04-02T07:22:51.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.596+0000 7f6fe1200640 1 -- 172.21.15.55:0/4273539974 learned_addr learned my addr 172.21.15.55:0/4273539974 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:51.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.596+0000 7f6fe2600640 1 --2- 172.21.15.55:0/4273539974 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6fdc06b920 0x7f6fdc06bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:51.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.596+0000 7f6fe1200640 1 -- 172.21.15.55:0/4273539974 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6fdc06b920 msgr2=0x7f6fdc06bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:51.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.596+0000 7f6fe1200640 1 --2- 172.21.15.55:0/4273539974 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6fdc06b920 0x7f6fdc06bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.596+0000 7f6fe1200640 1 -- 172.21.15.55:0/4273539974 >> v1:172.21.15.106:6789/0 conn(0x7f6fdc15ca60 legacy=0x7f6fdc0cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:51.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.596+0000 7f6fe1200640 1 -- 172.21.15.55:0/4273539974 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fdc0cf190 con 0x7f6fdc098a10 2024-04-02T07:22:51.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.600+0000 7f6fe1200640 1 --2- 172.21.15.55:0/4273539974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fdc098a10 0x7f6fdc098e80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8009870 tx=0x7f6fc801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5589e77f4b5487b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:51.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.600+0000 7f6fdbe00640 1 -- 172.21.15.55:0/4273539974 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc80a6040 con 0x7f6fdc098a10 2024-04-02T07:22:51.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.600+0000 7f6fdbe00640 1 -- 172.21.15.55:0/4273539974 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc80aa600 con 0x7f6fdc098a10 2024-04-02T07:22:51.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.600+0000 7f6fdbe00640 1 -- 172.21.15.55:0/4273539974 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc80aa990 con 0x7f6fdc098a10 2024-04-02T07:22:51.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.600+0000 7f6fe4600640 1 -- 172.21.15.55:0/4273539974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fdc098a10 msgr2=0x7f6fdc098e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:51.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.600+0000 7f6fe4600640 1 --2- 172.21.15.55:0/4273539974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fdc098a10 0x7f6fdc098e80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f6fc8009870 tx=0x7f6fc801c4a0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.600+0000 7f6fe4600640 1 -- 172.21.15.55:0/4273539974 shutdown_connections 2024-04-02T07:22:51.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.600+0000 7f6fe4600640 1 --2- 172.21.15.55:0/4273539974 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6fdc06b920 0x7f6fdc06bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.600+0000 7f6fe4600640 1 --2- 172.21.15.55:0/4273539974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fdc098a10 0x7f6fdc098e80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.600+0000 7f6fe4600640 1 -- 172.21.15.55:0/4273539974 >> 172.21.15.55:0/4273539974 conn(0x7f6fdc0b2150 msgr2=0x7f6fdc0b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:51.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.600+0000 7f6fe4600640 1 -- 172.21.15.55:0/4273539974 shutdown_connections 2024-04-02T07:22:51.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.600+0000 7f6fe4600640 1 -- 172.21.15.55:0/4273539974 wait complete. 2024-04-02T07:22:51.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.600+0000 7f6fe4600640 1 Processor -- start 2024-04-02T07:22:51.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe4600640 1 -- start start 2024-04-02T07:22:51.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe4600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fdc06b920 0x7f6fdc154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:51.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe4600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fdc098a10 0x7f6fdc0c9a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:51.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe4600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6fdc15ca60 0x7f6fdc15b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:51.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe4600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc0ad270 con 0x7f6fdc098a10 2024-04-02T07:22:51.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe4600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc155170 con 0x7f6fdc06b920 2024-04-02T07:22:51.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe4600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fdc0ca4d0 con 0x7f6fdc15ca60 2024-04-02T07:22:51.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe1200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fdc098a10 0x7f6fdc0c9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:51.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe1200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fdc098a10 0x7f6fdc0c9a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34238/0 (socket says 172.21.15.55:34238) 2024-04-02T07:22:51.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe1200640 1 -- 172.21.15.55:0/1504973623 learned_addr learned my addr 172.21.15.55:0/1504973623 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:51.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe1c00640 1 --2- 172.21.15.55:0/1504973623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fdc06b920 0x7f6fdc154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:51.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe2600640 1 --2- 172.21.15.55:0/1504973623 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6fdc15ca60 0x7f6fdc15b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:51.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe1200640 1 -- 172.21.15.55:0/1504973623 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6fdc15ca60 msgr2=0x7f6fdc15b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:51.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe1200640 1 --2- 172.21.15.55:0/1504973623 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6fdc15ca60 0x7f6fdc15b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe1200640 1 -- 172.21.15.55:0/1504973623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fdc06b920 msgr2=0x7f6fdc154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:51.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe1200640 1 --2- 172.21.15.55:0/1504973623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fdc06b920 0x7f6fdc154c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe1200640 1 -- 172.21.15.55:0/1504973623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc80094d0 con 0x7f6fdc098a10 2024-04-02T07:22:51.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe1c00640 1 --2- 172.21.15.55:0/1504973623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fdc06b920 0x7f6fdc154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:51.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe1200640 1 --2- 172.21.15.55:0/1504973623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fdc098a10 0x7f6fdc0c9a30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6fc801ab50 tx=0x7f6fc801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:51.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fd9600640 1 -- 172.21.15.55:0/1504973623 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc80b3800 con 0x7f6fdc098a10 2024-04-02T07:22:51.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fd9600640 1 -- 172.21.15.55:0/1504973623 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc80b3960 con 0x7f6fdc098a10 2024-04-02T07:22:51.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fd9600640 1 -- 172.21.15.55:0/1504973623 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc80b3cd0 con 0x7f6fdc098a10 2024-04-02T07:22:51.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe4600640 1 -- 172.21.15.55:0/1504973623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fdc0ad480 con 0x7f6fdc098a10 2024-04-02T07:22:51.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe4600640 1 -- 172.21.15.55:0/1504973623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fdc0ada40 con 0x7f6fdc098a10 2024-04-02T07:22:51.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.604+0000 7f6fe4600640 1 -- 172.21.15.55:0/1504973623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fdc0ca7b0 con 0x7f6fdc098a10 2024-04-02T07:22:51.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.608+0000 7f6fd9600640 1 -- 172.21.15.55:0/1504973623 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6fc80b2380 con 0x7f6fdc098a10 2024-04-02T07:22:51.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.608+0000 7f6fd9600640 1 --2- 172.21.15.55:0/1504973623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6fbc0666c0 0x7f6fbc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:51.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.608+0000 7f6fd9600640 1 -- 172.21.15.55:0/1504973623 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fc811e410 con 0x7f6fdc098a10 2024-04-02T07:22:51.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.608+0000 7f6fe1c00640 1 --2- 172.21.15.55:0/1504973623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6fbc0666c0 0x7f6fbc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:51.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.608+0000 7f6fe1c00640 1 --2- 172.21.15.55:0/1504973623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6fbc0666c0 0x7f6fbc068b80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0000f70 tx=0x7f6fd0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:51.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.612+0000 7f6fd9600640 1 -- 172.21.15.55:0/1504973623 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6fc80eb780 con 0x7f6fdc098a10 2024-04-02T07:22:51.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.772+0000 7f6fe4600640 1 -- 172.21.15.55:0/1504973623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6fdc066c90 con 0x7f6fdc098a10 2024-04-02T07:22:51.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.772+0000 7f6fd9600640 1 -- 172.21.15.55:0/1504973623 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6fc80eeda0 con 0x7f6fdc098a10 2024-04-02T07:22:51.777 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:22:51.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.772+0000 7f6fe4600640 1 -- 172.21.15.55:0/1504973623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6fbc0666c0 msgr2=0x7f6fbc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:51.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.772+0000 7f6fe4600640 1 --2- 172.21.15.55:0/1504973623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6fbc0666c0 0x7f6fbc068b80 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0000f70 tx=0x7f6fd0009040 comp rx=0 tx=0).stop 2024-04-02T07:22:51.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.772+0000 7f6fe4600640 1 -- 172.21.15.55:0/1504973623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fdc098a10 msgr2=0x7f6fdc0c9a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:51.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.772+0000 7f6fe4600640 1 --2- 172.21.15.55:0/1504973623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fdc098a10 0x7f6fdc0c9a30 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6fc801ab50 tx=0x7f6fc801ace0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.772+0000 7f6fe4600640 1 -- 172.21.15.55:0/1504973623 shutdown_connections 2024-04-02T07:22:51.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.772+0000 7f6fe4600640 1 --2- 172.21.15.55:0/1504973623 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6fdc15ca60 0x7f6fdc15b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.772+0000 7f6fe4600640 1 --2- 172.21.15.55:0/1504973623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6fdc098a10 0x7f6fdc0c9a30 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.772+0000 7f6fe4600640 1 --2- 172.21.15.55:0/1504973623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6fbc0666c0 0x7f6fbc068b80 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.772+0000 7f6fe4600640 1 --2- 172.21.15.55:0/1504973623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6fdc06b920 0x7f6fdc154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.772+0000 7f6fe4600640 1 -- 172.21.15.55:0/1504973623 >> 172.21.15.55:0/1504973623 conn(0x7f6fdc0b2150 msgr2=0x7f6fdc0b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:51.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.772+0000 7f6fe4600640 1 -- 172.21.15.55:0/1504973623 shutdown_connections 2024-04-02T07:22:51.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.772+0000 7f6fe4600640 1 -- 172.21.15.55:0/1504973623 wait complete. 2024-04-02T07:22:51.798 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:22:51.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.936+0000 7f696c600640 1 Processor -- start 2024-04-02T07:22:51.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.936+0000 7f696c600640 1 -- start start 2024-04-02T07:22:51.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.936+0000 7f696c600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f69640cc5b0 0x7f69640b0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.936+0000 7f696c600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69640cb0e0 con 0x7f69640b0d40 2024-04-02T07:22:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.936+0000 7f696c600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69640b1560 con 0x7f69640ceb50 2024-04-02T07:22:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.936+0000 7f696c600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69640b1840 con 0x7f69640cc5b0 2024-04-02T07:22:51.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.936+0000 7f696a600640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f69640b0d40 0x7f6964164390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37290/0 (socket says 172.21.15.55:37290) 2024-04-02T07:22:51.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.936+0000 7f696a600640 1 -- 172.21.15.55:0/3703757058 learned_addr learned my addr 172.21.15.55:0/3703757058 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:51.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.936+0000 7f6969200640 1 --2- 172.21.15.55:0/3703757058 >> v2:172.21.15.106:3300/0 conn(0x7f69640cc5b0 0x7f69640b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:51.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.936+0000 7f6963e00640 1 -- 172.21.15.55:0/3703757058 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3059717819 0 0) 0x7f69640cb0e0 con 0x7f69640b0d40 2024-04-02T07:22:51.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.936+0000 7f6963e00640 1 -- 172.21.15.55:0/3703757058 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f694c003530 con 0x7f69640b0d40 2024-04-02T07:22:51.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.936+0000 7f6963e00640 1 -- 172.21.15.55:0/3703757058 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 12914925 0 0) 0x7f69640b1560 con 0x7f69640ceb50 2024-04-02T07:22:51.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.936+0000 7f6963e00640 1 -- 172.21.15.55:0/3703757058 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69640cb0e0 con 0x7f69640ceb50 2024-04-02T07:22:51.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.936+0000 7f6969200640 1 -- 172.21.15.55:0/3703757058 >> v1:172.21.15.106:6789/0 conn(0x7f69640ceb50 legacy=0x7f69640cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:51.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.936+0000 7f6969200640 1 -- 172.21.15.55:0/3703757058 >> v1:172.21.15.55:6789/0 conn(0x7f69640b0d40 legacy=0x7f6964164390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:51.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.936+0000 7f6969200640 1 -- 172.21.15.55:0/3703757058 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69640b1b20 con 0x7f69640cc5b0 2024-04-02T07:22:51.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.940+0000 7f6969200640 1 --2- 172.21.15.55:0/3703757058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69640cc5b0 0x7f69640b0800 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f69500097c0 tx=0x7f695001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b55599a5b861232e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:51.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.940+0000 7f6963e00640 1 -- 172.21.15.55:0/3703757058 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69500ab600 con 0x7f69640cc5b0 2024-04-02T07:22:51.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.940+0000 7f6963e00640 1 -- 172.21.15.55:0/3703757058 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69500a7050 con 0x7f69640cc5b0 2024-04-02T07:22:51.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.940+0000 7f6963e00640 1 -- 172.21.15.55:0/3703757058 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69500ab960 con 0x7f69640cc5b0 2024-04-02T07:22:51.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.940+0000 7f696c600640 1 -- 172.21.15.55:0/3703757058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69640cc5b0 msgr2=0x7f69640b0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:51.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.940+0000 7f696c600640 1 --2- 172.21.15.55:0/3703757058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69640cc5b0 0x7f69640b0800 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f69500097c0 tx=0x7f695001c410 comp rx=0 tx=0).stop 2024-04-02T07:22:51.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.940+0000 7f696c600640 1 -- 172.21.15.55:0/3703757058 shutdown_connections 2024-04-02T07:22:51.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.940+0000 7f696c600640 1 --2- 172.21.15.55:0/3703757058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69640cc5b0 0x7f69640b0800 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.940+0000 7f696c600640 1 -- 172.21.15.55:0/3703757058 >> 172.21.15.55:0/3703757058 conn(0x7f69640d0700 msgr2=0x7f69640d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:51.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.940+0000 7f696c600640 1 -- 172.21.15.55:0/3703757058 shutdown_connections 2024-04-02T07:22:51.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.940+0000 7f696c600640 1 -- 172.21.15.55:0/3703757058 wait complete. 2024-04-02T07:22:51.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f696c600640 1 Processor -- start 2024-04-02T07:22:51.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f696c600640 1 -- start start 2024-04-02T07:22:51.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f696c600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69640b0d40 0x7f69640c3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:51.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f696c600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69640cc5b0 0x7f6964153470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:51.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f696c600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69640ceb50 0x7f6964154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:51.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f696c600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696415b9f0 con 0x7f69640ceb50 2024-04-02T07:22:51.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f696c600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696415d520 con 0x7f69640b0d40 2024-04-02T07:22:51.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f696c600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696415d800 con 0x7f69640cc5b0 2024-04-02T07:22:51.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f696a600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69640ceb50 0x7f6964154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:51.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f696a600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69640ceb50 0x7f6964154460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34240/0 (socket says 172.21.15.55:34240) 2024-04-02T07:22:51.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f696a600640 1 -- 172.21.15.55:0/1210630724 learned_addr learned my addr 172.21.15.55:0/1210630724 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:51.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f6969200640 1 --2- 172.21.15.55:0/1210630724 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69640cc5b0 0x7f6964153470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:51.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f6969c00640 1 --2- 172.21.15.55:0/1210630724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69640b0d40 0x7f69640c3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:51.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f696a600640 1 -- 172.21.15.55:0/1210630724 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69640cc5b0 msgr2=0x7f6964153470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:51.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f696a600640 1 --2- 172.21.15.55:0/1210630724 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69640cc5b0 0x7f6964153470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f696a600640 1 -- 172.21.15.55:0/1210630724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69640b0d40 msgr2=0x7f69640c3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:51.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f696a600640 1 --2- 172.21.15.55:0/1210630724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69640b0d40 0x7f69640c3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:51.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f696a600640 1 -- 172.21.15.55:0/1210630724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6950009420 con 0x7f69640ceb50 2024-04-02T07:22:51.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f696a600640 1 --2- 172.21.15.55:0/1210630724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69640ceb50 0x7f6964154460 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f695c00cb10 tx=0x7f695c00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:51.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f6961600640 1 -- 172.21.15.55:0/1210630724 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c00ac70 con 0x7f69640ceb50 2024-04-02T07:22:51.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f6961600640 1 -- 172.21.15.55:0/1210630724 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c00add0 con 0x7f69640ceb50 2024-04-02T07:22:51.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f6961600640 1 -- 172.21.15.55:0/1210630724 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c012620 con 0x7f69640ceb50 2024-04-02T07:22:51.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f696c600640 1 -- 172.21.15.55:0/1210630724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696406c710 con 0x7f69640ceb50 2024-04-02T07:22:51.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.944+0000 7f696c600640 1 -- 172.21.15.55:0/1210630724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6964153fa0 con 0x7f69640ceb50 2024-04-02T07:22:51.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.948+0000 7f696c600640 1 -- 172.21.15.55:0/1210630724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69640b6650 con 0x7f69640ceb50 2024-04-02T07:22:51.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.948+0000 7f6961600640 1 -- 172.21.15.55:0/1210630724 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f695c007070 con 0x7f69640ceb50 2024-04-02T07:22:51.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.948+0000 7f6961600640 1 --2- 172.21.15.55:0/1210630724 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6944066690 0x7f6944068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:51.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.948+0000 7f6961600640 1 -- 172.21.15.55:0/1210630724 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f695c084120 con 0x7f69640ceb50 2024-04-02T07:22:51.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.948+0000 7f6969c00640 1 --2- 172.21.15.55:0/1210630724 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6944066690 0x7f6944068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:51.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.948+0000 7f6969c00640 1 --2- 172.21.15.55:0/1210630724 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6944066690 0x7f6944068b50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f69640af720 tx=0x7f6958009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:51.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:51.952+0000 7f6961600640 1 -- 172.21.15.55:0/1210630724 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f695c051490 con 0x7f69640ceb50 2024-04-02T07:22:52.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.112+0000 7f696c600640 1 -- 172.21.15.55:0/1210630724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f696415bba0 con 0x7f69640ceb50 2024-04-02T07:22:52.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.112+0000 7f6961600640 1 -- 172.21.15.55:0/1210630724 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f696415bba0 con 0x7f69640ceb50 2024-04-02T07:22:52.117 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:22:52.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.112+0000 7f696c600640 1 -- 172.21.15.55:0/1210630724 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6944066690 msgr2=0x7f6944068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.112+0000 7f696c600640 1 --2- 172.21.15.55:0/1210630724 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6944066690 0x7f6944068b50 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f69640af720 tx=0x7f6958009040 comp rx=0 tx=0).stop 2024-04-02T07:22:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.112+0000 7f696c600640 1 -- 172.21.15.55:0/1210630724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69640ceb50 msgr2=0x7f6964154460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.112+0000 7f696c600640 1 --2- 172.21.15.55:0/1210630724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69640ceb50 0x7f6964154460 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f695c00cb10 tx=0x7f695c00a060 comp rx=0 tx=0).stop 2024-04-02T07:22:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.112+0000 7f696c600640 1 -- 172.21.15.55:0/1210630724 shutdown_connections 2024-04-02T07:22:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.112+0000 7f696c600640 1 --2- 172.21.15.55:0/1210630724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69640ceb50 0x7f6964154460 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.112+0000 7f696c600640 1 --2- 172.21.15.55:0/1210630724 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69640cc5b0 0x7f6964153470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.112+0000 7f696c600640 1 --2- 172.21.15.55:0/1210630724 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6944066690 0x7f6944068b50 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.112+0000 7f696c600640 1 --2- 172.21.15.55:0/1210630724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69640b0d40 0x7f69640c3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.112+0000 7f696c600640 1 -- 172.21.15.55:0/1210630724 >> 172.21.15.55:0/1210630724 conn(0x7f69640d0700 msgr2=0x7f696406f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.112+0000 7f696c600640 1 -- 172.21.15.55:0/1210630724 shutdown_connections 2024-04-02T07:22:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.112+0000 7f696c600640 1 -- 172.21.15.55:0/1210630724 wait complete. 2024-04-02T07:22:52.139 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:22:52.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.276+0000 7fc48ec00640 1 Processor -- start 2024-04-02T07:22:52.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.276+0000 7fc48ec00640 1 -- start start 2024-04-02T07:22:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.276+0000 7fc48ec00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc48815aad0 0x7fc4880caea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.276+0000 7fc48ec00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc48806da10 0x7fc4880cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.276+0000 7fc48ec00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4880c9ff0 con 0x7fc4880af920 2024-04-02T07:22:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.276+0000 7fc48ec00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4880cb920 con 0x7fc48806da10 2024-04-02T07:22:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.276+0000 7fc48ec00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4880c93e0 con 0x7fc48815aad0 2024-04-02T07:22:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.276+0000 7fc47fe00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc4880af920 0x7fc48815e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37296/0 (socket says 172.21.15.55:37296) 2024-04-02T07:22:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.276+0000 7fc47fe00640 1 -- 172.21.15.55:0/3192122049 learned_addr learned my addr 172.21.15.55:0/3192122049 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.276+0000 7fc48cc00640 1 --2- 172.21.15.55:0/3192122049 >> v2:172.21.15.55:3300/0 conn(0x7fc48806da10 0x7fc4880cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.276+0000 7fc487e00640 1 --2- 172.21.15.55:0/3192122049 >> v2:172.21.15.106:3300/0 conn(0x7fc48815aad0 0x7fc4880caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.276+0000 7fc487400640 1 -- 172.21.15.55:0/3192122049 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 317511260 0 0) 0x7fc4880c9ff0 con 0x7fc4880af920 2024-04-02T07:22:52.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.276+0000 7fc48cc00640 1 -- 172.21.15.55:0/3192122049 >> v2:172.21.15.106:3300/0 conn(0x7fc48815aad0 msgr2=0x7fc4880caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:52.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.276+0000 7fc48cc00640 1 --2- 172.21.15.55:0/3192122049 >> v2:172.21.15.106:3300/0 conn(0x7fc48815aad0 0x7fc4880caea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.276+0000 7fc48cc00640 1 -- 172.21.15.55:0/3192122049 >> v1:172.21.15.55:6789/0 conn(0x7fc4880af920 legacy=0x7fc48815e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:52.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.276+0000 7fc48cc00640 1 -- 172.21.15.55:0/3192122049 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4880c96c0 con 0x7fc48806da10 2024-04-02T07:22:52.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.280+0000 7fc48cc00640 1 --2- 172.21.15.55:0/3192122049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48806da10 0x7fc4880cb3e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc4880b1520 tx=0x7fc48001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9a41b9343a51b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:52.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.280+0000 7fc487400640 1 -- 172.21.15.55:0/3192122049 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4800a5930 con 0x7fc48806da10 2024-04-02T07:22:52.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.280+0000 7fc487400640 1 -- 172.21.15.55:0/3192122049 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4800a5a90 con 0x7fc48806da10 2024-04-02T07:22:52.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.280+0000 7fc487400640 1 -- 172.21.15.55:0/3192122049 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4800a5e20 con 0x7fc48806da10 2024-04-02T07:22:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.280+0000 7fc48ec00640 1 -- 172.21.15.55:0/3192122049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48806da10 msgr2=0x7fc4880cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.280+0000 7fc48ec00640 1 --2- 172.21.15.55:0/3192122049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48806da10 0x7fc4880cb3e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fc4880b1520 tx=0x7fc48001c870 comp rx=0 tx=0).stop 2024-04-02T07:22:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.280+0000 7fc48ec00640 1 -- 172.21.15.55:0/3192122049 shutdown_connections 2024-04-02T07:22:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.280+0000 7fc48ec00640 1 --2- 172.21.15.55:0/3192122049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48806da10 0x7fc4880cb3e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.280+0000 7fc48ec00640 1 --2- 172.21.15.55:0/3192122049 >> v2:172.21.15.106:3300/0 conn(0x7fc48815aad0 0x7fc4880caea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.280+0000 7fc48ec00640 1 -- 172.21.15.55:0/3192122049 >> 172.21.15.55:0/3192122049 conn(0x7fc488069d90 msgr2=0x7fc48806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.280+0000 7fc48ec00640 1 -- 172.21.15.55:0/3192122049 shutdown_connections 2024-04-02T07:22:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.280+0000 7fc48ec00640 1 -- 172.21.15.55:0/3192122049 wait complete. 2024-04-02T07:22:52.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc48ec00640 1 Processor -- start 2024-04-02T07:22:52.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc48ec00640 1 -- start start 2024-04-02T07:22:52.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc48ec00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48806da10 0x7fc48814f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:52.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc48ec00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4880af920 0x7fc4881596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:52.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc48ec00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc48815aad0 0x7fc488144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:52.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc48ec00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48815dfc0 con 0x7fc48806da10 2024-04-02T07:22:52.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc48ec00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48814ec50 con 0x7fc4880af920 2024-04-02T07:22:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc48ec00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48814e380 con 0x7fc48815aad0 2024-04-02T07:22:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc487e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48806da10 0x7fc48814f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc487e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48806da10 0x7fc48814f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34258/0 (socket says 172.21.15.55:34258) 2024-04-02T07:22:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc487e00640 1 -- 172.21.15.55:0/67167679 learned_addr learned my addr 172.21.15.55:0/67167679 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc47fe00640 1 --2- 172.21.15.55:0/67167679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4880af920 0x7fc4881596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc48cc00640 1 --2- 172.21.15.55:0/67167679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc48815aad0 0x7fc488144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc487e00640 1 -- 172.21.15.55:0/67167679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc48815aad0 msgr2=0x7fc488144fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc487e00640 1 --2- 172.21.15.55:0/67167679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc48815aad0 0x7fc488144fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc487e00640 1 -- 172.21.15.55:0/67167679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4880af920 msgr2=0x7fc4881596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc487e00640 1 --2- 172.21.15.55:0/67167679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4880af920 0x7fc4881596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc487e00640 1 -- 172.21.15.55:0/67167679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc480009a70 con 0x7fc48806da10 2024-04-02T07:22:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc48cc00640 1 --2- 172.21.15.55:0/67167679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc48815aad0 0x7fc488144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc487e00640 1 --2- 172.21.15.55:0/67167679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48806da10 0x7fc48814f0e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc47800d620 tx=0x7fc47800dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc484c00640 1 -- 172.21.15.55:0/67167679 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47800b620 con 0x7fc48806da10 2024-04-02T07:22:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc484c00640 1 -- 172.21.15.55:0/67167679 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47800b780 con 0x7fc48806da10 2024-04-02T07:22:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc484c00640 1 -- 172.21.15.55:0/67167679 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47800bb10 con 0x7fc48806da10 2024-04-02T07:22:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc48ec00640 1 -- 172.21.15.55:0/67167679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc488159c20 con 0x7fc48806da10 2024-04-02T07:22:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.284+0000 7fc48ec00640 1 -- 172.21.15.55:0/67167679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc48814e600 con 0x7fc48806da10 2024-04-02T07:22:52.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.288+0000 7fc48ec00640 1 -- 172.21.15.55:0/67167679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc48806e240 con 0x7fc48806da10 2024-04-02T07:22:52.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.288+0000 7fc484c00640 1 -- 172.21.15.55:0/67167679 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc47800bc70 con 0x7fc48806da10 2024-04-02T07:22:52.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.288+0000 7fc484c00640 1 --2- 172.21.15.55:0/67167679 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc464066690 0x7fc464068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:52.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.288+0000 7fc484c00640 1 -- 172.21.15.55:0/67167679 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc478084710 con 0x7fc48806da10 2024-04-02T07:22:52.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.288+0000 7fc47fe00640 1 --2- 172.21.15.55:0/67167679 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc464066690 0x7fc464068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:52.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.288+0000 7fc47fe00640 1 --2- 172.21.15.55:0/67167679 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc464066690 0x7fc464068b50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc4881f6830 tx=0x7fc470007b60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:52.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.292+0000 7fc484c00640 1 -- 172.21.15.55:0/67167679 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc4780519e0 con 0x7fc48806da10 2024-04-02T07:22:52.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.464+0000 7fc48ec00640 1 -- 172.21.15.55:0/67167679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc488066c90 con 0x7fc48806da10 2024-04-02T07:22:52.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.464+0000 7fc484c00640 1 -- 172.21.15.55:0/67167679 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc478007380 con 0x7fc48806da10 2024-04-02T07:22:52.469 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:22:52.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.464+0000 7fc48ec00640 1 -- 172.21.15.55:0/67167679 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc464066690 msgr2=0x7fc464068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:52.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.464+0000 7fc48ec00640 1 --2- 172.21.15.55:0/67167679 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc464066690 0x7fc464068b50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc4881f6830 tx=0x7fc470007b60 comp rx=0 tx=0).stop 2024-04-02T07:22:52.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.464+0000 7fc48ec00640 1 -- 172.21.15.55:0/67167679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48806da10 msgr2=0x7fc48814f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:52.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.464+0000 7fc48ec00640 1 --2- 172.21.15.55:0/67167679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48806da10 0x7fc48814f0e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fc47800d620 tx=0x7fc47800dae0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.464+0000 7fc48ec00640 1 -- 172.21.15.55:0/67167679 shutdown_connections 2024-04-02T07:22:52.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.464+0000 7fc48ec00640 1 --2- 172.21.15.55:0/67167679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc48815aad0 0x7fc488144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.464+0000 7fc48ec00640 1 --2- 172.21.15.55:0/67167679 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc464066690 0x7fc464068b50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.464+0000 7fc48ec00640 1 --2- 172.21.15.55:0/67167679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc4880af920 0x7fc4881596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.464+0000 7fc48ec00640 1 --2- 172.21.15.55:0/67167679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48806da10 0x7fc48814f0e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.464+0000 7fc48ec00640 1 -- 172.21.15.55:0/67167679 >> 172.21.15.55:0/67167679 conn(0x7fc488069d90 msgr2=0x7fc4880b0480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:52.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.464+0000 7fc48ec00640 1 -- 172.21.15.55:0/67167679 shutdown_connections 2024-04-02T07:22:52.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.464+0000 7fc48ec00640 1 -- 172.21.15.55:0/67167679 wait complete. 2024-04-02T07:22:52.490 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:22:52.490 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:22:52.500 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:52.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.676+0000 7f7c77c00640 1 Processor -- start 2024-04-02T07:22:52.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.676+0000 7f7c77c00640 1 -- start start 2024-04-02T07:22:52.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.680+0000 7f7c77c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7c700cfdf0 0x7f7c7006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:52.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.680+0000 7f7c77c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7c700b16e0 0x7f7c700b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:52.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.680+0000 7f7c77c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c700b11f0 0x7f7c70098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:52.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.680+0000 7f7c77c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c700d01d0 con 0x7f7c700b16e0 2024-04-02T07:22:52.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.680+0000 7f7c77c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7006c0e0 con 0x7f7c700cfdf0 2024-04-02T07:22:52.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.680+0000 7f7c77c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c700b01d0 con 0x7f7c700b11f0 2024-04-02T07:22:52.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.680+0000 7f7c6fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7c700b16e0 0x7f7c700b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:52.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.680+0000 7f7c6fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7c700b16e0 0x7f7c700b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34272/0 (socket says 172.21.15.55:34272) 2024-04-02T07:22:52.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.680+0000 7f7c6fe00640 1 -- 172.21.15.55:0/801763944 learned_addr learned my addr 172.21.15.55:0/801763944 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:52.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.680+0000 7f7c75c00640 1 --2- 172.21.15.55:0/801763944 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c700b11f0 0x7f7c70098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:52.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.680+0000 7f7c75200640 1 --2- 172.21.15.55:0/801763944 >> v2:172.21.15.106:3300/0 conn(0x7f7c700cfdf0 0x7f7c7006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:52.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.680+0000 7f7c6fe00640 1 -- 172.21.15.55:0/801763944 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c700b11f0 msgr2=0x7f7c70098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:52.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.680+0000 7f7c6fe00640 1 --2- 172.21.15.55:0/801763944 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c700b11f0 0x7f7c70098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.680+0000 7f7c6fe00640 1 -- 172.21.15.55:0/801763944 >> v2:172.21.15.106:3300/0 conn(0x7f7c700cfdf0 msgr2=0x7f7c7006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:52.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.680+0000 7f7c6fe00640 1 --2- 172.21.15.55:0/801763944 >> v2:172.21.15.106:3300/0 conn(0x7f7c700cfdf0 0x7f7c7006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.680+0000 7f7c6fe00640 1 -- 172.21.15.55:0/801763944 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c700b04b0 con 0x7f7c700b16e0 2024-04-02T07:22:52.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c6fe00640 1 --2- 172.21.15.55:0/801763944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c700b16e0 0x7f7c700b0cb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7c70073b60 tx=0x7f7c5c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a7c4d7843936b27 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:52.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c6f400640 1 -- 172.21.15.55:0/801763944 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c0ac620 con 0x7f7c700b16e0 2024-04-02T07:22:52.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c6f400640 1 -- 172.21.15.55:0/801763944 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c5c0ac780 con 0x7f7c700b16e0 2024-04-02T07:22:52.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c6f400640 1 -- 172.21.15.55:0/801763944 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c0acb10 con 0x7f7c700b16e0 2024-04-02T07:22:52.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c77c00640 1 -- 172.21.15.55:0/801763944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c700b16e0 msgr2=0x7f7c700b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:52.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c77c00640 1 --2- 172.21.15.55:0/801763944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c700b16e0 0x7f7c700b0cb0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7c70073b60 tx=0x7f7c5c01c4f0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c77c00640 1 -- 172.21.15.55:0/801763944 shutdown_connections 2024-04-02T07:22:52.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c77c00640 1 --2- 172.21.15.55:0/801763944 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c700b11f0 0x7f7c70098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c77c00640 1 --2- 172.21.15.55:0/801763944 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c700b16e0 0x7f7c700b0cb0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c77c00640 1 --2- 172.21.15.55:0/801763944 >> v2:172.21.15.106:3300/0 conn(0x7f7c700cfdf0 0x7f7c7006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c77c00640 1 -- 172.21.15.55:0/801763944 >> 172.21.15.55:0/801763944 conn(0x7f7c700b2210 msgr2=0x7f7c700b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:52.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c77c00640 1 -- 172.21.15.55:0/801763944 shutdown_connections 2024-04-02T07:22:52.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c77c00640 1 -- 172.21.15.55:0/801763944 wait complete. 2024-04-02T07:22:52.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c77c00640 1 Processor -- start 2024-04-02T07:22:52.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c77c00640 1 -- start start 2024-04-02T07:22:52.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c77c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c700b11f0 0x7f7c70157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:52.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c77c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c700b16e0 0x7f7c70157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:52.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c77c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c700cfdf0 0x7f7c70159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:52.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c77c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c700cade0 con 0x7f7c700cfdf0 2024-04-02T07:22:52.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c77c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c70157570 con 0x7f7c700b11f0 2024-04-02T07:22:52.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.684+0000 7f7c77c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c70157d70 con 0x7f7c700b16e0 2024-04-02T07:22:52.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.688+0000 7f7c75c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c700cfdf0 0x7f7c70159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:52.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.688+0000 7f7c75c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c700cfdf0 0x7f7c70159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34286/0 (socket says 172.21.15.55:34286) 2024-04-02T07:22:52.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.688+0000 7f7c75c00640 1 -- 172.21.15.55:0/3665024476 learned_addr learned my addr 172.21.15.55:0/3665024476 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:52.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.688+0000 7f7c75200640 1 --2- 172.21.15.55:0/3665024476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c700b11f0 0x7f7c70157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:52.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.688+0000 7f7c6fe00640 1 --2- 172.21.15.55:0/3665024476 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c700b16e0 0x7f7c70157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:52.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.688+0000 7f7c75c00640 1 -- 172.21.15.55:0/3665024476 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c700b16e0 msgr2=0x7f7c70157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:52.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.688+0000 7f7c75c00640 1 --2- 172.21.15.55:0/3665024476 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c700b16e0 0x7f7c70157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.688+0000 7f7c75c00640 1 -- 172.21.15.55:0/3665024476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c700b11f0 msgr2=0x7f7c70157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:52.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.688+0000 7f7c75c00640 1 --2- 172.21.15.55:0/3665024476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c700b11f0 0x7f7c70157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.688+0000 7f7c75c00640 1 -- 172.21.15.55:0/3665024476 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c0094d0 con 0x7f7c700cfdf0 2024-04-02T07:22:52.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.688+0000 7f7c75200640 1 --2- 172.21.15.55:0/3665024476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c700b11f0 0x7f7c70157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:52.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.688+0000 7f7c75c00640 1 --2- 172.21.15.55:0/3665024476 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c700cfdf0 0x7f7c70159280 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800efc0 tx=0x7f7c6800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:52.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.688+0000 7f7c6cc00640 1 -- 172.21.15.55:0/3665024476 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68014480 con 0x7f7c700cfdf0 2024-04-02T07:22:52.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.688+0000 7f7c6cc00640 1 -- 172.21.15.55:0/3665024476 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6800f040 con 0x7f7c700cfdf0 2024-04-02T07:22:52.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.688+0000 7f7c6cc00640 1 -- 172.21.15.55:0/3665024476 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c68014820 con 0x7f7c700cfdf0 2024-04-02T07:22:52.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.688+0000 7f7c77c00640 1 -- 172.21.15.55:0/3665024476 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c70158050 con 0x7f7c700cfdf0 2024-04-02T07:22:52.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.688+0000 7f7c77c00640 1 -- 172.21.15.55:0/3665024476 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c70158610 con 0x7f7c700cfdf0 2024-04-02T07:22:52.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.688+0000 7f7c77c00640 1 -- 172.21.15.55:0/3665024476 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c700caf50 con 0x7f7c700cfdf0 2024-04-02T07:22:52.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.688+0000 7f7c6cc00640 1 -- 172.21.15.55:0/3665024476 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7c68014980 con 0x7f7c700cfdf0 2024-04-02T07:22:52.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.688+0000 7f7c6cc00640 1 --2- 172.21.15.55:0/3665024476 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7c50066690 0x7f7c50068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:52.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.692+0000 7f7c6cc00640 1 -- 172.21.15.55:0/3665024476 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c68084c60 con 0x7f7c700cfdf0 2024-04-02T07:22:52.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.692+0000 7f7c75200640 1 --2- 172.21.15.55:0/3665024476 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7c50066690 0x7f7c50068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:52.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.692+0000 7f7c75200640 1 --2- 172.21.15.55:0/3665024476 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7c50066690 0x7f7c50068b50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009e30 tx=0x7f7c64009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.692+0000 7f7c6cc00640 1 -- 172.21.15.55:0/3665024476 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7c68051fe0 con 0x7f7c700cfdf0 2024-04-02T07:22:52.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.856+0000 7f7c77c00640 1 -- 172.21.15.55:0/3665024476 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c70066c90 con 0x7f7c700cfdf0 2024-04-02T07:22:52.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.856+0000 7f7c6cc00640 1 -- 172.21.15.55:0/3665024476 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f7c68018090 con 0x7f7c700cfdf0 2024-04-02T07:22:52.863 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:52.863 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:19.207279+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:52.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.860+0000 7f7c77c00640 1 -- 172.21.15.55:0/3665024476 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7c50066690 msgr2=0x7f7c50068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:52.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.860+0000 7f7c77c00640 1 --2- 172.21.15.55:0/3665024476 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7c50066690 0x7f7c50068b50 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7c64009e30 tx=0x7f7c64009190 comp rx=0 tx=0).stop 2024-04-02T07:22:52.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.860+0000 7f7c77c00640 1 -- 172.21.15.55:0/3665024476 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c700cfdf0 msgr2=0x7f7c70159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:52.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.860+0000 7f7c77c00640 1 --2- 172.21.15.55:0/3665024476 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c700cfdf0 0x7f7c70159280 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800efc0 tx=0x7f7c6800c490 comp rx=0 tx=0).stop 2024-04-02T07:22:52.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.860+0000 7f7c77c00640 1 -- 172.21.15.55:0/3665024476 shutdown_connections 2024-04-02T07:22:52.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.860+0000 7f7c77c00640 1 --2- 172.21.15.55:0/3665024476 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7c700cfdf0 0x7f7c70159280 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.860+0000 7f7c77c00640 1 --2- 172.21.15.55:0/3665024476 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7c700b16e0 0x7f7c70157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.860+0000 7f7c77c00640 1 --2- 172.21.15.55:0/3665024476 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7c50066690 0x7f7c50068b50 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.860+0000 7f7c77c00640 1 --2- 172.21.15.55:0/3665024476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7c700b11f0 0x7f7c70157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:52.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.860+0000 7f7c77c00640 1 -- 172.21.15.55:0/3665024476 >> 172.21.15.55:0/3665024476 conn(0x7f7c700b2210 msgr2=0x7f7c7015fde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:52.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.860+0000 7f7c77c00640 1 -- 172.21.15.55:0/3665024476 shutdown_connections 2024-04-02T07:22:52.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:52.860+0000 7f7c77c00640 1 -- 172.21.15.55:0/3665024476 wait complete. 2024-04-02T07:22:52.883 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:22:16.738297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:22:17.190496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:22:52.883 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:22:53.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.020+0000 7fe837200640 1 Processor -- start 2024-04-02T07:22:53.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.020+0000 7fe837200640 1 -- start start 2024-04-02T07:22:53.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.020+0000 7fe837200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe830144260 0x7fe8300702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.020+0000 7fe837200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8300707e0 0x7fe8300b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.020+0000 7fe837200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe83015e3a0 con 0x7fe8300b2fd0 2024-04-02T07:22:53.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.020+0000 7fe837200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8300b37c0 con 0x7fe830144260 2024-04-02T07:22:53.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.020+0000 7fe837200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe830070c60 con 0x7fe8300707e0 2024-04-02T07:22:53.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.020+0000 7fe835200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe8300b2fd0 0x7fe8300cc4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37310/0 (socket says 172.21.15.55:37310) 2024-04-02T07:22:53.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.020+0000 7fe835200640 1 -- 172.21.15.55:0/3547655460 learned_addr learned my addr 172.21.15.55:0/3547655460 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:53.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.020+0000 7fe827400640 1 --2- 172.21.15.55:0/3547655460 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8300707e0 0x7fe8300b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.024+0000 7fe82fe00640 1 --2- 172.21.15.55:0/3547655460 >> v2:172.21.15.106:3300/0 conn(0x7fe830144260 0x7fe8300702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.024+0000 7fe82f400640 1 -- 172.21.15.55:0/3547655460 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412116750 0 0) 0x7fe83015e3a0 con 0x7fe8300b2fd0 2024-04-02T07:22:53.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.024+0000 7fe82f400640 1 -- 172.21.15.55:0/3547655460 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe814003530 con 0x7fe8300b2fd0 2024-04-02T07:22:53.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.024+0000 7fe827400640 1 -- 172.21.15.55:0/3547655460 >> v2:172.21.15.106:3300/0 conn(0x7fe830144260 msgr2=0x7fe8300702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:53.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.024+0000 7fe827400640 1 --2- 172.21.15.55:0/3547655460 >> v2:172.21.15.106:3300/0 conn(0x7fe830144260 0x7fe8300702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.024+0000 7fe827400640 1 -- 172.21.15.55:0/3547655460 >> v1:172.21.15.55:6789/0 conn(0x7fe8300b2fd0 legacy=0x7fe8300cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:53.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.024+0000 7fe827400640 1 -- 172.21.15.55:0/3547655460 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe83015e5f0 con 0x7fe8300707e0 2024-04-02T07:22:53.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.024+0000 7fe827400640 1 --2- 172.21.15.55:0/3547655460 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8300707e0 0x7fe8300b2a90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe8180097c0 tx=0x7fe81801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a6f6000c252b078 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.024+0000 7fe82f400640 1 -- 172.21.15.55:0/3547655460 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180ab600 con 0x7fe8300707e0 2024-04-02T07:22:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.024+0000 7fe82f400640 1 -- 172.21.15.55:0/3547655460 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8180a7050 con 0x7fe8300707e0 2024-04-02T07:22:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.024+0000 7fe82f400640 1 -- 172.21.15.55:0/3547655460 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180ab960 con 0x7fe8300707e0 2024-04-02T07:22:53.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe837200640 1 -- 172.21.15.55:0/3547655460 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8300707e0 msgr2=0x7fe8300b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:53.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe837200640 1 --2- 172.21.15.55:0/3547655460 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8300707e0 0x7fe8300b2a90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe8180097c0 tx=0x7fe81801c4a0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe837200640 1 -- 172.21.15.55:0/3547655460 shutdown_connections 2024-04-02T07:22:53.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe837200640 1 --2- 172.21.15.55:0/3547655460 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8300707e0 0x7fe8300b2a90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe837200640 1 --2- 172.21.15.55:0/3547655460 >> v2:172.21.15.106:3300/0 conn(0x7fe830144260 0x7fe8300702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe837200640 1 -- 172.21.15.55:0/3547655460 >> 172.21.15.55:0/3547655460 conn(0x7fe83006a390 msgr2=0x7fe8300b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:53.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe837200640 1 -- 172.21.15.55:0/3547655460 shutdown_connections 2024-04-02T07:22:53.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe837200640 1 -- 172.21.15.55:0/3547655460 wait complete. 2024-04-02T07:22:53.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe837200640 1 Processor -- start 2024-04-02T07:22:53.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe837200640 1 -- start start 2024-04-02T07:22:53.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe837200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8300707e0 0x7fe8301377e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe837200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8300b2fd0 0x7fe830137040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe837200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe830144260 0x7fe83015c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe837200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83013fc90 con 0x7fe8300b2fd0 2024-04-02T07:22:53.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe837200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe83013ad60 con 0x7fe8300707e0 2024-04-02T07:22:53.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe837200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe830137580 con 0x7fe830144260 2024-04-02T07:22:53.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe827400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8300b2fd0 0x7fe830137040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe827400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8300b2fd0 0x7fe830137040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34300/0 (socket says 172.21.15.55:34300) 2024-04-02T07:22:53.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe827400640 1 -- 172.21.15.55:0/4011172026 learned_addr learned my addr 172.21.15.55:0/4011172026 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:53.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe835200640 1 --2- 172.21.15.55:0/4011172026 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe830144260 0x7fe83015c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe82fe00640 1 --2- 172.21.15.55:0/4011172026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8300707e0 0x7fe8301377e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe827400640 1 -- 172.21.15.55:0/4011172026 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe830144260 msgr2=0x7fe83015c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:53.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe827400640 1 --2- 172.21.15.55:0/4011172026 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe830144260 0x7fe83015c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe827400640 1 -- 172.21.15.55:0/4011172026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8300707e0 msgr2=0x7fe8301377e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:53.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe827400640 1 --2- 172.21.15.55:0/4011172026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8300707e0 0x7fe8301377e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe827400640 1 -- 172.21.15.55:0/4011172026 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe818009420 con 0x7fe8300b2fd0 2024-04-02T07:22:53.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.028+0000 7fe835200640 1 --2- 172.21.15.55:0/4011172026 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe830144260 0x7fe83015c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:53.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.032+0000 7fe827400640 1 --2- 172.21.15.55:0/4011172026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8300b2fd0 0x7fe830137040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe818000c10 tx=0x7fe818019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:53.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.032+0000 7fe82cc00640 1 -- 172.21.15.55:0/4011172026 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe818003a30 con 0x7fe8300b2fd0 2024-04-02T07:22:53.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.032+0000 7fe82cc00640 1 -- 172.21.15.55:0/4011172026 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe818003b90 con 0x7fe8300b2fd0 2024-04-02T07:22:53.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.032+0000 7fe82cc00640 1 -- 172.21.15.55:0/4011172026 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8180ab400 con 0x7fe8300b2fd0 2024-04-02T07:22:53.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.032+0000 7fe837200640 1 -- 172.21.15.55:0/4011172026 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe83013a5b0 con 0x7fe8300b2fd0 2024-04-02T07:22:53.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.032+0000 7fe837200640 1 -- 172.21.15.55:0/4011172026 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe83013f8b0 con 0x7fe8300b2fd0 2024-04-02T07:22:53.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.032+0000 7fe837200640 1 -- 172.21.15.55:0/4011172026 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe830073530 con 0x7fe8300b2fd0 2024-04-02T07:22:53.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.032+0000 7fe82cc00640 1 -- 172.21.15.55:0/4011172026 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe8180b2040 con 0x7fe8300b2fd0 2024-04-02T07:22:53.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.036+0000 7fe82cc00640 1 --2- 172.21.15.55:0/4011172026 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe80c066690 0x7fe80c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.036+0000 7fe82cc00640 1 -- 172.21.15.55:0/4011172026 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe81811de70 con 0x7fe8300b2fd0 2024-04-02T07:22:53.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.036+0000 7fe82fe00640 1 --2- 172.21.15.55:0/4011172026 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe80c066690 0x7fe80c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.036+0000 7fe82fe00640 1 --2- 172.21.15.55:0/4011172026 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe80c066690 0x7fe80c068b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe820009b60 tx=0x7fe820009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:53.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.040+0000 7fe82cc00640 1 -- 172.21.15.55:0/4011172026 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe8180eb1d0 con 0x7fe8300b2fd0 2024-04-02T07:22:53.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.200+0000 7fe837200640 1 -- 172.21.15.55:0/4011172026 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe83013fdd0 con 0x7fe8300b2fd0 2024-04-02T07:22:53.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.200+0000 7fe82cc00640 1 -- 172.21.15.55:0/4011172026 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8180ee7f0 con 0x7fe8300b2fd0 2024-04-02T07:22:53.204 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:22:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.200+0000 7fe837200640 1 -- 172.21.15.55:0/4011172026 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe80c066690 msgr2=0x7fe80c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.200+0000 7fe837200640 1 --2- 172.21.15.55:0/4011172026 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe80c066690 0x7fe80c068b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe820009b60 tx=0x7fe820009190 comp rx=0 tx=0).stop 2024-04-02T07:22:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.200+0000 7fe837200640 1 -- 172.21.15.55:0/4011172026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8300b2fd0 msgr2=0x7fe830137040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.200+0000 7fe837200640 1 --2- 172.21.15.55:0/4011172026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8300b2fd0 0x7fe830137040 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe818000c10 tx=0x7fe818019240 comp rx=0 tx=0).stop 2024-04-02T07:22:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.200+0000 7fe837200640 1 -- 172.21.15.55:0/4011172026 shutdown_connections 2024-04-02T07:22:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.200+0000 7fe837200640 1 --2- 172.21.15.55:0/4011172026 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe830144260 0x7fe83015c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.200+0000 7fe837200640 1 --2- 172.21.15.55:0/4011172026 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8300b2fd0 0x7fe830137040 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.200+0000 7fe837200640 1 --2- 172.21.15.55:0/4011172026 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe80c066690 0x7fe80c068b50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.200+0000 7fe837200640 1 --2- 172.21.15.55:0/4011172026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8300707e0 0x7fe8301377e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.200+0000 7fe837200640 1 -- 172.21.15.55:0/4011172026 >> 172.21.15.55:0/4011172026 conn(0x7fe83006a390 msgr2=0x7fe830164c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:53.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.200+0000 7fe837200640 1 -- 172.21.15.55:0/4011172026 shutdown_connections 2024-04-02T07:22:53.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.200+0000 7fe837200640 1 -- 172.21.15.55:0/4011172026 wait complete. 2024-04-02T07:22:53.225 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:22:53.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1559e00640 1 Processor -- start 2024-04-02T07:22:53.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1559e00640 1 -- start start 2024-04-02T07:22:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1559e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15540ade90 0x7f155406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1559e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f15540b41a0 0x7f1554142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1559e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f155406c630 con 0x7f15540b3dc0 2024-04-02T07:22:53.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1559e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15540cae80 con 0x7f15540b41a0 2024-04-02T07:22:53.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1559e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f155406c8f0 con 0x7f15540ade90 2024-04-02T07:22:53.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1552a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f15540b3dc0 0x7f15540ca770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37320/0 (socket says 172.21.15.55:37320) 2024-04-02T07:22:53.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1552a00640 1 -- 172.21.15.55:0/3967639189 learned_addr learned my addr 172.21.15.55:0/3967639189 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f154a000640 1 --2- 172.21.15.55:0/3967639189 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15540ade90 0x7f155406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1553400640 1 --2- 172.21.15.55:0/3967639189 >> v2:172.21.15.106:3300/0 conn(0x7f15540b41a0 0x7f1554142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1552000640 1 -- 172.21.15.55:0/3967639189 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1600810943 0 0) 0x7f155406c630 con 0x7f15540b3dc0 2024-04-02T07:22:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1552000640 1 -- 172.21.15.55:0/3967639189 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1538003530 con 0x7f15540b3dc0 2024-04-02T07:22:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1552000640 1 -- 172.21.15.55:0/3967639189 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1578080489 0 0) 0x7f1538003530 con 0x7f15540b3dc0 2024-04-02T07:22:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1552000640 1 -- 172.21.15.55:0/3967639189 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15540ade90 msgr2=0x7f155406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1552000640 1 --2- 172.21.15.55:0/3967639189 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15540ade90 0x7f155406d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1552000640 1 -- 172.21.15.55:0/3967639189 >> v2:172.21.15.106:3300/0 conn(0x7f15540b41a0 msgr2=0x7f1554142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1552000640 1 --2- 172.21.15.55:0/3967639189 >> v2:172.21.15.106:3300/0 conn(0x7f15540b41a0 0x7f1554142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1552000640 1 -- 172.21.15.55:0/3967639189 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f155406cbd0 con 0x7f15540b3dc0 2024-04-02T07:22:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1552000640 1 -- 172.21.15.55:0/3967639189 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f1544001680 con 0x7f15540b3dc0 2024-04-02T07:22:53.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1552000640 1 -- 172.21.15.55:0/3967639189 >> v1:172.21.15.55:6789/0 conn(0x7f15540b3dc0 legacy=0x7f15540ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:53.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1552000640 1 --2- 172.21.15.55:0/3967639189 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15540ade90 0x7f1538003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1552000640 1 --2- 172.21.15.55:0/3967639189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1538003f00 0x7f15380047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1552000640 1 --2- 172.21.15.55:0/3967639189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1538004d10 0x7f1538005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1552000640 1 -- 172.21.15.55:0/3967639189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15540cae80 con 0x7f1538003f00 2024-04-02T07:22:53.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1552000640 1 -- 172.21.15.55:0/3967639189 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155406c8f0 con 0x7f1538004d10 2024-04-02T07:22:53.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1552000640 1 -- 172.21.15.55:0/3967639189 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f153800b9e0 con 0x7f15540ade90 2024-04-02T07:22:53.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f154a000640 1 --2- 172.21.15.55:0/3967639189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1538003f00 0x7f15380047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1552a00640 1 --2- 172.21.15.55:0/3967639189 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15540ade90 0x7f1538003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.364+0000 7f1553400640 1 --2- 172.21.15.55:0/3967639189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1538004d10 0x7f1538005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.368+0000 7f1552a00640 1 -- 172.21.15.55:0/3967639189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1538004d10 msgr2=0x7f1538005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:53.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.368+0000 7f1552a00640 1 --2- 172.21.15.55:0/3967639189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1538004d10 0x7f1538005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.368+0000 7f1552a00640 1 -- 172.21.15.55:0/3967639189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1538003f00 msgr2=0x7f15380047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:53.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.368+0000 7f1552a00640 1 --2- 172.21.15.55:0/3967639189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1538003f00 0x7f15380047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.368+0000 7f1552a00640 1 -- 172.21.15.55:0/3967639189 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1538003530 con 0x7f15540ade90 2024-04-02T07:22:53.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.368+0000 7f1552a00640 1 --2- 172.21.15.55:0/3967639189 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15540ade90 0x7f1538003980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f154400c270 tx=0x7f154401cc50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caea9c17b5b485ec server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:53.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.368+0000 7f1552000640 1 -- 172.21.15.55:0/3967639189 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15440058e0 con 0x7f15540ade90 2024-04-02T07:22:53.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.368+0000 7f1552000640 1 -- 172.21.15.55:0/3967639189 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1544005a40 con 0x7f15540ade90 2024-04-02T07:22:53.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.368+0000 7f1552000640 1 -- 172.21.15.55:0/3967639189 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1544005e50 con 0x7f15540ade90 2024-04-02T07:22:53.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.368+0000 7f1559e00640 1 -- 172.21.15.55:0/3967639189 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15540ade90 msgr2=0x7f1538003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:53.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.368+0000 7f1559e00640 1 --2- 172.21.15.55:0/3967639189 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15540ade90 0x7f1538003980 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f154400c270 tx=0x7f154401cc50 comp rx=0 tx=0).stop 2024-04-02T07:22:53.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.368+0000 7f1553400640 1 -- 172.21.15.55:0/3967639189 reap_dead start 2024-04-02T07:22:53.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1559e00640 1 -- 172.21.15.55:0/3967639189 shutdown_connections 2024-04-02T07:22:53.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1559e00640 1 -- 172.21.15.55:0/3967639189 >> 172.21.15.55:0/3967639189 conn(0x7f155406a390 msgr2=0x7f15540b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:53.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1559e00640 1 -- 172.21.15.55:0/3967639189 shutdown_connections 2024-04-02T07:22:53.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1559e00640 1 -- 172.21.15.55:0/3967639189 wait complete. 2024-04-02T07:22:53.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1559e00640 1 Processor -- start 2024-04-02T07:22:53.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1559e00640 1 -- start start 2024-04-02T07:22:53.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1559e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15540ade90 0x7f15541f80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1559e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15541f5350 0x7f15540af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1559e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15540af800 0x7f155413eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1559e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15540afc80 con 0x7f15540af800 2024-04-02T07:22:53.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1559e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f155413fe50 con 0x7f15540ade90 2024-04-02T07:22:53.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1559e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15541409e0 con 0x7f15541f5350 2024-04-02T07:22:53.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1553400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15540af800 0x7f155413eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1553400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15540af800 0x7f155413eeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34322/0 (socket says 172.21.15.55:34322) 2024-04-02T07:22:53.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1553400640 1 -- 172.21.15.55:0/3154112487 learned_addr learned my addr 172.21.15.55:0/3154112487 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:53.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1552a00640 1 --2- 172.21.15.55:0/3154112487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15540ade90 0x7f15541f80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f154a000640 1 --2- 172.21.15.55:0/3154112487 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15541f5350 0x7f15540af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1553400640 1 -- 172.21.15.55:0/3154112487 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15541f5350 msgr2=0x7f15540af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1553400640 1 --2- 172.21.15.55:0/3154112487 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15541f5350 0x7f15540af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1553400640 1 -- 172.21.15.55:0/3154112487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15540ade90 msgr2=0x7f15541f80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1553400640 1 --2- 172.21.15.55:0/3154112487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15540ade90 0x7f15541f80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1553400640 1 -- 172.21.15.55:0/3154112487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15541f8630 con 0x7f15540af800 2024-04-02T07:22:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.372+0000 7f1553400640 1 --2- 172.21.15.55:0/3154112487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15540af800 0x7f155413eeb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f154c011bf0 tx=0x7f154c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.376+0000 7f154be00640 1 -- 172.21.15.55:0/3154112487 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c00e040 con 0x7f15540af800 2024-04-02T07:22:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.376+0000 7f154be00640 1 -- 172.21.15.55:0/3154112487 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f154c00f040 con 0x7f15540af800 2024-04-02T07:22:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.376+0000 7f154be00640 1 -- 172.21.15.55:0/3154112487 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f154c015430 con 0x7f15540af800 2024-04-02T07:22:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.376+0000 7f1559e00640 1 -- 172.21.15.55:0/3154112487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f155413fb70 con 0x7f15540af800 2024-04-02T07:22:53.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.376+0000 7f1559e00640 1 -- 172.21.15.55:0/3154112487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1554140670 con 0x7f15540af800 2024-04-02T07:22:53.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.376+0000 7f1559e00640 1 -- 172.21.15.55:0/3154112487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15541401f0 con 0x7f15540af800 2024-04-02T07:22:53.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.376+0000 7f154be00640 1 -- 172.21.15.55:0/3154112487 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f154c015590 con 0x7f15540af800 2024-04-02T07:22:53.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.376+0000 7f154be00640 1 --2- 172.21.15.55:0/3154112487 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1530066690 0x7f1530068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.376+0000 7f154be00640 1 -- 172.21.15.55:0/3154112487 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f154c084b70 con 0x7f15540af800 2024-04-02T07:22:53.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.376+0000 7f1552a00640 1 --2- 172.21.15.55:0/3154112487 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1530066690 0x7f1530068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.376+0000 7f1552a00640 1 --2- 172.21.15.55:0/3154112487 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1530066690 0x7f1530068b50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f15440aa000 tx=0x7f1544001a80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:53.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.380+0000 7f154be00640 1 -- 172.21.15.55:0/3154112487 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f15541401f0 con 0x7f15540af800 2024-04-02T07:22:53.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.540+0000 7f1559e00640 1 -- 172.21.15.55:0/3154112487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f15541401f0 con 0x7f15540af800 2024-04-02T07:22:53.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.540+0000 7f154be00640 1 -- 172.21.15.55:0/3154112487 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f15541401f0 con 0x7f15540af800 2024-04-02T07:22:53.546 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:22:53.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.544+0000 7f1559e00640 1 -- 172.21.15.55:0/3154112487 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1530066690 msgr2=0x7f1530068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:53.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.544+0000 7f1559e00640 1 --2- 172.21.15.55:0/3154112487 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1530066690 0x7f1530068b50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f15440aa000 tx=0x7f1544001a80 comp rx=0 tx=0).stop 2024-04-02T07:22:53.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.544+0000 7f1559e00640 1 -- 172.21.15.55:0/3154112487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15540af800 msgr2=0x7f155413eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:53.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.544+0000 7f1559e00640 1 --2- 172.21.15.55:0/3154112487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15540af800 0x7f155413eeb0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f154c011bf0 tx=0x7f154c00f580 comp rx=0 tx=0).stop 2024-04-02T07:22:53.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.544+0000 7f1559e00640 1 -- 172.21.15.55:0/3154112487 shutdown_connections 2024-04-02T07:22:53.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.544+0000 7f1559e00640 1 --2- 172.21.15.55:0/3154112487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15540af800 0x7f155413eeb0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.544+0000 7f1559e00640 1 --2- 172.21.15.55:0/3154112487 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15541f5350 0x7f15540af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.544+0000 7f1559e00640 1 --2- 172.21.15.55:0/3154112487 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1530066690 0x7f1530068b50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.544+0000 7f1559e00640 1 --2- 172.21.15.55:0/3154112487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15540ade90 0x7f15541f80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.544+0000 7f1559e00640 1 -- 172.21.15.55:0/3154112487 >> 172.21.15.55:0/3154112487 conn(0x7f155406a390 msgr2=0x7f1554157910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:53.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.544+0000 7f1559e00640 1 -- 172.21.15.55:0/3154112487 shutdown_connections 2024-04-02T07:22:53.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.544+0000 7f1559e00640 1 -- 172.21.15.55:0/3154112487 wait complete. 2024-04-02T07:22:53.567 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:22:53.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.704+0000 7ff4c2400640 1 Processor -- start 2024-04-02T07:22:53.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.704+0000 7ff4c2400640 1 -- start start 2024-04-02T07:22:53.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.704+0000 7ff4c2400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff4bc0709b0 0x7ff4bc0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.704+0000 7ff4c2400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4bc0b2fd0 0x7ff4bc0b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.704+0000 7ff4c2400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4bc15e3a0 con 0x7ff4bc144260 2024-04-02T07:22:53.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.708+0000 7ff4c2400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4bc0b37c0 con 0x7ff4bc0b2fd0 2024-04-02T07:22:53.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.708+0000 7ff4c2400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4bc15e5f0 con 0x7ff4bc0709b0 2024-04-02T07:22:53.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.708+0000 7ff4bbe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4bc0b2fd0 0x7ff4bc0b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.708+0000 7ff4bbe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff4bc0b2fd0 0x7ff4bc0b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34332/0 (socket says 172.21.15.55:34332) 2024-04-02T07:22:53.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.708+0000 7ff4bbe00640 1 -- 172.21.15.55:0/2210877598 learned_addr learned my addr 172.21.15.55:0/2210877598 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:53.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.708+0000 7ff4b2a00640 1 --2- 172.21.15.55:0/2210877598 >> v2:172.21.15.106:3300/0 conn(0x7ff4bc0709b0 0x7ff4bc0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.708+0000 7ff4bbe00640 1 -- 172.21.15.55:0/2210877598 >> v2:172.21.15.106:3300/0 conn(0x7ff4bc0709b0 msgr2=0x7ff4bc0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:53.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.708+0000 7ff4bbe00640 1 --2- 172.21.15.55:0/2210877598 >> v2:172.21.15.106:3300/0 conn(0x7ff4bc0709b0 0x7ff4bc0b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.708+0000 7ff4bbe00640 1 -- 172.21.15.55:0/2210877598 >> v1:172.21.15.106:6789/0 conn(0x7ff4bc144260 legacy=0x7ff4bc0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:53.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.708+0000 7ff4bbe00640 1 -- 172.21.15.55:0/2210877598 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc15e8d0 con 0x7ff4bc0b2fd0 2024-04-02T07:22:53.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.708+0000 7ff4bbe00640 1 --2- 172.21.15.55:0/2210877598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4bc0b2fd0 0x7ff4bc0b1670 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc0b1410 tx=0x7ff4b401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab6764e2f4860fa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:53.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.708+0000 7ff4baa00640 1 -- 172.21.15.55:0/2210877598 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b40a57a0 con 0x7ff4bc0b2fd0 2024-04-02T07:22:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.708+0000 7ff4baa00640 1 -- 172.21.15.55:0/2210877598 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b40a5900 con 0x7ff4bc0b2fd0 2024-04-02T07:22:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.708+0000 7ff4baa00640 1 -- 172.21.15.55:0/2210877598 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b40a5c90 con 0x7ff4bc0b2fd0 2024-04-02T07:22:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4c2400640 1 -- 172.21.15.55:0/2210877598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4bc0b2fd0 msgr2=0x7ff4bc0b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4c2400640 1 --2- 172.21.15.55:0/2210877598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4bc0b2fd0 0x7ff4bc0b1670 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc0b1410 tx=0x7ff4b401c9f0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4c2400640 1 -- 172.21.15.55:0/2210877598 shutdown_connections 2024-04-02T07:22:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4c2400640 1 --2- 172.21.15.55:0/2210877598 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4bc0b2fd0 0x7ff4bc0b1670 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4c2400640 1 --2- 172.21.15.55:0/2210877598 >> v2:172.21.15.106:3300/0 conn(0x7ff4bc0709b0 0x7ff4bc0b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4c2400640 1 -- 172.21.15.55:0/2210877598 >> 172.21.15.55:0/2210877598 conn(0x7ff4bc06a390 msgr2=0x7ff4bc0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:53.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4c2400640 1 -- 172.21.15.55:0/2210877598 shutdown_connections 2024-04-02T07:22:53.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4c2400640 1 -- 172.21.15.55:0/2210877598 wait complete. 2024-04-02T07:22:53.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4c2400640 1 Processor -- start 2024-04-02T07:22:53.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4c2400640 1 -- start start 2024-04-02T07:22:53.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4c2400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4bc0709b0 0x7ff4bc156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4c2400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff4bc0b2fd0 0x7ff4bc164a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4c2400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4bc144260 0x7ff4bc164f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4c2400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc13dba0 con 0x7ff4bc0709b0 2024-04-02T07:22:53.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4c2400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc13cf90 con 0x7ff4bc144260 2024-04-02T07:22:53.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4c2400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc13d270 con 0x7ff4bc0b2fd0 2024-04-02T07:22:53.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4bb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4bc0709b0 0x7ff4bc156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4bb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4bc0709b0 0x7ff4bc156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34340/0 (socket says 172.21.15.55:34340) 2024-04-02T07:22:53.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4bb400640 1 -- 172.21.15.55:0/937355818 learned_addr learned my addr 172.21.15.55:0/937355818 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:53.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4b2a00640 1 --2- 172.21.15.55:0/937355818 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff4bc0b2fd0 0x7ff4bc164a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4bbe00640 1 --2- 172.21.15.55:0/937355818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4bc144260 0x7ff4bc164f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4bb400640 1 -- 172.21.15.55:0/937355818 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff4bc0b2fd0 msgr2=0x7ff4bc164a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:53.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4bb400640 1 --2- 172.21.15.55:0/937355818 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff4bc0b2fd0 0x7ff4bc164a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4bb400640 1 -- 172.21.15.55:0/937355818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4bc144260 msgr2=0x7ff4bc164f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:53.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4bb400640 1 --2- 172.21.15.55:0/937355818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4bc144260 0x7ff4bc164f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4bb400640 1 -- 172.21.15.55:0/937355818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b4009b30 con 0x7ff4bc0709b0 2024-04-02T07:22:53.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.712+0000 7ff4bb400640 1 --2- 172.21.15.55:0/937355818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4bc0709b0 0x7ff4bc156c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c500 tx=0x7ff4ac00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:53.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.716+0000 7ff4b3e00640 1 -- 172.21.15.55:0/937355818 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac005220 con 0x7ff4bc0709b0 2024-04-02T07:22:53.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.716+0000 7ff4b3e00640 1 -- 172.21.15.55:0/937355818 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4ac005380 con 0x7ff4bc0709b0 2024-04-02T07:22:53.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.716+0000 7ff4b3e00640 1 -- 172.21.15.55:0/937355818 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4ac007270 con 0x7ff4bc0709b0 2024-04-02T07:22:53.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.716+0000 7ff4c2400640 1 -- 172.21.15.55:0/937355818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4bc13d550 con 0x7ff4bc0709b0 2024-04-02T07:22:53.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.716+0000 7ff4c2400640 1 -- 172.21.15.55:0/937355818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4bc1571c0 con 0x7ff4bc0709b0 2024-04-02T07:22:53.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.716+0000 7ff4c2400640 1 -- 172.21.15.55:0/937355818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4bc073530 con 0x7ff4bc0709b0 2024-04-02T07:22:53.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.716+0000 7ff4b3e00640 1 -- 172.21.15.55:0/937355818 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff4ac0073d0 con 0x7ff4bc0709b0 2024-04-02T07:22:53.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.716+0000 7ff4b3e00640 1 --2- 172.21.15.55:0/937355818 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff498066690 0x7ff498068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:53.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.716+0000 7ff4b3e00640 1 -- 172.21.15.55:0/937355818 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4ac0839e0 con 0x7ff4bc0709b0 2024-04-02T07:22:53.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.716+0000 7ff4b2a00640 1 --2- 172.21.15.55:0/937355818 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff498066690 0x7ff498068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:53.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.720+0000 7ff4b2a00640 1 --2- 172.21.15.55:0/937355818 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff498066690 0x7ff498068b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc15d860 tx=0x7ff4a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:53.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.720+0000 7ff4b3e00640 1 -- 172.21.15.55:0/937355818 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff4ac050d70 con 0x7ff4bc0709b0 2024-04-02T07:22:53.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.888+0000 7ff4c2400640 1 -- 172.21.15.55:0/937355818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff4bc066c90 con 0x7ff4bc0709b0 2024-04-02T07:22:53.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.888+0000 7ff4b3e00640 1 -- 172.21.15.55:0/937355818 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff4ac054390 con 0x7ff4bc0709b0 2024-04-02T07:22:53.895 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:22:53.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.892+0000 7ff4c2400640 1 -- 172.21.15.55:0/937355818 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff498066690 msgr2=0x7ff498068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:53.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.892+0000 7ff4c2400640 1 --2- 172.21.15.55:0/937355818 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff498066690 0x7ff498068b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc15d860 tx=0x7ff4a4008040 comp rx=0 tx=0).stop 2024-04-02T07:22:53.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.892+0000 7ff4c2400640 1 -- 172.21.15.55:0/937355818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4bc0709b0 msgr2=0x7ff4bc156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:53.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.892+0000 7ff4c2400640 1 --2- 172.21.15.55:0/937355818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4bc0709b0 0x7ff4bc156c80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac00c500 tx=0x7ff4ac00c9c0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.892+0000 7ff4c2400640 1 -- 172.21.15.55:0/937355818 shutdown_connections 2024-04-02T07:22:53.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.892+0000 7ff4c2400640 1 --2- 172.21.15.55:0/937355818 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff498066690 0x7ff498068b50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.892+0000 7ff4c2400640 1 --2- 172.21.15.55:0/937355818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff4bc144260 0x7ff4bc164f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.892+0000 7ff4c2400640 1 --2- 172.21.15.55:0/937355818 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff4bc0b2fd0 0x7ff4bc164a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.892+0000 7ff4c2400640 1 --2- 172.21.15.55:0/937355818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff4bc0709b0 0x7ff4bc156c80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:53.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.892+0000 7ff4c2400640 1 -- 172.21.15.55:0/937355818 >> 172.21.15.55:0/937355818 conn(0x7ff4bc06a390 msgr2=0x7ff4bc1431e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:53.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.892+0000 7ff4c2400640 1 -- 172.21.15.55:0/937355818 shutdown_connections 2024-04-02T07:22:53.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:53.892+0000 7ff4c2400640 1 -- 172.21.15.55:0/937355818 wait complete. 2024-04-02T07:22:53.918 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:22:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.052+0000 7fe0dc200640 1 Processor -- start 2024-04-02T07:22:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.052+0000 7fe0dc200640 1 -- start start 2024-04-02T07:22:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.056+0000 7fe0dc200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe0d415cb20 0x7fe0d40ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:54.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.056+0000 7fe0dc200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d40cea70 con 0x7fe0d40cad50 2024-04-02T07:22:54.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.056+0000 7fe0dc200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0d40b13a0 con 0x7fe0d40b0d30 2024-04-02T07:22:54.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.056+0000 7fe0dc200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0d40b11c0 con 0x7fe0d415cb20 2024-04-02T07:22:54.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.056+0000 7fe0d9800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe0d415cb20 0x7fe0d40ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:54.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.056+0000 7fe0d9800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe0d415cb20 0x7fe0d40ccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34348/0 (socket says 172.21.15.55:34348) 2024-04-02T07:22:54.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.056+0000 7fe0d8e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe0d40cad50 0x7fe0d40b0620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37326/0 (socket says 172.21.15.55:37326) 2024-04-02T07:22:54.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.056+0000 7fe0d9800640 1 -- 172.21.15.55:0/1607499707 learned_addr learned my addr 172.21.15.55:0/1607499707 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:54.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.056+0000 7fe0d9800640 1 -- 172.21.15.55:0/1607499707 >> v1:172.21.15.106:6789/0 conn(0x7fe0d40b0d30 legacy=0x7fe0d40cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:54.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.056+0000 7fe0d9800640 1 -- 172.21.15.55:0/1607499707 >> v1:172.21.15.55:6789/0 conn(0x7fe0d40cad50 legacy=0x7fe0d40b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:54.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.056+0000 7fe0d9800640 1 -- 172.21.15.55:0/1607499707 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d40b1680 con 0x7fe0d415cb20 2024-04-02T07:22:54.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.056+0000 7fe0d3e00640 1 -- 172.21.15.55:0/1607499707 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181675230 0 0) 0x7fe0d40cea70 con 0x7fe0d40cad50 2024-04-02T07:22:54.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.060+0000 7fe0d9800640 1 --2- 172.21.15.55:0/1607499707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d415cb20 0x7fe0d40ccf80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009870 tx=0x7fe0c801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ab938c9a1b4e15 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:54.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.060+0000 7fe0d3e00640 1 -- 172.21.15.55:0/1607499707 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80ab640 con 0x7fe0d415cb20 2024-04-02T07:22:54.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.060+0000 7fe0d3e00640 1 -- 172.21.15.55:0/1607499707 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c80a7070 con 0x7fe0d415cb20 2024-04-02T07:22:54.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.060+0000 7fe0d3e00640 1 -- 172.21.15.55:0/1607499707 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80ab9c0 con 0x7fe0d415cb20 2024-04-02T07:22:54.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.060+0000 7fe0dc200640 1 -- 172.21.15.55:0/1607499707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d415cb20 msgr2=0x7fe0d40ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:54.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.060+0000 7fe0dc200640 1 --2- 172.21.15.55:0/1607499707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d415cb20 0x7fe0d40ccf80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe0c8009870 tx=0x7fe0c801c530 comp rx=0 tx=0).stop 2024-04-02T07:22:54.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.060+0000 7fe0dc200640 1 -- 172.21.15.55:0/1607499707 shutdown_connections 2024-04-02T07:22:54.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.060+0000 7fe0dc200640 1 --2- 172.21.15.55:0/1607499707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d415cb20 0x7fe0d40ccf80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.060+0000 7fe0dc200640 1 -- 172.21.15.55:0/1607499707 >> 172.21.15.55:0/1607499707 conn(0x7fe0d40d0700 msgr2=0x7fe0d40d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:54.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.060+0000 7fe0dc200640 1 -- 172.21.15.55:0/1607499707 shutdown_connections 2024-04-02T07:22:54.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.060+0000 7fe0dc200640 1 -- 172.21.15.55:0/1607499707 wait complete. 2024-04-02T07:22:54.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.060+0000 7fe0dc200640 1 Processor -- start 2024-04-02T07:22:54.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.060+0000 7fe0dc200640 1 -- start start 2024-04-02T07:22:54.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.060+0000 7fe0dc200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d40b0d30 0x7fe0d406e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:54.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.060+0000 7fe0dc200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0d40cad50 0x7fe0d40b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:54.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.060+0000 7fe0dc200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0d415cb20 0x7fe0d40b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:54.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.060+0000 7fe0dc200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d40b6670 con 0x7fe0d40b0d30 2024-04-02T07:22:54.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.060+0000 7fe0dc200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d40b5ec0 con 0x7fe0d415cb20 2024-04-02T07:22:54.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.060+0000 7fe0dc200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0d40c4db0 con 0x7fe0d40cad50 2024-04-02T07:22:54.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.060+0000 7fe0d9800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d40b0d30 0x7fe0d406e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:54.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.064+0000 7fe0d9800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d40b0d30 0x7fe0d406e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34352/0 (socket says 172.21.15.55:34352) 2024-04-02T07:22:54.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.064+0000 7fe0d9800640 1 -- 172.21.15.55:0/1603996894 learned_addr learned my addr 172.21.15.55:0/1603996894 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:54.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.064+0000 7fe0da200640 1 --2- 172.21.15.55:0/1603996894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0d415cb20 0x7fe0d40b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:54.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.064+0000 7fe0d8e00640 1 --2- 172.21.15.55:0/1603996894 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0d40cad50 0x7fe0d40b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:54.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.064+0000 7fe0d9800640 1 -- 172.21.15.55:0/1603996894 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0d40cad50 msgr2=0x7fe0d40b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:54.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.064+0000 7fe0d9800640 1 --2- 172.21.15.55:0/1603996894 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0d40cad50 0x7fe0d40b5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.064+0000 7fe0d9800640 1 -- 172.21.15.55:0/1603996894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0d415cb20 msgr2=0x7fe0d40b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:54.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.064+0000 7fe0d9800640 1 --2- 172.21.15.55:0/1603996894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0d415cb20 0x7fe0d40b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.064+0000 7fe0d9800640 1 -- 172.21.15.55:0/1603996894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c80094d0 con 0x7fe0d40b0d30 2024-04-02T07:22:54.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.064+0000 7fe0d8e00640 1 --2- 172.21.15.55:0/1603996894 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0d40cad50 0x7fe0d40b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:54.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.064+0000 7fe0d9800640 1 --2- 172.21.15.55:0/1603996894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d40b0d30 0x7fe0d406e6b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe0c801a160 tx=0x7fe0c801ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:54.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.064+0000 7fe0d1600640 1 -- 172.21.15.55:0/1603996894 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80be5f0 con 0x7fe0d40b0d30 2024-04-02T07:22:54.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.064+0000 7fe0d1600640 1 -- 172.21.15.55:0/1603996894 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0c80be770 con 0x7fe0d40b0d30 2024-04-02T07:22:54.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.064+0000 7fe0d1600640 1 -- 172.21.15.55:0/1603996894 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0c80beb20 con 0x7fe0d40b0d30 2024-04-02T07:22:54.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.064+0000 7fe0dc200640 1 -- 172.21.15.55:0/1603996894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0d4153d30 con 0x7fe0d40b0d30 2024-04-02T07:22:54.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.064+0000 7fe0dc200640 1 -- 172.21.15.55:0/1603996894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0d40b6390 con 0x7fe0d40b0d30 2024-04-02T07:22:54.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.064+0000 7fe0dc200640 1 -- 172.21.15.55:0/1603996894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0d4066c90 con 0x7fe0d40b0d30 2024-04-02T07:22:54.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.064+0000 7fe0d1600640 1 -- 172.21.15.55:0/1603996894 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe0c80b43f0 con 0x7fe0d40b0d30 2024-04-02T07:22:54.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.068+0000 7fe0d1600640 1 --2- 172.21.15.55:0/1603996894 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe0b4066690 0x7fe0b4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:54.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.068+0000 7fe0d1600640 1 -- 172.21.15.55:0/1603996894 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0c811e500 con 0x7fe0d40b0d30 2024-04-02T07:22:54.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.068+0000 7fe0d8e00640 1 --2- 172.21.15.55:0/1603996894 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe0b4066690 0x7fe0b4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:54.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.068+0000 7fe0d8e00640 1 --2- 172.21.15.55:0/1603996894 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe0b4066690 0x7fe0b4068b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4099e80 tx=0x7fe0c0007c60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:54.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.068+0000 7fe0d1600640 1 -- 172.21.15.55:0/1603996894 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe0c80eb880 con 0x7fe0d40b0d30 2024-04-02T07:22:54.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.244+0000 7fe0dc200640 1 -- 172.21.15.55:0/1603996894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe0d40d0410 con 0x7fe0d40b0d30 2024-04-02T07:22:54.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.244+0000 7fe0d1600640 1 -- 172.21.15.55:0/1603996894 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe0d40d0410 con 0x7fe0d40b0d30 2024-04-02T07:22:54.249 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:22:54.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.244+0000 7fe0dc200640 1 -- 172.21.15.55:0/1603996894 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe0b4066690 msgr2=0x7fe0b4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:54.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.244+0000 7fe0dc200640 1 --2- 172.21.15.55:0/1603996894 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe0b4066690 0x7fe0b4068b50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4099e80 tx=0x7fe0c0007c60 comp rx=0 tx=0).stop 2024-04-02T07:22:54.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.244+0000 7fe0dc200640 1 -- 172.21.15.55:0/1603996894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d40b0d30 msgr2=0x7fe0d406e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:54.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.244+0000 7fe0dc200640 1 --2- 172.21.15.55:0/1603996894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d40b0d30 0x7fe0d406e6b0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe0c801a160 tx=0x7fe0c801ad70 comp rx=0 tx=0).stop 2024-04-02T07:22:54.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.244+0000 7fe0dc200640 1 -- 172.21.15.55:0/1603996894 shutdown_connections 2024-04-02T07:22:54.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.244+0000 7fe0dc200640 1 --2- 172.21.15.55:0/1603996894 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe0b4066690 0x7fe0b4068b50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.244+0000 7fe0dc200640 1 --2- 172.21.15.55:0/1603996894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0d415cb20 0x7fe0d40b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.244+0000 7fe0dc200640 1 --2- 172.21.15.55:0/1603996894 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0d40cad50 0x7fe0d40b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.244+0000 7fe0dc200640 1 --2- 172.21.15.55:0/1603996894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0d40b0d30 0x7fe0d406e6b0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.244+0000 7fe0dc200640 1 -- 172.21.15.55:0/1603996894 >> 172.21.15.55:0/1603996894 conn(0x7fe0d40d0700 msgr2=0x7fe0d406b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:54.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.244+0000 7fe0dc200640 1 -- 172.21.15.55:0/1603996894 shutdown_connections 2024-04-02T07:22:54.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.244+0000 7fe0dc200640 1 -- 172.21.15.55:0/1603996894 wait complete. 2024-04-02T07:22:54.270 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi055.front.sepia.ceph.com... 2024-04-02T07:22:54.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:54.271 DEBUG:teuthology.orchestra.run.smithi055:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-02T07:22:54.302 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:22:54.302 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:22:54.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:54.302 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-02T07:22:54.355 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:22:54.355 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:22:54.364 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:22:54.365 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:22:54.417 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:54.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.552+0000 7f0a2c200640 1 Processor -- start 2024-04-02T07:22:54.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.552+0000 7f0a2c200640 1 -- start start 2024-04-02T07:22:54.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.552+0000 7f0a2c200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0a24153ea0 0x7f0a240c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:54.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.552+0000 7f0a2c200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a24159be0 0x7f0a240b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:54.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.552+0000 7f0a2c200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2413d0c0 con 0x7f0a2415a040 2024-04-02T07:22:54.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.552+0000 7f0a2c200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2415a4f0 con 0x7f0a24153ea0 2024-04-02T07:22:54.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.552+0000 7f0a2c200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2415a7d0 con 0x7f0a24159be0 2024-04-02T07:22:54.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.552+0000 7f0a28e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a24159be0 0x7f0a240b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:54.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.552+0000 7f0a29800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0a24153ea0 0x7f0a240c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:54.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.552+0000 7f0a28e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a24159be0 0x7f0a240b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:37104/0 (socket says 172.21.15.55:37104) 2024-04-02T07:22:54.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.552+0000 7f0a2a200640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0a2415a040 0x7f0a2413ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:55954/0 (socket says 172.21.15.55:55954) 2024-04-02T07:22:54.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.552+0000 7f0a28e00640 1 -- 172.21.15.55:0/3149204062 learned_addr learned my addr 172.21.15.55:0/3149204062 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:54.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.556+0000 7f0a28e00640 1 -- 172.21.15.55:0/3149204062 >> v2:172.21.15.106:3300/0 conn(0x7f0a24153ea0 msgr2=0x7f0a240c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:54.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.556+0000 7f0a28e00640 1 --2- 172.21.15.55:0/3149204062 >> v2:172.21.15.106:3300/0 conn(0x7f0a24153ea0 0x7f0a240c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.556+0000 7f0a28e00640 1 -- 172.21.15.55:0/3149204062 >> v1:172.21.15.106:6789/0 conn(0x7f0a2415a040 legacy=0x7f0a2413ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:54.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.556+0000 7f0a28e00640 1 -- 172.21.15.55:0/3149204062 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2415aab0 con 0x7f0a24159be0 2024-04-02T07:22:54.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.556+0000 7f0a28e00640 1 --2- 172.21.15.55:0/3149204062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a24159be0 0x7f0a240b31b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0a10009870 tx=0x7f0a1001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5fe6527294ee9bb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:54.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.556+0000 7f0a23e00640 1 -- 172.21.15.55:0/3149204062 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100a9640 con 0x7f0a24159be0 2024-04-02T07:22:54.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.556+0000 7f0a23e00640 1 -- 172.21.15.55:0/3149204062 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a100a97a0 con 0x7f0a24159be0 2024-04-02T07:22:54.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.556+0000 7f0a23e00640 1 -- 172.21.15.55:0/3149204062 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a100a9b30 con 0x7f0a24159be0 2024-04-02T07:22:54.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a2c200640 1 -- 172.21.15.55:0/3149204062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a24159be0 msgr2=0x7f0a240b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:54.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a2c200640 1 --2- 172.21.15.55:0/3149204062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a24159be0 0x7f0a240b31b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0a10009870 tx=0x7f0a1001c560 comp rx=0 tx=0).stop 2024-04-02T07:22:54.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a2c200640 1 -- 172.21.15.55:0/3149204062 shutdown_connections 2024-04-02T07:22:54.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a2c200640 1 --2- 172.21.15.55:0/3149204062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a24159be0 0x7f0a240b31b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a2c200640 1 --2- 172.21.15.55:0/3149204062 >> v2:172.21.15.106:3300/0 conn(0x7f0a24153ea0 0x7f0a240c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a2c200640 1 -- 172.21.15.55:0/3149204062 >> 172.21.15.55:0/3149204062 conn(0x7f0a24066080 msgr2=0x7f0a24069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:54.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a2c200640 1 -- 172.21.15.55:0/3149204062 shutdown_connections 2024-04-02T07:22:54.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a2c200640 1 -- 172.21.15.55:0/3149204062 wait complete. 2024-04-02T07:22:54.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a2c200640 1 Processor -- start 2024-04-02T07:22:54.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a2c200640 1 -- start start 2024-04-02T07:22:54.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a2c200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a24153ea0 0x7f0a2413be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:54.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a2c200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a24159be0 0x7f0a2415c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:54.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a2c200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a2415a040 0x7f0a2415c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:54.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a2c200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a241f9430 con 0x7f0a24153ea0 2024-04-02T07:22:54.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a2c200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a241f6330 con 0x7f0a2415a040 2024-04-02T07:22:54.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a2c200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a241f8b00 con 0x7f0a24159be0 2024-04-02T07:22:54.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a29800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a24153ea0 0x7f0a2413be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:54.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a29800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a24153ea0 0x7f0a2413be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34356/0 (socket says 172.21.15.55:34356) 2024-04-02T07:22:54.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a29800640 1 -- 172.21.15.55:0/2940687172 learned_addr learned my addr 172.21.15.55:0/2940687172 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:54.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a28e00640 1 --2- 172.21.15.55:0/2940687172 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a24159be0 0x7f0a2415c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:54.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a2a200640 1 --2- 172.21.15.55:0/2940687172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a2415a040 0x7f0a2415c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:54.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a29800640 1 -- 172.21.15.55:0/2940687172 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a24159be0 msgr2=0x7f0a2415c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:54.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a29800640 1 --2- 172.21.15.55:0/2940687172 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a24159be0 0x7f0a2415c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a29800640 1 -- 172.21.15.55:0/2940687172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a2415a040 msgr2=0x7f0a2415c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:54.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a29800640 1 --2- 172.21.15.55:0/2940687172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a2415a040 0x7f0a2415c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.560+0000 7f0a29800640 1 -- 172.21.15.55:0/2940687172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a100094d0 con 0x7f0a24153ea0 2024-04-02T07:22:54.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.564+0000 7f0a29800640 1 --2- 172.21.15.55:0/2940687172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a24153ea0 0x7f0a2413be80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800e930 tx=0x7f0a1800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:54.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.564+0000 7f0a21600640 1 -- 172.21.15.55:0/2940687172 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a18009690 con 0x7f0a24153ea0 2024-04-02T07:22:54.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.564+0000 7f0a21600640 1 -- 172.21.15.55:0/2940687172 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1800c9a0 con 0x7f0a24153ea0 2024-04-02T07:22:54.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.564+0000 7f0a21600640 1 -- 172.21.15.55:0/2940687172 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1800cd10 con 0x7f0a24153ea0 2024-04-02T07:22:54.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.564+0000 7f0a2c200640 1 -- 172.21.15.55:0/2940687172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a241f8de0 con 0x7f0a24153ea0 2024-04-02T07:22:54.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.564+0000 7f0a2c200640 1 -- 172.21.15.55:0/2940687172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a241f98c0 con 0x7f0a24153ea0 2024-04-02T07:22:54.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.564+0000 7f0a2c200640 1 -- 172.21.15.55:0/2940687172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a24066c90 con 0x7f0a24153ea0 2024-04-02T07:22:54.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.564+0000 7f0a21600640 1 -- 172.21.15.55:0/2940687172 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f0a18013470 con 0x7f0a24153ea0 2024-04-02T07:22:54.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.564+0000 7f0a21600640 1 --2- 172.21.15.55:0/2940687172 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0a04066690 0x7f0a04068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:54.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.564+0000 7f0a21600640 1 -- 172.21.15.55:0/2940687172 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a18084340 con 0x7f0a24153ea0 2024-04-02T07:22:54.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.564+0000 7f0a28e00640 1 --2- 172.21.15.55:0/2940687172 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0a04066690 0x7f0a04068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:54.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.568+0000 7f0a28e00640 1 --2- 172.21.15.55:0/2940687172 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0a04066690 0x7f0a04068b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0a100ae000 tx=0x7f0a100b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:54.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.568+0000 7f0a21600640 1 -- 172.21.15.55:0/2940687172 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0a18051810 con 0x7f0a24153ea0 2024-04-02T07:22:54.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.732+0000 7f0a2c200640 1 -- 172.21.15.55:0/2940687172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a24153730 con 0x7f0a24153ea0 2024-04-02T07:22:54.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.732+0000 7f0a21600640 1 -- 172.21.15.55:0/2940687172 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f0a1805b030 con 0x7f0a24153ea0 2024-04-02T07:22:54.737 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:54.738 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:19.207279+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:54.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.732+0000 7f0a2c200640 1 -- 172.21.15.55:0/2940687172 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0a04066690 msgr2=0x7f0a04068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:54.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.732+0000 7f0a2c200640 1 --2- 172.21.15.55:0/2940687172 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0a04066690 0x7f0a04068b50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0a100ae000 tx=0x7f0a100b3040 comp rx=0 tx=0).stop 2024-04-02T07:22:54.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.732+0000 7f0a2c200640 1 -- 172.21.15.55:0/2940687172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a24153ea0 msgr2=0x7f0a2413be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:54.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.732+0000 7f0a2c200640 1 --2- 172.21.15.55:0/2940687172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a24153ea0 0x7f0a2413be80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0a1800e930 tx=0x7f0a1800edf0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.732+0000 7f0a2c200640 1 -- 172.21.15.55:0/2940687172 shutdown_connections 2024-04-02T07:22:54.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.732+0000 7f0a2c200640 1 --2- 172.21.15.55:0/2940687172 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0a04066690 0x7f0a04068b50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.732+0000 7f0a2c200640 1 --2- 172.21.15.55:0/2940687172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a2415a040 0x7f0a2415c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.732+0000 7f0a2c200640 1 --2- 172.21.15.55:0/2940687172 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a24159be0 0x7f0a2415c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.732+0000 7f0a2c200640 1 --2- 172.21.15.55:0/2940687172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a24153ea0 0x7f0a2413be80 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.732+0000 7f0a2c200640 1 -- 172.21.15.55:0/2940687172 >> 172.21.15.55:0/2940687172 conn(0x7f0a24066080 msgr2=0x7f0a24071b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:54.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.736+0000 7f0a2c200640 1 -- 172.21.15.55:0/2940687172 shutdown_connections 2024-04-02T07:22:54.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.736+0000 7f0a2c200640 1 -- 172.21.15.55:0/2940687172 wait complete. 2024-04-02T07:22:54.759 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:22:16.738297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:22:17.190496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:22:54.759 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:22:54.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.896+0000 7fa6a0c00640 1 Processor -- start 2024-04-02T07:22:54.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.896+0000 7fa6a0c00640 1 -- start start 2024-04-02T07:22:54.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.896+0000 7fa6a0c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa69c0b31a0 0x7fa69c165730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:54.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.896+0000 7fa6a0c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69c15e3a0 con 0x7fa69c0709b0 2024-04-02T07:22:54.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.896+0000 7fa6a0c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69c15e5f0 con 0x7fa69c144260 2024-04-02T07:22:54.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.896+0000 7fa6a0c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa69c0b37c0 con 0x7fa69c0b31a0 2024-04-02T07:22:54.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.896+0000 7fa69a800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa69c0b31a0 0x7fa69c165730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:54.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.896+0000 7fa691400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa69c0709b0 0x7fa69c0b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37336/0 (socket says 172.21.15.55:37336) 2024-04-02T07:22:54.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.896+0000 7fa691400640 1 -- 172.21.15.55:0/1705256611 learned_addr learned my addr 172.21.15.55:0/1705256611 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:54.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.900+0000 7fa69a800640 1 -- 172.21.15.55:0/1705256611 >> v1:172.21.15.106:6789/0 conn(0x7fa69c144260 legacy=0x7fa69c0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:54.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.900+0000 7fa69a800640 1 -- 172.21.15.55:0/1705256611 >> v1:172.21.15.55:6789/0 conn(0x7fa69c0709b0 legacy=0x7fa69c0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:54.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.900+0000 7fa69a800640 1 -- 172.21.15.55:0/1705256611 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69c15e8d0 con 0x7fa69c0b31a0 2024-04-02T07:22:54.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.900+0000 7fa699400640 1 -- 172.21.15.55:0/1705256611 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 564797286 0 0) 0x7fa69c15e3a0 con 0x7fa69c0709b0 2024-04-02T07:22:54.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.900+0000 7fa69a800640 1 --2- 172.21.15.55:0/1705256611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69c0b31a0 0x7fa69c165730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa6940097c0 tx=0x7fa69401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f506bc8b46764e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:54.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.900+0000 7fa699400640 1 -- 172.21.15.55:0/1705256611 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6940ab600 con 0x7fa69c0b31a0 2024-04-02T07:22:54.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.900+0000 7fa699400640 1 -- 172.21.15.55:0/1705256611 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6940a7050 con 0x7fa69c0b31a0 2024-04-02T07:22:54.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.900+0000 7fa699400640 1 -- 172.21.15.55:0/1705256611 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6940ab980 con 0x7fa69c0b31a0 2024-04-02T07:22:54.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.900+0000 7fa6a0c00640 1 -- 172.21.15.55:0/1705256611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69c0b31a0 msgr2=0x7fa69c165730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:54.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.900+0000 7fa6a0c00640 1 --2- 172.21.15.55:0/1705256611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69c0b31a0 0x7fa69c165730 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa6940097c0 tx=0x7fa69401c4a0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.900+0000 7fa6a0c00640 1 -- 172.21.15.55:0/1705256611 shutdown_connections 2024-04-02T07:22:54.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.900+0000 7fa6a0c00640 1 --2- 172.21.15.55:0/1705256611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69c0b31a0 0x7fa69c165730 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.900+0000 7fa6a0c00640 1 -- 172.21.15.55:0/1705256611 >> 172.21.15.55:0/1705256611 conn(0x7fa69c06a390 msgr2=0x7fa69c0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:54.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.900+0000 7fa6a0c00640 1 -- 172.21.15.55:0/1705256611 shutdown_connections 2024-04-02T07:22:54.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa6a0c00640 1 -- 172.21.15.55:0/1705256611 wait complete. 2024-04-02T07:22:54.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa6a0c00640 1 Processor -- start 2024-04-02T07:22:54.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa6a0c00640 1 -- start start 2024-04-02T07:22:54.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa6a0c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa69c0709b0 0x7fa69c159090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:54.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa6a0c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa69c0b31a0 0x7fa69c142da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:54.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa6a0c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69c144260 0x7fa69c1432e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:54.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa6a0c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c13e2e0 con 0x7fa69c144260 2024-04-02T07:22:54.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa6a0c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c1403a0 con 0x7fa69c0709b0 2024-04-02T07:22:54.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa6a0c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa69c1438f0 con 0x7fa69c0b31a0 2024-04-02T07:22:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa69a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69c144260 0x7fa69c1432e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa69a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69c144260 0x7fa69c1432e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34386/0 (socket says 172.21.15.55:34386) 2024-04-02T07:22:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa69a800640 1 -- 172.21.15.55:0/958279164 learned_addr learned my addr 172.21.15.55:0/958279164 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa699e00640 1 --2- 172.21.15.55:0/958279164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa69c0709b0 0x7fa69c159090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa691400640 1 --2- 172.21.15.55:0/958279164 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa69c0b31a0 0x7fa69c142da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa69a800640 1 -- 172.21.15.55:0/958279164 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa69c0b31a0 msgr2=0x7fa69c142da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa69a800640 1 --2- 172.21.15.55:0/958279164 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa69c0b31a0 0x7fa69c142da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa69a800640 1 -- 172.21.15.55:0/958279164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa69c0709b0 msgr2=0x7fa69c159090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa69a800640 1 --2- 172.21.15.55:0/958279164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa69c0709b0 0x7fa69c159090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa69a800640 1 -- 172.21.15.55:0/958279164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa694009420 con 0x7fa69c144260 2024-04-02T07:22:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa691400640 1 --2- 172.21.15.55:0/958279164 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa69c0b31a0 0x7fa69c142da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa69a800640 1 --2- 172.21.15.55:0/958279164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69c144260 0x7fa69c1432e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa6940ae040 tx=0x7fa694019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa692a00640 1 -- 172.21.15.55:0/958279164 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6940b4610 con 0x7fa69c144260 2024-04-02T07:22:54.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa692a00640 1 -- 172.21.15.55:0/958279164 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6940b4770 con 0x7fa69c144260 2024-04-02T07:22:54.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa6a0c00640 1 -- 172.21.15.55:0/958279164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa69c13e4f0 con 0x7fa69c144260 2024-04-02T07:22:54.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.904+0000 7fa692a00640 1 -- 172.21.15.55:0/958279164 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6940b4b00 con 0x7fa69c144260 2024-04-02T07:22:54.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.908+0000 7fa6a0c00640 1 -- 172.21.15.55:0/958279164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa69c13eab0 con 0x7fa69c144260 2024-04-02T07:22:54.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.908+0000 7fa6a0c00640 1 -- 172.21.15.55:0/958279164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa69c073530 con 0x7fa69c144260 2024-04-02T07:22:54.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.908+0000 7fa692a00640 1 -- 172.21.15.55:0/958279164 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa6940b2040 con 0x7fa69c144260 2024-04-02T07:22:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.908+0000 7fa692a00640 1 --2- 172.21.15.55:0/958279164 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa678066690 0x7fa678068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.908+0000 7fa692a00640 1 -- 172.21.15.55:0/958279164 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa69411e370 con 0x7fa69c144260 2024-04-02T07:22:54.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.908+0000 7fa699e00640 1 --2- 172.21.15.55:0/958279164 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa678066690 0x7fa678068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:54.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.908+0000 7fa699e00640 1 --2- 172.21.15.55:0/958279164 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa678066690 0x7fa678068b50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa68c000f70 tx=0x7fa68c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:54.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:54.912+0000 7fa692a00640 1 -- 172.21.15.55:0/958279164 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa6940eb6d0 con 0x7fa69c144260 2024-04-02T07:22:55.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.076+0000 7fa6a0c00640 1 -- 172.21.15.55:0/958279164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa69c140510 con 0x7fa69c144260 2024-04-02T07:22:55.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.076+0000 7fa692a00640 1 -- 172.21.15.55:0/958279164 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa6940eecf0 con 0x7fa69c144260 2024-04-02T07:22:55.081 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:22:55.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.076+0000 7fa6a0c00640 1 -- 172.21.15.55:0/958279164 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa678066690 msgr2=0x7fa678068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:55.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.076+0000 7fa6a0c00640 1 --2- 172.21.15.55:0/958279164 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa678066690 0x7fa678068b50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa68c000f70 tx=0x7fa68c009040 comp rx=0 tx=0).stop 2024-04-02T07:22:55.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.076+0000 7fa6a0c00640 1 -- 172.21.15.55:0/958279164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69c144260 msgr2=0x7fa69c1432e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:55.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.076+0000 7fa6a0c00640 1 --2- 172.21.15.55:0/958279164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69c144260 0x7fa69c1432e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fa6940ae040 tx=0x7fa694019240 comp rx=0 tx=0).stop 2024-04-02T07:22:55.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.076+0000 7fa6a0c00640 1 -- 172.21.15.55:0/958279164 shutdown_connections 2024-04-02T07:22:55.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.076+0000 7fa6a0c00640 1 --2- 172.21.15.55:0/958279164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69c144260 0x7fa69c1432e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.076+0000 7fa6a0c00640 1 --2- 172.21.15.55:0/958279164 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa69c0b31a0 0x7fa69c142da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.076+0000 7fa6a0c00640 1 --2- 172.21.15.55:0/958279164 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa678066690 0x7fa678068b50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.076+0000 7fa6a0c00640 1 --2- 172.21.15.55:0/958279164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa69c0709b0 0x7fa69c159090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.076+0000 7fa6a0c00640 1 -- 172.21.15.55:0/958279164 >> 172.21.15.55:0/958279164 conn(0x7fa69c06a390 msgr2=0x7fa69c0ca960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:55.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.076+0000 7fa6a0c00640 1 -- 172.21.15.55:0/958279164 shutdown_connections 2024-04-02T07:22:55.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.076+0000 7fa6a0c00640 1 -- 172.21.15.55:0/958279164 wait complete. 2024-04-02T07:22:55.102 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:22:55.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.240+0000 7faf22000640 1 Processor -- start 2024-04-02T07:22:55.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.240+0000 7faf22000640 1 -- start start 2024-04-02T07:22:55.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.240+0000 7faf22000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faf1c15cd20 0x7faf1c065a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:55.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.240+0000 7faf22000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faf1c161490 0x7faf1c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:55.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.240+0000 7faf22000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf1c0660d0 con 0x7faf1c06dde0 2024-04-02T07:22:55.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.240+0000 7faf22000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1c1607a0 con 0x7faf1c15cd20 2024-04-02T07:22:55.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.240+0000 7faf22000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf1c0ae8d0 con 0x7faf1c161490 2024-04-02T07:22:55.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.244+0000 7faf1b400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faf1c15cd20 0x7faf1c065a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:55.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.244+0000 7faf1b400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faf1c15cd20 0x7faf1c065a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34396/0 (socket says 172.21.15.55:34396) 2024-04-02T07:22:55.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.244+0000 7faf1be00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faf1c06dde0 0x7faf1c069d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37338/0 (socket says 172.21.15.55:37338) 2024-04-02T07:22:55.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.244+0000 7faf1b400640 1 -- 172.21.15.55:0/3837529025 learned_addr learned my addr 172.21.15.55:0/3837529025 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:55.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.244+0000 7faf12a00640 1 --2- 172.21.15.55:0/3837529025 >> v2:172.21.15.106:3300/0 conn(0x7faf1c161490 0x7faf1c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:55.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.244+0000 7faf1b400640 1 -- 172.21.15.55:0/3837529025 >> v2:172.21.15.106:3300/0 conn(0x7faf1c161490 msgr2=0x7faf1c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:55.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.244+0000 7faf1b400640 1 --2- 172.21.15.55:0/3837529025 >> v2:172.21.15.106:3300/0 conn(0x7faf1c161490 0x7faf1c06d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.244+0000 7faf1b400640 1 -- 172.21.15.55:0/3837529025 >> v1:172.21.15.55:6789/0 conn(0x7faf1c06dde0 legacy=0x7faf1c069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:55.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.244+0000 7faf1b400640 1 -- 172.21.15.55:0/3837529025 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf1c1609b0 con 0x7faf1c15cd20 2024-04-02T07:22:55.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.244+0000 7faf1aa00640 1 -- 172.21.15.55:0/3837529025 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1002722319 0 0) 0x7faf1c0660d0 con 0x7faf1c06dde0 2024-04-02T07:22:55.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.244+0000 7faf1b400640 1 --2- 172.21.15.55:0/3837529025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf1c15cd20 0x7faf1c065a80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0701a0 tx=0x7faf0c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3888121c789a8f06 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:55.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.244+0000 7faf1aa00640 1 -- 172.21.15.55:0/3837529025 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c0a57a0 con 0x7faf1c15cd20 2024-04-02T07:22:55.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.244+0000 7faf1aa00640 1 -- 172.21.15.55:0/3837529025 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0c0a5900 con 0x7faf1c15cd20 2024-04-02T07:22:55.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.244+0000 7faf1aa00640 1 -- 172.21.15.55:0/3837529025 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0c0a5c90 con 0x7faf1c15cd20 2024-04-02T07:22:55.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf22000640 1 -- 172.21.15.55:0/3837529025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf1c15cd20 msgr2=0x7faf1c065a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:55.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf22000640 1 --2- 172.21.15.55:0/3837529025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf1c15cd20 0x7faf1c065a80 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7faf1c0701a0 tx=0x7faf0c01c9f0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf22000640 1 -- 172.21.15.55:0/3837529025 shutdown_connections 2024-04-02T07:22:55.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf22000640 1 --2- 172.21.15.55:0/3837529025 >> v2:172.21.15.106:3300/0 conn(0x7faf1c161490 0x7faf1c06d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf22000640 1 --2- 172.21.15.55:0/3837529025 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf1c15cd20 0x7faf1c065a80 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf22000640 1 -- 172.21.15.55:0/3837529025 >> 172.21.15.55:0/3837529025 conn(0x7faf1c0ced90 msgr2=0x7faf1c0cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:55.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf22000640 1 -- 172.21.15.55:0/3837529025 shutdown_connections 2024-04-02T07:22:55.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf22000640 1 -- 172.21.15.55:0/3837529025 wait complete. 2024-04-02T07:22:55.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf22000640 1 Processor -- start 2024-04-02T07:22:55.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf22000640 1 -- start start 2024-04-02T07:22:55.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf22000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf1c06dde0 0x7faf1c14c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:55.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf22000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf1c15cd20 0x7faf1c151290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:55.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf22000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf1c161490 0x7faf1c1517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:55.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf22000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c1542f0 con 0x7faf1c15cd20 2024-04-02T07:22:55.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf22000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c153670 con 0x7faf1c161490 2024-04-02T07:22:55.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf22000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf1c153950 con 0x7faf1c06dde0 2024-04-02T07:22:55.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf12a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf1c15cd20 0x7faf1c151290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:55.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf12a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf1c15cd20 0x7faf1c151290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34404/0 (socket says 172.21.15.55:34404) 2024-04-02T07:22:55.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf12a00640 1 -- 172.21.15.55:0/2316446522 learned_addr learned my addr 172.21.15.55:0/2316446522 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:55.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf1b400640 1 --2- 172.21.15.55:0/2316446522 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf1c06dde0 0x7faf1c14c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:55.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf12a00640 1 -- 172.21.15.55:0/2316446522 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf1c06dde0 msgr2=0x7faf1c14c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:55.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf12a00640 1 --2- 172.21.15.55:0/2316446522 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf1c06dde0 0x7faf1c14c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf1be00640 1 --2- 172.21.15.55:0/2316446522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf1c161490 0x7faf1c1517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:55.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf12a00640 1 -- 172.21.15.55:0/2316446522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf1c161490 msgr2=0x7faf1c1517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:55.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf12a00640 1 --2- 172.21.15.55:0/2316446522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf1c161490 0x7faf1c1517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf12a00640 1 -- 172.21.15.55:0/2316446522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf0c009b30 con 0x7faf1c15cd20 2024-04-02T07:22:55.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.248+0000 7faf1be00640 1 --2- 172.21.15.55:0/2316446522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf1c161490 0x7faf1c1517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:55.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.252+0000 7faf12a00640 1 --2- 172.21.15.55:0/2316446522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf1c15cd20 0x7faf1c151290 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faf0400d7d0 tx=0x7faf0400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:55.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.252+0000 7faf13e00640 1 -- 172.21.15.55:0/2316446522 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0400b6c0 con 0x7faf1c15cd20 2024-04-02T07:22:55.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.252+0000 7faf13e00640 1 -- 172.21.15.55:0/2316446522 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf0400b820 con 0x7faf1c15cd20 2024-04-02T07:22:55.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.252+0000 7faf22000640 1 -- 172.21.15.55:0/2316446522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf1c153c30 con 0x7faf1c15cd20 2024-04-02T07:22:55.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.252+0000 7faf13e00640 1 -- 172.21.15.55:0/2316446522 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf0400bbd0 con 0x7faf1c15cd20 2024-04-02T07:22:55.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.252+0000 7faf22000640 1 -- 172.21.15.55:0/2316446522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf1c14cdf0 con 0x7faf1c15cd20 2024-04-02T07:22:55.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.252+0000 7faf22000640 1 -- 172.21.15.55:0/2316446522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf1c0ae470 con 0x7faf1c15cd20 2024-04-02T07:22:55.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.252+0000 7faf13e00640 1 -- 172.21.15.55:0/2316446522 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7faf0400bd30 con 0x7faf1c15cd20 2024-04-02T07:22:55.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.252+0000 7faf13e00640 1 --2- 172.21.15.55:0/2316446522 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faef8066690 0x7faef8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:55.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.252+0000 7faf13e00640 1 -- 172.21.15.55:0/2316446522 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf04084720 con 0x7faf1c15cd20 2024-04-02T07:22:55.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.252+0000 7faf1b400640 1 --2- 172.21.15.55:0/2316446522 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faef8066690 0x7faef8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:55.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.256+0000 7faf1b400640 1 --2- 172.21.15.55:0/2316446522 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faef8066690 0x7faef8068b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0ae000 tx=0x7faf0c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:55.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.256+0000 7faf13e00640 1 -- 172.21.15.55:0/2316446522 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7faf04051a80 con 0x7faf1c15cd20 2024-04-02T07:22:55.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.420+0000 7faf22000640 1 -- 172.21.15.55:0/2316446522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7faf1c0cc770 con 0x7faf1c15cd20 2024-04-02T07:22:55.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.420+0000 7faf13e00640 1 -- 172.21.15.55:0/2316446522 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7faf040550a0 con 0x7faf1c15cd20 2024-04-02T07:22:55.425 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:22:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.420+0000 7faf22000640 1 -- 172.21.15.55:0/2316446522 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faef8066690 msgr2=0x7faef8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.420+0000 7faf22000640 1 --2- 172.21.15.55:0/2316446522 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faef8066690 0x7faef8068b50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7faf0c0ae000 tx=0x7faf0c0a7070 comp rx=0 tx=0).stop 2024-04-02T07:22:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.420+0000 7faf22000640 1 -- 172.21.15.55:0/2316446522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf1c15cd20 msgr2=0x7faf1c151290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.420+0000 7faf22000640 1 --2- 172.21.15.55:0/2316446522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf1c15cd20 0x7faf1c151290 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7faf0400d7d0 tx=0x7faf0400dc90 comp rx=0 tx=0).stop 2024-04-02T07:22:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.420+0000 7faf22000640 1 -- 172.21.15.55:0/2316446522 shutdown_connections 2024-04-02T07:22:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.420+0000 7faf22000640 1 --2- 172.21.15.55:0/2316446522 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faef8066690 0x7faef8068b50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.420+0000 7faf22000640 1 --2- 172.21.15.55:0/2316446522 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf1c161490 0x7faf1c1517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.420+0000 7faf22000640 1 --2- 172.21.15.55:0/2316446522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf1c15cd20 0x7faf1c151290 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.420+0000 7faf22000640 1 --2- 172.21.15.55:0/2316446522 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf1c06dde0 0x7faf1c14c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.420+0000 7faf22000640 1 -- 172.21.15.55:0/2316446522 >> 172.21.15.55:0/2316446522 conn(0x7faf1c0ced90 msgr2=0x7faf1c0add60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.420+0000 7faf22000640 1 -- 172.21.15.55:0/2316446522 shutdown_connections 2024-04-02T07:22:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.420+0000 7faf22000640 1 -- 172.21.15.55:0/2316446522 wait complete. 2024-04-02T07:22:55.445 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:22:55.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.584+0000 7fa8ce600640 1 Processor -- start 2024-04-02T07:22:55.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.584+0000 7fa8ce600640 1 -- start start 2024-04-02T07:22:55.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.584+0000 7fa8ce600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8c815a9f0 0x7fa8c80cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:55.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.584+0000 7fa8ce600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8c80cbd30 0x7fa8c80cc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:55.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.584+0000 7fa8ce600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c80ce230 con 0x7fa8c8098a10 2024-04-02T07:22:55.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.584+0000 7fa8ce600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c815add0 con 0x7fa8c815a9f0 2024-04-02T07:22:55.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.584+0000 7fa8ce600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c80cf810 con 0x7fa8c80cbd30 2024-04-02T07:22:55.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.584+0000 7fa8c7400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8c815a9f0 0x7fa8c80cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:55.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.584+0000 7fa8c7400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8c815a9f0 0x7fa8c80cf2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43294/0 (socket says 172.21.15.55:43294) 2024-04-02T07:22:55.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.584+0000 7fa8c7e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa8c8098a10 0x7fa8c80afec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43758/0 (socket says 172.21.15.55:43758) 2024-04-02T07:22:55.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.584+0000 7fa8c7400640 1 -- 172.21.15.55:0/4188927254 learned_addr learned my addr 172.21.15.55:0/4188927254 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:55.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.584+0000 7fa8c7400640 1 -- 172.21.15.55:0/4188927254 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8c80cbd30 msgr2=0x7fa8c80cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:55.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.584+0000 7fa8c7400640 1 --2- 172.21.15.55:0/4188927254 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8c80cbd30 0x7fa8c80cc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.584+0000 7fa8c7400640 1 -- 172.21.15.55:0/4188927254 >> v1:172.21.15.55:6789/0 conn(0x7fa8c8098a10 legacy=0x7fa8c80afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:55.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.584+0000 7fa8c7400640 1 -- 172.21.15.55:0/4188927254 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c80ce510 con 0x7fa8c815a9f0 2024-04-02T07:22:55.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.588+0000 7fa8c7400640 1 --2- 172.21.15.55:0/4188927254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8c815a9f0 0x7fa8c80cf2d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009870 tx=0x7fa8b801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69290a83664008a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:55.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.588+0000 7fa8c6a00640 1 -- 172.21.15.55:0/4188927254 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b80a95f0 con 0x7fa8c815a9f0 2024-04-02T07:22:55.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.588+0000 7fa8c6a00640 1 -- 172.21.15.55:0/4188927254 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b80a9750 con 0x7fa8c815a9f0 2024-04-02T07:22:55.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.588+0000 7fa8c6a00640 1 -- 172.21.15.55:0/4188927254 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b80a9ae0 con 0x7fa8c815a9f0 2024-04-02T07:22:55.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.588+0000 7fa8ce600640 1 -- 172.21.15.55:0/4188927254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8c815a9f0 msgr2=0x7fa8c80cf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:55.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.588+0000 7fa8ce600640 1 --2- 172.21.15.55:0/4188927254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8c815a9f0 0x7fa8c80cf2d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa8b8009870 tx=0x7fa8b801c530 comp rx=0 tx=0).stop 2024-04-02T07:22:55.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.588+0000 7fa8ce600640 1 -- 172.21.15.55:0/4188927254 shutdown_connections 2024-04-02T07:22:55.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.588+0000 7fa8ce600640 1 --2- 172.21.15.55:0/4188927254 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8c80cbd30 0x7fa8c80cc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.588+0000 7fa8ce600640 1 --2- 172.21.15.55:0/4188927254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8c815a9f0 0x7fa8c80cf2d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.588+0000 7fa8ce600640 1 -- 172.21.15.55:0/4188927254 >> 172.21.15.55:0/4188927254 conn(0x7fa8c80b2150 msgr2=0x7fa8c80b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:55.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.588+0000 7fa8ce600640 1 -- 172.21.15.55:0/4188927254 shutdown_connections 2024-04-02T07:22:55.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.588+0000 7fa8ce600640 1 -- 172.21.15.55:0/4188927254 wait complete. 2024-04-02T07:22:55.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.588+0000 7fa8ce600640 1 Processor -- start 2024-04-02T07:22:55.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.588+0000 7fa8ce600640 1 -- start start 2024-04-02T07:22:55.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8ce600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8c8098a10 0x7fa8c8152740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:55.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8ce600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8c80cbd30 0x7fa8c80c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:55.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8ce600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c815a9f0 0x7fa8c81590b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:55.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8ce600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c81595f0 con 0x7fa8c8098a10 2024-04-02T07:22:55.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8ce600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8152fc0 con 0x7fa8c815a9f0 2024-04-02T07:22:55.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8ce600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c80c4210 con 0x7fa8c80cbd30 2024-04-02T07:22:55.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8c7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8c8098a10 0x7fa8c8152740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:55.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8c7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8c8098a10 0x7fa8c8152740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43300/0 (socket says 172.21.15.55:43300) 2024-04-02T07:22:55.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8c7400640 1 -- 172.21.15.55:0/2455453910 learned_addr learned my addr 172.21.15.55:0/2455453910 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:55.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8bfe00640 1 --2- 172.21.15.55:0/2455453910 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8c80cbd30 0x7fa8c80c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:55.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8c7e00640 1 --2- 172.21.15.55:0/2455453910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c815a9f0 0x7fa8c81590b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:55.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8c7400640 1 -- 172.21.15.55:0/2455453910 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8c80cbd30 msgr2=0x7fa8c80c4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:55.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8c7400640 1 --2- 172.21.15.55:0/2455453910 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8c80cbd30 0x7fa8c80c4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8c7400640 1 -- 172.21.15.55:0/2455453910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c815a9f0 msgr2=0x7fa8c81590b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:55.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8c7400640 1 --2- 172.21.15.55:0/2455453910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c815a9f0 0x7fa8c81590b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8c7400640 1 -- 172.21.15.55:0/2455453910 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b80094d0 con 0x7fa8c8098a10 2024-04-02T07:22:55.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8bfe00640 1 --2- 172.21.15.55:0/2455453910 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8c80cbd30 0x7fa8c80c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:55.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8c7e00640 1 --2- 172.21.15.55:0/2455453910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c815a9f0 0x7fa8c81590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:55.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8c7400640 1 --2- 172.21.15.55:0/2455453910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8c8098a10 0x7fa8c8152740 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa8b801a160 tx=0x7fa8b80192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:55.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8bf400640 1 -- 172.21.15.55:0/2455453910 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b80b1800 con 0x7fa8c8098a10 2024-04-02T07:22:55.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8bf400640 1 -- 172.21.15.55:0/2455453910 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b80b1980 con 0x7fa8c8098a10 2024-04-02T07:22:55.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8bf400640 1 -- 172.21.15.55:0/2455453910 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b80b1d30 con 0x7fa8c8098a10 2024-04-02T07:22:55.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8ce600640 1 -- 172.21.15.55:0/2455453910 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c80993b0 con 0x7fa8c8098a10 2024-04-02T07:22:55.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8ce600640 1 -- 172.21.15.55:0/2455453910 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c80c4790 con 0x7fa8c8098a10 2024-04-02T07:22:55.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.592+0000 7fa8ce600640 1 -- 172.21.15.55:0/2455453910 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c8066c90 con 0x7fa8c8098a10 2024-04-02T07:22:55.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.596+0000 7fa8bf400640 1 -- 172.21.15.55:0/2455453910 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa8b80ba480 con 0x7fa8c8098a10 2024-04-02T07:22:55.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.596+0000 7fa8bf400640 1 --2- 172.21.15.55:0/2455453910 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8a4066690 0x7fa8a4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:55.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.596+0000 7fa8bf400640 1 -- 172.21.15.55:0/2455453910 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8b811e930 con 0x7fa8c8098a10 2024-04-02T07:22:55.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.596+0000 7fa8bfe00640 1 --2- 172.21.15.55:0/2455453910 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8a4066690 0x7fa8a4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:55.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.596+0000 7fa8bfe00640 1 --2- 172.21.15.55:0/2455453910 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8a4066690 0x7fa8a4068b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa8c815a3f0 tx=0x7fa8b0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:55.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.600+0000 7fa8bf400640 1 -- 172.21.15.55:0/2455453910 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa8b80ebd30 con 0x7fa8c8098a10 2024-04-02T07:22:55.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.760+0000 7fa8ce600640 1 -- 172.21.15.55:0/2455453910 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa8c80cf990 con 0x7fa8c8098a10 2024-04-02T07:22:55.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.760+0000 7fa8bf400640 1 -- 172.21.15.55:0/2455453910 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa8b80ef350 con 0x7fa8c8098a10 2024-04-02T07:22:55.766 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:22:55.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.764+0000 7fa8ce600640 1 -- 172.21.15.55:0/2455453910 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8a4066690 msgr2=0x7fa8a4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:55.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.764+0000 7fa8ce600640 1 --2- 172.21.15.55:0/2455453910 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8a4066690 0x7fa8a4068b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fa8c815a3f0 tx=0x7fa8b0008040 comp rx=0 tx=0).stop 2024-04-02T07:22:55.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.764+0000 7fa8ce600640 1 -- 172.21.15.55:0/2455453910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8c8098a10 msgr2=0x7fa8c8152740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:55.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.764+0000 7fa8ce600640 1 --2- 172.21.15.55:0/2455453910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8c8098a10 0x7fa8c8152740 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa8b801a160 tx=0x7fa8b80192d0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.764+0000 7fa8ce600640 1 -- 172.21.15.55:0/2455453910 shutdown_connections 2024-04-02T07:22:55.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.764+0000 7fa8ce600640 1 --2- 172.21.15.55:0/2455453910 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8a4066690 0x7fa8a4068b50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.764+0000 7fa8ce600640 1 --2- 172.21.15.55:0/2455453910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8c815a9f0 0x7fa8c81590b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.764+0000 7fa8ce600640 1 --2- 172.21.15.55:0/2455453910 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8c80cbd30 0x7fa8c80c4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.764+0000 7fa8ce600640 1 --2- 172.21.15.55:0/2455453910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8c8098a10 0x7fa8c8152740 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.764+0000 7fa8ce600640 1 -- 172.21.15.55:0/2455453910 >> 172.21.15.55:0/2455453910 conn(0x7fa8c80b2150 msgr2=0x7fa8c80ad760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:55.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.764+0000 7fa8ce600640 1 -- 172.21.15.55:0/2455453910 shutdown_connections 2024-04-02T07:22:55.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.764+0000 7fa8ce600640 1 -- 172.21.15.55:0/2455453910 wait complete. 2024-04-02T07:22:55.788 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:22:55.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.924+0000 7f8f0f600640 1 Processor -- start 2024-04-02T07:22:55.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.924+0000 7f8f0f600640 1 -- start start 2024-04-02T07:22:55.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.924+0000 7f8f0f600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8f08070a20 0x7f8f080c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:55.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.924+0000 7f8f0f600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8f0815d6f0 0x7f8f080c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:55.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.924+0000 7f8f0f600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f080b3750 con 0x7f8f08159350 2024-04-02T07:22:55.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.924+0000 7f8f0f600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f080b28c0 con 0x7f8f0815d6f0 2024-04-02T07:22:55.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.924+0000 7f8f0f600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f080b2b40 con 0x7f8f08070a20 2024-04-02T07:22:55.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.924+0000 7f8f0d600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8f0815d6f0 0x7f8f080c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:55.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.924+0000 7f8f0d600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8f0815d6f0 0x7f8f080c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43304/0 (socket says 172.21.15.55:43304) 2024-04-02T07:22:55.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.924+0000 7f8f0d600640 1 -- 172.21.15.55:0/3127338752 learned_addr learned my addr 172.21.15.55:0/3127338752 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:55.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.924+0000 7f8effe00640 1 --2- 172.21.15.55:0/3127338752 >> v2:172.21.15.106:3300/0 conn(0x7f8f08070a20 0x7f8f080c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:55.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.924+0000 7f8f0d600640 1 -- 172.21.15.55:0/3127338752 >> v2:172.21.15.106:3300/0 conn(0x7f8f08070a20 msgr2=0x7f8f080c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:55.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.924+0000 7f8f0d600640 1 --2- 172.21.15.55:0/3127338752 >> v2:172.21.15.106:3300/0 conn(0x7f8f08070a20 0x7f8f080c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.924+0000 7f8f0d600640 1 -- 172.21.15.55:0/3127338752 >> v1:172.21.15.106:6789/0 conn(0x7f8f08159350 legacy=0x7f8f08070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:55.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.924+0000 7f8f0d600640 1 -- 172.21.15.55:0/3127338752 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f080b2e20 con 0x7f8f0815d6f0 2024-04-02T07:22:55.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.928+0000 7f8f0d600640 1 --2- 172.21.15.55:0/3127338752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f0815d6f0 0x7f8f080c90d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8f080b1ab0 tx=0x7f8f0001da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e0bcc3378e92aec server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:55.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.928+0000 7f8f07e00640 1 -- 172.21.15.55:0/3127338752 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f000a6880 con 0x7f8f0815d6f0 2024-04-02T07:22:55.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.928+0000 7f8f07e00640 1 -- 172.21.15.55:0/3127338752 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f000a69e0 con 0x7f8f0815d6f0 2024-04-02T07:22:55.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.928+0000 7f8f07e00640 1 -- 172.21.15.55:0/3127338752 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f000a6d70 con 0x7f8f0815d6f0 2024-04-02T07:22:55.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.928+0000 7f8f0f600640 1 -- 172.21.15.55:0/3127338752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f0815d6f0 msgr2=0x7f8f080c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:55.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.928+0000 7f8f0f600640 1 --2- 172.21.15.55:0/3127338752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f0815d6f0 0x7f8f080c90d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8f080b1ab0 tx=0x7f8f0001da40 comp rx=0 tx=0).stop 2024-04-02T07:22:55.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.928+0000 7f8f0f600640 1 -- 172.21.15.55:0/3127338752 shutdown_connections 2024-04-02T07:22:55.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.928+0000 7f8f0f600640 1 --2- 172.21.15.55:0/3127338752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f0815d6f0 0x7f8f080c90d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.928+0000 7f8f0f600640 1 --2- 172.21.15.55:0/3127338752 >> v2:172.21.15.106:3300/0 conn(0x7f8f08070a20 0x7f8f080c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.928+0000 7f8f0f600640 1 -- 172.21.15.55:0/3127338752 >> 172.21.15.55:0/3127338752 conn(0x7f8f08069d90 msgr2=0x7f8f0806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:55.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.928+0000 7f8f0f600640 1 -- 172.21.15.55:0/3127338752 shutdown_connections 2024-04-02T07:22:55.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.928+0000 7f8f0f600640 1 -- 172.21.15.55:0/3127338752 wait complete. 2024-04-02T07:22:55.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0f600640 1 Processor -- start 2024-04-02T07:22:55.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0f600640 1 -- start start 2024-04-02T07:22:55.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0f600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f08070a20 0x7f8f08151800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:55.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0f600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f08159350 0x7f8f08158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:55.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0f600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f0815d6f0 0x7f8f0815e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:55.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0f600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0815de30 con 0x7f8f0815d6f0 2024-04-02T07:22:55.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0f600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f08157240 con 0x7f8f08159350 2024-04-02T07:22:55.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0f600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f08157520 con 0x7f8f08070a20 2024-04-02T07:22:55.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0d600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f0815d6f0 0x7f8f0815e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:55.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0d600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f0815d6f0 0x7f8f0815e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43312/0 (socket says 172.21.15.55:43312) 2024-04-02T07:22:55.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0d600640 1 -- 172.21.15.55:0/4260378393 learned_addr learned my addr 172.21.15.55:0/4260378393 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:55.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8effe00640 1 --2- 172.21.15.55:0/4260378393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f08159350 0x7f8f08158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:55.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0cc00640 1 --2- 172.21.15.55:0/4260378393 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f08070a20 0x7f8f08151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:55.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0d600640 1 -- 172.21.15.55:0/4260378393 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f08070a20 msgr2=0x7f8f08151800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:55.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0d600640 1 --2- 172.21.15.55:0/4260378393 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f08070a20 0x7f8f08151800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0d600640 1 -- 172.21.15.55:0/4260378393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f08159350 msgr2=0x7f8f08158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:55.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0d600640 1 --2- 172.21.15.55:0/4260378393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f08159350 0x7f8f08158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:55.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0d600640 1 -- 172.21.15.55:0/4260378393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f00009b30 con 0x7f8f0815d6f0 2024-04-02T07:22:55.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0cc00640 1 --2- 172.21.15.55:0/4260378393 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f08070a20 0x7f8f08151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:55.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0d600640 1 --2- 172.21.15.55:0/4260378393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f0815d6f0 0x7f8f0815e610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8f000b0040 tx=0x7f8f0001c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:55.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f05600640 1 -- 172.21.15.55:0/4260378393 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f000b8600 con 0x7f8f0815d6f0 2024-04-02T07:22:55.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f05600640 1 -- 172.21.15.55:0/4260378393 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f000b8780 con 0x7f8f0815d6f0 2024-04-02T07:22:55.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f05600640 1 -- 172.21.15.55:0/4260378393 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f000b8b30 con 0x7f8f0815d6f0 2024-04-02T07:22:55.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0f600640 1 -- 172.21.15.55:0/4260378393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f08157800 con 0x7f8f0815d6f0 2024-04-02T07:22:55.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0f600640 1 -- 172.21.15.55:0/4260378393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f08153d20 con 0x7f8f0815d6f0 2024-04-02T07:22:55.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.932+0000 7f8f0f600640 1 -- 172.21.15.55:0/4260378393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0806e270 con 0x7f8f0815d6f0 2024-04-02T07:22:55.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.936+0000 7f8f05600640 1 -- 172.21.15.55:0/4260378393 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8f000b8c90 con 0x7f8f0815d6f0 2024-04-02T07:22:55.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.936+0000 7f8f05600640 1 --2- 172.21.15.55:0/4260378393 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8ee4066690 0x7f8ee4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:55.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.936+0000 7f8f05600640 1 -- 172.21.15.55:0/4260378393 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f0011f240 con 0x7f8f0815d6f0 2024-04-02T07:22:55.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.936+0000 7f8f0cc00640 1 --2- 172.21.15.55:0/4260378393 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8ee4066690 0x7f8ee4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:55.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.936+0000 7f8f0cc00640 1 --2- 172.21.15.55:0/4260378393 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8ee4066690 0x7f8ee4068b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8000f70 tx=0x7f8ef8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:55.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:55.940+0000 7f8f05600640 1 -- 172.21.15.55:0/4260378393 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f8f000ec510 con 0x7f8f0815d6f0 2024-04-02T07:22:56.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.112+0000 7f8f0f600640 1 -- 172.21.15.55:0/4260378393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8f08157660 con 0x7f8f0815d6f0 2024-04-02T07:22:56.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.112+0000 7f8f05600640 1 -- 172.21.15.55:0/4260378393 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f8f08157660 con 0x7f8f0815d6f0 2024-04-02T07:22:56.117 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:22:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.112+0000 7f8f0f600640 1 -- 172.21.15.55:0/4260378393 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8ee4066690 msgr2=0x7f8ee4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.112+0000 7f8f0f600640 1 --2- 172.21.15.55:0/4260378393 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8ee4066690 0x7f8ee4068b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8ef8000f70 tx=0x7f8ef8009040 comp rx=0 tx=0).stop 2024-04-02T07:22:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.112+0000 7f8f0f600640 1 -- 172.21.15.55:0/4260378393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f0815d6f0 msgr2=0x7f8f0815e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.112+0000 7f8f0f600640 1 --2- 172.21.15.55:0/4260378393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f0815d6f0 0x7f8f0815e610 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8f000b0040 tx=0x7f8f0001c280 comp rx=0 tx=0).stop 2024-04-02T07:22:56.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.112+0000 7f8f0f600640 1 -- 172.21.15.55:0/4260378393 shutdown_connections 2024-04-02T07:22:56.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.112+0000 7f8f0f600640 1 --2- 172.21.15.55:0/4260378393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8f0815d6f0 0x7f8f0815e610 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.112+0000 7f8f0f600640 1 --2- 172.21.15.55:0/4260378393 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8ee4066690 0x7f8ee4068b50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.112+0000 7f8f0f600640 1 --2- 172.21.15.55:0/4260378393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8f08159350 0x7f8f08158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.112+0000 7f8f0f600640 1 --2- 172.21.15.55:0/4260378393 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8f08070a20 0x7f8f08151800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.112+0000 7f8f0f600640 1 -- 172.21.15.55:0/4260378393 >> 172.21.15.55:0/4260378393 conn(0x7f8f08069d90 msgr2=0x7f8f080ca4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:56.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.112+0000 7f8f0f600640 1 -- 172.21.15.55:0/4260378393 shutdown_connections 2024-04-02T07:22:56.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.112+0000 7f8f0f600640 1 -- 172.21.15.55:0/4260378393 wait complete. 2024-04-02T07:22:56.138 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:22:56.138 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:22:56.148 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:56.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.280+0000 7f6970200640 1 Processor -- start 2024-04-02T07:22:56.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.280+0000 7f6970200640 1 -- start start 2024-04-02T07:22:56.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.284+0000 7f6970200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6968143f90 0x7f696815ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:56.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.284+0000 7f6970200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69680b34f0 0x7f69680cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:56.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.284+0000 7f6970200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696815b270 con 0x7f69680b3950 2024-04-02T07:22:56.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.284+0000 7f6970200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6968144370 con 0x7f6968143f90 2024-04-02T07:22:56.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.284+0000 7f6970200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69680c37b0 con 0x7f69680b34f0 2024-04-02T07:22:56.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.284+0000 7f696d800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6968143f90 0x7f696815ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:56.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.284+0000 7f696d800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6968143f90 0x7f696815ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43322/0 (socket says 172.21.15.55:43322) 2024-04-02T07:22:56.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.284+0000 7f696d800640 1 -- 172.21.15.55:0/976360186 learned_addr learned my addr 172.21.15.55:0/976360186 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:56.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.284+0000 7f696d800640 1 -- 172.21.15.55:0/976360186 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69680b34f0 msgr2=0x7f69680cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:56.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.284+0000 7f696ce00640 1 --2- 172.21.15.55:0/976360186 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69680b34f0 0x7f69680cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:56.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.284+0000 7f696d800640 1 --2- 172.21.15.55:0/976360186 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69680b34f0 0x7f69680cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.284+0000 7f696d800640 1 -- 172.21.15.55:0/976360186 >> v1:172.21.15.106:6789/0 conn(0x7f69680b3950 legacy=0x7f69680c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:56.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.284+0000 7f696d800640 1 -- 172.21.15.55:0/976360186 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69680c3a90 con 0x7f6968143f90 2024-04-02T07:22:56.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.284+0000 7f696ce00640 1 --2- 172.21.15.55:0/976360186 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69680b34f0 0x7f69680cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:22:56.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.288+0000 7f696d800640 1 --2- 172.21.15.55:0/976360186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6968143f90 0x7f696815ad30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f695c009870 tx=0x7f695c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb3cb11d2e301847 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:56.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.288+0000 7f6967e00640 1 -- 172.21.15.55:0/976360186 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c0ab600 con 0x7f6968143f90 2024-04-02T07:22:56.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.288+0000 7f6967e00640 1 -- 172.21.15.55:0/976360186 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c0a7050 con 0x7f6968143f90 2024-04-02T07:22:56.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.288+0000 7f6967e00640 1 -- 172.21.15.55:0/976360186 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c0ab980 con 0x7f6968143f90 2024-04-02T07:22:56.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.288+0000 7f6970200640 1 -- 172.21.15.55:0/976360186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6968143f90 msgr2=0x7f696815ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:56.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.288+0000 7f6970200640 1 --2- 172.21.15.55:0/976360186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6968143f90 0x7f696815ad30 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f695c009870 tx=0x7f695c01c460 comp rx=0 tx=0).stop 2024-04-02T07:22:56.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.288+0000 7f6970200640 1 -- 172.21.15.55:0/976360186 shutdown_connections 2024-04-02T07:22:56.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.288+0000 7f6970200640 1 --2- 172.21.15.55:0/976360186 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f69680b34f0 0x7f69680cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.288+0000 7f6970200640 1 --2- 172.21.15.55:0/976360186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6968143f90 0x7f696815ad30 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.288+0000 7f6970200640 1 -- 172.21.15.55:0/976360186 >> 172.21.15.55:0/976360186 conn(0x7f6968066080 msgr2=0x7f6968069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:56.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.288+0000 7f6970200640 1 -- 172.21.15.55:0/976360186 shutdown_connections 2024-04-02T07:22:56.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.288+0000 7f6970200640 1 -- 172.21.15.55:0/976360186 wait complete. 2024-04-02T07:22:56.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.288+0000 7f6970200640 1 Processor -- start 2024-04-02T07:22:56.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.288+0000 7f6970200640 1 -- start start 2024-04-02T07:22:56.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f6970200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69680b34f0 0x7f696813be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:56.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f6970200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69680b3950 0x7f696813f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:56.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f6970200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6968143f90 0x7f69680c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:56.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f6970200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696813e370 con 0x7f69680b3950 2024-04-02T07:22:56.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f6970200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696813e5c0 con 0x7f69680b34f0 2024-04-02T07:22:56.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f6970200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696813e8a0 con 0x7f6968143f90 2024-04-02T07:22:56.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f696ce00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69680b3950 0x7f696813f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:56.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f696ce00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69680b3950 0x7f696813f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43338/0 (socket says 172.21.15.55:43338) 2024-04-02T07:22:56.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f696ce00640 1 -- 172.21.15.55:0/2882906745 learned_addr learned my addr 172.21.15.55:0/2882906745 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:56.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f696d800640 1 --2- 172.21.15.55:0/2882906745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69680b34f0 0x7f696813be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:56.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f696e200640 1 --2- 172.21.15.55:0/2882906745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6968143f90 0x7f69680c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:56.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f696ce00640 1 -- 172.21.15.55:0/2882906745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6968143f90 msgr2=0x7f69680c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:56.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f696ce00640 1 --2- 172.21.15.55:0/2882906745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6968143f90 0x7f69680c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f696ce00640 1 -- 172.21.15.55:0/2882906745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69680b34f0 msgr2=0x7f696813be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:56.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f696ce00640 1 --2- 172.21.15.55:0/2882906745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69680b34f0 0x7f696813be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f696ce00640 1 -- 172.21.15.55:0/2882906745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c0094d0 con 0x7f69680b3950 2024-04-02T07:22:56.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f696ce00640 1 --2- 172.21.15.55:0/2882906745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69680b3950 0x7f696813f660 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f695400c7f0 tx=0x7f695400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:56.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f6965600640 1 -- 172.21.15.55:0/2882906745 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6954007820 con 0x7f69680b3950 2024-04-02T07:22:56.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f6965600640 1 -- 172.21.15.55:0/2882906745 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6954007980 con 0x7f69680b3950 2024-04-02T07:22:56.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f6965600640 1 -- 172.21.15.55:0/2882906745 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6954007d30 con 0x7f69680b3950 2024-04-02T07:22:56.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f6970200640 1 -- 172.21.15.55:0/2882906745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696813eb80 con 0x7f69680b3950 2024-04-02T07:22:56.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f6970200640 1 -- 172.21.15.55:0/2882906745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696813f140 con 0x7f69680b3950 2024-04-02T07:22:56.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f6970200640 1 -- 172.21.15.55:0/2882906745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6968066c90 con 0x7f69680b3950 2024-04-02T07:22:56.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.292+0000 7f6965600640 1 -- 172.21.15.55:0/2882906745 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f69540113f0 con 0x7f69680b3950 2024-04-02T07:22:56.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.296+0000 7f6965600640 1 --2- 172.21.15.55:0/2882906745 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6948066690 0x7f6948068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:56.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.296+0000 7f6965600640 1 -- 172.21.15.55:0/2882906745 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6954084560 con 0x7f69680b3950 2024-04-02T07:22:56.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.296+0000 7f696d800640 1 --2- 172.21.15.55:0/2882906745 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6948066690 0x7f6948068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:56.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.296+0000 7f696d800640 1 --2- 172.21.15.55:0/2882906745 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6948066690 0x7f6948068b50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f695c0ad000 tx=0x7f695c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:56.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.300+0000 7f6965600640 1 -- 172.21.15.55:0/2882906745 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6954051830 con 0x7f69680b3950 2024-04-02T07:22:56.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.460+0000 7f6970200640 1 -- 172.21.15.55:0/2882906745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f69680b2880 con 0x7f69680b3950 2024-04-02T07:22:56.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.464+0000 7f6965600640 1 -- 172.21.15.55:0/2882906745 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f6954054e50 con 0x7f69680b3950 2024-04-02T07:22:56.468 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:56.468 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:19.207279+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:56.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.464+0000 7f6970200640 1 -- 172.21.15.55:0/2882906745 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6948066690 msgr2=0x7f6948068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:56.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.464+0000 7f6970200640 1 --2- 172.21.15.55:0/2882906745 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6948066690 0x7f6948068b50 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f695c0ad000 tx=0x7f695c0a6000 comp rx=0 tx=0).stop 2024-04-02T07:22:56.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.464+0000 7f6970200640 1 -- 172.21.15.55:0/2882906745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69680b3950 msgr2=0x7f696813f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:56.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.464+0000 7f6970200640 1 --2- 172.21.15.55:0/2882906745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69680b3950 0x7f696813f660 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f695400c7f0 tx=0x7f695400ccb0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.464+0000 7f6970200640 1 -- 172.21.15.55:0/2882906745 shutdown_connections 2024-04-02T07:22:56.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.464+0000 7f6970200640 1 --2- 172.21.15.55:0/2882906745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6968143f90 0x7f69680c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.464+0000 7f6970200640 1 --2- 172.21.15.55:0/2882906745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69680b3950 0x7f696813f660 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.464+0000 7f6970200640 1 --2- 172.21.15.55:0/2882906745 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6948066690 0x7f6948068b50 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.464+0000 7f6970200640 1 --2- 172.21.15.55:0/2882906745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f69680b34f0 0x7f696813be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.464+0000 7f6970200640 1 -- 172.21.15.55:0/2882906745 >> 172.21.15.55:0/2882906745 conn(0x7f6968066080 msgr2=0x7f6968140820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:56.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.464+0000 7f6970200640 1 -- 172.21.15.55:0/2882906745 shutdown_connections 2024-04-02T07:22:56.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.464+0000 7f6970200640 1 -- 172.21.15.55:0/2882906745 wait complete. 2024-04-02T07:22:56.489 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:22:16.738297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:22:17.190496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:22:56.489 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:22:56.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.628+0000 7fc802400640 1 Processor -- start 2024-04-02T07:22:56.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.628+0000 7fc802400640 1 -- start start 2024-04-02T07:22:56.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.628+0000 7fc802400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc7fc0b3dc0 0x7fc7fc0ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:56.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.628+0000 7fc802400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7fc06ddc0 con 0x7fc7fc0b41a0 2024-04-02T07:22:56.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.628+0000 7fc802400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7fc06c630 con 0x7fc7fc0ade90 2024-04-02T07:22:56.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.628+0000 7fc802400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7fc06c8f0 con 0x7fc7fc0b3dc0 2024-04-02T07:22:56.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.628+0000 7fc7fb400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc7fc0b3dc0 0x7fc7fc0ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:56.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.628+0000 7fc7fbe00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc7fc0b41a0 0x7fc7fc142ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43764/0 (socket says 172.21.15.55:43764) 2024-04-02T07:22:56.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.628+0000 7fc7fbe00640 1 -- 172.21.15.55:0/151012700 learned_addr learned my addr 172.21.15.55:0/151012700 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:56.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.628+0000 7fc7fb400640 1 -- 172.21.15.55:0/151012700 >> v1:172.21.15.106:6789/0 conn(0x7fc7fc0ade90 legacy=0x7fc7fc06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:56.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.628+0000 7fc7fb400640 1 -- 172.21.15.55:0/151012700 >> v1:172.21.15.55:6789/0 conn(0x7fc7fc0b41a0 legacy=0x7fc7fc142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:56.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.628+0000 7fc7fb400640 1 -- 172.21.15.55:0/151012700 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7fc06cbd0 con 0x7fc7fc0b3dc0 2024-04-02T07:22:56.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.632+0000 7fc7fb400640 1 --2- 172.21.15.55:0/151012700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7fc0b3dc0 0x7fc7fc0ca770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec0097c0 tx=0x7fc7ec01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff775d79ed65d5a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:56.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.632+0000 7fc7faa00640 1 -- 172.21.15.55:0/151012700 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec0ab670 con 0x7fc7fc0b3dc0 2024-04-02T07:22:56.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.632+0000 7fc7faa00640 1 -- 172.21.15.55:0/151012700 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7ec0ab7d0 con 0x7fc7fc0b3dc0 2024-04-02T07:22:56.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.632+0000 7fc7faa00640 1 -- 172.21.15.55:0/151012700 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec0abb60 con 0x7fc7fc0b3dc0 2024-04-02T07:22:56.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.632+0000 7fc802400640 1 -- 172.21.15.55:0/151012700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7fc0b3dc0 msgr2=0x7fc7fc0ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:56.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.632+0000 7fc802400640 1 --2- 172.21.15.55:0/151012700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7fc0b3dc0 0x7fc7fc0ca770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec0097c0 tx=0x7fc7ec01c470 comp rx=0 tx=0).stop 2024-04-02T07:22:56.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.632+0000 7fc802400640 1 -- 172.21.15.55:0/151012700 shutdown_connections 2024-04-02T07:22:56.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.632+0000 7fc802400640 1 --2- 172.21.15.55:0/151012700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7fc0b3dc0 0x7fc7fc0ca770 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.632+0000 7fc802400640 1 -- 172.21.15.55:0/151012700 >> 172.21.15.55:0/151012700 conn(0x7fc7fc06a390 msgr2=0x7fc7fc0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:56.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.632+0000 7fc802400640 1 -- 172.21.15.55:0/151012700 shutdown_connections 2024-04-02T07:22:56.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.632+0000 7fc802400640 1 -- 172.21.15.55:0/151012700 wait complete. 2024-04-02T07:22:56.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.632+0000 7fc802400640 1 Processor -- start 2024-04-02T07:22:56.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc802400640 1 -- start start 2024-04-02T07:22:56.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc802400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7fc0ade90 0x7fc7fc138ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:56.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc802400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7fc0b3dc0 0x7fc7fc15a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:56.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc802400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7fc0b41a0 0x7fc7fc15ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:56.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc802400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc139410 con 0x7fc7fc0b3dc0 2024-04-02T07:22:56.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc802400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc154010 con 0x7fc7fc0ade90 2024-04-02T07:22:56.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc802400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7fc15b2a0 con 0x7fc7fc0b41a0 2024-04-02T07:22:56.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc7f3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7fc0b3dc0 0x7fc7fc15a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:56.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc7f3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7fc0b3dc0 0x7fc7fc15a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43370/0 (socket says 172.21.15.55:43370) 2024-04-02T07:22:56.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc7f3e00640 1 -- 172.21.15.55:0/704012263 learned_addr learned my addr 172.21.15.55:0/704012263 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:56.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc7fb400640 1 --2- 172.21.15.55:0/704012263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7fc0ade90 0x7fc7fc138ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:56.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc7fbe00640 1 --2- 172.21.15.55:0/704012263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7fc0b41a0 0x7fc7fc15ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:56.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc7f3e00640 1 -- 172.21.15.55:0/704012263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7fc0b41a0 msgr2=0x7fc7fc15ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:56.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc7f3e00640 1 --2- 172.21.15.55:0/704012263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7fc0b41a0 0x7fc7fc15ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc7f3e00640 1 -- 172.21.15.55:0/704012263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7fc0ade90 msgr2=0x7fc7fc138ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:56.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc7f3e00640 1 --2- 172.21.15.55:0/704012263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7fc0ade90 0x7fc7fc138ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc7f3e00640 1 -- 172.21.15.55:0/704012263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ec009420 con 0x7fc7fc0b3dc0 2024-04-02T07:22:56.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc7fbe00640 1 --2- 172.21.15.55:0/704012263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7fc0b41a0 0x7fc7fc15ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:56.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc7f3e00640 1 --2- 172.21.15.55:0/704012263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7fc0b3dc0 0x7fc7fc15a730 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400c500 tx=0x7fc7e400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:56.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc7f3400640 1 -- 172.21.15.55:0/704012263 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4005220 con 0x7fc7fc0b3dc0 2024-04-02T07:22:56.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc7f3400640 1 -- 172.21.15.55:0/704012263 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e4005380 con 0x7fc7fc0b3dc0 2024-04-02T07:22:56.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc7f3400640 1 -- 172.21.15.55:0/704012263 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4007270 con 0x7fc7fc0b3dc0 2024-04-02T07:22:56.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc802400640 1 -- 172.21.15.55:0/704012263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7fc15b580 con 0x7fc7fc0b3dc0 2024-04-02T07:22:56.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc802400640 1 -- 172.21.15.55:0/704012263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7fc13fca0 con 0x7fc7fc0b3dc0 2024-04-02T07:22:56.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.636+0000 7fc802400640 1 -- 172.21.15.55:0/704012263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7fc13fec0 con 0x7fc7fc0b3dc0 2024-04-02T07:22:56.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.640+0000 7fc7f3400640 1 -- 172.21.15.55:0/704012263 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc7e40073d0 con 0x7fc7fc0b3dc0 2024-04-02T07:22:56.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.640+0000 7fc7f3400640 1 --2- 172.21.15.55:0/704012263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc7d8066690 0x7fc7d8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:56.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.640+0000 7fc7f3400640 1 -- 172.21.15.55:0/704012263 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7e4083ad0 con 0x7fc7fc0b3dc0 2024-04-02T07:22:56.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.640+0000 7fc7fb400640 1 --2- 172.21.15.55:0/704012263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc7d8066690 0x7fc7d8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:56.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.640+0000 7fc7fb400640 1 --2- 172.21.15.55:0/704012263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc7d8066690 0x7fc7d8068b50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec0af000 tx=0x7fc7ec0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:56.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.644+0000 7fc7f3400640 1 -- 172.21.15.55:0/704012263 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc7e4050db0 con 0x7fc7fc0b3dc0 2024-04-02T07:22:56.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.800+0000 7fc802400640 1 -- 172.21.15.55:0/704012263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc7fc066c90 con 0x7fc7fc0b3dc0 2024-04-02T07:22:56.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.804+0000 7fc7f3400640 1 -- 172.21.15.55:0/704012263 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc7e40543d0 con 0x7fc7fc0b3dc0 2024-04-02T07:22:56.808 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:22:56.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.804+0000 7fc802400640 1 -- 172.21.15.55:0/704012263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc7d8066690 msgr2=0x7fc7d8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:56.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.804+0000 7fc802400640 1 --2- 172.21.15.55:0/704012263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc7d8066690 0x7fc7d8068b50 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec0af000 tx=0x7fc7ec0a7000 comp rx=0 tx=0).stop 2024-04-02T07:22:56.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.804+0000 7fc802400640 1 -- 172.21.15.55:0/704012263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7fc0b3dc0 msgr2=0x7fc7fc15a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:56.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.804+0000 7fc802400640 1 --2- 172.21.15.55:0/704012263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7fc0b3dc0 0x7fc7fc15a730 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400c500 tx=0x7fc7e400c9c0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.804+0000 7fc802400640 1 -- 172.21.15.55:0/704012263 shutdown_connections 2024-04-02T07:22:56.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.804+0000 7fc802400640 1 --2- 172.21.15.55:0/704012263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7fc0b41a0 0x7fc7fc15ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.804+0000 7fc802400640 1 --2- 172.21.15.55:0/704012263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7fc0b3dc0 0x7fc7fc15a730 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.804+0000 7fc802400640 1 --2- 172.21.15.55:0/704012263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc7d8066690 0x7fc7d8068b50 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.804+0000 7fc802400640 1 --2- 172.21.15.55:0/704012263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7fc0ade90 0x7fc7fc138ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.804+0000 7fc802400640 1 -- 172.21.15.55:0/704012263 >> 172.21.15.55:0/704012263 conn(0x7fc7fc06a390 msgr2=0x7fc7fc155810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:56.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.804+0000 7fc802400640 1 -- 172.21.15.55:0/704012263 shutdown_connections 2024-04-02T07:22:56.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.804+0000 7fc802400640 1 -- 172.21.15.55:0/704012263 wait complete. 2024-04-02T07:22:56.829 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:22:56.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.968+0000 7fb808400640 1 Processor -- start 2024-04-02T07:22:56.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.968+0000 7fb808400640 1 -- start start 2024-04-02T07:22:56.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.968+0000 7fb808400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb80015c920 0x7fb8000b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:56.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.968+0000 7fb808400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb80015de30 con 0x7fb8000afa70 2024-04-02T07:22:56.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.968+0000 7fb808400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb800098ab0 con 0x7fb8000cd690 2024-04-02T07:22:56.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.968+0000 7fb808400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb800098d90 con 0x7fb80015c920 2024-04-02T07:22:56.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.968+0000 7fb805000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb8000afa70 0x7fb8000ccf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43778/0 (socket says 172.21.15.55:43778) 2024-04-02T07:22:56.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.968+0000 7fb805000640 1 -- 172.21.15.55:0/1537260159 learned_addr learned my addr 172.21.15.55:0/1537260159 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:56.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.968+0000 7fb805a00640 1 --2- 172.21.15.55:0/1537260159 >> v2:172.21.15.106:3300/0 conn(0x7fb80015c920 0x7fb8000b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:56.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.968+0000 7fb7ffe00640 1 -- 172.21.15.55:0/1537260159 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881387918 0 0) 0x7fb80015de30 con 0x7fb8000afa70 2024-04-02T07:22:56.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.968+0000 7fb7ffe00640 1 -- 172.21.15.55:0/1537260159 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7e8003530 con 0x7fb8000afa70 2024-04-02T07:22:56.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.968+0000 7fb805a00640 1 -- 172.21.15.55:0/1537260159 >> v1:172.21.15.106:6789/0 conn(0x7fb8000cd690 legacy=0x7fb80006aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:56.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.968+0000 7fb7ffe00640 1 -- 172.21.15.55:0/1537260159 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4137358500 0 0) 0x7fb800098ab0 con 0x7fb8000cd690 2024-04-02T07:22:56.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.968+0000 7fb805a00640 1 -- 172.21.15.55:0/1537260159 >> v1:172.21.15.55:6789/0 conn(0x7fb8000afa70 legacy=0x7fb8000ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:56.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.968+0000 7fb805a00640 1 -- 172.21.15.55:0/1537260159 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb800099070 con 0x7fb80015c920 2024-04-02T07:22:56.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.972+0000 7fb805a00640 1 --2- 172.21.15.55:0/1537260159 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb80015c920 0x7fb8000b1ca0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40097c0 tx=0x7fb7f401c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c536d6ac11d7bc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:56.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.972+0000 7fb7ffe00640 1 -- 172.21.15.55:0/1537260159 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40ac630 con 0x7fb80015c920 2024-04-02T07:22:56.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.972+0000 7fb7ffe00640 1 -- 172.21.15.55:0/1537260159 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f40ac790 con 0x7fb80015c920 2024-04-02T07:22:56.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.972+0000 7fb7ffe00640 1 -- 172.21.15.55:0/1537260159 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f40acb20 con 0x7fb80015c920 2024-04-02T07:22:56.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.972+0000 7fb808400640 1 -- 172.21.15.55:0/1537260159 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb80015c920 msgr2=0x7fb8000b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:56.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.972+0000 7fb808400640 1 --2- 172.21.15.55:0/1537260159 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb80015c920 0x7fb8000b1ca0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40097c0 tx=0x7fb7f401c470 comp rx=0 tx=0).stop 2024-04-02T07:22:56.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.972+0000 7fb808400640 1 -- 172.21.15.55:0/1537260159 shutdown_connections 2024-04-02T07:22:56.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.972+0000 7fb808400640 1 --2- 172.21.15.55:0/1537260159 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb80015c920 0x7fb8000b1ca0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.972+0000 7fb808400640 1 -- 172.21.15.55:0/1537260159 >> 172.21.15.55:0/1537260159 conn(0x7fb8000d0700 msgr2=0x7fb8000d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:56.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.972+0000 7fb808400640 1 -- 172.21.15.55:0/1537260159 shutdown_connections 2024-04-02T07:22:56.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.972+0000 7fb808400640 1 -- 172.21.15.55:0/1537260159 wait complete. 2024-04-02T07:22:56.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb808400640 1 Processor -- start 2024-04-02T07:22:56.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb808400640 1 -- start start 2024-04-02T07:22:56.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb808400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8000afa70 0x7fb8000ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:56.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb808400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8000cd690 0x7fb8000adde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:56.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb808400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb80015c920 0x7fb800142ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:56.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb808400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000c6f50 con 0x7fb80015c920 2024-04-02T07:22:56.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb808400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb800154990 con 0x7fb8000afa70 2024-04-02T07:22:56.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb808400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8000c6340 con 0x7fb8000cd690 2024-04-02T07:22:56.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb806400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb80015c920 0x7fb800142ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:56.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb806400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb80015c920 0x7fb800142ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43382/0 (socket says 172.21.15.55:43382) 2024-04-02T07:22:56.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb806400640 1 -- 172.21.15.55:0/392409228 learned_addr learned my addr 172.21.15.55:0/392409228 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:56.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb805a00640 1 --2- 172.21.15.55:0/392409228 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8000afa70 0x7fb8000ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:56.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb805000640 1 --2- 172.21.15.55:0/392409228 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8000cd690 0x7fb8000adde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb806400640 1 -- 172.21.15.55:0/392409228 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8000cd690 msgr2=0x7fb8000adde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb806400640 1 --2- 172.21.15.55:0/392409228 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8000cd690 0x7fb8000adde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb806400640 1 -- 172.21.15.55:0/392409228 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8000afa70 msgr2=0x7fb8000ad8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb806400640 1 --2- 172.21.15.55:0/392409228 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8000afa70 0x7fb8000ad8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb806400640 1 -- 172.21.15.55:0/392409228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f4009420 con 0x7fb80015c920 2024-04-02T07:22:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb805a00640 1 --2- 172.21.15.55:0/392409228 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8000afa70 0x7fb8000ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb806400640 1 --2- 172.21.15.55:0/392409228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb80015c920 0x7fb800142ca0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800c750 tx=0x7fb7f800cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb7fd600640 1 -- 172.21.15.55:0/392409228 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f8003db0 con 0x7fb80015c920 2024-04-02T07:22:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb7fd600640 1 -- 172.21.15.55:0/392409228 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7f800ce60 con 0x7fb80015c920 2024-04-02T07:22:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb7fd600640 1 -- 172.21.15.55:0/392409228 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7f80052b0 con 0x7fb80015c920 2024-04-02T07:22:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb808400640 1 -- 172.21.15.55:0/392409228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8000c6620 con 0x7fb80015c920 2024-04-02T07:22:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.976+0000 7fb808400640 1 -- 172.21.15.55:0/392409228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8000c6be0 con 0x7fb80015c920 2024-04-02T07:22:56.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.980+0000 7fb808400640 1 -- 172.21.15.55:0/392409228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8000c7620 con 0x7fb80015c920 2024-04-02T07:22:56.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.980+0000 7fb7fd600640 1 -- 172.21.15.55:0/392409228 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb7f8005410 con 0x7fb80015c920 2024-04-02T07:22:56.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.980+0000 7fb7fd600640 1 --2- 172.21.15.55:0/392409228 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7e0066690 0x7fb7e0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:56.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.980+0000 7fb7fd600640 1 -- 172.21.15.55:0/392409228 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7f8083f40 con 0x7fb80015c920 2024-04-02T07:22:56.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.980+0000 7fb805a00640 1 --2- 172.21.15.55:0/392409228 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7e0066690 0x7fb7e0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:56.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.980+0000 7fb805a00640 1 --2- 172.21.15.55:0/392409228 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7e0066690 0x7fb7e0068b50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40ae000 tx=0x7fb7f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:56.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:56.984+0000 7fb7fd600640 1 -- 172.21.15.55:0/392409228 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fb7f80512c0 con 0x7fb80015c920 2024-04-02T07:22:57.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.148+0000 7fb808400640 1 -- 172.21.15.55:0/392409228 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb8000c7090 con 0x7fb80015c920 2024-04-02T07:22:57.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.148+0000 7fb7fd600640 1 -- 172.21.15.55:0/392409228 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb8000c7090 con 0x7fb80015c920 2024-04-02T07:22:57.154 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:22:57.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.152+0000 7fb808400640 1 -- 172.21.15.55:0/392409228 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7e0066690 msgr2=0x7fb7e0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:57.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.152+0000 7fb808400640 1 --2- 172.21.15.55:0/392409228 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7e0066690 0x7fb7e0068b50 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fb7f40ae000 tx=0x7fb7f4008040 comp rx=0 tx=0).stop 2024-04-02T07:22:57.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.152+0000 7fb808400640 1 -- 172.21.15.55:0/392409228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb80015c920 msgr2=0x7fb800142ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:57.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.152+0000 7fb808400640 1 --2- 172.21.15.55:0/392409228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb80015c920 0x7fb800142ca0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb7f800c750 tx=0x7fb7f800cc10 comp rx=0 tx=0).stop 2024-04-02T07:22:57.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.152+0000 7fb808400640 1 -- 172.21.15.55:0/392409228 shutdown_connections 2024-04-02T07:22:57.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.152+0000 7fb808400640 1 --2- 172.21.15.55:0/392409228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb80015c920 0x7fb800142ca0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:57.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.152+0000 7fb808400640 1 --2- 172.21.15.55:0/392409228 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8000cd690 0x7fb8000adde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:57.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.152+0000 7fb808400640 1 --2- 172.21.15.55:0/392409228 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7e0066690 0x7fb7e0068b50 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:57.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.152+0000 7fb808400640 1 --2- 172.21.15.55:0/392409228 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8000afa70 0x7fb8000ad8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:57.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.152+0000 7fb808400640 1 -- 172.21.15.55:0/392409228 >> 172.21.15.55:0/392409228 conn(0x7fb8000d0700 msgr2=0x7fb80006e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:57.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.152+0000 7fb808400640 1 -- 172.21.15.55:0/392409228 shutdown_connections 2024-04-02T07:22:57.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.152+0000 7fb808400640 1 -- 172.21.15.55:0/392409228 wait complete. 2024-04-02T07:22:57.175 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:22:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.316+0000 7fccd6200640 1 Processor -- start 2024-04-02T07:22:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.316+0000 7fccd6200640 1 -- start start 2024-04-02T07:22:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.316+0000 7fccd6200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccd00b1320 0x7fccd0099750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.316+0000 7fccd6200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd00b1ae0 con 0x7fccd015ded0 2024-04-02T07:22:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.316+0000 7fccd6200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccd00ce240 con 0x7fccd0099120 2024-04-02T07:22:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.316+0000 7fccd6200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd015e2b0 con 0x7fccd00b1320 2024-04-02T07:22:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.316+0000 7fcccf400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fccd015ded0 0x7fccd0098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43780/0 (socket says 172.21.15.55:43780) 2024-04-02T07:22:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.316+0000 7fcccf400640 1 -- 172.21.15.55:0/217989850 learned_addr learned my addr 172.21.15.55:0/217989850 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.316+0000 7fcccfe00640 1 --2- 172.21.15.55:0/217989850 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccd00b1320 0x7fccd0099750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.316+0000 7fccce000640 1 -- 172.21.15.55:0/217989850 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576438905 0 0) 0x7fccd00b1ae0 con 0x7fccd015ded0 2024-04-02T07:22:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.316+0000 7fccce000640 1 -- 172.21.15.55:0/217989850 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccb4003530 con 0x7fccd015ded0 2024-04-02T07:22:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.316+0000 7fccce000640 1 -- 172.21.15.55:0/217989850 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5146042 0 0) 0x7fccd00ce240 con 0x7fccd0099120 2024-04-02T07:22:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.316+0000 7fccce000640 1 -- 172.21.15.55:0/217989850 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fccd00b1ae0 con 0x7fccd0099120 2024-04-02T07:22:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.316+0000 7fcccfe00640 1 -- 172.21.15.55:0/217989850 >> v1:172.21.15.106:6789/0 conn(0x7fccd0099120 legacy=0x7fccd00ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:57.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.316+0000 7fcccfe00640 1 -- 172.21.15.55:0/217989850 >> v1:172.21.15.55:6789/0 conn(0x7fccd015ded0 legacy=0x7fccd0098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:57.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.316+0000 7fcccfe00640 1 -- 172.21.15.55:0/217989850 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccd00cbf30 con 0x7fccd00b1320 2024-04-02T07:22:57.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.320+0000 7fcccfe00640 1 --2- 172.21.15.55:0/217989850 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccd00b1320 0x7fccd0099750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fccc8009dc0 tx=0x7fccc801c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8f7b0a8d6ff950e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:57.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.320+0000 7fccce000640 1 -- 172.21.15.55:0/217989850 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc80a5850 con 0x7fccd00b1320 2024-04-02T07:22:57.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.320+0000 7fccce000640 1 -- 172.21.15.55:0/217989850 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc80a59b0 con 0x7fccd00b1320 2024-04-02T07:22:57.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.320+0000 7fccce000640 1 -- 172.21.15.55:0/217989850 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc80a5d40 con 0x7fccd00b1320 2024-04-02T07:22:57.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.320+0000 7fccd6200640 1 -- 172.21.15.55:0/217989850 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccd00b1320 msgr2=0x7fccd0099750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:57.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.320+0000 7fccd6200640 1 --2- 172.21.15.55:0/217989850 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccd00b1320 0x7fccd0099750 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fccc8009dc0 tx=0x7fccc801c990 comp rx=0 tx=0).stop 2024-04-02T07:22:57.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.320+0000 7fccd6200640 1 -- 172.21.15.55:0/217989850 shutdown_connections 2024-04-02T07:22:57.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.320+0000 7fccd6200640 1 --2- 172.21.15.55:0/217989850 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccd00b1320 0x7fccd0099750 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:57.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.320+0000 7fccd6200640 1 -- 172.21.15.55:0/217989850 >> 172.21.15.55:0/217989850 conn(0x7fccd00b2160 msgr2=0x7fccd00b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:57.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.320+0000 7fccd6200640 1 -- 172.21.15.55:0/217989850 shutdown_connections 2024-04-02T07:22:57.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.320+0000 7fccd6200640 1 -- 172.21.15.55:0/217989850 wait complete. 2024-04-02T07:22:57.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.320+0000 7fccd6200640 1 Processor -- start 2024-04-02T07:22:57.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fccd6200640 1 -- start start 2024-04-02T07:22:57.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fccd6200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccd0099120 0x7fccd0166190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:57.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fccd6200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccd00b1320 0x7fccd006c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:57.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fccd6200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd015ded0 0x7fccd00b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:57.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fccd6200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd01666d0 con 0x7fccd015ded0 2024-04-02T07:22:57.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fccd6200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd006bf60 con 0x7fccd00b1320 2024-04-02T07:22:57.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fccd6200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccd006c4e0 con 0x7fccd0099120 2024-04-02T07:22:57.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fcccfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd015ded0 0x7fccd00b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:57.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fcccfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd015ded0 0x7fccd00b4fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43386/0 (socket says 172.21.15.55:43386) 2024-04-02T07:22:57.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fcccfe00640 1 -- 172.21.15.55:0/667577583 learned_addr learned my addr 172.21.15.55:0/667577583 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:57.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fcccf400640 1 --2- 172.21.15.55:0/667577583 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccd0099120 0x7fccd0166190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:57.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fcccea00640 1 --2- 172.21.15.55:0/667577583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccd00b1320 0x7fccd006c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:57.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fcccfe00640 1 -- 172.21.15.55:0/667577583 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccd0099120 msgr2=0x7fccd0166190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:57.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fcccfe00640 1 --2- 172.21.15.55:0/667577583 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccd0099120 0x7fccd0166190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:57.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fcccfe00640 1 -- 172.21.15.55:0/667577583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccd00b1320 msgr2=0x7fccd006c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:57.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fcccfe00640 1 --2- 172.21.15.55:0/667577583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccd00b1320 0x7fccd006c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:57.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fcccfe00640 1 -- 172.21.15.55:0/667577583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc8009a70 con 0x7fccd015ded0 2024-04-02T07:22:57.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fcccfe00640 1 --2- 172.21.15.55:0/667577583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd015ded0 0x7fccd00b4fb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fccc80195a0 tx=0x7fccc8019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:57.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fccc7400640 1 -- 172.21.15.55:0/667577583 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc80b9650 con 0x7fccd015ded0 2024-04-02T07:22:57.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fccc7400640 1 -- 172.21.15.55:0/667577583 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc80b97b0 con 0x7fccd015ded0 2024-04-02T07:22:57.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fccc7400640 1 -- 172.21.15.55:0/667577583 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc80b9b60 con 0x7fccd015ded0 2024-04-02T07:22:57.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fccd6200640 1 -- 172.21.15.55:0/667577583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd006ceb0 con 0x7fccd015ded0 2024-04-02T07:22:57.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fccd6200640 1 -- 172.21.15.55:0/667577583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd00b5ae0 con 0x7fccd015ded0 2024-04-02T07:22:57.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.324+0000 7fccd6200640 1 -- 172.21.15.55:0/667577583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd00b5cd0 con 0x7fccd015ded0 2024-04-02T07:22:57.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.328+0000 7fccc7400640 1 -- 172.21.15.55:0/667577583 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fccc80b9cc0 con 0x7fccd015ded0 2024-04-02T07:22:57.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.328+0000 7fccc7400640 1 --2- 172.21.15.55:0/667577583 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fccb0066690 0x7fccb0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:57.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.328+0000 7fccc7400640 1 -- 172.21.15.55:0/667577583 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fccc811f420 con 0x7fccd015ded0 2024-04-02T07:22:57.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.328+0000 7fcccf400640 1 --2- 172.21.15.55:0/667577583 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fccb0066690 0x7fccb0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:57.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.328+0000 7fcccf400640 1 --2- 172.21.15.55:0/667577583 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fccb0066690 0x7fccb0068b50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fccc0007fd0 tx=0x7fccc0007d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:57.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.332+0000 7fccc7400640 1 -- 172.21.15.55:0/667577583 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fccc80ec8f0 con 0x7fccd015ded0 2024-04-02T07:22:57.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.492+0000 7fccd6200640 1 -- 172.21.15.55:0/667577583 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fccd006c650 con 0x7fccd015ded0 2024-04-02T07:22:57.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.492+0000 7fccc7400640 1 -- 172.21.15.55:0/667577583 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fccc80eff10 con 0x7fccd015ded0 2024-04-02T07:22:57.498 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:22:57.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.496+0000 7fccd6200640 1 -- 172.21.15.55:0/667577583 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fccb0066690 msgr2=0x7fccb0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:57.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.496+0000 7fccd6200640 1 --2- 172.21.15.55:0/667577583 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fccb0066690 0x7fccb0068b50 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fccc0007fd0 tx=0x7fccc0007d80 comp rx=0 tx=0).stop 2024-04-02T07:22:57.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.496+0000 7fccd6200640 1 -- 172.21.15.55:0/667577583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd015ded0 msgr2=0x7fccd00b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:57.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.496+0000 7fccd6200640 1 --2- 172.21.15.55:0/667577583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd015ded0 0x7fccd00b4fb0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fccc80195a0 tx=0x7fccc8019730 comp rx=0 tx=0).stop 2024-04-02T07:22:57.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.496+0000 7fccd6200640 1 -- 172.21.15.55:0/667577583 shutdown_connections 2024-04-02T07:22:57.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.496+0000 7fccd6200640 1 --2- 172.21.15.55:0/667577583 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccd015ded0 0x7fccd00b4fb0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:57.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.496+0000 7fccd6200640 1 --2- 172.21.15.55:0/667577583 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fccb0066690 0x7fccb0068b50 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:57.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.496+0000 7fccd6200640 1 --2- 172.21.15.55:0/667577583 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccd00b1320 0x7fccd006c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:57.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.496+0000 7fccd6200640 1 --2- 172.21.15.55:0/667577583 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccd0099120 0x7fccd0166190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:57.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.496+0000 7fccd6200640 1 -- 172.21.15.55:0/667577583 >> 172.21.15.55:0/667577583 conn(0x7fccd00b2160 msgr2=0x7fccd006e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:57.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.496+0000 7fccd6200640 1 -- 172.21.15.55:0/667577583 shutdown_connections 2024-04-02T07:22:57.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.496+0000 7fccd6200640 1 -- 172.21.15.55:0/667577583 wait complete. 2024-04-02T07:22:57.520 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:22:57.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c92200640 1 Processor -- start 2024-04-02T07:22:57.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c92200640 1 -- start start 2024-04-02T07:22:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c92200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c8c098a10 0x7f0c8c0b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c92200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8c0b1e30 con 0x7f0c8c0b3350 2024-04-02T07:22:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c92200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c8c099dc0 con 0x7f0c8c0cf420 2024-04-02T07:22:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c92200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c0ce170 con 0x7f0c8c098a10 2024-04-02T07:22:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c91800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0c8c0b3350 0x7f0c8c0cb720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43790/0 (socket says 172.21.15.55:43790) 2024-04-02T07:22:57.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c91800640 1 -- 172.21.15.55:0/4007091325 learned_addr learned my addr 172.21.15.55:0/4007091325 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:57.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c90e00640 1 --2- 172.21.15.55:0/4007091325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c8c098a10 0x7f0c8c0b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:57.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c8be00640 1 -- 172.21.15.55:0/4007091325 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156267471 0 0) 0x7f0c8c0b1e30 con 0x7f0c8c0b3350 2024-04-02T07:22:57.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c8be00640 1 -- 172.21.15.55:0/4007091325 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c70003530 con 0x7f0c8c0b3350 2024-04-02T07:22:57.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c8be00640 1 -- 172.21.15.55:0/4007091325 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416402230 0 0) 0x7f0c8c099dc0 con 0x7f0c8c0cf420 2024-04-02T07:22:57.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c8be00640 1 -- 172.21.15.55:0/4007091325 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c8c0b1e30 con 0x7f0c8c0cf420 2024-04-02T07:22:57.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c8be00640 1 -- 172.21.15.55:0/4007091325 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2479296253 0 0) 0x7f0c70003530 con 0x7f0c8c0b3350 2024-04-02T07:22:57.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c8be00640 1 -- 172.21.15.55:0/4007091325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c8c098a10 msgr2=0x7f0c8c0b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:57.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c8be00640 1 --2- 172.21.15.55:0/4007091325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c8c098a10 0x7f0c8c0b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:57.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c8be00640 1 -- 172.21.15.55:0/4007091325 >> v1:172.21.15.106:6789/0 conn(0x7f0c8c0cf420 legacy=0x7f0c8c098df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:57.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c8be00640 1 -- 172.21.15.55:0/4007091325 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c0ce450 con 0x7f0c8c0b3350 2024-04-02T07:22:57.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c8be00640 1 -- 172.21.15.55:0/4007091325 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f0c84001a00 con 0x7f0c8c0b3350 2024-04-02T07:22:57.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c8be00640 1 -- 172.21.15.55:0/4007091325 >> v1:172.21.15.55:6789/0 conn(0x7f0c8c0b3350 legacy=0x7f0c8c0cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:57.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c8be00640 1 --2- 172.21.15.55:0/4007091325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c70003b40 0x7f0c70003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:57.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c8be00640 1 --2- 172.21.15.55:0/4007091325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c700047d0 0x7f0c70004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:57.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c8be00640 1 --2- 172.21.15.55:0/4007091325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c70005190 0x7f0c7000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:57.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c8be00640 1 -- 172.21.15.55:0/4007091325 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c0ce170 con 0x7f0c70003b40 2024-04-02T07:22:57.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c8be00640 1 -- 172.21.15.55:0/4007091325 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7000c060 con 0x7f0c70005190 2024-04-02T07:22:57.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c8be00640 1 -- 172.21.15.55:0/4007091325 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7000c220 con 0x7f0c700047d0 2024-04-02T07:22:57.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.656+0000 7f0c90e00640 1 --2- 172.21.15.55:0/4007091325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c8c098a10 0x7f0c8c0b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:57.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.660+0000 7f0c90e00640 1 --2- 172.21.15.55:0/4007091325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c70003b40 0x7f0c70003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:57.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.660+0000 7f0c83e00640 1 --2- 172.21.15.55:0/4007091325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c700047d0 0x7f0c70004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:57.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.660+0000 7f0c91800640 1 --2- 172.21.15.55:0/4007091325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c70005190 0x7f0c7000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:57.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.660+0000 7f0c91800640 1 -- 172.21.15.55:0/4007091325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c700047d0 msgr2=0x7f0c70004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:57.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.660+0000 7f0c91800640 1 --2- 172.21.15.55:0/4007091325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c700047d0 0x7f0c70004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:57.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.660+0000 7f0c91800640 1 -- 172.21.15.55:0/4007091325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c70003b40 msgr2=0x7f0c70003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:57.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.660+0000 7f0c91800640 1 --2- 172.21.15.55:0/4007091325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c70003b40 0x7f0c70003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:57.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.660+0000 7f0c91800640 1 -- 172.21.15.55:0/4007091325 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c70003530 con 0x7f0c70005190 2024-04-02T07:22:57.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.660+0000 7f0c90e00640 1 --2- 172.21.15.55:0/4007091325 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c70003b40 0x7f0c70003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:57.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.660+0000 7f0c91800640 1 --2- 172.21.15.55:0/4007091325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c70005190 0x7f0c7000b990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400a740 tx=0x7f0c8401d200 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcb7180a7e3dc56c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:57.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.660+0000 7f0c8be00640 1 -- 172.21.15.55:0/4007091325 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c840ad630 con 0x7f0c70005190 2024-04-02T07:22:57.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.660+0000 7f0c8be00640 1 -- 172.21.15.55:0/4007091325 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c840a8070 con 0x7f0c70005190 2024-04-02T07:22:57.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.660+0000 7f0c8be00640 1 -- 172.21.15.55:0/4007091325 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c840ada10 con 0x7f0c70005190 2024-04-02T07:22:57.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c92200640 1 -- 172.21.15.55:0/4007091325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c70005190 msgr2=0x7f0c7000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:57.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c92200640 1 --2- 172.21.15.55:0/4007091325 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c70005190 0x7f0c7000b990 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f0c8400a740 tx=0x7f0c8401d200 comp rx=0 tx=0).stop 2024-04-02T07:22:57.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c91800640 1 -- 172.21.15.55:0/4007091325 reap_dead start 2024-04-02T07:22:57.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c92200640 1 -- 172.21.15.55:0/4007091325 shutdown_connections 2024-04-02T07:22:57.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c92200640 1 -- 172.21.15.55:0/4007091325 >> 172.21.15.55:0/4007091325 conn(0x7f0c8c0ccf80 msgr2=0x7f0c8c0cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:57.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c92200640 1 -- 172.21.15.55:0/4007091325 shutdown_connections 2024-04-02T07:22:57.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c92200640 1 -- 172.21.15.55:0/4007091325 wait complete. 2024-04-02T07:22:57.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c92200640 1 Processor -- start 2024-04-02T07:22:57.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c92200640 1 -- start start 2024-04-02T07:22:57.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c92200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c70005190 0x7f0c8c1573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:57.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c92200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c8c1478e0 0x7f0c8c158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:57.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c92200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c8c15e240 0x7f0c8c15e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:57.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c92200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c15ec00 con 0x7f0c8c15e240 2024-04-02T07:22:57.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c92200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c157c70 con 0x7f0c70005190 2024-04-02T07:22:57.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c92200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8c156970 con 0x7f0c8c1478e0 2024-04-02T07:22:57.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c91800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c8c15e240 0x7f0c8c15e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:57.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c91800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c8c15e240 0x7f0c8c15e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43412/0 (socket says 172.21.15.55:43412) 2024-04-02T07:22:57.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c91800640 1 -- 172.21.15.55:0/2182661230 learned_addr learned my addr 172.21.15.55:0/2182661230 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:57.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c90e00640 1 --2- 172.21.15.55:0/2182661230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c70005190 0x7f0c8c1573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:57.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c83e00640 1 --2- 172.21.15.55:0/2182661230 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c8c1478e0 0x7f0c8c158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:57.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c91800640 1 -- 172.21.15.55:0/2182661230 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c8c1478e0 msgr2=0x7f0c8c158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:57.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c91800640 1 --2- 172.21.15.55:0/2182661230 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c8c1478e0 0x7f0c8c158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:57.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c91800640 1 -- 172.21.15.55:0/2182661230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c70005190 msgr2=0x7f0c8c1573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:57.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c91800640 1 --2- 172.21.15.55:0/2182661230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c70005190 0x7f0c8c1573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:57.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c91800640 1 -- 172.21.15.55:0/2182661230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c156f30 con 0x7f0c8c15e240 2024-04-02T07:22:57.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.664+0000 7f0c90e00640 1 --2- 172.21.15.55:0/2182661230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c70005190 0x7f0c8c1573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:57.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.668+0000 7f0c91800640 1 --2- 172.21.15.55:0/2182661230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c8c15e240 0x7f0c8c15e6c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0c8401cc70 tx=0x7f0c70005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:57.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.668+0000 7f0c89600640 1 -- 172.21.15.55:0/2182661230 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c840011d0 con 0x7f0c8c15e240 2024-04-02T07:22:57.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.668+0000 7f0c89600640 1 -- 172.21.15.55:0/2182661230 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c84001800 con 0x7f0c8c15e240 2024-04-02T07:22:57.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.668+0000 7f0c89600640 1 -- 172.21.15.55:0/2182661230 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c840ad430 con 0x7f0c8c15e240 2024-04-02T07:22:57.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.668+0000 7f0c92200640 1 -- 172.21.15.55:0/2182661230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c8c157ec0 con 0x7f0c8c15e240 2024-04-02T07:22:57.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.668+0000 7f0c92200640 1 -- 172.21.15.55:0/2182661230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8c156bc0 con 0x7f0c8c15e240 2024-04-02T07:22:57.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.668+0000 7f0c92200640 1 -- 172.21.15.55:0/2182661230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c8c1570c0 con 0x7f0c8c15e240 2024-04-02T07:22:57.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.668+0000 7f0c89600640 1 -- 172.21.15.55:0/2182661230 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f0c840aa030 con 0x7f0c8c15e240 2024-04-02T07:22:57.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.668+0000 7f0c89600640 1 --2- 172.21.15.55:0/2182661230 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0c68066690 0x7f0c68068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:57.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.668+0000 7f0c89600640 1 -- 172.21.15.55:0/2182661230 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c8411da30 con 0x7f0c8c15e240 2024-04-02T07:22:57.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.668+0000 7f0c90e00640 1 --2- 172.21.15.55:0/2182661230 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0c68066690 0x7f0c68068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:57.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.672+0000 7f0c90e00640 1 --2- 172.21.15.55:0/2182661230 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0c68066690 0x7f0c68068b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c15f3b0 tx=0x7f0c7c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:57.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.672+0000 7f0c89600640 1 -- 172.21.15.55:0/2182661230 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0c840eadc0 con 0x7f0c8c15e240 2024-04-02T07:22:57.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.848+0000 7f0c92200640 1 -- 172.21.15.55:0/2182661230 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0c8c073fa0 con 0x7f0c8c15e240 2024-04-02T07:22:57.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.848+0000 7f0c89600640 1 -- 172.21.15.55:0/2182661230 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0c840bc020 con 0x7f0c8c15e240 2024-04-02T07:22:57.852 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:22:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.848+0000 7f0c92200640 1 -- 172.21.15.55:0/2182661230 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0c68066690 msgr2=0x7f0c68068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.848+0000 7f0c92200640 1 --2- 172.21.15.55:0/2182661230 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0c68066690 0x7f0c68068b50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c15f3b0 tx=0x7f0c7c008040 comp rx=0 tx=0).stop 2024-04-02T07:22:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.848+0000 7f0c92200640 1 -- 172.21.15.55:0/2182661230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c8c15e240 msgr2=0x7f0c8c15e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.848+0000 7f0c92200640 1 --2- 172.21.15.55:0/2182661230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c8c15e240 0x7f0c8c15e6c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0c8401cc70 tx=0x7f0c70005800 comp rx=0 tx=0).stop 2024-04-02T07:22:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.848+0000 7f0c92200640 1 -- 172.21.15.55:0/2182661230 shutdown_connections 2024-04-02T07:22:57.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.848+0000 7f0c92200640 1 --2- 172.21.15.55:0/2182661230 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c8c15e240 0x7f0c8c15e6c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:57.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.848+0000 7f0c92200640 1 --2- 172.21.15.55:0/2182661230 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0c8c1478e0 0x7f0c8c158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:57.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.848+0000 7f0c92200640 1 --2- 172.21.15.55:0/2182661230 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0c68066690 0x7f0c68068b50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:57.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.848+0000 7f0c92200640 1 --2- 172.21.15.55:0/2182661230 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0c70005190 0x7f0c8c1573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:57.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.848+0000 7f0c92200640 1 -- 172.21.15.55:0/2182661230 >> 172.21.15.55:0/2182661230 conn(0x7f0c8c0ccf80 msgr2=0x7f0c8c0b4620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:57.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.848+0000 7f0c92200640 1 -- 172.21.15.55:0/2182661230 shutdown_connections 2024-04-02T07:22:57.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:57.848+0000 7f0c92200640 1 -- 172.21.15.55:0/2182661230 wait complete. 2024-04-02T07:22:57.873 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi106.front.sepia.ceph.com... 2024-04-02T07:22:57.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:57.874 DEBUG:teuthology.orchestra.run.smithi106:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-04-02T07:22:57.912 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:22:57.912 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:22:57.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:22:57.912 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-02T07:22:57.971 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:22:57.971 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:22:57.979 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:22:57.979 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:22:58.031 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:22:58.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.212+0000 7f2cbea00640 1 Processor -- start 2024-04-02T07:22:58.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.212+0000 7f2cbea00640 1 -- start start 2024-04-02T07:22:58.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.216+0000 7f2cbea00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cb80b16e0 0x7f2cb80b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:58.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.216+0000 7f2cbea00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb80d01d0 con 0x7f2cb80b11f0 2024-04-02T07:22:58.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.216+0000 7f2cbea00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cb806c0e0 con 0x7f2cb80cfdf0 2024-04-02T07:22:58.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.216+0000 7f2cbea00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb80b01d0 con 0x7f2cb80b16e0 2024-04-02T07:22:58.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.216+0000 7f2cbca00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2cb80b11f0 0x7f2cb8098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43806/0 (socket says 172.21.15.55:43806) 2024-04-02T07:22:58.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.216+0000 7f2cbca00640 1 -- 172.21.15.55:0/1558799248 learned_addr learned my addr 172.21.15.55:0/1558799248 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:58.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.216+0000 7f2cafe00640 1 --2- 172.21.15.55:0/1558799248 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cb80b16e0 0x7f2cb80b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:58.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.216+0000 7f2cb7400640 1 -- 172.21.15.55:0/1558799248 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253152447 0 0) 0x7f2cb00014a0 con 0x7f2cb80b11f0 2024-04-02T07:22:58.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.216+0000 7f2cb7400640 1 -- 172.21.15.55:0/1558799248 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c9c003530 con 0x7f2cb80b11f0 2024-04-02T07:22:58.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.216+0000 7f2cb7400640 1 -- 172.21.15.55:0/1558799248 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4132114818 0 0) 0x7f2cb806c0e0 con 0x7f2cb80cfdf0 2024-04-02T07:22:58.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.216+0000 7f2cb7400640 1 -- 172.21.15.55:0/1558799248 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cb00014a0 con 0x7f2cb80cfdf0 2024-04-02T07:22:58.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.216+0000 7f2cafe00640 1 -- 172.21.15.55:0/1558799248 >> v1:172.21.15.106:6789/0 conn(0x7f2cb80cfdf0 legacy=0x7f2cb806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:58.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.216+0000 7f2cafe00640 1 -- 172.21.15.55:0/1558799248 >> v1:172.21.15.55:6789/0 conn(0x7f2cb80b11f0 legacy=0x7f2cb8098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:58.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.216+0000 7f2cafe00640 1 -- 172.21.15.55:0/1558799248 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb80b04b0 con 0x7f2cb80b16e0 2024-04-02T07:22:58.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.220+0000 7f2cafe00640 1 --2- 172.21.15.55:0/1558799248 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cb80b16e0 0x7f2cb80b0cb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00097f0 tx=0x7f2ca001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56ce9c8851d47899 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:58.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.220+0000 7f2cb7400640 1 -- 172.21.15.55:0/1558799248 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca00aa430 con 0x7f2cb80b16e0 2024-04-02T07:22:58.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.220+0000 7f2cb7400640 1 -- 172.21.15.55:0/1558799248 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca00aa590 con 0x7f2cb80b16e0 2024-04-02T07:22:58.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.220+0000 7f2cb7400640 1 -- 172.21.15.55:0/1558799248 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca00aa920 con 0x7f2cb80b16e0 2024-04-02T07:22:58.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.220+0000 7f2cbea00640 1 -- 172.21.15.55:0/1558799248 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cb80b16e0 msgr2=0x7f2cb80b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:58.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.220+0000 7f2cbea00640 1 --2- 172.21.15.55:0/1558799248 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cb80b16e0 0x7f2cb80b0cb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2ca00097f0 tx=0x7f2ca001c4b0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.220+0000 7f2cbea00640 1 -- 172.21.15.55:0/1558799248 shutdown_connections 2024-04-02T07:22:58.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.220+0000 7f2cbea00640 1 --2- 172.21.15.55:0/1558799248 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cb80b16e0 0x7f2cb80b0cb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.220+0000 7f2cbea00640 1 -- 172.21.15.55:0/1558799248 >> 172.21.15.55:0/1558799248 conn(0x7f2cb80b2210 msgr2=0x7f2cb80b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:58.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.220+0000 7f2cbea00640 1 -- 172.21.15.55:0/1558799248 shutdown_connections 2024-04-02T07:22:58.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.220+0000 7f2cbea00640 1 -- 172.21.15.55:0/1558799248 wait complete. 2024-04-02T07:22:58.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.220+0000 7f2cbea00640 1 Processor -- start 2024-04-02T07:22:58.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.220+0000 7f2cbea00640 1 -- start start 2024-04-02T07:22:58.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cbea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cb80b11f0 0x7f2cb80b5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:58.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cbea00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cb80b16e0 0x7f2cb814fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:58.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cbea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cb80cfdf0 0x7f2cb80cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:58.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cbea00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb80b45a0 con 0x7f2cb80cfdf0 2024-04-02T07:22:58.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cbea00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb80b4880 con 0x7f2cb80b11f0 2024-04-02T07:22:58.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cbea00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb80b4b60 con 0x7f2cb80b16e0 2024-04-02T07:22:58.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cbca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cb80cfdf0 0x7f2cb80cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:58.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cbca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cb80cfdf0 0x7f2cb80cb6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43416/0 (socket says 172.21.15.55:43416) 2024-04-02T07:22:58.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cbca00640 1 -- 172.21.15.55:0/1097804090 learned_addr learned my addr 172.21.15.55:0/1097804090 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:58.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cb7e00640 1 --2- 172.21.15.55:0/1097804090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cb80b11f0 0x7f2cb80b5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:58.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cafe00640 1 --2- 172.21.15.55:0/1097804090 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cb80b16e0 0x7f2cb814fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:58.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cbca00640 1 -- 172.21.15.55:0/1097804090 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cb80b16e0 msgr2=0x7f2cb814fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:58.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cbca00640 1 --2- 172.21.15.55:0/1097804090 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cb80b16e0 0x7f2cb814fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cbca00640 1 -- 172.21.15.55:0/1097804090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cb80b11f0 msgr2=0x7f2cb80b5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:58.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cbca00640 1 --2- 172.21.15.55:0/1097804090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cb80b11f0 0x7f2cb80b5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cbca00640 1 -- 172.21.15.55:0/1097804090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca0009420 con 0x7f2cb80cfdf0 2024-04-02T07:22:58.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cb7e00640 1 --2- 172.21.15.55:0/1097804090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cb80b11f0 0x7f2cb80b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:58.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cbca00640 1 --2- 172.21.15.55:0/1097804090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cb80cfdf0 0x7f2cb80cb6d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2cb000cc30 tx=0x7f2cb000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:58.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cb4c00640 1 -- 172.21.15.55:0/1097804090 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb000ce40 con 0x7f2cb80cfdf0 2024-04-02T07:22:58.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cb4c00640 1 -- 172.21.15.55:0/1097804090 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cb0012400 con 0x7f2cb80cfdf0 2024-04-02T07:22:58.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cb4c00640 1 -- 172.21.15.55:0/1097804090 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cb00127b0 con 0x7f2cb80cfdf0 2024-04-02T07:22:58.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cbea00640 1 -- 172.21.15.55:0/1097804090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb80b4e40 con 0x7f2cb80cfdf0 2024-04-02T07:22:58.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cbea00640 1 -- 172.21.15.55:0/1097804090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb80b5f80 con 0x7f2cb80cfdf0 2024-04-02T07:22:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cbea00640 1 -- 172.21.15.55:0/1097804090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb80b5360 con 0x7f2cb80cfdf0 2024-04-02T07:22:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.224+0000 7f2cb4c00640 1 -- 172.21.15.55:0/1097804090 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2cb0007070 con 0x7f2cb80cfdf0 2024-04-02T07:22:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.228+0000 7f2cb4c00640 1 --2- 172.21.15.55:0/1097804090 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2c94066690 0x7f2c94068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.228+0000 7f2cb4c00640 1 -- 172.21.15.55:0/1097804090 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cb00840f0 con 0x7f2cb80cfdf0 2024-04-02T07:22:58.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.228+0000 7f2cb7e00640 1 --2- 172.21.15.55:0/1097804090 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2c94066690 0x7f2c94068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:58.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.228+0000 7f2cb7e00640 1 --2- 172.21.15.55:0/1097804090 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2c94066690 0x7f2c94068b50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80011f0 tx=0x7f2ca8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:58.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.232+0000 7f2cb4c00640 1 -- 172.21.15.55:0/1097804090 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2cb80b5360 con 0x7f2cb80cfdf0 2024-04-02T07:22:58.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.400+0000 7f2cbea00640 1 -- 172.21.15.55:0/1097804090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cb80d01d0 con 0x7f2cb80cfdf0 2024-04-02T07:22:58.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.400+0000 7f2cb4c00640 1 -- 172.21.15.55:0/1097804090 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16037 (secure 0 0 0) 0x7f2cb80d01d0 con 0x7f2cb80cfdf0 2024-04-02T07:22:58.406 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:22:58.406 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":20,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:19.207279+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:22:58.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.404+0000 7f2cbea00640 1 -- 172.21.15.55:0/1097804090 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2c94066690 msgr2=0x7f2c94068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:58.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.404+0000 7f2cbea00640 1 --2- 172.21.15.55:0/1097804090 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2c94066690 0x7f2c94068b50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80011f0 tx=0x7f2ca8009040 comp rx=0 tx=0).stop 2024-04-02T07:22:58.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.404+0000 7f2cbea00640 1 -- 172.21.15.55:0/1097804090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cb80cfdf0 msgr2=0x7f2cb80cb6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:58.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.404+0000 7f2cbea00640 1 --2- 172.21.15.55:0/1097804090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cb80cfdf0 0x7f2cb80cb6d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f2cb000cc30 tx=0x7f2cb000a430 comp rx=0 tx=0).stop 2024-04-02T07:22:58.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.404+0000 7f2cbea00640 1 -- 172.21.15.55:0/1097804090 shutdown_connections 2024-04-02T07:22:58.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.404+0000 7f2cbea00640 1 --2- 172.21.15.55:0/1097804090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cb80cfdf0 0x7f2cb80cb6d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.404+0000 7f2cbea00640 1 --2- 172.21.15.55:0/1097804090 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cb80b16e0 0x7f2cb814fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.404+0000 7f2cbea00640 1 --2- 172.21.15.55:0/1097804090 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2c94066690 0x7f2c94068b50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.404+0000 7f2cbea00640 1 --2- 172.21.15.55:0/1097804090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cb80b11f0 0x7f2cb80b5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.404+0000 7f2cbea00640 1 -- 172.21.15.55:0/1097804090 >> 172.21.15.55:0/1097804090 conn(0x7f2cb80b2210 msgr2=0x7f2cb80ae1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:58.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.404+0000 7f2cbea00640 1 -- 172.21.15.55:0/1097804090 shutdown_connections 2024-04-02T07:22:58.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.404+0000 7f2cbea00640 1 -- 172.21.15.55:0/1097804090 wait complete. 2024-04-02T07:22:58.427 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:22:16.738297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:22:17.190496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:22:58.427 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:22:58.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.564+0000 7fd269a00640 1 Processor -- start 2024-04-02T07:22:58.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.564+0000 7fd269a00640 1 -- start start 2024-04-02T07:22:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.568+0000 7fd269a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd26415ca60 0x7fd2640cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:58.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.568+0000 7fd269a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd264098a10 0x7fd264098ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.568+0000 7fd269a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd26415ce40 con 0x7fd26406b920 2024-04-02T07:22:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.568+0000 7fd269a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2640993e0 con 0x7fd264098a10 2024-04-02T07:22:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.568+0000 7fd269a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd26406c440 con 0x7fd26415ca60 2024-04-02T07:22:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.568+0000 7fd25be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd264098a10 0x7fd264098ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.568+0000 7fd25be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd264098a10 0x7fd264098ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43428/0 (socket says 172.21.15.55:43428) 2024-04-02T07:22:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.568+0000 7fd25be00640 1 -- 172.21.15.55:0/1688131474 learned_addr learned my addr 172.21.15.55:0/1688131474 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.568+0000 7fd262a00640 1 --2- 172.21.15.55:0/1688131474 >> v2:172.21.15.106:3300/0 conn(0x7fd26415ca60 0x7fd2640cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.568+0000 7fd25be00640 1 -- 172.21.15.55:0/1688131474 >> v2:172.21.15.106:3300/0 conn(0x7fd26415ca60 msgr2=0x7fd2640cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.568+0000 7fd25be00640 1 --2- 172.21.15.55:0/1688131474 >> v2:172.21.15.106:3300/0 conn(0x7fd26415ca60 0x7fd2640cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.568+0000 7fd25be00640 1 -- 172.21.15.55:0/1688131474 >> v1:172.21.15.106:6789/0 conn(0x7fd26406b920 legacy=0x7fd26406bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:58.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.568+0000 7fd25be00640 1 -- 172.21.15.55:0/1688131474 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2640d01b0 con 0x7fd264098a10 2024-04-02T07:22:58.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.572+0000 7fd25be00640 1 --2- 172.21.15.55:0/1688131474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd264098a10 0x7fd264098ea0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd2640d1760 tx=0x7fd24c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7621bcc1e959977f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:58.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.572+0000 7fd262000640 1 -- 172.21.15.55:0/1688131474 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c0ab620 con 0x7fd264098a10 2024-04-02T07:22:58.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.572+0000 7fd262000640 1 -- 172.21.15.55:0/1688131474 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd24c0ab780 con 0x7fd264098a10 2024-04-02T07:22:58.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.572+0000 7fd262000640 1 -- 172.21.15.55:0/1688131474 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24c0abb10 con 0x7fd264098a10 2024-04-02T07:22:58.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.572+0000 7fd269a00640 1 -- 172.21.15.55:0/1688131474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd264098a10 msgr2=0x7fd264098ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:58.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.572+0000 7fd269a00640 1 --2- 172.21.15.55:0/1688131474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd264098a10 0x7fd264098ea0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd2640d1760 tx=0x7fd24c01c420 comp rx=0 tx=0).stop 2024-04-02T07:22:58.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.572+0000 7fd269a00640 1 -- 172.21.15.55:0/1688131474 shutdown_connections 2024-04-02T07:22:58.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.572+0000 7fd269a00640 1 --2- 172.21.15.55:0/1688131474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd264098a10 0x7fd264098ea0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.572+0000 7fd269a00640 1 --2- 172.21.15.55:0/1688131474 >> v2:172.21.15.106:3300/0 conn(0x7fd26415ca60 0x7fd2640cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.572+0000 7fd269a00640 1 -- 172.21.15.55:0/1688131474 >> 172.21.15.55:0/1688131474 conn(0x7fd2640b2150 msgr2=0x7fd2640b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:58.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.572+0000 7fd269a00640 1 -- 172.21.15.55:0/1688131474 shutdown_connections 2024-04-02T07:22:58.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.572+0000 7fd269a00640 1 -- 172.21.15.55:0/1688131474 wait complete. 2024-04-02T07:22:58.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.572+0000 7fd269a00640 1 Processor -- start 2024-04-02T07:22:58.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.572+0000 7fd269a00640 1 -- start start 2024-04-02T07:22:58.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.572+0000 7fd269a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd26406b920 0x7fd264154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:58.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.572+0000 7fd269a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd264098a10 0x7fd264158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:58.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.572+0000 7fd269a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd26415ca60 0x7fd264158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.572+0000 7fd269a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2640c6730 con 0x7fd26406b920 2024-04-02T07:22:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.572+0000 7fd269a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd264154d90 con 0x7fd264098a10 2024-04-02T07:22:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.572+0000 7fd269a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2640c4cb0 con 0x7fd26415ca60 2024-04-02T07:22:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.576+0000 7fd262a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd26406b920 0x7fd264154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.576+0000 7fd262a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd26406b920 0x7fd264154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43432/0 (socket says 172.21.15.55:43432) 2024-04-02T07:22:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.576+0000 7fd262a00640 1 -- 172.21.15.55:0/2115843759 learned_addr learned my addr 172.21.15.55:0/2115843759 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.576+0000 7fd25be00640 1 --2- 172.21.15.55:0/2115843759 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd264098a10 0x7fd264158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.576+0000 7fd263400640 1 --2- 172.21.15.55:0/2115843759 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd26415ca60 0x7fd264158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.576+0000 7fd262a00640 1 -- 172.21.15.55:0/2115843759 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd26415ca60 msgr2=0x7fd264158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.576+0000 7fd262a00640 1 --2- 172.21.15.55:0/2115843759 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd26415ca60 0x7fd264158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.576+0000 7fd262a00640 1 -- 172.21.15.55:0/2115843759 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd264098a10 msgr2=0x7fd264158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.576+0000 7fd262a00640 1 --2- 172.21.15.55:0/2115843759 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd264098a10 0x7fd264158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.576+0000 7fd262a00640 1 -- 172.21.15.55:0/2115843759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd24c0094d0 con 0x7fd26406b920 2024-04-02T07:22:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.576+0000 7fd262a00640 1 --2- 172.21.15.55:0/2115843759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd26406b920 0x7fd264154850 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd25400d800 tx=0x7fd25400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:58.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.576+0000 7fd25aa00640 1 -- 172.21.15.55:0/2115843759 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25400b6c0 con 0x7fd26406b920 2024-04-02T07:22:58.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.576+0000 7fd25aa00640 1 -- 172.21.15.55:0/2115843759 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd25400b820 con 0x7fd26406b920 2024-04-02T07:22:58.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.576+0000 7fd269a00640 1 -- 172.21.15.55:0/2115843759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2640c4f90 con 0x7fd26406b920 2024-04-02T07:22:58.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.576+0000 7fd25aa00640 1 -- 172.21.15.55:0/2115843759 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd25400bb90 con 0x7fd26406b920 2024-04-02T07:22:58.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.576+0000 7fd269a00640 1 -- 172.21.15.55:0/2115843759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2640c69d0 con 0x7fd26406b920 2024-04-02T07:22:58.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.576+0000 7fd269a00640 1 -- 172.21.15.55:0/2115843759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd264066c90 con 0x7fd26406b920 2024-04-02T07:22:58.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.576+0000 7fd25aa00640 1 -- 172.21.15.55:0/2115843759 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd25400bcf0 con 0x7fd26406b920 2024-04-02T07:22:58.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.576+0000 7fd25aa00640 1 --2- 172.21.15.55:0/2115843759 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd240066690 0x7fd240068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:58.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.576+0000 7fd25aa00640 1 -- 172.21.15.55:0/2115843759 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2540846c0 con 0x7fd26406b920 2024-04-02T07:22:58.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.580+0000 7fd25be00640 1 --2- 172.21.15.55:0/2115843759 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd240066690 0x7fd240068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:58.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.580+0000 7fd25be00640 1 --2- 172.21.15.55:0/2115843759 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd240066690 0x7fd240068b50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0af000 tx=0x7fd24c0b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:58.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.580+0000 7fd25aa00640 1 -- 172.21.15.55:0/2115843759 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd254051a20 con 0x7fd26406b920 2024-04-02T07:22:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.744+0000 7fd269a00640 1 -- 172.21.15.55:0/2115843759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2640b2ff0 con 0x7fd26406b920 2024-04-02T07:22:58.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.744+0000 7fd25aa00640 1 -- 172.21.15.55:0/2115843759 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd254055040 con 0x7fd26406b920 2024-04-02T07:22:58.749 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:22:58.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.744+0000 7fd269a00640 1 -- 172.21.15.55:0/2115843759 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd240066690 msgr2=0x7fd240068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:58.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.744+0000 7fd269a00640 1 --2- 172.21.15.55:0/2115843759 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd240066690 0x7fd240068b50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd24c0af000 tx=0x7fd24c0b6040 comp rx=0 tx=0).stop 2024-04-02T07:22:58.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.744+0000 7fd269a00640 1 -- 172.21.15.55:0/2115843759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd26406b920 msgr2=0x7fd264154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:58.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.744+0000 7fd269a00640 1 --2- 172.21.15.55:0/2115843759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd26406b920 0x7fd264154850 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd25400d800 tx=0x7fd25400dcc0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.744+0000 7fd269a00640 1 -- 172.21.15.55:0/2115843759 shutdown_connections 2024-04-02T07:22:58.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.744+0000 7fd269a00640 1 --2- 172.21.15.55:0/2115843759 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd26415ca60 0x7fd264158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.744+0000 7fd269a00640 1 --2- 172.21.15.55:0/2115843759 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd240066690 0x7fd240068b50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.744+0000 7fd269a00640 1 --2- 172.21.15.55:0/2115843759 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd264098a10 0x7fd264158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.744+0000 7fd269a00640 1 --2- 172.21.15.55:0/2115843759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd26406b920 0x7fd264154850 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.744+0000 7fd269a00640 1 -- 172.21.15.55:0/2115843759 >> 172.21.15.55:0/2115843759 conn(0x7fd2640b2150 msgr2=0x7fd2640cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:58.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.744+0000 7fd269a00640 1 -- 172.21.15.55:0/2115843759 shutdown_connections 2024-04-02T07:22:58.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.744+0000 7fd269a00640 1 -- 172.21.15.55:0/2115843759 wait complete. 2024-04-02T07:22:58.772 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:22:58.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.908+0000 7f036f200640 1 Processor -- start 2024-04-02T07:22:58.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.908+0000 7f036f200640 1 -- start start 2024-04-02T07:22:58.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.908+0000 7f036f200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f03700cc880 0x7f037006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:58.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.908+0000 7f036f200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0370098a10 0x7f0370098ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:58.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.908+0000 7f036f200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f037015c130 0x7f037015c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:58.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.908+0000 7f036f200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03700993e0 con 0x7f0370098a10 2024-04-02T07:22:58.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.908+0000 7f036f200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0370099a70 con 0x7f03700cc880 2024-04-02T07:22:58.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.908+0000 7f036f200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037006b5f0 con 0x7f037015c130 2024-04-02T07:22:58.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.912+0000 7f0367e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0370098a10 0x7f0370098ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:58.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.912+0000 7f0367e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0370098a10 0x7f0370098ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43444/0 (socket says 172.21.15.55:43444) 2024-04-02T07:22:58.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.912+0000 7f0367e00640 1 -- 172.21.15.55:0/3603944145 learned_addr learned my addr 172.21.15.55:0/3603944145 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:58.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.912+0000 7f036e800640 1 --2- 172.21.15.55:0/3603944145 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f037015c130 0x7f037015c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:58.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.912+0000 7f036de00640 1 --2- 172.21.15.55:0/3603944145 >> v2:172.21.15.106:3300/0 conn(0x7f03700cc880 0x7f037006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:58.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.912+0000 7f0367e00640 1 -- 172.21.15.55:0/3603944145 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f037015c130 msgr2=0x7f037015c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:58.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.912+0000 7f0367e00640 1 --2- 172.21.15.55:0/3603944145 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f037015c130 0x7f037015c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.912+0000 7f0367e00640 1 -- 172.21.15.55:0/3603944145 >> v2:172.21.15.106:3300/0 conn(0x7f03700cc880 msgr2=0x7f037006b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:58.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.912+0000 7f0367e00640 1 --2- 172.21.15.55:0/3603944145 >> v2:172.21.15.106:3300/0 conn(0x7f03700cc880 0x7f037006b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.912+0000 7f0367e00640 1 -- 172.21.15.55:0/3603944145 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037006bc90 con 0x7f0370098a10 2024-04-02T07:22:58.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.912+0000 7f036de00640 1 --2- 172.21.15.55:0/3603944145 >> v2:172.21.15.106:3300/0 conn(0x7f03700cc880 0x7f037006b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:58.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.912+0000 7f0367e00640 1 --2- 172.21.15.55:0/3603944145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0370098a10 0x7f0370098ea0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0370099ff0 tx=0x7f035801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2fbbe916f4bfd48 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:58.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.912+0000 7f036d400640 1 -- 172.21.15.55:0/3603944145 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03580aa610 con 0x7f0370098a10 2024-04-02T07:22:58.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.912+0000 7f036d400640 1 -- 172.21.15.55:0/3603944145 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03580a6040 con 0x7f0370098a10 2024-04-02T07:22:58.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.912+0000 7f036d400640 1 -- 172.21.15.55:0/3603944145 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03580aa990 con 0x7f0370098a10 2024-04-02T07:22:58.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036f200640 1 -- 172.21.15.55:0/3603944145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0370098a10 msgr2=0x7f0370098ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:58.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036f200640 1 --2- 172.21.15.55:0/3603944145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0370098a10 0x7f0370098ea0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f0370099ff0 tx=0x7f035801c4f0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036f200640 1 -- 172.21.15.55:0/3603944145 shutdown_connections 2024-04-02T07:22:58.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036f200640 1 --2- 172.21.15.55:0/3603944145 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f037015c130 0x7f037015c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036f200640 1 --2- 172.21.15.55:0/3603944145 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0370098a10 0x7f0370098ea0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036f200640 1 --2- 172.21.15.55:0/3603944145 >> v2:172.21.15.106:3300/0 conn(0x7f03700cc880 0x7f037006b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036f200640 1 -- 172.21.15.55:0/3603944145 >> 172.21.15.55:0/3603944145 conn(0x7f03700b1fb0 msgr2=0x7f03700b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:58.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036f200640 1 -- 172.21.15.55:0/3603944145 shutdown_connections 2024-04-02T07:22:58.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036f200640 1 -- 172.21.15.55:0/3603944145 wait complete. 2024-04-02T07:22:58.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036f200640 1 Processor -- start 2024-04-02T07:22:58.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036f200640 1 -- start start 2024-04-02T07:22:58.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036f200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0370098a10 0x7f0370153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036f200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f03700cc880 0x7f03700b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036f200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f037015c130 0x7f03700b3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036f200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03700b5a10 con 0x7f037015c130 2024-04-02T07:22:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036f200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03700b5cf0 con 0x7f0370098a10 2024-04-02T07:22:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036f200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03700b5fd0 con 0x7f03700cc880 2024-04-02T07:22:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036e800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f037015c130 0x7f03700b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036e800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f037015c130 0x7f03700b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43454/0 (socket says 172.21.15.55:43454) 2024-04-02T07:22:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036e800640 1 -- 172.21.15.55:0/1264465402 learned_addr learned my addr 172.21.15.55:0/1264465402 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f0367e00640 1 --2- 172.21.15.55:0/1264465402 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f03700cc880 0x7f03700b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036de00640 1 --2- 172.21.15.55:0/1264465402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0370098a10 0x7f0370153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036e800640 1 -- 172.21.15.55:0/1264465402 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f03700cc880 msgr2=0x7f03700b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:58.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036e800640 1 --2- 172.21.15.55:0/1264465402 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f03700cc880 0x7f03700b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036e800640 1 -- 172.21.15.55:0/1264465402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0370098a10 msgr2=0x7f0370153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036e800640 1 --2- 172.21.15.55:0/1264465402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0370098a10 0x7f0370153e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.916+0000 7f036e800640 1 -- 172.21.15.55:0/1264465402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03580094d0 con 0x7f037015c130 2024-04-02T07:22:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.920+0000 7f036e800640 1 --2- 172.21.15.55:0/1264465402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f037015c130 0x7f03700b3570 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f036800efc0 tx=0x7f036800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.920+0000 7f0366000640 1 -- 172.21.15.55:0/1264465402 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368014480 con 0x7f037015c130 2024-04-02T07:22:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.920+0000 7f0366000640 1 -- 172.21.15.55:0/1264465402 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f036800f040 con 0x7f037015c130 2024-04-02T07:22:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.920+0000 7f0366000640 1 -- 172.21.15.55:0/1264465402 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0368014820 con 0x7f037015c130 2024-04-02T07:22:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.920+0000 7f036f200640 1 -- 172.21.15.55:0/1264465402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037013d880 con 0x7f037015c130 2024-04-02T07:22:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.920+0000 7f036f200640 1 -- 172.21.15.55:0/1264465402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03700b56e0 con 0x7f037015c130 2024-04-02T07:22:58.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.920+0000 7f036f200640 1 -- 172.21.15.55:0/1264465402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037006b830 con 0x7f037015c130 2024-04-02T07:22:58.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.920+0000 7f0366000640 1 -- 172.21.15.55:0/1264465402 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f0368014980 con 0x7f037015c130 2024-04-02T07:22:58.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.920+0000 7f0366000640 1 --2- 172.21.15.55:0/1264465402 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f034c066690 0x7f034c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:58.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.920+0000 7f0366000640 1 -- 172.21.15.55:0/1264465402 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0368084cb0 con 0x7f037015c130 2024-04-02T07:22:58.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.920+0000 7f036de00640 1 --2- 172.21.15.55:0/1264465402 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f034c066690 0x7f034c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:58.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.924+0000 7f036de00640 1 --2- 172.21.15.55:0/1264465402 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f034c066690 0x7f034c068b50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f03600098b0 tx=0x7f0360008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:58.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:58.924+0000 7f0366000640 1 -- 172.21.15.55:0/1264465402 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0368052010 con 0x7f037015c130 2024-04-02T07:22:59.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.084+0000 7f036f200640 1 -- 172.21.15.55:0/1264465402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0370073fa0 con 0x7f037015c130 2024-04-02T07:22:59.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.084+0000 7f0366000640 1 -- 172.21.15.55:0/1264465402 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0368018020 con 0x7f037015c130 2024-04-02T07:22:59.091 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:22:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.088+0000 7f036f200640 1 -- 172.21.15.55:0/1264465402 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f034c066690 msgr2=0x7f034c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.088+0000 7f036f200640 1 --2- 172.21.15.55:0/1264465402 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f034c066690 0x7f034c068b50 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f03600098b0 tx=0x7f0360008040 comp rx=0 tx=0).stop 2024-04-02T07:22:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.088+0000 7f036f200640 1 -- 172.21.15.55:0/1264465402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f037015c130 msgr2=0x7f03700b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.088+0000 7f036f200640 1 --2- 172.21.15.55:0/1264465402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f037015c130 0x7f03700b3570 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f036800efc0 tx=0x7f036800c490 comp rx=0 tx=0).stop 2024-04-02T07:22:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.088+0000 7f036f200640 1 -- 172.21.15.55:0/1264465402 shutdown_connections 2024-04-02T07:22:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.088+0000 7f036f200640 1 --2- 172.21.15.55:0/1264465402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f037015c130 0x7f03700b3570 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.088+0000 7f036f200640 1 --2- 172.21.15.55:0/1264465402 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f03700cc880 0x7f03700b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.088+0000 7f036f200640 1 --2- 172.21.15.55:0/1264465402 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f034c066690 0x7f034c068b50 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.088+0000 7f036f200640 1 --2- 172.21.15.55:0/1264465402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0370098a10 0x7f0370153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.088+0000 7f036f200640 1 -- 172.21.15.55:0/1264465402 >> 172.21.15.55:0/1264465402 conn(0x7f03700b1fb0 msgr2=0x7f0370072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.088+0000 7f036f200640 1 -- 172.21.15.55:0/1264465402 shutdown_connections 2024-04-02T07:22:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.088+0000 7f036f200640 1 -- 172.21.15.55:0/1264465402 wait complete. 2024-04-02T07:22:59.112 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:22:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.252+0000 7f1fe2e00640 1 Processor -- start 2024-04-02T07:22:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.252+0000 7f1fe2e00640 1 -- start start 2024-04-02T07:22:59.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.256+0000 7f1fe2e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1fdc144260 0x7f1fdc0702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:59.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.256+0000 7f1fe2e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fdc0707e0 0x7f1fdc0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:59.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.256+0000 7f1fe2e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1fdc15e3a0 con 0x7f1fdc0b2fd0 2024-04-02T07:22:59.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.256+0000 7f1fe2e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fdc0b37c0 con 0x7f1fdc144260 2024-04-02T07:22:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.256+0000 7f1fe2e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc070c60 con 0x7f1fdc0707e0 2024-04-02T07:22:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.256+0000 7f1fdbe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1fdc144260 0x7f1fdc0702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.256+0000 7f1fdbe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1fdc144260 0x7f1fdc0702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43456/0 (socket says 172.21.15.55:43456) 2024-04-02T07:22:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.256+0000 7f1fdbe00640 1 -- 172.21.15.55:0/3189171472 learned_addr learned my addr 172.21.15.55:0/3189171472 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.256+0000 7f1fd3400640 1 --2- 172.21.15.55:0/3189171472 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fdc0707e0 0x7f1fdc0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.256+0000 7f1fdbe00640 1 -- 172.21.15.55:0/3189171472 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fdc0707e0 msgr2=0x7f1fdc0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.256+0000 7f1fdbe00640 1 --2- 172.21.15.55:0/3189171472 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fdc0707e0 0x7f1fdc0b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.256+0000 7f1fdbe00640 1 -- 172.21.15.55:0/3189171472 >> v1:172.21.15.55:6789/0 conn(0x7f1fdc0b2fd0 legacy=0x7f1fdc0cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:59.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.256+0000 7f1fdbe00640 1 -- 172.21.15.55:0/3189171472 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fdc15e5f0 con 0x7f1fdc144260 2024-04-02T07:22:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fdbe00640 1 --2- 172.21.15.55:0/3189171472 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc144260 0x7f1fdc0702a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009e50 tx=0x7f1fcc01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4866ea7a97bdc7c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fdb400640 1 -- 172.21.15.55:0/3189171472 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0a5700 con 0x7f1fdc144260 2024-04-02T07:22:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fdb400640 1 -- 172.21.15.55:0/3189171472 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc0a5860 con 0x7f1fdc144260 2024-04-02T07:22:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fdb400640 1 -- 172.21.15.55:0/3189171472 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0a5bf0 con 0x7f1fdc144260 2024-04-02T07:22:59.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fe2e00640 1 -- 172.21.15.55:0/3189171472 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc144260 msgr2=0x7f1fdc0702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fe2e00640 1 --2- 172.21.15.55:0/3189171472 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc144260 0x7f1fdc0702a0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc009e50 tx=0x7f1fcc01ca30 comp rx=0 tx=0).stop 2024-04-02T07:22:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fe2e00640 1 -- 172.21.15.55:0/3189171472 shutdown_connections 2024-04-02T07:22:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fe2e00640 1 --2- 172.21.15.55:0/3189171472 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fdc0707e0 0x7f1fdc0b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fe2e00640 1 --2- 172.21.15.55:0/3189171472 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc144260 0x7f1fdc0702a0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fe2e00640 1 -- 172.21.15.55:0/3189171472 >> 172.21.15.55:0/3189171472 conn(0x7f1fdc06a390 msgr2=0x7f1fdc0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fe2e00640 1 -- 172.21.15.55:0/3189171472 shutdown_connections 2024-04-02T07:22:59.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fe2e00640 1 -- 172.21.15.55:0/3189171472 wait complete. 2024-04-02T07:22:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fe2e00640 1 Processor -- start 2024-04-02T07:22:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fe2e00640 1 -- start start 2024-04-02T07:22:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fe2e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc0707e0 0x7f1fdc139b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fe2e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fdc0b2fd0 0x7f1fdc159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fe2e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fdc144260 0x7f1fdc15cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fe2e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc13a660 con 0x7f1fdc0707e0 2024-04-02T07:22:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fe2e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc164e50 con 0x7f1fdc0b2fd0 2024-04-02T07:22:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fe2e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fdc15f880 con 0x7f1fdc144260 2024-04-02T07:22:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fdbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc0707e0 0x7f1fdc139b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fdbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc0707e0 0x7f1fdc139b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43472/0 (socket says 172.21.15.55:43472) 2024-04-02T07:22:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fdbe00640 1 -- 172.21.15.55:0/2677623028 learned_addr learned my addr 172.21.15.55:0/2677623028 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fd3400640 1 --2- 172.21.15.55:0/2677623028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fdc0b2fd0 0x7f1fdc159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.260+0000 7f1fe0e00640 1 --2- 172.21.15.55:0/2677623028 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fdc144260 0x7f1fdc15cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.264+0000 7f1fdbe00640 1 -- 172.21.15.55:0/2677623028 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fdc144260 msgr2=0x7f1fdc15cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.264+0000 7f1fdbe00640 1 --2- 172.21.15.55:0/2677623028 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fdc144260 0x7f1fdc15cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.264+0000 7f1fdbe00640 1 -- 172.21.15.55:0/2677623028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fdc0b2fd0 msgr2=0x7f1fdc159de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.264+0000 7f1fdbe00640 1 --2- 172.21.15.55:0/2677623028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fdc0b2fd0 0x7f1fdc159de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.264+0000 7f1fdbe00640 1 -- 172.21.15.55:0/2677623028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fcc009b30 con 0x7f1fdc0707e0 2024-04-02T07:22:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.264+0000 7f1fdbe00640 1 --2- 172.21.15.55:0/2677623028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc0707e0 0x7f1fdc139b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0af040 tx=0x7f1fcc0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.264+0000 7f1fd8c00640 1 -- 172.21.15.55:0/2677623028 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0b8670 con 0x7f1fdc0707e0 2024-04-02T07:22:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.264+0000 7f1fd8c00640 1 -- 172.21.15.55:0/2677623028 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fcc0b87d0 con 0x7f1fdc0707e0 2024-04-02T07:22:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.264+0000 7f1fd8c00640 1 -- 172.21.15.55:0/2677623028 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fcc0b8b80 con 0x7f1fdc0707e0 2024-04-02T07:22:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.264+0000 7f1fe2e00640 1 -- 172.21.15.55:0/2677623028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fdc15fb60 con 0x7f1fdc0707e0 2024-04-02T07:22:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.264+0000 7f1fe2e00640 1 -- 172.21.15.55:0/2677623028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fdc164ae0 con 0x7f1fdc0707e0 2024-04-02T07:22:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.264+0000 7f1fe2e00640 1 -- 172.21.15.55:0/2677623028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fdc073530 con 0x7f1fdc0707e0 2024-04-02T07:22:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.264+0000 7f1fd8c00640 1 -- 172.21.15.55:0/2677623028 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1fcc0b8ce0 con 0x7f1fdc0707e0 2024-04-02T07:22:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.264+0000 7f1fd8c00640 1 --2- 172.21.15.55:0/2677623028 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1fb8066690 0x7f1fb8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.264+0000 7f1fd8c00640 1 -- 172.21.15.55:0/2677623028 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f1fcc11f7d0 con 0x7f1fdc0707e0 2024-04-02T07:22:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.268+0000 7f1fd3400640 1 --2- 172.21.15.55:0/2677623028 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1fb8066690 0x7f1fb8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:59.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.268+0000 7f1fd3400640 1 --2- 172.21.15.55:0/2677623028 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1fb8066690 0x7f1fb8068b50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc15fe40 tx=0x7f1fc4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.268+0000 7f1fd8c00640 1 -- 172.21.15.55:0/2677623028 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f1fcc0ecc80 con 0x7f1fdc0707e0 2024-04-02T07:22:59.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.440+0000 7f1fe2e00640 1 -- 172.21.15.55:0/2677623028 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1fdc164c70 con 0x7f1fdc0707e0 2024-04-02T07:22:59.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.440+0000 7f1fd8c00640 1 -- 172.21.15.55:0/2677623028 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v21) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1fcc0f02a0 con 0x7f1fdc0707e0 2024-04-02T07:22:59.447 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:22:59.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.444+0000 7f1fe2e00640 1 -- 172.21.15.55:0/2677623028 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1fb8066690 msgr2=0x7f1fb8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:59.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.444+0000 7f1fe2e00640 1 --2- 172.21.15.55:0/2677623028 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1fb8066690 0x7f1fb8068b50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc15fe40 tx=0x7f1fc4008040 comp rx=0 tx=0).stop 2024-04-02T07:22:59.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.444+0000 7f1fe2e00640 1 -- 172.21.15.55:0/2677623028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc0707e0 msgr2=0x7f1fdc139b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:59.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.444+0000 7f1fe2e00640 1 --2- 172.21.15.55:0/2677623028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc0707e0 0x7f1fdc139b90 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f1fcc0af040 tx=0x7f1fcc0197d0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.444+0000 7f1fe2e00640 1 -- 172.21.15.55:0/2677623028 shutdown_connections 2024-04-02T07:22:59.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.444+0000 7f1fe2e00640 1 --2- 172.21.15.55:0/2677623028 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1fdc144260 0x7f1fdc15cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.444+0000 7f1fe2e00640 1 --2- 172.21.15.55:0/2677623028 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1fb8066690 0x7f1fb8068b50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.444+0000 7f1fe2e00640 1 --2- 172.21.15.55:0/2677623028 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1fdc0b2fd0 0x7f1fdc159de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.444+0000 7f1fe2e00640 1 --2- 172.21.15.55:0/2677623028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1fdc0707e0 0x7f1fdc139b90 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.444+0000 7f1fe2e00640 1 -- 172.21.15.55:0/2677623028 >> 172.21.15.55:0/2677623028 conn(0x7f1fdc06a390 msgr2=0x7f1fdc13f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:59.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.444+0000 7f1fe2e00640 1 -- 172.21.15.55:0/2677623028 shutdown_connections 2024-04-02T07:22:59.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.444+0000 7f1fe2e00640 1 -- 172.21.15.55:0/2677623028 wait complete. 2024-04-02T07:22:59.468 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:22:59.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88eec00640 1 Processor -- start 2024-04-02T07:22:59.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88eec00640 1 -- start start 2024-04-02T07:22:59.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88eec00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e80cd690 0x7f88e80b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:59.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88eec00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e80cea70 con 0x7f88e80cad50 2024-04-02T07:22:59.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88eec00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e80b13a0 con 0x7f88e815cb20 2024-04-02T07:22:59.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88eec00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e80b1680 con 0x7f88e80cd690 2024-04-02T07:22:59.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88dfe00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f88e80cad50 0x7f88e80b0620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43814/0 (socket says 172.21.15.55:43814) 2024-04-02T07:22:59.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88dfe00640 1 -- 172.21.15.55:0/447924546 learned_addr learned my addr 172.21.15.55:0/447924546 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:22:59.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88ecc00640 1 --2- 172.21.15.55:0/447924546 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e80cd690 0x7f88e80b0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:59.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88e7400640 1 -- 172.21.15.55:0/447924546 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3946884613 0 0) 0x7f88e80cea70 con 0x7f88e80cad50 2024-04-02T07:22:59.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88e7400640 1 -- 172.21.15.55:0/447924546 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88cc003530 con 0x7f88e80cad50 2024-04-02T07:22:59.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88e7400640 1 -- 172.21.15.55:0/447924546 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873508114 0 0) 0x7f88e80b13a0 con 0x7f88e815cb20 2024-04-02T07:22:59.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88e7400640 1 -- 172.21.15.55:0/447924546 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88e80cea70 con 0x7f88e815cb20 2024-04-02T07:22:59.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88e7400640 1 -- 172.21.15.55:0/447924546 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1058048462 0 0) 0x7f88cc003530 con 0x7f88e80cad50 2024-04-02T07:22:59.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88e7400640 1 -- 172.21.15.55:0/447924546 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e80cd690 msgr2=0x7f88e80b0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:59.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88e7400640 1 --2- 172.21.15.55:0/447924546 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e80cd690 0x7f88e80b0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88e7400640 1 -- 172.21.15.55:0/447924546 >> v1:172.21.15.106:6789/0 conn(0x7f88e815cb20 legacy=0x7f88e80ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:59.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88e7400640 1 -- 172.21.15.55:0/447924546 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e80cecf0 con 0x7f88e80cad50 2024-04-02T07:22:59.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88e7400640 1 -- 172.21.15.55:0/447924546 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f88d0001680 con 0x7f88e80cad50 2024-04-02T07:22:59.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88e7400640 1 -- 172.21.15.55:0/447924546 >> v1:172.21.15.55:6789/0 conn(0x7f88e80cad50 legacy=0x7f88e80b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:59.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88e7400640 1 --2- 172.21.15.55:0/447924546 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88cc003b40 0x7f88cc003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:59.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88e7400640 1 --2- 172.21.15.55:0/447924546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88cc0047d0 0x7f88cc004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:59.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88e7400640 1 --2- 172.21.15.55:0/447924546 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88cc005190 0x7f88cc00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:59.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88e7400640 1 -- 172.21.15.55:0/447924546 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e80b1680 con 0x7f88cc0047d0 2024-04-02T07:22:59.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88e7400640 1 -- 172.21.15.55:0/447924546 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc00c000 con 0x7f88cc003b40 2024-04-02T07:22:59.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88e7400640 1 -- 172.21.15.55:0/447924546 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88cc00c1c0 con 0x7f88cc005190 2024-04-02T07:22:59.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.604+0000 7f88ecc00640 1 --2- 172.21.15.55:0/447924546 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e80cd690 0x7f88e80b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:59.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.608+0000 7f88e7e00640 1 --2- 172.21.15.55:0/447924546 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88cc003b40 0x7f88cc003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:59.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.608+0000 7f88dfe00640 1 --2- 172.21.15.55:0/447924546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88cc0047d0 0x7f88cc004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:59.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.608+0000 7f88ecc00640 1 --2- 172.21.15.55:0/447924546 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88cc005190 0x7f88cc00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:59.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.608+0000 7f88dfe00640 1 -- 172.21.15.55:0/447924546 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88cc005190 msgr2=0x7f88cc00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:59.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.608+0000 7f88dfe00640 1 --2- 172.21.15.55:0/447924546 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88cc005190 0x7f88cc00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.608+0000 7f88dfe00640 1 -- 172.21.15.55:0/447924546 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88cc003b40 msgr2=0x7f88cc003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:22:59.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.608+0000 7f88dfe00640 1 --2- 172.21.15.55:0/447924546 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88cc003b40 0x7f88cc003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.608+0000 7f88dfe00640 1 -- 172.21.15.55:0/447924546 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88cc003530 con 0x7f88cc0047d0 2024-04-02T07:22:59.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.608+0000 7f88dfe00640 1 --2- 172.21.15.55:0/447924546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88cc0047d0 0x7f88cc004c50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f88d000c160 tx=0x7f88d001cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbf07745a0a2bef server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:59.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.608+0000 7f88e7400640 1 -- 172.21.15.55:0/447924546 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d00058e0 con 0x7f88cc0047d0 2024-04-02T07:22:59.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.608+0000 7f88e7400640 1 -- 172.21.15.55:0/447924546 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d0005a40 con 0x7f88cc0047d0 2024-04-02T07:22:59.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.608+0000 7f88e7400640 1 -- 172.21.15.55:0/447924546 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d0005e10 con 0x7f88cc0047d0 2024-04-02T07:22:59.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.612+0000 7f88eec00640 1 -- 172.21.15.55:0/447924546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88cc0047d0 msgr2=0x7f88cc004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:59.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.612+0000 7f88eec00640 1 --2- 172.21.15.55:0/447924546 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88cc0047d0 0x7f88cc004c50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f88d000c160 tx=0x7f88d001cb90 comp rx=0 tx=0).stop 2024-04-02T07:22:59.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.612+0000 7f88ecc00640 1 -- 172.21.15.55:0/447924546 reap_dead start 2024-04-02T07:22:59.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.612+0000 7f88eec00640 1 -- 172.21.15.55:0/447924546 shutdown_connections 2024-04-02T07:22:59.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.612+0000 7f88eec00640 1 -- 172.21.15.55:0/447924546 >> 172.21.15.55:0/447924546 conn(0x7f88e80d0700 msgr2=0x7f88e80d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:59.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.612+0000 7f88eec00640 1 -- 172.21.15.55:0/447924546 shutdown_connections 2024-04-02T07:22:59.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.612+0000 7f88eec00640 1 -- 172.21.15.55:0/447924546 wait complete. 2024-04-02T07:22:59.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.612+0000 7f88eec00640 1 Processor -- start 2024-04-02T07:22:59.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.612+0000 7f88eec00640 1 -- start start 2024-04-02T07:22:59.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.612+0000 7f88eec00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88cc0047d0 0x7f88e80cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:59.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.612+0000 7f88eec00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e815fb90 0x7f88e814bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:59.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.612+0000 7f88eec00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88e815e090 0x7f88e815e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:59.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.612+0000 7f88eec00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e80ad4a0 con 0x7f88cc0047d0 2024-04-02T07:22:59.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.612+0000 7f88eec00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e815f490 con 0x7f88e815e090 2024-04-02T07:22:59.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.612+0000 7f88eec00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e815eed0 con 0x7f88e815fb90 2024-04-02T07:22:59.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.612+0000 7f88e7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88cc0047d0 0x7f88e80cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:59.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.612+0000 7f88e7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88cc0047d0 0x7f88e80cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43482/0 (socket says 172.21.15.55:43482) 2024-04-02T07:22:59.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.612+0000 7f88e7e00640 1 -- 172.21.15.55:0/2180868487 learned_addr learned my addr 172.21.15.55:0/2180868487 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:22:59.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.612+0000 7f88ecc00640 1 --2- 172.21.15.55:0/2180868487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88e815e090 0x7f88e815e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:59.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.612+0000 7f88dfe00640 1 --2- 172.21.15.55:0/2180868487 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e815fb90 0x7f88e814bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:59.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.616+0000 7f88e7e00640 1 -- 172.21.15.55:0/2180868487 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e815fb90 msgr2=0x7f88e814bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:59.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.616+0000 7f88e7e00640 1 --2- 172.21.15.55:0/2180868487 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e815fb90 0x7f88e814bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.616+0000 7f88e7e00640 1 -- 172.21.15.55:0/2180868487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88e815e090 msgr2=0x7f88e815e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:59.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.616+0000 7f88e7e00640 1 --2- 172.21.15.55:0/2180868487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88e815e090 0x7f88e815e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.616+0000 7f88e7e00640 1 -- 172.21.15.55:0/2180868487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e815f1b0 con 0x7f88cc0047d0 2024-04-02T07:22:59.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.616+0000 7f88dfe00640 1 --2- 172.21.15.55:0/2180868487 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e815fb90 0x7f88e814bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:22:59.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.616+0000 7f88ecc00640 1 --2- 172.21.15.55:0/2180868487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88e815e090 0x7f88e815e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:22:59.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.616+0000 7f88e7e00640 1 --2- 172.21.15.55:0/2180868487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88cc0047d0 0x7f88e80cbec0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f88d800f7f0 tx=0x7f88d800fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:59.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.616+0000 7f88e4c00640 1 -- 172.21.15.55:0/2180868487 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d80050d0 con 0x7f88cc0047d0 2024-04-02T07:22:59.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.616+0000 7f88e4c00640 1 -- 172.21.15.55:0/2180868487 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d8005250 con 0x7f88cc0047d0 2024-04-02T07:22:59.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.616+0000 7f88e4c00640 1 -- 172.21.15.55:0/2180868487 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d800d730 con 0x7f88cc0047d0 2024-04-02T07:22:59.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.616+0000 7f88eec00640 1 -- 172.21.15.55:0/2180868487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e814ca30 con 0x7f88cc0047d0 2024-04-02T07:22:59.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.616+0000 7f88eec00640 1 -- 172.21.15.55:0/2180868487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e814c6a0 con 0x7f88cc0047d0 2024-04-02T07:22:59.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.616+0000 7f88eec00640 1 -- 172.21.15.55:0/2180868487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e8066c90 con 0x7f88cc0047d0 2024-04-02T07:22:59.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.616+0000 7f88e4c00640 1 -- 172.21.15.55:0/2180868487 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f88d800d890 con 0x7f88cc0047d0 2024-04-02T07:22:59.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.620+0000 7f88e4c00640 1 --2- 172.21.15.55:0/2180868487 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f88c40666c0 0x7f88c4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:22:59.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.620+0000 7f88e4c00640 1 -- 172.21.15.55:0/2180868487 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f88d8084160 con 0x7f88cc0047d0 2024-04-02T07:22:59.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.620+0000 7f88dfe00640 1 --2- 172.21.15.55:0/2180868487 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f88c40666c0 0x7f88c4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:22:59.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.620+0000 7f88dfe00640 1 --2- 172.21.15.55:0/2180868487 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f88c40666c0 0x7f88c4068b80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f88d00aa000 tx=0x7f88d0001a00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:22:59.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.624+0000 7f88e4c00640 1 -- 172.21.15.55:0/2180868487 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f88d8051450 con 0x7f88cc0047d0 2024-04-02T07:22:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.796+0000 7f88eec00640 1 -- 172.21.15.55:0/2180868487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f88e806c280 con 0x7f88cc0047d0 2024-04-02T07:22:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.796+0000 7f88e4c00640 1 -- 172.21.15.55:0/2180868487 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v21) v1 ==== 80+0+0 (secure 0 0 0) 0x7f88d8059e60 con 0x7f88cc0047d0 2024-04-02T07:22:59.800 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:22:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.796+0000 7f88eec00640 1 -- 172.21.15.55:0/2180868487 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f88c40666c0 msgr2=0x7f88c4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.796+0000 7f88eec00640 1 --2- 172.21.15.55:0/2180868487 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f88c40666c0 0x7f88c4068b80 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f88d00aa000 tx=0x7f88d0001a00 comp rx=0 tx=0).stop 2024-04-02T07:22:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.796+0000 7f88eec00640 1 -- 172.21.15.55:0/2180868487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88cc0047d0 msgr2=0x7f88e80cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:22:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.796+0000 7f88eec00640 1 --2- 172.21.15.55:0/2180868487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88cc0047d0 0x7f88e80cbec0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f88d800f7f0 tx=0x7f88d800fcb0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.796+0000 7f88eec00640 1 -- 172.21.15.55:0/2180868487 shutdown_connections 2024-04-02T07:22:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.796+0000 7f88eec00640 1 --2- 172.21.15.55:0/2180868487 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f88c40666c0 0x7f88c4068b80 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.796+0000 7f88eec00640 1 --2- 172.21.15.55:0/2180868487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88e815e090 0x7f88e815e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.796+0000 7f88eec00640 1 --2- 172.21.15.55:0/2180868487 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e815fb90 0x7f88e814bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.796+0000 7f88eec00640 1 --2- 172.21.15.55:0/2180868487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88cc0047d0 0x7f88e80cbec0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:22:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.796+0000 7f88eec00640 1 -- 172.21.15.55:0/2180868487 >> 172.21.15.55:0/2180868487 conn(0x7f88e80d0700 msgr2=0x7f88e806e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:22:59.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.796+0000 7f88eec00640 1 -- 172.21.15.55:0/2180868487 shutdown_connections 2024-04-02T07:22:59.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:22:59.796+0000 7f88eec00640 1 -- 172.21.15.55:0/2180868487 wait complete. 2024-04-02T07:22:59.822 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:22:59.822 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:22:59.831 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:23:00.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.012+0000 7fdaa1e00640 1 Processor -- start 2024-04-02T07:23:00.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.012+0000 7fdaa1e00640 1 -- start start 2024-04-02T07:23:00.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.012+0000 7fdaa1e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fda9c15a480 0x7fda9c0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:00.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.012+0000 7fdaa1e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda9c0b1070 0x7fda9c0c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:00.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.012+0000 7fdaa1e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda9c15a860 con 0x7fda9c0ca9a0 2024-04-02T07:23:00.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.012+0000 7fdaa1e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda9c15ce20 con 0x7fda9c15a480 2024-04-02T07:23:00.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.012+0000 7fdaa1e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c0cade0 con 0x7fda9c0b1070 2024-04-02T07:23:00.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.012+0000 7fda93e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fda9c0ca9a0 0x7fda9c0b0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43816/0 (socket says 172.21.15.55:43816) 2024-04-02T07:23:00.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.012+0000 7fda93e00640 1 -- 172.21.15.55:0/1867921064 learned_addr learned my addr 172.21.15.55:0/1867921064 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:00.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.016+0000 7fda9b400640 1 --2- 172.21.15.55:0/1867921064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda9c0b1070 0x7fda9c0c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:00.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.016+0000 7fda9aa00640 1 --2- 172.21.15.55:0/1867921064 >> v2:172.21.15.106:3300/0 conn(0x7fda9c15a480 0x7fda9c0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:00.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.016+0000 7fda9a000640 1 -- 172.21.15.55:0/1867921064 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1631490577 0 0) 0x7fda84001120 con 0x7fda9c0ca9a0 2024-04-02T07:23:00.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.016+0000 7fda9a000640 1 -- 172.21.15.55:0/1867921064 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda80003530 con 0x7fda9c0ca9a0 2024-04-02T07:23:00.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.016+0000 7fda9b400640 1 -- 172.21.15.55:0/1867921064 >> v2:172.21.15.106:3300/0 conn(0x7fda9c15a480 msgr2=0x7fda9c0ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:00.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.016+0000 7fda9b400640 1 --2- 172.21.15.55:0/1867921064 >> v2:172.21.15.106:3300/0 conn(0x7fda9c15a480 0x7fda9c0ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.016+0000 7fda9b400640 1 -- 172.21.15.55:0/1867921064 >> v1:172.21.15.55:6789/0 conn(0x7fda9c0ca9a0 legacy=0x7fda9c0b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:00.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.016+0000 7fda9b400640 1 -- 172.21.15.55:0/1867921064 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda9c0cb570 con 0x7fda9c0b1070 2024-04-02T07:23:00.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.016+0000 7fda9aa00640 1 --2- 172.21.15.55:0/1867921064 >> v2:172.21.15.106:3300/0 conn(0x7fda9c15a480 0x7fda9c0ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:23:00.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.016+0000 7fda9b400640 1 --2- 172.21.15.55:0/1867921064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda9c0b1070 0x7fda9c0c8f10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fda94009d90 tx=0x7fda9401c970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a680f90da0bc9e62 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fda9a000640 1 -- 172.21.15.55:0/1867921064 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda940a5920 con 0x7fda9c0b1070 2024-04-02T07:23:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fda9a000640 1 -- 172.21.15.55:0/1867921064 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda940a5a80 con 0x7fda9c0b1070 2024-04-02T07:23:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fda9a000640 1 -- 172.21.15.55:0/1867921064 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda940a5df0 con 0x7fda9c0b1070 2024-04-02T07:23:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fdaa1e00640 1 -- 172.21.15.55:0/1867921064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda9c0b1070 msgr2=0x7fda9c0c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fdaa1e00640 1 --2- 172.21.15.55:0/1867921064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda9c0b1070 0x7fda9c0c8f10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fda94009d90 tx=0x7fda9401c970 comp rx=0 tx=0).stop 2024-04-02T07:23:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fdaa1e00640 1 -- 172.21.15.55:0/1867921064 shutdown_connections 2024-04-02T07:23:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fdaa1e00640 1 --2- 172.21.15.55:0/1867921064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda9c0b1070 0x7fda9c0c8f10 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fdaa1e00640 1 --2- 172.21.15.55:0/1867921064 >> v2:172.21.15.106:3300/0 conn(0x7fda9c15a480 0x7fda9c0ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fdaa1e00640 1 -- 172.21.15.55:0/1867921064 >> 172.21.15.55:0/1867921064 conn(0x7fda9c066080 msgr2=0x7fda9c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:00.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fdaa1e00640 1 -- 172.21.15.55:0/1867921064 shutdown_connections 2024-04-02T07:23:00.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fdaa1e00640 1 -- 172.21.15.55:0/1867921064 wait complete. 2024-04-02T07:23:00.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fdaa1e00640 1 Processor -- start 2024-04-02T07:23:00.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fdaa1e00640 1 -- start start 2024-04-02T07:23:00.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fdaa1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda9c0b1070 0x7fda9c145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:00.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fdaa1e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda9c0ca9a0 0x7fda9c15c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:00.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fdaa1e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda9c15a480 0x7fda9c0704b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:00.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fdaa1e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c14dab0 con 0x7fda9c0b1070 2024-04-02T07:23:00.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fdaa1e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c145c50 con 0x7fda9c0ca9a0 2024-04-02T07:23:00.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fdaa1e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda9c15b4d0 con 0x7fda9c15a480 2024-04-02T07:23:00.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fda9aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda9c0b1070 0x7fda9c145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:00.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fda9aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda9c0b1070 0x7fda9c145710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43492/0 (socket says 172.21.15.55:43492) 2024-04-02T07:23:00.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fda9aa00640 1 -- 172.21.15.55:0/2430507637 learned_addr learned my addr 172.21.15.55:0/2430507637 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:00.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fda93e00640 1 --2- 172.21.15.55:0/2430507637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda9c0ca9a0 0x7fda9c15c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:00.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.020+0000 7fda9b400640 1 --2- 172.21.15.55:0/2430507637 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda9c15a480 0x7fda9c0704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:00.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.024+0000 7fda9aa00640 1 -- 172.21.15.55:0/2430507637 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda9c15a480 msgr2=0x7fda9c0704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:00.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.024+0000 7fda9aa00640 1 --2- 172.21.15.55:0/2430507637 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda9c15a480 0x7fda9c0704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.024+0000 7fda9aa00640 1 -- 172.21.15.55:0/2430507637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda9c0ca9a0 msgr2=0x7fda9c15c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:00.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.024+0000 7fda9aa00640 1 --2- 172.21.15.55:0/2430507637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda9c0ca9a0 0x7fda9c15c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.024+0000 7fda9aa00640 1 -- 172.21.15.55:0/2430507637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda8c009420 con 0x7fda9c0b1070 2024-04-02T07:23:00.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.024+0000 7fda9b400640 1 --2- 172.21.15.55:0/2430507637 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda9c15a480 0x7fda9c0704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:00.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.024+0000 7fda9aa00640 1 --2- 172.21.15.55:0/2430507637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda9c0b1070 0x7fda9c145710 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00e9b0 tx=0x7fda8c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:00.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.024+0000 7fda93400640 1 -- 172.21.15.55:0/2430507637 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c00ca00 con 0x7fda9c0b1070 2024-04-02T07:23:00.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.024+0000 7fda93400640 1 -- 172.21.15.55:0/2430507637 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8c00cb60 con 0x7fda9c0b1070 2024-04-02T07:23:00.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.024+0000 7fda93400640 1 -- 172.21.15.55:0/2430507637 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8c013470 con 0x7fda9c0b1070 2024-04-02T07:23:00.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.024+0000 7fdaa1e00640 1 -- 172.21.15.55:0/2430507637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda94009a70 con 0x7fda9c0b1070 2024-04-02T07:23:00.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.024+0000 7fdaa1e00640 1 -- 172.21.15.55:0/2430507637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda9c15bce0 con 0x7fda9c0b1070 2024-04-02T07:23:00.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.024+0000 7fdaa1e00640 1 -- 172.21.15.55:0/2430507637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda9c15c8a0 con 0x7fda9c0b1070 2024-04-02T07:23:00.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.024+0000 7fda93400640 1 -- 172.21.15.55:0/2430507637 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fda8c0135d0 con 0x7fda9c0b1070 2024-04-02T07:23:00.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.024+0000 7fda93400640 1 --2- 172.21.15.55:0/2430507637 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fda780666c0 0x7fda78068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:00.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.024+0000 7fda93400640 1 -- 172.21.15.55:0/2430507637 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fda8c084410 con 0x7fda9c0b1070 2024-04-02T07:23:00.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.028+0000 7fda93e00640 1 --2- 172.21.15.55:0/2430507637 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fda780666c0 0x7fda78068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:00.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.028+0000 7fda93e00640 1 --2- 172.21.15.55:0/2430507637 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fda780666c0 0x7fda78068b80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fda9c1462d0 tx=0x7fda84009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:00.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.028+0000 7fda93400640 1 -- 172.21.15.55:0/2430507637 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fda8c0516f0 con 0x7fda9c0b1070 2024-04-02T07:23:00.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.192+0000 7fdaa1e00640 1 -- 172.21.15.55:0/2430507637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda9c066c90 con 0x7fda9c0b1070 2024-04-02T07:23:00.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.192+0000 7fda93400640 1 -- 172.21.15.55:0/2430507637 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+16287 (secure 0 0 0) 0x7fda8c054d10 con 0x7fda9c0b1070 2024-04-02T07:23:00.199 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:00.199 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":21,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:22:59.183394+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:23:00.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.196+0000 7fdaa1e00640 1 -- 172.21.15.55:0/2430507637 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fda780666c0 msgr2=0x7fda78068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:00.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.196+0000 7fdaa1e00640 1 --2- 172.21.15.55:0/2430507637 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fda780666c0 0x7fda78068b80 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fda9c1462d0 tx=0x7fda84009040 comp rx=0 tx=0).stop 2024-04-02T07:23:00.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.196+0000 7fdaa1e00640 1 -- 172.21.15.55:0/2430507637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda9c0b1070 msgr2=0x7fda9c145710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:00.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.196+0000 7fdaa1e00640 1 --2- 172.21.15.55:0/2430507637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda9c0b1070 0x7fda9c145710 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fda8c00e9b0 tx=0x7fda8c00ee70 comp rx=0 tx=0).stop 2024-04-02T07:23:00.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.196+0000 7fdaa1e00640 1 -- 172.21.15.55:0/2430507637 shutdown_connections 2024-04-02T07:23:00.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.196+0000 7fdaa1e00640 1 --2- 172.21.15.55:0/2430507637 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fda9c15a480 0x7fda9c0704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.196+0000 7fdaa1e00640 1 --2- 172.21.15.55:0/2430507637 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fda780666c0 0x7fda78068b80 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.196+0000 7fdaa1e00640 1 --2- 172.21.15.55:0/2430507637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fda9c0ca9a0 0x7fda9c15c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.196+0000 7fdaa1e00640 1 --2- 172.21.15.55:0/2430507637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda9c0b1070 0x7fda9c145710 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.196+0000 7fdaa1e00640 1 -- 172.21.15.55:0/2430507637 >> 172.21.15.55:0/2430507637 conn(0x7fda9c066080 msgr2=0x7fda9c0715f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:00.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.196+0000 7fdaa1e00640 1 -- 172.21.15.55:0/2430507637 shutdown_connections 2024-04-02T07:23:00.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.196+0000 7fdaa1e00640 1 -- 172.21.15.55:0/2430507637 wait complete. 2024-04-02T07:23:00.223 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:22:16.738297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:22:17.190496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:23:00.223 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:23:00.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.360+0000 7f1079e00640 1 Processor -- start 2024-04-02T07:23:00.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.360+0000 7f1079e00640 1 -- start start 2024-04-02T07:23:00.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.360+0000 7f1079e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f107415dc80 0x7f107406aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:00.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.360+0000 7f1079e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f107406b3e0 0x7f107415f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:00.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.360+0000 7f1079e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10740cec60 con 0x7f1074098a10 2024-04-02T07:23:00.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.360+0000 7f1079e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10740d0100 con 0x7f107415dc80 2024-04-02T07:23:00.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.360+0000 7f1079e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f107415d2c0 con 0x7f107406b3e0 2024-04-02T07:23:00.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.364+0000 7f106a000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f107415dc80 0x7f107406aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:00.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.364+0000 7f106a000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f107415dc80 0x7f107406aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43498/0 (socket says 172.21.15.55:43498) 2024-04-02T07:23:00.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.364+0000 7f106a000640 1 -- 172.21.15.55:0/480316439 learned_addr learned my addr 172.21.15.55:0/480316439 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:00.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.364+0000 7f1073400640 1 --2- 172.21.15.55:0/480316439 >> v2:172.21.15.106:3300/0 conn(0x7f107406b3e0 0x7f107415f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:00.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.364+0000 7f106a000640 1 -- 172.21.15.55:0/480316439 >> v2:172.21.15.106:3300/0 conn(0x7f107406b3e0 msgr2=0x7f107415f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:00.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.364+0000 7f106a000640 1 --2- 172.21.15.55:0/480316439 >> v2:172.21.15.106:3300/0 conn(0x7f107406b3e0 0x7f107415f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.364+0000 7f106a000640 1 -- 172.21.15.55:0/480316439 >> v1:172.21.15.106:6789/0 conn(0x7f1074098a10 legacy=0x7f1074098df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:00.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.364+0000 7f106a000640 1 -- 172.21.15.55:0/480316439 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f107406ba10 con 0x7f107415dc80 2024-04-02T07:23:00.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.364+0000 7f1073400640 1 --2- 172.21.15.55:0/480316439 >> v2:172.21.15.106:3300/0 conn(0x7f107406b3e0 0x7f107415f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:23:00.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.364+0000 7f106a000640 1 --2- 172.21.15.55:0/480316439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f107415dc80 0x7f107406aea0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f10740b2180 tx=0x7f105c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a951a2e7b81c70c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:00.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.364+0000 7f1072000640 1 -- 172.21.15.55:0/480316439 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c0aa640 con 0x7f107415dc80 2024-04-02T07:23:00.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.364+0000 7f1072000640 1 -- 172.21.15.55:0/480316439 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c0aa7a0 con 0x7f107415dc80 2024-04-02T07:23:00.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.364+0000 7f1072000640 1 -- 172.21.15.55:0/480316439 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c0aab30 con 0x7f107415dc80 2024-04-02T07:23:00.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f1079e00640 1 -- 172.21.15.55:0/480316439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f107415dc80 msgr2=0x7f107406aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:00.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f1079e00640 1 --2- 172.21.15.55:0/480316439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f107415dc80 0x7f107406aea0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f10740b2180 tx=0x7f105c01c4e0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f1079e00640 1 -- 172.21.15.55:0/480316439 shutdown_connections 2024-04-02T07:23:00.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f1079e00640 1 --2- 172.21.15.55:0/480316439 >> v2:172.21.15.106:3300/0 conn(0x7f107406b3e0 0x7f107415f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f1079e00640 1 --2- 172.21.15.55:0/480316439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f107415dc80 0x7f107406aea0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f1079e00640 1 -- 172.21.15.55:0/480316439 >> 172.21.15.55:0/480316439 conn(0x7f10740b21d0 msgr2=0x7f10740b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:00.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f1079e00640 1 -- 172.21.15.55:0/480316439 shutdown_connections 2024-04-02T07:23:00.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f1079e00640 1 -- 172.21.15.55:0/480316439 wait complete. 2024-04-02T07:23:00.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f1079e00640 1 Processor -- start 2024-04-02T07:23:00.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f1079e00640 1 -- start start 2024-04-02T07:23:00.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f1079e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f107406b3e0 0x7f10740b5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:00.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f1079e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1074098a10 0x7f107415c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:00.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f1079e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10741f8e10 0x7f10741f9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:00.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f1079e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1074156ee0 con 0x7f1074098a10 2024-04-02T07:23:00.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f1079e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10740b6110 con 0x7f107406b3e0 2024-04-02T07:23:00.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f1079e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1074155b10 con 0x7f10741f8e10 2024-04-02T07:23:00.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f106a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1074098a10 0x7f107415c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:00.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f106a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1074098a10 0x7f107415c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43506/0 (socket says 172.21.15.55:43506) 2024-04-02T07:23:00.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f106a000640 1 -- 172.21.15.55:0/670199992 learned_addr learned my addr 172.21.15.55:0/670199992 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:00.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f1072a00640 1 --2- 172.21.15.55:0/670199992 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f107406b3e0 0x7f10740b5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:00.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f1073400640 1 --2- 172.21.15.55:0/670199992 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10741f8e10 0x7f10741f9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:00.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f106a000640 1 -- 172.21.15.55:0/670199992 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10741f8e10 msgr2=0x7f10741f9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:00.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f106a000640 1 --2- 172.21.15.55:0/670199992 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10741f8e10 0x7f10741f9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f106a000640 1 -- 172.21.15.55:0/670199992 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f107406b3e0 msgr2=0x7f10740b5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:00.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f106a000640 1 --2- 172.21.15.55:0/670199992 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f107406b3e0 0x7f10740b5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.368+0000 7f106a000640 1 -- 172.21.15.55:0/670199992 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f105c0094d0 con 0x7f1074098a10 2024-04-02T07:23:00.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.372+0000 7f106a000640 1 --2- 172.21.15.55:0/670199992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1074098a10 0x7f107415c380 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f105c01a110 tx=0x7f105c01ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:00.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.372+0000 7f106be00640 1 -- 172.21.15.55:0/670199992 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c0bd5f0 con 0x7f1074098a10 2024-04-02T07:23:00.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.372+0000 7f106be00640 1 -- 172.21.15.55:0/670199992 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f105c0bd770 con 0x7f1074098a10 2024-04-02T07:23:00.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.372+0000 7f106be00640 1 -- 172.21.15.55:0/670199992 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f105c0bdb20 con 0x7f1074098a10 2024-04-02T07:23:00.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.372+0000 7f1079e00640 1 -- 172.21.15.55:0/670199992 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1074155df0 con 0x7f1074098a10 2024-04-02T07:23:00.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.372+0000 7f1079e00640 1 -- 172.21.15.55:0/670199992 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10741563b0 con 0x7f1074098a10 2024-04-02T07:23:00.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.372+0000 7f1079e00640 1 -- 172.21.15.55:0/670199992 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10740cf0d0 con 0x7f1074098a10 2024-04-02T07:23:00.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.372+0000 7f106be00640 1 -- 172.21.15.55:0/670199992 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f105c0a8050 con 0x7f1074098a10 2024-04-02T07:23:00.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.372+0000 7f106be00640 1 --2- 172.21.15.55:0/670199992 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1050066690 0x7f1050068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:00.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.372+0000 7f106be00640 1 -- 172.21.15.55:0/670199992 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f105c11e9d0 con 0x7f1074098a10 2024-04-02T07:23:00.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.372+0000 7f1072a00640 1 --2- 172.21.15.55:0/670199992 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1050066690 0x7f1050068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:00.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.376+0000 7f1072a00640 1 --2- 172.21.15.55:0/670199992 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1050066690 0x7f1050068b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1064005530 tx=0x7f1064009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:00.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.376+0000 7f106be00640 1 -- 172.21.15.55:0/670199992 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f10740cf0d0 con 0x7f1074098a10 2024-04-02T07:23:00.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.536+0000 7f1079e00640 1 -- 172.21.15.55:0/670199992 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10740cf0d0 con 0x7f1074098a10 2024-04-02T07:23:00.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.540+0000 7f106be00640 1 -- 172.21.15.55:0/670199992 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f10740cf0d0 con 0x7f1074098a10 2024-04-02T07:23:00.544 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:23:00.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.540+0000 7f1079e00640 1 -- 172.21.15.55:0/670199992 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1050066690 msgr2=0x7f1050068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:00.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.540+0000 7f1079e00640 1 --2- 172.21.15.55:0/670199992 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1050066690 0x7f1050068b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f1064005530 tx=0x7f1064009040 comp rx=0 tx=0).stop 2024-04-02T07:23:00.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.540+0000 7f1079e00640 1 -- 172.21.15.55:0/670199992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1074098a10 msgr2=0x7f107415c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:00.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.540+0000 7f1079e00640 1 --2- 172.21.15.55:0/670199992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1074098a10 0x7f107415c380 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f105c01a110 tx=0x7f105c01ad20 comp rx=0 tx=0).stop 2024-04-02T07:23:00.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.540+0000 7f1079e00640 1 -- 172.21.15.55:0/670199992 shutdown_connections 2024-04-02T07:23:00.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.540+0000 7f1079e00640 1 --2- 172.21.15.55:0/670199992 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10741f8e10 0x7f10741f9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.540+0000 7f1079e00640 1 --2- 172.21.15.55:0/670199992 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1074098a10 0x7f107415c380 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.540+0000 7f1079e00640 1 --2- 172.21.15.55:0/670199992 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1050066690 0x7f1050068b50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.540+0000 7f1079e00640 1 --2- 172.21.15.55:0/670199992 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f107406b3e0 0x7f10740b5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.540+0000 7f1079e00640 1 -- 172.21.15.55:0/670199992 >> 172.21.15.55:0/670199992 conn(0x7f10740b21d0 msgr2=0x7f10740cdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:00.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.540+0000 7f1079e00640 1 -- 172.21.15.55:0/670199992 shutdown_connections 2024-04-02T07:23:00.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.540+0000 7f1079e00640 1 -- 172.21.15.55:0/670199992 wait complete. 2024-04-02T07:23:00.564 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:23:00.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.700+0000 7f8ac2400640 1 Processor -- start 2024-04-02T07:23:00.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.700+0000 7f8ac2400640 1 -- start start 2024-04-02T07:23:00.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8ac2400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8abc1590d0 0x7f8abc0ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:00.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8ac2400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc15d640 con 0x7f8abc15cb10 2024-04-02T07:23:00.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8ac2400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8abc15d920 con 0x7f8abc0709b0 2024-04-02T07:23:00.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8ac2400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8abc0cd4e0 con 0x7f8abc1590d0 2024-04-02T07:23:00.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8ab2a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8abc15cb10 0x7f8abc0702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43830/0 (socket says 172.21.15.55:43830) 2024-04-02T07:23:00.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8ab2a00640 1 -- 172.21.15.55:0/3595786931 learned_addr learned my addr 172.21.15.55:0/3595786931 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8abb400640 1 --2- 172.21.15.55:0/3595786931 >> v2:172.21.15.106:3300/0 conn(0x7f8abc1590d0 0x7f8abc0ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8abaa00640 1 -- 172.21.15.55:0/3595786931 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 443125212 0 0) 0x7f8abc15d640 con 0x7f8abc15cb10 2024-04-02T07:23:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8abaa00640 1 -- 172.21.15.55:0/3595786931 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8aa0003530 con 0x7f8abc15cb10 2024-04-02T07:23:00.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8abaa00640 1 -- 172.21.15.55:0/3595786931 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4159614545 0 0) 0x7f8aa0003530 con 0x7f8abc15cb10 2024-04-02T07:23:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8abaa00640 1 -- 172.21.15.55:0/3595786931 >> v2:172.21.15.106:3300/0 conn(0x7f8abc1590d0 msgr2=0x7f8abc0ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8abaa00640 1 --2- 172.21.15.55:0/3595786931 >> v2:172.21.15.106:3300/0 conn(0x7f8abc1590d0 0x7f8abc0ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8abaa00640 1 -- 172.21.15.55:0/3595786931 >> v1:172.21.15.106:6789/0 conn(0x7f8abc0709b0 legacy=0x7f8abc0b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8abaa00640 1 -- 172.21.15.55:0/3595786931 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc0cc4c0 con 0x7f8abc15cb10 2024-04-02T07:23:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8abaa00640 1 -- 172.21.15.55:0/3595786931 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f8aa4001680 con 0x7f8abc15cb10 2024-04-02T07:23:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8abaa00640 1 -- 172.21.15.55:0/3595786931 >> v1:172.21.15.55:6789/0 conn(0x7f8abc15cb10 legacy=0x7f8abc0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8abaa00640 1 --2- 172.21.15.55:0/3595786931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8aa0003980 0x7f8aa0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:00.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8abaa00640 1 --2- 172.21.15.55:0/3595786931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa00047d0 0x7f8aa0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:00.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8abaa00640 1 --2- 172.21.15.55:0/3595786931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8aa0005190 0x7f8aa000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:00.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8abaa00640 1 -- 172.21.15.55:0/3595786931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0cd4e0 con 0x7f8aa00047d0 2024-04-02T07:23:00.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8abaa00640 1 -- 172.21.15.55:0/3595786931 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa000c130 con 0x7f8aa0003980 2024-04-02T07:23:00.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8abaa00640 1 -- 172.21.15.55:0/3595786931 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa000c2f0 con 0x7f8aa0005190 2024-04-02T07:23:00.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8ab2a00640 1 --2- 172.21.15.55:0/3595786931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa00047d0 0x7f8aa0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:00.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8abb400640 1 --2- 172.21.15.55:0/3595786931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8aa0003980 0x7f8aa0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:00.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8abbe00640 1 --2- 172.21.15.55:0/3595786931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8aa0005190 0x7f8aa000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:00.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8ab2a00640 1 -- 172.21.15.55:0/3595786931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8aa0005190 msgr2=0x7f8aa000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:00.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8ab2a00640 1 --2- 172.21.15.55:0/3595786931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8aa0005190 0x7f8aa000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8ab2a00640 1 -- 172.21.15.55:0/3595786931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8aa0003980 msgr2=0x7f8aa0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:00.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8ab2a00640 1 --2- 172.21.15.55:0/3595786931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8aa0003980 0x7f8aa0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8ab2a00640 1 -- 172.21.15.55:0/3595786931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa0003530 con 0x7f8aa00047d0 2024-04-02T07:23:00.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.704+0000 7f8abbe00640 1 -- 172.21.15.55:0/3595786931 reap_dead start 2024-04-02T07:23:00.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.708+0000 7f8ab2a00640 1 --2- 172.21.15.55:0/3595786931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa00047d0 0x7f8aa0004c50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400c240 tx=0x7f8aa401cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce876168fa1b005 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:00.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.708+0000 7f8abaa00640 1 -- 172.21.15.55:0/3595786931 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4005ae0 con 0x7f8aa00047d0 2024-04-02T07:23:00.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.708+0000 7f8abaa00640 1 -- 172.21.15.55:0/3595786931 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa4005c40 con 0x7f8aa00047d0 2024-04-02T07:23:00.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.708+0000 7f8abaa00640 1 -- 172.21.15.55:0/3595786931 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40a5a20 con 0x7f8aa00047d0 2024-04-02T07:23:00.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.708+0000 7f8ac2400640 1 -- 172.21.15.55:0/3595786931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa00047d0 msgr2=0x7f8aa0004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:00.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.708+0000 7f8ac2400640 1 --2- 172.21.15.55:0/3595786931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa00047d0 0x7f8aa0004c50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8aa400c240 tx=0x7f8aa401cbf0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.708+0000 7f8ac2400640 1 -- 172.21.15.55:0/3595786931 shutdown_connections 2024-04-02T07:23:00.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.708+0000 7f8ac2400640 1 --2- 172.21.15.55:0/3595786931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa00047d0 0x7f8aa0004c50 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.708+0000 7f8ac2400640 1 -- 172.21.15.55:0/3595786931 >> 172.21.15.55:0/3595786931 conn(0x7f8abc06a390 msgr2=0x7f8abc0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:00.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.708+0000 7f8ac2400640 1 -- 172.21.15.55:0/3595786931 shutdown_connections 2024-04-02T07:23:00.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.708+0000 7f8ac2400640 1 -- 172.21.15.55:0/3595786931 wait complete. 2024-04-02T07:23:00.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8ac2400640 1 Processor -- start 2024-04-02T07:23:00.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8ac2400640 1 -- start start 2024-04-02T07:23:00.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8ac2400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa00047d0 0x7f8abc15b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:00.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8ac2400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8abc0acf40 0x7f8abc0ad3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:00.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8ac2400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8abc155260 0x7f8abc1556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:00.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8ac2400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc155ee0 con 0x7f8aa00047d0 2024-04-02T07:23:00.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8ac2400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc144690 con 0x7f8abc0acf40 2024-04-02T07:23:00.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8ac2400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0ad900 con 0x7f8abc155260 2024-04-02T07:23:00.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8abb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa00047d0 0x7f8abc15b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:00.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8abb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa00047d0 0x7f8abc15b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43538/0 (socket says 172.21.15.55:43538) 2024-04-02T07:23:00.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8abb400640 1 -- 172.21.15.55:0/496683268 learned_addr learned my addr 172.21.15.55:0/496683268 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:00.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8abbe00640 1 --2- 172.21.15.55:0/496683268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8abc155260 0x7f8abc1556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:00.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8ab2a00640 1 --2- 172.21.15.55:0/496683268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8abc0acf40 0x7f8abc0ad3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:00.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8abb400640 1 -- 172.21.15.55:0/496683268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8abc155260 msgr2=0x7f8abc1556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:00.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8abb400640 1 --2- 172.21.15.55:0/496683268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8abc155260 0x7f8abc1556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8abb400640 1 -- 172.21.15.55:0/496683268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8abc0acf40 msgr2=0x7f8abc0ad3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:00.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8abb400640 1 --2- 172.21.15.55:0/496683268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8abc0acf40 0x7f8abc0ad3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8abb400640 1 -- 172.21.15.55:0/496683268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8abc0b1de0 con 0x7f8aa00047d0 2024-04-02T07:23:00.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8abbe00640 1 --2- 172.21.15.55:0/496683268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8abc155260 0x7f8abc1556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:00.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8ab2a00640 1 --2- 172.21.15.55:0/496683268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8abc0acf40 0x7f8abc0ad3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:00.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8abb400640 1 --2- 172.21.15.55:0/496683268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa00047d0 0x7f8abc15b5c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8aac011900 tx=0x7f8aac011dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:00.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8ab3e00640 1 -- 172.21.15.55:0/496683268 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac0095b0 con 0x7f8aa00047d0 2024-04-02T07:23:00.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8ab3e00640 1 -- 172.21.15.55:0/496683268 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aac004240 con 0x7f8aa00047d0 2024-04-02T07:23:00.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8ab3e00640 1 -- 172.21.15.55:0/496683268 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac00f880 con 0x7f8aa00047d0 2024-04-02T07:23:00.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8ac2400640 1 -- 172.21.15.55:0/496683268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8abc154650 con 0x7f8aa00047d0 2024-04-02T07:23:00.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8ac2400640 1 -- 172.21.15.55:0/496683268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc153d20 con 0x7f8aa00047d0 2024-04-02T07:23:00.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.712+0000 7f8ac2400640 1 -- 172.21.15.55:0/496683268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8abc073530 con 0x7f8aa00047d0 2024-04-02T07:23:00.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.716+0000 7f8ab3e00640 1 -- 172.21.15.55:0/496683268 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8aac00f9e0 con 0x7f8aa00047d0 2024-04-02T07:23:00.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.716+0000 7f8ab3e00640 1 --2- 172.21.15.55:0/496683268 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8a980666c0 0x7f8a98068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:00.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.716+0000 7f8ab3e00640 1 -- 172.21.15.55:0/496683268 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f8aac084820 con 0x7f8aa00047d0 2024-04-02T07:23:00.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.716+0000 7f8ab2a00640 1 --2- 172.21.15.55:0/496683268 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8a980666c0 0x7f8a98068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:00.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.716+0000 7f8ab2a00640 1 --2- 172.21.15.55:0/496683268 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8a980666c0 0x7f8a98068b80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40ab000 tx=0x7f8aa40a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:00.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.720+0000 7f8ab3e00640 1 -- 172.21.15.55:0/496683268 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f8aac051b00 con 0x7f8aa00047d0 2024-04-02T07:23:00.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.880+0000 7f8ac2400640 1 -- 172.21.15.55:0/496683268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8abc066c90 con 0x7f8aa00047d0 2024-04-02T07:23:00.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.880+0000 7f8ab3e00640 1 -- 172.21.15.55:0/496683268 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8aac019020 con 0x7f8aa00047d0 2024-04-02T07:23:00.885 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:23:00.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.880+0000 7f8ac2400640 1 -- 172.21.15.55:0/496683268 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8a980666c0 msgr2=0x7f8a98068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.880+0000 7f8ac2400640 1 --2- 172.21.15.55:0/496683268 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8a980666c0 0x7f8a98068b80 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8aa40ab000 tx=0x7f8aa40a7070 comp rx=0 tx=0).stop 2024-04-02T07:23:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.880+0000 7f8ac2400640 1 -- 172.21.15.55:0/496683268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa00047d0 msgr2=0x7f8abc15b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.880+0000 7f8ac2400640 1 --2- 172.21.15.55:0/496683268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa00047d0 0x7f8abc15b5c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f8aac011900 tx=0x7f8aac011dc0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.880+0000 7f8ac2400640 1 -- 172.21.15.55:0/496683268 shutdown_connections 2024-04-02T07:23:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.880+0000 7f8ac2400640 1 --2- 172.21.15.55:0/496683268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8abc155260 0x7f8abc1556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.880+0000 7f8ac2400640 1 --2- 172.21.15.55:0/496683268 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8a980666c0 0x7f8a98068b80 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.880+0000 7f8ac2400640 1 --2- 172.21.15.55:0/496683268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8abc0acf40 0x7f8abc0ad3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.880+0000 7f8ac2400640 1 --2- 172.21.15.55:0/496683268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8aa00047d0 0x7f8abc15b5c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:00.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.880+0000 7f8ac2400640 1 -- 172.21.15.55:0/496683268 >> 172.21.15.55:0/496683268 conn(0x7f8abc06a390 msgr2=0x7f8abc0ae2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:00.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.880+0000 7f8ac2400640 1 -- 172.21.15.55:0/496683268 shutdown_connections 2024-04-02T07:23:00.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:00.880+0000 7f8ac2400640 1 -- 172.21.15.55:0/496683268 wait complete. 2024-04-02T07:23:00.905 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:23:01.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.044+0000 7f0366200640 1 Processor -- start 2024-04-02T07:23:01.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.044+0000 7f0366200640 1 -- start start 2024-04-02T07:23:01.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.044+0000 7f0366200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f036015de50 0x7f03600cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:01.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.044+0000 7f0366200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0360099120 0x7f03600cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.044+0000 7f0366200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03600afbc0 con 0x7f036015e230 2024-04-02T07:23:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.044+0000 7f0366200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0360099be0 con 0x7f0360099120 2024-04-02T07:23:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.044+0000 7f0366200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03600cf740 con 0x7f036015de50 2024-04-02T07:23:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.044+0000 7f035fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0360099120 0x7f03600cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.044+0000 7f035ea00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f036015e230 0x7f0360098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43838/0 (socket says 172.21.15.55:43838) 2024-04-02T07:23:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.044+0000 7f035ea00640 1 -- 172.21.15.55:0/1230784680 learned_addr learned my addr 172.21.15.55:0/1230784680 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.044+0000 7f035f400640 1 --2- 172.21.15.55:0/1230784680 >> v2:172.21.15.106:3300/0 conn(0x7f036015de50 0x7f03600cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.044+0000 7f035fe00640 1 -- 172.21.15.55:0/1230784680 >> v2:172.21.15.106:3300/0 conn(0x7f036015de50 msgr2=0x7f03600cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.044+0000 7f035fe00640 1 --2- 172.21.15.55:0/1230784680 >> v2:172.21.15.106:3300/0 conn(0x7f036015de50 0x7f03600cebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.044+0000 7f035fe00640 1 -- 172.21.15.55:0/1230784680 >> v1:172.21.15.55:6789/0 conn(0x7f036015e230 legacy=0x7f0360098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.044+0000 7f035e000640 1 -- 172.21.15.55:0/1230784680 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 788961067 0 0) 0x7f03600afbc0 con 0x7f036015e230 2024-04-02T07:23:01.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.044+0000 7f035fe00640 1 -- 172.21.15.55:0/1230784680 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03600afe10 con 0x7f0360099120 2024-04-02T07:23:01.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.048+0000 7f035fe00640 1 --2- 172.21.15.55:0/1230784680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360099120 0x7f03600cf130 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f036009a1b0 tx=0x7f035801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0f22520ef3a807 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:01.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.048+0000 7f035e000640 1 -- 172.21.15.55:0/1230784680 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03580a5740 con 0x7f0360099120 2024-04-02T07:23:01.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.048+0000 7f035e000640 1 -- 172.21.15.55:0/1230784680 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03580a58a0 con 0x7f0360099120 2024-04-02T07:23:01.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.048+0000 7f035e000640 1 -- 172.21.15.55:0/1230784680 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03580a5c30 con 0x7f0360099120 2024-04-02T07:23:01.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.048+0000 7f0366200640 1 -- 172.21.15.55:0/1230784680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360099120 msgr2=0x7f03600cf130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:01.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.048+0000 7f0366200640 1 --2- 172.21.15.55:0/1230784680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360099120 0x7f03600cf130 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f036009a1b0 tx=0x7f035801c8a0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.048+0000 7f0366200640 1 -- 172.21.15.55:0/1230784680 shutdown_connections 2024-04-02T07:23:01.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.048+0000 7f0366200640 1 --2- 172.21.15.55:0/1230784680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360099120 0x7f03600cf130 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.048+0000 7f0366200640 1 --2- 172.21.15.55:0/1230784680 >> v2:172.21.15.106:3300/0 conn(0x7f036015de50 0x7f03600cebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.048+0000 7f0366200640 1 -- 172.21.15.55:0/1230784680 >> 172.21.15.55:0/1230784680 conn(0x7f03600b2150 msgr2=0x7f03600b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.048+0000 7f0366200640 1 -- 172.21.15.55:0/1230784680 shutdown_connections 2024-04-02T07:23:01.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.048+0000 7f0366200640 1 -- 172.21.15.55:0/1230784680 wait complete. 2024-04-02T07:23:01.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.048+0000 7f0366200640 1 Processor -- start 2024-04-02T07:23:01.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.048+0000 7f0366200640 1 -- start start 2024-04-02T07:23:01.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f0366200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360099120 0x7f036014ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:01.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f0366200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f036015de50 0x7f0360151de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:01.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f0366200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0360152320 0x7f03600cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:01.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f0366200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03601f8bc0 con 0x7f0360099120 2024-04-02T07:23:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f0366200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036014b060 con 0x7f036015de50 2024-04-02T07:23:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f0366200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03601f82d0 con 0x7f0360152320 2024-04-02T07:23:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f035f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360099120 0x7f036014ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f035f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360099120 0x7f036014ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43558/0 (socket says 172.21.15.55:43558) 2024-04-02T07:23:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f035f400640 1 -- 172.21.15.55:0/371300409 learned_addr learned my addr 172.21.15.55:0/371300409 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f035ea00640 1 --2- 172.21.15.55:0/371300409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f036015de50 0x7f0360151de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f035f400640 1 -- 172.21.15.55:0/371300409 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0360152320 msgr2=0x7f03600cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f035f400640 1 --2- 172.21.15.55:0/371300409 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0360152320 0x7f03600cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f035f400640 1 -- 172.21.15.55:0/371300409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f036015de50 msgr2=0x7f0360151de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f035f400640 1 --2- 172.21.15.55:0/371300409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f036015de50 0x7f0360151de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f035f400640 1 -- 172.21.15.55:0/371300409 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0358009a70 con 0x7f0360099120 2024-04-02T07:23:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f035ea00640 1 --2- 172.21.15.55:0/371300409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f036015de50 0x7f0360151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:23:01.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f035f400640 1 --2- 172.21.15.55:0/371300409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360099120 0x7f036014ab20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f035000d830 tx=0x7f035000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:01.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f0357400640 1 -- 172.21.15.55:0/371300409 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035000b6c0 con 0x7f0360099120 2024-04-02T07:23:01.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f0357400640 1 -- 172.21.15.55:0/371300409 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f035000b820 con 0x7f0360099120 2024-04-02T07:23:01.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f0357400640 1 -- 172.21.15.55:0/371300409 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035000bb90 con 0x7f0360099120 2024-04-02T07:23:01.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f0366200640 1 -- 172.21.15.55:0/371300409 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03601f8570 con 0x7f0360099120 2024-04-02T07:23:01.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f0366200640 1 -- 172.21.15.55:0/371300409 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0360157070 con 0x7f0360099120 2024-04-02T07:23:01.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f0366200640 1 -- 172.21.15.55:0/371300409 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03600723d0 con 0x7f0360099120 2024-04-02T07:23:01.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.052+0000 7f0357400640 1 -- 172.21.15.55:0/371300409 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f035001e460 con 0x7f0360099120 2024-04-02T07:23:01.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.056+0000 7f0357400640 1 --2- 172.21.15.55:0/371300409 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f03400666c0 0x7f0340068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:01.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.056+0000 7f0357400640 1 -- 172.21.15.55:0/371300409 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f0350084a10 con 0x7f0360099120 2024-04-02T07:23:01.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.056+0000 7f035ea00640 1 --2- 172.21.15.55:0/371300409 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f03400666c0 0x7f0340068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:01.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.056+0000 7f035ea00640 1 --2- 172.21.15.55:0/371300409 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f03400666c0 0x7f0340068b80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f034c007fd0 tx=0x7f034c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:01.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.060+0000 7f0357400640 1 -- 172.21.15.55:0/371300409 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0350051c60 con 0x7f0360099120 2024-04-02T07:23:01.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.220+0000 7f0366200640 1 -- 172.21.15.55:0/371300409 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0360066c90 con 0x7f0360099120 2024-04-02T07:23:01.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.220+0000 7f0357400640 1 -- 172.21.15.55:0/371300409 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0350055280 con 0x7f0360099120 2024-04-02T07:23:01.225 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:23:01.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.220+0000 7f0366200640 1 -- 172.21.15.55:0/371300409 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f03400666c0 msgr2=0x7f0340068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:01.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.220+0000 7f0366200640 1 --2- 172.21.15.55:0/371300409 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f03400666c0 0x7f0340068b80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f034c007fd0 tx=0x7f034c009040 comp rx=0 tx=0).stop 2024-04-02T07:23:01.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.220+0000 7f0366200640 1 -- 172.21.15.55:0/371300409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360099120 msgr2=0x7f036014ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:01.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.220+0000 7f0366200640 1 --2- 172.21.15.55:0/371300409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360099120 0x7f036014ab20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f035000d830 tx=0x7f035000dcf0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.220+0000 7f0366200640 1 -- 172.21.15.55:0/371300409 shutdown_connections 2024-04-02T07:23:01.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.220+0000 7f0366200640 1 --2- 172.21.15.55:0/371300409 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0360152320 0x7f03600cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.220+0000 7f0366200640 1 --2- 172.21.15.55:0/371300409 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f03400666c0 0x7f0340068b80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.220+0000 7f0366200640 1 --2- 172.21.15.55:0/371300409 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f036015de50 0x7f0360151de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.220+0000 7f0366200640 1 --2- 172.21.15.55:0/371300409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360099120 0x7f036014ab20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.220+0000 7f0366200640 1 -- 172.21.15.55:0/371300409 >> 172.21.15.55:0/371300409 conn(0x7f03600b2150 msgr2=0x7f03600cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:01.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.220+0000 7f0366200640 1 -- 172.21.15.55:0/371300409 shutdown_connections 2024-04-02T07:23:01.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.220+0000 7f0366200640 1 -- 172.21.15.55:0/371300409 wait complete. 2024-04-02T07:23:01.246 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:23:01.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.380+0000 7fc57c400640 1 Processor -- start 2024-04-02T07:23:01.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.384+0000 7fc57c400640 1 -- start start 2024-04-02T07:23:01.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.384+0000 7fc57c400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc57415cd50 0x7fc5740cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:01.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.384+0000 7fc57c400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc57406bac0 0x7fc574098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:01.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.384+0000 7fc57c400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc574098f50 0x7fc5740b5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:01.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.384+0000 7fc57c400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5740993e0 con 0x7fc574098f50 2024-04-02T07:23:01.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.384+0000 7fc57c400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc57406c2a0 con 0x7fc57415cd50 2024-04-02T07:23:01.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.384+0000 7fc57c400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5740cad60 con 0x7fc57406bac0 2024-04-02T07:23:01.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.384+0000 7fc57a400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc574098f50 0x7fc5740b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:01.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.384+0000 7fc57a400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc574098f50 0x7fc5740b5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43568/0 (socket says 172.21.15.55:43568) 2024-04-02T07:23:01.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.384+0000 7fc57a400640 1 -- 172.21.15.55:0/3311720067 learned_addr learned my addr 172.21.15.55:0/3311720067 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:01.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.384+0000 7fc579000640 1 --2- 172.21.15.55:0/3311720067 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc57406bac0 0x7fc574098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:01.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.384+0000 7fc579a00640 1 --2- 172.21.15.55:0/3311720067 >> v2:172.21.15.106:3300/0 conn(0x7fc57415cd50 0x7fc5740cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:01.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.384+0000 7fc57a400640 1 -- 172.21.15.55:0/3311720067 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc57406bac0 msgr2=0x7fc574098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:01.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.384+0000 7fc57a400640 1 --2- 172.21.15.55:0/3311720067 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc57406bac0 0x7fc574098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.384+0000 7fc57a400640 1 -- 172.21.15.55:0/3311720067 >> v2:172.21.15.106:3300/0 conn(0x7fc57415cd50 msgr2=0x7fc5740cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:01.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.384+0000 7fc57a400640 1 --2- 172.21.15.55:0/3311720067 >> v2:172.21.15.106:3300/0 conn(0x7fc57415cd50 0x7fc5740cfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.384+0000 7fc57a400640 1 -- 172.21.15.55:0/3311720067 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5740cb040 con 0x7fc574098f50 2024-04-02T07:23:01.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.384+0000 7fc579a00640 1 --2- 172.21.15.55:0/3311720067 >> v2:172.21.15.106:3300/0 conn(0x7fc57415cd50 0x7fc5740cfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:01.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.388+0000 7fc57a400640 1 --2- 172.21.15.55:0/3311720067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc574098f50 0x7fc5740b5880 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc57406e210 tx=0x7fc56c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c260676b84cd3f72 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:01.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.388+0000 7fc573e00640 1 -- 172.21.15.55:0/3311720067 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c0a57b0 con 0x7fc574098f50 2024-04-02T07:23:01.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.388+0000 7fc573e00640 1 -- 172.21.15.55:0/3311720067 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56c0a5910 con 0x7fc574098f50 2024-04-02T07:23:01.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.388+0000 7fc573e00640 1 -- 172.21.15.55:0/3311720067 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56c0a5ca0 con 0x7fc574098f50 2024-04-02T07:23:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.388+0000 7fc57c400640 1 -- 172.21.15.55:0/3311720067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc574098f50 msgr2=0x7fc5740b5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.388+0000 7fc57c400640 1 --2- 172.21.15.55:0/3311720067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc574098f50 0x7fc5740b5880 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fc57406e210 tx=0x7fc56c01c930 comp rx=0 tx=0).stop 2024-04-02T07:23:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.388+0000 7fc57c400640 1 -- 172.21.15.55:0/3311720067 shutdown_connections 2024-04-02T07:23:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.388+0000 7fc57c400640 1 --2- 172.21.15.55:0/3311720067 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc574098f50 0x7fc5740b5880 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.388+0000 7fc57c400640 1 --2- 172.21.15.55:0/3311720067 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc57406bac0 0x7fc574098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.388+0000 7fc57c400640 1 --2- 172.21.15.55:0/3311720067 >> v2:172.21.15.106:3300/0 conn(0x7fc57415cd50 0x7fc5740cfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.388+0000 7fc57c400640 1 -- 172.21.15.55:0/3311720067 >> 172.21.15.55:0/3311720067 conn(0x7fc5740b2160 msgr2=0x7fc5740b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.388+0000 7fc57c400640 1 -- 172.21.15.55:0/3311720067 shutdown_connections 2024-04-02T07:23:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.388+0000 7fc57c400640 1 -- 172.21.15.55:0/3311720067 wait complete. 2024-04-02T07:23:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.388+0000 7fc57c400640 1 Processor -- start 2024-04-02T07:23:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.388+0000 7fc57c400640 1 -- start start 2024-04-02T07:23:01.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc57c400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc57406bac0 0x7fc5740c51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:01.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc57c400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc574098f50 0x7fc5741f9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:01.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc57c400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc57415cd50 0x7fc5740c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:01.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc57c400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57409a3f0 con 0x7fc574098f50 2024-04-02T07:23:01.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc57c400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5740c8400 con 0x7fc57415cd50 2024-04-02T07:23:01.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc57c400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57409da00 con 0x7fc57406bac0 2024-04-02T07:23:01.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc579000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc574098f50 0x7fc5741f9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc579000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc574098f50 0x7fc5741f9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43582/0 (socket says 172.21.15.55:43582) 2024-04-02T07:23:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc579000640 1 -- 172.21.15.55:0/4104296935 learned_addr learned my addr 172.21.15.55:0/4104296935 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc579a00640 1 --2- 172.21.15.55:0/4104296935 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc57406bac0 0x7fc5740c51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc57a400640 1 --2- 172.21.15.55:0/4104296935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc57415cd50 0x7fc5740c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc579000640 1 -- 172.21.15.55:0/4104296935 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc57406bac0 msgr2=0x7fc5740c51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc579000640 1 --2- 172.21.15.55:0/4104296935 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc57406bac0 0x7fc5740c51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc579000640 1 -- 172.21.15.55:0/4104296935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc57415cd50 msgr2=0x7fc5740c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc579000640 1 --2- 172.21.15.55:0/4104296935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc57415cd50 0x7fc5740c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc579000640 1 -- 172.21.15.55:0/4104296935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc56c009b30 con 0x7fc574098f50 2024-04-02T07:23:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc579000640 1 --2- 172.21.15.55:0/4104296935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc574098f50 0x7fc5741f9660 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc56000e8e0 tx=0x7fc56000eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc571600640 1 -- 172.21.15.55:0/4104296935 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc56000ca00 con 0x7fc574098f50 2024-04-02T07:23:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc571600640 1 -- 172.21.15.55:0/4104296935 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc56000cb60 con 0x7fc574098f50 2024-04-02T07:23:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc571600640 1 -- 172.21.15.55:0/4104296935 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560013470 con 0x7fc574098f50 2024-04-02T07:23:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc57c400640 1 -- 172.21.15.55:0/4104296935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5741f9ba0 con 0x7fc574098f50 2024-04-02T07:23:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc57c400640 1 -- 172.21.15.55:0/4104296935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57409a920 con 0x7fc574098f50 2024-04-02T07:23:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc57c400640 1 -- 172.21.15.55:0/4104296935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc574066c90 con 0x7fc574098f50 2024-04-02T07:23:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.392+0000 7fc571600640 1 -- 172.21.15.55:0/4104296935 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc5600135d0 con 0x7fc574098f50 2024-04-02T07:23:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.396+0000 7fc571600640 1 --2- 172.21.15.55:0/4104296935 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc5540666c0 0x7fc554068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.396+0000 7fc571600640 1 -- 172.21.15.55:0/4104296935 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fc5600843b0 con 0x7fc574098f50 2024-04-02T07:23:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.396+0000 7fc579a00640 1 --2- 172.21.15.55:0/4104296935 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc5540666c0 0x7fc554068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:01.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.396+0000 7fc579a00640 1 --2- 172.21.15.55:0/4104296935 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc5540666c0 0x7fc554068b80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc5680045f0 tx=0x7fc568008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.400+0000 7fc571600640 1 -- 172.21.15.55:0/4104296935 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc560051740 con 0x7fc574098f50 2024-04-02T07:23:01.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.572+0000 7fc57c400640 1 -- 172.21.15.55:0/4104296935 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc5740ca540 con 0x7fc574098f50 2024-04-02T07:23:01.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.572+0000 7fc571600640 1 -- 172.21.15.55:0/4104296935 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc560054d60 con 0x7fc574098f50 2024-04-02T07:23:01.579 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:23:01.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.576+0000 7fc57c400640 1 -- 172.21.15.55:0/4104296935 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc5540666c0 msgr2=0x7fc554068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:01.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.576+0000 7fc57c400640 1 --2- 172.21.15.55:0/4104296935 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc5540666c0 0x7fc554068b80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc5680045f0 tx=0x7fc568008040 comp rx=0 tx=0).stop 2024-04-02T07:23:01.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.576+0000 7fc57c400640 1 -- 172.21.15.55:0/4104296935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc574098f50 msgr2=0x7fc5741f9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:01.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.576+0000 7fc57c400640 1 --2- 172.21.15.55:0/4104296935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc574098f50 0x7fc5741f9660 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fc56000e8e0 tx=0x7fc56000eda0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.576+0000 7fc57c400640 1 -- 172.21.15.55:0/4104296935 shutdown_connections 2024-04-02T07:23:01.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.576+0000 7fc57c400640 1 --2- 172.21.15.55:0/4104296935 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc5540666c0 0x7fc554068b80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.576+0000 7fc57c400640 1 --2- 172.21.15.55:0/4104296935 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc57415cd50 0x7fc5740c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.576+0000 7fc57c400640 1 --2- 172.21.15.55:0/4104296935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc574098f50 0x7fc5741f9660 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.576+0000 7fc57c400640 1 --2- 172.21.15.55:0/4104296935 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc57406bac0 0x7fc5740c51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.576+0000 7fc57c400640 1 -- 172.21.15.55:0/4104296935 >> 172.21.15.55:0/4104296935 conn(0x7fc5740b2160 msgr2=0x7fc57406fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:01.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.576+0000 7fc57c400640 1 -- 172.21.15.55:0/4104296935 shutdown_connections 2024-04-02T07:23:01.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.576+0000 7fc57c400640 1 -- 172.21.15.55:0/4104296935 wait complete. 2024-04-02T07:23:01.600 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi055.front.sepia.ceph.com... 2024-04-02T07:23:01.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:01.600 DEBUG:teuthology.orchestra.run.smithi055:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-04-02T07:23:01.620 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:23:01.621 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:23:01.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:01.621 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-02T07:23:01.676 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:23:01.676 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:23:01.685 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:23:01.685 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:23:01.737 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:23:01.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.872+0000 7f0604600640 1 Processor -- start 2024-04-02T07:23:01.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.872+0000 7f0604600640 1 -- start start 2024-04-02T07:23:01.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.872+0000 7f0604600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05fc143f90 0x7f05fc15ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:01.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.872+0000 7f0604600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05fc15b270 con 0x7f05fc0b34f0 2024-04-02T07:23:01.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.872+0000 7f0604600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05fc144370 con 0x7f05fc0cda80 2024-04-02T07:23:01.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.872+0000 7f0604600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc0c37b0 con 0x7f05fc143f90 2024-04-02T07:23:01.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.872+0000 7f0601200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f05fc0b34f0 0x7f05fc0cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43842/0 (socket says 172.21.15.55:43842) 2024-04-02T07:23:01.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.872+0000 7f0601200640 1 -- 172.21.15.55:0/2309567096 learned_addr learned my addr 172.21.15.55:0/2309567096 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:01.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.872+0000 7f0601c00640 1 --2- 172.21.15.55:0/2309567096 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05fc143f90 0x7f05fc15ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:01.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.876+0000 7f05fbe00640 1 -- 172.21.15.55:0/2309567096 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2262060033 0 0) 0x7f05fc15b270 con 0x7f05fc0b34f0 2024-04-02T07:23:01.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.876+0000 7f05fbe00640 1 -- 172.21.15.55:0/2309567096 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05e4003530 con 0x7f05fc0b34f0 2024-04-02T07:23:01.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.876+0000 7f05fbe00640 1 -- 172.21.15.55:0/2309567096 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000898934 0 0) 0x7f05fc144370 con 0x7f05fc0cda80 2024-04-02T07:23:01.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.876+0000 7f0601c00640 1 -- 172.21.15.55:0/2309567096 >> v1:172.21.15.106:6789/0 conn(0x7f05fc0cda80 legacy=0x7f05fc0c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:01.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.876+0000 7f0601c00640 1 -- 172.21.15.55:0/2309567096 >> v1:172.21.15.55:6789/0 conn(0x7f05fc0b34f0 legacy=0x7f05fc0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:01.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.876+0000 7f0601c00640 1 -- 172.21.15.55:0/2309567096 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc0c3a90 con 0x7f05fc143f90 2024-04-02T07:23:01.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.876+0000 7f0601c00640 1 --2- 172.21.15.55:0/2309567096 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05fc143f90 0x7f05fc15ad30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f05f00097f0 tx=0x7f05f001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f62e349f4e4ca343 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:01.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.876+0000 7f05fbe00640 1 -- 172.21.15.55:0/2309567096 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f00ab600 con 0x7f05fc143f90 2024-04-02T07:23:01.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.876+0000 7f05fbe00640 1 -- 172.21.15.55:0/2309567096 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f00a7050 con 0x7f05fc143f90 2024-04-02T07:23:01.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.876+0000 7f05fbe00640 1 -- 172.21.15.55:0/2309567096 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f00ab980 con 0x7f05fc143f90 2024-04-02T07:23:01.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0604600640 1 -- 172.21.15.55:0/2309567096 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05fc143f90 msgr2=0x7f05fc15ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:01.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0604600640 1 --2- 172.21.15.55:0/2309567096 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05fc143f90 0x7f05fc15ad30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f05f00097f0 tx=0x7f05f001c420 comp rx=0 tx=0).stop 2024-04-02T07:23:01.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0604600640 1 -- 172.21.15.55:0/2309567096 shutdown_connections 2024-04-02T07:23:01.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0604600640 1 --2- 172.21.15.55:0/2309567096 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05fc143f90 0x7f05fc15ad30 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0604600640 1 -- 172.21.15.55:0/2309567096 >> 172.21.15.55:0/2309567096 conn(0x7f05fc066080 msgr2=0x7f05fc069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:01.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0604600640 1 -- 172.21.15.55:0/2309567096 shutdown_connections 2024-04-02T07:23:01.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0604600640 1 -- 172.21.15.55:0/2309567096 wait complete. 2024-04-02T07:23:01.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0604600640 1 Processor -- start 2024-04-02T07:23:01.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0604600640 1 -- start start 2024-04-02T07:23:01.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0604600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05fc0b34f0 0x7f05fc165ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:01.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0604600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05fc0cda80 0x7f05fc1f6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:01.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0604600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05fc143f90 0x7f05fc1f7530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:01.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0604600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc1664d0 con 0x7f05fc143f90 2024-04-02T07:23:01.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0604600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc0c6b10 con 0x7f05fc0cda80 2024-04-02T07:23:01.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0604600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc0c6df0 con 0x7f05fc0b34f0 2024-04-02T07:23:01.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0602600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05fc143f90 0x7f05fc1f7530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:01.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0602600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05fc143f90 0x7f05fc1f7530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43594/0 (socket says 172.21.15.55:43594) 2024-04-02T07:23:01.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0602600640 1 -- 172.21.15.55:0/337934039 learned_addr learned my addr 172.21.15.55:0/337934039 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:01.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0601c00640 1 --2- 172.21.15.55:0/337934039 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05fc0b34f0 0x7f05fc165ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:01.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0601200640 1 --2- 172.21.15.55:0/337934039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05fc0cda80 0x7f05fc1f6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:01.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0602600640 1 -- 172.21.15.55:0/337934039 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05fc0b34f0 msgr2=0x7f05fc165ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:01.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0602600640 1 --2- 172.21.15.55:0/337934039 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05fc0b34f0 0x7f05fc165ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0602600640 1 -- 172.21.15.55:0/337934039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05fc0cda80 msgr2=0x7f05fc1f6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:01.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0602600640 1 --2- 172.21.15.55:0/337934039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05fc0cda80 0x7f05fc1f6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:01.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0602600640 1 -- 172.21.15.55:0/337934039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f0009420 con 0x7f05fc143f90 2024-04-02T07:23:01.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.880+0000 7f0601200640 1 --2- 172.21.15.55:0/337934039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05fc0cda80 0x7f05fc1f6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:23:01.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.884+0000 7f0602600640 1 --2- 172.21.15.55:0/337934039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05fc143f90 0x7f05fc1f7530 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f05f400c770 tx=0x7f05f400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:01.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.884+0000 7f05f9600640 1 -- 172.21.15.55:0/337934039 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f4003db0 con 0x7f05fc143f90 2024-04-02T07:23:01.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.884+0000 7f05f9600640 1 -- 172.21.15.55:0/337934039 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f400ce80 con 0x7f05fc143f90 2024-04-02T07:23:01.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.884+0000 7f05f9600640 1 -- 172.21.15.55:0/337934039 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f40052b0 con 0x7f05fc143f90 2024-04-02T07:23:01.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.884+0000 7f0604600640 1 -- 172.21.15.55:0/337934039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05fc0c70d0 con 0x7f05fc143f90 2024-04-02T07:23:01.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.884+0000 7f0604600640 1 -- 172.21.15.55:0/337934039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05fc15a850 con 0x7f05fc143f90 2024-04-02T07:23:01.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.884+0000 7f0604600640 1 -- 172.21.15.55:0/337934039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05fc066c90 con 0x7f05fc143f90 2024-04-02T07:23:01.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.884+0000 7f05f9600640 1 -- 172.21.15.55:0/337934039 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f05f4005410 con 0x7f05fc143f90 2024-04-02T07:23:01.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.884+0000 7f05f9600640 1 --2- 172.21.15.55:0/337934039 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f05dc066690 0x7f05dc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:01.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.884+0000 7f05f9600640 1 -- 172.21.15.55:0/337934039 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f05f4083a00 con 0x7f05fc143f90 2024-04-02T07:23:01.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.884+0000 7f0601c00640 1 --2- 172.21.15.55:0/337934039 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f05dc066690 0x7f05dc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:01.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.888+0000 7f0601c00640 1 --2- 172.21.15.55:0/337934039 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f05dc066690 0x7f05dc068b50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f05f00ad000 tx=0x7f05f00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:01.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:01.888+0000 7f05f9600640 1 -- 172.21.15.55:0/337934039 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f05f4050d80 con 0x7f05fc143f90 2024-04-02T07:23:02.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.052+0000 7f0604600640 1 -- 172.21.15.55:0/337934039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f05fc0b2880 con 0x7f05fc143f90 2024-04-02T07:23:02.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.056+0000 7f05f9600640 1 -- 172.21.15.55:0/337934039 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16287 (secure 0 0 0) 0x7f05f4017070 con 0x7f05fc143f90 2024-04-02T07:23:02.060 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:02.060 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":22,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:23:00.192054+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:23:02.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.056+0000 7f0604600640 1 -- 172.21.15.55:0/337934039 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f05dc066690 msgr2=0x7f05dc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:02.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.056+0000 7f0604600640 1 --2- 172.21.15.55:0/337934039 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f05dc066690 0x7f05dc068b50 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f05f00ad000 tx=0x7f05f00a6000 comp rx=0 tx=0).stop 2024-04-02T07:23:02.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.056+0000 7f0604600640 1 -- 172.21.15.55:0/337934039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05fc143f90 msgr2=0x7f05fc1f7530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:02.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.056+0000 7f0604600640 1 --2- 172.21.15.55:0/337934039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05fc143f90 0x7f05fc1f7530 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f05f400c770 tx=0x7f05f400cc30 comp rx=0 tx=0).stop 2024-04-02T07:23:02.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.056+0000 7f0604600640 1 -- 172.21.15.55:0/337934039 shutdown_connections 2024-04-02T07:23:02.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.056+0000 7f0604600640 1 --2- 172.21.15.55:0/337934039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f05fc143f90 0x7f05fc1f7530 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.056+0000 7f0604600640 1 --2- 172.21.15.55:0/337934039 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f05dc066690 0x7f05dc068b50 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.056+0000 7f0604600640 1 --2- 172.21.15.55:0/337934039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f05fc0cda80 0x7f05fc1f6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.056+0000 7f0604600640 1 --2- 172.21.15.55:0/337934039 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f05fc0b34f0 0x7f05fc165ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.056+0000 7f0604600640 1 -- 172.21.15.55:0/337934039 >> 172.21.15.55:0/337934039 conn(0x7f05fc066080 msgr2=0x7f05fc070210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:02.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.056+0000 7f0604600640 1 -- 172.21.15.55:0/337934039 shutdown_connections 2024-04-02T07:23:02.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.056+0000 7f0604600640 1 -- 172.21.15.55:0/337934039 wait complete. 2024-04-02T07:23:02.081 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:22:16.738297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:22:17.190496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:23:02.081 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:23:02.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.220+0000 7ff23a400640 1 Processor -- start 2024-04-02T07:23:02.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.220+0000 7ff23a400640 1 -- start start 2024-04-02T07:23:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.220+0000 7ff23a400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff23415c690 0x7ff2340cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.220+0000 7ff23a400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff23415ca70 0x7ff2340ce740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.220+0000 7ff23a400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff23406c0e0 0x7ff234098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.220+0000 7ff23a400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23406bc50 con 0x7ff23415ca70 2024-04-02T07:23:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.220+0000 7ff23a400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff23406b040 con 0x7ff23406c0e0 2024-04-02T07:23:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.220+0000 7ff23a400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff23406b320 con 0x7ff23415c690 2024-04-02T07:23:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.220+0000 7ff233e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff23415ca70 0x7ff2340ce740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.220+0000 7ff233e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff23415ca70 0x7ff2340ce740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43600/0 (socket says 172.21.15.55:43600) 2024-04-02T07:23:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.220+0000 7ff233e00640 1 -- 172.21.15.55:0/1342073647 learned_addr learned my addr 172.21.15.55:0/1342073647 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.220+0000 7ff239000640 1 --2- 172.21.15.55:0/1342073647 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff23415c690 0x7ff2340cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.220+0000 7ff239a00640 1 --2- 172.21.15.55:0/1342073647 >> v2:172.21.15.106:3300/0 conn(0x7ff23406c0e0 0x7ff234098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.220+0000 7ff233e00640 1 -- 172.21.15.55:0/1342073647 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff23415c690 msgr2=0x7ff2340cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.220+0000 7ff233e00640 1 --2- 172.21.15.55:0/1342073647 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff23415c690 0x7ff2340cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.220+0000 7ff233e00640 1 -- 172.21.15.55:0/1342073647 >> v2:172.21.15.106:3300/0 conn(0x7ff23406c0e0 msgr2=0x7ff234098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.220+0000 7ff233e00640 1 --2- 172.21.15.55:0/1342073647 >> v2:172.21.15.106:3300/0 conn(0x7ff23406c0e0 0x7ff234098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.220+0000 7ff233e00640 1 -- 172.21.15.55:0/1342073647 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff23406b600 con 0x7ff23415ca70 2024-04-02T07:23:02.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.224+0000 7ff233e00640 1 --2- 172.21.15.55:0/1342073647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23415ca70 0x7ff2340ce740 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff2340af8b0 tx=0x7ff22001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66fae0c1a589ae4f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:02.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.224+0000 7ff233400640 1 -- 172.21.15.55:0/1342073647 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2200ab5f0 con 0x7ff23415ca70 2024-04-02T07:23:02.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.224+0000 7ff233400640 1 -- 172.21.15.55:0/1342073647 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2200ab750 con 0x7ff23415ca70 2024-04-02T07:23:02.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.224+0000 7ff233400640 1 -- 172.21.15.55:0/1342073647 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2200abae0 con 0x7ff23415ca70 2024-04-02T07:23:02.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.224+0000 7ff23a400640 1 -- 172.21.15.55:0/1342073647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23415ca70 msgr2=0x7ff2340ce740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:02.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.224+0000 7ff23a400640 1 --2- 172.21.15.55:0/1342073647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23415ca70 0x7ff2340ce740 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff2340af8b0 tx=0x7ff22001c520 comp rx=0 tx=0).stop 2024-04-02T07:23:02.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.224+0000 7ff23a400640 1 -- 172.21.15.55:0/1342073647 shutdown_connections 2024-04-02T07:23:02.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.224+0000 7ff23a400640 1 --2- 172.21.15.55:0/1342073647 >> v2:172.21.15.106:3300/0 conn(0x7ff23406c0e0 0x7ff234098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.224+0000 7ff23a400640 1 --2- 172.21.15.55:0/1342073647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23415ca70 0x7ff2340ce740 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.224+0000 7ff23a400640 1 --2- 172.21.15.55:0/1342073647 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff23415c690 0x7ff2340cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.224+0000 7ff23a400640 1 -- 172.21.15.55:0/1342073647 >> 172.21.15.55:0/1342073647 conn(0x7ff2340b1ff0 msgr2=0x7ff2340b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:02.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.224+0000 7ff23a400640 1 -- 172.21.15.55:0/1342073647 shutdown_connections 2024-04-02T07:23:02.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.224+0000 7ff23a400640 1 -- 172.21.15.55:0/1342073647 wait complete. 2024-04-02T07:23:02.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.224+0000 7ff23a400640 1 Processor -- start 2024-04-02T07:23:02.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff23a400640 1 -- start start 2024-04-02T07:23:02.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff23a400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23406c0e0 0x7ff234154e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff23a400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff23415c690 0x7ff23415d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff23a400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff23415ca70 0x7ff23415dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff23a400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff23415b7e0 con 0x7ff23406c0e0 2024-04-02T07:23:02.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff23a400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340b4310 con 0x7ff23415ca70 2024-04-02T07:23:02.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff23a400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2340b45f0 con 0x7ff23415c690 2024-04-02T07:23:02.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff239000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23406c0e0 0x7ff234154e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff239000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23406c0e0 0x7ff234154e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43616/0 (socket says 172.21.15.55:43616) 2024-04-02T07:23:02.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff239000640 1 -- 172.21.15.55:0/2017963855 learned_addr learned my addr 172.21.15.55:0/2017963855 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:02.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff233e00640 1 --2- 172.21.15.55:0/2017963855 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff23415c690 0x7ff23415d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff239a00640 1 --2- 172.21.15.55:0/2017963855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff23415ca70 0x7ff23415dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff239000640 1 -- 172.21.15.55:0/2017963855 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff23415c690 msgr2=0x7ff23415d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:02.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff239000640 1 --2- 172.21.15.55:0/2017963855 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff23415c690 0x7ff23415d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff239000640 1 -- 172.21.15.55:0/2017963855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff23415ca70 msgr2=0x7ff23415dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:02.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff239000640 1 --2- 172.21.15.55:0/2017963855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff23415ca70 0x7ff23415dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff239000640 1 -- 172.21.15.55:0/2017963855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2200094d0 con 0x7ff23406c0e0 2024-04-02T07:23:02.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff239a00640 1 --2- 172.21.15.55:0/2017963855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff23415ca70 0x7ff23415dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:02.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff239000640 1 --2- 172.21.15.55:0/2017963855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23406c0e0 0x7ff234154e70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff22800d5f0 tx=0x7ff22800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:02.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff230c00640 1 -- 172.21.15.55:0/2017963855 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2280125f0 con 0x7ff23406c0e0 2024-04-02T07:23:02.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff230c00640 1 -- 172.21.15.55:0/2017963855 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff228012750 con 0x7ff23406c0e0 2024-04-02T07:23:02.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff23a400640 1 -- 172.21.15.55:0/2017963855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2340b48d0 con 0x7ff23406c0e0 2024-04-02T07:23:02.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff230c00640 1 -- 172.21.15.55:0/2017963855 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff228012ae0 con 0x7ff23406c0e0 2024-04-02T07:23:02.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff23a400640 1 -- 172.21.15.55:0/2017963855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2341553b0 con 0x7ff23406c0e0 2024-04-02T07:23:02.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.228+0000 7ff23a400640 1 -- 172.21.15.55:0/2017963855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff234098d50 con 0x7ff23406c0e0 2024-04-02T07:23:02.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.232+0000 7ff230c00640 1 -- 172.21.15.55:0/2017963855 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff228012c40 con 0x7ff23406c0e0 2024-04-02T07:23:02.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.232+0000 7ff230c00640 1 --2- 172.21.15.55:0/2017963855 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff214066690 0x7ff214068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.232+0000 7ff230c00640 1 -- 172.21.15.55:0/2017963855 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff228084630 con 0x7ff23406c0e0 2024-04-02T07:23:02.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.232+0000 7ff233e00640 1 --2- 172.21.15.55:0/2017963855 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff214066690 0x7ff214068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.232+0000 7ff233e00640 1 --2- 172.21.15.55:0/2017963855 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff214066690 0x7ff214068b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff2200af000 tx=0x7ff2200a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:02.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.236+0000 7ff230c00640 1 -- 172.21.15.55:0/2017963855 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff228051910 con 0x7ff23406c0e0 2024-04-02T07:23:02.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.396+0000 7ff23a400640 1 -- 172.21.15.55:0/2017963855 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff234073fa0 con 0x7ff23406c0e0 2024-04-02T07:23:02.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.396+0000 7ff230c00640 1 -- 172.21.15.55:0/2017963855 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff228082e60 con 0x7ff23406c0e0 2024-04-02T07:23:02.401 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:23:02.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.396+0000 7ff23a400640 1 -- 172.21.15.55:0/2017963855 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff214066690 msgr2=0x7ff214068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:02.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.396+0000 7ff23a400640 1 --2- 172.21.15.55:0/2017963855 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff214066690 0x7ff214068b50 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7ff2200af000 tx=0x7ff2200a7000 comp rx=0 tx=0).stop 2024-04-02T07:23:02.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.396+0000 7ff23a400640 1 -- 172.21.15.55:0/2017963855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23406c0e0 msgr2=0x7ff234154e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:02.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.396+0000 7ff23a400640 1 --2- 172.21.15.55:0/2017963855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23406c0e0 0x7ff234154e70 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff22800d5f0 tx=0x7ff22800dab0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.396+0000 7ff23a400640 1 -- 172.21.15.55:0/2017963855 shutdown_connections 2024-04-02T07:23:02.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.396+0000 7ff23a400640 1 --2- 172.21.15.55:0/2017963855 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff214066690 0x7ff214068b50 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.396+0000 7ff23a400640 1 --2- 172.21.15.55:0/2017963855 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff23415ca70 0x7ff23415dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.396+0000 7ff23a400640 1 --2- 172.21.15.55:0/2017963855 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff23415c690 0x7ff23415d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.396+0000 7ff23a400640 1 --2- 172.21.15.55:0/2017963855 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff23406c0e0 0x7ff234154e70 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.396+0000 7ff23a400640 1 -- 172.21.15.55:0/2017963855 >> 172.21.15.55:0/2017963855 conn(0x7ff2340b1ff0 msgr2=0x7ff2340b1770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:02.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.396+0000 7ff23a400640 1 -- 172.21.15.55:0/2017963855 shutdown_connections 2024-04-02T07:23:02.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.396+0000 7ff23a400640 1 -- 172.21.15.55:0/2017963855 wait complete. 2024-04-02T07:23:02.422 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:23:02.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17e5a00640 1 Processor -- start 2024-04-02T07:23:02.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17e5a00640 1 -- start start 2024-04-02T07:23:02.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17e5a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17e00709b0 0x7f17e00b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17e5a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f17e00b2fd0 0x7f17e00b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17e5a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17e015e3a0 con 0x7f17e0144260 2024-04-02T07:23:02.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17e5a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17e00b37c0 con 0x7f17e00b2fd0 2024-04-02T07:23:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17e5a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e015e5f0 con 0x7f17e00709b0 2024-04-02T07:23:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17dea00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f17e0144260 0x7f17e00702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43858/0 (socket says 172.21.15.55:43858) 2024-04-02T07:23:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17dea00640 1 -- 172.21.15.55:0/3701173723 learned_addr learned my addr 172.21.15.55:0/3701173723 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17df400640 1 --2- 172.21.15.55:0/3701173723 >> v2:172.21.15.106:3300/0 conn(0x7f17e00b2fd0 0x7f17e00b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17de000640 1 --2- 172.21.15.55:0/3701173723 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17e00709b0 0x7f17e00b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17dd600640 1 -- 172.21.15.55:0/3701173723 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1980797791 0 0) 0x7f17e015e3a0 con 0x7f17e0144260 2024-04-02T07:23:02.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17dd600640 1 -- 172.21.15.55:0/3701173723 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17c4003530 con 0x7f17e0144260 2024-04-02T07:23:02.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17dd600640 1 -- 172.21.15.55:0/3701173723 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3631083670 0 0) 0x7f17c4003530 con 0x7f17e0144260 2024-04-02T07:23:02.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17dd600640 1 -- 172.21.15.55:0/3701173723 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17e00709b0 msgr2=0x7f17e00b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:02.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17dd600640 1 --2- 172.21.15.55:0/3701173723 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17e00709b0 0x7f17e00b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17dd600640 1 -- 172.21.15.55:0/3701173723 >> v2:172.21.15.106:3300/0 conn(0x7f17e00b2fd0 msgr2=0x7f17e00b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:02.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17dd600640 1 --2- 172.21.15.55:0/3701173723 >> v2:172.21.15.106:3300/0 conn(0x7f17e00b2fd0 0x7f17e00b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17dd600640 1 -- 172.21.15.55:0/3701173723 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e015e8d0 con 0x7f17e0144260 2024-04-02T07:23:02.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17dd600640 1 -- 172.21.15.55:0/3701173723 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f17d0001680 con 0x7f17e0144260 2024-04-02T07:23:02.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17dd600640 1 -- 172.21.15.55:0/3701173723 >> v1:172.21.15.55:6789/0 conn(0x7f17e0144260 legacy=0x7f17e00702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:02.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17dd600640 1 --2- 172.21.15.55:0/3701173723 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17c4003980 0x7f17c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17dd600640 1 --2- 172.21.15.55:0/3701173723 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17e00709b0 0x7f17c40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17dd600640 1 --2- 172.21.15.55:0/3701173723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c4004d10 0x7f17c4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17dd600640 1 -- 172.21.15.55:0/3701173723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e00b37c0 con 0x7f17c4004d10 2024-04-02T07:23:02.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17dd600640 1 -- 172.21.15.55:0/3701173723 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e015e5f0 con 0x7f17c4003980 2024-04-02T07:23:02.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17dd600640 1 -- 172.21.15.55:0/3701173723 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c400b990 con 0x7f17e00709b0 2024-04-02T07:23:02.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17df400640 1 --2- 172.21.15.55:0/3701173723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c4004d10 0x7f17c4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17dea00640 1 --2- 172.21.15.55:0/3701173723 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17c4003980 0x7f17c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17de000640 1 --2- 172.21.15.55:0/3701173723 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17e00709b0 0x7f17c40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17df400640 1 -- 172.21.15.55:0/3701173723 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17e00709b0 msgr2=0x7f17c40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:02.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17df400640 1 --2- 172.21.15.55:0/3701173723 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17e00709b0 0x7f17c40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17df400640 1 -- 172.21.15.55:0/3701173723 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17c4003980 msgr2=0x7f17c4003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:02.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17df400640 1 --2- 172.21.15.55:0/3701173723 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17c4003980 0x7f17c4003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.560+0000 7f17df400640 1 -- 172.21.15.55:0/3701173723 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c4003530 con 0x7f17c4004d10 2024-04-02T07:23:02.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.564+0000 7f17df400640 1 --2- 172.21.15.55:0/3701173723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c4004d10 0x7f17c4005190 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f17d800e170 tx=0x7f17d801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f905e528fffc0a6c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:02.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.564+0000 7f17dd600640 1 -- 172.21.15.55:0/3701173723 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d80a5cb0 con 0x7f17c4004d10 2024-04-02T07:23:02.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.564+0000 7f17dd600640 1 -- 172.21.15.55:0/3701173723 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d800f040 con 0x7f17c4004d10 2024-04-02T07:23:02.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.564+0000 7f17dd600640 1 -- 172.21.15.55:0/3701173723 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d80ad680 con 0x7f17c4004d10 2024-04-02T07:23:02.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.564+0000 7f17e5a00640 1 -- 172.21.15.55:0/3701173723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c4004d10 msgr2=0x7f17c4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:02.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.564+0000 7f17e5a00640 1 --2- 172.21.15.55:0/3701173723 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c4004d10 0x7f17c4005190 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f17d800e170 tx=0x7f17d801cca0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.564+0000 7f17df400640 1 -- 172.21.15.55:0/3701173723 reap_dead start 2024-04-02T07:23:02.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.564+0000 7f17e5a00640 1 -- 172.21.15.55:0/3701173723 shutdown_connections 2024-04-02T07:23:02.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.564+0000 7f17e5a00640 1 -- 172.21.15.55:0/3701173723 >> 172.21.15.55:0/3701173723 conn(0x7f17e006a390 msgr2=0x7f17e00b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:02.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.564+0000 7f17e5a00640 1 -- 172.21.15.55:0/3701173723 shutdown_connections 2024-04-02T07:23:02.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.564+0000 7f17e5a00640 1 -- 172.21.15.55:0/3701173723 wait complete. 2024-04-02T07:23:02.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17e5a00640 1 Processor -- start 2024-04-02T07:23:02.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17e5a00640 1 -- start start 2024-04-02T07:23:02.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17e5a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c4004d10 0x7f17e015da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17e5a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17e01f32b0 0x7f17e0139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17e5a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17e0159070 0x7f17e0137480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17e5a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e01f4260 con 0x7f17c4004d10 2024-04-02T07:23:02.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17e5a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e01f0b20 con 0x7f17e01f32b0 2024-04-02T07:23:02.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17e5a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17e0134f30 con 0x7f17e0159070 2024-04-02T07:23:02.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17dea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c4004d10 0x7f17e015da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17dea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c4004d10 0x7f17e015da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43622/0 (socket says 172.21.15.55:43622) 2024-04-02T07:23:02.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17dea00640 1 -- 172.21.15.55:0/2958202763 learned_addr learned my addr 172.21.15.55:0/2958202763 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:02.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17de000640 1 --2- 172.21.15.55:0/2958202763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17e01f32b0 0x7f17e0139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17df400640 1 --2- 172.21.15.55:0/2958202763 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17e0159070 0x7f17e0137480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17dea00640 1 -- 172.21.15.55:0/2958202763 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17e0159070 msgr2=0x7f17e0137480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:02.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17dea00640 1 --2- 172.21.15.55:0/2958202763 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17e0159070 0x7f17e0137480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17dea00640 1 -- 172.21.15.55:0/2958202763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17e01f32b0 msgr2=0x7f17e0139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:02.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17dea00640 1 --2- 172.21.15.55:0/2958202763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17e01f32b0 0x7f17e0139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17dea00640 1 -- 172.21.15.55:0/2958202763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17e01eff10 con 0x7f17c4004d10 2024-04-02T07:23:02.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17dea00640 1 --2- 172.21.15.55:0/2958202763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c4004d10 0x7f17e015da50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f17d0007370 tx=0x7f17d0007770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:02.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17d6a00640 1 -- 172.21.15.55:0/2958202763 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d0001670 con 0x7f17c4004d10 2024-04-02T07:23:02.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17d6a00640 1 -- 172.21.15.55:0/2958202763 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d000f960 con 0x7f17c4004d10 2024-04-02T07:23:02.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17d6a00640 1 -- 172.21.15.55:0/2958202763 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d000fcf0 con 0x7f17c4004d10 2024-04-02T07:23:02.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17e5a00640 1 -- 172.21.15.55:0/2958202763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e01f01f0 con 0x7f17c4004d10 2024-04-02T07:23:02.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.568+0000 7f17e5a00640 1 -- 172.21.15.55:0/2958202763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e01f07b0 con 0x7f17c4004d10 2024-04-02T07:23:02.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.572+0000 7f17e5a00640 1 -- 172.21.15.55:0/2958202763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17e01f0970 con 0x7f17c4004d10 2024-04-02T07:23:02.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.572+0000 7f17d6a00640 1 -- 172.21.15.55:0/2958202763 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f17d001d460 con 0x7f17c4004d10 2024-04-02T07:23:02.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.572+0000 7f17d6a00640 1 --2- 172.21.15.55:0/2958202763 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f17c0066690 0x7f17c0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.572+0000 7f17d6a00640 1 -- 172.21.15.55:0/2958202763 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f17d0084250 con 0x7f17c4004d10 2024-04-02T07:23:02.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.572+0000 7f17de000640 1 --2- 172.21.15.55:0/2958202763 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f17c0066690 0x7f17c0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.572+0000 7f17de000640 1 --2- 172.21.15.55:0/2958202763 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f17c0066690 0x7f17c0068b50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f17e00afa10 tx=0x7f17cc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:02.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.576+0000 7f17d6a00640 1 -- 172.21.15.55:0/2958202763 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f17d0051530 con 0x7f17c4004d10 2024-04-02T07:23:02.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.732+0000 7f17e5a00640 1 -- 172.21.15.55:0/2958202763 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f17e0073530 con 0x7f17c4004d10 2024-04-02T07:23:02.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.736+0000 7f17d6a00640 1 -- 172.21.15.55:0/2958202763 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f17d0054b50 con 0x7f17c4004d10 2024-04-02T07:23:02.740 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:23:02.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.736+0000 7f17e5a00640 1 -- 172.21.15.55:0/2958202763 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f17c0066690 msgr2=0x7f17c0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:02.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.736+0000 7f17e5a00640 1 --2- 172.21.15.55:0/2958202763 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f17c0066690 0x7f17c0068b50 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f17e00afa10 tx=0x7f17cc009190 comp rx=0 tx=0).stop 2024-04-02T07:23:02.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.736+0000 7f17e5a00640 1 -- 172.21.15.55:0/2958202763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c4004d10 msgr2=0x7f17e015da50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:02.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.736+0000 7f17e5a00640 1 --2- 172.21.15.55:0/2958202763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c4004d10 0x7f17e015da50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f17d0007370 tx=0x7f17d0007770 comp rx=0 tx=0).stop 2024-04-02T07:23:02.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.736+0000 7f17e5a00640 1 -- 172.21.15.55:0/2958202763 shutdown_connections 2024-04-02T07:23:02.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.736+0000 7f17e5a00640 1 --2- 172.21.15.55:0/2958202763 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17e0159070 0x7f17e0137480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.736+0000 7f17e5a00640 1 --2- 172.21.15.55:0/2958202763 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f17c0066690 0x7f17c0068b50 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.736+0000 7f17e5a00640 1 --2- 172.21.15.55:0/2958202763 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17e01f32b0 0x7f17e0139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.736+0000 7f17e5a00640 1 --2- 172.21.15.55:0/2958202763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17c4004d10 0x7f17e015da50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.736+0000 7f17e5a00640 1 -- 172.21.15.55:0/2958202763 >> 172.21.15.55:0/2958202763 conn(0x7f17e006a390 msgr2=0x7f17e00ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:02.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.736+0000 7f17e5a00640 1 -- 172.21.15.55:0/2958202763 shutdown_connections 2024-04-02T07:23:02.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.736+0000 7f17e5a00640 1 -- 172.21.15.55:0/2958202763 wait complete. 2024-04-02T07:23:02.762 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:23:02.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.900+0000 7fcab0400640 1 Processor -- start 2024-04-02T07:23:02.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.900+0000 7fcab0400640 1 -- start start 2024-04-02T07:23:02.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.900+0000 7fcab0400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcaa80cfef0 0x7fcaa8098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.900+0000 7fcab0400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcaa8098f50 0x7fcaa80b5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.900+0000 7fcab0400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa80d0350 con 0x7fcaa815cd50 2024-04-02T07:23:02.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.900+0000 7fcab0400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa80993e0 con 0x7fcaa8098f50 2024-04-02T07:23:02.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.900+0000 7fcab0400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa80ccb30 con 0x7fcaa80cfef0 2024-04-02T07:23:02.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.900+0000 7fcaad000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcaa80cfef0 0x7fcaa8098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.900+0000 7fcaada00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fcaa815cd50 0x7fcaa806bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:38784/0 (socket says 172.21.15.55:38784) 2024-04-02T07:23:02.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.900+0000 7fcaada00640 1 -- 172.21.15.55:0/3171555664 learned_addr learned my addr 172.21.15.55:0/3171555664 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:02.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.900+0000 7fcaae400640 1 --2- 172.21.15.55:0/3171555664 >> v2:172.21.15.106:3300/0 conn(0x7fcaa8098f50 0x7fcaa80b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.900+0000 7fcaad000640 1 -- 172.21.15.55:0/3171555664 >> v2:172.21.15.106:3300/0 conn(0x7fcaa8098f50 msgr2=0x7fcaa80b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:02.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.900+0000 7fcaad000640 1 --2- 172.21.15.55:0/3171555664 >> v2:172.21.15.106:3300/0 conn(0x7fcaa8098f50 0x7fcaa80b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.900+0000 7fcaad000640 1 -- 172.21.15.55:0/3171555664 >> v1:172.21.15.106:6789/0 conn(0x7fcaa815cd50 legacy=0x7fcaa806bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:02.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.900+0000 7fcaad000640 1 -- 172.21.15.55:0/3171555664 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa806c2a0 con 0x7fcaa80cfef0 2024-04-02T07:23:02.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.900+0000 7fcaa7e00640 1 -- 172.21.15.55:0/3171555664 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2512490775 0 0) 0x7fcaa80d0350 con 0x7fcaa815cd50 2024-04-02T07:23:02.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.904+0000 7fcaad000640 1 --2- 172.21.15.55:0/3171555664 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcaa80cfef0 0x7fcaa8098a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fca940097c0 tx=0x7fca9401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d550c46dfdf3772 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:02.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.904+0000 7fcaa7e00640 1 -- 172.21.15.55:0/3171555664 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca940ac640 con 0x7fcaa80cfef0 2024-04-02T07:23:02.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.904+0000 7fcaa7e00640 1 -- 172.21.15.55:0/3171555664 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca940ac7a0 con 0x7fcaa80cfef0 2024-04-02T07:23:02.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.904+0000 7fcaa7e00640 1 -- 172.21.15.55:0/3171555664 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca940acb30 con 0x7fcaa80cfef0 2024-04-02T07:23:02.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.904+0000 7fcab0400640 1 -- 172.21.15.55:0/3171555664 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcaa80cfef0 msgr2=0x7fcaa8098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:02.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.904+0000 7fcab0400640 1 --2- 172.21.15.55:0/3171555664 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcaa80cfef0 0x7fcaa8098a10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fca940097c0 tx=0x7fca9401c3e0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.904+0000 7fcab0400640 1 -- 172.21.15.55:0/3171555664 shutdown_connections 2024-04-02T07:23:02.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.904+0000 7fcab0400640 1 --2- 172.21.15.55:0/3171555664 >> v2:172.21.15.106:3300/0 conn(0x7fcaa8098f50 0x7fcaa80b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.904+0000 7fcab0400640 1 --2- 172.21.15.55:0/3171555664 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcaa80cfef0 0x7fcaa8098a10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.904+0000 7fcab0400640 1 -- 172.21.15.55:0/3171555664 >> 172.21.15.55:0/3171555664 conn(0x7fcaa80b2160 msgr2=0x7fcaa80b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:02.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.904+0000 7fcab0400640 1 -- 172.21.15.55:0/3171555664 shutdown_connections 2024-04-02T07:23:02.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.904+0000 7fcab0400640 1 -- 172.21.15.55:0/3171555664 wait complete. 2024-04-02T07:23:02.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcab0400640 1 Processor -- start 2024-04-02T07:23:02.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcab0400640 1 -- start start 2024-04-02T07:23:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcab0400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcaa8098f50 0x7fcaa80c51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcab0400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcaa80cfef0 0x7fcaa815fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcab0400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaa815cd50 0x7fcaa80c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcab0400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa80c6f60 con 0x7fcaa815cd50 2024-04-02T07:23:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcab0400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa80c6d70 con 0x7fcaa8098f50 2024-04-02T07:23:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcab0400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa80c41a0 con 0x7fcaa80cfef0 2024-04-02T07:23:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcaae400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaa815cd50 0x7fcaa80c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcaae400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaa815cd50 0x7fcaa80c6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43630/0 (socket says 172.21.15.55:43630) 2024-04-02T07:23:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcaae400640 1 -- 172.21.15.55:0/3865791234 learned_addr learned my addr 172.21.15.55:0/3865791234 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcaad000640 1 --2- 172.21.15.55:0/3865791234 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcaa80cfef0 0x7fcaa815fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcaada00640 1 --2- 172.21.15.55:0/3865791234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcaa8098f50 0x7fcaa80c51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcaae400640 1 -- 172.21.15.55:0/3865791234 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcaa80cfef0 msgr2=0x7fcaa815fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:02.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcaae400640 1 --2- 172.21.15.55:0/3865791234 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcaa80cfef0 0x7fcaa815fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcaae400640 1 -- 172.21.15.55:0/3865791234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcaa8098f50 msgr2=0x7fcaa80c51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:02.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcaae400640 1 --2- 172.21.15.55:0/3865791234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcaa8098f50 0x7fcaa80c51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:02.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcaae400640 1 -- 172.21.15.55:0/3865791234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca94009420 con 0x7fcaa815cd50 2024-04-02T07:23:02.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcaae400640 1 --2- 172.21.15.55:0/3865791234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaa815cd50 0x7fcaa80c6830 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000efc0 tx=0x7fcaa000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:02.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcaa5600640 1 -- 172.21.15.55:0/3865791234 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0014480 con 0x7fcaa815cd50 2024-04-02T07:23:02.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcaa5600640 1 -- 172.21.15.55:0/3865791234 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa000f040 con 0x7fcaa815cd50 2024-04-02T07:23:02.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcab0400640 1 -- 172.21.15.55:0/3865791234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa80c43f0 con 0x7fcaa815cd50 2024-04-02T07:23:02.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcaa5600640 1 -- 172.21.15.55:0/3865791234 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa0014820 con 0x7fcaa815cd50 2024-04-02T07:23:02.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.908+0000 7fcab0400640 1 -- 172.21.15.55:0/3865791234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa80c49b0 con 0x7fcaa815cd50 2024-04-02T07:23:02.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.912+0000 7fcab0400640 1 -- 172.21.15.55:0/3865791234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa806f140 con 0x7fcaa815cd50 2024-04-02T07:23:02.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.912+0000 7fcaa5600640 1 -- 172.21.15.55:0/3865791234 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fcaa0014980 con 0x7fcaa815cd50 2024-04-02T07:23:02.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.912+0000 7fcaa5600640 1 --2- 172.21.15.55:0/3865791234 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fca88066690 0x7fca88068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:02.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.912+0000 7fcaa5600640 1 -- 172.21.15.55:0/3865791234 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fcaa0084f20 con 0x7fcaa815cd50 2024-04-02T07:23:02.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.912+0000 7fcaada00640 1 --2- 172.21.15.55:0/3865791234 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fca88066690 0x7fca88068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:02.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.912+0000 7fcaada00640 1 --2- 172.21.15.55:0/3865791234 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fca88066690 0x7fca88068b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fca9c007bc0 tx=0x7fca9c007b10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:02.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:02.916+0000 7fcaa5600640 1 -- 172.21.15.55:0/3865791234 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fcaa0052350 con 0x7fcaa815cd50 2024-04-02T07:23:03.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.076+0000 7fcab0400640 1 -- 172.21.15.55:0/3865791234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcaa8066c90 con 0x7fcaa815cd50 2024-04-02T07:23:03.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.076+0000 7fcaa5600640 1 -- 172.21.15.55:0/3865791234 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcaa00180a0 con 0x7fcaa815cd50 2024-04-02T07:23:03.083 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:23:03.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.080+0000 7fcab0400640 1 -- 172.21.15.55:0/3865791234 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fca88066690 msgr2=0x7fca88068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:03.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.080+0000 7fcab0400640 1 --2- 172.21.15.55:0/3865791234 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fca88066690 0x7fca88068b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fca9c007bc0 tx=0x7fca9c007b10 comp rx=0 tx=0).stop 2024-04-02T07:23:03.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.080+0000 7fcab0400640 1 -- 172.21.15.55:0/3865791234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaa815cd50 msgr2=0x7fcaa80c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:03.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.080+0000 7fcab0400640 1 --2- 172.21.15.55:0/3865791234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaa815cd50 0x7fcaa80c6830 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcaa000efc0 tx=0x7fcaa000c490 comp rx=0 tx=0).stop 2024-04-02T07:23:03.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.080+0000 7fcab0400640 1 -- 172.21.15.55:0/3865791234 shutdown_connections 2024-04-02T07:23:03.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.080+0000 7fcab0400640 1 --2- 172.21.15.55:0/3865791234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcaa815cd50 0x7fcaa80c6830 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.080+0000 7fcab0400640 1 --2- 172.21.15.55:0/3865791234 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcaa80cfef0 0x7fcaa815fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.080+0000 7fcab0400640 1 --2- 172.21.15.55:0/3865791234 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fca88066690 0x7fca88068b50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.080+0000 7fcab0400640 1 --2- 172.21.15.55:0/3865791234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcaa8098f50 0x7fcaa80c51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.080+0000 7fcab0400640 1 -- 172.21.15.55:0/3865791234 >> 172.21.15.55:0/3865791234 conn(0x7fcaa80b2160 msgr2=0x7fcaa806ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:03.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.080+0000 7fcab0400640 1 -- 172.21.15.55:0/3865791234 shutdown_connections 2024-04-02T07:23:03.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.080+0000 7fcab0400640 1 -- 172.21.15.55:0/3865791234 wait complete. 2024-04-02T07:23:03.104 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:23:03.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.240+0000 7f9265400640 1 Processor -- start 2024-04-02T07:23:03.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.240+0000 7f9265400640 1 -- start start 2024-04-02T07:23:03.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.244+0000 7f9265400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f926006d0a0 0x7f926006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.244+0000 7f9265400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92600cb160 0x7f92600cb610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.244+0000 7f9265400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f926015d5d0 con 0x7f926006ccc0 2024-04-02T07:23:03.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.244+0000 7f9265400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92600cbb50 con 0x7f926006d0a0 2024-04-02T07:23:03.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.244+0000 7f9265400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926015d8b0 con 0x7f92600cb160 2024-04-02T07:23:03.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.244+0000 7f9257e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f926006d0a0 0x7f926006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.244+0000 7f9257e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f926006d0a0 0x7f926006c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43634/0 (socket says 172.21.15.55:43634) 2024-04-02T07:23:03.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.244+0000 7f925e800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f926006ccc0 0x7f926006d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43872/0 (socket says 172.21.15.55:43872) 2024-04-02T07:23:03.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.244+0000 7f9257e00640 1 -- 172.21.15.55:0/2591930118 learned_addr learned my addr 172.21.15.55:0/2591930118 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:03.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.244+0000 7f925f200640 1 --2- 172.21.15.55:0/2591930118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92600cb160 0x7f92600cb610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.244+0000 7f9257e00640 1 -- 172.21.15.55:0/2591930118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92600cb160 msgr2=0x7f92600cb610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:03.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.244+0000 7f9257e00640 1 --2- 172.21.15.55:0/2591930118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92600cb160 0x7f92600cb610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.244+0000 7f9257e00640 1 -- 172.21.15.55:0/2591930118 >> v1:172.21.15.55:6789/0 conn(0x7f926006ccc0 legacy=0x7f926006d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:03.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.244+0000 7f9257e00640 1 -- 172.21.15.55:0/2591930118 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f926015db90 con 0x7f926006d0a0 2024-04-02T07:23:03.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.244+0000 7f925f200640 1 --2- 172.21.15.55:0/2591930118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92600cb160 0x7f92600cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:23:03.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.244+0000 7f9257e00640 1 --2- 172.21.15.55:0/2591930118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f926006d0a0 0x7f926006c280 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9248009870 tx=0x7f924801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8149981c0cc7e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:03.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f925de00640 1 -- 172.21.15.55:0/2591930118 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92480aa650 con 0x7f926006d0a0 2024-04-02T07:23:03.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f925de00640 1 -- 172.21.15.55:0/2591930118 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92480aa7b0 con 0x7f926006d0a0 2024-04-02T07:23:03.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f925de00640 1 -- 172.21.15.55:0/2591930118 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92480aab40 con 0x7f926006d0a0 2024-04-02T07:23:03.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f9265400640 1 -- 172.21.15.55:0/2591930118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f926006d0a0 msgr2=0x7f926006c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:03.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f9265400640 1 --2- 172.21.15.55:0/2591930118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f926006d0a0 0x7f926006c280 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9248009870 tx=0x7f924801c530 comp rx=0 tx=0).stop 2024-04-02T07:23:03.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f9265400640 1 -- 172.21.15.55:0/2591930118 shutdown_connections 2024-04-02T07:23:03.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f9265400640 1 --2- 172.21.15.55:0/2591930118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92600cb160 0x7f92600cb610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f9265400640 1 --2- 172.21.15.55:0/2591930118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f926006d0a0 0x7f926006c280 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f9265400640 1 -- 172.21.15.55:0/2591930118 >> 172.21.15.55:0/2591930118 conn(0x7f9260069d90 msgr2=0x7f926006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:03.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f9265400640 1 -- 172.21.15.55:0/2591930118 shutdown_connections 2024-04-02T07:23:03.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f9265400640 1 -- 172.21.15.55:0/2591930118 wait complete. 2024-04-02T07:23:03.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f9265400640 1 Processor -- start 2024-04-02T07:23:03.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f9265400640 1 -- start start 2024-04-02T07:23:03.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f9265400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f926006ccc0 0x7f92600ce080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f9265400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92600cb160 0x7f9260159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f9265400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9260152950 0x7f926015f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f9265400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9260158990 con 0x7f9260152950 2024-04-02T07:23:03.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f9265400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92601534f0 con 0x7f92600cb160 2024-04-02T07:23:03.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f9265400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f926015a590 con 0x7f926006ccc0 2024-04-02T07:23:03.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f925f200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9260152950 0x7f926015f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f925e800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f926006ccc0 0x7f92600ce080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f925f200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9260152950 0x7f926015f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43638/0 (socket says 172.21.15.55:43638) 2024-04-02T07:23:03.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f925f200640 1 -- 172.21.15.55:0/1827801995 learned_addr learned my addr 172.21.15.55:0/1827801995 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:03.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.248+0000 7f9257e00640 1 --2- 172.21.15.55:0/1827801995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92600cb160 0x7f9260159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.252+0000 7f925f200640 1 -- 172.21.15.55:0/1827801995 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f926006ccc0 msgr2=0x7f92600ce080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:03.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.252+0000 7f925f200640 1 --2- 172.21.15.55:0/1827801995 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f926006ccc0 0x7f92600ce080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.252+0000 7f925f200640 1 -- 172.21.15.55:0/1827801995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92600cb160 msgr2=0x7f9260159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:03.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.252+0000 7f925f200640 1 --2- 172.21.15.55:0/1827801995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92600cb160 0x7f9260159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.252+0000 7f925f200640 1 -- 172.21.15.55:0/1827801995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92480094d0 con 0x7f9260152950 2024-04-02T07:23:03.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.252+0000 7f925f200640 1 --2- 172.21.15.55:0/1827801995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9260152950 0x7f926015f440 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f925800cd50 tx=0x7f925800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:03.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.252+0000 7f9256a00640 1 -- 172.21.15.55:0/1827801995 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925800f680 con 0x7f9260152950 2024-04-02T07:23:03.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.252+0000 7f9256a00640 1 -- 172.21.15.55:0/1827801995 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925800f800 con 0x7f9260152950 2024-04-02T07:23:03.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.252+0000 7f9265400640 1 -- 172.21.15.55:0/1827801995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9260158060 con 0x7f9260152950 2024-04-02T07:23:03.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.252+0000 7f9256a00640 1 -- 172.21.15.55:0/1827801995 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925800fbb0 con 0x7f9260152950 2024-04-02T07:23:03.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.252+0000 7f9265400640 1 -- 172.21.15.55:0/1827801995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9260158620 con 0x7f9260152950 2024-04-02T07:23:03.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.252+0000 7f9265400640 1 -- 172.21.15.55:0/1827801995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9260066c90 con 0x7f9260152950 2024-04-02T07:23:03.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.252+0000 7f9256a00640 1 -- 172.21.15.55:0/1827801995 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f925800b040 con 0x7f9260152950 2024-04-02T07:23:03.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.252+0000 7f9256a00640 1 --2- 172.21.15.55:0/1827801995 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f923c066690 0x7f923c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.252+0000 7f9256a00640 1 -- 172.21.15.55:0/1827801995 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f9258084af0 con 0x7f9260152950 2024-04-02T07:23:03.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.252+0000 7f925e800640 1 --2- 172.21.15.55:0/1827801995 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f923c066690 0x7f923c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.256+0000 7f925e800640 1 --2- 172.21.15.55:0/1827801995 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f923c066690 0x7f923c068b50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9250000f70 tx=0x7f9250007e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:03.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.256+0000 7f9256a00640 1 -- 172.21.15.55:0/1827801995 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f9258051e80 con 0x7f9260152950 2024-04-02T07:23:03.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.428+0000 7f9265400640 1 -- 172.21.15.55:0/1827801995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9260073a10 con 0x7f9260152950 2024-04-02T07:23:03.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.428+0000 7f9256a00640 1 -- 172.21.15.55:0/1827801995 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7f92580554a0 con 0x7f9260152950 2024-04-02T07:23:03.435 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:23:03.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.432+0000 7f9265400640 1 -- 172.21.15.55:0/1827801995 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f923c066690 msgr2=0x7f923c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:03.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.432+0000 7f9265400640 1 --2- 172.21.15.55:0/1827801995 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f923c066690 0x7f923c068b50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f9250000f70 tx=0x7f9250007e50 comp rx=0 tx=0).stop 2024-04-02T07:23:03.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.432+0000 7f9265400640 1 -- 172.21.15.55:0/1827801995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9260152950 msgr2=0x7f926015f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:03.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.432+0000 7f9265400640 1 --2- 172.21.15.55:0/1827801995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9260152950 0x7f926015f440 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f925800cd50 tx=0x7f925800a650 comp rx=0 tx=0).stop 2024-04-02T07:23:03.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.432+0000 7f9265400640 1 -- 172.21.15.55:0/1827801995 shutdown_connections 2024-04-02T07:23:03.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.432+0000 7f9265400640 1 --2- 172.21.15.55:0/1827801995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9260152950 0x7f926015f440 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.432+0000 7f9265400640 1 --2- 172.21.15.55:0/1827801995 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f923c066690 0x7f923c068b50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.432+0000 7f9265400640 1 --2- 172.21.15.55:0/1827801995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f92600cb160 0x7f9260159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.432+0000 7f9265400640 1 --2- 172.21.15.55:0/1827801995 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f926006ccc0 0x7f92600ce080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.432+0000 7f9265400640 1 -- 172.21.15.55:0/1827801995 >> 172.21.15.55:0/1827801995 conn(0x7f9260069d90 msgr2=0x7f92600b1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:03.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.432+0000 7f9265400640 1 -- 172.21.15.55:0/1827801995 shutdown_connections 2024-04-02T07:23:03.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.432+0000 7f9265400640 1 -- 172.21.15.55:0/1827801995 wait complete. 2024-04-02T07:23:03.456 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:23:03.457 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:23:03.466 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:23:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.600+0000 7f796aa00640 1 Processor -- start 2024-04-02T07:23:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.600+0000 7f796aa00640 1 -- start start 2024-04-02T07:23:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.600+0000 7f796aa00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f796415a480 0x7f79640ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.600+0000 7f796aa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f79640b1070 0x7f79640c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.600+0000 7f796aa00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796415a860 con 0x7f79640ca9a0 2024-04-02T07:23:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.600+0000 7f796aa00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f796415ce20 con 0x7f79640b1070 2024-04-02T07:23:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.600+0000 7f796aa00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79640cade0 con 0x7f796415a480 2024-04-02T07:23:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.600+0000 7f7963e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f796415a480 0x7f79640ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.604+0000 7f7968a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f79640b1070 0x7f79640c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.604+0000 7f7968a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f79640b1070 0x7f79640c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:44910/0 (socket says 172.21.15.55:44910) 2024-04-02T07:23:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.604+0000 7f795b400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f79640ca9a0 0x7f79640b0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:38794/0 (socket says 172.21.15.55:38794) 2024-04-02T07:23:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.604+0000 7f7968a00640 1 -- 172.21.15.55:0/17528983 learned_addr learned my addr 172.21.15.55:0/17528983 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.604+0000 7f7963e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f796415a480 0x7f79640ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:59522/0 (socket says 172.21.15.55:59522) 2024-04-02T07:23:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.604+0000 7f7963e00640 1 -- 172.21.15.55:0/17528983 >> v2:172.21.15.106:3300/0 conn(0x7f79640b1070 msgr2=0x7f79640c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.604+0000 7f7963e00640 1 --2- 172.21.15.55:0/17528983 >> v2:172.21.15.106:3300/0 conn(0x7f79640b1070 0x7f79640c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.604+0000 7f7963e00640 1 -- 172.21.15.55:0/17528983 >> v1:172.21.15.106:6789/0 conn(0x7f79640ca9a0 legacy=0x7f79640b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.604+0000 7f7963e00640 1 -- 172.21.15.55:0/17528983 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79640cb570 con 0x7f796415a480 2024-04-02T07:23:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.604+0000 7f7968a00640 1 --2- 172.21.15.55:0/17528983 >> v2:172.21.15.106:3300/0 conn(0x7f79640b1070 0x7f79640c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:23:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.604+0000 7f7963e00640 1 --2- 172.21.15.55:0/17528983 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f796415a480 0x7f79640ca460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f79540097c0 tx=0x7f795401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca50d2ad572f0eab server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.604+0000 7f7963400640 1 -- 172.21.15.55:0/17528983 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79540ad640 con 0x7f796415a480 2024-04-02T07:23:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.604+0000 7f7963400640 1 -- 172.21.15.55:0/17528983 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79540ad7a0 con 0x7f796415a480 2024-04-02T07:23:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.604+0000 7f7963400640 1 -- 172.21.15.55:0/17528983 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79540adb30 con 0x7f796415a480 2024-04-02T07:23:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f796aa00640 1 -- 172.21.15.55:0/17528983 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f796415a480 msgr2=0x7f79640ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f796aa00640 1 --2- 172.21.15.55:0/17528983 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f796415a480 0x7f79640ca460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f79540097c0 tx=0x7f795401c4a0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f796aa00640 1 -- 172.21.15.55:0/17528983 shutdown_connections 2024-04-02T07:23:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f796aa00640 1 --2- 172.21.15.55:0/17528983 >> v2:172.21.15.106:3300/0 conn(0x7f79640b1070 0x7f79640c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f796aa00640 1 --2- 172.21.15.55:0/17528983 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f796415a480 0x7f79640ca460 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f796aa00640 1 -- 172.21.15.55:0/17528983 >> 172.21.15.55:0/17528983 conn(0x7f7964066080 msgr2=0x7f7964069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f796aa00640 1 -- 172.21.15.55:0/17528983 shutdown_connections 2024-04-02T07:23:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f796aa00640 1 -- 172.21.15.55:0/17528983 wait complete. 2024-04-02T07:23:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f796aa00640 1 Processor -- start 2024-04-02T07:23:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f796aa00640 1 -- start start 2024-04-02T07:23:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f796aa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79640b1070 0x7f796414f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f796aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79640ca9a0 0x7f7964154d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f796aa00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f796415a480 0x7f79640b1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f796aa00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796414ef10 con 0x7f79640ca9a0 2024-04-02T07:23:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f796aa00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796415c370 con 0x7f79640b1070 2024-04-02T07:23:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f796aa00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796415b7f0 con 0x7f796415a480 2024-04-02T07:23:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f795b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79640ca9a0 0x7f7964154d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f795b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79640ca9a0 0x7f7964154d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43654/0 (socket says 172.21.15.55:43654) 2024-04-02T07:23:03.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f795b400640 1 -- 172.21.15.55:0/2773288387 learned_addr learned my addr 172.21.15.55:0/2773288387 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:03.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f7963e00640 1 --2- 172.21.15.55:0/2773288387 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79640b1070 0x7f796414f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f7968a00640 1 --2- 172.21.15.55:0/2773288387 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f796415a480 0x7f79640b1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f795b400640 1 -- 172.21.15.55:0/2773288387 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f796415a480 msgr2=0x7f79640b1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:03.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f795b400640 1 --2- 172.21.15.55:0/2773288387 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f796415a480 0x7f79640b1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f795b400640 1 -- 172.21.15.55:0/2773288387 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79640b1070 msgr2=0x7f796414f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:03.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f795b400640 1 --2- 172.21.15.55:0/2773288387 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79640b1070 0x7f796414f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f795b400640 1 -- 172.21.15.55:0/2773288387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c009b30 con 0x7f79640ca9a0 2024-04-02T07:23:03.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.608+0000 7f795b400640 1 --2- 172.21.15.55:0/2773288387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79640ca9a0 0x7f7964154d60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f794c00c490 tx=0x7f794c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.612+0000 7f7960c00640 1 -- 172.21.15.55:0/2773288387 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c007480 con 0x7f79640ca9a0 2024-04-02T07:23:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.612+0000 7f7960c00640 1 -- 172.21.15.55:0/2773288387 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c0075e0 con 0x7f79640ca9a0 2024-04-02T07:23:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.612+0000 7f7960c00640 1 -- 172.21.15.55:0/2773288387 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c004a10 con 0x7f79640ca9a0 2024-04-02T07:23:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.612+0000 7f796aa00640 1 -- 172.21.15.55:0/2773288387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7954009420 con 0x7f79640ca9a0 2024-04-02T07:23:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.612+0000 7f796aa00640 1 -- 172.21.15.55:0/2773288387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796415bdb0 con 0x7f79640ca9a0 2024-04-02T07:23:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.612+0000 7f796aa00640 1 -- 172.21.15.55:0/2773288387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79640b18b0 con 0x7f79640ca9a0 2024-04-02T07:23:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.612+0000 7f7960c00640 1 -- 172.21.15.55:0/2773288387 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f794c004b70 con 0x7f79640ca9a0 2024-04-02T07:23:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.612+0000 7f7960c00640 1 --2- 172.21.15.55:0/2773288387 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7940066690 0x7f7940068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.612+0000 7f7960c00640 1 -- 172.21.15.55:0/2773288387 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f794c0831f0 con 0x7f79640ca9a0 2024-04-02T07:23:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.612+0000 7f7963e00640 1 --2- 172.21.15.55:0/2773288387 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7940066690 0x7f7940068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.616+0000 7f7963e00640 1 --2- 172.21.15.55:0/2773288387 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7940066690 0x7f7940068b50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f79540af000 tx=0x7f7954008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:03.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.616+0000 7f7960c00640 1 -- 172.21.15.55:0/2773288387 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f794c050580 con 0x7f79640ca9a0 2024-04-02T07:23:03.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.776+0000 7f796aa00640 1 -- 172.21.15.55:0/2773288387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f796415a860 con 0x7f79640ca9a0 2024-04-02T07:23:03.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.780+0000 7f7960c00640 1 -- 172.21.15.55:0/2773288387 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16287 (secure 0 0 0) 0x7f796415a860 con 0x7f79640ca9a0 2024-04-02T07:23:03.784 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:03.785 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":22,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:23:00.192054+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:23:03.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.780+0000 7f796aa00640 1 -- 172.21.15.55:0/2773288387 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7940066690 msgr2=0x7f7940068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:03.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.780+0000 7f796aa00640 1 --2- 172.21.15.55:0/2773288387 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7940066690 0x7f7940068b50 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f79540af000 tx=0x7f7954008040 comp rx=0 tx=0).stop 2024-04-02T07:23:03.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.780+0000 7f796aa00640 1 -- 172.21.15.55:0/2773288387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79640ca9a0 msgr2=0x7f7964154d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:03.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.780+0000 7f796aa00640 1 --2- 172.21.15.55:0/2773288387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79640ca9a0 0x7f7964154d60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f794c00c490 tx=0x7f794c00c950 comp rx=0 tx=0).stop 2024-04-02T07:23:03.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.780+0000 7f796aa00640 1 -- 172.21.15.55:0/2773288387 shutdown_connections 2024-04-02T07:23:03.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.780+0000 7f796aa00640 1 --2- 172.21.15.55:0/2773288387 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f796415a480 0x7f79640b1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.780+0000 7f796aa00640 1 --2- 172.21.15.55:0/2773288387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79640ca9a0 0x7f7964154d60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.780+0000 7f796aa00640 1 --2- 172.21.15.55:0/2773288387 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7940066690 0x7f7940068b50 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.780+0000 7f796aa00640 1 --2- 172.21.15.55:0/2773288387 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79640b1070 0x7f796414f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.780+0000 7f796aa00640 1 -- 172.21.15.55:0/2773288387 >> 172.21.15.55:0/2773288387 conn(0x7f7964066080 msgr2=0x7f7964071a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:03.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.780+0000 7f796aa00640 1 -- 172.21.15.55:0/2773288387 shutdown_connections 2024-04-02T07:23:03.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.780+0000 7f796aa00640 1 -- 172.21.15.55:0/2773288387 wait complete. 2024-04-02T07:23:03.806 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:22:16.738297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:22:17.190496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:23:03.807 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:23:03.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.944+0000 7facbfa00640 1 Processor -- start 2024-04-02T07:23:03.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.944+0000 7facbfa00640 1 -- start start 2024-04-02T07:23:03.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.944+0000 7facbfa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7facb815cd20 0x7facb8065a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.944+0000 7facbfa00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7facb806e4f0 0x7facb806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.944+0000 7facbfa00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facb80660d0 con 0x7facb8161490 2024-04-02T07:23:03.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.944+0000 7facbfa00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb81607a0 con 0x7facb815cd20 2024-04-02T07:23:03.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.944+0000 7facbfa00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb80ae8d0 con 0x7facb806e4f0 2024-04-02T07:23:03.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.944+0000 7facb7e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7facb8161490 0x7facb806dde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43878/0 (socket says 172.21.15.55:43878) 2024-04-02T07:23:03.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.944+0000 7facb7e00640 1 -- 172.21.15.55:0/3075984679 learned_addr learned my addr 172.21.15.55:0/3075984679 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:03.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.944+0000 7facbda00640 1 --2- 172.21.15.55:0/3075984679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7facb806e4f0 0x7facb806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.944+0000 7facbd000640 1 --2- 172.21.15.55:0/3075984679 >> v2:172.21.15.106:3300/0 conn(0x7facb815cd20 0x7facb8065a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facb7400640 1 -- 172.21.15.55:0/3075984679 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3169067294 0 0) 0x7facb80660d0 con 0x7facb8161490 2024-04-02T07:23:03.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facb7400640 1 -- 172.21.15.55:0/3075984679 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faca0003530 con 0x7facb8161490 2024-04-02T07:23:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facb7400640 1 -- 172.21.15.55:0/3075984679 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1113611771 0 0) 0x7faca0003530 con 0x7facb8161490 2024-04-02T07:23:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facb7400640 1 -- 172.21.15.55:0/3075984679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7facb806e4f0 msgr2=0x7facb806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facb7400640 1 --2- 172.21.15.55:0/3075984679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7facb806e4f0 0x7facb806d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facb7400640 1 -- 172.21.15.55:0/3075984679 >> v2:172.21.15.106:3300/0 conn(0x7facb815cd20 msgr2=0x7facb8065a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facb7400640 1 --2- 172.21.15.55:0/3075984679 >> v2:172.21.15.106:3300/0 conn(0x7facb815cd20 0x7facb8065a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facb7400640 1 -- 172.21.15.55:0/3075984679 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb81609b0 con 0x7facb8161490 2024-04-02T07:23:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facb7400640 1 -- 172.21.15.55:0/3075984679 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7faca4001680 con 0x7facb8161490 2024-04-02T07:23:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facb7400640 1 -- 172.21.15.55:0/3075984679 >> v1:172.21.15.55:6789/0 conn(0x7facb8161490 legacy=0x7facb806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facb7400640 1 --2- 172.21.15.55:0/3075984679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faca0003980 0x7faca0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facb7400640 1 --2- 172.21.15.55:0/3075984679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7facb806e4f0 0x7faca00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facb7400640 1 --2- 172.21.15.55:0/3075984679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca0004d10 0x7faca0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facb7400640 1 -- 172.21.15.55:0/3075984679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb81607a0 con 0x7faca0003980 2024-04-02T07:23:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facb7400640 1 -- 172.21.15.55:0/3075984679 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb80ae8d0 con 0x7faca0004d10 2024-04-02T07:23:03.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facb7400640 1 -- 172.21.15.55:0/3075984679 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca000b990 con 0x7facb806e4f0 2024-04-02T07:23:03.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facbd000640 1 --2- 172.21.15.55:0/3075984679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faca0003980 0x7faca0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facb7e00640 1 --2- 172.21.15.55:0/3075984679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7facb806e4f0 0x7faca00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facbda00640 1 --2- 172.21.15.55:0/3075984679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca0004d10 0x7faca0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facbd000640 1 -- 172.21.15.55:0/3075984679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7facb806e4f0 msgr2=0x7faca00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:03.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facbd000640 1 --2- 172.21.15.55:0/3075984679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7facb806e4f0 0x7faca00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facbd000640 1 -- 172.21.15.55:0/3075984679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca0004d10 msgr2=0x7faca0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:03.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facbd000640 1 --2- 172.21.15.55:0/3075984679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faca0004d10 0x7faca0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.948+0000 7facbd000640 1 -- 172.21.15.55:0/3075984679 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca0003530 con 0x7faca0003980 2024-04-02T07:23:03.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facbd000640 1 --2- 172.21.15.55:0/3075984679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faca0003980 0x7faca0003da0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7facac009b10 tx=0x7facac01cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dcbe1c37176ad3a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:03.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facb7400640 1 -- 172.21.15.55:0/3075984679 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac0b0400 con 0x7faca0003980 2024-04-02T07:23:03.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facb7400640 1 -- 172.21.15.55:0/3075984679 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac0b0560 con 0x7faca0003980 2024-04-02T07:23:03.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facb7400640 1 -- 172.21.15.55:0/3075984679 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac0b0910 con 0x7faca0003980 2024-04-02T07:23:03.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facbfa00640 1 -- 172.21.15.55:0/3075984679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faca0003980 msgr2=0x7faca0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:03.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facbfa00640 1 --2- 172.21.15.55:0/3075984679 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faca0003980 0x7faca0003da0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7facac009b10 tx=0x7facac01cab0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facbda00640 1 -- 172.21.15.55:0/3075984679 reap_dead start 2024-04-02T07:23:03.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facbfa00640 1 -- 172.21.15.55:0/3075984679 shutdown_connections 2024-04-02T07:23:03.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facbfa00640 1 -- 172.21.15.55:0/3075984679 >> 172.21.15.55:0/3075984679 conn(0x7facb80ced90 msgr2=0x7facb80cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:03.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facbfa00640 1 -- 172.21.15.55:0/3075984679 shutdown_connections 2024-04-02T07:23:03.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facbfa00640 1 -- 172.21.15.55:0/3075984679 wait complete. 2024-04-02T07:23:03.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facbfa00640 1 Processor -- start 2024-04-02T07:23:03.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facbfa00640 1 -- start start 2024-04-02T07:23:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facbfa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faca0003980 0x7facb81f6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facbfa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facb815fe90 0x7facb8153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facbfa00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7facb8153ec0 0x7facb8157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facbfa00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb8154320 con 0x7faca0003980 2024-04-02T07:23:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facbfa00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb815a320 con 0x7facb815fe90 2024-04-02T07:23:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facbfa00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb815aea0 con 0x7facb8153ec0 2024-04-02T07:23:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facbd000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faca0003980 0x7facb81f6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facbd000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faca0003980 0x7facb81f6b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43668/0 (socket says 172.21.15.55:43668) 2024-04-02T07:23:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.952+0000 7facbd000640 1 -- 172.21.15.55:0/1904233106 learned_addr learned my addr 172.21.15.55:0/1904233106 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.956+0000 7facb7e00640 1 --2- 172.21.15.55:0/1904233106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facb815fe90 0x7facb8153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.956+0000 7facbda00640 1 --2- 172.21.15.55:0/1904233106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7facb8153ec0 0x7facb8157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.956+0000 7facbd000640 1 -- 172.21.15.55:0/1904233106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7facb8153ec0 msgr2=0x7facb8157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.956+0000 7facbd000640 1 --2- 172.21.15.55:0/1904233106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7facb8153ec0 0x7facb8157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.956+0000 7facbd000640 1 -- 172.21.15.55:0/1904233106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facb815fe90 msgr2=0x7facb8153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.956+0000 7facbd000640 1 --2- 172.21.15.55:0/1904233106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facb815fe90 0x7facb8153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.956+0000 7facbd000640 1 -- 172.21.15.55:0/1904233106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb815a570 con 0x7faca0003980 2024-04-02T07:23:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.956+0000 7facbd000640 1 --2- 172.21.15.55:0/1904233106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faca0003980 0x7facb81f6b30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7facac01c8e0 tx=0x7facac019850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:03.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.956+0000 7facb4c00640 1 -- 172.21.15.55:0/1904233106 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac0b0400 con 0x7faca0003980 2024-04-02T07:23:03.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.956+0000 7facb4c00640 1 -- 172.21.15.55:0/1904233106 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facac00f000 con 0x7faca0003980 2024-04-02T07:23:03.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.956+0000 7facb4c00640 1 -- 172.21.15.55:0/1904233106 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facac004020 con 0x7faca0003980 2024-04-02T07:23:03.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.956+0000 7facbfa00640 1 -- 172.21.15.55:0/1904233106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb815a850 con 0x7faca0003980 2024-04-02T07:23:03.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.956+0000 7facbfa00640 1 -- 172.21.15.55:0/1904233106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb81f7070 con 0x7faca0003980 2024-04-02T07:23:03.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.956+0000 7facbfa00640 1 -- 172.21.15.55:0/1904233106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb81542a0 con 0x7faca0003980 2024-04-02T07:23:03.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.956+0000 7facb4c00640 1 -- 172.21.15.55:0/1904233106 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7facac004180 con 0x7faca0003980 2024-04-02T07:23:03.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.956+0000 7facb4c00640 1 --2- 172.21.15.55:0/1904233106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fac980666c0 0x7fac98068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:03.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.956+0000 7facb4c00640 1 -- 172.21.15.55:0/1904233106 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7facac11e140 con 0x7faca0003980 2024-04-02T07:23:03.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.960+0000 7facb7e00640 1 --2- 172.21.15.55:0/1904233106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fac980666c0 0x7fac98068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:03.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.960+0000 7facb7e00640 1 --2- 172.21.15.55:0/1904233106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fac980666c0 0x7fac98068b80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7facb80b3930 tx=0x7faca4007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:03.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:03.960+0000 7facb4c00640 1 -- 172.21.15.55:0/1904233106 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7facac0eb390 con 0x7faca0003980 2024-04-02T07:23:04.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.124+0000 7facbfa00640 1 -- 172.21.15.55:0/1904233106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7facb80cc770 con 0x7faca0003980 2024-04-02T07:23:04.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.124+0000 7facb4c00640 1 -- 172.21.15.55:0/1904233106 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7facac0ee9b0 con 0x7faca0003980 2024-04-02T07:23:04.129 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:23:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.124+0000 7facbfa00640 1 -- 172.21.15.55:0/1904233106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fac980666c0 msgr2=0x7fac98068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.124+0000 7facbfa00640 1 --2- 172.21.15.55:0/1904233106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fac980666c0 0x7fac98068b80 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7facb80b3930 tx=0x7faca4007900 comp rx=0 tx=0).stop 2024-04-02T07:23:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.124+0000 7facbfa00640 1 -- 172.21.15.55:0/1904233106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faca0003980 msgr2=0x7facb81f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.124+0000 7facbfa00640 1 --2- 172.21.15.55:0/1904233106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faca0003980 0x7facb81f6b30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7facac01c8e0 tx=0x7facac019850 comp rx=0 tx=0).stop 2024-04-02T07:23:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.124+0000 7facbfa00640 1 -- 172.21.15.55:0/1904233106 shutdown_connections 2024-04-02T07:23:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.124+0000 7facbfa00640 1 --2- 172.21.15.55:0/1904233106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7facb8153ec0 0x7facb8157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.124+0000 7facbfa00640 1 --2- 172.21.15.55:0/1904233106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fac980666c0 0x7fac98068b80 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.124+0000 7facbfa00640 1 --2- 172.21.15.55:0/1904233106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7facb815fe90 0x7facb8153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.124+0000 7facbfa00640 1 --2- 172.21.15.55:0/1904233106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faca0003980 0x7facb81f6b30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.124+0000 7facbfa00640 1 -- 172.21.15.55:0/1904233106 >> 172.21.15.55:0/1904233106 conn(0x7facb80ced90 msgr2=0x7facb8070b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.124+0000 7facbfa00640 1 -- 172.21.15.55:0/1904233106 shutdown_connections 2024-04-02T07:23:04.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.124+0000 7facbfa00640 1 -- 172.21.15.55:0/1904233106 wait complete. 2024-04-02T07:23:04.150 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:23:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.288+0000 7f6b1ac00640 1 Processor -- start 2024-04-02T07:23:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.288+0000 7f6b1ac00640 1 -- start start 2024-04-02T07:23:04.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.288+0000 7f6b1ac00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6b1415cd20 0x7f6b14065a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.288+0000 7f6b1ac00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b14161490 0x7f6b1406d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.288+0000 7f6b1ac00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b140660d0 con 0x7f6b1406dde0 2024-04-02T07:23:04.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.288+0000 7f6b1ac00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b141607a0 con 0x7f6b1415cd20 2024-04-02T07:23:04.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.288+0000 7f6b1ac00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b140ae8d0 con 0x7f6b14161490 2024-04-02T07:23:04.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.288+0000 7f6b13e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6b1415cd20 0x7f6b14065a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.288+0000 7f6b18c00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6b1406dde0 0x7f6b14069d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43886/0 (socket says 172.21.15.55:43886) 2024-04-02T07:23:04.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.288+0000 7f6b18c00640 1 -- 172.21.15.55:0/2126244358 learned_addr learned my addr 172.21.15.55:0/2126244358 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:04.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.288+0000 7f6b0be00640 1 --2- 172.21.15.55:0/2126244358 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b14161490 0x7f6b1406d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.288+0000 7f6b13e00640 1 -- 172.21.15.55:0/2126244358 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b14161490 msgr2=0x7f6b1406d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:04.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.288+0000 7f6b13e00640 1 --2- 172.21.15.55:0/2126244358 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b14161490 0x7f6b1406d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.288+0000 7f6b13e00640 1 -- 172.21.15.55:0/2126244358 >> v1:172.21.15.55:6789/0 conn(0x7f6b1406dde0 legacy=0x7f6b14069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:04.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.288+0000 7f6b13e00640 1 -- 172.21.15.55:0/2126244358 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b141609b0 con 0x7f6b1415cd20 2024-04-02T07:23:04.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.292+0000 7f6b13e00640 1 --2- 172.21.15.55:0/2126244358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b1415cd20 0x7f6b14065a80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6b040097c0 tx=0x7f6b0401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=597f4280fdd29eb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:04.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.292+0000 7f6b13400640 1 -- 172.21.15.55:0/2126244358 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b040ad640 con 0x7f6b1415cd20 2024-04-02T07:23:04.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.292+0000 7f6b13400640 1 -- 172.21.15.55:0/2126244358 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b040ad7a0 con 0x7f6b1415cd20 2024-04-02T07:23:04.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.292+0000 7f6b13400640 1 -- 172.21.15.55:0/2126244358 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b040adb30 con 0x7f6b1415cd20 2024-04-02T07:23:04.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.292+0000 7f6b1ac00640 1 -- 172.21.15.55:0/2126244358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b1415cd20 msgr2=0x7f6b14065a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:04.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.292+0000 7f6b1ac00640 1 --2- 172.21.15.55:0/2126244358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b1415cd20 0x7f6b14065a80 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6b040097c0 tx=0x7f6b0401c4a0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.292+0000 7f6b1ac00640 1 -- 172.21.15.55:0/2126244358 shutdown_connections 2024-04-02T07:23:04.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.292+0000 7f6b1ac00640 1 --2- 172.21.15.55:0/2126244358 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b14161490 0x7f6b1406d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.292+0000 7f6b1ac00640 1 --2- 172.21.15.55:0/2126244358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b1415cd20 0x7f6b14065a80 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.292+0000 7f6b1ac00640 1 -- 172.21.15.55:0/2126244358 >> 172.21.15.55:0/2126244358 conn(0x7f6b140ced90 msgr2=0x7f6b140cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:04.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.292+0000 7f6b1ac00640 1 -- 172.21.15.55:0/2126244358 shutdown_connections 2024-04-02T07:23:04.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.292+0000 7f6b1ac00640 1 -- 172.21.15.55:0/2126244358 wait complete. 2024-04-02T07:23:04.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b1ac00640 1 Processor -- start 2024-04-02T07:23:04.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b1ac00640 1 -- start start 2024-04-02T07:23:04.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b1ac00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b1406dde0 0x7f6b1413c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b1ac00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b1415cd20 0x7f6b14151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b1ac00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b14161490 0x7f6b14150430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b1ac00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b14151540 con 0x7f6b14161490 2024-04-02T07:23:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b1ac00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1413c8c0 con 0x7f6b1406dde0 2024-04-02T07:23:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b1ac00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1413cba0 con 0x7f6b1415cd20 2024-04-02T07:23:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b18c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b14161490 0x7f6b14150430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b18c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b14161490 0x7f6b14150430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43686/0 (socket says 172.21.15.55:43686) 2024-04-02T07:23:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b13e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b1406dde0 0x7f6b1413c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b18c00640 1 -- 172.21.15.55:0/4134218716 learned_addr learned my addr 172.21.15.55:0/4134218716 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b0be00640 1 --2- 172.21.15.55:0/4134218716 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b1415cd20 0x7f6b14151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b18c00640 1 -- 172.21.15.55:0/4134218716 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b1415cd20 msgr2=0x7f6b14151000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b18c00640 1 --2- 172.21.15.55:0/4134218716 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b1415cd20 0x7f6b14151000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b18c00640 1 -- 172.21.15.55:0/4134218716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b1406dde0 msgr2=0x7f6b1413c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b18c00640 1 --2- 172.21.15.55:0/4134218716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b1406dde0 0x7f6b1413c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b18c00640 1 -- 172.21.15.55:0/4134218716 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b04009420 con 0x7f6b14161490 2024-04-02T07:23:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b18c00640 1 --2- 172.21.15.55:0/4134218716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b14161490 0x7f6b14150430 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00cbc0 tx=0x7f6b0c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b10c00640 1 -- 172.21.15.55:0/4134218716 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c00ad40 con 0x7f6b14161490 2024-04-02T07:23:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b10c00640 1 -- 172.21.15.55:0/4134218716 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0c012400 con 0x7f6b14161490 2024-04-02T07:23:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b10c00640 1 -- 172.21.15.55:0/4134218716 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c00aea0 con 0x7f6b14161490 2024-04-02T07:23:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b1ac00640 1 -- 172.21.15.55:0/4134218716 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1413ce80 con 0x7f6b14161490 2024-04-02T07:23:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.296+0000 7f6b1ac00640 1 -- 172.21.15.55:0/4134218716 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1413d440 con 0x7f6b14161490 2024-04-02T07:23:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.300+0000 7f6b1ac00640 1 -- 172.21.15.55:0/4134218716 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b140cc770 con 0x7f6b14161490 2024-04-02T07:23:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.300+0000 7f6b10c00640 1 -- 172.21.15.55:0/4134218716 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6b0c007070 con 0x7f6b14161490 2024-04-02T07:23:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.300+0000 7f6b10c00640 1 --2- 172.21.15.55:0/4134218716 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6af0066690 0x7f6af0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.300+0000 7f6b10c00640 1 -- 172.21.15.55:0/4134218716 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6b0c084130 con 0x7f6b14161490 2024-04-02T07:23:04.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.300+0000 7f6b13e00640 1 --2- 172.21.15.55:0/4134218716 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6af0066690 0x7f6af0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.300+0000 7f6b13e00640 1 --2- 172.21.15.55:0/4134218716 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6af0066690 0x7f6af0068b50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6b040af000 tx=0x7f6b040a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:04.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.304+0000 7f6b10c00640 1 -- 172.21.15.55:0/4134218716 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6b0c051430 con 0x7f6b14161490 2024-04-02T07:23:04.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.464+0000 7f6b1ac00640 1 -- 172.21.15.55:0/4134218716 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b14066c90 con 0x7f6b14161490 2024-04-02T07:23:04.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.464+0000 7f6b10c00640 1 -- 172.21.15.55:0/4134218716 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6b0c054a50 con 0x7f6b14161490 2024-04-02T07:23:04.469 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:23:04.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.464+0000 7f6b1ac00640 1 -- 172.21.15.55:0/4134218716 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6af0066690 msgr2=0x7f6af0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:04.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.464+0000 7f6b1ac00640 1 --2- 172.21.15.55:0/4134218716 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6af0066690 0x7f6af0068b50 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f6b040af000 tx=0x7f6b040a7070 comp rx=0 tx=0).stop 2024-04-02T07:23:04.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.464+0000 7f6b1ac00640 1 -- 172.21.15.55:0/4134218716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b14161490 msgr2=0x7f6b14150430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:04.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.464+0000 7f6b1ac00640 1 --2- 172.21.15.55:0/4134218716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b14161490 0x7f6b14150430 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c00cbc0 tx=0x7f6b0c00a430 comp rx=0 tx=0).stop 2024-04-02T07:23:04.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.464+0000 7f6b1ac00640 1 -- 172.21.15.55:0/4134218716 shutdown_connections 2024-04-02T07:23:04.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.464+0000 7f6b1ac00640 1 --2- 172.21.15.55:0/4134218716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6b14161490 0x7f6b14150430 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.464+0000 7f6b1ac00640 1 --2- 172.21.15.55:0/4134218716 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6b1415cd20 0x7f6b14151000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.464+0000 7f6b1ac00640 1 --2- 172.21.15.55:0/4134218716 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6af0066690 0x7f6af0068b50 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.464+0000 7f6b1ac00640 1 --2- 172.21.15.55:0/4134218716 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6b1406dde0 0x7f6b1413c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.464+0000 7f6b1ac00640 1 -- 172.21.15.55:0/4134218716 >> 172.21.15.55:0/4134218716 conn(0x7f6b140ced90 msgr2=0x7f6b140b1b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:04.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.464+0000 7f6b1ac00640 1 -- 172.21.15.55:0/4134218716 shutdown_connections 2024-04-02T07:23:04.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.464+0000 7f6b1ac00640 1 -- 172.21.15.55:0/4134218716 wait complete. 2024-04-02T07:23:04.490 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:23:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.628+0000 7f794ba00640 1 Processor -- start 2024-04-02T07:23:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.628+0000 7f794ba00640 1 -- start start 2024-04-02T07:23:04.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.628+0000 7f794ba00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f79440709b0 0x7f79440b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.628+0000 7f794ba00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f79440b2fd0 0x7f79440b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.628+0000 7f794ba00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f794415e3a0 con 0x7f7944144260 2024-04-02T07:23:04.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.628+0000 7f794ba00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79440b37c0 con 0x7f79440b2fd0 2024-04-02T07:23:04.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.628+0000 7f794ba00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f794415e5f0 con 0x7f79440709b0 2024-04-02T07:23:04.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.628+0000 7f7949000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7944144260 0x7f79440702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43898/0 (socket says 172.21.15.55:43898) 2024-04-02T07:23:04.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.628+0000 7f7949000640 1 -- 172.21.15.55:0/3940796172 learned_addr learned my addr 172.21.15.55:0/3940796172 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.628+0000 7f793be00640 1 --2- 172.21.15.55:0/3940796172 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f79440709b0 0x7f79440b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.628+0000 7f7943e00640 1 -- 172.21.15.55:0/3940796172 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644908344 0 0) 0x7f794415e3a0 con 0x7f7944144260 2024-04-02T07:23:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7943e00640 1 -- 172.21.15.55:0/3940796172 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7928003530 con 0x7f7944144260 2024-04-02T07:23:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.628+0000 7f7949a00640 1 --2- 172.21.15.55:0/3940796172 >> v2:172.21.15.106:3300/0 conn(0x7f79440b2fd0 0x7f79440b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7943e00640 1 -- 172.21.15.55:0/3940796172 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 356515208 0 0) 0x7f7928003530 con 0x7f7944144260 2024-04-02T07:23:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7943e00640 1 -- 172.21.15.55:0/3940796172 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f79440709b0 msgr2=0x7f79440b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7943e00640 1 --2- 172.21.15.55:0/3940796172 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f79440709b0 0x7f79440b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7943e00640 1 -- 172.21.15.55:0/3940796172 >> v2:172.21.15.106:3300/0 conn(0x7f79440b2fd0 msgr2=0x7f79440b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7943e00640 1 --2- 172.21.15.55:0/3940796172 >> v2:172.21.15.106:3300/0 conn(0x7f79440b2fd0 0x7f79440b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7943e00640 1 -- 172.21.15.55:0/3940796172 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f794415e8d0 con 0x7f7944144260 2024-04-02T07:23:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7943e00640 1 -- 172.21.15.55:0/3940796172 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f7934001680 con 0x7f7944144260 2024-04-02T07:23:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7943e00640 1 -- 172.21.15.55:0/3940796172 >> v1:172.21.15.55:6789/0 conn(0x7f7944144260 legacy=0x7f79440702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7943e00640 1 --2- 172.21.15.55:0/3940796172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7928003980 0x7f7928003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7943e00640 1 --2- 172.21.15.55:0/3940796172 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f79440709b0 0x7f79280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7943e00640 1 --2- 172.21.15.55:0/3940796172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7928004d10 0x7f7928005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7943e00640 1 -- 172.21.15.55:0/3940796172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79440b37c0 con 0x7f7928004d10 2024-04-02T07:23:04.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7943e00640 1 -- 172.21.15.55:0/3940796172 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f794415e5f0 con 0x7f7928003980 2024-04-02T07:23:04.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7943e00640 1 -- 172.21.15.55:0/3940796172 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f792800b990 con 0x7f79440709b0 2024-04-02T07:23:04.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7949a00640 1 --2- 172.21.15.55:0/3940796172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7928004d10 0x7f7928005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f793be00640 1 --2- 172.21.15.55:0/3940796172 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f79440709b0 0x7f79280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7949000640 1 --2- 172.21.15.55:0/3940796172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7928003980 0x7f7928003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7949a00640 1 -- 172.21.15.55:0/3940796172 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f79440709b0 msgr2=0x7f79280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:04.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7949a00640 1 --2- 172.21.15.55:0/3940796172 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f79440709b0 0x7f79280047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7949a00640 1 -- 172.21.15.55:0/3940796172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7928003980 msgr2=0x7f7928003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:04.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7949a00640 1 --2- 172.21.15.55:0/3940796172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7928003980 0x7f7928003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7949a00640 1 -- 172.21.15.55:0/3940796172 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7928003530 con 0x7f7928004d10 2024-04-02T07:23:04.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.632+0000 7f7949000640 1 --2- 172.21.15.55:0/3940796172 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7928003980 0x7f7928003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f7949a00640 1 --2- 172.21.15.55:0/3940796172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7928004d10 0x7f7928005190 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f793c00e170 tx=0x7f793c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b4dcf7555d9c9b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:04.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f7943e00640 1 -- 172.21.15.55:0/3940796172 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c0a5cb0 con 0x7f7928004d10 2024-04-02T07:23:04.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f7943e00640 1 -- 172.21.15.55:0/3940796172 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f793c00f040 con 0x7f7928004d10 2024-04-02T07:23:04.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f7943e00640 1 -- 172.21.15.55:0/3940796172 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f793c0ad680 con 0x7f7928004d10 2024-04-02T07:23:04.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f794ba00640 1 -- 172.21.15.55:0/3940796172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7928004d10 msgr2=0x7f7928005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:04.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f794ba00640 1 --2- 172.21.15.55:0/3940796172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7928004d10 0x7f7928005190 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f793c00e170 tx=0x7f793c01cca0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f7949a00640 1 -- 172.21.15.55:0/3940796172 reap_dead start 2024-04-02T07:23:04.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f794ba00640 1 -- 172.21.15.55:0/3940796172 shutdown_connections 2024-04-02T07:23:04.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f794ba00640 1 -- 172.21.15.55:0/3940796172 >> 172.21.15.55:0/3940796172 conn(0x7f794406a390 msgr2=0x7f79440b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:04.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f794ba00640 1 -- 172.21.15.55:0/3940796172 shutdown_connections 2024-04-02T07:23:04.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f794ba00640 1 -- 172.21.15.55:0/3940796172 wait complete. 2024-04-02T07:23:04.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f794ba00640 1 Processor -- start 2024-04-02T07:23:04.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f794ba00640 1 -- start start 2024-04-02T07:23:04.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f794ba00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7928004d10 0x7f79440c4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f794ba00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f794415d640 0x7f7944142e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f794ba00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7944143390 0x7f794415aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f794ba00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7944143810 con 0x7f794415d640 2024-04-02T07:23:04.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f794ba00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79440c3b40 con 0x7f7928004d10 2024-04-02T07:23:04.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f794ba00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79440c43e0 con 0x7f7944143390 2024-04-02T07:23:04.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f793be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f794415d640 0x7f7944142e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f793be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f794415d640 0x7f7944142e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43702/0 (socket says 172.21.15.55:43702) 2024-04-02T07:23:04.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.636+0000 7f793be00640 1 -- 172.21.15.55:0/2634086891 learned_addr learned my addr 172.21.15.55:0/2634086891 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:04.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.640+0000 7f7949000640 1 --2- 172.21.15.55:0/2634086891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7928004d10 0x7f79440c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.640+0000 7f7949a00640 1 --2- 172.21.15.55:0/2634086891 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7944143390 0x7f794415aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.640+0000 7f793be00640 1 -- 172.21.15.55:0/2634086891 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7944143390 msgr2=0x7f794415aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:04.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.640+0000 7f793be00640 1 --2- 172.21.15.55:0/2634086891 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7944143390 0x7f794415aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.640+0000 7f793be00640 1 -- 172.21.15.55:0/2634086891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7928004d10 msgr2=0x7f79440c4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:04.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.640+0000 7f793be00640 1 --2- 172.21.15.55:0/2634086891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7928004d10 0x7f79440c4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.640+0000 7f793be00640 1 -- 172.21.15.55:0/2634086891 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79440c4db0 con 0x7f794415d640 2024-04-02T07:23:04.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.640+0000 7f793be00640 1 --2- 172.21.15.55:0/2634086891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f794415d640 0x7f7944142e50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f792c011970 tx=0x7f792c011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:04.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.640+0000 7f7941600640 1 -- 172.21.15.55:0/2634086891 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c004240 con 0x7f794415d640 2024-04-02T07:23:04.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.640+0000 7f7941600640 1 -- 172.21.15.55:0/2634086891 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f792c0043a0 con 0x7f794415d640 2024-04-02T07:23:04.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.640+0000 7f794ba00640 1 -- 172.21.15.55:0/2634086891 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f794415bd20 con 0x7f794415d640 2024-04-02T07:23:04.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.640+0000 7f7941600640 1 -- 172.21.15.55:0/2634086891 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f792c00fa40 con 0x7f794415d640 2024-04-02T07:23:04.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.640+0000 7f794ba00640 1 -- 172.21.15.55:0/2634086891 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79440c4070 con 0x7f794415d640 2024-04-02T07:23:04.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.640+0000 7f794ba00640 1 -- 172.21.15.55:0/2634086891 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7944073530 con 0x7f794415d640 2024-04-02T07:23:04.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.640+0000 7f7941600640 1 -- 172.21.15.55:0/2634086891 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f792c00fba0 con 0x7f794415d640 2024-04-02T07:23:04.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.640+0000 7f7941600640 1 --2- 172.21.15.55:0/2634086891 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f79200666c0 0x7f7920068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.640+0000 7f7941600640 1 -- 172.21.15.55:0/2634086891 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f792c084870 con 0x7f794415d640 2024-04-02T07:23:04.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.644+0000 7f7949000640 1 --2- 172.21.15.55:0/2634086891 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f79200666c0 0x7f7920068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.644+0000 7f7949000640 1 --2- 172.21.15.55:0/2634086891 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f79200666c0 0x7f7920068b80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7944158190 tx=0x7f7934007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:04.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.644+0000 7f7941600640 1 -- 172.21.15.55:0/2634086891 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f792c055600 con 0x7f794415d640 2024-04-02T07:23:04.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.804+0000 7f794ba00640 1 -- 172.21.15.55:0/2634086891 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7944066c90 con 0x7f794415d640 2024-04-02T07:23:04.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.804+0000 7f7941600640 1 -- 172.21.15.55:0/2634086891 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f792c023020 con 0x7f794415d640 2024-04-02T07:23:04.811 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:23:04.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.808+0000 7f794ba00640 1 -- 172.21.15.55:0/2634086891 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f79200666c0 msgr2=0x7f7920068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:04.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.808+0000 7f794ba00640 1 --2- 172.21.15.55:0/2634086891 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f79200666c0 0x7f7920068b80 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7944158190 tx=0x7f7934007040 comp rx=0 tx=0).stop 2024-04-02T07:23:04.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.808+0000 7f794ba00640 1 -- 172.21.15.55:0/2634086891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f794415d640 msgr2=0x7f7944142e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:04.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.808+0000 7f794ba00640 1 --2- 172.21.15.55:0/2634086891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f794415d640 0x7f7944142e50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f792c011970 tx=0x7f792c011d70 comp rx=0 tx=0).stop 2024-04-02T07:23:04.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.808+0000 7f794ba00640 1 -- 172.21.15.55:0/2634086891 shutdown_connections 2024-04-02T07:23:04.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.808+0000 7f794ba00640 1 --2- 172.21.15.55:0/2634086891 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7944143390 0x7f794415aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.808+0000 7f794ba00640 1 --2- 172.21.15.55:0/2634086891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f794415d640 0x7f7944142e50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.808+0000 7f794ba00640 1 --2- 172.21.15.55:0/2634086891 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f79200666c0 0x7f7920068b80 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.808+0000 7f794ba00640 1 --2- 172.21.15.55:0/2634086891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7928004d10 0x7f79440c4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.808+0000 7f794ba00640 1 -- 172.21.15.55:0/2634086891 >> 172.21.15.55:0/2634086891 conn(0x7f794406a390 msgr2=0x7f79440b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:04.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.808+0000 7f794ba00640 1 -- 172.21.15.55:0/2634086891 shutdown_connections 2024-04-02T07:23:04.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.808+0000 7f794ba00640 1 -- 172.21.15.55:0/2634086891 wait complete. 2024-04-02T07:23:04.832 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:23:04.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.968+0000 7fb1e4c00640 1 Processor -- start 2024-04-02T07:23:04.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.968+0000 7fb1e4c00640 1 -- start start 2024-04-02T07:23:04.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1e4c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb1e00b1650 0x7fb1e00cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1e4c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1e00cb1f0 0x7fb1e00cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1e4c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e00ce990 con 0x7fb1e0160230 2024-04-02T07:23:04.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1e4c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e0160610 con 0x7fb1e00b1650 2024-04-02T07:23:04.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1e4c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e00cf4f0 con 0x7fb1e00cb1f0 2024-04-02T07:23:04.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dde00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb1e0160230 0x7fb1e006bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43914/0 (socket says 172.21.15.55:43914) 2024-04-02T07:23:04.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dde00640 1 -- 172.21.15.55:0/450156356 learned_addr learned my addr 172.21.15.55:0/450156356 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:04.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1de800640 1 --2- 172.21.15.55:0/450156356 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1e00cb1f0 0x7fb1e00cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1d7e00640 1 --2- 172.21.15.55:0/450156356 >> v2:172.21.15.106:3300/0 conn(0x7fb1e00b1650 0x7fb1e00cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dd400640 1 -- 172.21.15.55:0/450156356 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 144872209 0 0) 0x7fb1e00ce990 con 0x7fb1e0160230 2024-04-02T07:23:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dd400640 1 -- 172.21.15.55:0/450156356 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1c4003530 con 0x7fb1e0160230 2024-04-02T07:23:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dd400640 1 -- 172.21.15.55:0/450156356 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3157227773 0 0) 0x7fb1c4003530 con 0x7fb1e0160230 2024-04-02T07:23:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dd400640 1 -- 172.21.15.55:0/450156356 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1e00cb1f0 msgr2=0x7fb1e00cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dd400640 1 --2- 172.21.15.55:0/450156356 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1e00cb1f0 0x7fb1e00cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dd400640 1 -- 172.21.15.55:0/450156356 >> v2:172.21.15.106:3300/0 conn(0x7fb1e00b1650 msgr2=0x7fb1e00cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dd400640 1 --2- 172.21.15.55:0/450156356 >> v2:172.21.15.106:3300/0 conn(0x7fb1e00b1650 0x7fb1e00cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dd400640 1 -- 172.21.15.55:0/450156356 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e00cebc0 con 0x7fb1e0160230 2024-04-02T07:23:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dd400640 1 -- 172.21.15.55:0/450156356 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fb1d0001680 con 0x7fb1e0160230 2024-04-02T07:23:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dd400640 1 -- 172.21.15.55:0/450156356 >> v1:172.21.15.55:6789/0 conn(0x7fb1e0160230 legacy=0x7fb1e006bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dd400640 1 --2- 172.21.15.55:0/450156356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1c4003980 0x7fb1c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dd400640 1 --2- 172.21.15.55:0/450156356 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1e00cb1f0 0x7fb1c40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dd400640 1 --2- 172.21.15.55:0/450156356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1c4004d10 0x7fb1c4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dd400640 1 -- 172.21.15.55:0/450156356 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e0160610 con 0x7fb1c4003980 2024-04-02T07:23:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dd400640 1 -- 172.21.15.55:0/450156356 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e00cf4f0 con 0x7fb1c4004d10 2024-04-02T07:23:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dd400640 1 -- 172.21.15.55:0/450156356 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1c400b9c0 con 0x7fb1e00cb1f0 2024-04-02T07:23:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dde00640 1 --2- 172.21.15.55:0/450156356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1c4003980 0x7fb1c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1d7e00640 1 --2- 172.21.15.55:0/450156356 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1e00cb1f0 0x7fb1c40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1de800640 1 --2- 172.21.15.55:0/450156356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1c4004d10 0x7fb1c4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dde00640 1 -- 172.21.15.55:0/450156356 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1e00cb1f0 msgr2=0x7fb1c40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dde00640 1 --2- 172.21.15.55:0/450156356 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1e00cb1f0 0x7fb1c40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dde00640 1 -- 172.21.15.55:0/450156356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1c4004d10 msgr2=0x7fb1c4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dde00640 1 --2- 172.21.15.55:0/450156356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1c4004d10 0x7fb1c4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1dde00640 1 -- 172.21.15.55:0/450156356 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c4003530 con 0x7fb1c4003980 2024-04-02T07:23:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1de800640 1 --2- 172.21.15.55:0/450156356 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1c4004d10 0x7fb1c4005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.972+0000 7fb1d7e00640 1 --2- 172.21.15.55:0/450156356 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1e00cb1f0 0x7fb1c40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.976+0000 7fb1dde00640 1 --2- 172.21.15.55:0/450156356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1c4003980 0x7fb1c4003da0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000c240 tx=0x7fb1d001cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ae2a8fa6216972 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.976+0000 7fb1dd400640 1 -- 172.21.15.55:0/450156356 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d00058e0 con 0x7fb1c4003980 2024-04-02T07:23:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.976+0000 7fb1dd400640 1 -- 172.21.15.55:0/450156356 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d0005a40 con 0x7fb1c4003980 2024-04-02T07:23:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.976+0000 7fb1dd400640 1 -- 172.21.15.55:0/450156356 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0005e10 con 0x7fb1c4003980 2024-04-02T07:23:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.976+0000 7fb1e4c00640 1 -- 172.21.15.55:0/450156356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1c4003980 msgr2=0x7fb1c4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.976+0000 7fb1e4c00640 1 --2- 172.21.15.55:0/450156356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1c4003980 0x7fb1c4003da0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb1d000c240 tx=0x7fb1d001cc80 comp rx=0 tx=0).stop 2024-04-02T07:23:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.976+0000 7fb1de800640 1 -- 172.21.15.55:0/450156356 reap_dead start 2024-04-02T07:23:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.976+0000 7fb1e4c00640 1 -- 172.21.15.55:0/450156356 shutdown_connections 2024-04-02T07:23:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.976+0000 7fb1e4c00640 1 -- 172.21.15.55:0/450156356 >> 172.21.15.55:0/450156356 conn(0x7fb1e00b2150 msgr2=0x7fb1e00b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.976+0000 7fb1e4c00640 1 -- 172.21.15.55:0/450156356 shutdown_connections 2024-04-02T07:23:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.976+0000 7fb1e4c00640 1 -- 172.21.15.55:0/450156356 wait complete. 2024-04-02T07:23:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.976+0000 7fb1e4c00640 1 Processor -- start 2024-04-02T07:23:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.976+0000 7fb1e4c00640 1 -- start start 2024-04-02T07:23:04.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1e4c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1c4003980 0x7fb1e01fa420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1e4c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1e00cb600 0x7fb1e01f8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1e4c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1e00990d0 0x7fb1e0099550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1e4c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e0099a90 con 0x7fb1e00cb600 2024-04-02T07:23:04.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1e4c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e00c7940 con 0x7fb1e00990d0 2024-04-02T07:23:04.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1e4c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e00cbd70 con 0x7fb1c4003980 2024-04-02T07:23:04.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1d7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1e00cb600 0x7fb1e01f8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1d7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1e00cb600 0x7fb1e01f8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43714/0 (socket says 172.21.15.55:43714) 2024-04-02T07:23:04.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1d7e00640 1 -- 172.21.15.55:0/1937699057 learned_addr learned my addr 172.21.15.55:0/1937699057 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:04.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1dde00640 1 --2- 172.21.15.55:0/1937699057 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1c4003980 0x7fb1e01fa420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1de800640 1 --2- 172.21.15.55:0/1937699057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1e00990d0 0x7fb1e0099550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1d7e00640 1 -- 172.21.15.55:0/1937699057 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1c4003980 msgr2=0x7fb1e01fa420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:04.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1d7e00640 1 --2- 172.21.15.55:0/1937699057 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1c4003980 0x7fb1e01fa420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1d7e00640 1 -- 172.21.15.55:0/1937699057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1e00990d0 msgr2=0x7fb1e0099550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:04.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1d7e00640 1 --2- 172.21.15.55:0/1937699057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1e00990d0 0x7fb1e0099550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:04.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1d7e00640 1 -- 172.21.15.55:0/1937699057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e00cc050 con 0x7fb1e00cb600 2024-04-02T07:23:04.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1de800640 1 --2- 172.21.15.55:0/1937699057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1e00990d0 0x7fb1e0099550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:04.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1d7e00640 1 --2- 172.21.15.55:0/1937699057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1e00cb600 0x7fb1e01f8f20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8009fd0 tx=0x7fb1c8011b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:04.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1d6000640 1 -- 172.21.15.55:0/1937699057 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c8004220 con 0x7fb1e00cb600 2024-04-02T07:23:04.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1d6000640 1 -- 172.21.15.55:0/1937699057 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1c8004380 con 0x7fb1e00cb600 2024-04-02T07:23:04.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1d6000640 1 -- 172.21.15.55:0/1937699057 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1c800f9e0 con 0x7fb1e00cb600 2024-04-02T07:23:04.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1e4c00640 1 -- 172.21.15.55:0/1937699057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1e00cc330 con 0x7fb1e00cb600 2024-04-02T07:23:04.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1e4c00640 1 -- 172.21.15.55:0/1937699057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e00cba80 con 0x7fb1e00cb600 2024-04-02T07:23:04.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1e4c00640 1 -- 172.21.15.55:0/1937699057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e00b65b0 con 0x7fb1e00cb600 2024-04-02T07:23:04.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.980+0000 7fb1d6000640 1 -- 172.21.15.55:0/1937699057 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb1c800fb40 con 0x7fb1e00cb600 2024-04-02T07:23:04.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.984+0000 7fb1d6000640 1 --2- 172.21.15.55:0/1937699057 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb1bc066690 0x7fb1bc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:04.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.984+0000 7fb1d6000640 1 -- 172.21.15.55:0/1937699057 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fb1c8084750 con 0x7fb1e00cb600 2024-04-02T07:23:04.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.984+0000 7fb1dde00640 1 --2- 172.21.15.55:0/1937699057 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb1bc066690 0x7fb1bc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:04.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.984+0000 7fb1dde00640 1 --2- 172.21.15.55:0/1937699057 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb1bc066690 0x7fb1bc068b50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00aa000 tx=0x7fb1d0001a80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:04.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:04.988+0000 7fb1d6000640 1 -- 172.21.15.55:0/1937699057 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fb1c8051a50 con 0x7fb1e00cb600 2024-04-02T07:23:05.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.160+0000 7fb1e4c00640 1 -- 172.21.15.55:0/1937699057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb1e0066c90 con 0x7fb1e00cb600 2024-04-02T07:23:05.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.160+0000 7fb1d6000640 1 -- 172.21.15.55:0/1937699057 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb1c8055070 con 0x7fb1e00cb600 2024-04-02T07:23:05.167 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:23:05.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.164+0000 7fb1e4c00640 1 -- 172.21.15.55:0/1937699057 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb1bc066690 msgr2=0x7fb1bc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:05.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.164+0000 7fb1e4c00640 1 --2- 172.21.15.55:0/1937699057 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb1bc066690 0x7fb1bc068b50 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00aa000 tx=0x7fb1d0001a80 comp rx=0 tx=0).stop 2024-04-02T07:23:05.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.164+0000 7fb1e4c00640 1 -- 172.21.15.55:0/1937699057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1e00cb600 msgr2=0x7fb1e01f8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:05.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.164+0000 7fb1e4c00640 1 --2- 172.21.15.55:0/1937699057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1e00cb600 0x7fb1e01f8f20 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb1c8009fd0 tx=0x7fb1c8011b30 comp rx=0 tx=0).stop 2024-04-02T07:23:05.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.164+0000 7fb1e4c00640 1 -- 172.21.15.55:0/1937699057 shutdown_connections 2024-04-02T07:23:05.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.164+0000 7fb1e4c00640 1 --2- 172.21.15.55:0/1937699057 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb1bc066690 0x7fb1bc068b50 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.164+0000 7fb1e4c00640 1 --2- 172.21.15.55:0/1937699057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1e00990d0 0x7fb1e0099550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.164+0000 7fb1e4c00640 1 --2- 172.21.15.55:0/1937699057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1e00cb600 0x7fb1e01f8f20 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.164+0000 7fb1e4c00640 1 --2- 172.21.15.55:0/1937699057 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1c4003980 0x7fb1e01fa420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.164+0000 7fb1e4c00640 1 -- 172.21.15.55:0/1937699057 >> 172.21.15.55:0/1937699057 conn(0x7fb1e00b2150 msgr2=0x7fb1e006e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:05.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.164+0000 7fb1e4c00640 1 -- 172.21.15.55:0/1937699057 shutdown_connections 2024-04-02T07:23:05.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.164+0000 7fb1e4c00640 1 -- 172.21.15.55:0/1937699057 wait complete. 2024-04-02T07:23:05.187 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi106.front.sepia.ceph.com... 2024-04-02T07:23:05.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:05.187 DEBUG:teuthology.orchestra.run.smithi106:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-04-02T07:23:05.210 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:23:05.210 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:23:05.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:05.210 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-02T07:23:05.266 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-02T07:23:05.266 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:23:05.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.400+0000 7fadf6200640 1 Processor -- start 2024-04-02T07:23:05.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.400+0000 7fadf6200640 1 -- start start 2024-04-02T07:23:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.404+0000 7fadf6200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fadf0153ea0 0x7fadf00c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.404+0000 7fadf6200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fadf0159be0 0x7fadf00b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.404+0000 7fadf6200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fadf015a040 0x7fadf00b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.404+0000 7fadf6200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf013d0c0 con 0x7fadf0159be0 2024-04-02T07:23:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.404+0000 7fadf6200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadf015a4f0 con 0x7fadf015a040 2024-04-02T07:23:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.404+0000 7fadf6200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf015a7d0 con 0x7fadf0153ea0 2024-04-02T07:23:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.404+0000 7fade7e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fadf0159be0 0x7fadf00b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.404+0000 7fade7e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fadf0159be0 0x7fadf00b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43718/0 (socket says 172.21.15.55:43718) 2024-04-02T07:23:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.404+0000 7fade7e00640 1 -- 172.21.15.55:0/2427265848 learned_addr learned my addr 172.21.15.55:0/2427265848 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.404+0000 7fadef400640 1 --2- 172.21.15.55:0/2427265848 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fadf0153ea0 0x7fadf00c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.404+0000 7fadefe00640 1 --2- 172.21.15.55:0/2427265848 >> v2:172.21.15.106:3300/0 conn(0x7fadf015a040 0x7fadf00b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.404+0000 7fade7e00640 1 -- 172.21.15.55:0/2427265848 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fadf0153ea0 msgr2=0x7fadf00c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:05.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.404+0000 7fade7e00640 1 --2- 172.21.15.55:0/2427265848 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fadf0153ea0 0x7fadf00c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.404+0000 7fade7e00640 1 -- 172.21.15.55:0/2427265848 >> v2:172.21.15.106:3300/0 conn(0x7fadf015a040 msgr2=0x7fadf00b36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:05.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.404+0000 7fade7e00640 1 --2- 172.21.15.55:0/2427265848 >> v2:172.21.15.106:3300/0 conn(0x7fadf015a040 0x7fadf00b36f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.404+0000 7fade7e00640 1 -- 172.21.15.55:0/2427265848 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf015aab0 con 0x7fadf0159be0 2024-04-02T07:23:05.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fade7e00640 1 --2- 172.21.15.55:0/2427265848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadf0159be0 0x7fadf00b31b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fadf0072500 tx=0x7fadd801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb6a6ffb441530b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:05.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fadeea00640 1 -- 172.21.15.55:0/2427265848 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd80aa660 con 0x7fadf0159be0 2024-04-02T07:23:05.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fadeea00640 1 -- 172.21.15.55:0/2427265848 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd80aa7c0 con 0x7fadf0159be0 2024-04-02T07:23:05.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fadeea00640 1 -- 172.21.15.55:0/2427265848 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd80aab50 con 0x7fadf0159be0 2024-04-02T07:23:05.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fadf6200640 1 -- 172.21.15.55:0/2427265848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadf0159be0 msgr2=0x7fadf00b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:05.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fadf6200640 1 --2- 172.21.15.55:0/2427265848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadf0159be0 0x7fadf00b31b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fadf0072500 tx=0x7fadd801c520 comp rx=0 tx=0).stop 2024-04-02T07:23:05.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fadf6200640 1 -- 172.21.15.55:0/2427265848 shutdown_connections 2024-04-02T07:23:05.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fadf6200640 1 --2- 172.21.15.55:0/2427265848 >> v2:172.21.15.106:3300/0 conn(0x7fadf015a040 0x7fadf00b36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fadf6200640 1 --2- 172.21.15.55:0/2427265848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadf0159be0 0x7fadf00b31b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fadf6200640 1 --2- 172.21.15.55:0/2427265848 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fadf0153ea0 0x7fadf00c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fadf6200640 1 -- 172.21.15.55:0/2427265848 >> 172.21.15.55:0/2427265848 conn(0x7fadf0066080 msgr2=0x7fadf0069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:05.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fadf6200640 1 -- 172.21.15.55:0/2427265848 shutdown_connections 2024-04-02T07:23:05.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fadf6200640 1 -- 172.21.15.55:0/2427265848 wait complete. 2024-04-02T07:23:05.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fadf6200640 1 Processor -- start 2024-04-02T07:23:05.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fadf6200640 1 -- start start 2024-04-02T07:23:05.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fadf6200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fadf0153ea0 0x7fadf013dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:05.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fadf6200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadf0159be0 0x7fadf0152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:05.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fadf6200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadf015a040 0x7fadf0152340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:05.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fadf6200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00cb0f0 con 0x7fadf0159be0 2024-04-02T07:23:05.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fadf6200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf01599e0 con 0x7fadf015a040 2024-04-02T07:23:05.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.408+0000 7fadf6200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00c9ea0 con 0x7fadf0153ea0 2024-04-02T07:23:05.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.412+0000 7fade7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadf0159be0 0x7fadf0152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:05.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.412+0000 7fade7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadf0159be0 0x7fadf0152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43722/0 (socket says 172.21.15.55:43722) 2024-04-02T07:23:05.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.412+0000 7fade7e00640 1 -- 172.21.15.55:0/3858943757 learned_addr learned my addr 172.21.15.55:0/3858943757 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:05.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.412+0000 7fadefe00640 1 --2- 172.21.15.55:0/3858943757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadf015a040 0x7fadf0152340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:05.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.412+0000 7fadef400640 1 --2- 172.21.15.55:0/3858943757 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fadf0153ea0 0x7fadf013dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:05.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.412+0000 7fade7e00640 1 -- 172.21.15.55:0/3858943757 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fadf0153ea0 msgr2=0x7fadf013dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:05.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.412+0000 7fade7e00640 1 --2- 172.21.15.55:0/3858943757 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fadf0153ea0 0x7fadf013dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.412+0000 7fade7e00640 1 -- 172.21.15.55:0/3858943757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadf015a040 msgr2=0x7fadf0152340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:05.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.412+0000 7fade7e00640 1 --2- 172.21.15.55:0/3858943757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadf015a040 0x7fadf0152340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.412+0000 7fade7e00640 1 -- 172.21.15.55:0/3858943757 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd80094d0 con 0x7fadf0159be0 2024-04-02T07:23:05.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.412+0000 7fadef400640 1 --2- 172.21.15.55:0/3858943757 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fadf0153ea0 0x7fadf013dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:23:05.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.412+0000 7fade7e00640 1 --2- 172.21.15.55:0/3858943757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadf0159be0 0x7fadf0152f00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fadd801ca00 tx=0x7fadd801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:05.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.412+0000 7fade7400640 1 -- 172.21.15.55:0/3858943757 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd80b3800 con 0x7fadf0159be0 2024-04-02T07:23:05.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.412+0000 7fade7400640 1 -- 172.21.15.55:0/3858943757 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd80b3980 con 0x7fadf0159be0 2024-04-02T07:23:05.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.412+0000 7fade7400640 1 -- 172.21.15.55:0/3858943757 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd80b3d30 con 0x7fadf0159be0 2024-04-02T07:23:05.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.412+0000 7fadf6200640 1 -- 172.21.15.55:0/3858943757 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf0140d10 con 0x7fadf0159be0 2024-04-02T07:23:05.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.412+0000 7fadf6200640 1 -- 172.21.15.55:0/3858943757 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf0069f20 con 0x7fadf0159be0 2024-04-02T07:23:05.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.412+0000 7fadf6200640 1 -- 172.21.15.55:0/3858943757 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf0066c90 con 0x7fadf0159be0 2024-04-02T07:23:05.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.412+0000 7fade7400640 1 -- 172.21.15.55:0/3858943757 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fadd80bd3f0 con 0x7fadf0159be0 2024-04-02T07:23:05.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.416+0000 7fade7400640 1 --2- 172.21.15.55:0/3858943757 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fadcc066690 0x7fadcc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:05.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.416+0000 7fade7400640 1 -- 172.21.15.55:0/3858943757 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fadd80a6040 con 0x7fadf0159be0 2024-04-02T07:23:05.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.416+0000 7fadef400640 1 --2- 172.21.15.55:0/3858943757 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fadcc066690 0x7fadcc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:05.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.416+0000 7fadef400640 1 --2- 172.21.15.55:0/3858943757 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fadcc066690 0x7fadcc068b50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fadf006ad30 tx=0x7fade0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:05.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.416+0000 7fade7400640 1 -- 172.21.15.55:0/3858943757 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fadd80ebe60 con 0x7fadf0159be0 2024-04-02T07:23:05.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.612+0000 7fadf6200640 1 -- 172.21.15.55:0/3858943757 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fadf00ca830 con 0x7fadf0159be0 2024-04-02T07:23:05.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.612+0000 7fade7400640 1 -- 172.21.15.55:0/3858943757 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4725 (secure 0 0 0) 0x7fadd80ef480 con 0x7fadf0159be0 2024-04-02T07:23:05.617 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:05.617 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1468533802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1468533802},{"type":"v1","addr":"172.21.15.106:6837","nonce":1468533802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/342047131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":342047131},{"type":"v1","addr":"172.21.15.55:6833","nonce":342047131}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/50847499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":50847499},{"type":"v1","addr":"172.21.15.55:6835","nonce":50847499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:22:18.201059+0000","modified":"2024-04-02T07:22:21.225641+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6836/3829467285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3829467285},{"type":"v1","addr":"172.21.15.106:6836","nonce":3829467285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-02T07:23:05.617 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2024-04-02T07:23:05.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.612+0000 7fadf6200640 1 -- 172.21.15.55:0/3858943757 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fadcc066690 msgr2=0x7fadcc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:05.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.612+0000 7fadf6200640 1 --2- 172.21.15.55:0/3858943757 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fadcc066690 0x7fadcc068b50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fadf006ad30 tx=0x7fade0008040 comp rx=0 tx=0).stop 2024-04-02T07:23:05.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.612+0000 7fadf6200640 1 -- 172.21.15.55:0/3858943757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadf0159be0 msgr2=0x7fadf0152f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:05.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.612+0000 7fadf6200640 1 --2- 172.21.15.55:0/3858943757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadf0159be0 0x7fadf0152f00 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fadd801ca00 tx=0x7fadd801ad60 comp rx=0 tx=0).stop 2024-04-02T07:23:05.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.612+0000 7fadf6200640 1 -- 172.21.15.55:0/3858943757 shutdown_connections 2024-04-02T07:23:05.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.612+0000 7fadf6200640 1 --2- 172.21.15.55:0/3858943757 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fadcc066690 0x7fadcc068b50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.612+0000 7fadf6200640 1 --2- 172.21.15.55:0/3858943757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fadf015a040 0x7fadf0152340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.612+0000 7fadf6200640 1 --2- 172.21.15.55:0/3858943757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fadf0159be0 0x7fadf0152f00 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.612+0000 7fadf6200640 1 --2- 172.21.15.55:0/3858943757 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fadf0153ea0 0x7fadf013dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.612+0000 7fadf6200640 1 -- 172.21.15.55:0/3858943757 >> 172.21.15.55:0/3858943757 conn(0x7fadf0066080 msgr2=0x7fadf00b26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:05.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.612+0000 7fadf6200640 1 -- 172.21.15.55:0/3858943757 shutdown_connections 2024-04-02T07:23:05.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.612+0000 7fadf6200640 1 -- 172.21.15.55:0/3858943757 wait complete. 2024-04-02T07:23:05.643 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:23:05.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.776+0000 7f330ee00640 1 Processor -- start 2024-04-02T07:23:05.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.776+0000 7f330ee00640 1 -- start start 2024-04-02T07:23:05.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.780+0000 7f330ee00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3308143f90 0x7f330815ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:05.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.780+0000 7f330ee00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f33080cda80 0x7f33080c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:05.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.780+0000 7f330ee00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f330815b270 con 0x7f33080b34f0 2024-04-02T07:23:05.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.780+0000 7f330ee00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3308144370 con 0x7f3308143f90 2024-04-02T07:23:05.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.780+0000 7f330ee00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33080c37b0 con 0x7f33080cda80 2024-04-02T07:23:05.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.780+0000 7f3307e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3308143f90 0x7f330815ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:05.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.780+0000 7f3307e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3308143f90 0x7f330815ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55154/0 (socket says 172.21.15.55:55154) 2024-04-02T07:23:05.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.780+0000 7f3307e00640 1 -- 172.21.15.55:0/660800616 learned_addr learned my addr 172.21.15.55:0/660800616 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:05.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.780+0000 7f330ce00640 1 --2- 172.21.15.55:0/660800616 >> v2:172.21.15.106:3300/0 conn(0x7f33080cda80 0x7f33080c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:05.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.780+0000 7f3307e00640 1 -- 172.21.15.55:0/660800616 >> v2:172.21.15.106:3300/0 conn(0x7f33080cda80 msgr2=0x7f33080c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:05.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.780+0000 7f3307e00640 1 --2- 172.21.15.55:0/660800616 >> v2:172.21.15.106:3300/0 conn(0x7f33080cda80 0x7f33080c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.780+0000 7f3307e00640 1 -- 172.21.15.55:0/660800616 >> v1:172.21.15.106:6789/0 conn(0x7f33080b34f0 legacy=0x7f33080cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:05.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.780+0000 7f3307e00640 1 -- 172.21.15.55:0/660800616 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33080c3a90 con 0x7f3308143f90 2024-04-02T07:23:05.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.780+0000 7f330ce00640 1 --2- 172.21.15.55:0/660800616 >> v2:172.21.15.106:3300/0 conn(0x7f33080cda80 0x7f33080c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:23:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.784+0000 7f3307e00640 1 --2- 172.21.15.55:0/660800616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3308143f90 0x7f330815ad30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3308144670 tx=0x7f32f801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39aad363958dc3b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.784+0000 7f3306a00640 1 -- 172.21.15.55:0/660800616 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f80ab620 con 0x7f3308143f90 2024-04-02T07:23:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.784+0000 7f3306a00640 1 -- 172.21.15.55:0/660800616 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f80ab780 con 0x7f3308143f90 2024-04-02T07:23:05.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.784+0000 7f3306a00640 1 -- 172.21.15.55:0/660800616 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f80abb10 con 0x7f3308143f90 2024-04-02T07:23:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.784+0000 7f330ee00640 1 -- 172.21.15.55:0/660800616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3308143f90 msgr2=0x7f330815ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.784+0000 7f330ee00640 1 --2- 172.21.15.55:0/660800616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3308143f90 0x7f330815ad30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f3308144670 tx=0x7f32f801c420 comp rx=0 tx=0).stop 2024-04-02T07:23:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.784+0000 7f330ee00640 1 -- 172.21.15.55:0/660800616 shutdown_connections 2024-04-02T07:23:05.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.784+0000 7f330ee00640 1 --2- 172.21.15.55:0/660800616 >> v2:172.21.15.106:3300/0 conn(0x7f33080cda80 0x7f33080c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.784+0000 7f330ee00640 1 --2- 172.21.15.55:0/660800616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3308143f90 0x7f330815ad30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.784+0000 7f330ee00640 1 -- 172.21.15.55:0/660800616 >> 172.21.15.55:0/660800616 conn(0x7f3308066080 msgr2=0x7f3308069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:05.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.784+0000 7f330ee00640 1 -- 172.21.15.55:0/660800616 shutdown_connections 2024-04-02T07:23:05.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.784+0000 7f330ee00640 1 -- 172.21.15.55:0/660800616 wait complete. 2024-04-02T07:23:05.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.784+0000 7f330ee00640 1 Processor -- start 2024-04-02T07:23:05.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.784+0000 7f330ee00640 1 -- start start 2024-04-02T07:23:05.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f330ee00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33080b34f0 0x7f3308136980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:05.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f330ee00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f33080cda80 0x7f330813da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:05.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f330ee00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3308143f90 0x7f3308159630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:05.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f330ee00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330813c010 con 0x7f33080b34f0 2024-04-02T07:23:05.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f330ee00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f330813f560 con 0x7f3308143f90 2024-04-02T07:23:05.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f330ee00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f330813f840 con 0x7f33080cda80 2024-04-02T07:23:05.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f3307e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33080b34f0 0x7f3308136980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:05.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f3307e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33080b34f0 0x7f3308136980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55164/0 (socket says 172.21.15.55:55164) 2024-04-02T07:23:05.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f3307e00640 1 -- 172.21.15.55:0/1821379216 learned_addr learned my addr 172.21.15.55:0/1821379216 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:05.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f330ce00640 1 --2- 172.21.15.55:0/1821379216 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3308143f90 0x7f3308159630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:05.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f3307400640 1 --2- 172.21.15.55:0/1821379216 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f33080cda80 0x7f330813da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:05.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f3307e00640 1 -- 172.21.15.55:0/1821379216 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f33080cda80 msgr2=0x7f330813da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:05.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f3307e00640 1 --2- 172.21.15.55:0/1821379216 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f33080cda80 0x7f330813da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f3307e00640 1 -- 172.21.15.55:0/1821379216 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3308143f90 msgr2=0x7f3308159630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:05.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f3307e00640 1 --2- 172.21.15.55:0/1821379216 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3308143f90 0x7f3308159630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f3307e00640 1 -- 172.21.15.55:0/1821379216 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f80094d0 con 0x7f33080b34f0 2024-04-02T07:23:05.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f330ce00640 1 --2- 172.21.15.55:0/1821379216 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3308143f90 0x7f3308159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:05.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f3307e00640 1 --2- 172.21.15.55:0/1821379216 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33080b34f0 0x7f3308136980 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f32f801a050 tx=0x7f32f801ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:05.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f32ffe00640 1 -- 172.21.15.55:0/1821379216 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f80be3f0 con 0x7f33080b34f0 2024-04-02T07:23:05.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f32ffe00640 1 -- 172.21.15.55:0/1821379216 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32f80be570 con 0x7f33080b34f0 2024-04-02T07:23:05.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f32ffe00640 1 -- 172.21.15.55:0/1821379216 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32f80be920 con 0x7f33080b34f0 2024-04-02T07:23:05.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f330ee00640 1 -- 172.21.15.55:0/1821379216 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f330813fb20 con 0x7f33080b34f0 2024-04-02T07:23:05.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f330ee00640 1 -- 172.21.15.55:0/1821379216 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f330813bba0 con 0x7f33080b34f0 2024-04-02T07:23:05.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f330ee00640 1 -- 172.21.15.55:0/1821379216 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f330813bdc0 con 0x7f33080b34f0 2024-04-02T07:23:05.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.788+0000 7f32ffe00640 1 -- 172.21.15.55:0/1821379216 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f32f80c7440 con 0x7f33080b34f0 2024-04-02T07:23:05.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.792+0000 7f32ffe00640 1 --2- 172.21.15.55:0/1821379216 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f32e80666c0 0x7f32e8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:05.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.792+0000 7f32ffe00640 1 -- 172.21.15.55:0/1821379216 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f33080c55a0 con 0x7f33080b34f0 2024-04-02T07:23:05.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.792+0000 7f3307400640 1 --2- 172.21.15.55:0/1821379216 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f32e80666c0 0x7f32e8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:05.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.792+0000 7f3307400640 1 --2- 172.21.15.55:0/1821379216 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f32e80666c0 0x7f32e8068b80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f33081f8fb0 tx=0x7f32f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.796+0000 7f32ffe00640 1 -- 172.21.15.55:0/1821379216 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f32f80ebcb0 con 0x7f33080b34f0 2024-04-02T07:23:05.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.956+0000 7f330ee00640 1 -- 172.21.15.55:0/1821379216 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3308066c90 con 0x7f33080b34f0 2024-04-02T07:23:05.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.956+0000 7f32ffe00640 1 -- 172.21.15.55:0/1821379216 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16287 (secure 0 0 0) 0x7f32f80ef2d0 con 0x7f33080b34f0 2024-04-02T07:23:05.963 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:05.963 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":22,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:23:00.192054+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:23:05.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.960+0000 7f330ee00640 1 -- 172.21.15.55:0/1821379216 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f32e80666c0 msgr2=0x7f32e8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:05.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.960+0000 7f330ee00640 1 --2- 172.21.15.55:0/1821379216 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f32e80666c0 0x7f32e8068b80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f33081f8fb0 tx=0x7f32f4009040 comp rx=0 tx=0).stop 2024-04-02T07:23:05.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.960+0000 7f330ee00640 1 -- 172.21.15.55:0/1821379216 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33080b34f0 msgr2=0x7f3308136980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:05.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.960+0000 7f330ee00640 1 --2- 172.21.15.55:0/1821379216 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33080b34f0 0x7f3308136980 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f32f801a050 tx=0x7f32f801ac60 comp rx=0 tx=0).stop 2024-04-02T07:23:05.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.960+0000 7f330ee00640 1 -- 172.21.15.55:0/1821379216 shutdown_connections 2024-04-02T07:23:05.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.960+0000 7f330ee00640 1 --2- 172.21.15.55:0/1821379216 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f32e80666c0 0x7f32e8068b80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.960+0000 7f330ee00640 1 --2- 172.21.15.55:0/1821379216 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3308143f90 0x7f3308159630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.960+0000 7f330ee00640 1 --2- 172.21.15.55:0/1821379216 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f33080cda80 0x7f330813da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.960+0000 7f330ee00640 1 --2- 172.21.15.55:0/1821379216 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33080b34f0 0x7f3308136980 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:05.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.960+0000 7f330ee00640 1 -- 172.21.15.55:0/1821379216 >> 172.21.15.55:0/1821379216 conn(0x7f3308066080 msgr2=0x7f33080cde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:05.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.960+0000 7f330ee00640 1 -- 172.21.15.55:0/1821379216 shutdown_connections 2024-04-02T07:23:05.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:05.960+0000 7f330ee00640 1 -- 172.21.15.55:0/1821379216 wait complete. 2024-04-02T07:23:05.985 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:22:16.738297+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:22:17.190496+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:23:05.985 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:23:06.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ee5e00640 1 Processor -- start 2024-04-02T07:23:06.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ee5e00640 1 -- start start 2024-04-02T07:23:06.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ee5e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ee01611f0 0x7f6ee015d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:06.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ee5e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee015dc70 con 0x7f6ee00709b0 2024-04-02T07:23:06.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ee5e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ee0160710 con 0x7f6ee0142f70 2024-04-02T07:23:06.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ee5e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee015df50 con 0x7f6ee01611f0 2024-04-02T07:23:06.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ed6000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6ee00709b0 0x7f6ee015cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50114/0 (socket says 172.21.15.55:50114) 2024-04-02T07:23:06.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ed6000640 1 -- 172.21.15.55:0/954039626 learned_addr learned my addr 172.21.15.55:0/954039626 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6edf400640 1 --2- 172.21.15.55:0/954039626 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ee01611f0 0x7f6ee015d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ede000640 1 -- 172.21.15.55:0/954039626 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 687414004 0 0) 0x7f6ee015dc70 con 0x7f6ee00709b0 2024-04-02T07:23:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ede000640 1 -- 172.21.15.55:0/954039626 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ec4003530 con 0x7f6ee00709b0 2024-04-02T07:23:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ede000640 1 -- 172.21.15.55:0/954039626 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3798234860 0 0) 0x7f6ec4003530 con 0x7f6ee00709b0 2024-04-02T07:23:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ede000640 1 -- 172.21.15.55:0/954039626 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ee01611f0 msgr2=0x7f6ee015d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ede000640 1 --2- 172.21.15.55:0/954039626 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ee01611f0 0x7f6ee015d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ede000640 1 -- 172.21.15.55:0/954039626 >> v1:172.21.15.106:6789/0 conn(0x7f6ee0142f70 legacy=0x7f6ee00702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ede000640 1 -- 172.21.15.55:0/954039626 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee01609f0 con 0x7f6ee00709b0 2024-04-02T07:23:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ede000640 1 -- 172.21.15.55:0/954039626 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f6ec8001a20 con 0x7f6ee00709b0 2024-04-02T07:23:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ede000640 1 -- 172.21.15.55:0/954039626 >> v1:172.21.15.55:6789/0 conn(0x7f6ee00709b0 legacy=0x7f6ee015cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ede000640 1 --2- 172.21.15.55:0/954039626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ec40039b0 0x7f6ec4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ede000640 1 --2- 172.21.15.55:0/954039626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ec40047d0 0x7f6ec4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ede000640 1 --2- 172.21.15.55:0/954039626 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ee01611f0 0x7f6ec4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ede000640 1 -- 172.21.15.55:0/954039626 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee015df50 con 0x7f6ec40047d0 2024-04-02T07:23:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ede000640 1 -- 172.21.15.55:0/954039626 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec400ba40 con 0x7f6ec40039b0 2024-04-02T07:23:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ede000640 1 -- 172.21.15.55:0/954039626 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec400bbb0 con 0x7f6ee01611f0 2024-04-02T07:23:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6ed6000640 1 --2- 172.21.15.55:0/954039626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ec40047d0 0x7f6ec4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6edea00640 1 --2- 172.21.15.55:0/954039626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ec40039b0 0x7f6ec4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.124+0000 7f6edf400640 1 --2- 172.21.15.55:0/954039626 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ee01611f0 0x7f6ec4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.128+0000 7f6ed6000640 1 -- 172.21.15.55:0/954039626 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ee01611f0 msgr2=0x7f6ec4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.128+0000 7f6ed6000640 1 --2- 172.21.15.55:0/954039626 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ee01611f0 0x7f6ec4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.128+0000 7f6ed6000640 1 -- 172.21.15.55:0/954039626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ec40039b0 msgr2=0x7f6ec4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.128+0000 7f6ed6000640 1 --2- 172.21.15.55:0/954039626 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ec40039b0 0x7f6ec4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.128+0000 7f6ed6000640 1 -- 172.21.15.55:0/954039626 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec4003530 con 0x7f6ec40047d0 2024-04-02T07:23:06.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.128+0000 7f6ed6000640 1 --2- 172.21.15.55:0/954039626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ec40047d0 0x7f6ec4004c50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00cd930 tx=0x7f6ec801d1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6adb3e9b17082d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:06.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.128+0000 7f6ede000640 1 -- 172.21.15.55:0/954039626 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec80ad630 con 0x7f6ec40047d0 2024-04-02T07:23:06.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.128+0000 7f6ede000640 1 -- 172.21.15.55:0/954039626 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec80a8070 con 0x7f6ec40047d0 2024-04-02T07:23:06.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.128+0000 7f6ede000640 1 -- 172.21.15.55:0/954039626 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec80ad9f0 con 0x7f6ec40047d0 2024-04-02T07:23:06.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.128+0000 7f6ee5e00640 1 -- 172.21.15.55:0/954039626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ec40047d0 msgr2=0x7f6ec4004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:06.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.128+0000 7f6ee5e00640 1 --2- 172.21.15.55:0/954039626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ec40047d0 0x7f6ec4004c50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6ee00cd930 tx=0x7f6ec801d1e0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.128+0000 7f6edf400640 1 -- 172.21.15.55:0/954039626 reap_dead start 2024-04-02T07:23:06.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.128+0000 7f6ee5e00640 1 -- 172.21.15.55:0/954039626 shutdown_connections 2024-04-02T07:23:06.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.128+0000 7f6ee5e00640 1 -- 172.21.15.55:0/954039626 >> 172.21.15.55:0/954039626 conn(0x7f6ee006a390 msgr2=0x7f6ee00b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:06.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.128+0000 7f6ee5e00640 1 -- 172.21.15.55:0/954039626 shutdown_connections 2024-04-02T07:23:06.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.128+0000 7f6ee5e00640 1 -- 172.21.15.55:0/954039626 wait complete. 2024-04-02T07:23:06.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ee5e00640 1 Processor -- start 2024-04-02T07:23:06.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ee5e00640 1 -- start start 2024-04-02T07:23:06.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ee5e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ec40047d0 0x7f6ee01510b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:06.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ee5e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ee0139910 0x7f6ee0139d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:06.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ee5e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ee014f5a0 0x7f6ee014fa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:06.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ee5e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee0151b70 con 0x7f6ee0139910 2024-04-02T07:23:06.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ee5e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee01515f0 con 0x7f6ec40047d0 2024-04-02T07:23:06.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ee5e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ee013a5e0 con 0x7f6ee014f5a0 2024-04-02T07:23:06.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ed6000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ee0139910 0x7f6ee0139d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:06.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ed6000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ee0139910 0x7f6ee0139d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55184/0 (socket says 172.21.15.55:55184) 2024-04-02T07:23:06.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ed6000640 1 -- 172.21.15.55:0/1029392762 learned_addr learned my addr 172.21.15.55:0/1029392762 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:06.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6edea00640 1 --2- 172.21.15.55:0/1029392762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ec40047d0 0x7f6ee01510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:06.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6edf400640 1 --2- 172.21.15.55:0/1029392762 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ee014f5a0 0x7f6ee014fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:06.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ed6000640 1 -- 172.21.15.55:0/1029392762 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ee014f5a0 msgr2=0x7f6ee014fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:06.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ed6000640 1 --2- 172.21.15.55:0/1029392762 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ee014f5a0 0x7f6ee014fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ed6000640 1 -- 172.21.15.55:0/1029392762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ec40047d0 msgr2=0x7f6ee01510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:06.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ed6000640 1 --2- 172.21.15.55:0/1029392762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ec40047d0 0x7f6ee01510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ed6000640 1 -- 172.21.15.55:0/1029392762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee013a8c0 con 0x7f6ee0139910 2024-04-02T07:23:06.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6edea00640 1 --2- 172.21.15.55:0/1029392762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ec40047d0 0x7f6ee01510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:06.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ed6000640 1 --2- 172.21.15.55:0/1029392762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ee0139910 0x7f6ee0139d90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6ec801da80 tx=0x7f6ec4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:06.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ed7e00640 1 -- 172.21.15.55:0/1029392762 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8004e70 con 0x7f6ee0139910 2024-04-02T07:23:06.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ed7e00640 1 -- 172.21.15.55:0/1029392762 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec8001760 con 0x7f6ee0139910 2024-04-02T07:23:06.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ed7e00640 1 -- 172.21.15.55:0/1029392762 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec8001ad0 con 0x7f6ee0139910 2024-04-02T07:23:06.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ee5e00640 1 -- 172.21.15.55:0/1029392762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ee014eda0 con 0x7f6ee0139910 2024-04-02T07:23:06.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.132+0000 7f6ee5e00640 1 -- 172.21.15.55:0/1029392762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ee013a2d0 con 0x7f6ee0139910 2024-04-02T07:23:06.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.136+0000 7f6ee5e00640 1 -- 172.21.15.55:0/1029392762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ee0073530 con 0x7f6ee0139910 2024-04-02T07:23:06.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.136+0000 7f6ed7e00640 1 -- 172.21.15.55:0/1029392762 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6ec80aa030 con 0x7f6ee0139910 2024-04-02T07:23:06.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.136+0000 7f6ed7e00640 1 --2- 172.21.15.55:0/1029392762 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6ebc0666c0 0x7f6ebc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:06.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.136+0000 7f6ed7e00640 1 -- 172.21.15.55:0/1029392762 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f6ec811edc0 con 0x7f6ee0139910 2024-04-02T07:23:06.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.136+0000 7f6edea00640 1 --2- 172.21.15.55:0/1029392762 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6ebc0666c0 0x7f6ebc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:06.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.136+0000 7f6edea00640 1 --2- 172.21.15.55:0/1029392762 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6ebc0666c0 0x7f6ebc068b80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0007990 tx=0x7f6ed0007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:06.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.140+0000 7f6ed7e00640 1 -- 172.21.15.55:0/1029392762 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6ec80efaa0 con 0x7f6ee0139910 2024-04-02T07:23:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.304+0000 7f6ee5e00640 1 -- 172.21.15.55:0/1029392762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6ee0073530 con 0x7f6ee0139910 2024-04-02T07:23:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.304+0000 7f6ed7e00640 1 -- 172.21.15.55:0/1029392762 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6ec80ef630 con 0x7f6ee0139910 2024-04-02T07:23:06.309 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:23:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.304+0000 7f6ee5e00640 1 -- 172.21.15.55:0/1029392762 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6ebc0666c0 msgr2=0x7f6ebc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.304+0000 7f6ee5e00640 1 --2- 172.21.15.55:0/1029392762 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6ebc0666c0 0x7f6ebc068b80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6ed0007990 tx=0x7f6ed0007900 comp rx=0 tx=0).stop 2024-04-02T07:23:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.304+0000 7f6ee5e00640 1 -- 172.21.15.55:0/1029392762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ee0139910 msgr2=0x7f6ee0139d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.304+0000 7f6ee5e00640 1 --2- 172.21.15.55:0/1029392762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ee0139910 0x7f6ee0139d90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6ec801da80 tx=0x7f6ec4005800 comp rx=0 tx=0).stop 2024-04-02T07:23:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.304+0000 7f6ee5e00640 1 -- 172.21.15.55:0/1029392762 shutdown_connections 2024-04-02T07:23:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.304+0000 7f6ee5e00640 1 --2- 172.21.15.55:0/1029392762 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ee014f5a0 0x7f6ee014fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.304+0000 7f6ee5e00640 1 --2- 172.21.15.55:0/1029392762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ee0139910 0x7f6ee0139d90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.304+0000 7f6ee5e00640 1 --2- 172.21.15.55:0/1029392762 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6ebc0666c0 0x7f6ebc068b80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.304+0000 7f6ee5e00640 1 --2- 172.21.15.55:0/1029392762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ec40047d0 0x7f6ee01510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.304+0000 7f6ee5e00640 1 -- 172.21.15.55:0/1029392762 >> 172.21.15.55:0/1029392762 conn(0x7f6ee006a390 msgr2=0x7f6ee00b0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.304+0000 7f6ee5e00640 1 -- 172.21.15.55:0/1029392762 shutdown_connections 2024-04-02T07:23:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.304+0000 7f6ee5e00640 1 -- 172.21.15.55:0/1029392762 wait complete. 2024-04-02T07:23:06.330 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:23:06.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.468+0000 7fa5a4e00640 1 Processor -- start 2024-04-02T07:23:06.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.468+0000 7fa5a4e00640 1 -- start start 2024-04-02T07:23:06.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.468+0000 7fa5a4e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa5a0157000 0x7fa5a0071a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:06.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.468+0000 7fa5a4e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a015de90 con 0x7fa5a0071f60 2024-04-02T07:23:06.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.468+0000 7fa5a4e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a015d280 con 0x7fa5a006a4a0 2024-04-02T07:23:06.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.468+0000 7fa5a4e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a015d070 con 0x7fa5a0157000 2024-04-02T07:23:06.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.468+0000 7fa59de00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa5a0157000 0x7fa5a0071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:06.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.468+0000 7fa59de00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa5a0157000 0x7fa5a0071a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55186/0 (socket says 172.21.15.55:55186) 2024-04-02T07:23:06.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.468+0000 7fa59de00640 1 -- 172.21.15.55:0/478988614 learned_addr learned my addr 172.21.15.55:0/478988614 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:06.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.468+0000 7fa597e00640 1 --1- 172.21.15.55:0/478988614 >> v1:172.21.15.55:6789/0 conn(0x7fa5a0071f60 0x7fa5a0069d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50120/0 (socket says 172.21.15.55:50120) 2024-04-02T07:23:06.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.468+0000 7fa59de00640 1 -- 172.21.15.55:0/478988614 >> v1:172.21.15.106:6789/0 conn(0x7fa5a006a4a0 legacy=0x7fa5a0160760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:06.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.468+0000 7fa59de00640 1 -- 172.21.15.55:0/478988614 >> v1:172.21.15.55:6789/0 conn(0x7fa5a0071f60 legacy=0x7fa5a0069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:06.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.468+0000 7fa59de00640 1 -- 172.21.15.55:0/478988614 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a015d560 con 0x7fa5a0157000 2024-04-02T07:23:06.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.472+0000 7fa59de00640 1 --2- 172.21.15.55:0/478988614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a0157000 0x7fa5a0071a20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa590009870 tx=0x7fa59001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bc6a2ce0cbbcddf server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:06.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.472+0000 7fa59d400640 1 -- 172.21.15.55:0/478988614 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5900ab610 con 0x7fa5a0157000 2024-04-02T07:23:06.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.472+0000 7fa59d400640 1 -- 172.21.15.55:0/478988614 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5900ab770 con 0x7fa5a0157000 2024-04-02T07:23:06.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.472+0000 7fa59d400640 1 -- 172.21.15.55:0/478988614 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5900abb00 con 0x7fa5a0157000 2024-04-02T07:23:06.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.472+0000 7fa5a4e00640 1 -- 172.21.15.55:0/478988614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a0157000 msgr2=0x7fa5a0071a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:06.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.472+0000 7fa5a4e00640 1 --2- 172.21.15.55:0/478988614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a0157000 0x7fa5a0071a20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa590009870 tx=0x7fa59001c520 comp rx=0 tx=0).stop 2024-04-02T07:23:06.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.472+0000 7fa5a4e00640 1 -- 172.21.15.55:0/478988614 shutdown_connections 2024-04-02T07:23:06.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.472+0000 7fa5a4e00640 1 --2- 172.21.15.55:0/478988614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a0157000 0x7fa5a0071a20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.472+0000 7fa5a4e00640 1 -- 172.21.15.55:0/478988614 >> 172.21.15.55:0/478988614 conn(0x7fa5a00b13b0 msgr2=0x7fa5a00b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:06.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.472+0000 7fa5a4e00640 1 -- 172.21.15.55:0/478988614 shutdown_connections 2024-04-02T07:23:06.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.472+0000 7fa5a4e00640 1 -- 172.21.15.55:0/478988614 wait complete. 2024-04-02T07:23:06.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa5a4e00640 1 Processor -- start 2024-04-02T07:23:06.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa5a4e00640 1 -- start start 2024-04-02T07:23:06.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa5a4e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a006a4a0 0x7fa5a014f160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:06.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa5a4e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5a0071f60 0x7fa5a014e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:06.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa5a4e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5a0157000 0x7fa5a0154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:06.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa5a4e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a014dcf0 con 0x7fa5a006a4a0 2024-04-02T07:23:06.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa5a4e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a014e270 con 0x7fa5a0157000 2024-04-02T07:23:06.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa5a4e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a01567f0 con 0x7fa5a0071f60 2024-04-02T07:23:06.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa59de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a006a4a0 0x7fa5a014f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:06.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa59de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a006a4a0 0x7fa5a014f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55198/0 (socket says 172.21.15.55:55198) 2024-04-02T07:23:06.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa59de00640 1 -- 172.21.15.55:0/654964277 learned_addr learned my addr 172.21.15.55:0/654964277 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:06.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa597e00640 1 --2- 172.21.15.55:0/654964277 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5a0071f60 0x7fa5a014e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:06.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa59e800640 1 --2- 172.21.15.55:0/654964277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5a0157000 0x7fa5a0154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:06.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa59de00640 1 -- 172.21.15.55:0/654964277 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5a0071f60 msgr2=0x7fa5a014e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:06.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa59de00640 1 --2- 172.21.15.55:0/654964277 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5a0071f60 0x7fa5a014e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa59de00640 1 -- 172.21.15.55:0/654964277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5a0157000 msgr2=0x7fa5a0154790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:06.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa59de00640 1 --2- 172.21.15.55:0/654964277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5a0157000 0x7fa5a0154790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa59de00640 1 -- 172.21.15.55:0/654964277 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5900094d0 con 0x7fa5a006a4a0 2024-04-02T07:23:06.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa59e800640 1 --2- 172.21.15.55:0/654964277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5a0157000 0x7fa5a0154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:06.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa59de00640 1 --2- 172.21.15.55:0/654964277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a006a4a0 0x7fa5a014f160 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa5900ad040 tx=0x7fa59001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:06.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa596000640 1 -- 172.21.15.55:0/654964277 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5900b4800 con 0x7fa5a006a4a0 2024-04-02T07:23:06.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa596000640 1 -- 172.21.15.55:0/654964277 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5900b4980 con 0x7fa5a006a4a0 2024-04-02T07:23:06.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa596000640 1 -- 172.21.15.55:0/654964277 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5900b4d30 con 0x7fa5a006a4a0 2024-04-02T07:23:06.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa5a4e00640 1 -- 172.21.15.55:0/654964277 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a014f7f0 con 0x7fa5a006a4a0 2024-04-02T07:23:06.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.476+0000 7fa5a4e00640 1 -- 172.21.15.55:0/654964277 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a014df00 con 0x7fa5a006a4a0 2024-04-02T07:23:06.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.480+0000 7fa5a4e00640 1 -- 172.21.15.55:0/654964277 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a014fca0 con 0x7fa5a006a4a0 2024-04-02T07:23:06.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.480+0000 7fa596000640 1 -- 172.21.15.55:0/654964277 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa5900b3380 con 0x7fa5a006a4a0 2024-04-02T07:23:06.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.480+0000 7fa596000640 1 --2- 172.21.15.55:0/654964277 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa57c066690 0x7fa57c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:06.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.480+0000 7fa596000640 1 -- 172.21.15.55:0/654964277 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa59011e8e0 con 0x7fa5a006a4a0 2024-04-02T07:23:06.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.480+0000 7fa597e00640 1 --2- 172.21.15.55:0/654964277 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa57c066690 0x7fa57c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:06.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.480+0000 7fa597e00640 1 --2- 172.21.15.55:0/654964277 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa57c066690 0x7fa57c068b50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa5a00ce9b0 tx=0x7fa588007e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:06.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.484+0000 7fa596000640 1 -- 172.21.15.55:0/654964277 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa5900ebbe0 con 0x7fa5a006a4a0 2024-04-02T07:23:06.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.640+0000 7fa5a4e00640 1 -- 172.21.15.55:0/654964277 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa5a0066c90 con 0x7fa5a006a4a0 2024-04-02T07:23:06.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.644+0000 7fa596000640 1 -- 172.21.15.55:0/654964277 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa5900c4020 con 0x7fa5a006a4a0 2024-04-02T07:23:06.648 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:23:06.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.644+0000 7fa5a4e00640 1 -- 172.21.15.55:0/654964277 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa57c066690 msgr2=0x7fa57c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:06.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.644+0000 7fa5a4e00640 1 --2- 172.21.15.55:0/654964277 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa57c066690 0x7fa57c068b50 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa5a00ce9b0 tx=0x7fa588007e50 comp rx=0 tx=0).stop 2024-04-02T07:23:06.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.644+0000 7fa5a4e00640 1 -- 172.21.15.55:0/654964277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a006a4a0 msgr2=0x7fa5a014f160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:06.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.644+0000 7fa5a4e00640 1 --2- 172.21.15.55:0/654964277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a006a4a0 0x7fa5a014f160 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa5900ad040 tx=0x7fa59001ad60 comp rx=0 tx=0).stop 2024-04-02T07:23:06.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.644+0000 7fa5a4e00640 1 -- 172.21.15.55:0/654964277 shutdown_connections 2024-04-02T07:23:06.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.644+0000 7fa5a4e00640 1 --2- 172.21.15.55:0/654964277 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa57c066690 0x7fa57c068b50 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.644+0000 7fa5a4e00640 1 --2- 172.21.15.55:0/654964277 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5a0157000 0x7fa5a0154790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.644+0000 7fa5a4e00640 1 --2- 172.21.15.55:0/654964277 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5a0071f60 0x7fa5a014e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.644+0000 7fa5a4e00640 1 --2- 172.21.15.55:0/654964277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a006a4a0 0x7fa5a014f160 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.644+0000 7fa5a4e00640 1 -- 172.21.15.55:0/654964277 >> 172.21.15.55:0/654964277 conn(0x7fa5a00b13b0 msgr2=0x7fa5a00b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:06.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.644+0000 7fa5a4e00640 1 -- 172.21.15.55:0/654964277 shutdown_connections 2024-04-02T07:23:06.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.644+0000 7fa5a4e00640 1 -- 172.21.15.55:0/654964277 wait complete. 2024-04-02T07:23:06.670 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:23:06.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.808+0000 7f4643000640 1 Processor -- start 2024-04-02T07:23:06.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.808+0000 7f4643000640 1 -- start start 2024-04-02T07:23:06.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.808+0000 7f4643000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f463c0709b0 0x7f463c0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:06.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.808+0000 7f4643000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f463c15e3a0 con 0x7f463c0b2fd0 2024-04-02T07:23:06.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.808+0000 7f4643000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f463c15e5f0 con 0x7f463c144260 2024-04-02T07:23:06.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.808+0000 7f4643000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f463c0b37c0 con 0x7f463c0709b0 2024-04-02T07:23:06.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.808+0000 7f4633400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f463c0709b0 0x7f463c0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:06.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.808+0000 7f4633400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f463c0709b0 0x7f463c0b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55204/0 (socket says 172.21.15.55:55204) 2024-04-02T07:23:06.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.808+0000 7f4633400640 1 -- 172.21.15.55:0/2495342176 learned_addr learned my addr 172.21.15.55:0/2495342176 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:06.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.808+0000 7f4633400640 1 -- 172.21.15.55:0/2495342176 >> v1:172.21.15.106:6789/0 conn(0x7f463c144260 legacy=0x7f463c0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:06.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.808+0000 7f4633400640 1 -- 172.21.15.55:0/2495342176 >> v1:172.21.15.55:6789/0 conn(0x7f463c0b2fd0 legacy=0x7f463c0b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:06.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.808+0000 7f4633400640 1 -- 172.21.15.55:0/2495342176 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f463c15e8d0 con 0x7f463c0709b0 2024-04-02T07:23:06.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.808+0000 7f463b400640 1 -- 172.21.15.55:0/2495342176 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4160840677 0 0) 0x7f463c15e3a0 con 0x7f463c0b2fd0 2024-04-02T07:23:06.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.812+0000 7f4633400640 1 --2- 172.21.15.55:0/2495342176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f463c0709b0 0x7f463c0b2a90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4624009870 tx=0x7f462401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a2310901f9d2825 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:06.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.812+0000 7f463b400640 1 -- 172.21.15.55:0/2495342176 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46240ab650 con 0x7f463c0709b0 2024-04-02T07:23:06.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.812+0000 7f463b400640 1 -- 172.21.15.55:0/2495342176 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46240ab7b0 con 0x7f463c0709b0 2024-04-02T07:23:06.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.812+0000 7f463b400640 1 -- 172.21.15.55:0/2495342176 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46240abb40 con 0x7f463c0709b0 2024-04-02T07:23:06.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.812+0000 7f4643000640 1 -- 172.21.15.55:0/2495342176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f463c0709b0 msgr2=0x7f463c0b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:06.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.812+0000 7f4643000640 1 --2- 172.21.15.55:0/2495342176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f463c0709b0 0x7f463c0b2a90 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4624009870 tx=0x7f462401c560 comp rx=0 tx=0).stop 2024-04-02T07:23:06.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.812+0000 7f4643000640 1 -- 172.21.15.55:0/2495342176 shutdown_connections 2024-04-02T07:23:06.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.812+0000 7f4643000640 1 --2- 172.21.15.55:0/2495342176 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f463c0709b0 0x7f463c0b2a90 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.812+0000 7f4643000640 1 -- 172.21.15.55:0/2495342176 >> 172.21.15.55:0/2495342176 conn(0x7f463c06a390 msgr2=0x7f463c0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:06.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.812+0000 7f4643000640 1 -- 172.21.15.55:0/2495342176 shutdown_connections 2024-04-02T07:23:06.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.812+0000 7f4643000640 1 -- 172.21.15.55:0/2495342176 wait complete. 2024-04-02T07:23:06.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f4643000640 1 Processor -- start 2024-04-02T07:23:06.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f4643000640 1 -- start start 2024-04-02T07:23:06.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f4643000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f463c0709b0 0x7f463c154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:06.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f4643000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f463c0b2fd0 0x7f463c0c9540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:06.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f4643000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f463c144260 0x7f463c15d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:06.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f4643000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c139730 con 0x7f463c0709b0 2024-04-02T07:23:06.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f4643000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f463c13a590 con 0x7f463c144260 2024-04-02T07:23:06.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f4643000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f463c139980 con 0x7f463c0b2fd0 2024-04-02T07:23:06.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f463be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f463c0709b0 0x7f463c154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:06.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f463be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f463c0709b0 0x7f463c154f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55220/0 (socket says 172.21.15.55:55220) 2024-04-02T07:23:06.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f463be00640 1 -- 172.21.15.55:0/3948133093 learned_addr learned my addr 172.21.15.55:0/3948133093 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:06.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f4633400640 1 --2- 172.21.15.55:0/3948133093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f463c0b2fd0 0x7f463c0c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:06.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f4641000640 1 --2- 172.21.15.55:0/3948133093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f463c144260 0x7f463c15d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:06.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f463be00640 1 -- 172.21.15.55:0/3948133093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f463c0b2fd0 msgr2=0x7f463c0c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:06.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f463be00640 1 --2- 172.21.15.55:0/3948133093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f463c0b2fd0 0x7f463c0c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f463be00640 1 -- 172.21.15.55:0/3948133093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f463c144260 msgr2=0x7f463c15d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:06.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f463be00640 1 --2- 172.21.15.55:0/3948133093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f463c144260 0x7f463c15d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f463be00640 1 -- 172.21.15.55:0/3948133093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46240094d0 con 0x7f463c0709b0 2024-04-02T07:23:06.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f463be00640 1 --2- 172.21.15.55:0/3948133093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f463c0709b0 0x7f463c154f00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f462c00c3c0 tx=0x7f462c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:06.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f4638c00640 1 -- 172.21.15.55:0/3948133093 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c0052d0 con 0x7f463c0709b0 2024-04-02T07:23:06.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f4638c00640 1 -- 172.21.15.55:0/3948133093 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f462c005430 con 0x7f463c0709b0 2024-04-02T07:23:06.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f4643000640 1 -- 172.21.15.55:0/3948133093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463c139c60 con 0x7f463c0709b0 2024-04-02T07:23:06.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f4638c00640 1 -- 172.21.15.55:0/3948133093 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f462c003840 con 0x7f463c0709b0 2024-04-02T07:23:06.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f4643000640 1 -- 172.21.15.55:0/3948133093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463c13a220 con 0x7f463c0709b0 2024-04-02T07:23:06.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.816+0000 7f4643000640 1 -- 172.21.15.55:0/3948133093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f463c073530 con 0x7f463c0709b0 2024-04-02T07:23:06.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.820+0000 7f4638c00640 1 -- 172.21.15.55:0/3948133093 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f462c0039a0 con 0x7f463c0709b0 2024-04-02T07:23:06.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.820+0000 7f4638c00640 1 --2- 172.21.15.55:0/3948133093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4618066690 0x7f4618068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:06.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.820+0000 7f4638c00640 1 -- 172.21.15.55:0/3948133093 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f462c083750 con 0x7f463c0709b0 2024-04-02T07:23:06.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.820+0000 7f4633400640 1 --2- 172.21.15.55:0/3948133093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4618066690 0x7f4618068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:06.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.820+0000 7f4633400640 1 --2- 172.21.15.55:0/3948133093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4618066690 0x7f4618068b50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f46240af000 tx=0x7f46240b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:06.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.824+0000 7f4638c00640 1 -- 172.21.15.55:0/3948133093 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f462c050a60 con 0x7f463c0709b0 2024-04-02T07:23:06.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.980+0000 7f4643000640 1 -- 172.21.15.55:0/3948133093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f463c066c90 con 0x7f463c0709b0 2024-04-02T07:23:06.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.980+0000 7f4638c00640 1 -- 172.21.15.55:0/3948133093 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f462c054080 con 0x7f463c0709b0 2024-04-02T07:23:06.987 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:23:06.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.984+0000 7f4643000640 1 -- 172.21.15.55:0/3948133093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4618066690 msgr2=0x7f4618068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:06.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.984+0000 7f4643000640 1 --2- 172.21.15.55:0/3948133093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4618066690 0x7f4618068b50 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f46240af000 tx=0x7f46240b6040 comp rx=0 tx=0).stop 2024-04-02T07:23:06.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.984+0000 7f4643000640 1 -- 172.21.15.55:0/3948133093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f463c0709b0 msgr2=0x7f463c154f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:06.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.984+0000 7f4643000640 1 --2- 172.21.15.55:0/3948133093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f463c0709b0 0x7f463c154f00 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f462c00c3c0 tx=0x7f462c00c880 comp rx=0 tx=0).stop 2024-04-02T07:23:06.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.984+0000 7f4643000640 1 -- 172.21.15.55:0/3948133093 shutdown_connections 2024-04-02T07:23:06.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.984+0000 7f4643000640 1 --2- 172.21.15.55:0/3948133093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4618066690 0x7f4618068b50 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.984+0000 7f4643000640 1 --2- 172.21.15.55:0/3948133093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f463c144260 0x7f463c15d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.984+0000 7f4643000640 1 --2- 172.21.15.55:0/3948133093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f463c0b2fd0 0x7f463c0c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.984+0000 7f4643000640 1 --2- 172.21.15.55:0/3948133093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f463c0709b0 0x7f463c154f00 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:06.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.984+0000 7f4643000640 1 -- 172.21.15.55:0/3948133093 >> 172.21.15.55:0/3948133093 conn(0x7f463c06a390 msgr2=0x7f463c06dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:06.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.984+0000 7f4643000640 1 -- 172.21.15.55:0/3948133093 shutdown_connections 2024-04-02T07:23:06.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:06.984+0000 7f4643000640 1 -- 172.21.15.55:0/3948133093 wait complete. 2024-04-02T07:23:07.009 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:23:07.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.144+0000 7f328f400640 1 Processor -- start 2024-04-02T07:23:07.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.144+0000 7f328f400640 1 -- start start 2024-04-02T07:23:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.144+0000 7f328f400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f328815ca70 0x7f32880b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.144+0000 7f328f400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3288098a10 0x7f3288098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.144+0000 7f328f400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f328806aff0 0x7f328806b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.144+0000 7f328f400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32880993b0 con 0x7f328806aff0 2024-04-02T07:23:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.144+0000 7f328f400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f328815ce50 con 0x7f3288098a10 2024-04-02T07:23:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.144+0000 7f328f400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32880cef60 con 0x7f328815ca70 2024-04-02T07:23:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.144+0000 7f328d400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f328806aff0 0x7f328806b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.144+0000 7f328d400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f328806aff0 0x7f328806b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55228/0 (socket says 172.21.15.55:55228) 2024-04-02T07:23:07.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.144+0000 7f328d400640 1 -- 172.21.15.55:0/2086689385 learned_addr learned my addr 172.21.15.55:0/2086689385 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:07.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.144+0000 7f327fe00640 1 --2- 172.21.15.55:0/2086689385 >> v2:172.21.15.106:3300/0 conn(0x7f3288098a10 0x7f3288098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:07.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.144+0000 7f328ca00640 1 --2- 172.21.15.55:0/2086689385 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f328815ca70 0x7f32880b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:07.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.144+0000 7f328d400640 1 -- 172.21.15.55:0/2086689385 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f328815ca70 msgr2=0x7f32880b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:07.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.144+0000 7f328d400640 1 --2- 172.21.15.55:0/2086689385 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f328815ca70 0x7f32880b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.144+0000 7f328d400640 1 -- 172.21.15.55:0/2086689385 >> v2:172.21.15.106:3300/0 conn(0x7f3288098a10 msgr2=0x7f3288098e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:07.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.144+0000 7f328d400640 1 --2- 172.21.15.55:0/2086689385 >> v2:172.21.15.106:3300/0 conn(0x7f3288098a10 0x7f3288098e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.144+0000 7f328d400640 1 -- 172.21.15.55:0/2086689385 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328806bd60 con 0x7f328806aff0 2024-04-02T07:23:07.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.144+0000 7f327fe00640 1 --2- 172.21.15.55:0/2086689385 >> v2:172.21.15.106:3300/0 conn(0x7f3288098a10 0x7f3288098e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:07.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.148+0000 7f328d400640 1 --2- 172.21.15.55:0/2086689385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f328806aff0 0x7f328806b480 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3288073bd0 tx=0x7f328001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6b165de366df90 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:07.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.148+0000 7f3287e00640 1 -- 172.21.15.55:0/2086689385 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800a5840 con 0x7f328806aff0 2024-04-02T07:23:07.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.148+0000 7f3287e00640 1 -- 172.21.15.55:0/2086689385 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32800a59a0 con 0x7f328806aff0 2024-04-02T07:23:07.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.148+0000 7f3287e00640 1 -- 172.21.15.55:0/2086689385 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32800a5d30 con 0x7f328806aff0 2024-04-02T07:23:07.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.148+0000 7f328f400640 1 -- 172.21.15.55:0/2086689385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f328806aff0 msgr2=0x7f328806b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:07.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.148+0000 7f328f400640 1 --2- 172.21.15.55:0/2086689385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f328806aff0 0x7f328806b480 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3288073bd0 tx=0x7f328001c9c0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.148+0000 7f328f400640 1 -- 172.21.15.55:0/2086689385 shutdown_connections 2024-04-02T07:23:07.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.148+0000 7f328f400640 1 --2- 172.21.15.55:0/2086689385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f328806aff0 0x7f328806b480 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.148+0000 7f328f400640 1 --2- 172.21.15.55:0/2086689385 >> v2:172.21.15.106:3300/0 conn(0x7f3288098a10 0x7f3288098e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.148+0000 7f328f400640 1 --2- 172.21.15.55:0/2086689385 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f328815ca70 0x7f32880b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.148+0000 7f328f400640 1 -- 172.21.15.55:0/2086689385 >> 172.21.15.55:0/2086689385 conn(0x7f32880b21d0 msgr2=0x7f32880b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:07.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.148+0000 7f328f400640 1 -- 172.21.15.55:0/2086689385 shutdown_connections 2024-04-02T07:23:07.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.148+0000 7f328f400640 1 -- 172.21.15.55:0/2086689385 wait complete. 2024-04-02T07:23:07.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f328f400640 1 Processor -- start 2024-04-02T07:23:07.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f328f400640 1 -- start start 2024-04-02T07:23:07.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f328f400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f328806aff0 0x7f328815f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:07.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f328f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3288098a10 0x7f32880cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:07.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f328f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f328815ca70 0x7f32880cd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:07.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f328f400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328815d280 con 0x7f3288098a10 2024-04-02T07:23:07.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f328f400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32880ae780 con 0x7f328815ca70 2024-04-02T07:23:07.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f328f400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32880aea60 con 0x7f328806aff0 2024-04-02T07:23:07.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f327fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3288098a10 0x7f32880cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:07.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f327fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3288098a10 0x7f32880cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55234/0 (socket says 172.21.15.55:55234) 2024-04-02T07:23:07.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f327fe00640 1 -- 172.21.15.55:0/3307659125 learned_addr learned my addr 172.21.15.55:0/3307659125 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:07.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f328ca00640 1 --2- 172.21.15.55:0/3307659125 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f328806aff0 0x7f328815f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:07.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f328d400640 1 --2- 172.21.15.55:0/3307659125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f328815ca70 0x7f32880cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:07.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f327fe00640 1 -- 172.21.15.55:0/3307659125 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f328806aff0 msgr2=0x7f328815f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:07.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f327fe00640 1 --2- 172.21.15.55:0/3307659125 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f328806aff0 0x7f328815f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f327fe00640 1 -- 172.21.15.55:0/3307659125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f328815ca70 msgr2=0x7f32880cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:07.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f327fe00640 1 --2- 172.21.15.55:0/3307659125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f328815ca70 0x7f32880cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f327fe00640 1 -- 172.21.15.55:0/3307659125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3280009b30 con 0x7f3288098a10 2024-04-02T07:23:07.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f327fe00640 1 --2- 172.21.15.55:0/3307659125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3288098a10 0x7f32880cd120 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f327000e810 tx=0x7f327000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:07.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f3285600640 1 -- 172.21.15.55:0/3307659125 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327000c8d0 con 0x7f3288098a10 2024-04-02T07:23:07.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f3285600640 1 -- 172.21.15.55:0/3307659125 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327000ca30 con 0x7f3288098a10 2024-04-02T07:23:07.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f3285600640 1 -- 172.21.15.55:0/3307659125 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327000cde0 con 0x7f3288098a10 2024-04-02T07:23:07.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f328f400640 1 -- 172.21.15.55:0/3307659125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32880aed40 con 0x7f3288098a10 2024-04-02T07:23:07.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.152+0000 7f328f400640 1 -- 172.21.15.55:0/3307659125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328815f750 con 0x7f3288098a10 2024-04-02T07:23:07.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.156+0000 7f328f400640 1 -- 172.21.15.55:0/3307659125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32880aef30 con 0x7f3288098a10 2024-04-02T07:23:07.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.156+0000 7f3285600640 1 -- 172.21.15.55:0/3307659125 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3270013410 con 0x7f3288098a10 2024-04-02T07:23:07.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.156+0000 7f3285600640 1 --2- 172.21.15.55:0/3307659125 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3264066690 0x7f3264068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:07.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.156+0000 7f3285600640 1 -- 172.21.15.55:0/3307659125 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f3270083f90 con 0x7f3288098a10 2024-04-02T07:23:07.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.156+0000 7f328ca00640 1 --2- 172.21.15.55:0/3307659125 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3264066690 0x7f3264068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:07.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.156+0000 7f328ca00640 1 --2- 172.21.15.55:0/3307659125 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3264066690 0x7f3264068b50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3278007940 tx=0x7f3278008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:07.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.160+0000 7f3285600640 1 -- 172.21.15.55:0/3307659125 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3270051320 con 0x7f3288098a10 2024-04-02T07:23:07.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.356+0000 7f328f400640 1 -- 172.21.15.55:0/3307659125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3288066c90 con 0x7f3288098a10 2024-04-02T07:23:07.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.356+0000 7f3285600640 1 -- 172.21.15.55:0/3307659125 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4725 (secure 0 0 0) 0x7f3270054940 con 0x7f3288098a10 2024-04-02T07:23:07.361 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:07.361 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1468533802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1468533802},{"type":"v1","addr":"172.21.15.106:6837","nonce":1468533802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/342047131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":342047131},{"type":"v1","addr":"172.21.15.55:6833","nonce":342047131}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/50847499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":50847499},{"type":"v1","addr":"172.21.15.55:6835","nonce":50847499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:22:18.201059+0000","modified":"2024-04-02T07:22:21.225641+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6836/3829467285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3829467285},{"type":"v1","addr":"172.21.15.106:6836","nonce":3829467285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-02T07:23:07.361 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2024-04-02T07:23:07.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.356+0000 7f328f400640 1 -- 172.21.15.55:0/3307659125 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3264066690 msgr2=0x7f3264068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:07.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.356+0000 7f328f400640 1 --2- 172.21.15.55:0/3307659125 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3264066690 0x7f3264068b50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3278007940 tx=0x7f3278008040 comp rx=0 tx=0).stop 2024-04-02T07:23:07.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.356+0000 7f328f400640 1 -- 172.21.15.55:0/3307659125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3288098a10 msgr2=0x7f32880cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:07.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.356+0000 7f328f400640 1 --2- 172.21.15.55:0/3307659125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3288098a10 0x7f32880cd120 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f327000e810 tx=0x7f327000ecd0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.356+0000 7f328f400640 1 -- 172.21.15.55:0/3307659125 shutdown_connections 2024-04-02T07:23:07.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.356+0000 7f328f400640 1 --2- 172.21.15.55:0/3307659125 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3264066690 0x7f3264068b50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.356+0000 7f328f400640 1 --2- 172.21.15.55:0/3307659125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f328815ca70 0x7f32880cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.356+0000 7f328f400640 1 --2- 172.21.15.55:0/3307659125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3288098a10 0x7f32880cd120 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.356+0000 7f328f400640 1 --2- 172.21.15.55:0/3307659125 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f328806aff0 0x7f328815f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.356+0000 7f328f400640 1 -- 172.21.15.55:0/3307659125 >> 172.21.15.55:0/3307659125 conn(0x7f32880b21d0 msgr2=0x7f328806f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:07.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.356+0000 7f328f400640 1 -- 172.21.15.55:0/3307659125 shutdown_connections 2024-04-02T07:23:07.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.356+0000 7f328f400640 1 -- 172.21.15.55:0/3307659125 wait complete. 2024-04-02T07:23:07.383 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:23:07.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.516+0000 7fa804e00640 1 Processor -- start 2024-04-02T07:23:07.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.516+0000 7fa804e00640 1 -- start start 2024-04-02T07:23:07.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.520+0000 7fa804e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa80015a8f0 0x7fa8000997d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:07.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.520+0000 7fa804e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa8000c59c0 0x7fa800098ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:07.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.520+0000 7fa804e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8000ce090 con 0x7fa800098a10 2024-04-02T07:23:07.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.520+0000 7fa804e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8000ce8f0 con 0x7fa80015a8f0 2024-04-02T07:23:07.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.520+0000 7fa804e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa800099400 con 0x7fa8000c59c0 2024-04-02T07:23:07.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.520+0000 7fa7ff400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa80015a8f0 0x7fa8000997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:07.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.520+0000 7fa7ff400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa80015a8f0 0x7fa8000997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55244/0 (socket says 172.21.15.55:55244) 2024-04-02T07:23:07.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.520+0000 7fa7ff400640 1 -- 172.21.15.55:0/1408667518 learned_addr learned my addr 172.21.15.55:0/1408667518 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:07.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.520+0000 7fa7f6a00640 1 --1- 172.21.15.55:0/1408667518 >> v1:172.21.15.55:6789/0 conn(0x7fa800098a10 0x7fa8000cb060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50134/0 (socket says 172.21.15.55:50134) 2024-04-02T07:23:07.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.520+0000 7fa7ffe00640 1 --2- 172.21.15.55:0/1408667518 >> v2:172.21.15.106:3300/0 conn(0x7fa8000c59c0 0x7fa800098ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:07.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.520+0000 7fa7ff400640 1 -- 172.21.15.55:0/1408667518 >> v2:172.21.15.106:3300/0 conn(0x7fa8000c59c0 msgr2=0x7fa800098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:07.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.520+0000 7fa7ff400640 1 --2- 172.21.15.55:0/1408667518 >> v2:172.21.15.106:3300/0 conn(0x7fa8000c59c0 0x7fa800098ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.520+0000 7fa7ff400640 1 -- 172.21.15.55:0/1408667518 >> v1:172.21.15.55:6789/0 conn(0x7fa800098a10 legacy=0x7fa8000cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:07.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.520+0000 7fa7ff400640 1 -- 172.21.15.55:0/1408667518 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8000ce330 con 0x7fa80015a8f0 2024-04-02T07:23:07.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.520+0000 7fa7fea00640 1 -- 172.21.15.55:0/1408667518 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79427540 0 0) 0x7fa8000ce090 con 0x7fa800098a10 2024-04-02T07:23:07.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.524+0000 7fa7ff400640 1 --2- 172.21.15.55:0/1408667518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa80015a8f0 0x7fa8000997d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa800071da0 tx=0x7fa7f001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=670f904dc15910dc server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:07.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.524+0000 7fa7fea00640 1 -- 172.21.15.55:0/1408667518 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f00ad680 con 0x7fa80015a8f0 2024-04-02T07:23:07.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.524+0000 7fa7fea00640 1 -- 172.21.15.55:0/1408667518 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7f00ad7e0 con 0x7fa80015a8f0 2024-04-02T07:23:07.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.524+0000 7fa7fea00640 1 -- 172.21.15.55:0/1408667518 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7f00adb70 con 0x7fa80015a8f0 2024-04-02T07:23:07.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.524+0000 7fa804e00640 1 -- 172.21.15.55:0/1408667518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa80015a8f0 msgr2=0x7fa8000997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:07.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.524+0000 7fa804e00640 1 --2- 172.21.15.55:0/1408667518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa80015a8f0 0x7fa8000997d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa800071da0 tx=0x7fa7f001c490 comp rx=0 tx=0).stop 2024-04-02T07:23:07.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.524+0000 7fa804e00640 1 -- 172.21.15.55:0/1408667518 shutdown_connections 2024-04-02T07:23:07.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.524+0000 7fa804e00640 1 --2- 172.21.15.55:0/1408667518 >> v2:172.21.15.106:3300/0 conn(0x7fa8000c59c0 0x7fa800098ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.524+0000 7fa804e00640 1 --2- 172.21.15.55:0/1408667518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa80015a8f0 0x7fa8000997d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.524+0000 7fa804e00640 1 -- 172.21.15.55:0/1408667518 >> 172.21.15.55:0/1408667518 conn(0x7fa8000b1fb0 msgr2=0x7fa8000b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:07.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.524+0000 7fa804e00640 1 -- 172.21.15.55:0/1408667518 shutdown_connections 2024-04-02T07:23:07.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.524+0000 7fa804e00640 1 -- 172.21.15.55:0/1408667518 wait complete. 2024-04-02T07:23:07.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.524+0000 7fa804e00640 1 Processor -- start 2024-04-02T07:23:07.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.524+0000 7fa804e00640 1 -- start start 2024-04-02T07:23:07.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa804e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa800098a10 0x7fa8000ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:07.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa804e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8000c59c0 0x7fa800153b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:07.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa804e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa80015a8f0 0x7fa8000c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:07.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa804e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa800152920 con 0x7fa8000c59c0 2024-04-02T07:23:07.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa804e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa800152c00 con 0x7fa80015a8f0 2024-04-02T07:23:07.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa804e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa800148ae0 con 0x7fa800098a10 2024-04-02T07:23:07.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa7f6a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8000c59c0 0x7fa800153b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:07.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa7f6a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8000c59c0 0x7fa800153b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55248/0 (socket says 172.21.15.55:55248) 2024-04-02T07:23:07.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa7f6a00640 1 -- 172.21.15.55:0/574981234 learned_addr learned my addr 172.21.15.55:0/574981234 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:07.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa7ff400640 1 --2- 172.21.15.55:0/574981234 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa800098a10 0x7fa8000ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:07.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa7ffe00640 1 --2- 172.21.15.55:0/574981234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa80015a8f0 0x7fa8000c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:07.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa7f6a00640 1 -- 172.21.15.55:0/574981234 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa800098a10 msgr2=0x7fa8000ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:07.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa7f6a00640 1 --2- 172.21.15.55:0/574981234 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa800098a10 0x7fa8000ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa7f6a00640 1 -- 172.21.15.55:0/574981234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa80015a8f0 msgr2=0x7fa8000c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:07.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa7f6a00640 1 --2- 172.21.15.55:0/574981234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa80015a8f0 0x7fa8000c7b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa7f6a00640 1 -- 172.21.15.55:0/574981234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7f00094d0 con 0x7fa8000c59c0 2024-04-02T07:23:07.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa7ffe00640 1 --2- 172.21.15.55:0/574981234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa80015a8f0 0x7fa8000c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:23:07.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa7f6a00640 1 --2- 172.21.15.55:0/574981234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8000c59c0 0x7fa800153b40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800c480 tx=0x7fa7e800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:07.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa7f7e00640 1 -- 172.21.15.55:0/574981234 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e80074e0 con 0x7fa8000c59c0 2024-04-02T07:23:07.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa7f7e00640 1 -- 172.21.15.55:0/574981234 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7e8007660 con 0x7fa8000c59c0 2024-04-02T07:23:07.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa7f7e00640 1 -- 172.21.15.55:0/574981234 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7e8004a30 con 0x7fa8000c59c0 2024-04-02T07:23:07.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa804e00640 1 -- 172.21.15.55:0/574981234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa800148dc0 con 0x7fa8000c59c0 2024-04-02T07:23:07.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa804e00640 1 -- 172.21.15.55:0/574981234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa800152540 con 0x7fa8000c59c0 2024-04-02T07:23:07.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa804e00640 1 -- 172.21.15.55:0/574981234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa800073fa0 con 0x7fa8000c59c0 2024-04-02T07:23:07.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.528+0000 7fa7f7e00640 1 -- 172.21.15.55:0/574981234 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa7e8004b90 con 0x7fa8000c59c0 2024-04-02T07:23:07.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.532+0000 7fa7f7e00640 1 --2- 172.21.15.55:0/574981234 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa7dc066690 0x7fa7dc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:07.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.532+0000 7fa7f7e00640 1 -- 172.21.15.55:0/574981234 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7fa7e80833e0 con 0x7fa8000c59c0 2024-04-02T07:23:07.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.532+0000 7fa7ff400640 1 --2- 172.21.15.55:0/574981234 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa7dc066690 0x7fa7dc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:07.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.532+0000 7fa7ff400640 1 --2- 172.21.15.55:0/574981234 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa7dc066690 0x7fa7dc068b50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00af000 tx=0x7fa7f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:07.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.536+0000 7fa7f7e00640 1 -- 172.21.15.55:0/574981234 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa7e8054150 con 0x7fa8000c59c0 2024-04-02T07:23:07.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.696+0000 7fa804e00640 1 -- 172.21.15.55:0/574981234 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8000cc960 con 0x7fa8000c59c0 2024-04-02T07:23:07.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.696+0000 7fa7f7e00640 1 -- 172.21.15.55:0/574981234 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16287 (secure 0 0 0) 0x7fa7e8053ce0 con 0x7fa8000c59c0 2024-04-02T07:23:07.701 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:07.702 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":22,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:23:00.192054+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:23:07.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.696+0000 7fa804e00640 1 -- 172.21.15.55:0/574981234 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa7dc066690 msgr2=0x7fa7dc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.696+0000 7fa804e00640 1 --2- 172.21.15.55:0/574981234 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa7dc066690 0x7fa7dc068b50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa7f00af000 tx=0x7fa7f0008040 comp rx=0 tx=0).stop 2024-04-02T07:23:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.696+0000 7fa804e00640 1 -- 172.21.15.55:0/574981234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8000c59c0 msgr2=0x7fa800153b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.696+0000 7fa804e00640 1 --2- 172.21.15.55:0/574981234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8000c59c0 0x7fa800153b40 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa7e800c480 tx=0x7fa7e800c940 comp rx=0 tx=0).stop 2024-04-02T07:23:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.696+0000 7fa804e00640 1 -- 172.21.15.55:0/574981234 shutdown_connections 2024-04-02T07:23:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.696+0000 7fa804e00640 1 --2- 172.21.15.55:0/574981234 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa7dc066690 0x7fa7dc068b50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.696+0000 7fa804e00640 1 --2- 172.21.15.55:0/574981234 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa80015a8f0 0x7fa8000c7b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.696+0000 7fa804e00640 1 --2- 172.21.15.55:0/574981234 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8000c59c0 0x7fa800153b40 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.696+0000 7fa804e00640 1 --2- 172.21.15.55:0/574981234 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa800098a10 0x7fa8000ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.696+0000 7fa804e00640 1 -- 172.21.15.55:0/574981234 >> 172.21.15.55:0/574981234 conn(0x7fa8000b1fb0 msgr2=0x7fa80006e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.700+0000 7fa804e00640 1 -- 172.21.15.55:0/574981234 shutdown_connections 2024-04-02T07:23:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.700+0000 7fa804e00640 1 -- 172.21.15.55:0/574981234 wait complete. 2024-04-02T07:23:07.723 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-02T07:23:07.723 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:23:07.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.856+0000 7f5fa8000640 1 Processor -- start 2024-04-02T07:23:07.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.856+0000 7f5fa8000640 1 -- start start 2024-04-02T07:23:07.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.860+0000 7f5fa8000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5fa0098a10 0x7f5fa00b1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:07.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.860+0000 7f5fa8000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa00ce2f0 con 0x7f5fa00afe30 2024-04-02T07:23:07.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.860+0000 7f5fa8000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa00ce5d0 con 0x7f5fa0099750 2024-04-02T07:23:07.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.860+0000 7f5fa8000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa00cbe10 con 0x7f5fa0098a10 2024-04-02T07:23:07.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.860+0000 7f5fa5600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5fa0098a10 0x7f5fa00b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:07.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.860+0000 7f5fa4c00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5fa00afe30 0x7f5fa0098df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50150/0 (socket says 172.21.15.55:50150) 2024-04-02T07:23:07.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.860+0000 7f5fa4c00640 1 -- 172.21.15.55:0/1304763727 learned_addr learned my addr 172.21.15.55:0/1304763727 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:07.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.860+0000 7f5fa5600640 1 -- 172.21.15.55:0/1304763727 >> v1:172.21.15.106:6789/0 conn(0x7f5fa0099750 legacy=0x7f5fa00cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:07.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.860+0000 7f5fa5600640 1 -- 172.21.15.55:0/1304763727 >> v1:172.21.15.55:6789/0 conn(0x7f5fa00afe30 legacy=0x7f5fa0098df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:07.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.860+0000 7f5fa5600640 1 -- 172.21.15.55:0/1304763727 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa0099be0 con 0x7f5fa0098a10 2024-04-02T07:23:07.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.860+0000 7f5f9fe00640 1 -- 172.21.15.55:0/1304763727 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 24438803 0 0) 0x7f5fa00ce2f0 con 0x7f5fa00afe30 2024-04-02T07:23:07.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.864+0000 7f5fa5600640 1 --2- 172.21.15.55:0/1304763727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa0098a10 0x7f5fa00b1430 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5f940097c0 tx=0x7f5f9401c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678b523fb95df74f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:07.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.864+0000 7f5f9fe00640 1 -- 172.21.15.55:0/1304763727 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f940ab600 con 0x7f5fa0098a10 2024-04-02T07:23:07.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.864+0000 7f5f9fe00640 1 -- 172.21.15.55:0/1304763727 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f940a7050 con 0x7f5fa0098a10 2024-04-02T07:23:07.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.864+0000 7f5f9fe00640 1 -- 172.21.15.55:0/1304763727 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f940ab980 con 0x7f5fa0098a10 2024-04-02T07:23:07.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.864+0000 7f5fa8000640 1 -- 172.21.15.55:0/1304763727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa0098a10 msgr2=0x7f5fa00b1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:07.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.864+0000 7f5fa8000640 1 --2- 172.21.15.55:0/1304763727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa0098a10 0x7f5fa00b1430 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5f940097c0 tx=0x7f5f9401c3b0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.864+0000 7f5fa8000640 1 -- 172.21.15.55:0/1304763727 shutdown_connections 2024-04-02T07:23:07.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.864+0000 7f5fa8000640 1 --2- 172.21.15.55:0/1304763727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa0098a10 0x7f5fa00b1430 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.864+0000 7f5fa8000640 1 -- 172.21.15.55:0/1304763727 >> 172.21.15.55:0/1304763727 conn(0x7f5fa00b2210 msgr2=0x7f5fa00b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:07.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.864+0000 7f5fa8000640 1 -- 172.21.15.55:0/1304763727 shutdown_connections 2024-04-02T07:23:07.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.864+0000 7f5fa8000640 1 -- 172.21.15.55:0/1304763727 wait complete. 2024-04-02T07:23:07.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.864+0000 7f5fa8000640 1 Processor -- start 2024-04-02T07:23:07.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.864+0000 7f5fa8000640 1 -- start start 2024-04-02T07:23:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.864+0000 7f5fa8000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fa0098a10 0x7f5fa014eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5fa8000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa0099750 0x7f5fa00c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5fa8000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fa00afe30 0x7f5fa00c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5fa8000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa00c6ef0 con 0x7f5fa0099750 2024-04-02T07:23:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5fa8000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa006f680 con 0x7f5fa00afe30 2024-04-02T07:23:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5fa8000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa014f6a0 con 0x7f5fa0098a10 2024-04-02T07:23:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5fa4c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa0099750 0x7f5fa00c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5fa4c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa0099750 0x7f5fa00c6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55258/0 (socket says 172.21.15.55:55258) 2024-04-02T07:23:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5fa4c00640 1 -- 172.21.15.55:0/2231214296 learned_addr learned my addr 172.21.15.55:0/2231214296 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5fa5600640 1 --2- 172.21.15.55:0/2231214296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fa0098a10 0x7f5fa014eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5fa6000640 1 --2- 172.21.15.55:0/2231214296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fa00afe30 0x7f5fa00c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5fa4c00640 1 -- 172.21.15.55:0/2231214296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fa0098a10 msgr2=0x7f5fa014eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5fa4c00640 1 --2- 172.21.15.55:0/2231214296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fa0098a10 0x7f5fa014eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5fa4c00640 1 -- 172.21.15.55:0/2231214296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fa00afe30 msgr2=0x7f5fa00c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:07.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5fa4c00640 1 --2- 172.21.15.55:0/2231214296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fa00afe30 0x7f5fa00c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:07.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5fa4c00640 1 -- 172.21.15.55:0/2231214296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f94009420 con 0x7f5fa0099750 2024-04-02T07:23:07.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5fa4c00640 1 --2- 172.21.15.55:0/2231214296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa0099750 0x7f5fa00c6470 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00c410 tx=0x7f5f8c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:07.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5f9d600640 1 -- 172.21.15.55:0/2231214296 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c0074e0 con 0x7f5fa0099750 2024-04-02T07:23:07.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5f9d600640 1 -- 172.21.15.55:0/2231214296 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8c007640 con 0x7f5fa0099750 2024-04-02T07:23:07.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5f9d600640 1 -- 172.21.15.55:0/2231214296 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f8c004a30 con 0x7f5fa0099750 2024-04-02T07:23:07.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5fa8000640 1 -- 172.21.15.55:0/2231214296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa014f3c0 con 0x7f5fa0099750 2024-04-02T07:23:07.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5fa8000640 1 -- 172.21.15.55:0/2231214296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa006ce10 con 0x7f5fa0099750 2024-04-02T07:23:07.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5fa8000640 1 -- 172.21.15.55:0/2231214296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa006f830 con 0x7f5fa0099750 2024-04-02T07:23:07.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.868+0000 7f5f9d600640 1 -- 172.21.15.55:0/2231214296 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5f8c004b90 con 0x7f5fa0099750 2024-04-02T07:23:07.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.872+0000 7f5f9d600640 1 --2- 172.21.15.55:0/2231214296 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5f80066710 0x7f5f80068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:07.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.872+0000 7f5f9d600640 1 -- 172.21.15.55:0/2231214296 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f5f8c083d40 con 0x7f5fa0099750 2024-04-02T07:23:07.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.872+0000 7f5fa5600640 1 --2- 172.21.15.55:0/2231214296 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5f80066710 0x7f5f80068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:07.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.872+0000 7f5fa5600640 1 --2- 172.21.15.55:0/2231214296 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5f80066710 0x7f5f80068bd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5f940ad000 tx=0x7f5f940a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:07.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:07.876+0000 7f5f9d600640 1 -- 172.21.15.55:0/2231214296 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5fa006f830 con 0x7f5fa0099750 2024-04-02T07:23:08.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.076+0000 7f5fa8000640 1 -- 172.21.15.55:0/2231214296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5fa006f7f0 con 0x7f5fa0099750 2024-04-02T07:23:08.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.076+0000 7f5f9d600640 1 -- 172.21.15.55:0/2231214296 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4725 (secure 0 0 0) 0x7f5f8c051150 con 0x7f5fa0099750 2024-04-02T07:23:08.081 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:08.081 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1468533802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1468533802},{"type":"v1","addr":"172.21.15.106:6837","nonce":1468533802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/342047131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":342047131},{"type":"v1","addr":"172.21.15.55:6833","nonce":342047131}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/50847499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":50847499},{"type":"v1","addr":"172.21.15.55:6835","nonce":50847499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:22:18.201059+0000","modified":"2024-04-02T07:22:21.225641+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6836/3829467285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3829467285},{"type":"v1","addr":"172.21.15.106:6836","nonce":3829467285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-02T07:23:08.081 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2024-04-02T07:23:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.076+0000 7f5fa8000640 1 -- 172.21.15.55:0/2231214296 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5f80066710 msgr2=0x7f5f80068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.076+0000 7f5fa8000640 1 --2- 172.21.15.55:0/2231214296 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5f80066710 0x7f5f80068bd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5f940ad000 tx=0x7f5f940a6000 comp rx=0 tx=0).stop 2024-04-02T07:23:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.076+0000 7f5fa8000640 1 -- 172.21.15.55:0/2231214296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa0099750 msgr2=0x7f5fa00c6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.076+0000 7f5fa8000640 1 --2- 172.21.15.55:0/2231214296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa0099750 0x7f5fa00c6470 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00c410 tx=0x7f5f8c00c8d0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.076+0000 7f5fa8000640 1 -- 172.21.15.55:0/2231214296 shutdown_connections 2024-04-02T07:23:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.076+0000 7f5fa8000640 1 --2- 172.21.15.55:0/2231214296 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5f80066710 0x7f5f80068bd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.076+0000 7f5fa8000640 1 --2- 172.21.15.55:0/2231214296 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fa00afe30 0x7f5fa00c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.076+0000 7f5fa8000640 1 --2- 172.21.15.55:0/2231214296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa0099750 0x7f5fa00c6470 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.076+0000 7f5fa8000640 1 --2- 172.21.15.55:0/2231214296 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fa0098a10 0x7f5fa014eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.076+0000 7f5fa8000640 1 -- 172.21.15.55:0/2231214296 >> 172.21.15.55:0/2231214296 conn(0x7f5fa00b2210 msgr2=0x7f5fa00cb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.076+0000 7f5fa8000640 1 -- 172.21.15.55:0/2231214296 shutdown_connections 2024-04-02T07:23:08.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.076+0000 7f5fa8000640 1 -- 172.21.15.55:0/2231214296 wait complete. 2024-04-02T07:23:08.102 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:23:08.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.236+0000 7ff30fe00640 1 Processor -- start 2024-04-02T07:23:08.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.236+0000 7ff30fe00640 1 -- start start 2024-04-02T07:23:08.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.236+0000 7ff30fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff31015ff90 0x7ff310098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:08.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.236+0000 7ff30fe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff3100d0050 0x7ff310098f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:08.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.236+0000 7ff30fe00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3100af460 con 0x7ff310099490 2024-04-02T07:23:08.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.236+0000 7ff30fe00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3100cf0f0 con 0x7ff31015ff90 2024-04-02T07:23:08.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.236+0000 7ff30fe00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3100af690 con 0x7ff3100d0050 2024-04-02T07:23:08.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.236+0000 7ff30ea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff31015ff90 0x7ff310098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:08.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.236+0000 7ff30ea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff31015ff90 0x7ff310098a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55264/0 (socket says 172.21.15.55:55264) 2024-04-02T07:23:08.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.236+0000 7ff30f400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff310099490 0x7ff31006aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50158/0 (socket says 172.21.15.55:50158) 2024-04-02T07:23:08.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.236+0000 7ff30ea00640 1 -- 172.21.15.55:0/4197959260 learned_addr learned my addr 172.21.15.55:0/4197959260 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:08.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.236+0000 7ff306000640 1 --2- 172.21.15.55:0/4197959260 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff3100d0050 0x7ff310098f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:08.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.236+0000 7ff30ea00640 1 -- 172.21.15.55:0/4197959260 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff3100d0050 msgr2=0x7ff310098f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:08.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.236+0000 7ff30ea00640 1 --2- 172.21.15.55:0/4197959260 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff3100d0050 0x7ff310098f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.236+0000 7ff30ea00640 1 -- 172.21.15.55:0/4197959260 >> v1:172.21.15.55:6789/0 conn(0x7ff310099490 legacy=0x7ff31006aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:08.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.236+0000 7ff30ea00640 1 -- 172.21.15.55:0/4197959260 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3100cf3b0 con 0x7ff31015ff90 2024-04-02T07:23:08.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.240+0000 7ff30ea00640 1 --2- 172.21.15.55:0/4197959260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff31015ff90 0x7ff310098a10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff300009e50 tx=0x7ff30001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c1f508b47683ba server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:08.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.240+0000 7ff30e000640 1 -- 172.21.15.55:0/4197959260 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3000a58d0 con 0x7ff31015ff90 2024-04-02T07:23:08.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.240+0000 7ff30e000640 1 -- 172.21.15.55:0/4197959260 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3000a5a30 con 0x7ff31015ff90 2024-04-02T07:23:08.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.240+0000 7ff30e000640 1 -- 172.21.15.55:0/4197959260 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3000a5dc0 con 0x7ff31015ff90 2024-04-02T07:23:08.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.240+0000 7ff30fe00640 1 -- 172.21.15.55:0/4197959260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff31015ff90 msgr2=0x7ff310098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:08.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.240+0000 7ff30fe00640 1 --2- 172.21.15.55:0/4197959260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff31015ff90 0x7ff310098a10 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7ff300009e50 tx=0x7ff30001ca00 comp rx=0 tx=0).stop 2024-04-02T07:23:08.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.240+0000 7ff30fe00640 1 -- 172.21.15.55:0/4197959260 shutdown_connections 2024-04-02T07:23:08.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.240+0000 7ff30fe00640 1 --2- 172.21.15.55:0/4197959260 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff3100d0050 0x7ff310098f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.240+0000 7ff30fe00640 1 --2- 172.21.15.55:0/4197959260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff31015ff90 0x7ff310098a10 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.240+0000 7ff30fe00640 1 -- 172.21.15.55:0/4197959260 >> 172.21.15.55:0/4197959260 conn(0x7ff3100b1fb0 msgr2=0x7ff3100b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:08.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.240+0000 7ff30fe00640 1 -- 172.21.15.55:0/4197959260 shutdown_connections 2024-04-02T07:23:08.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.240+0000 7ff30fe00640 1 -- 172.21.15.55:0/4197959260 wait complete. 2024-04-02T07:23:08.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30fe00640 1 Processor -- start 2024-04-02T07:23:08.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30fe00640 1 -- start start 2024-04-02T07:23:08.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff310099490 0x7ff3101537c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:08.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30fe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff3100d0050 0x7ff3100c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:08.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff31015ff90 0x7ff3100c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:08.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30fe00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff31015f840 con 0x7ff31015ff90 2024-04-02T07:23:08.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30fe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3100ca020 con 0x7ff310099490 2024-04-02T07:23:08.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30fe00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff31015f560 con 0x7ff3100d0050 2024-04-02T07:23:08.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff31015ff90 0x7ff3100c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:08.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30ea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff310099490 0x7ff3101537c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:08.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff306000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff3100d0050 0x7ff3100c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:08.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff31015ff90 0x7ff3100c90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55268/0 (socket says 172.21.15.55:55268) 2024-04-02T07:23:08.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30ea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff310099490 0x7ff3101537c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:38952/0 (socket says 172.21.15.55:38952) 2024-04-02T07:23:08.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30f400640 1 -- 172.21.15.55:0/1985748084 learned_addr learned my addr 172.21.15.55:0/1985748084 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:08.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff306000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff3100d0050 0x7ff3100c8b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:56866/0 (socket says 172.21.15.55:56866) 2024-04-02T07:23:08.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30f400640 1 -- 172.21.15.55:0/1985748084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff3100d0050 msgr2=0x7ff3100c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:08.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30f400640 1 --2- 172.21.15.55:0/1985748084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff3100d0050 0x7ff3100c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30f400640 1 -- 172.21.15.55:0/1985748084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff310099490 msgr2=0x7ff3101537c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:08.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30f400640 1 --2- 172.21.15.55:0/1985748084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff310099490 0x7ff3101537c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30f400640 1 -- 172.21.15.55:0/1985748084 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff300009b30 con 0x7ff31015ff90 2024-04-02T07:23:08.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30f400640 1 --2- 172.21.15.55:0/1985748084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff31015ff90 0x7ff3100c90c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff30800c3c0 tx=0x7ff30800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:08.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff307e00640 1 -- 172.21.15.55:0/1985748084 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3080074e0 con 0x7ff31015ff90 2024-04-02T07:23:08.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff307e00640 1 -- 172.21.15.55:0/1985748084 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff308007640 con 0x7ff31015ff90 2024-04-02T07:23:08.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff307e00640 1 -- 172.21.15.55:0/1985748084 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff308004a10 con 0x7ff31015ff90 2024-04-02T07:23:08.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30fe00640 1 -- 172.21.15.55:0/1985748084 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3100ca2c0 con 0x7ff31015ff90 2024-04-02T07:23:08.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.244+0000 7ff30fe00640 1 -- 172.21.15.55:0/1985748084 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff31015f230 con 0x7ff31015ff90 2024-04-02T07:23:08.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.248+0000 7ff30fe00640 1 -- 172.21.15.55:0/1985748084 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3100c9e80 con 0x7ff31015ff90 2024-04-02T07:23:08.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.248+0000 7ff307e00640 1 -- 172.21.15.55:0/1985748084 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff308004b70 con 0x7ff31015ff90 2024-04-02T07:23:08.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.248+0000 7ff307e00640 1 --2- 172.21.15.55:0/1985748084 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff2ec066690 0x7ff2ec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:08.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.248+0000 7ff307e00640 1 -- 172.21.15.55:0/1985748084 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7ff308083af0 con 0x7ff31015ff90 2024-04-02T07:23:08.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.248+0000 7ff30ea00640 1 --2- 172.21.15.55:0/1985748084 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff2ec066690 0x7ff2ec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:08.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.248+0000 7ff30ea00640 1 --2- 172.21.15.55:0/1985748084 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff2ec066690 0x7ff2ec068b50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff3000ae000 tx=0x7ff3000a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:08.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.252+0000 7ff307e00640 1 -- 172.21.15.55:0/1985748084 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff3100c9e80 con 0x7ff31015ff90 2024-04-02T07:23:08.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.448+0000 7ff30fe00640 1 -- 172.21.15.55:0/1985748084 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff3100c9e80 con 0x7ff31015ff90 2024-04-02T07:23:08.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.448+0000 7ff307e00640 1 -- 172.21.15.55:0/1985748084 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4725 (secure 0 0 0) 0x7ff3100c9e80 con 0x7ff31015ff90 2024-04-02T07:23:08.454 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:08.454 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4247,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1468533802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1468533802},{"type":"v1","addr":"172.21.15.106:6837","nonce":1468533802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4272,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/342047131","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":342047131},{"type":"v1","addr":"172.21.15.55:6833","nonce":342047131}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/50847499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":50847499},{"type":"v1","addr":"172.21.15.55:6835","nonce":50847499}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:22:18.201059+0000","modified":"2024-04-02T07:22:21.225641+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4288},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4288":{"gid":4288,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6836/3829467285","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3829467285},{"type":"v1","addr":"172.21.15.106:6836","nonce":3829467285}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2024-04-02T07:23:08.454 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 8 2024-04-02T07:23:08.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.448+0000 7ff30fe00640 1 -- 172.21.15.55:0/1985748084 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff2ec066690 msgr2=0x7ff2ec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:08.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.448+0000 7ff30fe00640 1 --2- 172.21.15.55:0/1985748084 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff2ec066690 0x7ff2ec068b50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff3000ae000 tx=0x7ff3000a7070 comp rx=0 tx=0).stop 2024-04-02T07:23:08.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.448+0000 7ff30fe00640 1 -- 172.21.15.55:0/1985748084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff31015ff90 msgr2=0x7ff3100c90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:08.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.448+0000 7ff30fe00640 1 --2- 172.21.15.55:0/1985748084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff31015ff90 0x7ff3100c90c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7ff30800c3c0 tx=0x7ff30800c880 comp rx=0 tx=0).stop 2024-04-02T07:23:08.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.452+0000 7ff30fe00640 1 -- 172.21.15.55:0/1985748084 shutdown_connections 2024-04-02T07:23:08.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.452+0000 7ff30fe00640 1 --2- 172.21.15.55:0/1985748084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff31015ff90 0x7ff3100c90c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.452+0000 7ff30fe00640 1 --2- 172.21.15.55:0/1985748084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff3100d0050 0x7ff3100c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.452+0000 7ff30fe00640 1 --2- 172.21.15.55:0/1985748084 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff2ec066690 0x7ff2ec068b50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.452+0000 7ff30fe00640 1 --2- 172.21.15.55:0/1985748084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff310099490 0x7ff3101537c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.452+0000 7ff30fe00640 1 -- 172.21.15.55:0/1985748084 >> 172.21.15.55:0/1985748084 conn(0x7ff3100b1fb0 msgr2=0x7ff31006f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:08.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.452+0000 7ff30fe00640 1 -- 172.21.15.55:0/1985748084 shutdown_connections 2024-04-02T07:23:08.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.452+0000 7ff30fe00640 1 -- 172.21.15.55:0/1985748084 wait complete. 2024-04-02T07:23:08.475 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:23:08.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.612+0000 7f1905000640 1 Processor -- start 2024-04-02T07:23:08.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.612+0000 7f1905000640 1 -- start start 2024-04-02T07:23:08.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.612+0000 7f1905000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19000cbab0 0x7f19000cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:08.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.612+0000 7f1905000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19000cb620 con 0x7f190015cd10 2024-04-02T07:23:08.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.612+0000 7f1905000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f190015d0f0 con 0x7f19000ca560 2024-04-02T07:23:08.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.612+0000 7f1905000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19000caa10 con 0x7f19000cbab0 2024-04-02T07:23:08.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.612+0000 7f18fea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f19000cbab0 0x7f19000cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:08.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.612+0000 7f18ff400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f190015cd10 0x7f19000c9e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50162/0 (socket says 172.21.15.55:50162) 2024-04-02T07:23:08.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.612+0000 7f18ff400640 1 -- 172.21.15.55:0/649667941 learned_addr learned my addr 172.21.15.55:0/649667941 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:08.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.612+0000 7f18fea00640 1 -- 172.21.15.55:0/649667941 >> v1:172.21.15.106:6789/0 conn(0x7f19000ca560 legacy=0x7f19000aec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:08.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.612+0000 7f18fea00640 1 -- 172.21.15.55:0/649667941 >> v1:172.21.15.55:6789/0 conn(0x7f190015cd10 legacy=0x7f19000c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:08.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.612+0000 7f18fea00640 1 -- 172.21.15.55:0/649667941 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19000cacf0 con 0x7f19000cbab0 2024-04-02T07:23:08.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.612+0000 7f18fe000640 1 -- 172.21.15.55:0/649667941 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2220315666 0 0) 0x7f19000cb620 con 0x7f190015cd10 2024-04-02T07:23:08.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.616+0000 7f18fea00640 1 --2- 172.21.15.55:0/649667941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19000cbab0 0x7f19000cbec0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0097c0 tx=0x7f18ec01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c082a1547e5435e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.616+0000 7f18fe000640 1 -- 172.21.15.55:0/649667941 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec0ad680 con 0x7f19000cbab0 2024-04-02T07:23:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.616+0000 7f18fe000640 1 -- 172.21.15.55:0/649667941 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18ec0ad7e0 con 0x7f19000cbab0 2024-04-02T07:23:08.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.616+0000 7f18fe000640 1 -- 172.21.15.55:0/649667941 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18ec0adb70 con 0x7f19000cbab0 2024-04-02T07:23:08.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.616+0000 7f1905000640 1 -- 172.21.15.55:0/649667941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19000cbab0 msgr2=0x7f19000cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:08.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.616+0000 7f1905000640 1 --2- 172.21.15.55:0/649667941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19000cbab0 0x7f19000cbec0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0097c0 tx=0x7f18ec01c470 comp rx=0 tx=0).stop 2024-04-02T07:23:08.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.616+0000 7f1905000640 1 -- 172.21.15.55:0/649667941 shutdown_connections 2024-04-02T07:23:08.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.616+0000 7f1905000640 1 --2- 172.21.15.55:0/649667941 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19000cbab0 0x7f19000cbec0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.616+0000 7f1905000640 1 -- 172.21.15.55:0/649667941 >> 172.21.15.55:0/649667941 conn(0x7f1900098a10 msgr2=0x7f19000cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:08.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.616+0000 7f1905000640 1 -- 172.21.15.55:0/649667941 shutdown_connections 2024-04-02T07:23:08.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.616+0000 7f1905000640 1 -- 172.21.15.55:0/649667941 wait complete. 2024-04-02T07:23:08.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.616+0000 7f1905000640 1 Processor -- start 2024-04-02T07:23:08.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.616+0000 7f1905000640 1 -- start start 2024-04-02T07:23:08.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f1905000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19000ca560 0x7f19000b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:08.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f1905000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f190015cd10 0x7f190006d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:08.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f1905000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1900154d90 0x7f190006d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f1905000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19000b3020 con 0x7f19000ca560 2024-04-02T07:23:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f1905000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19000b5370 con 0x7f1900154d90 2024-04-02T07:23:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f1905000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19001f9810 con 0x7f190015cd10 2024-04-02T07:23:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f18ff400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19000ca560 0x7f19000b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f18ff400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19000ca560 0x7f19000b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55276/0 (socket says 172.21.15.55:55276) 2024-04-02T07:23:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f18ff400640 1 -- 172.21.15.55:0/168880132 learned_addr learned my addr 172.21.15.55:0/168880132 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f18fea00640 1 --2- 172.21.15.55:0/168880132 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f190015cd10 0x7f190006d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f18ffe00640 1 --2- 172.21.15.55:0/168880132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1900154d90 0x7f190006d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f18ff400640 1 -- 172.21.15.55:0/168880132 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f190015cd10 msgr2=0x7f190006d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f18ff400640 1 --2- 172.21.15.55:0/168880132 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f190015cd10 0x7f190006d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f18ff400640 1 -- 172.21.15.55:0/168880132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1900154d90 msgr2=0x7f190006d8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f18ff400640 1 --2- 172.21.15.55:0/168880132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1900154d90 0x7f190006d8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f18ff400640 1 -- 172.21.15.55:0/168880132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ec009420 con 0x7f19000ca560 2024-04-02T07:23:08.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f18ffe00640 1 --2- 172.21.15.55:0/168880132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1900154d90 0x7f190006d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:08.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f18ff400640 1 --2- 172.21.15.55:0/168880132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19000ca560 0x7f19000b34b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f18f000c4a0 tx=0x7f18f000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:08.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f18f7400640 1 -- 172.21.15.55:0/168880132 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f00074e0 con 0x7f19000ca560 2024-04-02T07:23:08.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f18f7400640 1 -- 172.21.15.55:0/168880132 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18f0007640 con 0x7f19000ca560 2024-04-02T07:23:08.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f18f7400640 1 -- 172.21.15.55:0/168880132 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18f0004a30 con 0x7f19000ca560 2024-04-02T07:23:08.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f1905000640 1 -- 172.21.15.55:0/168880132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19001f9af0 con 0x7f19000ca560 2024-04-02T07:23:08.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f1905000640 1 -- 172.21.15.55:0/168880132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19000b2cb0 con 0x7f19000ca560 2024-04-02T07:23:08.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f1905000640 1 -- 172.21.15.55:0/168880132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1900073fa0 con 0x7f19000ca560 2024-04-02T07:23:08.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.620+0000 7f18f7400640 1 -- 172.21.15.55:0/168880132 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f18f0004b90 con 0x7f19000ca560 2024-04-02T07:23:08.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.624+0000 7f18f7400640 1 --2- 172.21.15.55:0/168880132 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f18e0066690 0x7f18e0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:08.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.624+0000 7f18f7400640 1 -- 172.21.15.55:0/168880132 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f18f00833e0 con 0x7f19000ca560 2024-04-02T07:23:08.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.624+0000 7f18fea00640 1 --2- 172.21.15.55:0/168880132 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f18e0066690 0x7f18e0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:08.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.624+0000 7f18fea00640 1 --2- 172.21.15.55:0/168880132 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f18e0066690 0x7f18e0068b50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0af000 tx=0x7f18ec0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:08.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.628+0000 7f18f7400640 1 -- 172.21.15.55:0/168880132 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f18f0050770 con 0x7f19000ca560 2024-04-02T07:23:08.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.792+0000 7f1905000640 1 -- 172.21.15.55:0/168880132 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19000c99e0 con 0x7f19000ca560 2024-04-02T07:23:08.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.792+0000 7f18f7400640 1 -- 172.21.15.55:0/168880132 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+16287 (secure 0 0 0) 0x7f18f0018090 con 0x7f19000ca560 2024-04-02T07:23:08.799 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:08.799 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":22,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:23:00.192054+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:22:16.738297+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-02T07:22:17.190496+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"3.36","mappings":[{"from":5,"to":2}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:23:08.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.796+0000 7f1905000640 1 -- 172.21.15.55:0/168880132 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f18e0066690 msgr2=0x7f18e0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:08.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.796+0000 7f1905000640 1 --2- 172.21.15.55:0/168880132 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f18e0066690 0x7f18e0068b50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f18ec0af000 tx=0x7f18ec0a7000 comp rx=0 tx=0).stop 2024-04-02T07:23:08.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.796+0000 7f1905000640 1 -- 172.21.15.55:0/168880132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19000ca560 msgr2=0x7f19000b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:08.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.796+0000 7f1905000640 1 --2- 172.21.15.55:0/168880132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19000ca560 0x7f19000b34b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f18f000c4a0 tx=0x7f18f000c960 comp rx=0 tx=0).stop 2024-04-02T07:23:08.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.796+0000 7f1905000640 1 -- 172.21.15.55:0/168880132 shutdown_connections 2024-04-02T07:23:08.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.796+0000 7f1905000640 1 --2- 172.21.15.55:0/168880132 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f18e0066690 0x7f18e0068b50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.796+0000 7f1905000640 1 --2- 172.21.15.55:0/168880132 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1900154d90 0x7f190006d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.796+0000 7f1905000640 1 --2- 172.21.15.55:0/168880132 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f190015cd10 0x7f190006d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.796+0000 7f1905000640 1 --2- 172.21.15.55:0/168880132 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f19000ca560 0x7f19000b34b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.796+0000 7f1905000640 1 -- 172.21.15.55:0/168880132 >> 172.21.15.55:0/168880132 conn(0x7f1900098a10 msgr2=0x7f1900069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:08.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.796+0000 7f1905000640 1 -- 172.21.15.55:0/168880132 shutdown_connections 2024-04-02T07:23:08.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.796+0000 7f1905000640 1 -- 172.21.15.55:0/168880132 wait complete. 2024-04-02T07:23:08.820 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-02T07:23:08.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.956+0000 7f9982400640 1 Processor -- start 2024-04-02T07:23:08.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.956+0000 7f9982400640 1 -- start start 2024-04-02T07:23:08.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.956+0000 7f9982400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f997c1659d0 0x7f997c167dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:08.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.956+0000 7f9982400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997c15df80 con 0x7f997c160a50 2024-04-02T07:23:08.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.956+0000 7f9982400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997c06a8d0 con 0x7f997c160670 2024-04-02T07:23:08.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.956+0000 7f9982400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f997c0cd410 con 0x7f997c1659d0 2024-04-02T07:23:08.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.956+0000 7f997be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f997c1659d0 0x7f997c167dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:08.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.956+0000 7f9972a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f997c160a50 0x7f997c160ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50168/0 (socket says 172.21.15.55:50168) 2024-04-02T07:23:08.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.956+0000 7f997be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f997c1659d0 0x7f997c167dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55282/0 (socket says 172.21.15.55:55282) 2024-04-02T07:23:08.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.956+0000 7f9972a00640 1 -- 172.21.15.55:0/3437506135 learned_addr learned my addr 172.21.15.55:0/3437506135 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:08.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.956+0000 7f997be00640 1 -- 172.21.15.55:0/3437506135 >> v1:172.21.15.106:6789/0 conn(0x7f997c160670 legacy=0x7f997c0ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:08.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.956+0000 7f997be00640 1 -- 172.21.15.55:0/3437506135 >> v1:172.21.15.55:6789/0 conn(0x7f997c160a50 legacy=0x7f997c160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:08.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.956+0000 7f997be00640 1 -- 172.21.15.55:0/3437506135 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997c06abb0 con 0x7f997c1659d0 2024-04-02T07:23:08.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.960+0000 7f997be00640 1 --2- 172.21.15.55:0/3437506135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997c1659d0 0x7f997c167dc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f99740097c0 tx=0x7f997401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=425a21b1cd4cdc77 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:08.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.960+0000 7f997aa00640 1 -- 172.21.15.55:0/3437506135 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99740ac630 con 0x7f997c1659d0 2024-04-02T07:23:08.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.960+0000 7f997aa00640 1 -- 172.21.15.55:0/3437506135 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99740ac790 con 0x7f997c1659d0 2024-04-02T07:23:08.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.960+0000 7f997aa00640 1 -- 172.21.15.55:0/3437506135 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99740acb20 con 0x7f997c1659d0 2024-04-02T07:23:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.960+0000 7f9982400640 1 -- 172.21.15.55:0/3437506135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997c1659d0 msgr2=0x7f997c167dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.960+0000 7f9982400640 1 --2- 172.21.15.55:0/3437506135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997c1659d0 0x7f997c167dc0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f99740097c0 tx=0x7f997401c3d0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.960+0000 7f9982400640 1 -- 172.21.15.55:0/3437506135 shutdown_connections 2024-04-02T07:23:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.960+0000 7f9982400640 1 --2- 172.21.15.55:0/3437506135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997c1659d0 0x7f997c167dc0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.960+0000 7f9982400640 1 -- 172.21.15.55:0/3437506135 >> 172.21.15.55:0/3437506135 conn(0x7f997c0cb7d0 msgr2=0x7f997c0cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.960+0000 7f9982400640 1 -- 172.21.15.55:0/3437506135 shutdown_connections 2024-04-02T07:23:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.960+0000 7f9982400640 1 -- 172.21.15.55:0/3437506135 wait complete. 2024-04-02T07:23:08.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9982400640 1 Processor -- start 2024-04-02T07:23:08.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9982400640 1 -- start start 2024-04-02T07:23:08.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9982400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f997c160670 0x7f997c14fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:08.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9982400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997c160a50 0x7f997c1565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:08.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9982400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f997c1659d0 0x7f997c156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:08.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9982400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997c150370 con 0x7f997c160a50 2024-04-02T07:23:08.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9982400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997c153b70 con 0x7f997c160670 2024-04-02T07:23:08.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9982400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997c153e50 con 0x7f997c1659d0 2024-04-02T07:23:08.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9972a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997c160a50 0x7f997c1565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:08.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9972a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997c160a50 0x7f997c1565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55286/0 (socket says 172.21.15.55:55286) 2024-04-02T07:23:08.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9972a00640 1 -- 172.21.15.55:0/323081308 learned_addr learned my addr 172.21.15.55:0/323081308 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:08.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f997be00640 1 --2- 172.21.15.55:0/323081308 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f997c1659d0 0x7f997c156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:08.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f997b400640 1 --2- 172.21.15.55:0/323081308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f997c160670 0x7f997c14fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:08.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9972a00640 1 -- 172.21.15.55:0/323081308 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f997c1659d0 msgr2=0x7f997c156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:08.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9972a00640 1 --2- 172.21.15.55:0/323081308 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f997c1659d0 0x7f997c156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9972a00640 1 -- 172.21.15.55:0/323081308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f997c160670 msgr2=0x7f997c14fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:08.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9972a00640 1 --2- 172.21.15.55:0/323081308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f997c160670 0x7f997c14fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:08.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9972a00640 1 -- 172.21.15.55:0/323081308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9974009420 con 0x7f997c160a50 2024-04-02T07:23:08.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9972a00640 1 --2- 172.21.15.55:0/323081308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997c160a50 0x7f997c1565a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f996400c500 tx=0x7f996400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:08.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9973e00640 1 -- 172.21.15.55:0/323081308 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9964005cf0 con 0x7f997c160a50 2024-04-02T07:23:08.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9973e00640 1 -- 172.21.15.55:0/323081308 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9964005e50 con 0x7f997c160a50 2024-04-02T07:23:08.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9973e00640 1 -- 172.21.15.55:0/323081308 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99640072f0 con 0x7f997c160a50 2024-04-02T07:23:08.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9982400640 1 -- 172.21.15.55:0/323081308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f997c154130 con 0x7f997c160a50 2024-04-02T07:23:08.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.964+0000 7f9982400640 1 -- 172.21.15.55:0/323081308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f997c1546f0 con 0x7f997c160a50 2024-04-02T07:23:08.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.968+0000 7f9982400640 1 -- 172.21.15.55:0/323081308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f997c066c90 con 0x7f997c160a50 2024-04-02T07:23:08.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.968+0000 7f9973e00640 1 -- 172.21.15.55:0/323081308 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f9964007450 con 0x7f997c160a50 2024-04-02T07:23:08.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.968+0000 7f9973e00640 1 --2- 172.21.15.55:0/323081308 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f99580666c0 0x7f9958068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:08.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.968+0000 7f9973e00640 1 -- 172.21.15.55:0/323081308 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5825+0+0 (secure 0 0 0) 0x7f99640836a0 con 0x7f997c160a50 2024-04-02T07:23:08.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.968+0000 7f997b400640 1 --2- 172.21.15.55:0/323081308 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f99580666c0 0x7f9958068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:08.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.968+0000 7f997b400640 1 --2- 172.21.15.55:0/323081308 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f99580666c0 0x7f9958068b80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f997c0c1ca0 tx=0x7f996c0094d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:08.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:08.972+0000 7f9973e00640 1 -- 172.21.15.55:0/323081308 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f9964050a30 con 0x7f997c160a50 2024-04-02T07:23:09.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.168+0000 7f9982400640 1 -- 172.21.15.55:0/323081308 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f997c0acd10 con 0x7f997c160a50 2024-04-02T07:23:09.173 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-02T07:23:09.168+0000 7f8f18800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-02T07:23:09.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.188+0000 7f9973e00640 1 -- 172.21.15.55:0/323081308 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9964054050 con 0x7f997c160a50 2024-04-02T07:23:09.192 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-02T07:23:09.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.188+0000 7f9982400640 1 -- 172.21.15.55:0/323081308 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f99580666c0 msgr2=0x7f9958068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:09.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.188+0000 7f9982400640 1 --2- 172.21.15.55:0/323081308 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f99580666c0 0x7f9958068b80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f997c0c1ca0 tx=0x7f996c0094d0 comp rx=0 tx=0).stop 2024-04-02T07:23:09.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.188+0000 7f9982400640 1 -- 172.21.15.55:0/323081308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997c160a50 msgr2=0x7f997c1565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:09.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.188+0000 7f9982400640 1 --2- 172.21.15.55:0/323081308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997c160a50 0x7f997c1565a0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f996400c500 tx=0x7f996400c9c0 comp rx=0 tx=0).stop 2024-04-02T07:23:09.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.188+0000 7f9982400640 1 -- 172.21.15.55:0/323081308 shutdown_connections 2024-04-02T07:23:09.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.188+0000 7f9982400640 1 --2- 172.21.15.55:0/323081308 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f997c1659d0 0x7f997c156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:09.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.188+0000 7f9982400640 1 --2- 172.21.15.55:0/323081308 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f997c160a50 0x7f997c1565a0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:09.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.188+0000 7f9982400640 1 --2- 172.21.15.55:0/323081308 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f99580666c0 0x7f9958068b80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:09.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.188+0000 7f9982400640 1 --2- 172.21.15.55:0/323081308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f997c160670 0x7f997c14fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:09.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.188+0000 7f9982400640 1 -- 172.21.15.55:0/323081308 >> 172.21.15.55:0/323081308 conn(0x7f997c0cb7d0 msgr2=0x7f997c0ccc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:09.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.188+0000 7f9982400640 1 -- 172.21.15.55:0/323081308 shutdown_connections 2024-04-02T07:23:09.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.188+0000 7f9982400640 1 -- 172.21.15.55:0/323081308 wait complete. 2024-04-02T07:23:09.200 INFO:tasks.ceph.mds.b.smithi106.stderr: -2924> 2024-04-02T07:22:23.000+0000 7f6954200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:23:09.213 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-02T07:23:09.247 INFO:tasks.ceph.mds.b.smithi106.stdout:starting mds.b at 2024-04-02T07:23:09.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.352+0000 7fcf2ec00640 1 Processor -- start 2024-04-02T07:23:09.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.352+0000 7fcf2ec00640 1 -- start start 2024-04-02T07:23:09.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.352+0000 7fcf2ec00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2815ca70 0x7fcf280cf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:09.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.352+0000 7fcf2ec00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2806bc50 con 0x7fcf28099120 2024-04-02T07:23:09.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.352+0000 7fcf2ec00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2806b040 con 0x7fcf2815c690 2024-04-02T07:23:09.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.352+0000 7fcf2ec00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2806b320 con 0x7fcf2815ca70 2024-04-02T07:23:09.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.352+0000 7fcf2ce00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcf28099120 0x7fcf28164780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50174/0 (socket says 172.21.15.55:50174) 2024-04-02T07:23:09.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.352+0000 7fcf2ce00640 1 -- 172.21.15.55:0/3552588127 learned_addr learned my addr 172.21.15.55:0/3552588127 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:09.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.352+0000 7fcf2e200640 1 --2- 172.21.15.55:0/3552588127 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2815ca70 0x7fcf280cf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:09.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.352+0000 7fcf27e00640 1 -- 172.21.15.55:0/3552588127 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2469317723 0 0) 0x7fcf2806bc50 con 0x7fcf28099120 2024-04-02T07:23:09.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf27e00640 1 -- 172.21.15.55:0/3552588127 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf10003530 con 0x7fcf28099120 2024-04-02T07:23:09.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf27e00640 1 -- 172.21.15.55:0/3552588127 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 671835508 0 0) 0x7fcf2806b040 con 0x7fcf2815c690 2024-04-02T07:23:09.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf27e00640 1 -- 172.21.15.55:0/3552588127 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf2806bc50 con 0x7fcf2815c690 2024-04-02T07:23:09.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf27e00640 1 -- 172.21.15.55:0/3552588127 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2796373947 0 0) 0x7fcf10003530 con 0x7fcf28099120 2024-04-02T07:23:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf27e00640 1 -- 172.21.15.55:0/3552588127 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2815ca70 msgr2=0x7fcf280cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf27e00640 1 --2- 172.21.15.55:0/3552588127 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2815ca70 0x7fcf280cf730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf27e00640 1 -- 172.21.15.55:0/3552588127 >> v1:172.21.15.106:6789/0 conn(0x7fcf2815c690 legacy=0x7fcf28098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf27e00640 1 -- 172.21.15.55:0/3552588127 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2806b600 con 0x7fcf28099120 2024-04-02T07:23:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf27e00640 1 -- 172.21.15.55:0/3552588127 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fcf14001680 con 0x7fcf28099120 2024-04-02T07:23:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf2e200640 1 --2- 172.21.15.55:0/3552588127 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2815ca70 0x7fcf280cf730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:23:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf27e00640 1 -- 172.21.15.55:0/3552588127 >> v1:172.21.15.55:6789/0 conn(0x7fcf28099120 legacy=0x7fcf28164780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf27e00640 1 --2- 172.21.15.55:0/3552588127 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2815ca70 0x7fcf10003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf27e00640 1 --2- 172.21.15.55:0/3552588127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf10004080 0x7fcf100047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf27e00640 1 --2- 172.21.15.55:0/3552588127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf10004d10 0x7fcf10005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf27e00640 1 -- 172.21.15.55:0/3552588127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2806b320 con 0x7fcf10004080 2024-04-02T07:23:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf27e00640 1 -- 172.21.15.55:0/3552588127 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1000ba40 con 0x7fcf10004d10 2024-04-02T07:23:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf27e00640 1 -- 172.21.15.55:0/3552588127 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1000bc00 con 0x7fcf2815ca70 2024-04-02T07:23:09.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf2ce00640 1 --2- 172.21.15.55:0/3552588127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf10004080 0x7fcf100047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:09.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf2d800640 1 --2- 172.21.15.55:0/3552588127 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2815ca70 0x7fcf10003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:09.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf2e200640 1 --2- 172.21.15.55:0/3552588127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf10004d10 0x7fcf10005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:09.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf2ce00640 1 -- 172.21.15.55:0/3552588127 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2815ca70 msgr2=0x7fcf10003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:09.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf2ce00640 1 --2- 172.21.15.55:0/3552588127 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2815ca70 0x7fcf10003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:09.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf2ce00640 1 -- 172.21.15.55:0/3552588127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf10004d10 msgr2=0x7fcf10005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:09.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf2ce00640 1 --2- 172.21.15.55:0/3552588127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf10004d10 0x7fcf10005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:09.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf2ce00640 1 -- 172.21.15.55:0/3552588127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf20009a70 con 0x7fcf10004080 2024-04-02T07:23:09.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.356+0000 7fcf2ce00640 1 --2- 172.21.15.55:0/3552588127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf10004080 0x7fcf100047d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcf2806a730 tx=0x7fcf1401cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df66a0e3180261e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:09.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf27e00640 1 -- 172.21.15.55:0/3552588127 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf140058e0 con 0x7fcf10004080 2024-04-02T07:23:09.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf27e00640 1 -- 172.21.15.55:0/3552588127 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf14005a60 con 0x7fcf10004080 2024-04-02T07:23:09.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf27e00640 1 -- 172.21.15.55:0/3552588127 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf14005e10 con 0x7fcf10004080 2024-04-02T07:23:09.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf2ec00640 1 -- 172.21.15.55:0/3552588127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf10004080 msgr2=0x7fcf100047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:09.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf2ec00640 1 --2- 172.21.15.55:0/3552588127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf10004080 0x7fcf100047d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fcf2806a730 tx=0x7fcf1401cba0 comp rx=0 tx=0).stop 2024-04-02T07:23:09.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf2e200640 1 -- 172.21.15.55:0/3552588127 reap_dead start 2024-04-02T07:23:09.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf2ec00640 1 -- 172.21.15.55:0/3552588127 shutdown_connections 2024-04-02T07:23:09.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf2ec00640 1 -- 172.21.15.55:0/3552588127 >> 172.21.15.55:0/3552588127 conn(0x7fcf280b1ff0 msgr2=0x7fcf280b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:09.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf2ec00640 1 -- 172.21.15.55:0/3552588127 shutdown_connections 2024-04-02T07:23:09.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf2ec00640 1 -- 172.21.15.55:0/3552588127 wait complete. 2024-04-02T07:23:09.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf2ec00640 1 Processor -- start 2024-04-02T07:23:09.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf2ec00640 1 -- start start 2024-04-02T07:23:09.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf2ec00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf10004080 0x7fcf28158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf2ec00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf280ce960 0x7fcf281f23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf2ec00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf280cedc0 0x7fcf281f2900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf2ec00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf28158200 con 0x7fcf280ce960 2024-04-02T07:23:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf2ec00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf281f2f30 con 0x7fcf10004080 2024-04-02T07:23:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf2ec00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf281f3210 con 0x7fcf280cedc0 2024-04-02T07:23:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf2ce00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf280ce960 0x7fcf281f23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf2ce00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf280ce960 0x7fcf281f23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55304/0 (socket says 172.21.15.55:55304) 2024-04-02T07:23:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf2ce00640 1 -- 172.21.15.55:0/511958969 learned_addr learned my addr 172.21.15.55:0/511958969 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf2e200640 1 --2- 172.21.15.55:0/511958969 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf280cedc0 0x7fcf281f2900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.360+0000 7fcf2d800640 1 --2- 172.21.15.55:0/511958969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf10004080 0x7fcf28158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.364+0000 7fcf2ce00640 1 -- 172.21.15.55:0/511958969 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf280cedc0 msgr2=0x7fcf281f2900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.364+0000 7fcf2ce00640 1 --2- 172.21.15.55:0/511958969 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf280cedc0 0x7fcf281f2900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.364+0000 7fcf2ce00640 1 -- 172.21.15.55:0/511958969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf10004080 msgr2=0x7fcf28158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.364+0000 7fcf2ce00640 1 --2- 172.21.15.55:0/511958969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf10004080 0x7fcf28158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.364+0000 7fcf2ce00640 1 -- 172.21.15.55:0/511958969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf28158410 con 0x7fcf280ce960 2024-04-02T07:23:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.364+0000 7fcf2ce00640 1 --2- 172.21.15.55:0/511958969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf280ce960 0x7fcf281f23c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcf1401c9d0 tx=0x7fcf10005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:09.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.364+0000 7fcf25600640 1 -- 172.21.15.55:0/511958969 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf140a5cb0 con 0x7fcf280ce960 2024-04-02T07:23:09.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.364+0000 7fcf25600640 1 -- 172.21.15.55:0/511958969 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf140a5e10 con 0x7fcf280ce960 2024-04-02T07:23:09.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.364+0000 7fcf2ec00640 1 -- 172.21.15.55:0/511958969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf281586f0 con 0x7fcf280ce960 2024-04-02T07:23:09.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.364+0000 7fcf25600640 1 -- 172.21.15.55:0/511958969 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf140049f0 con 0x7fcf280ce960 2024-04-02T07:23:09.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.364+0000 7fcf2ec00640 1 -- 172.21.15.55:0/511958969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf28159130 con 0x7fcf280ce960 2024-04-02T07:23:09.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.364+0000 7fcf2ec00640 1 -- 172.21.15.55:0/511958969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf28073fa0 con 0x7fcf280ce960 2024-04-02T07:23:09.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.364+0000 7fcf25600640 1 -- 172.21.15.55:0/511958969 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fcf14004b50 con 0x7fcf280ce960 2024-04-02T07:23:09.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.364+0000 7fcf25600640 1 --2- 172.21.15.55:0/511958969 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf080666c0 0x7fcf08068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:09.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.364+0000 7fcf25600640 1 -- 172.21.15.55:0/511958969 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7fcf1c001d30 con 0x7fcf280ce960 2024-04-02T07:23:09.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.364+0000 7fcf2d800640 1 --2- 172.21.15.55:0/511958969 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf080666c0 0x7fcf08068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:09.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.368+0000 7fcf2d800640 1 --2- 172.21.15.55:0/511958969 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf080666c0 0x7fcf08068b80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c000c10 tx=0x7fcf1c001490 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:09.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.368+0000 7fcf25600640 1 -- 172.21.15.55:0/511958969 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fcf140eb350 con 0x7fcf280ce960 2024-04-02T07:23:09.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:09.564+0000 7fcf2ec00640 1 -- 172.21.15.55:0/511958969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fcf2806c600 con 0x7fcf280ce960 2024-04-02T07:23:10.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.188+0000 7fcf25600640 1 -- 172.21.15.55:0/511958969 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7fcf140ee970 con 0x7fcf280ce960 2024-04-02T07:23:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.192+0000 7fcf2ec00640 1 -- 172.21.15.55:0/511958969 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf080666c0 msgr2=0x7fcf08068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.192+0000 7fcf2ec00640 1 --2- 172.21.15.55:0/511958969 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf080666c0 0x7fcf08068b80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c000c10 tx=0x7fcf1c001490 comp rx=0 tx=0).stop 2024-04-02T07:23:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.192+0000 7fcf2ec00640 1 -- 172.21.15.55:0/511958969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf280ce960 msgr2=0x7fcf281f23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.192+0000 7fcf2ec00640 1 --2- 172.21.15.55:0/511958969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf280ce960 0x7fcf281f23c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fcf1401c9d0 tx=0x7fcf10005800 comp rx=0 tx=0).stop 2024-04-02T07:23:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.192+0000 7fcf2ec00640 1 -- 172.21.15.55:0/511958969 shutdown_connections 2024-04-02T07:23:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.192+0000 7fcf2ec00640 1 --2- 172.21.15.55:0/511958969 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf280cedc0 0x7fcf281f2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:10.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.192+0000 7fcf2ec00640 1 --2- 172.21.15.55:0/511958969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf280ce960 0x7fcf281f23c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:10.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.192+0000 7fcf2ec00640 1 --2- 172.21.15.55:0/511958969 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf080666c0 0x7fcf08068b80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:10.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.192+0000 7fcf2ec00640 1 --2- 172.21.15.55:0/511958969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf10004080 0x7fcf28158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:10.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.192+0000 7fcf2ec00640 1 -- 172.21.15.55:0/511958969 >> 172.21.15.55:0/511958969 conn(0x7fcf280b1ff0 msgr2=0x7fcf280b3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:10.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.192+0000 7fcf2ec00640 1 -- 172.21.15.55:0/511958969 shutdown_connections 2024-04-02T07:23:10.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.192+0000 7fcf2ec00640 1 -- 172.21.15.55:0/511958969 wait complete. 2024-04-02T07:23:10.219 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-02T07:23:10.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.364+0000 7ff884a00640 1 Processor -- start 2024-04-02T07:23:10.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.364+0000 7ff884a00640 1 -- start start 2024-04-02T07:23:10.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.364+0000 7ff884a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff8800cc700 0x7ff88006bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:10.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.364+0000 7ff884a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff8800cead0 0x7ff880098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:10.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.364+0000 7ff884a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff880099360 con 0x7ff880098f50 2024-04-02T07:23:10.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.364+0000 7ff884a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8800ccae0 con 0x7ff8800cead0 2024-04-02T07:23:10.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.364+0000 7ff884a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8800d0300 con 0x7ff8800cc700 2024-04-02T07:23:10.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.364+0000 7ff877e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff8800cead0 0x7ff880098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:10.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.364+0000 7ff877e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff8800cead0 0x7ff880098a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55308/0 (socket says 172.21.15.55:55308) 2024-04-02T07:23:10.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.364+0000 7ff877e00640 1 -- 172.21.15.55:0/3189073729 learned_addr learned my addr 172.21.15.55:0/3189073729 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:10.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.364+0000 7ff87e800640 1 --1- 172.21.15.55:0/3189073729 >> v1:172.21.15.55:6789/0 conn(0x7ff880098f50 0x7ff88015c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50178/0 (socket says 172.21.15.55:50178) 2024-04-02T07:23:10.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.364+0000 7ff87de00640 1 --2- 172.21.15.55:0/3189073729 >> v2:172.21.15.106:3300/0 conn(0x7ff8800cc700 0x7ff88006bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:10.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.364+0000 7ff877e00640 1 -- 172.21.15.55:0/3189073729 >> v2:172.21.15.106:3300/0 conn(0x7ff8800cc700 msgr2=0x7ff88006bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:10.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.364+0000 7ff877e00640 1 --2- 172.21.15.55:0/3189073729 >> v2:172.21.15.106:3300/0 conn(0x7ff8800cc700 0x7ff88006bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:10.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.364+0000 7ff877e00640 1 -- 172.21.15.55:0/3189073729 >> v1:172.21.15.55:6789/0 conn(0x7ff880098f50 legacy=0x7ff88015c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:10.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.364+0000 7ff877e00640 1 -- 172.21.15.55:0/3189073729 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8800cf260 con 0x7ff8800cead0 2024-04-02T07:23:10.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.368+0000 7ff877e00640 1 --2- 172.21.15.55:0/3189073729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8800cead0 0x7ff880098a10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff880070cc0 tx=0x7ff86801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d2ca101855f534 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:10.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.368+0000 7ff87d400640 1 -- 172.21.15.55:0/3189073729 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8680aa680 con 0x7ff8800cead0 2024-04-02T07:23:10.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.368+0000 7ff87d400640 1 -- 172.21.15.55:0/3189073729 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8680aa7e0 con 0x7ff8800cead0 2024-04-02T07:23:10.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.368+0000 7ff87d400640 1 -- 172.21.15.55:0/3189073729 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8680aab70 con 0x7ff8800cead0 2024-04-02T07:23:10.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.368+0000 7ff884a00640 1 -- 172.21.15.55:0/3189073729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8800cead0 msgr2=0x7ff880098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:10.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.368+0000 7ff884a00640 1 --2- 172.21.15.55:0/3189073729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8800cead0 0x7ff880098a10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff880070cc0 tx=0x7ff86801c520 comp rx=0 tx=0).stop 2024-04-02T07:23:10.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.368+0000 7ff884a00640 1 -- 172.21.15.55:0/3189073729 shutdown_connections 2024-04-02T07:23:10.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.368+0000 7ff884a00640 1 --2- 172.21.15.55:0/3189073729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8800cead0 0x7ff880098a10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:10.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.368+0000 7ff884a00640 1 --2- 172.21.15.55:0/3189073729 >> v2:172.21.15.106:3300/0 conn(0x7ff8800cc700 0x7ff88006bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:10.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.368+0000 7ff884a00640 1 -- 172.21.15.55:0/3189073729 >> 172.21.15.55:0/3189073729 conn(0x7ff8800b2150 msgr2=0x7ff8800b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:10.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.368+0000 7ff884a00640 1 -- 172.21.15.55:0/3189073729 shutdown_connections 2024-04-02T07:23:10.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.368+0000 7ff884a00640 1 -- 172.21.15.55:0/3189073729 wait complete. 2024-04-02T07:23:10.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff884a00640 1 Processor -- start 2024-04-02T07:23:10.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff884a00640 1 -- start start 2024-04-02T07:23:10.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff884a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff880098f50 0x7ff880148f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:10.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff884a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8800cc700 0x7ff8800ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:10.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff884a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8800cead0 0x7ff880158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:10.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff884a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8801594e0 con 0x7ff8800cc700 2024-04-02T07:23:10.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff884a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8800adf90 con 0x7ff8800cead0 2024-04-02T07:23:10.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff884a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8800af650 con 0x7ff880098f50 2024-04-02T07:23:10.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff877e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8800cc700 0x7ff8800ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:10.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff877e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8800cc700 0x7ff8800ae3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55322/0 (socket says 172.21.15.55:55322) 2024-04-02T07:23:10.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff877e00640 1 -- 172.21.15.55:0/2610317540 learned_addr learned my addr 172.21.15.55:0/2610317540 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:10.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff87de00640 1 --2- 172.21.15.55:0/2610317540 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff880098f50 0x7ff880148f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:10.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff87e800640 1 --2- 172.21.15.55:0/2610317540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8800cead0 0x7ff880158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:10.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff877e00640 1 -- 172.21.15.55:0/2610317540 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff880098f50 msgr2=0x7ff880148f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:10.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff877e00640 1 --2- 172.21.15.55:0/2610317540 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff880098f50 0x7ff880148f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:10.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff877e00640 1 -- 172.21.15.55:0/2610317540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8800cead0 msgr2=0x7ff880158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:10.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff877e00640 1 --2- 172.21.15.55:0/2610317540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8800cead0 0x7ff880158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:10.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff877e00640 1 -- 172.21.15.55:0/2610317540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8680094d0 con 0x7ff8800cc700 2024-04-02T07:23:10.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff87de00640 1 --2- 172.21.15.55:0/2610317540 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff880098f50 0x7ff880148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:10.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff877e00640 1 --2- 172.21.15.55:0/2610317540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8800cc700 0x7ff8800ae3b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff86801a150 tx=0x7ff86801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:10.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff876000640 1 -- 172.21.15.55:0/2610317540 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8680bd5f0 con 0x7ff8800cc700 2024-04-02T07:23:10.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff876000640 1 -- 172.21.15.55:0/2610317540 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8680bd770 con 0x7ff8800cc700 2024-04-02T07:23:10.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff884a00640 1 -- 172.21.15.55:0/2610317540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff880159200 con 0x7ff8800cc700 2024-04-02T07:23:10.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff876000640 1 -- 172.21.15.55:0/2610317540 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8680bdb20 con 0x7ff8800cc700 2024-04-02T07:23:10.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.372+0000 7ff884a00640 1 -- 172.21.15.55:0/2610317540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8800adbb0 con 0x7ff8800cc700 2024-04-02T07:23:10.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.376+0000 7ff884a00640 1 -- 172.21.15.55:0/2610317540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8800ad730 con 0x7ff8800cc700 2024-04-02T07:23:10.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.376+0000 7ff876000640 1 -- 172.21.15.55:0/2610317540 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff8680b3600 con 0x7ff8800cc700 2024-04-02T07:23:10.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.376+0000 7ff876000640 1 --2- 172.21.15.55:0/2610317540 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff85c066690 0x7ff85c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:10.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.376+0000 7ff876000640 1 -- 172.21.15.55:0/2610317540 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5911+0+0 (secure 0 0 0) 0x7ff86811e600 con 0x7ff8800cc700 2024-04-02T07:23:10.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.376+0000 7ff87de00640 1 --2- 172.21.15.55:0/2610317540 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff85c066690 0x7ff85c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:10.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.376+0000 7ff87de00640 1 --2- 172.21.15.55:0/2610317540 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff85c066690 0x7ff85c068b50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff870009b10 tx=0x7ff870008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:10.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.380+0000 7ff876000640 1 -- 172.21.15.55:0/2610317540 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff8800ad730 con 0x7ff8800cc700 2024-04-02T07:23:10.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:10.544+0000 7ff884a00640 1 -- 172.21.15.55:0/2610317540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff8800ad730 con 0x7ff8800cc700 2024-04-02T07:23:11.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.320+0000 7ff876000640 1 -- 172.21.15.55:0/2610317540 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v24) v1 ==== 181+0+0 (secure 0 0 0) 0x7ff8800ad730 con 0x7ff8800cc700 2024-04-02T07:23:11.325 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2024-04-02T07:23:11.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.320+0000 7ff884a00640 1 -- 172.21.15.55:0/2610317540 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff85c066690 msgr2=0x7ff85c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:11.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.320+0000 7ff884a00640 1 --2- 172.21.15.55:0/2610317540 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff85c066690 0x7ff85c068b50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff870009b10 tx=0x7ff870008040 comp rx=0 tx=0).stop 2024-04-02T07:23:11.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.320+0000 7ff884a00640 1 -- 172.21.15.55:0/2610317540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8800cc700 msgr2=0x7ff8800ae3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:11.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.320+0000 7ff884a00640 1 --2- 172.21.15.55:0/2610317540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8800cc700 0x7ff8800ae3b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff86801a150 tx=0x7ff86801ad60 comp rx=0 tx=0).stop 2024-04-02T07:23:11.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.320+0000 7ff884a00640 1 -- 172.21.15.55:0/2610317540 shutdown_connections 2024-04-02T07:23:11.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.320+0000 7ff884a00640 1 --2- 172.21.15.55:0/2610317540 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff85c066690 0x7ff85c068b50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:11.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.320+0000 7ff884a00640 1 --2- 172.21.15.55:0/2610317540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff8800cead0 0x7ff880158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:11.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.320+0000 7ff884a00640 1 --2- 172.21.15.55:0/2610317540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8800cc700 0x7ff8800ae3b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:11.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.320+0000 7ff884a00640 1 --2- 172.21.15.55:0/2610317540 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff880098f50 0x7ff880148f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:11.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.320+0000 7ff884a00640 1 -- 172.21.15.55:0/2610317540 >> 172.21.15.55:0/2610317540 conn(0x7ff8800b2150 msgr2=0x7ff8800ccc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:11.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.320+0000 7ff884a00640 1 -- 172.21.15.55:0/2610317540 shutdown_connections 2024-04-02T07:23:11.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.320+0000 7ff884a00640 1 -- 172.21.15.55:0/2610317540 wait complete. 2024-04-02T07:23:11.352 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-02T07:23:11.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.500+0000 7efdb6a00640 1 Processor -- start 2024-04-02T07:23:11.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.500+0000 7efdb6a00640 1 -- start start 2024-04-02T07:23:11.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.504+0000 7efdb6a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efdb015a860 0x7efdb0098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:11.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.504+0000 7efdb6a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efdb0098f50 0x7efdb00ce1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:11.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.504+0000 7efdb6a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb00ce700 0x7efdb015e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:11.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.504+0000 7efdb6a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb0099400 con 0x7efdb015a860 2024-04-02T07:23:11.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.504+0000 7efdb6a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdb00cf750 con 0x7efdb0098f50 2024-04-02T07:23:11.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.504+0000 7efdb6a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb015ac40 con 0x7efdb00ce700 2024-04-02T07:23:11.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.504+0000 7efdafe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efdb015a860 0x7efdb0098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:11.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.504+0000 7efdafe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efdb015a860 0x7efdb0098a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55332/0 (socket says 172.21.15.55:55332) 2024-04-02T07:23:11.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.504+0000 7efdafe00640 1 -- 172.21.15.55:0/173693839 learned_addr learned my addr 172.21.15.55:0/173693839 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:11.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.504+0000 7efda7e00640 1 --2- 172.21.15.55:0/173693839 >> v2:172.21.15.106:3300/0 conn(0x7efdb0098f50 0x7efdb00ce1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:11.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.504+0000 7efdb4a00640 1 --2- 172.21.15.55:0/173693839 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb00ce700 0x7efdb015e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:11.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.504+0000 7efdafe00640 1 -- 172.21.15.55:0/173693839 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb00ce700 msgr2=0x7efdb015e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:11.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.504+0000 7efdafe00640 1 --2- 172.21.15.55:0/173693839 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb00ce700 0x7efdb015e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:11.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.504+0000 7efdafe00640 1 -- 172.21.15.55:0/173693839 >> v2:172.21.15.106:3300/0 conn(0x7efdb0098f50 msgr2=0x7efdb00ce1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:11.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.504+0000 7efdafe00640 1 --2- 172.21.15.55:0/173693839 >> v2:172.21.15.106:3300/0 conn(0x7efdb0098f50 0x7efdb00ce1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:11.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.504+0000 7efdafe00640 1 -- 172.21.15.55:0/173693839 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdb00ceeb0 con 0x7efdb015a860 2024-04-02T07:23:11.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.508+0000 7efdafe00640 1 --2- 172.21.15.55:0/173693839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdb015a860 0x7efdb0098a10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efdb0073af0 tx=0x7efda001c1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c776b1466509aef8 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:11.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.508+0000 7efdaf400640 1 -- 172.21.15.55:0/173693839 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda00ab600 con 0x7efdb015a860 2024-04-02T07:23:11.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.508+0000 7efdaf400640 1 -- 172.21.15.55:0/173693839 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda00a7050 con 0x7efdb015a860 2024-04-02T07:23:11.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.508+0000 7efdaf400640 1 -- 172.21.15.55:0/173693839 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda00ab980 con 0x7efdb015a860 2024-04-02T07:23:11.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.508+0000 7efdb6a00640 1 -- 172.21.15.55:0/173693839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdb015a860 msgr2=0x7efdb0098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:11.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.508+0000 7efdb6a00640 1 --2- 172.21.15.55:0/173693839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdb015a860 0x7efdb0098a10 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7efdb0073af0 tx=0x7efda001c1a0 comp rx=0 tx=0).stop 2024-04-02T07:23:11.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.508+0000 7efdb6a00640 1 -- 172.21.15.55:0/173693839 shutdown_connections 2024-04-02T07:23:11.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.508+0000 7efdb6a00640 1 --2- 172.21.15.55:0/173693839 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb00ce700 0x7efdb015e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:11.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.508+0000 7efdb6a00640 1 --2- 172.21.15.55:0/173693839 >> v2:172.21.15.106:3300/0 conn(0x7efdb0098f50 0x7efdb00ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:11.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.508+0000 7efdb6a00640 1 --2- 172.21.15.55:0/173693839 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdb015a860 0x7efdb0098a10 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:11.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.508+0000 7efdb6a00640 1 -- 172.21.15.55:0/173693839 >> 172.21.15.55:0/173693839 conn(0x7efdb00b20e0 msgr2=0x7efdb00b24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:11.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.508+0000 7efdb6a00640 1 -- 172.21.15.55:0/173693839 shutdown_connections 2024-04-02T07:23:11.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.508+0000 7efdb6a00640 1 -- 172.21.15.55:0/173693839 wait complete. 2024-04-02T07:23:11.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdb6a00640 1 Processor -- start 2024-04-02T07:23:11.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdb6a00640 1 -- start start 2024-04-02T07:23:11.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdb6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdb0098f50 0x7efdb00b31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:11.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdb6a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb00ce700 0x7efdb00c6840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:11.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdb6a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdb015a860 0x7efdb01523c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:11.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdb6a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00b5920 con 0x7efdb015a860 2024-04-02T07:23:11.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdb6a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdb00b61c0 con 0x7efdb0098f50 2024-04-02T07:23:11.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdb6a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdb0153700 con 0x7efdb00ce700 2024-04-02T07:23:11.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdb4a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdb015a860 0x7efdb01523c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:11.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdb4a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdb015a860 0x7efdb01523c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55342/0 (socket says 172.21.15.55:55342) 2024-04-02T07:23:11.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdb4a00640 1 -- 172.21.15.55:0/2964470891 learned_addr learned my addr 172.21.15.55:0/2964470891 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:11.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efda7e00640 1 --2- 172.21.15.55:0/2964470891 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb00ce700 0x7efdb00c6840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:11.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdafe00640 1 --2- 172.21.15.55:0/2964470891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdb0098f50 0x7efdb00b31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:11.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdb4a00640 1 -- 172.21.15.55:0/2964470891 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb00ce700 msgr2=0x7efdb00c6840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:11.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdb4a00640 1 --2- 172.21.15.55:0/2964470891 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb00ce700 0x7efdb00c6840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:11.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdb4a00640 1 -- 172.21.15.55:0/2964470891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdb0098f50 msgr2=0x7efdb00b31a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:11.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdb4a00640 1 --2- 172.21.15.55:0/2964470891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdb0098f50 0x7efdb00b31a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:11.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdb4a00640 1 -- 172.21.15.55:0/2964470891 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efda0009480 con 0x7efdb015a860 2024-04-02T07:23:11.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdb4a00640 1 --2- 172.21.15.55:0/2964470891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdb015a860 0x7efdb01523c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efda8009dd0 tx=0x7efda800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:11.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdacc00640 1 -- 172.21.15.55:0/2964470891 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8014480 con 0x7efdb015a860 2024-04-02T07:23:11.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdacc00640 1 -- 172.21.15.55:0/2964470891 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efda800f040 con 0x7efdb015a860 2024-04-02T07:23:11.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdacc00640 1 -- 172.21.15.55:0/2964470891 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efda8014840 con 0x7efdb015a860 2024-04-02T07:23:11.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdb6a00640 1 -- 172.21.15.55:0/2964470891 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdb00b3780 con 0x7efdb015a860 2024-04-02T07:23:11.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.512+0000 7efdb6a00640 1 -- 172.21.15.55:0/2964470891 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdb00b5e50 con 0x7efdb015a860 2024-04-02T07:23:11.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.516+0000 7efdb6a00640 1 -- 172.21.15.55:0/2964470891 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdb00b6350 con 0x7efdb015a860 2024-04-02T07:23:11.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.516+0000 7efdacc00640 1 -- 172.21.15.55:0/2964470891 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7efda80149a0 con 0x7efdb015a860 2024-04-02T07:23:11.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.516+0000 7efdacc00640 1 --2- 172.21.15.55:0/2964470891 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efd8c066690 0x7efd8c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:11.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.516+0000 7efdacc00640 1 -- 172.21.15.55:0/2964470891 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 5473+0+0 (secure 0 0 0) 0x7efda8084e00 con 0x7efdb015a860 2024-04-02T07:23:11.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.516+0000 7efdafe00640 1 --2- 172.21.15.55:0/2964470891 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efd8c066690 0x7efd8c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:11.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.516+0000 7efdafe00640 1 --2- 172.21.15.55:0/2964470891 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efd8c066690 0x7efd8c068b50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efda00ad000 tx=0x7efda00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:11.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.520+0000 7efdacc00640 1 -- 172.21.15.55:0/2964470891 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7efda8052260 con 0x7efdb015a860 2024-04-02T07:23:11.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:11.680+0000 7efdb6a00640 1 -- 172.21.15.55:0/2964470891 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efdb0066c90 con 0x7efdb015a860 2024-04-02T07:23:12.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:12.320+0000 7efdacc00640 1 -- 172.21.15.55:0/2964470891 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v25) v1 ==== 169+0+0 (secure 0 0 0) 0x7efda8055880 con 0x7efdb015a860 2024-04-02T07:23:12.328 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2024-04-02T07:23:12.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:12.324+0000 7efdb6a00640 1 -- 172.21.15.55:0/2964470891 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efd8c066690 msgr2=0x7efd8c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:12.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:12.324+0000 7efdb6a00640 1 --2- 172.21.15.55:0/2964470891 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efd8c066690 0x7efd8c068b50 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efda00ad000 tx=0x7efda00a6000 comp rx=0 tx=0).stop 2024-04-02T07:23:12.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:12.324+0000 7efdb6a00640 1 -- 172.21.15.55:0/2964470891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdb015a860 msgr2=0x7efdb01523c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:12.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:12.324+0000 7efdb6a00640 1 --2- 172.21.15.55:0/2964470891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdb015a860 0x7efdb01523c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efda8009dd0 tx=0x7efda800c490 comp rx=0 tx=0).stop 2024-04-02T07:23:12.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:12.324+0000 7efdb6a00640 1 -- 172.21.15.55:0/2964470891 shutdown_connections 2024-04-02T07:23:12.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:12.324+0000 7efdb6a00640 1 --2- 172.21.15.55:0/2964470891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efdb015a860 0x7efdb01523c0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:12.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:12.324+0000 7efdb6a00640 1 --2- 172.21.15.55:0/2964470891 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efdb00ce700 0x7efdb00c6840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:12.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:12.324+0000 7efdb6a00640 1 --2- 172.21.15.55:0/2964470891 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efd8c066690 0x7efd8c068b50 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:12.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:12.324+0000 7efdb6a00640 1 --2- 172.21.15.55:0/2964470891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efdb0098f50 0x7efdb00b31a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:12.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:12.324+0000 7efdb6a00640 1 -- 172.21.15.55:0/2964470891 >> 172.21.15.55:0/2964470891 conn(0x7efdb00b20e0 msgr2=0x7efdb006f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:12.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:12.324+0000 7efdb6a00640 1 -- 172.21.15.55:0/2964470891 shutdown_connections 2024-04-02T07:23:12.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:12.324+0000 7efdb6a00640 1 -- 172.21.15.55:0/2964470891 wait complete. 2024-04-02T07:23:12.358 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-02T07:23:12.359 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-02T07:23:12.359 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-02T07:23:12.359 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:23:12.359 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-02T07:23:12.359 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-02T07:23:12.359 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-02T07:23:12.360 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:23:12.360 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-02T07:23:12.360 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-02T07:23:12.360 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-02T07:23:12.360 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:23:12.360 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-02T07:23:12.360 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-02T07:23:12.361 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-02T07:23:12.361 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:23:12.373 INFO:tasks.ceph.mds.c:Stopped 2024-04-02T07:23:12.373 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-02T07:23:12.374 INFO:tasks.ceph.mds.d:Stopped 2024-04-02T07:23:12.375 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-02T07:23:12.375 INFO:tasks.ceph.mds.b:Stopped 2024-04-02T07:23:12.375 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-02T07:23:12.420 INFO:tasks.ceph.mds.d:Started 2024-04-02T07:23:12.421 DEBUG:teuthology.parallel:result is None 2024-04-02T07:23:12.422 INFO:tasks.ceph.mds.c:Started 2024-04-02T07:23:12.422 DEBUG:teuthology.parallel:result is None 2024-04-02T07:23:12.423 INFO:tasks.ceph.mds.b:Started 2024-04-02T07:23:12.423 DEBUG:teuthology.parallel:result is None 2024-04-02T07:23:12.508 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-02T07:23:12.515 INFO:tasks.ceph.mds.d.smithi106.stdout:starting mds.d at 2024-04-02T07:23:12.515 INFO:tasks.ceph.mds.b.smithi106.stdout:starting mds.b at 2024-04-02T07:23:13.229 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:23:13.233 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:23:18.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-04-02T07:23:18.373 INFO:tasks.ceph.mds.a:Stopped 2024-04-02T07:23:18.373 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-02T07:23:18.377 INFO:tasks.ceph.mds.a:Started 2024-04-02T07:23:18.377 DEBUG:teuthology.parallel:result is None 2024-04-02T07:23:18.377 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-02T07:23:18.473 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-02T07:23:18.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.528+0000 7f31e8600640 1 Processor -- start 2024-04-02T07:23:18.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.528+0000 7f31e8600640 1 -- start start 2024-04-02T07:23:18.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.528+0000 7f31e8600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f31e015aad0 0x7f31e00caea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:18.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.528+0000 7f31e8600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f31e006da10 0x7f31e00cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:18.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.528+0000 7f31e8600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31e00c9ff0 con 0x7f31e00af920 2024-04-02T07:23:18.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.528+0000 7f31e8600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e00cb920 con 0x7f31e006da10 2024-04-02T07:23:18.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.528+0000 7f31e8600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e00c93e0 con 0x7f31e015aad0 2024-04-02T07:23:18.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.528+0000 7f31e6600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f31e006da10 0x7f31e00cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:18.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.528+0000 7f31e5200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f31e00af920 0x7f31e015e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56054/0 (socket says 172.21.15.55:56054) 2024-04-02T07:23:18.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.528+0000 7f31e5200640 1 -- 172.21.15.55:0/1020574557 learned_addr learned my addr 172.21.15.55:0/1020574557 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:18.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.528+0000 7f31e6600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f31e006da10 0x7f31e00cb3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34464/0 (socket says 172.21.15.55:34464) 2024-04-02T07:23:18.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.528+0000 7f31e5c00640 1 --2- 172.21.15.55:0/1020574557 >> v2:172.21.15.106:3300/0 conn(0x7f31e015aad0 0x7f31e00caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:18.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.528+0000 7f31e6600640 1 -- 172.21.15.55:0/1020574557 >> v2:172.21.15.106:3300/0 conn(0x7f31e015aad0 msgr2=0x7f31e00caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:18.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.528+0000 7f31e6600640 1 --2- 172.21.15.55:0/1020574557 >> v2:172.21.15.106:3300/0 conn(0x7f31e015aad0 0x7f31e00caea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:18.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.528+0000 7f31e6600640 1 -- 172.21.15.55:0/1020574557 >> v1:172.21.15.55:6789/0 conn(0x7f31e00af920 legacy=0x7f31e015e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:18.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.528+0000 7f31e6600640 1 -- 172.21.15.55:0/1020574557 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e00c96c0 con 0x7f31e006da10 2024-04-02T07:23:18.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.528+0000 7f31e5c00640 1 --2- 172.21.15.55:0/1020574557 >> v2:172.21.15.106:3300/0 conn(0x7f31e015aad0 0x7f31e00caea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:18.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.532+0000 7f31e6600640 1 --2- 172.21.15.55:0/1020574557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31e006da10 0x7f31e00cb3e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f31e00b1520 tx=0x7f31d801c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11bd293decc8f9c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:18.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.532+0000 7f31dfe00640 1 -- 172.21.15.55:0/1020574557 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d80a5930 con 0x7f31e006da10 2024-04-02T07:23:18.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.532+0000 7f31dfe00640 1 -- 172.21.15.55:0/1020574557 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d80a5a90 con 0x7f31e006da10 2024-04-02T07:23:18.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.532+0000 7f31dfe00640 1 -- 172.21.15.55:0/1020574557 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d80a5e20 con 0x7f31e006da10 2024-04-02T07:23:18.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.532+0000 7f31e8600640 1 -- 172.21.15.55:0/1020574557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31e006da10 msgr2=0x7f31e00cb3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:18.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.532+0000 7f31e8600640 1 --2- 172.21.15.55:0/1020574557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31e006da10 0x7f31e00cb3e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f31e00b1520 tx=0x7f31d801c870 comp rx=0 tx=0).stop 2024-04-02T07:23:18.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.532+0000 7f31e8600640 1 -- 172.21.15.55:0/1020574557 shutdown_connections 2024-04-02T07:23:18.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.532+0000 7f31e8600640 1 --2- 172.21.15.55:0/1020574557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31e006da10 0x7f31e00cb3e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:18.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.532+0000 7f31e8600640 1 --2- 172.21.15.55:0/1020574557 >> v2:172.21.15.106:3300/0 conn(0x7f31e015aad0 0x7f31e00caea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:18.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.532+0000 7f31e8600640 1 -- 172.21.15.55:0/1020574557 >> 172.21.15.55:0/1020574557 conn(0x7f31e0069d90 msgr2=0x7f31e006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:18.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.532+0000 7f31e8600640 1 -- 172.21.15.55:0/1020574557 shutdown_connections 2024-04-02T07:23:18.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.532+0000 7f31e8600640 1 -- 172.21.15.55:0/1020574557 wait complete. 2024-04-02T07:23:18.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e8600640 1 Processor -- start 2024-04-02T07:23:18.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e8600640 1 -- start start 2024-04-02T07:23:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e8600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31e006da10 0x7f31e0138de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e8600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31e00af920 0x7f31e0138160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e8600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31e015aad0 0x7f31e01521b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e8600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e015d3e0 con 0x7f31e00af920 2024-04-02T07:23:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e8600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e015d6c0 con 0x7f31e006da10 2024-04-02T07:23:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e8600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e015d9a0 con 0x7f31e015aad0 2024-04-02T07:23:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e5200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31e00af920 0x7f31e0138160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e5200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31e00af920 0x7f31e0138160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34466/0 (socket says 172.21.15.55:34466) 2024-04-02T07:23:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e5200640 1 -- 172.21.15.55:0/2979770561 learned_addr learned my addr 172.21.15.55:0/2979770561 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e5c00640 1 --2- 172.21.15.55:0/2979770561 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31e006da10 0x7f31e0138de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e6600640 1 --2- 172.21.15.55:0/2979770561 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31e015aad0 0x7f31e01521b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e5200640 1 -- 172.21.15.55:0/2979770561 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31e015aad0 msgr2=0x7f31e01521b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:18.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e5200640 1 --2- 172.21.15.55:0/2979770561 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31e015aad0 0x7f31e01521b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:18.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e5200640 1 -- 172.21.15.55:0/2979770561 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31e006da10 msgr2=0x7f31e0138de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:18.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e5200640 1 --2- 172.21.15.55:0/2979770561 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31e006da10 0x7f31e0138de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:18.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e5200640 1 -- 172.21.15.55:0/2979770561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d8009a70 con 0x7f31e00af920 2024-04-02T07:23:18.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e5200640 1 --2- 172.21.15.55:0/2979770561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31e00af920 0x7f31e0138160 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00c500 tx=0x7f31cc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:18.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31dd600640 1 -- 172.21.15.55:0/2979770561 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc005cf0 con 0x7f31e00af920 2024-04-02T07:23:18.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31dd600640 1 -- 172.21.15.55:0/2979770561 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc005e50 con 0x7f31e00af920 2024-04-02T07:23:18.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31dd600640 1 -- 172.21.15.55:0/2979770561 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc0072f0 con 0x7f31e00af920 2024-04-02T07:23:18.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e8600640 1 -- 172.21.15.55:0/2979770561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e015dc80 con 0x7f31e00af920 2024-04-02T07:23:18.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.536+0000 7f31e8600640 1 -- 172.21.15.55:0/2979770561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e01386a0 con 0x7f31e00af920 2024-04-02T07:23:18.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.540+0000 7f31e8600640 1 -- 172.21.15.55:0/2979770561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e015dec0 con 0x7f31e00af920 2024-04-02T07:23:18.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.540+0000 7f31dd600640 1 -- 172.21.15.55:0/2979770561 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f31cc007450 con 0x7f31e00af920 2024-04-02T07:23:18.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.540+0000 7f31dd600640 1 --2- 172.21.15.55:0/2979770561 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f31c0066690 0x7f31c0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:18.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.540+0000 7f31dd600640 1 -- 172.21.15.55:0/2979770561 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f31cc083320 con 0x7f31e00af920 2024-04-02T07:23:18.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.540+0000 7f31e5c00640 1 --2- 172.21.15.55:0/2979770561 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f31c0066690 0x7f31c0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:18.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.540+0000 7f31e5c00640 1 --2- 172.21.15.55:0/2979770561 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f31c0066690 0x7f31c0068b50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f31e01396c0 tx=0x7f31d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:18.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.544+0000 7f31dd600640 1 -- 172.21.15.55:0/2979770561 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f31e015dec0 con 0x7f31e00af920 2024-04-02T07:23:18.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:18.716+0000 7f31e8600640 1 -- 172.21.15.55:0/2979770561 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f31e015d520 con 0x7f31e00af920 2024-04-02T07:23:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.488+0000 7f31dd600640 1 -- 172.21.15.55:0/2979770561 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7f31e015d520 con 0x7f31e00af920 2024-04-02T07:23:19.495 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2024-04-02T07:23:19.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.492+0000 7f31e8600640 1 -- 172.21.15.55:0/2979770561 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f31c0066690 msgr2=0x7f31c0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:19.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.492+0000 7f31e8600640 1 --2- 172.21.15.55:0/2979770561 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f31c0066690 0x7f31c0068b50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f31e01396c0 tx=0x7f31d4008040 comp rx=0 tx=0).stop 2024-04-02T07:23:19.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.492+0000 7f31e8600640 1 -- 172.21.15.55:0/2979770561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31e00af920 msgr2=0x7f31e0138160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:19.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.492+0000 7f31e8600640 1 --2- 172.21.15.55:0/2979770561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31e00af920 0x7f31e0138160 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f31cc00c500 tx=0x7f31cc00c9c0 comp rx=0 tx=0).stop 2024-04-02T07:23:19.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.492+0000 7f31e8600640 1 -- 172.21.15.55:0/2979770561 shutdown_connections 2024-04-02T07:23:19.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.492+0000 7f31e8600640 1 --2- 172.21.15.55:0/2979770561 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31e015aad0 0x7f31e01521b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:19.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.492+0000 7f31e8600640 1 --2- 172.21.15.55:0/2979770561 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31e00af920 0x7f31e0138160 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:19.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.492+0000 7f31e8600640 1 --2- 172.21.15.55:0/2979770561 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f31c0066690 0x7f31c0068b50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:19.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.492+0000 7f31e8600640 1 --2- 172.21.15.55:0/2979770561 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31e006da10 0x7f31e0138de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:19.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.492+0000 7f31e8600640 1 -- 172.21.15.55:0/2979770561 >> 172.21.15.55:0/2979770561 conn(0x7f31e0069d90 msgr2=0x7f31e006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:19.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.492+0000 7f31e8600640 1 -- 172.21.15.55:0/2979770561 shutdown_connections 2024-04-02T07:23:19.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.492+0000 7f31e8600640 1 -- 172.21.15.55:0/2979770561 wait complete. 2024-04-02T07:23:19.518 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-02T07:23:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.652+0000 7fdbd9e00640 1 Processor -- start 2024-04-02T07:23:19.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.652+0000 7fdbd9e00640 1 -- start start 2024-04-02T07:23:19.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.656+0000 7fdbd9e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdbd40ce630 0x7fdbd4065d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:19.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.656+0000 7fdbd9e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdbd4070a80 0x7fdbd4070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:19.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.656+0000 7fdbd9e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbd406d5b0 con 0x7fdbd415cbe0 2024-04-02T07:23:19.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.656+0000 7fdbd9e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd40cec10 con 0x7fdbd40ce630 2024-04-02T07:23:19.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.656+0000 7fdbd9e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbd40713f0 con 0x7fdbd4070a80 2024-04-02T07:23:19.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.656+0000 7fdbcbe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdbd40ce630 0x7fdbd4065d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:19.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.656+0000 7fdbd2a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdbd415cbe0 0x7fdbd40b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56062/0 (socket says 172.21.15.55:56062) 2024-04-02T07:23:19.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.656+0000 7fdbd2a00640 1 -- 172.21.15.55:0/2636838754 learned_addr learned my addr 172.21.15.55:0/2636838754 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:19.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.656+0000 7fdbcbe00640 1 -- 172.21.15.55:0/2636838754 >> v2:172.21.15.106:3300/0 conn(0x7fdbd4070a80 msgr2=0x7fdbd4070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:19.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.656+0000 7fdbcbe00640 1 --2- 172.21.15.55:0/2636838754 >> v2:172.21.15.106:3300/0 conn(0x7fdbd4070a80 0x7fdbd4070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:19.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.656+0000 7fdbcbe00640 1 -- 172.21.15.55:0/2636838754 >> v1:172.21.15.55:6789/0 conn(0x7fdbd415cbe0 legacy=0x7fdbd40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:19.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.656+0000 7fdbcbe00640 1 -- 172.21.15.55:0/2636838754 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd406cc80 con 0x7fdbd40ce630 2024-04-02T07:23:19.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.656+0000 7fdbd2000640 1 -- 172.21.15.55:0/2636838754 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 703274231 0 0) 0x7fdbd406d5b0 con 0x7fdbd415cbe0 2024-04-02T07:23:19.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.660+0000 7fdbcbe00640 1 --2- 172.21.15.55:0/2636838754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbd40ce630 0x7fdbd4065d20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdbd406b210 tx=0x7fdbbc01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a943f387334534d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:19.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.660+0000 7fdbd2000640 1 -- 172.21.15.55:0/2636838754 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc0ab600 con 0x7fdbd40ce630 2024-04-02T07:23:19.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.660+0000 7fdbd2000640 1 -- 172.21.15.55:0/2636838754 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbbc0a7050 con 0x7fdbd40ce630 2024-04-02T07:23:19.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.660+0000 7fdbd2000640 1 -- 172.21.15.55:0/2636838754 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc0ab980 con 0x7fdbd40ce630 2024-04-02T07:23:19.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.660+0000 7fdbd9e00640 1 -- 172.21.15.55:0/2636838754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbd40ce630 msgr2=0x7fdbd4065d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:19.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.660+0000 7fdbd9e00640 1 --2- 172.21.15.55:0/2636838754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbd40ce630 0x7fdbd4065d20 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fdbd406b210 tx=0x7fdbbc01c480 comp rx=0 tx=0).stop 2024-04-02T07:23:19.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.660+0000 7fdbd9e00640 1 -- 172.21.15.55:0/2636838754 shutdown_connections 2024-04-02T07:23:19.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.660+0000 7fdbd9e00640 1 --2- 172.21.15.55:0/2636838754 >> v2:172.21.15.106:3300/0 conn(0x7fdbd4070a80 0x7fdbd4070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:19.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.660+0000 7fdbd9e00640 1 --2- 172.21.15.55:0/2636838754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbd40ce630 0x7fdbd4065d20 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:19.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.660+0000 7fdbd9e00640 1 -- 172.21.15.55:0/2636838754 >> 172.21.15.55:0/2636838754 conn(0x7fdbd40ced50 msgr2=0x7fdbd40cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:19.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.660+0000 7fdbd9e00640 1 -- 172.21.15.55:0/2636838754 shutdown_connections 2024-04-02T07:23:19.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.660+0000 7fdbd9e00640 1 -- 172.21.15.55:0/2636838754 wait complete. 2024-04-02T07:23:19.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.660+0000 7fdbd9e00640 1 Processor -- start 2024-04-02T07:23:19.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.660+0000 7fdbd9e00640 1 -- start start 2024-04-02T07:23:19.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.660+0000 7fdbd9e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbd4070a80 0x7fdbd4146af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:19.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.660+0000 7fdbd9e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbd40ce630 0x7fdbd40afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:19.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.660+0000 7fdbd9e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbd415cbe0 0x7fdbd40b0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:19.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbd9e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd414ebc0 con 0x7fdbd4070a80 2024-04-02T07:23:19.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbd9e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd414df40 con 0x7fdbd40ce630 2024-04-02T07:23:19.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbd9e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbd414e220 con 0x7fdbd415cbe0 2024-04-02T07:23:19.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbd2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbd4070a80 0x7fdbd4146af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:19.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbd2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbd4070a80 0x7fdbd4146af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34486/0 (socket says 172.21.15.55:34486) 2024-04-02T07:23:19.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbd2a00640 1 -- 172.21.15.55:0/1629699638 learned_addr learned my addr 172.21.15.55:0/1629699638 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:19.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbcbe00640 1 --2- 172.21.15.55:0/1629699638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbd40ce630 0x7fdbd40afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:19.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbd3400640 1 --2- 172.21.15.55:0/1629699638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbd415cbe0 0x7fdbd40b0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:19.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbd2a00640 1 -- 172.21.15.55:0/1629699638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbd415cbe0 msgr2=0x7fdbd40b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:19.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbd2a00640 1 --2- 172.21.15.55:0/1629699638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbd415cbe0 0x7fdbd40b0010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:19.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbd2a00640 1 -- 172.21.15.55:0/1629699638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbd40ce630 msgr2=0x7fdbd40afad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:19.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbd2a00640 1 --2- 172.21.15.55:0/1629699638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbd40ce630 0x7fdbd40afad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:19.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbd2a00640 1 -- 172.21.15.55:0/1629699638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc009420 con 0x7fdbd4070a80 2024-04-02T07:23:19.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbd3400640 1 --2- 172.21.15.55:0/1629699638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbd415cbe0 0x7fdbd40b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:23:19.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbd2a00640 1 --2- 172.21.15.55:0/1629699638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbd4070a80 0x7fdbd4146af0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400c480 tx=0x7fdbc400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:19.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbcb400640 1 -- 172.21.15.55:0/1629699638 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc40074e0 con 0x7fdbd4070a80 2024-04-02T07:23:19.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbcb400640 1 -- 172.21.15.55:0/1629699638 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc4007660 con 0x7fdbd4070a80 2024-04-02T07:23:19.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbcb400640 1 -- 172.21.15.55:0/1629699638 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc4004a30 con 0x7fdbd4070a80 2024-04-02T07:23:19.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbd9e00640 1 -- 172.21.15.55:0/1629699638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbd414e500 con 0x7fdbd4070a80 2024-04-02T07:23:19.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbd9e00640 1 -- 172.21.15.55:0/1629699638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbd4147030 con 0x7fdbd4070a80 2024-04-02T07:23:19.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbd9e00640 1 -- 172.21.15.55:0/1629699638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbd414ed00 con 0x7fdbd4070a80 2024-04-02T07:23:19.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.664+0000 7fdbcb400640 1 -- 172.21.15.55:0/1629699638 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fdbc4004b90 con 0x7fdbd4070a80 2024-04-02T07:23:19.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.668+0000 7fdbcb400640 1 --2- 172.21.15.55:0/1629699638 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdbb0066690 0x7fdbb0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:19.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.668+0000 7fdbcb400640 1 -- 172.21.15.55:0/1629699638 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdbc40830d0 con 0x7fdbd4070a80 2024-04-02T07:23:19.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.668+0000 7fdbcbe00640 1 --2- 172.21.15.55:0/1629699638 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdbb0066690 0x7fdbb0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:19.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.668+0000 7fdbcbe00640 1 --2- 172.21.15.55:0/1629699638 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdbb0066690 0x7fdbb0068b50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0ad000 tx=0x7fdbbc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:19.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.672+0000 7fdbcb400640 1 -- 172.21.15.55:0/1629699638 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fdbd414ed00 con 0x7fdbd4070a80 2024-04-02T07:23:19.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.888+0000 7fdbd9e00640 1 -- 172.21.15.55:0/1629699638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fdbd4066c90 con 0x7fdbd4070a80 2024-04-02T07:23:19.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.888+0000 7fdbcb400640 1 -- 172.21.15.55:0/1629699638 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fdbc4054190 con 0x7fdbd4070a80 2024-04-02T07:23:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:19.895 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:23:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2024-04-02T07:23:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2024-04-02T07:23:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFL1DHxAAuUs47l42sADNRgxi4BeNrA==", 2024-04-02T07:23:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:23:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:23:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:23:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:23:19.895 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.896 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.896 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.896 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2024-04-02T07:23:19.896 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFZB+KxAAeKnfP4Z1UkLura+bQrG5mA==", 2024-04-02T07:23:19.896 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.896 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:23:19.896 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:23:19.896 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:23:19.896 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:23:19.896 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.896 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.896 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2024-04-02T07:23:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmUQR/JhAA9LNK5gHJ1NiiqNrfxL4mIA==", 2024-04-02T07:23:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:23:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:23:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:23:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:23:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2024-04-02T07:23:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmotumMhAASI1PogpVSHXWIv9xq3qs4Q==", 2024-04-02T07:23:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:23:19.897 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:23:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:23:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:23:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2024-04-02T07:23:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDysQtmsM9JIxAAZNjTGYW74kqz5NM9NyPSWQ==", 2024-04-02T07:23:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:23:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:23:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:23:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.898 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2024-04-02T07:23:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD1sQtmJaorKhAAtujPXPmQVX3QUG1ANqEphQ==", 2024-04-02T07:23:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:23:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:23:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:23:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2024-04-02T07:23:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD4sQtm1fdwMhAAOxlYwaBnPKhSQODMLVbaSQ==", 2024-04-02T07:23:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:23:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:23:19.899 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:23:19.901 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.901 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.901 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.901 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2024-04-02T07:23:19.901 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD7sQtmo9OaORAAsjpiVkG9vZV1QxpvgbrFmg==", 2024-04-02T07:23:19.901 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.901 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:23:19.901 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:23:19.901 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:23:19.901 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.901 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.901 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2024-04-02T07:23:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQACsgtmTyOkAxAARfxuj/YCM6FWNDhCkLQV3g==", 2024-04-02T07:23:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:23:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:23:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:23:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2024-04-02T07:23:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAFsgtmimDECRAAh/XVN7rICihc8NlxhDJB6Q==", 2024-04-02T07:23:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:23:19.902 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:23:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:23:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2024-04-02T07:23:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAIsgtmreHiDhAAISQbxixad17TRrz7MHQTxA==", 2024-04-02T07:23:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:23:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:23:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:23:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.903 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2024-04-02T07:23:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQALsgtmHVTlExAAT/6jK+czOZ3+4nwpgZOmow==", 2024-04-02T07:23:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:23:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:23:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:23:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2024-04-02T07:23:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmkS2QNhAAt+q0y1TDn03hqM/Y6uKq6g==", 2024-04-02T07:23:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:23:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:23:19.904 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:23:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:23:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2024-04-02T07:23:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmjCzTBBAAVYyat2dGZSTquRQoB+7JMg==", 2024-04-02T07:23:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:23:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:23:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:23:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:23:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.905 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2024-04-02T07:23:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmq45FARAAY6/caSeqvTn7/BThOodYIA==", 2024-04-02T07:23:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:23:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:23:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:23:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:23:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2024-04-02T07:23:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmmjDeChAAL2RsY5VlAy/KZ5go5ZJoBA==", 2024-04-02T07:23:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:23:19.906 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:23:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:23:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:23:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2024-04-02T07:23:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtm1hiMAxAAarlHR9VHGrkPCXhksMM/1w==", 2024-04-02T07:23:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:23:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:23:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:23:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:23:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.907 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.908 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.908 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-mds", 2024-04-02T07:23:19.908 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQARsgtm+oEsDxAAtnBhgcX/tq1bg5pMa2r7vQ==", 2024-04-02T07:23:19.908 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.908 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-mds" 2024-04-02T07:23:19.908 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.908 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.908 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.908 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-mgr", 2024-04-02T07:23:19.908 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQARsgtmMYwsDxAA+CNcyuJE00H0VhF7ONjp3A==", 2024-04-02T07:23:19.908 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.908 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-mgr" 2024-04-02T07:23:19.908 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.908 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.909 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.909 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-osd", 2024-04-02T07:23:19.909 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQARsgtm65QsDxAAtEj8no+Fs4x2+9wQx/dxhw==", 2024-04-02T07:23:19.909 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.909 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-osd" 2024-04-02T07:23:19.909 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.909 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.909 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.909 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rbd", 2024-04-02T07:23:19.909 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQARsgtmcp0sDxAA0hUT+2BXL7ZxvRiJU0wiIw==", 2024-04-02T07:23:19.909 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.909 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rbd" 2024-04-02T07:23:19.909 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.909 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.910 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.910 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-04-02T07:23:19.910 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQARsgtmM6YsDxAAYtZAKhiQgQ2w787UhHOAjg==", 2024-04-02T07:23:19.910 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.910 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-04-02T07:23:19.910 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.910 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.910 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.910 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.bootstrap-rgw", 2024-04-02T07:23:19.910 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQARsgtmB68sDxAARm9DOW2zGYIrWfNyh+mmiQ==", 2024-04-02T07:23:19.910 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.910 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile bootstrap-rgw" 2024-04-02T07:23:19.910 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.910 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.911 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.911 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2024-04-02T07:23:19.911 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFyktGxAAJC7ezewbXwDQue+qjpTfYw==", 2024-04-02T07:23:19.911 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.911 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:23:19.911 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-02T07:23:19.911 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:23:19.911 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.911 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:19.911 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:19.911 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2024-04-02T07:23:19.911 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmUcxUFxAA8NUHdxhUfp3/AILMIbS1fw==", 2024-04-02T07:23:19.911 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:23:19.912 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:23:19.912 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-02T07:23:19.912 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:23:19.912 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.912 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:19.912 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-04-02T07:23:19.912 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:23:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.892+0000 7fdbd9e00640 1 -- 172.21.15.55:0/1629699638 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdbb0066690 msgr2=0x7fdbb0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.892+0000 7fdbd9e00640 1 --2- 172.21.15.55:0/1629699638 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdbb0066690 0x7fdbb0068b50 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc0ad000 tx=0x7fdbbc008040 comp rx=0 tx=0).stop 2024-04-02T07:23:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.892+0000 7fdbd9e00640 1 -- 172.21.15.55:0/1629699638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbd4070a80 msgr2=0x7fdbd4146af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:19.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.892+0000 7fdbd9e00640 1 --2- 172.21.15.55:0/1629699638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbd4070a80 0x7fdbd4146af0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400c480 tx=0x7fdbc400c940 comp rx=0 tx=0).stop 2024-04-02T07:23:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.892+0000 7fdbd9e00640 1 -- 172.21.15.55:0/1629699638 shutdown_connections 2024-04-02T07:23:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.892+0000 7fdbd9e00640 1 --2- 172.21.15.55:0/1629699638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdbd415cbe0 0x7fdbd40b0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.892+0000 7fdbd9e00640 1 --2- 172.21.15.55:0/1629699638 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdbb0066690 0x7fdbb0068b50 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.892+0000 7fdbd9e00640 1 --2- 172.21.15.55:0/1629699638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbd40ce630 0x7fdbd40afad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.892+0000 7fdbd9e00640 1 --2- 172.21.15.55:0/1629699638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbd4070a80 0x7fdbd4146af0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.892+0000 7fdbd9e00640 1 -- 172.21.15.55:0/1629699638 >> 172.21.15.55:0/1629699638 conn(0x7fdbd40ced50 msgr2=0x7fdbd40aecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.892+0000 7fdbd9e00640 1 -- 172.21.15.55:0/1629699638 shutdown_connections 2024-04-02T07:23:19.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:19.892+0000 7fdbd9e00640 1 -- 172.21.15.55:0/1629699638 wait complete. 2024-04-02T07:23:19.916 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-04-02T07:23:20.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.056+0000 7fc304a00640 1 Processor -- start 2024-04-02T07:23:20.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.056+0000 7fc304a00640 1 -- start start 2024-04-02T07:23:20.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.056+0000 7fc304a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc3000ae3d0 0x7fc30015a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:20.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.056+0000 7fc304a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3000ca2c0 0x7fc3000ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:20.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.056+0000 7fc304a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc300159b50 con 0x7fc30006aea0 2024-04-02T07:23:20.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.056+0000 7fc304a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc30006ca60 con 0x7fc3000ae3d0 2024-04-02T07:23:20.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.056+0000 7fc304a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30006d880 con 0x7fc3000ca2c0 2024-04-02T07:23:20.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.056+0000 7fc2fde00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc30006aea0 0x7fc30006b280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56076/0 (socket says 172.21.15.55:56076) 2024-04-02T07:23:20.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.056+0000 7fc2fde00640 1 -- 172.21.15.55:0/4275446258 learned_addr learned my addr 172.21.15.55:0/4275446258 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:20.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.056+0000 7fc2f5400640 1 --2- 172.21.15.55:0/4275446258 >> v2:172.21.15.106:3300/0 conn(0x7fc3000ae3d0 0x7fc30015a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:20.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.056+0000 7fc2fe800640 1 --2- 172.21.15.55:0/4275446258 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3000ca2c0 0x7fc3000ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:20.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.056+0000 7fc2f5400640 1 -- 172.21.15.55:0/4275446258 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3000ca2c0 msgr2=0x7fc3000ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:20.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.056+0000 7fc2f5400640 1 --2- 172.21.15.55:0/4275446258 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3000ca2c0 0x7fc3000ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.056+0000 7fc2f5400640 1 -- 172.21.15.55:0/4275446258 >> v1:172.21.15.55:6789/0 conn(0x7fc30006aea0 legacy=0x7fc30006b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:20.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.056+0000 7fc2f5400640 1 -- 172.21.15.55:0/4275446258 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3000ce710 con 0x7fc3000ae3d0 2024-04-02T07:23:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.060+0000 7fc2f5400640 1 --2- 172.21.15.55:0/4275446258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3000ae3d0 0x7fc30015a6a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8009d90 tx=0x7fc2e801c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=202c7d4190f55dbc server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.060+0000 7fc2fd400640 1 -- 172.21.15.55:0/4275446258 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80a5a00 con 0x7fc3000ae3d0 2024-04-02T07:23:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.060+0000 7fc2fd400640 1 -- 172.21.15.55:0/4275446258 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e80a5b60 con 0x7fc3000ae3d0 2024-04-02T07:23:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.060+0000 7fc2fd400640 1 -- 172.21.15.55:0/4275446258 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80ad440 con 0x7fc3000ae3d0 2024-04-02T07:23:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.060+0000 7fc304a00640 1 -- 172.21.15.55:0/4275446258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3000ae3d0 msgr2=0x7fc30015a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.060+0000 7fc304a00640 1 --2- 172.21.15.55:0/4275446258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3000ae3d0 0x7fc30015a6a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8009d90 tx=0x7fc2e801c940 comp rx=0 tx=0).stop 2024-04-02T07:23:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.060+0000 7fc304a00640 1 -- 172.21.15.55:0/4275446258 shutdown_connections 2024-04-02T07:23:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.060+0000 7fc304a00640 1 --2- 172.21.15.55:0/4275446258 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3000ca2c0 0x7fc3000ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.060+0000 7fc304a00640 1 --2- 172.21.15.55:0/4275446258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc3000ae3d0 0x7fc30015a6a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.060+0000 7fc304a00640 1 -- 172.21.15.55:0/4275446258 >> 172.21.15.55:0/4275446258 conn(0x7fc3000cb7e0 msgr2=0x7fc3000cbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:20.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.060+0000 7fc304a00640 1 -- 172.21.15.55:0/4275446258 shutdown_connections 2024-04-02T07:23:20.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.060+0000 7fc304a00640 1 -- 172.21.15.55:0/4275446258 wait complete. 2024-04-02T07:23:20.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc304a00640 1 Processor -- start 2024-04-02T07:23:20.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc304a00640 1 -- start start 2024-04-02T07:23:20.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc304a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc30006aea0 0x7fc300156bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:20.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc304a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3000ae3d0 0x7fc30015c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:20.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc304a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3000ca2c0 0x7fc30015d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:20.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc304a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc300157130 con 0x7fc3000ca2c0 2024-04-02T07:23:20.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc304a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc30015b770 con 0x7fc30006aea0 2024-04-02T07:23:20.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc304a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc30015ba50 con 0x7fc3000ae3d0 2024-04-02T07:23:20.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc2fe800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3000ca2c0 0x7fc30015d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:20.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc2fe800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3000ca2c0 0x7fc30015d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34496/0 (socket says 172.21.15.55:34496) 2024-04-02T07:23:20.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc2fe800640 1 -- 172.21.15.55:0/459462734 learned_addr learned my addr 172.21.15.55:0/459462734 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:20.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc2fde00640 1 --2- 172.21.15.55:0/459462734 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc30006aea0 0x7fc300156bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:20.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc2f5400640 1 --2- 172.21.15.55:0/459462734 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3000ae3d0 0x7fc30015c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:20.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc2fe800640 1 -- 172.21.15.55:0/459462734 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3000ae3d0 msgr2=0x7fc30015c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:20.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc2fe800640 1 --2- 172.21.15.55:0/459462734 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3000ae3d0 0x7fc30015c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc2fe800640 1 -- 172.21.15.55:0/459462734 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc30006aea0 msgr2=0x7fc300156bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:20.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc2fe800640 1 --2- 172.21.15.55:0/459462734 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc30006aea0 0x7fc300156bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc2fe800640 1 -- 172.21.15.55:0/459462734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e8009a70 con 0x7fc3000ca2c0 2024-04-02T07:23:20.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc2fe800640 1 --2- 172.21.15.55:0/459462734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3000ca2c0 0x7fc30015d370 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800e7f0 tx=0x7fc2f800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:20.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc2f6a00640 1 -- 172.21.15.55:0/459462734 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f8009530 con 0x7fc3000ca2c0 2024-04-02T07:23:20.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc2f6a00640 1 -- 172.21.15.55:0/459462734 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2f800eea0 con 0x7fc3000ca2c0 2024-04-02T07:23:20.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc304a00640 1 -- 172.21.15.55:0/459462734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc30015bd30 con 0x7fc3000ca2c0 2024-04-02T07:23:20.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc2f6a00640 1 -- 172.21.15.55:0/459462734 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2f800cb60 con 0x7fc3000ca2c0 2024-04-02T07:23:20.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc304a00640 1 -- 172.21.15.55:0/459462734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc30015c2f0 con 0x7fc3000ca2c0 2024-04-02T07:23:20.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc304a00640 1 -- 172.21.15.55:0/459462734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc30015c4e0 con 0x7fc3000ca2c0 2024-04-02T07:23:20.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc2f6a00640 1 -- 172.21.15.55:0/459462734 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc2f800ccc0 con 0x7fc3000ca2c0 2024-04-02T07:23:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc2f6a00640 1 --2- 172.21.15.55:0/459462734 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2dc066690 0x7fc2dc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc2f6a00640 1 -- 172.21.15.55:0/459462734 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc2f8083e40 con 0x7fc3000ca2c0 2024-04-02T07:23:20.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc2fde00640 1 --2- 172.21.15.55:0/459462734 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2dc066690 0x7fc2dc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:20.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.068+0000 7fc2fde00640 1 --2- 172.21.15.55:0/459462734 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2dc066690 0x7fc2dc068b50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0005890 tx=0x7fc2f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:20.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.072+0000 7fc2f6a00640 1 -- 172.21.15.55:0/459462734 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc2f80515a0 con 0x7fc3000ca2c0 2024-04-02T07:23:20.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.287+0000 7fc304a00640 1 -- 172.21.15.55:0/459462734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7fc300066c90 con 0x7fc3000ca2c0 2024-04-02T07:23:20.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.299+0000 7fc2f6a00640 1 -- 172.21.15.55:0/459462734 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc2f8054bc0 con 0x7fc3000ca2c0 2024-04-02T07:23:20.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.299+0000 7fc304a00640 1 -- 172.21.15.55:0/459462734 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2dc066690 msgr2=0x7fc2dc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:20.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.299+0000 7fc304a00640 1 --2- 172.21.15.55:0/459462734 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2dc066690 0x7fc2dc068b50 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0005890 tx=0x7fc2f0009040 comp rx=0 tx=0).stop 2024-04-02T07:23:20.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.299+0000 7fc304a00640 1 -- 172.21.15.55:0/459462734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3000ca2c0 msgr2=0x7fc30015d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:20.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.299+0000 7fc304a00640 1 --2- 172.21.15.55:0/459462734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3000ca2c0 0x7fc30015d370 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc2f800e7f0 tx=0x7fc2f800ecb0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.299+0000 7fc304a00640 1 -- 172.21.15.55:0/459462734 shutdown_connections 2024-04-02T07:23:20.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.299+0000 7fc304a00640 1 --2- 172.21.15.55:0/459462734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3000ca2c0 0x7fc30015d370 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.299+0000 7fc304a00640 1 --2- 172.21.15.55:0/459462734 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc3000ae3d0 0x7fc30015c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.299+0000 7fc304a00640 1 --2- 172.21.15.55:0/459462734 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2dc066690 0x7fc2dc068b50 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.299+0000 7fc304a00640 1 --2- 172.21.15.55:0/459462734 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc30006aea0 0x7fc300156bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.299+0000 7fc304a00640 1 -- 172.21.15.55:0/459462734 >> 172.21.15.55:0/459462734 conn(0x7fc3000cb7e0 msgr2=0x7fc300159cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:20.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.299+0000 7fc304a00640 1 -- 172.21.15.55:0/459462734 shutdown_connections 2024-04-02T07:23:20.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.299+0000 7fc304a00640 1 -- 172.21.15.55:0/459462734 wait complete. 2024-04-02T07:23:20.324 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-04-02T07:23:20.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.459+0000 7f4b82e00640 1 Processor -- start 2024-04-02T07:23:20.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.459+0000 7f4b82e00640 1 -- start start 2024-04-02T07:23:20.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.459+0000 7f4b82e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4b7c0cc880 0x7f4b7c06b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:20.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.459+0000 7f4b82e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4b7c098a10 0x7f4b7c098ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:20.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.459+0000 7f4b82e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7c099a70 con 0x7f4b7c15c130 2024-04-02T07:23:20.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.459+0000 7f4b82e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7c0993e0 con 0x7f4b7c0cc880 2024-04-02T07:23:20.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.459+0000 7f4b82e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7c06b5f0 con 0x7f4b7c098a10 2024-04-02T07:23:20.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.459+0000 7f4b81a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4b7c0cc880 0x7f4b7c06b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:20.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.459+0000 7f4b81a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4b7c0cc880 0x7f4b7c06b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34510/0 (socket says 172.21.15.55:34510) 2024-04-02T07:23:20.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.459+0000 7f4b82400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4b7c15c130 0x7f4b7c15c540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56088/0 (socket says 172.21.15.55:56088) 2024-04-02T07:23:20.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.459+0000 7f4b81a00640 1 -- 172.21.15.55:0/3712482266 learned_addr learned my addr 172.21.15.55:0/3712482266 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:20.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.459+0000 7f4b81000640 1 --2- 172.21.15.55:0/3712482266 >> v2:172.21.15.106:3300/0 conn(0x7f4b7c098a10 0x7f4b7c098ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:20.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.459+0000 7f4b81a00640 1 -- 172.21.15.55:0/3712482266 >> v2:172.21.15.106:3300/0 conn(0x7f4b7c098a10 msgr2=0x7f4b7c098ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:20.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.459+0000 7f4b81a00640 1 --2- 172.21.15.55:0/3712482266 >> v2:172.21.15.106:3300/0 conn(0x7f4b7c098a10 0x7f4b7c098ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.459+0000 7f4b81a00640 1 -- 172.21.15.55:0/3712482266 >> v1:172.21.15.55:6789/0 conn(0x7f4b7c15c130 legacy=0x7f4b7c15c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:20.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.459+0000 7f4b81a00640 1 -- 172.21.15.55:0/3712482266 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7c06bc90 con 0x7f4b7c0cc880 2024-04-02T07:23:20.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.459+0000 7f4b7be00640 1 -- 172.21.15.55:0/3712482266 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020939529 0 0) 0x7f4b7c099a70 con 0x7f4b7c15c130 2024-04-02T07:23:20.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.463+0000 7f4b81a00640 1 --2- 172.21.15.55:0/3712482266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b7c0cc880 0x7f4b7c06b0b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c071aa0 tx=0x7f4b7001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff4f5e4cea368147 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:20.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.463+0000 7f4b7be00640 1 -- 172.21.15.55:0/3712482266 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b700aa650 con 0x7f4b7c0cc880 2024-04-02T07:23:20.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.463+0000 7f4b7be00640 1 -- 172.21.15.55:0/3712482266 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b700aa7b0 con 0x7f4b7c0cc880 2024-04-02T07:23:20.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.463+0000 7f4b7be00640 1 -- 172.21.15.55:0/3712482266 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b700aab40 con 0x7f4b7c0cc880 2024-04-02T07:23:20.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.463+0000 7f4b82e00640 1 -- 172.21.15.55:0/3712482266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b7c0cc880 msgr2=0x7f4b7c06b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:20.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.463+0000 7f4b82e00640 1 --2- 172.21.15.55:0/3712482266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b7c0cc880 0x7f4b7c06b0b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4b7c071aa0 tx=0x7f4b7001c4f0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.463+0000 7f4b82e00640 1 -- 172.21.15.55:0/3712482266 shutdown_connections 2024-04-02T07:23:20.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.463+0000 7f4b82e00640 1 --2- 172.21.15.55:0/3712482266 >> v2:172.21.15.106:3300/0 conn(0x7f4b7c098a10 0x7f4b7c098ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.463+0000 7f4b82e00640 1 --2- 172.21.15.55:0/3712482266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b7c0cc880 0x7f4b7c06b0b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.463+0000 7f4b82e00640 1 -- 172.21.15.55:0/3712482266 >> 172.21.15.55:0/3712482266 conn(0x7f4b7c0b1fb0 msgr2=0x7f4b7c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:20.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.463+0000 7f4b82e00640 1 -- 172.21.15.55:0/3712482266 shutdown_connections 2024-04-02T07:23:20.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.463+0000 7f4b82e00640 1 -- 172.21.15.55:0/3712482266 wait complete. 2024-04-02T07:23:20.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b82e00640 1 Processor -- start 2024-04-02T07:23:20.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b82e00640 1 -- start start 2024-04-02T07:23:20.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b82e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b7c098a10 0x7f4b7c0c9d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:20.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b82e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b7c0cc880 0x7f4b7c1534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:20.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b82e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b7c15c130 0x7f4b7c0c50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:20.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b82e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c0ca280 con 0x7f4b7c0cc880 2024-04-02T07:23:20.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b82e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c153c10 con 0x7f4b7c15c130 2024-04-02T07:23:20.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b82e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7c1539e0 con 0x7f4b7c098a10 2024-04-02T07:23:20.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b81000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b7c0cc880 0x7f4b7c1534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:20.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b81000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b7c0cc880 0x7f4b7c1534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34520/0 (socket says 172.21.15.55:34520) 2024-04-02T07:23:20.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b81000640 1 -- 172.21.15.55:0/3601358397 learned_addr learned my addr 172.21.15.55:0/3601358397 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:20.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b82400640 1 --2- 172.21.15.55:0/3601358397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b7c15c130 0x7f4b7c0c50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:20.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b81a00640 1 --2- 172.21.15.55:0/3601358397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b7c098a10 0x7f4b7c0c9d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:20.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b81000640 1 -- 172.21.15.55:0/3601358397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b7c098a10 msgr2=0x7f4b7c0c9d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:20.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b81000640 1 --2- 172.21.15.55:0/3601358397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b7c098a10 0x7f4b7c0c9d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b81000640 1 -- 172.21.15.55:0/3601358397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b7c15c130 msgr2=0x7f4b7c0c50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:20.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b81000640 1 --2- 172.21.15.55:0/3601358397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b7c15c130 0x7f4b7c0c50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b81000640 1 -- 172.21.15.55:0/3601358397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b700094d0 con 0x7f4b7c0cc880 2024-04-02T07:23:20.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b81000640 1 --2- 172.21.15.55:0/3601358397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b7c0cc880 0x7f4b7c1534a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800e870 tx=0x7f4b6800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:20.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b79600640 1 -- 172.21.15.55:0/3601358397 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68009510 con 0x7f4b7c0cc880 2024-04-02T07:23:20.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b79600640 1 -- 172.21.15.55:0/3601358397 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6800eec0 con 0x7f4b7c0cc880 2024-04-02T07:23:20.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b79600640 1 -- 172.21.15.55:0/3601358397 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6800cb40 con 0x7f4b7c0cc880 2024-04-02T07:23:20.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b82e00640 1 -- 172.21.15.55:0/3601358397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b7c0b4d10 con 0x7f4b7c0cc880 2024-04-02T07:23:20.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b82e00640 1 -- 172.21.15.55:0/3601358397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7c0c8820 con 0x7f4b7c0cc880 2024-04-02T07:23:20.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b82e00640 1 -- 172.21.15.55:0/3601358397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7c06cf00 con 0x7f4b7c0cc880 2024-04-02T07:23:20.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b79600640 1 -- 172.21.15.55:0/3601358397 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f4b6800cca0 con 0x7f4b7c0cc880 2024-04-02T07:23:20.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b79600640 1 --2- 172.21.15.55:0/3601358397 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4b5c066690 0x7f4b5c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:20.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b79600640 1 -- 172.21.15.55:0/3601358397 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4b68083ea0 con 0x7f4b7c0cc880 2024-04-02T07:23:20.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b81a00640 1 --2- 172.21.15.55:0/3601358397 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4b5c066690 0x7f4b5c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:20.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.471+0000 7f4b81a00640 1 --2- 172.21.15.55:0/3601358397 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4b5c066690 0x7f4b5c068b50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4b700ae000 tx=0x7f4b700a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:20.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.479+0000 7f4b79600640 1 -- 172.21.15.55:0/3601358397 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f4b680515f0 con 0x7f4b7c0cc880 2024-04-02T07:23:20.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.695+0000 7f4b82e00640 1 -- 172.21.15.55:0/3601358397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f4b7c06b830 con 0x7f4b7c0cc880 2024-04-02T07:23:20.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.699+0000 7f4b79600640 1 -- 172.21.15.55:0/3601358397 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4b68054c10 con 0x7f4b7c0cc880 2024-04-02T07:23:20.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.699+0000 7f4b82e00640 1 -- 172.21.15.55:0/3601358397 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4b5c066690 msgr2=0x7f4b5c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:20.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.699+0000 7f4b82e00640 1 --2- 172.21.15.55:0/3601358397 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4b5c066690 0x7f4b5c068b50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4b700ae000 tx=0x7f4b700a7000 comp rx=0 tx=0).stop 2024-04-02T07:23:20.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.699+0000 7f4b82e00640 1 -- 172.21.15.55:0/3601358397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b7c0cc880 msgr2=0x7f4b7c1534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:20.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.699+0000 7f4b82e00640 1 --2- 172.21.15.55:0/3601358397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b7c0cc880 0x7f4b7c1534a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800e870 tx=0x7f4b6800ec70 comp rx=0 tx=0).stop 2024-04-02T07:23:20.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.703+0000 7f4b82e00640 1 -- 172.21.15.55:0/3601358397 shutdown_connections 2024-04-02T07:23:20.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.703+0000 7f4b82e00640 1 --2- 172.21.15.55:0/3601358397 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4b5c066690 0x7f4b5c068b50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.703+0000 7f4b82e00640 1 --2- 172.21.15.55:0/3601358397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4b7c15c130 0x7f4b7c0c50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.703+0000 7f4b82e00640 1 --2- 172.21.15.55:0/3601358397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4b7c0cc880 0x7f4b7c1534a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.703+0000 7f4b82e00640 1 --2- 172.21.15.55:0/3601358397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4b7c098a10 0x7f4b7c0c9d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.703+0000 7f4b82e00640 1 -- 172.21.15.55:0/3601358397 >> 172.21.15.55:0/3601358397 conn(0x7f4b7c0b1fb0 msgr2=0x7f4b7c0b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:20.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.703+0000 7f4b82e00640 1 -- 172.21.15.55:0/3601358397 shutdown_connections 2024-04-02T07:23:20.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.703+0000 7f4b82e00640 1 -- 172.21.15.55:0/3601358397 wait complete. 2024-04-02T07:23:20.723 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-04-02T07:23:20.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.859+0000 7efed1a00640 1 Processor -- start 2024-04-02T07:23:20.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.863+0000 7efed1a00640 1 -- start start 2024-04-02T07:23:20.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.863+0000 7efed1a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efecc1599c0 0x7efecc0b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:20.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.863+0000 7efed1a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efecc06d1c0 0x7efecc0b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:20.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.863+0000 7efed1a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efecc0b1d60 con 0x7efecc0afe70 2024-04-02T07:23:20.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.863+0000 7efed1a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efecc06cda0 con 0x7efecc06d1c0 2024-04-02T07:23:20.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.863+0000 7efed1a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efecc06c400 con 0x7efecc1599c0 2024-04-02T07:23:20.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.863+0000 7efecb400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efecc0afe70 0x7efecc15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56100/0 (socket says 172.21.15.55:56100) 2024-04-02T07:23:20.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.863+0000 7efecb400640 1 -- 172.21.15.55:0/2982296605 learned_addr learned my addr 172.21.15.55:0/2982296605 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:20.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.863+0000 7efecaa00640 1 --2- 172.21.15.55:0/2982296605 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efecc1599c0 0x7efecc0b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:20.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.863+0000 7efec2000640 1 --2- 172.21.15.55:0/2982296605 >> v2:172.21.15.106:3300/0 conn(0x7efecc06d1c0 0x7efecc0b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:20.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.863+0000 7efeca000640 1 -- 172.21.15.55:0/2982296605 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2805030289 0 0) 0x7efecc0b1d60 con 0x7efecc0afe70 2024-04-02T07:23:20.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.863+0000 7efeca000640 1 -- 172.21.15.55:0/2982296605 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efeb0003530 con 0x7efecc0afe70 2024-04-02T07:23:20.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.863+0000 7efeca000640 1 -- 172.21.15.55:0/2982296605 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2390637235 0 0) 0x7efeb0003530 con 0x7efecc0afe70 2024-04-02T07:23:20.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.863+0000 7efecaa00640 1 -- 172.21.15.55:0/2982296605 >> v2:172.21.15.106:3300/0 conn(0x7efecc06d1c0 msgr2=0x7efecc0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:20.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.863+0000 7efecaa00640 1 --2- 172.21.15.55:0/2982296605 >> v2:172.21.15.106:3300/0 conn(0x7efecc06d1c0 0x7efecc0b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.863+0000 7efecaa00640 1 -- 172.21.15.55:0/2982296605 >> v1:172.21.15.55:6789/0 conn(0x7efecc0afe70 legacy=0x7efecc15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:20.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.863+0000 7efecaa00640 1 -- 172.21.15.55:0/2982296605 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efecc06c6e0 con 0x7efecc1599c0 2024-04-02T07:23:20.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.867+0000 7efecaa00640 1 --2- 172.21.15.55:0/2982296605 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efecc1599c0 0x7efecc0b1780 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efebc0097c0 tx=0x7efebc01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b577fad35a0b82f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:20.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.867+0000 7efeca000640 1 -- 172.21.15.55:0/2982296605 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efebc0a4ea0 con 0x7efecc1599c0 2024-04-02T07:23:20.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.867+0000 7efeca000640 1 -- 172.21.15.55:0/2982296605 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efebc0a7050 con 0x7efecc1599c0 2024-04-02T07:23:20.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.867+0000 7efeca000640 1 -- 172.21.15.55:0/2982296605 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec4001a00 con 0x7efecc1599c0 2024-04-02T07:23:20.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.867+0000 7efed1a00640 1 -- 172.21.15.55:0/2982296605 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efecc1599c0 msgr2=0x7efecc0b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:20.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.867+0000 7efed1a00640 1 --2- 172.21.15.55:0/2982296605 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efecc1599c0 0x7efecc0b1780 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efebc0097c0 tx=0x7efebc01c3c0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.867+0000 7efed1a00640 1 -- 172.21.15.55:0/2982296605 shutdown_connections 2024-04-02T07:23:20.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.867+0000 7efed1a00640 1 --2- 172.21.15.55:0/2982296605 >> v2:172.21.15.106:3300/0 conn(0x7efecc06d1c0 0x7efecc0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.867+0000 7efed1a00640 1 --2- 172.21.15.55:0/2982296605 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efecc1599c0 0x7efecc0b1780 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.867+0000 7efed1a00640 1 -- 172.21.15.55:0/2982296605 >> 172.21.15.55:0/2982296605 conn(0x7efecc069d90 msgr2=0x7efecc06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:20.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.867+0000 7efed1a00640 1 -- 172.21.15.55:0/2982296605 shutdown_connections 2024-04-02T07:23:20.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.867+0000 7efed1a00640 1 -- 172.21.15.55:0/2982296605 wait complete. 2024-04-02T07:23:20.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.867+0000 7efed1a00640 1 Processor -- start 2024-04-02T07:23:20.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.867+0000 7efed1a00640 1 -- start start 2024-04-02T07:23:20.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efed1a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efecc06d1c0 0x7efecc1580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:20.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efed1a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efecc0afe70 0x7efecc154980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:20.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efed1a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efecc1599c0 0x7efecc154ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:20.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efed1a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc157c20 con 0x7efecc0afe70 2024-04-02T07:23:20.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efed1a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efecc157010 con 0x7efecc1599c0 2024-04-02T07:23:20.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efed1a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efecc1572f0 con 0x7efecc06d1c0 2024-04-02T07:23:20.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efec2000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efecc0afe70 0x7efecc154980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:20.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efec2000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efecc0afe70 0x7efecc154980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34526/0 (socket says 172.21.15.55:34526) 2024-04-02T07:23:20.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efec2000640 1 -- 172.21.15.55:0/3941411552 learned_addr learned my addr 172.21.15.55:0/3941411552 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:20.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efecb400640 1 --2- 172.21.15.55:0/3941411552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efecc1599c0 0x7efecc154ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:20.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efecaa00640 1 --2- 172.21.15.55:0/3941411552 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efecc06d1c0 0x7efecc1580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:20.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efec2000640 1 -- 172.21.15.55:0/3941411552 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efecc06d1c0 msgr2=0x7efecc1580b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:20.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efec2000640 1 --2- 172.21.15.55:0/3941411552 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efecc06d1c0 0x7efecc1580b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efec2000640 1 -- 172.21.15.55:0/3941411552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efecc1599c0 msgr2=0x7efecc154ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:20.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efec2000640 1 --2- 172.21.15.55:0/3941411552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efecc1599c0 0x7efecc154ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:20.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efec2000640 1 -- 172.21.15.55:0/3941411552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efebc009420 con 0x7efecc0afe70 2024-04-02T07:23:20.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efec2000640 1 --2- 172.21.15.55:0/3941411552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efecc0afe70 0x7efecc154980 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efeb400e900 tx=0x7efeb400edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:20.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efec3400640 1 -- 172.21.15.55:0/3941411552 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb4009690 con 0x7efecc0afe70 2024-04-02T07:23:20.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efec3400640 1 -- 172.21.15.55:0/3941411552 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeb400ca00 con 0x7efecc0afe70 2024-04-02T07:23:20.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efec3400640 1 -- 172.21.15.55:0/3941411552 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeb400cdb0 con 0x7efecc0afe70 2024-04-02T07:23:20.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efed1a00640 1 -- 172.21.15.55:0/3941411552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efecc1575d0 con 0x7efecc0afe70 2024-04-02T07:23:20.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efed1a00640 1 -- 172.21.15.55:0/3941411552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efecc1585f0 con 0x7efecc0afe70 2024-04-02T07:23:20.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.871+0000 7efed1a00640 1 -- 172.21.15.55:0/3941411552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efecc06e270 con 0x7efecc0afe70 2024-04-02T07:23:20.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.875+0000 7efec3400640 1 -- 172.21.15.55:0/3941411552 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7efeb4013470 con 0x7efecc0afe70 2024-04-02T07:23:20.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.875+0000 7efec3400640 1 --2- 172.21.15.55:0/3941411552 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efea80666c0 0x7efea8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:20.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.875+0000 7efec3400640 1 -- 172.21.15.55:0/3941411552 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7efeb4084100 con 0x7efecc0afe70 2024-04-02T07:23:20.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.875+0000 7efecaa00640 1 --2- 172.21.15.55:0/3941411552 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efea80666c0 0x7efea8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:20.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.875+0000 7efecaa00640 1 --2- 172.21.15.55:0/3941411552 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efea80666c0 0x7efea8068b80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efebc0ad000 tx=0x7efebc0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:20.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:20.879+0000 7efec3400640 1 -- 172.21.15.55:0/3941411552 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7efeb4051720 con 0x7efecc0afe70 2024-04-02T07:23:21.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.095+0000 7efed1a00640 1 -- 172.21.15.55:0/3941411552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7efecc066c90 con 0x7efecc0afe70 2024-04-02T07:23:21.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.099+0000 7efec3400640 1 -- 172.21.15.55:0/3941411552 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7efeb4054d40 con 0x7efecc0afe70 2024-04-02T07:23:21.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.099+0000 7efed1a00640 1 -- 172.21.15.55:0/3941411552 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efea80666c0 msgr2=0x7efea8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:21.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.099+0000 7efed1a00640 1 --2- 172.21.15.55:0/3941411552 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efea80666c0 0x7efea8068b80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efebc0ad000 tx=0x7efebc0a6000 comp rx=0 tx=0).stop 2024-04-02T07:23:21.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.099+0000 7efed1a00640 1 -- 172.21.15.55:0/3941411552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efecc0afe70 msgr2=0x7efecc154980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:21.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.099+0000 7efed1a00640 1 --2- 172.21.15.55:0/3941411552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efecc0afe70 0x7efecc154980 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7efeb400e900 tx=0x7efeb400edc0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.099+0000 7efed1a00640 1 -- 172.21.15.55:0/3941411552 shutdown_connections 2024-04-02T07:23:21.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.099+0000 7efed1a00640 1 --2- 172.21.15.55:0/3941411552 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efea80666c0 0x7efea8068b80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.099+0000 7efed1a00640 1 --2- 172.21.15.55:0/3941411552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efecc1599c0 0x7efecc154ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.099+0000 7efed1a00640 1 --2- 172.21.15.55:0/3941411552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efecc0afe70 0x7efecc154980 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.099+0000 7efed1a00640 1 --2- 172.21.15.55:0/3941411552 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efecc06d1c0 0x7efecc1580b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.099+0000 7efed1a00640 1 -- 172.21.15.55:0/3941411552 >> 172.21.15.55:0/3941411552 conn(0x7efecc069d90 msgr2=0x7efecc156480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:21.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.099+0000 7efed1a00640 1 -- 172.21.15.55:0/3941411552 shutdown_connections 2024-04-02T07:23:21.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.099+0000 7efed1a00640 1 -- 172.21.15.55:0/3941411552 wait complete. 2024-04-02T07:23:21.123 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-04-02T07:23:21.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.263+0000 7fee30c00640 1 Processor -- start 2024-04-02T07:23:21.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.263+0000 7fee30c00640 1 -- start start 2024-04-02T07:23:21.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.263+0000 7fee30c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fee2c15fff0 0x7fee2c0b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:21.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.263+0000 7fee30c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fee2c0aebd0 0x7fee2c06f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:21.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.263+0000 7fee30c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee2c0aea20 con 0x7fee2c06f970 2024-04-02T07:23:21.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.263+0000 7fee30c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2c1603d0 con 0x7fee2c15fff0 2024-04-02T07:23:21.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.263+0000 7fee30c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee2c06ecc0 con 0x7fee2c0aebd0 2024-04-02T07:23:21.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.263+0000 7fee29e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fee2c15fff0 0x7fee2c0b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:21.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.263+0000 7fee2a800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fee2c06f970 0x7fee2c069d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56112/0 (socket says 172.21.15.55:56112) 2024-04-02T07:23:21.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.263+0000 7fee2a800640 1 -- 172.21.15.55:0/3669317203 learned_addr learned my addr 172.21.15.55:0/3669317203 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:21.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.263+0000 7fee29e00640 1 -- 172.21.15.55:0/3669317203 >> v2:172.21.15.106:3300/0 conn(0x7fee2c0aebd0 msgr2=0x7fee2c06f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:21.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.263+0000 7fee29e00640 1 --2- 172.21.15.55:0/3669317203 >> v2:172.21.15.106:3300/0 conn(0x7fee2c0aebd0 0x7fee2c06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.263+0000 7fee29e00640 1 -- 172.21.15.55:0/3669317203 >> v1:172.21.15.55:6789/0 conn(0x7fee2c06f970 legacy=0x7fee2c069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:21.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.263+0000 7fee29e00640 1 -- 172.21.15.55:0/3669317203 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee2c0b3c00 con 0x7fee2c15fff0 2024-04-02T07:23:21.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.263+0000 7fee29400640 1 -- 172.21.15.55:0/3669317203 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771485563 0 0) 0x7fee2c0aea20 con 0x7fee2c06f970 2024-04-02T07:23:21.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.267+0000 7fee29e00640 1 --2- 172.21.15.55:0/3669317203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee2c15fff0 0x7fee2c0b1f40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0b44e0 tx=0x7fee1c01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab5a963ce34a426 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:21.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.267+0000 7fee29400640 1 -- 172.21.15.55:0/3669317203 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0ab600 con 0x7fee2c15fff0 2024-04-02T07:23:21.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.267+0000 7fee29400640 1 -- 172.21.15.55:0/3669317203 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee1c0a7050 con 0x7fee2c15fff0 2024-04-02T07:23:21.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.267+0000 7fee29400640 1 -- 172.21.15.55:0/3669317203 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee1c0ab980 con 0x7fee2c15fff0 2024-04-02T07:23:21.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.267+0000 7fee30c00640 1 -- 172.21.15.55:0/3669317203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee2c15fff0 msgr2=0x7fee2c0b1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:21.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.267+0000 7fee30c00640 1 --2- 172.21.15.55:0/3669317203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee2c15fff0 0x7fee2c0b1f40 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0b44e0 tx=0x7fee1c01c3f0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.267+0000 7fee30c00640 1 -- 172.21.15.55:0/3669317203 shutdown_connections 2024-04-02T07:23:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.267+0000 7fee30c00640 1 --2- 172.21.15.55:0/3669317203 >> v2:172.21.15.106:3300/0 conn(0x7fee2c0aebd0 0x7fee2c06f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.267+0000 7fee30c00640 1 --2- 172.21.15.55:0/3669317203 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee2c15fff0 0x7fee2c0b1f40 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.267+0000 7fee30c00640 1 -- 172.21.15.55:0/3669317203 >> 172.21.15.55:0/3669317203 conn(0x7fee2c0b1420 msgr2=0x7fee2c0b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.267+0000 7fee30c00640 1 -- 172.21.15.55:0/3669317203 shutdown_connections 2024-04-02T07:23:21.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.267+0000 7fee30c00640 1 -- 172.21.15.55:0/3669317203 wait complete. 2024-04-02T07:23:21.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee30c00640 1 Processor -- start 2024-04-02T07:23:21.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee30c00640 1 -- start start 2024-04-02T07:23:21.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee30c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee2c0aebd0 0x7fee2c14ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:21.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee30c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee2c15fff0 0x7fee2c149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:21.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee30c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee2c146560 0x7fee2c14a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:21.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee30c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c14dc90 con 0x7fee2c146560 2024-04-02T07:23:21.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee30c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c14df30 con 0x7fee2c15fff0 2024-04-02T07:23:21.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee30c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c14e210 con 0x7fee2c0aebd0 2024-04-02T07:23:21.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee2a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee2c146560 0x7fee2c14a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:21.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee2a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee2c146560 0x7fee2c14a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34542/0 (socket says 172.21.15.55:34542) 2024-04-02T07:23:21.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee2a800640 1 -- 172.21.15.55:0/829297746 learned_addr learned my addr 172.21.15.55:0/829297746 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:21.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee21400640 1 --2- 172.21.15.55:0/829297746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee2c15fff0 0x7fee2c149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:21.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee29e00640 1 --2- 172.21.15.55:0/829297746 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee2c0aebd0 0x7fee2c14ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:21.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee2a800640 1 -- 172.21.15.55:0/829297746 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee2c0aebd0 msgr2=0x7fee2c14ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:21.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee2a800640 1 --2- 172.21.15.55:0/829297746 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee2c0aebd0 0x7fee2c14ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee2a800640 1 -- 172.21.15.55:0/829297746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee2c15fff0 msgr2=0x7fee2c149fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:21.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee2a800640 1 --2- 172.21.15.55:0/829297746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee2c15fff0 0x7fee2c149fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee2a800640 1 -- 172.21.15.55:0/829297746 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c009420 con 0x7fee2c146560 2024-04-02T07:23:21.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee2a800640 1 --2- 172.21.15.55:0/829297746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee2c146560 0x7fee2c14a500 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fee24001570 tx=0x7fee2400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:21.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee22a00640 1 -- 172.21.15.55:0/829297746 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2400a640 con 0x7fee2c146560 2024-04-02T07:23:21.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee22a00640 1 -- 172.21.15.55:0/829297746 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2400a7a0 con 0x7fee2c146560 2024-04-02T07:23:21.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee30c00640 1 -- 172.21.15.55:0/829297746 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2c14e4f0 con 0x7fee2c146560 2024-04-02T07:23:21.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee22a00640 1 -- 172.21.15.55:0/829297746 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2400ab90 con 0x7fee2c146560 2024-04-02T07:23:21.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.271+0000 7fee30c00640 1 -- 172.21.15.55:0/829297746 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2c14f230 con 0x7fee2c146560 2024-04-02T07:23:21.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.275+0000 7fee30c00640 1 -- 172.21.15.55:0/829297746 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2c066c90 con 0x7fee2c146560 2024-04-02T07:23:21.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.275+0000 7fee22a00640 1 -- 172.21.15.55:0/829297746 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fee2400acf0 con 0x7fee2c146560 2024-04-02T07:23:21.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.275+0000 7fee22a00640 1 --2- 172.21.15.55:0/829297746 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fee080666c0 0x7fee08068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:21.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.275+0000 7fee22a00640 1 -- 172.21.15.55:0/829297746 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fee24083660 con 0x7fee2c146560 2024-04-02T07:23:21.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.275+0000 7fee29e00640 1 --2- 172.21.15.55:0/829297746 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fee080666c0 0x7fee08068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:21.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.279+0000 7fee29e00640 1 --2- 172.21.15.55:0/829297746 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fee080666c0 0x7fee08068b80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0ad000 tx=0x7fee1c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:21.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.279+0000 7fee22a00640 1 -- 172.21.15.55:0/829297746 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fee24050dc0 con 0x7fee2c146560 2024-04-02T07:23:21.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.495+0000 7fee30c00640 1 -- 172.21.15.55:0/829297746 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fee2c14e9a0 con 0x7fee2c146560 2024-04-02T07:23:21.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.503+0000 7fee22a00640 1 -- 172.21.15.55:0/829297746 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7fee24018020 con 0x7fee2c146560 2024-04-02T07:23:21.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.503+0000 7fee30c00640 1 -- 172.21.15.55:0/829297746 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fee080666c0 msgr2=0x7fee08068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:21.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.503+0000 7fee30c00640 1 --2- 172.21.15.55:0/829297746 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fee080666c0 0x7fee08068b80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fee1c0ad000 tx=0x7fee1c0a6000 comp rx=0 tx=0).stop 2024-04-02T07:23:21.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.503+0000 7fee30c00640 1 -- 172.21.15.55:0/829297746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee2c146560 msgr2=0x7fee2c14a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:21.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.503+0000 7fee30c00640 1 --2- 172.21.15.55:0/829297746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee2c146560 0x7fee2c14a500 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fee24001570 tx=0x7fee2400cc70 comp rx=0 tx=0).stop 2024-04-02T07:23:21.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.507+0000 7fee30c00640 1 -- 172.21.15.55:0/829297746 shutdown_connections 2024-04-02T07:23:21.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.507+0000 7fee30c00640 1 --2- 172.21.15.55:0/829297746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee2c146560 0x7fee2c14a500 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.507+0000 7fee30c00640 1 --2- 172.21.15.55:0/829297746 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fee080666c0 0x7fee08068b80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.507+0000 7fee30c00640 1 --2- 172.21.15.55:0/829297746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee2c15fff0 0x7fee2c149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.507+0000 7fee30c00640 1 --2- 172.21.15.55:0/829297746 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee2c0aebd0 0x7fee2c14ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.507+0000 7fee30c00640 1 -- 172.21.15.55:0/829297746 >> 172.21.15.55:0/829297746 conn(0x7fee2c0b1420 msgr2=0x7fee2c1501f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:21.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.507+0000 7fee30c00640 1 -- 172.21.15.55:0/829297746 shutdown_connections 2024-04-02T07:23:21.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.507+0000 7fee30c00640 1 -- 172.21.15.55:0/829297746 wait complete. 2024-04-02T07:23:21.527 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-04-02T07:23:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd528a00640 1 Processor -- start 2024-04-02T07:23:21.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd528a00640 1 -- start start 2024-04-02T07:23:21.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd528a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd5240cdce0 0x7fd524164630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:21.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd528a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5240afd90 con 0x7fd52415ce70 2024-04-02T07:23:21.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd528a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5240c9ed0 con 0x7fd5240b1780 2024-04-02T07:23:21.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd528a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd524098fe0 con 0x7fd5240cdce0 2024-04-02T07:23:21.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd521e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd52415ce70 0x7fd5240af680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56126/0 (socket says 172.21.15.55:56126) 2024-04-02T07:23:21.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd521e00640 1 -- 172.21.15.55:0/3380863551 learned_addr learned my addr 172.21.15.55:0/3380863551 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:21.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd522800640 1 --2- 172.21.15.55:0/3380863551 >> v2:172.21.15.106:3300/0 conn(0x7fd5240cdce0 0x7fd524164630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:21.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd521400640 1 -- 172.21.15.55:0/3380863551 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415852947 0 0) 0x7fd5240afd90 con 0x7fd52415ce70 2024-04-02T07:23:21.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd521400640 1 -- 172.21.15.55:0/3380863551 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd508003530 con 0x7fd52415ce70 2024-04-02T07:23:21.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd521400640 1 -- 172.21.15.55:0/3380863551 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 952018364 0 0) 0x7fd508003530 con 0x7fd52415ce70 2024-04-02T07:23:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd521400640 1 -- 172.21.15.55:0/3380863551 >> v2:172.21.15.106:3300/0 conn(0x7fd5240cdce0 msgr2=0x7fd524164630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd521400640 1 --2- 172.21.15.55:0/3380863551 >> v2:172.21.15.106:3300/0 conn(0x7fd5240cdce0 0x7fd524164630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd521400640 1 -- 172.21.15.55:0/3380863551 >> v1:172.21.15.106:6789/0 conn(0x7fd5240b1780 legacy=0x7fd5240cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd521400640 1 -- 172.21.15.55:0/3380863551 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5240b0290 con 0x7fd52415ce70 2024-04-02T07:23:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd521400640 1 -- 172.21.15.55:0/3380863551 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fd514001680 con 0x7fd52415ce70 2024-04-02T07:23:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd521400640 1 -- 172.21.15.55:0/3380863551 >> v1:172.21.15.55:6789/0 conn(0x7fd52415ce70 legacy=0x7fd5240af680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd521400640 1 --2- 172.21.15.55:0/3380863551 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd508003980 0x7fd508003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd521400640 1 --2- 172.21.15.55:0/3380863551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5080047d0 0x7fd508004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd521400640 1 --2- 172.21.15.55:0/3380863551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd508005190 0x7fd50800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd521400640 1 -- 172.21.15.55:0/3380863551 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd524098fe0 con 0x7fd508005190 2024-04-02T07:23:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd521400640 1 -- 172.21.15.55:0/3380863551 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd50800e340 con 0x7fd5080047d0 2024-04-02T07:23:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.667+0000 7fd521400640 1 -- 172.21.15.55:0/3380863551 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50800e500 con 0x7fd508003980 2024-04-02T07:23:21.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.671+0000 7fd522800640 1 --2- 172.21.15.55:0/3380863551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd508005190 0x7fd50800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.671+0000 7fd51be00640 1 --2- 172.21.15.55:0/3380863551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5080047d0 0x7fd508004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.671+0000 7fd521e00640 1 --2- 172.21.15.55:0/3380863551 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd508003980 0x7fd508003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.671+0000 7fd522800640 1 -- 172.21.15.55:0/3380863551 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd508003980 msgr2=0x7fd508003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.671+0000 7fd522800640 1 --2- 172.21.15.55:0/3380863551 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd508003980 0x7fd508003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.671+0000 7fd522800640 1 -- 172.21.15.55:0/3380863551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5080047d0 msgr2=0x7fd508004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.671+0000 7fd522800640 1 --2- 172.21.15.55:0/3380863551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5080047d0 0x7fd508004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.671+0000 7fd522800640 1 -- 172.21.15.55:0/3380863551 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd508003530 con 0x7fd508005190 2024-04-02T07:23:21.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.671+0000 7fd521e00640 1 --2- 172.21.15.55:0/3380863551 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd508003980 0x7fd508003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:21.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.671+0000 7fd522800640 1 -- 172.21.15.55:0/3380863551 reap_dead start 2024-04-02T07:23:21.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.671+0000 7fd522800640 1 --2- 172.21.15.55:0/3380863551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd508005190 0x7fd50800dba0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009fc0 tx=0x7fd51c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8a2feec4794870a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:21.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.671+0000 7fd521400640 1 -- 172.21.15.55:0/3380863551 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0a5cd0 con 0x7fd508005190 2024-04-02T07:23:21.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.671+0000 7fd521400640 1 -- 172.21.15.55:0/3380863551 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51c00f040 con 0x7fd508005190 2024-04-02T07:23:21.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.671+0000 7fd521400640 1 -- 172.21.15.55:0/3380863551 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51c003be0 con 0x7fd508005190 2024-04-02T07:23:21.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.671+0000 7fd528a00640 1 -- 172.21.15.55:0/3380863551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd508005190 msgr2=0x7fd50800dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:21.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.671+0000 7fd528a00640 1 --2- 172.21.15.55:0/3380863551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd508005190 0x7fd50800dba0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd51c009fc0 tx=0x7fd51c01ccc0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd528a00640 1 -- 172.21.15.55:0/3380863551 shutdown_connections 2024-04-02T07:23:21.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd528a00640 1 --2- 172.21.15.55:0/3380863551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd508005190 0x7fd50800dba0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd528a00640 1 -- 172.21.15.55:0/3380863551 >> 172.21.15.55:0/3380863551 conn(0x7fd524098a10 msgr2=0x7fd5240b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:21.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd528a00640 1 -- 172.21.15.55:0/3380863551 shutdown_connections 2024-04-02T07:23:21.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd528a00640 1 -- 172.21.15.55:0/3380863551 wait complete. 2024-04-02T07:23:21.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd528a00640 1 Processor -- start 2024-04-02T07:23:21.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd528a00640 1 -- start start 2024-04-02T07:23:21.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd528a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd508005190 0x7fd524153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:21.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd528a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5240c8090 0x7fd5240c8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd528a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5240b45b0 0x7fd5240b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd528a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240b4f70 con 0x7fd508005190 2024-04-02T07:23:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd528a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5240b2670 con 0x7fd5240c8090 2024-04-02T07:23:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd528a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd524153e40 con 0x7fd5240b45b0 2024-04-02T07:23:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd521e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd508005190 0x7fd524153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd521e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd508005190 0x7fd524153900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34554/0 (socket says 172.21.15.55:34554) 2024-04-02T07:23:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd521e00640 1 -- 172.21.15.55:0/3711663197 learned_addr learned my addr 172.21.15.55:0/3711663197 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd51be00640 1 --2- 172.21.15.55:0/3711663197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5240c8090 0x7fd5240c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd522800640 1 --2- 172.21.15.55:0/3711663197 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5240b45b0 0x7fd5240b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd521e00640 1 -- 172.21.15.55:0/3711663197 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5240b45b0 msgr2=0x7fd5240b4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd521e00640 1 --2- 172.21.15.55:0/3711663197 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5240b45b0 0x7fd5240b4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd521e00640 1 -- 172.21.15.55:0/3711663197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5240c8090 msgr2=0x7fd5240c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd521e00640 1 --2- 172.21.15.55:0/3711663197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5240c8090 0x7fd5240c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd521e00640 1 -- 172.21.15.55:0/3711663197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5240c8b50 con 0x7fd508005190 2024-04-02T07:23:21.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd521e00640 1 --2- 172.21.15.55:0/3711663197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd508005190 0x7fd524153900 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd514011880 tx=0x7fd514011d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:21.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd51a000640 1 -- 172.21.15.55:0/3711663197 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd51400fb00 con 0x7fd508005190 2024-04-02T07:23:21.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd51a000640 1 -- 172.21.15.55:0/3711663197 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd51400fc60 con 0x7fd508005190 2024-04-02T07:23:21.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd528a00640 1 -- 172.21.15.55:0/3711663197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5240c8e30 con 0x7fd508005190 2024-04-02T07:23:21.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.675+0000 7fd51a000640 1 -- 172.21.15.55:0/3711663197 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd514015410 con 0x7fd508005190 2024-04-02T07:23:21.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.679+0000 7fd528a00640 1 -- 172.21.15.55:0/3711663197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd52415ace0 con 0x7fd508005190 2024-04-02T07:23:21.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.679+0000 7fd528a00640 1 -- 172.21.15.55:0/3711663197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5240b0e70 con 0x7fd508005190 2024-04-02T07:23:21.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.679+0000 7fd51a000640 1 -- 172.21.15.55:0/3711663197 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd514015570 con 0x7fd508005190 2024-04-02T07:23:21.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.679+0000 7fd51a000640 1 --2- 172.21.15.55:0/3711663197 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd500066690 0x7fd500068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:21.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.679+0000 7fd51a000640 1 -- 172.21.15.55:0/3711663197 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd514087190 con 0x7fd508005190 2024-04-02T07:23:21.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.679+0000 7fd51be00640 1 --2- 172.21.15.55:0/3711663197 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd500066690 0x7fd500068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:21.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.679+0000 7fd51be00640 1 --2- 172.21.15.55:0/3711663197 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd500066690 0x7fd500068b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd52406d7c0 tx=0x7fd50c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:21.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.683+0000 7fd51a000640 1 -- 172.21.15.55:0/3711663197 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd5140547b0 con 0x7fd508005190 2024-04-02T07:23:21.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.903+0000 7fd528a00640 1 -- 172.21.15.55:0/3711663197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7fd5240c9070 con 0x7fd508005190 2024-04-02T07:23:21.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.911+0000 7fd51a000640 1 -- 172.21.15.55:0/3711663197 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd5240c9070 con 0x7fd508005190 2024-04-02T07:23:21.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.911+0000 7fd528a00640 1 -- 172.21.15.55:0/3711663197 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd500066690 msgr2=0x7fd500068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:21.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.911+0000 7fd528a00640 1 --2- 172.21.15.55:0/3711663197 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd500066690 0x7fd500068b50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd52406d7c0 tx=0x7fd50c009040 comp rx=0 tx=0).stop 2024-04-02T07:23:21.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.911+0000 7fd528a00640 1 -- 172.21.15.55:0/3711663197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd508005190 msgr2=0x7fd524153900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:21.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.911+0000 7fd528a00640 1 --2- 172.21.15.55:0/3711663197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd508005190 0x7fd524153900 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fd514011880 tx=0x7fd514011d40 comp rx=0 tx=0).stop 2024-04-02T07:23:21.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.911+0000 7fd528a00640 1 -- 172.21.15.55:0/3711663197 shutdown_connections 2024-04-02T07:23:21.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.911+0000 7fd528a00640 1 --2- 172.21.15.55:0/3711663197 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5240b45b0 0x7fd5240b4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.911+0000 7fd528a00640 1 --2- 172.21.15.55:0/3711663197 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd500066690 0x7fd500068b50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.911+0000 7fd528a00640 1 --2- 172.21.15.55:0/3711663197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5240c8090 0x7fd5240c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.911+0000 7fd528a00640 1 --2- 172.21.15.55:0/3711663197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd508005190 0x7fd524153900 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:21.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.911+0000 7fd528a00640 1 -- 172.21.15.55:0/3711663197 >> 172.21.15.55:0/3711663197 conn(0x7fd524098a10 msgr2=0x7fd5240ac350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:21.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.911+0000 7fd528a00640 1 -- 172.21.15.55:0/3711663197 shutdown_connections 2024-04-02T07:23:21.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:21.911+0000 7fd528a00640 1 -- 172.21.15.55:0/3711663197 wait complete. 2024-04-02T07:23:21.934 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-04-02T07:23:22.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.071+0000 7f0060000640 1 Processor -- start 2024-04-02T07:23:22.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.071+0000 7f0060000640 1 -- start start 2024-04-02T07:23:22.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.075+0000 7f0060000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f00581599c0 0x7f00580b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:22.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.075+0000 7f0060000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f005806d1c0 0x7f00580b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:22.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.075+0000 7f0060000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00580afe70 0x7f00580b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:22.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.075+0000 7f0060000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f005806cda0 con 0x7f005806d1c0 2024-04-02T07:23:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.075+0000 7f0060000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00580b3c60 con 0x7f00581599c0 2024-04-02T07:23:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.075+0000 7f0060000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00580b1d60 con 0x7f00580afe70 2024-04-02T07:23:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.075+0000 7f005cc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f005806d1c0 0x7f00580b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.075+0000 7f005cc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f005806d1c0 0x7f00580b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34570/0 (socket says 172.21.15.55:34570) 2024-04-02T07:23:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.075+0000 7f005cc00640 1 -- 172.21.15.55:0/778215288 learned_addr learned my addr 172.21.15.55:0/778215288 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.075+0000 7f005cc00640 1 -- 172.21.15.55:0/778215288 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00580afe70 msgr2=0x7f00580b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.075+0000 7f005cc00640 1 --2- 172.21.15.55:0/778215288 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00580afe70 0x7f00580b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.075+0000 7f005d600640 1 --2- 172.21.15.55:0/778215288 >> v2:172.21.15.106:3300/0 conn(0x7f00581599c0 0x7f00580b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.075+0000 7f005cc00640 1 -- 172.21.15.55:0/778215288 >> v2:172.21.15.106:3300/0 conn(0x7f00581599c0 msgr2=0x7f00580b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.075+0000 7f005cc00640 1 --2- 172.21.15.55:0/778215288 >> v2:172.21.15.106:3300/0 conn(0x7f00581599c0 0x7f00580b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.075+0000 7f005cc00640 1 -- 172.21.15.55:0/778215288 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005806c400 con 0x7f005806d1c0 2024-04-02T07:23:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.075+0000 7f005d600640 1 --2- 172.21.15.55:0/778215288 >> v2:172.21.15.106:3300/0 conn(0x7f00581599c0 0x7f00580b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:23:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.079+0000 7f005cc00640 1 --2- 172.21.15.55:0/778215288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f005806d1c0 0x7f00580b31e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f00580b1520 tx=0x7f004401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94136cb8be44478 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.079+0000 7f0057e00640 1 -- 172.21.15.55:0/778215288 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00440ac630 con 0x7f005806d1c0 2024-04-02T07:23:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.079+0000 7f0057e00640 1 -- 172.21.15.55:0/778215288 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00440ac790 con 0x7f005806d1c0 2024-04-02T07:23:22.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.079+0000 7f0057e00640 1 -- 172.21.15.55:0/778215288 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00440acb20 con 0x7f005806d1c0 2024-04-02T07:23:22.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.079+0000 7f0060000640 1 -- 172.21.15.55:0/778215288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f005806d1c0 msgr2=0x7f00580b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:22.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.079+0000 7f0060000640 1 --2- 172.21.15.55:0/778215288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f005806d1c0 0x7f00580b31e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f00580b1520 tx=0x7f004401c520 comp rx=0 tx=0).stop 2024-04-02T07:23:22.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.079+0000 7f0060000640 1 -- 172.21.15.55:0/778215288 shutdown_connections 2024-04-02T07:23:22.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.079+0000 7f0060000640 1 --2- 172.21.15.55:0/778215288 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f00580afe70 0x7f00580b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.079+0000 7f0060000640 1 --2- 172.21.15.55:0/778215288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f005806d1c0 0x7f00580b31e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.079+0000 7f0060000640 1 --2- 172.21.15.55:0/778215288 >> v2:172.21.15.106:3300/0 conn(0x7f00581599c0 0x7f00580b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.079+0000 7f0060000640 1 -- 172.21.15.55:0/778215288 >> 172.21.15.55:0/778215288 conn(0x7f0058069d90 msgr2=0x7f005806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:22.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.079+0000 7f0060000640 1 -- 172.21.15.55:0/778215288 shutdown_connections 2024-04-02T07:23:22.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.079+0000 7f0060000640 1 -- 172.21.15.55:0/778215288 wait complete. 2024-04-02T07:23:22.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.079+0000 7f0060000640 1 Processor -- start 2024-04-02T07:23:22.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.079+0000 7f0060000640 1 -- start start 2024-04-02T07:23:22.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.079+0000 7f0060000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f005806d1c0 0x7f0058158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:22.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.079+0000 7f0060000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00580afe70 0x7f005814b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:22.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.079+0000 7f0060000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00581599c0 0x7f0058154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:22.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.079+0000 7f0060000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0058155150 con 0x7f00581599c0 2024-04-02T07:23:22.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.083+0000 7f0060000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0058155dc0 con 0x7f00580afe70 2024-04-02T07:23:22.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.083+0000 7f0060000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f005814b600 con 0x7f005806d1c0 2024-04-02T07:23:22.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.083+0000 7f005e000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00581599c0 0x7f0058154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:22.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.083+0000 7f005e000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00581599c0 0x7f0058154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34574/0 (socket says 172.21.15.55:34574) 2024-04-02T07:23:22.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.083+0000 7f005e000640 1 -- 172.21.15.55:0/1917077221 learned_addr learned my addr 172.21.15.55:0/1917077221 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:22.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.083+0000 7f005cc00640 1 --2- 172.21.15.55:0/1917077221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00580afe70 0x7f005814b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:22.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.083+0000 7f005d600640 1 --2- 172.21.15.55:0/1917077221 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f005806d1c0 0x7f0058158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:22.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.083+0000 7f005e000640 1 -- 172.21.15.55:0/1917077221 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f005806d1c0 msgr2=0x7f0058158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:22.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.083+0000 7f005e000640 1 --2- 172.21.15.55:0/1917077221 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f005806d1c0 0x7f0058158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.083+0000 7f005e000640 1 -- 172.21.15.55:0/1917077221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00580afe70 msgr2=0x7f005814b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:22.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.083+0000 7f005e000640 1 --2- 172.21.15.55:0/1917077221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00580afe70 0x7f005814b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.083+0000 7f005e000640 1 -- 172.21.15.55:0/1917077221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00440094d0 con 0x7f00581599c0 2024-04-02T07:23:22.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.083+0000 7f005e000640 1 --2- 172.21.15.55:0/1917077221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00581599c0 0x7f0058154280 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f005000b430 tx=0x7f005000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:22.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.083+0000 7f0055600640 1 -- 172.21.15.55:0/1917077221 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0050011830 con 0x7f00581599c0 2024-04-02T07:23:22.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.083+0000 7f0055600640 1 -- 172.21.15.55:0/1917077221 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0050011990 con 0x7f00581599c0 2024-04-02T07:23:22.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.083+0000 7f0055600640 1 -- 172.21.15.55:0/1917077221 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0050011d40 con 0x7f00581599c0 2024-04-02T07:23:22.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.083+0000 7f0060000640 1 -- 172.21.15.55:0/1917077221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0058154b90 con 0x7f00581599c0 2024-04-02T07:23:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.083+0000 7f0060000640 1 -- 172.21.15.55:0/1917077221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0058155a50 con 0x7f00581599c0 2024-04-02T07:23:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.083+0000 7f0060000640 1 -- 172.21.15.55:0/1917077221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f005806e270 con 0x7f00581599c0 2024-04-02T07:23:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.083+0000 7f0055600640 1 -- 172.21.15.55:0/1917077221 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f005001a400 con 0x7f00581599c0 2024-04-02T07:23:22.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.087+0000 7f0055600640 1 --2- 172.21.15.55:0/1917077221 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0038066690 0x7f0038068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:22.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.087+0000 7f0055600640 1 -- 172.21.15.55:0/1917077221 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0050083ff0 con 0x7f00581599c0 2024-04-02T07:23:22.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.087+0000 7f005d600640 1 --2- 172.21.15.55:0/1917077221 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0038066690 0x7f0038068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:22.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.087+0000 7f005d600640 1 --2- 172.21.15.55:0/1917077221 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0038066690 0x7f0038068b50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f004c00f500 tx=0x7f004c007770 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:22.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.087+0000 7f0055600640 1 -- 172.21.15.55:0/1917077221 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0050051630 con 0x7f00581599c0 2024-04-02T07:23:22.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.307+0000 7f0060000640 1 -- 172.21.15.55:0/1917077221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f00581558b0 con 0x7f00581599c0 2024-04-02T07:23:22.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.311+0000 7f0055600640 1 -- 172.21.15.55:0/1917077221 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f00581558b0 con 0x7f00581599c0 2024-04-02T07:23:22.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.311+0000 7f0060000640 1 -- 172.21.15.55:0/1917077221 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0038066690 msgr2=0x7f0038068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:22.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.311+0000 7f0060000640 1 --2- 172.21.15.55:0/1917077221 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0038066690 0x7f0038068b50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f004c00f500 tx=0x7f004c007770 comp rx=0 tx=0).stop 2024-04-02T07:23:22.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.311+0000 7f0060000640 1 -- 172.21.15.55:0/1917077221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00581599c0 msgr2=0x7f0058154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:22.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.311+0000 7f0060000640 1 --2- 172.21.15.55:0/1917077221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00581599c0 0x7f0058154280 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f005000b430 tx=0x7f005000b8f0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.311+0000 7f0060000640 1 -- 172.21.15.55:0/1917077221 shutdown_connections 2024-04-02T07:23:22.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.311+0000 7f0060000640 1 --2- 172.21.15.55:0/1917077221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f00581599c0 0x7f0058154280 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.311+0000 7f0060000640 1 --2- 172.21.15.55:0/1917077221 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0038066690 0x7f0038068b50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.311+0000 7f0060000640 1 --2- 172.21.15.55:0/1917077221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f00580afe70 0x7f005814b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.311+0000 7f0060000640 1 --2- 172.21.15.55:0/1917077221 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f005806d1c0 0x7f0058158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.311+0000 7f0060000640 1 -- 172.21.15.55:0/1917077221 >> 172.21.15.55:0/1917077221 conn(0x7f0058069d90 msgr2=0x7f00580ca9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:22.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.311+0000 7f0060000640 1 -- 172.21.15.55:0/1917077221 shutdown_connections 2024-04-02T07:23:22.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.311+0000 7f0060000640 1 -- 172.21.15.55:0/1917077221 wait complete. 2024-04-02T07:23:22.335 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:23:22.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.471+0000 7f0ecaa00640 1 Processor -- start 2024-04-02T07:23:22.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.471+0000 7f0ecaa00640 1 -- start start 2024-04-02T07:23:22.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.475+0000 7f0ecaa00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ec40cfdf0 0x7f0ec406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:22.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.475+0000 7f0ecaa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0ec40b16e0 0x7f0ec40b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:22.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.475+0000 7f0ecaa00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec40d01d0 con 0x7f0ec40b11f0 2024-04-02T07:23:22.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.475+0000 7f0ecaa00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec406c0e0 con 0x7f0ec40b16e0 2024-04-02T07:23:22.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.475+0000 7f0ecaa00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40b01d0 con 0x7f0ec40cfdf0 2024-04-02T07:23:22.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.475+0000 7f0ebbe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0ec40b16e0 0x7f0ec40b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:22.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.475+0000 7f0ec3e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ec40cfdf0 0x7f0ec406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:22.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.475+0000 7f0ec8a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0ec40b11f0 0x7f0ec4098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:37298/0 (socket says 172.21.15.55:37298) 2024-04-02T07:23:22.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.475+0000 7f0ec3e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ec40cfdf0 0x7f0ec406b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:59326/0 (socket says 172.21.15.55:59326) 2024-04-02T07:23:22.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.475+0000 7f0ebbe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0ec40b16e0 0x7f0ec40b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:51800/0 (socket says 172.21.15.55:51800) 2024-04-02T07:23:22.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.475+0000 7f0ec3e00640 1 -- 172.21.15.55:0/448523825 learned_addr learned my addr 172.21.15.55:0/448523825 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:22.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.475+0000 7f0ec3400640 1 -- 172.21.15.55:0/448523825 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1026446976 0 0) 0x7f0ebc0014a0 con 0x7f0ec40b11f0 2024-04-02T07:23:22.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.475+0000 7f0ec3400640 1 -- 172.21.15.55:0/448523825 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ea8003530 con 0x7f0ec40b11f0 2024-04-02T07:23:22.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.475+0000 7f0ebbe00640 1 -- 172.21.15.55:0/448523825 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ec40cfdf0 msgr2=0x7f0ec406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:22.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.475+0000 7f0ebbe00640 1 --2- 172.21.15.55:0/448523825 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ec40cfdf0 0x7f0ec406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.475+0000 7f0ebbe00640 1 -- 172.21.15.55:0/448523825 >> v1:172.21.15.106:6789/0 conn(0x7f0ec40b11f0 legacy=0x7f0ec4098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:22.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.475+0000 7f0ebbe00640 1 -- 172.21.15.55:0/448523825 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec40b04b0 con 0x7f0ec40b16e0 2024-04-02T07:23:22.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.475+0000 7f0ec3e00640 1 --2- 172.21.15.55:0/448523825 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ec40cfdf0 0x7f0ec406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:23:22.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.479+0000 7f0ebbe00640 1 --2- 172.21.15.55:0/448523825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ec40b16e0 0x7f0ec40b0cb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0097c0 tx=0x7f0eac01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97dfb1435e61b2b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:22.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.479+0000 7f0ec3400640 1 -- 172.21.15.55:0/448523825 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0ab650 con 0x7f0ec40b16e0 2024-04-02T07:23:22.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.479+0000 7f0ec3400640 1 -- 172.21.15.55:0/448523825 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eac0ab7b0 con 0x7f0ec40b16e0 2024-04-02T07:23:22.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.479+0000 7f0ec3400640 1 -- 172.21.15.55:0/448523825 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eac0abb20 con 0x7f0ec40b16e0 2024-04-02T07:23:22.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.479+0000 7f0ecaa00640 1 -- 172.21.15.55:0/448523825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ec40b16e0 msgr2=0x7f0ec40b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:22.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.479+0000 7f0ecaa00640 1 --2- 172.21.15.55:0/448523825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ec40b16e0 0x7f0ec40b0cb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0097c0 tx=0x7f0eac01c470 comp rx=0 tx=0).stop 2024-04-02T07:23:22.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.479+0000 7f0ecaa00640 1 -- 172.21.15.55:0/448523825 shutdown_connections 2024-04-02T07:23:22.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.479+0000 7f0ecaa00640 1 --2- 172.21.15.55:0/448523825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ec40b16e0 0x7f0ec40b0cb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.479+0000 7f0ecaa00640 1 --2- 172.21.15.55:0/448523825 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ec40cfdf0 0x7f0ec406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.479+0000 7f0ecaa00640 1 -- 172.21.15.55:0/448523825 >> 172.21.15.55:0/448523825 conn(0x7f0ec40b2210 msgr2=0x7f0ec40b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:22.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.479+0000 7f0ecaa00640 1 -- 172.21.15.55:0/448523825 shutdown_connections 2024-04-02T07:23:22.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.479+0000 7f0ecaa00640 1 -- 172.21.15.55:0/448523825 wait complete. 2024-04-02T07:23:22.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.479+0000 7f0ecaa00640 1 Processor -- start 2024-04-02T07:23:22.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.479+0000 7f0ecaa00640 1 -- start start 2024-04-02T07:23:22.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ecaa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ec40b11f0 0x7f0ec415e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:22.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ecaa00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ec40b16e0 0x7f0ec4157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:22.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ecaa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ec40cfdf0 0x7f0ec406f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:22.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ecaa00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec415b760 con 0x7f0ec40b11f0 2024-04-02T07:23:22.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ecaa00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec4159c00 con 0x7f0ec40cfdf0 2024-04-02T07:23:22.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ecaa00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec40b54b0 con 0x7f0ec40b16e0 2024-04-02T07:23:22.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ec3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ec40b11f0 0x7f0ec415e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:22.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ec3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ec40b11f0 0x7f0ec415e180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34578/0 (socket says 172.21.15.55:34578) 2024-04-02T07:23:22.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ec3e00640 1 -- 172.21.15.55:0/3747832438 learned_addr learned my addr 172.21.15.55:0/3747832438 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:22.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ec3e00640 1 -- 172.21.15.55:0/3747832438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ec40b16e0 msgr2=0x7f0ec4157b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:22.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ec3e00640 1 --2- 172.21.15.55:0/3747832438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ec40b16e0 0x7f0ec4157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ec3e00640 1 -- 172.21.15.55:0/3747832438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ec40cfdf0 msgr2=0x7f0ec406f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:22.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ec3e00640 1 --2- 172.21.15.55:0/3747832438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ec40cfdf0 0x7f0ec406f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ec3e00640 1 -- 172.21.15.55:0/3747832438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb40094d0 con 0x7f0ec40b11f0 2024-04-02T07:23:22.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ec3e00640 1 --2- 172.21.15.55:0/3747832438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ec40b11f0 0x7f0ec415e180 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400e930 tx=0x7f0eb400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:22.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ec0c00640 1 -- 172.21.15.55:0/3747832438 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb400ca00 con 0x7f0ec40b11f0 2024-04-02T07:23:22.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ec0c00640 1 -- 172.21.15.55:0/3747832438 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb400cb60 con 0x7f0ec40b11f0 2024-04-02T07:23:22.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ecaa00640 1 -- 172.21.15.55:0/3747832438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eac009420 con 0x7f0ec40b11f0 2024-04-02T07:23:22.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ec0c00640 1 -- 172.21.15.55:0/3747832438 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb4013470 con 0x7f0ec40b11f0 2024-04-02T07:23:22.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ecaa00640 1 -- 172.21.15.55:0/3747832438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec40b5cd0 con 0x7f0ec40b11f0 2024-04-02T07:23:22.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ecaa00640 1 -- 172.21.15.55:0/3747832438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec4066c90 con 0x7f0ec40b11f0 2024-04-02T07:23:22.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.483+0000 7f0ec0c00640 1 -- 172.21.15.55:0/3747832438 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f0eb40135d0 con 0x7f0ec40b11f0 2024-04-02T07:23:22.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.487+0000 7f0ec0c00640 1 --2- 172.21.15.55:0/3747832438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ea0066690 0x7f0ea0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:22.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.487+0000 7f0ec0c00640 1 -- 172.21.15.55:0/3747832438 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0eb4084230 con 0x7f0ec40b11f0 2024-04-02T07:23:22.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.487+0000 7f0ebbe00640 1 --2- 172.21.15.55:0/3747832438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ea0066690 0x7f0ea0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:22.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.487+0000 7f0ebbe00640 1 --2- 172.21.15.55:0/3747832438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ea0066690 0x7f0ea0068b50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0af000 tx=0x7f0eac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:22.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.491+0000 7f0ec0c00640 1 -- 172.21.15.55:0/3747832438 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0eb40517d0 con 0x7f0ec40b11f0 2024-04-02T07:23:22.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.651+0000 7f0ecaa00640 1 -- 172.21.15.55:0/3747832438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ec40b66a0 con 0x7f0ec40b11f0 2024-04-02T07:23:22.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.651+0000 7f0ec0c00640 1 -- 172.21.15.55:0/3747832438 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+12389 (secure 0 0 0) 0x7f0eb4054df0 con 0x7f0ec40b11f0 2024-04-02T07:23:22.655 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:22.655 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":30,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:23:19.489359+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:23:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.655+0000 7f0ecaa00640 1 -- 172.21.15.55:0/3747832438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ea0066690 msgr2=0x7f0ea0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.655+0000 7f0ecaa00640 1 --2- 172.21.15.55:0/3747832438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ea0066690 0x7f0ea0068b50 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0eac0af000 tx=0x7f0eac008040 comp rx=0 tx=0).stop 2024-04-02T07:23:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.655+0000 7f0ecaa00640 1 -- 172.21.15.55:0/3747832438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ec40b11f0 msgr2=0x7f0ec415e180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.655+0000 7f0ecaa00640 1 --2- 172.21.15.55:0/3747832438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ec40b11f0 0x7f0ec415e180 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f0eb400e930 tx=0x7f0eb400edf0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.655+0000 7f0ecaa00640 1 -- 172.21.15.55:0/3747832438 shutdown_connections 2024-04-02T07:23:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.655+0000 7f0ecaa00640 1 --2- 172.21.15.55:0/3747832438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ea0066690 0x7f0ea0068b50 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.655+0000 7f0ecaa00640 1 --2- 172.21.15.55:0/3747832438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ec40cfdf0 0x7f0ec406f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.655+0000 7f0ecaa00640 1 --2- 172.21.15.55:0/3747832438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ec40b16e0 0x7f0ec4157b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.655+0000 7f0ecaa00640 1 --2- 172.21.15.55:0/3747832438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ec40b11f0 0x7f0ec415e180 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.655+0000 7f0ecaa00640 1 -- 172.21.15.55:0/3747832438 >> 172.21.15.55:0/3747832438 conn(0x7f0ec40b2210 msgr2=0x7f0ec415aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.655+0000 7f0ecaa00640 1 -- 172.21.15.55:0/3747832438 shutdown_connections 2024-04-02T07:23:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.655+0000 7f0ecaa00640 1 -- 172.21.15.55:0/3747832438 wait complete. 2024-04-02T07:23:22.676 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:23:22.677 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:23:22.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.815+0000 7fb5f9200640 1 Processor -- start 2024-04-02T07:23:22.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.819+0000 7fb5f9200640 1 -- start start 2024-04-02T07:23:22.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.819+0000 7fb5f9200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5f40709b0 0x7fb5f40b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:22.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.819+0000 7fb5f9200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f415e3a0 con 0x7fb5f4144260 2024-04-02T07:23:22.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.819+0000 7fb5f9200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5f415e5f0 con 0x7fb5f40b2fd0 2024-04-02T07:23:22.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.819+0000 7fb5f9200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f40b37c0 con 0x7fb5f40709b0 2024-04-02T07:23:22.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.819+0000 7fb5f1e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb5f4144260 0x7fb5f40702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56128/0 (socket says 172.21.15.55:56128) 2024-04-02T07:23:22.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.819+0000 7fb5f1e00640 1 -- 172.21.15.55:0/3101196265 learned_addr learned my addr 172.21.15.55:0/3101196265 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:22.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.819+0000 7fb5e9400640 1 --2- 172.21.15.55:0/3101196265 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5f40709b0 0x7fb5f40b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:22.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.819+0000 7fb5f1400640 1 -- 172.21.15.55:0/3101196265 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2713243623 0 0) 0x7fb5f415e3a0 con 0x7fb5f4144260 2024-04-02T07:23:22.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.819+0000 7fb5f1400640 1 -- 172.21.15.55:0/3101196265 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5d8003530 con 0x7fb5f4144260 2024-04-02T07:23:22.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.819+0000 7fb5e9400640 1 -- 172.21.15.55:0/3101196265 >> v1:172.21.15.106:6789/0 conn(0x7fb5f40b2fd0 legacy=0x7fb5f40b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:22.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.819+0000 7fb5e9400640 1 -- 172.21.15.55:0/3101196265 >> v1:172.21.15.55:6789/0 conn(0x7fb5f4144260 legacy=0x7fb5f40702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:22.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.819+0000 7fb5e9400640 1 -- 172.21.15.55:0/3101196265 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5f415e8d0 con 0x7fb5f40709b0 2024-04-02T07:23:22.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.823+0000 7fb5e9400640 1 --2- 172.21.15.55:0/3101196265 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5f40709b0 0x7fb5f40b2a90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0097f0 tx=0x7fb5dc01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c070846334484380 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:22.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.823+0000 7fb5f1400640 1 -- 172.21.15.55:0/3101196265 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc0ac630 con 0x7fb5f40709b0 2024-04-02T07:23:22.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.823+0000 7fb5f1400640 1 -- 172.21.15.55:0/3101196265 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5dc0ac790 con 0x7fb5f40709b0 2024-04-02T07:23:22.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.823+0000 7fb5f1400640 1 -- 172.21.15.55:0/3101196265 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5dc0acb20 con 0x7fb5f40709b0 2024-04-02T07:23:22.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.823+0000 7fb5f9200640 1 -- 172.21.15.55:0/3101196265 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5f40709b0 msgr2=0x7fb5f40b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:22.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.823+0000 7fb5f9200640 1 --2- 172.21.15.55:0/3101196265 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5f40709b0 0x7fb5f40b2a90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb5dc0097f0 tx=0x7fb5dc01c4e0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.823+0000 7fb5f9200640 1 -- 172.21.15.55:0/3101196265 shutdown_connections 2024-04-02T07:23:22.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.823+0000 7fb5f9200640 1 --2- 172.21.15.55:0/3101196265 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5f40709b0 0x7fb5f40b2a90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.823+0000 7fb5f9200640 1 -- 172.21.15.55:0/3101196265 >> 172.21.15.55:0/3101196265 conn(0x7fb5f406a390 msgr2=0x7fb5f40b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:22.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.823+0000 7fb5f9200640 1 -- 172.21.15.55:0/3101196265 shutdown_connections 2024-04-02T07:23:22.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.823+0000 7fb5f9200640 1 -- 172.21.15.55:0/3101196265 wait complete. 2024-04-02T07:23:22.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.823+0000 7fb5f9200640 1 Processor -- start 2024-04-02T07:23:22.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.823+0000 7fb5f9200640 1 -- start start 2024-04-02T07:23:22.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5f9200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f40709b0 0x7fb5f4158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:22.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5f9200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5f40b2fd0 0x7fb5f4156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:22.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5f9200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f4144260 0x7fb5f4157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:22.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5f9200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f41f6090 con 0x7fb5f4144260 2024-04-02T07:23:22.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5f9200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f4158c60 con 0x7fb5f40709b0 2024-04-02T07:23:22.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5f9200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5f4158f40 con 0x7fb5f40b2fd0 2024-04-02T07:23:22.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5f2800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f4144260 0x7fb5f4157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:22.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5f2800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f4144260 0x7fb5f4157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34588/0 (socket says 172.21.15.55:34588) 2024-04-02T07:23:22.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5f2800640 1 -- 172.21.15.55:0/3064210354 learned_addr learned my addr 172.21.15.55:0/3064210354 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:22.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5f1e00640 1 --2- 172.21.15.55:0/3064210354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f40709b0 0x7fb5f4158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:22.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5e9400640 1 --2- 172.21.15.55:0/3064210354 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5f40b2fd0 0x7fb5f4156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5f2800640 1 -- 172.21.15.55:0/3064210354 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5f40b2fd0 msgr2=0x7fb5f4156210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5f2800640 1 --2- 172.21.15.55:0/3064210354 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5f40b2fd0 0x7fb5f4156210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5f2800640 1 -- 172.21.15.55:0/3064210354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f40709b0 msgr2=0x7fb5f4158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5f2800640 1 --2- 172.21.15.55:0/3064210354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f40709b0 0x7fb5f4158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5f2800640 1 -- 172.21.15.55:0/3064210354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5dc009420 con 0x7fb5f4144260 2024-04-02T07:23:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5f2800640 1 --2- 172.21.15.55:0/3064210354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f4144260 0x7fb5f4157150 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00c770 tx=0x7fb5ec00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5eaa00640 1 -- 172.21.15.55:0/3064210354 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec003b80 con 0x7fb5f4144260 2024-04-02T07:23:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5eaa00640 1 -- 172.21.15.55:0/3064210354 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5ec003ce0 con 0x7fb5f4144260 2024-04-02T07:23:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5eaa00640 1 -- 172.21.15.55:0/3064210354 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5ec00aa90 con 0x7fb5f4144260 2024-04-02T07:23:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5f9200640 1 -- 172.21.15.55:0/3064210354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5f4159220 con 0x7fb5f4144260 2024-04-02T07:23:22.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5f9200640 1 -- 172.21.15.55:0/3064210354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5f4153d50 con 0x7fb5f4144260 2024-04-02T07:23:22.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.827+0000 7fb5f9200640 1 -- 172.21.15.55:0/3064210354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5f4073530 con 0x7fb5f4144260 2024-04-02T07:23:22.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.831+0000 7fb5eaa00640 1 -- 172.21.15.55:0/3064210354 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb5ec00abf0 con 0x7fb5f4144260 2024-04-02T07:23:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.831+0000 7fb5eaa00640 1 --2- 172.21.15.55:0/3064210354 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb5d0066690 0x7fb5d0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.831+0000 7fb5eaa00640 1 -- 172.21.15.55:0/3064210354 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb5ec083bd0 con 0x7fb5f4144260 2024-04-02T07:23:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.831+0000 7fb5f1e00640 1 --2- 172.21.15.55:0/3064210354 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb5d0066690 0x7fb5d0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:22.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.831+0000 7fb5f1e00640 1 --2- 172.21.15.55:0/3064210354 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb5d0066690 0x7fb5d0068b50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40011f0 tx=0x7fb5e4007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:22.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.835+0000 7fb5eaa00640 1 -- 172.21.15.55:0/3064210354 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fb5ec0512a0 con 0x7fb5f4144260 2024-04-02T07:23:22.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.995+0000 7fb5f9200640 1 -- 172.21.15.55:0/3064210354 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb5f4066c90 con 0x7fb5f4144260 2024-04-02T07:23:22.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.995+0000 7fb5eaa00640 1 -- 172.21.15.55:0/3064210354 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb5ec0548c0 con 0x7fb5f4144260 2024-04-02T07:23:22.999 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:23:23.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.999+0000 7fb5f9200640 1 -- 172.21.15.55:0/3064210354 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb5d0066690 msgr2=0x7fb5d0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:23.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.999+0000 7fb5f9200640 1 --2- 172.21.15.55:0/3064210354 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb5d0066690 0x7fb5d0068b50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb5e40011f0 tx=0x7fb5e4007d40 comp rx=0 tx=0).stop 2024-04-02T07:23:23.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.999+0000 7fb5f9200640 1 -- 172.21.15.55:0/3064210354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f4144260 msgr2=0x7fb5f4157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:23.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.999+0000 7fb5f9200640 1 --2- 172.21.15.55:0/3064210354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f4144260 0x7fb5f4157150 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec00c770 tx=0x7fb5ec00cc30 comp rx=0 tx=0).stop 2024-04-02T07:23:23.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.999+0000 7fb5f9200640 1 -- 172.21.15.55:0/3064210354 shutdown_connections 2024-04-02T07:23:23.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.999+0000 7fb5f9200640 1 --2- 172.21.15.55:0/3064210354 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb5f4144260 0x7fb5f4157150 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:23.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.999+0000 7fb5f9200640 1 --2- 172.21.15.55:0/3064210354 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb5f40b2fd0 0x7fb5f4156210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:23.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.999+0000 7fb5f9200640 1 --2- 172.21.15.55:0/3064210354 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb5d0066690 0x7fb5d0068b50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:23.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.999+0000 7fb5f9200640 1 --2- 172.21.15.55:0/3064210354 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb5f40709b0 0x7fb5f4158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:23.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.999+0000 7fb5f9200640 1 -- 172.21.15.55:0/3064210354 >> 172.21.15.55:0/3064210354 conn(0x7fb5f406a390 msgr2=0x7fb5f415d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:23.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.999+0000 7fb5f9200640 1 -- 172.21.15.55:0/3064210354 shutdown_connections 2024-04-02T07:23:23.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:22.999+0000 7fb5f9200640 1 -- 172.21.15.55:0/3064210354 wait complete. 2024-04-02T07:23:23.020 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-02T07:23:23.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.159+0000 7f51f3200640 1 Processor -- start 2024-04-02T07:23:23.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.159+0000 7f51f3200640 1 -- start start 2024-04-02T07:23:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.159+0000 7f51f3200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51ec15ad30 0x7f51ec0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.159+0000 7f51f3200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec0cdce0 con 0x7f51ec143f90 2024-04-02T07:23:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.159+0000 7f51f3200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51ec0b3c00 con 0x7f51ec0cd8b0 2024-04-02T07:23:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.159+0000 7f51f3200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51ec144370 con 0x7f51ec15ad30 2024-04-02T07:23:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.159+0000 7f51ebe00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f51ec143f90 0x7f51ec0b34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56140/0 (socket says 172.21.15.55:56140) 2024-04-02T07:23:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.159+0000 7f51ebe00640 1 -- 172.21.15.55:0/3456348047 learned_addr learned my addr 172.21.15.55:0/3456348047 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.159+0000 7f51e3400640 1 --2- 172.21.15.55:0/3456348047 >> v2:172.21.15.55:3300/0 conn(0x7f51ec15ad30 0x7f51ec0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:23.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.159+0000 7f51e3400640 1 -- 172.21.15.55:0/3456348047 >> v1:172.21.15.106:6789/0 conn(0x7f51ec0cd8b0 legacy=0x7f51ec0c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:23.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.159+0000 7f51e3400640 1 -- 172.21.15.55:0/3456348047 >> v1:172.21.15.55:6789/0 conn(0x7f51ec143f90 legacy=0x7f51ec0b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:23.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.159+0000 7f51eb400640 1 -- 172.21.15.55:0/3456348047 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 413766418 0 0) 0x7f51ec0cdce0 con 0x7f51ec143f90 2024-04-02T07:23:23.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.159+0000 7f51e3400640 1 -- 172.21.15.55:0/3456348047 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ec0c37b0 con 0x7f51ec15ad30 2024-04-02T07:23:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.163+0000 7f51e3400640 1 --2- 172.21.15.55:0/3456348047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ec15ad30 0x7f51ec0cd370 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f51d40097c0 tx=0x7f51d401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b371be0593208358 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.163+0000 7f51eb400640 1 -- 172.21.15.55:0/3456348047 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d40ac640 con 0x7f51ec15ad30 2024-04-02T07:23:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.163+0000 7f51eb400640 1 -- 172.21.15.55:0/3456348047 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d40ac7a0 con 0x7f51ec15ad30 2024-04-02T07:23:23.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.163+0000 7f51eb400640 1 -- 172.21.15.55:0/3456348047 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d40acb30 con 0x7f51ec15ad30 2024-04-02T07:23:23.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.163+0000 7f51f3200640 1 -- 172.21.15.55:0/3456348047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ec15ad30 msgr2=0x7f51ec0cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:23.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.163+0000 7f51f3200640 1 --2- 172.21.15.55:0/3456348047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ec15ad30 0x7f51ec0cd370 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f51d40097c0 tx=0x7f51d401c3e0 comp rx=0 tx=0).stop 2024-04-02T07:23:23.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.163+0000 7f51f3200640 1 -- 172.21.15.55:0/3456348047 shutdown_connections 2024-04-02T07:23:23.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.163+0000 7f51f3200640 1 --2- 172.21.15.55:0/3456348047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ec15ad30 0x7f51ec0cd370 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:23.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.163+0000 7f51f3200640 1 -- 172.21.15.55:0/3456348047 >> 172.21.15.55:0/3456348047 conn(0x7f51ec066080 msgr2=0x7f51ec069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:23.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.163+0000 7f51f3200640 1 -- 172.21.15.55:0/3456348047 shutdown_connections 2024-04-02T07:23:23.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.163+0000 7f51f3200640 1 -- 172.21.15.55:0/3456348047 wait complete. 2024-04-02T07:23:23.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51f3200640 1 Processor -- start 2024-04-02T07:23:23.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51f3200640 1 -- start start 2024-04-02T07:23:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51f3200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51ec0cd8b0 0x7f51ec159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51f3200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ec143f90 0x7f51ec136880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51f3200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51ec15ad30 0x7f51ec06c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51f3200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec1378e0 con 0x7f51ec143f90 2024-04-02T07:23:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51f3200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec15a470 con 0x7f51ec0cd8b0 2024-04-02T07:23:23.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51f3200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51ec137320 con 0x7f51ec15ad30 2024-04-02T07:23:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51e3400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ec143f90 0x7f51ec136880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51e3400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ec143f90 0x7f51ec136880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34608/0 (socket says 172.21.15.55:34608) 2024-04-02T07:23:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51e3400640 1 -- 172.21.15.55:0/2395637471 learned_addr learned my addr 172.21.15.55:0/2395637471 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51ebe00640 1 --2- 172.21.15.55:0/2395637471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51ec0cd8b0 0x7f51ec159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51f1200640 1 --2- 172.21.15.55:0/2395637471 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51ec15ad30 0x7f51ec06c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51e3400640 1 -- 172.21.15.55:0/2395637471 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51ec15ad30 msgr2=0x7f51ec06c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51e3400640 1 --2- 172.21.15.55:0/2395637471 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51ec15ad30 0x7f51ec06c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51e3400640 1 -- 172.21.15.55:0/2395637471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51ec0cd8b0 msgr2=0x7f51ec159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51e3400640 1 --2- 172.21.15.55:0/2395637471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51ec0cd8b0 0x7f51ec159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51e3400640 1 -- 172.21.15.55:0/2395637471 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d4009420 con 0x7f51ec143f90 2024-04-02T07:23:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51e3400640 1 --2- 172.21.15.55:0/2395637471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ec143f90 0x7f51ec136880 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f51d4018ff0 tx=0x7f51d401ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:23.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51e8c00640 1 -- 172.21.15.55:0/2395637471 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d40b7860 con 0x7f51ec143f90 2024-04-02T07:23:23.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51e8c00640 1 -- 172.21.15.55:0/2395637471 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d40b79c0 con 0x7f51ec143f90 2024-04-02T07:23:23.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51e8c00640 1 -- 172.21.15.55:0/2395637471 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d40b7d70 con 0x7f51ec143f90 2024-04-02T07:23:23.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51f3200640 1 -- 172.21.15.55:0/2395637471 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51ec137600 con 0x7f51ec143f90 2024-04-02T07:23:23.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.167+0000 7f51f3200640 1 -- 172.21.15.55:0/2395637471 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51ec1393b0 con 0x7f51ec143f90 2024-04-02T07:23:23.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.171+0000 7f51f3200640 1 -- 172.21.15.55:0/2395637471 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51ec138f30 con 0x7f51ec143f90 2024-04-02T07:23:23.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.171+0000 7f51e8c00640 1 -- 172.21.15.55:0/2395637471 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f51d40b3070 con 0x7f51ec143f90 2024-04-02T07:23:23.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.171+0000 7f51e8c00640 1 --2- 172.21.15.55:0/2395637471 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51c8066690 0x7f51c8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:23.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.171+0000 7f51e8c00640 1 -- 172.21.15.55:0/2395637471 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f51d411e9c0 con 0x7f51ec143f90 2024-04-02T07:23:23.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.171+0000 7f51ebe00640 1 --2- 172.21.15.55:0/2395637471 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51c8066690 0x7f51c8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:23.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.171+0000 7f51ebe00640 1 --2- 172.21.15.55:0/2395637471 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51c8066690 0x7f51c8068b50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f51dc007fd0 tx=0x7f51dc007ba0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:23.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.175+0000 7f51e8c00640 1 -- 172.21.15.55:0/2395637471 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f51ec138f30 con 0x7f51ec143f90 2024-04-02T07:23:23.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.339+0000 7f51f3200640 1 -- 172.21.15.55:0/2395637471 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f51ec138f30 con 0x7f51ec143f90 2024-04-02T07:23:23.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.339+0000 7f51e8c00640 1 -- 172.21.15.55:0/2395637471 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+65 (secure 0 0 0) 0x7f51ec138f30 con 0x7f51ec143f90 2024-04-02T07:23:23.341 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:23.341 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-02T07:23:23.341 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:23:23.341 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-04-02T07:23:23.341 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-04-02T07:23:23.341 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:23.341 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-02T07:23:23.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.339+0000 7f51f3200640 1 -- 172.21.15.55:0/2395637471 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51c8066690 msgr2=0x7f51c8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:23.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.339+0000 7f51f3200640 1 --2- 172.21.15.55:0/2395637471 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51c8066690 0x7f51c8068b50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f51dc007fd0 tx=0x7f51dc007ba0 comp rx=0 tx=0).stop 2024-04-02T07:23:23.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.339+0000 7f51f3200640 1 -- 172.21.15.55:0/2395637471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ec143f90 msgr2=0x7f51ec136880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:23.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.339+0000 7f51f3200640 1 --2- 172.21.15.55:0/2395637471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ec143f90 0x7f51ec136880 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f51d4018ff0 tx=0x7f51d401ac20 comp rx=0 tx=0).stop 2024-04-02T07:23:23.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.339+0000 7f51f3200640 1 -- 172.21.15.55:0/2395637471 shutdown_connections 2024-04-02T07:23:23.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.339+0000 7f51f3200640 1 --2- 172.21.15.55:0/2395637471 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51ec15ad30 0x7f51ec06c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:23.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.339+0000 7f51f3200640 1 --2- 172.21.15.55:0/2395637471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51ec143f90 0x7f51ec136880 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:23.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.339+0000 7f51f3200640 1 --2- 172.21.15.55:0/2395637471 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51c8066690 0x7f51c8068b50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:23.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.339+0000 7f51f3200640 1 --2- 172.21.15.55:0/2395637471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51ec0cd8b0 0x7f51ec159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:23.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.339+0000 7f51f3200640 1 -- 172.21.15.55:0/2395637471 >> 172.21.15.55:0/2395637471 conn(0x7f51ec066080 msgr2=0x7f51ec070210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:23.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.339+0000 7f51f3200640 1 -- 172.21.15.55:0/2395637471 shutdown_connections 2024-04-02T07:23:23.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.339+0000 7f51f3200640 1 -- 172.21.15.55:0/2395637471 wait complete. 2024-04-02T07:23:23.361 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-02T07:23:23.361 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-02T07:23:23.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.503+0000 7f5d2c000640 1 Processor -- start 2024-04-02T07:23:23.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.503+0000 7f5d2c000640 1 -- start start 2024-04-02T07:23:23.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.503+0000 7f5d2c000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5d240af920 0x7f5d2406d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:23.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.503+0000 7f5d2c000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d240ca030 con 0x7f5d240cb5b0 2024-04-02T07:23:23.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.503+0000 7f5d2c000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d240c9420 con 0x7f5d2415aa40 2024-04-02T07:23:23.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.503+0000 7f5d2c000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d240c9700 con 0x7f5d240af920 2024-04-02T07:23:23.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.503+0000 7f5d28c00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5d240cb5b0 0x7f5d2406ca00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56146/0 (socket says 172.21.15.55:56146) 2024-04-02T07:23:23.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.503+0000 7f5d28c00640 1 -- 172.21.15.55:0/2116583390 learned_addr learned my addr 172.21.15.55:0/2116583390 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:23.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.503+0000 7f5d2a000640 1 --2- 172.21.15.55:0/2116583390 >> v2:172.21.15.106:3300/0 conn(0x7f5d240af920 0x7f5d2406d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:23.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.507+0000 7f5d23e00640 1 -- 172.21.15.55:0/2116583390 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3909105265 0 0) 0x7f5d240ca030 con 0x7f5d240cb5b0 2024-04-02T07:23:23.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.507+0000 7f5d23e00640 1 -- 172.21.15.55:0/2116583390 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d0c003530 con 0x7f5d240cb5b0 2024-04-02T07:23:23.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.507+0000 7f5d23e00640 1 -- 172.21.15.55:0/2116583390 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2910627133 0 0) 0x7f5d240c9420 con 0x7f5d2415aa40 2024-04-02T07:23:23.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.507+0000 7f5d23e00640 1 -- 172.21.15.55:0/2116583390 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d240ca030 con 0x7f5d2415aa40 2024-04-02T07:23:23.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.507+0000 7f5d2a000640 1 -- 172.21.15.55:0/2116583390 >> v1:172.21.15.106:6789/0 conn(0x7f5d2415aa40 legacy=0x7f5d240caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:23.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.507+0000 7f5d2a000640 1 -- 172.21.15.55:0/2116583390 >> v1:172.21.15.55:6789/0 conn(0x7f5d240cb5b0 legacy=0x7f5d2406ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:23.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.507+0000 7f5d2a000640 1 -- 172.21.15.55:0/2116583390 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d240c99e0 con 0x7f5d240af920 2024-04-02T07:23:23.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.507+0000 7f5d2a000640 1 --2- 172.21.15.55:0/2116583390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d240af920 0x7f5d2406d110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009d90 tx=0x7f5d2406de60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5651fc2ce7bf4b26 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:23.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.507+0000 7f5d23e00640 1 -- 172.21.15.55:0/2116583390 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0a5a20 con 0x7f5d240af920 2024-04-02T07:23:23.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.507+0000 7f5d23e00640 1 -- 172.21.15.55:0/2116583390 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1c0a5b80 con 0x7f5d240af920 2024-04-02T07:23:23.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.507+0000 7f5d23e00640 1 -- 172.21.15.55:0/2116583390 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1c0ad440 con 0x7f5d240af920 2024-04-02T07:23:23.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d2c000640 1 -- 172.21.15.55:0/2116583390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d240af920 msgr2=0x7f5d2406d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:23.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d2c000640 1 --2- 172.21.15.55:0/2116583390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d240af920 0x7f5d2406d110 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c009d90 tx=0x7f5d2406de60 comp rx=0 tx=0).stop 2024-04-02T07:23:23.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d2c000640 1 -- 172.21.15.55:0/2116583390 shutdown_connections 2024-04-02T07:23:23.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d2c000640 1 --2- 172.21.15.55:0/2116583390 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d240af920 0x7f5d2406d110 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:23.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d2c000640 1 -- 172.21.15.55:0/2116583390 >> 172.21.15.55:0/2116583390 conn(0x7f5d24069d90 msgr2=0x7f5d2406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:23.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d2c000640 1 -- 172.21.15.55:0/2116583390 shutdown_connections 2024-04-02T07:23:23.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d2c000640 1 -- 172.21.15.55:0/2116583390 wait complete. 2024-04-02T07:23:23.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d2c000640 1 Processor -- start 2024-04-02T07:23:23.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d2c000640 1 -- start start 2024-04-02T07:23:23.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d2c000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d240af920 0x7f5d241513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:23.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d2c000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d240cb5b0 0x7f5d240b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:23.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d2c000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d2415aa40 0x7f5d2414b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:23.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d2c000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d24145830 con 0x7f5d240af920 2024-04-02T07:23:23.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d2c000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d240b1c20 con 0x7f5d2415aa40 2024-04-02T07:23:23.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d2c000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d240b1920 con 0x7f5d240cb5b0 2024-04-02T07:23:23.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d29600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d240af920 0x7f5d241513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:23.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d29600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d240af920 0x7f5d241513a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34622/0 (socket says 172.21.15.55:34622) 2024-04-02T07:23:23.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d29600640 1 -- 172.21.15.55:0/2189415072 learned_addr learned my addr 172.21.15.55:0/2189415072 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:23.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d2a000640 1 --2- 172.21.15.55:0/2189415072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d2415aa40 0x7f5d2414b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:23.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d28c00640 1 --2- 172.21.15.55:0/2189415072 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d240cb5b0 0x7f5d240b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:23.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d29600640 1 -- 172.21.15.55:0/2189415072 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d240cb5b0 msgr2=0x7f5d240b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:23.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d29600640 1 --2- 172.21.15.55:0/2189415072 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d240cb5b0 0x7f5d240b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:23.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d29600640 1 -- 172.21.15.55:0/2189415072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d2415aa40 msgr2=0x7f5d2414b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:23.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d29600640 1 --2- 172.21.15.55:0/2189415072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d2415aa40 0x7f5d2414b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:23.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.511+0000 7f5d29600640 1 -- 172.21.15.55:0/2189415072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d1c009a70 con 0x7f5d240af920 2024-04-02T07:23:23.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.515+0000 7f5d29600640 1 --2- 172.21.15.55:0/2189415072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d240af920 0x7f5d241513a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5d1800c490 tx=0x7f5d1800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:23.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.515+0000 7f5d21600640 1 -- 172.21.15.55:0/2189415072 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d180052d0 con 0x7f5d240af920 2024-04-02T07:23:23.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.515+0000 7f5d21600640 1 -- 172.21.15.55:0/2189415072 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d18005430 con 0x7f5d240af920 2024-04-02T07:23:23.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.515+0000 7f5d21600640 1 -- 172.21.15.55:0/2189415072 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d18012870 con 0x7f5d240af920 2024-04-02T07:23:23.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.515+0000 7f5d2c000640 1 -- 172.21.15.55:0/2189415072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d241518e0 con 0x7f5d240af920 2024-04-02T07:23:23.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.515+0000 7f5d2c000640 1 -- 172.21.15.55:0/2189415072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d24151e60 con 0x7f5d240af920 2024-04-02T07:23:23.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.515+0000 7f5d2c000640 1 -- 172.21.15.55:0/2189415072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d2406e240 con 0x7f5d240af920 2024-04-02T07:23:23.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.515+0000 7f5d21600640 1 -- 172.21.15.55:0/2189415072 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5d180129d0 con 0x7f5d240af920 2024-04-02T07:23:23.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.515+0000 7f5d21600640 1 --2- 172.21.15.55:0/2189415072 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d04066690 0x7f5d04068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:23.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.515+0000 7f5d21600640 1 -- 172.21.15.55:0/2189415072 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5d180839f0 con 0x7f5d240af920 2024-04-02T07:23:23.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.515+0000 7f5d28c00640 1 --2- 172.21.15.55:0/2189415072 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d04066690 0x7f5d04068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:23.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.519+0000 7f5d28c00640 1 --2- 172.21.15.55:0/2189415072 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d04066690 0x7f5d04068b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5d24145510 tx=0x7f5d10009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:23.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.519+0000 7f5d21600640 1 -- 172.21.15.55:0/2189415072 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5d18051010 con 0x7f5d240af920 2024-04-02T07:23:23.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:23.679+0000 7f5d2c000640 1 -- 172.21.15.55:0/2189415072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5d24066c90 con 0x7f5d240af920 2024-04-02T07:23:24.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.327+0000 7f5d21600640 1 -- 172.21.15.55:0/2189415072 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5d18054630 con 0x7f5d240af920 2024-04-02T07:23:24.329 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-04-02T07:23:24.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.331+0000 7f5d2c000640 1 -- 172.21.15.55:0/2189415072 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d04066690 msgr2=0x7f5d04068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:24.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.331+0000 7f5d2c000640 1 --2- 172.21.15.55:0/2189415072 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d04066690 0x7f5d04068b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5d24145510 tx=0x7f5d10009040 comp rx=0 tx=0).stop 2024-04-02T07:23:24.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.331+0000 7f5d2c000640 1 -- 172.21.15.55:0/2189415072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d240af920 msgr2=0x7f5d241513a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:24.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.331+0000 7f5d2c000640 1 --2- 172.21.15.55:0/2189415072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d240af920 0x7f5d241513a0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5d1800c490 tx=0x7f5d1800c950 comp rx=0 tx=0).stop 2024-04-02T07:23:24.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.331+0000 7f5d2c000640 1 -- 172.21.15.55:0/2189415072 shutdown_connections 2024-04-02T07:23:24.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.331+0000 7f5d2c000640 1 --2- 172.21.15.55:0/2189415072 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d04066690 0x7f5d04068b50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:24.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.331+0000 7f5d2c000640 1 --2- 172.21.15.55:0/2189415072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d2415aa40 0x7f5d2414b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:24.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.331+0000 7f5d2c000640 1 --2- 172.21.15.55:0/2189415072 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d240cb5b0 0x7f5d240b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:24.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.331+0000 7f5d2c000640 1 --2- 172.21.15.55:0/2189415072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d240af920 0x7f5d241513a0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:24.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.331+0000 7f5d2c000640 1 -- 172.21.15.55:0/2189415072 >> 172.21.15.55:0/2189415072 conn(0x7f5d24069d90 msgr2=0x7f5d240caea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:24.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.331+0000 7f5d2c000640 1 -- 172.21.15.55:0/2189415072 shutdown_connections 2024-04-02T07:23:24.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.331+0000 7f5d2c000640 1 -- 172.21.15.55:0/2189415072 wait complete. 2024-04-02T07:23:24.359 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-02T07:23:24.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.511+0000 7fec0ca00640 1 Processor -- start 2024-04-02T07:23:24.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.511+0000 7fec0ca00640 1 -- start start 2024-04-02T07:23:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.511+0000 7fec0ca00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec081570c0 0x7fec0806ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.511+0000 7fec0ca00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fec0815dcd0 0x7fec080ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.511+0000 7fec0ca00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fec080cd1b0 0x7fec08070cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.511+0000 7fec0ca00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0806b3d0 con 0x7fec0815dcd0 2024-04-02T07:23:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.511+0000 7fec0ca00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec081574a0 con 0x7fec080cd1b0 2024-04-02T07:23:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.511+0000 7fec0ca00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0806aa00 con 0x7fec081570c0 2024-04-02T07:23:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.511+0000 7febffe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fec0815dcd0 0x7fec080ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.511+0000 7febffe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fec0815dcd0 0x7fec080ccc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34634/0 (socket says 172.21.15.55:34634) 2024-04-02T07:23:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.511+0000 7febffe00640 1 -- 172.21.15.55:0/4032414340 learned_addr learned my addr 172.21.15.55:0/4032414340 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.511+0000 7fec05e00640 1 --2- 172.21.15.55:0/4032414340 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec081570c0 0x7fec0806ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.511+0000 7fec06800640 1 --2- 172.21.15.55:0/4032414340 >> v2:172.21.15.106:3300/0 conn(0x7fec080cd1b0 0x7fec08070cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.511+0000 7febffe00640 1 -- 172.21.15.55:0/4032414340 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec081570c0 msgr2=0x7fec0806ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:24.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.511+0000 7febffe00640 1 --2- 172.21.15.55:0/4032414340 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec081570c0 0x7fec0806ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.511+0000 7febffe00640 1 -- 172.21.15.55:0/4032414340 >> v2:172.21.15.106:3300/0 conn(0x7fec080cd1b0 msgr2=0x7fec08070cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.511+0000 7febffe00640 1 --2- 172.21.15.55:0/4032414340 >> v2:172.21.15.106:3300/0 conn(0x7fec080cd1b0 0x7fec08070cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.511+0000 7febffe00640 1 -- 172.21.15.55:0/4032414340 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec08069e30 con 0x7fec0815dcd0 2024-04-02T07:23:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.511+0000 7fec06800640 1 --2- 172.21.15.55:0/4032414340 >> v2:172.21.15.106:3300/0 conn(0x7fec080cd1b0 0x7fec08070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:23:24.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.511+0000 7fec05e00640 1 --2- 172.21.15.55:0/4032414340 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec081570c0 0x7fec0806ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:23:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.515+0000 7febffe00640 1 --2- 172.21.15.55:0/4032414340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec0815dcd0 0x7fec080ccc70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fec0815ab60 tx=0x7febf001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=793e767102abd446 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.515+0000 7fec05400640 1 -- 172.21.15.55:0/4032414340 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf00ac620 con 0x7fec0815dcd0 2024-04-02T07:23:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.515+0000 7fec05400640 1 -- 172.21.15.55:0/4032414340 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf00ac780 con 0x7fec0815dcd0 2024-04-02T07:23:24.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.515+0000 7fec05400640 1 -- 172.21.15.55:0/4032414340 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf00acb10 con 0x7fec0815dcd0 2024-04-02T07:23:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.515+0000 7fec0ca00640 1 -- 172.21.15.55:0/4032414340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec0815dcd0 msgr2=0x7fec080ccc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.515+0000 7fec0ca00640 1 --2- 172.21.15.55:0/4032414340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec0815dcd0 0x7fec080ccc70 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fec0815ab60 tx=0x7febf001c4f0 comp rx=0 tx=0).stop 2024-04-02T07:23:24.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.515+0000 7fec0ca00640 1 -- 172.21.15.55:0/4032414340 shutdown_connections 2024-04-02T07:23:24.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.515+0000 7fec0ca00640 1 --2- 172.21.15.55:0/4032414340 >> v2:172.21.15.106:3300/0 conn(0x7fec080cd1b0 0x7fec08070cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:24.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.515+0000 7fec0ca00640 1 --2- 172.21.15.55:0/4032414340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec0815dcd0 0x7fec080ccc70 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:24.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.515+0000 7fec0ca00640 1 --2- 172.21.15.55:0/4032414340 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec081570c0 0x7fec0806ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:24.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.515+0000 7fec0ca00640 1 -- 172.21.15.55:0/4032414340 >> 172.21.15.55:0/4032414340 conn(0x7fec080cf170 msgr2=0x7fec080cf580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:24.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.515+0000 7fec0ca00640 1 -- 172.21.15.55:0/4032414340 shutdown_connections 2024-04-02T07:23:24.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.515+0000 7fec0ca00640 1 -- 172.21.15.55:0/4032414340 wait complete. 2024-04-02T07:23:24.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec0ca00640 1 Processor -- start 2024-04-02T07:23:24.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec0ca00640 1 -- start start 2024-04-02T07:23:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec0ca00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec080cd1b0 0x7fec080ca890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec0ca00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec081570c0 0x7fec0814b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec0ca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec0815dcd0 0x7fec08152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec0ca00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec080c4670 con 0x7fec0815dcd0 2024-04-02T07:23:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec0ca00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec080c4950 con 0x7fec080cd1b0 2024-04-02T07:23:24.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec0ca00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec080c4c30 con 0x7fec081570c0 2024-04-02T07:23:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec06800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec0815dcd0 0x7fec08152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec06800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec0815dcd0 0x7fec08152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34646/0 (socket says 172.21.15.55:34646) 2024-04-02T07:23:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec06800640 1 -- 172.21.15.55:0/714588709 learned_addr learned my addr 172.21.15.55:0/714588709 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec05e00640 1 --2- 172.21.15.55:0/714588709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec080cd1b0 0x7fec080ca890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7febffe00640 1 --2- 172.21.15.55:0/714588709 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec081570c0 0x7fec0814b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec06800640 1 -- 172.21.15.55:0/714588709 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec081570c0 msgr2=0x7fec0814b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec06800640 1 --2- 172.21.15.55:0/714588709 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec081570c0 0x7fec0814b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec06800640 1 -- 172.21.15.55:0/714588709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec080cd1b0 msgr2=0x7fec080ca890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec06800640 1 --2- 172.21.15.55:0/714588709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec080cd1b0 0x7fec080ca890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec06800640 1 -- 172.21.15.55:0/714588709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf00094d0 con 0x7fec0815dcd0 2024-04-02T07:23:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7febffe00640 1 --2- 172.21.15.55:0/714588709 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec081570c0 0x7fec0814b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:23:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec05e00640 1 --2- 172.21.15.55:0/714588709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec080cd1b0 0x7fec080ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:23:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec06800640 1 --2- 172.21.15.55:0/714588709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec0815dcd0 0x7fec08152280 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fec0000cef0 tx=0x7fec0000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:24.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7febfe000640 1 -- 172.21.15.55:0/714588709 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0000d840 con 0x7fec0815dcd0 2024-04-02T07:23:24.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7febfe000640 1 -- 172.21.15.55:0/714588709 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0000d9c0 con 0x7fec0815dcd0 2024-04-02T07:23:24.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7febfe000640 1 -- 172.21.15.55:0/714588709 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0000dd70 con 0x7fec0815dcd0 2024-04-02T07:23:24.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec0ca00640 1 -- 172.21.15.55:0/714588709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec080c4f10 con 0x7fec0815dcd0 2024-04-02T07:23:24.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec0ca00640 1 -- 172.21.15.55:0/714588709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec080c42b0 con 0x7fec0815dcd0 2024-04-02T07:23:24.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.519+0000 7fec0ca00640 1 -- 172.21.15.55:0/714588709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec080b2390 con 0x7fec0815dcd0 2024-04-02T07:23:24.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.523+0000 7febfe000640 1 -- 172.21.15.55:0/714588709 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fec0001e3b0 con 0x7fec0815dcd0 2024-04-02T07:23:24.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.523+0000 7febfe000640 1 --2- 172.21.15.55:0/714588709 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7febe4066690 0x7febe4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:24.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.523+0000 7febfe000640 1 -- 172.21.15.55:0/714588709 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fec00084dc0 con 0x7fec0815dcd0 2024-04-02T07:23:24.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.523+0000 7fec05e00640 1 --2- 172.21.15.55:0/714588709 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7febe4066690 0x7febe4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:24.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.523+0000 7fec05e00640 1 --2- 172.21.15.55:0/714588709 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7febe4066690 0x7febe4068b50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7febf8006fd0 tx=0x7febf8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:24.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.527+0000 7febfe000640 1 -- 172.21.15.55:0/714588709 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fec000523b0 con 0x7fec0815dcd0 2024-04-02T07:23:24.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:24.691+0000 7fec0ca00640 1 -- 172.21.15.55:0/714588709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fec080b2390 con 0x7fec0815dcd0 2024-04-02T07:23:24.774 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-04-02T07:23:25.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.331+0000 7febfe000640 1 -- 172.21.15.55:0/714588709 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7fec080b2390 con 0x7fec0815dcd0 2024-04-02T07:23:25.333 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-04-02T07:23:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.335+0000 7fec0ca00640 1 -- 172.21.15.55:0/714588709 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7febe4066690 msgr2=0x7febe4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.335+0000 7fec0ca00640 1 --2- 172.21.15.55:0/714588709 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7febe4066690 0x7febe4068b50 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7febf8006fd0 tx=0x7febf8008040 comp rx=0 tx=0).stop 2024-04-02T07:23:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.335+0000 7fec0ca00640 1 -- 172.21.15.55:0/714588709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec0815dcd0 msgr2=0x7fec08152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.335+0000 7fec0ca00640 1 --2- 172.21.15.55:0/714588709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec0815dcd0 0x7fec08152280 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fec0000cef0 tx=0x7fec0000a710 comp rx=0 tx=0).stop 2024-04-02T07:23:25.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.335+0000 7fec0ca00640 1 -- 172.21.15.55:0/714588709 shutdown_connections 2024-04-02T07:23:25.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.335+0000 7fec0ca00640 1 --2- 172.21.15.55:0/714588709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec0815dcd0 0x7fec08152280 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:25.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.335+0000 7fec0ca00640 1 --2- 172.21.15.55:0/714588709 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec081570c0 0x7fec0814b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:25.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.335+0000 7fec0ca00640 1 --2- 172.21.15.55:0/714588709 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7febe4066690 0x7febe4068b50 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:25.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.335+0000 7fec0ca00640 1 --2- 172.21.15.55:0/714588709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec080cd1b0 0x7fec080ca890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:25.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.335+0000 7fec0ca00640 1 -- 172.21.15.55:0/714588709 >> 172.21.15.55:0/714588709 conn(0x7fec080cf170 msgr2=0x7fec080cf550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:25.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.335+0000 7fec0ca00640 1 -- 172.21.15.55:0/714588709 shutdown_connections 2024-04-02T07:23:25.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.335+0000 7fec0ca00640 1 -- 172.21.15.55:0/714588709 wait complete. 2024-04-02T07:23:25.369 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-02T07:23:25.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.511+0000 7fbb1f400640 1 Processor -- start 2024-04-02T07:23:25.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.511+0000 7fbb1f400640 1 -- start start 2024-04-02T07:23:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.511+0000 7fbb1f400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbb180ceb50 0x7fbb180cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.511+0000 7fbb1f400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb180b0800 0x7fbb180b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.511+0000 7fbb1f400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb180cb0e0 con 0x7fbb180cb5a0 2024-04-02T07:23:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.511+0000 7fbb1f400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb180cf470 con 0x7fbb180ceb50 2024-04-02T07:23:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.511+0000 7fbb1f400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb180b1560 con 0x7fbb180b0800 2024-04-02T07:23:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.511+0000 7fbb1ca00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbb180ceb50 0x7fbb180cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.511+0000 7fbb1d400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbb180cb5a0 0x7fbb180cba00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:56158/0 (socket says 172.21.15.55:56158) 2024-04-02T07:23:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.511+0000 7fbb1d400640 1 -- 172.21.15.55:0/3562449418 learned_addr learned my addr 172.21.15.55:0/3562449418 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.515+0000 7fbb0fe00640 1 --2- 172.21.15.55:0/3562449418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb180b0800 0x7fbb180b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.515+0000 7fbb1ca00640 1 -- 172.21.15.55:0/3562449418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb180b0800 msgr2=0x7fbb180b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.515+0000 7fbb1ca00640 1 --2- 172.21.15.55:0/3562449418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb180b0800 0x7fbb180b0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.515+0000 7fbb1ca00640 1 -- 172.21.15.55:0/3562449418 >> v1:172.21.15.55:6789/0 conn(0x7fbb180cb5a0 legacy=0x7fbb180cba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.515+0000 7fbb1ca00640 1 -- 172.21.15.55:0/3562449418 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb180b1840 con 0x7fbb180ceb50 2024-04-02T07:23:25.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.515+0000 7fbb17e00640 1 -- 172.21.15.55:0/3562449418 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3387465545 0 0) 0x7fbb180cb0e0 con 0x7fbb180cb5a0 2024-04-02T07:23:25.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.515+0000 7fbb1ca00640 1 --2- 172.21.15.55:0/3562449418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb180ceb50 0x7fbb180cef30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbb080097c0 tx=0x7fbb0801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63281fdb31e7f442 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:25.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.515+0000 7fbb17e00640 1 -- 172.21.15.55:0/3562449418 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb080ab600 con 0x7fbb180ceb50 2024-04-02T07:23:25.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.515+0000 7fbb17e00640 1 -- 172.21.15.55:0/3562449418 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb080a7050 con 0x7fbb180ceb50 2024-04-02T07:23:25.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.515+0000 7fbb17e00640 1 -- 172.21.15.55:0/3562449418 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb080ab980 con 0x7fbb180ceb50 2024-04-02T07:23:25.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.515+0000 7fbb1f400640 1 -- 172.21.15.55:0/3562449418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb180ceb50 msgr2=0x7fbb180cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:25.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.515+0000 7fbb1f400640 1 --2- 172.21.15.55:0/3562449418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb180ceb50 0x7fbb180cef30 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbb080097c0 tx=0x7fbb0801c410 comp rx=0 tx=0).stop 2024-04-02T07:23:25.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.515+0000 7fbb1f400640 1 -- 172.21.15.55:0/3562449418 shutdown_connections 2024-04-02T07:23:25.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1f400640 1 --2- 172.21.15.55:0/3562449418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb180b0800 0x7fbb180b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:25.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1f400640 1 --2- 172.21.15.55:0/3562449418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb180ceb50 0x7fbb180cef30 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:25.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1f400640 1 -- 172.21.15.55:0/3562449418 >> 172.21.15.55:0/3562449418 conn(0x7fbb180d0700 msgr2=0x7fbb180d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:25.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1f400640 1 -- 172.21.15.55:0/3562449418 shutdown_connections 2024-04-02T07:23:25.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1f400640 1 -- 172.21.15.55:0/3562449418 wait complete. 2024-04-02T07:23:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1f400640 1 Processor -- start 2024-04-02T07:23:25.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1f400640 1 -- start start 2024-04-02T07:23:25.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1f400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb180b0800 0x7fbb180ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:25.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb180cb5a0 0x7fbb181520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:25.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb180ceb50 0x7fbb18157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1f400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb18162610 con 0x7fbb180ceb50 2024-04-02T07:23:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1f400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb18162bd0 con 0x7fbb180cb5a0 2024-04-02T07:23:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1f400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb18154e70 con 0x7fbb180b0800 2024-04-02T07:23:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb180ceb50 0x7fbb18157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb180ceb50 0x7fbb18157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34658/0 (socket says 172.21.15.55:34658) 2024-04-02T07:23:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1d400640 1 -- 172.21.15.55:0/2684673161 learned_addr learned my addr 172.21.15.55:0/2684673161 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb0fe00640 1 --2- 172.21.15.55:0/2684673161 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb180cb5a0 0x7fbb181520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1ca00640 1 --2- 172.21.15.55:0/2684673161 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb180b0800 0x7fbb180ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1d400640 1 -- 172.21.15.55:0/2684673161 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb180b0800 msgr2=0x7fbb180ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1d400640 1 --2- 172.21.15.55:0/2684673161 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb180b0800 0x7fbb180ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1d400640 1 -- 172.21.15.55:0/2684673161 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb180cb5a0 msgr2=0x7fbb181520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1d400640 1 --2- 172.21.15.55:0/2684673161 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb180cb5a0 0x7fbb181520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1d400640 1 -- 172.21.15.55:0/2684673161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb08009420 con 0x7fbb180ceb50 2024-04-02T07:23:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1d400640 1 --2- 172.21.15.55:0/2684673161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb180ceb50 0x7fbb18157c00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000c7b0 tx=0x7fbb1000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb15600640 1 -- 172.21.15.55:0/2684673161 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1000a640 con 0x7fbb180ceb50 2024-04-02T07:23:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb15600640 1 -- 172.21.15.55:0/2684673161 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb1000a7c0 con 0x7fbb180ceb50 2024-04-02T07:23:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb15600640 1 -- 172.21.15.55:0/2684673161 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb1000ab70 con 0x7fbb180ceb50 2024-04-02T07:23:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.519+0000 7fbb1f400640 1 -- 172.21.15.55:0/2684673161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb18155150 con 0x7fbb180ceb50 2024-04-02T07:23:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.523+0000 7fbb1f400640 1 -- 172.21.15.55:0/2684673161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb18152630 con 0x7fbb180ceb50 2024-04-02T07:23:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.523+0000 7fbb1f400640 1 -- 172.21.15.55:0/2684673161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb18162d60 con 0x7fbb180ceb50 2024-04-02T07:23:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.523+0000 7fbb15600640 1 -- 172.21.15.55:0/2684673161 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fbb1000acd0 con 0x7fbb180ceb50 2024-04-02T07:23:25.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.523+0000 7fbb15600640 1 --2- 172.21.15.55:0/2684673161 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbaf4066690 0x7fbaf4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.523+0000 7fbb15600640 1 -- 172.21.15.55:0/2684673161 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fbb10083420 con 0x7fbb180ceb50 2024-04-02T07:23:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.523+0000 7fbb1ca00640 1 --2- 172.21.15.55:0/2684673161 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbaf4066690 0x7fbaf4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:25.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.527+0000 7fbb1ca00640 1 --2- 172.21.15.55:0/2684673161 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbaf4066690 0x7fbaf4068b50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbb080ad000 tx=0x7fbb080a4f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:25.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.527+0000 7fbb15600640 1 -- 172.21.15.55:0/2684673161 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fbb10050930 con 0x7fbb180ceb50 2024-04-02T07:23:25.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.723+0000 7fbb1f400640 1 -- 172.21.15.55:0/2684673161 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbb18066c90 con 0x7fbb180ceb50 2024-04-02T07:23:25.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.735+0000 7fbb15600640 1 -- 172.21.15.55:0/2684673161 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fbb10053f50 con 0x7fbb180ceb50 2024-04-02T07:23:25.740 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 4 and data pool 5 2024-04-02T07:23:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.739+0000 7fbb1f400640 1 -- 172.21.15.55:0/2684673161 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbaf4066690 msgr2=0x7fbaf4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.739+0000 7fbb1f400640 1 --2- 172.21.15.55:0/2684673161 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbaf4066690 0x7fbaf4068b50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbb080ad000 tx=0x7fbb080a4f90 comp rx=0 tx=0).stop 2024-04-02T07:23:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.739+0000 7fbb1f400640 1 -- 172.21.15.55:0/2684673161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb180ceb50 msgr2=0x7fbb18157c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.739+0000 7fbb1f400640 1 --2- 172.21.15.55:0/2684673161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb180ceb50 0x7fbb18157c00 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fbb1000c7b0 tx=0x7fbb1000cc70 comp rx=0 tx=0).stop 2024-04-02T07:23:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.739+0000 7fbb1f400640 1 -- 172.21.15.55:0/2684673161 shutdown_connections 2024-04-02T07:23:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.739+0000 7fbb1f400640 1 --2- 172.21.15.55:0/2684673161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb180ceb50 0x7fbb18157c00 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.739+0000 7fbb1f400640 1 --2- 172.21.15.55:0/2684673161 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbaf4066690 0x7fbaf4068b50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.739+0000 7fbb1f400640 1 --2- 172.21.15.55:0/2684673161 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb180cb5a0 0x7fbb181520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.739+0000 7fbb1f400640 1 --2- 172.21.15.55:0/2684673161 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb180b0800 0x7fbb180ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.739+0000 7fbb1f400640 1 -- 172.21.15.55:0/2684673161 >> 172.21.15.55:0/2684673161 conn(0x7fbb180d0700 msgr2=0x7fbb180cb980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.743+0000 7fbb1f400640 1 -- 172.21.15.55:0/2684673161 shutdown_connections 2024-04-02T07:23:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.743+0000 7fbb1f400640 1 -- 172.21.15.55:0/2684673161 wait complete. 2024-04-02T07:23:25.781 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:23:25.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.919+0000 7fc6e2200640 1 Processor -- start 2024-04-02T07:23:25.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.919+0000 7fc6e2200640 1 -- start start 2024-04-02T07:23:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.919+0000 7fc6e2200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6dc0b19d0 0x7fc6dc0ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.919+0000 7fc6e2200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc6dc06c0d0 0x7fc6dc098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.919+0000 7fc6e2200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6dc0cf3d0 con 0x7fc6dc0cef10 2024-04-02T07:23:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.919+0000 7fc6e2200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6dc0cf6b0 con 0x7fc6dc06c0d0 2024-04-02T07:23:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.919+0000 7fc6e2200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc0cf990 con 0x7fc6dc0b19d0 2024-04-02T07:23:25.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.919+0000 7fc6d2a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc6dc06c0d0 0x7fc6dc098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:25.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.919+0000 7fc6db400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6dc0b19d0 0x7fc6dc0ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:25.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.919+0000 7fc6dbe00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc6dc0cef10 0x7fc6dc15c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:52048/0 (socket says 172.21.15.55:52048) 2024-04-02T07:23:25.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.919+0000 7fc6d2a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc6dc06c0d0 0x7fc6dc098a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:35396/0 (socket says 172.21.15.55:35396) 2024-04-02T07:23:25.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.919+0000 7fc6dbe00640 1 -- 172.21.15.55:0/1012327557 learned_addr learned my addr 172.21.15.55:0/1012327557 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:25.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.919+0000 7fc6d2a00640 1 -- 172.21.15.55:0/1012327557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6dc0b19d0 msgr2=0x7fc6dc0ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:25.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.919+0000 7fc6d2a00640 1 --2- 172.21.15.55:0/1012327557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6dc0b19d0 0x7fc6dc0ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:25.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.919+0000 7fc6d2a00640 1 -- 172.21.15.55:0/1012327557 >> v1:172.21.15.106:6789/0 conn(0x7fc6dc0cef10 legacy=0x7fc6dc15c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:25.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.919+0000 7fc6d2a00640 1 -- 172.21.15.55:0/1012327557 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6dc0cfc70 con 0x7fc6dc06c0d0 2024-04-02T07:23:25.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.919+0000 7fc6db400640 1 --2- 172.21.15.55:0/1012327557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6dc0b19d0 0x7fc6dc0ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:23:25.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.923+0000 7fc6d2a00640 1 --2- 172.21.15.55:0/1012327557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6dc06c0d0 0x7fc6dc098a10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc6c40097c0 tx=0x7fc6c401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30f157f0a5c43285 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:25.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.923+0000 7fc6daa00640 1 -- 172.21.15.55:0/1012327557 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c40ab600 con 0x7fc6dc06c0d0 2024-04-02T07:23:25.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.923+0000 7fc6daa00640 1 -- 172.21.15.55:0/1012327557 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c40a7050 con 0x7fc6dc06c0d0 2024-04-02T07:23:25.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.923+0000 7fc6daa00640 1 -- 172.21.15.55:0/1012327557 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c40ab980 con 0x7fc6dc06c0d0 2024-04-02T07:23:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.923+0000 7fc6e2200640 1 -- 172.21.15.55:0/1012327557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6dc06c0d0 msgr2=0x7fc6dc098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.923+0000 7fc6e2200640 1 --2- 172.21.15.55:0/1012327557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6dc06c0d0 0x7fc6dc098a10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fc6c40097c0 tx=0x7fc6c401c4a0 comp rx=0 tx=0).stop 2024-04-02T07:23:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.923+0000 7fc6e2200640 1 -- 172.21.15.55:0/1012327557 shutdown_connections 2024-04-02T07:23:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.923+0000 7fc6e2200640 1 --2- 172.21.15.55:0/1012327557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6dc06c0d0 0x7fc6dc098a10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.923+0000 7fc6e2200640 1 --2- 172.21.15.55:0/1012327557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6dc0b19d0 0x7fc6dc0ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.923+0000 7fc6e2200640 1 -- 172.21.15.55:0/1012327557 >> 172.21.15.55:0/1012327557 conn(0x7fc6dc0b2150 msgr2=0x7fc6dc0b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.923+0000 7fc6e2200640 1 -- 172.21.15.55:0/1012327557 shutdown_connections 2024-04-02T07:23:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.923+0000 7fc6e2200640 1 -- 172.21.15.55:0/1012327557 wait complete. 2024-04-02T07:23:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6e2200640 1 Processor -- start 2024-04-02T07:23:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6e2200640 1 -- start start 2024-04-02T07:23:25.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6e2200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6dc06c0d0 0x7fc6dc0b5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6e2200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6dc0b19d0 0x7fc6dc15ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6e2200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6dc0cef10 0x7fc6dc150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6e2200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc15fc20 con 0x7fc6dc0cef10 2024-04-02T07:23:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6e2200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc15f190 con 0x7fc6dc06c0d0 2024-04-02T07:23:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6e2200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6dc0b3f40 con 0x7fc6dc0b19d0 2024-04-02T07:23:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6dbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6dc0cef10 0x7fc6dc150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6dbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6dc0cef10 0x7fc6dc150a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45558/0 (socket says 172.21.15.55:45558) 2024-04-02T07:23:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6dbe00640 1 -- 172.21.15.55:0/2781896180 learned_addr learned my addr 172.21.15.55:0/2781896180 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6db400640 1 --2- 172.21.15.55:0/2781896180 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6dc06c0d0 0x7fc6dc0b5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6d2a00640 1 --2- 172.21.15.55:0/2781896180 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6dc0b19d0 0x7fc6dc15ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6d2a00640 1 -- 172.21.15.55:0/2781896180 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6dc06c0d0 msgr2=0x7fc6dc0b5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6d2a00640 1 --2- 172.21.15.55:0/2781896180 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6dc06c0d0 0x7fc6dc0b5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6d2a00640 1 -- 172.21.15.55:0/2781896180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6dc0cef10 msgr2=0x7fc6dc150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:25.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6d2a00640 1 --2- 172.21.15.55:0/2781896180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6dc0cef10 0x7fc6dc150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:25.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6d2a00640 1 -- 172.21.15.55:0/2781896180 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6cc009420 con 0x7fc6dc0b19d0 2024-04-02T07:23:25.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6dbe00640 1 --2- 172.21.15.55:0/2781896180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6dc0cef10 0x7fc6dc150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:23:25.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6d2a00640 1 --2- 172.21.15.55:0/2781896180 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6dc0b19d0 0x7fc6dc15ec50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc071ef0 tx=0x7fc6c4019240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:25.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6d3e00640 1 -- 172.21.15.55:0/2781896180 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c40b4840 con 0x7fc6dc0b19d0 2024-04-02T07:23:25.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6d3e00640 1 -- 172.21.15.55:0/2781896180 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6c40b49e0 con 0x7fc6dc0b19d0 2024-04-02T07:23:25.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6e2200640 1 -- 172.21.15.55:0/2781896180 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6c4009420 con 0x7fc6dc0b19d0 2024-04-02T07:23:25.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6d3e00640 1 -- 172.21.15.55:0/2781896180 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6c40b4d90 con 0x7fc6dc0b19d0 2024-04-02T07:23:25.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.927+0000 7fc6e2200640 1 -- 172.21.15.55:0/2781896180 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6dc15f380 con 0x7fc6dc0b19d0 2024-04-02T07:23:25.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.931+0000 7fc6e2200640 1 -- 172.21.15.55:0/2781896180 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6dc0b3d10 con 0x7fc6dc0b19d0 2024-04-02T07:23:25.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.931+0000 7fc6d3e00640 1 -- 172.21.15.55:0/2781896180 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc6c40b2040 con 0x7fc6dc0b19d0 2024-04-02T07:23:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.931+0000 7fc6d3e00640 1 --2- 172.21.15.55:0/2781896180 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc6b8066690 0x7fc6b8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.931+0000 7fc6d3e00640 1 -- 172.21.15.55:0/2781896180 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6c411e1e0 con 0x7fc6dc0b19d0 2024-04-02T07:23:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.931+0000 7fc6db400640 1 --2- 172.21.15.55:0/2781896180 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc6b8066690 0x7fc6b8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.931+0000 7fc6db400640 1 --2- 172.21.15.55:0/2781896180 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc6b8066690 0x7fc6b8068b50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009cf0 tx=0x7fc6cc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:25.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:25.935+0000 7fc6d3e00640 1 -- 172.21.15.55:0/2781896180 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc6c40eb710 con 0x7fc6dc0b19d0 2024-04-02T07:23:26.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.095+0000 7fc6e2200640 1 -- 172.21.15.55:0/2781896180 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6dc0b3d10 con 0x7fc6dc0b19d0 2024-04-02T07:23:26.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.099+0000 7fc6d3e00640 1 -- 172.21.15.55:0/2781896180 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16114 (secure 0 0 0) 0x7fc6dc0b3d10 con 0x7fc6dc0b19d0 2024-04-02T07:23:26.101 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:26.101 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":33,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:23:25.726901+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:23:23.729158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-02T07:23:24.740958+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:23:26.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.099+0000 7fc6e2200640 1 -- 172.21.15.55:0/2781896180 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc6b8066690 msgr2=0x7fc6b8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:26.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.099+0000 7fc6e2200640 1 --2- 172.21.15.55:0/2781896180 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc6b8066690 0x7fc6b8068b50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009cf0 tx=0x7fc6cc009190 comp rx=0 tx=0).stop 2024-04-02T07:23:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.099+0000 7fc6e2200640 1 -- 172.21.15.55:0/2781896180 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6dc0b19d0 msgr2=0x7fc6dc15ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.099+0000 7fc6e2200640 1 --2- 172.21.15.55:0/2781896180 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6dc0b19d0 0x7fc6dc15ec50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc6dc071ef0 tx=0x7fc6c4019240 comp rx=0 tx=0).stop 2024-04-02T07:23:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.099+0000 7fc6e2200640 1 -- 172.21.15.55:0/2781896180 shutdown_connections 2024-04-02T07:23:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.099+0000 7fc6e2200640 1 --2- 172.21.15.55:0/2781896180 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6dc0cef10 0x7fc6dc150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.099+0000 7fc6e2200640 1 --2- 172.21.15.55:0/2781896180 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6dc0b19d0 0x7fc6dc15ec50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.099+0000 7fc6e2200640 1 --2- 172.21.15.55:0/2781896180 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc6b8066690 0x7fc6b8068b50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.099+0000 7fc6e2200640 1 --2- 172.21.15.55:0/2781896180 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6dc06c0d0 0x7fc6dc0b5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.099+0000 7fc6e2200640 1 -- 172.21.15.55:0/2781896180 >> 172.21.15.55:0/2781896180 conn(0x7fc6dc0b2150 msgr2=0x7fc6dc0cb690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.099+0000 7fc6e2200640 1 -- 172.21.15.55:0/2781896180 shutdown_connections 2024-04-02T07:23:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.099+0000 7fc6e2200640 1 -- 172.21.15.55:0/2781896180 wait complete. 2024-04-02T07:23:26.121 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:23:26.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.259+0000 7f976b200640 1 Processor -- start 2024-04-02T07:23:26.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.259+0000 7f976b200640 1 -- start start 2024-04-02T07:23:26.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.259+0000 7f976b200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9764099120 0x7f9764099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:26.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.259+0000 7f976b200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97640ad270 con 0x7f976415ee70 2024-04-02T07:23:26.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.259+0000 7f976b200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97640b0a50 con 0x7f976415f250 2024-04-02T07:23:26.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.259+0000 7f976b200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97640b0840 con 0x7f9764099120 2024-04-02T07:23:26.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.259+0000 7f9763e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f976415ee70 0x7f9764098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46246/0 (socket says 172.21.15.55:46246) 2024-04-02T07:23:26.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.259+0000 7f9763e00640 1 -- 172.21.15.55:0/1349217475 learned_addr learned my addr 172.21.15.55:0/1349217475 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:26.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.259+0000 7f975b400640 1 --2- 172.21.15.55:0/1349217475 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9764099120 0x7f9764099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:26.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.259+0000 7f9763400640 1 -- 172.21.15.55:0/1349217475 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501422216 0 0) 0x7f97640b0a50 con 0x7f976415f250 2024-04-02T07:23:26.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.259+0000 7f9763400640 1 -- 172.21.15.55:0/1349217475 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9748003530 con 0x7f976415f250 2024-04-02T07:23:26.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.259+0000 7f9763400640 1 -- 172.21.15.55:0/1349217475 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2079820286 0 0) 0x7f97640ad270 con 0x7f976415ee70 2024-04-02T07:23:26.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.259+0000 7f975b400640 1 -- 172.21.15.55:0/1349217475 >> v1:172.21.15.106:6789/0 conn(0x7f976415f250 legacy=0x7f97640ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:26.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.259+0000 7f975b400640 1 -- 172.21.15.55:0/1349217475 >> v1:172.21.15.55:6789/0 conn(0x7f976415ee70 legacy=0x7f9764098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:26.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.259+0000 7f975b400640 1 -- 172.21.15.55:0/1349217475 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97640b0d30 con 0x7f9764099120 2024-04-02T07:23:26.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.263+0000 7f975b400640 1 --2- 172.21.15.55:0/1349217475 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9764099120 0x7f9764099830 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f974c009dc0 tx=0x7f974c01c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35c11903599ebff3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:26.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.263+0000 7f9763400640 1 -- 172.21.15.55:0/1349217475 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c0a5a00 con 0x7f9764099120 2024-04-02T07:23:26.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.263+0000 7f9763400640 1 -- 172.21.15.55:0/1349217475 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c0a5b60 con 0x7f9764099120 2024-04-02T07:23:26.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.263+0000 7f9763400640 1 -- 172.21.15.55:0/1349217475 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c0ad440 con 0x7f9764099120 2024-04-02T07:23:26.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.263+0000 7f976b200640 1 -- 172.21.15.55:0/1349217475 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9764099120 msgr2=0x7f9764099830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:26.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.263+0000 7f976b200640 1 --2- 172.21.15.55:0/1349217475 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9764099120 0x7f9764099830 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f974c009dc0 tx=0x7f974c01c960 comp rx=0 tx=0).stop 2024-04-02T07:23:26.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.263+0000 7f976b200640 1 -- 172.21.15.55:0/1349217475 shutdown_connections 2024-04-02T07:23:26.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.263+0000 7f976b200640 1 --2- 172.21.15.55:0/1349217475 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9764099120 0x7f9764099830 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:26.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.263+0000 7f976b200640 1 -- 172.21.15.55:0/1349217475 >> 172.21.15.55:0/1349217475 conn(0x7f97640b21d0 msgr2=0x7f97640b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:26.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.263+0000 7f976b200640 1 -- 172.21.15.55:0/1349217475 shutdown_connections 2024-04-02T07:23:26.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.263+0000 7f976b200640 1 -- 172.21.15.55:0/1349217475 wait complete. 2024-04-02T07:23:26.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f976b200640 1 Processor -- start 2024-04-02T07:23:26.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f976b200640 1 -- start start 2024-04-02T07:23:26.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f976b200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9764099120 0x7f97640b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:26.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f976b200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f976415ee70 0x7f9764159ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:26.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f976b200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f976415f250 0x7f976415a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:26.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f976b200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9764159430 con 0x7f976415ee70 2024-04-02T07:23:26.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f976b200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f976415cce0 con 0x7f9764099120 2024-04-02T07:23:26.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f976b200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97641596d0 con 0x7f976415f250 2024-04-02T07:23:26.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f975b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f976415ee70 0x7f9764159ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:26.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f975b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f976415ee70 0x7f9764159ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45562/0 (socket says 172.21.15.55:45562) 2024-04-02T07:23:26.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f975b400640 1 -- 172.21.15.55:0/708819245 learned_addr learned my addr 172.21.15.55:0/708819245 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:26.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f9763e00640 1 --2- 172.21.15.55:0/708819245 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9764099120 0x7f97640b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:26.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f9769200640 1 --2- 172.21.15.55:0/708819245 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f976415f250 0x7f976415a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:26.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f975b400640 1 -- 172.21.15.55:0/708819245 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f976415f250 msgr2=0x7f976415a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:26.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f975b400640 1 --2- 172.21.15.55:0/708819245 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f976415f250 0x7f976415a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:26.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f975b400640 1 -- 172.21.15.55:0/708819245 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9764099120 msgr2=0x7f97640b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:26.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f975b400640 1 --2- 172.21.15.55:0/708819245 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9764099120 0x7f97640b5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:26.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f975b400640 1 -- 172.21.15.55:0/708819245 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974c009a70 con 0x7f976415ee70 2024-04-02T07:23:26.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f975b400640 1 --2- 172.21.15.55:0/708819245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f976415ee70 0x7f9764159ed0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f974c01a590 tx=0x7f974c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:26.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f9760c00640 1 -- 172.21.15.55:0/708819245 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c0add70 con 0x7f976415ee70 2024-04-02T07:23:26.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f9760c00640 1 -- 172.21.15.55:0/708819245 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c009450 con 0x7f976415ee70 2024-04-02T07:23:26.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f9760c00640 1 -- 172.21.15.55:0/708819245 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c003bc0 con 0x7f976415ee70 2024-04-02T07:23:26.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f976b200640 1 -- 172.21.15.55:0/708819245 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97641599b0 con 0x7f976415ee70 2024-04-02T07:23:26.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.267+0000 7f976b200640 1 -- 172.21.15.55:0/708819245 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97640c77b0 con 0x7f976415ee70 2024-04-02T07:23:26.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.271+0000 7f976b200640 1 -- 172.21.15.55:0/708819245 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9764066c90 con 0x7f976415ee70 2024-04-02T07:23:26.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.271+0000 7f9760c00640 1 -- 172.21.15.55:0/708819245 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f974c0b4050 con 0x7f976415ee70 2024-04-02T07:23:26.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.271+0000 7f9760c00640 1 --2- 172.21.15.55:0/708819245 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97400666c0 0x7f9740068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:26.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.271+0000 7f9760c00640 1 -- 172.21.15.55:0/708819245 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f974c11e640 con 0x7f976415ee70 2024-04-02T07:23:26.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.271+0000 7f9763e00640 1 --2- 172.21.15.55:0/708819245 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97400666c0 0x7f9740068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:26.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.271+0000 7f9763e00640 1 --2- 172.21.15.55:0/708819245 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97400666c0 0x7f9740068b80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9754007fd0 tx=0x7f9754007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:26.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.275+0000 7f9760c00640 1 -- 172.21.15.55:0/708819245 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f974c0eba60 con 0x7f976415ee70 2024-04-02T07:23:26.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.439+0000 7f976b200640 1 -- 172.21.15.55:0/708819245 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97640cc3e0 con 0x7f976415ee70 2024-04-02T07:23:26.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.439+0000 7f9760c00640 1 -- 172.21.15.55:0/708819245 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16114 (secure 0 0 0) 0x7f974c0ef080 con 0x7f976415ee70 2024-04-02T07:23:26.442 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:26.442 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":33,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:23:25.726901+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:23:23.729158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-02T07:23:24.740958+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:23:26.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.439+0000 7f976b200640 1 -- 172.21.15.55:0/708819245 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97400666c0 msgr2=0x7f9740068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:26.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.439+0000 7f976b200640 1 --2- 172.21.15.55:0/708819245 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97400666c0 0x7f9740068b80 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9754007fd0 tx=0x7f9754007d60 comp rx=0 tx=0).stop 2024-04-02T07:23:26.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.439+0000 7f976b200640 1 -- 172.21.15.55:0/708819245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f976415ee70 msgr2=0x7f9764159ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:26.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.439+0000 7f976b200640 1 --2- 172.21.15.55:0/708819245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f976415ee70 0x7f9764159ed0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f974c01a590 tx=0x7f974c019700 comp rx=0 tx=0).stop 2024-04-02T07:23:26.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.443+0000 7f976b200640 1 -- 172.21.15.55:0/708819245 shutdown_connections 2024-04-02T07:23:26.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.443+0000 7f976b200640 1 --2- 172.21.15.55:0/708819245 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f976415f250 0x7f976415a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:26.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.443+0000 7f976b200640 1 --2- 172.21.15.55:0/708819245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f976415ee70 0x7f9764159ed0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:26.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.443+0000 7f976b200640 1 --2- 172.21.15.55:0/708819245 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97400666c0 0x7f9740068b80 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:26.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.443+0000 7f976b200640 1 --2- 172.21.15.55:0/708819245 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9764099120 0x7f97640b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:26.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.443+0000 7f976b200640 1 -- 172.21.15.55:0/708819245 >> 172.21.15.55:0/708819245 conn(0x7f97640b21d0 msgr2=0x7f97640cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:26.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.443+0000 7f976b200640 1 -- 172.21.15.55:0/708819245 shutdown_connections 2024-04-02T07:23:26.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.443+0000 7f976b200640 1 -- 172.21.15.55:0/708819245 wait complete. 2024-04-02T07:23:26.464 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-02T07:23:26.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.607+0000 7f15d0e00640 1 Processor -- start 2024-04-02T07:23:26.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.607+0000 7f15d0e00640 1 -- start start 2024-04-02T07:23:26.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.607+0000 7f15d0e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f15cc0ade90 0x7f15cc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:26.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.607+0000 7f15d0e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15cc0b41a0 0x7f15cc142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:26.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.607+0000 7f15d0e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15cc06c630 con 0x7f15cc0b3dc0 2024-04-02T07:23:26.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.607+0000 7f15d0e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15cc0cae80 con 0x7f15cc0ade90 2024-04-02T07:23:26.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.607+0000 7f15d0e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc06c8f0 con 0x7f15cc0b41a0 2024-04-02T07:23:26.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.607+0000 7f15ca800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15cc0b41a0 0x7f15cc142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:26.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.607+0000 7f15c1400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f15cc0ade90 0x7f15cc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:26.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.607+0000 7f15c9e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f15cc0b3dc0 0x7f15cc0ca770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:52058/0 (socket says 172.21.15.55:52058) 2024-04-02T07:23:26.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.607+0000 7f15c9e00640 1 -- 172.21.15.55:0/3304654237 learned_addr learned my addr 172.21.15.55:0/3304654237 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:26.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.607+0000 7f15c1400640 1 --2- 172.21.15.55:0/3304654237 >> v2:172.21.15.106:3300/0 conn(0x7f15cc0ade90 0x7f15cc06d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:35430/0 (socket says 172.21.15.55:35430) 2024-04-02T07:23:26.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.607+0000 7f15ca800640 1 --2- 172.21.15.55:0/3304654237 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15cc0b41a0 0x7f15cc142ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:50762/0 (socket says 172.21.15.55:50762) 2024-04-02T07:23:26.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.607+0000 7f15ca800640 1 -- 172.21.15.55:0/3304654237 >> v2:172.21.15.106:3300/0 conn(0x7f15cc0ade90 msgr2=0x7f15cc06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:26.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.607+0000 7f15ca800640 1 --2- 172.21.15.55:0/3304654237 >> v2:172.21.15.106:3300/0 conn(0x7f15cc0ade90 0x7f15cc06d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:26.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.607+0000 7f15ca800640 1 -- 172.21.15.55:0/3304654237 >> v1:172.21.15.106:6789/0 conn(0x7f15cc0b3dc0 legacy=0x7f15cc0ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:26.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.607+0000 7f15ca800640 1 -- 172.21.15.55:0/3304654237 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15cc06cbd0 con 0x7f15cc0b41a0 2024-04-02T07:23:26.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.607+0000 7f15c1400640 1 --2- 172.21.15.55:0/3304654237 >> v2:172.21.15.106:3300/0 conn(0x7f15cc0ade90 0x7f15cc06d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:23:26.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.611+0000 7f15ca800640 1 --2- 172.21.15.55:0/3304654237 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15cc0b41a0 0x7f15cc142ac0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009d90 tx=0x7f15c401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7e9d4b431725175 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:26.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.611+0000 7f15c9400640 1 -- 172.21.15.55:0/3304654237 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c40a5880 con 0x7f15cc0b41a0 2024-04-02T07:23:26.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.611+0000 7f15c9400640 1 -- 172.21.15.55:0/3304654237 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15c40a59e0 con 0x7f15cc0b41a0 2024-04-02T07:23:26.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.611+0000 7f15c9400640 1 -- 172.21.15.55:0/3304654237 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15c40a5d70 con 0x7f15cc0b41a0 2024-04-02T07:23:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.611+0000 7f15d0e00640 1 -- 172.21.15.55:0/3304654237 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15cc0b41a0 msgr2=0x7f15cc142ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.611+0000 7f15d0e00640 1 --2- 172.21.15.55:0/3304654237 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15cc0b41a0 0x7f15cc142ac0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f15c4009d90 tx=0x7f15c401c8b0 comp rx=0 tx=0).stop 2024-04-02T07:23:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.611+0000 7f15d0e00640 1 -- 172.21.15.55:0/3304654237 shutdown_connections 2024-04-02T07:23:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.611+0000 7f15d0e00640 1 --2- 172.21.15.55:0/3304654237 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15cc0b41a0 0x7f15cc142ac0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.611+0000 7f15d0e00640 1 --2- 172.21.15.55:0/3304654237 >> v2:172.21.15.106:3300/0 conn(0x7f15cc0ade90 0x7f15cc06d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:26.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.611+0000 7f15d0e00640 1 -- 172.21.15.55:0/3304654237 >> 172.21.15.55:0/3304654237 conn(0x7f15cc06a390 msgr2=0x7f15cc0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:26.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.611+0000 7f15d0e00640 1 -- 172.21.15.55:0/3304654237 shutdown_connections 2024-04-02T07:23:26.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.611+0000 7f15d0e00640 1 -- 172.21.15.55:0/3304654237 wait complete. 2024-04-02T07:23:26.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15d0e00640 1 Processor -- start 2024-04-02T07:23:26.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15d0e00640 1 -- start start 2024-04-02T07:23:26.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15d0e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15cc0ade90 0x7f15cc138fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:26.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15d0e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15cc0b3dc0 0x7f15cc140720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:26.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15d0e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15cc0b41a0 0x7f15cc160ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:26.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15d0e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc141020 con 0x7f15cc0ade90 2024-04-02T07:23:26.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15d0e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc141300 con 0x7f15cc0b3dc0 2024-04-02T07:23:26.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15d0e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15cc1415e0 con 0x7f15cc0b41a0 2024-04-02T07:23:26.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15c9e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15cc0ade90 0x7f15cc138fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:26.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15c9e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15cc0ade90 0x7f15cc138fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45574/0 (socket says 172.21.15.55:45574) 2024-04-02T07:23:26.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15c9e00640 1 -- 172.21.15.55:0/3106816394 learned_addr learned my addr 172.21.15.55:0/3106816394 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:26.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15c1400640 1 --2- 172.21.15.55:0/3106816394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15cc0b3dc0 0x7f15cc140720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:26.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15ca800640 1 --2- 172.21.15.55:0/3106816394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15cc0b41a0 0x7f15cc160ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:26.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15c9e00640 1 -- 172.21.15.55:0/3106816394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15cc0b41a0 msgr2=0x7f15cc160ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:26.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15c9e00640 1 --2- 172.21.15.55:0/3106816394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15cc0b41a0 0x7f15cc160ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:26.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15c9e00640 1 -- 172.21.15.55:0/3106816394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15cc0b3dc0 msgr2=0x7f15cc140720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:26.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15c9e00640 1 --2- 172.21.15.55:0/3106816394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15cc0b3dc0 0x7f15cc140720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:26.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15c9e00640 1 -- 172.21.15.55:0/3106816394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b4009420 con 0x7f15cc0ade90 2024-04-02T07:23:26.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15c9e00640 1 --2- 172.21.15.55:0/3106816394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15cc0ade90 0x7f15cc138fd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00c500 tx=0x7f15bc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:26.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15c2a00640 1 -- 172.21.15.55:0/3106816394 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc005cf0 con 0x7f15cc0ade90 2024-04-02T07:23:26.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15c2a00640 1 -- 172.21.15.55:0/3106816394 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc005e50 con 0x7f15cc0ade90 2024-04-02T07:23:26.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15c2a00640 1 -- 172.21.15.55:0/3106816394 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc0072f0 con 0x7f15cc0ade90 2024-04-02T07:23:26.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15d0e00640 1 -- 172.21.15.55:0/3106816394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c4009a70 con 0x7f15cc0ade90 2024-04-02T07:23:26.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15d0e00640 1 -- 172.21.15.55:0/3106816394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15cc06de00 con 0x7f15cc0ade90 2024-04-02T07:23:26.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.615+0000 7f15d0e00640 1 -- 172.21.15.55:0/3106816394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15cc073530 con 0x7f15cc0ade90 2024-04-02T07:23:26.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.619+0000 7f15c2a00640 1 -- 172.21.15.55:0/3106816394 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f15bc007450 con 0x7f15cc0ade90 2024-04-02T07:23:26.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.619+0000 7f15c2a00640 1 --2- 172.21.15.55:0/3106816394 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f15a8066690 0x7f15a8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:26.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.619+0000 7f15c2a00640 1 -- 172.21.15.55:0/3106816394 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f15bc0836e0 con 0x7f15cc0ade90 2024-04-02T07:23:26.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.619+0000 7f15c1400640 1 --2- 172.21.15.55:0/3106816394 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f15a8066690 0x7f15a8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:26.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.619+0000 7f15c1400640 1 --2- 172.21.15.55:0/3106816394 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f15a8066690 0x7f15a8068b50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f15cc0acee0 tx=0x7f15b4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:26.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.623+0000 7f15c2a00640 1 -- 172.21.15.55:0/3106816394 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f15bc050af0 con 0x7f15cc0ade90 2024-04-02T07:23:26.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:26.827+0000 7f15d0e00640 1 -- 172.21.15.55:0/3106816394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f15cc066c90 con 0x7f15cc0ade90 2024-04-02T07:23:27.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.743+0000 7f15c2a00640 1 -- 172.21.15.55:0/3106816394 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f15bc054110 con 0x7f15cc0ade90 2024-04-02T07:23:27.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.747+0000 7f15d0e00640 1 -- 172.21.15.55:0/3106816394 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f15a8066690 msgr2=0x7f15a8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:27.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.747+0000 7f15d0e00640 1 --2- 172.21.15.55:0/3106816394 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f15a8066690 0x7f15a8068b50 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f15cc0acee0 tx=0x7f15b4009190 comp rx=0 tx=0).stop 2024-04-02T07:23:27.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.747+0000 7f15d0e00640 1 -- 172.21.15.55:0/3106816394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15cc0ade90 msgr2=0x7f15cc138fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:27.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.747+0000 7f15d0e00640 1 --2- 172.21.15.55:0/3106816394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15cc0ade90 0x7f15cc138fd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f15bc00c500 tx=0x7f15bc00c9c0 comp rx=0 tx=0).stop 2024-04-02T07:23:27.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.747+0000 7f15d0e00640 1 -- 172.21.15.55:0/3106816394 shutdown_connections 2024-04-02T07:23:27.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.747+0000 7f15d0e00640 1 --2- 172.21.15.55:0/3106816394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f15cc0b41a0 0x7f15cc160ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:27.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.747+0000 7f15d0e00640 1 --2- 172.21.15.55:0/3106816394 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f15a8066690 0x7f15a8068b50 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:27.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.747+0000 7f15d0e00640 1 --2- 172.21.15.55:0/3106816394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f15cc0b3dc0 0x7f15cc140720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:27.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.747+0000 7f15d0e00640 1 --2- 172.21.15.55:0/3106816394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f15cc0ade90 0x7f15cc138fd0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:27.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.747+0000 7f15d0e00640 1 -- 172.21.15.55:0/3106816394 >> 172.21.15.55:0/3106816394 conn(0x7f15cc06a390 msgr2=0x7f15cc0b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:27.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.747+0000 7f15d0e00640 1 -- 172.21.15.55:0/3106816394 shutdown_connections 2024-04-02T07:23:27.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.747+0000 7f15d0e00640 1 -- 172.21.15.55:0/3106816394 wait complete. 2024-04-02T07:23:27.772 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-02T07:23:27.773 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-02T07:23:27.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.919+0000 7f4868200640 1 Processor -- start 2024-04-02T07:23:27.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.919+0000 7f4868200640 1 -- start start 2024-04-02T07:23:27.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.919+0000 7f4868200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4860144260 0x7f48600702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:27.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.919+0000 7f4868200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f48600707e0 0x7f48600b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:27.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.919+0000 7f4868200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4860070c90 con 0x7f48600b2fd0 2024-04-02T07:23:27.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.919+0000 7f4868200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48600b37c0 con 0x7f4860144260 2024-04-02T07:23:27.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.919+0000 7f4868200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f486015e3a0 con 0x7f48600707e0 2024-04-02T07:23:27.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.919+0000 7f4865800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4860144260 0x7f48600702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:27.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.919+0000 7f4865800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4860144260 0x7f48600702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45584/0 (socket says 172.21.15.55:45584) 2024-04-02T07:23:27.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.919+0000 7f4865800640 1 -- 172.21.15.55:0/3114119971 learned_addr learned my addr 172.21.15.55:0/3114119971 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:27.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.919+0000 7f4866200640 1 --1- 172.21.15.55:0/3114119971 >> v1:172.21.15.55:6789/0 conn(0x7f48600b2fd0 0x7f48600cc4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46258/0 (socket says 172.21.15.55:46258) 2024-04-02T07:23:27.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.919+0000 7f4864e00640 1 --2- 172.21.15.55:0/3114119971 >> v2:172.21.15.106:3300/0 conn(0x7f48600707e0 0x7f48600b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:27.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.919+0000 7f4865800640 1 -- 172.21.15.55:0/3114119971 >> v2:172.21.15.106:3300/0 conn(0x7f48600707e0 msgr2=0x7f48600b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:27.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.919+0000 7f4865800640 1 --2- 172.21.15.55:0/3114119971 >> v2:172.21.15.106:3300/0 conn(0x7f48600707e0 0x7f48600b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:27.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.919+0000 7f4865800640 1 -- 172.21.15.55:0/3114119971 >> v1:172.21.15.55:6789/0 conn(0x7f48600b2fd0 legacy=0x7f48600cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:27.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.919+0000 7f4865800640 1 -- 172.21.15.55:0/3114119971 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f486015e5f0 con 0x7f4860144260 2024-04-02T07:23:27.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.923+0000 7f4865800640 1 --2- 172.21.15.55:0/3114119971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4860144260 0x7f48600702a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f48600b1410 tx=0x7f485401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f1f4c4b631a155 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:27.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.923+0000 7f485fe00640 1 -- 172.21.15.55:0/3114119971 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48540ab600 con 0x7f4860144260 2024-04-02T07:23:27.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.923+0000 7f485fe00640 1 -- 172.21.15.55:0/3114119971 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48540a7050 con 0x7f4860144260 2024-04-02T07:23:27.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.923+0000 7f485fe00640 1 -- 172.21.15.55:0/3114119971 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48540ab980 con 0x7f4860144260 2024-04-02T07:23:27.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.923+0000 7f4868200640 1 -- 172.21.15.55:0/3114119971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4860144260 msgr2=0x7f48600702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:27.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.923+0000 7f4868200640 1 --2- 172.21.15.55:0/3114119971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4860144260 0x7f48600702a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f48600b1410 tx=0x7f485401c520 comp rx=0 tx=0).stop 2024-04-02T07:23:27.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.923+0000 7f4868200640 1 -- 172.21.15.55:0/3114119971 shutdown_connections 2024-04-02T07:23:27.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.923+0000 7f4868200640 1 --2- 172.21.15.55:0/3114119971 >> v2:172.21.15.106:3300/0 conn(0x7f48600707e0 0x7f48600b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:27.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.923+0000 7f4868200640 1 --2- 172.21.15.55:0/3114119971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4860144260 0x7f48600702a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:27.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.923+0000 7f4868200640 1 -- 172.21.15.55:0/3114119971 >> 172.21.15.55:0/3114119971 conn(0x7f486006a390 msgr2=0x7f48600b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:27.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.923+0000 7f4868200640 1 -- 172.21.15.55:0/3114119971 shutdown_connections 2024-04-02T07:23:27.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.923+0000 7f4868200640 1 -- 172.21.15.55:0/3114119971 wait complete. 2024-04-02T07:23:27.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4868200640 1 Processor -- start 2024-04-02T07:23:27.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4868200640 1 -- start start 2024-04-02T07:23:27.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4868200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48600707e0 0x7f4860142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:27.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4868200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48600b2fd0 0x7f4860155fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:27.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4868200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4860144260 0x7f4860154230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:27.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4868200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48601406c0 con 0x7f48600b2fd0 2024-04-02T07:23:27.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4868200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f486013a6e0 con 0x7f4860144260 2024-04-02T07:23:27.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4868200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4860140910 con 0x7f48600707e0 2024-04-02T07:23:27.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4864e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48600b2fd0 0x7f4860155fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:27.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4864e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48600b2fd0 0x7f4860155fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45586/0 (socket says 172.21.15.55:45586) 2024-04-02T07:23:27.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4864e00640 1 -- 172.21.15.55:0/4239516400 learned_addr learned my addr 172.21.15.55:0/4239516400 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:27.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4865800640 1 --2- 172.21.15.55:0/4239516400 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48600707e0 0x7f4860142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:27.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4866200640 1 --2- 172.21.15.55:0/4239516400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4860144260 0x7f4860154230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:27.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4864e00640 1 -- 172.21.15.55:0/4239516400 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48600707e0 msgr2=0x7f4860142ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:27.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4864e00640 1 --2- 172.21.15.55:0/4239516400 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48600707e0 0x7f4860142ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:27.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4864e00640 1 -- 172.21.15.55:0/4239516400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4860144260 msgr2=0x7f4860154230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:27.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4864e00640 1 --2- 172.21.15.55:0/4239516400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4860144260 0x7f4860154230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:27.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4864e00640 1 -- 172.21.15.55:0/4239516400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48540094d0 con 0x7f48600b2fd0 2024-04-02T07:23:27.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4864e00640 1 --2- 172.21.15.55:0/4239516400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48600b2fd0 0x7f4860155fd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f484c00d800 tx=0x7f484c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:27.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f485d600640 1 -- 172.21.15.55:0/4239516400 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c00b6c0 con 0x7f48600b2fd0 2024-04-02T07:23:27.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f485d600640 1 -- 172.21.15.55:0/4239516400 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484c00b820 con 0x7f48600b2fd0 2024-04-02T07:23:27.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f485d600640 1 -- 172.21.15.55:0/4239516400 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c00bb90 con 0x7f48600b2fd0 2024-04-02T07:23:27.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4868200640 1 -- 172.21.15.55:0/4239516400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4860140bf0 con 0x7f48600b2fd0 2024-04-02T07:23:27.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4868200640 1 -- 172.21.15.55:0/4239516400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48601411b0 con 0x7f48600b2fd0 2024-04-02T07:23:27.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.927+0000 7f4868200640 1 -- 172.21.15.55:0/4239516400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4860141370 con 0x7f48600b2fd0 2024-04-02T07:23:27.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.931+0000 7f485d600640 1 -- 172.21.15.55:0/4239516400 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f484c00bcf0 con 0x7f48600b2fd0 2024-04-02T07:23:27.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.931+0000 7f485d600640 1 --2- 172.21.15.55:0/4239516400 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4840066690 0x7f4840068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:27.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.931+0000 7f485d600640 1 -- 172.21.15.55:0/4239516400 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f484c0845c0 con 0x7f48600b2fd0 2024-04-02T07:23:27.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.931+0000 7f4865800640 1 --2- 172.21.15.55:0/4239516400 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4840066690 0x7f4840068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:27.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.931+0000 7f4865800640 1 --2- 172.21.15.55:0/4239516400 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4840066690 0x7f4840068b50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f48540ad000 tx=0x7f48540a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:27.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:27.935+0000 7f485d600640 1 -- 172.21.15.55:0/4239516400 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f484c0519d0 con 0x7f48600b2fd0 2024-04-02T07:23:28.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:28.127+0000 7f4868200640 1 -- 172.21.15.55:0/4239516400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4860073530 con 0x7f48600b2fd0 2024-04-02T07:23:29.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.055+0000 7f485d600640 1 -- 172.21.15.55:0/4239516400 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f484c054ff0 con 0x7f48600b2fd0 2024-04-02T07:23:29.060 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-04-02T07:23:29.059+0000 7fb56f200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:23:29.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.059+0000 7f4868200640 1 -- 172.21.15.55:0/4239516400 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4840066690 msgr2=0x7f4840068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:29.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.059+0000 7f4868200640 1 --2- 172.21.15.55:0/4239516400 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4840066690 0x7f4840068b50 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f48540ad000 tx=0x7f48540a6000 comp rx=0 tx=0).stop 2024-04-02T07:23:29.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.059+0000 7f4868200640 1 -- 172.21.15.55:0/4239516400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48600b2fd0 msgr2=0x7f4860155fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:29.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.059+0000 7f4868200640 1 --2- 172.21.15.55:0/4239516400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48600b2fd0 0x7f4860155fd0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f484c00d800 tx=0x7f484c00dcc0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.059+0000 7f4868200640 1 -- 172.21.15.55:0/4239516400 shutdown_connections 2024-04-02T07:23:29.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.059+0000 7f4868200640 1 --2- 172.21.15.55:0/4239516400 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4840066690 0x7f4840068b50 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.059+0000 7f4868200640 1 --2- 172.21.15.55:0/4239516400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4860144260 0x7f4860154230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.059+0000 7f4868200640 1 --2- 172.21.15.55:0/4239516400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f48600b2fd0 0x7f4860155fd0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.059+0000 7f4868200640 1 --2- 172.21.15.55:0/4239516400 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f48600707e0 0x7f4860142ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.059+0000 7f4868200640 1 -- 172.21.15.55:0/4239516400 >> 172.21.15.55:0/4239516400 conn(0x7f486006a390 msgr2=0x7f486006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:29.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.059+0000 7f4868200640 1 -- 172.21.15.55:0/4239516400 shutdown_connections 2024-04-02T07:23:29.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.059+0000 7f4868200640 1 -- 172.21.15.55:0/4239516400 wait complete. 2024-04-02T07:23:29.084 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-02T07:23:29.084 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:23:29.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.227+0000 7f1506800640 1 Processor -- start 2024-04-02T07:23:29.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.227+0000 7f1506800640 1 -- start start 2024-04-02T07:23:29.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.227+0000 7f1506800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f150015a8b0 0x7f15000cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:29.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.227+0000 7f1506800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f150015ac90 0x7f1500071c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:29.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.227+0000 7f1506800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f150006ec30 con 0x7f1500072150 2024-04-02T07:23:29.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.227+0000 7f1506800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15000717a0 con 0x7f150015ac90 2024-04-02T07:23:29.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.227+0000 7f1506800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f150006ef10 con 0x7f150015a8b0 2024-04-02T07:23:29.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.227+0000 7f14f6a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f150015ac90 0x7f1500071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:29.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.227+0000 7f14f6a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f150015ac90 0x7f1500071c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45592/0 (socket says 172.21.15.55:45592) 2024-04-02T07:23:29.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.227+0000 7f14f6a00640 1 -- 172.21.15.55:0/2655314103 learned_addr learned my addr 172.21.15.55:0/2655314103 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:29.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.227+0000 7f14ff400640 1 --2- 172.21.15.55:0/2655314103 >> v2:172.21.15.106:3300/0 conn(0x7f150015a8b0 0x7f15000cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:29.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.227+0000 7f14f6a00640 1 -- 172.21.15.55:0/2655314103 >> v2:172.21.15.106:3300/0 conn(0x7f150015a8b0 msgr2=0x7f15000cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:29.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.227+0000 7f14f6a00640 1 --2- 172.21.15.55:0/2655314103 >> v2:172.21.15.106:3300/0 conn(0x7f150015a8b0 0x7f15000cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.227+0000 7f14f6a00640 1 -- 172.21.15.55:0/2655314103 >> v1:172.21.15.106:6789/0 conn(0x7f1500072150 legacy=0x7f1500069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:29.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.227+0000 7f14f6a00640 1 -- 172.21.15.55:0/2655314103 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f150006f1f0 con 0x7f150015ac90 2024-04-02T07:23:29.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.227+0000 7f14fea00640 1 -- 172.21.15.55:0/2655314103 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198035954 0 0) 0x7f150006ec30 con 0x7f1500072150 2024-04-02T07:23:29.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.231+0000 7f14f6a00640 1 --2- 172.21.15.55:0/2655314103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150015ac90 0x7f1500071c10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f150006e510 tx=0x7f14e801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f7f4e9640041cf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:29.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.231+0000 7f14fea00640 1 -- 172.21.15.55:0/2655314103 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e80ab660 con 0x7f150015ac90 2024-04-02T07:23:29.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.231+0000 7f14fea00640 1 -- 172.21.15.55:0/2655314103 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e80ab7c0 con 0x7f150015ac90 2024-04-02T07:23:29.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.231+0000 7f14fea00640 1 -- 172.21.15.55:0/2655314103 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e80abb50 con 0x7f150015ac90 2024-04-02T07:23:29.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.231+0000 7f1506800640 1 -- 172.21.15.55:0/2655314103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150015ac90 msgr2=0x7f1500071c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:29.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.231+0000 7f1506800640 1 --2- 172.21.15.55:0/2655314103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150015ac90 0x7f1500071c10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f150006e510 tx=0x7f14e801c460 comp rx=0 tx=0).stop 2024-04-02T07:23:29.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.231+0000 7f1506800640 1 -- 172.21.15.55:0/2655314103 shutdown_connections 2024-04-02T07:23:29.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.231+0000 7f1506800640 1 --2- 172.21.15.55:0/2655314103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150015ac90 0x7f1500071c10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.231+0000 7f1506800640 1 --2- 172.21.15.55:0/2655314103 >> v2:172.21.15.106:3300/0 conn(0x7f150015a8b0 0x7f15000cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.231+0000 7f1506800640 1 -- 172.21.15.55:0/2655314103 >> 172.21.15.55:0/2655314103 conn(0x7f15000b13b0 msgr2=0x7f15000b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:29.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.231+0000 7f1506800640 1 -- 172.21.15.55:0/2655314103 shutdown_connections 2024-04-02T07:23:29.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.231+0000 7f1506800640 1 -- 172.21.15.55:0/2655314103 wait complete. 2024-04-02T07:23:29.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f1506800640 1 Processor -- start 2024-04-02T07:23:29.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f1506800640 1 -- start start 2024-04-02T07:23:29.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f1506800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1500072150 0x7f15000ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:29.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f1506800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f150015a8b0 0x7f1500152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:29.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f1506800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150015ac90 0x7f150015ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:29.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f1506800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1500151c70 con 0x7f150015ac90 2024-04-02T07:23:29.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f1506800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1500153aa0 con 0x7f150015a8b0 2024-04-02T07:23:29.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f1506800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15000cd4e0 con 0x7f1500072150 2024-04-02T07:23:29.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f14ffe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150015ac90 0x7f150015ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:29.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f14ffe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150015ac90 0x7f150015ceb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45596/0 (socket says 172.21.15.55:45596) 2024-04-02T07:23:29.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f14ffe00640 1 -- 172.21.15.55:0/1750456885 learned_addr learned my addr 172.21.15.55:0/1750456885 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:29.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f14ff400640 1 --2- 172.21.15.55:0/1750456885 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1500072150 0x7f15000ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:29.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f14f6a00640 1 --2- 172.21.15.55:0/1750456885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f150015a8b0 0x7f1500152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f14ffe00640 1 -- 172.21.15.55:0/1750456885 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1500072150 msgr2=0x7f15000ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f14ffe00640 1 --2- 172.21.15.55:0/1750456885 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1500072150 0x7f15000ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f14ffe00640 1 -- 172.21.15.55:0/1750456885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f150015a8b0 msgr2=0x7f1500152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f14ffe00640 1 --2- 172.21.15.55:0/1750456885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f150015a8b0 0x7f1500152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f14ffe00640 1 -- 172.21.15.55:0/1750456885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e80094d0 con 0x7f150015ac90 2024-04-02T07:23:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f14ffe00640 1 --2- 172.21.15.55:0/1750456885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150015ac90 0x7f150015ceb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f14f8001570 tx=0x7f14f800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f14f7e00640 1 -- 172.21.15.55:0/1750456885 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f8003db0 con 0x7f150015ac90 2024-04-02T07:23:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f14f7e00640 1 -- 172.21.15.55:0/1750456885 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14f8005070 con 0x7f150015ac90 2024-04-02T07:23:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f1506800640 1 -- 172.21.15.55:0/1750456885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15001537c0 con 0x7f150015ac90 2024-04-02T07:23:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f14f7e00640 1 -- 172.21.15.55:0/1750456885 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14f8005420 con 0x7f150015ac90 2024-04-02T07:23:29.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.235+0000 7f1506800640 1 -- 172.21.15.55:0/1750456885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1500152180 con 0x7f150015ac90 2024-04-02T07:23:29.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.239+0000 7f1506800640 1 -- 172.21.15.55:0/1750456885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1500066c90 con 0x7f150015ac90 2024-04-02T07:23:29.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.239+0000 7f14f7e00640 1 -- 172.21.15.55:0/1750456885 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f14f8005580 con 0x7f150015ac90 2024-04-02T07:23:29.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.239+0000 7f14f7e00640 1 --2- 172.21.15.55:0/1750456885 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f14dc066690 0x7f14dc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:29.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.239+0000 7f14f7e00640 1 -- 172.21.15.55:0/1750456885 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14f8083a90 con 0x7f150015ac90 2024-04-02T07:23:29.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.239+0000 7f14ff400640 1 --2- 172.21.15.55:0/1750456885 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f14dc066690 0x7f14dc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:29.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.239+0000 7f14ff400640 1 --2- 172.21.15.55:0/1750456885 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f14dc066690 0x7f14dc068b50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009b60 tx=0x7f14f0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:29.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.243+0000 7f14f7e00640 1 -- 172.21.15.55:0/1750456885 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f14f8050e10 con 0x7f150015ac90 2024-04-02T07:23:29.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.439+0000 7f1506800640 1 -- 172.21.15.55:0/1750456885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f15000b0c30 con 0x7f150015ac90 2024-04-02T07:23:29.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.439+0000 7f14f7e00640 1 -- 172.21.15.55:0/1750456885 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4725 (secure 0 0 0) 0x7f14f8017070 con 0x7f150015ac90 2024-04-02T07:23:29.441 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:29.442 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4883,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53106343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53106343},{"type":"v1","addr":"172.21.15.55:6833","nonce":53106343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/44669622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":44669622},{"type":"v1","addr":"172.21.15.106:6837","nonce":44669622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/741637637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":741637637},{"type":"v1","addr":"172.21.15.106:6836","nonce":741637637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:23:25.727369+0000","modified":"2024-04-02T07:23:29.049370+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/2440784960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2440784960},{"type":"v1","addr":"172.21.15.55:6835","nonce":2440784960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-02T07:23:29.442 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 17 2024-04-02T07:23:29.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.439+0000 7f1506800640 1 -- 172.21.15.55:0/1750456885 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f14dc066690 msgr2=0x7f14dc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:29.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.439+0000 7f1506800640 1 --2- 172.21.15.55:0/1750456885 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f14dc066690 0x7f14dc068b50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f14f0009b60 tx=0x7f14f0009190 comp rx=0 tx=0).stop 2024-04-02T07:23:29.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.439+0000 7f1506800640 1 -- 172.21.15.55:0/1750456885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150015ac90 msgr2=0x7f150015ceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:29.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.439+0000 7f1506800640 1 --2- 172.21.15.55:0/1750456885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150015ac90 0x7f150015ceb0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f14f8001570 tx=0x7f14f800cd20 comp rx=0 tx=0).stop 2024-04-02T07:23:29.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.439+0000 7f1506800640 1 -- 172.21.15.55:0/1750456885 shutdown_connections 2024-04-02T07:23:29.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.439+0000 7f1506800640 1 --2- 172.21.15.55:0/1750456885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f150015ac90 0x7f150015ceb0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.439+0000 7f1506800640 1 --2- 172.21.15.55:0/1750456885 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f14dc066690 0x7f14dc068b50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.439+0000 7f1506800640 1 --2- 172.21.15.55:0/1750456885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f150015a8b0 0x7f1500152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.439+0000 7f1506800640 1 --2- 172.21.15.55:0/1750456885 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1500072150 0x7f15000ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.439+0000 7f1506800640 1 -- 172.21.15.55:0/1750456885 >> 172.21.15.55:0/1750456885 conn(0x7f15000b13b0 msgr2=0x7f15000b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:29.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.439+0000 7f1506800640 1 -- 172.21.15.55:0/1750456885 shutdown_connections 2024-04-02T07:23:29.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.439+0000 7f1506800640 1 -- 172.21.15.55:0/1750456885 wait complete. 2024-04-02T07:23:29.463 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:23:29.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.599+0000 7f7cff000640 1 Processor -- start 2024-04-02T07:23:29.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.599+0000 7f7cff000640 1 -- start start 2024-04-02T07:23:29.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.599+0000 7f7cff000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7cf80c4120 0x7f7cf80b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:29.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.599+0000 7f7cff000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7cf80b36f0 0x7f7cf813d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:29.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.599+0000 7f7cff000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf813d0c0 con 0x7f7cf8153ea0 2024-04-02T07:23:29.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.599+0000 7f7cff000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf80c4580 con 0x7f7cf80b36f0 2024-04-02T07:23:29.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.599+0000 7f7cff000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf815a2f0 con 0x7f7cf80c4120 2024-04-02T07:23:29.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.603+0000 7f7cfd000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7cf80b36f0 0x7f7cf813d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:29.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.603+0000 7f7cf7e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7cf8153ea0 0x7f7cf8159be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46270/0 (socket says 172.21.15.55:46270) 2024-04-02T07:23:29.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.603+0000 7f7cf7e00640 1 -- 172.21.15.55:0/3554366019 learned_addr learned my addr 172.21.15.55:0/3554366019 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:29.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.603+0000 7f7cf7400640 1 --2- 172.21.15.55:0/3554366019 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7cf80c4120 0x7f7cf80b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:29.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.603+0000 7f7cfd000640 1 -- 172.21.15.55:0/3554366019 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7cf80c4120 msgr2=0x7f7cf80b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:29.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.603+0000 7f7cfd000640 1 --2- 172.21.15.55:0/3554366019 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7cf80c4120 0x7f7cf80b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.603+0000 7f7cfd000640 1 -- 172.21.15.55:0/3554366019 >> v1:172.21.15.55:6789/0 conn(0x7f7cf8153ea0 legacy=0x7f7cf8159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:29.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.603+0000 7f7cfd000640 1 -- 172.21.15.55:0/3554366019 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf815a4f0 con 0x7f7cf80b36f0 2024-04-02T07:23:29.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.603+0000 7f7cf6a00640 1 -- 172.21.15.55:0/3554366019 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2863772540 0 0) 0x7f7cf813d0c0 con 0x7f7cf8153ea0 2024-04-02T07:23:29.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.603+0000 7f7cfd000640 1 --2- 172.21.15.55:0/3554366019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf80b36f0 0x7f7cf813d550 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009d90 tx=0x7f7cf001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20dee4e48f8fbc91 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:29.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.603+0000 7f7cf6a00640 1 -- 172.21.15.55:0/3554366019 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00a5940 con 0x7f7cf80b36f0 2024-04-02T07:23:29.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.603+0000 7f7cf6a00640 1 -- 172.21.15.55:0/3554366019 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf00a5aa0 con 0x7f7cf80b36f0 2024-04-02T07:23:29.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.603+0000 7f7cf6a00640 1 -- 172.21.15.55:0/3554366019 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf00a5e30 con 0x7f7cf80b36f0 2024-04-02T07:23:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cff000640 1 -- 172.21.15.55:0/3554366019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf80b36f0 msgr2=0x7f7cf813d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:29.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cff000640 1 --2- 172.21.15.55:0/3554366019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf80b36f0 0x7f7cf813d550 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009d90 tx=0x7f7cf001c970 comp rx=0 tx=0).stop 2024-04-02T07:23:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cff000640 1 -- 172.21.15.55:0/3554366019 shutdown_connections 2024-04-02T07:23:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cff000640 1 --2- 172.21.15.55:0/3554366019 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7cf80c4120 0x7f7cf80b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cff000640 1 --2- 172.21.15.55:0/3554366019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf80b36f0 0x7f7cf813d550 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cff000640 1 -- 172.21.15.55:0/3554366019 >> 172.21.15.55:0/3554366019 conn(0x7f7cf8066080 msgr2=0x7f7cf8069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cff000640 1 -- 172.21.15.55:0/3554366019 shutdown_connections 2024-04-02T07:23:29.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cff000640 1 -- 172.21.15.55:0/3554366019 wait complete. 2024-04-02T07:23:29.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cff000640 1 Processor -- start 2024-04-02T07:23:29.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cff000640 1 -- start start 2024-04-02T07:23:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cff000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf80b36f0 0x7f7cf813f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cff000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cf80c4120 0x7f7cf813f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cff000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7cf8153ea0 0x7f7cf815b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cff000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf80cc550 con 0x7f7cf80b36f0 2024-04-02T07:23:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cff000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf80cb4b0 con 0x7f7cf80c4120 2024-04-02T07:23:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cff000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf80cb790 con 0x7f7cf8153ea0 2024-04-02T07:23:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cf7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf80b36f0 0x7f7cf813f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:29.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cf7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf80b36f0 0x7f7cf813f1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45620/0 (socket says 172.21.15.55:45620) 2024-04-02T07:23:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cf7e00640 1 -- 172.21.15.55:0/4167685976 learned_addr learned my addr 172.21.15.55:0/4167685976 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cf7400640 1 --2- 172.21.15.55:0/4167685976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cf80c4120 0x7f7cf813f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cfd000640 1 --2- 172.21.15.55:0/4167685976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7cf8153ea0 0x7f7cf815b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cf7e00640 1 -- 172.21.15.55:0/4167685976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7cf8153ea0 msgr2=0x7f7cf815b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cf7e00640 1 --2- 172.21.15.55:0/4167685976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7cf8153ea0 0x7f7cf815b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cf7e00640 1 -- 172.21.15.55:0/4167685976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cf80c4120 msgr2=0x7f7cf813f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cf7e00640 1 --2- 172.21.15.55:0/4167685976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cf80c4120 0x7f7cf813f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.607+0000 7f7cf7e00640 1 -- 172.21.15.55:0/4167685976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf0009a70 con 0x7f7cf80b36f0 2024-04-02T07:23:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.611+0000 7f7cf7e00640 1 --2- 172.21.15.55:0/4167685976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf80b36f0 0x7f7cf813f1d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800c480 tx=0x7f7ce800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.611+0000 7f7cefe00640 1 -- 172.21.15.55:0/4167685976 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce80074e0 con 0x7f7cf80b36f0 2024-04-02T07:23:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.611+0000 7f7cefe00640 1 -- 172.21.15.55:0/4167685976 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce8007660 con 0x7f7cf80b36f0 2024-04-02T07:23:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.611+0000 7f7cefe00640 1 -- 172.21.15.55:0/4167685976 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8004a30 con 0x7f7cf80b36f0 2024-04-02T07:23:29.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.611+0000 7f7cff000640 1 -- 172.21.15.55:0/4167685976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf80cba70 con 0x7f7cf80b36f0 2024-04-02T07:23:29.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.611+0000 7f7cff000640 1 -- 172.21.15.55:0/4167685976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf80cc030 con 0x7f7cf80b36f0 2024-04-02T07:23:29.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.611+0000 7f7cff000640 1 -- 172.21.15.55:0/4167685976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf8066c90 con 0x7f7cf80b36f0 2024-04-02T07:23:29.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.611+0000 7f7cefe00640 1 -- 172.21.15.55:0/4167685976 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7ce8004b90 con 0x7f7cf80b36f0 2024-04-02T07:23:29.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.611+0000 7f7cefe00640 1 --2- 172.21.15.55:0/4167685976 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7cd8066690 0x7f7cd8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:29.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.611+0000 7f7cefe00640 1 -- 172.21.15.55:0/4167685976 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ce8083340 con 0x7f7cf80b36f0 2024-04-02T07:23:29.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.611+0000 7f7cf7400640 1 --2- 172.21.15.55:0/4167685976 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7cd8066690 0x7f7cd8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:29.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.615+0000 7f7cf7400640 1 --2- 172.21.15.55:0/4167685976 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7cd8066690 0x7f7cd8068b50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7cf81641e0 tx=0x7f7ce4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:29.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.615+0000 7f7cefe00640 1 -- 172.21.15.55:0/4167685976 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7ce8054150 con 0x7f7cf80b36f0 2024-04-02T07:23:29.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.779+0000 7f7cff000640 1 -- 172.21.15.55:0/4167685976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cf806b3d0 con 0x7f7cf80b36f0 2024-04-02T07:23:29.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.779+0000 7f7cefe00640 1 -- 172.21.15.55:0/4167685976 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16101 (secure 0 0 0) 0x7f7ce8053ce0 con 0x7f7cf80b36f0 2024-04-02T07:23:29.783 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:29.784 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":34,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:23:26.730146+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:23:23.729158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-02T07:23:24.740958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:23:29.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.783+0000 7f7cff000640 1 -- 172.21.15.55:0/4167685976 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7cd8066690 msgr2=0x7f7cd8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:29.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.783+0000 7f7cff000640 1 --2- 172.21.15.55:0/4167685976 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7cd8066690 0x7f7cd8068b50 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f7cf81641e0 tx=0x7f7ce4008040 comp rx=0 tx=0).stop 2024-04-02T07:23:29.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.783+0000 7f7cff000640 1 -- 172.21.15.55:0/4167685976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf80b36f0 msgr2=0x7f7cf813f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:29.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.783+0000 7f7cff000640 1 --2- 172.21.15.55:0/4167685976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf80b36f0 0x7f7cf813f1d0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f7ce800c480 tx=0x7f7ce800c940 comp rx=0 tx=0).stop 2024-04-02T07:23:29.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.783+0000 7f7cff000640 1 -- 172.21.15.55:0/4167685976 shutdown_connections 2024-04-02T07:23:29.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.783+0000 7f7cff000640 1 --2- 172.21.15.55:0/4167685976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7cf8153ea0 0x7f7cf815b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.783+0000 7f7cff000640 1 --2- 172.21.15.55:0/4167685976 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7cd8066690 0x7f7cd8068b50 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.783+0000 7f7cff000640 1 --2- 172.21.15.55:0/4167685976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cf80c4120 0x7f7cf813f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.783+0000 7f7cff000640 1 --2- 172.21.15.55:0/4167685976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf80b36f0 0x7f7cf813f1d0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.783+0000 7f7cff000640 1 -- 172.21.15.55:0/4167685976 >> 172.21.15.55:0/4167685976 conn(0x7f7cf8066080 msgr2=0x7f7cf8069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:29.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.783+0000 7f7cff000640 1 -- 172.21.15.55:0/4167685976 shutdown_connections 2024-04-02T07:23:29.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.783+0000 7f7cff000640 1 -- 172.21.15.55:0/4167685976 wait complete. 2024-04-02T07:23:29.805 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-02T07:23:29.806 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:23:29.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.943+0000 7f2f33000640 1 Processor -- start 2024-04-02T07:23:29.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.943+0000 7f2f33000640 1 -- start start 2024-04-02T07:23:29.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.943+0000 7f2f33000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2f2c147a00 0x7f2f2c0afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:29.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.943+0000 7f2f33000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f2c0b01c0 0x7f2f2c0b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:29.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.943+0000 7f2f33000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2c0ce340 con 0x7f2f2c146fa0 2024-04-02T07:23:29.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.943+0000 7f2f33000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f2c0b0650 con 0x7f2f2c147a00 2024-04-02T07:23:29.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.943+0000 7f2f33000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c164be0 con 0x7f2f2c0b01c0 2024-04-02T07:23:29.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.943+0000 7f2f23e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2f2c147a00 0x7f2f2c0afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:29.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.943+0000 7f2f31000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f2c0b01c0 0x7f2f2c0b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:29.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.947+0000 7f2f23e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2f2c147a00 0x7f2f2c0afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:35506/0 (socket says 172.21.15.55:35506) 2024-04-02T07:23:29.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.947+0000 7f2f23e00640 1 -- 172.21.15.55:0/1208414400 learned_addr learned my addr 172.21.15.55:0/1208414400 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:29.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.947+0000 7f2f23e00640 1 -- 172.21.15.55:0/1208414400 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f2c0b01c0 msgr2=0x7f2f2c0b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:29.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.947+0000 7f2f23e00640 1 --2- 172.21.15.55:0/1208414400 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f2c0b01c0 0x7f2f2c0b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.947+0000 7f2f23e00640 1 -- 172.21.15.55:0/1208414400 >> v1:172.21.15.106:6789/0 conn(0x7f2f2c146fa0 legacy=0x7f2f2c14a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:29.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.947+0000 7f2f23e00640 1 -- 172.21.15.55:0/1208414400 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f2c164ec0 con 0x7f2f2c147a00 2024-04-02T07:23:29.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.947+0000 7f2f23e00640 1 --2- 172.21.15.55:0/1208414400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f2c147a00 0x7f2f2c0afc80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009870 tx=0x7f2f1401c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d4d865a04291ecb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:29.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.947+0000 7f2f2b400640 1 -- 172.21.15.55:0/1208414400 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f140a95f0 con 0x7f2f2c147a00 2024-04-02T07:23:29.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.947+0000 7f2f2b400640 1 -- 172.21.15.55:0/1208414400 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f140a9750 con 0x7f2f2c147a00 2024-04-02T07:23:29.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.947+0000 7f2f2b400640 1 -- 172.21.15.55:0/1208414400 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f140a9ae0 con 0x7f2f2c147a00 2024-04-02T07:23:29.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f33000640 1 -- 172.21.15.55:0/1208414400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f2c147a00 msgr2=0x7f2f2c0afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:29.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f33000640 1 --2- 172.21.15.55:0/1208414400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f2c147a00 0x7f2f2c0afc80 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2f14009870 tx=0x7f2f1401c530 comp rx=0 tx=0).stop 2024-04-02T07:23:29.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f33000640 1 -- 172.21.15.55:0/1208414400 shutdown_connections 2024-04-02T07:23:29.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f33000640 1 --2- 172.21.15.55:0/1208414400 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f2c0b01c0 0x7f2f2c0b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f33000640 1 --2- 172.21.15.55:0/1208414400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f2c147a00 0x7f2f2c0afc80 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f33000640 1 -- 172.21.15.55:0/1208414400 >> 172.21.15.55:0/1208414400 conn(0x7f2f2c066080 msgr2=0x7f2f2c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:29.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f33000640 1 -- 172.21.15.55:0/1208414400 shutdown_connections 2024-04-02T07:23:29.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f33000640 1 -- 172.21.15.55:0/1208414400 wait complete. 2024-04-02T07:23:29.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f33000640 1 Processor -- start 2024-04-02T07:23:29.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f33000640 1 -- start start 2024-04-02T07:23:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f33000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f2c0b01c0 0x7f2f2c140320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f33000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f2c146fa0 0x7f2f2c1fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f33000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f2c147a00 0x7f2f2c144cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f33000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c1fd700 con 0x7f2f2c0b01c0 2024-04-02T07:23:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f33000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c15eaa0 con 0x7f2f2c147a00 2024-04-02T07:23:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f33000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f2c136720 con 0x7f2f2c146fa0 2024-04-02T07:23:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f2be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f2c0b01c0 0x7f2f2c140320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f2be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f2c0b01c0 0x7f2f2c140320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45626/0 (socket says 172.21.15.55:45626) 2024-04-02T07:23:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f2be00640 1 -- 172.21.15.55:0/1600861477 learned_addr learned my addr 172.21.15.55:0/1600861477 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f31000640 1 --2- 172.21.15.55:0/1600861477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f2c147a00 0x7f2f2c144cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.951+0000 7f2f23e00640 1 --2- 172.21.15.55:0/1600861477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f2c146fa0 0x7f2f2c1fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.955+0000 7f2f2be00640 1 -- 172.21.15.55:0/1600861477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f2c146fa0 msgr2=0x7f2f2c1fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:29.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.955+0000 7f2f2be00640 1 --2- 172.21.15.55:0/1600861477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f2c146fa0 0x7f2f2c1fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.955+0000 7f2f2be00640 1 -- 172.21.15.55:0/1600861477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f2c147a00 msgr2=0x7f2f2c144cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:29.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.955+0000 7f2f2be00640 1 --2- 172.21.15.55:0/1600861477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f2c147a00 0x7f2f2c144cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:29.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.955+0000 7f2f2be00640 1 -- 172.21.15.55:0/1600861477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f140094d0 con 0x7f2f2c0b01c0 2024-04-02T07:23:29.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.955+0000 7f2f2be00640 1 --2- 172.21.15.55:0/1600861477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f2c0b01c0 0x7f2f2c140320 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00c420 tx=0x7f2f1c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:29.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.955+0000 7f2f28c00640 1 -- 172.21.15.55:0/1600861477 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c0052d0 con 0x7f2f2c0b01c0 2024-04-02T07:23:29.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.955+0000 7f2f28c00640 1 -- 172.21.15.55:0/1600861477 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1c005430 con 0x7f2f2c0b01c0 2024-04-02T07:23:29.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.955+0000 7f2f28c00640 1 -- 172.21.15.55:0/1600861477 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c007260 con 0x7f2f2c0b01c0 2024-04-02T07:23:29.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.955+0000 7f2f33000640 1 -- 172.21.15.55:0/1600861477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f2c136a00 con 0x7f2f2c0b01c0 2024-04-02T07:23:29.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.955+0000 7f2f33000640 1 -- 172.21.15.55:0/1600861477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f2c136fc0 con 0x7f2f2c0b01c0 2024-04-02T07:23:29.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.955+0000 7f2f33000640 1 -- 172.21.15.55:0/1600861477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2c066c90 con 0x7f2f2c0b01c0 2024-04-02T07:23:29.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.955+0000 7f2f28c00640 1 -- 172.21.15.55:0/1600861477 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2f1c0073c0 con 0x7f2f2c0b01c0 2024-04-02T07:23:29.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.955+0000 7f2f28c00640 1 --2- 172.21.15.55:0/1600861477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2f08066690 0x7f2f08068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:29.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.955+0000 7f2f28c00640 1 -- 172.21.15.55:0/1600861477 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2f1c0834d0 con 0x7f2f2c0b01c0 2024-04-02T07:23:29.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.959+0000 7f2f23e00640 1 --2- 172.21.15.55:0/1600861477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2f08066690 0x7f2f08068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:29.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.959+0000 7f2f23e00640 1 --2- 172.21.15.55:0/1600861477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2f08066690 0x7f2f08068b50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2f140ae000 tx=0x7f2f140b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:29.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:29.959+0000 7f2f28c00640 1 -- 172.21.15.55:0/1600861477 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2f1c0508d0 con 0x7f2f2c0b01c0 2024-04-02T07:23:30.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.119+0000 7f2f33000640 1 -- 172.21.15.55:0/1600861477 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2f2c164870 con 0x7f2f08066690 2024-04-02T07:23:30.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.131+0000 7f2f28c00640 1 -- 172.21.15.55:0/1600861477 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288501 (secure 0 0 0) 0x7f2f140a98c0 con 0x7f2f08066690 2024-04-02T07:23:30.137 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:30.139 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:23:30.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.135+0000 7f2f33000640 1 -- 172.21.15.55:0/1600861477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2f08066690 msgr2=0x7f2f08068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:30.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.135+0000 7f2f33000640 1 --2- 172.21.15.55:0/1600861477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2f08066690 0x7f2f08068b50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f2f140ae000 tx=0x7f2f140b3040 comp rx=0 tx=0).stop 2024-04-02T07:23:30.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.135+0000 7f2f33000640 1 -- 172.21.15.55:0/1600861477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f2c0b01c0 msgr2=0x7f2f2c140320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:30.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.135+0000 7f2f33000640 1 --2- 172.21.15.55:0/1600861477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f2c0b01c0 0x7f2f2c140320 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00c420 tx=0x7f2f1c00c8e0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.135+0000 7f2f33000640 1 -- 172.21.15.55:0/1600861477 shutdown_connections 2024-04-02T07:23:30.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.135+0000 7f2f33000640 1 --2- 172.21.15.55:0/1600861477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2f08066690 0x7f2f08068b50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.135+0000 7f2f33000640 1 --2- 172.21.15.55:0/1600861477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f2c147a00 0x7f2f2c144cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.135+0000 7f2f33000640 1 --2- 172.21.15.55:0/1600861477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f2c146fa0 0x7f2f2c1fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.135+0000 7f2f33000640 1 --2- 172.21.15.55:0/1600861477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f2c0b01c0 0x7f2f2c140320 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.135+0000 7f2f33000640 1 -- 172.21.15.55:0/1600861477 >> 172.21.15.55:0/1600861477 conn(0x7f2f2c066080 msgr2=0x7f2f2c06cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:30.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.135+0000 7f2f33000640 1 -- 172.21.15.55:0/1600861477 shutdown_connections 2024-04-02T07:23:30.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.135+0000 7f2f33000640 1 -- 172.21.15.55:0/1600861477 wait complete. 2024-04-02T07:23:30.157 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2024-04-02T07:23:28.350534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236588,"kb_used_data":4028,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738132,"statfs":{"total":773094113280,"available":772851847168,"internally_reserved":0,"allocated":4124672,"data_stored":2312341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.029729"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.761229+0000","last_change":"2024-04-02T07:23:25.753884+0000","last_active":"2024-04-02T07:23:25.761229+0000","last_peered":"2024-04-02T07:23:25.761229+0000","last_clean":"2024-04-02T07:23:25.761229+0000","last_became_active":"2024-04-02T07:23:25.753645+0000","last_became_peered":"2024-04-02T07:23:25.753645+0000","last_unstale":"2024-04-02T07:23:25.761229+0000","last_undegraded":"2024-04-02T07:23:25.761229+0000","last_fullsized":"2024-04-02T07:23:25.761229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:37:42.173429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.760982+0000","last_change":"2024-04-02T07:23:25.759497+0000","last_active":"2024-04-02T07:23:25.760982+0000","last_peered":"2024-04-02T07:23:25.760982+0000","last_clean":"2024-04-02T07:23:25.760982+0000","last_became_active":"2024-04-02T07:23:25.759249+0000","last_became_peered":"2024-04-02T07:23:25.759249+0000","last_unstale":"2024-04-02T07:23:25.760982+0000","last_undegraded":"2024-04-02T07:23:25.760982+0000","last_fullsized":"2024-04-02T07:23:25.760982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:53:03.319419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.770854+0000","last_change":"2024-04-02T07:23:25.766731+0000","last_active":"2024-04-02T07:23:25.770854+0000","last_peered":"2024-04-02T07:23:25.770854+0000","last_clean":"2024-04-02T07:23:25.770854+0000","last_became_active":"2024-04-02T07:23:25.766410+0000","last_became_peered":"2024-04-02T07:23:25.766410+0000","last_unstale":"2024-04-02T07:23:25.770854+0000","last_undegraded":"2024-04-02T07:23:25.770854+0000","last_fullsized":"2024-04-02T07:23:25.770854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:55.563309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.771916+0000","last_change":"2024-04-02T07:23:25.765696+0000","last_active":"2024-04-02T07:23:25.771916+0000","last_peered":"2024-04-02T07:23:25.771916+0000","last_clean":"2024-04-02T07:23:25.771916+0000","last_became_active":"2024-04-02T07:23:25.765100+0000","last_became_peered":"2024-04-02T07:23:25.765100+0000","last_unstale":"2024-04-02T07:23:25.771916+0000","last_undegraded":"2024-04-02T07:23:25.771916+0000","last_fullsized":"2024-04-02T07:23:25.771916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:11:24.616677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.763263+0000","last_change":"2024-04-02T07:23:25.757414+0000","last_active":"2024-04-02T07:23:25.763263+0000","last_peered":"2024-04-02T07:23:25.763263+0000","last_clean":"2024-04-02T07:23:25.763263+0000","last_became_active":"2024-04-02T07:23:25.757167+0000","last_became_peered":"2024-04-02T07:23:25.757167+0000","last_unstale":"2024-04-02T07:23:25.763263+0000","last_undegraded":"2024-04-02T07:23:25.763263+0000","last_fullsized":"2024-04-02T07:23:25.763263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:48:02.771529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.756117+0000","last_change":"2024-04-02T07:23:25.749973+0000","last_active":"2024-04-02T07:23:25.756117+0000","last_peered":"2024-04-02T07:23:25.756117+0000","last_clean":"2024-04-02T07:23:25.756117+0000","last_became_active":"2024-04-02T07:23:25.749676+0000","last_became_peered":"2024-04-02T07:23:25.749676+0000","last_unstale":"2024-04-02T07:23:25.756117+0000","last_undegraded":"2024-04-02T07:23:25.756117+0000","last_fullsized":"2024-04-02T07:23:25.756117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:33:05.852503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.757164+0000","last_change":"2024-04-02T07:23:25.751120+0000","last_active":"2024-04-02T07:23:25.757164+0000","last_peered":"2024-04-02T07:23:25.757164+0000","last_clean":"2024-04-02T07:23:25.757164+0000","last_became_active":"2024-04-02T07:23:25.750841+0000","last_became_peered":"2024-04-02T07:23:25.750841+0000","last_unstale":"2024-04-02T07:23:25.757164+0000","last_undegraded":"2024-04-02T07:23:25.757164+0000","last_fullsized":"2024-04-02T07:23:25.757164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:33.264955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.762101+0000","last_change":"2024-04-02T07:23:25.756789+0000","last_active":"2024-04-02T07:23:25.762101+0000","last_peered":"2024-04-02T07:23:25.762101+0000","last_clean":"2024-04-02T07:23:25.762101+0000","last_became_active":"2024-04-02T07:23:25.756516+0000","last_became_peered":"2024-04-02T07:23:25.756516+0000","last_unstale":"2024-04-02T07:23:25.762101+0000","last_undegraded":"2024-04-02T07:23:25.762101+0000","last_fullsized":"2024-04-02T07:23:25.762101+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:33:05.852503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.765665+0000","last_change":"2024-04-02T07:23:25.761410+0000","last_active":"2024-04-02T07:23:25.765665+0000","last_peered":"2024-04-02T07:23:25.765665+0000","last_clean":"2024-04-02T07:23:25.765665+0000","last_became_active":"2024-04-02T07:23:25.761104+0000","last_became_peered":"2024-04-02T07:23:25.761104+0000","last_unstale":"2024-04-02T07:23:25.765665+0000","last_undegraded":"2024-04-02T07:23:25.765665+0000","last_fullsized":"2024-04-02T07:23:25.765665+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:33:06.242431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.774788+0000","last_change":"2024-04-02T07:23:25.771654+0000","last_active":"2024-04-02T07:23:25.774788+0000","last_peered":"2024-04-02T07:23:25.774788+0000","last_clean":"2024-04-02T07:23:25.774788+0000","last_became_active":"2024-04-02T07:23:25.771431+0000","last_became_peered":"2024-04-02T07:23:25.771431+0000","last_unstale":"2024-04-02T07:23:25.774788+0000","last_undegraded":"2024-04-02T07:23:25.774788+0000","last_fullsized":"2024-04-02T07:23:25.774788+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:01:05.258579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.773392+0000","last_change":"2024-04-02T07:23:25.769705+0000","last_active":"2024-04-02T07:23:25.773392+0000","last_peered":"2024-04-02T07:23:25.773392+0000","last_clean":"2024-04-02T07:23:25.773392+0000","last_became_active":"2024-04-02T07:23:25.769470+0000","last_became_peered":"2024-04-02T07:23:25.769470+0000","last_unstale":"2024-04-02T07:23:25.773392+0000","last_undegraded":"2024-04-02T07:23:25.773392+0000","last_fullsized":"2024-04-02T07:23:25.773392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:01:05.258579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.762426+0000","last_change":"2024-04-02T07:23:25.753681+0000","last_active":"2024-04-02T07:23:25.762426+0000","last_peered":"2024-04-02T07:23:25.762426+0000","last_clean":"2024-04-02T07:23:25.762426+0000","last_became_active":"2024-04-02T07:23:25.753415+0000","last_became_peered":"2024-04-02T07:23:25.753415+0000","last_unstale":"2024-04-02T07:23:25.762426+0000","last_undegraded":"2024-04-02T07:23:25.762426+0000","last_fullsized":"2024-04-02T07:23:25.762426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:23:43.517794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.763297+0000","last_change":"2024-04-02T07:23:25.758468+0000","last_active":"2024-04-02T07:23:25.763297+0000","last_peered":"2024-04-02T07:23:25.763297+0000","last_clean":"2024-04-02T07:23:25.763297+0000","last_became_active":"2024-04-02T07:23:25.758113+0000","last_became_peered":"2024-04-02T07:23:25.758113+0000","last_unstale":"2024-04-02T07:23:25.763297+0000","last_undegraded":"2024-04-02T07:23:25.763297+0000","last_fullsized":"2024-04-02T07:23:25.763297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:57:39.705151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.756984+0000","last_change":"2024-04-02T07:23:25.754359+0000","last_active":"2024-04-02T07:23:25.756984+0000","last_peered":"2024-04-02T07:23:25.756984+0000","last_clean":"2024-04-02T07:23:25.756984+0000","last_became_active":"2024-04-02T07:23:25.753354+0000","last_became_peered":"2024-04-02T07:23:25.753354+0000","last_unstale":"2024-04-02T07:23:25.756984+0000","last_undegraded":"2024-04-02T07:23:25.756984+0000","last_fullsized":"2024-04-02T07:23:25.756984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:32:12.440577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.763080+0000","last_change":"2024-04-02T07:23:25.754436+0000","last_active":"2024-04-02T07:23:25.763080+0000","last_peered":"2024-04-02T07:23:25.763080+0000","last_clean":"2024-04-02T07:23:25.763080+0000","last_became_active":"2024-04-02T07:23:25.754196+0000","last_became_peered":"2024-04-02T07:23:25.754196+0000","last_unstale":"2024-04-02T07:23:25.763080+0000","last_undegraded":"2024-04-02T07:23:25.763080+0000","last_fullsized":"2024-04-02T07:23:25.763080+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:01:05.258579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.762119+0000","last_change":"2024-04-02T07:23:25.757410+0000","last_active":"2024-04-02T07:23:25.762119+0000","last_peered":"2024-04-02T07:23:25.762119+0000","last_clean":"2024-04-02T07:23:25.762119+0000","last_became_active":"2024-04-02T07:23:25.757131+0000","last_became_peered":"2024-04-02T07:23:25.757131+0000","last_unstale":"2024-04-02T07:23:25.762119+0000","last_undegraded":"2024-04-02T07:23:25.762119+0000","last_fullsized":"2024-04-02T07:23:25.762119+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:23:43.517794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.767609+0000","last_change":"2024-04-02T07:23:25.765349+0000","last_active":"2024-04-02T07:23:25.767609+0000","last_peered":"2024-04-02T07:23:25.767609+0000","last_clean":"2024-04-02T07:23:25.767609+0000","last_became_active":"2024-04-02T07:23:25.764524+0000","last_became_peered":"2024-04-02T07:23:25.764524+0000","last_unstale":"2024-04-02T07:23:25.767609+0000","last_undegraded":"2024-04-02T07:23:25.767609+0000","last_fullsized":"2024-04-02T07:23:25.767609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:55.563309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.770527+0000","last_change":"2024-04-02T07:23:25.767344+0000","last_active":"2024-04-02T07:23:25.770527+0000","last_peered":"2024-04-02T07:23:25.770527+0000","last_clean":"2024-04-02T07:23:25.770527+0000","last_became_active":"2024-04-02T07:23:25.767063+0000","last_became_peered":"2024-04-02T07:23:25.767063+0000","last_unstale":"2024-04-02T07:23:25.770527+0000","last_undegraded":"2024-04-02T07:23:25.770527+0000","last_fullsized":"2024-04-02T07:23:25.770527+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:57:03.351637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.770805+0000","last_change":"2024-04-02T07:23:25.767442+0000","last_active":"2024-04-02T07:23:25.770805+0000","last_peered":"2024-04-02T07:23:25.770805+0000","last_clean":"2024-04-02T07:23:25.770805+0000","last_became_active":"2024-04-02T07:23:25.767169+0000","last_became_peered":"2024-04-02T07:23:25.767169+0000","last_unstale":"2024-04-02T07:23:25.770805+0000","last_undegraded":"2024-04-02T07:23:25.770805+0000","last_fullsized":"2024-04-02T07:23:25.770805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:26:49.378658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.761979+0000","last_change":"2024-04-02T07:23:25.755186+0000","last_active":"2024-04-02T07:23:25.761979+0000","last_peered":"2024-04-02T07:23:25.761979+0000","last_clean":"2024-04-02T07:23:25.761979+0000","last_became_active":"2024-04-02T07:23:25.754942+0000","last_became_peered":"2024-04-02T07:23:25.754942+0000","last_unstale":"2024-04-02T07:23:25.761979+0000","last_undegraded":"2024-04-02T07:23:25.761979+0000","last_fullsized":"2024-04-02T07:23:25.761979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:59:33.900364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.761849+0000","last_change":"2024-04-02T07:23:25.754694+0000","last_active":"2024-04-02T07:23:25.761849+0000","last_peered":"2024-04-02T07:23:25.761849+0000","last_clean":"2024-04-02T07:23:25.761849+0000","last_became_active":"2024-04-02T07:23:25.754441+0000","last_became_peered":"2024-04-02T07:23:25.754441+0000","last_unstale":"2024-04-02T07:23:25.761849+0000","last_undegraded":"2024-04-02T07:23:25.761849+0000","last_fullsized":"2024-04-02T07:23:25.761849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:23:43.517794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.754323+0000","last_change":"2024-04-02T07:23:25.748488+0000","last_active":"2024-04-02T07:23:25.754323+0000","last_peered":"2024-04-02T07:23:25.754323+0000","last_clean":"2024-04-02T07:23:25.754323+0000","last_became_active":"2024-04-02T07:23:25.747897+0000","last_became_peered":"2024-04-02T07:23:25.747897+0000","last_unstale":"2024-04-02T07:23:25.754323+0000","last_undegraded":"2024-04-02T07:23:25.754323+0000","last_fullsized":"2024-04-02T07:23:25.754323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:27:03.804725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.759325+0000","last_change":"2024-04-02T07:23:25.753856+0000","last_active":"2024-04-02T07:23:25.759325+0000","last_peered":"2024-04-02T07:23:25.759325+0000","last_clean":"2024-04-02T07:23:25.759325+0000","last_became_active":"2024-04-02T07:23:25.753600+0000","last_became_peered":"2024-04-02T07:23:25.753600+0000","last_unstale":"2024-04-02T07:23:25.759325+0000","last_undegraded":"2024-04-02T07:23:25.759325+0000","last_fullsized":"2024-04-02T07:23:25.759325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:50:57.979986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.767640+0000","last_change":"2024-04-02T07:23:25.759203+0000","last_active":"2024-04-02T07:23:25.767640+0000","last_peered":"2024-04-02T07:23:25.767640+0000","last_clean":"2024-04-02T07:23:25.767640+0000","last_became_active":"2024-04-02T07:23:25.758869+0000","last_became_peered":"2024-04-02T07:23:25.758869+0000","last_unstale":"2024-04-02T07:23:25.767640+0000","last_undegraded":"2024-04-02T07:23:25.767640+0000","last_fullsized":"2024-04-02T07:23:25.767640+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:07:08.542685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.774917+0000","last_change":"2024-04-02T07:23:25.773238+0000","last_active":"2024-04-02T07:23:25.774917+0000","last_peered":"2024-04-02T07:23:25.774917+0000","last_clean":"2024-04-02T07:23:25.774917+0000","last_became_active":"2024-04-02T07:23:25.772027+0000","last_became_peered":"2024-04-02T07:23:25.772027+0000","last_unstale":"2024-04-02T07:23:25.774917+0000","last_undegraded":"2024-04-02T07:23:25.774917+0000","last_fullsized":"2024-04-02T07:23:25.774917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:26:49.378658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.756898+0000","last_change":"2024-04-02T07:23:25.754187+0000","last_active":"2024-04-02T07:23:25.756898+0000","last_peered":"2024-04-02T07:23:25.756898+0000","last_clean":"2024-04-02T07:23:25.756898+0000","last_became_active":"2024-04-02T07:23:25.753756+0000","last_became_peered":"2024-04-02T07:23:25.753756+0000","last_unstale":"2024-04-02T07:23:25.756898+0000","last_undegraded":"2024-04-02T07:23:25.756898+0000","last_fullsized":"2024-04-02T07:23:25.756898+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:07:08.542685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.774824+0000","last_change":"2024-04-02T07:23:25.772532+0000","last_active":"2024-04-02T07:23:25.774824+0000","last_peered":"2024-04-02T07:23:25.774824+0000","last_clean":"2024-04-02T07:23:25.774824+0000","last_became_active":"2024-04-02T07:23:25.767617+0000","last_became_peered":"2024-04-02T07:23:25.767617+0000","last_unstale":"2024-04-02T07:23:25.774824+0000","last_undegraded":"2024-04-02T07:23:25.774824+0000","last_fullsized":"2024-04-02T07:23:25.774824+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:55.563309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.767684+0000","last_change":"2024-04-02T07:23:25.761081+0000","last_active":"2024-04-02T07:23:25.767684+0000","last_peered":"2024-04-02T07:23:25.767684+0000","last_clean":"2024-04-02T07:23:25.767684+0000","last_became_active":"2024-04-02T07:23:25.760834+0000","last_became_peered":"2024-04-02T07:23:25.760834+0000","last_unstale":"2024-04-02T07:23:25.767684+0000","last_undegraded":"2024-04-02T07:23:25.767684+0000","last_fullsized":"2024-04-02T07:23:25.767684+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:10:29.399488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.755453+0000","last_change":"2024-04-02T07:23:25.746792+0000","last_active":"2024-04-02T07:23:25.755453+0000","last_peered":"2024-04-02T07:23:25.755453+0000","last_clean":"2024-04-02T07:23:25.755453+0000","last_became_active":"2024-04-02T07:23:25.746529+0000","last_became_peered":"2024-04-02T07:23:25.746529+0000","last_unstale":"2024-04-02T07:23:25.755453+0000","last_undegraded":"2024-04-02T07:23:25.755453+0000","last_fullsized":"2024-04-02T07:23:25.755453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:47:25.777640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.765023+0000","last_change":"2024-04-02T07:23:25.760987+0000","last_active":"2024-04-02T07:23:25.765023+0000","last_peered":"2024-04-02T07:23:25.765023+0000","last_clean":"2024-04-02T07:23:25.765023+0000","last_became_active":"2024-04-02T07:23:25.760626+0000","last_became_peered":"2024-04-02T07:23:25.760626+0000","last_unstale":"2024-04-02T07:23:25.765023+0000","last_undegraded":"2024-04-02T07:23:25.765023+0000","last_fullsized":"2024-04-02T07:23:25.765023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:07:08.542685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.762463+0000","last_change":"2024-04-02T07:23:25.754145+0000","last_active":"2024-04-02T07:23:25.762463+0000","last_peered":"2024-04-02T07:23:25.762463+0000","last_clean":"2024-04-02T07:23:25.762463+0000","last_became_active":"2024-04-02T07:23:25.753057+0000","last_became_peered":"2024-04-02T07:23:25.753057+0000","last_unstale":"2024-04-02T07:23:25.762463+0000","last_undegraded":"2024-04-02T07:23:25.762463+0000","last_fullsized":"2024-04-02T07:23:25.762463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:33.264955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.764311+0000","last_change":"2024-04-02T07:23:25.759494+0000","last_active":"2024-04-02T07:23:25.764311+0000","last_peered":"2024-04-02T07:23:25.764311+0000","last_clean":"2024-04-02T07:23:25.764311+0000","last_became_active":"2024-04-02T07:23:25.759265+0000","last_became_peered":"2024-04-02T07:23:25.759265+0000","last_unstale":"2024-04-02T07:23:25.764311+0000","last_undegraded":"2024-04-02T07:23:25.764311+0000","last_fullsized":"2024-04-02T07:23:25.764311+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:10:29.399488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.763783+0000","last_change":"2024-04-02T07:23:25.761525+0000","last_active":"2024-04-02T07:23:25.763783+0000","last_peered":"2024-04-02T07:23:25.763783+0000","last_clean":"2024-04-02T07:23:25.763783+0000","last_became_active":"2024-04-02T07:23:25.761218+0000","last_became_peered":"2024-04-02T07:23:25.761218+0000","last_unstale":"2024-04-02T07:23:25.763783+0000","last_undegraded":"2024-04-02T07:23:25.763783+0000","last_fullsized":"2024-04-02T07:23:25.763783+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:47:25.777640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.763568+0000","last_change":"2024-04-02T07:23:25.345573+0000","last_active":"2024-04-02T07:23:25.763568+0000","last_peered":"2024-04-02T07:23:25.763568+0000","last_clean":"2024-04-02T07:23:25.763568+0000","last_became_active":"2024-04-02T07:23:25.344846+0000","last_became_peered":"2024-04-02T07:23:25.344846+0000","last_unstale":"2024-04-02T07:23:25.763568+0000","last_undegraded":"2024-04-02T07:23:25.763568+0000","last_fullsized":"2024-04-02T07:23:25.763568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:30:55.598213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.759606+0000","last_change":"2024-04-02T07:23:25.748665+0000","last_active":"2024-04-02T07:23:25.759606+0000","last_peered":"2024-04-02T07:23:25.759606+0000","last_clean":"2024-04-02T07:23:25.759606+0000","last_became_active":"2024-04-02T07:23:25.748420+0000","last_became_peered":"2024-04-02T07:23:25.748420+0000","last_unstale":"2024-04-02T07:23:25.759606+0000","last_undegraded":"2024-04-02T07:23:25.759606+0000","last_fullsized":"2024-04-02T07:23:25.759606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:33:06.242431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.761167+0000","last_change":"2024-04-02T07:23:25.353890+0000","last_active":"2024-04-02T07:23:25.761167+0000","last_peered":"2024-04-02T07:23:25.761167+0000","last_clean":"2024-04-02T07:23:25.761167+0000","last_became_active":"2024-04-02T07:23:25.353659+0000","last_became_peered":"2024-04-02T07:23:25.353659+0000","last_unstale":"2024-04-02T07:23:25.761167+0000","last_undegraded":"2024-04-02T07:23:25.761167+0000","last_fullsized":"2024-04-02T07:23:25.761167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:42:00.093702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.762617+0000","last_change":"2024-04-02T07:23:25.758584+0000","last_active":"2024-04-02T07:23:25.762617+0000","last_peered":"2024-04-02T07:23:25.762617+0000","last_clean":"2024-04-02T07:23:25.762617+0000","last_became_active":"2024-04-02T07:23:25.758270+0000","last_became_peered":"2024-04-02T07:23:25.758270+0000","last_unstale":"2024-04-02T07:23:25.762617+0000","last_undegraded":"2024-04-02T07:23:25.762617+0000","last_fullsized":"2024-04-02T07:23:25.762617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:08:08.568590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.771427+0000","last_change":"2024-04-02T07:23:25.344844+0000","last_active":"2024-04-02T07:23:25.771427+0000","last_peered":"2024-04-02T07:23:25.771427+0000","last_clean":"2024-04-02T07:23:25.771427+0000","last_became_active":"2024-04-02T07:23:25.344584+0000","last_became_peered":"2024-04-02T07:23:25.344584+0000","last_unstale":"2024-04-02T07:23:25.771427+0000","last_undegraded":"2024-04-02T07:23:25.771427+0000","last_fullsized":"2024-04-02T07:23:25.771427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:23:07.294625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.771042+0000","last_change":"2024-04-02T07:23:25.768177+0000","last_active":"2024-04-02T07:23:25.771042+0000","last_peered":"2024-04-02T07:23:25.771042+0000","last_clean":"2024-04-02T07:23:25.771042+0000","last_became_active":"2024-04-02T07:23:25.767130+0000","last_became_peered":"2024-04-02T07:23:25.767130+0000","last_unstale":"2024-04-02T07:23:25.771042+0000","last_undegraded":"2024-04-02T07:23:25.771042+0000","last_fullsized":"2024-04-02T07:23:25.771042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:49:29.388659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.756066+0000","last_change":"2024-04-02T07:23:25.358060+0000","last_active":"2024-04-02T07:23:25.756066+0000","last_peered":"2024-04-02T07:23:25.756066+0000","last_clean":"2024-04-02T07:23:25.756066+0000","last_became_active":"2024-04-02T07:23:25.357771+0000","last_became_peered":"2024-04-02T07:23:25.357771+0000","last_unstale":"2024-04-02T07:23:25.756066+0000","last_undegraded":"2024-04-02T07:23:25.756066+0000","last_fullsized":"2024-04-02T07:23:25.756066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:30:58.276742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.764640+0000","last_change":"2024-04-02T07:23:25.757878+0000","last_active":"2024-04-02T07:23:25.764640+0000","last_peered":"2024-04-02T07:23:25.764640+0000","last_clean":"2024-04-02T07:23:25.764640+0000","last_became_active":"2024-04-02T07:23:25.757705+0000","last_became_peered":"2024-04-02T07:23:25.757705+0000","last_unstale":"2024-04-02T07:23:25.764640+0000","last_undegraded":"2024-04-02T07:23:25.764640+0000","last_fullsized":"2024-04-02T07:23:25.764640+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:11:24.616677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.762113+0000","last_change":"2024-04-02T07:23:25.347587+0000","last_active":"2024-04-02T07:23:25.762113+0000","last_peered":"2024-04-02T07:23:25.762113+0000","last_clean":"2024-04-02T07:23:25.762113+0000","last_became_active":"2024-04-02T07:23:25.347350+0000","last_became_peered":"2024-04-02T07:23:25.347350+0000","last_unstale":"2024-04-02T07:23:25.762113+0000","last_undegraded":"2024-04-02T07:23:25.762113+0000","last_fullsized":"2024-04-02T07:23:25.762113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:13:58.149984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.760722+0000","last_change":"2024-04-02T07:23:25.753390+0000","last_active":"2024-04-02T07:23:25.760722+0000","last_peered":"2024-04-02T07:23:25.760722+0000","last_clean":"2024-04-02T07:23:25.760722+0000","last_became_active":"2024-04-02T07:23:25.753075+0000","last_became_peered":"2024-04-02T07:23:25.753075+0000","last_unstale":"2024-04-02T07:23:25.760722+0000","last_undegraded":"2024-04-02T07:23:25.760722+0000","last_fullsized":"2024-04-02T07:23:25.760722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:26:49.378658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.760391+0000","last_change":"2024-04-02T07:23:25.348159+0000","last_active":"2024-04-02T07:23:25.760391+0000","last_peered":"2024-04-02T07:23:25.760391+0000","last_clean":"2024-04-02T07:23:25.760391+0000","last_became_active":"2024-04-02T07:23:25.345987+0000","last_became_peered":"2024-04-02T07:23:25.345987+0000","last_unstale":"2024-04-02T07:23:25.760391+0000","last_undegraded":"2024-04-02T07:23:25.760391+0000","last_fullsized":"2024-04-02T07:23:25.760391+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:30:58.276742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.758574+0000","last_change":"2024-04-02T07:23:25.748627+0000","last_active":"2024-04-02T07:23:25.758574+0000","last_peered":"2024-04-02T07:23:25.758574+0000","last_clean":"2024-04-02T07:23:25.758574+0000","last_became_active":"2024-04-02T07:23:25.747489+0000","last_became_peered":"2024-04-02T07:23:25.747489+0000","last_unstale":"2024-04-02T07:23:25.758574+0000","last_undegraded":"2024-04-02T07:23:25.758574+0000","last_fullsized":"2024-04-02T07:23:25.758574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:01:44.731845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.736357+0000","last_change":"2024-04-02T07:23:25.352810+0000","last_active":"2024-04-02T07:23:25.736357+0000","last_peered":"2024-04-02T07:23:25.736357+0000","last_clean":"2024-04-02T07:23:25.736357+0000","last_became_active":"2024-04-02T07:23:25.352224+0000","last_became_peered":"2024-04-02T07:23:25.352224+0000","last_unstale":"2024-04-02T07:23:25.736357+0000","last_undegraded":"2024-04-02T07:23:25.736357+0000","last_fullsized":"2024-04-02T07:23:25.736357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:22:32.464837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.770876+0000","last_change":"2024-04-02T07:23:25.764861+0000","last_active":"2024-04-02T07:23:25.770876+0000","last_peered":"2024-04-02T07:23:25.770876+0000","last_clean":"2024-04-02T07:23:25.770876+0000","last_became_active":"2024-04-02T07:23:25.764583+0000","last_became_peered":"2024-04-02T07:23:25.764583+0000","last_unstale":"2024-04-02T07:23:25.770876+0000","last_undegraded":"2024-04-02T07:23:25.770876+0000","last_fullsized":"2024-04-02T07:23:25.770876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:10:29.399488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.733253+0000","last_change":"2024-04-02T07:23:25.344321+0000","last_active":"2024-04-02T07:23:25.733253+0000","last_peered":"2024-04-02T07:23:25.733253+0000","last_clean":"2024-04-02T07:23:25.733253+0000","last_became_active":"2024-04-02T07:23:25.343928+0000","last_became_peered":"2024-04-02T07:23:25.343928+0000","last_unstale":"2024-04-02T07:23:25.733253+0000","last_undegraded":"2024-04-02T07:23:25.733253+0000","last_fullsized":"2024-04-02T07:23:25.733253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:20:20.029156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.762395+0000","last_change":"2024-04-02T07:23:25.757655+0000","last_active":"2024-04-02T07:23:25.762395+0000","last_peered":"2024-04-02T07:23:25.762395+0000","last_clean":"2024-04-02T07:23:25.762395+0000","last_became_active":"2024-04-02T07:23:25.757311+0000","last_became_peered":"2024-04-02T07:23:25.757311+0000","last_unstale":"2024-04-02T07:23:25.762395+0000","last_undegraded":"2024-04-02T07:23:25.762395+0000","last_fullsized":"2024-04-02T07:23:25.762395+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:47:25.777640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.736968+0000","last_change":"2024-04-02T07:23:25.348462+0000","last_active":"2024-04-02T07:23:25.736968+0000","last_peered":"2024-04-02T07:23:25.736968+0000","last_clean":"2024-04-02T07:23:25.736968+0000","last_became_active":"2024-04-02T07:23:25.348163+0000","last_became_peered":"2024-04-02T07:23:25.348163+0000","last_unstale":"2024-04-02T07:23:25.736968+0000","last_undegraded":"2024-04-02T07:23:25.736968+0000","last_fullsized":"2024-04-02T07:23:25.736968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:48:01.765589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.770507+0000","last_change":"2024-04-02T07:23:25.767912+0000","last_active":"2024-04-02T07:23:25.770507+0000","last_peered":"2024-04-02T07:23:25.770507+0000","last_clean":"2024-04-02T07:23:25.770507+0000","last_became_active":"2024-04-02T07:23:25.767638+0000","last_became_peered":"2024-04-02T07:23:25.767638+0000","last_unstale":"2024-04-02T07:23:25.770507+0000","last_undegraded":"2024-04-02T07:23:25.770507+0000","last_fullsized":"2024-04-02T07:23:25.770507+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:10:29.399488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.749873+0000","last_change":"2024-04-02T07:23:25.354817+0000","last_active":"2024-04-02T07:23:25.749873+0000","last_peered":"2024-04-02T07:23:25.749873+0000","last_clean":"2024-04-02T07:23:25.749873+0000","last_became_active":"2024-04-02T07:23:25.354588+0000","last_became_peered":"2024-04-02T07:23:25.354588+0000","last_unstale":"2024-04-02T07:23:25.749873+0000","last_undegraded":"2024-04-02T07:23:25.749873+0000","last_fullsized":"2024-04-02T07:23:25.749873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:52:42.539175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.757017+0000","last_change":"2024-04-02T07:23:25.753611+0000","last_active":"2024-04-02T07:23:25.757017+0000","last_peered":"2024-04-02T07:23:25.757017+0000","last_clean":"2024-04-02T07:23:25.757017+0000","last_became_active":"2024-04-02T07:23:25.753311+0000","last_became_peered":"2024-04-02T07:23:25.753311+0000","last_unstale":"2024-04-02T07:23:25.757017+0000","last_undegraded":"2024-04-02T07:23:25.757017+0000","last_fullsized":"2024-04-02T07:23:25.757017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:23:45.094009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.753641+0000","last_change":"2024-04-02T07:23:25.348520+0000","last_active":"2024-04-02T07:23:25.753641+0000","last_peered":"2024-04-02T07:23:25.753641+0000","last_clean":"2024-04-02T07:23:25.753641+0000","last_became_active":"2024-04-02T07:23:25.347694+0000","last_became_peered":"2024-04-02T07:23:25.347694+0000","last_unstale":"2024-04-02T07:23:25.753641+0000","last_undegraded":"2024-04-02T07:23:25.753641+0000","last_fullsized":"2024-04-02T07:23:25.753641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:23:07.294625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.770865+0000","last_change":"2024-04-02T07:23:25.767240+0000","last_active":"2024-04-02T07:23:25.770865+0000","last_peered":"2024-04-02T07:23:25.770865+0000","last_clean":"2024-04-02T07:23:25.770865+0000","last_became_active":"2024-04-02T07:23:25.767029+0000","last_became_peered":"2024-04-02T07:23:25.767029+0000","last_unstale":"2024-04-02T07:23:25.770865+0000","last_undegraded":"2024-04-02T07:23:25.770865+0000","last_fullsized":"2024-04-02T07:23:25.770865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:11:24.616677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.776959+0000","last_change":"2024-04-02T07:23:25.345908+0000","last_active":"2024-04-02T07:23:25.776959+0000","last_peered":"2024-04-02T07:23:25.776959+0000","last_clean":"2024-04-02T07:23:25.776959+0000","last_became_active":"2024-04-02T07:23:25.345647+0000","last_became_peered":"2024-04-02T07:23:25.345647+0000","last_unstale":"2024-04-02T07:23:25.776959+0000","last_undegraded":"2024-04-02T07:23:25.776959+0000","last_fullsized":"2024-04-02T07:23:25.776959+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:59:32.894424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.770189+0000","last_change":"2024-04-02T07:23:25.763734+0000","last_active":"2024-04-02T07:23:25.770189+0000","last_peered":"2024-04-02T07:23:25.770189+0000","last_clean":"2024-04-02T07:23:25.770189+0000","last_became_active":"2024-04-02T07:23:25.762742+0000","last_became_peered":"2024-04-02T07:23:25.762742+0000","last_unstale":"2024-04-02T07:23:25.770189+0000","last_undegraded":"2024-04-02T07:23:25.770189+0000","last_fullsized":"2024-04-02T07:23:25.770189+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:57:03.351637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.765158+0000","last_change":"2024-04-02T07:23:25.341421+0000","last_active":"2024-04-02T07:23:25.765158+0000","last_peered":"2024-04-02T07:23:25.765158+0000","last_clean":"2024-04-02T07:23:25.765158+0000","last_became_active":"2024-04-02T07:23:25.341155+0000","last_became_peered":"2024-04-02T07:23:25.341155+0000","last_unstale":"2024-04-02T07:23:25.765158+0000","last_undegraded":"2024-04-02T07:23:25.765158+0000","last_fullsized":"2024-04-02T07:23:25.765158+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:56:49.611080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.759438+0000","last_change":"2024-04-02T07:23:25.755957+0000","last_active":"2024-04-02T07:23:25.759438+0000","last_peered":"2024-04-02T07:23:25.759438+0000","last_clean":"2024-04-02T07:23:25.759438+0000","last_became_active":"2024-04-02T07:23:25.755688+0000","last_became_peered":"2024-04-02T07:23:25.755688+0000","last_unstale":"2024-04-02T07:23:25.759438+0000","last_undegraded":"2024-04-02T07:23:25.759438+0000","last_fullsized":"2024-04-02T07:23:25.759438+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:06:31.149778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.769288+0000","last_change":"2024-04-02T07:23:25.345787+0000","last_active":"2024-04-02T07:23:25.769288+0000","last_peered":"2024-04-02T07:23:25.769288+0000","last_clean":"2024-04-02T07:23:25.769288+0000","last_became_active":"2024-04-02T07:23:25.345247+0000","last_became_peered":"2024-04-02T07:23:25.345247+0000","last_unstale":"2024-04-02T07:23:25.769288+0000","last_undegraded":"2024-04-02T07:23:25.769288+0000","last_fullsized":"2024-04-02T07:23:25.769288+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:30:55.598213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.764333+0000","last_change":"2024-04-02T07:23:25.759585+0000","last_active":"2024-04-02T07:23:25.764333+0000","last_peered":"2024-04-02T07:23:25.764333+0000","last_clean":"2024-04-02T07:23:25.764333+0000","last_became_active":"2024-04-02T07:23:25.759334+0000","last_became_peered":"2024-04-02T07:23:25.759334+0000","last_unstale":"2024-04-02T07:23:25.764333+0000","last_undegraded":"2024-04-02T07:23:25.764333+0000","last_fullsized":"2024-04-02T07:23:25.764333+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:57:03.351637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.736393+0000","last_change":"2024-04-02T07:23:25.344501+0000","last_active":"2024-04-02T07:23:25.736393+0000","last_peered":"2024-04-02T07:23:25.736393+0000","last_clean":"2024-04-02T07:23:25.736393+0000","last_became_active":"2024-04-02T07:23:25.344171+0000","last_became_peered":"2024-04-02T07:23:25.344171+0000","last_unstale":"2024-04-02T07:23:25.736393+0000","last_undegraded":"2024-04-02T07:23:25.736393+0000","last_fullsized":"2024-04-02T07:23:25.736393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:14:17.359308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.763390+0000","last_change":"2024-04-02T07:23:25.756279+0000","last_active":"2024-04-02T07:23:25.763390+0000","last_peered":"2024-04-02T07:23:25.763390+0000","last_clean":"2024-04-02T07:23:25.763390+0000","last_became_active":"2024-04-02T07:23:25.755998+0000","last_became_peered":"2024-04-02T07:23:25.755998+0000","last_unstale":"2024-04-02T07:23:25.763390+0000","last_undegraded":"2024-04-02T07:23:25.763390+0000","last_fullsized":"2024-04-02T07:23:25.763390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:08:08.568590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.770731+0000","last_change":"2024-04-02T07:23:25.346051+0000","last_active":"2024-04-02T07:23:25.770731+0000","last_peered":"2024-04-02T07:23:25.770731+0000","last_clean":"2024-04-02T07:23:25.770731+0000","last_became_active":"2024-04-02T07:23:25.345740+0000","last_became_peered":"2024-04-02T07:23:25.345740+0000","last_unstale":"2024-04-02T07:23:25.770731+0000","last_undegraded":"2024-04-02T07:23:25.770731+0000","last_fullsized":"2024-04-02T07:23:25.770731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:30:55.598213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.760062+0000","last_change":"2024-04-02T07:23:25.753648+0000","last_active":"2024-04-02T07:23:25.760062+0000","last_peered":"2024-04-02T07:23:25.760062+0000","last_clean":"2024-04-02T07:23:25.760062+0000","last_became_active":"2024-04-02T07:23:25.753349+0000","last_became_peered":"2024-04-02T07:23:25.753349+0000","last_unstale":"2024-04-02T07:23:25.760062+0000","last_undegraded":"2024-04-02T07:23:25.760062+0000","last_fullsized":"2024-04-02T07:23:25.760062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:37:42.173429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.777140+0000","last_change":"2024-04-02T07:23:25.355369+0000","last_active":"2024-04-02T07:23:25.777140+0000","last_peered":"2024-04-02T07:23:25.777140+0000","last_clean":"2024-04-02T07:23:25.777140+0000","last_became_active":"2024-04-02T07:23:25.354543+0000","last_became_peered":"2024-04-02T07:23:25.354543+0000","last_unstale":"2024-04-02T07:23:25.777140+0000","last_undegraded":"2024-04-02T07:23:25.777140+0000","last_fullsized":"2024-04-02T07:23:25.777140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:23:07.294625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.762362+0000","last_change":"2024-04-02T07:23:25.755314+0000","last_active":"2024-04-02T07:23:25.762362+0000","last_peered":"2024-04-02T07:23:25.762362+0000","last_clean":"2024-04-02T07:23:25.762362+0000","last_became_active":"2024-04-02T07:23:25.755026+0000","last_became_peered":"2024-04-02T07:23:25.755026+0000","last_unstale":"2024-04-02T07:23:25.762362+0000","last_undegraded":"2024-04-02T07:23:25.762362+0000","last_fullsized":"2024-04-02T07:23:25.762362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:49:29.388659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.764364+0000","last_change":"2024-04-02T07:23:25.341985+0000","last_active":"2024-04-02T07:23:25.764364+0000","last_peered":"2024-04-02T07:23:25.764364+0000","last_clean":"2024-04-02T07:23:25.764364+0000","last_became_active":"2024-04-02T07:23:25.341700+0000","last_became_peered":"2024-04-02T07:23:25.341700+0000","last_unstale":"2024-04-02T07:23:25.764364+0000","last_undegraded":"2024-04-02T07:23:25.764364+0000","last_fullsized":"2024-04-02T07:23:25.764364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:48:28.211677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.771959+0000","last_change":"2024-04-02T07:23:25.765855+0000","last_active":"2024-04-02T07:23:25.771959+0000","last_peered":"2024-04-02T07:23:25.771959+0000","last_clean":"2024-04-02T07:23:25.771959+0000","last_became_active":"2024-04-02T07:23:25.765498+0000","last_became_peered":"2024-04-02T07:23:25.765498+0000","last_unstale":"2024-04-02T07:23:25.771959+0000","last_undegraded":"2024-04-02T07:23:25.771959+0000","last_fullsized":"2024-04-02T07:23:25.771959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:33.264955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.762386+0000","last_change":"2024-04-02T07:23:25.352002+0000","last_active":"2024-04-02T07:23:25.762386+0000","last_peered":"2024-04-02T07:23:25.762386+0000","last_clean":"2024-04-02T07:23:25.762386+0000","last_became_active":"2024-04-02T07:23:25.351711+0000","last_became_peered":"2024-04-02T07:23:25.351711+0000","last_unstale":"2024-04-02T07:23:25.762386+0000","last_undegraded":"2024-04-02T07:23:25.762386+0000","last_fullsized":"2024-04-02T07:23:25.762386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:33:29.504833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.754257+0000","last_change":"2024-04-02T07:23:25.751143+0000","last_active":"2024-04-02T07:23:25.754257+0000","last_peered":"2024-04-02T07:23:25.754257+0000","last_clean":"2024-04-02T07:23:25.754257+0000","last_became_active":"2024-04-02T07:23:25.750889+0000","last_became_peered":"2024-04-02T07:23:25.750889+0000","last_unstale":"2024-04-02T07:23:25.754257+0000","last_undegraded":"2024-04-02T07:23:25.754257+0000","last_fullsized":"2024-04-02T07:23:25.754257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:27:03.804725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.733544+0000","last_change":"2024-04-02T07:23:25.346623+0000","last_active":"2024-04-02T07:23:25.733544+0000","last_peered":"2024-04-02T07:23:25.733544+0000","last_clean":"2024-04-02T07:23:25.733544+0000","last_became_active":"2024-04-02T07:23:25.346377+0000","last_became_peered":"2024-04-02T07:23:25.346377+0000","last_unstale":"2024-04-02T07:23:25.733544+0000","last_undegraded":"2024-04-02T07:23:25.733544+0000","last_fullsized":"2024-04-02T07:23:25.733544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:38:49.075746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.763090+0000","last_change":"2024-04-02T07:23:25.756908+0000","last_active":"2024-04-02T07:23:25.763090+0000","last_peered":"2024-04-02T07:23:25.763090+0000","last_clean":"2024-04-02T07:23:25.763090+0000","last_became_active":"2024-04-02T07:23:25.756621+0000","last_became_peered":"2024-04-02T07:23:25.756621+0000","last_unstale":"2024-04-02T07:23:25.763090+0000","last_undegraded":"2024-04-02T07:23:25.763090+0000","last_fullsized":"2024-04-02T07:23:25.763090+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:30:56.604153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.760438+0000","last_change":"2024-04-02T07:23:25.352321+0000","last_active":"2024-04-02T07:23:25.760438+0000","last_peered":"2024-04-02T07:23:25.760438+0000","last_clean":"2024-04-02T07:23:25.760438+0000","last_became_active":"2024-04-02T07:23:25.352069+0000","last_became_peered":"2024-04-02T07:23:25.352069+0000","last_unstale":"2024-04-02T07:23:25.760438+0000","last_undegraded":"2024-04-02T07:23:25.760438+0000","last_fullsized":"2024-04-02T07:23:25.760438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:57:38.699211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.758331+0000","last_change":"2024-04-02T07:23:25.752296+0000","last_active":"2024-04-02T07:23:25.758331+0000","last_peered":"2024-04-02T07:23:25.758331+0000","last_clean":"2024-04-02T07:23:25.758331+0000","last_became_active":"2024-04-02T07:23:25.752048+0000","last_became_peered":"2024-04-02T07:23:25.752048+0000","last_unstale":"2024-04-02T07:23:25.758331+0000","last_undegraded":"2024-04-02T07:23:25.758331+0000","last_fullsized":"2024-04-02T07:23:25.758331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:14:18.365248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.742892+0000","last_change":"2024-04-02T07:23:25.352287+0000","last_active":"2024-04-02T07:23:25.742892+0000","last_peered":"2024-04-02T07:23:25.742892+0000","last_clean":"2024-04-02T07:23:25.742892+0000","last_became_active":"2024-04-02T07:23:25.348693+0000","last_became_peered":"2024-04-02T07:23:25.348693+0000","last_unstale":"2024-04-02T07:23:25.742892+0000","last_undegraded":"2024-04-02T07:23:25.742892+0000","last_fullsized":"2024-04-02T07:23:25.742892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:59:32.894424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.758935+0000","last_change":"2024-04-02T07:23:25.752922+0000","last_active":"2024-04-02T07:23:25.758935+0000","last_peered":"2024-04-02T07:23:25.758935+0000","last_clean":"2024-04-02T07:23:25.758935+0000","last_became_active":"2024-04-02T07:23:25.752620+0000","last_became_peered":"2024-04-02T07:23:25.752620+0000","last_unstale":"2024-04-02T07:23:25.758935+0000","last_undegraded":"2024-04-02T07:23:25.758935+0000","last_fullsized":"2024-04-02T07:23:25.758935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:23:08.300566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.733409+0000","last_change":"2024-04-02T07:23:25.345624+0000","last_active":"2024-04-02T07:23:25.733409+0000","last_peered":"2024-04-02T07:23:25.733409+0000","last_clean":"2024-04-02T07:23:25.733409+0000","last_became_active":"2024-04-02T07:23:25.344902+0000","last_became_peered":"2024-04-02T07:23:25.344902+0000","last_unstale":"2024-04-02T07:23:25.733409+0000","last_undegraded":"2024-04-02T07:23:25.733409+0000","last_fullsized":"2024-04-02T07:23:25.733409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:46:00.766800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.757138+0000","last_change":"2024-04-02T07:23:25.751101+0000","last_active":"2024-04-02T07:23:25.757138+0000","last_peered":"2024-04-02T07:23:25.757138+0000","last_clean":"2024-04-02T07:23:25.757138+0000","last_became_active":"2024-04-02T07:23:25.750782+0000","last_became_peered":"2024-04-02T07:23:25.750782+0000","last_unstale":"2024-04-02T07:23:25.757138+0000","last_undegraded":"2024-04-02T07:23:25.757138+0000","last_fullsized":"2024-04-02T07:23:25.757138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:49:29.388659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.741818+0000","last_change":"2024-04-02T07:23:25.347234+0000","last_active":"2024-04-02T07:23:25.741818+0000","last_peered":"2024-04-02T07:23:25.741818+0000","last_clean":"2024-04-02T07:23:25.741818+0000","last_became_active":"2024-04-02T07:23:25.346955+0000","last_became_peered":"2024-04-02T07:23:25.346955+0000","last_unstale":"2024-04-02T07:23:25.741818+0000","last_undegraded":"2024-04-02T07:23:25.741818+0000","last_fullsized":"2024-04-02T07:23:25.741818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:22:32.464837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.760066+0000","last_change":"2024-04-02T07:23:25.755006+0000","last_active":"2024-04-02T07:23:25.760066+0000","last_peered":"2024-04-02T07:23:25.760066+0000","last_clean":"2024-04-02T07:23:25.760066+0000","last_became_active":"2024-04-02T07:23:25.754724+0000","last_became_peered":"2024-04-02T07:23:25.754724+0000","last_unstale":"2024-04-02T07:23:25.760066+0000","last_undegraded":"2024-04-02T07:23:25.760066+0000","last_fullsized":"2024-04-02T07:23:25.760066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:22:33.470777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.777793+0000","last_change":"2024-04-02T07:23:25.346435+0000","last_active":"2024-04-02T07:23:25.777793+0000","last_peered":"2024-04-02T07:23:25.777793+0000","last_clean":"2024-04-02T07:23:25.777793+0000","last_became_active":"2024-04-02T07:23:25.346177+0000","last_became_peered":"2024-04-02T07:23:25.346177+0000","last_unstale":"2024-04-02T07:23:25.777793+0000","last_undegraded":"2024-04-02T07:23:25.777793+0000","last_fullsized":"2024-04-02T07:23:25.777793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:59:32.894424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.767754+0000","last_change":"2024-04-02T07:23:25.764291+0000","last_active":"2024-04-02T07:23:25.767754+0000","last_peered":"2024-04-02T07:23:25.767754+0000","last_clean":"2024-04-02T07:23:25.767754+0000","last_became_active":"2024-04-02T07:23:25.763986+0000","last_became_peered":"2024-04-02T07:23:25.763986+0000","last_unstale":"2024-04-02T07:23:25.767754+0000","last_undegraded":"2024-04-02T07:23:25.767754+0000","last_fullsized":"2024-04-02T07:23:25.767754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:57:03.351637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.749263+0000","last_change":"2024-04-02T07:23:25.354424+0000","last_active":"2024-04-02T07:23:25.749263+0000","last_peered":"2024-04-02T07:23:25.749263+0000","last_clean":"2024-04-02T07:23:25.749263+0000","last_became_active":"2024-04-02T07:23:25.352133+0000","last_became_peered":"2024-04-02T07:23:25.352133+0000","last_unstale":"2024-04-02T07:23:25.749263+0000","last_undegraded":"2024-04-02T07:23:25.749263+0000","last_fullsized":"2024-04-02T07:23:25.749263+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:05:46.580442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.776628+0000","last_change":"2024-04-02T07:23:25.772844+0000","last_active":"2024-04-02T07:23:25.776628+0000","last_peered":"2024-04-02T07:23:25.776628+0000","last_clean":"2024-04-02T07:23:25.776628+0000","last_became_active":"2024-04-02T07:23:25.772555+0000","last_became_peered":"2024-04-02T07:23:25.772555+0000","last_unstale":"2024-04-02T07:23:25.776628+0000","last_undegraded":"2024-04-02T07:23:25.776628+0000","last_fullsized":"2024-04-02T07:23:25.776628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:27:03.804725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.769359+0000","last_change":"2024-04-02T07:23:25.353370+0000","last_active":"2024-04-02T07:23:25.769359+0000","last_peered":"2024-04-02T07:23:25.769359+0000","last_clean":"2024-04-02T07:23:25.769359+0000","last_became_active":"2024-04-02T07:23:25.353069+0000","last_became_peered":"2024-04-02T07:23:25.353069+0000","last_unstale":"2024-04-02T07:23:25.769359+0000","last_undegraded":"2024-04-02T07:23:25.769359+0000","last_fullsized":"2024-04-02T07:23:25.769359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:22:32.464837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.763174+0000","last_change":"2024-04-02T07:23:25.756444+0000","last_active":"2024-04-02T07:23:25.763174+0000","last_peered":"2024-04-02T07:23:25.763174+0000","last_clean":"2024-04-02T07:23:25.763174+0000","last_became_active":"2024-04-02T07:23:25.756113+0000","last_became_peered":"2024-04-02T07:23:25.756113+0000","last_unstale":"2024-04-02T07:23:25.763174+0000","last_undegraded":"2024-04-02T07:23:25.763174+0000","last_fullsized":"2024-04-02T07:23:25.763174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:23:43.517794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.747613+0000","last_change":"2024-04-02T07:23:25.352249+0000","last_active":"2024-04-02T07:23:25.747613+0000","last_peered":"2024-04-02T07:23:25.747613+0000","last_clean":"2024-04-02T07:23:25.747613+0000","last_became_active":"2024-04-02T07:23:25.351832+0000","last_became_peered":"2024-04-02T07:23:25.351832+0000","last_unstale":"2024-04-02T07:23:25.747613+0000","last_undegraded":"2024-04-02T07:23:25.747613+0000","last_fullsized":"2024-04-02T07:23:25.747613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:56:49.611080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.772749+0000","last_change":"2024-04-02T07:23:25.766080+0000","last_active":"2024-04-02T07:23:25.772749+0000","last_peered":"2024-04-02T07:23:25.772749+0000","last_clean":"2024-04-02T07:23:25.772749+0000","last_became_active":"2024-04-02T07:23:25.763300+0000","last_became_peered":"2024-04-02T07:23:25.763300+0000","last_unstale":"2024-04-02T07:23:25.772749+0000","last_undegraded":"2024-04-02T07:23:25.772749+0000","last_fullsized":"2024-04-02T07:23:25.772749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:08:08.568590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.769377+0000","last_change":"2024-04-02T07:23:25.347353+0000","last_active":"2024-04-02T07:23:25.769377+0000","last_peered":"2024-04-02T07:23:25.769377+0000","last_clean":"2024-04-02T07:23:25.769377+0000","last_became_active":"2024-04-02T07:23:25.345902+0000","last_became_peered":"2024-04-02T07:23:25.345902+0000","last_unstale":"2024-04-02T07:23:25.769377+0000","last_undegraded":"2024-04-02T07:23:25.769377+0000","last_fullsized":"2024-04-02T07:23:25.769377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:57:38.699211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.770587+0000","last_change":"2024-04-02T07:23:25.767531+0000","last_active":"2024-04-02T07:23:25.770587+0000","last_peered":"2024-04-02T07:23:25.770587+0000","last_clean":"2024-04-02T07:23:25.770587+0000","last_became_active":"2024-04-02T07:23:25.767211+0000","last_became_peered":"2024-04-02T07:23:25.767211+0000","last_unstale":"2024-04-02T07:23:25.770587+0000","last_undegraded":"2024-04-02T07:23:25.770587+0000","last_fullsized":"2024-04-02T07:23:25.770587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:11:24.616677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.733183+0000","last_change":"2024-04-02T07:23:25.340841+0000","last_active":"2024-04-02T07:23:25.733183+0000","last_peered":"2024-04-02T07:23:25.733183+0000","last_clean":"2024-04-02T07:23:25.733183+0000","last_became_active":"2024-04-02T07:23:25.340559+0000","last_became_peered":"2024-04-02T07:23:25.340559+0000","last_unstale":"2024-04-02T07:23:25.733183+0000","last_undegraded":"2024-04-02T07:23:25.733183+0000","last_fullsized":"2024-04-02T07:23:25.733183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:52:42.539175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.754008+0000","last_change":"2024-04-02T07:23:25.747400+0000","last_active":"2024-04-02T07:23:25.754008+0000","last_peered":"2024-04-02T07:23:25.754008+0000","last_clean":"2024-04-02T07:23:25.754008+0000","last_became_active":"2024-04-02T07:23:25.746167+0000","last_became_peered":"2024-04-02T07:23:25.746167+0000","last_unstale":"2024-04-02T07:23:25.754008+0000","last_undegraded":"2024-04-02T07:23:25.754008+0000","last_fullsized":"2024-04-02T07:23:25.754008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:50:57.979986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.736400+0000","last_change":"2024-04-02T07:23:25.345530+0000","last_active":"2024-04-02T07:23:25.736400+0000","last_peered":"2024-04-02T07:23:25.736400+0000","last_clean":"2024-04-02T07:23:25.736400+0000","last_became_active":"2024-04-02T07:23:25.345189+0000","last_became_peered":"2024-04-02T07:23:25.345189+0000","last_unstale":"2024-04-02T07:23:25.736400+0000","last_undegraded":"2024-04-02T07:23:25.736400+0000","last_fullsized":"2024-04-02T07:23:25.736400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:27:02.798785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.760496+0000","last_change":"2024-04-02T07:23:25.755025+0000","last_active":"2024-04-02T07:23:25.760496+0000","last_peered":"2024-04-02T07:23:25.760496+0000","last_clean":"2024-04-02T07:23:25.760496+0000","last_became_active":"2024-04-02T07:23:25.754751+0000","last_became_peered":"2024-04-02T07:23:25.754751+0000","last_unstale":"2024-04-02T07:23:25.760496+0000","last_undegraded":"2024-04-02T07:23:25.760496+0000","last_fullsized":"2024-04-02T07:23:25.760496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:26:49.378658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.742587+0000","last_change":"2024-04-02T07:23:25.348337+0000","last_active":"2024-04-02T07:23:25.742587+0000","last_peered":"2024-04-02T07:23:25.742587+0000","last_clean":"2024-04-02T07:23:25.742587+0000","last_became_active":"2024-04-02T07:23:25.348029+0000","last_became_peered":"2024-04-02T07:23:25.348029+0000","last_unstale":"2024-04-02T07:23:25.742587+0000","last_undegraded":"2024-04-02T07:23:25.742587+0000","last_fullsized":"2024-04-02T07:23:25.742587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:23:07.294625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.344322+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:23:25.344322+0000","last_peered":"2024-04-02T07:23:25.344322+0000","last_clean":"2024-04-02T07:23:25.344322+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:23:25.344322+0000","last_undegraded":"2024-04-02T07:23:25.344322+0000","last_fullsized":"2024-04-02T07:23:25.344322+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":729188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.624},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56000000000000005}]},{"osd":1,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.51300000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.76200000000000001}]},{"osd":3,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.68600000000000005}]},{"osd":4,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.58499999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.70999999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.69699999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":146211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":5.7569999999999997,"5min":5.7569999999999997,"15min":5.7569999999999997},"last":0.84899999999999998}]},{"osd":1,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.88300000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.66200000000000003}]},{"osd":3,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.73199999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.746},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.91000000000000003}]},{"osd":5,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.82499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.54900000000000004}]},{"osd":1,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.68400000000000005}]},{"osd":2,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.63200000000000001}]},{"osd":3,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.504},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.52900000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.58499999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.69699999999999995}]},{"osd":7,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.73199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":145699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:23:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.4929999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":3.2519999999999998,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.61099999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:23:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":4.3810000000000002,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":0.65100000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:23:08 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":3.3420000000000001,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.77000000000000002}]},{"osd":3,"last update":"Tue Apr 2 07:23:08 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":3.9180000000000001,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.9750000000000001,"5min":3.9750000000000001,"15min":3.9750000000000001},"last":0.73799999999999999}]},{"osd":5,"last update":"Tue Apr 2 07:23:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.57699999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:23:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.754}]},{"osd":7,"last update":"Tue Apr 2 07:23:08 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.81899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":360448,"data_stored":138820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:23:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.372},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.44600000000000001}]},{"osd":1,"last update":"Tue Apr 2 07:23:09 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.41099999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:23:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.46400000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:23:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.71899999999999997}]},{"osd":5,"last update":"Tue Apr 2 07:23:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.76300000000000001}]},{"osd":6,"last update":"Tue Apr 2 07:23:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.755},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.64700000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:23:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.624}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":360448,"data_stored":138820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.313}]},{"osd":1,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.433},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.443}]},{"osd":3,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.45800000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.59999999999999998}]},{"osd":5,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.80500000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.3580000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.751},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.72599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":360448,"data_stored":138820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":4.157,"5min":4.157,"15min":4.157},"last":1.093}]},{"osd":2,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":4.282,"5min":4.282,"15min":4.282},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.53000000000000003}]},{"osd":3,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.5},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":8.1620000000000008,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":1.052}]},{"osd":4,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.7400000000000002,"5min":4.7400000000000002,"15min":4.7400000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.55900000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":4.5759999999999996,"5min":4.5759999999999996,"15min":4.5759999999999996},"last":1.163},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":4.7949999999999999,"5min":4.7949999999999999,"15min":4.7949999999999999},"last":0.60499999999999998}]},{"osd":6,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":4.6890000000000001,"5min":4.6890000000000001,"15min":4.6890000000000001},"last":1.129},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.6059999999999999,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.57199999999999995}]},{"osd":7,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.629},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":4.6420000000000003,"5min":4.6420000000000003,"15min":4.6420000000000003},"last":1.383}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":966656,"data_stored":735963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.433}]},{"osd":2,"last update":"Tue Apr 2 07:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.50900000000000001}]},{"osd":3,"last update":"Tue Apr 2 07:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.56100000000000005}]},{"osd":4,"last update":"Tue Apr 2 07:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.623},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.76000000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.70899999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.73799999999999999}]},{"osd":7,"last update":"Tue Apr 2 07:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.72099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:23:30.162 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:23:30.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.335+0000 7f87f7600640 1 Processor -- start 2024-04-02T07:23:30.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.335+0000 7f87f7600640 1 -- start start 2024-04-02T07:23:30.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.339+0000 7f87f7600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87f00b16e0 0x7f87f00b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:30.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.339+0000 7f87f7600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f00d01d0 con 0x7f87f00cfdf0 2024-04-02T07:23:30.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.339+0000 7f87f7600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f006c0e0 con 0x7f87f00b11f0 2024-04-02T07:23:30.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.339+0000 7f87f7600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f00b01d0 con 0x7f87f00b16e0 2024-04-02T07:23:30.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.339+0000 7f87e7e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87f00b16e0 0x7f87f00b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:30.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.339+0000 7f87e7e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87f00b16e0 0x7f87f00b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45630/0 (socket says 172.21.15.55:45630) 2024-04-02T07:23:30.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.339+0000 7f87e7e00640 1 -- 172.21.15.55:0/858835463 learned_addr learned my addr 172.21.15.55:0/858835463 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:30.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.339+0000 7f87f4c00640 1 --1- 172.21.15.55:0/858835463 >> v1:172.21.15.55:6789/0 conn(0x7f87f00cfdf0 0x7f87f006b8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46280/0 (socket says 172.21.15.55:46280) 2024-04-02T07:23:30.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.339+0000 7f87e7e00640 1 -- 172.21.15.55:0/858835463 >> v1:172.21.15.106:6789/0 conn(0x7f87f00b11f0 legacy=0x7f87f0098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:30.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.339+0000 7f87e7e00640 1 -- 172.21.15.55:0/858835463 >> v1:172.21.15.55:6789/0 conn(0x7f87f00cfdf0 legacy=0x7f87f006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:30.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.339+0000 7f87e7e00640 1 -- 172.21.15.55:0/858835463 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f00b04b0 con 0x7f87f00b16e0 2024-04-02T07:23:30.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.339+0000 7f87efe00640 1 -- 172.21.15.55:0/858835463 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2480073138 0 0) 0x7f87e0001120 con 0x7f87f00cfdf0 2024-04-02T07:23:30.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87e7e00640 1 --2- 172.21.15.55:0/858835463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87f00b16e0 0x7f87f00b0cb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009870 tx=0x7f87d801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=316ce5cb031203ad server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:30.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87efe00640 1 -- 172.21.15.55:0/858835463 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d80a9610 con 0x7f87f00b16e0 2024-04-02T07:23:30.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87efe00640 1 -- 172.21.15.55:0/858835463 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d80a9770 con 0x7f87f00b16e0 2024-04-02T07:23:30.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87efe00640 1 -- 172.21.15.55:0/858835463 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d80a9b00 con 0x7f87f00b16e0 2024-04-02T07:23:30.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87f7600640 1 -- 172.21.15.55:0/858835463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87f00b16e0 msgr2=0x7f87f00b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:30.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87f7600640 1 --2- 172.21.15.55:0/858835463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87f00b16e0 0x7f87f00b0cb0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f87d8009870 tx=0x7f87d801c530 comp rx=0 tx=0).stop 2024-04-02T07:23:30.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87f7600640 1 -- 172.21.15.55:0/858835463 shutdown_connections 2024-04-02T07:23:30.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87f7600640 1 --2- 172.21.15.55:0/858835463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87f00b16e0 0x7f87f00b0cb0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87f7600640 1 -- 172.21.15.55:0/858835463 >> 172.21.15.55:0/858835463 conn(0x7f87f00b2210 msgr2=0x7f87f00b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:30.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87f7600640 1 -- 172.21.15.55:0/858835463 shutdown_connections 2024-04-02T07:23:30.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87f7600640 1 -- 172.21.15.55:0/858835463 wait complete. 2024-04-02T07:23:30.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87f7600640 1 Processor -- start 2024-04-02T07:23:30.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87f7600640 1 -- start start 2024-04-02T07:23:30.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87f7600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87f00b11f0 0x7f87f00cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:30.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87f7600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87f00b16e0 0x7f87f00c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:30.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87f7600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87f00cfdf0 0x7f87f0159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:30.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87f7600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f00cbba0 con 0x7f87f00b16e0 2024-04-02T07:23:30.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87f7600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f00c5fc0 con 0x7f87f00b11f0 2024-04-02T07:23:30.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87f7600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f00c62a0 con 0x7f87f00cfdf0 2024-04-02T07:23:30.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87e7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87f00b16e0 0x7f87f00c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:30.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87e7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87f00b16e0 0x7f87f00c5770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45640/0 (socket says 172.21.15.55:45640) 2024-04-02T07:23:30.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.343+0000 7f87e7e00640 1 -- 172.21.15.55:0/475506348 learned_addr learned my addr 172.21.15.55:0/475506348 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:30.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.347+0000 7f87f5600640 1 --2- 172.21.15.55:0/475506348 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87f00cfdf0 0x7f87f0159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:30.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.347+0000 7f87f4c00640 1 --2- 172.21.15.55:0/475506348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87f00b11f0 0x7f87f00cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:30.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.347+0000 7f87e7e00640 1 -- 172.21.15.55:0/475506348 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87f00cfdf0 msgr2=0x7f87f0159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:30.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.347+0000 7f87e7e00640 1 --2- 172.21.15.55:0/475506348 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87f00cfdf0 0x7f87f0159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.347+0000 7f87e7e00640 1 -- 172.21.15.55:0/475506348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87f00b11f0 msgr2=0x7f87f00cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:30.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.347+0000 7f87e7e00640 1 --2- 172.21.15.55:0/475506348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87f00b11f0 0x7f87f00cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.347+0000 7f87e7e00640 1 -- 172.21.15.55:0/475506348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d80094d0 con 0x7f87f00b16e0 2024-04-02T07:23:30.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.347+0000 7f87f5600640 1 --2- 172.21.15.55:0/475506348 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87f00cfdf0 0x7f87f0159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:30.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.347+0000 7f87f4c00640 1 --2- 172.21.15.55:0/475506348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87f00b11f0 0x7f87f00cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:30.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.347+0000 7f87e7e00640 1 --2- 172.21.15.55:0/475506348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87f00b16e0 0x7f87f00c5770 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f87d801a160 tx=0x7f87d80192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:30.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.347+0000 7f87ed600640 1 -- 172.21.15.55:0/475506348 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d80a9e90 con 0x7f87f00b16e0 2024-04-02T07:23:30.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.347+0000 7f87ed600640 1 -- 172.21.15.55:0/475506348 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87d80b9420 con 0x7f87f00b16e0 2024-04-02T07:23:30.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.347+0000 7f87ed600640 1 -- 172.21.15.55:0/475506348 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87d80b97d0 con 0x7f87f00b16e0 2024-04-02T07:23:30.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.347+0000 7f87f7600640 1 -- 172.21.15.55:0/475506348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f00cae60 con 0x7f87f00b16e0 2024-04-02T07:23:30.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.347+0000 7f87f7600640 1 -- 172.21.15.55:0/475506348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f00c6580 con 0x7f87f00b16e0 2024-04-02T07:23:30.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.347+0000 7f87f7600640 1 -- 172.21.15.55:0/475506348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f0066c90 con 0x7f87f00b16e0 2024-04-02T07:23:30.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.347+0000 7f87ed600640 1 -- 172.21.15.55:0/475506348 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f87d80b13f0 con 0x7f87f00b16e0 2024-04-02T07:23:30.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.347+0000 7f87ed600640 1 --2- 172.21.15.55:0/475506348 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f87cc066690 0x7f87cc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:30.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.347+0000 7f87ed600640 1 -- 172.21.15.55:0/475506348 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f87d811e0b0 con 0x7f87f00b16e0 2024-04-02T07:23:30.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.351+0000 7f87f4c00640 1 --2- 172.21.15.55:0/475506348 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f87cc066690 0x7f87cc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:30.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.351+0000 7f87f4c00640 1 --2- 172.21.15.55:0/475506348 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f87cc066690 0x7f87cc068b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f87e0000f70 tx=0x7f87e0007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:30.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.351+0000 7f87ed600640 1 -- 172.21.15.55:0/475506348 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f87d80eb410 con 0x7f87f00b16e0 2024-04-02T07:23:30.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.507+0000 7f87f7600640 1 -- 172.21.15.55:0/475506348 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f87f00b3020 con 0x7f87cc066690 2024-04-02T07:23:30.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.515+0000 7f87ed600640 1 -- 172.21.15.55:0/475506348 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288501 (secure 0 0 0) 0x7f87f00b3020 con 0x7f87cc066690 2024-04-02T07:23:30.522 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:30.524 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:23:30.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.519+0000 7f87f7600640 1 -- 172.21.15.55:0/475506348 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f87cc066690 msgr2=0x7f87cc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:30.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.519+0000 7f87f7600640 1 --2- 172.21.15.55:0/475506348 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f87cc066690 0x7f87cc068b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f87e0000f70 tx=0x7f87e0007df0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.519+0000 7f87f7600640 1 -- 172.21.15.55:0/475506348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87f00b16e0 msgr2=0x7f87f00c5770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:30.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.519+0000 7f87f7600640 1 --2- 172.21.15.55:0/475506348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87f00b16e0 0x7f87f00c5770 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f87d801a160 tx=0x7f87d80192d0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.519+0000 7f87f7600640 1 -- 172.21.15.55:0/475506348 shutdown_connections 2024-04-02T07:23:30.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.519+0000 7f87f7600640 1 --2- 172.21.15.55:0/475506348 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87f00cfdf0 0x7f87f0159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.519+0000 7f87f7600640 1 --2- 172.21.15.55:0/475506348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87f00b16e0 0x7f87f00c5770 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.519+0000 7f87f7600640 1 --2- 172.21.15.55:0/475506348 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f87cc066690 0x7f87cc068b50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.519+0000 7f87f7600640 1 --2- 172.21.15.55:0/475506348 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87f00b11f0 0x7f87f00cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.519+0000 7f87f7600640 1 -- 172.21.15.55:0/475506348 >> 172.21.15.55:0/475506348 conn(0x7f87f00b2210 msgr2=0x7f87f0098a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:30.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.519+0000 7f87f7600640 1 -- 172.21.15.55:0/475506348 shutdown_connections 2024-04-02T07:23:30.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.519+0000 7f87f7600640 1 -- 172.21.15.55:0/475506348 wait complete. 2024-04-02T07:23:30.543 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":69,"stamp":"2024-04-02T07:23:30.350848+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":46,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236588,"kb_used_data":4028,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754738132,"statfs":{"total":773094113280,"available":772851847168,"internally_reserved":0,"allocated":4124672,"data_stored":2312341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":44,"apply_latency_ms":44,"commit_latency_ns":44000000,"apply_latency_ns":44000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001099"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.761229+0000","last_change":"2024-04-02T07:23:25.753884+0000","last_active":"2024-04-02T07:23:25.761229+0000","last_peered":"2024-04-02T07:23:25.761229+0000","last_clean":"2024-04-02T07:23:25.761229+0000","last_became_active":"2024-04-02T07:23:25.753645+0000","last_became_peered":"2024-04-02T07:23:25.753645+0000","last_unstale":"2024-04-02T07:23:25.761229+0000","last_undegraded":"2024-04-02T07:23:25.761229+0000","last_fullsized":"2024-04-02T07:23:25.761229+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:37:42.173429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.760982+0000","last_change":"2024-04-02T07:23:25.759497+0000","last_active":"2024-04-02T07:23:25.760982+0000","last_peered":"2024-04-02T07:23:25.760982+0000","last_clean":"2024-04-02T07:23:25.760982+0000","last_became_active":"2024-04-02T07:23:25.759249+0000","last_became_peered":"2024-04-02T07:23:25.759249+0000","last_unstale":"2024-04-02T07:23:25.760982+0000","last_undegraded":"2024-04-02T07:23:25.760982+0000","last_fullsized":"2024-04-02T07:23:25.760982+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:53:03.319419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.770854+0000","last_change":"2024-04-02T07:23:25.766731+0000","last_active":"2024-04-02T07:23:25.770854+0000","last_peered":"2024-04-02T07:23:25.770854+0000","last_clean":"2024-04-02T07:23:25.770854+0000","last_became_active":"2024-04-02T07:23:25.766410+0000","last_became_peered":"2024-04-02T07:23:25.766410+0000","last_unstale":"2024-04-02T07:23:25.770854+0000","last_undegraded":"2024-04-02T07:23:25.770854+0000","last_fullsized":"2024-04-02T07:23:25.770854+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:55.563309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.771916+0000","last_change":"2024-04-02T07:23:25.765696+0000","last_active":"2024-04-02T07:23:25.771916+0000","last_peered":"2024-04-02T07:23:25.771916+0000","last_clean":"2024-04-02T07:23:25.771916+0000","last_became_active":"2024-04-02T07:23:25.765100+0000","last_became_peered":"2024-04-02T07:23:25.765100+0000","last_unstale":"2024-04-02T07:23:25.771916+0000","last_undegraded":"2024-04-02T07:23:25.771916+0000","last_fullsized":"2024-04-02T07:23:25.771916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:11:24.616677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.763263+0000","last_change":"2024-04-02T07:23:25.757414+0000","last_active":"2024-04-02T07:23:25.763263+0000","last_peered":"2024-04-02T07:23:25.763263+0000","last_clean":"2024-04-02T07:23:25.763263+0000","last_became_active":"2024-04-02T07:23:25.757167+0000","last_became_peered":"2024-04-02T07:23:25.757167+0000","last_unstale":"2024-04-02T07:23:25.763263+0000","last_undegraded":"2024-04-02T07:23:25.763263+0000","last_fullsized":"2024-04-02T07:23:25.763263+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:48:02.771529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.756117+0000","last_change":"2024-04-02T07:23:25.749973+0000","last_active":"2024-04-02T07:23:25.756117+0000","last_peered":"2024-04-02T07:23:25.756117+0000","last_clean":"2024-04-02T07:23:25.756117+0000","last_became_active":"2024-04-02T07:23:25.749676+0000","last_became_peered":"2024-04-02T07:23:25.749676+0000","last_unstale":"2024-04-02T07:23:25.756117+0000","last_undegraded":"2024-04-02T07:23:25.756117+0000","last_fullsized":"2024-04-02T07:23:25.756117+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:33:05.852503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.757164+0000","last_change":"2024-04-02T07:23:25.751120+0000","last_active":"2024-04-02T07:23:25.757164+0000","last_peered":"2024-04-02T07:23:25.757164+0000","last_clean":"2024-04-02T07:23:25.757164+0000","last_became_active":"2024-04-02T07:23:25.750841+0000","last_became_peered":"2024-04-02T07:23:25.750841+0000","last_unstale":"2024-04-02T07:23:25.757164+0000","last_undegraded":"2024-04-02T07:23:25.757164+0000","last_fullsized":"2024-04-02T07:23:25.757164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:33.264955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.762101+0000","last_change":"2024-04-02T07:23:25.756789+0000","last_active":"2024-04-02T07:23:25.762101+0000","last_peered":"2024-04-02T07:23:25.762101+0000","last_clean":"2024-04-02T07:23:25.762101+0000","last_became_active":"2024-04-02T07:23:25.756516+0000","last_became_peered":"2024-04-02T07:23:25.756516+0000","last_unstale":"2024-04-02T07:23:25.762101+0000","last_undegraded":"2024-04-02T07:23:25.762101+0000","last_fullsized":"2024-04-02T07:23:25.762101+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:33:05.852503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.765665+0000","last_change":"2024-04-02T07:23:25.761410+0000","last_active":"2024-04-02T07:23:25.765665+0000","last_peered":"2024-04-02T07:23:25.765665+0000","last_clean":"2024-04-02T07:23:25.765665+0000","last_became_active":"2024-04-02T07:23:25.761104+0000","last_became_peered":"2024-04-02T07:23:25.761104+0000","last_unstale":"2024-04-02T07:23:25.765665+0000","last_undegraded":"2024-04-02T07:23:25.765665+0000","last_fullsized":"2024-04-02T07:23:25.765665+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:33:06.242431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.774788+0000","last_change":"2024-04-02T07:23:25.771654+0000","last_active":"2024-04-02T07:23:25.774788+0000","last_peered":"2024-04-02T07:23:25.774788+0000","last_clean":"2024-04-02T07:23:25.774788+0000","last_became_active":"2024-04-02T07:23:25.771431+0000","last_became_peered":"2024-04-02T07:23:25.771431+0000","last_unstale":"2024-04-02T07:23:25.774788+0000","last_undegraded":"2024-04-02T07:23:25.774788+0000","last_fullsized":"2024-04-02T07:23:25.774788+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:01:05.258579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.773392+0000","last_change":"2024-04-02T07:23:25.769705+0000","last_active":"2024-04-02T07:23:25.773392+0000","last_peered":"2024-04-02T07:23:25.773392+0000","last_clean":"2024-04-02T07:23:25.773392+0000","last_became_active":"2024-04-02T07:23:25.769470+0000","last_became_peered":"2024-04-02T07:23:25.769470+0000","last_unstale":"2024-04-02T07:23:25.773392+0000","last_undegraded":"2024-04-02T07:23:25.773392+0000","last_fullsized":"2024-04-02T07:23:25.773392+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:01:05.258579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.762426+0000","last_change":"2024-04-02T07:23:25.753681+0000","last_active":"2024-04-02T07:23:25.762426+0000","last_peered":"2024-04-02T07:23:25.762426+0000","last_clean":"2024-04-02T07:23:25.762426+0000","last_became_active":"2024-04-02T07:23:25.753415+0000","last_became_peered":"2024-04-02T07:23:25.753415+0000","last_unstale":"2024-04-02T07:23:25.762426+0000","last_undegraded":"2024-04-02T07:23:25.762426+0000","last_fullsized":"2024-04-02T07:23:25.762426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:23:43.517794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.763297+0000","last_change":"2024-04-02T07:23:25.758468+0000","last_active":"2024-04-02T07:23:25.763297+0000","last_peered":"2024-04-02T07:23:25.763297+0000","last_clean":"2024-04-02T07:23:25.763297+0000","last_became_active":"2024-04-02T07:23:25.758113+0000","last_became_peered":"2024-04-02T07:23:25.758113+0000","last_unstale":"2024-04-02T07:23:25.763297+0000","last_undegraded":"2024-04-02T07:23:25.763297+0000","last_fullsized":"2024-04-02T07:23:25.763297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:57:39.705151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.756984+0000","last_change":"2024-04-02T07:23:25.754359+0000","last_active":"2024-04-02T07:23:25.756984+0000","last_peered":"2024-04-02T07:23:25.756984+0000","last_clean":"2024-04-02T07:23:25.756984+0000","last_became_active":"2024-04-02T07:23:25.753354+0000","last_became_peered":"2024-04-02T07:23:25.753354+0000","last_unstale":"2024-04-02T07:23:25.756984+0000","last_undegraded":"2024-04-02T07:23:25.756984+0000","last_fullsized":"2024-04-02T07:23:25.756984+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:32:12.440577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.763080+0000","last_change":"2024-04-02T07:23:25.754436+0000","last_active":"2024-04-02T07:23:25.763080+0000","last_peered":"2024-04-02T07:23:25.763080+0000","last_clean":"2024-04-02T07:23:25.763080+0000","last_became_active":"2024-04-02T07:23:25.754196+0000","last_became_peered":"2024-04-02T07:23:25.754196+0000","last_unstale":"2024-04-02T07:23:25.763080+0000","last_undegraded":"2024-04-02T07:23:25.763080+0000","last_fullsized":"2024-04-02T07:23:25.763080+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:01:05.258579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.762119+0000","last_change":"2024-04-02T07:23:25.757410+0000","last_active":"2024-04-02T07:23:25.762119+0000","last_peered":"2024-04-02T07:23:25.762119+0000","last_clean":"2024-04-02T07:23:25.762119+0000","last_became_active":"2024-04-02T07:23:25.757131+0000","last_became_peered":"2024-04-02T07:23:25.757131+0000","last_unstale":"2024-04-02T07:23:25.762119+0000","last_undegraded":"2024-04-02T07:23:25.762119+0000","last_fullsized":"2024-04-02T07:23:25.762119+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:23:43.517794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.767609+0000","last_change":"2024-04-02T07:23:25.765349+0000","last_active":"2024-04-02T07:23:25.767609+0000","last_peered":"2024-04-02T07:23:25.767609+0000","last_clean":"2024-04-02T07:23:25.767609+0000","last_became_active":"2024-04-02T07:23:25.764524+0000","last_became_peered":"2024-04-02T07:23:25.764524+0000","last_unstale":"2024-04-02T07:23:25.767609+0000","last_undegraded":"2024-04-02T07:23:25.767609+0000","last_fullsized":"2024-04-02T07:23:25.767609+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:55.563309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.770527+0000","last_change":"2024-04-02T07:23:25.767344+0000","last_active":"2024-04-02T07:23:25.770527+0000","last_peered":"2024-04-02T07:23:25.770527+0000","last_clean":"2024-04-02T07:23:25.770527+0000","last_became_active":"2024-04-02T07:23:25.767063+0000","last_became_peered":"2024-04-02T07:23:25.767063+0000","last_unstale":"2024-04-02T07:23:25.770527+0000","last_undegraded":"2024-04-02T07:23:25.770527+0000","last_fullsized":"2024-04-02T07:23:25.770527+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:57:03.351637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.770805+0000","last_change":"2024-04-02T07:23:25.767442+0000","last_active":"2024-04-02T07:23:25.770805+0000","last_peered":"2024-04-02T07:23:25.770805+0000","last_clean":"2024-04-02T07:23:25.770805+0000","last_became_active":"2024-04-02T07:23:25.767169+0000","last_became_peered":"2024-04-02T07:23:25.767169+0000","last_unstale":"2024-04-02T07:23:25.770805+0000","last_undegraded":"2024-04-02T07:23:25.770805+0000","last_fullsized":"2024-04-02T07:23:25.770805+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:26:49.378658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.761979+0000","last_change":"2024-04-02T07:23:25.755186+0000","last_active":"2024-04-02T07:23:25.761979+0000","last_peered":"2024-04-02T07:23:25.761979+0000","last_clean":"2024-04-02T07:23:25.761979+0000","last_became_active":"2024-04-02T07:23:25.754942+0000","last_became_peered":"2024-04-02T07:23:25.754942+0000","last_unstale":"2024-04-02T07:23:25.761979+0000","last_undegraded":"2024-04-02T07:23:25.761979+0000","last_fullsized":"2024-04-02T07:23:25.761979+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:59:33.900364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.761849+0000","last_change":"2024-04-02T07:23:25.754694+0000","last_active":"2024-04-02T07:23:25.761849+0000","last_peered":"2024-04-02T07:23:25.761849+0000","last_clean":"2024-04-02T07:23:25.761849+0000","last_became_active":"2024-04-02T07:23:25.754441+0000","last_became_peered":"2024-04-02T07:23:25.754441+0000","last_unstale":"2024-04-02T07:23:25.761849+0000","last_undegraded":"2024-04-02T07:23:25.761849+0000","last_fullsized":"2024-04-02T07:23:25.761849+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:23:43.517794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.754323+0000","last_change":"2024-04-02T07:23:25.748488+0000","last_active":"2024-04-02T07:23:25.754323+0000","last_peered":"2024-04-02T07:23:25.754323+0000","last_clean":"2024-04-02T07:23:25.754323+0000","last_became_active":"2024-04-02T07:23:25.747897+0000","last_became_peered":"2024-04-02T07:23:25.747897+0000","last_unstale":"2024-04-02T07:23:25.754323+0000","last_undegraded":"2024-04-02T07:23:25.754323+0000","last_fullsized":"2024-04-02T07:23:25.754323+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:27:03.804725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.759325+0000","last_change":"2024-04-02T07:23:25.753856+0000","last_active":"2024-04-02T07:23:25.759325+0000","last_peered":"2024-04-02T07:23:25.759325+0000","last_clean":"2024-04-02T07:23:25.759325+0000","last_became_active":"2024-04-02T07:23:25.753600+0000","last_became_peered":"2024-04-02T07:23:25.753600+0000","last_unstale":"2024-04-02T07:23:25.759325+0000","last_undegraded":"2024-04-02T07:23:25.759325+0000","last_fullsized":"2024-04-02T07:23:25.759325+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:50:57.979986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.767640+0000","last_change":"2024-04-02T07:23:25.759203+0000","last_active":"2024-04-02T07:23:25.767640+0000","last_peered":"2024-04-02T07:23:25.767640+0000","last_clean":"2024-04-02T07:23:25.767640+0000","last_became_active":"2024-04-02T07:23:25.758869+0000","last_became_peered":"2024-04-02T07:23:25.758869+0000","last_unstale":"2024-04-02T07:23:25.767640+0000","last_undegraded":"2024-04-02T07:23:25.767640+0000","last_fullsized":"2024-04-02T07:23:25.767640+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:07:08.542685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.774917+0000","last_change":"2024-04-02T07:23:25.773238+0000","last_active":"2024-04-02T07:23:25.774917+0000","last_peered":"2024-04-02T07:23:25.774917+0000","last_clean":"2024-04-02T07:23:25.774917+0000","last_became_active":"2024-04-02T07:23:25.772027+0000","last_became_peered":"2024-04-02T07:23:25.772027+0000","last_unstale":"2024-04-02T07:23:25.774917+0000","last_undegraded":"2024-04-02T07:23:25.774917+0000","last_fullsized":"2024-04-02T07:23:25.774917+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:26:49.378658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.756898+0000","last_change":"2024-04-02T07:23:25.754187+0000","last_active":"2024-04-02T07:23:25.756898+0000","last_peered":"2024-04-02T07:23:25.756898+0000","last_clean":"2024-04-02T07:23:25.756898+0000","last_became_active":"2024-04-02T07:23:25.753756+0000","last_became_peered":"2024-04-02T07:23:25.753756+0000","last_unstale":"2024-04-02T07:23:25.756898+0000","last_undegraded":"2024-04-02T07:23:25.756898+0000","last_fullsized":"2024-04-02T07:23:25.756898+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:07:08.542685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.774824+0000","last_change":"2024-04-02T07:23:25.772532+0000","last_active":"2024-04-02T07:23:25.774824+0000","last_peered":"2024-04-02T07:23:25.774824+0000","last_clean":"2024-04-02T07:23:25.774824+0000","last_became_active":"2024-04-02T07:23:25.767617+0000","last_became_peered":"2024-04-02T07:23:25.767617+0000","last_unstale":"2024-04-02T07:23:25.774824+0000","last_undegraded":"2024-04-02T07:23:25.774824+0000","last_fullsized":"2024-04-02T07:23:25.774824+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:55.563309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.767684+0000","last_change":"2024-04-02T07:23:25.761081+0000","last_active":"2024-04-02T07:23:25.767684+0000","last_peered":"2024-04-02T07:23:25.767684+0000","last_clean":"2024-04-02T07:23:25.767684+0000","last_became_active":"2024-04-02T07:23:25.760834+0000","last_became_peered":"2024-04-02T07:23:25.760834+0000","last_unstale":"2024-04-02T07:23:25.767684+0000","last_undegraded":"2024-04-02T07:23:25.767684+0000","last_fullsized":"2024-04-02T07:23:25.767684+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:10:29.399488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.755453+0000","last_change":"2024-04-02T07:23:25.746792+0000","last_active":"2024-04-02T07:23:25.755453+0000","last_peered":"2024-04-02T07:23:25.755453+0000","last_clean":"2024-04-02T07:23:25.755453+0000","last_became_active":"2024-04-02T07:23:25.746529+0000","last_became_peered":"2024-04-02T07:23:25.746529+0000","last_unstale":"2024-04-02T07:23:25.755453+0000","last_undegraded":"2024-04-02T07:23:25.755453+0000","last_fullsized":"2024-04-02T07:23:25.755453+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:47:25.777640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.765023+0000","last_change":"2024-04-02T07:23:25.760987+0000","last_active":"2024-04-02T07:23:25.765023+0000","last_peered":"2024-04-02T07:23:25.765023+0000","last_clean":"2024-04-02T07:23:25.765023+0000","last_became_active":"2024-04-02T07:23:25.760626+0000","last_became_peered":"2024-04-02T07:23:25.760626+0000","last_unstale":"2024-04-02T07:23:25.765023+0000","last_undegraded":"2024-04-02T07:23:25.765023+0000","last_fullsized":"2024-04-02T07:23:25.765023+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:07:08.542685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.762463+0000","last_change":"2024-04-02T07:23:25.754145+0000","last_active":"2024-04-02T07:23:25.762463+0000","last_peered":"2024-04-02T07:23:25.762463+0000","last_clean":"2024-04-02T07:23:25.762463+0000","last_became_active":"2024-04-02T07:23:25.753057+0000","last_became_peered":"2024-04-02T07:23:25.753057+0000","last_unstale":"2024-04-02T07:23:25.762463+0000","last_undegraded":"2024-04-02T07:23:25.762463+0000","last_fullsized":"2024-04-02T07:23:25.762463+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:33.264955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.764311+0000","last_change":"2024-04-02T07:23:25.759494+0000","last_active":"2024-04-02T07:23:25.764311+0000","last_peered":"2024-04-02T07:23:25.764311+0000","last_clean":"2024-04-02T07:23:25.764311+0000","last_became_active":"2024-04-02T07:23:25.759265+0000","last_became_peered":"2024-04-02T07:23:25.759265+0000","last_unstale":"2024-04-02T07:23:25.764311+0000","last_undegraded":"2024-04-02T07:23:25.764311+0000","last_fullsized":"2024-04-02T07:23:25.764311+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:10:29.399488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.763783+0000","last_change":"2024-04-02T07:23:25.761525+0000","last_active":"2024-04-02T07:23:25.763783+0000","last_peered":"2024-04-02T07:23:25.763783+0000","last_clean":"2024-04-02T07:23:25.763783+0000","last_became_active":"2024-04-02T07:23:25.761218+0000","last_became_peered":"2024-04-02T07:23:25.761218+0000","last_unstale":"2024-04-02T07:23:25.763783+0000","last_undegraded":"2024-04-02T07:23:25.763783+0000","last_fullsized":"2024-04-02T07:23:25.763783+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:47:25.777640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.763568+0000","last_change":"2024-04-02T07:23:25.345573+0000","last_active":"2024-04-02T07:23:25.763568+0000","last_peered":"2024-04-02T07:23:25.763568+0000","last_clean":"2024-04-02T07:23:25.763568+0000","last_became_active":"2024-04-02T07:23:25.344846+0000","last_became_peered":"2024-04-02T07:23:25.344846+0000","last_unstale":"2024-04-02T07:23:25.763568+0000","last_undegraded":"2024-04-02T07:23:25.763568+0000","last_fullsized":"2024-04-02T07:23:25.763568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:30:55.598213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.759606+0000","last_change":"2024-04-02T07:23:25.748665+0000","last_active":"2024-04-02T07:23:25.759606+0000","last_peered":"2024-04-02T07:23:25.759606+0000","last_clean":"2024-04-02T07:23:25.759606+0000","last_became_active":"2024-04-02T07:23:25.748420+0000","last_became_peered":"2024-04-02T07:23:25.748420+0000","last_unstale":"2024-04-02T07:23:25.759606+0000","last_undegraded":"2024-04-02T07:23:25.759606+0000","last_fullsized":"2024-04-02T07:23:25.759606+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:33:06.242431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.761167+0000","last_change":"2024-04-02T07:23:25.353890+0000","last_active":"2024-04-02T07:23:25.761167+0000","last_peered":"2024-04-02T07:23:25.761167+0000","last_clean":"2024-04-02T07:23:25.761167+0000","last_became_active":"2024-04-02T07:23:25.353659+0000","last_became_peered":"2024-04-02T07:23:25.353659+0000","last_unstale":"2024-04-02T07:23:25.761167+0000","last_undegraded":"2024-04-02T07:23:25.761167+0000","last_fullsized":"2024-04-02T07:23:25.761167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:42:00.093702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.762617+0000","last_change":"2024-04-02T07:23:25.758584+0000","last_active":"2024-04-02T07:23:25.762617+0000","last_peered":"2024-04-02T07:23:25.762617+0000","last_clean":"2024-04-02T07:23:25.762617+0000","last_became_active":"2024-04-02T07:23:25.758270+0000","last_became_peered":"2024-04-02T07:23:25.758270+0000","last_unstale":"2024-04-02T07:23:25.762617+0000","last_undegraded":"2024-04-02T07:23:25.762617+0000","last_fullsized":"2024-04-02T07:23:25.762617+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:08:08.568590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.771427+0000","last_change":"2024-04-02T07:23:25.344844+0000","last_active":"2024-04-02T07:23:25.771427+0000","last_peered":"2024-04-02T07:23:25.771427+0000","last_clean":"2024-04-02T07:23:25.771427+0000","last_became_active":"2024-04-02T07:23:25.344584+0000","last_became_peered":"2024-04-02T07:23:25.344584+0000","last_unstale":"2024-04-02T07:23:25.771427+0000","last_undegraded":"2024-04-02T07:23:25.771427+0000","last_fullsized":"2024-04-02T07:23:25.771427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:23:07.294625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.771042+0000","last_change":"2024-04-02T07:23:25.768177+0000","last_active":"2024-04-02T07:23:25.771042+0000","last_peered":"2024-04-02T07:23:25.771042+0000","last_clean":"2024-04-02T07:23:25.771042+0000","last_became_active":"2024-04-02T07:23:25.767130+0000","last_became_peered":"2024-04-02T07:23:25.767130+0000","last_unstale":"2024-04-02T07:23:25.771042+0000","last_undegraded":"2024-04-02T07:23:25.771042+0000","last_fullsized":"2024-04-02T07:23:25.771042+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:49:29.388659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.756066+0000","last_change":"2024-04-02T07:23:25.358060+0000","last_active":"2024-04-02T07:23:25.756066+0000","last_peered":"2024-04-02T07:23:25.756066+0000","last_clean":"2024-04-02T07:23:25.756066+0000","last_became_active":"2024-04-02T07:23:25.357771+0000","last_became_peered":"2024-04-02T07:23:25.357771+0000","last_unstale":"2024-04-02T07:23:25.756066+0000","last_undegraded":"2024-04-02T07:23:25.756066+0000","last_fullsized":"2024-04-02T07:23:25.756066+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:30:58.276742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.764640+0000","last_change":"2024-04-02T07:23:25.757878+0000","last_active":"2024-04-02T07:23:25.764640+0000","last_peered":"2024-04-02T07:23:25.764640+0000","last_clean":"2024-04-02T07:23:25.764640+0000","last_became_active":"2024-04-02T07:23:25.757705+0000","last_became_peered":"2024-04-02T07:23:25.757705+0000","last_unstale":"2024-04-02T07:23:25.764640+0000","last_undegraded":"2024-04-02T07:23:25.764640+0000","last_fullsized":"2024-04-02T07:23:25.764640+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:11:24.616677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.762113+0000","last_change":"2024-04-02T07:23:25.347587+0000","last_active":"2024-04-02T07:23:25.762113+0000","last_peered":"2024-04-02T07:23:25.762113+0000","last_clean":"2024-04-02T07:23:25.762113+0000","last_became_active":"2024-04-02T07:23:25.347350+0000","last_became_peered":"2024-04-02T07:23:25.347350+0000","last_unstale":"2024-04-02T07:23:25.762113+0000","last_undegraded":"2024-04-02T07:23:25.762113+0000","last_fullsized":"2024-04-02T07:23:25.762113+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:13:58.149984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.760722+0000","last_change":"2024-04-02T07:23:25.753390+0000","last_active":"2024-04-02T07:23:25.760722+0000","last_peered":"2024-04-02T07:23:25.760722+0000","last_clean":"2024-04-02T07:23:25.760722+0000","last_became_active":"2024-04-02T07:23:25.753075+0000","last_became_peered":"2024-04-02T07:23:25.753075+0000","last_unstale":"2024-04-02T07:23:25.760722+0000","last_undegraded":"2024-04-02T07:23:25.760722+0000","last_fullsized":"2024-04-02T07:23:25.760722+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:26:49.378658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.760391+0000","last_change":"2024-04-02T07:23:25.348159+0000","last_active":"2024-04-02T07:23:25.760391+0000","last_peered":"2024-04-02T07:23:25.760391+0000","last_clean":"2024-04-02T07:23:25.760391+0000","last_became_active":"2024-04-02T07:23:25.345987+0000","last_became_peered":"2024-04-02T07:23:25.345987+0000","last_unstale":"2024-04-02T07:23:25.760391+0000","last_undegraded":"2024-04-02T07:23:25.760391+0000","last_fullsized":"2024-04-02T07:23:25.760391+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:30:58.276742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.758574+0000","last_change":"2024-04-02T07:23:25.748627+0000","last_active":"2024-04-02T07:23:25.758574+0000","last_peered":"2024-04-02T07:23:25.758574+0000","last_clean":"2024-04-02T07:23:25.758574+0000","last_became_active":"2024-04-02T07:23:25.747489+0000","last_became_peered":"2024-04-02T07:23:25.747489+0000","last_unstale":"2024-04-02T07:23:25.758574+0000","last_undegraded":"2024-04-02T07:23:25.758574+0000","last_fullsized":"2024-04-02T07:23:25.758574+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:01:44.731845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.736357+0000","last_change":"2024-04-02T07:23:25.352810+0000","last_active":"2024-04-02T07:23:25.736357+0000","last_peered":"2024-04-02T07:23:25.736357+0000","last_clean":"2024-04-02T07:23:25.736357+0000","last_became_active":"2024-04-02T07:23:25.352224+0000","last_became_peered":"2024-04-02T07:23:25.352224+0000","last_unstale":"2024-04-02T07:23:25.736357+0000","last_undegraded":"2024-04-02T07:23:25.736357+0000","last_fullsized":"2024-04-02T07:23:25.736357+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:22:32.464837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.770876+0000","last_change":"2024-04-02T07:23:25.764861+0000","last_active":"2024-04-02T07:23:25.770876+0000","last_peered":"2024-04-02T07:23:25.770876+0000","last_clean":"2024-04-02T07:23:25.770876+0000","last_became_active":"2024-04-02T07:23:25.764583+0000","last_became_peered":"2024-04-02T07:23:25.764583+0000","last_unstale":"2024-04-02T07:23:25.770876+0000","last_undegraded":"2024-04-02T07:23:25.770876+0000","last_fullsized":"2024-04-02T07:23:25.770876+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:10:29.399488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.733253+0000","last_change":"2024-04-02T07:23:25.344321+0000","last_active":"2024-04-02T07:23:25.733253+0000","last_peered":"2024-04-02T07:23:25.733253+0000","last_clean":"2024-04-02T07:23:25.733253+0000","last_became_active":"2024-04-02T07:23:25.343928+0000","last_became_peered":"2024-04-02T07:23:25.343928+0000","last_unstale":"2024-04-02T07:23:25.733253+0000","last_undegraded":"2024-04-02T07:23:25.733253+0000","last_fullsized":"2024-04-02T07:23:25.733253+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:20:20.029156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.762395+0000","last_change":"2024-04-02T07:23:25.757655+0000","last_active":"2024-04-02T07:23:25.762395+0000","last_peered":"2024-04-02T07:23:25.762395+0000","last_clean":"2024-04-02T07:23:25.762395+0000","last_became_active":"2024-04-02T07:23:25.757311+0000","last_became_peered":"2024-04-02T07:23:25.757311+0000","last_unstale":"2024-04-02T07:23:25.762395+0000","last_undegraded":"2024-04-02T07:23:25.762395+0000","last_fullsized":"2024-04-02T07:23:25.762395+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:47:25.777640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.736968+0000","last_change":"2024-04-02T07:23:25.348462+0000","last_active":"2024-04-02T07:23:25.736968+0000","last_peered":"2024-04-02T07:23:25.736968+0000","last_clean":"2024-04-02T07:23:25.736968+0000","last_became_active":"2024-04-02T07:23:25.348163+0000","last_became_peered":"2024-04-02T07:23:25.348163+0000","last_unstale":"2024-04-02T07:23:25.736968+0000","last_undegraded":"2024-04-02T07:23:25.736968+0000","last_fullsized":"2024-04-02T07:23:25.736968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:48:01.765589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.770507+0000","last_change":"2024-04-02T07:23:25.767912+0000","last_active":"2024-04-02T07:23:25.770507+0000","last_peered":"2024-04-02T07:23:25.770507+0000","last_clean":"2024-04-02T07:23:25.770507+0000","last_became_active":"2024-04-02T07:23:25.767638+0000","last_became_peered":"2024-04-02T07:23:25.767638+0000","last_unstale":"2024-04-02T07:23:25.770507+0000","last_undegraded":"2024-04-02T07:23:25.770507+0000","last_fullsized":"2024-04-02T07:23:25.770507+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:10:29.399488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.749873+0000","last_change":"2024-04-02T07:23:25.354817+0000","last_active":"2024-04-02T07:23:25.749873+0000","last_peered":"2024-04-02T07:23:25.749873+0000","last_clean":"2024-04-02T07:23:25.749873+0000","last_became_active":"2024-04-02T07:23:25.354588+0000","last_became_peered":"2024-04-02T07:23:25.354588+0000","last_unstale":"2024-04-02T07:23:25.749873+0000","last_undegraded":"2024-04-02T07:23:25.749873+0000","last_fullsized":"2024-04-02T07:23:25.749873+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:52:42.539175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.757017+0000","last_change":"2024-04-02T07:23:25.753611+0000","last_active":"2024-04-02T07:23:25.757017+0000","last_peered":"2024-04-02T07:23:25.757017+0000","last_clean":"2024-04-02T07:23:25.757017+0000","last_became_active":"2024-04-02T07:23:25.753311+0000","last_became_peered":"2024-04-02T07:23:25.753311+0000","last_unstale":"2024-04-02T07:23:25.757017+0000","last_undegraded":"2024-04-02T07:23:25.757017+0000","last_fullsized":"2024-04-02T07:23:25.757017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:23:45.094009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.753641+0000","last_change":"2024-04-02T07:23:25.348520+0000","last_active":"2024-04-02T07:23:25.753641+0000","last_peered":"2024-04-02T07:23:25.753641+0000","last_clean":"2024-04-02T07:23:25.753641+0000","last_became_active":"2024-04-02T07:23:25.347694+0000","last_became_peered":"2024-04-02T07:23:25.347694+0000","last_unstale":"2024-04-02T07:23:25.753641+0000","last_undegraded":"2024-04-02T07:23:25.753641+0000","last_fullsized":"2024-04-02T07:23:25.753641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:23:07.294625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.770865+0000","last_change":"2024-04-02T07:23:25.767240+0000","last_active":"2024-04-02T07:23:25.770865+0000","last_peered":"2024-04-02T07:23:25.770865+0000","last_clean":"2024-04-02T07:23:25.770865+0000","last_became_active":"2024-04-02T07:23:25.767029+0000","last_became_peered":"2024-04-02T07:23:25.767029+0000","last_unstale":"2024-04-02T07:23:25.770865+0000","last_undegraded":"2024-04-02T07:23:25.770865+0000","last_fullsized":"2024-04-02T07:23:25.770865+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:11:24.616677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":16,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.776959+0000","last_change":"2024-04-02T07:23:25.345908+0000","last_active":"2024-04-02T07:23:25.776959+0000","last_peered":"2024-04-02T07:23:25.776959+0000","last_clean":"2024-04-02T07:23:25.776959+0000","last_became_active":"2024-04-02T07:23:25.345647+0000","last_became_peered":"2024-04-02T07:23:25.345647+0000","last_unstale":"2024-04-02T07:23:25.776959+0000","last_undegraded":"2024-04-02T07:23:25.776959+0000","last_fullsized":"2024-04-02T07:23:25.776959+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:59:32.894424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.770189+0000","last_change":"2024-04-02T07:23:25.763734+0000","last_active":"2024-04-02T07:23:25.770189+0000","last_peered":"2024-04-02T07:23:25.770189+0000","last_clean":"2024-04-02T07:23:25.770189+0000","last_became_active":"2024-04-02T07:23:25.762742+0000","last_became_peered":"2024-04-02T07:23:25.762742+0000","last_unstale":"2024-04-02T07:23:25.770189+0000","last_undegraded":"2024-04-02T07:23:25.770189+0000","last_fullsized":"2024-04-02T07:23:25.770189+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:57:03.351637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.765158+0000","last_change":"2024-04-02T07:23:25.341421+0000","last_active":"2024-04-02T07:23:25.765158+0000","last_peered":"2024-04-02T07:23:25.765158+0000","last_clean":"2024-04-02T07:23:25.765158+0000","last_became_active":"2024-04-02T07:23:25.341155+0000","last_became_peered":"2024-04-02T07:23:25.341155+0000","last_unstale":"2024-04-02T07:23:25.765158+0000","last_undegraded":"2024-04-02T07:23:25.765158+0000","last_fullsized":"2024-04-02T07:23:25.765158+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:56:49.611080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.759438+0000","last_change":"2024-04-02T07:23:25.755957+0000","last_active":"2024-04-02T07:23:25.759438+0000","last_peered":"2024-04-02T07:23:25.759438+0000","last_clean":"2024-04-02T07:23:25.759438+0000","last_became_active":"2024-04-02T07:23:25.755688+0000","last_became_peered":"2024-04-02T07:23:25.755688+0000","last_unstale":"2024-04-02T07:23:25.759438+0000","last_undegraded":"2024-04-02T07:23:25.759438+0000","last_fullsized":"2024-04-02T07:23:25.759438+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:06:31.149778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.769288+0000","last_change":"2024-04-02T07:23:25.345787+0000","last_active":"2024-04-02T07:23:25.769288+0000","last_peered":"2024-04-02T07:23:25.769288+0000","last_clean":"2024-04-02T07:23:25.769288+0000","last_became_active":"2024-04-02T07:23:25.345247+0000","last_became_peered":"2024-04-02T07:23:25.345247+0000","last_unstale":"2024-04-02T07:23:25.769288+0000","last_undegraded":"2024-04-02T07:23:25.769288+0000","last_fullsized":"2024-04-02T07:23:25.769288+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:30:55.598213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.764333+0000","last_change":"2024-04-02T07:23:25.759585+0000","last_active":"2024-04-02T07:23:25.764333+0000","last_peered":"2024-04-02T07:23:25.764333+0000","last_clean":"2024-04-02T07:23:25.764333+0000","last_became_active":"2024-04-02T07:23:25.759334+0000","last_became_peered":"2024-04-02T07:23:25.759334+0000","last_unstale":"2024-04-02T07:23:25.764333+0000","last_undegraded":"2024-04-02T07:23:25.764333+0000","last_fullsized":"2024-04-02T07:23:25.764333+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:57:03.351637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.736393+0000","last_change":"2024-04-02T07:23:25.344501+0000","last_active":"2024-04-02T07:23:25.736393+0000","last_peered":"2024-04-02T07:23:25.736393+0000","last_clean":"2024-04-02T07:23:25.736393+0000","last_became_active":"2024-04-02T07:23:25.344171+0000","last_became_peered":"2024-04-02T07:23:25.344171+0000","last_unstale":"2024-04-02T07:23:25.736393+0000","last_undegraded":"2024-04-02T07:23:25.736393+0000","last_fullsized":"2024-04-02T07:23:25.736393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:14:17.359308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.763390+0000","last_change":"2024-04-02T07:23:25.756279+0000","last_active":"2024-04-02T07:23:25.763390+0000","last_peered":"2024-04-02T07:23:25.763390+0000","last_clean":"2024-04-02T07:23:25.763390+0000","last_became_active":"2024-04-02T07:23:25.755998+0000","last_became_peered":"2024-04-02T07:23:25.755998+0000","last_unstale":"2024-04-02T07:23:25.763390+0000","last_undegraded":"2024-04-02T07:23:25.763390+0000","last_fullsized":"2024-04-02T07:23:25.763390+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:08:08.568590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.770731+0000","last_change":"2024-04-02T07:23:25.346051+0000","last_active":"2024-04-02T07:23:25.770731+0000","last_peered":"2024-04-02T07:23:25.770731+0000","last_clean":"2024-04-02T07:23:25.770731+0000","last_became_active":"2024-04-02T07:23:25.345740+0000","last_became_peered":"2024-04-02T07:23:25.345740+0000","last_unstale":"2024-04-02T07:23:25.770731+0000","last_undegraded":"2024-04-02T07:23:25.770731+0000","last_fullsized":"2024-04-02T07:23:25.770731+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:30:55.598213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.760062+0000","last_change":"2024-04-02T07:23:25.753648+0000","last_active":"2024-04-02T07:23:25.760062+0000","last_peered":"2024-04-02T07:23:25.760062+0000","last_clean":"2024-04-02T07:23:25.760062+0000","last_became_active":"2024-04-02T07:23:25.753349+0000","last_became_peered":"2024-04-02T07:23:25.753349+0000","last_unstale":"2024-04-02T07:23:25.760062+0000","last_undegraded":"2024-04-02T07:23:25.760062+0000","last_fullsized":"2024-04-02T07:23:25.760062+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:37:42.173429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.777140+0000","last_change":"2024-04-02T07:23:25.355369+0000","last_active":"2024-04-02T07:23:25.777140+0000","last_peered":"2024-04-02T07:23:25.777140+0000","last_clean":"2024-04-02T07:23:25.777140+0000","last_became_active":"2024-04-02T07:23:25.354543+0000","last_became_peered":"2024-04-02T07:23:25.354543+0000","last_unstale":"2024-04-02T07:23:25.777140+0000","last_undegraded":"2024-04-02T07:23:25.777140+0000","last_fullsized":"2024-04-02T07:23:25.777140+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:23:07.294625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.762362+0000","last_change":"2024-04-02T07:23:25.755314+0000","last_active":"2024-04-02T07:23:25.762362+0000","last_peered":"2024-04-02T07:23:25.762362+0000","last_clean":"2024-04-02T07:23:25.762362+0000","last_became_active":"2024-04-02T07:23:25.755026+0000","last_became_peered":"2024-04-02T07:23:25.755026+0000","last_unstale":"2024-04-02T07:23:25.762362+0000","last_undegraded":"2024-04-02T07:23:25.762362+0000","last_fullsized":"2024-04-02T07:23:25.762362+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:49:29.388659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.764364+0000","last_change":"2024-04-02T07:23:25.341985+0000","last_active":"2024-04-02T07:23:25.764364+0000","last_peered":"2024-04-02T07:23:25.764364+0000","last_clean":"2024-04-02T07:23:25.764364+0000","last_became_active":"2024-04-02T07:23:25.341700+0000","last_became_peered":"2024-04-02T07:23:25.341700+0000","last_unstale":"2024-04-02T07:23:25.764364+0000","last_undegraded":"2024-04-02T07:23:25.764364+0000","last_fullsized":"2024-04-02T07:23:25.764364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:48:28.211677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.771959+0000","last_change":"2024-04-02T07:23:25.765855+0000","last_active":"2024-04-02T07:23:25.771959+0000","last_peered":"2024-04-02T07:23:25.771959+0000","last_clean":"2024-04-02T07:23:25.771959+0000","last_became_active":"2024-04-02T07:23:25.765498+0000","last_became_peered":"2024-04-02T07:23:25.765498+0000","last_unstale":"2024-04-02T07:23:25.771959+0000","last_undegraded":"2024-04-02T07:23:25.771959+0000","last_fullsized":"2024-04-02T07:23:25.771959+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:11:33.264955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.762386+0000","last_change":"2024-04-02T07:23:25.352002+0000","last_active":"2024-04-02T07:23:25.762386+0000","last_peered":"2024-04-02T07:23:25.762386+0000","last_clean":"2024-04-02T07:23:25.762386+0000","last_became_active":"2024-04-02T07:23:25.351711+0000","last_became_peered":"2024-04-02T07:23:25.351711+0000","last_unstale":"2024-04-02T07:23:25.762386+0000","last_undegraded":"2024-04-02T07:23:25.762386+0000","last_fullsized":"2024-04-02T07:23:25.762386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:33:29.504833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.754257+0000","last_change":"2024-04-02T07:23:25.751143+0000","last_active":"2024-04-02T07:23:25.754257+0000","last_peered":"2024-04-02T07:23:25.754257+0000","last_clean":"2024-04-02T07:23:25.754257+0000","last_became_active":"2024-04-02T07:23:25.750889+0000","last_became_peered":"2024-04-02T07:23:25.750889+0000","last_unstale":"2024-04-02T07:23:25.754257+0000","last_undegraded":"2024-04-02T07:23:25.754257+0000","last_fullsized":"2024-04-02T07:23:25.754257+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:27:03.804725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.733544+0000","last_change":"2024-04-02T07:23:25.346623+0000","last_active":"2024-04-02T07:23:25.733544+0000","last_peered":"2024-04-02T07:23:25.733544+0000","last_clean":"2024-04-02T07:23:25.733544+0000","last_became_active":"2024-04-02T07:23:25.346377+0000","last_became_peered":"2024-04-02T07:23:25.346377+0000","last_unstale":"2024-04-02T07:23:25.733544+0000","last_undegraded":"2024-04-02T07:23:25.733544+0000","last_fullsized":"2024-04-02T07:23:25.733544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:38:49.075746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.763090+0000","last_change":"2024-04-02T07:23:25.756908+0000","last_active":"2024-04-02T07:23:25.763090+0000","last_peered":"2024-04-02T07:23:25.763090+0000","last_clean":"2024-04-02T07:23:25.763090+0000","last_became_active":"2024-04-02T07:23:25.756621+0000","last_became_peered":"2024-04-02T07:23:25.756621+0000","last_unstale":"2024-04-02T07:23:25.763090+0000","last_undegraded":"2024-04-02T07:23:25.763090+0000","last_fullsized":"2024-04-02T07:23:25.763090+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:30:56.604153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.760438+0000","last_change":"2024-04-02T07:23:25.352321+0000","last_active":"2024-04-02T07:23:25.760438+0000","last_peered":"2024-04-02T07:23:25.760438+0000","last_clean":"2024-04-02T07:23:25.760438+0000","last_became_active":"2024-04-02T07:23:25.352069+0000","last_became_peered":"2024-04-02T07:23:25.352069+0000","last_unstale":"2024-04-02T07:23:25.760438+0000","last_undegraded":"2024-04-02T07:23:25.760438+0000","last_fullsized":"2024-04-02T07:23:25.760438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:57:38.699211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.758331+0000","last_change":"2024-04-02T07:23:25.752296+0000","last_active":"2024-04-02T07:23:25.758331+0000","last_peered":"2024-04-02T07:23:25.758331+0000","last_clean":"2024-04-02T07:23:25.758331+0000","last_became_active":"2024-04-02T07:23:25.752048+0000","last_became_peered":"2024-04-02T07:23:25.752048+0000","last_unstale":"2024-04-02T07:23:25.758331+0000","last_undegraded":"2024-04-02T07:23:25.758331+0000","last_fullsized":"2024-04-02T07:23:25.758331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:14:18.365248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.742892+0000","last_change":"2024-04-02T07:23:25.352287+0000","last_active":"2024-04-02T07:23:25.742892+0000","last_peered":"2024-04-02T07:23:25.742892+0000","last_clean":"2024-04-02T07:23:25.742892+0000","last_became_active":"2024-04-02T07:23:25.348693+0000","last_became_peered":"2024-04-02T07:23:25.348693+0000","last_unstale":"2024-04-02T07:23:25.742892+0000","last_undegraded":"2024-04-02T07:23:25.742892+0000","last_fullsized":"2024-04-02T07:23:25.742892+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:59:32.894424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.758935+0000","last_change":"2024-04-02T07:23:25.752922+0000","last_active":"2024-04-02T07:23:25.758935+0000","last_peered":"2024-04-02T07:23:25.758935+0000","last_clean":"2024-04-02T07:23:25.758935+0000","last_became_active":"2024-04-02T07:23:25.752620+0000","last_became_peered":"2024-04-02T07:23:25.752620+0000","last_unstale":"2024-04-02T07:23:25.758935+0000","last_undegraded":"2024-04-02T07:23:25.758935+0000","last_fullsized":"2024-04-02T07:23:25.758935+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:23:08.300566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.733409+0000","last_change":"2024-04-02T07:23:25.345624+0000","last_active":"2024-04-02T07:23:25.733409+0000","last_peered":"2024-04-02T07:23:25.733409+0000","last_clean":"2024-04-02T07:23:25.733409+0000","last_became_active":"2024-04-02T07:23:25.344902+0000","last_became_peered":"2024-04-02T07:23:25.344902+0000","last_unstale":"2024-04-02T07:23:25.733409+0000","last_undegraded":"2024-04-02T07:23:25.733409+0000","last_fullsized":"2024-04-02T07:23:25.733409+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:46:00.766800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.757138+0000","last_change":"2024-04-02T07:23:25.751101+0000","last_active":"2024-04-02T07:23:25.757138+0000","last_peered":"2024-04-02T07:23:25.757138+0000","last_clean":"2024-04-02T07:23:25.757138+0000","last_became_active":"2024-04-02T07:23:25.750782+0000","last_became_peered":"2024-04-02T07:23:25.750782+0000","last_unstale":"2024-04-02T07:23:25.757138+0000","last_undegraded":"2024-04-02T07:23:25.757138+0000","last_fullsized":"2024-04-02T07:23:25.757138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:49:29.388659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.741818+0000","last_change":"2024-04-02T07:23:25.347234+0000","last_active":"2024-04-02T07:23:25.741818+0000","last_peered":"2024-04-02T07:23:25.741818+0000","last_clean":"2024-04-02T07:23:25.741818+0000","last_became_active":"2024-04-02T07:23:25.346955+0000","last_became_peered":"2024-04-02T07:23:25.346955+0000","last_unstale":"2024-04-02T07:23:25.741818+0000","last_undegraded":"2024-04-02T07:23:25.741818+0000","last_fullsized":"2024-04-02T07:23:25.741818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:22:32.464837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.760066+0000","last_change":"2024-04-02T07:23:25.755006+0000","last_active":"2024-04-02T07:23:25.760066+0000","last_peered":"2024-04-02T07:23:25.760066+0000","last_clean":"2024-04-02T07:23:25.760066+0000","last_became_active":"2024-04-02T07:23:25.754724+0000","last_became_peered":"2024-04-02T07:23:25.754724+0000","last_unstale":"2024-04-02T07:23:25.760066+0000","last_undegraded":"2024-04-02T07:23:25.760066+0000","last_fullsized":"2024-04-02T07:23:25.760066+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:22:33.470777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.777793+0000","last_change":"2024-04-02T07:23:25.346435+0000","last_active":"2024-04-02T07:23:25.777793+0000","last_peered":"2024-04-02T07:23:25.777793+0000","last_clean":"2024-04-02T07:23:25.777793+0000","last_became_active":"2024-04-02T07:23:25.346177+0000","last_became_peered":"2024-04-02T07:23:25.346177+0000","last_unstale":"2024-04-02T07:23:25.777793+0000","last_undegraded":"2024-04-02T07:23:25.777793+0000","last_fullsized":"2024-04-02T07:23:25.777793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:59:32.894424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.767754+0000","last_change":"2024-04-02T07:23:25.764291+0000","last_active":"2024-04-02T07:23:25.767754+0000","last_peered":"2024-04-02T07:23:25.767754+0000","last_clean":"2024-04-02T07:23:25.767754+0000","last_became_active":"2024-04-02T07:23:25.763986+0000","last_became_peered":"2024-04-02T07:23:25.763986+0000","last_unstale":"2024-04-02T07:23:25.767754+0000","last_undegraded":"2024-04-02T07:23:25.767754+0000","last_fullsized":"2024-04-02T07:23:25.767754+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:57:03.351637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.749263+0000","last_change":"2024-04-02T07:23:25.354424+0000","last_active":"2024-04-02T07:23:25.749263+0000","last_peered":"2024-04-02T07:23:25.749263+0000","last_clean":"2024-04-02T07:23:25.749263+0000","last_became_active":"2024-04-02T07:23:25.352133+0000","last_became_peered":"2024-04-02T07:23:25.352133+0000","last_unstale":"2024-04-02T07:23:25.749263+0000","last_undegraded":"2024-04-02T07:23:25.749263+0000","last_fullsized":"2024-04-02T07:23:25.749263+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:05:46.580442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.776628+0000","last_change":"2024-04-02T07:23:25.772844+0000","last_active":"2024-04-02T07:23:25.776628+0000","last_peered":"2024-04-02T07:23:25.776628+0000","last_clean":"2024-04-02T07:23:25.776628+0000","last_became_active":"2024-04-02T07:23:25.772555+0000","last_became_peered":"2024-04-02T07:23:25.772555+0000","last_unstale":"2024-04-02T07:23:25.776628+0000","last_undegraded":"2024-04-02T07:23:25.776628+0000","last_fullsized":"2024-04-02T07:23:25.776628+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:27:03.804725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.769359+0000","last_change":"2024-04-02T07:23:25.353370+0000","last_active":"2024-04-02T07:23:25.769359+0000","last_peered":"2024-04-02T07:23:25.769359+0000","last_clean":"2024-04-02T07:23:25.769359+0000","last_became_active":"2024-04-02T07:23:25.353069+0000","last_became_peered":"2024-04-02T07:23:25.353069+0000","last_unstale":"2024-04-02T07:23:25.769359+0000","last_undegraded":"2024-04-02T07:23:25.769359+0000","last_fullsized":"2024-04-02T07:23:25.769359+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:22:32.464837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.763174+0000","last_change":"2024-04-02T07:23:25.756444+0000","last_active":"2024-04-02T07:23:25.763174+0000","last_peered":"2024-04-02T07:23:25.763174+0000","last_clean":"2024-04-02T07:23:25.763174+0000","last_became_active":"2024-04-02T07:23:25.756113+0000","last_became_peered":"2024-04-02T07:23:25.756113+0000","last_unstale":"2024-04-02T07:23:25.763174+0000","last_undegraded":"2024-04-02T07:23:25.763174+0000","last_fullsized":"2024-04-02T07:23:25.763174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:23:43.517794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.747613+0000","last_change":"2024-04-02T07:23:25.352249+0000","last_active":"2024-04-02T07:23:25.747613+0000","last_peered":"2024-04-02T07:23:25.747613+0000","last_clean":"2024-04-02T07:23:25.747613+0000","last_became_active":"2024-04-02T07:23:25.351832+0000","last_became_peered":"2024-04-02T07:23:25.351832+0000","last_unstale":"2024-04-02T07:23:25.747613+0000","last_undegraded":"2024-04-02T07:23:25.747613+0000","last_fullsized":"2024-04-02T07:23:25.747613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:56:49.611080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.772749+0000","last_change":"2024-04-02T07:23:25.766080+0000","last_active":"2024-04-02T07:23:25.772749+0000","last_peered":"2024-04-02T07:23:25.772749+0000","last_clean":"2024-04-02T07:23:25.772749+0000","last_became_active":"2024-04-02T07:23:25.763300+0000","last_became_peered":"2024-04-02T07:23:25.763300+0000","last_unstale":"2024-04-02T07:23:25.772749+0000","last_undegraded":"2024-04-02T07:23:25.772749+0000","last_fullsized":"2024-04-02T07:23:25.772749+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:08:08.568590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.769377+0000","last_change":"2024-04-02T07:23:25.347353+0000","last_active":"2024-04-02T07:23:25.769377+0000","last_peered":"2024-04-02T07:23:25.769377+0000","last_clean":"2024-04-02T07:23:25.769377+0000","last_became_active":"2024-04-02T07:23:25.345902+0000","last_became_peered":"2024-04-02T07:23:25.345902+0000","last_unstale":"2024-04-02T07:23:25.769377+0000","last_undegraded":"2024-04-02T07:23:25.769377+0000","last_fullsized":"2024-04-02T07:23:25.769377+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:57:38.699211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.770587+0000","last_change":"2024-04-02T07:23:25.767531+0000","last_active":"2024-04-02T07:23:25.770587+0000","last_peered":"2024-04-02T07:23:25.770587+0000","last_clean":"2024-04-02T07:23:25.770587+0000","last_became_active":"2024-04-02T07:23:25.767211+0000","last_became_peered":"2024-04-02T07:23:25.767211+0000","last_unstale":"2024-04-02T07:23:25.770587+0000","last_undegraded":"2024-04-02T07:23:25.770587+0000","last_fullsized":"2024-04-02T07:23:25.770587+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:11:24.616677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.733183+0000","last_change":"2024-04-02T07:23:25.340841+0000","last_active":"2024-04-02T07:23:25.733183+0000","last_peered":"2024-04-02T07:23:25.733183+0000","last_clean":"2024-04-02T07:23:25.733183+0000","last_became_active":"2024-04-02T07:23:25.340559+0000","last_became_peered":"2024-04-02T07:23:25.340559+0000","last_unstale":"2024-04-02T07:23:25.733183+0000","last_undegraded":"2024-04-02T07:23:25.733183+0000","last_fullsized":"2024-04-02T07:23:25.733183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:52:42.539175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.754008+0000","last_change":"2024-04-02T07:23:25.747400+0000","last_active":"2024-04-02T07:23:25.754008+0000","last_peered":"2024-04-02T07:23:25.754008+0000","last_clean":"2024-04-02T07:23:25.754008+0000","last_became_active":"2024-04-02T07:23:25.746167+0000","last_became_peered":"2024-04-02T07:23:25.746167+0000","last_unstale":"2024-04-02T07:23:25.754008+0000","last_undegraded":"2024-04-02T07:23:25.754008+0000","last_fullsized":"2024-04-02T07:23:25.754008+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:50:57.979986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.736400+0000","last_change":"2024-04-02T07:23:25.345530+0000","last_active":"2024-04-02T07:23:25.736400+0000","last_peered":"2024-04-02T07:23:25.736400+0000","last_clean":"2024-04-02T07:23:25.736400+0000","last_became_active":"2024-04-02T07:23:25.345189+0000","last_became_peered":"2024-04-02T07:23:25.345189+0000","last_unstale":"2024-04-02T07:23:25.736400+0000","last_undegraded":"2024-04-02T07:23:25.736400+0000","last_fullsized":"2024-04-02T07:23:25.736400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:27:02.798785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.760496+0000","last_change":"2024-04-02T07:23:25.755025+0000","last_active":"2024-04-02T07:23:25.760496+0000","last_peered":"2024-04-02T07:23:25.760496+0000","last_clean":"2024-04-02T07:23:25.760496+0000","last_became_active":"2024-04-02T07:23:25.754751+0000","last_became_peered":"2024-04-02T07:23:25.754751+0000","last_unstale":"2024-04-02T07:23:25.760496+0000","last_undegraded":"2024-04-02T07:23:25.760496+0000","last_fullsized":"2024-04-02T07:23:25.760496+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:25.319725+0000","last_clean_scrub_stamp":"2024-04-02T07:23:25.319725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:26:49.378658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.742587+0000","last_change":"2024-04-02T07:23:25.348337+0000","last_active":"2024-04-02T07:23:25.742587+0000","last_peered":"2024-04-02T07:23:25.742587+0000","last_clean":"2024-04-02T07:23:25.742587+0000","last_became_active":"2024-04-02T07:23:25.348029+0000","last_became_peered":"2024-04-02T07:23:25.348029+0000","last_unstale":"2024-04-02T07:23:25.742587+0000","last_undegraded":"2024-04-02T07:23:25.742587+0000","last_fullsized":"2024-04-02T07:23:25.742587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:23:24.313785+0000","last_clean_scrub_stamp":"2024-04-02T07:23:24.313785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:23:07.294625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-02T07:23:25.344322+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:23:25.344322+0000","last_peered":"2024-04-02T07:23:25.344322+0000","last_clean":"2024-04-02T07:23:25.344322+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:23:25.344322+0000","last_undegraded":"2024-04-02T07:23:25.344322+0000","last_fullsized":"2024-04-02T07:23:25.344322+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":954368,"data_stored":729188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.624},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56000000000000005}]},{"osd":1,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.113,"5min":1.113,"15min":1.113},"last":0.51300000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.752,"15min":0.752},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.522,"5min":1.522,"15min":1.522},"last":0.76200000000000001}]},{"osd":3,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.405,"5min":1.405,"15min":1.405},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.68600000000000005}]},{"osd":4,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.633,"5min":1.633,"15min":1.633},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.079,"5min":1.079,"15min":1.079},"last":0.58499999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.5609999999999999,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.70999999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1,"5min":1,"15min":1},"last":0.69699999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":146211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":5.7569999999999997,"5min":5.7569999999999997,"15min":5.7569999999999997},"last":0.84899999999999998}]},{"osd":1,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.95,"5min":1.95,"15min":1.95},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.88300000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.226,"5min":1.226,"15min":1.226},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.66200000000000003}]},{"osd":3,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":0.83299999999999996},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":2.6389999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.73199999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.746},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.91000000000000003}]},{"osd":5,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.70799999999999996}]},{"osd":7,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.82499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":360448,"data_stored":138820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.54900000000000004}]},{"osd":1,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.68400000000000005}]},{"osd":2,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.8280000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.63200000000000001}]},{"osd":3,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.504},{"interface":"front","average":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":2.0219999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.52900000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.755,"15min":0.755},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":1.911,"5min":1.911,"15min":1.911},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.82699999999999996},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.7829999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.58499999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":2.1829999999999998,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":2.1280000000000001,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.69699999999999995}]},{"osd":7,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.887,"5min":1.887,"15min":1.887},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.625,"5min":0.625,"15min":0.625},"max":{"1min":2.2599999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.73199999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":145699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:23:08 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.4929999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":3.2519999999999998,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.61099999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:23:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.4279999999999999,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":4.3810000000000002,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":0.65100000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:23:08 2024","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":2.056,"5min":2.056,"15min":2.056},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":3.3420000000000001,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.77000000000000002}]},{"osd":3,"last update":"Tue Apr 2 07:23:08 2024","interfaces":[{"interface":"back","average":{"1min":1.056,"5min":1.056,"15min":1.056},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":3.9180000000000001,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.63100000000000001},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":3.9750000000000001,"5min":3.9750000000000001,"15min":3.9750000000000001},"last":0.73799999999999999}]},{"osd":5,"last update":"Tue Apr 2 07:23:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.57699999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:23:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.754}]},{"osd":7,"last update":"Tue Apr 2 07:23:08 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.80400000000000005},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.627,"5min":0.627,"15min":0.627},"max":{"1min":1.353,"5min":1.353,"15min":1.353},"last":0.81899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":360448,"data_stored":138820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:23:09 2024","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.372},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.44600000000000001}]},{"osd":1,"last update":"Tue Apr 2 07:23:09 2024","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.41099999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:23:09 2024","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.306,"5min":1.306,"15min":1.306},"last":0.46400000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:23:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.71899999999999997}]},{"osd":5,"last update":"Tue Apr 2 07:23:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.745,"5min":0.745,"15min":0.745},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.76300000000000001}]},{"osd":6,"last update":"Tue Apr 2 07:23:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.25,"5min":1.25,"15min":1.25},"last":0.755},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.64700000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:23:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.216,"5min":1.216,"15min":1.216},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.624}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":360448,"data_stored":138820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.313}]},{"osd":1,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":1.171,"5min":1.171,"15min":1.171},"last":0.433},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.333,"5min":1.333,"15min":1.333},"last":0.443}]},{"osd":3,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.45800000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.254,"5min":2.254,"15min":2.254},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.59999999999999998}]},{"osd":5,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":2.0840000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.67000000000000004}]},{"osd":6,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.80500000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:23:06 2024","interfaces":[{"interface":"back","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.3580000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.751},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.2909999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.72599999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":352,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":360448,"data_stored":138820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":4.157,"5min":4.157,"15min":4.157},"last":1.093}]},{"osd":2,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":4.282,"5min":4.282,"15min":4.282},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.627,"15min":0.627},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":0.53000000000000003}]},{"osd":3,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.5},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":8.1620000000000008,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":1.052}]},{"osd":4,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":4.7400000000000002,"5min":4.7400000000000002,"15min":4.7400000000000002},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.7070000000000001,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.55900000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"min":{"1min":0.497,"5min":0.497,"15min":0.497},"max":{"1min":4.5759999999999996,"5min":4.5759999999999996,"15min":4.5759999999999996},"last":1.163},{"interface":"front","average":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":4.7949999999999999,"5min":4.7949999999999999,"15min":4.7949999999999999},"last":0.60499999999999998}]},{"osd":6,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":4.6890000000000001,"5min":4.6890000000000001,"15min":4.6890000000000001},"last":1.129},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":4.6059999999999999,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.57199999999999995}]},{"osd":7,"last update":"Tue Apr 2 07:23:05 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.629},{"interface":"front","average":{"1min":1.026,"5min":1.026,"15min":1.026},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":4.6420000000000003,"5min":4.6420000000000003,"15min":4.6420000000000003},"last":1.383}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32064,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339776,"statfs":{"total":96636764160,"available":96603930624,"internally_reserved":0,"allocated":966656,"data_stored":735963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.48,"5min":1.48,"15min":1.48},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.433}]},{"osd":2,"last update":"Tue Apr 2 07:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.3129999999999999,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.50900000000000001}]},{"osd":3,"last update":"Tue Apr 2 07:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.56100000000000005}]},{"osd":4,"last update":"Tue Apr 2 07:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.623},{"interface":"front","average":{"1min":0.747,"5min":0.747,"15min":0.747},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.76000000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.371,"5min":1.371,"15min":1.371},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.70899999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"min":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"min":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.73799999999999999}]},{"osd":7,"last update":"Tue Apr 2 07:23:07 2024","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.135,"5min":1.135,"15min":1.135},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":1.141,"5min":1.141,"15min":1.141},"last":0.72099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:23:30.547 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-02T07:23:30.548 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-02T07:23:30.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.727+0000 7f9d9e600640 1 Processor -- start 2024-04-02T07:23:30.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.727+0000 7f9d9e600640 1 -- start start 2024-04-02T07:23:30.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.727+0000 7f9d9e600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9d980b1ac0 0x7f9d981655a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:30.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.727+0000 7f9d9e600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d980ce6c0 con 0x7f9d9815a980 2024-04-02T07:23:30.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.727+0000 7f9d9e600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d980cbf00 con 0x7f9d980d0ad0 2024-04-02T07:23:30.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.727+0000 7f9d9e600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d980cc7a0 con 0x7f9d980b1ac0 2024-04-02T07:23:30.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.727+0000 7f9d97e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9d980b1ac0 0x7f9d981655a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:30.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.727+0000 7f9d97e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9d980b1ac0 0x7f9d981655a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45646/0 (socket says 172.21.15.55:45646) 2024-04-02T07:23:30.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.727+0000 7f9d97e00640 1 -- 172.21.15.55:0/3350544337 learned_addr learned my addr 172.21.15.55:0/3350544337 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:30.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.727+0000 7f9d97400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9d9815a980 0x7f9d980d03c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46284/0 (socket says 172.21.15.55:46284) 2024-04-02T07:23:30.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.727+0000 7f9d97e00640 1 -- 172.21.15.55:0/3350544337 >> v1:172.21.15.106:6789/0 conn(0x7f9d980d0ad0 legacy=0x7f9d980cb220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:30.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.727+0000 7f9d97e00640 1 -- 172.21.15.55:0/3350544337 >> v1:172.21.15.55:6789/0 conn(0x7f9d9815a980 legacy=0x7f9d980d03c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:30.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.727+0000 7f9d97e00640 1 -- 172.21.15.55:0/3350544337 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d980cc1e0 con 0x7f9d980b1ac0 2024-04-02T07:23:30.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.727+0000 7f9d96a00640 1 -- 172.21.15.55:0/3350544337 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3350276867 0 0) 0x7f9d88001120 con 0x7f9d9815a980 2024-04-02T07:23:30.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.731+0000 7f9d97e00640 1 --2- 172.21.15.55:0/3350544337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d980b1ac0 0x7f9d981655a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009e50 tx=0x7f9d9001ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f732656440f592 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:30.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.731+0000 7f9d96a00640 1 -- 172.21.15.55:0/3350544337 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d900a58f0 con 0x7f9d980b1ac0 2024-04-02T07:23:30.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.731+0000 7f9d96a00640 1 -- 172.21.15.55:0/3350544337 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d900a5a50 con 0x7f9d980b1ac0 2024-04-02T07:23:30.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.731+0000 7f9d96a00640 1 -- 172.21.15.55:0/3350544337 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d900a5de0 con 0x7f9d980b1ac0 2024-04-02T07:23:30.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.731+0000 7f9d9e600640 1 -- 172.21.15.55:0/3350544337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d980b1ac0 msgr2=0x7f9d981655a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:30.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.731+0000 7f9d9e600640 1 --2- 172.21.15.55:0/3350544337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d980b1ac0 0x7f9d981655a0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9d90009e50 tx=0x7f9d9001ca00 comp rx=0 tx=0).stop 2024-04-02T07:23:30.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.731+0000 7f9d9e600640 1 -- 172.21.15.55:0/3350544337 shutdown_connections 2024-04-02T07:23:30.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.731+0000 7f9d9e600640 1 --2- 172.21.15.55:0/3350544337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d980b1ac0 0x7f9d981655a0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.731+0000 7f9d9e600640 1 -- 172.21.15.55:0/3350544337 >> 172.21.15.55:0/3350544337 conn(0x7f9d98089fa0 msgr2=0x7f9d9808a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:30.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.731+0000 7f9d9e600640 1 -- 172.21.15.55:0/3350544337 shutdown_connections 2024-04-02T07:23:30.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.731+0000 7f9d9e600640 1 -- 172.21.15.55:0/3350544337 wait complete. 2024-04-02T07:23:30.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d9e600640 1 Processor -- start 2024-04-02T07:23:30.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d9e600640 1 -- start start 2024-04-02T07:23:30.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d9e600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d980b1ac0 0x7f9d9806c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:30.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d9e600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d980d0ad0 0x7f9d98150ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:30.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d9e600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d9815a980 0x7f9d980c83d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:30.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d9e600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9806c310 con 0x7f9d980b1ac0 2024-04-02T07:23:30.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d9e600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d98152dd0 con 0x7f9d9815a980 2024-04-02T07:23:30.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d9e600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d9806bcc0 con 0x7f9d980d0ad0 2024-04-02T07:23:30.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d97400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d980b1ac0 0x7f9d9806c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:30.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d97400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d980b1ac0 0x7f9d9806c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45662/0 (socket says 172.21.15.55:45662) 2024-04-02T07:23:30.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d97400640 1 -- 172.21.15.55:0/1619196350 learned_addr learned my addr 172.21.15.55:0/1619196350 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:30.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d97e00640 1 --2- 172.21.15.55:0/1619196350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d9815a980 0x7f9d980c83d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:30.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d8ea00640 1 --2- 172.21.15.55:0/1619196350 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d980d0ad0 0x7f9d98150ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:30.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d97400640 1 -- 172.21.15.55:0/1619196350 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d980d0ad0 msgr2=0x7f9d98150ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:30.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d97400640 1 --2- 172.21.15.55:0/1619196350 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d980d0ad0 0x7f9d98150ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d97400640 1 -- 172.21.15.55:0/1619196350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d9815a980 msgr2=0x7f9d980c83d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:30.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d97400640 1 --2- 172.21.15.55:0/1619196350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d9815a980 0x7f9d980c83d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d97400640 1 -- 172.21.15.55:0/1619196350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d90009b30 con 0x7f9d980b1ac0 2024-04-02T07:23:30.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d97e00640 1 --2- 172.21.15.55:0/1619196350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d9815a980 0x7f9d980c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:30.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d97400640 1 --2- 172.21.15.55:0/1619196350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d980b1ac0 0x7f9d9806c7a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800c780 tx=0x7f9d8800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:30.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d8fe00640 1 -- 172.21.15.55:0/1619196350 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d880072d0 con 0x7f9d980b1ac0 2024-04-02T07:23:30.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d8fe00640 1 -- 172.21.15.55:0/1619196350 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d88007430 con 0x7f9d980b1ac0 2024-04-02T07:23:30.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d9e600640 1 -- 172.21.15.55:0/1619196350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9806bfa0 con 0x7f9d980b1ac0 2024-04-02T07:23:30.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d8fe00640 1 -- 172.21.15.55:0/1619196350 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d88001d20 con 0x7f9d980b1ac0 2024-04-02T07:23:30.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.735+0000 7f9d9e600640 1 -- 172.21.15.55:0/1619196350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d981515d0 con 0x7f9d980b1ac0 2024-04-02T07:23:30.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.739+0000 7f9d9e600640 1 -- 172.21.15.55:0/1619196350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d9806c130 con 0x7f9d980b1ac0 2024-04-02T07:23:30.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.739+0000 7f9d8fe00640 1 -- 172.21.15.55:0/1619196350 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f9d880047f0 con 0x7f9d980b1ac0 2024-04-02T07:23:30.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.739+0000 7f9d8fe00640 1 --2- 172.21.15.55:0/1619196350 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9d740666c0 0x7f9d74068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:30.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.739+0000 7f9d8fe00640 1 -- 172.21.15.55:0/1619196350 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9d88083080 con 0x7f9d980b1ac0 2024-04-02T07:23:30.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.739+0000 7f9d8ea00640 1 --2- 172.21.15.55:0/1619196350 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9d740666c0 0x7f9d74068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:30.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.739+0000 7f9d8ea00640 1 --2- 172.21.15.55:0/1619196350 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9d740666c0 0x7f9d74068b80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9d98152350 tx=0x7f9d80009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:30.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.743+0000 7f9d8fe00640 1 -- 172.21.15.55:0/1619196350 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f9d880503f0 con 0x7f9d980b1ac0 2024-04-02T07:23:30.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.963+0000 7f9d9e600640 1 -- 172.21.15.55:0/1619196350 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f9d980ce6c0 con 0x7f9d980b1ac0 2024-04-02T07:23:30.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.967+0000 7f9d8fe00640 1 -- 172.21.15.55:0/1619196350 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f9d980ce6c0 con 0x7f9d980b1ac0 2024-04-02T07:23:30.970 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2024-04-02T07:23:30.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.967+0000 7f9d9e600640 1 -- 172.21.15.55:0/1619196350 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9d740666c0 msgr2=0x7f9d74068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:30.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.967+0000 7f9d9e600640 1 --2- 172.21.15.55:0/1619196350 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9d740666c0 0x7f9d74068b80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9d98152350 tx=0x7f9d80009040 comp rx=0 tx=0).stop 2024-04-02T07:23:30.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.967+0000 7f9d9e600640 1 -- 172.21.15.55:0/1619196350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d980b1ac0 msgr2=0x7f9d9806c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:30.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.967+0000 7f9d9e600640 1 --2- 172.21.15.55:0/1619196350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d980b1ac0 0x7f9d9806c7a0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f9d8800c780 tx=0x7f9d8800cc40 comp rx=0 tx=0).stop 2024-04-02T07:23:30.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.971+0000 7f9d9e600640 1 -- 172.21.15.55:0/1619196350 shutdown_connections 2024-04-02T07:23:30.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.971+0000 7f9d9e600640 1 --2- 172.21.15.55:0/1619196350 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9d740666c0 0x7f9d74068b80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.971+0000 7f9d9e600640 1 --2- 172.21.15.55:0/1619196350 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d9815a980 0x7f9d980c83d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.971+0000 7f9d9e600640 1 --2- 172.21.15.55:0/1619196350 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d980d0ad0 0x7f9d98150ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.971+0000 7f9d9e600640 1 --2- 172.21.15.55:0/1619196350 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d980b1ac0 0x7f9d9806c7a0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:30.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.971+0000 7f9d9e600640 1 -- 172.21.15.55:0/1619196350 >> 172.21.15.55:0/1619196350 conn(0x7f9d98089fa0 msgr2=0x7f9d9806fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:30.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.971+0000 7f9d9e600640 1 -- 172.21.15.55:0/1619196350 shutdown_connections 2024-04-02T07:23:30.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:30.971+0000 7f9d9e600640 1 -- 172.21.15.55:0/1619196350 wait complete. 2024-04-02T07:23:30.991 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:23:31.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.131+0000 7fb444400640 1 Processor -- start 2024-04-02T07:23:31.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.131+0000 7fb444400640 1 -- start start 2024-04-02T07:23:31.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.131+0000 7fb444400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb43c0b0cb0 0x7fb43c0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.131+0000 7fb444400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb43c0c3680 0x7fb43c15c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.131+0000 7fb444400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43c15d270 con 0x7fb43c15ce40 2024-04-02T07:23:31.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.131+0000 7fb444400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43c0b1090 con 0x7fb43c0c3680 2024-04-02T07:23:31.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.131+0000 7fb444400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c0cac90 con 0x7fb43c0b0cb0 2024-04-02T07:23:31.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.131+0000 7fb441000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb43c0c3680 0x7fb43c15c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.131+0000 7fb441a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb43c0b0cb0 0x7fb43c0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.131+0000 7fb441000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb43c0c3680 0x7fb43c15c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:35548/0 (socket says 172.21.15.55:35548) 2024-04-02T07:23:31.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.131+0000 7fb442400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb43c15ce40 0x7fb43c0cbe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:52110/0 (socket says 172.21.15.55:52110) 2024-04-02T07:23:31.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.131+0000 7fb441000640 1 -- 172.21.15.55:0/1133067988 learned_addr learned my addr 172.21.15.55:0/1133067988 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:31.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.131+0000 7fb43be00640 1 -- 172.21.15.55:0/1133067988 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444229448 0 0) 0x7fb43c15d270 con 0x7fb43c15ce40 2024-04-02T07:23:31.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.131+0000 7fb441a00640 1 -- 172.21.15.55:0/1133067988 >> v2:172.21.15.106:3300/0 conn(0x7fb43c0c3680 msgr2=0x7fb43c15c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:31.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.131+0000 7fb441a00640 1 --2- 172.21.15.55:0/1133067988 >> v2:172.21.15.106:3300/0 conn(0x7fb43c0c3680 0x7fb43c15c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.131+0000 7fb441a00640 1 -- 172.21.15.55:0/1133067988 >> v1:172.21.15.106:6789/0 conn(0x7fb43c15ce40 legacy=0x7fb43c0cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:31.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.131+0000 7fb441a00640 1 -- 172.21.15.55:0/1133067988 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43c0caf70 con 0x7fb43c0b0cb0 2024-04-02T07:23:31.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.131+0000 7fb441000640 1 --2- 172.21.15.55:0/1133067988 >> v2:172.21.15.106:3300/0 conn(0x7fb43c0c3680 0x7fb43c15c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:23:31.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.135+0000 7fb441a00640 1 --2- 172.21.15.55:0/1133067988 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb43c0b0cb0 0x7fb43c0b3590 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb4300097c0 tx=0x7fb43001c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c9d42ca9ea60ed server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:31.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.135+0000 7fb43be00640 1 -- 172.21.15.55:0/1133067988 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4300ab670 con 0x7fb43c0b0cb0 2024-04-02T07:23:31.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.135+0000 7fb43be00640 1 -- 172.21.15.55:0/1133067988 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4300ab7d0 con 0x7fb43c0b0cb0 2024-04-02T07:23:31.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.135+0000 7fb43be00640 1 -- 172.21.15.55:0/1133067988 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4300abb60 con 0x7fb43c0b0cb0 2024-04-02T07:23:31.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.135+0000 7fb444400640 1 -- 172.21.15.55:0/1133067988 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb43c0b0cb0 msgr2=0x7fb43c0b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:31.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.135+0000 7fb444400640 1 --2- 172.21.15.55:0/1133067988 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb43c0b0cb0 0x7fb43c0b3590 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb4300097c0 tx=0x7fb43001c470 comp rx=0 tx=0).stop 2024-04-02T07:23:31.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb444400640 1 -- 172.21.15.55:0/1133067988 shutdown_connections 2024-04-02T07:23:31.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb444400640 1 --2- 172.21.15.55:0/1133067988 >> v2:172.21.15.106:3300/0 conn(0x7fb43c0c3680 0x7fb43c15c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb444400640 1 --2- 172.21.15.55:0/1133067988 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb43c0b0cb0 0x7fb43c0b3590 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb444400640 1 -- 172.21.15.55:0/1133067988 >> 172.21.15.55:0/1133067988 conn(0x7fb43c066080 msgr2=0x7fb43c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:31.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb444400640 1 -- 172.21.15.55:0/1133067988 shutdown_connections 2024-04-02T07:23:31.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb444400640 1 -- 172.21.15.55:0/1133067988 wait complete. 2024-04-02T07:23:31.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb444400640 1 Processor -- start 2024-04-02T07:23:31.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb444400640 1 -- start start 2024-04-02T07:23:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb444400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb43c0b0cb0 0x7fb43c14a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb444400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb43c0c3680 0x7fb43c14ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb444400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb43c15ce40 0x7fb43c1502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb444400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c14f010 con 0x7fb43c0c3680 2024-04-02T07:23:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb444400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c14fe50 con 0x7fb43c0b0cb0 2024-04-02T07:23:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb444400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb43c14f240 con 0x7fb43c15ce40 2024-04-02T07:23:31.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb441000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb43c0c3680 0x7fb43c14ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb441000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb43c0c3680 0x7fb43c14ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45672/0 (socket says 172.21.15.55:45672) 2024-04-02T07:23:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb441000640 1 -- 172.21.15.55:0/3501273232 learned_addr learned my addr 172.21.15.55:0/3501273232 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb441a00640 1 --2- 172.21.15.55:0/3501273232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb43c0b0cb0 0x7fb43c14a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb442400640 1 --2- 172.21.15.55:0/3501273232 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb43c15ce40 0x7fb43c1502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb441000640 1 -- 172.21.15.55:0/3501273232 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb43c15ce40 msgr2=0x7fb43c1502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb441000640 1 --2- 172.21.15.55:0/3501273232 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb43c15ce40 0x7fb43c1502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb441000640 1 -- 172.21.15.55:0/3501273232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb43c0b0cb0 msgr2=0x7fb43c14a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb441000640 1 --2- 172.21.15.55:0/3501273232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb43c0b0cb0 0x7fb43c14a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb441000640 1 -- 172.21.15.55:0/3501273232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4280094d0 con 0x7fb43c0c3680 2024-04-02T07:23:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.139+0000 7fb441000640 1 --2- 172.21.15.55:0/3501273232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb43c0c3680 0x7fb43c14ead0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb42800e9d0 tx=0x7fb42800ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.143+0000 7fb439600640 1 -- 172.21.15.55:0/3501273232 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42800ca60 con 0x7fb43c0c3680 2024-04-02T07:23:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.143+0000 7fb439600640 1 -- 172.21.15.55:0/3501273232 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb42800cbc0 con 0x7fb43c0c3680 2024-04-02T07:23:31.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.143+0000 7fb439600640 1 -- 172.21.15.55:0/3501273232 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb428013470 con 0x7fb43c0c3680 2024-04-02T07:23:31.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.143+0000 7fb444400640 1 -- 172.21.15.55:0/3501273232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb430009420 con 0x7fb43c0c3680 2024-04-02T07:23:31.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.143+0000 7fb444400640 1 -- 172.21.15.55:0/3501273232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb43c14f800 con 0x7fb43c0c3680 2024-04-02T07:23:31.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.143+0000 7fb444400640 1 -- 172.21.15.55:0/3501273232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43c14ffc0 con 0x7fb43c0c3680 2024-04-02T07:23:31.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.143+0000 7fb439600640 1 -- 172.21.15.55:0/3501273232 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb4280135d0 con 0x7fb43c0c3680 2024-04-02T07:23:31.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.143+0000 7fb439600640 1 --2- 172.21.15.55:0/3501273232 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb41c066690 0x7fb41c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.143+0000 7fb439600640 1 -- 172.21.15.55:0/3501273232 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb428084400 con 0x7fb43c0c3680 2024-04-02T07:23:31.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.143+0000 7fb441a00640 1 --2- 172.21.15.55:0/3501273232 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb41c066690 0x7fb41c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.143+0000 7fb441a00640 1 --2- 172.21.15.55:0/3501273232 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb41c066690 0x7fb41c068b50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb4300af000 tx=0x7fb4300a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:31.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.147+0000 7fb439600640 1 -- 172.21.15.55:0/3501273232 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fb428051810 con 0x7fb43c0c3680 2024-04-02T07:23:31.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.343+0000 7fb444400640 1 -- 172.21.15.55:0/3501273232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb43c066c90 con 0x7fb43c0c3680 2024-04-02T07:23:31.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.343+0000 7fb439600640 1 -- 172.21.15.55:0/3501273232 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4725 (secure 0 0 0) 0x7fb42805b030 con 0x7fb43c0c3680 2024-04-02T07:23:31.346 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:31.346 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4883,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53106343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53106343},{"type":"v1","addr":"172.21.15.55:6833","nonce":53106343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/44669622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":44669622},{"type":"v1","addr":"172.21.15.106:6837","nonce":44669622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/741637637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":741637637},{"type":"v1","addr":"172.21.15.106:6836","nonce":741637637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:23:25.727369+0000","modified":"2024-04-02T07:23:29.049370+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/2440784960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2440784960},{"type":"v1","addr":"172.21.15.55:6835","nonce":2440784960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-02T07:23:31.347 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 17 2024-04-02T07:23:31.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.347+0000 7fb444400640 1 -- 172.21.15.55:0/3501273232 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb41c066690 msgr2=0x7fb41c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:31.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.347+0000 7fb444400640 1 --2- 172.21.15.55:0/3501273232 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb41c066690 0x7fb41c068b50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb4300af000 tx=0x7fb4300a7000 comp rx=0 tx=0).stop 2024-04-02T07:23:31.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.347+0000 7fb444400640 1 -- 172.21.15.55:0/3501273232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb43c0c3680 msgr2=0x7fb43c14ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:31.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.347+0000 7fb444400640 1 --2- 172.21.15.55:0/3501273232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb43c0c3680 0x7fb43c14ead0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fb42800e9d0 tx=0x7fb42800ee90 comp rx=0 tx=0).stop 2024-04-02T07:23:31.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.347+0000 7fb444400640 1 -- 172.21.15.55:0/3501273232 shutdown_connections 2024-04-02T07:23:31.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.347+0000 7fb444400640 1 --2- 172.21.15.55:0/3501273232 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb43c15ce40 0x7fb43c1502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.347+0000 7fb444400640 1 --2- 172.21.15.55:0/3501273232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb43c0c3680 0x7fb43c14ead0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.347+0000 7fb444400640 1 --2- 172.21.15.55:0/3501273232 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb41c066690 0x7fb41c068b50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.347+0000 7fb444400640 1 --2- 172.21.15.55:0/3501273232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb43c0b0cb0 0x7fb43c14a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.347+0000 7fb444400640 1 -- 172.21.15.55:0/3501273232 >> 172.21.15.55:0/3501273232 conn(0x7fb43c066080 msgr2=0x7fb43c0cd5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:31.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.347+0000 7fb444400640 1 -- 172.21.15.55:0/3501273232 shutdown_connections 2024-04-02T07:23:31.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.347+0000 7fb444400640 1 -- 172.21.15.55:0/3501273232 wait complete. 2024-04-02T07:23:31.770 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:23:25.727369+0000', 'modified': '2024-04-02T07:23:29.049370+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5199}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5199': {'gid': 5199, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6835/2440784960', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6834', 'nonce': 2440784960}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 2440784960}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:23:31.770 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-02T07:23:31.770 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-02T07:23:31.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.911+0000 7f7f39a00640 1 Processor -- start 2024-04-02T07:23:31.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.911+0000 7f7f39a00640 1 -- start start 2024-04-02T07:23:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.911+0000 7f7f39a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7f3415fff0 0x7f7f340b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.911+0000 7f7f39a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f34069d90 0x7f7f3406a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.911+0000 7f7f39a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f340aea20 con 0x7f7f340aebd0 2024-04-02T07:23:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.911+0000 7f7f39a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f341603d0 con 0x7f7f3415fff0 2024-04-02T07:23:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.911+0000 7f7f39a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3406a760 con 0x7f7f34069d90 2024-04-02T07:23:31.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.911+0000 7f7f32a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7f3415fff0 0x7f7f340b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.911+0000 7f7f2a000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7f340aebd0 0x7f7f3406f430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46286/0 (socket says 172.21.15.55:46286) 2024-04-02T07:23:31.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.911+0000 7f7f2a000640 1 -- 172.21.15.55:0/588572762 learned_addr learned my addr 172.21.15.55:0/588572762 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:31.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.911+0000 7f7f33400640 1 --2- 172.21.15.55:0/588572762 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f34069d90 0x7f7f3406a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.911+0000 7f7f32a00640 1 -- 172.21.15.55:0/588572762 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f34069d90 msgr2=0x7f7f3406a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:31.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.911+0000 7f7f32a00640 1 --2- 172.21.15.55:0/588572762 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f34069d90 0x7f7f3406a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.911+0000 7f7f32a00640 1 -- 172.21.15.55:0/588572762 >> v1:172.21.15.55:6789/0 conn(0x7f7f340aebd0 legacy=0x7f7f3406f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:31.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.911+0000 7f7f32a00640 1 -- 172.21.15.55:0/588572762 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f340b3c00 con 0x7f7f3415fff0 2024-04-02T07:23:31.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.911+0000 7f7f32000640 1 -- 172.21.15.55:0/588572762 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2932461710 0 0) 0x7f7f340aea20 con 0x7f7f340aebd0 2024-04-02T07:23:31.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.915+0000 7f7f32a00640 1 --2- 172.21.15.55:0/588572762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f3415fff0 0x7f7f340b1f40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7f240097c0 tx=0x7f7f2401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a753f45654599da server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:31.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.915+0000 7f7f32000640 1 -- 172.21.15.55:0/588572762 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f240ab600 con 0x7f7f3415fff0 2024-04-02T07:23:31.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.915+0000 7f7f32000640 1 -- 172.21.15.55:0/588572762 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f240a7050 con 0x7f7f3415fff0 2024-04-02T07:23:31.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.915+0000 7f7f32000640 1 -- 172.21.15.55:0/588572762 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f240ab980 con 0x7f7f3415fff0 2024-04-02T07:23:31.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.915+0000 7f7f39a00640 1 -- 172.21.15.55:0/588572762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f3415fff0 msgr2=0x7f7f340b1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:31.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.915+0000 7f7f39a00640 1 --2- 172.21.15.55:0/588572762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f3415fff0 0x7f7f340b1f40 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f7f240097c0 tx=0x7f7f2401c380 comp rx=0 tx=0).stop 2024-04-02T07:23:31.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.915+0000 7f7f39a00640 1 -- 172.21.15.55:0/588572762 shutdown_connections 2024-04-02T07:23:31.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.915+0000 7f7f39a00640 1 --2- 172.21.15.55:0/588572762 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f34069d90 0x7f7f3406a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.915+0000 7f7f39a00640 1 --2- 172.21.15.55:0/588572762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f3415fff0 0x7f7f340b1f40 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.915+0000 7f7f39a00640 1 -- 172.21.15.55:0/588572762 >> 172.21.15.55:0/588572762 conn(0x7f7f340b1420 msgr2=0x7f7f340b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:31.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.915+0000 7f7f39a00640 1 -- 172.21.15.55:0/588572762 shutdown_connections 2024-04-02T07:23:31.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.915+0000 7f7f39a00640 1 -- 172.21.15.55:0/588572762 wait complete. 2024-04-02T07:23:31.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f39a00640 1 Processor -- start 2024-04-02T07:23:31.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f39a00640 1 -- start start 2024-04-02T07:23:31.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f39a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f34069d90 0x7f7f340c8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f39a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f340aebd0 0x7f7f34145810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f39a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f3415fff0 0x7f7f340af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f39a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f34155560 con 0x7f7f34069d90 2024-04-02T07:23:31.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f39a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f340cb600 con 0x7f7f340aebd0 2024-04-02T07:23:31.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f39a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f34154f10 con 0x7f7f3415fff0 2024-04-02T07:23:31.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f32a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f34069d90 0x7f7f340c8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f32a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f34069d90 0x7f7f340c8fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45702/0 (socket says 172.21.15.55:45702) 2024-04-02T07:23:31.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f32a00640 1 -- 172.21.15.55:0/3363712223 learned_addr learned my addr 172.21.15.55:0/3363712223 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:31.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f33400640 1 --2- 172.21.15.55:0/3363712223 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f3415fff0 0x7f7f340af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f2a000640 1 --2- 172.21.15.55:0/3363712223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f340aebd0 0x7f7f34145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f32a00640 1 -- 172.21.15.55:0/3363712223 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f3415fff0 msgr2=0x7f7f340af050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:31.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f32a00640 1 --2- 172.21.15.55:0/3363712223 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f3415fff0 0x7f7f340af050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f32a00640 1 -- 172.21.15.55:0/3363712223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f340aebd0 msgr2=0x7f7f34145810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:31.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f32a00640 1 --2- 172.21.15.55:0/3363712223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f340aebd0 0x7f7f34145810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f32a00640 1 -- 172.21.15.55:0/3363712223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f24009420 con 0x7f7f34069d90 2024-04-02T07:23:31.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f33400640 1 --2- 172.21.15.55:0/3363712223 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f3415fff0 0x7f7f340af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:23:31.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f2a000640 1 --2- 172.21.15.55:0/3363712223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f340aebd0 0x7f7f34145810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:23:31.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f32a00640 1 --2- 172.21.15.55:0/3363712223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f34069d90 0x7f7f340c8fa0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7f2401aa30 tx=0x7f7f24019120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:31.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f2b400640 1 -- 172.21.15.55:0/3363712223 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24004230 con 0x7f7f34069d90 2024-04-02T07:23:31.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f2b400640 1 -- 172.21.15.55:0/3363712223 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f24004390 con 0x7f7f34069d90 2024-04-02T07:23:31.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f2b400640 1 -- 172.21.15.55:0/3363712223 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24003820 con 0x7f7f34069d90 2024-04-02T07:23:31.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f39a00640 1 -- 172.21.15.55:0/3363712223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f341551f0 con 0x7f7f34069d90 2024-04-02T07:23:31.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.919+0000 7f7f39a00640 1 -- 172.21.15.55:0/3363712223 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f340c94e0 con 0x7f7f34069d90 2024-04-02T07:23:31.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.923+0000 7f7f2b400640 1 -- 172.21.15.55:0/3363712223 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7f240b2040 con 0x7f7f34069d90 2024-04-02T07:23:31.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.923+0000 7f7f2b400640 1 --2- 172.21.15.55:0/3363712223 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7f10066690 0x7f7f10068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.923+0000 7f7f2b400640 1 -- 172.21.15.55:0/3363712223 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f2411e360 con 0x7f7f34069d90 2024-04-02T07:23:31.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.923+0000 7f7f2a000640 1 --2- 172.21.15.55:0/3363712223 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7f10066690 0x7f7f10068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.923+0000 7f7f3cf0f000 1 Processor -- start 2024-04-02T07:23:31.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.923+0000 7f7f3cf0f000 1 -- start start 2024-04-02T07:23:31.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.923+0000 7f7f2a000640 1 --2- 172.21.15.55:0/3363712223 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7f10066690 0x7f7f10068b50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7f3415cf10 tx=0x7f7f1c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:31.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f3cf0f000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b78d8db0 0x55a9b78d9190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f3cf0f000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 0x55a9b788ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f3cf0f000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b788f4c0 0x55a9b788f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f3cf0f000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9b77575a0 con 0x55a9b78d96d0 2024-04-02T07:23:31.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f3cf0f000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9b76e4af0 con 0x55a9b78d8db0 2024-04-02T07:23:31.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f3cf0f000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9b76e20c0 con 0x55a9b788f4c0 2024-04-02T07:23:31.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f2a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 0x55a9b788ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f2a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 0x55a9b788ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45708/0 (socket says 172.21.15.55:45708) 2024-04-02T07:23:31.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f2a000640 1 -- 172.21.15.55:0/3106148928 learned_addr learned my addr 172.21.15.55:0/3106148928 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:31.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f32a00640 1 --2- 172.21.15.55:0/3106148928 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b78d8db0 0x55a9b78d9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f33400640 1 --2- 172.21.15.55:0/3106148928 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b788f4c0 0x55a9b788f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f2a000640 1 -- 172.21.15.55:0/3106148928 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b788f4c0 msgr2=0x55a9b788f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:31.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f2a000640 1 --2- 172.21.15.55:0/3106148928 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b788f4c0 0x55a9b788f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f2a000640 1 -- 172.21.15.55:0/3106148928 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b78d8db0 msgr2=0x55a9b78d9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:31.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f2a000640 1 --2- 172.21.15.55:0/3106148928 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b78d8db0 0x55a9b78d9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f2a000640 1 -- 172.21.15.55:0/3106148928 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9b73d9890 con 0x55a9b78d96d0 2024-04-02T07:23:31.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f33400640 1 --2- 172.21.15.55:0/3106148928 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b788f4c0 0x55a9b788f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:31.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f2a000640 1 --2- 172.21.15.55:0/3106148928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 0x55a9b788ef80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c007390 tx=0x7f7f1c010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e954dc17df2ba86a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:31.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f23400640 1 -- 172.21.15.55:0/3106148928 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c00db50 con 0x55a9b78d96d0 2024-04-02T07:23:31.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f23400640 1 -- 172.21.15.55:0/3106148928 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1c00dcb0 con 0x55a9b78d96d0 2024-04-02T07:23:31.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f23400640 1 -- 172.21.15.55:0/3106148928 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1c001d60 con 0x55a9b78d96d0 2024-04-02T07:23:31.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3106148928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 msgr2=0x55a9b788ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:31.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f3cf0f000 1 --2- 172.21.15.55:0/3106148928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 0x55a9b788ef80 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c007390 tx=0x7f7f1c010000 comp rx=0 tx=0).stop 2024-04-02T07:23:31.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3106148928 shutdown_connections 2024-04-02T07:23:31.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f3cf0f000 1 --2- 172.21.15.55:0/3106148928 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b788f4c0 0x55a9b788f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f3cf0f000 1 --2- 172.21.15.55:0/3106148928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 0x55a9b788ef80 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f3cf0f000 1 --2- 172.21.15.55:0/3106148928 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b78d8db0 0x55a9b78d9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3106148928 >> 172.21.15.55:0/3106148928 conn(0x55a9b7895830 msgr2=0x55a9b788d860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:31.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3106148928 shutdown_connections 2024-04-02T07:23:31.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3106148928 wait complete. 2024-04-02T07:23:31.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f3cf0f000 1 -- start start 2024-04-02T07:23:31.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.927+0000 7f7f3cf0f000 1 Processor -- start 2024-04-02T07:23:31.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f3cf0f000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b788f4c0 0x55a9b7894120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f3cf0f000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b78d8db0 0x55a9b78d8170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f3cf0f000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 0x55a9b78d86b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f3cf0f000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9b76dd9b0 con 0x55a9b78d96d0 2024-04-02T07:23:31.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f3cf0f000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9b767cc00 con 0x55a9b788f4c0 2024-04-02T07:23:31.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f3cf0f000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9b769b070 con 0x55a9b78d8db0 2024-04-02T07:23:31.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f3cf0f000 10 client.0 _ll_register_callbacks cb 0x55a9b787b0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:23:31.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f33400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 0x55a9b78d86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f33400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 0x55a9b78d86b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45716/0 (socket says 172.21.15.55:45716) 2024-04-02T07:23:31.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f33400640 1 -- 172.21.15.55:0/3135182673 learned_addr learned my addr 172.21.15.55:0/3135182673 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:31.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f32a00640 1 --2- 172.21.15.55:0/3135182673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b788f4c0 0x55a9b7894120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f2a000640 1 --2- 172.21.15.55:0/3135182673 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b78d8db0 0x55a9b78d8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f33400640 1 -- 172.21.15.55:0/3135182673 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b78d8db0 msgr2=0x55a9b78d8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:31.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f33400640 1 --2- 172.21.15.55:0/3135182673 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b78d8db0 0x55a9b78d8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f33400640 1 -- 172.21.15.55:0/3135182673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b788f4c0 msgr2=0x55a9b7894120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:31.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f33400640 1 --2- 172.21.15.55:0/3135182673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b788f4c0 0x55a9b7894120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f33400640 1 -- 172.21.15.55:0/3135182673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1c0070d0 con 0x55a9b78d96d0 2024-04-02T07:23:31.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f33400640 1 --2- 172.21.15.55:0/3135182673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 0x55a9b78d86b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c007af0 tx=0x7f7f2c009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a1075a7d511f20 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:31.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f17e00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:23:31.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f17e00640 1 -- 172.21.15.55:0/3135182673 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c011b70 con 0x55a9b78d96d0 2024-04-02T07:23:31.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f17e00640 1 -- 172.21.15.55:0/3135182673 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f2c011cd0 con 0x55a9b78d96d0 2024-04-02T07:23:31.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3135182673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a9b769a5f0 con 0x55a9b78d96d0 2024-04-02T07:23:31.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f17e00640 1 -- 172.21.15.55:0/3135182673 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f2c011e90 con 0x55a9b78d96d0 2024-04-02T07:23:31.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f3cf0f000 10 client.5370 fetch_fsmap learned FSMap version 17 2024-04-02T07:23:31.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3135182673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a9b76a2ab0 con 0x55a9b78d96d0 2024-04-02T07:23:31.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f17e00640 1 -- 172.21.15.55:0/3135182673 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a9b769a5f0 con 0x55a9b78d96d0 2024-04-02T07:23:31.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f17e00640 1 -- 172.21.15.55:0/3135182673 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7f2c014070 con 0x55a9b78d96d0 2024-04-02T07:23:31.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f3cf0f000 10 client.5370 fetch_fsmap finished waiting for FSMap version 17 2024-04-02T07:23:31.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f3cf0f000 10 client.5370 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f3cf0f000 20 client.5370 populate_metadata read hostname 'smithi055' 2024-04-02T07:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f3cf0f000 1 --2- 172.21.15.55:0/3135182673 >> [v2:172.21.15.55:6834/2440784960,v1:172.21.15.55:6835/2440784960] conn(0x55a9b78da2e0 0x55a9b78ea450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f3cf0f000 4 client.5370 mds_command: new command op to 5199 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3135182673 --> [v2:172.21.15.55:6834/2440784960,v1:172.21.15.55:6835/2440784960] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a9b76da790 con 0x55a9b78da2e0 2024-04-02T07:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f32a00640 1 --2- 172.21.15.55:0/3135182673 >> [v2:172.21.15.55:6834/2440784960,v1:172.21.15.55:6835/2440784960] conn(0x55a9b78da2e0 0x55a9b78ea450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f32a00640 1 --2- 172.21.15.55:0/3135182673 >> [v2:172.21.15.55:6834/2440784960,v1:172.21.15.55:6835/2440784960] conn(0x55a9b78da2e0 0x55a9b78ea450 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76668d0cb3d42e74 server_cookie=77ba1f8fd9f592ae in_seq=0 out_seq=0 2024-04-02T07:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f17e00640 10 client.5370 ms_handle_connect on v2:172.21.15.55:6834/2440784960 2024-04-02T07:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f17e00640 1 -- 172.21.15.55:0/3135182673 <== mds.0 v2:172.21.15.55:6834/2440784960 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a9b76da790 con 0x55a9b78da2e0 2024-04-02T07:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f17e00640 10 client.5370 handle_command_reply: tid=0 2024-04-02T07:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.931+0000 7f7f3cf0f000 1 client.5370 shutdown 2024-04-02T07:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.935+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3135182673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 msgr2=0x55a9b78d86b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.935+0000 7f7f3cf0f000 1 --2- 172.21.15.55:0/3135182673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 0x55a9b78d86b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c007af0 tx=0x7f7f2c009f60 comp rx=0 tx=0).stop 2024-04-02T07:23:31.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.935+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3135182673 shutdown_connections 2024-04-02T07:23:31.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.935+0000 7f7f3cf0f000 1 --2- 172.21.15.55:0/3135182673 >> [v2:172.21.15.55:6834/2440784960,v1:172.21.15.55:6835/2440784960] conn(0x55a9b78da2e0 0x55a9b78ea450 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.935+0000 7f7f3cf0f000 1 --2- 172.21.15.55:0/3135182673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 0x55a9b78d86b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.935+0000 7f7f3cf0f000 1 --2- 172.21.15.55:0/3135182673 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b78d8db0 0x55a9b78d8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.935+0000 7f7f3cf0f000 1 --2- 172.21.15.55:0/3135182673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b788f4c0 0x55a9b7894120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.935+0000 7f7f17e00640 0 client.5370 ms_handle_reset on v2:172.21.15.55:6834/2440784960 2024-04-02T07:23:31.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.935+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3135182673 >> 172.21.15.55:0/3135182673 conn(0x55a9b7895830 msgr2=0x55a9b788df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:31.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.935+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3135182673 shutdown_connections 2024-04-02T07:23:31.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.935+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3135182673 wait complete. 2024-04-02T07:23:31.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.935+0000 7f7f3cf0f000 20 client.5370 trim_cache size 0 max 16384 2024-04-02T07:23:31.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.947+0000 7f7f3cf0f000 1 Processor -- start 2024-04-02T07:23:31.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.947+0000 7f7f3cf0f000 1 -- start start 2024-04-02T07:23:31.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f3cf0f000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b788f4c0 0x55a9b78d77a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f3cf0f000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b78d8db0 0x55a9b78d7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f3cf0f000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b78d96d0 0x55a9b78e8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f3cf0f000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9b739a940 con 0x55a9b788f4c0 2024-04-02T07:23:31.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f3cf0f000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9b7684660 con 0x55a9b78d8db0 2024-04-02T07:23:31.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f3cf0f000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9b76e0510 con 0x55a9b78d96d0 2024-04-02T07:23:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f32a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b788f4c0 0x55a9b78d77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f32a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b788f4c0 0x55a9b78d77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45722/0 (socket says 172.21.15.55:45722) 2024-04-02T07:23:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f32a00640 1 -- 172.21.15.55:0/561008330 learned_addr learned my addr 172.21.15.55:0/561008330 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f2a000640 1 --2- 172.21.15.55:0/561008330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b78d8db0 0x55a9b78d7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f33400640 1 --2- 172.21.15.55:0/561008330 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b78d96d0 0x55a9b78e8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f32a00640 1 -- 172.21.15.55:0/561008330 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b78d96d0 msgr2=0x55a9b78e8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f32a00640 1 --2- 172.21.15.55:0/561008330 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b78d96d0 0x55a9b78e8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f32a00640 1 -- 172.21.15.55:0/561008330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b78d8db0 msgr2=0x55a9b78d7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f32a00640 1 --2- 172.21.15.55:0/561008330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b78d8db0 0x55a9b78d7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f32a00640 1 -- 172.21.15.55:0/561008330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a9b7688c00 con 0x55a9b788f4c0 2024-04-02T07:23:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f33400640 1 --2- 172.21.15.55:0/561008330 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b78d96d0 0x55a9b78e8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f32a00640 1 --2- 172.21.15.55:0/561008330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b788f4c0 0x55a9b78d77a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7f2401c8f0 tx=0x7f7f240bf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e872d249f2d6d13 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:31.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f23e00640 1 -- 172.21.15.55:0/561008330 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2411c070 con 0x55a9b788f4c0 2024-04-02T07:23:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f23e00640 1 -- 172.21.15.55:0/561008330 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f24106040 con 0x55a9b788f4c0 2024-04-02T07:23:31.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f23e00640 1 -- 172.21.15.55:0/561008330 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f24104040 con 0x55a9b788f4c0 2024-04-02T07:23:31.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/561008330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b788f4c0 msgr2=0x55a9b78d77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:31.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f3cf0f000 1 --2- 172.21.15.55:0/561008330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b788f4c0 0x55a9b78d77a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f7f2401c8f0 tx=0x7f7f240bf040 comp rx=0 tx=0).stop 2024-04-02T07:23:31.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/561008330 shutdown_connections 2024-04-02T07:23:31.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f3cf0f000 1 --2- 172.21.15.55:0/561008330 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b78d96d0 0x55a9b78e8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f3cf0f000 1 --2- 172.21.15.55:0/561008330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b78d8db0 0x55a9b78d7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f3cf0f000 1 --2- 172.21.15.55:0/561008330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b788f4c0 0x55a9b78d77a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/561008330 >> 172.21.15.55:0/561008330 conn(0x55a9b7895830 msgr2=0x55a9b78e5620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:31.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/561008330 shutdown_connections 2024-04-02T07:23:31.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/561008330 wait complete. 2024-04-02T07:23:31.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f3cf0f000 1 -- start start 2024-04-02T07:23:31.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.951+0000 7f7f3cf0f000 1 Processor -- start 2024-04-02T07:23:31.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b788f4c0 0x55a9b78eb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b78d8db0 0x55a9b7933a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 0x55a9b7933fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9b768e5b0 con 0x55a9b78d96d0 2024-04-02T07:23:31.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a9b7893830 con 0x55a9b78d8db0 2024-04-02T07:23:31.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a9b76db1c0 con 0x55a9b788f4c0 2024-04-02T07:23:31.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 10 client.0 _ll_register_callbacks cb 0x55a9b76a2590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:23:31.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f33400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 0x55a9b7933fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f33400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 0x55a9b7933fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45726/0 (socket says 172.21.15.55:45726) 2024-04-02T07:23:31.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f33400640 1 -- 172.21.15.55:0/3504884401 learned_addr learned my addr 172.21.15.55:0/3504884401 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:31.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f2a000640 1 --2- 172.21.15.55:0/3504884401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b78d8db0 0x55a9b7933a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f32a00640 1 --2- 172.21.15.55:0/3504884401 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b788f4c0 0x55a9b78eb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f33400640 1 -- 172.21.15.55:0/3504884401 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b788f4c0 msgr2=0x55a9b78eb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:31.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f33400640 1 --2- 172.21.15.55:0/3504884401 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b788f4c0 0x55a9b78eb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f33400640 1 -- 172.21.15.55:0/3504884401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b78d8db0 msgr2=0x55a9b7933a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:31.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f33400640 1 --2- 172.21.15.55:0/3504884401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b78d8db0 0x55a9b7933a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f33400640 1 -- 172.21.15.55:0/3504884401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f340c94e0 con 0x55a9b78d96d0 2024-04-02T07:23:31.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f32a00640 1 --2- 172.21.15.55:0/3504884401 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b788f4c0 0x55a9b78eb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:31.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f2a000640 1 --2- 172.21.15.55:0/3504884401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b78d8db0 0x55a9b7933a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:31.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f33400640 1 --2- 172.21.15.55:0/3504884401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 0x55a9b7933fb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c000f90 tx=0x7f7f2c004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5988d428661f6fa5 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:31.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f17e00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:23:31.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f17e00640 1 -- 172.21.15.55:0/3504884401 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2c007000 con 0x55a9b78d96d0 2024-04-02T07:23:31.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f17e00640 1 -- 172.21.15.55:0/3504884401 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f2c011660 con 0x55a9b78d96d0 2024-04-02T07:23:31.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3504884401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a9b76ad460 con 0x55a9b78d96d0 2024-04-02T07:23:31.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f17e00640 1 -- 172.21.15.55:0/3504884401 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f2c007660 con 0x55a9b78d96d0 2024-04-02T07:23:31.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 10 client.5376 fetch_fsmap learned FSMap version 17 2024-04-02T07:23:31.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3504884401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55a9b73d9cc0 con 0x55a9b78d96d0 2024-04-02T07:23:31.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f17e00640 1 -- 172.21.15.55:0/3504884401 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a9b76ad460 con 0x55a9b78d96d0 2024-04-02T07:23:31.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f17e00640 1 -- 172.21.15.55:0/3504884401 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 17) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7f2c0039a0 con 0x55a9b78d96d0 2024-04-02T07:23:31.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 10 client.5376 fetch_fsmap finished waiting for FSMap version 17 2024-04-02T07:23:31.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 10 client.5376 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:23:31.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 20 client.5376 populate_metadata read hostname 'smithi055' 2024-04-02T07:23:31.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 --2- 172.21.15.55:0/3504884401 >> [v2:172.21.15.55:6834/2440784960,v1:172.21.15.55:6835/2440784960] conn(0x55a9b79344f0 0x55a9b79348d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:31.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 4 client.5376 mds_command: new command op to 5199 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-02T07:23:31.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3504884401 --> [v2:172.21.15.55:6834/2440784960,v1:172.21.15.55:6835/2440784960] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55a9b76a69c0 con 0x55a9b79344f0 2024-04-02T07:23:31.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f32a00640 1 --2- 172.21.15.55:0/3504884401 >> [v2:172.21.15.55:6834/2440784960,v1:172.21.15.55:6835/2440784960] conn(0x55a9b79344f0 0x55a9b79348d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f32a00640 1 --2- 172.21.15.55:0/3504884401 >> [v2:172.21.15.55:6834/2440784960,v1:172.21.15.55:6835/2440784960] conn(0x55a9b79344f0 0x55a9b79348d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3be11cbb80c7016b server_cookie=4de9a38e943c8935 in_seq=0 out_seq=0 2024-04-02T07:23:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f17e00640 10 client.5376 ms_handle_connect on v2:172.21.15.55:6834/2440784960 2024-04-02T07:23:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f17e00640 1 -- 172.21.15.55:0/3504884401 <== mds.0 v2:172.21.15.55:6834/2440784960 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55a9b76a69c0 con 0x55a9b79344f0 2024-04-02T07:23:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f17e00640 10 client.5376 handle_command_reply: tid=0 2024-04-02T07:23:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 client.5376 shutdown 2024-04-02T07:23:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3504884401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 msgr2=0x55a9b7933fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 --2- 172.21.15.55:0/3504884401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 0x55a9b7933fb0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f7f2c000f90 tx=0x7f7f2c004a50 comp rx=0 tx=0).stop 2024-04-02T07:23:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3504884401 shutdown_connections 2024-04-02T07:23:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 --2- 172.21.15.55:0/3504884401 >> [v2:172.21.15.55:6834/2440784960,v1:172.21.15.55:6835/2440784960] conn(0x55a9b79344f0 0x55a9b79348d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 --2- 172.21.15.55:0/3504884401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a9b78d96d0 0x55a9b7933fb0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 --2- 172.21.15.55:0/3504884401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a9b78d8db0 0x55a9b7933a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 --2- 172.21.15.55:0/3504884401 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a9b788f4c0 0x55a9b78eb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f17e00640 0 client.5376 ms_handle_reset on v2:172.21.15.55:6834/2440784960 2024-04-02T07:23:31.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3504884401 >> 172.21.15.55:0/3504884401 conn(0x55a9b7895830 msgr2=0x55a9b78d6790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:31.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3504884401 shutdown_connections 2024-04-02T07:23:31.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 1 -- 172.21.15.55:0/3504884401 wait complete. 2024-04-02T07:23:31.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f3cf0f000 20 client.5376 trim_cache size 0 max 16384 2024-04-02T07:23:31.966 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:23:31.966 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "642a0456-a2ac-49a4-91a5-3b3449b512da", 2024-04-02T07:23:31.966 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-02T07:23:31.966 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 5199, 2024-04-02T07:23:31.966 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-02T07:23:31.967 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-02T07:23:31.967 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-02T07:23:31.967 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 6.2284507649999998, 2024-04-02T07:23:31.967 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 17, 2024-04-02T07:23:31.967 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 34, 2024-04-02T07:23:31.967 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 34, 2024-04-02T07:23:31.967 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 13.482152170999999 2024-04-02T07:23:31.967 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:23:31.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f39a00640 1 -- 172.21.15.55:0/3363712223 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7f10066690 msgr2=0x7f7f10068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:31.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f39a00640 1 --2- 172.21.15.55:0/3363712223 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7f10066690 0x7f7f10068b50 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7f3415cf10 tx=0x7f7f1c009040 comp rx=0 tx=0).stop 2024-04-02T07:23:31.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f39a00640 1 -- 172.21.15.55:0/3363712223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f34069d90 msgr2=0x7f7f340c8fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:31.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f39a00640 1 --2- 172.21.15.55:0/3363712223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f34069d90 0x7f7f340c8fa0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f7f2401aa30 tx=0x7f7f24019120 comp rx=0 tx=0).stop 2024-04-02T07:23:31.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f39a00640 1 -- 172.21.15.55:0/3363712223 shutdown_connections 2024-04-02T07:23:31.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f39a00640 1 --2- 172.21.15.55:0/3363712223 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7f3415fff0 0x7f7f340af050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f39a00640 1 --2- 172.21.15.55:0/3363712223 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7f10066690 0x7f7f10068b50 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f39a00640 1 --2- 172.21.15.55:0/3363712223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7f340aebd0 0x7f7f34145810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f39a00640 1 --2- 172.21.15.55:0/3363712223 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f34069d90 0x7f7f340c8fa0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:31.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.955+0000 7f7f39a00640 1 -- 172.21.15.55:0/3363712223 >> 172.21.15.55:0/3363712223 conn(0x7f7f340b1420 msgr2=0x7f7f341504f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:31.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.959+0000 7f7f39a00640 1 -- 172.21.15.55:0/3363712223 shutdown_connections 2024-04-02T07:23:31.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:31.959+0000 7f7f39a00640 1 -- 172.21.15.55:0/3363712223 wait complete. 2024-04-02T07:23:31.978 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-02T07:23:32.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.115+0000 7f2842c00640 1 Processor -- start 2024-04-02T07:23:32.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.115+0000 7f2842c00640 1 -- start start 2024-04-02T07:23:32.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.119+0000 7f2842c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f283c0cab70 0x7f283c0b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:32.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.119+0000 7f2842c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f283c0b0ea0 0x7f283c0c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:32.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.119+0000 7f2842c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f283c15a860 con 0x7f283c15a480 2024-04-02T07:23:32.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.119+0000 7f2842c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f283c15ce20 con 0x7f283c0b0ea0 2024-04-02T07:23:32.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.119+0000 7f2842c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283c0b1350 con 0x7f283c0cab70 2024-04-02T07:23:32.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.119+0000 7f2833e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f283c0cab70 0x7f283c0b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:32.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.119+0000 7f2833e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f283c0cab70 0x7f283c0b0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:50924/0 (socket says 172.21.15.55:50924) 2024-04-02T07:23:32.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.119+0000 7f2833e00640 1 -- 172.21.15.55:0/2100262128 learned_addr learned my addr 172.21.15.55:0/2100262128 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:32.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.119+0000 7f2840c00640 1 --2- 172.21.15.55:0/2100262128 >> v2:172.21.15.106:3300/0 conn(0x7f283c0b0ea0 0x7f283c0c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:32.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.119+0000 7f2833e00640 1 -- 172.21.15.55:0/2100262128 >> v2:172.21.15.106:3300/0 conn(0x7f283c0b0ea0 msgr2=0x7f283c0c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:32.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.119+0000 7f2833e00640 1 --2- 172.21.15.55:0/2100262128 >> v2:172.21.15.106:3300/0 conn(0x7f283c0b0ea0 0x7f283c0c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:32.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.119+0000 7f2833e00640 1 -- 172.21.15.55:0/2100262128 >> v1:172.21.15.106:6789/0 conn(0x7f283c15a480 legacy=0x7f283c0ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:32.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.119+0000 7f2833e00640 1 -- 172.21.15.55:0/2100262128 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f283c0cb570 con 0x7f283c0cab70 2024-04-02T07:23:32.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f2833e00640 1 --2- 172.21.15.55:0/2100262128 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f283c0cab70 0x7f283c0b0960 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2824009870 tx=0x7f282401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9f087e995173609 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:32.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f283b400640 1 -- 172.21.15.55:0/2100262128 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28240ab650 con 0x7f283c0cab70 2024-04-02T07:23:32.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f283b400640 1 -- 172.21.15.55:0/2100262128 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28240ab7b0 con 0x7f283c0cab70 2024-04-02T07:23:32.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f283b400640 1 -- 172.21.15.55:0/2100262128 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28240abb40 con 0x7f283c0cab70 2024-04-02T07:23:32.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f2842c00640 1 -- 172.21.15.55:0/2100262128 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f283c0cab70 msgr2=0x7f283c0b0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:32.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f2842c00640 1 --2- 172.21.15.55:0/2100262128 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f283c0cab70 0x7f283c0b0960 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2824009870 tx=0x7f282401c560 comp rx=0 tx=0).stop 2024-04-02T07:23:32.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f2842c00640 1 -- 172.21.15.55:0/2100262128 shutdown_connections 2024-04-02T07:23:32.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f2842c00640 1 --2- 172.21.15.55:0/2100262128 >> v2:172.21.15.106:3300/0 conn(0x7f283c0b0ea0 0x7f283c0c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:32.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f2842c00640 1 --2- 172.21.15.55:0/2100262128 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f283c0cab70 0x7f283c0b0960 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:32.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f2842c00640 1 -- 172.21.15.55:0/2100262128 >> 172.21.15.55:0/2100262128 conn(0x7f283c066080 msgr2=0x7f283c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:32.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f2842c00640 1 -- 172.21.15.55:0/2100262128 shutdown_connections 2024-04-02T07:23:32.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f2842c00640 1 -- 172.21.15.55:0/2100262128 wait complete. 2024-04-02T07:23:32.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f2842c00640 1 Processor -- start 2024-04-02T07:23:32.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f2842c00640 1 -- start start 2024-04-02T07:23:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f2842c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f283c0b0ea0 0x7f283c070470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f2842c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f283c0cab70 0x7f283c0b2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f2842c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f283c15a480 0x7f283c0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f2842c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c0b2fd0 con 0x7f283c0cab70 2024-04-02T07:23:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f2842c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f283c13eee0 con 0x7f283c0b0ea0 2024-04-02T07:23:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f2842c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f283c13f780 con 0x7f283c15a480 2024-04-02T07:23:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.123+0000 7f2833e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f283c0cab70 0x7f283c0b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.127+0000 7f2833e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f283c0cab70 0x7f283c0b2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45736/0 (socket says 172.21.15.55:45736) 2024-04-02T07:23:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.127+0000 7f2833e00640 1 -- 172.21.15.55:0/784718226 learned_addr learned my addr 172.21.15.55:0/784718226 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.127+0000 7f283be00640 1 --2- 172.21.15.55:0/784718226 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f283c0b0ea0 0x7f283c070470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.127+0000 7f2840c00640 1 --2- 172.21.15.55:0/784718226 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f283c15a480 0x7f283c0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.127+0000 7f2833e00640 1 -- 172.21.15.55:0/784718226 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f283c15a480 msgr2=0x7f283c0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.127+0000 7f2833e00640 1 --2- 172.21.15.55:0/784718226 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f283c15a480 0x7f283c0b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.127+0000 7f2833e00640 1 -- 172.21.15.55:0/784718226 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f283c0b0ea0 msgr2=0x7f283c070470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.127+0000 7f2833e00640 1 --2- 172.21.15.55:0/784718226 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f283c0b0ea0 0x7f283c070470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.127+0000 7f2833e00640 1 -- 172.21.15.55:0/784718226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28240094d0 con 0x7f283c0cab70 2024-04-02T07:23:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.127+0000 7f2840c00640 1 --2- 172.21.15.55:0/784718226 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f283c15a480 0x7f283c0b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.127+0000 7f2833e00640 1 --2- 172.21.15.55:0/784718226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f283c0cab70 0x7f283c0b2550 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f28240ad040 tx=0x7f282401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:32.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.127+0000 7f2838c00640 1 -- 172.21.15.55:0/784718226 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28240b4800 con 0x7f283c0cab70 2024-04-02T07:23:32.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.127+0000 7f2838c00640 1 -- 172.21.15.55:0/784718226 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28240b4960 con 0x7f283c0cab70 2024-04-02T07:23:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.127+0000 7f2842c00640 1 -- 172.21.15.55:0/784718226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f283c0b3210 con 0x7f283c0cab70 2024-04-02T07:23:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.127+0000 7f2838c00640 1 -- 172.21.15.55:0/784718226 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28240b4d10 con 0x7f283c0cab70 2024-04-02T07:23:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.127+0000 7f2842c00640 1 -- 172.21.15.55:0/784718226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f283c13f410 con 0x7f283c0cab70 2024-04-02T07:23:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.127+0000 7f2842c00640 1 -- 172.21.15.55:0/784718226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f283c13f8f0 con 0x7f283c0cab70 2024-04-02T07:23:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.127+0000 7f2838c00640 1 -- 172.21.15.55:0/784718226 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f28240b3380 con 0x7f283c0cab70 2024-04-02T07:23:32.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.127+0000 7f2838c00640 1 --2- 172.21.15.55:0/784718226 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2818066690 0x7f2818068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:32.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.127+0000 7f2838c00640 1 -- 172.21.15.55:0/784718226 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f282411e2c0 con 0x7f283c0cab70 2024-04-02T07:23:32.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.131+0000 7f283be00640 1 --2- 172.21.15.55:0/784718226 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2818066690 0x7f2818068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:32.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.131+0000 7f283be00640 1 --2- 172.21.15.55:0/784718226 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2818066690 0x7f2818068b50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f282c0015b0 tx=0x7f282c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:32.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.131+0000 7f2838c00640 1 -- 172.21.15.55:0/784718226 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f28240eb6b0 con 0x7f283c0cab70 2024-04-02T07:23:32.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.331+0000 7f2842c00640 1 -- 172.21.15.55:0/784718226 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f283c066c90 con 0x7f283c0cab70 2024-04-02T07:23:32.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.331+0000 7f2838c00640 1 -- 172.21.15.55:0/784718226 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f28240ab610 con 0x7f283c0cab70 2024-04-02T07:23:32.336 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-02T07:23:32.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.335+0000 7f2842c00640 1 -- 172.21.15.55:0/784718226 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2818066690 msgr2=0x7f2818068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:32.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.335+0000 7f2842c00640 1 --2- 172.21.15.55:0/784718226 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2818066690 0x7f2818068b50 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f282c0015b0 tx=0x7f282c009040 comp rx=0 tx=0).stop 2024-04-02T07:23:32.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.335+0000 7f2842c00640 1 -- 172.21.15.55:0/784718226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f283c0cab70 msgr2=0x7f283c0b2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:32.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.335+0000 7f2842c00640 1 --2- 172.21.15.55:0/784718226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f283c0cab70 0x7f283c0b2550 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f28240ad040 tx=0x7f282401ada0 comp rx=0 tx=0).stop 2024-04-02T07:23:32.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.335+0000 7f2842c00640 1 -- 172.21.15.55:0/784718226 shutdown_connections 2024-04-02T07:23:32.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.335+0000 7f2842c00640 1 --2- 172.21.15.55:0/784718226 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f283c15a480 0x7f283c0b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:32.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.335+0000 7f2842c00640 1 --2- 172.21.15.55:0/784718226 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f283c0cab70 0x7f283c0b2550 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:32.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.335+0000 7f2842c00640 1 --2- 172.21.15.55:0/784718226 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2818066690 0x7f2818068b50 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:32.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.335+0000 7f2842c00640 1 --2- 172.21.15.55:0/784718226 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f283c0b0ea0 0x7f283c070470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:32.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.335+0000 7f2842c00640 1 -- 172.21.15.55:0/784718226 >> 172.21.15.55:0/784718226 conn(0x7f283c066080 msgr2=0x7f283c1502f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:32.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.335+0000 7f2842c00640 1 -- 172.21.15.55:0/784718226 shutdown_connections 2024-04-02T07:23:32.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:32.335+0000 7f2842c00640 1 -- 172.21.15.55:0/784718226 wait complete. 2024-04-02T07:23:32.356 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-02T07:23:32.356 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-02T07:23:32.356 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-02T07:23:32.357 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-02T07:23:32.357 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-02T07:23:32.357 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-02T07:23:32.357 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-02T07:23:32.357 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-02T07:23:32.357 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:23:32.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:32.357 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-02T07:23:32.368 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:23:32.368 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:23:32.368 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:23:32.368 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:23:32.368 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-02T07:23:32.368 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:23:32.368 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:23:32.368 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:23:32.368 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-02T07:23:32.368 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:23:32.368 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:23:32.368 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-02T07:23:32.369 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-02T07:23:32.369 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:23:32.369 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-02T07:23:32.369 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-02T07:23:32.369 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42382sec preferred_lft 42382sec 2024-04-02T07:23:32.369 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2024-04-02T07:23:32.369 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:23:32.369 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:23:32.369 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:23:32.369 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-02T07:23:32.369 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-02T07:23:32.369 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:81:5a:89:17 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:23:32.369 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-02T07:23:32.369 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:23:32.370 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:23:32.370 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-02T07:23:32.370 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-02T07:23:32.370 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:23:32.370 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-02T07:23:32.370 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:23:32.370 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:23:32.370 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-02T07:23:32.370 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-02T07:23:32.370 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:23:32.370 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:23:32.370 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-02T07:23:32.370 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-02T07:23:32.370 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:23:32.371 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:32.371 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-02T07:23:32.429 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:23:32.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:32.431 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-02T07:23:32.484 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-02T07:23:32.485 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-02T07:23:32.485 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-02T07:23:32.485 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-02T07:23:32.485 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-02T07:23:32.485 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-02T07:23:32.485 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:32.485 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:23:32.485 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:23:32.485 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-02T07:23:32.486 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-02T07:23:32.486 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-02T07:23:32.486 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:23:32.577 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:32.577 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-02T07:23:32.586 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-02T07:23:32.586 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-02T07:23:32.586 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:23:32.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:32.587 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-02T07:23:32.647 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-02T07:23:32.648 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:23:32.648 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-02T07:23:32.699 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:23:32.700 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:23:32.700 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:23:32.751 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:23:32.812 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:23:32.812 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:23:32.877 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:23:32.879 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:23:32.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:32.880 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:23:32.931 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-02T07:23:32.932 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-02T07:23:32.978 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:23:32.998 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:23:32.999 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:23:33.058 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:23:33.060 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:23:33.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:33.061 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:23:33.074 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:2024-04-02T07:23:33.071+0000 7fda5e049580 -1 init, newargv = 0x55aebc709db0 newargc=15 2024-04-02T07:23:33.074 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[37646]: starting ceph client 2024-04-02T07:23:33.082 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[37646]: starting fuse 2024-04-02T07:23:33.082 INFO:teuthology.orchestra.run.smithi055.stdout:43 2024-04-02T07:23:33.083 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-02T07:23:33.083 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:23:33.083 DEBUG:teuthology.orchestra.run.smithi055:> import glob 2024-04-02T07:23:33.084 DEBUG:teuthology.orchestra.run.smithi055:> import re 2024-04-02T07:23:33.084 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:23:33.084 DEBUG:teuthology.orchestra.run.smithi055:> import subprocess 2024-04-02T07:23:33.084 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:23:33.084 DEBUG:teuthology.orchestra.run.smithi055:> def _find_admin_socket(client_name): 2024-04-02T07:23:33.084 DEBUG:teuthology.orchestra.run.smithi055:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-02T07:23:33.084 DEBUG:teuthology.orchestra.run.smithi055:> files = glob.glob(asok_path) 2024-04-02T07:23:33.084 DEBUG:teuthology.orchestra.run.smithi055:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-02T07:23:33.084 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:23:33.084 DEBUG:teuthology.orchestra.run.smithi055:> # Given a non-glob path, it better be there 2024-04-02T07:23:33.084 DEBUG:teuthology.orchestra.run.smithi055:> if "*" not in asok_path: 2024-04-02T07:23:33.084 DEBUG:teuthology.orchestra.run.smithi055:> assert(len(files) == 1) 2024-04-02T07:23:33.084 DEBUG:teuthology.orchestra.run.smithi055:> return files[0] 2024-04-02T07:23:33.084 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:23:33.084 DEBUG:teuthology.orchestra.run.smithi055:> for f in files: 2024-04-02T07:23:33.085 DEBUG:teuthology.orchestra.run.smithi055:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-02T07:23:33.085 DEBUG:teuthology.orchestra.run.smithi055:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-02T07:23:33.085 DEBUG:teuthology.orchestra.run.smithi055:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-02T07:23:33.085 DEBUG:teuthology.orchestra.run.smithi055:> contents = proc_f.read() 2024-04-02T07:23:33.085 DEBUG:teuthology.orchestra.run.smithi055:> if mountpoint in contents: 2024-04-02T07:23:33.085 DEBUG:teuthology.orchestra.run.smithi055:> return f 2024-04-02T07:23:33.085 DEBUG:teuthology.orchestra.run.smithi055:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-02T07:23:33.085 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:23:33.085 DEBUG:teuthology.orchestra.run.smithi055:> print(_find_admin_socket("client.0")) 2024-04-02T07:23:33.085 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:23:33.208 INFO:teuthology.orchestra.run.smithi055.stdout:/var/run/ceph/ceph-client.0.37646.asok 2024-04-02T07:23:33.392 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37646.asok 2024-04-02T07:23:33.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:33.392 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37646.asok status 2024-04-02T07:23:33.567 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:23:33.568 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": { 2024-04-02T07:23:33.568 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_sha1": "d0e392d9aee635f2b65768c460c7a151ead7a5e2", 2024-04-02T07:23:33.568 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)", 2024-04-02T07:23:33.568 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "0", 2024-04-02T07:23:33.568 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2024-04-02T07:23:33.568 INFO:teuthology.orchestra.run.smithi055.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-02T07:23:33.568 INFO:teuthology.orchestra.run.smithi055.stdout: "pid": "37646", 2024-04-02T07:23:33.568 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2024-04-02T07:23:33.568 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:33.568 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_count": 0, 2024-04-02T07:23:33.568 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_pinned_count": 0, 2024-04-02T07:23:33.568 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 5009, 2024-04-02T07:23:33.568 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": { 2024-04-02T07:23:33.569 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2024-04-02T07:23:33.569 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2024-04-02T07:23:33.569 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 5009 2024-04-02T07:23:33.569 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:33.569 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:23:33.569 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:23:33.569 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:23:33.569 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 2157445516 2024-04-02T07:23:33.569 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:23:33.569 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:33.569 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:23:33.569 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:23:33.569 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:23:33.569 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 2157445516 2024-04-02T07:23:33.569 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:23:33.570 INFO:teuthology.orchestra.run.smithi055.stdout: "inst_str": "client.5009 192.168.0.1:0/2157445516", 2024-04-02T07:23:33.570 INFO:teuthology.orchestra.run.smithi055.stdout: "addr_str": "192.168.0.1:0/2157445516", 2024-04-02T07:23:33.570 INFO:teuthology.orchestra.run.smithi055.stdout: "inode_count": 1, 2024-04-02T07:23:33.570 INFO:teuthology.orchestra.run.smithi055.stdout: "mds_epoch": 17, 2024-04-02T07:23:33.570 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch": 34, 2024-04-02T07:23:33.570 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch_barrier": 0, 2024-04-02T07:23:33.570 INFO:teuthology.orchestra.run.smithi055.stdout: "blocklisted": false, 2024-04-02T07:23:33.570 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs" 2024-04-02T07:23:33.570 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:23:33.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:33.583 DEBUG:teuthology.orchestra.run.smithi055:> stat --file-system '--printf=%T 2024-04-02T07:23:33.583 DEBUG:teuthology.orchestra.run.smithi055:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-02T07:23:33.592 INFO:teuthology.orchestra.run.smithi055.stdout:fuseblk 2024-04-02T07:23:33.592 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-02T07:23:33.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:33.593 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:23:33.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:33.655 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir) 2024-04-02T07:23:33.710 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:33.710 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parentdir/childdir) 2024-04-02T07:23:33.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:33.768 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch rfile) 2024-04-02T07:23:33.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:33.824 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/pfile) 2024-04-02T07:23:33.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:33.882 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parentdir/childdir/cfile) 2024-04-02T07:23:33.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:33.935 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-02T07:23:33.999 INFO:teuthology.orchestra.run.smithi055.stdout:./ 2024-04-02T07:23:34.000 INFO:teuthology.orchestra.run.smithi055.stdout:./rfile 2024-04-02T07:23:34.000 INFO:teuthology.orchestra.run.smithi055.stdout:./parentdir 2024-04-02T07:23:34.000 INFO:teuthology.orchestra.run.smithi055.stdout:./parentdir/pfile 2024-04-02T07:23:34.000 INFO:teuthology.orchestra.run.smithi055.stdout:./parentdir/childdir 2024-04-02T07:23:34.000 INFO:teuthology.orchestra.run.smithi055.stdout:./parentdir/childdir/cfile 2024-04-02T07:23:34.001 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:23:34.001 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:23:34.001 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:23:34.001 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:23:34.001 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-02T07:23:34.001 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:23:34.109 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:23:34.297 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:23:34.297 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:23:34.297 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:23:34.297 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:23:34.297 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./rfile").st_ino) 2024-04-02T07:23:34.297 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:23:34.404 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627778 2024-04-02T07:23:34.593 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:23:34.593 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:23:34.593 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:23:34.593 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:23:34.594 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir").st_ino) 2024-04-02T07:23:34.594 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:23:34.703 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627776 2024-04-02T07:23:34.893 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:23:34.893 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:23:34.893 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:23:34.894 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:23:34.894 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/pfile").st_ino) 2024-04-02T07:23:34.894 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:23:34.999 INFO:teuthology.orchestra.run.smithi055.stdout:1099511628279 2024-04-02T07:23:35.189 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:23:35.189 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:23:35.189 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:23:35.189 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:23:35.189 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir").st_ino) 2024-04-02T07:23:35.189 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:23:35.301 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627777 2024-04-02T07:23:35.490 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:23:35.490 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:23:35.490 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:23:35.490 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:23:35.491 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parentdir/childdir/cfile").st_ino) 2024-04-02T07:23:35.491 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:23:35.602 INFO:teuthology.orchestra.run.smithi055.stdout:1099511628280 2024-04-02T07:23:35.791 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:23:35.791 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:23:35.844 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:23:36.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.023+0000 7fe9df400640 1 Processor -- start 2024-04-02T07:23:36.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.023+0000 7fe9df400640 1 -- start start 2024-04-02T07:23:36.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.027+0000 7fe9df400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d8153ea0 0x7fe9d80c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:36.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.027+0000 7fe9df400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe9d8159be0 0x7fe9d80b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:36.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.027+0000 7fe9df400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d813d0c0 con 0x7fe9d815a040 2024-04-02T07:23:36.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.027+0000 7fe9df400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d815a4f0 con 0x7fe9d8159be0 2024-04-02T07:23:36.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.027+0000 7fe9df400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d815a7d0 con 0x7fe9d8153ea0 2024-04-02T07:23:36.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.027+0000 7fe9dca00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d8153ea0 0x7fe9d80c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:36.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.027+0000 7fe9cfe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe9d8159be0 0x7fe9d80b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:36.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.027+0000 7fe9dca00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d8153ea0 0x7fe9d80c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:52952/0 (socket says 172.21.15.55:52952) 2024-04-02T07:23:36.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.027+0000 7fe9dca00640 1 -- 172.21.15.55:0/2679588913 learned_addr learned my addr 172.21.15.55:0/2679588913 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:36.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.027+0000 7fe9dd400640 1 --1- 172.21.15.55:0/2679588913 >> v1:172.21.15.106:6789/0 conn(0x7fe9d815a040 0x7fe9d813ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:53010/0 (socket says 172.21.15.55:53010) 2024-04-02T07:23:36.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.027+0000 7fe9dca00640 1 -- 172.21.15.55:0/2679588913 >> v2:172.21.15.106:3300/0 conn(0x7fe9d8159be0 msgr2=0x7fe9d80b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:36.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.027+0000 7fe9dca00640 1 --2- 172.21.15.55:0/2679588913 >> v2:172.21.15.106:3300/0 conn(0x7fe9d8159be0 0x7fe9d80b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.027+0000 7fe9dca00640 1 -- 172.21.15.55:0/2679588913 >> v1:172.21.15.106:6789/0 conn(0x7fe9d815a040 legacy=0x7fe9d813ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:36.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.027+0000 7fe9dca00640 1 -- 172.21.15.55:0/2679588913 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d815aab0 con 0x7fe9d8153ea0 2024-04-02T07:23:36.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.031+0000 7fe9dca00640 1 --2- 172.21.15.55:0/2679588913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d8153ea0 0x7fe9d80c4120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8009870 tx=0x7fe9c801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c34a2b4767993054 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:36.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.031+0000 7fe9d7e00640 1 -- 172.21.15.55:0/2679588913 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80a9640 con 0x7fe9d8153ea0 2024-04-02T07:23:36.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.031+0000 7fe9d7e00640 1 -- 172.21.15.55:0/2679588913 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c80a97a0 con 0x7fe9d8153ea0 2024-04-02T07:23:36.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.031+0000 7fe9d7e00640 1 -- 172.21.15.55:0/2679588913 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c80a9b30 con 0x7fe9d8153ea0 2024-04-02T07:23:36.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.031+0000 7fe9df400640 1 -- 172.21.15.55:0/2679588913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d8153ea0 msgr2=0x7fe9d80c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:36.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.031+0000 7fe9df400640 1 --2- 172.21.15.55:0/2679588913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d8153ea0 0x7fe9d80c4120 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8009870 tx=0x7fe9c801c560 comp rx=0 tx=0).stop 2024-04-02T07:23:36.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.031+0000 7fe9df400640 1 -- 172.21.15.55:0/2679588913 shutdown_connections 2024-04-02T07:23:36.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.031+0000 7fe9df400640 1 --2- 172.21.15.55:0/2679588913 >> v2:172.21.15.106:3300/0 conn(0x7fe9d8159be0 0x7fe9d80b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.031+0000 7fe9df400640 1 --2- 172.21.15.55:0/2679588913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d8153ea0 0x7fe9d80c4120 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.031+0000 7fe9df400640 1 -- 172.21.15.55:0/2679588913 >> 172.21.15.55:0/2679588913 conn(0x7fe9d8066080 msgr2=0x7fe9d8069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:36.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.031+0000 7fe9df400640 1 -- 172.21.15.55:0/2679588913 shutdown_connections 2024-04-02T07:23:36.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.031+0000 7fe9df400640 1 -- 172.21.15.55:0/2679588913 wait complete. 2024-04-02T07:23:36.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.031+0000 7fe9df400640 1 Processor -- start 2024-04-02T07:23:36.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.031+0000 7fe9df400640 1 -- start start 2024-04-02T07:23:36.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9df400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d8153ea0 0x7fe9d80ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:36.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9df400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d8159be0 0x7fe9d813b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:36.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9df400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9d815a040 0x7fe9d813bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:36.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9df400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d80cc980 con 0x7fe9d815a040 2024-04-02T07:23:36.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9df400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d8141fc0 con 0x7fe9d8153ea0 2024-04-02T07:23:36.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9df400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d80cbd00 con 0x7fe9d8159be0 2024-04-02T07:23:36.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9dd400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9d815a040 0x7fe9d813bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:36.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9dd400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9d815a040 0x7fe9d813bd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57696/0 (socket says 172.21.15.55:57696) 2024-04-02T07:23:36.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9dd400640 1 -- 172.21.15.55:0/1387157011 learned_addr learned my addr 172.21.15.55:0/1387157011 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:36.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9cfe00640 1 --2- 172.21.15.55:0/1387157011 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d8159be0 0x7fe9d813b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:36.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9dca00640 1 --2- 172.21.15.55:0/1387157011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d8153ea0 0x7fe9d80ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:36.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9cfe00640 1 -- 172.21.15.55:0/1387157011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d8153ea0 msgr2=0x7fe9d80ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:36.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9cfe00640 1 --2- 172.21.15.55:0/1387157011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d8153ea0 0x7fe9d80ccda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9cfe00640 1 -- 172.21.15.55:0/1387157011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9d815a040 msgr2=0x7fe9d813bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:36.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9cfe00640 1 --2- 172.21.15.55:0/1387157011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9d815a040 0x7fe9d813bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9cfe00640 1 -- 172.21.15.55:0/1387157011 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c80094d0 con 0x7fe9d8159be0 2024-04-02T07:23:36.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9dd400640 1 --2- 172.21.15.55:0/1387157011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9d815a040 0x7fe9d813bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:23:36.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9cfe00640 1 --2- 172.21.15.55:0/1387157011 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d8159be0 0x7fe9d813b850 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000e870 tx=0x7fe9c000ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:36.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9d5600640 1 -- 172.21.15.55:0/1387157011 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c00095d0 con 0x7fe9d8159be0 2024-04-02T07:23:36.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9d5600640 1 -- 172.21.15.55:0/1387157011 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9c000c940 con 0x7fe9d8159be0 2024-04-02T07:23:36.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9d5600640 1 -- 172.21.15.55:0/1387157011 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9c000ccb0 con 0x7fe9d8159be0 2024-04-02T07:23:36.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9df400640 1 -- 172.21.15.55:0/1387157011 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d80cbfe0 con 0x7fe9d8159be0 2024-04-02T07:23:36.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9df400640 1 -- 172.21.15.55:0/1387157011 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d80cc5a0 con 0x7fe9d8159be0 2024-04-02T07:23:36.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9df400640 1 -- 172.21.15.55:0/1387157011 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d80ccac0 con 0x7fe9d8159be0 2024-04-02T07:23:36.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.035+0000 7fe9d5600640 1 -- 172.21.15.55:0/1387157011 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe9c0013470 con 0x7fe9d8159be0 2024-04-02T07:23:36.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.039+0000 7fe9d5600640 1 --2- 172.21.15.55:0/1387157011 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe9b4066690 0x7fe9b4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:36.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.039+0000 7fe9d5600640 1 -- 172.21.15.55:0/1387157011 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe9c00842b0 con 0x7fe9d8159be0 2024-04-02T07:23:36.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.039+0000 7fe9dca00640 1 --2- 172.21.15.55:0/1387157011 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe9b4066690 0x7fe9b4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:36.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.039+0000 7fe9dca00640 1 --2- 172.21.15.55:0/1387157011 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe9b4066690 0x7fe9b4068b50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80ae000 tx=0x7fe9c80b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:36.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.043+0000 7fe9d5600640 1 -- 172.21.15.55:0/1387157011 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe9d80ccac0 con 0x7fe9d8159be0 2024-04-02T07:23:36.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.207+0000 7fe9df400640 1 -- 172.21.15.55:0/1387157011 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe9d80ccac0 con 0x7fe9d8159be0 2024-04-02T07:23:36.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.207+0000 7fe9d5600640 1 -- 172.21.15.55:0/1387157011 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16101 (secure 0 0 0) 0x7fe9d80ccac0 con 0x7fe9d8159be0 2024-04-02T07:23:36.210 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:36.211 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":34,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:23:26.730146+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:23:23.729158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-02T07:23:24.740958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:23:36.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.211+0000 7fe9df400640 1 -- 172.21.15.55:0/1387157011 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe9b4066690 msgr2=0x7fe9b4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:36.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.211+0000 7fe9df400640 1 --2- 172.21.15.55:0/1387157011 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe9b4066690 0x7fe9b4068b50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80ae000 tx=0x7fe9c80b3040 comp rx=0 tx=0).stop 2024-04-02T07:23:36.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.211+0000 7fe9df400640 1 -- 172.21.15.55:0/1387157011 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d8159be0 msgr2=0x7fe9d813b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:36.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.211+0000 7fe9df400640 1 --2- 172.21.15.55:0/1387157011 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d8159be0 0x7fe9d813b850 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe9c000e870 tx=0x7fe9c000ed30 comp rx=0 tx=0).stop 2024-04-02T07:23:36.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.211+0000 7fe9df400640 1 -- 172.21.15.55:0/1387157011 shutdown_connections 2024-04-02T07:23:36.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.211+0000 7fe9df400640 1 --2- 172.21.15.55:0/1387157011 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9d815a040 0x7fe9d813bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.211+0000 7fe9df400640 1 --2- 172.21.15.55:0/1387157011 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9d8159be0 0x7fe9d813b850 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.211+0000 7fe9df400640 1 --2- 172.21.15.55:0/1387157011 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe9b4066690 0x7fe9b4068b50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.211+0000 7fe9df400640 1 --2- 172.21.15.55:0/1387157011 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9d8153ea0 0x7fe9d80ccda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.211+0000 7fe9df400640 1 -- 172.21.15.55:0/1387157011 >> 172.21.15.55:0/1387157011 conn(0x7fe9d8066080 msgr2=0x7fe9d815acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:36.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.211+0000 7fe9df400640 1 -- 172.21.15.55:0/1387157011 shutdown_connections 2024-04-02T07:23:36.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.211+0000 7fe9df400640 1 -- 172.21.15.55:0/1387157011 wait complete. 2024-04-02T07:23:36.231 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:23:23.729158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:23:24.740958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:23:36.232 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:23:36.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.371+0000 7fd82a200640 1 Processor -- start 2024-04-02T07:23:36.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.371+0000 7fd82a200640 1 -- start start 2024-04-02T07:23:36.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.375+0000 7fd82a200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd82415ca60 0x7fd8240cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:36.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.375+0000 7fd82a200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd824098a10 0x7fd824098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:36.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.375+0000 7fd82a200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8240993b0 con 0x7fd82406b920 2024-04-02T07:23:36.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.375+0000 7fd82a200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd82406c460 con 0x7fd824098a10 2024-04-02T07:23:36.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.375+0000 7fd82a200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82415ce40 con 0x7fd82415ca60 2024-04-02T07:23:36.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.375+0000 7fd823e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd82406b920 0x7fd82406bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57452/0 (socket says 172.21.15.55:57452) 2024-04-02T07:23:36.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.375+0000 7fd823e00640 1 -- 172.21.15.55:0/3038292941 learned_addr learned my addr 172.21.15.55:0/3038292941 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:36.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.375+0000 7fd823400640 1 --2- 172.21.15.55:0/3038292941 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd82415ca60 0x7fd8240cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:36.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.375+0000 7fd81be00640 1 --2- 172.21.15.55:0/3038292941 >> v2:172.21.15.106:3300/0 conn(0x7fd824098a10 0x7fd824098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:36.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.375+0000 7fd822a00640 1 -- 172.21.15.55:0/3038292941 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2788843760 0 0) 0x7fd8240993b0 con 0x7fd82406b920 2024-04-02T07:23:36.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.375+0000 7fd822a00640 1 -- 172.21.15.55:0/3038292941 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd808003530 con 0x7fd82406b920 2024-04-02T07:23:36.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.375+0000 7fd81be00640 1 -- 172.21.15.55:0/3038292941 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd82415ca60 msgr2=0x7fd8240cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:36.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.375+0000 7fd81be00640 1 --2- 172.21.15.55:0/3038292941 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd82415ca60 0x7fd8240cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.375+0000 7fd81be00640 1 -- 172.21.15.55:0/3038292941 >> v1:172.21.15.55:6789/0 conn(0x7fd82406b920 legacy=0x7fd82406bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:36.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.375+0000 7fd81be00640 1 -- 172.21.15.55:0/3038292941 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8240d01b0 con 0x7fd824098a10 2024-04-02T07:23:36.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.375+0000 7fd823400640 1 --2- 172.21.15.55:0/3038292941 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd82415ca60 0x7fd8240cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:23:36.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.379+0000 7fd81be00640 1 --2- 172.21.15.55:0/3038292941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd824098a10 0x7fd824098e70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0097c0 tx=0x7fd80c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d00e6277808f02f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:36.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.379+0000 7fd822a00640 1 -- 172.21.15.55:0/3038292941 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c0ac640 con 0x7fd824098a10 2024-04-02T07:23:36.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.379+0000 7fd822a00640 1 -- 172.21.15.55:0/3038292941 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c0ac7a0 con 0x7fd824098a10 2024-04-02T07:23:36.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.379+0000 7fd822a00640 1 -- 172.21.15.55:0/3038292941 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c0acb30 con 0x7fd824098a10 2024-04-02T07:23:36.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.379+0000 7fd82a200640 1 -- 172.21.15.55:0/3038292941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd824098a10 msgr2=0x7fd824098e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:36.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.379+0000 7fd82a200640 1 --2- 172.21.15.55:0/3038292941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd824098a10 0x7fd824098e70 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0097c0 tx=0x7fd80c01c3e0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.379+0000 7fd82a200640 1 -- 172.21.15.55:0/3038292941 shutdown_connections 2024-04-02T07:23:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.379+0000 7fd82a200640 1 --2- 172.21.15.55:0/3038292941 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd824098a10 0x7fd824098e70 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.379+0000 7fd82a200640 1 --2- 172.21.15.55:0/3038292941 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd82415ca60 0x7fd8240cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.379+0000 7fd82a200640 1 -- 172.21.15.55:0/3038292941 >> 172.21.15.55:0/3038292941 conn(0x7fd8240b2150 msgr2=0x7fd8240b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.379+0000 7fd82a200640 1 -- 172.21.15.55:0/3038292941 shutdown_connections 2024-04-02T07:23:36.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.379+0000 7fd82a200640 1 -- 172.21.15.55:0/3038292941 wait complete. 2024-04-02T07:23:36.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.379+0000 7fd82a200640 1 Processor -- start 2024-04-02T07:23:36.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.379+0000 7fd82a200640 1 -- start start 2024-04-02T07:23:36.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd82a200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd82406b920 0x7fd824152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd82a200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd824098a10 0x7fd8240c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd82a200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd82415ca60 0x7fd8240c4b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd82a200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82415adf0 con 0x7fd824098a10 2024-04-02T07:23:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd82a200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82415b0d0 con 0x7fd82406b920 2024-04-02T07:23:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd82a200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd82415b3b0 con 0x7fd82415ca60 2024-04-02T07:23:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd81be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd824098a10 0x7fd8240c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd81be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd824098a10 0x7fd8240c6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57702/0 (socket says 172.21.15.55:57702) 2024-04-02T07:23:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd81be00640 1 -- 172.21.15.55:0/109837041 learned_addr learned my addr 172.21.15.55:0/109837041 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd823400640 1 --2- 172.21.15.55:0/109837041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd82406b920 0x7fd824152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd823e00640 1 --2- 172.21.15.55:0/109837041 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd82415ca60 0x7fd8240c4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd81be00640 1 -- 172.21.15.55:0/109837041 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd82415ca60 msgr2=0x7fd8240c4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd81be00640 1 --2- 172.21.15.55:0/109837041 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd82415ca60 0x7fd8240c4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd81be00640 1 -- 172.21.15.55:0/109837041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd82406b920 msgr2=0x7fd824152ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:36.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd81be00640 1 --2- 172.21.15.55:0/109837041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd82406b920 0x7fd824152ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd81be00640 1 -- 172.21.15.55:0/109837041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd814009420 con 0x7fd824098a10 2024-04-02T07:23:36.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd823e00640 1 --2- 172.21.15.55:0/109837041 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd82415ca60 0x7fd8240c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:36.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd81be00640 1 --2- 172.21.15.55:0/109837041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd824098a10 0x7fd8240c6ac0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd80c018ff0 tx=0x7fd80c019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:36.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd81b400640 1 -- 172.21.15.55:0/109837041 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c0b5610 con 0x7fd824098a10 2024-04-02T07:23:36.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd81b400640 1 -- 172.21.15.55:0/109837041 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80c0b5770 con 0x7fd824098a10 2024-04-02T07:23:36.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd82a200640 1 -- 172.21.15.55:0/109837041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80c009420 con 0x7fd824098a10 2024-04-02T07:23:36.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd81b400640 1 -- 172.21.15.55:0/109837041 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c0b5b20 con 0x7fd824098a10 2024-04-02T07:23:36.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd82a200640 1 -- 172.21.15.55:0/109837041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd82415b970 con 0x7fd824098a10 2024-04-02T07:23:36.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd82a200640 1 -- 172.21.15.55:0/109837041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd824066c90 con 0x7fd824098a10 2024-04-02T07:23:36.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.383+0000 7fd81b400640 1 -- 172.21.15.55:0/109837041 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd80c0b3040 con 0x7fd824098a10 2024-04-02T07:23:36.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.387+0000 7fd81b400640 1 --2- 172.21.15.55:0/109837041 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd800066690 0x7fd800068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:36.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.387+0000 7fd81b400640 1 -- 172.21.15.55:0/109837041 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd80c11e110 con 0x7fd824098a10 2024-04-02T07:23:36.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.387+0000 7fd823400640 1 --2- 172.21.15.55:0/109837041 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd800066690 0x7fd800068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:36.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.387+0000 7fd823400640 1 --2- 172.21.15.55:0/109837041 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd800066690 0x7fd800068b50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd814009cf0 tx=0x7fd814009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:36.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.391+0000 7fd81b400640 1 -- 172.21.15.55:0/109837041 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd80c0eb500 con 0x7fd824098a10 2024-04-02T07:23:36.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.551+0000 7fd82a200640 1 -- 172.21.15.55:0/109837041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd824157420 con 0x7fd824098a10 2024-04-02T07:23:36.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.551+0000 7fd81b400640 1 -- 172.21.15.55:0/109837041 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd80c0eeb20 con 0x7fd824098a10 2024-04-02T07:23:36.554 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:23:36.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.551+0000 7fd82a200640 1 -- 172.21.15.55:0/109837041 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd800066690 msgr2=0x7fd800068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:36.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.551+0000 7fd82a200640 1 --2- 172.21.15.55:0/109837041 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd800066690 0x7fd800068b50 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd814009cf0 tx=0x7fd814009190 comp rx=0 tx=0).stop 2024-04-02T07:23:36.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.551+0000 7fd82a200640 1 -- 172.21.15.55:0/109837041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd824098a10 msgr2=0x7fd8240c6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:36.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.551+0000 7fd82a200640 1 --2- 172.21.15.55:0/109837041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd824098a10 0x7fd8240c6ac0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd80c018ff0 tx=0x7fd80c019180 comp rx=0 tx=0).stop 2024-04-02T07:23:36.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.555+0000 7fd82a200640 1 -- 172.21.15.55:0/109837041 shutdown_connections 2024-04-02T07:23:36.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.555+0000 7fd82a200640 1 --2- 172.21.15.55:0/109837041 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd82415ca60 0x7fd8240c4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.555+0000 7fd82a200640 1 --2- 172.21.15.55:0/109837041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd824098a10 0x7fd8240c6ac0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.555+0000 7fd82a200640 1 --2- 172.21.15.55:0/109837041 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd800066690 0x7fd800068b50 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.555+0000 7fd82a200640 1 --2- 172.21.15.55:0/109837041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd82406b920 0x7fd824152ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.555+0000 7fd82a200640 1 -- 172.21.15.55:0/109837041 >> 172.21.15.55:0/109837041 conn(0x7fd8240b2150 msgr2=0x7fd82406bd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:36.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.555+0000 7fd82a200640 1 -- 172.21.15.55:0/109837041 shutdown_connections 2024-04-02T07:23:36.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.555+0000 7fd82a200640 1 -- 172.21.15.55:0/109837041 wait complete. 2024-04-02T07:23:36.574 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:23:36.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.715+0000 7fe04fc00640 1 Processor -- start 2024-04-02T07:23:36.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.715+0000 7fe04fc00640 1 -- start start 2024-04-02T07:23:36.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.715+0000 7fe04fc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe0480cea00 0x7fe0480cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:36.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.715+0000 7fe04fc00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04806a350 con 0x7fe0480c9ba0 2024-04-02T07:23:36.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.715+0000 7fe04fc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe04806a5f0 con 0x7fe048069d90 2024-04-02T07:23:36.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.715+0000 7fe04fc00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0480cb7e0 con 0x7fe0480cea00 2024-04-02T07:23:36.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.715+0000 7fe04dc00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe0480c9ba0 0x7fe0480cc2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57454/0 (socket says 172.21.15.55:57454) 2024-04-02T07:23:36.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.715+0000 7fe04dc00640 1 -- 172.21.15.55:0/3125108572 learned_addr learned my addr 172.21.15.55:0/3125108572 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:36.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.715+0000 7fe04d200640 1 --2- 172.21.15.55:0/3125108572 >> v2:172.21.15.106:3300/0 conn(0x7fe0480cea00 0x7fe0480cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:36.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.715+0000 7fe047400640 1 -- 172.21.15.55:0/3125108572 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 10804055 0 0) 0x7fe04806a350 con 0x7fe0480c9ba0 2024-04-02T07:23:36.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.715+0000 7fe047400640 1 -- 172.21.15.55:0/3125108572 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe030003530 con 0x7fe0480c9ba0 2024-04-02T07:23:36.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.715+0000 7fe04d200640 1 -- 172.21.15.55:0/3125108572 >> v1:172.21.15.106:6789/0 conn(0x7fe048069d90 legacy=0x7fe0480cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:36.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.715+0000 7fe04d200640 1 -- 172.21.15.55:0/3125108572 >> v1:172.21.15.55:6789/0 conn(0x7fe0480c9ba0 legacy=0x7fe0480cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:36.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.715+0000 7fe04d200640 1 -- 172.21.15.55:0/3125108572 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0480cbac0 con 0x7fe0480cea00 2024-04-02T07:23:36.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.719+0000 7fe04d200640 1 --2- 172.21.15.55:0/3125108572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0480cea00 0x7fe0480cd120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0097c0 tx=0x7fe03c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca2db2665383235b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:36.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.719+0000 7fe047400640 1 -- 172.21.15.55:0/3125108572 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c0ab600 con 0x7fe0480cea00 2024-04-02T07:23:36.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.719+0000 7fe047400640 1 -- 172.21.15.55:0/3125108572 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03c0a7050 con 0x7fe0480cea00 2024-04-02T07:23:36.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.719+0000 7fe047400640 1 -- 172.21.15.55:0/3125108572 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03c0ab980 con 0x7fe0480cea00 2024-04-02T07:23:36.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.719+0000 7fe04fc00640 1 -- 172.21.15.55:0/3125108572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0480cea00 msgr2=0x7fe0480cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:36.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.719+0000 7fe04fc00640 1 --2- 172.21.15.55:0/3125108572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0480cea00 0x7fe0480cd120 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0097c0 tx=0x7fe03c01c4a0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.719+0000 7fe04fc00640 1 -- 172.21.15.55:0/3125108572 shutdown_connections 2024-04-02T07:23:36.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.719+0000 7fe04fc00640 1 --2- 172.21.15.55:0/3125108572 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe0480cea00 0x7fe0480cd120 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.719+0000 7fe04fc00640 1 -- 172.21.15.55:0/3125108572 >> 172.21.15.55:0/3125108572 conn(0x7fe0480cf550 msgr2=0x7fe0480cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:36.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.719+0000 7fe04fc00640 1 -- 172.21.15.55:0/3125108572 shutdown_connections 2024-04-02T07:23:36.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.719+0000 7fe04fc00640 1 -- 172.21.15.55:0/3125108572 wait complete. 2024-04-02T07:23:36.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe04fc00640 1 Processor -- start 2024-04-02T07:23:36.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe04fc00640 1 -- start start 2024-04-02T07:23:36.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe04fc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe048069d90 0x7fe048152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:36.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe04fc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0480c9ba0 0x7fe0480accf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:36.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe04fc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0480cea00 0x7fe0480ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:36.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe04fc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe048159e10 con 0x7fe0480c9ba0 2024-04-02T07:23:36.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe04fc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe048159200 con 0x7fe048069d90 2024-04-02T07:23:36.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe04fc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0481594e0 con 0x7fe0480cea00 2024-04-02T07:23:36.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe047e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0480c9ba0 0x7fe0480accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:36.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe047e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0480c9ba0 0x7fe0480accf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57716/0 (socket says 172.21.15.55:57716) 2024-04-02T07:23:36.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe047e00640 1 -- 172.21.15.55:0/373026998 learned_addr learned my addr 172.21.15.55:0/373026998 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:36.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe04dc00640 1 --2- 172.21.15.55:0/373026998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0480cea00 0x7fe0480ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:36.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe04d200640 1 --2- 172.21.15.55:0/373026998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe048069d90 0x7fe048152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:36.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe047e00640 1 -- 172.21.15.55:0/373026998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0480cea00 msgr2=0x7fe0480ad930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:36.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe047e00640 1 --2- 172.21.15.55:0/373026998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0480cea00 0x7fe0480ad930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe047e00640 1 -- 172.21.15.55:0/373026998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe048069d90 msgr2=0x7fe048152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:36.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe047e00640 1 --2- 172.21.15.55:0/373026998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe048069d90 0x7fe048152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe047e00640 1 -- 172.21.15.55:0/373026998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe03c009420 con 0x7fe0480c9ba0 2024-04-02T07:23:36.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe047e00640 1 --2- 172.21.15.55:0/373026998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0480c9ba0 0x7fe0480accf0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe03400c500 tx=0x7fe03400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:36.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe044c00640 1 -- 172.21.15.55:0/373026998 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe034005220 con 0x7fe0480c9ba0 2024-04-02T07:23:36.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe044c00640 1 -- 172.21.15.55:0/373026998 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe034005380 con 0x7fe0480c9ba0 2024-04-02T07:23:36.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe044c00640 1 -- 172.21.15.55:0/373026998 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe034007270 con 0x7fe0480c9ba0 2024-04-02T07:23:36.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe04fc00640 1 -- 172.21.15.55:0/373026998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0481597c0 con 0x7fe0480c9ba0 2024-04-02T07:23:36.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.723+0000 7fe04fc00640 1 -- 172.21.15.55:0/373026998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0480ad230 con 0x7fe0480c9ba0 2024-04-02T07:23:36.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.727+0000 7fe04fc00640 1 -- 172.21.15.55:0/373026998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0480cda10 con 0x7fe0480c9ba0 2024-04-02T07:23:36.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.727+0000 7fe044c00640 1 -- 172.21.15.55:0/373026998 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe0340073d0 con 0x7fe0480c9ba0 2024-04-02T07:23:36.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.727+0000 7fe044c00640 1 --2- 172.21.15.55:0/373026998 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe028066690 0x7fe028068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:36.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.727+0000 7fe044c00640 1 -- 172.21.15.55:0/373026998 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe034083b70 con 0x7fe0480c9ba0 2024-04-02T07:23:36.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.727+0000 7fe04d200640 1 --2- 172.21.15.55:0/373026998 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe028066690 0x7fe028068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:36.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.727+0000 7fe04d200640 1 --2- 172.21.15.55:0/373026998 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe028066690 0x7fe028068b50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0ad000 tx=0x7fe03c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:36.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.731+0000 7fe044c00640 1 -- 172.21.15.55:0/373026998 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe034050e50 con 0x7fe0480c9ba0 2024-04-02T07:23:36.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.891+0000 7fe04fc00640 1 -- 172.21.15.55:0/373026998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe048066c90 con 0x7fe0480c9ba0 2024-04-02T07:23:36.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.891+0000 7fe044c00640 1 -- 172.21.15.55:0/373026998 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe034054470 con 0x7fe0480c9ba0 2024-04-02T07:23:36.894 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:23:36.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.895+0000 7fe04fc00640 1 -- 172.21.15.55:0/373026998 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe028066690 msgr2=0x7fe028068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:36.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.895+0000 7fe04fc00640 1 --2- 172.21.15.55:0/373026998 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe028066690 0x7fe028068b50 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe03c0ad000 tx=0x7fe03c008040 comp rx=0 tx=0).stop 2024-04-02T07:23:36.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.895+0000 7fe04fc00640 1 -- 172.21.15.55:0/373026998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0480c9ba0 msgr2=0x7fe0480accf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:36.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.895+0000 7fe04fc00640 1 --2- 172.21.15.55:0/373026998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0480c9ba0 0x7fe0480accf0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe03400c500 tx=0x7fe03400c9c0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.895+0000 7fe04fc00640 1 -- 172.21.15.55:0/373026998 shutdown_connections 2024-04-02T07:23:36.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.895+0000 7fe04fc00640 1 --2- 172.21.15.55:0/373026998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe0480cea00 0x7fe0480ad930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.895+0000 7fe04fc00640 1 --2- 172.21.15.55:0/373026998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe0480c9ba0 0x7fe0480accf0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.895+0000 7fe04fc00640 1 --2- 172.21.15.55:0/373026998 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe028066690 0x7fe028068b50 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.895+0000 7fe04fc00640 1 --2- 172.21.15.55:0/373026998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe048069d90 0x7fe048152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:36.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.895+0000 7fe04fc00640 1 -- 172.21.15.55:0/373026998 >> 172.21.15.55:0/373026998 conn(0x7fe0480cf550 msgr2=0x7fe0480b0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:36.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.895+0000 7fe04fc00640 1 -- 172.21.15.55:0/373026998 shutdown_connections 2024-04-02T07:23:36.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:36.895+0000 7fe04fc00640 1 -- 172.21.15.55:0/373026998 wait complete. 2024-04-02T07:23:36.916 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:23:37.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.055+0000 7f114aa00640 1 Processor -- start 2024-04-02T07:23:37.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.055+0000 7f114aa00640 1 -- start start 2024-04-02T07:23:37.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.055+0000 7f114aa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f114415de50 0x7f11440cebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:37.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.055+0000 7f114aa00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f114415e230 0x7f11440cf130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:37.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.055+0000 7f114aa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1144098a10 0x7f1144098ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:37.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.059+0000 7f114aa00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11440993e0 con 0x7f114415de50 2024-04-02T07:23:37.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.059+0000 7f114aa00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11440afbc0 con 0x7f1144098a10 2024-04-02T07:23:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.059+0000 7f114aa00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1144099be0 con 0x7f114415e230 2024-04-02T07:23:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.059+0000 7f1143e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f114415de50 0x7f11440cebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.059+0000 7f1143e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f114415de50 0x7f11440cebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57724/0 (socket says 172.21.15.55:57724) 2024-04-02T07:23:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.059+0000 7f1143e00640 1 -- 172.21.15.55:0/3257511608 learned_addr learned my addr 172.21.15.55:0/3257511608 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.059+0000 7f113b400640 1 --2- 172.21.15.55:0/3257511608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f114415e230 0x7f11440cf130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.059+0000 7f1148a00640 1 --2- 172.21.15.55:0/3257511608 >> v2:172.21.15.106:3300/0 conn(0x7f1144098a10 0x7f1144098ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.059+0000 7f1143e00640 1 -- 172.21.15.55:0/3257511608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f114415e230 msgr2=0x7f11440cf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.059+0000 7f1143e00640 1 --2- 172.21.15.55:0/3257511608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f114415e230 0x7f11440cf130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.059+0000 7f1143e00640 1 -- 172.21.15.55:0/3257511608 >> v2:172.21.15.106:3300/0 conn(0x7f1144098a10 msgr2=0x7f1144098ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.059+0000 7f1143e00640 1 --2- 172.21.15.55:0/3257511608 >> v2:172.21.15.106:3300/0 conn(0x7f1144098a10 0x7f1144098ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.059+0000 7f1143e00640 1 -- 172.21.15.55:0/3257511608 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11440cf740 con 0x7f114415de50 2024-04-02T07:23:37.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.059+0000 7f1143e00640 1 --2- 172.21.15.55:0/3257511608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f114415de50 0x7f11440cebf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f11440cd090 tx=0x7f113401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c294dc446bd6d6f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:37.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.059+0000 7f1143400640 1 -- 172.21.15.55:0/3257511608 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11340ab600 con 0x7f114415de50 2024-04-02T07:23:37.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f1143400640 1 -- 172.21.15.55:0/3257511608 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11340a7050 con 0x7f114415de50 2024-04-02T07:23:37.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f1143400640 1 -- 172.21.15.55:0/3257511608 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11340ab980 con 0x7f114415de50 2024-04-02T07:23:37.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f114aa00640 1 -- 172.21.15.55:0/3257511608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f114415de50 msgr2=0x7f11440cebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:37.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f114aa00640 1 --2- 172.21.15.55:0/3257511608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f114415de50 0x7f11440cebf0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f11440cd090 tx=0x7f113401c520 comp rx=0 tx=0).stop 2024-04-02T07:23:37.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f114aa00640 1 -- 172.21.15.55:0/3257511608 shutdown_connections 2024-04-02T07:23:37.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f114aa00640 1 --2- 172.21.15.55:0/3257511608 >> v2:172.21.15.106:3300/0 conn(0x7f1144098a10 0x7f1144098ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f114aa00640 1 --2- 172.21.15.55:0/3257511608 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f114415e230 0x7f11440cf130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f114aa00640 1 --2- 172.21.15.55:0/3257511608 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f114415de50 0x7f11440cebf0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f114aa00640 1 -- 172.21.15.55:0/3257511608 >> 172.21.15.55:0/3257511608 conn(0x7f11440b2150 msgr2=0x7f11440b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:37.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f114aa00640 1 -- 172.21.15.55:0/3257511608 shutdown_connections 2024-04-02T07:23:37.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f114aa00640 1 -- 172.21.15.55:0/3257511608 wait complete. 2024-04-02T07:23:37.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f114aa00640 1 Processor -- start 2024-04-02T07:23:37.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f114aa00640 1 -- start start 2024-04-02T07:23:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f114aa00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1144098a10 0x7f1144158cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f114aa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f114415de50 0x7f1144149f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f114aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11440adfa0 0x7f1144158050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f114aa00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11440ad270 con 0x7f11440adfa0 2024-04-02T07:23:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f114aa00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f114414a4a0 con 0x7f114415de50 2024-04-02T07:23:37.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f114aa00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f114414a700 con 0x7f1144098a10 2024-04-02T07:23:37.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f1148a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11440adfa0 0x7f1144158050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:37.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f1148a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11440adfa0 0x7f1144158050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57726/0 (socket says 172.21.15.55:57726) 2024-04-02T07:23:37.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f1148a00640 1 -- 172.21.15.55:0/3876728178 learned_addr learned my addr 172.21.15.55:0/3876728178 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:37.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f1143e00640 1 --2- 172.21.15.55:0/3876728178 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1144098a10 0x7f1144158cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:37.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.063+0000 7f113b400640 1 --2- 172.21.15.55:0/3876728178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f114415de50 0x7f1144149f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:37.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.067+0000 7f1148a00640 1 -- 172.21.15.55:0/3876728178 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1144098a10 msgr2=0x7f1144158cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:37.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.067+0000 7f1148a00640 1 --2- 172.21.15.55:0/3876728178 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1144098a10 0x7f1144158cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.067+0000 7f1148a00640 1 -- 172.21.15.55:0/3876728178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f114415de50 msgr2=0x7f1144149f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:37.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.067+0000 7f1148a00640 1 --2- 172.21.15.55:0/3876728178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f114415de50 0x7f1144149f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.067+0000 7f1148a00640 1 -- 172.21.15.55:0/3876728178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11340094d0 con 0x7f11440adfa0 2024-04-02T07:23:37.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.067+0000 7f1143e00640 1 --2- 172.21.15.55:0/3876728178 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1144098a10 0x7f1144158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:37.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.067+0000 7f113b400640 1 --2- 172.21.15.55:0/3876728178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f114415de50 0x7f1144149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:37.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.067+0000 7f1148a00640 1 --2- 172.21.15.55:0/3876728178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11440adfa0 0x7f1144158050 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f113c00efc0 tx=0x7f113c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.067+0000 7f1140c00640 1 -- 172.21.15.55:0/3876728178 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c014480 con 0x7f11440adfa0 2024-04-02T07:23:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.067+0000 7f1140c00640 1 -- 172.21.15.55:0/3876728178 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113c00f040 con 0x7f11440adfa0 2024-04-02T07:23:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.067+0000 7f1140c00640 1 -- 172.21.15.55:0/3876728178 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c014820 con 0x7f11440adfa0 2024-04-02T07:23:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.067+0000 7f114aa00640 1 -- 172.21.15.55:0/3876728178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11440ad4c0 con 0x7f11440adfa0 2024-04-02T07:23:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.067+0000 7f114aa00640 1 -- 172.21.15.55:0/3876728178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11440ada80 con 0x7f11440adfa0 2024-04-02T07:23:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.067+0000 7f114aa00640 1 -- 172.21.15.55:0/3876728178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11440adca0 con 0x7f11440adfa0 2024-04-02T07:23:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.067+0000 7f1140c00640 1 -- 172.21.15.55:0/3876728178 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f113c014980 con 0x7f11440adfa0 2024-04-02T07:23:37.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.067+0000 7f1140c00640 1 --2- 172.21.15.55:0/3876728178 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1120066690 0x7f1120068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:37.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.071+0000 7f1140c00640 1 -- 172.21.15.55:0/3876728178 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f113c084d60 con 0x7f11440adfa0 2024-04-02T07:23:37.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.071+0000 7f1143e00640 1 --2- 172.21.15.55:0/3876728178 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1120066690 0x7f1120068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:37.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.071+0000 7f1143e00640 1 --2- 172.21.15.55:0/3876728178 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1120066690 0x7f1120068b50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f11340ad000 tx=0x7f11340a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:37.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.075+0000 7f1140c00640 1 -- 172.21.15.55:0/3876728178 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f113c0520c0 con 0x7f11440adfa0 2024-04-02T07:23:37.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.231+0000 7f114aa00640 1 -- 172.21.15.55:0/3876728178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f11440723d0 con 0x7f11440adfa0 2024-04-02T07:23:37.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.235+0000 7f1140c00640 1 -- 172.21.15.55:0/3876728178 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f113c0180a0 con 0x7f11440adfa0 2024-04-02T07:23:37.236 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:23:37.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.235+0000 7f114aa00640 1 -- 172.21.15.55:0/3876728178 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1120066690 msgr2=0x7f1120068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:37.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.235+0000 7f114aa00640 1 --2- 172.21.15.55:0/3876728178 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1120066690 0x7f1120068b50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f11340ad000 tx=0x7f11340a6000 comp rx=0 tx=0).stop 2024-04-02T07:23:37.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.235+0000 7f114aa00640 1 -- 172.21.15.55:0/3876728178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11440adfa0 msgr2=0x7f1144158050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:37.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.235+0000 7f114aa00640 1 --2- 172.21.15.55:0/3876728178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11440adfa0 0x7f1144158050 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f113c00efc0 tx=0x7f113c00c490 comp rx=0 tx=0).stop 2024-04-02T07:23:37.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.235+0000 7f114aa00640 1 -- 172.21.15.55:0/3876728178 shutdown_connections 2024-04-02T07:23:37.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.235+0000 7f114aa00640 1 --2- 172.21.15.55:0/3876728178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11440adfa0 0x7f1144158050 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.235+0000 7f114aa00640 1 --2- 172.21.15.55:0/3876728178 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1120066690 0x7f1120068b50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.235+0000 7f114aa00640 1 --2- 172.21.15.55:0/3876728178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f114415de50 0x7f1144149f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.235+0000 7f114aa00640 1 --2- 172.21.15.55:0/3876728178 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1144098a10 0x7f1144158cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.235+0000 7f114aa00640 1 -- 172.21.15.55:0/3876728178 >> 172.21.15.55:0/3876728178 conn(0x7f11440b2150 msgr2=0x7f114406fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:37.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.235+0000 7f114aa00640 1 -- 172.21.15.55:0/3876728178 shutdown_connections 2024-04-02T07:23:37.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.235+0000 7f114aa00640 1 -- 172.21.15.55:0/3876728178 wait complete. 2024-04-02T07:23:37.257 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:23:37.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.395+0000 7fee9b600640 1 Processor -- start 2024-04-02T07:23:37.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.395+0000 7fee9b600640 1 -- start start 2024-04-02T07:23:37.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee9b600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fee9406d1c0 0x7fee940b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:37.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee9b600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee940b1d60 con 0x7fee940b38f0 2024-04-02T07:23:37.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee9b600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9406c400 con 0x7fee941599c0 2024-04-02T07:23:37.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee9b600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9406cda0 con 0x7fee9406d1c0 2024-04-02T07:23:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee99600640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fee940b38f0 0x7fee940c90d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57456/0 (socket says 172.21.15.55:57456) 2024-04-02T07:23:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee99600640 1 -- 172.21.15.55:0/791244177 learned_addr learned my addr 172.21.15.55:0/791244177 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:37.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee8be00640 1 --2- 172.21.15.55:0/791244177 >> v2:172.21.15.106:3300/0 conn(0x7fee9406d1c0 0x7fee940b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:37.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee93e00640 1 -- 172.21.15.55:0/791244177 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3873531295 0 0) 0x7fee940b1d60 con 0x7fee940b38f0 2024-04-02T07:23:37.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee93e00640 1 -- 172.21.15.55:0/791244177 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee78003530 con 0x7fee940b38f0 2024-04-02T07:23:37.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee93e00640 1 -- 172.21.15.55:0/791244177 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 740969470 0 0) 0x7fee9406c400 con 0x7fee941599c0 2024-04-02T07:23:37.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee93e00640 1 -- 172.21.15.55:0/791244177 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee940b1d60 con 0x7fee941599c0 2024-04-02T07:23:37.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee93e00640 1 -- 172.21.15.55:0/791244177 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1683362028 0 0) 0x7fee78003530 con 0x7fee940b38f0 2024-04-02T07:23:37.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee93e00640 1 -- 172.21.15.55:0/791244177 >> v2:172.21.15.106:3300/0 conn(0x7fee9406d1c0 msgr2=0x7fee940b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:37.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee93e00640 1 --2- 172.21.15.55:0/791244177 >> v2:172.21.15.106:3300/0 conn(0x7fee9406d1c0 0x7fee940b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee93e00640 1 -- 172.21.15.55:0/791244177 >> v1:172.21.15.106:6789/0 conn(0x7fee941599c0 legacy=0x7fee940b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee93e00640 1 -- 172.21.15.55:0/791244177 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9406c6e0 con 0x7fee940b38f0 2024-04-02T07:23:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee93e00640 1 -- 172.21.15.55:0/791244177 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fee8c001980 con 0x7fee940b38f0 2024-04-02T07:23:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee8be00640 1 --2- 172.21.15.55:0/791244177 >> v2:172.21.15.106:3300/0 conn(0x7fee9406d1c0 0x7fee940b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:23:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee93e00640 1 -- 172.21.15.55:0/791244177 >> v1:172.21.15.55:6789/0 conn(0x7fee940b38f0 legacy=0x7fee940c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee93e00640 1 --2- 172.21.15.55:0/791244177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee78003b60 0x7fee78003f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee93e00640 1 --2- 172.21.15.55:0/791244177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee780047d0 0x7fee78004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee93e00640 1 --2- 172.21.15.55:0/791244177 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee78005190 0x7fee7800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee93e00640 1 -- 172.21.15.55:0/791244177 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9406cda0 con 0x7fee78003b60 2024-04-02T07:23:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee93e00640 1 -- 172.21.15.55:0/791244177 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee7800c060 con 0x7fee780047d0 2024-04-02T07:23:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee93e00640 1 -- 172.21.15.55:0/791244177 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee7800c220 con 0x7fee78005190 2024-04-02T07:23:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee98c00640 1 --2- 172.21.15.55:0/791244177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee78003b60 0x7fee78003f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee8be00640 1 --2- 172.21.15.55:0/791244177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee780047d0 0x7fee78004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee99600640 1 --2- 172.21.15.55:0/791244177 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee78005190 0x7fee7800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee98c00640 1 -- 172.21.15.55:0/791244177 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee78005190 msgr2=0x7fee7800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee98c00640 1 --2- 172.21.15.55:0/791244177 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee78005190 0x7fee7800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee98c00640 1 -- 172.21.15.55:0/791244177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee780047d0 msgr2=0x7fee78004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee98c00640 1 --2- 172.21.15.55:0/791244177 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee780047d0 0x7fee78004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee98c00640 1 -- 172.21.15.55:0/791244177 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee78003530 con 0x7fee78003b60 2024-04-02T07:23:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.399+0000 7fee99600640 1 -- 172.21.15.55:0/791244177 reap_dead start 2024-04-02T07:23:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.403+0000 7fee98c00640 1 --2- 172.21.15.55:0/791244177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee78003b60 0x7fee78003f60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fee840018d0 tx=0x7fee8401c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=513bc02d0e9dedee server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.403+0000 7fee93e00640 1 -- 172.21.15.55:0/791244177 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee840052d0 con 0x7fee78003b60 2024-04-02T07:23:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.403+0000 7fee93e00640 1 -- 172.21.15.55:0/791244177 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee840a7050 con 0x7fee78003b60 2024-04-02T07:23:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.403+0000 7fee93e00640 1 -- 172.21.15.55:0/791244177 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee84003600 con 0x7fee78003b60 2024-04-02T07:23:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.403+0000 7fee9b600640 1 -- 172.21.15.55:0/791244177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee78003b60 msgr2=0x7fee78003f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.403+0000 7fee9b600640 1 --2- 172.21.15.55:0/791244177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee78003b60 0x7fee78003f60 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fee840018d0 tx=0x7fee8401c580 comp rx=0 tx=0).stop 2024-04-02T07:23:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.403+0000 7fee9b600640 1 -- 172.21.15.55:0/791244177 shutdown_connections 2024-04-02T07:23:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.403+0000 7fee9b600640 1 --2- 172.21.15.55:0/791244177 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee78003b60 0x7fee78003f60 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.403+0000 7fee9b600640 1 -- 172.21.15.55:0/791244177 >> 172.21.15.55:0/791244177 conn(0x7fee94069d90 msgr2=0x7fee9406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.403+0000 7fee9b600640 1 -- 172.21.15.55:0/791244177 shutdown_connections 2024-04-02T07:23:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.403+0000 7fee9b600640 1 -- 172.21.15.55:0/791244177 wait complete. 2024-04-02T07:23:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee9b600640 1 Processor -- start 2024-04-02T07:23:37.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee9b600640 1 -- start start 2024-04-02T07:23:37.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee9b600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee78003b60 0x7fee94156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:37.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee9b600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee9415aa00 0x7fee94144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:37.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee9b600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee940c7b00 0x7fee940c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:37.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee9b600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee940c84c0 con 0x7fee940c7b00 2024-04-02T07:23:37.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee9b600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9415b1e0 con 0x7fee9415aa00 2024-04-02T07:23:37.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee9b600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9415b4c0 con 0x7fee78003b60 2024-04-02T07:23:37.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee99600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee940c7b00 0x7fee940c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:37.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee99600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee940c7b00 0x7fee940c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57744/0 (socket says 172.21.15.55:57744) 2024-04-02T07:23:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee99600640 1 -- 172.21.15.55:0/3310181932 learned_addr learned my addr 172.21.15.55:0/3310181932 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee8be00640 1 --2- 172.21.15.55:0/3310181932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee9415aa00 0x7fee94144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee98c00640 1 --2- 172.21.15.55:0/3310181932 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee78003b60 0x7fee94156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee99600640 1 -- 172.21.15.55:0/3310181932 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee78003b60 msgr2=0x7fee94156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee99600640 1 --2- 172.21.15.55:0/3310181932 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee78003b60 0x7fee94156160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee99600640 1 -- 172.21.15.55:0/3310181932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee9415aa00 msgr2=0x7fee94144dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee99600640 1 --2- 172.21.15.55:0/3310181932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee9415aa00 0x7fee94144dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee99600640 1 -- 172.21.15.55:0/3310181932 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9415b7a0 con 0x7fee940c7b00 2024-04-02T07:23:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee99600640 1 --2- 172.21.15.55:0/3310181932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee940c7b00 0x7fee940c7f80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fee94071c00 tx=0x7fee8c007af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee91600640 1 -- 172.21.15.55:0/3310181932 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c00e900 con 0x7fee940c7b00 2024-04-02T07:23:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee91600640 1 -- 172.21.15.55:0/3310181932 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8c00ea60 con 0x7fee940c7b00 2024-04-02T07:23:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee91600640 1 -- 172.21.15.55:0/3310181932 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c00ee10 con 0x7fee940c7b00 2024-04-02T07:23:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee9b600640 1 -- 172.21.15.55:0/3310181932 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9415ba80 con 0x7fee940c7b00 2024-04-02T07:23:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee9b600640 1 -- 172.21.15.55:0/3310181932 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee9415ae80 con 0x7fee940c7b00 2024-04-02T07:23:37.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.407+0000 7fee9b600640 1 -- 172.21.15.55:0/3310181932 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9406e270 con 0x7fee940c7b00 2024-04-02T07:23:37.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.411+0000 7fee91600640 1 -- 172.21.15.55:0/3310181932 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fee8c01d460 con 0x7fee940c7b00 2024-04-02T07:23:37.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.411+0000 7fee91600640 1 --2- 172.21.15.55:0/3310181932 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fee700666c0 0x7fee70068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:37.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.411+0000 7fee91600640 1 -- 172.21.15.55:0/3310181932 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee8c0843f0 con 0x7fee940c7b00 2024-04-02T07:23:37.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.411+0000 7fee98c00640 1 --2- 172.21.15.55:0/3310181932 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fee700666c0 0x7fee70068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:37.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.411+0000 7fee98c00640 1 --2- 172.21.15.55:0/3310181932 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fee700666c0 0x7fee70068b80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fee840ac000 tx=0x7fee840a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:37.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.415+0000 7fee91600640 1 -- 172.21.15.55:0/3310181932 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fee8c051770 con 0x7fee940c7b00 2024-04-02T07:23:37.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.587+0000 7fee9b600640 1 -- 172.21.15.55:0/3310181932 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fee9406e270 con 0x7fee940c7b00 2024-04-02T07:23:37.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.587+0000 7fee91600640 1 -- 172.21.15.55:0/3310181932 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) v1 ==== 80+0+0 (secure 0 0 0) 0x7fee8c054d90 con 0x7fee940c7b00 2024-04-02T07:23:37.591 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:23:37.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.591+0000 7fee9b600640 1 -- 172.21.15.55:0/3310181932 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fee700666c0 msgr2=0x7fee70068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:37.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.591+0000 7fee9b600640 1 --2- 172.21.15.55:0/3310181932 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fee700666c0 0x7fee70068b80 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fee840ac000 tx=0x7fee840a6000 comp rx=0 tx=0).stop 2024-04-02T07:23:37.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.591+0000 7fee9b600640 1 -- 172.21.15.55:0/3310181932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee940c7b00 msgr2=0x7fee940c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:37.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.591+0000 7fee9b600640 1 --2- 172.21.15.55:0/3310181932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee940c7b00 0x7fee940c7f80 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fee94071c00 tx=0x7fee8c007af0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.591+0000 7fee9b600640 1 -- 172.21.15.55:0/3310181932 shutdown_connections 2024-04-02T07:23:37.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.591+0000 7fee9b600640 1 --2- 172.21.15.55:0/3310181932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee940c7b00 0x7fee940c7f80 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.591+0000 7fee9b600640 1 --2- 172.21.15.55:0/3310181932 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fee700666c0 0x7fee70068b80 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.591+0000 7fee9b600640 1 --2- 172.21.15.55:0/3310181932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee9415aa00 0x7fee94144dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.591+0000 7fee9b600640 1 --2- 172.21.15.55:0/3310181932 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee78003b60 0x7fee94156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.591+0000 7fee9b600640 1 -- 172.21.15.55:0/3310181932 >> 172.21.15.55:0/3310181932 conn(0x7fee94069d90 msgr2=0x7fee940b0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:37.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.591+0000 7fee9b600640 1 -- 172.21.15.55:0/3310181932 shutdown_connections 2024-04-02T07:23:37.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.591+0000 7fee9b600640 1 -- 172.21.15.55:0/3310181932 wait complete. 2024-04-02T07:23:37.612 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:23:37.612 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:23:37.622 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:23:37.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.799+0000 7fce22600640 1 Processor -- start 2024-04-02T07:23:37.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.799+0000 7fce22600640 1 -- start start 2024-04-02T07:23:37.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.799+0000 7fce22600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fce1c0b38c0 0x7fce1c164210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:37.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.799+0000 7fce22600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce1c13d0c0 con 0x7fce1c0c4120 2024-04-02T07:23:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.799+0000 7fce22600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce1c15a4f0 con 0x7fce1c153ea0 2024-04-02T07:23:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.799+0000 7fce22600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce1c15a2f0 con 0x7fce1c0b38c0 2024-04-02T07:23:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.803+0000 7fce13e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fce1c0c4120 0x7fce1c0b31b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57464/0 (socket says 172.21.15.55:57464) 2024-04-02T07:23:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.803+0000 7fce13e00640 1 -- 172.21.15.55:0/3241922440 learned_addr learned my addr 172.21.15.55:0/3241922440 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.803+0000 7fce1be00640 1 --2- 172.21.15.55:0/3241922440 >> v2:172.21.15.55:3300/0 conn(0x7fce1c0b38c0 0x7fce1c164210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.803+0000 7fce1be00640 1 -- 172.21.15.55:0/3241922440 >> v1:172.21.15.106:6789/0 conn(0x7fce1c153ea0 legacy=0x7fce1c159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.803+0000 7fce1be00640 1 -- 172.21.15.55:0/3241922440 >> v1:172.21.15.55:6789/0 conn(0x7fce1c0c4120 legacy=0x7fce1c0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.803+0000 7fce1be00640 1 -- 172.21.15.55:0/3241922440 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce1c15a7d0 con 0x7fce1c0b38c0 2024-04-02T07:23:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.803+0000 7fce1aa00640 1 -- 172.21.15.55:0/3241922440 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4129577348 0 0) 0x7fce1c13d0c0 con 0x7fce1c0c4120 2024-04-02T07:23:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.803+0000 7fce1be00640 1 --2- 172.21.15.55:0/3241922440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce1c0b38c0 0x7fce1c164210 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fce14009d90 tx=0x7fce1401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e53dc3eedf2aa71 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:37.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.803+0000 7fce1aa00640 1 -- 172.21.15.55:0/3241922440 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce140a5940 con 0x7fce1c0b38c0 2024-04-02T07:23:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.803+0000 7fce1aa00640 1 -- 172.21.15.55:0/3241922440 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce140a5aa0 con 0x7fce1c0b38c0 2024-04-02T07:23:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.803+0000 7fce1aa00640 1 -- 172.21.15.55:0/3241922440 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce140a5e30 con 0x7fce1c0b38c0 2024-04-02T07:23:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce22600640 1 -- 172.21.15.55:0/3241922440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce1c0b38c0 msgr2=0x7fce1c164210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce22600640 1 --2- 172.21.15.55:0/3241922440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce1c0b38c0 0x7fce1c164210 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fce14009d90 tx=0x7fce1401c970 comp rx=0 tx=0).stop 2024-04-02T07:23:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce22600640 1 -- 172.21.15.55:0/3241922440 shutdown_connections 2024-04-02T07:23:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce22600640 1 --2- 172.21.15.55:0/3241922440 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce1c0b38c0 0x7fce1c164210 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce22600640 1 -- 172.21.15.55:0/3241922440 >> 172.21.15.55:0/3241922440 conn(0x7fce1c066080 msgr2=0x7fce1c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce22600640 1 -- 172.21.15.55:0/3241922440 shutdown_connections 2024-04-02T07:23:37.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce22600640 1 -- 172.21.15.55:0/3241922440 wait complete. 2024-04-02T07:23:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce22600640 1 Processor -- start 2024-04-02T07:23:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce22600640 1 -- start start 2024-04-02T07:23:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce22600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce1c0b38c0 0x7fce1c152510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce22600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce1c0c4120 0x7fce1c0cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce22600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce1c153ea0 0x7fce1c0cd640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce22600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c137e50 con 0x7fce1c0c4120 2024-04-02T07:23:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce22600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c153260 con 0x7fce1c0b38c0 2024-04-02T07:23:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce22600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce1c1375b0 con 0x7fce1c153ea0 2024-04-02T07:23:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce13e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce1c0c4120 0x7fce1c0cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce13e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce1c0c4120 0x7fce1c0cd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57762/0 (socket says 172.21.15.55:57762) 2024-04-02T07:23:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce13e00640 1 -- 172.21.15.55:0/583708322 learned_addr learned my addr 172.21.15.55:0/583708322 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:37.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce1b400640 1 --2- 172.21.15.55:0/583708322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce1c0b38c0 0x7fce1c152510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:37.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce1be00640 1 --2- 172.21.15.55:0/583708322 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce1c153ea0 0x7fce1c0cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:37.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce13e00640 1 -- 172.21.15.55:0/583708322 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce1c153ea0 msgr2=0x7fce1c0cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:37.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce13e00640 1 --2- 172.21.15.55:0/583708322 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce1c153ea0 0x7fce1c0cd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce13e00640 1 -- 172.21.15.55:0/583708322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce1c0b38c0 msgr2=0x7fce1c152510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:37.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce13e00640 1 --2- 172.21.15.55:0/583708322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce1c0b38c0 0x7fce1c152510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.807+0000 7fce13e00640 1 -- 172.21.15.55:0/583708322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce14009a70 con 0x7fce1c0c4120 2024-04-02T07:23:37.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.811+0000 7fce13e00640 1 --2- 172.21.15.55:0/583708322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce1c0c4120 0x7fce1c0cd100 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fce0400c4a0 tx=0x7fce0400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:37.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.811+0000 7fce13400640 1 -- 172.21.15.55:0/583708322 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce040074e0 con 0x7fce1c0c4120 2024-04-02T07:23:37.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.811+0000 7fce13400640 1 -- 172.21.15.55:0/583708322 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce04007640 con 0x7fce1c0c4120 2024-04-02T07:23:37.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.811+0000 7fce22600640 1 -- 172.21.15.55:0/583708322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce1c137890 con 0x7fce1c0c4120 2024-04-02T07:23:37.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.811+0000 7fce13400640 1 -- 172.21.15.55:0/583708322 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce04004a30 con 0x7fce1c0c4120 2024-04-02T07:23:37.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.811+0000 7fce22600640 1 -- 172.21.15.55:0/583708322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce1c13eee0 con 0x7fce1c0c4120 2024-04-02T07:23:37.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.811+0000 7fce22600640 1 -- 172.21.15.55:0/583708322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce1c13ed40 con 0x7fce1c0c4120 2024-04-02T07:23:37.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.811+0000 7fce13400640 1 -- 172.21.15.55:0/583708322 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fce04004b90 con 0x7fce1c0c4120 2024-04-02T07:23:37.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.811+0000 7fce13400640 1 --2- 172.21.15.55:0/583708322 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcdf8066690 0x7fcdf8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:37.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.811+0000 7fce13400640 1 -- 172.21.15.55:0/583708322 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce040835b0 con 0x7fce1c0c4120 2024-04-02T07:23:37.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.811+0000 7fce1b400640 1 --2- 172.21.15.55:0/583708322 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcdf8066690 0x7fcdf8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:37.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.815+0000 7fce1b400640 1 --2- 172.21.15.55:0/583708322 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcdf8066690 0x7fcdf8068b50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fce0c007fd0 tx=0x7fce0c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:37.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.815+0000 7fce13400640 1 -- 172.21.15.55:0/583708322 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fce1c13ed40 con 0x7fce1c0c4120 2024-04-02T07:23:37.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.979+0000 7fce22600640 1 -- 172.21.15.55:0/583708322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce1c13ed40 con 0x7fce1c0c4120 2024-04-02T07:23:37.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.979+0000 7fce13400640 1 -- 172.21.15.55:0/583708322 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16101 (secure 0 0 0) 0x7fce1c13ed40 con 0x7fce1c0c4120 2024-04-02T07:23:37.981 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:37.981 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":34,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:23:26.730146+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:23:23.729158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-02T07:23:24.740958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:23:37.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.979+0000 7fce22600640 1 -- 172.21.15.55:0/583708322 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcdf8066690 msgr2=0x7fcdf8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:37.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.979+0000 7fce22600640 1 --2- 172.21.15.55:0/583708322 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcdf8066690 0x7fcdf8068b50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fce0c007fd0 tx=0x7fce0c009040 comp rx=0 tx=0).stop 2024-04-02T07:23:37.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.979+0000 7fce22600640 1 -- 172.21.15.55:0/583708322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce1c0c4120 msgr2=0x7fce1c0cd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:37.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.979+0000 7fce22600640 1 --2- 172.21.15.55:0/583708322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce1c0c4120 0x7fce1c0cd100 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fce0400c4a0 tx=0x7fce0400c960 comp rx=0 tx=0).stop 2024-04-02T07:23:37.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.979+0000 7fce22600640 1 -- 172.21.15.55:0/583708322 shutdown_connections 2024-04-02T07:23:37.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.979+0000 7fce22600640 1 --2- 172.21.15.55:0/583708322 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce1c153ea0 0x7fce1c0cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.979+0000 7fce22600640 1 --2- 172.21.15.55:0/583708322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce1c0c4120 0x7fce1c0cd100 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.979+0000 7fce22600640 1 --2- 172.21.15.55:0/583708322 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcdf8066690 0x7fcdf8068b50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.979+0000 7fce22600640 1 --2- 172.21.15.55:0/583708322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce1c0b38c0 0x7fce1c152510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:37.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.979+0000 7fce22600640 1 -- 172.21.15.55:0/583708322 >> 172.21.15.55:0/583708322 conn(0x7fce1c066080 msgr2=0x7fce1c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:37.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.979+0000 7fce22600640 1 -- 172.21.15.55:0/583708322 shutdown_connections 2024-04-02T07:23:37.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:37.979+0000 7fce22600640 1 -- 172.21.15.55:0/583708322 wait complete. 2024-04-02T07:23:38.002 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:23:23.729158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:23:24.740958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:23:38.002 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:23:38.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.143+0000 7f10e3c00640 1 Processor -- start 2024-04-02T07:23:38.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.143+0000 7f10e3c00640 1 -- start start 2024-04-02T07:23:38.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.147+0000 7f10e3c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f10dc0b31a0 0x7f10dc165730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:38.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.147+0000 7f10e3c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10dc15e3a0 con 0x7f10dc0709b0 2024-04-02T07:23:38.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.147+0000 7f10e3c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10dc15e5f0 con 0x7f10dc144260 2024-04-02T07:23:38.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.147+0000 7f10e3c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10dc0b37c0 con 0x7f10dc0b31a0 2024-04-02T07:23:38.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.147+0000 7f10d3e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f10dc0709b0 0x7f10dc0b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57470/0 (socket says 172.21.15.55:57470) 2024-04-02T07:23:38.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.147+0000 7f10d3e00640 1 -- 172.21.15.55:0/3430124068 learned_addr learned my addr 172.21.15.55:0/3430124068 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:38.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.147+0000 7f10e1c00640 1 --2- 172.21.15.55:0/3430124068 >> v2:172.21.15.106:3300/0 conn(0x7f10dc0b31a0 0x7f10dc165730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:38.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.147+0000 7f10dbe00640 1 -- 172.21.15.55:0/3430124068 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4068485766 0 0) 0x7f10dc15e3a0 con 0x7f10dc0709b0 2024-04-02T07:23:38.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.147+0000 7f10dbe00640 1 -- 172.21.15.55:0/3430124068 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10c0003530 con 0x7f10dc0709b0 2024-04-02T07:23:38.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.147+0000 7f10dbe00640 1 -- 172.21.15.55:0/3430124068 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142388003 0 0) 0x7f10dc15e5f0 con 0x7f10dc144260 2024-04-02T07:23:38.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.147+0000 7f10dbe00640 1 -- 172.21.15.55:0/3430124068 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10dc15e3a0 con 0x7f10dc144260 2024-04-02T07:23:38.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.147+0000 7f10e1c00640 1 -- 172.21.15.55:0/3430124068 >> v1:172.21.15.106:6789/0 conn(0x7f10dc144260 legacy=0x7f10dc0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:38.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.147+0000 7f10e1c00640 1 -- 172.21.15.55:0/3430124068 >> v1:172.21.15.55:6789/0 conn(0x7f10dc0709b0 legacy=0x7f10dc0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:38.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.147+0000 7f10e1c00640 1 -- 172.21.15.55:0/3430124068 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10dc15e8d0 con 0x7f10dc0b31a0 2024-04-02T07:23:38.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.151+0000 7f10e1c00640 1 --2- 172.21.15.55:0/3430124068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10dc0b31a0 0x7f10dc165730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f10d4009d90 tx=0x7f10d401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=880dd569e83745be server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:38.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.151+0000 7f10dbe00640 1 -- 172.21.15.55:0/3430124068 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d40a5830 con 0x7f10dc0b31a0 2024-04-02T07:23:38.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.151+0000 7f10dbe00640 1 -- 172.21.15.55:0/3430124068 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10d40a5990 con 0x7f10dc0b31a0 2024-04-02T07:23:38.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.151+0000 7f10dbe00640 1 -- 172.21.15.55:0/3430124068 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10d40a5d20 con 0x7f10dc0b31a0 2024-04-02T07:23:38.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.151+0000 7f10e3c00640 1 -- 172.21.15.55:0/3430124068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10dc0b31a0 msgr2=0x7f10dc165730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:38.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.151+0000 7f10e3c00640 1 --2- 172.21.15.55:0/3430124068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10dc0b31a0 0x7f10dc165730 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f10d4009d90 tx=0x7f10d401c970 comp rx=0 tx=0).stop 2024-04-02T07:23:38.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.151+0000 7f10e3c00640 1 -- 172.21.15.55:0/3430124068 shutdown_connections 2024-04-02T07:23:38.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.151+0000 7f10e3c00640 1 --2- 172.21.15.55:0/3430124068 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10dc0b31a0 0x7f10dc165730 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.151+0000 7f10e3c00640 1 -- 172.21.15.55:0/3430124068 >> 172.21.15.55:0/3430124068 conn(0x7f10dc06a390 msgr2=0x7f10dc0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:38.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.151+0000 7f10e3c00640 1 -- 172.21.15.55:0/3430124068 shutdown_connections 2024-04-02T07:23:38.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.151+0000 7f10e3c00640 1 -- 172.21.15.55:0/3430124068 wait complete. 2024-04-02T07:23:38.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.151+0000 7f10e3c00640 1 Processor -- start 2024-04-02T07:23:38.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.151+0000 7f10e3c00640 1 -- start start 2024-04-02T07:23:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.151+0000 7f10e3c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10dc0709b0 0x7f10dc135ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.151+0000 7f10e3c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10dc0b31a0 0x7f10dc13a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.151+0000 7f10e3c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10dc144260 0x7f10dc13a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.151+0000 7f10e3c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc139950 con 0x7f10dc0709b0 2024-04-02T07:23:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.151+0000 7f10e3c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc1394c0 con 0x7f10dc144260 2024-04-02T07:23:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.151+0000 7f10e3c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10dc1388b0 con 0x7f10dc0b31a0 2024-04-02T07:23:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.155+0000 7f10e1200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10dc0709b0 0x7f10dc135ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.155+0000 7f10e1200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10dc0709b0 0x7f10dc135ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57768/0 (socket says 172.21.15.55:57768) 2024-04-02T07:23:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.155+0000 7f10e1200640 1 -- 172.21.15.55:0/2750584695 learned_addr learned my addr 172.21.15.55:0/2750584695 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.155+0000 7f10e1c00640 1 --2- 172.21.15.55:0/2750584695 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10dc144260 0x7f10dc13a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.155+0000 7f10d3e00640 1 --2- 172.21.15.55:0/2750584695 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10dc0b31a0 0x7f10dc13a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.155+0000 7f10e1200640 1 -- 172.21.15.55:0/2750584695 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10dc0b31a0 msgr2=0x7f10dc13a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:38.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.155+0000 7f10e1200640 1 --2- 172.21.15.55:0/2750584695 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10dc0b31a0 0x7f10dc13a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.155+0000 7f10e1200640 1 -- 172.21.15.55:0/2750584695 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10dc144260 msgr2=0x7f10dc13a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.155+0000 7f10e1200640 1 --2- 172.21.15.55:0/2750584695 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10dc144260 0x7f10dc13a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.155+0000 7f10e1200640 1 -- 172.21.15.55:0/2750584695 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d4009a70 con 0x7f10dc0709b0 2024-04-02T07:23:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.155+0000 7f10e1200640 1 --2- 172.21.15.55:0/2750584695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10dc0709b0 0x7f10dc135ea0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00c430 tx=0x7f10cc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.155+0000 7f10d9600640 1 -- 172.21.15.55:0/2750584695 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc0052d0 con 0x7f10dc0709b0 2024-04-02T07:23:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.155+0000 7f10d9600640 1 -- 172.21.15.55:0/2750584695 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10cc005450 con 0x7f10dc0709b0 2024-04-02T07:23:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.155+0000 7f10d9600640 1 -- 172.21.15.55:0/2750584695 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10cc003840 con 0x7f10dc0709b0 2024-04-02T07:23:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.155+0000 7f10e3c00640 1 -- 172.21.15.55:0/2750584695 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10dc138b90 con 0x7f10dc0709b0 2024-04-02T07:23:38.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.155+0000 7f10e3c00640 1 -- 172.21.15.55:0/2750584695 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10dc139150 con 0x7f10dc0709b0 2024-04-02T07:23:38.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.155+0000 7f10e3c00640 1 -- 172.21.15.55:0/2750584695 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10dc1392e0 con 0x7f10dc0709b0 2024-04-02T07:23:38.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.155+0000 7f10d9600640 1 -- 172.21.15.55:0/2750584695 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f10cc0039a0 con 0x7f10dc0709b0 2024-04-02T07:23:38.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.155+0000 7f10d9600640 1 --2- 172.21.15.55:0/2750584695 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f10b8066690 0x7f10b8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:38.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.159+0000 7f10d9600640 1 -- 172.21.15.55:0/2750584695 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f10cc0837f0 con 0x7f10dc0709b0 2024-04-02T07:23:38.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.159+0000 7f10d3e00640 1 --2- 172.21.15.55:0/2750584695 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f10b8066690 0x7f10b8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:38.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.159+0000 7f10d3e00640 1 --2- 172.21.15.55:0/2750584695 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f10b8066690 0x7f10b8068b50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f10dc165c40 tx=0x7f10c4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:38.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.163+0000 7f10d9600640 1 -- 172.21.15.55:0/2750584695 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f10cc050b50 con 0x7f10dc0709b0 2024-04-02T07:23:38.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.323+0000 7f10e3c00640 1 -- 172.21.15.55:0/2750584695 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10dc073530 con 0x7f10dc0709b0 2024-04-02T07:23:38.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.327+0000 7f10d9600640 1 -- 172.21.15.55:0/2750584695 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7f10cc017020 con 0x7f10dc0709b0 2024-04-02T07:23:38.328 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:23:38.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.327+0000 7f10e3c00640 1 -- 172.21.15.55:0/2750584695 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f10b8066690 msgr2=0x7f10b8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:38.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.327+0000 7f10e3c00640 1 --2- 172.21.15.55:0/2750584695 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f10b8066690 0x7f10b8068b50 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f10dc165c40 tx=0x7f10c4009040 comp rx=0 tx=0).stop 2024-04-02T07:23:38.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.327+0000 7f10e3c00640 1 -- 172.21.15.55:0/2750584695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10dc0709b0 msgr2=0x7f10dc135ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:38.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.327+0000 7f10e3c00640 1 --2- 172.21.15.55:0/2750584695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10dc0709b0 0x7f10dc135ea0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f10cc00c430 tx=0x7f10cc00c8f0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.327+0000 7f10e3c00640 1 -- 172.21.15.55:0/2750584695 shutdown_connections 2024-04-02T07:23:38.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.327+0000 7f10e3c00640 1 --2- 172.21.15.55:0/2750584695 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f10b8066690 0x7f10b8068b50 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.327+0000 7f10e3c00640 1 --2- 172.21.15.55:0/2750584695 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10dc144260 0x7f10dc13a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.327+0000 7f10e3c00640 1 --2- 172.21.15.55:0/2750584695 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10dc0b31a0 0x7f10dc13a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.327+0000 7f10e3c00640 1 --2- 172.21.15.55:0/2750584695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10dc0709b0 0x7f10dc135ea0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.327+0000 7f10e3c00640 1 -- 172.21.15.55:0/2750584695 >> 172.21.15.55:0/2750584695 conn(0x7f10dc06a390 msgr2=0x7f10dc0cb610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:38.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.327+0000 7f10e3c00640 1 -- 172.21.15.55:0/2750584695 shutdown_connections 2024-04-02T07:23:38.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.327+0000 7f10e3c00640 1 -- 172.21.15.55:0/2750584695 wait complete. 2024-04-02T07:23:38.349 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:23:38.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.487+0000 7f9ebc400640 1 Processor -- start 2024-04-02T07:23:38.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.487+0000 7f9ebc400640 1 -- start start 2024-04-02T07:23:38.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.491+0000 7f9ebc400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9eb40ade90 0x7f9eb406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:38.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.491+0000 7f9ebc400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb406c630 con 0x7f9eb40b41a0 2024-04-02T07:23:38.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.491+0000 7f9ebc400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eb406c8f0 con 0x7f9eb40b3dc0 2024-04-02T07:23:38.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.491+0000 7f9ebc400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eb40cae80 con 0x7f9eb40ade90 2024-04-02T07:23:38.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.491+0000 7f9eb9000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9eb40ade90 0x7f9eb406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:38.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.491+0000 7f9eba400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9eb40b41a0 0x7f9eb4142ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57472/0 (socket says 172.21.15.55:57472) 2024-04-02T07:23:38.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.491+0000 7f9eba400640 1 -- 172.21.15.55:0/3953908330 learned_addr learned my addr 172.21.15.55:0/3953908330 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:38.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.491+0000 7f9eb9000640 1 -- 172.21.15.55:0/3953908330 >> v1:172.21.15.106:6789/0 conn(0x7f9eb40b3dc0 legacy=0x7f9eb40ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:38.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.491+0000 7f9eb9000640 1 -- 172.21.15.55:0/3953908330 >> v1:172.21.15.55:6789/0 conn(0x7f9eb40b41a0 legacy=0x7f9eb4142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:38.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.491+0000 7f9eb9000640 1 -- 172.21.15.55:0/3953908330 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eb406cbd0 con 0x7f9eb40ade90 2024-04-02T07:23:38.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.491+0000 7f9eb3e00640 1 -- 172.21.15.55:0/3953908330 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576824681 0 0) 0x7f9eb406c630 con 0x7f9eb40b41a0 2024-04-02T07:23:38.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.495+0000 7f9eb9000640 1 --2- 172.21.15.55:0/3953908330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9eb40ade90 0x7f9eb406d6b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00097c0 tx=0x7f9ea001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ed6eb2664771b1a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:38.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.495+0000 7f9eb3e00640 1 -- 172.21.15.55:0/3953908330 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea00ab670 con 0x7f9eb40ade90 2024-04-02T07:23:38.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.495+0000 7f9eb3e00640 1 -- 172.21.15.55:0/3953908330 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea00ab7d0 con 0x7f9eb40ade90 2024-04-02T07:23:38.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.495+0000 7f9eb3e00640 1 -- 172.21.15.55:0/3953908330 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea00abb60 con 0x7f9eb40ade90 2024-04-02T07:23:38.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.495+0000 7f9ebc400640 1 -- 172.21.15.55:0/3953908330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9eb40ade90 msgr2=0x7f9eb406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:38.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.495+0000 7f9ebc400640 1 --2- 172.21.15.55:0/3953908330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9eb40ade90 0x7f9eb406d6b0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00097c0 tx=0x7f9ea001c470 comp rx=0 tx=0).stop 2024-04-02T07:23:38.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.495+0000 7f9ebc400640 1 -- 172.21.15.55:0/3953908330 shutdown_connections 2024-04-02T07:23:38.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.495+0000 7f9ebc400640 1 --2- 172.21.15.55:0/3953908330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9eb40ade90 0x7f9eb406d6b0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.495+0000 7f9ebc400640 1 -- 172.21.15.55:0/3953908330 >> 172.21.15.55:0/3953908330 conn(0x7f9eb406a390 msgr2=0x7f9eb40b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:38.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.495+0000 7f9ebc400640 1 -- 172.21.15.55:0/3953908330 shutdown_connections 2024-04-02T07:23:38.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.495+0000 7f9ebc400640 1 -- 172.21.15.55:0/3953908330 wait complete. 2024-04-02T07:23:38.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.495+0000 7f9ebc400640 1 Processor -- start 2024-04-02T07:23:38.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.495+0000 7f9ebc400640 1 -- start start 2024-04-02T07:23:38.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9ebc400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9eb40ade90 0x7f9eb4154180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:38.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9ebc400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eb40b3dc0 0x7f9eb413beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:38.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9ebc400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9eb40b41a0 0x7f9eb413c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:38.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9ebc400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb413f860 con 0x7f9eb40b3dc0 2024-04-02T07:23:38.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9ebc400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb41590e0 con 0x7f9eb40ade90 2024-04-02T07:23:38.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9ebc400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb413ebe0 con 0x7f9eb40b41a0 2024-04-02T07:23:38.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9eb9000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eb40b3dc0 0x7f9eb413beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:38.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9eb9000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eb40b3dc0 0x7f9eb413beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57782/0 (socket says 172.21.15.55:57782) 2024-04-02T07:23:38.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9eb9000640 1 -- 172.21.15.55:0/612453607 learned_addr learned my addr 172.21.15.55:0/612453607 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:38.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9eba400640 1 --2- 172.21.15.55:0/612453607 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9eb40b41a0 0x7f9eb413c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:38.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9eb9a00640 1 --2- 172.21.15.55:0/612453607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9eb40ade90 0x7f9eb4154180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:38.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9eb9000640 1 -- 172.21.15.55:0/612453607 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9eb40b41a0 msgr2=0x7f9eb413c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:38.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9eb9000640 1 --2- 172.21.15.55:0/612453607 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9eb40b41a0 0x7f9eb413c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9eb9000640 1 -- 172.21.15.55:0/612453607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9eb40ade90 msgr2=0x7f9eb4154180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:38.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9eb9000640 1 --2- 172.21.15.55:0/612453607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9eb40ade90 0x7f9eb4154180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9eb9000640 1 -- 172.21.15.55:0/612453607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea0009420 con 0x7f9eb40b3dc0 2024-04-02T07:23:38.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9eb9000640 1 --2- 172.21.15.55:0/612453607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eb40b3dc0 0x7f9eb413beb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00ad040 tx=0x7f9ea001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:38.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9eb1600640 1 -- 172.21.15.55:0/612453607 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea00b5810 con 0x7f9eb40b3dc0 2024-04-02T07:23:38.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9eb1600640 1 -- 172.21.15.55:0/612453607 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea00b5990 con 0x7f9eb40b3dc0 2024-04-02T07:23:38.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9ebc400640 1 -- 172.21.15.55:0/612453607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eb406de00 con 0x7f9eb40b3dc0 2024-04-02T07:23:38.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9eb1600640 1 -- 172.21.15.55:0/612453607 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea00b5d40 con 0x7f9eb40b3dc0 2024-04-02T07:23:38.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9ebc400640 1 -- 172.21.15.55:0/612453607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb413f1a0 con 0x7f9eb40b3dc0 2024-04-02T07:23:38.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9ebc400640 1 -- 172.21.15.55:0/612453607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eb4066c90 con 0x7f9eb40b3dc0 2024-04-02T07:23:38.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.499+0000 7f9eb1600640 1 -- 172.21.15.55:0/612453607 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f9ea00bf410 con 0x7f9eb40b3dc0 2024-04-02T07:23:38.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.503+0000 7f9eb1600640 1 --2- 172.21.15.55:0/612453607 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9e940666c0 0x7f9e94068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:38.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.503+0000 7f9eb1600640 1 -- 172.21.15.55:0/612453607 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ea011ece0 con 0x7f9eb40b3dc0 2024-04-02T07:23:38.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.503+0000 7f9eb9a00640 1 --2- 172.21.15.55:0/612453607 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9e940666c0 0x7f9e94068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:38.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.503+0000 7f9eb9a00640 1 --2- 172.21.15.55:0/612453607 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9e940666c0 0x7f9e94068b80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8007fd0 tx=0x7f9ea8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:38.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.507+0000 7f9eb1600640 1 -- 172.21.15.55:0/612453607 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f9ea00ec060 con 0x7f9eb40b3dc0 2024-04-02T07:23:38.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.667+0000 7f9ebc400640 1 -- 172.21.15.55:0/612453607 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9eb40b1240 con 0x7f9eb40b3dc0 2024-04-02T07:23:38.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.667+0000 7f9eb1600640 1 -- 172.21.15.55:0/612453607 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9ea00ef680 con 0x7f9eb40b3dc0 2024-04-02T07:23:38.669 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:23:38.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.667+0000 7f9ebc400640 1 -- 172.21.15.55:0/612453607 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9e940666c0 msgr2=0x7f9e94068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:38.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.667+0000 7f9ebc400640 1 --2- 172.21.15.55:0/612453607 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9e940666c0 0x7f9e94068b80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8007fd0 tx=0x7f9ea8009040 comp rx=0 tx=0).stop 2024-04-02T07:23:38.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.667+0000 7f9ebc400640 1 -- 172.21.15.55:0/612453607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eb40b3dc0 msgr2=0x7f9eb413beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:38.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.667+0000 7f9ebc400640 1 --2- 172.21.15.55:0/612453607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eb40b3dc0 0x7f9eb413beb0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f9ea00ad040 tx=0x7f9ea001acb0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.667+0000 7f9ebc400640 1 -- 172.21.15.55:0/612453607 shutdown_connections 2024-04-02T07:23:38.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.667+0000 7f9ebc400640 1 --2- 172.21.15.55:0/612453607 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9eb40b41a0 0x7f9eb413c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.667+0000 7f9ebc400640 1 --2- 172.21.15.55:0/612453607 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9eb40b3dc0 0x7f9eb413beb0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.667+0000 7f9ebc400640 1 --2- 172.21.15.55:0/612453607 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9e940666c0 0x7f9e94068b80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.667+0000 7f9ebc400640 1 --2- 172.21.15.55:0/612453607 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9eb40ade90 0x7f9eb4154180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.667+0000 7f9ebc400640 1 -- 172.21.15.55:0/612453607 >> 172.21.15.55:0/612453607 conn(0x7f9eb406a390 msgr2=0x7f9eb415d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:38.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.667+0000 7f9ebc400640 1 -- 172.21.15.55:0/612453607 shutdown_connections 2024-04-02T07:23:38.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.667+0000 7f9ebc400640 1 -- 172.21.15.55:0/612453607 wait complete. 2024-04-02T07:23:38.689 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:23:38.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.831+0000 7f0504c00640 1 Processor -- start 2024-04-02T07:23:38.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.831+0000 7f0504c00640 1 -- start start 2024-04-02T07:23:38.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.831+0000 7f0504c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0500099120 0x7f05000b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:38.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.831+0000 7f0504c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0500099750 0x7f05000b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:38.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.831+0000 7f0504c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05000b1ae0 con 0x7f050015ded0 2024-04-02T07:23:38.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.831+0000 7f0504c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0500099bc0 con 0x7f0500099750 2024-04-02T07:23:38.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.831+0000 7f0504c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05000ce240 con 0x7f0500099120 2024-04-02T07:23:38.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.831+0000 7f04fe800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0500099750 0x7f05000b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:38.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.831+0000 7f04fe800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0500099750 0x7f05000b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57790/0 (socket says 172.21.15.55:57790) 2024-04-02T07:23:38.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.831+0000 7f04fe800640 1 -- 172.21.15.55:0/3934138248 learned_addr learned my addr 172.21.15.55:0/3934138248 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:38.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.831+0000 7f04f5400640 1 --2- 172.21.15.55:0/3934138248 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0500099120 0x7f05000b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:38.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.831+0000 7f04fe800640 1 -- 172.21.15.55:0/3934138248 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0500099120 msgr2=0x7f05000b1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:38.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.831+0000 7f04fe800640 1 --2- 172.21.15.55:0/3934138248 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0500099120 0x7f05000b1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.831+0000 7f04fe800640 1 -- 172.21.15.55:0/3934138248 >> v1:172.21.15.106:6789/0 conn(0x7f050015ded0 legacy=0x7f0500098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:38.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.831+0000 7f04fe800640 1 -- 172.21.15.55:0/3934138248 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f050015e2b0 con 0x7f0500099750 2024-04-02T07:23:38.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.835+0000 7f04fe800640 1 --2- 172.21.15.55:0/3934138248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0500099750 0x7f05000b34c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009e50 tx=0x7f04f801ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3982b6c08383ac0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:38.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.835+0000 7f04fd400640 1 -- 172.21.15.55:0/3934138248 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f80a57f0 con 0x7f0500099750 2024-04-02T07:23:38.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.835+0000 7f04fd400640 1 -- 172.21.15.55:0/3934138248 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f80a5950 con 0x7f0500099750 2024-04-02T07:23:38.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.835+0000 7f04fd400640 1 -- 172.21.15.55:0/3934138248 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f80a5ce0 con 0x7f0500099750 2024-04-02T07:23:38.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.835+0000 7f0504c00640 1 -- 172.21.15.55:0/3934138248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0500099750 msgr2=0x7f05000b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:38.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.835+0000 7f0504c00640 1 --2- 172.21.15.55:0/3934138248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0500099750 0x7f05000b34c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f04f8009e50 tx=0x7f04f801ca30 comp rx=0 tx=0).stop 2024-04-02T07:23:38.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.835+0000 7f0504c00640 1 -- 172.21.15.55:0/3934138248 shutdown_connections 2024-04-02T07:23:38.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.835+0000 7f0504c00640 1 --2- 172.21.15.55:0/3934138248 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0500099750 0x7f05000b34c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.835+0000 7f0504c00640 1 --2- 172.21.15.55:0/3934138248 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0500099120 0x7f05000b1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.835+0000 7f0504c00640 1 -- 172.21.15.55:0/3934138248 >> 172.21.15.55:0/3934138248 conn(0x7f05000b2160 msgr2=0x7f05000b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:38.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.835+0000 7f0504c00640 1 -- 172.21.15.55:0/3934138248 shutdown_connections 2024-04-02T07:23:38.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.835+0000 7f0504c00640 1 -- 172.21.15.55:0/3934138248 wait complete. 2024-04-02T07:23:38.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f0504c00640 1 Processor -- start 2024-04-02T07:23:38.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f0504c00640 1 -- start start 2024-04-02T07:23:38.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f0504c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0500099120 0x7f0500154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:38.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f0504c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0500099750 0x7f050006f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:38.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f0504c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f050015ded0 0x7f050006fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:38.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f0504c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05000ca420 con 0x7f050015ded0 2024-04-02T07:23:38.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f0504c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0500156c00 con 0x7f0500099750 2024-04-02T07:23:38.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f0504c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0500156ee0 con 0x7f0500099120 2024-04-02T07:23:38.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f04fe800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f050015ded0 0x7f050006fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:38.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f04fe800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f050015ded0 0x7f050006fb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57792/0 (socket says 172.21.15.55:57792) 2024-04-02T07:23:38.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f04fe800640 1 -- 172.21.15.55:0/2695394373 learned_addr learned my addr 172.21.15.55:0/2695394373 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:38.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f04f5400640 1 --2- 172.21.15.55:0/2695394373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0500099750 0x7f050006f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:38.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f04fde00640 1 --2- 172.21.15.55:0/2695394373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0500099120 0x7f0500154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:38.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f04fe800640 1 -- 172.21.15.55:0/2695394373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0500099120 msgr2=0x7f0500154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:38.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f04fe800640 1 --2- 172.21.15.55:0/2695394373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0500099120 0x7f0500154c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f04fe800640 1 -- 172.21.15.55:0/2695394373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0500099750 msgr2=0x7f050006f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:38.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f04fe800640 1 --2- 172.21.15.55:0/2695394373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0500099750 0x7f050006f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:38.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f04fe800640 1 -- 172.21.15.55:0/2695394373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04f8009b30 con 0x7f050015ded0 2024-04-02T07:23:38.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f04fde00640 1 --2- 172.21.15.55:0/2695394373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0500099120 0x7f0500154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:38.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f04fe800640 1 --2- 172.21.15.55:0/2695394373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f050015ded0 0x7f050006fb20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f04f801a660 tx=0x7f04f80197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:38.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f04f6a00640 1 -- 172.21.15.55:0/2695394373 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f80b8670 con 0x7f050015ded0 2024-04-02T07:23:38.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f04f6a00640 1 -- 172.21.15.55:0/2695394373 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04f80b87d0 con 0x7f050015ded0 2024-04-02T07:23:38.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f04f6a00640 1 -- 172.21.15.55:0/2695394373 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04f80b8b80 con 0x7f050015ded0 2024-04-02T07:23:38.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f0504c00640 1 -- 172.21.15.55:0/2695394373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05001571c0 con 0x7f050015ded0 2024-04-02T07:23:38.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f0504c00640 1 -- 172.21.15.55:0/2695394373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0500155180 con 0x7f050015ded0 2024-04-02T07:23:38.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.839+0000 7f0504c00640 1 -- 172.21.15.55:0/2695394373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0500066c90 con 0x7f050015ded0 2024-04-02T07:23:38.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.843+0000 7f04f6a00640 1 -- 172.21.15.55:0/2695394373 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f04f80b8ce0 con 0x7f050015ded0 2024-04-02T07:23:38.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.843+0000 7f04f6a00640 1 --2- 172.21.15.55:0/2695394373 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f04dc066690 0x7f04dc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:38.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.843+0000 7f04f6a00640 1 -- 172.21.15.55:0/2695394373 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04f811f860 con 0x7f050015ded0 2024-04-02T07:23:38.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.843+0000 7f04fde00640 1 --2- 172.21.15.55:0/2695394373 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f04dc066690 0x7f04dc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:38.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.843+0000 7f04fde00640 1 --2- 172.21.15.55:0/2695394373 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f04dc066690 0x7f04dc068b50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f04f0000f70 tx=0x7f04f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:38.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:38.847+0000 7f04f6a00640 1 -- 172.21.15.55:0/2695394373 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f04f80ecd10 con 0x7f050015ded0 2024-04-02T07:23:39.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.007+0000 7f0504c00640 1 -- 172.21.15.55:0/2695394373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f05000b2f60 con 0x7f050015ded0 2024-04-02T07:23:39.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.011+0000 7f04f6a00640 1 -- 172.21.15.55:0/2695394373 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f04f80f0330 con 0x7f050015ded0 2024-04-02T07:23:39.012 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:23:39.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.011+0000 7f0504c00640 1 -- 172.21.15.55:0/2695394373 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f04dc066690 msgr2=0x7f04dc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:39.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.011+0000 7f0504c00640 1 --2- 172.21.15.55:0/2695394373 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f04dc066690 0x7f04dc068b50 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f04f0000f70 tx=0x7f04f0009040 comp rx=0 tx=0).stop 2024-04-02T07:23:39.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.011+0000 7f0504c00640 1 -- 172.21.15.55:0/2695394373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f050015ded0 msgr2=0x7f050006fb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:39.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.011+0000 7f0504c00640 1 --2- 172.21.15.55:0/2695394373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f050015ded0 0x7f050006fb20 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f04f801a660 tx=0x7f04f80197d0 comp rx=0 tx=0).stop 2024-04-02T07:23:39.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.011+0000 7f0504c00640 1 -- 172.21.15.55:0/2695394373 shutdown_connections 2024-04-02T07:23:39.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.011+0000 7f0504c00640 1 --2- 172.21.15.55:0/2695394373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f050015ded0 0x7f050006fb20 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:39.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.011+0000 7f0504c00640 1 --2- 172.21.15.55:0/2695394373 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f04dc066690 0x7f04dc068b50 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:39.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.011+0000 7f0504c00640 1 --2- 172.21.15.55:0/2695394373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0500099750 0x7f050006f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:39.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.011+0000 7f0504c00640 1 --2- 172.21.15.55:0/2695394373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0500099120 0x7f0500154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:39.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.011+0000 7f0504c00640 1 -- 172.21.15.55:0/2695394373 >> 172.21.15.55:0/2695394373 conn(0x7f05000b2160 msgr2=0x7f0500164970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:39.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.011+0000 7f0504c00640 1 -- 172.21.15.55:0/2695394373 shutdown_connections 2024-04-02T07:23:39.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.011+0000 7f0504c00640 1 -- 172.21.15.55:0/2695394373 wait complete. 2024-04-02T07:23:39.033 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:23:39.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.171+0000 7efc87200640 1 Processor -- start 2024-04-02T07:23:39.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.171+0000 7efc87200640 1 -- start start 2024-04-02T07:23:39.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc87200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc8006ccc0 0x7efc8006c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:39.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc87200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efc8006d0a0 0x7efc8006d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:39.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc87200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc8015d5d0 con 0x7efc8006dd60 2024-04-02T07:23:39.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc87200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc8015d8b0 con 0x7efc8006d0a0 2024-04-02T07:23:39.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc87200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc8015db90 con 0x7efc8006ccc0 2024-04-02T07:23:39.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc85200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efc8006dd60 0x7efc800cb160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57486/0 (socket says 172.21.15.55:57486) 2024-04-02T07:23:39.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc85200640 1 -- 172.21.15.55:0/2638848854 learned_addr learned my addr 172.21.15.55:0/2638848854 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:39.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7fe00640 1 --2- 172.21.15.55:0/2638848854 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc8006ccc0 0x7efc8006c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:39.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc77e00640 1 --2- 172.21.15.55:0/2638848854 >> v2:172.21.15.106:3300/0 conn(0x7efc8006d0a0 0x7efc8006d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:39.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7f400640 1 -- 172.21.15.55:0/2638848854 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2477117037 0 0) 0x7efc8015d5d0 con 0x7efc8006dd60 2024-04-02T07:23:39.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7f400640 1 -- 172.21.15.55:0/2638848854 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efc64003530 con 0x7efc8006dd60 2024-04-02T07:23:39.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7f400640 1 -- 172.21.15.55:0/2638848854 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 589636024 0 0) 0x7efc64003530 con 0x7efc8006dd60 2024-04-02T07:23:39.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7f400640 1 -- 172.21.15.55:0/2638848854 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc8006ccc0 msgr2=0x7efc8006c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:39.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7f400640 1 --2- 172.21.15.55:0/2638848854 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc8006ccc0 0x7efc8006c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:39.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7f400640 1 -- 172.21.15.55:0/2638848854 >> v2:172.21.15.106:3300/0 conn(0x7efc8006d0a0 msgr2=0x7efc8006d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:39.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7f400640 1 --2- 172.21.15.55:0/2638848854 >> v2:172.21.15.106:3300/0 conn(0x7efc8006d0a0 0x7efc8006d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:39.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7f400640 1 -- 172.21.15.55:0/2638848854 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8015de70 con 0x7efc8006dd60 2024-04-02T07:23:39.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7f400640 1 -- 172.21.15.55:0/2638848854 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7efc78001a00 con 0x7efc8006dd60 2024-04-02T07:23:39.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc77e00640 1 --2- 172.21.15.55:0/2638848854 >> v2:172.21.15.106:3300/0 conn(0x7efc8006d0a0 0x7efc8006d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:23:39.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7f400640 1 -- 172.21.15.55:0/2638848854 >> v1:172.21.15.55:6789/0 conn(0x7efc8006dd60 legacy=0x7efc800cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:39.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7f400640 1 --2- 172.21.15.55:0/2638848854 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc8006ccc0 0x7efc64003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:39.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7f400640 1 --2- 172.21.15.55:0/2638848854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc64003f50 0x7efc640047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:39.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7f400640 1 --2- 172.21.15.55:0/2638848854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc64004d10 0x7efc64005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:39.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7f400640 1 -- 172.21.15.55:0/2638848854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8015d8b0 con 0x7efc64004d10 2024-04-02T07:23:39.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7f400640 1 -- 172.21.15.55:0/2638848854 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc8015db90 con 0x7efc64003f50 2024-04-02T07:23:39.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7f400640 1 -- 172.21.15.55:0/2638848854 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc6400b990 con 0x7efc8006ccc0 2024-04-02T07:23:39.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc85200640 1 --2- 172.21.15.55:0/2638848854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc64004d10 0x7efc64005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:39.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7fe00640 1 --2- 172.21.15.55:0/2638848854 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc8006ccc0 0x7efc64003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:39.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc77e00640 1 --2- 172.21.15.55:0/2638848854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc64003f50 0x7efc640047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:39.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7fe00640 1 -- 172.21.15.55:0/2638848854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc64003f50 msgr2=0x7efc640047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:39.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7fe00640 1 --2- 172.21.15.55:0/2638848854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc64003f50 0x7efc640047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:39.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7fe00640 1 -- 172.21.15.55:0/2638848854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc64004d10 msgr2=0x7efc64005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:39.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7fe00640 1 --2- 172.21.15.55:0/2638848854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc64004d10 0x7efc64005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:39.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc7fe00640 1 -- 172.21.15.55:0/2638848854 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc64003530 con 0x7efc8006ccc0 2024-04-02T07:23:39.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.175+0000 7efc85200640 1 --2- 172.21.15.55:0/2638848854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc64004d10 0x7efc64005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:23:39.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.179+0000 7efc7fe00640 1 --2- 172.21.15.55:0/2638848854 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc8006ccc0 0x7efc64003980 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efc70009b10 tx=0x7efc7001cab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2437ee431719de1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:39.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.179+0000 7efc7f400640 1 -- 172.21.15.55:0/2638848854 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc700a56a0 con 0x7efc8006ccc0 2024-04-02T07:23:39.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.179+0000 7efc7f400640 1 -- 172.21.15.55:0/2638848854 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc700a5800 con 0x7efc8006ccc0 2024-04-02T07:23:39.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.179+0000 7efc7f400640 1 -- 172.21.15.55:0/2638848854 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc700a5bb0 con 0x7efc8006ccc0 2024-04-02T07:23:39.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.179+0000 7efc87200640 1 -- 172.21.15.55:0/2638848854 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc8006ccc0 msgr2=0x7efc64003980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:39.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.179+0000 7efc87200640 1 --2- 172.21.15.55:0/2638848854 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc8006ccc0 0x7efc64003980 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7efc70009b10 tx=0x7efc7001cab0 comp rx=0 tx=0).stop 2024-04-02T07:23:39.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.179+0000 7efc85200640 1 -- 172.21.15.55:0/2638848854 reap_dead start 2024-04-02T07:23:39.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.179+0000 7efc87200640 1 -- 172.21.15.55:0/2638848854 shutdown_connections 2024-04-02T07:23:39.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.179+0000 7efc87200640 1 -- 172.21.15.55:0/2638848854 >> 172.21.15.55:0/2638848854 conn(0x7efc80069d90 msgr2=0x7efc8006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:39.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.179+0000 7efc87200640 1 -- 172.21.15.55:0/2638848854 shutdown_connections 2024-04-02T07:23:39.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.179+0000 7efc87200640 1 -- 172.21.15.55:0/2638848854 wait complete. 2024-04-02T07:23:39.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc87200640 1 Processor -- start 2024-04-02T07:23:39.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc87200640 1 -- start start 2024-04-02T07:23:39.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc87200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc8006ccc0 0x7efc801511d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc87200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc801f2f50 0x7efc8015eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc87200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc800709e0 0x7efc80070e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc87200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc800713d0 con 0x7efc801f2f50 2024-04-02T07:23:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc87200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc80152210 con 0x7efc800709e0 2024-04-02T07:23:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc87200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc80152420 con 0x7efc8006ccc0 2024-04-02T07:23:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc77e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc801f2f50 0x7efc8015eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc77e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc801f2f50 0x7efc8015eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57808/0 (socket says 172.21.15.55:57808) 2024-04-02T07:23:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc77e00640 1 -- 172.21.15.55:0/634682269 learned_addr learned my addr 172.21.15.55:0/634682269 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc7fe00640 1 --2- 172.21.15.55:0/634682269 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc8006ccc0 0x7efc801511d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc85200640 1 --2- 172.21.15.55:0/634682269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc800709e0 0x7efc80070e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc77e00640 1 -- 172.21.15.55:0/634682269 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc8006ccc0 msgr2=0x7efc801511d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:39.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc77e00640 1 --2- 172.21.15.55:0/634682269 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc8006ccc0 0x7efc801511d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:39.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc77e00640 1 -- 172.21.15.55:0/634682269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc800709e0 msgr2=0x7efc80070e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:39.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc77e00640 1 --2- 172.21.15.55:0/634682269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc800709e0 0x7efc80070e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:39.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc77e00640 1 -- 172.21.15.55:0/634682269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc80152700 con 0x7efc801f2f50 2024-04-02T07:23:39.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc77e00640 1 --2- 172.21.15.55:0/634682269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc801f2f50 0x7efc8015eff0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7efc68011ca0 tx=0x7efc6800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:39.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc7cc00640 1 -- 172.21.15.55:0/634682269 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6800fd20 con 0x7efc801f2f50 2024-04-02T07:23:39.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc7cc00640 1 -- 172.21.15.55:0/634682269 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6800fe80 con 0x7efc801f2f50 2024-04-02T07:23:39.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc87200640 1 -- 172.21.15.55:0/634682269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc801529e0 con 0x7efc801f2f50 2024-04-02T07:23:39.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc7cc00640 1 -- 172.21.15.55:0/634682269 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc68004270 con 0x7efc801f2f50 2024-04-02T07:23:39.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc87200640 1 -- 172.21.15.55:0/634682269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc80151710 con 0x7efc801f2f50 2024-04-02T07:23:39.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.183+0000 7efc87200640 1 -- 172.21.15.55:0/634682269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc80066c90 con 0x7efc801f2f50 2024-04-02T07:23:39.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.187+0000 7efc7cc00640 1 -- 172.21.15.55:0/634682269 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7efc680043d0 con 0x7efc801f2f50 2024-04-02T07:23:39.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.187+0000 7efc7cc00640 1 --2- 172.21.15.55:0/634682269 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efc5c0666c0 0x7efc5c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:39.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.187+0000 7efc7cc00640 1 -- 172.21.15.55:0/634682269 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc68084ba0 con 0x7efc801f2f50 2024-04-02T07:23:39.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.187+0000 7efc7fe00640 1 --2- 172.21.15.55:0/634682269 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efc5c0666c0 0x7efc5c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:39.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.187+0000 7efc7fe00640 1 --2- 172.21.15.55:0/634682269 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efc5c0666c0 0x7efc5c068b80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efc700af000 tx=0x7efc700046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:39.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.191+0000 7efc7cc00640 1 -- 172.21.15.55:0/634682269 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7efc68051f20 con 0x7efc801f2f50 2024-04-02T07:23:39.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.363+0000 7efc87200640 1 -- 172.21.15.55:0/634682269 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7efc80073a10 con 0x7efc801f2f50 2024-04-02T07:23:39.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.363+0000 7efc7cc00640 1 -- 172.21.15.55:0/634682269 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) v1 ==== 80+0+0 (secure 0 0 0) 0x7efc68055540 con 0x7efc801f2f50 2024-04-02T07:23:39.367 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:23:39.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.367+0000 7efc87200640 1 -- 172.21.15.55:0/634682269 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efc5c0666c0 msgr2=0x7efc5c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:39.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.367+0000 7efc87200640 1 --2- 172.21.15.55:0/634682269 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efc5c0666c0 0x7efc5c068b80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7efc700af000 tx=0x7efc700046d0 comp rx=0 tx=0).stop 2024-04-02T07:23:39.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.367+0000 7efc87200640 1 -- 172.21.15.55:0/634682269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc801f2f50 msgr2=0x7efc8015eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:39.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.367+0000 7efc87200640 1 --2- 172.21.15.55:0/634682269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc801f2f50 0x7efc8015eff0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7efc68011ca0 tx=0x7efc6800f610 comp rx=0 tx=0).stop 2024-04-02T07:23:39.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.367+0000 7efc87200640 1 -- 172.21.15.55:0/634682269 shutdown_connections 2024-04-02T07:23:39.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.367+0000 7efc87200640 1 --2- 172.21.15.55:0/634682269 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efc5c0666c0 0x7efc5c068b80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:39.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.367+0000 7efc87200640 1 --2- 172.21.15.55:0/634682269 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efc800709e0 0x7efc80070e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:39.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.367+0000 7efc87200640 1 --2- 172.21.15.55:0/634682269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efc801f2f50 0x7efc8015eff0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:39.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.367+0000 7efc87200640 1 --2- 172.21.15.55:0/634682269 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efc8006ccc0 0x7efc801511d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:39.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.367+0000 7efc87200640 1 -- 172.21.15.55:0/634682269 >> 172.21.15.55:0/634682269 conn(0x7efc80069d90 msgr2=0x7efc800b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:39.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.367+0000 7efc87200640 1 -- 172.21.15.55:0/634682269 shutdown_connections 2024-04-02T07:23:39.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:39.367+0000 7efc87200640 1 -- 172.21.15.55:0/634682269 wait complete. 2024-04-02T07:23:39.388 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi055.front.sepia.ceph.com... 2024-04-02T07:23:39.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:39.388 DEBUG:teuthology.orchestra.run.smithi055:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-02T07:23:39.406 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[37646]: fuse finished with error 0 and tester_r 0 2024-04-02T07:23:39.409 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:23:43.294 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:23:43.298 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:23:45.511 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:23:45.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:45.511 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-02T07:23:45.522 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:23:45.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.711+0000 7fd539a00640 1 Processor -- start 2024-04-02T07:23:45.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.711+0000 7fd539a00640 1 -- start start 2024-04-02T07:23:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.711+0000 7fd539a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd534099120 0x7fd534165420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.711+0000 7fd539a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5340ad190 con 0x7fd5340cf1e0 2024-04-02T07:23:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.711+0000 7fd539a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5340cc4e0 con 0x7fd53415de80 2024-04-02T07:23:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.711+0000 7fd539a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5340cc210 con 0x7fd534099120 2024-04-02T07:23:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.711+0000 7fd52be00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd5340cf1e0 0x7fd534098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33014/0 (socket says 172.21.15.55:33014) 2024-04-02T07:23:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.711+0000 7fd52be00640 1 -- 172.21.15.55:0/2467814680 learned_addr learned my addr 172.21.15.55:0/2467814680 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:45.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.711+0000 7fd539000640 1 --2- 172.21.15.55:0/2467814680 >> v2:172.21.15.55:3300/0 conn(0x7fd534099120 0x7fd534165420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:45.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.715+0000 7fd533400640 1 -- 172.21.15.55:0/2467814680 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447435629 0 0) 0x7fd5340ad190 con 0x7fd5340cf1e0 2024-04-02T07:23:45.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.715+0000 7fd533400640 1 -- 172.21.15.55:0/2467814680 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd518003530 con 0x7fd5340cf1e0 2024-04-02T07:23:45.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.715+0000 7fd533400640 1 -- 172.21.15.55:0/2467814680 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524622874 0 0) 0x7fd5340cc4e0 con 0x7fd53415de80 2024-04-02T07:23:45.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.715+0000 7fd539000640 1 -- 172.21.15.55:0/2467814680 >> v1:172.21.15.106:6789/0 conn(0x7fd53415de80 legacy=0x7fd5340cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:45.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.715+0000 7fd539000640 1 -- 172.21.15.55:0/2467814680 >> v1:172.21.15.55:6789/0 conn(0x7fd5340cf1e0 legacy=0x7fd534098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:45.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.715+0000 7fd539000640 1 -- 172.21.15.55:0/2467814680 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5340afea0 con 0x7fd534099120 2024-04-02T07:23:45.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.715+0000 7fd539000640 1 --2- 172.21.15.55:0/2467814680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd534099120 0x7fd534165420 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009d90 tx=0x7fd52c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2df477ff624f643 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:45.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.715+0000 7fd533400640 1 -- 172.21.15.55:0/2467814680 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c0a5810 con 0x7fd534099120 2024-04-02T07:23:45.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.715+0000 7fd533400640 1 -- 172.21.15.55:0/2467814680 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c0a5970 con 0x7fd534099120 2024-04-02T07:23:45.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.715+0000 7fd533400640 1 -- 172.21.15.55:0/2467814680 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c0a5ce0 con 0x7fd534099120 2024-04-02T07:23:45.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.715+0000 7fd539a00640 1 -- 172.21.15.55:0/2467814680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd534099120 msgr2=0x7fd534165420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:45.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.715+0000 7fd539a00640 1 --2- 172.21.15.55:0/2467814680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd534099120 0x7fd534165420 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd52c009d90 tx=0x7fd52c01c970 comp rx=0 tx=0).stop 2024-04-02T07:23:45.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539a00640 1 -- 172.21.15.55:0/2467814680 shutdown_connections 2024-04-02T07:23:45.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539a00640 1 --2- 172.21.15.55:0/2467814680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd534099120 0x7fd534165420 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:45.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539a00640 1 -- 172.21.15.55:0/2467814680 >> 172.21.15.55:0/2467814680 conn(0x7fd5340b1ff0 msgr2=0x7fd5340b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:45.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539a00640 1 -- 172.21.15.55:0/2467814680 shutdown_connections 2024-04-02T07:23:45.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539a00640 1 -- 172.21.15.55:0/2467814680 wait complete. 2024-04-02T07:23:45.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539a00640 1 Processor -- start 2024-04-02T07:23:45.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539a00640 1 -- start start 2024-04-02T07:23:45.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd534099120 0x7fd5340c9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:45.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5340cf1e0 0x7fd5340c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:45.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd53415de80 0x7fd5340b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:45.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53409ded0 con 0x7fd53415de80 2024-04-02T07:23:45.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340c51b0 con 0x7fd5340cf1e0 2024-04-02T07:23:45.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5340c5490 con 0x7fd534099120 2024-04-02T07:23:45.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd53415de80 0x7fd5340b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:45.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd53415de80 0x7fd5340b4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34910/0 (socket says 172.21.15.55:34910) 2024-04-02T07:23:45.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539000640 1 -- 172.21.15.55:0/808767113 learned_addr learned my addr 172.21.15.55:0/808767113 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:45.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd52be00640 1 --2- 172.21.15.55:0/808767113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5340cf1e0 0x7fd5340c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:45.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd533e00640 1 --2- 172.21.15.55:0/808767113 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd534099120 0x7fd5340c9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:45.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539000640 1 -- 172.21.15.55:0/808767113 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd534099120 msgr2=0x7fd5340c9e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:45.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539000640 1 --2- 172.21.15.55:0/808767113 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd534099120 0x7fd5340c9e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:45.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539000640 1 -- 172.21.15.55:0/808767113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5340cf1e0 msgr2=0x7fd5340c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:45.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539000640 1 --2- 172.21.15.55:0/808767113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5340cf1e0 0x7fd5340c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:45.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539000640 1 -- 172.21.15.55:0/808767113 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd52c009a70 con 0x7fd53415de80 2024-04-02T07:23:45.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd533e00640 1 --2- 172.21.15.55:0/808767113 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd534099120 0x7fd5340c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:45.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.719+0000 7fd539000640 1 --2- 172.21.15.55:0/808767113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd53415de80 0x7fd5340b4090 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd52c019580 tx=0x7fd52c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:45.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.723+0000 7fd530c00640 1 -- 172.21.15.55:0/808767113 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c0ad440 con 0x7fd53415de80 2024-04-02T07:23:45.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.723+0000 7fd530c00640 1 -- 172.21.15.55:0/808767113 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd52c0ad5a0 con 0x7fd53415de80 2024-04-02T07:23:45.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.723+0000 7fd530c00640 1 -- 172.21.15.55:0/808767113 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd52c0ad910 con 0x7fd53415de80 2024-04-02T07:23:45.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.723+0000 7fd539a00640 1 -- 172.21.15.55:0/808767113 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5340c5770 con 0x7fd53415de80 2024-04-02T07:23:45.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.723+0000 7fd539a00640 1 -- 172.21.15.55:0/808767113 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5340c5d30 con 0x7fd53415de80 2024-04-02T07:23:45.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.723+0000 7fd539a00640 1 -- 172.21.15.55:0/808767113 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5340c5f20 con 0x7fd53415de80 2024-04-02T07:23:45.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.723+0000 7fd530c00640 1 -- 172.21.15.55:0/808767113 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd52c0ada70 con 0x7fd53415de80 2024-04-02T07:23:45.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.723+0000 7fd530c00640 1 --2- 172.21.15.55:0/808767113 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd510066690 0x7fd510068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:45.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.723+0000 7fd530c00640 1 -- 172.21.15.55:0/808767113 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd52c11f5a0 con 0x7fd53415de80 2024-04-02T07:23:45.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.723+0000 7fd533e00640 1 --2- 172.21.15.55:0/808767113 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd510066690 0x7fd510068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:45.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.723+0000 7fd533e00640 1 --2- 172.21.15.55:0/808767113 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd510066690 0x7fd510068b50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd524000f70 tx=0x7fd524009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:45.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.727+0000 7fd530c00640 1 -- 172.21.15.55:0/808767113 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd52c0ec920 con 0x7fd53415de80 2024-04-02T07:23:45.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.923+0000 7fd539a00640 1 -- 172.21.15.55:0/808767113 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd534073fa0 con 0x7fd53415de80 2024-04-02T07:23:45.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.923+0000 7fd530c00640 1 -- 172.21.15.55:0/808767113 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4725 (secure 0 0 0) 0x7fd52c0eff40 con 0x7fd53415de80 2024-04-02T07:23:45.926 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:45.926 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4883,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53106343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53106343},{"type":"v1","addr":"172.21.15.55:6833","nonce":53106343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/44669622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":44669622},{"type":"v1","addr":"172.21.15.106:6837","nonce":44669622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/741637637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":741637637},{"type":"v1","addr":"172.21.15.106:6836","nonce":741637637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:23:25.727369+0000","modified":"2024-04-02T07:23:29.049370+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/2440784960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2440784960},{"type":"v1","addr":"172.21.15.55:6835","nonce":2440784960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-02T07:23:45.926 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 17 2024-04-02T07:23:45.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.923+0000 7fd539a00640 1 -- 172.21.15.55:0/808767113 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd510066690 msgr2=0x7fd510068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:45.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.927+0000 7fd539a00640 1 --2- 172.21.15.55:0/808767113 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd510066690 0x7fd510068b50 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd524000f70 tx=0x7fd524009040 comp rx=0 tx=0).stop 2024-04-02T07:23:45.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.927+0000 7fd539a00640 1 -- 172.21.15.55:0/808767113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd53415de80 msgr2=0x7fd5340b4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:45.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.927+0000 7fd539a00640 1 --2- 172.21.15.55:0/808767113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd53415de80 0x7fd5340b4090 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fd52c019580 tx=0x7fd52c019710 comp rx=0 tx=0).stop 2024-04-02T07:23:45.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.927+0000 7fd539a00640 1 -- 172.21.15.55:0/808767113 shutdown_connections 2024-04-02T07:23:45.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.927+0000 7fd539a00640 1 --2- 172.21.15.55:0/808767113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd53415de80 0x7fd5340b4090 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:45.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.927+0000 7fd539a00640 1 --2- 172.21.15.55:0/808767113 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd510066690 0x7fd510068b50 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:45.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.927+0000 7fd539a00640 1 --2- 172.21.15.55:0/808767113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd5340cf1e0 0x7fd5340c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:45.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.927+0000 7fd539a00640 1 --2- 172.21.15.55:0/808767113 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd534099120 0x7fd5340c9e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:45.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.927+0000 7fd539a00640 1 -- 172.21.15.55:0/808767113 >> 172.21.15.55:0/808767113 conn(0x7fd5340b1ff0 msgr2=0x7fd53406e320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:45.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.927+0000 7fd539a00640 1 -- 172.21.15.55:0/808767113 shutdown_connections 2024-04-02T07:23:45.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:45.927+0000 7fd539a00640 1 -- 172.21.15.55:0/808767113 wait complete. 2024-04-02T07:23:45.948 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-02T07:23:46.115 INFO:teuthology.orchestra.run.smithi055.stdout:{"message":"","return_code":0} 2024-04-02T07:23:46.115 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-02T07:23:46.116 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:23:46.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.255+0000 7f0761000640 1 Processor -- start 2024-04-02T07:23:46.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.255+0000 7f0761000640 1 -- start start 2024-04-02T07:23:46.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.255+0000 7f0761000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f075c099120 0x7f075c099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:46.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.255+0000 7f0761000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f075c15f250 0x7f075c0b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:46.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.255+0000 7f0761000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f075c0ad270 con 0x7f075c15ee70 2024-04-02T07:23:46.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.255+0000 7f0761000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f075c0b0840 con 0x7f075c15f250 2024-04-02T07:23:46.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.255+0000 7f0761000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075c0cf6a0 con 0x7f075c099120 2024-04-02T07:23:46.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.255+0000 7f075a800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f075c15f250 0x7f075c0b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:46.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.255+0000 7f0751400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f075c099120 0x7f075c099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:46.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.255+0000 7f075a800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f075c15f250 0x7f075c0b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:49558/0 (socket says 172.21.15.55:49558) 2024-04-02T07:23:46.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.255+0000 7f075a800640 1 -- 172.21.15.55:0/491373565 learned_addr learned my addr 172.21.15.55:0/491373565 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:46.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.255+0000 7f0759e00640 1 --1- 172.21.15.55:0/491373565 >> v1:172.21.15.106:6789/0 conn(0x7f075c15ee70 0x7f075c098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:45744/0 (socket says 172.21.15.55:45744) 2024-04-02T07:23:46.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.255+0000 7f075a800640 1 -- 172.21.15.55:0/491373565 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f075c099120 msgr2=0x7f075c099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:46.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.255+0000 7f075a800640 1 --2- 172.21.15.55:0/491373565 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f075c099120 0x7f075c099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:46.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.255+0000 7f075a800640 1 -- 172.21.15.55:0/491373565 >> v1:172.21.15.106:6789/0 conn(0x7f075c15ee70 legacy=0x7f075c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:46.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.255+0000 7f075a800640 1 -- 172.21.15.55:0/491373565 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f075c0b0a50 con 0x7f075c15f250 2024-04-02T07:23:46.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.259+0000 7f075a800640 1 --2- 172.21.15.55:0/491373565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f075c15f250 0x7f075c0b12f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0754009870 tx=0x7f075401c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88a92f191403bff3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:46.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.259+0000 7f0759400640 1 -- 172.21.15.55:0/491373565 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07540a9620 con 0x7f075c15f250 2024-04-02T07:23:46.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.259+0000 7f0759400640 1 -- 172.21.15.55:0/491373565 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07540a9780 con 0x7f075c15f250 2024-04-02T07:23:46.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.259+0000 7f0759400640 1 -- 172.21.15.55:0/491373565 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07540a9b10 con 0x7f075c15f250 2024-04-02T07:23:46.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.259+0000 7f0761000640 1 -- 172.21.15.55:0/491373565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f075c15f250 msgr2=0x7f075c0b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:46.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.259+0000 7f0761000640 1 --2- 172.21.15.55:0/491373565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f075c15f250 0x7f075c0b12f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0754009870 tx=0x7f075401c560 comp rx=0 tx=0).stop 2024-04-02T07:23:46.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.259+0000 7f0761000640 1 -- 172.21.15.55:0/491373565 shutdown_connections 2024-04-02T07:23:46.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.259+0000 7f0761000640 1 --2- 172.21.15.55:0/491373565 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f075c15f250 0x7f075c0b12f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:46.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.259+0000 7f0761000640 1 --2- 172.21.15.55:0/491373565 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f075c099120 0x7f075c099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:46.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.259+0000 7f0761000640 1 -- 172.21.15.55:0/491373565 >> 172.21.15.55:0/491373565 conn(0x7f075c0b21d0 msgr2=0x7f075c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:46.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.259+0000 7f0761000640 1 -- 172.21.15.55:0/491373565 shutdown_connections 2024-04-02T07:23:46.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.259+0000 7f0761000640 1 -- 172.21.15.55:0/491373565 wait complete. 2024-04-02T07:23:46.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0761000640 1 Processor -- start 2024-04-02T07:23:46.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0761000640 1 -- start start 2024-04-02T07:23:46.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0761000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f075c099120 0x7f075c1541f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:46.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0761000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f075c15ee70 0x7f075c0c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:46.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0761000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f075c15f250 0x7f075c0b58c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:46.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0761000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c154730 con 0x7f075c099120 2024-04-02T07:23:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0761000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f075c0c4bf0 con 0x7f075c15ee70 2024-04-02T07:23:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0761000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f075c0c5a10 con 0x7f075c15f250 2024-04-02T07:23:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0759e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f075c099120 0x7f075c1541f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0759e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f075c099120 0x7f075c1541f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34924/0 (socket says 172.21.15.55:34924) 2024-04-02T07:23:46.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0759e00640 1 -- 172.21.15.55:0/2982288840 learned_addr learned my addr 172.21.15.55:0/2982288840 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:46.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0751400640 1 --2- 172.21.15.55:0/2982288840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f075c15ee70 0x7f075c0c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:46.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f075a800640 1 --2- 172.21.15.55:0/2982288840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f075c15f250 0x7f075c0b58c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:46.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0759e00640 1 -- 172.21.15.55:0/2982288840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f075c15f250 msgr2=0x7f075c0b58c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:46.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0759e00640 1 --2- 172.21.15.55:0/2982288840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f075c15f250 0x7f075c0b58c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:46.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0759e00640 1 -- 172.21.15.55:0/2982288840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f075c15ee70 msgr2=0x7f075c0c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:46.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0759e00640 1 --2- 172.21.15.55:0/2982288840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f075c15ee70 0x7f075c0c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:46.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0759e00640 1 -- 172.21.15.55:0/2982288840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07540094d0 con 0x7f075c099120 2024-04-02T07:23:46.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0759e00640 1 --2- 172.21.15.55:0/2982288840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f075c099120 0x7f075c1541f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f074c00c870 tx=0x7f074c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:46.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0752a00640 1 -- 172.21.15.55:0/2982288840 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c00a640 con 0x7f075c099120 2024-04-02T07:23:46.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0752a00640 1 -- 172.21.15.55:0/2982288840 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f074c00a7a0 con 0x7f075c099120 2024-04-02T07:23:46.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0752a00640 1 -- 172.21.15.55:0/2982288840 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f074c00ab10 con 0x7f075c099120 2024-04-02T07:23:46.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0761000640 1 -- 172.21.15.55:0/2982288840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f075c0c4e00 con 0x7f075c099120 2024-04-02T07:23:46.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0761000640 1 -- 172.21.15.55:0/2982288840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f075c0c53c0 con 0x7f075c099120 2024-04-02T07:23:46.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.263+0000 7f0761000640 1 -- 172.21.15.55:0/2982288840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f075c066c90 con 0x7f075c099120 2024-04-02T07:23:46.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.267+0000 7f0752a00640 1 -- 172.21.15.55:0/2982288840 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f074c00ac70 con 0x7f075c099120 2024-04-02T07:23:46.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.267+0000 7f0752a00640 1 --2- 172.21.15.55:0/2982288840 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0738066690 0x7f0738068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:46.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.267+0000 7f0752a00640 1 -- 172.21.15.55:0/2982288840 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f074c083aa0 con 0x7f075c099120 2024-04-02T07:23:46.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.267+0000 7f0751400640 1 --2- 172.21.15.55:0/2982288840 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0738066690 0x7f0738068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:46.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.267+0000 7f0751400640 1 --2- 172.21.15.55:0/2982288840 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0738066690 0x7f0738068b50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f075c1657d0 tx=0x7f0744008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:46.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.271+0000 7f0752a00640 1 -- 172.21.15.55:0/2982288840 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f074c050da0 con 0x7f075c099120 2024-04-02T07:23:46.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.467+0000 7f0761000640 1 -- 172.21.15.55:0/2982288840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f075c0c7540 con 0x7f075c099120 2024-04-02T07:23:46.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.467+0000 7f0752a00640 1 -- 172.21.15.55:0/2982288840 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4725 (secure 0 0 0) 0x7f074c017090 con 0x7f075c099120 2024-04-02T07:23:46.470 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:46.470 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4883,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53106343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53106343},{"type":"v1","addr":"172.21.15.55:6833","nonce":53106343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/44669622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":44669622},{"type":"v1","addr":"172.21.15.106:6837","nonce":44669622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/741637637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":741637637},{"type":"v1","addr":"172.21.15.106:6836","nonce":741637637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:23:25.727369+0000","modified":"2024-04-02T07:23:29.049370+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/2440784960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2440784960},{"type":"v1","addr":"172.21.15.55:6835","nonce":2440784960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-02T07:23:46.470 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 17 2024-04-02T07:23:46.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.467+0000 7f0761000640 1 -- 172.21.15.55:0/2982288840 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0738066690 msgr2=0x7f0738068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:46.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.467+0000 7f0761000640 1 --2- 172.21.15.55:0/2982288840 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0738066690 0x7f0738068b50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f075c1657d0 tx=0x7f0744008040 comp rx=0 tx=0).stop 2024-04-02T07:23:46.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.467+0000 7f0761000640 1 -- 172.21.15.55:0/2982288840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f075c099120 msgr2=0x7f075c1541f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:46.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.467+0000 7f0761000640 1 --2- 172.21.15.55:0/2982288840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f075c099120 0x7f075c1541f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f074c00c870 tx=0x7f074c00cd30 comp rx=0 tx=0).stop 2024-04-02T07:23:46.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.467+0000 7f0761000640 1 -- 172.21.15.55:0/2982288840 shutdown_connections 2024-04-02T07:23:46.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.467+0000 7f0761000640 1 --2- 172.21.15.55:0/2982288840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f075c15f250 0x7f075c0b58c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:46.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.467+0000 7f0761000640 1 --2- 172.21.15.55:0/2982288840 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0738066690 0x7f0738068b50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:46.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.467+0000 7f0761000640 1 --2- 172.21.15.55:0/2982288840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f075c15ee70 0x7f075c0c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:46.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.467+0000 7f0761000640 1 --2- 172.21.15.55:0/2982288840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f075c099120 0x7f075c1541f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:46.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.467+0000 7f0761000640 1 -- 172.21.15.55:0/2982288840 >> 172.21.15.55:0/2982288840 conn(0x7f075c0b21d0 msgr2=0x7f075c159260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:46.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.467+0000 7f0761000640 1 -- 172.21.15.55:0/2982288840 shutdown_connections 2024-04-02T07:23:46.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:46.467+0000 7f0761000640 1 -- 172.21.15.55:0/2982288840 wait complete. 2024-04-02T07:23:46.491 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json tag path /parentdir mytag 2024-04-02T07:23:46.655 INFO:teuthology.orchestra.run.smithi055.stdout:{"return_code":0,"scrub_tag":"mytag","mode":"asynchronous"} 2024-04-02T07:23:46.655 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag" } 2024-04-02T07:23:56.656 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000000.00000000 scrub_tag 2024-04-02T07:23:56.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00ee48080 1 Processor -- start 2024-04-02T07:23:56.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00ee48080 1 -- start start 2024-04-02T07:23:56.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00ee48080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d33ef681c0 0x55d33eeeb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00ee48080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d33ef685a0 0x55d33ef62420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00ee48080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d33ef7f850 0x55d33eef20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00ee48080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d33edf0600 con 0x55d33ef685a0 2024-04-02T07:23:56.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00ee48080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d33ede7690 con 0x55d33ef681c0 2024-04-02T07:23:56.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00ee48080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d33eee8f60 con 0x55d33ef7f850 2024-04-02T07:23:56.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d33ef685a0 0x55d33ef62420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d33ef685a0 0x55d33ef62420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51060/0 (socket says 172.21.15.55:51060) 2024-04-02T07:23:56.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00aa00640 1 -- 172.21.15.55:0/2207805860 learned_addr learned my addr 172.21.15.55:0/2207805860 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:56.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d33ef681c0 0x55d33eeeb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00be00640 1 --2- 172.21.15.55:0/2207805860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d33ef7f850 0x55d33eef20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00aa00640 1 -- 172.21.15.55:0/2207805860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d33ef7f850 msgr2=0x55d33eef20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:56.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00aa00640 1 --2- 172.21.15.55:0/2207805860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d33ef7f850 0x55d33eef20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00aa00640 1 -- 172.21.15.55:0/2207805860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d33ef681c0 msgr2=0x55d33eeeb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:56.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00aa00640 1 --2- 172.21.15.55:0/2207805860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d33ef681c0 0x55d33eeeb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00aa00640 1 -- 172.21.15.55:0/2207805860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcffc005df0 con 0x55d33ef685a0 2024-04-02T07:23:56.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00aa00640 1 --2- 172.21.15.55:0/2207805860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d33ef685a0 0x55d33ef62420 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fcff800a7b0 tx=0x7fcff800ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2299281e5fff595 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:56.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd009600640 1 -- 172.21.15.55:0/2207805860 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff800f070 con 0x55d33ef685a0 2024-04-02T07:23:56.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd009600640 1 -- 172.21.15.55:0/2207805860 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcff800ada0 con 0x55d33ef685a0 2024-04-02T07:23:56.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd009600640 1 -- 172.21.15.55:0/2207805860 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff8008bb0 con 0x55d33ef685a0 2024-04-02T07:23:56.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00ee48080 1 -- 172.21.15.55:0/2207805860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d33ef685a0 msgr2=0x55d33ef62420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00ee48080 1 --2- 172.21.15.55:0/2207805860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d33ef685a0 0x55d33ef62420 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fcff800a7b0 tx=0x7fcff800ac70 comp rx=0 tx=0).stop 2024-04-02T07:23:56.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00ee48080 1 -- 172.21.15.55:0/2207805860 shutdown_connections 2024-04-02T07:23:56.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00ee48080 1 --2- 172.21.15.55:0/2207805860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d33ef7f850 0x55d33eef20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00ee48080 1 --2- 172.21.15.55:0/2207805860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d33ef685a0 0x55d33ef62420 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00ee48080 1 --2- 172.21.15.55:0/2207805860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d33ef681c0 0x55d33eeeb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00ee48080 1 -- 172.21.15.55:0/2207805860 >> 172.21.15.55:0/2207805860 conn(0x55d33eed6bf0 msgr2=0x55d33eed8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:56.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.707+0000 7fd00ee48080 1 -- 172.21.15.55:0/2207805860 shutdown_connections 2024-04-02T07:23:56.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00ee48080 1 -- 172.21.15.55:0/2207805860 wait complete. 2024-04-02T07:23:56.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00ee48080 1 Processor -- start 2024-04-02T07:23:56.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00ee48080 1 -- start start 2024-04-02T07:23:56.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00ee48080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d33ef681c0 0x55d33ef7e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00ee48080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d33ef685a0 0x55d33ef60f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00ee48080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d33ef7f850 0x55d33eeeeb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00ee48080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d33ef7ea20 con 0x55d33ef7f850 2024-04-02T07:23:56.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00ee48080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d33eef1890 con 0x55d33ef685a0 2024-04-02T07:23:56.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00ee48080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d33ef63730 con 0x55d33ef681c0 2024-04-02T07:23:56.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d33ef7f850 0x55d33eeeeb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00b400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d33ef681c0 0x55d33ef7e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d33ef7f850 0x55d33eeeeb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51074/0 (socket says 172.21.15.55:51074) 2024-04-02T07:23:56.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00be00640 1 -- 172.21.15.55:0/3022007984 learned_addr learned my addr 172.21.15.55:0/3022007984 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:56.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00aa00640 1 --2- 172.21.15.55:0/3022007984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d33ef685a0 0x55d33ef60f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00be00640 1 -- 172.21.15.55:0/3022007984 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d33ef681c0 msgr2=0x55d33ef7e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00be00640 1 --2- 172.21.15.55:0/3022007984 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d33ef681c0 0x55d33ef7e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00be00640 1 -- 172.21.15.55:0/3022007984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d33ef685a0 msgr2=0x55d33ef60f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00be00640 1 --2- 172.21.15.55:0/3022007984 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d33ef685a0 0x55d33ef60f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00be00640 1 -- 172.21.15.55:0/3022007984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcff800a430 con 0x55d33ef7f850 2024-04-02T07:23:56.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00be00640 1 --2- 172.21.15.55:0/3022007984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d33ef7f850 0x55d33eeeeb60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd00400f670 tx=0x7fd00400fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:56.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd003e00640 1 -- 172.21.15.55:0/3022007984 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00400c390 con 0x55d33ef7f850 2024-04-02T07:23:56.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd003e00640 1 -- 172.21.15.55:0/3022007984 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd00400d750 con 0x55d33ef7f850 2024-04-02T07:23:56.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd003e00640 1 -- 172.21.15.55:0/3022007984 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd00400dae0 con 0x55d33ef7f850 2024-04-02T07:23:56.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00ee48080 1 -- 172.21.15.55:0/3022007984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d33ee19a60 con 0x55d33ef7f850 2024-04-02T07:23:56.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.711+0000 7fd00ee48080 1 -- 172.21.15.55:0/3022007984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d33edff8c0 con 0x55d33ef7f850 2024-04-02T07:23:56.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.715+0000 7fd003e00640 1 -- 172.21.15.55:0/3022007984 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd00400dc40 con 0x55d33ef7f850 2024-04-02T07:23:56.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.715+0000 7fd003e00640 1 --2- 172.21.15.55:0/3022007984 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcfec0650a0 0x7fcfec067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.715+0000 7fd003e00640 1 -- 172.21.15.55:0/3022007984 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd004083410 con 0x55d33ef7f850 2024-04-02T07:23:56.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.715+0000 7fd00b400640 1 --2- 172.21.15.55:0/3022007984 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcfec0650a0 0x7fcfec067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.715+0000 7fd00ee48080 1 --2- 172.21.15.55:0/3022007984 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55d33eeed450 0x55d33ef640a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.715+0000 7fd00ee48080 1 -- 172.21.15.55:0/3022007984 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:1 4.10 4:0cf6ad0f:::10000000000.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55d33ef645e0 con 0x55d33eeed450 2024-04-02T07:23:56.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.715+0000 7fd00aa00640 1 --2- 172.21.15.55:0/3022007984 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55d33eeed450 0x55d33ef640a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.715+0000 7fd00b400640 1 --2- 172.21.15.55:0/3022007984 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcfec0650a0 0x7fcfec067560 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0ae000 tx=0x7fcffc0a6070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:56.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.715+0000 7fd00aa00640 1 --2- 172.21.15.55:0/3022007984 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55d33eeed450 0x55d33ef640a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:56.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.715+0000 7fd00aa00640 1 -- 172.21.15.55:0/3022007984 <== osd.3 v2:172.21.15.55:6824/27393 1 ==== osd_op_reply(1 10000000000.00000000 [getxattr (9) out=9b] v0'0 uv11 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7fcff8008d90 con 0x55d33eeed450 2024-04-02T07:23:56.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.715+0000 7fd00ee48080 1 -- 172.21.15.55:0/3022007984 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55d33eeed450 msgr2=0x55d33ef640a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.715+0000 7fd00ee48080 1 --2- 172.21.15.55:0/3022007984 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55d33eeed450 0x55d33ef640a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.715+0000 7fd00ee48080 1 -- 172.21.15.55:0/3022007984 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcfec0650a0 msgr2=0x7fcfec067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.715+0000 7fd00ee48080 1 --2- 172.21.15.55:0/3022007984 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcfec0650a0 0x7fcfec067560 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fcffc0ae000 tx=0x7fcffc0a6070 comp rx=0 tx=0).stop 2024-04-02T07:23:56.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.715+0000 7fd00ee48080 1 -- 172.21.15.55:0/3022007984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d33ef7f850 msgr2=0x55d33eeeeb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.715+0000 7fd00ee48080 1 --2- 172.21.15.55:0/3022007984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d33ef7f850 0x55d33eeeeb60 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd00400f670 tx=0x7fd00400fb30 comp rx=0 tx=0).stop 2024-04-02T07:23:56.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.715+0000 7fd00be00640 1 -- 172.21.15.55:0/3022007984 reap_dead start 2024-04-02T07:23:56.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.719+0000 7fd00ee48080 1 -- 172.21.15.55:0/3022007984 shutdown_connections 2024-04-02T07:23:56.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.719+0000 7fd00ee48080 1 -- 172.21.15.55:0/3022007984 >> 172.21.15.55:0/3022007984 conn(0x55d33eed6bf0 msgr2=0x55d33eef20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:56.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.719+0000 7fd00ee48080 1 -- 172.21.15.55:0/3022007984 shutdown_connections 2024-04-02T07:23:56.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.719+0000 7fd00ee48080 1 -- 172.21.15.55:0/3022007984 wait complete. 2024-04-02T07:23:56.724 INFO:teuthology.orchestra.run.smithi055.stdout:mytag 2024-04-02T07:23:56.725 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata getxattr 10000000001.00000000 scrub_tag 2024-04-02T07:23:56.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f730b1e8080 1 Processor -- start 2024-04-02T07:23:56.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f730b1e8080 1 -- start start 2024-04-02T07:23:56.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f730b1e8080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d566800130 0x55d566813030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f730b1e8080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d566800510 0x55d566813570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f730b1e8080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d5668186e0 0x55d5667fecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f730b1e8080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d566688960 con 0x55d566800510 2024-04-02T07:23:56.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f730b1e8080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d566688600 con 0x55d5668186e0 2024-04-02T07:23:56.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f730b1e8080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d56667f690 con 0x55d566800130 2024-04-02T07:23:56.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f7307a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d566800510 0x55d566813570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f7307a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d566800510 0x55d566813570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51092/0 (socket says 172.21.15.55:51092) 2024-04-02T07:23:56.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f7307a00640 1 -- 172.21.15.55:0/2445460333 learned_addr learned my addr 172.21.15.55:0/2445460333 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:56.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f7308400640 1 --2- 172.21.15.55:0/2445460333 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d566800130 0x55d566813030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f7308e00640 1 --2- 172.21.15.55:0/2445460333 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d5668186e0 0x55d5667fecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f7307a00640 1 -- 172.21.15.55:0/2445460333 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d566800130 msgr2=0x55d566813030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:56.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f7307a00640 1 --2- 172.21.15.55:0/2445460333 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d566800130 0x55d566813030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f7307a00640 1 -- 172.21.15.55:0/2445460333 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d5668186e0 msgr2=0x55d5667fecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:56.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f7307a00640 1 --2- 172.21.15.55:0/2445460333 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d5668186e0 0x55d5667fecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f7307a00640 1 -- 172.21.15.55:0/2445460333 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f8005df0 con 0x55d566800510 2024-04-02T07:23:56.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f7308400640 1 --2- 172.21.15.55:0/2445460333 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d566800130 0x55d566813030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:56.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f7308e00640 1 --2- 172.21.15.55:0/2445460333 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d5668186e0 0x55d5667fecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:56.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f7307a00640 1 --2- 172.21.15.55:0/2445460333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d566800510 0x55d566813570 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f72f400b2a0 tx=0x7f72f400b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b3d560362c05dc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:56.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f7306600640 1 -- 172.21.15.55:0/2445460333 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f400e780 con 0x55d566800510 2024-04-02T07:23:56.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f7306600640 1 -- 172.21.15.55:0/2445460333 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f400e900 con 0x55d566800510 2024-04-02T07:23:56.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f7306600640 1 -- 172.21.15.55:0/2445460333 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f400ecb0 con 0x55d566800510 2024-04-02T07:23:56.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f730b1e8080 1 -- 172.21.15.55:0/2445460333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d566800510 msgr2=0x55d566813570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f730b1e8080 1 --2- 172.21.15.55:0/2445460333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d566800510 0x55d566813570 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f72f400b2a0 tx=0x7f72f400b760 comp rx=0 tx=0).stop 2024-04-02T07:23:56.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f730b1e8080 1 -- 172.21.15.55:0/2445460333 shutdown_connections 2024-04-02T07:23:56.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f730b1e8080 1 --2- 172.21.15.55:0/2445460333 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d5668186e0 0x55d5667fecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f730b1e8080 1 --2- 172.21.15.55:0/2445460333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d566800510 0x55d566813570 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f730b1e8080 1 --2- 172.21.15.55:0/2445460333 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d566800130 0x55d566813030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.771+0000 7f730b1e8080 1 -- 172.21.15.55:0/2445460333 >> 172.21.15.55:0/2445460333 conn(0x55d56676ebf0 msgr2=0x55d56673fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:56.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f730b1e8080 1 -- 172.21.15.55:0/2445460333 shutdown_connections 2024-04-02T07:23:56.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f730b1e8080 1 -- 172.21.15.55:0/2445460333 wait complete. 2024-04-02T07:23:56.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f730b1e8080 1 Processor -- start 2024-04-02T07:23:56.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f730b1e8080 1 -- start start 2024-04-02T07:23:56.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f730b1e8080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d566800130 0x55d566740670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f730b1e8080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d566800510 0x55d5668b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f730b1e8080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5668186e0 0x55d566786ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f730b1e8080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d566740d80 con 0x55d5668186e0 2024-04-02T07:23:56.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f730b1e8080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d566741020 con 0x55d566800130 2024-04-02T07:23:56.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f730b1e8080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d5667412c0 con 0x55d566800510 2024-04-02T07:23:56.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f7308e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5668186e0 0x55d566786ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f7308400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d566800130 0x55d566740670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f7307a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d566800510 0x55d5668b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f7308400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d566800130 0x55d566740670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:43980/0 (socket says 172.21.15.55:43980) 2024-04-02T07:23:56.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f7308400640 1 -- 172.21.15.55:0/3833291684 learned_addr learned my addr 172.21.15.55:0/3833291684 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:56.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f7308e00640 1 -- 172.21.15.55:0/3833291684 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d566800510 msgr2=0x55d5668b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f7308e00640 1 --2- 172.21.15.55:0/3833291684 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d566800510 0x55d5668b0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f7308e00640 1 -- 172.21.15.55:0/3833291684 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d566800130 msgr2=0x55d566740670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f7308e00640 1 --2- 172.21.15.55:0/3833291684 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d566800130 0x55d566740670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f7308e00640 1 -- 172.21.15.55:0/3833291684 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f4002bb0 con 0x55d5668186e0 2024-04-02T07:23:56.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f7308e00640 1 --2- 172.21.15.55:0/3833291684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5668186e0 0x55d566786ef0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f730000b450 tx=0x7f730000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:56.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f7305200640 1 -- 172.21.15.55:0/3833291684 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7300012660 con 0x55d5668186e0 2024-04-02T07:23:56.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f7305200640 1 -- 172.21.15.55:0/3833291684 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73000127c0 con 0x55d5668186e0 2024-04-02T07:23:56.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f7305200640 1 -- 172.21.15.55:0/3833291684 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7300012b50 con 0x55d5668186e0 2024-04-02T07:23:56.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f730b1e8080 1 -- 172.21.15.55:0/3833291684 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d5666978c0 con 0x55d5668186e0 2024-04-02T07:23:56.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.775+0000 7f730b1e8080 1 -- 172.21.15.55:0/3833291684 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d56668ad00 con 0x55d5668186e0 2024-04-02T07:23:56.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f7305200640 1 -- 172.21.15.55:0/3833291684 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7300012cb0 con 0x55d5668186e0 2024-04-02T07:23:56.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f7305200640 1 --2- 172.21.15.55:0/3833291684 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f72e80650d0 0x7f72e8067590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f7305200640 1 -- 172.21.15.55:0/3833291684 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7300083500 con 0x55d5668186e0 2024-04-02T07:23:56.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f7308400640 1 --2- 172.21.15.55:0/3833291684 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f72e80650d0 0x7f72e8067590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f730b1e8080 1 --2- 172.21.15.55:0/3833291684 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55d5668b0d60 0x55d566741ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f730b1e8080 1 -- 172.21.15.55:0/3833291684 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:1 4.7 4:e2e07930:::10000000001.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55d566787430 con 0x55d5668b0d60 2024-04-02T07:23:56.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f7307a00640 1 --2- 172.21.15.55:0/3833291684 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55d5668b0d60 0x55d566741ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f7308400640 1 --2- 172.21.15.55:0/3833291684 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f72e80650d0 0x7f72e8067590 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f72f8000c10 tx=0x7f72f80a6070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:56.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f7307a00640 1 --2- 172.21.15.55:0/3833291684 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55d5668b0d60 0x55d566741ca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:56.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f7307a00640 1 -- 172.21.15.55:0/3833291684 <== osd.1 v2:172.21.15.55:6809/27391 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (9) out=9b] v0'0 uv5 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f72f4015020 con 0x55d5668b0d60 2024-04-02T07:23:56.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f730b1e8080 1 -- 172.21.15.55:0/3833291684 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55d5668b0d60 msgr2=0x55d566741ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f730b1e8080 1 --2- 172.21.15.55:0/3833291684 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55d5668b0d60 0x55d566741ca0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f730b1e8080 1 -- 172.21.15.55:0/3833291684 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f72e80650d0 msgr2=0x7f72e8067590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f730b1e8080 1 --2- 172.21.15.55:0/3833291684 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f72e80650d0 0x7f72e8067590 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f72f8000c10 tx=0x7f72f80a6070 comp rx=0 tx=0).stop 2024-04-02T07:23:56.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f730b1e8080 1 -- 172.21.15.55:0/3833291684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5668186e0 msgr2=0x55d566786ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f730b1e8080 1 --2- 172.21.15.55:0/3833291684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d5668186e0 0x55d566786ef0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f730000b450 tx=0x7f730000b910 comp rx=0 tx=0).stop 2024-04-02T07:23:56.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f7308e00640 1 -- 172.21.15.55:0/3833291684 reap_dead start 2024-04-02T07:23:56.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f730b1e8080 1 -- 172.21.15.55:0/3833291684 shutdown_connections 2024-04-02T07:23:56.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f730b1e8080 1 -- 172.21.15.55:0/3833291684 >> 172.21.15.55:0/3833291684 conn(0x55d56676ebf0 msgr2=0x55d56672c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:56.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f730b1e8080 1 -- 172.21.15.55:0/3833291684 shutdown_connections 2024-04-02T07:23:56.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.779+0000 7f730b1e8080 1 -- 172.21.15.55:0/3833291684 wait complete. 2024-04-02T07:23:56.788 INFO:teuthology.orchestra.run.smithi055.stdout:mytag 2024-04-02T07:23:56.788 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-04-02T07:23:56.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.831+0000 7f98e6041080 1 Processor -- start 2024-04-02T07:23:56.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.831+0000 7f98e6041080 1 -- start start 2024-04-02T07:23:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.831+0000 7f98e6041080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d9da4a6ce0 0x55d9da531d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.831+0000 7f98e6041080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d9da532a20 0x55d9da534d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.831+0000 7f98e6041080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d9da533340 0x55d9da535290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.831+0000 7f98e6041080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9da3a2600 con 0x55d9da533340 2024-04-02T07:23:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.831+0000 7f98e6041080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9da399690 con 0x55d9da532a20 2024-04-02T07:23:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.831+0000 7f98e6041080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d9da48dea0 con 0x55d9da4a6ce0 2024-04-02T07:23:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.831+0000 7f98e3c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d9da533340 0x55d9da535290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e3200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d9da4a6ce0 0x55d9da531d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e2800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d9da532a20 0x55d9da534d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e3200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d9da4a6ce0 0x55d9da531d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:58404/0 (socket says 172.21.15.55:58404) 2024-04-02T07:23:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e3200640 1 -- 172.21.15.55:0/2041101900 learned_addr learned my addr 172.21.15.55:0/2041101900 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e3c00640 1 -- 172.21.15.55:0/2041101900 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d9da4a6ce0 msgr2=0x55d9da531d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e3c00640 1 --2- 172.21.15.55:0/2041101900 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d9da4a6ce0 0x55d9da531d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e3c00640 1 -- 172.21.15.55:0/2041101900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d9da532a20 msgr2=0x55d9da534d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e3c00640 1 --2- 172.21.15.55:0/2041101900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d9da532a20 0x55d9da534d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e3c00640 1 -- 172.21.15.55:0/2041101900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d4005df0 con 0x55d9da533340 2024-04-02T07:23:56.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e3c00640 1 --2- 172.21.15.55:0/2041101900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d9da533340 0x55d9da535290 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00c3f0 tx=0x7f98dc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21d1cc1e221900a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e1400640 1 -- 172.21.15.55:0/2041101900 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc0115f0 con 0x55d9da533340 2024-04-02T07:23:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e1400640 1 -- 172.21.15.55:0/2041101900 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98dc011750 con 0x55d9da533340 2024-04-02T07:23:56.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e1400640 1 -- 172.21.15.55:0/2041101900 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc011ae0 con 0x55d9da533340 2024-04-02T07:23:56.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e6041080 1 -- 172.21.15.55:0/2041101900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d9da533340 msgr2=0x55d9da535290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e6041080 1 --2- 172.21.15.55:0/2041101900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d9da533340 0x55d9da535290 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00c3f0 tx=0x7f98dc00c8b0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e6041080 1 -- 172.21.15.55:0/2041101900 shutdown_connections 2024-04-02T07:23:56.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e6041080 1 --2- 172.21.15.55:0/2041101900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d9da533340 0x55d9da535290 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e6041080 1 --2- 172.21.15.55:0/2041101900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d9da532a20 0x55d9da534d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e6041080 1 --2- 172.21.15.55:0/2041101900 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d9da4a6ce0 0x55d9da531d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e6041080 1 -- 172.21.15.55:0/2041101900 >> 172.21.15.55:0/2041101900 conn(0x55d9da4895a0 msgr2=0x55d9da512c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e6041080 1 -- 172.21.15.55:0/2041101900 shutdown_connections 2024-04-02T07:23:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e6041080 1 -- 172.21.15.55:0/2041101900 wait complete. 2024-04-02T07:23:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e6041080 1 Processor -- start 2024-04-02T07:23:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e6041080 1 -- start start 2024-04-02T07:23:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e6041080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d9da4a6ce0 0x55d9da4a0750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e6041080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d9da532a20 0x55d9da45c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e6041080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d9da533340 0x55d9da534a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e6041080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9da45cb30 con 0x55d9da533340 2024-04-02T07:23:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e6041080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9da4a0db0 con 0x55d9da532a20 2024-04-02T07:23:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e6041080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d9da4a1050 con 0x55d9da4a6ce0 2024-04-02T07:23:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e3c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d9da533340 0x55d9da534a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e3200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d9da4a6ce0 0x55d9da4a0750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e3c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d9da533340 0x55d9da534a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51132/0 (socket says 172.21.15.55:51132) 2024-04-02T07:23:56.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e3c00640 1 -- 172.21.15.55:0/3887716396 learned_addr learned my addr 172.21.15.55:0/3887716396 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:56.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.835+0000 7f98e2800640 1 --2- 172.21.15.55:0/3887716396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d9da532a20 0x55d9da45c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.839+0000 7f98e3c00640 1 -- 172.21.15.55:0/3887716396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d9da4a6ce0 msgr2=0x55d9da4a0750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.839+0000 7f98e3c00640 1 --2- 172.21.15.55:0/3887716396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d9da4a6ce0 0x55d9da4a0750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.839+0000 7f98e3c00640 1 -- 172.21.15.55:0/3887716396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d9da532a20 msgr2=0x55d9da45c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.839+0000 7f98e3c00640 1 --2- 172.21.15.55:0/3887716396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d9da532a20 0x55d9da45c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.839+0000 7f98e3c00640 1 -- 172.21.15.55:0/3887716396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc00d040 con 0x55d9da533340 2024-04-02T07:23:56.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.839+0000 7f98e3c00640 1 --2- 172.21.15.55:0/3887716396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d9da533340 0x55d9da534a50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0126b0 tx=0x7f98dc0033b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:56.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.839+0000 7f98dbe00640 1 -- 172.21.15.55:0/3887716396 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc0115f0 con 0x55d9da533340 2024-04-02T07:23:56.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.839+0000 7f98dbe00640 1 -- 172.21.15.55:0/3887716396 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98dc021070 con 0x55d9da533340 2024-04-02T07:23:56.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.839+0000 7f98e6041080 1 -- 172.21.15.55:0/3887716396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55d9da3cba60 con 0x55d9da533340 2024-04-02T07:23:56.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.839+0000 7f98dbe00640 1 -- 172.21.15.55:0/3887716396 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98dc012a90 con 0x55d9da533340 2024-04-02T07:23:56.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.839+0000 7f98e6041080 1 -- 172.21.15.55:0/3887716396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d9da3b18c0 con 0x55d9da533340 2024-04-02T07:23:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.839+0000 7f98dbe00640 1 -- 172.21.15.55:0/3887716396 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f98dc023030 con 0x55d9da533340 2024-04-02T07:23:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.839+0000 7f98dbe00640 1 --2- 172.21.15.55:0/3887716396 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f98c40650a0 0x7f98c4067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.839+0000 7f98dbe00640 1 -- 172.21.15.55:0/3887716396 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98dc084af0 con 0x55d9da533340 2024-04-02T07:23:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.839+0000 7f98e6041080 1 --2- 172.21.15.55:0/3887716396 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55d9da534f90 0x55d9da4a2f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.839+0000 7f98e3200640 1 --2- 172.21.15.55:0/3887716396 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f98c40650a0 0x7f98c4067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.839+0000 7f98e6041080 1 -- 172.21.15.55:0/3887716396 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:1 5.36 5:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55d9da4a3480 con 0x55d9da534f90 2024-04-02T07:23:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.843+0000 7f98e2800640 1 --2- 172.21.15.55:0/3887716396 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55d9da534f90 0x55d9da4a2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.843+0000 7f98e3200640 1 --2- 172.21.15.55:0/3887716396 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f98c40650a0 0x7f98c4067560 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f98d401b770 tx=0x7f98d40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:56.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.843+0000 7f98e2800640 1 --2- 172.21.15.55:0/3887716396 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55d9da534f90 0x55d9da4a2f40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:56.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.843+0000 7f98e2800640 1 -- 172.21.15.55:0/3887716396 <== osd.1 v2:172.21.15.55:6809/27391 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr (9) out=9b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f98d0009ae0 con 0x55d9da534f90 2024-04-02T07:23:56.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.843+0000 7f98e6041080 1 -- 172.21.15.55:0/3887716396 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55d9da534f90 msgr2=0x55d9da4a2f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.843+0000 7f98e6041080 1 --2- 172.21.15.55:0/3887716396 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55d9da534f90 0x55d9da4a2f40 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.843+0000 7f98e6041080 1 -- 172.21.15.55:0/3887716396 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f98c40650a0 msgr2=0x7f98c4067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.843+0000 7f98e6041080 1 --2- 172.21.15.55:0/3887716396 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f98c40650a0 0x7f98c4067560 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f98d401b770 tx=0x7f98d40a6000 comp rx=0 tx=0).stop 2024-04-02T07:23:56.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.843+0000 7f98e6041080 1 -- 172.21.15.55:0/3887716396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d9da533340 msgr2=0x55d9da534a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.843+0000 7f98e6041080 1 --2- 172.21.15.55:0/3887716396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d9da533340 0x55d9da534a50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f98dc0126b0 tx=0x7f98dc0033b0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.843+0000 7f98e3c00640 1 -- 172.21.15.55:0/3887716396 reap_dead start 2024-04-02T07:23:56.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.843+0000 7f98e6041080 1 -- 172.21.15.55:0/3887716396 shutdown_connections 2024-04-02T07:23:56.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.843+0000 7f98e6041080 1 -- 172.21.15.55:0/3887716396 >> 172.21.15.55:0/3887716396 conn(0x55d9da4895a0 msgr2=0x55d9da531d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:56.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.843+0000 7f98e6041080 1 -- 172.21.15.55:0/3887716396 shutdown_connections 2024-04-02T07:23:56.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.843+0000 7f98e6041080 1 -- 172.21.15.55:0/3887716396 wait complete. 2024-04-02T07:23:56.849 INFO:teuthology.orchestra.run.smithi055.stdout:mytag 2024-04-02T07:23:56.849 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-04-02T07:23:56.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66bce21080 1 Processor -- start 2024-04-02T07:23:56.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66bce21080 1 -- start start 2024-04-02T07:23:56.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66bce21080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa14dd3540 0x55fa14d5bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66bce21080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa14dea710 0x55fa14de9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66bce21080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa14deada0 0x55fa14dd2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66bce21080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa14c59960 con 0x55fa14dd3540 2024-04-02T07:23:56.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66bce21080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa14c59600 con 0x55fa14dea710 2024-04-02T07:23:56.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66bce21080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa14c50690 con 0x55fa14deada0 2024-04-02T07:23:56.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66ba000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa14dd3540 0x55fa14d5bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66ba000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa14dd3540 0x55fa14d5bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51136/0 (socket says 172.21.15.55:51136) 2024-04-02T07:23:56.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66ba000640 1 -- 172.21.15.55:0/1850439597 learned_addr learned my addr 172.21.15.55:0/1850439597 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:56.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66baa00640 1 --2- 172.21.15.55:0/1850439597 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa14deada0 0x55fa14dd2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66b9600640 1 --2- 172.21.15.55:0/1850439597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa14dea710 0x55fa14de9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66ba000640 1 -- 172.21.15.55:0/1850439597 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa14deada0 msgr2=0x55fa14dd2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:56.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66ba000640 1 --2- 172.21.15.55:0/1850439597 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa14deada0 0x55fa14dd2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66ba000640 1 -- 172.21.15.55:0/1850439597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa14dea710 msgr2=0x55fa14de9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:56.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66ba000640 1 --2- 172.21.15.55:0/1850439597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa14dea710 0x55fa14de9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66ba000640 1 -- 172.21.15.55:0/1850439597 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac005d30 con 0x55fa14dd3540 2024-04-02T07:23:56.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66ba000640 1 --2- 172.21.15.55:0/1850439597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa14dd3540 0x55fa14d5bc70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009a10 tx=0x7f66ac005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bc80606e2e9be5c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:56.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66b3e00640 1 -- 172.21.15.55:0/1850439597 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac00f040 con 0x55fa14dd3540 2024-04-02T07:23:56.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66b3e00640 1 -- 172.21.15.55:0/1850439597 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ac008e60 con 0x55fa14dd3540 2024-04-02T07:23:56.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66b3e00640 1 -- 172.21.15.55:0/1850439597 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac013620 con 0x55fa14dd3540 2024-04-02T07:23:56.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66bce21080 1 -- 172.21.15.55:0/1850439597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa14dd3540 msgr2=0x55fa14d5bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66bce21080 1 --2- 172.21.15.55:0/1850439597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa14dd3540 0x55fa14d5bc70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009a10 tx=0x7f66ac005a10 comp rx=0 tx=0).stop 2024-04-02T07:23:56.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66bce21080 1 -- 172.21.15.55:0/1850439597 shutdown_connections 2024-04-02T07:23:56.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66bce21080 1 --2- 172.21.15.55:0/1850439597 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa14deada0 0x55fa14dd2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66bce21080 1 --2- 172.21.15.55:0/1850439597 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa14dea710 0x55fa14de9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66bce21080 1 --2- 172.21.15.55:0/1850439597 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa14dd3540 0x55fa14d5bc70 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.935+0000 7f66bce21080 1 -- 172.21.15.55:0/1850439597 >> 172.21.15.55:0/1850439597 conn(0x55fa14d3fbf0 msgr2=0x55fa14d5b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:56.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66bce21080 1 -- 172.21.15.55:0/1850439597 shutdown_connections 2024-04-02T07:23:56.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66bce21080 1 -- 172.21.15.55:0/1850439597 wait complete. 2024-04-02T07:23:56.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66bce21080 1 Processor -- start 2024-04-02T07:23:56.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66bce21080 1 -- start start 2024-04-02T07:23:56.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66bce21080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa14dd3540 0x55fa14e846e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66bce21080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa14dea710 0x55fa14d11da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66bce21080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa14deada0 0x55fa14d122e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66bce21080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa14e81aa0 con 0x55fa14deada0 2024-04-02T07:23:56.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66bce21080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa14dd0060 con 0x55fa14dea710 2024-04-02T07:23:56.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66bce21080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa14dcf5e0 con 0x55fa14dd3540 2024-04-02T07:23:56.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66baa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa14deada0 0x55fa14d122e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66baa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa14deada0 0x55fa14d122e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51142/0 (socket says 172.21.15.55:51142) 2024-04-02T07:23:56.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66baa00640 1 -- 172.21.15.55:0/1297928790 learned_addr learned my addr 172.21.15.55:0/1297928790 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:56.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66ba000640 1 --2- 172.21.15.55:0/1297928790 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa14dd3540 0x55fa14e846e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66b9600640 1 --2- 172.21.15.55:0/1297928790 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa14dea710 0x55fa14d11da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66baa00640 1 -- 172.21.15.55:0/1297928790 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa14dd3540 msgr2=0x55fa14e846e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66baa00640 1 --2- 172.21.15.55:0/1297928790 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa14dd3540 0x55fa14e846e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66baa00640 1 -- 172.21.15.55:0/1297928790 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa14dea710 msgr2=0x55fa14d11da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66baa00640 1 --2- 172.21.15.55:0/1297928790 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa14dea710 0x55fa14d11da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66baa00640 1 -- 172.21.15.55:0/1297928790 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac009610 con 0x55fa14deada0 2024-04-02T07:23:56.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66baa00640 1 --2- 172.21.15.55:0/1297928790 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa14deada0 0x55fa14d122e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f66b400a190 tx=0x7f66b40182f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:56.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66b2a00640 1 -- 172.21.15.55:0/1297928790 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b40aae20 con 0x55fa14deada0 2024-04-02T07:23:56.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66b2a00640 1 -- 172.21.15.55:0/1297928790 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b40be470 con 0x55fa14deada0 2024-04-02T07:23:56.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66b2a00640 1 -- 172.21.15.55:0/1297928790 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b40be7e0 con 0x55fa14deada0 2024-04-02T07:23:56.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66bce21080 1 -- 172.21.15.55:0/1297928790 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b400a1c0 con 0x55fa14deada0 2024-04-02T07:23:56.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.939+0000 7f66bce21080 1 -- 172.21.15.55:0/1297928790 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa14c688c0 con 0x55fa14deada0 2024-04-02T07:23:56.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66b2a00640 1 -- 172.21.15.55:0/1297928790 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f66b40bb070 con 0x55fa14deada0 2024-04-02T07:23:56.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66b2a00640 1 --2- 172.21.15.55:0/1297928790 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f669c0650a0 0x7f669c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66b2a00640 1 -- 172.21.15.55:0/1297928790 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66b411de60 con 0x55fa14deada0 2024-04-02T07:23:56.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66ba000640 1 --2- 172.21.15.55:0/1297928790 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f669c0650a0 0x7f669c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66bce21080 1 --2- 172.21.15.55:0/1297928790 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55fa14e82e60 0x55fa14dce4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:56.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66bce21080 1 -- 172.21.15.55:0/1297928790 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:1 5.19 5:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55fa14dcea00 con 0x55fa14e82e60 2024-04-02T07:23:56.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66b9600640 1 --2- 172.21.15.55:0/1297928790 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55fa14e82e60 0x55fa14dce4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:56.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66b9600640 1 --2- 172.21.15.55:0/1297928790 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55fa14e82e60 0x55fa14dce4c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:56.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66ba000640 1 --2- 172.21.15.55:0/1297928790 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f669c0650a0 0x7f669c067560 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f66ac015040 tx=0x7f66ac011000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:56.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66b9600640 1 -- 172.21.15.55:0/1297928790 <== osd.1 v2:172.21.15.55:6809/27391 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (9) out=9b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+9 (crc 0 0 0) 0x7f66a8001940 con 0x55fa14e82e60 2024-04-02T07:23:56.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66bce21080 1 -- 172.21.15.55:0/1297928790 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55fa14e82e60 msgr2=0x55fa14dce4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66bce21080 1 --2- 172.21.15.55:0/1297928790 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55fa14e82e60 0x55fa14dce4c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66bce21080 1 -- 172.21.15.55:0/1297928790 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f669c0650a0 msgr2=0x7f669c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66bce21080 1 --2- 172.21.15.55:0/1297928790 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f669c0650a0 0x7f669c067560 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f66ac015040 tx=0x7f66ac011000 comp rx=0 tx=0).stop 2024-04-02T07:23:56.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66bce21080 1 -- 172.21.15.55:0/1297928790 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa14deada0 msgr2=0x55fa14d122e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:56.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66bce21080 1 --2- 172.21.15.55:0/1297928790 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa14deada0 0x55fa14d122e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f66b400a190 tx=0x7f66b40182f0 comp rx=0 tx=0).stop 2024-04-02T07:23:56.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66baa00640 1 -- 172.21.15.55:0/1297928790 reap_dead start 2024-04-02T07:23:56.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66bce21080 1 -- 172.21.15.55:0/1297928790 shutdown_connections 2024-04-02T07:23:56.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66bce21080 1 -- 172.21.15.55:0/1297928790 >> 172.21.15.55:0/1297928790 conn(0x55fa14d3fbf0 msgr2=0x55fa14d5b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:56.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66bce21080 1 -- 172.21.15.55:0/1297928790 shutdown_connections 2024-04-02T07:23:56.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.943+0000 7f66bce21080 1 -- 172.21.15.55:0/1297928790 wait complete. 2024-04-02T07:23:56.952 INFO:teuthology.orchestra.run.smithi055.stdout:mytag 2024-04-02T07:23:56.952 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-04-02T07:23:56.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.995+0000 7efc9e0e9080 1 Processor -- start 2024-04-02T07:23:56.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.995+0000 7efc9e0e9080 1 -- start start 2024-04-02T07:23:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.995+0000 7efc9e0e9080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c62c70a130 0x55c62c704ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.995+0000 7efc9e0e9080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c62c70a510 0x55c62c693ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.995+0000 7efc9e0e9080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c62c7216d0 0x55c62c694400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.995+0000 7efc9e0e9080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c62c592600 con 0x55c62c70a510 2024-04-02T07:23:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.995+0000 7efc9e0e9080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c62c589690 con 0x55c62c7216d0 2024-04-02T07:23:57.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.995+0000 7efc9e0e9080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c62c708d70 con 0x55c62c70a130 2024-04-02T07:23:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.995+0000 7efc9aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c62c70a510 0x55c62c693ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.995+0000 7efc9aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c62c70a510 0x55c62c693ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51160/0 (socket says 172.21.15.55:51160) 2024-04-02T07:23:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.995+0000 7efc9aa00640 1 -- 172.21.15.55:0/4288560261 learned_addr learned my addr 172.21.15.55:0/4288560261 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.995+0000 7efc9b400640 1 --2- 172.21.15.55:0/4288560261 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c62c70a130 0x55c62c704ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9be00640 1 --2- 172.21.15.55:0/4288560261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c62c7216d0 0x55c62c694400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9aa00640 1 -- 172.21.15.55:0/4288560261 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c62c70a130 msgr2=0x55c62c704ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9aa00640 1 --2- 172.21.15.55:0/4288560261 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c62c70a130 0x55c62c704ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9aa00640 1 -- 172.21.15.55:0/4288560261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c62c7216d0 msgr2=0x55c62c694400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9aa00640 1 --2- 172.21.15.55:0/4288560261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c62c7216d0 0x55c62c694400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9aa00640 1 -- 172.21.15.55:0/4288560261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc8c005d30 con 0x55c62c70a510 2024-04-02T07:23:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9aa00640 1 --2- 172.21.15.55:0/4288560261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c62c70a510 0x55c62c693ec0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efc8801c0f0 tx=0x7efc88003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ede1871cab5869e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc99600640 1 -- 172.21.15.55:0/4288560261 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc880a4ab0 con 0x55c62c70a510 2024-04-02T07:23:57.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc99600640 1 -- 172.21.15.55:0/4288560261 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc880a4c30 con 0x55c62c70a510 2024-04-02T07:23:57.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc99600640 1 -- 172.21.15.55:0/4288560261 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc880ac440 con 0x55c62c70a510 2024-04-02T07:23:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9e0e9080 1 -- 172.21.15.55:0/4288560261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c62c70a510 msgr2=0x55c62c693ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9e0e9080 1 --2- 172.21.15.55:0/4288560261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c62c70a510 0x55c62c693ec0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7efc8801c0f0 tx=0x7efc88003030 comp rx=0 tx=0).stop 2024-04-02T07:23:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9e0e9080 1 -- 172.21.15.55:0/4288560261 shutdown_connections 2024-04-02T07:23:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9e0e9080 1 --2- 172.21.15.55:0/4288560261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c62c7216d0 0x55c62c694400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9e0e9080 1 --2- 172.21.15.55:0/4288560261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c62c70a510 0x55c62c693ec0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9e0e9080 1 --2- 172.21.15.55:0/4288560261 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c62c70a130 0x55c62c704ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9e0e9080 1 -- 172.21.15.55:0/4288560261 >> 172.21.15.55:0/4288560261 conn(0x55c62c678bf0 msgr2=0x55c62c67afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9e0e9080 1 -- 172.21.15.55:0/4288560261 shutdown_connections 2024-04-02T07:23:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9e0e9080 1 -- 172.21.15.55:0/4288560261 wait complete. 2024-04-02T07:23:57.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9e0e9080 1 Processor -- start 2024-04-02T07:23:57.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9e0e9080 1 -- start start 2024-04-02T07:23:57.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9e0e9080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c62c70a130 0x55c62c702fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:57.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9e0e9080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c62c70a510 0x55c62c64aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:57.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9e0e9080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c62c7216d0 0x55c62c690c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:57.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9e0e9080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c62c64b600 con 0x55c62c70a510 2024-04-02T07:23:57.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9e0e9080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c62c64b8a0 con 0x55c62c70a130 2024-04-02T07:23:57.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9e0e9080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c62c64bb40 con 0x55c62c7216d0 2024-04-02T07:23:57.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c62c70a510 0x55c62c64aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:57.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c62c70a510 0x55c62c64aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51164/0 (socket says 172.21.15.55:51164) 2024-04-02T07:23:57.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9aa00640 1 -- 172.21.15.55:0/1548074183 learned_addr learned my addr 172.21.15.55:0/1548074183 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:57.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9b400640 1 --2- 172.21.15.55:0/1548074183 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c62c70a130 0x55c62c702fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:57.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9be00640 1 --2- 172.21.15.55:0/1548074183 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c62c7216d0 0x55c62c690c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:57.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9aa00640 1 -- 172.21.15.55:0/1548074183 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c62c7216d0 msgr2=0x55c62c690c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:57.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9aa00640 1 --2- 172.21.15.55:0/1548074183 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c62c7216d0 0x55c62c690c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9aa00640 1 -- 172.21.15.55:0/1548074183 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c62c70a130 msgr2=0x55c62c702fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:57.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9aa00640 1 --2- 172.21.15.55:0/1548074183 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c62c70a130 0x55c62c702fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:56.999+0000 7efc9aa00640 1 -- 172.21.15.55:0/1548074183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c62c594970 con 0x55c62c70a510 2024-04-02T07:23:57.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.003+0000 7efc9aa00640 1 --2- 172.21.15.55:0/1548074183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c62c70a510 0x55c62c64aaf0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efc8801bd30 tx=0x7efc880185f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:57.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.003+0000 7efc93e00640 1 -- 172.21.15.55:0/1548074183 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc880c7640 con 0x55c62c70a510 2024-04-02T07:23:57.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.003+0000 7efc93e00640 1 -- 172.21.15.55:0/1548074183 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc880c77a0 con 0x55c62c70a510 2024-04-02T07:23:57.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.003+0000 7efc93e00640 1 -- 172.21.15.55:0/1548074183 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc880c7b50 con 0x55c62c70a510 2024-04-02T07:23:57.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.003+0000 7efc9e0e9080 1 -- 172.21.15.55:0/1548074183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc88005df0 con 0x55c62c70a510 2024-04-02T07:23:57.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.003+0000 7efc9e0e9080 1 -- 172.21.15.55:0/1548074183 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c62c5bba60 con 0x55c62c70a510 2024-04-02T07:23:57.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.003+0000 7efc93e00640 1 -- 172.21.15.55:0/1548074183 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7efc880b3070 con 0x55c62c70a510 2024-04-02T07:23:57.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.003+0000 7efc93e00640 1 --2- 172.21.15.55:0/1548074183 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efc7c065070 0x7efc7c067530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.003+0000 7efc93e00640 1 -- 172.21.15.55:0/1548074183 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efc8811f650 con 0x55c62c70a510 2024-04-02T07:23:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.003+0000 7efc9b400640 1 --2- 172.21.15.55:0/1548074183 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efc7c065070 0x7efc7c067530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.003+0000 7efc9e0e9080 1 --2- 172.21.15.55:0/1548074183 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55c62c703500 0x55c62c7bb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.003+0000 7efc9e0e9080 1 -- 172.21.15.55:0/1548074183 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:1 5.12 5:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e34) v8 -- 0x55c62c7bba40 con 0x55c62c703500 2024-04-02T07:23:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.003+0000 7efc9be00640 1 --2- 172.21.15.55:0/1548074183 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55c62c703500 0x55c62c7bb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.007+0000 7efc9b400640 1 --2- 172.21.15.55:0/1548074183 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efc7c065070 0x7efc7c067530 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0055e0 tx=0x7efc8c00c040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.007+0000 7efc9be00640 1 --2- 172.21.15.55:0/1548074183 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55c62c703500 0x55c62c7bb500 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.007+0000 7efc9be00640 1 -- 172.21.15.55:0/1548074183 <== osd.1 v2:172.21.15.55:6809/27391 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7efc9400da30 con 0x55c62c703500 2024-04-02T07:23:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:error getting xattr cephfs_data/10000000002.00000000/scrub_tag: (61) No data available 2024-04-02T07:23:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.007+0000 7efc9e0e9080 1 -- 172.21.15.55:0/1548074183 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55c62c703500 msgr2=0x55c62c7bb500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.007+0000 7efc9e0e9080 1 --2- 172.21.15.55:0/1548074183 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55c62c703500 0x55c62c7bb500 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.007+0000 7efc9e0e9080 1 -- 172.21.15.55:0/1548074183 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efc7c065070 msgr2=0x7efc7c067530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.007+0000 7efc9e0e9080 1 --2- 172.21.15.55:0/1548074183 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efc7c065070 0x7efc7c067530 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efc8c0055e0 tx=0x7efc8c00c040 comp rx=0 tx=0).stop 2024-04-02T07:23:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.007+0000 7efc9e0e9080 1 -- 172.21.15.55:0/1548074183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c62c70a510 msgr2=0x55c62c64aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:57.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.007+0000 7efc9e0e9080 1 --2- 172.21.15.55:0/1548074183 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c62c70a510 0x55c62c64aaf0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7efc8801bd30 tx=0x7efc880185f0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.007+0000 7efc9be00640 1 -- 172.21.15.55:0/1548074183 reap_dead start 2024-04-02T07:23:57.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.007+0000 7efc9e0e9080 1 -- 172.21.15.55:0/1548074183 shutdown_connections 2024-04-02T07:23:57.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.007+0000 7efc9e0e9080 1 -- 172.21.15.55:0/1548074183 >> 172.21.15.55:0/1548074183 conn(0x55c62c678bf0 msgr2=0x55c62c708ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:57.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.007+0000 7efc9e0e9080 1 -- 172.21.15.55:0/1548074183 shutdown_connections 2024-04-02T07:23:57.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.007+0000 7efc9e0e9080 1 -- 172.21.15.55:0/1548074183 wait complete. 2024-04-02T07:23:57.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:23:57.013 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-02T07:23:57.014 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:23:57.138 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:23:57.232 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-02T07:23:57.233 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:23:57.233 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:23:57.242 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:23:57.242 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:23:57.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:57.242 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-02T07:23:57.291 INFO:teuthology.orchestra.run.smithi055.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-02T07:23:57.291 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:23:57.292 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:23:57.292 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:23:57.301 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:23:57.301 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:23:57.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:57.301 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-02T07:23:57.350 INFO:teuthology.orchestra.run.smithi106.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-04-02T07:23:57.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:23:57.352 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:23:57.352 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:23:57.361 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:23:57.361 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:23:57.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:57.361 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-02T07:23:57.411 INFO:teuthology.orchestra.run.smithi055.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-04-02T07:23:57.412 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:23:57.412 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:23:57.412 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:23:57.421 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:23:57.421 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:23:57.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:23:57.422 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-02T07:23:57.473 INFO:teuthology.orchestra.run.smithi106.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-04-02T07:23:57.474 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:23:57.475 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:23:57.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.611+0000 7f40d5400640 1 Processor -- start 2024-04-02T07:23:57.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.615+0000 7f40d5400640 1 -- start start 2024-04-02T07:23:57.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.615+0000 7f40d5400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f40d015eaf0 0x7f40d015b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:57.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.615+0000 7f40d5400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40d00b0700 0x7f40d0143400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:57.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.615+0000 7f40d5400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40d006c5f0 con 0x7f40d015b910 2024-04-02T07:23:57.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.615+0000 7f40d5400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40d006d270 con 0x7f40d015eaf0 2024-04-02T07:23:57.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.615+0000 7f40d5400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d00710f0 con 0x7f40d00b0700 2024-04-02T07:23:57.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.615+0000 7f40cfe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f40d015eaf0 0x7f40d015b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:57.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.615+0000 7f40c7400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f40d015b910 0x7f40d00afff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50078/0 (socket says 172.21.15.55:50078) 2024-04-02T07:23:57.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.615+0000 7f40c7400640 1 -- 172.21.15.55:0/1242237904 learned_addr learned my addr 172.21.15.55:0/1242237904 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:57.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.615+0000 7f40d4a00640 1 --2- 172.21.15.55:0/1242237904 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40d00b0700 0x7f40d0143400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:57.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.615+0000 7f40cfe00640 1 -- 172.21.15.55:0/1242237904 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40d00b0700 msgr2=0x7f40d0143400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:57.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.615+0000 7f40cfe00640 1 --2- 172.21.15.55:0/1242237904 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40d00b0700 0x7f40d0143400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.615+0000 7f40cfe00640 1 -- 172.21.15.55:0/1242237904 >> v1:172.21.15.55:6789/0 conn(0x7f40d015b910 legacy=0x7f40d00afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:57.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.615+0000 7f40cfe00640 1 -- 172.21.15.55:0/1242237904 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d006c8d0 con 0x7f40d015eaf0 2024-04-02T07:23:57.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.615+0000 7f40cf400640 1 -- 172.21.15.55:0/1242237904 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4093978425 0 0) 0x7f40d006c5f0 con 0x7f40d015b910 2024-04-02T07:23:57.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.619+0000 7f40cfe00640 1 --2- 172.21.15.55:0/1242237904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40d015eaf0 0x7f40d015b3d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f40c00097c0 tx=0x7f40c001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b63592501577a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:57.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.619+0000 7f40cf400640 1 -- 172.21.15.55:0/1242237904 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c00ab670 con 0x7f40d015eaf0 2024-04-02T07:23:57.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.619+0000 7f40cf400640 1 -- 172.21.15.55:0/1242237904 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c00ab7d0 con 0x7f40d015eaf0 2024-04-02T07:23:57.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.619+0000 7f40cf400640 1 -- 172.21.15.55:0/1242237904 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c00abb60 con 0x7f40d015eaf0 2024-04-02T07:23:57.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.619+0000 7f40d5400640 1 -- 172.21.15.55:0/1242237904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40d015eaf0 msgr2=0x7f40d015b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:57.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.619+0000 7f40d5400640 1 --2- 172.21.15.55:0/1242237904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40d015eaf0 0x7f40d015b3d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f40c00097c0 tx=0x7f40c001c470 comp rx=0 tx=0).stop 2024-04-02T07:23:57.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.619+0000 7f40d5400640 1 -- 172.21.15.55:0/1242237904 shutdown_connections 2024-04-02T07:23:57.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.619+0000 7f40d5400640 1 --2- 172.21.15.55:0/1242237904 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40d00b0700 0x7f40d0143400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.619+0000 7f40d5400640 1 --2- 172.21.15.55:0/1242237904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40d015eaf0 0x7f40d015b3d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.619+0000 7f40d5400640 1 -- 172.21.15.55:0/1242237904 >> 172.21.15.55:0/1242237904 conn(0x7f40d0066080 msgr2=0x7f40d0069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:57.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.619+0000 7f40d5400640 1 -- 172.21.15.55:0/1242237904 shutdown_connections 2024-04-02T07:23:57.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.619+0000 7f40d5400640 1 -- 172.21.15.55:0/1242237904 wait complete. 2024-04-02T07:23:57.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.619+0000 7f40d5400640 1 Processor -- start 2024-04-02T07:23:57.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.619+0000 7f40d5400640 1 -- start start 2024-04-02T07:23:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40d5400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40d00b0700 0x7f40d01552e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40d5400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40d015b910 0x7f40d0142660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40d5400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40d015eaf0 0x7f40d0154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40d5400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d0154660 con 0x7f40d015eaf0 2024-04-02T07:23:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40d5400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40d013f3c0 con 0x7f40d00b0700 2024-04-02T07:23:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40d5400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40d01558c0 con 0x7f40d015b910 2024-04-02T07:23:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40d4a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40d015eaf0 0x7f40d0154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40d4a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40d015eaf0 0x7f40d0154120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51180/0 (socket says 172.21.15.55:51180) 2024-04-02T07:23:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40d4a00640 1 -- 172.21.15.55:0/822795931 learned_addr learned my addr 172.21.15.55:0/822795931 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40cfe00640 1 --2- 172.21.15.55:0/822795931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40d00b0700 0x7f40d01552e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40c7400640 1 --2- 172.21.15.55:0/822795931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40d015b910 0x7f40d0142660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40d4a00640 1 -- 172.21.15.55:0/822795931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40d015b910 msgr2=0x7f40d0142660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:57.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40d4a00640 1 --2- 172.21.15.55:0/822795931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40d015b910 0x7f40d0142660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40d4a00640 1 -- 172.21.15.55:0/822795931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40d00b0700 msgr2=0x7f40d01552e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:57.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40d4a00640 1 --2- 172.21.15.55:0/822795931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40d00b0700 0x7f40d01552e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40d4a00640 1 -- 172.21.15.55:0/822795931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40c0009420 con 0x7f40d015eaf0 2024-04-02T07:23:57.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40d4a00640 1 --2- 172.21.15.55:0/822795931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40d015eaf0 0x7f40d0154120 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f40c8007de0 tx=0x7f40c800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:57.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40ccc00640 1 -- 172.21.15.55:0/822795931 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c8014620 con 0x7f40d015eaf0 2024-04-02T07:23:57.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40ccc00640 1 -- 172.21.15.55:0/822795931 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40c800ee90 con 0x7f40d015eaf0 2024-04-02T07:23:57.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40d5400640 1 -- 172.21.15.55:0/822795931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40d0157cb0 con 0x7f40d015eaf0 2024-04-02T07:23:57.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40ccc00640 1 -- 172.21.15.55:0/822795931 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40c80149e0 con 0x7f40d015eaf0 2024-04-02T07:23:57.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40d5400640 1 -- 172.21.15.55:0/822795931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40d0158270 con 0x7f40d015eaf0 2024-04-02T07:23:57.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40d5400640 1 -- 172.21.15.55:0/822795931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40d00adfb0 con 0x7f40d015eaf0 2024-04-02T07:23:57.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.623+0000 7f40ccc00640 1 -- 172.21.15.55:0/822795931 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f40c8014b40 con 0x7f40d015eaf0 2024-04-02T07:23:57.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.627+0000 7f40ccc00640 1 --2- 172.21.15.55:0/822795931 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f40ac066690 0x7f40ac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:57.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.627+0000 7f40ccc00640 1 -- 172.21.15.55:0/822795931 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40c8084aa0 con 0x7f40d015eaf0 2024-04-02T07:23:57.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.627+0000 7f40cfe00640 1 --2- 172.21.15.55:0/822795931 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f40ac066690 0x7f40ac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:57.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.627+0000 7f40cfe00640 1 --2- 172.21.15.55:0/822795931 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f40ac066690 0x7f40ac068b50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f40c00af000 tx=0x7f40c00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:57.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.631+0000 7f40ccc00640 1 -- 172.21.15.55:0/822795931 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f40c8051eb0 con 0x7f40d015eaf0 2024-04-02T07:23:57.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.827+0000 7f40d5400640 1 -- 172.21.15.55:0/822795931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40d00738f0 con 0x7f40d015eaf0 2024-04-02T07:23:57.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.827+0000 7f40ccc00640 1 -- 172.21.15.55:0/822795931 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4725 (secure 0 0 0) 0x7f40c80554d0 con 0x7f40d015eaf0 2024-04-02T07:23:57.831 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:57.831 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4883,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53106343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53106343},{"type":"v1","addr":"172.21.15.55:6833","nonce":53106343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/44669622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":44669622},{"type":"v1","addr":"172.21.15.106:6837","nonce":44669622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/741637637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":741637637},{"type":"v1","addr":"172.21.15.106:6836","nonce":741637637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:23:25.727369+0000","modified":"2024-04-02T07:23:29.049370+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/2440784960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2440784960},{"type":"v1","addr":"172.21.15.55:6835","nonce":2440784960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-02T07:23:57.832 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 17 2024-04-02T07:23:57.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.831+0000 7f40d5400640 1 -- 172.21.15.55:0/822795931 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f40ac066690 msgr2=0x7f40ac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:57.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.831+0000 7f40d5400640 1 --2- 172.21.15.55:0/822795931 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f40ac066690 0x7f40ac068b50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f40c00af000 tx=0x7f40c00a7000 comp rx=0 tx=0).stop 2024-04-02T07:23:57.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.831+0000 7f40d5400640 1 -- 172.21.15.55:0/822795931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40d015eaf0 msgr2=0x7f40d0154120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:57.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.831+0000 7f40d5400640 1 --2- 172.21.15.55:0/822795931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40d015eaf0 0x7f40d0154120 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f40c8007de0 tx=0x7f40c800e4b0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.831+0000 7f40d5400640 1 -- 172.21.15.55:0/822795931 shutdown_connections 2024-04-02T07:23:57.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.831+0000 7f40d5400640 1 --2- 172.21.15.55:0/822795931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40d015eaf0 0x7f40d0154120 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.831+0000 7f40d5400640 1 --2- 172.21.15.55:0/822795931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40d015b910 0x7f40d0142660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.831+0000 7f40d5400640 1 --2- 172.21.15.55:0/822795931 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f40ac066690 0x7f40ac068b50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.831+0000 7f40d5400640 1 --2- 172.21.15.55:0/822795931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40d00b0700 0x7f40d01552e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.831+0000 7f40d5400640 1 -- 172.21.15.55:0/822795931 >> 172.21.15.55:0/822795931 conn(0x7f40d0066080 msgr2=0x7f40d0142e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:57.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.831+0000 7f40d5400640 1 -- 172.21.15.55:0/822795931 shutdown_connections 2024-04-02T07:23:57.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.831+0000 7f40d5400640 1 -- 172.21.15.55:0/822795931 wait complete. 2024-04-02T07:23:57.853 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:23:57.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.991+0000 7f25a7e00640 1 Processor -- start 2024-04-02T07:23:57.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.991+0000 7f25a7e00640 1 -- start start 2024-04-02T07:23:57.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.991+0000 7f25a7e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25a0146fa0 0x7f25a014a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:57.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.991+0000 7f25a7e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f25a00b0390 0x7f25a00b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:57.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.991+0000 7f25a7e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25a00ce340 con 0x7f25a0147a00 2024-04-02T07:23:57.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.991+0000 7f25a7e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25a0164be0 con 0x7f25a00b0390 2024-04-02T07:23:57.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.991+0000 7f25a7e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a0164ec0 con 0x7f25a0146fa0 2024-04-02T07:23:57.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.991+0000 7f25a5e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f25a00b0390 0x7f25a00b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:57.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.991+0000 7f25a5400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25a0146fa0 0x7f25a014a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:57.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.991+0000 7f25a5e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f25a00b0390 0x7f25a00b19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:44050/0 (socket says 172.21.15.55:44050) 2024-04-02T07:23:57.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.991+0000 7f25a5400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25a0146fa0 0x7f25a014a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:58482/0 (socket says 172.21.15.55:58482) 2024-04-02T07:23:57.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.991+0000 7f25a5e00640 1 -- 172.21.15.55:0/2149961502 learned_addr learned my addr 172.21.15.55:0/2149961502 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:57.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.991+0000 7f25a5e00640 1 -- 172.21.15.55:0/2149961502 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25a0146fa0 msgr2=0x7f25a014a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:57.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.991+0000 7f25a5e00640 1 --2- 172.21.15.55:0/2149961502 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25a0146fa0 0x7f25a014a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.991+0000 7f25a5e00640 1 -- 172.21.15.55:0/2149961502 >> v1:172.21.15.106:6789/0 conn(0x7f25a0147a00 legacy=0x7f25a00afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:57.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.991+0000 7f25a5e00640 1 -- 172.21.15.55:0/2149961502 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a01651a0 con 0x7f25a00b0390 2024-04-02T07:23:57.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.995+0000 7f25a5e00640 1 --2- 172.21.15.55:0/2149961502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25a00b0390 0x7f25a00b19b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2598009e50 tx=0x7f259801ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=974ee18a9a397848 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:57.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.995+0000 7f259fe00640 1 -- 172.21.15.55:0/2149961502 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25980a58b0 con 0x7f25a00b0390 2024-04-02T07:23:57.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.995+0000 7f259fe00640 1 -- 172.21.15.55:0/2149961502 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25980a5a10 con 0x7f25a00b0390 2024-04-02T07:23:57.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.995+0000 7f259fe00640 1 -- 172.21.15.55:0/2149961502 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25980a5da0 con 0x7f25a00b0390 2024-04-02T07:23:57.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.995+0000 7f25a7e00640 1 -- 172.21.15.55:0/2149961502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25a00b0390 msgr2=0x7f25a00b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:57.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.995+0000 7f25a7e00640 1 --2- 172.21.15.55:0/2149961502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25a00b0390 0x7f25a00b19b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2598009e50 tx=0x7f259801ca00 comp rx=0 tx=0).stop 2024-04-02T07:23:57.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.995+0000 7f25a7e00640 1 -- 172.21.15.55:0/2149961502 shutdown_connections 2024-04-02T07:23:57.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.995+0000 7f25a7e00640 1 --2- 172.21.15.55:0/2149961502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25a00b0390 0x7f25a00b19b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.995+0000 7f25a7e00640 1 --2- 172.21.15.55:0/2149961502 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25a0146fa0 0x7f25a014a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:57.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.995+0000 7f25a7e00640 1 -- 172.21.15.55:0/2149961502 >> 172.21.15.55:0/2149961502 conn(0x7f25a0066080 msgr2=0x7f25a0069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:57.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.995+0000 7f25a7e00640 1 -- 172.21.15.55:0/2149961502 shutdown_connections 2024-04-02T07:23:57.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.995+0000 7f25a7e00640 1 -- 172.21.15.55:0/2149961502 wait complete. 2024-04-02T07:23:58.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a7e00640 1 Processor -- start 2024-04-02T07:23:58.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a7e00640 1 -- start start 2024-04-02T07:23:58.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a7e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25a00b0390 0x7f25a01353a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:58.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a7e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25a0146fa0 0x7f25a00b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:58.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25a0147a00 0x7f25a00b3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:58.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a7e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a013c2b0 con 0x7f25a0147a00 2024-04-02T07:23:58.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a7e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25a013cfa0 con 0x7f25a00b0390 2024-04-02T07:23:58.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a7e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a013b6a0 con 0x7f25a0146fa0 2024-04-02T07:23:58.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a5400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25a00b0390 0x7f25a01353a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:58.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a4a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25a0146fa0 0x7f25a00b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:58.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a5e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25a0147a00 0x7f25a00b3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:58.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a5400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25a00b0390 0x7f25a01353a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:44052/0 (socket says 172.21.15.55:44052) 2024-04-02T07:23:58.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a5400640 1 -- 172.21.15.55:0/2488528987 learned_addr learned my addr 172.21.15.55:0/2488528987 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:58.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a5400640 1 -- 172.21.15.55:0/2488528987 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25a0146fa0 msgr2=0x7f25a00b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:58.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a5400640 1 --2- 172.21.15.55:0/2488528987 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25a0146fa0 0x7f25a00b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a5400640 1 -- 172.21.15.55:0/2488528987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25a0147a00 msgr2=0x7f25a00b3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:58.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a5400640 1 --2- 172.21.15.55:0/2488528987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25a0147a00 0x7f25a00b3230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a5400640 1 -- 172.21.15.55:0/2488528987 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2598009b30 con 0x7f25a00b0390 2024-04-02T07:23:58.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a5e00640 1 --2- 172.21.15.55:0/2488528987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25a0147a00 0x7f25a00b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:23:58.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a5400640 1 --2- 172.21.15.55:0/2488528987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25a00b0390 0x7f25a01353a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f259400e930 tx=0x7f259400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:58.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f259d600640 1 -- 172.21.15.55:0/2488528987 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2594009690 con 0x7f25a00b0390 2024-04-02T07:23:58.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f259d600640 1 -- 172.21.15.55:0/2488528987 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f259400ca00 con 0x7f25a00b0390 2024-04-02T07:23:58.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f259d600640 1 -- 172.21.15.55:0/2488528987 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f259400cd70 con 0x7f25a00b0390 2024-04-02T07:23:58.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a7e00640 1 -- 172.21.15.55:0/2488528987 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25a013b980 con 0x7f25a00b0390 2024-04-02T07:23:58.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:57.999+0000 7f25a7e00640 1 -- 172.21.15.55:0/2488528987 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a013bf40 con 0x7f25a00b0390 2024-04-02T07:23:58.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.003+0000 7f25a7e00640 1 -- 172.21.15.55:0/2488528987 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25a0066c90 con 0x7f25a00b0390 2024-04-02T07:23:58.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.003+0000 7f259d600640 1 -- 172.21.15.55:0/2488528987 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2594013470 con 0x7f25a00b0390 2024-04-02T07:23:58.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.003+0000 7f259d600640 1 --2- 172.21.15.55:0/2488528987 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25800666c0 0x7f2580068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:58.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.003+0000 7f259d600640 1 -- 172.21.15.55:0/2488528987 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2594084b60 con 0x7f25a00b0390 2024-04-02T07:23:58.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.003+0000 7f25a4a00640 1 --2- 172.21.15.55:0/2488528987 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25800666c0 0x7f2580068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:58.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.003+0000 7f25a4a00640 1 --2- 172.21.15.55:0/2488528987 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25800666c0 0x7f2580068b80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f25a01fc780 tx=0x7f258c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:58.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.007+0000 7f259d600640 1 -- 172.21.15.55:0/2488528987 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2594052020 con 0x7f25a00b0390 2024-04-02T07:23:58.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.171+0000 7f25a7e00640 1 -- 172.21.15.55:0/2488528987 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25a0148860 con 0x7f25a00b0390 2024-04-02T07:23:58.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.175+0000 7f259d600640 1 -- 172.21.15.55:0/2488528987 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16101 (secure 0 0 0) 0x7f2594017090 con 0x7f25a00b0390 2024-04-02T07:23:58.178 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:58.178 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":34,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:23:26.730146+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:23:23.729158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-02T07:23:24.740958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:23:58.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.179+0000 7f25a7e00640 1 -- 172.21.15.55:0/2488528987 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25800666c0 msgr2=0x7f2580068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:58.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.179+0000 7f25a7e00640 1 --2- 172.21.15.55:0/2488528987 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25800666c0 0x7f2580068b80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f25a01fc780 tx=0x7f258c009040 comp rx=0 tx=0).stop 2024-04-02T07:23:58.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.179+0000 7f25a7e00640 1 -- 172.21.15.55:0/2488528987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25a00b0390 msgr2=0x7f25a01353a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:58.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.179+0000 7f25a7e00640 1 --2- 172.21.15.55:0/2488528987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25a00b0390 0x7f25a01353a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f259400e930 tx=0x7f259400edf0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.179+0000 7f25a7e00640 1 -- 172.21.15.55:0/2488528987 shutdown_connections 2024-04-02T07:23:58.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.179+0000 7f25a7e00640 1 --2- 172.21.15.55:0/2488528987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25a0147a00 0x7f25a00b3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.179+0000 7f25a7e00640 1 --2- 172.21.15.55:0/2488528987 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25a0146fa0 0x7f25a00b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.179+0000 7f25a7e00640 1 --2- 172.21.15.55:0/2488528987 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25800666c0 0x7f2580068b80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.179+0000 7f25a7e00640 1 --2- 172.21.15.55:0/2488528987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25a00b0390 0x7f25a01353a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.179+0000 7f25a7e00640 1 -- 172.21.15.55:0/2488528987 >> 172.21.15.55:0/2488528987 conn(0x7f25a0066080 msgr2=0x7f25a0145240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:58.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.179+0000 7f25a7e00640 1 -- 172.21.15.55:0/2488528987 shutdown_connections 2024-04-02T07:23:58.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.179+0000 7f25a7e00640 1 -- 172.21.15.55:0/2488528987 wait complete. 2024-04-02T07:23:58.199 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:23:23.729158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:23:24.740958+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:23:58.200 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:23:58.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.339+0000 7fcf42000640 1 Processor -- start 2024-04-02T07:23:58.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.339+0000 7fcf42000640 1 -- start start 2024-04-02T07:23:58.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.339+0000 7fcf42000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcf3c157000 0x7fcf3c071a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:58.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.343+0000 7fcf42000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcf3c071f60 0x7fcf3c069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:58.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.343+0000 7fcf42000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf3c15de90 con 0x7fcf3c06a2d0 2024-04-02T07:23:58.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.343+0000 7fcf42000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c15d070 con 0x7fcf3c157000 2024-04-02T07:23:58.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.343+0000 7fcf42000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf3c0723e0 con 0x7fcf3c071f60 2024-04-02T07:23:58.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.343+0000 7fcf3b400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcf3c157000 0x7fcf3c071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:58.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.343+0000 7fcf3b400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcf3c157000 0x7fcf3c071a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51200/0 (socket says 172.21.15.55:51200) 2024-04-02T07:23:58.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.343+0000 7fcf3b400640 1 -- 172.21.15.55:0/1839847410 learned_addr learned my addr 172.21.15.55:0/1839847410 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:58.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.343+0000 7fcf3b400640 1 -- 172.21.15.55:0/1839847410 >> v2:172.21.15.106:3300/0 conn(0x7fcf3c071f60 msgr2=0x7fcf3c069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:58.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.343+0000 7fcf3aa00640 1 --2- 172.21.15.55:0/1839847410 >> v2:172.21.15.106:3300/0 conn(0x7fcf3c071f60 0x7fcf3c069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:58.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.343+0000 7fcf3b400640 1 --2- 172.21.15.55:0/1839847410 >> v2:172.21.15.106:3300/0 conn(0x7fcf3c071f60 0x7fcf3c069d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.343+0000 7fcf3b400640 1 -- 172.21.15.55:0/1839847410 >> v1:172.21.15.106:6789/0 conn(0x7fcf3c06a2d0 legacy=0x7fcf3c0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:58.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.343+0000 7fcf3b400640 1 -- 172.21.15.55:0/1839847410 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c15d280 con 0x7fcf3c157000 2024-04-02T07:23:58.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.343+0000 7fcf3aa00640 1 --2- 172.21.15.55:0/1839847410 >> v2:172.21.15.106:3300/0 conn(0x7fcf3c071f60 0x7fcf3c069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:23:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.343+0000 7fcf3b400640 1 --2- 172.21.15.55:0/1839847410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c157000 0x7fcf3c071a20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0736c0 tx=0x7fcf2c01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f476ee2b864a8c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.343+0000 7fcf3a000640 1 -- 172.21.15.55:0/1839847410 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0ac630 con 0x7fcf3c157000 2024-04-02T07:23:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.343+0000 7fcf3a000640 1 -- 172.21.15.55:0/1839847410 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2c0ac790 con 0x7fcf3c157000 2024-04-02T07:23:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.343+0000 7fcf3a000640 1 -- 172.21.15.55:0/1839847410 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2c0acb20 con 0x7fcf3c157000 2024-04-02T07:23:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf42000640 1 -- 172.21.15.55:0/1839847410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c157000 msgr2=0x7fcf3c071a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf42000640 1 --2- 172.21.15.55:0/1839847410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c157000 0x7fcf3c071a20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c0736c0 tx=0x7fcf2c01c4b0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf42000640 1 -- 172.21.15.55:0/1839847410 shutdown_connections 2024-04-02T07:23:58.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf42000640 1 --2- 172.21.15.55:0/1839847410 >> v2:172.21.15.106:3300/0 conn(0x7fcf3c071f60 0x7fcf3c069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf42000640 1 --2- 172.21.15.55:0/1839847410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c157000 0x7fcf3c071a20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf42000640 1 -- 172.21.15.55:0/1839847410 >> 172.21.15.55:0/1839847410 conn(0x7fcf3c0b13b0 msgr2=0x7fcf3c0b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf42000640 1 -- 172.21.15.55:0/1839847410 shutdown_connections 2024-04-02T07:23:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf42000640 1 -- 172.21.15.55:0/1839847410 wait complete. 2024-04-02T07:23:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf42000640 1 Processor -- start 2024-04-02T07:23:58.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf42000640 1 -- start start 2024-04-02T07:23:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf42000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3c06a2d0 0x7fcf3c0cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf42000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf3c071f60 0x7fcf3c144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf42000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c157000 0x7fcf3c153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf42000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c0cd180 con 0x7fcf3c157000 2024-04-02T07:23:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf42000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c0cd460 con 0x7fcf3c06a2d0 2024-04-02T07:23:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf42000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf3c0cd740 con 0x7fcf3c071f60 2024-04-02T07:23:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf3be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c157000 0x7fcf3c153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf3be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c157000 0x7fcf3c153060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51210/0 (socket says 172.21.15.55:51210) 2024-04-02T07:23:58.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf3be00640 1 -- 172.21.15.55:0/2576718835 learned_addr learned my addr 172.21.15.55:0/2576718835 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf3b400640 1 --2- 172.21.15.55:0/2576718835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3c06a2d0 0x7fcf3c0cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf3aa00640 1 --2- 172.21.15.55:0/2576718835 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf3c071f60 0x7fcf3c144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf3be00640 1 -- 172.21.15.55:0/2576718835 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf3c071f60 msgr2=0x7fcf3c144ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf3be00640 1 --2- 172.21.15.55:0/2576718835 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf3c071f60 0x7fcf3c144ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf3be00640 1 -- 172.21.15.55:0/2576718835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3c06a2d0 msgr2=0x7fcf3c0cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf3be00640 1 --2- 172.21.15.55:0/2576718835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3c06a2d0 0x7fcf3c0cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.347+0000 7fcf3be00640 1 -- 172.21.15.55:0/2576718835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c0094d0 con 0x7fcf3c157000 2024-04-02T07:23:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.351+0000 7fcf3be00640 1 --2- 172.21.15.55:0/2576718835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c157000 0x7fcf3c153060 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400b970 tx=0x7fcf3400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.351+0000 7fcf33400640 1 -- 172.21.15.55:0/2576718835 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3400cb40 con 0x7fcf3c157000 2024-04-02T07:23:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.351+0000 7fcf33400640 1 -- 172.21.15.55:0/2576718835 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3400cca0 con 0x7fcf3c157000 2024-04-02T07:23:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.351+0000 7fcf42000640 1 -- 172.21.15.55:0/2576718835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3c0cda20 con 0x7fcf3c157000 2024-04-02T07:23:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.351+0000 7fcf33400640 1 -- 172.21.15.55:0/2576718835 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf34014680 con 0x7fcf3c157000 2024-04-02T07:23:58.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.351+0000 7fcf42000640 1 -- 172.21.15.55:0/2576718835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf3c0c8ca0 con 0x7fcf3c157000 2024-04-02T07:23:58.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.351+0000 7fcf42000640 1 -- 172.21.15.55:0/2576718835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf3c0cdf40 con 0x7fcf3c157000 2024-04-02T07:23:58.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.351+0000 7fcf33400640 1 -- 172.21.15.55:0/2576718835 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fcf3401d3b0 con 0x7fcf3c157000 2024-04-02T07:23:58.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.351+0000 7fcf33400640 1 --2- 172.21.15.55:0/2576718835 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf1c066690 0x7fcf1c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:58.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.351+0000 7fcf33400640 1 -- 172.21.15.55:0/2576718835 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf34083ff0 con 0x7fcf3c157000 2024-04-02T07:23:58.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.351+0000 7fcf3b400640 1 --2- 172.21.15.55:0/2576718835 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf1c066690 0x7fcf1c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:58.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.355+0000 7fcf3b400640 1 --2- 172.21.15.55:0/2576718835 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf1c066690 0x7fcf1c068b50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c0ae000 tx=0x7fcf2c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:58.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.355+0000 7fcf33400640 1 -- 172.21.15.55:0/2576718835 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fcf340b5980 con 0x7fcf3c157000 2024-04-02T07:23:58.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.519+0000 7fcf42000640 1 -- 172.21.15.55:0/2576718835 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcf3c066c90 con 0x7fcf3c157000 2024-04-02T07:23:58.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.519+0000 7fcf33400640 1 -- 172.21.15.55:0/2576718835 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v34) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcf34019020 con 0x7fcf3c157000 2024-04-02T07:23:58.521 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:23:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.519+0000 7fcf42000640 1 -- 172.21.15.55:0/2576718835 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf1c066690 msgr2=0x7fcf1c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.519+0000 7fcf42000640 1 --2- 172.21.15.55:0/2576718835 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf1c066690 0x7fcf1c068b50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c0ae000 tx=0x7fcf2c0a7000 comp rx=0 tx=0).stop 2024-04-02T07:23:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.519+0000 7fcf42000640 1 -- 172.21.15.55:0/2576718835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c157000 msgr2=0x7fcf3c153060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.519+0000 7fcf42000640 1 --2- 172.21.15.55:0/2576718835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c157000 0x7fcf3c153060 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400b970 tx=0x7fcf3400be30 comp rx=0 tx=0).stop 2024-04-02T07:23:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.519+0000 7fcf42000640 1 -- 172.21.15.55:0/2576718835 shutdown_connections 2024-04-02T07:23:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.519+0000 7fcf42000640 1 --2- 172.21.15.55:0/2576718835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf3c157000 0x7fcf3c153060 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.519+0000 7fcf42000640 1 --2- 172.21.15.55:0/2576718835 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf3c071f60 0x7fcf3c144ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.519+0000 7fcf42000640 1 --2- 172.21.15.55:0/2576718835 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf1c066690 0x7fcf1c068b50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.519+0000 7fcf42000640 1 --2- 172.21.15.55:0/2576718835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf3c06a2d0 0x7fcf3c0cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.519+0000 7fcf42000640 1 -- 172.21.15.55:0/2576718835 >> 172.21.15.55:0/2576718835 conn(0x7fcf3c0b13b0 msgr2=0x7fcf3c0b0bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.519+0000 7fcf42000640 1 -- 172.21.15.55:0/2576718835 shutdown_connections 2024-04-02T07:23:58.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.519+0000 7fcf42000640 1 -- 172.21.15.55:0/2576718835 wait complete. 2024-04-02T07:23:58.543 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:23:58.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.683+0000 7f8b11e00640 1 Processor -- start 2024-04-02T07:23:58.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.683+0000 7f8b11e00640 1 -- start start 2024-04-02T07:23:58.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.683+0000 7f8b11e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8b0c160580 0x7f8b0c098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:58.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.683+0000 7f8b11e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b0c0b19b0 0x7f8b0c098f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:58.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.683+0000 7f8b11e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b0c0cfee0 con 0x7f8b0c1601a0 2024-04-02T07:23:58.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.683+0000 7f8b11e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b0c0d04a0 con 0x7f8b0c160580 2024-04-02T07:23:58.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.683+0000 7f8b11e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c0cfcf0 con 0x7f8b0c0b19b0 2024-04-02T07:23:58.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0aa00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8b0c1601a0 0x7f8b0c0cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50084/0 (socket says 172.21.15.55:50084) 2024-04-02T07:23:58.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0aa00640 1 -- 172.21.15.55:0/1211667083 learned_addr learned my addr 172.21.15.55:0/1211667083 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:58.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0a000640 1 -- 172.21.15.55:0/1211667083 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2891937918 0 0) 0x7f8b0c0cfee0 con 0x7f8b0c1601a0 2024-04-02T07:23:58.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b02000640 1 --2- 172.21.15.55:0/1211667083 >> v2:172.21.15.106:3300/0 conn(0x7f8b0c160580 0x7f8b0c098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0a000640 1 -- 172.21.15.55:0/1211667083 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8af0003530 con 0x7f8b0c1601a0 2024-04-02T07:23:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0b400640 1 --2- 172.21.15.55:0/1211667083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b0c0b19b0 0x7f8b0c098f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0a000640 1 -- 172.21.15.55:0/1211667083 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3477621120 0 0) 0x7f8af0003530 con 0x7f8b0c1601a0 2024-04-02T07:23:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0a000640 1 -- 172.21.15.55:0/1211667083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b0c0b19b0 msgr2=0x7f8b0c098f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0a000640 1 --2- 172.21.15.55:0/1211667083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b0c0b19b0 0x7f8b0c098f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0a000640 1 -- 172.21.15.55:0/1211667083 >> v2:172.21.15.106:3300/0 conn(0x7f8b0c160580 msgr2=0x7f8b0c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0a000640 1 --2- 172.21.15.55:0/1211667083 >> v2:172.21.15.106:3300/0 conn(0x7f8b0c160580 0x7f8b0c098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0a000640 1 -- 172.21.15.55:0/1211667083 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c0d01c0 con 0x7f8b0c1601a0 2024-04-02T07:23:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0a000640 1 -- 172.21.15.55:0/1211667083 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f8afc001680 con 0x7f8b0c1601a0 2024-04-02T07:23:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0a000640 1 -- 172.21.15.55:0/1211667083 >> v1:172.21.15.55:6789/0 conn(0x7f8b0c1601a0 legacy=0x7f8b0c0cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0a000640 1 --2- 172.21.15.55:0/1211667083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8af0003980 0x7f8af0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0a000640 1 --2- 172.21.15.55:0/1211667083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b0c0b19b0 0x7f8af00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0a000640 1 --2- 172.21.15.55:0/1211667083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8af0004d10 0x7f8af0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0a000640 1 -- 172.21.15.55:0/1211667083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c0d04a0 con 0x7f8af0004d10 2024-04-02T07:23:58.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0a000640 1 -- 172.21.15.55:0/1211667083 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8af000b9e0 con 0x7f8af0003980 2024-04-02T07:23:58.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0a000640 1 -- 172.21.15.55:0/1211667083 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8af000bba0 con 0x7f8b0c0b19b0 2024-04-02T07:23:58.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0b400640 1 --2- 172.21.15.55:0/1211667083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8af0004d10 0x7f8af0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:58.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0aa00640 1 --2- 172.21.15.55:0/1211667083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8af0003980 0x7f8af0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:58.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b02000640 1 --2- 172.21.15.55:0/1211667083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b0c0b19b0 0x7f8af00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:58.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0b400640 1 -- 172.21.15.55:0/1211667083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b0c0b19b0 msgr2=0x7f8af00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:58.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0b400640 1 --2- 172.21.15.55:0/1211667083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b0c0b19b0 0x7f8af00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0b400640 1 -- 172.21.15.55:0/1211667083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8af0003980 msgr2=0x7f8af0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:58.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0b400640 1 --2- 172.21.15.55:0/1211667083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8af0003980 0x7f8af0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.687+0000 7f8b0b400640 1 -- 172.21.15.55:0/1211667083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af0003530 con 0x7f8af0004d10 2024-04-02T07:23:58.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.691+0000 7f8b0b400640 1 --2- 172.21.15.55:0/1211667083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8af0004d10 0x7f8af0005190 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009fc0 tx=0x7f8b0401cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=154565a9a91576f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:58.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.691+0000 7f8b0a000640 1 -- 172.21.15.55:0/1211667083 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b040a5b50 con 0x7f8af0004d10 2024-04-02T07:23:58.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.691+0000 7f8b0a000640 1 -- 172.21.15.55:0/1211667083 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b0400f040 con 0x7f8af0004d10 2024-04-02T07:23:58.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.691+0000 7f8b0a000640 1 -- 172.21.15.55:0/1211667083 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b040ad440 con 0x7f8af0004d10 2024-04-02T07:23:58.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.691+0000 7f8b11e00640 1 -- 172.21.15.55:0/1211667083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8af0004d10 msgr2=0x7f8af0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:58.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.691+0000 7f8b11e00640 1 --2- 172.21.15.55:0/1211667083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8af0004d10 0x7f8af0005190 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009fc0 tx=0x7f8b0401cc50 comp rx=0 tx=0).stop 2024-04-02T07:23:58.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.691+0000 7f8b0b400640 1 -- 172.21.15.55:0/1211667083 reap_dead start 2024-04-02T07:23:58.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.691+0000 7f8b11e00640 1 -- 172.21.15.55:0/1211667083 shutdown_connections 2024-04-02T07:23:58.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.691+0000 7f8b11e00640 1 -- 172.21.15.55:0/1211667083 >> 172.21.15.55:0/1211667083 conn(0x7f8b0c0b2150 msgr2=0x7f8b0c0b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:58.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.691+0000 7f8b11e00640 1 -- 172.21.15.55:0/1211667083 shutdown_connections 2024-04-02T07:23:58.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.691+0000 7f8b11e00640 1 -- 172.21.15.55:0/1211667083 wait complete. 2024-04-02T07:23:58.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.691+0000 7f8b11e00640 1 Processor -- start 2024-04-02T07:23:58.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.691+0000 7f8b11e00640 1 -- start start 2024-04-02T07:23:58.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.691+0000 7f8b11e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8af0004d10 0x7f8b0c1f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:58.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.691+0000 7f8b11e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b0c1f8270 0x7f8b0c0c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:58.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.691+0000 7f8b11e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b0c0ca080 0x7f8b0c0b4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:58.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.691+0000 7f8b11e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c0c7730 con 0x7f8b0c0ca080 2024-04-02T07:23:58.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.691+0000 7f8b11e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c0ca500 con 0x7f8b0c1f8270 2024-04-02T07:23:58.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.691+0000 7f8b11e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b0c0c7f60 con 0x7f8af0004d10 2024-04-02T07:23:58.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.695+0000 7f8b0b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b0c0ca080 0x7f8b0c0b4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:58.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.695+0000 7f8b0b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b0c0ca080 0x7f8b0c0b4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51220/0 (socket says 172.21.15.55:51220) 2024-04-02T07:23:58.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.695+0000 7f8b0b400640 1 -- 172.21.15.55:0/2334911396 learned_addr learned my addr 172.21.15.55:0/2334911396 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:58.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.695+0000 7f8b0aa00640 1 --2- 172.21.15.55:0/2334911396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8af0004d10 0x7f8b0c1f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:58.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.695+0000 7f8b02000640 1 --2- 172.21.15.55:0/2334911396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b0c1f8270 0x7f8b0c0c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:58.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.695+0000 7f8b0b400640 1 -- 172.21.15.55:0/2334911396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8af0004d10 msgr2=0x7f8b0c1f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:58.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.695+0000 7f8b0b400640 1 --2- 172.21.15.55:0/2334911396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8af0004d10 0x7f8b0c1f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.695+0000 7f8b0b400640 1 -- 172.21.15.55:0/2334911396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b0c1f8270 msgr2=0x7f8b0c0c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:58.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.695+0000 7f8b0b400640 1 --2- 172.21.15.55:0/2334911396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b0c1f8270 0x7f8b0c0c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.695+0000 7f8b0b400640 1 -- 172.21.15.55:0/2334911396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b0c0b5690 con 0x7f8b0c0ca080 2024-04-02T07:23:58.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.695+0000 7f8b0b400640 1 --2- 172.21.15.55:0/2334911396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b0c0ca080 0x7f8b0c0b4900 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8b04002240 tx=0x7f8b04009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:58.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.695+0000 7f8b03e00640 1 -- 172.21.15.55:0/2334911396 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b040039a0 con 0x7f8b0c0ca080 2024-04-02T07:23:58.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.695+0000 7f8b03e00640 1 -- 172.21.15.55:0/2334911396 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b04003b00 con 0x7f8b0c0ca080 2024-04-02T07:23:58.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.695+0000 7f8b03e00640 1 -- 172.21.15.55:0/2334911396 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b04003e70 con 0x7f8b0c0ca080 2024-04-02T07:23:58.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.695+0000 7f8b11e00640 1 -- 172.21.15.55:0/2334911396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b0c0c7910 con 0x7f8b0c0ca080 2024-04-02T07:23:58.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.695+0000 7f8b11e00640 1 -- 172.21.15.55:0/2334911396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b0c1f86f0 con 0x7f8b0c0ca080 2024-04-02T07:23:58.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.695+0000 7f8b11e00640 1 -- 172.21.15.55:0/2334911396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b0c0c80f0 con 0x7f8b0c0ca080 2024-04-02T07:23:58.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.695+0000 7f8b03e00640 1 -- 172.21.15.55:0/2334911396 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8b040b4040 con 0x7f8b0c0ca080 2024-04-02T07:23:58.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.695+0000 7f8b03e00640 1 --2- 172.21.15.55:0/2334911396 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8ae8066690 0x7f8ae8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:58.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.699+0000 7f8b03e00640 1 -- 172.21.15.55:0/2334911396 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b0411d940 con 0x7f8b0c0ca080 2024-04-02T07:23:58.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.699+0000 7f8b0aa00640 1 --2- 172.21.15.55:0/2334911396 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8ae8066690 0x7f8ae8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:58.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.699+0000 7f8b0aa00640 1 --2- 172.21.15.55:0/2334911396 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8ae8066690 0x7f8ae8068b50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8afc001130 tx=0x7f8afc001de0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:58.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.703+0000 7f8b03e00640 1 -- 172.21.15.55:0/2334911396 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f8b040eacb0 con 0x7f8b0c0ca080 2024-04-02T07:23:58.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.863+0000 7f8b11e00640 1 -- 172.21.15.55:0/2334911396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8b0c0723d0 con 0x7f8b0c0ca080 2024-04-02T07:23:58.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.863+0000 7f8b03e00640 1 -- 172.21.15.55:0/2334911396 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v34) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8b040b2020 con 0x7f8b0c0ca080 2024-04-02T07:23:58.866 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:23:58.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.863+0000 7f8b11e00640 1 -- 172.21.15.55:0/2334911396 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8ae8066690 msgr2=0x7f8ae8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:58.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.863+0000 7f8b11e00640 1 --2- 172.21.15.55:0/2334911396 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8ae8066690 0x7f8ae8068b50 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8afc001130 tx=0x7f8afc001de0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.863+0000 7f8b11e00640 1 -- 172.21.15.55:0/2334911396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b0c0ca080 msgr2=0x7f8b0c0b4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:58.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.863+0000 7f8b11e00640 1 --2- 172.21.15.55:0/2334911396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b0c0ca080 0x7f8b0c0b4900 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f8b04002240 tx=0x7f8b04009750 comp rx=0 tx=0).stop 2024-04-02T07:23:58.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.867+0000 7f8b11e00640 1 -- 172.21.15.55:0/2334911396 shutdown_connections 2024-04-02T07:23:58.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.867+0000 7f8b11e00640 1 --2- 172.21.15.55:0/2334911396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b0c0ca080 0x7f8b0c0b4900 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.867+0000 7f8b11e00640 1 --2- 172.21.15.55:0/2334911396 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8ae8066690 0x7f8ae8068b50 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.867+0000 7f8b11e00640 1 --2- 172.21.15.55:0/2334911396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b0c1f8270 0x7f8b0c0c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.867+0000 7f8b11e00640 1 --2- 172.21.15.55:0/2334911396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8af0004d10 0x7f8b0c1f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:58.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.867+0000 7f8b11e00640 1 -- 172.21.15.55:0/2334911396 >> 172.21.15.55:0/2334911396 conn(0x7f8b0c0b2150 msgr2=0x7f8b0c0cf550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:58.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.867+0000 7f8b11e00640 1 -- 172.21.15.55:0/2334911396 shutdown_connections 2024-04-02T07:23:58.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:58.867+0000 7f8b11e00640 1 -- 172.21.15.55:0/2334911396 wait complete. 2024-04-02T07:23:58.887 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:23:59.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.027+0000 7f7e2ae00640 1 Processor -- start 2024-04-02T07:23:59.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.027+0000 7f7e2ae00640 1 -- start start 2024-04-02T07:23:59.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.027+0000 7f7e2ae00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e240b41a0 0x7f7e24142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:59.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.027+0000 7f7e2ae00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2406ddc0 con 0x7f7e240ade90 2024-04-02T07:23:59.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.027+0000 7f7e2ae00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2406c630 con 0x7f7e240b3dc0 2024-04-02T07:23:59.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.031+0000 7f7e2ae00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240cae80 con 0x7f7e240b41a0 2024-04-02T07:23:59.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.031+0000 7f7e23400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7e240ade90 0x7f7e2406d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50086/0 (socket says 172.21.15.55:50086) 2024-04-02T07:23:59.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.031+0000 7f7e23400640 1 -- 172.21.15.55:0/3378533831 learned_addr learned my addr 172.21.15.55:0/3378533831 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:23:59.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.031+0000 7f7e28e00640 1 --2- 172.21.15.55:0/3378533831 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e240b41a0 0x7f7e24142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:59.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.031+0000 7f7e22a00640 1 -- 172.21.15.55:0/3378533831 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 802452395 0 0) 0x7f7e2406ddc0 con 0x7f7e240ade90 2024-04-02T07:23:59.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.031+0000 7f7e22a00640 1 -- 172.21.15.55:0/3378533831 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e08003530 con 0x7f7e240ade90 2024-04-02T07:23:59.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.031+0000 7f7e22a00640 1 -- 172.21.15.55:0/3378533831 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271774934 0 0) 0x7f7e2406c630 con 0x7f7e240b3dc0 2024-04-02T07:23:59.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.031+0000 7f7e22a00640 1 -- 172.21.15.55:0/3378533831 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e2406ddc0 con 0x7f7e240b3dc0 2024-04-02T07:23:59.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.031+0000 7f7e28e00640 1 -- 172.21.15.55:0/3378533831 >> v1:172.21.15.106:6789/0 conn(0x7f7e240b3dc0 legacy=0x7f7e240ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:59.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.031+0000 7f7e28e00640 1 -- 172.21.15.55:0/3378533831 >> v1:172.21.15.55:6789/0 conn(0x7f7e240ade90 legacy=0x7f7e2406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:59.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.031+0000 7f7e28e00640 1 -- 172.21.15.55:0/3378533831 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2406c8f0 con 0x7f7e240b41a0 2024-04-02T07:23:59.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e28e00640 1 --2- 172.21.15.55:0/3378533831 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e240b41a0 0x7f7e24142ac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0097f0 tx=0x7f7e1c01c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33d041280b8b0602 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:59.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e22a00640 1 -- 172.21.15.55:0/3378533831 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0ab600 con 0x7f7e240b41a0 2024-04-02T07:23:59.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e22a00640 1 -- 172.21.15.55:0/3378533831 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c0a7050 con 0x7f7e240b41a0 2024-04-02T07:23:59.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e22a00640 1 -- 172.21.15.55:0/3378533831 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0ab980 con 0x7f7e240b41a0 2024-04-02T07:23:59.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e2ae00640 1 -- 172.21.15.55:0/3378533831 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e240b41a0 msgr2=0x7f7e24142ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:59.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e2ae00640 1 --2- 172.21.15.55:0/3378533831 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e240b41a0 0x7f7e24142ac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0097f0 tx=0x7f7e1c01c420 comp rx=0 tx=0).stop 2024-04-02T07:23:59.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e2ae00640 1 -- 172.21.15.55:0/3378533831 shutdown_connections 2024-04-02T07:23:59.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e2ae00640 1 --2- 172.21.15.55:0/3378533831 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e240b41a0 0x7f7e24142ac0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e2ae00640 1 -- 172.21.15.55:0/3378533831 >> 172.21.15.55:0/3378533831 conn(0x7f7e2406a390 msgr2=0x7f7e240b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:59.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e2ae00640 1 -- 172.21.15.55:0/3378533831 shutdown_connections 2024-04-02T07:23:59.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e2ae00640 1 -- 172.21.15.55:0/3378533831 wait complete. 2024-04-02T07:23:59.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e2ae00640 1 Processor -- start 2024-04-02T07:23:59.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e2ae00640 1 -- start start 2024-04-02T07:23:59.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e2ae00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e240ade90 0x7f7e24159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e2ae00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e240b3dc0 0x7f7e2413dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e2ae00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e240b41a0 0x7f7e2413e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e2ae00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2415cc60 con 0x7f7e240b41a0 2024-04-02T07:23:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e2ae00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2414e1a0 con 0x7f7e240b3dc0 2024-04-02T07:23:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e2ae00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2415c980 con 0x7f7e240ade90 2024-04-02T07:23:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e28e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e240b41a0 0x7f7e2413e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e28e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e240b41a0 0x7f7e2413e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51222/0 (socket says 172.21.15.55:51222) 2024-04-02T07:23:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e28e00640 1 -- 172.21.15.55:0/1782174753 learned_addr learned my addr 172.21.15.55:0/1782174753 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.035+0000 7f7e23e00640 1 --2- 172.21.15.55:0/1782174753 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e240ade90 0x7f7e24159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.039+0000 7f7e23400640 1 --2- 172.21.15.55:0/1782174753 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e240b3dc0 0x7f7e2413dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.039+0000 7f7e28e00640 1 -- 172.21.15.55:0/1782174753 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e240ade90 msgr2=0x7f7e24159d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.039+0000 7f7e28e00640 1 --2- 172.21.15.55:0/1782174753 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e240ade90 0x7f7e24159d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.039+0000 7f7e28e00640 1 -- 172.21.15.55:0/1782174753 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e240b3dc0 msgr2=0x7f7e2413dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.039+0000 7f7e28e00640 1 --2- 172.21.15.55:0/1782174753 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e240b3dc0 0x7f7e2413dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.039+0000 7f7e28e00640 1 -- 172.21.15.55:0/1782174753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1c009420 con 0x7f7e240b41a0 2024-04-02T07:23:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.039+0000 7f7e28e00640 1 --2- 172.21.15.55:0/1782174753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e240b41a0 0x7f7e2413e170 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0097f0 tx=0x7f7e1c0191c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.039+0000 7f7e1be00640 1 -- 172.21.15.55:0/1782174753 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0abe10 con 0x7f7e240b41a0 2024-04-02T07:23:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.039+0000 7f7e1be00640 1 -- 172.21.15.55:0/1782174753 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e1c004030 con 0x7f7e240b41a0 2024-04-02T07:23:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.039+0000 7f7e2ae00640 1 -- 172.21.15.55:0/1782174753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2414e440 con 0x7f7e240b41a0 2024-04-02T07:23:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.039+0000 7f7e1be00640 1 -- 172.21.15.55:0/1782174753 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e1c0043a0 con 0x7f7e240b41a0 2024-04-02T07:23:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.039+0000 7f7e2ae00640 1 -- 172.21.15.55:0/1782174753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2415bd50 con 0x7f7e240b41a0 2024-04-02T07:23:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.039+0000 7f7e2ae00640 1 -- 172.21.15.55:0/1782174753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2414e960 con 0x7f7e240b41a0 2024-04-02T07:23:59.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.039+0000 7f7e1be00640 1 -- 172.21.15.55:0/1782174753 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7e1c0b2040 con 0x7f7e240b41a0 2024-04-02T07:23:59.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.043+0000 7f7e1be00640 1 --2- 172.21.15.55:0/1782174753 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e04066690 0x7f7e04068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:59.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.043+0000 7f7e1be00640 1 -- 172.21.15.55:0/1782174753 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e1c11e230 con 0x7f7e240b41a0 2024-04-02T07:23:59.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.043+0000 7f7e23e00640 1 --2- 172.21.15.55:0/1782174753 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e04066690 0x7f7e04068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:59.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.043+0000 7f7e23e00640 1 --2- 172.21.15.55:0/1782174753 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e04066690 0x7f7e04068b50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7e14001570 tx=0x7f7e14009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:59.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.047+0000 7f7e1be00640 1 -- 172.21.15.55:0/1782174753 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7e2414e960 con 0x7f7e240b41a0 2024-04-02T07:23:59.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.207+0000 7f7e2ae00640 1 -- 172.21.15.55:0/1782174753 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e2414e960 con 0x7f7e240b41a0 2024-04-02T07:23:59.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.207+0000 7f7e1be00640 1 -- 172.21.15.55:0/1782174753 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v34) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7e2414e960 con 0x7f7e240b41a0 2024-04-02T07:23:59.208 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:23:59.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.207+0000 7f7e2ae00640 1 -- 172.21.15.55:0/1782174753 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e04066690 msgr2=0x7f7e04068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:59.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.207+0000 7f7e2ae00640 1 --2- 172.21.15.55:0/1782174753 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e04066690 0x7f7e04068b50 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f7e14001570 tx=0x7f7e14009040 comp rx=0 tx=0).stop 2024-04-02T07:23:59.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.207+0000 7f7e2ae00640 1 -- 172.21.15.55:0/1782174753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e240b41a0 msgr2=0x7f7e2413e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:59.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.207+0000 7f7e2ae00640 1 --2- 172.21.15.55:0/1782174753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e240b41a0 0x7f7e2413e170 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0097f0 tx=0x7f7e1c0191c0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.207+0000 7f7e2ae00640 1 -- 172.21.15.55:0/1782174753 shutdown_connections 2024-04-02T07:23:59.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.207+0000 7f7e2ae00640 1 --2- 172.21.15.55:0/1782174753 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e240b41a0 0x7f7e2413e170 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.207+0000 7f7e2ae00640 1 --2- 172.21.15.55:0/1782174753 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e04066690 0x7f7e04068b50 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.207+0000 7f7e2ae00640 1 --2- 172.21.15.55:0/1782174753 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e240b3dc0 0x7f7e2413dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.207+0000 7f7e2ae00640 1 --2- 172.21.15.55:0/1782174753 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e240ade90 0x7f7e24159d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.207+0000 7f7e2ae00640 1 -- 172.21.15.55:0/1782174753 >> 172.21.15.55:0/1782174753 conn(0x7f7e2406a390 msgr2=0x7f7e24154df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:59.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.207+0000 7f7e2ae00640 1 -- 172.21.15.55:0/1782174753 shutdown_connections 2024-04-02T07:23:59.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.207+0000 7f7e2ae00640 1 -- 172.21.15.55:0/1782174753 wait complete. 2024-04-02T07:23:59.229 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:23:59.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.367+0000 7f90d2000640 1 Processor -- start 2024-04-02T07:23:59.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.367+0000 7f90d2000640 1 -- start start 2024-04-02T07:23:59.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.367+0000 7f90d2000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f90cc0b19d0 0x7f90cc0ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:59.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.367+0000 7f90d2000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f90cc06c0d0 0x7f90cc098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:59.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.367+0000 7f90d2000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f90cc0cef10 0x7f90cc098f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:59.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.367+0000 7f90d2000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90cc0cf3d0 con 0x7f90cc0cef10 2024-04-02T07:23:59.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.367+0000 7f90d2000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90cc0cf6b0 con 0x7f90cc06c0d0 2024-04-02T07:23:59.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.367+0000 7f90d2000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0cf990 con 0x7f90cc0b19d0 2024-04-02T07:23:59.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.367+0000 7f90cbe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f90cc0cef10 0x7f90cc098f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:59.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.367+0000 7f90cbe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f90cc0cef10 0x7f90cc098f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51232/0 (socket says 172.21.15.55:51232) 2024-04-02T07:23:59.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.367+0000 7f90cbe00640 1 -- 172.21.15.55:0/964327189 learned_addr learned my addr 172.21.15.55:0/964327189 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:59.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.371+0000 7f90cbe00640 1 -- 172.21.15.55:0/964327189 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f90cc0b19d0 msgr2=0x7f90cc0ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:59.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.371+0000 7f90cbe00640 1 --2- 172.21.15.55:0/964327189 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f90cc0b19d0 0x7f90cc0ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.371+0000 7f90cbe00640 1 -- 172.21.15.55:0/964327189 >> v2:172.21.15.106:3300/0 conn(0x7f90cc06c0d0 msgr2=0x7f90cc098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:59.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.371+0000 7f90cbe00640 1 --2- 172.21.15.55:0/964327189 >> v2:172.21.15.106:3300/0 conn(0x7f90cc06c0d0 0x7f90cc098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.371+0000 7f90cbe00640 1 -- 172.21.15.55:0/964327189 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90cc0cfc70 con 0x7f90cc0cef10 2024-04-02T07:23:59.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.371+0000 7f90cbe00640 1 --2- 172.21.15.55:0/964327189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90cc0cef10 0x7f90cc098f50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0719b0 tx=0x7f90c401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1590b2ed4790bb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:59.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.371+0000 7f90caa00640 1 -- 172.21.15.55:0/964327189 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c40ab5f0 con 0x7f90cc0cef10 2024-04-02T07:23:59.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.371+0000 7f90caa00640 1 -- 172.21.15.55:0/964327189 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c40ab750 con 0x7f90cc0cef10 2024-04-02T07:23:59.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.371+0000 7f90caa00640 1 -- 172.21.15.55:0/964327189 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c40abae0 con 0x7f90cc0cef10 2024-04-02T07:23:59.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.371+0000 7f90d2000640 1 -- 172.21.15.55:0/964327189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90cc0cef10 msgr2=0x7f90cc098f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:59.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.371+0000 7f90d2000640 1 --2- 172.21.15.55:0/964327189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90cc0cef10 0x7f90cc098f50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f90cc0719b0 tx=0x7f90c401c520 comp rx=0 tx=0).stop 2024-04-02T07:23:59.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.371+0000 7f90d2000640 1 -- 172.21.15.55:0/964327189 shutdown_connections 2024-04-02T07:23:59.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.371+0000 7f90d2000640 1 --2- 172.21.15.55:0/964327189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90cc0cef10 0x7f90cc098f50 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.371+0000 7f90d2000640 1 --2- 172.21.15.55:0/964327189 >> v2:172.21.15.106:3300/0 conn(0x7f90cc06c0d0 0x7f90cc098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.371+0000 7f90d2000640 1 --2- 172.21.15.55:0/964327189 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f90cc0b19d0 0x7f90cc0ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.371+0000 7f90d2000640 1 -- 172.21.15.55:0/964327189 >> 172.21.15.55:0/964327189 conn(0x7f90cc0b2150 msgr2=0x7f90cc0b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:59.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.371+0000 7f90d2000640 1 -- 172.21.15.55:0/964327189 shutdown_connections 2024-04-02T07:23:59.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.371+0000 7f90d2000640 1 -- 172.21.15.55:0/964327189 wait complete. 2024-04-02T07:23:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90d2000640 1 Processor -- start 2024-04-02T07:23:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90d2000640 1 -- start start 2024-04-02T07:23:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90d2000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90cc06c0d0 0x7f90cc15d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90d2000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90cc0b19d0 0x7f90cc1f89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90d2000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f90cc0cef10 0x7f90cc1f8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90d2000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0b5ed0 con 0x7f90cc06c0d0 2024-04-02T07:23:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90d2000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0c4910 con 0x7f90cc0b19d0 2024-04-02T07:23:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90d2000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90cc0b5bf0 con 0x7f90cc0cef10 2024-04-02T07:23:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90cb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90cc06c0d0 0x7f90cc15d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90cb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90cc06c0d0 0x7f90cc15d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51236/0 (socket says 172.21.15.55:51236) 2024-04-02T07:23:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90cb400640 1 -- 172.21.15.55:0/1744065465 learned_addr learned my addr 172.21.15.55:0/1744065465 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90cbe00640 1 --2- 172.21.15.55:0/1744065465 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f90cc0cef10 0x7f90cc1f8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90c2a00640 1 --2- 172.21.15.55:0/1744065465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90cc0b19d0 0x7f90cc1f89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90cb400640 1 -- 172.21.15.55:0/1744065465 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f90cc0cef10 msgr2=0x7f90cc1f8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90cb400640 1 --2- 172.21.15.55:0/1744065465 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f90cc0cef10 0x7f90cc1f8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90cb400640 1 -- 172.21.15.55:0/1744065465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90cc0b19d0 msgr2=0x7f90cc1f89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90cb400640 1 --2- 172.21.15.55:0/1744065465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90cc0b19d0 0x7f90cc1f89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90cb400640 1 -- 172.21.15.55:0/1744065465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c40094d0 con 0x7f90cc06c0d0 2024-04-02T07:23:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90c2a00640 1 --2- 172.21.15.55:0/1744065465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90cc0b19d0 0x7f90cc1f89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90cb400640 1 --2- 172.21.15.55:0/1744065465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90cc06c0d0 0x7f90cc15d480 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00ba50 tx=0x7f90bc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90c3e00640 1 -- 172.21.15.55:0/1744065465 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc00cbe0 con 0x7f90cc06c0d0 2024-04-02T07:23:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90c3e00640 1 -- 172.21.15.55:0/1744065465 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90bc00cd60 con 0x7f90cc06c0d0 2024-04-02T07:23:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90c3e00640 1 -- 172.21.15.55:0/1744065465 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90bc014680 con 0x7f90cc06c0d0 2024-04-02T07:23:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90d2000640 1 -- 172.21.15.55:0/1744065465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90cc0c42c0 con 0x7f90cc06c0d0 2024-04-02T07:23:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.375+0000 7f90d2000640 1 -- 172.21.15.55:0/1744065465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90cc15d9c0 con 0x7f90cc06c0d0 2024-04-02T07:23:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.379+0000 7f90d2000640 1 -- 172.21.15.55:0/1744065465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90cc066c90 con 0x7f90cc06c0d0 2024-04-02T07:23:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.379+0000 7f90c3e00640 1 -- 172.21.15.55:0/1744065465 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f90bc0147e0 con 0x7f90cc06c0d0 2024-04-02T07:23:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.379+0000 7f90c3e00640 1 --2- 172.21.15.55:0/1744065465 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f90a80666c0 0x7f90a8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.379+0000 7f90c3e00640 1 -- 172.21.15.55:0/1744065465 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90bc083fe0 con 0x7f90cc06c0d0 2024-04-02T07:23:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.379+0000 7f90c2a00640 1 --2- 172.21.15.55:0/1744065465 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f90a80666c0 0x7f90a8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.379+0000 7f90c2a00640 1 --2- 172.21.15.55:0/1744065465 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f90a80666c0 0x7f90a8068b80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f90b4006fd0 tx=0x7f90b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:59.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.383+0000 7f90c3e00640 1 -- 172.21.15.55:0/1744065465 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f90bc051450 con 0x7f90cc06c0d0 2024-04-02T07:23:59.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.579+0000 7f90d2000640 1 -- 172.21.15.55:0/1744065465 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90cc0b2fa0 con 0x7f90cc06c0d0 2024-04-02T07:23:59.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.579+0000 7f90c3e00640 1 -- 172.21.15.55:0/1744065465 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4725 (secure 0 0 0) 0x7f90bc054a70 con 0x7f90cc06c0d0 2024-04-02T07:23:59.581 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:59.581 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4883,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53106343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53106343},{"type":"v1","addr":"172.21.15.55:6833","nonce":53106343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/44669622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":44669622},{"type":"v1","addr":"172.21.15.106:6837","nonce":44669622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/741637637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":741637637},{"type":"v1","addr":"172.21.15.106:6836","nonce":741637637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:23:25.727369+0000","modified":"2024-04-02T07:23:29.049370+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/2440784960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2440784960},{"type":"v1","addr":"172.21.15.55:6835","nonce":2440784960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-02T07:23:59.581 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 17 2024-04-02T07:23:59.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.579+0000 7f90d2000640 1 -- 172.21.15.55:0/1744065465 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f90a80666c0 msgr2=0x7f90a8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:59.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.579+0000 7f90d2000640 1 --2- 172.21.15.55:0/1744065465 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f90a80666c0 0x7f90a8068b80 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f90b4006fd0 tx=0x7f90b4008040 comp rx=0 tx=0).stop 2024-04-02T07:23:59.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.579+0000 7f90d2000640 1 -- 172.21.15.55:0/1744065465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90cc06c0d0 msgr2=0x7f90cc15d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:59.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.579+0000 7f90d2000640 1 --2- 172.21.15.55:0/1744065465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90cc06c0d0 0x7f90cc15d480 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f90bc00ba50 tx=0x7f90bc00bf10 comp rx=0 tx=0).stop 2024-04-02T07:23:59.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.579+0000 7f90d2000640 1 -- 172.21.15.55:0/1744065465 shutdown_connections 2024-04-02T07:23:59.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.579+0000 7f90d2000640 1 --2- 172.21.15.55:0/1744065465 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f90cc0cef10 0x7f90cc1f8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.579+0000 7f90d2000640 1 --2- 172.21.15.55:0/1744065465 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f90a80666c0 0x7f90a8068b80 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.579+0000 7f90d2000640 1 --2- 172.21.15.55:0/1744065465 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f90cc0b19d0 0x7f90cc1f89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.579+0000 7f90d2000640 1 --2- 172.21.15.55:0/1744065465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90cc06c0d0 0x7f90cc15d480 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.579+0000 7f90d2000640 1 -- 172.21.15.55:0/1744065465 >> 172.21.15.55:0/1744065465 conn(0x7f90cc0b2150 msgr2=0x7f90cc06fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:59.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.579+0000 7f90d2000640 1 -- 172.21.15.55:0/1744065465 shutdown_connections 2024-04-02T07:23:59.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.579+0000 7f90d2000640 1 -- 172.21.15.55:0/1744065465 wait complete. 2024-04-02T07:23:59.602 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:23:59.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.739+0000 7ff6ee600640 1 Processor -- start 2024-04-02T07:23:59.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.739+0000 7ff6ee600640 1 -- start start 2024-04-02T07:23:59.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.739+0000 7ff6ee600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6e80b3590 0x7ff6e815c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:59.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.739+0000 7ff6ee600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6e815ce40 0x7ff6e80cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:59.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.739+0000 7ff6ee600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e815d290 con 0x7ff6e80b0cb0 2024-04-02T07:23:59.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.739+0000 7ff6ee600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e80b1090 con 0x7ff6e815ce40 2024-04-02T07:23:59.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.739+0000 7ff6ee600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e80b3a40 con 0x7ff6e80b3590 2024-04-02T07:23:59.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.739+0000 7ff6e7e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6e815ce40 0x7ff6e80cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:59.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.739+0000 7ff6e7e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6e815ce40 0x7ff6e80cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51238/0 (socket says 172.21.15.55:51238) 2024-04-02T07:23:59.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.739+0000 7ff6e7e00640 1 -- 172.21.15.55:0/2135898008 learned_addr learned my addr 172.21.15.55:0/2135898008 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:59.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.739+0000 7ff6dea00640 1 --2- 172.21.15.55:0/2135898008 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6e80b3590 0x7ff6e815c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:59.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.739+0000 7ff6e7e00640 1 -- 172.21.15.55:0/2135898008 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6e80b3590 msgr2=0x7ff6e815c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:59.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.739+0000 7ff6e7e00640 1 --2- 172.21.15.55:0/2135898008 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6e80b3590 0x7ff6e815c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.739+0000 7ff6e7e00640 1 -- 172.21.15.55:0/2135898008 >> v1:172.21.15.106:6789/0 conn(0x7ff6e80b0cb0 legacy=0x7ff6e80c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:23:59.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.739+0000 7ff6e7e00640 1 -- 172.21.15.55:0/2135898008 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e80cac90 con 0x7ff6e815ce40 2024-04-02T07:23:59.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.743+0000 7ff6e7e00640 1 --2- 172.21.15.55:0/2135898008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e815ce40 0x7ff6e80cbe50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0006fd0 tx=0x7ff6e001e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a93b144e2683beb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:59.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.743+0000 7ff6e6a00640 1 -- 172.21.15.55:0/2135898008 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e0004230 con 0x7ff6e815ce40 2024-04-02T07:23:59.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.743+0000 7ff6e6a00640 1 -- 172.21.15.55:0/2135898008 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6e00ab070 con 0x7ff6e815ce40 2024-04-02T07:23:59.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.743+0000 7ff6e6a00640 1 -- 172.21.15.55:0/2135898008 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6e00a7790 con 0x7ff6e815ce40 2024-04-02T07:23:59.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.743+0000 7ff6ee600640 1 -- 172.21.15.55:0/2135898008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e815ce40 msgr2=0x7ff6e80cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:59.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.743+0000 7ff6ee600640 1 --2- 172.21.15.55:0/2135898008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e815ce40 0x7ff6e80cbe50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7ff6e0006fd0 tx=0x7ff6e001e980 comp rx=0 tx=0).stop 2024-04-02T07:23:59.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.743+0000 7ff6ee600640 1 -- 172.21.15.55:0/2135898008 shutdown_connections 2024-04-02T07:23:59.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.743+0000 7ff6ee600640 1 --2- 172.21.15.55:0/2135898008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e815ce40 0x7ff6e80cbe50 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.743+0000 7ff6ee600640 1 --2- 172.21.15.55:0/2135898008 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6e80b3590 0x7ff6e815c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.743+0000 7ff6ee600640 1 -- 172.21.15.55:0/2135898008 >> 172.21.15.55:0/2135898008 conn(0x7ff6e8066080 msgr2=0x7ff6e8069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:59.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.743+0000 7ff6ee600640 1 -- 172.21.15.55:0/2135898008 shutdown_connections 2024-04-02T07:23:59.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.743+0000 7ff6ee600640 1 -- 172.21.15.55:0/2135898008 wait complete. 2024-04-02T07:23:59.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6ee600640 1 Processor -- start 2024-04-02T07:23:59.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6ee600640 1 -- start start 2024-04-02T07:23:59.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6ee600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e80b0cb0 0x7ff6e8141740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:59.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6ee600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6e80b3590 0x7ff6e813cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:59.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6ee600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6e815ce40 0x7ff6e8070210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:59.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6ee600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e8141dd0 con 0x7ff6e80b0cb0 2024-04-02T07:23:59.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6ee600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e81414f0 con 0x7ff6e80b3590 2024-04-02T07:23:59.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6ee600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e80c8e90 con 0x7ff6e815ce40 2024-04-02T07:23:59.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6e7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e80b0cb0 0x7ff6e8141740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:59.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6e7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e80b0cb0 0x7ff6e8141740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51250/0 (socket says 172.21.15.55:51250) 2024-04-02T07:23:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6e7400640 1 -- 172.21.15.55:0/4197292090 learned_addr learned my addr 172.21.15.55:0/4197292090 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:23:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6dea00640 1 --2- 172.21.15.55:0/4197292090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6e80b3590 0x7ff6e813cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6e7e00640 1 --2- 172.21.15.55:0/4197292090 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6e815ce40 0x7ff6e8070210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6e7400640 1 -- 172.21.15.55:0/4197292090 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6e815ce40 msgr2=0x7ff6e8070210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6e7400640 1 --2- 172.21.15.55:0/4197292090 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6e815ce40 0x7ff6e8070210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6e7400640 1 -- 172.21.15.55:0/4197292090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6e80b3590 msgr2=0x7ff6e813cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6e7400640 1 --2- 172.21.15.55:0/4197292090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6e80b3590 0x7ff6e813cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6e7400640 1 -- 172.21.15.55:0/4197292090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e000b780 con 0x7ff6e80b0cb0 2024-04-02T07:23:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6e7e00640 1 --2- 172.21.15.55:0/4197292090 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6e815ce40 0x7ff6e8070210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:23:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6e7400640 1 --2- 172.21.15.55:0/4197292090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e80b0cb0 0x7ff6e8141740 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800b410 tx=0x7ff6d800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6dfe00640 1 -- 172.21.15.55:0/4197292090 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8004020 con 0x7ff6e80b0cb0 2024-04-02T07:23:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6dfe00640 1 -- 172.21.15.55:0/4197292090 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d8004180 con 0x7ff6e80b0cb0 2024-04-02T07:23:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6dfe00640 1 -- 172.21.15.55:0/4197292090 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8011630 con 0x7ff6e80b0cb0 2024-04-02T07:23:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6ee600640 1 -- 172.21.15.55:0/4197292090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e80c9130 con 0x7ff6e80b0cb0 2024-04-02T07:23:59.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.747+0000 7ff6ee600640 1 -- 172.21.15.55:0/4197292090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e80c96f0 con 0x7ff6e80b0cb0 2024-04-02T07:23:59.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.751+0000 7ff6ee600640 1 -- 172.21.15.55:0/4197292090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e8066c90 con 0x7ff6e80b0cb0 2024-04-02T07:23:59.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.751+0000 7ff6dfe00640 1 -- 172.21.15.55:0/4197292090 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff6d8011790 con 0x7ff6e80b0cb0 2024-04-02T07:23:59.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.751+0000 7ff6dfe00640 1 --2- 172.21.15.55:0/4197292090 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff6c4066690 0x7ff6c4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:23:59.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.751+0000 7ff6dfe00640 1 -- 172.21.15.55:0/4197292090 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6d8083e30 con 0x7ff6e80b0cb0 2024-04-02T07:23:59.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.751+0000 7ff6dea00640 1 --2- 172.21.15.55:0/4197292090 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff6c4066690 0x7ff6c4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:23:59.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.751+0000 7ff6dea00640 1 --2- 172.21.15.55:0/4197292090 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff6c4066690 0x7ff6c4068b50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff6e80c6d40 tx=0x7ff6d0009830 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:23:59.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.755+0000 7ff6dfe00640 1 -- 172.21.15.55:0/4197292090 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff6d8051190 con 0x7ff6e80b0cb0 2024-04-02T07:23:59.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.915+0000 7ff6ee600640 1 -- 172.21.15.55:0/4197292090 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6e80cb720 con 0x7ff6e80b0cb0 2024-04-02T07:23:59.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.919+0000 7ff6dfe00640 1 -- 172.21.15.55:0/4197292090 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16101 (secure 0 0 0) 0x7ff6d80547b0 con 0x7ff6e80b0cb0 2024-04-02T07:23:59.923 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:23:59.923 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":34,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:23:26.730146+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:23:23.729158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-02T07:23:24.740958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:23:59.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.919+0000 7ff6ee600640 1 -- 172.21.15.55:0/4197292090 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff6c4066690 msgr2=0x7ff6c4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:59.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.919+0000 7ff6ee600640 1 --2- 172.21.15.55:0/4197292090 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff6c4066690 0x7ff6c4068b50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff6e80c6d40 tx=0x7ff6d0009830 comp rx=0 tx=0).stop 2024-04-02T07:23:59.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.919+0000 7ff6ee600640 1 -- 172.21.15.55:0/4197292090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e80b0cb0 msgr2=0x7ff6e8141740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:23:59.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.919+0000 7ff6ee600640 1 --2- 172.21.15.55:0/4197292090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e80b0cb0 0x7ff6e8141740 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800b410 tx=0x7ff6d800b8d0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.919+0000 7ff6ee600640 1 -- 172.21.15.55:0/4197292090 shutdown_connections 2024-04-02T07:23:59.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.919+0000 7ff6ee600640 1 --2- 172.21.15.55:0/4197292090 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6e815ce40 0x7ff6e8070210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.919+0000 7ff6ee600640 1 --2- 172.21.15.55:0/4197292090 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff6c4066690 0x7ff6c4068b50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.919+0000 7ff6ee600640 1 --2- 172.21.15.55:0/4197292090 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6e80b3590 0x7ff6e813cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.919+0000 7ff6ee600640 1 --2- 172.21.15.55:0/4197292090 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6e80b0cb0 0x7ff6e8141740 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:23:59.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.919+0000 7ff6ee600640 1 -- 172.21.15.55:0/4197292090 >> 172.21.15.55:0/4197292090 conn(0x7ff6e8066080 msgr2=0x7ff6e813f100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:23:59.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.919+0000 7ff6ee600640 1 -- 172.21.15.55:0/4197292090 shutdown_connections 2024-04-02T07:23:59.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:23:59.919+0000 7ff6ee600640 1 -- 172.21.15.55:0/4197292090 wait complete. 2024-04-02T07:23:59.943 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-02T07:23:59.943 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:24:00.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.079+0000 7fb43a400640 1 Processor -- start 2024-04-02T07:24:00.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.079+0000 7fb43a400640 1 -- start start 2024-04-02T07:24:00.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.083+0000 7fb43a400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb4340c4120 0x7fb4340b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:00.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.083+0000 7fb43a400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4340b36f0 0x7fb43413d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:00.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.083+0000 7fb43a400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb43413d0c0 con 0x7fb434153ea0 2024-04-02T07:24:00.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.083+0000 7fb43a400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb43415a2f0 con 0x7fb4340c4120 2024-04-02T07:24:00.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.083+0000 7fb43a400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340b3b60 con 0x7fb4340b36f0 2024-04-02T07:24:00.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.083+0000 7fb42aa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb4340c4120 0x7fb4340b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:00.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.083+0000 7fb42aa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb4340c4120 0x7fb4340b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51260/0 (socket says 172.21.15.55:51260) 2024-04-02T07:24:00.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.083+0000 7fb42aa00640 1 -- 172.21.15.55:0/2961912008 learned_addr learned my addr 172.21.15.55:0/2961912008 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:00.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.083+0000 7fb433e00640 1 --2- 172.21.15.55:0/2961912008 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4340b36f0 0x7fb43413d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:00.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.083+0000 7fb42aa00640 1 -- 172.21.15.55:0/2961912008 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4340b36f0 msgr2=0x7fb43413d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:00.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.083+0000 7fb42aa00640 1 --2- 172.21.15.55:0/2961912008 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4340b36f0 0x7fb43413d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.083+0000 7fb42aa00640 1 -- 172.21.15.55:0/2961912008 >> v1:172.21.15.106:6789/0 conn(0x7fb434153ea0 legacy=0x7fb434159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:00.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.083+0000 7fb42aa00640 1 -- 172.21.15.55:0/2961912008 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb43415a4f0 con 0x7fb4340c4120 2024-04-02T07:24:00.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.087+0000 7fb42aa00640 1 --2- 172.21.15.55:0/2961912008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4340c4120 0x7fb4340b31b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0098a0 tx=0x7fb41c01c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=592e98371f5dc89f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:00.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.087+0000 7fb432a00640 1 -- 172.21.15.55:0/2961912008 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c0ab650 con 0x7fb4340c4120 2024-04-02T07:24:00.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.087+0000 7fb432a00640 1 -- 172.21.15.55:0/2961912008 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41c0ab7b0 con 0x7fb4340c4120 2024-04-02T07:24:00.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.087+0000 7fb432a00640 1 -- 172.21.15.55:0/2961912008 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c0abb40 con 0x7fb4340c4120 2024-04-02T07:24:00.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.087+0000 7fb43a400640 1 -- 172.21.15.55:0/2961912008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4340c4120 msgr2=0x7fb4340b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:00.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.087+0000 7fb43a400640 1 --2- 172.21.15.55:0/2961912008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4340c4120 0x7fb4340b31b0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0098a0 tx=0x7fb41c01c540 comp rx=0 tx=0).stop 2024-04-02T07:24:00.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.087+0000 7fb43a400640 1 -- 172.21.15.55:0/2961912008 shutdown_connections 2024-04-02T07:24:00.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.087+0000 7fb43a400640 1 --2- 172.21.15.55:0/2961912008 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4340b36f0 0x7fb43413d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.087+0000 7fb43a400640 1 --2- 172.21.15.55:0/2961912008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4340c4120 0x7fb4340b31b0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.087+0000 7fb43a400640 1 -- 172.21.15.55:0/2961912008 >> 172.21.15.55:0/2961912008 conn(0x7fb434066080 msgr2=0x7fb434069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:00.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.087+0000 7fb43a400640 1 -- 172.21.15.55:0/2961912008 shutdown_connections 2024-04-02T07:24:00.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.087+0000 7fb43a400640 1 -- 172.21.15.55:0/2961912008 wait complete. 2024-04-02T07:24:00.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.087+0000 7fb43a400640 1 Processor -- start 2024-04-02T07:24:00.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.087+0000 7fb43a400640 1 -- start start 2024-04-02T07:24:00.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.087+0000 7fb43a400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4340b36f0 0x7fb434151040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:00.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.087+0000 7fb43a400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4340c4120 0x7fb4341340b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:00.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.087+0000 7fb43a400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb434153ea0 0x7fb4341381e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:00.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.087+0000 7fb43a400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340cb910 con 0x7fb4340b36f0 2024-04-02T07:24:00.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.087+0000 7fb43a400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb434134960 con 0x7fb434153ea0 2024-04-02T07:24:00.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.087+0000 7fb43a400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4340cbbb0 con 0x7fb4340c4120 2024-04-02T07:24:00.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.091+0000 7fb433400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4340b36f0 0x7fb434151040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:00.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.091+0000 7fb433400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4340b36f0 0x7fb434151040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51276/0 (socket says 172.21.15.55:51276) 2024-04-02T07:24:00.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.091+0000 7fb433400640 1 -- 172.21.15.55:0/40401331 learned_addr learned my addr 172.21.15.55:0/40401331 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:00.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.091+0000 7fb433e00640 1 --2- 172.21.15.55:0/40401331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb434153ea0 0x7fb4341381e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:00.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.091+0000 7fb42aa00640 1 --2- 172.21.15.55:0/40401331 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4340c4120 0x7fb4341340b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:00.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.091+0000 7fb433400640 1 -- 172.21.15.55:0/40401331 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4340c4120 msgr2=0x7fb4341340b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:00.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.091+0000 7fb433400640 1 --2- 172.21.15.55:0/40401331 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4340c4120 0x7fb4341340b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.091+0000 7fb433400640 1 -- 172.21.15.55:0/40401331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb434153ea0 msgr2=0x7fb4341381e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:00.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.091+0000 7fb433400640 1 --2- 172.21.15.55:0/40401331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb434153ea0 0x7fb4341381e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.091+0000 7fb433400640 1 -- 172.21.15.55:0/40401331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb41c0094d0 con 0x7fb4340b36f0 2024-04-02T07:24:00.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.091+0000 7fb433400640 1 --2- 172.21.15.55:0/40401331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4340b36f0 0x7fb434151040 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb42400c7a0 tx=0x7fb42400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:00.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.091+0000 7fb42be00640 1 -- 172.21.15.55:0/40401331 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb424003b80 con 0x7fb4340b36f0 2024-04-02T07:24:00.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.091+0000 7fb42be00640 1 -- 172.21.15.55:0/40401331 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb424003ce0 con 0x7fb4340b36f0 2024-04-02T07:24:00.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.091+0000 7fb42be00640 1 -- 172.21.15.55:0/40401331 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb42400aa90 con 0x7fb4340b36f0 2024-04-02T07:24:00.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.091+0000 7fb43a400640 1 -- 172.21.15.55:0/40401331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4340cbe90 con 0x7fb4340b36f0 2024-04-02T07:24:00.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.091+0000 7fb43a400640 1 -- 172.21.15.55:0/40401331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb434134c40 con 0x7fb4340b36f0 2024-04-02T07:24:00.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.091+0000 7fb43a400640 1 -- 172.21.15.55:0/40401331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb434066c90 con 0x7fb4340b36f0 2024-04-02T07:24:00.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.091+0000 7fb42be00640 1 -- 172.21.15.55:0/40401331 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb42400abf0 con 0x7fb4340b36f0 2024-04-02T07:24:00.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.091+0000 7fb42be00640 1 --2- 172.21.15.55:0/40401331 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb4100666c0 0x7fb410068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:00.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.091+0000 7fb42be00640 1 -- 172.21.15.55:0/40401331 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb424083e90 con 0x7fb4340b36f0 2024-04-02T07:24:00.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.095+0000 7fb42aa00640 1 --2- 172.21.15.55:0/40401331 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb4100666c0 0x7fb410068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:00.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.095+0000 7fb42aa00640 1 --2- 172.21.15.55:0/40401331 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb4100666c0 0x7fb410068b80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0af000 tx=0x7fb41c0b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:00.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.095+0000 7fb42be00640 1 -- 172.21.15.55:0/40401331 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fb4240512a0 con 0x7fb4340b36f0 2024-04-02T07:24:00.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.295+0000 7fb43a400640 1 -- 172.21.15.55:0/40401331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4340cc340 con 0x7fb4340b36f0 2024-04-02T07:24:00.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.295+0000 7fb42be00640 1 -- 172.21.15.55:0/40401331 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4725 (secure 0 0 0) 0x7fb4240548c0 con 0x7fb4340b36f0 2024-04-02T07:24:00.296 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:00.297 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4883,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53106343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53106343},{"type":"v1","addr":"172.21.15.55:6833","nonce":53106343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/44669622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":44669622},{"type":"v1","addr":"172.21.15.106:6837","nonce":44669622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/741637637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":741637637},{"type":"v1","addr":"172.21.15.106:6836","nonce":741637637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:23:25.727369+0000","modified":"2024-04-02T07:23:29.049370+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/2440784960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2440784960},{"type":"v1","addr":"172.21.15.55:6835","nonce":2440784960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-02T07:24:00.297 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 17 2024-04-02T07:24:00.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.295+0000 7fb43a400640 1 -- 172.21.15.55:0/40401331 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb4100666c0 msgr2=0x7fb410068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:00.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.295+0000 7fb43a400640 1 --2- 172.21.15.55:0/40401331 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb4100666c0 0x7fb410068b80 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fb41c0af000 tx=0x7fb41c0b6040 comp rx=0 tx=0).stop 2024-04-02T07:24:00.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.295+0000 7fb43a400640 1 -- 172.21.15.55:0/40401331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4340b36f0 msgr2=0x7fb434151040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:00.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.295+0000 7fb43a400640 1 --2- 172.21.15.55:0/40401331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4340b36f0 0x7fb434151040 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb42400c7a0 tx=0x7fb42400cc60 comp rx=0 tx=0).stop 2024-04-02T07:24:00.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.295+0000 7fb43a400640 1 -- 172.21.15.55:0/40401331 shutdown_connections 2024-04-02T07:24:00.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.295+0000 7fb43a400640 1 --2- 172.21.15.55:0/40401331 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb4100666c0 0x7fb410068b80 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.295+0000 7fb43a400640 1 --2- 172.21.15.55:0/40401331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb434153ea0 0x7fb4341381e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.295+0000 7fb43a400640 1 --2- 172.21.15.55:0/40401331 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb4340c4120 0x7fb4341340b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.295+0000 7fb43a400640 1 --2- 172.21.15.55:0/40401331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb4340b36f0 0x7fb434151040 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.295+0000 7fb43a400640 1 -- 172.21.15.55:0/40401331 >> 172.21.15.55:0/40401331 conn(0x7fb434066080 msgr2=0x7fb43415ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:00.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.295+0000 7fb43a400640 1 -- 172.21.15.55:0/40401331 shutdown_connections 2024-04-02T07:24:00.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.295+0000 7fb43a400640 1 -- 172.21.15.55:0/40401331 wait complete. 2024-04-02T07:24:00.317 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:24:00.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.455+0000 7fbbe0600640 1 Processor -- start 2024-04-02T07:24:00.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.455+0000 7fbbe0600640 1 -- start start 2024-04-02T07:24:00.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.455+0000 7fbbe0600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbbd815c8b0 0x7fbbd806f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:00.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.455+0000 7fbbe0600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbbd815cc90 0x7fbbd8069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:00.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.455+0000 7fbbe0600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd806f420 con 0x7fbbd80aecb0 2024-04-02T07:24:00.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.455+0000 7fbbe0600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd806fdf0 con 0x7fbbd815cc90 2024-04-02T07:24:00.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.455+0000 7fbbe0600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd806a5e0 con 0x7fbbd815c8b0 2024-04-02T07:24:00.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.455+0000 7fbbdd200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbbd815cc90 0x7fbbd8069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:00.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.455+0000 7fbbde600640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbbd80aecb0 0x7fbbd80b31c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50088/0 (socket says 172.21.15.55:50088) 2024-04-02T07:24:00.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.455+0000 7fbbde600640 1 -- 172.21.15.55:0/4048367663 learned_addr learned my addr 172.21.15.55:0/4048367663 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:00.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.455+0000 7fbbddc00640 1 --2- 172.21.15.55:0/4048367663 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbbd815c8b0 0x7fbbd806f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:00.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.455+0000 7fbbdd200640 1 -- 172.21.15.55:0/4048367663 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbbd815c8b0 msgr2=0x7fbbd806f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:00.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.455+0000 7fbbdd200640 1 --2- 172.21.15.55:0/4048367663 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbbd815c8b0 0x7fbbd806f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.455+0000 7fbbdd200640 1 -- 172.21.15.55:0/4048367663 >> v1:172.21.15.55:6789/0 conn(0x7fbbd80aecb0 legacy=0x7fbbd80b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:00.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.455+0000 7fbbd7e00640 1 -- 172.21.15.55:0/4048367663 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601110527 0 0) 0x7fbbd806f420 con 0x7fbbd80aecb0 2024-04-02T07:24:00.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.455+0000 7fbbdd200640 1 -- 172.21.15.55:0/4048367663 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd806edd0 con 0x7fbbd815cc90 2024-04-02T07:24:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.459+0000 7fbbdd200640 1 --2- 172.21.15.55:0/4048367663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbd815cc90 0x7fbbd8069d90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40097c0 tx=0x7fbbc401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03ac349a2ee656a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.459+0000 7fbbd7e00640 1 -- 172.21.15.55:0/4048367663 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc40ac600 con 0x7fbbd815cc90 2024-04-02T07:24:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.459+0000 7fbbd7e00640 1 -- 172.21.15.55:0/4048367663 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc40a8050 con 0x7fbbd815cc90 2024-04-02T07:24:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.459+0000 7fbbd7e00640 1 -- 172.21.15.55:0/4048367663 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc40ac980 con 0x7fbbd815cc90 2024-04-02T07:24:00.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.459+0000 7fbbe0600640 1 -- 172.21.15.55:0/4048367663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbd815cc90 msgr2=0x7fbbd8069d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:00.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.459+0000 7fbbe0600640 1 --2- 172.21.15.55:0/4048367663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbd815cc90 0x7fbbd8069d90 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbbc40097c0 tx=0x7fbbc401c3e0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.459+0000 7fbbe0600640 1 -- 172.21.15.55:0/4048367663 shutdown_connections 2024-04-02T07:24:00.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.459+0000 7fbbe0600640 1 --2- 172.21.15.55:0/4048367663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbd815cc90 0x7fbbd8069d90 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.459+0000 7fbbe0600640 1 --2- 172.21.15.55:0/4048367663 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbbd815c8b0 0x7fbbd806f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.459+0000 7fbbe0600640 1 -- 172.21.15.55:0/4048367663 >> 172.21.15.55:0/4048367663 conn(0x7fbbd80b13b0 msgr2=0x7fbbd80b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:00.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.459+0000 7fbbe0600640 1 -- 172.21.15.55:0/4048367663 shutdown_connections 2024-04-02T07:24:00.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.459+0000 7fbbe0600640 1 -- 172.21.15.55:0/4048367663 wait complete. 2024-04-02T07:24:00.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbe0600640 1 Processor -- start 2024-04-02T07:24:00.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbe0600640 1 -- start start 2024-04-02T07:24:00.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbe0600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbd80aecb0 0x7fbbd815f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:00.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbe0600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbbd815c8b0 0x7fbbd8154ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:00.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbe0600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbd815dc00 0x7fbbd8155220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:00.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbe0600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd814b6e0 con 0x7fbbd815dc00 2024-04-02T07:24:00.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbe0600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd815f850 con 0x7fbbd80aecb0 2024-04-02T07:24:00.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbe0600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd815fb10 con 0x7fbbd815c8b0 2024-04-02T07:24:00.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbde600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbd815dc00 0x7fbbd8155220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:00.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbde600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbd815dc00 0x7fbbd8155220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51300/0 (socket says 172.21.15.55:51300) 2024-04-02T07:24:00.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbde600640 1 -- 172.21.15.55:0/735829709 learned_addr learned my addr 172.21.15.55:0/735829709 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:00.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbddc00640 1 --2- 172.21.15.55:0/735829709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbd80aecb0 0x7fbbd815f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:00.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbdd200640 1 --2- 172.21.15.55:0/735829709 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbbd815c8b0 0x7fbbd8154ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:00.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbde600640 1 -- 172.21.15.55:0/735829709 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbbd815c8b0 msgr2=0x7fbbd8154ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:00.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbde600640 1 --2- 172.21.15.55:0/735829709 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbbd815c8b0 0x7fbbd8154ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbde600640 1 -- 172.21.15.55:0/735829709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbd80aecb0 msgr2=0x7fbbd815f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:00.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbde600640 1 --2- 172.21.15.55:0/735829709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbd80aecb0 0x7fbbd815f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbde600640 1 -- 172.21.15.55:0/735829709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc4009420 con 0x7fbbd815dc00 2024-04-02T07:24:00.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbde600640 1 --2- 172.21.15.55:0/735829709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbd815dc00 0x7fbbd8155220 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000c7a0 tx=0x7fbbd000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:00.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbd5600640 1 -- 172.21.15.55:0/735829709 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000a640 con 0x7fbbd815dc00 2024-04-02T07:24:00.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbd5600640 1 -- 172.21.15.55:0/735829709 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbd000a7a0 con 0x7fbbd815dc00 2024-04-02T07:24:00.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbd5600640 1 -- 172.21.15.55:0/735829709 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbd000abd0 con 0x7fbbd815dc00 2024-04-02T07:24:00.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbe0600640 1 -- 172.21.15.55:0/735829709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd815d120 con 0x7fbbd815dc00 2024-04-02T07:24:00.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbe0600640 1 -- 172.21.15.55:0/735829709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd815d6e0 con 0x7fbbd815dc00 2024-04-02T07:24:00.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.463+0000 7fbbe0600640 1 -- 172.21.15.55:0/735829709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd815d900 con 0x7fbbd815dc00 2024-04-02T07:24:00.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.467+0000 7fbbd5600640 1 -- 172.21.15.55:0/735829709 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fbbd000ad30 con 0x7fbbd815dc00 2024-04-02T07:24:00.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.467+0000 7fbbd5600640 1 --2- 172.21.15.55:0/735829709 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbbb8066690 0x7fbbb8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:00.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.467+0000 7fbbd5600640 1 -- 172.21.15.55:0/735829709 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbd0083720 con 0x7fbbd815dc00 2024-04-02T07:24:00.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.467+0000 7fbbddc00640 1 --2- 172.21.15.55:0/735829709 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbbb8066690 0x7fbbb8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:00.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.467+0000 7fbbddc00640 1 --2- 172.21.15.55:0/735829709 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbbb8066690 0x7fbbb8068b50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbbd806f5f0 tx=0x7fbbcc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:00.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.471+0000 7fbbd5600640 1 -- 172.21.15.55:0/735829709 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fbbd0050aa0 con 0x7fbbd815dc00 2024-04-02T07:24:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.667+0000 7fbbe0600640 1 -- 172.21.15.55:0/735829709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbd8066c90 con 0x7fbbd815dc00 2024-04-02T07:24:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.667+0000 7fbbd5600640 1 -- 172.21.15.55:0/735829709 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4725 (secure 0 0 0) 0x7fbbd0018090 con 0x7fbbd815dc00 2024-04-02T07:24:00.670 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:00.670 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4883,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53106343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53106343},{"type":"v1","addr":"172.21.15.55:6833","nonce":53106343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/44669622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":44669622},{"type":"v1","addr":"172.21.15.106:6837","nonce":44669622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/741637637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":741637637},{"type":"v1","addr":"172.21.15.106:6836","nonce":741637637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:23:25.727369+0000","modified":"2024-04-02T07:23:29.049370+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/2440784960","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":2440784960},{"type":"v1","addr":"172.21.15.55:6835","nonce":2440784960}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2024-04-02T07:24:00.670 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 17 2024-04-02T07:24:00.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.667+0000 7fbbe0600640 1 -- 172.21.15.55:0/735829709 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbbb8066690 msgr2=0x7fbbb8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.667+0000 7fbbe0600640 1 --2- 172.21.15.55:0/735829709 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbbb8066690 0x7fbbb8068b50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fbbd806f5f0 tx=0x7fbbcc008040 comp rx=0 tx=0).stop 2024-04-02T07:24:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.667+0000 7fbbe0600640 1 -- 172.21.15.55:0/735829709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbd815dc00 msgr2=0x7fbbd8155220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.667+0000 7fbbe0600640 1 --2- 172.21.15.55:0/735829709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbd815dc00 0x7fbbd8155220 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fbbd000c7a0 tx=0x7fbbd000cc60 comp rx=0 tx=0).stop 2024-04-02T07:24:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.667+0000 7fbbe0600640 1 -- 172.21.15.55:0/735829709 shutdown_connections 2024-04-02T07:24:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.667+0000 7fbbe0600640 1 --2- 172.21.15.55:0/735829709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbbd815dc00 0x7fbbd8155220 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.667+0000 7fbbe0600640 1 --2- 172.21.15.55:0/735829709 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbbd815c8b0 0x7fbbd8154ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.667+0000 7fbbe0600640 1 --2- 172.21.15.55:0/735829709 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbbb8066690 0x7fbbb8068b50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.667+0000 7fbbe0600640 1 --2- 172.21.15.55:0/735829709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbbd80aecb0 0x7fbbd815f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.667+0000 7fbbe0600640 1 -- 172.21.15.55:0/735829709 >> 172.21.15.55:0/735829709 conn(0x7fbbd80b13b0 msgr2=0x7fbbd80b31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.667+0000 7fbbe0600640 1 -- 172.21.15.55:0/735829709 shutdown_connections 2024-04-02T07:24:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.667+0000 7fbbe0600640 1 -- 172.21.15.55:0/735829709 wait complete. 2024-04-02T07:24:00.690 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:24:00.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.827+0000 7f541f200640 1 Processor -- start 2024-04-02T07:24:00.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.827+0000 7f541f200640 1 -- start start 2024-04-02T07:24:00.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.831+0000 7f541f200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f54180b19d0 0x7f54180ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:00.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.831+0000 7f541f200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54180cf3d0 con 0x7f5418099120 2024-04-02T07:24:00.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.831+0000 7f541f200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54180cf6b0 con 0x7f541806c0d0 2024-04-02T07:24:00.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.831+0000 7f541f200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54180cf990 con 0x7f54180b19d0 2024-04-02T07:24:00.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.831+0000 7f5417e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f54180b19d0 0x7f54180ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:00.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.831+0000 7f5417e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f54180b19d0 0x7f54180ce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51304/0 (socket says 172.21.15.55:51304) 2024-04-02T07:24:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.831+0000 7f541d200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5418099120 0x7f541815c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50094/0 (socket says 172.21.15.55:50094) 2024-04-02T07:24:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.831+0000 7f5417e00640 1 -- 172.21.15.55:0/3185362261 learned_addr learned my addr 172.21.15.55:0/3185362261 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.831+0000 7f5417e00640 1 -- 172.21.15.55:0/3185362261 >> v1:172.21.15.106:6789/0 conn(0x7f541806c0d0 legacy=0x7f5418098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.831+0000 7f5417e00640 1 -- 172.21.15.55:0/3185362261 >> v1:172.21.15.55:6789/0 conn(0x7f5418099120 legacy=0x7f541815c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.831+0000 7f5417e00640 1 -- 172.21.15.55:0/3185362261 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54180cfc70 con 0x7f54180b19d0 2024-04-02T07:24:00.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f5417e00640 1 --2- 172.21.15.55:0/3185362261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54180b19d0 0x7f54180ce9d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5408009870 tx=0x7f540801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460e68b11fbe249f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:00.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f5417400640 1 -- 172.21.15.55:0/3185362261 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54080ab670 con 0x7f54180b19d0 2024-04-02T07:24:00.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f5417400640 1 -- 172.21.15.55:0/3185362261 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54080ab7d0 con 0x7f54180b19d0 2024-04-02T07:24:00.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f5417400640 1 -- 172.21.15.55:0/3185362261 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54080abb60 con 0x7f54180b19d0 2024-04-02T07:24:00.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f541f200640 1 -- 172.21.15.55:0/3185362261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54180b19d0 msgr2=0x7f54180ce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:00.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f541f200640 1 --2- 172.21.15.55:0/3185362261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54180b19d0 0x7f54180ce9d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5408009870 tx=0x7f540801c560 comp rx=0 tx=0).stop 2024-04-02T07:24:00.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f541f200640 1 -- 172.21.15.55:0/3185362261 shutdown_connections 2024-04-02T07:24:00.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f541f200640 1 --2- 172.21.15.55:0/3185362261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54180b19d0 0x7f54180ce9d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f541f200640 1 -- 172.21.15.55:0/3185362261 >> 172.21.15.55:0/3185362261 conn(0x7f54180b2150 msgr2=0x7f54180b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:00.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f541f200640 1 -- 172.21.15.55:0/3185362261 shutdown_connections 2024-04-02T07:24:00.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f541f200640 1 -- 172.21.15.55:0/3185362261 wait complete. 2024-04-02T07:24:00.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f541f200640 1 Processor -- start 2024-04-02T07:24:00.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f541f200640 1 -- start start 2024-04-02T07:24:00.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f541f200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f541806c0d0 0x7f5418157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:00.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f541f200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5418099120 0x7f54180b5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:00.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f541f200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54180b19d0 0x7f54180b3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:00.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f541f200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54180b58a0 con 0x7f54180b19d0 2024-04-02T07:24:00.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f541f200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54180b41f0 con 0x7f5418099120 2024-04-02T07:24:00.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f541f200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54181576f0 con 0x7f541806c0d0 2024-04-02T07:24:00.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f541d200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54180b19d0 0x7f54180b3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:00.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f5417e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f541806c0d0 0x7f5418157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:00.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f541d200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54180b19d0 0x7f54180b3cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51312/0 (socket says 172.21.15.55:51312) 2024-04-02T07:24:00.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f541d200640 1 -- 172.21.15.55:0/2141411846 learned_addr learned my addr 172.21.15.55:0/2141411846 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:00.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.835+0000 7f540fe00640 1 --2- 172.21.15.55:0/2141411846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5418099120 0x7f54180b5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:00.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.839+0000 7f541d200640 1 -- 172.21.15.55:0/2141411846 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f541806c0d0 msgr2=0x7f5418157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:00.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.839+0000 7f541d200640 1 --2- 172.21.15.55:0/2141411846 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f541806c0d0 0x7f5418157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.839+0000 7f541d200640 1 -- 172.21.15.55:0/2141411846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5418099120 msgr2=0x7f54180b5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:00.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.839+0000 7f541d200640 1 --2- 172.21.15.55:0/2141411846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5418099120 0x7f54180b5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:00.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.839+0000 7f541d200640 1 -- 172.21.15.55:0/2141411846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54080094d0 con 0x7f54180b19d0 2024-04-02T07:24:00.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.839+0000 7f5417e00640 1 --2- 172.21.15.55:0/2141411846 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f541806c0d0 0x7f5418157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:24:00.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.839+0000 7f541d200640 1 --2- 172.21.15.55:0/2141411846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54180b19d0 0x7f54180b3cb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f541000c7a0 tx=0x7f541000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:00.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.839+0000 7f5414c00640 1 -- 172.21.15.55:0/2141411846 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541000a640 con 0x7f54180b19d0 2024-04-02T07:24:00.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.839+0000 7f5414c00640 1 -- 172.21.15.55:0/2141411846 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f541000a7a0 con 0x7f54180b19d0 2024-04-02T07:24:00.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.839+0000 7f5414c00640 1 -- 172.21.15.55:0/2141411846 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f541000ab10 con 0x7f54180b19d0 2024-04-02T07:24:00.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.839+0000 7f541f200640 1 -- 172.21.15.55:0/2141411846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54180b45c0 con 0x7f54180b19d0 2024-04-02T07:24:00.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.839+0000 7f541f200640 1 -- 172.21.15.55:0/2141411846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54180b4b80 con 0x7f54180b19d0 2024-04-02T07:24:00.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.839+0000 7f541f200640 1 -- 172.21.15.55:0/2141411846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5418066c90 con 0x7f54180b19d0 2024-04-02T07:24:00.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.839+0000 7f5414c00640 1 -- 172.21.15.55:0/2141411846 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f541000ac70 con 0x7f54180b19d0 2024-04-02T07:24:00.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.843+0000 7f5414c00640 1 --2- 172.21.15.55:0/2141411846 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f53f4066690 0x7f53f4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:00.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.843+0000 7f5414c00640 1 -- 172.21.15.55:0/2141411846 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5410083a00 con 0x7f54180b19d0 2024-04-02T07:24:00.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.843+0000 7f5417e00640 1 --2- 172.21.15.55:0/2141411846 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f53f4066690 0x7f53f4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:00.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.843+0000 7f5417e00640 1 --2- 172.21.15.55:0/2141411846 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f53f4066690 0x7f53f4068b50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f54080af000 tx=0x7f54080b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:00.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:00.843+0000 7f5414c00640 1 -- 172.21.15.55:0/2141411846 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5410050d80 con 0x7f54180b19d0 2024-04-02T07:24:01.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.007+0000 7f541f200640 1 -- 172.21.15.55:0/2141411846 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f54180b64e0 con 0x7f54180b19d0 2024-04-02T07:24:01.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.007+0000 7f5414c00640 1 -- 172.21.15.55:0/2141411846 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16101 (secure 0 0 0) 0x7f5410017020 con 0x7f54180b19d0 2024-04-02T07:24:01.011 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:01.011 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":34,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:23:26.730146+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:23:23.729158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-04-02T07:23:24.740958+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:24:01.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.011+0000 7f541f200640 1 -- 172.21.15.55:0/2141411846 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f53f4066690 msgr2=0x7f53f4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:01.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.011+0000 7f541f200640 1 --2- 172.21.15.55:0/2141411846 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f53f4066690 0x7f53f4068b50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f54080af000 tx=0x7f54080b6040 comp rx=0 tx=0).stop 2024-04-02T07:24:01.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.011+0000 7f541f200640 1 -- 172.21.15.55:0/2141411846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54180b19d0 msgr2=0x7f54180b3cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:01.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.011+0000 7f541f200640 1 --2- 172.21.15.55:0/2141411846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54180b19d0 0x7f54180b3cb0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f541000c7a0 tx=0x7f541000cc60 comp rx=0 tx=0).stop 2024-04-02T07:24:01.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.011+0000 7f541f200640 1 -- 172.21.15.55:0/2141411846 shutdown_connections 2024-04-02T07:24:01.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.011+0000 7f541f200640 1 --2- 172.21.15.55:0/2141411846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f54180b19d0 0x7f54180b3cb0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.011+0000 7f541f200640 1 --2- 172.21.15.55:0/2141411846 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f53f4066690 0x7f53f4068b50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.011+0000 7f541f200640 1 --2- 172.21.15.55:0/2141411846 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5418099120 0x7f54180b5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.011+0000 7f541f200640 1 --2- 172.21.15.55:0/2141411846 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f541806c0d0 0x7f5418157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.011+0000 7f541f200640 1 -- 172.21.15.55:0/2141411846 >> 172.21.15.55:0/2141411846 conn(0x7f54180b2150 msgr2=0x7f541806fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:01.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.011+0000 7f541f200640 1 -- 172.21.15.55:0/2141411846 shutdown_connections 2024-04-02T07:24:01.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.011+0000 7f541f200640 1 -- 172.21.15.55:0/2141411846 wait complete. 2024-04-02T07:24:01.032 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-02T07:24:01.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.171+0000 7f13c0800640 1 Processor -- start 2024-04-02T07:24:01.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.171+0000 7f13c0800640 1 -- start start 2024-04-02T07:24:01.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.171+0000 7f13c0800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13b81599c0 0x7f13b80b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:01.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.171+0000 7f13c0800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f13b806d1c0 0x7f13b80b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:01.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.171+0000 7f13c0800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13b80afe70 0x7f13b80b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:01.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.171+0000 7f13c0800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b806cda0 con 0x7f13b80afe70 2024-04-02T07:24:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.171+0000 7f13c0800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b80b3c60 con 0x7f13b806d1c0 2024-04-02T07:24:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.171+0000 7f13c0800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b80b1d60 con 0x7f13b81599c0 2024-04-02T07:24:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.171+0000 7f13be800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13b80afe70 0x7f13b80b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.171+0000 7f13be800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13b80afe70 0x7f13b80b3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51322/0 (socket says 172.21.15.55:51322) 2024-04-02T07:24:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.171+0000 7f13be800640 1 -- 172.21.15.55:0/1390292981 learned_addr learned my addr 172.21.15.55:0/1390292981 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.171+0000 7f13be800640 1 -- 172.21.15.55:0/1390292981 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13b81599c0 msgr2=0x7f13b80b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.171+0000 7f13bd400640 1 --2- 172.21.15.55:0/1390292981 >> v2:172.21.15.106:3300/0 conn(0x7f13b806d1c0 0x7f13b80b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.171+0000 7f13bde00640 1 --2- 172.21.15.55:0/1390292981 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13b81599c0 0x7f13b80b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.171+0000 7f13be800640 1 --2- 172.21.15.55:0/1390292981 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13b81599c0 0x7f13b80b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.171+0000 7f13be800640 1 -- 172.21.15.55:0/1390292981 >> v2:172.21.15.106:3300/0 conn(0x7f13b806d1c0 msgr2=0x7f13b80b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.171+0000 7f13be800640 1 --2- 172.21.15.55:0/1390292981 >> v2:172.21.15.106:3300/0 conn(0x7f13b806d1c0 0x7f13b80b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.171+0000 7f13be800640 1 -- 172.21.15.55:0/1390292981 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b806c400 con 0x7f13b80afe70 2024-04-02T07:24:01.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.171+0000 7f13bde00640 1 --2- 172.21.15.55:0/1390292981 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13b81599c0 0x7f13b80b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:24:01.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.171+0000 7f13bd400640 1 --2- 172.21.15.55:0/1390292981 >> v2:172.21.15.106:3300/0 conn(0x7f13b806d1c0 0x7f13b80b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:24:01.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.175+0000 7f13be800640 1 --2- 172.21.15.55:0/1390292981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b80afe70 0x7f13b80b3720 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f13b806ab00 tx=0x7f13b401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c76703d35b3ea3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:01.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.175+0000 7f13bca00640 1 -- 172.21.15.55:0/1390292981 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b40a5760 con 0x7f13b80afe70 2024-04-02T07:24:01.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.175+0000 7f13bca00640 1 -- 172.21.15.55:0/1390292981 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b40a58c0 con 0x7f13b80afe70 2024-04-02T07:24:01.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.175+0000 7f13bca00640 1 -- 172.21.15.55:0/1390292981 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b40a5c50 con 0x7f13b80afe70 2024-04-02T07:24:01.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.175+0000 7f13c0800640 1 -- 172.21.15.55:0/1390292981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b80afe70 msgr2=0x7f13b80b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:01.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.175+0000 7f13c0800640 1 --2- 172.21.15.55:0/1390292981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b80afe70 0x7f13b80b3720 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f13b806ab00 tx=0x7f13b401c9f0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.175+0000 7f13c0800640 1 -- 172.21.15.55:0/1390292981 shutdown_connections 2024-04-02T07:24:01.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.175+0000 7f13c0800640 1 --2- 172.21.15.55:0/1390292981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b80afe70 0x7f13b80b3720 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.175+0000 7f13c0800640 1 --2- 172.21.15.55:0/1390292981 >> v2:172.21.15.106:3300/0 conn(0x7f13b806d1c0 0x7f13b80b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.175+0000 7f13c0800640 1 --2- 172.21.15.55:0/1390292981 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13b81599c0 0x7f13b80b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.175+0000 7f13c0800640 1 -- 172.21.15.55:0/1390292981 >> 172.21.15.55:0/1390292981 conn(0x7f13b8069d90 msgr2=0x7f13b806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:01.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.175+0000 7f13c0800640 1 -- 172.21.15.55:0/1390292981 shutdown_connections 2024-04-02T07:24:01.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.175+0000 7f13c0800640 1 -- 172.21.15.55:0/1390292981 wait complete. 2024-04-02T07:24:01.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13c0800640 1 Processor -- start 2024-04-02T07:24:01.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13c0800640 1 -- start start 2024-04-02T07:24:01.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13c0800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13b806d1c0 0x7f13b81469b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:01.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13c0800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13b80afe70 0x7f13b81570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:01.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13c0800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b81599c0 0x7f13b815a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:01.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13c0800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b814d690 con 0x7f13b81599c0 2024-04-02T07:24:01.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13c0800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b8146ef0 con 0x7f13b80afe70 2024-04-02T07:24:01.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13c0800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b8157b70 con 0x7f13b806d1c0 2024-04-02T07:24:01.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13be800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b81599c0 0x7f13b815a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:01.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13bde00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13b806d1c0 0x7f13b81469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:01.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13be800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b81599c0 0x7f13b815a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51328/0 (socket says 172.21.15.55:51328) 2024-04-02T07:24:01.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13be800640 1 -- 172.21.15.55:0/1116516213 learned_addr learned my addr 172.21.15.55:0/1116516213 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:01.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13bd400640 1 --2- 172.21.15.55:0/1116516213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13b80afe70 0x7f13b81570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:01.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13be800640 1 -- 172.21.15.55:0/1116516213 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13b806d1c0 msgr2=0x7f13b81469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:01.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13be800640 1 --2- 172.21.15.55:0/1116516213 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13b806d1c0 0x7f13b81469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13be800640 1 -- 172.21.15.55:0/1116516213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13b80afe70 msgr2=0x7f13b81570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:01.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13be800640 1 --2- 172.21.15.55:0/1116516213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13b80afe70 0x7f13b81570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13be800640 1 -- 172.21.15.55:0/1116516213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b4009b30 con 0x7f13b81599c0 2024-04-02T07:24:01.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13be800640 1 --2- 172.21.15.55:0/1116516213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b81599c0 0x7f13b815a9a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f13b40af040 tx=0x7f13b4019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:01.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13b2000640 1 -- 172.21.15.55:0/1116516213 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b40b8670 con 0x7f13b81599c0 2024-04-02T07:24:01.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13b2000640 1 -- 172.21.15.55:0/1116516213 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13b40b87d0 con 0x7f13b81599c0 2024-04-02T07:24:01.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13b2000640 1 -- 172.21.15.55:0/1116516213 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13b40b8b60 con 0x7f13b81599c0 2024-04-02T07:24:01.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13c0800640 1 -- 172.21.15.55:0/1116516213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13b8157e50 con 0x7f13b81599c0 2024-04-02T07:24:01.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.179+0000 7f13c0800640 1 -- 172.21.15.55:0/1116516213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b814db80 con 0x7f13b81599c0 2024-04-02T07:24:01.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.183+0000 7f13c0800640 1 -- 172.21.15.55:0/1116516213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b806e270 con 0x7f13b81599c0 2024-04-02T07:24:01.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.183+0000 7f13b2000640 1 -- 172.21.15.55:0/1116516213 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f13b40b8cc0 con 0x7f13b81599c0 2024-04-02T07:24:01.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.183+0000 7f13b2000640 1 --2- 172.21.15.55:0/1116516213 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f139c066690 0x7f139c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:01.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.183+0000 7f13b2000640 1 -- 172.21.15.55:0/1116516213 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13b411f910 con 0x7f13b81599c0 2024-04-02T07:24:01.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.183+0000 7f13bde00640 1 --2- 172.21.15.55:0/1116516213 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f139c066690 0x7f139c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:01.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.183+0000 7f13bde00640 1 --2- 172.21.15.55:0/1116516213 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f139c066690 0x7f139c068b50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f13ac006fd0 tx=0x7f13ac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:01.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.187+0000 7f13b2000640 1 -- 172.21.15.55:0/1116516213 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f13b40ecfa0 con 0x7f13b81599c0 2024-04-02T07:24:01.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.383+0000 7f13c0800640 1 -- 172.21.15.55:0/1116516213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f13b814dd70 con 0x7f13b81599c0 2024-04-02T07:24:01.387 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-02T07:24:01.387+0000 7f8f18800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-02T07:24:01.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.403+0000 7f13b2000640 1 -- 172.21.15.55:0/1116516213 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v18) v1 ==== 161+0+0 (secure 0 0 0) 0x7f13b40bc090 con 0x7f13b81599c0 2024-04-02T07:24:01.406 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-02T07:24:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.403+0000 7f13c0800640 1 -- 172.21.15.55:0/1116516213 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f139c066690 msgr2=0x7f139c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.403+0000 7f13c0800640 1 --2- 172.21.15.55:0/1116516213 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f139c066690 0x7f139c068b50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f13ac006fd0 tx=0x7f13ac008040 comp rx=0 tx=0).stop 2024-04-02T07:24:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.403+0000 7f13c0800640 1 -- 172.21.15.55:0/1116516213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b81599c0 msgr2=0x7f13b815a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.403+0000 7f13c0800640 1 --2- 172.21.15.55:0/1116516213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b81599c0 0x7f13b815a9a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f13b40af040 tx=0x7f13b4019790 comp rx=0 tx=0).stop 2024-04-02T07:24:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.407+0000 7f13c0800640 1 -- 172.21.15.55:0/1116516213 shutdown_connections 2024-04-02T07:24:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.407+0000 7f13c0800640 1 --2- 172.21.15.55:0/1116516213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13b81599c0 0x7f13b815a9a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.407+0000 7f13c0800640 1 --2- 172.21.15.55:0/1116516213 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f139c066690 0x7f139c068b50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.407+0000 7f13c0800640 1 --2- 172.21.15.55:0/1116516213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13b80afe70 0x7f13b81570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.407+0000 7f13c0800640 1 --2- 172.21.15.55:0/1116516213 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13b806d1c0 0x7f13b81469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.407+0000 7f13c0800640 1 -- 172.21.15.55:0/1116516213 >> 172.21.15.55:0/1116516213 conn(0x7f13b8069d90 msgr2=0x7f13b806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:01.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.407+0000 7f13c0800640 1 -- 172.21.15.55:0/1116516213 shutdown_connections 2024-04-02T07:24:01.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.407+0000 7f13c0800640 1 -- 172.21.15.55:0/1116516213 wait complete. 2024-04-02T07:24:01.416 INFO:tasks.ceph.mds.a.smithi055.stderr: -5830> 2024-04-02T07:23:29.059+0000 7fb56f200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:24:01.428 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-02T07:24:01.471 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-02T07:24:01.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdee4200640 1 Processor -- start 2024-04-02T07:24:01.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdee4200640 1 -- start start 2024-04-02T07:24:01.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdee4200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdedc15c920 0x7fdedc0b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:01.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdee4200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdedc15de30 con 0x7fdedc0afa70 2024-04-02T07:24:01.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdee4200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdedc098ab0 con 0x7fdedc0cd690 2024-04-02T07:24:01.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdee4200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdedc098d90 con 0x7fdedc15c920 2024-04-02T07:24:01.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdee0e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdedc0afa70 0x7fdedc0ccf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50102/0 (socket says 172.21.15.55:50102) 2024-04-02T07:24:01.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdee0e00640 1 -- 172.21.15.55:0/2320844961 learned_addr learned my addr 172.21.15.55:0/2320844961 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:01.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdee1800640 1 --2- 172.21.15.55:0/2320844961 >> v2:172.21.15.106:3300/0 conn(0x7fdedc15c920 0x7fdedc0b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:01.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdedbe00640 1 -- 172.21.15.55:0/2320844961 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2440000456 0 0) 0x7fdedc15de30 con 0x7fdedc0afa70 2024-04-02T07:24:01.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdedbe00640 1 -- 172.21.15.55:0/2320844961 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdec4003530 con 0x7fdedc0afa70 2024-04-02T07:24:01.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdedbe00640 1 -- 172.21.15.55:0/2320844961 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3208081946 0 0) 0x7fdec4003530 con 0x7fdedc0afa70 2024-04-02T07:24:01.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdedbe00640 1 -- 172.21.15.55:0/2320844961 >> v2:172.21.15.106:3300/0 conn(0x7fdedc15c920 msgr2=0x7fdedc0b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:01.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdedbe00640 1 --2- 172.21.15.55:0/2320844961 >> v2:172.21.15.106:3300/0 conn(0x7fdedc15c920 0x7fdedc0b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdedbe00640 1 -- 172.21.15.55:0/2320844961 >> v1:172.21.15.106:6789/0 conn(0x7fdedc0cd690 legacy=0x7fdedc06aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:01.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdedbe00640 1 -- 172.21.15.55:0/2320844961 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc099070 con 0x7fdedc0afa70 2024-04-02T07:24:01.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdedbe00640 1 -- 172.21.15.55:0/2320844961 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fdec8001680 con 0x7fdedc0afa70 2024-04-02T07:24:01.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdedbe00640 1 -- 172.21.15.55:0/2320844961 >> v1:172.21.15.55:6789/0 conn(0x7fdedc0afa70 legacy=0x7fdedc0ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:01.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdedbe00640 1 --2- 172.21.15.55:0/2320844961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdec40039d0 0x7fdec4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:01.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdedbe00640 1 --2- 172.21.15.55:0/2320844961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdec40047d0 0x7fdec4004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:01.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdedbe00640 1 --2- 172.21.15.55:0/2320844961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec4005190 0x7fdec400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:01.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdedbe00640 1 -- 172.21.15.55:0/2320844961 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc098d90 con 0x7fdec4005190 2024-04-02T07:24:01.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdedbe00640 1 -- 172.21.15.55:0/2320844961 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdec400c090 con 0x7fdec40039d0 2024-04-02T07:24:01.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdedbe00640 1 -- 172.21.15.55:0/2320844961 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdec400c250 con 0x7fdec40047d0 2024-04-02T07:24:01.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.571+0000 7fdee2200640 1 --2- 172.21.15.55:0/2320844961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec4005190 0x7fdec400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:01.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.575+0000 7fdee1800640 1 --2- 172.21.15.55:0/2320844961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdec40039d0 0x7fdec4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:01.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.575+0000 7fdee0e00640 1 --2- 172.21.15.55:0/2320844961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdec40047d0 0x7fdec4004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:01.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.575+0000 7fdee2200640 1 -- 172.21.15.55:0/2320844961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdec40047d0 msgr2=0x7fdec4004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:01.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.575+0000 7fdee2200640 1 --2- 172.21.15.55:0/2320844961 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdec40047d0 0x7fdec4004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.575+0000 7fdee2200640 1 -- 172.21.15.55:0/2320844961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdec40039d0 msgr2=0x7fdec4003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:01.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.575+0000 7fdee2200640 1 --2- 172.21.15.55:0/2320844961 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdec40039d0 0x7fdec4003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.575+0000 7fdee2200640 1 -- 172.21.15.55:0/2320844961 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec4003530 con 0x7fdec4005190 2024-04-02T07:24:01.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.575+0000 7fdee2200640 1 -- 172.21.15.55:0/2320844961 reap_dead start 2024-04-02T07:24:01.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.575+0000 7fdee2200640 1 --2- 172.21.15.55:0/2320844961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec4005190 0x7fdec400b990 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fded4001e40 tx=0x7fded401c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2e673bc23decfb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:01.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.575+0000 7fdedbe00640 1 -- 172.21.15.55:0/2320844961 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded4003b80 con 0x7fdec4005190 2024-04-02T07:24:01.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.575+0000 7fdedbe00640 1 -- 172.21.15.55:0/2320844961 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded4003ce0 con 0x7fdec4005190 2024-04-02T07:24:01.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.575+0000 7fdedbe00640 1 -- 172.21.15.55:0/2320844961 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded4005260 con 0x7fdec4005190 2024-04-02T07:24:01.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.575+0000 7fdee4200640 1 -- 172.21.15.55:0/2320844961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec4005190 msgr2=0x7fdec400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:01.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.575+0000 7fdee4200640 1 --2- 172.21.15.55:0/2320844961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec4005190 0x7fdec400b990 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fded4001e40 tx=0x7fded401c760 comp rx=0 tx=0).stop 2024-04-02T07:24:01.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee4200640 1 -- 172.21.15.55:0/2320844961 shutdown_connections 2024-04-02T07:24:01.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee4200640 1 --2- 172.21.15.55:0/2320844961 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdec4005190 0x7fdec400b990 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee4200640 1 -- 172.21.15.55:0/2320844961 >> 172.21.15.55:0/2320844961 conn(0x7fdedc0d0700 msgr2=0x7fdedc0d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:01.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee4200640 1 -- 172.21.15.55:0/2320844961 shutdown_connections 2024-04-02T07:24:01.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee4200640 1 -- 172.21.15.55:0/2320844961 wait complete. 2024-04-02T07:24:01.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee4200640 1 Processor -- start 2024-04-02T07:24:01.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee4200640 1 -- start start 2024-04-02T07:24:01.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee4200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdec4005190 0x7fdedc154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:01.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee4200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdedc1f18e0 0x7fdedc0b04b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:01.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee4200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdedc0b09f0 0x7fdedc0cbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:01.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee4200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0b0e70 con 0x7fdedc0b09f0 2024-04-02T07:24:01.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee4200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0c7870 con 0x7fdec4005190 2024-04-02T07:24:01.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee4200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdedc0c7b10 con 0x7fdedc1f18e0 2024-04-02T07:24:01.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee2200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdedc0b09f0 0x7fdedc0cbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:01.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee2200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdedc0b09f0 0x7fdedc0cbaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51368/0 (socket says 172.21.15.55:51368) 2024-04-02T07:24:01.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee2200640 1 -- 172.21.15.55:0/2549158638 learned_addr learned my addr 172.21.15.55:0/2549158638 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:01.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee1800640 1 --2- 172.21.15.55:0/2549158638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdec4005190 0x7fdedc154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:01.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee0e00640 1 --2- 172.21.15.55:0/2549158638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdedc1f18e0 0x7fdedc0b04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:01.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee2200640 1 -- 172.21.15.55:0/2549158638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdedc1f18e0 msgr2=0x7fdedc0b04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:01.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee2200640 1 --2- 172.21.15.55:0/2549158638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdedc1f18e0 0x7fdedc0b04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee2200640 1 -- 172.21.15.55:0/2549158638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdec4005190 msgr2=0x7fdedc154b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:01.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee2200640 1 --2- 172.21.15.55:0/2549158638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdec4005190 0x7fdedc154b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:01.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee2200640 1 -- 172.21.15.55:0/2549158638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc0c7df0 con 0x7fdedc0b09f0 2024-04-02T07:24:01.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee1800640 1 --2- 172.21.15.55:0/2549158638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdec4005190 0x7fdedc154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:24:01.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee0e00640 1 --2- 172.21.15.55:0/2549158638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdedc1f18e0 0x7fdedc0b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:24:01.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee2200640 1 --2- 172.21.15.55:0/2549158638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdedc0b09f0 0x7fdedc0cbaf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fded401d000 tx=0x7fdec4005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:01.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fded9600640 1 -- 172.21.15.55:0/2549158638 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded40b1660 con 0x7fdedc0b09f0 2024-04-02T07:24:01.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fded9600640 1 -- 172.21.15.55:0/2549158638 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fded40b17c0 con 0x7fdedc0b09f0 2024-04-02T07:24:01.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.579+0000 7fdee4200640 1 -- 172.21.15.55:0/2549158638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdedc0c80d0 con 0x7fdedc0b09f0 2024-04-02T07:24:01.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.583+0000 7fded9600640 1 -- 172.21.15.55:0/2549158638 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fded40b1b50 con 0x7fdedc0b09f0 2024-04-02T07:24:01.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.583+0000 7fdee4200640 1 -- 172.21.15.55:0/2549158638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdedc1f1d60 con 0x7fdedc0b09f0 2024-04-02T07:24:01.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.583+0000 7fdee4200640 1 -- 172.21.15.55:0/2549158638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdedc066c90 con 0x7fdedc0b09f0 2024-04-02T07:24:01.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.583+0000 7fded9600640 1 -- 172.21.15.55:0/2549158638 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fded40a6460 con 0x7fdedc0b09f0 2024-04-02T07:24:01.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.583+0000 7fded9600640 1 --2- 172.21.15.55:0/2549158638 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdebc0666c0 0x7fdebc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:01.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.583+0000 7fded9600640 1 -- 172.21.15.55:0/2549158638 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fded411dcc0 con 0x7fdedc0b09f0 2024-04-02T07:24:01.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.583+0000 7fdee1800640 1 --2- 172.21.15.55:0/2549158638 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdebc0666c0 0x7fdebc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:01.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.587+0000 7fdee1800640 1 --2- 172.21.15.55:0/2549158638 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdebc0666c0 0x7fdebc068b80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fded00093f0 tx=0x7fded0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:01.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.587+0000 7fded9600640 1 -- 172.21.15.55:0/2549158638 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fded4124080 con 0x7fdedc0b09f0 2024-04-02T07:24:01.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:01.787+0000 7fdee4200640 1 -- 172.21.15.55:0/2549158638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdedc0b0e70 con 0x7fdedc0b09f0 2024-04-02T07:24:02.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.407+0000 7fded9600640 1 -- 172.21.15.55:0/2549158638 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdedc0b0e70 con 0x7fdedc0b09f0 2024-04-02T07:24:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.407+0000 7fdee4200640 1 -- 172.21.15.55:0/2549158638 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdebc0666c0 msgr2=0x7fdebc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.407+0000 7fdee4200640 1 --2- 172.21.15.55:0/2549158638 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdebc0666c0 0x7fdebc068b80 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fded00093f0 tx=0x7fded0008040 comp rx=0 tx=0).stop 2024-04-02T07:24:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.407+0000 7fdee4200640 1 -- 172.21.15.55:0/2549158638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdedc0b09f0 msgr2=0x7fdedc0cbaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.407+0000 7fdee4200640 1 --2- 172.21.15.55:0/2549158638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdedc0b09f0 0x7fdedc0cbaf0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fded401d000 tx=0x7fdec4005800 comp rx=0 tx=0).stop 2024-04-02T07:24:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.407+0000 7fdee4200640 1 -- 172.21.15.55:0/2549158638 shutdown_connections 2024-04-02T07:24:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.407+0000 7fdee4200640 1 --2- 172.21.15.55:0/2549158638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdedc0b09f0 0x7fdedc0cbaf0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.407+0000 7fdee4200640 1 --2- 172.21.15.55:0/2549158638 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdedc1f18e0 0x7fdedc0b04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.407+0000 7fdee4200640 1 --2- 172.21.15.55:0/2549158638 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdebc0666c0 0x7fdebc068b80 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.407+0000 7fdee4200640 1 --2- 172.21.15.55:0/2549158638 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdec4005190 0x7fdedc154b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.407+0000 7fdee4200640 1 -- 172.21.15.55:0/2549158638 >> 172.21.15.55:0/2549158638 conn(0x7fdedc0d0700 msgr2=0x7fdedc0cfe80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.407+0000 7fdee4200640 1 -- 172.21.15.55:0/2549158638 shutdown_connections 2024-04-02T07:24:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.407+0000 7fdee4200640 1 -- 172.21.15.55:0/2549158638 wait complete. 2024-04-02T07:24:02.435 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-02T07:24:02.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.623+0000 7f973c800640 1 Processor -- start 2024-04-02T07:24:02.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.623+0000 7f973c800640 1 -- start start 2024-04-02T07:24:02.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.623+0000 7f973c800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f973406ccc0 0x7f973406c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:02.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.623+0000 7f973c800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973415d5d0 con 0x7f973406d0a0 2024-04-02T07:24:02.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.623+0000 7f973c800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973415d8b0 con 0x7f97340cb160 2024-04-02T07:24:02.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.623+0000 7f973c800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973415db90 con 0x7f973406ccc0 2024-04-02T07:24:02.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.623+0000 7f9739400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f973406d0a0 0x7f973406d820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50114/0 (socket says 172.21.15.55:50114) 2024-04-02T07:24:02.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.623+0000 7f9739400640 1 -- 172.21.15.55:0/1809678998 learned_addr learned my addr 172.21.15.55:0/1809678998 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:02.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.623+0000 7f9739e00640 1 --2- 172.21.15.55:0/1809678998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f973406ccc0 0x7f973406c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:02.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.623+0000 7f9738a00640 1 -- 172.21.15.55:0/1809678998 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1943315208 0 0) 0x7f973415d5d0 con 0x7f973406d0a0 2024-04-02T07:24:02.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.623+0000 7f9738a00640 1 -- 172.21.15.55:0/1809678998 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f971c003530 con 0x7f973406d0a0 2024-04-02T07:24:02.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.623+0000 7f9738a00640 1 -- 172.21.15.55:0/1809678998 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955754727 0 0) 0x7f973415d8b0 con 0x7f97340cb160 2024-04-02T07:24:02.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.623+0000 7f9738a00640 1 -- 172.21.15.55:0/1809678998 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f973415d5d0 con 0x7f97340cb160 2024-04-02T07:24:02.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.623+0000 7f9739e00640 1 -- 172.21.15.55:0/1809678998 >> v1:172.21.15.106:6789/0 conn(0x7f97340cb160 legacy=0x7f97340705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:02.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.623+0000 7f9739e00640 1 -- 172.21.15.55:0/1809678998 >> v1:172.21.15.55:6789/0 conn(0x7f973406d0a0 legacy=0x7f973406d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:02.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.623+0000 7f9739e00640 1 -- 172.21.15.55:0/1809678998 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973415de70 con 0x7f973406ccc0 2024-04-02T07:24:02.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.627+0000 7f9739e00640 1 --2- 172.21.15.55:0/1809678998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f973406ccc0 0x7f973406c280 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f97280097f0 tx=0x7f972801c480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a87dea69237e945 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:02.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.627+0000 7f9738a00640 1 -- 172.21.15.55:0/1809678998 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97280ab610 con 0x7f973406ccc0 2024-04-02T07:24:02.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.627+0000 7f9738a00640 1 -- 172.21.15.55:0/1809678998 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97280ab770 con 0x7f973406ccc0 2024-04-02T07:24:02.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.627+0000 7f9738a00640 1 -- 172.21.15.55:0/1809678998 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97280abae0 con 0x7f973406ccc0 2024-04-02T07:24:02.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.627+0000 7f973c800640 1 -- 172.21.15.55:0/1809678998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f973406ccc0 msgr2=0x7f973406c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:02.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.627+0000 7f973c800640 1 --2- 172.21.15.55:0/1809678998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f973406ccc0 0x7f973406c280 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f97280097f0 tx=0x7f972801c480 comp rx=0 tx=0).stop 2024-04-02T07:24:02.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.627+0000 7f973c800640 1 -- 172.21.15.55:0/1809678998 shutdown_connections 2024-04-02T07:24:02.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.627+0000 7f973c800640 1 --2- 172.21.15.55:0/1809678998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f973406ccc0 0x7f973406c280 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:02.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.627+0000 7f973c800640 1 -- 172.21.15.55:0/1809678998 >> 172.21.15.55:0/1809678998 conn(0x7f9734069d90 msgr2=0x7f973406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:02.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.627+0000 7f973c800640 1 -- 172.21.15.55:0/1809678998 shutdown_connections 2024-04-02T07:24:02.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.627+0000 7f973c800640 1 -- 172.21.15.55:0/1809678998 wait complete. 2024-04-02T07:24:02.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f973c800640 1 Processor -- start 2024-04-02T07:24:02.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f973c800640 1 -- start start 2024-04-02T07:24:02.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f973c800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f973406ccc0 0x7f9734144fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f973c800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97340cb160 0x7f97341589d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f973c800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97341f4ff0 0x7f973415e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f973c800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973415bae0 con 0x7f97340cb160 2024-04-02T07:24:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f973c800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973415ae60 con 0x7f97341f4ff0 2024-04-02T07:24:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f973c800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973415b140 con 0x7f973406ccc0 2024-04-02T07:24:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f9739400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97340cb160 0x7f97341589d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f9739400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97340cb160 0x7f97341589d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51384/0 (socket says 172.21.15.55:51384) 2024-04-02T07:24:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f9739400640 1 -- 172.21.15.55:0/2333367529 learned_addr learned my addr 172.21.15.55:0/2333367529 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f9739e00640 1 --2- 172.21.15.55:0/2333367529 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f973406ccc0 0x7f9734144fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f973a800640 1 --2- 172.21.15.55:0/2333367529 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97341f4ff0 0x7f973415e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f9739400640 1 -- 172.21.15.55:0/2333367529 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f973406ccc0 msgr2=0x7f9734144fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f9739400640 1 --2- 172.21.15.55:0/2333367529 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f973406ccc0 0x7f9734144fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:02.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f9739400640 1 -- 172.21.15.55:0/2333367529 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97341f4ff0 msgr2=0x7f973415e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f9739400640 1 --2- 172.21.15.55:0/2333367529 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97341f4ff0 0x7f973415e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f9739400640 1 -- 172.21.15.55:0/2333367529 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9728009420 con 0x7f97340cb160 2024-04-02T07:24:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f9739400640 1 --2- 172.21.15.55:0/2333367529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97340cb160 0x7f97341589d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9724005890 tx=0x7f972400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f972e000640 1 -- 172.21.15.55:0/2333367529 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9724005cf0 con 0x7f97340cb160 2024-04-02T07:24:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f972e000640 1 -- 172.21.15.55:0/2333367529 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9724005e50 con 0x7f97340cb160 2024-04-02T07:24:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f972e000640 1 -- 172.21.15.55:0/2333367529 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97240072b0 con 0x7f97340cb160 2024-04-02T07:24:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f973c800640 1 -- 172.21.15.55:0/2333367529 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f973415b420 con 0x7f97340cb160 2024-04-02T07:24:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f973c800640 1 -- 172.21.15.55:0/2333367529 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97341454e0 con 0x7f97340cb160 2024-04-02T07:24:02.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.631+0000 7f973c800640 1 -- 172.21.15.55:0/2333367529 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973415bc20 con 0x7f97340cb160 2024-04-02T07:24:02.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.635+0000 7f972e000640 1 -- 172.21.15.55:0/2333367529 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f9724007410 con 0x7f97340cb160 2024-04-02T07:24:02.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.635+0000 7f972e000640 1 --2- 172.21.15.55:0/2333367529 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97180666c0 0x7f9718068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:02.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.635+0000 7f972e000640 1 -- 172.21.15.55:0/2333367529 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f97240836b0 con 0x7f97340cb160 2024-04-02T07:24:02.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.635+0000 7f9739e00640 1 --2- 172.21.15.55:0/2333367529 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97180666c0 0x7f9718068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:02.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.635+0000 7f9739e00640 1 --2- 172.21.15.55:0/2333367529 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97180666c0 0x7f9718068b80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f97280af000 tx=0x7f97280a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:02.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.639+0000 7f972e000640 1 -- 172.21.15.55:0/2333367529 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f973415bc20 con 0x7f97340cb160 2024-04-02T07:24:02.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:02.799+0000 7f973c800640 1 -- 172.21.15.55:0/2333367529 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f973415bc20 con 0x7f97340cb160 2024-04-02T07:24:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.415+0000 7f972e000640 1 -- 172.21.15.55:0/2333367529 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) v1 ==== 181+0+0 (secure 0 0 0) 0x7f973415bc20 con 0x7f97340cb160 2024-04-02T07:24:03.419 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2024-04-02T07:24:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.419+0000 7f973c800640 1 -- 172.21.15.55:0/2333367529 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97180666c0 msgr2=0x7f9718068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.419+0000 7f973c800640 1 --2- 172.21.15.55:0/2333367529 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97180666c0 0x7f9718068b80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f97280af000 tx=0x7f97280a7000 comp rx=0 tx=0).stop 2024-04-02T07:24:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.419+0000 7f973c800640 1 -- 172.21.15.55:0/2333367529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97340cb160 msgr2=0x7f97341589d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.419+0000 7f973c800640 1 --2- 172.21.15.55:0/2333367529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97340cb160 0x7f97341589d0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f9724005890 tx=0x7f972400c960 comp rx=0 tx=0).stop 2024-04-02T07:24:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.419+0000 7f973c800640 1 -- 172.21.15.55:0/2333367529 shutdown_connections 2024-04-02T07:24:03.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.419+0000 7f973c800640 1 --2- 172.21.15.55:0/2333367529 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97180666c0 0x7f9718068b80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.419+0000 7f973c800640 1 --2- 172.21.15.55:0/2333367529 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f97341f4ff0 0x7f973415e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.419+0000 7f973c800640 1 --2- 172.21.15.55:0/2333367529 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97340cb160 0x7f97341589d0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.419+0000 7f973c800640 1 --2- 172.21.15.55:0/2333367529 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f973406ccc0 0x7f9734144fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.419+0000 7f973c800640 1 -- 172.21.15.55:0/2333367529 >> 172.21.15.55:0/2333367529 conn(0x7f9734069d90 msgr2=0x7f97340b1520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.419+0000 7f973c800640 1 -- 172.21.15.55:0/2333367529 shutdown_connections 2024-04-02T07:24:03.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.419+0000 7f973c800640 1 -- 172.21.15.55:0/2333367529 wait complete. 2024-04-02T07:24:03.447 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-02T07:24:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.591+0000 7f41f7200640 1 Processor -- start 2024-04-02T07:24:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.591+0000 7f41f7200640 1 -- start start 2024-04-02T07:24:03.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.595+0000 7f41f7200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f41f015ce40 0x7f41f00b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:03.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.595+0000 7f41f7200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41f00afe70 0x7f41f00c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.595+0000 7f41f7200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41f00b1d60 con 0x7f41f006d1c0 2024-04-02T07:24:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.595+0000 7f41f7200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41f006cda0 con 0x7f41f015ce40 2024-04-02T07:24:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.595+0000 7f41f7200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f006c400 con 0x7f41f00afe70 2024-04-02T07:24:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.595+0000 7f41efe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f41f015ce40 0x7f41f00b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.595+0000 7f41efe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f41f015ce40 0x7f41f00b1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51386/0 (socket says 172.21.15.55:51386) 2024-04-02T07:24:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.595+0000 7f41efe00640 1 -- 172.21.15.55:0/1743324313 learned_addr learned my addr 172.21.15.55:0/1743324313 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.595+0000 7f41f5200640 1 --2- 172.21.15.55:0/1743324313 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41f00afe70 0x7f41f00c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.595+0000 7f41efe00640 1 -- 172.21.15.55:0/1743324313 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41f00afe70 msgr2=0x7f41f00c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.595+0000 7f41efe00640 1 --2- 172.21.15.55:0/1743324313 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41f00afe70 0x7f41f00c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.595+0000 7f41efe00640 1 -- 172.21.15.55:0/1743324313 >> v1:172.21.15.106:6789/0 conn(0x7f41f006d1c0 legacy=0x7f41f00b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.595+0000 7f41efe00640 1 -- 172.21.15.55:0/1743324313 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f006c6e0 con 0x7f41f015ce40 2024-04-02T07:24:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.595+0000 7f41f5200640 1 --2- 172.21.15.55:0/1743324313 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41f00afe70 0x7f41f00c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:24:03.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.595+0000 7f41efe00640 1 --2- 172.21.15.55:0/1743324313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41f015ce40 0x7f41f00b1780 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f41f00b1520 tx=0x7f41e001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207dd7cec9cfb1d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:03.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.595+0000 7f41ef400640 1 -- 172.21.15.55:0/1743324313 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e00a4ea0 con 0x7f41f015ce40 2024-04-02T07:24:03.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.595+0000 7f41ef400640 1 -- 172.21.15.55:0/1743324313 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41e00a7050 con 0x7f41f015ce40 2024-04-02T07:24:03.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.595+0000 7f41ef400640 1 -- 172.21.15.55:0/1743324313 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41e00ab820 con 0x7f41f015ce40 2024-04-02T07:24:03.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41f7200640 1 -- 172.21.15.55:0/1743324313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41f015ce40 msgr2=0x7f41f00b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:03.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41f7200640 1 --2- 172.21.15.55:0/1743324313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41f015ce40 0x7f41f00b1780 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f41f00b1520 tx=0x7f41e001c450 comp rx=0 tx=0).stop 2024-04-02T07:24:03.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41f7200640 1 -- 172.21.15.55:0/1743324313 shutdown_connections 2024-04-02T07:24:03.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41f7200640 1 --2- 172.21.15.55:0/1743324313 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41f00afe70 0x7f41f00c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:03.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41f7200640 1 --2- 172.21.15.55:0/1743324313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41f015ce40 0x7f41f00b1780 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:03.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41f7200640 1 -- 172.21.15.55:0/1743324313 >> 172.21.15.55:0/1743324313 conn(0x7f41f0069d90 msgr2=0x7f41f006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:03.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41f7200640 1 -- 172.21.15.55:0/1743324313 shutdown_connections 2024-04-02T07:24:03.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41f7200640 1 -- 172.21.15.55:0/1743324313 wait complete. 2024-04-02T07:24:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41f7200640 1 Processor -- start 2024-04-02T07:24:03.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41f7200640 1 -- start start 2024-04-02T07:24:03.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41f7200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41f006d1c0 0x7f41f0138ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41f7200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41f00afe70 0x7f41f00b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41f7200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41f015ce40 0x7f41f00b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41f7200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f0166680 con 0x7f41f00afe70 2024-04-02T07:24:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41f7200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41f0165a70 con 0x7f41f006d1c0 2024-04-02T07:24:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41f7200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41f0165d50 con 0x7f41f015ce40 2024-04-02T07:24:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41e7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41f00afe70 0x7f41f00b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41e7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41f00afe70 0x7f41f00b0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51394/0 (socket says 172.21.15.55:51394) 2024-04-02T07:24:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41e7e00640 1 -- 172.21.15.55:0/1987630760 learned_addr learned my addr 172.21.15.55:0/1987630760 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41f5200640 1 --2- 172.21.15.55:0/1987630760 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41f015ce40 0x7f41f00b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41efe00640 1 --2- 172.21.15.55:0/1987630760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41f006d1c0 0x7f41f0138ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41e7e00640 1 -- 172.21.15.55:0/1987630760 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41f015ce40 msgr2=0x7f41f00b0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.599+0000 7f41e7e00640 1 --2- 172.21.15.55:0/1987630760 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41f015ce40 0x7f41f00b0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.603+0000 7f41e7e00640 1 -- 172.21.15.55:0/1987630760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41f006d1c0 msgr2=0x7f41f0138ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.603+0000 7f41e7e00640 1 --2- 172.21.15.55:0/1987630760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41f006d1c0 0x7f41f0138ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.603+0000 7f41e7e00640 1 -- 172.21.15.55:0/1987630760 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e00094d0 con 0x7f41f00afe70 2024-04-02T07:24:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.603+0000 7f41efe00640 1 --2- 172.21.15.55:0/1987630760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41f006d1c0 0x7f41f0138ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.603+0000 7f41e7e00640 1 --2- 172.21.15.55:0/1987630760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41f00afe70 0x7f41f00b0560 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f41d800c450 tx=0x7f41d800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.603+0000 7f41ecc00640 1 -- 172.21.15.55:0/1987630760 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8012830 con 0x7f41f00afe70 2024-04-02T07:24:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.603+0000 7f41ecc00640 1 -- 172.21.15.55:0/1987630760 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d80129b0 con 0x7f41f00afe70 2024-04-02T07:24:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.603+0000 7f41ecc00640 1 -- 172.21.15.55:0/1987630760 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d8012d60 con 0x7f41f00afe70 2024-04-02T07:24:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.603+0000 7f41f7200640 1 -- 172.21.15.55:0/1987630760 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f0166030 con 0x7f41f00afe70 2024-04-02T07:24:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.603+0000 7f41f7200640 1 -- 172.21.15.55:0/1987630760 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41f0139400 con 0x7f41f00afe70 2024-04-02T07:24:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.603+0000 7f41f7200640 1 -- 172.21.15.55:0/1987630760 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41f014cce0 con 0x7f41f00afe70 2024-04-02T07:24:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.603+0000 7f41ecc00640 1 -- 172.21.15.55:0/1987630760 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f41d801c460 con 0x7f41f00afe70 2024-04-02T07:24:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.603+0000 7f41ecc00640 1 --2- 172.21.15.55:0/1987630760 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41cc0666c0 0x7f41cc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.603+0000 7f41ecc00640 1 -- 172.21.15.55:0/1987630760 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f41d8083e70 con 0x7f41f00afe70 2024-04-02T07:24:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.603+0000 7f41efe00640 1 --2- 172.21.15.55:0/1987630760 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41cc0666c0 0x7f41cc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.607+0000 7f41efe00640 1 --2- 172.21.15.55:0/1987630760 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41cc0666c0 0x7f41cc068b80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f41e00ad000 tx=0x7f41e00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:03.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.607+0000 7f41ecc00640 1 -- 172.21.15.55:0/1987630760 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f41d80512a0 con 0x7f41f00afe70 2024-04-02T07:24:03.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:03.775+0000 7f41f7200640 1 -- 172.21.15.55:0/1987630760 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f41f006e270 con 0x7f41f00afe70 2024-04-02T07:24:04.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.419+0000 7f41ecc00640 1 -- 172.21.15.55:0/1987630760 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) v1 ==== 169+0+0 (secure 0 0 0) 0x7f41d80548c0 con 0x7f41f00afe70 2024-04-02T07:24:04.422 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2024-04-02T07:24:04.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.423+0000 7f41f7200640 1 -- 172.21.15.55:0/1987630760 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41cc0666c0 msgr2=0x7f41cc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:04.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.423+0000 7f41f7200640 1 --2- 172.21.15.55:0/1987630760 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41cc0666c0 0x7f41cc068b80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f41e00ad000 tx=0x7f41e00a6000 comp rx=0 tx=0).stop 2024-04-02T07:24:04.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.423+0000 7f41f7200640 1 -- 172.21.15.55:0/1987630760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41f00afe70 msgr2=0x7f41f00b0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:04.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.423+0000 7f41f7200640 1 --2- 172.21.15.55:0/1987630760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41f00afe70 0x7f41f00b0560 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f41d800c450 tx=0x7f41d800c910 comp rx=0 tx=0).stop 2024-04-02T07:24:04.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.423+0000 7f41f7200640 1 -- 172.21.15.55:0/1987630760 shutdown_connections 2024-04-02T07:24:04.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.423+0000 7f41f7200640 1 --2- 172.21.15.55:0/1987630760 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41f015ce40 0x7f41f00b0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:04.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.423+0000 7f41f7200640 1 --2- 172.21.15.55:0/1987630760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41f00afe70 0x7f41f00b0560 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:04.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.423+0000 7f41f7200640 1 --2- 172.21.15.55:0/1987630760 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41cc0666c0 0x7f41cc068b80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:04.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.423+0000 7f41f7200640 1 --2- 172.21.15.55:0/1987630760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41f006d1c0 0x7f41f0138ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:04.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.423+0000 7f41f7200640 1 -- 172.21.15.55:0/1987630760 >> 172.21.15.55:0/1987630760 conn(0x7f41f0069d90 msgr2=0x7f41f00b31a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:04.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.423+0000 7f41f7200640 1 -- 172.21.15.55:0/1987630760 shutdown_connections 2024-04-02T07:24:04.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.423+0000 7f41f7200640 1 -- 172.21.15.55:0/1987630760 wait complete. 2024-04-02T07:24:04.450 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-02T07:24:04.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.595+0000 7fd147800640 1 Processor -- start 2024-04-02T07:24:04.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.595+0000 7fd147800640 1 -- start start 2024-04-02T07:24:04.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.595+0000 7fd147800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd14015cd20 0x7fd140065a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:04.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.595+0000 7fd147800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1400660d0 con 0x7fd140161490 2024-04-02T07:24:04.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.595+0000 7fd147800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1401609b0 con 0x7fd14006e4f0 2024-04-02T07:24:04.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.595+0000 7fd147800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1401607a0 con 0x7fd14015cd20 2024-04-02T07:24:04.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.595+0000 7fd13fe00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd140161490 0x7fd14006dde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:50120/0 (socket says 172.21.15.55:50120) 2024-04-02T07:24:04.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.595+0000 7fd13fe00640 1 -- 172.21.15.55:0/3380292410 learned_addr learned my addr 172.21.15.55:0/3380292410 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:04.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.595+0000 7fd144e00640 1 --2- 172.21.15.55:0/3380292410 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd14015cd20 0x7fd140065a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:04.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.595+0000 7fd13f400640 1 -- 172.21.15.55:0/3380292410 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1569150050 0 0) 0x7fd1400660d0 con 0x7fd140161490 2024-04-02T07:24:04.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.599+0000 7fd13f400640 1 -- 172.21.15.55:0/3380292410 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd128003530 con 0x7fd140161490 2024-04-02T07:24:04.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.599+0000 7fd13f400640 1 -- 172.21.15.55:0/3380292410 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731705290 0 0) 0x7fd1401609b0 con 0x7fd14006e4f0 2024-04-02T07:24:04.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.599+0000 7fd13f400640 1 -- 172.21.15.55:0/3380292410 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1400660d0 con 0x7fd14006e4f0 2024-04-02T07:24:04.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.599+0000 7fd13f400640 1 -- 172.21.15.55:0/3380292410 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3059888575 0 0) 0x7fd128003530 con 0x7fd140161490 2024-04-02T07:24:04.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.599+0000 7fd144e00640 1 -- 172.21.15.55:0/3380292410 >> v1:172.21.15.106:6789/0 conn(0x7fd14006e4f0 legacy=0x7fd1400cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:04.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.599+0000 7fd144e00640 1 -- 172.21.15.55:0/3380292410 >> v1:172.21.15.55:6789/0 conn(0x7fd140161490 legacy=0x7fd14006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:04.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.599+0000 7fd144e00640 1 -- 172.21.15.55:0/3380292410 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd140160c90 con 0x7fd14015cd20 2024-04-02T07:24:04.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.599+0000 7fd144e00640 1 --2- 172.21.15.55:0/3380292410 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd14015cd20 0x7fd140065a80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd1340097f0 tx=0x7fd13401c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c634cb69cf5d24cb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:04.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.599+0000 7fd13f400640 1 -- 172.21.15.55:0/3380292410 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c001680 con 0x7fd14015cd20 2024-04-02T07:24:04.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.599+0000 7fd13f400640 1 -- 172.21.15.55:0/3380292410 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1340a7050 con 0x7fd14015cd20 2024-04-02T07:24:04.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.599+0000 7fd13f400640 1 -- 172.21.15.55:0/3380292410 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1340ab600 con 0x7fd14015cd20 2024-04-02T07:24:04.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd147800640 1 -- 172.21.15.55:0/3380292410 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd14015cd20 msgr2=0x7fd140065a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:04.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd147800640 1 --2- 172.21.15.55:0/3380292410 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd14015cd20 0x7fd140065a80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd1340097f0 tx=0x7fd13401c400 comp rx=0 tx=0).stop 2024-04-02T07:24:04.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd147800640 1 -- 172.21.15.55:0/3380292410 shutdown_connections 2024-04-02T07:24:04.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd147800640 1 --2- 172.21.15.55:0/3380292410 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd14015cd20 0x7fd140065a80 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:04.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd147800640 1 -- 172.21.15.55:0/3380292410 >> 172.21.15.55:0/3380292410 conn(0x7fd1400ced90 msgr2=0x7fd1400cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:04.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd147800640 1 -- 172.21.15.55:0/3380292410 shutdown_connections 2024-04-02T07:24:04.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd147800640 1 -- 172.21.15.55:0/3380292410 wait complete. 2024-04-02T07:24:04.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd147800640 1 Processor -- start 2024-04-02T07:24:04.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd147800640 1 -- start start 2024-04-02T07:24:04.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd147800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd14006e4f0 0x7fd140148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:04.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd147800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd14015cd20 0x7fd14013ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:04.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd147800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd140161490 0x7fd1400af260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:04.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd147800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd140141e10 con 0x7fd140161490 2024-04-02T07:24:04.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd147800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14014c4c0 con 0x7fd14015cd20 2024-04-02T07:24:04.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd147800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1400ad910 con 0x7fd14006e4f0 2024-04-02T07:24:04.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd145800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd140161490 0x7fd1400af260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:04.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd145800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd140161490 0x7fd1400af260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51408/0 (socket says 172.21.15.55:51408) 2024-04-02T07:24:04.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd145800640 1 -- 172.21.15.55:0/3278418942 learned_addr learned my addr 172.21.15.55:0/3278418942 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:04.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd13fe00640 1 --2- 172.21.15.55:0/3278418942 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd14015cd20 0x7fd14013ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:04.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd144e00640 1 --2- 172.21.15.55:0/3278418942 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd14006e4f0 0x7fd140148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:04.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd145800640 1 -- 172.21.15.55:0/3278418942 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd14006e4f0 msgr2=0x7fd140148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:04.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd145800640 1 --2- 172.21.15.55:0/3278418942 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd14006e4f0 0x7fd140148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:04.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd145800640 1 -- 172.21.15.55:0/3278418942 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd14015cd20 msgr2=0x7fd14013ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:04.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd145800640 1 --2- 172.21.15.55:0/3278418942 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd14015cd20 0x7fd14013ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:04.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd145800640 1 -- 172.21.15.55:0/3278418942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd134009420 con 0x7fd140161490 2024-04-02T07:24:04.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd144e00640 1 --2- 172.21.15.55:0/3278418942 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd14006e4f0 0x7fd140148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:24:04.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd13fe00640 1 --2- 172.21.15.55:0/3278418942 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd14015cd20 0x7fd14013ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:24:04.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.603+0000 7fd145800640 1 --2- 172.21.15.55:0/3278418942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd140161490 0x7fd1400af260 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd13800c730 tx=0x7fd13800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:04.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.607+0000 7fd13cc00640 1 -- 172.21.15.55:0/3278418942 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd138003b80 con 0x7fd140161490 2024-04-02T07:24:04.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.607+0000 7fd13cc00640 1 -- 172.21.15.55:0/3278418942 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd138003ce0 con 0x7fd140161490 2024-04-02T07:24:04.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.607+0000 7fd13cc00640 1 -- 172.21.15.55:0/3278418942 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13800aa90 con 0x7fd140161490 2024-04-02T07:24:04.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.607+0000 7fd147800640 1 -- 172.21.15.55:0/3278418942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1400adbf0 con 0x7fd140161490 2024-04-02T07:24:04.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.607+0000 7fd147800640 1 -- 172.21.15.55:0/3278418942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14014fae0 con 0x7fd140161490 2024-04-02T07:24:04.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.607+0000 7fd147800640 1 -- 172.21.15.55:0/3278418942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1400cc770 con 0x7fd140161490 2024-04-02T07:24:04.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.607+0000 7fd13cc00640 1 -- 172.21.15.55:0/3278418942 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd13800abf0 con 0x7fd140161490 2024-04-02T07:24:04.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.607+0000 7fd13cc00640 1 --2- 172.21.15.55:0/3278418942 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd120066690 0x7fd120068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:04.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.607+0000 7fd13cc00640 1 -- 172.21.15.55:0/3278418942 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd138083d80 con 0x7fd140161490 2024-04-02T07:24:04.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.607+0000 7fd144e00640 1 --2- 172.21.15.55:0/3278418942 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd120066690 0x7fd120068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:04.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.611+0000 7fd144e00640 1 --2- 172.21.15.55:0/3278418942 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd120066690 0x7fd120068b50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd1340ad000 tx=0x7fd1340a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:04.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.611+0000 7fd13cc00640 1 -- 172.21.15.55:0/3278418942 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd138051350 con 0x7fd140161490 2024-04-02T07:24:04.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.771+0000 7fd147800640 1 -- 172.21.15.55:0/3278418942 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fd140066c90 con 0x7fd140161490 2024-04-02T07:24:04.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.775+0000 7fd13cc00640 1 -- 172.21.15.55:0/3278418942 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd138054970 con 0x7fd140161490 2024-04-02T07:24:04.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.779+0000 7fd147800640 1 -- 172.21.15.55:0/3278418942 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd120066690 msgr2=0x7fd120068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:04.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.779+0000 7fd147800640 1 --2- 172.21.15.55:0/3278418942 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd120066690 0x7fd120068b50 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd1340ad000 tx=0x7fd1340a6000 comp rx=0 tx=0).stop 2024-04-02T07:24:04.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.779+0000 7fd147800640 1 -- 172.21.15.55:0/3278418942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd140161490 msgr2=0x7fd1400af260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:04.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.779+0000 7fd147800640 1 --2- 172.21.15.55:0/3278418942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd140161490 0x7fd1400af260 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd13800c730 tx=0x7fd13800cbf0 comp rx=0 tx=0).stop 2024-04-02T07:24:04.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.779+0000 7fd147800640 1 -- 172.21.15.55:0/3278418942 shutdown_connections 2024-04-02T07:24:04.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.779+0000 7fd147800640 1 --2- 172.21.15.55:0/3278418942 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd140161490 0x7fd1400af260 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:04.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.779+0000 7fd147800640 1 --2- 172.21.15.55:0/3278418942 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd120066690 0x7fd120068b50 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:04.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.779+0000 7fd147800640 1 --2- 172.21.15.55:0/3278418942 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd14015cd20 0x7fd14013ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:04.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.779+0000 7fd147800640 1 --2- 172.21.15.55:0/3278418942 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd14006e4f0 0x7fd140148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:04.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.779+0000 7fd147800640 1 -- 172.21.15.55:0/3278418942 >> 172.21.15.55:0/3278418942 conn(0x7fd1400ced90 msgr2=0x7fd1400b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:04.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.779+0000 7fd147800640 1 -- 172.21.15.55:0/3278418942 shutdown_connections 2024-04-02T07:24:04.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.779+0000 7fd147800640 1 -- 172.21.15.55:0/3278418942 wait complete. 2024-04-02T07:24:04.800 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag' 2024-04-02T07:24:04.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.947+0000 7fd21ec00640 1 Processor -- start 2024-04-02T07:24:04.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.947+0000 7fd21ec00640 1 -- start start 2024-04-02T07:24:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.947+0000 7fd21ec00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd2180ce7f0 0x7fd2180cec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.947+0000 7fd21ec00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd21815c1e0 0x7fd21815c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.947+0000 7fd21ec00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd21815d0f0 con 0x7fd2181600b0 2024-04-02T07:24:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.947+0000 7fd21ec00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2181615e0 con 0x7fd2180ce7f0 2024-04-02T07:24:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.947+0000 7fd21ec00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd21815d3d0 con 0x7fd21815c1e0 2024-04-02T07:24:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.947+0000 7fd20fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd2180ce7f0 0x7fd2180cec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.947+0000 7fd20fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd2180ce7f0 0x7fd2180cec70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51418/0 (socket says 172.21.15.55:51418) 2024-04-02T07:24:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.947+0000 7fd20fe00640 1 -- 172.21.15.55:0/3435300155 learned_addr learned my addr 172.21.15.55:0/3435300155 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:04.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.947+0000 7fd21cc00640 1 --2- 172.21.15.55:0/3435300155 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd21815c1e0 0x7fd21815c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:04.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.947+0000 7fd20fe00640 1 -- 172.21.15.55:0/3435300155 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd21815c1e0 msgr2=0x7fd21815c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:04.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.947+0000 7fd20fe00640 1 --2- 172.21.15.55:0/3435300155 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd21815c1e0 0x7fd21815c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:04.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.947+0000 7fd20fe00640 1 -- 172.21.15.55:0/3435300155 >> v1:172.21.15.106:6789/0 conn(0x7fd2181600b0 legacy=0x7fd21806eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:04.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.947+0000 7fd20fe00640 1 -- 172.21.15.55:0/3435300155 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd21815d6b0 con 0x7fd2180ce7f0 2024-04-02T07:24:04.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.951+0000 7fd20fe00640 1 --2- 172.21.15.55:0/3435300155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2180ce7f0 0x7fd2180cec70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd200009870 tx=0x7fd20001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfe9c17f57cdb23 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:04.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.951+0000 7fd217400640 1 -- 172.21.15.55:0/3435300155 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2000aa5f0 con 0x7fd2180ce7f0 2024-04-02T07:24:04.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.951+0000 7fd217400640 1 -- 172.21.15.55:0/3435300155 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2000aa750 con 0x7fd2180ce7f0 2024-04-02T07:24:04.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.951+0000 7fd217400640 1 -- 172.21.15.55:0/3435300155 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2000aaae0 con 0x7fd2180ce7f0 2024-04-02T07:24:04.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.951+0000 7fd21ec00640 1 -- 172.21.15.55:0/3435300155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2180ce7f0 msgr2=0x7fd2180cec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:04.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.951+0000 7fd21ec00640 1 --2- 172.21.15.55:0/3435300155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2180ce7f0 0x7fd2180cec70 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fd200009870 tx=0x7fd20001c4d0 comp rx=0 tx=0).stop 2024-04-02T07:24:04.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.951+0000 7fd21ec00640 1 -- 172.21.15.55:0/3435300155 shutdown_connections 2024-04-02T07:24:04.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.951+0000 7fd21ec00640 1 --2- 172.21.15.55:0/3435300155 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd21815c1e0 0x7fd21815c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:04.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.951+0000 7fd21ec00640 1 --2- 172.21.15.55:0/3435300155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2180ce7f0 0x7fd2180cec70 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:04.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.951+0000 7fd21ec00640 1 -- 172.21.15.55:0/3435300155 >> 172.21.15.55:0/3435300155 conn(0x7fd218098a10 msgr2=0x7fd2180b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:04.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.951+0000 7fd21ec00640 1 -- 172.21.15.55:0/3435300155 shutdown_connections 2024-04-02T07:24:04.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.951+0000 7fd21ec00640 1 -- 172.21.15.55:0/3435300155 wait complete. 2024-04-02T07:24:04.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd21ec00640 1 Processor -- start 2024-04-02T07:24:04.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd21ec00640 1 -- start start 2024-04-02T07:24:04.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd21ec00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2180ce7f0 0x7fd2180ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:04.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd21ec00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd21815c1e0 0x7fd2180c59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:04.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd21ec00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd2181600b0 0x7fd2180c5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:04.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd21ec00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2180ad050 con 0x7fd2180ce7f0 2024-04-02T07:24:04.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd21ec00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2180ad330 con 0x7fd21815c1e0 2024-04-02T07:24:04.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd21ec00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2180ad610 con 0x7fd2181600b0 2024-04-02T07:24:04.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd217e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2180ce7f0 0x7fd2180ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:04.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd217e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2180ce7f0 0x7fd2180ac6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51434/0 (socket says 172.21.15.55:51434) 2024-04-02T07:24:04.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd217e00640 1 -- 172.21.15.55:0/2408065239 learned_addr learned my addr 172.21.15.55:0/2408065239 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:04.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd21cc00640 1 --2- 172.21.15.55:0/2408065239 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd2181600b0 0x7fd2180c5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:04.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd20fe00640 1 --2- 172.21.15.55:0/2408065239 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd21815c1e0 0x7fd2180c59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:04.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd217e00640 1 -- 172.21.15.55:0/2408065239 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd2181600b0 msgr2=0x7fd2180c5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:04.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd217e00640 1 --2- 172.21.15.55:0/2408065239 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd2181600b0 0x7fd2180c5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:04.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd217e00640 1 -- 172.21.15.55:0/2408065239 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd21815c1e0 msgr2=0x7fd2180c59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:04.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd217e00640 1 --2- 172.21.15.55:0/2408065239 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd21815c1e0 0x7fd2180c59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:04.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd217e00640 1 -- 172.21.15.55:0/2408065239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2000094d0 con 0x7fd2180ce7f0 2024-04-02T07:24:04.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd21cc00640 1 --2- 172.21.15.55:0/2408065239 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd2181600b0 0x7fd2180c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:04.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd217e00640 1 --2- 172.21.15.55:0/2408065239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2180ce7f0 0x7fd2180ac6d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd20800c3c0 tx=0x7fd20800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:04.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd214c00640 1 -- 172.21.15.55:0/2408065239 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2080052d0 con 0x7fd2180ce7f0 2024-04-02T07:24:04.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd214c00640 1 -- 172.21.15.55:0/2408065239 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd208005430 con 0x7fd2180ce7f0 2024-04-02T07:24:04.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd21ec00640 1 -- 172.21.15.55:0/2408065239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21815e530 con 0x7fd2180ce7f0 2024-04-02T07:24:04.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd214c00640 1 -- 172.21.15.55:0/2408065239 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd208003840 con 0x7fd2180ce7f0 2024-04-02T07:24:04.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.955+0000 7fd21ec00640 1 -- 172.21.15.55:0/2408065239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2180adbd0 con 0x7fd2180ce7f0 2024-04-02T07:24:04.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.959+0000 7fd21ec00640 1 -- 172.21.15.55:0/2408065239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd218066c90 con 0x7fd2180ce7f0 2024-04-02T07:24:04.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.959+0000 7fd214c00640 1 -- 172.21.15.55:0/2408065239 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd2080039a0 con 0x7fd2180ce7f0 2024-04-02T07:24:04.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.959+0000 7fd214c00640 1 --2- 172.21.15.55:0/2408065239 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd1f4066690 0x7fd1f4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:04.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.959+0000 7fd214c00640 1 -- 172.21.15.55:0/2408065239 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd208083440 con 0x7fd2180ce7f0 2024-04-02T07:24:04.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.959+0000 7fd20fe00640 1 --2- 172.21.15.55:0/2408065239 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd1f4066690 0x7fd1f4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:04.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.959+0000 7fd20fe00640 1 --2- 172.21.15.55:0/2408065239 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd1f4066690 0x7fd1f4068b50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd2000ae000 tx=0x7fd2000b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:04.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:04.963+0000 7fd214c00640 1 -- 172.21.15.55:0/2408065239 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd208050a30 con 0x7fd2180ce7f0 2024-04-02T07:24:05.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.187+0000 7fd21ec00640 1 -- 172.21.15.55:0/2408065239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]} v 0) v1 -- 0x7fd2181523d0 con 0x7fd2180ce7f0 2024-04-02T07:24:05.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.419+0000 7fd214c00640 1 -- 172.21.15.55:0/2408065239 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_apply_tag"]}]=0 v115) v1 ==== 142+0+0 (secure 0 0 0) 0x7fd2080170d0 con 0x7fd2180ce7f0 2024-04-02T07:24:05.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.419+0000 7fd21ec00640 1 -- 172.21.15.55:0/2408065239 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd1f4066690 msgr2=0x7fd1f4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:05.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.419+0000 7fd21ec00640 1 --2- 172.21.15.55:0/2408065239 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd1f4066690 0x7fd1f4068b50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd2000ae000 tx=0x7fd2000b5040 comp rx=0 tx=0).stop 2024-04-02T07:24:05.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.419+0000 7fd21ec00640 1 -- 172.21.15.55:0/2408065239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2180ce7f0 msgr2=0x7fd2180ac6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:05.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.419+0000 7fd21ec00640 1 --2- 172.21.15.55:0/2408065239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2180ce7f0 0x7fd2180ac6d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fd20800c3c0 tx=0x7fd20800c880 comp rx=0 tx=0).stop 2024-04-02T07:24:05.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.419+0000 7fd21ec00640 1 -- 172.21.15.55:0/2408065239 shutdown_connections 2024-04-02T07:24:05.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.419+0000 7fd21ec00640 1 --2- 172.21.15.55:0/2408065239 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd2181600b0 0x7fd2180c5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:05.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.419+0000 7fd21ec00640 1 --2- 172.21.15.55:0/2408065239 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd1f4066690 0x7fd1f4068b50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:05.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.419+0000 7fd21ec00640 1 --2- 172.21.15.55:0/2408065239 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd21815c1e0 0x7fd2180c59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:05.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.419+0000 7fd21ec00640 1 --2- 172.21.15.55:0/2408065239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd2180ce7f0 0x7fd2180ac6d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:05.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.419+0000 7fd21ec00640 1 -- 172.21.15.55:0/2408065239 >> 172.21.15.55:0/2408065239 conn(0x7fd218098a10 msgr2=0x7fd2180b07b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:05.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.419+0000 7fd21ec00640 1 -- 172.21.15.55:0/2408065239 shutdown_connections 2024-04-02T07:24:05.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.419+0000 7fd21ec00640 1 -- 172.21.15.55:0/2408065239 wait complete. 2024-04-02T07:24:05.443 INFO:tasks.cephfs_test_runner:test_apply_tag (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-02T07:24:05.443 INFO:tasks.cephfs_test_runner:Starting test: test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) That the MDS can repair an inodes backtrace in the data pool 2024-04-02T07:24:05.444 INFO:tasks.cephfs_test_runner:test_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-02T07:24:05.444 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-04-02T07:24:05.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.583+0000 7f45fea00640 1 Processor -- start 2024-04-02T07:24:05.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.583+0000 7f45fea00640 1 -- start start 2024-04-02T07:24:05.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.583+0000 7f45fea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f45f806c0d0 0x7f45f8098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.583+0000 7f45fea00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45f8098f50 0x7f45f815c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.583+0000 7f45fea00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f80993a0 con 0x7f45f80b19d0 2024-04-02T07:24:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.583+0000 7f45fea00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f80cf3d0 con 0x7f45f806c0d0 2024-04-02T07:24:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.583+0000 7f45fea00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f80cf6b0 con 0x7f45f8098f50 2024-04-02T07:24:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.583+0000 7f45f7400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f45f806c0d0 0x7f45f8098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.583+0000 7f45f7400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f45f806c0d0 0x7f45f8098a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53714/0 (socket says 172.21.15.55:53714) 2024-04-02T07:24:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.583+0000 7f45f7400640 1 -- 172.21.15.55:0/837420475 learned_addr learned my addr 172.21.15.55:0/837420475 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.583+0000 7f45fca00640 1 --2- 172.21.15.55:0/837420475 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45f8098f50 0x7f45f815c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.583+0000 7f45f7400640 1 -- 172.21.15.55:0/837420475 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45f8098f50 msgr2=0x7f45f815c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.583+0000 7f45f7400640 1 --2- 172.21.15.55:0/837420475 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45f8098f50 0x7f45f815c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.583+0000 7f45f7400640 1 -- 172.21.15.55:0/837420475 >> v1:172.21.15.106:6789/0 conn(0x7f45f80b19d0 legacy=0x7f45f80ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:05.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.583+0000 7f45f7400640 1 -- 172.21.15.55:0/837420475 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f80cf990 con 0x7f45f806c0d0 2024-04-02T07:24:05.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.587+0000 7f45f7400640 1 --2- 172.21.15.55:0/837420475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45f806c0d0 0x7f45f8098a10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009870 tx=0x7f45e401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b6679775bc8a765 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:05.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.587+0000 7f45f6a00640 1 -- 172.21.15.55:0/837420475 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e40ab450 con 0x7f45f806c0d0 2024-04-02T07:24:05.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.587+0000 7f45f6a00640 1 -- 172.21.15.55:0/837420475 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e40ab5b0 con 0x7f45f806c0d0 2024-04-02T07:24:05.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.587+0000 7f45f6a00640 1 -- 172.21.15.55:0/837420475 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e40ab940 con 0x7f45f806c0d0 2024-04-02T07:24:05.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.587+0000 7f45fea00640 1 -- 172.21.15.55:0/837420475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45f806c0d0 msgr2=0x7f45f8098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:05.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.587+0000 7f45fea00640 1 --2- 172.21.15.55:0/837420475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45f806c0d0 0x7f45f8098a10 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f45e4009870 tx=0x7f45e401c560 comp rx=0 tx=0).stop 2024-04-02T07:24:05.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.587+0000 7f45fea00640 1 -- 172.21.15.55:0/837420475 shutdown_connections 2024-04-02T07:24:05.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.587+0000 7f45fea00640 1 --2- 172.21.15.55:0/837420475 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45f8098f50 0x7f45f815c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:05.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.587+0000 7f45fea00640 1 --2- 172.21.15.55:0/837420475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45f806c0d0 0x7f45f8098a10 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:05.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.587+0000 7f45fea00640 1 -- 172.21.15.55:0/837420475 >> 172.21.15.55:0/837420475 conn(0x7f45f80b2150 msgr2=0x7f45f80b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:05.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.587+0000 7f45fea00640 1 -- 172.21.15.55:0/837420475 shutdown_connections 2024-04-02T07:24:05.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.587+0000 7f45fea00640 1 -- 172.21.15.55:0/837420475 wait complete. 2024-04-02T07:24:05.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.587+0000 7f45fea00640 1 Processor -- start 2024-04-02T07:24:05.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.587+0000 7f45fea00640 1 -- start start 2024-04-02T07:24:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45fea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45f806c0d0 0x7f45f8150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45fea00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45f8098f50 0x7f45f81581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45fea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45f80b19d0 0x7f45f8158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45fea00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f815db40 con 0x7f45f806c0d0 2024-04-02T07:24:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45fea00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f815d230 con 0x7f45f80b19d0 2024-04-02T07:24:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45fea00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f81516c0 con 0x7f45f8098f50 2024-04-02T07:24:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45f7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45f806c0d0 0x7f45f8150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45f7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45f806c0d0 0x7f45f8150ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53720/0 (socket says 172.21.15.55:53720) 2024-04-02T07:24:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45f7e00640 1 -- 172.21.15.55:0/2725241686 learned_addr learned my addr 172.21.15.55:0/2725241686 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45fca00640 1 --2- 172.21.15.55:0/2725241686 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45f80b19d0 0x7f45f8158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45f7400640 1 --2- 172.21.15.55:0/2725241686 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45f8098f50 0x7f45f81581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45f7e00640 1 -- 172.21.15.55:0/2725241686 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45f8098f50 msgr2=0x7f45f81581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45f7e00640 1 --2- 172.21.15.55:0/2725241686 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45f8098f50 0x7f45f81581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45f7e00640 1 -- 172.21.15.55:0/2725241686 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45f80b19d0 msgr2=0x7f45f8158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45f7e00640 1 --2- 172.21.15.55:0/2725241686 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45f80b19d0 0x7f45f8158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45f7e00640 1 -- 172.21.15.55:0/2725241686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e40094d0 con 0x7f45f806c0d0 2024-04-02T07:24:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45f7e00640 1 --2- 172.21.15.55:0/2725241686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45f806c0d0 0x7f45f8150ea0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f45e800c3c0 tx=0x7f45e800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45efe00640 1 -- 172.21.15.55:0/2725241686 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e80052d0 con 0x7f45f806c0d0 2024-04-02T07:24:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45efe00640 1 -- 172.21.15.55:0/2725241686 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e8005430 con 0x7f45f806c0d0 2024-04-02T07:24:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45fea00640 1 -- 172.21.15.55:0/2725241686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f815d4f0 con 0x7f45f806c0d0 2024-04-02T07:24:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45efe00640 1 -- 172.21.15.55:0/2725241686 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e8003840 con 0x7f45f806c0d0 2024-04-02T07:24:05.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45fea00640 1 -- 172.21.15.55:0/2725241686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f81513e0 con 0x7f45f806c0d0 2024-04-02T07:24:05.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.591+0000 7f45fea00640 1 -- 172.21.15.55:0/2725241686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f8066c90 con 0x7f45f806c0d0 2024-04-02T07:24:05.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.595+0000 7f45efe00640 1 -- 172.21.15.55:0/2725241686 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f45e80039a0 con 0x7f45f806c0d0 2024-04-02T07:24:05.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.595+0000 7f45efe00640 1 --2- 172.21.15.55:0/2725241686 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f45d8066690 0x7f45d8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:05.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.595+0000 7f45efe00640 1 -- 172.21.15.55:0/2725241686 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f45e8083250 con 0x7f45f806c0d0 2024-04-02T07:24:05.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.595+0000 7f45f7400640 1 --2- 172.21.15.55:0/2725241686 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f45d8066690 0x7f45d8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:05.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.595+0000 7f45f7400640 1 --2- 172.21.15.55:0/2725241686 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f45d8066690 0x7f45d8068b50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f45e40af000 tx=0x7f45e40b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:05.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.599+0000 7f45efe00640 1 -- 172.21.15.55:0/2725241686 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f45e80508d0 con 0x7f45f806c0d0 2024-04-02T07:24:05.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:05.815+0000 7f45fea00640 1 -- 172.21.15.55:0/2725241686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7f45f80993a0 con 0x7f45f806c0d0 2024-04-02T07:24:06.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.423+0000 7f45efe00640 1 -- 172.21.15.55:0/2725241686 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v116) v1 ==== 152+0+0 (secure 0 0 0) 0x7f45f80993a0 con 0x7f45f806c0d0 2024-04-02T07:24:06.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.427+0000 7f45fea00640 1 -- 172.21.15.55:0/2725241686 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f45d8066690 msgr2=0x7f45d8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:06.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.427+0000 7f45fea00640 1 --2- 172.21.15.55:0/2725241686 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f45d8066690 0x7f45d8068b50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f45e40af000 tx=0x7f45e40b6040 comp rx=0 tx=0).stop 2024-04-02T07:24:06.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.427+0000 7f45fea00640 1 -- 172.21.15.55:0/2725241686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45f806c0d0 msgr2=0x7f45f8150ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:06.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.427+0000 7f45fea00640 1 --2- 172.21.15.55:0/2725241686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45f806c0d0 0x7f45f8150ea0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f45e800c3c0 tx=0x7f45e800c880 comp rx=0 tx=0).stop 2024-04-02T07:24:06.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.427+0000 7f45fea00640 1 -- 172.21.15.55:0/2725241686 shutdown_connections 2024-04-02T07:24:06.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.427+0000 7f45fea00640 1 --2- 172.21.15.55:0/2725241686 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f45d8066690 0x7f45d8068b50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:06.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.427+0000 7f45fea00640 1 --2- 172.21.15.55:0/2725241686 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f45f80b19d0 0x7f45f8158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:06.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.427+0000 7f45fea00640 1 --2- 172.21.15.55:0/2725241686 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f45f8098f50 0x7f45f81581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:06.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.427+0000 7f45fea00640 1 --2- 172.21.15.55:0/2725241686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f45f806c0d0 0x7f45f8150ea0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:06.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.427+0000 7f45fea00640 1 -- 172.21.15.55:0/2725241686 >> 172.21.15.55:0/2725241686 conn(0x7f45f80b2150 msgr2=0x7f45f80ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:06.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.427+0000 7f45fea00640 1 -- 172.21.15.55:0/2725241686 shutdown_connections 2024-04-02T07:24:06.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.427+0000 7f45fea00640 1 -- 172.21.15.55:0/2725241686 wait complete. 2024-04-02T07:24:06.451 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-02T07:24:06.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.591+0000 7f5d8fc00640 1 Processor -- start 2024-04-02T07:24:06.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.591+0000 7f5d8fc00640 1 -- start start 2024-04-02T07:24:06.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.595+0000 7f5d8fc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d880b41a0 0x7f5d88142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:06.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.595+0000 7f5d8fc00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d8806ddc0 con 0x7f5d880b3dc0 2024-04-02T07:24:06.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.595+0000 7f5d8fc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d8806c630 con 0x7f5d880ade90 2024-04-02T07:24:06.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.595+0000 7f5d8fc00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d880cae80 con 0x7f5d880b41a0 2024-04-02T07:24:06.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.595+0000 7f5d8d200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5d880b3dc0 0x7f5d880ca770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48402/0 (socket says 172.21.15.55:48402) 2024-04-02T07:24:06.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.595+0000 7f5d8d200640 1 -- 172.21.15.55:0/4208004082 learned_addr learned my addr 172.21.15.55:0/4208004082 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:06.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.595+0000 7f5d8dc00640 1 --2- 172.21.15.55:0/4208004082 >> v2:172.21.15.55:3300/0 conn(0x7f5d880b41a0 0x7f5d88142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:06.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.595+0000 7f5d8dc00640 1 -- 172.21.15.55:0/4208004082 >> v1:172.21.15.106:6789/0 conn(0x7f5d880ade90 legacy=0x7f5d8806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:06.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.595+0000 7f5d8dc00640 1 -- 172.21.15.55:0/4208004082 >> v1:172.21.15.55:6789/0 conn(0x7f5d880b3dc0 legacy=0x7f5d880ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:06.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.595+0000 7f5d8dc00640 1 -- 172.21.15.55:0/4208004082 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8806c8f0 con 0x7f5d880b41a0 2024-04-02T07:24:06.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.599+0000 7f5d8dc00640 1 --2- 172.21.15.55:0/4208004082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d880b41a0 0x7f5d88142ac0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009d90 tx=0x7f5d8001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ee204465590d8f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:06.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.599+0000 7f5d87e00640 1 -- 172.21.15.55:0/4208004082 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d800a58d0 con 0x7f5d880b41a0 2024-04-02T07:24:06.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.599+0000 7f5d87e00640 1 -- 172.21.15.55:0/4208004082 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d800a5a30 con 0x7f5d880b41a0 2024-04-02T07:24:06.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.599+0000 7f5d87e00640 1 -- 172.21.15.55:0/4208004082 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d800a5dc0 con 0x7f5d880b41a0 2024-04-02T07:24:06.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.599+0000 7f5d8fc00640 1 -- 172.21.15.55:0/4208004082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d880b41a0 msgr2=0x7f5d88142ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:06.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.599+0000 7f5d8fc00640 1 --2- 172.21.15.55:0/4208004082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d880b41a0 0x7f5d88142ac0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009d90 tx=0x7f5d8001c900 comp rx=0 tx=0).stop 2024-04-02T07:24:06.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.599+0000 7f5d8fc00640 1 -- 172.21.15.55:0/4208004082 shutdown_connections 2024-04-02T07:24:06.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.599+0000 7f5d8fc00640 1 --2- 172.21.15.55:0/4208004082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d880b41a0 0x7f5d88142ac0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:06.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.599+0000 7f5d8fc00640 1 -- 172.21.15.55:0/4208004082 >> 172.21.15.55:0/4208004082 conn(0x7f5d8806a390 msgr2=0x7f5d880b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:06.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.599+0000 7f5d8fc00640 1 -- 172.21.15.55:0/4208004082 shutdown_connections 2024-04-02T07:24:06.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.599+0000 7f5d8fc00640 1 -- 172.21.15.55:0/4208004082 wait complete. 2024-04-02T07:24:06.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.599+0000 7f5d8fc00640 1 Processor -- start 2024-04-02T07:24:06.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.599+0000 7f5d8fc00640 1 -- start start 2024-04-02T07:24:06.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d8fc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d880ade90 0x7f5d880b0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:06.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d8fc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d880b3dc0 0x7f5d88138c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:06.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d8fc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d880b41a0 0x7f5d8813db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:06.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d8fc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d880b0640 con 0x7f5d880b41a0 2024-04-02T07:24:06.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d8fc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d881391c0 con 0x7f5d880ade90 2024-04-02T07:24:06.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d8fc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d88159070 con 0x7f5d880b3dc0 2024-04-02T07:24:06.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d8dc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d880b41a0 0x7f5d8813db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:06.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d8dc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d880b41a0 0x7f5d8813db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53740/0 (socket says 172.21.15.55:53740) 2024-04-02T07:24:06.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d8dc00640 1 -- 172.21.15.55:0/2480781136 learned_addr learned my addr 172.21.15.55:0/2480781136 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:06.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d8d200640 1 --2- 172.21.15.55:0/2480781136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d880ade90 0x7f5d880b0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:06.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d7fe00640 1 --2- 172.21.15.55:0/2480781136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d880b3dc0 0x7f5d88138c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:06.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d8dc00640 1 -- 172.21.15.55:0/2480781136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d880b3dc0 msgr2=0x7f5d88138c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:06.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d8dc00640 1 --2- 172.21.15.55:0/2480781136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d880b3dc0 0x7f5d88138c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:06.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d8dc00640 1 -- 172.21.15.55:0/2480781136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d880ade90 msgr2=0x7f5d880b0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:06.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d8dc00640 1 --2- 172.21.15.55:0/2480781136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d880ade90 0x7f5d880b0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:06.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d8dc00640 1 -- 172.21.15.55:0/2480781136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d80009a70 con 0x7f5d880b41a0 2024-04-02T07:24:06.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d7fe00640 1 --2- 172.21.15.55:0/2480781136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d880b3dc0 0x7f5d88138c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:24:06.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d8dc00640 1 --2- 172.21.15.55:0/2480781136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d880b41a0 0x7f5d8813db60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5d8001a530 tx=0x7f5d800196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:06.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d85600640 1 -- 172.21.15.55:0/2480781136 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d800b9860 con 0x7f5d880b41a0 2024-04-02T07:24:06.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d85600640 1 -- 172.21.15.55:0/2480781136 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d800b99c0 con 0x7f5d880b41a0 2024-04-02T07:24:06.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d85600640 1 -- 172.21.15.55:0/2480781136 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d800b9d50 con 0x7f5d880b41a0 2024-04-02T07:24:06.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d8fc00640 1 -- 172.21.15.55:0/2480781136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d88159350 con 0x7f5d880b41a0 2024-04-02T07:24:06.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d8fc00640 1 -- 172.21.15.55:0/2480781136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d881509d0 con 0x7f5d880b41a0 2024-04-02T07:24:06.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d8fc00640 1 -- 172.21.15.55:0/2480781136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d88066c90 con 0x7f5d880b41a0 2024-04-02T07:24:06.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.603+0000 7f5d85600640 1 -- 172.21.15.55:0/2480781136 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5d800ad440 con 0x7f5d880b41a0 2024-04-02T07:24:06.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.607+0000 7f5d85600640 1 --2- 172.21.15.55:0/2480781136 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d64066690 0x7f5d64068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:06.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.607+0000 7f5d85600640 1 -- 172.21.15.55:0/2480781136 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5d8011f370 con 0x7f5d880b41a0 2024-04-02T07:24:06.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.607+0000 7f5d8d200640 1 --2- 172.21.15.55:0/2480781136 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d64066690 0x7f5d64068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:06.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.607+0000 7f5d8d200640 1 --2- 172.21.15.55:0/2480781136 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d64066690 0x7f5d64068b50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5d78005890 tx=0x7f5d78009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:06.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.611+0000 7f5d85600640 1 -- 172.21.15.55:0/2480781136 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5d800ecaf0 con 0x7f5d880b41a0 2024-04-02T07:24:06.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.771+0000 7f5d8fc00640 1 -- 172.21.15.55:0/2480781136 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f5d880b1240 con 0x7f5d880b41a0 2024-04-02T07:24:06.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.775+0000 7f5d85600640 1 -- 172.21.15.55:0/2480781136 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f5d800f0110 con 0x7f5d880b41a0 2024-04-02T07:24:06.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.779+0000 7f5d8fc00640 1 -- 172.21.15.55:0/2480781136 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d64066690 msgr2=0x7f5d64068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:06.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.779+0000 7f5d8fc00640 1 --2- 172.21.15.55:0/2480781136 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d64066690 0x7f5d64068b50 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5d78005890 tx=0x7f5d78009040 comp rx=0 tx=0).stop 2024-04-02T07:24:06.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.779+0000 7f5d8fc00640 1 -- 172.21.15.55:0/2480781136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d880b41a0 msgr2=0x7f5d8813db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:06.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.779+0000 7f5d8fc00640 1 --2- 172.21.15.55:0/2480781136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d880b41a0 0x7f5d8813db60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f5d8001a530 tx=0x7f5d800196a0 comp rx=0 tx=0).stop 2024-04-02T07:24:06.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.779+0000 7f5d8fc00640 1 -- 172.21.15.55:0/2480781136 shutdown_connections 2024-04-02T07:24:06.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.779+0000 7f5d8fc00640 1 --2- 172.21.15.55:0/2480781136 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d880b41a0 0x7f5d8813db60 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:06.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.779+0000 7f5d8fc00640 1 --2- 172.21.15.55:0/2480781136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d880b3dc0 0x7f5d88138c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:06.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.779+0000 7f5d8fc00640 1 --2- 172.21.15.55:0/2480781136 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d64066690 0x7f5d64068b50 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:06.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.779+0000 7f5d8fc00640 1 --2- 172.21.15.55:0/2480781136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d880ade90 0x7f5d880b0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:06.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.779+0000 7f5d8fc00640 1 -- 172.21.15.55:0/2480781136 >> 172.21.15.55:0/2480781136 conn(0x7f5d8806a390 msgr2=0x7f5d8813cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:06.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.779+0000 7f5d8fc00640 1 -- 172.21.15.55:0/2480781136 shutdown_connections 2024-04-02T07:24:06.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:06.779+0000 7f5d8fc00640 1 -- 172.21.15.55:0/2480781136 wait complete. 2024-04-02T07:24:06.800 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-02T07:24:06.800 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:24:06.882 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:24:06.960 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-02T07:24:06.960 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:24:06.960 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:24:06.969 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:24:06.969 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:24:06.969 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:24:06.978 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:24:06.979 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:24:06.979 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:24:07.019 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:24:07.019 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:24:07.019 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:24:07.033 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:24:07.033 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-02T07:24:07.034 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:24:07.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.199+0000 7f8672e00640 1 Processor -- start 2024-04-02T07:24:07.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.199+0000 7f8672e00640 1 -- start start 2024-04-02T07:24:07.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.203+0000 7f8672e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f866c143f90 0x7f866c15ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:07.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.203+0000 7f8672e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f866c0cda80 0x7f866c0c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:07.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.203+0000 7f8672e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f866c15b270 con 0x7f866c0b34f0 2024-04-02T07:24:07.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.203+0000 7f8672e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866c144370 con 0x7f866c143f90 2024-04-02T07:24:07.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.203+0000 7f8672e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866c0c37b0 con 0x7f866c0cda80 2024-04-02T07:24:07.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.203+0000 7f866be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f866c143f90 0x7f866c15ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:07.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.203+0000 7f866be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f866c143f90 0x7f866c15ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53748/0 (socket says 172.21.15.55:53748) 2024-04-02T07:24:07.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.203+0000 7f866be00640 1 -- 172.21.15.55:0/1012019298 learned_addr learned my addr 172.21.15.55:0/1012019298 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:07.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.203+0000 7f866be00640 1 -- 172.21.15.55:0/1012019298 >> v2:172.21.15.106:3300/0 conn(0x7f866c0cda80 msgr2=0x7f866c0c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:07.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.203+0000 7f866be00640 1 --2- 172.21.15.55:0/1012019298 >> v2:172.21.15.106:3300/0 conn(0x7f866c0cda80 0x7f866c0c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:07.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.203+0000 7f866be00640 1 -- 172.21.15.55:0/1012019298 >> v1:172.21.15.106:6789/0 conn(0x7f866c0b34f0 legacy=0x7f866c0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:07.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.203+0000 7f866be00640 1 -- 172.21.15.55:0/1012019298 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c0c3a90 con 0x7f866c143f90 2024-04-02T07:24:07.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.207+0000 7f866be00640 1 --2- 172.21.15.55:0/1012019298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f866c143f90 0x7f866c15ad30 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f866c144670 tx=0x7f865c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af43c7ac58cc9db server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:07.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.207+0000 7f866b400640 1 -- 172.21.15.55:0/1012019298 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0ab620 con 0x7f866c143f90 2024-04-02T07:24:07.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.207+0000 7f866b400640 1 -- 172.21.15.55:0/1012019298 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c0ab780 con 0x7f866c143f90 2024-04-02T07:24:07.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.207+0000 7f866b400640 1 -- 172.21.15.55:0/1012019298 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0abb10 con 0x7f866c143f90 2024-04-02T07:24:07.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.207+0000 7f8672e00640 1 -- 172.21.15.55:0/1012019298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f866c143f90 msgr2=0x7f866c15ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:07.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.207+0000 7f8672e00640 1 --2- 172.21.15.55:0/1012019298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f866c143f90 0x7f866c15ad30 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f866c144670 tx=0x7f865c01c420 comp rx=0 tx=0).stop 2024-04-02T07:24:07.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.207+0000 7f8672e00640 1 -- 172.21.15.55:0/1012019298 shutdown_connections 2024-04-02T07:24:07.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.207+0000 7f8672e00640 1 --2- 172.21.15.55:0/1012019298 >> v2:172.21.15.106:3300/0 conn(0x7f866c0cda80 0x7f866c0c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:07.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.207+0000 7f8672e00640 1 --2- 172.21.15.55:0/1012019298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f866c143f90 0x7f866c15ad30 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:07.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.207+0000 7f8672e00640 1 -- 172.21.15.55:0/1012019298 >> 172.21.15.55:0/1012019298 conn(0x7f866c066080 msgr2=0x7f866c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:07.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.207+0000 7f8672e00640 1 -- 172.21.15.55:0/1012019298 shutdown_connections 2024-04-02T07:24:07.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.207+0000 7f8672e00640 1 -- 172.21.15.55:0/1012019298 wait complete. 2024-04-02T07:24:07.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.207+0000 7f8672e00640 1 Processor -- start 2024-04-02T07:24:07.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.207+0000 7f8672e00640 1 -- start start 2024-04-02T07:24:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.207+0000 7f8672e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f866c0b34f0 0x7f866c0cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.207+0000 7f8672e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f866c0cda80 0x7f866c0cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.207+0000 7f8672e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f866c143f90 0x7f866c142790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.207+0000 7f8672e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c0cb9b0 con 0x7f866c0b34f0 2024-04-02T07:24:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.207+0000 7f8672e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c0cc310 con 0x7f866c0cda80 2024-04-02T07:24:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.207+0000 7f8672e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866c13a740 con 0x7f866c143f90 2024-04-02T07:24:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.211+0000 7f866be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f866c0b34f0 0x7f866c0cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.211+0000 7f866be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f866c0b34f0 0x7f866c0cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53762/0 (socket says 172.21.15.55:53762) 2024-04-02T07:24:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.211+0000 7f866be00640 1 -- 172.21.15.55:0/2479069802 learned_addr learned my addr 172.21.15.55:0/2479069802 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.211+0000 7f866be00640 1 -- 172.21.15.55:0/2479069802 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f866c143f90 msgr2=0x7f866c142790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.211+0000 7f866be00640 1 --2- 172.21.15.55:0/2479069802 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f866c143f90 0x7f866c142790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:07.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.211+0000 7f866be00640 1 -- 172.21.15.55:0/2479069802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f866c0cda80 msgr2=0x7f866c0cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.211+0000 7f866be00640 1 --2- 172.21.15.55:0/2479069802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f866c0cda80 0x7f866c0cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.211+0000 7f866be00640 1 -- 172.21.15.55:0/2479069802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c0094d0 con 0x7f866c0b34f0 2024-04-02T07:24:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.211+0000 7f866be00640 1 --2- 172.21.15.55:0/2479069802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f866c0b34f0 0x7f866c0cbdd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f865c01a050 tx=0x7f865c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.211+0000 7f8668c00640 1 -- 172.21.15.55:0/2479069802 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0be3f0 con 0x7f866c0b34f0 2024-04-02T07:24:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.211+0000 7f8668c00640 1 -- 172.21.15.55:0/2479069802 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c0be570 con 0x7f866c0b34f0 2024-04-02T07:24:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.211+0000 7f8668c00640 1 -- 172.21.15.55:0/2479069802 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0be920 con 0x7f866c0b34f0 2024-04-02T07:24:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.211+0000 7f8672e00640 1 -- 172.21.15.55:0/2479069802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866c0cb010 con 0x7f866c0b34f0 2024-04-02T07:24:07.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.211+0000 7f8672e00640 1 -- 172.21.15.55:0/2479069802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866c0cb5d0 con 0x7f866c0b34f0 2024-04-02T07:24:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.211+0000 7f8672e00640 1 -- 172.21.15.55:0/2479069802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866c066c90 con 0x7f866c0b34f0 2024-04-02T07:24:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.211+0000 7f8668c00640 1 -- 172.21.15.55:0/2479069802 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f865c0bea80 con 0x7f866c0b34f0 2024-04-02T07:24:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.211+0000 7f8668c00640 1 --2- 172.21.15.55:0/2479069802 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8648066690 0x7f8648068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:07.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.211+0000 7f8668c00640 1 -- 172.21.15.55:0/2479069802 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f866c0c55a0 con 0x7f866c0b34f0 2024-04-02T07:24:07.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.215+0000 7f8663e00640 1 --2- 172.21.15.55:0/2479069802 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8648066690 0x7f8648068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:07.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.215+0000 7f8663e00640 1 --2- 172.21.15.55:0/2479069802 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8648066690 0x7f8648068b50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8654007fd0 tx=0x7f86540079a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:07.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.215+0000 7f8668c00640 1 -- 172.21.15.55:0/2479069802 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f865c0ebca0 con 0x7f866c0b34f0 2024-04-02T07:24:07.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.411+0000 7f8672e00640 1 -- 172.21.15.55:0/2479069802 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f866c0b2880 con 0x7f866c0b34f0 2024-04-02T07:24:07.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.411+0000 7f8668c00640 1 -- 172.21.15.55:0/2479069802 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3517 (secure 0 0 0) 0x7f865c0c4dd0 con 0x7f866c0b34f0 2024-04-02T07:24:07.415 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:07.415 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4883,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53106343","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53106343},{"type":"v1","addr":"172.21.15.55:6833","nonce":53106343}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4886,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/44669622","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":44669622},{"type":"v1","addr":"172.21.15.106:6837","nonce":44669622}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5116,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/741637637","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":741637637},{"type":"v1","addr":"172.21.15.106:6836","nonce":741637637}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5580,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/937354545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":937354545},{"type":"v1","addr":"172.21.15.55:6835","nonce":937354545}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":19}],"filesystems":[]} 2024-04-02T07:24:07.415 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 19 2024-04-02T07:24:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.415+0000 7f8672e00640 1 -- 172.21.15.55:0/2479069802 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8648066690 msgr2=0x7f8648068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.415+0000 7f8672e00640 1 --2- 172.21.15.55:0/2479069802 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8648066690 0x7f8648068b50 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8654007fd0 tx=0x7f86540079a0 comp rx=0 tx=0).stop 2024-04-02T07:24:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.415+0000 7f8672e00640 1 -- 172.21.15.55:0/2479069802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f866c0b34f0 msgr2=0x7f866c0cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.415+0000 7f8672e00640 1 --2- 172.21.15.55:0/2479069802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f866c0b34f0 0x7f866c0cbdd0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f865c01a050 tx=0x7f865c01ac60 comp rx=0 tx=0).stop 2024-04-02T07:24:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.415+0000 7f8672e00640 1 -- 172.21.15.55:0/2479069802 shutdown_connections 2024-04-02T07:24:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.415+0000 7f8672e00640 1 --2- 172.21.15.55:0/2479069802 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f866c143f90 0x7f866c142790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.415+0000 7f8672e00640 1 --2- 172.21.15.55:0/2479069802 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8648066690 0x7f8648068b50 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.415+0000 7f8672e00640 1 --2- 172.21.15.55:0/2479069802 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f866c0cda80 0x7f866c0cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.415+0000 7f8672e00640 1 --2- 172.21.15.55:0/2479069802 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f866c0b34f0 0x7f866c0cbdd0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.415+0000 7f8672e00640 1 -- 172.21.15.55:0/2479069802 >> 172.21.15.55:0/2479069802 conn(0x7f866c066080 msgr2=0x7f866c070210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.415+0000 7f8672e00640 1 -- 172.21.15.55:0/2479069802 shutdown_connections 2024-04-02T07:24:07.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.415+0000 7f8672e00640 1 -- 172.21.15.55:0/2479069802 wait complete. 2024-04-02T07:24:07.436 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-02T07:24:07.436 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-02T07:24:07.437 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-02T07:24:07.437 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:24:07.437 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-02T07:24:07.437 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-02T07:24:07.437 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-02T07:24:07.437 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:24:07.437 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-02T07:24:07.438 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-02T07:24:07.438 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-02T07:24:07.438 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:24:07.438 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-02T07:24:07.438 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-02T07:24:07.438 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-02T07:24:07.438 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:24:07.452 INFO:tasks.ceph.mds.a:Stopped 2024-04-02T07:24:07.452 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-02T07:24:07.453 INFO:tasks.ceph.mds.c:Stopped 2024-04-02T07:24:07.453 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-02T07:24:07.454 INFO:tasks.ceph.mds.b:Stopped 2024-04-02T07:24:07.455 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-02T07:24:07.455 INFO:tasks.ceph.mds.d:Stopped 2024-04-02T07:24:07.456 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-02T07:24:07.497 INFO:tasks.ceph.mds.a:Started 2024-04-02T07:24:07.498 DEBUG:teuthology.parallel:result is None 2024-04-02T07:24:07.499 INFO:tasks.ceph.mds.c:Started 2024-04-02T07:24:07.500 DEBUG:teuthology.parallel:result is None 2024-04-02T07:24:07.501 INFO:tasks.ceph.mds.b:Started 2024-04-02T07:24:07.501 DEBUG:teuthology.parallel:result is None 2024-04-02T07:24:07.502 INFO:tasks.ceph.mds.d:Started 2024-04-02T07:24:07.502 DEBUG:teuthology.parallel:result is None 2024-04-02T07:24:07.503 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-02T07:24:07.584 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-02T07:24:07.586 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-02T07:24:07.588 INFO:tasks.ceph.mds.b.smithi106.stdout:starting mds.b at 2024-04-02T07:24:07.588 INFO:tasks.ceph.mds.d.smithi106.stdout:starting mds.d at 2024-04-02T07:24:07.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.651+0000 7fe93ec00640 1 Processor -- start 2024-04-02T07:24:07.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.651+0000 7fe93ec00640 1 -- start start 2024-04-02T07:24:07.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.651+0000 7fe93ec00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe93815c860 0x7fe9380ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:07.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.651+0000 7fe93ec00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9380ccbe0 0x7fe9380cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:07.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.651+0000 7fe93ec00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9380aee40 con 0x7fe93815cc40 2024-04-02T07:24:07.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.651+0000 7fe93ec00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe93806e120 con 0x7fe93815c860 2024-04-02T07:24:07.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.651+0000 7fe93ec00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9380cf010 con 0x7fe9380ccbe0 2024-04-02T07:24:07.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.651+0000 7fe93d800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe93815c860 0x7fe9380ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:07.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.651+0000 7fe93ce00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe93815cc40 0x7fe938069d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48422/0 (socket says 172.21.15.55:48422) 2024-04-02T07:24:07.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.651+0000 7fe93ce00640 1 -- 172.21.15.55:0/50200109 learned_addr learned my addr 172.21.15.55:0/50200109 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:07.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.651+0000 7fe93e200640 1 --2- 172.21.15.55:0/50200109 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9380ccbe0 0x7fe9380cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:07.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.651+0000 7fe93d800640 1 -- 172.21.15.55:0/50200109 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9380ccbe0 msgr2=0x7fe9380cead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:07.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.651+0000 7fe93d800640 1 --2- 172.21.15.55:0/50200109 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9380ccbe0 0x7fe9380cead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:07.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.651+0000 7fe93d800640 1 -- 172.21.15.55:0/50200109 >> v1:172.21.15.55:6789/0 conn(0x7fe93815cc40 legacy=0x7fe938069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:07.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.651+0000 7fe93d800640 1 -- 172.21.15.55:0/50200109 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93806d510 con 0x7fe93815c860 2024-04-02T07:24:07.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.651+0000 7fe937e00640 1 -- 172.21.15.55:0/50200109 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1429268465 0 0) 0x7fe9380aee40 con 0x7fe93815cc40 2024-04-02T07:24:07.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.655+0000 7fe93d800640 1 --2- 172.21.15.55:0/50200109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93815c860 0x7fe9380ce590 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0097c0 tx=0x7fe92c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972ce11f2a2e9838 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:07.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.655+0000 7fe937e00640 1 -- 172.21.15.55:0/50200109 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c0ac640 con 0x7fe93815c860 2024-04-02T07:24:07.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.655+0000 7fe937e00640 1 -- 172.21.15.55:0/50200109 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92c0ac7a0 con 0x7fe93815c860 2024-04-02T07:24:07.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.655+0000 7fe937e00640 1 -- 172.21.15.55:0/50200109 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c0acb30 con 0x7fe93815c860 2024-04-02T07:24:07.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.655+0000 7fe93ec00640 1 -- 172.21.15.55:0/50200109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93815c860 msgr2=0x7fe9380ce590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:07.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.655+0000 7fe93ec00640 1 --2- 172.21.15.55:0/50200109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93815c860 0x7fe9380ce590 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0097c0 tx=0x7fe92c01c3e0 comp rx=0 tx=0).stop 2024-04-02T07:24:07.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.655+0000 7fe93ec00640 1 -- 172.21.15.55:0/50200109 shutdown_connections 2024-04-02T07:24:07.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.655+0000 7fe93ec00640 1 --2- 172.21.15.55:0/50200109 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9380ccbe0 0x7fe9380cead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:07.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.655+0000 7fe93ec00640 1 --2- 172.21.15.55:0/50200109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93815c860 0x7fe9380ce590 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:07.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.655+0000 7fe93ec00640 1 -- 172.21.15.55:0/50200109 >> 172.21.15.55:0/50200109 conn(0x7fe938098a10 msgr2=0x7fe9380cf5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:07.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.655+0000 7fe93ec00640 1 -- 172.21.15.55:0/50200109 shutdown_connections 2024-04-02T07:24:07.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.655+0000 7fe93ec00640 1 -- 172.21.15.55:0/50200109 wait complete. 2024-04-02T07:24:07.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93ec00640 1 Processor -- start 2024-04-02T07:24:07.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93ec00640 1 -- start start 2024-04-02T07:24:07.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93ec00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9380ccbe0 0x7fe93815ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93ec00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe93815c860 0x7fe93815d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93ec00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93815cc40 0x7fe9380b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93ec00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9380c7640 con 0x7fe93815cc40 2024-04-02T07:24:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93ec00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe938154810 con 0x7fe9380ccbe0 2024-04-02T07:24:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93ec00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9380c69c0 con 0x7fe93815c860 2024-04-02T07:24:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93e200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93815cc40 0x7fe9380b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93e200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93815cc40 0x7fe9380b3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53824/0 (socket says 172.21.15.55:53824) 2024-04-02T07:24:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93e200640 1 -- 172.21.15.55:0/2843666276 learned_addr learned my addr 172.21.15.55:0/2843666276 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93ce00640 1 --2- 172.21.15.55:0/2843666276 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe93815c860 0x7fe93815d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93d800640 1 --2- 172.21.15.55:0/2843666276 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9380ccbe0 0x7fe93815ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93e200640 1 -- 172.21.15.55:0/2843666276 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe93815c860 msgr2=0x7fe93815d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93e200640 1 --2- 172.21.15.55:0/2843666276 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe93815c860 0x7fe93815d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:07.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93e200640 1 -- 172.21.15.55:0/2843666276 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9380ccbe0 msgr2=0x7fe93815ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:07.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93e200640 1 --2- 172.21.15.55:0/2843666276 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9380ccbe0 0x7fe93815ba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:07.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93e200640 1 -- 172.21.15.55:0/2843666276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c009420 con 0x7fe93815cc40 2024-04-02T07:24:07.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93e200640 1 --2- 172.21.15.55:0/2843666276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93815cc40 0x7fe9380b3e10 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe93000efc0 tx=0x7fe93000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:07.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe935600640 1 -- 172.21.15.55:0/2843666276 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe930009ca0 con 0x7fe93815cc40 2024-04-02T07:24:07.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe935600640 1 -- 172.21.15.55:0/2843666276 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe93000f040 con 0x7fe93815cc40 2024-04-02T07:24:07.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe935600640 1 -- 172.21.15.55:0/2843666276 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9300146c0 con 0x7fe93815cc40 2024-04-02T07:24:07.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93ec00640 1 -- 172.21.15.55:0/2843666276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9380c6ca0 con 0x7fe93815cc40 2024-04-02T07:24:07.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.659+0000 7fe93ec00640 1 -- 172.21.15.55:0/2843666276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9380c7260 con 0x7fe93815cc40 2024-04-02T07:24:07.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.663+0000 7fe93ec00640 1 -- 172.21.15.55:0/2843666276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9380c7780 con 0x7fe93815cc40 2024-04-02T07:24:07.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.663+0000 7fe935600640 1 -- 172.21.15.55:0/2843666276 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe930014820 con 0x7fe93815cc40 2024-04-02T07:24:07.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.663+0000 7fe935600640 1 --2- 172.21.15.55:0/2843666276 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe9180666c0 0x7fe918068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:07.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.663+0000 7fe935600640 1 -- 172.21.15.55:0/2843666276 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe930084c80 con 0x7fe93815cc40 2024-04-02T07:24:07.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.663+0000 7fe93d800640 1 --2- 172.21.15.55:0/2843666276 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe9180666c0 0x7fe918068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:07.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.663+0000 7fe93d800640 1 --2- 172.21.15.55:0/2843666276 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe9180666c0 0x7fe918068b80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0ae000 tx=0x7fe92c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:07.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.667+0000 7fe935600640 1 -- 172.21.15.55:0/2843666276 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe9380c7780 con 0x7fe93815cc40 2024-04-02T07:24:07.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:07.839+0000 7fe93ec00640 1 -- 172.21.15.55:0/2843666276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fe9380c6470 con 0x7fe93815cc40 2024-04-02T07:24:08.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.631+0000 7fe935600640 1 -- 172.21.15.55:0/2843666276 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v42) v1 ==== 97+0+0 (secure 0 0 0) 0x7fe930052300 con 0x7fe93815cc40 2024-04-02T07:24:08.633 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2024-04-02T07:24:08.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.631+0000 7fe93ec00640 1 -- 172.21.15.55:0/2843666276 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe9180666c0 msgr2=0x7fe918068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:08.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.631+0000 7fe93ec00640 1 --2- 172.21.15.55:0/2843666276 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe9180666c0 0x7fe918068b80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0ae000 tx=0x7fe92c0a7000 comp rx=0 tx=0).stop 2024-04-02T07:24:08.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.631+0000 7fe93ec00640 1 -- 172.21.15.55:0/2843666276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93815cc40 msgr2=0x7fe9380b3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:08.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.631+0000 7fe93ec00640 1 --2- 172.21.15.55:0/2843666276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93815cc40 0x7fe9380b3e10 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fe93000efc0 tx=0x7fe93000c490 comp rx=0 tx=0).stop 2024-04-02T07:24:08.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.631+0000 7fe93ec00640 1 -- 172.21.15.55:0/2843666276 shutdown_connections 2024-04-02T07:24:08.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.631+0000 7fe93ec00640 1 --2- 172.21.15.55:0/2843666276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe93815cc40 0x7fe9380b3e10 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:08.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.631+0000 7fe93ec00640 1 --2- 172.21.15.55:0/2843666276 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe93815c860 0x7fe93815d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:08.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.631+0000 7fe93ec00640 1 --2- 172.21.15.55:0/2843666276 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe9180666c0 0x7fe918068b80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:08.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.631+0000 7fe93ec00640 1 --2- 172.21.15.55:0/2843666276 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe9380ccbe0 0x7fe93815ba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:08.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.631+0000 7fe93ec00640 1 -- 172.21.15.55:0/2843666276 >> 172.21.15.55:0/2843666276 conn(0x7fe938098a10 msgr2=0x7fe938158750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:08.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.631+0000 7fe93ec00640 1 -- 172.21.15.55:0/2843666276 shutdown_connections 2024-04-02T07:24:08.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.631+0000 7fe93ec00640 1 -- 172.21.15.55:0/2843666276 wait complete. 2024-04-02T07:24:08.658 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-02T07:24:08.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.803+0000 7fd1ce800640 1 Processor -- start 2024-04-02T07:24:08.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.803+0000 7fd1ce800640 1 -- start start 2024-04-02T07:24:08.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.803+0000 7fd1ce800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1c80b4760 0x7fd1c80ce710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:08.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.803+0000 7fd1ce800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd1c80b3b80 0x7fd1c80cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:08.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.803+0000 7fd1ce800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c80cf190 con 0x7fd1c81598e0 2024-04-02T07:24:08.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.803+0000 7fd1ce800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c80ccc90 con 0x7fd1c80b3b80 2024-04-02T07:24:08.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.803+0000 7fd1ce800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c806f970 con 0x7fd1c80b4760 2024-04-02T07:24:08.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.803+0000 7fd1c7400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd1c81598e0 0x7fd1c806f260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48430/0 (socket says 172.21.15.55:48430) 2024-04-02T07:24:08.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.803+0000 7fd1c7400640 1 -- 172.21.15.55:0/2080269593 learned_addr learned my addr 172.21.15.55:0/2080269593 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:08.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.803+0000 7fd1c7e00640 1 --2- 172.21.15.55:0/2080269593 >> v2:172.21.15.55:3300/0 conn(0x7fd1c80b3b80 0x7fd1c80cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:08.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.803+0000 7fd1c6a00640 1 --2- 172.21.15.55:0/2080269593 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1c80b4760 0x7fd1c80ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:08.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.803+0000 7fd1c6000640 1 -- 172.21.15.55:0/2080269593 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72681326 0 0) 0x7fd1c80cf190 con 0x7fd1c81598e0 2024-04-02T07:24:08.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.803+0000 7fd1c7e00640 1 -- 172.21.15.55:0/2080269593 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1c80b4760 msgr2=0x7fd1c80ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:08.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.803+0000 7fd1c7e00640 1 --2- 172.21.15.55:0/2080269593 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1c80b4760 0x7fd1c80ce710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:08.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.803+0000 7fd1c7e00640 1 -- 172.21.15.55:0/2080269593 >> v1:172.21.15.55:6789/0 conn(0x7fd1c81598e0 legacy=0x7fd1c806f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:08.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.803+0000 7fd1c7e00640 1 -- 172.21.15.55:0/2080269593 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c80ccf50 con 0x7fd1c80b3b80 2024-04-02T07:24:08.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.807+0000 7fd1c7e00640 1 --2- 172.21.15.55:0/2080269593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1c80b3b80 0x7fd1c80cec50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0009d90 tx=0x7fd1c001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf738c099812bc87 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:08.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.807+0000 7fd1c6000640 1 -- 172.21.15.55:0/2080269593 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c00a58b0 con 0x7fd1c80b3b80 2024-04-02T07:24:08.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.807+0000 7fd1c6000640 1 -- 172.21.15.55:0/2080269593 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c00a5a10 con 0x7fd1c80b3b80 2024-04-02T07:24:08.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.807+0000 7fd1c6000640 1 -- 172.21.15.55:0/2080269593 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c00a5da0 con 0x7fd1c80b3b80 2024-04-02T07:24:08.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.807+0000 7fd1ce800640 1 -- 172.21.15.55:0/2080269593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1c80b3b80 msgr2=0x7fd1c80cec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:08.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.807+0000 7fd1ce800640 1 --2- 172.21.15.55:0/2080269593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1c80b3b80 0x7fd1c80cec50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd1c0009d90 tx=0x7fd1c001c8e0 comp rx=0 tx=0).stop 2024-04-02T07:24:08.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.807+0000 7fd1ce800640 1 -- 172.21.15.55:0/2080269593 shutdown_connections 2024-04-02T07:24:08.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.807+0000 7fd1ce800640 1 --2- 172.21.15.55:0/2080269593 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1c80b4760 0x7fd1c80ce710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:08.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.807+0000 7fd1ce800640 1 --2- 172.21.15.55:0/2080269593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1c80b3b80 0x7fd1c80cec50 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:08.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.807+0000 7fd1ce800640 1 -- 172.21.15.55:0/2080269593 >> 172.21.15.55:0/2080269593 conn(0x7fd1c80b13b0 msgr2=0x7fd1c80b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:08.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.807+0000 7fd1ce800640 1 -- 172.21.15.55:0/2080269593 shutdown_connections 2024-04-02T07:24:08.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.807+0000 7fd1ce800640 1 -- 172.21.15.55:0/2080269593 wait complete. 2024-04-02T07:24:08.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.807+0000 7fd1ce800640 1 Processor -- start 2024-04-02T07:24:08.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.807+0000 7fd1ce800640 1 -- start start 2024-04-02T07:24:08.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1ce800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1c80b3b80 0x7fd1c814dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1ce800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1c80b4760 0x7fd1c8155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1ce800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1c81598e0 0x7fd1c814f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1ce800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c814e740 con 0x7fd1c80b4760 2024-04-02T07:24:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1ce800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c814ea20 con 0x7fd1c80b3b80 2024-04-02T07:24:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1ce800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c814ed00 con 0x7fd1c81598e0 2024-04-02T07:24:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1c6a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1c80b4760 0x7fd1c8155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1c6a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1c80b4760 0x7fd1c8155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53844/0 (socket says 172.21.15.55:53844) 2024-04-02T07:24:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1c6a00640 1 -- 172.21.15.55:0/3302107667 learned_addr learned my addr 172.21.15.55:0/3302107667 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1c7400640 1 --2- 172.21.15.55:0/3302107667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1c80b3b80 0x7fd1c814dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1c7e00640 1 --2- 172.21.15.55:0/3302107667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1c81598e0 0x7fd1c814f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1c6a00640 1 -- 172.21.15.55:0/3302107667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1c81598e0 msgr2=0x7fd1c814f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1c6a00640 1 --2- 172.21.15.55:0/3302107667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1c81598e0 0x7fd1c814f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1c6a00640 1 -- 172.21.15.55:0/3302107667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1c80b3b80 msgr2=0x7fd1c814dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:08.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1c6a00640 1 --2- 172.21.15.55:0/3302107667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1c80b3b80 0x7fd1c814dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:08.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1c6a00640 1 -- 172.21.15.55:0/3302107667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c0009a70 con 0x7fd1c80b4760 2024-04-02T07:24:08.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1c7e00640 1 --2- 172.21.15.55:0/3302107667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1c81598e0 0x7fd1c814f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:08.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1c6a00640 1 --2- 172.21.15.55:0/3302107667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1c80b4760 0x7fd1c8155310 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400d7d0 tx=0x7fd1b400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:08.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1bf400640 1 -- 172.21.15.55:0/3302107667 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400b6c0 con 0x7fd1c80b4760 2024-04-02T07:24:08.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1bf400640 1 -- 172.21.15.55:0/3302107667 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b400b820 con 0x7fd1c80b4760 2024-04-02T07:24:08.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1ce800640 1 -- 172.21.15.55:0/3302107667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c814efe0 con 0x7fd1c80b4760 2024-04-02T07:24:08.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1bf400640 1 -- 172.21.15.55:0/3302107667 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b400bbd0 con 0x7fd1c80b4760 2024-04-02T07:24:08.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1ce800640 1 -- 172.21.15.55:0/3302107667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c814e120 con 0x7fd1c80b4760 2024-04-02T07:24:08.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1ce800640 1 -- 172.21.15.55:0/3302107667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c8066c90 con 0x7fd1c80b4760 2024-04-02T07:24:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.811+0000 7fd1bf400640 1 -- 172.21.15.55:0/3302107667 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd1b400bd30 con 0x7fd1c80b4760 2024-04-02T07:24:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.815+0000 7fd1bf400640 1 --2- 172.21.15.55:0/3302107667 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd1a80666c0 0x7fd1a8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.815+0000 7fd1bf400640 1 -- 172.21.15.55:0/3302107667 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd1b4084400 con 0x7fd1c80b4760 2024-04-02T07:24:08.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.815+0000 7fd1c7400640 1 --2- 172.21.15.55:0/3302107667 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd1a80666c0 0x7fd1a8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:08.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.815+0000 7fd1c7400640 1 --2- 172.21.15.55:0/3302107667 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd1a80666c0 0x7fd1a8068b80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8000f70 tx=0x7fd1b8007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:08.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:08.819+0000 7fd1bf400640 1 -- 172.21.15.55:0/3302107667 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd1b4051990 con 0x7fd1c80b4760 2024-04-02T07:24:09.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.035+0000 7fd1ce800640 1 -- 172.21.15.55:0/3302107667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd1c80ad9d0 con 0x7fd1c80b4760 2024-04-02T07:24:09.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.035+0000 7fd1bf400640 1 -- 172.21.15.55:0/3302107667 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v11) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd1b4054fb0 con 0x7fd1c80b4760 2024-04-02T07:24:09.039 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:09.039 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:24:09.039 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2024-04-02T07:24:09.039 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:09.040 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2024-04-02T07:24:09.040 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFL1DHxAAuUs47l42sADNRgxi4BeNrA==", 2024-04-02T07:24:09.040 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:24:09.040 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:24:09.040 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:24:09.040 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:24:09.040 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:24:09.040 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:09.040 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:09.040 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:09.040 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2024-04-02T07:24:09.040 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFZB+KxAAeKnfP4Z1UkLura+bQrG5mA==", 2024-04-02T07:24:09.040 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:24:09.040 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:24:09.041 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:24:09.041 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:24:09.041 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:24:09.041 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:09.041 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:09.041 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:09.041 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2024-04-02T07:24:09.041 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmUQR/JhAA9LNK5gHJ1NiiqNrfxL4mIA==", 2024-04-02T07:24:09.041 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:24:09.041 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:24:09.041 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:24:09.041 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:24:09.041 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:24:09.041 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:09.041 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:09.042 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:09.042 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2024-04-02T07:24:09.042 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmotumMhAASI1PogpVSHXWIv9xq3qs4Q==", 2024-04-02T07:24:09.042 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:24:09.042 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:24:09.042 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:24:09.042 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:24:09.042 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:24:09.042 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:09.042 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:09.042 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:09.042 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2024-04-02T07:24:09.042 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDysQtmsM9JIxAAZNjTGYW74kqz5NM9NyPSWQ==", 2024-04-02T07:24:09.042 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:24:09.043 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:24:09.043 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:24:09.043 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:24:09.043 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:09.043 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:09.043 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:09.043 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2024-04-02T07:24:09.043 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD1sQtmJaorKhAAtujPXPmQVX3QUG1ANqEphQ==", 2024-04-02T07:24:09.043 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:24:09.043 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:24:09.043 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:24:09.043 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:24:09.043 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:09.043 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:09.044 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:09.044 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2024-04-02T07:24:09.044 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD4sQtm1fdwMhAAOxlYwaBnPKhSQODMLVbaSQ==", 2024-04-02T07:24:09.044 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:24:09.044 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:24:09.044 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:24:09.044 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:24:09.044 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:09.044 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:09.044 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:09.044 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2024-04-02T07:24:09.044 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD7sQtmo9OaORAAsjpiVkG9vZV1QxpvgbrFmg==", 2024-04-02T07:24:09.044 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:24:09.044 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:24:09.045 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:24:09.045 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:24:09.045 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:09.045 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:09.045 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:09.045 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2024-04-02T07:24:09.045 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQACsgtmTyOkAxAARfxuj/YCM6FWNDhCkLQV3g==", 2024-04-02T07:24:09.045 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:24:09.045 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:24:09.045 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:24:09.045 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:24:09.045 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:09.046 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:09.046 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:09.046 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2024-04-02T07:24:09.046 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAFsgtmimDECRAAh/XVN7rICihc8NlxhDJB6Q==", 2024-04-02T07:24:09.046 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:24:09.046 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:24:09.046 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:24:09.046 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:24:09.046 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:09.046 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:09.046 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:09.046 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2024-04-02T07:24:09.046 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAIsgtmreHiDhAAISQbxixad17TRrz7MHQTxA==", 2024-04-02T07:24:09.047 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:24:09.047 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:24:09.047 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:24:09.047 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:24:09.047 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:09.047 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:09.047 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:09.047 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2024-04-02T07:24:09.047 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQALsgtmHVTlExAAT/6jK+czOZ3+4nwpgZOmow==", 2024-04-02T07:24:09.047 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:24:09.047 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:24:09.047 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:24:09.047 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:24:09.047 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:09.048 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:09.048 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:09.048 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2024-04-02T07:24:09.048 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmkS2QNhAAt+q0y1TDn03hqM/Y6uKq6g==", 2024-04-02T07:24:09.048 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:24:09.048 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:24:09.048 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2024-04-02T07:24:09.048 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-02T07:24:09.048 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:09.048 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:09.048 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:09.048 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2024-04-02T07:24:09.048 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmjCzTBBAAVYyat2dGZSTquRQoB+7JMg==", 2024-04-02T07:24:09.048 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:24:09.049 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:24:09.049 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:24:09.049 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:24:09.049 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:24:09.049 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:09.049 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:09.049 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:09.049 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2024-04-02T07:24:09.049 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmq45FARAAY6/caSeqvTn7/BThOodYIA==", 2024-04-02T07:24:09.049 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:24:09.049 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:24:09.049 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:24:09.049 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:24:09.050 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:24:09.050 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:09.050 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:09.050 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:09.050 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2024-04-02T07:24:09.050 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmmjDeChAAL2RsY5VlAy/KZ5go5ZJoBA==", 2024-04-02T07:24:09.050 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:24:09.050 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:24:09.050 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:24:09.050 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:24:09.050 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:24:09.050 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:09.050 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:09.050 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:09.051 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2024-04-02T07:24:09.051 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtm1hiMAxAAarlHR9VHGrkPCXhksMM/1w==", 2024-04-02T07:24:09.051 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:24:09.051 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:24:09.051 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:24:09.051 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:24:09.051 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:24:09.051 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:09.051 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:09.051 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:09.051 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2024-04-02T07:24:09.051 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFyktGxAAJC7ezewbXwDQue+qjpTfYw==", 2024-04-02T07:24:09.051 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:24:09.051 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:24:09.051 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-02T07:24:09.051 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:24:09.052 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:09.052 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:09.052 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:09.052 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2024-04-02T07:24:09.052 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmUcxUFxAA8NUHdxhUfp3/AILMIbS1fw==", 2024-04-02T07:24:09.052 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:24:09.052 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:24:09.052 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-02T07:24:09.052 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:24:09.052 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:09.052 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:09.052 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-04-02T07:24:09.052 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:24:09.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.039+0000 7fd1ce800640 1 -- 172.21.15.55:0/3302107667 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd1a80666c0 msgr2=0x7fd1a8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:09.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.039+0000 7fd1ce800640 1 --2- 172.21.15.55:0/3302107667 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd1a80666c0 0x7fd1a8068b80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8000f70 tx=0x7fd1b8007df0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.039+0000 7fd1ce800640 1 -- 172.21.15.55:0/3302107667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1c80b4760 msgr2=0x7fd1c8155310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:09.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.039+0000 7fd1ce800640 1 --2- 172.21.15.55:0/3302107667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1c80b4760 0x7fd1c8155310 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fd1b400d7d0 tx=0x7fd1b400dc90 comp rx=0 tx=0).stop 2024-04-02T07:24:09.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.039+0000 7fd1ce800640 1 -- 172.21.15.55:0/3302107667 shutdown_connections 2024-04-02T07:24:09.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.039+0000 7fd1ce800640 1 --2- 172.21.15.55:0/3302107667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1c81598e0 0x7fd1c814f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.039+0000 7fd1ce800640 1 --2- 172.21.15.55:0/3302107667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1c80b4760 0x7fd1c8155310 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.039+0000 7fd1ce800640 1 --2- 172.21.15.55:0/3302107667 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd1a80666c0 0x7fd1a8068b80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.039+0000 7fd1ce800640 1 --2- 172.21.15.55:0/3302107667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1c80b3b80 0x7fd1c814dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.039+0000 7fd1ce800640 1 -- 172.21.15.55:0/3302107667 >> 172.21.15.55:0/3302107667 conn(0x7fd1c80b13b0 msgr2=0x7fd1c81540e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:09.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.039+0000 7fd1ce800640 1 -- 172.21.15.55:0/3302107667 shutdown_connections 2024-04-02T07:24:09.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.039+0000 7fd1ce800640 1 -- 172.21.15.55:0/3302107667 wait complete. 2024-04-02T07:24:09.061 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:24:09.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.199+0000 7feeb3600640 1 Processor -- start 2024-04-02T07:24:09.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.199+0000 7feeb3600640 1 -- start start 2024-04-02T07:24:09.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.199+0000 7feeb3600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feeac15ad30 0x7feeac0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:09.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.199+0000 7feeb3600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeac0cdce0 con 0x7feeac0cd8b0 2024-04-02T07:24:09.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.199+0000 7feeb3600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feeac0b3c00 con 0x7feeac143f90 2024-04-02T07:24:09.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.199+0000 7feeb3600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feeac144370 con 0x7feeac15ad30 2024-04-02T07:24:09.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.199+0000 7feea3e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feeac15ad30 0x7feeac0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:09.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.199+0000 7feeb1600640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feeac0cd8b0 0x7feeac0c4850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48438/0 (socket says 172.21.15.55:48438) 2024-04-02T07:24:09.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.199+0000 7feeb1600640 1 -- 172.21.15.55:0/2874441 learned_addr learned my addr 172.21.15.55:0/2874441 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:09.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.199+0000 7feea3e00640 1 -- 172.21.15.55:0/2874441 >> v1:172.21.15.106:6789/0 conn(0x7feeac143f90 legacy=0x7feeac0b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:09.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.199+0000 7feea3e00640 1 -- 172.21.15.55:0/2874441 >> v1:172.21.15.55:6789/0 conn(0x7feeac0cd8b0 legacy=0x7feeac0c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:09.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.199+0000 7feea3e00640 1 -- 172.21.15.55:0/2874441 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeac0c37b0 con 0x7feeac15ad30 2024-04-02T07:24:09.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.203+0000 7feea3e00640 1 --2- 172.21.15.55:0/2874441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feeac15ad30 0x7feeac0cd370 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fee940097c0 tx=0x7fee9401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763fa4703f8cdb8f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:09.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.203+0000 7feeabe00640 1 -- 172.21.15.55:0/2874441 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee940ac640 con 0x7feeac15ad30 2024-04-02T07:24:09.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.203+0000 7feeabe00640 1 -- 172.21.15.55:0/2874441 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee940ac7a0 con 0x7feeac15ad30 2024-04-02T07:24:09.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.203+0000 7feeabe00640 1 -- 172.21.15.55:0/2874441 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee940acb30 con 0x7feeac15ad30 2024-04-02T07:24:09.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.203+0000 7feeb3600640 1 -- 172.21.15.55:0/2874441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feeac15ad30 msgr2=0x7feeac0cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:09.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.203+0000 7feeb3600640 1 --2- 172.21.15.55:0/2874441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feeac15ad30 0x7feeac0cd370 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fee940097c0 tx=0x7fee9401c3e0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.203+0000 7feeb3600640 1 -- 172.21.15.55:0/2874441 shutdown_connections 2024-04-02T07:24:09.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.203+0000 7feeb3600640 1 --2- 172.21.15.55:0/2874441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feeac15ad30 0x7feeac0cd370 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.203+0000 7feeb3600640 1 -- 172.21.15.55:0/2874441 >> 172.21.15.55:0/2874441 conn(0x7feeac066080 msgr2=0x7feeac069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:09.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.203+0000 7feeb3600640 1 -- 172.21.15.55:0/2874441 shutdown_connections 2024-04-02T07:24:09.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.203+0000 7feeb3600640 1 -- 172.21.15.55:0/2874441 wait complete. 2024-04-02T07:24:09.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feeb3600640 1 Processor -- start 2024-04-02T07:24:09.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feeb3600640 1 -- start start 2024-04-02T07:24:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feeb3600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feeac0cd8b0 0x7feeac1350e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feeb3600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feeac143f90 0x7feeac135620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feeb3600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feeac15ad30 0x7feeac163890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feeb3600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac1658a0 con 0x7feeac143f90 2024-04-02T07:24:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feeb3600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feeac165b80 con 0x7feeac0cd8b0 2024-04-02T07:24:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feeb3600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feeac165e60 con 0x7feeac15ad30 2024-04-02T07:24:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feea3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feeac143f90 0x7feeac135620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feea3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feeac143f90 0x7feeac135620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53872/0 (socket says 172.21.15.55:53872) 2024-04-02T07:24:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feea3e00640 1 -- 172.21.15.55:0/825285882 learned_addr learned my addr 172.21.15.55:0/825285882 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feeb0c00640 1 --2- 172.21.15.55:0/825285882 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feeac0cd8b0 0x7feeac1350e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feeb1600640 1 --2- 172.21.15.55:0/825285882 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feeac15ad30 0x7feeac163890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feea3e00640 1 -- 172.21.15.55:0/825285882 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feeac15ad30 msgr2=0x7feeac163890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feea3e00640 1 --2- 172.21.15.55:0/825285882 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feeac15ad30 0x7feeac163890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feea3e00640 1 -- 172.21.15.55:0/825285882 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feeac0cd8b0 msgr2=0x7feeac1350e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:09.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feea3e00640 1 --2- 172.21.15.55:0/825285882 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feeac0cd8b0 0x7feeac1350e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feea3e00640 1 -- 172.21.15.55:0/825285882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee94009420 con 0x7feeac143f90 2024-04-02T07:24:09.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feeb1600640 1 --2- 172.21.15.55:0/825285882 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feeac15ad30 0x7feeac163890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:09.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feea3e00640 1 --2- 172.21.15.55:0/825285882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feeac143f90 0x7feeac135620 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fee9401a010 tx=0x7fee94019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:09.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feea9600640 1 -- 172.21.15.55:0/825285882 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee940bb070 con 0x7feeac143f90 2024-04-02T07:24:09.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feea9600640 1 -- 172.21.15.55:0/825285882 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee940ac5e0 con 0x7feeac143f90 2024-04-02T07:24:09.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feea9600640 1 -- 172.21.15.55:0/825285882 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee940b5840 con 0x7feeac143f90 2024-04-02T07:24:09.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feeb3600640 1 -- 172.21.15.55:0/825285882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feeac166140 con 0x7feeac143f90 2024-04-02T07:24:09.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.207+0000 7feeb3600640 1 -- 172.21.15.55:0/825285882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feeac166420 con 0x7feeac143f90 2024-04-02T07:24:09.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.211+0000 7feeb3600640 1 -- 172.21.15.55:0/825285882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feeac159450 con 0x7feeac143f90 2024-04-02T07:24:09.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.211+0000 7feea9600640 1 -- 172.21.15.55:0/825285882 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fee940b3040 con 0x7feeac143f90 2024-04-02T07:24:09.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.211+0000 7feea9600640 1 --2- 172.21.15.55:0/825285882 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fee88066690 0x7fee88068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:09.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.211+0000 7feea9600640 1 -- 172.21.15.55:0/825285882 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fee9411d9e0 con 0x7feeac143f90 2024-04-02T07:24:09.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.211+0000 7feeb0c00640 1 --2- 172.21.15.55:0/825285882 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fee88066690 0x7fee88068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:09.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.211+0000 7feeb0c00640 1 --2- 172.21.15.55:0/825285882 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fee88066690 0x7fee88068b50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fee9c007fd0 tx=0x7fee9c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:09.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.215+0000 7feea9600640 1 -- 172.21.15.55:0/825285882 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7feeac159450 con 0x7feeac143f90 2024-04-02T07:24:09.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.375+0000 7feeb3600640 1 -- 172.21.15.55:0/825285882 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feeac159450 con 0x7feeac143f90 2024-04-02T07:24:09.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.379+0000 7feea9600640 1 -- 172.21.15.55:0/825285882 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+12389 (secure 0 0 0) 0x7feeac159450 con 0x7feeac143f90 2024-04-02T07:24:09.380 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:09.381 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":42,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:24:08.623288+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:24:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.379+0000 7feeb3600640 1 -- 172.21.15.55:0/825285882 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fee88066690 msgr2=0x7fee88068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.379+0000 7feeb3600640 1 --2- 172.21.15.55:0/825285882 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fee88066690 0x7fee88068b50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fee9c007fd0 tx=0x7fee9c009040 comp rx=0 tx=0).stop 2024-04-02T07:24:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.379+0000 7feeb3600640 1 -- 172.21.15.55:0/825285882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feeac143f90 msgr2=0x7feeac135620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.379+0000 7feeb3600640 1 --2- 172.21.15.55:0/825285882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feeac143f90 0x7feeac135620 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fee9401a010 tx=0x7fee94019180 comp rx=0 tx=0).stop 2024-04-02T07:24:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.379+0000 7feeb3600640 1 -- 172.21.15.55:0/825285882 shutdown_connections 2024-04-02T07:24:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.379+0000 7feeb3600640 1 --2- 172.21.15.55:0/825285882 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feeac15ad30 0x7feeac163890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.379+0000 7feeb3600640 1 --2- 172.21.15.55:0/825285882 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feeac143f90 0x7feeac135620 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.379+0000 7feeb3600640 1 --2- 172.21.15.55:0/825285882 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fee88066690 0x7fee88068b50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.379+0000 7feeb3600640 1 --2- 172.21.15.55:0/825285882 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feeac0cd8b0 0x7feeac1350e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.379+0000 7feeb3600640 1 -- 172.21.15.55:0/825285882 >> 172.21.15.55:0/825285882 conn(0x7feeac066080 msgr2=0x7feeac13f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:09.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.379+0000 7feeb3600640 1 -- 172.21.15.55:0/825285882 shutdown_connections 2024-04-02T07:24:09.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.379+0000 7feeb3600640 1 -- 172.21.15.55:0/825285882 wait complete. 2024-04-02T07:24:09.401 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:24:09.402 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:24:09.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.543+0000 7f2f3da00640 1 Processor -- start 2024-04-02T07:24:09.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.543+0000 7f2f3da00640 1 -- start start 2024-04-02T07:24:09.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.543+0000 7f2f3da00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f380b3dc0 0x7f2f380ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:09.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.543+0000 7f2f3da00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2f380ade90 0x7f2f3806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:09.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.543+0000 7f2f3da00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f3806c630 con 0x7f2f380b41a0 2024-04-02T07:24:09.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.543+0000 7f2f3da00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f3806c8f0 con 0x7f2f380b3dc0 2024-04-02T07:24:09.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.543+0000 7f2f3da00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f3806cbd0 con 0x7f2f380ade90 2024-04-02T07:24:09.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.543+0000 7f2f36a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f380b3dc0 0x7f2f380ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:09.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.543+0000 7f2f36a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f380b3dc0 0x7f2f380ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53878/0 (socket says 172.21.15.55:53878) 2024-04-02T07:24:09.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.543+0000 7f2f36a00640 1 -- 172.21.15.55:0/1678047005 learned_addr learned my addr 172.21.15.55:0/1678047005 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:09.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.543+0000 7f2f36000640 1 --2- 172.21.15.55:0/1678047005 >> v2:172.21.15.106:3300/0 conn(0x7f2f380ade90 0x7f2f3806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:09.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.543+0000 7f2f36a00640 1 -- 172.21.15.55:0/1678047005 >> v2:172.21.15.106:3300/0 conn(0x7f2f380ade90 msgr2=0x7f2f3806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:09.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.543+0000 7f2f36a00640 1 --2- 172.21.15.55:0/1678047005 >> v2:172.21.15.106:3300/0 conn(0x7f2f380ade90 0x7f2f3806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.543+0000 7f2f36a00640 1 -- 172.21.15.55:0/1678047005 >> v1:172.21.15.106:6789/0 conn(0x7f2f380b41a0 legacy=0x7f2f38142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:09.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.543+0000 7f2f36a00640 1 -- 172.21.15.55:0/1678047005 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3806ceb0 con 0x7f2f380b3dc0 2024-04-02T07:24:09.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.547+0000 7f2f36a00640 1 --2- 172.21.15.55:0/1678047005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f380b3dc0 0x7f2f380ca770 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2f3806c820 tx=0x7f2f2801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec195623366a936e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.547+0000 7f2f35600640 1 -- 172.21.15.55:0/1678047005 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f280aa670 con 0x7f2f380b3dc0 2024-04-02T07:24:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.547+0000 7f2f35600640 1 -- 172.21.15.55:0/1678047005 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f280aa7d0 con 0x7f2f380b3dc0 2024-04-02T07:24:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.547+0000 7f2f35600640 1 -- 172.21.15.55:0/1678047005 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f280aab60 con 0x7f2f380b3dc0 2024-04-02T07:24:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.547+0000 7f2f3da00640 1 -- 172.21.15.55:0/1678047005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f380b3dc0 msgr2=0x7f2f380ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.547+0000 7f2f3da00640 1 --2- 172.21.15.55:0/1678047005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f380b3dc0 0x7f2f380ca770 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2f3806c820 tx=0x7f2f2801c4f0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.547+0000 7f2f3da00640 1 -- 172.21.15.55:0/1678047005 shutdown_connections 2024-04-02T07:24:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.547+0000 7f2f3da00640 1 --2- 172.21.15.55:0/1678047005 >> v2:172.21.15.106:3300/0 conn(0x7f2f380ade90 0x7f2f3806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.547+0000 7f2f3da00640 1 --2- 172.21.15.55:0/1678047005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f380b3dc0 0x7f2f380ca770 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.547+0000 7f2f3da00640 1 -- 172.21.15.55:0/1678047005 >> 172.21.15.55:0/1678047005 conn(0x7f2f3806a390 msgr2=0x7f2f380b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.547+0000 7f2f3da00640 1 -- 172.21.15.55:0/1678047005 shutdown_connections 2024-04-02T07:24:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.547+0000 7f2f3da00640 1 -- 172.21.15.55:0/1678047005 wait complete. 2024-04-02T07:24:09.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f3da00640 1 Processor -- start 2024-04-02T07:24:09.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f3da00640 1 -- start start 2024-04-02T07:24:09.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f3da00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f380ade90 0x7f2f381352e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:09.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f3da00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f380b3dc0 0x7f2f38132820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:09.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f3da00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f380b41a0 0x7f2f3814fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:09.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f3da00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f38132d60 con 0x7f2f380b41a0 2024-04-02T07:24:09.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f3da00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3815c060 con 0x7f2f380ade90 2024-04-02T07:24:09.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f3da00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f3815c340 con 0x7f2f380b3dc0 2024-04-02T07:24:09.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f37400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f380b41a0 0x7f2f3814fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:09.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f36a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f380ade90 0x7f2f381352e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:09.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f36000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f380b3dc0 0x7f2f38132820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:09.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f36a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f380ade90 0x7f2f381352e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:59098/0 (socket says 172.21.15.55:59098) 2024-04-02T07:24:09.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f36a00640 1 -- 172.21.15.55:0/1153962584 learned_addr learned my addr 172.21.15.55:0/1153962584 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:09.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f36000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f380b3dc0 0x7f2f38132820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:60240/0 (socket says 172.21.15.55:60240) 2024-04-02T07:24:09.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f37400640 1 -- 172.21.15.55:0/1153962584 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f380b3dc0 msgr2=0x7f2f38132820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:09.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f37400640 1 --2- 172.21.15.55:0/1153962584 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f380b3dc0 0x7f2f38132820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f37400640 1 -- 172.21.15.55:0/1153962584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f380ade90 msgr2=0x7f2f381352e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:09.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f37400640 1 --2- 172.21.15.55:0/1153962584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f380ade90 0x7f2f381352e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f37400640 1 -- 172.21.15.55:0/1153962584 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f280094d0 con 0x7f2f380b41a0 2024-04-02T07:24:09.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f36a00640 1 --2- 172.21.15.55:0/1153962584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f380ade90 0x7f2f381352e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:24:09.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f37400640 1 --2- 172.21.15.55:0/1153962584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f380b41a0 0x7f2f3814fe80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000c700 tx=0x7f2f3000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:09.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f2ea00640 1 -- 172.21.15.55:0/1153962584 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30003b80 con 0x7f2f380b41a0 2024-04-02T07:24:09.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f2ea00640 1 -- 172.21.15.55:0/1153962584 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f30003ce0 con 0x7f2f380b41a0 2024-04-02T07:24:09.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f3da00640 1 -- 172.21.15.55:0/1153962584 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f3806de00 con 0x7f2f380b41a0 2024-04-02T07:24:09.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f2ea00640 1 -- 172.21.15.55:0/1153962584 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f30005310 con 0x7f2f380b41a0 2024-04-02T07:24:09.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.551+0000 7f2f3da00640 1 -- 172.21.15.55:0/1153962584 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f38151e50 con 0x7f2f380b41a0 2024-04-02T07:24:09.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.555+0000 7f2f3da00640 1 -- 172.21.15.55:0/1153962584 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f3815c500 con 0x7f2f380b41a0 2024-04-02T07:24:09.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.555+0000 7f2f2ea00640 1 -- 172.21.15.55:0/1153962584 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2f30005470 con 0x7f2f380b41a0 2024-04-02T07:24:09.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.555+0000 7f2f2ea00640 1 --2- 172.21.15.55:0/1153962584 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2f180666c0 0x7f2f18068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:09.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.555+0000 7f2f2ea00640 1 -- 172.21.15.55:0/1153962584 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2f30084120 con 0x7f2f380b41a0 2024-04-02T07:24:09.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.555+0000 7f2f36a00640 1 --2- 172.21.15.55:0/1153962584 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2f180666c0 0x7f2f18068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:09.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.555+0000 7f2f36a00640 1 --2- 172.21.15.55:0/1153962584 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2f180666c0 0x7f2f18068b80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2f28000c10 tx=0x7f2f280b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:09.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.559+0000 7f2f2ea00640 1 -- 172.21.15.55:0/1153962584 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2f30051900 con 0x7f2f380b41a0 2024-04-02T07:24:09.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.719+0000 7f2f3da00640 1 -- 172.21.15.55:0/1153962584 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2f38073530 con 0x7f2f380b41a0 2024-04-02T07:24:09.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.719+0000 7f2f2ea00640 1 -- 172.21.15.55:0/1153962584 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2f30054f20 con 0x7f2f380b41a0 2024-04-02T07:24:09.722 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:24:09.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.723+0000 7f2f3da00640 1 -- 172.21.15.55:0/1153962584 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2f180666c0 msgr2=0x7f2f18068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:09.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.723+0000 7f2f3da00640 1 --2- 172.21.15.55:0/1153962584 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2f180666c0 0x7f2f18068b80 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f2f28000c10 tx=0x7f2f280b5040 comp rx=0 tx=0).stop 2024-04-02T07:24:09.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.723+0000 7f2f3da00640 1 -- 172.21.15.55:0/1153962584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f380b41a0 msgr2=0x7f2f3814fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:09.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.723+0000 7f2f3da00640 1 --2- 172.21.15.55:0/1153962584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f380b41a0 0x7f2f3814fe80 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f2f3000c700 tx=0x7f2f3000cbc0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.723+0000 7f2f3da00640 1 -- 172.21.15.55:0/1153962584 shutdown_connections 2024-04-02T07:24:09.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.723+0000 7f2f3da00640 1 --2- 172.21.15.55:0/1153962584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f380b41a0 0x7f2f3814fe80 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.723+0000 7f2f3da00640 1 --2- 172.21.15.55:0/1153962584 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2f380b3dc0 0x7f2f38132820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.723+0000 7f2f3da00640 1 --2- 172.21.15.55:0/1153962584 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2f180666c0 0x7f2f18068b80 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.723+0000 7f2f3da00640 1 --2- 172.21.15.55:0/1153962584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2f380ade90 0x7f2f381352e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.723+0000 7f2f3da00640 1 -- 172.21.15.55:0/1153962584 >> 172.21.15.55:0/1153962584 conn(0x7f2f3806a390 msgr2=0x7f2f3815d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:09.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.723+0000 7f2f3da00640 1 -- 172.21.15.55:0/1153962584 shutdown_connections 2024-04-02T07:24:09.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.723+0000 7f2f3da00640 1 -- 172.21.15.55:0/1153962584 wait complete. 2024-04-02T07:24:09.743 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-02T07:24:09.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.883+0000 7fdd13e00640 1 Processor -- start 2024-04-02T07:24:09.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.883+0000 7fdd13e00640 1 -- start start 2024-04-02T07:24:09.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.883+0000 7fdd13e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd1415de80 0x7fdd140cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:09.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.883+0000 7fdd13e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdd140cf1e0 0x7fdd14098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:09.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.883+0000 7fdd13e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd140ad190 con 0x7fdd140cc040 2024-04-02T07:24:09.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.883+0000 7fdd13e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd140cc4e0 con 0x7fdd1415de80 2024-04-02T07:24:09.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.883+0000 7fdd13e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd140afea0 con 0x7fdd140cf1e0 2024-04-02T07:24:09.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.883+0000 7fdd12a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd1415de80 0x7fdd140cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:09.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.883+0000 7fdd12a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd1415de80 0x7fdd140cbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53900/0 (socket says 172.21.15.55:53900) 2024-04-02T07:24:09.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.883+0000 7fdd12a00640 1 -- 172.21.15.55:0/960892690 learned_addr learned my addr 172.21.15.55:0/960892690 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:09.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.883+0000 7fdd0be00640 1 --2- 172.21.15.55:0/960892690 >> v2:172.21.15.106:3300/0 conn(0x7fdd140cf1e0 0x7fdd14098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:09.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.883+0000 7fdd12a00640 1 -- 172.21.15.55:0/960892690 >> v2:172.21.15.106:3300/0 conn(0x7fdd140cf1e0 msgr2=0x7fdd14098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.883+0000 7fdd12a00640 1 --2- 172.21.15.55:0/960892690 >> v2:172.21.15.106:3300/0 conn(0x7fdd140cf1e0 0x7fdd14098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.883+0000 7fdd12a00640 1 -- 172.21.15.55:0/960892690 >> v1:172.21.15.106:6789/0 conn(0x7fdd140cc040 legacy=0x7fdd140ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:09.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.883+0000 7fdd12a00640 1 -- 172.21.15.55:0/960892690 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd140b0180 con 0x7fdd1415de80 2024-04-02T07:24:09.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.887+0000 7fdd12a00640 1 --2- 172.21.15.55:0/960892690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd1415de80 0x7fdd140cbb00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fdd140c7580 tx=0x7fdd0401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25022a59ce4cb3a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:09.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.887+0000 7fdd12000640 1 -- 172.21.15.55:0/960892690 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd040a4ea0 con 0x7fdd1415de80 2024-04-02T07:24:09.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.887+0000 7fdd12000640 1 -- 172.21.15.55:0/960892690 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd040a7050 con 0x7fdd1415de80 2024-04-02T07:24:09.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.887+0000 7fdd12000640 1 -- 172.21.15.55:0/960892690 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd040ab820 con 0x7fdd1415de80 2024-04-02T07:24:09.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.887+0000 7fdd13e00640 1 -- 172.21.15.55:0/960892690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd1415de80 msgr2=0x7fdd140cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.887+0000 7fdd13e00640 1 --2- 172.21.15.55:0/960892690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd1415de80 0x7fdd140cbb00 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fdd140c7580 tx=0x7fdd0401c520 comp rx=0 tx=0).stop 2024-04-02T07:24:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.887+0000 7fdd13e00640 1 -- 172.21.15.55:0/960892690 shutdown_connections 2024-04-02T07:24:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.887+0000 7fdd13e00640 1 --2- 172.21.15.55:0/960892690 >> v2:172.21.15.106:3300/0 conn(0x7fdd140cf1e0 0x7fdd14098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.887+0000 7fdd13e00640 1 --2- 172.21.15.55:0/960892690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd1415de80 0x7fdd140cbb00 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.887+0000 7fdd13e00640 1 -- 172.21.15.55:0/960892690 >> 172.21.15.55:0/960892690 conn(0x7fdd140b1ff0 msgr2=0x7fdd140b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.887+0000 7fdd13e00640 1 -- 172.21.15.55:0/960892690 shutdown_connections 2024-04-02T07:24:09.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.887+0000 7fdd13e00640 1 -- 172.21.15.55:0/960892690 wait complete. 2024-04-02T07:24:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.887+0000 7fdd13e00640 1 Processor -- start 2024-04-02T07:24:09.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.887+0000 7fdd13e00640 1 -- start start 2024-04-02T07:24:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd13e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdd140cc040 0x7fdd140c8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:09.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd13e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd140cf1e0 0x7fdd140c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd13e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd1415de80 0x7fdd140c90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd13e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd140b5d30 con 0x7fdd140cf1e0 2024-04-02T07:24:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd13e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd140b5fd0 con 0x7fdd1415de80 2024-04-02T07:24:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd13e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd140b62b0 con 0x7fdd140cc040 2024-04-02T07:24:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd0be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd140cf1e0 0x7fdd140c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd0be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd140cf1e0 0x7fdd140c8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53906/0 (socket says 172.21.15.55:53906) 2024-04-02T07:24:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd0be00640 1 -- 172.21.15.55:0/3659837198 learned_addr learned my addr 172.21.15.55:0/3659837198 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd12a00640 1 --2- 172.21.15.55:0/3659837198 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdd140cc040 0x7fdd140c8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd13400640 1 --2- 172.21.15.55:0/3659837198 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd1415de80 0x7fdd140c90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd0be00640 1 -- 172.21.15.55:0/3659837198 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdd140cc040 msgr2=0x7fdd140c8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd0be00640 1 --2- 172.21.15.55:0/3659837198 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdd140cc040 0x7fdd140c8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd0be00640 1 -- 172.21.15.55:0/3659837198 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd1415de80 msgr2=0x7fdd140c90a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:09.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd0be00640 1 --2- 172.21.15.55:0/3659837198 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd1415de80 0x7fdd140c90a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:09.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd0be00640 1 -- 172.21.15.55:0/3659837198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd040094d0 con 0x7fdd140cf1e0 2024-04-02T07:24:09.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd0be00640 1 --2- 172.21.15.55:0/3659837198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd140cf1e0 0x7fdd140c8b60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00d800 tx=0x7fdcfc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:09.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd0aa00640 1 -- 172.21.15.55:0/3659837198 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc00b6c0 con 0x7fdd140cf1e0 2024-04-02T07:24:09.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd0aa00640 1 -- 172.21.15.55:0/3659837198 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcfc00b820 con 0x7fdd140cf1e0 2024-04-02T07:24:09.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd0aa00640 1 -- 172.21.15.55:0/3659837198 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcfc00bb90 con 0x7fdd140cf1e0 2024-04-02T07:24:09.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd13e00640 1 -- 172.21.15.55:0/3659837198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd140c5750 con 0x7fdd140cf1e0 2024-04-02T07:24:09.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd13e00640 1 -- 172.21.15.55:0/3659837198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd140c5370 con 0x7fdd140cf1e0 2024-04-02T07:24:09.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd13e00640 1 -- 172.21.15.55:0/3659837198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd140c5560 con 0x7fdd140cf1e0 2024-04-02T07:24:09.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.891+0000 7fdd0aa00640 1 -- 172.21.15.55:0/3659837198 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fdcfc00bcf0 con 0x7fdd140cf1e0 2024-04-02T07:24:09.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.895+0000 7fdd0aa00640 1 --2- 172.21.15.55:0/3659837198 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdcf0066690 0x7fdcf0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:09.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.895+0000 7fdd0aa00640 1 -- 172.21.15.55:0/3659837198 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdcfc0842a0 con 0x7fdd140cf1e0 2024-04-02T07:24:09.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.895+0000 7fdd12a00640 1 --2- 172.21.15.55:0/3659837198 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdcf0066690 0x7fdcf0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:09.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.895+0000 7fdd12a00640 1 --2- 172.21.15.55:0/3659837198 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdcf0066690 0x7fdcf0068b50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdd040ad000 tx=0x7fdd04008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:09.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:09.899+0000 7fdd0aa00640 1 -- 172.21.15.55:0/3659837198 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fdcfc051a00 con 0x7fdd140cf1e0 2024-04-02T07:24:10.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.059+0000 7fdd13e00640 1 -- 172.21.15.55:0/3659837198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fdd14073fa0 con 0x7fdd140cf1e0 2024-04-02T07:24:10.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.059+0000 7fdd0aa00640 1 -- 172.21.15.55:0/3659837198 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v42) v1 ==== 84+0+65 (secure 0 0 0) 0x7fdcfc055020 con 0x7fdd140cf1e0 2024-04-02T07:24:10.063 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:10.063 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-02T07:24:10.063 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:10.063 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-04-02T07:24:10.063 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-04-02T07:24:10.063 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:10.063 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-02T07:24:10.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.063+0000 7fdd13e00640 1 -- 172.21.15.55:0/3659837198 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdcf0066690 msgr2=0x7fdcf0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:10.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.063+0000 7fdd13e00640 1 --2- 172.21.15.55:0/3659837198 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdcf0066690 0x7fdcf0068b50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdd040ad000 tx=0x7fdd04008040 comp rx=0 tx=0).stop 2024-04-02T07:24:10.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.063+0000 7fdd13e00640 1 -- 172.21.15.55:0/3659837198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd140cf1e0 msgr2=0x7fdd140c8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:10.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.063+0000 7fdd13e00640 1 --2- 172.21.15.55:0/3659837198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd140cf1e0 0x7fdd140c8b60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc00d800 tx=0x7fdcfc00dcc0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.063+0000 7fdd13e00640 1 -- 172.21.15.55:0/3659837198 shutdown_connections 2024-04-02T07:24:10.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.063+0000 7fdd13e00640 1 --2- 172.21.15.55:0/3659837198 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdcf0066690 0x7fdcf0068b50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.063+0000 7fdd13e00640 1 --2- 172.21.15.55:0/3659837198 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd1415de80 0x7fdd140c90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.063+0000 7fdd13e00640 1 --2- 172.21.15.55:0/3659837198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd140cf1e0 0x7fdd140c8b60 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.063+0000 7fdd13e00640 1 --2- 172.21.15.55:0/3659837198 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdd140cc040 0x7fdd140c8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.063+0000 7fdd13e00640 1 -- 172.21.15.55:0/3659837198 >> 172.21.15.55:0/3659837198 conn(0x7fdd140b1ff0 msgr2=0x7fdd140aeed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:10.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.063+0000 7fdd13e00640 1 -- 172.21.15.55:0/3659837198 shutdown_connections 2024-04-02T07:24:10.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.063+0000 7fdd13e00640 1 -- 172.21.15.55:0/3659837198 wait complete. 2024-04-02T07:24:10.083 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-02T07:24:10.083 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-02T07:24:10.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.223+0000 7f6343000640 1 Processor -- start 2024-04-02T07:24:10.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.227+0000 7f6343000640 1 -- start start 2024-04-02T07:24:10.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.227+0000 7f6343000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f633c15ff20 0x7f633c098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:10.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.227+0000 7f6343000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f633c098f50 0x7f633c0993b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:10.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.227+0000 7f6343000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f633c099d70 con 0x7f633c06aea0 2024-04-02T07:24:10.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.227+0000 7f6343000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f633c0cab10 con 0x7f633c098f50 2024-04-02T07:24:10.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.227+0000 7f6343000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c160300 con 0x7f633c15ff20 2024-04-02T07:24:10.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.227+0000 7f6341200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f633c098f50 0x7f633c0993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:10.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.227+0000 7f6341200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f633c098f50 0x7f633c0993b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53916/0 (socket says 172.21.15.55:53916) 2024-04-02T07:24:10.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.227+0000 7f6341200640 1 -- 172.21.15.55:0/907584367 learned_addr learned my addr 172.21.15.55:0/907584367 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:10.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.227+0000 7f6341c00640 1 --2- 172.21.15.55:0/907584367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f633c15ff20 0x7f633c098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:10.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.227+0000 7f6341200640 1 -- 172.21.15.55:0/907584367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f633c15ff20 msgr2=0x7f633c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:10.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.227+0000 7f6341200640 1 --2- 172.21.15.55:0/907584367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f633c15ff20 0x7f633c098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.227+0000 7f6341200640 1 -- 172.21.15.55:0/907584367 >> v1:172.21.15.106:6789/0 conn(0x7f633c06aea0 legacy=0x7f633c06b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:10.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.227+0000 7f6341200640 1 -- 172.21.15.55:0/907584367 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f633c0cf3d0 con 0x7f633c098f50 2024-04-02T07:24:10.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.231+0000 7f6341200640 1 --2- 172.21.15.55:0/907584367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f633c098f50 0x7f633c0993b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6328009870 tx=0x7f632801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bab0bd4867f86f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:10.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.231+0000 7f633be00640 1 -- 172.21.15.55:0/907584367 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63280ab650 con 0x7f633c098f50 2024-04-02T07:24:10.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.231+0000 7f633be00640 1 -- 172.21.15.55:0/907584367 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63280ab7b0 con 0x7f633c098f50 2024-04-02T07:24:10.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.231+0000 7f633be00640 1 -- 172.21.15.55:0/907584367 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63280abb40 con 0x7f633c098f50 2024-04-02T07:24:10.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.231+0000 7f6343000640 1 -- 172.21.15.55:0/907584367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f633c098f50 msgr2=0x7f633c0993b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:10.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.231+0000 7f6343000640 1 --2- 172.21.15.55:0/907584367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f633c098f50 0x7f633c0993b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f6328009870 tx=0x7f632801c560 comp rx=0 tx=0).stop 2024-04-02T07:24:10.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.231+0000 7f6343000640 1 -- 172.21.15.55:0/907584367 shutdown_connections 2024-04-02T07:24:10.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.231+0000 7f6343000640 1 --2- 172.21.15.55:0/907584367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f633c098f50 0x7f633c0993b0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.231+0000 7f6343000640 1 --2- 172.21.15.55:0/907584367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f633c15ff20 0x7f633c098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.231+0000 7f6343000640 1 -- 172.21.15.55:0/907584367 >> 172.21.15.55:0/907584367 conn(0x7f633c0b1fb0 msgr2=0x7f633c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:10.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.231+0000 7f6343000640 1 -- 172.21.15.55:0/907584367 shutdown_connections 2024-04-02T07:24:10.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.231+0000 7f6343000640 1 -- 172.21.15.55:0/907584367 wait complete. 2024-04-02T07:24:10.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.231+0000 7f6343000640 1 Processor -- start 2024-04-02T07:24:10.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.231+0000 7f6343000640 1 -- start start 2024-04-02T07:24:10.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6343000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f633c06aea0 0x7f633c152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:10.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6343000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f633c098f50 0x7f633c154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:10.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6343000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f633c15ff20 0x7f633c155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:10.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6343000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c155ff0 con 0x7f633c06aea0 2024-04-02T07:24:10.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6343000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f633c155840 con 0x7f633c098f50 2024-04-02T07:24:10.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6343000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f633c155a30 con 0x7f633c15ff20 2024-04-02T07:24:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6341c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f633c06aea0 0x7f633c152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6341c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f633c06aea0 0x7f633c152f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53918/0 (socket says 172.21.15.55:53918) 2024-04-02T07:24:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6341c00640 1 -- 172.21.15.55:0/3248237280 learned_addr learned my addr 172.21.15.55:0/3248237280 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6341200640 1 --2- 172.21.15.55:0/3248237280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f633c098f50 0x7f633c154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6342600640 1 --2- 172.21.15.55:0/3248237280 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f633c15ff20 0x7f633c155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6341c00640 1 -- 172.21.15.55:0/3248237280 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f633c15ff20 msgr2=0x7f633c155300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6341c00640 1 --2- 172.21.15.55:0/3248237280 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f633c15ff20 0x7f633c155300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6341c00640 1 -- 172.21.15.55:0/3248237280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f633c098f50 msgr2=0x7f633c154dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6341c00640 1 --2- 172.21.15.55:0/3248237280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f633c098f50 0x7f633c154dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6341c00640 1 -- 172.21.15.55:0/3248237280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63280094d0 con 0x7f633c06aea0 2024-04-02T07:24:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6342600640 1 --2- 172.21.15.55:0/3248237280 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f633c15ff20 0x7f633c155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:10.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6341c00640 1 --2- 172.21.15.55:0/3248237280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f633c06aea0 0x7f633c152f40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f633000d800 tx=0x7f633000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:10.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6339600640 1 -- 172.21.15.55:0/3248237280 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633000b6c0 con 0x7f633c06aea0 2024-04-02T07:24:10.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6339600640 1 -- 172.21.15.55:0/3248237280 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633000b820 con 0x7f633c06aea0 2024-04-02T07:24:10.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6339600640 1 -- 172.21.15.55:0/3248237280 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633000bb90 con 0x7f633c06aea0 2024-04-02T07:24:10.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6343000640 1 -- 172.21.15.55:0/3248237280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f633c155d10 con 0x7f633c06aea0 2024-04-02T07:24:10.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6343000640 1 -- 172.21.15.55:0/3248237280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f633c0c8430 con 0x7f633c06aea0 2024-04-02T07:24:10.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6343000640 1 -- 172.21.15.55:0/3248237280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f633c0c7fb0 con 0x7f633c06aea0 2024-04-02T07:24:10.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.235+0000 7f6339600640 1 -- 172.21.15.55:0/3248237280 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f633000bcf0 con 0x7f633c06aea0 2024-04-02T07:24:10.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.239+0000 7f6339600640 1 --2- 172.21.15.55:0/3248237280 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f631c066690 0x7f631c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:10.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.239+0000 7f6339600640 1 -- 172.21.15.55:0/3248237280 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f63300842f0 con 0x7f633c06aea0 2024-04-02T07:24:10.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.239+0000 7f6341200640 1 --2- 172.21.15.55:0/3248237280 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f631c066690 0x7f631c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:10.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.239+0000 7f6341200640 1 --2- 172.21.15.55:0/3248237280 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f631c066690 0x7f631c068b50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f63280af000 tx=0x7f63280b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:10.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.243+0000 7f6339600640 1 -- 172.21.15.55:0/3248237280 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f633c0c7fb0 con 0x7f633c06aea0 2024-04-02T07:24:10.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.407+0000 7f6343000640 1 -- 172.21.15.55:0/3248237280 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f633c0c7fb0 con 0x7f633c06aea0 2024-04-02T07:24:10.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.503+0000 7f6339600640 1 -- 172.21.15.55:0/3248237280 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v43) v1 ==== 138+0+0 (secure 0 0 0) 0x7f633c0c7fb0 con 0x7f633c06aea0 2024-04-02T07:24:10.508 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-04-02T07:24:10.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.507+0000 7f6343000640 1 -- 172.21.15.55:0/3248237280 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f631c066690 msgr2=0x7f631c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:10.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.507+0000 7f6343000640 1 --2- 172.21.15.55:0/3248237280 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f631c066690 0x7f631c068b50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f63280af000 tx=0x7f63280b6040 comp rx=0 tx=0).stop 2024-04-02T07:24:10.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.507+0000 7f6343000640 1 -- 172.21.15.55:0/3248237280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f633c06aea0 msgr2=0x7f633c152f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:10.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.507+0000 7f6343000640 1 --2- 172.21.15.55:0/3248237280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f633c06aea0 0x7f633c152f40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f633000d800 tx=0x7f633000dcc0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.507+0000 7f6343000640 1 -- 172.21.15.55:0/3248237280 shutdown_connections 2024-04-02T07:24:10.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.507+0000 7f6343000640 1 --2- 172.21.15.55:0/3248237280 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f633c15ff20 0x7f633c155300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.507+0000 7f6343000640 1 --2- 172.21.15.55:0/3248237280 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f631c066690 0x7f631c068b50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.507+0000 7f6343000640 1 --2- 172.21.15.55:0/3248237280 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f633c098f50 0x7f633c154dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.507+0000 7f6343000640 1 --2- 172.21.15.55:0/3248237280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f633c06aea0 0x7f633c152f40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.507+0000 7f6343000640 1 -- 172.21.15.55:0/3248237280 >> 172.21.15.55:0/3248237280 conn(0x7f633c0b1fb0 msgr2=0x7f633c0cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:10.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.511+0000 7f6343000640 1 -- 172.21.15.55:0/3248237280 shutdown_connections 2024-04-02T07:24:10.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.511+0000 7f6343000640 1 -- 172.21.15.55:0/3248237280 wait complete. 2024-04-02T07:24:10.534 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-02T07:24:10.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ec3800640 1 Processor -- start 2024-04-02T07:24:10.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ec3800640 1 -- start start 2024-04-02T07:24:10.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ec3800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6ebc157130 0x7f6ebc15a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:10.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ec3800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ebc06e160 0x7f6ebc0ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:10.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ec3800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ebc0ced60 con 0x7f6ebc0ce8f0 2024-04-02T07:24:10.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ec3800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ebc06c1e0 con 0x7f6ebc157130 2024-04-02T07:24:10.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ec3800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc06c4c0 con 0x7f6ebc06e160 2024-04-02T07:24:10.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ec1800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6ebc0ce8f0 0x7f6ebc15d220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48444/0 (socket says 172.21.15.55:48444) 2024-04-02T07:24:10.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ec1800640 1 -- 172.21.15.55:0/998808827 learned_addr learned my addr 172.21.15.55:0/998808827 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:10.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ec0e00640 1 --2- 172.21.15.55:0/998808827 >> v2:172.21.15.106:3300/0 conn(0x7f6ebc157130 0x7f6ebc15a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:10.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6eb3e00640 1 --2- 172.21.15.55:0/998808827 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ebc06e160 0x7f6ebc0ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:10.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ebbe00640 1 -- 172.21.15.55:0/998808827 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2898937382 0 0) 0x7f6ebc0ced60 con 0x7f6ebc0ce8f0 2024-04-02T07:24:10.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ebbe00640 1 -- 172.21.15.55:0/998808827 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ea0003530 con 0x7f6ebc0ce8f0 2024-04-02T07:24:10.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ebbe00640 1 -- 172.21.15.55:0/998808827 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2802052024 0 0) 0x7f6ea0003530 con 0x7f6ebc0ce8f0 2024-04-02T07:24:10.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ebbe00640 1 -- 172.21.15.55:0/998808827 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ebc06e160 msgr2=0x7f6ebc0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:10.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ebbe00640 1 --2- 172.21.15.55:0/998808827 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ebc06e160 0x7f6ebc0ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ebbe00640 1 -- 172.21.15.55:0/998808827 >> v2:172.21.15.106:3300/0 conn(0x7f6ebc157130 msgr2=0x7f6ebc15a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:10.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ebbe00640 1 --2- 172.21.15.55:0/998808827 >> v2:172.21.15.106:3300/0 conn(0x7f6ebc157130 0x7f6ebc15a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ebbe00640 1 -- 172.21.15.55:0/998808827 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc06c7a0 con 0x7f6ebc0ce8f0 2024-04-02T07:24:10.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ebbe00640 1 -- 172.21.15.55:0/998808827 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f6eb4001a00 con 0x7f6ebc0ce8f0 2024-04-02T07:24:10.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ebbe00640 1 -- 172.21.15.55:0/998808827 >> v1:172.21.15.55:6789/0 conn(0x7f6ebc0ce8f0 legacy=0x7f6ebc15d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:10.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ebbe00640 1 --2- 172.21.15.55:0/998808827 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ebc06e160 0x7f6ea0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ebbe00640 1 --2- 172.21.15.55:0/998808827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea0003f00 0x7f6ea00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ebbe00640 1 --2- 172.21.15.55:0/998808827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ea0004d10 0x7f6ea0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ebbe00640 1 -- 172.21.15.55:0/998808827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc06c1e0 con 0x7f6ea0003f00 2024-04-02T07:24:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ebbe00640 1 -- 172.21.15.55:0/998808827 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc06c4c0 con 0x7f6ea0004d10 2024-04-02T07:24:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.679+0000 7f6ebbe00640 1 -- 172.21.15.55:0/998808827 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ea000b990 con 0x7f6ebc06e160 2024-04-02T07:24:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.683+0000 7f6ec0e00640 1 --2- 172.21.15.55:0/998808827 >> v2:172.21.15.106:3300/0 conn(0x7f6ebc157130 0x7f6ebc15a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:24:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.683+0000 7f6eb3e00640 1 --2- 172.21.15.55:0/998808827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea0003f00 0x7f6ea00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.683+0000 7f6ec1800640 1 --2- 172.21.15.55:0/998808827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ea0004d10 0x7f6ea0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.683+0000 7f6ec0e00640 1 --2- 172.21.15.55:0/998808827 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ebc06e160 0x7f6ea0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.683+0000 7f6eb3e00640 1 -- 172.21.15.55:0/998808827 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ebc06e160 msgr2=0x7f6ea0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.683+0000 7f6eb3e00640 1 --2- 172.21.15.55:0/998808827 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ebc06e160 0x7f6ea0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.683+0000 7f6eb3e00640 1 -- 172.21.15.55:0/998808827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ea0004d10 msgr2=0x7f6ea0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.683+0000 7f6eb3e00640 1 --2- 172.21.15.55:0/998808827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ea0004d10 0x7f6ea0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.683+0000 7f6eb3e00640 1 -- 172.21.15.55:0/998808827 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ea0003530 con 0x7f6ea0003f00 2024-04-02T07:24:10.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.683+0000 7f6ec1800640 1 --2- 172.21.15.55:0/998808827 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ea0004d10 0x7f6ea0005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:10.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.683+0000 7f6eb3e00640 1 --2- 172.21.15.55:0/998808827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea0003f00 0x7f6ea00047d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009ab0 tx=0x7f6ea401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985f0251a9a9098b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:10.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.683+0000 7f6ebbe00640 1 -- 172.21.15.55:0/998808827 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40a5640 con 0x7f6ea0003f00 2024-04-02T07:24:10.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.683+0000 7f6ebbe00640 1 -- 172.21.15.55:0/998808827 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ea40a57a0 con 0x7f6ea0003f00 2024-04-02T07:24:10.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.683+0000 7f6ebbe00640 1 -- 172.21.15.55:0/998808827 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ea40a5b50 con 0x7f6ea0003f00 2024-04-02T07:24:10.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec3800640 1 -- 172.21.15.55:0/998808827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea0003f00 msgr2=0x7f6ea00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:10.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec3800640 1 --2- 172.21.15.55:0/998808827 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea0003f00 0x7f6ea00047d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f6ea4009ab0 tx=0x7f6ea401c9f0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec1800640 1 -- 172.21.15.55:0/998808827 reap_dead start 2024-04-02T07:24:10.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec3800640 1 -- 172.21.15.55:0/998808827 shutdown_connections 2024-04-02T07:24:10.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec3800640 1 -- 172.21.15.55:0/998808827 >> 172.21.15.55:0/998808827 conn(0x7f6ebc066110 msgr2=0x7f6ebc069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:10.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec3800640 1 -- 172.21.15.55:0/998808827 shutdown_connections 2024-04-02T07:24:10.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec3800640 1 -- 172.21.15.55:0/998808827 wait complete. 2024-04-02T07:24:10.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec3800640 1 Processor -- start 2024-04-02T07:24:10.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec3800640 1 -- start start 2024-04-02T07:24:10.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec3800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea0003f00 0x7f6ebc14f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:10.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec3800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ebc150600 0x7f6ebc150a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:10.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec3800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ebc1495c0 0x7f6ebc149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:10.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec3800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc150fc0 con 0x7f6ea0003f00 2024-04-02T07:24:10.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec3800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc149f80 con 0x7f6ebc150600 2024-04-02T07:24:10.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec3800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ebc152760 con 0x7f6ebc1495c0 2024-04-02T07:24:10.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec0e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea0003f00 0x7f6ebc14f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:10.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec0e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea0003f00 0x7f6ebc14f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53930/0 (socket says 172.21.15.55:53930) 2024-04-02T07:24:10.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec0e00640 1 -- 172.21.15.55:0/1677126496 learned_addr learned my addr 172.21.15.55:0/1677126496 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:10.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec1800640 1 --2- 172.21.15.55:0/1677126496 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ebc1495c0 0x7f6ebc149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:10.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6eb3e00640 1 --2- 172.21.15.55:0/1677126496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ebc150600 0x7f6ebc150a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:10.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec0e00640 1 -- 172.21.15.55:0/1677126496 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ebc1495c0 msgr2=0x7f6ebc149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:10.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec0e00640 1 --2- 172.21.15.55:0/1677126496 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ebc1495c0 0x7f6ebc149a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec0e00640 1 -- 172.21.15.55:0/1677126496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ebc150600 msgr2=0x7f6ebc150a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:10.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec0e00640 1 --2- 172.21.15.55:0/1677126496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ebc150600 0x7f6ebc150a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:10.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.687+0000 7f6ec0e00640 1 -- 172.21.15.55:0/1677126496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ebc14a1d0 con 0x7f6ea0003f00 2024-04-02T07:24:10.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.691+0000 7f6ec0e00640 1 --2- 172.21.15.55:0/1677126496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea0003f00 0x7f6ebc14f8e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6eac011960 tx=0x7f6eac011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:10.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.691+0000 7f6eb9600640 1 -- 172.21.15.55:0/1677126496 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00fbd0 con 0x7f6ea0003f00 2024-04-02T07:24:10.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.691+0000 7f6eb9600640 1 -- 172.21.15.55:0/1677126496 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eac00fd30 con 0x7f6ea0003f00 2024-04-02T07:24:10.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.691+0000 7f6eb9600640 1 -- 172.21.15.55:0/1677126496 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eac015660 con 0x7f6ea0003f00 2024-04-02T07:24:10.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.691+0000 7f6ec3800640 1 -- 172.21.15.55:0/1677126496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ebc14a4b0 con 0x7f6ea0003f00 2024-04-02T07:24:10.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.691+0000 7f6ec3800640 1 -- 172.21.15.55:0/1677126496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ebc14aa70 con 0x7f6ea0003f00 2024-04-02T07:24:10.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.691+0000 7f6ec3800640 1 -- 172.21.15.55:0/1677126496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ebc066c90 con 0x7f6ea0003f00 2024-04-02T07:24:10.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.691+0000 7f6eb9600640 1 -- 172.21.15.55:0/1677126496 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6eac0157c0 con 0x7f6ea0003f00 2024-04-02T07:24:10.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.691+0000 7f6eb9600640 1 --2- 172.21.15.55:0/1677126496 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6e980666c0 0x7f6e98068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:10.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.691+0000 7f6eb9600640 1 -- 172.21.15.55:0/1677126496 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f6eac084770 con 0x7f6ea0003f00 2024-04-02T07:24:10.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.691+0000 7f6eb3e00640 1 --2- 172.21.15.55:0/1677126496 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6e980666c0 0x7f6e98068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:10.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.695+0000 7f6eb3e00640 1 --2- 172.21.15.55:0/1677126496 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6e980666c0 0x7f6e98068b80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40af000 tx=0x7f6ea40046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:10.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.699+0000 7f6eb9600640 1 -- 172.21.15.55:0/1677126496 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6eac051c20 con 0x7f6ea0003f00 2024-04-02T07:24:10.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:10.859+0000 7f6ec3800640 1 -- 172.21.15.55:0/1677126496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f6ebc14b710 con 0x7f6ea0003f00 2024-04-02T07:24:11.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.527+0000 7f6eb9600640 1 -- 172.21.15.55:0/1677126496 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v44) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6eac00fea0 con 0x7f6ea0003f00 2024-04-02T07:24:11.532 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-04-02T07:24:11.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.535+0000 7f6ec3800640 1 -- 172.21.15.55:0/1677126496 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6e980666c0 msgr2=0x7f6e98068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:11.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.535+0000 7f6ec3800640 1 --2- 172.21.15.55:0/1677126496 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6e980666c0 0x7f6e98068b80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40af000 tx=0x7f6ea40046d0 comp rx=0 tx=0).stop 2024-04-02T07:24:11.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.535+0000 7f6ec3800640 1 -- 172.21.15.55:0/1677126496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea0003f00 msgr2=0x7f6ebc14f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:11.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.535+0000 7f6ec3800640 1 --2- 172.21.15.55:0/1677126496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea0003f00 0x7f6ebc14f8e0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f6eac011960 tx=0x7f6eac011e20 comp rx=0 tx=0).stop 2024-04-02T07:24:11.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.535+0000 7f6ec3800640 1 -- 172.21.15.55:0/1677126496 shutdown_connections 2024-04-02T07:24:11.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.535+0000 7f6ec3800640 1 --2- 172.21.15.55:0/1677126496 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6ebc1495c0 0x7f6ebc149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:11.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.535+0000 7f6ec3800640 1 --2- 172.21.15.55:0/1677126496 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6e980666c0 0x7f6e98068b80 secure :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f6ea40af000 tx=0x7f6ea40046d0 comp rx=0 tx=0).stop 2024-04-02T07:24:11.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.535+0000 7f6ec3800640 1 --2- 172.21.15.55:0/1677126496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6ebc150600 0x7f6ebc150a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:11.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.535+0000 7f6ec3800640 1 --2- 172.21.15.55:0/1677126496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6ea0003f00 0x7f6ebc14f8e0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:11.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.535+0000 7f6ec3800640 1 -- 172.21.15.55:0/1677126496 >> 172.21.15.55:0/1677126496 conn(0x7f6ebc066110 msgr2=0x7f6ebc159170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:11.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.543+0000 7f6ec3800640 1 -- 172.21.15.55:0/1677126496 shutdown_connections 2024-04-02T07:24:11.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.543+0000 7f6ec3800640 1 -- 172.21.15.55:0/1677126496 wait complete. 2024-04-02T07:24:11.572 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-02T07:24:11.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.715+0000 7f7a61000640 1 Processor -- start 2024-04-02T07:24:11.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.715+0000 7f7a61000640 1 -- start start 2024-04-02T07:24:11.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.719+0000 7f7a61000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a5c15a850 0x7f7a5c0cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:11.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.719+0000 7f7a61000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7a5c099120 0x7f7a5c0b3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:11.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.719+0000 7f7a61000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a5c0ce090 con 0x7f7a5c0cc070 2024-04-02T07:24:11.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.719+0000 7f7a61000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a5c0cc4b0 con 0x7f7a5c099120 2024-04-02T07:24:11.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.719+0000 7f7a61000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c15ac30 con 0x7f7a5c15a850 2024-04-02T07:24:11.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.719+0000 7f7a5be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7a5c099120 0x7f7a5c0b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:11.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.719+0000 7f7a5b400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a5c15a850 0x7f7a5c0cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:11.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.719+0000 7f7a52a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7a5c0cc070 0x7f7a5c098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:57160/0 (socket says 172.21.15.55:57160) 2024-04-02T07:24:11.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.719+0000 7f7a52a00640 1 -- 172.21.15.55:0/3293821004 learned_addr learned my addr 172.21.15.55:0/3293821004 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:11.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.719+0000 7f7a5b400640 1 -- 172.21.15.55:0/3293821004 >> v2:172.21.15.106:3300/0 conn(0x7f7a5c099120 msgr2=0x7f7a5c0b3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:11.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.719+0000 7f7a5b400640 1 --2- 172.21.15.55:0/3293821004 >> v2:172.21.15.106:3300/0 conn(0x7f7a5c099120 0x7f7a5c0b3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:11.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.719+0000 7f7a5b400640 1 -- 172.21.15.55:0/3293821004 >> v1:172.21.15.106:6789/0 conn(0x7f7a5c0cc070 legacy=0x7f7a5c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:11.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.719+0000 7f7a5b400640 1 -- 172.21.15.55:0/3293821004 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5c0ce2e0 con 0x7f7a5c15a850 2024-04-02T07:24:11.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a5b400640 1 --2- 172.21.15.55:0/3293821004 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a5c15a850 0x7f7a5c0cbb30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0097c0 tx=0x7f7a4c01c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34f84de5dfa3f01e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:11.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a5aa00640 1 -- 172.21.15.55:0/3293821004 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c0ac640 con 0x7f7a5c15a850 2024-04-02T07:24:11.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a5aa00640 1 -- 172.21.15.55:0/3293821004 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4c0ac7a0 con 0x7f7a5c15a850 2024-04-02T07:24:11.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a5aa00640 1 -- 172.21.15.55:0/3293821004 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4c0acb30 con 0x7f7a5c15a850 2024-04-02T07:24:11.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a61000640 1 -- 172.21.15.55:0/3293821004 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a5c15a850 msgr2=0x7f7a5c0cbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:11.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a61000640 1 --2- 172.21.15.55:0/3293821004 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a5c15a850 0x7f7a5c0cbb30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0097c0 tx=0x7f7a4c01c3e0 comp rx=0 tx=0).stop 2024-04-02T07:24:11.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a61000640 1 -- 172.21.15.55:0/3293821004 shutdown_connections 2024-04-02T07:24:11.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a61000640 1 --2- 172.21.15.55:0/3293821004 >> v2:172.21.15.106:3300/0 conn(0x7f7a5c099120 0x7f7a5c0b3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:11.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a61000640 1 --2- 172.21.15.55:0/3293821004 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a5c15a850 0x7f7a5c0cbb30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:11.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a61000640 1 -- 172.21.15.55:0/3293821004 >> 172.21.15.55:0/3293821004 conn(0x7f7a5c0b1fb0 msgr2=0x7f7a5c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:11.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a61000640 1 -- 172.21.15.55:0/3293821004 shutdown_connections 2024-04-02T07:24:11.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a61000640 1 -- 172.21.15.55:0/3293821004 wait complete. 2024-04-02T07:24:11.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a61000640 1 Processor -- start 2024-04-02T07:24:11.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a61000640 1 -- start start 2024-04-02T07:24:11.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a61000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a5c099120 0x7f7a5c158400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:11.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a61000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a5c0cc070 0x7f7a5c158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:11.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a61000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a5c15a850 0x7f7a5c0b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:11.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a61000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c14a460 con 0x7f7a5c15a850 2024-04-02T07:24:11.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a61000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c1560d0 con 0x7f7a5c099120 2024-04-02T07:24:11.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a61000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5c1563b0 con 0x7f7a5c0cc070 2024-04-02T07:24:11.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.723+0000 7f7a5be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a5c15a850 0x7f7a5c0b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:11.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.727+0000 7f7a5be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a5c15a850 0x7f7a5c0b57d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53944/0 (socket says 172.21.15.55:53944) 2024-04-02T07:24:11.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.727+0000 7f7a5be00640 1 -- 172.21.15.55:0/3583139355 learned_addr learned my addr 172.21.15.55:0/3583139355 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:11.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.727+0000 7f7a52a00640 1 --2- 172.21.15.55:0/3583139355 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a5c0cc070 0x7f7a5c158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:11.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.727+0000 7f7a5b400640 1 --2- 172.21.15.55:0/3583139355 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a5c099120 0x7f7a5c158400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:11.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.727+0000 7f7a5be00640 1 -- 172.21.15.55:0/3583139355 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a5c0cc070 msgr2=0x7f7a5c158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:11.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.727+0000 7f7a5be00640 1 --2- 172.21.15.55:0/3583139355 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a5c0cc070 0x7f7a5c158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:11.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.727+0000 7f7a5be00640 1 -- 172.21.15.55:0/3583139355 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a5c099120 msgr2=0x7f7a5c158400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:11.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.727+0000 7f7a5be00640 1 --2- 172.21.15.55:0/3583139355 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a5c099120 0x7f7a5c158400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:11.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.727+0000 7f7a5be00640 1 -- 172.21.15.55:0/3583139355 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a4c009420 con 0x7f7a5c15a850 2024-04-02T07:24:11.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.727+0000 7f7a5be00640 1 --2- 172.21.15.55:0/3583139355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a5c15a850 0x7f7a5c0b57d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400e850 tx=0x7f7a5400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:11.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.727+0000 7f7a53e00640 1 -- 172.21.15.55:0/3583139355 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a54009650 con 0x7f7a5c15a850 2024-04-02T07:24:11.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.727+0000 7f7a53e00640 1 -- 172.21.15.55:0/3583139355 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a5400c940 con 0x7f7a5c15a850 2024-04-02T07:24:11.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.727+0000 7f7a61000640 1 -- 172.21.15.55:0/3583139355 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5c156690 con 0x7f7a5c15a850 2024-04-02T07:24:11.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.727+0000 7f7a53e00640 1 -- 172.21.15.55:0/3583139355 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a5400ccd0 con 0x7f7a5c15a850 2024-04-02T07:24:11.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.727+0000 7f7a61000640 1 -- 172.21.15.55:0/3583139355 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5c155d80 con 0x7f7a5c15a850 2024-04-02T07:24:11.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.727+0000 7f7a61000640 1 -- 172.21.15.55:0/3583139355 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5c156bb0 con 0x7f7a5c15a850 2024-04-02T07:24:11.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.731+0000 7f7a53e00640 1 -- 172.21.15.55:0/3583139355 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7a54013470 con 0x7f7a5c15a850 2024-04-02T07:24:11.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.731+0000 7f7a53e00640 1 --2- 172.21.15.55:0/3583139355 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7a38066690 0x7f7a38068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:11.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.731+0000 7f7a53e00640 1 -- 172.21.15.55:0/3583139355 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f7a540847d0 con 0x7f7a5c15a850 2024-04-02T07:24:11.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.731+0000 7f7a5b400640 1 --2- 172.21.15.55:0/3583139355 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7a38066690 0x7f7a38068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:11.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.731+0000 7f7a5b400640 1 --2- 172.21.15.55:0/3583139355 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7a38066690 0x7f7a38068b50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0ae000 tx=0x7f7a4c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:11.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.735+0000 7f7a53e00640 1 -- 172.21.15.55:0/3583139355 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7a54051dc0 con 0x7f7a5c15a850 2024-04-02T07:24:11.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.927+0000 7f7a61000640 1 -- 172.21.15.55:0/3583139355 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7a5c156bb0 con 0x7f7a5c15a850 2024-04-02T07:24:11.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.935+0000 7f7a53e00640 1 -- 172.21.15.55:0/3583139355 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v21) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7a5c156bb0 con 0x7f7a5c15a850 2024-04-02T07:24:11.938 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 6 and data pool 7 2024-04-02T07:24:11.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.939+0000 7f7a61000640 1 -- 172.21.15.55:0/3583139355 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7a38066690 msgr2=0x7f7a38068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:11.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.939+0000 7f7a61000640 1 --2- 172.21.15.55:0/3583139355 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7a38066690 0x7f7a38068b50 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f7a4c0ae000 tx=0x7f7a4c0a7000 comp rx=0 tx=0).stop 2024-04-02T07:24:11.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.939+0000 7f7a61000640 1 -- 172.21.15.55:0/3583139355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a5c15a850 msgr2=0x7f7a5c0b57d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:11.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.939+0000 7f7a61000640 1 --2- 172.21.15.55:0/3583139355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a5c15a850 0x7f7a5c0b57d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7a5400e850 tx=0x7f7a5400ed10 comp rx=0 tx=0).stop 2024-04-02T07:24:11.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.939+0000 7f7a61000640 1 -- 172.21.15.55:0/3583139355 shutdown_connections 2024-04-02T07:24:11.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.939+0000 7f7a61000640 1 --2- 172.21.15.55:0/3583139355 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7a5c15a850 0x7f7a5c0b57d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:11.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.939+0000 7f7a61000640 1 --2- 172.21.15.55:0/3583139355 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7a5c0cc070 0x7f7a5c158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:11.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.939+0000 7f7a61000640 1 --2- 172.21.15.55:0/3583139355 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7a38066690 0x7f7a38068b50 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:11.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.939+0000 7f7a61000640 1 --2- 172.21.15.55:0/3583139355 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7a5c099120 0x7f7a5c158400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:11.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.939+0000 7f7a61000640 1 -- 172.21.15.55:0/3583139355 >> 172.21.15.55:0/3583139355 conn(0x7f7a5c0b1fb0 msgr2=0x7f7a5c06b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:11.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.943+0000 7f7a61000640 1 -- 172.21.15.55:0/3583139355 shutdown_connections 2024-04-02T07:24:11.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:11.943+0000 7f7a61000640 1 -- 172.21.15.55:0/3583139355 wait complete. 2024-04-02T07:24:11.985 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:24:12.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.123+0000 7fa9ad800640 1 Processor -- start 2024-04-02T07:24:12.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.123+0000 7fa9ad800640 1 -- start start 2024-04-02T07:24:12.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.123+0000 7fa9ad800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9a80ce630 0x7fa9a8065d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:12.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.123+0000 7fa9ad800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9a8070a80 0x7fa9a8070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:12.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.123+0000 7fa9ad800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9a806d5b0 con 0x7fa9a815cbe0 2024-04-02T07:24:12.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.123+0000 7fa9ad800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9a80cec10 con 0x7fa9a8070a80 2024-04-02T07:24:12.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.123+0000 7fa9ad800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a8071450 con 0x7fa9a80ce630 2024-04-02T07:24:12.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.123+0000 7fa9a6a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa9a815cbe0 0x7fa9a80b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48452/0 (socket says 172.21.15.55:48452) 2024-04-02T07:24:12.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.123+0000 7fa9a6a00640 1 -- 172.21.15.55:0/2562865972 learned_addr learned my addr 172.21.15.55:0/2562865972 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:12.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.123+0000 7fa9a7400640 1 --2- 172.21.15.55:0/2562865972 >> v2:172.21.15.55:3300/0 conn(0x7fa9a8070a80 0x7fa9a8070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:12.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.123+0000 7fa99e000640 1 --2- 172.21.15.55:0/2562865972 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9a80ce630 0x7fa9a8065d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:12.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.123+0000 7fa9a6000640 1 -- 172.21.15.55:0/2562865972 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436986108 0 0) 0x7fa9a806d5b0 con 0x7fa9a815cbe0 2024-04-02T07:24:12.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.123+0000 7fa9a6000640 1 -- 172.21.15.55:0/2562865972 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa98c003530 con 0x7fa9a815cbe0 2024-04-02T07:24:12.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.123+0000 7fa9a7400640 1 -- 172.21.15.55:0/2562865972 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9a80ce630 msgr2=0x7fa9a8065d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:12.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.123+0000 7fa9a7400640 1 --2- 172.21.15.55:0/2562865972 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9a80ce630 0x7fa9a8065d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.123+0000 7fa9a7400640 1 -- 172.21.15.55:0/2562865972 >> v1:172.21.15.55:6789/0 conn(0x7fa9a815cbe0 legacy=0x7fa9a80b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:12.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.123+0000 7fa9a7400640 1 -- 172.21.15.55:0/2562865972 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a806cc80 con 0x7fa9a8070a80 2024-04-02T07:24:12.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.123+0000 7fa99e000640 1 --2- 172.21.15.55:0/2562865972 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9a80ce630 0x7fa9a8065d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:12.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.127+0000 7fa9a7400640 1 --2- 172.21.15.55:0/2562865972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9a8070a80 0x7fa9a8070f10 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009d90 tx=0x7fa9a001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e57cd6f1382860b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:12.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.127+0000 7fa9a6000640 1 -- 172.21.15.55:0/2562865972 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00a5830 con 0x7fa9a8070a80 2024-04-02T07:24:12.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.127+0000 7fa9a6000640 1 -- 172.21.15.55:0/2562865972 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a00a5990 con 0x7fa9a8070a80 2024-04-02T07:24:12.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.127+0000 7fa9a6000640 1 -- 172.21.15.55:0/2562865972 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00a5d00 con 0x7fa9a8070a80 2024-04-02T07:24:12.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.127+0000 7fa9ad800640 1 -- 172.21.15.55:0/2562865972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9a8070a80 msgr2=0x7fa9a8070f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:12.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.127+0000 7fa9ad800640 1 --2- 172.21.15.55:0/2562865972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9a8070a80 0x7fa9a8070f10 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009d90 tx=0x7fa9a001c970 comp rx=0 tx=0).stop 2024-04-02T07:24:12.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.127+0000 7fa9ad800640 1 -- 172.21.15.55:0/2562865972 shutdown_connections 2024-04-02T07:24:12.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.127+0000 7fa9ad800640 1 --2- 172.21.15.55:0/2562865972 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9a80ce630 0x7fa9a8065d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.127+0000 7fa9ad800640 1 --2- 172.21.15.55:0/2562865972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9a8070a80 0x7fa9a8070f10 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.127+0000 7fa9ad800640 1 -- 172.21.15.55:0/2562865972 >> 172.21.15.55:0/2562865972 conn(0x7fa9a80ced50 msgr2=0x7fa9a80cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:12.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.127+0000 7fa9ad800640 1 -- 172.21.15.55:0/2562865972 shutdown_connections 2024-04-02T07:24:12.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.127+0000 7fa9ad800640 1 -- 172.21.15.55:0/2562865972 wait complete. 2024-04-02T07:24:12.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa9ad800640 1 Processor -- start 2024-04-02T07:24:12.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa9ad800640 1 -- start start 2024-04-02T07:24:12.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa9ad800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9a8070a80 0x7fa9a81f5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:12.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa9ad800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9a80ce630 0x7fa9a80aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:12.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa9ad800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9a815cbe0 0x7fa9a80aefb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:12.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa9ad800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a814dd20 con 0x7fa9a815cbe0 2024-04-02T07:24:12.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa9ad800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a814eb80 con 0x7fa9a8070a80 2024-04-02T07:24:12.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa9ad800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9a81f58b0 con 0x7fa9a80ce630 2024-04-02T07:24:12.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa9a7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9a815cbe0 0x7fa9a80aefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:12.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa9a7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9a815cbe0 0x7fa9a80aefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53968/0 (socket says 172.21.15.55:53968) 2024-04-02T07:24:12.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa9a7400640 1 -- 172.21.15.55:0/1931992741 learned_addr learned my addr 172.21.15.55:0/1931992741 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:12.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa9a6a00640 1 --2- 172.21.15.55:0/1931992741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9a8070a80 0x7fa9a81f5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:12.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa99e000640 1 --2- 172.21.15.55:0/1931992741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9a80ce630 0x7fa9a80aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:12.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa9a7400640 1 -- 172.21.15.55:0/1931992741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9a80ce630 msgr2=0x7fa9a80aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:12.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa9a7400640 1 --2- 172.21.15.55:0/1931992741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9a80ce630 0x7fa9a80aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa9a7400640 1 -- 172.21.15.55:0/1931992741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9a8070a80 msgr2=0x7fa9a81f5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:12.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa9a7400640 1 --2- 172.21.15.55:0/1931992741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9a8070a80 0x7fa9a81f5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa9a7400640 1 -- 172.21.15.55:0/1931992741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a0009a70 con 0x7fa9a815cbe0 2024-04-02T07:24:12.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa99e000640 1 --2- 172.21.15.55:0/1931992741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9a80ce630 0x7fa9a80aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:12.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa9a7400640 1 --2- 172.21.15.55:0/1931992741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9a815cbe0 0x7fa9a80aefb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009d90 tx=0x7fa9a0019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:12.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa99f400640 1 -- 172.21.15.55:0/1931992741 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a00bd070 con 0x7fa9a815cbe0 2024-04-02T07:24:12.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa99f400640 1 -- 172.21.15.55:0/1931992741 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a00a57b0 con 0x7fa9a815cbe0 2024-04-02T07:24:12.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa99f400640 1 -- 172.21.15.55:0/1931992741 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a0003dd0 con 0x7fa9a815cbe0 2024-04-02T07:24:12.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa9ad800640 1 -- 172.21.15.55:0/1931992741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9a814df70 con 0x7fa9a815cbe0 2024-04-02T07:24:12.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.131+0000 7fa9ad800640 1 -- 172.21.15.55:0/1931992741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9a814e530 con 0x7fa9a815cbe0 2024-04-02T07:24:12.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.135+0000 7fa9ad800640 1 -- 172.21.15.55:0/1931992741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9a814ed10 con 0x7fa9a815cbe0 2024-04-02T07:24:12.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.135+0000 7fa99f400640 1 -- 172.21.15.55:0/1931992741 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa9a00b4070 con 0x7fa9a815cbe0 2024-04-02T07:24:12.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.135+0000 7fa99f400640 1 --2- 172.21.15.55:0/1931992741 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa984066690 0x7fa984068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:12.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.135+0000 7fa99f400640 1 -- 172.21.15.55:0/1931992741 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9a011e700 con 0x7fa9a815cbe0 2024-04-02T07:24:12.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.135+0000 7fa9a6a00640 1 --2- 172.21.15.55:0/1931992741 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa984066690 0x7fa984068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:12.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.135+0000 7fa9a6a00640 1 --2- 172.21.15.55:0/1931992741 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa984066690 0x7fa984068b50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa998007fd0 tx=0x7fa998009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:12.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.139+0000 7fa99f400640 1 -- 172.21.15.55:0/1931992741 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa9a00eba70 con 0x7fa9a815cbe0 2024-04-02T07:24:12.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.319+0000 7fa9ad800640 1 -- 172.21.15.55:0/1931992741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9a8066c90 con 0x7fa9a815cbe0 2024-04-02T07:24:12.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.319+0000 7fa99f400640 1 -- 172.21.15.55:0/1931992741 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16058 (secure 0 0 0) 0x7fa9a00b2090 con 0x7fa9a815cbe0 2024-04-02T07:24:12.321 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:12.321 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":45,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:24:11.928906+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:24:10.453515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-02T07:24:10.908188+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:24:12.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.319+0000 7fa9ad800640 1 -- 172.21.15.55:0/1931992741 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa984066690 msgr2=0x7fa984068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:12.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.319+0000 7fa9ad800640 1 --2- 172.21.15.55:0/1931992741 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa984066690 0x7fa984068b50 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa998007fd0 tx=0x7fa998009040 comp rx=0 tx=0).stop 2024-04-02T07:24:12.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.319+0000 7fa9ad800640 1 -- 172.21.15.55:0/1931992741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9a815cbe0 msgr2=0x7fa9a80aefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:12.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.319+0000 7fa9ad800640 1 --2- 172.21.15.55:0/1931992741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9a815cbe0 0x7fa9a80aefb0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa9a0009d90 tx=0x7fa9a0019710 comp rx=0 tx=0).stop 2024-04-02T07:24:12.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.319+0000 7fa9ad800640 1 -- 172.21.15.55:0/1931992741 shutdown_connections 2024-04-02T07:24:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.319+0000 7fa9ad800640 1 --2- 172.21.15.55:0/1931992741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9a815cbe0 0x7fa9a80aefb0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.319+0000 7fa9ad800640 1 --2- 172.21.15.55:0/1931992741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9a80ce630 0x7fa9a80aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.319+0000 7fa9ad800640 1 --2- 172.21.15.55:0/1931992741 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa984066690 0x7fa984068b50 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.319+0000 7fa9ad800640 1 --2- 172.21.15.55:0/1931992741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9a8070a80 0x7fa9a81f5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.319+0000 7fa9ad800640 1 -- 172.21.15.55:0/1931992741 >> 172.21.15.55:0/1931992741 conn(0x7fa9a80ced50 msgr2=0x7fa9a80b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.319+0000 7fa9ad800640 1 -- 172.21.15.55:0/1931992741 shutdown_connections 2024-04-02T07:24:12.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.319+0000 7fa9ad800640 1 -- 172.21.15.55:0/1931992741 wait complete. 2024-04-02T07:24:12.342 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:24:12.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.479+0000 7f9142000640 1 Processor -- start 2024-04-02T07:24:12.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.479+0000 7f9142000640 1 -- start start 2024-04-02T07:24:12.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.479+0000 7f9142000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f913c15a8b0 0x7f913c0cc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:12.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.479+0000 7f9142000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f913c15ac90 0x7f913c071c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:12.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.479+0000 7f9142000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f913c06ec30 con 0x7f913c072150 2024-04-02T07:24:12.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.479+0000 7f9142000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f913c0717a0 con 0x7f913c15ac90 2024-04-02T07:24:12.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.479+0000 7f9142000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913c06ef10 con 0x7f913c15a8b0 2024-04-02T07:24:12.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.479+0000 7f9133e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f913c15ac90 0x7f913c071c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:12.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.479+0000 7f9133e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f913c15ac90 0x7f913c071c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53980/0 (socket says 172.21.15.55:53980) 2024-04-02T07:24:12.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.479+0000 7f9133e00640 1 -- 172.21.15.55:0/3729041657 learned_addr learned my addr 172.21.15.55:0/3729041657 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:12.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.479+0000 7f913b400640 1 --2- 172.21.15.55:0/3729041657 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f913c15a8b0 0x7f913c0cc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:12.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.479+0000 7f9133e00640 1 -- 172.21.15.55:0/3729041657 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f913c15a8b0 msgr2=0x7f913c0cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:12.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.479+0000 7f9133e00640 1 --2- 172.21.15.55:0/3729041657 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f913c15a8b0 0x7f913c0cc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.479+0000 7f9133e00640 1 -- 172.21.15.55:0/3729041657 >> v1:172.21.15.106:6789/0 conn(0x7f913c072150 legacy=0x7f913c069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:12.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.479+0000 7f9133e00640 1 -- 172.21.15.55:0/3729041657 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f913c06f1f0 con 0x7f913c15ac90 2024-04-02T07:24:12.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.479+0000 7f913b400640 1 --2- 172.21.15.55:0/3729041657 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f913c15a8b0 0x7f913c0cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:24:12.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.483+0000 7f9133e00640 1 --2- 172.21.15.55:0/3729041657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f913c15ac90 0x7f913c071c10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9124009870 tx=0x7f912401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c434801194f491 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:12.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.483+0000 7f913aa00640 1 -- 172.21.15.55:0/3729041657 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91240ab620 con 0x7f913c15ac90 2024-04-02T07:24:12.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.483+0000 7f913aa00640 1 -- 172.21.15.55:0/3729041657 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91240ab780 con 0x7f913c15ac90 2024-04-02T07:24:12.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.483+0000 7f913aa00640 1 -- 172.21.15.55:0/3729041657 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91240abb10 con 0x7f913c15ac90 2024-04-02T07:24:12.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.483+0000 7f9142000640 1 -- 172.21.15.55:0/3729041657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f913c15ac90 msgr2=0x7f913c071c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:12.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.483+0000 7f9142000640 1 --2- 172.21.15.55:0/3729041657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f913c15ac90 0x7f913c071c10 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f9124009870 tx=0x7f912401c460 comp rx=0 tx=0).stop 2024-04-02T07:24:12.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.483+0000 7f9142000640 1 -- 172.21.15.55:0/3729041657 shutdown_connections 2024-04-02T07:24:12.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.483+0000 7f9142000640 1 --2- 172.21.15.55:0/3729041657 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f913c15ac90 0x7f913c071c10 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.483+0000 7f9142000640 1 --2- 172.21.15.55:0/3729041657 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f913c15a8b0 0x7f913c0cc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.483+0000 7f9142000640 1 -- 172.21.15.55:0/3729041657 >> 172.21.15.55:0/3729041657 conn(0x7f913c0b13b0 msgr2=0x7f913c0b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:12.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.483+0000 7f9142000640 1 -- 172.21.15.55:0/3729041657 shutdown_connections 2024-04-02T07:24:12.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.483+0000 7f9142000640 1 -- 172.21.15.55:0/3729041657 wait complete. 2024-04-02T07:24:12.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f9142000640 1 Processor -- start 2024-04-02T07:24:12.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f9142000640 1 -- start start 2024-04-02T07:24:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f9142000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f913c072150 0x7f913c14cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f9142000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f913c15a8b0 0x7f913c155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f9142000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f913c15ac90 0x7f913c0b06e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f9142000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c14d280 con 0x7f913c15ac90 2024-04-02T07:24:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f9142000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f913c1f4c20 con 0x7f913c072150 2024-04-02T07:24:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f9142000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f913c0b3680 con 0x7f913c15a8b0 2024-04-02T07:24:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f913be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f913c15ac90 0x7f913c0b06e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f913be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f913c15ac90 0x7f913c0b06e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53986/0 (socket says 172.21.15.55:53986) 2024-04-02T07:24:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f913be00640 1 -- 172.21.15.55:0/868715206 learned_addr learned my addr 172.21.15.55:0/868715206 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f913b400640 1 --2- 172.21.15.55:0/868715206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f913c072150 0x7f913c14cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:12.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f9133e00640 1 --2- 172.21.15.55:0/868715206 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f913c15a8b0 0x7f913c155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f913be00640 1 -- 172.21.15.55:0/868715206 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f913c15a8b0 msgr2=0x7f913c155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f913be00640 1 --2- 172.21.15.55:0/868715206 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f913c15a8b0 0x7f913c155bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f913be00640 1 -- 172.21.15.55:0/868715206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f913c072150 msgr2=0x7f913c14cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f913be00640 1 --2- 172.21.15.55:0/868715206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f913c072150 0x7f913c14cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f913be00640 1 -- 172.21.15.55:0/868715206 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91240094d0 con 0x7f913c15ac90 2024-04-02T07:24:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f913b400640 1 --2- 172.21.15.55:0/868715206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f913c072150 0x7f913c14cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:24:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f913be00640 1 --2- 172.21.15.55:0/868715206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f913c15ac90 0x7f913c0b06e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f913400b9e0 tx=0x7f913400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f9133400640 1 -- 172.21.15.55:0/868715206 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9134003b80 con 0x7f913c15ac90 2024-04-02T07:24:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f9133400640 1 -- 172.21.15.55:0/868715206 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9134003ce0 con 0x7f913c15ac90 2024-04-02T07:24:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f9133400640 1 -- 172.21.15.55:0/868715206 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913400cb60 con 0x7f913c15ac90 2024-04-02T07:24:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f9142000640 1 -- 172.21.15.55:0/868715206 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f913c0b3960 con 0x7f913c15ac90 2024-04-02T07:24:12.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.487+0000 7f9142000640 1 -- 172.21.15.55:0/868715206 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f913c0b3f20 con 0x7f913c15ac90 2024-04-02T07:24:12.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.491+0000 7f9142000640 1 -- 172.21.15.55:0/868715206 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f913c066c90 con 0x7f913c15ac90 2024-04-02T07:24:12.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.491+0000 7f9133400640 1 -- 172.21.15.55:0/868715206 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f913400ccc0 con 0x7f913c15ac90 2024-04-02T07:24:12.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.491+0000 7f9133400640 1 --2- 172.21.15.55:0/868715206 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9118066690 0x7f9118068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:12.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.491+0000 7f9133400640 1 -- 172.21.15.55:0/868715206 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9134083f50 con 0x7f913c15ac90 2024-04-02T07:24:12.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.491+0000 7f913b400640 1 --2- 172.21.15.55:0/868715206 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9118066690 0x7f9118068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:12.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.491+0000 7f913b400640 1 --2- 172.21.15.55:0/868715206 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9118066690 0x7f9118068b50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f912c008930 tx=0x7f912c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:12.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.495+0000 7f9133400640 1 -- 172.21.15.55:0/868715206 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f9134051220 con 0x7f913c15ac90 2024-04-02T07:24:12.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.659+0000 7f9142000640 1 -- 172.21.15.55:0/868715206 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f913c151720 con 0x7f913c15ac90 2024-04-02T07:24:12.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.659+0000 7f9133400640 1 -- 172.21.15.55:0/868715206 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) v1 ==== 74+0+16058 (secure 0 0 0) 0x7f9134054840 con 0x7f913c15ac90 2024-04-02T07:24:12.663 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:12.663 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":45,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:24:11.928906+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:24:10.453515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-02T07:24:10.908188+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:24:12.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.663+0000 7f9142000640 1 -- 172.21.15.55:0/868715206 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9118066690 msgr2=0x7f9118068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:12.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.663+0000 7f9142000640 1 --2- 172.21.15.55:0/868715206 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9118066690 0x7f9118068b50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f912c008930 tx=0x7f912c008040 comp rx=0 tx=0).stop 2024-04-02T07:24:12.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.663+0000 7f9142000640 1 -- 172.21.15.55:0/868715206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f913c15ac90 msgr2=0x7f913c0b06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:12.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.663+0000 7f9142000640 1 --2- 172.21.15.55:0/868715206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f913c15ac90 0x7f913c0b06e0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f913400b9e0 tx=0x7f913400bea0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.663+0000 7f9142000640 1 -- 172.21.15.55:0/868715206 shutdown_connections 2024-04-02T07:24:12.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.663+0000 7f9142000640 1 --2- 172.21.15.55:0/868715206 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f913c15ac90 0x7f913c0b06e0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.663+0000 7f9142000640 1 --2- 172.21.15.55:0/868715206 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f913c15a8b0 0x7f913c155bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.663+0000 7f9142000640 1 --2- 172.21.15.55:0/868715206 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9118066690 0x7f9118068b50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.663+0000 7f9142000640 1 --2- 172.21.15.55:0/868715206 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f913c072150 0x7f913c14cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.663+0000 7f9142000640 1 -- 172.21.15.55:0/868715206 >> 172.21.15.55:0/868715206 conn(0x7f913c0b13b0 msgr2=0x7f913c0cbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:12.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.663+0000 7f9142000640 1 -- 172.21.15.55:0/868715206 shutdown_connections 2024-04-02T07:24:12.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.663+0000 7f9142000640 1 -- 172.21.15.55:0/868715206 wait complete. 2024-04-02T07:24:12.684 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-02T07:24:12.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.823+0000 7ff156400640 1 Processor -- start 2024-04-02T07:24:12.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.823+0000 7ff156400640 1 -- start start 2024-04-02T07:24:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.823+0000 7ff156400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff15015ca60 0x7ff1500cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.823+0000 7ff156400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff150098a10 0x7ff150098ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.823+0000 7ff156400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff15015ce40 con 0x7ff15006b920 2024-04-02T07:24:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.823+0000 7ff156400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1500993e0 con 0x7ff150098a10 2024-04-02T07:24:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.823+0000 7ff156400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15006c440 con 0x7ff15015ca60 2024-04-02T07:24:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.827+0000 7ff147e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff150098a10 0x7ff150098ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.827+0000 7ff147e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff150098a10 0x7ff150098ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53994/0 (socket says 172.21.15.55:53994) 2024-04-02T07:24:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.827+0000 7ff147e00640 1 -- 172.21.15.55:0/2895454320 learned_addr learned my addr 172.21.15.55:0/2895454320 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.827+0000 7ff14f400640 1 --2- 172.21.15.55:0/2895454320 >> v2:172.21.15.106:3300/0 conn(0x7ff15015ca60 0x7ff1500cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:12.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.827+0000 7ff147e00640 1 -- 172.21.15.55:0/2895454320 >> v2:172.21.15.106:3300/0 conn(0x7ff15015ca60 msgr2=0x7ff1500cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:12.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.827+0000 7ff147e00640 1 --2- 172.21.15.55:0/2895454320 >> v2:172.21.15.106:3300/0 conn(0x7ff15015ca60 0x7ff1500cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.827+0000 7ff147e00640 1 -- 172.21.15.55:0/2895454320 >> v1:172.21.15.106:6789/0 conn(0x7ff15006b920 legacy=0x7ff15006bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:12.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.827+0000 7ff147e00640 1 -- 172.21.15.55:0/2895454320 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1500d01b0 con 0x7ff150098a10 2024-04-02T07:24:12.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.827+0000 7ff147e00640 1 --2- 172.21.15.55:0/2895454320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150098a10 0x7ff150098ea0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff1500d1760 tx=0x7ff13801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea329269138dcfb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:12.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.827+0000 7ff14ea00640 1 -- 172.21.15.55:0/2895454320 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1380ab660 con 0x7ff150098a10 2024-04-02T07:24:12.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.827+0000 7ff14ea00640 1 -- 172.21.15.55:0/2895454320 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1380ab7c0 con 0x7ff150098a10 2024-04-02T07:24:12.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.827+0000 7ff14ea00640 1 -- 172.21.15.55:0/2895454320 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1380abb50 con 0x7ff150098a10 2024-04-02T07:24:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff156400640 1 -- 172.21.15.55:0/2895454320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150098a10 msgr2=0x7ff150098ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff156400640 1 --2- 172.21.15.55:0/2895454320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150098a10 0x7ff150098ea0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff1500d1760 tx=0x7ff13801c460 comp rx=0 tx=0).stop 2024-04-02T07:24:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff156400640 1 -- 172.21.15.55:0/2895454320 shutdown_connections 2024-04-02T07:24:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff156400640 1 --2- 172.21.15.55:0/2895454320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150098a10 0x7ff150098ea0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff156400640 1 --2- 172.21.15.55:0/2895454320 >> v2:172.21.15.106:3300/0 conn(0x7ff15015ca60 0x7ff1500cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff156400640 1 -- 172.21.15.55:0/2895454320 >> 172.21.15.55:0/2895454320 conn(0x7ff1500b2150 msgr2=0x7ff1500b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff156400640 1 -- 172.21.15.55:0/2895454320 shutdown_connections 2024-04-02T07:24:12.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff156400640 1 -- 172.21.15.55:0/2895454320 wait complete. 2024-04-02T07:24:12.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff156400640 1 Processor -- start 2024-04-02T07:24:12.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff156400640 1 -- start start 2024-04-02T07:24:12.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff156400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff15006b920 0x7ff1500b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:12.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff156400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150098a10 0x7ff1500c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:12.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff156400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff15015ca60 0x7ff150158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:12.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff156400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1500c6520 con 0x7ff150098a10 2024-04-02T07:24:12.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff156400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1500b4350 con 0x7ff15006b920 2024-04-02T07:24:12.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff156400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1500c5910 con 0x7ff15015ca60 2024-04-02T07:24:12.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff147e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150098a10 0x7ff1500c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff147e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150098a10 0x7ff1500c69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53998/0 (socket says 172.21.15.55:53998) 2024-04-02T07:24:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff147e00640 1 -- 172.21.15.55:0/2261176376 learned_addr learned my addr 172.21.15.55:0/2261176376 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff14f400640 1 --2- 172.21.15.55:0/2261176376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff15006b920 0x7ff1500b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff14fe00640 1 --2- 172.21.15.55:0/2261176376 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff15015ca60 0x7ff150158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff147e00640 1 -- 172.21.15.55:0/2261176376 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff15015ca60 msgr2=0x7ff150158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff147e00640 1 --2- 172.21.15.55:0/2261176376 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff15015ca60 0x7ff150158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff147e00640 1 -- 172.21.15.55:0/2261176376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff15006b920 msgr2=0x7ff1500b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff147e00640 1 --2- 172.21.15.55:0/2261176376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff15006b920 0x7ff1500b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff147e00640 1 -- 172.21.15.55:0/2261176376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1380094d0 con 0x7ff150098a10 2024-04-02T07:24:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff14fe00640 1 --2- 172.21.15.55:0/2261176376 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff15015ca60 0x7ff150158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:24:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.831+0000 7ff147e00640 1 --2- 172.21.15.55:0/2261176376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150098a10 0x7ff1500c69b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff138019070 tx=0x7ff13801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:12.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.835+0000 7ff147400640 1 -- 172.21.15.55:0/2261176376 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1380b4800 con 0x7ff150098a10 2024-04-02T07:24:12.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.835+0000 7ff147400640 1 -- 172.21.15.55:0/2261176376 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1380b4980 con 0x7ff150098a10 2024-04-02T07:24:12.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.835+0000 7ff147400640 1 -- 172.21.15.55:0/2261176376 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1380b4d30 con 0x7ff150098a10 2024-04-02T07:24:12.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.835+0000 7ff156400640 1 -- 172.21.15.55:0/2261176376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1500c5bf0 con 0x7ff150098a10 2024-04-02T07:24:12.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.835+0000 7ff156400640 1 -- 172.21.15.55:0/2261176376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1500c61b0 con 0x7ff150098a10 2024-04-02T07:24:12.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.835+0000 7ff156400640 1 -- 172.21.15.55:0/2261176376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1500c6690 con 0x7ff150098a10 2024-04-02T07:24:12.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.835+0000 7ff147400640 1 -- 172.21.15.55:0/2261176376 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff1380a9070 con 0x7ff150098a10 2024-04-02T07:24:12.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.835+0000 7ff147400640 1 --2- 172.21.15.55:0/2261176376 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff12c066690 0x7ff12c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:12.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.835+0000 7ff147400640 1 -- 172.21.15.55:0/2261176376 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff13811eb60 con 0x7ff150098a10 2024-04-02T07:24:12.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.835+0000 7ff14f400640 1 --2- 172.21.15.55:0/2261176376 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff12c066690 0x7ff12c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:12.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.839+0000 7ff14f400640 1 --2- 172.21.15.55:0/2261176376 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff12c066690 0x7ff12c068b50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff14000ba50 tx=0x7ff140008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:12.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:12.839+0000 7ff147400640 1 -- 172.21.15.55:0/2261176376 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff1380ec080 con 0x7ff150098a10 2024-04-02T07:24:13.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:13.039+0000 7ff156400640 1 -- 172.21.15.55:0/2261176376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff150066c90 con 0x7ff150098a10 2024-04-02T07:24:13.358 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:24:13.362 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:24:13.446 INFO:tasks.ceph.mds.b.smithi106.stderr:2024-04-02T07:24:13.444+0000 7f2e6d000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:24:13.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:13.955+0000 7ff147400640 1 -- 172.21.15.55:0/2261176376 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v24) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff1380ef6a0 con 0x7ff150098a10 2024-04-02T07:24:13.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:13.959+0000 7ff156400640 1 -- 172.21.15.55:0/2261176376 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff12c066690 msgr2=0x7ff12c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:13.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:13.959+0000 7ff156400640 1 --2- 172.21.15.55:0/2261176376 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff12c066690 0x7ff12c068b50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff14000ba50 tx=0x7ff140008040 comp rx=0 tx=0).stop 2024-04-02T07:24:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:13.959+0000 7ff156400640 1 -- 172.21.15.55:0/2261176376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150098a10 msgr2=0x7ff1500c69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:13.959+0000 7ff156400640 1 --2- 172.21.15.55:0/2261176376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150098a10 0x7ff1500c69b0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff138019070 tx=0x7ff13801aca0 comp rx=0 tx=0).stop 2024-04-02T07:24:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:13.959+0000 7ff156400640 1 -- 172.21.15.55:0/2261176376 shutdown_connections 2024-04-02T07:24:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:13.959+0000 7ff156400640 1 --2- 172.21.15.55:0/2261176376 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff15015ca60 0x7ff150158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:13.959+0000 7ff156400640 1 --2- 172.21.15.55:0/2261176376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff150098a10 0x7ff1500c69b0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:13.959+0000 7ff156400640 1 --2- 172.21.15.55:0/2261176376 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff12c066690 0x7ff12c068b50 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:13.959+0000 7ff156400640 1 --2- 172.21.15.55:0/2261176376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff15006b920 0x7ff1500b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:13.959+0000 7ff156400640 1 -- 172.21.15.55:0/2261176376 >> 172.21.15.55:0/2261176376 conn(0x7ff1500b2150 msgr2=0x7ff1500afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:13.959+0000 7ff156400640 1 -- 172.21.15.55:0/2261176376 shutdown_connections 2024-04-02T07:24:13.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:13.959+0000 7ff156400640 1 -- 172.21.15.55:0/2261176376 wait complete. 2024-04-02T07:24:13.986 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-02T07:24:13.986 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-02T07:24:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.130+0000 7f9a3b000640 1 Processor -- start 2024-04-02T07:24:14.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.130+0000 7f9a3b000640 1 -- start start 2024-04-02T07:24:14.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.130+0000 7f9a3b000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a340b29e0 0x7f9a34071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:14.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.130+0000 7f9a3b000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9a340b2dc0 0x7f9a34070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:14.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.130+0000 7f9a3b000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a34071990 con 0x7f9a34070c50 2024-04-02T07:24:14.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.130+0000 7f9a3b000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a340710a0 con 0x7f9a340b2dc0 2024-04-02T07:24:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.130+0000 7f9a3b000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3415df80 con 0x7f9a340b29e0 2024-04-02T07:24:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.134+0000 7f9a33e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a340b29e0 0x7f9a34071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.134+0000 7f9a2be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9a340b2dc0 0x7f9a34070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.134+0000 7f9a33e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a340b29e0 0x7f9a34071450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:60370/0 (socket says 172.21.15.55:60370) 2024-04-02T07:24:14.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.134+0000 7f9a33e00640 1 -- 172.21.15.55:0/2858745543 learned_addr learned my addr 172.21.15.55:0/2858745543 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:14.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.134+0000 7f9a33e00640 1 -- 172.21.15.55:0/2858745543 >> v2:172.21.15.106:3300/0 conn(0x7f9a340b2dc0 msgr2=0x7f9a34070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:14.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.134+0000 7f9a33e00640 1 --2- 172.21.15.55:0/2858745543 >> v2:172.21.15.106:3300/0 conn(0x7f9a340b2dc0 0x7f9a34070710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:14.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.134+0000 7f9a33e00640 1 -- 172.21.15.55:0/2858745543 >> v1:172.21.15.106:6789/0 conn(0x7f9a34070c50 legacy=0x7f9a341605a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:14.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.134+0000 7f9a33e00640 1 -- 172.21.15.55:0/2858745543 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a3415d400 con 0x7f9a340b29e0 2024-04-02T07:24:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.134+0000 7f9a33e00640 1 --2- 172.21.15.55:0/2858745543 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a340b29e0 0x7f9a34071450 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009870 tx=0x7f9a2401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7460380f6081e299 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a33400640 1 -- 172.21.15.55:0/2858745543 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a240a6040 con 0x7f9a340b29e0 2024-04-02T07:24:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a33400640 1 -- 172.21.15.55:0/2858745543 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a240aa600 con 0x7f9a340b29e0 2024-04-02T07:24:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a33400640 1 -- 172.21.15.55:0/2858745543 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a240aa990 con 0x7f9a340b29e0 2024-04-02T07:24:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a3b000640 1 -- 172.21.15.55:0/2858745543 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a340b29e0 msgr2=0x7f9a34071450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:14.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a3b000640 1 --2- 172.21.15.55:0/2858745543 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a340b29e0 0x7f9a34071450 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9a24009870 tx=0x7f9a2401c4a0 comp rx=0 tx=0).stop 2024-04-02T07:24:14.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a3b000640 1 -- 172.21.15.55:0/2858745543 shutdown_connections 2024-04-02T07:24:14.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a3b000640 1 --2- 172.21.15.55:0/2858745543 >> v2:172.21.15.106:3300/0 conn(0x7f9a340b2dc0 0x7f9a34070710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:14.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a3b000640 1 --2- 172.21.15.55:0/2858745543 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a340b29e0 0x7f9a34071450 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:14.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a3b000640 1 -- 172.21.15.55:0/2858745543 >> 172.21.15.55:0/2858745543 conn(0x7f9a340b06f0 msgr2=0x7f9a340b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:14.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a3b000640 1 -- 172.21.15.55:0/2858745543 shutdown_connections 2024-04-02T07:24:14.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a3b000640 1 -- 172.21.15.55:0/2858745543 wait complete. 2024-04-02T07:24:14.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a3b000640 1 Processor -- start 2024-04-02T07:24:14.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a3b000640 1 -- start start 2024-04-02T07:24:14.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a3b000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a34070c50 0x7f9a34156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a3b000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a340b29e0 0x7f9a3415bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a3b000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a340b2dc0 0x7f9a3415c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a3b000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a34158e70 con 0x7f9a34070c50 2024-04-02T07:24:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a3b000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a34159150 con 0x7f9a340b29e0 2024-04-02T07:24:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a3b000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a34159430 con 0x7f9a340b2dc0 2024-04-02T07:24:14.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a33e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a34070c50 0x7f9a34156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:14.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a33e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a34070c50 0x7f9a34156a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54008/0 (socket says 172.21.15.55:54008) 2024-04-02T07:24:14.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a33e00640 1 -- 172.21.15.55:0/3919832502 learned_addr learned my addr 172.21.15.55:0/3919832502 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:14.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a2be00640 1 --2- 172.21.15.55:0/3919832502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a340b29e0 0x7f9a3415bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:14.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a39000640 1 --2- 172.21.15.55:0/3919832502 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a340b2dc0 0x7f9a3415c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:14.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a33e00640 1 -- 172.21.15.55:0/3919832502 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a340b2dc0 msgr2=0x7f9a3415c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:14.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a33e00640 1 --2- 172.21.15.55:0/3919832502 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a340b2dc0 0x7f9a3415c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:14.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a33e00640 1 -- 172.21.15.55:0/3919832502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a340b29e0 msgr2=0x7f9a3415bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:14.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.138+0000 7f9a33e00640 1 --2- 172.21.15.55:0/3919832502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a340b29e0 0x7f9a3415bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:14.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.142+0000 7f9a33e00640 1 -- 172.21.15.55:0/3919832502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a240094d0 con 0x7f9a34070c50 2024-04-02T07:24:14.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.142+0000 7f9a33e00640 1 --2- 172.21.15.55:0/3919832502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a34070c50 0x7f9a34156a60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9a2401a0d0 tx=0x7f9a2401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:14.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.142+0000 7f9a30c00640 1 -- 172.21.15.55:0/3919832502 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a240b3600 con 0x7f9a34070c50 2024-04-02T07:24:14.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.142+0000 7f9a30c00640 1 -- 172.21.15.55:0/3919832502 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a240b3760 con 0x7f9a34070c50 2024-04-02T07:24:14.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.142+0000 7f9a30c00640 1 -- 172.21.15.55:0/3919832502 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a240b3af0 con 0x7f9a34070c50 2024-04-02T07:24:14.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.142+0000 7f9a3b000640 1 -- 172.21.15.55:0/3919832502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a34159710 con 0x7f9a34070c50 2024-04-02T07:24:14.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.142+0000 7f9a3b000640 1 -- 172.21.15.55:0/3919832502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a3414db10 con 0x7f9a34070c50 2024-04-02T07:24:14.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.142+0000 7f9a3b000640 1 -- 172.21.15.55:0/3919832502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a34159930 con 0x7f9a34070c50 2024-04-02T07:24:14.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.142+0000 7f9a30c00640 1 -- 172.21.15.55:0/3919832502 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f9a240b3c50 con 0x7f9a34070c50 2024-04-02T07:24:14.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.142+0000 7f9a30c00640 1 --2- 172.21.15.55:0/3919832502 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9a100666c0 0x7f9a10068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:14.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.142+0000 7f9a30c00640 1 -- 172.21.15.55:0/3919832502 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9a2411ed50 con 0x7f9a34070c50 2024-04-02T07:24:14.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.146+0000 7f9a2be00640 1 --2- 172.21.15.55:0/3919832502 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9a100666c0 0x7f9a10068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:14.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.146+0000 7f9a2be00640 1 --2- 172.21.15.55:0/3919832502 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9a100666c0 0x7f9a10068b80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9a3415a510 tx=0x7f9a1c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:14.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.150+0000 7f9a30c00640 1 -- 172.21.15.55:0/3919832502 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f9a240ec220 con 0x7f9a34070c50 2024-04-02T07:24:14.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.342+0000 7f9a3b000640 1 -- 172.21.15.55:0/3919832502 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9a34158fb0 con 0x7f9a34070c50 2024-04-02T07:24:14.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.966+0000 7f9a30c00640 1 -- 172.21.15.55:0/3919832502 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v25) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9a34158fb0 con 0x7f9a34070c50 2024-04-02T07:24:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.966+0000 7f9a3b000640 1 -- 172.21.15.55:0/3919832502 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9a100666c0 msgr2=0x7f9a10068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.966+0000 7f9a3b000640 1 --2- 172.21.15.55:0/3919832502 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9a100666c0 0x7f9a10068b80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f9a3415a510 tx=0x7f9a1c009190 comp rx=0 tx=0).stop 2024-04-02T07:24:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.966+0000 7f9a3b000640 1 -- 172.21.15.55:0/3919832502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a34070c50 msgr2=0x7f9a34156a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.966+0000 7f9a3b000640 1 --2- 172.21.15.55:0/3919832502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a34070c50 0x7f9a34156a60 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f9a2401a0d0 tx=0x7f9a2401ace0 comp rx=0 tx=0).stop 2024-04-02T07:24:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.966+0000 7f9a3b000640 1 -- 172.21.15.55:0/3919832502 shutdown_connections 2024-04-02T07:24:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.966+0000 7f9a3b000640 1 --2- 172.21.15.55:0/3919832502 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9a340b2dc0 0x7f9a3415c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:14.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.966+0000 7f9a3b000640 1 --2- 172.21.15.55:0/3919832502 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9a100666c0 0x7f9a10068b80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.966+0000 7f9a3b000640 1 --2- 172.21.15.55:0/3919832502 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9a340b29e0 0x7f9a3415bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.966+0000 7f9a3b000640 1 --2- 172.21.15.55:0/3919832502 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9a34070c50 0x7f9a34156a60 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.966+0000 7f9a3b000640 1 -- 172.21.15.55:0/3919832502 >> 172.21.15.55:0/3919832502 conn(0x7f9a340b06f0 msgr2=0x7f9a340ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.966+0000 7f9a3b000640 1 -- 172.21.15.55:0/3919832502 shutdown_connections 2024-04-02T07:24:14.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:14.966+0000 7f9a3b000640 1 -- 172.21.15.55:0/3919832502 wait complete. 2024-04-02T07:24:14.995 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-02T07:24:14.995 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:24:15.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.138+0000 7f8b2cc00640 1 Processor -- start 2024-04-02T07:24:15.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.138+0000 7f8b2cc00640 1 -- start start 2024-04-02T07:24:15.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.138+0000 7f8b2cc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b28153ea0 0x7f8b280c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.138+0000 7f8b2cc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8b28159be0 0x7f8b280b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.138+0000 7f8b2cc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8b2815a040 0x7f8b280b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.138+0000 7f8b2cc00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b2813d0c0 con 0x7f8b2815a040 2024-04-02T07:24:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.138+0000 7f8b2cc00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b2815a4f0 con 0x7f8b28159be0 2024-04-02T07:24:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.138+0000 7f8b2cc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b2815a7d0 con 0x7f8b28153ea0 2024-04-02T07:24:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.138+0000 7f8b26800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8b2815a040 0x7f8b280b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.138+0000 7f8b26800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8b2815a040 0x7f8b280b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54016/0 (socket says 172.21.15.55:54016) 2024-04-02T07:24:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.138+0000 7f8b26800640 1 -- 172.21.15.55:0/462660414 learned_addr learned my addr 172.21.15.55:0/462660414 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.138+0000 7f8b25400640 1 --2- 172.21.15.55:0/462660414 >> v2:172.21.15.106:3300/0 conn(0x7f8b28159be0 0x7f8b280b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.138+0000 7f8b25e00640 1 --2- 172.21.15.55:0/462660414 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b28153ea0 0x7f8b280c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.138+0000 7f8b26800640 1 -- 172.21.15.55:0/462660414 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b28153ea0 msgr2=0x7f8b280c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.138+0000 7f8b26800640 1 --2- 172.21.15.55:0/462660414 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b28153ea0 0x7f8b280c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.138+0000 7f8b26800640 1 -- 172.21.15.55:0/462660414 >> v2:172.21.15.106:3300/0 conn(0x7f8b28159be0 msgr2=0x7f8b280b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.138+0000 7f8b26800640 1 --2- 172.21.15.55:0/462660414 >> v2:172.21.15.106:3300/0 conn(0x7f8b28159be0 0x7f8b280b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.138+0000 7f8b26800640 1 -- 172.21.15.55:0/462660414 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b2815aab0 con 0x7f8b2815a040 2024-04-02T07:24:15.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.138+0000 7f8b25400640 1 --2- 172.21.15.55:0/462660414 >> v2:172.21.15.106:3300/0 conn(0x7f8b28159be0 0x7f8b280b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:15.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.142+0000 7f8b26800640 1 --2- 172.21.15.55:0/462660414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b2815a040 0x7f8b280b36f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8b280b3d70 tx=0x7f8b2001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22505a13095268fd server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:15.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.142+0000 7f8b24a00640 1 -- 172.21.15.55:0/462660414 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b200a5890 con 0x7f8b2815a040 2024-04-02T07:24:15.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.142+0000 7f8b24a00640 1 -- 172.21.15.55:0/462660414 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b200a59f0 con 0x7f8b2815a040 2024-04-02T07:24:15.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.142+0000 7f8b24a00640 1 -- 172.21.15.55:0/462660414 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b200a5d80 con 0x7f8b2815a040 2024-04-02T07:24:15.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.142+0000 7f8b2cc00640 1 -- 172.21.15.55:0/462660414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b2815a040 msgr2=0x7f8b280b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:15.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.142+0000 7f8b2cc00640 1 --2- 172.21.15.55:0/462660414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b2815a040 0x7f8b280b36f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8b280b3d70 tx=0x7f8b2001c9f0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.142+0000 7f8b2cc00640 1 -- 172.21.15.55:0/462660414 shutdown_connections 2024-04-02T07:24:15.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.142+0000 7f8b2cc00640 1 --2- 172.21.15.55:0/462660414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b2815a040 0x7f8b280b36f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.142+0000 7f8b2cc00640 1 --2- 172.21.15.55:0/462660414 >> v2:172.21.15.106:3300/0 conn(0x7f8b28159be0 0x7f8b280b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.142+0000 7f8b2cc00640 1 --2- 172.21.15.55:0/462660414 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b28153ea0 0x7f8b280c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.142+0000 7f8b2cc00640 1 -- 172.21.15.55:0/462660414 >> 172.21.15.55:0/462660414 conn(0x7f8b28066080 msgr2=0x7f8b28069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:15.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.142+0000 7f8b2cc00640 1 -- 172.21.15.55:0/462660414 shutdown_connections 2024-04-02T07:24:15.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.142+0000 7f8b2cc00640 1 -- 172.21.15.55:0/462660414 wait complete. 2024-04-02T07:24:15.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.142+0000 7f8b2cc00640 1 Processor -- start 2024-04-02T07:24:15.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.142+0000 7f8b2cc00640 1 -- start start 2024-04-02T07:24:15.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b2cc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b28153ea0 0x7f8b281f90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b2cc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b28159be0 0x7f8b28134d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b2cc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b2815a040 0x7f8b2813d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b2cc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280cb0f0 con 0x7f8b28159be0 2024-04-02T07:24:15.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b2cc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280cb3d0 con 0x7f8b2815a040 2024-04-02T07:24:15.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b2cc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b280cb6b0 con 0x7f8b28153ea0 2024-04-02T07:24:15.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b25400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b28159be0 0x7f8b28134d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b25400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b28159be0 0x7f8b28134d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54028/0 (socket says 172.21.15.55:54028) 2024-04-02T07:24:15.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b25400640 1 -- 172.21.15.55:0/1403864897 learned_addr learned my addr 172.21.15.55:0/1403864897 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:15.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b25e00640 1 --2- 172.21.15.55:0/1403864897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b28153ea0 0x7f8b281f90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b26800640 1 --2- 172.21.15.55:0/1403864897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b2815a040 0x7f8b2813d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b25400640 1 -- 172.21.15.55:0/1403864897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b28153ea0 msgr2=0x7f8b281f90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:15.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b25400640 1 --2- 172.21.15.55:0/1403864897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b28153ea0 0x7f8b281f90f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b25400640 1 -- 172.21.15.55:0/1403864897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b2815a040 msgr2=0x7f8b2813d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:15.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b25400640 1 --2- 172.21.15.55:0/1403864897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b2815a040 0x7f8b2813d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b25400640 1 -- 172.21.15.55:0/1403864897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b20009b30 con 0x7f8b28159be0 2024-04-02T07:24:15.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b25400640 1 --2- 172.21.15.55:0/1403864897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b28159be0 0x7f8b28134d70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400e810 tx=0x7f8b1400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:15.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b1e000640 1 -- 172.21.15.55:0/1403864897 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1400c8d0 con 0x7f8b28159be0 2024-04-02T07:24:15.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b1e000640 1 -- 172.21.15.55:0/1403864897 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b1400ca30 con 0x7f8b28159be0 2024-04-02T07:24:15.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b1e000640 1 -- 172.21.15.55:0/1403864897 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b1400cdc0 con 0x7f8b28159be0 2024-04-02T07:24:15.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b2cc00640 1 -- 172.21.15.55:0/1403864897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b280cb990 con 0x7f8b28159be0 2024-04-02T07:24:15.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b2cc00640 1 -- 172.21.15.55:0/1403864897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b281352b0 con 0x7f8b28159be0 2024-04-02T07:24:15.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.146+0000 7f8b2cc00640 1 -- 172.21.15.55:0/1403864897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b28066c90 con 0x7f8b28159be0 2024-04-02T07:24:15.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.150+0000 7f8b1e000640 1 -- 172.21.15.55:0/1403864897 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8b14013410 con 0x7f8b28159be0 2024-04-02T07:24:15.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.150+0000 7f8b1e000640 1 --2- 172.21.15.55:0/1403864897 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8b08066690 0x7f8b08068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.150+0000 7f8b1e000640 1 -- 172.21.15.55:0/1403864897 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b14083fa0 con 0x7f8b28159be0 2024-04-02T07:24:15.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.150+0000 7f8b25e00640 1 --2- 172.21.15.55:0/1403864897 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8b08066690 0x7f8b08068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.150+0000 7f8b25e00640 1 --2- 172.21.15.55:0/1403864897 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8b08066690 0x7f8b08068b50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009a40 tx=0x7f8b18009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:15.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.154+0000 7f8b1e000640 1 -- 172.21.15.55:0/1403864897 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f8b14051320 con 0x7f8b28159be0 2024-04-02T07:24:15.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.346+0000 7f8b2cc00640 1 -- 172.21.15.55:0/1403864897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b28153560 con 0x7f8b28159be0 2024-04-02T07:24:15.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.346+0000 7f8b1e000640 1 -- 172.21.15.55:0/1403864897 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f8b14054940 con 0x7f8b28159be0 2024-04-02T07:24:15.350 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:15.350 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2224746522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2224746522},{"type":"v1","addr":"172.21.15.106:6837","nonce":2224746522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/2077739908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2077739908},{"type":"v1","addr":"172.21.15.55:6833","nonce":2077739908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/4108584287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4108584287},{"type":"v1","addr":"172.21.15.55:6835","nonce":4108584287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:24:11.929212+0000","modified":"2024-04-02T07:24:14.958225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5655":{"gid":5655,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6836/1720558250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1720558250},{"type":"v1","addr":"172.21.15.106:6836","nonce":1720558250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-02T07:24:15.350 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 25 2024-04-02T07:24:15.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.346+0000 7f8b2cc00640 1 -- 172.21.15.55:0/1403864897 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8b08066690 msgr2=0x7f8b08068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:15.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.346+0000 7f8b2cc00640 1 --2- 172.21.15.55:0/1403864897 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8b08066690 0x7f8b08068b50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f8b18009a40 tx=0x7f8b18009190 comp rx=0 tx=0).stop 2024-04-02T07:24:15.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.346+0000 7f8b2cc00640 1 -- 172.21.15.55:0/1403864897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b28159be0 msgr2=0x7f8b28134d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:15.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.346+0000 7f8b2cc00640 1 --2- 172.21.15.55:0/1403864897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b28159be0 0x7f8b28134d70 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8b1400e810 tx=0x7f8b1400ecd0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.350+0000 7f8b2cc00640 1 -- 172.21.15.55:0/1403864897 shutdown_connections 2024-04-02T07:24:15.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.350+0000 7f8b2cc00640 1 --2- 172.21.15.55:0/1403864897 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8b08066690 0x7f8b08068b50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.350+0000 7f8b2cc00640 1 --2- 172.21.15.55:0/1403864897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b2815a040 0x7f8b2813d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.350+0000 7f8b2cc00640 1 --2- 172.21.15.55:0/1403864897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b28159be0 0x7f8b28134d70 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.350+0000 7f8b2cc00640 1 --2- 172.21.15.55:0/1403864897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b28153ea0 0x7f8b281f90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.350+0000 7f8b2cc00640 1 -- 172.21.15.55:0/1403864897 >> 172.21.15.55:0/1403864897 conn(0x7f8b28066080 msgr2=0x7f8b281392f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:15.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.350+0000 7f8b2cc00640 1 -- 172.21.15.55:0/1403864897 shutdown_connections 2024-04-02T07:24:15.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.350+0000 7f8b2cc00640 1 -- 172.21.15.55:0/1403864897 wait complete. 2024-04-02T07:24:15.371 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:24:15.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.506+0000 7f3fe8e00640 1 Processor -- start 2024-04-02T07:24:15.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.506+0000 7f3fe8e00640 1 -- start start 2024-04-02T07:24:15.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.510+0000 7f3fe8e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3fe40b1430 0x7f3fe40afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.510+0000 7f3fe8e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3fe4099750 0x7f3fe40cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.510+0000 7f3fe8e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe40ce2f0 con 0x7f3fe4098a10 2024-04-02T07:24:15.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.510+0000 7f3fe8e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe40cbe10 con 0x7f3fe4099750 2024-04-02T07:24:15.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.510+0000 7f3fe8e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe40ce5d0 con 0x7f3fe40b1430 2024-04-02T07:24:15.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.510+0000 7f3fe1e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3fe4098a10 0x7f3fe4098df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48468/0 (socket says 172.21.15.55:48468) 2024-04-02T07:24:15.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.510+0000 7f3fe1e00640 1 -- 172.21.15.55:0/1024101635 learned_addr learned my addr 172.21.15.55:0/1024101635 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:15.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.510+0000 7f3fe2800640 1 --2- 172.21.15.55:0/1024101635 >> v2:172.21.15.55:3300/0 conn(0x7f3fe4099750 0x7f3fe40cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.510+0000 7f3fd9400640 1 --2- 172.21.15.55:0/1024101635 >> v2:172.21.15.106:3300/0 conn(0x7f3fe40b1430 0x7f3fe40afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.510+0000 7f3fe1400640 1 -- 172.21.15.55:0/1024101635 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3418592486 0 0) 0x7f3fe40ce2f0 con 0x7f3fe4098a10 2024-04-02T07:24:15.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.510+0000 7f3fe1400640 1 -- 172.21.15.55:0/1024101635 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fc8003530 con 0x7f3fe4098a10 2024-04-02T07:24:15.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.510+0000 7f3fe2800640 1 -- 172.21.15.55:0/1024101635 >> v2:172.21.15.106:3300/0 conn(0x7f3fe40b1430 msgr2=0x7f3fe40afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:15.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.510+0000 7f3fe2800640 1 --2- 172.21.15.55:0/1024101635 >> v2:172.21.15.106:3300/0 conn(0x7f3fe40b1430 0x7f3fe40afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.510+0000 7f3fe2800640 1 -- 172.21.15.55:0/1024101635 >> v1:172.21.15.55:6789/0 conn(0x7f3fe4098a10 legacy=0x7f3fe4098df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:15.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.510+0000 7f3fe2800640 1 -- 172.21.15.55:0/1024101635 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe4099be0 con 0x7f3fe4099750 2024-04-02T07:24:15.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.510+0000 7f3fd9400640 1 --2- 172.21.15.55:0/1024101635 >> v2:172.21.15.106:3300/0 conn(0x7f3fe40b1430 0x7f3fe40afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:15.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.510+0000 7f3fe2800640 1 --2- 172.21.15.55:0/1024101635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fe4099750 0x7f3fe40cea60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4073650 tx=0x7f3fdc01c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e89af58a8a171d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:15.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe1400640 1 -- 172.21.15.55:0/1024101635 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0ab5f0 con 0x7f3fe4099750 2024-04-02T07:24:15.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe1400640 1 -- 172.21.15.55:0/1024101635 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc0ab750 con 0x7f3fe4099750 2024-04-02T07:24:15.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe1400640 1 -- 172.21.15.55:0/1024101635 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0abae0 con 0x7f3fe4099750 2024-04-02T07:24:15.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe8e00640 1 -- 172.21.15.55:0/1024101635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fe4099750 msgr2=0x7f3fe40cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:15.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe8e00640 1 --2- 172.21.15.55:0/1024101635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fe4099750 0x7f3fe40cea60 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4073650 tx=0x7f3fdc01c3f0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe8e00640 1 -- 172.21.15.55:0/1024101635 shutdown_connections 2024-04-02T07:24:15.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe8e00640 1 --2- 172.21.15.55:0/1024101635 >> v2:172.21.15.106:3300/0 conn(0x7f3fe40b1430 0x7f3fe40afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe8e00640 1 --2- 172.21.15.55:0/1024101635 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fe4099750 0x7f3fe40cea60 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe8e00640 1 -- 172.21.15.55:0/1024101635 >> 172.21.15.55:0/1024101635 conn(0x7f3fe40b2210 msgr2=0x7f3fe40b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:15.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe8e00640 1 -- 172.21.15.55:0/1024101635 shutdown_connections 2024-04-02T07:24:15.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe8e00640 1 -- 172.21.15.55:0/1024101635 wait complete. 2024-04-02T07:24:15.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe8e00640 1 Processor -- start 2024-04-02T07:24:15.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe8e00640 1 -- start start 2024-04-02T07:24:15.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe8e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3fe4098a10 0x7f3fe415edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe8e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3fe4099750 0x7f3fe4156930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe8e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fe40b1430 0x7f3fe4156e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe8e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe415f2f0 con 0x7f3fe40b1430 2024-04-02T07:24:15.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe8e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40c8fc0 con 0x7f3fe4099750 2024-04-02T07:24:15.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe8e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe40c92a0 con 0x7f3fe4098a10 2024-04-02T07:24:15.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe2800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fe40b1430 0x7f3fe4156e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe2800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fe40b1430 0x7f3fe4156e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54048/0 (socket says 172.21.15.55:54048) 2024-04-02T07:24:15.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe2800640 1 -- 172.21.15.55:0/3308317724 learned_addr learned my addr 172.21.15.55:0/3308317724 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:15.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fd9400640 1 --2- 172.21.15.55:0/3308317724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3fe4099750 0x7f3fe4156930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe1e00640 1 --2- 172.21.15.55:0/3308317724 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3fe4098a10 0x7f3fe415edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe2800640 1 -- 172.21.15.55:0/3308317724 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3fe4098a10 msgr2=0x7f3fe415edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:15.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe2800640 1 --2- 172.21.15.55:0/3308317724 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3fe4098a10 0x7f3fe415edb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe2800640 1 -- 172.21.15.55:0/3308317724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3fe4099750 msgr2=0x7f3fe4156930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:15.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.514+0000 7f3fe2800640 1 --2- 172.21.15.55:0/3308317724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3fe4099750 0x7f3fe4156930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.518+0000 7f3fe2800640 1 -- 172.21.15.55:0/3308317724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fdc009420 con 0x7f3fe40b1430 2024-04-02T07:24:15.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.518+0000 7f3fd9400640 1 --2- 172.21.15.55:0/3308317724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3fe4099750 0x7f3fe4156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:15.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.518+0000 7f3fe2800640 1 --2- 172.21.15.55:0/3308317724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fe40b1430 0x7f3fe4156e70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc0ad040 tx=0x7f3fdc01ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:15.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.518+0000 7f3fdaa00640 1 -- 172.21.15.55:0/3308317724 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0b5810 con 0x7f3fe40b1430 2024-04-02T07:24:15.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.518+0000 7f3fdaa00640 1 -- 172.21.15.55:0/3308317724 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fdc0b5970 con 0x7f3fe40b1430 2024-04-02T07:24:15.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.518+0000 7f3fdaa00640 1 -- 172.21.15.55:0/3308317724 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc0b5d00 con 0x7f3fe40b1430 2024-04-02T07:24:15.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.518+0000 7f3fe8e00640 1 -- 172.21.15.55:0/3308317724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe40c9580 con 0x7f3fe40b1430 2024-04-02T07:24:15.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.518+0000 7f3fe8e00640 1 -- 172.21.15.55:0/3308317724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe40c9b40 con 0x7f3fe40b1430 2024-04-02T07:24:15.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.518+0000 7f3fe8e00640 1 -- 172.21.15.55:0/3308317724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe4066c90 con 0x7f3fe40b1430 2024-04-02T07:24:15.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.518+0000 7f3fdaa00640 1 -- 172.21.15.55:0/3308317724 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3fdc0bf410 con 0x7f3fe40b1430 2024-04-02T07:24:15.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.518+0000 7f3fdaa00640 1 --2- 172.21.15.55:0/3308317724 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3fc0066690 0x7f3fc0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.518+0000 7f3fdaa00640 1 -- 172.21.15.55:0/3308317724 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3fdc0a8050 con 0x7f3fe40b1430 2024-04-02T07:24:15.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.518+0000 7f3fe1e00640 1 --2- 172.21.15.55:0/3308317724 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3fc0066690 0x7f3fc0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.522+0000 7f3fe1e00640 1 --2- 172.21.15.55:0/3308317724 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3fc0066690 0x7f3fc0068b50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40011f0 tx=0x7f3fd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:15.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.522+0000 7f3fdaa00640 1 -- 172.21.15.55:0/3308317724 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3fdc0ec130 con 0x7f3fe40b1430 2024-04-02T07:24:15.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.686+0000 7f3fe8e00640 1 -- 172.21.15.55:0/3308317724 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fe40b3020 con 0x7f3fe40b1430 2024-04-02T07:24:15.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.690+0000 7f3fdaa00640 1 -- 172.21.15.55:0/3308317724 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16045 (secure 0 0 0) 0x7f3fdc0b5e60 con 0x7f3fe40b1430 2024-04-02T07:24:15.692 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:15.692 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":46,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:24:12.932095+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:24:10.453515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-02T07:24:10.908188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:24:15.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.690+0000 7f3fe8e00640 1 -- 172.21.15.55:0/3308317724 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3fc0066690 msgr2=0x7f3fc0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:15.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.690+0000 7f3fe8e00640 1 --2- 172.21.15.55:0/3308317724 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3fc0066690 0x7f3fc0068b50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3fd40011f0 tx=0x7f3fd4009040 comp rx=0 tx=0).stop 2024-04-02T07:24:15.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.690+0000 7f3fe8e00640 1 -- 172.21.15.55:0/3308317724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fe40b1430 msgr2=0x7f3fe4156e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:15.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.690+0000 7f3fe8e00640 1 --2- 172.21.15.55:0/3308317724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fe40b1430 0x7f3fe4156e70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc0ad040 tx=0x7f3fdc01ac30 comp rx=0 tx=0).stop 2024-04-02T07:24:15.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.690+0000 7f3fe8e00640 1 -- 172.21.15.55:0/3308317724 shutdown_connections 2024-04-02T07:24:15.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.690+0000 7f3fe8e00640 1 --2- 172.21.15.55:0/3308317724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3fe40b1430 0x7f3fe4156e70 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.690+0000 7f3fe8e00640 1 --2- 172.21.15.55:0/3308317724 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3fc0066690 0x7f3fc0068b50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.690+0000 7f3fe8e00640 1 --2- 172.21.15.55:0/3308317724 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3fe4099750 0x7f3fe4156930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.690+0000 7f3fe8e00640 1 --2- 172.21.15.55:0/3308317724 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3fe4098a10 0x7f3fe415edb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.690+0000 7f3fe8e00640 1 -- 172.21.15.55:0/3308317724 >> 172.21.15.55:0/3308317724 conn(0x7f3fe40b2210 msgr2=0x7f3fe4165210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:15.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.690+0000 7f3fe8e00640 1 -- 172.21.15.55:0/3308317724 shutdown_connections 2024-04-02T07:24:15.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.690+0000 7f3fe8e00640 1 -- 172.21.15.55:0/3308317724 wait complete. 2024-04-02T07:24:15.714 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-02T07:24:15.714 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:24:15.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.850+0000 7f3e9b200640 1 Processor -- start 2024-04-02T07:24:15.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.850+0000 7f3e9b200640 1 -- start start 2024-04-02T07:24:15.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.850+0000 7f3e9b200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3e9c0d0050 0x7f3e9c099120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.850+0000 7f3e9b200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e9c0af460 con 0x7f3e9c15ff90 2024-04-02T07:24:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.850+0000 7f3e9b200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e9c0cf0f0 con 0x7f3e9c0cadf0 2024-04-02T07:24:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.850+0000 7f3e9b200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e9c0af690 con 0x7f3e9c0d0050 2024-04-02T07:24:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.850+0000 7f3e99e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3e9c15ff90 0x7f3e9c098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48180/0 (socket says 172.21.15.55:48180) 2024-04-02T07:24:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.850+0000 7f3e99e00640 1 -- 172.21.15.55:0/3453044484 learned_addr learned my addr 172.21.15.55:0/3453044484 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e93e00640 1 --2- 172.21.15.55:0/3453044484 >> v2:172.21.15.106:3300/0 conn(0x7f3e9c0d0050 0x7f3e9c099120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e99400640 1 -- 172.21.15.55:0/3453044484 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3588842114 0 0) 0x7f3e9c0af460 con 0x7f3e9c15ff90 2024-04-02T07:24:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e99400640 1 -- 172.21.15.55:0/3453044484 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e80003530 con 0x7f3e9c15ff90 2024-04-02T07:24:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e99400640 1 -- 172.21.15.55:0/3453044484 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3707421400 0 0) 0x7f3e80003530 con 0x7f3e9c15ff90 2024-04-02T07:24:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e99400640 1 -- 172.21.15.55:0/3453044484 >> v2:172.21.15.106:3300/0 conn(0x7f3e9c0d0050 msgr2=0x7f3e9c099120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e99400640 1 --2- 172.21.15.55:0/3453044484 >> v2:172.21.15.106:3300/0 conn(0x7f3e9c0d0050 0x7f3e9c099120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e99400640 1 -- 172.21.15.55:0/3453044484 >> v1:172.21.15.106:6789/0 conn(0x7f3e9c0cadf0 legacy=0x7f3e9c0cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:15.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e99400640 1 -- 172.21.15.55:0/3453044484 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9c0cf3b0 con 0x7f3e9c15ff90 2024-04-02T07:24:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e99400640 1 -- 172.21.15.55:0/3453044484 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f3e8c001680 con 0x7f3e9c15ff90 2024-04-02T07:24:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e99400640 1 -- 172.21.15.55:0/3453044484 >> v1:172.21.15.55:6789/0 conn(0x7f3e9c15ff90 legacy=0x7f3e9c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e99400640 1 --2- 172.21.15.55:0/3453044484 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e80003980 0x7f3e80003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e99400640 1 --2- 172.21.15.55:0/3453044484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e800047d0 0x7f3e80004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e99400640 1 --2- 172.21.15.55:0/3453044484 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e80005190 0x7f3e8000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e99400640 1 -- 172.21.15.55:0/3453044484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c0af690 con 0x7f3e800047d0 2024-04-02T07:24:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e99400640 1 -- 172.21.15.55:0/3453044484 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8000c030 con 0x7f3e80003980 2024-04-02T07:24:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e99400640 1 -- 172.21.15.55:0/3453044484 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e8000c1f0 con 0x7f3e80005190 2024-04-02T07:24:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e93e00640 1 --2- 172.21.15.55:0/3453044484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e800047d0 0x7f3e80004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e99e00640 1 --2- 172.21.15.55:0/3453044484 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e80003980 0x7f3e80003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e9a800640 1 --2- 172.21.15.55:0/3453044484 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e80005190 0x7f3e8000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e93e00640 1 -- 172.21.15.55:0/3453044484 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e80005190 msgr2=0x7f3e8000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e93e00640 1 --2- 172.21.15.55:0/3453044484 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e80005190 0x7f3e8000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e93e00640 1 -- 172.21.15.55:0/3453044484 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e80003980 msgr2=0x7f3e80003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:15.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e93e00640 1 --2- 172.21.15.55:0/3453044484 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e80003980 0x7f3e80003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e93e00640 1 -- 172.21.15.55:0/3453044484 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e80003530 con 0x7f3e800047d0 2024-04-02T07:24:15.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e9a800640 1 --2- 172.21.15.55:0/3453044484 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e80005190 0x7f3e8000b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:15.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.854+0000 7f3e9a800640 1 -- 172.21.15.55:0/3453044484 reap_dead start 2024-04-02T07:24:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.858+0000 7f3e93e00640 1 --2- 172.21.15.55:0/3453044484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e800047d0 0x7f3e80004c50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009ae0 tx=0x7f3e8401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8c87ad600d2d52f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.858+0000 7f3e99400640 1 -- 172.21.15.55:0/3453044484 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e840a6460 con 0x7f3e800047d0 2024-04-02T07:24:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.858+0000 7f3e99400640 1 -- 172.21.15.55:0/3453044484 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e840a65c0 con 0x7f3e800047d0 2024-04-02T07:24:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.858+0000 7f3e99400640 1 -- 172.21.15.55:0/3453044484 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e840a6970 con 0x7f3e800047d0 2024-04-02T07:24:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.858+0000 7f3e9b200640 1 -- 172.21.15.55:0/3453044484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e800047d0 msgr2=0x7f3e80004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.858+0000 7f3e9b200640 1 --2- 172.21.15.55:0/3453044484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e800047d0 0x7f3e80004c50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009ae0 tx=0x7f3e8401ca70 comp rx=0 tx=0).stop 2024-04-02T07:24:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.858+0000 7f3e9b200640 1 -- 172.21.15.55:0/3453044484 shutdown_connections 2024-04-02T07:24:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.858+0000 7f3e9b200640 1 --2- 172.21.15.55:0/3453044484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e800047d0 0x7f3e80004c50 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.858+0000 7f3e9b200640 1 -- 172.21.15.55:0/3453044484 >> 172.21.15.55:0/3453044484 conn(0x7f3e9c0b1fb0 msgr2=0x7f3e9c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.858+0000 7f3e9b200640 1 -- 172.21.15.55:0/3453044484 shutdown_connections 2024-04-02T07:24:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.858+0000 7f3e9b200640 1 -- 172.21.15.55:0/3453044484 wait complete. 2024-04-02T07:24:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.858+0000 7f3e9b200640 1 Processor -- start 2024-04-02T07:24:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.858+0000 7f3e9b200640 1 -- start start 2024-04-02T07:24:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.858+0000 7f3e9b200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e800047d0 0x7f3e9c15b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.858+0000 7f3e9b200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e9c0b15d0 0x7f3e9c159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.858+0000 7f3e9b200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e9c0cd420 0x7f3e9c0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.858+0000 7f3e9b200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c0cdde0 con 0x7f3e9c0b15d0 2024-04-02T07:24:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.858+0000 7f3e9b200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c0afce0 con 0x7f3e800047d0 2024-04-02T07:24:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.858+0000 7f3e9b200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e9c0affc0 con 0x7f3e9c0cd420 2024-04-02T07:24:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.858+0000 7f3e93e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e9c0b15d0 0x7f3e9c159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.862+0000 7f3e93e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e9c0b15d0 0x7f3e9c159c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33472/0 (socket says 172.21.15.55:33472) 2024-04-02T07:24:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.862+0000 7f3e93e00640 1 -- 172.21.15.55:0/1234682232 learned_addr learned my addr 172.21.15.55:0/1234682232 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.862+0000 7f3e9a800640 1 --2- 172.21.15.55:0/1234682232 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e9c0cd420 0x7f3e9c0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.862+0000 7f3e99e00640 1 --2- 172.21.15.55:0/1234682232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e800047d0 0x7f3e9c15b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.862+0000 7f3e93e00640 1 -- 172.21.15.55:0/1234682232 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e9c0cd420 msgr2=0x7f3e9c0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.862+0000 7f3e93e00640 1 --2- 172.21.15.55:0/1234682232 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e9c0cd420 0x7f3e9c0cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.862+0000 7f3e93e00640 1 -- 172.21.15.55:0/1234682232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e800047d0 msgr2=0x7f3e9c15b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.862+0000 7f3e93e00640 1 --2- 172.21.15.55:0/1234682232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e800047d0 0x7f3e9c15b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.862+0000 7f3e93e00640 1 -- 172.21.15.55:0/1234682232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e9c0b02a0 con 0x7f3e9c0b15d0 2024-04-02T07:24:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.862+0000 7f3e99e00640 1 --2- 172.21.15.55:0/1234682232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e800047d0 0x7f3e9c15b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.862+0000 7f3e93e00640 1 --2- 172.21.15.55:0/1234682232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e9c0b15d0 0x7f3e9c159c70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009ae0 tx=0x7f3e84019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.862+0000 7f3e92000640 1 -- 172.21.15.55:0/1234682232 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e840a6e30 con 0x7f3e9c0b15d0 2024-04-02T07:24:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.862+0000 7f3e92000640 1 -- 172.21.15.55:0/1234682232 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e840a7440 con 0x7f3e9c0b15d0 2024-04-02T07:24:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.862+0000 7f3e9b200640 1 -- 172.21.15.55:0/1234682232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e9c0b0580 con 0x7f3e9c0b15d0 2024-04-02T07:24:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.862+0000 7f3e92000640 1 -- 172.21.15.55:0/1234682232 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e840a77d0 con 0x7f3e9c0b15d0 2024-04-02T07:24:15.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.862+0000 7f3e9b200640 1 -- 172.21.15.55:0/1234682232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9c0af970 con 0x7f3e9c0b15d0 2024-04-02T07:24:15.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.862+0000 7f3e9b200640 1 -- 172.21.15.55:0/1234682232 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9c073fa0 con 0x7f3e9c0b15d0 2024-04-02T07:24:15.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.862+0000 7f3e92000640 1 -- 172.21.15.55:0/1234682232 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3e840a7930 con 0x7f3e9c0b15d0 2024-04-02T07:24:15.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.862+0000 7f3e92000640 1 --2- 172.21.15.55:0/1234682232 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3e780666c0 0x7f3e78068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:15.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.862+0000 7f3e92000640 1 -- 172.21.15.55:0/1234682232 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e8411de10 con 0x7f3e9c0b15d0 2024-04-02T07:24:15.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.866+0000 7f3e99e00640 1 --2- 172.21.15.55:0/1234682232 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3e780666c0 0x7f3e78068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:15.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.866+0000 7f3e99e00640 1 --2- 172.21.15.55:0/1234682232 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3e780666c0 0x7f3e78068b80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c007cc0 tx=0x7f3e8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:15.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:15.866+0000 7f3e92000640 1 -- 172.21.15.55:0/1234682232 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3e84121030 con 0x7f3e9c0b15d0 2024-04-02T07:24:16.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.030+0000 7f3e9b200640 1 -- 172.21.15.55:0/1234682232 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3e9c0b0130 con 0x7f3e780666c0 2024-04-02T07:24:16.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.038+0000 7f3e92000640 1 -- 172.21.15.55:0/1234682232 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277783 (secure 0 0 0) 0x7f3e9c0b0130 con 0x7f3e780666c0 2024-04-02T07:24:16.045 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:16.046 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:24:16.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.042+0000 7f3e9b200640 1 -- 172.21.15.55:0/1234682232 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3e780666c0 msgr2=0x7f3e78068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.042+0000 7f3e9b200640 1 --2- 172.21.15.55:0/1234682232 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3e780666c0 0x7f3e78068b80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c007cc0 tx=0x7f3e8c009040 comp rx=0 tx=0).stop 2024-04-02T07:24:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.042+0000 7f3e9b200640 1 -- 172.21.15.55:0/1234682232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e9c0b15d0 msgr2=0x7f3e9c159c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.042+0000 7f3e9b200640 1 --2- 172.21.15.55:0/1234682232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e9c0b15d0 0x7f3e9c159c70 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f3e84009ae0 tx=0x7f3e84019810 comp rx=0 tx=0).stop 2024-04-02T07:24:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.042+0000 7f3e9b200640 1 -- 172.21.15.55:0/1234682232 shutdown_connections 2024-04-02T07:24:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.042+0000 7f3e9b200640 1 --2- 172.21.15.55:0/1234682232 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e9c0cd420 0x7f3e9c0cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.042+0000 7f3e9b200640 1 --2- 172.21.15.55:0/1234682232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e9c0b15d0 0x7f3e9c159c70 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.042+0000 7f3e9b200640 1 --2- 172.21.15.55:0/1234682232 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3e780666c0 0x7f3e78068b80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.042+0000 7f3e9b200640 1 --2- 172.21.15.55:0/1234682232 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e800047d0 0x7f3e9c15b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.042+0000 7f3e9b200640 1 -- 172.21.15.55:0/1234682232 >> 172.21.15.55:0/1234682232 conn(0x7f3e9c0b1fb0 msgr2=0x7f3e9c15e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.042+0000 7f3e9b200640 1 -- 172.21.15.55:0/1234682232 shutdown_connections 2024-04-02T07:24:16.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.042+0000 7f3e9b200640 1 -- 172.21.15.55:0/1234682232 wait complete. 2024-04-02T07:24:16.065 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":103,"stamp":"2024-04-02T07:24:14.360290+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":237632,"kb_used_data":5072,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754737088,"statfs":{"total":773094113280,"available":772850778112,"internally_reserved":0,"allocated":5193728,"data_stored":2777582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000976"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.511543+0000","last_change":"2024-04-02T07:24:10.511543+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.511543+0000","last_undegraded":"2024-04-02T07:24:10.511543+0000","last_fullsized":"2024-04-02T07:24:10.511543+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:00:31.241815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.516293+0000","last_change":"2024-04-02T07:24:10.516293+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.516293+0000","last_undegraded":"2024-04-02T07:24:10.516293+0000","last_fullsized":"2024-04-02T07:24:10.516293+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:20:10.281531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512337+0000","last_change":"2024-04-02T07:24:10.512337+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512337+0000","last_undegraded":"2024-04-02T07:24:10.512337+0000","last_fullsized":"2024-04-02T07:24:10.512337+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:05:52.333856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.513927+0000","last_change":"2024-04-02T07:24:10.513927+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.513927+0000","last_undegraded":"2024-04-02T07:24:10.513927+0000","last_fullsized":"2024-04-02T07:24:10.513927+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:14:08.858057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512563+0000","last_change":"2024-04-02T07:24:10.512563+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512563+0000","last_undegraded":"2024-04-02T07:24:10.512563+0000","last_fullsized":"2024-04-02T07:24:10.512563+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:12:21.124664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.516499+0000","last_change":"2024-04-02T07:24:10.516499+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.516499+0000","last_undegraded":"2024-04-02T07:24:10.516499+0000","last_fullsized":"2024-04-02T07:24:10.516499+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:50:14.697045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512279+0000","last_change":"2024-04-02T07:24:10.512279+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512279+0000","last_undegraded":"2024-04-02T07:24:10.512279+0000","last_fullsized":"2024-04-02T07:24:10.512279+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:18:59.945527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.509876+0000","last_change":"2024-04-02T07:24:10.509876+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.509876+0000","last_undegraded":"2024-04-02T07:24:10.509876+0000","last_fullsized":"2024-04-02T07:24:10.509876+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:54:03.635207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.515953+0000","last_change":"2024-04-02T07:24:10.515953+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.515953+0000","last_undegraded":"2024-04-02T07:24:10.515953+0000","last_fullsized":"2024-04-02T07:24:10.515953+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:56:10.784349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.509424+0000","last_change":"2024-04-02T07:24:10.509424+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.509424+0000","last_undegraded":"2024-04-02T07:24:10.509424+0000","last_fullsized":"2024-04-02T07:24:10.509424+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:18:20.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.514857+0000","last_change":"2024-04-02T07:24:10.514857+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.514857+0000","last_undegraded":"2024-04-02T07:24:10.514857+0000","last_fullsized":"2024-04-02T07:24:10.514857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:55:23.427125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.517980+0000","last_change":"2024-04-02T07:24:10.517980+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.517980+0000","last_undegraded":"2024-04-02T07:24:10.517980+0000","last_fullsized":"2024-04-02T07:24:10.517980+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:15:57.473214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512166+0000","last_change":"2024-04-02T07:24:10.512166+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512166+0000","last_undegraded":"2024-04-02T07:24:10.512166+0000","last_fullsized":"2024-04-02T07:24:10.512166+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:05:42.639900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.514265+0000","last_change":"2024-04-02T07:24:10.514265+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.514265+0000","last_undegraded":"2024-04-02T07:24:10.514265+0000","last_fullsized":"2024-04-02T07:24:10.514265+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:00:31.241815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.511643+0000","last_change":"2024-04-02T07:24:10.511643+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.511643+0000","last_undegraded":"2024-04-02T07:24:10.511643+0000","last_fullsized":"2024-04-02T07:24:10.511643+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:14:08.858057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.509418+0000","last_change":"2024-04-02T07:24:10.509418+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.509418+0000","last_undegraded":"2024-04-02T07:24:10.509418+0000","last_fullsized":"2024-04-02T07:24:10.509418+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:20:10.281531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.518359+0000","last_change":"2024-04-02T07:24:10.518359+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.518359+0000","last_undegraded":"2024-04-02T07:24:10.518359+0000","last_fullsized":"2024-04-02T07:24:10.518359+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:33:20.814250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.515570+0000","last_change":"2024-04-02T07:24:10.515570+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.515570+0000","last_undegraded":"2024-04-02T07:24:10.515570+0000","last_fullsized":"2024-04-02T07:24:10.515570+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:18:20.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512642+0000","last_change":"2024-04-02T07:24:10.512642+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512642+0000","last_undegraded":"2024-04-02T07:24:10.512642+0000","last_fullsized":"2024-04-02T07:24:10.512642+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:45:51.236711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.511517+0000","last_change":"2024-04-02T07:24:10.511517+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.511517+0000","last_undegraded":"2024-04-02T07:24:10.511517+0000","last_fullsized":"2024-04-02T07:24:10.511517+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:58.481260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.511572+0000","last_change":"2024-04-02T07:24:10.511572+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.511572+0000","last_undegraded":"2024-04-02T07:24:10.511572+0000","last_fullsized":"2024-04-02T07:24:10.511572+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:55:23.427125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512840+0000","last_change":"2024-04-02T07:24:10.512840+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512840+0000","last_undegraded":"2024-04-02T07:24:10.512840+0000","last_fullsized":"2024-04-02T07:24:10.512840+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:41:58.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.508727+0000","last_change":"2024-04-02T07:24:10.508727+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.508727+0000","last_undegraded":"2024-04-02T07:24:10.508727+0000","last_fullsized":"2024-04-02T07:24:10.508727+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:19:53.123928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.513682+0000","last_change":"2024-04-02T07:24:10.513682+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.513682+0000","last_undegraded":"2024-04-02T07:24:10.513682+0000","last_fullsized":"2024-04-02T07:24:10.513682+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:58.481260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.511454+0000","last_change":"2024-04-02T07:24:10.511454+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.511454+0000","last_undegraded":"2024-04-02T07:24:10.511454+0000","last_fullsized":"2024-04-02T07:24:10.511454+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:04:08.094127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.514408+0000","last_change":"2024-04-02T07:24:10.514408+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.514408+0000","last_undegraded":"2024-04-02T07:24:10.514408+0000","last_fullsized":"2024-04-02T07:24:10.514408+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:05:42.639900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512172+0000","last_change":"2024-04-02T07:24:10.512172+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512172+0000","last_undegraded":"2024-04-02T07:24:10.512172+0000","last_fullsized":"2024-04-02T07:24:10.512172+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:49:40.986769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.513235+0000","last_change":"2024-04-02T07:24:10.513235+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.513235+0000","last_undegraded":"2024-04-02T07:24:10.513235+0000","last_fullsized":"2024-04-02T07:24:10.513235+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:12:21.124664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.515981+0000","last_change":"2024-04-02T07:24:10.515981+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.515981+0000","last_undegraded":"2024-04-02T07:24:10.515981+0000","last_fullsized":"2024-04-02T07:24:10.515981+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:19:53.123928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512184+0000","last_change":"2024-04-02T07:24:10.512184+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512184+0000","last_undegraded":"2024-04-02T07:24:10.512184+0000","last_fullsized":"2024-04-02T07:24:10.512184+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:42:08.977549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.508727+0000","last_change":"2024-04-02T07:24:10.508727+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.508727+0000","last_undegraded":"2024-04-02T07:24:10.508727+0000","last_fullsized":"2024-04-02T07:24:10.508727+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:30:39.543249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512493+0000","last_change":"2024-04-02T07:24:10.512493+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512493+0000","last_undegraded":"2024-04-02T07:24:10.512493+0000","last_fullsized":"2024-04-02T07:24:10.512493+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:11:13.000802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-02T07:24:10.513949+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:24:10.513949+0000","last_peered":"2024-04-02T07:24:10.513949+0000","last_clean":"2024-04-02T07:24:10.513949+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:24:10.513949+0000","last_undegraded":"2024-04-02T07:24:10.513949+0000","last_fullsized":"2024-04-02T07:24:10.513949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1085440,"data_stored":785611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64200000000000002,"15min":0.64100000000000001},"min":{"1min":0.441,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88300000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.501},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.60999999999999999,"15min":0.59799999999999998},"min":{"1min":0.48299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.64300000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.628,"15min":0.624},"min":{"1min":0.436,"5min":0.379,"15min":0.379},"max":{"1min":0.84299999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.436},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86199999999999999,"5min":1.113,"15min":1.113},"last":0.60199999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.747,"15min":0.75},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.93999999999999995,"5min":1.139,"15min":1.139},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.5,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96299999999999997,"5min":1.522,"15min":1.522},"last":0.57999999999999996}]},{"osd":3,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.50700000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92700000000000005,"5min":1.405,"15min":1.405},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72699999999999998,"15min":0.72799999999999998},"min":{"1min":0.58599999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92300000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.74399999999999999}]},{"osd":4,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68799999999999994,"15min":0.70299999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81499999999999995,"5min":1.633,"15min":1.633},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.874,"5min":1.079,"15min":1.079},"last":0.66700000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72299999999999998,"15min":0.74099999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94499999999999995,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.78700000000000003,"15min":0.79900000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95499999999999996,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.76700000000000002}]},{"osd":6,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82799999999999996,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.69799999999999995,"15min":0.71499999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82499999999999996,"5min":1,"15min":1},"last":0.626}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":201060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66200000000000003,"15min":0.66300000000000003},"min":{"1min":0.48299999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86199999999999999,"5min":1.399,"15min":1.399},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.88,"15min":0.91900000000000004},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95999999999999996,"5min":5.7569999999999997,"15min":5.7569999999999997},"last":0.56599999999999995}]},{"osd":1,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.52600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.93899999999999995,"5min":1.95,"15min":1.95},"last":0.75},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95799999999999996,"5min":1.248,"15min":1.248},"last":0.67200000000000004}]},{"osd":2,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.54900000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89300000000000002,"5min":1.226,"15min":1.226},"last":0.501},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71199999999999997,"15min":0.70999999999999996},"min":{"1min":0.55700000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.58599999999999997}]},{"osd":3,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.81000000000000005,"15min":0.82499999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.88,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.628},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.52600000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97899999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.64600000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.91000000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.76400000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.68000000000000005,"15min":0.68799999999999994},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89500000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73799999999999999,"15min":0.73999999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98999999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.80200000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.745,"15min":0.753},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93400000000000005,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.56299999999999994,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97099999999999997,"5min":0.999,"15min":0.999},"last":0.78400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":201060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86199999999999999,"5min":1.25,"15min":1.25},"last":0.622},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.70899999999999996},"min":{"1min":0.48899999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91300000000000003,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.83799999999999997}]},{"osd":1,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97399999999999998,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72499999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.97899999999999998,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.82299999999999995,"15min":0.83499999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98399999999999999,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.751},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.74299999999999999,"15min":0.752},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95699999999999996,"5min":1.696,"15min":1.696},"last":0.71199999999999997}]},{"osd":3,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.76100000000000001,"15min":0.77300000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.99099999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.82499999999999996,"15min":0.84199999999999997},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.65800000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.71599999999999997,"15min":0.74199999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90500000000000003,"5min":1.911,"15min":1.911},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.77800000000000002,"15min":0.81000000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.92400000000000004,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.86099999999999999,"15min":0.89400000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.95799999999999996,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.84599999999999997,"15min":0.878},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0269999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.76500000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.86199999999999999,"15min":0.89400000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.038,"5min":1.887,"15min":1.887},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.91300000000000003,"15min":0.94799999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.012,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.69799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":201060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.746,"15min":0.75900000000000001},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91800000000000004,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.81999999999999995,"15min":0.84999999999999998},"min":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81499999999999995,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.67100000000000004}]},{"osd":1,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76300000000000001,"15min":0.77000000000000002},"min":{"1min":0.56200000000000006,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90600000000000003,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.90800000000000003,"15min":0.94199999999999995},"min":{"1min":0.54200000000000004,"5min":0.503,"15min":0.503},"max":{"1min":0.97399999999999998,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":0.69699999999999995}]},{"osd":2,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.80400000000000005,"15min":0.81499999999999995},"min":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.93999999999999995,"5min":2.056,"15min":2.056},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.878,"15min":0.90200000000000002},"min":{"1min":0.59399999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.874,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.82499999999999996}]},{"osd":3,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.999,"15min":1.0369999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.97899999999999998,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":1.012,"15min":1.0509999999999999},"min":{"1min":0.65200000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.91700000000000004,"5min":3.9750000000000001,"15min":3.9750000000000001},"last":1.014}]},{"osd":5,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71999999999999997,"15min":0.72499999999999998},"min":{"1min":0.439,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91000000000000003,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.45800000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95499999999999996,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.0549999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":0.72999999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.085,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.123},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79300000000000004,"15min":0.79400000000000004},"min":{"1min":0.57799999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98399999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.99199999999999999}]},{"osd":7,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.026,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.68500000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.0640000000000001,"5min":1.353,"15min":1.353},"last":1.1499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":503808,"data_stored":201060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.44900000000000001,"15min":0.45400000000000001},"min":{"1min":0.26600000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56599999999999995,"5min":0.62,"15min":0.62},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.746,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.35199999999999998}]},{"osd":1,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.434,"15min":0.434},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.61399999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52300000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.374},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.65300000000000002,"5min":1.306,"15min":1.306},"last":0.496}]},{"osd":4,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.012,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98999999999999999,"5min":1.155,"15min":1.155},"last":0.79300000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77300000000000002,"15min":0.77500000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.74199999999999999,"15min":0.74399999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.038,"5min":1.135,"15min":1.135},"last":0.88300000000000001}]},{"osd":6,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0700000000000001,"5min":1.25,"15min":1.25},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.095,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.92600000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1319999999999999,"5min":1.216,"15min":1.216},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.78900000000000003,"15min":0.79600000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.046,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.81299999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":491520,"data_stored":195243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57399999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47999999999999998,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.42199999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80800000000000005,"5min":1.171,"15min":1.171},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48799999999999999,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64500000000000002,"5min":1.333,"15min":1.333},"last":0.48899999999999999}]},{"osd":3,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51700000000000002,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72099999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.39900000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.76400000000000001,"15min":0.77400000000000002},"min":{"1min":0.47699999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0109999999999999,"5min":2.254,"15min":2.254},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76500000000000001,"15min":0.76600000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.016,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.73199999999999998}]},{"osd":5,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.52600000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.80900000000000005,"15min":0.81799999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.093,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.85899999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.61099999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0369999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.82099999999999995,"15min":0.82399999999999995},"min":{"1min":0.62,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.105,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.77600000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0549999999999999,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82399999999999995,"15min":0.82799999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0629999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.69399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":503808,"data_stored":201060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.254,"5min":0.251,"15min":0.251},"max":{"1min":0.60399999999999998,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.501},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.65300000000000002,"15min":0.67500000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.093,"5min":4.157,"15min":4.157},"last":0.26200000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.65600000000000003,"15min":0.69199999999999995},"min":{"1min":0.32700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68500000000000005,"5min":4.282,"15min":4.282},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79500000000000004,"5min":1.625,"15min":1.625},"last":0.55800000000000005}]},{"osd":3,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60999999999999999,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72099999999999997,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.91100000000000003,"15min":0.97199999999999998},"min":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.052,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.38400000000000001}]},{"osd":4,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.96599999999999997,"15min":1.006},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0900000000000001,"5min":4.7400000000000002,"15min":4.7400000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.82799999999999996,"15min":0.83999999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.99199999999999999,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.624}]},{"osd":5,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.95899999999999996,"15min":0.98199999999999998},"min":{"1min":0.53900000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.163,"5min":4.5759999999999996,"15min":4.5759999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.95499999999999996,"15min":0.98699999999999999},"min":{"1min":0.48999999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0089999999999999,"5min":4.7949999999999999,"15min":4.7949999999999999},"last":0.48999999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":1.0029999999999999,"15min":1.0389999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.129,"5min":4.6890000000000001,"15min":4.6890000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.97299999999999998,"15min":1.01},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0620000000000001,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.52100000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.83799999999999997,"15min":0.84999999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0069999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.98799999999999999,"15min":1.0129999999999999},"min":{"1min":0.55800000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.383,"5min":4.6420000000000003,"15min":4.6420000000000003},"last":0.58599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1097728,"data_stored":791428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.47399999999999998,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.622,"5min":1.48,"15min":1.48},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.51000000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74399999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.39900000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.34000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79100000000000004,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51900000000000002,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.434}]},{"osd":3,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.32600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.56999999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.61899999999999999,"15min":0.63100000000000001},"min":{"1min":0.41799999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.69899999999999995,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.47799999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.90600000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.53700000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.68400000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.78900000000000003,"15min":0.79900000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94099999999999995,"5min":1.371,"15min":1.371},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.97899999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.58799999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.018,"5min":1.177,"15min":1.177},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.83499999999999996,"15min":0.84899999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.002,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.622}]},{"osd":7,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.56299999999999994,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.069,"5min":1.135,"15min":1.135},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.92400000000000004,"5min":1.141,"15min":1.141},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:24:16.070 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:24:16.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.242+0000 7f31bf400640 1 Processor -- start 2024-04-02T07:24:16.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.242+0000 7f31bf400640 1 -- start start 2024-04-02T07:24:16.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.242+0000 7f31bf400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f31b80b16e0 0x7f31b80b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:16.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.242+0000 7f31bf400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f31b80b11f0 0x7f31b8098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:16.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.242+0000 7f31bf400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31b80d01d0 con 0x7f31b80cfdf0 2024-04-02T07:24:16.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.242+0000 7f31bf400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b806c0e0 con 0x7f31b80b11f0 2024-04-02T07:24:16.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.242+0000 7f31bf400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31b80b01d0 con 0x7f31b80b16e0 2024-04-02T07:24:16.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.242+0000 7f31bd400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f31b80b11f0 0x7f31b8098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:16.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.242+0000 7f31bd400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f31b80b11f0 0x7f31b8098a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33482/0 (socket says 172.21.15.55:33482) 2024-04-02T07:24:16.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.242+0000 7f31bd400640 1 -- 172.21.15.55:0/1767319187 learned_addr learned my addr 172.21.15.55:0/1767319187 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:16.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.242+0000 7f31b7e00640 1 --2- 172.21.15.55:0/1767319187 >> v2:172.21.15.106:3300/0 conn(0x7f31b80b16e0 0x7f31b80b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:16.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.246+0000 7f31bd400640 1 -- 172.21.15.55:0/1767319187 >> v2:172.21.15.106:3300/0 conn(0x7f31b80b16e0 msgr2=0x7f31b80b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:16.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.246+0000 7f31bd400640 1 --2- 172.21.15.55:0/1767319187 >> v2:172.21.15.106:3300/0 conn(0x7f31b80b16e0 0x7f31b80b0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.246+0000 7f31bd400640 1 -- 172.21.15.55:0/1767319187 >> v1:172.21.15.106:6789/0 conn(0x7f31b80cfdf0 legacy=0x7f31b806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:16.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.246+0000 7f31bd400640 1 -- 172.21.15.55:0/1767319187 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b80b04b0 con 0x7f31b80b11f0 2024-04-02T07:24:16.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.246+0000 7f31bd400640 1 --2- 172.21.15.55:0/1767319187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80b11f0 0x7f31b8098a10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f31b80b32f0 tx=0x7f31b001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c72fd87712fc85 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:16.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.246+0000 7f31b7400640 1 -- 172.21.15.55:0/1767319187 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b00a5790 con 0x7f31b80b11f0 2024-04-02T07:24:16.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.246+0000 7f31b7400640 1 -- 172.21.15.55:0/1767319187 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b00a58f0 con 0x7f31b80b11f0 2024-04-02T07:24:16.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.246+0000 7f31b7400640 1 -- 172.21.15.55:0/1767319187 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b00a5c80 con 0x7f31b80b11f0 2024-04-02T07:24:16.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.246+0000 7f31bf400640 1 -- 172.21.15.55:0/1767319187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80b11f0 msgr2=0x7f31b8098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:16.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.246+0000 7f31bf400640 1 --2- 172.21.15.55:0/1767319187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80b11f0 0x7f31b8098a10 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f31b80b32f0 tx=0x7f31b001c9c0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.246+0000 7f31bf400640 1 -- 172.21.15.55:0/1767319187 shutdown_connections 2024-04-02T07:24:16.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.246+0000 7f31bf400640 1 --2- 172.21.15.55:0/1767319187 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80b11f0 0x7f31b8098a10 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.246+0000 7f31bf400640 1 --2- 172.21.15.55:0/1767319187 >> v2:172.21.15.106:3300/0 conn(0x7f31b80b16e0 0x7f31b80b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bf400640 1 -- 172.21.15.55:0/1767319187 >> 172.21.15.55:0/1767319187 conn(0x7f31b80b2210 msgr2=0x7f31b80b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:16.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bf400640 1 -- 172.21.15.55:0/1767319187 shutdown_connections 2024-04-02T07:24:16.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bf400640 1 -- 172.21.15.55:0/1767319187 wait complete. 2024-04-02T07:24:16.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bf400640 1 Processor -- start 2024-04-02T07:24:16.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bf400640 1 -- start start 2024-04-02T07:24:16.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bf400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31b80b11f0 0x7f31b8154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:16.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bf400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31b80b16e0 0x7f31b8157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:16.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bf400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80cfdf0 0x7f31b806f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:16.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bf400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b80c5b60 con 0x7f31b80cfdf0 2024-04-02T07:24:16.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bf400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b80c47d0 con 0x7f31b80b11f0 2024-04-02T07:24:16.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bf400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31b80c4ab0 con 0x7f31b80b16e0 2024-04-02T07:24:16.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bd400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80cfdf0 0x7f31b806f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:16.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bd400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80cfdf0 0x7f31b806f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33486/0 (socket says 172.21.15.55:33486) 2024-04-02T07:24:16.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bd400640 1 -- 172.21.15.55:0/2439809147 learned_addr learned my addr 172.21.15.55:0/2439809147 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:16.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31b7e00640 1 --2- 172.21.15.55:0/2439809147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31b80b16e0 0x7f31b8157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:16.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bca00640 1 --2- 172.21.15.55:0/2439809147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31b80b11f0 0x7f31b8154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:16.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bd400640 1 -- 172.21.15.55:0/2439809147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31b80b16e0 msgr2=0x7f31b8157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:16.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bd400640 1 --2- 172.21.15.55:0/2439809147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31b80b16e0 0x7f31b8157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bd400640 1 -- 172.21.15.55:0/2439809147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31b80b11f0 msgr2=0x7f31b8154860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:16.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bd400640 1 --2- 172.21.15.55:0/2439809147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31b80b11f0 0x7f31b8154860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bd400640 1 -- 172.21.15.55:0/2439809147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b0009b30 con 0x7f31b80cfdf0 2024-04-02T07:24:16.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31bd400640 1 --2- 172.21.15.55:0/2439809147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80cfdf0 0x7f31b806f390 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f31b00af040 tx=0x7f31b0019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:16.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.250+0000 7f31b4c00640 1 -- 172.21.15.55:0/2439809147 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b00b8470 con 0x7f31b80cfdf0 2024-04-02T07:24:16.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.254+0000 7f31b4c00640 1 -- 172.21.15.55:0/2439809147 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31b00b8610 con 0x7f31b80cfdf0 2024-04-02T07:24:16.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.254+0000 7f31b4c00640 1 -- 172.21.15.55:0/2439809147 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b00b89c0 con 0x7f31b80cfdf0 2024-04-02T07:24:16.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.254+0000 7f31bf400640 1 -- 172.21.15.55:0/2439809147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b80c4d90 con 0x7f31b80cfdf0 2024-04-02T07:24:16.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.254+0000 7f31bf400640 1 -- 172.21.15.55:0/2439809147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b8157ad0 con 0x7f31b80cfdf0 2024-04-02T07:24:16.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.254+0000 7f31bf400640 1 -- 172.21.15.55:0/2439809147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31b8066c90 con 0x7f31b80cfdf0 2024-04-02T07:24:16.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.254+0000 7f31b4c00640 1 -- 172.21.15.55:0/2439809147 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f31b00b8b20 con 0x7f31b80cfdf0 2024-04-02T07:24:16.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.254+0000 7f31b4c00640 1 --2- 172.21.15.55:0/2439809147 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3198066690 0x7f3198068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:16.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.254+0000 7f31b4c00640 1 -- 172.21.15.55:0/2439809147 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31b011f550 con 0x7f31b80cfdf0 2024-04-02T07:24:16.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.254+0000 7f31bca00640 1 --2- 172.21.15.55:0/2439809147 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3198066690 0x7f3198068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:16.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.254+0000 7f31bca00640 1 --2- 172.21.15.55:0/2439809147 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3198066690 0x7f3198068b50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f31b80c5ae0 tx=0x7f31ac009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:16.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.258+0000 7f31b4c00640 1 -- 172.21.15.55:0/2439809147 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f31b00eca80 con 0x7f31b80cfdf0 2024-04-02T07:24:16.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.414+0000 7f31bf400640 1 -- 172.21.15.55:0/2439809147 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f31b80b3020 con 0x7f3198066690 2024-04-02T07:24:16.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.422+0000 7f31b4c00640 1 -- 172.21.15.55:0/2439809147 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277783 (secure 0 0 0) 0x7f31b80b3020 con 0x7f3198066690 2024-04-02T07:24:16.430 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:16.432 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:24:16.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.426+0000 7f31bf400640 1 -- 172.21.15.55:0/2439809147 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3198066690 msgr2=0x7f3198068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:16.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.426+0000 7f31bf400640 1 --2- 172.21.15.55:0/2439809147 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3198066690 0x7f3198068b50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f31b80c5ae0 tx=0x7f31ac009040 comp rx=0 tx=0).stop 2024-04-02T07:24:16.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.426+0000 7f31bf400640 1 -- 172.21.15.55:0/2439809147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80cfdf0 msgr2=0x7f31b806f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:16.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.426+0000 7f31bf400640 1 --2- 172.21.15.55:0/2439809147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80cfdf0 0x7f31b806f390 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f31b00af040 tx=0x7f31b0019760 comp rx=0 tx=0).stop 2024-04-02T07:24:16.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.426+0000 7f31bf400640 1 -- 172.21.15.55:0/2439809147 shutdown_connections 2024-04-02T07:24:16.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.426+0000 7f31bf400640 1 --2- 172.21.15.55:0/2439809147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f31b80cfdf0 0x7f31b806f390 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.426+0000 7f31bf400640 1 --2- 172.21.15.55:0/2439809147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f31b80b16e0 0x7f31b8157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.426+0000 7f31bf400640 1 --2- 172.21.15.55:0/2439809147 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3198066690 0x7f3198068b50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.426+0000 7f31bf400640 1 --2- 172.21.15.55:0/2439809147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f31b80b11f0 0x7f31b8154860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.426+0000 7f31bf400640 1 -- 172.21.15.55:0/2439809147 >> 172.21.15.55:0/2439809147 conn(0x7f31b80b2210 msgr2=0x7f31b80af250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:16.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.426+0000 7f31bf400640 1 -- 172.21.15.55:0/2439809147 shutdown_connections 2024-04-02T07:24:16.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.426+0000 7f31bf400640 1 -- 172.21.15.55:0/2439809147 wait complete. 2024-04-02T07:24:16.449 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-04-02T07:24:16.360706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":237632,"kb_used_data":5072,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754737088,"statfs":{"total":773094113280,"available":772850778112,"internally_reserved":0,"allocated":5193728,"data_stored":2777582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.850013"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.511543+0000","last_change":"2024-04-02T07:24:10.511543+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.511543+0000","last_undegraded":"2024-04-02T07:24:10.511543+0000","last_fullsized":"2024-04-02T07:24:10.511543+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:00:31.241815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.516293+0000","last_change":"2024-04-02T07:24:10.516293+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.516293+0000","last_undegraded":"2024-04-02T07:24:10.516293+0000","last_fullsized":"2024-04-02T07:24:10.516293+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:20:10.281531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512337+0000","last_change":"2024-04-02T07:24:10.512337+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512337+0000","last_undegraded":"2024-04-02T07:24:10.512337+0000","last_fullsized":"2024-04-02T07:24:10.512337+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:05:52.333856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.513927+0000","last_change":"2024-04-02T07:24:10.513927+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.513927+0000","last_undegraded":"2024-04-02T07:24:10.513927+0000","last_fullsized":"2024-04-02T07:24:10.513927+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:14:08.858057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512563+0000","last_change":"2024-04-02T07:24:10.512563+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512563+0000","last_undegraded":"2024-04-02T07:24:10.512563+0000","last_fullsized":"2024-04-02T07:24:10.512563+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:12:21.124664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.516499+0000","last_change":"2024-04-02T07:24:10.516499+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.516499+0000","last_undegraded":"2024-04-02T07:24:10.516499+0000","last_fullsized":"2024-04-02T07:24:10.516499+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:50:14.697045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512279+0000","last_change":"2024-04-02T07:24:10.512279+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512279+0000","last_undegraded":"2024-04-02T07:24:10.512279+0000","last_fullsized":"2024-04-02T07:24:10.512279+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:18:59.945527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.509876+0000","last_change":"2024-04-02T07:24:10.509876+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.509876+0000","last_undegraded":"2024-04-02T07:24:10.509876+0000","last_fullsized":"2024-04-02T07:24:10.509876+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:54:03.635207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.515953+0000","last_change":"2024-04-02T07:24:10.515953+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.515953+0000","last_undegraded":"2024-04-02T07:24:10.515953+0000","last_fullsized":"2024-04-02T07:24:10.515953+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:56:10.784349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.509424+0000","last_change":"2024-04-02T07:24:10.509424+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.509424+0000","last_undegraded":"2024-04-02T07:24:10.509424+0000","last_fullsized":"2024-04-02T07:24:10.509424+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:18:20.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.514857+0000","last_change":"2024-04-02T07:24:10.514857+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.514857+0000","last_undegraded":"2024-04-02T07:24:10.514857+0000","last_fullsized":"2024-04-02T07:24:10.514857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:55:23.427125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.517980+0000","last_change":"2024-04-02T07:24:10.517980+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.517980+0000","last_undegraded":"2024-04-02T07:24:10.517980+0000","last_fullsized":"2024-04-02T07:24:10.517980+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:15:57.473214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512166+0000","last_change":"2024-04-02T07:24:10.512166+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512166+0000","last_undegraded":"2024-04-02T07:24:10.512166+0000","last_fullsized":"2024-04-02T07:24:10.512166+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:05:42.639900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.514265+0000","last_change":"2024-04-02T07:24:10.514265+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.514265+0000","last_undegraded":"2024-04-02T07:24:10.514265+0000","last_fullsized":"2024-04-02T07:24:10.514265+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:00:31.241815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.511643+0000","last_change":"2024-04-02T07:24:10.511643+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.511643+0000","last_undegraded":"2024-04-02T07:24:10.511643+0000","last_fullsized":"2024-04-02T07:24:10.511643+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:14:08.858057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.509418+0000","last_change":"2024-04-02T07:24:10.509418+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.509418+0000","last_undegraded":"2024-04-02T07:24:10.509418+0000","last_fullsized":"2024-04-02T07:24:10.509418+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:20:10.281531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.518359+0000","last_change":"2024-04-02T07:24:10.518359+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.518359+0000","last_undegraded":"2024-04-02T07:24:10.518359+0000","last_fullsized":"2024-04-02T07:24:10.518359+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:33:20.814250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.515570+0000","last_change":"2024-04-02T07:24:10.515570+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.515570+0000","last_undegraded":"2024-04-02T07:24:10.515570+0000","last_fullsized":"2024-04-02T07:24:10.515570+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:18:20.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512642+0000","last_change":"2024-04-02T07:24:10.512642+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512642+0000","last_undegraded":"2024-04-02T07:24:10.512642+0000","last_fullsized":"2024-04-02T07:24:10.512642+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:45:51.236711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.511517+0000","last_change":"2024-04-02T07:24:10.511517+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.511517+0000","last_undegraded":"2024-04-02T07:24:10.511517+0000","last_fullsized":"2024-04-02T07:24:10.511517+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:58.481260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.511572+0000","last_change":"2024-04-02T07:24:10.511572+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.511572+0000","last_undegraded":"2024-04-02T07:24:10.511572+0000","last_fullsized":"2024-04-02T07:24:10.511572+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:55:23.427125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512840+0000","last_change":"2024-04-02T07:24:10.512840+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512840+0000","last_undegraded":"2024-04-02T07:24:10.512840+0000","last_fullsized":"2024-04-02T07:24:10.512840+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:41:58.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.508727+0000","last_change":"2024-04-02T07:24:10.508727+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.508727+0000","last_undegraded":"2024-04-02T07:24:10.508727+0000","last_fullsized":"2024-04-02T07:24:10.508727+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:19:53.123928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.513682+0000","last_change":"2024-04-02T07:24:10.513682+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.513682+0000","last_undegraded":"2024-04-02T07:24:10.513682+0000","last_fullsized":"2024-04-02T07:24:10.513682+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:58.481260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.511454+0000","last_change":"2024-04-02T07:24:10.511454+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.511454+0000","last_undegraded":"2024-04-02T07:24:10.511454+0000","last_fullsized":"2024-04-02T07:24:10.511454+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:04:08.094127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.514408+0000","last_change":"2024-04-02T07:24:10.514408+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.514408+0000","last_undegraded":"2024-04-02T07:24:10.514408+0000","last_fullsized":"2024-04-02T07:24:10.514408+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:05:42.639900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512172+0000","last_change":"2024-04-02T07:24:10.512172+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512172+0000","last_undegraded":"2024-04-02T07:24:10.512172+0000","last_fullsized":"2024-04-02T07:24:10.512172+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:49:40.986769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.513235+0000","last_change":"2024-04-02T07:24:10.513235+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.513235+0000","last_undegraded":"2024-04-02T07:24:10.513235+0000","last_fullsized":"2024-04-02T07:24:10.513235+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:12:21.124664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.515981+0000","last_change":"2024-04-02T07:24:10.515981+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.515981+0000","last_undegraded":"2024-04-02T07:24:10.515981+0000","last_fullsized":"2024-04-02T07:24:10.515981+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:19:53.123928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512184+0000","last_change":"2024-04-02T07:24:10.512184+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512184+0000","last_undegraded":"2024-04-02T07:24:10.512184+0000","last_fullsized":"2024-04-02T07:24:10.512184+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:42:08.977549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.508727+0000","last_change":"2024-04-02T07:24:10.508727+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.508727+0000","last_undegraded":"2024-04-02T07:24:10.508727+0000","last_fullsized":"2024-04-02T07:24:10.508727+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:30:39.543249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512493+0000","last_change":"2024-04-02T07:24:10.512493+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512493+0000","last_undegraded":"2024-04-02T07:24:10.512493+0000","last_fullsized":"2024-04-02T07:24:10.512493+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:11:13.000802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-02T07:24:10.513949+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:24:10.513949+0000","last_peered":"2024-04-02T07:24:10.513949+0000","last_clean":"2024-04-02T07:24:10.513949+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:24:10.513949+0000","last_undegraded":"2024-04-02T07:24:10.513949+0000","last_fullsized":"2024-04-02T07:24:10.513949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1085440,"data_stored":785611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64200000000000002,"15min":0.64100000000000001},"min":{"1min":0.441,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88300000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.501},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.60999999999999999,"15min":0.59799999999999998},"min":{"1min":0.48299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.64300000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.628,"15min":0.624},"min":{"1min":0.436,"5min":0.379,"15min":0.379},"max":{"1min":0.84299999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.436},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86199999999999999,"5min":1.113,"15min":1.113},"last":0.60199999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.747,"15min":0.75},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.93999999999999995,"5min":1.139,"15min":1.139},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.5,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96299999999999997,"5min":1.522,"15min":1.522},"last":0.57999999999999996}]},{"osd":3,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.50700000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92700000000000005,"5min":1.405,"15min":1.405},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72699999999999998,"15min":0.72799999999999998},"min":{"1min":0.58599999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92300000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.74399999999999999}]},{"osd":4,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68799999999999994,"15min":0.70299999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81499999999999995,"5min":1.633,"15min":1.633},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.874,"5min":1.079,"15min":1.079},"last":0.66700000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72299999999999998,"15min":0.74099999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94499999999999995,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.78700000000000003,"15min":0.79900000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95499999999999996,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.76700000000000002}]},{"osd":6,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82799999999999996,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.69799999999999995,"15min":0.71499999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82499999999999996,"5min":1,"15min":1},"last":0.626}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":201060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66200000000000003,"15min":0.66300000000000003},"min":{"1min":0.48299999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86199999999999999,"5min":1.399,"15min":1.399},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.88,"15min":0.91900000000000004},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95999999999999996,"5min":5.7569999999999997,"15min":5.7569999999999997},"last":0.56599999999999995}]},{"osd":1,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.52600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.93899999999999995,"5min":1.95,"15min":1.95},"last":0.75},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95799999999999996,"5min":1.248,"15min":1.248},"last":0.67200000000000004}]},{"osd":2,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.54900000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89300000000000002,"5min":1.226,"15min":1.226},"last":0.501},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71199999999999997,"15min":0.70999999999999996},"min":{"1min":0.55700000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.58599999999999997}]},{"osd":3,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.81000000000000005,"15min":0.82499999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.88,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.628},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.52600000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97899999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.64600000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.91000000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.76400000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.68000000000000005,"15min":0.68799999999999994},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89500000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73799999999999999,"15min":0.73999999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98999999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.80200000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.745,"15min":0.753},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93400000000000005,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.56299999999999994,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97099999999999997,"5min":0.999,"15min":0.999},"last":0.78400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":201060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86199999999999999,"5min":1.25,"15min":1.25},"last":0.622},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.70899999999999996},"min":{"1min":0.48899999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91300000000000003,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.83799999999999997}]},{"osd":1,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97399999999999998,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72499999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.97899999999999998,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.82299999999999995,"15min":0.83499999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98399999999999999,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.751},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.74299999999999999,"15min":0.752},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95699999999999996,"5min":1.696,"15min":1.696},"last":0.71199999999999997}]},{"osd":3,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.76100000000000001,"15min":0.77300000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.99099999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.82499999999999996,"15min":0.84199999999999997},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.65800000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.71599999999999997,"15min":0.74199999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90500000000000003,"5min":1.911,"15min":1.911},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.77800000000000002,"15min":0.81000000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.92400000000000004,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.86099999999999999,"15min":0.89400000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.95799999999999996,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.84599999999999997,"15min":0.878},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0269999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.76500000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.86199999999999999,"15min":0.89400000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.038,"5min":1.887,"15min":1.887},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.91300000000000003,"15min":0.94799999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.012,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.69799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":201060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.746,"15min":0.75900000000000001},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91800000000000004,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.81999999999999995,"15min":0.84999999999999998},"min":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81499999999999995,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.67100000000000004}]},{"osd":1,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76300000000000001,"15min":0.77000000000000002},"min":{"1min":0.56200000000000006,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90600000000000003,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.90800000000000003,"15min":0.94199999999999995},"min":{"1min":0.54200000000000004,"5min":0.503,"15min":0.503},"max":{"1min":0.97399999999999998,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":0.69699999999999995}]},{"osd":2,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.80400000000000005,"15min":0.81499999999999995},"min":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.93999999999999995,"5min":2.056,"15min":2.056},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.878,"15min":0.90200000000000002},"min":{"1min":0.59399999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.874,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.82499999999999996}]},{"osd":3,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.999,"15min":1.0369999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.97899999999999998,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":1.012,"15min":1.0509999999999999},"min":{"1min":0.65200000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.91700000000000004,"5min":3.9750000000000001,"15min":3.9750000000000001},"last":1.014}]},{"osd":5,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71999999999999997,"15min":0.72499999999999998},"min":{"1min":0.439,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91000000000000003,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.45800000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95499999999999996,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.0549999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":0.72999999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.085,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.123},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79300000000000004,"15min":0.79400000000000004},"min":{"1min":0.57799999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98399999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.99199999999999999}]},{"osd":7,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.026,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.68500000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.0640000000000001,"5min":1.353,"15min":1.353},"last":1.1499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":503808,"data_stored":201060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.44900000000000001,"15min":0.45400000000000001},"min":{"1min":0.26600000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56599999999999995,"5min":0.62,"15min":0.62},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.746,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.35199999999999998}]},{"osd":1,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.434,"15min":0.434},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.61399999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52300000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.374},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.65300000000000002,"5min":1.306,"15min":1.306},"last":0.496}]},{"osd":4,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.012,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98999999999999999,"5min":1.155,"15min":1.155},"last":0.79300000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77300000000000002,"15min":0.77500000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.74199999999999999,"15min":0.74399999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.038,"5min":1.135,"15min":1.135},"last":0.88300000000000001}]},{"osd":6,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0700000000000001,"5min":1.25,"15min":1.25},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.095,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.92600000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1319999999999999,"5min":1.216,"15min":1.216},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.78900000000000003,"15min":0.79600000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.046,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.81299999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":491520,"data_stored":195243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57399999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47999999999999998,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.42199999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80800000000000005,"5min":1.171,"15min":1.171},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48799999999999999,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64500000000000002,"5min":1.333,"15min":1.333},"last":0.48899999999999999}]},{"osd":3,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51700000000000002,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72099999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.39900000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.76400000000000001,"15min":0.77400000000000002},"min":{"1min":0.47699999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0109999999999999,"5min":2.254,"15min":2.254},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76500000000000001,"15min":0.76600000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.016,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.73199999999999998}]},{"osd":5,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.52600000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.80900000000000005,"15min":0.81799999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.093,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.85899999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.61099999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0369999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.82099999999999995,"15min":0.82399999999999995},"min":{"1min":0.62,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.105,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.77600000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0549999999999999,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82399999999999995,"15min":0.82799999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0629999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.69399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":503808,"data_stored":201060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.254,"5min":0.251,"15min":0.251},"max":{"1min":0.60399999999999998,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.501},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.65300000000000002,"15min":0.67500000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.093,"5min":4.157,"15min":4.157},"last":0.26200000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.65600000000000003,"15min":0.69199999999999995},"min":{"1min":0.32700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68500000000000005,"5min":4.282,"15min":4.282},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79500000000000004,"5min":1.625,"15min":1.625},"last":0.55800000000000005}]},{"osd":3,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60999999999999999,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72099999999999997,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.91100000000000003,"15min":0.97199999999999998},"min":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.052,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.38400000000000001}]},{"osd":4,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.96599999999999997,"15min":1.006},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0900000000000001,"5min":4.7400000000000002,"15min":4.7400000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.82799999999999996,"15min":0.83999999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.99199999999999999,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.624}]},{"osd":5,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.95899999999999996,"15min":0.98199999999999998},"min":{"1min":0.53900000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.163,"5min":4.5759999999999996,"15min":4.5759999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.95499999999999996,"15min":0.98699999999999999},"min":{"1min":0.48999999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0089999999999999,"5min":4.7949999999999999,"15min":4.7949999999999999},"last":0.48999999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":1.0029999999999999,"15min":1.0389999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.129,"5min":4.6890000000000001,"15min":4.6890000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.97299999999999998,"15min":1.01},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0620000000000001,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.52100000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.83799999999999997,"15min":0.84999999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0069999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.98799999999999999,"15min":1.0129999999999999},"min":{"1min":0.55800000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.383,"5min":4.6420000000000003,"15min":4.6420000000000003},"last":0.58599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1097728,"data_stored":791428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.47399999999999998,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.622,"5min":1.48,"15min":1.48},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.51000000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74399999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.39900000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.34000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79100000000000004,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51900000000000002,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.434}]},{"osd":3,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.32600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.56999999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.61899999999999999,"15min":0.63100000000000001},"min":{"1min":0.41799999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.69899999999999995,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.47799999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.90600000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.53700000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.68400000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.78900000000000003,"15min":0.79900000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94099999999999995,"5min":1.371,"15min":1.371},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.97899999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.58799999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.018,"5min":1.177,"15min":1.177},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.83499999999999996,"15min":0.84899999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.002,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.622}]},{"osd":7,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.56299999999999994,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.069,"5min":1.135,"15min":1.135},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.92400000000000004,"5min":1.141,"15min":1.141},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:24:16.453 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:24:16.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.626+0000 7f11b7600640 1 Processor -- start 2024-04-02T07:24:16.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.626+0000 7f11b7600640 1 -- start start 2024-04-02T07:24:16.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.630+0000 7f11b7600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11b0153ea0 0x7f11b00c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:16.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.630+0000 7f11b7600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f11b0159be0 0x7f11b00b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:16.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.630+0000 7f11b7600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f11b015a040 0x7f11b00b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:16.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.630+0000 7f11b7600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b013d0c0 con 0x7f11b015a040 2024-04-02T07:24:16.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.630+0000 7f11b7600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b015a4f0 con 0x7f11b0159be0 2024-04-02T07:24:16.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.630+0000 7f11b7600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b015a7d0 con 0x7f11b0153ea0 2024-04-02T07:24:16.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.630+0000 7f11b5600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f11b015a040 0x7f11b00b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:16.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.630+0000 7f11b5600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f11b015a040 0x7f11b00b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33494/0 (socket says 172.21.15.55:33494) 2024-04-02T07:24:16.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.630+0000 7f11b5600640 1 -- 172.21.15.55:0/3783645770 learned_addr learned my addr 172.21.15.55:0/3783645770 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:16.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.630+0000 7f11afe00640 1 --2- 172.21.15.55:0/3783645770 >> v2:172.21.15.106:3300/0 conn(0x7f11b0159be0 0x7f11b00b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:16.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.630+0000 7f11b4c00640 1 --2- 172.21.15.55:0/3783645770 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11b0153ea0 0x7f11b00c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:16.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.630+0000 7f11b5600640 1 -- 172.21.15.55:0/3783645770 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11b0153ea0 msgr2=0x7f11b00c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:16.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.630+0000 7f11b5600640 1 --2- 172.21.15.55:0/3783645770 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11b0153ea0 0x7f11b00c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.630+0000 7f11b5600640 1 -- 172.21.15.55:0/3783645770 >> v2:172.21.15.106:3300/0 conn(0x7f11b0159be0 msgr2=0x7f11b00b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:16.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.630+0000 7f11b5600640 1 --2- 172.21.15.55:0/3783645770 >> v2:172.21.15.106:3300/0 conn(0x7f11b0159be0 0x7f11b00b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.630+0000 7f11b5600640 1 -- 172.21.15.55:0/3783645770 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b015aab0 con 0x7f11b015a040 2024-04-02T07:24:16.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.630+0000 7f11b5600640 1 --2- 172.21.15.55:0/3783645770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11b015a040 0x7f11b00b36f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f11b00b3d70 tx=0x7f11a801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4981c0f6a603e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11af400640 1 -- 172.21.15.55:0/3783645770 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a80a5890 con 0x7f11b015a040 2024-04-02T07:24:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11af400640 1 -- 172.21.15.55:0/3783645770 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a80a59f0 con 0x7f11b015a040 2024-04-02T07:24:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11af400640 1 -- 172.21.15.55:0/3783645770 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a80a5d80 con 0x7f11b015a040 2024-04-02T07:24:16.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11b7600640 1 -- 172.21.15.55:0/3783645770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11b015a040 msgr2=0x7f11b00b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11b7600640 1 --2- 172.21.15.55:0/3783645770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11b015a040 0x7f11b00b36f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f11b00b3d70 tx=0x7f11a801c9f0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11b7600640 1 -- 172.21.15.55:0/3783645770 shutdown_connections 2024-04-02T07:24:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11b7600640 1 --2- 172.21.15.55:0/3783645770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11b015a040 0x7f11b00b36f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11b7600640 1 --2- 172.21.15.55:0/3783645770 >> v2:172.21.15.106:3300/0 conn(0x7f11b0159be0 0x7f11b00b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11b7600640 1 --2- 172.21.15.55:0/3783645770 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11b0153ea0 0x7f11b00c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11b7600640 1 -- 172.21.15.55:0/3783645770 >> 172.21.15.55:0/3783645770 conn(0x7f11b0066080 msgr2=0x7f11b0069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11b7600640 1 -- 172.21.15.55:0/3783645770 shutdown_connections 2024-04-02T07:24:16.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11b7600640 1 -- 172.21.15.55:0/3783645770 wait complete. 2024-04-02T07:24:16.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11b7600640 1 Processor -- start 2024-04-02T07:24:16.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11b7600640 1 -- start start 2024-04-02T07:24:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11b7600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11b0153ea0 0x7f11b014f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11b7600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11b0159be0 0x7f11b014d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11b7600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11b015a040 0x7f11b013d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11b7600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b0138b60 con 0x7f11b0159be0 2024-04-02T07:24:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11b7600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b0138e00 con 0x7f11b015a040 2024-04-02T07:24:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11b7600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b01390e0 con 0x7f11b0153ea0 2024-04-02T07:24:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11afe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11b0159be0 0x7f11b014d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11afe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11b0159be0 0x7f11b014d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33500/0 (socket says 172.21.15.55:33500) 2024-04-02T07:24:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11afe00640 1 -- 172.21.15.55:0/3439225001 learned_addr learned my addr 172.21.15.55:0/3439225001 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11b4c00640 1 --2- 172.21.15.55:0/3439225001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11b0153ea0 0x7f11b014f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.634+0000 7f11b5600640 1 --2- 172.21.15.55:0/3439225001 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11b015a040 0x7f11b013d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.638+0000 7f11afe00640 1 -- 172.21.15.55:0/3439225001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11b0153ea0 msgr2=0x7f11b014f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.638+0000 7f11afe00640 1 --2- 172.21.15.55:0/3439225001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11b0153ea0 0x7f11b014f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.638+0000 7f11afe00640 1 -- 172.21.15.55:0/3439225001 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11b015a040 msgr2=0x7f11b013d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:16.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.638+0000 7f11afe00640 1 --2- 172.21.15.55:0/3439225001 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11b015a040 0x7f11b013d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.638+0000 7f11afe00640 1 -- 172.21.15.55:0/3439225001 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a8009b30 con 0x7f11b0159be0 2024-04-02T07:24:16.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.638+0000 7f11afe00640 1 --2- 172.21.15.55:0/3439225001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11b0159be0 0x7f11b014d150 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f119c00d800 tx=0x7f119c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:16.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.638+0000 7f11acc00640 1 -- 172.21.15.55:0/3439225001 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c00b6c0 con 0x7f11b0159be0 2024-04-02T07:24:16.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.638+0000 7f11acc00640 1 -- 172.21.15.55:0/3439225001 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f119c00b820 con 0x7f11b0159be0 2024-04-02T07:24:16.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.638+0000 7f11acc00640 1 -- 172.21.15.55:0/3439225001 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f119c00bb90 con 0x7f11b0159be0 2024-04-02T07:24:16.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.638+0000 7f11b7600640 1 -- 172.21.15.55:0/3439225001 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b01393c0 con 0x7f11b0159be0 2024-04-02T07:24:16.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.638+0000 7f11b7600640 1 -- 172.21.15.55:0/3439225001 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b014fc80 con 0x7f11b0159be0 2024-04-02T07:24:16.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.638+0000 7f11b7600640 1 -- 172.21.15.55:0/3439225001 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b0066c90 con 0x7f11b0159be0 2024-04-02T07:24:16.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.638+0000 7f11acc00640 1 -- 172.21.15.55:0/3439225001 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f119c00bcf0 con 0x7f11b0159be0 2024-04-02T07:24:16.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.638+0000 7f11acc00640 1 --2- 172.21.15.55:0/3439225001 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1190066690 0x7f1190068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:16.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.638+0000 7f11acc00640 1 -- 172.21.15.55:0/3439225001 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f119c084680 con 0x7f11b0159be0 2024-04-02T07:24:16.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.642+0000 7f11b4c00640 1 --2- 172.21.15.55:0/3439225001 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1190066690 0x7f1190068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:16.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.642+0000 7f11b4c00640 1 --2- 172.21.15.55:0/3439225001 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1190066690 0x7f1190068b50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f11a40045f0 tx=0x7f11a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:16.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.642+0000 7f11acc00640 1 -- 172.21.15.55:0/3439225001 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f119c051a00 con 0x7f11b0159be0 2024-04-02T07:24:16.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.802+0000 7f11b7600640 1 -- 172.21.15.55:0/3439225001 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f11b0139870 con 0x7f1190066690 2024-04-02T07:24:16.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.810+0000 7f11acc00640 1 -- 172.21.15.55:0/3439225001 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277783 (secure 0 0 0) 0x7f11a400b6a0 con 0x7f1190066690 2024-04-02T07:24:16.814 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:16.816 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:24:16.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.814+0000 7f11b7600640 1 -- 172.21.15.55:0/3439225001 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1190066690 msgr2=0x7f1190068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:16.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.814+0000 7f11b7600640 1 --2- 172.21.15.55:0/3439225001 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1190066690 0x7f1190068b50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f11a40045f0 tx=0x7f11a4008040 comp rx=0 tx=0).stop 2024-04-02T07:24:16.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.814+0000 7f11b7600640 1 -- 172.21.15.55:0/3439225001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11b0159be0 msgr2=0x7f11b014d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:16.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.814+0000 7f11b7600640 1 --2- 172.21.15.55:0/3439225001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11b0159be0 0x7f11b014d150 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f119c00d800 tx=0x7f119c00dcc0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.814+0000 7f11b7600640 1 -- 172.21.15.55:0/3439225001 shutdown_connections 2024-04-02T07:24:16.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.814+0000 7f11b7600640 1 --2- 172.21.15.55:0/3439225001 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1190066690 0x7f1190068b50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.814+0000 7f11b7600640 1 --2- 172.21.15.55:0/3439225001 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f11b015a040 0x7f11b013d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.814+0000 7f11b7600640 1 --2- 172.21.15.55:0/3439225001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f11b0159be0 0x7f11b014d150 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.814+0000 7f11b7600640 1 --2- 172.21.15.55:0/3439225001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f11b0153ea0 0x7f11b014f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:16.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.814+0000 7f11b7600640 1 -- 172.21.15.55:0/3439225001 >> 172.21.15.55:0/3439225001 conn(0x7f11b0066080 msgr2=0x7f11b00cd100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:16.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.814+0000 7f11b7600640 1 -- 172.21.15.55:0/3439225001 shutdown_connections 2024-04-02T07:24:16.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:16.814+0000 7f11b7600640 1 -- 172.21.15.55:0/3439225001 wait complete. 2024-04-02T07:24:16.834 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-04-02T07:24:16.360706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":237632,"kb_used_data":5072,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754737088,"statfs":{"total":773094113280,"available":772850778112,"internally_reserved":0,"allocated":5193728,"data_stored":2777582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.850013"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.511543+0000","last_change":"2024-04-02T07:24:10.511543+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.511543+0000","last_undegraded":"2024-04-02T07:24:10.511543+0000","last_fullsized":"2024-04-02T07:24:10.511543+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:00:31.241815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.516293+0000","last_change":"2024-04-02T07:24:10.516293+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.516293+0000","last_undegraded":"2024-04-02T07:24:10.516293+0000","last_fullsized":"2024-04-02T07:24:10.516293+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:20:10.281531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512337+0000","last_change":"2024-04-02T07:24:10.512337+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512337+0000","last_undegraded":"2024-04-02T07:24:10.512337+0000","last_fullsized":"2024-04-02T07:24:10.512337+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:05:52.333856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.513927+0000","last_change":"2024-04-02T07:24:10.513927+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.513927+0000","last_undegraded":"2024-04-02T07:24:10.513927+0000","last_fullsized":"2024-04-02T07:24:10.513927+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:14:08.858057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512563+0000","last_change":"2024-04-02T07:24:10.512563+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512563+0000","last_undegraded":"2024-04-02T07:24:10.512563+0000","last_fullsized":"2024-04-02T07:24:10.512563+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:12:21.124664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.516499+0000","last_change":"2024-04-02T07:24:10.516499+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.516499+0000","last_undegraded":"2024-04-02T07:24:10.516499+0000","last_fullsized":"2024-04-02T07:24:10.516499+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:50:14.697045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512279+0000","last_change":"2024-04-02T07:24:10.512279+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512279+0000","last_undegraded":"2024-04-02T07:24:10.512279+0000","last_fullsized":"2024-04-02T07:24:10.512279+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:18:59.945527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.509876+0000","last_change":"2024-04-02T07:24:10.509876+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.509876+0000","last_undegraded":"2024-04-02T07:24:10.509876+0000","last_fullsized":"2024-04-02T07:24:10.509876+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:54:03.635207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.515953+0000","last_change":"2024-04-02T07:24:10.515953+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.515953+0000","last_undegraded":"2024-04-02T07:24:10.515953+0000","last_fullsized":"2024-04-02T07:24:10.515953+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:56:10.784349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.509424+0000","last_change":"2024-04-02T07:24:10.509424+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.509424+0000","last_undegraded":"2024-04-02T07:24:10.509424+0000","last_fullsized":"2024-04-02T07:24:10.509424+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:18:20.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.514857+0000","last_change":"2024-04-02T07:24:10.514857+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.514857+0000","last_undegraded":"2024-04-02T07:24:10.514857+0000","last_fullsized":"2024-04-02T07:24:10.514857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:55:23.427125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.517980+0000","last_change":"2024-04-02T07:24:10.517980+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.517980+0000","last_undegraded":"2024-04-02T07:24:10.517980+0000","last_fullsized":"2024-04-02T07:24:10.517980+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:15:57.473214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512166+0000","last_change":"2024-04-02T07:24:10.512166+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512166+0000","last_undegraded":"2024-04-02T07:24:10.512166+0000","last_fullsized":"2024-04-02T07:24:10.512166+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:05:42.639900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.514265+0000","last_change":"2024-04-02T07:24:10.514265+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.514265+0000","last_undegraded":"2024-04-02T07:24:10.514265+0000","last_fullsized":"2024-04-02T07:24:10.514265+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:00:31.241815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.511643+0000","last_change":"2024-04-02T07:24:10.511643+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.511643+0000","last_undegraded":"2024-04-02T07:24:10.511643+0000","last_fullsized":"2024-04-02T07:24:10.511643+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:14:08.858057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.509418+0000","last_change":"2024-04-02T07:24:10.509418+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.509418+0000","last_undegraded":"2024-04-02T07:24:10.509418+0000","last_fullsized":"2024-04-02T07:24:10.509418+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:20:10.281531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.518359+0000","last_change":"2024-04-02T07:24:10.518359+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.518359+0000","last_undegraded":"2024-04-02T07:24:10.518359+0000","last_fullsized":"2024-04-02T07:24:10.518359+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:33:20.814250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.515570+0000","last_change":"2024-04-02T07:24:10.515570+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.515570+0000","last_undegraded":"2024-04-02T07:24:10.515570+0000","last_fullsized":"2024-04-02T07:24:10.515570+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:18:20.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512642+0000","last_change":"2024-04-02T07:24:10.512642+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512642+0000","last_undegraded":"2024-04-02T07:24:10.512642+0000","last_fullsized":"2024-04-02T07:24:10.512642+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:45:51.236711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.511517+0000","last_change":"2024-04-02T07:24:10.511517+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.511517+0000","last_undegraded":"2024-04-02T07:24:10.511517+0000","last_fullsized":"2024-04-02T07:24:10.511517+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:58.481260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.511572+0000","last_change":"2024-04-02T07:24:10.511572+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.511572+0000","last_undegraded":"2024-04-02T07:24:10.511572+0000","last_fullsized":"2024-04-02T07:24:10.511572+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:55:23.427125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512840+0000","last_change":"2024-04-02T07:24:10.512840+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512840+0000","last_undegraded":"2024-04-02T07:24:10.512840+0000","last_fullsized":"2024-04-02T07:24:10.512840+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:41:58.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.508727+0000","last_change":"2024-04-02T07:24:10.508727+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.508727+0000","last_undegraded":"2024-04-02T07:24:10.508727+0000","last_fullsized":"2024-04-02T07:24:10.508727+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:19:53.123928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.513682+0000","last_change":"2024-04-02T07:24:10.513682+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.513682+0000","last_undegraded":"2024-04-02T07:24:10.513682+0000","last_fullsized":"2024-04-02T07:24:10.513682+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:58.481260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.511454+0000","last_change":"2024-04-02T07:24:10.511454+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.511454+0000","last_undegraded":"2024-04-02T07:24:10.511454+0000","last_fullsized":"2024-04-02T07:24:10.511454+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:04:08.094127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.514408+0000","last_change":"2024-04-02T07:24:10.514408+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.514408+0000","last_undegraded":"2024-04-02T07:24:10.514408+0000","last_fullsized":"2024-04-02T07:24:10.514408+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:05:42.639900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512172+0000","last_change":"2024-04-02T07:24:10.512172+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512172+0000","last_undegraded":"2024-04-02T07:24:10.512172+0000","last_fullsized":"2024-04-02T07:24:10.512172+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:49:40.986769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.513235+0000","last_change":"2024-04-02T07:24:10.513235+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.513235+0000","last_undegraded":"2024-04-02T07:24:10.513235+0000","last_fullsized":"2024-04-02T07:24:10.513235+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:12:21.124664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.515981+0000","last_change":"2024-04-02T07:24:10.515981+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.515981+0000","last_undegraded":"2024-04-02T07:24:10.515981+0000","last_fullsized":"2024-04-02T07:24:10.515981+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:19:53.123928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512184+0000","last_change":"2024-04-02T07:24:10.512184+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512184+0000","last_undegraded":"2024-04-02T07:24:10.512184+0000","last_fullsized":"2024-04-02T07:24:10.512184+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:42:08.977549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.508727+0000","last_change":"2024-04-02T07:24:10.508727+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.508727+0000","last_undegraded":"2024-04-02T07:24:10.508727+0000","last_fullsized":"2024-04-02T07:24:10.508727+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:30:39.543249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512493+0000","last_change":"2024-04-02T07:24:10.512493+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512493+0000","last_undegraded":"2024-04-02T07:24:10.512493+0000","last_fullsized":"2024-04-02T07:24:10.512493+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:11:13.000802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-02T07:24:10.513949+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:24:10.513949+0000","last_peered":"2024-04-02T07:24:10.513949+0000","last_clean":"2024-04-02T07:24:10.513949+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:24:10.513949+0000","last_undegraded":"2024-04-02T07:24:10.513949+0000","last_fullsized":"2024-04-02T07:24:10.513949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1085440,"data_stored":785611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64200000000000002,"15min":0.64100000000000001},"min":{"1min":0.441,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88300000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.501},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.60999999999999999,"15min":0.59799999999999998},"min":{"1min":0.48299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.64300000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.628,"15min":0.624},"min":{"1min":0.436,"5min":0.379,"15min":0.379},"max":{"1min":0.84299999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.436},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86199999999999999,"5min":1.113,"15min":1.113},"last":0.60199999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.747,"15min":0.75},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.93999999999999995,"5min":1.139,"15min":1.139},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.5,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96299999999999997,"5min":1.522,"15min":1.522},"last":0.57999999999999996}]},{"osd":3,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.50700000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92700000000000005,"5min":1.405,"15min":1.405},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72699999999999998,"15min":0.72799999999999998},"min":{"1min":0.58599999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92300000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.74399999999999999}]},{"osd":4,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68799999999999994,"15min":0.70299999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81499999999999995,"5min":1.633,"15min":1.633},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.874,"5min":1.079,"15min":1.079},"last":0.66700000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72299999999999998,"15min":0.74099999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94499999999999995,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.78700000000000003,"15min":0.79900000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95499999999999996,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.76700000000000002}]},{"osd":6,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82799999999999996,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.69799999999999995,"15min":0.71499999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82499999999999996,"5min":1,"15min":1},"last":0.626}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":201060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66200000000000003,"15min":0.66300000000000003},"min":{"1min":0.48299999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86199999999999999,"5min":1.399,"15min":1.399},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.88,"15min":0.91900000000000004},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95999999999999996,"5min":5.7569999999999997,"15min":5.7569999999999997},"last":0.56599999999999995}]},{"osd":1,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.52600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.93899999999999995,"5min":1.95,"15min":1.95},"last":0.75},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95799999999999996,"5min":1.248,"15min":1.248},"last":0.67200000000000004}]},{"osd":2,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.54900000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89300000000000002,"5min":1.226,"15min":1.226},"last":0.501},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71199999999999997,"15min":0.70999999999999996},"min":{"1min":0.55700000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.58599999999999997}]},{"osd":3,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.81000000000000005,"15min":0.82499999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.88,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.628},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.52600000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97899999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.64600000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.91000000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.76400000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.68000000000000005,"15min":0.68799999999999994},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89500000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73799999999999999,"15min":0.73999999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98999999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.80200000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.745,"15min":0.753},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93400000000000005,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.56299999999999994,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97099999999999997,"5min":0.999,"15min":0.999},"last":0.78400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":201060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86199999999999999,"5min":1.25,"15min":1.25},"last":0.622},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.70899999999999996},"min":{"1min":0.48899999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91300000000000003,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.83799999999999997}]},{"osd":1,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97399999999999998,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72499999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.97899999999999998,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.82299999999999995,"15min":0.83499999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98399999999999999,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.751},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.74299999999999999,"15min":0.752},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95699999999999996,"5min":1.696,"15min":1.696},"last":0.71199999999999997}]},{"osd":3,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.76100000000000001,"15min":0.77300000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.99099999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.82499999999999996,"15min":0.84199999999999997},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.65800000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.71599999999999997,"15min":0.74199999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90500000000000003,"5min":1.911,"15min":1.911},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.77800000000000002,"15min":0.81000000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.92400000000000004,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.86099999999999999,"15min":0.89400000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.95799999999999996,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.84599999999999997,"15min":0.878},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0269999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.76500000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.86199999999999999,"15min":0.89400000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.038,"5min":1.887,"15min":1.887},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.91300000000000003,"15min":0.94799999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.012,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.69799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":201060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.746,"15min":0.75900000000000001},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91800000000000004,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.81999999999999995,"15min":0.84999999999999998},"min":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81499999999999995,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.67100000000000004}]},{"osd":1,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76300000000000001,"15min":0.77000000000000002},"min":{"1min":0.56200000000000006,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90600000000000003,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.90800000000000003,"15min":0.94199999999999995},"min":{"1min":0.54200000000000004,"5min":0.503,"15min":0.503},"max":{"1min":0.97399999999999998,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":0.69699999999999995}]},{"osd":2,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.80400000000000005,"15min":0.81499999999999995},"min":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.93999999999999995,"5min":2.056,"15min":2.056},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.878,"15min":0.90200000000000002},"min":{"1min":0.59399999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.874,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.82499999999999996}]},{"osd":3,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.999,"15min":1.0369999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.97899999999999998,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":1.012,"15min":1.0509999999999999},"min":{"1min":0.65200000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.91700000000000004,"5min":3.9750000000000001,"15min":3.9750000000000001},"last":1.014}]},{"osd":5,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71999999999999997,"15min":0.72499999999999998},"min":{"1min":0.439,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91000000000000003,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.45800000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95499999999999996,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.0549999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":0.72999999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.085,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.123},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79300000000000004,"15min":0.79400000000000004},"min":{"1min":0.57799999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98399999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.99199999999999999}]},{"osd":7,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.026,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.68500000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.0640000000000001,"5min":1.353,"15min":1.353},"last":1.1499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":503808,"data_stored":201060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.44900000000000001,"15min":0.45400000000000001},"min":{"1min":0.26600000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56599999999999995,"5min":0.62,"15min":0.62},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.746,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.35199999999999998}]},{"osd":1,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.434,"15min":0.434},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.61399999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52300000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.374},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.65300000000000002,"5min":1.306,"15min":1.306},"last":0.496}]},{"osd":4,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.012,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98999999999999999,"5min":1.155,"15min":1.155},"last":0.79300000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77300000000000002,"15min":0.77500000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.74199999999999999,"15min":0.74399999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.038,"5min":1.135,"15min":1.135},"last":0.88300000000000001}]},{"osd":6,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0700000000000001,"5min":1.25,"15min":1.25},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.095,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.92600000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1319999999999999,"5min":1.216,"15min":1.216},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.78900000000000003,"15min":0.79600000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.046,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.81299999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":491520,"data_stored":195243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57399999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47999999999999998,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.42199999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80800000000000005,"5min":1.171,"15min":1.171},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48799999999999999,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64500000000000002,"5min":1.333,"15min":1.333},"last":0.48899999999999999}]},{"osd":3,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51700000000000002,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72099999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.39900000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.76400000000000001,"15min":0.77400000000000002},"min":{"1min":0.47699999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0109999999999999,"5min":2.254,"15min":2.254},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76500000000000001,"15min":0.76600000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.016,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.73199999999999998}]},{"osd":5,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.52600000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.80900000000000005,"15min":0.81799999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.093,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.85899999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.61099999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0369999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.82099999999999995,"15min":0.82399999999999995},"min":{"1min":0.62,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.105,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.77600000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0549999999999999,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82399999999999995,"15min":0.82799999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0629999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.69399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":503808,"data_stored":201060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.254,"5min":0.251,"15min":0.251},"max":{"1min":0.60399999999999998,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.501},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.65300000000000002,"15min":0.67500000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.093,"5min":4.157,"15min":4.157},"last":0.26200000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.65600000000000003,"15min":0.69199999999999995},"min":{"1min":0.32700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68500000000000005,"5min":4.282,"15min":4.282},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79500000000000004,"5min":1.625,"15min":1.625},"last":0.55800000000000005}]},{"osd":3,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60999999999999999,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72099999999999997,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.91100000000000003,"15min":0.97199999999999998},"min":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.052,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.38400000000000001}]},{"osd":4,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.96599999999999997,"15min":1.006},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0900000000000001,"5min":4.7400000000000002,"15min":4.7400000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.82799999999999996,"15min":0.83999999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.99199999999999999,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.624}]},{"osd":5,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.95899999999999996,"15min":0.98199999999999998},"min":{"1min":0.53900000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.163,"5min":4.5759999999999996,"15min":4.5759999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.95499999999999996,"15min":0.98699999999999999},"min":{"1min":0.48999999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0089999999999999,"5min":4.7949999999999999,"15min":4.7949999999999999},"last":0.48999999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":1.0029999999999999,"15min":1.0389999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.129,"5min":4.6890000000000001,"15min":4.6890000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.97299999999999998,"15min":1.01},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0620000000000001,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.52100000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.83799999999999997,"15min":0.84999999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0069999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.98799999999999999,"15min":1.0129999999999999},"min":{"1min":0.55800000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.383,"5min":4.6420000000000003,"15min":4.6420000000000003},"last":0.58599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1097728,"data_stored":791428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.47399999999999998,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.622,"5min":1.48,"15min":1.48},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.51000000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74399999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.39900000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.34000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79100000000000004,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51900000000000002,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.434}]},{"osd":3,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.32600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.56999999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.61899999999999999,"15min":0.63100000000000001},"min":{"1min":0.41799999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.69899999999999995,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.47799999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.90600000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.53700000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.68400000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.78900000000000003,"15min":0.79900000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94099999999999995,"5min":1.371,"15min":1.371},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.97899999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.58799999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.018,"5min":1.177,"15min":1.177},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.83499999999999996,"15min":0.84899999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.002,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.622}]},{"osd":7,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.56299999999999994,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.069,"5min":1.135,"15min":1.135},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.92400000000000004,"5min":1.141,"15min":1.141},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:24:16.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2024-04-02T07:24:16.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2024-04-02T07:24:16.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2024-04-02T07:24:16.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2024-04-02T07:24:16.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2024-04-02T07:24:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2024-04-02T07:24:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2024-04-02T07:24:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2024-04-02T07:24:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2024-04-02T07:24:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2024-04-02T07:24:16.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2024-04-02T07:24:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2024-04-02T07:24:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2024-04-02T07:24:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2024-04-02T07:24:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2024-04-02T07:24:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2024-04-02T07:24:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2024-04-02T07:24:16.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2024-04-02T07:24:16.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2024-04-02T07:24:16.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2024-04-02T07:24:16.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2024-04-02T07:24:16.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2024-04-02T07:24:16.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2024-04-02T07:24:16.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2024-04-02T07:24:16.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2024-04-02T07:24:16.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2024-04-02T07:24:16.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2024-04-02T07:24:16.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2024-04-02T07:24:16.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2024-04-02T07:24:16.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2024-04-02T07:24:16.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2024-04-02T07:24:16.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2024-04-02T07:24:16.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2024-04-02T07:24:16.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2024-04-02T07:24:16.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.511543+0000', 'last_change': '2024-04-02T07:24:10.511543+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.511543+0000', 'last_undegraded': '2024-04-02T07:24:10.511543+0000', 'last_fullsized': '2024-04-02T07:24:10.511543+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T13:00:31.241815+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-02T07:24:16.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2024-04-02T07:24:16.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2024-04-02T07:24:16.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.516293+0000', 'last_change': '2024-04-02T07:24:10.516293+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.516293+0000', 'last_undegraded': '2024-04-02T07:24:10.516293+0000', 'last_fullsized': '2024-04-02T07:24:10.516293+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T11:20:10.281531+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-02T07:24:16.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2024-04-02T07:24:16.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2024-04-02T07:24:16.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.512337+0000', 'last_change': '2024-04-02T07:24:10.512337+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.512337+0000', 'last_undegraded': '2024-04-02T07:24:10.512337+0000', 'last_fullsized': '2024-04-02T07:24:10.512337+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T08:05:52.333856+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-02T07:24:16.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2024-04-02T07:24:16.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2024-04-02T07:24:16.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.513927+0000', 'last_change': '2024-04-02T07:24:10.513927+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.513927+0000', 'last_undegraded': '2024-04-02T07:24:10.513927+0000', 'last_fullsized': '2024-04-02T07:24:10.513927+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T15:14:08.858057+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-02T07:24:16.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2024-04-02T07:24:16.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2024-04-02T07:24:16.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.512563+0000', 'last_change': '2024-04-02T07:24:10.512563+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.512563+0000', 'last_undegraded': '2024-04-02T07:24:10.512563+0000', 'last_fullsized': '2024-04-02T07:24:10.512563+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T15:12:21.124664+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-02T07:24:16.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2024-04-02T07:24:16.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2024-04-02T07:24:16.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.516499+0000', 'last_change': '2024-04-02T07:24:10.516499+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.516499+0000', 'last_undegraded': '2024-04-02T07:24:10.516499+0000', 'last_fullsized': '2024-04-02T07:24:10.516499+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T15:50:14.697045+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-02T07:24:16.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2024-04-02T07:24:16.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2024-04-02T07:24:16.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.512279+0000', 'last_change': '2024-04-02T07:24:10.512279+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.512279+0000', 'last_undegraded': '2024-04-02T07:24:10.512279+0000', 'last_fullsized': '2024-04-02T07:24:10.512279+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T14:18:59.945527+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-02T07:24:16.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2024-04-02T07:24:16.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2024-04-02T07:24:16.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.509876+0000', 'last_change': '2024-04-02T07:24:10.509876+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.509876+0000', 'last_undegraded': '2024-04-02T07:24:10.509876+0000', 'last_fullsized': '2024-04-02T07:24:10.509876+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T12:54:03.635207+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-02T07:24:16.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2024-04-02T07:24:16.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.847 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2024-04-02T07:24:16.847 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.515953+0000', 'last_change': '2024-04-02T07:24:10.515953+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.515953+0000', 'last_undegraded': '2024-04-02T07:24:10.515953+0000', 'last_fullsized': '2024-04-02T07:24:10.515953+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T10:56:10.784349+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-02T07:24:16.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2024-04-02T07:24:16.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2024-04-02T07:24:16.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.509424+0000', 'last_change': '2024-04-02T07:24:10.509424+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.509424+0000', 'last_undegraded': '2024-04-02T07:24:10.509424+0000', 'last_fullsized': '2024-04-02T07:24:10.509424+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T11:18:20.283174+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-02T07:24:16.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2024-04-02T07:24:16.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2024-04-02T07:24:16.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.514857+0000', 'last_change': '2024-04-02T07:24:10.514857+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.514857+0000', 'last_undegraded': '2024-04-02T07:24:10.514857+0000', 'last_fullsized': '2024-04-02T07:24:10.514857+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T09:55:23.427125+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-02T07:24:16.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2024-04-02T07:24:16.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.848 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2024-04-02T07:24:16.848 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.517980+0000', 'last_change': '2024-04-02T07:24:10.517980+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.517980+0000', 'last_undegraded': '2024-04-02T07:24:10.517980+0000', 'last_fullsized': '2024-04-02T07:24:10.517980+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T12:15:57.473214+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-02T07:24:16.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2024-04-02T07:24:16.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2024-04-02T07:24:16.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.512166+0000', 'last_change': '2024-04-02T07:24:10.512166+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.512166+0000', 'last_undegraded': '2024-04-02T07:24:10.512166+0000', 'last_fullsized': '2024-04-02T07:24:10.512166+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T10:05:42.639900+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-02T07:24:16.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2024-04-02T07:24:16.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2024-04-02T07:24:16.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.514265+0000', 'last_change': '2024-04-02T07:24:10.514265+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.514265+0000', 'last_undegraded': '2024-04-02T07:24:10.514265+0000', 'last_fullsized': '2024-04-02T07:24:10.514265+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T13:00:31.241815+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-02T07:24:16.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2024-04-02T07:24:16.849 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.849 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2024-04-02T07:24:16.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.511643+0000', 'last_change': '2024-04-02T07:24:10.511643+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.511643+0000', 'last_undegraded': '2024-04-02T07:24:10.511643+0000', 'last_fullsized': '2024-04-02T07:24:10.511643+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T15:14:08.858057+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-02T07:24:16.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2024-04-02T07:24:16.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2024-04-02T07:24:16.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.509418+0000', 'last_change': '2024-04-02T07:24:10.509418+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.509418+0000', 'last_undegraded': '2024-04-02T07:24:10.509418+0000', 'last_fullsized': '2024-04-02T07:24:10.509418+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T11:20:10.281531+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-02T07:24:16.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2024-04-02T07:24:16.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2024-04-02T07:24:16.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.518359+0000', 'last_change': '2024-04-02T07:24:10.518359+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.518359+0000', 'last_undegraded': '2024-04-02T07:24:10.518359+0000', 'last_fullsized': '2024-04-02T07:24:10.518359+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T10:33:20.814250+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-04-02T07:24:16.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2024-04-02T07:24:16.850 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.850 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2024-04-02T07:24:16.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.515570+0000', 'last_change': '2024-04-02T07:24:10.515570+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.515570+0000', 'last_undegraded': '2024-04-02T07:24:10.515570+0000', 'last_fullsized': '2024-04-02T07:24:10.515570+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T11:18:20.283174+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-02T07:24:16.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2024-04-02T07:24:16.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2024-04-02T07:24:16.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.512642+0000', 'last_change': '2024-04-02T07:24:10.512642+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.512642+0000', 'last_undegraded': '2024-04-02T07:24:10.512642+0000', 'last_fullsized': '2024-04-02T07:24:10.512642+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T12:45:51.236711+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-02T07:24:16.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2024-04-02T07:24:16.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2024-04-02T07:24:16.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.511517+0000', 'last_change': '2024-04-02T07:24:10.511517+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.511517+0000', 'last_undegraded': '2024-04-02T07:24:10.511517+0000', 'last_fullsized': '2024-04-02T07:24:10.511517+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T19:19:58.481260+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-02T07:24:16.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2024-04-02T07:24:16.851 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.851 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2024-04-02T07:24:16.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.511572+0000', 'last_change': '2024-04-02T07:24:10.511572+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.511572+0000', 'last_undegraded': '2024-04-02T07:24:10.511572+0000', 'last_fullsized': '2024-04-02T07:24:10.511572+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T09:55:23.427125+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-02T07:24:16.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2024-04-02T07:24:16.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2024-04-02T07:24:16.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.512840+0000', 'last_change': '2024-04-02T07:24:10.512840+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.512840+0000', 'last_undegraded': '2024-04-02T07:24:10.512840+0000', 'last_fullsized': '2024-04-02T07:24:10.512840+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T09:41:58.634024+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-02T07:24:16.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2024-04-02T07:24:16.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2024-04-02T07:24:16.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.508727+0000', 'last_change': '2024-04-02T07:24:10.508727+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.508727+0000', 'last_undegraded': '2024-04-02T07:24:10.508727+0000', 'last_fullsized': '2024-04-02T07:24:10.508727+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T18:19:53.123928+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-02T07:24:16.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2024-04-02T07:24:16.852 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.852 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2024-04-02T07:24:16.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.513682+0000', 'last_change': '2024-04-02T07:24:10.513682+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.513682+0000', 'last_undegraded': '2024-04-02T07:24:10.513682+0000', 'last_fullsized': '2024-04-02T07:24:10.513682+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T19:19:58.481260+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-02T07:24:16.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2024-04-02T07:24:16.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2024-04-02T07:24:16.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.511454+0000', 'last_change': '2024-04-02T07:24:10.511454+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.511454+0000', 'last_undegraded': '2024-04-02T07:24:10.511454+0000', 'last_fullsized': '2024-04-02T07:24:10.511454+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T08:04:08.094127+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-04-02T07:24:16.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2024-04-02T07:24:16.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2024-04-02T07:24:16.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.514408+0000', 'last_change': '2024-04-02T07:24:10.514408+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.514408+0000', 'last_undegraded': '2024-04-02T07:24:10.514408+0000', 'last_fullsized': '2024-04-02T07:24:10.514408+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T10:05:42.639900+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-02T07:24:16.853 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2024-04-02T07:24:16.853 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2024-04-02T07:24:16.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.512172+0000', 'last_change': '2024-04-02T07:24:10.512172+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.512172+0000', 'last_undegraded': '2024-04-02T07:24:10.512172+0000', 'last_fullsized': '2024-04-02T07:24:10.512172+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T08:49:40.986769+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-02T07:24:16.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2024-04-02T07:24:16.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2024-04-02T07:24:16.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.513235+0000', 'last_change': '2024-04-02T07:24:10.513235+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.513235+0000', 'last_undegraded': '2024-04-02T07:24:10.513235+0000', 'last_fullsized': '2024-04-02T07:24:10.513235+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T15:12:21.124664+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-04-02T07:24:16.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2024-04-02T07:24:16.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.854 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2024-04-02T07:24:16.854 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.515981+0000', 'last_change': '2024-04-02T07:24:10.515981+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.515981+0000', 'last_undegraded': '2024-04-02T07:24:10.515981+0000', 'last_fullsized': '2024-04-02T07:24:10.515981+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T18:19:53.123928+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-04-02T07:24:16.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2024-04-02T07:24:16.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2024-04-02T07:24:16.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.512184+0000', 'last_change': '2024-04-02T07:24:10.512184+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.512184+0000', 'last_undegraded': '2024-04-02T07:24:10.512184+0000', 'last_fullsized': '2024-04-02T07:24:10.512184+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T10:42:08.977549+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-04-02T07:24:16.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2024-04-02T07:24:16.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2024-04-02T07:24:16.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.508727+0000', 'last_change': '2024-04-02T07:24:10.508727+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.508727+0000', 'last_undegraded': '2024-04-02T07:24:10.508727+0000', 'last_fullsized': '2024-04-02T07:24:10.508727+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T15:30:39.543249+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-04-02T07:24:16.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2024-04-02T07:24:16.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-04-02T07:24:11.506601+0000', 'last_change': '2024-04-02T07:24:11.506601+0000', 'last_active': '2024-04-02T07:24:11.506601+0000', 'last_peered': '2024-04-02T07:24:11.506601+0000', 'last_clean': '2024-04-02T07:24:11.506601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:11.506601+0000', 'last_undegraded': '2024-04-02T07:24:11.506601+0000', 'last_fullsized': '2024-04-02T07:24:11.506601+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:11.506601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-04-02T07:24:16.855 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2024-04-02T07:24:16.855 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 43, 'state': 'creating+peering', 'last_fresh': '2024-04-02T07:24:10.512493+0000', 'last_change': '2024-04-02T07:24:10.512493+0000', 'last_active': '2024-04-02T07:24:10.503751+0000', 'last_peered': '2024-04-02T07:24:10.503751+0000', 'last_clean': '2024-04-02T07:24:10.503751+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-04-02T07:24:10.512493+0000', 'last_undegraded': '2024-04-02T07:24:10.512493+0000', 'last_fullsized': '2024-04-02T07:24:10.512493+0000', 'mapping_epoch': 43, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 43, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'last_clean_scrub_stamp': '2024-04-02T07:24:10.503751+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2024-04-03T16:11:13.000802+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-04-02T07:24:16.856 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-02T07:24:17.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.010+0000 7f4257000640 1 Processor -- start 2024-04-02T07:24:17.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.010+0000 7f4257000640 1 -- start start 2024-04-02T07:24:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.010+0000 7f4257000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f42500b19d0 0x7f42500ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.010+0000 7f4257000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f425006c0d0 0x7f4250098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.010+0000 7f4257000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42500cf3d0 con 0x7f42500cef10 2024-04-02T07:24:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.010+0000 7f4257000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42500cf6b0 con 0x7f42500b19d0 2024-04-02T07:24:17.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.010+0000 7f4257000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42500cf990 con 0x7f425006c0d0 2024-04-02T07:24:17.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.010+0000 7f424fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f42500b19d0 0x7f42500ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:17.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.010+0000 7f424fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f42500b19d0 0x7f42500ce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33510/0 (socket says 172.21.15.55:33510) 2024-04-02T07:24:17.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.010+0000 7f424fe00640 1 -- 172.21.15.55:0/2432185821 learned_addr learned my addr 172.21.15.55:0/2432185821 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:17.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.010+0000 7f4247e00640 1 --2- 172.21.15.55:0/2432185821 >> v2:172.21.15.106:3300/0 conn(0x7f425006c0d0 0x7f4250098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:17.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.010+0000 7f424fe00640 1 -- 172.21.15.55:0/2432185821 >> v2:172.21.15.106:3300/0 conn(0x7f425006c0d0 msgr2=0x7f4250098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:17.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.010+0000 7f424fe00640 1 --2- 172.21.15.55:0/2432185821 >> v2:172.21.15.106:3300/0 conn(0x7f425006c0d0 0x7f4250098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:17.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.010+0000 7f424fe00640 1 -- 172.21.15.55:0/2432185821 >> v1:172.21.15.106:6789/0 conn(0x7f42500cef10 legacy=0x7f425015c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:17.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.010+0000 7f424fe00640 1 -- 172.21.15.55:0/2432185821 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42500cfc70 con 0x7f42500b19d0 2024-04-02T07:24:17.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.014+0000 7f424fe00640 1 --2- 172.21.15.55:0/2432185821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42500b19d0 0x7f42500ce9d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f42501617c0 tx=0x7f424001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd052a5b482de007 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:17.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.014+0000 7f424f400640 1 -- 172.21.15.55:0/2432185821 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42400ab600 con 0x7f42500b19d0 2024-04-02T07:24:17.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.014+0000 7f424f400640 1 -- 172.21.15.55:0/2432185821 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42400a7050 con 0x7f42500b19d0 2024-04-02T07:24:17.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.014+0000 7f424f400640 1 -- 172.21.15.55:0/2432185821 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42400ab980 con 0x7f42500b19d0 2024-04-02T07:24:17.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.014+0000 7f4257000640 1 -- 172.21.15.55:0/2432185821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42500b19d0 msgr2=0x7f42500ce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:17.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.014+0000 7f4257000640 1 --2- 172.21.15.55:0/2432185821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42500b19d0 0x7f42500ce9d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f42501617c0 tx=0x7f424001c520 comp rx=0 tx=0).stop 2024-04-02T07:24:17.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.014+0000 7f4257000640 1 -- 172.21.15.55:0/2432185821 shutdown_connections 2024-04-02T07:24:17.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.014+0000 7f4257000640 1 --2- 172.21.15.55:0/2432185821 >> v2:172.21.15.106:3300/0 conn(0x7f425006c0d0 0x7f4250098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:17.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.014+0000 7f4257000640 1 --2- 172.21.15.55:0/2432185821 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42500b19d0 0x7f42500ce9d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:17.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.014+0000 7f4257000640 1 -- 172.21.15.55:0/2432185821 >> 172.21.15.55:0/2432185821 conn(0x7f42500b2150 msgr2=0x7f42500b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:17.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.014+0000 7f4257000640 1 -- 172.21.15.55:0/2432185821 shutdown_connections 2024-04-02T07:24:17.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.014+0000 7f4257000640 1 -- 172.21.15.55:0/2432185821 wait complete. 2024-04-02T07:24:17.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f4257000640 1 Processor -- start 2024-04-02T07:24:17.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f4257000640 1 -- start start 2024-04-02T07:24:17.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f4257000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f425006c0d0 0x7f42500c9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:17.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f4257000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42500b19d0 0x7f425015ef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:17.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f4257000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42500cef10 0x7f4250150630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:17.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f4257000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425015dc00 con 0x7f42500b19d0 2024-04-02T07:24:17.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f4257000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f425015de80 con 0x7f425006c0d0 2024-04-02T07:24:17.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f4257000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f425015e160 con 0x7f42500cef10 2024-04-02T07:24:17.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f4247e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42500b19d0 0x7f425015ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:17.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f4247e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42500b19d0 0x7f425015ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33516/0 (socket says 172.21.15.55:33516) 2024-04-02T07:24:17.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f4247e00640 1 -- 172.21.15.55:0/722460533 learned_addr learned my addr 172.21.15.55:0/722460533 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:17.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f424fe00640 1 --2- 172.21.15.55:0/722460533 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f425006c0d0 0x7f42500c9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:17.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f4255000640 1 --2- 172.21.15.55:0/722460533 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42500cef10 0x7f4250150630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:17.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f4247e00640 1 -- 172.21.15.55:0/722460533 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42500cef10 msgr2=0x7f4250150630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:17.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f4247e00640 1 --2- 172.21.15.55:0/722460533 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42500cef10 0x7f4250150630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:17.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f4247e00640 1 -- 172.21.15.55:0/722460533 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f425006c0d0 msgr2=0x7f42500c9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:17.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f4247e00640 1 --2- 172.21.15.55:0/722460533 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f425006c0d0 0x7f42500c9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:17.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f4247e00640 1 -- 172.21.15.55:0/722460533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42400094d0 con 0x7f42500b19d0 2024-04-02T07:24:17.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f4247e00640 1 --2- 172.21.15.55:0/722460533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42500b19d0 0x7f425015ef20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f423800d800 tx=0x7f423800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:17.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f424cc00640 1 -- 172.21.15.55:0/722460533 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423800b6c0 con 0x7f42500b19d0 2024-04-02T07:24:17.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f424cc00640 1 -- 172.21.15.55:0/722460533 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423800b860 con 0x7f42500b19d0 2024-04-02T07:24:17.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f424cc00640 1 -- 172.21.15.55:0/722460533 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423800bc10 con 0x7f42500b19d0 2024-04-02T07:24:17.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f4257000640 1 -- 172.21.15.55:0/722460533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f425015e440 con 0x7f42500b19d0 2024-04-02T07:24:17.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.018+0000 7f4257000640 1 -- 172.21.15.55:0/722460533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f425015ea00 con 0x7f42500b19d0 2024-04-02T07:24:17.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.022+0000 7f4257000640 1 -- 172.21.15.55:0/722460533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4250066c90 con 0x7f42500b19d0 2024-04-02T07:24:17.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.022+0000 7f424cc00640 1 -- 172.21.15.55:0/722460533 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f423801e460 con 0x7f42500b19d0 2024-04-02T07:24:17.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.022+0000 7f424cc00640 1 --2- 172.21.15.55:0/722460533 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f422c066690 0x7f422c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:17.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.022+0000 7f424cc00640 1 -- 172.21.15.55:0/722460533 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4238084780 con 0x7f42500b19d0 2024-04-02T07:24:17.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.022+0000 7f424fe00640 1 --2- 172.21.15.55:0/722460533 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f422c066690 0x7f422c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:17.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.022+0000 7f424fe00640 1 --2- 172.21.15.55:0/722460533 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f422c066690 0x7f422c068b50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f42400ad000 tx=0x7f42400a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:17.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.026+0000 7f424cc00640 1 -- 172.21.15.55:0/722460533 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f4238051a50 con 0x7f42500b19d0 2024-04-02T07:24:17.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.246+0000 7f4257000640 1 -- 172.21.15.55:0/722460533 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f42500bac00 con 0x7f42500b19d0 2024-04-02T07:24:17.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.246+0000 7f424cc00640 1 -- 172.21.15.55:0/722460533 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1527 (secure 0 0 0) 0x7f4238055070 con 0x7f42500b19d0 2024-04-02T07:24:17.249 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:17.249 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":144,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":46,"num_osds":8,"num_up_osds":8,"osd_up_since":1712042525,"num_in_osds":8,"osd_in_since":1712042515,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":243335168,"bytes_avail":772850778112,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":25,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"b","status":"up:active","gid":5655}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-04-02T07:24:02.357690+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-02T07:24:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.246+0000 7f4257000640 1 -- 172.21.15.55:0/722460533 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f422c066690 msgr2=0x7f422c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.246+0000 7f4257000640 1 --2- 172.21.15.55:0/722460533 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f422c066690 0x7f422c068b50 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f42400ad000 tx=0x7f42400a6000 comp rx=0 tx=0).stop 2024-04-02T07:24:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.246+0000 7f4257000640 1 -- 172.21.15.55:0/722460533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42500b19d0 msgr2=0x7f425015ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.246+0000 7f4257000640 1 --2- 172.21.15.55:0/722460533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42500b19d0 0x7f425015ef20 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f423800d800 tx=0x7f423800dcc0 comp rx=0 tx=0).stop 2024-04-02T07:24:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.246+0000 7f4257000640 1 -- 172.21.15.55:0/722460533 shutdown_connections 2024-04-02T07:24:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.246+0000 7f4257000640 1 --2- 172.21.15.55:0/722460533 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42500cef10 0x7f4250150630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.246+0000 7f4257000640 1 --2- 172.21.15.55:0/722460533 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42500b19d0 0x7f425015ef20 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.246+0000 7f4257000640 1 --2- 172.21.15.55:0/722460533 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f422c066690 0x7f422c068b50 secure :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f42400ad000 tx=0x7f42400a6000 comp rx=0 tx=0).stop 2024-04-02T07:24:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.246+0000 7f4257000640 1 --2- 172.21.15.55:0/722460533 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f425006c0d0 0x7f42500c9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.246+0000 7f4257000640 1 -- 172.21.15.55:0/722460533 >> 172.21.15.55:0/722460533 conn(0x7f42500b2150 msgr2=0x7f4250160460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.246+0000 7f4257000640 1 -- 172.21.15.55:0/722460533 shutdown_connections 2024-04-02T07:24:17.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.246+0000 7f4257000640 1 -- 172.21.15.55:0/722460533 wait complete. 2024-04-02T07:24:17.271 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-02T07:24:17.271 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:24:17.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.406+0000 7f0f19400640 1 Processor -- start 2024-04-02T07:24:17.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.406+0000 7f0f19400640 1 -- start start 2024-04-02T07:24:17.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f19400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f1415f250 0x7f0f14099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:17.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f19400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f140ad270 con 0x7f0f1415ee70 2024-04-02T07:24:17.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f19400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f140b0a50 con 0x7f0f14099120 2024-04-02T07:24:17.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f19400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f140b0840 con 0x7f0f1415f250 2024-04-02T07:24:17.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f12800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0f1415ee70 0x7f0f14098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48184/0 (socket says 172.21.15.55:48184) 2024-04-02T07:24:17.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f12800640 1 -- 172.21.15.55:0/1703656430 learned_addr learned my addr 172.21.15.55:0/1703656430 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:17.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f13200640 1 --2- 172.21.15.55:0/1703656430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f1415f250 0x7f0f14099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:17.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f11e00640 1 -- 172.21.15.55:0/1703656430 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166380799 0 0) 0x7f0f140ad270 con 0x7f0f1415ee70 2024-04-02T07:24:17.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f11e00640 1 -- 172.21.15.55:0/1703656430 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ef8003530 con 0x7f0f1415ee70 2024-04-02T07:24:17.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f11e00640 1 -- 172.21.15.55:0/1703656430 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474027749 0 0) 0x7f0f140b0a50 con 0x7f0f14099120 2024-04-02T07:24:17.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f11e00640 1 -- 172.21.15.55:0/1703656430 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f140ad270 con 0x7f0f14099120 2024-04-02T07:24:17.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f11e00640 1 -- 172.21.15.55:0/1703656430 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1403299285 0 0) 0x7f0ef8003530 con 0x7f0f1415ee70 2024-04-02T07:24:17.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f11e00640 1 -- 172.21.15.55:0/1703656430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f1415f250 msgr2=0x7f0f14099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:17.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f11e00640 1 --2- 172.21.15.55:0/1703656430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f1415f250 0x7f0f14099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:17.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f11e00640 1 -- 172.21.15.55:0/1703656430 >> v1:172.21.15.106:6789/0 conn(0x7f0f14099120 legacy=0x7f0f140ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:17.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f11e00640 1 -- 172.21.15.55:0/1703656430 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f140b0d30 con 0x7f0f1415ee70 2024-04-02T07:24:17.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f11e00640 1 -- 172.21.15.55:0/1703656430 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f0f04001680 con 0x7f0f1415ee70 2024-04-02T07:24:17.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f11e00640 1 -- 172.21.15.55:0/1703656430 >> v1:172.21.15.55:6789/0 conn(0x7f0f1415ee70 legacy=0x7f0f14098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:17.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f11e00640 1 --2- 172.21.15.55:0/1703656430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ef8003b40 0x7f0ef8003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:17.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f11e00640 1 --2- 172.21.15.55:0/1703656430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef80047d0 0x7f0ef8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:17.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f11e00640 1 --2- 172.21.15.55:0/1703656430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ef8005190 0x7f0ef800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:17.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f11e00640 1 -- 172.21.15.55:0/1703656430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f140b0840 con 0x7f0ef80047d0 2024-04-02T07:24:17.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f11e00640 1 -- 172.21.15.55:0/1703656430 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef800bfb0 con 0x7f0ef8005190 2024-04-02T07:24:17.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f11e00640 1 -- 172.21.15.55:0/1703656430 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ef800c170 con 0x7f0ef8003b40 2024-04-02T07:24:17.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f09e00640 1 --2- 172.21.15.55:0/1703656430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef80047d0 0x7f0ef8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:17.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f12800640 1 --2- 172.21.15.55:0/1703656430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ef8003b40 0x7f0ef8003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:17.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f13200640 1 --2- 172.21.15.55:0/1703656430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ef8005190 0x7f0ef800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:17.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f09e00640 1 -- 172.21.15.55:0/1703656430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ef8003b40 msgr2=0x7f0ef8003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:17.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f09e00640 1 --2- 172.21.15.55:0/1703656430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0ef8003b40 0x7f0ef8003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:17.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f09e00640 1 -- 172.21.15.55:0/1703656430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ef8005190 msgr2=0x7f0ef800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:17.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f09e00640 1 --2- 172.21.15.55:0/1703656430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ef8005190 0x7f0ef800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:17.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f09e00640 1 -- 172.21.15.55:0/1703656430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef8003530 con 0x7f0ef80047d0 2024-04-02T07:24:17.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.410+0000 7f0f13200640 1 --2- 172.21.15.55:0/1703656430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ef8005190 0x7f0ef800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:24:17.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.414+0000 7f0f09e00640 1 --2- 172.21.15.55:0/1703656430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef80047d0 0x7f0ef8004c50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0018d0 tx=0x7f0efc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0f0cc6ebe3b5c4f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:17.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.414+0000 7f0f11e00640 1 -- 172.21.15.55:0/1703656430 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0052d0 con 0x7f0ef80047d0 2024-04-02T07:24:17.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.414+0000 7f0f11e00640 1 -- 172.21.15.55:0/1703656430 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc005450 con 0x7f0ef80047d0 2024-04-02T07:24:17.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.414+0000 7f0f11e00640 1 -- 172.21.15.55:0/1703656430 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0a8950 con 0x7f0ef80047d0 2024-04-02T07:24:17.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.414+0000 7f0f19400640 1 -- 172.21.15.55:0/1703656430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef80047d0 msgr2=0x7f0ef8004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:17.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.414+0000 7f0f19400640 1 --2- 172.21.15.55:0/1703656430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0ef80047d0 0x7f0ef8004c50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0018d0 tx=0x7f0efc01ecf0 comp rx=0 tx=0).stop 2024-04-02T07:24:17.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.414+0000 7f0f13200640 1 -- 172.21.15.55:0/1703656430 reap_dead start 2024-04-02T07:24:17.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.414+0000 7f0f19400640 1 -- 172.21.15.55:0/1703656430 shutdown_connections 2024-04-02T07:24:17.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.414+0000 7f0f19400640 1 -- 172.21.15.55:0/1703656430 >> 172.21.15.55:0/1703656430 conn(0x7f0f140b21d0 msgr2=0x7f0f140b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:17.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.414+0000 7f0f19400640 1 -- 172.21.15.55:0/1703656430 shutdown_connections 2024-04-02T07:24:17.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.414+0000 7f0f19400640 1 -- 172.21.15.55:0/1703656430 wait complete. 2024-04-02T07:24:17.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.414+0000 7f0f19400640 1 Processor -- start 2024-04-02T07:24:17.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f19400640 1 -- start start 2024-04-02T07:24:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f19400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ef80047d0 0x7f0f140b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f19400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f141522a0 0x7f0f140ae4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f19400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f140b30b0 0x7f0f140b3530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f19400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f140af920 con 0x7f0f141522a0 2024-04-02T07:24:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f19400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f140b3a70 con 0x7f0ef80047d0 2024-04-02T07:24:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f19400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f140b5ed0 con 0x7f0f140b30b0 2024-04-02T07:24:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f09e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f141522a0 0x7f0f140ae4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f09e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f141522a0 0x7f0f140ae4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33530/0 (socket says 172.21.15.55:33530) 2024-04-02T07:24:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f09e00640 1 -- 172.21.15.55:0/929804820 learned_addr learned my addr 172.21.15.55:0/929804820 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:17.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f13200640 1 --2- 172.21.15.55:0/929804820 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f140b30b0 0x7f0f140b3530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:17.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f12800640 1 --2- 172.21.15.55:0/929804820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ef80047d0 0x7f0f140b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:17.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f09e00640 1 -- 172.21.15.55:0/929804820 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f140b30b0 msgr2=0x7f0f140b3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:17.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f09e00640 1 --2- 172.21.15.55:0/929804820 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f140b30b0 0x7f0f140b3530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:17.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f09e00640 1 -- 172.21.15.55:0/929804820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ef80047d0 msgr2=0x7f0f140b5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:17.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f09e00640 1 --2- 172.21.15.55:0/929804820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ef80047d0 0x7f0f140b5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:17.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f09e00640 1 -- 172.21.15.55:0/929804820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1414dd70 con 0x7f0f141522a0 2024-04-02T07:24:17.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f09e00640 1 --2- 172.21.15.55:0/929804820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f141522a0 0x7f0f140ae4e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0018d0 tx=0x7f0ef8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:17.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f0b400640 1 -- 172.21.15.55:0/929804820 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0050d0 con 0x7f0f141522a0 2024-04-02T07:24:17.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f0b400640 1 -- 172.21.15.55:0/929804820 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0efc005230 con 0x7f0f141522a0 2024-04-02T07:24:17.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f0b400640 1 -- 172.21.15.55:0/929804820 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0efc0a8ea0 con 0x7f0f141522a0 2024-04-02T07:24:17.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f19400640 1 -- 172.21.15.55:0/929804820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f140aed10 con 0x7f0f141522a0 2024-04-02T07:24:17.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f19400640 1 -- 172.21.15.55:0/929804820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f140af2d0 con 0x7f0f141522a0 2024-04-02T07:24:17.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.418+0000 7f0f19400640 1 -- 172.21.15.55:0/929804820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f1414c7e0 con 0x7f0f141522a0 2024-04-02T07:24:17.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.422+0000 7f0f0b400640 1 -- 172.21.15.55:0/929804820 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f0efc003600 con 0x7f0f141522a0 2024-04-02T07:24:17.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.422+0000 7f0f0b400640 1 --2- 172.21.15.55:0/929804820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ef00666c0 0x7f0ef0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:17.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.422+0000 7f0f0b400640 1 -- 172.21.15.55:0/929804820 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0efc121600 con 0x7f0f141522a0 2024-04-02T07:24:17.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.422+0000 7f0f12800640 1 --2- 172.21.15.55:0/929804820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ef00666c0 0x7f0ef0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:17.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.422+0000 7f0f12800640 1 --2- 172.21.15.55:0/929804820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ef00666c0 0x7f0ef0068b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0f04000c10 tx=0x7f0f04000ee0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:17.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.426+0000 7f0f0b400640 1 -- 172.21.15.55:0/929804820 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0f1414c7e0 con 0x7f0f141522a0 2024-04-02T07:24:17.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.582+0000 7f0f19400640 1 -- 172.21.15.55:0/929804820 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0f1414c7e0 con 0x7f0ef00666c0 2024-04-02T07:24:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.590+0000 7f0f0b400640 1 -- 172.21.15.55:0/929804820 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+277783 (secure 0 0 0) 0x7f0f1414c7e0 con 0x7f0ef00666c0 2024-04-02T07:24:17.596 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:17.598 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:24:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.594+0000 7f0f19400640 1 -- 172.21.15.55:0/929804820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ef00666c0 msgr2=0x7f0ef0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.594+0000 7f0f19400640 1 --2- 172.21.15.55:0/929804820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ef00666c0 0x7f0ef0068b80 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f0f04000c10 tx=0x7f0f04000ee0 comp rx=0 tx=0).stop 2024-04-02T07:24:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.594+0000 7f0f19400640 1 -- 172.21.15.55:0/929804820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f141522a0 msgr2=0x7f0f140ae4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:17.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.594+0000 7f0f19400640 1 --2- 172.21.15.55:0/929804820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f141522a0 0x7f0f140ae4e0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0efc0018d0 tx=0x7f0ef8005800 comp rx=0 tx=0).stop 2024-04-02T07:24:17.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.594+0000 7f0f19400640 1 -- 172.21.15.55:0/929804820 shutdown_connections 2024-04-02T07:24:17.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.594+0000 7f0f19400640 1 --2- 172.21.15.55:0/929804820 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f140b30b0 0x7f0f140b3530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:17.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.594+0000 7f0f19400640 1 --2- 172.21.15.55:0/929804820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f141522a0 0x7f0f140ae4e0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:17.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.594+0000 7f0f19400640 1 --2- 172.21.15.55:0/929804820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ef00666c0 0x7f0ef0068b80 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:17.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.594+0000 7f0f19400640 1 --2- 172.21.15.55:0/929804820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0ef80047d0 0x7f0f140b5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:17.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.594+0000 7f0f19400640 1 -- 172.21.15.55:0/929804820 >> 172.21.15.55:0/929804820 conn(0x7f0f140b21d0 msgr2=0x7f0f140cc780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:17.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.594+0000 7f0f19400640 1 -- 172.21.15.55:0/929804820 shutdown_connections 2024-04-02T07:24:17.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:17.594+0000 7f0f19400640 1 -- 172.21.15.55:0/929804820 wait complete. 2024-04-02T07:24:17.617 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2024-04-02T07:24:16.360706+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":237632,"kb_used_data":5072,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754737088,"statfs":{"total":773094113280,"available":772850778112,"internally_reserved":0,"allocated":5193728,"data_stored":2777582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.850013"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.511543+0000","last_change":"2024-04-02T07:24:10.511543+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.511543+0000","last_undegraded":"2024-04-02T07:24:10.511543+0000","last_fullsized":"2024-04-02T07:24:10.511543+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:00:31.241815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.516293+0000","last_change":"2024-04-02T07:24:10.516293+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.516293+0000","last_undegraded":"2024-04-02T07:24:10.516293+0000","last_fullsized":"2024-04-02T07:24:10.516293+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:20:10.281531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512337+0000","last_change":"2024-04-02T07:24:10.512337+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512337+0000","last_undegraded":"2024-04-02T07:24:10.512337+0000","last_fullsized":"2024-04-02T07:24:10.512337+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:05:52.333856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.513927+0000","last_change":"2024-04-02T07:24:10.513927+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.513927+0000","last_undegraded":"2024-04-02T07:24:10.513927+0000","last_fullsized":"2024-04-02T07:24:10.513927+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:14:08.858057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512563+0000","last_change":"2024-04-02T07:24:10.512563+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512563+0000","last_undegraded":"2024-04-02T07:24:10.512563+0000","last_fullsized":"2024-04-02T07:24:10.512563+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:12:21.124664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.516499+0000","last_change":"2024-04-02T07:24:10.516499+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.516499+0000","last_undegraded":"2024-04-02T07:24:10.516499+0000","last_fullsized":"2024-04-02T07:24:10.516499+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:50:14.697045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512279+0000","last_change":"2024-04-02T07:24:10.512279+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512279+0000","last_undegraded":"2024-04-02T07:24:10.512279+0000","last_fullsized":"2024-04-02T07:24:10.512279+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:18:59.945527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.509876+0000","last_change":"2024-04-02T07:24:10.509876+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.509876+0000","last_undegraded":"2024-04-02T07:24:10.509876+0000","last_fullsized":"2024-04-02T07:24:10.509876+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:54:03.635207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.515953+0000","last_change":"2024-04-02T07:24:10.515953+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.515953+0000","last_undegraded":"2024-04-02T07:24:10.515953+0000","last_fullsized":"2024-04-02T07:24:10.515953+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:56:10.784349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.509424+0000","last_change":"2024-04-02T07:24:10.509424+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.509424+0000","last_undegraded":"2024-04-02T07:24:10.509424+0000","last_fullsized":"2024-04-02T07:24:10.509424+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:18:20.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.514857+0000","last_change":"2024-04-02T07:24:10.514857+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.514857+0000","last_undegraded":"2024-04-02T07:24:10.514857+0000","last_fullsized":"2024-04-02T07:24:10.514857+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:55:23.427125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.517980+0000","last_change":"2024-04-02T07:24:10.517980+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.517980+0000","last_undegraded":"2024-04-02T07:24:10.517980+0000","last_fullsized":"2024-04-02T07:24:10.517980+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:15:57.473214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512166+0000","last_change":"2024-04-02T07:24:10.512166+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512166+0000","last_undegraded":"2024-04-02T07:24:10.512166+0000","last_fullsized":"2024-04-02T07:24:10.512166+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:05:42.639900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.514265+0000","last_change":"2024-04-02T07:24:10.514265+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.514265+0000","last_undegraded":"2024-04-02T07:24:10.514265+0000","last_fullsized":"2024-04-02T07:24:10.514265+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:00:31.241815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.511643+0000","last_change":"2024-04-02T07:24:10.511643+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.511643+0000","last_undegraded":"2024-04-02T07:24:10.511643+0000","last_fullsized":"2024-04-02T07:24:10.511643+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:14:08.858057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.509418+0000","last_change":"2024-04-02T07:24:10.509418+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.509418+0000","last_undegraded":"2024-04-02T07:24:10.509418+0000","last_fullsized":"2024-04-02T07:24:10.509418+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:20:10.281531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.518359+0000","last_change":"2024-04-02T07:24:10.518359+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.518359+0000","last_undegraded":"2024-04-02T07:24:10.518359+0000","last_fullsized":"2024-04-02T07:24:10.518359+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:33:20.814250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.515570+0000","last_change":"2024-04-02T07:24:10.515570+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.515570+0000","last_undegraded":"2024-04-02T07:24:10.515570+0000","last_fullsized":"2024-04-02T07:24:10.515570+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:18:20.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512642+0000","last_change":"2024-04-02T07:24:10.512642+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512642+0000","last_undegraded":"2024-04-02T07:24:10.512642+0000","last_fullsized":"2024-04-02T07:24:10.512642+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:45:51.236711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.511517+0000","last_change":"2024-04-02T07:24:10.511517+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.511517+0000","last_undegraded":"2024-04-02T07:24:10.511517+0000","last_fullsized":"2024-04-02T07:24:10.511517+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:58.481260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.511572+0000","last_change":"2024-04-02T07:24:10.511572+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.511572+0000","last_undegraded":"2024-04-02T07:24:10.511572+0000","last_fullsized":"2024-04-02T07:24:10.511572+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:55:23.427125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512840+0000","last_change":"2024-04-02T07:24:10.512840+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512840+0000","last_undegraded":"2024-04-02T07:24:10.512840+0000","last_fullsized":"2024-04-02T07:24:10.512840+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:41:58.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.508727+0000","last_change":"2024-04-02T07:24:10.508727+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.508727+0000","last_undegraded":"2024-04-02T07:24:10.508727+0000","last_fullsized":"2024-04-02T07:24:10.508727+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:19:53.123928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.513682+0000","last_change":"2024-04-02T07:24:10.513682+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.513682+0000","last_undegraded":"2024-04-02T07:24:10.513682+0000","last_fullsized":"2024-04-02T07:24:10.513682+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:58.481260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.511454+0000","last_change":"2024-04-02T07:24:10.511454+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.511454+0000","last_undegraded":"2024-04-02T07:24:10.511454+0000","last_fullsized":"2024-04-02T07:24:10.511454+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:04:08.094127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.514408+0000","last_change":"2024-04-02T07:24:10.514408+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.514408+0000","last_undegraded":"2024-04-02T07:24:10.514408+0000","last_fullsized":"2024-04-02T07:24:10.514408+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:05:42.639900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512172+0000","last_change":"2024-04-02T07:24:10.512172+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512172+0000","last_undegraded":"2024-04-02T07:24:10.512172+0000","last_fullsized":"2024-04-02T07:24:10.512172+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:49:40.986769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.513235+0000","last_change":"2024-04-02T07:24:10.513235+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.513235+0000","last_undegraded":"2024-04-02T07:24:10.513235+0000","last_fullsized":"2024-04-02T07:24:10.513235+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:12:21.124664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.515981+0000","last_change":"2024-04-02T07:24:10.515981+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.515981+0000","last_undegraded":"2024-04-02T07:24:10.515981+0000","last_fullsized":"2024-04-02T07:24:10.515981+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:19:53.123928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512184+0000","last_change":"2024-04-02T07:24:10.512184+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512184+0000","last_undegraded":"2024-04-02T07:24:10.512184+0000","last_fullsized":"2024-04-02T07:24:10.512184+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:42:08.977549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.508727+0000","last_change":"2024-04-02T07:24:10.508727+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.508727+0000","last_undegraded":"2024-04-02T07:24:10.508727+0000","last_fullsized":"2024-04-02T07:24:10.508727+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:30:39.543249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:24:11.506601+0000","last_change":"2024-04-02T07:24:11.506601+0000","last_active":"2024-04-02T07:24:11.506601+0000","last_peered":"2024-04-02T07:24:11.506601+0000","last_clean":"2024-04-02T07:24:11.506601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:11.506601+0000","last_undegraded":"2024-04-02T07:24:11.506601+0000","last_fullsized":"2024-04-02T07:24:11.506601+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":43,"state":"creating+peering","last_fresh":"2024-04-02T07:24:10.512493+0000","last_change":"2024-04-02T07:24:10.512493+0000","last_active":"2024-04-02T07:24:10.503751+0000","last_peered":"2024-04-02T07:24:10.503751+0000","last_clean":"2024-04-02T07:24:10.503751+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:24:10.512493+0000","last_undegraded":"2024-04-02T07:24:10.512493+0000","last_fullsized":"2024-04-02T07:24:10.512493+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:11:13.000802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":184,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-02T07:24:10.513949+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:24:10.513949+0000","last_peered":"2024-04-02T07:24:10.513949+0000","last_clean":"2024-04-02T07:24:10.513949+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:24:10.513949+0000","last_undegraded":"2024-04-02T07:24:10.513949+0000","last_fullsized":"2024-04-02T07:24:10.513949+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28088,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343752,"statfs":{"total":96636764160,"available":96608002048,"internally_reserved":0,"allocated":1085440,"data_stored":785611,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64200000000000002,"15min":0.64100000000000001},"min":{"1min":0.441,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88300000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.501},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.60999999999999999,"15min":0.59799999999999998},"min":{"1min":0.48299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.64300000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.628,"15min":0.624},"min":{"1min":0.436,"5min":0.379,"15min":0.379},"max":{"1min":0.84299999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.436},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86199999999999999,"5min":1.113,"15min":1.113},"last":0.60199999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.747,"15min":0.75},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.93999999999999995,"5min":1.139,"15min":1.139},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.5,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96299999999999997,"5min":1.522,"15min":1.522},"last":0.57999999999999996}]},{"osd":3,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.50700000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92700000000000005,"5min":1.405,"15min":1.405},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72699999999999998,"15min":0.72799999999999998},"min":{"1min":0.58599999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92300000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.74399999999999999}]},{"osd":4,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68799999999999994,"15min":0.70299999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81499999999999995,"5min":1.633,"15min":1.633},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.874,"5min":1.079,"15min":1.079},"last":0.66700000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72299999999999998,"15min":0.74099999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94499999999999995,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.78700000000000003,"15min":0.79900000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95499999999999996,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.76700000000000002}]},{"osd":6,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82799999999999996,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.69799999999999995,"15min":0.71499999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82499999999999996,"5min":1,"15min":1},"last":0.626}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":201060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66200000000000003,"15min":0.66300000000000003},"min":{"1min":0.48299999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86199999999999999,"5min":1.399,"15min":1.399},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.88,"15min":0.91900000000000004},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95999999999999996,"5min":5.7569999999999997,"15min":5.7569999999999997},"last":0.56599999999999995}]},{"osd":1,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.52600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.93899999999999995,"5min":1.95,"15min":1.95},"last":0.75},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95799999999999996,"5min":1.248,"15min":1.248},"last":0.67200000000000004}]},{"osd":2,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.54900000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89300000000000002,"5min":1.226,"15min":1.226},"last":0.501},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71199999999999997,"15min":0.70999999999999996},"min":{"1min":0.55700000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.58599999999999997}]},{"osd":3,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.81000000000000005,"15min":0.82499999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.88,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.628},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.52600000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97899999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.64600000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.91000000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.76400000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.68000000000000005,"15min":0.68799999999999994},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89500000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73799999999999999,"15min":0.73999999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98999999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.80200000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.745,"15min":0.753},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93400000000000005,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.56299999999999994,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97099999999999997,"5min":0.999,"15min":0.999},"last":0.78400000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":201060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86199999999999999,"5min":1.25,"15min":1.25},"last":0.622},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.70899999999999996},"min":{"1min":0.48899999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91300000000000003,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.83799999999999997}]},{"osd":1,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97399999999999998,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72499999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.97899999999999998,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.60099999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.82299999999999995,"15min":0.83499999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98399999999999999,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.751},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.74299999999999999,"15min":0.752},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95699999999999996,"5min":1.696,"15min":1.696},"last":0.71199999999999997}]},{"osd":3,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.76100000000000001,"15min":0.77300000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.99099999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.82499999999999996,"15min":0.84199999999999997},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.65800000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.71599999999999997,"15min":0.74199999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90500000000000003,"5min":1.911,"15min":1.911},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.77800000000000002,"15min":0.81000000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.92400000000000004,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.78500000000000003}]},{"osd":6,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.86099999999999999,"15min":0.89400000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.95799999999999996,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.84599999999999997,"15min":0.878},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0269999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.76500000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.86199999999999999,"15min":0.89400000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.038,"5min":1.887,"15min":1.887},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.91300000000000003,"15min":0.94799999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.012,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.69799999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":503808,"data_stored":201060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.746,"15min":0.75900000000000001},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91800000000000004,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.81999999999999995,"15min":0.84999999999999998},"min":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81499999999999995,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.67100000000000004}]},{"osd":1,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76300000000000001,"15min":0.77000000000000002},"min":{"1min":0.56200000000000006,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90600000000000003,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.90800000000000003,"15min":0.94199999999999995},"min":{"1min":0.54200000000000004,"5min":0.503,"15min":0.503},"max":{"1min":0.97399999999999998,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":0.69699999999999995}]},{"osd":2,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.80400000000000005,"15min":0.81499999999999995},"min":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.93999999999999995,"5min":2.056,"15min":2.056},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.878,"15min":0.90200000000000002},"min":{"1min":0.59399999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.874,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.82499999999999996}]},{"osd":3,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.999,"15min":1.0369999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.97899999999999998,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.77600000000000002,"5min":1.012,"15min":1.0509999999999999},"min":{"1min":0.65200000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.91700000000000004,"5min":3.9750000000000001,"15min":3.9750000000000001},"last":1.014}]},{"osd":5,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71999999999999997,"15min":0.72499999999999998},"min":{"1min":0.439,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91000000000000003,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.45800000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95499999999999996,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1.0549999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":0.72999999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.085,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":1.123},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79300000000000004,"15min":0.79400000000000004},"min":{"1min":0.57799999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98399999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.99199999999999999}]},{"osd":7,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.026,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":1.1060000000000001},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.68500000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.0640000000000001,"5min":1.353,"15min":1.353},"last":1.1499999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":503808,"data_stored":201060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.44900000000000001,"15min":0.45400000000000001},"min":{"1min":0.26600000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56599999999999995,"5min":0.62,"15min":0.62},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.746,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.35199999999999998}]},{"osd":1,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.434,"15min":0.434},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.61399999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.52300000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.374},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.65300000000000002,"5min":1.306,"15min":1.306},"last":0.496}]},{"osd":4,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.012,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98999999999999999,"5min":1.155,"15min":1.155},"last":0.79300000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77300000000000002,"15min":0.77500000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.74199999999999999,"15min":0.74399999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.038,"5min":1.135,"15min":1.135},"last":0.88300000000000001}]},{"osd":6,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0700000000000001,"5min":1.25,"15min":1.25},"last":0.90700000000000003},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.095,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.92600000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1319999999999999,"5min":1.216,"15min":1.216},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.746,"5min":0.78900000000000003,"15min":0.79600000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.046,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.81299999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31604,"kb_used_data":480,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340236,"statfs":{"total":96636764160,"available":96604401664,"internally_reserved":0,"allocated":491520,"data_stored":195243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57399999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47999999999999998,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.42199999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80800000000000005,"5min":1.171,"15min":1.171},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48799999999999999,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64500000000000002,"5min":1.333,"15min":1.333},"last":0.48899999999999999}]},{"osd":3,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51700000000000002,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72099999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.39900000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.76400000000000001,"15min":0.77400000000000002},"min":{"1min":0.47699999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0109999999999999,"5min":2.254,"15min":2.254},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76500000000000001,"15min":0.76600000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.016,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.73199999999999998}]},{"osd":5,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.52600000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.80900000000000005,"15min":0.81799999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.093,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.85899999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.61099999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0369999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.82099999999999995,"15min":0.82399999999999995},"min":{"1min":0.62,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.105,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.77600000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0549999999999999,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.81200000000000006},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82399999999999995,"15min":0.82799999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0629999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.69399999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31608,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340232,"statfs":{"total":96636764160,"available":96604397568,"internally_reserved":0,"allocated":503808,"data_stored":201060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.254,"5min":0.251,"15min":0.251},"max":{"1min":0.60399999999999998,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.501},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.65300000000000002,"15min":0.67500000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.093,"5min":4.157,"15min":4.157},"last":0.26200000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.65600000000000003,"15min":0.69199999999999995},"min":{"1min":0.32700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68500000000000005,"5min":4.282,"15min":4.282},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79500000000000004,"5min":1.625,"15min":1.625},"last":0.55800000000000005}]},{"osd":3,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60999999999999999,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72099999999999997,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.91100000000000003,"15min":0.97199999999999998},"min":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.052,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.38400000000000001}]},{"osd":4,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.96599999999999997,"15min":1.006},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0900000000000001,"5min":4.7400000000000002,"15min":4.7400000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.82799999999999996,"15min":0.83999999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.99199999999999999,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.624}]},{"osd":5,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.95899999999999996,"15min":0.98199999999999998},"min":{"1min":0.53900000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.163,"5min":4.5759999999999996,"15min":4.5759999999999996},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.95499999999999996,"15min":0.98699999999999999},"min":{"1min":0.48999999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0089999999999999,"5min":4.7949999999999999,"15min":4.7949999999999999},"last":0.48999999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":1.0029999999999999,"15min":1.0389999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.129,"5min":4.6890000000000001,"15min":4.6890000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.97299999999999998,"15min":1.01},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0620000000000001,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.52100000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.83799999999999997,"15min":0.84999999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0069999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.98799999999999999,"15min":1.0129999999999999},"min":{"1min":0.55800000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.383,"5min":4.6420000000000003,"15min":4.6420000000000003},"last":0.58599999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1097728,"data_stored":791428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.47399999999999998,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.622,"5min":1.48,"15min":1.48},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.51000000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74399999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.39900000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.34000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79100000000000004,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51900000000000002,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.434}]},{"osd":3,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.32600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.56999999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.61899999999999999,"15min":0.63100000000000001},"min":{"1min":0.41799999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.69899999999999995,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.47799999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.90600000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.53700000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.68400000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.78900000000000003,"15min":0.79900000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94099999999999995,"5min":1.371,"15min":1.371},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.97899999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.60599999999999998}]},{"osd":6,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.58799999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.018,"5min":1.177,"15min":1.177},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.83499999999999996,"15min":0.84899999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.002,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.622}]},{"osd":7,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.56299999999999994,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.069,"5min":1.135,"15min":1.135},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.92400000000000004,"5min":1.141,"15min":1.141},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:24:20.623 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:24:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.774+0000 7f7743e00640 1 Processor -- start 2024-04-02T07:24:20.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.774+0000 7f7743e00640 1 -- start start 2024-04-02T07:24:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.774+0000 7f7743e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f773c143f90 0x7f773c15ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.774+0000 7f7743e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f773c0b34f0 0x7f773c0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.774+0000 7f7743e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f773c15b270 con 0x7f773c0b3950 2024-04-02T07:24:20.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.774+0000 7f7743e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f773c144370 con 0x7f773c143f90 2024-04-02T07:24:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.774+0000 7f7743e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c0c37b0 con 0x7f773c0b34f0 2024-04-02T07:24:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.774+0000 7f7741400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f773c143f90 0x7f773c15ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.774+0000 7f7741e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f773c0b3950 0x7f773c0c4850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48194/0 (socket says 172.21.15.55:48194) 2024-04-02T07:24:20.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.774+0000 7f7741e00640 1 -- 172.21.15.55:0/229832261 learned_addr learned my addr 172.21.15.55:0/229832261 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.774+0000 7f7740a00640 1 --2- 172.21.15.55:0/229832261 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f773c0b34f0 0x7f773c0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.774+0000 7f7741400640 1 -- 172.21.15.55:0/229832261 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f773c0b34f0 msgr2=0x7f773c0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.774+0000 7f7741400640 1 --2- 172.21.15.55:0/229832261 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f773c0b34f0 0x7f773c0cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.774+0000 7f7741400640 1 -- 172.21.15.55:0/229832261 >> v1:172.21.15.55:6789/0 conn(0x7f773c0b3950 legacy=0x7f773c0c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.774+0000 7f7741400640 1 -- 172.21.15.55:0/229832261 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f773c0c3a90 con 0x7f773c143f90 2024-04-02T07:24:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.774+0000 7f7740a00640 1 --2- 172.21.15.55:0/229832261 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f773c0b34f0 0x7f773c0cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:20.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.774+0000 7f773be00640 1 -- 172.21.15.55:0/229832261 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587255907 0 0) 0x7f773c15b270 con 0x7f773c0b3950 2024-04-02T07:24:20.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.778+0000 7f7741400640 1 --2- 172.21.15.55:0/229832261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f773c143f90 0x7f773c15ad30 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f77300097c0 tx=0x7f773001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cfde6834e6d45f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:20.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.778+0000 7f773be00640 1 -- 172.21.15.55:0/229832261 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77300ab600 con 0x7f773c143f90 2024-04-02T07:24:20.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.778+0000 7f773be00640 1 -- 172.21.15.55:0/229832261 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77300a7050 con 0x7f773c143f90 2024-04-02T07:24:20.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.778+0000 7f773be00640 1 -- 172.21.15.55:0/229832261 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77300ab980 con 0x7f773c143f90 2024-04-02T07:24:20.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.778+0000 7f7743e00640 1 -- 172.21.15.55:0/229832261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f773c143f90 msgr2=0x7f773c15ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:20.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.778+0000 7f7743e00640 1 --2- 172.21.15.55:0/229832261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f773c143f90 0x7f773c15ad30 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f77300097c0 tx=0x7f773001c3e0 comp rx=0 tx=0).stop 2024-04-02T07:24:20.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.778+0000 7f7743e00640 1 -- 172.21.15.55:0/229832261 shutdown_connections 2024-04-02T07:24:20.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.778+0000 7f7743e00640 1 --2- 172.21.15.55:0/229832261 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f773c0b34f0 0x7f773c0cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:20.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.778+0000 7f7743e00640 1 --2- 172.21.15.55:0/229832261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f773c143f90 0x7f773c15ad30 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:20.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.778+0000 7f7743e00640 1 -- 172.21.15.55:0/229832261 >> 172.21.15.55:0/229832261 conn(0x7f773c066080 msgr2=0x7f773c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:20.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.778+0000 7f7743e00640 1 -- 172.21.15.55:0/229832261 shutdown_connections 2024-04-02T07:24:20.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.778+0000 7f7743e00640 1 -- 172.21.15.55:0/229832261 wait complete. 2024-04-02T07:24:20.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7743e00640 1 Processor -- start 2024-04-02T07:24:20.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7743e00640 1 -- start start 2024-04-02T07:24:20.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7743e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f773c0b34f0 0x7f773c15a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:20.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7743e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f773c0b3950 0x7f773c0c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:20.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7743e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f773c143f90 0x7f773c0c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:20.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7743e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c15a6a0 con 0x7f773c0b3950 2024-04-02T07:24:20.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7743e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f773c0c9b70 con 0x7f773c143f90 2024-04-02T07:24:20.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7743e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f773c0c9e50 con 0x7f773c0b34f0 2024-04-02T07:24:20.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7740a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f773c0b3950 0x7f773c0c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:20.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7740a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f773c0b3950 0x7f773c0c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33542/0 (socket says 172.21.15.55:33542) 2024-04-02T07:24:20.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7740a00640 1 -- 172.21.15.55:0/193458297 learned_addr learned my addr 172.21.15.55:0/193458297 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:20.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7741e00640 1 --2- 172.21.15.55:0/193458297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f773c143f90 0x7f773c0c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:20.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7741400640 1 --2- 172.21.15.55:0/193458297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f773c0b34f0 0x7f773c15a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:20.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7740a00640 1 -- 172.21.15.55:0/193458297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f773c0b34f0 msgr2=0x7f773c15a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:20.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7740a00640 1 --2- 172.21.15.55:0/193458297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f773c0b34f0 0x7f773c15a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:20.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7740a00640 1 -- 172.21.15.55:0/193458297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f773c143f90 msgr2=0x7f773c0c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:20.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7740a00640 1 --2- 172.21.15.55:0/193458297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f773c143f90 0x7f773c0c94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:20.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7740a00640 1 -- 172.21.15.55:0/193458297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7730009420 con 0x7f773c0b3950 2024-04-02T07:24:20.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7740a00640 1 --2- 172.21.15.55:0/193458297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f773c0b3950 0x7f773c0c8fb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f772800d800 tx=0x7f772800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:20.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7739600640 1 -- 172.21.15.55:0/193458297 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772800b6c0 con 0x7f773c0b3950 2024-04-02T07:24:20.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7739600640 1 -- 172.21.15.55:0/193458297 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f772800b820 con 0x7f773c0b3950 2024-04-02T07:24:20.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7739600640 1 -- 172.21.15.55:0/193458297 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f772800bbd0 con 0x7f773c0b3950 2024-04-02T07:24:20.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7743e00640 1 -- 172.21.15.55:0/193458297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f773c0ca130 con 0x7f773c0b3950 2024-04-02T07:24:20.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.782+0000 7f7743e00640 1 -- 172.21.15.55:0/193458297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f773c0ca6f0 con 0x7f773c0b3950 2024-04-02T07:24:20.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.786+0000 7f7743e00640 1 -- 172.21.15.55:0/193458297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f773c066c90 con 0x7f773c0b3950 2024-04-02T07:24:20.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.786+0000 7f7739600640 1 -- 172.21.15.55:0/193458297 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f772800bd30 con 0x7f773c0b3950 2024-04-02T07:24:20.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.786+0000 7f7739600640 1 --2- 172.21.15.55:0/193458297 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f771c066690 0x7f771c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:20.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.786+0000 7f7739600640 1 -- 172.21.15.55:0/193458297 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77280845e0 con 0x7f773c0b3950 2024-04-02T07:24:20.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.786+0000 7f7741400640 1 --2- 172.21.15.55:0/193458297 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f771c066690 0x7f771c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:20.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.790+0000 7f7741400640 1 --2- 172.21.15.55:0/193458297 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f771c066690 0x7f771c068b50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f77300ad000 tx=0x7f7730008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:20.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.790+0000 7f7739600640 1 -- 172.21.15.55:0/193458297 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7728051960 con 0x7f773c0b3950 2024-04-02T07:24:20.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.946+0000 7f7743e00640 1 -- 172.21.15.55:0/193458297 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f773c0c5370 con 0x7f771c066690 2024-04-02T07:24:20.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.954+0000 7f7739600640 1 -- 172.21.15.55:0/193458297 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288755 (secure 0 0 0) 0x7f77300bc090 con 0x7f771c066690 2024-04-02T07:24:20.962 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:20.964 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:24:20.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.958+0000 7f7743e00640 1 -- 172.21.15.55:0/193458297 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f771c066690 msgr2=0x7f771c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:20.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.958+0000 7f7743e00640 1 --2- 172.21.15.55:0/193458297 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f771c066690 0x7f771c068b50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f77300ad000 tx=0x7f7730008040 comp rx=0 tx=0).stop 2024-04-02T07:24:20.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.958+0000 7f7743e00640 1 -- 172.21.15.55:0/193458297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f773c0b3950 msgr2=0x7f773c0c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:20.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.958+0000 7f7743e00640 1 --2- 172.21.15.55:0/193458297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f773c0b3950 0x7f773c0c8fb0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f772800d800 tx=0x7f772800dcc0 comp rx=0 tx=0).stop 2024-04-02T07:24:20.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.958+0000 7f7743e00640 1 -- 172.21.15.55:0/193458297 shutdown_connections 2024-04-02T07:24:20.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.958+0000 7f7743e00640 1 --2- 172.21.15.55:0/193458297 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f771c066690 0x7f771c068b50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:20.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.958+0000 7f7743e00640 1 --2- 172.21.15.55:0/193458297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f773c143f90 0x7f773c0c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:20.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.958+0000 7f7743e00640 1 --2- 172.21.15.55:0/193458297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f773c0b3950 0x7f773c0c8fb0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:20.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.958+0000 7f7743e00640 1 --2- 172.21.15.55:0/193458297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f773c0b34f0 0x7f773c15a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:20.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.958+0000 7f7743e00640 1 -- 172.21.15.55:0/193458297 >> 172.21.15.55:0/193458297 conn(0x7f773c066080 msgr2=0x7f773c164f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:20.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.958+0000 7f7743e00640 1 -- 172.21.15.55:0/193458297 shutdown_connections 2024-04-02T07:24:20.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:20.958+0000 7f7743e00640 1 -- 172.21.15.55:0/193458297 wait complete. 2024-04-02T07:24:20.981 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":106,"stamp":"2024-04-02T07:24:20.361633+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":238004,"kb_used_data":5448,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754736716,"statfs":{"total":773094113280,"available":772850397184,"internally_reserved":0,"allocated":5578752,"data_stored":2948676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.428975"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047491+0000","last_change":"2024-04-02T07:24:11.967297+0000","last_active":"2024-04-02T07:24:13.047491+0000","last_peered":"2024-04-02T07:24:13.047491+0000","last_clean":"2024-04-02T07:24:13.047491+0000","last_became_active":"2024-04-02T07:24:11.965767+0000","last_became_peered":"2024-04-02T07:24:11.965767+0000","last_unstale":"2024-04-02T07:24:13.047491+0000","last_undegraded":"2024-04-02T07:24:13.047491+0000","last_fullsized":"2024-04-02T07:24:13.047491+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:45:07.156605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.949009+0000","last_change":"2024-04-02T07:24:11.959051+0000","last_active":"2024-04-02T07:24:12.949009+0000","last_peered":"2024-04-02T07:24:12.949009+0000","last_clean":"2024-04-02T07:24:12.949009+0000","last_became_active":"2024-04-02T07:24:11.958632+0000","last_became_peered":"2024-04-02T07:24:11.958632+0000","last_unstale":"2024-04-02T07:24:12.949009+0000","last_undegraded":"2024-04-02T07:24:12.949009+0000","last_fullsized":"2024-04-02T07:24:12.949009+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:51:50.616189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.048489+0000","last_change":"2024-04-02T07:24:11.949380+0000","last_active":"2024-04-02T07:24:13.048489+0000","last_peered":"2024-04-02T07:24:13.048489+0000","last_clean":"2024-04-02T07:24:13.048489+0000","last_became_active":"2024-04-02T07:24:11.948959+0000","last_became_peered":"2024-04-02T07:24:11.948959+0000","last_unstale":"2024-04-02T07:24:13.048489+0000","last_undegraded":"2024-04-02T07:24:13.048489+0000","last_fullsized":"2024-04-02T07:24:13.048489+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:14:09.860907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047741+0000","last_change":"2024-04-02T07:24:11.953694+0000","last_active":"2024-04-02T07:24:13.047741+0000","last_peered":"2024-04-02T07:24:13.047741+0000","last_clean":"2024-04-02T07:24:13.047741+0000","last_became_active":"2024-04-02T07:24:11.953022+0000","last_became_peered":"2024-04-02T07:24:11.953022+0000","last_unstale":"2024-04-02T07:24:13.047741+0000","last_undegraded":"2024-04-02T07:24:13.047741+0000","last_fullsized":"2024-04-02T07:24:13.047741+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:27:50.181396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.948777+0000","last_change":"2024-04-02T07:24:11.958949+0000","last_active":"2024-04-02T07:24:12.948777+0000","last_peered":"2024-04-02T07:24:12.948777+0000","last_clean":"2024-04-02T07:24:12.948777+0000","last_became_active":"2024-04-02T07:24:11.958704+0000","last_became_peered":"2024-04-02T07:24:11.958704+0000","last_unstale":"2024-04-02T07:24:12.948777+0000","last_undegraded":"2024-04-02T07:24:12.948777+0000","last_fullsized":"2024-04-02T07:24:12.948777+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:42:55.496971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.949190+0000","last_change":"2024-04-02T07:24:11.957575+0000","last_active":"2024-04-02T07:24:12.949190+0000","last_peered":"2024-04-02T07:24:12.949190+0000","last_clean":"2024-04-02T07:24:12.949190+0000","last_became_active":"2024-04-02T07:24:11.957206+0000","last_became_peered":"2024-04-02T07:24:11.957206+0000","last_unstale":"2024-04-02T07:24:12.949190+0000","last_undegraded":"2024-04-02T07:24:12.949190+0000","last_fullsized":"2024-04-02T07:24:12.949190+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:25:39.381679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047409+0000","last_change":"2024-04-02T07:24:11.966522+0000","last_active":"2024-04-02T07:24:13.047409+0000","last_peered":"2024-04-02T07:24:13.047409+0000","last_clean":"2024-04-02T07:24:13.047409+0000","last_became_active":"2024-04-02T07:24:11.966247+0000","last_became_peered":"2024-04-02T07:24:11.966247+0000","last_unstale":"2024-04-02T07:24:13.047409+0000","last_undegraded":"2024-04-02T07:24:13.047409+0000","last_fullsized":"2024-04-02T07:24:13.047409+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:09:29.307486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047244+0000","last_change":"2024-04-02T07:24:11.942803+0000","last_active":"2024-04-02T07:24:13.047244+0000","last_peered":"2024-04-02T07:24:13.047244+0000","last_clean":"2024-04-02T07:24:13.047244+0000","last_became_active":"2024-04-02T07:24:11.942555+0000","last_became_peered":"2024-04-02T07:24:11.942555+0000","last_unstale":"2024-04-02T07:24:13.047244+0000","last_undegraded":"2024-04-02T07:24:13.047244+0000","last_fullsized":"2024-04-02T07:24:13.047244+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:42:55.496971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047977+0000","last_change":"2024-04-02T07:24:11.958156+0000","last_active":"2024-04-02T07:24:13.047977+0000","last_peered":"2024-04-02T07:24:13.047977+0000","last_clean":"2024-04-02T07:24:13.047977+0000","last_became_active":"2024-04-02T07:24:11.956761+0000","last_became_peered":"2024-04-02T07:24:11.956761+0000","last_unstale":"2024-04-02T07:24:13.047977+0000","last_undegraded":"2024-04-02T07:24:13.047977+0000","last_fullsized":"2024-04-02T07:24:13.047977+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:13:29.529707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047954+0000","last_change":"2024-04-02T07:24:11.953321+0000","last_active":"2024-04-02T07:24:13.047954+0000","last_peered":"2024-04-02T07:24:13.047954+0000","last_clean":"2024-04-02T07:24:13.047954+0000","last_became_active":"2024-04-02T07:24:11.953046+0000","last_became_peered":"2024-04-02T07:24:11.953046+0000","last_unstale":"2024-04-02T07:24:13.047954+0000","last_undegraded":"2024-04-02T07:24:13.047954+0000","last_fullsized":"2024-04-02T07:24:13.047954+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:43:36.398251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047867+0000","last_change":"2024-04-02T07:24:11.955166+0000","last_active":"2024-04-02T07:24:13.047867+0000","last_peered":"2024-04-02T07:24:13.047867+0000","last_clean":"2024-04-02T07:24:13.047867+0000","last_became_active":"2024-04-02T07:24:11.954931+0000","last_became_peered":"2024-04-02T07:24:11.954931+0000","last_unstale":"2024-04-02T07:24:13.047867+0000","last_undegraded":"2024-04-02T07:24:13.047867+0000","last_fullsized":"2024-04-02T07:24:13.047867+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:23:43.578859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.948728+0000","last_change":"2024-04-02T07:24:11.964004+0000","last_active":"2024-04-02T07:24:12.948728+0000","last_peered":"2024-04-02T07:24:12.948728+0000","last_clean":"2024-04-02T07:24:12.948728+0000","last_became_active":"2024-04-02T07:24:11.962599+0000","last_became_peered":"2024-04-02T07:24:11.962599+0000","last_unstale":"2024-04-02T07:24:12.948728+0000","last_undegraded":"2024-04-02T07:24:12.948728+0000","last_fullsized":"2024-04-02T07:24:12.948728+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:29:09.794588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.950366+0000","last_change":"2024-04-02T07:24:11.958848+0000","last_active":"2024-04-02T07:24:12.950366+0000","last_peered":"2024-04-02T07:24:12.950366+0000","last_clean":"2024-04-02T07:24:12.950366+0000","last_became_active":"2024-04-02T07:24:11.958208+0000","last_became_peered":"2024-04-02T07:24:11.958208+0000","last_unstale":"2024-04-02T07:24:12.950366+0000","last_undegraded":"2024-04-02T07:24:12.950366+0000","last_fullsized":"2024-04-02T07:24:12.950366+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:56:11.787199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047560+0000","last_change":"2024-04-02T07:24:11.953899+0000","last_active":"2024-04-02T07:24:13.047560+0000","last_peered":"2024-04-02T07:24:13.047560+0000","last_clean":"2024-04-02T07:24:13.047560+0000","last_became_active":"2024-04-02T07:24:11.953659+0000","last_became_peered":"2024-04-02T07:24:11.953659+0000","last_unstale":"2024-04-02T07:24:13.047560+0000","last_undegraded":"2024-04-02T07:24:13.047560+0000","last_fullsized":"2024-04-02T07:24:13.047560+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:17:53.358281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.949031+0000","last_change":"2024-04-02T07:24:11.956513+0000","last_active":"2024-04-02T07:24:12.949031+0000","last_peered":"2024-04-02T07:24:12.949031+0000","last_clean":"2024-04-02T07:24:12.949031+0000","last_became_active":"2024-04-02T07:24:11.956237+0000","last_became_peered":"2024-04-02T07:24:11.956237+0000","last_unstale":"2024-04-02T07:24:12.949031+0000","last_undegraded":"2024-04-02T07:24:12.949031+0000","last_fullsized":"2024-04-02T07:24:12.949031+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:22:08.408052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047379+0000","last_change":"2024-04-02T07:24:11.950917+0000","last_active":"2024-04-02T07:24:13.047379+0000","last_peered":"2024-04-02T07:24:13.047379+0000","last_clean":"2024-04-02T07:24:13.047379+0000","last_became_active":"2024-04-02T07:24:11.950647+0000","last_became_peered":"2024-04-02T07:24:11.950647+0000","last_unstale":"2024-04-02T07:24:13.047379+0000","last_undegraded":"2024-04-02T07:24:13.047379+0000","last_fullsized":"2024-04-02T07:24:13.047379+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:51:43.923273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.048674+0000","last_change":"2024-04-02T07:24:11.950457+0000","last_active":"2024-04-02T07:24:13.048674+0000","last_peered":"2024-04-02T07:24:13.048674+0000","last_clean":"2024-04-02T07:24:13.048674+0000","last_became_active":"2024-04-02T07:24:11.950160+0000","last_became_peered":"2024-04-02T07:24:11.950160+0000","last_unstale":"2024-04-02T07:24:13.048674+0000","last_undegraded":"2024-04-02T07:24:13.048674+0000","last_fullsized":"2024-04-02T07:24:13.048674+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:51:43.923273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.048617+0000","last_change":"2024-04-02T07:24:11.959122+0000","last_active":"2024-04-02T07:24:13.048617+0000","last_peered":"2024-04-02T07:24:13.048617+0000","last_clean":"2024-04-02T07:24:13.048617+0000","last_became_active":"2024-04-02T07:24:11.958796+0000","last_became_peered":"2024-04-02T07:24:11.958796+0000","last_unstale":"2024-04-02T07:24:13.048617+0000","last_undegraded":"2024-04-02T07:24:13.048617+0000","last_fullsized":"2024-04-02T07:24:13.048617+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:59.484110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.048255+0000","last_change":"2024-04-02T07:24:11.955036+0000","last_active":"2024-04-02T07:24:13.048255+0000","last_peered":"2024-04-02T07:24:13.048255+0000","last_clean":"2024-04-02T07:24:13.048255+0000","last_became_active":"2024-04-02T07:24:11.954705+0000","last_became_peered":"2024-04-02T07:24:11.954705+0000","last_unstale":"2024-04-02T07:24:13.048255+0000","last_undegraded":"2024-04-02T07:24:13.048255+0000","last_fullsized":"2024-04-02T07:24:13.048255+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:55:24.429974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.950514+0000","last_change":"2024-04-02T07:24:11.960570+0000","last_active":"2024-04-02T07:24:12.950514+0000","last_peered":"2024-04-02T07:24:12.950514+0000","last_clean":"2024-04-02T07:24:12.950514+0000","last_became_active":"2024-04-02T07:24:11.960315+0000","last_became_peered":"2024-04-02T07:24:11.960315+0000","last_unstale":"2024-04-02T07:24:12.950514+0000","last_undegraded":"2024-04-02T07:24:12.950514+0000","last_fullsized":"2024-04-02T07:24:12.950514+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:49:41.989618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.949130+0000","last_change":"2024-04-02T07:24:11.957020+0000","last_active":"2024-04-02T07:24:12.949130+0000","last_peered":"2024-04-02T07:24:12.949130+0000","last_clean":"2024-04-02T07:24:12.949130+0000","last_became_active":"2024-04-02T07:24:11.956626+0000","last_became_peered":"2024-04-02T07:24:11.956626+0000","last_unstale":"2024-04-02T07:24:12.949130+0000","last_undegraded":"2024-04-02T07:24:12.949130+0000","last_fullsized":"2024-04-02T07:24:12.949130+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:30:20.753043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047584+0000","last_change":"2024-04-02T07:24:11.954312+0000","last_active":"2024-04-02T07:24:13.047584+0000","last_peered":"2024-04-02T07:24:13.047584+0000","last_clean":"2024-04-02T07:24:13.047584+0000","last_became_active":"2024-04-02T07:24:11.949039+0000","last_became_peered":"2024-04-02T07:24:11.949039+0000","last_unstale":"2024-04-02T07:24:13.047584+0000","last_undegraded":"2024-04-02T07:24:13.047584+0000","last_fullsized":"2024-04-02T07:24:13.047584+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:05:43.642749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047782+0000","last_change":"2024-04-02T07:24:11.958404+0000","last_active":"2024-04-02T07:24:13.047782+0000","last_peered":"2024-04-02T07:24:13.047782+0000","last_clean":"2024-04-02T07:24:13.047782+0000","last_became_active":"2024-04-02T07:24:11.957424+0000","last_became_peered":"2024-04-02T07:24:11.957424+0000","last_unstale":"2024-04-02T07:24:13.047782+0000","last_undegraded":"2024-04-02T07:24:13.047782+0000","last_fullsized":"2024-04-02T07:24:13.047782+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:30:18.094389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047477+0000","last_change":"2024-04-02T07:24:11.957142+0000","last_active":"2024-04-02T07:24:13.047477+0000","last_peered":"2024-04-02T07:24:13.047477+0000","last_clean":"2024-04-02T07:24:13.047477+0000","last_became_active":"2024-04-02T07:24:11.956852+0000","last_became_peered":"2024-04-02T07:24:11.956852+0000","last_unstale":"2024-04-02T07:24:13.047477+0000","last_undegraded":"2024-04-02T07:24:13.047477+0000","last_fullsized":"2024-04-02T07:24:13.047477+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:19:32.469160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.048255+0000","last_change":"2024-04-02T07:24:11.962830+0000","last_active":"2024-04-02T07:24:13.048255+0000","last_peered":"2024-04-02T07:24:13.048255+0000","last_clean":"2024-04-02T07:24:13.048255+0000","last_became_active":"2024-04-02T07:24:11.957548+0000","last_became_peered":"2024-04-02T07:24:11.957548+0000","last_unstale":"2024-04-02T07:24:13.048255+0000","last_undegraded":"2024-04-02T07:24:13.048255+0000","last_fullsized":"2024-04-02T07:24:13.048255+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:05:43.642749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.950562+0000","last_change":"2024-04-02T07:24:11.960452+0000","last_active":"2024-04-02T07:24:12.950562+0000","last_peered":"2024-04-02T07:24:12.950562+0000","last_clean":"2024-04-02T07:24:12.950562+0000","last_became_active":"2024-04-02T07:24:11.960212+0000","last_became_peered":"2024-04-02T07:24:11.960212+0000","last_unstale":"2024-04-02T07:24:12.950562+0000","last_undegraded":"2024-04-02T07:24:12.950562+0000","last_fullsized":"2024-04-02T07:24:12.950562+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:50:15.699894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.048561+0000","last_change":"2024-04-02T07:24:11.951505+0000","last_active":"2024-04-02T07:24:13.048561+0000","last_peered":"2024-04-02T07:24:13.048561+0000","last_clean":"2024-04-02T07:24:13.048561+0000","last_became_active":"2024-04-02T07:24:11.951226+0000","last_became_peered":"2024-04-02T07:24:11.951226+0000","last_unstale":"2024-04-02T07:24:13.048561+0000","last_undegraded":"2024-04-02T07:24:13.048561+0000","last_fullsized":"2024-04-02T07:24:13.048561+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:22:21.812693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.948885+0000","last_change":"2024-04-02T07:24:11.964016+0000","last_active":"2024-04-02T07:24:12.948885+0000","last_peered":"2024-04-02T07:24:12.948885+0000","last_clean":"2024-04-02T07:24:12.948885+0000","last_became_active":"2024-04-02T07:24:11.962203+0000","last_became_peered":"2024-04-02T07:24:11.962203+0000","last_unstale":"2024-04-02T07:24:12.948885+0000","last_undegraded":"2024-04-02T07:24:12.948885+0000","last_fullsized":"2024-04-02T07:24:12.948885+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:04:09.096977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047924+0000","last_change":"2024-04-02T07:24:11.950067+0000","last_active":"2024-04-02T07:24:13.047924+0000","last_peered":"2024-04-02T07:24:13.047924+0000","last_clean":"2024-04-02T07:24:13.047924+0000","last_became_active":"2024-04-02T07:24:11.949815+0000","last_became_peered":"2024-04-02T07:24:11.949815+0000","last_unstale":"2024-04-02T07:24:13.047924+0000","last_undegraded":"2024-04-02T07:24:13.047924+0000","last_fullsized":"2024-04-02T07:24:13.047924+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:22:21.812693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047944+0000","last_change":"2024-04-02T07:24:11.956637+0000","last_active":"2024-04-02T07:24:13.047944+0000","last_peered":"2024-04-02T07:24:13.047944+0000","last_clean":"2024-04-02T07:24:13.047944+0000","last_became_active":"2024-04-02T07:24:11.956276+0000","last_became_peered":"2024-04-02T07:24:11.956276+0000","last_unstale":"2024-04-02T07:24:13.047944+0000","last_undegraded":"2024-04-02T07:24:13.047944+0000","last_fullsized":"2024-04-02T07:24:13.047944+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:55:24.429974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.949086+0000","last_change":"2024-04-02T07:24:11.952293+0000","last_active":"2024-04-02T07:24:12.949086+0000","last_peered":"2024-04-02T07:24:12.949086+0000","last_clean":"2024-04-02T07:24:12.949086+0000","last_became_active":"2024-04-02T07:24:11.951119+0000","last_became_peered":"2024-04-02T07:24:11.951119+0000","last_unstale":"2024-04-02T07:24:12.949086+0000","last_undegraded":"2024-04-02T07:24:12.949086+0000","last_fullsized":"2024-04-02T07:24:12.949086+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:34:59.790504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.949936+0000","last_change":"2024-04-02T07:24:11.956218+0000","last_active":"2024-04-02T07:24:12.949936+0000","last_peered":"2024-04-02T07:24:12.949936+0000","last_clean":"2024-04-02T07:24:12.949936+0000","last_became_active":"2024-04-02T07:24:11.955796+0000","last_became_peered":"2024-04-02T07:24:11.955796+0000","last_unstale":"2024-04-02T07:24:12.949936+0000","last_undegraded":"2024-04-02T07:24:12.949936+0000","last_fullsized":"2024-04-02T07:24:12.949936+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:20:11.284381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047262+0000","last_change":"2024-04-02T07:24:11.961597+0000","last_active":"2024-04-02T07:24:13.047262+0000","last_peered":"2024-04-02T07:24:13.047262+0000","last_clean":"2024-04-02T07:24:13.047262+0000","last_became_active":"2024-04-02T07:24:11.961361+0000","last_became_peered":"2024-04-02T07:24:11.961361+0000","last_unstale":"2024-04-02T07:24:13.047262+0000","last_undegraded":"2024-04-02T07:24:13.047262+0000","last_fullsized":"2024-04-02T07:24:13.047262+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:22:21.812693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"45'4","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.969103+0000","last_change":"2024-04-02T07:24:11.544734+0000","last_active":"2024-04-02T07:24:11.969103+0000","last_peered":"2024-04-02T07:24:11.969103+0000","last_clean":"2024-04-02T07:24:11.969103+0000","last_became_active":"2024-04-02T07:24:11.544469+0000","last_became_peered":"2024-04-02T07:24:11.544469+0000","last_unstale":"2024-04-02T07:24:11.969103+0000","last_undegraded":"2024-04-02T07:24:11.969103+0000","last_fullsized":"2024-04-02T07:24:11.969103+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:00:31.241815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.048296+0000","last_change":"2024-04-02T07:24:11.943165+0000","last_active":"2024-04-02T07:24:13.048296+0000","last_peered":"2024-04-02T07:24:13.048296+0000","last_clean":"2024-04-02T07:24:13.048296+0000","last_became_active":"2024-04-02T07:24:11.942810+0000","last_became_peered":"2024-04-02T07:24:11.942810+0000","last_unstale":"2024-04-02T07:24:13.048296+0000","last_undegraded":"2024-04-02T07:24:13.048296+0000","last_fullsized":"2024-04-02T07:24:13.048296+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:12:22.127514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"45'1","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.964204+0000","last_change":"2024-04-02T07:24:11.546804+0000","last_active":"2024-04-02T07:24:11.964204+0000","last_peered":"2024-04-02T07:24:11.964204+0000","last_clean":"2024-04-02T07:24:11.964204+0000","last_became_active":"2024-04-02T07:24:11.546517+0000","last_became_peered":"2024-04-02T07:24:11.546517+0000","last_unstale":"2024-04-02T07:24:11.964204+0000","last_undegraded":"2024-04-02T07:24:11.964204+0000","last_fullsized":"2024-04-02T07:24:11.964204+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:20:10.281531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.948887+0000","last_change":"2024-04-02T07:24:11.959490+0000","last_active":"2024-04-02T07:24:12.948887+0000","last_peered":"2024-04-02T07:24:12.948887+0000","last_clean":"2024-04-02T07:24:12.948887+0000","last_became_active":"2024-04-02T07:24:11.959306+0000","last_became_peered":"2024-04-02T07:24:11.959306+0000","last_unstale":"2024-04-02T07:24:12.948887+0000","last_undegraded":"2024-04-02T07:24:12.948887+0000","last_fullsized":"2024-04-02T07:24:12.948887+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:27:50.181396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"45'2","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.959708+0000","last_change":"2024-04-02T07:24:11.548453+0000","last_active":"2024-04-02T07:24:11.959708+0000","last_peered":"2024-04-02T07:24:11.959708+0000","last_clean":"2024-04-02T07:24:11.959708+0000","last_became_active":"2024-04-02T07:24:11.548178+0000","last_became_peered":"2024-04-02T07:24:11.548178+0000","last_unstale":"2024-04-02T07:24:11.959708+0000","last_undegraded":"2024-04-02T07:24:11.959708+0000","last_fullsized":"2024-04-02T07:24:11.959708+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:05:52.333856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047161+0000","last_change":"2024-04-02T07:24:11.952868+0000","last_active":"2024-04-02T07:24:13.047161+0000","last_peered":"2024-04-02T07:24:13.047161+0000","last_clean":"2024-04-02T07:24:13.047161+0000","last_became_active":"2024-04-02T07:24:11.952611+0000","last_became_peered":"2024-04-02T07:24:11.952611+0000","last_unstale":"2024-04-02T07:24:13.047161+0000","last_undegraded":"2024-04-02T07:24:13.047161+0000","last_fullsized":"2024-04-02T07:24:13.047161+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:45:52.239560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"45'2","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.968850+0000","last_change":"2024-04-02T07:24:11.541977+0000","last_active":"2024-04-02T07:24:11.968850+0000","last_peered":"2024-04-02T07:24:11.968850+0000","last_clean":"2024-04-02T07:24:11.968850+0000","last_became_active":"2024-04-02T07:24:11.541406+0000","last_became_peered":"2024-04-02T07:24:11.541406+0000","last_unstale":"2024-04-02T07:24:11.968850+0000","last_undegraded":"2024-04-02T07:24:11.968850+0000","last_fullsized":"2024-04-02T07:24:11.968850+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:14:08.858057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.048214+0000","last_change":"2024-04-02T07:24:11.946803+0000","last_active":"2024-04-02T07:24:13.048214+0000","last_peered":"2024-04-02T07:24:13.048214+0000","last_clean":"2024-04-02T07:24:13.048214+0000","last_became_active":"2024-04-02T07:24:11.946505+0000","last_became_peered":"2024-04-02T07:24:11.946505+0000","last_unstale":"2024-04-02T07:24:13.048214+0000","last_undegraded":"2024-04-02T07:24:13.048214+0000","last_fullsized":"2024-04-02T07:24:13.048214+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:00:32.244665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"45'1","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.964663+0000","last_change":"2024-04-02T07:24:11.543312+0000","last_active":"2024-04-02T07:24:11.964663+0000","last_peered":"2024-04-02T07:24:11.964663+0000","last_clean":"2024-04-02T07:24:11.964663+0000","last_became_active":"2024-04-02T07:24:11.543015+0000","last_became_peered":"2024-04-02T07:24:11.543015+0000","last_unstale":"2024-04-02T07:24:11.964663+0000","last_undegraded":"2024-04-02T07:24:11.964663+0000","last_fullsized":"2024-04-02T07:24:11.964663+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:12:21.124664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047560+0000","last_change":"2024-04-02T07:24:11.954286+0000","last_active":"2024-04-02T07:24:13.047560+0000","last_peered":"2024-04-02T07:24:13.047560+0000","last_clean":"2024-04-02T07:24:13.047560+0000","last_became_active":"2024-04-02T07:24:11.954046+0000","last_became_peered":"2024-04-02T07:24:11.954046+0000","last_unstale":"2024-04-02T07:24:13.047560+0000","last_undegraded":"2024-04-02T07:24:13.047560+0000","last_fullsized":"2024-04-02T07:24:13.047560+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:04:09.096977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"45'1","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.963721+0000","last_change":"2024-04-02T07:24:11.541077+0000","last_active":"2024-04-02T07:24:11.963721+0000","last_peered":"2024-04-02T07:24:11.963721+0000","last_clean":"2024-04-02T07:24:11.963721+0000","last_became_active":"2024-04-02T07:24:11.540512+0000","last_became_peered":"2024-04-02T07:24:11.540512+0000","last_unstale":"2024-04-02T07:24:11.963721+0000","last_undegraded":"2024-04-02T07:24:11.963721+0000","last_fullsized":"2024-04-02T07:24:11.963721+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:50:14.697045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047294+0000","last_change":"2024-04-02T07:24:11.948412+0000","last_active":"2024-04-02T07:24:13.047294+0000","last_peered":"2024-04-02T07:24:13.047294+0000","last_clean":"2024-04-02T07:24:13.047294+0000","last_became_active":"2024-04-02T07:24:11.948157+0000","last_became_peered":"2024-04-02T07:24:11.948157+0000","last_unstale":"2024-04-02T07:24:13.047294+0000","last_undegraded":"2024-04-02T07:24:13.047294+0000","last_fullsized":"2024-04-02T07:24:13.047294+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:51:50.616189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.944751+0000","last_change":"2024-04-02T07:24:11.548514+0000","last_active":"2024-04-02T07:24:11.944751+0000","last_peered":"2024-04-02T07:24:11.944751+0000","last_clean":"2024-04-02T07:24:11.944751+0000","last_became_active":"2024-04-02T07:24:11.548211+0000","last_became_peered":"2024-04-02T07:24:11.548211+0000","last_unstale":"2024-04-02T07:24:11.944751+0000","last_undegraded":"2024-04-02T07:24:11.944751+0000","last_fullsized":"2024-04-02T07:24:11.944751+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:18:59.945527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047671+0000","last_change":"2024-04-02T07:24:11.957920+0000","last_active":"2024-04-02T07:24:13.047671+0000","last_peered":"2024-04-02T07:24:13.047671+0000","last_clean":"2024-04-02T07:24:13.047671+0000","last_became_active":"2024-04-02T07:24:11.957093+0000","last_became_peered":"2024-04-02T07:24:11.957093+0000","last_unstale":"2024-04-02T07:24:13.047671+0000","last_undegraded":"2024-04-02T07:24:13.047671+0000","last_fullsized":"2024-04-02T07:24:13.047671+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:19:00.948376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.936839+0000","last_change":"2024-04-02T07:24:11.551712+0000","last_active":"2024-04-02T07:24:11.936839+0000","last_peered":"2024-04-02T07:24:11.936839+0000","last_clean":"2024-04-02T07:24:11.936839+0000","last_became_active":"2024-04-02T07:24:11.551426+0000","last_became_peered":"2024-04-02T07:24:11.551426+0000","last_unstale":"2024-04-02T07:24:11.936839+0000","last_undegraded":"2024-04-02T07:24:11.936839+0000","last_fullsized":"2024-04-02T07:24:11.936839+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:54:03.635207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.048761+0000","last_change":"2024-04-02T07:24:11.956904+0000","last_active":"2024-04-02T07:24:13.048761+0000","last_peered":"2024-04-02T07:24:13.048761+0000","last_clean":"2024-04-02T07:24:13.048761+0000","last_became_active":"2024-04-02T07:24:11.956650+0000","last_became_peered":"2024-04-02T07:24:11.956650+0000","last_unstale":"2024-04-02T07:24:13.048761+0000","last_undegraded":"2024-04-02T07:24:13.048761+0000","last_fullsized":"2024-04-02T07:24:13.048761+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:12:22.127514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.938133+0000","last_change":"2024-04-02T07:24:11.549199+0000","last_active":"2024-04-02T07:24:11.938133+0000","last_peered":"2024-04-02T07:24:11.938133+0000","last_clean":"2024-04-02T07:24:11.938133+0000","last_became_active":"2024-04-02T07:24:11.548926+0000","last_became_peered":"2024-04-02T07:24:11.548926+0000","last_unstale":"2024-04-02T07:24:11.938133+0000","last_undegraded":"2024-04-02T07:24:11.938133+0000","last_fullsized":"2024-04-02T07:24:11.938133+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:56:10.784349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047546+0000","last_change":"2024-04-02T07:24:11.957745+0000","last_active":"2024-04-02T07:24:13.047546+0000","last_peered":"2024-04-02T07:24:13.047546+0000","last_clean":"2024-04-02T07:24:13.047546+0000","last_became_active":"2024-04-02T07:24:11.956520+0000","last_became_peered":"2024-04-02T07:24:11.956520+0000","last_unstale":"2024-04-02T07:24:13.047546+0000","last_undegraded":"2024-04-02T07:24:13.047546+0000","last_fullsized":"2024-04-02T07:24:13.047546+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:13:29.529707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.938655+0000","last_change":"2024-04-02T07:24:11.546505+0000","last_active":"2024-04-02T07:24:11.938655+0000","last_peered":"2024-04-02T07:24:11.938655+0000","last_clean":"2024-04-02T07:24:11.938655+0000","last_became_active":"2024-04-02T07:24:11.546257+0000","last_became_peered":"2024-04-02T07:24:11.546257+0000","last_unstale":"2024-04-02T07:24:11.938655+0000","last_undegraded":"2024-04-02T07:24:11.938655+0000","last_fullsized":"2024-04-02T07:24:11.938655+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:18:20.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.949675+0000","last_change":"2024-04-02T07:24:11.963820+0000","last_active":"2024-04-02T07:24:12.949675+0000","last_peered":"2024-04-02T07:24:12.949675+0000","last_clean":"2024-04-02T07:24:12.949675+0000","last_became_active":"2024-04-02T07:24:11.963583+0000","last_became_peered":"2024-04-02T07:24:11.963583+0000","last_unstale":"2024-04-02T07:24:12.949675+0000","last_undegraded":"2024-04-02T07:24:12.949675+0000","last_fullsized":"2024-04-02T07:24:12.949675+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.551555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"45'3","reported_seq":14,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.971813+0000","last_change":"2024-04-02T07:24:11.538392+0000","last_active":"2024-04-02T07:24:11.971813+0000","last_peered":"2024-04-02T07:24:11.971813+0000","last_clean":"2024-04-02T07:24:11.971813+0000","last_became_active":"2024-04-02T07:24:11.538105+0000","last_became_peered":"2024-04-02T07:24:11.538105+0000","last_unstale":"2024-04-02T07:24:11.971813+0000","last_undegraded":"2024-04-02T07:24:11.971813+0000","last_fullsized":"2024-04-02T07:24:11.971813+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:55:23.427125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047074+0000","last_change":"2024-04-02T07:24:11.966905+0000","last_active":"2024-04-02T07:24:13.047074+0000","last_peered":"2024-04-02T07:24:13.047074+0000","last_clean":"2024-04-02T07:24:13.047074+0000","last_became_active":"2024-04-02T07:24:11.965344+0000","last_became_peered":"2024-04-02T07:24:11.965344+0000","last_unstale":"2024-04-02T07:24:13.047074+0000","last_undegraded":"2024-04-02T07:24:13.047074+0000","last_fullsized":"2024-04-02T07:24:13.047074+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:43:57.551555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"45'6","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.971382+0000","last_change":"2024-04-02T07:24:11.540311+0000","last_active":"2024-04-02T07:24:11.971382+0000","last_peered":"2024-04-02T07:24:11.971382+0000","last_clean":"2024-04-02T07:24:11.971382+0000","last_became_active":"2024-04-02T07:24:11.540011+0000","last_became_peered":"2024-04-02T07:24:11.540011+0000","last_unstale":"2024-04-02T07:24:11.971382+0000","last_undegraded":"2024-04-02T07:24:11.971382+0000","last_fullsized":"2024-04-02T07:24:11.971382+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:15:57.473214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047870+0000","last_change":"2024-04-02T07:24:11.957746+0000","last_active":"2024-04-02T07:24:13.047870+0000","last_peered":"2024-04-02T07:24:13.047870+0000","last_clean":"2024-04-02T07:24:13.047870+0000","last_became_active":"2024-04-02T07:24:11.955431+0000","last_became_peered":"2024-04-02T07:24:11.955431+0000","last_unstale":"2024-04-02T07:24:13.047870+0000","last_undegraded":"2024-04-02T07:24:13.047870+0000","last_fullsized":"2024-04-02T07:24:13.047870+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:45:52.239560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"45'2","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.971441+0000","last_change":"2024-04-02T07:24:11.543261+0000","last_active":"2024-04-02T07:24:11.971441+0000","last_peered":"2024-04-02T07:24:11.971441+0000","last_clean":"2024-04-02T07:24:11.971441+0000","last_became_active":"2024-04-02T07:24:11.542805+0000","last_became_peered":"2024-04-02T07:24:11.542805+0000","last_unstale":"2024-04-02T07:24:11.971441+0000","last_undegraded":"2024-04-02T07:24:11.971441+0000","last_fullsized":"2024-04-02T07:24:11.971441+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:05:42.639900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047668+0000","last_change":"2024-04-02T07:24:11.959100+0000","last_active":"2024-04-02T07:24:13.047668+0000","last_peered":"2024-04-02T07:24:13.047668+0000","last_clean":"2024-04-02T07:24:13.047668+0000","last_became_active":"2024-04-02T07:24:11.958866+0000","last_became_peered":"2024-04-02T07:24:11.958866+0000","last_unstale":"2024-04-02T07:24:13.047668+0000","last_undegraded":"2024-04-02T07:24:13.047668+0000","last_fullsized":"2024-04-02T07:24:13.047668+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:59.484110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.949608+0000","last_change":"2024-04-02T07:24:11.538140+0000","last_active":"2024-04-02T07:24:11.949608+0000","last_peered":"2024-04-02T07:24:11.949608+0000","last_clean":"2024-04-02T07:24:11.949608+0000","last_became_active":"2024-04-02T07:24:11.537822+0000","last_became_peered":"2024-04-02T07:24:11.537822+0000","last_unstale":"2024-04-02T07:24:11.949608+0000","last_undegraded":"2024-04-02T07:24:11.949608+0000","last_fullsized":"2024-04-02T07:24:11.949608+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:00:31.241815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.948981+0000","last_change":"2024-04-02T07:24:11.959320+0000","last_active":"2024-04-02T07:24:12.948981+0000","last_peered":"2024-04-02T07:24:12.948981+0000","last_clean":"2024-04-02T07:24:12.948981+0000","last_became_active":"2024-04-02T07:24:11.959138+0000","last_became_peered":"2024-04-02T07:24:11.959138+0000","last_unstale":"2024-04-02T07:24:12.948981+0000","last_undegraded":"2024-04-02T07:24:12.948981+0000","last_fullsized":"2024-04-02T07:24:12.948981+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:35:05.911001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.945743+0000","last_change":"2024-04-02T07:24:11.539188+0000","last_active":"2024-04-02T07:24:11.945743+0000","last_peered":"2024-04-02T07:24:11.945743+0000","last_clean":"2024-04-02T07:24:11.945743+0000","last_became_active":"2024-04-02T07:24:11.538510+0000","last_became_peered":"2024-04-02T07:24:11.538510+0000","last_unstale":"2024-04-02T07:24:11.945743+0000","last_undegraded":"2024-04-02T07:24:11.945743+0000","last_fullsized":"2024-04-02T07:24:11.945743+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:14:08.858057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047476+0000","last_change":"2024-04-02T07:24:11.963273+0000","last_active":"2024-04-02T07:24:13.047476+0000","last_peered":"2024-04-02T07:24:13.047476+0000","last_clean":"2024-04-02T07:24:13.047476+0000","last_became_active":"2024-04-02T07:24:11.963008+0000","last_became_peered":"2024-04-02T07:24:11.963008+0000","last_unstale":"2024-04-02T07:24:13.047476+0000","last_undegraded":"2024-04-02T07:24:13.047476+0000","last_fullsized":"2024-04-02T07:24:13.047476+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:17:53.358281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"45'8","reported_seq":19,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.971658+0000","last_change":"2024-04-02T07:24:11.547770+0000","last_active":"2024-04-02T07:24:11.971658+0000","last_peered":"2024-04-02T07:24:11.971658+0000","last_clean":"2024-04-02T07:24:11.971658+0000","last_became_active":"2024-04-02T07:24:11.545391+0000","last_became_peered":"2024-04-02T07:24:11.545391+0000","last_unstale":"2024-04-02T07:24:11.971658+0000","last_undegraded":"2024-04-02T07:24:11.971658+0000","last_fullsized":"2024-04-02T07:24:11.971658+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:20:10.281531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.950693+0000","last_change":"2024-04-02T07:24:11.950734+0000","last_active":"2024-04-02T07:24:12.950693+0000","last_peered":"2024-04-02T07:24:12.950693+0000","last_clean":"2024-04-02T07:24:12.950693+0000","last_became_active":"2024-04-02T07:24:11.950517+0000","last_became_peered":"2024-04-02T07:24:11.950517+0000","last_unstale":"2024-04-02T07:24:12.950693+0000","last_undegraded":"2024-04-02T07:24:12.950693+0000","last_fullsized":"2024-04-02T07:24:12.950693+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:19:54.126778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"45'1","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.965895+0000","last_change":"2024-04-02T07:24:11.546098+0000","last_active":"2024-04-02T07:24:11.965895+0000","last_peered":"2024-04-02T07:24:11.965895+0000","last_clean":"2024-04-02T07:24:11.965895+0000","last_became_active":"2024-04-02T07:24:11.545650+0000","last_became_peered":"2024-04-02T07:24:11.545650+0000","last_unstale":"2024-04-02T07:24:11.965895+0000","last_undegraded":"2024-04-02T07:24:11.965895+0000","last_fullsized":"2024-04-02T07:24:11.965895+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:33:20.814250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047981+0000","last_change":"2024-04-02T07:24:11.967503+0000","last_active":"2024-04-02T07:24:13.047981+0000","last_peered":"2024-04-02T07:24:13.047981+0000","last_clean":"2024-04-02T07:24:13.047981+0000","last_became_active":"2024-04-02T07:24:11.967158+0000","last_became_peered":"2024-04-02T07:24:11.967158+0000","last_unstale":"2024-04-02T07:24:13.047981+0000","last_undegraded":"2024-04-02T07:24:13.047981+0000","last_fullsized":"2024-04-02T07:24:13.047981+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:12:22.127514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"45'2","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.964498+0000","last_change":"2024-04-02T07:24:11.550977+0000","last_active":"2024-04-02T07:24:11.964498+0000","last_peered":"2024-04-02T07:24:11.964498+0000","last_clean":"2024-04-02T07:24:11.964498+0000","last_became_active":"2024-04-02T07:24:11.550709+0000","last_became_peered":"2024-04-02T07:24:11.550709+0000","last_unstale":"2024-04-02T07:24:11.964498+0000","last_undegraded":"2024-04-02T07:24:11.964498+0000","last_fullsized":"2024-04-02T07:24:11.964498+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:18:20.283174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.048063+0000","last_change":"2024-04-02T07:24:11.962120+0000","last_active":"2024-04-02T07:24:13.048063+0000","last_peered":"2024-04-02T07:24:13.048063+0000","last_clean":"2024-04-02T07:24:13.048063+0000","last_became_active":"2024-04-02T07:24:11.961783+0000","last_became_peered":"2024-04-02T07:24:11.961783+0000","last_unstale":"2024-04-02T07:24:13.048063+0000","last_undegraded":"2024-04-02T07:24:13.048063+0000","last_fullsized":"2024-04-02T07:24:13.048063+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:11:14.003651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"45'1","reported_seq":12,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.965198+0000","last_change":"2024-04-02T07:24:11.550197+0000","last_active":"2024-04-02T07:24:11.965198+0000","last_peered":"2024-04-02T07:24:11.965198+0000","last_clean":"2024-04-02T07:24:11.965198+0000","last_became_active":"2024-04-02T07:24:11.549752+0000","last_became_peered":"2024-04-02T07:24:11.549752+0000","last_unstale":"2024-04-02T07:24:11.965198+0000","last_undegraded":"2024-04-02T07:24:11.965198+0000","last_fullsized":"2024-04-02T07:24:11.965198+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:45:51.236711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.048151+0000","last_change":"2024-04-02T07:24:11.963463+0000","last_active":"2024-04-02T07:24:13.048151+0000","last_peered":"2024-04-02T07:24:13.048151+0000","last_clean":"2024-04-02T07:24:13.048151+0000","last_became_active":"2024-04-02T07:24:11.963146+0000","last_became_peered":"2024-04-02T07:24:11.963146+0000","last_unstale":"2024-04-02T07:24:13.048151+0000","last_undegraded":"2024-04-02T07:24:13.048151+0000","last_fullsized":"2024-04-02T07:24:13.048151+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:14:09.860907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.948707+0000","last_change":"2024-04-02T07:24:11.542317+0000","last_active":"2024-04-02T07:24:11.948707+0000","last_peered":"2024-04-02T07:24:11.948707+0000","last_clean":"2024-04-02T07:24:11.948707+0000","last_became_active":"2024-04-02T07:24:11.542040+0000","last_became_peered":"2024-04-02T07:24:11.542040+0000","last_unstale":"2024-04-02T07:24:11.948707+0000","last_undegraded":"2024-04-02T07:24:11.948707+0000","last_fullsized":"2024-04-02T07:24:11.948707+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:58.481260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.949224+0000","last_change":"2024-04-02T07:24:11.960791+0000","last_active":"2024-04-02T07:24:12.949224+0000","last_peered":"2024-04-02T07:24:12.949224+0000","last_clean":"2024-04-02T07:24:12.949224+0000","last_became_active":"2024-04-02T07:24:11.959335+0000","last_became_peered":"2024-04-02T07:24:11.959335+0000","last_unstale":"2024-04-02T07:24:12.949224+0000","last_undegraded":"2024-04-02T07:24:12.949224+0000","last_fullsized":"2024-04-02T07:24:12.949224+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:17:07.437204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"45'2","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.965363+0000","last_change":"2024-04-02T07:24:11.543099+0000","last_active":"2024-04-02T07:24:11.965363+0000","last_peered":"2024-04-02T07:24:11.965363+0000","last_clean":"2024-04-02T07:24:11.965363+0000","last_became_active":"2024-04-02T07:24:11.542716+0000","last_became_peered":"2024-04-02T07:24:11.542716+0000","last_unstale":"2024-04-02T07:24:11.965363+0000","last_undegraded":"2024-04-02T07:24:11.965363+0000","last_fullsized":"2024-04-02T07:24:11.965363+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:55:23.427125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047024+0000","last_change":"2024-04-02T07:24:11.950606+0000","last_active":"2024-04-02T07:24:13.047024+0000","last_peered":"2024-04-02T07:24:13.047024+0000","last_clean":"2024-04-02T07:24:13.047024+0000","last_became_active":"2024-04-02T07:24:11.950273+0000","last_became_peered":"2024-04-02T07:24:11.950273+0000","last_unstale":"2024-04-02T07:24:13.047024+0000","last_undegraded":"2024-04-02T07:24:13.047024+0000","last_fullsized":"2024-04-02T07:24:13.047024+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:41:59.636874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.944908+0000","last_change":"2024-04-02T07:24:11.543094+0000","last_active":"2024-04-02T07:24:11.944908+0000","last_peered":"2024-04-02T07:24:11.944908+0000","last_clean":"2024-04-02T07:24:11.944908+0000","last_became_active":"2024-04-02T07:24:11.542834+0000","last_became_peered":"2024-04-02T07:24:11.542834+0000","last_unstale":"2024-04-02T07:24:11.944908+0000","last_undegraded":"2024-04-02T07:24:11.944908+0000","last_fullsized":"2024-04-02T07:24:11.944908+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:41:58.634024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.950026+0000","last_change":"2024-04-02T07:24:11.956052+0000","last_active":"2024-04-02T07:24:12.950026+0000","last_peered":"2024-04-02T07:24:12.950026+0000","last_clean":"2024-04-02T07:24:12.950026+0000","last_became_active":"2024-04-02T07:24:11.955514+0000","last_became_peered":"2024-04-02T07:24:11.955514+0000","last_unstale":"2024-04-02T07:24:12.950026+0000","last_undegraded":"2024-04-02T07:24:12.950026+0000","last_fullsized":"2024-04-02T07:24:12.950026+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:54:04.638056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.937030+0000","last_change":"2024-04-02T07:24:11.541763+0000","last_active":"2024-04-02T07:24:11.937030+0000","last_peered":"2024-04-02T07:24:11.937030+0000","last_clean":"2024-04-02T07:24:11.937030+0000","last_became_active":"2024-04-02T07:24:11.541470+0000","last_became_peered":"2024-04-02T07:24:11.541470+0000","last_unstale":"2024-04-02T07:24:11.937030+0000","last_undegraded":"2024-04-02T07:24:11.937030+0000","last_fullsized":"2024-04-02T07:24:11.937030+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:19:53.123928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047792+0000","last_change":"2024-04-02T07:24:11.958550+0000","last_active":"2024-04-02T07:24:13.047792+0000","last_peered":"2024-04-02T07:24:13.047792+0000","last_clean":"2024-04-02T07:24:13.047792+0000","last_became_active":"2024-04-02T07:24:11.958231+0000","last_became_peered":"2024-04-02T07:24:11.958231+0000","last_unstale":"2024-04-02T07:24:13.047792+0000","last_undegraded":"2024-04-02T07:24:13.047792+0000","last_fullsized":"2024-04-02T07:24:13.047792+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:49:24.536449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.947815+0000","last_change":"2024-04-02T07:24:11.538858+0000","last_active":"2024-04-02T07:24:11.947815+0000","last_peered":"2024-04-02T07:24:11.947815+0000","last_clean":"2024-04-02T07:24:11.947815+0000","last_became_active":"2024-04-02T07:24:11.537162+0000","last_became_peered":"2024-04-02T07:24:11.537162+0000","last_unstale":"2024-04-02T07:24:11.947815+0000","last_undegraded":"2024-04-02T07:24:11.947815+0000","last_fullsized":"2024-04-02T07:24:11.947815+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:58.481260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.048332+0000","last_change":"2024-04-02T07:24:11.950881+0000","last_active":"2024-04-02T07:24:13.048332+0000","last_peered":"2024-04-02T07:24:13.048332+0000","last_clean":"2024-04-02T07:24:13.048332+0000","last_became_active":"2024-04-02T07:24:11.950550+0000","last_became_peered":"2024-04-02T07:24:11.950550+0000","last_unstale":"2024-04-02T07:24:13.048332+0000","last_undegraded":"2024-04-02T07:24:13.048332+0000","last_fullsized":"2024-04-02T07:24:13.048332+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:41:59.636874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.948745+0000","last_change":"2024-04-02T07:24:11.542456+0000","last_active":"2024-04-02T07:24:11.948745+0000","last_peered":"2024-04-02T07:24:11.948745+0000","last_clean":"2024-04-02T07:24:11.948745+0000","last_became_active":"2024-04-02T07:24:11.542176+0000","last_became_peered":"2024-04-02T07:24:11.542176+0000","last_unstale":"2024-04-02T07:24:11.948745+0000","last_undegraded":"2024-04-02T07:24:11.948745+0000","last_fullsized":"2024-04-02T07:24:11.948745+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:04:08.094127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047813+0000","last_change":"2024-04-02T07:24:11.953905+0000","last_active":"2024-04-02T07:24:13.047813+0000","last_peered":"2024-04-02T07:24:13.047813+0000","last_clean":"2024-04-02T07:24:13.047813+0000","last_became_active":"2024-04-02T07:24:11.953388+0000","last_became_peered":"2024-04-02T07:24:11.953388+0000","last_unstale":"2024-04-02T07:24:13.047813+0000","last_undegraded":"2024-04-02T07:24:13.047813+0000","last_fullsized":"2024-04-02T07:24:13.047813+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:29:09.794588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.952805+0000","last_change":"2024-04-02T07:24:11.539164+0000","last_active":"2024-04-02T07:24:11.952805+0000","last_peered":"2024-04-02T07:24:11.952805+0000","last_clean":"2024-04-02T07:24:11.952805+0000","last_became_active":"2024-04-02T07:24:11.538224+0000","last_became_peered":"2024-04-02T07:24:11.538224+0000","last_unstale":"2024-04-02T07:24:11.952805+0000","last_undegraded":"2024-04-02T07:24:11.952805+0000","last_fullsized":"2024-04-02T07:24:11.952805+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:05:42.639900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047222+0000","last_change":"2024-04-02T07:24:11.967474+0000","last_active":"2024-04-02T07:24:13.047222+0000","last_peered":"2024-04-02T07:24:13.047222+0000","last_clean":"2024-04-02T07:24:13.047222+0000","last_became_active":"2024-04-02T07:24:11.967215+0000","last_became_peered":"2024-04-02T07:24:11.967215+0000","last_unstale":"2024-04-02T07:24:13.047222+0000","last_undegraded":"2024-04-02T07:24:13.047222+0000","last_fullsized":"2024-04-02T07:24:13.047222+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:49:24.536449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.946110+0000","last_change":"2024-04-02T07:24:11.548954+0000","last_active":"2024-04-02T07:24:11.946110+0000","last_peered":"2024-04-02T07:24:11.946110+0000","last_clean":"2024-04-02T07:24:11.946110+0000","last_became_active":"2024-04-02T07:24:11.548670+0000","last_became_peered":"2024-04-02T07:24:11.548670+0000","last_unstale":"2024-04-02T07:24:11.946110+0000","last_undegraded":"2024-04-02T07:24:11.946110+0000","last_fullsized":"2024-04-02T07:24:11.946110+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:49:40.986769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.949279+0000","last_change":"2024-04-02T07:24:11.957426+0000","last_active":"2024-04-02T07:24:12.949279+0000","last_peered":"2024-04-02T07:24:12.949279+0000","last_clean":"2024-04-02T07:24:12.949279+0000","last_became_active":"2024-04-02T07:24:11.956932+0000","last_became_peered":"2024-04-02T07:24:11.956932+0000","last_unstale":"2024-04-02T07:24:12.949279+0000","last_undegraded":"2024-04-02T07:24:12.949279+0000","last_fullsized":"2024-04-02T07:24:12.949279+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:31:45.969467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.952006+0000","last_change":"2024-04-02T07:24:11.538204+0000","last_active":"2024-04-02T07:24:11.952006+0000","last_peered":"2024-04-02T07:24:11.952006+0000","last_clean":"2024-04-02T07:24:11.952006+0000","last_became_active":"2024-04-02T07:24:11.537930+0000","last_became_peered":"2024-04-02T07:24:11.537930+0000","last_unstale":"2024-04-02T07:24:11.952006+0000","last_undegraded":"2024-04-02T07:24:11.952006+0000","last_fullsized":"2024-04-02T07:24:11.952006+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:12:21.124664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.949369+0000","last_change":"2024-04-02T07:24:11.956868+0000","last_active":"2024-04-02T07:24:12.949369+0000","last_peered":"2024-04-02T07:24:12.949369+0000","last_clean":"2024-04-02T07:24:12.949369+0000","last_became_active":"2024-04-02T07:24:11.956365+0000","last_became_peered":"2024-04-02T07:24:11.956365+0000","last_unstale":"2024-04-02T07:24:12.949369+0000","last_undegraded":"2024-04-02T07:24:12.949369+0000","last_fullsized":"2024-04-02T07:24:12.949369+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:09:29.307486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.938911+0000","last_change":"2024-04-02T07:24:11.546975+0000","last_active":"2024-04-02T07:24:11.938911+0000","last_peered":"2024-04-02T07:24:11.938911+0000","last_clean":"2024-04-02T07:24:11.938911+0000","last_became_active":"2024-04-02T07:24:11.546641+0000","last_became_peered":"2024-04-02T07:24:11.546641+0000","last_unstale":"2024-04-02T07:24:11.938911+0000","last_undegraded":"2024-04-02T07:24:11.938911+0000","last_fullsized":"2024-04-02T07:24:11.938911+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:19:53.123928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:12.948560+0000","last_change":"2024-04-02T07:24:11.955204+0000","last_active":"2024-04-02T07:24:12.948560+0000","last_peered":"2024-04-02T07:24:12.948560+0000","last_clean":"2024-04-02T07:24:12.948560+0000","last_became_active":"2024-04-02T07:24:11.952978+0000","last_became_peered":"2024-04-02T07:24:11.952978+0000","last_unstale":"2024-04-02T07:24:12.948560+0000","last_undegraded":"2024-04-02T07:24:12.948560+0000","last_fullsized":"2024-04-02T07:24:12.948560+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:00:32.244665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.946853+0000","last_change":"2024-04-02T07:24:11.545951+0000","last_active":"2024-04-02T07:24:11.946853+0000","last_peered":"2024-04-02T07:24:11.946853+0000","last_clean":"2024-04-02T07:24:11.946853+0000","last_became_active":"2024-04-02T07:24:11.545359+0000","last_became_peered":"2024-04-02T07:24:11.545359+0000","last_unstale":"2024-04-02T07:24:11.946853+0000","last_undegraded":"2024-04-02T07:24:11.946853+0000","last_fullsized":"2024-04-02T07:24:11.946853+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:42:08.977549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.047824+0000","last_change":"2024-04-02T07:24:11.960353+0000","last_active":"2024-04-02T07:24:13.047824+0000","last_peered":"2024-04-02T07:24:13.047824+0000","last_clean":"2024-04-02T07:24:13.047824+0000","last_became_active":"2024-04-02T07:24:11.960041+0000","last_became_peered":"2024-04-02T07:24:11.960041+0000","last_unstale":"2024-04-02T07:24:13.047824+0000","last_undegraded":"2024-04-02T07:24:13.047824+0000","last_fullsized":"2024-04-02T07:24:13.047824+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:05:43.642749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.937526+0000","last_change":"2024-04-02T07:24:11.550540+0000","last_active":"2024-04-02T07:24:11.937526+0000","last_peered":"2024-04-02T07:24:11.937526+0000","last_clean":"2024-04-02T07:24:11.937526+0000","last_became_active":"2024-04-02T07:24:11.549947+0000","last_became_peered":"2024-04-02T07:24:11.549947+0000","last_unstale":"2024-04-02T07:24:11.937526+0000","last_undegraded":"2024-04-02T07:24:11.937526+0000","last_fullsized":"2024-04-02T07:24:11.937526+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:30:39.543249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":46,"state":"active+clean","last_fresh":"2024-04-02T07:24:13.048019+0000","last_change":"2024-04-02T07:24:11.959765+0000","last_active":"2024-04-02T07:24:13.048019+0000","last_peered":"2024-04-02T07:24:13.048019+0000","last_clean":"2024-04-02T07:24:13.048019+0000","last_became_active":"2024-04-02T07:24:11.959341+0000","last_became_peered":"2024-04-02T07:24:11.959341+0000","last_unstale":"2024-04-02T07:24:13.048019+0000","last_undegraded":"2024-04-02T07:24:13.048019+0000","last_fullsized":"2024-04-02T07:24:13.048019+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:11.506601+0000","last_clean_scrub_stamp":"2024-04-02T07:24:11.506601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:00:32.244665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"45'2","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.965762+0000","last_change":"2024-04-02T07:24:11.548468+0000","last_active":"2024-04-02T07:24:11.965762+0000","last_peered":"2024-04-02T07:24:11.965762+0000","last_clean":"2024-04-02T07:24:11.965762+0000","last_became_active":"2024-04-02T07:24:11.548187+0000","last_became_peered":"2024-04-02T07:24:11.548187+0000","last_unstale":"2024-04-02T07:24:11.965762+0000","last_undegraded":"2024-04-02T07:24:11.965762+0000","last_fullsized":"2024-04-02T07:24:11.965762+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:24:10.503751+0000","last_clean_scrub_stamp":"2024-04-02T07:24:10.503751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:11:13.000802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":187,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-04-02T07:24:11.947908+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:24:11.947908+0000","last_peered":"2024-04-02T07:24:11.947908+0000","last_clean":"2024-04-02T07:24:11.947908+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:24:11.947908+0000","last_undegraded":"2024-04-02T07:24:11.947908+0000","last_fullsized":"2024-04-02T07:24:11.947908+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574876,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28132,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343708,"statfs":{"total":96636764160,"available":96607956992,"internally_reserved":0,"allocated":1138688,"data_stored":810860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64200000000000002,"15min":0.64100000000000001},"min":{"1min":0.441,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88300000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.60999999999999999,"15min":0.59799999999999998},"min":{"1min":0.48299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.755}]},{"osd":1,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.628,"15min":0.624},"min":{"1min":0.436,"5min":0.379,"15min":0.379},"max":{"1min":0.84299999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86199999999999999,"5min":1.113,"15min":1.113},"last":0.59699999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.747,"15min":0.75},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.93999999999999995,"5min":1.139,"15min":1.139},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.5,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96299999999999997,"5min":1.522,"15min":1.522},"last":0.80900000000000005}]},{"osd":3,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.50700000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92700000000000005,"5min":1.405,"15min":1.405},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72699999999999998,"15min":0.72799999999999998},"min":{"1min":0.58599999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92300000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.82999999999999996}]},{"osd":4,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68799999999999994,"15min":0.70299999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81499999999999995,"5min":1.633,"15min":1.633},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.874,"5min":1.079,"15min":1.079},"last":0.93600000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72299999999999998,"15min":0.74099999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94499999999999995,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.78700000000000003,"15min":0.79900000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95499999999999996,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.95599999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82799999999999996,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.69799999999999995,"15min":0.71499999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82499999999999996,"5min":1,"15min":1},"last":0.86499999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":536,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":548864,"data_stored":221074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.66200000000000003,"15min":0.66300000000000003},"min":{"1min":0.48299999999999998,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86199999999999999,"5min":1.399,"15min":1.399},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.88,"15min":0.91900000000000004},"min":{"1min":0.44800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95999999999999996,"5min":5.7569999999999997,"15min":5.7569999999999997},"last":0.77000000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69299999999999995,"5min":0.72599999999999998,"15min":0.73199999999999998},"min":{"1min":0.52600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.93899999999999995,"5min":1.95,"15min":1.95},"last":0.752},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"min":{"1min":0.52500000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.95799999999999996,"5min":1.248,"15min":1.248},"last":0.72899999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.69499999999999995,"15min":0.69799999999999995},"min":{"1min":0.54900000000000004,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.89300000000000002,"5min":1.226,"15min":1.226},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.71199999999999997,"15min":0.70999999999999996},"min":{"1min":0.55700000000000005,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.61699999999999999}]},{"osd":3,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.81000000000000005,"15min":0.82499999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.88,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.79700000000000004,"15min":0.80900000000000005},"min":{"1min":0.52600000000000002,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":0.97899999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.54100000000000004}]},{"osd":4,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.66600000000000004,"15min":0.67300000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67300000000000004,"15min":0.67400000000000004},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.91000000000000003,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.69799999999999995}]},{"osd":5,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.68000000000000005,"15min":0.68799999999999994},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.89500000000000002,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.73799999999999999,"15min":0.73999999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.98999999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.66600000000000004}]},{"osd":7,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.745,"15min":0.753},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.93400000000000005,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.754,"15min":0.75700000000000001},"min":{"1min":0.56299999999999994,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.97099999999999997,"5min":0.999,"15min":0.999},"last":0.68300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":544768,"data_stored":220472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.65300000000000002,"15min":0.64700000000000002},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.86199999999999999,"5min":1.25,"15min":1.25},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.70799999999999996,"15min":0.70899999999999996},"min":{"1min":0.48899999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.91300000000000003,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.56100000000000005}]},{"osd":1,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.97399999999999998,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.72499999999999998,"15min":0.72999999999999998},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.97899999999999998,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.46800000000000003}]},{"osd":2,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.82299999999999995,"15min":0.83499999999999996},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98399999999999999,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.74299999999999999,"15min":0.752},"min":{"1min":0.438,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.95699999999999996,"5min":1.696,"15min":1.696},"last":0.442}]},{"osd":3,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.76100000000000001,"15min":0.77300000000000002},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":0.99099999999999999,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.82499999999999996,"15min":0.84199999999999997},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":0.998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.58499999999999996}]},{"osd":4,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.71599999999999997,"15min":0.74199999999999999},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.90500000000000003,"5min":1.911,"15min":1.911},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.77800000000000002,"15min":0.81000000000000005},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.92400000000000004,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.496}]},{"osd":6,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.86099999999999999,"15min":0.89400000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.95799999999999996,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.84599999999999997,"15min":0.878},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.0269999999999999,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.62}]},{"osd":7,"last update":"Tue Apr 2 07:24:06 2024","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.86199999999999999,"15min":0.89400000000000002},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":1.038,"5min":1.887,"15min":1.887},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.91300000000000003,"15min":0.94799999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.012,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.54200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574879,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27560,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344280,"statfs":{"total":96636764160,"available":96608542720,"internally_reserved":0,"allocated":552960,"data_stored":221966,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.746,"15min":0.75900000000000001},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91800000000000004,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.81999999999999995,"15min":0.84999999999999998},"min":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81499999999999995,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.71699999999999997}]},{"osd":1,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76300000000000001,"15min":0.77000000000000002},"min":{"1min":0.56200000000000006,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90600000000000003,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.499},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.90800000000000003,"15min":0.94199999999999995},"min":{"1min":0.54200000000000004,"5min":0.503,"15min":0.503},"max":{"1min":0.97399999999999998,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":0.75700000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.80400000000000005,"15min":0.81499999999999995},"min":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.93999999999999995,"5min":2.056,"15min":2.056},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.878,"15min":0.90200000000000002},"min":{"1min":0.59399999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.874,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.73799999999999999}]},{"osd":3,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.999,"15min":1.0369999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.97899999999999998,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.77600000000000002,"5min":1.012,"15min":1.0509999999999999},"min":{"1min":0.65200000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.91700000000000004,"5min":3.9750000000000001,"15min":3.9750000000000001},"last":0.78700000000000003}]},{"osd":5,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71999999999999997,"15min":0.72499999999999998},"min":{"1min":0.439,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91000000000000003,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.45800000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95499999999999996,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.66500000000000004}]},{"osd":6,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":0.72999999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.085,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79300000000000004,"15min":0.79400000000000004},"min":{"1min":0.57799999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98399999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.68400000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.026,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.68500000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.0640000000000001,"5min":1.353,"15min":1.353},"last":0.85699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574877,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31668,"kb_used_data":540,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340172,"statfs":{"total":96636764160,"available":96604336128,"internally_reserved":0,"allocated":552960,"data_stored":221040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.44900000000000001,"15min":0.45400000000000001},"min":{"1min":0.26600000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.56599999999999995,"5min":0.62,"15min":0.62},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.47999999999999998,"15min":0.48299999999999998},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.746,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.46400000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.434,"15min":0.434},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.503,"15min":0.50700000000000001},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.61399999999999999,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.42999999999999999}]},{"osd":2,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.52000000000000002,"15min":0.52400000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.58199999999999996,"15min":0.59099999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.65300000000000002,"5min":1.306,"15min":1.306},"last":0.504}]},{"osd":4,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.012,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.752,"15min":0.75700000000000001},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.98999999999999999,"5min":1.155,"15min":1.155},"last":0.86299999999999999}]},{"osd":5,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.77300000000000002,"15min":0.77500000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.73799999999999999},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.74199999999999999,"15min":0.74399999999999999},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.038,"5min":1.135,"15min":1.135},"last":0.76200000000000001}]},{"osd":6,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0700000000000001,"5min":1.25,"15min":1.25},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"min":{"1min":0.60099999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.095,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.81899999999999995}]},{"osd":7,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.1319999999999999,"5min":1.216,"15min":1.216},"last":0.625},{"interface":"front","average":{"1min":0.746,"5min":0.78900000000000003,"15min":0.79600000000000004},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.046,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.83499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31660,"kb_used_data":544,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340180,"statfs":{"total":96636764160,"available":96604344320,"internally_reserved":0,"allocated":557056,"data_stored":221988,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.44600000000000001,"15min":0.45200000000000001},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.57399999999999995,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.47999999999999998,"15min":0.48399999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.63400000000000001}]},{"osd":1,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.80800000000000005,"5min":1.171,"15min":1.171},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48799999999999999,"15min":0.49199999999999999},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.64500000000000002,"5min":1.333,"15min":1.333},"last":0.59299999999999997}]},{"osd":3,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.51700000000000002,"15min":0.51400000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72099999999999997,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.56499999999999995,"15min":0.56599999999999995},"min":{"1min":0.39900000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.61499999999999999}]},{"osd":4,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.76400000000000001,"15min":0.77400000000000002},"min":{"1min":0.47699999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0109999999999999,"5min":2.254,"15min":2.254},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.76500000000000001,"15min":0.76600000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.016,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.84299999999999997}]},{"osd":5,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.75,"15min":0.75600000000000001},"min":{"1min":0.52600000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":0.997,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.80900000000000005,"15min":0.81799999999999995},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.093,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.81499999999999995}]},{"osd":6,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.61099999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0369999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"last":0.88300000000000001},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.82099999999999995,"15min":0.82399999999999995},"min":{"1min":0.62,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.105,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":0.92800000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:24:07 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.82599999999999996,"15min":0.83999999999999997},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0549999999999999,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.79900000000000004,"5min":0.82399999999999995,"15min":0.82799999999999996},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0629999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"last":0.91400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31648,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340192,"statfs":{"total":96636764160,"available":96604356608,"internally_reserved":0,"allocated":544768,"data_stored":220472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.254,"5min":0.251,"15min":0.251},"max":{"1min":0.60399999999999998,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.373},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.65300000000000002,"15min":0.67500000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.093,"5min":4.157,"15min":4.157},"last":0.41899999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.65600000000000003,"15min":0.69199999999999995},"min":{"1min":0.32700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68500000000000005,"5min":4.282,"15min":4.282},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79500000000000004,"5min":1.625,"15min":1.625},"last":0.59499999999999997}]},{"osd":3,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60999999999999999,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72099999999999997,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.504},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.91100000000000003,"15min":0.97199999999999998},"min":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.052,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.47499999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.96599999999999997,"15min":1.006},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0900000000000001,"5min":4.7400000000000002,"15min":4.7400000000000002},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.754,"5min":0.82799999999999996,"15min":0.83999999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.99199999999999999,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.73999999999999999}]},{"osd":5,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.95899999999999996,"15min":0.98199999999999998},"min":{"1min":0.53900000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.163,"5min":4.5759999999999996,"15min":4.5759999999999996},"last":0.63},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.95499999999999996,"15min":0.98699999999999999},"min":{"1min":0.48999999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0089999999999999,"5min":4.7949999999999999,"15min":4.7949999999999999},"last":0.64500000000000002}]},{"osd":6,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":1.0029999999999999,"15min":1.0389999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.129,"5min":4.6890000000000001,"15min":4.6890000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.752,"5min":0.97299999999999998,"15min":1.01},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0620000000000001,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.68400000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.83799999999999997,"15min":0.84999999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0069999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.98799999999999999,"15min":1.0129999999999999},"min":{"1min":0.55800000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.383,"5min":4.6420000000000003,"15min":4.6420000000000003},"last":0.66900000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32228,"kb_used_data":1112,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339612,"statfs":{"total":96636764160,"available":96603762688,"internally_reserved":0,"allocated":1138688,"data_stored":810804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.47399999999999998,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.622,"5min":1.48,"15min":1.48},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.51000000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74399999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.34000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79100000000000004,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51900000000000002,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.70299999999999996}]},{"osd":3,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.32600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.56999999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.61899999999999999,"15min":0.63100000000000001},"min":{"1min":0.41799999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.69899999999999995,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.72699999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.90600000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.53700000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":1.0369999999999999}]},{"osd":5,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.78900000000000003,"15min":0.79900000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94099999999999995,"5min":1.371,"15min":1.371},"last":0.89600000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.97899999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.878}]},{"osd":6,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.58799999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.018,"5min":1.177,"15min":1.177},"last":0.97899999999999998},{"interface":"front","average":{"1min":0.748,"5min":0.83499999999999996,"15min":0.84899999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.002,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.99399999999999999}]},{"osd":7,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.56299999999999994,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.069,"5min":1.135,"15min":1.135},"last":1.016},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.92400000000000004,"5min":1.141,"15min":1.141},"last":0.93600000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:24:20.986 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-02T07:24:20.986 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-02T07:24:21.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.166+0000 7fd4c4000640 1 Processor -- start 2024-04-02T07:24:21.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.166+0000 7fd4c4000640 1 -- start start 2024-04-02T07:24:21.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.166+0000 7fd4c4000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd4bc06e160 0x7fd4bc15a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:21.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.166+0000 7fd4c4000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4bc0ceac0 0x7fd4bc0cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:21.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.166+0000 7fd4c4000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4bc06c1e0 con 0x7fd4bc157130 2024-04-02T07:24:21.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.166+0000 7fd4c4000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc06c4c0 con 0x7fd4bc0ceac0 2024-04-02T07:24:21.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.166+0000 7fd4c4000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4bc06c7a0 con 0x7fd4bc06e160 2024-04-02T07:24:21.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.166+0000 7fd4c2000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4bc0ceac0 0x7fd4bc0cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:21.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.166+0000 7fd4c2000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4bc0ceac0 0x7fd4bc0cc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33552/0 (socket says 172.21.15.55:33552) 2024-04-02T07:24:21.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.166+0000 7fd4c2000640 1 -- 172.21.15.55:0/707848191 learned_addr learned my addr 172.21.15.55:0/707848191 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:21.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.166+0000 7fd4c0c00640 1 --2- 172.21.15.55:0/707848191 >> v2:172.21.15.106:3300/0 conn(0x7fd4bc06e160 0x7fd4bc15a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:21.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.170+0000 7fd4c2000640 1 -- 172.21.15.55:0/707848191 >> v2:172.21.15.106:3300/0 conn(0x7fd4bc06e160 msgr2=0x7fd4bc15a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:21.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.170+0000 7fd4c2000640 1 --2- 172.21.15.55:0/707848191 >> v2:172.21.15.106:3300/0 conn(0x7fd4bc06e160 0x7fd4bc15a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.170+0000 7fd4c2000640 1 -- 172.21.15.55:0/707848191 >> v1:172.21.15.106:6789/0 conn(0x7fd4bc157130 legacy=0x7fd4bc0ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:21.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.170+0000 7fd4c2000640 1 -- 172.21.15.55:0/707848191 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4bc06ca80 con 0x7fd4bc0ceac0 2024-04-02T07:24:21.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.170+0000 7fd4c2000640 1 --2- 172.21.15.55:0/707848191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4bc0ceac0 0x7fd4bc0cc2e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc159c30 tx=0x7fd4b401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3fc3bad7976c4a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:21.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.170+0000 7fd4bbe00640 1 -- 172.21.15.55:0/707848191 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40a56c0 con 0x7fd4bc0ceac0 2024-04-02T07:24:21.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.170+0000 7fd4bbe00640 1 -- 172.21.15.55:0/707848191 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b40a5820 con 0x7fd4bc0ceac0 2024-04-02T07:24:21.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.170+0000 7fd4bbe00640 1 -- 172.21.15.55:0/707848191 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40a5bb0 con 0x7fd4bc0ceac0 2024-04-02T07:24:21.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.170+0000 7fd4c4000640 1 -- 172.21.15.55:0/707848191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4bc0ceac0 msgr2=0x7fd4bc0cc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:21.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.170+0000 7fd4c4000640 1 --2- 172.21.15.55:0/707848191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4bc0ceac0 0x7fd4bc0cc2e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc159c30 tx=0x7fd4b401c9f0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.170+0000 7fd4c4000640 1 -- 172.21.15.55:0/707848191 shutdown_connections 2024-04-02T07:24:21.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.170+0000 7fd4c4000640 1 --2- 172.21.15.55:0/707848191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4bc0ceac0 0x7fd4bc0cc2e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.170+0000 7fd4c4000640 1 --2- 172.21.15.55:0/707848191 >> v2:172.21.15.106:3300/0 conn(0x7fd4bc06e160 0x7fd4bc15a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.170+0000 7fd4c4000640 1 -- 172.21.15.55:0/707848191 >> 172.21.15.55:0/707848191 conn(0x7fd4bc066110 msgr2=0x7fd4bc069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:21.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.170+0000 7fd4c4000640 1 -- 172.21.15.55:0/707848191 shutdown_connections 2024-04-02T07:24:21.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.170+0000 7fd4c4000640 1 -- 172.21.15.55:0/707848191 wait complete. 2024-04-02T07:24:21.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c4000640 1 Processor -- start 2024-04-02T07:24:21.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c4000640 1 -- start start 2024-04-02T07:24:21.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c4000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4bc06e160 0x7fd4bc1464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:21.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c4000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4bc0ceac0 0x7fd4bc14b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:21.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c4000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4bc157130 0x7fd4bc145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:21.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c4000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc148f70 con 0x7fd4bc157130 2024-04-02T07:24:21.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c4000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc14bc10 con 0x7fd4bc06e160 2024-04-02T07:24:21.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c4000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4bc147310 con 0x7fd4bc0ceac0 2024-04-02T07:24:21.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c0c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4bc0ceac0 0x7fd4bc14b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:21.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c2000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4bc157130 0x7fd4bc145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:21.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c1600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4bc06e160 0x7fd4bc1464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:21.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c0c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4bc0ceac0 0x7fd4bc14b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:60068/0 (socket says 172.21.15.55:60068) 2024-04-02T07:24:21.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c0c00640 1 -- 172.21.15.55:0/3586557750 learned_addr learned my addr 172.21.15.55:0/3586557750 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:21.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c2000640 1 -- 172.21.15.55:0/3586557750 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4bc0ceac0 msgr2=0x7fd4bc14b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:21.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c2000640 1 --2- 172.21.15.55:0/3586557750 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4bc0ceac0 0x7fd4bc14b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c2000640 1 -- 172.21.15.55:0/3586557750 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4bc06e160 msgr2=0x7fd4bc1464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:21.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c2000640 1 --2- 172.21.15.55:0/3586557750 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4bc06e160 0x7fd4bc1464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c2000640 1 -- 172.21.15.55:0/3586557750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b4009b30 con 0x7fd4bc157130 2024-04-02T07:24:21.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c0c00640 1 --2- 172.21.15.55:0/3586557750 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4bc0ceac0 0x7fd4bc14b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:24:21.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c2000640 1 --2- 172.21.15.55:0/3586557750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4bc157130 0x7fd4bc145bf0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40ab000 tx=0x7fd4b4019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:21.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4b9600640 1 -- 172.21.15.55:0/3586557750 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40bd070 con 0x7fd4bc157130 2024-04-02T07:24:21.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4b9600640 1 -- 172.21.15.55:0/3586557750 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b4009510 con 0x7fd4bc157130 2024-04-02T07:24:21.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4b9600640 1 -- 172.21.15.55:0/3586557750 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b40b86b0 con 0x7fd4bc157130 2024-04-02T07:24:21.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.174+0000 7fd4c4000640 1 -- 172.21.15.55:0/3586557750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4bc14b960 con 0x7fd4bc157130 2024-04-02T07:24:21.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.178+0000 7fd4c4000640 1 -- 172.21.15.55:0/3586557750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4bc1489b0 con 0x7fd4bc157130 2024-04-02T07:24:21.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.178+0000 7fd4c4000640 1 -- 172.21.15.55:0/3586557750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4bc14bd80 con 0x7fd4bc157130 2024-04-02T07:24:21.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.178+0000 7fd4b9600640 1 -- 172.21.15.55:0/3586557750 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd4b40b8810 con 0x7fd4bc157130 2024-04-02T07:24:21.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.178+0000 7fd4b9600640 1 --2- 172.21.15.55:0/3586557750 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd49c066690 0x7fd49c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:21.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.178+0000 7fd4b9600640 1 -- 172.21.15.55:0/3586557750 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4b411ecd0 con 0x7fd4bc157130 2024-04-02T07:24:21.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.178+0000 7fd4c1600640 1 --2- 172.21.15.55:0/3586557750 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd49c066690 0x7fd49c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:21.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.178+0000 7fd4c1600640 1 --2- 172.21.15.55:0/3586557750 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd49c066690 0x7fd49c068b50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc156b50 tx=0x7fd4b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:21.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.182+0000 7fd4b9600640 1 -- 172.21.15.55:0/3586557750 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd4bc14bd80 con 0x7fd4bc157130 2024-04-02T07:24:21.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.398+0000 7fd4c4000640 1 -- 172.21.15.55:0/3586557750 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd4bc14bd80 con 0x7fd4bc157130 2024-04-02T07:24:21.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.402+0000 7fd4b9600640 1 -- 172.21.15.55:0/3586557750 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v12) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd4bc14bd80 con 0x7fd4bc157130 2024-04-02T07:24:21.406 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2024-04-02T07:24:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.406+0000 7fd4c4000640 1 -- 172.21.15.55:0/3586557750 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd49c066690 msgr2=0x7fd49c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.406+0000 7fd4c4000640 1 --2- 172.21.15.55:0/3586557750 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd49c066690 0x7fd49c068b50 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc156b50 tx=0x7fd4b0009040 comp rx=0 tx=0).stop 2024-04-02T07:24:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.406+0000 7fd4c4000640 1 -- 172.21.15.55:0/3586557750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4bc157130 msgr2=0x7fd4bc145bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.406+0000 7fd4c4000640 1 --2- 172.21.15.55:0/3586557750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4bc157130 0x7fd4bc145bf0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd4b40ab000 tx=0x7fd4b4019790 comp rx=0 tx=0).stop 2024-04-02T07:24:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.406+0000 7fd4c4000640 1 -- 172.21.15.55:0/3586557750 shutdown_connections 2024-04-02T07:24:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.406+0000 7fd4c4000640 1 --2- 172.21.15.55:0/3586557750 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4bc157130 0x7fd4bc145bf0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.406+0000 7fd4c4000640 1 --2- 172.21.15.55:0/3586557750 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4bc0ceac0 0x7fd4bc14b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.406+0000 7fd4c4000640 1 --2- 172.21.15.55:0/3586557750 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd49c066690 0x7fd49c068b50 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.406+0000 7fd4c4000640 1 --2- 172.21.15.55:0/3586557750 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4bc06e160 0x7fd4bc1464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.406+0000 7fd4c4000640 1 -- 172.21.15.55:0/3586557750 >> 172.21.15.55:0/3586557750 conn(0x7fd4bc066110 msgr2=0x7fd4bc153fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.406+0000 7fd4c4000640 1 -- 172.21.15.55:0/3586557750 shutdown_connections 2024-04-02T07:24:21.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.406+0000 7fd4c4000640 1 -- 172.21.15.55:0/3586557750 wait complete. 2024-04-02T07:24:21.427 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:24:21.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.562+0000 7f9f2b200640 1 Processor -- start 2024-04-02T07:24:21.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.562+0000 7f9f2b200640 1 -- start start 2024-04-02T07:24:21.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.566+0000 7f9f2b200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9f24143f90 0x7f9f2415ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:21.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.566+0000 7f9f2b200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9f240b34f0 0x7f9f240cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:21.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.566+0000 7f9f2b200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9f240b3980 0x7f9f240cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:21.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.566+0000 7f9f2b200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f2415b270 con 0x7f9f24143f90 2024-04-02T07:24:21.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.566+0000 7f9f2b200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f24144370 con 0x7f9f240b34f0 2024-04-02T07:24:21.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.566+0000 7f9f2b200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f240c37b0 con 0x7f9f240b3980 2024-04-02T07:24:21.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.566+0000 7f9f23e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9f24143f90 0x7f9f2415ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:21.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.566+0000 7f9f23e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9f24143f90 0x7f9f2415ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33556/0 (socket says 172.21.15.55:33556) 2024-04-02T07:24:21.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.566+0000 7f9f23e00640 1 -- 172.21.15.55:0/219963157 learned_addr learned my addr 172.21.15.55:0/219963157 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:21.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.566+0000 7f9f23e00640 1 -- 172.21.15.55:0/219963157 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9f240b3980 msgr2=0x7f9f240cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:21.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.566+0000 7f9f23e00640 1 --2- 172.21.15.55:0/219963157 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9f240b3980 0x7f9f240cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.566+0000 7f9f23e00640 1 -- 172.21.15.55:0/219963157 >> v2:172.21.15.106:3300/0 conn(0x7f9f240b34f0 msgr2=0x7f9f240cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:21.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.566+0000 7f9f23e00640 1 --2- 172.21.15.55:0/219963157 >> v2:172.21.15.106:3300/0 conn(0x7f9f240b34f0 0x7f9f240cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.566+0000 7f9f23e00640 1 -- 172.21.15.55:0/219963157 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f240c3a90 con 0x7f9f24143f90 2024-04-02T07:24:21.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f23e00640 1 --2- 172.21.15.55:0/219963157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f24143f90 0x7f9f2415ad30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9f240b2d40 tx=0x7f9f1401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffc7ac0e9cc741d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:21.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f23400640 1 -- 172.21.15.55:0/219963157 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f140ab620 con 0x7f9f24143f90 2024-04-02T07:24:21.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f23400640 1 -- 172.21.15.55:0/219963157 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f140ab780 con 0x7f9f24143f90 2024-04-02T07:24:21.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f23400640 1 -- 172.21.15.55:0/219963157 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f140abb10 con 0x7f9f24143f90 2024-04-02T07:24:21.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f2b200640 1 -- 172.21.15.55:0/219963157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f24143f90 msgr2=0x7f9f2415ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:21.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f2b200640 1 --2- 172.21.15.55:0/219963157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f24143f90 0x7f9f2415ad30 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9f240b2d40 tx=0x7f9f1401c460 comp rx=0 tx=0).stop 2024-04-02T07:24:21.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f2b200640 1 -- 172.21.15.55:0/219963157 shutdown_connections 2024-04-02T07:24:21.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f2b200640 1 --2- 172.21.15.55:0/219963157 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9f240b3980 0x7f9f240cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f2b200640 1 --2- 172.21.15.55:0/219963157 >> v2:172.21.15.106:3300/0 conn(0x7f9f240b34f0 0x7f9f240cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f2b200640 1 --2- 172.21.15.55:0/219963157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f24143f90 0x7f9f2415ad30 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f2b200640 1 -- 172.21.15.55:0/219963157 >> 172.21.15.55:0/219963157 conn(0x7f9f24066080 msgr2=0x7f9f24069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:21.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f2b200640 1 -- 172.21.15.55:0/219963157 shutdown_connections 2024-04-02T07:24:21.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f2b200640 1 -- 172.21.15.55:0/219963157 wait complete. 2024-04-02T07:24:21.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f2b200640 1 Processor -- start 2024-04-02T07:24:21.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f2b200640 1 -- start start 2024-04-02T07:24:21.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f2b200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f240b34f0 0x7f9f24140440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:21.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f2b200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f240b3980 0x7f9f2413d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f2b200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9f24143f90 0x7f9f24138f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f2b200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24141030 con 0x7f9f240b34f0 2024-04-02T07:24:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f2b200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f24140980 con 0x7f9f240b3980 2024-04-02T07:24:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.570+0000 7f9f2b200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f2413b670 con 0x7f9f24143f90 2024-04-02T07:24:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f23e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f240b34f0 0x7f9f24140440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f23e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f240b34f0 0x7f9f24140440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33572/0 (socket says 172.21.15.55:33572) 2024-04-02T07:24:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f23e00640 1 -- 172.21.15.55:0/2825173178 learned_addr learned my addr 172.21.15.55:0/2825173178 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f29200640 1 --2- 172.21.15.55:0/2825173178 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9f24143f90 0x7f9f24138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f1b400640 1 --2- 172.21.15.55:0/2825173178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f240b3980 0x7f9f2413d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f23e00640 1 -- 172.21.15.55:0/2825173178 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9f24143f90 msgr2=0x7f9f24138f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f23e00640 1 --2- 172.21.15.55:0/2825173178 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9f24143f90 0x7f9f24138f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f23e00640 1 -- 172.21.15.55:0/2825173178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f240b3980 msgr2=0x7f9f2413d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f23e00640 1 --2- 172.21.15.55:0/2825173178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f240b3980 0x7f9f2413d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f23e00640 1 -- 172.21.15.55:0/2825173178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f140094d0 con 0x7f9f240b34f0 2024-04-02T07:24:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f29200640 1 --2- 172.21.15.55:0/2825173178 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9f24143f90 0x7f9f24138f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:24:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f1b400640 1 --2- 172.21.15.55:0/2825173178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f240b3980 0x7f9f2413d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:24:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f23e00640 1 --2- 172.21.15.55:0/2825173178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f240b34f0 0x7f9f24140440 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9f1401ab10 tx=0x7f9f1401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f20c00640 1 -- 172.21.15.55:0/2825173178 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f140be3f0 con 0x7f9f240b34f0 2024-04-02T07:24:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f20c00640 1 -- 172.21.15.55:0/2825173178 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f140be570 con 0x7f9f240b34f0 2024-04-02T07:24:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f2b200640 1 -- 172.21.15.55:0/2825173178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f2413b950 con 0x7f9f240b34f0 2024-04-02T07:24:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f20c00640 1 -- 172.21.15.55:0/2825173178 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f140be920 con 0x7f9f240b34f0 2024-04-02T07:24:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f2b200640 1 -- 172.21.15.55:0/2825173178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f24141520 con 0x7f9f240b34f0 2024-04-02T07:24:21.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f2b200640 1 -- 172.21.15.55:0/2825173178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f24141710 con 0x7f9f240b34f0 2024-04-02T07:24:21.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f20c00640 1 -- 172.21.15.55:0/2825173178 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f9f140b43f0 con 0x7f9f240b34f0 2024-04-02T07:24:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.574+0000 7f9f20c00640 1 --2- 172.21.15.55:0/2825173178 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9f000666c0 0x7f9f00068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.578+0000 7f9f20c00640 1 -- 172.21.15.55:0/2825173178 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9f1411e970 con 0x7f9f240b34f0 2024-04-02T07:24:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.578+0000 7f9f1b400640 1 --2- 172.21.15.55:0/2825173178 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9f000666c0 0x7f9f00068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.578+0000 7f9f1b400640 1 --2- 172.21.15.55:0/2825173178 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9f000666c0 0x7f9f00068b80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9f2413e150 tx=0x7f9f0c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:21.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.578+0000 7f9f20c00640 1 -- 172.21.15.55:0/2825173178 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f9f140ebc40 con 0x7f9f240b34f0 2024-04-02T07:24:21.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.774+0000 7f9f2b200640 1 -- 172.21.15.55:0/2825173178 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9f24066c90 con 0x7f9f240b34f0 2024-04-02T07:24:21.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.774+0000 7f9f20c00640 1 -- 172.21.15.55:0/2825173178 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f9f140ef260 con 0x7f9f240b34f0 2024-04-02T07:24:21.778 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:21.778 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2224746522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2224746522},{"type":"v1","addr":"172.21.15.106:6837","nonce":2224746522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/2077739908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2077739908},{"type":"v1","addr":"172.21.15.55:6833","nonce":2077739908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/4108584287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4108584287},{"type":"v1","addr":"172.21.15.55:6835","nonce":4108584287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:24:11.929212+0000","modified":"2024-04-02T07:24:14.958225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5655":{"gid":5655,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6836/1720558250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1720558250},{"type":"v1","addr":"172.21.15.106:6836","nonce":1720558250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-02T07:24:21.778 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 25 2024-04-02T07:24:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.778+0000 7f9f2b200640 1 -- 172.21.15.55:0/2825173178 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9f000666c0 msgr2=0x7f9f00068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.778+0000 7f9f2b200640 1 --2- 172.21.15.55:0/2825173178 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9f000666c0 0x7f9f00068b80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f9f2413e150 tx=0x7f9f0c008040 comp rx=0 tx=0).stop 2024-04-02T07:24:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.778+0000 7f9f2b200640 1 -- 172.21.15.55:0/2825173178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f240b34f0 msgr2=0x7f9f24140440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.778+0000 7f9f2b200640 1 --2- 172.21.15.55:0/2825173178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f240b34f0 0x7f9f24140440 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9f1401ab10 tx=0x7f9f1401aca0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.778+0000 7f9f2b200640 1 -- 172.21.15.55:0/2825173178 shutdown_connections 2024-04-02T07:24:21.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.778+0000 7f9f2b200640 1 --2- 172.21.15.55:0/2825173178 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9f24143f90 0x7f9f24138f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.778+0000 7f9f2b200640 1 --2- 172.21.15.55:0/2825173178 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9f000666c0 0x7f9f00068b80 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.778+0000 7f9f2b200640 1 --2- 172.21.15.55:0/2825173178 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9f240b3980 0x7f9f2413d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.778+0000 7f9f2b200640 1 --2- 172.21.15.55:0/2825173178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9f240b34f0 0x7f9f24140440 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:21.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.778+0000 7f9f2b200640 1 -- 172.21.15.55:0/2825173178 >> 172.21.15.55:0/2825173178 conn(0x7f9f24066080 msgr2=0x7f9f24164ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:21.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.778+0000 7f9f2b200640 1 -- 172.21.15.55:0/2825173178 shutdown_connections 2024-04-02T07:24:21.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:21.778+0000 7f9f2b200640 1 -- 172.21.15.55:0/2825173178 wait complete. 2024-04-02T07:24:22.202 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:24:11.929212+0000', 'modified': '2024-04-02T07:24:14.958225+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5655}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5655': {'gid': 5655, 'name': 'b', 'rank': 0, 'incarnation': 21, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.106:6836/1720558250', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6834', 'nonce': 1720558250}, {'type': 'v1', 'addr': '172.21.15.106:6836', 'nonce': 1720558250}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:24:22.202 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-02T07:24:22.202 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-02T07:24:22.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.342+0000 7f61b4600640 1 Processor -- start 2024-04-02T07:24:22.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.342+0000 7f61b4600640 1 -- start start 2024-04-02T07:24:22.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.342+0000 7f61b4600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f61ac1599c0 0x7f61ac0b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.342+0000 7f61b4600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ac0b1d60 con 0x7f61ac06d1c0 2024-04-02T07:24:22.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.342+0000 7f61b4600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ac06c400 con 0x7f61ac0b38f0 2024-04-02T07:24:22.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.342+0000 7f61b4600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ac06cda0 con 0x7f61ac1599c0 2024-04-02T07:24:22.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.346+0000 7f61b1200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f61ac06d1c0 0x7f61ac0b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48206/0 (socket says 172.21.15.55:48206) 2024-04-02T07:24:22.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.346+0000 7f61b1200640 1 -- 172.21.15.55:0/1672592932 learned_addr learned my addr 172.21.15.55:0/1672592932 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:22.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.346+0000 7f61b1c00640 1 --2- 172.21.15.55:0/1672592932 >> v2:172.21.15.106:3300/0 conn(0x7f61ac1599c0 0x7f61ac0b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.346+0000 7f61abe00640 1 -- 172.21.15.55:0/1672592932 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 955564915 0 0) 0x7f61ac0b1d60 con 0x7f61ac06d1c0 2024-04-02T07:24:22.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.346+0000 7f61abe00640 1 -- 172.21.15.55:0/1672592932 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6194003530 con 0x7f61ac06d1c0 2024-04-02T07:24:22.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.346+0000 7f61b1c00640 1 -- 172.21.15.55:0/1672592932 >> v1:172.21.15.106:6789/0 conn(0x7f61ac0b38f0 legacy=0x7f61ac0c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:22.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.346+0000 7f61b1c00640 1 -- 172.21.15.55:0/1672592932 >> v1:172.21.15.55:6789/0 conn(0x7f61ac06d1c0 legacy=0x7f61ac0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:22.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.346+0000 7f61b1c00640 1 -- 172.21.15.55:0/1672592932 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ac06c6e0 con 0x7f61ac1599c0 2024-04-02T07:24:22.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.346+0000 7f61b1c00640 1 --2- 172.21.15.55:0/1672592932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61ac1599c0 0x7f61ac0b1780 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f61a00097c0 tx=0x7f61a001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a33c2082f40dce6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:22.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61abe00640 1 -- 172.21.15.55:0/1672592932 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a00ab600 con 0x7f61ac1599c0 2024-04-02T07:24:22.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61abe00640 1 -- 172.21.15.55:0/1672592932 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a00a7050 con 0x7f61ac1599c0 2024-04-02T07:24:22.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61abe00640 1 -- 172.21.15.55:0/1672592932 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a00ab980 con 0x7f61ac1599c0 2024-04-02T07:24:22.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61b4600640 1 -- 172.21.15.55:0/1672592932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61ac1599c0 msgr2=0x7f61ac0b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:22.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61b4600640 1 --2- 172.21.15.55:0/1672592932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61ac1599c0 0x7f61ac0b1780 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f61a00097c0 tx=0x7f61a001c4a0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61b4600640 1 -- 172.21.15.55:0/1672592932 shutdown_connections 2024-04-02T07:24:22.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61b4600640 1 --2- 172.21.15.55:0/1672592932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61ac1599c0 0x7f61ac0b1780 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61b4600640 1 -- 172.21.15.55:0/1672592932 >> 172.21.15.55:0/1672592932 conn(0x7f61ac069d90 msgr2=0x7f61ac06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:22.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61b4600640 1 -- 172.21.15.55:0/1672592932 shutdown_connections 2024-04-02T07:24:22.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61b4600640 1 -- 172.21.15.55:0/1672592932 wait complete. 2024-04-02T07:24:22.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61b4600640 1 Processor -- start 2024-04-02T07:24:22.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61b4600640 1 -- start start 2024-04-02T07:24:22.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61b4600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61ac06d1c0 0x7f61ac14b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61b4600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f61ac0b38f0 0x7f61ac0c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61b4600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61ac1599c0 0x7f61ac0c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61b4600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac158a50 con 0x7f61ac1599c0 2024-04-02T07:24:22.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61b4600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac158460 con 0x7f61ac06d1c0 2024-04-02T07:24:22.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61b4600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ac154060 con 0x7f61ac0b38f0 2024-04-02T07:24:22.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61b2600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61ac1599c0 0x7f61ac0c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61b2600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61ac1599c0 0x7f61ac0c8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33580/0 (socket says 172.21.15.55:33580) 2024-04-02T07:24:22.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61b2600640 1 -- 172.21.15.55:0/3809173555 learned_addr learned my addr 172.21.15.55:0/3809173555 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:22.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.350+0000 7f61b1c00640 1 --2- 172.21.15.55:0/3809173555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61ac06d1c0 0x7f61ac14b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.354+0000 7f61b1200640 1 --2- 172.21.15.55:0/3809173555 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f61ac0b38f0 0x7f61ac0c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.354+0000 7f61b2600640 1 -- 172.21.15.55:0/3809173555 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f61ac0b38f0 msgr2=0x7f61ac0c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:22.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.354+0000 7f61b2600640 1 --2- 172.21.15.55:0/3809173555 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f61ac0b38f0 0x7f61ac0c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.354+0000 7f61b2600640 1 -- 172.21.15.55:0/3809173555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61ac06d1c0 msgr2=0x7f61ac14b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:22.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.354+0000 7f61b2600640 1 --2- 172.21.15.55:0/3809173555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61ac06d1c0 0x7f61ac14b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.354+0000 7f61b2600640 1 -- 172.21.15.55:0/3809173555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a0009420 con 0x7f61ac1599c0 2024-04-02T07:24:22.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.354+0000 7f61b2600640 1 --2- 172.21.15.55:0/3809173555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61ac1599c0 0x7f61ac0c8040 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f61a400c7a0 tx=0x7f61a400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:22.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.354+0000 7f61a9600640 1 -- 172.21.15.55:0/3809173555 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4003b80 con 0x7f61ac1599c0 2024-04-02T07:24:22.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.354+0000 7f61a9600640 1 -- 172.21.15.55:0/3809173555 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a4003ce0 con 0x7f61ac1599c0 2024-04-02T07:24:22.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.354+0000 7f61b4600640 1 -- 172.21.15.55:0/3809173555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ac154340 con 0x7f61ac1599c0 2024-04-02T07:24:22.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.354+0000 7f61a9600640 1 -- 172.21.15.55:0/3809173555 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a400aa90 con 0x7f61ac1599c0 2024-04-02T07:24:22.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.354+0000 7f61b4600640 1 -- 172.21.15.55:0/3809173555 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ac153d30 con 0x7f61ac1599c0 2024-04-02T07:24:22.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.354+0000 7f61a9600640 1 -- 172.21.15.55:0/3809173555 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f61a400abf0 con 0x7f61ac1599c0 2024-04-02T07:24:22.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.354+0000 7f61a9600640 1 --2- 172.21.15.55:0/3809173555 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f618c066690 0x7f618c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.354+0000 7f61a9600640 1 -- 172.21.15.55:0/3809173555 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61a4083eb0 con 0x7f61ac1599c0 2024-04-02T07:24:22.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b1c00640 1 --2- 172.21.15.55:0/3809173555 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f618c066690 0x7f618c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b7a5c000 1 Processor -- start 2024-04-02T07:24:22.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b7a5c000 1 -- start start 2024-04-02T07:24:22.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b1c00640 1 --2- 172.21.15.55:0/3809173555 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f618c066690 0x7f618c068b50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f61a00ad000 tx=0x7f61a00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:22.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b7a5c000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6adb0 0x562b51c6b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b7a5c000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c6b6d0 0x562b51c20f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b7a5c000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c214c0 0x562b51c218a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b7a5c000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b51ae95a0 con 0x562b51c6adb0 2024-04-02T07:24:22.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b7a5c000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b51a76af0 con 0x562b51c214c0 2024-04-02T07:24:22.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b7a5c000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b51a740c0 con 0x562b51c6b6d0 2024-04-02T07:24:22.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b1c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6adb0 0x562b51c6b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b1c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6adb0 0x562b51c6b190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33596/0 (socket says 172.21.15.55:33596) 2024-04-02T07:24:22.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b1c00640 1 -- 172.21.15.55:0/452681196 learned_addr learned my addr 172.21.15.55:0/452681196 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:22.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b1200640 1 --2- 172.21.15.55:0/452681196 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c6b6d0 0x562b51c20f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b2600640 1 --2- 172.21.15.55:0/452681196 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c214c0 0x562b51c218a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b1c00640 1 -- 172.21.15.55:0/452681196 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c6b6d0 msgr2=0x562b51c20f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:22.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b1c00640 1 --2- 172.21.15.55:0/452681196 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c6b6d0 0x562b51c20f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b1c00640 1 -- 172.21.15.55:0/452681196 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c214c0 msgr2=0x562b51c218a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:22.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b1c00640 1 --2- 172.21.15.55:0/452681196 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c214c0 0x562b51c218a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b1c00640 1 -- 172.21.15.55:0/452681196 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b5176b890 con 0x562b51c6adb0 2024-04-02T07:24:22.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b2600640 1 --2- 172.21.15.55:0/452681196 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c214c0 0x562b51c218a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:22.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b1c00640 1 --2- 172.21.15.55:0/452681196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6adb0 0x562b51c6b190 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f61a00ae040 tx=0x7f61a0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe5d0ce924b1ade server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:22.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f619e000640 1 -- 172.21.15.55:0/452681196 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a00cb660 con 0x562b51c6adb0 2024-04-02T07:24:22.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f619e000640 1 -- 172.21.15.55:0/452681196 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a00cb7c0 con 0x562b51c6adb0 2024-04-02T07:24:22.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f619e000640 1 -- 172.21.15.55:0/452681196 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a00cbb30 con 0x562b51c6adb0 2024-04-02T07:24:22.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b7a5c000 1 -- 172.21.15.55:0/452681196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6adb0 msgr2=0x562b51c6b190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:22.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b7a5c000 1 --2- 172.21.15.55:0/452681196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6adb0 0x562b51c6b190 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f61a00ae040 tx=0x7f61a0004740 comp rx=0 tx=0).stop 2024-04-02T07:24:22.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b7a5c000 1 -- 172.21.15.55:0/452681196 shutdown_connections 2024-04-02T07:24:22.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b7a5c000 1 --2- 172.21.15.55:0/452681196 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c214c0 0x562b51c218a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b7a5c000 1 --2- 172.21.15.55:0/452681196 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c6b6d0 0x562b51c20f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b7a5c000 1 --2- 172.21.15.55:0/452681196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6adb0 0x562b51c6b190 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b7a5c000 1 -- 172.21.15.55:0/452681196 >> 172.21.15.55:0/452681196 conn(0x562b51c27830 msgr2=0x562b51c1f860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:22.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b7a5c000 1 -- 172.21.15.55:0/452681196 shutdown_connections 2024-04-02T07:24:22.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.358+0000 7f61b7a5c000 1 -- 172.21.15.55:0/452681196 wait complete. 2024-04-02T07:24:22.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b7a5c000 1 -- start start 2024-04-02T07:24:22.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b7a5c000 1 Processor -- start 2024-04-02T07:24:22.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b7a5c000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c214c0 0x562b51c25cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b7a5c000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c6adb0 0x562b51c26210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b7a5c000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c6b6d0 0x562b51c6bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b7a5c000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b51a6f9b0 con 0x562b51c214c0 2024-04-02T07:24:22.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b7a5c000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b51a0ec00 con 0x562b51c6b6d0 2024-04-02T07:24:22.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b7a5c000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b51a2d070 con 0x562b51c6adb0 2024-04-02T07:24:22.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b7a5c000 10 client.0 _ll_register_callbacks cb 0x562b51c0d0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:24:22.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b2600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c6b6d0 0x562b51c6bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b1200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c6adb0 0x562b51c26210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b1200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c6adb0 0x562b51c26210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:60136/0 (socket says 172.21.15.55:60136) 2024-04-02T07:24:22.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b2600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c6b6d0 0x562b51c6bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:48242/0 (socket says 172.21.15.55:48242) 2024-04-02T07:24:22.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b1200640 1 -- 172.21.15.55:0/428654208 learned_addr learned my addr 172.21.15.55:0/428654208 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:22.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b1c00640 1 --2- 172.21.15.55:0/428654208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c214c0 0x562b51c25cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b2600640 1 -- 172.21.15.55:0/428654208 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c6adb0 msgr2=0x562b51c26210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:22.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b2600640 1 --2- 172.21.15.55:0/428654208 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c6adb0 0x562b51c26210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b2600640 1 -- 172.21.15.55:0/428654208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c214c0 msgr2=0x562b51c25cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:22.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b2600640 1 --2- 172.21.15.55:0/428654208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c214c0 0x562b51c25cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b2600640 1 -- 172.21.15.55:0/428654208 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ac06c6e0 con 0x562b51c6b6d0 2024-04-02T07:24:22.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b1200640 1 --2- 172.21.15.55:0/428654208 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c6adb0 0x562b51c26210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:24:22.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b1c00640 1 --2- 172.21.15.55:0/428654208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c214c0 0x562b51c25cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:24:22.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b2600640 1 --2- 172.21.15.55:0/428654208 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c6b6d0 0x562b51c6bab0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f61a40823d0 tx=0x7f61a40548e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75db678457667af0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:22.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f6192a00640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-04-02T07:24:22.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f6192a00640 1 -- 172.21.15.55:0/428654208 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a405d2c0 con 0x562b51c6b6d0 2024-04-02T07:24:22.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b7a5c000 1 -- 172.21.15.55:0/428654208 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b51a2c5f0 con 0x562b51c6b6d0 2024-04-02T07:24:22.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f6192a00640 1 -- 172.21.15.55:0/428654208 <== mon.1 v2:172.21.15.106:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61a405ce30 con 0x562b51c6b6d0 2024-04-02T07:24:22.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f6192a00640 1 -- 172.21.15.55:0/428654208 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f61a405cff0 con 0x562b51c6b6d0 2024-04-02T07:24:22.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b7a5c000 10 client.5689 fetch_fsmap learned FSMap version 25 2024-04-02T07:24:22.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b7a5c000 1 -- 172.21.15.55:0/428654208 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x562b51a34ab0 con 0x562b51c6b6d0 2024-04-02T07:24:22.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f6192a00640 1 -- 172.21.15.55:0/428654208 <== mon.1 v2:172.21.15.106:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562b51a2c5f0 con 0x562b51c6b6d0 2024-04-02T07:24:22.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f6192a00640 1 -- 172.21.15.55:0/428654208 <== mon.1 v2:172.21.15.106:3300/0 5 ==== fsmap(e 25) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f61a4019020 con 0x562b51c6b6d0 2024-04-02T07:24:22.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b7a5c000 10 client.5689 fetch_fsmap finished waiting for FSMap version 25 2024-04-02T07:24:22.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b7a5c000 10 client.5689 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-02T07:24:22.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b7a5c000 20 client.5689 populate_metadata read hostname 'smithi055' 2024-04-02T07:24:22.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b7a5c000 1 --2- 172.21.15.55:0/428654208 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x562b51c6c4c0 0x562b51c7be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b7a5c000 4 client.5689 mds_command: new command op to 5655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:24:22.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b7a5c000 1 -- 172.21.15.55:0/428654208 --> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b51a6c790 con 0x562b51c6c4c0 2024-04-02T07:24:22.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.362+0000 7f61b1c00640 1 --2- 172.21.15.55:0/428654208 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x562b51c6c4c0 0x562b51c7be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.366+0000 7f61b1c00640 1 --2- 172.21.15.55:0/428654208 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x562b51c6c4c0 0x562b51c7be50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=82555f475c7130c1 server_cookie=5b8ef2489d4ec89e in_seq=0 out_seq=0 2024-04-02T07:24:22.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.366+0000 7f6192a00640 10 client.5689 ms_handle_connect on v2:172.21.15.106:6834/1720558250 2024-04-02T07:24:22.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.366+0000 7f6192a00640 1 -- 172.21.15.55:0/428654208 <== mds.0 v2:172.21.15.106:6834/1720558250 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x562b51a6c790 con 0x562b51c6c4c0 2024-04-02T07:24:22.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.366+0000 7f6192a00640 10 client.5689 handle_command_reply: tid=0 2024-04-02T07:24:22.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.366+0000 7f61b7a5c000 1 client.5689 shutdown 2024-04-02T07:24:22.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.366+0000 7f61b7a5c000 1 -- 172.21.15.55:0/428654208 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c6b6d0 msgr2=0x562b51c6bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:22.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.366+0000 7f61b7a5c000 1 --2- 172.21.15.55:0/428654208 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c6b6d0 0x562b51c6bab0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f61a40823d0 tx=0x7f61a40548e0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.366+0000 7f61b7a5c000 1 -- 172.21.15.55:0/428654208 shutdown_connections 2024-04-02T07:24:22.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.366+0000 7f61b7a5c000 1 --2- 172.21.15.55:0/428654208 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c6b6d0 0x562b51c6bab0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.366+0000 7f61b7a5c000 1 --2- 172.21.15.55:0/428654208 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x562b51c6c4c0 0x562b51c7be50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.366+0000 7f61b7a5c000 1 --2- 172.21.15.55:0/428654208 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c6adb0 0x562b51c26210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.366+0000 7f61b7a5c000 1 --2- 172.21.15.55:0/428654208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c214c0 0x562b51c25cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.366+0000 7f6192a00640 0 client.5689 ms_handle_reset on v2:172.21.15.106:6834/1720558250 2024-04-02T07:24:22.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.366+0000 7f61b7a5c000 1 -- 172.21.15.55:0/428654208 >> 172.21.15.55:0/428654208 conn(0x562b51c27830 msgr2=0x562b51c1ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:22.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.366+0000 7f61b7a5c000 1 -- 172.21.15.55:0/428654208 shutdown_connections 2024-04-02T07:24:22.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.366+0000 7f61b7a5c000 1 -- 172.21.15.55:0/428654208 wait complete. 2024-04-02T07:24:22.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.366+0000 7f61b7a5c000 20 client.5689 trim_cache size 0 max 16384 2024-04-02T07:24:22.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b7a5c000 1 Processor -- start 2024-04-02T07:24:22.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b7a5c000 1 -- start start 2024-04-02T07:24:22.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b7a5c000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c214c0 0x562b51c697a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b7a5c000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c6adb0 0x562b51c69ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b7a5c000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6b6d0 0x562b51c79e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b7a5c000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b5172c940 con 0x562b51c6b6d0 2024-04-02T07:24:22.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b7a5c000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b51a739b0 con 0x562b51c6adb0 2024-04-02T07:24:22.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b7a5c000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b51a6cdb0 con 0x562b51c214c0 2024-04-02T07:24:22.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b2600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6b6d0 0x562b51c79e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b2600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6b6d0 0x562b51c79e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33618/0 (socket says 172.21.15.55:33618) 2024-04-02T07:24:22.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b2600640 1 -- 172.21.15.55:0/264629268 learned_addr learned my addr 172.21.15.55:0/264629268 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:22.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b1c00640 1 --2- 172.21.15.55:0/264629268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c214c0 0x562b51c697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b1200640 1 --2- 172.21.15.55:0/264629268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c6adb0 0x562b51c69ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b2600640 1 -- 172.21.15.55:0/264629268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c214c0 msgr2=0x562b51c697a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:22.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b2600640 1 --2- 172.21.15.55:0/264629268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c214c0 0x562b51c697a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b2600640 1 -- 172.21.15.55:0/264629268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c6adb0 msgr2=0x562b51c69ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:22.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b2600640 1 --2- 172.21.15.55:0/264629268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c6adb0 0x562b51c69ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b2600640 1 -- 172.21.15.55:0/264629268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b51a1ac00 con 0x562b51c6b6d0 2024-04-02T07:24:22.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b1200640 1 --2- 172.21.15.55:0/264629268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c6adb0 0x562b51c69ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:24:22.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b2600640 1 --2- 172.21.15.55:0/264629268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6b6d0 0x562b51c79e40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f61a405b010 tx=0x7f61a4057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac19c4366edd58fa server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:22.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f619ea00640 1 -- 172.21.15.55:0/264629268 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a405d2c0 con 0x562b51c6b6d0 2024-04-02T07:24:22.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f619ea00640 1 -- 172.21.15.55:0/264629268 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a4054f80 con 0x562b51c6b6d0 2024-04-02T07:24:22.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f619ea00640 1 -- 172.21.15.55:0/264629268 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a406cae0 con 0x562b51c6b6d0 2024-04-02T07:24:22.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b7a5c000 1 -- 172.21.15.55:0/264629268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6b6d0 msgr2=0x562b51c79e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:22.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b7a5c000 1 --2- 172.21.15.55:0/264629268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6b6d0 0x562b51c79e40 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f61a405b010 tx=0x7f61a4057000 comp rx=0 tx=0).stop 2024-04-02T07:24:22.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b7a5c000 1 -- 172.21.15.55:0/264629268 shutdown_connections 2024-04-02T07:24:22.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b7a5c000 1 --2- 172.21.15.55:0/264629268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6b6d0 0x562b51c79e40 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b7a5c000 1 --2- 172.21.15.55:0/264629268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c6adb0 0x562b51c69ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b7a5c000 1 --2- 172.21.15.55:0/264629268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c214c0 0x562b51c697a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b7a5c000 1 -- 172.21.15.55:0/264629268 >> 172.21.15.55:0/264629268 conn(0x562b51c27830 msgr2=0x562b51c7ffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:22.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b7a5c000 1 -- 172.21.15.55:0/264629268 shutdown_connections 2024-04-02T07:24:22.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.382+0000 7f61b7a5c000 1 -- 172.21.15.55:0/264629268 wait complete. 2024-04-02T07:24:22.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b7a5c000 1 -- start start 2024-04-02T07:24:22.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b7a5c000 1 Processor -- start 2024-04-02T07:24:22.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b7a5c000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c214c0 0x562b51c7d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b7a5c000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6adb0 0x562b51cc9390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b7a5c000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c6b6d0 0x562b51cc98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b7a5c000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b51a0cc10 con 0x562b51c6adb0 2024-04-02T07:24:22.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b7a5c000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b51a36c60 con 0x562b51c214c0 2024-04-02T07:24:22.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b7a5c000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x562b51c26f30 con 0x562b51c6b6d0 2024-04-02T07:24:22.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b7a5c000 10 client.0 _ll_register_callbacks cb 0x562b51a34590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:24:22.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b1200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6adb0 0x562b51cc9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b1200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6adb0 0x562b51cc9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33620/0 (socket says 172.21.15.55:33620) 2024-04-02T07:24:22.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b1200640 1 -- 172.21.15.55:0/3765231566 learned_addr learned my addr 172.21.15.55:0/3765231566 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:22.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b1c00640 1 --2- 172.21.15.55:0/3765231566 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c214c0 0x562b51c7d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b2600640 1 --2- 172.21.15.55:0/3765231566 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c6b6d0 0x562b51cc98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b1200640 1 -- 172.21.15.55:0/3765231566 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c6b6d0 msgr2=0x562b51cc98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:22.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b1200640 1 --2- 172.21.15.55:0/3765231566 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c6b6d0 0x562b51cc98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b1200640 1 -- 172.21.15.55:0/3765231566 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c214c0 msgr2=0x562b51c7d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:22.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b1200640 1 --2- 172.21.15.55:0/3765231566 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c214c0 0x562b51c7d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b1200640 1 -- 172.21.15.55:0/3765231566 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b51a34ab0 con 0x562b51c6adb0 2024-04-02T07:24:22.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b1200640 1 --2- 172.21.15.55:0/3765231566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6adb0 0x562b51cc9390 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6198001690 tx=0x7f6198001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e1761cc29cf51ba server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:22.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f6192a00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:24:22.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f6192a00640 1 -- 172.21.15.55:0/3765231566 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6198016b30 con 0x562b51c6adb0 2024-04-02T07:24:22.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f6192a00640 1 -- 172.21.15.55:0/3765231566 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6198016c90 con 0x562b51c6adb0 2024-04-02T07:24:22.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b7a5c000 1 -- 172.21.15.55:0/3765231566 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b51a389c0 con 0x562b51c6adb0 2024-04-02T07:24:22.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f6192a00640 1 -- 172.21.15.55:0/3765231566 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6198016e50 con 0x562b51c6adb0 2024-04-02T07:24:22.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b7a5c000 10 client.5820 fetch_fsmap learned FSMap version 25 2024-04-02T07:24:22.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b7a5c000 1 -- 172.21.15.55:0/3765231566 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x562b5176bcc0 con 0x562b51c6adb0 2024-04-02T07:24:22.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f6192a00640 1 -- 172.21.15.55:0/3765231566 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562b51a389c0 con 0x562b51c6adb0 2024-04-02T07:24:22.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f6192a00640 1 -- 172.21.15.55:0/3765231566 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 25) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f6198012070 con 0x562b51c6adb0 2024-04-02T07:24:22.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b7a5c000 10 client.5820 fetch_fsmap finished waiting for FSMap version 25 2024-04-02T07:24:22.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b7a5c000 10 client.5820 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-02T07:24:22.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b7a5c000 20 client.5820 populate_metadata read hostname 'smithi055' 2024-04-02T07:24:22.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b7a5c000 1 --2- 172.21.15.55:0/3765231566 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x562b51cc5e60 0x562b51cc6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b7a5c000 4 client.5820 mds_command: new command op to 5655 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-02T07:24:22.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b7a5c000 1 -- 172.21.15.55:0/3765231566 --> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562b51a68470 con 0x562b51cc5e60 2024-04-02T07:24:22.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.386+0000 7f61b1c00640 1 --2- 172.21.15.55:0/3765231566 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x562b51cc5e60 0x562b51cc6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b1c00640 1 --2- 172.21.15.55:0/3765231566 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x562b51cc5e60 0x562b51cc6240 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4208ad1d8719af1 server_cookie=bfc15d47e0a3a0b2 in_seq=0 out_seq=0 2024-04-02T07:24:22.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f6192a00640 10 client.5820 ms_handle_connect on v2:172.21.15.106:6834/1720558250 2024-04-02T07:24:22.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f6192a00640 1 -- 172.21.15.55:0/3765231566 <== mds.0 v2:172.21.15.106:6834/1720558250 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x562b51a68470 con 0x562b51cc5e60 2024-04-02T07:24:22.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f6192a00640 10 client.5820 handle_command_reply: tid=0 2024-04-02T07:24:22.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b7a5c000 1 client.5820 shutdown 2024-04-02T07:24:22.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b7a5c000 1 -- 172.21.15.55:0/3765231566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6adb0 msgr2=0x562b51cc9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:22.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b7a5c000 1 --2- 172.21.15.55:0/3765231566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6adb0 0x562b51cc9390 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f6198001690 tx=0x7f6198001b50 comp rx=0 tx=0).stop 2024-04-02T07:24:22.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b7a5c000 1 -- 172.21.15.55:0/3765231566 shutdown_connections 2024-04-02T07:24:22.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b7a5c000 1 --2- 172.21.15.55:0/3765231566 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x562b51cc5e60 0x562b51cc6240 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b7a5c000 1 --2- 172.21.15.55:0/3765231566 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x562b51c6b6d0 0x562b51cc98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b7a5c000 1 --2- 172.21.15.55:0/3765231566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x562b51c6adb0 0x562b51cc9390 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b7a5c000 1 --2- 172.21.15.55:0/3765231566 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x562b51c214c0 0x562b51c7d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f6192a00640 0 client.5820 ms_handle_reset on v2:172.21.15.106:6834/1720558250 2024-04-02T07:24:22.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b7a5c000 1 -- 172.21.15.55:0/3765231566 >> 172.21.15.55:0/3765231566 conn(0x562b51c27830 msgr2=0x562b51c68790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:22.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b7a5c000 1 -- 172.21.15.55:0/3765231566 shutdown_connections 2024-04-02T07:24:22.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b7a5c000 1 -- 172.21.15.55:0/3765231566 wait complete. 2024-04-02T07:24:22.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b7a5c000 20 client.5820 trim_cache size 0 max 16384 2024-04-02T07:24:22.397 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:24:22.398 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "642a0456-a2ac-49a4-91a5-3b3449b512da", 2024-04-02T07:24:22.398 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-02T07:24:22.398 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 5655, 2024-04-02T07:24:22.398 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-02T07:24:22.398 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-02T07:24:22.398 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-02T07:24:22.398 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.460599075999999, 2024-04-02T07:24:22.398 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 25, 2024-04-02T07:24:22.398 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 46, 2024-04-02T07:24:22.398 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 46, 2024-04-02T07:24:22.398 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 14.800492466 2024-04-02T07:24:22.398 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:24:22.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b4600640 1 -- 172.21.15.55:0/3809173555 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f618c066690 msgr2=0x7f618c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:22.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b4600640 1 --2- 172.21.15.55:0/3809173555 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f618c066690 0x7f618c068b50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f61a00ad000 tx=0x7f61a00a6000 comp rx=0 tx=0).stop 2024-04-02T07:24:22.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b4600640 1 -- 172.21.15.55:0/3809173555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61ac1599c0 msgr2=0x7f61ac0c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:22.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b4600640 1 --2- 172.21.15.55:0/3809173555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61ac1599c0 0x7f61ac0c8040 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f61a400c7a0 tx=0x7f61a400cc60 comp rx=0 tx=0).stop 2024-04-02T07:24:22.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b4600640 1 -- 172.21.15.55:0/3809173555 shutdown_connections 2024-04-02T07:24:22.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b4600640 1 --2- 172.21.15.55:0/3809173555 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61ac1599c0 0x7f61ac0c8040 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b4600640 1 --2- 172.21.15.55:0/3809173555 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f61ac0b38f0 0x7f61ac0c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b4600640 1 --2- 172.21.15.55:0/3809173555 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f618c066690 0x7f618c068b50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b4600640 1 --2- 172.21.15.55:0/3809173555 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f61ac06d1c0 0x7f61ac14b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b4600640 1 -- 172.21.15.55:0/3809173555 >> 172.21.15.55:0/3809173555 conn(0x7f61ac069d90 msgr2=0x7f61ac164c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:22.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b4600640 1 -- 172.21.15.55:0/3809173555 shutdown_connections 2024-04-02T07:24:22.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.390+0000 7f61b4600640 1 -- 172.21.15.55:0/3809173555 wait complete. 2024-04-02T07:24:22.412 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-02T07:24:22.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.550+0000 7ff481c00640 1 Processor -- start 2024-04-02T07:24:22.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.550+0000 7ff481c00640 1 -- start start 2024-04-02T07:24:22.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.550+0000 7ff481c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff47c15ca70 0x7ff47c0b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.550+0000 7ff481c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff47c098a10 0x7ff47c098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.550+0000 7ff481c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff47c06aff0 0x7ff47c06b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.550+0000 7ff481c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47c0993b0 con 0x7ff47c15ca70 2024-04-02T07:24:22.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.550+0000 7ff481c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff47c15ce50 con 0x7ff47c06aff0 2024-04-02T07:24:22.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.550+0000 7ff481c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c0cef60 con 0x7ff47c098a10 2024-04-02T07:24:22.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.550+0000 7ff47aa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff47c15ca70 0x7ff47c0b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.550+0000 7ff47aa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff47c15ca70 0x7ff47c0b0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33632/0 (socket says 172.21.15.55:33632) 2024-04-02T07:24:22.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.550+0000 7ff47aa00640 1 -- 172.21.15.55:0/2943962767 learned_addr learned my addr 172.21.15.55:0/2943962767 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:22.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.550+0000 7ff47b400640 1 --2- 172.21.15.55:0/2943962767 >> v2:172.21.15.106:3300/0 conn(0x7ff47c06aff0 0x7ff47c06b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.550+0000 7ff473e00640 1 --2- 172.21.15.55:0/2943962767 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff47c098a10 0x7ff47c098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.550+0000 7ff47aa00640 1 -- 172.21.15.55:0/2943962767 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff47c098a10 msgr2=0x7ff47c098e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:22.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.550+0000 7ff47aa00640 1 --2- 172.21.15.55:0/2943962767 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff47c098a10 0x7ff47c098e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.550+0000 7ff47aa00640 1 -- 172.21.15.55:0/2943962767 >> v2:172.21.15.106:3300/0 conn(0x7ff47c06aff0 msgr2=0x7ff47c06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:22.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.550+0000 7ff47aa00640 1 --2- 172.21.15.55:0/2943962767 >> v2:172.21.15.106:3300/0 conn(0x7ff47c06aff0 0x7ff47c06b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.550+0000 7ff47aa00640 1 -- 172.21.15.55:0/2943962767 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff47c06bd60 con 0x7ff47c15ca70 2024-04-02T07:24:22.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.550+0000 7ff473e00640 1 --2- 172.21.15.55:0/2943962767 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff47c098a10 0x7ff47c098e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:22.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.550+0000 7ff47b400640 1 --2- 172.21.15.55:0/2943962767 >> v2:172.21.15.106:3300/0 conn(0x7ff47c06aff0 0x7ff47c06b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:22.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.554+0000 7ff47aa00640 1 --2- 172.21.15.55:0/2943962767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c15ca70 0x7ff47c0b0040 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff47c071dd0 tx=0x7ff46c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0117c8697ca384b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:22.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.554+0000 7ff47a000640 1 -- 172.21.15.55:0/2943962767 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c0aa610 con 0x7ff47c15ca70 2024-04-02T07:24:22.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.554+0000 7ff47a000640 1 -- 172.21.15.55:0/2943962767 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c0a6040 con 0x7ff47c15ca70 2024-04-02T07:24:22.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.554+0000 7ff47a000640 1 -- 172.21.15.55:0/2943962767 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c0aa990 con 0x7ff47c15ca70 2024-04-02T07:24:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.554+0000 7ff481c00640 1 -- 172.21.15.55:0/2943962767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c15ca70 msgr2=0x7ff47c0b0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.554+0000 7ff481c00640 1 --2- 172.21.15.55:0/2943962767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c15ca70 0x7ff47c0b0040 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff47c071dd0 tx=0x7ff46c01c4f0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.554+0000 7ff481c00640 1 -- 172.21.15.55:0/2943962767 shutdown_connections 2024-04-02T07:24:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.554+0000 7ff481c00640 1 --2- 172.21.15.55:0/2943962767 >> v2:172.21.15.106:3300/0 conn(0x7ff47c06aff0 0x7ff47c06b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.554+0000 7ff481c00640 1 --2- 172.21.15.55:0/2943962767 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff47c098a10 0x7ff47c098e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.554+0000 7ff481c00640 1 --2- 172.21.15.55:0/2943962767 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c15ca70 0x7ff47c0b0040 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.554+0000 7ff481c00640 1 -- 172.21.15.55:0/2943962767 >> 172.21.15.55:0/2943962767 conn(0x7ff47c0b21d0 msgr2=0x7ff47c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.554+0000 7ff481c00640 1 -- 172.21.15.55:0/2943962767 shutdown_connections 2024-04-02T07:24:22.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.554+0000 7ff481c00640 1 -- 172.21.15.55:0/2943962767 wait complete. 2024-04-02T07:24:22.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff481c00640 1 Processor -- start 2024-04-02T07:24:22.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff481c00640 1 -- start start 2024-04-02T07:24:22.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff481c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c06aff0 0x7ff47c14af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff481c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff47c098a10 0x7ff47c15f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff481c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff47c15ca70 0x7ff47c149930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff481c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c14b480 con 0x7ff47c06aff0 2024-04-02T07:24:22.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff481c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c1598e0 con 0x7ff47c098a10 2024-04-02T07:24:22.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff481c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff47c14b6b0 con 0x7ff47c15ca70 2024-04-02T07:24:22.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff47aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c06aff0 0x7ff47c14af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff47aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c06aff0 0x7ff47c14af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33646/0 (socket says 172.21.15.55:33646) 2024-04-02T07:24:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff47aa00640 1 -- 172.21.15.55:0/1096810147 learned_addr learned my addr 172.21.15.55:0/1096810147 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff473e00640 1 --2- 172.21.15.55:0/1096810147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff47c098a10 0x7ff47c15f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff47b400640 1 --2- 172.21.15.55:0/1096810147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff47c15ca70 0x7ff47c149930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff47aa00640 1 -- 172.21.15.55:0/1096810147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff47c15ca70 msgr2=0x7ff47c149930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff47aa00640 1 --2- 172.21.15.55:0/1096810147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff47c15ca70 0x7ff47c149930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff47aa00640 1 -- 172.21.15.55:0/1096810147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff47c098a10 msgr2=0x7ff47c15f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff47aa00640 1 --2- 172.21.15.55:0/1096810147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff47c098a10 0x7ff47c15f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff47aa00640 1 -- 172.21.15.55:0/1096810147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff46c0094d0 con 0x7ff47c06aff0 2024-04-02T07:24:22.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff47aa00640 1 --2- 172.21.15.55:0/1096810147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c06aff0 0x7ff47c14af40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff46c01aba0 tx=0x7ff46c01ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff472a00640 1 -- 172.21.15.55:0/1096810147 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c0bd5f0 con 0x7ff47c06aff0 2024-04-02T07:24:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff472a00640 1 -- 172.21.15.55:0/1096810147 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff46c0bd750 con 0x7ff47c06aff0 2024-04-02T07:24:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff472a00640 1 -- 172.21.15.55:0/1096810147 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46c0bdb00 con 0x7ff47c06aff0 2024-04-02T07:24:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff481c00640 1 -- 172.21.15.55:0/1096810147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47c159b30 con 0x7ff47c06aff0 2024-04-02T07:24:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.558+0000 7ff481c00640 1 -- 172.21.15.55:0/1096810147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47c15a0f0 con 0x7ff47c06aff0 2024-04-02T07:24:22.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.562+0000 7ff481c00640 1 -- 172.21.15.55:0/1096810147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff47c066c90 con 0x7ff47c06aff0 2024-04-02T07:24:22.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.562+0000 7ff472a00640 1 -- 172.21.15.55:0/1096810147 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff46c0b33f0 con 0x7ff47c06aff0 2024-04-02T07:24:22.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.562+0000 7ff472a00640 1 --2- 172.21.15.55:0/1096810147 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff458066690 0x7ff458068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:22.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.562+0000 7ff472a00640 1 -- 172.21.15.55:0/1096810147 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff46c11ed70 con 0x7ff47c06aff0 2024-04-02T07:24:22.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.562+0000 7ff473e00640 1 --2- 172.21.15.55:0/1096810147 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff458066690 0x7ff458068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:22.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.562+0000 7ff473e00640 1 --2- 172.21.15.55:0/1096810147 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff458066690 0x7ff458068b50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff47c1562d0 tx=0x7ff464008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:22.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.566+0000 7ff472a00640 1 -- 172.21.15.55:0/1096810147 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff46c0ec220 con 0x7ff47c06aff0 2024-04-02T07:24:22.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.762+0000 7ff481c00640 1 -- 172.21.15.55:0/1096810147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff47c0b6660 con 0x7ff47c06aff0 2024-04-02T07:24:22.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.762+0000 7ff472a00640 1 -- 172.21.15.55:0/1096810147 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff46c0ef840 con 0x7ff47c06aff0 2024-04-02T07:24:22.765 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-02T07:24:22.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.762+0000 7ff481c00640 1 -- 172.21.15.55:0/1096810147 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff458066690 msgr2=0x7ff458068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:22.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.762+0000 7ff481c00640 1 --2- 172.21.15.55:0/1096810147 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff458066690 0x7ff458068b50 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7ff47c1562d0 tx=0x7ff464008040 comp rx=0 tx=0).stop 2024-04-02T07:24:22.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.762+0000 7ff481c00640 1 -- 172.21.15.55:0/1096810147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c06aff0 msgr2=0x7ff47c14af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:22.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.762+0000 7ff481c00640 1 --2- 172.21.15.55:0/1096810147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c06aff0 0x7ff47c14af40 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7ff46c01aba0 tx=0x7ff46c01ad30 comp rx=0 tx=0).stop 2024-04-02T07:24:22.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.762+0000 7ff481c00640 1 -- 172.21.15.55:0/1096810147 shutdown_connections 2024-04-02T07:24:22.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.762+0000 7ff481c00640 1 --2- 172.21.15.55:0/1096810147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff47c15ca70 0x7ff47c149930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.762+0000 7ff481c00640 1 --2- 172.21.15.55:0/1096810147 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff458066690 0x7ff458068b50 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.762+0000 7ff481c00640 1 --2- 172.21.15.55:0/1096810147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff47c098a10 0x7ff47c15f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.762+0000 7ff481c00640 1 --2- 172.21.15.55:0/1096810147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff47c06aff0 0x7ff47c14af40 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:22.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.762+0000 7ff481c00640 1 -- 172.21.15.55:0/1096810147 >> 172.21.15.55:0/1096810147 conn(0x7ff47c0b21d0 msgr2=0x7ff47c0cd160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:22.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.762+0000 7ff481c00640 1 -- 172.21.15.55:0/1096810147 shutdown_connections 2024-04-02T07:24:22.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:22.762+0000 7ff481c00640 1 -- 172.21.15.55:0/1096810147 wait complete. 2024-04-02T07:24:22.786 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-02T07:24:22.786 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-02T07:24:22.787 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-02T07:24:22.787 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-02T07:24:22.787 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-02T07:24:22.787 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-02T07:24:22.787 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-02T07:24:22.787 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-02T07:24:22.787 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:24:22.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:22.787 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-02T07:24:22.797 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:24:22.797 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:24:22.797 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:24:22.797 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:24:22.797 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-02T07:24:22.797 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:24:22.797 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:24:22.797 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:24:22.797 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-02T07:24:22.797 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:24:22.798 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:24:22.798 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-02T07:24:22.798 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-02T07:24:22.798 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:24:22.798 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-02T07:24:22.798 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-02T07:24:22.798 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42332sec preferred_lft 42332sec 2024-04-02T07:24:22.798 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2024-04-02T07:24:22.798 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:24:22.798 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:24:22.798 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:24:22.798 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-02T07:24:22.798 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-02T07:24:22.798 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:81:5a:89:17 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:24:22.799 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-02T07:24:22.799 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:24:22.799 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:24:22.799 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-02T07:24:22.799 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-02T07:24:22.799 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:24:22.799 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-02T07:24:22.799 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:24:22.799 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:24:22.799 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-02T07:24:22.799 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-02T07:24:22.799 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:24:22.799 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:24:22.799 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-02T07:24:22.799 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-02T07:24:22.800 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:24:22.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:22.800 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-02T07:24:22.861 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:24:22.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:22.863 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-02T07:24:22.917 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-02T07:24:22.917 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-02T07:24:22.917 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-02T07:24:22.917 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-02T07:24:22.917 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-02T07:24:22.917 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-02T07:24:22.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:22.917 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:24:22.917 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:24:22.918 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-02T07:24:22.918 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-02T07:24:22.918 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-02T07:24:22.918 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:24:23.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:23.012 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-02T07:24:23.021 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-02T07:24:23.021 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-02T07:24:23.022 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:24:23.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:23.022 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-02T07:24:23.084 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-02T07:24:23.084 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:24:23.084 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-02T07:24:23.135 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:24:23.135 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:24:23.135 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:24:23.187 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:24:23.247 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:24:23.248 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:24:23.309 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:24:23.310 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:24:23.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:23.311 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:24:23.359 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-02T07:24:23.360 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-02T07:24:23.406 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:24:23.427 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:24:23.427 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:24:23.491 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:24:23.493 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:24:23.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:23.493 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:24:23.502 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:2024-04-02T07:24:23.498+0000 7f3ed89fc580 -1 init, newargv = 0x5641ce2f5d40 newargc=15 2024-04-02T07:24:23.502 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[39424]: starting ceph client 2024-04-02T07:24:23.511 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[39424]: starting fuse 2024-04-02T07:24:23.512 INFO:teuthology.orchestra.run.smithi055.stdout:43 2024-04-02T07:24:23.513 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-02T07:24:23.513 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:24:23.513 DEBUG:teuthology.orchestra.run.smithi055:> import glob 2024-04-02T07:24:23.513 DEBUG:teuthology.orchestra.run.smithi055:> import re 2024-04-02T07:24:23.513 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:24:23.513 DEBUG:teuthology.orchestra.run.smithi055:> import subprocess 2024-04-02T07:24:23.513 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:24:23.513 DEBUG:teuthology.orchestra.run.smithi055:> def _find_admin_socket(client_name): 2024-04-02T07:24:23.513 DEBUG:teuthology.orchestra.run.smithi055:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-02T07:24:23.514 DEBUG:teuthology.orchestra.run.smithi055:> files = glob.glob(asok_path) 2024-04-02T07:24:23.514 DEBUG:teuthology.orchestra.run.smithi055:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-02T07:24:23.514 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:24:23.514 DEBUG:teuthology.orchestra.run.smithi055:> # Given a non-glob path, it better be there 2024-04-02T07:24:23.514 DEBUG:teuthology.orchestra.run.smithi055:> if "*" not in asok_path: 2024-04-02T07:24:23.514 DEBUG:teuthology.orchestra.run.smithi055:> assert(len(files) == 1) 2024-04-02T07:24:23.514 DEBUG:teuthology.orchestra.run.smithi055:> return files[0] 2024-04-02T07:24:23.514 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:24:23.514 DEBUG:teuthology.orchestra.run.smithi055:> for f in files: 2024-04-02T07:24:23.514 DEBUG:teuthology.orchestra.run.smithi055:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-02T07:24:23.514 DEBUG:teuthology.orchestra.run.smithi055:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-02T07:24:23.514 DEBUG:teuthology.orchestra.run.smithi055:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-02T07:24:23.514 DEBUG:teuthology.orchestra.run.smithi055:> contents = proc_f.read() 2024-04-02T07:24:23.515 DEBUG:teuthology.orchestra.run.smithi055:> if mountpoint in contents: 2024-04-02T07:24:23.515 DEBUG:teuthology.orchestra.run.smithi055:> return f 2024-04-02T07:24:23.515 DEBUG:teuthology.orchestra.run.smithi055:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-02T07:24:23.515 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:24:23.515 DEBUG:teuthology.orchestra.run.smithi055:> print(_find_admin_socket("client.0")) 2024-04-02T07:24:23.515 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:24:23.639 INFO:teuthology.orchestra.run.smithi055.stdout:/var/run/ceph/ceph-client.0.39424.asok 2024-04-02T07:24:23.824 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39424.asok 2024-04-02T07:24:23.824 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:23.824 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39424.asok status 2024-04-02T07:24:24.007 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:24:24.007 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": { 2024-04-02T07:24:24.007 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_sha1": "d0e392d9aee635f2b65768c460c7a151ead7a5e2", 2024-04-02T07:24:24.007 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)", 2024-04-02T07:24:24.008 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "0", 2024-04-02T07:24:24.008 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2024-04-02T07:24:24.008 INFO:teuthology.orchestra.run.smithi055.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-02T07:24:24.008 INFO:teuthology.orchestra.run.smithi055.stdout: "pid": "39424", 2024-04-02T07:24:24.008 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2024-04-02T07:24:24.008 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:24.008 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_count": 0, 2024-04-02T07:24:24.008 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_pinned_count": 0, 2024-04-02T07:24:24.008 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 5835, 2024-04-02T07:24:24.008 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": { 2024-04-02T07:24:24.009 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2024-04-02T07:24:24.009 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2024-04-02T07:24:24.009 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 5835 2024-04-02T07:24:24.009 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:24.009 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:24:24.009 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:24:24.009 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:24:24.009 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 325003438 2024-04-02T07:24:24.009 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:24.009 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:24.009 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:24:24.009 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:24:24.009 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:24:24.009 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 325003438 2024-04-02T07:24:24.009 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:24.010 INFO:teuthology.orchestra.run.smithi055.stdout: "inst_str": "client.5835 192.168.0.1:0/325003438", 2024-04-02T07:24:24.010 INFO:teuthology.orchestra.run.smithi055.stdout: "addr_str": "192.168.0.1:0/325003438", 2024-04-02T07:24:24.010 INFO:teuthology.orchestra.run.smithi055.stdout: "inode_count": 1, 2024-04-02T07:24:24.010 INFO:teuthology.orchestra.run.smithi055.stdout: "mds_epoch": 25, 2024-04-02T07:24:24.010 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch": 46, 2024-04-02T07:24:24.010 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch_barrier": 0, 2024-04-02T07:24:24.010 INFO:teuthology.orchestra.run.smithi055.stdout: "blocklisted": false, 2024-04-02T07:24:24.010 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs" 2024-04-02T07:24:24.010 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:24:24.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:24.023 DEBUG:teuthology.orchestra.run.smithi055:> stat --file-system '--printf=%T 2024-04-02T07:24:24.023 DEBUG:teuthology.orchestra.run.smithi055:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-02T07:24:24.031 INFO:teuthology.orchestra.run.smithi055.stdout:fuseblk 2024-04-02T07:24:24.032 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-02T07:24:24.032 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:24.032 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:24:24.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:24.097 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent_a) 2024-04-02T07:24:24.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:24.156 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch parent_a/alpha) 2024-04-02T07:24:24.211 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:24:24.211 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:24:24.212 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:24:24.212 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:24:24.212 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/parent_a/alpha").st_ino) 2024-04-02T07:24:24.212 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:24:24.319 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627777 2024-04-02T07:24:24.508 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:24:24.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.694+0000 7ff6dee00640 1 Processor -- start 2024-04-02T07:24:24.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.694+0000 7ff6dee00640 1 -- start start 2024-04-02T07:24:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.694+0000 7ff6dee00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6d815ee70 0x7ff6d8099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.694+0000 7ff6dee00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6d815f250 0x7ff6d80b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.694+0000 7ff6dee00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d80cf6a0 con 0x7ff6d8098a10 2024-04-02T07:24:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.694+0000 7ff6dee00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d80b0840 con 0x7ff6d815f250 2024-04-02T07:24:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.694+0000 7ff6dee00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d80ad270 con 0x7ff6d815ee70 2024-04-02T07:24:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.694+0000 7ff6cf400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6d815f250 0x7ff6d80b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.694+0000 7ff6cf400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff6d815f250 0x7ff6d80b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33648/0 (socket says 172.21.15.55:33648) 2024-04-02T07:24:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.694+0000 7ff6cf400640 1 -- 172.21.15.55:0/4206334147 learned_addr learned my addr 172.21.15.55:0/4206334147 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.694+0000 7ff6d7e00640 1 --2- 172.21.15.55:0/4206334147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6d815ee70 0x7ff6d8099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.694+0000 7ff6cf400640 1 -- 172.21.15.55:0/4206334147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6d815ee70 msgr2=0x7ff6d8099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.694+0000 7ff6cf400640 1 --2- 172.21.15.55:0/4206334147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6d815ee70 0x7ff6d8099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:24.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.694+0000 7ff6cf400640 1 -- 172.21.15.55:0/4206334147 >> v1:172.21.15.106:6789/0 conn(0x7ff6d8098a10 legacy=0x7ff6d80cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.694+0000 7ff6cf400640 1 -- 172.21.15.55:0/4206334147 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d80b0a50 con 0x7ff6d815f250 2024-04-02T07:24:24.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.694+0000 7ff6d7e00640 1 --2- 172.21.15.55:0/4206334147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6d815ee70 0x7ff6d8099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:24.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.698+0000 7ff6cf400640 1 --2- 172.21.15.55:0/4206334147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6d815f250 0x7ff6d80b12f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0009870 tx=0x7ff6c001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df124f30d9d46c78 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:24.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.698+0000 7ff6d7400640 1 -- 172.21.15.55:0/4206334147 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c00a9620 con 0x7ff6d815f250 2024-04-02T07:24:24.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.698+0000 7ff6d7400640 1 -- 172.21.15.55:0/4206334147 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c00a9780 con 0x7ff6d815f250 2024-04-02T07:24:24.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.698+0000 7ff6d7400640 1 -- 172.21.15.55:0/4206334147 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c00a9b10 con 0x7ff6d815f250 2024-04-02T07:24:24.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.698+0000 7ff6dee00640 1 -- 172.21.15.55:0/4206334147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6d815f250 msgr2=0x7ff6d80b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:24.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.698+0000 7ff6dee00640 1 --2- 172.21.15.55:0/4206334147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6d815f250 0x7ff6d80b12f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7ff6c0009870 tx=0x7ff6c001c560 comp rx=0 tx=0).stop 2024-04-02T07:24:24.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.698+0000 7ff6dee00640 1 -- 172.21.15.55:0/4206334147 shutdown_connections 2024-04-02T07:24:24.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.698+0000 7ff6dee00640 1 --2- 172.21.15.55:0/4206334147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6d815f250 0x7ff6d80b12f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:24.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.698+0000 7ff6dee00640 1 --2- 172.21.15.55:0/4206334147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6d815ee70 0x7ff6d8099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:24.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.698+0000 7ff6dee00640 1 -- 172.21.15.55:0/4206334147 >> 172.21.15.55:0/4206334147 conn(0x7ff6d80b21d0 msgr2=0x7ff6d80b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:24.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.698+0000 7ff6dee00640 1 -- 172.21.15.55:0/4206334147 shutdown_connections 2024-04-02T07:24:24.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.698+0000 7ff6dee00640 1 -- 172.21.15.55:0/4206334147 wait complete. 2024-04-02T07:24:24.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6dee00640 1 Processor -- start 2024-04-02T07:24:24.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6dee00640 1 -- start start 2024-04-02T07:24:24.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6dee00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6d8098a10 0x7ff6d8154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:24.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6dee00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6d815ee70 0x7ff6d806af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:24.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6dee00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6d815f250 0x7ff6d806b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6dee00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d80c44d0 con 0x7ff6d815ee70 2024-04-02T07:24:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6dee00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d806b990 con 0x7ff6d815f250 2024-04-02T07:24:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6dee00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d806bc40 con 0x7ff6d8098a10 2024-04-02T07:24:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6cf400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6d815ee70 0x7ff6d806af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6d7e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6d8098a10 0x7ff6d8154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6cf400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6d815ee70 0x7ff6d806af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33658/0 (socket says 172.21.15.55:33658) 2024-04-02T07:24:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6cf400640 1 -- 172.21.15.55:0/771081236 learned_addr learned my addr 172.21.15.55:0/771081236 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6dce00640 1 --2- 172.21.15.55:0/771081236 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6d815f250 0x7ff6d806b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6cf400640 1 -- 172.21.15.55:0/771081236 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6d8098a10 msgr2=0x7ff6d8154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6cf400640 1 --2- 172.21.15.55:0/771081236 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6d8098a10 0x7ff6d8154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6cf400640 1 -- 172.21.15.55:0/771081236 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6d815f250 msgr2=0x7ff6d806b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6cf400640 1 --2- 172.21.15.55:0/771081236 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6d815f250 0x7ff6d806b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:24.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6cf400640 1 -- 172.21.15.55:0/771081236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c00094d0 con 0x7ff6d815ee70 2024-04-02T07:24:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6cf400640 1 --2- 172.21.15.55:0/771081236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6d815ee70 0x7ff6d806af10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff6c00ab040 tx=0x7ff6c001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6d4c00640 1 -- 172.21.15.55:0/771081236 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c00bc450 con 0x7ff6d815ee70 2024-04-02T07:24:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6d4c00640 1 -- 172.21.15.55:0/771081236 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c00bc5b0 con 0x7ff6d815ee70 2024-04-02T07:24:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6d4c00640 1 -- 172.21.15.55:0/771081236 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c00bc960 con 0x7ff6d815ee70 2024-04-02T07:24:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6dee00640 1 -- 172.21.15.55:0/771081236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d80993b0 con 0x7ff6d815ee70 2024-04-02T07:24:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6dee00640 1 -- 172.21.15.55:0/771081236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d806c200 con 0x7ff6d815ee70 2024-04-02T07:24:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.702+0000 7ff6dee00640 1 -- 172.21.15.55:0/771081236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d8066c90 con 0x7ff6d815ee70 2024-04-02T07:24:24.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.706+0000 7ff6d4c00640 1 -- 172.21.15.55:0/771081236 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff6c00bcac0 con 0x7ff6d815ee70 2024-04-02T07:24:24.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.706+0000 7ff6d4c00640 1 --2- 172.21.15.55:0/771081236 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff6b4066690 0x7ff6b4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:24.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.706+0000 7ff6d4c00640 1 -- 172.21.15.55:0/771081236 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6c011e660 con 0x7ff6d815ee70 2024-04-02T07:24:24.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.706+0000 7ff6d7e00640 1 --2- 172.21.15.55:0/771081236 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff6b4066690 0x7ff6b4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:24.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.706+0000 7ff6d7e00640 1 --2- 172.21.15.55:0/771081236 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff6b4066690 0x7ff6b4068b50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8003b90 tx=0x7ff6c8009910 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:24.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.710+0000 7ff6d4c00640 1 -- 172.21.15.55:0/771081236 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff6c00ebaf0 con 0x7ff6d815ee70 2024-04-02T07:24:24.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.902+0000 7ff6dee00640 1 -- 172.21.15.55:0/771081236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6d80cc3e0 con 0x7ff6d815ee70 2024-04-02T07:24:24.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.906+0000 7ff6d4c00640 1 -- 172.21.15.55:0/771081236 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4740 (secure 0 0 0) 0x7ff6c00ef110 con 0x7ff6d815ee70 2024-04-02T07:24:24.908 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:24.908 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2224746522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2224746522},{"type":"v1","addr":"172.21.15.106:6837","nonce":2224746522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/2077739908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2077739908},{"type":"v1","addr":"172.21.15.55:6833","nonce":2077739908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/4108584287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4108584287},{"type":"v1","addr":"172.21.15.55:6835","nonce":4108584287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:24:11.929212+0000","modified":"2024-04-02T07:24:14.958225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5655":{"gid":5655,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6836/1720558250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1720558250},{"type":"v1","addr":"172.21.15.106:6836","nonce":1720558250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-02T07:24:24.908 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 25 2024-04-02T07:24:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.906+0000 7ff6dee00640 1 -- 172.21.15.55:0/771081236 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff6b4066690 msgr2=0x7ff6b4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.906+0000 7ff6dee00640 1 --2- 172.21.15.55:0/771081236 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff6b4066690 0x7ff6b4068b50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8003b90 tx=0x7ff6c8009910 comp rx=0 tx=0).stop 2024-04-02T07:24:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.906+0000 7ff6dee00640 1 -- 172.21.15.55:0/771081236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6d815ee70 msgr2=0x7ff6d806af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.906+0000 7ff6dee00640 1 --2- 172.21.15.55:0/771081236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6d815ee70 0x7ff6d806af10 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff6c00ab040 tx=0x7ff6c001ada0 comp rx=0 tx=0).stop 2024-04-02T07:24:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.906+0000 7ff6dee00640 1 -- 172.21.15.55:0/771081236 shutdown_connections 2024-04-02T07:24:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.906+0000 7ff6dee00640 1 --2- 172.21.15.55:0/771081236 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff6b4066690 0x7ff6b4068b50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.906+0000 7ff6dee00640 1 --2- 172.21.15.55:0/771081236 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6d815f250 0x7ff6d806b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:24.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.906+0000 7ff6dee00640 1 --2- 172.21.15.55:0/771081236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6d815ee70 0x7ff6d806af10 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:24.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.906+0000 7ff6dee00640 1 --2- 172.21.15.55:0/771081236 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6d8098a10 0x7ff6d8154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:24.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.906+0000 7ff6dee00640 1 -- 172.21.15.55:0/771081236 >> 172.21.15.55:0/771081236 conn(0x7ff6d80b21d0 msgr2=0x7ff6d815dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:24.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.906+0000 7ff6dee00640 1 -- 172.21.15.55:0/771081236 shutdown_connections 2024-04-02T07:24:24.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:24.906+0000 7ff6dee00640 1 -- 172.21.15.55:0/771081236 wait complete. 2024-04-02T07:24:24.929 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-04-02T07:24:25.104 INFO:teuthology.orchestra.run.smithi106.stdout:{"message":"","return_code":0} 2024-04-02T07:24:25.104 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-02T07:24:25.104 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-02T07:24:25.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.146+0000 7fdc8fc72080 1 Processor -- start 2024-04-02T07:24:25.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.146+0000 7fdc8fc72080 1 -- start start 2024-04-02T07:24:25.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc8fc72080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558478a9e500 0x558478b77760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc8fc72080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558478b758d0 0x558478b55a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc8fc72080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558478b761f0 0x558478b55fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc8fc72080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558478a4a1e0 con 0x558478b758d0 2024-04-02T07:24:25.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc8fc72080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584789e5960 con 0x558478b761f0 2024-04-02T07:24:25.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc8fc72080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5584789e5600 con 0x558478a9e500 2024-04-02T07:24:25.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc87e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558478b758d0 0x558478b55a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc87e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558478b758d0 0x558478b55a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33678/0 (socket says 172.21.15.55:33678) 2024-04-02T07:24:25.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc87e00640 1 -- 172.21.15.55:0/1953055380 learned_addr learned my addr 172.21.15.55:0/1953055380 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:25.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc8ce00640 1 --2- 172.21.15.55:0/1953055380 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558478a9e500 0x558478b77760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc8d800640 1 --2- 172.21.15.55:0/1953055380 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558478b761f0 0x558478b55fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc87e00640 1 -- 172.21.15.55:0/1953055380 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558478a9e500 msgr2=0x558478b77760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc87e00640 1 --2- 172.21.15.55:0/1953055380 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558478a9e500 0x558478b77760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc87e00640 1 -- 172.21.15.55:0/1953055380 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558478b761f0 msgr2=0x558478b55fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc87e00640 1 --2- 172.21.15.55:0/1953055380 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558478b761f0 0x558478b55fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc87e00640 1 -- 172.21.15.55:0/1953055380 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc80005df0 con 0x558478b758d0 2024-04-02T07:24:25.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc87e00640 1 --2- 172.21.15.55:0/1953055380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558478b758d0 0x558478b55a80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800b280 tx=0x7fdc7800b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=301a816377e005e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc86a00640 1 -- 172.21.15.55:0/1953055380 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc78014070 con 0x558478b758d0 2024-04-02T07:24:25.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc86a00640 1 -- 172.21.15.55:0/1953055380 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc7800d510 con 0x558478b758d0 2024-04-02T07:24:25.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc86a00640 1 -- 172.21.15.55:0/1953055380 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc7800d8a0 con 0x558478b758d0 2024-04-02T07:24:25.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc8fc72080 1 -- 172.21.15.55:0/1953055380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558478b758d0 msgr2=0x558478b55a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc8fc72080 1 --2- 172.21.15.55:0/1953055380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558478b758d0 0x558478b55a80 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fdc7800b280 tx=0x7fdc7800b740 comp rx=0 tx=0).stop 2024-04-02T07:24:25.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc8fc72080 1 -- 172.21.15.55:0/1953055380 shutdown_connections 2024-04-02T07:24:25.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc8fc72080 1 --2- 172.21.15.55:0/1953055380 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558478b761f0 0x558478b55fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc8fc72080 1 --2- 172.21.15.55:0/1953055380 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558478b758d0 0x558478b55a80 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc8fc72080 1 --2- 172.21.15.55:0/1953055380 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558478a9e500 0x558478b77760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc8fc72080 1 -- 172.21.15.55:0/1953055380 >> 172.21.15.55:0/1953055380 conn(0x558478a9ed50 msgr2=0x558478aeb6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:25.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc8fc72080 1 -- 172.21.15.55:0/1953055380 shutdown_connections 2024-04-02T07:24:25.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc8fc72080 1 -- 172.21.15.55:0/1953055380 wait complete. 2024-04-02T07:24:25.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc8fc72080 1 Processor -- start 2024-04-02T07:24:25.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.150+0000 7fdc8fc72080 1 -- start start 2024-04-02T07:24:25.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc8fc72080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558478a9e500 0x558478b7fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc8fc72080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558478b758d0 0x558478b7cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc8fc72080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558478b761f0 0x558478b74720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc8fc72080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584789dc690 con 0x558478a9e500 2024-04-02T07:24:25.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc8fc72080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558478b734c0 con 0x558478b758d0 2024-04-02T07:24:25.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc8fc72080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x558478b807e0 con 0x558478b761f0 2024-04-02T07:24:25.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc8ce00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558478a9e500 0x558478b7fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc8ce00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558478a9e500 0x558478b7fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33690/0 (socket says 172.21.15.55:33690) 2024-04-02T07:24:25.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc8ce00640 1 -- 172.21.15.55:0/1258862900 learned_addr learned my addr 172.21.15.55:0/1258862900 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:25.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc87e00640 1 --2- 172.21.15.55:0/1258862900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558478b758d0 0x558478b7cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc8d800640 1 --2- 172.21.15.55:0/1258862900 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558478b761f0 0x558478b74720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc8ce00640 1 -- 172.21.15.55:0/1258862900 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558478b761f0 msgr2=0x558478b74720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc8ce00640 1 --2- 172.21.15.55:0/1258862900 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558478b761f0 0x558478b74720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc8ce00640 1 -- 172.21.15.55:0/1258862900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558478b758d0 msgr2=0x558478b7cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc8ce00640 1 --2- 172.21.15.55:0/1258862900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558478b758d0 0x558478b7cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc8ce00640 1 -- 172.21.15.55:0/1258862900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc78001b10 con 0x558478a9e500 2024-04-02T07:24:25.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc87e00640 1 --2- 172.21.15.55:0/1258862900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558478b758d0 0x558478b7cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:25.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc8ce00640 1 --2- 172.21.15.55:0/1258862900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558478a9e500 0x558478b7fff0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fdc8001bc50 tx=0x7fdc80018510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc85600640 1 -- 172.21.15.55:0/1258862900 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc800acc00 con 0x558478a9e500 2024-04-02T07:24:25.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc85600640 1 -- 172.21.15.55:0/1258862900 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc800acd60 con 0x558478a9e500 2024-04-02T07:24:25.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc85600640 1 -- 172.21.15.55:0/1258862900 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc800b7660 con 0x558478a9e500 2024-04-02T07:24:25.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc8fc72080 1 -- 172.21.15.55:0/1258862900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5584789e7d00 con 0x558478a9e500 2024-04-02T07:24:25.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc8fc72080 1 -- 172.21.15.55:0/1258862900 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5584789e7760 con 0x558478a9e500 2024-04-02T07:24:25.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc85600640 1 -- 172.21.15.55:0/1258862900 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fdc800b77c0 con 0x558478a9e500 2024-04-02T07:24:25.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc85600640 1 --2- 172.21.15.55:0/1258862900 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdc6c0650a0 0x7fdc6c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.154+0000 7fdc85600640 1 -- 172.21.15.55:0/1258862900 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc8011e610 con 0x558478a9e500 2024-04-02T07:24:25.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.158+0000 7fdc8fc72080 1 --2- 172.21.15.55:0/1258862900 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x558478b7cff0 0x558478c0ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.158+0000 7fdc8fc72080 1 -- 172.21.15.55:0/1258862900 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:1 7.7 7:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x558478b811e0 con 0x558478b7cff0 2024-04-02T07:24:25.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.158+0000 7fdc87e00640 1 --2- 172.21.15.55:0/1258862900 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdc6c0650a0 0x7fdc6c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.158+0000 7fdc8d800640 1 --2- 172.21.15.55:0/1258862900 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x558478b7cff0 0x558478c0ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.158+0000 7fdc87e00640 1 --2- 172.21.15.55:0/1258862900 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdc6c0650a0 0x7fdc6c067560 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdc78000c10 tx=0x7fdc78009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.158+0000 7fdc8d800640 1 --2- 172.21.15.55:0/1258862900 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x558478b7cff0 0x558478c0ea70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.158+0000 7fdc8d800640 1 -- 172.21.15.55:0/1258862900 <== osd.6 v2:172.21.15.106:6816/27678 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7fdc88002750 con 0x558478b7cff0 2024-04-02T07:24:25.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.158+0000 7fdc8fc72080 1 -- 172.21.15.55:0/1258862900 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x558478b7cff0 msgr2=0x558478c0ea70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.158+0000 7fdc8fc72080 1 --2- 172.21.15.55:0/1258862900 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x558478b7cff0 0x558478c0ea70 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.158+0000 7fdc8fc72080 1 -- 172.21.15.55:0/1258862900 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdc6c0650a0 msgr2=0x7fdc6c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.158+0000 7fdc8fc72080 1 --2- 172.21.15.55:0/1258862900 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdc6c0650a0 0x7fdc6c067560 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fdc78000c10 tx=0x7fdc78009000 comp rx=0 tx=0).stop 2024-04-02T07:24:25.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.158+0000 7fdc8fc72080 1 -- 172.21.15.55:0/1258862900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558478a9e500 msgr2=0x558478b7fff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.158+0000 7fdc8fc72080 1 --2- 172.21.15.55:0/1258862900 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558478a9e500 0x558478b7fff0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fdc8001bc50 tx=0x7fdc80018510 comp rx=0 tx=0).stop 2024-04-02T07:24:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.158+0000 7fdc8d800640 1 -- 172.21.15.55:0/1258862900 reap_dead start 2024-04-02T07:24:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.158+0000 7fdc8fc72080 1 -- 172.21.15.55:0/1258862900 shutdown_connections 2024-04-02T07:24:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.158+0000 7fdc8fc72080 1 -- 172.21.15.55:0/1258862900 >> 172.21.15.55:0/1258862900 conn(0x558478a9ed50 msgr2=0x558478a89560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.158+0000 7fdc8fc72080 1 -- 172.21.15.55:0/1258862900 shutdown_connections 2024-04-02T07:24:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.158+0000 7fdc8fc72080 1 -- 172.21.15.55:0/1258862900 wait complete. 2024-04-02T07:24:25.166 INFO:teuthology.orchestra.run.smithi055.stdout:Yalphaparent_a 2024-04-02T07:24:25.166 DEBUG:teuthology.orchestra.run.smithi055:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-02T07:24:25.261 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:24:25.261 INFO:teuthology.orchestra.run.smithi055.stdout: "ino": 1099511627777, 2024-04-02T07:24:25.261 INFO:teuthology.orchestra.run.smithi055.stdout: "ancestors": [ 2024-04-02T07:24:25.261 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:25.261 INFO:teuthology.orchestra.run.smithi055.stdout: "dirino": 1099511627776, 2024-04-02T07:24:25.261 INFO:teuthology.orchestra.run.smithi055.stdout: "dname": "alpha", 2024-04-02T07:24:25.261 INFO:teuthology.orchestra.run.smithi055.stdout: "version": 2 2024-04-02T07:24:25.261 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:25.261 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:25.262 INFO:teuthology.orchestra.run.smithi055.stdout: "dirino": 1, 2024-04-02T07:24:25.262 INFO:teuthology.orchestra.run.smithi055.stdout: "dname": "parent_a", 2024-04-02T07:24:25.262 INFO:teuthology.orchestra.run.smithi055.stdout: "version": 4 2024-04-02T07:24:25.262 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:25.262 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-02T07:24:25.262 INFO:teuthology.orchestra.run.smithi055.stdout: "pool": 7, 2024-04-02T07:24:25.262 INFO:teuthology.orchestra.run.smithi055.stdout: "old_pools": [] 2024-04-02T07:24:25.262 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:24:25.262 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:25.265 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'oh i'"'"'m sorry did i overwrite your xattr?' 2024-04-02T07:24:25.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.354+0000 7fd9546a6080 1 Processor -- start 2024-04-02T07:24:25.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.354+0000 7fd9546a6080 1 -- start start 2024-04-02T07:24:25.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.354+0000 7fd9546a6080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559183ea9bd0 0x559183ea13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.354+0000 7fd9546a6080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559183f1e0b0 0x559183ea8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.354+0000 7fd9546a6080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559183f1e490 0x559183e8f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.354+0000 7fd9546a6080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559183e0c1e0 con 0x559183ea9bd0 2024-04-02T07:24:25.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.354+0000 7fd9546a6080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559183da7960 con 0x559183f1e0b0 2024-04-02T07:24:25.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.354+0000 7fd9546a6080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x559183da7600 con 0x559183f1e490 2024-04-02T07:24:25.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.354+0000 7fd951800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559183ea9bd0 0x559183ea13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.354+0000 7fd951800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559183ea9bd0 0x559183ea13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33700/0 (socket says 172.21.15.55:33700) 2024-04-02T07:24:25.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.354+0000 7fd951800640 1 -- 172.21.15.55:0/3843411923 learned_addr learned my addr 172.21.15.55:0/3843411923 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:25.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.354+0000 7fd952200640 1 --2- 172.21.15.55:0/3843411923 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559183f1e490 0x559183e8f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.354+0000 7fd950e00640 1 --2- 172.21.15.55:0/3843411923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559183f1e0b0 0x559183ea8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.354+0000 7fd951800640 1 -- 172.21.15.55:0/3843411923 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559183f1e490 msgr2=0x559183e8f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.354+0000 7fd951800640 1 --2- 172.21.15.55:0/3843411923 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559183f1e490 0x559183e8f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.354+0000 7fd951800640 1 -- 172.21.15.55:0/3843411923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559183f1e0b0 msgr2=0x559183ea8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.354+0000 7fd951800640 1 --2- 172.21.15.55:0/3843411923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559183f1e0b0 0x559183ea8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.354+0000 7fd951800640 1 -- 172.21.15.55:0/3843411923 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd94c00a100 con 0x559183ea9bd0 2024-04-02T07:24:25.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.354+0000 7fd950e00640 1 --2- 172.21.15.55:0/3843411923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559183f1e0b0 0x559183ea8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:24:25.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.354+0000 7fd951800640 1 --2- 172.21.15.55:0/3843411923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559183ea9bd0 0x559183ea13f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd94400b2d0 tx=0x7fd94400b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9939bef05768abbc server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd94b400640 1 -- 172.21.15.55:0/3843411923 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd944014070 con 0x559183ea9bd0 2024-04-02T07:24:25.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd94b400640 1 -- 172.21.15.55:0/3843411923 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd94400d510 con 0x559183ea9bd0 2024-04-02T07:24:25.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd94b400640 1 -- 172.21.15.55:0/3843411923 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd94400d900 con 0x559183ea9bd0 2024-04-02T07:24:25.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd9546a6080 1 -- 172.21.15.55:0/3843411923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559183ea9bd0 msgr2=0x559183ea13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd9546a6080 1 --2- 172.21.15.55:0/3843411923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559183ea9bd0 0x559183ea13f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd94400b2d0 tx=0x7fd94400b790 comp rx=0 tx=0).stop 2024-04-02T07:24:25.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd9546a6080 1 -- 172.21.15.55:0/3843411923 shutdown_connections 2024-04-02T07:24:25.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd9546a6080 1 --2- 172.21.15.55:0/3843411923 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559183f1e490 0x559183e8f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd9546a6080 1 --2- 172.21.15.55:0/3843411923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559183f1e0b0 0x559183ea8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd9546a6080 1 --2- 172.21.15.55:0/3843411923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559183ea9bd0 0x559183ea13f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd9546a6080 1 -- 172.21.15.55:0/3843411923 >> 172.21.15.55:0/3843411923 conn(0x559183e8dbf0 msgr2=0x559183f37430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:25.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd9546a6080 1 -- 172.21.15.55:0/3843411923 shutdown_connections 2024-04-02T07:24:25.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd9546a6080 1 -- 172.21.15.55:0/3843411923 wait complete. 2024-04-02T07:24:25.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd9546a6080 1 Processor -- start 2024-04-02T07:24:25.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd9546a6080 1 -- start start 2024-04-02T07:24:25.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd9546a6080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559183ea9bd0 0x559183f1a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd9546a6080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559183f1e0b0 0x559183e5f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd9546a6080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559183f1e490 0x559183f17d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd9546a6080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559183d9e690 con 0x559183f1e0b0 2024-04-02T07:24:25.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd9546a6080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559183f1b100 con 0x559183f1e490 2024-04-02T07:24:25.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd9546a6080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x559183f1b3a0 con 0x559183ea9bd0 2024-04-02T07:24:25.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd950e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559183f1e0b0 0x559183e5f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd950e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559183f1e0b0 0x559183e5f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33702/0 (socket says 172.21.15.55:33702) 2024-04-02T07:24:25.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd950e00640 1 -- 172.21.15.55:0/4022269751 learned_addr learned my addr 172.21.15.55:0/4022269751 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:25.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd951800640 1 --2- 172.21.15.55:0/4022269751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559183ea9bd0 0x559183f1a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd952200640 1 --2- 172.21.15.55:0/4022269751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559183f1e490 0x559183f17d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd950e00640 1 -- 172.21.15.55:0/4022269751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559183ea9bd0 msgr2=0x559183f1a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd950e00640 1 --2- 172.21.15.55:0/4022269751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559183ea9bd0 0x559183f1a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd950e00640 1 -- 172.21.15.55:0/4022269751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559183f1e490 msgr2=0x559183f17d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd950e00640 1 --2- 172.21.15.55:0/4022269751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559183f1e490 0x559183f17d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd950e00640 1 -- 172.21.15.55:0/4022269751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd944001bb0 con 0x559183f1e0b0 2024-04-02T07:24:25.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd950e00640 1 --2- 172.21.15.55:0/4022269751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559183f1e0b0 0x559183e5f1f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd94000cf70 tx=0x7fd94000a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd94a000640 1 -- 172.21.15.55:0/4022269751 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd940015030 con 0x559183f1e0b0 2024-04-02T07:24:25.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd94a000640 1 -- 172.21.15.55:0/4022269751 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd940001d80 con 0x559183f1e0b0 2024-04-02T07:24:25.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd9546a6080 1 -- 172.21.15.55:0/4022269751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559183da9d00 con 0x559183f1e0b0 2024-04-02T07:24:25.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd94a000640 1 -- 172.21.15.55:0/4022269751 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd940010880 con 0x559183f1e0b0 2024-04-02T07:24:25.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.358+0000 7fd9546a6080 1 -- 172.21.15.55:0/4022269751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559183da9760 con 0x559183f1e0b0 2024-04-02T07:24:25.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.362+0000 7fd94a000640 1 -- 172.21.15.55:0/4022269751 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd940018070 con 0x559183f1e0b0 2024-04-02T07:24:25.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.362+0000 7fd94a000640 1 --2- 172.21.15.55:0/4022269751 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd9340650a0 0x7fd934067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.362+0000 7fd94a000640 1 -- 172.21.15.55:0/4022269751 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd940016070 con 0x559183f1e0b0 2024-04-02T07:24:25.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.362+0000 7fd951800640 1 --2- 172.21.15.55:0/4022269751 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd9340650a0 0x7fd934067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.362+0000 7fd9546a6080 1 --2- 172.21.15.55:0/4022269751 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x559183f1ac80 0x559183fdca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.362+0000 7fd9546a6080 1 -- 172.21.15.55:0/4022269751 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:1 7.7 7:e2e07930:::10000000001.00000000:head [setxattr parent (40) in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e46) v8 -- 0x559183ea64e0 con 0x559183f1ac80 2024-04-02T07:24:25.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.362+0000 7fd952200640 1 --2- 172.21.15.55:0/4022269751 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x559183f1ac80 0x559183fdca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.362+0000 7fd951800640 1 --2- 172.21.15.55:0/4022269751 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd9340650a0 0x7fd934067560 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd94400b2d0 tx=0x7fd944009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.362+0000 7fd952200640 1 --2- 172.21.15.55:0/4022269751 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x559183f1ac80 0x559183fdca90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.366+0000 7fd952200640 1 -- 172.21.15.55:0/4022269751 <== osd.6 v2:172.21.15.106:6816/27678 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (40)] v46'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fd94c0aa6a0 con 0x559183f1ac80 2024-04-02T07:24:25.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.366+0000 7fd9546a6080 1 -- 172.21.15.55:0/4022269751 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x559183f1ac80 msgr2=0x559183fdca90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.366+0000 7fd9546a6080 1 --2- 172.21.15.55:0/4022269751 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x559183f1ac80 0x559183fdca90 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.366+0000 7fd9546a6080 1 -- 172.21.15.55:0/4022269751 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd9340650a0 msgr2=0x7fd934067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.366+0000 7fd9546a6080 1 --2- 172.21.15.55:0/4022269751 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd9340650a0 0x7fd934067560 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd94400b2d0 tx=0x7fd944009000 comp rx=0 tx=0).stop 2024-04-02T07:24:25.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.366+0000 7fd9546a6080 1 -- 172.21.15.55:0/4022269751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559183f1e0b0 msgr2=0x559183e5f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.366+0000 7fd9546a6080 1 --2- 172.21.15.55:0/4022269751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559183f1e0b0 0x559183e5f1f0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd94000cf70 tx=0x7fd94000a5b0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.366+0000 7fd952200640 1 -- 172.21.15.55:0/4022269751 reap_dead start 2024-04-02T07:24:25.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.366+0000 7fd9546a6080 1 -- 172.21.15.55:0/4022269751 shutdown_connections 2024-04-02T07:24:25.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.366+0000 7fd9546a6080 1 -- 172.21.15.55:0/4022269751 >> 172.21.15.55:0/4022269751 conn(0x559183e8dbf0 msgr2=0x559183f37430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:25.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.366+0000 7fd9546a6080 1 -- 172.21.15.55:0/4022269751 shutdown_connections 2024-04-02T07:24:25.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.366+0000 7fd9546a6080 1 -- 172.21.15.55:0/4022269751 wait complete. 2024-04-02T07:24:25.374 DEBUG:teuthology.orchestra.run.smithi055:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-02T07:24:25.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:25.377 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub start / repair,recursive 2024-04-02T07:24:25.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.518+0000 7f3e43600640 1 Processor -- start 2024-04-02T07:24:25.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.518+0000 7f3e43600640 1 -- start start 2024-04-02T07:24:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.522+0000 7f3e43600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3e3c0cd430 0x7f3e3c06b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.522+0000 7f3e43600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c15df40 con 0x7f3e3c15d450 2024-04-02T07:24:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.522+0000 7f3e43600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e3c0cd880 con 0x7f3e3c0ccf80 2024-04-02T07:24:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.522+0000 7f3e43600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3c098d40 con 0x7f3e3c0cd430 2024-04-02T07:24:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.522+0000 7f3e40c00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3e3c15d450 0x7f3e3c15d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48242/0 (socket says 172.21.15.55:48242) 2024-04-02T07:24:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.522+0000 7f3e40c00640 1 -- 172.21.15.55:0/1856483026 learned_addr learned my addr 172.21.15.55:0/1856483026 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:25.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.522+0000 7f3e41600640 1 --2- 172.21.15.55:0/1856483026 >> v2:172.21.15.106:3300/0 conn(0x7f3e3c0cd430 0x7f3e3c06b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.522+0000 7f3e3b400640 1 -- 172.21.15.55:0/1856483026 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1247653988 0 0) 0x7f3e3c15df40 con 0x7f3e3c15d450 2024-04-02T07:24:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.522+0000 7f3e3b400640 1 -- 172.21.15.55:0/1856483026 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e24003530 con 0x7f3e3c15d450 2024-04-02T07:24:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.522+0000 7f3e3b400640 1 -- 172.21.15.55:0/1856483026 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3339071998 0 0) 0x7f3e3c0cd880 con 0x7f3e3c0ccf80 2024-04-02T07:24:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.522+0000 7f3e3b400640 1 -- 172.21.15.55:0/1856483026 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e3c15df40 con 0x7f3e3c0ccf80 2024-04-02T07:24:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.522+0000 7f3e41600640 1 -- 172.21.15.55:0/1856483026 >> v1:172.21.15.106:6789/0 conn(0x7f3e3c0ccf80 legacy=0x7f3e3c06b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.522+0000 7f3e41600640 1 -- 172.21.15.55:0/1856483026 >> v1:172.21.15.55:6789/0 conn(0x7f3e3c15d450 legacy=0x7f3e3c15d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.522+0000 7f3e41600640 1 -- 172.21.15.55:0/1856483026 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e3c099020 con 0x7f3e3c0cd430 2024-04-02T07:24:25.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.526+0000 7f3e41600640 1 --2- 172.21.15.55:0/1856483026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e3c0cd430 0x7f3e3c06b7b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009d90 tx=0x7f3e3401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbe7ffa2a8e36e1e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.526+0000 7f3e3b400640 1 -- 172.21.15.55:0/1856483026 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e340a5910 con 0x7f3e3c0cd430 2024-04-02T07:24:25.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.526+0000 7f3e3b400640 1 -- 172.21.15.55:0/1856483026 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e340a5a70 con 0x7f3e3c0cd430 2024-04-02T07:24:25.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.526+0000 7f3e3b400640 1 -- 172.21.15.55:0/1856483026 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e340a5e00 con 0x7f3e3c0cd430 2024-04-02T07:24:25.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e43600640 1 -- 172.21.15.55:0/1856483026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e3c0cd430 msgr2=0x7f3e3c06b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e43600640 1 --2- 172.21.15.55:0/1856483026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e3c0cd430 0x7f3e3c06b7b0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f3e34009d90 tx=0x7f3e3401c940 comp rx=0 tx=0).stop 2024-04-02T07:24:25.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e43600640 1 -- 172.21.15.55:0/1856483026 shutdown_connections 2024-04-02T07:24:25.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e43600640 1 --2- 172.21.15.55:0/1856483026 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e3c0cd430 0x7f3e3c06b7b0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e43600640 1 -- 172.21.15.55:0/1856483026 >> 172.21.15.55:0/1856483026 conn(0x7f3e3c0d0700 msgr2=0x7f3e3c0d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:25.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e43600640 1 -- 172.21.15.55:0/1856483026 shutdown_connections 2024-04-02T07:24:25.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e43600640 1 -- 172.21.15.55:0/1856483026 wait complete. 2024-04-02T07:24:25.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e43600640 1 Processor -- start 2024-04-02T07:24:25.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e43600640 1 -- start start 2024-04-02T07:24:25.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e43600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e3c0ccf80 0x7f3e3c151eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e43600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e3c0cd430 0x7f3e3c0c4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e43600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e3c15d450 0x7f3e3c0c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e43600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0adfb0 con 0x7f3e3c0cd430 2024-04-02T07:24:25.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e43600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0ad3a0 con 0x7f3e3c15d450 2024-04-02T07:24:25.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e43600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3c0ad680 con 0x7f3e3c0ccf80 2024-04-02T07:24:25.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e3be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e3c0cd430 0x7f3e3c0c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e3be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e3c0cd430 0x7f3e3c0c4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33710/0 (socket says 172.21.15.55:33710) 2024-04-02T07:24:25.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e3be00640 1 -- 172.21.15.55:0/975573972 learned_addr learned my addr 172.21.15.55:0/975573972 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:25.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e41600640 1 --2- 172.21.15.55:0/975573972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e3c15d450 0x7f3e3c0c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e40c00640 1 --2- 172.21.15.55:0/975573972 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e3c0ccf80 0x7f3e3c151eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e3be00640 1 -- 172.21.15.55:0/975573972 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e3c0ccf80 msgr2=0x7f3e3c151eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e3be00640 1 --2- 172.21.15.55:0/975573972 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e3c0ccf80 0x7f3e3c151eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e3be00640 1 -- 172.21.15.55:0/975573972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e3c15d450 msgr2=0x7f3e3c0c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e3be00640 1 --2- 172.21.15.55:0/975573972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e3c15d450 0x7f3e3c0c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e3be00640 1 -- 172.21.15.55:0/975573972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e34009a70 con 0x7f3e3c0cd430 2024-04-02T07:24:25.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e40c00640 1 --2- 172.21.15.55:0/975573972 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e3c0ccf80 0x7f3e3c151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:24:25.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.530+0000 7f3e3be00640 1 --2- 172.21.15.55:0/975573972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e3c0cd430 0x7f3e3c0c4210 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3e2800c430 tx=0x7f3e2800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.534+0000 7f3e38c00640 1 -- 172.21.15.55:0/975573972 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e280052d0 con 0x7f3e3c0cd430 2024-04-02T07:24:25.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.534+0000 7f3e38c00640 1 -- 172.21.15.55:0/975573972 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e28005450 con 0x7f3e3c0cd430 2024-04-02T07:24:25.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.534+0000 7f3e43600640 1 -- 172.21.15.55:0/975573972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e3c0ad960 con 0x7f3e3c0cd430 2024-04-02T07:24:25.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.534+0000 7f3e38c00640 1 -- 172.21.15.55:0/975573972 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e28003840 con 0x7f3e3c0cd430 2024-04-02T07:24:25.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.534+0000 7f3e43600640 1 -- 172.21.15.55:0/975573972 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c1523f0 con 0x7f3e3c0cd430 2024-04-02T07:24:25.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.534+0000 7f3e38c00640 1 -- 172.21.15.55:0/975573972 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3e280039a0 con 0x7f3e3c0cd430 2024-04-02T07:24:25.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.534+0000 7f3e38c00640 1 --2- 172.21.15.55:0/975573972 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3e1c066690 0x7f3e1c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.534+0000 7f3e38c00640 1 -- 172.21.15.55:0/975573972 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e28083860 con 0x7f3e3c0cd430 2024-04-02T07:24:25.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.534+0000 7f3e46af8000 1 Processor -- start 2024-04-02T07:24:25.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.534+0000 7f3e46af8000 1 -- start start 2024-04-02T07:24:25.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.534+0000 7f3e40c00640 1 --2- 172.21.15.55:0/975573972 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3e1c066690 0x7f3e1c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e46af8000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31f9d30 0x5561e31fa110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e40c00640 1 --2- 172.21.15.55:0/975573972 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3e1c066690 0x7f3e1c068b50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3e30005890 tx=0x7f3e30009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e46af8000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31fa650 0x5561e31b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e46af8000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31b0f60 0x5561e31b1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e46af8000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561e3078170 con 0x5561e31b0f60 2024-04-02T07:24:25.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e46af8000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561e3005d80 con 0x5561e31f9d30 2024-04-02T07:24:25.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e46af8000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561e3003350 con 0x5561e31fa650 2024-04-02T07:24:25.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e41600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31b0f60 0x5561e31b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e3be00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31fa650 0x5561e31b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e40c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31f9d30 0x5561e31fa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e41600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31b0f60 0x5561e31b1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33726/0 (socket says 172.21.15.55:33726) 2024-04-02T07:24:25.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e41600640 1 -- 172.21.15.55:0/2184024002 learned_addr learned my addr 172.21.15.55:0/2184024002 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:25.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e3be00640 1 -- 172.21.15.55:0/2184024002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31f9d30 msgr2=0x5561e31fa110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e3be00640 1 --2- 172.21.15.55:0/2184024002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31f9d30 0x5561e31fa110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e3be00640 1 -- 172.21.15.55:0/2184024002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31b0f60 msgr2=0x5561e31b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e3be00640 1 --2- 172.21.15.55:0/2184024002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31b0f60 0x5561e31b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e3be00640 1 -- 172.21.15.55:0/2184024002 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561e2cfb070 con 0x5561e31fa650 2024-04-02T07:24:25.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e3be00640 1 --2- 172.21.15.55:0/2184024002 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31fa650 0x5561e31b0a20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e28081cf0 tx=0x7f3e28054ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6dbbf3f2e664426 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e2d600640 1 -- 172.21.15.55:0/2184024002 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2805cbe0 con 0x5561e31fa650 2024-04-02T07:24:25.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e2d600640 1 -- 172.21.15.55:0/2184024002 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e28052b90 con 0x5561e31fa650 2024-04-02T07:24:25.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e2d600640 1 -- 172.21.15.55:0/2184024002 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2805c750 con 0x5561e31fa650 2024-04-02T07:24:25.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e46af8000 1 -- 172.21.15.55:0/2184024002 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31fa650 msgr2=0x5561e31b0a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e46af8000 1 --2- 172.21.15.55:0/2184024002 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31fa650 0x5561e31b0a20 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3e28081cf0 tx=0x7f3e28054ef0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e46af8000 1 -- 172.21.15.55:0/2184024002 shutdown_connections 2024-04-02T07:24:25.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e46af8000 1 --2- 172.21.15.55:0/2184024002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31b0f60 0x5561e31b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e46af8000 1 --2- 172.21.15.55:0/2184024002 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31fa650 0x5561e31b0a20 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e46af8000 1 --2- 172.21.15.55:0/2184024002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31f9d30 0x5561e31fa110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e46af8000 1 -- 172.21.15.55:0/2184024002 >> 172.21.15.55:0/2184024002 conn(0x5561e31acf10 msgr2=0x5561e31af300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:25.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e46af8000 1 -- 172.21.15.55:0/2184024002 shutdown_connections 2024-04-02T07:24:25.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e46af8000 1 -- 172.21.15.55:0/2184024002 wait complete. 2024-04-02T07:24:25.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e46af8000 1 -- start start 2024-04-02T07:24:25.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.538+0000 7f3e46af8000 1 Processor -- start 2024-04-02T07:24:25.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e46af8000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31b0f60 0x5561e3201170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e46af8000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31f9d30 0x5561e32016b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e46af8000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31fa650 0x5561e31faa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e46af8000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561e2ffec40 con 0x5561e31f9d30 2024-04-02T07:24:25.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e46af8000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561e2f9dfa0 con 0x5561e31fa650 2024-04-02T07:24:25.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e46af8000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561e2fbc1c0 con 0x5561e31b0f60 2024-04-02T07:24:25.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e46af8000 10 client.0 _ll_register_callbacks cb 0x5561e319c060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:24:25.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e3be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31f9d30 0x5561e32016b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e3be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31f9d30 0x5561e32016b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33728/0 (socket says 172.21.15.55:33728) 2024-04-02T07:24:25.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e3be00640 1 -- 172.21.15.55:0/2701618793 learned_addr learned my addr 172.21.15.55:0/2701618793 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e40c00640 1 --2- 172.21.15.55:0/2701618793 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31b0f60 0x5561e3201170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e41600640 1 --2- 172.21.15.55:0/2701618793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31fa650 0x5561e31faa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e3be00640 1 -- 172.21.15.55:0/2701618793 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31b0f60 msgr2=0x5561e3201170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e3be00640 1 --2- 172.21.15.55:0/2701618793 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31b0f60 0x5561e3201170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e3be00640 1 -- 172.21.15.55:0/2701618793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31fa650 msgr2=0x5561e31faa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e3be00640 1 --2- 172.21.15.55:0/2701618793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31fa650 0x5561e31faa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e3be00640 1 -- 172.21.15.55:0/2701618793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e3c1523f0 con 0x5561e31f9d30 2024-04-02T07:24:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e3be00640 1 --2- 172.21.15.55:0/2701618793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31f9d30 0x5561e32016b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3e28054780 tx=0x7f3e28000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b53139fc93a302 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e22000640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:24:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e22000640 1 -- 172.21.15.55:0/2701618793 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2806c1e0 con 0x5561e31f9d30 2024-04-02T07:24:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e22000640 1 -- 172.21.15.55:0/2701618793 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e2805cbe0 con 0x5561e31f9d30 2024-04-02T07:24:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e46af8000 1 -- 172.21.15.55:0/2701618793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561e2ffba20 con 0x5561e31f9d30 2024-04-02T07:24:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e22000640 1 -- 172.21.15.55:0/2701618793 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e2805c750 con 0x5561e31f9d30 2024-04-02T07:24:25.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e46af8000 10 client.5874 fetch_fsmap learned FSMap version 25 2024-04-02T07:24:25.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e46af8000 1 -- 172.21.15.55:0/2701618793 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x5561e2fc3ba0 con 0x5561e31f9d30 2024-04-02T07:24:25.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e22000640 1 -- 172.21.15.55:0/2701618793 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561e2ffba20 con 0x5561e31f9d30 2024-04-02T07:24:25.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e22000640 1 -- 172.21.15.55:0/2701618793 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 25) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3e28058120 con 0x5561e31f9d30 2024-04-02T07:24:25.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e46af8000 10 client.5874 fetch_fsmap finished waiting for FSMap version 25 2024-04-02T07:24:25.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e46af8000 10 client.5874 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-04-02T07:24:25.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e46af8000 20 client.5874 populate_metadata read hostname 'smithi055' 2024-04-02T07:24:25.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e46af8000 1 --2- 172.21.15.55:0/2701618793 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x5561e31fb7d0 0x5561e31fbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e46af8000 4 client.5874 mds_command: new command op to 5655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:24:25.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e46af8000 1 -- 172.21.15.55:0/2701618793 --> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5561e2ffd590 con 0x5561e31fb7d0 2024-04-02T07:24:25.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e40c00640 1 --2- 172.21.15.55:0/2701618793 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x5561e31fb7d0 0x5561e31fbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e40c00640 1 --2- 172.21.15.55:0/2701618793 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x5561e31fb7d0 0x5561e31fbbb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfc6b5045e1516d4 server_cookie=558123f64cbce70f in_seq=0 out_seq=0 2024-04-02T07:24:25.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e22000640 10 client.5874 ms_handle_connect on v2:172.21.15.106:6834/1720558250 2024-04-02T07:24:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e22000640 1 -- 172.21.15.55:0/2701618793 <== mds.0 v2:172.21.15.106:6834/1720558250 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5561e2ffd590 con 0x5561e31fb7d0 2024-04-02T07:24:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e22000640 10 client.5874 handle_command_reply: tid=0 2024-04-02T07:24:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e46af8000 1 client.5874 shutdown 2024-04-02T07:24:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e46af8000 1 -- 172.21.15.55:0/2701618793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31f9d30 msgr2=0x5561e32016b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.542+0000 7f3e46af8000 1 --2- 172.21.15.55:0/2701618793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31f9d30 0x5561e32016b0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f3e28054780 tx=0x7f3e28000ee0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7f3e46af8000 1 -- 172.21.15.55:0/2701618793 shutdown_connections 2024-04-02T07:24:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7f3e46af8000 1 --2- 172.21.15.55:0/2701618793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31fa650 0x5561e31faa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7f3e46af8000 1 --2- 172.21.15.55:0/2701618793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31f9d30 0x5561e32016b0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7f3e46af8000 1 --2- 172.21.15.55:0/2701618793 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x5561e31fb7d0 0x5561e31fbbb0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7f3e46af8000 1 --2- 172.21.15.55:0/2701618793 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31b0f60 0x5561e3201170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7f3e46af8000 1 -- 172.21.15.55:0/2701618793 >> 172.21.15.55:0/2701618793 conn(0x5561e31acf10 msgr2=0x5561e31afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7f3e22000640 0 client.5874 ms_handle_reset on v2:172.21.15.106:6834/1720558250 2024-04-02T07:24:25.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7f3e46af8000 1 -- 172.21.15.55:0/2701618793 shutdown_connections 2024-04-02T07:24:25.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7f3e46af8000 1 -- 172.21.15.55:0/2701618793 wait complete. 2024-04-02T07:24:25.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7f3e46af8000 20 client.5874 trim_cache size 0 max 16384 2024-04-02T07:24:25.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7fba5fc00640 1 Processor -- start 2024-04-02T07:24:25.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7fba5fc00640 1 -- start start 2024-04-02T07:24:25.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7fba5fc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fba5815cac0 0x7fba5815dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7fba5fc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba5806a4a0 0x7fba58159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7fba5fc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba5806d320 con 0x7fba5815ae20 2024-04-02T07:24:25.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7fba5fc00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba5806e680 con 0x7fba5815cac0 2024-04-02T07:24:25.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7fba5fc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba5815e1a0 con 0x7fba5806a4a0 2024-04-02T07:24:25.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7fba5d200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fba5815cac0 0x7fba5815dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7fba5d200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fba5815cac0 0x7fba5815dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33738/0 (socket says 172.21.15.55:33738) 2024-04-02T07:24:25.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7fba5d200640 1 -- 172.21.15.55:0/2201228601 learned_addr learned my addr 172.21.15.55:0/2201228601 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:25.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7fba5dc00640 1 --2- 172.21.15.55:0/2201228601 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba5806a4a0 0x7fba58159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7fba5d200640 1 -- 172.21.15.55:0/2201228601 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba5806a4a0 msgr2=0x7fba58159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7fba5d200640 1 --2- 172.21.15.55:0/2201228601 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba5806a4a0 0x7fba58159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7fba5d200640 1 -- 172.21.15.55:0/2201228601 >> v1:172.21.15.106:6789/0 conn(0x7fba5815ae20 legacy=0x7fba58069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.546+0000 7fba5d200640 1 -- 172.21.15.55:0/2201228601 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba580cc320 con 0x7fba5815cac0 2024-04-02T07:24:25.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.550+0000 7fba5d200640 1 --2- 172.21.15.55:0/2201228601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba5815cac0 0x7fba5815dc60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fba4c009870 tx=0x7fba4c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8191c04e098bd0ff server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba57400640 1 -- 172.21.15.55:0/2201228601 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0a95f0 con 0x7fba5815cac0 2024-04-02T07:24:25.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba57400640 1 -- 172.21.15.55:0/2201228601 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4c0a9750 con 0x7fba5815cac0 2024-04-02T07:24:25.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba57400640 1 -- 172.21.15.55:0/2201228601 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0a9ae0 con 0x7fba5815cac0 2024-04-02T07:24:25.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba5fc00640 1 -- 172.21.15.55:0/2201228601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba5815cac0 msgr2=0x7fba5815dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba5fc00640 1 --2- 172.21.15.55:0/2201228601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba5815cac0 0x7fba5815dc60 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fba4c009870 tx=0x7fba4c01c530 comp rx=0 tx=0).stop 2024-04-02T07:24:25.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba5fc00640 1 -- 172.21.15.55:0/2201228601 shutdown_connections 2024-04-02T07:24:25.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba5fc00640 1 --2- 172.21.15.55:0/2201228601 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba5806a4a0 0x7fba58159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba5fc00640 1 --2- 172.21.15.55:0/2201228601 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba5815cac0 0x7fba5815dc60 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba5fc00640 1 -- 172.21.15.55:0/2201228601 >> 172.21.15.55:0/2201228601 conn(0x7fba580b0220 msgr2=0x7fba580b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:25.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba5fc00640 1 -- 172.21.15.55:0/2201228601 shutdown_connections 2024-04-02T07:24:25.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba5fc00640 1 -- 172.21.15.55:0/2201228601 wait complete. 2024-04-02T07:24:25.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba5fc00640 1 Processor -- start 2024-04-02T07:24:25.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba5fc00640 1 -- start start 2024-04-02T07:24:25.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba5fc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba5806a4a0 0x7fba581418c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba5fc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba5815ae20 0x7fba580a7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba5fc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba5815cac0 0x7fba580a79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba5fc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba58142660 con 0x7fba5815cac0 2024-04-02T07:24:25.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba5fc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba581548e0 con 0x7fba5806a4a0 2024-04-02T07:24:25.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba5fc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba580b2900 con 0x7fba5815ae20 2024-04-02T07:24:25.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba5dc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba5815cac0 0x7fba580a79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba5dc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba5815cac0 0x7fba580a79b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54370/0 (socket says 172.21.15.55:54370) 2024-04-02T07:24:25.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba5dc00640 1 -- 172.21.15.55:0/3661572864 learned_addr learned my addr 172.21.15.55:0/3661572864 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:25.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.554+0000 7fba5d200640 1 --2- 172.21.15.55:0/3661572864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba5806a4a0 0x7fba581418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.558+0000 7fba57e00640 1 --2- 172.21.15.55:0/3661572864 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba5815ae20 0x7fba580a7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.558+0000 7fba5dc00640 1 -- 172.21.15.55:0/3661572864 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba5815ae20 msgr2=0x7fba580a7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.558+0000 7fba5dc00640 1 --2- 172.21.15.55:0/3661572864 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba5815ae20 0x7fba580a7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.558+0000 7fba5dc00640 1 -- 172.21.15.55:0/3661572864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba5806a4a0 msgr2=0x7fba581418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.558+0000 7fba5dc00640 1 --2- 172.21.15.55:0/3661572864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba5806a4a0 0x7fba581418c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.558+0000 7fba5dc00640 1 -- 172.21.15.55:0/3661572864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4c0094d0 con 0x7fba5815cac0 2024-04-02T07:24:25.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.558+0000 7fba57e00640 1 --2- 172.21.15.55:0/3661572864 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba5815ae20 0x7fba580a7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:25.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.558+0000 7fba5dc00640 1 --2- 172.21.15.55:0/3661572864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba5815cac0 0x7fba580a79b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fba50009dd0 tx=0x7fba5000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.558+0000 7fba54c00640 1 -- 172.21.15.55:0/3661572864 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50014480 con 0x7fba5815cac0 2024-04-02T07:24:25.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.558+0000 7fba54c00640 1 -- 172.21.15.55:0/3661572864 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba5000f040 con 0x7fba5815cac0 2024-04-02T07:24:25.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.558+0000 7fba5fc00640 1 -- 172.21.15.55:0/3661572864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba580b2be0 con 0x7fba5815cac0 2024-04-02T07:24:25.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.558+0000 7fba54c00640 1 -- 172.21.15.55:0/3661572864 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba50014840 con 0x7fba5815cac0 2024-04-02T07:24:25.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.558+0000 7fba5fc00640 1 -- 172.21.15.55:0/3661572864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba581422f0 con 0x7fba5815cac0 2024-04-02T07:24:25.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.558+0000 7fba5fc00640 1 -- 172.21.15.55:0/3661572864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fba581427d0 con 0x7fba5815cac0 2024-04-02T07:24:25.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.558+0000 7fba54c00640 1 -- 172.21.15.55:0/3661572864 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fba500149a0 con 0x7fba5815cac0 2024-04-02T07:24:25.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.558+0000 7fba54c00640 1 --2- 172.21.15.55:0/3661572864 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fba38066690 0x7fba38068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.558+0000 7fba54c00640 1 -- 172.21.15.55:0/3661572864 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba50084d40 con 0x7fba5815cac0 2024-04-02T07:24:25.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.562+0000 7fba5d200640 1 --2- 172.21.15.55:0/3661572864 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fba38066690 0x7fba38068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.562+0000 7fba54c00640 1 -- 172.21.15.55:0/3661572864 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+501 (secure 0 0 0) 0x7fba500872a0 con 0x7fba5815cac0 2024-04-02T07:24:25.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.562+0000 7fba5fc00640 1 -- 172.21.15.55:0/3661572864 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fba58066c90 con 0x7fba5815cac0 2024-04-02T07:24:25.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.562+0000 7fba5d200640 1 --2- 172.21.15.55:0/3661572864 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fba38066690 0x7fba38068b50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fba4c0ae000 tx=0x7fba4c0b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.562+0000 7f3e46af8000 1 Processor -- start 2024-04-02T07:24:25.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.562+0000 7f3e46af8000 1 -- start start 2024-04-02T07:24:25.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.562+0000 7f3e46af8000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31b0f60 0x5561e31b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.562+0000 7f3e46af8000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31f9d30 0x5561e31b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.562+0000 7f3e46af8000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31fa650 0x5561e31fbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.562+0000 7f3e46af8000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561e2cbbcf0 con 0x5561e31f9d30 2024-04-02T07:24:25.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.562+0000 7f3e46af8000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561e3210530 con 0x5561e31fa650 2024-04-02T07:24:25.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.562+0000 7f3e46af8000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561e2fbf090 con 0x5561e31b0f60 2024-04-02T07:24:25.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e3be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31f9d30 0x5561e31b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e3be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31f9d30 0x5561e31b07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54378/0 (socket says 172.21.15.55:54378) 2024-04-02T07:24:25.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e3be00640 1 -- 172.21.15.55:0/2145958611 learned_addr learned my addr 172.21.15.55:0/2145958611 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:25.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e40c00640 1 --2- 172.21.15.55:0/2145958611 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31b0f60 0x5561e31b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e41600640 1 --2- 172.21.15.55:0/2145958611 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31fa650 0x5561e31fbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e3be00640 1 -- 172.21.15.55:0/2145958611 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31b0f60 msgr2=0x5561e31b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e3be00640 1 --2- 172.21.15.55:0/2145958611 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31b0f60 0x5561e31b02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e3be00640 1 -- 172.21.15.55:0/2145958611 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31fa650 msgr2=0x5561e31fbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e3be00640 1 --2- 172.21.15.55:0/2145958611 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31fa650 0x5561e31fbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e3be00640 1 -- 172.21.15.55:0/2145958611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561e2fa9ef0 con 0x5561e31f9d30 2024-04-02T07:24:25.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e3be00640 1 --2- 172.21.15.55:0/2145958611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31f9d30 0x5561e31b07e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3e2805c6b0 tx=0x7f3e2806a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157fa7ef89d6716f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e2e000640 1 -- 172.21.15.55:0/2145958611 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2800e040 con 0x5561e31f9d30 2024-04-02T07:24:25.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e2e000640 1 -- 172.21.15.55:0/2145958611 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e2806c070 con 0x5561e31f9d30 2024-04-02T07:24:25.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e2e000640 1 -- 172.21.15.55:0/2145958611 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2806c1e0 con 0x5561e31f9d30 2024-04-02T07:24:25.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e46af8000 1 -- 172.21.15.55:0/2145958611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31f9d30 msgr2=0x5561e31b07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e46af8000 1 --2- 172.21.15.55:0/2145958611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31f9d30 0x5561e31b07e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f3e2805c6b0 tx=0x7f3e2806a070 comp rx=0 tx=0).stop 2024-04-02T07:24:25.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e46af8000 1 -- 172.21.15.55:0/2145958611 shutdown_connections 2024-04-02T07:24:25.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e46af8000 1 --2- 172.21.15.55:0/2145958611 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31fa650 0x5561e31fbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e46af8000 1 --2- 172.21.15.55:0/2145958611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31f9d30 0x5561e31b07e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e46af8000 1 --2- 172.21.15.55:0/2145958611 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31b0f60 0x5561e31b02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e46af8000 1 -- 172.21.15.55:0/2145958611 >> 172.21.15.55:0/2145958611 conn(0x5561e31acf10 msgr2=0x5561e31afb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:25.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e46af8000 1 -- 172.21.15.55:0/2145958611 shutdown_connections 2024-04-02T07:24:25.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e46af8000 1 -- 172.21.15.55:0/2145958611 wait complete. 2024-04-02T07:24:25.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e46af8000 1 -- start start 2024-04-02T07:24:25.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e46af8000 1 Processor -- start 2024-04-02T07:24:25.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e46af8000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31b0f60 0x5561e3254f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e46af8000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31f9d30 0x5561e31fe320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e46af8000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31fa650 0x5561e31fe860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e46af8000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561e2fce390 con 0x5561e31fa650 2024-04-02T07:24:25.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e46af8000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561e30017a0 con 0x5561e31f9d30 2024-04-02T07:24:25.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e46af8000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561e3007010 con 0x5561e31b0f60 2024-04-02T07:24:25.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.566+0000 7f3e46af8000 10 client.0 _ll_register_callbacks cb 0x5561e30780c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:24:25.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e40c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31b0f60 0x5561e3254f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e3be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31f9d30 0x5561e31fe320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e3be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31f9d30 0x5561e31fe320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:44434/0 (socket says 172.21.15.55:44434) 2024-04-02T07:24:25.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e3be00640 1 -- 172.21.15.55:0/2942487320 learned_addr learned my addr 172.21.15.55:0/2942487320 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:25.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e41600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31fa650 0x5561e31fe860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e40c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31b0f60 0x5561e3254f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:35180/0 (socket says 172.21.15.55:35180) 2024-04-02T07:24:25.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e40c00640 1 -- 172.21.15.55:0/2942487320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31f9d30 msgr2=0x5561e31fe320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e40c00640 1 --2- 172.21.15.55:0/2942487320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31f9d30 0x5561e31fe320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e40c00640 1 -- 172.21.15.55:0/2942487320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31fa650 msgr2=0x5561e31fe860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e40c00640 1 --2- 172.21.15.55:0/2942487320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31fa650 0x5561e31fe860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e40c00640 1 -- 172.21.15.55:0/2942487320 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561e2fc3ba0 con 0x5561e31b0f60 2024-04-02T07:24:25.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e3be00640 1 --2- 172.21.15.55:0/2942487320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31f9d30 0x5561e31fe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:24:25.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e40c00640 1 --2- 172.21.15.55:0/2942487320 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31b0f60 0x5561e3254f90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3e30000f70 tx=0x7f3e30000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dee6184e2d108dd server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e22000640 10 client.0 ms_handle_connect on v2:172.21.15.106:3301/0 2024-04-02T07:24:25.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e22000640 1 -- 172.21.15.55:0/2942487320 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e30026280 con 0x5561e31b0f60 2024-04-02T07:24:25.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e22000640 1 -- 172.21.15.55:0/2942487320 <== mon.2 v2:172.21.15.106:3301/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e300263e0 con 0x5561e31b0f60 2024-04-02T07:24:25.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e46af8000 1 -- 172.21.15.55:0/2942487320 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561e2fbb5f0 con 0x5561e31b0f60 2024-04-02T07:24:25.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e22000640 1 -- 172.21.15.55:0/2942487320 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e300265a0 con 0x5561e31b0f60 2024-04-02T07:24:25.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e46af8000 10 client.5348 fetch_fsmap learned FSMap version 25 2024-04-02T07:24:25.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e46af8000 1 -- 172.21.15.55:0/2942487320 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x5561e2f9da60 con 0x5561e31b0f60 2024-04-02T07:24:25.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e22000640 1 -- 172.21.15.55:0/2942487320 <== mon.2 v2:172.21.15.106:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561e2fbb5f0 con 0x5561e31b0f60 2024-04-02T07:24:25.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e22000640 1 -- 172.21.15.55:0/2942487320 <== mon.2 v2:172.21.15.106:3301/0 5 ==== fsmap(e 25) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3e3001f070 con 0x5561e31b0f60 2024-04-02T07:24:25.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e46af8000 10 client.5348 fetch_fsmap finished waiting for FSMap version 25 2024-04-02T07:24:25.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e46af8000 10 client.5348 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-04-02T07:24:25.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e46af8000 20 client.5348 populate_metadata read hostname 'smithi055' 2024-04-02T07:24:25.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e46af8000 1 --2- 172.21.15.55:0/2942487320 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x5561e31feda0 0x5561e31ff180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e46af8000 4 client.5348 mds_command: new command op to 5655 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-02T07:24:25.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e46af8000 1 -- 172.21.15.55:0/2942487320 --> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x5561e2fbd410 con 0x5561e31feda0 2024-04-02T07:24:25.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e3be00640 1 --2- 172.21.15.55:0/2942487320 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x5561e31feda0 0x5561e31ff180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e22000640 10 client.5348 ms_handle_connect on v2:172.21.15.106:6834/1720558250 2024-04-02T07:24:25.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e3be00640 1 --2- 172.21.15.55:0/2942487320 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x5561e31feda0 0x5561e31ff180 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b512a6f1e2d4dee1 server_cookie=a5e180b2580d00cb in_seq=0 out_seq=0 2024-04-02T07:24:25.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e22000640 1 -- 172.21.15.55:0/2942487320 <== mds.0 v2:172.21.15.106:6834/1720558250 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5561e2fbd410 con 0x5561e31feda0 2024-04-02T07:24:25.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e22000640 10 client.5348 handle_command_reply: tid=0 2024-04-02T07:24:25.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e46af8000 1 client.5348 shutdown 2024-04-02T07:24:25.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e46af8000 1 -- 172.21.15.55:0/2942487320 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31b0f60 msgr2=0x5561e3254f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e46af8000 1 --2- 172.21.15.55:0/2942487320 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31b0f60 0x5561e3254f90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3e30000f70 tx=0x7f3e30000ee0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e46af8000 1 -- 172.21.15.55:0/2942487320 shutdown_connections 2024-04-02T07:24:25.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e46af8000 1 --2- 172.21.15.55:0/2942487320 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5561e31fa650 0x5561e31fe860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e46af8000 1 --2- 172.21.15.55:0/2942487320 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5561e31f9d30 0x5561e31fe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e46af8000 1 --2- 172.21.15.55:0/2942487320 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x5561e31feda0 0x5561e31ff180 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e46af8000 1 --2- 172.21.15.55:0/2942487320 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5561e31b0f60 0x5561e3254f90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e22000640 0 client.5348 ms_handle_reset on v2:172.21.15.106:6834/1720558250 2024-04-02T07:24:25.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.570+0000 7f3e46af8000 1 -- 172.21.15.55:0/2942487320 >> 172.21.15.55:0/2942487320 conn(0x5561e31acf10 msgr2=0x5561e31b0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:25.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.574+0000 7f3e46af8000 1 -- 172.21.15.55:0/2942487320 shutdown_connections 2024-04-02T07:24:25.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.574+0000 7f3e46af8000 1 -- 172.21.15.55:0/2942487320 wait complete. 2024-04-02T07:24:25.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.574+0000 7f3e46af8000 20 client.5348 trim_cache size 0 max 16384 2024-04-02T07:24:25.579 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:24:25.579 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-04-02T07:24:25.579 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "11c56eb4-ff19-48ed-9a7d-fc048932085b", 2024-04-02T07:24:25.579 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-04-02T07:24:25.580 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:24:25.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.574+0000 7f3e43600640 1 -- 172.21.15.55:0/975573972 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3e1c066690 msgr2=0x7f3e1c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.574+0000 7f3e43600640 1 --2- 172.21.15.55:0/975573972 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3e1c066690 0x7f3e1c068b50 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3e30005890 tx=0x7f3e30009040 comp rx=0 tx=0).stop 2024-04-02T07:24:25.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.574+0000 7f3e43600640 1 -- 172.21.15.55:0/975573972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e3c0cd430 msgr2=0x7f3e3c0c4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.574+0000 7f3e43600640 1 --2- 172.21.15.55:0/975573972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e3c0cd430 0x7f3e3c0c4210 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f3e2800c430 tx=0x7f3e2800c8f0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.574+0000 7f3e43600640 1 -- 172.21.15.55:0/975573972 shutdown_connections 2024-04-02T07:24:25.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.574+0000 7f3e43600640 1 --2- 172.21.15.55:0/975573972 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3e1c066690 0x7f3e1c068b50 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.574+0000 7f3e43600640 1 --2- 172.21.15.55:0/975573972 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3e3c15d450 0x7f3e3c0c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.574+0000 7f3e43600640 1 --2- 172.21.15.55:0/975573972 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3e3c0cd430 0x7f3e3c0c4210 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.574+0000 7f3e43600640 1 --2- 172.21.15.55:0/975573972 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3e3c0ccf80 0x7f3e3c151eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.574+0000 7f3e43600640 1 -- 172.21.15.55:0/975573972 >> 172.21.15.55:0/975573972 conn(0x7f3e3c0d0700 msgr2=0x7f3e3c06f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:25.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.574+0000 7f3e43600640 1 -- 172.21.15.55:0/975573972 shutdown_connections 2024-04-02T07:24:25.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.574+0000 7f3e43600640 1 -- 172.21.15.55:0/975573972 wait complete. 2024-04-02T07:24:25.582 INFO:tasks.ceph.mds.b.smithi106.stderr:2024-04-02T07:24:25.572+0000 7f2e68a00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5835=0-4194304@1} caps={5835=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5835 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x557664428100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-02T07:24:25.595 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:25.596 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-02T07:24:25.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.734+0000 7fe712600640 1 Processor -- start 2024-04-02T07:24:25.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.734+0000 7fe712600640 1 -- start start 2024-04-02T07:24:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.734+0000 7fe712600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe70c0709b0 0x7fe70c0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.734+0000 7fe712600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70c15e3a0 con 0x7fe70c144260 2024-04-02T07:24:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe712600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe70c15e5f0 con 0x7fe70c0b2fd0 2024-04-02T07:24:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe712600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe70c0b37c0 con 0x7fe70c0709b0 2024-04-02T07:24:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70b400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe70c144260 0x7fe70c0702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45974/0 (socket says 172.21.15.55:45974) 2024-04-02T07:24:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70b400640 1 -- 172.21.15.55:0/2073401931 learned_addr learned my addr 172.21.15.55:0/2073401931 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:25.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe703e00640 1 --2- 172.21.15.55:0/2073401931 >> v2:172.21.15.106:3300/0 conn(0x7fe70c0709b0 0x7fe70c0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70aa00640 1 -- 172.21.15.55:0/2073401931 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1013614555 0 0) 0x7fe70c15e3a0 con 0x7fe70c144260 2024-04-02T07:24:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70aa00640 1 -- 172.21.15.55:0/2073401931 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe6f0003530 con 0x7fe70c144260 2024-04-02T07:24:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70aa00640 1 -- 172.21.15.55:0/2073401931 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 589360720 0 0) 0x7fe6f0003530 con 0x7fe70c144260 2024-04-02T07:24:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70aa00640 1 -- 172.21.15.55:0/2073401931 >> v2:172.21.15.106:3300/0 conn(0x7fe70c0709b0 msgr2=0x7fe70c0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70aa00640 1 --2- 172.21.15.55:0/2073401931 >> v2:172.21.15.106:3300/0 conn(0x7fe70c0709b0 0x7fe70c0b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70aa00640 1 -- 172.21.15.55:0/2073401931 >> v1:172.21.15.106:6789/0 conn(0x7fe70c0b2fd0 legacy=0x7fe70c0b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70aa00640 1 -- 172.21.15.55:0/2073401931 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c15e8d0 con 0x7fe70c144260 2024-04-02T07:24:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70aa00640 1 -- 172.21.15.55:0/2073401931 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fe6fc001680 con 0x7fe70c144260 2024-04-02T07:24:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70aa00640 1 -- 172.21.15.55:0/2073401931 >> v1:172.21.15.55:6789/0 conn(0x7fe70c144260 legacy=0x7fe70c0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70aa00640 1 --2- 172.21.15.55:0/2073401931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6f0003980 0x7fe6f0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70aa00640 1 --2- 172.21.15.55:0/2073401931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6f00047d0 0x7fe6f0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70aa00640 1 --2- 172.21.15.55:0/2073401931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f0005190 0x7fe6f000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70aa00640 1 -- 172.21.15.55:0/2073401931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0b37c0 con 0x7fe6f0005190 2024-04-02T07:24:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70aa00640 1 -- 172.21.15.55:0/2073401931 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f000c030 con 0x7fe6f00047d0 2024-04-02T07:24:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70aa00640 1 -- 172.21.15.55:0/2073401931 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6f000c1f0 con 0x7fe6f0003980 2024-04-02T07:24:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70be00640 1 --2- 172.21.15.55:0/2073401931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f0005190 0x7fe6f000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70b400640 1 --2- 172.21.15.55:0/2073401931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6f0003980 0x7fe6f0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe703e00640 1 --2- 172.21.15.55:0/2073401931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6f00047d0 0x7fe6f0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70be00640 1 -- 172.21.15.55:0/2073401931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6f0003980 msgr2=0x7fe6f0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70be00640 1 --2- 172.21.15.55:0/2073401931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6f0003980 0x7fe6f0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70be00640 1 -- 172.21.15.55:0/2073401931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6f00047d0 msgr2=0x7fe6f0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70be00640 1 --2- 172.21.15.55:0/2073401931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe6f00047d0 0x7fe6f0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.738+0000 7fe70be00640 1 -- 172.21.15.55:0/2073401931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6f0003530 con 0x7fe6f0005190 2024-04-02T07:24:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.742+0000 7fe70be00640 1 -- 172.21.15.55:0/2073401931 reap_dead start 2024-04-02T07:24:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.742+0000 7fe70be00640 1 --2- 172.21.15.55:0/2073401931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f0005190 0x7fe6f000b990 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe704001e70 tx=0x7fe70401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc1f81fb20a88d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.742+0000 7fe70aa00640 1 -- 172.21.15.55:0/2073401931 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe704003b80 con 0x7fe6f0005190 2024-04-02T07:24:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.742+0000 7fe70aa00640 1 -- 172.21.15.55:0/2073401931 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe704003d20 con 0x7fe6f0005190 2024-04-02T07:24:25.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.742+0000 7fe70aa00640 1 -- 172.21.15.55:0/2073401931 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe704005260 con 0x7fe6f0005190 2024-04-02T07:24:25.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.742+0000 7fe712600640 1 -- 172.21.15.55:0/2073401931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f0005190 msgr2=0x7fe6f000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.742+0000 7fe712600640 1 --2- 172.21.15.55:0/2073401931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f0005190 0x7fe6f000b990 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fe704001e70 tx=0x7fe70401c780 comp rx=0 tx=0).stop 2024-04-02T07:24:25.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.742+0000 7fe712600640 1 -- 172.21.15.55:0/2073401931 shutdown_connections 2024-04-02T07:24:25.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.742+0000 7fe712600640 1 --2- 172.21.15.55:0/2073401931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f0005190 0x7fe6f000b990 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.742+0000 7fe712600640 1 -- 172.21.15.55:0/2073401931 >> 172.21.15.55:0/2073401931 conn(0x7fe70c06a390 msgr2=0x7fe70c0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:25.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.742+0000 7fe712600640 1 -- 172.21.15.55:0/2073401931 shutdown_connections 2024-04-02T07:24:25.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.742+0000 7fe712600640 1 -- 172.21.15.55:0/2073401931 wait complete. 2024-04-02T07:24:25.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.742+0000 7fe712600640 1 Processor -- start 2024-04-02T07:24:25.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.742+0000 7fe712600640 1 -- start start 2024-04-02T07:24:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe712600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f0005190 0x7fe70c15c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe712600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe70c15cdd0 0x7fe70c0c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe712600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe70c0c86c0 0x7fe70c0c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe712600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c1597e0 con 0x7fe6f0005190 2024-04-02T07:24:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe712600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c0c9080 con 0x7fe70c0c86c0 2024-04-02T07:24:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe712600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70c1f23d0 con 0x7fe70c15cdd0 2024-04-02T07:24:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe70b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f0005190 0x7fe70c15c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe70b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f0005190 0x7fe70c15c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54386/0 (socket says 172.21.15.55:54386) 2024-04-02T07:24:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe70b400640 1 -- 172.21.15.55:0/3935088865 learned_addr learned my addr 172.21.15.55:0/3935088865 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe703e00640 1 --2- 172.21.15.55:0/3935088865 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe70c15cdd0 0x7fe70c0c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe70be00640 1 --2- 172.21.15.55:0/3935088865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe70c0c86c0 0x7fe70c0c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe70b400640 1 -- 172.21.15.55:0/3935088865 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe70c15cdd0 msgr2=0x7fe70c0c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe70b400640 1 --2- 172.21.15.55:0/3935088865 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe70c15cdd0 0x7fe70c0c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe70b400640 1 -- 172.21.15.55:0/3935088865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe70c0c86c0 msgr2=0x7fe70c0c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe70b400640 1 --2- 172.21.15.55:0/3935088865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe70c0c86c0 0x7fe70c0c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe70b400640 1 -- 172.21.15.55:0/3935088865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe70c15d400 con 0x7fe6f0005190 2024-04-02T07:24:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe70b400640 1 --2- 172.21.15.55:0/3935088865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f0005190 0x7fe70c15c890 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc007290 tx=0x7fe6fc007690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe703400640 1 -- 172.21.15.55:0/3935088865 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc0077c0 con 0x7fe6f0005190 2024-04-02T07:24:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe703400640 1 -- 172.21.15.55:0/3935088865 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6fc00f9c0 con 0x7fe6f0005190 2024-04-02T07:24:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe703400640 1 -- 172.21.15.55:0/3935088865 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc00fd90 con 0x7fe6f0005190 2024-04-02T07:24:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe712600640 1 -- 172.21.15.55:0/3935088865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe70c15d6e0 con 0x7fe6f0005190 2024-04-02T07:24:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.746+0000 7fe712600640 1 -- 172.21.15.55:0/3935088865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70c1f2970 con 0x7fe6f0005190 2024-04-02T07:24:25.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe703400640 1 -- 172.21.15.55:0/3935088865 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe6fc01d460 con 0x7fe6f0005190 2024-04-02T07:24:25.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe703400640 1 --2- 172.21.15.55:0/3935088865 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe6e8066690 0x7fe6e8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe703400640 1 -- 172.21.15.55:0/3935088865 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6fc084160 con 0x7fe6f0005190 2024-04-02T07:24:25.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe703e00640 1 --2- 172.21.15.55:0/3935088865 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe6e8066690 0x7fe6e8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe715a2c000 1 Processor -- start 2024-04-02T07:24:25.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe715a2c000 1 -- start start 2024-04-02T07:24:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe703e00640 1 --2- 172.21.15.55:0/3935088865 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe6e8066690 0x7fe6e8068b50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe70c15e030 tx=0x7fe6f4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe715a2c000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe39a70 0x55663fe39e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe715a2c000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fe3a390 0x55663fded4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe715a2c000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fdeda00 0x55663fdedde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe715a2c000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55663fcb8630 con 0x55663fe39a70 2024-04-02T07:24:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe715a2c000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55663fc45bd0 con 0x55663fdeda00 2024-04-02T07:24:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe715a2c000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55663fc431a0 con 0x55663fe3a390 2024-04-02T07:24:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe70b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe39a70 0x55663fe39e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe70b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe39a70 0x55663fe39e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54400/0 (socket says 172.21.15.55:54400) 2024-04-02T07:24:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe70b400640 1 -- 172.21.15.55:0/2972122862 learned_addr learned my addr 172.21.15.55:0/2972122862 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe70be00640 1 --2- 172.21.15.55:0/2972122862 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fdeda00 0x55663fdedde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe703e00640 1 --2- 172.21.15.55:0/2972122862 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fe3a390 0x55663fded4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe70b400640 1 -- 172.21.15.55:0/2972122862 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fe3a390 msgr2=0x55663fded4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe70b400640 1 --2- 172.21.15.55:0/2972122862 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fe3a390 0x55663fded4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe70b400640 1 -- 172.21.15.55:0/2972122862 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fdeda00 msgr2=0x55663fdedde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe70b400640 1 --2- 172.21.15.55:0/2972122862 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fdeda00 0x55663fdedde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe70b400640 1 -- 172.21.15.55:0/2972122862 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55663f93ae20 con 0x55663fe39a70 2024-04-02T07:24:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe70b400640 1 --2- 172.21.15.55:0/2972122862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe39a70 0x55663fe39e50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc082740 tx=0x7fe6fc001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7547fd7bbdb45ae server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe6fbe00640 1 -- 172.21.15.55:0/2972122862 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc059050 con 0x55663fe39a70 2024-04-02T07:24:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe6fbe00640 1 -- 172.21.15.55:0/2972122862 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6fc05d610 con 0x55663fe39a70 2024-04-02T07:24:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.750+0000 7fe6fbe00640 1 -- 172.21.15.55:0/2972122862 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc051930 con 0x55663fe39a70 2024-04-02T07:24:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 -- 172.21.15.55:0/2972122862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe39a70 msgr2=0x55663fe39e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 --2- 172.21.15.55:0/2972122862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe39a70 0x55663fe39e50 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc082740 tx=0x7fe6fc001a10 comp rx=0 tx=0).stop 2024-04-02T07:24:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 -- 172.21.15.55:0/2972122862 shutdown_connections 2024-04-02T07:24:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 --2- 172.21.15.55:0/2972122862 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fdeda00 0x55663fdedde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 --2- 172.21.15.55:0/2972122862 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fe3a390 0x55663fded4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 --2- 172.21.15.55:0/2972122862 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe39a70 0x55663fe39e50 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 -- 172.21.15.55:0/2972122862 >> 172.21.15.55:0/2972122862 conn(0x55663fbee160 msgr2=0x55663fe1c820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:25.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 -- 172.21.15.55:0/2972122862 shutdown_connections 2024-04-02T07:24:25.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 -- 172.21.15.55:0/2972122862 wait complete. 2024-04-02T07:24:25.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 -- start start 2024-04-02T07:24:25.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 Processor -- start 2024-04-02T07:24:25.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fdeda00 0x55663fdf67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fe39a70 0x55663fe1da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fe3a390 0x55663fe1df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55663fc3ea90 con 0x55663fdeda00 2024-04-02T07:24:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55663fbddd40 con 0x55663fe39a70 2024-04-02T07:24:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55663fbfbf30 con 0x55663fe3a390 2024-04-02T07:24:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 10 client.0 _ll_register_callbacks cb 0x55663fca0810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:24:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe70b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fdeda00 0x55663fdf67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe70b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fdeda00 0x55663fdf67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54414/0 (socket says 172.21.15.55:54414) 2024-04-02T07:24:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe70b400640 1 -- 172.21.15.55:0/2552673143 learned_addr learned my addr 172.21.15.55:0/2552673143 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe703e00640 1 --2- 172.21.15.55:0/2552673143 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fe39a70 0x55663fe1da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe70be00640 1 --2- 172.21.15.55:0/2552673143 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fe3a390 0x55663fe1df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe70b400640 1 -- 172.21.15.55:0/2552673143 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fe3a390 msgr2=0x55663fe1df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe70b400640 1 --2- 172.21.15.55:0/2552673143 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fe3a390 0x55663fe1df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe70b400640 1 -- 172.21.15.55:0/2552673143 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fe39a70 msgr2=0x55663fe1da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe70b400640 1 --2- 172.21.15.55:0/2552673143 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fe39a70 0x55663fe1da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe70b400640 1 -- 172.21.15.55:0/2552673143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70c1f2970 con 0x55663fdeda00 2024-04-02T07:24:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe70b400640 1 --2- 172.21.15.55:0/2552673143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fdeda00 0x55663fdf67e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00f5a0 tx=0x7fe6fc004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb55e780fc5076d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe6f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:24:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe6f8c00640 1 -- 172.21.15.55:0/2552673143 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6fc059050 con 0x55663fdeda00 2024-04-02T07:24:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe6f8c00640 1 -- 172.21.15.55:0/2552673143 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6fc0822f0 con 0x55663fdeda00 2024-04-02T07:24:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 -- 172.21.15.55:0/2552673143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55663fc3d3e0 con 0x55663fdeda00 2024-04-02T07:24:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe6f8c00640 1 -- 172.21.15.55:0/2552673143 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe6fc0730d0 con 0x55663fdeda00 2024-04-02T07:24:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 10 client.5898 fetch_fsmap learned FSMap version 25 2024-04-02T07:24:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 -- 172.21.15.55:0/2552673143 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55663fc03aa0 con 0x55663fdeda00 2024-04-02T07:24:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe6f8c00640 1 -- 172.21.15.55:0/2552673143 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6fc077080 con 0x55663fdeda00 2024-04-02T07:24:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe6f8c00640 1 -- 172.21.15.55:0/2552673143 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 25) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fe6fc012070 con 0x55663fdeda00 2024-04-02T07:24:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 10 client.5898 fetch_fsmap finished waiting for FSMap version 25 2024-04-02T07:24:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 10 client.5898 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-04-02T07:24:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 20 client.5898 populate_metadata read hostname 'smithi055' 2024-04-02T07:24:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 --2- 172.21.15.55:0/2552673143 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x55663fe40e00 0x55663fe411e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 4 client.5898 mds_command: new command op to 5655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:24:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.754+0000 7fe715a2c000 1 -- 172.21.15.55:0/2552673143 --> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55663fc0ed00 con 0x55663fe40e00 2024-04-02T07:24:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.758+0000 7fe703e00640 1 --2- 172.21.15.55:0/2552673143 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x55663fe40e00 0x55663fe411e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.758+0000 7fe703e00640 1 --2- 172.21.15.55:0/2552673143 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x55663fe40e00 0x55663fe411e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed3adbb1b1739ea server_cookie=5e118b32ab4ebcd5 in_seq=0 out_seq=0 2024-04-02T07:24:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.758+0000 7fe6f8c00640 10 client.5898 ms_handle_connect on v2:172.21.15.106:6834/1720558250 2024-04-02T07:24:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.758+0000 7fe6f8c00640 1 -- 172.21.15.55:0/2552673143 <== mds.0 v2:172.21.15.106:6834/1720558250 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55663fc0ed00 con 0x55663fe40e00 2024-04-02T07:24:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.758+0000 7fe6f8c00640 10 client.5898 handle_command_reply: tid=0 2024-04-02T07:24:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.758+0000 7fe715a2c000 1 client.5898 shutdown 2024-04-02T07:24:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.758+0000 7fe715a2c000 1 -- 172.21.15.55:0/2552673143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fdeda00 msgr2=0x55663fdf67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.758+0000 7fe715a2c000 1 --2- 172.21.15.55:0/2552673143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fdeda00 0x55663fdf67e0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc00f5a0 tx=0x7fe6fc004f90 comp rx=0 tx=0).stop 2024-04-02T07:24:25.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.758+0000 7fe715a2c000 1 -- 172.21.15.55:0/2552673143 shutdown_connections 2024-04-02T07:24:25.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.758+0000 7fe715a2c000 1 --2- 172.21.15.55:0/2552673143 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x55663fe40e00 0x55663fe411e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.758+0000 7fe715a2c000 1 --2- 172.21.15.55:0/2552673143 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fe3a390 0x55663fe1df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.758+0000 7fe715a2c000 1 --2- 172.21.15.55:0/2552673143 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fe39a70 0x55663fe1da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.758+0000 7fe715a2c000 1 --2- 172.21.15.55:0/2552673143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fdeda00 0x55663fdf67e0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.758+0000 7fe715a2c000 1 -- 172.21.15.55:0/2552673143 >> 172.21.15.55:0/2552673143 conn(0x55663fbee160 msgr2=0x55663fdecbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:25.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.758+0000 7fe6f8c00640 0 client.5898 ms_handle_reset on v2:172.21.15.106:6834/1720558250 2024-04-02T07:24:25.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.758+0000 7fe715a2c000 1 -- 172.21.15.55:0/2552673143 shutdown_connections 2024-04-02T07:24:25.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.758+0000 7fe715a2c000 1 -- 172.21.15.55:0/2552673143 wait complete. 2024-04-02T07:24:25.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.758+0000 7fe715a2c000 20 client.5898 trim_cache size 0 max 16384 2024-04-02T07:24:25.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe715a2c000 1 Processor -- start 2024-04-02T07:24:25.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe715a2c000 1 -- start start 2024-04-02T07:24:25.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe715a2c000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fdeda00 0x55663fdf58d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe715a2c000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe39a70 0x55663fdf5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe715a2c000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fe3a390 0x55663fdecc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe715a2c000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55663f8fbaa0 con 0x55663fe39a70 2024-04-02T07:24:25.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe715a2c000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55663fbffc60 con 0x55663fdeda00 2024-04-02T07:24:25.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe715a2c000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55663fc415f0 con 0x55663fe3a390 2024-04-02T07:24:25.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe703e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe39a70 0x55663fdf5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe703e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe39a70 0x55663fdf5e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54426/0 (socket says 172.21.15.55:54426) 2024-04-02T07:24:25.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe703e00640 1 -- 172.21.15.55:0/732384911 learned_addr learned my addr 172.21.15.55:0/732384911 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe70be00640 1 --2- 172.21.15.55:0/732384911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fe3a390 0x55663fdecc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe70b400640 1 --2- 172.21.15.55:0/732384911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fdeda00 0x55663fdf58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe703e00640 1 -- 172.21.15.55:0/732384911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fe3a390 msgr2=0x55663fdecc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe703e00640 1 --2- 172.21.15.55:0/732384911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fe3a390 0x55663fdecc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe703e00640 1 -- 172.21.15.55:0/732384911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fdeda00 msgr2=0x55663fdf58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe703e00640 1 --2- 172.21.15.55:0/732384911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fdeda00 0x55663fdf58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe703e00640 1 -- 172.21.15.55:0/732384911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55663fbe9df0 con 0x55663fe39a70 2024-04-02T07:24:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe70be00640 1 --2- 172.21.15.55:0/732384911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fe3a390 0x55663fdecc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe70b400640 1 --2- 172.21.15.55:0/732384911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fdeda00 0x55663fdf58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe703e00640 1 --2- 172.21.15.55:0/732384911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe39a70 0x55663fdf5e10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe6f402ca70 tx=0x7fe6f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eef57eb9b2d3555e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe700c00640 1 -- 172.21.15.55:0/732384911 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4027040 con 0x55663fe39a70 2024-04-02T07:24:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe700c00640 1 -- 172.21.15.55:0/732384911 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6f4019070 con 0x55663fe39a70 2024-04-02T07:24:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe700c00640 1 -- 172.21.15.55:0/732384911 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6f4021540 con 0x55663fe39a70 2024-04-02T07:24:25.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe715a2c000 1 -- 172.21.15.55:0/732384911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe39a70 msgr2=0x55663fdf5e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe715a2c000 1 --2- 172.21.15.55:0/732384911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe39a70 0x55663fdf5e10 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe6f402ca70 tx=0x7fe6f4017000 comp rx=0 tx=0).stop 2024-04-02T07:24:25.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe715a2c000 1 -- 172.21.15.55:0/732384911 shutdown_connections 2024-04-02T07:24:25.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe715a2c000 1 --2- 172.21.15.55:0/732384911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fe3a390 0x55663fdecc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe715a2c000 1 --2- 172.21.15.55:0/732384911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe39a70 0x55663fdf5e10 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe715a2c000 1 --2- 172.21.15.55:0/732384911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fdeda00 0x55663fdf58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe715a2c000 1 -- 172.21.15.55:0/732384911 >> 172.21.15.55:0/732384911 conn(0x55663fbee160 msgr2=0x55663fdf4fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:25.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe715a2c000 1 -- 172.21.15.55:0/732384911 shutdown_connections 2024-04-02T07:24:25.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe715a2c000 1 -- 172.21.15.55:0/732384911 wait complete. 2024-04-02T07:24:25.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe715a2c000 1 -- start start 2024-04-02T07:24:25.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.774+0000 7fe715a2c000 1 Processor -- start 2024-04-02T07:24:25.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fdeda00 0x55663fdf00f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fe39a70 0x55663fdf0630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe3a390 0x55663fdf0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55663fc82170 con 0x55663fe3a390 2024-04-02T07:24:25.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55663fcf7ec0 con 0x55663fe39a70 2024-04-02T07:24:25.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55663fc08ee0 con 0x55663fdeda00 2024-04-02T07:24:25.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 10 client.0 _ll_register_callbacks cb 0x7fe6fc00fef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:24:25.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe70be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe3a390 0x55663fdf0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe70be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe3a390 0x55663fdf0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54428/0 (socket says 172.21.15.55:54428) 2024-04-02T07:24:25.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe70be00640 1 -- 172.21.15.55:0/2294503017 learned_addr learned my addr 172.21.15.55:0/2294503017 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:25.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe703e00640 1 --2- 172.21.15.55:0/2294503017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fe39a70 0x55663fdf0630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe70b400640 1 --2- 172.21.15.55:0/2294503017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fdeda00 0x55663fdf00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe70be00640 1 -- 172.21.15.55:0/2294503017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fdeda00 msgr2=0x55663fdf00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe70be00640 1 --2- 172.21.15.55:0/2294503017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fdeda00 0x55663fdf00f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe70be00640 1 -- 172.21.15.55:0/2294503017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fe39a70 msgr2=0x55663fdf0630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:25.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe70be00640 1 --2- 172.21.15.55:0/2294503017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fe39a70 0x55663fdf0630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe70be00640 1 -- 172.21.15.55:0/2294503017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55663fbdd960 con 0x55663fe3a390 2024-04-02T07:24:25.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe70be00640 1 --2- 172.21.15.55:0/2294503017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe3a390 0x55663fdf0b70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe70401c5b0 tx=0x7fe704019520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95cb7884eb7f4aa4 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:25.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe6f8c00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:24:25.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe6f8c00640 1 -- 172.21.15.55:0/2294503017 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7040ac040 con 0x55663fe3a390 2024-04-02T07:24:25.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe6f8c00640 1 -- 172.21.15.55:0/2294503017 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe704005440 con 0x55663fe3a390 2024-04-02T07:24:25.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 1 -- 172.21.15.55:0/2294503017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55663fbfb970 con 0x55663fe3a390 2024-04-02T07:24:25.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe6f8c00640 1 -- 172.21.15.55:0/2294503017 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe704005600 con 0x55663fe3a390 2024-04-02T07:24:25.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 10 client.5904 fetch_fsmap learned FSMap version 25 2024-04-02T07:24:25.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 1 -- 172.21.15.55:0/2294503017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55663fb6be50 con 0x55663fe3a390 2024-04-02T07:24:25.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe6f8c00640 1 -- 172.21.15.55:0/2294503017 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55663fbfb970 con 0x55663fe3a390 2024-04-02T07:24:25.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe6f8c00640 1 -- 172.21.15.55:0/2294503017 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 25) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fe7040b2040 con 0x55663fe3a390 2024-04-02T07:24:25.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 10 client.5904 fetch_fsmap finished waiting for FSMap version 25 2024-04-02T07:24:25.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 10 client.5904 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-04-02T07:24:25.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 20 client.5904 populate_metadata read hostname 'smithi055' 2024-04-02T07:24:25.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 1 --2- 172.21.15.55:0/2294503017 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x55663fe94c40 0x55663fe95050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:25.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 4 client.5904 mds_command: new command op to 5655 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-02T07:24:25.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 1 -- 172.21.15.55:0/2294503017 --> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55663fc6da20 con 0x55663fe94c40 2024-04-02T07:24:25.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe70b400640 1 --2- 172.21.15.55:0/2294503017 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x55663fe94c40 0x55663fe95050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:25.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe70b400640 1 --2- 172.21.15.55:0/2294503017 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x55663fe94c40 0x55663fe95050 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff0ca521322bb7f0 server_cookie=305dc06ff493a549 in_seq=0 out_seq=0 2024-04-02T07:24:25.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe6f8c00640 10 client.5904 ms_handle_connect on v2:172.21.15.106:6834/1720558250 2024-04-02T07:24:25.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe6f8c00640 1 -- 172.21.15.55:0/2294503017 <== mds.0 v2:172.21.15.106:6834/1720558250 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x55663fc6da20 con 0x55663fe94c40 2024-04-02T07:24:25.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe6f8c00640 10 client.5904 handle_command_reply: tid=0 2024-04-02T07:24:25.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 1 client.5904 shutdown 2024-04-02T07:24:25.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 1 -- 172.21.15.55:0/2294503017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe3a390 msgr2=0x55663fdf0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 1 --2- 172.21.15.55:0/2294503017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe3a390 0x55663fdf0b70 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe70401c5b0 tx=0x7fe704019520 comp rx=0 tx=0).stop 2024-04-02T07:24:25.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 1 -- 172.21.15.55:0/2294503017 shutdown_connections 2024-04-02T07:24:25.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 1 --2- 172.21.15.55:0/2294503017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55663fe3a390 0x55663fdf0b70 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 1 --2- 172.21.15.55:0/2294503017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55663fe39a70 0x55663fdf0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 1 --2- 172.21.15.55:0/2294503017 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x55663fe94c40 0x55663fe95050 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 1 --2- 172.21.15.55:0/2294503017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55663fdeda00 0x55663fdf00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe715a2c000 1 -- 172.21.15.55:0/2294503017 >> 172.21.15.55:0/2294503017 conn(0x55663fbee160 msgr2=0x55663fe47910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:25.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.778+0000 7fe6f8c00640 0 client.5904 ms_handle_reset on v2:172.21.15.106:6834/1720558250 2024-04-02T07:24:25.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.782+0000 7fe715a2c000 1 -- 172.21.15.55:0/2294503017 shutdown_connections 2024-04-02T07:24:25.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.782+0000 7fe715a2c000 1 -- 172.21.15.55:0/2294503017 wait complete. 2024-04-02T07:24:25.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.782+0000 7fe715a2c000 20 client.5904 trim_cache size 0 max 16384 2024-04-02T07:24:25.788 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:24:25.788 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-02T07:24:25.788 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-04-02T07:24:25.788 INFO:teuthology.orchestra.run.smithi055.stdout: "11c56eb4-ff19-48ed-9a7d-fc048932085b": { 2024-04-02T07:24:25.789 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/", 2024-04-02T07:24:25.789 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "11c56eb4-ff19-48ed-9a7d-fc048932085b", 2024-04-02T07:24:25.789 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive,repair" 2024-04-02T07:24:25.789 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:25.789 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:25.789 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:24:25.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.782+0000 7fe712600640 1 -- 172.21.15.55:0/3935088865 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe6e8066690 msgr2=0x7fe6e8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.782+0000 7fe712600640 1 --2- 172.21.15.55:0/3935088865 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe6e8066690 0x7fe6e8068b50 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe70c15e030 tx=0x7fe6f4009190 comp rx=0 tx=0).stop 2024-04-02T07:24:25.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.782+0000 7fe712600640 1 -- 172.21.15.55:0/3935088865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f0005190 msgr2=0x7fe70c15c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:25.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.782+0000 7fe712600640 1 --2- 172.21.15.55:0/3935088865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f0005190 0x7fe70c15c890 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fe6fc007290 tx=0x7fe6fc007690 comp rx=0 tx=0).stop 2024-04-02T07:24:25.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.782+0000 7fe712600640 1 -- 172.21.15.55:0/3935088865 shutdown_connections 2024-04-02T07:24:25.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.782+0000 7fe712600640 1 --2- 172.21.15.55:0/3935088865 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe6e8066690 0x7fe6e8068b50 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.782+0000 7fe712600640 1 --2- 172.21.15.55:0/3935088865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe70c0c86c0 0x7fe70c0c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.782+0000 7fe712600640 1 --2- 172.21.15.55:0/3935088865 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe70c15cdd0 0x7fe70c0c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.782+0000 7fe712600640 1 --2- 172.21.15.55:0/3935088865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6f0005190 0x7fe70c15c890 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:25.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.782+0000 7fe712600640 1 -- 172.21.15.55:0/3935088865 >> 172.21.15.55:0/3935088865 conn(0x7fe70c06a390 msgr2=0x7fe70c13fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:25.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.782+0000 7fe712600640 1 -- 172.21.15.55:0/3935088865 shutdown_connections 2024-04-02T07:24:25.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:25.782+0000 7fe712600640 1 -- 172.21.15.55:0/3935088865 wait complete. 2024-04-02T07:24:25.803 INFO:tasks.cephfs.filesystem:scrub status for tag:11c56eb4-ff19-48ed-9a7d-fc048932085b - {'path': '/', 'tag': '11c56eb4-ff19-48ed-9a7d-fc048932085b', 'options': 'recursive,repair'} 2024-04-02T07:24:26.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:26.090+0000 7fba54c00640 1 -- 172.21.15.55:0/3661572864 <== mon.0 v2:172.21.15.55:3300/0 7 ==== log(6 entries from seq 1 at 2024-04-02T07:24:25.574501+0000) v1 ==== 1078+0+0 (secure 0 0 0) 0x7fba500563d0 con 0x7fba5815cac0 2024-04-02T07:24:26.095 INFO:teuthology.orchestra.run.smithi055.stdout: cluster: 2024-04-02T07:24:26.095 INFO:teuthology.orchestra.run.smithi055.stdout: id: 642a0456-a2ac-49a4-91a5-3b3449b512da 2024-04-02T07:24:26.095 INFO:teuthology.orchestra.run.smithi055.stdout: health: HEALTH_OK 2024-04-02T07:24:26.095 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:26.095 INFO:teuthology.orchestra.run.smithi055.stdout: services: 2024-04-02T07:24:26.096 INFO:teuthology.orchestra.run.smithi055.stdout: mon: 3 daemons, quorum a,b,c (age 2m) 2024-04-02T07:24:26.096 INFO:teuthology.orchestra.run.smithi055.stdout: mgr: x(active, since 2m), standbys: y 2024-04-02T07:24:26.096 INFO:teuthology.orchestra.run.smithi055.stdout: mds: 1/1 daemons up, 3 standby 2024-04-02T07:24:26.096 INFO:teuthology.orchestra.run.smithi055.stdout: osd: 8 osds: 8 up (since 2m), 8 in (since 2m) 2024-04-02T07:24:26.096 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:26.096 INFO:teuthology.orchestra.run.smithi055.stdout: data: 2024-04-02T07:24:26.096 INFO:teuthology.orchestra.run.smithi055.stdout: volumes: 1/1 healthy 2024-04-02T07:24:26.096 INFO:teuthology.orchestra.run.smithi055.stdout: pools: 3 pools, 97 pgs 2024-04-02T07:24:26.096 INFO:teuthology.orchestra.run.smithi055.stdout: objects: 24 objects, 579 KiB 2024-04-02T07:24:26.096 INFO:teuthology.orchestra.run.smithi055.stdout: usage: 232 MiB used, 720 GiB / 720 GiB avail 2024-04-02T07:24:26.096 INFO:teuthology.orchestra.run.smithi055.stdout: pgs: 97 active+clean 2024-04-02T07:24:26.096 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:26.096 INFO:teuthology.orchestra.run.smithi055.stdout: io: 2024-04-02T07:24:26.096 INFO:teuthology.orchestra.run.smithi055.stdout: client: 1.2 KiB/s wr, 0 op/s rd, 3 op/s wr 2024-04-02T07:24:26.096 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:26.097 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:26.097 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:24:25.574501+0000 mds.b [INF] scrub queued for path: / 2024-04-02T07:24:26.097 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:24:25.574506+0000 mds.b [INF] scrub summary: idle+waiting paths [/] 2024-04-02T07:24:26.097 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:24:25.574512+0000 mds.b [INF] scrub summary: active paths [/] 2024-04-02T07:24:26.097 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:24:25.575380+0000 mds.b [WRN] bad backtrace on inode 0x10000000001(/parent_a/alpha), rewriting it 2024-04-02T07:24:26.097 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:24:25.575388+0000 mds.b [INF] Scrub repaired inode 0x10000000001 (/parent_a/alpha) 2024-04-02T07:24:26.097 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:24:25.575896+0000 mds.b [INF] scrub summary: idle+waiting paths [/] 2024-04-02T07:24:29.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:29.102+0000 7fba54c00640 1 -- 172.21.15.55:0/3661572864 <== mon.0 v2:172.21.15.55:3300/0 8 ==== log(1 entries from seq 7 at 2024-04-02T07:24:27.598495+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7fba50055cd0 con 0x7fba5815cac0 2024-04-02T07:24:29.106 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:24:27.598495+0000 mds.b [INF] scrub summary: idle 2024-04-02T07:24:43.554 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:24:43.557 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:24:55.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:55.805 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.3:0 scrub status 2024-04-02T07:24:55.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c9400640 1 Processor -- start 2024-04-02T07:24:55.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c9400640 1 -- start start 2024-04-02T07:24:55.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c9400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f25c40cc880 0x7f25c406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:55.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c9400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25c4098a10 0x7f25c4098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:55.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c9400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25c4099a70 con 0x7f25c415c130 2024-04-02T07:24:55.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c9400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25c406b5f0 con 0x7f25c40cc880 2024-04-02T07:24:55.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c9400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c406bc90 con 0x7f25c4098a10 2024-04-02T07:24:55.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c8a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f25c415c130 0x7f25c415c5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42030/0 (socket says 172.21.15.55:42030) 2024-04-02T07:24:55.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c8a00640 1 -- 172.21.15.55:0/4070375373 learned_addr learned my addr 172.21.15.55:0/4070375373 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:55.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c3e00640 1 --2- 172.21.15.55:0/4070375373 >> v2:172.21.15.106:3300/0 conn(0x7f25c40cc880 0x7f25c406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:55.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25bb400640 1 --2- 172.21.15.55:0/4070375373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25c4098a10 0x7f25c4098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:55.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c3400640 1 -- 172.21.15.55:0/4070375373 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431918776 0 0) 0x7f25c4099a70 con 0x7f25c415c130 2024-04-02T07:24:55.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c3400640 1 -- 172.21.15.55:0/4070375373 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f25a8003530 con 0x7f25c415c130 2024-04-02T07:24:55.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c3400640 1 -- 172.21.15.55:0/4070375373 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1813185748 0 0) 0x7f25a8003530 con 0x7f25c415c130 2024-04-02T07:24:55.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c3400640 1 -- 172.21.15.55:0/4070375373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25c4098a10 msgr2=0x7f25c4098e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:55.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c3400640 1 --2- 172.21.15.55:0/4070375373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25c4098a10 0x7f25c4098e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:55.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c3400640 1 -- 172.21.15.55:0/4070375373 >> v2:172.21.15.106:3300/0 conn(0x7f25c40cc880 msgr2=0x7f25c406b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:55.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c3400640 1 --2- 172.21.15.55:0/4070375373 >> v2:172.21.15.106:3300/0 conn(0x7f25c40cc880 0x7f25c406b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:55.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c3400640 1 -- 172.21.15.55:0/4070375373 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c40993b0 con 0x7f25c415c130 2024-04-02T07:24:55.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c3400640 1 -- 172.21.15.55:0/4070375373 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f25bc001a00 con 0x7f25c415c130 2024-04-02T07:24:55.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c3400640 1 -- 172.21.15.55:0/4070375373 >> v1:172.21.15.55:6789/0 conn(0x7f25c415c130 legacy=0x7f25c415c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:55.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c3400640 1 --2- 172.21.15.55:0/4070375373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25c4098a10 0x7f25a8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:55.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c3400640 1 --2- 172.21.15.55:0/4070375373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25a8003f00 0x7f25a80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:55.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c3400640 1 --2- 172.21.15.55:0/4070375373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25a8004d10 0x7f25a8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:55.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c3400640 1 -- 172.21.15.55:0/4070375373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c406b5f0 con 0x7f25a8003f00 2024-04-02T07:24:55.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c3400640 1 -- 172.21.15.55:0/4070375373 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c406bc90 con 0x7f25a8004d10 2024-04-02T07:24:55.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c3400640 1 -- 172.21.15.55:0/4070375373 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25a800b990 con 0x7f25c4098a10 2024-04-02T07:24:55.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25bb400640 1 --2- 172.21.15.55:0/4070375373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25a8003f00 0x7f25a80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:55.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c8a00640 1 --2- 172.21.15.55:0/4070375373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25a8004d10 0x7f25a8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:55.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25c3e00640 1 --2- 172.21.15.55:0/4070375373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25c4098a10 0x7f25a8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:55.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25bb400640 1 -- 172.21.15.55:0/4070375373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25c4098a10 msgr2=0x7f25a8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:55.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25bb400640 1 --2- 172.21.15.55:0/4070375373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25c4098a10 0x7f25a8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:55.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.958+0000 7f25bb400640 1 -- 172.21.15.55:0/4070375373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25a8004d10 msgr2=0x7f25a8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:55.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.962+0000 7f25bb400640 1 --2- 172.21.15.55:0/4070375373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25a8004d10 0x7f25a8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:55.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.962+0000 7f25bb400640 1 -- 172.21.15.55:0/4070375373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25a8003530 con 0x7f25a8003f00 2024-04-02T07:24:55.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.962+0000 7f25c3e00640 1 --2- 172.21.15.55:0/4070375373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25c4098a10 0x7f25a8003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:55.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.962+0000 7f25c8a00640 1 --2- 172.21.15.55:0/4070375373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25a8004d10 0x7f25a8005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:55.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.962+0000 7f25bb400640 1 --2- 172.21.15.55:0/4070375373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25a8003f00 0x7f25a80047d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009ae0 tx=0x7f25ac01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bad064f4a3f41fe server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:55.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.962+0000 7f25c3400640 1 -- 172.21.15.55:0/4070375373 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0a5660 con 0x7f25a8003f00 2024-04-02T07:24:55.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.962+0000 7f25c3400640 1 -- 172.21.15.55:0/4070375373 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac0a57c0 con 0x7f25a8003f00 2024-04-02T07:24:55.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.962+0000 7f25c3400640 1 -- 172.21.15.55:0/4070375373 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0a5b70 con 0x7f25a8003f00 2024-04-02T07:24:55.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.962+0000 7f25c9400640 1 -- 172.21.15.55:0/4070375373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25a8003f00 msgr2=0x7f25a80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:55.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.962+0000 7f25c9400640 1 --2- 172.21.15.55:0/4070375373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25a8003f00 0x7f25a80047d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009ae0 tx=0x7f25ac01ca10 comp rx=0 tx=0).stop 2024-04-02T07:24:55.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.962+0000 7f25c8a00640 1 -- 172.21.15.55:0/4070375373 reap_dead start 2024-04-02T07:24:55.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.962+0000 7f25c9400640 1 -- 172.21.15.55:0/4070375373 shutdown_connections 2024-04-02T07:24:55.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.962+0000 7f25c9400640 1 -- 172.21.15.55:0/4070375373 >> 172.21.15.55:0/4070375373 conn(0x7f25c40b1fb0 msgr2=0x7f25c40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:55.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.962+0000 7f25c9400640 1 -- 172.21.15.55:0/4070375373 shutdown_connections 2024-04-02T07:24:55.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.962+0000 7f25c9400640 1 -- 172.21.15.55:0/4070375373 wait complete. 2024-04-02T07:24:55.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c9400640 1 Processor -- start 2024-04-02T07:24:55.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c9400640 1 -- start start 2024-04-02T07:24:55.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c9400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25a8003f00 0x7f25c40c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:55.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c9400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25c4159020 0x7f25c40c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:55.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c9400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25c40c9e50 0x7f25c40c7590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:55.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c9400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c40ca2d0 con 0x7f25a8003f00 2024-04-02T07:24:55.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c9400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25c41594a0 con 0x7f25c4159020 2024-04-02T07:24:55.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c9400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25c40c8250 con 0x7f25c40c9e50 2024-04-02T07:24:55.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25a8003f00 0x7f25c40c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:55.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25a8003f00 0x7f25c40c92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35862/0 (socket says 172.21.15.55:35862) 2024-04-02T07:24:55.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c3e00640 1 -- 172.21.15.55:0/1529500756 learned_addr learned my addr 172.21.15.55:0/1529500756 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:55.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c8a00640 1 --2- 172.21.15.55:0/1529500756 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25c40c9e50 0x7f25c40c7590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:55.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25bb400640 1 --2- 172.21.15.55:0/1529500756 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25c4159020 0x7f25c40c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:55.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c3e00640 1 -- 172.21.15.55:0/1529500756 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25c40c9e50 msgr2=0x7f25c40c7590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:55.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c3e00640 1 --2- 172.21.15.55:0/1529500756 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25c40c9e50 0x7f25c40c7590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:55.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c3e00640 1 -- 172.21.15.55:0/1529500756 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25c4159020 msgr2=0x7f25c40c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:55.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c3e00640 1 --2- 172.21.15.55:0/1529500756 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25c4159020 0x7f25c40c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:55.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c3e00640 1 -- 172.21.15.55:0/1529500756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c40c8530 con 0x7f25a8003f00 2024-04-02T07:24:55.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c3e00640 1 --2- 172.21.15.55:0/1529500756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25a8003f00 0x7f25c40c92f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f25b4011900 tx=0x7f25b4011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:55.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c0c00640 1 -- 172.21.15.55:0/1529500756 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4004220 con 0x7f25a8003f00 2024-04-02T07:24:55.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c0c00640 1 -- 172.21.15.55:0/1529500756 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b4004380 con 0x7f25a8003f00 2024-04-02T07:24:55.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c0c00640 1 -- 172.21.15.55:0/1529500756 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b400fbd0 con 0x7f25a8003f00 2024-04-02T07:24:55.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c9400640 1 -- 172.21.15.55:0/1529500756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25c40c8810 con 0x7f25a8003f00 2024-04-02T07:24:55.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.966+0000 7f25c9400640 1 -- 172.21.15.55:0/1529500756 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c40c8dd0 con 0x7f25a8003f00 2024-04-02T07:24:55.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.970+0000 7f25c0c00640 1 -- 172.21.15.55:0/1529500756 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f25b400fd30 con 0x7f25a8003f00 2024-04-02T07:24:55.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.970+0000 7f25c0c00640 1 --2- 172.21.15.55:0/1529500756 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25a00666c0 0x7f25a0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:55.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.970+0000 7f25c0c00640 1 -- 172.21.15.55:0/1529500756 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25b4084650 con 0x7f25a8003f00 2024-04-02T07:24:55.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.970+0000 7f25bb400640 1 --2- 172.21.15.55:0/1529500756 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25a00666c0 0x7f25a0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:55.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.970+0000 7f25cdf28000 1 Processor -- start 2024-04-02T07:24:55.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.970+0000 7f25cdf28000 1 -- start start 2024-04-02T07:24:55.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25bb400640 1 --2- 172.21.15.55:0/1529500756 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25a00666c0 0x7f25a0068b80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0af000 tx=0x7f25ac0046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:55.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25cdf28000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c8ba36ca70 0x55c8ba36ce50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:55.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25cdf28000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36d390 0x55c8ba3204c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:55.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25cdf28000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c8ba320a00 0x55c8ba320de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:55.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25cdf28000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8ba1eb630 con 0x55c8ba36d390 2024-04-02T07:24:55.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25cdf28000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8ba178bd0 con 0x55c8ba36ca70 2024-04-02T07:24:55.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25cdf28000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8ba1761a0 con 0x55c8ba320a00 2024-04-02T07:24:55.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25bb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36d390 0x55c8ba3204c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:55.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25bb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36d390 0x55c8ba3204c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35872/0 (socket says 172.21.15.55:35872) 2024-04-02T07:24:55.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25bb400640 1 -- 172.21.15.55:0/3504954894 learned_addr learned my addr 172.21.15.55:0/3504954894 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:55.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25c3e00640 1 --2- 172.21.15.55:0/3504954894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c8ba36ca70 0x55c8ba36ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:55.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25c8a00640 1 --2- 172.21.15.55:0/3504954894 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c8ba320a00 0x55c8ba320de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:55.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25bb400640 1 -- 172.21.15.55:0/3504954894 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c8ba320a00 msgr2=0x55c8ba320de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:55.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25bb400640 1 --2- 172.21.15.55:0/3504954894 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c8ba320a00 0x55c8ba320de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:55.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25bb400640 1 -- 172.21.15.55:0/3504954894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c8ba36ca70 msgr2=0x55c8ba36ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:55.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25bb400640 1 --2- 172.21.15.55:0/3504954894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c8ba36ca70 0x55c8ba36ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:55.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25bb400640 1 -- 172.21.15.55:0/3504954894 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8b9e6de20 con 0x55c8ba36d390 2024-04-02T07:24:55.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25bb400640 1 --2- 172.21.15.55:0/3504954894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36d390 0x55c8ba3204c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0b0040 tx=0x7f25ac004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e6049120d64895 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:55.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25b8c00640 1 -- 172.21.15.55:0/3504954894 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0ad640 con 0x55c8ba36d390 2024-04-02T07:24:55.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25b8c00640 1 -- 172.21.15.55:0/3504954894 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac0ad7a0 con 0x55c8ba36d390 2024-04-02T07:24:55.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25b8c00640 1 -- 172.21.15.55:0/3504954894 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0adb10 con 0x55c8ba36d390 2024-04-02T07:24:55.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25cdf28000 1 -- 172.21.15.55:0/3504954894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36d390 msgr2=0x55c8ba3204c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:55.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25cdf28000 1 --2- 172.21.15.55:0/3504954894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36d390 0x55c8ba3204c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0b0040 tx=0x7f25ac004740 comp rx=0 tx=0).stop 2024-04-02T07:24:55.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25cdf28000 1 -- 172.21.15.55:0/3504954894 shutdown_connections 2024-04-02T07:24:55.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25cdf28000 1 --2- 172.21.15.55:0/3504954894 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c8ba320a00 0x55c8ba320de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:55.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25cdf28000 1 --2- 172.21.15.55:0/3504954894 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36d390 0x55c8ba3204c0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:55.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25cdf28000 1 --2- 172.21.15.55:0/3504954894 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c8ba36ca70 0x55c8ba36ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:55.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25cdf28000 1 -- 172.21.15.55:0/3504954894 >> 172.21.15.55:0/3504954894 conn(0x55c8ba121160 msgr2=0x55c8ba34f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:55.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25cdf28000 1 -- 172.21.15.55:0/3504954894 shutdown_connections 2024-04-02T07:24:55.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25cdf28000 1 -- 172.21.15.55:0/3504954894 wait complete. 2024-04-02T07:24:55.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25cdf28000 1 -- start start 2024-04-02T07:24:55.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.974+0000 7f25cdf28000 1 Processor -- start 2024-04-02T07:24:55.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25cdf28000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c8ba320a00 0x55c8ba3297b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:55.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25cdf28000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36ca70 0x55c8ba350a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:55.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25cdf28000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c8ba36d390 0x55c8ba350f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:55.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25cdf28000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8ba171a90 con 0x55c8ba36ca70 2024-04-02T07:24:55.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25cdf28000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8ba110d40 con 0x55c8ba320a00 2024-04-02T07:24:55.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25cdf28000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8ba12ef30 con 0x55c8ba36d390 2024-04-02T07:24:55.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25cdf28000 10 client.0 _ll_register_callbacks cb 0x55c8ba1d3810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:24:55.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25bb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36ca70 0x55c8ba350a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:55.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25bb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36ca70 0x55c8ba350a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35888/0 (socket says 172.21.15.55:35888) 2024-04-02T07:24:55.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25bb400640 1 -- 172.21.15.55:0/3635931557 learned_addr learned my addr 172.21.15.55:0/3635931557 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:55.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25c8a00640 1 --2- 172.21.15.55:0/3635931557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c8ba36d390 0x55c8ba350f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:55.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25c3e00640 1 --2- 172.21.15.55:0/3635931557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c8ba320a00 0x55c8ba3297b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:55.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25bb400640 1 -- 172.21.15.55:0/3635931557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c8ba36d390 msgr2=0x55c8ba350f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:55.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25bb400640 1 --2- 172.21.15.55:0/3635931557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c8ba36d390 0x55c8ba350f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:55.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25bb400640 1 -- 172.21.15.55:0/3635931557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c8ba320a00 msgr2=0x55c8ba3297b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:55.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25bb400640 1 --2- 172.21.15.55:0/3635931557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c8ba320a00 0x55c8ba3297b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:55.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25bb400640 1 -- 172.21.15.55:0/3635931557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25a8003530 con 0x55c8ba36ca70 2024-04-02T07:24:55.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25bb400640 1 --2- 172.21.15.55:0/3635931557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36ca70 0x55c8ba350a50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009ab0 tx=0x7f25ac019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0c4e3f739ad1e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:55.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25b1600640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:24:55.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25b1600640 1 -- 172.21.15.55:0/3635931557 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0c2d60 con 0x55c8ba36ca70 2024-04-02T07:24:55.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25b1600640 1 -- 172.21.15.55:0/3635931557 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25ac0d5aa0 con 0x55c8ba36ca70 2024-04-02T07:24:55.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25cdf28000 1 -- 172.21.15.55:0/3635931557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c8ba1703e0 con 0x55c8ba36ca70 2024-04-02T07:24:55.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25b1600640 1 -- 172.21.15.55:0/3635931557 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25ac0d5c80 con 0x55c8ba36ca70 2024-04-02T07:24:55.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25cdf28000 10 client.5916 fetch_fsmap learned FSMap version 25 2024-04-02T07:24:55.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25cdf28000 1 -- 172.21.15.55:0/3635931557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55c8ba136aa0 con 0x55c8ba36ca70 2024-04-02T07:24:55.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25b1600640 1 -- 172.21.15.55:0/3635931557 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c8ba1703e0 con 0x55c8ba36ca70 2024-04-02T07:24:55.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25b1600640 1 -- 172.21.15.55:0/3635931557 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 25) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f25ac0bf050 con 0x55c8ba36ca70 2024-04-02T07:24:55.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25cdf28000 10 client.5916 fetch_fsmap finished waiting for FSMap version 25 2024-04-02T07:24:55.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25cdf28000 10 client.5916 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-04-02T07:24:55.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25cdf28000 20 client.5916 populate_metadata read hostname 'smithi055' 2024-04-02T07:24:55.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25cdf28000 1 --2- 172.21.15.55:0/3635931557 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x55c8ba3740c0 0x55c8ba3744a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:55.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25cdf28000 4 client.5916 mds_command: new command op to 5655 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:24:55.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25cdf28000 1 -- 172.21.15.55:0/3635931557 --> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c8ba141d00 con 0x55c8ba3740c0 2024-04-02T07:24:55.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25c3e00640 1 --2- 172.21.15.55:0/3635931557 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x55c8ba3740c0 0x55c8ba3744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:55.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25c3e00640 1 --2- 172.21.15.55:0/3635931557 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x55c8ba3740c0 0x55c8ba3744a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be1a659cf5a38692 server_cookie=479217d6726ef784 in_seq=0 out_seq=0 2024-04-02T07:24:55.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.978+0000 7f25b1600640 10 client.5916 ms_handle_connect on v2:172.21.15.106:6834/1720558250 2024-04-02T07:24:55.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.982+0000 7f25b1600640 1 -- 172.21.15.55:0/3635931557 <== mds.0 v2:172.21.15.106:6834/1720558250 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c8ba141d00 con 0x55c8ba3740c0 2024-04-02T07:24:55.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.982+0000 7f25b1600640 10 client.5916 handle_command_reply: tid=0 2024-04-02T07:24:55.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.982+0000 7f25cdf28000 1 client.5916 shutdown 2024-04-02T07:24:55.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.982+0000 7f25cdf28000 1 -- 172.21.15.55:0/3635931557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36ca70 msgr2=0x55c8ba350a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:55.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.982+0000 7f25cdf28000 1 --2- 172.21.15.55:0/3635931557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36ca70 0x55c8ba350a50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009ab0 tx=0x7f25ac019810 comp rx=0 tx=0).stop 2024-04-02T07:24:55.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.982+0000 7f25cdf28000 1 -- 172.21.15.55:0/3635931557 shutdown_connections 2024-04-02T07:24:55.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.982+0000 7f25cdf28000 1 --2- 172.21.15.55:0/3635931557 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x55c8ba3740c0 0x55c8ba3744a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:55.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.982+0000 7f25cdf28000 1 --2- 172.21.15.55:0/3635931557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c8ba36d390 0x55c8ba350f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:55.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.982+0000 7f25cdf28000 1 --2- 172.21.15.55:0/3635931557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36ca70 0x55c8ba350a50 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:55.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.982+0000 7f25cdf28000 1 --2- 172.21.15.55:0/3635931557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c8ba320a00 0x55c8ba3297b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:55.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.982+0000 7f25b1600640 0 client.5916 ms_handle_reset on v2:172.21.15.106:6834/1720558250 2024-04-02T07:24:55.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.982+0000 7f25cdf28000 1 -- 172.21.15.55:0/3635931557 >> 172.21.15.55:0/3635931557 conn(0x55c8ba121160 msgr2=0x55c8ba31fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:55.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.982+0000 7f25cdf28000 1 -- 172.21.15.55:0/3635931557 shutdown_connections 2024-04-02T07:24:55.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.982+0000 7f25cdf28000 1 -- 172.21.15.55:0/3635931557 wait complete. 2024-04-02T07:24:55.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.982+0000 7f25cdf28000 20 client.5916 trim_cache size 0 max 16384 2024-04-02T07:24:55.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.994+0000 7f25cdf28000 1 Processor -- start 2024-04-02T07:24:55.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.994+0000 7f25cdf28000 1 -- start start 2024-04-02T07:24:56.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25cdf28000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba320a00 0x55c8ba31fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25cdf28000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c8ba36ca70 0x55c8ba320170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25cdf28000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c8ba36d390 0x55c8ba320de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25cdf28000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8b9e2eaa0 con 0x55c8ba320a00 2024-04-02T07:24:56.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25cdf28000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8ba1c9920 con 0x55c8ba36ca70 2024-04-02T07:24:56.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25cdf28000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8ba173020 con 0x55c8ba36d390 2024-04-02T07:24:56.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25c3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba320a00 0x55c8ba31fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25c3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba320a00 0x55c8ba31fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35898/0 (socket says 172.21.15.55:35898) 2024-04-02T07:24:56.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25c3e00640 1 -- 172.21.15.55:0/2254902073 learned_addr learned my addr 172.21.15.55:0/2254902073 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:56.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25bb400640 1 --2- 172.21.15.55:0/2254902073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c8ba36ca70 0x55c8ba320170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25c8a00640 1 --2- 172.21.15.55:0/2254902073 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c8ba36d390 0x55c8ba320de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25c3e00640 1 -- 172.21.15.55:0/2254902073 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c8ba36d390 msgr2=0x55c8ba320de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:56.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25c3e00640 1 --2- 172.21.15.55:0/2254902073 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c8ba36d390 0x55c8ba320de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25c3e00640 1 -- 172.21.15.55:0/2254902073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c8ba36ca70 msgr2=0x55c8ba320170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:56.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25c3e00640 1 --2- 172.21.15.55:0/2254902073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c8ba36ca70 0x55c8ba320170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25c3e00640 1 -- 172.21.15.55:0/2254902073 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c8ba11cdf0 con 0x55c8ba320a00 2024-04-02T07:24:56.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25c3e00640 1 --2- 172.21.15.55:0/2254902073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba320a00 0x55c8ba31fc30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f25b4051c20 tx=0x7f25b4017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2690742d113546dd server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:56.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25b9600640 1 -- 172.21.15.55:0/2254902073 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b4082bf0 con 0x55c8ba320a00 2024-04-02T07:24:56.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25b9600640 1 -- 172.21.15.55:0/2254902073 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25b4053ac0 con 0x55c8ba320a00 2024-04-02T07:24:56.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25b9600640 1 -- 172.21.15.55:0/2254902073 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25b40590b0 con 0x55c8ba320a00 2024-04-02T07:24:56.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25cdf28000 1 -- 172.21.15.55:0/2254902073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba320a00 msgr2=0x55c8ba31fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:56.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25cdf28000 1 --2- 172.21.15.55:0/2254902073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba320a00 0x55c8ba31fc30 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f25b4051c20 tx=0x7f25b4017040 comp rx=0 tx=0).stop 2024-04-02T07:24:56.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25cdf28000 1 -- 172.21.15.55:0/2254902073 shutdown_connections 2024-04-02T07:24:56.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25cdf28000 1 --2- 172.21.15.55:0/2254902073 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c8ba36d390 0x55c8ba320de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25cdf28000 1 --2- 172.21.15.55:0/2254902073 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c8ba36ca70 0x55c8ba320170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25cdf28000 1 --2- 172.21.15.55:0/2254902073 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba320a00 0x55c8ba31fc30 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25cdf28000 1 -- 172.21.15.55:0/2254902073 >> 172.21.15.55:0/2254902073 conn(0x55c8ba121160 msgr2=0x55c8ba327f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:56.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25cdf28000 1 -- 172.21.15.55:0/2254902073 shutdown_connections 2024-04-02T07:24:56.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25cdf28000 1 -- 172.21.15.55:0/2254902073 wait complete. 2024-04-02T07:24:56.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25cdf28000 1 -- start start 2024-04-02T07:24:56.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:55.998+0000 7f25cdf28000 1 Processor -- start 2024-04-02T07:24:56.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c8ba320a00 0x55c8ba3aff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c8ba36ca70 0x55c8ba323600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36d390 0x55c8ba323b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8ba351220 con 0x55c8ba36d390 2024-04-02T07:24:56.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c8ba350c80 con 0x55c8ba320a00 2024-04-02T07:24:56.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c8ba22aec0 con 0x55c8ba36ca70 2024-04-02T07:24:56.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 10 client.0 _ll_register_callbacks cb 0x7f25ac0bb050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:24:56.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25c8a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36d390 0x55c8ba323b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25c8a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36d390 0x55c8ba323b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35906/0 (socket says 172.21.15.55:35906) 2024-04-02T07:24:56.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25c8a00640 1 -- 172.21.15.55:0/2310165826 learned_addr learned my addr 172.21.15.55:0/2310165826 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:56.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25c3e00640 1 --2- 172.21.15.55:0/2310165826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c8ba320a00 0x55c8ba3aff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25bb400640 1 --2- 172.21.15.55:0/2310165826 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c8ba36ca70 0x55c8ba323600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25c8a00640 1 -- 172.21.15.55:0/2310165826 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c8ba36ca70 msgr2=0x55c8ba323600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:56.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25c8a00640 1 --2- 172.21.15.55:0/2310165826 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c8ba36ca70 0x55c8ba323600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25c8a00640 1 -- 172.21.15.55:0/2310165826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c8ba320a00 msgr2=0x55c8ba3aff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:56.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25c8a00640 1 --2- 172.21.15.55:0/2310165826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c8ba320a00 0x55c8ba3aff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25c8a00640 1 -- 172.21.15.55:0/2310165826 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25c40c8dd0 con 0x55c8ba36d390 2024-04-02T07:24:56.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25c8a00640 1 --2- 172.21.15.55:0/2310165826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36d390 0x55c8ba323b40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f25c40721a0 tx=0x7f25bc018b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a24ac46f2d85a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:56.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25b1600640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:24:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25b1600640 1 -- 172.21.15.55:0/2310165826 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc017750 con 0x55c8ba36d390 2024-04-02T07:24:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25b1600640 1 -- 172.21.15.55:0/2310165826 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25bc025ac0 con 0x55c8ba36d390 2024-04-02T07:24:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 1 -- 172.21.15.55:0/2310165826 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c8ba351360 con 0x55c8ba36d390 2024-04-02T07:24:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25b1600640 1 -- 172.21.15.55:0/2310165826 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25bc025c80 con 0x55c8ba36d390 2024-04-02T07:24:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 10 client.5922 fetch_fsmap learned FSMap version 25 2024-04-02T07:24:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 1 -- 172.21.15.55:0/2310165826 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=2+}) v3 -- 0x55c8ba110960 con 0x55c8ba36d390 2024-04-02T07:24:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25b1600640 1 -- 172.21.15.55:0/2310165826 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c8ba351360 con 0x55c8ba36d390 2024-04-02T07:24:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25b1600640 1 -- 172.21.15.55:0/2310165826 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 25) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f25bc021070 con 0x55c8ba36d390 2024-04-02T07:24:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 10 client.5922 fetch_fsmap finished waiting for FSMap version 25 2024-04-02T07:24:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 10 client.5922 resolve_mds: resolved 3:0 to role '3:0' aka daemon mds.b 2024-04-02T07:24:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 20 client.5922 populate_metadata read hostname 'smithi055' 2024-04-02T07:24:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 1 --2- 172.21.15.55:0/2310165826 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x55c8ba324080 0x55c8ba324490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 4 client.5922 mds_command: new command op to 5655 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-02T07:24:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 1 -- 172.21.15.55:0/2310165826 --> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c8ba12e970 con 0x55c8ba324080 2024-04-02T07:24:56.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25c3e00640 1 --2- 172.21.15.55:0/2310165826 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x55c8ba324080 0x55c8ba324490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25b1600640 10 client.5922 ms_handle_connect on v2:172.21.15.106:6834/1720558250 2024-04-02T07:24:56.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25c3e00640 1 --2- 172.21.15.55:0/2310165826 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x55c8ba324080 0x55c8ba324490 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad4f9a0454d591c4 server_cookie=bfcdc89f3f286e8a in_seq=0 out_seq=0 2024-04-02T07:24:56.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25b1600640 1 -- 172.21.15.55:0/2310165826 <== mds.0 v2:172.21.15.106:6834/1720558250 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55c8ba12e970 con 0x55c8ba324080 2024-04-02T07:24:56.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25b1600640 10 client.5922 handle_command_reply: tid=0 2024-04-02T07:24:56.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 1 client.5922 shutdown 2024-04-02T07:24:56.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 1 -- 172.21.15.55:0/2310165826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36d390 msgr2=0x55c8ba323b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:56.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 1 --2- 172.21.15.55:0/2310165826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36d390 0x55c8ba323b40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f25c40721a0 tx=0x7f25bc018b00 comp rx=0 tx=0).stop 2024-04-02T07:24:56.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 1 -- 172.21.15.55:0/2310165826 shutdown_connections 2024-04-02T07:24:56.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 1 --2- 172.21.15.55:0/2310165826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c8ba36d390 0x55c8ba323b40 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 1 --2- 172.21.15.55:0/2310165826 >> [v2:172.21.15.106:6834/1720558250,v1:172.21.15.106:6836/1720558250] conn(0x55c8ba324080 0x55c8ba324490 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 1 --2- 172.21.15.55:0/2310165826 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c8ba36ca70 0x55c8ba323600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 1 --2- 172.21.15.55:0/2310165826 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c8ba320a00 0x55c8ba3aff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25b1600640 0 client.5922 ms_handle_reset on v2:172.21.15.106:6834/1720558250 2024-04-02T07:24:56.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.002+0000 7f25cdf28000 1 -- 172.21.15.55:0/2310165826 >> 172.21.15.55:0/2310165826 conn(0x55c8ba121160 msgr2=0x55c8ba328810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:56.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.006+0000 7f25cdf28000 1 -- 172.21.15.55:0/2310165826 shutdown_connections 2024-04-02T07:24:56.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.006+0000 7f25cdf28000 1 -- 172.21.15.55:0/2310165826 wait complete. 2024-04-02T07:24:56.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.006+0000 7f25cdf28000 20 client.5922 trim_cache size 0 max 16384 2024-04-02T07:24:56.011 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:24:56.011 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-04-02T07:24:56.012 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-04-02T07:24:56.012 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:24:56.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.006+0000 7f25c9400640 1 -- 172.21.15.55:0/1529500756 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25a00666c0 msgr2=0x7f25a0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:56.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.006+0000 7f25c9400640 1 --2- 172.21.15.55:0/1529500756 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25a00666c0 0x7f25a0068b80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f25ac0af000 tx=0x7f25ac0046d0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.006+0000 7f25c9400640 1 -- 172.21.15.55:0/1529500756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25a8003f00 msgr2=0x7f25c40c92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:56.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.006+0000 7f25c9400640 1 --2- 172.21.15.55:0/1529500756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25a8003f00 0x7f25c40c92f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f25b4011900 tx=0x7f25b4011d00 comp rx=0 tx=0).stop 2024-04-02T07:24:56.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.006+0000 7f25c9400640 1 -- 172.21.15.55:0/1529500756 shutdown_connections 2024-04-02T07:24:56.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.006+0000 7f25c9400640 1 --2- 172.21.15.55:0/1529500756 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25c40c9e50 0x7f25c40c7590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.006+0000 7f25c9400640 1 --2- 172.21.15.55:0/1529500756 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25a00666c0 0x7f25a0068b80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.006+0000 7f25c9400640 1 --2- 172.21.15.55:0/1529500756 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25c4159020 0x7f25c40c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.006+0000 7f25c9400640 1 --2- 172.21.15.55:0/1529500756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25a8003f00 0x7f25c40c92f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.006+0000 7f25c9400640 1 -- 172.21.15.55:0/1529500756 >> 172.21.15.55:0/1529500756 conn(0x7f25c40b1fb0 msgr2=0x7f25c4072eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:56.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.006+0000 7f25c9400640 1 -- 172.21.15.55:0/1529500756 shutdown_connections 2024-04-02T07:24:56.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.006+0000 7f25c9400640 1 -- 172.21.15.55:0/1529500756 wait complete. 2024-04-02T07:24:56.027 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-02T07:24:56.128 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:24:56.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.266+0000 7f88aba00640 1 Processor -- start 2024-04-02T07:24:56.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.266+0000 7f88aba00640 1 -- start start 2024-04-02T07:24:56.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.266+0000 7f88aba00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f88a4153ea0 0x7f88a40c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.266+0000 7f88aba00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f88a4159be0 0x7f88a40b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.266+0000 7f88aba00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a413d0c0 con 0x7f88a415a070 2024-04-02T07:24:56.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.266+0000 7f88aba00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a415a4f0 con 0x7f88a4153ea0 2024-04-02T07:24:56.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.266+0000 7f88aba00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a415a7d0 con 0x7f88a4159be0 2024-04-02T07:24:56.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.266+0000 7f88a9000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f88a4153ea0 0x7f88a40c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.266+0000 7f88a9000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f88a4153ea0 0x7f88a40c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35916/0 (socket says 172.21.15.55:35916) 2024-04-02T07:24:56.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.266+0000 7f88a9000640 1 -- 172.21.15.55:0/2029182714 learned_addr learned my addr 172.21.15.55:0/2029182714 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:56.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.266+0000 7f88a3e00640 1 --2- 172.21.15.55:0/2029182714 >> v2:172.21.15.106:3300/0 conn(0x7f88a4159be0 0x7f88a40b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.266+0000 7f88a9000640 1 -- 172.21.15.55:0/2029182714 >> v2:172.21.15.106:3300/0 conn(0x7f88a4159be0 msgr2=0x7f88a40b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:56.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.266+0000 7f88a9000640 1 --2- 172.21.15.55:0/2029182714 >> v2:172.21.15.106:3300/0 conn(0x7f88a4159be0 0x7f88a40b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.266+0000 7f88a9000640 1 -- 172.21.15.55:0/2029182714 >> v1:172.21.15.106:6789/0 conn(0x7f88a415a070 legacy=0x7f88a413ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:56.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.266+0000 7f88a9000640 1 -- 172.21.15.55:0/2029182714 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a415aab0 con 0x7f88a4153ea0 2024-04-02T07:24:56.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.270+0000 7f88a9000640 1 --2- 172.21.15.55:0/2029182714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4153ea0 0x7f88a40c4120 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f88a406d470 tx=0x7f889801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6915a8bff59ebb89 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:56.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.270+0000 7f88a3400640 1 -- 172.21.15.55:0/2029182714 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88980aa660 con 0x7f88a4153ea0 2024-04-02T07:24:56.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.270+0000 7f88a3400640 1 -- 172.21.15.55:0/2029182714 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88980aa7c0 con 0x7f88a4153ea0 2024-04-02T07:24:56.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.270+0000 7f88a3400640 1 -- 172.21.15.55:0/2029182714 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88980aab50 con 0x7f88a4153ea0 2024-04-02T07:24:56.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.270+0000 7f88aba00640 1 -- 172.21.15.55:0/2029182714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4153ea0 msgr2=0x7f88a40c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:56.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.270+0000 7f88aba00640 1 --2- 172.21.15.55:0/2029182714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4153ea0 0x7f88a40c4120 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f88a406d470 tx=0x7f889801c4e0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.270+0000 7f88aba00640 1 -- 172.21.15.55:0/2029182714 shutdown_connections 2024-04-02T07:24:56.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.270+0000 7f88aba00640 1 --2- 172.21.15.55:0/2029182714 >> v2:172.21.15.106:3300/0 conn(0x7f88a4159be0 0x7f88a40b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.270+0000 7f88aba00640 1 --2- 172.21.15.55:0/2029182714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4153ea0 0x7f88a40c4120 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.270+0000 7f88aba00640 1 -- 172.21.15.55:0/2029182714 >> 172.21.15.55:0/2029182714 conn(0x7f88a4066080 msgr2=0x7f88a4069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:56.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.270+0000 7f88aba00640 1 -- 172.21.15.55:0/2029182714 shutdown_connections 2024-04-02T07:24:56.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.270+0000 7f88aba00640 1 -- 172.21.15.55:0/2029182714 wait complete. 2024-04-02T07:24:56.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88aba00640 1 Processor -- start 2024-04-02T07:24:56.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88aba00640 1 -- start start 2024-04-02T07:24:56.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88aba00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88a4153ea0 0x7f88a413b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88aba00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4159be0 0x7f88a41417b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88aba00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88a415a070 0x7f88a4070d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88aba00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a41f5ab0 con 0x7f88a4159be0 2024-04-02T07:24:56.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88aba00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a41f5d90 con 0x7f88a4153ea0 2024-04-02T07:24:56.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88aba00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a41f6070 con 0x7f88a415a070 2024-04-02T07:24:56.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88a3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4159be0 0x7f88a41417b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88a3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4159be0 0x7f88a41417b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35928/0 (socket says 172.21.15.55:35928) 2024-04-02T07:24:56.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88a3e00640 1 -- 172.21.15.55:0/4065941006 learned_addr learned my addr 172.21.15.55:0/4065941006 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:56.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88a9000640 1 --2- 172.21.15.55:0/4065941006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88a4153ea0 0x7f88a413b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88a9a00640 1 --2- 172.21.15.55:0/4065941006 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88a415a070 0x7f88a4070d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88a3e00640 1 -- 172.21.15.55:0/4065941006 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88a415a070 msgr2=0x7f88a4070d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:56.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88a3e00640 1 --2- 172.21.15.55:0/4065941006 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88a415a070 0x7f88a4070d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88a3e00640 1 -- 172.21.15.55:0/4065941006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88a4153ea0 msgr2=0x7f88a413b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:56.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88a3e00640 1 --2- 172.21.15.55:0/4065941006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88a4153ea0 0x7f88a413b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88a3e00640 1 -- 172.21.15.55:0/4065941006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88980094d0 con 0x7f88a4159be0 2024-04-02T07:24:56.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88a3e00640 1 --2- 172.21.15.55:0/4065941006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4159be0 0x7f88a41417b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f889000d800 tx=0x7f889000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:56.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88a0c00640 1 -- 172.21.15.55:0/4065941006 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889000b6c0 con 0x7f88a4159be0 2024-04-02T07:24:56.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88a0c00640 1 -- 172.21.15.55:0/4065941006 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889000b820 con 0x7f88a4159be0 2024-04-02T07:24:56.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88a0c00640 1 -- 172.21.15.55:0/4065941006 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889000bb90 con 0x7f88a4159be0 2024-04-02T07:24:56.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88aba00640 1 -- 172.21.15.55:0/4065941006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a41f6350 con 0x7f88a4159be0 2024-04-02T07:24:56.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.274+0000 7f88aba00640 1 -- 172.21.15.55:0/4065941006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a4141cf0 con 0x7f88a4159be0 2024-04-02T07:24:56.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.278+0000 7f88aba00640 1 -- 172.21.15.55:0/4065941006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a4066c90 con 0x7f88a4159be0 2024-04-02T07:24:56.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.278+0000 7f88a0c00640 1 -- 172.21.15.55:0/4065941006 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f889000bcf0 con 0x7f88a4159be0 2024-04-02T07:24:56.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.278+0000 7f88a0c00640 1 --2- 172.21.15.55:0/4065941006 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f88840666c0 0x7f8884068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.278+0000 7f88a0c00640 1 -- 172.21.15.55:0/4065941006 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88900845d0 con 0x7f88a4159be0 2024-04-02T07:24:56.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.278+0000 7f88a9000640 1 --2- 172.21.15.55:0/4065941006 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f88840666c0 0x7f8884068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.278+0000 7f88a9000640 1 --2- 172.21.15.55:0/4065941006 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f88840666c0 0x7f8884068b80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f88980ae000 tx=0x7f88980b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:56.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.282+0000 7f88a0c00640 1 -- 172.21.15.55:0/4065941006 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f88900519d0 con 0x7f88a4159be0 2024-04-02T07:24:56.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.478+0000 7f88aba00640 1 -- 172.21.15.55:0/4065941006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88a40b2240 con 0x7f88a4159be0 2024-04-02T07:24:56.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.478+0000 7f88a0c00640 1 -- 172.21.15.55:0/4065941006 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f8890054ff0 con 0x7f88a4159be0 2024-04-02T07:24:56.482 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:56.482 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2224746522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2224746522},{"type":"v1","addr":"172.21.15.106:6837","nonce":2224746522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/2077739908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2077739908},{"type":"v1","addr":"172.21.15.55:6833","nonce":2077739908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/4108584287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4108584287},{"type":"v1","addr":"172.21.15.55:6835","nonce":4108584287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:24:11.929212+0000","modified":"2024-04-02T07:24:14.958225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5655":{"gid":5655,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6836/1720558250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1720558250},{"type":"v1","addr":"172.21.15.106:6836","nonce":1720558250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-02T07:24:56.482 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 25 2024-04-02T07:24:56.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.478+0000 7f88aba00640 1 -- 172.21.15.55:0/4065941006 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f88840666c0 msgr2=0x7f8884068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:56.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.478+0000 7f88aba00640 1 --2- 172.21.15.55:0/4065941006 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f88840666c0 0x7f8884068b80 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f88980ae000 tx=0x7f88980b5040 comp rx=0 tx=0).stop 2024-04-02T07:24:56.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.478+0000 7f88aba00640 1 -- 172.21.15.55:0/4065941006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4159be0 msgr2=0x7f88a41417b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:56.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.478+0000 7f88aba00640 1 --2- 172.21.15.55:0/4065941006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4159be0 0x7f88a41417b0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f889000d800 tx=0x7f889000dcc0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.478+0000 7f88aba00640 1 -- 172.21.15.55:0/4065941006 shutdown_connections 2024-04-02T07:24:56.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.478+0000 7f88aba00640 1 --2- 172.21.15.55:0/4065941006 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88a415a070 0x7f88a4070d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.478+0000 7f88aba00640 1 --2- 172.21.15.55:0/4065941006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88a4159be0 0x7f88a41417b0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.478+0000 7f88aba00640 1 --2- 172.21.15.55:0/4065941006 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f88840666c0 0x7f8884068b80 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.478+0000 7f88aba00640 1 --2- 172.21.15.55:0/4065941006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88a4153ea0 0x7f88a413b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.478+0000 7f88aba00640 1 -- 172.21.15.55:0/4065941006 >> 172.21.15.55:0/4065941006 conn(0x7f88a4066080 msgr2=0x7f88a40cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:56.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.482+0000 7f88aba00640 1 -- 172.21.15.55:0/4065941006 shutdown_connections 2024-04-02T07:24:56.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.482+0000 7f88aba00640 1 -- 172.21.15.55:0/4065941006 wait complete. 2024-04-02T07:24:56.503 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-04-02T07:24:56.675 INFO:teuthology.orchestra.run.smithi106.stdout:{"message":"","return_code":0} 2024-04-02T07:24:56.675 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-02T07:24:56.675 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-02T07:24:56.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.718+0000 7f875cd26080 1 Processor -- start 2024-04-02T07:24:56.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.718+0000 7f875cd26080 1 -- start start 2024-04-02T07:24:56.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.718+0000 7f875cd26080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8740003600 0x561624beaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.718+0000 7f875cd26080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561624b75950 0x561624c8dee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.718+0000 7f875cd26080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561624b5b9c0 0x561624b2bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.718+0000 7f875cd26080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561624ad91e0 con 0x561624b75950 2024-04-02T07:24:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.718+0000 7f875cd26080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561624a74960 con 0x561624b5b9c0 2024-04-02T07:24:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.718+0000 7f875cd26080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x561624a74600 con 0x7f8740003600 2024-04-02T07:24:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f8759600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561624b75950 0x561624c8dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f8759600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561624b75950 0x561624c8dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35942/0 (socket says 172.21.15.55:35942) 2024-04-02T07:24:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f8759600640 1 -- 172.21.15.55:0/1236741857 learned_addr learned my addr 172.21.15.55:0/1236741857 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875aa00640 1 --2- 172.21.15.55:0/1236741857 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561624b5b9c0 0x561624b2bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875a000640 1 --2- 172.21.15.55:0/1236741857 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8740003600 0x561624beaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f8759600640 1 -- 172.21.15.55:0/1236741857 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8740003600 msgr2=0x561624beaf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f8759600640 1 --2- 172.21.15.55:0/1236741857 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8740003600 0x561624beaf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f8759600640 1 -- 172.21.15.55:0/1236741857 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561624b5b9c0 msgr2=0x561624b2bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f8759600640 1 --2- 172.21.15.55:0/1236741857 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561624b5b9c0 0x561624b2bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f8759600640 1 -- 172.21.15.55:0/1236741857 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561624a76d00 con 0x561624b75950 2024-04-02T07:24:56.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875aa00640 1 --2- 172.21.15.55:0/1236741857 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561624b5b9c0 0x561624b2bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:56.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875a000640 1 --2- 172.21.15.55:0/1236741857 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8740003600 0x561624beaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:56.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f8759600640 1 --2- 172.21.15.55:0/1236741857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561624b75950 0x561624c8dee0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8748009550 tx=0x7f8748009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1a93cf8f54a52e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:56.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f8753e00640 1 -- 172.21.15.55:0/1236741857 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874800ea20 con 0x561624b75950 2024-04-02T07:24:56.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f8753e00640 1 -- 172.21.15.55:0/1236741857 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874800eb80 con 0x561624b75950 2024-04-02T07:24:56.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f8753e00640 1 -- 172.21.15.55:0/1236741857 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8748018400 con 0x561624b75950 2024-04-02T07:24:56.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875cd26080 1 -- 172.21.15.55:0/1236741857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561624b75950 msgr2=0x561624c8dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:56.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875cd26080 1 --2- 172.21.15.55:0/1236741857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561624b75950 0x561624c8dee0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f8748009550 tx=0x7f8748009a10 comp rx=0 tx=0).stop 2024-04-02T07:24:56.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875cd26080 1 -- 172.21.15.55:0/1236741857 shutdown_connections 2024-04-02T07:24:56.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875cd26080 1 --2- 172.21.15.55:0/1236741857 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561624b5b9c0 0x561624b2bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875cd26080 1 --2- 172.21.15.55:0/1236741857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561624b75950 0x561624c8dee0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875cd26080 1 --2- 172.21.15.55:0/1236741857 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8740003600 0x561624beaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875cd26080 1 -- 172.21.15.55:0/1236741857 >> 172.21.15.55:0/1236741857 conn(0x561624b5abf0 msgr2=0x561624b75240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:56.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875cd26080 1 -- 172.21.15.55:0/1236741857 shutdown_connections 2024-04-02T07:24:56.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875cd26080 1 -- 172.21.15.55:0/1236741857 wait complete. 2024-04-02T07:24:56.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875cd26080 1 Processor -- start 2024-04-02T07:24:56.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875cd26080 1 -- start start 2024-04-02T07:24:56.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875cd26080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561624b5b9c0 0x561624c9ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875cd26080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561624b75950 0x561624b5c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875cd26080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8740003600 0x561624b5ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875cd26080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561624a6b690 con 0x7f8740003600 2024-04-02T07:24:56.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875cd26080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561624b75490 con 0x561624b75950 2024-04-02T07:24:56.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875cd26080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x561624c9d3b0 con 0x561624b5b9c0 2024-04-02T07:24:56.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8740003600 0x561624b5ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8740003600 0x561624b5ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35944/0 (socket says 172.21.15.55:35944) 2024-04-02T07:24:56.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875aa00640 1 -- 172.21.15.55:0/3858892349 learned_addr learned my addr 172.21.15.55:0/3858892349 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:56.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875a000640 1 --2- 172.21.15.55:0/3858892349 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561624b5b9c0 0x561624c9ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f8759600640 1 --2- 172.21.15.55:0/3858892349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561624b75950 0x561624b5c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.722+0000 7f875aa00640 1 -- 172.21.15.55:0/3858892349 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561624b5b9c0 msgr2=0x561624c9ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:56.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.726+0000 7f875aa00640 1 --2- 172.21.15.55:0/3858892349 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561624b5b9c0 0x561624c9ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.726+0000 7f875aa00640 1 -- 172.21.15.55:0/3858892349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561624b75950 msgr2=0x561624b5c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:56.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.726+0000 7f875aa00640 1 --2- 172.21.15.55:0/3858892349 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561624b75950 0x561624b5c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.726+0000 7f875aa00640 1 -- 172.21.15.55:0/3858892349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561624a838c0 con 0x7f8740003600 2024-04-02T07:24:56.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.726+0000 7f875aa00640 1 --2- 172.21.15.55:0/3858892349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8740003600 0x561624b5ce80 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8754002240 tx=0x7f87400040f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:56.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.726+0000 7f8752a00640 1 -- 172.21.15.55:0/3858892349 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8754005520 con 0x7f8740003600 2024-04-02T07:24:56.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.726+0000 7f8752a00640 1 -- 172.21.15.55:0/3858892349 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87540a4900 con 0x7f8740003600 2024-04-02T07:24:56.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.726+0000 7f8752a00640 1 -- 172.21.15.55:0/3858892349 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87540a4a70 con 0x7f8740003600 2024-04-02T07:24:56.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.726+0000 7f875cd26080 1 -- 172.21.15.55:0/3858892349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x561624a76760 con 0x7f8740003600 2024-04-02T07:24:56.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.726+0000 7f875cd26080 1 -- 172.21.15.55:0/3858892349 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561624b2fb40 con 0x7f8740003600 2024-04-02T07:24:56.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.726+0000 7f8752a00640 1 -- 172.21.15.55:0/3858892349 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f87540a4bd0 con 0x7f8740003600 2024-04-02T07:24:56.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.726+0000 7f8752a00640 1 --2- 172.21.15.55:0/3858892349 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f873c0650a0 0x7f873c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.726+0000 7f8752a00640 1 -- 172.21.15.55:0/3858892349 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f875411cff0 con 0x7f8740003600 2024-04-02T07:24:56.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.726+0000 7f875cd26080 1 --2- 172.21.15.55:0/3858892349 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x561624c9b200 0x561624b2e710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:56.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.726+0000 7f875cd26080 1 -- 172.21.15.55:0/3858892349 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:1 7.7 7:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e46) v8 -- 0x561624b2ec50 con 0x561624c9b200 2024-04-02T07:24:56.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.726+0000 7f875a000640 1 --2- 172.21.15.55:0/3858892349 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f873c0650a0 0x7f873c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.730+0000 7f8759600640 1 --2- 172.21.15.55:0/3858892349 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x561624c9b200 0x561624b2e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:56.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.730+0000 7f875a000640 1 --2- 172.21.15.55:0/3858892349 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f873c0650a0 0x7f873c067560 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f874c000c10 tx=0x7f874c001740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:56.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.730+0000 7f8759600640 1 --2- 172.21.15.55:0/3858892349 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x561624c9b200 0x561624b2e710 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:56.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.730+0000 7f8759600640 1 -- 172.21.15.55:0/3858892349 <== osd.6 v2:172.21.15.106:6816/27678 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x7f874800e820 con 0x561624c9b200 2024-04-02T07:24:56.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.730+0000 7f875cd26080 1 -- 172.21.15.55:0/3858892349 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x561624c9b200 msgr2=0x561624b2e710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:56.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.730+0000 7f875cd26080 1 --2- 172.21.15.55:0/3858892349 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x561624c9b200 0x561624b2e710 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.730+0000 7f875cd26080 1 -- 172.21.15.55:0/3858892349 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f873c0650a0 msgr2=0x7f873c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:56.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.730+0000 7f875cd26080 1 --2- 172.21.15.55:0/3858892349 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f873c0650a0 0x7f873c067560 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f874c000c10 tx=0x7f874c001740 comp rx=0 tx=0).stop 2024-04-02T07:24:56.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.730+0000 7f875cd26080 1 -- 172.21.15.55:0/3858892349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8740003600 msgr2=0x561624b5ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:56.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.730+0000 7f875cd26080 1 --2- 172.21.15.55:0/3858892349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8740003600 0x561624b5ce80 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f8754002240 tx=0x7f87400040f0 comp rx=0 tx=0).stop 2024-04-02T07:24:56.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.730+0000 7f875aa00640 1 -- 172.21.15.55:0/3858892349 reap_dead start 2024-04-02T07:24:56.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.730+0000 7f875cd26080 1 -- 172.21.15.55:0/3858892349 shutdown_connections 2024-04-02T07:24:56.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.730+0000 7f875cd26080 1 -- 172.21.15.55:0/3858892349 >> 172.21.15.55:0/3858892349 conn(0x561624b5abf0 msgr2=0x561624bed1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:56.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.730+0000 7f875cd26080 1 -- 172.21.15.55:0/3858892349 shutdown_connections 2024-04-02T07:24:56.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:56.730+0000 7f875cd26080 1 -- 172.21.15.55:0/3858892349 wait complete. 2024-04-02T07:24:56.737 INFO:teuthology.orchestra.run.smithi055.stdout:Yalphaparent_a 2024-04-02T07:24:56.737 DEBUG:teuthology.orchestra.run.smithi055:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-02T07:24:56.828 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:24:56.828 INFO:teuthology.orchestra.run.smithi055.stdout: "ino": 1099511627777, 2024-04-02T07:24:56.828 INFO:teuthology.orchestra.run.smithi055.stdout: "ancestors": [ 2024-04-02T07:24:56.828 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:56.828 INFO:teuthology.orchestra.run.smithi055.stdout: "dirino": 1099511627776, 2024-04-02T07:24:56.828 INFO:teuthology.orchestra.run.smithi055.stdout: "dname": "alpha", 2024-04-02T07:24:56.828 INFO:teuthology.orchestra.run.smithi055.stdout: "version": 4 2024-04-02T07:24:56.828 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:24:56.828 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:24:56.828 INFO:teuthology.orchestra.run.smithi055.stdout: "dirino": 1, 2024-04-02T07:24:56.829 INFO:teuthology.orchestra.run.smithi055.stdout: "dname": "parent_a", 2024-04-02T07:24:56.829 INFO:teuthology.orchestra.run.smithi055.stdout: "version": 7 2024-04-02T07:24:56.829 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:24:56.829 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-02T07:24:56.829 INFO:teuthology.orchestra.run.smithi055.stdout: "pool": 7, 2024-04-02T07:24:56.829 INFO:teuthology.orchestra.run.smithi055.stdout: "old_pools": [] 2024-04-02T07:24:56.829 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:24:56.829 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:56.833 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-02T07:24:56.834 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:24:56.962 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:24:57.047 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-02T07:24:57.047 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:24:57.047 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:24:57.056 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:24:57.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.238+0000 7fed8e200640 1 Processor -- start 2024-04-02T07:24:57.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.238+0000 7fed8e200640 1 -- start start 2024-04-02T07:24:57.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.242+0000 7fed8e200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fed88143f90 0x7fed8815ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:57.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.242+0000 7fed8e200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fed880b34f0 0x7fed880cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:57.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.242+0000 7fed8e200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8815b270 con 0x7fed880b3980 2024-04-02T07:24:57.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.242+0000 7fed8e200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed88144370 con 0x7fed880b34f0 2024-04-02T07:24:57.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.242+0000 7fed8e200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed880c37b0 con 0x7fed88143f90 2024-04-02T07:24:57.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.242+0000 7fed7ea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fed880b34f0 0x7fed880cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:57.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.242+0000 7fed7ea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fed880b34f0 0x7fed880cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35954/0 (socket says 172.21.15.55:35954) 2024-04-02T07:24:57.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.242+0000 7fed87e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fed880b3980 0x7fed880c4850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42048/0 (socket says 172.21.15.55:42048) 2024-04-02T07:24:57.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.242+0000 7fed7ea00640 1 -- 172.21.15.55:0/78139846 learned_addr learned my addr 172.21.15.55:0/78139846 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:57.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.242+0000 7fed87400640 1 --2- 172.21.15.55:0/78139846 >> v2:172.21.15.106:3300/0 conn(0x7fed88143f90 0x7fed8815ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:57.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.242+0000 7fed7ea00640 1 -- 172.21.15.55:0/78139846 >> v2:172.21.15.106:3300/0 conn(0x7fed88143f90 msgr2=0x7fed8815ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:57.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.242+0000 7fed7ea00640 1 --2- 172.21.15.55:0/78139846 >> v2:172.21.15.106:3300/0 conn(0x7fed88143f90 0x7fed8815ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.242+0000 7fed7ea00640 1 -- 172.21.15.55:0/78139846 >> v1:172.21.15.55:6789/0 conn(0x7fed880b3980 legacy=0x7fed880c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:57.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.242+0000 7fed7ea00640 1 -- 172.21.15.55:0/78139846 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed880c3a90 con 0x7fed880b34f0 2024-04-02T07:24:57.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.242+0000 7fed87400640 1 --2- 172.21.15.55:0/78139846 >> v2:172.21.15.106:3300/0 conn(0x7fed88143f90 0x7fed8815ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:24:57.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.246+0000 7fed7ea00640 1 --2- 172.21.15.55:0/78139846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed880b34f0 0x7fed880cd370 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fed8806abc0 tx=0x7fed7001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f30d51e214e406 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:57.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.246+0000 7fed86a00640 1 -- 172.21.15.55:0/78139846 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed700ab600 con 0x7fed880b34f0 2024-04-02T07:24:57.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.246+0000 7fed86a00640 1 -- 172.21.15.55:0/78139846 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed700a7050 con 0x7fed880b34f0 2024-04-02T07:24:57.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.246+0000 7fed86a00640 1 -- 172.21.15.55:0/78139846 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed700ab980 con 0x7fed880b34f0 2024-04-02T07:24:57.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.246+0000 7fed8e200640 1 -- 172.21.15.55:0/78139846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed880b34f0 msgr2=0x7fed880cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:57.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.246+0000 7fed8e200640 1 --2- 172.21.15.55:0/78139846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed880b34f0 0x7fed880cd370 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fed8806abc0 tx=0x7fed7001c460 comp rx=0 tx=0).stop 2024-04-02T07:24:57.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.246+0000 7fed8e200640 1 -- 172.21.15.55:0/78139846 shutdown_connections 2024-04-02T07:24:57.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.246+0000 7fed8e200640 1 --2- 172.21.15.55:0/78139846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed880b34f0 0x7fed880cd370 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.246+0000 7fed8e200640 1 --2- 172.21.15.55:0/78139846 >> v2:172.21.15.106:3300/0 conn(0x7fed88143f90 0x7fed8815ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.246+0000 7fed8e200640 1 -- 172.21.15.55:0/78139846 >> 172.21.15.55:0/78139846 conn(0x7fed88066080 msgr2=0x7fed88069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:57.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.246+0000 7fed8e200640 1 -- 172.21.15.55:0/78139846 shutdown_connections 2024-04-02T07:24:57.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.246+0000 7fed8e200640 1 -- 172.21.15.55:0/78139846 wait complete. 2024-04-02T07:24:57.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.246+0000 7fed8e200640 1 Processor -- start 2024-04-02T07:24:57.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.246+0000 7fed8e200640 1 -- start start 2024-04-02T07:24:57.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.246+0000 7fed8e200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed880b34f0 0x7fed88142740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:57.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.246+0000 7fed8e200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed880b3980 0x7fed8815ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:57.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.246+0000 7fed8e200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed88143f90 0x7fed8813dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:57.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.246+0000 7fed8e200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed881f8ca0 con 0x7fed88143f90 2024-04-02T07:24:57.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.246+0000 7fed8e200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed881f8eb0 con 0x7fed880b34f0 2024-04-02T07:24:57.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.246+0000 7fed8e200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed881f9190 con 0x7fed880b3980 2024-04-02T07:24:57.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.250+0000 7fed87e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed88143f90 0x7fed8813dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:57.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.250+0000 7fed87e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed88143f90 0x7fed8813dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35968/0 (socket says 172.21.15.55:35968) 2024-04-02T07:24:57.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.250+0000 7fed87e00640 1 -- 172.21.15.55:0/1530409334 learned_addr learned my addr 172.21.15.55:0/1530409334 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:57.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.250+0000 7fed7ea00640 1 --2- 172.21.15.55:0/1530409334 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed880b3980 0x7fed8815ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:57.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.250+0000 7fed87400640 1 --2- 172.21.15.55:0/1530409334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed880b34f0 0x7fed88142740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:57.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.250+0000 7fed87e00640 1 -- 172.21.15.55:0/1530409334 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed880b3980 msgr2=0x7fed8815ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:57.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.250+0000 7fed87e00640 1 --2- 172.21.15.55:0/1530409334 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed880b3980 0x7fed8815ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.250+0000 7fed87e00640 1 -- 172.21.15.55:0/1530409334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed880b34f0 msgr2=0x7fed88142740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:57.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.250+0000 7fed87e00640 1 --2- 172.21.15.55:0/1530409334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed880b34f0 0x7fed88142740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.250+0000 7fed87e00640 1 -- 172.21.15.55:0/1530409334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed700094d0 con 0x7fed88143f90 2024-04-02T07:24:57.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.250+0000 7fed87e00640 1 --2- 172.21.15.55:0/1530409334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed88143f90 0x7fed8813dc30 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fed8000c7a0 tx=0x7fed8000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:57.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.250+0000 7fed7fe00640 1 -- 172.21.15.55:0/1530409334 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8000a640 con 0x7fed88143f90 2024-04-02T07:24:57.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.250+0000 7fed7fe00640 1 -- 172.21.15.55:0/1530409334 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8000a7a0 con 0x7fed88143f90 2024-04-02T07:24:57.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.250+0000 7fed7fe00640 1 -- 172.21.15.55:0/1530409334 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8000ab10 con 0x7fed88143f90 2024-04-02T07:24:57.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.250+0000 7fed8e200640 1 -- 172.21.15.55:0/1530409334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed881f9470 con 0x7fed88143f90 2024-04-02T07:24:57.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.250+0000 7fed8e200640 1 -- 172.21.15.55:0/1530409334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed881f9a30 con 0x7fed88143f90 2024-04-02T07:24:57.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.250+0000 7fed8e200640 1 -- 172.21.15.55:0/1530409334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed88066c90 con 0x7fed88143f90 2024-04-02T07:24:57.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.250+0000 7fed7fe00640 1 -- 172.21.15.55:0/1530409334 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fed8000ac70 con 0x7fed88143f90 2024-04-02T07:24:57.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.254+0000 7fed7fe00640 1 --2- 172.21.15.55:0/1530409334 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fed64066690 0x7fed64068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:57.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.254+0000 7fed7fe00640 1 -- 172.21.15.55:0/1530409334 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fed80083970 con 0x7fed88143f90 2024-04-02T07:24:57.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.254+0000 7fed87400640 1 --2- 172.21.15.55:0/1530409334 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fed64066690 0x7fed64068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:57.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.254+0000 7fed87400640 1 --2- 172.21.15.55:0/1530409334 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fed64066690 0x7fed64068b50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fed78006fd0 tx=0x7fed78008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:57.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.258+0000 7fed7fe00640 1 -- 172.21.15.55:0/1530409334 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fed80050d80 con 0x7fed88143f90 2024-04-02T07:24:57.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.418+0000 7fed8e200640 1 -- 172.21.15.55:0/1530409334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed880b2880 con 0x7fed88143f90 2024-04-02T07:24:57.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.418+0000 7fed7fe00640 1 -- 172.21.15.55:0/1530409334 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16045 (secure 0 0 0) 0x7fed80017020 con 0x7fed88143f90 2024-04-02T07:24:57.423 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:57.423 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":46,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:24:12.932095+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:24:10.453515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-02T07:24:10.908188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:24:57.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.422+0000 7fed8e200640 1 -- 172.21.15.55:0/1530409334 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fed64066690 msgr2=0x7fed64068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:57.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.422+0000 7fed8e200640 1 --2- 172.21.15.55:0/1530409334 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fed64066690 0x7fed64068b50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fed78006fd0 tx=0x7fed78008040 comp rx=0 tx=0).stop 2024-04-02T07:24:57.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.422+0000 7fed8e200640 1 -- 172.21.15.55:0/1530409334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed88143f90 msgr2=0x7fed8813dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:57.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.422+0000 7fed8e200640 1 --2- 172.21.15.55:0/1530409334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed88143f90 0x7fed8813dc30 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fed8000c7a0 tx=0x7fed8000cc60 comp rx=0 tx=0).stop 2024-04-02T07:24:57.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.422+0000 7fed8e200640 1 -- 172.21.15.55:0/1530409334 shutdown_connections 2024-04-02T07:24:57.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.422+0000 7fed8e200640 1 --2- 172.21.15.55:0/1530409334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fed88143f90 0x7fed8813dc30 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.422+0000 7fed8e200640 1 --2- 172.21.15.55:0/1530409334 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fed880b3980 0x7fed8815ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.422+0000 7fed8e200640 1 --2- 172.21.15.55:0/1530409334 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fed64066690 0x7fed64068b50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.422+0000 7fed8e200640 1 --2- 172.21.15.55:0/1530409334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fed880b34f0 0x7fed88142740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.422+0000 7fed8e200640 1 -- 172.21.15.55:0/1530409334 >> 172.21.15.55:0/1530409334 conn(0x7fed88066080 msgr2=0x7fed88072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:57.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.422+0000 7fed8e200640 1 -- 172.21.15.55:0/1530409334 shutdown_connections 2024-04-02T07:24:57.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.422+0000 7fed8e200640 1 -- 172.21.15.55:0/1530409334 wait complete. 2024-04-02T07:24:57.445 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:24:10.453515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:24:10.908188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:24:57.446 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:24:57.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.586+0000 7f0481600640 1 Processor -- start 2024-04-02T07:24:57.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.586+0000 7f0481600640 1 -- start start 2024-04-02T07:24:57.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.586+0000 7f0481600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f047c144260 0x7f047c0702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:57.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.586+0000 7f0481600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047c070c90 con 0x7f047c0b31a0 2024-04-02T07:24:57.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.586+0000 7f0481600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f047c0b3580 con 0x7f047c0707e0 2024-04-02T07:24:57.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.586+0000 7f0481600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f047c0b37c0 con 0x7f047c144260 2024-04-02T07:24:57.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.586+0000 7f047aa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f047c144260 0x7f047c0702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:57.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.586+0000 7f047aa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f047c144260 0x7f047c0702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35980/0 (socket says 172.21.15.55:35980) 2024-04-02T07:24:57.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.586+0000 7f047aa00640 1 -- 172.21.15.55:0/2730091908 learned_addr learned my addr 172.21.15.55:0/2730091908 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:57.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.586+0000 7f047b400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f047c0b31a0 0x7f047c0b1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42060/0 (socket says 172.21.15.55:42060) 2024-04-02T07:24:57.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.586+0000 7f047aa00640 1 -- 172.21.15.55:0/2730091908 >> v1:172.21.15.106:6789/0 conn(0x7f047c0707e0 legacy=0x7f047c0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:57.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.586+0000 7f047aa00640 1 -- 172.21.15.55:0/2730091908 >> v1:172.21.15.55:6789/0 conn(0x7f047c0b31a0 legacy=0x7f047c0b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:57.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.586+0000 7f047aa00640 1 -- 172.21.15.55:0/2730091908 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f047c15e3a0 con 0x7f047c144260 2024-04-02T07:24:57.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.590+0000 7f047aa00640 1 --2- 172.21.15.55:0/2730091908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f047c144260 0x7f047c0702a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f046c009870 tx=0x7f046c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d57e835773cdfb7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:57.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.590+0000 7f047a000640 1 -- 172.21.15.55:0/2730091908 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c0ab650 con 0x7f047c144260 2024-04-02T07:24:57.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.590+0000 7f047a000640 1 -- 172.21.15.55:0/2730091908 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f046c0ab7b0 con 0x7f047c144260 2024-04-02T07:24:57.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.590+0000 7f047a000640 1 -- 172.21.15.55:0/2730091908 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f046c0abb40 con 0x7f047c144260 2024-04-02T07:24:57.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.590+0000 7f0481600640 1 -- 172.21.15.55:0/2730091908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f047c144260 msgr2=0x7f047c0702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:57.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.590+0000 7f0481600640 1 --2- 172.21.15.55:0/2730091908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f047c144260 0x7f047c0702a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f046c009870 tx=0x7f046c01c560 comp rx=0 tx=0).stop 2024-04-02T07:24:57.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.590+0000 7f0481600640 1 -- 172.21.15.55:0/2730091908 shutdown_connections 2024-04-02T07:24:57.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.590+0000 7f0481600640 1 --2- 172.21.15.55:0/2730091908 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f047c144260 0x7f047c0702a0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.590+0000 7f0481600640 1 -- 172.21.15.55:0/2730091908 >> 172.21.15.55:0/2730091908 conn(0x7f047c06a390 msgr2=0x7f047c0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:57.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.590+0000 7f0481600640 1 -- 172.21.15.55:0/2730091908 shutdown_connections 2024-04-02T07:24:57.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.590+0000 7f0481600640 1 -- 172.21.15.55:0/2730091908 wait complete. 2024-04-02T07:24:57.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f0481600640 1 Processor -- start 2024-04-02T07:24:57.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f0481600640 1 -- start start 2024-04-02T07:24:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f0481600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f047c0707e0 0x7f047c1552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f0481600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f047c0b31a0 0x7f047c139b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f0481600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f047c144260 0x7f047c1f96b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f0481600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047c13a060 con 0x7f047c144260 2024-04-02T07:24:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f0481600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f047c13aad0 con 0x7f047c0b31a0 2024-04-02T07:24:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f0481600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f047c1f9bf0 con 0x7f047c0707e0 2024-04-02T07:24:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f047b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f047c144260 0x7f047c1f96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f047b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f047c144260 0x7f047c1f96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35994/0 (socket says 172.21.15.55:35994) 2024-04-02T07:24:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f047b400640 1 -- 172.21.15.55:0/451701261 learned_addr learned my addr 172.21.15.55:0/451701261 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f047aa00640 1 --2- 172.21.15.55:0/451701261 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f047c0707e0 0x7f047c1552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f0472000640 1 --2- 172.21.15.55:0/451701261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f047c0b31a0 0x7f047c139b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f047b400640 1 -- 172.21.15.55:0/451701261 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f047c0707e0 msgr2=0x7f047c1552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:57.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f047b400640 1 --2- 172.21.15.55:0/451701261 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f047c0707e0 0x7f047c1552c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f047b400640 1 -- 172.21.15.55:0/451701261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f047c0b31a0 msgr2=0x7f047c139b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:57.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f047b400640 1 --2- 172.21.15.55:0/451701261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f047c0b31a0 0x7f047c139b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f047b400640 1 -- 172.21.15.55:0/451701261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f046c0094d0 con 0x7f047c144260 2024-04-02T07:24:57.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f047b400640 1 --2- 172.21.15.55:0/451701261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f047c144260 0x7f047c1f96b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f047400c7d0 tx=0x7f047400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:57.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f0473400640 1 -- 172.21.15.55:0/451701261 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047400a640 con 0x7f047c144260 2024-04-02T07:24:57.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f0473400640 1 -- 172.21.15.55:0/451701261 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f047400a7a0 con 0x7f047c144260 2024-04-02T07:24:57.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f0473400640 1 -- 172.21.15.55:0/451701261 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f047400ab10 con 0x7f047c144260 2024-04-02T07:24:57.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f0481600640 1 -- 172.21.15.55:0/451701261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f047c1564b0 con 0x7f047c144260 2024-04-02T07:24:57.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f0481600640 1 -- 172.21.15.55:0/451701261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f047c155b80 con 0x7f047c144260 2024-04-02T07:24:57.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.594+0000 7f0481600640 1 -- 172.21.15.55:0/451701261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f047c073530 con 0x7f047c144260 2024-04-02T07:24:57.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.598+0000 7f0473400640 1 -- 172.21.15.55:0/451701261 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f047400ac70 con 0x7f047c144260 2024-04-02T07:24:57.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.598+0000 7f0473400640 1 --2- 172.21.15.55:0/451701261 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f04580666c0 0x7f0458068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:57.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.598+0000 7f0473400640 1 -- 172.21.15.55:0/451701261 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0474083810 con 0x7f047c144260 2024-04-02T07:24:57.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.598+0000 7f047aa00640 1 --2- 172.21.15.55:0/451701261 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f04580666c0 0x7f0458068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:57.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.598+0000 7f047aa00640 1 --2- 172.21.15.55:0/451701261 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f04580666c0 0x7f0458068b80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f046c0af000 tx=0x7f046c0b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:57.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.602+0000 7f0473400640 1 -- 172.21.15.55:0/451701261 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0474050b90 con 0x7f047c144260 2024-04-02T07:24:57.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.758+0000 7f0481600640 1 -- 172.21.15.55:0/451701261 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f047c1406c0 con 0x7f047c144260 2024-04-02T07:24:57.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.762+0000 7f0473400640 1 -- 172.21.15.55:0/451701261 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v46) v1 ==== 93+0+10 (secure 0 0 0) 0x7f047c1406c0 con 0x7f047c144260 2024-04-02T07:24:57.764 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:24:57.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.762+0000 7f0481600640 1 -- 172.21.15.55:0/451701261 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f04580666c0 msgr2=0x7f0458068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:57.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.762+0000 7f0481600640 1 --2- 172.21.15.55:0/451701261 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f04580666c0 0x7f0458068b80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f046c0af000 tx=0x7f046c0b6040 comp rx=0 tx=0).stop 2024-04-02T07:24:57.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.762+0000 7f0481600640 1 -- 172.21.15.55:0/451701261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f047c144260 msgr2=0x7f047c1f96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:57.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.762+0000 7f0481600640 1 --2- 172.21.15.55:0/451701261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f047c144260 0x7f047c1f96b0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f047400c7d0 tx=0x7f047400cc90 comp rx=0 tx=0).stop 2024-04-02T07:24:57.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.762+0000 7f0481600640 1 -- 172.21.15.55:0/451701261 shutdown_connections 2024-04-02T07:24:57.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.762+0000 7f0481600640 1 --2- 172.21.15.55:0/451701261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f047c144260 0x7f047c1f96b0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.762+0000 7f0481600640 1 --2- 172.21.15.55:0/451701261 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f04580666c0 0x7f0458068b80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.762+0000 7f0481600640 1 --2- 172.21.15.55:0/451701261 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f047c0b31a0 0x7f047c139b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.762+0000 7f0481600640 1 --2- 172.21.15.55:0/451701261 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f047c0707e0 0x7f047c1552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.762+0000 7f0481600640 1 -- 172.21.15.55:0/451701261 >> 172.21.15.55:0/451701261 conn(0x7f047c06a390 msgr2=0x7f047c0b15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:57.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.762+0000 7f0481600640 1 -- 172.21.15.55:0/451701261 shutdown_connections 2024-04-02T07:24:57.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.762+0000 7f0481600640 1 -- 172.21.15.55:0/451701261 wait complete. 2024-04-02T07:24:57.784 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:24:57.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.922+0000 7fa2a3000640 1 Processor -- start 2024-04-02T07:24:57.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.922+0000 7fa2a3000640 1 -- start start 2024-04-02T07:24:57.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.926+0000 7fa2a3000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa29c144260 0x7fa29c0702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:57.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.926+0000 7fa2a3000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa29c0707e0 0x7fa29c0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:57.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.926+0000 7fa2a3000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa29c0b2fd0 0x7fa29c0cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:57.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.926+0000 7fa2a3000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c0b37c0 con 0x7fa29c0707e0 2024-04-02T07:24:57.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.926+0000 7fa2a3000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa29c070c90 con 0x7fa29c144260 2024-04-02T07:24:57.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.926+0000 7fa2a3000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c15e3a0 con 0x7fa29c0b2fd0 2024-04-02T07:24:57.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.926+0000 7fa293e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa29c0707e0 0x7fa29c0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:57.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.926+0000 7fa293e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa29c0707e0 0x7fa29c0b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35998/0 (socket says 172.21.15.55:35998) 2024-04-02T07:24:57.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.926+0000 7fa293e00640 1 -- 172.21.15.55:0/3668207054 learned_addr learned my addr 172.21.15.55:0/3668207054 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:57.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.926+0000 7fa2a1000640 1 --2- 172.21.15.55:0/3668207054 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa29c0b2fd0 0x7fa29c0cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:57.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.926+0000 7fa29be00640 1 --2- 172.21.15.55:0/3668207054 >> v2:172.21.15.106:3300/0 conn(0x7fa29c144260 0x7fa29c0702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:57.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.926+0000 7fa293e00640 1 -- 172.21.15.55:0/3668207054 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa29c0b2fd0 msgr2=0x7fa29c0cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:57.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.926+0000 7fa293e00640 1 --2- 172.21.15.55:0/3668207054 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa29c0b2fd0 0x7fa29c0cc4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.926+0000 7fa293e00640 1 -- 172.21.15.55:0/3668207054 >> v2:172.21.15.106:3300/0 conn(0x7fa29c144260 msgr2=0x7fa29c0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:57.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.926+0000 7fa293e00640 1 --2- 172.21.15.55:0/3668207054 >> v2:172.21.15.106:3300/0 conn(0x7fa29c144260 0x7fa29c0702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.926+0000 7fa293e00640 1 -- 172.21.15.55:0/3668207054 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa29c15e5f0 con 0x7fa29c0707e0 2024-04-02T07:24:57.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.930+0000 7fa293e00640 1 --2- 172.21.15.55:0/3668207054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa29c0707e0 0x7fa29c0b2a90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa29c06aa30 tx=0x7fa28401c260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b912d7c723e04133 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:57.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.930+0000 7fa29b400640 1 -- 172.21.15.55:0/3668207054 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2840ab600 con 0x7fa29c0707e0 2024-04-02T07:24:57.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.930+0000 7fa29b400640 1 -- 172.21.15.55:0/3668207054 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2840a7050 con 0x7fa29c0707e0 2024-04-02T07:24:57.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.930+0000 7fa29b400640 1 -- 172.21.15.55:0/3668207054 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2840ab980 con 0x7fa29c0707e0 2024-04-02T07:24:57.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.930+0000 7fa2a3000640 1 -- 172.21.15.55:0/3668207054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa29c0707e0 msgr2=0x7fa29c0b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:57.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.930+0000 7fa2a3000640 1 --2- 172.21.15.55:0/3668207054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa29c0707e0 0x7fa29c0b2a90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa29c06aa30 tx=0x7fa28401c260 comp rx=0 tx=0).stop 2024-04-02T07:24:57.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.930+0000 7fa2a3000640 1 -- 172.21.15.55:0/3668207054 shutdown_connections 2024-04-02T07:24:57.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.930+0000 7fa2a3000640 1 --2- 172.21.15.55:0/3668207054 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa29c0b2fd0 0x7fa29c0cc4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.930+0000 7fa2a3000640 1 --2- 172.21.15.55:0/3668207054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa29c0707e0 0x7fa29c0b2a90 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.930+0000 7fa2a3000640 1 --2- 172.21.15.55:0/3668207054 >> v2:172.21.15.106:3300/0 conn(0x7fa29c144260 0x7fa29c0702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.930+0000 7fa2a3000640 1 -- 172.21.15.55:0/3668207054 >> 172.21.15.55:0/3668207054 conn(0x7fa29c06a390 msgr2=0x7fa29c0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:57.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.930+0000 7fa2a3000640 1 -- 172.21.15.55:0/3668207054 shutdown_connections 2024-04-02T07:24:57.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.930+0000 7fa2a3000640 1 -- 172.21.15.55:0/3668207054 wait complete. 2024-04-02T07:24:57.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.930+0000 7fa2a3000640 1 Processor -- start 2024-04-02T07:24:57.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.930+0000 7fa2a3000640 1 -- start start 2024-04-02T07:24:57.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.930+0000 7fa2a3000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa29c0707e0 0x7fa29c1369b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:57.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa2a3000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa29c0b2fd0 0x7fa29c138a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:57.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa2a3000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa29c144260 0x7fa29c1548a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:57.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa2a3000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c1377e0 con 0x7fa29c0707e0 2024-04-02T07:24:57.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa2a3000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c1379f0 con 0x7fa29c0b2fd0 2024-04-02T07:24:57.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa2a3000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa29c137cd0 con 0x7fa29c144260 2024-04-02T07:24:57.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa29be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa29c0707e0 0x7fa29c1369b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa29be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa29c0707e0 0x7fa29c1369b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36014/0 (socket says 172.21.15.55:36014) 2024-04-02T07:24:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa29be00640 1 -- 172.21.15.55:0/4017772406 learned_addr learned my addr 172.21.15.55:0/4017772406 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa293e00640 1 --2- 172.21.15.55:0/4017772406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa29c0b2fd0 0x7fa29c138a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa2a1000640 1 --2- 172.21.15.55:0/4017772406 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa29c144260 0x7fa29c1548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa29be00640 1 -- 172.21.15.55:0/4017772406 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa29c144260 msgr2=0x7fa29c1548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa29be00640 1 --2- 172.21.15.55:0/4017772406 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa29c144260 0x7fa29c1548a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa29be00640 1 -- 172.21.15.55:0/4017772406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa29c0b2fd0 msgr2=0x7fa29c138a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa29be00640 1 --2- 172.21.15.55:0/4017772406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa29c0b2fd0 0x7fa29c138a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa29be00640 1 -- 172.21.15.55:0/4017772406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2840094d0 con 0x7fa29c0707e0 2024-04-02T07:24:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa29be00640 1 --2- 172.21.15.55:0/4017772406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa29c0707e0 0x7fa29c1369b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00e870 tx=0x7fa28c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:57.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa298c00640 1 -- 172.21.15.55:0/4017772406 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c009510 con 0x7fa29c0707e0 2024-04-02T07:24:57.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa298c00640 1 -- 172.21.15.55:0/4017772406 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c00eec0 con 0x7fa29c0707e0 2024-04-02T07:24:57.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa298c00640 1 -- 172.21.15.55:0/4017772406 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28c00cb40 con 0x7fa29c0707e0 2024-04-02T07:24:57.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa2a3000640 1 -- 172.21.15.55:0/4017772406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29c137fb0 con 0x7fa29c0707e0 2024-04-02T07:24:57.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa2a3000640 1 -- 172.21.15.55:0/4017772406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29c138570 con 0x7fa29c0707e0 2024-04-02T07:24:57.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa2a3000640 1 -- 172.21.15.55:0/4017772406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29c073530 con 0x7fa29c0707e0 2024-04-02T07:24:57.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.934+0000 7fa298c00640 1 -- 172.21.15.55:0/4017772406 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa28c00cca0 con 0x7fa29c0707e0 2024-04-02T07:24:57.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.938+0000 7fa298c00640 1 --2- 172.21.15.55:0/4017772406 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa278066690 0x7fa278068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.938+0000 7fa298c00640 1 -- 172.21.15.55:0/4017772406 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa28c0842f0 con 0x7fa29c0707e0 2024-04-02T07:24:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.938+0000 7fa293e00640 1 --2- 172.21.15.55:0/4017772406 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa278066690 0x7fa278068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.938+0000 7fa293e00640 1 --2- 172.21.15.55:0/4017772406 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa278066690 0x7fa278068b50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa2840ad000 tx=0x7fa284008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:57.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:57.942+0000 7fa298c00640 1 -- 172.21.15.55:0/4017772406 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa28c051670 con 0x7fa29c0707e0 2024-04-02T07:24:58.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.102+0000 7fa2a3000640 1 -- 172.21.15.55:0/4017772406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa29c13a6f0 con 0x7fa29c0707e0 2024-04-02T07:24:58.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.102+0000 7fa298c00640 1 -- 172.21.15.55:0/4017772406 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v46) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa28c054c90 con 0x7fa29c0707e0 2024-04-02T07:24:58.107 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:24:58.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.106+0000 7fa2a3000640 1 -- 172.21.15.55:0/4017772406 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa278066690 msgr2=0x7fa278068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:58.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.106+0000 7fa2a3000640 1 --2- 172.21.15.55:0/4017772406 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa278066690 0x7fa278068b50 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fa2840ad000 tx=0x7fa284008040 comp rx=0 tx=0).stop 2024-04-02T07:24:58.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.106+0000 7fa2a3000640 1 -- 172.21.15.55:0/4017772406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa29c0707e0 msgr2=0x7fa29c1369b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:58.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.106+0000 7fa2a3000640 1 --2- 172.21.15.55:0/4017772406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa29c0707e0 0x7fa29c1369b0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fa28c00e870 tx=0x7fa28c00ec70 comp rx=0 tx=0).stop 2024-04-02T07:24:58.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.106+0000 7fa2a3000640 1 -- 172.21.15.55:0/4017772406 shutdown_connections 2024-04-02T07:24:58.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.106+0000 7fa2a3000640 1 --2- 172.21.15.55:0/4017772406 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa29c144260 0x7fa29c1548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.106+0000 7fa2a3000640 1 --2- 172.21.15.55:0/4017772406 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa278066690 0x7fa278068b50 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.106+0000 7fa2a3000640 1 --2- 172.21.15.55:0/4017772406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa29c0b2fd0 0x7fa29c138a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.106+0000 7fa2a3000640 1 --2- 172.21.15.55:0/4017772406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa29c0707e0 0x7fa29c1369b0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.106+0000 7fa2a3000640 1 -- 172.21.15.55:0/4017772406 >> 172.21.15.55:0/4017772406 conn(0x7fa29c06a390 msgr2=0x7fa29c142f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:58.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.106+0000 7fa2a3000640 1 -- 172.21.15.55:0/4017772406 shutdown_connections 2024-04-02T07:24:58.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.106+0000 7fa2a3000640 1 -- 172.21.15.55:0/4017772406 wait complete. 2024-04-02T07:24:58.128 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:24:58.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.266+0000 7f56b2a00640 1 Processor -- start 2024-04-02T07:24:58.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.270+0000 7f56b2a00640 1 -- start start 2024-04-02T07:24:58.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.270+0000 7f56b2a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56ac144260 0x7f56ac0702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:58.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.270+0000 7f56b2a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f56ac0b31a0 0x7f56ac0b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:58.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.270+0000 7f56b2a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56ac070c90 con 0x7f56ac0707e0 2024-04-02T07:24:58.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.270+0000 7f56b2a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ac0b37c0 con 0x7f56ac144260 2024-04-02T07:24:58.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.270+0000 7f56b2a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56ac0b3580 con 0x7f56ac0b31a0 2024-04-02T07:24:58.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.270+0000 7f56abe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56ac144260 0x7f56ac0702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:58.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.270+0000 7f56abe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56ac144260 0x7f56ac0702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36022/0 (socket says 172.21.15.55:36022) 2024-04-02T07:24:58.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.270+0000 7f56abe00640 1 -- 172.21.15.55:0/2313383031 learned_addr learned my addr 172.21.15.55:0/2313383031 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:58.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.270+0000 7f56b0a00640 1 --2- 172.21.15.55:0/2313383031 >> v2:172.21.15.106:3300/0 conn(0x7f56ac0b31a0 0x7f56ac0b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:58.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.270+0000 7f56abe00640 1 -- 172.21.15.55:0/2313383031 >> v2:172.21.15.106:3300/0 conn(0x7f56ac0b31a0 msgr2=0x7f56ac0b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:58.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.270+0000 7f56abe00640 1 --2- 172.21.15.55:0/2313383031 >> v2:172.21.15.106:3300/0 conn(0x7f56ac0b31a0 0x7f56ac0b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.270+0000 7f56abe00640 1 -- 172.21.15.55:0/2313383031 >> v1:172.21.15.106:6789/0 conn(0x7f56ac0707e0 legacy=0x7f56ac0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:58.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.270+0000 7f56abe00640 1 -- 172.21.15.55:0/2313383031 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ac15e3a0 con 0x7f56ac144260 2024-04-02T07:24:58.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.270+0000 7f56b0a00640 1 --2- 172.21.15.55:0/2313383031 >> v2:172.21.15.106:3300/0 conn(0x7f56ac0b31a0 0x7f56ac0b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:24:58.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.274+0000 7f56abe00640 1 --2- 172.21.15.55:0/2313383031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56ac144260 0x7f56ac0702a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f56ac06ac10 tx=0x7f569c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638924bcf37303fa server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:58.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.274+0000 7f56ab400640 1 -- 172.21.15.55:0/2313383031 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c0ac630 con 0x7f56ac144260 2024-04-02T07:24:58.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.274+0000 7f56ab400640 1 -- 172.21.15.55:0/2313383031 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f569c0ac790 con 0x7f56ac144260 2024-04-02T07:24:58.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.274+0000 7f56ab400640 1 -- 172.21.15.55:0/2313383031 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f569c0acb20 con 0x7f56ac144260 2024-04-02T07:24:58.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.274+0000 7f56b2a00640 1 -- 172.21.15.55:0/2313383031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56ac144260 msgr2=0x7f56ac0702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:58.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.274+0000 7f56b2a00640 1 --2- 172.21.15.55:0/2313383031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56ac144260 0x7f56ac0702a0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f56ac06ac10 tx=0x7f569c01c4e0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.274+0000 7f56b2a00640 1 -- 172.21.15.55:0/2313383031 shutdown_connections 2024-04-02T07:24:58.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.274+0000 7f56b2a00640 1 --2- 172.21.15.55:0/2313383031 >> v2:172.21.15.106:3300/0 conn(0x7f56ac0b31a0 0x7f56ac0b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.274+0000 7f56b2a00640 1 --2- 172.21.15.55:0/2313383031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56ac144260 0x7f56ac0702a0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.274+0000 7f56b2a00640 1 -- 172.21.15.55:0/2313383031 >> 172.21.15.55:0/2313383031 conn(0x7f56ac06a390 msgr2=0x7f56ac0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:58.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.274+0000 7f56b2a00640 1 -- 172.21.15.55:0/2313383031 shutdown_connections 2024-04-02T07:24:58.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.274+0000 7f56b2a00640 1 -- 172.21.15.55:0/2313383031 wait complete. 2024-04-02T07:24:58.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.274+0000 7f56b2a00640 1 Processor -- start 2024-04-02T07:24:58.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.274+0000 7f56b2a00640 1 -- start start 2024-04-02T07:24:58.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56b2a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56ac0707e0 0x7f56ac1f4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:58.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56b2a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56ac0b31a0 0x7f56ac142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:58.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56b2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56ac144260 0x7f56ac142550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:58.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56b2a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac155530 con 0x7f56ac144260 2024-04-02T07:24:58.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56b2a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac155810 con 0x7f56ac0b31a0 2024-04-02T07:24:58.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56b2a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56ac155af0 con 0x7f56ac0707e0 2024-04-02T07:24:58.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56b0a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56ac144260 0x7f56ac142550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:58.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56b0a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56ac144260 0x7f56ac142550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36032/0 (socket says 172.21.15.55:36032) 2024-04-02T07:24:58.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56b0a00640 1 -- 172.21.15.55:0/2025558810 learned_addr learned my addr 172.21.15.55:0/2025558810 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:58.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56abe00640 1 --2- 172.21.15.55:0/2025558810 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56ac0707e0 0x7f56ac1f4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:58.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56a3e00640 1 --2- 172.21.15.55:0/2025558810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56ac0b31a0 0x7f56ac142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:58.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56b0a00640 1 -- 172.21.15.55:0/2025558810 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56ac0707e0 msgr2=0x7f56ac1f4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:58.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56b0a00640 1 --2- 172.21.15.55:0/2025558810 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56ac0707e0 0x7f56ac1f4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56b0a00640 1 -- 172.21.15.55:0/2025558810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56ac0b31a0 msgr2=0x7f56ac142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:58.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56b0a00640 1 --2- 172.21.15.55:0/2025558810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56ac0b31a0 0x7f56ac142010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56b0a00640 1 -- 172.21.15.55:0/2025558810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f569c0094d0 con 0x7f56ac144260 2024-04-02T07:24:58.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56b0a00640 1 --2- 172.21.15.55:0/2025558810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56ac144260 0x7f56ac142550 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f56a400cef0 tx=0x7f56a400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:58.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56a8c00640 1 -- 172.21.15.55:0/2025558810 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a400d840 con 0x7f56ac144260 2024-04-02T07:24:58.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56a8c00640 1 -- 172.21.15.55:0/2025558810 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56a400d9c0 con 0x7f56ac144260 2024-04-02T07:24:58.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56a8c00640 1 -- 172.21.15.55:0/2025558810 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56a400dd70 con 0x7f56ac144260 2024-04-02T07:24:58.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56b2a00640 1 -- 172.21.15.55:0/2025558810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56ac155dd0 con 0x7f56ac144260 2024-04-02T07:24:58.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56b2a00640 1 -- 172.21.15.55:0/2025558810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56ac1f4dd0 con 0x7f56ac144260 2024-04-02T07:24:58.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56b2a00640 1 -- 172.21.15.55:0/2025558810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56ac073530 con 0x7f56ac144260 2024-04-02T07:24:58.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.278+0000 7f56a8c00640 1 -- 172.21.15.55:0/2025558810 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f56a401e3b0 con 0x7f56ac144260 2024-04-02T07:24:58.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.282+0000 7f56a8c00640 1 --2- 172.21.15.55:0/2025558810 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5688066690 0x7f5688068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:58.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.282+0000 7f56a8c00640 1 -- 172.21.15.55:0/2025558810 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56a4084c00 con 0x7f56ac144260 2024-04-02T07:24:58.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.282+0000 7f56abe00640 1 --2- 172.21.15.55:0/2025558810 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5688066690 0x7f5688068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:58.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.282+0000 7f56abe00640 1 --2- 172.21.15.55:0/2025558810 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5688066690 0x7f5688068b50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f569c0ae000 tx=0x7f569c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:58.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.286+0000 7f56a8c00640 1 -- 172.21.15.55:0/2025558810 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f56a4052040 con 0x7f56ac144260 2024-04-02T07:24:58.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.446+0000 7f56b2a00640 1 -- 172.21.15.55:0/2025558810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f56ac1f5050 con 0x7f56ac144260 2024-04-02T07:24:58.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.446+0000 7f56a8c00640 1 -- 172.21.15.55:0/2025558810 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v46) v1 ==== 100+0+11 (secure 0 0 0) 0x7f56a401a020 con 0x7f56ac144260 2024-04-02T07:24:58.448 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:24:58.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.446+0000 7f56b2a00640 1 -- 172.21.15.55:0/2025558810 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5688066690 msgr2=0x7f5688068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:58.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.446+0000 7f56b2a00640 1 --2- 172.21.15.55:0/2025558810 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5688066690 0x7f5688068b50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f569c0ae000 tx=0x7f569c008040 comp rx=0 tx=0).stop 2024-04-02T07:24:58.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.446+0000 7f56b2a00640 1 -- 172.21.15.55:0/2025558810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56ac144260 msgr2=0x7f56ac142550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:58.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.446+0000 7f56b2a00640 1 --2- 172.21.15.55:0/2025558810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56ac144260 0x7f56ac142550 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f56a400cef0 tx=0x7f56a400a710 comp rx=0 tx=0).stop 2024-04-02T07:24:58.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.446+0000 7f56b2a00640 1 -- 172.21.15.55:0/2025558810 shutdown_connections 2024-04-02T07:24:58.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.446+0000 7f56b2a00640 1 --2- 172.21.15.55:0/2025558810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56ac144260 0x7f56ac142550 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.446+0000 7f56b2a00640 1 --2- 172.21.15.55:0/2025558810 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5688066690 0x7f5688068b50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.446+0000 7f56b2a00640 1 --2- 172.21.15.55:0/2025558810 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56ac0b31a0 0x7f56ac142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.446+0000 7f56b2a00640 1 --2- 172.21.15.55:0/2025558810 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56ac0707e0 0x7f56ac1f4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.446+0000 7f56b2a00640 1 -- 172.21.15.55:0/2025558810 >> 172.21.15.55:0/2025558810 conn(0x7f56ac06a390 msgr2=0x7f56ac0cb0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:58.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.446+0000 7f56b2a00640 1 -- 172.21.15.55:0/2025558810 shutdown_connections 2024-04-02T07:24:58.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.446+0000 7f56b2a00640 1 -- 172.21.15.55:0/2025558810 wait complete. 2024-04-02T07:24:58.469 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:24:58.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.606+0000 7f3085a00640 1 Processor -- start 2024-04-02T07:24:58.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.606+0000 7f3085a00640 1 -- start start 2024-04-02T07:24:58.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.606+0000 7f3085a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30800cb5b0 0x7f308006ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:58.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.606+0000 7f3085a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f30800af920 0x7f308006cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:58.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.606+0000 7f3085a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30800c9ff0 con 0x7f308015aad0 2024-04-02T07:24:58.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.606+0000 7f3085a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30800c93e0 con 0x7f30800af920 2024-04-02T07:24:58.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.606+0000 7f3085a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30800c96c0 con 0x7f30800cb5b0 2024-04-02T07:24:58.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.610+0000 7f307ea00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f308015aad0 0x7f30800caea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42072/0 (socket says 172.21.15.55:42072) 2024-04-02T07:24:58.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.610+0000 7f307ea00640 1 -- 172.21.15.55:0/3214651652 learned_addr learned my addr 172.21.15.55:0/3214651652 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:58.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.610+0000 7f307f400640 1 --2- 172.21.15.55:0/3214651652 >> v2:172.21.15.55:3300/0 conn(0x7f30800af920 0x7f308006cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:58.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.610+0000 7f3076000640 1 --2- 172.21.15.55:0/3214651652 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30800cb5b0 0x7f308006ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:58.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.610+0000 7f307f400640 1 -- 172.21.15.55:0/3214651652 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30800cb5b0 msgr2=0x7f308006ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:58.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.610+0000 7f307f400640 1 --2- 172.21.15.55:0/3214651652 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30800cb5b0 0x7f308006ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.610+0000 7f307f400640 1 -- 172.21.15.55:0/3214651652 >> v1:172.21.15.55:6789/0 conn(0x7f308015aad0 legacy=0x7f30800caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:58.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.610+0000 7f307f400640 1 -- 172.21.15.55:0/3214651652 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30800c99a0 con 0x7f30800af920 2024-04-02T07:24:58.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.610+0000 7f307e000640 1 -- 172.21.15.55:0/3214651652 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122991134 0 0) 0x7f30800c9ff0 con 0x7f308015aad0 2024-04-02T07:24:58.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.610+0000 7f307f400640 1 --2- 172.21.15.55:0/3214651652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30800af920 0x7f308006cf40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3078009d90 tx=0x7f307801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e097205a414789c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:58.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.610+0000 7f307e000640 1 -- 172.21.15.55:0/3214651652 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30780a5990 con 0x7f30800af920 2024-04-02T07:24:58.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.610+0000 7f307e000640 1 -- 172.21.15.55:0/3214651652 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30780a5af0 con 0x7f30800af920 2024-04-02T07:24:58.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.610+0000 7f307e000640 1 -- 172.21.15.55:0/3214651652 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30780a5e80 con 0x7f30800af920 2024-04-02T07:24:58.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f3085a00640 1 -- 172.21.15.55:0/3214651652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30800af920 msgr2=0x7f308006cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:58.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f3085a00640 1 --2- 172.21.15.55:0/3214651652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30800af920 0x7f308006cf40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f3078009d90 tx=0x7f307801c8b0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f3085a00640 1 -- 172.21.15.55:0/3214651652 shutdown_connections 2024-04-02T07:24:58.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f3085a00640 1 --2- 172.21.15.55:0/3214651652 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30800cb5b0 0x7f308006ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f3085a00640 1 --2- 172.21.15.55:0/3214651652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30800af920 0x7f308006cf40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f3085a00640 1 -- 172.21.15.55:0/3214651652 >> 172.21.15.55:0/3214651652 conn(0x7f3080069d90 msgr2=0x7f308006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:58.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f3085a00640 1 -- 172.21.15.55:0/3214651652 shutdown_connections 2024-04-02T07:24:58.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f3085a00640 1 -- 172.21.15.55:0/3214651652 wait complete. 2024-04-02T07:24:58.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f3085a00640 1 Processor -- start 2024-04-02T07:24:58.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f3085a00640 1 -- start start 2024-04-02T07:24:58.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f3085a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30800af920 0x7f3080142970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:58.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f3085a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30800cb5b0 0x7f308014b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:58.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f3085a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f308015aad0 0x7f30800cd620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:58.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f3085a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308014e290 con 0x7f30800af920 2024-04-02T07:24:58.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f3085a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308014d1f0 con 0x7f308015aad0 2024-04-02T07:24:58.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f3085a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308014d4d0 con 0x7f30800cb5b0 2024-04-02T07:24:58.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f307ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30800af920 0x7f3080142970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:58.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f307ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30800af920 0x7f3080142970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36048/0 (socket says 172.21.15.55:36048) 2024-04-02T07:24:58.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f307ea00640 1 -- 172.21.15.55:0/2024212263 learned_addr learned my addr 172.21.15.55:0/2024212263 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:58.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f307f400640 1 --2- 172.21.15.55:0/2024212263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f308015aad0 0x7f30800cd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:58.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f3076000640 1 --2- 172.21.15.55:0/2024212263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30800cb5b0 0x7f308014b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:58.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f307ea00640 1 -- 172.21.15.55:0/2024212263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30800cb5b0 msgr2=0x7f308014b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:58.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f307ea00640 1 --2- 172.21.15.55:0/2024212263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30800cb5b0 0x7f308014b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f307ea00640 1 -- 172.21.15.55:0/2024212263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f308015aad0 msgr2=0x7f30800cd620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:58.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f307ea00640 1 --2- 172.21.15.55:0/2024212263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f308015aad0 0x7f30800cd620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f307ea00640 1 -- 172.21.15.55:0/2024212263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3078009a70 con 0x7f30800af920 2024-04-02T07:24:58.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.614+0000 7f307ea00640 1 --2- 172.21.15.55:0/2024212263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30800af920 0x7f3080142970 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f307000c480 tx=0x7f307000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:58.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.618+0000 7f3077400640 1 -- 172.21.15.55:0/2024212263 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30700074e0 con 0x7f30800af920 2024-04-02T07:24:58.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.618+0000 7f3077400640 1 -- 172.21.15.55:0/2024212263 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3070007660 con 0x7f30800af920 2024-04-02T07:24:58.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.618+0000 7f3077400640 1 -- 172.21.15.55:0/2024212263 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3070004a30 con 0x7f30800af920 2024-04-02T07:24:58.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.618+0000 7f3085a00640 1 -- 172.21.15.55:0/2024212263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f308014d7b0 con 0x7f30800af920 2024-04-02T07:24:58.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.618+0000 7f3085a00640 1 -- 172.21.15.55:0/2024212263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f308014dd70 con 0x7f30800af920 2024-04-02T07:24:58.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.618+0000 7f3085a00640 1 -- 172.21.15.55:0/2024212263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f308006e240 con 0x7f30800af920 2024-04-02T07:24:58.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.618+0000 7f3077400640 1 -- 172.21.15.55:0/2024212263 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3070004b90 con 0x7f30800af920 2024-04-02T07:24:58.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.618+0000 7f3077400640 1 --2- 172.21.15.55:0/2024212263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f305c0666c0 0x7f305c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:58.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.618+0000 7f3077400640 1 -- 172.21.15.55:0/2024212263 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3070083320 con 0x7f30800af920 2024-04-02T07:24:58.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.618+0000 7f3076000640 1 --2- 172.21.15.55:0/2024212263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f305c0666c0 0x7f305c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:58.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.622+0000 7f3076000640 1 --2- 172.21.15.55:0/2024212263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f305c0666c0 0x7f305c068b80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3080071640 tx=0x7f3068008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:58.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.622+0000 7f3077400640 1 -- 172.21.15.55:0/2024212263 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3070054110 con 0x7f30800af920 2024-04-02T07:24:58.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.794+0000 7f3085a00640 1 -- 172.21.15.55:0/2024212263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f308014df90 con 0x7f30800af920 2024-04-02T07:24:58.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.794+0000 7f3077400640 1 -- 172.21.15.55:0/2024212263 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v46) v1 ==== 80+0+0 (secure 0 0 0) 0x7f3070053ca0 con 0x7f30800af920 2024-04-02T07:24:58.799 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:24:58.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.798+0000 7f3085a00640 1 -- 172.21.15.55:0/2024212263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f305c0666c0 msgr2=0x7f305c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:58.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.798+0000 7f3085a00640 1 --2- 172.21.15.55:0/2024212263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f305c0666c0 0x7f305c068b80 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f3080071640 tx=0x7f3068008040 comp rx=0 tx=0).stop 2024-04-02T07:24:58.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.798+0000 7f3085a00640 1 -- 172.21.15.55:0/2024212263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30800af920 msgr2=0x7f3080142970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:58.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.798+0000 7f3085a00640 1 --2- 172.21.15.55:0/2024212263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30800af920 0x7f3080142970 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f307000c480 tx=0x7f307000c940 comp rx=0 tx=0).stop 2024-04-02T07:24:58.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.798+0000 7f3085a00640 1 -- 172.21.15.55:0/2024212263 shutdown_connections 2024-04-02T07:24:58.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.798+0000 7f3085a00640 1 --2- 172.21.15.55:0/2024212263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f305c0666c0 0x7f305c068b80 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.798+0000 7f3085a00640 1 --2- 172.21.15.55:0/2024212263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f308015aad0 0x7f30800cd620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.798+0000 7f3085a00640 1 --2- 172.21.15.55:0/2024212263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30800cb5b0 0x7f308014b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.798+0000 7f3085a00640 1 --2- 172.21.15.55:0/2024212263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30800af920 0x7f3080142970 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:58.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.798+0000 7f3085a00640 1 -- 172.21.15.55:0/2024212263 >> 172.21.15.55:0/2024212263 conn(0x7f3080069d90 msgr2=0x7f30800b2830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:58.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.798+0000 7f3085a00640 1 -- 172.21.15.55:0/2024212263 shutdown_connections 2024-04-02T07:24:58.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:58.798+0000 7f3085a00640 1 -- 172.21.15.55:0/2024212263 wait complete. 2024-04-02T07:24:58.820 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi055.front.sepia.ceph.com... 2024-04-02T07:24:58.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:58.821 DEBUG:teuthology.orchestra.run.smithi055:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-02T07:24:58.838 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[39424]: fuse finished with error 0 and tester_r 0 2024-04-02T07:24:58.840 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:24:58.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:58.841 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-02T07:24:58.933 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:24:58.933 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:24:58.942 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:24:58.943 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:24:58.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:58.943 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-02T07:24:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-04-02T07:24:58.993 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:24:58.993 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:24:58.993 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:24:59.002 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:24:59.002 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:24:59.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:59.003 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-02T07:24:59.051 INFO:teuthology.orchestra.run.smithi055.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-04-02T07:24:59.051 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:24:59.052 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:24:59.052 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:24:59.061 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:24:59.061 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:24:59.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:24:59.061 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-02T07:24:59.112 INFO:teuthology.orchestra.run.smithi106.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-04-02T07:24:59.113 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:24:59.113 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:24:59.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.254+0000 7f488ba00640 1 Processor -- start 2024-04-02T07:24:59.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.254+0000 7f488ba00640 1 -- start start 2024-04-02T07:24:59.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.254+0000 7f488ba00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4884099120 0x7f4884099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.254+0000 7f488ba00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f488415f250 0x7f48840b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.254+0000 7f488ba00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48840ad270 con 0x7f488415ee70 2024-04-02T07:24:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.254+0000 7f488ba00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48840b0840 con 0x7f4884099120 2024-04-02T07:24:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.254+0000 7f488ba00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48840cf6a0 con 0x7f488415f250 2024-04-02T07:24:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.254+0000 7f4889a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f488415f250 0x7f48840b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.254+0000 7f487be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4884099120 0x7f4884099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.254+0000 7f4889a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f488415f250 0x7f48840b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:58546/0 (socket says 172.21.15.55:58546) 2024-04-02T07:24:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.254+0000 7f4889000640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f488415ee70 0x7f4884098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:40300/0 (socket says 172.21.15.55:40300) 2024-04-02T07:24:59.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.254+0000 7f4889a00640 1 -- 172.21.15.55:0/3865968184 learned_addr learned my addr 172.21.15.55:0/3865968184 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.254+0000 7f4883e00640 1 -- 172.21.15.55:0/3865968184 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3477670512 0 0) 0x7f48840ad270 con 0x7f488415ee70 2024-04-02T07:24:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.254+0000 7f4889a00640 1 -- 172.21.15.55:0/3865968184 >> v2:172.21.15.106:3300/0 conn(0x7f4884099120 msgr2=0x7f4884099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.254+0000 7f4889a00640 1 --2- 172.21.15.55:0/3865968184 >> v2:172.21.15.106:3300/0 conn(0x7f4884099120 0x7f4884099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.254+0000 7f4889a00640 1 -- 172.21.15.55:0/3865968184 >> v1:172.21.15.106:6789/0 conn(0x7f488415ee70 legacy=0x7f4884098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:59.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.254+0000 7f4889a00640 1 -- 172.21.15.55:0/3865968184 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48840b0a50 con 0x7f488415f250 2024-04-02T07:24:59.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.258+0000 7f4889a00640 1 --2- 172.21.15.55:0/3865968184 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f488415f250 0x7f48840b12f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f487c009e50 tx=0x7f487c01ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13ad36dfd326d296 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:59.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.258+0000 7f4883e00640 1 -- 172.21.15.55:0/3865968184 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c0a5900 con 0x7f488415f250 2024-04-02T07:24:59.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.258+0000 7f4883e00640 1 -- 172.21.15.55:0/3865968184 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487c0a5a60 con 0x7f488415f250 2024-04-02T07:24:59.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.258+0000 7f4883e00640 1 -- 172.21.15.55:0/3865968184 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c0a5df0 con 0x7f488415f250 2024-04-02T07:24:59.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.258+0000 7f488ba00640 1 -- 172.21.15.55:0/3865968184 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f488415f250 msgr2=0x7f48840b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:59.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.258+0000 7f488ba00640 1 --2- 172.21.15.55:0/3865968184 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f488415f250 0x7f48840b12f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f487c009e50 tx=0x7f487c01ca30 comp rx=0 tx=0).stop 2024-04-02T07:24:59.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.258+0000 7f488ba00640 1 -- 172.21.15.55:0/3865968184 shutdown_connections 2024-04-02T07:24:59.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.258+0000 7f488ba00640 1 --2- 172.21.15.55:0/3865968184 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f488415f250 0x7f48840b12f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.258+0000 7f488ba00640 1 --2- 172.21.15.55:0/3865968184 >> v2:172.21.15.106:3300/0 conn(0x7f4884099120 0x7f4884099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.258+0000 7f488ba00640 1 -- 172.21.15.55:0/3865968184 >> 172.21.15.55:0/3865968184 conn(0x7f48840b21d0 msgr2=0x7f48840b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:59.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.258+0000 7f488ba00640 1 -- 172.21.15.55:0/3865968184 shutdown_connections 2024-04-02T07:24:59.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.258+0000 7f488ba00640 1 -- 172.21.15.55:0/3865968184 wait complete. 2024-04-02T07:24:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f488ba00640 1 Processor -- start 2024-04-02T07:24:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f488ba00640 1 -- start start 2024-04-02T07:24:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f488ba00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4884099120 0x7f488415b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:59.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f488ba00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f488415ee70 0x7f48840af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f488ba00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488415f250 0x7f488406e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f488ba00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488414fc30 con 0x7f488415f250 2024-04-02T07:24:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f488ba00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48840ad490 con 0x7f488415ee70 2024-04-02T07:24:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f488ba00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f488415bbe0 con 0x7f4884099120 2024-04-02T07:24:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f4889a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488415f250 0x7f488406e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f4889a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488415f250 0x7f488406e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36062/0 (socket says 172.21.15.55:36062) 2024-04-02T07:24:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f4889a00640 1 -- 172.21.15.55:0/4151059413 learned_addr learned my addr 172.21.15.55:0/4151059413 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f487be00640 1 --2- 172.21.15.55:0/4151059413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f488415ee70 0x7f48840af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f4889000640 1 --2- 172.21.15.55:0/4151059413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4884099120 0x7f488415b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f4889a00640 1 -- 172.21.15.55:0/4151059413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4884099120 msgr2=0x7f488415b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f4889a00640 1 --2- 172.21.15.55:0/4151059413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4884099120 0x7f488415b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f4889a00640 1 -- 172.21.15.55:0/4151059413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f488415ee70 msgr2=0x7f48840af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f4889a00640 1 --2- 172.21.15.55:0/4151059413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f488415ee70 0x7f48840af180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f4889a00640 1 -- 172.21.15.55:0/4151059413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f487c009b30 con 0x7f488415f250 2024-04-02T07:24:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f487be00640 1 --2- 172.21.15.55:0/4151059413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f488415ee70 0x7f48840af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f4889a00640 1 --2- 172.21.15.55:0/4151059413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488415f250 0x7f488406e4b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f487c009e50 tx=0x7f487c0197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f4881600640 1 -- 172.21.15.55:0/4151059413 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c0b8640 con 0x7f488415f250 2024-04-02T07:24:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f4881600640 1 -- 172.21.15.55:0/4151059413 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f487c0b87e0 con 0x7f488415f250 2024-04-02T07:24:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f4881600640 1 -- 172.21.15.55:0/4151059413 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f487c0b8b90 con 0x7f488415f250 2024-04-02T07:24:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f488ba00640 1 -- 172.21.15.55:0/4151059413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48840af6c0 con 0x7f488415f250 2024-04-02T07:24:59.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f488ba00640 1 -- 172.21.15.55:0/4151059413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48841581b0 con 0x7f488415f250 2024-04-02T07:24:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.262+0000 7f488ba00640 1 -- 172.21.15.55:0/4151059413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4884066c90 con 0x7f488415f250 2024-04-02T07:24:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.266+0000 7f4881600640 1 -- 172.21.15.55:0/4151059413 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f487c0b8cf0 con 0x7f488415f250 2024-04-02T07:24:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.266+0000 7f4881600640 1 --2- 172.21.15.55:0/4151059413 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4860066690 0x7f4860068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.266+0000 7f4881600640 1 -- 172.21.15.55:0/4151059413 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f487c11f340 con 0x7f488415f250 2024-04-02T07:24:59.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.266+0000 7f4889000640 1 --2- 172.21.15.55:0/4151059413 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4860066690 0x7f4860068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:59.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.266+0000 7f4889000640 1 --2- 172.21.15.55:0/4151059413 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4860066690 0x7f4860068b50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4874000f70 tx=0x7f4874007b60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:59.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.270+0000 7f4881600640 1 -- 172.21.15.55:0/4151059413 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f487c0ec5d0 con 0x7f488415f250 2024-04-02T07:24:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.462+0000 7f488ba00640 1 -- 172.21.15.55:0/4151059413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48840cc3e0 con 0x7f488415f250 2024-04-02T07:24:59.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.462+0000 7f4881600640 1 -- 172.21.15.55:0/4151059413 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f487c0efbf0 con 0x7f488415f250 2024-04-02T07:24:59.467 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:59.468 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2224746522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2224746522},{"type":"v1","addr":"172.21.15.106:6837","nonce":2224746522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/2077739908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2077739908},{"type":"v1","addr":"172.21.15.55:6833","nonce":2077739908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/4108584287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4108584287},{"type":"v1","addr":"172.21.15.55:6835","nonce":4108584287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:24:11.929212+0000","modified":"2024-04-02T07:24:14.958225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5655":{"gid":5655,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6836/1720558250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1720558250},{"type":"v1","addr":"172.21.15.106:6836","nonce":1720558250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-02T07:24:59.468 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 25 2024-04-02T07:24:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.466+0000 7f488ba00640 1 -- 172.21.15.55:0/4151059413 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4860066690 msgr2=0x7f4860068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:59.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.466+0000 7f488ba00640 1 --2- 172.21.15.55:0/4151059413 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4860066690 0x7f4860068b50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4874000f70 tx=0x7f4874007b60 comp rx=0 tx=0).stop 2024-04-02T07:24:59.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.466+0000 7f488ba00640 1 -- 172.21.15.55:0/4151059413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488415f250 msgr2=0x7f488406e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:59.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.466+0000 7f488ba00640 1 --2- 172.21.15.55:0/4151059413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488415f250 0x7f488406e4b0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f487c009e50 tx=0x7f487c0197d0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.466+0000 7f488ba00640 1 -- 172.21.15.55:0/4151059413 shutdown_connections 2024-04-02T07:24:59.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.466+0000 7f488ba00640 1 --2- 172.21.15.55:0/4151059413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f488415f250 0x7f488406e4b0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.466+0000 7f488ba00640 1 --2- 172.21.15.55:0/4151059413 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4860066690 0x7f4860068b50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.466+0000 7f488ba00640 1 --2- 172.21.15.55:0/4151059413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f488415ee70 0x7f48840af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.466+0000 7f488ba00640 1 --2- 172.21.15.55:0/4151059413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4884099120 0x7f488415b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.466+0000 7f488ba00640 1 -- 172.21.15.55:0/4151059413 >> 172.21.15.55:0/4151059413 conn(0x7f48840b21d0 msgr2=0x7f4884098a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:59.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.466+0000 7f488ba00640 1 -- 172.21.15.55:0/4151059413 shutdown_connections 2024-04-02T07:24:59.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.466+0000 7f488ba00640 1 -- 172.21.15.55:0/4151059413 wait complete. 2024-04-02T07:24:59.489 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:24:59.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.626+0000 7fe930e00640 1 Processor -- start 2024-04-02T07:24:59.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.626+0000 7fe930e00640 1 -- start start 2024-04-02T07:24:59.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.626+0000 7fe930e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe92c143f90 0x7fe92c15ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:59.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.626+0000 7fe930e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe92c0b34f0 0x7fe92c0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:59.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.626+0000 7fe930e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe92c15b270 con 0x7fe92c0b3950 2024-04-02T07:24:59.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.626+0000 7fe930e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe92c144370 con 0x7fe92c143f90 2024-04-02T07:24:59.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.626+0000 7fe930e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c0c37b0 con 0x7fe92c0b34f0 2024-04-02T07:24:59.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.626+0000 7fe92a800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe92c0b3950 0x7fe92c0c4850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42084/0 (socket says 172.21.15.55:42084) 2024-04-02T07:24:59.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.626+0000 7fe92a800640 1 -- 172.21.15.55:0/2776562590 learned_addr learned my addr 172.21.15.55:0/2776562590 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:59.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.626+0000 7fe929e00640 1 --2- 172.21.15.55:0/2776562590 >> v2:172.21.15.106:3300/0 conn(0x7fe92c143f90 0x7fe92c15ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:59.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.626+0000 7fe921400640 1 --2- 172.21.15.55:0/2776562590 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe92c0b34f0 0x7fe92c0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:59.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.626+0000 7fe929400640 1 -- 172.21.15.55:0/2776562590 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943716124 0 0) 0x7fe92c15b270 con 0x7fe92c0b3950 2024-04-02T07:24:59.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.626+0000 7fe929400640 1 -- 172.21.15.55:0/2776562590 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe910003530 con 0x7fe92c0b3950 2024-04-02T07:24:59.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.626+0000 7fe929e00640 1 -- 172.21.15.55:0/2776562590 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe92c0b34f0 msgr2=0x7fe92c0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:59.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.630+0000 7fe929e00640 1 --2- 172.21.15.55:0/2776562590 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe92c0b34f0 0x7fe92c0cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.630+0000 7fe929e00640 1 -- 172.21.15.55:0/2776562590 >> v1:172.21.15.55:6789/0 conn(0x7fe92c0b3950 legacy=0x7fe92c0c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:59.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.630+0000 7fe929e00640 1 -- 172.21.15.55:0/2776562590 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c0c3a90 con 0x7fe92c143f90 2024-04-02T07:24:59.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.630+0000 7fe929e00640 1 --2- 172.21.15.55:0/2776562590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe92c143f90 0x7fe92c15ad30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009d90 tx=0x7fe91c01c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4883651c32e1e04 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:59.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.630+0000 7fe929400640 1 -- 172.21.15.55:0/2776562590 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0a5880 con 0x7fe92c143f90 2024-04-02T07:24:59.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.630+0000 7fe929400640 1 -- 172.21.15.55:0/2776562590 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe91c0a59e0 con 0x7fe92c143f90 2024-04-02T07:24:59.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.630+0000 7fe929400640 1 -- 172.21.15.55:0/2776562590 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe91c0a5d50 con 0x7fe92c143f90 2024-04-02T07:24:59.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.630+0000 7fe930e00640 1 -- 172.21.15.55:0/2776562590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe92c143f90 msgr2=0x7fe92c15ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:59.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.630+0000 7fe930e00640 1 --2- 172.21.15.55:0/2776562590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe92c143f90 0x7fe92c15ad30 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fe91c009d90 tx=0x7fe91c01c8b0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.630+0000 7fe930e00640 1 -- 172.21.15.55:0/2776562590 shutdown_connections 2024-04-02T07:24:59.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.630+0000 7fe930e00640 1 --2- 172.21.15.55:0/2776562590 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe92c0b34f0 0x7fe92c0cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.630+0000 7fe930e00640 1 --2- 172.21.15.55:0/2776562590 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe92c143f90 0x7fe92c15ad30 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.630+0000 7fe930e00640 1 -- 172.21.15.55:0/2776562590 >> 172.21.15.55:0/2776562590 conn(0x7fe92c066080 msgr2=0x7fe92c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:59.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.630+0000 7fe930e00640 1 -- 172.21.15.55:0/2776562590 shutdown_connections 2024-04-02T07:24:59.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.630+0000 7fe930e00640 1 -- 172.21.15.55:0/2776562590 wait complete. 2024-04-02T07:24:59.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe930e00640 1 Processor -- start 2024-04-02T07:24:59.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe930e00640 1 -- start start 2024-04-02T07:24:59.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe930e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe92c0b34f0 0x7fe92c13f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:59.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe930e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe92c0b3950 0x7fe92c13a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:59.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe930e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe92c143f90 0x7fe92c0cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:59.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe930e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c141ee0 con 0x7fe92c143f90 2024-04-02T07:24:59.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe930e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c1412d0 con 0x7fe92c0b34f0 2024-04-02T07:24:59.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe930e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe92c1415b0 con 0x7fe92c0b3950 2024-04-02T07:24:59.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe92a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe92c143f90 0x7fe92c0cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:59.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe929e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe92c0b34f0 0x7fe92c13f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:59.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe92a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe92c143f90 0x7fe92c0cb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36064/0 (socket says 172.21.15.55:36064) 2024-04-02T07:24:59.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe92a800640 1 -- 172.21.15.55:0/1933627135 learned_addr learned my addr 172.21.15.55:0/1933627135 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:59.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe921400640 1 --2- 172.21.15.55:0/1933627135 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe92c0b3950 0x7fe92c13a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:59.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe92a800640 1 -- 172.21.15.55:0/1933627135 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe92c0b3950 msgr2=0x7fe92c13a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:59.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe92a800640 1 --2- 172.21.15.55:0/1933627135 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe92c0b3950 0x7fe92c13a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe92a800640 1 -- 172.21.15.55:0/1933627135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe92c0b34f0 msgr2=0x7fe92c13f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:59.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe92a800640 1 --2- 172.21.15.55:0/1933627135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe92c0b34f0 0x7fe92c13f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe92a800640 1 -- 172.21.15.55:0/1933627135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe91c009a70 con 0x7fe92c143f90 2024-04-02T07:24:59.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe92a800640 1 --2- 172.21.15.55:0/1933627135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe92c143f90 0x7fe92c0cb160 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe92400c420 tx=0x7fe92400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:59.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe922a00640 1 -- 172.21.15.55:0/1933627135 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe924005cf0 con 0x7fe92c143f90 2024-04-02T07:24:59.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe922a00640 1 -- 172.21.15.55:0/1933627135 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe924005e50 con 0x7fe92c143f90 2024-04-02T07:24:59.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe930e00640 1 -- 172.21.15.55:0/1933627135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92c141890 con 0x7fe92c143f90 2024-04-02T07:24:59.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe922a00640 1 -- 172.21.15.55:0/1933627135 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9240072d0 con 0x7fe92c143f90 2024-04-02T07:24:59.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.634+0000 7fe930e00640 1 -- 172.21.15.55:0/1933627135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe92c13f6c0 con 0x7fe92c143f90 2024-04-02T07:24:59.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.638+0000 7fe930e00640 1 -- 172.21.15.55:0/1933627135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe92c142050 con 0x7fe92c143f90 2024-04-02T07:24:59.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.638+0000 7fe922a00640 1 -- 172.21.15.55:0/1933627135 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe924007470 con 0x7fe92c143f90 2024-04-02T07:24:59.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.638+0000 7fe922a00640 1 --2- 172.21.15.55:0/1933627135 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe908066690 0x7fe908068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:59.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.638+0000 7fe922a00640 1 -- 172.21.15.55:0/1933627135 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe9240834d0 con 0x7fe92c143f90 2024-04-02T07:24:59.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.638+0000 7fe929e00640 1 --2- 172.21.15.55:0/1933627135 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe908066690 0x7fe908068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:59.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.638+0000 7fe929e00640 1 --2- 172.21.15.55:0/1933627135 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe908066690 0x7fe908068b50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0af000 tx=0x7fe91c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:59.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.642+0000 7fe922a00640 1 -- 172.21.15.55:0/1933627135 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe9240507c0 con 0x7fe92c143f90 2024-04-02T07:24:59.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.806+0000 7fe930e00640 1 -- 172.21.15.55:0/1933627135 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe92c066c90 con 0x7fe92c143f90 2024-04-02T07:24:59.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.806+0000 7fe922a00640 1 -- 172.21.15.55:0/1933627135 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16197 (secure 0 0 0) 0x7fe924053de0 con 0x7fe92c143f90 2024-04-02T07:24:59.809 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:24:59.810 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":47,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:24:59.224524+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:24:10.453515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-02T07:24:10.908188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2a","mappings":[{"from":0,"to":4}]},{"pgid":"7.30","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:24:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.806+0000 7fe930e00640 1 -- 172.21.15.55:0/1933627135 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe908066690 msgr2=0x7fe908068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:59.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.806+0000 7fe930e00640 1 --2- 172.21.15.55:0/1933627135 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe908066690 0x7fe908068b50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe91c0af000 tx=0x7fe91c0a7070 comp rx=0 tx=0).stop 2024-04-02T07:24:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.806+0000 7fe930e00640 1 -- 172.21.15.55:0/1933627135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe92c143f90 msgr2=0x7fe92c0cb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.806+0000 7fe930e00640 1 --2- 172.21.15.55:0/1933627135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe92c143f90 0x7fe92c0cb160 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe92400c420 tx=0x7fe92400c8e0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.806+0000 7fe930e00640 1 -- 172.21.15.55:0/1933627135 shutdown_connections 2024-04-02T07:24:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.806+0000 7fe930e00640 1 --2- 172.21.15.55:0/1933627135 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe92c143f90 0x7fe92c0cb160 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.806+0000 7fe930e00640 1 --2- 172.21.15.55:0/1933627135 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe92c0b3950 0x7fe92c13a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.806+0000 7fe930e00640 1 --2- 172.21.15.55:0/1933627135 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe908066690 0x7fe908068b50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.806+0000 7fe930e00640 1 --2- 172.21.15.55:0/1933627135 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe92c0b34f0 0x7fe92c13f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.806+0000 7fe930e00640 1 -- 172.21.15.55:0/1933627135 >> 172.21.15.55:0/1933627135 conn(0x7fe92c066080 msgr2=0x7fe92c142ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.806+0000 7fe930e00640 1 -- 172.21.15.55:0/1933627135 shutdown_connections 2024-04-02T07:24:59.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.806+0000 7fe930e00640 1 -- 172.21.15.55:0/1933627135 wait complete. 2024-04-02T07:24:59.831 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:24:10.453515+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '45', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:24:10.908188+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:24:59.832 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:24:59.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.974+0000 7f6a51400640 1 Processor -- start 2024-04-02T07:24:59.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.974+0000 7f6a51400640 1 -- start start 2024-04-02T07:24:59.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.974+0000 7f6a51400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a4c0cfef0 0x7f6a4c098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.974+0000 7f6a51400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6a4c098f50 0x7f6a4c0b5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.974+0000 7f6a51400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4c0d0350 con 0x7f6a4c15cd50 2024-04-02T07:24:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.974+0000 7f6a51400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a4c0993c0 con 0x7f6a4c0cfef0 2024-04-02T07:24:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.974+0000 7f6a51400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a4c0ccb30 con 0x7f6a4c098f50 2024-04-02T07:24:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.978+0000 7f6a41e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a4c0cfef0 0x7f6a4c098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.978+0000 7f6a4a800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6a4c15cd50 0x7f6a4c06bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42090/0 (socket says 172.21.15.55:42090) 2024-04-02T07:24:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.978+0000 7f6a4a800640 1 -- 172.21.15.55:0/1359187994 learned_addr learned my addr 172.21.15.55:0/1359187994 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:24:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.978+0000 7f6a4b200640 1 --2- 172.21.15.55:0/1359187994 >> v2:172.21.15.106:3300/0 conn(0x7f6a4c098f50 0x7f6a4c0b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.978+0000 7f6a41e00640 1 -- 172.21.15.55:0/1359187994 >> v2:172.21.15.106:3300/0 conn(0x7f6a4c098f50 msgr2=0x7f6a4c0b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:24:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.978+0000 7f6a41e00640 1 --2- 172.21.15.55:0/1359187994 >> v2:172.21.15.106:3300/0 conn(0x7f6a4c098f50 0x7f6a4c0b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.978+0000 7f6a41e00640 1 -- 172.21.15.55:0/1359187994 >> v1:172.21.15.55:6789/0 conn(0x7f6a4c15cd50 legacy=0x7f6a4c06bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:59.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.978+0000 7f6a41e00640 1 -- 172.21.15.55:0/1359187994 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c06c2a0 con 0x7f6a4c0cfef0 2024-04-02T07:24:59.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.978+0000 7f6a41e00640 1 --2- 172.21.15.55:0/1359187994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a4c0cfef0 0x7f6a4c098a10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c071840 tx=0x7f6a3401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=490d1f5dd4d93b0e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:59.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.978+0000 7f6a49e00640 1 -- 172.21.15.55:0/1359187994 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a340ac620 con 0x7f6a4c0cfef0 2024-04-02T07:24:59.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.978+0000 7f6a49e00640 1 -- 172.21.15.55:0/1359187994 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a340ac780 con 0x7f6a4c0cfef0 2024-04-02T07:24:59.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.978+0000 7f6a49e00640 1 -- 172.21.15.55:0/1359187994 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a340acb10 con 0x7f6a4c0cfef0 2024-04-02T07:24:59.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.978+0000 7f6a51400640 1 -- 172.21.15.55:0/1359187994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a4c0cfef0 msgr2=0x7f6a4c098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:59.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.978+0000 7f6a51400640 1 --2- 172.21.15.55:0/1359187994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a4c0cfef0 0x7f6a4c098a10 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c071840 tx=0x7f6a3401c3c0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a51400640 1 -- 172.21.15.55:0/1359187994 shutdown_connections 2024-04-02T07:24:59.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a51400640 1 --2- 172.21.15.55:0/1359187994 >> v2:172.21.15.106:3300/0 conn(0x7f6a4c098f50 0x7f6a4c0b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a51400640 1 --2- 172.21.15.55:0/1359187994 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a4c0cfef0 0x7f6a4c098a10 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a51400640 1 -- 172.21.15.55:0/1359187994 >> 172.21.15.55:0/1359187994 conn(0x7f6a4c0b2160 msgr2=0x7f6a4c0b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:24:59.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a51400640 1 -- 172.21.15.55:0/1359187994 shutdown_connections 2024-04-02T07:24:59.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a51400640 1 -- 172.21.15.55:0/1359187994 wait complete. 2024-04-02T07:24:59.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a51400640 1 Processor -- start 2024-04-02T07:24:59.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a51400640 1 -- start start 2024-04-02T07:24:59.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a51400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a4c098f50 0x7f6a4c153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a51400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a4c0cfef0 0x7f6a4c0c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a51400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a4c15cd50 0x7f6a4c0c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a51400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c153f40 con 0x7f6a4c098f50 2024-04-02T07:24:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a51400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c0c4f90 con 0x7f6a4c0cfef0 2024-04-02T07:24:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a51400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c0c5270 con 0x7f6a4c15cd50 2024-04-02T07:24:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a4a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a4c098f50 0x7f6a4c153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a4a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a4c098f50 0x7f6a4c153a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36080/0 (socket says 172.21.15.55:36080) 2024-04-02T07:24:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a4a800640 1 -- 172.21.15.55:0/3331856057 learned_addr learned my addr 172.21.15.55:0/3331856057 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:24:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a41e00640 1 --2- 172.21.15.55:0/3331856057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a4c0cfef0 0x7f6a4c0c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a4b200640 1 --2- 172.21.15.55:0/3331856057 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a4c15cd50 0x7f6a4c0c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a4a800640 1 -- 172.21.15.55:0/3331856057 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a4c15cd50 msgr2=0x7f6a4c0c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a4a800640 1 --2- 172.21.15.55:0/3331856057 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a4c15cd50 0x7f6a4c0c8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a4a800640 1 -- 172.21.15.55:0/3331856057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a4c0cfef0 msgr2=0x7f6a4c0c65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:24:59.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a4a800640 1 --2- 172.21.15.55:0/3331856057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a4c0cfef0 0x7f6a4c0c65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:24:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a4a800640 1 -- 172.21.15.55:0/3331856057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a34009420 con 0x7f6a4c098f50 2024-04-02T07:24:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a41e00640 1 --2- 172.21.15.55:0/3331856057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a4c0cfef0 0x7f6a4c0c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:24:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a4a800640 1 --2- 172.21.15.55:0/3331856057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a4c098f50 0x7f6a4c153a00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00c400 tx=0x7f6a3c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a43400640 1 -- 172.21.15.55:0/3331856057 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c005cf0 con 0x7f6a4c098f50 2024-04-02T07:24:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a43400640 1 -- 172.21.15.55:0/3331856057 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c005e50 con 0x7f6a4c098f50 2024-04-02T07:24:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a43400640 1 -- 172.21.15.55:0/3331856057 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c0072d0 con 0x7f6a4c098f50 2024-04-02T07:24:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.982+0000 7f6a51400640 1 -- 172.21.15.55:0/3331856057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4c0c5550 con 0x7f6a4c098f50 2024-04-02T07:24:59.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.986+0000 7f6a51400640 1 -- 172.21.15.55:0/3331856057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4c0c5b10 con 0x7f6a4c098f50 2024-04-02T07:24:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.986+0000 7f6a51400640 1 -- 172.21.15.55:0/3331856057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4c066c90 con 0x7f6a4c098f50 2024-04-02T07:24:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.986+0000 7f6a43400640 1 -- 172.21.15.55:0/3331856057 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6a3c007430 con 0x7f6a4c098f50 2024-04-02T07:24:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.986+0000 7f6a43400640 1 --2- 172.21.15.55:0/3331856057 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a28066690 0x7f6a28068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:24:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.986+0000 7f6a43400640 1 -- 172.21.15.55:0/3331856057 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6a3c083710 con 0x7f6a4c098f50 2024-04-02T07:24:59.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.986+0000 7f6a41e00640 1 --2- 172.21.15.55:0/3331856057 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a28066690 0x7f6a28068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:24:59.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.986+0000 7f6a41e00640 1 --2- 172.21.15.55:0/3331856057 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a28066690 0x7f6a28068b50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6a340ae000 tx=0x7f6a34008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:24:59.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:24:59.990+0000 7f6a43400640 1 -- 172.21.15.55:0/3331856057 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6a3c050a50 con 0x7f6a4c098f50 2024-04-02T07:25:00.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.150+0000 7f6a51400640 1 -- 172.21.15.55:0/3331856057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a4c0b4610 con 0x7f6a4c098f50 2024-04-02T07:25:00.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.154+0000 7f6a43400640 1 -- 172.21.15.55:0/3331856057 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a3c054070 con 0x7f6a4c098f50 2024-04-02T07:25:00.156 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:25:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.154+0000 7f6a51400640 1 -- 172.21.15.55:0/3331856057 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a28066690 msgr2=0x7f6a28068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.154+0000 7f6a51400640 1 --2- 172.21.15.55:0/3331856057 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a28066690 0x7f6a28068b50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6a340ae000 tx=0x7f6a34008040 comp rx=0 tx=0).stop 2024-04-02T07:25:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.154+0000 7f6a51400640 1 -- 172.21.15.55:0/3331856057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a4c098f50 msgr2=0x7f6a4c153a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.154+0000 7f6a51400640 1 --2- 172.21.15.55:0/3331856057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a4c098f50 0x7f6a4c153a00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00c400 tx=0x7f6a3c00c8c0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.154+0000 7f6a51400640 1 -- 172.21.15.55:0/3331856057 shutdown_connections 2024-04-02T07:25:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.154+0000 7f6a51400640 1 --2- 172.21.15.55:0/3331856057 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a4c15cd50 0x7f6a4c0c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.154+0000 7f6a51400640 1 --2- 172.21.15.55:0/3331856057 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a28066690 0x7f6a28068b50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.154+0000 7f6a51400640 1 --2- 172.21.15.55:0/3331856057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a4c0cfef0 0x7f6a4c0c65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.154+0000 7f6a51400640 1 --2- 172.21.15.55:0/3331856057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a4c098f50 0x7f6a4c153a00 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.154+0000 7f6a51400640 1 -- 172.21.15.55:0/3331856057 >> 172.21.15.55:0/3331856057 conn(0x7f6a4c0b2160 msgr2=0x7f6a4c06e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.154+0000 7f6a51400640 1 -- 172.21.15.55:0/3331856057 shutdown_connections 2024-04-02T07:25:00.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.154+0000 7f6a51400640 1 -- 172.21.15.55:0/3331856057 wait complete. 2024-04-02T07:25:00.177 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:25:00.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.318+0000 7fe301c00640 1 Processor -- start 2024-04-02T07:25:00.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.318+0000 7fe301c00640 1 -- start start 2024-04-02T07:25:00.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.318+0000 7fe301c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe2fc098a10 0x7fe2fc098df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:00.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.318+0000 7fe301c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2fc099330 con 0x7fe2fc099750 2024-04-02T07:25:00.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.318+0000 7fe301c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2fc0ce2b0 con 0x7fe2fc0afc30 2024-04-02T07:25:00.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.318+0000 7fe301c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2fc0ce590 con 0x7fe2fc098a10 2024-04-02T07:25:00.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.322+0000 7fe2faa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe2fc098a10 0x7fe2fc098df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:00.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.322+0000 7fe2f3e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe2fc099750 0x7fe2fc0b0fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42098/0 (socket says 172.21.15.55:42098) 2024-04-02T07:25:00.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.322+0000 7fe2f3e00640 1 -- 172.21.15.55:0/441530182 learned_addr learned my addr 172.21.15.55:0/441530182 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:00.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.322+0000 7fe2fa000640 1 -- 172.21.15.55:0/441530182 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4153832000 0 0) 0x7fe2fc099330 con 0x7fe2fc099750 2024-04-02T07:25:00.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.322+0000 7fe2faa00640 1 -- 172.21.15.55:0/441530182 >> v1:172.21.15.106:6789/0 conn(0x7fe2fc0afc30 legacy=0x7fe2fc0cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:00.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.322+0000 7fe2faa00640 1 -- 172.21.15.55:0/441530182 >> v1:172.21.15.55:6789/0 conn(0x7fe2fc099750 legacy=0x7fe2fc0b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:00.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.322+0000 7fe2faa00640 1 -- 172.21.15.55:0/441530182 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2fc0ce870 con 0x7fe2fc098a10 2024-04-02T07:25:00.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.322+0000 7fe2faa00640 1 --2- 172.21.15.55:0/441530182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2fc098a10 0x7fe2fc098df0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0097c0 tx=0x7fe2ec01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2a8eeaeb6fef79 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:00.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.322+0000 7fe2fa000640 1 -- 172.21.15.55:0/441530182 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0aa620 con 0x7fe2fc098a10 2024-04-02T07:25:00.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.322+0000 7fe2fa000640 1 -- 172.21.15.55:0/441530182 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec0aa780 con 0x7fe2fc098a10 2024-04-02T07:25:00.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.322+0000 7fe2fa000640 1 -- 172.21.15.55:0/441530182 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0aab10 con 0x7fe2fc098a10 2024-04-02T07:25:00.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe301c00640 1 -- 172.21.15.55:0/441530182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2fc098a10 msgr2=0x7fe2fc098df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:00.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe301c00640 1 --2- 172.21.15.55:0/441530182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2fc098a10 0x7fe2fc098df0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0097c0 tx=0x7fe2ec01c4a0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe301c00640 1 -- 172.21.15.55:0/441530182 shutdown_connections 2024-04-02T07:25:00.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe301c00640 1 --2- 172.21.15.55:0/441530182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2fc098a10 0x7fe2fc098df0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe301c00640 1 -- 172.21.15.55:0/441530182 >> 172.21.15.55:0/441530182 conn(0x7fe2fc0b21d0 msgr2=0x7fe2fc0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:00.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe301c00640 1 -- 172.21.15.55:0/441530182 shutdown_connections 2024-04-02T07:25:00.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe301c00640 1 -- 172.21.15.55:0/441530182 wait complete. 2024-04-02T07:25:00.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe301c00640 1 Processor -- start 2024-04-02T07:25:00.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe301c00640 1 -- start start 2024-04-02T07:25:00.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe301c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2fc098a10 0x7fe2fc0b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:00.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe301c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2fc099750 0x7fe2fc0b3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:00.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe301c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2fc0afc30 0x7fe2fc0b3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:00.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe301c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc06af40 con 0x7fe2fc098a10 2024-04-02T07:25:00.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe301c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc06b220 con 0x7fe2fc099750 2024-04-02T07:25:00.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe301c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2fc06b500 con 0x7fe2fc0afc30 2024-04-02T07:25:00.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe2faa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2fc098a10 0x7fe2fc0b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:00.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe2faa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2fc098a10 0x7fe2fc0b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36104/0 (socket says 172.21.15.55:36104) 2024-04-02T07:25:00.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe2faa00640 1 -- 172.21.15.55:0/3973847955 learned_addr learned my addr 172.21.15.55:0/3973847955 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:00.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe2faa00640 1 -- 172.21.15.55:0/3973847955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2fc0afc30 msgr2=0x7fe2fc0b3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:00.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe2faa00640 1 --2- 172.21.15.55:0/3973847955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2fc0afc30 0x7fe2fc0b3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe2faa00640 1 -- 172.21.15.55:0/3973847955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2fc099750 msgr2=0x7fe2fc0b3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:00.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe2faa00640 1 --2- 172.21.15.55:0/3973847955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2fc099750 0x7fe2fc0b3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe2faa00640 1 -- 172.21.15.55:0/3973847955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2ec009420 con 0x7fe2fc098a10 2024-04-02T07:25:00.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe2faa00640 1 --2- 172.21.15.55:0/3973847955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2fc098a10 0x7fe2fc0b59d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0ac040 tx=0x7fe2ec01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:00.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.326+0000 7fe2f2a00640 1 -- 172.21.15.55:0/3973847955 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0aae40 con 0x7fe2fc098a10 2024-04-02T07:25:00.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.330+0000 7fe2f2a00640 1 -- 172.21.15.55:0/3973847955 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2ec0be410 con 0x7fe2fc098a10 2024-04-02T07:25:00.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.330+0000 7fe2f2a00640 1 -- 172.21.15.55:0/3973847955 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2ec0be7c0 con 0x7fe2fc098a10 2024-04-02T07:25:00.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.330+0000 7fe301c00640 1 -- 172.21.15.55:0/3973847955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2fc06b7e0 con 0x7fe2fc098a10 2024-04-02T07:25:00.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.330+0000 7fe301c00640 1 -- 172.21.15.55:0/3973847955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2fc0b4360 con 0x7fe2fc098a10 2024-04-02T07:25:00.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.330+0000 7fe301c00640 1 -- 172.21.15.55:0/3973847955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2fc06ba20 con 0x7fe2fc098a10 2024-04-02T07:25:00.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.330+0000 7fe2f2a00640 1 -- 172.21.15.55:0/3973847955 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe2ec0b4400 con 0x7fe2fc098a10 2024-04-02T07:25:00.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.330+0000 7fe2f2a00640 1 --2- 172.21.15.55:0/3973847955 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe2d8066690 0x7fe2d8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:00.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.330+0000 7fe2f2a00640 1 -- 172.21.15.55:0/3973847955 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe2ec11e660 con 0x7fe2fc098a10 2024-04-02T07:25:00.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.330+0000 7fe2f3e00640 1 --2- 172.21.15.55:0/3973847955 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe2d8066690 0x7fe2d8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:00.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.334+0000 7fe2f3e00640 1 --2- 172.21.15.55:0/3973847955 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe2d8066690 0x7fe2d8068b50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4000c10 tx=0x7fe2e40079d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:00.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.334+0000 7fe2f2a00640 1 -- 172.21.15.55:0/3973847955 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe2ec0eb990 con 0x7fe2fc098a10 2024-04-02T07:25:00.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.494+0000 7fe301c00640 1 -- 172.21.15.55:0/3973847955 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe2fc06b080 con 0x7fe2fc098a10 2024-04-02T07:25:00.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.494+0000 7fe2f2a00640 1 -- 172.21.15.55:0/3973847955 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v48) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe2fc06b080 con 0x7fe2fc098a10 2024-04-02T07:25:00.500 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:25:00.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.498+0000 7fe301c00640 1 -- 172.21.15.55:0/3973847955 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe2d8066690 msgr2=0x7fe2d8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:00.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.498+0000 7fe301c00640 1 --2- 172.21.15.55:0/3973847955 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe2d8066690 0x7fe2d8068b50 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe2e4000c10 tx=0x7fe2e40079d0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.498+0000 7fe301c00640 1 -- 172.21.15.55:0/3973847955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2fc098a10 msgr2=0x7fe2fc0b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:00.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.498+0000 7fe301c00640 1 --2- 172.21.15.55:0/3973847955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2fc098a10 0x7fe2fc0b59d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe2ec0ac040 tx=0x7fe2ec01ace0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.498+0000 7fe301c00640 1 -- 172.21.15.55:0/3973847955 shutdown_connections 2024-04-02T07:25:00.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.498+0000 7fe301c00640 1 --2- 172.21.15.55:0/3973847955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe2fc0afc30 0x7fe2fc0b3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.498+0000 7fe301c00640 1 --2- 172.21.15.55:0/3973847955 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe2d8066690 0x7fe2d8068b50 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.498+0000 7fe301c00640 1 --2- 172.21.15.55:0/3973847955 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe2fc099750 0x7fe2fc0b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.498+0000 7fe301c00640 1 --2- 172.21.15.55:0/3973847955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe2fc098a10 0x7fe2fc0b59d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.498+0000 7fe301c00640 1 -- 172.21.15.55:0/3973847955 >> 172.21.15.55:0/3973847955 conn(0x7fe2fc0b21d0 msgr2=0x7fe2fc0ae920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:00.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.498+0000 7fe301c00640 1 -- 172.21.15.55:0/3973847955 shutdown_connections 2024-04-02T07:25:00.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.498+0000 7fe301c00640 1 -- 172.21.15.55:0/3973847955 wait complete. 2024-04-02T07:25:00.520 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:25:00.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.658+0000 7fd6c9c00640 1 Processor -- start 2024-04-02T07:25:00.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.658+0000 7fd6c9c00640 1 -- start start 2024-04-02T07:25:00.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.662+0000 7fd6c9c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6c4160580 0x7fd6c4098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:00.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.662+0000 7fd6c9c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd6c40b19b0 0x7fd6c4098f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:00.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.662+0000 7fd6c9c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c40cfee0 con 0x7fd6c41601a0 2024-04-02T07:25:00.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.662+0000 7fd6c9c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c40d04a0 con 0x7fd6c40b19b0 2024-04-02T07:25:00.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.662+0000 7fd6c9c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c40cfcf0 con 0x7fd6c4160580 2024-04-02T07:25:00.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.662+0000 7fd6c3400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd6c40b19b0 0x7fd6c4098f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:00.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.662+0000 7fd6c3400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd6c40b19b0 0x7fd6c4098f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36110/0 (socket says 172.21.15.55:36110) 2024-04-02T07:25:00.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.662+0000 7fd6c3400640 1 -- 172.21.15.55:0/2142634758 learned_addr learned my addr 172.21.15.55:0/2142634758 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:00.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.662+0000 7fd6ba000640 1 --2- 172.21.15.55:0/2142634758 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6c4160580 0x7fd6c4098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:00.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.662+0000 7fd6c3400640 1 -- 172.21.15.55:0/2142634758 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6c4160580 msgr2=0x7fd6c4098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:00.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.662+0000 7fd6c3400640 1 --2- 172.21.15.55:0/2142634758 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6c4160580 0x7fd6c4098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.662+0000 7fd6c3400640 1 -- 172.21.15.55:0/2142634758 >> v1:172.21.15.106:6789/0 conn(0x7fd6c41601a0 legacy=0x7fd6c40cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:00.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.662+0000 7fd6c3400640 1 -- 172.21.15.55:0/2142634758 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c40d01c0 con 0x7fd6c40b19b0 2024-04-02T07:25:00.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.666+0000 7fd6c3400640 1 --2- 172.21.15.55:0/2142634758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6c40b19b0 0x7fd6c4098f50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009870 tx=0x7fd6bc01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cbeaf5142d675bb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.666+0000 7fd6c2000640 1 -- 172.21.15.55:0/2142634758 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc0ab610 con 0x7fd6c40b19b0 2024-04-02T07:25:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.666+0000 7fd6c2000640 1 -- 172.21.15.55:0/2142634758 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6bc0ab770 con 0x7fd6c40b19b0 2024-04-02T07:25:00.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.666+0000 7fd6c2000640 1 -- 172.21.15.55:0/2142634758 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6bc0abb00 con 0x7fd6c40b19b0 2024-04-02T07:25:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.666+0000 7fd6c9c00640 1 -- 172.21.15.55:0/2142634758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6c40b19b0 msgr2=0x7fd6c4098f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.666+0000 7fd6c9c00640 1 --2- 172.21.15.55:0/2142634758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6c40b19b0 0x7fd6c4098f50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc009870 tx=0x7fd6bc01c410 comp rx=0 tx=0).stop 2024-04-02T07:25:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.666+0000 7fd6c9c00640 1 -- 172.21.15.55:0/2142634758 shutdown_connections 2024-04-02T07:25:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.666+0000 7fd6c9c00640 1 --2- 172.21.15.55:0/2142634758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6c40b19b0 0x7fd6c4098f50 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.666+0000 7fd6c9c00640 1 --2- 172.21.15.55:0/2142634758 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6c4160580 0x7fd6c4098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.666+0000 7fd6c9c00640 1 -- 172.21.15.55:0/2142634758 >> 172.21.15.55:0/2142634758 conn(0x7fd6c40b2150 msgr2=0x7fd6c40b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.666+0000 7fd6c9c00640 1 -- 172.21.15.55:0/2142634758 shutdown_connections 2024-04-02T07:25:00.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.666+0000 7fd6c9c00640 1 -- 172.21.15.55:0/2142634758 wait complete. 2024-04-02T07:25:00.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.666+0000 7fd6c9c00640 1 Processor -- start 2024-04-02T07:25:00.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.666+0000 7fd6c9c00640 1 -- start start 2024-04-02T07:25:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.666+0000 7fd6c9c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6c40b19b0 0x7fd6c4155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.666+0000 7fd6c9c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6c41601a0 0x7fd6c40c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.666+0000 7fd6c9c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6c4160580 0x7fd6c40c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.666+0000 7fd6c9c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c40c8ac0 con 0x7fd6c40b19b0 2024-04-02T07:25:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.666+0000 7fd6c9c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c40c6ea0 con 0x7fd6c41601a0 2024-04-02T07:25:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.666+0000 7fd6c9c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c40c8500 con 0x7fd6c4160580 2024-04-02T07:25:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.670+0000 7fd6c2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6c40b19b0 0x7fd6c4155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.670+0000 7fd6c2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6c40b19b0 0x7fd6c4155510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36126/0 (socket says 172.21.15.55:36126) 2024-04-02T07:25:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.670+0000 7fd6c2a00640 1 -- 172.21.15.55:0/758509500 learned_addr learned my addr 172.21.15.55:0/758509500 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.670+0000 7fd6ba000640 1 --2- 172.21.15.55:0/758509500 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6c41601a0 0x7fd6c40c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:00.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.670+0000 7fd6c3400640 1 --2- 172.21.15.55:0/758509500 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6c4160580 0x7fd6c40c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:00.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.670+0000 7fd6c2a00640 1 -- 172.21.15.55:0/758509500 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6c4160580 msgr2=0x7fd6c40c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:00.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.670+0000 7fd6c2a00640 1 --2- 172.21.15.55:0/758509500 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6c4160580 0x7fd6c40c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.670+0000 7fd6c2a00640 1 -- 172.21.15.55:0/758509500 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6c41601a0 msgr2=0x7fd6c40c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:00.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.670+0000 7fd6c2a00640 1 --2- 172.21.15.55:0/758509500 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6c41601a0 0x7fd6c40c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.670+0000 7fd6c2a00640 1 -- 172.21.15.55:0/758509500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6bc0094d0 con 0x7fd6c40b19b0 2024-04-02T07:25:00.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.670+0000 7fd6c2a00640 1 --2- 172.21.15.55:0/758509500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6c40b19b0 0x7fd6c4155510 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400c7f0 tx=0x7fd6b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:00.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.670+0000 7fd6bb400640 1 -- 172.21.15.55:0/758509500 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b4003b80 con 0x7fd6c40b19b0 2024-04-02T07:25:00.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.670+0000 7fd6bb400640 1 -- 172.21.15.55:0/758509500 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b4003ce0 con 0x7fd6c40b19b0 2024-04-02T07:25:00.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.670+0000 7fd6c9c00640 1 -- 172.21.15.55:0/758509500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c40c87e0 con 0x7fd6c40b19b0 2024-04-02T07:25:00.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.670+0000 7fd6bb400640 1 -- 172.21.15.55:0/758509500 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b400aa90 con 0x7fd6c40b19b0 2024-04-02T07:25:00.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.670+0000 7fd6c9c00640 1 -- 172.21.15.55:0/758509500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c40c6ae0 con 0x7fd6c40b19b0 2024-04-02T07:25:00.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.670+0000 7fd6c9c00640 1 -- 172.21.15.55:0/758509500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c40723d0 con 0x7fd6c40b19b0 2024-04-02T07:25:00.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.670+0000 7fd6bb400640 1 -- 172.21.15.55:0/758509500 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd6b400abf0 con 0x7fd6c40b19b0 2024-04-02T07:25:00.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.674+0000 7fd6bb400640 1 --2- 172.21.15.55:0/758509500 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd6a0066690 0x7fd6a0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:00.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.674+0000 7fd6bb400640 1 -- 172.21.15.55:0/758509500 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd6b4083ff0 con 0x7fd6c40b19b0 2024-04-02T07:25:00.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.674+0000 7fd6ba000640 1 --2- 172.21.15.55:0/758509500 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd6a0066690 0x7fd6a0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:00.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.674+0000 7fd6ba000640 1 --2- 172.21.15.55:0/758509500 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd6a0066690 0x7fd6a0068b50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4070190 tx=0x7fd6ac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:00.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.674+0000 7fd6bb400640 1 -- 172.21.15.55:0/758509500 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd6b40b5980 con 0x7fd6c40b19b0 2024-04-02T07:25:00.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.838+0000 7fd6c9c00640 1 -- 172.21.15.55:0/758509500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd6c4066c90 con 0x7fd6c40b19b0 2024-04-02T07:25:00.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.838+0000 7fd6bb400640 1 -- 172.21.15.55:0/758509500 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v48) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd6b4051350 con 0x7fd6c40b19b0 2024-04-02T07:25:00.842 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:25:00.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.842+0000 7fd6c9c00640 1 -- 172.21.15.55:0/758509500 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd6a0066690 msgr2=0x7fd6a0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:00.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.842+0000 7fd6c9c00640 1 --2- 172.21.15.55:0/758509500 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd6a0066690 0x7fd6a0068b50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fd6c4070190 tx=0x7fd6ac008040 comp rx=0 tx=0).stop 2024-04-02T07:25:00.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.842+0000 7fd6c9c00640 1 -- 172.21.15.55:0/758509500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6c40b19b0 msgr2=0x7fd6c4155510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:00.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.842+0000 7fd6c9c00640 1 --2- 172.21.15.55:0/758509500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6c40b19b0 0x7fd6c4155510 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fd6b400c7f0 tx=0x7fd6b400ccb0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.842+0000 7fd6c9c00640 1 -- 172.21.15.55:0/758509500 shutdown_connections 2024-04-02T07:25:00.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.842+0000 7fd6c9c00640 1 --2- 172.21.15.55:0/758509500 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd6c4160580 0x7fd6c40c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.842+0000 7fd6c9c00640 1 --2- 172.21.15.55:0/758509500 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd6a0066690 0x7fd6a0068b50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.842+0000 7fd6c9c00640 1 --2- 172.21.15.55:0/758509500 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd6c41601a0 0x7fd6c40c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.842+0000 7fd6c9c00640 1 --2- 172.21.15.55:0/758509500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd6c40b19b0 0x7fd6c4155510 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:00.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.842+0000 7fd6c9c00640 1 -- 172.21.15.55:0/758509500 >> 172.21.15.55:0/758509500 conn(0x7fd6c40b2150 msgr2=0x7fd6c41563e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:00.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.842+0000 7fd6c9c00640 1 -- 172.21.15.55:0/758509500 shutdown_connections 2024-04-02T07:25:00.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:00.842+0000 7fd6c9c00640 1 -- 172.21.15.55:0/758509500 wait complete. 2024-04-02T07:25:00.863 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:25:01.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.002+0000 7fbb59600640 1 Processor -- start 2024-04-02T07:25:01.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.002+0000 7fbb59600640 1 -- start start 2024-04-02T07:25:01.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.002+0000 7fbb59600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb5415f250 0x7fbb54099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:01.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.002+0000 7fbb59600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb540ad270 con 0x7fbb5415ee70 2024-04-02T07:25:01.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.002+0000 7fbb59600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb540b0a50 con 0x7fbb54099120 2024-04-02T07:25:01.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.002+0000 7fbb59600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb540b0840 con 0x7fbb5415f250 2024-04-02T07:25:01.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.002+0000 7fbb52a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbb5415ee70 0x7fbb54098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42104/0 (socket says 172.21.15.55:42104) 2024-04-02T07:25:01.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.002+0000 7fbb52a00640 1 -- 172.21.15.55:0/2708294933 learned_addr learned my addr 172.21.15.55:0/2708294933 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:01.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.002+0000 7fbb53400640 1 --2- 172.21.15.55:0/2708294933 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb5415f250 0x7fbb54099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:01.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.002+0000 7fbb52000640 1 -- 172.21.15.55:0/2708294933 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3301547695 0 0) 0x7fbb540ad270 con 0x7fbb5415ee70 2024-04-02T07:25:01.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.002+0000 7fbb52000640 1 -- 172.21.15.55:0/2708294933 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb38003530 con 0x7fbb5415ee70 2024-04-02T07:25:01.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.002+0000 7fbb52000640 1 -- 172.21.15.55:0/2708294933 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154122880 0 0) 0x7fbb540b0a50 con 0x7fbb54099120 2024-04-02T07:25:01.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.002+0000 7fbb52000640 1 -- 172.21.15.55:0/2708294933 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb540ad270 con 0x7fbb54099120 2024-04-02T07:25:01.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.002+0000 7fbb53400640 1 -- 172.21.15.55:0/2708294933 >> v1:172.21.15.106:6789/0 conn(0x7fbb54099120 legacy=0x7fbb540ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:01.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.002+0000 7fbb53400640 1 -- 172.21.15.55:0/2708294933 >> v1:172.21.15.55:6789/0 conn(0x7fbb5415ee70 legacy=0x7fbb54098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:01.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.002+0000 7fbb53400640 1 -- 172.21.15.55:0/2708294933 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb540b0d30 con 0x7fbb5415f250 2024-04-02T07:25:01.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.006+0000 7fbb53400640 1 --2- 172.21.15.55:0/2708294933 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb5415f250 0x7fbb54099830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c009dc0 tx=0x7fbb4c01c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dca1e3921e4332a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:01.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.006+0000 7fbb52000640 1 -- 172.21.15.55:0/2708294933 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0a5a00 con 0x7fbb5415f250 2024-04-02T07:25:01.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.006+0000 7fbb52000640 1 -- 172.21.15.55:0/2708294933 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4c0a5b60 con 0x7fbb5415f250 2024-04-02T07:25:01.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.006+0000 7fbb52000640 1 -- 172.21.15.55:0/2708294933 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0ad440 con 0x7fbb5415f250 2024-04-02T07:25:01.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.006+0000 7fbb59600640 1 -- 172.21.15.55:0/2708294933 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb5415f250 msgr2=0x7fbb54099830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:01.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.006+0000 7fbb59600640 1 --2- 172.21.15.55:0/2708294933 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb5415f250 0x7fbb54099830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c009dc0 tx=0x7fbb4c01c960 comp rx=0 tx=0).stop 2024-04-02T07:25:01.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.006+0000 7fbb59600640 1 -- 172.21.15.55:0/2708294933 shutdown_connections 2024-04-02T07:25:01.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.006+0000 7fbb59600640 1 --2- 172.21.15.55:0/2708294933 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb5415f250 0x7fbb54099830 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.006+0000 7fbb59600640 1 -- 172.21.15.55:0/2708294933 >> 172.21.15.55:0/2708294933 conn(0x7fbb540b21d0 msgr2=0x7fbb540b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:01.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.006+0000 7fbb59600640 1 -- 172.21.15.55:0/2708294933 shutdown_connections 2024-04-02T07:25:01.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.006+0000 7fbb59600640 1 -- 172.21.15.55:0/2708294933 wait complete. 2024-04-02T07:25:01.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb59600640 1 Processor -- start 2024-04-02T07:25:01.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb59600640 1 -- start start 2024-04-02T07:25:01.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb59600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb54099120 0x7fbb54158a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:01.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb59600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb5415ee70 0x7fbb5415d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:01.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb59600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5415f250 0x7fbb54153990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:01.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb59600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54154d40 con 0x7fbb5415f250 2024-04-02T07:25:01.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb59600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5406e840 con 0x7fbb5415ee70 2024-04-02T07:25:01.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb59600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5406eb20 con 0x7fbb54099120 2024-04-02T07:25:01.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb53400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5415f250 0x7fbb54153990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:01.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb53400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5415f250 0x7fbb54153990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36134/0 (socket says 172.21.15.55:36134) 2024-04-02T07:25:01.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb53400640 1 -- 172.21.15.55:0/2441651080 learned_addr learned my addr 172.21.15.55:0/2441651080 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:01.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb4a000640 1 --2- 172.21.15.55:0/2441651080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb5415ee70 0x7fbb5415d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:01.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb52a00640 1 --2- 172.21.15.55:0/2441651080 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb54099120 0x7fbb54158a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:01.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb53400640 1 -- 172.21.15.55:0/2441651080 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb54099120 msgr2=0x7fbb54158a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:01.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb53400640 1 --2- 172.21.15.55:0/2441651080 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb54099120 0x7fbb54158a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb53400640 1 -- 172.21.15.55:0/2441651080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb5415ee70 msgr2=0x7fbb5415d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:01.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb53400640 1 --2- 172.21.15.55:0/2441651080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb5415ee70 0x7fbb5415d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb53400640 1 -- 172.21.15.55:0/2441651080 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb4c009a70 con 0x7fbb5415f250 2024-04-02T07:25:01.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb4a000640 1 --2- 172.21.15.55:0/2441651080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb5415ee70 0x7fbb5415d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:01.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb53400640 1 --2- 172.21.15.55:0/2441651080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5415f250 0x7fbb54153990 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c01a590 tx=0x7fbb4c019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:01.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb4b400640 1 -- 172.21.15.55:0/2441651080 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0adca0 con 0x7fbb5415f250 2024-04-02T07:25:01.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb4b400640 1 -- 172.21.15.55:0/2441651080 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4c0ade00 con 0x7fbb5415f250 2024-04-02T07:25:01.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb4b400640 1 -- 172.21.15.55:0/2441651080 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4c0b9690 con 0x7fbb5415f250 2024-04-02T07:25:01.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb59600640 1 -- 172.21.15.55:0/2441651080 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb5406ee00 con 0x7fbb5415f250 2024-04-02T07:25:01.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb59600640 1 -- 172.21.15.55:0/2441651080 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb540aef70 con 0x7fbb5415f250 2024-04-02T07:25:01.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.010+0000 7fbb59600640 1 -- 172.21.15.55:0/2441651080 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb540af160 con 0x7fbb5415f250 2024-04-02T07:25:01.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.014+0000 7fbb4b400640 1 -- 172.21.15.55:0/2441651080 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fbb4c0b97f0 con 0x7fbb5415f250 2024-04-02T07:25:01.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.014+0000 7fbb4b400640 1 --2- 172.21.15.55:0/2441651080 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb30066690 0x7fbb30068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:01.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.014+0000 7fbb4b400640 1 -- 172.21.15.55:0/2441651080 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbb4c11f8e0 con 0x7fbb5415f250 2024-04-02T07:25:01.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.014+0000 7fbb52a00640 1 --2- 172.21.15.55:0/2441651080 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb30066690 0x7fbb30068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:01.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.014+0000 7fbb52a00640 1 --2- 172.21.15.55:0/2441651080 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb30066690 0x7fbb30068b50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbb44000f70 tx=0x7fbb44009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:01.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.018+0000 7fbb4b400640 1 -- 172.21.15.55:0/2441651080 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fbb4c0ecd50 con 0x7fbb5415f250 2024-04-02T07:25:01.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.218+0000 7fbb59600640 1 -- 172.21.15.55:0/2441651080 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbb54066c90 con 0x7fbb5415f250 2024-04-02T07:25:01.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.218+0000 7fbb4b400640 1 -- 172.21.15.55:0/2441651080 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4740 (secure 0 0 0) 0x7fbb4c0b2090 con 0x7fbb5415f250 2024-04-02T07:25:01.220 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:01.220 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2224746522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2224746522},{"type":"v1","addr":"172.21.15.106:6837","nonce":2224746522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/2077739908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2077739908},{"type":"v1","addr":"172.21.15.55:6833","nonce":2077739908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/4108584287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4108584287},{"type":"v1","addr":"172.21.15.55:6835","nonce":4108584287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:24:11.929212+0000","modified":"2024-04-02T07:24:14.958225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5655":{"gid":5655,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6836/1720558250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1720558250},{"type":"v1","addr":"172.21.15.106:6836","nonce":1720558250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-02T07:25:01.221 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 25 2024-04-02T07:25:01.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.218+0000 7fbb59600640 1 -- 172.21.15.55:0/2441651080 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb30066690 msgr2=0x7fbb30068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:01.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.218+0000 7fbb59600640 1 --2- 172.21.15.55:0/2441651080 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb30066690 0x7fbb30068b50 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fbb44000f70 tx=0x7fbb44009040 comp rx=0 tx=0).stop 2024-04-02T07:25:01.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.218+0000 7fbb59600640 1 -- 172.21.15.55:0/2441651080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5415f250 msgr2=0x7fbb54153990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:01.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.218+0000 7fbb59600640 1 --2- 172.21.15.55:0/2441651080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5415f250 0x7fbb54153990 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fbb4c01a590 tx=0x7fbb4c019700 comp rx=0 tx=0).stop 2024-04-02T07:25:01.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.218+0000 7fbb59600640 1 -- 172.21.15.55:0/2441651080 shutdown_connections 2024-04-02T07:25:01.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.218+0000 7fbb59600640 1 --2- 172.21.15.55:0/2441651080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5415f250 0x7fbb54153990 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.218+0000 7fbb59600640 1 --2- 172.21.15.55:0/2441651080 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb30066690 0x7fbb30068b50 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.218+0000 7fbb59600640 1 --2- 172.21.15.55:0/2441651080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb5415ee70 0x7fbb5415d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.218+0000 7fbb59600640 1 --2- 172.21.15.55:0/2441651080 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb54099120 0x7fbb54158a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.218+0000 7fbb59600640 1 -- 172.21.15.55:0/2441651080 >> 172.21.15.55:0/2441651080 conn(0x7fbb540b21d0 msgr2=0x7fbb5406b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:01.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.218+0000 7fbb59600640 1 -- 172.21.15.55:0/2441651080 shutdown_connections 2024-04-02T07:25:01.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.218+0000 7fbb59600640 1 -- 172.21.15.55:0/2441651080 wait complete. 2024-04-02T07:25:01.242 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:25:01.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.378+0000 7fafa9200640 1 Processor -- start 2024-04-02T07:25:01.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.378+0000 7fafa9200640 1 -- start start 2024-04-02T07:25:01.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.378+0000 7fafa9200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fafa4156f70 0x7fafa415d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:01.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.378+0000 7fafa9200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fafa4157350 0x7fafa40cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:01.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.378+0000 7fafa9200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafa415d950 con 0x7fafa40d02a0 2024-04-02T07:25:01.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.378+0000 7fafa9200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafa415dc30 con 0x7fafa4157350 2024-04-02T07:25:01.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.378+0000 7fafa9200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa415df10 con 0x7fafa4156f70 2024-04-02T07:25:01.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.378+0000 7fafa2800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fafa40d02a0 0x7fafa40b31c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42120/0 (socket says 172.21.15.55:42120) 2024-04-02T07:25:01.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.378+0000 7fafa2800640 1 -- 172.21.15.55:0/1824602980 learned_addr learned my addr 172.21.15.55:0/1824602980 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:01.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.378+0000 7faf99400640 1 --2- 172.21.15.55:0/1824602980 >> v2:172.21.15.55:3300/0 conn(0x7fafa4157350 0x7fafa40cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:01.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.378+0000 7fafa1e00640 1 --2- 172.21.15.55:0/1824602980 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fafa4156f70 0x7fafa415d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:01.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.378+0000 7fafa1400640 1 -- 172.21.15.55:0/1824602980 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4001516760 0 0) 0x7fafa415d950 con 0x7fafa40d02a0 2024-04-02T07:25:01.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.378+0000 7fafa1400640 1 -- 172.21.15.55:0/1824602980 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf88003530 con 0x7fafa40d02a0 2024-04-02T07:25:01.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.378+0000 7faf99400640 1 -- 172.21.15.55:0/1824602980 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fafa4156f70 msgr2=0x7fafa415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:01.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.378+0000 7faf99400640 1 --2- 172.21.15.55:0/1824602980 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fafa4156f70 0x7fafa415d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.378+0000 7faf99400640 1 -- 172.21.15.55:0/1824602980 >> v1:172.21.15.55:6789/0 conn(0x7fafa40d02a0 legacy=0x7fafa40b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:01.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.378+0000 7faf99400640 1 -- 172.21.15.55:0/1824602980 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa40cf560 con 0x7fafa4157350 2024-04-02T07:25:01.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.382+0000 7faf99400640 1 --2- 172.21.15.55:0/1824602980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafa4157350 0x7fafa40cfd60 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009d90 tx=0x7faf8c01c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b95c9a63f7df295 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:01.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.382+0000 7fafa1400640 1 -- 172.21.15.55:0/1824602980 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0a5a20 con 0x7fafa4157350 2024-04-02T07:25:01.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.382+0000 7fafa1400640 1 -- 172.21.15.55:0/1824602980 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c0a5b80 con 0x7fafa4157350 2024-04-02T07:25:01.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.382+0000 7fafa1400640 1 -- 172.21.15.55:0/1824602980 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c0ad440 con 0x7fafa4157350 2024-04-02T07:25:01.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.382+0000 7fafa9200640 1 -- 172.21.15.55:0/1824602980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafa4157350 msgr2=0x7fafa40cfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:01.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.382+0000 7fafa9200640 1 --2- 172.21.15.55:0/1824602980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafa4157350 0x7fafa40cfd60 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7faf8c009d90 tx=0x7faf8c01c940 comp rx=0 tx=0).stop 2024-04-02T07:25:01.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.382+0000 7fafa9200640 1 -- 172.21.15.55:0/1824602980 shutdown_connections 2024-04-02T07:25:01.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.382+0000 7fafa9200640 1 --2- 172.21.15.55:0/1824602980 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafa4157350 0x7fafa40cfd60 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.382+0000 7fafa9200640 1 --2- 172.21.15.55:0/1824602980 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fafa4156f70 0x7fafa415d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.382+0000 7fafa9200640 1 -- 172.21.15.55:0/1824602980 >> 172.21.15.55:0/1824602980 conn(0x7fafa40b13b0 msgr2=0x7fafa40b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:01.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.382+0000 7fafa9200640 1 -- 172.21.15.55:0/1824602980 shutdown_connections 2024-04-02T07:25:01.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.382+0000 7fafa9200640 1 -- 172.21.15.55:0/1824602980 wait complete. 2024-04-02T07:25:01.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7fafa9200640 1 Processor -- start 2024-04-02T07:25:01.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7fafa9200640 1 -- start start 2024-04-02T07:25:01.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7fafa9200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafa40d02a0 0x7fafa4151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:01.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7fafa9200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fafa4156f70 0x7fafa40ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:01.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7fafa9200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafa4157350 0x7fafa40cd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:01.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7fafa9200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa41523d0 con 0x7fafa4157350 2024-04-02T07:25:01.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7fafa9200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40cabd0 con 0x7fafa40d02a0 2024-04-02T07:25:01.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7fafa9200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafa40caeb0 con 0x7fafa4156f70 2024-04-02T07:25:01.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7fafa2800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafa4157350 0x7fafa40cd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:01.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7fafa2800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafa4157350 0x7fafa40cd5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36156/0 (socket says 172.21.15.55:36156) 2024-04-02T07:25:01.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7fafa2800640 1 -- 172.21.15.55:0/2773862792 learned_addr learned my addr 172.21.15.55:0/2773862792 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:01.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7fafa1e00640 1 --2- 172.21.15.55:0/2773862792 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafa40d02a0 0x7fafa4151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:01.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7faf99400640 1 --2- 172.21.15.55:0/2773862792 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fafa4156f70 0x7fafa40ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:01.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7fafa2800640 1 -- 172.21.15.55:0/2773862792 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fafa4156f70 msgr2=0x7fafa40ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:01.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7fafa2800640 1 --2- 172.21.15.55:0/2773862792 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fafa4156f70 0x7fafa40ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7fafa2800640 1 -- 172.21.15.55:0/2773862792 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafa40d02a0 msgr2=0x7fafa4151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:01.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7fafa2800640 1 --2- 172.21.15.55:0/2773862792 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafa40d02a0 0x7fafa4151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7fafa2800640 1 -- 172.21.15.55:0/2773862792 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8c009a70 con 0x7fafa4157350 2024-04-02T07:25:01.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7fafa2800640 1 --2- 172.21.15.55:0/2773862792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafa4157350 0x7fafa40cd5b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00c3e0 tx=0x7faf9c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:01.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7faf9aa00640 1 -- 172.21.15.55:0/2773862792 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c005cf0 con 0x7fafa4157350 2024-04-02T07:25:01.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7faf9aa00640 1 -- 172.21.15.55:0/2773862792 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf9c005e50 con 0x7fafa4157350 2024-04-02T07:25:01.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7faf9aa00640 1 -- 172.21.15.55:0/2773862792 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf9c0072d0 con 0x7fafa4157350 2024-04-02T07:25:01.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7fafa9200640 1 -- 172.21.15.55:0/2773862792 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafa40cb190 con 0x7fafa4157350 2024-04-02T07:25:01.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.386+0000 7fafa9200640 1 -- 172.21.15.55:0/2773862792 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafa40cb750 con 0x7fafa4157350 2024-04-02T07:25:01.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.390+0000 7fafa9200640 1 -- 172.21.15.55:0/2773862792 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafa40cb940 con 0x7fafa4157350 2024-04-02T07:25:01.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.390+0000 7faf9aa00640 1 -- 172.21.15.55:0/2773862792 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7faf9c007430 con 0x7fafa4157350 2024-04-02T07:25:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.390+0000 7faf9aa00640 1 --2- 172.21.15.55:0/2773862792 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faf80066690 0x7faf80068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.390+0000 7faf9aa00640 1 -- 172.21.15.55:0/2773862792 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7faf9c083700 con 0x7fafa4157350 2024-04-02T07:25:01.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.390+0000 7fafa1e00640 1 --2- 172.21.15.55:0/2773862792 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faf80066690 0x7faf80068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:01.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.390+0000 7fafa1e00640 1 --2- 172.21.15.55:0/2773862792 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faf80066690 0x7faf80068b50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7faf94009b60 tx=0x7faf94009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:01.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.394+0000 7faf9aa00640 1 -- 172.21.15.55:0/2773862792 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7faf9c050ad0 con 0x7fafa4157350 2024-04-02T07:25:01.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.554+0000 7fafa9200640 1 -- 172.21.15.55:0/2773862792 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fafa4066c90 con 0x7fafa4157350 2024-04-02T07:25:01.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.558+0000 7faf9aa00640 1 -- 172.21.15.55:0/2773862792 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16197 (secure 0 0 0) 0x7faf9c0540f0 con 0x7fafa4157350 2024-04-02T07:25:01.560 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:01.560 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":48,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:25:00.229800+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:24:10.453515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-02T07:24:10.908188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2a","mappings":[{"from":0,"to":4}]},{"pgid":"7.30","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:25:01.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.558+0000 7fafa9200640 1 -- 172.21.15.55:0/2773862792 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faf80066690 msgr2=0x7faf80068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:01.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.558+0000 7fafa9200640 1 --2- 172.21.15.55:0/2773862792 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faf80066690 0x7faf80068b50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7faf94009b60 tx=0x7faf94009190 comp rx=0 tx=0).stop 2024-04-02T07:25:01.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.558+0000 7fafa9200640 1 -- 172.21.15.55:0/2773862792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafa4157350 msgr2=0x7fafa40cd5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:01.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.558+0000 7fafa9200640 1 --2- 172.21.15.55:0/2773862792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafa4157350 0x7fafa40cd5b0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7faf9c00c3e0 tx=0x7faf9c00c8a0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.558+0000 7fafa9200640 1 -- 172.21.15.55:0/2773862792 shutdown_connections 2024-04-02T07:25:01.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.558+0000 7fafa9200640 1 --2- 172.21.15.55:0/2773862792 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fafa4157350 0x7fafa40cd5b0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.558+0000 7fafa9200640 1 --2- 172.21.15.55:0/2773862792 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fafa4156f70 0x7fafa40ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.558+0000 7fafa9200640 1 --2- 172.21.15.55:0/2773862792 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faf80066690 0x7faf80068b50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.558+0000 7fafa9200640 1 --2- 172.21.15.55:0/2773862792 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fafa40d02a0 0x7fafa4151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.558+0000 7fafa9200640 1 -- 172.21.15.55:0/2773862792 >> 172.21.15.55:0/2773862792 conn(0x7fafa40b13b0 msgr2=0x7fafa4156240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:01.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.558+0000 7fafa9200640 1 -- 172.21.15.55:0/2773862792 shutdown_connections 2024-04-02T07:25:01.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.558+0000 7fafa9200640 1 -- 172.21.15.55:0/2773862792 wait complete. 2024-04-02T07:25:01.582 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-02T07:25:01.582 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:25:01.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.718+0000 7f8c16000640 1 Processor -- start 2024-04-02T07:25:01.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.718+0000 7f8c16000640 1 -- start start 2024-04-02T07:25:01.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.722+0000 7f8c16000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c10143f90 0x7f8c1015ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:01.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.722+0000 7f8c16000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8c100cda80 0x7f8c100c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:01.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.722+0000 7f8c16000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c1015b270 con 0x7f8c100b34f0 2024-04-02T07:25:01.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.722+0000 7f8c16000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c10144370 con 0x7f8c100cda80 2024-04-02T07:25:01.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.722+0000 7f8c16000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100c37b0 con 0x7f8c10143f90 2024-04-02T07:25:01.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.722+0000 7f8c0fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8c100cda80 0x7f8c100c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:01.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.722+0000 7f8c0fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8c100cda80 0x7f8c100c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36158/0 (socket says 172.21.15.55:36158) 2024-04-02T07:25:01.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.722+0000 7f8c0fe00640 1 -- 172.21.15.55:0/1028172727 learned_addr learned my addr 172.21.15.55:0/1028172727 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:01.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.722+0000 7f8c0f400640 1 --2- 172.21.15.55:0/1028172727 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c10143f90 0x7f8c1015ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:01.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.722+0000 7f8c0fe00640 1 -- 172.21.15.55:0/1028172727 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c10143f90 msgr2=0x7f8c1015ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:01.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.722+0000 7f8c0fe00640 1 --2- 172.21.15.55:0/1028172727 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c10143f90 0x7f8c1015ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.722+0000 7f8c0fe00640 1 -- 172.21.15.55:0/1028172727 >> v1:172.21.15.106:6789/0 conn(0x7f8c100b34f0 legacy=0x7f8c100cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:01.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.722+0000 7f8c0fe00640 1 -- 172.21.15.55:0/1028172727 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c100c3a90 con 0x7f8c100cda80 2024-04-02T07:25:01.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.722+0000 7f8c0f400640 1 --2- 172.21.15.55:0/1028172727 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c10143f90 0x7f8c1015ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:25:01.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c0fe00640 1 --2- 172.21.15.55:0/1028172727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c100cda80 0x7f8c100c4850 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8c08009e50 tx=0x7f8c0801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a241f71d2887f902 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:01.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c0ea00640 1 -- 172.21.15.55:0/1028172727 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c080a57b0 con 0x7f8c100cda80 2024-04-02T07:25:01.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c0ea00640 1 -- 172.21.15.55:0/1028172727 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c080a5910 con 0x7f8c100cda80 2024-04-02T07:25:01.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c0ea00640 1 -- 172.21.15.55:0/1028172727 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c080a5ca0 con 0x7f8c100cda80 2024-04-02T07:25:01.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c16000640 1 -- 172.21.15.55:0/1028172727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c100cda80 msgr2=0x7f8c100c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:01.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c16000640 1 --2- 172.21.15.55:0/1028172727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c100cda80 0x7f8c100c4850 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8c08009e50 tx=0x7f8c0801c930 comp rx=0 tx=0).stop 2024-04-02T07:25:01.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c16000640 1 -- 172.21.15.55:0/1028172727 shutdown_connections 2024-04-02T07:25:01.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c16000640 1 --2- 172.21.15.55:0/1028172727 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c100cda80 0x7f8c100c4850 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c16000640 1 --2- 172.21.15.55:0/1028172727 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c10143f90 0x7f8c1015ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c16000640 1 -- 172.21.15.55:0/1028172727 >> 172.21.15.55:0/1028172727 conn(0x7f8c10066080 msgr2=0x7f8c10069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:01.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c16000640 1 -- 172.21.15.55:0/1028172727 shutdown_connections 2024-04-02T07:25:01.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c16000640 1 -- 172.21.15.55:0/1028172727 wait complete. 2024-04-02T07:25:01.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c16000640 1 Processor -- start 2024-04-02T07:25:01.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c16000640 1 -- start start 2024-04-02T07:25:01.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c16000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c100b34f0 0x7f8c100c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:01.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c16000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c100cda80 0x7f8c10140200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:01.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c16000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c10143f90 0x7f8c100c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:01.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c16000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c100c69e0 con 0x7f8c100cda80 2024-04-02T07:25:01.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c16000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1013f200 con 0x7f8c100b34f0 2024-04-02T07:25:01.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c16000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c1013f4e0 con 0x7f8c10143f90 2024-04-02T07:25:01.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c06a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c100cda80 0x7f8c10140200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:01.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c06a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c100cda80 0x7f8c10140200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36160/0 (socket says 172.21.15.55:36160) 2024-04-02T07:25:01.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c06a00640 1 -- 172.21.15.55:0/3938724998 learned_addr learned my addr 172.21.15.55:0/3938724998 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:01.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.726+0000 7f8c0f400640 1 --2- 172.21.15.55:0/3938724998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c100b34f0 0x7f8c100c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:01.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.730+0000 7f8c0fe00640 1 --2- 172.21.15.55:0/3938724998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c10143f90 0x7f8c100c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:01.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.730+0000 7f8c06a00640 1 -- 172.21.15.55:0/3938724998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c10143f90 msgr2=0x7f8c100c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:01.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.730+0000 7f8c06a00640 1 --2- 172.21.15.55:0/3938724998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c10143f90 0x7f8c100c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.730+0000 7f8c06a00640 1 -- 172.21.15.55:0/3938724998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c100b34f0 msgr2=0x7f8c100c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:01.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.730+0000 7f8c06a00640 1 --2- 172.21.15.55:0/3938724998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c100b34f0 0x7f8c100c8fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.730+0000 7f8c06a00640 1 -- 172.21.15.55:0/3938724998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c08009b30 con 0x7f8c100cda80 2024-04-02T07:25:01.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.730+0000 7f8c06a00640 1 --2- 172.21.15.55:0/3938724998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c100cda80 0x7f8c10140200 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8bf800c450 tx=0x7f8bf800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:01.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.730+0000 7f8c07e00640 1 -- 172.21.15.55:0/3938724998 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8012830 con 0x7f8c100cda80 2024-04-02T07:25:01.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.730+0000 7f8c07e00640 1 -- 172.21.15.55:0/3938724998 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf80129b0 con 0x7f8c100cda80 2024-04-02T07:25:01.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.730+0000 7f8c16000640 1 -- 172.21.15.55:0/3938724998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c1013f7c0 con 0x7f8c100cda80 2024-04-02T07:25:01.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.730+0000 7f8c07e00640 1 -- 172.21.15.55:0/3938724998 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf8012d60 con 0x7f8c100cda80 2024-04-02T07:25:01.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.730+0000 7f8c16000640 1 -- 172.21.15.55:0/3938724998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c100c6f80 con 0x7f8c100cda80 2024-04-02T07:25:01.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.730+0000 7f8c16000640 1 -- 172.21.15.55:0/3938724998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c100c71a0 con 0x7f8c100cda80 2024-04-02T07:25:01.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.730+0000 7f8c07e00640 1 -- 172.21.15.55:0/3938724998 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8bf801c460 con 0x7f8c100cda80 2024-04-02T07:25:01.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.730+0000 7f8c07e00640 1 --2- 172.21.15.55:0/3938724998 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8bec066690 0x7f8bec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:01.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.734+0000 7f8c07e00640 1 -- 172.21.15.55:0/3938724998 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8bf8083f70 con 0x7f8c100cda80 2024-04-02T07:25:01.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.734+0000 7f8c0f400640 1 --2- 172.21.15.55:0/3938724998 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8bec066690 0x7f8bec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:01.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.734+0000 7f8c0f400640 1 --2- 172.21.15.55:0/3938724998 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8bec066690 0x7f8bec068b50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8c00006fd0 tx=0x7f8c00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:01.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.734+0000 7f8c07e00640 1 -- 172.21.15.55:0/3938724998 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f8bf80512b0 con 0x7f8c100cda80 2024-04-02T07:25:01.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.926+0000 7f8c16000640 1 -- 172.21.15.55:0/3938724998 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c10066c90 con 0x7f8c100cda80 2024-04-02T07:25:01.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.926+0000 7f8c07e00640 1 -- 172.21.15.55:0/3938724998 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f8bf80548d0 con 0x7f8c100cda80 2024-04-02T07:25:01.932 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:01.932 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2224746522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2224746522},{"type":"v1","addr":"172.21.15.106:6837","nonce":2224746522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/2077739908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2077739908},{"type":"v1","addr":"172.21.15.55:6833","nonce":2077739908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/4108584287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4108584287},{"type":"v1","addr":"172.21.15.55:6835","nonce":4108584287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:24:11.929212+0000","modified":"2024-04-02T07:24:14.958225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5655":{"gid":5655,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6836/1720558250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1720558250},{"type":"v1","addr":"172.21.15.106:6836","nonce":1720558250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-02T07:25:01.932 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 25 2024-04-02T07:25:01.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.930+0000 7f8c16000640 1 -- 172.21.15.55:0/3938724998 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8bec066690 msgr2=0x7f8bec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:01.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.930+0000 7f8c16000640 1 --2- 172.21.15.55:0/3938724998 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8bec066690 0x7f8bec068b50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f8c00006fd0 tx=0x7f8c00008040 comp rx=0 tx=0).stop 2024-04-02T07:25:01.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.930+0000 7f8c16000640 1 -- 172.21.15.55:0/3938724998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c100cda80 msgr2=0x7f8c10140200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.930+0000 7f8c16000640 1 --2- 172.21.15.55:0/3938724998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c100cda80 0x7f8c10140200 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8bf800c450 tx=0x7f8bf800c910 comp rx=0 tx=0).stop 2024-04-02T07:25:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.930+0000 7f8c16000640 1 -- 172.21.15.55:0/3938724998 shutdown_connections 2024-04-02T07:25:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.930+0000 7f8c16000640 1 --2- 172.21.15.55:0/3938724998 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8c10143f90 0x7f8c100c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.930+0000 7f8c16000640 1 --2- 172.21.15.55:0/3938724998 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c100cda80 0x7f8c10140200 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.930+0000 7f8c16000640 1 --2- 172.21.15.55:0/3938724998 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8bec066690 0x7f8bec068b50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.930+0000 7f8c16000640 1 --2- 172.21.15.55:0/3938724998 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8c100b34f0 0x7f8c100c8fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.930+0000 7f8c16000640 1 -- 172.21.15.55:0/3938724998 >> 172.21.15.55:0/3938724998 conn(0x7f8c10066080 msgr2=0x7f8c1015b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.930+0000 7f8c16000640 1 -- 172.21.15.55:0/3938724998 shutdown_connections 2024-04-02T07:25:01.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:01.930+0000 7f8c16000640 1 -- 172.21.15.55:0/3938724998 wait complete. 2024-04-02T07:25:01.953 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:25:02.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.090+0000 7f59bd000640 1 Processor -- start 2024-04-02T07:25:02.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.090+0000 7f59bd000640 1 -- start start 2024-04-02T07:25:02.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.090+0000 7f59bd000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f59b8143f90 0x7f59b815ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:02.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.090+0000 7f59bd000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f59b80b34f0 0x7f59b80cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:02.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.090+0000 7f59bd000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b815b270 con 0x7f59b80b3980 2024-04-02T07:25:02.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.090+0000 7f59bd000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b8144370 con 0x7f59b80b34f0 2024-04-02T07:25:02.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.090+0000 7f59bd000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59b80c37b0 con 0x7f59b8143f90 2024-04-02T07:25:02.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.090+0000 7f59ad400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f59b80b34f0 0x7f59b80cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:02.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.090+0000 7f59b6800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f59b80b3980 0x7f59b80c4850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42128/0 (socket says 172.21.15.55:42128) 2024-04-02T07:25:02.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.090+0000 7f59b6800640 1 -- 172.21.15.55:0/187493437 learned_addr learned my addr 172.21.15.55:0/187493437 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:02.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.090+0000 7f59ad400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f59b80b34f0 0x7f59b80cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36172/0 (socket says 172.21.15.55:36172) 2024-04-02T07:25:02.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.090+0000 7f59b5e00640 1 --2- 172.21.15.55:0/187493437 >> v2:172.21.15.106:3300/0 conn(0x7f59b8143f90 0x7f59b815ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:02.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.090+0000 7f59ad400640 1 -- 172.21.15.55:0/187493437 >> v2:172.21.15.106:3300/0 conn(0x7f59b8143f90 msgr2=0x7f59b815ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:02.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.090+0000 7f59ad400640 1 --2- 172.21.15.55:0/187493437 >> v2:172.21.15.106:3300/0 conn(0x7f59b8143f90 0x7f59b815ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.090+0000 7f59ad400640 1 -- 172.21.15.55:0/187493437 >> v1:172.21.15.55:6789/0 conn(0x7f59b80b3980 legacy=0x7f59b80c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:02.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.090+0000 7f59ad400640 1 -- 172.21.15.55:0/187493437 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b80c3a90 con 0x7f59b80b34f0 2024-04-02T07:25:02.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.094+0000 7f59ad400640 1 --2- 172.21.15.55:0/187493437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59b80b34f0 0x7f59b80cd370 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f59b806abc0 tx=0x7f59a001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4e075a7a51d16c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:02.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.094+0000 7f59b5400640 1 -- 172.21.15.55:0/187493437 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a00ab600 con 0x7f59b80b34f0 2024-04-02T07:25:02.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.094+0000 7f59b5400640 1 -- 172.21.15.55:0/187493437 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a00a7050 con 0x7f59b80b34f0 2024-04-02T07:25:02.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.094+0000 7f59b5400640 1 -- 172.21.15.55:0/187493437 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a00ab980 con 0x7f59b80b34f0 2024-04-02T07:25:02.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.094+0000 7f59bd000640 1 -- 172.21.15.55:0/187493437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59b80b34f0 msgr2=0x7f59b80cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:02.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.094+0000 7f59bd000640 1 --2- 172.21.15.55:0/187493437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59b80b34f0 0x7f59b80cd370 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f59b806abc0 tx=0x7f59a001c3c0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.094+0000 7f59bd000640 1 -- 172.21.15.55:0/187493437 shutdown_connections 2024-04-02T07:25:02.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.094+0000 7f59bd000640 1 --2- 172.21.15.55:0/187493437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59b80b34f0 0x7f59b80cd370 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.094+0000 7f59bd000640 1 --2- 172.21.15.55:0/187493437 >> v2:172.21.15.106:3300/0 conn(0x7f59b8143f90 0x7f59b815ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.094+0000 7f59bd000640 1 -- 172.21.15.55:0/187493437 >> 172.21.15.55:0/187493437 conn(0x7f59b8066080 msgr2=0x7f59b8069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:02.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.094+0000 7f59bd000640 1 -- 172.21.15.55:0/187493437 shutdown_connections 2024-04-02T07:25:02.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.094+0000 7f59bd000640 1 -- 172.21.15.55:0/187493437 wait complete. 2024-04-02T07:25:02.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59bd000640 1 Processor -- start 2024-04-02T07:25:02.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59bd000640 1 -- start start 2024-04-02T07:25:02.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59bd000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59b80b34f0 0x7f59b81f8f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:02.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59bd000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59b80b3980 0x7f59b81f9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:02.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59bd000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59b8143f90 0x7f59b81f81f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:02.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59bd000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b8165190 con 0x7f59b80b3980 2024-04-02T07:25:02.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59bd000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b80cb890 con 0x7f59b80b34f0 2024-04-02T07:25:02.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59bd000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b80cbb70 con 0x7f59b8143f90 2024-04-02T07:25:02.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59ad400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59b80b3980 0x7f59b81f9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:02.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59ad400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59b80b3980 0x7f59b81f9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36182/0 (socket says 172.21.15.55:36182) 2024-04-02T07:25:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59ad400640 1 -- 172.21.15.55:0/3354757346 learned_addr learned my addr 172.21.15.55:0/3354757346 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59ad400640 1 -- 172.21.15.55:0/3354757346 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59b8143f90 msgr2=0x7f59b81f81f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59ad400640 1 --2- 172.21.15.55:0/3354757346 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59b8143f90 0x7f59b81f81f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59ad400640 1 -- 172.21.15.55:0/3354757346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59b80b34f0 msgr2=0x7f59b81f8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59ad400640 1 --2- 172.21.15.55:0/3354757346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59b80b34f0 0x7f59b81f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59ad400640 1 -- 172.21.15.55:0/3354757346 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a0009420 con 0x7f59b80b3980 2024-04-02T07:25:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59ad400640 1 --2- 172.21.15.55:0/3354757346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59b80b3980 0x7f59b81f9480 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f59a00ae040 tx=0x7f59a0019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59aea00640 1 -- 172.21.15.55:0/3354757346 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a00b4430 con 0x7f59b80b3980 2024-04-02T07:25:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59aea00640 1 -- 172.21.15.55:0/3354757346 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a00b45b0 con 0x7f59b80b3980 2024-04-02T07:25:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59aea00640 1 -- 172.21.15.55:0/3354757346 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a00b4960 con 0x7f59b80b3980 2024-04-02T07:25:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59bd000640 1 -- 172.21.15.55:0/3354757346 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b80cbe50 con 0x7f59b80b3980 2024-04-02T07:25:02.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.098+0000 7f59bd000640 1 -- 172.21.15.55:0/3354757346 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b81f8730 con 0x7f59b80b3980 2024-04-02T07:25:02.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.102+0000 7f59bd000640 1 -- 172.21.15.55:0/3354757346 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b8066c90 con 0x7f59b80b3980 2024-04-02T07:25:02.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.102+0000 7f59aea00640 1 -- 172.21.15.55:0/3354757346 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f59a00b2040 con 0x7f59b80b3980 2024-04-02T07:25:02.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.102+0000 7f59aea00640 1 --2- 172.21.15.55:0/3354757346 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5994066690 0x7f5994068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:02.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.102+0000 7f59aea00640 1 -- 172.21.15.55:0/3354757346 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f59a011e1b0 con 0x7f59b80b3980 2024-04-02T07:25:02.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.102+0000 7f59b5e00640 1 --2- 172.21.15.55:0/3354757346 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5994066690 0x7f5994068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:02.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.102+0000 7f59b5e00640 1 --2- 172.21.15.55:0/3354757346 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5994066690 0x7f5994068b50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f59a800b850 tx=0x7f59a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:02.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.106+0000 7f59aea00640 1 -- 172.21.15.55:0/3354757346 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f59a00eb4e0 con 0x7f59b80b3980 2024-04-02T07:25:02.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.306+0000 7f59bd000640 1 -- 172.21.15.55:0/3354757346 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f59b80cc300 con 0x7f59b80b3980 2024-04-02T07:25:02.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.306+0000 7f59aea00640 1 -- 172.21.15.55:0/3354757346 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f59a00eeb00 con 0x7f59b80b3980 2024-04-02T07:25:02.310 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:02.310 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":25,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2224746522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2224746522},{"type":"v1","addr":"172.21.15.106:6837","nonce":2224746522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/2077739908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2077739908},{"type":"v1","addr":"172.21.15.55:6833","nonce":2077739908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/4108584287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4108584287},{"type":"v1","addr":"172.21.15.55:6835","nonce":4108584287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:24:11.929212+0000","modified":"2024-04-02T07:24:14.958225+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5655},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5655":{"gid":5655,"name":"b","rank":0,"incarnation":21,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6836/1720558250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1720558250},{"type":"v1","addr":"172.21.15.106:6836","nonce":1720558250}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2024-04-02T07:25:02.311 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 25 2024-04-02T07:25:02.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.310+0000 7f59bd000640 1 -- 172.21.15.55:0/3354757346 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5994066690 msgr2=0x7f5994068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:02.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.310+0000 7f59bd000640 1 --2- 172.21.15.55:0/3354757346 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5994066690 0x7f5994068b50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f59a800b850 tx=0x7f59a8008040 comp rx=0 tx=0).stop 2024-04-02T07:25:02.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.310+0000 7f59bd000640 1 -- 172.21.15.55:0/3354757346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59b80b3980 msgr2=0x7f59b81f9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:02.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.310+0000 7f59bd000640 1 --2- 172.21.15.55:0/3354757346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59b80b3980 0x7f59b81f9480 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f59a00ae040 tx=0x7f59a0019160 comp rx=0 tx=0).stop 2024-04-02T07:25:02.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.310+0000 7f59bd000640 1 -- 172.21.15.55:0/3354757346 shutdown_connections 2024-04-02T07:25:02.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.310+0000 7f59bd000640 1 --2- 172.21.15.55:0/3354757346 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59b8143f90 0x7f59b81f81f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.310+0000 7f59bd000640 1 --2- 172.21.15.55:0/3354757346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59b80b3980 0x7f59b81f9480 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.310+0000 7f59bd000640 1 --2- 172.21.15.55:0/3354757346 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5994066690 0x7f5994068b50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.310+0000 7f59bd000640 1 --2- 172.21.15.55:0/3354757346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59b80b34f0 0x7f59b81f8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.310+0000 7f59bd000640 1 -- 172.21.15.55:0/3354757346 >> 172.21.15.55:0/3354757346 conn(0x7f59b8066080 msgr2=0x7f59b813d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:02.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.310+0000 7f59bd000640 1 -- 172.21.15.55:0/3354757346 shutdown_connections 2024-04-02T07:25:02.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.310+0000 7f59bd000640 1 -- 172.21.15.55:0/3354757346 wait complete. 2024-04-02T07:25:02.332 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:25:02.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.466+0000 7f6a8d400640 1 Processor -- start 2024-04-02T07:25:02.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.466+0000 7f6a8d400640 1 -- start start 2024-04-02T07:25:02.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.470+0000 7f6a8d400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a881597a0 0x7f6a880aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:02.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.470+0000 7f6a8d400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6a8806f9a0 0x7f6a880b26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:02.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.470+0000 7f6a8d400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a880cd620 con 0x7f6a880b2bf0 2024-04-02T07:25:02.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.470+0000 7f6a8d400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a8815e2c0 con 0x7f6a881597a0 2024-04-02T07:25:02.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.470+0000 7f6a8d400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a88159b80 con 0x7f6a8806f9a0 2024-04-02T07:25:02.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.470+0000 7f6a86800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a881597a0 0x7f6a880aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:02.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.470+0000 7f6a86800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6a881597a0 0x7f6a880aedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36186/0 (socket says 172.21.15.55:36186) 2024-04-02T07:25:02.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.470+0000 7f6a86800640 1 -- 172.21.15.55:0/366955934 learned_addr learned my addr 172.21.15.55:0/366955934 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:02.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.470+0000 7f6a86800640 1 -- 172.21.15.55:0/366955934 >> v2:172.21.15.106:3300/0 conn(0x7f6a8806f9a0 msgr2=0x7f6a880b26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:02.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.470+0000 7f6a86800640 1 --2- 172.21.15.55:0/366955934 >> v2:172.21.15.106:3300/0 conn(0x7f6a8806f9a0 0x7f6a880b26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.470+0000 7f6a86800640 1 -- 172.21.15.55:0/366955934 >> v1:172.21.15.106:6789/0 conn(0x7f6a880b2bf0 legacy=0x7f6a880ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:02.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.470+0000 7f6a86800640 1 -- 172.21.15.55:0/366955934 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a8815dd20 con 0x7f6a881597a0 2024-04-02T07:25:02.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.474+0000 7f6a86800640 1 --2- 172.21.15.55:0/366955934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a881597a0 0x7f6a880aedc0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6a8806e470 tx=0x7f6a7801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321cdf8d42bebe1b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:02.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.474+0000 7f6a85e00640 1 -- 172.21.15.55:0/366955934 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a780ab620 con 0x7f6a881597a0 2024-04-02T07:25:02.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.474+0000 7f6a85e00640 1 -- 172.21.15.55:0/366955934 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a780ab780 con 0x7f6a881597a0 2024-04-02T07:25:02.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.474+0000 7f6a85e00640 1 -- 172.21.15.55:0/366955934 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a780abb10 con 0x7f6a881597a0 2024-04-02T07:25:02.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.474+0000 7f6a8d400640 1 -- 172.21.15.55:0/366955934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a881597a0 msgr2=0x7f6a880aedc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:02.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.474+0000 7f6a8d400640 1 --2- 172.21.15.55:0/366955934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a881597a0 0x7f6a880aedc0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f6a8806e470 tx=0x7f6a7801c420 comp rx=0 tx=0).stop 2024-04-02T07:25:02.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.474+0000 7f6a8d400640 1 -- 172.21.15.55:0/366955934 shutdown_connections 2024-04-02T07:25:02.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.474+0000 7f6a8d400640 1 --2- 172.21.15.55:0/366955934 >> v2:172.21.15.106:3300/0 conn(0x7f6a8806f9a0 0x7f6a880b26b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.474+0000 7f6a8d400640 1 --2- 172.21.15.55:0/366955934 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a881597a0 0x7f6a880aedc0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.474+0000 7f6a8d400640 1 -- 172.21.15.55:0/366955934 >> 172.21.15.55:0/366955934 conn(0x7f6a880b13b0 msgr2=0x7f6a880b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:02.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.474+0000 7f6a8d400640 1 -- 172.21.15.55:0/366955934 shutdown_connections 2024-04-02T07:25:02.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.474+0000 7f6a8d400640 1 -- 172.21.15.55:0/366955934 wait complete. 2024-04-02T07:25:02.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.474+0000 7f6a8d400640 1 Processor -- start 2024-04-02T07:25:02.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.474+0000 7f6a8d400640 1 -- start start 2024-04-02T07:25:02.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a8d400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a8806f9a0 0x7f6a880b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:02.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a8d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a880b2bf0 0x7f6a8814ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:02.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a8d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a881597a0 0x7f6a88159d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:02.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a8d400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8815fb00 con 0x7f6a881597a0 2024-04-02T07:25:02.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a8d400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8815b340 con 0x7f6a880b2bf0 2024-04-02T07:25:02.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a8d400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8815f260 con 0x7f6a8806f9a0 2024-04-02T07:25:02.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a87200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a881597a0 0x7f6a88159d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:02.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a87200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a881597a0 0x7f6a88159d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36202/0 (socket says 172.21.15.55:36202) 2024-04-02T07:25:02.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a87200640 1 -- 172.21.15.55:0/4168268881 learned_addr learned my addr 172.21.15.55:0/4168268881 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:02.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a7fe00640 1 --2- 172.21.15.55:0/4168268881 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a880b2bf0 0x7f6a8814ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:02.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a86800640 1 --2- 172.21.15.55:0/4168268881 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a8806f9a0 0x7f6a880b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:02.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a87200640 1 -- 172.21.15.55:0/4168268881 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a8806f9a0 msgr2=0x7f6a880b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:02.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a87200640 1 --2- 172.21.15.55:0/4168268881 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a8806f9a0 0x7f6a880b08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a87200640 1 -- 172.21.15.55:0/4168268881 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a880b2bf0 msgr2=0x7f6a8814ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:02.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a87200640 1 --2- 172.21.15.55:0/4168268881 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a880b2bf0 0x7f6a8814ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a87200640 1 -- 172.21.15.55:0/4168268881 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a780094d0 con 0x7f6a881597a0 2024-04-02T07:25:02.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a86800640 1 --2- 172.21.15.55:0/4168268881 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a8806f9a0 0x7f6a880b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:25:02.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a87200640 1 --2- 172.21.15.55:0/4168268881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a881597a0 0x7f6a88159d90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000c7b0 tx=0x7f6a8000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:02.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a7ea00640 1 -- 172.21.15.55:0/4168268881 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a80003d90 con 0x7f6a881597a0 2024-04-02T07:25:02.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a7ea00640 1 -- 172.21.15.55:0/4168268881 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a80005070 con 0x7f6a881597a0 2024-04-02T07:25:02.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a7ea00640 1 -- 172.21.15.55:0/4168268881 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a80005420 con 0x7f6a881597a0 2024-04-02T07:25:02.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a8d400640 1 -- 172.21.15.55:0/4168268881 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a8815f540 con 0x7f6a881597a0 2024-04-02T07:25:02.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a8d400640 1 -- 172.21.15.55:0/4168268881 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a8815ee80 con 0x7f6a881597a0 2024-04-02T07:25:02.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a8d400640 1 -- 172.21.15.55:0/4168268881 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8815b110 con 0x7f6a881597a0 2024-04-02T07:25:02.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.478+0000 7f6a7ea00640 1 -- 172.21.15.55:0/4168268881 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6a80005580 con 0x7f6a881597a0 2024-04-02T07:25:02.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.482+0000 7f6a7ea00640 1 --2- 172.21.15.55:0/4168268881 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a640666c0 0x7f6a64068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:02.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.482+0000 7f6a7ea00640 1 -- 172.21.15.55:0/4168268881 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6a800835e0 con 0x7f6a881597a0 2024-04-02T07:25:02.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.482+0000 7f6a86800640 1 --2- 172.21.15.55:0/4168268881 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a640666c0 0x7f6a64068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:02.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.482+0000 7f6a86800640 1 --2- 172.21.15.55:0/4168268881 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a640666c0 0x7f6a64068b80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6a780af000 tx=0x7f6a78008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:02.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.486+0000 7f6a7ea00640 1 -- 172.21.15.55:0/4168268881 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6a8815b110 con 0x7f6a881597a0 2024-04-02T07:25:02.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.646+0000 7f6a8d400640 1 -- 172.21.15.55:0/4168268881 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a8815b4f0 con 0x7f6a881597a0 2024-04-02T07:25:02.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.650+0000 7f6a7ea00640 1 -- 172.21.15.55:0/4168268881 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v48) v1 ==== 74+0+16197 (secure 0 0 0) 0x7f6a8815b4f0 con 0x7f6a881597a0 2024-04-02T07:25:02.651 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:02.652 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":48,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:25:00.229800+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:24:10.453515+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-04-02T07:24:10.908188+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.2a","mappings":[{"from":0,"to":4}]},{"pgid":"7.30","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:25:02.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.650+0000 7f6a8d400640 1 -- 172.21.15.55:0/4168268881 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a640666c0 msgr2=0x7f6a64068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:02.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.650+0000 7f6a8d400640 1 --2- 172.21.15.55:0/4168268881 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a640666c0 0x7f6a64068b80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6a780af000 tx=0x7f6a78008040 comp rx=0 tx=0).stop 2024-04-02T07:25:02.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.650+0000 7f6a8d400640 1 -- 172.21.15.55:0/4168268881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a881597a0 msgr2=0x7f6a88159d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:02.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.650+0000 7f6a8d400640 1 --2- 172.21.15.55:0/4168268881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a881597a0 0x7f6a88159d90 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000c7b0 tx=0x7f6a8000cc70 comp rx=0 tx=0).stop 2024-04-02T07:25:02.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.650+0000 7f6a8d400640 1 -- 172.21.15.55:0/4168268881 shutdown_connections 2024-04-02T07:25:02.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.650+0000 7f6a8d400640 1 --2- 172.21.15.55:0/4168268881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a881597a0 0x7f6a88159d90 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.650+0000 7f6a8d400640 1 --2- 172.21.15.55:0/4168268881 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a640666c0 0x7f6a64068b80 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.650+0000 7f6a8d400640 1 --2- 172.21.15.55:0/4168268881 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a880b2bf0 0x7f6a8814ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.650+0000 7f6a8d400640 1 --2- 172.21.15.55:0/4168268881 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a8806f9a0 0x7f6a880b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.650+0000 7f6a8d400640 1 -- 172.21.15.55:0/4168268881 >> 172.21.15.55:0/4168268881 conn(0x7f6a880b13b0 msgr2=0x7f6a880cb8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:02.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.650+0000 7f6a8d400640 1 -- 172.21.15.55:0/4168268881 shutdown_connections 2024-04-02T07:25:02.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.650+0000 7f6a8d400640 1 -- 172.21.15.55:0/4168268881 wait complete. 2024-04-02T07:25:02.673 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-02T07:25:02.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.810+0000 7fe516800640 1 Processor -- start 2024-04-02T07:25:02.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.810+0000 7fe516800640 1 -- start start 2024-04-02T07:25:02.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.810+0000 7fe516800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe51015a950 0x7fe5100cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:02.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.810+0000 7fe516800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5100cd630 0x7fe5100ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:02.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.810+0000 7fe516800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5100cb280 con 0x7fe5100ce8f0 2024-04-02T07:25:02.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.810+0000 7fe516800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5100c4250 con 0x7fe51015a950 2024-04-02T07:25:02.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.810+0000 7fe516800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5100cb7e0 con 0x7fe5100cd630 2024-04-02T07:25:02.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.810+0000 7fe50f400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe51015a950 0x7fe5100cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:02.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.810+0000 7fe50fe00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe5100ce8f0 0x7fe510098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42144/0 (socket says 172.21.15.55:42144) 2024-04-02T07:25:02.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.810+0000 7fe50fe00640 1 -- 172.21.15.55:0/1827256955 learned_addr learned my addr 172.21.15.55:0/1827256955 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:02.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.810+0000 7fe506a00640 1 --2- 172.21.15.55:0/1827256955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5100cd630 0x7fe5100ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:02.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.810+0000 7fe50f400640 1 -- 172.21.15.55:0/1827256955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5100cd630 msgr2=0x7fe5100ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:02.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.810+0000 7fe50f400640 1 --2- 172.21.15.55:0/1827256955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5100cd630 0x7fe5100ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.810+0000 7fe50f400640 1 -- 172.21.15.55:0/1827256955 >> v1:172.21.15.55:6789/0 conn(0x7fe5100ce8f0 legacy=0x7fe510098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:02.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.810+0000 7fe50f400640 1 -- 172.21.15.55:0/1827256955 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5100cda90 con 0x7fe51015a950 2024-04-02T07:25:02.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.810+0000 7fe50ea00640 1 -- 172.21.15.55:0/1827256955 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316946086 0 0) 0x7fe5100cb280 con 0x7fe5100ce8f0 2024-04-02T07:25:02.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.814+0000 7fe50f400640 1 --2- 172.21.15.55:0/1827256955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe51015a950 0x7fe5100cd0f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe500009d90 tx=0x7fe50001c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591d10a3a1ed241 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:02.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.814+0000 7fe50ea00640 1 -- 172.21.15.55:0/1827256955 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5000a5840 con 0x7fe51015a950 2024-04-02T07:25:02.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.814+0000 7fe50ea00640 1 -- 172.21.15.55:0/1827256955 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5000a59a0 con 0x7fe51015a950 2024-04-02T07:25:02.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.814+0000 7fe50ea00640 1 -- 172.21.15.55:0/1827256955 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5000a5d30 con 0x7fe51015a950 2024-04-02T07:25:02.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.814+0000 7fe516800640 1 -- 172.21.15.55:0/1827256955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe51015a950 msgr2=0x7fe5100cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:02.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.814+0000 7fe516800640 1 --2- 172.21.15.55:0/1827256955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe51015a950 0x7fe5100cd0f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fe500009d90 tx=0x7fe50001c970 comp rx=0 tx=0).stop 2024-04-02T07:25:02.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.814+0000 7fe516800640 1 -- 172.21.15.55:0/1827256955 shutdown_connections 2024-04-02T07:25:02.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.814+0000 7fe516800640 1 --2- 172.21.15.55:0/1827256955 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5100cd630 0x7fe5100ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.814+0000 7fe516800640 1 --2- 172.21.15.55:0/1827256955 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe51015a950 0x7fe5100cd0f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.814+0000 7fe516800640 1 -- 172.21.15.55:0/1827256955 >> 172.21.15.55:0/1827256955 conn(0x7fe5100d0700 msgr2=0x7fe5100d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:02.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.814+0000 7fe516800640 1 -- 172.21.15.55:0/1827256955 shutdown_connections 2024-04-02T07:25:02.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.814+0000 7fe516800640 1 -- 172.21.15.55:0/1827256955 wait complete. 2024-04-02T07:25:02.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe516800640 1 Processor -- start 2024-04-02T07:25:02.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe516800640 1 -- start start 2024-04-02T07:25:02.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe516800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5100cd630 0x7fe51014f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:02.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe516800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5100ce8f0 0x7fe510150460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:02.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe516800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe51015a950 0x7fe510162910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:02.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe516800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51014fac0 con 0x7fe5100ce8f0 2024-04-02T07:25:02.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe516800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5101509a0 con 0x7fe51015a950 2024-04-02T07:25:02.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe516800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe51006cad0 con 0x7fe5100cd630 2024-04-02T07:25:02.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe506a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5100ce8f0 0x7fe510150460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:02.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe506a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5100ce8f0 0x7fe510150460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36210/0 (socket says 172.21.15.55:36210) 2024-04-02T07:25:02.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe506a00640 1 -- 172.21.15.55:0/2991490138 learned_addr learned my addr 172.21.15.55:0/2991490138 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:02.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe50f400640 1 --2- 172.21.15.55:0/2991490138 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5100cd630 0x7fe51014f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:02.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe50fe00640 1 --2- 172.21.15.55:0/2991490138 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe51015a950 0x7fe510162910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:02.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe506a00640 1 -- 172.21.15.55:0/2991490138 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5100cd630 msgr2=0x7fe51014f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:02.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe506a00640 1 --2- 172.21.15.55:0/2991490138 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5100cd630 0x7fe51014f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe506a00640 1 -- 172.21.15.55:0/2991490138 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe51015a950 msgr2=0x7fe510162910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:02.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe506a00640 1 --2- 172.21.15.55:0/2991490138 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe51015a950 0x7fe510162910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:02.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe506a00640 1 -- 172.21.15.55:0/2991490138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe500009a70 con 0x7fe5100ce8f0 2024-04-02T07:25:02.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe506a00640 1 --2- 172.21.15.55:0/2991490138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5100ce8f0 0x7fe510150460 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe4f800d800 tx=0x7fe4f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:02.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe507e00640 1 -- 172.21.15.55:0/2991490138 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f800b6c0 con 0x7fe5100ce8f0 2024-04-02T07:25:02.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe507e00640 1 -- 172.21.15.55:0/2991490138 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4f800b820 con 0x7fe5100ce8f0 2024-04-02T07:25:02.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe516800640 1 -- 172.21.15.55:0/2991490138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe51006cdb0 con 0x7fe5100ce8f0 2024-04-02T07:25:02.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe507e00640 1 -- 172.21.15.55:0/2991490138 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4f800bb90 con 0x7fe5100ce8f0 2024-04-02T07:25:02.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe516800640 1 -- 172.21.15.55:0/2991490138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5101524f0 con 0x7fe5100ce8f0 2024-04-02T07:25:02.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.818+0000 7fe516800640 1 -- 172.21.15.55:0/2991490138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe510066c90 con 0x7fe5100ce8f0 2024-04-02T07:25:02.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.822+0000 7fe507e00640 1 -- 172.21.15.55:0/2991490138 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe4f800bcf0 con 0x7fe5100ce8f0 2024-04-02T07:25:02.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.822+0000 7fe507e00640 1 --2- 172.21.15.55:0/2991490138 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe4ec066690 0x7fe4ec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:02.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.822+0000 7fe507e00640 1 -- 172.21.15.55:0/2991490138 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe4f80846f0 con 0x7fe5100ce8f0 2024-04-02T07:25:02.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.822+0000 7fe50f400640 1 --2- 172.21.15.55:0/2991490138 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe4ec066690 0x7fe4ec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:02.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.822+0000 7fe50f400640 1 --2- 172.21.15.55:0/2991490138 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe4ec066690 0x7fe4ec068b50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe5000af000 tx=0x7fe5000a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:02.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:02.826+0000 7fe507e00640 1 -- 172.21.15.55:0/2991490138 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe4f8051a40 con 0x7fe5100ce8f0 2024-04-02T07:25:03.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.022+0000 7fe516800640 1 -- 172.21.15.55:0/2991490138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe51006d320 con 0x7fe5100ce8f0 2024-04-02T07:25:03.025 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-02T07:25:03.022+0000 7f8f18800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-02T07:25:03.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.034+0000 7fe507e00640 1 -- 172.21.15.55:0/2991490138 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v26) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe4f8055060 con 0x7fe5100ce8f0 2024-04-02T07:25:03.038 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-02T07:25:03.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.038+0000 7fe516800640 1 -- 172.21.15.55:0/2991490138 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe4ec066690 msgr2=0x7fe4ec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:03.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.038+0000 7fe516800640 1 --2- 172.21.15.55:0/2991490138 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe4ec066690 0x7fe4ec068b50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe5000af000 tx=0x7fe5000a7070 comp rx=0 tx=0).stop 2024-04-02T07:25:03.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.038+0000 7fe516800640 1 -- 172.21.15.55:0/2991490138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5100ce8f0 msgr2=0x7fe510150460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:03.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.038+0000 7fe516800640 1 --2- 172.21.15.55:0/2991490138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5100ce8f0 0x7fe510150460 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fe4f800d800 tx=0x7fe4f800dcc0 comp rx=0 tx=0).stop 2024-04-02T07:25:03.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.038+0000 7fe516800640 1 -- 172.21.15.55:0/2991490138 shutdown_connections 2024-04-02T07:25:03.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.038+0000 7fe516800640 1 --2- 172.21.15.55:0/2991490138 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe4ec066690 0x7fe4ec068b50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:03.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.038+0000 7fe516800640 1 --2- 172.21.15.55:0/2991490138 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe51015a950 0x7fe510162910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:03.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.038+0000 7fe516800640 1 --2- 172.21.15.55:0/2991490138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5100ce8f0 0x7fe510150460 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:03.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.038+0000 7fe516800640 1 --2- 172.21.15.55:0/2991490138 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe5100cd630 0x7fe51014f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:03.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.038+0000 7fe516800640 1 -- 172.21.15.55:0/2991490138 >> 172.21.15.55:0/2991490138 conn(0x7fe5100d0700 msgr2=0x7fe51006fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:03.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.038+0000 7fe516800640 1 -- 172.21.15.55:0/2991490138 shutdown_connections 2024-04-02T07:25:03.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.038+0000 7fe516800640 1 -- 172.21.15.55:0/2991490138 wait complete. 2024-04-02T07:25:03.047 INFO:tasks.ceph.mds.b.smithi106.stderr: -4855> 2024-04-02T07:24:13.444+0000 7f2e6d000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:25:03.051 INFO:tasks.ceph.mds.b.smithi106.stderr: -3064> 2024-04-02T07:24:25.572+0000 7f2e68a00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /parent_a/alpha auth v2 ap=1 DIRTYPARENT s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={5835=0-4194304@1} caps={5835=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=5835 | request=0 caps=1 dirtyparent=1 dirty=0 authpin=1 scrubqueue=0 0x557664428100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(7)0x10000000001:[<0x10000000000/alpha v2>,<0x1/parent_a v4>]//[]","error_str":"failed to decode on-disk backtrace (40 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-02T07:25:03.060 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-02T07:25:03.100 INFO:tasks.ceph.mds.b.smithi106.stdout:starting mds.b at 2024-04-02T07:25:03.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.198+0000 7f3895000640 1 Processor -- start 2024-04-02T07:25:03.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.198+0000 7f3895000640 1 -- start start 2024-04-02T07:25:03.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.202+0000 7f3895000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3890160580 0x7f3890098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:03.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.202+0000 7f3895000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f38900b19b0 0x7f3890098f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:03.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.202+0000 7f3895000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38900cfee0 con 0x7f38901601a0 2024-04-02T07:25:03.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.202+0000 7f3895000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38900d04a0 con 0x7f38900b19b0 2024-04-02T07:25:03.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.202+0000 7f3895000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38900cfcf0 con 0x7f3890160580 2024-04-02T07:25:03.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.202+0000 7f3887e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3890160580 0x7f3890098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:03.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.202+0000 7f3887e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3890160580 0x7f3890098a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:58716/0 (socket says 172.21.15.55:58716) 2024-04-02T07:25:03.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.202+0000 7f3887e00640 1 -- 172.21.15.55:0/3803094263 learned_addr learned my addr 172.21.15.55:0/3803094263 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:03.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.202+0000 7f388de00640 1 --1- 172.21.15.55:0/3803094263 >> v1:172.21.15.106:6789/0 conn(0x7f38901601a0 0x7f38900cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:40374/0 (socket says 172.21.15.55:40374) 2024-04-02T07:25:03.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.202+0000 7f388e800640 1 --2- 172.21.15.55:0/3803094263 >> v2:172.21.15.106:3300/0 conn(0x7f38900b19b0 0x7f3890098f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:03.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.202+0000 7f3887e00640 1 -- 172.21.15.55:0/3803094263 >> v2:172.21.15.106:3300/0 conn(0x7f38900b19b0 msgr2=0x7f3890098f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:03.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.202+0000 7f3887e00640 1 --2- 172.21.15.55:0/3803094263 >> v2:172.21.15.106:3300/0 conn(0x7f38900b19b0 0x7f3890098f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:03.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.202+0000 7f3887e00640 1 -- 172.21.15.55:0/3803094263 >> v1:172.21.15.106:6789/0 conn(0x7f38901601a0 legacy=0x7f38900cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:03.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.202+0000 7f3887e00640 1 -- 172.21.15.55:0/3803094263 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38900d01c0 con 0x7f3890160580 2024-04-02T07:25:03.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f3887e00640 1 --2- 172.21.15.55:0/3803094263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3890160580 0x7f3890098a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3878009870 tx=0x7f387801c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cedbf0a1d7b9d981 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:03.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f388d400640 1 -- 172.21.15.55:0/3803094263 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38780ab610 con 0x7f3890160580 2024-04-02T07:25:03.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f388d400640 1 -- 172.21.15.55:0/3803094263 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38780ab770 con 0x7f3890160580 2024-04-02T07:25:03.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f388d400640 1 -- 172.21.15.55:0/3803094263 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38780abb00 con 0x7f3890160580 2024-04-02T07:25:03.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f3895000640 1 -- 172.21.15.55:0/3803094263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3890160580 msgr2=0x7f3890098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:03.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f3895000640 1 --2- 172.21.15.55:0/3803094263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3890160580 0x7f3890098a10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3878009870 tx=0x7f387801c410 comp rx=0 tx=0).stop 2024-04-02T07:25:03.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f3895000640 1 -- 172.21.15.55:0/3803094263 shutdown_connections 2024-04-02T07:25:03.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f3895000640 1 --2- 172.21.15.55:0/3803094263 >> v2:172.21.15.106:3300/0 conn(0x7f38900b19b0 0x7f3890098f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:03.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f3895000640 1 --2- 172.21.15.55:0/3803094263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3890160580 0x7f3890098a10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:03.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f3895000640 1 -- 172.21.15.55:0/3803094263 >> 172.21.15.55:0/3803094263 conn(0x7f38900b2150 msgr2=0x7f38900b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:03.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f3895000640 1 -- 172.21.15.55:0/3803094263 shutdown_connections 2024-04-02T07:25:03.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f3895000640 1 -- 172.21.15.55:0/3803094263 wait complete. 2024-04-02T07:25:03.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f3895000640 1 Processor -- start 2024-04-02T07:25:03.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f3895000640 1 -- start start 2024-04-02T07:25:03.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f3895000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38900b19b0 0x7f38900c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:03.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f3895000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38901601a0 0x7f38900c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:03.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f3895000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3890160580 0x7f38900b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:03.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f3895000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f389014b2e0 con 0x7f38901601a0 2024-04-02T07:25:03.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f3895000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38900c9a40 con 0x7f38900b19b0 2024-04-02T07:25:03.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f3895000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38900b59e0 con 0x7f3890160580 2024-04-02T07:25:03.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f3887e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38901601a0 0x7f38900c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:03.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f3887e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38901601a0 0x7f38900c7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36226/0 (socket says 172.21.15.55:36226) 2024-04-02T07:25:03.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f3887e00640 1 -- 172.21.15.55:0/1857430702 learned_addr learned my addr 172.21.15.55:0/1857430702 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:03.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f388de00640 1 --2- 172.21.15.55:0/1857430702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38900b19b0 0x7f38900c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:03.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.206+0000 7f388e800640 1 --2- 172.21.15.55:0/1857430702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3890160580 0x7f38900b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:03.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.210+0000 7f3887e00640 1 -- 172.21.15.55:0/1857430702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3890160580 msgr2=0x7f38900b4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:03.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.210+0000 7f3887e00640 1 --2- 172.21.15.55:0/1857430702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3890160580 0x7f38900b4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:03.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.210+0000 7f3887e00640 1 -- 172.21.15.55:0/1857430702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38900b19b0 msgr2=0x7f38900c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:03.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.210+0000 7f3887e00640 1 --2- 172.21.15.55:0/1857430702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38900b19b0 0x7f38900c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:03.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.210+0000 7f3887e00640 1 -- 172.21.15.55:0/1857430702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38780094d0 con 0x7f38901601a0 2024-04-02T07:25:03.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.210+0000 7f3887e00640 1 --2- 172.21.15.55:0/1857430702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38901601a0 0x7f38900c7730 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f387801a040 tx=0x7f387801ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:03.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.210+0000 7f3886000640 1 -- 172.21.15.55:0/1857430702 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38780b4800 con 0x7f38901601a0 2024-04-02T07:25:03.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.210+0000 7f3886000640 1 -- 172.21.15.55:0/1857430702 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38780b4980 con 0x7f38901601a0 2024-04-02T07:25:03.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.210+0000 7f3886000640 1 -- 172.21.15.55:0/1857430702 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38780b4d30 con 0x7f38901601a0 2024-04-02T07:25:03.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.210+0000 7f3895000640 1 -- 172.21.15.55:0/1857430702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38900b5cc0 con 0x7f38901601a0 2024-04-02T07:25:03.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.210+0000 7f3895000640 1 -- 172.21.15.55:0/1857430702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f389014b8d0 con 0x7f38901601a0 2024-04-02T07:25:03.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.210+0000 7f3895000640 1 -- 172.21.15.55:0/1857430702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38900b3af0 con 0x7f38901601a0 2024-04-02T07:25:03.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.210+0000 7f3886000640 1 -- 172.21.15.55:0/1857430702 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f38780c7440 con 0x7f38901601a0 2024-04-02T07:25:03.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.210+0000 7f3886000640 1 --2- 172.21.15.55:0/1857430702 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f386c066690 0x7f386c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:03.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.210+0000 7f3886000640 1 -- 172.21.15.55:0/1857430702 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f387811ecc0 con 0x7f38901601a0 2024-04-02T07:25:03.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.210+0000 7f388de00640 1 --2- 172.21.15.55:0/1857430702 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f386c066690 0x7f386c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:03.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.214+0000 7f388de00640 1 --2- 172.21.15.55:0/1857430702 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f386c066690 0x7f386c068b50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3880000f70 tx=0x7f3880007e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:03.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.214+0000 7f3886000640 1 -- 172.21.15.55:0/1857430702 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3878125080 con 0x7f38901601a0 2024-04-02T07:25:03.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:03.414+0000 7f3895000640 1 -- 172.21.15.55:0/1857430702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f389014b450 con 0x7f38901601a0 2024-04-02T07:25:04.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.070+0000 7f3886000640 1 -- 172.21.15.55:0/1857430702 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7f389014b450 con 0x7f38901601a0 2024-04-02T07:25:04.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.074+0000 7f3895000640 1 -- 172.21.15.55:0/1857430702 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f386c066690 msgr2=0x7f386c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:04.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.074+0000 7f3895000640 1 --2- 172.21.15.55:0/1857430702 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f386c066690 0x7f386c068b50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3880000f70 tx=0x7f3880007e50 comp rx=0 tx=0).stop 2024-04-02T07:25:04.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.074+0000 7f3895000640 1 -- 172.21.15.55:0/1857430702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38901601a0 msgr2=0x7f38900c7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:04.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.074+0000 7f3895000640 1 --2- 172.21.15.55:0/1857430702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38901601a0 0x7f38900c7730 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f387801a040 tx=0x7f387801ac50 comp rx=0 tx=0).stop 2024-04-02T07:25:04.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.074+0000 7f3895000640 1 -- 172.21.15.55:0/1857430702 shutdown_connections 2024-04-02T07:25:04.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.074+0000 7f3895000640 1 --2- 172.21.15.55:0/1857430702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3890160580 0x7f38900b4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:04.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.074+0000 7f3895000640 1 --2- 172.21.15.55:0/1857430702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38901601a0 0x7f38900c7730 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:04.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.074+0000 7f3895000640 1 --2- 172.21.15.55:0/1857430702 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f386c066690 0x7f386c068b50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:04.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.074+0000 7f3895000640 1 --2- 172.21.15.55:0/1857430702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38900b19b0 0x7f38900c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:04.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.074+0000 7f3895000640 1 -- 172.21.15.55:0/1857430702 >> 172.21.15.55:0/1857430702 conn(0x7f38900b2150 msgr2=0x7f389015e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:04.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.074+0000 7f3895000640 1 -- 172.21.15.55:0/1857430702 shutdown_connections 2024-04-02T07:25:04.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.074+0000 7f3895000640 1 -- 172.21.15.55:0/1857430702 wait complete. 2024-04-02T07:25:04.100 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-02T07:25:04.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.246+0000 7f5afd200640 1 Processor -- start 2024-04-02T07:25:04.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.246+0000 7f5afd200640 1 -- start start 2024-04-02T07:25:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.246+0000 7f5afd200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5af815ce40 0x7f5af80b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.246+0000 7f5afd200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5af80afe70 0x7f5af80c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.246+0000 7f5afd200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af80b1d60 con 0x7f5af806d1c0 2024-04-02T07:25:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.246+0000 7f5afd200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af806cda0 con 0x7f5af815ce40 2024-04-02T07:25:04.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.246+0000 7f5afd200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af806c400 con 0x7f5af80afe70 2024-04-02T07:25:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.250+0000 7f5af6800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5af80afe70 0x7f5af80c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.250+0000 7f5af6800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5af80afe70 0x7f5af80c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:58734/0 (socket says 172.21.15.55:58734) 2024-04-02T07:25:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.250+0000 7f5af6800640 1 -- 172.21.15.55:0/316634858 learned_addr learned my addr 172.21.15.55:0/316634858 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.250+0000 7f5af5e00640 1 --2- 172.21.15.55:0/316634858 >> v2:172.21.15.106:3300/0 conn(0x7f5af815ce40 0x7f5af80b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:04.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.250+0000 7f5af6800640 1 -- 172.21.15.55:0/316634858 >> v2:172.21.15.106:3300/0 conn(0x7f5af815ce40 msgr2=0x7f5af80b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.250+0000 7f5af6800640 1 --2- 172.21.15.55:0/316634858 >> v2:172.21.15.106:3300/0 conn(0x7f5af815ce40 0x7f5af80b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.250+0000 7f5af6800640 1 -- 172.21.15.55:0/316634858 >> v1:172.21.15.106:6789/0 conn(0x7f5af806d1c0 legacy=0x7f5af80b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:04.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.250+0000 7f5af6800640 1 -- 172.21.15.55:0/316634858 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af806c6e0 con 0x7f5af80afe70 2024-04-02T07:25:04.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.250+0000 7f5af6800640 1 --2- 172.21.15.55:0/316634858 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5af80afe70 0x7f5af80c90d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5af0009e50 tx=0x7f5af001c9a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db9edd03c70860ec server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:04.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.250+0000 7f5af5400640 1 -- 172.21.15.55:0/316634858 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af00a5660 con 0x7f5af80afe70 2024-04-02T07:25:04.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5af5400640 1 -- 172.21.15.55:0/316634858 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af00a57c0 con 0x7f5af80afe70 2024-04-02T07:25:04.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5af5400640 1 -- 172.21.15.55:0/316634858 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af00a5b50 con 0x7f5af80afe70 2024-04-02T07:25:04.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5afd200640 1 -- 172.21.15.55:0/316634858 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5af80afe70 msgr2=0x7f5af80c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:04.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5afd200640 1 --2- 172.21.15.55:0/316634858 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5af80afe70 0x7f5af80c90d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5af0009e50 tx=0x7f5af001c9a0 comp rx=0 tx=0).stop 2024-04-02T07:25:04.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5afd200640 1 -- 172.21.15.55:0/316634858 shutdown_connections 2024-04-02T07:25:04.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5afd200640 1 --2- 172.21.15.55:0/316634858 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5af80afe70 0x7f5af80c90d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:04.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5afd200640 1 --2- 172.21.15.55:0/316634858 >> v2:172.21.15.106:3300/0 conn(0x7f5af815ce40 0x7f5af80b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:04.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5afd200640 1 -- 172.21.15.55:0/316634858 >> 172.21.15.55:0/316634858 conn(0x7f5af8069d90 msgr2=0x7f5af806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:04.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5afd200640 1 -- 172.21.15.55:0/316634858 shutdown_connections 2024-04-02T07:25:04.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5afd200640 1 -- 172.21.15.55:0/316634858 wait complete. 2024-04-02T07:25:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5afd200640 1 Processor -- start 2024-04-02T07:25:04.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5afd200640 1 -- start start 2024-04-02T07:25:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5afd200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5af806d1c0 0x7f5af8159550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5afd200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5af80afe70 0x7f5af8158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5afd200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5af815ce40 0x7f5af80ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5afd200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af815ae80 con 0x7f5af815ce40 2024-04-02T07:25:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5afd200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af81592f0 con 0x7f5af806d1c0 2024-04-02T07:25:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5afd200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af8159b30 con 0x7f5af80afe70 2024-04-02T07:25:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5af6800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5af815ce40 0x7f5af80ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5af6800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5af815ce40 0x7f5af80ccbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36230/0 (socket says 172.21.15.55:36230) 2024-04-02T07:25:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5af6800640 1 -- 172.21.15.55:0/2355404520 learned_addr learned my addr 172.21.15.55:0/2355404520 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5aefe00640 1 --2- 172.21.15.55:0/2355404520 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5af80afe70 0x7f5af8158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.254+0000 7f5af5e00640 1 --2- 172.21.15.55:0/2355404520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5af806d1c0 0x7f5af8159550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:04.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.258+0000 7f5af6800640 1 -- 172.21.15.55:0/2355404520 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5af80afe70 msgr2=0x7f5af8158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:04.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.258+0000 7f5af6800640 1 --2- 172.21.15.55:0/2355404520 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5af80afe70 0x7f5af8158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:04.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.258+0000 7f5af6800640 1 -- 172.21.15.55:0/2355404520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5af806d1c0 msgr2=0x7f5af8159550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:04.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.258+0000 7f5af6800640 1 --2- 172.21.15.55:0/2355404520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5af806d1c0 0x7f5af8159550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:04.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.258+0000 7f5af6800640 1 -- 172.21.15.55:0/2355404520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af0009b30 con 0x7f5af815ce40 2024-04-02T07:25:04.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.258+0000 7f5aefe00640 1 --2- 172.21.15.55:0/2355404520 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5af80afe70 0x7f5af8158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:04.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.258+0000 7f5af5e00640 1 --2- 172.21.15.55:0/2355404520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5af806d1c0 0x7f5af8159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:04.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.258+0000 7f5af6800640 1 --2- 172.21.15.55:0/2355404520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5af815ce40 0x7f5af80ccbb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5af00af040 tx=0x7f5af0019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:04.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.262+0000 7f5aee000640 1 -- 172.21.15.55:0/2355404520 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af00b8670 con 0x7f5af815ce40 2024-04-02T07:25:04.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.262+0000 7f5afd200640 1 -- 172.21.15.55:0/2355404520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af815a4e0 con 0x7f5af815ce40 2024-04-02T07:25:04.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.262+0000 7f5aee000640 1 -- 172.21.15.55:0/2355404520 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af00b87d0 con 0x7f5af815ce40 2024-04-02T07:25:04.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.262+0000 7f5aee000640 1 -- 172.21.15.55:0/2355404520 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af00b8b80 con 0x7f5af815ce40 2024-04-02T07:25:04.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.262+0000 7f5afd200640 1 -- 172.21.15.55:0/2355404520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af815aaa0 con 0x7f5af815ce40 2024-04-02T07:25:04.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.262+0000 7f5afd200640 1 -- 172.21.15.55:0/2355404520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af806e270 con 0x7f5af815ce40 2024-04-02T07:25:04.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.266+0000 7f5aee000640 1 -- 172.21.15.55:0/2355404520 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5af00b8ce0 con 0x7f5af815ce40 2024-04-02T07:25:04.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.266+0000 7f5aee000640 1 --2- 172.21.15.55:0/2355404520 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ad4066690 0x7f5ad4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:04.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.266+0000 7f5aee000640 1 -- 172.21.15.55:0/2355404520 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f5af011f840 con 0x7f5af815ce40 2024-04-02T07:25:04.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.266+0000 7f5af5e00640 1 --2- 172.21.15.55:0/2355404520 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ad4066690 0x7f5ad4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:04.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.266+0000 7f5af5e00640 1 --2- 172.21.15.55:0/2355404520 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ad4066690 0x7f5ad4068b50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009b10 tx=0x7f5ae8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:04.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.270+0000 7f5aee000640 1 -- 172.21.15.55:0/2355404520 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5af00ecc60 con 0x7f5af815ce40 2024-04-02T07:25:04.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:04.434+0000 7f5afd200640 1 -- 172.21.15.55:0/2355404520 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5af8066c90 con 0x7f5af815ce40 2024-04-02T07:25:05.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.282+0000 7f5aee000640 1 -- 172.21.15.55:0/2355404520 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v50) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5af00bc0d0 con 0x7f5af815ce40 2024-04-02T07:25:05.286 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2024-04-02T07:25:05.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.286+0000 7f5afd200640 1 -- 172.21.15.55:0/2355404520 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ad4066690 msgr2=0x7f5ad4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.286+0000 7f5afd200640 1 --2- 172.21.15.55:0/2355404520 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ad4066690 0x7f5ad4068b50 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f5ae8009b10 tx=0x7f5ae8008040 comp rx=0 tx=0).stop 2024-04-02T07:25:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.286+0000 7f5afd200640 1 -- 172.21.15.55:0/2355404520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5af815ce40 msgr2=0x7f5af80ccbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.286+0000 7f5afd200640 1 --2- 172.21.15.55:0/2355404520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5af815ce40 0x7f5af80ccbb0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f5af00af040 tx=0x7f5af0019740 comp rx=0 tx=0).stop 2024-04-02T07:25:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.286+0000 7f5afd200640 1 -- 172.21.15.55:0/2355404520 shutdown_connections 2024-04-02T07:25:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.286+0000 7f5afd200640 1 --2- 172.21.15.55:0/2355404520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5af815ce40 0x7f5af80ccbb0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.286+0000 7f5afd200640 1 --2- 172.21.15.55:0/2355404520 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5af80afe70 0x7f5af8158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.286+0000 7f5afd200640 1 --2- 172.21.15.55:0/2355404520 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ad4066690 0x7f5ad4068b50 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.286+0000 7f5afd200640 1 --2- 172.21.15.55:0/2355404520 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5af806d1c0 0x7f5af8159550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.286+0000 7f5afd200640 1 -- 172.21.15.55:0/2355404520 >> 172.21.15.55:0/2355404520 conn(0x7f5af8069d90 msgr2=0x7f5af806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.286+0000 7f5afd200640 1 -- 172.21.15.55:0/2355404520 shutdown_connections 2024-04-02T07:25:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.286+0000 7f5afd200640 1 -- 172.21.15.55:0/2355404520 wait complete. 2024-04-02T07:25:05.315 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-02T07:25:05.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.462+0000 7f51ea800640 1 Processor -- start 2024-04-02T07:25:05.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.462+0000 7f51ea800640 1 -- start start 2024-04-02T07:25:05.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.462+0000 7f51ea800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f51e415ab20 0x7f51e40cc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:05.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.462+0000 7f51ea800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51e40cf110 0x7f51e4098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:05.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.462+0000 7f51ea800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51e40cf570 0x7f51e4098f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:05.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.462+0000 7f51ea800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e40cc3b0 con 0x7f51e40cf570 2024-04-02T07:25:05.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.462+0000 7f51ea800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51e40cb7a0 con 0x7f51e415ab20 2024-04-02T07:25:05.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.462+0000 7f51ea800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e40cba80 con 0x7f51e40cf110 2024-04-02T07:25:05.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.462+0000 7f51e3e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51e40cf570 0x7f51e4098f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:05.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.462+0000 7f51e3e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51e40cf570 0x7f51e4098f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36242/0 (socket says 172.21.15.55:36242) 2024-04-02T07:25:05.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.462+0000 7f51e3e00640 1 -- 172.21.15.55:0/3413825656 learned_addr learned my addr 172.21.15.55:0/3413825656 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:05.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.462+0000 7f51e3400640 1 --2- 172.21.15.55:0/3413825656 >> v2:172.21.15.106:3300/0 conn(0x7f51e415ab20 0x7f51e40cc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:05.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.462+0000 7f51e2a00640 1 --2- 172.21.15.55:0/3413825656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51e40cf110 0x7f51e4098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:05.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.462+0000 7f51e3e00640 1 -- 172.21.15.55:0/3413825656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51e40cf110 msgr2=0x7f51e4098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:05.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.462+0000 7f51e3e00640 1 --2- 172.21.15.55:0/3413825656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51e40cf110 0x7f51e4098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:05.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.462+0000 7f51e3e00640 1 -- 172.21.15.55:0/3413825656 >> v2:172.21.15.106:3300/0 conn(0x7f51e415ab20 msgr2=0x7f51e40cc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:05.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.462+0000 7f51e3e00640 1 --2- 172.21.15.55:0/3413825656 >> v2:172.21.15.106:3300/0 conn(0x7f51e415ab20 0x7f51e40cc840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:05.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.462+0000 7f51e3e00640 1 -- 172.21.15.55:0/3413825656 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51e40cbd60 con 0x7f51e40cf570 2024-04-02T07:25:05.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.462+0000 7f51e2a00640 1 --2- 172.21.15.55:0/3413825656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51e40cf110 0x7f51e4098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:05.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.466+0000 7f51e3e00640 1 --2- 172.21.15.55:0/3413825656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e40cf570 0x7f51e4098f50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f51e4072540 tx=0x7f51dc01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca3823ed2ea31d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:05.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.466+0000 7f51e2000640 1 -- 172.21.15.55:0/3413825656 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0a57d0 con 0x7f51e40cf570 2024-04-02T07:25:05.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.466+0000 7f51e2000640 1 -- 172.21.15.55:0/3413825656 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51dc0a5930 con 0x7f51e40cf570 2024-04-02T07:25:05.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.466+0000 7f51e2000640 1 -- 172.21.15.55:0/3413825656 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51dc0a5cc0 con 0x7f51e40cf570 2024-04-02T07:25:05.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.466+0000 7f51ea800640 1 -- 172.21.15.55:0/3413825656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e40cf570 msgr2=0x7f51e4098f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:05.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.466+0000 7f51ea800640 1 --2- 172.21.15.55:0/3413825656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e40cf570 0x7f51e4098f50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f51e4072540 tx=0x7f51dc01c9c0 comp rx=0 tx=0).stop 2024-04-02T07:25:05.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.466+0000 7f51ea800640 1 -- 172.21.15.55:0/3413825656 shutdown_connections 2024-04-02T07:25:05.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.466+0000 7f51ea800640 1 --2- 172.21.15.55:0/3413825656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e40cf570 0x7f51e4098f50 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:05.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.466+0000 7f51ea800640 1 --2- 172.21.15.55:0/3413825656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51e40cf110 0x7f51e4098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:05.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.466+0000 7f51ea800640 1 --2- 172.21.15.55:0/3413825656 >> v2:172.21.15.106:3300/0 conn(0x7f51e415ab20 0x7f51e40cc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:05.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.466+0000 7f51ea800640 1 -- 172.21.15.55:0/3413825656 >> 172.21.15.55:0/3413825656 conn(0x7f51e40b2150 msgr2=0x7f51e40b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:05.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.466+0000 7f51ea800640 1 -- 172.21.15.55:0/3413825656 shutdown_connections 2024-04-02T07:25:05.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.466+0000 7f51ea800640 1 -- 172.21.15.55:0/3413825656 wait complete. 2024-04-02T07:25:05.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.466+0000 7f51ea800640 1 Processor -- start 2024-04-02T07:25:05.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.466+0000 7f51ea800640 1 -- start start 2024-04-02T07:25:05.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51ea800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51e40cf110 0x7f51e4153ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:05.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51ea800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e40cf570 0x7f51e4142510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:05.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51ea800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51e415ab20 0x7f51e4142a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:05.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51ea800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e41404d0 con 0x7f51e40cf570 2024-04-02T07:25:05.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51ea800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51e4140a90 con 0x7f51e40cf110 2024-04-02T07:25:05.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51ea800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51e41421d0 con 0x7f51e415ab20 2024-04-02T07:25:05.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51e2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e40cf570 0x7f51e4142510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:05.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51e2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e40cf570 0x7f51e4142510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36258/0 (socket says 172.21.15.55:36258) 2024-04-02T07:25:05.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51e2a00640 1 -- 172.21.15.55:0/1337533099 learned_addr learned my addr 172.21.15.55:0/1337533099 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:05.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51e3400640 1 --2- 172.21.15.55:0/1337533099 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51e40cf110 0x7f51e4153ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:05.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51e3e00640 1 --2- 172.21.15.55:0/1337533099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51e415ab20 0x7f51e4142a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:05.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51e2a00640 1 -- 172.21.15.55:0/1337533099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51e415ab20 msgr2=0x7f51e4142a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:05.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51e2a00640 1 --2- 172.21.15.55:0/1337533099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51e415ab20 0x7f51e4142a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:05.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51e2a00640 1 -- 172.21.15.55:0/1337533099 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51e40cf110 msgr2=0x7f51e4153ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:05.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51e2a00640 1 --2- 172.21.15.55:0/1337533099 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51e40cf110 0x7f51e4153ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:05.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51e2a00640 1 -- 172.21.15.55:0/1337533099 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51dc009b30 con 0x7f51e40cf570 2024-04-02T07:25:05.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51e3e00640 1 --2- 172.21.15.55:0/1337533099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51e415ab20 0x7f51e4142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:05.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51e2a00640 1 --2- 172.21.15.55:0/1337533099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e40cf570 0x7f51e4142510 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f51d000d830 tx=0x7f51d000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:05.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51db400640 1 -- 172.21.15.55:0/1337533099 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d000be10 con 0x7f51e40cf570 2024-04-02T07:25:05.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51db400640 1 -- 172.21.15.55:0/1337533099 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51d0004030 con 0x7f51e40cf570 2024-04-02T07:25:05.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51db400640 1 -- 172.21.15.55:0/1337533099 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51d00043c0 con 0x7f51e40cf570 2024-04-02T07:25:05.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51ea800640 1 -- 172.21.15.55:0/1337533099 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51e4143060 con 0x7f51e40cf570 2024-04-02T07:25:05.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51ea800640 1 -- 172.21.15.55:0/1337533099 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51e4140720 con 0x7f51e40cf570 2024-04-02T07:25:05.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51ea800640 1 -- 172.21.15.55:0/1337533099 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51e4140c20 con 0x7f51e40cf570 2024-04-02T07:25:05.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.470+0000 7f51db400640 1 -- 172.21.15.55:0/1337533099 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f51d00098b0 con 0x7f51e40cf570 2024-04-02T07:25:05.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.474+0000 7f51db400640 1 --2- 172.21.15.55:0/1337533099 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51c40666c0 0x7f51c4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:05.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.474+0000 7f51db400640 1 -- 172.21.15.55:0/1337533099 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f51d00840e0 con 0x7f51e40cf570 2024-04-02T07:25:05.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.474+0000 7f51e3400640 1 --2- 172.21.15.55:0/1337533099 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51c40666c0 0x7f51c4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:05.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.474+0000 7f51e3400640 1 --2- 172.21.15.55:0/1337533099 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51c40666c0 0x7f51c4068b80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009b60 tx=0x7f51d4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:05.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.478+0000 7f51db400640 1 -- 172.21.15.55:0/1337533099 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f51d0051560 con 0x7f51e40cf570 2024-04-02T07:25:05.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:05.638+0000 7f51ea800640 1 -- 172.21.15.55:0/1337533099 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f51e4066c90 con 0x7f51e40cf570 2024-04-02T07:25:06.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.286+0000 7f51db400640 1 -- 172.21.15.55:0/1337533099 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v51) v1 ==== 169+0+0 (secure 0 0 0) 0x7f51d0054b80 con 0x7f51e40cf570 2024-04-02T07:25:06.291 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2024-04-02T07:25:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.290+0000 7f51ea800640 1 -- 172.21.15.55:0/1337533099 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51c40666c0 msgr2=0x7f51c4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.290+0000 7f51ea800640 1 --2- 172.21.15.55:0/1337533099 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51c40666c0 0x7f51c4068b80 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f51d4009b60 tx=0x7f51d4009190 comp rx=0 tx=0).stop 2024-04-02T07:25:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.290+0000 7f51ea800640 1 -- 172.21.15.55:0/1337533099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e40cf570 msgr2=0x7f51e4142510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.290+0000 7f51ea800640 1 --2- 172.21.15.55:0/1337533099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e40cf570 0x7f51e4142510 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f51d000d830 tx=0x7f51d000dcf0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.290+0000 7f51ea800640 1 -- 172.21.15.55:0/1337533099 shutdown_connections 2024-04-02T07:25:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.290+0000 7f51ea800640 1 --2- 172.21.15.55:0/1337533099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51e415ab20 0x7f51e4142a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.290+0000 7f51ea800640 1 --2- 172.21.15.55:0/1337533099 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51e40cf570 0x7f51e4142510 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.290+0000 7f51ea800640 1 --2- 172.21.15.55:0/1337533099 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51c40666c0 0x7f51c4068b80 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.290+0000 7f51ea800640 1 --2- 172.21.15.55:0/1337533099 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51e40cf110 0x7f51e4153ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.290+0000 7f51ea800640 1 -- 172.21.15.55:0/1337533099 >> 172.21.15.55:0/1337533099 conn(0x7f51e40b2150 msgr2=0x7f51e40c6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.290+0000 7f51ea800640 1 -- 172.21.15.55:0/1337533099 shutdown_connections 2024-04-02T07:25:06.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.290+0000 7f51ea800640 1 -- 172.21.15.55:0/1337533099 wait complete. 2024-04-02T07:25:06.317 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-02T07:25:06.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.458+0000 7fc90d400640 1 Processor -- start 2024-04-02T07:25:06.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.458+0000 7fc90d400640 1 -- start start 2024-04-02T07:25:06.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.458+0000 7fc90d400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9080ade90 0x7fc90806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:06.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.458+0000 7fc90d400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc9080b41a0 0x7fc908142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:06.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.458+0000 7fc90d400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc90806c630 con 0x7fc9080b3dc0 2024-04-02T07:25:06.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.458+0000 7fc90d400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9080cae80 con 0x7fc9080b41a0 2024-04-02T07:25:06.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.458+0000 7fc90d400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc90806c8f0 con 0x7fc9080ade90 2024-04-02T07:25:06.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.458+0000 7fc906800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc9080b3dc0 0x7fc9080ca770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:52524/0 (socket says 172.21.15.55:52524) 2024-04-02T07:25:06.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.458+0000 7fc906800640 1 -- 172.21.15.55:0/140826389 learned_addr learned my addr 172.21.15.55:0/140826389 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:06.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.458+0000 7fc905e00640 1 --2- 172.21.15.55:0/140826389 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9080ade90 0x7fc90806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:06.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.458+0000 7fc907200640 1 --2- 172.21.15.55:0/140826389 >> v2:172.21.15.106:3300/0 conn(0x7fc9080b41a0 0x7fc908142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:06.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.458+0000 7fc905400640 1 -- 172.21.15.55:0/140826389 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4131514037 0 0) 0x7fc90806c630 con 0x7fc9080b3dc0 2024-04-02T07:25:06.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.458+0000 7fc905400640 1 -- 172.21.15.55:0/140826389 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8ec005740 con 0x7fc9080b3dc0 2024-04-02T07:25:06.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.458+0000 7fc905e00640 1 -- 172.21.15.55:0/140826389 >> v2:172.21.15.106:3300/0 conn(0x7fc9080b41a0 msgr2=0x7fc908142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:06.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.458+0000 7fc905e00640 1 --2- 172.21.15.55:0/140826389 >> v2:172.21.15.106:3300/0 conn(0x7fc9080b41a0 0x7fc908142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.458+0000 7fc905e00640 1 -- 172.21.15.55:0/140826389 >> v1:172.21.15.106:6789/0 conn(0x7fc9080b3dc0 legacy=0x7fc9080ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:06.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.458+0000 7fc905e00640 1 -- 172.21.15.55:0/140826389 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90806cbd0 con 0x7fc9080ade90 2024-04-02T07:25:06.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.462+0000 7fc905e00640 1 --2- 172.21.15.55:0/140826389 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9080ade90 0x7fc90806d6b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc8f40097c0 tx=0x7fc8f401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8284954912b9d386 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:06.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.462+0000 7fc905400640 1 -- 172.21.15.55:0/140826389 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f40ab600 con 0x7fc9080ade90 2024-04-02T07:25:06.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.462+0000 7fc905400640 1 -- 172.21.15.55:0/140826389 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f40a7050 con 0x7fc9080ade90 2024-04-02T07:25:06.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.462+0000 7fc905400640 1 -- 172.21.15.55:0/140826389 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f40ab980 con 0x7fc9080ade90 2024-04-02T07:25:06.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.462+0000 7fc90d400640 1 -- 172.21.15.55:0/140826389 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9080ade90 msgr2=0x7fc90806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:06.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.462+0000 7fc90d400640 1 --2- 172.21.15.55:0/140826389 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9080ade90 0x7fc90806d6b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fc8f40097c0 tx=0x7fc8f401c3e0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.462+0000 7fc90d400640 1 -- 172.21.15.55:0/140826389 shutdown_connections 2024-04-02T07:25:06.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.462+0000 7fc90d400640 1 --2- 172.21.15.55:0/140826389 >> v2:172.21.15.106:3300/0 conn(0x7fc9080b41a0 0x7fc908142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.462+0000 7fc90d400640 1 --2- 172.21.15.55:0/140826389 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9080ade90 0x7fc90806d6b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.462+0000 7fc90d400640 1 -- 172.21.15.55:0/140826389 >> 172.21.15.55:0/140826389 conn(0x7fc90806a390 msgr2=0x7fc9080b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:06.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.462+0000 7fc90d400640 1 -- 172.21.15.55:0/140826389 shutdown_connections 2024-04-02T07:25:06.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.462+0000 7fc90d400640 1 -- 172.21.15.55:0/140826389 wait complete. 2024-04-02T07:25:06.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc90d400640 1 Processor -- start 2024-04-02T07:25:06.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc90d400640 1 -- start start 2024-04-02T07:25:06.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc90d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9080ade90 0x7fc908155ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:06.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc90d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9080b3dc0 0x7fc908138c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:06.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc90d400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9080b41a0 0x7fc9081f9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:06.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc90d400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc908141d60 con 0x7fc9080b3dc0 2024-04-02T07:25:06.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc90d400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc908156000 con 0x7fc9080ade90 2024-04-02T07:25:06.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc90d400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9081391c0 con 0x7fc9080b41a0 2024-04-02T07:25:06.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc905e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9080b3dc0 0x7fc908138c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:06.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc905e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9080b3dc0 0x7fc908138c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54212/0 (socket says 172.21.15.55:54212) 2024-04-02T07:25:06.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc905e00640 1 -- 172.21.15.55:0/3221818500 learned_addr learned my addr 172.21.15.55:0/3221818500 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:06.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc906800640 1 --2- 172.21.15.55:0/3221818500 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9080ade90 0x7fc908155ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:06.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc907200640 1 --2- 172.21.15.55:0/3221818500 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9080b41a0 0x7fc9081f9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:06.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc905e00640 1 -- 172.21.15.55:0/3221818500 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9080b41a0 msgr2=0x7fc9081f9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:06.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc905e00640 1 --2- 172.21.15.55:0/3221818500 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9080b41a0 0x7fc9081f9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc905e00640 1 -- 172.21.15.55:0/3221818500 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9080ade90 msgr2=0x7fc908155ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:06.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc905e00640 1 --2- 172.21.15.55:0/3221818500 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9080ade90 0x7fc908155ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc905e00640 1 -- 172.21.15.55:0/3221818500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8f4009420 con 0x7fc9080b3dc0 2024-04-02T07:25:06.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc905e00640 1 --2- 172.21.15.55:0/3221818500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9080b3dc0 0x7fc908138c80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc8f401a010 tx=0x7fc8f4019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:06.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc8fea00640 1 -- 172.21.15.55:0/3221818500 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f40b4410 con 0x7fc9080b3dc0 2024-04-02T07:25:06.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc8fea00640 1 -- 172.21.15.55:0/3221818500 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f40b4590 con 0x7fc9080b3dc0 2024-04-02T07:25:06.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc8fea00640 1 -- 172.21.15.55:0/3221818500 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f40b4940 con 0x7fc9080b3dc0 2024-04-02T07:25:06.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc90d400640 1 -- 172.21.15.55:0/3221818500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc90806de00 con 0x7fc9080b3dc0 2024-04-02T07:25:06.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc90d400640 1 -- 172.21.15.55:0/3221818500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc908155870 con 0x7fc9080b3dc0 2024-04-02T07:25:06.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.466+0000 7fc8f3e00640 1 -- 172.21.15.55:0/3221818500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8dc005260 con 0x7fc9080b3dc0 2024-04-02T07:25:06.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.470+0000 7fc8fea00640 1 -- 172.21.15.55:0/3221818500 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc8f40b2040 con 0x7fc9080b3dc0 2024-04-02T07:25:06.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.470+0000 7fc8fea00640 1 --2- 172.21.15.55:0/3221818500 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc8e8066690 0x7fc8e8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:06.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.470+0000 7fc8fea00640 1 -- 172.21.15.55:0/3221818500 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc8f411de50 con 0x7fc9080b3dc0 2024-04-02T07:25:06.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.470+0000 7fc906800640 1 --2- 172.21.15.55:0/3221818500 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc8e8066690 0x7fc8e8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:06.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.470+0000 7fc906800640 1 --2- 172.21.15.55:0/3221818500 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc8e8066690 0x7fc8e8068b50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80011f0 tx=0x7fc8f8007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:06.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.474+0000 7fc8fea00640 1 -- 172.21.15.55:0/3221818500 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc8f40eb4d0 con 0x7fc9080b3dc0 2024-04-02T07:25:06.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.642+0000 7fc8f3e00640 1 -- 172.21.15.55:0/3221818500 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc8dc005a90 con 0x7fc9080b3dc0 2024-04-02T07:25:06.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.650+0000 7fc8fea00640 1 -- 172.21.15.55:0/3221818500 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc8f40eeaf0 con 0x7fc9080b3dc0 2024-04-02T07:25:06.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.650+0000 7fc8f3e00640 1 -- 172.21.15.55:0/3221818500 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc8e8066690 msgr2=0x7fc8e8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:06.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.650+0000 7fc8f3e00640 1 --2- 172.21.15.55:0/3221818500 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc8e8066690 0x7fc8e8068b50 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80011f0 tx=0x7fc8f8007d40 comp rx=0 tx=0).stop 2024-04-02T07:25:06.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.650+0000 7fc8f3e00640 1 -- 172.21.15.55:0/3221818500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9080b3dc0 msgr2=0x7fc908138c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:06.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.650+0000 7fc8f3e00640 1 --2- 172.21.15.55:0/3221818500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9080b3dc0 0x7fc908138c80 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc8f401a010 tx=0x7fc8f4019180 comp rx=0 tx=0).stop 2024-04-02T07:25:06.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.650+0000 7fc8f3e00640 1 -- 172.21.15.55:0/3221818500 shutdown_connections 2024-04-02T07:25:06.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.650+0000 7fc8f3e00640 1 --2- 172.21.15.55:0/3221818500 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9080b41a0 0x7fc9081f9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.650+0000 7fc8f3e00640 1 --2- 172.21.15.55:0/3221818500 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9080b3dc0 0x7fc908138c80 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.650+0000 7fc8f3e00640 1 --2- 172.21.15.55:0/3221818500 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc8e8066690 0x7fc8e8068b50 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.650+0000 7fc8f3e00640 1 --2- 172.21.15.55:0/3221818500 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9080ade90 0x7fc908155ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.650+0000 7fc8f3e00640 1 -- 172.21.15.55:0/3221818500 >> 172.21.15.55:0/3221818500 conn(0x7fc90806a390 msgr2=0x7fc908070a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:06.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.650+0000 7fc8f3e00640 1 -- 172.21.15.55:0/3221818500 shutdown_connections 2024-04-02T07:25:06.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.650+0000 7fc8f3e00640 1 -- 172.21.15.55:0/3221818500 wait complete. 2024-04-02T07:25:06.675 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair' 2024-04-02T07:25:06.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.810+0000 7f56e9000640 1 Processor -- start 2024-04-02T07:25:06.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.810+0000 7f56e9000640 1 -- start start 2024-04-02T07:25:06.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e9000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e4153ea0 0x7f56e40c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:06.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e9000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f56e4159be0 0x7f56e40b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:06.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e9000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56e413d0c0 con 0x7f56e415a040 2024-04-02T07:25:06.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e9000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56e415a4f0 con 0x7f56e4159be0 2024-04-02T07:25:06.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e9000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e415a7d0 con 0x7f56e4153ea0 2024-04-02T07:25:06.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e2800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f56e415a040 0x7f56e413ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52480/0 (socket says 172.21.15.55:52480) 2024-04-02T07:25:06.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e2800640 1 -- 172.21.15.55:0/3200220726 learned_addr learned my addr 172.21.15.55:0/3200220726 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:06.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e1e00640 1 --2- 172.21.15.55:0/3200220726 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e4153ea0 0x7f56e40c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:06.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56dbe00640 1 --2- 172.21.15.55:0/3200220726 >> v2:172.21.15.106:3300/0 conn(0x7f56e4159be0 0x7f56e40b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:06.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e1400640 1 -- 172.21.15.55:0/3200220726 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2134796634 0 0) 0x7f56e413d0c0 con 0x7f56e415a040 2024-04-02T07:25:06.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e1400640 1 -- 172.21.15.55:0/3200220726 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56c8003530 con 0x7f56e415a040 2024-04-02T07:25:06.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e1400640 1 -- 172.21.15.55:0/3200220726 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3074054697 0 0) 0x7f56c8003530 con 0x7f56e415a040 2024-04-02T07:25:06.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e1400640 1 -- 172.21.15.55:0/3200220726 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e4153ea0 msgr2=0x7f56e40c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:06.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e1400640 1 --2- 172.21.15.55:0/3200220726 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e4153ea0 0x7f56e40c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e1400640 1 -- 172.21.15.55:0/3200220726 >> v2:172.21.15.106:3300/0 conn(0x7f56e4159be0 msgr2=0x7f56e40b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:06.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e1400640 1 --2- 172.21.15.55:0/3200220726 >> v2:172.21.15.106:3300/0 conn(0x7f56e4159be0 0x7f56e40b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e1400640 1 -- 172.21.15.55:0/3200220726 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e415aab0 con 0x7f56e415a040 2024-04-02T07:25:06.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e1400640 1 -- 172.21.15.55:0/3200220726 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f56dc001a00 con 0x7f56e415a040 2024-04-02T07:25:06.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e1400640 1 -- 172.21.15.55:0/3200220726 >> v1:172.21.15.55:6789/0 conn(0x7f56e415a040 legacy=0x7f56e413ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:06.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e1400640 1 --2- 172.21.15.55:0/3200220726 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e4153ea0 0x7f56c8003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:06.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e1400640 1 --2- 172.21.15.55:0/3200220726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56c8003f00 0x7f56c80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:06.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e1400640 1 --2- 172.21.15.55:0/3200220726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56c8004d10 0x7f56c8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:06.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e1400640 1 -- 172.21.15.55:0/3200220726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e415a4f0 con 0x7f56c8003f00 2024-04-02T07:25:06.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e1400640 1 -- 172.21.15.55:0/3200220726 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e415a7d0 con 0x7f56c8004d10 2024-04-02T07:25:06.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e1400640 1 -- 172.21.15.55:0/3200220726 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c800b990 con 0x7f56e4153ea0 2024-04-02T07:25:06.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56dbe00640 1 --2- 172.21.15.55:0/3200220726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56c8003f00 0x7f56c80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:06.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e1e00640 1 --2- 172.21.15.55:0/3200220726 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e4153ea0 0x7f56c8003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:06.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56e2800640 1 --2- 172.21.15.55:0/3200220726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56c8004d10 0x7f56c8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:06.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56dbe00640 1 -- 172.21.15.55:0/3200220726 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e4153ea0 msgr2=0x7f56c8003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:06.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56dbe00640 1 --2- 172.21.15.55:0/3200220726 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e4153ea0 0x7f56c8003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56dbe00640 1 -- 172.21.15.55:0/3200220726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56c8004d10 msgr2=0x7f56c8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:06.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56dbe00640 1 --2- 172.21.15.55:0/3200220726 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56c8004d10 0x7f56c8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.814+0000 7f56dbe00640 1 -- 172.21.15.55:0/3200220726 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c8003530 con 0x7f56c8003f00 2024-04-02T07:25:06.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.818+0000 7f56dbe00640 1 --2- 172.21.15.55:0/3200220726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56c8003f00 0x7f56c80047d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f56cc009ae0 tx=0x7f56cc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd733074f51b5476 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:06.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.818+0000 7f56e1400640 1 -- 172.21.15.55:0/3200220726 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc0a5590 con 0x7f56c8003f00 2024-04-02T07:25:06.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.818+0000 7f56e1400640 1 -- 172.21.15.55:0/3200220726 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56cc0a56f0 con 0x7f56c8003f00 2024-04-02T07:25:06.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.818+0000 7f56e1400640 1 -- 172.21.15.55:0/3200220726 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc0a5aa0 con 0x7f56c8003f00 2024-04-02T07:25:06.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.818+0000 7f56e9000640 1 -- 172.21.15.55:0/3200220726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56c8003f00 msgr2=0x7f56c80047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:06.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.818+0000 7f56e9000640 1 --2- 172.21.15.55:0/3200220726 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56c8003f00 0x7f56c80047d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f56cc009ae0 tx=0x7f56cc01ca50 comp rx=0 tx=0).stop 2024-04-02T07:25:06.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.818+0000 7f56e2800640 1 -- 172.21.15.55:0/3200220726 reap_dead start 2024-04-02T07:25:06.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.818+0000 7f56e9000640 1 -- 172.21.15.55:0/3200220726 shutdown_connections 2024-04-02T07:25:06.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.818+0000 7f56e9000640 1 -- 172.21.15.55:0/3200220726 >> 172.21.15.55:0/3200220726 conn(0x7f56e4066080 msgr2=0x7f56e4069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:06.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.818+0000 7f56e9000640 1 -- 172.21.15.55:0/3200220726 shutdown_connections 2024-04-02T07:25:06.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.818+0000 7f56e9000640 1 -- 172.21.15.55:0/3200220726 wait complete. 2024-04-02T07:25:06.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56e9000640 1 Processor -- start 2024-04-02T07:25:06.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56e9000640 1 -- start start 2024-04-02T07:25:06.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56e9000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56c8003f00 0x7f56e415c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:06.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56e9000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e4154280 0x7f56e41f1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:06.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56e9000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e412f670 0x7f56e412faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:06.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56e9000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e415b970 con 0x7f56e4154280 2024-04-02T07:25:06.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56e9000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56e4154700 con 0x7f56c8003f00 2024-04-02T07:25:06.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56e9000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56e415acf0 con 0x7f56e412f670 2024-04-02T07:25:06.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56dbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e4154280 0x7f56e41f1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:06.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56dbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e4154280 0x7f56e41f1b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54230/0 (socket says 172.21.15.55:54230) 2024-04-02T07:25:06.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56dbe00640 1 -- 172.21.15.55:0/3644686236 learned_addr learned my addr 172.21.15.55:0/3644686236 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:06.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56e1e00640 1 --2- 172.21.15.55:0/3644686236 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56c8003f00 0x7f56e415c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:06.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56e2800640 1 --2- 172.21.15.55:0/3644686236 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e412f670 0x7f56e412faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:06.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56dbe00640 1 -- 172.21.15.55:0/3644686236 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e412f670 msgr2=0x7f56e412faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:06.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56dbe00640 1 --2- 172.21.15.55:0/3644686236 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e412f670 0x7f56e412faf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56dbe00640 1 -- 172.21.15.55:0/3644686236 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56c8003f00 msgr2=0x7f56e415c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:06.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56dbe00640 1 --2- 172.21.15.55:0/3644686236 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56c8003f00 0x7f56e415c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:06.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56dbe00640 1 -- 172.21.15.55:0/3644686236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56e415afd0 con 0x7f56e4154280 2024-04-02T07:25:06.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56e2800640 1 --2- 172.21.15.55:0/3644686236 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e412f670 0x7f56e412faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:06.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56dbe00640 1 --2- 172.21.15.55:0/3644686236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e4154280 0x7f56e41f1b30 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f56cc009ae0 tx=0x7f56c8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:06.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56da000640 1 -- 172.21.15.55:0/3644686236 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc0be070 con 0x7f56e4154280 2024-04-02T07:25:06.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56da000640 1 -- 172.21.15.55:0/3644686236 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56cc004020 con 0x7f56e4154280 2024-04-02T07:25:06.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56da000640 1 -- 172.21.15.55:0/3644686236 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56cc004390 con 0x7f56e4154280 2024-04-02T07:25:06.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56e9000640 1 -- 172.21.15.55:0/3644686236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56e415b2b0 con 0x7f56e4154280 2024-04-02T07:25:06.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56e9000640 1 -- 172.21.15.55:0/3644686236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56e41f2070 con 0x7f56e4154280 2024-04-02T07:25:06.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.822+0000 7f56e9000640 1 -- 172.21.15.55:0/3644686236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56e415bab0 con 0x7f56e4154280 2024-04-02T07:25:06.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.826+0000 7f56da000640 1 -- 172.21.15.55:0/3644686236 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f56cc0b4040 con 0x7f56e4154280 2024-04-02T07:25:06.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.826+0000 7f56da000640 1 --2- 172.21.15.55:0/3644686236 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f56c00666c0 0x7f56c0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:06.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.826+0000 7f56da000640 1 -- 172.21.15.55:0/3644686236 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f56cc11dac0 con 0x7f56e4154280 2024-04-02T07:25:06.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.826+0000 7f56e1e00640 1 --2- 172.21.15.55:0/3644686236 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f56c00666c0 0x7f56c0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:06.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.826+0000 7f56e1e00640 1 --2- 172.21.15.55:0/3644686236 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f56c00666c0 0x7f56c0068b80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009b00 tx=0x7f56d4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:06.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:06.830+0000 7f56da000640 1 -- 172.21.15.55:0/3644686236 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f56e415bab0 con 0x7f56e4154280 2024-04-02T07:25:07.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.046+0000 7f56e9000640 1 -- 172.21.15.55:0/3644686236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]} v 0) v1 -- 0x7f56e415bab0 con 0x7f56e4154280 2024-04-02T07:25:07.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.302+0000 7f56da000640 1 -- 172.21.15.55:0/3644686236 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_backtrace_repair"]}]=0 v161) v1 ==== 149+0+0 (secure 0 0 0) 0x7f56e415bab0 con 0x7f56e4154280 2024-04-02T07:25:07.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.302+0000 7f56e9000640 1 -- 172.21.15.55:0/3644686236 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f56c00666c0 msgr2=0x7f56c0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:07.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.302+0000 7f56e9000640 1 --2- 172.21.15.55:0/3644686236 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f56c00666c0 0x7f56c0068b80 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f56d4009b00 tx=0x7f56d4009190 comp rx=0 tx=0).stop 2024-04-02T07:25:07.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.302+0000 7f56e9000640 1 -- 172.21.15.55:0/3644686236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e4154280 msgr2=0x7f56e41f1b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:07.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.302+0000 7f56e9000640 1 --2- 172.21.15.55:0/3644686236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e4154280 0x7f56e41f1b30 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f56cc009ae0 tx=0x7f56c8005800 comp rx=0 tx=0).stop 2024-04-02T07:25:07.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.302+0000 7f56e9000640 1 -- 172.21.15.55:0/3644686236 shutdown_connections 2024-04-02T07:25:07.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.302+0000 7f56e9000640 1 --2- 172.21.15.55:0/3644686236 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56e412f670 0x7f56e412faf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:07.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.302+0000 7f56e9000640 1 --2- 172.21.15.55:0/3644686236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56e4154280 0x7f56e41f1b30 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:07.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.302+0000 7f56e9000640 1 --2- 172.21.15.55:0/3644686236 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f56c00666c0 0x7f56c0068b80 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:07.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.302+0000 7f56e9000640 1 --2- 172.21.15.55:0/3644686236 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56c8003f00 0x7f56e415c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:07.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.302+0000 7f56e9000640 1 -- 172.21.15.55:0/3644686236 >> 172.21.15.55:0/3644686236 conn(0x7f56e4066080 msgr2=0x7f56e40cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:07.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.302+0000 7f56e9000640 1 -- 172.21.15.55:0/3644686236 shutdown_connections 2024-04-02T07:25:07.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.302+0000 7f56e9000640 1 -- 172.21.15.55:0/3644686236 wait complete. 2024-04-02T07:25:07.327 INFO:tasks.cephfs_test_runner:That the MDS can repair an inodes backtrace in the data pool ... ok 2024-04-02T07:25:07.327 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-02T07:25:07.327 INFO:tasks.cephfs_test_runner:test_health_status_after_backtrace_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-02T07:25:07.327 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-04-02T07:25:07.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.466+0000 7f8289e00640 1 Processor -- start 2024-04-02T07:25:07.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.466+0000 7f8289e00640 1 -- start start 2024-04-02T07:25:07.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.466+0000 7f8289e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8284143f90 0x7f828415ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:07.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.466+0000 7f8289e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f82840cda80 0x7f82840c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:07.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.466+0000 7f8289e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f828415b270 con 0x7f82840b34f0 2024-04-02T07:25:07.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.466+0000 7f8289e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8284144370 con 0x7f82840cda80 2024-04-02T07:25:07.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.466+0000 7f8289e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82840c37b0 con 0x7f8284143f90 2024-04-02T07:25:07.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.466+0000 7f8283400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f82840cda80 0x7f82840c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:07.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.466+0000 7f827a000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f82840b34f0 0x7f82840cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52492/0 (socket says 172.21.15.55:52492) 2024-04-02T07:25:07.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.466+0000 7f827a000640 1 -- 172.21.15.55:0/2905872518 learned_addr learned my addr 172.21.15.55:0/2905872518 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:07.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.466+0000 7f8282a00640 1 --2- 172.21.15.55:0/2905872518 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8284143f90 0x7f828415ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:07.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.466+0000 7f8283400640 1 -- 172.21.15.55:0/2905872518 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8284143f90 msgr2=0x7f828415ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:07.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.466+0000 7f8283400640 1 --2- 172.21.15.55:0/2905872518 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8284143f90 0x7f828415ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:07.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.466+0000 7f8283400640 1 -- 172.21.15.55:0/2905872518 >> v1:172.21.15.55:6789/0 conn(0x7f82840b34f0 legacy=0x7f82840cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:07.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.466+0000 7f8283400640 1 -- 172.21.15.55:0/2905872518 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82840c3a90 con 0x7f82840cda80 2024-04-02T07:25:07.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.466+0000 7f8282000640 1 -- 172.21.15.55:0/2905872518 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4177792837 0 0) 0x7f828415b270 con 0x7f82840b34f0 2024-04-02T07:25:07.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.470+0000 7f8283400640 1 --2- 172.21.15.55:0/2905872518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82840cda80 0x7f82840c4850 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f827c0097c0 tx=0x7f827c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03f22f481269e46 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:07.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.470+0000 7f8282000640 1 -- 172.21.15.55:0/2905872518 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c0ac640 con 0x7f82840cda80 2024-04-02T07:25:07.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.470+0000 7f8282000640 1 -- 172.21.15.55:0/2905872518 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f827c0ac7a0 con 0x7f82840cda80 2024-04-02T07:25:07.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.470+0000 7f8282000640 1 -- 172.21.15.55:0/2905872518 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f827c0acb30 con 0x7f82840cda80 2024-04-02T07:25:07.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.470+0000 7f8289e00640 1 -- 172.21.15.55:0/2905872518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82840cda80 msgr2=0x7f82840c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:07.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.470+0000 7f8289e00640 1 --2- 172.21.15.55:0/2905872518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82840cda80 0x7f82840c4850 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f827c0097c0 tx=0x7f827c01c3e0 comp rx=0 tx=0).stop 2024-04-02T07:25:07.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.470+0000 7f8289e00640 1 -- 172.21.15.55:0/2905872518 shutdown_connections 2024-04-02T07:25:07.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.470+0000 7f8289e00640 1 --2- 172.21.15.55:0/2905872518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82840cda80 0x7f82840c4850 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:07.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.470+0000 7f8289e00640 1 --2- 172.21.15.55:0/2905872518 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8284143f90 0x7f828415ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:07.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.470+0000 7f8289e00640 1 -- 172.21.15.55:0/2905872518 >> 172.21.15.55:0/2905872518 conn(0x7f8284066080 msgr2=0x7f8284069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:07.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.470+0000 7f8289e00640 1 -- 172.21.15.55:0/2905872518 shutdown_connections 2024-04-02T07:25:07.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.470+0000 7f8289e00640 1 -- 172.21.15.55:0/2905872518 wait complete. 2024-04-02T07:25:07.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8289e00640 1 Processor -- start 2024-04-02T07:25:07.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8289e00640 1 -- start start 2024-04-02T07:25:07.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8289e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82840b34f0 0x7f828413e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:07.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8289e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82840cda80 0x7f82840c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:07.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8289e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8284143f90 0x7f82840c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:07.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8289e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82840c74b0 con 0x7f82840b34f0 2024-04-02T07:25:07.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8289e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82841407a0 con 0x7f82840cda80 2024-04-02T07:25:07.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8289e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8284140a80 con 0x7f8284143f90 2024-04-02T07:25:07.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8282a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82840b34f0 0x7f828413e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:07.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8282a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82840b34f0 0x7f828413e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54244/0 (socket says 172.21.15.55:54244) 2024-04-02T07:25:07.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8282a00640 1 -- 172.21.15.55:0/1952973061 learned_addr learned my addr 172.21.15.55:0/1952973061 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:07.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8283400640 1 --2- 172.21.15.55:0/1952973061 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8284143f90 0x7f82840c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:07.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f827a000640 1 --2- 172.21.15.55:0/1952973061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82840cda80 0x7f82840c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:07.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8282a00640 1 -- 172.21.15.55:0/1952973061 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8284143f90 msgr2=0x7f82840c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:07.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8282a00640 1 --2- 172.21.15.55:0/1952973061 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8284143f90 0x7f82840c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:07.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8282a00640 1 -- 172.21.15.55:0/1952973061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82840cda80 msgr2=0x7f82840c6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:07.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8282a00640 1 --2- 172.21.15.55:0/1952973061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82840cda80 0x7f82840c6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:07.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8282a00640 1 -- 172.21.15.55:0/1952973061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827c009420 con 0x7f82840b34f0 2024-04-02T07:25:07.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8282a00640 1 --2- 172.21.15.55:0/1952973061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82840b34f0 0x7f828413e130 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f827400d5f0 tx=0x7f827400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:07.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f827be00640 1 -- 172.21.15.55:0/1952973061 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82740125f0 con 0x7f82840b34f0 2024-04-02T07:25:07.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f827be00640 1 -- 172.21.15.55:0/1952973061 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8274012750 con 0x7f82840b34f0 2024-04-02T07:25:07.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f827be00640 1 -- 172.21.15.55:0/1952973061 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8274012ae0 con 0x7f82840b34f0 2024-04-02T07:25:07.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8289e00640 1 -- 172.21.15.55:0/1952973061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8284140d60 con 0x7f82840b34f0 2024-04-02T07:25:07.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8289e00640 1 -- 172.21.15.55:0/1952973061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f828413e670 con 0x7f82840b34f0 2024-04-02T07:25:07.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.474+0000 7f8289e00640 1 -- 172.21.15.55:0/1952973061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8284066c90 con 0x7f82840b34f0 2024-04-02T07:25:07.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.478+0000 7f827be00640 1 -- 172.21.15.55:0/1952973061 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8274012c40 con 0x7f82840b34f0 2024-04-02T07:25:07.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.478+0000 7f827be00640 1 --2- 172.21.15.55:0/1952973061 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8260066690 0x7f8260068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:07.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.478+0000 7f827be00640 1 -- 172.21.15.55:0/1952973061 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8274084400 con 0x7f82840b34f0 2024-04-02T07:25:07.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.478+0000 7f827a000640 1 --2- 172.21.15.55:0/1952973061 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8260066690 0x7f8260068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:07.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.478+0000 7f827a000640 1 --2- 172.21.15.55:0/1952973061 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8260066690 0x7f8260068b50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f826c007fd0 tx=0x7f826c007ee0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:07.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.482+0000 7f827be00640 1 -- 172.21.15.55:0/1952973061 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f82740519d0 con 0x7f82840b34f0 2024-04-02T07:25:07.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:07.702+0000 7f8289e00640 1 -- 172.21.15.55:0/1952973061 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7f82840b2880 con 0x7f82840b34f0 2024-04-02T07:25:08.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.302+0000 7f827be00640 1 -- 172.21.15.55:0/1952973061 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v162) v1 ==== 172+0+0 (secure 0 0 0) 0x7f8274007380 con 0x7f82840b34f0 2024-04-02T07:25:08.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.306+0000 7f8289e00640 1 -- 172.21.15.55:0/1952973061 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8260066690 msgr2=0x7f8260068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:08.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.306+0000 7f8289e00640 1 --2- 172.21.15.55:0/1952973061 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8260066690 0x7f8260068b50 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f826c007fd0 tx=0x7f826c007ee0 comp rx=0 tx=0).stop 2024-04-02T07:25:08.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.306+0000 7f8289e00640 1 -- 172.21.15.55:0/1952973061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82840b34f0 msgr2=0x7f828413e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:08.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.306+0000 7f8289e00640 1 --2- 172.21.15.55:0/1952973061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82840b34f0 0x7f828413e130 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f827400d5f0 tx=0x7f827400dab0 comp rx=0 tx=0).stop 2024-04-02T07:25:08.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.306+0000 7f8289e00640 1 -- 172.21.15.55:0/1952973061 shutdown_connections 2024-04-02T07:25:08.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.306+0000 7f8289e00640 1 --2- 172.21.15.55:0/1952973061 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8284143f90 0x7f82840c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:08.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.306+0000 7f8289e00640 1 --2- 172.21.15.55:0/1952973061 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8260066690 0x7f8260068b50 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:08.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.306+0000 7f8289e00640 1 --2- 172.21.15.55:0/1952973061 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f82840cda80 0x7f82840c6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:08.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.306+0000 7f8289e00640 1 --2- 172.21.15.55:0/1952973061 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f82840b34f0 0x7f828413e130 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:08.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.306+0000 7f8289e00640 1 -- 172.21.15.55:0/1952973061 >> 172.21.15.55:0/1952973061 conn(0x7f8284066080 msgr2=0x7f82841431d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:08.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.306+0000 7f8289e00640 1 -- 172.21.15.55:0/1952973061 shutdown_connections 2024-04-02T07:25:08.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.306+0000 7f8289e00640 1 -- 172.21.15.55:0/1952973061 wait complete. 2024-04-02T07:25:08.331 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-02T07:25:08.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.474+0000 7f41e8600640 1 Processor -- start 2024-04-02T07:25:08.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.474+0000 7f41e8600640 1 -- start start 2024-04-02T07:25:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.474+0000 7f41e8600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f41e015c920 0x7f41e00b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.474+0000 7f41e8600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f41e00cd690 0x7f41e006aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.474+0000 7f41e8600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41e015de30 con 0x7f41e00afa70 2024-04-02T07:25:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.474+0000 7f41e8600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e0098ab0 con 0x7f41e015c920 2024-04-02T07:25:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.474+0000 7f41e8600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41e0098d90 con 0x7f41e00cd690 2024-04-02T07:25:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.474+0000 7f41e5c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f41e015c920 0x7f41e00b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.474+0000 7f41e5c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f41e015c920 0x7f41e00b1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54252/0 (socket says 172.21.15.55:54252) 2024-04-02T07:25:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.474+0000 7f41e5c00640 1 -- 172.21.15.55:0/3673153850 learned_addr learned my addr 172.21.15.55:0/3673153850 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.474+0000 7f41e6600640 1 --2- 172.21.15.55:0/3673153850 >> v2:172.21.15.106:3300/0 conn(0x7f41e00cd690 0x7f41e006aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.474+0000 7f41e5c00640 1 -- 172.21.15.55:0/3673153850 >> v2:172.21.15.106:3300/0 conn(0x7f41e00cd690 msgr2=0x7f41e006aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.474+0000 7f41e5c00640 1 --2- 172.21.15.55:0/3673153850 >> v2:172.21.15.106:3300/0 conn(0x7f41e00cd690 0x7f41e006aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.474+0000 7f41e5c00640 1 -- 172.21.15.55:0/3673153850 >> v1:172.21.15.106:6789/0 conn(0x7f41e00afa70 legacy=0x7f41e00ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.474+0000 7f41e5c00640 1 -- 172.21.15.55:0/3673153850 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41e0099070 con 0x7f41e015c920 2024-04-02T07:25:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.474+0000 7f41e6600640 1 --2- 172.21.15.55:0/3673153850 >> v2:172.21.15.106:3300/0 conn(0x7f41e00cd690 0x7f41e006aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:08.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.478+0000 7f41e5c00640 1 --2- 172.21.15.55:0/3673153850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41e015c920 0x7f41e00b1ca0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f41e00b0270 tx=0x7f41d401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eff70218c37d2e82 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:08.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.478+0000 7f41dfe00640 1 -- 172.21.15.55:0/3673153850 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d40ab650 con 0x7f41e015c920 2024-04-02T07:25:08.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.478+0000 7f41dfe00640 1 -- 172.21.15.55:0/3673153850 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d40ab7b0 con 0x7f41e015c920 2024-04-02T07:25:08.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.478+0000 7f41dfe00640 1 -- 172.21.15.55:0/3673153850 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d40abb40 con 0x7f41e015c920 2024-04-02T07:25:08.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.478+0000 7f41e8600640 1 -- 172.21.15.55:0/3673153850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41e015c920 msgr2=0x7f41e00b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:08.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.478+0000 7f41e8600640 1 --2- 172.21.15.55:0/3673153850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41e015c920 0x7f41e00b1ca0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f41e00b0270 tx=0x7f41d401c4f0 comp rx=0 tx=0).stop 2024-04-02T07:25:08.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.478+0000 7f41e8600640 1 -- 172.21.15.55:0/3673153850 shutdown_connections 2024-04-02T07:25:08.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.478+0000 7f41e8600640 1 --2- 172.21.15.55:0/3673153850 >> v2:172.21.15.106:3300/0 conn(0x7f41e00cd690 0x7f41e006aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:08.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.478+0000 7f41e8600640 1 --2- 172.21.15.55:0/3673153850 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41e015c920 0x7f41e00b1ca0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:08.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.478+0000 7f41e8600640 1 -- 172.21.15.55:0/3673153850 >> 172.21.15.55:0/3673153850 conn(0x7f41e00d0700 msgr2=0x7f41e00d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:08.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.478+0000 7f41e8600640 1 -- 172.21.15.55:0/3673153850 shutdown_connections 2024-04-02T07:25:08.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.478+0000 7f41e8600640 1 -- 172.21.15.55:0/3673153850 wait complete. 2024-04-02T07:25:08.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e8600640 1 Processor -- start 2024-04-02T07:25:08.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e8600640 1 -- start start 2024-04-02T07:25:08.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e8600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41e00afa70 0x7f41e0154ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:08.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e8600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41e00cd690 0x7f41e00c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:08.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e8600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41e015c920 0x7f41e015b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:08.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e8600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e00c4470 con 0x7f41e00afa70 2024-04-02T07:25:08.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e8600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41e0155530 con 0x7f41e00cd690 2024-04-02T07:25:08.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e8600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41e015ab10 con 0x7f41e015c920 2024-04-02T07:25:08.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e5c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41e00afa70 0x7f41e0154ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:08.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e5c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41e00afa70 0x7f41e0154ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54256/0 (socket says 172.21.15.55:54256) 2024-04-02T07:25:08.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e5c00640 1 -- 172.21.15.55:0/2601658401 learned_addr learned my addr 172.21.15.55:0/2601658401 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:08.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e5200640 1 --2- 172.21.15.55:0/2601658401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41e00cd690 0x7f41e00c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:08.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e6600640 1 --2- 172.21.15.55:0/2601658401 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41e015c920 0x7f41e015b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:08.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e5c00640 1 -- 172.21.15.55:0/2601658401 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41e015c920 msgr2=0x7f41e015b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:08.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e5c00640 1 --2- 172.21.15.55:0/2601658401 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41e015c920 0x7f41e015b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:08.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e5c00640 1 -- 172.21.15.55:0/2601658401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41e00cd690 msgr2=0x7f41e00c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:08.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e5c00640 1 --2- 172.21.15.55:0/2601658401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41e00cd690 0x7f41e00c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:08.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e5c00640 1 -- 172.21.15.55:0/2601658401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d40094d0 con 0x7f41e00afa70 2024-04-02T07:25:08.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e6600640 1 --2- 172.21.15.55:0/2601658401 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41e015c920 0x7f41e015b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:08.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e5c00640 1 --2- 172.21.15.55:0/2601658401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41e00afa70 0x7f41e0154ff0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f41d40ad040 tx=0x7f41d401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:08.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41dd600640 1 -- 172.21.15.55:0/2601658401 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d40b4800 con 0x7f41e00afa70 2024-04-02T07:25:08.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41dd600640 1 -- 172.21.15.55:0/2601658401 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41d40b4960 con 0x7f41e00afa70 2024-04-02T07:25:08.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41dd600640 1 -- 172.21.15.55:0/2601658401 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41d40b4d10 con 0x7f41e00afa70 2024-04-02T07:25:08.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e8600640 1 -- 172.21.15.55:0/2601658401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41e015ad80 con 0x7f41e00afa70 2024-04-02T07:25:08.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.482+0000 7f41e8600640 1 -- 172.21.15.55:0/2601658401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41e00c8380 con 0x7f41e00afa70 2024-04-02T07:25:08.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.486+0000 7f41e8600640 1 -- 172.21.15.55:0/2601658401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41e015b230 con 0x7f41e00afa70 2024-04-02T07:25:08.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.486+0000 7f41dd600640 1 -- 172.21.15.55:0/2601658401 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f41d40c83a0 con 0x7f41e00afa70 2024-04-02T07:25:08.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.486+0000 7f41dd600640 1 --2- 172.21.15.55:0/2601658401 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41c0066690 0x7f41c0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:08.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.486+0000 7f41dd600640 1 -- 172.21.15.55:0/2601658401 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f41d411e9e0 con 0x7f41e00afa70 2024-04-02T07:25:08.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.486+0000 7f41e5200640 1 --2- 172.21.15.55:0/2601658401 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41c0066690 0x7f41c0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:08.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.486+0000 7f41e5200640 1 --2- 172.21.15.55:0/2601658401 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41c0066690 0x7f41c0068b50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f41e0167590 tx=0x7f41cc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:08.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.490+0000 7f41dd600640 1 -- 172.21.15.55:0/2601658401 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f41d40ec190 con 0x7f41e00afa70 2024-04-02T07:25:08.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.650+0000 7f41e8600640 1 -- 172.21.15.55:0/2601658401 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f41e0066c90 con 0x7f41e00afa70 2024-04-02T07:25:08.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.654+0000 7f41dd600640 1 -- 172.21.15.55:0/2601658401 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f41d40ef7b0 con 0x7f41e00afa70 2024-04-02T07:25:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.658+0000 7f41e8600640 1 -- 172.21.15.55:0/2601658401 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41c0066690 msgr2=0x7f41c0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.658+0000 7f41e8600640 1 --2- 172.21.15.55:0/2601658401 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41c0066690 0x7f41c0068b50 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f41e0167590 tx=0x7f41cc009040 comp rx=0 tx=0).stop 2024-04-02T07:25:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.658+0000 7f41e8600640 1 -- 172.21.15.55:0/2601658401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41e00afa70 msgr2=0x7f41e0154ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.658+0000 7f41e8600640 1 --2- 172.21.15.55:0/2601658401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41e00afa70 0x7f41e0154ff0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f41d40ad040 tx=0x7f41d401ad30 comp rx=0 tx=0).stop 2024-04-02T07:25:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.658+0000 7f41e8600640 1 -- 172.21.15.55:0/2601658401 shutdown_connections 2024-04-02T07:25:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.658+0000 7f41e8600640 1 --2- 172.21.15.55:0/2601658401 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41e015c920 0x7f41e015b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.658+0000 7f41e8600640 1 --2- 172.21.15.55:0/2601658401 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41c0066690 0x7f41c0068b50 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.658+0000 7f41e8600640 1 --2- 172.21.15.55:0/2601658401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41e00cd690 0x7f41e00c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.658+0000 7f41e8600640 1 --2- 172.21.15.55:0/2601658401 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41e00afa70 0x7f41e0154ff0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:08.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.658+0000 7f41e8600640 1 -- 172.21.15.55:0/2601658401 >> 172.21.15.55:0/2601658401 conn(0x7f41e00d0700 msgr2=0x7f41e00b2500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:08.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.658+0000 7f41e8600640 1 -- 172.21.15.55:0/2601658401 shutdown_connections 2024-04-02T07:25:08.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:08.658+0000 7f41e8600640 1 -- 172.21.15.55:0/2601658401 wait complete. 2024-04-02T07:25:08.680 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-02T07:25:08.680 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:25:08.762 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:25:08.839 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-02T07:25:08.839 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:25:08.839 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:25:08.848 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:25:08.848 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:25:08.848 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:25:08.857 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:25:08.857 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:25:08.857 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:25:08.899 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:25:08.900 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:25:08.900 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:25:08.909 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:25:08.909 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-02T07:25:08.909 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:25:09.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.082+0000 7f2381200640 1 Processor -- start 2024-04-02T07:25:09.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.082+0000 7f2381200640 1 -- start start 2024-04-02T07:25:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.082+0000 7f2381200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f237c15ee70 0x7f237c099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.082+0000 7f2381200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f237c15f250 0x7f237c0b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.082+0000 7f2381200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f237c0ad270 con 0x7f237c098a10 2024-04-02T07:25:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.082+0000 7f2381200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237c0b0840 con 0x7f237c15f250 2024-04-02T07:25:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.082+0000 7f2381200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f237c0cf6a0 con 0x7f237c15ee70 2024-04-02T07:25:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.082+0000 7f2371400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f237c15f250 0x7f237c0b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.082+0000 7f2371400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f237c15f250 0x7f237c0b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54258/0 (socket says 172.21.15.55:54258) 2024-04-02T07:25:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.082+0000 7f237a800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f237c098a10 0x7f237c098e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52506/0 (socket says 172.21.15.55:52506) 2024-04-02T07:25:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.082+0000 7f2371400640 1 -- 172.21.15.55:0/412329410 learned_addr learned my addr 172.21.15.55:0/412329410 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.082+0000 7f2379e00640 1 --2- 172.21.15.55:0/412329410 >> v2:172.21.15.106:3300/0 conn(0x7f237c15ee70 0x7f237c099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.082+0000 7f2371400640 1 -- 172.21.15.55:0/412329410 >> v2:172.21.15.106:3300/0 conn(0x7f237c15ee70 msgr2=0x7f237c099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.082+0000 7f2371400640 1 --2- 172.21.15.55:0/412329410 >> v2:172.21.15.106:3300/0 conn(0x7f237c15ee70 0x7f237c099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.082+0000 7f2371400640 1 -- 172.21.15.55:0/412329410 >> v1:172.21.15.55:6789/0 conn(0x7f237c098a10 legacy=0x7f237c098e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.082+0000 7f2371400640 1 -- 172.21.15.55:0/412329410 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f237c0b0a50 con 0x7f237c15f250 2024-04-02T07:25:09.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.082+0000 7f2379400640 1 -- 172.21.15.55:0/412329410 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3790817143 0 0) 0x7f237c0ad270 con 0x7f237c098a10 2024-04-02T07:25:09.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.086+0000 7f2371400640 1 --2- 172.21.15.55:0/412329410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f237c15f250 0x7f237c0b12f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f237c0719c0 tx=0x7f236401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27930e8830f27734 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:09.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.086+0000 7f2379400640 1 -- 172.21.15.55:0/412329410 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23640a58b0 con 0x7f237c15f250 2024-04-02T07:25:09.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.086+0000 7f2379400640 1 -- 172.21.15.55:0/412329410 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23640a5a10 con 0x7f237c15f250 2024-04-02T07:25:09.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.086+0000 7f2379400640 1 -- 172.21.15.55:0/412329410 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23640a5da0 con 0x7f237c15f250 2024-04-02T07:25:09.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.086+0000 7f2381200640 1 -- 172.21.15.55:0/412329410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f237c15f250 msgr2=0x7f237c0b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:09.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.086+0000 7f2381200640 1 --2- 172.21.15.55:0/412329410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f237c15f250 0x7f237c0b12f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f237c0719c0 tx=0x7f236401c9f0 comp rx=0 tx=0).stop 2024-04-02T07:25:09.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.086+0000 7f2381200640 1 -- 172.21.15.55:0/412329410 shutdown_connections 2024-04-02T07:25:09.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.086+0000 7f2381200640 1 --2- 172.21.15.55:0/412329410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f237c15f250 0x7f237c0b12f0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:09.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.086+0000 7f2381200640 1 --2- 172.21.15.55:0/412329410 >> v2:172.21.15.106:3300/0 conn(0x7f237c15ee70 0x7f237c099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:09.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.086+0000 7f2381200640 1 -- 172.21.15.55:0/412329410 >> 172.21.15.55:0/412329410 conn(0x7f237c0b21d0 msgr2=0x7f237c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:09.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.086+0000 7f2381200640 1 -- 172.21.15.55:0/412329410 shutdown_connections 2024-04-02T07:25:09.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.086+0000 7f2381200640 1 -- 172.21.15.55:0/412329410 wait complete. 2024-04-02T07:25:09.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2381200640 1 Processor -- start 2024-04-02T07:25:09.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2381200640 1 -- start start 2024-04-02T07:25:09.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2381200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f237c098a10 0x7f237c152ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:09.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2381200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f237c15ee70 0x7f237c1550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:09.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2381200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f237c15f250 0x7f237c14d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:09.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2381200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c158050 con 0x7f237c098a10 2024-04-02T07:25:09.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2381200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c1584e0 con 0x7f237c15ee70 2024-04-02T07:25:09.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2381200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f237c157760 con 0x7f237c15f250 2024-04-02T07:25:09.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2379e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f237c098a10 0x7f237c152ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:09.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2379e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f237c098a10 0x7f237c152ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54264/0 (socket says 172.21.15.55:54264) 2024-04-02T07:25:09.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2379e00640 1 -- 172.21.15.55:0/2394580527 learned_addr learned my addr 172.21.15.55:0/2394580527 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:09.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2371400640 1 --2- 172.21.15.55:0/2394580527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f237c15ee70 0x7f237c1550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:09.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f237a800640 1 --2- 172.21.15.55:0/2394580527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f237c15f250 0x7f237c14d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:09.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2379e00640 1 -- 172.21.15.55:0/2394580527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f237c15f250 msgr2=0x7f237c14d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2379e00640 1 --2- 172.21.15.55:0/2394580527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f237c15f250 0x7f237c14d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2379e00640 1 -- 172.21.15.55:0/2394580527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f237c15ee70 msgr2=0x7f237c1550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2379e00640 1 --2- 172.21.15.55:0/2394580527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f237c15ee70 0x7f237c1550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2379e00640 1 -- 172.21.15.55:0/2394580527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2364009b30 con 0x7f237c098a10 2024-04-02T07:25:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2371400640 1 --2- 172.21.15.55:0/2394580527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f237c15ee70 0x7f237c1550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2379e00640 1 --2- 172.21.15.55:0/2394580527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f237c098a10 0x7f237c152ad0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f236c00d830 tx=0x7f236c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2372a00640 1 -- 172.21.15.55:0/2394580527 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c00b6c0 con 0x7f237c098a10 2024-04-02T07:25:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2372a00640 1 -- 172.21.15.55:0/2394580527 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f236c00b820 con 0x7f237c098a10 2024-04-02T07:25:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2381200640 1 -- 172.21.15.55:0/2394580527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f237c155b60 con 0x7f237c098a10 2024-04-02T07:25:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2372a00640 1 -- 172.21.15.55:0/2394580527 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c00bb90 con 0x7f237c098a10 2024-04-02T07:25:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2381200640 1 -- 172.21.15.55:0/2394580527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237c157ce0 con 0x7f237c098a10 2024-04-02T07:25:09.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.090+0000 7f2381200640 1 -- 172.21.15.55:0/2394580527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f237c066c90 con 0x7f237c098a10 2024-04-02T07:25:09.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.094+0000 7f2372a00640 1 -- 172.21.15.55:0/2394580527 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f236c01e460 con 0x7f237c098a10 2024-04-02T07:25:09.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.094+0000 7f2372a00640 1 --2- 172.21.15.55:0/2394580527 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2358066690 0x7f2358068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:09.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.094+0000 7f2372a00640 1 -- 172.21.15.55:0/2394580527 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f236c084680 con 0x7f237c098a10 2024-04-02T07:25:09.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.094+0000 7f2371400640 1 --2- 172.21.15.55:0/2394580527 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2358066690 0x7f2358068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:09.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.094+0000 7f2371400640 1 --2- 172.21.15.55:0/2394580527 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2358066690 0x7f2358068b50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f23640ae000 tx=0x7f23640a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:09.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.098+0000 7f2372a00640 1 -- 172.21.15.55:0/2394580527 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f236c051cd0 con 0x7f237c098a10 2024-04-02T07:25:09.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.294+0000 7f2381200640 1 -- 172.21.15.55:0/2394580527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f237c165690 con 0x7f237c098a10 2024-04-02T07:25:09.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.298+0000 7f2372a00640 1 -- 172.21.15.55:0/2394580527 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f236c0552f0 con 0x7f237c098a10 2024-04-02T07:25:09.300 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:09.300 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":27,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5545,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2224746522","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2224746522},{"type":"v1","addr":"172.21.15.106:6837","nonce":2224746522}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5649,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/2077739908","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2077739908},{"type":"v1","addr":"172.21.15.55:6833","nonce":2077739908}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5652,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/4108584287","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4108584287},{"type":"v1","addr":"172.21.15.55:6835","nonce":4108584287}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":5884,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2403612536","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2403612536},{"type":"v1","addr":"172.21.15.106:6836","nonce":2403612536}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":27}],"filesystems":[]} 2024-04-02T07:25:09.300 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 27 2024-04-02T07:25:09.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.298+0000 7f2381200640 1 -- 172.21.15.55:0/2394580527 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2358066690 msgr2=0x7f2358068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:09.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.298+0000 7f2381200640 1 --2- 172.21.15.55:0/2394580527 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2358066690 0x7f2358068b50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f23640ae000 tx=0x7f23640a7070 comp rx=0 tx=0).stop 2024-04-02T07:25:09.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.298+0000 7f2381200640 1 -- 172.21.15.55:0/2394580527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f237c098a10 msgr2=0x7f237c152ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:09.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.298+0000 7f2381200640 1 --2- 172.21.15.55:0/2394580527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f237c098a10 0x7f237c152ad0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f236c00d830 tx=0x7f236c00dcf0 comp rx=0 tx=0).stop 2024-04-02T07:25:09.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.298+0000 7f2381200640 1 -- 172.21.15.55:0/2394580527 shutdown_connections 2024-04-02T07:25:09.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.298+0000 7f2381200640 1 --2- 172.21.15.55:0/2394580527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f237c15f250 0x7f237c14d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:09.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.298+0000 7f2381200640 1 --2- 172.21.15.55:0/2394580527 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2358066690 0x7f2358068b50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:09.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.298+0000 7f2381200640 1 --2- 172.21.15.55:0/2394580527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f237c15ee70 0x7f237c1550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:09.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.298+0000 7f2381200640 1 --2- 172.21.15.55:0/2394580527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f237c098a10 0x7f237c152ad0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:09.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.298+0000 7f2381200640 1 -- 172.21.15.55:0/2394580527 >> 172.21.15.55:0/2394580527 conn(0x7f237c0b21d0 msgr2=0x7f237c072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:09.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.298+0000 7f2381200640 1 -- 172.21.15.55:0/2394580527 shutdown_connections 2024-04-02T07:25:09.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.298+0000 7f2381200640 1 -- 172.21.15.55:0/2394580527 wait complete. 2024-04-02T07:25:09.322 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-02T07:25:09.323 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-02T07:25:09.323 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-02T07:25:09.323 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:25:09.323 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-02T07:25:09.323 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-02T07:25:09.323 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-02T07:25:09.323 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:25:09.324 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-02T07:25:09.324 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-02T07:25:09.324 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-02T07:25:09.324 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:25:09.324 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-02T07:25:09.324 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-02T07:25:09.324 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-02T07:25:09.325 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:25:09.336 INFO:tasks.ceph.mds.a:Stopped 2024-04-02T07:25:09.336 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-02T07:25:09.337 INFO:tasks.ceph.mds.c:Stopped 2024-04-02T07:25:09.338 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-02T07:25:09.342 INFO:tasks.ceph.mds.b:Stopped 2024-04-02T07:25:09.342 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-02T07:25:09.343 INFO:tasks.ceph.mds.d:Stopped 2024-04-02T07:25:09.343 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-02T07:25:09.386 INFO:tasks.ceph.mds.a:Started 2024-04-02T07:25:09.386 DEBUG:teuthology.parallel:result is None 2024-04-02T07:25:09.387 INFO:tasks.ceph.mds.b:Started 2024-04-02T07:25:09.387 DEBUG:teuthology.parallel:result is None 2024-04-02T07:25:09.388 INFO:tasks.ceph.mds.c:Started 2024-04-02T07:25:09.388 DEBUG:teuthology.parallel:result is None 2024-04-02T07:25:09.389 INFO:tasks.ceph.mds.d:Started 2024-04-02T07:25:09.389 DEBUG:teuthology.parallel:result is None 2024-04-02T07:25:09.389 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-02T07:25:09.473 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-02T07:25:09.473 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-02T07:25:09.478 INFO:tasks.ceph.mds.b.smithi106.stdout:starting mds.b at 2024-04-02T07:25:09.479 INFO:tasks.ceph.mds.d.smithi106.stdout:starting mds.d at 2024-04-02T07:25:09.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.538+0000 7fd4ada00640 1 Processor -- start 2024-04-02T07:25:09.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.538+0000 7fd4ada00640 1 -- start start 2024-04-02T07:25:09.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.538+0000 7fd4ada00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4a806b8b0 0x7fd4a80b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:09.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.538+0000 7fd4ada00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4a80cf4b0 0x7fd4a80caac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:09.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.538+0000 7fd4ada00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4a80cea10 con 0x7fd4a8099420 2024-04-02T07:25:09.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.538+0000 7fd4ada00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4a81603f0 con 0x7fd4a806b8b0 2024-04-02T07:25:09.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.538+0000 7fd4ada00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a806b150 con 0x7fd4a80cf4b0 2024-04-02T07:25:09.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.538+0000 7fd4a7e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4a806b8b0 0x7fd4a80b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:09.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.538+0000 7fd4a7e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4a806b8b0 0x7fd4a80b13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54312/0 (socket says 172.21.15.55:54312) 2024-04-02T07:25:09.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.538+0000 7fd4a7e00640 1 -- 172.21.15.55:0/1037803044 learned_addr learned my addr 172.21.15.55:0/1037803044 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:09.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.538+0000 7fd49fe00640 1 --1- 172.21.15.55:0/1037803044 >> v1:172.21.15.55:6789/0 conn(0x7fd4a8099420 0x7fd4a806bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52512/0 (socket says 172.21.15.55:52512) 2024-04-02T07:25:09.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.538+0000 7fd4ad000640 1 --2- 172.21.15.55:0/1037803044 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4a80cf4b0 0x7fd4a80caac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:09.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.538+0000 7fd4a7e00640 1 -- 172.21.15.55:0/1037803044 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4a80cf4b0 msgr2=0x7fd4a80caac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:09.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.538+0000 7fd4a7e00640 1 --2- 172.21.15.55:0/1037803044 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4a80cf4b0 0x7fd4a80caac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:09.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.538+0000 7fd4a7e00640 1 -- 172.21.15.55:0/1037803044 >> v1:172.21.15.55:6789/0 conn(0x7fd4a8099420 legacy=0x7fd4a806bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:09.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.538+0000 7fd4a7e00640 1 -- 172.21.15.55:0/1037803044 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a80cecb0 con 0x7fd4a806b8b0 2024-04-02T07:25:09.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.538+0000 7fd4a7400640 1 -- 172.21.15.55:0/1037803044 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 987930390 0 0) 0x7fd4a80cea10 con 0x7fd4a8099420 2024-04-02T07:25:09.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.538+0000 7fd4ad000640 1 --2- 172.21.15.55:0/1037803044 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4a80cf4b0 0x7fd4a80caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:25:09.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.542+0000 7fd4a7e00640 1 --2- 172.21.15.55:0/1037803044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4a806b8b0 0x7fd4a80b13f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd498009870 tx=0x7fd49801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1abfc9f3e001c94 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:09.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.542+0000 7fd4a7400640 1 -- 172.21.15.55:0/1037803044 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4980ab640 con 0x7fd4a806b8b0 2024-04-02T07:25:09.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.542+0000 7fd4a7400640 1 -- 172.21.15.55:0/1037803044 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4980a7070 con 0x7fd4a806b8b0 2024-04-02T07:25:09.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.542+0000 7fd4a7400640 1 -- 172.21.15.55:0/1037803044 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4980ab9c0 con 0x7fd4a806b8b0 2024-04-02T07:25:09.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.542+0000 7fd4ada00640 1 -- 172.21.15.55:0/1037803044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4a806b8b0 msgr2=0x7fd4a80b13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:09.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.542+0000 7fd4ada00640 1 --2- 172.21.15.55:0/1037803044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4a806b8b0 0x7fd4a80b13f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fd498009870 tx=0x7fd49801c530 comp rx=0 tx=0).stop 2024-04-02T07:25:09.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.542+0000 7fd4ada00640 1 -- 172.21.15.55:0/1037803044 shutdown_connections 2024-04-02T07:25:09.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.542+0000 7fd4ada00640 1 --2- 172.21.15.55:0/1037803044 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4a80cf4b0 0x7fd4a80caac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:09.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.542+0000 7fd4ada00640 1 --2- 172.21.15.55:0/1037803044 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4a806b8b0 0x7fd4a80b13f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:09.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.542+0000 7fd4ada00640 1 -- 172.21.15.55:0/1037803044 >> 172.21.15.55:0/1037803044 conn(0x7fd4a80ccf80 msgr2=0x7fd4a80cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:09.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.542+0000 7fd4ada00640 1 -- 172.21.15.55:0/1037803044 shutdown_connections 2024-04-02T07:25:09.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.542+0000 7fd4ada00640 1 -- 172.21.15.55:0/1037803044 wait complete. 2024-04-02T07:25:09.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4ada00640 1 Processor -- start 2024-04-02T07:25:09.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4ada00640 1 -- start start 2024-04-02T07:25:09.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4ada00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4a806b8b0 0x7fd4a8157f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:09.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4ada00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4a8099420 0x7fd4a8152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:09.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4ada00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4a80cf4b0 0x7fd4a8154510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:09.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4ada00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a8153310 con 0x7fd4a80cf4b0 2024-04-02T07:25:09.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4ada00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a8156ed0 con 0x7fd4a8099420 2024-04-02T07:25:09.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4ada00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4a81571b0 con 0x7fd4a806b8b0 2024-04-02T07:25:09.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4ad000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4a80cf4b0 0x7fd4a8154510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:09.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4ad000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4a80cf4b0 0x7fd4a8154510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54322/0 (socket says 172.21.15.55:54322) 2024-04-02T07:25:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4ad000640 1 -- 172.21.15.55:0/3574025749 learned_addr learned my addr 172.21.15.55:0/3574025749 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4a7e00640 1 --2- 172.21.15.55:0/3574025749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4a806b8b0 0x7fd4a8157f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd49fe00640 1 --2- 172.21.15.55:0/3574025749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4a8099420 0x7fd4a8152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4ad000640 1 -- 172.21.15.55:0/3574025749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4a806b8b0 msgr2=0x7fd4a8157f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4ad000640 1 --2- 172.21.15.55:0/3574025749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4a806b8b0 0x7fd4a8157f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4ad000640 1 -- 172.21.15.55:0/3574025749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4a8099420 msgr2=0x7fd4a8152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4ad000640 1 --2- 172.21.15.55:0/3574025749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4a8099420 0x7fd4a8152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4ad000640 1 -- 172.21.15.55:0/3574025749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4980094d0 con 0x7fd4a80cf4b0 2024-04-02T07:25:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd49fe00640 1 --2- 172.21.15.55:0/3574025749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4a8099420 0x7fd4a8152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:25:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4ad000640 1 --2- 172.21.15.55:0/3574025749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4a80cf4b0 0x7fd4a8154510 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000cef0 tx=0x7fd4a000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4a4c00640 1 -- 172.21.15.55:0/3574025749 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a000d840 con 0x7fd4a80cf4b0 2024-04-02T07:25:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4a4c00640 1 -- 172.21.15.55:0/3574025749 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a000d9c0 con 0x7fd4a80cf4b0 2024-04-02T07:25:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4a4c00640 1 -- 172.21.15.55:0/3574025749 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a000dd70 con 0x7fd4a80cf4b0 2024-04-02T07:25:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4ada00640 1 -- 172.21.15.55:0/3574025749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4a8157490 con 0x7fd4a80cf4b0 2024-04-02T07:25:09.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4ada00640 1 -- 172.21.15.55:0/3574025749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4a8157a50 con 0x7fd4a80cf4b0 2024-04-02T07:25:09.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.546+0000 7fd4ada00640 1 -- 172.21.15.55:0/3574025749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4a8157c70 con 0x7fd4a80cf4b0 2024-04-02T07:25:09.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.550+0000 7fd4a4c00640 1 -- 172.21.15.55:0/3574025749 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd4a001e3b0 con 0x7fd4a80cf4b0 2024-04-02T07:25:09.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.550+0000 7fd4a4c00640 1 --2- 172.21.15.55:0/3574025749 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd4840666c0 0x7fd484068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:09.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.550+0000 7fd4a4c00640 1 -- 172.21.15.55:0/3574025749 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd4a0084950 con 0x7fd4a80cf4b0 2024-04-02T07:25:09.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.550+0000 7fd4a7e00640 1 --2- 172.21.15.55:0/3574025749 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd4840666c0 0x7fd484068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:09.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.550+0000 7fd4a7e00640 1 --2- 172.21.15.55:0/3574025749 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd4840666c0 0x7fd484068b80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd4980af000 tx=0x7fd4980a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:09.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.554+0000 7fd4a4c00640 1 -- 172.21.15.55:0/3574025749 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd4a0051fe0 con 0x7fd4a80cf4b0 2024-04-02T07:25:09.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:09.726+0000 7fd4ada00640 1 -- 172.21.15.55:0/3574025749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd4a8073fa0 con 0x7fd4a80cf4b0 2024-04-02T07:25:10.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.506+0000 7fd4a4c00640 1 -- 172.21.15.55:0/3574025749 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v56) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd4a001a020 con 0x7fd4a80cf4b0 2024-04-02T07:25:10.515 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2024-04-02T07:25:10.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.510+0000 7fd4ada00640 1 -- 172.21.15.55:0/3574025749 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd4840666c0 msgr2=0x7fd484068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:10.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.510+0000 7fd4ada00640 1 --2- 172.21.15.55:0/3574025749 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd4840666c0 0x7fd484068b80 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fd4980af000 tx=0x7fd4980a7000 comp rx=0 tx=0).stop 2024-04-02T07:25:10.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.510+0000 7fd4ada00640 1 -- 172.21.15.55:0/3574025749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4a80cf4b0 msgr2=0x7fd4a8154510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:10.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.510+0000 7fd4ada00640 1 --2- 172.21.15.55:0/3574025749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4a80cf4b0 0x7fd4a8154510 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000cef0 tx=0x7fd4a000a710 comp rx=0 tx=0).stop 2024-04-02T07:25:10.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.510+0000 7fd4ada00640 1 -- 172.21.15.55:0/3574025749 shutdown_connections 2024-04-02T07:25:10.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.510+0000 7fd4ada00640 1 --2- 172.21.15.55:0/3574025749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4a80cf4b0 0x7fd4a8154510 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:10.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.510+0000 7fd4ada00640 1 --2- 172.21.15.55:0/3574025749 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd4840666c0 0x7fd484068b80 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:10.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.510+0000 7fd4ada00640 1 --2- 172.21.15.55:0/3574025749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4a8099420 0x7fd4a8152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:10.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.510+0000 7fd4ada00640 1 --2- 172.21.15.55:0/3574025749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4a806b8b0 0x7fd4a8157f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:10.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.510+0000 7fd4ada00640 1 -- 172.21.15.55:0/3574025749 >> 172.21.15.55:0/3574025749 conn(0x7fd4a80ccf80 msgr2=0x7fd4a8159720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:10.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.510+0000 7fd4ada00640 1 -- 172.21.15.55:0/3574025749 shutdown_connections 2024-04-02T07:25:10.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.510+0000 7fd4ada00640 1 -- 172.21.15.55:0/3574025749 wait complete. 2024-04-02T07:25:10.538 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-02T07:25:10.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.682+0000 7fcd8a000640 1 Processor -- start 2024-04-02T07:25:10.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.682+0000 7fcd8a000640 1 -- start start 2024-04-02T07:25:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.682+0000 7fcd8a000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd8415ee70 0x7fcd84099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.682+0000 7fcd8a000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcd8415f250 0x7fcd840b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.682+0000 7fcd8a000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd840cf6a0 con 0x7fcd84098a10 2024-04-02T07:25:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.682+0000 7fcd8a000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd840b0840 con 0x7fcd8415f250 2024-04-02T07:25:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.682+0000 7fcd8a000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd840ad270 con 0x7fcd8415ee70 2024-04-02T07:25:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.682+0000 7fcd82a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcd8415f250 0x7fcd840b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.682+0000 7fcd82a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcd8415f250 0x7fcd840b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54332/0 (socket says 172.21.15.55:54332) 2024-04-02T07:25:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.682+0000 7fcd83e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcd84098a10 0x7fcd840cb2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52520/0 (socket says 172.21.15.55:52520) 2024-04-02T07:25:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.682+0000 7fcd82a00640 1 -- 172.21.15.55:0/974946704 learned_addr learned my addr 172.21.15.55:0/974946704 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.682+0000 7fcd83400640 1 --2- 172.21.15.55:0/974946704 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd8415ee70 0x7fcd84099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:10.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.682+0000 7fcd82a00640 1 -- 172.21.15.55:0/974946704 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd8415ee70 msgr2=0x7fcd84099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:10.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.682+0000 7fcd82a00640 1 --2- 172.21.15.55:0/974946704 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd8415ee70 0x7fcd84099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:10.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.682+0000 7fcd82a00640 1 -- 172.21.15.55:0/974946704 >> v1:172.21.15.55:6789/0 conn(0x7fcd84098a10 legacy=0x7fcd840cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:10.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.682+0000 7fcd82a00640 1 -- 172.21.15.55:0/974946704 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd840b0a50 con 0x7fcd8415f250 2024-04-02T07:25:10.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.682+0000 7fcd82000640 1 -- 172.21.15.55:0/974946704 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 256490684 0 0) 0x7fcd840cf6a0 con 0x7fcd84098a10 2024-04-02T07:25:10.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.686+0000 7fcd82a00640 1 --2- 172.21.15.55:0/974946704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd8415f250 0x7fcd840b12f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fcd70009870 tx=0x7fcd7001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=401fd08c50eb34d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:10.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.686+0000 7fcd82000640 1 -- 172.21.15.55:0/974946704 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd700a9620 con 0x7fcd8415f250 2024-04-02T07:25:10.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.686+0000 7fcd82000640 1 -- 172.21.15.55:0/974946704 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd700a9780 con 0x7fcd8415f250 2024-04-02T07:25:10.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.686+0000 7fcd82000640 1 -- 172.21.15.55:0/974946704 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd700a9b10 con 0x7fcd8415f250 2024-04-02T07:25:10.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.686+0000 7fcd8a000640 1 -- 172.21.15.55:0/974946704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd8415f250 msgr2=0x7fcd840b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:10.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.686+0000 7fcd8a000640 1 --2- 172.21.15.55:0/974946704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd8415f250 0x7fcd840b12f0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fcd70009870 tx=0x7fcd7001c560 comp rx=0 tx=0).stop 2024-04-02T07:25:10.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.686+0000 7fcd8a000640 1 -- 172.21.15.55:0/974946704 shutdown_connections 2024-04-02T07:25:10.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.686+0000 7fcd8a000640 1 --2- 172.21.15.55:0/974946704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd8415f250 0x7fcd840b12f0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:10.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.686+0000 7fcd8a000640 1 --2- 172.21.15.55:0/974946704 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd8415ee70 0x7fcd84099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:10.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.686+0000 7fcd8a000640 1 -- 172.21.15.55:0/974946704 >> 172.21.15.55:0/974946704 conn(0x7fcd840b21d0 msgr2=0x7fcd840b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:10.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.686+0000 7fcd8a000640 1 -- 172.21.15.55:0/974946704 shutdown_connections 2024-04-02T07:25:10.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.686+0000 7fcd8a000640 1 -- 172.21.15.55:0/974946704 wait complete. 2024-04-02T07:25:10.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.686+0000 7fcd8a000640 1 Processor -- start 2024-04-02T07:25:10.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.686+0000 7fcd8a000640 1 -- start start 2024-04-02T07:25:10.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd8a000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd84098a10 0x7fcd8415b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:10.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd8a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd8415ee70 0x7fcd8414a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:10.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd8a000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd8415f250 0x7fcd8414ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:10.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd8a000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8414ba30 con 0x7fcd8415ee70 2024-04-02T07:25:10.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd8a000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd840b3b30 con 0x7fcd8415f250 2024-04-02T07:25:10.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd8a000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8414b470 con 0x7fcd84098a10 2024-04-02T07:25:10.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd82a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd8415ee70 0x7fcd8414a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:10.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd82a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd8415ee70 0x7fcd8414a8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54342/0 (socket says 172.21.15.55:54342) 2024-04-02T07:25:10.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd82a00640 1 -- 172.21.15.55:0/1906310605 learned_addr learned my addr 172.21.15.55:0/1906310605 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:10.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd83400640 1 --2- 172.21.15.55:0/1906310605 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd84098a10 0x7fcd8415b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:10.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd83e00640 1 --2- 172.21.15.55:0/1906310605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd8415f250 0x7fcd8414ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:10.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd82a00640 1 -- 172.21.15.55:0/1906310605 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd84098a10 msgr2=0x7fcd8415b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:10.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd82a00640 1 --2- 172.21.15.55:0/1906310605 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd84098a10 0x7fcd8415b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:10.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd82a00640 1 -- 172.21.15.55:0/1906310605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd8415f250 msgr2=0x7fcd8414ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:10.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd82a00640 1 --2- 172.21.15.55:0/1906310605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd8415f250 0x7fcd8414ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:10.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd82a00640 1 -- 172.21.15.55:0/1906310605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd700094d0 con 0x7fcd8415ee70 2024-04-02T07:25:10.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd82a00640 1 --2- 172.21.15.55:0/1906310605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd8415ee70 0x7fcd8414a8e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcd700ab040 tx=0x7fcd7001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:10.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd7b400640 1 -- 172.21.15.55:0/1906310605 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd700bc450 con 0x7fcd8415ee70 2024-04-02T07:25:10.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd7b400640 1 -- 172.21.15.55:0/1906310605 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd700bc5b0 con 0x7fcd8415ee70 2024-04-02T07:25:10.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd8a000640 1 -- 172.21.15.55:0/1906310605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8414b750 con 0x7fcd8415ee70 2024-04-02T07:25:10.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd7b400640 1 -- 172.21.15.55:0/1906310605 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd700bc960 con 0x7fcd8415ee70 2024-04-02T07:25:10.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd8a000640 1 -- 172.21.15.55:0/1906310605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd840b40b0 con 0x7fcd8415ee70 2024-04-02T07:25:10.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd8a000640 1 -- 172.21.15.55:0/1906310605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd840b42a0 con 0x7fcd8415ee70 2024-04-02T07:25:10.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.690+0000 7fcd7b400640 1 -- 172.21.15.55:0/1906310605 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fcd700bcac0 con 0x7fcd8415ee70 2024-04-02T07:25:10.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.694+0000 7fcd7b400640 1 --2- 172.21.15.55:0/1906310605 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcd64066690 0x7fcd64068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:10.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.694+0000 7fcd7b400640 1 -- 172.21.15.55:0/1906310605 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcd7011e340 con 0x7fcd8415ee70 2024-04-02T07:25:10.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.694+0000 7fcd83400640 1 --2- 172.21.15.55:0/1906310605 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcd64066690 0x7fcd64068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:10.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.694+0000 7fcd83400640 1 --2- 172.21.15.55:0/1906310605 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcd64066690 0x7fcd64068b50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcd840b0760 tx=0x7fcd74008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:10.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.698+0000 7fcd7b400640 1 -- 172.21.15.55:0/1906310605 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fcd700ebb10 con 0x7fcd8415ee70 2024-04-02T07:25:10.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.910+0000 7fcd8a000640 1 -- 172.21.15.55:0/1906310605 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcd84066c90 con 0x7fcd8415ee70 2024-04-02T07:25:10.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.914+0000 7fcd7b400640 1 -- 172.21.15.55:0/1906310605 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v12) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fcd700ef130 con 0x7fcd8415ee70 2024-04-02T07:25:10.916 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:10.916 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:25:10.916 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2024-04-02T07:25:10.916 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:10.916 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2024-04-02T07:25:10.916 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFL1DHxAAuUs47l42sADNRgxi4BeNrA==", 2024-04-02T07:25:10.917 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:25:10.917 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:25:10.917 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:25:10.917 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:25:10.917 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:25:10.917 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:10.917 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:10.917 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:10.917 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2024-04-02T07:25:10.917 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFZB+KxAAeKnfP4Z1UkLura+bQrG5mA==", 2024-04-02T07:25:10.917 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:25:10.917 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:25:10.917 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:25:10.917 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:25:10.918 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:25:10.918 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:10.918 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:10.918 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:10.918 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2024-04-02T07:25:10.918 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmUQR/JhAA9LNK5gHJ1NiiqNrfxL4mIA==", 2024-04-02T07:25:10.918 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:25:10.918 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:25:10.918 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:25:10.918 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:25:10.918 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:25:10.918 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:10.918 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:10.919 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:10.919 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2024-04-02T07:25:10.919 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmotumMhAASI1PogpVSHXWIv9xq3qs4Q==", 2024-04-02T07:25:10.919 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:25:10.919 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:25:10.919 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:25:10.919 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:25:10.919 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:25:10.919 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:10.919 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:10.919 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:10.919 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2024-04-02T07:25:10.919 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDysQtmsM9JIxAAZNjTGYW74kqz5NM9NyPSWQ==", 2024-04-02T07:25:10.919 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:25:10.920 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:25:10.920 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:25:10.920 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:25:10.920 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:10.920 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:10.920 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:10.920 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2024-04-02T07:25:10.920 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD1sQtmJaorKhAAtujPXPmQVX3QUG1ANqEphQ==", 2024-04-02T07:25:10.920 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:25:10.920 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:25:10.920 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:25:10.920 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:25:10.920 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:10.920 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:10.921 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:10.921 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2024-04-02T07:25:10.921 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD4sQtm1fdwMhAAOxlYwaBnPKhSQODMLVbaSQ==", 2024-04-02T07:25:10.921 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:25:10.921 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:25:10.921 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:25:10.921 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:25:10.921 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:10.921 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:10.921 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:10.921 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2024-04-02T07:25:10.921 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD7sQtmo9OaORAAsjpiVkG9vZV1QxpvgbrFmg==", 2024-04-02T07:25:10.921 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:25:10.921 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:25:10.922 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:25:10.922 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:25:10.922 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:10.922 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:10.922 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:10.922 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2024-04-02T07:25:10.922 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQACsgtmTyOkAxAARfxuj/YCM6FWNDhCkLQV3g==", 2024-04-02T07:25:10.922 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:25:10.922 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:25:10.922 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:25:10.922 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:25:10.922 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:10.922 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:10.923 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:10.923 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2024-04-02T07:25:10.923 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAFsgtmimDECRAAh/XVN7rICihc8NlxhDJB6Q==", 2024-04-02T07:25:10.923 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:25:10.923 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:25:10.923 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:25:10.923 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:25:10.923 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:10.923 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:10.923 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:10.923 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2024-04-02T07:25:10.923 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAIsgtmreHiDhAAISQbxixad17TRrz7MHQTxA==", 2024-04-02T07:25:10.923 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:25:10.923 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:25:10.924 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:25:10.924 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:25:10.924 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:10.924 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:10.924 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:10.924 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2024-04-02T07:25:10.924 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQALsgtmHVTlExAAT/6jK+czOZ3+4nwpgZOmow==", 2024-04-02T07:25:10.924 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:25:10.924 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:25:10.924 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:25:10.924 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:25:10.924 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:10.924 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:10.924 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:10.925 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2024-04-02T07:25:10.925 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmkS2QNhAAt+q0y1TDn03hqM/Y6uKq6g==", 2024-04-02T07:25:10.925 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:25:10.925 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:25:10.925 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2024-04-02T07:25:10.925 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-02T07:25:10.925 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:10.925 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:10.925 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:10.925 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2024-04-02T07:25:10.925 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmjCzTBBAAVYyat2dGZSTquRQoB+7JMg==", 2024-04-02T07:25:10.925 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:25:10.925 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:25:10.925 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:25:10.925 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:25:10.926 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:25:10.926 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:10.926 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:10.926 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:10.926 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2024-04-02T07:25:10.926 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmq45FARAAY6/caSeqvTn7/BThOodYIA==", 2024-04-02T07:25:10.926 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:25:10.926 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:25:10.926 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:25:10.926 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:25:10.926 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:25:10.926 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:10.926 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:10.927 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:10.927 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2024-04-02T07:25:10.927 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmmjDeChAAL2RsY5VlAy/KZ5go5ZJoBA==", 2024-04-02T07:25:10.927 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:25:10.927 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:25:10.927 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:25:10.927 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:25:10.927 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:25:10.927 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:10.927 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:10.927 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:10.927 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2024-04-02T07:25:10.927 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtm1hiMAxAAarlHR9VHGrkPCXhksMM/1w==", 2024-04-02T07:25:10.927 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:25:10.927 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:25:10.928 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:25:10.928 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:25:10.928 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:25:10.928 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:10.928 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:10.928 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:10.928 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2024-04-02T07:25:10.928 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFyktGxAAJC7ezewbXwDQue+qjpTfYw==", 2024-04-02T07:25:10.928 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:25:10.928 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:25:10.928 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-02T07:25:10.928 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:25:10.928 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:10.928 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:10.929 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:10.929 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2024-04-02T07:25:10.929 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmUcxUFxAA8NUHdxhUfp3/AILMIbS1fw==", 2024-04-02T07:25:10.929 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:25:10.929 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:25:10.929 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-02T07:25:10.929 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:25:10.929 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:10.929 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:10.929 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-04-02T07:25:10.929 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:25:10.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.914+0000 7fcd8a000640 1 -- 172.21.15.55:0/1906310605 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcd64066690 msgr2=0x7fcd64068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:10.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.914+0000 7fcd8a000640 1 --2- 172.21.15.55:0/1906310605 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcd64066690 0x7fcd64068b50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fcd840b0760 tx=0x7fcd74008040 comp rx=0 tx=0).stop 2024-04-02T07:25:10.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.914+0000 7fcd8a000640 1 -- 172.21.15.55:0/1906310605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd8415ee70 msgr2=0x7fcd8414a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:10.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.914+0000 7fcd8a000640 1 --2- 172.21.15.55:0/1906310605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd8415ee70 0x7fcd8414a8e0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcd700ab040 tx=0x7fcd7001ada0 comp rx=0 tx=0).stop 2024-04-02T07:25:10.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.914+0000 7fcd8a000640 1 -- 172.21.15.55:0/1906310605 shutdown_connections 2024-04-02T07:25:10.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.914+0000 7fcd8a000640 1 --2- 172.21.15.55:0/1906310605 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcd64066690 0x7fcd64068b50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:10.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.914+0000 7fcd8a000640 1 --2- 172.21.15.55:0/1906310605 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcd8415f250 0x7fcd8414ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:10.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.914+0000 7fcd8a000640 1 --2- 172.21.15.55:0/1906310605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd8415ee70 0x7fcd8414a8e0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:10.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.914+0000 7fcd8a000640 1 --2- 172.21.15.55:0/1906310605 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcd84098a10 0x7fcd8415b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:10.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.914+0000 7fcd8a000640 1 -- 172.21.15.55:0/1906310605 >> 172.21.15.55:0/1906310605 conn(0x7fcd840b21d0 msgr2=0x7fcd8415d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:10.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.914+0000 7fcd8a000640 1 -- 172.21.15.55:0/1906310605 shutdown_connections 2024-04-02T07:25:10.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:10.914+0000 7fcd8a000640 1 -- 172.21.15.55:0/1906310605 wait complete. 2024-04-02T07:25:10.937 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:25:11.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.074+0000 7fb8c9c00640 1 Processor -- start 2024-04-02T07:25:11.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.074+0000 7fb8c9c00640 1 -- start start 2024-04-02T07:25:11.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.074+0000 7fb8c9c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8c4153ea0 0x7fb8c40c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:11.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.074+0000 7fb8c9c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c413d0c0 con 0x7fb8c415a070 2024-04-02T07:25:11.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.074+0000 7fb8c9c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8c415a4f0 con 0x7fb8c4159be0 2024-04-02T07:25:11.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.074+0000 7fb8c9c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8c415a7d0 con 0x7fb8c4153ea0 2024-04-02T07:25:11.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.078+0000 7fb8c2a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb8c4153ea0 0x7fb8c40c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:11.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.078+0000 7fb8c3400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb8c415a070 0x7fb8c413d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52522/0 (socket says 172.21.15.55:52522) 2024-04-02T07:25:11.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.078+0000 7fb8c3400640 1 -- 172.21.15.55:0/1136521462 learned_addr learned my addr 172.21.15.55:0/1136521462 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:11.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.078+0000 7fb8c2000640 1 -- 172.21.15.55:0/1136521462 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 983050071 0 0) 0x7fb8c413d0c0 con 0x7fb8c415a070 2024-04-02T07:25:11.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.078+0000 7fb8c2a00640 1 -- 172.21.15.55:0/1136521462 >> v1:172.21.15.106:6789/0 conn(0x7fb8c4159be0 legacy=0x7fb8c40b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:11.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.078+0000 7fb8c2a00640 1 -- 172.21.15.55:0/1136521462 >> v1:172.21.15.55:6789/0 conn(0x7fb8c415a070 legacy=0x7fb8c413d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:11.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.078+0000 7fb8c2a00640 1 -- 172.21.15.55:0/1136521462 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8c415aab0 con 0x7fb8c4153ea0 2024-04-02T07:25:11.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.078+0000 7fb8c2a00640 1 --2- 172.21.15.55:0/1136521462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8c4153ea0 0x7fb8c40c4120 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40097c0 tx=0x7fb8b401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=927c9784998efb9a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:11.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.078+0000 7fb8c2000640 1 -- 172.21.15.55:0/1136521462 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b40aa620 con 0x7fb8c4153ea0 2024-04-02T07:25:11.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.078+0000 7fb8c2000640 1 -- 172.21.15.55:0/1136521462 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8b40aa780 con 0x7fb8c4153ea0 2024-04-02T07:25:11.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.078+0000 7fb8c2000640 1 -- 172.21.15.55:0/1136521462 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8b40aab10 con 0x7fb8c4153ea0 2024-04-02T07:25:11.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c9c00640 1 -- 172.21.15.55:0/1136521462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8c4153ea0 msgr2=0x7fb8c40c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:11.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c9c00640 1 --2- 172.21.15.55:0/1136521462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8c4153ea0 0x7fb8c40c4120 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40097c0 tx=0x7fb8b401c4a0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c9c00640 1 -- 172.21.15.55:0/1136521462 shutdown_connections 2024-04-02T07:25:11.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c9c00640 1 --2- 172.21.15.55:0/1136521462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8c4153ea0 0x7fb8c40c4120 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c9c00640 1 -- 172.21.15.55:0/1136521462 >> 172.21.15.55:0/1136521462 conn(0x7fb8c4066080 msgr2=0x7fb8c4069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:11.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c9c00640 1 -- 172.21.15.55:0/1136521462 shutdown_connections 2024-04-02T07:25:11.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c9c00640 1 -- 172.21.15.55:0/1136521462 wait complete. 2024-04-02T07:25:11.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c9c00640 1 Processor -- start 2024-04-02T07:25:11.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c9c00640 1 -- start start 2024-04-02T07:25:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c9c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8c4153ea0 0x7fb8c415c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c9c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8c4159be0 0x7fb8c41523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c9c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8c415a070 0x7fb8c4152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c9c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c40ce4b0 con 0x7fb8c415a070 2024-04-02T07:25:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c9c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c415cd50 con 0x7fb8c4153ea0 2024-04-02T07:25:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c9c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8c4071fa0 con 0x7fb8c4159be0 2024-04-02T07:25:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c3400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8c415a070 0x7fb8c4152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c3400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8c415a070 0x7fb8c4152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54356/0 (socket says 172.21.15.55:54356) 2024-04-02T07:25:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c3400640 1 -- 172.21.15.55:0/4123226579 learned_addr learned my addr 172.21.15.55:0/4123226579 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:11.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c2a00640 1 --2- 172.21.15.55:0/4123226579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8c4153ea0 0x7fb8c415c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:11.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8ba000640 1 --2- 172.21.15.55:0/4123226579 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8c4159be0 0x7fb8c41523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:11.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c3400640 1 -- 172.21.15.55:0/4123226579 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8c4159be0 msgr2=0x7fb8c41523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:11.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c3400640 1 --2- 172.21.15.55:0/4123226579 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8c4159be0 0x7fb8c41523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c3400640 1 -- 172.21.15.55:0/4123226579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8c4153ea0 msgr2=0x7fb8c415c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:11.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c3400640 1 --2- 172.21.15.55:0/4123226579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8c4153ea0 0x7fb8c415c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8c3400640 1 -- 172.21.15.55:0/4123226579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8b4009420 con 0x7fb8c415a070 2024-04-02T07:25:11.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.082+0000 7fb8ba000640 1 --2- 172.21.15.55:0/4123226579 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8c4159be0 0x7fb8c41523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:25:11.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.086+0000 7fb8c3400640 1 --2- 172.21.15.55:0/4123226579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8c415a070 0x7fb8c4152bb0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00c3f0 tx=0x7fb8bc00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:11.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.086+0000 7fb8bb400640 1 -- 172.21.15.55:0/4123226579 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc0074e0 con 0x7fb8c415a070 2024-04-02T07:25:11.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.086+0000 7fb8bb400640 1 -- 172.21.15.55:0/4123226579 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8bc007640 con 0x7fb8c415a070 2024-04-02T07:25:11.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.086+0000 7fb8bb400640 1 -- 172.21.15.55:0/4123226579 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc004a30 con 0x7fb8c415a070 2024-04-02T07:25:11.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.086+0000 7fb8c9c00640 1 -- 172.21.15.55:0/4123226579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c4071cc0 con 0x7fb8c415a070 2024-04-02T07:25:11.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.086+0000 7fb8c9c00640 1 -- 172.21.15.55:0/4123226579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8c4152930 con 0x7fb8c415a070 2024-04-02T07:25:11.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.086+0000 7fb8c9c00640 1 -- 172.21.15.55:0/4123226579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c40c59d0 con 0x7fb8c415a070 2024-04-02T07:25:11.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.086+0000 7fb8bb400640 1 -- 172.21.15.55:0/4123226579 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb8bc004b90 con 0x7fb8c415a070 2024-04-02T07:25:11.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.086+0000 7fb8bb400640 1 --2- 172.21.15.55:0/4123226579 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb8a00666c0 0x7fb8a0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:11.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.086+0000 7fb8bb400640 1 -- 172.21.15.55:0/4123226579 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb8bc083be0 con 0x7fb8c415a070 2024-04-02T07:25:11.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.086+0000 7fb8c2a00640 1 --2- 172.21.15.55:0/4123226579 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb8a00666c0 0x7fb8a0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:11.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.090+0000 7fb8c2a00640 1 --2- 172.21.15.55:0/4123226579 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb8a00666c0 0x7fb8a0068b80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40ae000 tx=0x7fb8b40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:11.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.090+0000 7fb8bb400640 1 -- 172.21.15.55:0/4123226579 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fb8c40c59d0 con 0x7fb8c415a070 2024-04-02T07:25:11.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.254+0000 7fb8c9c00640 1 -- 172.21.15.55:0/4123226579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb8c40c59d0 con 0x7fb8c415a070 2024-04-02T07:25:11.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.254+0000 7fb8bb400640 1 -- 172.21.15.55:0/4123226579 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v56) v1 ==== 74+0+12389 (secure 0 0 0) 0x7fb8c40c59d0 con 0x7fb8c415a070 2024-04-02T07:25:11.258 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:11.258 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":56,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:25:10.505242+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":44,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:25:11.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.258+0000 7fb8c9c00640 1 -- 172.21.15.55:0/4123226579 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb8a00666c0 msgr2=0x7fb8a0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:11.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.258+0000 7fb8c9c00640 1 --2- 172.21.15.55:0/4123226579 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb8a00666c0 0x7fb8a0068b80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb8b40ae000 tx=0x7fb8b40a7000 comp rx=0 tx=0).stop 2024-04-02T07:25:11.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.258+0000 7fb8c9c00640 1 -- 172.21.15.55:0/4123226579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8c415a070 msgr2=0x7fb8c4152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:11.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.258+0000 7fb8c9c00640 1 --2- 172.21.15.55:0/4123226579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8c415a070 0x7fb8c4152bb0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00c3f0 tx=0x7fb8bc00c8b0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.258+0000 7fb8c9c00640 1 -- 172.21.15.55:0/4123226579 shutdown_connections 2024-04-02T07:25:11.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.258+0000 7fb8c9c00640 1 --2- 172.21.15.55:0/4123226579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb8c415a070 0x7fb8c4152bb0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.258+0000 7fb8c9c00640 1 --2- 172.21.15.55:0/4123226579 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8c4159be0 0x7fb8c41523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.258+0000 7fb8c9c00640 1 --2- 172.21.15.55:0/4123226579 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb8a00666c0 0x7fb8a0068b80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.258+0000 7fb8c9c00640 1 --2- 172.21.15.55:0/4123226579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb8c4153ea0 0x7fb8c415c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.258+0000 7fb8c9c00640 1 -- 172.21.15.55:0/4123226579 >> 172.21.15.55:0/4123226579 conn(0x7fb8c4066080 msgr2=0x7fb8c40b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:11.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.258+0000 7fb8c9c00640 1 -- 172.21.15.55:0/4123226579 shutdown_connections 2024-04-02T07:25:11.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.258+0000 7fb8c9c00640 1 -- 172.21.15.55:0/4123226579 wait complete. 2024-04-02T07:25:11.279 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:25:11.279 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:25:11.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.418+0000 7f88e7800640 1 Processor -- start 2024-04-02T07:25:11.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.418+0000 7f88e7800640 1 -- start start 2024-04-02T07:25:11.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.422+0000 7f88e7800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e0098a10 0x7f88e0098df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:11.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.422+0000 7f88e7800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f88e015f650 0x7f88e015fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:11.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.422+0000 7f88e7800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88e00cec60 con 0x7f88e015dc80 2024-04-02T07:25:11.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.422+0000 7f88e7800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88e00d0100 con 0x7f88e015f650 2024-04-02T07:25:11.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.422+0000 7f88e7800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e015d2c0 con 0x7f88e0098a10 2024-04-02T07:25:11.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.422+0000 7f88e5800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f88e015f650 0x7f88e015fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:11.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.422+0000 7f88e5800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f88e015f650 0x7f88e015fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54366/0 (socket says 172.21.15.55:54366) 2024-04-02T07:25:11.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.422+0000 7f88dfe00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f88e015dc80 0x7f88e006aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52528/0 (socket says 172.21.15.55:52528) 2024-04-02T07:25:11.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.422+0000 7f88e5800640 1 -- 172.21.15.55:0/1790060474 learned_addr learned my addr 172.21.15.55:0/1790060474 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:11.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.422+0000 7f88e4e00640 1 --2- 172.21.15.55:0/1790060474 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e0098a10 0x7f88e0098df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:11.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.422+0000 7f88e5800640 1 -- 172.21.15.55:0/1790060474 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e0098a10 msgr2=0x7f88e0098df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:11.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.422+0000 7f88e5800640 1 --2- 172.21.15.55:0/1790060474 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e0098a10 0x7f88e0098df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.422+0000 7f88e5800640 1 -- 172.21.15.55:0/1790060474 >> v1:172.21.15.55:6789/0 conn(0x7f88e015dc80 legacy=0x7f88e006aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:11.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.422+0000 7f88e5800640 1 -- 172.21.15.55:0/1790060474 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88e0099330 con 0x7f88e015f650 2024-04-02T07:25:11.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.422+0000 7f88e4e00640 1 --2- 172.21.15.55:0/1790060474 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e0098a10 0x7f88e0098df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:11.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88e5800640 1 --2- 172.21.15.55:0/1790060474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88e015f650 0x7f88e015fb00 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f88d8009e50 tx=0x7f88d801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a5ecc74a2075586 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:11.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88df400640 1 -- 172.21.15.55:0/1790060474 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d80a58a0 con 0x7f88e015f650 2024-04-02T07:25:11.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88df400640 1 -- 172.21.15.55:0/1790060474 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88d80a5a00 con 0x7f88e015f650 2024-04-02T07:25:11.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88df400640 1 -- 172.21.15.55:0/1790060474 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88d80a5d90 con 0x7f88e015f650 2024-04-02T07:25:11.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88e7800640 1 -- 172.21.15.55:0/1790060474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88e015f650 msgr2=0x7f88e015fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:11.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88e7800640 1 --2- 172.21.15.55:0/1790060474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88e015f650 0x7f88e015fb00 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f88d8009e50 tx=0x7f88d801c9e0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88e7800640 1 -- 172.21.15.55:0/1790060474 shutdown_connections 2024-04-02T07:25:11.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88e7800640 1 --2- 172.21.15.55:0/1790060474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88e015f650 0x7f88e015fb00 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88e7800640 1 --2- 172.21.15.55:0/1790060474 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e0098a10 0x7f88e0098df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88e7800640 1 -- 172.21.15.55:0/1790060474 >> 172.21.15.55:0/1790060474 conn(0x7f88e00b21d0 msgr2=0x7f88e00b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:11.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88e7800640 1 -- 172.21.15.55:0/1790060474 shutdown_connections 2024-04-02T07:25:11.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88e7800640 1 -- 172.21.15.55:0/1790060474 wait complete. 2024-04-02T07:25:11.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88e7800640 1 Processor -- start 2024-04-02T07:25:11.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88e7800640 1 -- start start 2024-04-02T07:25:11.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88e7800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88e0098a10 0x7f88e015c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:11.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88e7800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88e015f650 0x7f88e0154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:11.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88e7800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e00b0d80 0x7f88e00b1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:11.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88e7800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00b1750 con 0x7f88e015f650 2024-04-02T07:25:11.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88e7800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00c4210 con 0x7f88e0098a10 2024-04-02T07:25:11.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88e7800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88e00c44f0 con 0x7f88e00b0d80 2024-04-02T07:25:11.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88dfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88e015f650 0x7f88e0154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:11.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88dfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88e015f650 0x7f88e0154480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54368/0 (socket says 172.21.15.55:54368) 2024-04-02T07:25:11.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.426+0000 7f88dfe00640 1 -- 172.21.15.55:0/1490682770 learned_addr learned my addr 172.21.15.55:0/1490682770 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:11.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.430+0000 7f88e4e00640 1 --2- 172.21.15.55:0/1490682770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88e0098a10 0x7f88e015c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:11.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.430+0000 7f88e5800640 1 --2- 172.21.15.55:0/1490682770 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e00b0d80 0x7f88e00b1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:11.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.430+0000 7f88dfe00640 1 -- 172.21.15.55:0/1490682770 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e00b0d80 msgr2=0x7f88e00b1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:11.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.430+0000 7f88dfe00640 1 --2- 172.21.15.55:0/1490682770 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e00b0d80 0x7f88e00b1210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.430+0000 7f88dfe00640 1 -- 172.21.15.55:0/1490682770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88e0098a10 msgr2=0x7f88e015c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:11.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.430+0000 7f88dfe00640 1 --2- 172.21.15.55:0/1490682770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88e0098a10 0x7f88e015c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.430+0000 7f88dfe00640 1 -- 172.21.15.55:0/1490682770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d8009b30 con 0x7f88e015f650 2024-04-02T07:25:11.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.430+0000 7f88e4e00640 1 --2- 172.21.15.55:0/1490682770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88e0098a10 0x7f88e015c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:25:11.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.430+0000 7f88e5800640 1 --2- 172.21.15.55:0/1490682770 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e00b0d80 0x7f88e00b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:25:11.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.430+0000 7f88dfe00640 1 --2- 172.21.15.55:0/1490682770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88e015f650 0x7f88e0154480 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00c490 tx=0x7f88cc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:11.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.430+0000 7f88dcc00640 1 -- 172.21.15.55:0/1490682770 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc007480 con 0x7f88e015f650 2024-04-02T07:25:11.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.430+0000 7f88dcc00640 1 -- 172.21.15.55:0/1490682770 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88cc0075e0 con 0x7f88e015f650 2024-04-02T07:25:11.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.430+0000 7f88dcc00640 1 -- 172.21.15.55:0/1490682770 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88cc004a10 con 0x7f88e015f650 2024-04-02T07:25:11.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.430+0000 7f88e7800640 1 -- 172.21.15.55:0/1490682770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88e00b4f60 con 0x7f88e015f650 2024-04-02T07:25:11.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.430+0000 7f88e7800640 1 -- 172.21.15.55:0/1490682770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88e00b5520 con 0x7f88e015f650 2024-04-02T07:25:11.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.430+0000 7f88e7800640 1 -- 172.21.15.55:0/1490682770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e00c46a0 con 0x7f88e015f650 2024-04-02T07:25:11.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.430+0000 7f88dcc00640 1 -- 172.21.15.55:0/1490682770 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f88cc004b70 con 0x7f88e015f650 2024-04-02T07:25:11.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.430+0000 7f88dcc00640 1 --2- 172.21.15.55:0/1490682770 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f88c0066690 0x7f88c0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:11.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.430+0000 7f88dcc00640 1 -- 172.21.15.55:0/1490682770 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f88cc083060 con 0x7f88e015f650 2024-04-02T07:25:11.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.430+0000 7f88e4e00640 1 --2- 172.21.15.55:0/1490682770 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f88c0066690 0x7f88c0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:11.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.434+0000 7f88e4e00640 1 --2- 172.21.15.55:0/1490682770 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f88c0066690 0x7f88c0068b50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f88d40097a0 tx=0x7f88d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:11.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.434+0000 7f88dcc00640 1 -- 172.21.15.55:0/1490682770 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f88cc0b4980 con 0x7f88e015f650 2024-04-02T07:25:11.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.598+0000 7f88e7800640 1 -- 172.21.15.55:0/1490682770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f88e015fe70 con 0x7f88e015f650 2024-04-02T07:25:11.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.598+0000 7f88dcc00640 1 -- 172.21.15.55:0/1490682770 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v56) v1 ==== 93+0+10 (secure 0 0 0) 0x7f88cc018020 con 0x7f88e015f650 2024-04-02T07:25:11.602 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:25:11.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.602+0000 7f88e7800640 1 -- 172.21.15.55:0/1490682770 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f88c0066690 msgr2=0x7f88c0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:11.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.602+0000 7f88e7800640 1 --2- 172.21.15.55:0/1490682770 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f88c0066690 0x7f88c0068b50 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f88d40097a0 tx=0x7f88d4008040 comp rx=0 tx=0).stop 2024-04-02T07:25:11.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.602+0000 7f88e7800640 1 -- 172.21.15.55:0/1490682770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88e015f650 msgr2=0x7f88e0154480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:11.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.602+0000 7f88e7800640 1 --2- 172.21.15.55:0/1490682770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88e015f650 0x7f88e0154480 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f88cc00c490 tx=0x7f88cc00c950 comp rx=0 tx=0).stop 2024-04-02T07:25:11.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.602+0000 7f88e7800640 1 -- 172.21.15.55:0/1490682770 shutdown_connections 2024-04-02T07:25:11.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.602+0000 7f88e7800640 1 --2- 172.21.15.55:0/1490682770 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88e00b0d80 0x7f88e00b1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.602+0000 7f88e7800640 1 --2- 172.21.15.55:0/1490682770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88e015f650 0x7f88e0154480 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.602+0000 7f88e7800640 1 --2- 172.21.15.55:0/1490682770 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f88c0066690 0x7f88c0068b50 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.602+0000 7f88e7800640 1 --2- 172.21.15.55:0/1490682770 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88e0098a10 0x7f88e015c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.602+0000 7f88e7800640 1 -- 172.21.15.55:0/1490682770 >> 172.21.15.55:0/1490682770 conn(0x7f88e00b21d0 msgr2=0x7f88e006b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:11.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.602+0000 7f88e7800640 1 -- 172.21.15.55:0/1490682770 shutdown_connections 2024-04-02T07:25:11.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.602+0000 7f88e7800640 1 -- 172.21.15.55:0/1490682770 wait complete. 2024-04-02T07:25:11.624 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-02T07:25:11.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.762+0000 7fa6a0400640 1 Processor -- start 2024-04-02T07:25:11.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.762+0000 7fa6a0400640 1 -- start start 2024-04-02T07:25:11.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.762+0000 7fa6a0400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa69815ca70 0x7fa6980b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:11.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.762+0000 7fa6a0400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa69806b700 0x7fa698098ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:11.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.762+0000 7fa6a0400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa69815ce50 con 0x7fa698098a10 2024-04-02T07:25:11.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.762+0000 7fa6a0400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6980993e0 con 0x7fa69815ca70 2024-04-02T07:25:11.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.762+0000 7fa6a0400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6980cef60 con 0x7fa69806b700 2024-04-02T07:25:11.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.762+0000 7fa69da00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa69815ca70 0x7fa6980b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:11.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.762+0000 7fa69da00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa69815ca70 0x7fa6980b0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54388/0 (socket says 172.21.15.55:54388) 2024-04-02T07:25:11.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.762+0000 7fa69da00640 1 -- 172.21.15.55:0/1522879771 learned_addr learned my addr 172.21.15.55:0/1522879771 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:11.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.762+0000 7fa69d000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa698098a10 0x7fa69806aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52530/0 (socket says 172.21.15.55:52530) 2024-04-02T07:25:11.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.762+0000 7fa69e400640 1 --2- 172.21.15.55:0/1522879771 >> v2:172.21.15.106:3300/0 conn(0x7fa69806b700 0x7fa698098ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:11.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.762+0000 7fa69da00640 1 -- 172.21.15.55:0/1522879771 >> v2:172.21.15.106:3300/0 conn(0x7fa69806b700 msgr2=0x7fa698098ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:11.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.762+0000 7fa69da00640 1 --2- 172.21.15.55:0/1522879771 >> v2:172.21.15.106:3300/0 conn(0x7fa69806b700 0x7fa698098ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.762+0000 7fa69da00640 1 -- 172.21.15.55:0/1522879771 >> v1:172.21.15.55:6789/0 conn(0x7fa698098a10 legacy=0x7fa69806aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:11.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.762+0000 7fa69da00640 1 -- 172.21.15.55:0/1522879771 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa69806bd60 con 0x7fa69815ca70 2024-04-02T07:25:11.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.762+0000 7fa697e00640 1 -- 172.21.15.55:0/1522879771 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 611154124 0 0) 0x7fa69815ce50 con 0x7fa698098a10 2024-04-02T07:25:11.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.766+0000 7fa69da00640 1 --2- 172.21.15.55:0/1522879771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69815ca70 0x7fa6980b0040 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa698161620 tx=0x7fa68c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d269bbe4ef760f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:11.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.766+0000 7fa697e00640 1 -- 172.21.15.55:0/1522879771 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c0ab610 con 0x7fa69815ca70 2024-04-02T07:25:11.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.766+0000 7fa697e00640 1 -- 172.21.15.55:0/1522879771 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa68c0ab770 con 0x7fa69815ca70 2024-04-02T07:25:11.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.766+0000 7fa697e00640 1 -- 172.21.15.55:0/1522879771 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa68c0abb00 con 0x7fa69815ca70 2024-04-02T07:25:11.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.766+0000 7fa6a0400640 1 -- 172.21.15.55:0/1522879771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69815ca70 msgr2=0x7fa6980b0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:11.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.766+0000 7fa6a0400640 1 --2- 172.21.15.55:0/1522879771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69815ca70 0x7fa6980b0040 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fa698161620 tx=0x7fa68c01c520 comp rx=0 tx=0).stop 2024-04-02T07:25:11.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.766+0000 7fa6a0400640 1 -- 172.21.15.55:0/1522879771 shutdown_connections 2024-04-02T07:25:11.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.766+0000 7fa6a0400640 1 --2- 172.21.15.55:0/1522879771 >> v2:172.21.15.106:3300/0 conn(0x7fa69806b700 0x7fa698098ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.766+0000 7fa6a0400640 1 --2- 172.21.15.55:0/1522879771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69815ca70 0x7fa6980b0040 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.766+0000 7fa6a0400640 1 -- 172.21.15.55:0/1522879771 >> 172.21.15.55:0/1522879771 conn(0x7fa6980b21d0 msgr2=0x7fa6980b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:11.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.766+0000 7fa6a0400640 1 -- 172.21.15.55:0/1522879771 shutdown_connections 2024-04-02T07:25:11.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.766+0000 7fa6a0400640 1 -- 172.21.15.55:0/1522879771 wait complete. 2024-04-02T07:25:11.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.766+0000 7fa6a0400640 1 Processor -- start 2024-04-02T07:25:11.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.766+0000 7fa6a0400640 1 -- start start 2024-04-02T07:25:11.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa6a0400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa69806b700 0x7fa69815e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:11.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa6a0400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa698098a10 0x7fa69815a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:11.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa6a0400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69815ca70 0x7fa69815ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:11.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa6a0400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa69815ed70 con 0x7fa69815ca70 2024-04-02T07:25:11.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa6a0400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa698157580 con 0x7fa698098a10 2024-04-02T07:25:11.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa6a0400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6980af950 con 0x7fa69806b700 2024-04-02T07:25:11.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa69e400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69815ca70 0x7fa69815ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:11.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa69e400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69815ca70 0x7fa69815ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54396/0 (socket says 172.21.15.55:54396) 2024-04-02T07:25:11.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa69e400640 1 -- 172.21.15.55:0/1544244493 learned_addr learned my addr 172.21.15.55:0/1544244493 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:11.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa69d000640 1 --2- 172.21.15.55:0/1544244493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa698098a10 0x7fa69815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:11.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa69da00640 1 --2- 172.21.15.55:0/1544244493 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa69806b700 0x7fa69815e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:11.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa69e400640 1 -- 172.21.15.55:0/1544244493 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa69806b700 msgr2=0x7fa69815e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:11.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa69e400640 1 --2- 172.21.15.55:0/1544244493 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa69806b700 0x7fa69815e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa69e400640 1 -- 172.21.15.55:0/1544244493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa698098a10 msgr2=0x7fa69815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:11.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa69e400640 1 --2- 172.21.15.55:0/1544244493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa698098a10 0x7fa69815a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa69e400640 1 -- 172.21.15.55:0/1544244493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa68c0094d0 con 0x7fa69815ca70 2024-04-02T07:25:11.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa69e400640 1 --2- 172.21.15.55:0/1544244493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69815ca70 0x7fa69815ae70 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa690007e40 tx=0x7fa69000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:11.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa695600640 1 -- 172.21.15.55:0/1544244493 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa690014620 con 0x7fa69815ca70 2024-04-02T07:25:11.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa695600640 1 -- 172.21.15.55:0/1544244493 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa69000ee90 con 0x7fa69815ca70 2024-04-02T07:25:11.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa695600640 1 -- 172.21.15.55:0/1544244493 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6900149e0 con 0x7fa69815ca70 2024-04-02T07:25:11.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa6a0400640 1 -- 172.21.15.55:0/1544244493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6981577d0 con 0x7fa69815ca70 2024-04-02T07:25:11.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa6a0400640 1 -- 172.21.15.55:0/1544244493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa698157d90 con 0x7fa69815ca70 2024-04-02T07:25:11.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.770+0000 7fa6a0400640 1 -- 172.21.15.55:0/1544244493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6980afeb0 con 0x7fa69815ca70 2024-04-02T07:25:11.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.774+0000 7fa695600640 1 -- 172.21.15.55:0/1544244493 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa690014b40 con 0x7fa69815ca70 2024-04-02T07:25:11.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.774+0000 7fa695600640 1 --2- 172.21.15.55:0/1544244493 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa678066690 0x7fa678068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:11.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.774+0000 7fa695600640 1 -- 172.21.15.55:0/1544244493 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa6900846a0 con 0x7fa69815ca70 2024-04-02T07:25:11.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.774+0000 7fa69da00640 1 --2- 172.21.15.55:0/1544244493 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa678066690 0x7fa678068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:11.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.774+0000 7fa69da00640 1 --2- 172.21.15.55:0/1544244493 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa678066690 0x7fa678068b50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0af000 tx=0x7fa68c0b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:11.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.778+0000 7fa695600640 1 -- 172.21.15.55:0/1544244493 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa690051e10 con 0x7fa69815ca70 2024-04-02T07:25:11.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.938+0000 7fa6a0400640 1 -- 172.21.15.55:0/1544244493 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa698066c90 con 0x7fa69815ca70 2024-04-02T07:25:11.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.938+0000 7fa695600640 1 -- 172.21.15.55:0/1544244493 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v56) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa690055430 con 0x7fa69815ca70 2024-04-02T07:25:11.943 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:11.943 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-02T07:25:11.943 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:11.943 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-04-02T07:25:11.943 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-04-02T07:25:11.943 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:11.943 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-02T07:25:11.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.942+0000 7fa6a0400640 1 -- 172.21.15.55:0/1544244493 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa678066690 msgr2=0x7fa678068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:11.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.942+0000 7fa6a0400640 1 --2- 172.21.15.55:0/1544244493 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa678066690 0x7fa678068b50 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0af000 tx=0x7fa68c0b6040 comp rx=0 tx=0).stop 2024-04-02T07:25:11.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.942+0000 7fa6a0400640 1 -- 172.21.15.55:0/1544244493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69815ca70 msgr2=0x7fa69815ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:11.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.942+0000 7fa6a0400640 1 --2- 172.21.15.55:0/1544244493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69815ca70 0x7fa69815ae70 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa690007e40 tx=0x7fa69000e4b0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.942+0000 7fa6a0400640 1 -- 172.21.15.55:0/1544244493 shutdown_connections 2024-04-02T07:25:11.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.942+0000 7fa6a0400640 1 --2- 172.21.15.55:0/1544244493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa69815ca70 0x7fa69815ae70 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.942+0000 7fa6a0400640 1 --2- 172.21.15.55:0/1544244493 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa678066690 0x7fa678068b50 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.942+0000 7fa6a0400640 1 --2- 172.21.15.55:0/1544244493 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa698098a10 0x7fa69815a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.942+0000 7fa6a0400640 1 --2- 172.21.15.55:0/1544244493 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa69806b700 0x7fa69815e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:11.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.942+0000 7fa6a0400640 1 -- 172.21.15.55:0/1544244493 >> 172.21.15.55:0/1544244493 conn(0x7fa6980b21d0 msgr2=0x7fa6980b13c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:11.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.942+0000 7fa6a0400640 1 -- 172.21.15.55:0/1544244493 shutdown_connections 2024-04-02T07:25:11.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:11.942+0000 7fa6a0400640 1 -- 172.21.15.55:0/1544244493 wait complete. 2024-04-02T07:25:11.963 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-02T07:25:11.964 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-02T07:25:12.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.106+0000 7fbfb7000640 1 Processor -- start 2024-04-02T07:25:12.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.106+0000 7fbfb7000640 1 -- start start 2024-04-02T07:25:12.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.106+0000 7fbfb7000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfb0099120 0x7fbfb006bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:12.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.106+0000 7fbfb7000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb00ccae0 con 0x7fbfb00cead0 2024-04-02T07:25:12.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.106+0000 7fbfb7000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb00d0300 con 0x7fbfb00cc700 2024-04-02T07:25:12.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.106+0000 7fbfb7000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb00cf260 con 0x7fbfb0099120 2024-04-02T07:25:12.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.106+0000 7fbfb5000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbfb00cead0 0x7fbfb015c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52544/0 (socket says 172.21.15.55:52544) 2024-04-02T07:25:12.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.106+0000 7fbfb5000640 1 -- 172.21.15.55:0/1862656947 learned_addr learned my addr 172.21.15.55:0/1862656947 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:12.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.106+0000 7fbfaf400640 1 --2- 172.21.15.55:0/1862656947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfb0099120 0x7fbfb006bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:12.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.106+0000 7fbfaea00640 1 -- 172.21.15.55:0/1862656947 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178731528 0 0) 0x7fbfb00ccae0 con 0x7fbfb00cead0 2024-04-02T07:25:12.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.106+0000 7fbfaea00640 1 -- 172.21.15.55:0/1862656947 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf94003530 con 0x7fbfb00cead0 2024-04-02T07:25:12.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.106+0000 7fbfaf400640 1 -- 172.21.15.55:0/1862656947 >> v1:172.21.15.106:6789/0 conn(0x7fbfb00cc700 legacy=0x7fbfb0098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:12.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.106+0000 7fbfaea00640 1 -- 172.21.15.55:0/1862656947 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1819386175 0 0) 0x7fbfb00d0300 con 0x7fbfb00cc700 2024-04-02T07:25:12.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.106+0000 7fbfaf400640 1 -- 172.21.15.55:0/1862656947 >> v1:172.21.15.55:6789/0 conn(0x7fbfb00cead0 legacy=0x7fbfb015c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:12.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.106+0000 7fbfaf400640 1 -- 172.21.15.55:0/1862656947 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb00cf540 con 0x7fbfb0099120 2024-04-02T07:25:12.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.110+0000 7fbfaf400640 1 --2- 172.21.15.55:0/1862656947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfb0099120 0x7fbfb006bfd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c0097f0 tx=0x7fbf9c01c4e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18e225246a60c53a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:12.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.110+0000 7fbfaea00640 1 -- 172.21.15.55:0/1862656947 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c0aa640 con 0x7fbfb0099120 2024-04-02T07:25:12.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.110+0000 7fbfaea00640 1 -- 172.21.15.55:0/1862656947 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c0aa7a0 con 0x7fbfb0099120 2024-04-02T07:25:12.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.110+0000 7fbfaea00640 1 -- 172.21.15.55:0/1862656947 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c0aab10 con 0x7fbfb0099120 2024-04-02T07:25:12.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.110+0000 7fbfb7000640 1 -- 172.21.15.55:0/1862656947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfb0099120 msgr2=0x7fbfb006bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:12.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.110+0000 7fbfb7000640 1 --2- 172.21.15.55:0/1862656947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfb0099120 0x7fbfb006bfd0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c0097f0 tx=0x7fbf9c01c4e0 comp rx=0 tx=0).stop 2024-04-02T07:25:12.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.110+0000 7fbfb7000640 1 -- 172.21.15.55:0/1862656947 shutdown_connections 2024-04-02T07:25:12.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.110+0000 7fbfb7000640 1 --2- 172.21.15.55:0/1862656947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfb0099120 0x7fbfb006bfd0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:12.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.110+0000 7fbfb7000640 1 -- 172.21.15.55:0/1862656947 >> 172.21.15.55:0/1862656947 conn(0x7fbfb00b2150 msgr2=0x7fbfb00b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:12.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.110+0000 7fbfb7000640 1 -- 172.21.15.55:0/1862656947 shutdown_connections 2024-04-02T07:25:12.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.110+0000 7fbfb7000640 1 -- 172.21.15.55:0/1862656947 wait complete. 2024-04-02T07:25:12.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfb7000640 1 Processor -- start 2024-04-02T07:25:12.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfb7000640 1 -- start start 2024-04-02T07:25:12.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfb7000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb0099120 0x7fbfb00c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:12.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfb7000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfb00cc700 0x7fbfb00c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:12.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfb7000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfb00cead0 0x7fbfb00c4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:12.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfb7000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb00b5ba0 con 0x7fbfb00cead0 2024-04-02T07:25:12.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfb7000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb00b5710 con 0x7fbfb0099120 2024-04-02T07:25:12.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfb7000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb00b4b00 con 0x7fbfb00cc700 2024-04-02T07:25:12.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfb5000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfb00cead0 0x7fbfb00c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:12.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfb5000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfb00cead0 0x7fbfb00c4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54410/0 (socket says 172.21.15.55:54410) 2024-04-02T07:25:12.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfb5000640 1 -- 172.21.15.55:0/2288232501 learned_addr learned my addr 172.21.15.55:0/2288232501 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:12.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfafe00640 1 --2- 172.21.15.55:0/2288232501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb0099120 0x7fbfb00c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:12.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfaf400640 1 --2- 172.21.15.55:0/2288232501 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfb00cc700 0x7fbfb00c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:12.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfb5000640 1 -- 172.21.15.55:0/2288232501 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfb00cc700 msgr2=0x7fbfb00c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:12.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfb5000640 1 --2- 172.21.15.55:0/2288232501 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfb00cc700 0x7fbfb00c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:12.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfb5000640 1 -- 172.21.15.55:0/2288232501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb0099120 msgr2=0x7fbfb00c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:12.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfb5000640 1 --2- 172.21.15.55:0/2288232501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb0099120 0x7fbfb00c7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:12.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfb5000640 1 -- 172.21.15.55:0/2288232501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c009420 con 0x7fbfb00cead0 2024-04-02T07:25:12.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfb5000640 1 --2- 172.21.15.55:0/2288232501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfb00cead0 0x7fbfb00c4140 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800caa0 tx=0x7fbfa800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:12.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfa7e00640 1 -- 172.21.15.55:0/2288232501 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa800ac00 con 0x7fbfb00cead0 2024-04-02T07:25:12.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfa7e00640 1 -- 172.21.15.55:0/2288232501 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa800ad60 con 0x7fbfb00cead0 2024-04-02T07:25:12.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfb7000640 1 -- 172.21.15.55:0/2288232501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb00b4de0 con 0x7fbfb00cead0 2024-04-02T07:25:12.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfa7e00640 1 -- 172.21.15.55:0/2288232501 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa8012620 con 0x7fbfb00cead0 2024-04-02T07:25:12.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfb7000640 1 -- 172.21.15.55:0/2288232501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb00b53a0 con 0x7fbfb00cead0 2024-04-02T07:25:12.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.114+0000 7fbfb7000640 1 -- 172.21.15.55:0/2288232501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb00b5880 con 0x7fbfb00cead0 2024-04-02T07:25:12.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.118+0000 7fbfa7e00640 1 -- 172.21.15.55:0/2288232501 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fbfa8007070 con 0x7fbfb00cead0 2024-04-02T07:25:12.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.118+0000 7fbfa7e00640 1 --2- 172.21.15.55:0/2288232501 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbf900666c0 0x7fbf90068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:12.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.118+0000 7fbfa7e00640 1 -- 172.21.15.55:0/2288232501 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbfa8083d80 con 0x7fbfb00cead0 2024-04-02T07:25:12.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.118+0000 7fbfafe00640 1 --2- 172.21.15.55:0/2288232501 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbf900666c0 0x7fbf90068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:12.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.118+0000 7fbfafe00640 1 --2- 172.21.15.55:0/2288232501 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbf900666c0 0x7fbf90068b80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0000f70 tx=0x7fbfa0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:12.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.122+0000 7fbfa7e00640 1 -- 172.21.15.55:0/2288232501 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fbfa8051430 con 0x7fbfb00cead0 2024-04-02T07:25:12.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.282+0000 7fbfb7000640 1 -- 172.21.15.55:0/2288232501 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fbfb0066c90 con 0x7fbfb00cead0 2024-04-02T07:25:12.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.382+0000 7fbfa7e00640 1 -- 172.21.15.55:0/2288232501 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v57) v1 ==== 138+0+0 (secure 0 0 0) 0x7fbfa8054a50 con 0x7fbfb00cead0 2024-04-02T07:25:12.387 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-04-02T07:25:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.386+0000 7fbfb7000640 1 -- 172.21.15.55:0/2288232501 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbf900666c0 msgr2=0x7fbf90068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.386+0000 7fbfb7000640 1 --2- 172.21.15.55:0/2288232501 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbf900666c0 0x7fbf90068b80 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbfa0000f70 tx=0x7fbfa0009040 comp rx=0 tx=0).stop 2024-04-02T07:25:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.386+0000 7fbfb7000640 1 -- 172.21.15.55:0/2288232501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfb00cead0 msgr2=0x7fbfb00c4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.386+0000 7fbfb7000640 1 --2- 172.21.15.55:0/2288232501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfb00cead0 0x7fbfb00c4140 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7fbfa800caa0 tx=0x7fbfa800cf60 comp rx=0 tx=0).stop 2024-04-02T07:25:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.386+0000 7fbfb7000640 1 -- 172.21.15.55:0/2288232501 shutdown_connections 2024-04-02T07:25:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.386+0000 7fbfb7000640 1 --2- 172.21.15.55:0/2288232501 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfb00cead0 0x7fbfb00c4140 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.386+0000 7fbfb7000640 1 --2- 172.21.15.55:0/2288232501 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfb00cc700 0x7fbfb00c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.386+0000 7fbfb7000640 1 --2- 172.21.15.55:0/2288232501 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbf900666c0 0x7fbf90068b80 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.386+0000 7fbfb7000640 1 --2- 172.21.15.55:0/2288232501 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb0099120 0x7fbfb00c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.386+0000 7fbfb7000640 1 -- 172.21.15.55:0/2288232501 >> 172.21.15.55:0/2288232501 conn(0x7fbfb00b2150 msgr2=0x7fbfb006f150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:12.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.386+0000 7fbfb7000640 1 -- 172.21.15.55:0/2288232501 shutdown_connections 2024-04-02T07:25:12.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.386+0000 7fbfb7000640 1 -- 172.21.15.55:0/2288232501 wait complete. 2024-04-02T07:25:12.413 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-02T07:25:12.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.558+0000 7f0bc8e00640 1 Processor -- start 2024-04-02T07:25:12.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.558+0000 7f0bc8e00640 1 -- start start 2024-04-02T07:25:12.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.558+0000 7f0bc8e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0bc40d0010 0x7f0bc40cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:12.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.558+0000 7f0bc8e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc40cf260 con 0x7f0bc40b0aa0 2024-04-02T07:25:12.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.558+0000 7f0bc8e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bc40c9d70 con 0x7f0bc415cd50 2024-04-02T07:25:12.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.558+0000 7f0bc8e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc40cea40 con 0x7f0bc40d0010 2024-04-02T07:25:12.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.558+0000 7f0bb9400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0bc40b0aa0 0x7f0bc40ca200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52548/0 (socket says 172.21.15.55:52548) 2024-04-02T07:25:12.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.558+0000 7f0bb9400640 1 -- 172.21.15.55:0/2621023860 learned_addr learned my addr 172.21.15.55:0/2621023860 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:12.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.558+0000 7f0bc2800640 1 --2- 172.21.15.55:0/2621023860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0bc40d0010 0x7f0bc40cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:12.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.558+0000 7f0bc1400640 1 -- 172.21.15.55:0/2621023860 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815692073 0 0) 0x7f0bc40cf260 con 0x7f0bc40b0aa0 2024-04-02T07:25:12.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.558+0000 7f0bc1400640 1 -- 172.21.15.55:0/2621023860 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0ba8003530 con 0x7f0bc40b0aa0 2024-04-02T07:25:12.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.558+0000 7f0bc1400640 1 -- 172.21.15.55:0/2621023860 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 176424768 0 0) 0x7f0bc40c9d70 con 0x7f0bc415cd50 2024-04-02T07:25:12.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.558+0000 7f0bc2800640 1 -- 172.21.15.55:0/2621023860 >> v1:172.21.15.106:6789/0 conn(0x7f0bc415cd50 legacy=0x7f0bc40b0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:12.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.558+0000 7f0bc2800640 1 -- 172.21.15.55:0/2621023860 >> v1:172.21.15.55:6789/0 conn(0x7f0bc40b0aa0 legacy=0x7f0bc40ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:12.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.558+0000 7f0bc2800640 1 -- 172.21.15.55:0/2621023860 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc415d130 con 0x7f0bc40d0010 2024-04-02T07:25:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.562+0000 7f0bc2800640 1 --2- 172.21.15.55:0/2621023860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0bc40d0010 0x7f0bc40cc8c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc009dc0 tx=0x7f0bbc01c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae57e55f5fcaec21 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.562+0000 7f0bc1400640 1 -- 172.21.15.55:0/2621023860 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc0a59c0 con 0x7f0bc40d0010 2024-04-02T07:25:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.562+0000 7f0bc1400640 1 -- 172.21.15.55:0/2621023860 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bbc0a5b20 con 0x7f0bc40d0010 2024-04-02T07:25:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.562+0000 7f0bc1400640 1 -- 172.21.15.55:0/2621023860 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bbc0ad440 con 0x7f0bc40d0010 2024-04-02T07:25:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.562+0000 7f0bc8e00640 1 -- 172.21.15.55:0/2621023860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0bc40d0010 msgr2=0x7f0bc40cc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.562+0000 7f0bc8e00640 1 --2- 172.21.15.55:0/2621023860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0bc40d0010 0x7f0bc40cc8c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc009dc0 tx=0x7f0bbc01c900 comp rx=0 tx=0).stop 2024-04-02T07:25:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.562+0000 7f0bc8e00640 1 -- 172.21.15.55:0/2621023860 shutdown_connections 2024-04-02T07:25:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.562+0000 7f0bc8e00640 1 --2- 172.21.15.55:0/2621023860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0bc40d0010 0x7f0bc40cc8c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.562+0000 7f0bc8e00640 1 -- 172.21.15.55:0/2621023860 >> 172.21.15.55:0/2621023860 conn(0x7f0bc4098a10 msgr2=0x7f0bc40cf560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.562+0000 7f0bc8e00640 1 -- 172.21.15.55:0/2621023860 shutdown_connections 2024-04-02T07:25:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.562+0000 7f0bc8e00640 1 -- 172.21.15.55:0/2621023860 wait complete. 2024-04-02T07:25:12.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bc8e00640 1 Processor -- start 2024-04-02T07:25:12.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bc8e00640 1 -- start start 2024-04-02T07:25:12.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bc8e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0bc40b0aa0 0x7f0bc4159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:12.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bc8e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc40d0010 0x7f0bc4152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:12.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bc8e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bc415cd50 0x7f0bc41528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:12.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bc8e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc40c8f60 con 0x7f0bc40d0010 2024-04-02T07:25:12.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bc8e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc4151ca0 con 0x7f0bc415cd50 2024-04-02T07:25:12.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bc8e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bc4149a60 con 0x7f0bc40b0aa0 2024-04-02T07:25:12.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bb9400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc40d0010 0x7f0bc4152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:12.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bb9400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc40d0010 0x7f0bc4152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54412/0 (socket says 172.21.15.55:54412) 2024-04-02T07:25:12.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bb9400640 1 -- 172.21.15.55:0/1465738613 learned_addr learned my addr 172.21.15.55:0/1465738613 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:12.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bc2800640 1 --2- 172.21.15.55:0/1465738613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bc415cd50 0x7f0bc41528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:12.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bc1e00640 1 --2- 172.21.15.55:0/1465738613 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0bc40b0aa0 0x7f0bc4159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:12.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bb9400640 1 -- 172.21.15.55:0/1465738613 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0bc40b0aa0 msgr2=0x7f0bc4159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:12.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bb9400640 1 --2- 172.21.15.55:0/1465738613 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0bc40b0aa0 0x7f0bc4159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:12.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bb9400640 1 -- 172.21.15.55:0/1465738613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bc415cd50 msgr2=0x7f0bc41528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:12.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bb9400640 1 --2- 172.21.15.55:0/1465738613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bc415cd50 0x7f0bc41528b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:12.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bb9400640 1 -- 172.21.15.55:0/1465738613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc009a70 con 0x7f0bc40d0010 2024-04-02T07:25:12.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bb9400640 1 --2- 172.21.15.55:0/1465738613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc40d0010 0x7f0bc4152370 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00c3f0 tx=0x7f0bac00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:12.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bbaa00640 1 -- 172.21.15.55:0/1465738613 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac005cf0 con 0x7f0bc40d0010 2024-04-02T07:25:12.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bbaa00640 1 -- 172.21.15.55:0/1465738613 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bac005e50 con 0x7f0bc40d0010 2024-04-02T07:25:12.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bbaa00640 1 -- 172.21.15.55:0/1465738613 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bac0072f0 con 0x7f0bc40d0010 2024-04-02T07:25:12.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bc8e00640 1 -- 172.21.15.55:0/1465738613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bc415a160 con 0x7f0bc40d0010 2024-04-02T07:25:12.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.566+0000 7f0bc8e00640 1 -- 172.21.15.55:0/1465738613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc4149410 con 0x7f0bc40d0010 2024-04-02T07:25:12.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.570+0000 7f0bc8e00640 1 -- 172.21.15.55:0/1465738613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bc4066c90 con 0x7f0bc40d0010 2024-04-02T07:25:12.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.570+0000 7f0bbaa00640 1 -- 172.21.15.55:0/1465738613 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f0bac007450 con 0x7f0bc40d0010 2024-04-02T07:25:12.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.570+0000 7f0bbaa00640 1 --2- 172.21.15.55:0/1465738613 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ba0066690 0x7f0ba0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:12.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.570+0000 7f0bbaa00640 1 -- 172.21.15.55:0/1465738613 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(57..57 src has 1..57) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f0bac083620 con 0x7f0bc40d0010 2024-04-02T07:25:12.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.570+0000 7f0bc1e00640 1 --2- 172.21.15.55:0/1465738613 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ba0066690 0x7f0ba0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:12.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.570+0000 7f0bc1e00640 1 --2- 172.21.15.55:0/1465738613 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ba0066690 0x7f0ba0068b50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4000f70 tx=0x7f0bb4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:12.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.574+0000 7f0bbaa00640 1 -- 172.21.15.55:0/1465738613 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0bac050ad0 con 0x7f0bc40d0010 2024-04-02T07:25:12.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:12.738+0000 7f0bc8e00640 1 -- 172.21.15.55:0/1465738613 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f0bc406e940 con 0x7f0bc40d0010 2024-04-02T07:25:13.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.394+0000 7f0bbaa00640 1 -- 172.21.15.55:0/1465738613 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v58) v1 ==== 170+0+0 (secure 0 0 0) 0x7f0bac0170d0 con 0x7f0bc40d0010 2024-04-02T07:25:13.399 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-04-02T07:25:13.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.406+0000 7f0bc8e00640 1 -- 172.21.15.55:0/1465738613 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ba0066690 msgr2=0x7f0ba0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:13.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.406+0000 7f0bc8e00640 1 --2- 172.21.15.55:0/1465738613 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ba0066690 0x7f0ba0068b50 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4000f70 tx=0x7f0bb4009040 comp rx=0 tx=0).stop 2024-04-02T07:25:13.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.406+0000 7f0bc8e00640 1 -- 172.21.15.55:0/1465738613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc40d0010 msgr2=0x7f0bc4152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:13.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.406+0000 7f0bc8e00640 1 --2- 172.21.15.55:0/1465738613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc40d0010 0x7f0bc4152370 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0bac00c3f0 tx=0x7f0bac00c8b0 comp rx=0 tx=0).stop 2024-04-02T07:25:13.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.406+0000 7f0bc8e00640 1 -- 172.21.15.55:0/1465738613 shutdown_connections 2024-04-02T07:25:13.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.406+0000 7f0bc8e00640 1 --2- 172.21.15.55:0/1465738613 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ba0066690 0x7f0ba0068b50 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:13.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.406+0000 7f0bc8e00640 1 --2- 172.21.15.55:0/1465738613 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0bc415cd50 0x7f0bc41528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:13.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.406+0000 7f0bc8e00640 1 --2- 172.21.15.55:0/1465738613 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0bc40d0010 0x7f0bc4152370 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:13.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.406+0000 7f0bc8e00640 1 --2- 172.21.15.55:0/1465738613 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0bc40b0aa0 0x7f0bc4159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:13.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.406+0000 7f0bc8e00640 1 -- 172.21.15.55:0/1465738613 >> 172.21.15.55:0/1465738613 conn(0x7f0bc4098a10 msgr2=0x7f0bc4155610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:13.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.410+0000 7f0bc8e00640 1 -- 172.21.15.55:0/1465738613 shutdown_connections 2024-04-02T07:25:13.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.410+0000 7f0bc8e00640 1 -- 172.21.15.55:0/1465738613 wait complete. 2024-04-02T07:25:13.445 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-02T07:25:13.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.590+0000 7f4d8f200640 1 Processor -- start 2024-04-02T07:25:13.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.590+0000 7f4d8f200640 1 -- start start 2024-04-02T07:25:13.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.590+0000 7f4d8f200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d900cbc20 0x7f4d90098ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:13.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.590+0000 7f4d8f200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d90099a70 con 0x7f4d90098a10 2024-04-02T07:25:13.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.590+0000 7f4d8f200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d9006bc90 con 0x7f4d900cc880 2024-04-02T07:25:13.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.590+0000 7f4d8f200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d900993e0 con 0x7f4d900cbc20 2024-04-02T07:25:13.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.590+0000 7f4d85400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4d90098a10 0x7f4d9015c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52564/0 (socket says 172.21.15.55:52564) 2024-04-02T07:25:13.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.590+0000 7f4d85400640 1 -- 172.21.15.55:0/3206323267 learned_addr learned my addr 172.21.15.55:0/3206323267 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:13.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.590+0000 7f4d8e800640 1 --2- 172.21.15.55:0/3206323267 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d900cbc20 0x7f4d90098ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:13.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.590+0000 7f4d8d400640 1 -- 172.21.15.55:0/3206323267 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2755285756 0 0) 0x7f4d90099a70 con 0x7f4d90098a10 2024-04-02T07:25:13.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.590+0000 7f4d8d400640 1 -- 172.21.15.55:0/3206323267 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d74003530 con 0x7f4d90098a10 2024-04-02T07:25:13.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.590+0000 7f4d8d400640 1 -- 172.21.15.55:0/3206323267 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1416255381 0 0) 0x7f4d9006bc90 con 0x7f4d900cc880 2024-04-02T07:25:13.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.590+0000 7f4d8d400640 1 -- 172.21.15.55:0/3206323267 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d90099a70 con 0x7f4d900cc880 2024-04-02T07:25:13.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.590+0000 7f4d8e800640 1 -- 172.21.15.55:0/3206323267 >> v1:172.21.15.106:6789/0 conn(0x7f4d900cc880 legacy=0x7f4d9006b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:13.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.590+0000 7f4d8e800640 1 -- 172.21.15.55:0/3206323267 >> v1:172.21.15.55:6789/0 conn(0x7f4d90098a10 legacy=0x7f4d9015c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:13.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.590+0000 7f4d8d400640 1 -- 172.21.15.55:0/3206323267 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3799050714 0 0) 0x7f4d74003530 con 0x7f4d90098a10 2024-04-02T07:25:13.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.590+0000 7f4d8e800640 1 -- 172.21.15.55:0/3206323267 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9006bf70 con 0x7f4d900cbc20 2024-04-02T07:25:13.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.594+0000 7f4d8e800640 1 --2- 172.21.15.55:0/3206323267 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d900cbc20 0x7f4d90098ea0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4d88009dc0 tx=0x7f4d8801c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6851ca190210e97a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:13.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.594+0000 7f4d8d400640 1 -- 172.21.15.55:0/3206323267 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78001680 con 0x7f4d900cbc20 2024-04-02T07:25:13.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.594+0000 7f4d8d400640 1 -- 172.21.15.55:0/3206323267 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d880a56c0 con 0x7f4d900cbc20 2024-04-02T07:25:13.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.594+0000 7f4d8d400640 1 -- 172.21.15.55:0/3206323267 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d880a5a50 con 0x7f4d900cbc20 2024-04-02T07:25:13.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.594+0000 7f4d8f200640 1 -- 172.21.15.55:0/3206323267 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d900cbc20 msgr2=0x7f4d90098ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:13.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.594+0000 7f4d8f200640 1 --2- 172.21.15.55:0/3206323267 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d900cbc20 0x7f4d90098ea0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4d88009dc0 tx=0x7f4d8801c880 comp rx=0 tx=0).stop 2024-04-02T07:25:13.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.594+0000 7f4d8f200640 1 -- 172.21.15.55:0/3206323267 shutdown_connections 2024-04-02T07:25:13.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.594+0000 7f4d8f200640 1 --2- 172.21.15.55:0/3206323267 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d900cbc20 0x7f4d90098ea0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:13.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.594+0000 7f4d8f200640 1 -- 172.21.15.55:0/3206323267 >> 172.21.15.55:0/3206323267 conn(0x7f4d900b1fb0 msgr2=0x7f4d900b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:13.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.594+0000 7f4d8f200640 1 -- 172.21.15.55:0/3206323267 shutdown_connections 2024-04-02T07:25:13.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.594+0000 7f4d8f200640 1 -- 172.21.15.55:0/3206323267 wait complete. 2024-04-02T07:25:13.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.594+0000 7f4d8f200640 1 Processor -- start 2024-04-02T07:25:13.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d8f200640 1 -- start start 2024-04-02T07:25:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d8f200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d90098a10 0x7f4d9014a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d8f200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d900cbc20 0x7f4d90154940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d8f200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d900cc880 0x7f4d900c3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d8f200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d90152980 con 0x7f4d900cbc20 2024-04-02T07:25:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d8f200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d900ca690 con 0x7f4d900cc880 2024-04-02T07:25:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d8f200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d900ca3b0 con 0x7f4d90098a10 2024-04-02T07:25:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d85400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d900cbc20 0x7f4d90154940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d85400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d900cbc20 0x7f4d90154940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54430/0 (socket says 172.21.15.55:54430) 2024-04-02T07:25:13.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d85400640 1 -- 172.21.15.55:0/4200801396 learned_addr learned my addr 172.21.15.55:0/4200801396 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:13.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d8de00640 1 --2- 172.21.15.55:0/4200801396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d90098a10 0x7f4d9014a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:13.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d8e800640 1 --2- 172.21.15.55:0/4200801396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d900cc880 0x7f4d900c3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:13.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d85400640 1 -- 172.21.15.55:0/4200801396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d90098a10 msgr2=0x7f4d9014a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:13.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d85400640 1 --2- 172.21.15.55:0/4200801396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d90098a10 0x7f4d9014a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:13.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d85400640 1 -- 172.21.15.55:0/4200801396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d900cc880 msgr2=0x7f4d900c3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:13.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d85400640 1 --2- 172.21.15.55:0/4200801396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d900cc880 0x7f4d900c3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:13.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d85400640 1 -- 172.21.15.55:0/4200801396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d88009a70 con 0x7f4d900cbc20 2024-04-02T07:25:13.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d85400640 1 --2- 172.21.15.55:0/4200801396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d900cbc20 0x7f4d90154940 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800c780 tx=0x7f4d7800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:13.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d86a00640 1 -- 172.21.15.55:0/4200801396 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d78005cf0 con 0x7f4d900cbc20 2024-04-02T07:25:13.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d86a00640 1 -- 172.21.15.55:0/4200801396 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d78005e50 con 0x7f4d900cbc20 2024-04-02T07:25:13.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d86a00640 1 -- 172.21.15.55:0/4200801396 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d780072b0 con 0x7f4d900cbc20 2024-04-02T07:25:13.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d8f200640 1 -- 172.21.15.55:0/4200801396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d90152330 con 0x7f4d900cbc20 2024-04-02T07:25:13.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d8f200640 1 -- 172.21.15.55:0/4200801396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d900ca060 con 0x7f4d900cbc20 2024-04-02T07:25:13.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.598+0000 7f4d8f200640 1 -- 172.21.15.55:0/4200801396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d900671b0 con 0x7f4d900cbc20 2024-04-02T07:25:13.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.602+0000 7f4d86a00640 1 -- 172.21.15.55:0/4200801396 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f4d78007410 con 0x7f4d900cbc20 2024-04-02T07:25:13.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.602+0000 7f4d86a00640 1 --2- 172.21.15.55:0/4200801396 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4d6c066690 0x7f4d6c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:13.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.602+0000 7f4d86a00640 1 -- 172.21.15.55:0/4200801396 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f4d78083870 con 0x7f4d900cbc20 2024-04-02T07:25:13.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.602+0000 7f4d8de00640 1 --2- 172.21.15.55:0/4200801396 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4d6c066690 0x7f4d6c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:13.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.602+0000 7f4d8de00640 1 --2- 172.21.15.55:0/4200801396 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4d6c066690 0x7f4d6c068b50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4d800011f0 tx=0x7f4d80009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:13.609 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:25:13.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.606+0000 7f4d86a00640 1 -- 172.21.15.55:0/4200801396 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f4d78050ce0 con 0x7f4d900cbc20 2024-04-02T07:25:13.614 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:25:13.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.802+0000 7f4d8f200640 1 -- 172.21.15.55:0/4200801396 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f4d9006cf00 con 0x7f4d900cbc20 2024-04-02T07:25:13.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.814+0000 7f4d86a00640 1 -- 172.21.15.55:0/4200801396 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v29) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4d780170c0 con 0x7f4d900cbc20 2024-04-02T07:25:13.817 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 8 and data pool 9 2024-04-02T07:25:13.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.814+0000 7f4d8f200640 1 -- 172.21.15.55:0/4200801396 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4d6c066690 msgr2=0x7f4d6c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:13.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.814+0000 7f4d8f200640 1 --2- 172.21.15.55:0/4200801396 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4d6c066690 0x7f4d6c068b50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4d800011f0 tx=0x7f4d80009040 comp rx=0 tx=0).stop 2024-04-02T07:25:13.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.814+0000 7f4d8f200640 1 -- 172.21.15.55:0/4200801396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d900cbc20 msgr2=0x7f4d90154940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:13.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.814+0000 7f4d8f200640 1 --2- 172.21.15.55:0/4200801396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d900cbc20 0x7f4d90154940 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f4d7800c780 tx=0x7f4d7800cc40 comp rx=0 tx=0).stop 2024-04-02T07:25:13.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.814+0000 7f4d8f200640 1 -- 172.21.15.55:0/4200801396 shutdown_connections 2024-04-02T07:25:13.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.814+0000 7f4d8f200640 1 --2- 172.21.15.55:0/4200801396 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4d6c066690 0x7f4d6c068b50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:13.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.814+0000 7f4d8f200640 1 --2- 172.21.15.55:0/4200801396 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d900cc880 0x7f4d900c3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:13.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.814+0000 7f4d8f200640 1 --2- 172.21.15.55:0/4200801396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d900cbc20 0x7f4d90154940 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:13.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.814+0000 7f4d8f200640 1 --2- 172.21.15.55:0/4200801396 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d90098a10 0x7f4d9014a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:13.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.814+0000 7f4d8f200640 1 -- 172.21.15.55:0/4200801396 >> 172.21.15.55:0/4200801396 conn(0x7f4d900b1fb0 msgr2=0x7f4d90072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:13.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.818+0000 7f4d8f200640 1 -- 172.21.15.55:0/4200801396 shutdown_connections 2024-04-02T07:25:13.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.818+0000 7f4d8f200640 1 -- 172.21.15.55:0/4200801396 wait complete. 2024-04-02T07:25:13.857 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:25:13.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.994+0000 7f5e15600640 1 Processor -- start 2024-04-02T07:25:13.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.994+0000 7f5e15600640 1 -- start start 2024-04-02T07:25:13.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.994+0000 7f5e15600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5e1015ee70 0x7f5e10099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:13.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.994+0000 7f5e15600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e10099120 0x7f5e100b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:13.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.994+0000 7f5e15600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e100ad270 con 0x7f5e1015f250 2024-04-02T07:25:13.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.994+0000 7f5e15600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e100b0840 con 0x7f5e1015ee70 2024-04-02T07:25:13.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.994+0000 7f5e15600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e100cf6a0 con 0x7f5e10099120 2024-04-02T07:25:13.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.994+0000 7f5e0ea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5e1015ee70 0x7f5e10099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:13.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.994+0000 7f5e0ea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5e1015ee70 0x7f5e10099830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54432/0 (socket says 172.21.15.55:54432) 2024-04-02T07:25:13.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.994+0000 7f5e0ea00640 1 -- 172.21.15.55:0/218634786 learned_addr learned my addr 172.21.15.55:0/218634786 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:13.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.994+0000 7f5e0f400640 1 --2- 172.21.15.55:0/218634786 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e10099120 0x7f5e100b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:13.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.994+0000 7f5e0ea00640 1 -- 172.21.15.55:0/218634786 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e10099120 msgr2=0x7f5e100b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:13.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.994+0000 7f5e0ea00640 1 --2- 172.21.15.55:0/218634786 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e10099120 0x7f5e100b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:13.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.994+0000 7f5e0ea00640 1 -- 172.21.15.55:0/218634786 >> v1:172.21.15.55:6789/0 conn(0x7f5e1015f250 legacy=0x7f5e10098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:13.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.994+0000 7f5e0ea00640 1 -- 172.21.15.55:0/218634786 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e100b0a50 con 0x7f5e1015ee70 2024-04-02T07:25:14.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.998+0000 7f5e0ea00640 1 --2- 172.21.15.55:0/218634786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e1015ee70 0x7f5e10099830 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009870 tx=0x7f5e0001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516c21f2dea2835c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:14.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.998+0000 7f5e0e000640 1 -- 172.21.15.55:0/218634786 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e000a9620 con 0x7f5e1015ee70 2024-04-02T07:25:14.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.998+0000 7f5e0e000640 1 -- 172.21.15.55:0/218634786 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e000a9780 con 0x7f5e1015ee70 2024-04-02T07:25:14.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.998+0000 7f5e0e000640 1 -- 172.21.15.55:0/218634786 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e000a9b10 con 0x7f5e1015ee70 2024-04-02T07:25:14.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.998+0000 7f5e15600640 1 -- 172.21.15.55:0/218634786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e1015ee70 msgr2=0x7f5e10099830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:14.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.998+0000 7f5e15600640 1 --2- 172.21.15.55:0/218634786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e1015ee70 0x7f5e10099830 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f5e00009870 tx=0x7f5e0001c560 comp rx=0 tx=0).stop 2024-04-02T07:25:14.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.998+0000 7f5e15600640 1 -- 172.21.15.55:0/218634786 shutdown_connections 2024-04-02T07:25:14.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.998+0000 7f5e15600640 1 --2- 172.21.15.55:0/218634786 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e10099120 0x7f5e100b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.998+0000 7f5e15600640 1 --2- 172.21.15.55:0/218634786 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e1015ee70 0x7f5e10099830 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.998+0000 7f5e15600640 1 -- 172.21.15.55:0/218634786 >> 172.21.15.55:0/218634786 conn(0x7f5e100b21d0 msgr2=0x7f5e100b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:14.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.998+0000 7f5e15600640 1 -- 172.21.15.55:0/218634786 shutdown_connections 2024-04-02T07:25:14.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.998+0000 7f5e15600640 1 -- 172.21.15.55:0/218634786 wait complete. 2024-04-02T07:25:14.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:13.998+0000 7f5e15600640 1 Processor -- start 2024-04-02T07:25:14.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e15600640 1 -- start start 2024-04-02T07:25:14.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e15600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e10099120 0x7f5e100c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:14.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e15600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e1015ee70 0x7f5e100cd120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:14.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e15600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e1015f250 0x7f5e100cd660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:14.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e15600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e100c7200 con 0x7f5e10099120 2024-04-02T07:25:14.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e15600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e100c6960 con 0x7f5e1015f250 2024-04-02T07:25:14.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e15600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e100c6c40 con 0x7f5e1015ee70 2024-04-02T07:25:14.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e0ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e10099120 0x7f5e100c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:14.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e0ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e10099120 0x7f5e100c6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54446/0 (socket says 172.21.15.55:54446) 2024-04-02T07:25:14.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e0ea00640 1 -- 172.21.15.55:0/3022285799 learned_addr learned my addr 172.21.15.55:0/3022285799 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:14.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e06000640 1 --2- 172.21.15.55:0/3022285799 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e1015ee70 0x7f5e100cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:14.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e0f400640 1 --2- 172.21.15.55:0/3022285799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e1015f250 0x7f5e100cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:14.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e0ea00640 1 -- 172.21.15.55:0/3022285799 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e1015ee70 msgr2=0x7f5e100cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:14.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e0ea00640 1 --2- 172.21.15.55:0/3022285799 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e1015ee70 0x7f5e100cd120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e0ea00640 1 -- 172.21.15.55:0/3022285799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e1015f250 msgr2=0x7f5e100cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:14.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e0ea00640 1 --2- 172.21.15.55:0/3022285799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e1015f250 0x7f5e100cd660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e0ea00640 1 -- 172.21.15.55:0/3022285799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e000094d0 con 0x7f5e10099120 2024-04-02T07:25:14.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e0ea00640 1 --2- 172.21.15.55:0/3022285799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e10099120 0x7f5e100c6010 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f5e000ab040 tx=0x7f5e0001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:14.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e07400640 1 -- 172.21.15.55:0/3022285799 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e000bc450 con 0x7f5e10099120 2024-04-02T07:25:14.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e07400640 1 -- 172.21.15.55:0/3022285799 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e000bc5d0 con 0x7f5e10099120 2024-04-02T07:25:14.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e15600640 1 -- 172.21.15.55:0/3022285799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e100c6f20 con 0x7f5e10099120 2024-04-02T07:25:14.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e07400640 1 -- 172.21.15.55:0/3022285799 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e000bc980 con 0x7f5e10099120 2024-04-02T07:25:14.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e15600640 1 -- 172.21.15.55:0/3022285799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e100c6550 con 0x7f5e10099120 2024-04-02T07:25:14.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.002+0000 7f5e15600640 1 -- 172.21.15.55:0/3022285799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e100cfee0 con 0x7f5e10099120 2024-04-02T07:25:14.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.006+0000 7f5e07400640 1 -- 172.21.15.55:0/3022285799 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5e000bcae0 con 0x7f5e10099120 2024-04-02T07:25:14.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.006+0000 7f5e07400640 1 --2- 172.21.15.55:0/3022285799 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5dec066690 0x7f5dec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:14.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.006+0000 7f5e07400640 1 -- 172.21.15.55:0/3022285799 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e0011ead0 con 0x7f5e10099120 2024-04-02T07:25:14.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.006+0000 7f5e06000640 1 --2- 172.21.15.55:0/3022285799 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5dec066690 0x7f5dec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:14.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.006+0000 7f5e06000640 1 --2- 172.21.15.55:0/3022285799 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5dec066690 0x7f5dec068b50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5e1006e890 tx=0x7f5df8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:14.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.010+0000 7f5e07400640 1 -- 172.21.15.55:0/3022285799 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5e000ebf40 con 0x7f5e10099120 2024-04-02T07:25:14.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.174+0000 7f5e15600640 1 -- 172.21.15.55:0/3022285799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e100c6d80 con 0x7f5e10099120 2024-04-02T07:25:14.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.174+0000 7f5e07400640 1 -- 172.21.15.55:0/3022285799 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16110 (secure 0 0 0) 0x7f5e100c6d80 con 0x7f5e10099120 2024-04-02T07:25:14.177 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:14.178 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":59,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:25:13.807554+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:25:12.332239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-02T07:25:12.785664+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:25:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.174+0000 7f5e15600640 1 -- 172.21.15.55:0/3022285799 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5dec066690 msgr2=0x7f5dec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.174+0000 7f5e15600640 1 --2- 172.21.15.55:0/3022285799 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5dec066690 0x7f5dec068b50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5e1006e890 tx=0x7f5df8009040 comp rx=0 tx=0).stop 2024-04-02T07:25:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.174+0000 7f5e15600640 1 -- 172.21.15.55:0/3022285799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e10099120 msgr2=0x7f5e100c6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.174+0000 7f5e15600640 1 --2- 172.21.15.55:0/3022285799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e10099120 0x7f5e100c6010 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f5e000ab040 tx=0x7f5e0001ada0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.174+0000 7f5e15600640 1 -- 172.21.15.55:0/3022285799 shutdown_connections 2024-04-02T07:25:14.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.174+0000 7f5e15600640 1 --2- 172.21.15.55:0/3022285799 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5dec066690 0x7f5dec068b50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.174+0000 7f5e15600640 1 --2- 172.21.15.55:0/3022285799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e1015f250 0x7f5e100cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.174+0000 7f5e15600640 1 --2- 172.21.15.55:0/3022285799 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e1015ee70 0x7f5e100cd120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.174+0000 7f5e15600640 1 --2- 172.21.15.55:0/3022285799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e10099120 0x7f5e100c6010 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.174+0000 7f5e15600640 1 -- 172.21.15.55:0/3022285799 >> 172.21.15.55:0/3022285799 conn(0x7f5e100b21d0 msgr2=0x7f5e1006ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:14.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.174+0000 7f5e15600640 1 -- 172.21.15.55:0/3022285799 shutdown_connections 2024-04-02T07:25:14.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.174+0000 7f5e15600640 1 -- 172.21.15.55:0/3022285799 wait complete. 2024-04-02T07:25:14.199 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:25:14.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.338+0000 7fc013200640 1 Processor -- start 2024-04-02T07:25:14.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.338+0000 7fc013200640 1 -- start start 2024-04-02T07:25:14.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.338+0000 7fc013200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc00c159480 0x7fc00c15d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:14.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.338+0000 7fc013200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00c15dec0 con 0x7fc00c0b0700 2024-04-02T07:25:14.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.338+0000 7fc013200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc00c0b35e0 con 0x7fc00c0cc030 2024-04-02T07:25:14.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.338+0000 7fc013200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc00c159860 con 0x7fc00c159480 2024-04-02T07:25:14.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.338+0000 7fc011e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc00c159480 0x7fc00c15d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:14.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.338+0000 7fc012800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc00c0b0700 0x7fc00c0b1460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:52590/0 (socket says 172.21.15.55:52590) 2024-04-02T07:25:14.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.338+0000 7fc012800640 1 -- 172.21.15.55:0/232929322 learned_addr learned my addr 172.21.15.55:0/232929322 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:14.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.338+0000 7fc011e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc00c159480 0x7fc00c15d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54458/0 (socket says 172.21.15.55:54458) 2024-04-02T07:25:14.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.338+0000 7fc011e00640 1 -- 172.21.15.55:0/232929322 >> v1:172.21.15.106:6789/0 conn(0x7fc00c0cc030 legacy=0x7fc00c0afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:14.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.338+0000 7fc011e00640 1 -- 172.21.15.55:0/232929322 >> v1:172.21.15.55:6789/0 conn(0x7fc00c0b0700 legacy=0x7fc00c0b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:14.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.338+0000 7fc011e00640 1 -- 172.21.15.55:0/232929322 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc00c0b29d0 con 0x7fc00c159480 2024-04-02T07:25:14.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.338+0000 7fc010a00640 1 -- 172.21.15.55:0/232929322 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3502917335 0 0) 0x7fc0080014a0 con 0x7fc00c0b0700 2024-04-02T07:25:14.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.342+0000 7fc011e00640 1 --2- 172.21.15.55:0/232929322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c159480 0x7fc00c15d980 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc0000097c0 tx=0x7fc00001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de421e7a14c47d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:14.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.342+0000 7fc010a00640 1 -- 172.21.15.55:0/232929322 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0000a7070 con 0x7fc00c159480 2024-04-02T07:25:14.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.342+0000 7fc010a00640 1 -- 172.21.15.55:0/232929322 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0000ab430 con 0x7fc00c159480 2024-04-02T07:25:14.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.342+0000 7fc010a00640 1 -- 172.21.15.55:0/232929322 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0000ab7c0 con 0x7fc00c159480 2024-04-02T07:25:14.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.342+0000 7fc013200640 1 -- 172.21.15.55:0/232929322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c159480 msgr2=0x7fc00c15d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:14.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.342+0000 7fc013200640 1 --2- 172.21.15.55:0/232929322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c159480 0x7fc00c15d980 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fc0000097c0 tx=0x7fc00001c430 comp rx=0 tx=0).stop 2024-04-02T07:25:14.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.342+0000 7fc013200640 1 -- 172.21.15.55:0/232929322 shutdown_connections 2024-04-02T07:25:14.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.342+0000 7fc013200640 1 --2- 172.21.15.55:0/232929322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c159480 0x7fc00c15d980 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.342+0000 7fc013200640 1 -- 172.21.15.55:0/232929322 >> 172.21.15.55:0/232929322 conn(0x7fc00c066080 msgr2=0x7fc00c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:14.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.342+0000 7fc013200640 1 -- 172.21.15.55:0/232929322 shutdown_connections 2024-04-02T07:25:14.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.342+0000 7fc013200640 1 -- 172.21.15.55:0/232929322 wait complete. 2024-04-02T07:25:14.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc013200640 1 Processor -- start 2024-04-02T07:25:14.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc013200640 1 -- start start 2024-04-02T07:25:14.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc013200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc00c0b0700 0x7fc00c0c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:14.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc013200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c0cc030 0x7fc00c0c8440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:14.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc013200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc00c159480 0x7fc00c0c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:14.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc013200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c0c7630 con 0x7fc00c0cc030 2024-04-02T07:25:14.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc013200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c0c8fe0 con 0x7fc00c0b0700 2024-04-02T07:25:14.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc013200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc00c0c92c0 con 0x7fc00c159480 2024-04-02T07:25:14.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc011400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c0cc030 0x7fc00c0c8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:14.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc011400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c0cc030 0x7fc00c0c8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54468/0 (socket says 172.21.15.55:54468) 2024-04-02T07:25:14.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc011400640 1 -- 172.21.15.55:0/2382082034 learned_addr learned my addr 172.21.15.55:0/2382082034 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:14.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc012800640 1 --2- 172.21.15.55:0/2382082034 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc00c159480 0x7fc00c0c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:14.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc011e00640 1 --2- 172.21.15.55:0/2382082034 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc00c0b0700 0x7fc00c0c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:14.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc011400640 1 -- 172.21.15.55:0/2382082034 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc00c159480 msgr2=0x7fc00c0c8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:14.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc011400640 1 --2- 172.21.15.55:0/2382082034 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc00c159480 0x7fc00c0c8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc011400640 1 -- 172.21.15.55:0/2382082034 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc00c0b0700 msgr2=0x7fc00c0c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:14.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc011400640 1 --2- 172.21.15.55:0/2382082034 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc00c0b0700 0x7fc00c0c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc011400640 1 -- 172.21.15.55:0/2382082034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc000009420 con 0x7fc00c0cc030 2024-04-02T07:25:14.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc012800640 1 --2- 172.21.15.55:0/2382082034 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc00c159480 0x7fc00c0c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:14.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc011400640 1 --2- 172.21.15.55:0/2382082034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c0cc030 0x7fc00c0c8440 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00c400 tx=0x7fbffc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:14.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc006000640 1 -- 172.21.15.55:0/2382082034 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc016070 con 0x7fc00c0cc030 2024-04-02T07:25:14.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc006000640 1 -- 172.21.15.55:0/2382082034 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbffc007020 con 0x7fc00c0cc030 2024-04-02T07:25:14.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc013200640 1 -- 172.21.15.55:0/2382082034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc00c0c95a0 con 0x7fc00c0cc030 2024-04-02T07:25:14.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc006000640 1 -- 172.21.15.55:0/2382082034 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbffc007410 con 0x7fc00c0cc030 2024-04-02T07:25:14.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc013200640 1 -- 172.21.15.55:0/2382082034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc00c0c9b60 con 0x7fc00c0cc030 2024-04-02T07:25:14.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.346+0000 7fc013200640 1 -- 172.21.15.55:0/2382082034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc00c06a310 con 0x7fc00c0cc030 2024-04-02T07:25:14.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.350+0000 7fc006000640 1 -- 172.21.15.55:0/2382082034 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fbffc007570 con 0x7fc00c0cc030 2024-04-02T07:25:14.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.350+0000 7fc006000640 1 --2- 172.21.15.55:0/2382082034 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbff0066690 0x7fbff0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:14.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.350+0000 7fc006000640 1 -- 172.21.15.55:0/2382082034 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbffc083970 con 0x7fc00c0cc030 2024-04-02T07:25:14.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.350+0000 7fc011e00640 1 --2- 172.21.15.55:0/2382082034 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbff0066690 0x7fbff0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:14.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.350+0000 7fc011e00640 1 --2- 172.21.15.55:0/2382082034 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbff0066690 0x7fbff0068b50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc0000af000 tx=0x7fc0000a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:14.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.354+0000 7fc006000640 1 -- 172.21.15.55:0/2382082034 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fbffc050ce0 con 0x7fc00c0cc030 2024-04-02T07:25:14.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.514+0000 7fc013200640 1 -- 172.21.15.55:0/2382082034 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc00c0738f0 con 0x7fc00c0cc030 2024-04-02T07:25:14.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.518+0000 7fc006000640 1 -- 172.21.15.55:0/2382082034 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+16110 (secure 0 0 0) 0x7fbffc054300 con 0x7fc00c0cc030 2024-04-02T07:25:14.520 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:14.520 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":59,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:25:13.807554+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:25:12.332239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-02T07:25:12.785664+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:25:14.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.518+0000 7fc013200640 1 -- 172.21.15.55:0/2382082034 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbff0066690 msgr2=0x7fbff0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:14.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.518+0000 7fc013200640 1 --2- 172.21.15.55:0/2382082034 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbff0066690 0x7fbff0068b50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc0000af000 tx=0x7fc0000a7000 comp rx=0 tx=0).stop 2024-04-02T07:25:14.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.518+0000 7fc013200640 1 -- 172.21.15.55:0/2382082034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c0cc030 msgr2=0x7fc00c0c8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:14.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.518+0000 7fc013200640 1 --2- 172.21.15.55:0/2382082034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c0cc030 0x7fc00c0c8440 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fbffc00c400 tx=0x7fbffc00c8c0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.518+0000 7fc013200640 1 -- 172.21.15.55:0/2382082034 shutdown_connections 2024-04-02T07:25:14.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.518+0000 7fc013200640 1 --2- 172.21.15.55:0/2382082034 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc00c159480 0x7fc00c0c8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.518+0000 7fc013200640 1 --2- 172.21.15.55:0/2382082034 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc00c0cc030 0x7fc00c0c8440 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.518+0000 7fc013200640 1 --2- 172.21.15.55:0/2382082034 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbff0066690 0x7fbff0068b50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.518+0000 7fc013200640 1 --2- 172.21.15.55:0/2382082034 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc00c0b0700 0x7fc00c0c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.518+0000 7fc013200640 1 -- 172.21.15.55:0/2382082034 >> 172.21.15.55:0/2382082034 conn(0x7fc00c066080 msgr2=0x7fc00c159a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:14.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.518+0000 7fc013200640 1 -- 172.21.15.55:0/2382082034 shutdown_connections 2024-04-02T07:25:14.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.518+0000 7fc013200640 1 -- 172.21.15.55:0/2382082034 wait complete. 2024-04-02T07:25:14.542 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-02T07:25:14.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.682+0000 7f7da1000640 1 Processor -- start 2024-04-02T07:25:14.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.682+0000 7f7da1000640 1 -- start start 2024-04-02T07:25:14.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.682+0000 7f7da1000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7d9c06e4f0 0x7f7d9c065a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:14.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.682+0000 7f7da1000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c161490 0x7f7d9c06d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:14.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.682+0000 7f7da1000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d9c0660d0 con 0x7f7d9c15cd20 2024-04-02T07:25:14.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.682+0000 7f7da1000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d9c1607a0 con 0x7f7d9c06e4f0 2024-04-02T07:25:14.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.682+0000 7f7da1000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c0ae8d0 con 0x7f7d9c161490 2024-04-02T07:25:14.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.682+0000 7f7d9a800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c161490 0x7f7d9c06d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:14.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.682+0000 7f7d91400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7d9c06e4f0 0x7f7d9c065a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:14.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.682+0000 7f7d91400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7d9c06e4f0 0x7f7d9c065a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:33876/0 (socket says 172.21.15.55:33876) 2024-04-02T07:25:14.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.682+0000 7f7d91400640 1 -- 172.21.15.55:0/1788350301 learned_addr learned my addr 172.21.15.55:0/1788350301 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:14.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.682+0000 7f7d91400640 1 -- 172.21.15.55:0/1788350301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c161490 msgr2=0x7f7d9c06d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:14.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.682+0000 7f7d91400640 1 --2- 172.21.15.55:0/1788350301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c161490 0x7f7d9c06d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.682+0000 7f7d91400640 1 -- 172.21.15.55:0/1788350301 >> v1:172.21.15.106:6789/0 conn(0x7f7d9c15cd20 legacy=0x7f7d9c06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:14.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.682+0000 7f7d91400640 1 -- 172.21.15.55:0/1788350301 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d9c1609b0 con 0x7f7d9c06e4f0 2024-04-02T07:25:14.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.686+0000 7f7d91400640 1 --2- 172.21.15.55:0/1788350301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d9c06e4f0 0x7f7d9c065a80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009870 tx=0x7f7d8401c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1384501e596697e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:14.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.686+0000 7f7d99400640 1 -- 172.21.15.55:0/1788350301 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84004230 con 0x7f7d9c06e4f0 2024-04-02T07:25:14.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.686+0000 7f7d99400640 1 -- 172.21.15.55:0/1788350301 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d840a7050 con 0x7f7d9c06e4f0 2024-04-02T07:25:14.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.686+0000 7f7d99400640 1 -- 172.21.15.55:0/1788350301 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84003620 con 0x7f7d9c06e4f0 2024-04-02T07:25:14.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.686+0000 7f7da1000640 1 -- 172.21.15.55:0/1788350301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d9c06e4f0 msgr2=0x7f7d9c065a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:14.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.686+0000 7f7da1000640 1 --2- 172.21.15.55:0/1788350301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d9c06e4f0 0x7f7d9c065a80 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7d84009870 tx=0x7f7d8401c560 comp rx=0 tx=0).stop 2024-04-02T07:25:14.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.686+0000 7f7da1000640 1 -- 172.21.15.55:0/1788350301 shutdown_connections 2024-04-02T07:25:14.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.686+0000 7f7da1000640 1 --2- 172.21.15.55:0/1788350301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c161490 0x7f7d9c06d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.686+0000 7f7da1000640 1 --2- 172.21.15.55:0/1788350301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d9c06e4f0 0x7f7d9c065a80 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.686+0000 7f7da1000640 1 -- 172.21.15.55:0/1788350301 >> 172.21.15.55:0/1788350301 conn(0x7f7d9c0ced90 msgr2=0x7f7d9c0cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:14.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.686+0000 7f7da1000640 1 -- 172.21.15.55:0/1788350301 shutdown_connections 2024-04-02T07:25:14.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.686+0000 7f7da1000640 1 -- 172.21.15.55:0/1788350301 wait complete. 2024-04-02T07:25:14.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7da1000640 1 Processor -- start 2024-04-02T07:25:14.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7da1000640 1 -- start start 2024-04-02T07:25:14.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7da1000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d9c06e4f0 0x7f7d9c0b2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:14.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7da1000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d9c15cd20 0x7f7d9c0b29d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:14.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7da1000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c161490 0x7f7d9c15a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:14.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7da1000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c151fa0 con 0x7f7d9c15cd20 2024-04-02T07:25:14.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7da1000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c15d260 con 0x7f7d9c06e4f0 2024-04-02T07:25:14.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7da1000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d9c140c90 con 0x7f7d9c161490 2024-04-02T07:25:14.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7d91400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d9c15cd20 0x7f7d9c0b29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:14.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7d91400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d9c15cd20 0x7f7d9c0b29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54474/0 (socket says 172.21.15.55:54474) 2024-04-02T07:25:14.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7d91400640 1 -- 172.21.15.55:0/1254649616 learned_addr learned my addr 172.21.15.55:0/1254649616 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:14.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7d99e00640 1 --2- 172.21.15.55:0/1254649616 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d9c06e4f0 0x7f7d9c0b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:14.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7d9a800640 1 --2- 172.21.15.55:0/1254649616 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c161490 0x7f7d9c15a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:14.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7d91400640 1 -- 172.21.15.55:0/1254649616 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c161490 msgr2=0x7f7d9c15a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:14.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7d91400640 1 --2- 172.21.15.55:0/1254649616 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c161490 0x7f7d9c15a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7d91400640 1 -- 172.21.15.55:0/1254649616 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d9c06e4f0 msgr2=0x7f7d9c0b2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:14.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7d91400640 1 --2- 172.21.15.55:0/1254649616 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d9c06e4f0 0x7f7d9c0b2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:14.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7d91400640 1 -- 172.21.15.55:0/1254649616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d840094d0 con 0x7f7d9c15cd20 2024-04-02T07:25:14.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7d9a800640 1 --2- 172.21.15.55:0/1254649616 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c161490 0x7f7d9c15a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:14.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7d99e00640 1 --2- 172.21.15.55:0/1254649616 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d9c06e4f0 0x7f7d9c0b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:14.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7d91400640 1 --2- 172.21.15.55:0/1254649616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d9c15cd20 0x7f7d9c0b29d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7d840ae040 tx=0x7f7d84019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:14.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7d92a00640 1 -- 172.21.15.55:0/1254649616 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d84003bf0 con 0x7f7d9c15cd20 2024-04-02T07:25:14.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7d92a00640 1 -- 172.21.15.55:0/1254649616 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d84003d70 con 0x7f7d9c15cd20 2024-04-02T07:25:14.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7d92a00640 1 -- 172.21.15.55:0/1254649616 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d840ab680 con 0x7f7d9c15cd20 2024-04-02T07:25:14.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7da1000640 1 -- 172.21.15.55:0/1254649616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d9c15d4b0 con 0x7f7d9c15cd20 2024-04-02T07:25:14.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.690+0000 7f7da1000640 1 -- 172.21.15.55:0/1254649616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d9c15da70 con 0x7f7d9c15cd20 2024-04-02T07:25:14.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.694+0000 7f7da1000640 1 -- 172.21.15.55:0/1254649616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d9c0cc770 con 0x7f7d9c15cd20 2024-04-02T07:25:14.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.694+0000 7f7d92a00640 1 -- 172.21.15.55:0/1254649616 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7d840b2040 con 0x7f7d9c15cd20 2024-04-02T07:25:14.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.694+0000 7f7d92a00640 1 --2- 172.21.15.55:0/1254649616 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7d78066690 0x7f7d78068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:14.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.694+0000 7f7d92a00640 1 -- 172.21.15.55:0/1254649616 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d8411e2e0 con 0x7f7d9c15cd20 2024-04-02T07:25:14.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.694+0000 7f7d99e00640 1 --2- 172.21.15.55:0/1254649616 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7d78066690 0x7f7d78068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:14.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.694+0000 7f7d99e00640 1 --2- 172.21.15.55:0/1254649616 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7d78066690 0x7f7d78068b50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c000f70 tx=0x7f7d8c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:14.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.698+0000 7f7d92a00640 1 -- 172.21.15.55:0/1254649616 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7d840eb760 con 0x7f7d9c15cd20 2024-04-02T07:25:14.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:14.894+0000 7f7da1000640 1 -- 172.21.15.55:0/1254649616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7d9c15dc60 con 0x7f7d9c15cd20 2024-04-02T07:25:15.321 INFO:tasks.ceph.mds.d.smithi106.stderr:2024-04-02T07:25:15.319+0000 7f442f000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:25:15.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:15.833+0000 7f7d92a00640 1 -- 172.21.15.55:0/1254649616 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v32) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7d840f5030 con 0x7f7d9c15cd20 2024-04-02T07:25:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:15.837+0000 7f7da1000640 1 -- 172.21.15.55:0/1254649616 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7d78066690 msgr2=0x7f7d78068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:15.837+0000 7f7da1000640 1 --2- 172.21.15.55:0/1254649616 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7d78066690 0x7f7d78068b50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f7d8c000f70 tx=0x7f7d8c009040 comp rx=0 tx=0).stop 2024-04-02T07:25:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:15.837+0000 7f7da1000640 1 -- 172.21.15.55:0/1254649616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d9c15cd20 msgr2=0x7f7d9c0b29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:15.837+0000 7f7da1000640 1 --2- 172.21.15.55:0/1254649616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d9c15cd20 0x7f7d9c0b29d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7d840ae040 tx=0x7f7d84019300 comp rx=0 tx=0).stop 2024-04-02T07:25:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:15.837+0000 7f7da1000640 1 -- 172.21.15.55:0/1254649616 shutdown_connections 2024-04-02T07:25:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:15.837+0000 7f7da1000640 1 --2- 172.21.15.55:0/1254649616 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d9c161490 0x7f7d9c15a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:15.837+0000 7f7da1000640 1 --2- 172.21.15.55:0/1254649616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d9c15cd20 0x7f7d9c0b29d0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:15.837+0000 7f7da1000640 1 --2- 172.21.15.55:0/1254649616 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7d78066690 0x7f7d78068b50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:15.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:15.837+0000 7f7da1000640 1 --2- 172.21.15.55:0/1254649616 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d9c06e4f0 0x7f7d9c0b2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:15.837+0000 7f7da1000640 1 -- 172.21.15.55:0/1254649616 >> 172.21.15.55:0/1254649616 conn(0x7f7d9c0ced90 msgr2=0x7f7d9c0aea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:15.837+0000 7f7da1000640 1 -- 172.21.15.55:0/1254649616 shutdown_connections 2024-04-02T07:25:15.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:15.837+0000 7f7da1000640 1 -- 172.21.15.55:0/1254649616 wait complete. 2024-04-02T07:25:15.865 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-02T07:25:15.865 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-02T07:25:16.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.009+0000 7f4448600640 1 Processor -- start 2024-04-02T07:25:16.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.009+0000 7f4448600640 1 -- start start 2024-04-02T07:25:16.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.009+0000 7f4448600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f444015ca60 0x7f44400cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:16.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.009+0000 7f4448600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4440098a10 0x7f4440098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:16.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.009+0000 7f4448600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44400993b0 con 0x7f444006b920 2024-04-02T07:25:16.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.009+0000 7f4448600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f444006c460 con 0x7f444015ca60 2024-04-02T07:25:16.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.009+0000 7f4448600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f444015ce40 con 0x7f4440098a10 2024-04-02T07:25:16.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.009+0000 7f4445c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f444015ca60 0x7f44400cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:16.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.009+0000 7f4445c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f444015ca60 0x7f44400cfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41290/0 (socket says 172.21.15.55:41290) 2024-04-02T07:25:16.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.009+0000 7f4445c00640 1 -- 172.21.15.55:0/4257613520 learned_addr learned my addr 172.21.15.55:0/4257613520 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:16.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.009+0000 7f4445c00640 1 -- 172.21.15.55:0/4257613520 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4440098a10 msgr2=0x7f4440098e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:16.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.009+0000 7f4445c00640 1 --2- 172.21.15.55:0/4257613520 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4440098a10 0x7f4440098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:16.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.009+0000 7f4445c00640 1 -- 172.21.15.55:0/4257613520 >> v1:172.21.15.106:6789/0 conn(0x7f444006b920 legacy=0x7f444006bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:16.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.009+0000 7f4445c00640 1 -- 172.21.15.55:0/4257613520 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44400d01b0 con 0x7f444015ca60 2024-04-02T07:25:16.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.013+0000 7f4445c00640 1 --2- 172.21.15.55:0/4257613520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f444015ca60 0x7f44400cfc70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4434009870 tx=0x7f443401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39f3d39485e9280 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:16.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.013+0000 7f443fe00640 1 -- 172.21.15.55:0/4257613520 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44340ab620 con 0x7f444015ca60 2024-04-02T07:25:16.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.013+0000 7f443fe00640 1 -- 172.21.15.55:0/4257613520 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44340ab780 con 0x7f444015ca60 2024-04-02T07:25:16.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.013+0000 7f443fe00640 1 -- 172.21.15.55:0/4257613520 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44340abb10 con 0x7f444015ca60 2024-04-02T07:25:16.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.013+0000 7f4448600640 1 -- 172.21.15.55:0/4257613520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f444015ca60 msgr2=0x7f44400cfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:16.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.013+0000 7f4448600640 1 --2- 172.21.15.55:0/4257613520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f444015ca60 0x7f44400cfc70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f4434009870 tx=0x7f443401c460 comp rx=0 tx=0).stop 2024-04-02T07:25:16.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.013+0000 7f4448600640 1 -- 172.21.15.55:0/4257613520 shutdown_connections 2024-04-02T07:25:16.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.013+0000 7f4448600640 1 --2- 172.21.15.55:0/4257613520 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4440098a10 0x7f4440098e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:16.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.013+0000 7f4448600640 1 --2- 172.21.15.55:0/4257613520 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f444015ca60 0x7f44400cfc70 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:16.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.013+0000 7f4448600640 1 -- 172.21.15.55:0/4257613520 >> 172.21.15.55:0/4257613520 conn(0x7f44400b2150 msgr2=0x7f44400b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:16.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.013+0000 7f4448600640 1 -- 172.21.15.55:0/4257613520 shutdown_connections 2024-04-02T07:25:16.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.013+0000 7f4448600640 1 -- 172.21.15.55:0/4257613520 wait complete. 2024-04-02T07:25:16.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4448600640 1 Processor -- start 2024-04-02T07:25:16.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4448600640 1 -- start start 2024-04-02T07:25:16.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4448600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f444006b920 0x7f4440152ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:16.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4448600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4440098a10 0x7f44400b5c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:16.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4448600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f444015ca60 0x7f44400c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4448600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4440154300 con 0x7f444006b920 2024-04-02T07:25:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4448600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44400b3850 con 0x7f444015ca60 2024-04-02T07:25:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4448600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44400b6180 con 0x7f4440098a10 2024-04-02T07:25:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4445c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f444006b920 0x7f4440152ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4445c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f444006b920 0x7f4440152ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41306/0 (socket says 172.21.15.55:41306) 2024-04-02T07:25:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4445c00640 1 -- 172.21.15.55:0/536593893 learned_addr learned my addr 172.21.15.55:0/536593893 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4445200640 1 --2- 172.21.15.55:0/536593893 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4440098a10 0x7f44400b5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4446600640 1 --2- 172.21.15.55:0/536593893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f444015ca60 0x7f44400c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4445c00640 1 -- 172.21.15.55:0/536593893 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4440098a10 msgr2=0x7f44400b5c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4445c00640 1 --2- 172.21.15.55:0/536593893 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4440098a10 0x7f44400b5c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4445c00640 1 -- 172.21.15.55:0/536593893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f444015ca60 msgr2=0x7f44400c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4445c00640 1 --2- 172.21.15.55:0/536593893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f444015ca60 0x7f44400c7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4445c00640 1 -- 172.21.15.55:0/536593893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44340094d0 con 0x7f444006b920 2024-04-02T07:25:16.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4445200640 1 --2- 172.21.15.55:0/536593893 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4440098a10 0x7f44400b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:16.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4445c00640 1 --2- 172.21.15.55:0/536593893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f444006b920 0x7f4440152ff0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f44340ad040 tx=0x7f443401aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:16.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f443d600640 1 -- 172.21.15.55:0/536593893 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44340be3f0 con 0x7f444006b920 2024-04-02T07:25:16.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f443d600640 1 -- 172.21.15.55:0/536593893 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44340be570 con 0x7f444006b920 2024-04-02T07:25:16.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f443d600640 1 -- 172.21.15.55:0/536593893 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44340be920 con 0x7f444006b920 2024-04-02T07:25:16.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4448600640 1 -- 172.21.15.55:0/536593893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4440153680 con 0x7f444006b920 2024-04-02T07:25:16.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4448600640 1 -- 172.21.15.55:0/536593893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4440153c40 con 0x7f444006b920 2024-04-02T07:25:16.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.017+0000 7f4448600640 1 -- 172.21.15.55:0/536593893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4440066c90 con 0x7f444006b920 2024-04-02T07:25:16.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.021+0000 7f443d600640 1 -- 172.21.15.55:0/536593893 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f44340c7440 con 0x7f444006b920 2024-04-02T07:25:16.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.021+0000 7f443d600640 1 --2- 172.21.15.55:0/536593893 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4420066690 0x7f4420068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:16.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.021+0000 7f443d600640 1 -- 172.21.15.55:0/536593893 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f443411eab0 con 0x7f444006b920 2024-04-02T07:25:16.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.021+0000 7f4445200640 1 --2- 172.21.15.55:0/536593893 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4420066690 0x7f4420068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:16.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.021+0000 7f4445200640 1 --2- 172.21.15.55:0/536593893 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4420066690 0x7f4420068b50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f442c006fd0 tx=0x7f442c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:16.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.025+0000 7f443d600640 1 -- 172.21.15.55:0/536593893 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f44340ebe10 con 0x7f444006b920 2024-04-02T07:25:16.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.217+0000 7f4448600640 1 -- 172.21.15.55:0/536593893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f44400b2ff0 con 0x7f444006b920 2024-04-02T07:25:16.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.841+0000 7f443d600640 1 -- 172.21.15.55:0/536593893 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v33) v1 ==== 122+0+0 (secure 0 0 0) 0x7f44340ef430 con 0x7f444006b920 2024-04-02T07:25:16.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.845+0000 7f4448600640 1 -- 172.21.15.55:0/536593893 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4420066690 msgr2=0x7f4420068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:16.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.845+0000 7f4448600640 1 --2- 172.21.15.55:0/536593893 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4420066690 0x7f4420068b50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f442c006fd0 tx=0x7f442c008040 comp rx=0 tx=0).stop 2024-04-02T07:25:16.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.845+0000 7f4448600640 1 -- 172.21.15.55:0/536593893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f444006b920 msgr2=0x7f4440152ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:16.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.845+0000 7f4448600640 1 --2- 172.21.15.55:0/536593893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f444006b920 0x7f4440152ff0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f44340ad040 tx=0x7f443401aca0 comp rx=0 tx=0).stop 2024-04-02T07:25:16.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.845+0000 7f4448600640 1 -- 172.21.15.55:0/536593893 shutdown_connections 2024-04-02T07:25:16.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.845+0000 7f4448600640 1 --2- 172.21.15.55:0/536593893 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4420066690 0x7f4420068b50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:16.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.845+0000 7f4448600640 1 --2- 172.21.15.55:0/536593893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f444015ca60 0x7f44400c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:16.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.845+0000 7f4448600640 1 --2- 172.21.15.55:0/536593893 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4440098a10 0x7f44400b5c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:16.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.845+0000 7f4448600640 1 --2- 172.21.15.55:0/536593893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f444006b920 0x7f4440152ff0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:16.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.845+0000 7f4448600640 1 -- 172.21.15.55:0/536593893 >> 172.21.15.55:0/536593893 conn(0x7f44400b2150 msgr2=0x7f44400affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:16.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.845+0000 7f4448600640 1 -- 172.21.15.55:0/536593893 shutdown_connections 2024-04-02T07:25:16.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:16.845+0000 7f4448600640 1 -- 172.21.15.55:0/536593893 wait complete. 2024-04-02T07:25:16.870 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-02T07:25:16.871 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:25:17.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.009+0000 7fdd0f400640 1 Processor -- start 2024-04-02T07:25:17.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.009+0000 7fdd0f400640 1 -- start start 2024-04-02T07:25:17.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.009+0000 7fdd0f400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdd0815ee70 0x7fdd08099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:17.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.009+0000 7fdd0f400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdd0815f250 0x7fdd080b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:17.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.009+0000 7fdd0f400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd08098a10 0x7fdd08098e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:17.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.009+0000 7fdd0f400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd080b0840 con 0x7fdd08098a10 2024-04-02T07:25:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.009+0000 7fdd0f400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd080993c0 con 0x7fdd0815ee70 2024-04-02T07:25:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.009+0000 7fdd0f400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd080ad270 con 0x7fdd0815f250 2024-04-02T07:25:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.009+0000 7fdd0d400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd08098a10 0x7fdd08098e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.009+0000 7fdd0d400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd08098a10 0x7fdd08098e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41322/0 (socket says 172.21.15.55:41322) 2024-04-02T07:25:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.009+0000 7fdd0d400640 1 -- 172.21.15.55:0/1122896020 learned_addr learned my addr 172.21.15.55:0/1122896020 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.009+0000 7fdcffe00640 1 --2- 172.21.15.55:0/1122896020 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdd0815f250 0x7fdd080b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.009+0000 7fdd0d400640 1 -- 172.21.15.55:0/1122896020 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdd0815f250 msgr2=0x7fdd080b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.009+0000 7fdd0d400640 1 --2- 172.21.15.55:0/1122896020 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdd0815f250 0x7fdd080b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.009+0000 7fdd0d400640 1 -- 172.21.15.55:0/1122896020 >> v2:172.21.15.106:3300/0 conn(0x7fdd0815ee70 msgr2=0x7fdd08099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.009+0000 7fdd0ca00640 1 --2- 172.21.15.55:0/1122896020 >> v2:172.21.15.106:3300/0 conn(0x7fdd0815ee70 0x7fdd08099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.009+0000 7fdd0d400640 1 --2- 172.21.15.55:0/1122896020 >> v2:172.21.15.106:3300/0 conn(0x7fdd0815ee70 0x7fdd08099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.009+0000 7fdd0d400640 1 -- 172.21.15.55:0/1122896020 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd080b0a50 con 0x7fdd08098a10 2024-04-02T07:25:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.009+0000 7fdcffe00640 1 --2- 172.21.15.55:0/1122896020 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdd0815f250 0x7fdd080b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:25:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.009+0000 7fdd0ca00640 1 --2- 172.21.15.55:0/1122896020 >> v2:172.21.15.106:3300/0 conn(0x7fdd0815ee70 0x7fdd08099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:25:17.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.013+0000 7fdd0d400640 1 --2- 172.21.15.55:0/1122896020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd08098a10 0x7fdd08098e80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fdd080719c0 tx=0x7fdd0001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49fa95309cc84400 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:17.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.013+0000 7fdd07e00640 1 -- 172.21.15.55:0/1122896020 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd000a5870 con 0x7fdd08098a10 2024-04-02T07:25:17.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.013+0000 7fdd07e00640 1 -- 172.21.15.55:0/1122896020 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd000a59d0 con 0x7fdd08098a10 2024-04-02T07:25:17.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.013+0000 7fdd07e00640 1 -- 172.21.15.55:0/1122896020 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd000a5d60 con 0x7fdd08098a10 2024-04-02T07:25:17.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.013+0000 7fdd0f400640 1 -- 172.21.15.55:0/1122896020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd08098a10 msgr2=0x7fdd08098e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:17.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.013+0000 7fdd0f400640 1 --2- 172.21.15.55:0/1122896020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd08098a10 0x7fdd08098e80 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fdd080719c0 tx=0x7fdd0001c9f0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.013+0000 7fdd0f400640 1 -- 172.21.15.55:0/1122896020 shutdown_connections 2024-04-02T07:25:17.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.013+0000 7fdd0f400640 1 --2- 172.21.15.55:0/1122896020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd08098a10 0x7fdd08098e80 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.013+0000 7fdd0f400640 1 --2- 172.21.15.55:0/1122896020 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdd0815f250 0x7fdd080b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.013+0000 7fdd0f400640 1 --2- 172.21.15.55:0/1122896020 >> v2:172.21.15.106:3300/0 conn(0x7fdd0815ee70 0x7fdd08099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.013+0000 7fdd0f400640 1 -- 172.21.15.55:0/1122896020 >> 172.21.15.55:0/1122896020 conn(0x7fdd080b21d0 msgr2=0x7fdd080b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:17.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.013+0000 7fdd0f400640 1 -- 172.21.15.55:0/1122896020 shutdown_connections 2024-04-02T07:25:17.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.013+0000 7fdd0f400640 1 -- 172.21.15.55:0/1122896020 wait complete. 2024-04-02T07:25:17.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0f400640 1 Processor -- start 2024-04-02T07:25:17.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0f400640 1 -- start start 2024-04-02T07:25:17.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd08098a10 0x7fdd0806f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:17.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd0815ee70 0x7fdd0806fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:17.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0f400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdd0815f250 0x7fdd0806b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:17.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0f400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd081f4f80 con 0x7fdd08098a10 2024-04-02T07:25:17.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0f400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd08151e00 con 0x7fdd0815ee70 2024-04-02T07:25:17.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0f400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd08157320 con 0x7fdd0815f250 2024-04-02T07:25:17.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0ca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd08098a10 0x7fdd0806f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:17.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0ca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd08098a10 0x7fdd0806f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41328/0 (socket says 172.21.15.55:41328) 2024-04-02T07:25:17.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0ca00640 1 -- 172.21.15.55:0/966343040 learned_addr learned my addr 172.21.15.55:0/966343040 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:17.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0d400640 1 --2- 172.21.15.55:0/966343040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdd0815f250 0x7fdd0806b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:17.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdcffe00640 1 --2- 172.21.15.55:0/966343040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd0815ee70 0x7fdd0806fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:17.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0ca00640 1 -- 172.21.15.55:0/966343040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdd0815f250 msgr2=0x7fdd0806b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:17.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0ca00640 1 --2- 172.21.15.55:0/966343040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdd0815f250 0x7fdd0806b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0ca00640 1 -- 172.21.15.55:0/966343040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd0815ee70 msgr2=0x7fdd0806fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:17.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0ca00640 1 --2- 172.21.15.55:0/966343040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd0815ee70 0x7fdd0806fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0ca00640 1 -- 172.21.15.55:0/966343040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd00009b30 con 0x7fdd08098a10 2024-04-02T07:25:17.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdcffe00640 1 --2- 172.21.15.55:0/966343040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd0815ee70 0x7fdd0806fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:17.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0ca00640 1 --2- 172.21.15.55:0/966343040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd08098a10 0x7fdd0806f550 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fdcf800c7c0 tx=0x7fdcf800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:17.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd05600640 1 -- 172.21.15.55:0/966343040 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8007a30 con 0x7fdd08098a10 2024-04-02T07:25:17.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd05600640 1 -- 172.21.15.55:0/966343040 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf8007b90 con 0x7fdd08098a10 2024-04-02T07:25:17.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd05600640 1 -- 172.21.15.55:0/966343040 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf800ce70 con 0x7fdd08098a10 2024-04-02T07:25:17.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0f400640 1 -- 172.21.15.55:0/966343040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd08157600 con 0x7fdd08098a10 2024-04-02T07:25:17.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0f400640 1 -- 172.21.15.55:0/966343040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd08157bc0 con 0x7fdd08098a10 2024-04-02T07:25:17.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.017+0000 7fdd0f400640 1 -- 172.21.15.55:0/966343040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd08066c90 con 0x7fdd08098a10 2024-04-02T07:25:17.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.021+0000 7fdd05600640 1 -- 172.21.15.55:0/966343040 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fdcf80113f0 con 0x7fdd08098a10 2024-04-02T07:25:17.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.021+0000 7fdd05600640 1 --2- 172.21.15.55:0/966343040 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdce4066690 0x7fdce4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:17.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.021+0000 7fdd05600640 1 -- 172.21.15.55:0/966343040 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcf8084620 con 0x7fdd08098a10 2024-04-02T07:25:17.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.021+0000 7fdcffe00640 1 --2- 172.21.15.55:0/966343040 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdce4066690 0x7fdce4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:17.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.021+0000 7fdcffe00640 1 --2- 172.21.15.55:0/966343040 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdce4066690 0x7fdce4068b50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdd08070250 tx=0x7fdcf0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:17.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.025+0000 7fdd05600640 1 -- 172.21.15.55:0/966343040 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fdcf80519a0 con 0x7fdd08098a10 2024-04-02T07:25:17.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.221+0000 7fdd0f400640 1 -- 172.21.15.55:0/966343040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdd080cc3e0 con 0x7fdd08098a10 2024-04-02T07:25:17.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.221+0000 7fdd05600640 1 -- 172.21.15.55:0/966343040 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4740 (secure 0 0 0) 0x7fdcf8054fc0 con 0x7fdd08098a10 2024-04-02T07:25:17.224 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:17.225 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5510,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3429221899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3429221899},{"type":"v1","addr":"172.21.15.55:6835","nonce":3429221899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5513,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/4033456774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4033456774},{"type":"v1","addr":"172.21.15.106:6836","nonce":4033456774}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6129,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2170345840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2170345840},{"type":"v1","addr":"172.21.15.55:6834","nonce":2170345840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:25:13.807869+0000","modified":"2024-04-02T07:25:16.836879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6138":{"gid":6138,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6837/1050953219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1050953219},{"type":"v1","addr":"172.21.15.106:6837","nonce":1050953219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-02T07:25:17.225 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 33 2024-04-02T07:25:17.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.221+0000 7fdd0f400640 1 -- 172.21.15.55:0/966343040 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdce4066690 msgr2=0x7fdce4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:17.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.221+0000 7fdd0f400640 1 --2- 172.21.15.55:0/966343040 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdce4066690 0x7fdce4068b50 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fdd08070250 tx=0x7fdcf0008040 comp rx=0 tx=0).stop 2024-04-02T07:25:17.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.221+0000 7fdd0f400640 1 -- 172.21.15.55:0/966343040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd08098a10 msgr2=0x7fdd0806f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:17.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.221+0000 7fdd0f400640 1 --2- 172.21.15.55:0/966343040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd08098a10 0x7fdd0806f550 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fdcf800c7c0 tx=0x7fdcf800cc80 comp rx=0 tx=0).stop 2024-04-02T07:25:17.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.221+0000 7fdd0f400640 1 -- 172.21.15.55:0/966343040 shutdown_connections 2024-04-02T07:25:17.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.221+0000 7fdd0f400640 1 --2- 172.21.15.55:0/966343040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdd0815f250 0x7fdd0806b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.221+0000 7fdd0f400640 1 --2- 172.21.15.55:0/966343040 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdce4066690 0x7fdce4068b50 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.221+0000 7fdd0f400640 1 --2- 172.21.15.55:0/966343040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdd0815ee70 0x7fdd0806fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.221+0000 7fdd0f400640 1 --2- 172.21.15.55:0/966343040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd08098a10 0x7fdd0806f550 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.221+0000 7fdd0f400640 1 -- 172.21.15.55:0/966343040 >> 172.21.15.55:0/966343040 conn(0x7fdd080b21d0 msgr2=0x7fdd0815ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:17.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.221+0000 7fdd0f400640 1 -- 172.21.15.55:0/966343040 shutdown_connections 2024-04-02T07:25:17.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.221+0000 7fdd0f400640 1 -- 172.21.15.55:0/966343040 wait complete. 2024-04-02T07:25:17.246 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:25:17.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.381+0000 7fde78800640 1 Processor -- start 2024-04-02T07:25:17.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.381+0000 7fde78800640 1 -- start start 2024-04-02T07:25:17.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.385+0000 7fde78800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fde700b38c0 0x7fde70164210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:17.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.385+0000 7fde78800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde7013d0c0 con 0x7fde70153ea0 2024-04-02T07:25:17.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.385+0000 7fde78800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde7015a4f0 con 0x7fde700c4120 2024-04-02T07:25:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.385+0000 7fde78800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7015a2f0 con 0x7fde700b38c0 2024-04-02T07:25:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.385+0000 7fde75e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fde70153ea0 0x7fde70159be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47376/0 (socket says 172.21.15.55:47376) 2024-04-02T07:25:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.385+0000 7fde75e00640 1 -- 172.21.15.55:0/3593938042 learned_addr learned my addr 172.21.15.55:0/3593938042 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.385+0000 7fde76800640 1 --2- 172.21.15.55:0/3593938042 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fde700b38c0 0x7fde70164210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.385+0000 7fde74a00640 1 -- 172.21.15.55:0/3593938042 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4215117084 0 0) 0x7fde7013d0c0 con 0x7fde70153ea0 2024-04-02T07:25:17.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.385+0000 7fde74a00640 1 -- 172.21.15.55:0/3593938042 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde58003530 con 0x7fde70153ea0 2024-04-02T07:25:17.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.385+0000 7fde74a00640 1 -- 172.21.15.55:0/3593938042 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1678356651 0 0) 0x7fde7015a4f0 con 0x7fde700c4120 2024-04-02T07:25:17.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.385+0000 7fde74a00640 1 -- 172.21.15.55:0/3593938042 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde7013d0c0 con 0x7fde700c4120 2024-04-02T07:25:17.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.385+0000 7fde76800640 1 -- 172.21.15.55:0/3593938042 >> v1:172.21.15.106:6789/0 conn(0x7fde700c4120 legacy=0x7fde700b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:17.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.385+0000 7fde76800640 1 -- 172.21.15.55:0/3593938042 >> v1:172.21.15.55:6789/0 conn(0x7fde70153ea0 legacy=0x7fde70159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:17.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.385+0000 7fde76800640 1 -- 172.21.15.55:0/3593938042 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7015a7d0 con 0x7fde700b38c0 2024-04-02T07:25:17.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.389+0000 7fde76800640 1 --2- 172.21.15.55:0/3593938042 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fde700b38c0 0x7fde70164210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fde6c009dc0 tx=0x7fde6c01c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61c9ce8a0907fe71 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:17.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.389+0000 7fde74a00640 1 -- 172.21.15.55:0/3593938042 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c0a5860 con 0x7fde700b38c0 2024-04-02T07:25:17.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.389+0000 7fde74a00640 1 -- 172.21.15.55:0/3593938042 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde6c0a59c0 con 0x7fde700b38c0 2024-04-02T07:25:17.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.389+0000 7fde74a00640 1 -- 172.21.15.55:0/3593938042 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde6c0a5d50 con 0x7fde700b38c0 2024-04-02T07:25:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.389+0000 7fde78800640 1 -- 172.21.15.55:0/3593938042 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fde700b38c0 msgr2=0x7fde70164210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.389+0000 7fde78800640 1 --2- 172.21.15.55:0/3593938042 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fde700b38c0 0x7fde70164210 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fde6c009dc0 tx=0x7fde6c01c990 comp rx=0 tx=0).stop 2024-04-02T07:25:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.389+0000 7fde78800640 1 -- 172.21.15.55:0/3593938042 shutdown_connections 2024-04-02T07:25:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.389+0000 7fde78800640 1 --2- 172.21.15.55:0/3593938042 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fde700b38c0 0x7fde70164210 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.389+0000 7fde78800640 1 -- 172.21.15.55:0/3593938042 >> 172.21.15.55:0/3593938042 conn(0x7fde70066080 msgr2=0x7fde70069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:17.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.389+0000 7fde78800640 1 -- 172.21.15.55:0/3593938042 shutdown_connections 2024-04-02T07:25:17.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.389+0000 7fde78800640 1 -- 172.21.15.55:0/3593938042 wait complete. 2024-04-02T07:25:17.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.389+0000 7fde78800640 1 Processor -- start 2024-04-02T07:25:17.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.389+0000 7fde78800640 1 -- start start 2024-04-02T07:25:17.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.389+0000 7fde78800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde700b38c0 0x7fde700cc700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:17.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.389+0000 7fde78800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde700c4120 0x7fde70158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:17.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.389+0000 7fde78800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fde70153ea0 0x7fde701f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:17.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.389+0000 7fde78800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde700cb660 con 0x7fde700b38c0 2024-04-02T07:25:17.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.389+0000 7fde78800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde700cb940 con 0x7fde700c4120 2024-04-02T07:25:17.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.393+0000 7fde78800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde700cbc20 con 0x7fde70153ea0 2024-04-02T07:25:17.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.393+0000 7fde75e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde700b38c0 0x7fde700cc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:17.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.393+0000 7fde75e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde700b38c0 0x7fde700cc700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41338/0 (socket says 172.21.15.55:41338) 2024-04-02T07:25:17.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.393+0000 7fde75e00640 1 -- 172.21.15.55:0/4000200077 learned_addr learned my addr 172.21.15.55:0/4000200077 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:17.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.393+0000 7fde76800640 1 --2- 172.21.15.55:0/4000200077 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fde70153ea0 0x7fde701f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:17.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.393+0000 7fde75400640 1 --2- 172.21.15.55:0/4000200077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde700c4120 0x7fde70158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:17.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.393+0000 7fde75e00640 1 -- 172.21.15.55:0/4000200077 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fde70153ea0 msgr2=0x7fde701f5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:17.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.393+0000 7fde75e00640 1 --2- 172.21.15.55:0/4000200077 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fde70153ea0 0x7fde701f5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.393+0000 7fde75e00640 1 -- 172.21.15.55:0/4000200077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde700c4120 msgr2=0x7fde70158910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:17.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.393+0000 7fde75e00640 1 --2- 172.21.15.55:0/4000200077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde700c4120 0x7fde70158910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.393+0000 7fde75e00640 1 -- 172.21.15.55:0/4000200077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde6c009a70 con 0x7fde700b38c0 2024-04-02T07:25:17.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.393+0000 7fde75400640 1 --2- 172.21.15.55:0/4000200077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde700c4120 0x7fde70158910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:17.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.393+0000 7fde75e00640 1 --2- 172.21.15.55:0/4000200077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde700b38c0 0x7fde700cc700 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fde6400c4d0 tx=0x7fde6400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:17.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.393+0000 7fde6a000640 1 -- 172.21.15.55:0/4000200077 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde64005cf0 con 0x7fde700b38c0 2024-04-02T07:25:17.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.393+0000 7fde6a000640 1 -- 172.21.15.55:0/4000200077 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde64005e50 con 0x7fde700b38c0 2024-04-02T07:25:17.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.393+0000 7fde78800640 1 -- 172.21.15.55:0/4000200077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde700cbf00 con 0x7fde700b38c0 2024-04-02T07:25:17.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.393+0000 7fde6a000640 1 -- 172.21.15.55:0/4000200077 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde640072b0 con 0x7fde700b38c0 2024-04-02T07:25:17.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.393+0000 7fde78800640 1 -- 172.21.15.55:0/4000200077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde70152d30 con 0x7fde700b38c0 2024-04-02T07:25:17.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.393+0000 7fde78800640 1 -- 172.21.15.55:0/4000200077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde70066c90 con 0x7fde700b38c0 2024-04-02T07:25:17.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.393+0000 7fde6a000640 1 -- 172.21.15.55:0/4000200077 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fde64007410 con 0x7fde700b38c0 2024-04-02T07:25:17.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.397+0000 7fde6a000640 1 --2- 172.21.15.55:0/4000200077 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fde54066690 0x7fde54068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:17.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.397+0000 7fde6a000640 1 -- 172.21.15.55:0/4000200077 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fde64083840 con 0x7fde700b38c0 2024-04-02T07:25:17.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.397+0000 7fde75400640 1 --2- 172.21.15.55:0/4000200077 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fde54066690 0x7fde54068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:17.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.397+0000 7fde75400640 1 --2- 172.21.15.55:0/4000200077 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fde54066690 0x7fde54068b50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fde701525d0 tx=0x7fde60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:17.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.401+0000 7fde6a000640 1 -- 172.21.15.55:0/4000200077 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fde64050b30 con 0x7fde700b38c0 2024-04-02T07:25:17.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.561+0000 7fde78800640 1 -- 172.21.15.55:0/4000200077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fde70070b50 con 0x7fde700b38c0 2024-04-02T07:25:17.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.561+0000 7fde6a000640 1 -- 172.21.15.55:0/4000200077 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16097 (secure 0 0 0) 0x7fde64017020 con 0x7fde700b38c0 2024-04-02T07:25:17.567 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:17.568 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":60,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:25:14.810503+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:25:12.332239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-02T07:25:12.785664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:25:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.565+0000 7fde78800640 1 -- 172.21.15.55:0/4000200077 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fde54066690 msgr2=0x7fde54068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.565+0000 7fde78800640 1 --2- 172.21.15.55:0/4000200077 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fde54066690 0x7fde54068b50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fde701525d0 tx=0x7fde60009040 comp rx=0 tx=0).stop 2024-04-02T07:25:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.565+0000 7fde78800640 1 -- 172.21.15.55:0/4000200077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde700b38c0 msgr2=0x7fde700cc700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.565+0000 7fde78800640 1 --2- 172.21.15.55:0/4000200077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde700b38c0 0x7fde700cc700 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fde6400c4d0 tx=0x7fde6400c990 comp rx=0 tx=0).stop 2024-04-02T07:25:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.565+0000 7fde78800640 1 -- 172.21.15.55:0/4000200077 shutdown_connections 2024-04-02T07:25:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.565+0000 7fde78800640 1 --2- 172.21.15.55:0/4000200077 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fde70153ea0 0x7fde701f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.565+0000 7fde78800640 1 --2- 172.21.15.55:0/4000200077 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fde54066690 0x7fde54068b50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.565+0000 7fde78800640 1 --2- 172.21.15.55:0/4000200077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fde700c4120 0x7fde70158910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.565+0000 7fde78800640 1 --2- 172.21.15.55:0/4000200077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fde700b38c0 0x7fde700cc700 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.565+0000 7fde78800640 1 -- 172.21.15.55:0/4000200077 >> 172.21.15.55:0/4000200077 conn(0x7fde70066080 msgr2=0x7fde7015acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.565+0000 7fde78800640 1 -- 172.21.15.55:0/4000200077 shutdown_connections 2024-04-02T07:25:17.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.565+0000 7fde78800640 1 -- 172.21.15.55:0/4000200077 wait complete. 2024-04-02T07:25:17.589 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-02T07:25:17.589 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:25:17.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.725+0000 7efde0e00640 1 Processor -- start 2024-04-02T07:25:17.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.725+0000 7efde0e00640 1 -- start start 2024-04-02T07:25:17.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.725+0000 7efde0e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efddc098a10 0x7efddc098e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:17.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.725+0000 7efde0e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efddc0d01d0 con 0x7efddc0cfdf0 2024-04-02T07:25:17.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.725+0000 7efde0e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efddc099360 con 0x7efddc0b16e0 2024-04-02T07:25:17.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.725+0000 7efde0e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efddc06c0e0 con 0x7efddc098a10 2024-04-02T07:25:17.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.725+0000 7efdda800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efddc098a10 0x7efddc098e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:17.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.725+0000 7efdd9e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efddc0cfdf0 0x7efddc06b8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47380/0 (socket says 172.21.15.55:47380) 2024-04-02T07:25:17.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.725+0000 7efdd9e00640 1 -- 172.21.15.55:0/3139153617 learned_addr learned my addr 172.21.15.55:0/3139153617 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:17.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.725+0000 7efdda800640 1 -- 172.21.15.55:0/3139153617 >> v1:172.21.15.106:6789/0 conn(0x7efddc0b16e0 legacy=0x7efddc0b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:17.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.725+0000 7efdda800640 1 -- 172.21.15.55:0/3139153617 >> v1:172.21.15.55:6789/0 conn(0x7efddc0cfdf0 legacy=0x7efddc06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:17.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.725+0000 7efdda800640 1 -- 172.21.15.55:0/3139153617 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efddc0b01d0 con 0x7efddc098a10 2024-04-02T07:25:17.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.725+0000 7efdd9400640 1 -- 172.21.15.55:0/3139153617 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3241627057 0 0) 0x7efdcc001120 con 0x7efddc0cfdf0 2024-04-02T07:25:17.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.729+0000 7efdda800640 1 --2- 172.21.15.55:0/3139153617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efddc098a10 0x7efddc098e20 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7efdd4009d90 tx=0x7efdd401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8099ec4d706c04b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:17.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.729+0000 7efdd9400640 1 -- 172.21.15.55:0/3139153617 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd40a5a00 con 0x7efddc098a10 2024-04-02T07:25:17.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.729+0000 7efdd9400640 1 -- 172.21.15.55:0/3139153617 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd40a5b60 con 0x7efddc098a10 2024-04-02T07:25:17.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.729+0000 7efdd9400640 1 -- 172.21.15.55:0/3139153617 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd40ad440 con 0x7efddc098a10 2024-04-02T07:25:17.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.729+0000 7efde0e00640 1 -- 172.21.15.55:0/3139153617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efddc098a10 msgr2=0x7efddc098e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:17.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.729+0000 7efde0e00640 1 --2- 172.21.15.55:0/3139153617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efddc098a10 0x7efddc098e20 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7efdd4009d90 tx=0x7efdd401c940 comp rx=0 tx=0).stop 2024-04-02T07:25:17.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.729+0000 7efde0e00640 1 -- 172.21.15.55:0/3139153617 shutdown_connections 2024-04-02T07:25:17.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.729+0000 7efde0e00640 1 --2- 172.21.15.55:0/3139153617 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efddc098a10 0x7efddc098e20 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.729+0000 7efde0e00640 1 -- 172.21.15.55:0/3139153617 >> 172.21.15.55:0/3139153617 conn(0x7efddc0b2210 msgr2=0x7efddc0b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:17.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.729+0000 7efde0e00640 1 -- 172.21.15.55:0/3139153617 shutdown_connections 2024-04-02T07:25:17.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.729+0000 7efde0e00640 1 -- 172.21.15.55:0/3139153617 wait complete. 2024-04-02T07:25:17.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efde0e00640 1 Processor -- start 2024-04-02T07:25:17.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efde0e00640 1 -- start start 2024-04-02T07:25:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efde0e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efddc098a10 0x7efddc0cd560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efde0e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efddc0b16e0 0x7efddc0c4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efde0e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efddc0cfdf0 0x7efddc151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efde0e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efddc0c97a0 con 0x7efddc098a10 2024-04-02T07:25:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efde0e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efddc0cdaa0 con 0x7efddc0cfdf0 2024-04-02T07:25:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efde0e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efddc0cdcd0 con 0x7efddc0b16e0 2024-04-02T07:25:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efdd9e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efddc098a10 0x7efddc0cd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efdd9e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efddc098a10 0x7efddc0cd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41350/0 (socket says 172.21.15.55:41350) 2024-04-02T07:25:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efdd9e00640 1 -- 172.21.15.55:0/3467143327 learned_addr learned my addr 172.21.15.55:0/3467143327 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efdda800640 1 --2- 172.21.15.55:0/3467143327 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efddc0cfdf0 0x7efddc151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efdd3e00640 1 --2- 172.21.15.55:0/3467143327 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efddc0b16e0 0x7efddc0c4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efdd9e00640 1 -- 172.21.15.55:0/3467143327 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efddc0b16e0 msgr2=0x7efddc0c4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:17.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efdd9e00640 1 --2- 172.21.15.55:0/3467143327 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efddc0b16e0 0x7efddc0c4230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efdd9e00640 1 -- 172.21.15.55:0/3467143327 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efddc0cfdf0 msgr2=0x7efddc151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:17.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efdd9e00640 1 --2- 172.21.15.55:0/3467143327 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efddc0cfdf0 0x7efddc151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efdd9e00640 1 -- 172.21.15.55:0/3467143327 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd4009a70 con 0x7efddc098a10 2024-04-02T07:25:17.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efdda800640 1 --2- 172.21.15.55:0/3467143327 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efddc0cfdf0 0x7efddc151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:17.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efdd9e00640 1 --2- 172.21.15.55:0/3467143327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efddc098a10 0x7efddc0cd560 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00c410 tx=0x7efdcc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:17.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efdd2000640 1 -- 172.21.15.55:0/3467143327 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc0074e0 con 0x7efddc098a10 2024-04-02T07:25:17.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efdd2000640 1 -- 172.21.15.55:0/3467143327 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdcc007640 con 0x7efddc098a10 2024-04-02T07:25:17.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efdd2000640 1 -- 172.21.15.55:0/3467143327 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc004a30 con 0x7efddc098a10 2024-04-02T07:25:17.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efde0e00640 1 -- 172.21.15.55:0/3467143327 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efddc152910 con 0x7efddc098a10 2024-04-02T07:25:17.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efde0e00640 1 -- 172.21.15.55:0/3467143327 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efddc0c90e0 con 0x7efddc098a10 2024-04-02T07:25:17.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.733+0000 7efde0e00640 1 -- 172.21.15.55:0/3467143327 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efddc066c90 con 0x7efddc098a10 2024-04-02T07:25:17.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.737+0000 7efdd2000640 1 -- 172.21.15.55:0/3467143327 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7efdcc004b90 con 0x7efddc098a10 2024-04-02T07:25:17.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.737+0000 7efdd2000640 1 --2- 172.21.15.55:0/3467143327 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdb8066690 0x7efdb8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:17.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.737+0000 7efdd2000640 1 -- 172.21.15.55:0/3467143327 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdcc083dd0 con 0x7efddc098a10 2024-04-02T07:25:17.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.737+0000 7efdd3e00640 1 --2- 172.21.15.55:0/3467143327 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdb8066690 0x7efdb8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:17.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.737+0000 7efdd3e00640 1 --2- 172.21.15.55:0/3467143327 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdb8066690 0x7efdb8068b50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efddc0ce2e0 tx=0x7efdc4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:17.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.741+0000 7efdd2000640 1 -- 172.21.15.55:0/3467143327 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7efdcc051130 con 0x7efddc098a10 2024-04-02T07:25:17.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.897+0000 7efde0e00640 1 -- 172.21.15.55:0/3467143327 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efddc0d01d0 con 0x7efdb8066690 2024-04-02T07:25:17.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.909+0000 7efdd2000640 1 -- 172.21.15.55:0/3467143327 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273946 (secure 0 0 0) 0x7efddc0d01d0 con 0x7efdb8066690 2024-04-02T07:25:17.915 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:17.917 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:25:17.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.909+0000 7efde0e00640 1 -- 172.21.15.55:0/3467143327 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdb8066690 msgr2=0x7efdb8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:17.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.909+0000 7efde0e00640 1 --2- 172.21.15.55:0/3467143327 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdb8066690 0x7efdb8068b50 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7efddc0ce2e0 tx=0x7efdc4009040 comp rx=0 tx=0).stop 2024-04-02T07:25:17.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.909+0000 7efde0e00640 1 -- 172.21.15.55:0/3467143327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efddc098a10 msgr2=0x7efddc0cd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:17.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.909+0000 7efde0e00640 1 --2- 172.21.15.55:0/3467143327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efddc098a10 0x7efddc0cd560 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7efdcc00c410 tx=0x7efdcc00c8d0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.909+0000 7efde0e00640 1 -- 172.21.15.55:0/3467143327 shutdown_connections 2024-04-02T07:25:17.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.909+0000 7efde0e00640 1 --2- 172.21.15.55:0/3467143327 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdb8066690 0x7efdb8068b50 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.909+0000 7efde0e00640 1 --2- 172.21.15.55:0/3467143327 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efddc0cfdf0 0x7efddc151d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.909+0000 7efde0e00640 1 --2- 172.21.15.55:0/3467143327 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efddc0b16e0 0x7efddc0c4230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.909+0000 7efde0e00640 1 --2- 172.21.15.55:0/3467143327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efddc098a10 0x7efddc0cd560 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:17.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.909+0000 7efde0e00640 1 -- 172.21.15.55:0/3467143327 >> 172.21.15.55:0/3467143327 conn(0x7efddc0b2210 msgr2=0x7efddc0ad3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:17.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.909+0000 7efde0e00640 1 -- 172.21.15.55:0/3467143327 shutdown_connections 2024-04-02T07:25:17.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:17.909+0000 7efde0e00640 1 -- 172.21.15.55:0/3467143327 wait complete. 2024-04-02T07:25:17.935 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-04-02T07:25:16.375873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":238884,"kb_used_data":6312,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754735836,"statfs":{"total":773094113280,"available":772849496064,"internally_reserved":0,"allocated":6463488,"data_stored":3346936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001065"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-02T07:25:09.505051+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:25:09.505051+0000","last_peered":"2024-04-02T07:25:09.505051+0000","last_clean":"2024-04-02T07:25:09.505051+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:25:09.505051+0000","last_undegraded":"2024-04-02T07:25:09.505051+0000","last_fullsized":"2024-04-02T07:25:09.505051+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28260,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343580,"statfs":{"total":96636764160,"available":96607825920,"internally_reserved":0,"allocated":1265664,"data_stored":866276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64200000000000002,"15min":0.64100000000000001},"min":{"1min":0.441,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88300000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.501},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.60999999999999999,"15min":0.59799999999999998},"min":{"1min":0.48299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.76000000000000001}]},{"osd":1,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.628,"15min":0.624},"min":{"1min":0.436,"5min":0.379,"15min":0.379},"max":{"1min":0.84299999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86199999999999999,"5min":1.113,"15min":1.113},"last":0.55600000000000005}]},{"osd":2,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.747,"15min":0.75},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.93999999999999995,"5min":1.139,"15min":1.139},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.5,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96299999999999997,"5min":1.522,"15min":1.522},"last":0.58299999999999996}]},{"osd":3,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.50700000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92700000000000005,"5min":1.405,"15min":1.405},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72699999999999998,"15min":0.72799999999999998},"min":{"1min":0.58599999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92300000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.65100000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68799999999999994,"15min":0.70299999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81499999999999995,"5min":1.633,"15min":1.633},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.874,"5min":1.079,"15min":1.079},"last":0.68500000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72299999999999998,"15min":0.74099999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94499999999999995,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.78700000000000003,"15min":0.79900000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95499999999999996,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.66300000000000003}]},{"osd":6,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82799999999999996,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.69799999999999995,"15min":0.71499999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82499999999999996,"5min":1,"15min":1},"last":0.63300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":275908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.65300000000000002,"15min":0.66000000000000003},"min":{"1min":0.46600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.75700000000000001,"5min":1.399,"15min":1.399},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.82699999999999996,"15min":0.90100000000000002},"min":{"1min":0.498,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.876,"5min":5.7569999999999997,"15min":5.7569999999999997},"last":0.54300000000000004}]},{"osd":1,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71899999999999997,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90500000000000003,"5min":1.95,"15min":1.95},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.72099999999999997,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83599999999999997,"5min":1.248,"15min":1.248},"last":0.63600000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.67700000000000005,"15min":0.69199999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.746,"5min":1.226,"15min":1.226},"last":0.623},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.70399999999999996,"15min":0.70799999999999996},"min":{"1min":0.504,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86599999999999999,"5min":0.997,"15min":0.997},"last":0.66500000000000004}]},{"osd":3,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.78100000000000003,"15min":0.81499999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.82899999999999996,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.76700000000000002,"15min":0.79900000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.84799999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.72699999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65300000000000002,"15min":0.66900000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83699999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83799999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.60299999999999998}]},{"osd":5,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.65600000000000003,"15min":0.68000000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.749,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.496},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71999999999999997,"15min":0.73399999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.873,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.751}]},{"osd":7,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73099999999999998,"15min":0.748},"min":{"1min":0.53300000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.73099999999999998,"15min":0.749},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.81799999999999995,"5min":0.999,"15min":0.999},"last":0.77400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27676,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":659456,"data_stored":270781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64900000000000002,"15min":0.64500000000000002},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.873,"5min":1.25,"15min":1.25},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70399999999999996,"15min":0.70799999999999996},"min":{"1min":0.47599999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93300000000000005,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.78500000000000003}]},{"osd":1,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.68999999999999995,"15min":0.68899999999999995},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.875,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86199999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.81100000000000005}]},{"osd":2,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.79400000000000004,"15min":0.82599999999999996},"min":{"1min":0.47399999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88700000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72399999999999998,"15min":0.746},"min":{"1min":0.442,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86099999999999999,"5min":1.696,"15min":1.696},"last":0.77000000000000002}]},{"osd":3,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.74399999999999999,"15min":0.76700000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92400000000000004,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.746},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.78700000000000003,"15min":0.82899999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85799999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.874}]},{"osd":4,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.67500000000000004,"15min":0.72799999999999998},"min":{"1min":0.39200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":1.911,"15min":1.911},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.73399999999999999,"15min":0.79600000000000004},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84099999999999997,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.68799999999999994}]},{"osd":6,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.79800000000000004,"15min":0.873},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80300000000000005,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.78700000000000003,"15min":0.85799999999999998},"min":{"1min":0.45100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.82699999999999996,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.72799999999999998}]},{"osd":7,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.81399999999999995,"15min":0.878},"min":{"1min":0.48899999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.88700000000000001,"5min":1.887,"15min":1.887},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.84799999999999998,"15min":0.92600000000000005},"min":{"1min":0.443,"5min":0.439,"15min":0.439},"max":{"1min":0.86699999999999999,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.97999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":647168,"data_stored":265638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.746,"15min":0.75900000000000001},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91800000000000004,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.81999999999999995,"15min":0.84999999999999998},"min":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81499999999999995,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.505}]},{"osd":1,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76300000000000001,"15min":0.77000000000000002},"min":{"1min":0.56200000000000006,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90600000000000003,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.90800000000000003,"15min":0.94199999999999995},"min":{"1min":0.54200000000000004,"5min":0.503,"15min":0.503},"max":{"1min":0.97399999999999998,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":0.56299999999999994}]},{"osd":2,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.80400000000000005,"15min":0.81499999999999995},"min":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.93999999999999995,"5min":2.056,"15min":2.056},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.878,"15min":0.90200000000000002},"min":{"1min":0.59399999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.874,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.61599999999999999}]},{"osd":3,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.999,"15min":1.0369999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.97899999999999998,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":1.012,"15min":1.0509999999999999},"min":{"1min":0.65200000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.91700000000000004,"5min":3.9750000000000001,"15min":3.9750000000000001},"last":0.68400000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71999999999999997,"15min":0.72499999999999998},"min":{"1min":0.439,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91000000000000003,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.45800000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95499999999999996,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.54300000000000004}]},{"osd":6,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":0.72999999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.085,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79300000000000004,"15min":0.79400000000000004},"min":{"1min":0.57799999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98399999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.63300000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.026,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.68500000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.0640000000000001,"5min":1.353,"15min":1.353},"last":0.69799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":659456,"data_stored":270781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.438,"15min":0.45000000000000001},"min":{"1min":0.28499999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.48199999999999998},"min":{"1min":0.34200000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73699999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.34200000000000003}]},{"osd":1,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.33800000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.504},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.497,"15min":0.505},"min":{"1min":0.375,"5min":0.309,"15min":0.309},"max":{"1min":0.68899999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.46100000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.625},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93700000000000006,"5min":1.306,"15min":1.306},"last":0.52100000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.5,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.876,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.876},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.57099999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94099999999999995,"5min":1.155,"15min":1.155},"last":0.81000000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.024,"5min":1.198,"15min":1.198},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.746,"15min":0.745},"min":{"1min":0.57299999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.034,"5min":1.135,"15min":1.135},"last":0.67900000000000005}]},{"osd":6,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76400000000000001,"15min":0.76900000000000002},"min":{"1min":0.58799999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.96499999999999997,"5min":1.25,"15min":1.25},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78500000000000003,"15min":0.78200000000000003},"min":{"1min":0.59799999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.98499999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.89600000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75700000000000001,"15min":0.75800000000000001},"min":{"1min":0.53300000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0740000000000001,"5min":1.216,"15min":1.216},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78900000000000003,"15min":0.79600000000000004},"min":{"1min":0.57199999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.012,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.78800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31772,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":671744,"data_stored":275908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44700000000000001,"15min":0.45200000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.747,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65200000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.33900000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.54500000000000004},"min":{"1min":0.379,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76800000000000002,"5min":1.171,"15min":1.171},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48599999999999999,"15min":0.49199999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.74299999999999999,"5min":1.333,"15min":1.333},"last":0.441}]},{"osd":3,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70099999999999996,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83099999999999996,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.50900000000000001}]},{"osd":4,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.49299999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5309999999999999,"5min":2.254,"15min":2.254},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.76200000000000001,"15min":0.76500000000000001},"min":{"1min":0.51800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2210000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.76100000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2629999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79900000000000004,"15min":0.81499999999999995},"min":{"1min":0.57099999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.3149999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.60499999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.82399999999999995,"15min":0.82499999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.83699999999999997}]},{"osd":7,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.81699999999999995,"15min":0.83699999999999997},"min":{"1min":0.58399999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4750000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.63500000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.80000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31748,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":647168,"data_stored":265638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.254,"5min":0.251,"15min":0.251},"max":{"1min":0.60399999999999998,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.65300000000000002,"15min":0.67500000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.093,"5min":4.157,"15min":4.157},"last":0.71699999999999997}]},{"osd":2,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.65600000000000003,"15min":0.69199999999999995},"min":{"1min":0.32700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68500000000000005,"5min":4.282,"15min":4.282},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79500000000000004,"5min":1.625,"15min":1.625},"last":0.56999999999999995}]},{"osd":3,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60999999999999999,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72099999999999997,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.628},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.91100000000000003,"15min":0.97199999999999998},"min":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.052,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.749}]},{"osd":4,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.96599999999999997,"15min":1.006},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0900000000000001,"5min":4.7400000000000002,"15min":4.7400000000000002},"last":1.105},{"interface":"front","average":{"1min":0.754,"5min":0.82799999999999996,"15min":0.83999999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.99199999999999999,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.996}]},{"osd":5,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.95899999999999996,"15min":0.98199999999999998},"min":{"1min":0.53900000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.163,"5min":4.5759999999999996,"15min":4.5759999999999996},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.95499999999999996,"15min":0.98699999999999999},"min":{"1min":0.48999999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0089999999999999,"5min":4.7949999999999999,"15min":4.7949999999999999},"last":1.1539999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":1.0029999999999999,"15min":1.0389999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.129,"5min":4.6890000000000001,"15min":4.6890000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.97299999999999998,"15min":1.01},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0620000000000001,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":1.0720000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.83799999999999997,"15min":0.84999999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0069999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.137},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.98799999999999999,"15min":1.0129999999999999},"min":{"1min":0.55800000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.383,"5min":4.6420000000000003,"15min":4.6420000000000003},"last":1.024}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1241088,"data_stored":856006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.47399999999999998,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.622,"5min":1.48,"15min":1.48},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.51000000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74399999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.40799999999999997}]},{"osd":2,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.34000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79100000000000004,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51900000000000002,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.47299999999999998}]},{"osd":3,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.32600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.56999999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.61899999999999999,"15min":0.63100000000000001},"min":{"1min":0.41799999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.69899999999999995,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.501}]},{"osd":4,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.90600000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.53700000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.77600000000000002}]},{"osd":5,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.78900000000000003,"15min":0.79900000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94099999999999995,"5min":1.371,"15min":1.371},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.97899999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.58799999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.018,"5min":1.177,"15min":1.177},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.83499999999999996,"15min":0.84899999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.002,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.82999999999999996}]},{"osd":7,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.56299999999999994,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.069,"5min":1.135,"15min":1.135},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.92400000000000004,"5min":1.141,"15min":1.141},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:25:17.942 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:25:18.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.121+0000 7f7b2a400640 1 Processor -- start 2024-04-02T07:25:18.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.121+0000 7f7b2a400640 1 -- start start 2024-04-02T07:25:18.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.121+0000 7f7b2a400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7b2415cb60 0x7f7b240ae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:18.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.121+0000 7f7b2a400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b240af460 con 0x7f7b240aef60 2024-04-02T07:25:18.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.121+0000 7f7b2a400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b240af740 con 0x7f7b240b09b0 2024-04-02T07:25:18.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.121+0000 7f7b2a400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b240ac2e0 con 0x7f7b2415cb60 2024-04-02T07:25:18.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.121+0000 7f7b23e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7b240aef60 0x7f7b240b02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47384/0 (socket says 172.21.15.55:47384) 2024-04-02T07:25:18.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.121+0000 7f7b23e00640 1 -- 172.21.15.55:0/617380243 learned_addr learned my addr 172.21.15.55:0/617380243 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:18.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.121+0000 7f7b29000640 1 --2- 172.21.15.55:0/617380243 >> v2:172.21.15.106:3300/0 conn(0x7f7b2415cb60 0x7f7b240ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:18.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.121+0000 7f7b23400640 1 -- 172.21.15.55:0/617380243 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1117152210 0 0) 0x7f7b240af460 con 0x7f7b240aef60 2024-04-02T07:25:18.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.121+0000 7f7b23400640 1 -- 172.21.15.55:0/617380243 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b0c003530 con 0x7f7b240aef60 2024-04-02T07:25:18.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.121+0000 7f7b29000640 1 -- 172.21.15.55:0/617380243 >> v1:172.21.15.106:6789/0 conn(0x7f7b240b09b0 legacy=0x7f7b240ac730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:18.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.121+0000 7f7b29000640 1 -- 172.21.15.55:0/617380243 >> v1:172.21.15.55:6789/0 conn(0x7f7b240aef60 legacy=0x7f7b240b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:18.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.121+0000 7f7b29000640 1 -- 172.21.15.55:0/617380243 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b240afa20 con 0x7f7b2415cb60 2024-04-02T07:25:18.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.125+0000 7f7b29000640 1 --2- 172.21.15.55:0/617380243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b2415cb60 0x7f7b240ae630 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7b180097c0 tx=0x7f7b1801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=74216abe2b49d449 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:18.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.125+0000 7f7b23400640 1 -- 172.21.15.55:0/617380243 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b180aa5f0 con 0x7f7b2415cb60 2024-04-02T07:25:18.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.125+0000 7f7b23400640 1 -- 172.21.15.55:0/617380243 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b180aa750 con 0x7f7b2415cb60 2024-04-02T07:25:18.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.125+0000 7f7b23400640 1 -- 172.21.15.55:0/617380243 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b180aaae0 con 0x7f7b2415cb60 2024-04-02T07:25:18.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.125+0000 7f7b2a400640 1 -- 172.21.15.55:0/617380243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b2415cb60 msgr2=0x7f7b240ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:18.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.125+0000 7f7b2a400640 1 --2- 172.21.15.55:0/617380243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b2415cb60 0x7f7b240ae630 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f7b180097c0 tx=0x7f7b1801c470 comp rx=0 tx=0).stop 2024-04-02T07:25:18.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.125+0000 7f7b2a400640 1 -- 172.21.15.55:0/617380243 shutdown_connections 2024-04-02T07:25:18.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.125+0000 7f7b2a400640 1 --2- 172.21.15.55:0/617380243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b2415cb60 0x7f7b240ae630 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:18.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.125+0000 7f7b2a400640 1 -- 172.21.15.55:0/617380243 >> 172.21.15.55:0/617380243 conn(0x7f7b24098a10 msgr2=0x7f7b240cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:18.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.125+0000 7f7b2a400640 1 -- 172.21.15.55:0/617380243 shutdown_connections 2024-04-02T07:25:18.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.125+0000 7f7b2a400640 1 -- 172.21.15.55:0/617380243 wait complete. 2024-04-02T07:25:18.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b2a400640 1 Processor -- start 2024-04-02T07:25:18.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b2a400640 1 -- start start 2024-04-02T07:25:18.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b2a400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7b240aef60 0x7f7b240b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:18.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b2a400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b240b09b0 0x7f7b24149e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:18.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b2a400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b2415cb60 0x7f7b2414b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:18.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b2a400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240b3940 con 0x7f7b2415cb60 2024-04-02T07:25:18.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b2a400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240b3c20 con 0x7f7b240b09b0 2024-04-02T07:25:18.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b2a400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b240b3f00 con 0x7f7b240aef60 2024-04-02T07:25:18.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b29a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b2415cb60 0x7f7b2414b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:18.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b29a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b2415cb60 0x7f7b2414b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41354/0 (socket says 172.21.15.55:41354) 2024-04-02T07:25:18.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b29a00640 1 -- 172.21.15.55:0/1397660317 learned_addr learned my addr 172.21.15.55:0/1397660317 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:18.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b29000640 1 --2- 172.21.15.55:0/1397660317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7b240aef60 0x7f7b240b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:18.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b23e00640 1 --2- 172.21.15.55:0/1397660317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b240b09b0 0x7f7b24149e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:18.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b29a00640 1 -- 172.21.15.55:0/1397660317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7b240aef60 msgr2=0x7f7b240b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:18.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b29a00640 1 --2- 172.21.15.55:0/1397660317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7b240aef60 0x7f7b240b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:18.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b29a00640 1 -- 172.21.15.55:0/1397660317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b240b09b0 msgr2=0x7f7b24149e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:18.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b29a00640 1 --2- 172.21.15.55:0/1397660317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b240b09b0 0x7f7b24149e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:18.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b29a00640 1 -- 172.21.15.55:0/1397660317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b18009420 con 0x7f7b2415cb60 2024-04-02T07:25:18.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b29a00640 1 --2- 172.21.15.55:0/1397660317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b2415cb60 0x7f7b2414b3b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00c7a0 tx=0x7f7b1c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:18.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b20c00640 1 -- 172.21.15.55:0/1397660317 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c003b80 con 0x7f7b2415cb60 2024-04-02T07:25:18.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b20c00640 1 -- 172.21.15.55:0/1397660317 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1c003ce0 con 0x7f7b2415cb60 2024-04-02T07:25:18.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b20c00640 1 -- 172.21.15.55:0/1397660317 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c00aa30 con 0x7f7b2415cb60 2024-04-02T07:25:18.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b2a400640 1 -- 172.21.15.55:0/1397660317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b240b41e0 con 0x7f7b2415cb60 2024-04-02T07:25:18.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b2a400640 1 -- 172.21.15.55:0/1397660317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b2414a390 con 0x7f7b2415cb60 2024-04-02T07:25:18.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.129+0000 7f7b2a400640 1 -- 172.21.15.55:0/1397660317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b240b4700 con 0x7f7b2415cb60 2024-04-02T07:25:18.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.133+0000 7f7b20c00640 1 -- 172.21.15.55:0/1397660317 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7b1c00ab90 con 0x7f7b2415cb60 2024-04-02T07:25:18.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.133+0000 7f7b20c00640 1 --2- 172.21.15.55:0/1397660317 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b040666c0 0x7f7b04068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:18.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.133+0000 7f7b20c00640 1 -- 172.21.15.55:0/1397660317 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b1c083e60 con 0x7f7b2415cb60 2024-04-02T07:25:18.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.133+0000 7f7b29000640 1 --2- 172.21.15.55:0/1397660317 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b040666c0 0x7f7b04068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:18.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.133+0000 7f7b29000640 1 --2- 172.21.15.55:0/1397660317 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b040666c0 0x7f7b04068b80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7b180ae000 tx=0x7f7b180a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:18.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.137+0000 7f7b20c00640 1 -- 172.21.15.55:0/1397660317 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7b240b4700 con 0x7f7b2415cb60 2024-04-02T07:25:18.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.293+0000 7f7b2a400640 1 -- 172.21.15.55:0/1397660317 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b2416a590 con 0x7f7b040666c0 2024-04-02T07:25:18.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.301+0000 7f7b20c00640 1 -- 172.21.15.55:0/1397660317 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+273946 (secure 0 0 0) 0x7f7b180aa8c0 con 0x7f7b040666c0 2024-04-02T07:25:18.309 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:18.311 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:25:18.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.305+0000 7f7b2a400640 1 -- 172.21.15.55:0/1397660317 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b040666c0 msgr2=0x7f7b04068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:18.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.305+0000 7f7b2a400640 1 --2- 172.21.15.55:0/1397660317 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b040666c0 0x7f7b04068b80 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7b180ae000 tx=0x7f7b180a7000 comp rx=0 tx=0).stop 2024-04-02T07:25:18.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.305+0000 7f7b2a400640 1 -- 172.21.15.55:0/1397660317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b2415cb60 msgr2=0x7f7b2414b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:18.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.305+0000 7f7b2a400640 1 --2- 172.21.15.55:0/1397660317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b2415cb60 0x7f7b2414b3b0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00c7a0 tx=0x7f7b1c00cc60 comp rx=0 tx=0).stop 2024-04-02T07:25:18.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.305+0000 7f7b2a400640 1 -- 172.21.15.55:0/1397660317 shutdown_connections 2024-04-02T07:25:18.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.305+0000 7f7b2a400640 1 --2- 172.21.15.55:0/1397660317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b2415cb60 0x7f7b2414b3b0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:18.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.305+0000 7f7b2a400640 1 --2- 172.21.15.55:0/1397660317 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b040666c0 0x7f7b04068b80 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:18.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.305+0000 7f7b2a400640 1 --2- 172.21.15.55:0/1397660317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b240b09b0 0x7f7b24149e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:18.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.305+0000 7f7b2a400640 1 --2- 172.21.15.55:0/1397660317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7b240aef60 0x7f7b240b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:18.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.305+0000 7f7b2a400640 1 -- 172.21.15.55:0/1397660317 >> 172.21.15.55:0/1397660317 conn(0x7f7b24098a10 msgr2=0x7f7b240ce9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:18.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.305+0000 7f7b2a400640 1 -- 172.21.15.55:0/1397660317 shutdown_connections 2024-04-02T07:25:18.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.305+0000 7f7b2a400640 1 -- 172.21.15.55:0/1397660317 wait complete. 2024-04-02T07:25:18.329 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":148,"stamp":"2024-04-02T07:25:16.375873+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":238884,"kb_used_data":6312,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754735836,"statfs":{"total":773094113280,"available":772849496064,"internally_reserved":0,"allocated":6463488,"data_stored":3346936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001065"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:13.385595+0000","last_change":"2024-04-02T07:25:13.385595+0000","last_active":"2024-04-02T07:25:13.385595+0000","last_peered":"2024-04-02T07:25:13.385595+0000","last_clean":"2024-04-02T07:25:13.385595+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:13.385595+0000","last_undegraded":"2024-04-02T07:25:13.385595+0000","last_fullsized":"2024-04-02T07:25:13.385595+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:25:12.382435+0000","last_change":"2024-04-02T07:25:12.382435+0000","last_active":"2024-04-02T07:25:12.382435+0000","last_peered":"2024-04-02T07:25:12.382435+0000","last_clean":"2024-04-02T07:25:12.382435+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:25:12.382435+0000","last_undegraded":"2024-04-02T07:25:12.382435+0000","last_fullsized":"2024-04-02T07:25:12.382435+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":194,"reported_epoch":55,"state":"active+clean","last_fresh":"2024-04-02T07:25:09.505051+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:25:09.505051+0000","last_peered":"2024-04-02T07:25:09.505051+0000","last_clean":"2024-04-02T07:25:09.505051+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:25:09.505051+0000","last_undegraded":"2024-04-02T07:25:09.505051+0000","last_fullsized":"2024-04-02T07:25:09.505051+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574887,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28260,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343580,"statfs":{"total":96636764160,"available":96607825920,"internally_reserved":0,"allocated":1265664,"data_stored":866276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64200000000000002,"15min":0.64100000000000001},"min":{"1min":0.441,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.88300000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.501},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.60999999999999999,"15min":0.59799999999999998},"min":{"1min":0.48299999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.76000000000000001}]},{"osd":1,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.628,"15min":0.624},"min":{"1min":0.436,"5min":0.379,"15min":0.379},"max":{"1min":0.84299999999999997,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65000000000000002,"15min":0.65000000000000002},"min":{"1min":0.49299999999999999,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.86199999999999999,"5min":1.113,"15min":1.113},"last":0.55600000000000005}]},{"osd":2,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.747,"15min":0.75},"min":{"1min":0.53800000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.93999999999999995,"5min":1.139,"15min":1.139},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72599999999999998,"15min":0.72699999999999998},"min":{"1min":0.5,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96299999999999997,"5min":1.522,"15min":1.522},"last":0.58299999999999996}]},{"osd":3,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69999999999999996,"15min":0.69999999999999996},"min":{"1min":0.50700000000000001,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.92700000000000005,"5min":1.405,"15min":1.405},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.72699999999999998,"15min":0.72799999999999998},"min":{"1min":0.58599999999999997,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92300000000000004,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.65100000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.68799999999999994,"15min":0.70299999999999996},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.81499999999999995,"5min":1.633,"15min":1.633},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.73999999999999999,"15min":0.752},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.874,"5min":1.079,"15min":1.079},"last":0.68500000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.72299999999999998,"15min":0.74099999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94499999999999995,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.78700000000000003,"15min":0.79900000000000004},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.95499999999999996,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.66300000000000003}]},{"osd":6,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.73399999999999999,"15min":0.748},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.82799999999999996,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.69799999999999995,"15min":0.71499999999999997},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.82499999999999996,"5min":1,"15min":1},"last":0.63300000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27676,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":671744,"data_stored":275908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.65300000000000002,"15min":0.66000000000000003},"min":{"1min":0.46600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.75700000000000001,"5min":1.399,"15min":1.399},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.82699999999999996,"15min":0.90100000000000002},"min":{"1min":0.498,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.876,"5min":5.7569999999999997,"15min":5.7569999999999997},"last":0.54300000000000004}]},{"osd":1,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71899999999999997,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90500000000000003,"5min":1.95,"15min":1.95},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.72099999999999997,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83599999999999997,"5min":1.248,"15min":1.248},"last":0.63600000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.67700000000000005,"15min":0.69199999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.746,"5min":1.226,"15min":1.226},"last":0.623},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.70399999999999996,"15min":0.70799999999999996},"min":{"1min":0.504,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86599999999999999,"5min":0.997,"15min":0.997},"last":0.66500000000000004}]},{"osd":3,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.78100000000000003,"15min":0.81499999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.82899999999999996,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.76700000000000002,"15min":0.79900000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.84799999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.72699999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65300000000000002,"15min":0.66900000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83699999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83799999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.60299999999999998}]},{"osd":5,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.65600000000000003,"15min":0.68000000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.749,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.496},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71999999999999997,"15min":0.73399999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.873,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.751}]},{"osd":7,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73099999999999998,"15min":0.748},"min":{"1min":0.53300000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.73099999999999998,"15min":0.749},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.81799999999999995,"5min":0.999,"15min":0.999},"last":0.77400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27676,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":659456,"data_stored":270781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64900000000000002,"15min":0.64500000000000002},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.873,"5min":1.25,"15min":1.25},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70399999999999996,"15min":0.70799999999999996},"min":{"1min":0.47599999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93300000000000005,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.78500000000000003}]},{"osd":1,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.68999999999999995,"15min":0.68899999999999995},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.875,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86199999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.81100000000000005}]},{"osd":2,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.79400000000000004,"15min":0.82599999999999996},"min":{"1min":0.47399999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88700000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.94699999999999995},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72399999999999998,"15min":0.746},"min":{"1min":0.442,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86099999999999999,"5min":1.696,"15min":1.696},"last":0.77000000000000002}]},{"osd":3,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.74399999999999999,"15min":0.76700000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92400000000000004,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.746},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.78700000000000003,"15min":0.82899999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85799999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.874}]},{"osd":4,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.67500000000000004,"15min":0.72799999999999998},"min":{"1min":0.39200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":1.911,"15min":1.911},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.73399999999999999,"15min":0.79600000000000004},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84099999999999997,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.68799999999999994}]},{"osd":6,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.79800000000000004,"15min":0.873},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80300000000000005,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.78700000000000003,"15min":0.85799999999999998},"min":{"1min":0.45100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.82699999999999996,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.72799999999999998}]},{"osd":7,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.81399999999999995,"15min":0.878},"min":{"1min":0.48899999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.88700000000000001,"5min":1.887,"15min":1.887},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.84799999999999998,"15min":0.92600000000000005},"min":{"1min":0.443,"5min":0.439,"15min":0.439},"max":{"1min":0.86699999999999999,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.97999999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574890,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27652,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344188,"statfs":{"total":96636764160,"available":96608448512,"internally_reserved":0,"allocated":647168,"data_stored":265638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.746,"15min":0.75900000000000001},"min":{"1min":0.498,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.91800000000000004,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.81999999999999995,"15min":0.84999999999999998},"min":{"1min":0.48499999999999999,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.81499999999999995,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.505}]},{"osd":1,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.76300000000000001,"15min":0.77000000000000002},"min":{"1min":0.56200000000000006,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.90600000000000003,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.90800000000000003,"15min":0.94199999999999995},"min":{"1min":0.54200000000000004,"5min":0.503,"15min":0.503},"max":{"1min":0.97399999999999998,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":0.56299999999999994}]},{"osd":2,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.73799999999999999,"5min":0.80400000000000005,"15min":0.81499999999999995},"min":{"1min":0.56799999999999995,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.93999999999999995,"5min":2.056,"15min":2.056},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.878,"15min":0.90200000000000002},"min":{"1min":0.59399999999999997,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":0.874,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.61599999999999999}]},{"osd":3,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.999,"15min":1.0369999999999999},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.97899999999999998,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.77600000000000002,"5min":1.012,"15min":1.0509999999999999},"min":{"1min":0.65200000000000002,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":0.91700000000000004,"5min":3.9750000000000001,"15min":3.9750000000000001},"last":0.68400000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.71999999999999997,"15min":0.72499999999999998},"min":{"1min":0.439,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.91000000000000003,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.76100000000000001,"15min":0.76700000000000002},"min":{"1min":0.45800000000000002,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.95499999999999996,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.54300000000000004}]},{"osd":6,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72799999999999998,"15min":0.72999999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.085,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.79300000000000004,"15min":0.79400000000000004},"min":{"1min":0.57799999999999996,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":0.98399999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.63300000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:24:08 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.026,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.68500000000000005,"5min":0.627,"15min":0.627},"max":{"1min":1.0640000000000001,"5min":1.353,"15min":1.353},"last":0.69799999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31764,"kb_used_data":644,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340076,"statfs":{"total":96636764160,"available":96604237824,"internally_reserved":0,"allocated":659456,"data_stored":270781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.438,"15min":0.45000000000000001},"min":{"1min":0.28499999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.48199999999999998},"min":{"1min":0.34200000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73699999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.34200000000000003}]},{"osd":1,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.33800000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.504},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.497,"15min":0.505},"min":{"1min":0.375,"5min":0.309,"15min":0.309},"max":{"1min":0.68899999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.46100000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.625},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93700000000000006,"5min":1.306,"15min":1.306},"last":0.52100000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.5,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.876,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.876},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.57099999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94099999999999995,"5min":1.155,"15min":1.155},"last":0.81000000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.024,"5min":1.198,"15min":1.198},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.746,"15min":0.745},"min":{"1min":0.57299999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.034,"5min":1.135,"15min":1.135},"last":0.67900000000000005}]},{"osd":6,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76400000000000001,"15min":0.76900000000000002},"min":{"1min":0.58799999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.96499999999999997,"5min":1.25,"15min":1.25},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78500000000000003,"15min":0.78200000000000003},"min":{"1min":0.59799999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.98499999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.89600000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75700000000000001,"15min":0.75800000000000001},"min":{"1min":0.53300000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0740000000000001,"5min":1.216,"15min":1.216},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78900000000000003,"15min":0.79600000000000004},"min":{"1min":0.57199999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.012,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.78800000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31772,"kb_used_data":656,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340068,"statfs":{"total":96636764160,"available":96604229632,"internally_reserved":0,"allocated":671744,"data_stored":275908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44700000000000001,"15min":0.45200000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.747,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65200000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.33900000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.54500000000000004},"min":{"1min":0.379,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76800000000000002,"5min":1.171,"15min":1.171},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48599999999999999,"15min":0.49199999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.74299999999999999,"5min":1.333,"15min":1.333},"last":0.441}]},{"osd":3,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70099999999999996,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83099999999999996,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.50900000000000001}]},{"osd":4,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.49299999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5309999999999999,"5min":2.254,"15min":2.254},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.76200000000000001,"15min":0.76500000000000001},"min":{"1min":0.51800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2210000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.76100000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2629999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79900000000000004,"15min":0.81499999999999995},"min":{"1min":0.57099999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.3149999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.60499999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.82399999999999995,"15min":0.82499999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.83699999999999997}]},{"osd":7,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.81699999999999995,"15min":0.83699999999999997},"min":{"1min":0.58399999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4750000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.63500000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.80000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":31748,"kb_used_data":632,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340092,"statfs":{"total":96636764160,"available":96604254208,"internally_reserved":0,"allocated":647168,"data_stored":265638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48499999999999999,"15min":0.49099999999999999},"min":{"1min":0.254,"5min":0.251,"15min":0.251},"max":{"1min":0.60399999999999998,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.65300000000000002,"15min":0.67500000000000004},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":1.093,"5min":4.157,"15min":4.157},"last":0.71699999999999997}]},{"osd":2,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.65600000000000003,"15min":0.69199999999999995},"min":{"1min":0.32700000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.68500000000000005,"5min":4.282,"15min":4.282},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.60699999999999998,"15min":0.62},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.79500000000000004,"5min":1.625,"15min":1.625},"last":0.56999999999999995}]},{"osd":3,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.60999999999999999,"15min":0.61799999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.72099999999999997,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.628},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.91100000000000003,"15min":0.97199999999999998},"min":{"1min":0.36299999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.052,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.749}]},{"osd":4,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.96599999999999997,"15min":1.006},"min":{"1min":0.46800000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0900000000000001,"5min":4.7400000000000002,"15min":4.7400000000000002},"last":1.105},{"interface":"front","average":{"1min":0.754,"5min":0.82799999999999996,"15min":0.83999999999999997},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.99199999999999999,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.996}]},{"osd":5,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.95899999999999996,"15min":0.98199999999999998},"min":{"1min":0.53900000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.163,"5min":4.5759999999999996,"15min":4.5759999999999996},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.95499999999999996,"15min":0.98699999999999999},"min":{"1min":0.48999999999999999,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.0089999999999999,"5min":4.7949999999999999,"15min":4.7949999999999999},"last":1.1539999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":1.0029999999999999,"15min":1.0389999999999999},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.129,"5min":4.6890000000000001,"15min":4.6890000000000001},"last":0.96199999999999997},{"interface":"front","average":{"1min":0.752,"5min":0.97299999999999998,"15min":1.01},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0620000000000001,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":1.0720000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:24:09 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.83799999999999997,"15min":0.84999999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0069999999999999,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":1.137},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.98799999999999999,"15min":1.0129999999999999},"min":{"1min":0.55800000000000005,"5min":0.5,"15min":0.5},"max":{"1min":1.383,"5min":4.6420000000000003,"15min":4.6420000000000003},"last":1.024}]}]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1212,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1241088,"data_stored":856006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.47399999999999998,"15min":0.48299999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.622,"5min":1.48,"15min":1.48},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.50800000000000001,"15min":0.51000000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.74399999999999999,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.40799999999999997}]},{"osd":2,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.52300000000000002,"15min":0.52900000000000003},"min":{"1min":0.34000000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79100000000000004,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.51900000000000002,"15min":0.51800000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.47299999999999998}]},{"osd":3,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.32600000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.56999999999999995,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.61899999999999999,"15min":0.63100000000000001},"min":{"1min":0.41799999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.69899999999999995,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.501}]},{"osd":4,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.72599999999999998,"15min":0.72899999999999998},"min":{"1min":0.52500000000000002,"5min":0.504,"15min":0.504},"max":{"1min":0.90600000000000003,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.73999999999999999,"15min":0.74399999999999999},"min":{"1min":0.53700000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.77600000000000002}]},{"osd":5,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.78900000000000003,"15min":0.79900000000000004},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":0.94099999999999995,"5min":1.371,"15min":1.371},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.75600000000000001,"15min":0.76300000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.97899999999999998,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.79800000000000004}]},{"osd":6,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.79500000000000004,"15min":0.80300000000000005},"min":{"1min":0.58799999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.018,"5min":1.177,"15min":1.177},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.83499999999999996,"15min":0.84899999999999998},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.002,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.82999999999999996}]},{"osd":7,"last update":"Tue Apr 2 07:24:10 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.79200000000000004,"15min":0.80000000000000004},"min":{"1min":0.56299999999999994,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":1.069,"5min":1.135,"15min":1.135},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.92400000000000004,"5min":1.141,"15min":1.141},"last":0.83699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:25:18.333 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:25:18.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.505+0000 7f302e400640 1 Processor -- start 2024-04-02T07:25:18.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.509+0000 7f302e400640 1 -- start start 2024-04-02T07:25:18.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.509+0000 7f302e400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f302815a8f0 0x7f30280997d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:18.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.509+0000 7f302e400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30280c59c0 0x7f3028098ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:18.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.509+0000 7f302e400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30280ce090 con 0x7f3028098a10 2024-04-02T07:25:18.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.509+0000 7f302e400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30280ce8f0 con 0x7f302815a8f0 2024-04-02T07:25:18.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.509+0000 7f302e400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3028099400 con 0x7f30280c59c0 2024-04-02T07:25:18.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.509+0000 7f302d000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f302815a8f0 0x7f30280997d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:18.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.509+0000 7f302d000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f302815a8f0 0x7f30280997d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41358/0 (socket says 172.21.15.55:41358) 2024-04-02T07:25:18.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.509+0000 7f302d000640 1 -- 172.21.15.55:0/2711165542 learned_addr learned my addr 172.21.15.55:0/2711165542 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:18.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.509+0000 7f302da00640 1 --2- 172.21.15.55:0/2711165542 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30280c59c0 0x7f3028098ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:18.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.509+0000 7f302d000640 1 -- 172.21.15.55:0/2711165542 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30280c59c0 msgr2=0x7f3028098ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:18.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.509+0000 7f302d000640 1 --2- 172.21.15.55:0/2711165542 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30280c59c0 0x7f3028098ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:18.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.509+0000 7f302d000640 1 -- 172.21.15.55:0/2711165542 >> v1:172.21.15.106:6789/0 conn(0x7f3028098a10 legacy=0x7f30280cb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:18.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.509+0000 7f302d000640 1 -- 172.21.15.55:0/2711165542 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30280ce330 con 0x7f302815a8f0 2024-04-02T07:25:18.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.513+0000 7f302d000640 1 --2- 172.21.15.55:0/2711165542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f302815a8f0 0x7f30280997d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f301c009870 tx=0x7f301c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f5388296cd34c57 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:18.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.513+0000 7f3027400640 1 -- 172.21.15.55:0/2711165542 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c0ab650 con 0x7f302815a8f0 2024-04-02T07:25:18.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.513+0000 7f3027400640 1 -- 172.21.15.55:0/2711165542 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c0ab7b0 con 0x7f302815a8f0 2024-04-02T07:25:18.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.513+0000 7f3027400640 1 -- 172.21.15.55:0/2711165542 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c0abb40 con 0x7f302815a8f0 2024-04-02T07:25:18.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.513+0000 7f302e400640 1 -- 172.21.15.55:0/2711165542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f302815a8f0 msgr2=0x7f30280997d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:18.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.513+0000 7f302e400640 1 --2- 172.21.15.55:0/2711165542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f302815a8f0 0x7f30280997d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f301c009870 tx=0x7f301c01c560 comp rx=0 tx=0).stop 2024-04-02T07:25:18.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.513+0000 7f302e400640 1 -- 172.21.15.55:0/2711165542 shutdown_connections 2024-04-02T07:25:18.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.513+0000 7f302e400640 1 --2- 172.21.15.55:0/2711165542 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30280c59c0 0x7f3028098ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:18.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.513+0000 7f302e400640 1 --2- 172.21.15.55:0/2711165542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f302815a8f0 0x7f30280997d0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:18.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.513+0000 7f302e400640 1 -- 172.21.15.55:0/2711165542 >> 172.21.15.55:0/2711165542 conn(0x7f30280b1fb0 msgr2=0x7f30280b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:18.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.513+0000 7f302e400640 1 -- 172.21.15.55:0/2711165542 shutdown_connections 2024-04-02T07:25:18.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.513+0000 7f302e400640 1 -- 172.21.15.55:0/2711165542 wait complete. 2024-04-02T07:25:18.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.513+0000 7f302e400640 1 Processor -- start 2024-04-02T07:25:18.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.513+0000 7f302e400640 1 -- start start 2024-04-02T07:25:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f302e400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3028098a10 0x7f30280b5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f302e400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30280c59c0 0x7f3028159360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:18.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f302e400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f302815a8f0 0x7f30280b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:18.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f302e400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30281582c0 con 0x7f302815a8f0 2024-04-02T07:25:18.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f302e400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30281585a0 con 0x7f3028098a10 2024-04-02T07:25:18.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f302e400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3028158880 con 0x7f30280c59c0 2024-04-02T07:25:18.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f302da00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f302815a8f0 0x7f30280b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:18.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f302da00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f302815a8f0 0x7f30280b30e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41362/0 (socket says 172.21.15.55:41362) 2024-04-02T07:25:18.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f302da00640 1 -- 172.21.15.55:0/662514551 learned_addr learned my addr 172.21.15.55:0/662514551 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:18.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f302d000640 1 --2- 172.21.15.55:0/662514551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3028098a10 0x7f30280b5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:18.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f3027e00640 1 --2- 172.21.15.55:0/662514551 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30280c59c0 0x7f3028159360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:18.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f302da00640 1 -- 172.21.15.55:0/662514551 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30280c59c0 msgr2=0x7f3028159360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:18.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f302da00640 1 --2- 172.21.15.55:0/662514551 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30280c59c0 0x7f3028159360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:18.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f302da00640 1 -- 172.21.15.55:0/662514551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3028098a10 msgr2=0x7f30280b5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:18.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f302da00640 1 --2- 172.21.15.55:0/662514551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3028098a10 0x7f30280b5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:18.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f302da00640 1 -- 172.21.15.55:0/662514551 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301c0094d0 con 0x7f302815a8f0 2024-04-02T07:25:18.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f302d000640 1 --2- 172.21.15.55:0/662514551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3028098a10 0x7f30280b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:18.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f302da00640 1 --2- 172.21.15.55:0/662514551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f302815a8f0 0x7f30280b30e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f3020007e40 tx=0x7f302000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:18.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f3024c00640 1 -- 172.21.15.55:0/662514551 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3020014620 con 0x7f302815a8f0 2024-04-02T07:25:18.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f3024c00640 1 -- 172.21.15.55:0/662514551 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302000ee90 con 0x7f302815a8f0 2024-04-02T07:25:18.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f3024c00640 1 -- 172.21.15.55:0/662514551 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30200149e0 con 0x7f302815a8f0 2024-04-02T07:25:18.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f302e400640 1 -- 172.21.15.55:0/662514551 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3028158b60 con 0x7f302815a8f0 2024-04-02T07:25:18.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f302e400640 1 -- 172.21.15.55:0/662514551 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3028157e50 con 0x7f302815a8f0 2024-04-02T07:25:18.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f302e400640 1 -- 172.21.15.55:0/662514551 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3028073fa0 con 0x7f302815a8f0 2024-04-02T07:25:18.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.517+0000 7f3024c00640 1 -- 172.21.15.55:0/662514551 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3020014b40 con 0x7f302815a8f0 2024-04-02T07:25:18.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.521+0000 7f3024c00640 1 --2- 172.21.15.55:0/662514551 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3008066690 0x7f3008068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:18.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.521+0000 7f3024c00640 1 -- 172.21.15.55:0/662514551 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3020084b50 con 0x7f302815a8f0 2024-04-02T07:25:18.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.521+0000 7f302d000640 1 --2- 172.21.15.55:0/662514551 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3008066690 0x7f3008068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:18.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.521+0000 7f302d000640 1 --2- 172.21.15.55:0/662514551 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3008066690 0x7f3008068b50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f301c0af000 tx=0x7f301c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:18.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.525+0000 7f3024c00640 1 -- 172.21.15.55:0/662514551 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3020051eb0 con 0x7f302815a8f0 2024-04-02T07:25:18.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.685+0000 7f302e400640 1 -- 172.21.15.55:0/662514551 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3028158710 con 0x7f3008066690 2024-04-02T07:25:18.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.693+0000 7f3024c00640 1 -- 172.21.15.55:0/662514551 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288746 (secure 0 0 0) 0x7f3028158710 con 0x7f3008066690 2024-04-02T07:25:18.699 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:18.700 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:25:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.697+0000 7f302e400640 1 -- 172.21.15.55:0/662514551 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3008066690 msgr2=0x7f3008068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.697+0000 7f302e400640 1 --2- 172.21.15.55:0/662514551 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3008066690 0x7f3008068b50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f301c0af000 tx=0x7f301c0a7000 comp rx=0 tx=0).stop 2024-04-02T07:25:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.697+0000 7f302e400640 1 -- 172.21.15.55:0/662514551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f302815a8f0 msgr2=0x7f30280b30e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.697+0000 7f302e400640 1 --2- 172.21.15.55:0/662514551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f302815a8f0 0x7f30280b30e0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f3020007e40 tx=0x7f302000e4b0 comp rx=0 tx=0).stop 2024-04-02T07:25:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.697+0000 7f302e400640 1 -- 172.21.15.55:0/662514551 shutdown_connections 2024-04-02T07:25:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.697+0000 7f302e400640 1 --2- 172.21.15.55:0/662514551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f302815a8f0 0x7f30280b30e0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.697+0000 7f302e400640 1 --2- 172.21.15.55:0/662514551 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30280c59c0 0x7f3028159360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.697+0000 7f302e400640 1 --2- 172.21.15.55:0/662514551 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3008066690 0x7f3008068b50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.697+0000 7f302e400640 1 --2- 172.21.15.55:0/662514551 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3028098a10 0x7f30280b5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:18.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.697+0000 7f302e400640 1 -- 172.21.15.55:0/662514551 >> 172.21.15.55:0/662514551 conn(0x7f30280b1fb0 msgr2=0x7f302806ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:18.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.697+0000 7f302e400640 1 -- 172.21.15.55:0/662514551 shutdown_connections 2024-04-02T07:25:18.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.697+0000 7f302e400640 1 -- 172.21.15.55:0/662514551 wait complete. 2024-04-02T07:25:18.719 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-04-02T07:25:18.376441+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239456,"kb_used_data":6856,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754735264,"statfs":{"total":773094113280,"available":772848910336,"internally_reserved":0,"allocated":7020544,"data_stored":3593996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.989938"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.830538+0000","last_change":"2024-04-02T07:25:13.839144+0000","last_active":"2024-04-02T07:25:14.830538+0000","last_peered":"2024-04-02T07:25:14.830538+0000","last_clean":"2024-04-02T07:25:14.830538+0000","last_became_active":"2024-04-02T07:25:13.838871+0000","last_became_peered":"2024-04-02T07:25:13.838871+0000","last_unstale":"2024-04-02T07:25:14.830538+0000","last_undegraded":"2024-04-02T07:25:14.830538+0000","last_fullsized":"2024-04-02T07:25:14.830538+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:53:20.638660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829151+0000","last_change":"2024-04-02T07:25:13.838677+0000","last_active":"2024-04-02T07:25:14.829151+0000","last_peered":"2024-04-02T07:25:14.829151+0000","last_clean":"2024-04-02T07:25:14.829151+0000","last_became_active":"2024-04-02T07:25:13.838436+0000","last_became_peered":"2024-04-02T07:25:13.838436+0000","last_unstale":"2024-04-02T07:25:14.829151+0000","last_undegraded":"2024-04-02T07:25:14.829151+0000","last_fullsized":"2024-04-02T07:25:14.829151+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:55:42.022540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456256+0000","last_change":"2024-04-02T07:25:13.843698+0000","last_active":"2024-04-02T07:25:15.456256+0000","last_peered":"2024-04-02T07:25:15.456256+0000","last_clean":"2024-04-02T07:25:15.456256+0000","last_became_active":"2024-04-02T07:25:13.840368+0000","last_became_peered":"2024-04-02T07:25:13.840368+0000","last_unstale":"2024-04-02T07:25:15.456256+0000","last_undegraded":"2024-04-02T07:25:15.456256+0000","last_fullsized":"2024-04-02T07:25:15.456256+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:48:10.866582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455938+0000","last_change":"2024-04-02T07:25:13.829308+0000","last_active":"2024-04-02T07:25:15.455938+0000","last_peered":"2024-04-02T07:25:15.455938+0000","last_clean":"2024-04-02T07:25:15.455938+0000","last_became_active":"2024-04-02T07:25:13.829023+0000","last_became_peered":"2024-04-02T07:25:13.829023+0000","last_unstale":"2024-04-02T07:25:15.455938+0000","last_undegraded":"2024-04-02T07:25:15.455938+0000","last_fullsized":"2024-04-02T07:25:15.455938+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:18:24.553416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.830510+0000","last_change":"2024-04-02T07:25:13.837124+0000","last_active":"2024-04-02T07:25:14.830510+0000","last_peered":"2024-04-02T07:25:14.830510+0000","last_clean":"2024-04-02T07:25:14.830510+0000","last_became_active":"2024-04-02T07:25:13.836828+0000","last_became_peered":"2024-04-02T07:25:13.836828+0000","last_unstale":"2024-04-02T07:25:14.830510+0000","last_undegraded":"2024-04-02T07:25:14.830510+0000","last_fullsized":"2024-04-02T07:25:14.830510+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:27:19.539517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455427+0000","last_change":"2024-04-02T07:25:13.840680+0000","last_active":"2024-04-02T07:25:15.455427+0000","last_peered":"2024-04-02T07:25:15.455427+0000","last_clean":"2024-04-02T07:25:15.455427+0000","last_became_active":"2024-04-02T07:25:13.840435+0000","last_became_peered":"2024-04-02T07:25:13.840435+0000","last_unstale":"2024-04-02T07:25:15.455427+0000","last_undegraded":"2024-04-02T07:25:15.455427+0000","last_fullsized":"2024-04-02T07:25:15.455427+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:17:05.963406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826310+0000","last_change":"2024-04-02T07:25:13.828916+0000","last_active":"2024-04-02T07:25:14.826310+0000","last_peered":"2024-04-02T07:25:14.826310+0000","last_clean":"2024-04-02T07:25:14.826310+0000","last_became_active":"2024-04-02T07:25:13.828653+0000","last_became_peered":"2024-04-02T07:25:13.828653+0000","last_unstale":"2024-04-02T07:25:14.826310+0000","last_undegraded":"2024-04-02T07:25:14.826310+0000","last_fullsized":"2024-04-02T07:25:14.826310+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:37:31.544600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.828815+0000","last_change":"2024-04-02T07:25:13.832544+0000","last_active":"2024-04-02T07:25:14.828815+0000","last_peered":"2024-04-02T07:25:14.828815+0000","last_clean":"2024-04-02T07:25:14.828815+0000","last_became_active":"2024-04-02T07:25:13.831634+0000","last_became_peered":"2024-04-02T07:25:13.831634+0000","last_unstale":"2024-04-02T07:25:14.828815+0000","last_undegraded":"2024-04-02T07:25:14.828815+0000","last_fullsized":"2024-04-02T07:25:14.828815+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:22:24.369836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826801+0000","last_change":"2024-04-02T07:25:13.848365+0000","last_active":"2024-04-02T07:25:14.826801+0000","last_peered":"2024-04-02T07:25:14.826801+0000","last_clean":"2024-04-02T07:25:14.826801+0000","last_became_active":"2024-04-02T07:25:13.848075+0000","last_became_peered":"2024-04-02T07:25:13.848075+0000","last_unstale":"2024-04-02T07:25:14.826801+0000","last_undegraded":"2024-04-02T07:25:14.826801+0000","last_fullsized":"2024-04-02T07:25:14.826801+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:00:09.681534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455584+0000","last_change":"2024-04-02T07:25:13.830577+0000","last_active":"2024-04-02T07:25:15.455584+0000","last_peered":"2024-04-02T07:25:15.455584+0000","last_clean":"2024-04-02T07:25:15.455584+0000","last_became_active":"2024-04-02T07:25:13.830222+0000","last_became_peered":"2024-04-02T07:25:13.830222+0000","last_unstale":"2024-04-02T07:25:15.455584+0000","last_undegraded":"2024-04-02T07:25:15.455584+0000","last_fullsized":"2024-04-02T07:25:15.455584+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:49:54.955423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455298+0000","last_change":"2024-04-02T07:25:13.839434+0000","last_active":"2024-04-02T07:25:15.455298+0000","last_peered":"2024-04-02T07:25:15.455298+0000","last_clean":"2024-04-02T07:25:15.455298+0000","last_became_active":"2024-04-02T07:25:13.839191+0000","last_became_peered":"2024-04-02T07:25:13.839191+0000","last_unstale":"2024-04-02T07:25:15.455298+0000","last_undegraded":"2024-04-02T07:25:15.455298+0000","last_fullsized":"2024-04-02T07:25:15.455298+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:17:51.543470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455994+0000","last_change":"2024-04-02T07:25:13.833269+0000","last_active":"2024-04-02T07:25:15.455994+0000","last_peered":"2024-04-02T07:25:15.455994+0000","last_clean":"2024-04-02T07:25:15.455994+0000","last_became_active":"2024-04-02T07:25:13.832979+0000","last_became_peered":"2024-04-02T07:25:13.832979+0000","last_unstale":"2024-04-02T07:25:15.455994+0000","last_undegraded":"2024-04-02T07:25:15.455994+0000","last_fullsized":"2024-04-02T07:25:15.455994+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:51:16.504462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456762+0000","last_change":"2024-04-02T07:25:13.832987+0000","last_active":"2024-04-02T07:25:15.456762+0000","last_peered":"2024-04-02T07:25:15.456762+0000","last_clean":"2024-04-02T07:25:15.456762+0000","last_became_active":"2024-04-02T07:25:13.832625+0000","last_became_peered":"2024-04-02T07:25:13.832625+0000","last_unstale":"2024-04-02T07:25:15.456762+0000","last_undegraded":"2024-04-02T07:25:15.456762+0000","last_fullsized":"2024-04-02T07:25:15.456762+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:15:48.740463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826470+0000","last_change":"2024-04-02T07:25:13.834787+0000","last_active":"2024-04-02T07:25:14.826470+0000","last_peered":"2024-04-02T07:25:14.826470+0000","last_clean":"2024-04-02T07:25:14.826470+0000","last_became_active":"2024-04-02T07:25:13.831629+0000","last_became_peered":"2024-04-02T07:25:13.831629+0000","last_unstale":"2024-04-02T07:25:14.826470+0000","last_undegraded":"2024-04-02T07:25:14.826470+0000","last_fullsized":"2024-04-02T07:25:14.826470+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:35:15.300703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826560+0000","last_change":"2024-04-02T07:25:13.838509+0000","last_active":"2024-04-02T07:25:14.826560+0000","last_peered":"2024-04-02T07:25:14.826560+0000","last_clean":"2024-04-02T07:25:14.826560+0000","last_became_active":"2024-04-02T07:25:13.838180+0000","last_became_peered":"2024-04-02T07:25:13.838180+0000","last_unstale":"2024-04-02T07:25:14.826560+0000","last_undegraded":"2024-04-02T07:25:14.826560+0000","last_fullsized":"2024-04-02T07:25:14.826560+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:28:55.115477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455481+0000","last_change":"2024-04-02T07:25:13.845846+0000","last_active":"2024-04-02T07:25:15.455481+0000","last_peered":"2024-04-02T07:25:15.455481+0000","last_clean":"2024-04-02T07:25:15.455481+0000","last_became_active":"2024-04-02T07:25:13.845290+0000","last_became_peered":"2024-04-02T07:25:13.845290+0000","last_unstale":"2024-04-02T07:25:15.455481+0000","last_undegraded":"2024-04-02T07:25:15.455481+0000","last_fullsized":"2024-04-02T07:25:15.455481+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:02:07.068315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829308+0000","last_change":"2024-04-02T07:25:13.834576+0000","last_active":"2024-04-02T07:25:14.829308+0000","last_peered":"2024-04-02T07:25:14.829308+0000","last_clean":"2024-04-02T07:25:14.829308+0000","last_became_active":"2024-04-02T07:25:13.834288+0000","last_became_peered":"2024-04-02T07:25:13.834288+0000","last_unstale":"2024-04-02T07:25:14.829308+0000","last_undegraded":"2024-04-02T07:25:14.829308+0000","last_fullsized":"2024-04-02T07:25:14.829308+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:10:06.210851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456362+0000","last_change":"2024-04-02T07:25:13.843458+0000","last_active":"2024-04-02T07:25:15.456362+0000","last_peered":"2024-04-02T07:25:15.456362+0000","last_clean":"2024-04-02T07:25:15.456362+0000","last_became_active":"2024-04-02T07:25:13.842905+0000","last_became_peered":"2024-04-02T07:25:13.842905+0000","last_unstale":"2024-04-02T07:25:15.456362+0000","last_undegraded":"2024-04-02T07:25:15.456362+0000","last_fullsized":"2024-04-02T07:25:15.456362+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:55:32.708707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.830482+0000","last_change":"2024-04-02T07:25:13.838336+0000","last_active":"2024-04-02T07:25:14.830482+0000","last_peered":"2024-04-02T07:25:14.830482+0000","last_clean":"2024-04-02T07:25:14.830482+0000","last_became_active":"2024-04-02T07:25:13.838042+0000","last_became_peered":"2024-04-02T07:25:13.838042+0000","last_unstale":"2024-04-02T07:25:14.830482+0000","last_undegraded":"2024-04-02T07:25:14.830482+0000","last_fullsized":"2024-04-02T07:25:14.830482+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:18:53.200389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829194+0000","last_change":"2024-04-02T07:25:13.838204+0000","last_active":"2024-04-02T07:25:14.829194+0000","last_peered":"2024-04-02T07:25:14.829194+0000","last_clean":"2024-04-02T07:25:14.829194+0000","last_became_active":"2024-04-02T07:25:13.837836+0000","last_became_peered":"2024-04-02T07:25:13.837836+0000","last_unstale":"2024-04-02T07:25:14.829194+0000","last_undegraded":"2024-04-02T07:25:14.829194+0000","last_fullsized":"2024-04-02T07:25:14.829194+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:45:25.339615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455360+0000","last_change":"2024-04-02T07:25:13.836353+0000","last_active":"2024-04-02T07:25:15.455360+0000","last_peered":"2024-04-02T07:25:15.455360+0000","last_clean":"2024-04-02T07:25:15.455360+0000","last_became_active":"2024-04-02T07:25:13.836102+0000","last_became_peered":"2024-04-02T07:25:13.836102+0000","last_unstale":"2024-04-02T07:25:15.455360+0000","last_undegraded":"2024-04-02T07:25:15.455360+0000","last_fullsized":"2024-04-02T07:25:15.455360+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:34:55.188580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829053+0000","last_change":"2024-04-02T07:25:13.832801+0000","last_active":"2024-04-02T07:25:14.829053+0000","last_peered":"2024-04-02T07:25:14.829053+0000","last_clean":"2024-04-02T07:25:14.829053+0000","last_became_active":"2024-04-02T07:25:13.832250+0000","last_became_peered":"2024-04-02T07:25:13.832250+0000","last_unstale":"2024-04-02T07:25:14.829053+0000","last_undegraded":"2024-04-02T07:25:14.829053+0000","last_fullsized":"2024-04-02T07:25:14.829053+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:57:20.665756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455366+0000","last_change":"2024-04-02T07:25:13.844142+0000","last_active":"2024-04-02T07:25:15.455366+0000","last_peered":"2024-04-02T07:25:15.455366+0000","last_clean":"2024-04-02T07:25:15.455366+0000","last_became_active":"2024-04-02T07:25:13.843777+0000","last_became_peered":"2024-04-02T07:25:13.843777+0000","last_unstale":"2024-04-02T07:25:15.455366+0000","last_undegraded":"2024-04-02T07:25:15.455366+0000","last_fullsized":"2024-04-02T07:25:15.455366+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:49:41.992789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456107+0000","last_change":"2024-04-02T07:25:13.834559+0000","last_active":"2024-04-02T07:25:15.456107+0000","last_peered":"2024-04-02T07:25:15.456107+0000","last_clean":"2024-04-02T07:25:15.456107+0000","last_became_active":"2024-04-02T07:25:13.833967+0000","last_became_peered":"2024-04-02T07:25:13.833967+0000","last_unstale":"2024-04-02T07:25:15.456107+0000","last_undegraded":"2024-04-02T07:25:15.456107+0000","last_fullsized":"2024-04-02T07:25:15.456107+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:04:16.273349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.830598+0000","last_change":"2024-04-02T07:25:13.847877+0000","last_active":"2024-04-02T07:25:14.830598+0000","last_peered":"2024-04-02T07:25:14.830598+0000","last_clean":"2024-04-02T07:25:14.830598+0000","last_became_active":"2024-04-02T07:25:13.847022+0000","last_became_peered":"2024-04-02T07:25:13.847022+0000","last_unstale":"2024-04-02T07:25:14.830598+0000","last_undegraded":"2024-04-02T07:25:14.830598+0000","last_fullsized":"2024-04-02T07:25:14.830598+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:32:33.134234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455946+0000","last_change":"2024-04-02T07:25:13.837984+0000","last_active":"2024-04-02T07:25:15.455946+0000","last_peered":"2024-04-02T07:25:15.455946+0000","last_clean":"2024-04-02T07:25:15.455946+0000","last_became_active":"2024-04-02T07:25:13.837732+0000","last_became_peered":"2024-04-02T07:25:13.837732+0000","last_unstale":"2024-04-02T07:25:15.455946+0000","last_undegraded":"2024-04-02T07:25:15.455946+0000","last_fullsized":"2024-04-02T07:25:15.455946+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:56:30.473912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455639+0000","last_change":"2024-04-02T07:25:13.833228+0000","last_active":"2024-04-02T07:25:15.455639+0000","last_peered":"2024-04-02T07:25:15.455639+0000","last_clean":"2024-04-02T07:25:15.455639+0000","last_became_active":"2024-04-02T07:25:13.833014+0000","last_became_peered":"2024-04-02T07:25:13.833014+0000","last_unstale":"2024-04-02T07:25:15.455639+0000","last_undegraded":"2024-04-02T07:25:15.455639+0000","last_fullsized":"2024-04-02T07:25:15.455639+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:15:58.074270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.830579+0000","last_change":"2024-04-02T07:25:13.831253+0000","last_active":"2024-04-02T07:25:14.830579+0000","last_peered":"2024-04-02T07:25:14.830579+0000","last_clean":"2024-04-02T07:25:14.830579+0000","last_became_active":"2024-04-02T07:25:13.829934+0000","last_became_peered":"2024-04-02T07:25:13.829934+0000","last_unstale":"2024-04-02T07:25:14.830579+0000","last_undegraded":"2024-04-02T07:25:14.830579+0000","last_fullsized":"2024-04-02T07:25:14.830579+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:47:51.522549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829142+0000","last_change":"2024-04-02T07:25:13.838011+0000","last_active":"2024-04-02T07:25:14.829142+0000","last_peered":"2024-04-02T07:25:14.829142+0000","last_clean":"2024-04-02T07:25:14.829142+0000","last_became_active":"2024-04-02T07:25:13.837672+0000","last_became_peered":"2024-04-02T07:25:13.837672+0000","last_unstale":"2024-04-02T07:25:14.829142+0000","last_undegraded":"2024-04-02T07:25:14.829142+0000","last_fullsized":"2024-04-02T07:25:14.829142+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:49:41.992789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455360+0000","last_change":"2024-04-02T07:25:13.838228+0000","last_active":"2024-04-02T07:25:15.455360+0000","last_peered":"2024-04-02T07:25:15.455360+0000","last_clean":"2024-04-02T07:25:15.455360+0000","last_became_active":"2024-04-02T07:25:13.837579+0000","last_became_peered":"2024-04-02T07:25:13.837579+0000","last_unstale":"2024-04-02T07:25:15.455360+0000","last_undegraded":"2024-04-02T07:25:15.455360+0000","last_fullsized":"2024-04-02T07:25:15.455360+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:55:52.300846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.830321+0000","last_change":"2024-04-02T07:25:13.847345+0000","last_active":"2024-04-02T07:25:14.830321+0000","last_peered":"2024-04-02T07:25:14.830321+0000","last_clean":"2024-04-02T07:25:14.830321+0000","last_became_active":"2024-04-02T07:25:13.847026+0000","last_became_peered":"2024-04-02T07:25:13.847026+0000","last_unstale":"2024-04-02T07:25:14.830321+0000","last_undegraded":"2024-04-02T07:25:14.830321+0000","last_fullsized":"2024-04-02T07:25:14.830321+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:17:07.326518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455574+0000","last_change":"2024-04-02T07:25:13.846009+0000","last_active":"2024-04-02T07:25:15.455574+0000","last_peered":"2024-04-02T07:25:15.455574+0000","last_clean":"2024-04-02T07:25:15.455574+0000","last_became_active":"2024-04-02T07:25:13.845605+0000","last_became_peered":"2024-04-02T07:25:13.845605+0000","last_unstale":"2024-04-02T07:25:15.455574+0000","last_undegraded":"2024-04-02T07:25:15.455574+0000","last_fullsized":"2024-04-02T07:25:15.455574+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:44:09.371280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455904+0000","last_change":"2024-04-02T07:25:13.841312+0000","last_active":"2024-04-02T07:25:15.455904+0000","last_peered":"2024-04-02T07:25:15.455904+0000","last_clean":"2024-04-02T07:25:15.455904+0000","last_became_active":"2024-04-02T07:25:13.840560+0000","last_became_peered":"2024-04-02T07:25:13.840560+0000","last_unstale":"2024-04-02T07:25:15.455904+0000","last_undegraded":"2024-04-02T07:25:15.455904+0000","last_fullsized":"2024-04-02T07:25:15.455904+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:55:32.708707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456048+0000","last_change":"2024-04-02T07:25:13.415068+0000","last_active":"2024-04-02T07:25:15.456048+0000","last_peered":"2024-04-02T07:25:15.456048+0000","last_clean":"2024-04-02T07:25:15.456048+0000","last_became_active":"2024-04-02T07:25:13.414817+0000","last_became_peered":"2024-04-02T07:25:13.414817+0000","last_unstale":"2024-04-02T07:25:15.456048+0000","last_undegraded":"2024-04-02T07:25:15.456048+0000","last_fullsized":"2024-04-02T07:25:15.456048+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:07:08.173462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455590+0000","last_change":"2024-04-02T07:25:13.838505+0000","last_active":"2024-04-02T07:25:15.455590+0000","last_peered":"2024-04-02T07:25:15.455590+0000","last_clean":"2024-04-02T07:25:15.455590+0000","last_became_active":"2024-04-02T07:25:13.838240+0000","last_became_peered":"2024-04-02T07:25:13.838240+0000","last_unstale":"2024-04-02T07:25:15.455590+0000","last_undegraded":"2024-04-02T07:25:15.455590+0000","last_fullsized":"2024-04-02T07:25:15.455590+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:03:59.723055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829249+0000","last_change":"2024-04-02T07:25:13.424079+0000","last_active":"2024-04-02T07:25:14.829249+0000","last_peered":"2024-04-02T07:25:14.829249+0000","last_clean":"2024-04-02T07:25:14.829249+0000","last_became_active":"2024-04-02T07:25:13.423746+0000","last_became_peered":"2024-04-02T07:25:13.423746+0000","last_unstale":"2024-04-02T07:25:14.829249+0000","last_undegraded":"2024-04-02T07:25:14.829249+0000","last_fullsized":"2024-04-02T07:25:14.829249+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:18:23.550256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455715+0000","last_change":"2024-04-02T07:25:13.843729+0000","last_active":"2024-04-02T07:25:15.455715+0000","last_peered":"2024-04-02T07:25:15.455715+0000","last_clean":"2024-04-02T07:25:15.455715+0000","last_became_active":"2024-04-02T07:25:13.843443+0000","last_became_peered":"2024-04-02T07:25:13.843443+0000","last_unstale":"2024-04-02T07:25:15.455715+0000","last_undegraded":"2024-04-02T07:25:15.455715+0000","last_fullsized":"2024-04-02T07:25:15.455715+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:36:10.654914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455971+0000","last_change":"2024-04-02T07:25:13.416627+0000","last_active":"2024-04-02T07:25:15.455971+0000","last_peered":"2024-04-02T07:25:15.455971+0000","last_clean":"2024-04-02T07:25:15.455971+0000","last_became_active":"2024-04-02T07:25:13.415857+0000","last_became_peered":"2024-04-02T07:25:13.415857+0000","last_unstale":"2024-04-02T07:25:15.455971+0000","last_undegraded":"2024-04-02T07:25:15.455971+0000","last_fullsized":"2024-04-02T07:25:15.455971+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:45:45.317797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455862+0000","last_change":"2024-04-02T07:25:13.835778+0000","last_active":"2024-04-02T07:25:15.455862+0000","last_peered":"2024-04-02T07:25:15.455862+0000","last_clean":"2024-04-02T07:25:15.455862+0000","last_became_active":"2024-04-02T07:25:13.835268+0000","last_became_peered":"2024-04-02T07:25:13.835268+0000","last_unstale":"2024-04-02T07:25:15.455862+0000","last_undegraded":"2024-04-02T07:25:15.455862+0000","last_fullsized":"2024-04-02T07:25:15.455862+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:48:10.866582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456028+0000","last_change":"2024-04-02T07:25:13.421639+0000","last_active":"2024-04-02T07:25:15.456028+0000","last_peered":"2024-04-02T07:25:15.456028+0000","last_clean":"2024-04-02T07:25:15.456028+0000","last_became_active":"2024-04-02T07:25:13.421395+0000","last_became_peered":"2024-04-02T07:25:13.421395+0000","last_unstale":"2024-04-02T07:25:15.456028+0000","last_undegraded":"2024-04-02T07:25:15.456028+0000","last_fullsized":"2024-04-02T07:25:15.456028+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:45:59.216395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829495+0000","last_change":"2024-04-02T07:25:13.832954+0000","last_active":"2024-04-02T07:25:14.829495+0000","last_peered":"2024-04-02T07:25:14.829495+0000","last_clean":"2024-04-02T07:25:14.829495+0000","last_became_active":"2024-04-02T07:25:13.832570+0000","last_became_peered":"2024-04-02T07:25:13.832570+0000","last_unstale":"2024-04-02T07:25:14.829495+0000","last_undegraded":"2024-04-02T07:25:14.829495+0000","last_fullsized":"2024-04-02T07:25:14.829495+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:25:16.892809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826681+0000","last_change":"2024-04-02T07:25:13.420222+0000","last_active":"2024-04-02T07:25:14.826681+0000","last_peered":"2024-04-02T07:25:14.826681+0000","last_clean":"2024-04-02T07:25:14.826681+0000","last_became_active":"2024-04-02T07:25:13.419887+0000","last_became_peered":"2024-04-02T07:25:13.419887+0000","last_unstale":"2024-04-02T07:25:14.826681+0000","last_undegraded":"2024-04-02T07:25:14.826681+0000","last_fullsized":"2024-04-02T07:25:14.826681+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:03:58.719895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829048+0000","last_change":"2024-04-02T07:25:13.850986+0000","last_active":"2024-04-02T07:25:14.829048+0000","last_peered":"2024-04-02T07:25:14.829048+0000","last_clean":"2024-04-02T07:25:14.829048+0000","last_became_active":"2024-04-02T07:25:13.850156+0000","last_became_peered":"2024-04-02T07:25:13.850156+0000","last_unstale":"2024-04-02T07:25:14.829048+0000","last_undegraded":"2024-04-02T07:25:14.829048+0000","last_fullsized":"2024-04-02T07:25:14.829048+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:07.833961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455873+0000","last_change":"2024-04-02T07:25:13.416810+0000","last_active":"2024-04-02T07:25:15.455873+0000","last_peered":"2024-04-02T07:25:15.455873+0000","last_clean":"2024-04-02T07:25:15.455873+0000","last_became_active":"2024-04-02T07:25:13.416223+0000","last_became_peered":"2024-04-02T07:25:13.416223+0000","last_unstale":"2024-04-02T07:25:15.455873+0000","last_undegraded":"2024-04-02T07:25:15.455873+0000","last_fullsized":"2024-04-02T07:25:15.455873+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:35:14.297544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456165+0000","last_change":"2024-04-02T07:25:13.834761+0000","last_active":"2024-04-02T07:25:15.456165+0000","last_peered":"2024-04-02T07:25:15.456165+0000","last_clean":"2024-04-02T07:25:15.456165+0000","last_became_active":"2024-04-02T07:25:13.834324+0000","last_became_peered":"2024-04-02T07:25:13.834324+0000","last_unstale":"2024-04-02T07:25:15.456165+0000","last_undegraded":"2024-04-02T07:25:15.456165+0000","last_fullsized":"2024-04-02T07:25:15.456165+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:53:24.682624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455725+0000","last_change":"2024-04-02T07:25:13.419532+0000","last_active":"2024-04-02T07:25:15.455725+0000","last_peered":"2024-04-02T07:25:15.455725+0000","last_clean":"2024-04-02T07:25:15.455725+0000","last_became_active":"2024-04-02T07:25:13.419219+0000","last_became_peered":"2024-04-02T07:25:13.419219+0000","last_unstale":"2024-04-02T07:25:15.455725+0000","last_undegraded":"2024-04-02T07:25:15.455725+0000","last_fullsized":"2024-04-02T07:25:15.455725+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:27:54.548904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.828913+0000","last_change":"2024-04-02T07:25:13.834100+0000","last_active":"2024-04-02T07:25:14.828913+0000","last_peered":"2024-04-02T07:25:14.828913+0000","last_clean":"2024-04-02T07:25:14.828913+0000","last_became_active":"2024-04-02T07:25:13.833716+0000","last_became_peered":"2024-04-02T07:25:13.833716+0000","last_unstale":"2024-04-02T07:25:14.828913+0000","last_undegraded":"2024-04-02T07:25:14.828913+0000","last_fullsized":"2024-04-02T07:25:14.828913+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:41:14.947839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826382+0000","last_change":"2024-04-02T07:25:13.424479+0000","last_active":"2024-04-02T07:25:14.826382+0000","last_peered":"2024-04-02T07:25:14.826382+0000","last_clean":"2024-04-02T07:25:14.826382+0000","last_became_active":"2024-04-02T07:25:13.424050+0000","last_became_peered":"2024-04-02T07:25:13.424050+0000","last_unstale":"2024-04-02T07:25:14.826382+0000","last_undegraded":"2024-04-02T07:25:14.826382+0000","last_fullsized":"2024-04-02T07:25:14.826382+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:24:14.617250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826801+0000","last_change":"2024-04-02T07:25:13.834396+0000","last_active":"2024-04-02T07:25:14.826801+0000","last_peered":"2024-04-02T07:25:14.826801+0000","last_clean":"2024-04-02T07:25:14.826801+0000","last_became_active":"2024-04-02T07:25:13.834132+0000","last_became_peered":"2024-04-02T07:25:13.834132+0000","last_unstale":"2024-04-02T07:25:14.826801+0000","last_undegraded":"2024-04-02T07:25:14.826801+0000","last_fullsized":"2024-04-02T07:25:14.826801+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:09:15.330565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456685+0000","last_change":"2024-04-02T07:25:13.422718+0000","last_active":"2024-04-02T07:25:15.456685+0000","last_peered":"2024-04-02T07:25:15.456685+0000","last_clean":"2024-04-02T07:25:15.456685+0000","last_became_active":"2024-04-02T07:25:13.422325+0000","last_became_peered":"2024-04-02T07:25:13.422325+0000","last_unstale":"2024-04-02T07:25:15.456685+0000","last_undegraded":"2024-04-02T07:25:15.456685+0000","last_fullsized":"2024-04-02T07:25:15.456685+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:37:30.541440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456689+0000","last_change":"2024-04-02T07:25:13.847554+0000","last_active":"2024-04-02T07:25:15.456689+0000","last_peered":"2024-04-02T07:25:15.456689+0000","last_clean":"2024-04-02T07:25:15.456689+0000","last_became_active":"2024-04-02T07:25:13.847256+0000","last_became_peered":"2024-04-02T07:25:13.847256+0000","last_unstale":"2024-04-02T07:25:15.456689+0000","last_undegraded":"2024-04-02T07:25:15.456689+0000","last_fullsized":"2024-04-02T07:25:15.456689+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:15:58.074270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829305+0000","last_change":"2024-04-02T07:25:13.422323+0000","last_active":"2024-04-02T07:25:14.829305+0000","last_peered":"2024-04-02T07:25:14.829305+0000","last_clean":"2024-04-02T07:25:14.829305+0000","last_became_active":"2024-04-02T07:25:13.422067+0000","last_became_peered":"2024-04-02T07:25:13.422067+0000","last_unstale":"2024-04-02T07:25:14.829305+0000","last_undegraded":"2024-04-02T07:25:14.829305+0000","last_fullsized":"2024-04-02T07:25:14.829305+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:42:18.216499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455183+0000","last_change":"2024-04-02T07:25:13.842448+0000","last_active":"2024-04-02T07:25:15.455183+0000","last_peered":"2024-04-02T07:25:15.455183+0000","last_clean":"2024-04-02T07:25:15.455183+0000","last_became_active":"2024-04-02T07:25:13.841871+0000","last_became_peered":"2024-04-02T07:25:13.841871+0000","last_unstale":"2024-04-02T07:25:15.455183+0000","last_undegraded":"2024-04-02T07:25:15.455183+0000","last_fullsized":"2024-04-02T07:25:15.455183+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:04:16.273349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456485+0000","last_change":"2024-04-02T07:25:13.420126+0000","last_active":"2024-04-02T07:25:15.456485+0000","last_peered":"2024-04-02T07:25:15.456485+0000","last_clean":"2024-04-02T07:25:15.456485+0000","last_became_active":"2024-04-02T07:25:13.419873+0000","last_became_peered":"2024-04-02T07:25:13.419873+0000","last_unstale":"2024-04-02T07:25:15.456485+0000","last_undegraded":"2024-04-02T07:25:15.456485+0000","last_fullsized":"2024-04-02T07:25:15.456485+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:07:08.173462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456356+0000","last_change":"2024-04-02T07:25:13.847728+0000","last_active":"2024-04-02T07:25:15.456356+0000","last_peered":"2024-04-02T07:25:15.456356+0000","last_clean":"2024-04-02T07:25:15.456356+0000","last_became_active":"2024-04-02T07:25:13.847425+0000","last_became_peered":"2024-04-02T07:25:13.847425+0000","last_unstale":"2024-04-02T07:25:15.456356+0000","last_undegraded":"2024-04-02T07:25:15.456356+0000","last_fullsized":"2024-04-02T07:25:15.456356+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:02:07.068315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826768+0000","last_change":"2024-04-02T07:25:13.424042+0000","last_active":"2024-04-02T07:25:14.826768+0000","last_peered":"2024-04-02T07:25:14.826768+0000","last_clean":"2024-04-02T07:25:14.826768+0000","last_became_active":"2024-04-02T07:25:13.423787+0000","last_became_peered":"2024-04-02T07:25:13.423787+0000","last_unstale":"2024-04-02T07:25:14.826768+0000","last_undegraded":"2024-04-02T07:25:14.826768+0000","last_fullsized":"2024-04-02T07:25:14.826768+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:17:50.540310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455659+0000","last_change":"2024-04-02T07:25:13.830681+0000","last_active":"2024-04-02T07:25:15.455659+0000","last_peered":"2024-04-02T07:25:15.455659+0000","last_clean":"2024-04-02T07:25:15.455659+0000","last_became_active":"2024-04-02T07:25:13.830405+0000","last_became_peered":"2024-04-02T07:25:13.830405+0000","last_unstale":"2024-04-02T07:25:15.455659+0000","last_undegraded":"2024-04-02T07:25:15.455659+0000","last_fullsized":"2024-04-02T07:25:15.455659+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:23:03.626287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829140+0000","last_change":"2024-04-02T07:25:13.424149+0000","last_active":"2024-04-02T07:25:14.829140+0000","last_peered":"2024-04-02T07:25:14.829140+0000","last_clean":"2024-04-02T07:25:14.829140+0000","last_became_active":"2024-04-02T07:25:13.423867+0000","last_became_peered":"2024-04-02T07:25:13.423867+0000","last_unstale":"2024-04-02T07:25:14.829140+0000","last_undegraded":"2024-04-02T07:25:14.829140+0000","last_fullsized":"2024-04-02T07:25:14.829140+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:01:49.923849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456264+0000","last_change":"2024-04-02T07:25:13.832846+0000","last_active":"2024-04-02T07:25:15.456264+0000","last_peered":"2024-04-02T07:25:15.456264+0000","last_clean":"2024-04-02T07:25:15.456264+0000","last_became_active":"2024-04-02T07:25:13.832047+0000","last_became_peered":"2024-04-02T07:25:13.832047+0000","last_unstale":"2024-04-02T07:25:15.456264+0000","last_undegraded":"2024-04-02T07:25:15.456264+0000","last_fullsized":"2024-04-02T07:25:15.456264+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:17:05.963406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456862+0000","last_change":"2024-04-02T07:25:13.414656+0000","last_active":"2024-04-02T07:25:15.456862+0000","last_peered":"2024-04-02T07:25:15.456862+0000","last_clean":"2024-04-02T07:25:15.456862+0000","last_became_active":"2024-04-02T07:25:13.414393+0000","last_became_peered":"2024-04-02T07:25:13.414393+0000","last_unstale":"2024-04-02T07:25:15.456862+0000","last_undegraded":"2024-04-02T07:25:15.456862+0000","last_fullsized":"2024-04-02T07:25:15.456862+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:40:18.231963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826312+0000","last_change":"2024-04-02T07:25:13.839714+0000","last_active":"2024-04-02T07:25:14.826312+0000","last_peered":"2024-04-02T07:25:14.826312+0000","last_clean":"2024-04-02T07:25:14.826312+0000","last_became_active":"2024-04-02T07:25:13.833918+0000","last_became_peered":"2024-04-02T07:25:13.833918+0000","last_unstale":"2024-04-02T07:25:14.826312+0000","last_undegraded":"2024-04-02T07:25:14.826312+0000","last_fullsized":"2024-04-02T07:25:14.826312+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:45:37.603677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455850+0000","last_change":"2024-04-02T07:25:13.415326+0000","last_active":"2024-04-02T07:25:15.455850+0000","last_peered":"2024-04-02T07:25:15.455850+0000","last_clean":"2024-04-02T07:25:15.455850+0000","last_became_active":"2024-04-02T07:25:13.414772+0000","last_became_peered":"2024-04-02T07:25:13.414772+0000","last_unstale":"2024-04-02T07:25:15.455850+0000","last_undegraded":"2024-04-02T07:25:15.455850+0000","last_fullsized":"2024-04-02T07:25:15.455850+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:15:47.737303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456287+0000","last_change":"2024-04-02T07:25:13.844036+0000","last_active":"2024-04-02T07:25:15.456287+0000","last_peered":"2024-04-02T07:25:15.456287+0000","last_clean":"2024-04-02T07:25:15.456287+0000","last_became_active":"2024-04-02T07:25:13.843573+0000","last_became_peered":"2024-04-02T07:25:13.843573+0000","last_unstale":"2024-04-02T07:25:15.456287+0000","last_undegraded":"2024-04-02T07:25:15.456287+0000","last_fullsized":"2024-04-02T07:25:15.456287+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:38:46.221450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":19,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455276+0000","last_change":"2024-04-02T07:25:13.415882+0000","last_active":"2024-04-02T07:25:15.455276+0000","last_peered":"2024-04-02T07:25:15.455276+0000","last_clean":"2024-04-02T07:25:15.455276+0000","last_became_active":"2024-04-02T07:25:13.415566+0000","last_became_peered":"2024-04-02T07:25:13.415566+0000","last_unstale":"2024-04-02T07:25:15.455276+0000","last_undegraded":"2024-04-02T07:25:15.455276+0000","last_fullsized":"2024-04-02T07:25:15.455276+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:35:14.297544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456467+0000","last_change":"2024-04-02T07:25:13.838691+0000","last_active":"2024-04-02T07:25:15.456467+0000","last_peered":"2024-04-02T07:25:15.456467+0000","last_clean":"2024-04-02T07:25:15.456467+0000","last_became_active":"2024-04-02T07:25:13.838425+0000","last_became_peered":"2024-04-02T07:25:13.838425+0000","last_unstale":"2024-04-02T07:25:15.456467+0000","last_undegraded":"2024-04-02T07:25:15.456467+0000","last_fullsized":"2024-04-02T07:25:15.456467+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:44:09.371280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829430+0000","last_change":"2024-04-02T07:25:13.420012+0000","last_active":"2024-04-02T07:25:14.829430+0000","last_peered":"2024-04-02T07:25:14.829430+0000","last_clean":"2024-04-02T07:25:14.829430+0000","last_became_active":"2024-04-02T07:25:13.419709+0000","last_became_peered":"2024-04-02T07:25:13.419709+0000","last_unstale":"2024-04-02T07:25:14.829430+0000","last_undegraded":"2024-04-02T07:25:14.829430+0000","last_fullsized":"2024-04-02T07:25:14.829430+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:13:17.056274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456169+0000","last_change":"2024-04-02T07:25:13.841727+0000","last_active":"2024-04-02T07:25:15.456169+0000","last_peered":"2024-04-02T07:25:15.456169+0000","last_clean":"2024-04-02T07:25:15.456169+0000","last_became_active":"2024-04-02T07:25:13.841192+0000","last_became_peered":"2024-04-02T07:25:13.841192+0000","last_unstale":"2024-04-02T07:25:15.456169+0000","last_undegraded":"2024-04-02T07:25:15.456169+0000","last_fullsized":"2024-04-02T07:25:15.456169+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:24:57.139678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455908+0000","last_change":"2024-04-02T07:25:13.415637+0000","last_active":"2024-04-02T07:25:15.455908+0000","last_peered":"2024-04-02T07:25:15.455908+0000","last_clean":"2024-04-02T07:25:15.455908+0000","last_became_active":"2024-04-02T07:25:13.414724+0000","last_became_peered":"2024-04-02T07:25:13.414724+0000","last_unstale":"2024-04-02T07:25:15.455908+0000","last_undegraded":"2024-04-02T07:25:15.455908+0000","last_fullsized":"2024-04-02T07:25:15.455908+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:27:54.548904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829302+0000","last_change":"2024-04-02T07:25:13.838727+0000","last_active":"2024-04-02T07:25:14.829302+0000","last_peered":"2024-04-02T07:25:14.829302+0000","last_clean":"2024-04-02T07:25:14.829302+0000","last_became_active":"2024-04-02T07:25:13.838464+0000","last_became_peered":"2024-04-02T07:25:13.838464+0000","last_unstale":"2024-04-02T07:25:14.829302+0000","last_undegraded":"2024-04-02T07:25:14.829302+0000","last_fullsized":"2024-04-02T07:25:14.829302+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:08:26.104078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455935+0000","last_change":"2024-04-02T07:25:13.421116+0000","last_active":"2024-04-02T07:25:15.455935+0000","last_peered":"2024-04-02T07:25:15.455935+0000","last_clean":"2024-04-02T07:25:15.455935+0000","last_became_active":"2024-04-02T07:25:13.420829+0000","last_became_peered":"2024-04-02T07:25:13.420829+0000","last_unstale":"2024-04-02T07:25:15.455935+0000","last_undegraded":"2024-04-02T07:25:15.455935+0000","last_fullsized":"2024-04-02T07:25:15.455935+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:30:45.003944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456455+0000","last_change":"2024-04-02T07:25:13.848913+0000","last_active":"2024-04-02T07:25:15.456455+0000","last_peered":"2024-04-02T07:25:15.456455+0000","last_clean":"2024-04-02T07:25:15.456455+0000","last_became_active":"2024-04-02T07:25:13.847541+0000","last_became_peered":"2024-04-02T07:25:13.847541+0000","last_unstale":"2024-04-02T07:25:15.456455+0000","last_undegraded":"2024-04-02T07:25:15.456455+0000","last_fullsized":"2024-04-02T07:25:15.456455+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:36:10.654914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455804+0000","last_change":"2024-04-02T07:25:13.420298+0000","last_active":"2024-04-02T07:25:15.455804+0000","last_peered":"2024-04-02T07:25:15.455804+0000","last_clean":"2024-04-02T07:25:15.455804+0000","last_became_active":"2024-04-02T07:25:13.419940+0000","last_became_peered":"2024-04-02T07:25:13.419940+0000","last_unstale":"2024-04-02T07:25:15.455804+0000","last_undegraded":"2024-04-02T07:25:15.455804+0000","last_fullsized":"2024-04-02T07:25:15.455804+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:45:36.600517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456068+0000","last_change":"2024-04-02T07:25:13.841576+0000","last_active":"2024-04-02T07:25:15.456068+0000","last_peered":"2024-04-02T07:25:15.456068+0000","last_clean":"2024-04-02T07:25:15.456068+0000","last_became_active":"2024-04-02T07:25:13.841305+0000","last_became_peered":"2024-04-02T07:25:13.841305+0000","last_unstale":"2024-04-02T07:25:15.456068+0000","last_undegraded":"2024-04-02T07:25:15.456068+0000","last_fullsized":"2024-04-02T07:25:15.456068+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:30:14.485175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829230+0000","last_change":"2024-04-02T07:25:13.419301+0000","last_active":"2024-04-02T07:25:14.829230+0000","last_peered":"2024-04-02T07:25:14.829230+0000","last_clean":"2024-04-02T07:25:14.829230+0000","last_became_active":"2024-04-02T07:25:13.419018+0000","last_became_peered":"2024-04-02T07:25:13.419018+0000","last_unstale":"2024-04-02T07:25:14.829230+0000","last_undegraded":"2024-04-02T07:25:14.829230+0000","last_fullsized":"2024-04-02T07:25:14.829230+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:37:21.580450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455561+0000","last_change":"2024-04-02T07:25:13.845285+0000","last_active":"2024-04-02T07:25:15.455561+0000","last_peered":"2024-04-02T07:25:15.455561+0000","last_clean":"2024-04-02T07:25:15.455561+0000","last_became_active":"2024-04-02T07:25:13.845046+0000","last_became_peered":"2024-04-02T07:25:13.845046+0000","last_unstale":"2024-04-02T07:25:15.455561+0000","last_undegraded":"2024-04-02T07:25:15.455561+0000","last_fullsized":"2024-04-02T07:25:15.455561+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:51:16.504462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455070+0000","last_change":"2024-04-02T07:25:13.414596+0000","last_active":"2024-04-02T07:25:15.455070+0000","last_peered":"2024-04-02T07:25:15.455070+0000","last_clean":"2024-04-02T07:25:15.455070+0000","last_became_active":"2024-04-02T07:25:13.414339+0000","last_became_peered":"2024-04-02T07:25:13.414339+0000","last_unstale":"2024-04-02T07:25:15.455070+0000","last_undegraded":"2024-04-02T07:25:15.455070+0000","last_fullsized":"2024-04-02T07:25:15.455070+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:30:09.018484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455712+0000","last_change":"2024-04-02T07:25:13.841015+0000","last_active":"2024-04-02T07:25:15.455712+0000","last_peered":"2024-04-02T07:25:15.455712+0000","last_clean":"2024-04-02T07:25:15.455712+0000","last_became_active":"2024-04-02T07:25:13.840145+0000","last_became_peered":"2024-04-02T07:25:13.840145+0000","last_unstale":"2024-04-02T07:25:15.455712+0000","last_undegraded":"2024-04-02T07:25:15.455712+0000","last_fullsized":"2024-04-02T07:25:15.455712+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:56:30.473912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455692+0000","last_change":"2024-04-02T07:25:13.419192+0000","last_active":"2024-04-02T07:25:15.455692+0000","last_peered":"2024-04-02T07:25:15.455692+0000","last_clean":"2024-04-02T07:25:15.455692+0000","last_became_active":"2024-04-02T07:25:13.418954+0000","last_became_peered":"2024-04-02T07:25:13.418954+0000","last_unstale":"2024-04-02T07:25:15.455692+0000","last_undegraded":"2024-04-02T07:25:15.455692+0000","last_fullsized":"2024-04-02T07:25:15.455692+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:45:45.317797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456108+0000","last_change":"2024-04-02T07:25:13.828785+0000","last_active":"2024-04-02T07:25:15.456108+0000","last_peered":"2024-04-02T07:25:15.456108+0000","last_clean":"2024-04-02T07:25:15.456108+0000","last_became_active":"2024-04-02T07:25:13.827672+0000","last_became_peered":"2024-04-02T07:25:13.827672+0000","last_unstale":"2024-04-02T07:25:15.456108+0000","last_undegraded":"2024-04-02T07:25:15.456108+0000","last_fullsized":"2024-04-02T07:25:15.456108+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:42:19.219659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455681+0000","last_change":"2024-04-02T07:25:13.425406+0000","last_active":"2024-04-02T07:25:15.455681+0000","last_peered":"2024-04-02T07:25:15.455681+0000","last_clean":"2024-04-02T07:25:15.455681+0000","last_became_active":"2024-04-02T07:25:13.425101+0000","last_became_peered":"2024-04-02T07:25:13.425101+0000","last_unstale":"2024-04-02T07:25:15.455681+0000","last_undegraded":"2024-04-02T07:25:15.455681+0000","last_fullsized":"2024-04-02T07:25:15.455681+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:58:08.193966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456175+0000","last_change":"2024-04-02T07:25:13.833680+0000","last_active":"2024-04-02T07:25:15.456175+0000","last_peered":"2024-04-02T07:25:15.456175+0000","last_clean":"2024-04-02T07:25:15.456175+0000","last_became_active":"2024-04-02T07:25:13.833408+0000","last_became_peered":"2024-04-02T07:25:13.833408+0000","last_unstale":"2024-04-02T07:25:15.456175+0000","last_undegraded":"2024-04-02T07:25:15.456175+0000","last_fullsized":"2024-04-02T07:25:15.456175+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:02:07.068315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456017+0000","last_change":"2024-04-02T07:25:13.415820+0000","last_active":"2024-04-02T07:25:15.456017+0000","last_peered":"2024-04-02T07:25:15.456017+0000","last_clean":"2024-04-02T07:25:15.456017+0000","last_became_active":"2024-04-02T07:25:13.415350+0000","last_became_peered":"2024-04-02T07:25:13.415350+0000","last_unstale":"2024-04-02T07:25:15.456017+0000","last_undegraded":"2024-04-02T07:25:15.456017+0000","last_fullsized":"2024-04-02T07:25:15.456017+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:37:30.541440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455199+0000","last_change":"2024-04-02T07:25:13.842444+0000","last_active":"2024-04-02T07:25:15.455199+0000","last_peered":"2024-04-02T07:25:15.455199+0000","last_clean":"2024-04-02T07:25:15.455199+0000","last_became_active":"2024-04-02T07:25:13.841421+0000","last_became_peered":"2024-04-02T07:25:13.841421+0000","last_unstale":"2024-04-02T07:25:15.455199+0000","last_undegraded":"2024-04-02T07:25:15.455199+0000","last_fullsized":"2024-04-02T07:25:15.455199+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:53:24.682624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456808+0000","last_change":"2024-04-02T07:25:13.417590+0000","last_active":"2024-04-02T07:25:15.456808+0000","last_peered":"2024-04-02T07:25:15.456808+0000","last_clean":"2024-04-02T07:25:15.456808+0000","last_became_active":"2024-04-02T07:25:13.417374+0000","last_became_peered":"2024-04-02T07:25:13.417374+0000","last_unstale":"2024-04-02T07:25:15.456808+0000","last_undegraded":"2024-04-02T07:25:15.456808+0000","last_fullsized":"2024-04-02T07:25:15.456808+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:58:39.230040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455944+0000","last_change":"2024-04-02T07:25:13.835557+0000","last_active":"2024-04-02T07:25:15.455944+0000","last_peered":"2024-04-02T07:25:15.455944+0000","last_clean":"2024-04-02T07:25:15.455944+0000","last_became_active":"2024-04-02T07:25:13.834950+0000","last_became_peered":"2024-04-02T07:25:13.834950+0000","last_unstale":"2024-04-02T07:25:15.455944+0000","last_undegraded":"2024-04-02T07:25:15.455944+0000","last_fullsized":"2024-04-02T07:25:15.455944+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:55:52.300846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456095+0000","last_change":"2024-04-02T07:25:13.418153+0000","last_active":"2024-04-02T07:25:15.456095+0000","last_peered":"2024-04-02T07:25:15.456095+0000","last_clean":"2024-04-02T07:25:15.456095+0000","last_became_active":"2024-04-02T07:25:13.417552+0000","last_became_peered":"2024-04-02T07:25:13.417552+0000","last_unstale":"2024-04-02T07:25:15.456095+0000","last_undegraded":"2024-04-02T07:25:15.456095+0000","last_fullsized":"2024-04-02T07:25:15.456095+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:45:36.600517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829430+0000","last_change":"2024-04-02T07:25:13.841756+0000","last_active":"2024-04-02T07:25:14.829430+0000","last_peered":"2024-04-02T07:25:14.829430+0000","last_clean":"2024-04-02T07:25:14.829430+0000","last_became_active":"2024-04-02T07:25:13.841502+0000","last_became_peered":"2024-04-02T07:25:13.841502+0000","last_unstale":"2024-04-02T07:25:14.829430+0000","last_undegraded":"2024-04-02T07:25:14.829430+0000","last_fullsized":"2024-04-02T07:25:14.829430+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:59:19.156812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455000+0000","last_change":"2024-04-02T07:25:13.413685+0000","last_active":"2024-04-02T07:25:15.455000+0000","last_peered":"2024-04-02T07:25:15.455000+0000","last_clean":"2024-04-02T07:25:15.455000+0000","last_became_active":"2024-04-02T07:25:13.413007+0000","last_became_peered":"2024-04-02T07:25:13.413007+0000","last_unstale":"2024-04-02T07:25:15.455000+0000","last_undegraded":"2024-04-02T07:25:15.455000+0000","last_fullsized":"2024-04-02T07:25:15.455000+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:48:18.595104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456389+0000","last_change":"2024-04-02T07:25:13.843455+0000","last_active":"2024-04-02T07:25:15.456389+0000","last_peered":"2024-04-02T07:25:15.456389+0000","last_clean":"2024-04-02T07:25:15.456389+0000","last_became_active":"2024-04-02T07:25:13.842833+0000","last_became_peered":"2024-04-02T07:25:13.842833+0000","last_unstale":"2024-04-02T07:25:15.456389+0000","last_undegraded":"2024-04-02T07:25:15.456389+0000","last_fullsized":"2024-04-02T07:25:15.456389+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:55:42.022540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826503+0000","last_change":"2024-04-02T07:25:13.422967+0000","last_active":"2024-04-02T07:25:14.826503+0000","last_peered":"2024-04-02T07:25:14.826503+0000","last_clean":"2024-04-02T07:25:14.826503+0000","last_became_active":"2024-04-02T07:25:13.422128+0000","last_became_peered":"2024-04-02T07:25:13.422128+0000","last_unstale":"2024-04-02T07:25:14.826503+0000","last_undegraded":"2024-04-02T07:25:14.826503+0000","last_fullsized":"2024-04-02T07:25:14.826503+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:49:53.952263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.454919+0000","last_change":"2024-04-02T07:25:13.842639+0000","last_active":"2024-04-02T07:25:15.454919+0000","last_peered":"2024-04-02T07:25:15.454919+0000","last_clean":"2024-04-02T07:25:15.454919+0000","last_became_active":"2024-04-02T07:25:13.842327+0000","last_became_peered":"2024-04-02T07:25:13.842327+0000","last_unstale":"2024-04-02T07:25:15.454919+0000","last_undegraded":"2024-04-02T07:25:15.454919+0000","last_fullsized":"2024-04-02T07:25:15.454919+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:24:15.620410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.454995+0000","last_change":"2024-04-02T07:25:13.419195+0000","last_active":"2024-04-02T07:25:15.454995+0000","last_peered":"2024-04-02T07:25:15.454995+0000","last_clean":"2024-04-02T07:25:15.454995+0000","last_became_active":"2024-04-02T07:25:13.418989+0000","last_became_peered":"2024-04-02T07:25:13.418989+0000","last_unstale":"2024-04-02T07:25:15.454995+0000","last_undegraded":"2024-04-02T07:25:15.454995+0000","last_fullsized":"2024-04-02T07:25:15.454995+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:30:18.876417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.828948+0000","last_change":"2024-04-02T07:25:13.839287+0000","last_active":"2024-04-02T07:25:14.828948+0000","last_peered":"2024-04-02T07:25:14.828948+0000","last_clean":"2024-04-02T07:25:14.828948+0000","last_became_active":"2024-04-02T07:25:13.838963+0000","last_became_peered":"2024-04-02T07:25:13.838963+0000","last_unstale":"2024-04-02T07:25:14.828948+0000","last_undegraded":"2024-04-02T07:25:14.828948+0000","last_fullsized":"2024-04-02T07:25:14.828948+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:58:24.188990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.828930+0000","last_change":"2024-04-02T07:25:13.414859+0000","last_active":"2024-04-02T07:25:14.828930+0000","last_peered":"2024-04-02T07:25:14.828930+0000","last_clean":"2024-04-02T07:25:14.828930+0000","last_became_active":"2024-04-02T07:25:13.414603+0000","last_became_peered":"2024-04-02T07:25:13.414603+0000","last_unstale":"2024-04-02T07:25:14.828930+0000","last_undegraded":"2024-04-02T07:25:14.828930+0000","last_fullsized":"2024-04-02T07:25:14.828930+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:24:56.136518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.828813+0000","last_change":"2024-04-02T07:25:13.834084+0000","last_active":"2024-04-02T07:25:14.828813+0000","last_peered":"2024-04-02T07:25:14.828813+0000","last_clean":"2024-04-02T07:25:14.828813+0000","last_became_active":"2024-04-02T07:25:13.833842+0000","last_became_peered":"2024-04-02T07:25:13.833842+0000","last_unstale":"2024-04-02T07:25:14.828813+0000","last_undegraded":"2024-04-02T07:25:14.828813+0000","last_fullsized":"2024-04-02T07:25:14.828813+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:37:26.090804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456251+0000","last_change":"2024-04-02T07:25:13.413117+0000","last_active":"2024-04-02T07:25:15.456251+0000","last_peered":"2024-04-02T07:25:15.456251+0000","last_clean":"2024-04-02T07:25:15.456251+0000","last_became_active":"2024-04-02T07:25:13.412801+0000","last_became_peered":"2024-04-02T07:25:13.412801+0000","last_unstale":"2024-04-02T07:25:15.456251+0000","last_undegraded":"2024-04-02T07:25:15.456251+0000","last_fullsized":"2024-04-02T07:25:15.456251+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:40:11.277526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":198,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-02T07:25:13.823121+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:25:13.823121+0000","last_peered":"2024-04-02T07:25:13.823121+0000","last_clean":"2024-04-02T07:25:13.823121+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:25:13.823121+0000","last_undegraded":"2024-04-02T07:25:13.823121+0000","last_fullsized":"2024-04-02T07:25:13.823121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28312,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343528,"statfs":{"total":96636764160,"available":96607772672,"internally_reserved":0,"allocated":1323008,"data_stored":891595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.64100000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.437},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.623,"15min":0.60299999999999998},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.75600000000000001}]},{"osd":1,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.432,"5min":0.379,"15min":0.379},"max":{"1min":0.95999999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.871,"5min":1.113,"15min":1.113},"last":0.58999999999999997}]},{"osd":2,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.746,"15min":0.75},"min":{"1min":0.55700000000000005,"5min":0.435,"15min":0.435},"max":{"1min":1.0149999999999999,"5min":1.139,"15min":1.139},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.499,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93300000000000005,"5min":1.522,"15min":1.522},"last":0.72999999999999998}]},{"osd":3,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69799999999999995,"15min":0.69999999999999996},"min":{"1min":0.46800000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0369999999999999,"5min":1.405,"15min":1.405},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90500000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.48599999999999999}]},{"osd":4,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.66800000000000004,"15min":0.69599999999999995},"min":{"1min":0.38300000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.92500000000000004,"5min":1.633,"15min":1.633},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.72199999999999998,"15min":0.746},"min":{"1min":0.51600000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.93600000000000005,"5min":1.079,"15min":1.079},"last":0.61799999999999999}]},{"osd":5,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.69999999999999996,"15min":0.73299999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90600000000000003,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.76200000000000001,"15min":0.79100000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95599999999999996,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.70999999999999996,"15min":0.73999999999999999},"min":{"1min":0.46000000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88700000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.67800000000000005,"15min":0.70799999999999996},"min":{"1min":0.44700000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86499999999999999,"5min":1,"15min":1},"last":0.57199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":720896,"data_stored":301067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.65300000000000002,"15min":0.66000000000000003},"min":{"1min":0.46600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.75700000000000001,"5min":1.399,"15min":1.399},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.82699999999999996,"15min":0.90100000000000002},"min":{"1min":0.498,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.876,"5min":5.7569999999999997,"15min":5.7569999999999997},"last":0.54300000000000004}]},{"osd":1,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71899999999999997,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90500000000000003,"5min":1.95,"15min":1.95},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.72099999999999997,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83599999999999997,"5min":1.248,"15min":1.248},"last":0.63600000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.67700000000000005,"15min":0.69199999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.746,"5min":1.226,"15min":1.226},"last":0.623},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.70399999999999996,"15min":0.70799999999999996},"min":{"1min":0.504,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86599999999999999,"5min":0.997,"15min":0.997},"last":0.66500000000000004}]},{"osd":3,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.78100000000000003,"15min":0.81499999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.82899999999999996,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.76700000000000002,"15min":0.79900000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.84799999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.72699999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65300000000000002,"15min":0.66900000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83699999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83799999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.60299999999999998}]},{"osd":5,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.65600000000000003,"15min":0.68000000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.749,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.496},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71999999999999997,"15min":0.73399999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.873,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.751}]},{"osd":7,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73099999999999998,"15min":0.748},"min":{"1min":0.53300000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.73099999999999998,"15min":0.749},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.81799999999999995,"5min":0.999,"15min":0.999},"last":0.77400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":729088,"data_stored":301719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64900000000000002,"15min":0.64500000000000002},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.873,"5min":1.25,"15min":1.25},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70399999999999996,"15min":0.70799999999999996},"min":{"1min":0.47599999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93300000000000005,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.70699999999999996}]},{"osd":1,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.68999999999999995,"15min":0.68899999999999995},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.875,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86199999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.79800000000000004}]},{"osd":2,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.79400000000000004,"15min":0.82599999999999996},"min":{"1min":0.47399999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88700000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72399999999999998,"15min":0.746},"min":{"1min":0.442,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86099999999999999,"5min":1.696,"15min":1.696},"last":0.78900000000000003}]},{"osd":3,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.74399999999999999,"15min":0.76700000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92400000000000004,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.78700000000000003,"15min":0.82899999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85799999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.84699999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.67500000000000004,"15min":0.72799999999999998},"min":{"1min":0.39200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":1.911,"15min":1.911},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.73399999999999999,"15min":0.79600000000000004},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84099999999999997,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.64000000000000001}]},{"osd":6,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.79800000000000004,"15min":0.873},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80300000000000005,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.78700000000000003,"15min":0.85799999999999998},"min":{"1min":0.45100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.82699999999999996,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.621}]},{"osd":7,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.81399999999999995,"15min":0.878},"min":{"1min":0.48899999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.88700000000000001,"5min":1.887,"15min":1.887},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.84799999999999998,"15min":0.92600000000000005},"min":{"1min":0.443,"5min":0.439,"15min":0.439},"max":{"1min":0.86699999999999999,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.60899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":733184,"data_stored":302631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.72699999999999998,"15min":0.753},"min":{"1min":0.47299999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85899999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.77700000000000002,"15min":0.83499999999999996},"min":{"1min":0.48099999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.78800000000000003,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.48099999999999998}]},{"osd":1,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.745,"15min":0.76400000000000001},"min":{"1min":0.499,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93300000000000005,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.85599999999999998,"15min":0.92500000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91400000000000003,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":0.63}]},{"osd":2,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.78400000000000003,"15min":0.80800000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95199999999999996,"5min":2.056,"15min":2.056},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.83899999999999997,"15min":0.88900000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.92000000000000004,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.498}]},{"osd":3,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.94099999999999995,"15min":1.0169999999999999},"min":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.97899999999999998,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.95099999999999996,"15min":1.0309999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.014,"5min":3.9750000000000001,"15min":3.9750000000000001},"last":0.58299999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.42599999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0389999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.73799999999999999,"15min":0.76000000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0549999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.66600000000000004}]},{"osd":6,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.45400000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.123,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":0.78700000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.032,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1060000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.754},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.86399999999999999,"15min":0.877},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1499999999999999,"5min":1.353,"15min":1.353},"last":0.68899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":729088,"data_stored":301123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.438,"15min":0.45000000000000001},"min":{"1min":0.28499999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.48199999999999998},"min":{"1min":0.34200000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73699999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.54300000000000004}]},{"osd":1,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.33800000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.497,"15min":0.505},"min":{"1min":0.375,"5min":0.309,"15min":0.309},"max":{"1min":0.68899999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.59299999999999997}]},{"osd":2,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93700000000000006,"5min":1.306,"15min":1.306},"last":0.71399999999999997}]},{"osd":4,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.5,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.876,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.57099999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94099999999999995,"5min":1.155,"15min":1.155},"last":1.0089999999999999}]},{"osd":5,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.024,"5min":1.198,"15min":1.198},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.746,"15min":0.745},"min":{"1min":0.57299999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.034,"5min":1.135,"15min":1.135},"last":0.93300000000000005}]},{"osd":6,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76400000000000001,"15min":0.76900000000000002},"min":{"1min":0.58799999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.96499999999999997,"5min":1.25,"15min":1.25},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78500000000000003,"15min":0.78200000000000003},"min":{"1min":0.59799999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.98499999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.90900000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75700000000000001,"15min":0.75800000000000001},"min":{"1min":0.53300000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0740000000000001,"5min":1.216,"15min":1.216},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78900000000000003,"15min":0.79600000000000004},"min":{"1min":0.57199999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.012,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.64300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":729088,"data_stored":301123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44700000000000001,"15min":0.45200000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.747,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65200000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.45700000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.54500000000000004},"min":{"1min":0.379,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76800000000000002,"5min":1.171,"15min":1.171},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48599999999999999,"15min":0.49199999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.74299999999999999,"5min":1.333,"15min":1.333},"last":0.53400000000000003}]},{"osd":3,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70099999999999996,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83099999999999996,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.41899999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.49299999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5309999999999999,"5min":2.254,"15min":2.254},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.76200000000000001,"15min":0.76500000000000001},"min":{"1min":0.51800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2210000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.91500000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2629999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79900000000000004,"15min":0.81499999999999995},"min":{"1min":0.57099999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.3149999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.74099999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.60499999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.82399999999999995,"15min":0.82499999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.89000000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.81699999999999995,"15min":0.83699999999999997},"min":{"1min":0.58399999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4750000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.63500000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.879}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31832,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":724992,"data_stored":301157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.46999999999999997,"15min":0.48599999999999999},"min":{"1min":0.255,"5min":0.251,"15min":0.251},"max":{"1min":0.53800000000000003,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.372},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.61099999999999999,"15min":0.66100000000000003},"min":{"1min":0.27000000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.745,"5min":4.157,"15min":4.157},"last":0.28000000000000003}]},{"osd":2,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.61099999999999999,"15min":0.67700000000000005},"min":{"1min":0.32900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60799999999999998,"5min":4.282,"15min":4.282},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.58599999999999997,"15min":0.61299999999999999},"min":{"1min":0.37,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.63300000000000001,"5min":1.625,"15min":1.625},"last":0.52100000000000002}]},{"osd":3,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.441,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94399999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.495},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.81899999999999995,"15min":0.94099999999999995},"min":{"1min":0.42999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.749,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.42999999999999999}]},{"osd":4,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.91300000000000003,"15min":0.98899999999999999},"min":{"1min":0.52900000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.105,"5min":4.7400000000000002,"15min":4.7400000000000002},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81399999999999995,"15min":0.83599999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.996,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.94499999999999995}]},{"osd":5,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.91100000000000003,"15min":0.96599999999999997},"min":{"1min":0.53500000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.0620000000000001,"5min":4.5759999999999996,"15min":4.5759999999999996},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.91100000000000003,"15min":0.97199999999999998},"min":{"1min":0.59399999999999997,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1539999999999999,"5min":4.7949999999999999,"15min":4.7949999999999999},"last":0.85599999999999998}]},{"osd":6,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.94399999999999995,"15min":1.02},"min":{"1min":0.47799999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.006,"5min":4.6890000000000001,"15min":4.6890000000000001},"last":0.63},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.92700000000000005,"15min":0.995},"min":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0720000000000001,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.82999999999999996}]},{"osd":7,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.82199999999999995,"15min":0.84399999999999997},"min":{"1min":0.60099999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.137,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.93799999999999994,"15min":0.996},"min":{"1min":0.57999999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.024,"5min":4.6420000000000003,"15min":4.6420000000000003},"last":0.71199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1331200,"data_stored":893581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46200000000000002,"15min":0.47899999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.53900000000000003,"5min":1.48,"15min":1.48},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.39900000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.65500000000000003,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.51700000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72699999999999998,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.498},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.39400000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.45200000000000001}]},{"osd":3,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46800000000000003,"15min":0.46999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60499999999999998,"15min":0.626},"min":{"1min":0.435,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.75900000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.435}]},{"osd":4,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.54200000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.91900000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.58699999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.0369999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77900000000000003,"15min":0.79500000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.91300000000000003,"5min":1.371,"15min":1.371},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75700000000000001,"15min":0.76300000000000001},"min":{"1min":0.57599999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.98699999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.087,"5min":1.177,"15min":1.177},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82099999999999995,"15min":0.84499999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.0329999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.65100000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.78400000000000003,"15min":0.79800000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.016,"5min":1.135,"15min":1.135},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.58699999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.046,"5min":1.141,"15min":1.141},"last":0.68700000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:25:18.725 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-02T07:25:18.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.897+0000 7f138ca00640 1 Processor -- start 2024-04-02T07:25:18.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.897+0000 7f138ca00640 1 -- start start 2024-04-02T07:25:18.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.897+0000 7f138ca00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13880b1430 0x7f13880afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:18.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.897+0000 7f138ca00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13880ce2f0 con 0x7f1388099750 2024-04-02T07:25:18.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.897+0000 7f138ca00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13880ce5d0 con 0x7f1388098a10 2024-04-02T07:25:18.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.897+0000 7f138ca00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13880cbe10 con 0x7f13880b1430 2024-04-02T07:25:18.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.901+0000 7f137fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13880b1430 0x7f13880afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:18.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.901+0000 7f1386800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1388099750 0x7f13880cea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47398/0 (socket says 172.21.15.55:47398) 2024-04-02T07:25:18.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.901+0000 7f1386800640 1 -- 172.21.15.55:0/3847018205 learned_addr learned my addr 172.21.15.55:0/3847018205 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:18.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.901+0000 7f137fe00640 1 -- 172.21.15.55:0/3847018205 >> v1:172.21.15.106:6789/0 conn(0x7f1388098a10 legacy=0x7f1388098df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:18.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.901+0000 7f137fe00640 1 -- 172.21.15.55:0/3847018205 >> v1:172.21.15.55:6789/0 conn(0x7f1388099750 legacy=0x7f13880cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:18.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.901+0000 7f137fe00640 1 -- 172.21.15.55:0/3847018205 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1388099be0 con 0x7f13880b1430 2024-04-02T07:25:18.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.901+0000 7f1385400640 1 -- 172.21.15.55:0/3847018205 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1925752438 0 0) 0x7f13880ce2f0 con 0x7f1388099750 2024-04-02T07:25:18.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.901+0000 7f137fe00640 1 --2- 172.21.15.55:0/3847018205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13880b1430 0x7f13880afe30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f13700097c0 tx=0x7f137001c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3b5d436fe2a426d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:18.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.901+0000 7f1385400640 1 -- 172.21.15.55:0/3847018205 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13700ab600 con 0x7f13880b1430 2024-04-02T07:25:18.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.901+0000 7f1385400640 1 -- 172.21.15.55:0/3847018205 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13700a7050 con 0x7f13880b1430 2024-04-02T07:25:18.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.901+0000 7f1385400640 1 -- 172.21.15.55:0/3847018205 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13700ab980 con 0x7f13880b1430 2024-04-02T07:25:18.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f138ca00640 1 -- 172.21.15.55:0/3847018205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13880b1430 msgr2=0x7f13880afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:18.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f138ca00640 1 --2- 172.21.15.55:0/3847018205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13880b1430 0x7f13880afe30 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f13700097c0 tx=0x7f137001c370 comp rx=0 tx=0).stop 2024-04-02T07:25:18.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f138ca00640 1 -- 172.21.15.55:0/3847018205 shutdown_connections 2024-04-02T07:25:18.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f138ca00640 1 --2- 172.21.15.55:0/3847018205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13880b1430 0x7f13880afe30 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:18.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f138ca00640 1 -- 172.21.15.55:0/3847018205 >> 172.21.15.55:0/3847018205 conn(0x7f13880b2210 msgr2=0x7f13880b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:18.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f138ca00640 1 -- 172.21.15.55:0/3847018205 shutdown_connections 2024-04-02T07:25:18.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f138ca00640 1 -- 172.21.15.55:0/3847018205 wait complete. 2024-04-02T07:25:18.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f138ca00640 1 Processor -- start 2024-04-02T07:25:18.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f138ca00640 1 -- start start 2024-04-02T07:25:18.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f138ca00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1388098a10 0x7f13880c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:18.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f138ca00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1388099750 0x7f138814f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:18.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f138ca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13880b1430 0x7f1388146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:18.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f138ca00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138815aee0 con 0x7f13880b1430 2024-04-02T07:25:18.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f138ca00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f138806b880 con 0x7f1388099750 2024-04-02T07:25:18.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f138ca00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f138806bb00 con 0x7f1388098a10 2024-04-02T07:25:18.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f1386800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13880b1430 0x7f1388146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:18.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f1386800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13880b1430 0x7f1388146840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41380/0 (socket says 172.21.15.55:41380) 2024-04-02T07:25:18.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f1386800640 1 -- 172.21.15.55:0/2029594426 learned_addr learned my addr 172.21.15.55:0/2029594426 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:18.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f1385e00640 1 --2- 172.21.15.55:0/2029594426 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1388098a10 0x7f13880c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:18.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f137fe00640 1 --2- 172.21.15.55:0/2029594426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1388099750 0x7f138814f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:18.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f1386800640 1 -- 172.21.15.55:0/2029594426 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1388098a10 msgr2=0x7f13880c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:18.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f1386800640 1 --2- 172.21.15.55:0/2029594426 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1388098a10 0x7f13880c7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:18.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f1386800640 1 -- 172.21.15.55:0/2029594426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1388099750 msgr2=0x7f138814f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:18.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f1386800640 1 --2- 172.21.15.55:0/2029594426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1388099750 0x7f138814f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:18.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f1386800640 1 -- 172.21.15.55:0/2029594426 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1370009420 con 0x7f13880b1430 2024-04-02T07:25:18.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f137fe00640 1 --2- 172.21.15.55:0/2029594426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1388099750 0x7f138814f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:18.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.905+0000 7f1386800640 1 --2- 172.21.15.55:0/2029594426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13880b1430 0x7f1388146840 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f138000c7b0 tx=0x7f138000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:18.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.909+0000 7f137e000640 1 -- 172.21.15.55:0/2029594426 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138000a640 con 0x7f13880b1430 2024-04-02T07:25:18.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.909+0000 7f137e000640 1 -- 172.21.15.55:0/2029594426 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f138000a7c0 con 0x7f13880b1430 2024-04-02T07:25:18.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.909+0000 7f137e000640 1 -- 172.21.15.55:0/2029594426 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f138000ab70 con 0x7f13880b1430 2024-04-02T07:25:18.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.909+0000 7f138ca00640 1 -- 172.21.15.55:0/2029594426 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f138815a890 con 0x7f13880b1430 2024-04-02T07:25:18.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.909+0000 7f138ca00640 1 -- 172.21.15.55:0/2029594426 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f138806bde0 con 0x7f13880b1430 2024-04-02T07:25:18.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.909+0000 7f138ca00640 1 -- 172.21.15.55:0/2029594426 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1388066c90 con 0x7f13880b1430 2024-04-02T07:25:18.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.909+0000 7f137e000640 1 -- 172.21.15.55:0/2029594426 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f138000acd0 con 0x7f13880b1430 2024-04-02T07:25:18.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.909+0000 7f137e000640 1 --2- 172.21.15.55:0/2029594426 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1364066690 0x7f1364068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:18.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.909+0000 7f137e000640 1 -- 172.21.15.55:0/2029594426 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13800835e0 con 0x7f13880b1430 2024-04-02T07:25:18.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.909+0000 7f1385e00640 1 --2- 172.21.15.55:0/2029594426 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1364066690 0x7f1364068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:18.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.913+0000 7f1385e00640 1 --2- 172.21.15.55:0/2029594426 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1364066690 0x7f1364068b50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f13881f8ee0 tx=0x7f1378009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:18.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:18.913+0000 7f137e000640 1 -- 172.21.15.55:0/2029594426 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f1380050960 con 0x7f13880b1430 2024-04-02T07:25:19.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.129+0000 7f138ca00640 1 -- 172.21.15.55:0/2029594426 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f138815b020 con 0x7f13880b1430 2024-04-02T07:25:19.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.129+0000 7f137e000640 1 -- 172.21.15.55:0/2029594426 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1431 (secure 0 0 0) 0x7f138815b020 con 0x7f13880b1430 2024-04-02T07:25:19.133 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:19.134 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":205,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":60,"num_osds":8,"num_up_osds":8,"osd_up_since":1712042525,"num_in_osds":8,"osd_in_since":1712042515,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592730,"bytes_used":245202944,"bytes_avail":772848910336,"bytes_total":773094113280,"write_bytes_sec":2393,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":33,"id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"d","status":"up:active","gid":6138}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2024-04-02T07:24:02.357690+0000","services":{"mds":{"daemons":{"summary":"","b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-04-02T07:25:19.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.129+0000 7f138ca00640 1 -- 172.21.15.55:0/2029594426 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1364066690 msgr2=0x7f1364068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:19.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.129+0000 7f138ca00640 1 --2- 172.21.15.55:0/2029594426 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1364066690 0x7f1364068b50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f13881f8ee0 tx=0x7f1378009060 comp rx=0 tx=0).stop 2024-04-02T07:25:19.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.129+0000 7f138ca00640 1 -- 172.21.15.55:0/2029594426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13880b1430 msgr2=0x7f1388146840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:19.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.129+0000 7f138ca00640 1 --2- 172.21.15.55:0/2029594426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13880b1430 0x7f1388146840 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f138000c7b0 tx=0x7f138000cc70 comp rx=0 tx=0).stop 2024-04-02T07:25:19.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.129+0000 7f138ca00640 1 -- 172.21.15.55:0/2029594426 shutdown_connections 2024-04-02T07:25:19.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.129+0000 7f138ca00640 1 --2- 172.21.15.55:0/2029594426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13880b1430 0x7f1388146840 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:19.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.129+0000 7f138ca00640 1 --2- 172.21.15.55:0/2029594426 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1364066690 0x7f1364068b50 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:19.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.129+0000 7f138ca00640 1 --2- 172.21.15.55:0/2029594426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1388099750 0x7f138814f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:19.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.129+0000 7f138ca00640 1 --2- 172.21.15.55:0/2029594426 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1388098a10 0x7f13880c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:19.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.129+0000 7f138ca00640 1 -- 172.21.15.55:0/2029594426 >> 172.21.15.55:0/2029594426 conn(0x7f13880b2210 msgr2=0x7f13880cd040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:19.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.129+0000 7f138ca00640 1 -- 172.21.15.55:0/2029594426 shutdown_connections 2024-04-02T07:25:19.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.129+0000 7f138ca00640 1 -- 172.21.15.55:0/2029594426 wait complete. 2024-04-02T07:25:19.154 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-02T07:25:19.154 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:25:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.289+0000 7f264ac00640 1 Processor -- start 2024-04-02T07:25:19.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.289+0000 7f264ac00640 1 -- start start 2024-04-02T07:25:19.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.289+0000 7f264ac00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f26440cfdf0 0x7f264406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:19.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.289+0000 7f264ac00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2644098a10 0x7f2644098e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:19.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.289+0000 7f264ac00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26440d01d0 con 0x7f26440b16e0 2024-04-02T07:25:19.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.289+0000 7f264ac00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2644099360 con 0x7f2644098a10 2024-04-02T07:25:19.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.289+0000 7f264ac00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f264406c0e0 con 0x7f26440cfdf0 2024-04-02T07:25:19.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.289+0000 7f2648c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2644098a10 0x7f2644098e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:19.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.289+0000 7f2648c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2644098a10 0x7f2644098e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41382/0 (socket says 172.21.15.55:41382) 2024-04-02T07:25:19.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.289+0000 7f2648c00640 1 -- 172.21.15.55:0/2855700247 learned_addr learned my addr 172.21.15.55:0/2855700247 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:19.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.289+0000 7f2643e00640 1 --2- 172.21.15.55:0/2855700247 >> v2:172.21.15.106:3300/0 conn(0x7f26440cfdf0 0x7f264406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:19.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.293+0000 7f2648c00640 1 -- 172.21.15.55:0/2855700247 >> v2:172.21.15.106:3300/0 conn(0x7f26440cfdf0 msgr2=0x7f264406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:19.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.293+0000 7f2648c00640 1 --2- 172.21.15.55:0/2855700247 >> v2:172.21.15.106:3300/0 conn(0x7f26440cfdf0 0x7f264406b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:19.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.293+0000 7f2648c00640 1 -- 172.21.15.55:0/2855700247 >> v1:172.21.15.106:6789/0 conn(0x7f26440b16e0 legacy=0x7f26440b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:19.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.293+0000 7f2648c00640 1 -- 172.21.15.55:0/2855700247 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26440b01d0 con 0x7f2644098a10 2024-04-02T07:25:19.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.293+0000 7f2648c00640 1 --2- 172.21.15.55:0/2855700247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2644098a10 0x7f2644098e20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2644073b60 tx=0x7f263c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01f6df31e5c76cd server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:19.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.293+0000 7f2643400640 1 -- 172.21.15.55:0/2855700247 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c0a5880 con 0x7f2644098a10 2024-04-02T07:25:19.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.293+0000 7f2643400640 1 -- 172.21.15.55:0/2855700247 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263c0a59e0 con 0x7f2644098a10 2024-04-02T07:25:19.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.293+0000 7f2643400640 1 -- 172.21.15.55:0/2855700247 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c0a5d70 con 0x7f2644098a10 2024-04-02T07:25:19.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.293+0000 7f264ac00640 1 -- 172.21.15.55:0/2855700247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2644098a10 msgr2=0x7f2644098e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:19.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.293+0000 7f264ac00640 1 --2- 172.21.15.55:0/2855700247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2644098a10 0x7f2644098e20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f2644073b60 tx=0x7f263c01c9c0 comp rx=0 tx=0).stop 2024-04-02T07:25:19.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.293+0000 7f264ac00640 1 -- 172.21.15.55:0/2855700247 shutdown_connections 2024-04-02T07:25:19.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.293+0000 7f264ac00640 1 --2- 172.21.15.55:0/2855700247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2644098a10 0x7f2644098e20 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:19.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.293+0000 7f264ac00640 1 --2- 172.21.15.55:0/2855700247 >> v2:172.21.15.106:3300/0 conn(0x7f26440cfdf0 0x7f264406b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:19.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.293+0000 7f264ac00640 1 -- 172.21.15.55:0/2855700247 >> 172.21.15.55:0/2855700247 conn(0x7f26440b2210 msgr2=0x7f26440b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:19.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f264ac00640 1 -- 172.21.15.55:0/2855700247 shutdown_connections 2024-04-02T07:25:19.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f264ac00640 1 -- 172.21.15.55:0/2855700247 wait complete. 2024-04-02T07:25:19.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f264ac00640 1 Processor -- start 2024-04-02T07:25:19.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f264ac00640 1 -- start start 2024-04-02T07:25:19.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f264ac00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2644098a10 0x7f2644153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:19.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f264ac00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26440b16e0 0x7f264414e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:19.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f264ac00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26440cfdf0 0x7f26440b4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:19.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f264ac00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2644153020 con 0x7f26440cfdf0 2024-04-02T07:25:19.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f264ac00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26440b49b0 con 0x7f26440b16e0 2024-04-02T07:25:19.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f264ac00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2644153270 con 0x7f2644098a10 2024-04-02T07:25:19.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f2648c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26440cfdf0 0x7f26440b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:19.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f2648c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26440cfdf0 0x7f26440b4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41396/0 (socket says 172.21.15.55:41396) 2024-04-02T07:25:19.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f2648c00640 1 -- 172.21.15.55:0/2442087946 learned_addr learned my addr 172.21.15.55:0/2442087946 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:19.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f2648c00640 1 -- 172.21.15.55:0/2442087946 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2644098a10 msgr2=0x7f2644153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:19.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f2648c00640 1 --2- 172.21.15.55:0/2442087946 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2644098a10 0x7f2644153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:19.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f2648c00640 1 -- 172.21.15.55:0/2442087946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26440b16e0 msgr2=0x7f264414e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:19.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f2648c00640 1 --2- 172.21.15.55:0/2442087946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26440b16e0 0x7f264414e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:19.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f2648c00640 1 -- 172.21.15.55:0/2442087946 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c009b30 con 0x7f26440cfdf0 2024-04-02T07:25:19.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f2648c00640 1 --2- 172.21.15.55:0/2442087946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26440cfdf0 0x7f26440b4340 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f263c0af040 tx=0x7f263c019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:19.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f2640c00640 1 -- 172.21.15.55:0/2442087946 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c0a5d50 con 0x7f26440cfdf0 2024-04-02T07:25:19.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f2640c00640 1 -- 172.21.15.55:0/2442087946 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f263c0b8470 con 0x7f26440cfdf0 2024-04-02T07:25:19.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f2640c00640 1 -- 172.21.15.55:0/2442087946 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263c0b8820 con 0x7f26440cfdf0 2024-04-02T07:25:19.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f264ac00640 1 -- 172.21.15.55:0/2442087946 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2644153550 con 0x7f26440cfdf0 2024-04-02T07:25:19.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.297+0000 7f264ac00640 1 -- 172.21.15.55:0/2442087946 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26440c6b50 con 0x7f26440cfdf0 2024-04-02T07:25:19.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.301+0000 7f264ac00640 1 -- 172.21.15.55:0/2442087946 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2644066c90 con 0x7f26440cfdf0 2024-04-02T07:25:19.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.301+0000 7f2640c00640 1 -- 172.21.15.55:0/2442087946 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f263c0b8980 con 0x7f26440cfdf0 2024-04-02T07:25:19.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.301+0000 7f2640c00640 1 --2- 172.21.15.55:0/2442087946 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2620066690 0x7f2620068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:19.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.301+0000 7f2640c00640 1 -- 172.21.15.55:0/2442087946 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f263c11f3b0 con 0x7f26440cfdf0 2024-04-02T07:25:19.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.301+0000 7f2643e00640 1 --2- 172.21.15.55:0/2442087946 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2620066690 0x7f2620068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:19.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.305+0000 7f2643e00640 1 --2- 172.21.15.55:0/2442087946 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2620066690 0x7f2620068b50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2634006aa0 tx=0x7f2634006a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:19.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.305+0000 7f2640c00640 1 -- 172.21.15.55:0/2442087946 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f263c0ec710 con 0x7f26440cfdf0 2024-04-02T07:25:19.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.465+0000 7f264ac00640 1 -- 172.21.15.55:0/2442087946 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2644169b70 con 0x7f2620066690 2024-04-02T07:25:19.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.473+0000 7f2640c00640 1 -- 172.21.15.55:0/2442087946 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288746 (secure 0 0 0) 0x7f263400e7d0 con 0x7f2620066690 2024-04-02T07:25:19.480 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:19.481 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:25:19.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.477+0000 7f264ac00640 1 -- 172.21.15.55:0/2442087946 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2620066690 msgr2=0x7f2620068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:19.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.477+0000 7f264ac00640 1 --2- 172.21.15.55:0/2442087946 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2620066690 0x7f2620068b50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f2634006aa0 tx=0x7f2634006a30 comp rx=0 tx=0).stop 2024-04-02T07:25:19.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.477+0000 7f264ac00640 1 -- 172.21.15.55:0/2442087946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26440cfdf0 msgr2=0x7f26440b4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:19.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.477+0000 7f264ac00640 1 --2- 172.21.15.55:0/2442087946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26440cfdf0 0x7f26440b4340 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f263c0af040 tx=0x7f263c019760 comp rx=0 tx=0).stop 2024-04-02T07:25:19.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.477+0000 7f264ac00640 1 -- 172.21.15.55:0/2442087946 shutdown_connections 2024-04-02T07:25:19.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.477+0000 7f264ac00640 1 --2- 172.21.15.55:0/2442087946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26440cfdf0 0x7f26440b4340 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:19.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.477+0000 7f264ac00640 1 --2- 172.21.15.55:0/2442087946 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2620066690 0x7f2620068b50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:19.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.477+0000 7f264ac00640 1 --2- 172.21.15.55:0/2442087946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26440b16e0 0x7f264414e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:19.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.477+0000 7f264ac00640 1 --2- 172.21.15.55:0/2442087946 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2644098a10 0x7f2644153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:19.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.477+0000 7f264ac00640 1 -- 172.21.15.55:0/2442087946 >> 172.21.15.55:0/2442087946 conn(0x7f26440b2210 msgr2=0x7f26440ad3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:19.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.477+0000 7f264ac00640 1 -- 172.21.15.55:0/2442087946 shutdown_connections 2024-04-02T07:25:19.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:19.477+0000 7f264ac00640 1 -- 172.21.15.55:0/2442087946 wait complete. 2024-04-02T07:25:19.499 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-04-02T07:25:18.376441+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":74,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239456,"kb_used_data":6856,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754735264,"statfs":{"total":773094113280,"available":772848910336,"internally_reserved":0,"allocated":7020544,"data_stored":3593996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.989938"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.830538+0000","last_change":"2024-04-02T07:25:13.839144+0000","last_active":"2024-04-02T07:25:14.830538+0000","last_peered":"2024-04-02T07:25:14.830538+0000","last_clean":"2024-04-02T07:25:14.830538+0000","last_became_active":"2024-04-02T07:25:13.838871+0000","last_became_peered":"2024-04-02T07:25:13.838871+0000","last_unstale":"2024-04-02T07:25:14.830538+0000","last_undegraded":"2024-04-02T07:25:14.830538+0000","last_fullsized":"2024-04-02T07:25:14.830538+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:53:20.638660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829151+0000","last_change":"2024-04-02T07:25:13.838677+0000","last_active":"2024-04-02T07:25:14.829151+0000","last_peered":"2024-04-02T07:25:14.829151+0000","last_clean":"2024-04-02T07:25:14.829151+0000","last_became_active":"2024-04-02T07:25:13.838436+0000","last_became_peered":"2024-04-02T07:25:13.838436+0000","last_unstale":"2024-04-02T07:25:14.829151+0000","last_undegraded":"2024-04-02T07:25:14.829151+0000","last_fullsized":"2024-04-02T07:25:14.829151+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:55:42.022540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456256+0000","last_change":"2024-04-02T07:25:13.843698+0000","last_active":"2024-04-02T07:25:15.456256+0000","last_peered":"2024-04-02T07:25:15.456256+0000","last_clean":"2024-04-02T07:25:15.456256+0000","last_became_active":"2024-04-02T07:25:13.840368+0000","last_became_peered":"2024-04-02T07:25:13.840368+0000","last_unstale":"2024-04-02T07:25:15.456256+0000","last_undegraded":"2024-04-02T07:25:15.456256+0000","last_fullsized":"2024-04-02T07:25:15.456256+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:48:10.866582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455938+0000","last_change":"2024-04-02T07:25:13.829308+0000","last_active":"2024-04-02T07:25:15.455938+0000","last_peered":"2024-04-02T07:25:15.455938+0000","last_clean":"2024-04-02T07:25:15.455938+0000","last_became_active":"2024-04-02T07:25:13.829023+0000","last_became_peered":"2024-04-02T07:25:13.829023+0000","last_unstale":"2024-04-02T07:25:15.455938+0000","last_undegraded":"2024-04-02T07:25:15.455938+0000","last_fullsized":"2024-04-02T07:25:15.455938+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:18:24.553416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.830510+0000","last_change":"2024-04-02T07:25:13.837124+0000","last_active":"2024-04-02T07:25:14.830510+0000","last_peered":"2024-04-02T07:25:14.830510+0000","last_clean":"2024-04-02T07:25:14.830510+0000","last_became_active":"2024-04-02T07:25:13.836828+0000","last_became_peered":"2024-04-02T07:25:13.836828+0000","last_unstale":"2024-04-02T07:25:14.830510+0000","last_undegraded":"2024-04-02T07:25:14.830510+0000","last_fullsized":"2024-04-02T07:25:14.830510+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:27:19.539517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455427+0000","last_change":"2024-04-02T07:25:13.840680+0000","last_active":"2024-04-02T07:25:15.455427+0000","last_peered":"2024-04-02T07:25:15.455427+0000","last_clean":"2024-04-02T07:25:15.455427+0000","last_became_active":"2024-04-02T07:25:13.840435+0000","last_became_peered":"2024-04-02T07:25:13.840435+0000","last_unstale":"2024-04-02T07:25:15.455427+0000","last_undegraded":"2024-04-02T07:25:15.455427+0000","last_fullsized":"2024-04-02T07:25:15.455427+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:17:05.963406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826310+0000","last_change":"2024-04-02T07:25:13.828916+0000","last_active":"2024-04-02T07:25:14.826310+0000","last_peered":"2024-04-02T07:25:14.826310+0000","last_clean":"2024-04-02T07:25:14.826310+0000","last_became_active":"2024-04-02T07:25:13.828653+0000","last_became_peered":"2024-04-02T07:25:13.828653+0000","last_unstale":"2024-04-02T07:25:14.826310+0000","last_undegraded":"2024-04-02T07:25:14.826310+0000","last_fullsized":"2024-04-02T07:25:14.826310+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:37:31.544600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.828815+0000","last_change":"2024-04-02T07:25:13.832544+0000","last_active":"2024-04-02T07:25:14.828815+0000","last_peered":"2024-04-02T07:25:14.828815+0000","last_clean":"2024-04-02T07:25:14.828815+0000","last_became_active":"2024-04-02T07:25:13.831634+0000","last_became_peered":"2024-04-02T07:25:13.831634+0000","last_unstale":"2024-04-02T07:25:14.828815+0000","last_undegraded":"2024-04-02T07:25:14.828815+0000","last_fullsized":"2024-04-02T07:25:14.828815+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:22:24.369836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826801+0000","last_change":"2024-04-02T07:25:13.848365+0000","last_active":"2024-04-02T07:25:14.826801+0000","last_peered":"2024-04-02T07:25:14.826801+0000","last_clean":"2024-04-02T07:25:14.826801+0000","last_became_active":"2024-04-02T07:25:13.848075+0000","last_became_peered":"2024-04-02T07:25:13.848075+0000","last_unstale":"2024-04-02T07:25:14.826801+0000","last_undegraded":"2024-04-02T07:25:14.826801+0000","last_fullsized":"2024-04-02T07:25:14.826801+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:00:09.681534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455584+0000","last_change":"2024-04-02T07:25:13.830577+0000","last_active":"2024-04-02T07:25:15.455584+0000","last_peered":"2024-04-02T07:25:15.455584+0000","last_clean":"2024-04-02T07:25:15.455584+0000","last_became_active":"2024-04-02T07:25:13.830222+0000","last_became_peered":"2024-04-02T07:25:13.830222+0000","last_unstale":"2024-04-02T07:25:15.455584+0000","last_undegraded":"2024-04-02T07:25:15.455584+0000","last_fullsized":"2024-04-02T07:25:15.455584+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:49:54.955423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455298+0000","last_change":"2024-04-02T07:25:13.839434+0000","last_active":"2024-04-02T07:25:15.455298+0000","last_peered":"2024-04-02T07:25:15.455298+0000","last_clean":"2024-04-02T07:25:15.455298+0000","last_became_active":"2024-04-02T07:25:13.839191+0000","last_became_peered":"2024-04-02T07:25:13.839191+0000","last_unstale":"2024-04-02T07:25:15.455298+0000","last_undegraded":"2024-04-02T07:25:15.455298+0000","last_fullsized":"2024-04-02T07:25:15.455298+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:17:51.543470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455994+0000","last_change":"2024-04-02T07:25:13.833269+0000","last_active":"2024-04-02T07:25:15.455994+0000","last_peered":"2024-04-02T07:25:15.455994+0000","last_clean":"2024-04-02T07:25:15.455994+0000","last_became_active":"2024-04-02T07:25:13.832979+0000","last_became_peered":"2024-04-02T07:25:13.832979+0000","last_unstale":"2024-04-02T07:25:15.455994+0000","last_undegraded":"2024-04-02T07:25:15.455994+0000","last_fullsized":"2024-04-02T07:25:15.455994+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:51:16.504462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456762+0000","last_change":"2024-04-02T07:25:13.832987+0000","last_active":"2024-04-02T07:25:15.456762+0000","last_peered":"2024-04-02T07:25:15.456762+0000","last_clean":"2024-04-02T07:25:15.456762+0000","last_became_active":"2024-04-02T07:25:13.832625+0000","last_became_peered":"2024-04-02T07:25:13.832625+0000","last_unstale":"2024-04-02T07:25:15.456762+0000","last_undegraded":"2024-04-02T07:25:15.456762+0000","last_fullsized":"2024-04-02T07:25:15.456762+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:15:48.740463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826470+0000","last_change":"2024-04-02T07:25:13.834787+0000","last_active":"2024-04-02T07:25:14.826470+0000","last_peered":"2024-04-02T07:25:14.826470+0000","last_clean":"2024-04-02T07:25:14.826470+0000","last_became_active":"2024-04-02T07:25:13.831629+0000","last_became_peered":"2024-04-02T07:25:13.831629+0000","last_unstale":"2024-04-02T07:25:14.826470+0000","last_undegraded":"2024-04-02T07:25:14.826470+0000","last_fullsized":"2024-04-02T07:25:14.826470+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:35:15.300703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826560+0000","last_change":"2024-04-02T07:25:13.838509+0000","last_active":"2024-04-02T07:25:14.826560+0000","last_peered":"2024-04-02T07:25:14.826560+0000","last_clean":"2024-04-02T07:25:14.826560+0000","last_became_active":"2024-04-02T07:25:13.838180+0000","last_became_peered":"2024-04-02T07:25:13.838180+0000","last_unstale":"2024-04-02T07:25:14.826560+0000","last_undegraded":"2024-04-02T07:25:14.826560+0000","last_fullsized":"2024-04-02T07:25:14.826560+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:28:55.115477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455481+0000","last_change":"2024-04-02T07:25:13.845846+0000","last_active":"2024-04-02T07:25:15.455481+0000","last_peered":"2024-04-02T07:25:15.455481+0000","last_clean":"2024-04-02T07:25:15.455481+0000","last_became_active":"2024-04-02T07:25:13.845290+0000","last_became_peered":"2024-04-02T07:25:13.845290+0000","last_unstale":"2024-04-02T07:25:15.455481+0000","last_undegraded":"2024-04-02T07:25:15.455481+0000","last_fullsized":"2024-04-02T07:25:15.455481+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:02:07.068315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829308+0000","last_change":"2024-04-02T07:25:13.834576+0000","last_active":"2024-04-02T07:25:14.829308+0000","last_peered":"2024-04-02T07:25:14.829308+0000","last_clean":"2024-04-02T07:25:14.829308+0000","last_became_active":"2024-04-02T07:25:13.834288+0000","last_became_peered":"2024-04-02T07:25:13.834288+0000","last_unstale":"2024-04-02T07:25:14.829308+0000","last_undegraded":"2024-04-02T07:25:14.829308+0000","last_fullsized":"2024-04-02T07:25:14.829308+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:10:06.210851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456362+0000","last_change":"2024-04-02T07:25:13.843458+0000","last_active":"2024-04-02T07:25:15.456362+0000","last_peered":"2024-04-02T07:25:15.456362+0000","last_clean":"2024-04-02T07:25:15.456362+0000","last_became_active":"2024-04-02T07:25:13.842905+0000","last_became_peered":"2024-04-02T07:25:13.842905+0000","last_unstale":"2024-04-02T07:25:15.456362+0000","last_undegraded":"2024-04-02T07:25:15.456362+0000","last_fullsized":"2024-04-02T07:25:15.456362+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:55:32.708707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.830482+0000","last_change":"2024-04-02T07:25:13.838336+0000","last_active":"2024-04-02T07:25:14.830482+0000","last_peered":"2024-04-02T07:25:14.830482+0000","last_clean":"2024-04-02T07:25:14.830482+0000","last_became_active":"2024-04-02T07:25:13.838042+0000","last_became_peered":"2024-04-02T07:25:13.838042+0000","last_unstale":"2024-04-02T07:25:14.830482+0000","last_undegraded":"2024-04-02T07:25:14.830482+0000","last_fullsized":"2024-04-02T07:25:14.830482+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:18:53.200389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829194+0000","last_change":"2024-04-02T07:25:13.838204+0000","last_active":"2024-04-02T07:25:14.829194+0000","last_peered":"2024-04-02T07:25:14.829194+0000","last_clean":"2024-04-02T07:25:14.829194+0000","last_became_active":"2024-04-02T07:25:13.837836+0000","last_became_peered":"2024-04-02T07:25:13.837836+0000","last_unstale":"2024-04-02T07:25:14.829194+0000","last_undegraded":"2024-04-02T07:25:14.829194+0000","last_fullsized":"2024-04-02T07:25:14.829194+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:45:25.339615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455360+0000","last_change":"2024-04-02T07:25:13.836353+0000","last_active":"2024-04-02T07:25:15.455360+0000","last_peered":"2024-04-02T07:25:15.455360+0000","last_clean":"2024-04-02T07:25:15.455360+0000","last_became_active":"2024-04-02T07:25:13.836102+0000","last_became_peered":"2024-04-02T07:25:13.836102+0000","last_unstale":"2024-04-02T07:25:15.455360+0000","last_undegraded":"2024-04-02T07:25:15.455360+0000","last_fullsized":"2024-04-02T07:25:15.455360+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:34:55.188580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829053+0000","last_change":"2024-04-02T07:25:13.832801+0000","last_active":"2024-04-02T07:25:14.829053+0000","last_peered":"2024-04-02T07:25:14.829053+0000","last_clean":"2024-04-02T07:25:14.829053+0000","last_became_active":"2024-04-02T07:25:13.832250+0000","last_became_peered":"2024-04-02T07:25:13.832250+0000","last_unstale":"2024-04-02T07:25:14.829053+0000","last_undegraded":"2024-04-02T07:25:14.829053+0000","last_fullsized":"2024-04-02T07:25:14.829053+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:57:20.665756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455366+0000","last_change":"2024-04-02T07:25:13.844142+0000","last_active":"2024-04-02T07:25:15.455366+0000","last_peered":"2024-04-02T07:25:15.455366+0000","last_clean":"2024-04-02T07:25:15.455366+0000","last_became_active":"2024-04-02T07:25:13.843777+0000","last_became_peered":"2024-04-02T07:25:13.843777+0000","last_unstale":"2024-04-02T07:25:15.455366+0000","last_undegraded":"2024-04-02T07:25:15.455366+0000","last_fullsized":"2024-04-02T07:25:15.455366+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:49:41.992789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456107+0000","last_change":"2024-04-02T07:25:13.834559+0000","last_active":"2024-04-02T07:25:15.456107+0000","last_peered":"2024-04-02T07:25:15.456107+0000","last_clean":"2024-04-02T07:25:15.456107+0000","last_became_active":"2024-04-02T07:25:13.833967+0000","last_became_peered":"2024-04-02T07:25:13.833967+0000","last_unstale":"2024-04-02T07:25:15.456107+0000","last_undegraded":"2024-04-02T07:25:15.456107+0000","last_fullsized":"2024-04-02T07:25:15.456107+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:04:16.273349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.830598+0000","last_change":"2024-04-02T07:25:13.847877+0000","last_active":"2024-04-02T07:25:14.830598+0000","last_peered":"2024-04-02T07:25:14.830598+0000","last_clean":"2024-04-02T07:25:14.830598+0000","last_became_active":"2024-04-02T07:25:13.847022+0000","last_became_peered":"2024-04-02T07:25:13.847022+0000","last_unstale":"2024-04-02T07:25:14.830598+0000","last_undegraded":"2024-04-02T07:25:14.830598+0000","last_fullsized":"2024-04-02T07:25:14.830598+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:32:33.134234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455946+0000","last_change":"2024-04-02T07:25:13.837984+0000","last_active":"2024-04-02T07:25:15.455946+0000","last_peered":"2024-04-02T07:25:15.455946+0000","last_clean":"2024-04-02T07:25:15.455946+0000","last_became_active":"2024-04-02T07:25:13.837732+0000","last_became_peered":"2024-04-02T07:25:13.837732+0000","last_unstale":"2024-04-02T07:25:15.455946+0000","last_undegraded":"2024-04-02T07:25:15.455946+0000","last_fullsized":"2024-04-02T07:25:15.455946+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:56:30.473912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455639+0000","last_change":"2024-04-02T07:25:13.833228+0000","last_active":"2024-04-02T07:25:15.455639+0000","last_peered":"2024-04-02T07:25:15.455639+0000","last_clean":"2024-04-02T07:25:15.455639+0000","last_became_active":"2024-04-02T07:25:13.833014+0000","last_became_peered":"2024-04-02T07:25:13.833014+0000","last_unstale":"2024-04-02T07:25:15.455639+0000","last_undegraded":"2024-04-02T07:25:15.455639+0000","last_fullsized":"2024-04-02T07:25:15.455639+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:15:58.074270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.830579+0000","last_change":"2024-04-02T07:25:13.831253+0000","last_active":"2024-04-02T07:25:14.830579+0000","last_peered":"2024-04-02T07:25:14.830579+0000","last_clean":"2024-04-02T07:25:14.830579+0000","last_became_active":"2024-04-02T07:25:13.829934+0000","last_became_peered":"2024-04-02T07:25:13.829934+0000","last_unstale":"2024-04-02T07:25:14.830579+0000","last_undegraded":"2024-04-02T07:25:14.830579+0000","last_fullsized":"2024-04-02T07:25:14.830579+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:47:51.522549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829142+0000","last_change":"2024-04-02T07:25:13.838011+0000","last_active":"2024-04-02T07:25:14.829142+0000","last_peered":"2024-04-02T07:25:14.829142+0000","last_clean":"2024-04-02T07:25:14.829142+0000","last_became_active":"2024-04-02T07:25:13.837672+0000","last_became_peered":"2024-04-02T07:25:13.837672+0000","last_unstale":"2024-04-02T07:25:14.829142+0000","last_undegraded":"2024-04-02T07:25:14.829142+0000","last_fullsized":"2024-04-02T07:25:14.829142+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:49:41.992789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455360+0000","last_change":"2024-04-02T07:25:13.838228+0000","last_active":"2024-04-02T07:25:15.455360+0000","last_peered":"2024-04-02T07:25:15.455360+0000","last_clean":"2024-04-02T07:25:15.455360+0000","last_became_active":"2024-04-02T07:25:13.837579+0000","last_became_peered":"2024-04-02T07:25:13.837579+0000","last_unstale":"2024-04-02T07:25:15.455360+0000","last_undegraded":"2024-04-02T07:25:15.455360+0000","last_fullsized":"2024-04-02T07:25:15.455360+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:55:52.300846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.830321+0000","last_change":"2024-04-02T07:25:13.847345+0000","last_active":"2024-04-02T07:25:14.830321+0000","last_peered":"2024-04-02T07:25:14.830321+0000","last_clean":"2024-04-02T07:25:14.830321+0000","last_became_active":"2024-04-02T07:25:13.847026+0000","last_became_peered":"2024-04-02T07:25:13.847026+0000","last_unstale":"2024-04-02T07:25:14.830321+0000","last_undegraded":"2024-04-02T07:25:14.830321+0000","last_fullsized":"2024-04-02T07:25:14.830321+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:17:07.326518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455574+0000","last_change":"2024-04-02T07:25:13.846009+0000","last_active":"2024-04-02T07:25:15.455574+0000","last_peered":"2024-04-02T07:25:15.455574+0000","last_clean":"2024-04-02T07:25:15.455574+0000","last_became_active":"2024-04-02T07:25:13.845605+0000","last_became_peered":"2024-04-02T07:25:13.845605+0000","last_unstale":"2024-04-02T07:25:15.455574+0000","last_undegraded":"2024-04-02T07:25:15.455574+0000","last_fullsized":"2024-04-02T07:25:15.455574+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:44:09.371280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455904+0000","last_change":"2024-04-02T07:25:13.841312+0000","last_active":"2024-04-02T07:25:15.455904+0000","last_peered":"2024-04-02T07:25:15.455904+0000","last_clean":"2024-04-02T07:25:15.455904+0000","last_became_active":"2024-04-02T07:25:13.840560+0000","last_became_peered":"2024-04-02T07:25:13.840560+0000","last_unstale":"2024-04-02T07:25:15.455904+0000","last_undegraded":"2024-04-02T07:25:15.455904+0000","last_fullsized":"2024-04-02T07:25:15.455904+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:55:32.708707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456048+0000","last_change":"2024-04-02T07:25:13.415068+0000","last_active":"2024-04-02T07:25:15.456048+0000","last_peered":"2024-04-02T07:25:15.456048+0000","last_clean":"2024-04-02T07:25:15.456048+0000","last_became_active":"2024-04-02T07:25:13.414817+0000","last_became_peered":"2024-04-02T07:25:13.414817+0000","last_unstale":"2024-04-02T07:25:15.456048+0000","last_undegraded":"2024-04-02T07:25:15.456048+0000","last_fullsized":"2024-04-02T07:25:15.456048+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:07:08.173462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455590+0000","last_change":"2024-04-02T07:25:13.838505+0000","last_active":"2024-04-02T07:25:15.455590+0000","last_peered":"2024-04-02T07:25:15.455590+0000","last_clean":"2024-04-02T07:25:15.455590+0000","last_became_active":"2024-04-02T07:25:13.838240+0000","last_became_peered":"2024-04-02T07:25:13.838240+0000","last_unstale":"2024-04-02T07:25:15.455590+0000","last_undegraded":"2024-04-02T07:25:15.455590+0000","last_fullsized":"2024-04-02T07:25:15.455590+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:03:59.723055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829249+0000","last_change":"2024-04-02T07:25:13.424079+0000","last_active":"2024-04-02T07:25:14.829249+0000","last_peered":"2024-04-02T07:25:14.829249+0000","last_clean":"2024-04-02T07:25:14.829249+0000","last_became_active":"2024-04-02T07:25:13.423746+0000","last_became_peered":"2024-04-02T07:25:13.423746+0000","last_unstale":"2024-04-02T07:25:14.829249+0000","last_undegraded":"2024-04-02T07:25:14.829249+0000","last_fullsized":"2024-04-02T07:25:14.829249+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:18:23.550256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455715+0000","last_change":"2024-04-02T07:25:13.843729+0000","last_active":"2024-04-02T07:25:15.455715+0000","last_peered":"2024-04-02T07:25:15.455715+0000","last_clean":"2024-04-02T07:25:15.455715+0000","last_became_active":"2024-04-02T07:25:13.843443+0000","last_became_peered":"2024-04-02T07:25:13.843443+0000","last_unstale":"2024-04-02T07:25:15.455715+0000","last_undegraded":"2024-04-02T07:25:15.455715+0000","last_fullsized":"2024-04-02T07:25:15.455715+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:36:10.654914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455971+0000","last_change":"2024-04-02T07:25:13.416627+0000","last_active":"2024-04-02T07:25:15.455971+0000","last_peered":"2024-04-02T07:25:15.455971+0000","last_clean":"2024-04-02T07:25:15.455971+0000","last_became_active":"2024-04-02T07:25:13.415857+0000","last_became_peered":"2024-04-02T07:25:13.415857+0000","last_unstale":"2024-04-02T07:25:15.455971+0000","last_undegraded":"2024-04-02T07:25:15.455971+0000","last_fullsized":"2024-04-02T07:25:15.455971+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:45:45.317797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455862+0000","last_change":"2024-04-02T07:25:13.835778+0000","last_active":"2024-04-02T07:25:15.455862+0000","last_peered":"2024-04-02T07:25:15.455862+0000","last_clean":"2024-04-02T07:25:15.455862+0000","last_became_active":"2024-04-02T07:25:13.835268+0000","last_became_peered":"2024-04-02T07:25:13.835268+0000","last_unstale":"2024-04-02T07:25:15.455862+0000","last_undegraded":"2024-04-02T07:25:15.455862+0000","last_fullsized":"2024-04-02T07:25:15.455862+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:48:10.866582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456028+0000","last_change":"2024-04-02T07:25:13.421639+0000","last_active":"2024-04-02T07:25:15.456028+0000","last_peered":"2024-04-02T07:25:15.456028+0000","last_clean":"2024-04-02T07:25:15.456028+0000","last_became_active":"2024-04-02T07:25:13.421395+0000","last_became_peered":"2024-04-02T07:25:13.421395+0000","last_unstale":"2024-04-02T07:25:15.456028+0000","last_undegraded":"2024-04-02T07:25:15.456028+0000","last_fullsized":"2024-04-02T07:25:15.456028+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:45:59.216395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829495+0000","last_change":"2024-04-02T07:25:13.832954+0000","last_active":"2024-04-02T07:25:14.829495+0000","last_peered":"2024-04-02T07:25:14.829495+0000","last_clean":"2024-04-02T07:25:14.829495+0000","last_became_active":"2024-04-02T07:25:13.832570+0000","last_became_peered":"2024-04-02T07:25:13.832570+0000","last_unstale":"2024-04-02T07:25:14.829495+0000","last_undegraded":"2024-04-02T07:25:14.829495+0000","last_fullsized":"2024-04-02T07:25:14.829495+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:25:16.892809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826681+0000","last_change":"2024-04-02T07:25:13.420222+0000","last_active":"2024-04-02T07:25:14.826681+0000","last_peered":"2024-04-02T07:25:14.826681+0000","last_clean":"2024-04-02T07:25:14.826681+0000","last_became_active":"2024-04-02T07:25:13.419887+0000","last_became_peered":"2024-04-02T07:25:13.419887+0000","last_unstale":"2024-04-02T07:25:14.826681+0000","last_undegraded":"2024-04-02T07:25:14.826681+0000","last_fullsized":"2024-04-02T07:25:14.826681+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:03:58.719895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829048+0000","last_change":"2024-04-02T07:25:13.850986+0000","last_active":"2024-04-02T07:25:14.829048+0000","last_peered":"2024-04-02T07:25:14.829048+0000","last_clean":"2024-04-02T07:25:14.829048+0000","last_became_active":"2024-04-02T07:25:13.850156+0000","last_became_peered":"2024-04-02T07:25:13.850156+0000","last_unstale":"2024-04-02T07:25:14.829048+0000","last_undegraded":"2024-04-02T07:25:14.829048+0000","last_fullsized":"2024-04-02T07:25:14.829048+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:07.833961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455873+0000","last_change":"2024-04-02T07:25:13.416810+0000","last_active":"2024-04-02T07:25:15.455873+0000","last_peered":"2024-04-02T07:25:15.455873+0000","last_clean":"2024-04-02T07:25:15.455873+0000","last_became_active":"2024-04-02T07:25:13.416223+0000","last_became_peered":"2024-04-02T07:25:13.416223+0000","last_unstale":"2024-04-02T07:25:15.455873+0000","last_undegraded":"2024-04-02T07:25:15.455873+0000","last_fullsized":"2024-04-02T07:25:15.455873+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:35:14.297544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456165+0000","last_change":"2024-04-02T07:25:13.834761+0000","last_active":"2024-04-02T07:25:15.456165+0000","last_peered":"2024-04-02T07:25:15.456165+0000","last_clean":"2024-04-02T07:25:15.456165+0000","last_became_active":"2024-04-02T07:25:13.834324+0000","last_became_peered":"2024-04-02T07:25:13.834324+0000","last_unstale":"2024-04-02T07:25:15.456165+0000","last_undegraded":"2024-04-02T07:25:15.456165+0000","last_fullsized":"2024-04-02T07:25:15.456165+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:53:24.682624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455725+0000","last_change":"2024-04-02T07:25:13.419532+0000","last_active":"2024-04-02T07:25:15.455725+0000","last_peered":"2024-04-02T07:25:15.455725+0000","last_clean":"2024-04-02T07:25:15.455725+0000","last_became_active":"2024-04-02T07:25:13.419219+0000","last_became_peered":"2024-04-02T07:25:13.419219+0000","last_unstale":"2024-04-02T07:25:15.455725+0000","last_undegraded":"2024-04-02T07:25:15.455725+0000","last_fullsized":"2024-04-02T07:25:15.455725+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:27:54.548904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.828913+0000","last_change":"2024-04-02T07:25:13.834100+0000","last_active":"2024-04-02T07:25:14.828913+0000","last_peered":"2024-04-02T07:25:14.828913+0000","last_clean":"2024-04-02T07:25:14.828913+0000","last_became_active":"2024-04-02T07:25:13.833716+0000","last_became_peered":"2024-04-02T07:25:13.833716+0000","last_unstale":"2024-04-02T07:25:14.828913+0000","last_undegraded":"2024-04-02T07:25:14.828913+0000","last_fullsized":"2024-04-02T07:25:14.828913+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:41:14.947839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826382+0000","last_change":"2024-04-02T07:25:13.424479+0000","last_active":"2024-04-02T07:25:14.826382+0000","last_peered":"2024-04-02T07:25:14.826382+0000","last_clean":"2024-04-02T07:25:14.826382+0000","last_became_active":"2024-04-02T07:25:13.424050+0000","last_became_peered":"2024-04-02T07:25:13.424050+0000","last_unstale":"2024-04-02T07:25:14.826382+0000","last_undegraded":"2024-04-02T07:25:14.826382+0000","last_fullsized":"2024-04-02T07:25:14.826382+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:24:14.617250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826801+0000","last_change":"2024-04-02T07:25:13.834396+0000","last_active":"2024-04-02T07:25:14.826801+0000","last_peered":"2024-04-02T07:25:14.826801+0000","last_clean":"2024-04-02T07:25:14.826801+0000","last_became_active":"2024-04-02T07:25:13.834132+0000","last_became_peered":"2024-04-02T07:25:13.834132+0000","last_unstale":"2024-04-02T07:25:14.826801+0000","last_undegraded":"2024-04-02T07:25:14.826801+0000","last_fullsized":"2024-04-02T07:25:14.826801+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:09:15.330565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456685+0000","last_change":"2024-04-02T07:25:13.422718+0000","last_active":"2024-04-02T07:25:15.456685+0000","last_peered":"2024-04-02T07:25:15.456685+0000","last_clean":"2024-04-02T07:25:15.456685+0000","last_became_active":"2024-04-02T07:25:13.422325+0000","last_became_peered":"2024-04-02T07:25:13.422325+0000","last_unstale":"2024-04-02T07:25:15.456685+0000","last_undegraded":"2024-04-02T07:25:15.456685+0000","last_fullsized":"2024-04-02T07:25:15.456685+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:37:30.541440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456689+0000","last_change":"2024-04-02T07:25:13.847554+0000","last_active":"2024-04-02T07:25:15.456689+0000","last_peered":"2024-04-02T07:25:15.456689+0000","last_clean":"2024-04-02T07:25:15.456689+0000","last_became_active":"2024-04-02T07:25:13.847256+0000","last_became_peered":"2024-04-02T07:25:13.847256+0000","last_unstale":"2024-04-02T07:25:15.456689+0000","last_undegraded":"2024-04-02T07:25:15.456689+0000","last_fullsized":"2024-04-02T07:25:15.456689+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:15:58.074270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829305+0000","last_change":"2024-04-02T07:25:13.422323+0000","last_active":"2024-04-02T07:25:14.829305+0000","last_peered":"2024-04-02T07:25:14.829305+0000","last_clean":"2024-04-02T07:25:14.829305+0000","last_became_active":"2024-04-02T07:25:13.422067+0000","last_became_peered":"2024-04-02T07:25:13.422067+0000","last_unstale":"2024-04-02T07:25:14.829305+0000","last_undegraded":"2024-04-02T07:25:14.829305+0000","last_fullsized":"2024-04-02T07:25:14.829305+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:42:18.216499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455183+0000","last_change":"2024-04-02T07:25:13.842448+0000","last_active":"2024-04-02T07:25:15.455183+0000","last_peered":"2024-04-02T07:25:15.455183+0000","last_clean":"2024-04-02T07:25:15.455183+0000","last_became_active":"2024-04-02T07:25:13.841871+0000","last_became_peered":"2024-04-02T07:25:13.841871+0000","last_unstale":"2024-04-02T07:25:15.455183+0000","last_undegraded":"2024-04-02T07:25:15.455183+0000","last_fullsized":"2024-04-02T07:25:15.455183+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:04:16.273349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456485+0000","last_change":"2024-04-02T07:25:13.420126+0000","last_active":"2024-04-02T07:25:15.456485+0000","last_peered":"2024-04-02T07:25:15.456485+0000","last_clean":"2024-04-02T07:25:15.456485+0000","last_became_active":"2024-04-02T07:25:13.419873+0000","last_became_peered":"2024-04-02T07:25:13.419873+0000","last_unstale":"2024-04-02T07:25:15.456485+0000","last_undegraded":"2024-04-02T07:25:15.456485+0000","last_fullsized":"2024-04-02T07:25:15.456485+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:07:08.173462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456356+0000","last_change":"2024-04-02T07:25:13.847728+0000","last_active":"2024-04-02T07:25:15.456356+0000","last_peered":"2024-04-02T07:25:15.456356+0000","last_clean":"2024-04-02T07:25:15.456356+0000","last_became_active":"2024-04-02T07:25:13.847425+0000","last_became_peered":"2024-04-02T07:25:13.847425+0000","last_unstale":"2024-04-02T07:25:15.456356+0000","last_undegraded":"2024-04-02T07:25:15.456356+0000","last_fullsized":"2024-04-02T07:25:15.456356+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:02:07.068315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826768+0000","last_change":"2024-04-02T07:25:13.424042+0000","last_active":"2024-04-02T07:25:14.826768+0000","last_peered":"2024-04-02T07:25:14.826768+0000","last_clean":"2024-04-02T07:25:14.826768+0000","last_became_active":"2024-04-02T07:25:13.423787+0000","last_became_peered":"2024-04-02T07:25:13.423787+0000","last_unstale":"2024-04-02T07:25:14.826768+0000","last_undegraded":"2024-04-02T07:25:14.826768+0000","last_fullsized":"2024-04-02T07:25:14.826768+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:17:50.540310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455659+0000","last_change":"2024-04-02T07:25:13.830681+0000","last_active":"2024-04-02T07:25:15.455659+0000","last_peered":"2024-04-02T07:25:15.455659+0000","last_clean":"2024-04-02T07:25:15.455659+0000","last_became_active":"2024-04-02T07:25:13.830405+0000","last_became_peered":"2024-04-02T07:25:13.830405+0000","last_unstale":"2024-04-02T07:25:15.455659+0000","last_undegraded":"2024-04-02T07:25:15.455659+0000","last_fullsized":"2024-04-02T07:25:15.455659+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:23:03.626287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829140+0000","last_change":"2024-04-02T07:25:13.424149+0000","last_active":"2024-04-02T07:25:14.829140+0000","last_peered":"2024-04-02T07:25:14.829140+0000","last_clean":"2024-04-02T07:25:14.829140+0000","last_became_active":"2024-04-02T07:25:13.423867+0000","last_became_peered":"2024-04-02T07:25:13.423867+0000","last_unstale":"2024-04-02T07:25:14.829140+0000","last_undegraded":"2024-04-02T07:25:14.829140+0000","last_fullsized":"2024-04-02T07:25:14.829140+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:01:49.923849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456264+0000","last_change":"2024-04-02T07:25:13.832846+0000","last_active":"2024-04-02T07:25:15.456264+0000","last_peered":"2024-04-02T07:25:15.456264+0000","last_clean":"2024-04-02T07:25:15.456264+0000","last_became_active":"2024-04-02T07:25:13.832047+0000","last_became_peered":"2024-04-02T07:25:13.832047+0000","last_unstale":"2024-04-02T07:25:15.456264+0000","last_undegraded":"2024-04-02T07:25:15.456264+0000","last_fullsized":"2024-04-02T07:25:15.456264+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:17:05.963406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456862+0000","last_change":"2024-04-02T07:25:13.414656+0000","last_active":"2024-04-02T07:25:15.456862+0000","last_peered":"2024-04-02T07:25:15.456862+0000","last_clean":"2024-04-02T07:25:15.456862+0000","last_became_active":"2024-04-02T07:25:13.414393+0000","last_became_peered":"2024-04-02T07:25:13.414393+0000","last_unstale":"2024-04-02T07:25:15.456862+0000","last_undegraded":"2024-04-02T07:25:15.456862+0000","last_fullsized":"2024-04-02T07:25:15.456862+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:40:18.231963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826312+0000","last_change":"2024-04-02T07:25:13.839714+0000","last_active":"2024-04-02T07:25:14.826312+0000","last_peered":"2024-04-02T07:25:14.826312+0000","last_clean":"2024-04-02T07:25:14.826312+0000","last_became_active":"2024-04-02T07:25:13.833918+0000","last_became_peered":"2024-04-02T07:25:13.833918+0000","last_unstale":"2024-04-02T07:25:14.826312+0000","last_undegraded":"2024-04-02T07:25:14.826312+0000","last_fullsized":"2024-04-02T07:25:14.826312+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:45:37.603677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455850+0000","last_change":"2024-04-02T07:25:13.415326+0000","last_active":"2024-04-02T07:25:15.455850+0000","last_peered":"2024-04-02T07:25:15.455850+0000","last_clean":"2024-04-02T07:25:15.455850+0000","last_became_active":"2024-04-02T07:25:13.414772+0000","last_became_peered":"2024-04-02T07:25:13.414772+0000","last_unstale":"2024-04-02T07:25:15.455850+0000","last_undegraded":"2024-04-02T07:25:15.455850+0000","last_fullsized":"2024-04-02T07:25:15.455850+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:15:47.737303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456287+0000","last_change":"2024-04-02T07:25:13.844036+0000","last_active":"2024-04-02T07:25:15.456287+0000","last_peered":"2024-04-02T07:25:15.456287+0000","last_clean":"2024-04-02T07:25:15.456287+0000","last_became_active":"2024-04-02T07:25:13.843573+0000","last_became_peered":"2024-04-02T07:25:13.843573+0000","last_unstale":"2024-04-02T07:25:15.456287+0000","last_undegraded":"2024-04-02T07:25:15.456287+0000","last_fullsized":"2024-04-02T07:25:15.456287+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:38:46.221450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":19,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455276+0000","last_change":"2024-04-02T07:25:13.415882+0000","last_active":"2024-04-02T07:25:15.455276+0000","last_peered":"2024-04-02T07:25:15.455276+0000","last_clean":"2024-04-02T07:25:15.455276+0000","last_became_active":"2024-04-02T07:25:13.415566+0000","last_became_peered":"2024-04-02T07:25:13.415566+0000","last_unstale":"2024-04-02T07:25:15.455276+0000","last_undegraded":"2024-04-02T07:25:15.455276+0000","last_fullsized":"2024-04-02T07:25:15.455276+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:35:14.297544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456467+0000","last_change":"2024-04-02T07:25:13.838691+0000","last_active":"2024-04-02T07:25:15.456467+0000","last_peered":"2024-04-02T07:25:15.456467+0000","last_clean":"2024-04-02T07:25:15.456467+0000","last_became_active":"2024-04-02T07:25:13.838425+0000","last_became_peered":"2024-04-02T07:25:13.838425+0000","last_unstale":"2024-04-02T07:25:15.456467+0000","last_undegraded":"2024-04-02T07:25:15.456467+0000","last_fullsized":"2024-04-02T07:25:15.456467+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:44:09.371280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829430+0000","last_change":"2024-04-02T07:25:13.420012+0000","last_active":"2024-04-02T07:25:14.829430+0000","last_peered":"2024-04-02T07:25:14.829430+0000","last_clean":"2024-04-02T07:25:14.829430+0000","last_became_active":"2024-04-02T07:25:13.419709+0000","last_became_peered":"2024-04-02T07:25:13.419709+0000","last_unstale":"2024-04-02T07:25:14.829430+0000","last_undegraded":"2024-04-02T07:25:14.829430+0000","last_fullsized":"2024-04-02T07:25:14.829430+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:13:17.056274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456169+0000","last_change":"2024-04-02T07:25:13.841727+0000","last_active":"2024-04-02T07:25:15.456169+0000","last_peered":"2024-04-02T07:25:15.456169+0000","last_clean":"2024-04-02T07:25:15.456169+0000","last_became_active":"2024-04-02T07:25:13.841192+0000","last_became_peered":"2024-04-02T07:25:13.841192+0000","last_unstale":"2024-04-02T07:25:15.456169+0000","last_undegraded":"2024-04-02T07:25:15.456169+0000","last_fullsized":"2024-04-02T07:25:15.456169+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:24:57.139678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455908+0000","last_change":"2024-04-02T07:25:13.415637+0000","last_active":"2024-04-02T07:25:15.455908+0000","last_peered":"2024-04-02T07:25:15.455908+0000","last_clean":"2024-04-02T07:25:15.455908+0000","last_became_active":"2024-04-02T07:25:13.414724+0000","last_became_peered":"2024-04-02T07:25:13.414724+0000","last_unstale":"2024-04-02T07:25:15.455908+0000","last_undegraded":"2024-04-02T07:25:15.455908+0000","last_fullsized":"2024-04-02T07:25:15.455908+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:27:54.548904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829302+0000","last_change":"2024-04-02T07:25:13.838727+0000","last_active":"2024-04-02T07:25:14.829302+0000","last_peered":"2024-04-02T07:25:14.829302+0000","last_clean":"2024-04-02T07:25:14.829302+0000","last_became_active":"2024-04-02T07:25:13.838464+0000","last_became_peered":"2024-04-02T07:25:13.838464+0000","last_unstale":"2024-04-02T07:25:14.829302+0000","last_undegraded":"2024-04-02T07:25:14.829302+0000","last_fullsized":"2024-04-02T07:25:14.829302+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:08:26.104078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455935+0000","last_change":"2024-04-02T07:25:13.421116+0000","last_active":"2024-04-02T07:25:15.455935+0000","last_peered":"2024-04-02T07:25:15.455935+0000","last_clean":"2024-04-02T07:25:15.455935+0000","last_became_active":"2024-04-02T07:25:13.420829+0000","last_became_peered":"2024-04-02T07:25:13.420829+0000","last_unstale":"2024-04-02T07:25:15.455935+0000","last_undegraded":"2024-04-02T07:25:15.455935+0000","last_fullsized":"2024-04-02T07:25:15.455935+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:30:45.003944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456455+0000","last_change":"2024-04-02T07:25:13.848913+0000","last_active":"2024-04-02T07:25:15.456455+0000","last_peered":"2024-04-02T07:25:15.456455+0000","last_clean":"2024-04-02T07:25:15.456455+0000","last_became_active":"2024-04-02T07:25:13.847541+0000","last_became_peered":"2024-04-02T07:25:13.847541+0000","last_unstale":"2024-04-02T07:25:15.456455+0000","last_undegraded":"2024-04-02T07:25:15.456455+0000","last_fullsized":"2024-04-02T07:25:15.456455+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:36:10.654914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455804+0000","last_change":"2024-04-02T07:25:13.420298+0000","last_active":"2024-04-02T07:25:15.455804+0000","last_peered":"2024-04-02T07:25:15.455804+0000","last_clean":"2024-04-02T07:25:15.455804+0000","last_became_active":"2024-04-02T07:25:13.419940+0000","last_became_peered":"2024-04-02T07:25:13.419940+0000","last_unstale":"2024-04-02T07:25:15.455804+0000","last_undegraded":"2024-04-02T07:25:15.455804+0000","last_fullsized":"2024-04-02T07:25:15.455804+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:45:36.600517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456068+0000","last_change":"2024-04-02T07:25:13.841576+0000","last_active":"2024-04-02T07:25:15.456068+0000","last_peered":"2024-04-02T07:25:15.456068+0000","last_clean":"2024-04-02T07:25:15.456068+0000","last_became_active":"2024-04-02T07:25:13.841305+0000","last_became_peered":"2024-04-02T07:25:13.841305+0000","last_unstale":"2024-04-02T07:25:15.456068+0000","last_undegraded":"2024-04-02T07:25:15.456068+0000","last_fullsized":"2024-04-02T07:25:15.456068+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:30:14.485175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829230+0000","last_change":"2024-04-02T07:25:13.419301+0000","last_active":"2024-04-02T07:25:14.829230+0000","last_peered":"2024-04-02T07:25:14.829230+0000","last_clean":"2024-04-02T07:25:14.829230+0000","last_became_active":"2024-04-02T07:25:13.419018+0000","last_became_peered":"2024-04-02T07:25:13.419018+0000","last_unstale":"2024-04-02T07:25:14.829230+0000","last_undegraded":"2024-04-02T07:25:14.829230+0000","last_fullsized":"2024-04-02T07:25:14.829230+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:37:21.580450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455561+0000","last_change":"2024-04-02T07:25:13.845285+0000","last_active":"2024-04-02T07:25:15.455561+0000","last_peered":"2024-04-02T07:25:15.455561+0000","last_clean":"2024-04-02T07:25:15.455561+0000","last_became_active":"2024-04-02T07:25:13.845046+0000","last_became_peered":"2024-04-02T07:25:13.845046+0000","last_unstale":"2024-04-02T07:25:15.455561+0000","last_undegraded":"2024-04-02T07:25:15.455561+0000","last_fullsized":"2024-04-02T07:25:15.455561+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:51:16.504462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455070+0000","last_change":"2024-04-02T07:25:13.414596+0000","last_active":"2024-04-02T07:25:15.455070+0000","last_peered":"2024-04-02T07:25:15.455070+0000","last_clean":"2024-04-02T07:25:15.455070+0000","last_became_active":"2024-04-02T07:25:13.414339+0000","last_became_peered":"2024-04-02T07:25:13.414339+0000","last_unstale":"2024-04-02T07:25:15.455070+0000","last_undegraded":"2024-04-02T07:25:15.455070+0000","last_fullsized":"2024-04-02T07:25:15.455070+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:30:09.018484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455712+0000","last_change":"2024-04-02T07:25:13.841015+0000","last_active":"2024-04-02T07:25:15.455712+0000","last_peered":"2024-04-02T07:25:15.455712+0000","last_clean":"2024-04-02T07:25:15.455712+0000","last_became_active":"2024-04-02T07:25:13.840145+0000","last_became_peered":"2024-04-02T07:25:13.840145+0000","last_unstale":"2024-04-02T07:25:15.455712+0000","last_undegraded":"2024-04-02T07:25:15.455712+0000","last_fullsized":"2024-04-02T07:25:15.455712+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:56:30.473912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455692+0000","last_change":"2024-04-02T07:25:13.419192+0000","last_active":"2024-04-02T07:25:15.455692+0000","last_peered":"2024-04-02T07:25:15.455692+0000","last_clean":"2024-04-02T07:25:15.455692+0000","last_became_active":"2024-04-02T07:25:13.418954+0000","last_became_peered":"2024-04-02T07:25:13.418954+0000","last_unstale":"2024-04-02T07:25:15.455692+0000","last_undegraded":"2024-04-02T07:25:15.455692+0000","last_fullsized":"2024-04-02T07:25:15.455692+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:45:45.317797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456108+0000","last_change":"2024-04-02T07:25:13.828785+0000","last_active":"2024-04-02T07:25:15.456108+0000","last_peered":"2024-04-02T07:25:15.456108+0000","last_clean":"2024-04-02T07:25:15.456108+0000","last_became_active":"2024-04-02T07:25:13.827672+0000","last_became_peered":"2024-04-02T07:25:13.827672+0000","last_unstale":"2024-04-02T07:25:15.456108+0000","last_undegraded":"2024-04-02T07:25:15.456108+0000","last_fullsized":"2024-04-02T07:25:15.456108+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:42:19.219659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455681+0000","last_change":"2024-04-02T07:25:13.425406+0000","last_active":"2024-04-02T07:25:15.455681+0000","last_peered":"2024-04-02T07:25:15.455681+0000","last_clean":"2024-04-02T07:25:15.455681+0000","last_became_active":"2024-04-02T07:25:13.425101+0000","last_became_peered":"2024-04-02T07:25:13.425101+0000","last_unstale":"2024-04-02T07:25:15.455681+0000","last_undegraded":"2024-04-02T07:25:15.455681+0000","last_fullsized":"2024-04-02T07:25:15.455681+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:58:08.193966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456175+0000","last_change":"2024-04-02T07:25:13.833680+0000","last_active":"2024-04-02T07:25:15.456175+0000","last_peered":"2024-04-02T07:25:15.456175+0000","last_clean":"2024-04-02T07:25:15.456175+0000","last_became_active":"2024-04-02T07:25:13.833408+0000","last_became_peered":"2024-04-02T07:25:13.833408+0000","last_unstale":"2024-04-02T07:25:15.456175+0000","last_undegraded":"2024-04-02T07:25:15.456175+0000","last_fullsized":"2024-04-02T07:25:15.456175+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:02:07.068315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456017+0000","last_change":"2024-04-02T07:25:13.415820+0000","last_active":"2024-04-02T07:25:15.456017+0000","last_peered":"2024-04-02T07:25:15.456017+0000","last_clean":"2024-04-02T07:25:15.456017+0000","last_became_active":"2024-04-02T07:25:13.415350+0000","last_became_peered":"2024-04-02T07:25:13.415350+0000","last_unstale":"2024-04-02T07:25:15.456017+0000","last_undegraded":"2024-04-02T07:25:15.456017+0000","last_fullsized":"2024-04-02T07:25:15.456017+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:37:30.541440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455199+0000","last_change":"2024-04-02T07:25:13.842444+0000","last_active":"2024-04-02T07:25:15.455199+0000","last_peered":"2024-04-02T07:25:15.455199+0000","last_clean":"2024-04-02T07:25:15.455199+0000","last_became_active":"2024-04-02T07:25:13.841421+0000","last_became_peered":"2024-04-02T07:25:13.841421+0000","last_unstale":"2024-04-02T07:25:15.455199+0000","last_undegraded":"2024-04-02T07:25:15.455199+0000","last_fullsized":"2024-04-02T07:25:15.455199+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:53:24.682624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456808+0000","last_change":"2024-04-02T07:25:13.417590+0000","last_active":"2024-04-02T07:25:15.456808+0000","last_peered":"2024-04-02T07:25:15.456808+0000","last_clean":"2024-04-02T07:25:15.456808+0000","last_became_active":"2024-04-02T07:25:13.417374+0000","last_became_peered":"2024-04-02T07:25:13.417374+0000","last_unstale":"2024-04-02T07:25:15.456808+0000","last_undegraded":"2024-04-02T07:25:15.456808+0000","last_fullsized":"2024-04-02T07:25:15.456808+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:58:39.230040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455944+0000","last_change":"2024-04-02T07:25:13.835557+0000","last_active":"2024-04-02T07:25:15.455944+0000","last_peered":"2024-04-02T07:25:15.455944+0000","last_clean":"2024-04-02T07:25:15.455944+0000","last_became_active":"2024-04-02T07:25:13.834950+0000","last_became_peered":"2024-04-02T07:25:13.834950+0000","last_unstale":"2024-04-02T07:25:15.455944+0000","last_undegraded":"2024-04-02T07:25:15.455944+0000","last_fullsized":"2024-04-02T07:25:15.455944+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:55:52.300846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456095+0000","last_change":"2024-04-02T07:25:13.418153+0000","last_active":"2024-04-02T07:25:15.456095+0000","last_peered":"2024-04-02T07:25:15.456095+0000","last_clean":"2024-04-02T07:25:15.456095+0000","last_became_active":"2024-04-02T07:25:13.417552+0000","last_became_peered":"2024-04-02T07:25:13.417552+0000","last_unstale":"2024-04-02T07:25:15.456095+0000","last_undegraded":"2024-04-02T07:25:15.456095+0000","last_fullsized":"2024-04-02T07:25:15.456095+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:45:36.600517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829430+0000","last_change":"2024-04-02T07:25:13.841756+0000","last_active":"2024-04-02T07:25:14.829430+0000","last_peered":"2024-04-02T07:25:14.829430+0000","last_clean":"2024-04-02T07:25:14.829430+0000","last_became_active":"2024-04-02T07:25:13.841502+0000","last_became_peered":"2024-04-02T07:25:13.841502+0000","last_unstale":"2024-04-02T07:25:14.829430+0000","last_undegraded":"2024-04-02T07:25:14.829430+0000","last_fullsized":"2024-04-02T07:25:14.829430+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:59:19.156812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455000+0000","last_change":"2024-04-02T07:25:13.413685+0000","last_active":"2024-04-02T07:25:15.455000+0000","last_peered":"2024-04-02T07:25:15.455000+0000","last_clean":"2024-04-02T07:25:15.455000+0000","last_became_active":"2024-04-02T07:25:13.413007+0000","last_became_peered":"2024-04-02T07:25:13.413007+0000","last_unstale":"2024-04-02T07:25:15.455000+0000","last_undegraded":"2024-04-02T07:25:15.455000+0000","last_fullsized":"2024-04-02T07:25:15.455000+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:48:18.595104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456389+0000","last_change":"2024-04-02T07:25:13.843455+0000","last_active":"2024-04-02T07:25:15.456389+0000","last_peered":"2024-04-02T07:25:15.456389+0000","last_clean":"2024-04-02T07:25:15.456389+0000","last_became_active":"2024-04-02T07:25:13.842833+0000","last_became_peered":"2024-04-02T07:25:13.842833+0000","last_unstale":"2024-04-02T07:25:15.456389+0000","last_undegraded":"2024-04-02T07:25:15.456389+0000","last_fullsized":"2024-04-02T07:25:15.456389+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:55:42.022540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826503+0000","last_change":"2024-04-02T07:25:13.422967+0000","last_active":"2024-04-02T07:25:14.826503+0000","last_peered":"2024-04-02T07:25:14.826503+0000","last_clean":"2024-04-02T07:25:14.826503+0000","last_became_active":"2024-04-02T07:25:13.422128+0000","last_became_peered":"2024-04-02T07:25:13.422128+0000","last_unstale":"2024-04-02T07:25:14.826503+0000","last_undegraded":"2024-04-02T07:25:14.826503+0000","last_fullsized":"2024-04-02T07:25:14.826503+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:49:53.952263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.454919+0000","last_change":"2024-04-02T07:25:13.842639+0000","last_active":"2024-04-02T07:25:15.454919+0000","last_peered":"2024-04-02T07:25:15.454919+0000","last_clean":"2024-04-02T07:25:15.454919+0000","last_became_active":"2024-04-02T07:25:13.842327+0000","last_became_peered":"2024-04-02T07:25:13.842327+0000","last_unstale":"2024-04-02T07:25:15.454919+0000","last_undegraded":"2024-04-02T07:25:15.454919+0000","last_fullsized":"2024-04-02T07:25:15.454919+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:24:15.620410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.454995+0000","last_change":"2024-04-02T07:25:13.419195+0000","last_active":"2024-04-02T07:25:15.454995+0000","last_peered":"2024-04-02T07:25:15.454995+0000","last_clean":"2024-04-02T07:25:15.454995+0000","last_became_active":"2024-04-02T07:25:13.418989+0000","last_became_peered":"2024-04-02T07:25:13.418989+0000","last_unstale":"2024-04-02T07:25:15.454995+0000","last_undegraded":"2024-04-02T07:25:15.454995+0000","last_fullsized":"2024-04-02T07:25:15.454995+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:30:18.876417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.828948+0000","last_change":"2024-04-02T07:25:13.839287+0000","last_active":"2024-04-02T07:25:14.828948+0000","last_peered":"2024-04-02T07:25:14.828948+0000","last_clean":"2024-04-02T07:25:14.828948+0000","last_became_active":"2024-04-02T07:25:13.838963+0000","last_became_peered":"2024-04-02T07:25:13.838963+0000","last_unstale":"2024-04-02T07:25:14.828948+0000","last_undegraded":"2024-04-02T07:25:14.828948+0000","last_fullsized":"2024-04-02T07:25:14.828948+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:58:24.188990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.828930+0000","last_change":"2024-04-02T07:25:13.414859+0000","last_active":"2024-04-02T07:25:14.828930+0000","last_peered":"2024-04-02T07:25:14.828930+0000","last_clean":"2024-04-02T07:25:14.828930+0000","last_became_active":"2024-04-02T07:25:13.414603+0000","last_became_peered":"2024-04-02T07:25:13.414603+0000","last_unstale":"2024-04-02T07:25:14.828930+0000","last_undegraded":"2024-04-02T07:25:14.828930+0000","last_fullsized":"2024-04-02T07:25:14.828930+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:24:56.136518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.828813+0000","last_change":"2024-04-02T07:25:13.834084+0000","last_active":"2024-04-02T07:25:14.828813+0000","last_peered":"2024-04-02T07:25:14.828813+0000","last_clean":"2024-04-02T07:25:14.828813+0000","last_became_active":"2024-04-02T07:25:13.833842+0000","last_became_peered":"2024-04-02T07:25:13.833842+0000","last_unstale":"2024-04-02T07:25:14.828813+0000","last_undegraded":"2024-04-02T07:25:14.828813+0000","last_fullsized":"2024-04-02T07:25:14.828813+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:37:26.090804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456251+0000","last_change":"2024-04-02T07:25:13.413117+0000","last_active":"2024-04-02T07:25:15.456251+0000","last_peered":"2024-04-02T07:25:15.456251+0000","last_clean":"2024-04-02T07:25:15.456251+0000","last_became_active":"2024-04-02T07:25:13.412801+0000","last_became_peered":"2024-04-02T07:25:13.412801+0000","last_unstale":"2024-04-02T07:25:15.456251+0000","last_undegraded":"2024-04-02T07:25:15.456251+0000","last_fullsized":"2024-04-02T07:25:15.456251+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:40:11.277526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":198,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-02T07:25:13.823121+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:25:13.823121+0000","last_peered":"2024-04-02T07:25:13.823121+0000","last_clean":"2024-04-02T07:25:13.823121+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:25:13.823121+0000","last_undegraded":"2024-04-02T07:25:13.823121+0000","last_fullsized":"2024-04-02T07:25:13.823121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574888,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28312,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343528,"statfs":{"total":96636764160,"available":96607772672,"internally_reserved":0,"allocated":1323008,"data_stored":891595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.64100000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.437},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.623,"15min":0.60299999999999998},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.75600000000000001}]},{"osd":1,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.432,"5min":0.379,"15min":0.379},"max":{"1min":0.95999999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.871,"5min":1.113,"15min":1.113},"last":0.58999999999999997}]},{"osd":2,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.746,"15min":0.75},"min":{"1min":0.55700000000000005,"5min":0.435,"15min":0.435},"max":{"1min":1.0149999999999999,"5min":1.139,"15min":1.139},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.499,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93300000000000005,"5min":1.522,"15min":1.522},"last":0.72999999999999998}]},{"osd":3,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69799999999999995,"15min":0.69999999999999996},"min":{"1min":0.46800000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0369999999999999,"5min":1.405,"15min":1.405},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90500000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.48599999999999999}]},{"osd":4,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.66800000000000004,"15min":0.69599999999999995},"min":{"1min":0.38300000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.92500000000000004,"5min":1.633,"15min":1.633},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.72199999999999998,"15min":0.746},"min":{"1min":0.51600000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.93600000000000005,"5min":1.079,"15min":1.079},"last":0.61799999999999999}]},{"osd":5,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.69999999999999996,"15min":0.73299999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90600000000000003,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.76200000000000001,"15min":0.79100000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95599999999999996,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.80100000000000005}]},{"osd":6,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.70999999999999996,"15min":0.73999999999999999},"min":{"1min":0.46000000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88700000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.82899999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.67800000000000005,"15min":0.70799999999999996},"min":{"1min":0.44700000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86499999999999999,"5min":1,"15min":1},"last":0.57199999999999995}]}]},{"osd":6,"up_from":13,"seq":55834574889,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":720896,"data_stored":301067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.65300000000000002,"15min":0.66000000000000003},"min":{"1min":0.46600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.75700000000000001,"5min":1.399,"15min":1.399},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.82699999999999996,"15min":0.90100000000000002},"min":{"1min":0.498,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.876,"5min":5.7569999999999997,"15min":5.7569999999999997},"last":0.54300000000000004}]},{"osd":1,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71899999999999997,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90500000000000003,"5min":1.95,"15min":1.95},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.72099999999999997,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83599999999999997,"5min":1.248,"15min":1.248},"last":0.63600000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.67700000000000005,"15min":0.69199999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.746,"5min":1.226,"15min":1.226},"last":0.623},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.70399999999999996,"15min":0.70799999999999996},"min":{"1min":0.504,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86599999999999999,"5min":0.997,"15min":0.997},"last":0.66500000000000004}]},{"osd":3,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.78100000000000003,"15min":0.81499999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.82899999999999996,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.76700000000000002,"15min":0.79900000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.84799999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.72699999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65300000000000002,"15min":0.66900000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83699999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83799999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.60299999999999998}]},{"osd":5,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.65600000000000003,"15min":0.68000000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.749,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.496},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71999999999999997,"15min":0.73399999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.873,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.751}]},{"osd":7,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73099999999999998,"15min":0.748},"min":{"1min":0.53300000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.73099999999999998,"15min":0.749},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.81799999999999995,"5min":0.999,"15min":0.999},"last":0.77400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574889,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":729088,"data_stored":301719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64900000000000002,"15min":0.64500000000000002},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.873,"5min":1.25,"15min":1.25},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70399999999999996,"15min":0.70799999999999996},"min":{"1min":0.47599999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93300000000000005,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.70699999999999996}]},{"osd":1,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.68999999999999995,"15min":0.68899999999999995},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.875,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86199999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.79800000000000004}]},{"osd":2,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.79400000000000004,"15min":0.82599999999999996},"min":{"1min":0.47399999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88700000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72399999999999998,"15min":0.746},"min":{"1min":0.442,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86099999999999999,"5min":1.696,"15min":1.696},"last":0.78900000000000003}]},{"osd":3,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.74399999999999999,"15min":0.76700000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92400000000000004,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.78700000000000003,"15min":0.82899999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85799999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.84699999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.67500000000000004,"15min":0.72799999999999998},"min":{"1min":0.39200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":1.911,"15min":1.911},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.73399999999999999,"15min":0.79600000000000004},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84099999999999997,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.64000000000000001}]},{"osd":6,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.79800000000000004,"15min":0.873},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80300000000000005,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.78700000000000003,"15min":0.85799999999999998},"min":{"1min":0.45100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.82699999999999996,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.621}]},{"osd":7,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.81399999999999995,"15min":0.878},"min":{"1min":0.48899999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.88700000000000001,"5min":1.887,"15min":1.887},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.84799999999999998,"15min":0.92600000000000005},"min":{"1min":0.443,"5min":0.439,"15min":0.439},"max":{"1min":0.86699999999999999,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.60899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574891,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":733184,"data_stored":302631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.72699999999999998,"15min":0.753},"min":{"1min":0.47299999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85899999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.77700000000000002,"15min":0.83499999999999996},"min":{"1min":0.48099999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.78800000000000003,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.48099999999999998}]},{"osd":1,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.745,"15min":0.76400000000000001},"min":{"1min":0.499,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93300000000000005,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.85599999999999998,"15min":0.92500000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91400000000000003,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":0.63}]},{"osd":2,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.78400000000000003,"15min":0.80800000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95199999999999996,"5min":2.056,"15min":2.056},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.83899999999999997,"15min":0.88900000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.92000000000000004,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.498}]},{"osd":3,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.94099999999999995,"15min":1.0169999999999999},"min":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.97899999999999998,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.95099999999999996,"15min":1.0309999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.014,"5min":3.9750000000000001,"15min":3.9750000000000001},"last":0.58299999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.42599999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0389999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.73799999999999999,"15min":0.76000000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0549999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.66600000000000004}]},{"osd":6,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.45400000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.123,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":0.78700000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.032,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1060000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.754},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.86399999999999999,"15min":0.877},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1499999999999999,"5min":1.353,"15min":1.353},"last":0.68899999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574889,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":729088,"data_stored":301123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.438,"15min":0.45000000000000001},"min":{"1min":0.28499999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.48199999999999998},"min":{"1min":0.34200000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73699999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.54300000000000004}]},{"osd":1,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.33800000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.497,"15min":0.505},"min":{"1min":0.375,"5min":0.309,"15min":0.309},"max":{"1min":0.68899999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.59299999999999997}]},{"osd":2,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93700000000000006,"5min":1.306,"15min":1.306},"last":0.71399999999999997}]},{"osd":4,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.5,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.876,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.57099999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94099999999999995,"5min":1.155,"15min":1.155},"last":1.0089999999999999}]},{"osd":5,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.024,"5min":1.198,"15min":1.198},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.746,"15min":0.745},"min":{"1min":0.57299999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.034,"5min":1.135,"15min":1.135},"last":0.93300000000000005}]},{"osd":6,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76400000000000001,"15min":0.76900000000000002},"min":{"1min":0.58799999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.96499999999999997,"5min":1.25,"15min":1.25},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78500000000000003,"15min":0.78200000000000003},"min":{"1min":0.59799999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.98499999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.90900000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75700000000000001,"15min":0.75800000000000001},"min":{"1min":0.53300000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0740000000000001,"5min":1.216,"15min":1.216},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78900000000000003,"15min":0.79600000000000004},"min":{"1min":0.57199999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.012,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.64300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574889,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":729088,"data_stored":301123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44700000000000001,"15min":0.45200000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.747,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65200000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.45700000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.54500000000000004},"min":{"1min":0.379,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76800000000000002,"5min":1.171,"15min":1.171},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48599999999999999,"15min":0.49199999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.74299999999999999,"5min":1.333,"15min":1.333},"last":0.53400000000000003}]},{"osd":3,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70099999999999996,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83099999999999996,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.41899999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.49299999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5309999999999999,"5min":2.254,"15min":2.254},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.751,"5min":0.76200000000000001,"15min":0.76500000000000001},"min":{"1min":0.51800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2210000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.91500000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2629999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79900000000000004,"15min":0.81499999999999995},"min":{"1min":0.57099999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.3149999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.74099999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.60499999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.82399999999999995,"15min":0.82499999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.89000000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.81699999999999995,"15min":0.83699999999999997},"min":{"1min":0.58399999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4750000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.63500000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.879}]}]},{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31832,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":724992,"data_stored":301157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.46999999999999997,"15min":0.48599999999999999},"min":{"1min":0.255,"5min":0.251,"15min":0.251},"max":{"1min":0.53800000000000003,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.372},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.61099999999999999,"15min":0.66100000000000003},"min":{"1min":0.27000000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.745,"5min":4.157,"15min":4.157},"last":0.28000000000000003}]},{"osd":2,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.61099999999999999,"15min":0.67700000000000005},"min":{"1min":0.32900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60799999999999998,"5min":4.282,"15min":4.282},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.58599999999999997,"15min":0.61299999999999999},"min":{"1min":0.37,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.63300000000000001,"5min":1.625,"15min":1.625},"last":0.52100000000000002}]},{"osd":3,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.441,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94399999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.495},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.81899999999999995,"15min":0.94099999999999995},"min":{"1min":0.42999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.749,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.42999999999999999}]},{"osd":4,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.91300000000000003,"15min":0.98899999999999999},"min":{"1min":0.52900000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.105,"5min":4.7400000000000002,"15min":4.7400000000000002},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81399999999999995,"15min":0.83599999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.996,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.94499999999999995}]},{"osd":5,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.91100000000000003,"15min":0.96599999999999997},"min":{"1min":0.53500000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.0620000000000001,"5min":4.5759999999999996,"15min":4.5759999999999996},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.91100000000000003,"15min":0.97199999999999998},"min":{"1min":0.59399999999999997,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1539999999999999,"5min":4.7949999999999999,"15min":4.7949999999999999},"last":0.85599999999999998}]},{"osd":6,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.94399999999999995,"15min":1.02},"min":{"1min":0.47799999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.006,"5min":4.6890000000000001,"15min":4.6890000000000001},"last":0.63},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.92700000000000005,"15min":0.995},"min":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0720000000000001,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.82999999999999996}]},{"osd":7,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.82199999999999995,"15min":0.84399999999999997},"min":{"1min":0.60099999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.137,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.93799999999999994,"15min":0.996},"min":{"1min":0.57999999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.024,"5min":4.6420000000000003,"15min":4.6420000000000003},"last":0.71199999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1331200,"data_stored":893581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46200000000000002,"15min":0.47899999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.53900000000000003,"5min":1.48,"15min":1.48},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.39900000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.65500000000000003,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.51700000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72699999999999998,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.498},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.39400000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.45200000000000001}]},{"osd":3,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46800000000000003,"15min":0.46999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60499999999999998,"15min":0.626},"min":{"1min":0.435,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.75900000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.435}]},{"osd":4,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.54200000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.91900000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.58699999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.0369999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.58699999999999997}]},{"osd":5,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77900000000000003,"15min":0.79500000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.91300000000000003,"5min":1.371,"15min":1.371},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75700000000000001,"15min":0.76300000000000001},"min":{"1min":0.57599999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.98699999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.70699999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.087,"5min":1.177,"15min":1.177},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82099999999999995,"15min":0.84499999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.0329999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.65100000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.78400000000000003,"15min":0.79800000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.016,"5min":1.135,"15min":1.135},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.58699999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.046,"5min":1.141,"15min":1.141},"last":0.68700000000000006}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:25:22.504 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:25:22.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.653+0000 7f2bb0c00640 1 Processor -- start 2024-04-02T07:25:22.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.653+0000 7f2bb0c00640 1 -- start start 2024-04-02T07:25:22.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.653+0000 7f2bb0c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2bac0cf1e0 0x7f2bac098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:22.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.653+0000 7f2bb0c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2bac098f50 0x7f2bac0b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:22.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.653+0000 7f2bb0c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bac0ad190 con 0x7f2bac15de80 2024-04-02T07:25:22.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.653+0000 7f2bb0c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bac099380 con 0x7f2bac0cf1e0 2024-04-02T07:25:22.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.653+0000 7f2bb0c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bac0cc4e0 con 0x7f2bac098f50 2024-04-02T07:25:22.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.653+0000 7f2baaa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2bac0cf1e0 0x7f2bac098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:22.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.653+0000 7f2baaa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2bac0cf1e0 0x7f2bac098a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41404/0 (socket says 172.21.15.55:41404) 2024-04-02T07:25:22.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.653+0000 7f2bab400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2bac15de80 0x7f2bac0cbb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47410/0 (socket says 172.21.15.55:47410) 2024-04-02T07:25:22.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.653+0000 7f2baaa00640 1 -- 172.21.15.55:0/16891790 learned_addr learned my addr 172.21.15.55:0/16891790 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:22.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.653+0000 7f2babe00640 1 --2- 172.21.15.55:0/16891790 >> v2:172.21.15.106:3300/0 conn(0x7f2bac098f50 0x7f2bac0b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:22.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.653+0000 7f2baaa00640 1 -- 172.21.15.55:0/16891790 >> v2:172.21.15.106:3300/0 conn(0x7f2bac098f50 msgr2=0x7f2bac0b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:22.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.653+0000 7f2baaa00640 1 --2- 172.21.15.55:0/16891790 >> v2:172.21.15.106:3300/0 conn(0x7f2bac098f50 0x7f2bac0b0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:22.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.653+0000 7f2baaa00640 1 -- 172.21.15.55:0/16891790 >> v1:172.21.15.55:6789/0 conn(0x7f2bac15de80 legacy=0x7f2bac0cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:22.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.653+0000 7f2baaa00640 1 -- 172.21.15.55:0/16891790 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac0cc210 con 0x7f2bac0cf1e0 2024-04-02T07:25:22.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.653+0000 7f2babe00640 1 --2- 172.21.15.55:0/16891790 >> v2:172.21.15.106:3300/0 conn(0x7f2bac098f50 0x7f2bac0b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:22.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.657+0000 7f2baaa00640 1 --2- 172.21.15.55:0/16891790 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bac0cf1e0 0x7f2bac098a10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0ccef0 tx=0x7f2b9801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f2be03716a82da server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:22.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.657+0000 7f2baa000640 1 -- 172.21.15.55:0/16891790 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b980ab600 con 0x7f2bac0cf1e0 2024-04-02T07:25:22.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.657+0000 7f2baa000640 1 -- 172.21.15.55:0/16891790 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b980a7050 con 0x7f2bac0cf1e0 2024-04-02T07:25:22.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.657+0000 7f2baa000640 1 -- 172.21.15.55:0/16891790 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b980ab980 con 0x7f2bac0cf1e0 2024-04-02T07:25:22.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.657+0000 7f2bb0c00640 1 -- 172.21.15.55:0/16891790 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bac0cf1e0 msgr2=0x7f2bac098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:22.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.657+0000 7f2bb0c00640 1 --2- 172.21.15.55:0/16891790 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bac0cf1e0 0x7f2bac098a10 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0ccef0 tx=0x7f2b9801c520 comp rx=0 tx=0).stop 2024-04-02T07:25:22.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.657+0000 7f2bb0c00640 1 -- 172.21.15.55:0/16891790 shutdown_connections 2024-04-02T07:25:22.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.657+0000 7f2bb0c00640 1 --2- 172.21.15.55:0/16891790 >> v2:172.21.15.106:3300/0 conn(0x7f2bac098f50 0x7f2bac0b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:22.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.657+0000 7f2bb0c00640 1 --2- 172.21.15.55:0/16891790 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bac0cf1e0 0x7f2bac098a10 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:22.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.657+0000 7f2bb0c00640 1 -- 172.21.15.55:0/16891790 >> 172.21.15.55:0/16891790 conn(0x7f2bac0b1ff0 msgr2=0x7f2bac0b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:22.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.657+0000 7f2bb0c00640 1 -- 172.21.15.55:0/16891790 shutdown_connections 2024-04-02T07:25:22.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.657+0000 7f2bb0c00640 1 -- 172.21.15.55:0/16891790 wait complete. 2024-04-02T07:25:22.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2bb0c00640 1 Processor -- start 2024-04-02T07:25:22.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2bb0c00640 1 -- start start 2024-04-02T07:25:22.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2bb0c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bac098f50 0x7f2bac1f4a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:22.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2bb0c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2bac0cf1e0 0x7f2bac0b5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:22.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2bb0c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bac15de80 0x7f2bac157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:22.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2bb0c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac163b00 con 0x7f2bac15de80 2024-04-02T07:25:22.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2bb0c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac0b6070 con 0x7f2bac098f50 2024-04-02T07:25:22.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2bb0c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac0b3120 con 0x7f2bac0cf1e0 2024-04-02T07:25:22.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2babe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bac15de80 0x7f2bac157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:22.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2babe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bac15de80 0x7f2bac157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41420/0 (socket says 172.21.15.55:41420) 2024-04-02T07:25:22.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2babe00640 1 -- 172.21.15.55:0/3537709225 learned_addr learned my addr 172.21.15.55:0/3537709225 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:22.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2bab400640 1 --2- 172.21.15.55:0/3537709225 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bac098f50 0x7f2bac1f4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:22.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2baaa00640 1 --2- 172.21.15.55:0/3537709225 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2bac0cf1e0 0x7f2bac0b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:22.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2babe00640 1 -- 172.21.15.55:0/3537709225 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2bac0cf1e0 msgr2=0x7f2bac0b5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:22.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2babe00640 1 --2- 172.21.15.55:0/3537709225 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2bac0cf1e0 0x7f2bac0b5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:22.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2babe00640 1 -- 172.21.15.55:0/3537709225 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bac098f50 msgr2=0x7f2bac1f4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:22.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2babe00640 1 --2- 172.21.15.55:0/3537709225 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bac098f50 0x7f2bac1f4a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:22.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2babe00640 1 -- 172.21.15.55:0/3537709225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b980094d0 con 0x7f2bac15de80 2024-04-02T07:25:22.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2babe00640 1 --2- 172.21.15.55:0/3537709225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bac15de80 0x7f2bac157120 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4007ef0 tx=0x7f2ba400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:22.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2ba3400640 1 -- 172.21.15.55:0/3537709225 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba4003ba0 con 0x7f2bac15de80 2024-04-02T07:25:22.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2ba3400640 1 -- 172.21.15.55:0/3537709225 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba400f040 con 0x7f2bac15de80 2024-04-02T07:25:22.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2bb0c00640 1 -- 172.21.15.55:0/3537709225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bac0b5dd0 con 0x7f2bac15de80 2024-04-02T07:25:22.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2ba3400640 1 -- 172.21.15.55:0/3537709225 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba400de80 con 0x7f2bac15de80 2024-04-02T07:25:22.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2bb0c00640 1 -- 172.21.15.55:0/3537709225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bac0c6130 con 0x7f2bac15de80 2024-04-02T07:25:22.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.661+0000 7f2bb0c00640 1 -- 172.21.15.55:0/3537709225 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bac0b3290 con 0x7f2bac15de80 2024-04-02T07:25:22.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.665+0000 7f2ba3400640 1 -- 172.21.15.55:0/3537709225 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2ba4004030 con 0x7f2bac15de80 2024-04-02T07:25:22.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.665+0000 7f2ba3400640 1 --2- 172.21.15.55:0/3537709225 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2b8c066690 0x7f2b8c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:22.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.665+0000 7f2ba3400640 1 -- 172.21.15.55:0/3537709225 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2ba40843d0 con 0x7f2bac15de80 2024-04-02T07:25:22.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.665+0000 7f2bab400640 1 --2- 172.21.15.55:0/3537709225 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2b8c066690 0x7f2b8c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:22.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.665+0000 7f2bab400640 1 --2- 172.21.15.55:0/3537709225 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2b8c066690 0x7f2b8c068b50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c000f70 tx=0x7f2b9c007e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:22.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.669+0000 7f2ba3400640 1 -- 172.21.15.55:0/3537709225 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2ba4051880 con 0x7f2bac15de80 2024-04-02T07:25:22.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.825+0000 7f2bb0c00640 1 -- 172.21.15.55:0/3537709225 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2bac0b0740 con 0x7f2b8c066690 2024-04-02T07:25:22.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.833+0000 7f2ba3400640 1 -- 172.21.15.55:0/3537709225 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288658 (secure 0 0 0) 0x7f2b9c004a70 con 0x7f2b8c066690 2024-04-02T07:25:22.841 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:22.842 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:25:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.837+0000 7f2bb0c00640 1 -- 172.21.15.55:0/3537709225 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2b8c066690 msgr2=0x7f2b8c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.837+0000 7f2bb0c00640 1 --2- 172.21.15.55:0/3537709225 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2b8c066690 0x7f2b8c068b50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c000f70 tx=0x7f2b9c007e50 comp rx=0 tx=0).stop 2024-04-02T07:25:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.837+0000 7f2bb0c00640 1 -- 172.21.15.55:0/3537709225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bac15de80 msgr2=0x7f2bac157120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.837+0000 7f2bb0c00640 1 --2- 172.21.15.55:0/3537709225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bac15de80 0x7f2bac157120 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2ba4007ef0 tx=0x7f2ba400d4a0 comp rx=0 tx=0).stop 2024-04-02T07:25:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.837+0000 7f2bb0c00640 1 -- 172.21.15.55:0/3537709225 shutdown_connections 2024-04-02T07:25:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.837+0000 7f2bb0c00640 1 --2- 172.21.15.55:0/3537709225 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bac15de80 0x7f2bac157120 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.837+0000 7f2bb0c00640 1 --2- 172.21.15.55:0/3537709225 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2bac0cf1e0 0x7f2bac0b5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.837+0000 7f2bb0c00640 1 --2- 172.21.15.55:0/3537709225 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2b8c066690 0x7f2b8c068b50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.837+0000 7f2bb0c00640 1 --2- 172.21.15.55:0/3537709225 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bac098f50 0x7f2bac1f4a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:22.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.837+0000 7f2bb0c00640 1 -- 172.21.15.55:0/3537709225 >> 172.21.15.55:0/3537709225 conn(0x7f2bac0b1ff0 msgr2=0x7f2bac06fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:22.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.837+0000 7f2bb0c00640 1 -- 172.21.15.55:0/3537709225 shutdown_connections 2024-04-02T07:25:22.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:22.837+0000 7f2bb0c00640 1 -- 172.21.15.55:0/3537709225 wait complete. 2024-04-02T07:25:22.861 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-04-02T07:25:22.377493+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":239456,"kb_used_data":6856,"kb_used_omap":12,"kb_used_meta":232435,"kb_avail":754735264,"statfs":{"total":773094113280,"available":772848910336,"internally_reserved":0,"allocated":7020544,"data_stored":3593996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":238014008},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.565986"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.830538+0000","last_change":"2024-04-02T07:25:13.839144+0000","last_active":"2024-04-02T07:25:14.830538+0000","last_peered":"2024-04-02T07:25:14.830538+0000","last_clean":"2024-04-02T07:25:14.830538+0000","last_became_active":"2024-04-02T07:25:13.838871+0000","last_became_peered":"2024-04-02T07:25:13.838871+0000","last_unstale":"2024-04-02T07:25:14.830538+0000","last_undegraded":"2024-04-02T07:25:14.830538+0000","last_fullsized":"2024-04-02T07:25:14.830538+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:53:20.638660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829151+0000","last_change":"2024-04-02T07:25:13.838677+0000","last_active":"2024-04-02T07:25:14.829151+0000","last_peered":"2024-04-02T07:25:14.829151+0000","last_clean":"2024-04-02T07:25:14.829151+0000","last_became_active":"2024-04-02T07:25:13.838436+0000","last_became_peered":"2024-04-02T07:25:13.838436+0000","last_unstale":"2024-04-02T07:25:14.829151+0000","last_undegraded":"2024-04-02T07:25:14.829151+0000","last_fullsized":"2024-04-02T07:25:14.829151+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:55:42.022540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456256+0000","last_change":"2024-04-02T07:25:13.843698+0000","last_active":"2024-04-02T07:25:15.456256+0000","last_peered":"2024-04-02T07:25:15.456256+0000","last_clean":"2024-04-02T07:25:15.456256+0000","last_became_active":"2024-04-02T07:25:13.840368+0000","last_became_peered":"2024-04-02T07:25:13.840368+0000","last_unstale":"2024-04-02T07:25:15.456256+0000","last_undegraded":"2024-04-02T07:25:15.456256+0000","last_fullsized":"2024-04-02T07:25:15.456256+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:48:10.866582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455938+0000","last_change":"2024-04-02T07:25:13.829308+0000","last_active":"2024-04-02T07:25:15.455938+0000","last_peered":"2024-04-02T07:25:15.455938+0000","last_clean":"2024-04-02T07:25:15.455938+0000","last_became_active":"2024-04-02T07:25:13.829023+0000","last_became_peered":"2024-04-02T07:25:13.829023+0000","last_unstale":"2024-04-02T07:25:15.455938+0000","last_undegraded":"2024-04-02T07:25:15.455938+0000","last_fullsized":"2024-04-02T07:25:15.455938+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:18:24.553416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.830510+0000","last_change":"2024-04-02T07:25:13.837124+0000","last_active":"2024-04-02T07:25:14.830510+0000","last_peered":"2024-04-02T07:25:14.830510+0000","last_clean":"2024-04-02T07:25:14.830510+0000","last_became_active":"2024-04-02T07:25:13.836828+0000","last_became_peered":"2024-04-02T07:25:13.836828+0000","last_unstale":"2024-04-02T07:25:14.830510+0000","last_undegraded":"2024-04-02T07:25:14.830510+0000","last_fullsized":"2024-04-02T07:25:14.830510+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:27:19.539517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455427+0000","last_change":"2024-04-02T07:25:13.840680+0000","last_active":"2024-04-02T07:25:15.455427+0000","last_peered":"2024-04-02T07:25:15.455427+0000","last_clean":"2024-04-02T07:25:15.455427+0000","last_became_active":"2024-04-02T07:25:13.840435+0000","last_became_peered":"2024-04-02T07:25:13.840435+0000","last_unstale":"2024-04-02T07:25:15.455427+0000","last_undegraded":"2024-04-02T07:25:15.455427+0000","last_fullsized":"2024-04-02T07:25:15.455427+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:17:05.963406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826310+0000","last_change":"2024-04-02T07:25:13.828916+0000","last_active":"2024-04-02T07:25:14.826310+0000","last_peered":"2024-04-02T07:25:14.826310+0000","last_clean":"2024-04-02T07:25:14.826310+0000","last_became_active":"2024-04-02T07:25:13.828653+0000","last_became_peered":"2024-04-02T07:25:13.828653+0000","last_unstale":"2024-04-02T07:25:14.826310+0000","last_undegraded":"2024-04-02T07:25:14.826310+0000","last_fullsized":"2024-04-02T07:25:14.826310+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:37:31.544600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.828815+0000","last_change":"2024-04-02T07:25:13.832544+0000","last_active":"2024-04-02T07:25:14.828815+0000","last_peered":"2024-04-02T07:25:14.828815+0000","last_clean":"2024-04-02T07:25:14.828815+0000","last_became_active":"2024-04-02T07:25:13.831634+0000","last_became_peered":"2024-04-02T07:25:13.831634+0000","last_unstale":"2024-04-02T07:25:14.828815+0000","last_undegraded":"2024-04-02T07:25:14.828815+0000","last_fullsized":"2024-04-02T07:25:14.828815+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:22:24.369836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826801+0000","last_change":"2024-04-02T07:25:13.848365+0000","last_active":"2024-04-02T07:25:14.826801+0000","last_peered":"2024-04-02T07:25:14.826801+0000","last_clean":"2024-04-02T07:25:14.826801+0000","last_became_active":"2024-04-02T07:25:13.848075+0000","last_became_peered":"2024-04-02T07:25:13.848075+0000","last_unstale":"2024-04-02T07:25:14.826801+0000","last_undegraded":"2024-04-02T07:25:14.826801+0000","last_fullsized":"2024-04-02T07:25:14.826801+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:00:09.681534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455584+0000","last_change":"2024-04-02T07:25:13.830577+0000","last_active":"2024-04-02T07:25:15.455584+0000","last_peered":"2024-04-02T07:25:15.455584+0000","last_clean":"2024-04-02T07:25:15.455584+0000","last_became_active":"2024-04-02T07:25:13.830222+0000","last_became_peered":"2024-04-02T07:25:13.830222+0000","last_unstale":"2024-04-02T07:25:15.455584+0000","last_undegraded":"2024-04-02T07:25:15.455584+0000","last_fullsized":"2024-04-02T07:25:15.455584+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:49:54.955423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455298+0000","last_change":"2024-04-02T07:25:13.839434+0000","last_active":"2024-04-02T07:25:15.455298+0000","last_peered":"2024-04-02T07:25:15.455298+0000","last_clean":"2024-04-02T07:25:15.455298+0000","last_became_active":"2024-04-02T07:25:13.839191+0000","last_became_peered":"2024-04-02T07:25:13.839191+0000","last_unstale":"2024-04-02T07:25:15.455298+0000","last_undegraded":"2024-04-02T07:25:15.455298+0000","last_fullsized":"2024-04-02T07:25:15.455298+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:17:51.543470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455994+0000","last_change":"2024-04-02T07:25:13.833269+0000","last_active":"2024-04-02T07:25:15.455994+0000","last_peered":"2024-04-02T07:25:15.455994+0000","last_clean":"2024-04-02T07:25:15.455994+0000","last_became_active":"2024-04-02T07:25:13.832979+0000","last_became_peered":"2024-04-02T07:25:13.832979+0000","last_unstale":"2024-04-02T07:25:15.455994+0000","last_undegraded":"2024-04-02T07:25:15.455994+0000","last_fullsized":"2024-04-02T07:25:15.455994+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:51:16.504462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456762+0000","last_change":"2024-04-02T07:25:13.832987+0000","last_active":"2024-04-02T07:25:15.456762+0000","last_peered":"2024-04-02T07:25:15.456762+0000","last_clean":"2024-04-02T07:25:15.456762+0000","last_became_active":"2024-04-02T07:25:13.832625+0000","last_became_peered":"2024-04-02T07:25:13.832625+0000","last_unstale":"2024-04-02T07:25:15.456762+0000","last_undegraded":"2024-04-02T07:25:15.456762+0000","last_fullsized":"2024-04-02T07:25:15.456762+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:15:48.740463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826470+0000","last_change":"2024-04-02T07:25:13.834787+0000","last_active":"2024-04-02T07:25:14.826470+0000","last_peered":"2024-04-02T07:25:14.826470+0000","last_clean":"2024-04-02T07:25:14.826470+0000","last_became_active":"2024-04-02T07:25:13.831629+0000","last_became_peered":"2024-04-02T07:25:13.831629+0000","last_unstale":"2024-04-02T07:25:14.826470+0000","last_undegraded":"2024-04-02T07:25:14.826470+0000","last_fullsized":"2024-04-02T07:25:14.826470+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:35:15.300703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826560+0000","last_change":"2024-04-02T07:25:13.838509+0000","last_active":"2024-04-02T07:25:14.826560+0000","last_peered":"2024-04-02T07:25:14.826560+0000","last_clean":"2024-04-02T07:25:14.826560+0000","last_became_active":"2024-04-02T07:25:13.838180+0000","last_became_peered":"2024-04-02T07:25:13.838180+0000","last_unstale":"2024-04-02T07:25:14.826560+0000","last_undegraded":"2024-04-02T07:25:14.826560+0000","last_fullsized":"2024-04-02T07:25:14.826560+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:28:55.115477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455481+0000","last_change":"2024-04-02T07:25:13.845846+0000","last_active":"2024-04-02T07:25:15.455481+0000","last_peered":"2024-04-02T07:25:15.455481+0000","last_clean":"2024-04-02T07:25:15.455481+0000","last_became_active":"2024-04-02T07:25:13.845290+0000","last_became_peered":"2024-04-02T07:25:13.845290+0000","last_unstale":"2024-04-02T07:25:15.455481+0000","last_undegraded":"2024-04-02T07:25:15.455481+0000","last_fullsized":"2024-04-02T07:25:15.455481+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:02:07.068315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829308+0000","last_change":"2024-04-02T07:25:13.834576+0000","last_active":"2024-04-02T07:25:14.829308+0000","last_peered":"2024-04-02T07:25:14.829308+0000","last_clean":"2024-04-02T07:25:14.829308+0000","last_became_active":"2024-04-02T07:25:13.834288+0000","last_became_peered":"2024-04-02T07:25:13.834288+0000","last_unstale":"2024-04-02T07:25:14.829308+0000","last_undegraded":"2024-04-02T07:25:14.829308+0000","last_fullsized":"2024-04-02T07:25:14.829308+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:10:06.210851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456362+0000","last_change":"2024-04-02T07:25:13.843458+0000","last_active":"2024-04-02T07:25:15.456362+0000","last_peered":"2024-04-02T07:25:15.456362+0000","last_clean":"2024-04-02T07:25:15.456362+0000","last_became_active":"2024-04-02T07:25:13.842905+0000","last_became_peered":"2024-04-02T07:25:13.842905+0000","last_unstale":"2024-04-02T07:25:15.456362+0000","last_undegraded":"2024-04-02T07:25:15.456362+0000","last_fullsized":"2024-04-02T07:25:15.456362+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:55:32.708707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.830482+0000","last_change":"2024-04-02T07:25:13.838336+0000","last_active":"2024-04-02T07:25:14.830482+0000","last_peered":"2024-04-02T07:25:14.830482+0000","last_clean":"2024-04-02T07:25:14.830482+0000","last_became_active":"2024-04-02T07:25:13.838042+0000","last_became_peered":"2024-04-02T07:25:13.838042+0000","last_unstale":"2024-04-02T07:25:14.830482+0000","last_undegraded":"2024-04-02T07:25:14.830482+0000","last_fullsized":"2024-04-02T07:25:14.830482+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:18:53.200389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829194+0000","last_change":"2024-04-02T07:25:13.838204+0000","last_active":"2024-04-02T07:25:14.829194+0000","last_peered":"2024-04-02T07:25:14.829194+0000","last_clean":"2024-04-02T07:25:14.829194+0000","last_became_active":"2024-04-02T07:25:13.837836+0000","last_became_peered":"2024-04-02T07:25:13.837836+0000","last_unstale":"2024-04-02T07:25:14.829194+0000","last_undegraded":"2024-04-02T07:25:14.829194+0000","last_fullsized":"2024-04-02T07:25:14.829194+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:45:25.339615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455360+0000","last_change":"2024-04-02T07:25:13.836353+0000","last_active":"2024-04-02T07:25:15.455360+0000","last_peered":"2024-04-02T07:25:15.455360+0000","last_clean":"2024-04-02T07:25:15.455360+0000","last_became_active":"2024-04-02T07:25:13.836102+0000","last_became_peered":"2024-04-02T07:25:13.836102+0000","last_unstale":"2024-04-02T07:25:15.455360+0000","last_undegraded":"2024-04-02T07:25:15.455360+0000","last_fullsized":"2024-04-02T07:25:15.455360+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:34:55.188580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829053+0000","last_change":"2024-04-02T07:25:13.832801+0000","last_active":"2024-04-02T07:25:14.829053+0000","last_peered":"2024-04-02T07:25:14.829053+0000","last_clean":"2024-04-02T07:25:14.829053+0000","last_became_active":"2024-04-02T07:25:13.832250+0000","last_became_peered":"2024-04-02T07:25:13.832250+0000","last_unstale":"2024-04-02T07:25:14.829053+0000","last_undegraded":"2024-04-02T07:25:14.829053+0000","last_fullsized":"2024-04-02T07:25:14.829053+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:57:20.665756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455366+0000","last_change":"2024-04-02T07:25:13.844142+0000","last_active":"2024-04-02T07:25:15.455366+0000","last_peered":"2024-04-02T07:25:15.455366+0000","last_clean":"2024-04-02T07:25:15.455366+0000","last_became_active":"2024-04-02T07:25:13.843777+0000","last_became_peered":"2024-04-02T07:25:13.843777+0000","last_unstale":"2024-04-02T07:25:15.455366+0000","last_undegraded":"2024-04-02T07:25:15.455366+0000","last_fullsized":"2024-04-02T07:25:15.455366+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:49:41.992789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456107+0000","last_change":"2024-04-02T07:25:13.834559+0000","last_active":"2024-04-02T07:25:15.456107+0000","last_peered":"2024-04-02T07:25:15.456107+0000","last_clean":"2024-04-02T07:25:15.456107+0000","last_became_active":"2024-04-02T07:25:13.833967+0000","last_became_peered":"2024-04-02T07:25:13.833967+0000","last_unstale":"2024-04-02T07:25:15.456107+0000","last_undegraded":"2024-04-02T07:25:15.456107+0000","last_fullsized":"2024-04-02T07:25:15.456107+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:04:16.273349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.830598+0000","last_change":"2024-04-02T07:25:13.847877+0000","last_active":"2024-04-02T07:25:14.830598+0000","last_peered":"2024-04-02T07:25:14.830598+0000","last_clean":"2024-04-02T07:25:14.830598+0000","last_became_active":"2024-04-02T07:25:13.847022+0000","last_became_peered":"2024-04-02T07:25:13.847022+0000","last_unstale":"2024-04-02T07:25:14.830598+0000","last_undegraded":"2024-04-02T07:25:14.830598+0000","last_fullsized":"2024-04-02T07:25:14.830598+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:32:33.134234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455946+0000","last_change":"2024-04-02T07:25:13.837984+0000","last_active":"2024-04-02T07:25:15.455946+0000","last_peered":"2024-04-02T07:25:15.455946+0000","last_clean":"2024-04-02T07:25:15.455946+0000","last_became_active":"2024-04-02T07:25:13.837732+0000","last_became_peered":"2024-04-02T07:25:13.837732+0000","last_unstale":"2024-04-02T07:25:15.455946+0000","last_undegraded":"2024-04-02T07:25:15.455946+0000","last_fullsized":"2024-04-02T07:25:15.455946+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:56:30.473912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455639+0000","last_change":"2024-04-02T07:25:13.833228+0000","last_active":"2024-04-02T07:25:15.455639+0000","last_peered":"2024-04-02T07:25:15.455639+0000","last_clean":"2024-04-02T07:25:15.455639+0000","last_became_active":"2024-04-02T07:25:13.833014+0000","last_became_peered":"2024-04-02T07:25:13.833014+0000","last_unstale":"2024-04-02T07:25:15.455639+0000","last_undegraded":"2024-04-02T07:25:15.455639+0000","last_fullsized":"2024-04-02T07:25:15.455639+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:15:58.074270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.830579+0000","last_change":"2024-04-02T07:25:13.831253+0000","last_active":"2024-04-02T07:25:14.830579+0000","last_peered":"2024-04-02T07:25:14.830579+0000","last_clean":"2024-04-02T07:25:14.830579+0000","last_became_active":"2024-04-02T07:25:13.829934+0000","last_became_peered":"2024-04-02T07:25:13.829934+0000","last_unstale":"2024-04-02T07:25:14.830579+0000","last_undegraded":"2024-04-02T07:25:14.830579+0000","last_fullsized":"2024-04-02T07:25:14.830579+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:47:51.522549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829142+0000","last_change":"2024-04-02T07:25:13.838011+0000","last_active":"2024-04-02T07:25:14.829142+0000","last_peered":"2024-04-02T07:25:14.829142+0000","last_clean":"2024-04-02T07:25:14.829142+0000","last_became_active":"2024-04-02T07:25:13.837672+0000","last_became_peered":"2024-04-02T07:25:13.837672+0000","last_unstale":"2024-04-02T07:25:14.829142+0000","last_undegraded":"2024-04-02T07:25:14.829142+0000","last_fullsized":"2024-04-02T07:25:14.829142+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:49:41.992789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455360+0000","last_change":"2024-04-02T07:25:13.838228+0000","last_active":"2024-04-02T07:25:15.455360+0000","last_peered":"2024-04-02T07:25:15.455360+0000","last_clean":"2024-04-02T07:25:15.455360+0000","last_became_active":"2024-04-02T07:25:13.837579+0000","last_became_peered":"2024-04-02T07:25:13.837579+0000","last_unstale":"2024-04-02T07:25:15.455360+0000","last_undegraded":"2024-04-02T07:25:15.455360+0000","last_fullsized":"2024-04-02T07:25:15.455360+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:55:52.300846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.830321+0000","last_change":"2024-04-02T07:25:13.847345+0000","last_active":"2024-04-02T07:25:14.830321+0000","last_peered":"2024-04-02T07:25:14.830321+0000","last_clean":"2024-04-02T07:25:14.830321+0000","last_became_active":"2024-04-02T07:25:13.847026+0000","last_became_peered":"2024-04-02T07:25:13.847026+0000","last_unstale":"2024-04-02T07:25:14.830321+0000","last_undegraded":"2024-04-02T07:25:14.830321+0000","last_fullsized":"2024-04-02T07:25:14.830321+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:17:07.326518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455574+0000","last_change":"2024-04-02T07:25:13.846009+0000","last_active":"2024-04-02T07:25:15.455574+0000","last_peered":"2024-04-02T07:25:15.455574+0000","last_clean":"2024-04-02T07:25:15.455574+0000","last_became_active":"2024-04-02T07:25:13.845605+0000","last_became_peered":"2024-04-02T07:25:13.845605+0000","last_unstale":"2024-04-02T07:25:15.455574+0000","last_undegraded":"2024-04-02T07:25:15.455574+0000","last_fullsized":"2024-04-02T07:25:15.455574+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:44:09.371280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455904+0000","last_change":"2024-04-02T07:25:13.841312+0000","last_active":"2024-04-02T07:25:15.455904+0000","last_peered":"2024-04-02T07:25:15.455904+0000","last_clean":"2024-04-02T07:25:15.455904+0000","last_became_active":"2024-04-02T07:25:13.840560+0000","last_became_peered":"2024-04-02T07:25:13.840560+0000","last_unstale":"2024-04-02T07:25:15.455904+0000","last_undegraded":"2024-04-02T07:25:15.455904+0000","last_fullsized":"2024-04-02T07:25:15.455904+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:55:32.708707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"59'4","reported_seq":15,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456048+0000","last_change":"2024-04-02T07:25:13.415068+0000","last_active":"2024-04-02T07:25:15.456048+0000","last_peered":"2024-04-02T07:25:15.456048+0000","last_clean":"2024-04-02T07:25:15.456048+0000","last_became_active":"2024-04-02T07:25:13.414817+0000","last_became_peered":"2024-04-02T07:25:13.414817+0000","last_unstale":"2024-04-02T07:25:15.456048+0000","last_undegraded":"2024-04-02T07:25:15.456048+0000","last_fullsized":"2024-04-02T07:25:15.456048+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:07:08.173462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455590+0000","last_change":"2024-04-02T07:25:13.838505+0000","last_active":"2024-04-02T07:25:15.455590+0000","last_peered":"2024-04-02T07:25:15.455590+0000","last_clean":"2024-04-02T07:25:15.455590+0000","last_became_active":"2024-04-02T07:25:13.838240+0000","last_became_peered":"2024-04-02T07:25:13.838240+0000","last_unstale":"2024-04-02T07:25:15.455590+0000","last_undegraded":"2024-04-02T07:25:15.455590+0000","last_fullsized":"2024-04-02T07:25:15.455590+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:03:59.723055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829249+0000","last_change":"2024-04-02T07:25:13.424079+0000","last_active":"2024-04-02T07:25:14.829249+0000","last_peered":"2024-04-02T07:25:14.829249+0000","last_clean":"2024-04-02T07:25:14.829249+0000","last_became_active":"2024-04-02T07:25:13.423746+0000","last_became_peered":"2024-04-02T07:25:13.423746+0000","last_unstale":"2024-04-02T07:25:14.829249+0000","last_undegraded":"2024-04-02T07:25:14.829249+0000","last_fullsized":"2024-04-02T07:25:14.829249+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:18:23.550256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455715+0000","last_change":"2024-04-02T07:25:13.843729+0000","last_active":"2024-04-02T07:25:15.455715+0000","last_peered":"2024-04-02T07:25:15.455715+0000","last_clean":"2024-04-02T07:25:15.455715+0000","last_became_active":"2024-04-02T07:25:13.843443+0000","last_became_peered":"2024-04-02T07:25:13.843443+0000","last_unstale":"2024-04-02T07:25:15.455715+0000","last_undegraded":"2024-04-02T07:25:15.455715+0000","last_fullsized":"2024-04-02T07:25:15.455715+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:36:10.654914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455971+0000","last_change":"2024-04-02T07:25:13.416627+0000","last_active":"2024-04-02T07:25:15.455971+0000","last_peered":"2024-04-02T07:25:15.455971+0000","last_clean":"2024-04-02T07:25:15.455971+0000","last_became_active":"2024-04-02T07:25:13.415857+0000","last_became_peered":"2024-04-02T07:25:13.415857+0000","last_unstale":"2024-04-02T07:25:15.455971+0000","last_undegraded":"2024-04-02T07:25:15.455971+0000","last_fullsized":"2024-04-02T07:25:15.455971+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:45:45.317797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455862+0000","last_change":"2024-04-02T07:25:13.835778+0000","last_active":"2024-04-02T07:25:15.455862+0000","last_peered":"2024-04-02T07:25:15.455862+0000","last_clean":"2024-04-02T07:25:15.455862+0000","last_became_active":"2024-04-02T07:25:13.835268+0000","last_became_peered":"2024-04-02T07:25:13.835268+0000","last_unstale":"2024-04-02T07:25:15.455862+0000","last_undegraded":"2024-04-02T07:25:15.455862+0000","last_fullsized":"2024-04-02T07:25:15.455862+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:48:10.866582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456028+0000","last_change":"2024-04-02T07:25:13.421639+0000","last_active":"2024-04-02T07:25:15.456028+0000","last_peered":"2024-04-02T07:25:15.456028+0000","last_clean":"2024-04-02T07:25:15.456028+0000","last_became_active":"2024-04-02T07:25:13.421395+0000","last_became_peered":"2024-04-02T07:25:13.421395+0000","last_unstale":"2024-04-02T07:25:15.456028+0000","last_undegraded":"2024-04-02T07:25:15.456028+0000","last_fullsized":"2024-04-02T07:25:15.456028+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:45:59.216395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829495+0000","last_change":"2024-04-02T07:25:13.832954+0000","last_active":"2024-04-02T07:25:14.829495+0000","last_peered":"2024-04-02T07:25:14.829495+0000","last_clean":"2024-04-02T07:25:14.829495+0000","last_became_active":"2024-04-02T07:25:13.832570+0000","last_became_peered":"2024-04-02T07:25:13.832570+0000","last_unstale":"2024-04-02T07:25:14.829495+0000","last_undegraded":"2024-04-02T07:25:14.829495+0000","last_fullsized":"2024-04-02T07:25:14.829495+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:25:16.892809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826681+0000","last_change":"2024-04-02T07:25:13.420222+0000","last_active":"2024-04-02T07:25:14.826681+0000","last_peered":"2024-04-02T07:25:14.826681+0000","last_clean":"2024-04-02T07:25:14.826681+0000","last_became_active":"2024-04-02T07:25:13.419887+0000","last_became_peered":"2024-04-02T07:25:13.419887+0000","last_unstale":"2024-04-02T07:25:14.826681+0000","last_undegraded":"2024-04-02T07:25:14.826681+0000","last_fullsized":"2024-04-02T07:25:14.826681+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:03:58.719895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829048+0000","last_change":"2024-04-02T07:25:13.850986+0000","last_active":"2024-04-02T07:25:14.829048+0000","last_peered":"2024-04-02T07:25:14.829048+0000","last_clean":"2024-04-02T07:25:14.829048+0000","last_became_active":"2024-04-02T07:25:13.850156+0000","last_became_peered":"2024-04-02T07:25:13.850156+0000","last_unstale":"2024-04-02T07:25:14.829048+0000","last_undegraded":"2024-04-02T07:25:14.829048+0000","last_fullsized":"2024-04-02T07:25:14.829048+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:07.833961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455873+0000","last_change":"2024-04-02T07:25:13.416810+0000","last_active":"2024-04-02T07:25:15.455873+0000","last_peered":"2024-04-02T07:25:15.455873+0000","last_clean":"2024-04-02T07:25:15.455873+0000","last_became_active":"2024-04-02T07:25:13.416223+0000","last_became_peered":"2024-04-02T07:25:13.416223+0000","last_unstale":"2024-04-02T07:25:15.455873+0000","last_undegraded":"2024-04-02T07:25:15.455873+0000","last_fullsized":"2024-04-02T07:25:15.455873+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:35:14.297544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456165+0000","last_change":"2024-04-02T07:25:13.834761+0000","last_active":"2024-04-02T07:25:15.456165+0000","last_peered":"2024-04-02T07:25:15.456165+0000","last_clean":"2024-04-02T07:25:15.456165+0000","last_became_active":"2024-04-02T07:25:13.834324+0000","last_became_peered":"2024-04-02T07:25:13.834324+0000","last_unstale":"2024-04-02T07:25:15.456165+0000","last_undegraded":"2024-04-02T07:25:15.456165+0000","last_fullsized":"2024-04-02T07:25:15.456165+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:53:24.682624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455725+0000","last_change":"2024-04-02T07:25:13.419532+0000","last_active":"2024-04-02T07:25:15.455725+0000","last_peered":"2024-04-02T07:25:15.455725+0000","last_clean":"2024-04-02T07:25:15.455725+0000","last_became_active":"2024-04-02T07:25:13.419219+0000","last_became_peered":"2024-04-02T07:25:13.419219+0000","last_unstale":"2024-04-02T07:25:15.455725+0000","last_undegraded":"2024-04-02T07:25:15.455725+0000","last_fullsized":"2024-04-02T07:25:15.455725+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:27:54.548904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.828913+0000","last_change":"2024-04-02T07:25:13.834100+0000","last_active":"2024-04-02T07:25:14.828913+0000","last_peered":"2024-04-02T07:25:14.828913+0000","last_clean":"2024-04-02T07:25:14.828913+0000","last_became_active":"2024-04-02T07:25:13.833716+0000","last_became_peered":"2024-04-02T07:25:13.833716+0000","last_unstale":"2024-04-02T07:25:14.828913+0000","last_undegraded":"2024-04-02T07:25:14.828913+0000","last_fullsized":"2024-04-02T07:25:14.828913+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:41:14.947839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826382+0000","last_change":"2024-04-02T07:25:13.424479+0000","last_active":"2024-04-02T07:25:14.826382+0000","last_peered":"2024-04-02T07:25:14.826382+0000","last_clean":"2024-04-02T07:25:14.826382+0000","last_became_active":"2024-04-02T07:25:13.424050+0000","last_became_peered":"2024-04-02T07:25:13.424050+0000","last_unstale":"2024-04-02T07:25:14.826382+0000","last_undegraded":"2024-04-02T07:25:14.826382+0000","last_fullsized":"2024-04-02T07:25:14.826382+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:24:14.617250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826801+0000","last_change":"2024-04-02T07:25:13.834396+0000","last_active":"2024-04-02T07:25:14.826801+0000","last_peered":"2024-04-02T07:25:14.826801+0000","last_clean":"2024-04-02T07:25:14.826801+0000","last_became_active":"2024-04-02T07:25:13.834132+0000","last_became_peered":"2024-04-02T07:25:13.834132+0000","last_unstale":"2024-04-02T07:25:14.826801+0000","last_undegraded":"2024-04-02T07:25:14.826801+0000","last_fullsized":"2024-04-02T07:25:14.826801+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:09:15.330565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456685+0000","last_change":"2024-04-02T07:25:13.422718+0000","last_active":"2024-04-02T07:25:15.456685+0000","last_peered":"2024-04-02T07:25:15.456685+0000","last_clean":"2024-04-02T07:25:15.456685+0000","last_became_active":"2024-04-02T07:25:13.422325+0000","last_became_peered":"2024-04-02T07:25:13.422325+0000","last_unstale":"2024-04-02T07:25:15.456685+0000","last_undegraded":"2024-04-02T07:25:15.456685+0000","last_fullsized":"2024-04-02T07:25:15.456685+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:37:30.541440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456689+0000","last_change":"2024-04-02T07:25:13.847554+0000","last_active":"2024-04-02T07:25:15.456689+0000","last_peered":"2024-04-02T07:25:15.456689+0000","last_clean":"2024-04-02T07:25:15.456689+0000","last_became_active":"2024-04-02T07:25:13.847256+0000","last_became_peered":"2024-04-02T07:25:13.847256+0000","last_unstale":"2024-04-02T07:25:15.456689+0000","last_undegraded":"2024-04-02T07:25:15.456689+0000","last_fullsized":"2024-04-02T07:25:15.456689+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:15:58.074270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829305+0000","last_change":"2024-04-02T07:25:13.422323+0000","last_active":"2024-04-02T07:25:14.829305+0000","last_peered":"2024-04-02T07:25:14.829305+0000","last_clean":"2024-04-02T07:25:14.829305+0000","last_became_active":"2024-04-02T07:25:13.422067+0000","last_became_peered":"2024-04-02T07:25:13.422067+0000","last_unstale":"2024-04-02T07:25:14.829305+0000","last_undegraded":"2024-04-02T07:25:14.829305+0000","last_fullsized":"2024-04-02T07:25:14.829305+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:42:18.216499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455183+0000","last_change":"2024-04-02T07:25:13.842448+0000","last_active":"2024-04-02T07:25:15.455183+0000","last_peered":"2024-04-02T07:25:15.455183+0000","last_clean":"2024-04-02T07:25:15.455183+0000","last_became_active":"2024-04-02T07:25:13.841871+0000","last_became_peered":"2024-04-02T07:25:13.841871+0000","last_unstale":"2024-04-02T07:25:15.455183+0000","last_undegraded":"2024-04-02T07:25:15.455183+0000","last_fullsized":"2024-04-02T07:25:15.455183+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:04:16.273349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"59'3","reported_seq":14,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456485+0000","last_change":"2024-04-02T07:25:13.420126+0000","last_active":"2024-04-02T07:25:15.456485+0000","last_peered":"2024-04-02T07:25:15.456485+0000","last_clean":"2024-04-02T07:25:15.456485+0000","last_became_active":"2024-04-02T07:25:13.419873+0000","last_became_peered":"2024-04-02T07:25:13.419873+0000","last_unstale":"2024-04-02T07:25:15.456485+0000","last_undegraded":"2024-04-02T07:25:15.456485+0000","last_fullsized":"2024-04-02T07:25:15.456485+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:07:08.173462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456356+0000","last_change":"2024-04-02T07:25:13.847728+0000","last_active":"2024-04-02T07:25:15.456356+0000","last_peered":"2024-04-02T07:25:15.456356+0000","last_clean":"2024-04-02T07:25:15.456356+0000","last_became_active":"2024-04-02T07:25:13.847425+0000","last_became_peered":"2024-04-02T07:25:13.847425+0000","last_unstale":"2024-04-02T07:25:15.456356+0000","last_undegraded":"2024-04-02T07:25:15.456356+0000","last_fullsized":"2024-04-02T07:25:15.456356+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:02:07.068315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"59'6","reported_seq":17,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826768+0000","last_change":"2024-04-02T07:25:13.424042+0000","last_active":"2024-04-02T07:25:14.826768+0000","last_peered":"2024-04-02T07:25:14.826768+0000","last_clean":"2024-04-02T07:25:14.826768+0000","last_became_active":"2024-04-02T07:25:13.423787+0000","last_became_peered":"2024-04-02T07:25:13.423787+0000","last_unstale":"2024-04-02T07:25:14.826768+0000","last_undegraded":"2024-04-02T07:25:14.826768+0000","last_fullsized":"2024-04-02T07:25:14.826768+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:17:50.540310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455659+0000","last_change":"2024-04-02T07:25:13.830681+0000","last_active":"2024-04-02T07:25:15.455659+0000","last_peered":"2024-04-02T07:25:15.455659+0000","last_clean":"2024-04-02T07:25:15.455659+0000","last_became_active":"2024-04-02T07:25:13.830405+0000","last_became_peered":"2024-04-02T07:25:13.830405+0000","last_unstale":"2024-04-02T07:25:15.455659+0000","last_undegraded":"2024-04-02T07:25:15.455659+0000","last_fullsized":"2024-04-02T07:25:15.455659+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:23:03.626287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829140+0000","last_change":"2024-04-02T07:25:13.424149+0000","last_active":"2024-04-02T07:25:14.829140+0000","last_peered":"2024-04-02T07:25:14.829140+0000","last_clean":"2024-04-02T07:25:14.829140+0000","last_became_active":"2024-04-02T07:25:13.423867+0000","last_became_peered":"2024-04-02T07:25:13.423867+0000","last_unstale":"2024-04-02T07:25:14.829140+0000","last_undegraded":"2024-04-02T07:25:14.829140+0000","last_fullsized":"2024-04-02T07:25:14.829140+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:01:49.923849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456264+0000","last_change":"2024-04-02T07:25:13.832846+0000","last_active":"2024-04-02T07:25:15.456264+0000","last_peered":"2024-04-02T07:25:15.456264+0000","last_clean":"2024-04-02T07:25:15.456264+0000","last_became_active":"2024-04-02T07:25:13.832047+0000","last_became_peered":"2024-04-02T07:25:13.832047+0000","last_unstale":"2024-04-02T07:25:15.456264+0000","last_undegraded":"2024-04-02T07:25:15.456264+0000","last_fullsized":"2024-04-02T07:25:15.456264+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:17:05.963406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456862+0000","last_change":"2024-04-02T07:25:13.414656+0000","last_active":"2024-04-02T07:25:15.456862+0000","last_peered":"2024-04-02T07:25:15.456862+0000","last_clean":"2024-04-02T07:25:15.456862+0000","last_became_active":"2024-04-02T07:25:13.414393+0000","last_became_peered":"2024-04-02T07:25:13.414393+0000","last_unstale":"2024-04-02T07:25:15.456862+0000","last_undegraded":"2024-04-02T07:25:15.456862+0000","last_fullsized":"2024-04-02T07:25:15.456862+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:40:18.231963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826312+0000","last_change":"2024-04-02T07:25:13.839714+0000","last_active":"2024-04-02T07:25:14.826312+0000","last_peered":"2024-04-02T07:25:14.826312+0000","last_clean":"2024-04-02T07:25:14.826312+0000","last_became_active":"2024-04-02T07:25:13.833918+0000","last_became_peered":"2024-04-02T07:25:13.833918+0000","last_unstale":"2024-04-02T07:25:14.826312+0000","last_undegraded":"2024-04-02T07:25:14.826312+0000","last_fullsized":"2024-04-02T07:25:14.826312+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:45:37.603677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455850+0000","last_change":"2024-04-02T07:25:13.415326+0000","last_active":"2024-04-02T07:25:15.455850+0000","last_peered":"2024-04-02T07:25:15.455850+0000","last_clean":"2024-04-02T07:25:15.455850+0000","last_became_active":"2024-04-02T07:25:13.414772+0000","last_became_peered":"2024-04-02T07:25:13.414772+0000","last_unstale":"2024-04-02T07:25:15.455850+0000","last_undegraded":"2024-04-02T07:25:15.455850+0000","last_fullsized":"2024-04-02T07:25:15.455850+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:15:47.737303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456287+0000","last_change":"2024-04-02T07:25:13.844036+0000","last_active":"2024-04-02T07:25:15.456287+0000","last_peered":"2024-04-02T07:25:15.456287+0000","last_clean":"2024-04-02T07:25:15.456287+0000","last_became_active":"2024-04-02T07:25:13.843573+0000","last_became_peered":"2024-04-02T07:25:13.843573+0000","last_unstale":"2024-04-02T07:25:15.456287+0000","last_undegraded":"2024-04-02T07:25:15.456287+0000","last_fullsized":"2024-04-02T07:25:15.456287+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:38:46.221450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"59'8","reported_seq":19,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455276+0000","last_change":"2024-04-02T07:25:13.415882+0000","last_active":"2024-04-02T07:25:15.455276+0000","last_peered":"2024-04-02T07:25:15.455276+0000","last_clean":"2024-04-02T07:25:15.455276+0000","last_became_active":"2024-04-02T07:25:13.415566+0000","last_became_peered":"2024-04-02T07:25:13.415566+0000","last_unstale":"2024-04-02T07:25:15.455276+0000","last_undegraded":"2024-04-02T07:25:15.455276+0000","last_fullsized":"2024-04-02T07:25:15.455276+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:35:14.297544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456467+0000","last_change":"2024-04-02T07:25:13.838691+0000","last_active":"2024-04-02T07:25:15.456467+0000","last_peered":"2024-04-02T07:25:15.456467+0000","last_clean":"2024-04-02T07:25:15.456467+0000","last_became_active":"2024-04-02T07:25:13.838425+0000","last_became_peered":"2024-04-02T07:25:13.838425+0000","last_unstale":"2024-04-02T07:25:15.456467+0000","last_undegraded":"2024-04-02T07:25:15.456467+0000","last_fullsized":"2024-04-02T07:25:15.456467+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:44:09.371280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829430+0000","last_change":"2024-04-02T07:25:13.420012+0000","last_active":"2024-04-02T07:25:14.829430+0000","last_peered":"2024-04-02T07:25:14.829430+0000","last_clean":"2024-04-02T07:25:14.829430+0000","last_became_active":"2024-04-02T07:25:13.419709+0000","last_became_peered":"2024-04-02T07:25:13.419709+0000","last_unstale":"2024-04-02T07:25:14.829430+0000","last_undegraded":"2024-04-02T07:25:14.829430+0000","last_fullsized":"2024-04-02T07:25:14.829430+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:13:17.056274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456169+0000","last_change":"2024-04-02T07:25:13.841727+0000","last_active":"2024-04-02T07:25:15.456169+0000","last_peered":"2024-04-02T07:25:15.456169+0000","last_clean":"2024-04-02T07:25:15.456169+0000","last_became_active":"2024-04-02T07:25:13.841192+0000","last_became_peered":"2024-04-02T07:25:13.841192+0000","last_unstale":"2024-04-02T07:25:15.456169+0000","last_undegraded":"2024-04-02T07:25:15.456169+0000","last_fullsized":"2024-04-02T07:25:15.456169+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:24:57.139678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455908+0000","last_change":"2024-04-02T07:25:13.415637+0000","last_active":"2024-04-02T07:25:15.455908+0000","last_peered":"2024-04-02T07:25:15.455908+0000","last_clean":"2024-04-02T07:25:15.455908+0000","last_became_active":"2024-04-02T07:25:13.414724+0000","last_became_peered":"2024-04-02T07:25:13.414724+0000","last_unstale":"2024-04-02T07:25:15.455908+0000","last_undegraded":"2024-04-02T07:25:15.455908+0000","last_fullsized":"2024-04-02T07:25:15.455908+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:27:54.548904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829302+0000","last_change":"2024-04-02T07:25:13.838727+0000","last_active":"2024-04-02T07:25:14.829302+0000","last_peered":"2024-04-02T07:25:14.829302+0000","last_clean":"2024-04-02T07:25:14.829302+0000","last_became_active":"2024-04-02T07:25:13.838464+0000","last_became_peered":"2024-04-02T07:25:13.838464+0000","last_unstale":"2024-04-02T07:25:14.829302+0000","last_undegraded":"2024-04-02T07:25:14.829302+0000","last_fullsized":"2024-04-02T07:25:14.829302+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:08:26.104078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"59'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455935+0000","last_change":"2024-04-02T07:25:13.421116+0000","last_active":"2024-04-02T07:25:15.455935+0000","last_peered":"2024-04-02T07:25:15.455935+0000","last_clean":"2024-04-02T07:25:15.455935+0000","last_became_active":"2024-04-02T07:25:13.420829+0000","last_became_peered":"2024-04-02T07:25:13.420829+0000","last_unstale":"2024-04-02T07:25:15.455935+0000","last_undegraded":"2024-04-02T07:25:15.455935+0000","last_fullsized":"2024-04-02T07:25:15.455935+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:30:45.003944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456455+0000","last_change":"2024-04-02T07:25:13.848913+0000","last_active":"2024-04-02T07:25:15.456455+0000","last_peered":"2024-04-02T07:25:15.456455+0000","last_clean":"2024-04-02T07:25:15.456455+0000","last_became_active":"2024-04-02T07:25:13.847541+0000","last_became_peered":"2024-04-02T07:25:13.847541+0000","last_unstale":"2024-04-02T07:25:15.456455+0000","last_undegraded":"2024-04-02T07:25:15.456455+0000","last_fullsized":"2024-04-02T07:25:15.456455+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:36:10.654914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455804+0000","last_change":"2024-04-02T07:25:13.420298+0000","last_active":"2024-04-02T07:25:15.455804+0000","last_peered":"2024-04-02T07:25:15.455804+0000","last_clean":"2024-04-02T07:25:15.455804+0000","last_became_active":"2024-04-02T07:25:13.419940+0000","last_became_peered":"2024-04-02T07:25:13.419940+0000","last_unstale":"2024-04-02T07:25:15.455804+0000","last_undegraded":"2024-04-02T07:25:15.455804+0000","last_fullsized":"2024-04-02T07:25:15.455804+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:45:36.600517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456068+0000","last_change":"2024-04-02T07:25:13.841576+0000","last_active":"2024-04-02T07:25:15.456068+0000","last_peered":"2024-04-02T07:25:15.456068+0000","last_clean":"2024-04-02T07:25:15.456068+0000","last_became_active":"2024-04-02T07:25:13.841305+0000","last_became_peered":"2024-04-02T07:25:13.841305+0000","last_unstale":"2024-04-02T07:25:15.456068+0000","last_undegraded":"2024-04-02T07:25:15.456068+0000","last_fullsized":"2024-04-02T07:25:15.456068+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:30:14.485175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829230+0000","last_change":"2024-04-02T07:25:13.419301+0000","last_active":"2024-04-02T07:25:14.829230+0000","last_peered":"2024-04-02T07:25:14.829230+0000","last_clean":"2024-04-02T07:25:14.829230+0000","last_became_active":"2024-04-02T07:25:13.419018+0000","last_became_peered":"2024-04-02T07:25:13.419018+0000","last_unstale":"2024-04-02T07:25:14.829230+0000","last_undegraded":"2024-04-02T07:25:14.829230+0000","last_fullsized":"2024-04-02T07:25:14.829230+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:37:21.580450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455561+0000","last_change":"2024-04-02T07:25:13.845285+0000","last_active":"2024-04-02T07:25:15.455561+0000","last_peered":"2024-04-02T07:25:15.455561+0000","last_clean":"2024-04-02T07:25:15.455561+0000","last_became_active":"2024-04-02T07:25:13.845046+0000","last_became_peered":"2024-04-02T07:25:13.845046+0000","last_unstale":"2024-04-02T07:25:15.455561+0000","last_undegraded":"2024-04-02T07:25:15.455561+0000","last_fullsized":"2024-04-02T07:25:15.455561+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:51:16.504462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455070+0000","last_change":"2024-04-02T07:25:13.414596+0000","last_active":"2024-04-02T07:25:15.455070+0000","last_peered":"2024-04-02T07:25:15.455070+0000","last_clean":"2024-04-02T07:25:15.455070+0000","last_became_active":"2024-04-02T07:25:13.414339+0000","last_became_peered":"2024-04-02T07:25:13.414339+0000","last_unstale":"2024-04-02T07:25:15.455070+0000","last_undegraded":"2024-04-02T07:25:15.455070+0000","last_fullsized":"2024-04-02T07:25:15.455070+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:30:09.018484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455712+0000","last_change":"2024-04-02T07:25:13.841015+0000","last_active":"2024-04-02T07:25:15.455712+0000","last_peered":"2024-04-02T07:25:15.455712+0000","last_clean":"2024-04-02T07:25:15.455712+0000","last_became_active":"2024-04-02T07:25:13.840145+0000","last_became_peered":"2024-04-02T07:25:13.840145+0000","last_unstale":"2024-04-02T07:25:15.455712+0000","last_undegraded":"2024-04-02T07:25:15.455712+0000","last_fullsized":"2024-04-02T07:25:15.455712+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:56:30.473912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455692+0000","last_change":"2024-04-02T07:25:13.419192+0000","last_active":"2024-04-02T07:25:15.455692+0000","last_peered":"2024-04-02T07:25:15.455692+0000","last_clean":"2024-04-02T07:25:15.455692+0000","last_became_active":"2024-04-02T07:25:13.418954+0000","last_became_peered":"2024-04-02T07:25:13.418954+0000","last_unstale":"2024-04-02T07:25:15.455692+0000","last_undegraded":"2024-04-02T07:25:15.455692+0000","last_fullsized":"2024-04-02T07:25:15.455692+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:45:45.317797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456108+0000","last_change":"2024-04-02T07:25:13.828785+0000","last_active":"2024-04-02T07:25:15.456108+0000","last_peered":"2024-04-02T07:25:15.456108+0000","last_clean":"2024-04-02T07:25:15.456108+0000","last_became_active":"2024-04-02T07:25:13.827672+0000","last_became_peered":"2024-04-02T07:25:13.827672+0000","last_unstale":"2024-04-02T07:25:15.456108+0000","last_undegraded":"2024-04-02T07:25:15.456108+0000","last_fullsized":"2024-04-02T07:25:15.456108+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:42:19.219659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"59'2","reported_seq":13,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455681+0000","last_change":"2024-04-02T07:25:13.425406+0000","last_active":"2024-04-02T07:25:15.455681+0000","last_peered":"2024-04-02T07:25:15.455681+0000","last_clean":"2024-04-02T07:25:15.455681+0000","last_became_active":"2024-04-02T07:25:13.425101+0000","last_became_peered":"2024-04-02T07:25:13.425101+0000","last_unstale":"2024-04-02T07:25:15.455681+0000","last_undegraded":"2024-04-02T07:25:15.455681+0000","last_fullsized":"2024-04-02T07:25:15.455681+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:58:08.193966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456175+0000","last_change":"2024-04-02T07:25:13.833680+0000","last_active":"2024-04-02T07:25:15.456175+0000","last_peered":"2024-04-02T07:25:15.456175+0000","last_clean":"2024-04-02T07:25:15.456175+0000","last_became_active":"2024-04-02T07:25:13.833408+0000","last_became_peered":"2024-04-02T07:25:13.833408+0000","last_unstale":"2024-04-02T07:25:15.456175+0000","last_undegraded":"2024-04-02T07:25:15.456175+0000","last_fullsized":"2024-04-02T07:25:15.456175+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:02:07.068315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"60'1","reported_seq":12,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:16.386257+0000","last_change":"2024-04-02T07:25:13.415820+0000","last_active":"2024-04-02T07:25:16.386257+0000","last_peered":"2024-04-02T07:25:16.386257+0000","last_clean":"2024-04-02T07:25:16.386257+0000","last_became_active":"2024-04-02T07:25:13.415350+0000","last_became_peered":"2024-04-02T07:25:13.415350+0000","last_unstale":"2024-04-02T07:25:16.386257+0000","last_undegraded":"2024-04-02T07:25:16.386257+0000","last_fullsized":"2024-04-02T07:25:16.386257+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:37:30.541440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455199+0000","last_change":"2024-04-02T07:25:13.842444+0000","last_active":"2024-04-02T07:25:15.455199+0000","last_peered":"2024-04-02T07:25:15.455199+0000","last_clean":"2024-04-02T07:25:15.455199+0000","last_became_active":"2024-04-02T07:25:13.841421+0000","last_became_peered":"2024-04-02T07:25:13.841421+0000","last_unstale":"2024-04-02T07:25:15.455199+0000","last_undegraded":"2024-04-02T07:25:15.455199+0000","last_fullsized":"2024-04-02T07:25:15.455199+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:53:24.682624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456808+0000","last_change":"2024-04-02T07:25:13.417590+0000","last_active":"2024-04-02T07:25:15.456808+0000","last_peered":"2024-04-02T07:25:15.456808+0000","last_clean":"2024-04-02T07:25:15.456808+0000","last_became_active":"2024-04-02T07:25:13.417374+0000","last_became_peered":"2024-04-02T07:25:13.417374+0000","last_unstale":"2024-04-02T07:25:15.456808+0000","last_undegraded":"2024-04-02T07:25:15.456808+0000","last_fullsized":"2024-04-02T07:25:15.456808+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:58:39.230040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455944+0000","last_change":"2024-04-02T07:25:13.835557+0000","last_active":"2024-04-02T07:25:15.455944+0000","last_peered":"2024-04-02T07:25:15.455944+0000","last_clean":"2024-04-02T07:25:15.455944+0000","last_became_active":"2024-04-02T07:25:13.834950+0000","last_became_peered":"2024-04-02T07:25:13.834950+0000","last_unstale":"2024-04-02T07:25:15.455944+0000","last_undegraded":"2024-04-02T07:25:15.455944+0000","last_fullsized":"2024-04-02T07:25:15.455944+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:55:52.300846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456095+0000","last_change":"2024-04-02T07:25:13.418153+0000","last_active":"2024-04-02T07:25:15.456095+0000","last_peered":"2024-04-02T07:25:15.456095+0000","last_clean":"2024-04-02T07:25:15.456095+0000","last_became_active":"2024-04-02T07:25:13.417552+0000","last_became_peered":"2024-04-02T07:25:13.417552+0000","last_unstale":"2024-04-02T07:25:15.456095+0000","last_undegraded":"2024-04-02T07:25:15.456095+0000","last_fullsized":"2024-04-02T07:25:15.456095+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:45:36.600517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.829430+0000","last_change":"2024-04-02T07:25:13.841756+0000","last_active":"2024-04-02T07:25:14.829430+0000","last_peered":"2024-04-02T07:25:14.829430+0000","last_clean":"2024-04-02T07:25:14.829430+0000","last_became_active":"2024-04-02T07:25:13.841502+0000","last_became_peered":"2024-04-02T07:25:13.841502+0000","last_unstale":"2024-04-02T07:25:14.829430+0000","last_undegraded":"2024-04-02T07:25:14.829430+0000","last_fullsized":"2024-04-02T07:25:14.829430+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:59:19.156812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.455000+0000","last_change":"2024-04-02T07:25:13.413685+0000","last_active":"2024-04-02T07:25:15.455000+0000","last_peered":"2024-04-02T07:25:15.455000+0000","last_clean":"2024-04-02T07:25:15.455000+0000","last_became_active":"2024-04-02T07:25:13.413007+0000","last_became_peered":"2024-04-02T07:25:13.413007+0000","last_unstale":"2024-04-02T07:25:15.455000+0000","last_undegraded":"2024-04-02T07:25:15.455000+0000","last_fullsized":"2024-04-02T07:25:15.455000+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:48:18.595104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456389+0000","last_change":"2024-04-02T07:25:13.843455+0000","last_active":"2024-04-02T07:25:15.456389+0000","last_peered":"2024-04-02T07:25:15.456389+0000","last_clean":"2024-04-02T07:25:15.456389+0000","last_became_active":"2024-04-02T07:25:13.842833+0000","last_became_peered":"2024-04-02T07:25:13.842833+0000","last_unstale":"2024-04-02T07:25:15.456389+0000","last_undegraded":"2024-04-02T07:25:15.456389+0000","last_fullsized":"2024-04-02T07:25:15.456389+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:55:42.022540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.826503+0000","last_change":"2024-04-02T07:25:13.422967+0000","last_active":"2024-04-02T07:25:14.826503+0000","last_peered":"2024-04-02T07:25:14.826503+0000","last_clean":"2024-04-02T07:25:14.826503+0000","last_became_active":"2024-04-02T07:25:13.422128+0000","last_became_peered":"2024-04-02T07:25:13.422128+0000","last_unstale":"2024-04-02T07:25:14.826503+0000","last_undegraded":"2024-04-02T07:25:14.826503+0000","last_fullsized":"2024-04-02T07:25:14.826503+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:49:53.952263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.454919+0000","last_change":"2024-04-02T07:25:13.842639+0000","last_active":"2024-04-02T07:25:15.454919+0000","last_peered":"2024-04-02T07:25:15.454919+0000","last_clean":"2024-04-02T07:25:15.454919+0000","last_became_active":"2024-04-02T07:25:13.842327+0000","last_became_peered":"2024-04-02T07:25:13.842327+0000","last_unstale":"2024-04-02T07:25:15.454919+0000","last_undegraded":"2024-04-02T07:25:15.454919+0000","last_fullsized":"2024-04-02T07:25:15.454919+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:24:15.620410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.454995+0000","last_change":"2024-04-02T07:25:13.419195+0000","last_active":"2024-04-02T07:25:15.454995+0000","last_peered":"2024-04-02T07:25:15.454995+0000","last_clean":"2024-04-02T07:25:15.454995+0000","last_became_active":"2024-04-02T07:25:13.418989+0000","last_became_peered":"2024-04-02T07:25:13.418989+0000","last_unstale":"2024-04-02T07:25:15.454995+0000","last_undegraded":"2024-04-02T07:25:15.454995+0000","last_fullsized":"2024-04-02T07:25:15.454995+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:30:18.876417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.828948+0000","last_change":"2024-04-02T07:25:13.839287+0000","last_active":"2024-04-02T07:25:14.828948+0000","last_peered":"2024-04-02T07:25:14.828948+0000","last_clean":"2024-04-02T07:25:14.828948+0000","last_became_active":"2024-04-02T07:25:13.838963+0000","last_became_peered":"2024-04-02T07:25:13.838963+0000","last_unstale":"2024-04-02T07:25:14.828948+0000","last_undegraded":"2024-04-02T07:25:14.828948+0000","last_fullsized":"2024-04-02T07:25:14.828948+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:58:24.188990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.828930+0000","last_change":"2024-04-02T07:25:13.414859+0000","last_active":"2024-04-02T07:25:14.828930+0000","last_peered":"2024-04-02T07:25:14.828930+0000","last_clean":"2024-04-02T07:25:14.828930+0000","last_became_active":"2024-04-02T07:25:13.414603+0000","last_became_peered":"2024-04-02T07:25:13.414603+0000","last_unstale":"2024-04-02T07:25:14.828930+0000","last_undegraded":"2024-04-02T07:25:14.828930+0000","last_fullsized":"2024-04-02T07:25:14.828930+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:24:56.136518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:14.828813+0000","last_change":"2024-04-02T07:25:13.834084+0000","last_active":"2024-04-02T07:25:14.828813+0000","last_peered":"2024-04-02T07:25:14.828813+0000","last_clean":"2024-04-02T07:25:14.828813+0000","last_became_active":"2024-04-02T07:25:13.833842+0000","last_became_peered":"2024-04-02T07:25:13.833842+0000","last_unstale":"2024-04-02T07:25:14.828813+0000","last_undegraded":"2024-04-02T07:25:14.828813+0000","last_fullsized":"2024-04-02T07:25:14.828813+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":58,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:13.385595+0000","last_clean_scrub_stamp":"2024-04-02T07:25:13.385595+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:37:26.090804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-04-02T07:25:15.456251+0000","last_change":"2024-04-02T07:25:13.413117+0000","last_active":"2024-04-02T07:25:15.456251+0000","last_peered":"2024-04-02T07:25:15.456251+0000","last_clean":"2024-04-02T07:25:15.456251+0000","last_became_active":"2024-04-02T07:25:13.412801+0000","last_became_peered":"2024-04-02T07:25:13.412801+0000","last_unstale":"2024-04-02T07:25:15.456251+0000","last_undegraded":"2024-04-02T07:25:15.456251+0000","last_fullsized":"2024-04-02T07:25:15.456251+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:25:12.382435+0000","last_clean_scrub_stamp":"2024-04-02T07:25:12.382435+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:40:11.277526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":198,"reported_epoch":59,"state":"active+clean","last_fresh":"2024-04-02T07:25:13.823121+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:25:13.823121+0000","last_peered":"2024-04-02T07:25:13.823121+0000","last_clean":"2024-04-02T07:25:13.823121+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:25:13.823121+0000","last_undegraded":"2024-04-02T07:25:13.823121+0000","last_fullsized":"2024-04-02T07:25:13.823121+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574889,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28312,"kb_used_data":1292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343528,"statfs":{"total":96636764160,"available":96607772672,"internally_reserved":0,"allocated":1323008,"data_stored":891595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.64200000000000002,"15min":0.64100000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.623,"15min":0.60299999999999998},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.68200000000000005}]},{"osd":1,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.63400000000000001,"15min":0.626},"min":{"1min":0.432,"5min":0.379,"15min":0.379},"max":{"1min":0.95999999999999996,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.65400000000000003,"15min":0.65100000000000002},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.871,"5min":1.113,"15min":1.113},"last":0.58299999999999996}]},{"osd":2,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.746,"15min":0.75},"min":{"1min":0.55700000000000005,"5min":0.435,"15min":0.435},"max":{"1min":1.0149999999999999,"5min":1.139,"15min":1.139},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72099999999999997,"15min":0.72499999999999998},"min":{"1min":0.499,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.93300000000000005,"5min":1.522,"15min":1.522},"last":0.63800000000000001}]},{"osd":3,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.69799999999999995,"15min":0.69999999999999996},"min":{"1min":0.46800000000000003,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":1.0369999999999999,"5min":1.405,"15min":1.405},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.71699999999999997,"15min":0.72499999999999998},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.90500000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.65800000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.66800000000000004,"15min":0.69599999999999995},"min":{"1min":0.38300000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.92500000000000004,"5min":1.633,"15min":1.633},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.72199999999999998,"15min":0.746},"min":{"1min":0.51600000000000001,"5min":0.495,"15min":0.495},"max":{"1min":0.93600000000000005,"5min":1.079,"15min":1.079},"last":0.70999999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.69999999999999996,"15min":0.73299999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.90600000000000003,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.76200000000000001,"15min":0.79100000000000004},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.95599999999999996,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.72699999999999998}]},{"osd":6,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.70999999999999996,"15min":0.73999999999999999},"min":{"1min":0.46000000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.88700000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.755},{"interface":"front","average":{"1min":0.623,"5min":0.67800000000000005,"15min":0.70799999999999996},"min":{"1min":0.44700000000000001,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86499999999999999,"5min":1,"15min":1},"last":0.51400000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574890,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27732,"kb_used_data":704,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344108,"statfs":{"total":96636764160,"available":96608366592,"internally_reserved":0,"allocated":720896,"data_stored":301067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.65300000000000002,"15min":0.66000000000000003},"min":{"1min":0.46600000000000003,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.75700000000000001,"5min":1.399,"15min":1.399},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.82699999999999996,"15min":0.90100000000000002},"min":{"1min":0.498,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.876,"5min":5.7569999999999997,"15min":5.7569999999999997},"last":0.57599999999999996}]},{"osd":1,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.71899999999999997,"15min":0.72899999999999998},"min":{"1min":0.42799999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.90500000000000003,"5min":1.95,"15min":1.95},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.72099999999999997,"15min":0.72999999999999998},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.83599999999999997,"5min":1.248,"15min":1.248},"last":0.68400000000000005}]},{"osd":2,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.67700000000000005,"15min":0.69199999999999995},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.746,"5min":1.226,"15min":1.226},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.70399999999999996,"15min":0.70799999999999996},"min":{"1min":0.504,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.86599999999999999,"5min":0.997,"15min":0.997},"last":0.80800000000000005}]},{"osd":3,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.78100000000000003,"15min":0.81499999999999995},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.82899999999999996,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.751},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.76700000000000002,"15min":0.79900000000000004},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.84799999999999998,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.76700000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.65300000000000002,"15min":0.66900000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.83699999999999997,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83799999999999997,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.83099999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.65600000000000003,"15min":0.68000000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.749,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.71999999999999997,"15min":0.73399999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.873,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.78200000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:25:08 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.73099999999999998,"15min":0.748},"min":{"1min":0.53300000000000003,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.88,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.73099999999999998,"15min":0.749},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.81799999999999995,"5min":0.999,"15min":0.999},"last":0.73899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574890,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27740,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344100,"statfs":{"total":96636764160,"available":96608358400,"internally_reserved":0,"allocated":729088,"data_stored":301719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.64900000000000002,"15min":0.64500000000000002},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.873,"5min":1.25,"15min":1.25},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.70399999999999996,"15min":0.70799999999999996},"min":{"1min":0.47599999999999998,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.93300000000000005,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.70699999999999996}]},{"osd":1,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.68999999999999995,"15min":0.68899999999999995},"min":{"1min":0.52200000000000002,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.875,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.70299999999999996,"15min":0.72299999999999998},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.86199999999999999,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.79800000000000004}]},{"osd":2,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.79400000000000004,"15min":0.82599999999999996},"min":{"1min":0.47399999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.88700000000000001,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.72399999999999998,"15min":0.746},"min":{"1min":0.442,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.86099999999999999,"5min":1.696,"15min":1.696},"last":0.78900000000000003}]},{"osd":3,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.74399999999999999,"15min":0.76700000000000002},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92400000000000004,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.78700000000000003,"15min":0.82899999999999996},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.85799999999999998,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.84699999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.67500000000000004,"15min":0.72799999999999998},"min":{"1min":0.39200000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79400000000000004,"5min":1.911,"15min":1.911},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.73399999999999999,"15min":0.79600000000000004},"min":{"1min":0.42399999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.84099999999999997,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.64000000000000001}]},{"osd":6,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.79800000000000004,"15min":0.873},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.80300000000000005,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.78700000000000003,"15min":0.85799999999999998},"min":{"1min":0.45100000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.82699999999999996,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.621}]},{"osd":7,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.81399999999999995,"15min":0.878},"min":{"1min":0.48899999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.88700000000000001,"5min":1.887,"15min":1.887},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.84799999999999998,"15min":0.92600000000000005},"min":{"1min":0.443,"5min":0.439,"15min":0.439},"max":{"1min":0.86699999999999999,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":0.60899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574892,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27744,"kb_used_data":716,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344096,"statfs":{"total":96636764160,"available":96608354304,"internally_reserved":0,"allocated":733184,"data_stored":302631,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.72699999999999998,"15min":0.753},"min":{"1min":0.47299999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.85899999999999999,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.77700000000000002,"15min":0.83499999999999996},"min":{"1min":0.48099999999999998,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.78800000000000003,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.72399999999999998}]},{"osd":1,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.745,"15min":0.76400000000000001},"min":{"1min":0.499,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.93300000000000005,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.85599999999999998,"15min":0.92500000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.91400000000000003,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":0.48699999999999999}]},{"osd":2,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.78400000000000003,"15min":0.80800000000000005},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.95199999999999996,"5min":2.056,"15min":2.056},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.83899999999999997,"15min":0.88900000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.92000000000000004,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.66400000000000003}]},{"osd":3,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.94099999999999995,"15min":1.0169999999999999},"min":{"1min":0.57699999999999996,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.97899999999999998,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.95099999999999996,"15min":1.0309999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.014,"5min":3.9750000000000001,"15min":3.9750000000000001},"last":0.68600000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.70399999999999996,"15min":0.71999999999999997},"min":{"1min":0.42599999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":1.0389999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.73799999999999999,"15min":0.76000000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.0549999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.69899999999999995}]},{"osd":6,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71699999999999997,"15min":0.72599999999999998},"min":{"1min":0.45400000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.123,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.77300000000000002,"15min":0.78700000000000003},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.032,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.70699999999999996}]},{"osd":7,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.80500000000000005,"15min":0.81100000000000005},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.1060000000000001,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.86399999999999999,"15min":0.877},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.1499999999999999,"5min":1.353,"15min":1.353},"last":0.754}]}]},{"osd":3,"up_from":13,"seq":55834574890,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":729088,"data_stored":301123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.438,"15min":0.45000000000000001},"min":{"1min":0.28499999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47799999999999998,"15min":0.48199999999999998},"min":{"1min":0.34200000000000003,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.73699999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.498}]},{"osd":1,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.44400000000000001,"15min":0.438},"min":{"1min":0.33800000000000002,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.497,"15min":0.505},"min":{"1min":0.375,"5min":0.309,"15min":0.309},"max":{"1min":0.68899999999999995,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.46500000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.53200000000000003,"15min":0.52800000000000002},"min":{"1min":0.39500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.44800000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.93700000000000006,"5min":1.306,"15min":1.306},"last":0.67100000000000004}]},{"osd":4,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.74299999999999999,"15min":0.75900000000000001},"min":{"1min":0.5,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.876,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.93700000000000006},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.57099999999999995,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.94099999999999995,"5min":1.155,"15min":1.155},"last":0.89900000000000002}]},{"osd":5,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.53200000000000003,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.024,"5min":1.198,"15min":1.198},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.746,"15min":0.745},"min":{"1min":0.57299999999999995,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.034,"5min":1.135,"15min":1.135},"last":0.95799999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.76400000000000001,"15min":0.76900000000000002},"min":{"1min":0.58799999999999997,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.96499999999999997,"5min":1.25,"15min":1.25},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.78500000000000003,"15min":0.78200000000000003},"min":{"1min":0.59799999999999998,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":0.98499999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.92000000000000004}]},{"osd":7,"last update":"Tue Apr 2 07:25:10 2024","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.75700000000000001,"15min":0.75800000000000001},"min":{"1min":0.53300000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0740000000000001,"5min":1.216,"15min":1.216},"last":0.85199999999999998},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.78900000000000003,"15min":0.79600000000000004},"min":{"1min":0.57199999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.012,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.88500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574890,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31836,"kb_used_data":712,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340004,"statfs":{"total":96636764160,"available":96604164096,"internally_reserved":0,"allocated":729088,"data_stored":301123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44700000000000001,"15min":0.45200000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.747,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.373},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.65200000000000002,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.41799999999999998}]},{"osd":1,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53500000000000003,"15min":0.54500000000000004},"min":{"1min":0.379,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.76800000000000002,"5min":1.171,"15min":1.171},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.48599999999999999,"15min":0.49199999999999999},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.74299999999999999,"5min":1.333,"15min":1.333},"last":0.45400000000000001}]},{"osd":3,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52000000000000002,"15min":0.51500000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.70099999999999996,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83099999999999996,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.439}]},{"osd":4,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.49299999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.5309999999999999,"5min":2.254,"15min":2.254},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.751,"5min":0.76200000000000001,"15min":0.76500000000000001},"min":{"1min":0.51800000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.2210000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.79100000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.751,"15min":0.75600000000000001},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.2629999999999999,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.79900000000000004,"15min":0.81499999999999995},"min":{"1min":0.57099999999999995,"5min":0.443,"15min":0.443},"max":{"1min":1.3149999999999999,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.82799999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.81699999999999995,"15min":0.82399999999999995},"min":{"1min":0.60499999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.5029999999999999,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.754},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.82399999999999995,"15min":0.82499999999999996},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.81000000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:25:07 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.81699999999999995,"15min":0.83699999999999997},"min":{"1min":0.58399999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.4750000000000001,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81899999999999995,"15min":0.82699999999999996},"min":{"1min":0.63500000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.377,"5min":1.377,"15min":1.377},"last":0.84599999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31832,"kb_used_data":708,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94340008,"statfs":{"total":96636764160,"available":96604168192,"internally_reserved":0,"allocated":724992,"data_stored":301157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.46999999999999997,"15min":0.48599999999999999},"min":{"1min":0.255,"5min":0.251,"15min":0.251},"max":{"1min":0.53800000000000003,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.61099999999999999,"15min":0.66100000000000003},"min":{"1min":0.27000000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.745,"5min":4.157,"15min":4.157},"last":0.51900000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.61099999999999999,"15min":0.67700000000000005},"min":{"1min":0.32900000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.60799999999999998,"5min":4.282,"15min":4.282},"last":0.499},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.58599999999999997,"15min":0.61299999999999999},"min":{"1min":0.37,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.63300000000000001,"5min":1.625,"15min":1.625},"last":0.54000000000000004}]},{"osd":3,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.60299999999999998,"15min":0.61599999999999999},"min":{"1min":0.441,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.94399999999999995,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.81899999999999995,"15min":0.94099999999999995},"min":{"1min":0.42999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.749,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.48599999999999999}]},{"osd":4,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.91300000000000003,"15min":0.98899999999999999},"min":{"1min":0.52900000000000003,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.105,"5min":4.7400000000000002,"15min":4.7400000000000002},"last":0.997},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.81399999999999995,"15min":0.83599999999999997},"min":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.996,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.81799999999999995}]},{"osd":5,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.91100000000000003,"15min":0.96599999999999997},"min":{"1min":0.53500000000000003,"5min":0.497,"15min":0.497},"max":{"1min":1.0620000000000001,"5min":4.5759999999999996,"15min":4.5759999999999996},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.91100000000000003,"15min":0.97199999999999998},"min":{"1min":0.59399999999999997,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.1539999999999999,"5min":4.7949999999999999,"15min":4.7949999999999999},"last":0.83399999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.94399999999999995,"15min":1.02},"min":{"1min":0.47799999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.006,"5min":4.6890000000000001,"15min":4.6890000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.92700000000000005,"15min":0.995},"min":{"1min":0.57599999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0720000000000001,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.95199999999999996}]},{"osd":7,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.82199999999999995,"15min":0.84399999999999997},"min":{"1min":0.60099999999999998,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.137,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.92300000000000004},{"interface":"front","average":{"1min":0.77600000000000002,"5min":0.93799999999999994,"15min":0.996},"min":{"1min":0.57999999999999996,"5min":0.5,"15min":0.5},"max":{"1min":1.024,"5min":4.6420000000000003,"15min":4.6420000000000003},"last":0.94299999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1331200,"data_stored":893581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42699999999999999,"5min":0.46200000000000002,"15min":0.47899999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.53900000000000003,"5min":1.48,"15min":1.48},"last":0.435},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.50700000000000001,"15min":0.51000000000000001},"min":{"1min":0.39900000000000002,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.65500000000000003,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.46400000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51900000000000002,"15min":0.52800000000000002},"min":{"1min":0.34399999999999997,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72699999999999998,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.52700000000000002,"15min":0.52100000000000002},"min":{"1min":0.39400000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.502}]},{"osd":3,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.46800000000000003,"15min":0.46999999999999997},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.60499999999999998,"15min":0.626},"min":{"1min":0.435,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.75900000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.48499999999999999}]},{"osd":4,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.72699999999999998,"15min":0.72899999999999998},"min":{"1min":0.54200000000000004,"5min":0.504,"15min":0.504},"max":{"1min":0.91900000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.58699999999999997,"5min":0.501,"15min":0.501},"max":{"1min":1.0369999999999999,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.748}]},{"osd":5,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77900000000000003,"15min":0.79500000000000004},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.91300000000000003,"5min":1.371,"15min":1.371},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75700000000000001,"15min":0.76300000000000001},"min":{"1min":0.57599999999999996,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":0.98699999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.80700000000000005}]},{"osd":6,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.79000000000000004,"15min":0.80200000000000005},"min":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.087,"5min":1.177,"15min":1.177},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.82099999999999995,"15min":0.84499999999999997},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.0329999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.84399999999999997}]},{"osd":7,"last update":"Tue Apr 2 07:25:12 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.78400000000000003,"15min":0.79800000000000004},"min":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.016,"5min":1.135,"15min":1.135},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.58699999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.046,"5min":1.141,"15min":1.141},"last":0.86399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:25:22.866 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-02T07:25:22.867 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-02T07:25:23.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.049+0000 7f7b51e00640 1 Processor -- start 2024-04-02T07:25:23.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.049+0000 7f7b51e00640 1 -- start start 2024-04-02T07:25:23.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.049+0000 7f7b51e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7b4c0ccf10 0x7f7b4c0cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:23.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.049+0000 7f7b51e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7b4c15cd70 0x7f7b4c0cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:23.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.049+0000 7f7b51e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b4c06ebc0 con 0x7f7b4c0afba0 2024-04-02T07:25:23.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.049+0000 7f7b51e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b4c0cd830 con 0x7f7b4c0ccf10 2024-04-02T07:25:23.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.049+0000 7f7b51e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c0cfd00 con 0x7f7b4c15cd70 2024-04-02T07:25:23.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.049+0000 7f7b4aa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7b4c0ccf10 0x7f7b4c0cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:23.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.049+0000 7f7b4aa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7b4c0ccf10 0x7f7b4c0cd2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41428/0 (socket says 172.21.15.55:41428) 2024-04-02T07:25:23.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.049+0000 7f7b4aa00640 1 -- 172.21.15.55:0/887648511 learned_addr learned my addr 172.21.15.55:0/887648511 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:23.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.049+0000 7f7b43e00640 1 --2- 172.21.15.55:0/887648511 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7b4c15cd70 0x7f7b4c0cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:23.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.049+0000 7f7b4aa00640 1 -- 172.21.15.55:0/887648511 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7b4c15cd70 msgr2=0x7f7b4c0cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:23.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.049+0000 7f7b4aa00640 1 --2- 172.21.15.55:0/887648511 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7b4c15cd70 0x7f7b4c0cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:23.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.049+0000 7f7b4aa00640 1 -- 172.21.15.55:0/887648511 >> v1:172.21.15.106:6789/0 conn(0x7f7b4c0afba0 legacy=0x7f7b4c06f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:23.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.049+0000 7f7b4aa00640 1 -- 172.21.15.55:0/887648511 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b4c06e290 con 0x7f7b4c0ccf10 2024-04-02T07:25:23.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.053+0000 7f7b4aa00640 1 --2- 172.21.15.55:0/887648511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b4c0ccf10 0x7f7b4c0cd2f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009870 tx=0x7f7b3c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87caf74c1d39b6cd server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:23.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.053+0000 7f7b4a000640 1 -- 172.21.15.55:0/887648511 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c0a95f0 con 0x7f7b4c0ccf10 2024-04-02T07:25:23.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.053+0000 7f7b4a000640 1 -- 172.21.15.55:0/887648511 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c0a9750 con 0x7f7b4c0ccf10 2024-04-02T07:25:23.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.053+0000 7f7b4a000640 1 -- 172.21.15.55:0/887648511 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c0a9ae0 con 0x7f7b4c0ccf10 2024-04-02T07:25:23.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.053+0000 7f7b51e00640 1 -- 172.21.15.55:0/887648511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b4c0ccf10 msgr2=0x7f7b4c0cd2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:23.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.053+0000 7f7b51e00640 1 --2- 172.21.15.55:0/887648511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b4c0ccf10 0x7f7b4c0cd2f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c009870 tx=0x7f7b3c01c530 comp rx=0 tx=0).stop 2024-04-02T07:25:23.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.053+0000 7f7b51e00640 1 -- 172.21.15.55:0/887648511 shutdown_connections 2024-04-02T07:25:23.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.053+0000 7f7b51e00640 1 --2- 172.21.15.55:0/887648511 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7b4c15cd70 0x7f7b4c0cf4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:23.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.053+0000 7f7b51e00640 1 --2- 172.21.15.55:0/887648511 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b4c0ccf10 0x7f7b4c0cd2f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:23.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.053+0000 7f7b51e00640 1 -- 172.21.15.55:0/887648511 >> 172.21.15.55:0/887648511 conn(0x7f7b4c0d0690 msgr2=0x7f7b4c0d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:23.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.053+0000 7f7b51e00640 1 -- 172.21.15.55:0/887648511 shutdown_connections 2024-04-02T07:25:23.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.053+0000 7f7b51e00640 1 -- 172.21.15.55:0/887648511 wait complete. 2024-04-02T07:25:23.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b51e00640 1 Processor -- start 2024-04-02T07:25:23.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b51e00640 1 -- start start 2024-04-02T07:25:23.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b51e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b4c0afba0 0x7f7b4c150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:23.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b51e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b4c0ccf10 0x7f7b4c14f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:23.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b51e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7b4c15cd70 0x7f7b4c15f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:23.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b51e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c0c9a70 con 0x7f7b4c0afba0 2024-04-02T07:25:23.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b51e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c150950 con 0x7f7b4c0ccf10 2024-04-02T07:25:23.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b51e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4c151320 con 0x7f7b4c15cd70 2024-04-02T07:25:23.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b4aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b4c0afba0 0x7f7b4c150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:23.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b4aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b4c0afba0 0x7f7b4c150de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41444/0 (socket says 172.21.15.55:41444) 2024-04-02T07:25:23.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b4aa00640 1 -- 172.21.15.55:0/1752382445 learned_addr learned my addr 172.21.15.55:0/1752382445 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:23.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b43e00640 1 --2- 172.21.15.55:0/1752382445 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b4c0ccf10 0x7f7b4c14f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:23.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b4b400640 1 --2- 172.21.15.55:0/1752382445 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7b4c15cd70 0x7f7b4c15f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:23.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b4aa00640 1 -- 172.21.15.55:0/1752382445 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7b4c15cd70 msgr2=0x7f7b4c15f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:23.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b4aa00640 1 --2- 172.21.15.55:0/1752382445 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7b4c15cd70 0x7f7b4c15f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:23.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b4aa00640 1 -- 172.21.15.55:0/1752382445 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b4c0ccf10 msgr2=0x7f7b4c14f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:23.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b4aa00640 1 --2- 172.21.15.55:0/1752382445 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b4c0ccf10 0x7f7b4c14f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:23.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b4aa00640 1 -- 172.21.15.55:0/1752382445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b3c0094d0 con 0x7f7b4c0afba0 2024-04-02T07:25:23.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b43e00640 1 --2- 172.21.15.55:0/1752382445 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b4c0ccf10 0x7f7b4c14f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:23.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b4aa00640 1 --2- 172.21.15.55:0/1752382445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b4c0afba0 0x7f7b4c150de0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c01abe0 tx=0x7f7b3c0192d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:23.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b43400640 1 -- 172.21.15.55:0/1752382445 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c0a95f0 con 0x7f7b4c0afba0 2024-04-02T07:25:23.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b43400640 1 -- 172.21.15.55:0/1752382445 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b3c0b1800 con 0x7f7b4c0afba0 2024-04-02T07:25:23.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b43400640 1 -- 172.21.15.55:0/1752382445 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3c0b1bb0 con 0x7f7b4c0afba0 2024-04-02T07:25:23.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b51e00640 1 -- 172.21.15.55:0/1752382445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4c150020 con 0x7f7b4c0afba0 2024-04-02T07:25:23.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.057+0000 7f7b51e00640 1 -- 172.21.15.55:0/1752382445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4c1505e0 con 0x7f7b4c0afba0 2024-04-02T07:25:23.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.061+0000 7f7b51e00640 1 -- 172.21.15.55:0/1752382445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4c066c90 con 0x7f7b4c0afba0 2024-04-02T07:25:23.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.061+0000 7f7b43400640 1 -- 172.21.15.55:0/1752382445 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7b3c0b1d10 con 0x7f7b4c0afba0 2024-04-02T07:25:23.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.061+0000 7f7b43400640 1 --2- 172.21.15.55:0/1752382445 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b28066690 0x7f7b28068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:23.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.061+0000 7f7b43400640 1 -- 172.21.15.55:0/1752382445 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b3c11e840 con 0x7f7b4c0afba0 2024-04-02T07:25:23.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.061+0000 7f7b43e00640 1 --2- 172.21.15.55:0/1752382445 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b28066690 0x7f7b28068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:23.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.061+0000 7f7b43e00640 1 --2- 172.21.15.55:0/1752382445 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b28066690 0x7f7b28068b50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0d0ae0 tx=0x7f7b34008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:23.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.065+0000 7f7b43400640 1 -- 172.21.15.55:0/1752382445 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7b3c0ebba0 con 0x7f7b4c0afba0 2024-04-02T07:25:23.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.281+0000 7f7b51e00640 1 -- 172.21.15.55:0/1752382445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7b4c0d13e0 con 0x7f7b4c0afba0 2024-04-02T07:25:23.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.289+0000 7f7b43400640 1 -- 172.21.15.55:0/1752382445 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7b3c0ef1c0 con 0x7f7b4c0afba0 2024-04-02T07:25:23.295 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2024-04-02T07:25:23.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.293+0000 7f7b51e00640 1 -- 172.21.15.55:0/1752382445 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b28066690 msgr2=0x7f7b28068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:23.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.293+0000 7f7b51e00640 1 --2- 172.21.15.55:0/1752382445 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b28066690 0x7f7b28068b50 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f7b4c0d0ae0 tx=0x7f7b34008040 comp rx=0 tx=0).stop 2024-04-02T07:25:23.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.293+0000 7f7b51e00640 1 -- 172.21.15.55:0/1752382445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b4c0afba0 msgr2=0x7f7b4c150de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:23.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.293+0000 7f7b51e00640 1 --2- 172.21.15.55:0/1752382445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b4c0afba0 0x7f7b4c150de0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f7b3c01abe0 tx=0x7f7b3c0192d0 comp rx=0 tx=0).stop 2024-04-02T07:25:23.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.293+0000 7f7b51e00640 1 -- 172.21.15.55:0/1752382445 shutdown_connections 2024-04-02T07:25:23.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.293+0000 7f7b51e00640 1 --2- 172.21.15.55:0/1752382445 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7b4c15cd70 0x7f7b4c15f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:23.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.293+0000 7f7b51e00640 1 --2- 172.21.15.55:0/1752382445 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b28066690 0x7f7b28068b50 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:23.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.293+0000 7f7b51e00640 1 --2- 172.21.15.55:0/1752382445 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7b4c0ccf10 0x7f7b4c14f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:23.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.293+0000 7f7b51e00640 1 --2- 172.21.15.55:0/1752382445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7b4c0afba0 0x7f7b4c150de0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:23.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.293+0000 7f7b51e00640 1 -- 172.21.15.55:0/1752382445 >> 172.21.15.55:0/1752382445 conn(0x7f7b4c0d0690 msgr2=0x7f7b4c0ad2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:23.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.293+0000 7f7b51e00640 1 -- 172.21.15.55:0/1752382445 shutdown_connections 2024-04-02T07:25:23.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.293+0000 7f7b51e00640 1 -- 172.21.15.55:0/1752382445 wait complete. 2024-04-02T07:25:23.316 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:25:23.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.453+0000 7fc879a00640 1 Processor -- start 2024-04-02T07:25:23.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.453+0000 7fc879a00640 1 -- start start 2024-04-02T07:25:23.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.453+0000 7fc879a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc87415cad0 0x7fc8740b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:23.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.453+0000 7fc879a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc87406a4a0 0x7fc8740cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:23.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.453+0000 7fc879a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8740b26b0 con 0x7fc87406ec10 2024-04-02T07:25:23.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.453+0000 7fc879a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc87415ceb0 con 0x7fc87406a4a0 2024-04-02T07:25:23.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.453+0000 7fc879a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87406f1d0 con 0x7fc87415cad0 2024-04-02T07:25:23.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.453+0000 7fc873400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc87406a4a0 0x7fc8740cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:23.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.453+0000 7fc872a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc87415cad0 0x7fc8740b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:23.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.453+0000 7fc872a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc87415cad0 0x7fc8740b43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:57238/0 (socket says 172.21.15.55:57238) 2024-04-02T07:25:23.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.453+0000 7fc872a00640 1 -- 172.21.15.55:0/912300442 learned_addr learned my addr 172.21.15.55:0/912300442 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:23.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.453+0000 7fc872a00640 1 -- 172.21.15.55:0/912300442 >> v2:172.21.15.106:3300/0 conn(0x7fc87406a4a0 msgr2=0x7fc8740cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:23.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.453+0000 7fc872a00640 1 --2- 172.21.15.55:0/912300442 >> v2:172.21.15.106:3300/0 conn(0x7fc87406a4a0 0x7fc8740cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:23.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.453+0000 7fc872a00640 1 -- 172.21.15.55:0/912300442 >> v1:172.21.15.106:6789/0 conn(0x7fc87406ec10 legacy=0x7fc874069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:23.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.453+0000 7fc872a00640 1 -- 172.21.15.55:0/912300442 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8740cd640 con 0x7fc87415cad0 2024-04-02T07:25:23.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.453+0000 7fc872000640 1 -- 172.21.15.55:0/912300442 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601340197 0 0) 0x7fc8740b26b0 con 0x7fc87406ec10 2024-04-02T07:25:23.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.453+0000 7fc873400640 1 --2- 172.21.15.55:0/912300442 >> v2:172.21.15.106:3300/0 conn(0x7fc87406a4a0 0x7fc8740cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:25:23.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.457+0000 7fc872a00640 1 --2- 172.21.15.55:0/912300442 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc87415cad0 0x7fc8740b43d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc864009870 tx=0x7fc86401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d915a942d5ff579 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:23.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.457+0000 7fc872000640 1 -- 172.21.15.55:0/912300442 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8640a6040 con 0x7fc87415cad0 2024-04-02T07:25:23.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.457+0000 7fc872000640 1 -- 172.21.15.55:0/912300442 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8640aa600 con 0x7fc87415cad0 2024-04-02T07:25:23.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.457+0000 7fc872000640 1 -- 172.21.15.55:0/912300442 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8640aa990 con 0x7fc87415cad0 2024-04-02T07:25:23.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.457+0000 7fc879a00640 1 -- 172.21.15.55:0/912300442 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc87415cad0 msgr2=0x7fc8740b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:23.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.457+0000 7fc879a00640 1 --2- 172.21.15.55:0/912300442 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc87415cad0 0x7fc8740b43d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc864009870 tx=0x7fc86401c4a0 comp rx=0 tx=0).stop 2024-04-02T07:25:23.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.457+0000 7fc879a00640 1 -- 172.21.15.55:0/912300442 shutdown_connections 2024-04-02T07:25:23.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.457+0000 7fc879a00640 1 --2- 172.21.15.55:0/912300442 >> v2:172.21.15.106:3300/0 conn(0x7fc87406a4a0 0x7fc8740cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:23.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.457+0000 7fc879a00640 1 --2- 172.21.15.55:0/912300442 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc87415cad0 0x7fc8740b43d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:23.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.457+0000 7fc879a00640 1 -- 172.21.15.55:0/912300442 >> 172.21.15.55:0/912300442 conn(0x7fc8740b13b0 msgr2=0x7fc8740b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:23.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.457+0000 7fc879a00640 1 -- 172.21.15.55:0/912300442 shutdown_connections 2024-04-02T07:25:23.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.457+0000 7fc879a00640 1 -- 172.21.15.55:0/912300442 wait complete. 2024-04-02T07:25:23.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc879a00640 1 Processor -- start 2024-04-02T07:25:23.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc879a00640 1 -- start start 2024-04-02T07:25:23.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc879a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc87406a4a0 0x7fc8741623d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:23.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc879a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc87406ec10 0x7fc874149070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:23.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc879a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc87415cad0 0x7fc874158b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:23.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc879a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8741495b0 con 0x7fc87406a4a0 2024-04-02T07:25:23.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc879a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc874164680 con 0x7fc87415cad0 2024-04-02T07:25:23.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc879a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc874159060 con 0x7fc87406ec10 2024-04-02T07:25:23.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc872a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc87406a4a0 0x7fc8741623d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:23.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc872a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc87406a4a0 0x7fc8741623d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41454/0 (socket says 172.21.15.55:41454) 2024-04-02T07:25:23.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc872a00640 1 -- 172.21.15.55:0/224246006 learned_addr learned my addr 172.21.15.55:0/224246006 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:23.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc873400640 1 --2- 172.21.15.55:0/224246006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc87415cad0 0x7fc874158b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:23.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc86a000640 1 --2- 172.21.15.55:0/224246006 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc87406ec10 0x7fc874149070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:23.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc872a00640 1 -- 172.21.15.55:0/224246006 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc87406ec10 msgr2=0x7fc874149070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:23.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc872a00640 1 --2- 172.21.15.55:0/224246006 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc87406ec10 0x7fc874149070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:23.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc872a00640 1 -- 172.21.15.55:0/224246006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc87415cad0 msgr2=0x7fc874158b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:23.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc872a00640 1 --2- 172.21.15.55:0/224246006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc87415cad0 0x7fc874158b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:23.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc872a00640 1 -- 172.21.15.55:0/224246006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc86c009a70 con 0x7fc87406a4a0 2024-04-02T07:25:23.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc872a00640 1 --2- 172.21.15.55:0/224246006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc87406a4a0 0x7fc8741623d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc86401ab50 tx=0x7fc864019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:23.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc86b400640 1 -- 172.21.15.55:0/224246006 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8640b3800 con 0x7fc87406a4a0 2024-04-02T07:25:23.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc86b400640 1 -- 172.21.15.55:0/224246006 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8640b3980 con 0x7fc87406a4a0 2024-04-02T07:25:23.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc879a00640 1 -- 172.21.15.55:0/224246006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8640094d0 con 0x7fc87406a4a0 2024-04-02T07:25:23.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc86b400640 1 -- 172.21.15.55:0/224246006 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8640b3d30 con 0x7fc87406a4a0 2024-04-02T07:25:23.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.461+0000 7fc879a00640 1 -- 172.21.15.55:0/224246006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc874164030 con 0x7fc87406a4a0 2024-04-02T07:25:23.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.465+0000 7fc879a00640 1 -- 172.21.15.55:0/224246006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8740706a0 con 0x7fc87406a4a0 2024-04-02T07:25:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.465+0000 7fc86b400640 1 -- 172.21.15.55:0/224246006 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc8640c6440 con 0x7fc87406a4a0 2024-04-02T07:25:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.465+0000 7fc86b400640 1 --2- 172.21.15.55:0/224246006 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc850066690 0x7fc850068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:23.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.465+0000 7fc86b400640 1 -- 172.21.15.55:0/224246006 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc86411eb90 con 0x7fc87406a4a0 2024-04-02T07:25:23.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.465+0000 7fc86a000640 1 --2- 172.21.15.55:0/224246006 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc850066690 0x7fc850068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:23.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.465+0000 7fc86a000640 1 --2- 172.21.15.55:0/224246006 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc850066690 0x7fc850068b50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc8741f7f30 tx=0x7fc85c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:23.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.469+0000 7fc86b400640 1 -- 172.21.15.55:0/224246006 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc8640ebef0 con 0x7fc87406a4a0 2024-04-02T07:25:23.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.661+0000 7fc879a00640 1 -- 172.21.15.55:0/224246006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc874066c90 con 0x7fc87406a4a0 2024-04-02T07:25:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.665+0000 7fc86b400640 1 -- 172.21.15.55:0/224246006 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4740 (secure 0 0 0) 0x7fc8640ef510 con 0x7fc87406a4a0 2024-04-02T07:25:23.668 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:23.668 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5510,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3429221899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3429221899},{"type":"v1","addr":"172.21.15.55:6835","nonce":3429221899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5513,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/4033456774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4033456774},{"type":"v1","addr":"172.21.15.106:6836","nonce":4033456774}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6129,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2170345840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2170345840},{"type":"v1","addr":"172.21.15.55:6834","nonce":2170345840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:25:13.807869+0000","modified":"2024-04-02T07:25:16.836879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6138":{"gid":6138,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6837/1050953219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1050953219},{"type":"v1","addr":"172.21.15.106:6837","nonce":1050953219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-02T07:25:23.668 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 33 2024-04-02T07:25:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.665+0000 7fc879a00640 1 -- 172.21.15.55:0/224246006 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc850066690 msgr2=0x7fc850068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.665+0000 7fc879a00640 1 --2- 172.21.15.55:0/224246006 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc850066690 0x7fc850068b50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc8741f7f30 tx=0x7fc85c009040 comp rx=0 tx=0).stop 2024-04-02T07:25:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.665+0000 7fc879a00640 1 -- 172.21.15.55:0/224246006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc87406a4a0 msgr2=0x7fc8741623d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.665+0000 7fc879a00640 1 --2- 172.21.15.55:0/224246006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc87406a4a0 0x7fc8741623d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fc86401ab50 tx=0x7fc864019240 comp rx=0 tx=0).stop 2024-04-02T07:25:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.665+0000 7fc879a00640 1 -- 172.21.15.55:0/224246006 shutdown_connections 2024-04-02T07:25:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.665+0000 7fc879a00640 1 --2- 172.21.15.55:0/224246006 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc850066690 0x7fc850068b50 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.665+0000 7fc879a00640 1 --2- 172.21.15.55:0/224246006 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc87415cad0 0x7fc874158b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.665+0000 7fc879a00640 1 --2- 172.21.15.55:0/224246006 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc87406ec10 0x7fc874149070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:23.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.665+0000 7fc879a00640 1 --2- 172.21.15.55:0/224246006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc87406a4a0 0x7fc8741623d0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.665+0000 7fc879a00640 1 -- 172.21.15.55:0/224246006 >> 172.21.15.55:0/224246006 conn(0x7fc8740b13b0 msgr2=0x7fc8740b40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.665+0000 7fc879a00640 1 -- 172.21.15.55:0/224246006 shutdown_connections 2024-04-02T07:25:23.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:23.665+0000 7fc879a00640 1 -- 172.21.15.55:0/224246006 wait complete. 2024-04-02T07:25:24.093 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 33, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:25:13.807869+0000', 'modified': '2024-04-02T07:25:16.836879+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6138}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6138': {'gid': 6138, 'name': 'd', 'rank': 0, 'incarnation': 29, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.106:6837/1050953219', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6835', 'nonce': 1050953219}, {'type': 'v1', 'addr': '172.21.15.106:6837', 'nonce': 1050953219}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:25:24.093 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-02T07:25:24.093 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-02T07:25:24.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.233+0000 7fa98a600640 1 Processor -- start 2024-04-02T07:25:24.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.233+0000 7fa98a600640 1 -- start start 2024-04-02T07:25:24.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.233+0000 7fa98a600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9841599c0 0x7fa9840b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.233+0000 7fa98a600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9840b1d60 con 0x7fa98406d1c0 2024-04-02T07:25:24.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.233+0000 7fa98a600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98406c400 con 0x7fa9840b38f0 2024-04-02T07:25:24.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.233+0000 7fa98a600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98406cda0 con 0x7fa9841599c0 2024-04-02T07:25:24.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.233+0000 7fa97aa00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa98406d1c0 0x7fa9840b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47418/0 (socket says 172.21.15.55:47418) 2024-04-02T07:25:24.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.233+0000 7fa97aa00640 1 -- 172.21.15.55:0/2419322286 learned_addr learned my addr 172.21.15.55:0/2419322286 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:24.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.233+0000 7fa983400640 1 --2- 172.21.15.55:0/2419322286 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9841599c0 0x7fa9840b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.233+0000 7fa982a00640 1 -- 172.21.15.55:0/2419322286 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4260820911 0 0) 0x7fa9840b1d60 con 0x7fa98406d1c0 2024-04-02T07:25:24.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.237+0000 7fa982a00640 1 -- 172.21.15.55:0/2419322286 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa968003530 con 0x7fa98406d1c0 2024-04-02T07:25:24.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.237+0000 7fa982a00640 1 -- 172.21.15.55:0/2419322286 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105797750 0 0) 0x7fa98406c400 con 0x7fa9840b38f0 2024-04-02T07:25:24.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.237+0000 7fa982a00640 1 -- 172.21.15.55:0/2419322286 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9840b1d60 con 0x7fa9840b38f0 2024-04-02T07:25:24.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.237+0000 7fa983400640 1 -- 172.21.15.55:0/2419322286 >> v1:172.21.15.106:6789/0 conn(0x7fa9840b38f0 legacy=0x7fa9840c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:24.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.237+0000 7fa983400640 1 -- 172.21.15.55:0/2419322286 >> v1:172.21.15.55:6789/0 conn(0x7fa98406d1c0 legacy=0x7fa9840b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:24.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.237+0000 7fa983400640 1 -- 172.21.15.55:0/2419322286 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98406c6e0 con 0x7fa9841599c0 2024-04-02T07:25:24.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.237+0000 7fa983400640 1 --2- 172.21.15.55:0/2419322286 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9841599c0 0x7fa9840b1780 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa9740097f0 tx=0x7fa97401c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b3c792c71a7cd server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:24.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.237+0000 7fa982a00640 1 -- 172.21.15.55:0/2419322286 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9740ad660 con 0x7fa9841599c0 2024-04-02T07:25:24.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.237+0000 7fa982a00640 1 -- 172.21.15.55:0/2419322286 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9740ad7c0 con 0x7fa9841599c0 2024-04-02T07:25:24.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.237+0000 7fa982a00640 1 -- 172.21.15.55:0/2419322286 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9740adb50 con 0x7fa9841599c0 2024-04-02T07:25:24.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa98a600640 1 -- 172.21.15.55:0/2419322286 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9841599c0 msgr2=0x7fa9840b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:24.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa98a600640 1 --2- 172.21.15.55:0/2419322286 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9841599c0 0x7fa9840b1780 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa9740097f0 tx=0x7fa97401c450 comp rx=0 tx=0).stop 2024-04-02T07:25:24.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa98a600640 1 -- 172.21.15.55:0/2419322286 shutdown_connections 2024-04-02T07:25:24.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa98a600640 1 --2- 172.21.15.55:0/2419322286 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9841599c0 0x7fa9840b1780 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa98a600640 1 -- 172.21.15.55:0/2419322286 >> 172.21.15.55:0/2419322286 conn(0x7fa984069d90 msgr2=0x7fa98406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:24.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa98a600640 1 -- 172.21.15.55:0/2419322286 shutdown_connections 2024-04-02T07:25:24.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa98a600640 1 -- 172.21.15.55:0/2419322286 wait complete. 2024-04-02T07:25:24.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa98a600640 1 Processor -- start 2024-04-02T07:25:24.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa98a600640 1 -- start start 2024-04-02T07:25:24.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa98a600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98406d1c0 0x7fa98414dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa98a600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9840b38f0 0x7fa984152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa98a600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9841599c0 0x7fa984153a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa98a600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa984153600 con 0x7fa9841599c0 2024-04-02T07:25:24.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa98a600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa984152750 con 0x7fa98406d1c0 2024-04-02T07:25:24.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa98a600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa984152980 con 0x7fa9840b38f0 2024-04-02T07:25:24.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa983e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9841599c0 0x7fa984153a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa983e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9841599c0 0x7fa984153a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41466/0 (socket says 172.21.15.55:41466) 2024-04-02T07:25:24.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa983e00640 1 -- 172.21.15.55:0/1850002093 learned_addr learned my addr 172.21.15.55:0/1850002093 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:24.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa983400640 1 --2- 172.21.15.55:0/1850002093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98406d1c0 0x7fa98414dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa97aa00640 1 --2- 172.21.15.55:0/1850002093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9840b38f0 0x7fa984152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa983e00640 1 -- 172.21.15.55:0/1850002093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9840b38f0 msgr2=0x7fa984152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:24.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa983e00640 1 --2- 172.21.15.55:0/1850002093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9840b38f0 0x7fa984152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa983e00640 1 -- 172.21.15.55:0/1850002093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98406d1c0 msgr2=0x7fa98414dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:24.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa983e00640 1 --2- 172.21.15.55:0/1850002093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98406d1c0 0x7fa98414dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa983e00640 1 -- 172.21.15.55:0/1850002093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa974009420 con 0x7fa9841599c0 2024-04-02T07:25:24.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa97aa00640 1 --2- 172.21.15.55:0/1850002093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9840b38f0 0x7fa984152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:24.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.241+0000 7fa983e00640 1 --2- 172.21.15.55:0/1850002093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9841599c0 0x7fa984153a20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00c790 tx=0x7fa97c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:24.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.245+0000 7fa97be00640 1 -- 172.21.15.55:0/1850002093 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c00cea0 con 0x7fa9841599c0 2024-04-02T07:25:24.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.245+0000 7fa97be00640 1 -- 172.21.15.55:0/1850002093 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c003b80 con 0x7fa9841599c0 2024-04-02T07:25:24.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.245+0000 7fa98a600640 1 -- 172.21.15.55:0/1850002093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa984152c60 con 0x7fa9841599c0 2024-04-02T07:25:24.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.245+0000 7fa97be00640 1 -- 172.21.15.55:0/1850002093 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c00a850 con 0x7fa9841599c0 2024-04-02T07:25:24.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.245+0000 7fa98a600640 1 -- 172.21.15.55:0/1850002093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa984153220 con 0x7fa9841599c0 2024-04-02T07:25:24.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.245+0000 7fa97be00640 1 -- 172.21.15.55:0/1850002093 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa97c00a9b0 con 0x7fa9841599c0 2024-04-02T07:25:24.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.245+0000 7fa97be00640 1 --2- 172.21.15.55:0/1850002093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa960066690 0x7fa960068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.245+0000 7fa97be00640 1 -- 172.21.15.55:0/1850002093 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa97c0840e0 con 0x7fa9841599c0 2024-04-02T07:25:24.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.245+0000 7fa983400640 1 --2- 172.21.15.55:0/1850002093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa960066690 0x7fa960068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.245+0000 7fa98dab0000 1 Processor -- start 2024-04-02T07:25:24.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.245+0000 7fa98dab0000 1 -- start start 2024-04-02T07:25:24.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa983400640 1 --2- 172.21.15.55:0/1850002093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa960066690 0x7fa960068b50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa9740af000 tx=0x7fa9740a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:24.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa98dab0000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b386dd5c0 0x564b386dd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa98dab0000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 0x564b3868af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa98dab0000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b3868b4c0 0x564b3868b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa98dab0000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b385535a0 con 0x564b386dd5c0 2024-04-02T07:25:24.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa98dab0000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b384e0af0 con 0x564b386ddee0 2024-04-02T07:25:24.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa98dab0000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b384de0c0 con 0x564b3868b4c0 2024-04-02T07:25:24.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa983400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b386dd5c0 0x564b386dd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa983400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b386dd5c0 0x564b386dd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41476/0 (socket says 172.21.15.55:41476) 2024-04-02T07:25:24.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa983400640 1 -- 172.21.15.55:0/2114259297 learned_addr learned my addr 172.21.15.55:0/2114259297 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:24.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa983e00640 1 --2- 172.21.15.55:0/2114259297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b3868b4c0 0x564b3868b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa97aa00640 1 --2- 172.21.15.55:0/2114259297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 0x564b3868af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa983400640 1 -- 172.21.15.55:0/2114259297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b3868b4c0 msgr2=0x564b3868b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:24.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa983400640 1 --2- 172.21.15.55:0/2114259297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b3868b4c0 0x564b3868b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa983400640 1 -- 172.21.15.55:0/2114259297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 msgr2=0x564b3868af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:24.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa983400640 1 --2- 172.21.15.55:0/2114259297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 0x564b3868af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa983400640 1 -- 172.21.15.55:0/2114259297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b381d5890 con 0x564b386dd5c0 2024-04-02T07:25:24.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa983400640 1 --2- 172.21.15.55:0/2114259297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b386dd5c0 0x564b386dd9a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa9740b0040 tx=0x7fa974004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3dd010d956efc16 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:24.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa973e00640 1 -- 172.21.15.55:0/2114259297 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9740b7640 con 0x564b386dd5c0 2024-04-02T07:25:24.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa973e00640 1 -- 172.21.15.55:0/2114259297 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9740c7070 con 0x564b386dd5c0 2024-04-02T07:25:24.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa973e00640 1 -- 172.21.15.55:0/2114259297 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9740b79a0 con 0x564b386dd5c0 2024-04-02T07:25:24.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa98dab0000 1 -- 172.21.15.55:0/2114259297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b386dd5c0 msgr2=0x564b386dd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:24.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa98dab0000 1 --2- 172.21.15.55:0/2114259297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b386dd5c0 0x564b386dd9a0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa9740b0040 tx=0x7fa974004740 comp rx=0 tx=0).stop 2024-04-02T07:25:24.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa98dab0000 1 -- 172.21.15.55:0/2114259297 shutdown_connections 2024-04-02T07:25:24.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa98dab0000 1 --2- 172.21.15.55:0/2114259297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b3868b4c0 0x564b3868b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa98dab0000 1 --2- 172.21.15.55:0/2114259297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 0x564b3868af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa98dab0000 1 --2- 172.21.15.55:0/2114259297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b386dd5c0 0x564b386dd9a0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa98dab0000 1 -- 172.21.15.55:0/2114259297 >> 172.21.15.55:0/2114259297 conn(0x564b38691830 msgr2=0x564b38689860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:24.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa98dab0000 1 -- 172.21.15.55:0/2114259297 shutdown_connections 2024-04-02T07:25:24.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa98dab0000 1 -- 172.21.15.55:0/2114259297 wait complete. 2024-04-02T07:25:24.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa98dab0000 1 -- start start 2024-04-02T07:25:24.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.249+0000 7fa98dab0000 1 Processor -- start 2024-04-02T07:25:24.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa98dab0000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 0x564b386dce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa98dab0000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b386dd5c0 0x564b3868f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa98dab0000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 0x564b3868f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa98dab0000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b384d99b0 con 0x564b3868b4c0 2024-04-02T07:25:24.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa98dab0000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b38478c00 con 0x564b386ddee0 2024-04-02T07:25:24.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa98dab0000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b38497070 con 0x564b386dd5c0 2024-04-02T07:25:24.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa98dab0000 10 client.0 _ll_register_callbacks cb 0x564b386770e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:25:24.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa983400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 0x564b386dce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa983400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 0x564b386dce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41490/0 (socket says 172.21.15.55:41490) 2024-04-02T07:25:24.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa983400640 1 -- 172.21.15.55:0/4017741 learned_addr learned my addr 172.21.15.55:0/4017741 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:24.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa983e00640 1 --2- 172.21.15.55:0/4017741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 0x564b3868f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa97aa00640 1 --2- 172.21.15.55:0/4017741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b386dd5c0 0x564b3868f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa983400640 1 -- 172.21.15.55:0/4017741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b386dd5c0 msgr2=0x564b3868f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:24.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa983400640 1 --2- 172.21.15.55:0/4017741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b386dd5c0 0x564b3868f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa983400640 1 -- 172.21.15.55:0/4017741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 msgr2=0x564b3868f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:24.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa983400640 1 --2- 172.21.15.55:0/4017741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 0x564b3868f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa983400640 1 -- 172.21.15.55:0/4017741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9740bd070 con 0x564b3868b4c0 2024-04-02T07:25:24.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa983400640 1 --2- 172.21.15.55:0/4017741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 0x564b386dce20 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa97401c930 tx=0x7fa97401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a128101615e6183 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:24.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa970c00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:25:24.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa970c00640 1 -- 172.21.15.55:0/4017741 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974004200 con 0x564b3868b4c0 2024-04-02T07:25:24.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa970c00640 1 -- 172.21.15.55:0/4017741 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa974004360 con 0x564b3868b4c0 2024-04-02T07:25:24.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa98dab0000 1 -- 172.21.15.55:0/4017741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b384965f0 con 0x564b3868b4c0 2024-04-02T07:25:24.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa970c00640 1 -- 172.21.15.55:0/4017741 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa974004520 con 0x564b3868b4c0 2024-04-02T07:25:24.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa98dab0000 10 client.6306 fetch_fsmap learned FSMap version 33 2024-04-02T07:25:24.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa98dab0000 1 -- 172.21.15.55:0/4017741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x564b3849eab0 con 0x564b3868b4c0 2024-04-02T07:25:24.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa970c00640 1 -- 172.21.15.55:0/4017741 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564b384965f0 con 0x564b3868b4c0 2024-04-02T07:25:24.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa970c00640 1 -- 172.21.15.55:0/4017741 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 33) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fa974003620 con 0x564b3868b4c0 2024-04-02T07:25:24.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa98dab0000 10 client.6306 fetch_fsmap finished waiting for FSMap version 33 2024-04-02T07:25:24.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa98dab0000 10 client.6306 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-02T07:25:24.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa98dab0000 20 client.6306 populate_metadata read hostname 'smithi055' 2024-04-02T07:25:24.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa98dab0000 1 --2- 172.21.15.55:0/4017741 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x564b38690180 0x564b38690560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa98dab0000 4 client.6306 mds_command: new command op to 6138 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:25:24.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa98dab0000 1 -- 172.21.15.55:0/4017741 --> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b384d6790 con 0x564b38690180 2024-04-02T07:25:24.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa97aa00640 1 --2- 172.21.15.55:0/4017741 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x564b38690180 0x564b38690560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa97aa00640 1 --2- 172.21.15.55:0/4017741 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x564b38690180 0x564b38690560 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1312eb0931bde0d1 server_cookie=3567651ad8a0c4e2 in_seq=0 out_seq=0 2024-04-02T07:25:24.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.253+0000 7fa970c00640 10 client.6306 ms_handle_connect on v2:172.21.15.106:6835/1050953219 2024-04-02T07:25:24.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.257+0000 7fa970c00640 1 -- 172.21.15.55:0/4017741 <== mds.0 v2:172.21.15.106:6835/1050953219 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564b384d6790 con 0x564b38690180 2024-04-02T07:25:24.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.257+0000 7fa970c00640 10 client.6306 handle_command_reply: tid=0 2024-04-02T07:25:24.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.257+0000 7fa98dab0000 1 client.6306 shutdown 2024-04-02T07:25:24.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.257+0000 7fa98dab0000 1 -- 172.21.15.55:0/4017741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 msgr2=0x564b386dce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:24.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.257+0000 7fa98dab0000 1 --2- 172.21.15.55:0/4017741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 0x564b386dce20 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fa97401c930 tx=0x7fa97401ac90 comp rx=0 tx=0).stop 2024-04-02T07:25:24.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.257+0000 7fa98dab0000 1 -- 172.21.15.55:0/4017741 shutdown_connections 2024-04-02T07:25:24.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.257+0000 7fa98dab0000 1 --2- 172.21.15.55:0/4017741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 0x564b3868f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.257+0000 7fa98dab0000 1 --2- 172.21.15.55:0/4017741 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x564b38690180 0x564b38690560 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.257+0000 7fa98dab0000 1 --2- 172.21.15.55:0/4017741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b386dd5c0 0x564b3868f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.257+0000 7fa98dab0000 1 --2- 172.21.15.55:0/4017741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 0x564b386dce20 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.257+0000 7fa970c00640 0 client.6306 ms_handle_reset on v2:172.21.15.106:6835/1050953219 2024-04-02T07:25:24.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.257+0000 7fa98dab0000 1 -- 172.21.15.55:0/4017741 >> 172.21.15.55:0/4017741 conn(0x564b38691830 msgr2=0x564b38689f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:24.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.257+0000 7fa98dab0000 1 -- 172.21.15.55:0/4017741 shutdown_connections 2024-04-02T07:25:24.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.257+0000 7fa98dab0000 1 -- 172.21.15.55:0/4017741 wait complete. 2024-04-02T07:25:24.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.257+0000 7fa98dab0000 20 client.6306 trim_cache size 0 max 16384 2024-04-02T07:25:24.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa98dab0000 1 Processor -- start 2024-04-02T07:25:24.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa98dab0000 1 -- start start 2024-04-02T07:25:24.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa98dab0000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 0x564b386db990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa98dab0000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b386dd5c0 0x564b386dbed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa98dab0000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 0x564b386edb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa98dab0000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b38196940 con 0x564b3868b4c0 2024-04-02T07:25:24.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa98dab0000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b384d71c0 con 0x564b386ddee0 2024-04-02T07:25:24.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa98dab0000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b384d8660 con 0x564b386dd5c0 2024-04-02T07:25:24.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa983400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 0x564b386db990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa983400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 0x564b386db990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41500/0 (socket says 172.21.15.55:41500) 2024-04-02T07:25:24.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa983400640 1 -- 172.21.15.55:0/4185809122 learned_addr learned my addr 172.21.15.55:0/4185809122 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:24.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa983400640 1 -- 172.21.15.55:0/4185809122 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b386dd5c0 msgr2=0x564b386dbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:24.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa983e00640 1 --2- 172.21.15.55:0/4185809122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 0x564b386edb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa97aa00640 1 --2- 172.21.15.55:0/4185809122 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b386dd5c0 0x564b386dbed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa983400640 1 --2- 172.21.15.55:0/4185809122 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b386dd5c0 0x564b386dbed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa983400640 1 -- 172.21.15.55:0/4185809122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 msgr2=0x564b386edb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:24.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa983400640 1 --2- 172.21.15.55:0/4185809122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 0x564b386edb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa983400640 1 -- 172.21.15.55:0/4185809122 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b386ea690 con 0x564b3868b4c0 2024-04-02T07:25:24.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa983e00640 1 --2- 172.21.15.55:0/4185809122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 0x564b386edb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:25:24.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa97aa00640 1 --2- 172.21.15.55:0/4185809122 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b386dd5c0 0x564b386dbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:25:24.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa983400640 1 --2- 172.21.15.55:0/4185809122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 0x564b386db990 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa97401ccf0 tx=0x7fa97400b050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989ec9695ef99d17 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:24.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa978c00640 1 -- 172.21.15.55:0/4185809122 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9740add00 con 0x564b3868b4c0 2024-04-02T07:25:24.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa978c00640 1 -- 172.21.15.55:0/4185809122 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9740c7040 con 0x564b3868b4c0 2024-04-02T07:25:24.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa978c00640 1 -- 172.21.15.55:0/4185809122 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9740ad620 con 0x564b3868b4c0 2024-04-02T07:25:24.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa98dab0000 1 -- 172.21.15.55:0/4185809122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 msgr2=0x564b386db990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:24.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa98dab0000 1 --2- 172.21.15.55:0/4185809122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 0x564b386db990 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fa97401ccf0 tx=0x7fa97400b050 comp rx=0 tx=0).stop 2024-04-02T07:25:24.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa98dab0000 1 -- 172.21.15.55:0/4185809122 shutdown_connections 2024-04-02T07:25:24.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa98dab0000 1 --2- 172.21.15.55:0/4185809122 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 0x564b386edb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa98dab0000 1 --2- 172.21.15.55:0/4185809122 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b386dd5c0 0x564b386dbed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa98dab0000 1 --2- 172.21.15.55:0/4185809122 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 0x564b386db990 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa98dab0000 1 -- 172.21.15.55:0/4185809122 >> 172.21.15.55:0/4185809122 conn(0x564b38691830 msgr2=0x564b386db280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:24.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa98dab0000 1 -- 172.21.15.55:0/4185809122 shutdown_connections 2024-04-02T07:25:24.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa98dab0000 1 -- 172.21.15.55:0/4185809122 wait complete. 2024-04-02T07:25:24.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa98dab0000 1 -- start start 2024-04-02T07:25:24.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.273+0000 7fa98dab0000 1 Processor -- start 2024-04-02T07:25:24.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa98dab0000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 0x564b38733590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa98dab0000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b386dd5c0 0x564b386f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa98dab0000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 0x564b386f1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa98dab0000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b384a0c60 con 0x564b3868b4c0 2024-04-02T07:25:24.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa98dab0000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b38476c10 con 0x564b386ddee0 2024-04-02T07:25:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa98dab0000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b384daf40 con 0x564b386dd5c0 2024-04-02T07:25:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa98dab0000 10 client.0 _ll_register_callbacks cb 0x564b3849e590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:25:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa983400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 0x564b38733590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa983400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 0x564b38733590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41516/0 (socket says 172.21.15.55:41516) 2024-04-02T07:25:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa983400640 1 -- 172.21.15.55:0/2118453734 learned_addr learned my addr 172.21.15.55:0/2118453734 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa983e00640 1 --2- 172.21.15.55:0/2118453734 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 0x564b386f1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa97aa00640 1 --2- 172.21.15.55:0/2118453734 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b386dd5c0 0x564b386f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa983400640 1 -- 172.21.15.55:0/2118453734 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b386dd5c0 msgr2=0x564b386f0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa983400640 1 --2- 172.21.15.55:0/2118453734 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b386dd5c0 0x564b386f0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa983400640 1 -- 172.21.15.55:0/2118453734 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 msgr2=0x564b386f1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa983400640 1 --2- 172.21.15.55:0/2118453734 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 0x564b386f1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa983400640 1 -- 172.21.15.55:0/2118453734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b3849eab0 con 0x564b3868b4c0 2024-04-02T07:25:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa983e00640 1 --2- 172.21.15.55:0/2118453734 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 0x564b386f1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa97aa00640 1 --2- 172.21.15.55:0/2118453734 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b386dd5c0 0x564b386f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa983400640 1 --2- 172.21.15.55:0/2118453734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 0x564b38733590 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa974019060 tx=0x7fa9740a9000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=798d1782d5d299cb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa970c00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:25:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa970c00640 1 -- 172.21.15.55:0/2118453734 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974004400 con 0x564b3868b4c0 2024-04-02T07:25:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa970c00640 1 -- 172.21.15.55:0/2118453734 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa974003b30 con 0x564b3868b4c0 2024-04-02T07:25:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa98dab0000 1 -- 172.21.15.55:0/2118453734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b384a9460 con 0x564b3868b4c0 2024-04-02T07:25:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa970c00640 1 -- 172.21.15.55:0/2118453734 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa9740e7480 con 0x564b3868b4c0 2024-04-02T07:25:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa98dab0000 10 client.6312 fetch_fsmap learned FSMap version 33 2024-04-02T07:25:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa98dab0000 1 -- 172.21.15.55:0/2118453734 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x564b38484c00 con 0x564b3868b4c0 2024-04-02T07:25:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa970c00640 1 -- 172.21.15.55:0/2118453734 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564b384a9460 con 0x564b3868b4c0 2024-04-02T07:25:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa970c00640 1 -- 172.21.15.55:0/2118453734 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 33) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fa9740e75e0 con 0x564b3868b4c0 2024-04-02T07:25:24.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa98dab0000 10 client.6312 fetch_fsmap finished waiting for FSMap version 33 2024-04-02T07:25:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa98dab0000 10 client.6312 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-02T07:25:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa98dab0000 20 client.6312 populate_metadata read hostname 'smithi055' 2024-04-02T07:25:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa98dab0000 1 --2- 172.21.15.55:0/2118453734 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x564b386f17d0 0x564b386f1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa98dab0000 4 client.6312 mds_command: new command op to 6138 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-02T07:25:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa98dab0000 1 -- 172.21.15.55:0/2118453734 --> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564b384a29c0 con 0x564b386f17d0 2024-04-02T07:25:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa97aa00640 1 --2- 172.21.15.55:0/2118453734 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x564b386f17d0 0x564b386f1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa97aa00640 1 --2- 172.21.15.55:0/2118453734 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x564b386f17d0 0x564b386f1bb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4327ac20368d6cbb server_cookie=2e980812c4147ff0 in_seq=0 out_seq=0 2024-04-02T07:25:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa970c00640 10 client.6312 ms_handle_connect on v2:172.21.15.106:6835/1050953219 2024-04-02T07:25:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa970c00640 1 -- 172.21.15.55:0/2118453734 <== mds.0 v2:172.21.15.106:6835/1050953219 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x564b384a29c0 con 0x564b386f17d0 2024-04-02T07:25:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa970c00640 10 client.6312 handle_command_reply: tid=0 2024-04-02T07:25:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.277+0000 7fa98dab0000 1 client.6312 shutdown 2024-04-02T07:25:24.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98dab0000 1 -- 172.21.15.55:0/2118453734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 msgr2=0x564b38733590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98dab0000 1 --2- 172.21.15.55:0/2118453734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 0x564b38733590 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fa974019060 tx=0x7fa9740a9000 comp rx=0 tx=0).stop 2024-04-02T07:25:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98dab0000 1 -- 172.21.15.55:0/2118453734 shutdown_connections 2024-04-02T07:25:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98dab0000 1 --2- 172.21.15.55:0/2118453734 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b386ddee0 0x564b386f1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98dab0000 1 --2- 172.21.15.55:0/2118453734 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x564b386f17d0 0x564b386f1bb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98dab0000 1 --2- 172.21.15.55:0/2118453734 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b386dd5c0 0x564b386f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98dab0000 1 --2- 172.21.15.55:0/2118453734 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b3868b4c0 0x564b38733590 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa970c00640 0 client.6312 ms_handle_reset on v2:172.21.15.106:6835/1050953219 2024-04-02T07:25:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98dab0000 1 -- 172.21.15.55:0/2118453734 >> 172.21.15.55:0/2118453734 conn(0x564b38691830 msgr2=0x564b386db980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98dab0000 1 -- 172.21.15.55:0/2118453734 shutdown_connections 2024-04-02T07:25:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98dab0000 1 -- 172.21.15.55:0/2118453734 wait complete. 2024-04-02T07:25:24.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98dab0000 20 client.6312 trim_cache size 0 max 16384 2024-04-02T07:25:24.290 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:25:24.290 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "642a0456-a2ac-49a4-91a5-3b3449b512da", 2024-04-02T07:25:24.290 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-02T07:25:24.290 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 6138, 2024-04-02T07:25:24.290 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-02T07:25:24.290 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-02T07:25:24.290 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-02T07:25:24.290 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.473141389, 2024-04-02T07:25:24.290 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 33, 2024-04-02T07:25:24.290 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 60, 2024-04-02T07:25:24.290 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 60, 2024-04-02T07:25:24.290 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 14.800514028 2024-04-02T07:25:24.290 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:25:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98a600640 1 -- 172.21.15.55:0/1850002093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa960066690 msgr2=0x7fa960068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98a600640 1 --2- 172.21.15.55:0/1850002093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa960066690 0x7fa960068b50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa9740af000 tx=0x7fa9740a7000 comp rx=0 tx=0).stop 2024-04-02T07:25:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98a600640 1 -- 172.21.15.55:0/1850002093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9841599c0 msgr2=0x7fa984153a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98a600640 1 --2- 172.21.15.55:0/1850002093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9841599c0 0x7fa984153a20 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa97c00c790 tx=0x7fa97c00cc50 comp rx=0 tx=0).stop 2024-04-02T07:25:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98a600640 1 -- 172.21.15.55:0/1850002093 shutdown_connections 2024-04-02T07:25:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98a600640 1 --2- 172.21.15.55:0/1850002093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9841599c0 0x7fa984153a20 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98a600640 1 --2- 172.21.15.55:0/1850002093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9840b38f0 0x7fa984152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98a600640 1 --2- 172.21.15.55:0/1850002093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa960066690 0x7fa960068b50 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98a600640 1 --2- 172.21.15.55:0/1850002093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98406d1c0 0x7fa98414dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98a600640 1 -- 172.21.15.55:0/1850002093 >> 172.21.15.55:0/1850002093 conn(0x7fa984069d90 msgr2=0x7fa9840c7b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98a600640 1 -- 172.21.15.55:0/1850002093 shutdown_connections 2024-04-02T07:25:24.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.281+0000 7fa98a600640 1 -- 172.21.15.55:0/1850002093 wait complete. 2024-04-02T07:25:24.303 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-02T07:25:24.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.437+0000 7f3d36800640 1 Processor -- start 2024-04-02T07:25:24.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.437+0000 7f3d36800640 1 -- start start 2024-04-02T07:25:24.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.441+0000 7f3d36800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3d3015cbe0 0x7f3d300ce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.441+0000 7f3d36800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d3006d5b0 con 0x7f3d30065d20 2024-04-02T07:25:24.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.441+0000 7f3d36800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d3006cc80 con 0x7f3d30070a80 2024-04-02T07:25:24.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.441+0000 7f3d36800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d300cec10 con 0x7f3d3015cbe0 2024-04-02T07:25:24.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.441+0000 7f3d2f400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3d3015cbe0 0x7f3d300ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.441+0000 7f3d2f400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3d3015cbe0 0x7f3d300ce630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41530/0 (socket says 172.21.15.55:41530) 2024-04-02T07:25:24.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.441+0000 7f3d2f400640 1 -- 172.21.15.55:0/3562170881 learned_addr learned my addr 172.21.15.55:0/3562170881 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:24.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.441+0000 7f3d26a00640 1 --1- 172.21.15.55:0/3562170881 >> v1:172.21.15.55:6789/0 conn(0x7f3d30065d20 0x7f3d300b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47426/0 (socket says 172.21.15.55:47426) 2024-04-02T07:25:24.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.441+0000 7f3d2f400640 1 -- 172.21.15.55:0/3562170881 >> v1:172.21.15.106:6789/0 conn(0x7f3d30070a80 legacy=0x7f3d3006da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:24.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.441+0000 7f3d2f400640 1 -- 172.21.15.55:0/3562170881 >> v1:172.21.15.55:6789/0 conn(0x7f3d30065d20 legacy=0x7f3d300b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:24.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.441+0000 7f3d2f400640 1 -- 172.21.15.55:0/3562170881 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d3006cf60 con 0x7f3d3015cbe0 2024-04-02T07:25:24.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d2f400640 1 --2- 172.21.15.55:0/3562170881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d3015cbe0 0x7f3d300ce630 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009870 tx=0x7f3d2001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=896d2f5618cb095e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:24.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d2ea00640 1 -- 172.21.15.55:0/3562170881 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d200ab600 con 0x7f3d3015cbe0 2024-04-02T07:25:24.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d2ea00640 1 -- 172.21.15.55:0/3562170881 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d200a7050 con 0x7f3d3015cbe0 2024-04-02T07:25:24.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d2ea00640 1 -- 172.21.15.55:0/3562170881 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d200ab980 con 0x7f3d3015cbe0 2024-04-02T07:25:24.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d36800640 1 -- 172.21.15.55:0/3562170881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d3015cbe0 msgr2=0x7f3d300ce630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:24.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d36800640 1 --2- 172.21.15.55:0/3562170881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d3015cbe0 0x7f3d300ce630 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f3d20009870 tx=0x7f3d2001c520 comp rx=0 tx=0).stop 2024-04-02T07:25:24.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d36800640 1 -- 172.21.15.55:0/3562170881 shutdown_connections 2024-04-02T07:25:24.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d36800640 1 --2- 172.21.15.55:0/3562170881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d3015cbe0 0x7f3d300ce630 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d36800640 1 -- 172.21.15.55:0/3562170881 >> 172.21.15.55:0/3562170881 conn(0x7f3d300ced50 msgr2=0x7f3d300cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:24.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d36800640 1 -- 172.21.15.55:0/3562170881 shutdown_connections 2024-04-02T07:25:24.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d36800640 1 -- 172.21.15.55:0/3562170881 wait complete. 2024-04-02T07:25:24.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d36800640 1 Processor -- start 2024-04-02T07:25:24.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d36800640 1 -- start start 2024-04-02T07:25:24.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d36800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3d30065d20 0x7f3d3014e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d36800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d30070a80 0x7f3d3015e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d36800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d3015cbe0 0x7f3d300cb410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d36800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3015d2e0 con 0x7f3d30070a80 2024-04-02T07:25:24.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d36800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3015d530 con 0x7f3d3015cbe0 2024-04-02T07:25:24.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d36800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d3015d810 con 0x7f3d30065d20 2024-04-02T07:25:24.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d26a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d30070a80 0x7f3d3015e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d26a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d30070a80 0x7f3d3015e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41538/0 (socket says 172.21.15.55:41538) 2024-04-02T07:25:24.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.445+0000 7f3d26a00640 1 -- 172.21.15.55:0/3154512673 learned_addr learned my addr 172.21.15.55:0/3154512673 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:24.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.449+0000 7f3d2fe00640 1 --2- 172.21.15.55:0/3154512673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d3015cbe0 0x7f3d300cb410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.449+0000 7f3d2f400640 1 --2- 172.21.15.55:0/3154512673 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3d30065d20 0x7f3d3014e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.449+0000 7f3d26a00640 1 -- 172.21.15.55:0/3154512673 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3d30065d20 msgr2=0x7f3d3014e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:24.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.449+0000 7f3d26a00640 1 --2- 172.21.15.55:0/3154512673 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3d30065d20 0x7f3d3014e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.449+0000 7f3d26a00640 1 -- 172.21.15.55:0/3154512673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d3015cbe0 msgr2=0x7f3d300cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.449+0000 7f3d26a00640 1 --2- 172.21.15.55:0/3154512673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d3015cbe0 0x7f3d300cb410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.449+0000 7f3d26a00640 1 -- 172.21.15.55:0/3154512673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d200094d0 con 0x7f3d30070a80 2024-04-02T07:25:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.449+0000 7f3d26a00640 1 --2- 172.21.15.55:0/3154512673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d30070a80 0x7f3d3015e5d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800c490 tx=0x7f3d1800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.449+0000 7f3d27e00640 1 -- 172.21.15.55:0/3154512673 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d18007480 con 0x7f3d30070a80 2024-04-02T07:25:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.449+0000 7f3d27e00640 1 -- 172.21.15.55:0/3154512673 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d180075e0 con 0x7f3d30070a80 2024-04-02T07:25:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.449+0000 7f3d27e00640 1 -- 172.21.15.55:0/3154512673 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d18004a10 con 0x7f3d30070a80 2024-04-02T07:25:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.449+0000 7f3d36800640 1 -- 172.21.15.55:0/3154512673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d3015daf0 con 0x7f3d30070a80 2024-04-02T07:25:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.449+0000 7f3d36800640 1 -- 172.21.15.55:0/3154512673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d3015e0b0 con 0x7f3d30070a80 2024-04-02T07:25:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.449+0000 7f3d36800640 1 -- 172.21.15.55:0/3154512673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d30066c90 con 0x7f3d30070a80 2024-04-02T07:25:24.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.449+0000 7f3d27e00640 1 -- 172.21.15.55:0/3154512673 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3d18004b70 con 0x7f3d30070a80 2024-04-02T07:25:24.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.449+0000 7f3d27e00640 1 --2- 172.21.15.55:0/3154512673 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3d0c066690 0x7f3d0c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:24.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.449+0000 7f3d27e00640 1 -- 172.21.15.55:0/3154512673 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d18083340 con 0x7f3d30070a80 2024-04-02T07:25:24.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.453+0000 7f3d2f400640 1 --2- 172.21.15.55:0/3154512673 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3d0c066690 0x7f3d0c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:24.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.453+0000 7f3d2f400640 1 --2- 172.21.15.55:0/3154512673 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3d0c066690 0x7f3d0c068b50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3d200ad000 tx=0x7f3d200a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:24.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.453+0000 7f3d27e00640 1 -- 172.21.15.55:0/3154512673 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3d180506c0 con 0x7f3d30070a80 2024-04-02T07:25:24.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.653+0000 7f3d36800640 1 -- 172.21.15.55:0/3154512673 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3d3006db70 con 0x7f3d30070a80 2024-04-02T07:25:24.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.653+0000 7f3d27e00640 1 -- 172.21.15.55:0/3154512673 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v33) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3d18018060 con 0x7f3d30070a80 2024-04-02T07:25:24.657 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-02T07:25:24.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.653+0000 7f3d36800640 1 -- 172.21.15.55:0/3154512673 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3d0c066690 msgr2=0x7f3d0c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:24.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.653+0000 7f3d36800640 1 --2- 172.21.15.55:0/3154512673 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3d0c066690 0x7f3d0c068b50 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f3d200ad000 tx=0x7f3d200a6000 comp rx=0 tx=0).stop 2024-04-02T07:25:24.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.653+0000 7f3d36800640 1 -- 172.21.15.55:0/3154512673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d30070a80 msgr2=0x7f3d3015e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:24.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.653+0000 7f3d36800640 1 --2- 172.21.15.55:0/3154512673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d30070a80 0x7f3d3015e5d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f3d1800c490 tx=0x7f3d1800c950 comp rx=0 tx=0).stop 2024-04-02T07:25:24.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.653+0000 7f3d36800640 1 -- 172.21.15.55:0/3154512673 shutdown_connections 2024-04-02T07:25:24.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.653+0000 7f3d36800640 1 --2- 172.21.15.55:0/3154512673 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3d0c066690 0x7f3d0c068b50 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.653+0000 7f3d36800640 1 --2- 172.21.15.55:0/3154512673 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3d3015cbe0 0x7f3d300cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.653+0000 7f3d36800640 1 --2- 172.21.15.55:0/3154512673 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3d30070a80 0x7f3d3015e5d0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.653+0000 7f3d36800640 1 --2- 172.21.15.55:0/3154512673 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3d30065d20 0x7f3d3014e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:24.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.653+0000 7f3d36800640 1 -- 172.21.15.55:0/3154512673 >> 172.21.15.55:0/3154512673 conn(0x7f3d300ced50 msgr2=0x7f3d300adf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:24.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.653+0000 7f3d36800640 1 -- 172.21.15.55:0/3154512673 shutdown_connections 2024-04-02T07:25:24.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:24.653+0000 7f3d36800640 1 -- 172.21.15.55:0/3154512673 wait complete. 2024-04-02T07:25:24.678 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-02T07:25:24.678 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-02T07:25:24.678 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-02T07:25:24.679 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-02T07:25:24.679 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-02T07:25:24.679 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-02T07:25:24.679 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-02T07:25:24.679 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-02T07:25:24.679 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:25:24.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:25:24.679 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-02T07:25:24.689 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:25:24.689 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:25:24.689 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:25:24.689 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:25:24.689 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-02T07:25:24.689 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:25:24.690 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:25:24.690 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:25:24.690 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-02T07:25:24.690 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:25:24.690 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:25:24.690 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-02T07:25:24.690 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-02T07:25:24.690 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:25:24.690 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-02T07:25:24.690 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-02T07:25:24.690 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42270sec preferred_lft 42270sec 2024-04-02T07:25:24.690 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2024-04-02T07:25:24.690 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:25:24.690 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:25:24.691 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:25:24.691 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-02T07:25:24.691 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-02T07:25:24.691 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:81:5a:89:17 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:25:24.691 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-02T07:25:24.691 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:25:24.691 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:25:24.691 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-02T07:25:24.691 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-02T07:25:24.691 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:25:24.691 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-02T07:25:24.691 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:25:24.691 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:25:24.691 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-02T07:25:24.692 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-02T07:25:24.692 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:25:24.692 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:25:24.692 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-02T07:25:24.692 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-02T07:25:24.692 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:25:24.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:25:24.692 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-02T07:25:24.749 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:25:24.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:25:24.751 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-02T07:25:24.805 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-02T07:25:24.805 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-02T07:25:24.805 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-02T07:25:24.805 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-02T07:25:24.805 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-02T07:25:24.805 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-02T07:25:24.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:25:24.806 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:25:24.806 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:25:24.806 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-02T07:25:24.806 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-02T07:25:24.806 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-02T07:25:24.806 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:25:24.897 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:25:24.897 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-02T07:25:24.906 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-02T07:25:24.906 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-02T07:25:24.906 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:25:24.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:25:24.907 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-02T07:25:24.967 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-02T07:25:24.967 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:25:24.967 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-02T07:25:25.015 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:25:25.015 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:25:25.016 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:25:25.066 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:25:25.127 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:25:25.128 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:25:25.189 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:25:25.191 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:25:25.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:25:25.192 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:25:25.243 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-02T07:25:25.243 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-02T07:25:25.290 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:25:25.310 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:25:25.310 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:25:25.370 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:25:25.371 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:25:25.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:25:25.372 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:25:25.387 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:2024-04-02T07:25:25.381+0000 7f0db0f59580 -1 init, newargv = 0x5576593f36a0 newargc=15 2024-04-02T07:25:25.387 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[41155]: starting ceph client 2024-04-02T07:25:25.395 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[41155]: starting fuse 2024-04-02T07:25:26.497 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:25:26.522 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:25:26.522 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:25:26.583 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:25:26.585 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:25:26.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:25:26.586 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:25:26.636 INFO:teuthology.orchestra.run.smithi055.stdout:43 2024-04-02T07:25:26.636 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-02T07:25:26.636 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:25:26.636 DEBUG:teuthology.orchestra.run.smithi055:> import glob 2024-04-02T07:25:26.637 DEBUG:teuthology.orchestra.run.smithi055:> import re 2024-04-02T07:25:26.637 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:25:26.637 DEBUG:teuthology.orchestra.run.smithi055:> import subprocess 2024-04-02T07:25:26.637 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:25:26.637 DEBUG:teuthology.orchestra.run.smithi055:> def _find_admin_socket(client_name): 2024-04-02T07:25:26.637 DEBUG:teuthology.orchestra.run.smithi055:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-02T07:25:26.637 DEBUG:teuthology.orchestra.run.smithi055:> files = glob.glob(asok_path) 2024-04-02T07:25:26.637 DEBUG:teuthology.orchestra.run.smithi055:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-02T07:25:26.637 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:25:26.637 DEBUG:teuthology.orchestra.run.smithi055:> # Given a non-glob path, it better be there 2024-04-02T07:25:26.637 DEBUG:teuthology.orchestra.run.smithi055:> if "*" not in asok_path: 2024-04-02T07:25:26.637 DEBUG:teuthology.orchestra.run.smithi055:> assert(len(files) == 1) 2024-04-02T07:25:26.637 DEBUG:teuthology.orchestra.run.smithi055:> return files[0] 2024-04-02T07:25:26.638 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:25:26.638 DEBUG:teuthology.orchestra.run.smithi055:> for f in files: 2024-04-02T07:25:26.638 DEBUG:teuthology.orchestra.run.smithi055:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-02T07:25:26.638 DEBUG:teuthology.orchestra.run.smithi055:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-02T07:25:26.638 DEBUG:teuthology.orchestra.run.smithi055:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-02T07:25:26.638 DEBUG:teuthology.orchestra.run.smithi055:> contents = proc_f.read() 2024-04-02T07:25:26.638 DEBUG:teuthology.orchestra.run.smithi055:> if mountpoint in contents: 2024-04-02T07:25:26.638 DEBUG:teuthology.orchestra.run.smithi055:> return f 2024-04-02T07:25:26.638 DEBUG:teuthology.orchestra.run.smithi055:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-02T07:25:26.638 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:25:26.638 DEBUG:teuthology.orchestra.run.smithi055:> print(_find_admin_socket("client.0")) 2024-04-02T07:25:26.638 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:25:26.767 INFO:teuthology.orchestra.run.smithi055.stdout:/var/run/ceph/ceph-client.0.41155.asok 2024-04-02T07:25:26.950 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.41155.asok 2024-04-02T07:25:26.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:25:26.950 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.41155.asok status 2024-04-02T07:25:27.129 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:25:27.129 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": { 2024-04-02T07:25:27.130 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_sha1": "d0e392d9aee635f2b65768c460c7a151ead7a5e2", 2024-04-02T07:25:27.130 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)", 2024-04-02T07:25:27.130 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "0", 2024-04-02T07:25:27.130 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2024-04-02T07:25:27.130 INFO:teuthology.orchestra.run.smithi055.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-02T07:25:27.130 INFO:teuthology.orchestra.run.smithi055.stdout: "pid": "41155", 2024-04-02T07:25:27.130 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2024-04-02T07:25:27.130 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:27.130 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_count": 0, 2024-04-02T07:25:27.130 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_pinned_count": 0, 2024-04-02T07:25:27.130 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 6327, 2024-04-02T07:25:27.130 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": { 2024-04-02T07:25:27.130 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2024-04-02T07:25:27.130 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2024-04-02T07:25:27.131 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 6327 2024-04-02T07:25:27.131 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:27.131 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:25:27.131 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:25:27.131 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:25:27.131 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 1287720437 2024-04-02T07:25:27.131 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:27.131 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:27.131 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:25:27.131 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:25:27.131 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:25:27.131 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 1287720437 2024-04-02T07:25:27.131 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:27.131 INFO:teuthology.orchestra.run.smithi055.stdout: "inst_str": "client.6327 192.168.0.1:0/1287720437", 2024-04-02T07:25:27.131 INFO:teuthology.orchestra.run.smithi055.stdout: "addr_str": "192.168.0.1:0/1287720437", 2024-04-02T07:25:27.132 INFO:teuthology.orchestra.run.smithi055.stdout: "inode_count": 1, 2024-04-02T07:25:27.132 INFO:teuthology.orchestra.run.smithi055.stdout: "mds_epoch": 33, 2024-04-02T07:25:27.132 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch": 60, 2024-04-02T07:25:27.132 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch_barrier": 0, 2024-04-02T07:25:27.132 INFO:teuthology.orchestra.run.smithi055.stdout: "blocklisted": false, 2024-04-02T07:25:27.132 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs" 2024-04-02T07:25:27.132 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:25:27.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:25:27.145 DEBUG:teuthology.orchestra.run.smithi055:> stat --file-system '--printf=%T 2024-04-02T07:25:27.146 DEBUG:teuthology.orchestra.run.smithi055:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-02T07:25:27.155 INFO:teuthology.orchestra.run.smithi055.stdout:fuseblk 2024-04-02T07:25:27.155 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-02T07:25:27.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:25:27.155 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:25:27.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:25:27.216 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir_test) 2024-04-02T07:25:27.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:25:27.281 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir_test/file) 2024-04-02T07:25:27.336 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:25:27.336 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:25:27.336 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:25:27.336 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:25:27.336 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir_test/file").st_ino) 2024-04-02T07:25:27.336 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:25:27.447 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627777 2024-04-02T07:25:27.637 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:25:27.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.817+0000 7f18b4a00640 1 Processor -- start 2024-04-02T07:25:27.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.817+0000 7f18b4a00640 1 -- start start 2024-04-02T07:25:27.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.821+0000 7f18b4a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f18b01604b0 0x7f18b006be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:27.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.821+0000 7f18b4a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18b015cb10 0x7f18b0160890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:27.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.821+0000 7f18b4a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b00cf890 con 0x7f18b0161070 2024-04-02T07:25:27.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.821+0000 7f18b4a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b00cfb00 con 0x7f18b01604b0 2024-04-02T07:25:27.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.821+0000 7f18b4a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b0160dd0 con 0x7f18b015cb10 2024-04-02T07:25:27.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.821+0000 7f18ae800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f18b01604b0 0x7f18b006be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:27.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.821+0000 7f18ae800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f18b01604b0 0x7f18b006be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47852/0 (socket says 172.21.15.55:47852) 2024-04-02T07:25:27.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.821+0000 7f18ae800640 1 -- 172.21.15.55:0/2412219227 learned_addr learned my addr 172.21.15.55:0/2412219227 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:27.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.821+0000 7f18ade00640 1 --2- 172.21.15.55:0/2412219227 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18b015cb10 0x7f18b0160890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:27.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.821+0000 7f18ae800640 1 -- 172.21.15.55:0/2412219227 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18b015cb10 msgr2=0x7f18b0160890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:27.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.821+0000 7f18ae800640 1 --2- 172.21.15.55:0/2412219227 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18b015cb10 0x7f18b0160890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:27.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.821+0000 7f18ae800640 1 -- 172.21.15.55:0/2412219227 >> v1:172.21.15.106:6789/0 conn(0x7f18b0161070 legacy=0x7f18b00cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:27.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.821+0000 7f18ae800640 1 -- 172.21.15.55:0/2412219227 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b006b040 con 0x7f18b01604b0 2024-04-02T07:25:27.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.825+0000 7f18ae800640 1 --2- 172.21.15.55:0/2412219227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b01604b0 0x7f18b006be00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009870 tx=0x7f18a001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e3504b31cc3eca server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:27.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.825+0000 7f18ad400640 1 -- 172.21.15.55:0/2412219227 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a00a95f0 con 0x7f18b01604b0 2024-04-02T07:25:27.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.825+0000 7f18ad400640 1 -- 172.21.15.55:0/2412219227 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a00a9750 con 0x7f18b01604b0 2024-04-02T07:25:27.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.825+0000 7f18ad400640 1 -- 172.21.15.55:0/2412219227 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a00a9ae0 con 0x7f18b01604b0 2024-04-02T07:25:27.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.825+0000 7f18b4a00640 1 -- 172.21.15.55:0/2412219227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b01604b0 msgr2=0x7f18b006be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:27.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.825+0000 7f18b4a00640 1 --2- 172.21.15.55:0/2412219227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b01604b0 0x7f18b006be00 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f18a0009870 tx=0x7f18a001c530 comp rx=0 tx=0).stop 2024-04-02T07:25:27.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.825+0000 7f18b4a00640 1 -- 172.21.15.55:0/2412219227 shutdown_connections 2024-04-02T07:25:27.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.825+0000 7f18b4a00640 1 --2- 172.21.15.55:0/2412219227 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18b015cb10 0x7f18b0160890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:27.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.825+0000 7f18b4a00640 1 --2- 172.21.15.55:0/2412219227 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b01604b0 0x7f18b006be00 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:27.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.825+0000 7f18b4a00640 1 -- 172.21.15.55:0/2412219227 >> 172.21.15.55:0/2412219227 conn(0x7f18b00b1fb0 msgr2=0x7f18b00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:27.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.825+0000 7f18b4a00640 1 -- 172.21.15.55:0/2412219227 shutdown_connections 2024-04-02T07:25:27.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.825+0000 7f18b4a00640 1 -- 172.21.15.55:0/2412219227 wait complete. 2024-04-02T07:25:27.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.825+0000 7f18b4a00640 1 Processor -- start 2024-04-02T07:25:27.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.825+0000 7f18b4a00640 1 -- start start 2024-04-02T07:25:27.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.825+0000 7f18b4a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18b015cb10 0x7f18b00c4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:27.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.825+0000 7f18b4a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18b01604b0 0x7f18b00c4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:27.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.825+0000 7f18b4a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b0161070 0x7f18b00b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:27.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.825+0000 7f18b4a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b00b5ed0 con 0x7f18b0161070 2024-04-02T07:25:27.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.825+0000 7f18b4a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b00c5850 con 0x7f18b015cb10 2024-04-02T07:25:27.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.825+0000 7f18b4a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b00c5b30 con 0x7f18b01604b0 2024-04-02T07:25:27.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.829+0000 7f18af200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b0161070 0x7f18b00b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:27.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.829+0000 7f18af200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b0161070 0x7f18b00b3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47862/0 (socket says 172.21.15.55:47862) 2024-04-02T07:25:27.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.829+0000 7f18af200640 1 -- 172.21.15.55:0/4199561114 learned_addr learned my addr 172.21.15.55:0/4199561114 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:27.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.829+0000 7f18ae800640 1 --2- 172.21.15.55:0/4199561114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18b015cb10 0x7f18b00c4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:27.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.829+0000 7f18ade00640 1 --2- 172.21.15.55:0/4199561114 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18b01604b0 0x7f18b00c4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:27.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.829+0000 7f18af200640 1 -- 172.21.15.55:0/4199561114 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18b01604b0 msgr2=0x7f18b00c4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:27.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.829+0000 7f18af200640 1 --2- 172.21.15.55:0/4199561114 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18b01604b0 0x7f18b00c4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:27.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.829+0000 7f18af200640 1 -- 172.21.15.55:0/4199561114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18b015cb10 msgr2=0x7f18b00c4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:27.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.829+0000 7f18af200640 1 --2- 172.21.15.55:0/4199561114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18b015cb10 0x7f18b00c4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:27.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.829+0000 7f18af200640 1 -- 172.21.15.55:0/4199561114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a00094d0 con 0x7f18b0161070 2024-04-02T07:25:27.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.829+0000 7f18af200640 1 --2- 172.21.15.55:0/4199561114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b0161070 0x7f18b00b3cd0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f18a800c730 tx=0x7f18a800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:27.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.829+0000 7f18a6a00640 1 -- 172.21.15.55:0/4199561114 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8003b80 con 0x7f18b0161070 2024-04-02T07:25:27.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.829+0000 7f18a6a00640 1 -- 172.21.15.55:0/4199561114 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a8003ce0 con 0x7f18b0161070 2024-04-02T07:25:27.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.829+0000 7f18b4a00640 1 -- 172.21.15.55:0/4199561114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b00c5e10 con 0x7f18b0161070 2024-04-02T07:25:27.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.829+0000 7f18a6a00640 1 -- 172.21.15.55:0/4199561114 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8005310 con 0x7f18b0161070 2024-04-02T07:25:27.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.829+0000 7f18b4a00640 1 -- 172.21.15.55:0/4199561114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b00c5530 con 0x7f18b0161070 2024-04-02T07:25:27.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.829+0000 7f18b4a00640 1 -- 172.21.15.55:0/4199561114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b00b39f0 con 0x7f18b0161070 2024-04-02T07:25:27.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.829+0000 7f18a6a00640 1 -- 172.21.15.55:0/4199561114 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f18a8005680 con 0x7f18b0161070 2024-04-02T07:25:27.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.833+0000 7f18a6a00640 1 --2- 172.21.15.55:0/4199561114 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1890066690 0x7f1890068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:27.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.833+0000 7f18a6a00640 1 -- 172.21.15.55:0/4199561114 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18a80840e0 con 0x7f18b0161070 2024-04-02T07:25:27.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.833+0000 7f18ae800640 1 --2- 172.21.15.55:0/4199561114 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1890066690 0x7f1890068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:27.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.833+0000 7f18ae800640 1 --2- 172.21.15.55:0/4199561114 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1890066690 0x7f1890068b50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f18a00ae000 tx=0x7f18a00b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:27.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:27.837+0000 7f18a6a00640 1 -- 172.21.15.55:0/4199561114 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f18b00b39f0 con 0x7f18b0161070 2024-04-02T07:25:28.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.033+0000 7f18b4a00640 1 -- 172.21.15.55:0/4199561114 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18b00b39d0 con 0x7f18b0161070 2024-04-02T07:25:28.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.033+0000 7f18a6a00640 1 -- 172.21.15.55:0/4199561114 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f18a80513b0 con 0x7f18b0161070 2024-04-02T07:25:28.040 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:28.040 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":33,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5510,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3429221899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3429221899},{"type":"v1","addr":"172.21.15.55:6835","nonce":3429221899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5513,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/4033456774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4033456774},{"type":"v1","addr":"172.21.15.106:6836","nonce":4033456774}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6129,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2170345840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2170345840},{"type":"v1","addr":"172.21.15.55:6834","nonce":2170345840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:25:13.807869+0000","modified":"2024-04-02T07:25:16.836879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6138":{"gid":6138,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6837/1050953219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1050953219},{"type":"v1","addr":"172.21.15.106:6837","nonce":1050953219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-02T07:25:28.040 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 33 2024-04-02T07:25:28.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.037+0000 7f18b4a00640 1 -- 172.21.15.55:0/4199561114 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1890066690 msgr2=0x7f1890068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.037+0000 7f18b4a00640 1 --2- 172.21.15.55:0/4199561114 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1890066690 0x7f1890068b50 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f18a00ae000 tx=0x7f18a00b3040 comp rx=0 tx=0).stop 2024-04-02T07:25:28.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.037+0000 7f18b4a00640 1 -- 172.21.15.55:0/4199561114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b0161070 msgr2=0x7f18b00b3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.037+0000 7f18b4a00640 1 --2- 172.21.15.55:0/4199561114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b0161070 0x7f18b00b3cd0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f18a800c730 tx=0x7f18a800cbf0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.037+0000 7f18b4a00640 1 -- 172.21.15.55:0/4199561114 shutdown_connections 2024-04-02T07:25:28.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.037+0000 7f18b4a00640 1 --2- 172.21.15.55:0/4199561114 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f18b0161070 0x7f18b00b3cd0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.037+0000 7f18b4a00640 1 --2- 172.21.15.55:0/4199561114 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f18b01604b0 0x7f18b00c4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.037+0000 7f18b4a00640 1 --2- 172.21.15.55:0/4199561114 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1890066690 0x7f1890068b50 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.037+0000 7f18b4a00640 1 --2- 172.21.15.55:0/4199561114 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f18b015cb10 0x7f18b00c4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.037+0000 7f18b4a00640 1 -- 172.21.15.55:0/4199561114 >> 172.21.15.55:0/4199561114 conn(0x7f18b00b1fb0 msgr2=0x7f18b006eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:28.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.037+0000 7f18b4a00640 1 -- 172.21.15.55:0/4199561114 shutdown_connections 2024-04-02T07:25:28.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.037+0000 7f18b4a00640 1 -- 172.21.15.55:0/4199561114 wait complete. 2024-04-02T07:25:28.061 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json flush journal 2024-04-02T07:25:28.237 INFO:teuthology.orchestra.run.smithi106.stdout:{"message":"","return_code":0} 2024-04-02T07:25:28.238 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-02T07:25:28.238 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000001.00000000 parent 2024-04-02T07:25:28.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06ee462080 1 Processor -- start 2024-04-02T07:25:28.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06ee462080 1 -- start start 2024-04-02T07:25:28.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06ee462080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578009837e0 0x557800a0be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06ee462080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578009847a0 0x557800a12bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06ee462080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557800a10a20 0x55780096c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06ee462080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578008e51e0 con 0x5578009837e0 2024-04-02T07:25:28.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06ee462080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557800880960 con 0x557800a10a20 2024-04-02T07:25:28.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06ee462080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x557800880600 con 0x5578009847a0 2024-04-02T07:25:28.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06eb600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578009837e0 0x557800a0be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06eb600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578009837e0 0x557800a0be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47880/0 (socket says 172.21.15.55:47880) 2024-04-02T07:25:28.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06eb600640 1 -- 172.21.15.55:0/2586838886 learned_addr learned my addr 172.21.15.55:0/2586838886 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:28.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06ec000640 1 --2- 172.21.15.55:0/2586838886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557800a10a20 0x55780096c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06eac00640 1 --2- 172.21.15.55:0/2586838886 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578009847a0 0x557800a12bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06eb600640 1 -- 172.21.15.55:0/2586838886 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578009847a0 msgr2=0x557800a12bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06eb600640 1 --2- 172.21.15.55:0/2586838886 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578009847a0 0x557800a12bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06eb600640 1 -- 172.21.15.55:0/2586838886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557800a10a20 msgr2=0x55780096c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06eb600640 1 --2- 172.21.15.55:0/2586838886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557800a10a20 0x55780096c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06eb600640 1 -- 172.21.15.55:0/2586838886 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d8005d30 con 0x5578009837e0 2024-04-02T07:25:28.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06ec000640 1 --2- 172.21.15.55:0/2586838886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557800a10a20 0x55780096c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:28.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06eb600640 1 --2- 172.21.15.55:0/2586838886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578009837e0 0x557800a0be70 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f06dc001d50 tx=0x7f06dc00b5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419b06254af5ff96 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06e9800640 1 -- 172.21.15.55:0/2586838886 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc014070 con 0x5578009837e0 2024-04-02T07:25:28.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06e9800640 1 -- 172.21.15.55:0/2586838886 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06dc00f410 con 0x5578009837e0 2024-04-02T07:25:28.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06e9800640 1 -- 172.21.15.55:0/2586838886 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06dc001ea0 con 0x5578009837e0 2024-04-02T07:25:28.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06ee462080 1 -- 172.21.15.55:0/2586838886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578009837e0 msgr2=0x557800a0be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06ee462080 1 --2- 172.21.15.55:0/2586838886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578009837e0 0x557800a0be70 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f06dc001d50 tx=0x7f06dc00b5c0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06ee462080 1 -- 172.21.15.55:0/2586838886 shutdown_connections 2024-04-02T07:25:28.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06ee462080 1 --2- 172.21.15.55:0/2586838886 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557800a10a20 0x55780096c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06ee462080 1 --2- 172.21.15.55:0/2586838886 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578009847a0 0x557800a12bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06ee462080 1 --2- 172.21.15.55:0/2586838886 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578009837e0 0x557800a0be70 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06ee462080 1 -- 172.21.15.55:0/2586838886 >> 172.21.15.55:0/2586838886 conn(0x5578009675a0 msgr2=0x557800a0f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06ee462080 1 -- 172.21.15.55:0/2586838886 shutdown_connections 2024-04-02T07:25:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.281+0000 7f06ee462080 1 -- 172.21.15.55:0/2586838886 wait complete. 2024-04-02T07:25:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06ee462080 1 Processor -- start 2024-04-02T07:25:28.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06ee462080 1 -- start start 2024-04-02T07:25:28.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06ee462080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578009837e0 0x557800a11f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06ee462080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578009847a0 0x557800a09a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06ee462080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557800a10a20 0x557800a09fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06ee462080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557800877690 con 0x5578009847a0 2024-04-02T07:25:28.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06ee462080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557800a0a500 con 0x5578009837e0 2024-04-02T07:25:28.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06ee462080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x557800a0a790 con 0x557800a10a20 2024-04-02T07:25:28.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06eac00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578009847a0 0x557800a09a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06eac00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578009847a0 0x557800a09a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47882/0 (socket says 172.21.15.55:47882) 2024-04-02T07:25:28.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06eac00640 1 -- 172.21.15.55:0/3459622542 learned_addr learned my addr 172.21.15.55:0/3459622542 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:28.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06eb600640 1 --2- 172.21.15.55:0/3459622542 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578009837e0 0x557800a11f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06ec000640 1 --2- 172.21.15.55:0/3459622542 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557800a10a20 0x557800a09fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06eac00640 1 -- 172.21.15.55:0/3459622542 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557800a10a20 msgr2=0x557800a09fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06eac00640 1 --2- 172.21.15.55:0/3459622542 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557800a10a20 0x557800a09fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06eac00640 1 -- 172.21.15.55:0/3459622542 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578009837e0 msgr2=0x557800a11f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06eac00640 1 --2- 172.21.15.55:0/3459622542 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578009837e0 0x557800a11f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06eac00640 1 -- 172.21.15.55:0/3459622542 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578008a9a60 con 0x5578009847a0 2024-04-02T07:25:28.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06eb600640 1 --2- 172.21.15.55:0/3459622542 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578009837e0 0x557800a11f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:25:28.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06eac00640 1 --2- 172.21.15.55:0/3459622542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578009847a0 0x557800a09a80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f06d80192e0 tx=0x7f06d8019ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06e3e00640 1 -- 172.21.15.55:0/3459622542 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d80b8040 con 0x5578009847a0 2024-04-02T07:25:28.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06e3e00640 1 -- 172.21.15.55:0/3459622542 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d80a8640 con 0x5578009847a0 2024-04-02T07:25:28.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06e3e00640 1 -- 172.21.15.55:0/3459622542 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d80bd680 con 0x5578009847a0 2024-04-02T07:25:28.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06ee462080 1 -- 172.21.15.55:0/3459622542 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x557800882d00 con 0x5578009847a0 2024-04-02T07:25:28.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.285+0000 7f06ee462080 1 -- 172.21.15.55:0/3459622542 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557800882760 con 0x5578009847a0 2024-04-02T07:25:28.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06e3e00640 1 -- 172.21.15.55:0/3459622542 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f06d80bd7e0 con 0x5578009847a0 2024-04-02T07:25:28.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06e3e00640 1 --2- 172.21.15.55:0/3459622542 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f06cc0650a0 0x7f06cc067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06e3e00640 1 -- 172.21.15.55:0/3459622542 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06d811e320 con 0x5578009847a0 2024-04-02T07:25:28.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06ee462080 1 --2- 172.21.15.55:0/3459622542 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x557800a12460 0x557800aacf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06eb600640 1 --2- 172.21.15.55:0/3459622542 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f06cc0650a0 0x7f06cc067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06ee462080 1 -- 172.21.15.55:0/3459622542 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e60) v8 -- 0x5578009f1020 con 0x557800a12460 2024-04-02T07:25:28.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06ec000640 1 --2- 172.21.15.55:0/3459622542 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x557800a12460 0x557800aacf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06eb600640 1 --2- 172.21.15.55:0/3459622542 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f06cc0650a0 0x7f06cc067560 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00b600 tx=0x7f06dc009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06ec000640 1 --2- 172.21.15.55:0/3459622542 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x557800a12460 0x557800aacf00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06ec000640 1 -- 172.21.15.55:0/3459622542 <== osd.5 v2:172.21.15.106:6800/27676 1 ==== osd_op_reply(1 10000000001.00000000 [getxattr (94) out=94b] v0'0 uv1 ondisk = 0) v8 ==== 164+0+94 (crc 0 0 0) 0x7f06e4001990 con 0x557800a12460 2024-04-02T07:25:28.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06ee462080 1 -- 172.21.15.55:0/3459622542 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x557800a12460 msgr2=0x557800aacf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06ee462080 1 --2- 172.21.15.55:0/3459622542 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x557800a12460 0x557800aacf00 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06ee462080 1 -- 172.21.15.55:0/3459622542 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f06cc0650a0 msgr2=0x7f06cc067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06ee462080 1 --2- 172.21.15.55:0/3459622542 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f06cc0650a0 0x7f06cc067560 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00b600 tx=0x7f06dc009000 comp rx=0 tx=0).stop 2024-04-02T07:25:28.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06ee462080 1 -- 172.21.15.55:0/3459622542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578009847a0 msgr2=0x557800a09a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06ee462080 1 --2- 172.21.15.55:0/3459622542 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578009847a0 0x557800a09a80 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f06d80192e0 tx=0x7f06d8019ef0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06ec000640 1 -- 172.21.15.55:0/3459622542 reap_dead start 2024-04-02T07:25:28.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06ee462080 1 -- 172.21.15.55:0/3459622542 shutdown_connections 2024-04-02T07:25:28.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06ee462080 1 -- 172.21.15.55:0/3459622542 >> 172.21.15.55:0/3459622542 conn(0x5578009675a0 msgr2=0x55780096bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:28.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06ee462080 1 -- 172.21.15.55:0/3459622542 shutdown_connections 2024-04-02T07:25:28.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.289+0000 7f06ee462080 1 -- 172.21.15.55:0/3459622542 wait complete. 2024-04-02T07:25:28.300 INFO:teuthology.orchestra.run.smithi055.stdout:Xfiledir_test 2024-04-02T07:25:28.300 DEBUG:teuthology.orchestra.run.smithi055:> ceph-dencoder type inode_backtrace_t import - decode dump_json 2024-04-02T07:25:28.348 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:25:28.348 INFO:teuthology.orchestra.run.smithi055.stdout: "ino": 1099511627777, 2024-04-02T07:25:28.348 INFO:teuthology.orchestra.run.smithi055.stdout: "ancestors": [ 2024-04-02T07:25:28.348 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:28.348 INFO:teuthology.orchestra.run.smithi055.stdout: "dirino": 1099511627776, 2024-04-02T07:25:28.348 INFO:teuthology.orchestra.run.smithi055.stdout: "dname": "file", 2024-04-02T07:25:28.348 INFO:teuthology.orchestra.run.smithi055.stdout: "version": 2 2024-04-02T07:25:28.348 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:25:28.348 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:28.349 INFO:teuthology.orchestra.run.smithi055.stdout: "dirino": 1, 2024-04-02T07:25:28.349 INFO:teuthology.orchestra.run.smithi055.stdout: "dname": "dir_test", 2024-04-02T07:25:28.349 INFO:teuthology.orchestra.run.smithi055.stdout: "version": 4 2024-04-02T07:25:28.349 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:28.349 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-02T07:25:28.349 INFO:teuthology.orchestra.run.smithi055.stdout: "pool": 9, 2024-04-02T07:25:28.349 INFO:teuthology.orchestra.run.smithi055.stdout: "old_pools": [] 2024-04-02T07:25:28.349 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:25:28.349 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:28.352 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data setxattr 10000000001.00000000 parent 'The backtrace is corrupted' 2024-04-02T07:25:28.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.437+0000 7f93ab8cd080 1 Processor -- start 2024-04-02T07:25:28.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.437+0000 7f93ab8cd080 1 -- start start 2024-04-02T07:25:28.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.437+0000 7f93ab8cd080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cbe21da00 0x559cbe1d4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.437+0000 7f93ab8cd080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559cbe2920b0 0x559cbe21cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.437+0000 7f93ab8cd080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559cbe292490 0x559cbe28b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.437+0000 7f93ab8cd080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cbe1801e0 con 0x559cbe21da00 2024-04-02T07:25:28.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.437+0000 7f93ab8cd080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cbe11b960 con 0x559cbe2920b0 2024-04-02T07:25:28.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.437+0000 7f93ab8cd080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x559cbe11b600 con 0x559cbe292490 2024-04-02T07:25:28.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.437+0000 7f93a8a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cbe21da00 0x559cbe1d4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a8a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cbe21da00 0x559cbe1d4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47894/0 (socket says 172.21.15.55:47894) 2024-04-02T07:25:28.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a8a00640 1 -- 172.21.15.55:0/3747759937 learned_addr learned my addr 172.21.15.55:0/3747759937 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:28.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a3e00640 1 --2- 172.21.15.55:0/3747759937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559cbe2920b0 0x559cbe21cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a9400640 1 --2- 172.21.15.55:0/3747759937 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559cbe292490 0x559cbe28b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a8a00640 1 -- 172.21.15.55:0/3747759937 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559cbe292490 msgr2=0x559cbe28b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a8a00640 1 --2- 172.21.15.55:0/3747759937 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559cbe292490 0x559cbe28b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a8a00640 1 -- 172.21.15.55:0/3747759937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559cbe2920b0 msgr2=0x559cbe21cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a8a00640 1 --2- 172.21.15.55:0/3747759937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559cbe2920b0 0x559cbe21cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a8a00640 1 -- 172.21.15.55:0/3747759937 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9394005d30 con 0x559cbe21da00 2024-04-02T07:25:28.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a9400640 1 --2- 172.21.15.55:0/3747759937 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559cbe292490 0x559cbe28b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:25:28.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a8a00640 1 --2- 172.21.15.55:0/3747759937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cbe21da00 0x559cbe1d4a60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f939c001d90 tx=0x7f939c001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a920b89d21f06f0e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a2a00640 1 -- 172.21.15.55:0/3747759937 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c00e480 con 0x559cbe21da00 2024-04-02T07:25:28.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a2a00640 1 -- 172.21.15.55:0/3747759937 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c00e5e0 con 0x559cbe21da00 2024-04-02T07:25:28.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a2a00640 1 -- 172.21.15.55:0/3747759937 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c00e990 con 0x559cbe21da00 2024-04-02T07:25:28.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93ab8cd080 1 -- 172.21.15.55:0/3747759937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cbe21da00 msgr2=0x559cbe1d4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93ab8cd080 1 --2- 172.21.15.55:0/3747759937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cbe21da00 0x559cbe1d4a60 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f939c001d90 tx=0x7f939c001e80 comp rx=0 tx=0).stop 2024-04-02T07:25:28.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93ab8cd080 1 -- 172.21.15.55:0/3747759937 shutdown_connections 2024-04-02T07:25:28.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93ab8cd080 1 --2- 172.21.15.55:0/3747759937 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559cbe292490 0x559cbe28b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93ab8cd080 1 --2- 172.21.15.55:0/3747759937 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559cbe2920b0 0x559cbe21cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93ab8cd080 1 --2- 172.21.15.55:0/3747759937 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cbe21da00 0x559cbe1d4a60 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93ab8cd080 1 -- 172.21.15.55:0/3747759937 >> 172.21.15.55:0/3747759937 conn(0x559cbe201bf0 msgr2=0x559cbe1d4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:28.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93ab8cd080 1 -- 172.21.15.55:0/3747759937 shutdown_connections 2024-04-02T07:25:28.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93ab8cd080 1 -- 172.21.15.55:0/3747759937 wait complete. 2024-04-02T07:25:28.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93ab8cd080 1 Processor -- start 2024-04-02T07:25:28.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93ab8cd080 1 -- start start 2024-04-02T07:25:28.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93ab8cd080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cbe21da00 0x559cbe1d3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93ab8cd080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559cbe2920b0 0x559cbe297c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93ab8cd080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559cbe292490 0x559cbe298140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93ab8cd080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cbe112690 con 0x559cbe21da00 2024-04-02T07:25:28.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93ab8cd080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cbe29a840 con 0x559cbe2920b0 2024-04-02T07:25:28.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93ab8cd080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x559cbe29aae0 con 0x559cbe292490 2024-04-02T07:25:28.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a8a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cbe21da00 0x559cbe1d3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a8a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cbe21da00 0x559cbe1d3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47898/0 (socket says 172.21.15.55:47898) 2024-04-02T07:25:28.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a8a00640 1 -- 172.21.15.55:0/944262447 learned_addr learned my addr 172.21.15.55:0/944262447 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:28.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a9400640 1 --2- 172.21.15.55:0/944262447 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559cbe292490 0x559cbe298140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a3e00640 1 --2- 172.21.15.55:0/944262447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559cbe2920b0 0x559cbe297c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a8a00640 1 -- 172.21.15.55:0/944262447 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559cbe292490 msgr2=0x559cbe298140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a8a00640 1 --2- 172.21.15.55:0/944262447 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559cbe292490 0x559cbe298140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a8a00640 1 -- 172.21.15.55:0/944262447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559cbe2920b0 msgr2=0x559cbe297c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a8a00640 1 --2- 172.21.15.55:0/944262447 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559cbe2920b0 0x559cbe297c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.441+0000 7f93a8a00640 1 -- 172.21.15.55:0/944262447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559cbe11d970 con 0x559cbe21da00 2024-04-02T07:25:28.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.445+0000 7f93a8a00640 1 --2- 172.21.15.55:0/944262447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cbe21da00 0x559cbe1d3260 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f939c001d30 tx=0x7f939c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.445+0000 7f93a1600640 1 -- 172.21.15.55:0/944262447 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c01e070 con 0x559cbe21da00 2024-04-02T07:25:28.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.445+0000 7f93a1600640 1 -- 172.21.15.55:0/944262447 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c00ee40 con 0x559cbe21da00 2024-04-02T07:25:28.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.445+0000 7f93a1600640 1 -- 172.21.15.55:0/944262447 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c00e480 con 0x559cbe21da00 2024-04-02T07:25:28.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.445+0000 7f93ab8cd080 1 -- 172.21.15.55:0/944262447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9390004030 con 0x559cbe21da00 2024-04-02T07:25:28.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.445+0000 7f93ab8cd080 1 -- 172.21.15.55:0/944262447 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559cbe11dd00 con 0x559cbe21da00 2024-04-02T07:25:28.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.445+0000 7f93a1600640 1 -- 172.21.15.55:0/944262447 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f939c00a040 con 0x559cbe21da00 2024-04-02T07:25:28.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.445+0000 7f93a1600640 1 --2- 172.21.15.55:0/944262447 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9388065070 0x7f9388067530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.445+0000 7f93a1600640 1 -- 172.21.15.55:0/944262447 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f939c084280 con 0x559cbe21da00 2024-04-02T07:25:28.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.445+0000 7f93a3e00640 1 --2- 172.21.15.55:0/944262447 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9388065070 0x7f9388067530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.445+0000 7f93ab8cd080 1 --2- 172.21.15.55:0/944262447 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x559cbe1d37a0 0x559cbe2994c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.445+0000 7f93ab8cd080 1 -- 172.21.15.55:0/944262447 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:1 9.7 9:e2e07930:::10000000001.00000000:head [setxattr parent (26) in=32b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e60) v8 -- 0x559cbe345180 con 0x559cbe1d37a0 2024-04-02T07:25:28.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.445+0000 7f93a9400640 1 --2- 172.21.15.55:0/944262447 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x559cbe1d37a0 0x559cbe2994c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.449+0000 7f93a3e00640 1 --2- 172.21.15.55:0/944262447 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9388065070 0x7f9388067530 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f93940ae000 tx=0x7f93940b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.449+0000 7f93a9400640 1 --2- 172.21.15.55:0/944262447 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x559cbe1d37a0 0x559cbe2994c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.449+0000 7f93a9400640 1 -- 172.21.15.55:0/944262447 <== osd.5 v2:172.21.15.106:6800/27676 1 ==== osd_op_reply(1 10000000001.00000000 [setxattr (26)] v60'2 uv2 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f93a4001660 con 0x559cbe1d37a0 2024-04-02T07:25:28.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.449+0000 7f93ab8cd080 1 -- 172.21.15.55:0/944262447 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x559cbe1d37a0 msgr2=0x559cbe2994c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.449+0000 7f93ab8cd080 1 --2- 172.21.15.55:0/944262447 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x559cbe1d37a0 0x559cbe2994c0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.449+0000 7f93ab8cd080 1 -- 172.21.15.55:0/944262447 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9388065070 msgr2=0x7f9388067530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.449+0000 7f93ab8cd080 1 --2- 172.21.15.55:0/944262447 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9388065070 0x7f9388067530 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f93940ae000 tx=0x7f93940b3040 comp rx=0 tx=0).stop 2024-04-02T07:25:28.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.449+0000 7f93ab8cd080 1 -- 172.21.15.55:0/944262447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cbe21da00 msgr2=0x559cbe1d3260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.449+0000 7f93ab8cd080 1 --2- 172.21.15.55:0/944262447 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cbe21da00 0x559cbe1d3260 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f939c001d30 tx=0x7f939c000ee0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.449+0000 7f93a9400640 1 -- 172.21.15.55:0/944262447 reap_dead start 2024-04-02T07:25:28.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.449+0000 7f93ab8cd080 1 -- 172.21.15.55:0/944262447 shutdown_connections 2024-04-02T07:25:28.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.449+0000 7f93ab8cd080 1 -- 172.21.15.55:0/944262447 >> 172.21.15.55:0/944262447 conn(0x559cbe201bf0 msgr2=0x559cbe21cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:28.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.449+0000 7f93ab8cd080 1 -- 172.21.15.55:0/944262447 shutdown_connections 2024-04-02T07:25:28.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.449+0000 7f93ab8cd080 1 -- 172.21.15.55:0/944262447 wait complete. 2024-04-02T07:25:28.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:25:28.458 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / recursive 2024-04-02T07:25:28.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.637+0000 7f2535800640 1 Processor -- start 2024-04-02T07:25:28.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.637+0000 7f2535800640 1 -- start start 2024-04-02T07:25:28.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.641+0000 7f2535800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f253015ff20 0x7f2530098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.641+0000 7f2535800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2530098f50 0x7f25300993b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.641+0000 7f2535800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f253006aea0 0x7f253006b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.641+0000 7f2535800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2530099d70 con 0x7f253006aea0 2024-04-02T07:25:28.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.641+0000 7f2535800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25300cab10 con 0x7f2530098f50 2024-04-02T07:25:28.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.641+0000 7f2535800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2530160300 con 0x7f253015ff20 2024-04-02T07:25:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.641+0000 7f2534e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f253006aea0 0x7f253006b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.641+0000 7f2534e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f253006aea0 0x7f253006b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47904/0 (socket says 172.21.15.55:47904) 2024-04-02T07:25:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.641+0000 7f2534e00640 1 -- 172.21.15.55:0/2615562783 learned_addr learned my addr 172.21.15.55:0/2615562783 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.641+0000 7f252fe00640 1 --2- 172.21.15.55:0/2615562783 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f253015ff20 0x7f2530098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.641+0000 7f2527e00640 1 --2- 172.21.15.55:0/2615562783 >> v2:172.21.15.106:3300/0 conn(0x7f2530098f50 0x7f25300993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.641+0000 7f2534e00640 1 -- 172.21.15.55:0/2615562783 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f253015ff20 msgr2=0x7f2530098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.641+0000 7f2534e00640 1 --2- 172.21.15.55:0/2615562783 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f253015ff20 0x7f2530098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.641+0000 7f2534e00640 1 -- 172.21.15.55:0/2615562783 >> v2:172.21.15.106:3300/0 conn(0x7f2530098f50 msgr2=0x7f25300993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.641+0000 7f2534e00640 1 --2- 172.21.15.55:0/2615562783 >> v2:172.21.15.106:3300/0 conn(0x7f2530098f50 0x7f25300993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.641+0000 7f2534e00640 1 -- 172.21.15.55:0/2615562783 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25300cf3d0 con 0x7f253006aea0 2024-04-02T07:25:28.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f2534e00640 1 --2- 172.21.15.55:0/2615562783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f253006aea0 0x7f253006b310 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2530071710 tx=0x7f252801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c8c0bf90aa7159 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f252f400640 1 -- 172.21.15.55:0/2615562783 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25280a5760 con 0x7f253006aea0 2024-04-02T07:25:28.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f252f400640 1 -- 172.21.15.55:0/2615562783 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25280a58c0 con 0x7f253006aea0 2024-04-02T07:25:28.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f252f400640 1 -- 172.21.15.55:0/2615562783 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25280a5c50 con 0x7f253006aea0 2024-04-02T07:25:28.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f2535800640 1 -- 172.21.15.55:0/2615562783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f253006aea0 msgr2=0x7f253006b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f2535800640 1 --2- 172.21.15.55:0/2615562783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f253006aea0 0x7f253006b310 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f2530071710 tx=0x7f252801c9f0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f2535800640 1 -- 172.21.15.55:0/2615562783 shutdown_connections 2024-04-02T07:25:28.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f2535800640 1 --2- 172.21.15.55:0/2615562783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f253006aea0 0x7f253006b310 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f2535800640 1 --2- 172.21.15.55:0/2615562783 >> v2:172.21.15.106:3300/0 conn(0x7f2530098f50 0x7f25300993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f2535800640 1 --2- 172.21.15.55:0/2615562783 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f253015ff20 0x7f2530098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f2535800640 1 -- 172.21.15.55:0/2615562783 >> 172.21.15.55:0/2615562783 conn(0x7f25300b1fb0 msgr2=0x7f25300b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:28.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f2535800640 1 -- 172.21.15.55:0/2615562783 shutdown_connections 2024-04-02T07:25:28.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f2535800640 1 -- 172.21.15.55:0/2615562783 wait complete. 2024-04-02T07:25:28.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f2535800640 1 Processor -- start 2024-04-02T07:25:28.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f2535800640 1 -- start start 2024-04-02T07:25:28.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f2535800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f253006aea0 0x7f25300ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f2535800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2530098f50 0x7f25300ae890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f2535800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f253015ff20 0x7f25300c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f2535800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25300aedd0 con 0x7f253015ff20 2024-04-02T07:25:28.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f2535800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25300c9e20 con 0x7f253006aea0 2024-04-02T07:25:28.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.645+0000 7f2535800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25300aefc0 con 0x7f2530098f50 2024-04-02T07:25:28.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.649+0000 7f2534e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f253015ff20 0x7f25300c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.649+0000 7f252fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f253006aea0 0x7f25300ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.649+0000 7f2534e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f253015ff20 0x7f25300c98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47906/0 (socket says 172.21.15.55:47906) 2024-04-02T07:25:28.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.649+0000 7f2534e00640 1 -- 172.21.15.55:0/1542438127 learned_addr learned my addr 172.21.15.55:0/1542438127 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:28.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.649+0000 7f2527e00640 1 --2- 172.21.15.55:0/1542438127 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2530098f50 0x7f25300ae890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.649+0000 7f2534e00640 1 -- 172.21.15.55:0/1542438127 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2530098f50 msgr2=0x7f25300ae890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.649+0000 7f2534e00640 1 --2- 172.21.15.55:0/1542438127 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2530098f50 0x7f25300ae890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.649+0000 7f2534e00640 1 -- 172.21.15.55:0/1542438127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f253006aea0 msgr2=0x7f25300ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.649+0000 7f2534e00640 1 --2- 172.21.15.55:0/1542438127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f253006aea0 0x7f25300ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.649+0000 7f2534e00640 1 -- 172.21.15.55:0/1542438127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2528009b30 con 0x7f253015ff20 2024-04-02T07:25:28.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.649+0000 7f252fe00640 1 --2- 172.21.15.55:0/1542438127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f253006aea0 0x7f25300ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:25:28.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.649+0000 7f2534e00640 1 --2- 172.21.15.55:0/1542438127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f253015ff20 0x7f25300c98e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f25280af040 tx=0x7f2528019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.649+0000 7f252cc00640 1 -- 172.21.15.55:0/1542438127 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25280b8670 con 0x7f253015ff20 2024-04-02T07:25:28.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.649+0000 7f252cc00640 1 -- 172.21.15.55:0/1542438127 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25280b87d0 con 0x7f253015ff20 2024-04-02T07:25:28.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.649+0000 7f2535800640 1 -- 172.21.15.55:0/1542438127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25300ad290 con 0x7f253015ff20 2024-04-02T07:25:28.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.649+0000 7f252cc00640 1 -- 172.21.15.55:0/1542438127 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25280b8b80 con 0x7f253015ff20 2024-04-02T07:25:28.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.649+0000 7f2535800640 1 -- 172.21.15.55:0/1542438127 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25300ad850 con 0x7f253015ff20 2024-04-02T07:25:28.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.649+0000 7f252cc00640 1 -- 172.21.15.55:0/1542438127 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f25280b8ce0 con 0x7f253015ff20 2024-04-02T07:25:28.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f252cc00640 1 --2- 172.21.15.55:0/1542438127 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f250c066690 0x7f250c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f252cc00640 1 -- 172.21.15.55:0/1542438127 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f252811f620 con 0x7f253015ff20 2024-04-02T07:25:28.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f252fe00640 1 --2- 172.21.15.55:0/1542438127 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f250c066690 0x7f250c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f253a255000 1 Processor -- start 2024-04-02T07:25:28.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f253a255000 1 -- start start 2024-04-02T07:25:28.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f252fe00640 1 --2- 172.21.15.55:0/1542438127 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f250c066690 0x7f250c068b50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2520007db0 tx=0x7f2520008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f253a255000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40050820 0x557c40050c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f253a255000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557c40051140 0x557c40007910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f253a255000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40007e50 0x557c40008230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f253a255000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3fed0100 con 0x557c40050820 2024-04-02T07:25:28.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f253a255000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3fe5dd10 con 0x557c40051140 2024-04-02T07:25:28.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f253a255000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c3fe5b2e0 con 0x557c40007e50 2024-04-02T07:25:28.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f252fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40050820 0x557c40050c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f252fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40050820 0x557c40050c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47914/0 (socket says 172.21.15.55:47914) 2024-04-02T07:25:28.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f252fe00640 1 -- 172.21.15.55:0/1922678514 learned_addr learned my addr 172.21.15.55:0/1922678514 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:28.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f2527e00640 1 --2- 172.21.15.55:0/1922678514 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557c40051140 0x557c40007910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f2534e00640 1 --2- 172.21.15.55:0/1922678514 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40007e50 0x557c40008230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f252fe00640 1 -- 172.21.15.55:0/1922678514 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40007e50 msgr2=0x557c40008230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f252fe00640 1 --2- 172.21.15.55:0/1922678514 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40007e50 0x557c40008230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f252fe00640 1 -- 172.21.15.55:0/1922678514 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557c40051140 msgr2=0x557c40007910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f252fe00640 1 --2- 172.21.15.55:0/1922678514 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557c40051140 0x557c40007910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f252fe00640 1 -- 172.21.15.55:0/1922678514 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c3fb52fb0 con 0x557c40050820 2024-04-02T07:25:28.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f2534e00640 1 --2- 172.21.15.55:0/1922678514 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40007e50 0x557c40008230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:28.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f252fe00640 1 --2- 172.21.15.55:0/1922678514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40050820 0x557c40050c00 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2520010ed0 tx=0x7f2520013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0f7e4b941d2e7f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f2524c00640 1 -- 172.21.15.55:0/1922678514 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520016e90 con 0x557c40050820 2024-04-02T07:25:28.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f2524c00640 1 -- 172.21.15.55:0/1922678514 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252001a070 con 0x557c40050820 2024-04-02T07:25:28.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f2524c00640 1 -- 172.21.15.55:0/1922678514 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520014860 con 0x557c40050820 2024-04-02T07:25:28.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f253a255000 1 -- 172.21.15.55:0/1922678514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40050820 msgr2=0x557c40050c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f253a255000 1 --2- 172.21.15.55:0/1922678514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40050820 0x557c40050c00 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f2520010ed0 tx=0x7f2520013000 comp rx=0 tx=0).stop 2024-04-02T07:25:28.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f253a255000 1 -- 172.21.15.55:0/1922678514 shutdown_connections 2024-04-02T07:25:28.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f253a255000 1 --2- 172.21.15.55:0/1922678514 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40007e50 0x557c40008230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f253a255000 1 --2- 172.21.15.55:0/1922678514 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557c40051140 0x557c40007910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f253a255000 1 --2- 172.21.15.55:0/1922678514 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40050820 0x557c40050c00 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f253a255000 1 -- 172.21.15.55:0/1922678514 >> 172.21.15.55:0/1922678514 conn(0x557c3fe06280 msgr2=0x557c400061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:28.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f253a255000 1 -- 172.21.15.55:0/1922678514 shutdown_connections 2024-04-02T07:25:28.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.653+0000 7f253a255000 1 -- 172.21.15.55:0/1922678514 wait complete. 2024-04-02T07:25:28.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f253a255000 1 -- start start 2024-04-02T07:25:28.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f253a255000 1 Processor -- start 2024-04-02T07:25:28.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f253a255000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40007e50 0x557c4003c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f253a255000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40050820 0x557c4003c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f253a255000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557c40051140 0x557c4003cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f253a255000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3fe56bd0 con 0x557c40007e50 2024-04-02T07:25:28.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f253a255000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3fdf5f60 con 0x557c40051140 2024-04-02T07:25:28.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f253a255000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c3fe14180 con 0x557c40050820 2024-04-02T07:25:28.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f253a255000 10 client.0 _ll_register_callbacks cb 0x557c3fe50240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:25:28.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f252fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40007e50 0x557c4003c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f252fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40007e50 0x557c4003c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47916/0 (socket says 172.21.15.55:47916) 2024-04-02T07:25:28.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f252fe00640 1 -- 172.21.15.55:0/1105536982 learned_addr learned my addr 172.21.15.55:0/1105536982 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:28.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f2527e00640 1 --2- 172.21.15.55:0/1105536982 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40050820 0x557c4003c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f2534e00640 1 --2- 172.21.15.55:0/1105536982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557c40051140 0x557c4003cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f252fe00640 1 -- 172.21.15.55:0/1105536982 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40050820 msgr2=0x557c4003c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f252fe00640 1 --2- 172.21.15.55:0/1105536982 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40050820 0x557c4003c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f252fe00640 1 -- 172.21.15.55:0/1105536982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557c40051140 msgr2=0x557c4003cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f252fe00640 1 --2- 172.21.15.55:0/1105536982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557c40051140 0x557c4003cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f252fe00640 1 -- 172.21.15.55:0/1105536982 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f252000e040 con 0x557c40007e50 2024-04-02T07:25:28.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f252fe00640 1 --2- 172.21.15.55:0/1105536982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40007e50 0x557c4003c0b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f2520016ce0 tx=0x7f2520004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce29c6caf8f18eb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f251d600640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:25:28.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f251d600640 1 -- 172.21.15.55:0/1105536982 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520014ea0 con 0x557c40007e50 2024-04-02T07:25:28.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f251d600640 1 -- 172.21.15.55:0/1105536982 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2520005bb0 con 0x557c40007e50 2024-04-02T07:25:28.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f253a255000 1 -- 172.21.15.55:0/1105536982 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c3fe26850 con 0x557c40007e50 2024-04-02T07:25:28.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f251d600640 1 -- 172.21.15.55:0/1105536982 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2520016e90 con 0x557c40007e50 2024-04-02T07:25:28.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f253a255000 10 client.6366 fetch_fsmap learned FSMap version 33 2024-04-02T07:25:28.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f253a255000 1 -- 172.21.15.55:0/1105536982 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x557c3fe1bbc0 con 0x557c40007e50 2024-04-02T07:25:28.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f251d600640 1 -- 172.21.15.55:0/1105536982 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557c3fe26850 con 0x557c40007e50 2024-04-02T07:25:28.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f251d600640 1 -- 172.21.15.55:0/1105536982 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 33) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2520006030 con 0x557c40007e50 2024-04-02T07:25:28.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f253a255000 10 client.6366 fetch_fsmap finished waiting for FSMap version 33 2024-04-02T07:25:28.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f253a255000 10 client.6366 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-04-02T07:25:28.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f253a255000 20 client.6366 populate_metadata read hostname 'smithi055' 2024-04-02T07:25:28.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f253a255000 1 --2- 172.21.15.55:0/1105536982 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x557c40059180 0x557c40059560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f253a255000 4 client.6366 mds_command: new command op to 6138 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:25:28.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.657+0000 7f253a255000 1 -- 172.21.15.55:0/1105536982 --> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557c3fe539b0 con 0x557c40059180 2024-04-02T07:25:28.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.661+0000 7f2527e00640 1 --2- 172.21.15.55:0/1105536982 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x557c40059180 0x557c40059560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.661+0000 7f2527e00640 1 --2- 172.21.15.55:0/1105536982 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x557c40059180 0x557c40059560 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f673e87d0d7cfa11 server_cookie=530c343cc043ac6b in_seq=0 out_seq=0 2024-04-02T07:25:28.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.661+0000 7f251d600640 10 client.6366 ms_handle_connect on v2:172.21.15.106:6835/1050953219 2024-04-02T07:25:28.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.661+0000 7f251d600640 1 -- 172.21.15.55:0/1105536982 <== mds.0 v2:172.21.15.106:6835/1050953219 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557c3fe539b0 con 0x557c40059180 2024-04-02T07:25:28.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.661+0000 7f251d600640 10 client.6366 handle_command_reply: tid=0 2024-04-02T07:25:28.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.661+0000 7f253a255000 1 client.6366 shutdown 2024-04-02T07:25:28.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.661+0000 7f253a255000 1 -- 172.21.15.55:0/1105536982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40007e50 msgr2=0x557c4003c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.661+0000 7f253a255000 1 --2- 172.21.15.55:0/1105536982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40007e50 0x557c4003c0b0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f2520016ce0 tx=0x7f2520004740 comp rx=0 tx=0).stop 2024-04-02T07:25:28.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.661+0000 7f253a255000 1 -- 172.21.15.55:0/1105536982 shutdown_connections 2024-04-02T07:25:28.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.661+0000 7f253a255000 1 --2- 172.21.15.55:0/1105536982 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557c40051140 0x557c4003cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.661+0000 7f253a255000 1 --2- 172.21.15.55:0/1105536982 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x557c40059180 0x557c40059560 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.661+0000 7f253a255000 1 --2- 172.21.15.55:0/1105536982 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40050820 0x557c4003c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.661+0000 7f253a255000 1 --2- 172.21.15.55:0/1105536982 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40007e50 0x557c4003c0b0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.661+0000 7f251d600640 0 client.6366 ms_handle_reset on v2:172.21.15.106:6835/1050953219 2024-04-02T07:25:28.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.661+0000 7f253a255000 1 -- 172.21.15.55:0/1105536982 >> 172.21.15.55:0/1105536982 conn(0x557c3fe06280 msgr2=0x557c400068f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:28.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.661+0000 7f253a255000 1 -- 172.21.15.55:0/1105536982 shutdown_connections 2024-04-02T07:25:28.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.661+0000 7f253a255000 1 -- 172.21.15.55:0/1105536982 wait complete. 2024-04-02T07:25:28.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.661+0000 7f253a255000 20 client.6366 trim_cache size 0 max 16384 2024-04-02T07:25:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f253a255000 1 Processor -- start 2024-04-02T07:25:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f253a255000 1 -- start start 2024-04-02T07:25:28.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f253a255000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40007e50 0x557c40057550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f253a255000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40050820 0x557c40057a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f253a255000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557c40051140 0x557c40063280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f253a255000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3fb13c30 con 0x557c40050820 2024-04-02T07:25:28.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f253a255000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3fe76a50 con 0x557c40051140 2024-04-02T07:25:28.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f253a255000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c4003cb90 con 0x557c40007e50 2024-04-02T07:25:28.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f2527e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40050820 0x557c40057a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f2527e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40050820 0x557c40057a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47924/0 (socket says 172.21.15.55:47924) 2024-04-02T07:25:28.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f2527e00640 1 -- 172.21.15.55:0/3612468539 learned_addr learned my addr 172.21.15.55:0/3612468539 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:28.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f252fe00640 1 --2- 172.21.15.55:0/3612468539 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40007e50 0x557c40057550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f2534e00640 1 --2- 172.21.15.55:0/3612468539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557c40051140 0x557c40063280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f2527e00640 1 -- 172.21.15.55:0/3612468539 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40007e50 msgr2=0x557c40057550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f2527e00640 1 --2- 172.21.15.55:0/3612468539 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40007e50 0x557c40057550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f2527e00640 1 -- 172.21.15.55:0/3612468539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557c40051140 msgr2=0x557c40063280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f2527e00640 1 --2- 172.21.15.55:0/3612468539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557c40051140 0x557c40063280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f2527e00640 1 -- 172.21.15.55:0/3612468539 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557c3fe01f10 con 0x557c40050820 2024-04-02T07:25:28.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f2527e00640 1 --2- 172.21.15.55:0/3612468539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40050820 0x557c40057a90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f253006f4c0 tx=0x7f2518008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9254770d891539 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f2525600640 1 -- 172.21.15.55:0/3612468539 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f251801b040 con 0x557c40050820 2024-04-02T07:25:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f2525600640 1 -- 172.21.15.55:0/3612468539 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f251801dd60 con 0x557c40050820 2024-04-02T07:25:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f2525600640 1 -- 172.21.15.55:0/3612468539 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2518004030 con 0x557c40050820 2024-04-02T07:25:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f253a255000 1 -- 172.21.15.55:0/3612468539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40050820 msgr2=0x557c40057a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f253a255000 1 --2- 172.21.15.55:0/3612468539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40050820 0x557c40057a90 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f253006f4c0 tx=0x7f2518008040 comp rx=0 tx=0).stop 2024-04-02T07:25:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f253a255000 1 -- 172.21.15.55:0/3612468539 shutdown_connections 2024-04-02T07:25:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f253a255000 1 --2- 172.21.15.55:0/3612468539 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557c40051140 0x557c40063280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f253a255000 1 --2- 172.21.15.55:0/3612468539 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40050820 0x557c40057a90 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f253a255000 1 --2- 172.21.15.55:0/3612468539 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40007e50 0x557c40057550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f253a255000 1 -- 172.21.15.55:0/3612468539 >> 172.21.15.55:0/3612468539 conn(0x557c3fe06280 msgr2=0x557c4000dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f253a255000 1 -- 172.21.15.55:0/3612468539 shutdown_connections 2024-04-02T07:25:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f253a255000 1 -- 172.21.15.55:0/3612468539 wait complete. 2024-04-02T07:25:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.677+0000 7f253a255000 1 -- start start 2024-04-02T07:25:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f253a255000 1 Processor -- start 2024-04-02T07:25:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f253a255000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40007e50 0x557c40098750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f253a255000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557c40050820 0x557c40066040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f253a255000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40051140 0x557c40066580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f253a255000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3fe26fb0 con 0x557c40007e50 2024-04-02T07:25:28.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f253a255000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557c3fe9a2b0 con 0x557c40050820 2024-04-02T07:25:28.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f253a255000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x557c3fe218b0 con 0x557c40051140 2024-04-02T07:25:28.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f253a255000 10 client.0 _ll_register_callbacks cb 0x557c3fe077a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:25:28.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f252fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40007e50 0x557c40098750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f252fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40007e50 0x557c40098750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47928/0 (socket says 172.21.15.55:47928) 2024-04-02T07:25:28.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f252fe00640 1 -- 172.21.15.55:0/1853335426 learned_addr learned my addr 172.21.15.55:0/1853335426 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:28.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f2527e00640 1 --2- 172.21.15.55:0/1853335426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557c40050820 0x557c40066040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f2534e00640 1 --2- 172.21.15.55:0/1853335426 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40051140 0x557c40066580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f252fe00640 1 -- 172.21.15.55:0/1853335426 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40051140 msgr2=0x557c40066580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f252fe00640 1 --2- 172.21.15.55:0/1853335426 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40051140 0x557c40066580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f252fe00640 1 -- 172.21.15.55:0/1853335426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557c40050820 msgr2=0x557c40066040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f252fe00640 1 --2- 172.21.15.55:0/1853335426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557c40050820 0x557c40066040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f252fe00640 1 -- 172.21.15.55:0/1853335426 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f251800e040 con 0x557c40007e50 2024-04-02T07:25:28.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f252fe00640 1 --2- 172.21.15.55:0/1853335426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40007e50 0x557c40098750 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2520006a30 tx=0x7f2520016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f80b6c9e8be651e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f251d600640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:25:28.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f251d600640 1 -- 172.21.15.55:0/1853335426 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520005fc0 con 0x557c40007e50 2024-04-02T07:25:28.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f251d600640 1 -- 172.21.15.55:0/1853335426 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2520006540 con 0x557c40007e50 2024-04-02T07:25:28.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f253a255000 1 -- 172.21.15.55:0/1853335426 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557c4000ad00 con 0x557c40007e50 2024-04-02T07:25:28.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f251d600640 1 -- 172.21.15.55:0/1853335426 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2520006120 con 0x557c40007e50 2024-04-02T07:25:28.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f253a255000 10 client.6372 fetch_fsmap learned FSMap version 33 2024-04-02T07:25:28.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f253a255000 1 -- 172.21.15.55:0/1853335426 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x557c3fdf5a80 con 0x557c40007e50 2024-04-02T07:25:28.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f251d600640 1 -- 172.21.15.55:0/1853335426 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557c4000ad00 con 0x557c40007e50 2024-04-02T07:25:28.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f251d600640 1 -- 172.21.15.55:0/1853335426 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 33) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2520033440 con 0x557c40007e50 2024-04-02T07:25:28.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f253a255000 10 client.6372 fetch_fsmap finished waiting for FSMap version 33 2024-04-02T07:25:28.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f253a255000 10 client.6372 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-04-02T07:25:28.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f253a255000 20 client.6372 populate_metadata read hostname 'smithi055' 2024-04-02T07:25:28.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f253a255000 1 --2- 172.21.15.55:0/1853335426 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x557c40068530 0x557c40066ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f253a255000 4 client.6372 mds_command: new command op to 6138 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}] 2024-04-02T07:25:28.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f253a255000 1 -- 172.21.15.55:0/1853335426 --> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["recursive"]}) v1 -- 0x557c3fe26570 con 0x557c40068530 2024-04-02T07:25:28.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f2527e00640 1 --2- 172.21.15.55:0/1853335426 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x557c40068530 0x557c40066ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.690 INFO:tasks.ceph.mds.d.smithi106.stderr:2024-04-02T07:25:28.683+0000 7f442aa00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6327=0-4194304@1} caps={6327=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6327 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x563cd6c1bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-02T07:25:28.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f2527e00640 1 --2- 172.21.15.55:0/1853335426 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x557c40068530 0x557c40066ac0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dba5d170d81ecf75 server_cookie=903bf029dd3b49a2 in_seq=0 out_seq=0 2024-04-02T07:25:28.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.681+0000 7f251d600640 10 client.6372 ms_handle_connect on v2:172.21.15.106:6835/1050953219 2024-04-02T07:25:28.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f251d600640 1 -- 172.21.15.55:0/1853335426 <== mds.0 v2:172.21.15.106:6835/1050953219 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x557c3fe26570 con 0x557c40068530 2024-04-02T07:25:28.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f251d600640 10 client.6372 handle_command_reply: tid=0 2024-04-02T07:25:28.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f253a255000 1 client.6372 shutdown 2024-04-02T07:25:28.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f253a255000 1 -- 172.21.15.55:0/1853335426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40007e50 msgr2=0x557c40098750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f253a255000 1 --2- 172.21.15.55:0/1853335426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40007e50 0x557c40098750 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f2520006a30 tx=0x7f2520016000 comp rx=0 tx=0).stop 2024-04-02T07:25:28.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f253a255000 1 -- 172.21.15.55:0/1853335426 shutdown_connections 2024-04-02T07:25:28.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f253a255000 1 --2- 172.21.15.55:0/1853335426 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x557c40068530 0x557c40066ac0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f253a255000 1 --2- 172.21.15.55:0/1853335426 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x557c40051140 0x557c40066580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f253a255000 1 --2- 172.21.15.55:0/1853335426 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x557c40050820 0x557c40066040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f253a255000 1 --2- 172.21.15.55:0/1853335426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x557c40007e50 0x557c40098750 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f253a255000 1 -- 172.21.15.55:0/1853335426 >> 172.21.15.55:0/1853335426 conn(0x557c3fe06280 msgr2=0x557c4000d3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:28.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f251d600640 0 client.6372 ms_handle_reset on v2:172.21.15.106:6835/1050953219 2024-04-02T07:25:28.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f253a255000 1 -- 172.21.15.55:0/1853335426 shutdown_connections 2024-04-02T07:25:28.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f253a255000 1 -- 172.21.15.55:0/1853335426 wait complete. 2024-04-02T07:25:28.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f253a255000 20 client.6372 trim_cache size 0 max 16384 2024-04-02T07:25:28.693 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:25:28.693 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-04-02T07:25:28.693 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "8c0fe2e7-ac73-4071-a74e-58f09a7365bf", 2024-04-02T07:25:28.693 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-04-02T07:25:28.693 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:25:28.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f2535800640 1 -- 172.21.15.55:0/1542438127 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f250c066690 msgr2=0x7f250c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f2535800640 1 --2- 172.21.15.55:0/1542438127 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f250c066690 0x7f250c068b50 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f2520007db0 tx=0x7f2520008040 comp rx=0 tx=0).stop 2024-04-02T07:25:28.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f2535800640 1 -- 172.21.15.55:0/1542438127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f253015ff20 msgr2=0x7f25300c98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f2535800640 1 --2- 172.21.15.55:0/1542438127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f253015ff20 0x7f25300c98e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f25280af040 tx=0x7f2528019790 comp rx=0 tx=0).stop 2024-04-02T07:25:28.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f2535800640 1 -- 172.21.15.55:0/1542438127 shutdown_connections 2024-04-02T07:25:28.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f2535800640 1 --2- 172.21.15.55:0/1542438127 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f253015ff20 0x7f25300c98e0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f2535800640 1 --2- 172.21.15.55:0/1542438127 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2530098f50 0x7f25300ae890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f2535800640 1 --2- 172.21.15.55:0/1542438127 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f250c066690 0x7f250c068b50 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f2535800640 1 --2- 172.21.15.55:0/1542438127 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f253006aea0 0x7f25300ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f2535800640 1 -- 172.21.15.55:0/1542438127 >> 172.21.15.55:0/1542438127 conn(0x7f25300b1fb0 msgr2=0x7f25300cc040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:28.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f2535800640 1 -- 172.21.15.55:0/1542438127 shutdown_connections 2024-04-02T07:25:28.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.685+0000 7f2535800640 1 -- 172.21.15.55:0/1542438127 wait complete. 2024-04-02T07:25:28.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:25:28.709 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-02T07:25:28.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.845+0000 7f7961200640 1 Processor -- start 2024-04-02T07:25:28.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.845+0000 7f7961200640 1 -- start start 2024-04-02T07:25:28.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.849+0000 7f7961200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f795c098a10 0x7f795c098e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.849+0000 7f7961200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f795c06b920 0x7f795c06bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.849+0000 7f7961200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f795c15ce40 con 0x7f795c15ca60 2024-04-02T07:25:28.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.849+0000 7f7961200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795c0993c0 con 0x7f795c06b920 2024-04-02T07:25:28.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.849+0000 7f7961200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f795c0ceeb0 con 0x7f795c098a10 2024-04-02T07:25:28.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.849+0000 7f795a800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f795c06b920 0x7f795c06bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.849+0000 7f7953e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f795c098a10 0x7f795c098e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.849+0000 7f795a800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f795c06b920 0x7f795c06bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47944/0 (socket says 172.21.15.55:47944) 2024-04-02T07:25:28.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.849+0000 7f795a800640 1 -- 172.21.15.55:0/2862228783 learned_addr learned my addr 172.21.15.55:0/2862228783 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:28.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.849+0000 7f795a800640 1 -- 172.21.15.55:0/2862228783 >> v2:172.21.15.106:3300/0 conn(0x7f795c098a10 msgr2=0x7f795c098e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.849+0000 7f795a800640 1 --2- 172.21.15.55:0/2862228783 >> v2:172.21.15.106:3300/0 conn(0x7f795c098a10 0x7f795c098e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.849+0000 7f795a800640 1 -- 172.21.15.55:0/2862228783 >> v1:172.21.15.106:6789/0 conn(0x7f795c15ca60 legacy=0x7f795c0cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.849+0000 7f7959400640 1 -- 172.21.15.55:0/2862228783 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3998402729 0 0) 0x7f795c15ce40 con 0x7f795c15ca60 2024-04-02T07:25:28.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.849+0000 7f795a800640 1 -- 172.21.15.55:0/2862228783 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c0cf190 con 0x7f795c06b920 2024-04-02T07:25:28.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.849+0000 7f795a800640 1 --2- 172.21.15.55:0/2862228783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f795c06b920 0x7f795c06bd30 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f795c0716c0 tx=0x7f795401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b3ee7a8b0badfdd server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7959400640 1 -- 172.21.15.55:0/2862228783 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79540a57f0 con 0x7f795c06b920 2024-04-02T07:25:28.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7959400640 1 -- 172.21.15.55:0/2862228783 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79540a5950 con 0x7f795c06b920 2024-04-02T07:25:28.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7959400640 1 -- 172.21.15.55:0/2862228783 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79540a5ce0 con 0x7f795c06b920 2024-04-02T07:25:28.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7961200640 1 -- 172.21.15.55:0/2862228783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f795c06b920 msgr2=0x7f795c06bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7961200640 1 --2- 172.21.15.55:0/2862228783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f795c06b920 0x7f795c06bd30 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f795c0716c0 tx=0x7f795401c930 comp rx=0 tx=0).stop 2024-04-02T07:25:28.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7961200640 1 -- 172.21.15.55:0/2862228783 shutdown_connections 2024-04-02T07:25:28.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7961200640 1 --2- 172.21.15.55:0/2862228783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f795c06b920 0x7f795c06bd30 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7961200640 1 --2- 172.21.15.55:0/2862228783 >> v2:172.21.15.106:3300/0 conn(0x7f795c098a10 0x7f795c098e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7961200640 1 -- 172.21.15.55:0/2862228783 >> 172.21.15.55:0/2862228783 conn(0x7f795c0b2150 msgr2=0x7f795c0b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:28.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7961200640 1 -- 172.21.15.55:0/2862228783 shutdown_connections 2024-04-02T07:25:28.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7961200640 1 -- 172.21.15.55:0/2862228783 wait complete. 2024-04-02T07:25:28.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7961200640 1 Processor -- start 2024-04-02T07:25:28.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7961200640 1 -- start start 2024-04-02T07:25:28.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7961200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f795c06b920 0x7f795c0c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7961200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f795c098a10 0x7f795c0c8c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7961200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f795c15ca60 0x7f795c0c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7961200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c0c54a0 con 0x7f795c15ca60 2024-04-02T07:25:28.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7961200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f795c159530 con 0x7f795c098a10 2024-04-02T07:25:28.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7961200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f795c0c4890 con 0x7f795c06b920 2024-04-02T07:25:28.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f795a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f795c15ca60 0x7f795c0c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7959e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f795c06b920 0x7f795c0c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f7953e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f795c098a10 0x7f795c0c8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f795a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f795c15ca60 0x7f795c0c5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47948/0 (socket says 172.21.15.55:47948) 2024-04-02T07:25:28.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.853+0000 7f795a800640 1 -- 172.21.15.55:0/2616836868 learned_addr learned my addr 172.21.15.55:0/2616836868 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:28.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.857+0000 7f7959e00640 1 -- 172.21.15.55:0/2616836868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f795c098a10 msgr2=0x7f795c0c8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.857+0000 7f7959e00640 1 --2- 172.21.15.55:0/2616836868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f795c098a10 0x7f795c0c8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.857+0000 7f7959e00640 1 -- 172.21.15.55:0/2616836868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f795c15ca60 msgr2=0x7f795c0c5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.857+0000 7f7959e00640 1 --2- 172.21.15.55:0/2616836868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f795c15ca60 0x7f795c0c5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.857+0000 7f7959e00640 1 -- 172.21.15.55:0/2616836868 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7954009b30 con 0x7f795c06b920 2024-04-02T07:25:28.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.857+0000 7f7959e00640 1 --2- 172.21.15.55:0/2616836868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f795c06b920 0x7f795c0c4190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f794c00c410 tx=0x7f794c00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.857+0000 7f7952000640 1 -- 172.21.15.55:0/2616836868 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c0054e0 con 0x7f795c06b920 2024-04-02T07:25:28.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.857+0000 7f7952000640 1 -- 172.21.15.55:0/2616836868 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f794c003600 con 0x7f795c06b920 2024-04-02T07:25:28.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.857+0000 7f7952000640 1 -- 172.21.15.55:0/2616836868 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f794c003990 con 0x7f795c06b920 2024-04-02T07:25:28.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.857+0000 7f7961200640 1 -- 172.21.15.55:0/2616836868 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f795c0c4b70 con 0x7f795c06b920 2024-04-02T07:25:28.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.857+0000 7f7961200640 1 -- 172.21.15.55:0/2616836868 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795c0c5130 con 0x7f795c06b920 2024-04-02T07:25:28.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.857+0000 7f7952000640 1 -- 172.21.15.55:0/2616836868 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f794c003af0 con 0x7f795c06b920 2024-04-02T07:25:28.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f7952000640 1 --2- 172.21.15.55:0/2616836868 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f79380666c0 0x7f7938068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f7952000640 1 -- 172.21.15.55:0/2616836868 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f794c083740 con 0x7f795c06b920 2024-04-02T07:25:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f79646e2000 1 Processor -- start 2024-04-02T07:25:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f7953e00640 1 --2- 172.21.15.55:0/2616836868 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f79380666c0 0x7f7938068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f79646e2000 1 -- start start 2024-04-02T07:25:28.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f7953e00640 1 --2- 172.21.15.55:0/2616836868 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f79380666c0 0x7f7938068b80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f795c0b04c0 tx=0x7f7944009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f79646e2000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f86590fa70 0x55f86590fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f79646e2000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f865910390 0x55f8658c34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f79646e2000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8658c3a00 0x55f8658c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f79646e2000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f86578e630 con 0x55f8658c3a00 2024-04-02T07:25:28.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f79646e2000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f86571bbd0 con 0x55f86590fa70 2024-04-02T07:25:28.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f79646e2000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8657191a0 con 0x55f865910390 2024-04-02T07:25:28.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f795a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8658c3a00 0x55f8658c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f795a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8658c3a00 0x55f8658c3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47962/0 (socket says 172.21.15.55:47962) 2024-04-02T07:25:28.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f795a800640 1 -- 172.21.15.55:0/1612314091 learned_addr learned my addr 172.21.15.55:0/1612314091 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:28.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f7953e00640 1 --2- 172.21.15.55:0/1612314091 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f865910390 0x55f8658c34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f7959e00640 1 --2- 172.21.15.55:0/1612314091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f86590fa70 0x55f86590fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f795a800640 1 -- 172.21.15.55:0/1612314091 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f865910390 msgr2=0x55f8658c34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f795a800640 1 --2- 172.21.15.55:0/1612314091 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f865910390 0x55f8658c34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f795a800640 1 -- 172.21.15.55:0/1612314091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f86590fa70 msgr2=0x55f86590fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f795a800640 1 --2- 172.21.15.55:0/1612314091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f86590fa70 0x55f86590fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f795a800640 1 -- 172.21.15.55:0/1612314091 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f865410e20 con 0x55f8658c3a00 2024-04-02T07:25:28.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f7953e00640 1 --2- 172.21.15.55:0/1612314091 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f865910390 0x55f8658c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:28.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f7959e00640 1 --2- 172.21.15.55:0/1612314091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f86590fa70 0x55f86590fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:28.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f795a800640 1 --2- 172.21.15.55:0/1612314091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8658c3a00 0x55f8658c3de0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7954098510 tx=0x7f7954004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718ce7ad6d4a7d5f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f794aa00640 1 -- 172.21.15.55:0/1612314091 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79540a5cc0 con 0x55f8658c3a00 2024-04-02T07:25:28.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f794aa00640 1 -- 172.21.15.55:0/1612314091 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79540a5e20 con 0x55f8658c3a00 2024-04-02T07:25:28.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f794aa00640 1 -- 172.21.15.55:0/1612314091 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79540c0640 con 0x55f8658c3a00 2024-04-02T07:25:28.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f79646e2000 1 -- 172.21.15.55:0/1612314091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8658c3a00 msgr2=0x55f8658c3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f79646e2000 1 --2- 172.21.15.55:0/1612314091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8658c3a00 0x55f8658c3de0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f7954098510 tx=0x7f7954004ac0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f79646e2000 1 -- 172.21.15.55:0/1612314091 shutdown_connections 2024-04-02T07:25:28.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f79646e2000 1 --2- 172.21.15.55:0/1612314091 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8658c3a00 0x55f8658c3de0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f79646e2000 1 --2- 172.21.15.55:0/1612314091 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f865910390 0x55f8658c34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f79646e2000 1 --2- 172.21.15.55:0/1612314091 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f86590fa70 0x55f86590fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f79646e2000 1 -- 172.21.15.55:0/1612314091 >> 172.21.15.55:0/1612314091 conn(0x55f8656c4160 msgr2=0x55f8658f2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:28.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f79646e2000 1 -- 172.21.15.55:0/1612314091 shutdown_connections 2024-04-02T07:25:28.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.861+0000 7f79646e2000 1 -- 172.21.15.55:0/1612314091 wait complete. 2024-04-02T07:25:28.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f79646e2000 1 -- start start 2024-04-02T07:25:28.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f79646e2000 1 Processor -- start 2024-04-02T07:25:28.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f79646e2000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f8658c3a00 0x55f8658cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f79646e2000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f86590fa70 0x55f8658f3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f79646e2000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f865910390 0x55f8658f3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f79646e2000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f865714a90 con 0x55f865910390 2024-04-02T07:25:28.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f79646e2000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8656b3d40 con 0x55f8658c3a00 2024-04-02T07:25:28.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f79646e2000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8656d1f30 con 0x55f86590fa70 2024-04-02T07:25:28.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f79646e2000 10 client.0 _ll_register_callbacks cb 0x55f865776810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:25:28.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f795a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f865910390 0x55f8658f3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f795a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f865910390 0x55f8658f3f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47964/0 (socket says 172.21.15.55:47964) 2024-04-02T07:25:28.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f795a800640 1 -- 172.21.15.55:0/3812020639 learned_addr learned my addr 172.21.15.55:0/3812020639 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:28.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f7953e00640 1 --2- 172.21.15.55:0/3812020639 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f86590fa70 0x55f8658f3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f7959e00640 1 --2- 172.21.15.55:0/3812020639 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f8658c3a00 0x55f8658cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f795a800640 1 -- 172.21.15.55:0/3812020639 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f86590fa70 msgr2=0x55f8658f3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f795a800640 1 --2- 172.21.15.55:0/3812020639 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f86590fa70 0x55f8658f3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f795a800640 1 -- 172.21.15.55:0/3812020639 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f8658c3a00 msgr2=0x55f8658cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f795a800640 1 --2- 172.21.15.55:0/3812020639 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f8658c3a00 0x55f8658cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f795a800640 1 -- 172.21.15.55:0/3812020639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f795c0cf190 con 0x55f865910390 2024-04-02T07:25:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f795a800640 1 --2- 172.21.15.55:0/3812020639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f865910390 0x55f8658f3f90 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f79540af040 tx=0x7f795401b170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b78eb3a3155075f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f793f400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:25:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f793f400640 1 -- 172.21.15.55:0/3812020639 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7954003ba0 con 0x55f865910390 2024-04-02T07:25:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f793f400640 1 -- 172.21.15.55:0/3812020639 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7954003d00 con 0x55f865910390 2024-04-02T07:25:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f79646e2000 1 -- 172.21.15.55:0/3812020639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f8657133e0 con 0x55f865910390 2024-04-02T07:25:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f793f400640 1 -- 172.21.15.55:0/3812020639 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7954009290 con 0x55f865910390 2024-04-02T07:25:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f79646e2000 10 client.6384 fetch_fsmap learned FSMap version 33 2024-04-02T07:25:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f79646e2000 1 -- 172.21.15.55:0/3812020639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x55f8656d9aa0 con 0x55f865910390 2024-04-02T07:25:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f793f400640 1 -- 172.21.15.55:0/3812020639 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f8657133e0 con 0x55f865910390 2024-04-02T07:25:28.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f793f400640 1 -- 172.21.15.55:0/3812020639 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 33) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7954004040 con 0x55f865910390 2024-04-02T07:25:28.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f79646e2000 10 client.6384 fetch_fsmap finished waiting for FSMap version 33 2024-04-02T07:25:28.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f79646e2000 10 client.6384 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-04-02T07:25:28.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f79646e2000 20 client.6384 populate_metadata read hostname 'smithi055' 2024-04-02T07:25:28.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f79646e2000 1 --2- 172.21.15.55:0/3812020639 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55f8659172d0 0x55f8659176b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f79646e2000 4 client.6384 mds_command: new command op to 6138 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:25:28.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f79646e2000 1 -- 172.21.15.55:0/3812020639 --> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f8656e4d00 con 0x55f8659172d0 2024-04-02T07:25:28.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f7959e00640 1 --2- 172.21.15.55:0/3812020639 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55f8659172d0 0x55f8659176b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f7959e00640 1 --2- 172.21.15.55:0/3812020639 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55f8659172d0 0x55f8659176b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dea2654f74f0118 server_cookie=75af95275e1614e1 in_seq=0 out_seq=0 2024-04-02T07:25:28.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.865+0000 7f793f400640 10 client.6384 ms_handle_connect on v2:172.21.15.106:6835/1050953219 2024-04-02T07:25:28.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.869+0000 7f793f400640 1 -- 172.21.15.55:0/3812020639 <== mds.0 v2:172.21.15.106:6835/1050953219 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f8656e4d00 con 0x55f8659172d0 2024-04-02T07:25:28.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.869+0000 7f793f400640 10 client.6384 handle_command_reply: tid=0 2024-04-02T07:25:28.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.869+0000 7f79646e2000 1 client.6384 shutdown 2024-04-02T07:25:28.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.869+0000 7f79646e2000 1 -- 172.21.15.55:0/3812020639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f865910390 msgr2=0x55f8658f3f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.869+0000 7f79646e2000 1 --2- 172.21.15.55:0/3812020639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f865910390 0x55f8658f3f90 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f79540af040 tx=0x7f795401b170 comp rx=0 tx=0).stop 2024-04-02T07:25:28.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.869+0000 7f79646e2000 1 -- 172.21.15.55:0/3812020639 shutdown_connections 2024-04-02T07:25:28.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.869+0000 7f79646e2000 1 --2- 172.21.15.55:0/3812020639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f865910390 0x55f8658f3f90 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.869+0000 7f79646e2000 1 --2- 172.21.15.55:0/3812020639 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55f8659172d0 0x55f8659176b0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.869+0000 7f79646e2000 1 --2- 172.21.15.55:0/3812020639 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f86590fa70 0x55f8658f3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.869+0000 7f79646e2000 1 --2- 172.21.15.55:0/3812020639 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f8658c3a00 0x55f8658cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.869+0000 7f793f400640 0 client.6384 ms_handle_reset on v2:172.21.15.106:6835/1050953219 2024-04-02T07:25:28.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.869+0000 7f79646e2000 1 -- 172.21.15.55:0/3812020639 >> 172.21.15.55:0/3812020639 conn(0x55f8656c4160 msgr2=0x55f8658c2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:28.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.869+0000 7f79646e2000 1 -- 172.21.15.55:0/3812020639 shutdown_connections 2024-04-02T07:25:28.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.869+0000 7f79646e2000 1 -- 172.21.15.55:0/3812020639 wait complete. 2024-04-02T07:25:28.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.869+0000 7f79646e2000 20 client.6384 trim_cache size 0 max 16384 2024-04-02T07:25:28.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.881+0000 7f79646e2000 1 Processor -- start 2024-04-02T07:25:28.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.881+0000 7f79646e2000 1 -- start start 2024-04-02T07:25:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f8656c4160 0x55f8658c2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f8658c3a00 0x55f8658c3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f86590fa70 0x55f8658c3de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8653d1aa0 con 0x55f86590fa70 2024-04-02T07:25:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8656d5c60 con 0x55f8658c3a00 2024-04-02T07:25:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8659267e0 con 0x55f8656c4160 2024-04-02T07:25:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f795a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f86590fa70 0x55f8658c3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f795a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f86590fa70 0x55f8658c3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47978/0 (socket says 172.21.15.55:47978) 2024-04-02T07:25:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f795a800640 1 -- 172.21.15.55:0/216614258 learned_addr learned my addr 172.21.15.55:0/216614258 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f7959e00640 1 --2- 172.21.15.55:0/216614258 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f8656c4160 0x55f8658c2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f7953e00640 1 --2- 172.21.15.55:0/216614258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f8658c3a00 0x55f8658c3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f795a800640 1 -- 172.21.15.55:0/216614258 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f8656c4160 msgr2=0x55f8658c2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f795a800640 1 --2- 172.21.15.55:0/216614258 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f8656c4160 0x55f8658c2c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f795a800640 1 -- 172.21.15.55:0/216614258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f8658c3a00 msgr2=0x55f8658c3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f795a800640 1 --2- 172.21.15.55:0/216614258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f8658c3a00 0x55f8658c3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f795a800640 1 -- 172.21.15.55:0/216614258 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f8656bfdf0 con 0x55f86590fa70 2024-04-02T07:25:28.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f795a800640 1 --2- 172.21.15.55:0/216614258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f86590fa70 0x55f8658c3de0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f795401c970 tx=0x7f79540c2040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cac51289f5775a5f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f794b400640 1 -- 172.21.15.55:0/216614258 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79540a57f0 con 0x55f86590fa70 2024-04-02T07:25:28.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f794b400640 1 -- 172.21.15.55:0/216614258 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7954009510 con 0x55f86590fa70 2024-04-02T07:25:28.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f794b400640 1 -- 172.21.15.55:0/216614258 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7954004500 con 0x55f86590fa70 2024-04-02T07:25:28.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 -- 172.21.15.55:0/216614258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f86590fa70 msgr2=0x55f8658c3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 --2- 172.21.15.55:0/216614258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f86590fa70 0x55f8658c3de0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f795401c970 tx=0x7f79540c2040 comp rx=0 tx=0).stop 2024-04-02T07:25:28.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 -- 172.21.15.55:0/216614258 shutdown_connections 2024-04-02T07:25:28.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 --2- 172.21.15.55:0/216614258 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f86590fa70 0x55f8658c3de0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 --2- 172.21.15.55:0/216614258 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f8658c3a00 0x55f8658c3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 --2- 172.21.15.55:0/216614258 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f8656c4160 0x55f8658c2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 -- 172.21.15.55:0/216614258 >> 172.21.15.55:0/216614258 conn(0x55f86590f3b0 msgr2=0x55f8658cb870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:28.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 -- 172.21.15.55:0/216614258 shutdown_connections 2024-04-02T07:25:28.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 -- 172.21.15.55:0/216614258 wait complete. 2024-04-02T07:25:28.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 -- start start 2024-04-02T07:25:28.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 Processor -- start 2024-04-02T07:25:28.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f8656c4160 0x55f865952f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8658c3a00 0x55f8658c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f86590fa70 0x55f8658c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f8657cdec0 con 0x55f8658c3a00 2024-04-02T07:25:28.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f865713920 con 0x55f86590fa70 2024-04-02T07:25:28.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.885+0000 7f79646e2000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f8657175f0 con 0x55f8656c4160 2024-04-02T07:25:28.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 10 client.0 _ll_register_callbacks cb 0x7f7954009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:25:28.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f7953e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8658c3a00 0x55f8658c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f7959e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f8656c4160 0x55f865952f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f795a800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f86590fa70 0x55f8658c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f7959e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f8656c4160 0x55f865952f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:40190/0 (socket says 172.21.15.55:40190) 2024-04-02T07:25:28.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f795a800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f86590fa70 0x55f8658c70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:41560/0 (socket says 172.21.15.55:41560) 2024-04-02T07:25:28.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f7959e00640 1 -- 172.21.15.55:0/3499654345 learned_addr learned my addr 172.21.15.55:0/3499654345 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:28.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f7953e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8658c3a00 0x55f8658c6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47986/0 (socket says 172.21.15.55:47986) 2024-04-02T07:25:28.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f795a800640 1 -- 172.21.15.55:0/3499654345 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f8656c4160 msgr2=0x55f865952f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f795a800640 1 --2- 172.21.15.55:0/3499654345 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f8656c4160 0x55f865952f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f795a800640 1 -- 172.21.15.55:0/3499654345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8658c3a00 msgr2=0x55f8658c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:28.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f795a800640 1 --2- 172.21.15.55:0/3499654345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8658c3a00 0x55f8658c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f795a800640 1 -- 172.21.15.55:0/3499654345 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f8656d9aa0 con 0x55f86590fa70 2024-04-02T07:25:28.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f7959e00640 1 --2- 172.21.15.55:0/3499654345 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f8656c4160 0x55f865952f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:25:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f795a800640 1 --2- 172.21.15.55:0/3499654345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f86590fa70 0x55f8658c70e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f795401b1b0 tx=0x7f79540a7070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b843d955fbf14a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f793f400640 10 client.0 ms_handle_connect on v2:172.21.15.106:3300/0 2024-04-02T07:25:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f793f400640 1 -- 172.21.15.55:0/3499654345 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79540df070 con 0x55f86590fa70 2024-04-02T07:25:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f793f400640 1 -- 172.21.15.55:0/3499654345 <== mon.1 v2:172.21.15.106:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7954004490 con 0x55f86590fa70 2024-04-02T07:25:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 1 -- 172.21.15.55:0/3499654345 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f865926920 con 0x55f86590fa70 2024-04-02T07:25:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f793f400640 1 -- 172.21.15.55:0/3499654345 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7954004710 con 0x55f86590fa70 2024-04-02T07:25:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 10 client.6163 fetch_fsmap learned FSMap version 33 2024-04-02T07:25:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 1 -- 172.21.15.55:0/3499654345 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=2+}) v3 -- 0x55f8656b3960 con 0x55f86590fa70 2024-04-02T07:25:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f793f400640 1 -- 172.21.15.55:0/3499654345 <== mon.1 v2:172.21.15.106:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f865926920 con 0x55f86590fa70 2024-04-02T07:25:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f793f400640 1 -- 172.21.15.55:0/3499654345 <== mon.1 v2:172.21.15.106:3300/0 5 ==== fsmap(e 33) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7954005d20 con 0x55f86590fa70 2024-04-02T07:25:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 10 client.6163 fetch_fsmap finished waiting for FSMap version 33 2024-04-02T07:25:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 10 client.6163 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-04-02T07:25:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 20 client.6163 populate_metadata read hostname 'smithi055' 2024-04-02T07:25:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 1 --2- 172.21.15.55:0/3499654345 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55f865910390 0x55f8658c7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:28.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 4 client.6163 mds_command: new command op to 6138 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-02T07:25:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 1 -- 172.21.15.55:0/3499654345 --> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f8656d1970 con 0x55f865910390 2024-04-02T07:25:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f7959e00640 1 --2- 172.21.15.55:0/3499654345 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55f865910390 0x55f8658c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f7959e00640 1 --2- 172.21.15.55:0/3499654345 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55f865910390 0x55f8658c7620 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=291e6c287424aaaf server_cookie=f4003865a4f00a42 in_seq=0 out_seq=0 2024-04-02T07:25:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f793f400640 10 client.6163 ms_handle_connect on v2:172.21.15.106:6835/1050953219 2024-04-02T07:25:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f793f400640 1 -- 172.21.15.55:0/3499654345 <== mds.0 v2:172.21.15.106:6835/1050953219 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+253 (crc 0 0 0) 0x55f8656d1970 con 0x55f865910390 2024-04-02T07:25:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f793f400640 10 client.6163 handle_command_reply: tid=0 2024-04-02T07:25:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 1 client.6163 shutdown 2024-04-02T07:25:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 1 -- 172.21.15.55:0/3499654345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f86590fa70 msgr2=0x55f8658c70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 1 --2- 172.21.15.55:0/3499654345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f86590fa70 0x55f8658c70e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f795401b1b0 tx=0x7f79540a7070 comp rx=0 tx=0).stop 2024-04-02T07:25:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 1 -- 172.21.15.55:0/3499654345 shutdown_connections 2024-04-02T07:25:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 1 --2- 172.21.15.55:0/3499654345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f86590fa70 0x55f8658c70e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 1 --2- 172.21.15.55:0/3499654345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f8658c3a00 0x55f8658c6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 1 --2- 172.21.15.55:0/3499654345 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55f865910390 0x55f8658c7620 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 1 --2- 172.21.15.55:0/3499654345 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f8656c4160 0x55f865952f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 1 -- 172.21.15.55:0/3499654345 >> 172.21.15.55:0/3499654345 conn(0x55f86590f3b0 msgr2=0x55f8658c1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:28.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f793f400640 0 client.6163 ms_handle_reset on v2:172.21.15.106:6835/1050953219 2024-04-02T07:25:28.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 1 -- 172.21.15.55:0/3499654345 shutdown_connections 2024-04-02T07:25:28.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 1 -- 172.21.15.55:0/3499654345 wait complete. 2024-04-02T07:25:28.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f79646e2000 20 client.6163 trim_cache size 0 max 16384 2024-04-02T07:25:28.899 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:25:28.899 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-02T07:25:28.899 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-04-02T07:25:28.899 INFO:teuthology.orchestra.run.smithi055.stdout: "8c0fe2e7-ac73-4071-a74e-58f09a7365bf": { 2024-04-02T07:25:28.899 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/", 2024-04-02T07:25:28.899 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "8c0fe2e7-ac73-4071-a74e-58f09a7365bf", 2024-04-02T07:25:28.899 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive" 2024-04-02T07:25:28.900 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:28.900 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:28.900 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:25:28.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f7961200640 1 -- 172.21.15.55:0/2616836868 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f79380666c0 msgr2=0x7f7938068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f7961200640 1 --2- 172.21.15.55:0/2616836868 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f79380666c0 0x7f7938068b80 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f795c0b04c0 tx=0x7f7944009190 comp rx=0 tx=0).stop 2024-04-02T07:25:28.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f7961200640 1 -- 172.21.15.55:0/2616836868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f795c06b920 msgr2=0x7f795c0c4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:28.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.889+0000 7f7961200640 1 --2- 172.21.15.55:0/2616836868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f795c06b920 0x7f795c0c4190 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f794c00c410 tx=0x7f794c00c8d0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.893+0000 7f7961200640 1 -- 172.21.15.55:0/2616836868 shutdown_connections 2024-04-02T07:25:28.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.893+0000 7f7961200640 1 --2- 172.21.15.55:0/2616836868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f795c15ca60 0x7f795c0c5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.893+0000 7f7961200640 1 --2- 172.21.15.55:0/2616836868 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f79380666c0 0x7f7938068b80 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.893+0000 7f7961200640 1 --2- 172.21.15.55:0/2616836868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f795c098a10 0x7f795c0c8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.893+0000 7f7961200640 1 --2- 172.21.15.55:0/2616836868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f795c06b920 0x7f795c0c4190 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:28.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.893+0000 7f7961200640 1 -- 172.21.15.55:0/2616836868 >> 172.21.15.55:0/2616836868 conn(0x7f795c0b2150 msgr2=0x7f795c06eb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:28.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.893+0000 7f7961200640 1 -- 172.21.15.55:0/2616836868 shutdown_connections 2024-04-02T07:25:28.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:28.893+0000 7f7961200640 1 -- 172.21.15.55:0/2616836868 wait complete. 2024-04-02T07:25:28.915 INFO:tasks.cephfs.filesystem:scrub status for tag:8c0fe2e7-ac73-4071-a74e-58f09a7365bf - {'path': '/', 'tag': '8c0fe2e7-ac73-4071-a74e-58f09a7365bf', 'options': 'recursive'} 2024-04-02T07:25:30.140 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-02T07:25:30.137+0000 7f8f1ba00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-02T07:25:43.671 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:25:43.675 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:25:58.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:25:58.917 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-02T07:25:59.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56de000640 1 Processor -- start 2024-04-02T07:25:59.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56de000640 1 -- start start 2024-04-02T07:25:59.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56de000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56d8144260 0x7f56d80702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56de000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d815e3a0 con 0x7f56d80b31a0 2024-04-02T07:25:59.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56de000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56d8070c60 con 0x7f56d80707e0 2024-04-02T07:25:59.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56de000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d80b35d0 con 0x7f56d8144260 2024-04-02T07:25:59.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d7e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f56d80b31a0 0x7f56d80b1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43836/0 (socket says 172.21.15.55:43836) 2024-04-02T07:25:59.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d7e00640 1 -- 172.21.15.55:0/973229233 learned_addr learned my addr 172.21.15.55:0/973229233 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:59.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d7400640 1 --2- 172.21.15.55:0/973229233 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56d8144260 0x7f56d80702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d6a00640 1 -- 172.21.15.55:0/973229233 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1198132657 0 0) 0x7f56d815e3a0 con 0x7f56d80b31a0 2024-04-02T07:25:59.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d6a00640 1 -- 172.21.15.55:0/973229233 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f56bc003530 con 0x7f56d80b31a0 2024-04-02T07:25:59.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d6a00640 1 -- 172.21.15.55:0/973229233 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3596161484 0 0) 0x7f56bc003530 con 0x7f56d80b31a0 2024-04-02T07:25:59.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d6a00640 1 -- 172.21.15.55:0/973229233 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56d8144260 msgr2=0x7f56d80702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d6a00640 1 --2- 172.21.15.55:0/973229233 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56d8144260 0x7f56d80702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d6a00640 1 -- 172.21.15.55:0/973229233 >> v1:172.21.15.106:6789/0 conn(0x7f56d80707e0 legacy=0x7f56d80b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d6a00640 1 -- 172.21.15.55:0/973229233 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d815e5f0 con 0x7f56d80b31a0 2024-04-02T07:25:59.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d6a00640 1 -- 172.21.15.55:0/973229233 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f56d0001a00 con 0x7f56d80b31a0 2024-04-02T07:25:59.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d6a00640 1 -- 172.21.15.55:0/973229233 >> v1:172.21.15.55:6789/0 conn(0x7f56d80b31a0 legacy=0x7f56d80b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d6a00640 1 --2- 172.21.15.55:0/973229233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56bc0039b0 0x7f56bc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d6a00640 1 --2- 172.21.15.55:0/973229233 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56d8144260 0x7f56bc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d6a00640 1 --2- 172.21.15.55:0/973229233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56bc004d10 0x7f56bc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d6a00640 1 -- 172.21.15.55:0/973229233 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc00ba40 con 0x7f56bc0039b0 2024-04-02T07:25:59.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d6a00640 1 -- 172.21.15.55:0/973229233 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc00bb80 con 0x7f56bc004d10 2024-04-02T07:25:59.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d6a00640 1 -- 172.21.15.55:0/973229233 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56bc00bd40 con 0x7f56d8144260 2024-04-02T07:25:59.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d7400640 1 --2- 172.21.15.55:0/973229233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56bc0039b0 0x7f56bc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56cea00640 1 --2- 172.21.15.55:0/973229233 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56d8144260 0x7f56bc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d7e00640 1 --2- 172.21.15.55:0/973229233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56bc004d10 0x7f56bc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d7400640 1 -- 172.21.15.55:0/973229233 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56d8144260 msgr2=0x7f56bc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d7400640 1 --2- 172.21.15.55:0/973229233 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56d8144260 0x7f56bc0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d7400640 1 -- 172.21.15.55:0/973229233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56bc004d10 msgr2=0x7f56bc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d7400640 1 --2- 172.21.15.55:0/973229233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56bc004d10 0x7f56bc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.069+0000 7f56d7400640 1 -- 172.21.15.55:0/973229233 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56bc003530 con 0x7f56bc0039b0 2024-04-02T07:25:59.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.073+0000 7f56d7400640 1 --2- 172.21.15.55:0/973229233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56bc0039b0 0x7f56bc003dd0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009ab0 tx=0x7f56c801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=346b2d857f473228 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:59.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.073+0000 7f56d6a00640 1 -- 172.21.15.55:0/973229233 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c80a6430 con 0x7f56bc0039b0 2024-04-02T07:25:59.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.073+0000 7f56d6a00640 1 -- 172.21.15.55:0/973229233 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c80a6590 con 0x7f56bc0039b0 2024-04-02T07:25:59.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.073+0000 7f56d6a00640 1 -- 172.21.15.55:0/973229233 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c80a6940 con 0x7f56bc0039b0 2024-04-02T07:25:59.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.073+0000 7f56de000640 1 -- 172.21.15.55:0/973229233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56bc0039b0 msgr2=0x7f56bc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.073+0000 7f56de000640 1 --2- 172.21.15.55:0/973229233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56bc0039b0 0x7f56bc003dd0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f56c8009ab0 tx=0x7f56c801ca50 comp rx=0 tx=0).stop 2024-04-02T07:25:59.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.073+0000 7f56d7e00640 1 -- 172.21.15.55:0/973229233 reap_dead start 2024-04-02T07:25:59.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.073+0000 7f56de000640 1 -- 172.21.15.55:0/973229233 shutdown_connections 2024-04-02T07:25:59.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.073+0000 7f56de000640 1 -- 172.21.15.55:0/973229233 >> 172.21.15.55:0/973229233 conn(0x7f56d806a390 msgr2=0x7f56d80b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:59.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.073+0000 7f56de000640 1 -- 172.21.15.55:0/973229233 shutdown_connections 2024-04-02T07:25:59.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.073+0000 7f56de000640 1 -- 172.21.15.55:0/973229233 wait complete. 2024-04-02T07:25:59.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56de000640 1 Processor -- start 2024-04-02T07:25:59.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56de000640 1 -- start start 2024-04-02T07:25:59.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56de000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56bc0039b0 0x7f56d81f6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56de000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56d815c540 0x7f56d815c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56de000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d81f8b60 0x7f56d81f8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56de000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d812eb30 con 0x7f56d81f8b60 2024-04-02T07:25:59.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56de000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56d81f9520 con 0x7f56d815c540 2024-04-02T07:25:59.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56de000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56d815d070 con 0x7f56bc0039b0 2024-04-02T07:25:59.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56d7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d81f8b60 0x7f56d81f8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56d7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d81f8b60 0x7f56d81f8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35350/0 (socket says 172.21.15.55:35350) 2024-04-02T07:25:59.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56d7e00640 1 -- 172.21.15.55:0/3467191477 learned_addr learned my addr 172.21.15.55:0/3467191477 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:59.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56d7400640 1 --2- 172.21.15.55:0/3467191477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56bc0039b0 0x7f56d81f6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56cea00640 1 --2- 172.21.15.55:0/3467191477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56d815c540 0x7f56d815c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56d7e00640 1 -- 172.21.15.55:0/3467191477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56bc0039b0 msgr2=0x7f56d81f6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56d7e00640 1 --2- 172.21.15.55:0/3467191477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56bc0039b0 0x7f56d81f6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56d7e00640 1 -- 172.21.15.55:0/3467191477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56d815c540 msgr2=0x7f56d815c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56d7e00640 1 --2- 172.21.15.55:0/3467191477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56d815c540 0x7f56d815c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56d7e00640 1 -- 172.21.15.55:0/3467191477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56d815d350 con 0x7f56d81f8b60 2024-04-02T07:25:59.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56d7e00640 1 --2- 172.21.15.55:0/3467191477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d81f8b60 0x7f56d81f8fe0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f56d0000f90 tx=0x7f56d0007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:59.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56cfe00640 1 -- 172.21.15.55:0/3467191477 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d000abd0 con 0x7f56d81f8b60 2024-04-02T07:25:59.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56cfe00640 1 -- 172.21.15.55:0/3467191477 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56d000ad50 con 0x7f56d81f8b60 2024-04-02T07:25:59.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56cfe00640 1 -- 172.21.15.55:0/3467191477 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56d0013630 con 0x7f56d81f8b60 2024-04-02T07:25:59.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56de000640 1 -- 172.21.15.55:0/3467191477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56d815d630 con 0x7f56d81f8b60 2024-04-02T07:25:59.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.077+0000 7f56de000640 1 -- 172.21.15.55:0/3467191477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56d80ae840 con 0x7f56d81f8b60 2024-04-02T07:25:59.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.081+0000 7f56cfe00640 1 -- 172.21.15.55:0/3467191477 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f56d0013790 con 0x7f56d81f8b60 2024-04-02T07:25:59.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.081+0000 7f56cfe00640 1 --2- 172.21.15.55:0/3467191477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f56b40666c0 0x7f56b4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.081+0000 7f56cfe00640 1 -- 172.21.15.55:0/3467191477 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56d0084a60 con 0x7f56d81f8b60 2024-04-02T07:25:59.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.081+0000 7f56d7400640 1 --2- 172.21.15.55:0/3467191477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f56b40666c0 0x7f56b4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.081+0000 7f56e1516000 1 Processor -- start 2024-04-02T07:25:59.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.081+0000 7f56e1516000 1 -- start start 2024-04-02T07:25:59.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.081+0000 7f56d7400640 1 --2- 172.21.15.55:0/3467191477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f56b40666c0 0x7f56b4068b80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f56c80ad000 tx=0x7f56c80b2040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:59.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.081+0000 7f56e1516000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23ccfa70 0x55eb23ccfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.081+0000 7f56e1516000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23cd0390 0x55eb23c834c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.081+0000 7f56e1516000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55eb23c83a00 0x55eb23c83de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.081+0000 7f56e1516000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb23b4e630 con 0x55eb23ccfa70 2024-04-02T07:25:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.081+0000 7f56e1516000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb23adbbd0 con 0x55eb23cd0390 2024-04-02T07:25:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.081+0000 7f56e1516000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb23ad91a0 con 0x55eb23c83a00 2024-04-02T07:25:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56d7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23ccfa70 0x55eb23ccfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56d7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23ccfa70 0x55eb23ccfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35364/0 (socket says 172.21.15.55:35364) 2024-04-02T07:25:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56d7400640 1 -- 172.21.15.55:0/989587965 learned_addr learned my addr 172.21.15.55:0/989587965 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56cea00640 1 --2- 172.21.15.55:0/989587965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23cd0390 0x55eb23c834c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56d7e00640 1 --2- 172.21.15.55:0/989587965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55eb23c83a00 0x55eb23c83de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56d7400640 1 -- 172.21.15.55:0/989587965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55eb23c83a00 msgr2=0x55eb23c83de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56d7400640 1 --2- 172.21.15.55:0/989587965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55eb23c83a00 0x55eb23c83de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56d7400640 1 -- 172.21.15.55:0/989587965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23cd0390 msgr2=0x55eb23c834c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56d7400640 1 --2- 172.21.15.55:0/989587965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23cd0390 0x55eb23c834c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56d7400640 1 -- 172.21.15.55:0/989587965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb237d0e20 con 0x55eb23ccfa70 2024-04-02T07:25:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56d7400640 1 --2- 172.21.15.55:0/989587965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23ccfa70 0x55eb23ccfe50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f56c801ca90 tx=0x7f56c8004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eafb519e878614c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:59.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56c7e00640 1 -- 172.21.15.55:0/989587965 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c80b5040 con 0x55eb23ccfa70 2024-04-02T07:25:59.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56c7e00640 1 -- 172.21.15.55:0/989587965 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c80a6dd0 con 0x55eb23ccfa70 2024-04-02T07:25:59.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56c7e00640 1 -- 172.21.15.55:0/989587965 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8003840 con 0x55eb23ccfa70 2024-04-02T07:25:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56e1516000 1 -- 172.21.15.55:0/989587965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23ccfa70 msgr2=0x55eb23ccfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56e1516000 1 --2- 172.21.15.55:0/989587965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23ccfa70 0x55eb23ccfe50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f56c801ca90 tx=0x7f56c8004740 comp rx=0 tx=0).stop 2024-04-02T07:25:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56e1516000 1 -- 172.21.15.55:0/989587965 shutdown_connections 2024-04-02T07:25:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56e1516000 1 --2- 172.21.15.55:0/989587965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55eb23c83a00 0x55eb23c83de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56e1516000 1 --2- 172.21.15.55:0/989587965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23cd0390 0x55eb23c834c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56e1516000 1 --2- 172.21.15.55:0/989587965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23ccfa70 0x55eb23ccfe50 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56e1516000 1 -- 172.21.15.55:0/989587965 >> 172.21.15.55:0/989587965 conn(0x55eb23a84160 msgr2=0x55eb23cb2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:59.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56e1516000 1 -- 172.21.15.55:0/989587965 shutdown_connections 2024-04-02T07:25:59.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56e1516000 1 -- 172.21.15.55:0/989587965 wait complete. 2024-04-02T07:25:59.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56e1516000 1 -- start start 2024-04-02T07:25:59.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56e1516000 1 Processor -- start 2024-04-02T07:25:59.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56e1516000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23c83a00 0x55eb23c8c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56e1516000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23ccfa70 0x55eb23cb3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56e1516000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55eb23cd0390 0x55eb23cb3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56e1516000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb23ad4a90 con 0x55eb23c83a00 2024-04-02T07:25:59.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56e1516000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb23a73d40 con 0x55eb23ccfa70 2024-04-02T07:25:59.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56e1516000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb23a91f30 con 0x55eb23cd0390 2024-04-02T07:25:59.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56e1516000 10 client.0 _ll_register_callbacks cb 0x55eb23b36810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:25:59.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56d7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23c83a00 0x55eb23c8c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56d7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23c83a00 0x55eb23c8c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35372/0 (socket says 172.21.15.55:35372) 2024-04-02T07:25:59.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56d7400640 1 -- 172.21.15.55:0/1766291819 learned_addr learned my addr 172.21.15.55:0/1766291819 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:59.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56d7e00640 1 --2- 172.21.15.55:0/1766291819 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55eb23cd0390 0x55eb23cb3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.085+0000 7f56cea00640 1 --2- 172.21.15.55:0/1766291819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23ccfa70 0x55eb23cb3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56d7400640 1 -- 172.21.15.55:0/1766291819 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55eb23cd0390 msgr2=0x55eb23cb3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56d7400640 1 --2- 172.21.15.55:0/1766291819 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55eb23cd0390 0x55eb23cb3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56d7400640 1 -- 172.21.15.55:0/1766291819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23ccfa70 msgr2=0x55eb23cb3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56d7400640 1 --2- 172.21.15.55:0/1766291819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23ccfa70 0x55eb23cb3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56d7400640 1 -- 172.21.15.55:0/1766291819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56bc003530 con 0x55eb23c83a00 2024-04-02T07:25:59.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56cea00640 1 --2- 172.21.15.55:0/1766291819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23ccfa70 0x55eb23cb3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:59.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56d7400640 1 --2- 172.21.15.55:0/1766291819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23c83a00 0x55eb23c8c7e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f56c801cf30 tx=0x7f56c80197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60564f71839bb65f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:59.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:25:59.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56c4c00640 1 -- 172.21.15.55:0/1766291819 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8003820 con 0x55eb23c83a00 2024-04-02T07:25:59.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56c4c00640 1 -- 172.21.15.55:0/1766291819 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56c8003980 con 0x55eb23c83a00 2024-04-02T07:25:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 1 -- 172.21.15.55:0/1766291819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eb23ad33e0 con 0x55eb23c83a00 2024-04-02T07:25:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56c4c00640 1 -- 172.21.15.55:0/1766291819 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56c8003b40 con 0x55eb23c83a00 2024-04-02T07:25:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 10 client.6402 fetch_fsmap learned FSMap version 34 2024-04-02T07:25:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 1 -- 172.21.15.55:0/1766291819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x55eb23a99aa0 con 0x55eb23c83a00 2024-04-02T07:25:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56c4c00640 1 -- 172.21.15.55:0/1766291819 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c80db020 con 0x55eb23c83a00 2024-04-02T07:25:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56c4c00640 1 -- 172.21.15.55:0/1766291819 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 34) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f56c8003ca0 con 0x55eb23c83a00 2024-04-02T07:25:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 10 client.6402 fetch_fsmap finished waiting for FSMap version 34 2024-04-02T07:25:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 10 client.6402 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-04-02T07:25:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 20 client.6402 populate_metadata read hostname 'smithi055' 2024-04-02T07:25:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 1 --2- 172.21.15.55:0/1766291819 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55eb23cd70c0 0x55eb23cd74d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 4 client.6402 mds_command: new command op to 6138 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:25:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 1 -- 172.21.15.55:0/1766291819 --> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eb23aa4d00 con 0x55eb23cd70c0 2024-04-02T07:25:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56cea00640 1 --2- 172.21.15.55:0/1766291819 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55eb23cd70c0 0x55eb23cd74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56cea00640 1 --2- 172.21.15.55:0/1766291819 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55eb23cd70c0 0x55eb23cd74d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1764bdd05040e96b server_cookie=8aeb0730eca08134 in_seq=0 out_seq=0 2024-04-02T07:25:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56c4c00640 10 client.6402 ms_handle_connect on v2:172.21.15.106:6835/1050953219 2024-04-02T07:25:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56c4c00640 1 -- 172.21.15.55:0/1766291819 <== mds.0 v2:172.21.15.106:6835/1050953219 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55eb23aa4d00 con 0x55eb23cd70c0 2024-04-02T07:25:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56c4c00640 10 client.6402 handle_command_reply: tid=0 2024-04-02T07:25:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 1 client.6402 shutdown 2024-04-02T07:25:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 1 -- 172.21.15.55:0/1766291819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23c83a00 msgr2=0x55eb23c8c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 1 --2- 172.21.15.55:0/1766291819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23c83a00 0x55eb23c8c7e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f56c801cf30 tx=0x7f56c80197f0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 1 -- 172.21.15.55:0/1766291819 shutdown_connections 2024-04-02T07:25:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 1 --2- 172.21.15.55:0/1766291819 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55eb23cd70c0 0x55eb23cd74d0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 1 --2- 172.21.15.55:0/1766291819 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55eb23cd0390 0x55eb23cb3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 1 --2- 172.21.15.55:0/1766291819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23ccfa70 0x55eb23cb3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 1 --2- 172.21.15.55:0/1766291819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23c83a00 0x55eb23c8c7e0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56c4c00640 0 client.6402 ms_handle_reset on v2:172.21.15.106:6835/1050953219 2024-04-02T07:25:59.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 1 -- 172.21.15.55:0/1766291819 >> 172.21.15.55:0/1766291819 conn(0x55eb23a84160 msgr2=0x55eb23c82bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:59.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 1 -- 172.21.15.55:0/1766291819 shutdown_connections 2024-04-02T07:25:59.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 1 -- 172.21.15.55:0/1766291819 wait complete. 2024-04-02T07:25:59.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.089+0000 7f56e1516000 20 client.6402 trim_cache size 0 max 16384 2024-04-02T07:25:59.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.105+0000 7f56e1516000 1 Processor -- start 2024-04-02T07:25:59.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.105+0000 7f56e1516000 1 -- start start 2024-04-02T07:25:59.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.105+0000 7f56e1516000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23c83a00 0x55eb23c8b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.105+0000 7f56e1516000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23ccfa70 0x55eb23c8bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.105+0000 7f56e1516000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55eb23cd0390 0x55eb23c83de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.105+0000 7f56e1516000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb23791aa0 con 0x55eb23c83a00 2024-04-02T07:25:59.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.105+0000 7f56e1516000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb23aa4290 con 0x55eb23ccfa70 2024-04-02T07:25:59.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.105+0000 7f56e1516000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb23ad75f0 con 0x55eb23cd0390 2024-04-02T07:25:59.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.105+0000 7f56d7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23c83a00 0x55eb23c8b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.105+0000 7f56d7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23c83a00 0x55eb23c8b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35388/0 (socket says 172.21.15.55:35388) 2024-04-02T07:25:59.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.105+0000 7f56d7400640 1 -- 172.21.15.55:0/446504166 learned_addr learned my addr 172.21.15.55:0/446504166 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:59.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.105+0000 7f56cea00640 1 --2- 172.21.15.55:0/446504166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23ccfa70 0x55eb23c8bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.105+0000 7f56d7e00640 1 --2- 172.21.15.55:0/446504166 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55eb23cd0390 0x55eb23c83de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.105+0000 7f56d7400640 1 -- 172.21.15.55:0/446504166 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55eb23cd0390 msgr2=0x55eb23c83de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.105+0000 7f56d7400640 1 --2- 172.21.15.55:0/446504166 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55eb23cd0390 0x55eb23c83de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.105+0000 7f56d7400640 1 -- 172.21.15.55:0/446504166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23ccfa70 msgr2=0x55eb23c8bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.105+0000 7f56d7400640 1 --2- 172.21.15.55:0/446504166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23ccfa70 0x55eb23c8bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.105+0000 7f56d7400640 1 -- 172.21.15.55:0/446504166 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eb23a7fdf0 con 0x55eb23c83a00 2024-04-02T07:25:59.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.105+0000 7f56cea00640 1 --2- 172.21.15.55:0/446504166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23ccfa70 0x55eb23c8bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:59.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.105+0000 7f56d7400640 1 --2- 172.21.15.55:0/446504166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23c83a00 0x55eb23c8b6c0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f56c801d2f0 tx=0x7f56c80cd070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d81937d35eff5d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:59.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56ccc00640 1 -- 172.21.15.55:0/446504166 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c800e070 con 0x55eb23c83a00 2024-04-02T07:25:59.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56ccc00640 1 -- 172.21.15.55:0/446504166 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56c80db040 con 0x55eb23c83a00 2024-04-02T07:25:59.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56ccc00640 1 -- 172.21.15.55:0/446504166 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c8003820 con 0x55eb23c83a00 2024-04-02T07:25:59.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 1 -- 172.21.15.55:0/446504166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23c83a00 msgr2=0x55eb23c8b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 1 --2- 172.21.15.55:0/446504166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23c83a00 0x55eb23c8b6c0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f56c801d2f0 tx=0x7f56c80cd070 comp rx=0 tx=0).stop 2024-04-02T07:25:59.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 1 -- 172.21.15.55:0/446504166 shutdown_connections 2024-04-02T07:25:59.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 1 --2- 172.21.15.55:0/446504166 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55eb23cd0390 0x55eb23c83de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 1 --2- 172.21.15.55:0/446504166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23ccfa70 0x55eb23c8bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 1 --2- 172.21.15.55:0/446504166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23c83a00 0x55eb23c8b6c0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 1 -- 172.21.15.55:0/446504166 >> 172.21.15.55:0/446504166 conn(0x55eb23a84160 msgr2=0x55eb23c8afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:59.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 1 -- 172.21.15.55:0/446504166 shutdown_connections 2024-04-02T07:25:59.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 1 -- 172.21.15.55:0/446504166 wait complete. 2024-04-02T07:25:59.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 1 -- start start 2024-04-02T07:25:59.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 1 Processor -- start 2024-04-02T07:25:59.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23c83a00 0x55eb23c86600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23ccfa70 0x55eb23c86b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55eb23cd0390 0x55eb23c87080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb23ba5470 con 0x55eb23ccfa70 2024-04-02T07:25:59.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eb23adce60 con 0x55eb23c83a00 2024-04-02T07:25:59.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55eb23cb4220 con 0x55eb23cd0390 2024-04-02T07:25:59.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 10 client.0 _ll_register_callbacks cb 0x7f56bc00b990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:25:59.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56cea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23ccfa70 0x55eb23c86b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56cea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23ccfa70 0x55eb23c86b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35404/0 (socket says 172.21.15.55:35404) 2024-04-02T07:25:59.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56cea00640 1 -- 172.21.15.55:0/883489171 learned_addr learned my addr 172.21.15.55:0/883489171 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:59.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56d7e00640 1 --2- 172.21.15.55:0/883489171 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55eb23cd0390 0x55eb23c87080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56d7400640 1 --2- 172.21.15.55:0/883489171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23c83a00 0x55eb23c86600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56cea00640 1 -- 172.21.15.55:0/883489171 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55eb23cd0390 msgr2=0x55eb23c87080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56cea00640 1 --2- 172.21.15.55:0/883489171 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55eb23cd0390 0x55eb23c87080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56cea00640 1 -- 172.21.15.55:0/883489171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23c83a00 msgr2=0x55eb23c86600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56cea00640 1 --2- 172.21.15.55:0/883489171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23c83a00 0x55eb23c86600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56cea00640 1 -- 172.21.15.55:0/883489171 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55eb23a99aa0 con 0x55eb23ccfa70 2024-04-02T07:25:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56d7400640 1 --2- 172.21.15.55:0/883489171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23c83a00 0x55eb23c86600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56cea00640 1 --2- 172.21.15.55:0/883489171 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23ccfa70 0x55eb23c86b40 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f56c001d400 tx=0x7f56c0007c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245d8f81e37b6888 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56c4c00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:25:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56c4c00640 1 -- 172.21.15.55:0/883489171 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0004b80 con 0x55eb23ccfa70 2024-04-02T07:25:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56c4c00640 1 -- 172.21.15.55:0/883489171 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f56c0004ce0 con 0x55eb23ccfa70 2024-04-02T07:25:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 1 -- 172.21.15.55:0/883489171 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eb23cb4360 con 0x55eb23ccfa70 2024-04-02T07:25:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56c4c00640 1 -- 172.21.15.55:0/883489171 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f56c0004ea0 con 0x55eb23ccfa70 2024-04-02T07:25:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 10 client.6408 fetch_fsmap learned FSMap version 34 2024-04-02T07:25:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.109+0000 7f56e1516000 1 -- 172.21.15.55:0/883489171 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x55eb23a73960 con 0x55eb23ccfa70 2024-04-02T07:25:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56c4c00640 1 -- 172.21.15.55:0/883489171 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55eb23cb4360 con 0x55eb23ccfa70 2024-04-02T07:25:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56c4c00640 1 -- 172.21.15.55:0/883489171 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 34) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f56c0017430 con 0x55eb23ccfa70 2024-04-02T07:25:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56e1516000 10 client.6408 fetch_fsmap finished waiting for FSMap version 34 2024-04-02T07:25:59.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56e1516000 10 client.6408 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-04-02T07:25:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56e1516000 20 client.6408 populate_metadata read hostname 'smithi055' 2024-04-02T07:25:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56e1516000 1 --2- 172.21.15.55:0/883489171 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55eb23d2af70 0x55eb23c875c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56e1516000 4 client.6408 mds_command: new command op to 6138 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-02T07:25:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56e1516000 1 -- 172.21.15.55:0/883489171 --> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55eb23a91970 con 0x55eb23d2af70 2024-04-02T07:25:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56d7400640 1 --2- 172.21.15.55:0/883489171 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55eb23d2af70 0x55eb23c875c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56d7400640 1 --2- 172.21.15.55:0/883489171 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55eb23d2af70 0x55eb23c875c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e53a0f8ff8c2ece4 server_cookie=e98f7e7cf13848d8 in_seq=0 out_seq=0 2024-04-02T07:25:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56c4c00640 10 client.6408 ms_handle_connect on v2:172.21.15.106:6835/1050953219 2024-04-02T07:25:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56c4c00640 1 -- 172.21.15.55:0/883489171 <== mds.0 v2:172.21.15.106:6835/1050953219 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55eb23a91970 con 0x55eb23d2af70 2024-04-02T07:25:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56c4c00640 10 client.6408 handle_command_reply: tid=0 2024-04-02T07:25:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56e1516000 1 client.6408 shutdown 2024-04-02T07:25:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56e1516000 1 -- 172.21.15.55:0/883489171 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23ccfa70 msgr2=0x55eb23c86b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56e1516000 1 --2- 172.21.15.55:0/883489171 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23ccfa70 0x55eb23c86b40 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f56c001d400 tx=0x7f56c0007c90 comp rx=0 tx=0).stop 2024-04-02T07:25:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56e1516000 1 -- 172.21.15.55:0/883489171 shutdown_connections 2024-04-02T07:25:59.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56e1516000 1 --2- 172.21.15.55:0/883489171 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55eb23d2af70 0x55eb23c875c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56e1516000 1 --2- 172.21.15.55:0/883489171 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55eb23cd0390 0x55eb23c87080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56e1516000 1 --2- 172.21.15.55:0/883489171 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55eb23ccfa70 0x55eb23c86b40 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56e1516000 1 --2- 172.21.15.55:0/883489171 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55eb23c83a00 0x55eb23c86600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56c4c00640 0 client.6408 ms_handle_reset on v2:172.21.15.106:6835/1050953219 2024-04-02T07:25:59.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56e1516000 1 -- 172.21.15.55:0/883489171 >> 172.21.15.55:0/883489171 conn(0x55eb23a84160 msgr2=0x55eb23c8b840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:59.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56e1516000 1 -- 172.21.15.55:0/883489171 shutdown_connections 2024-04-02T07:25:59.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56e1516000 1 -- 172.21.15.55:0/883489171 wait complete. 2024-04-02T07:25:59.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56e1516000 20 client.6408 trim_cache size 0 max 16384 2024-04-02T07:25:59.122 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:25:59.123 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-04-02T07:25:59.123 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-04-02T07:25:59.123 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:25:59.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56de000640 1 -- 172.21.15.55:0/3467191477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f56b40666c0 msgr2=0x7f56b4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56de000640 1 --2- 172.21.15.55:0/3467191477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f56b40666c0 0x7f56b4068b80 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f56c80ad000 tx=0x7f56c80b2040 comp rx=0 tx=0).stop 2024-04-02T07:25:59.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56de000640 1 -- 172.21.15.55:0/3467191477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d81f8b60 msgr2=0x7f56d81f8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56de000640 1 --2- 172.21.15.55:0/3467191477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d81f8b60 0x7f56d81f8fe0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f56d0000f90 tx=0x7f56d0007bd0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56de000640 1 -- 172.21.15.55:0/3467191477 shutdown_connections 2024-04-02T07:25:59.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56de000640 1 --2- 172.21.15.55:0/3467191477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56d81f8b60 0x7f56d81f8fe0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56de000640 1 --2- 172.21.15.55:0/3467191477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f56b40666c0 0x7f56b4068b80 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56de000640 1 --2- 172.21.15.55:0/3467191477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f56d815c540 0x7f56d815c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56de000640 1 --2- 172.21.15.55:0/3467191477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56bc0039b0 0x7f56d81f6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56de000640 1 -- 172.21.15.55:0/3467191477 >> 172.21.15.55:0/3467191477 conn(0x7f56d806a390 msgr2=0x7f56d80c8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:59.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56de000640 1 -- 172.21.15.55:0/3467191477 shutdown_connections 2024-04-02T07:25:59.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.113+0000 7f56de000640 1 -- 172.21.15.55:0/3467191477 wait complete. 2024-04-02T07:25:59.137 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-02T07:25:59.137 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:25:59.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.273+0000 7f83aa600640 1 Processor -- start 2024-04-02T07:25:59.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.273+0000 7f83aa600640 1 -- start start 2024-04-02T07:25:59.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.273+0000 7f83aa600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f83a40cfdf0 0x7f83a406b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.273+0000 7f83aa600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83a4098a10 0x7f83a4098e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.273+0000 7f83aa600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83a40d01d0 con 0x7f83a40b16e0 2024-04-02T07:25:59.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.273+0000 7f83aa600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83a4099360 con 0x7f83a40cfdf0 2024-04-02T07:25:59.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.273+0000 7f83aa600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a406c0e0 con 0x7f83a4098a10 2024-04-02T07:25:59.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.277+0000 7f83a3400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f83a40cfdf0 0x7f83a406b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.277+0000 7f83a3e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83a4098a10 0x7f83a4098e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.277+0000 7f839aa00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f83a40b16e0 0x7f83a40b0cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:57024/0 (socket says 172.21.15.55:57024) 2024-04-02T07:25:59.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.277+0000 7f839aa00640 1 -- 172.21.15.55:0/1811924812 learned_addr learned my addr 172.21.15.55:0/1811924812 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:59.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.277+0000 7f83a2a00640 1 -- 172.21.15.55:0/1811924812 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886085625 0 0) 0x7f838c001120 con 0x7f83a40b16e0 2024-04-02T07:25:59.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.277+0000 7f83a2a00640 1 -- 172.21.15.55:0/1811924812 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8388003530 con 0x7f83a40b16e0 2024-04-02T07:25:59.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.277+0000 7f83a3400640 1 -- 172.21.15.55:0/1811924812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83a4098a10 msgr2=0x7f83a4098e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.277+0000 7f83a3400640 1 --2- 172.21.15.55:0/1811924812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83a4098a10 0x7f83a4098e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.277+0000 7f83a3400640 1 -- 172.21.15.55:0/1811924812 >> v1:172.21.15.106:6789/0 conn(0x7f83a40b16e0 legacy=0x7f83a40b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.277+0000 7f83a3400640 1 -- 172.21.15.55:0/1811924812 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83a40b01d0 con 0x7f83a40cfdf0 2024-04-02T07:25:59.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.277+0000 7f83a3e00640 1 --2- 172.21.15.55:0/1811924812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83a4098a10 0x7f83a4098e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:25:59.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.277+0000 7f83a3400640 1 --2- 172.21.15.55:0/1811924812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83a40cfdf0 0x7f83a406b8b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8394009d90 tx=0x7f839401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1558f61731a580d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:59.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.277+0000 7f83a2a00640 1 -- 172.21.15.55:0/1811924812 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83940a5a00 con 0x7f83a40cfdf0 2024-04-02T07:25:59.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.277+0000 7f83a2a00640 1 -- 172.21.15.55:0/1811924812 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83940a5b60 con 0x7f83a40cfdf0 2024-04-02T07:25:59.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83a2a00640 1 -- 172.21.15.55:0/1811924812 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83940ad440 con 0x7f83a40cfdf0 2024-04-02T07:25:59.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83aa600640 1 -- 172.21.15.55:0/1811924812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83a40cfdf0 msgr2=0x7f83a406b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83aa600640 1 --2- 172.21.15.55:0/1811924812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83a40cfdf0 0x7f83a406b8b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f8394009d90 tx=0x7f839401c940 comp rx=0 tx=0).stop 2024-04-02T07:25:59.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83aa600640 1 -- 172.21.15.55:0/1811924812 shutdown_connections 2024-04-02T07:25:59.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83aa600640 1 --2- 172.21.15.55:0/1811924812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83a4098a10 0x7f83a4098e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83aa600640 1 --2- 172.21.15.55:0/1811924812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83a40cfdf0 0x7f83a406b8b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83aa600640 1 -- 172.21.15.55:0/1811924812 >> 172.21.15.55:0/1811924812 conn(0x7f83a40b2210 msgr2=0x7f83a40b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:59.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83aa600640 1 -- 172.21.15.55:0/1811924812 shutdown_connections 2024-04-02T07:25:59.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83aa600640 1 -- 172.21.15.55:0/1811924812 wait complete. 2024-04-02T07:25:59.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83aa600640 1 Processor -- start 2024-04-02T07:25:59.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83aa600640 1 -- start start 2024-04-02T07:25:59.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83aa600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83a4098a10 0x7f83a414d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83aa600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83a40b16e0 0x7f83a41545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83aa600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83a40cfdf0 0x7f83a40ccf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83aa600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a40ca420 con 0x7f83a4098a10 2024-04-02T07:25:59.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83aa600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a40b34c0 con 0x7f83a40b16e0 2024-04-02T07:25:59.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83aa600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83a40b37a0 con 0x7f83a40cfdf0 2024-04-02T07:25:59.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83a3400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83a4098a10 0x7f83a414d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83a3400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83a4098a10 0x7f83a414d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35410/0 (socket says 172.21.15.55:35410) 2024-04-02T07:25:59.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83a3400640 1 -- 172.21.15.55:0/1687837319 learned_addr learned my addr 172.21.15.55:0/1687837319 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:59.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f839aa00640 1 --2- 172.21.15.55:0/1687837319 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83a40b16e0 0x7f83a41545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83a3e00640 1 --2- 172.21.15.55:0/1687837319 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83a40cfdf0 0x7f83a40ccf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83a3400640 1 -- 172.21.15.55:0/1687837319 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83a40cfdf0 msgr2=0x7f83a40ccf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83a3400640 1 --2- 172.21.15.55:0/1687837319 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83a40cfdf0 0x7f83a40ccf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83a3400640 1 -- 172.21.15.55:0/1687837319 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83a40b16e0 msgr2=0x7f83a41545d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83a3400640 1 --2- 172.21.15.55:0/1687837319 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83a40b16e0 0x7f83a41545d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f83a3400640 1 -- 172.21.15.55:0/1687837319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839c009420 con 0x7f83a4098a10 2024-04-02T07:25:59.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.281+0000 7f839aa00640 1 --2- 172.21.15.55:0/1687837319 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83a40b16e0 0x7f83a41545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:59.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.285+0000 7f83a3400640 1 --2- 172.21.15.55:0/1687837319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83a4098a10 0x7f83a414d4e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f839401a570 tx=0x7f83940196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:59.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.285+0000 7f839be00640 1 -- 172.21.15.55:0/1687837319 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83940a5a00 con 0x7f83a4098a10 2024-04-02T07:25:59.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.285+0000 7f839be00640 1 -- 172.21.15.55:0/1687837319 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83940ad850 con 0x7f83a4098a10 2024-04-02T07:25:59.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.285+0000 7f839be00640 1 -- 172.21.15.55:0/1687837319 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83940adbc0 con 0x7f83a4098a10 2024-04-02T07:25:59.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.285+0000 7f83aa600640 1 -- 172.21.15.55:0/1687837319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8394009a70 con 0x7f83a4098a10 2024-04-02T07:25:59.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.285+0000 7f83aa600640 1 -- 172.21.15.55:0/1687837319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a4154b10 con 0x7f83a4098a10 2024-04-02T07:25:59.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.285+0000 7f83aa600640 1 -- 172.21.15.55:0/1687837319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a4066c90 con 0x7f83a4098a10 2024-04-02T07:25:59.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.285+0000 7f839be00640 1 -- 172.21.15.55:0/1687837319 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f83940b4070 con 0x7f83a4098a10 2024-04-02T07:25:59.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.285+0000 7f839be00640 1 --2- 172.21.15.55:0/1687837319 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8380066690 0x7f8380068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.285+0000 7f839be00640 1 -- 172.21.15.55:0/1687837319 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f839411f0a0 con 0x7f83a4098a10 2024-04-02T07:25:59.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.285+0000 7f839aa00640 1 --2- 172.21.15.55:0/1687837319 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8380066690 0x7f8380068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.289+0000 7f839aa00640 1 --2- 172.21.15.55:0/1687837319 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8380066690 0x7f8380068b50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f83a41f8e60 tx=0x7f838c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:59.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.289+0000 7f839be00640 1 -- 172.21.15.55:0/1687837319 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f83940ec490 con 0x7f83a4098a10 2024-04-02T07:25:59.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.489+0000 7f83aa600640 1 -- 172.21.15.55:0/1687837319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83a40ca830 con 0x7f83a4098a10 2024-04-02T07:25:59.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.489+0000 7f839be00640 1 -- 172.21.15.55:0/1687837319 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f83940efab0 con 0x7f83a4098a10 2024-04-02T07:25:59.492 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:59.493 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":34,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5510,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3429221899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3429221899},{"type":"v1","addr":"172.21.15.55:6835","nonce":3429221899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5513,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/4033456774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4033456774},{"type":"v1","addr":"172.21.15.106:6836","nonce":4033456774}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6129,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2170345840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2170345840},{"type":"v1","addr":"172.21.15.55:6834","nonce":2170345840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:25:13.807869+0000","modified":"2024-04-02T07:25:30.140288+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6138":{"gid":6138,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":7,"addr":"172.21.15.106:6837/1050953219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1050953219},{"type":"v1","addr":"172.21.15.106:6837","nonce":1050953219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-02T07:25:59.493 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 34 2024-04-02T07:25:59.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.489+0000 7f83aa600640 1 -- 172.21.15.55:0/1687837319 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8380066690 msgr2=0x7f8380068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.489+0000 7f83aa600640 1 --2- 172.21.15.55:0/1687837319 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8380066690 0x7f8380068b50 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f83a41f8e60 tx=0x7f838c009040 comp rx=0 tx=0).stop 2024-04-02T07:25:59.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.489+0000 7f83aa600640 1 -- 172.21.15.55:0/1687837319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83a4098a10 msgr2=0x7f83a414d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.489+0000 7f83aa600640 1 --2- 172.21.15.55:0/1687837319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83a4098a10 0x7f83a414d4e0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f839401a570 tx=0x7f83940196e0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.489+0000 7f83aa600640 1 -- 172.21.15.55:0/1687837319 shutdown_connections 2024-04-02T07:25:59.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.489+0000 7f83aa600640 1 --2- 172.21.15.55:0/1687837319 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f83a40cfdf0 0x7f83a40ccf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.489+0000 7f83aa600640 1 --2- 172.21.15.55:0/1687837319 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8380066690 0x7f8380068b50 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.489+0000 7f83aa600640 1 --2- 172.21.15.55:0/1687837319 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83a40b16e0 0x7f83a41545d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.489+0000 7f83aa600640 1 --2- 172.21.15.55:0/1687837319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83a4098a10 0x7f83a414d4e0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.489+0000 7f83aa600640 1 -- 172.21.15.55:0/1687837319 >> 172.21.15.55:0/1687837319 conn(0x7f83a40b2210 msgr2=0x7f83a40ae990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:59.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.489+0000 7f83aa600640 1 -- 172.21.15.55:0/1687837319 shutdown_connections 2024-04-02T07:25:59.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.489+0000 7f83aa600640 1 -- 172.21.15.55:0/1687837319 wait complete. 2024-04-02T07:25:59.514 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d damage ls --format=json-pretty 2024-04-02T07:25:59.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.649+0000 7f74e3e00640 1 Processor -- start 2024-04-02T07:25:59.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.649+0000 7f74e3e00640 1 -- start start 2024-04-02T07:25:59.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.653+0000 7f74e3e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74dc0b31a0 0x7f74dc165730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.653+0000 7f74e3e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74dc15e3a0 con 0x7f74dc0709b0 2024-04-02T07:25:59.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.653+0000 7f74e3e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74dc15e5f0 con 0x7f74dc144260 2024-04-02T07:25:59.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.653+0000 7f74e3e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc0b37c0 con 0x7f74dc0b31a0 2024-04-02T07:25:59.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.653+0000 7f74e0a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f74dc0709b0 0x7f74dc0b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43838/0 (socket says 172.21.15.55:43838) 2024-04-02T07:25:59.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.653+0000 7f74e0a00640 1 -- 172.21.15.55:0/4102203080 learned_addr learned my addr 172.21.15.55:0/4102203080 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:25:59.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.653+0000 7f74e1e00640 1 --2- 172.21.15.55:0/4102203080 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74dc0b31a0 0x7f74dc165730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.653+0000 7f74dbe00640 1 -- 172.21.15.55:0/4102203080 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3985138173 0 0) 0x7f74dc15e3a0 con 0x7f74dc0709b0 2024-04-02T07:25:59.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.653+0000 7f74dbe00640 1 -- 172.21.15.55:0/4102203080 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74c4003530 con 0x7f74dc0709b0 2024-04-02T07:25:59.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.653+0000 7f74dbe00640 1 -- 172.21.15.55:0/4102203080 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984388582 0 0) 0x7f74dc15e5f0 con 0x7f74dc144260 2024-04-02T07:25:59.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.653+0000 7f74dbe00640 1 -- 172.21.15.55:0/4102203080 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74dc15e3a0 con 0x7f74dc144260 2024-04-02T07:25:59.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.653+0000 7f74e1e00640 1 -- 172.21.15.55:0/4102203080 >> v1:172.21.15.106:6789/0 conn(0x7f74dc144260 legacy=0x7f74dc0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.653+0000 7f74e1e00640 1 -- 172.21.15.55:0/4102203080 >> v1:172.21.15.55:6789/0 conn(0x7f74dc0709b0 legacy=0x7f74dc0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.653+0000 7f74e1e00640 1 -- 172.21.15.55:0/4102203080 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74dc15e8d0 con 0x7f74dc0b31a0 2024-04-02T07:25:59.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.657+0000 7f74e1e00640 1 --2- 172.21.15.55:0/4102203080 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74dc0b31a0 0x7f74dc165730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f74d4009dc0 tx=0x7f74d401c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8bb67bd54420256c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:59.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.657+0000 7f74dbe00640 1 -- 172.21.15.55:0/4102203080 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d40a5850 con 0x7f74dc0b31a0 2024-04-02T07:25:59.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.657+0000 7f74dbe00640 1 -- 172.21.15.55:0/4102203080 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d40a59b0 con 0x7f74dc0b31a0 2024-04-02T07:25:59.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.657+0000 7f74dbe00640 1 -- 172.21.15.55:0/4102203080 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d40a5d40 con 0x7f74dc0b31a0 2024-04-02T07:25:59.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.657+0000 7f74e3e00640 1 -- 172.21.15.55:0/4102203080 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74dc0b31a0 msgr2=0x7f74dc165730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.657+0000 7f74e3e00640 1 --2- 172.21.15.55:0/4102203080 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74dc0b31a0 0x7f74dc165730 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f74d4009dc0 tx=0x7f74d401c990 comp rx=0 tx=0).stop 2024-04-02T07:25:59.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.657+0000 7f74e3e00640 1 -- 172.21.15.55:0/4102203080 shutdown_connections 2024-04-02T07:25:59.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.657+0000 7f74e3e00640 1 --2- 172.21.15.55:0/4102203080 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74dc0b31a0 0x7f74dc165730 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.657+0000 7f74e3e00640 1 -- 172.21.15.55:0/4102203080 >> 172.21.15.55:0/4102203080 conn(0x7f74dc06a390 msgr2=0x7f74dc0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:59.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.657+0000 7f74e3e00640 1 -- 172.21.15.55:0/4102203080 shutdown_connections 2024-04-02T07:25:59.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.657+0000 7f74e3e00640 1 -- 172.21.15.55:0/4102203080 wait complete. 2024-04-02T07:25:59.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.657+0000 7f74e3e00640 1 Processor -- start 2024-04-02T07:25:59.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.657+0000 7f74e3e00640 1 -- start start 2024-04-02T07:25:59.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74e3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74dc0709b0 0x7f74dc0afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74e3e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74dc0b31a0 0x7f74dc13d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74e3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74dc144260 0x7f74dc15ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74e3e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc141860 con 0x7f74dc144260 2024-04-02T07:25:59.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74e3e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc143350 con 0x7f74dc0709b0 2024-04-02T07:25:59.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74e3e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74dc141ab0 con 0x7f74dc0b31a0 2024-04-02T07:25:59.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74e1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74dc144260 0x7f74dc15ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74e1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74dc144260 0x7f74dc15ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35426/0 (socket says 172.21.15.55:35426) 2024-04-02T07:25:59.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74e1e00640 1 -- 172.21.15.55:0/3519248603 learned_addr learned my addr 172.21.15.55:0/3519248603 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:59.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74e0a00640 1 --2- 172.21.15.55:0/3519248603 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74dc0b31a0 0x7f74dc13d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74e1400640 1 --2- 172.21.15.55:0/3519248603 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74dc0709b0 0x7f74dc0afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74e1e00640 1 -- 172.21.15.55:0/3519248603 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74dc0b31a0 msgr2=0x7f74dc13d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74e1e00640 1 --2- 172.21.15.55:0/3519248603 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74dc0b31a0 0x7f74dc13d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74e1e00640 1 -- 172.21.15.55:0/3519248603 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74dc0709b0 msgr2=0x7f74dc0afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74e1e00640 1 --2- 172.21.15.55:0/3519248603 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74dc0709b0 0x7f74dc0afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74e1e00640 1 -- 172.21.15.55:0/3519248603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d4009a70 con 0x7f74dc144260 2024-04-02T07:25:59.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74e1e00640 1 --2- 172.21.15.55:0/3519248603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74dc144260 0x7f74dc15ca10 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f74d40195a0 tx=0x7f74d4019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:59.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74d9600640 1 -- 172.21.15.55:0/3519248603 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d40b9650 con 0x7f74dc144260 2024-04-02T07:25:59.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74d9600640 1 -- 172.21.15.55:0/3519248603 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74d40b97b0 con 0x7f74dc144260 2024-04-02T07:25:59.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74e3e00640 1 -- 172.21.15.55:0/3519248603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74dc151940 con 0x7f74dc144260 2024-04-02T07:25:59.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74d9600640 1 -- 172.21.15.55:0/3519248603 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d40b9b60 con 0x7f74dc144260 2024-04-02T07:25:59.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74e3e00640 1 -- 172.21.15.55:0/3519248603 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74dc141d90 con 0x7f74dc144260 2024-04-02T07:25:59.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.661+0000 7f74d9600640 1 -- 172.21.15.55:0/3519248603 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f74d40b9cc0 con 0x7f74dc144260 2024-04-02T07:25:59.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74d9600640 1 --2- 172.21.15.55:0/3519248603 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f74bc066690 0x7f74bc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74d9600640 1 -- 172.21.15.55:0/3519248603 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74d411f480 con 0x7f74dc144260 2024-04-02T07:25:59.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e1400640 1 --2- 172.21.15.55:0/3519248603 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f74bc066690 0x7f74bc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e7182000 1 Processor -- start 2024-04-02T07:25:59.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e7182000 1 -- start start 2024-04-02T07:25:59.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e1400640 1 --2- 172.21.15.55:0/3519248603 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f74bc066690 0x7f74bc068b50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f74d00011f0 tx=0x7f74d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:59.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e7182000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55bc81b95290 0x55bc81b95670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e7182000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95bb0 0x55bc81b4bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e7182000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b4c1b0 0x55bc81b4c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e7182000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc81a14340 con 0x55bc81b95bb0 2024-04-02T07:25:59.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e7182000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc819a0cd0 con 0x55bc81b4c1b0 2024-04-02T07:25:59.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e7182000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc8199e2a0 con 0x55bc81b95290 2024-04-02T07:25:59.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e0a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95bb0 0x55bc81b4bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e0a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95bb0 0x55bc81b4bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35438/0 (socket says 172.21.15.55:35438) 2024-04-02T07:25:59.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e0a00640 1 -- 172.21.15.55:0/579911276 learned_addr learned my addr 172.21.15.55:0/579911276 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:59.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e1e00640 1 --2- 172.21.15.55:0/579911276 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b4c1b0 0x55bc81b4c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e1400640 1 --2- 172.21.15.55:0/579911276 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55bc81b95290 0x55bc81b95670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e0a00640 1 -- 172.21.15.55:0/579911276 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55bc81b95290 msgr2=0x55bc81b95670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e0a00640 1 --2- 172.21.15.55:0/579911276 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55bc81b95290 0x55bc81b95670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e0a00640 1 -- 172.21.15.55:0/579911276 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b4c1b0 msgr2=0x55bc81b4c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e0a00640 1 --2- 172.21.15.55:0/579911276 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b4c1b0 0x55bc81b4c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e0a00640 1 -- 172.21.15.55:0/579911276 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc8168c4b0 con 0x55bc81b95bb0 2024-04-02T07:25:59.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74e0a00640 1 --2- 172.21.15.55:0/579911276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95bb0 0x55bc81b4bc70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f74c8006ce0 tx=0x7f74c8007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ecd2955e3ac789 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:59.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74ce000640 1 -- 172.21.15.55:0/579911276 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c80069c0 con 0x55bc81b95bb0 2024-04-02T07:25:59.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74ce000640 1 -- 172.21.15.55:0/579911276 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c8007750 con 0x55bc81b95bb0 2024-04-02T07:25:59.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.665+0000 7f74ce000640 1 -- 172.21.15.55:0/579911276 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8001b00 con 0x55bc81b95bb0 2024-04-02T07:25:59.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e7182000 1 -- 172.21.15.55:0/579911276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95bb0 msgr2=0x55bc81b4bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e7182000 1 --2- 172.21.15.55:0/579911276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95bb0 0x55bc81b4bc70 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f74c8006ce0 tx=0x7f74c8007410 comp rx=0 tx=0).stop 2024-04-02T07:25:59.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e7182000 1 -- 172.21.15.55:0/579911276 shutdown_connections 2024-04-02T07:25:59.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e7182000 1 --2- 172.21.15.55:0/579911276 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b4c1b0 0x55bc81b4c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e7182000 1 --2- 172.21.15.55:0/579911276 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95bb0 0x55bc81b4bc70 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e7182000 1 --2- 172.21.15.55:0/579911276 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55bc81b95290 0x55bc81b95670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e7182000 1 -- 172.21.15.55:0/579911276 >> 172.21.15.55:0/579911276 conn(0x55bc81b48160 msgr2=0x55bc81b4a550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e7182000 1 -- 172.21.15.55:0/579911276 shutdown_connections 2024-04-02T07:25:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e7182000 1 -- 172.21.15.55:0/579911276 wait complete. 2024-04-02T07:25:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e7182000 1 -- start start 2024-04-02T07:25:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e7182000 1 Processor -- start 2024-04-02T07:25:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e7182000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b4c1b0 0x55bc81b51710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e7182000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55bc81b95290 0x55bc81b51c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e7182000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b95bb0 0x55bc81b56e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e7182000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc81999b90 con 0x55bc81b4c1b0 2024-04-02T07:25:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e7182000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc819570a0 con 0x55bc81b95bb0 2024-04-02T07:25:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e7182000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc81956d40 con 0x55bc81b95290 2024-04-02T07:25:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e7182000 10 client.0 _ll_register_callbacks cb 0x55bc81a4ec20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:25:59.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e1400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b4c1b0 0x55bc81b51710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e1400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b4c1b0 0x55bc81b51710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35448/0 (socket says 172.21.15.55:35448) 2024-04-02T07:25:59.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e1400640 1 -- 172.21.15.55:0/4274479482 learned_addr learned my addr 172.21.15.55:0/4274479482 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:59.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e0a00640 1 --2- 172.21.15.55:0/4274479482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55bc81b95290 0x55bc81b51c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e1e00640 1 --2- 172.21.15.55:0/4274479482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b95bb0 0x55bc81b56e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e1400640 1 -- 172.21.15.55:0/4274479482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55bc81b95290 msgr2=0x55bc81b51c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e1400640 1 --2- 172.21.15.55:0/4274479482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55bc81b95290 0x55bc81b51c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e1400640 1 -- 172.21.15.55:0/4274479482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b95bb0 msgr2=0x55bc81b56e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e1400640 1 --2- 172.21.15.55:0/4274479482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b95bb0 0x55bc81b56e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e1400640 1 -- 172.21.15.55:0/4274479482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c4003530 con 0x55bc81b4c1b0 2024-04-02T07:25:59.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e1e00640 1 --2- 172.21.15.55:0/4274479482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b95bb0 0x55bc81b56e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:25:59.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e1400640 1 --2- 172.21.15.55:0/4274479482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b4c1b0 0x55bc81b51710 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f74d0014700 tx=0x7f74d0001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35360565866139b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:59.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74c2a00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:25:59.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74c2a00640 1 -- 172.21.15.55:0/4274479482 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d0013680 con 0x55bc81b4c1b0 2024-04-02T07:25:59.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74c2a00640 1 -- 172.21.15.55:0/4274479482 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74d001c040 con 0x55bc81b4c1b0 2024-04-02T07:25:59.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e7182000 1 -- 172.21.15.55:0/4274479482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc81969550 con 0x55bc81b4c1b0 2024-04-02T07:25:59.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74c2a00640 1 -- 172.21.15.55:0/4274479482 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74d00137e0 con 0x55bc81b4c1b0 2024-04-02T07:25:59.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.669+0000 7f74e7182000 10 client.6423 fetch_fsmap learned FSMap version 34 2024-04-02T07:25:59.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e7182000 1 -- 172.21.15.55:0/4274479482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x55bc8195eba0 con 0x55bc81b4c1b0 2024-04-02T07:25:59.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74c2a00640 1 -- 172.21.15.55:0/4274479482 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc81969550 con 0x55bc81b4c1b0 2024-04-02T07:25:59.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74c2a00640 1 -- 172.21.15.55:0/4274479482 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 34) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f74d0012070 con 0x55bc81b4c1b0 2024-04-02T07:25:59.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e7182000 10 client.6423 fetch_fsmap finished waiting for FSMap version 34 2024-04-02T07:25:59.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e7182000 10 client.6423 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-02T07:25:59.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e7182000 20 client.6423 populate_metadata read hostname 'smithi055' 2024-04-02T07:25:59.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e7182000 1 --2- 172.21.15.55:0/4274479482 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55bc81ba4320 0x55bc81ba6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e7182000 4 client.6423 mds_command: new command op to 6138 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:25:59.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e7182000 1 -- 172.21.15.55:0/4274479482 --> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bc81996970 con 0x55bc81ba4320 2024-04-02T07:25:59.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e0a00640 1 --2- 172.21.15.55:0/4274479482 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55bc81ba4320 0x55bc81ba6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e0a00640 1 --2- 172.21.15.55:0/4274479482 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55bc81ba4320 0x55bc81ba6710 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eff225a7c547a2d3 server_cookie=f36630062620bf89 in_seq=0 out_seq=0 2024-04-02T07:25:59.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74c2a00640 10 client.6423 ms_handle_connect on v2:172.21.15.106:6835/1050953219 2024-04-02T07:25:59.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74c2a00640 1 -- 172.21.15.55:0/4274479482 <== mds.0 v2:172.21.15.106:6835/1050953219 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55bc81996970 con 0x55bc81ba4320 2024-04-02T07:25:59.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74c2a00640 10 client.6423 handle_command_reply: tid=0 2024-04-02T07:25:59.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e7182000 1 client.6423 shutdown 2024-04-02T07:25:59.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e7182000 1 -- 172.21.15.55:0/4274479482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b4c1b0 msgr2=0x55bc81b51710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e7182000 1 --2- 172.21.15.55:0/4274479482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b4c1b0 0x55bc81b51710 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f74d0014700 tx=0x7f74d0001160 comp rx=0 tx=0).stop 2024-04-02T07:25:59.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e7182000 1 -- 172.21.15.55:0/4274479482 shutdown_connections 2024-04-02T07:25:59.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e7182000 1 --2- 172.21.15.55:0/4274479482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b95bb0 0x55bc81b56e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e7182000 1 --2- 172.21.15.55:0/4274479482 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55bc81ba4320 0x55bc81ba6710 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e7182000 1 --2- 172.21.15.55:0/4274479482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55bc81b95290 0x55bc81b51c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e7182000 1 --2- 172.21.15.55:0/4274479482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b4c1b0 0x55bc81b51710 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74c2a00640 0 client.6423 ms_handle_reset on v2:172.21.15.106:6835/1050953219 2024-04-02T07:25:59.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e7182000 1 -- 172.21.15.55:0/4274479482 >> 172.21.15.55:0/4274479482 conn(0x55bc81b48160 msgr2=0x55bc81b4ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:59.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e7182000 1 -- 172.21.15.55:0/4274479482 shutdown_connections 2024-04-02T07:25:59.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e7182000 1 -- 172.21.15.55:0/4274479482 wait complete. 2024-04-02T07:25:59.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.673+0000 7f74e7182000 20 client.6423 trim_cache size 0 max 16384 2024-04-02T07:25:59.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.685+0000 7f74e7182000 1 Processor -- start 2024-04-02T07:25:59.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.685+0000 7f74e7182000 1 -- start start 2024-04-02T07:25:59.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.685+0000 7f74e7182000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b4c1b0 0x55bc81bee6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.685+0000 7f74e7182000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95290 0x55bc81beec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.685+0000 7f74e7182000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55bc81b95bb0 0x55bc81bef170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.685+0000 7f74e7182000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc81656c40 con 0x55bc81b95290 2024-04-02T07:25:59.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.685+0000 7f74e7182000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc8199c6f0 con 0x55bc81b4c1b0 2024-04-02T07:25:59.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.685+0000 7f74e7182000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc8199db90 con 0x55bc81b95bb0 2024-04-02T07:25:59.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.685+0000 7f74e0a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95290 0x55bc81beec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.685+0000 7f74e0a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95290 0x55bc81beec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35454/0 (socket says 172.21.15.55:35454) 2024-04-02T07:25:59.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.685+0000 7f74e0a00640 1 -- 172.21.15.55:0/4178686996 learned_addr learned my addr 172.21.15.55:0/4178686996 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:59.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.685+0000 7f74e1400640 1 --2- 172.21.15.55:0/4178686996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b4c1b0 0x55bc81bee6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.685+0000 7f74e1e00640 1 --2- 172.21.15.55:0/4178686996 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55bc81b95bb0 0x55bc81bef170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.685+0000 7f74e0a00640 1 -- 172.21.15.55:0/4178686996 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55bc81b95bb0 msgr2=0x55bc81bef170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.685+0000 7f74e0a00640 1 --2- 172.21.15.55:0/4178686996 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55bc81b95bb0 0x55bc81bef170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.685+0000 7f74e0a00640 1 -- 172.21.15.55:0/4178686996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b4c1b0 msgr2=0x55bc81bee6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.685+0000 7f74e0a00640 1 --2- 172.21.15.55:0/4178686996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b4c1b0 0x55bc81bee6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.685+0000 7f74e0a00640 1 -- 172.21.15.55:0/4178686996 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bc81944ef0 con 0x55bc81b95290 2024-04-02T07:25:59.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e0a00640 1 --2- 172.21.15.55:0/4178686996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95290 0x55bc81beec30 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f74c8018040 tx=0x7f74c800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ac06e40b437172 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:59.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74cea00640 1 -- 172.21.15.55:0/4178686996 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8026070 con 0x55bc81b95290 2024-04-02T07:25:59.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74cea00640 1 -- 172.21.15.55:0/4178686996 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c8007770 con 0x55bc81b95290 2024-04-02T07:25:59.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74cea00640 1 -- 172.21.15.55:0/4178686996 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8001d40 con 0x55bc81b95290 2024-04-02T07:25:59.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e7182000 1 -- 172.21.15.55:0/4178686996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95290 msgr2=0x55bc81beec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e7182000 1 --2- 172.21.15.55:0/4178686996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95290 0x55bc81beec30 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f74c8018040 tx=0x7f74c800f000 comp rx=0 tx=0).stop 2024-04-02T07:25:59.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e7182000 1 -- 172.21.15.55:0/4178686996 shutdown_connections 2024-04-02T07:25:59.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e7182000 1 --2- 172.21.15.55:0/4178686996 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55bc81b95bb0 0x55bc81bef170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e7182000 1 --2- 172.21.15.55:0/4178686996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95290 0x55bc81beec30 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e7182000 1 --2- 172.21.15.55:0/4178686996 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b4c1b0 0x55bc81bee6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e7182000 1 -- 172.21.15.55:0/4178686996 >> 172.21.15.55:0/4178686996 conn(0x55bc81b48160 msgr2=0x55bc81b51a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e7182000 1 -- 172.21.15.55:0/4178686996 shutdown_connections 2024-04-02T07:25:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e7182000 1 -- 172.21.15.55:0/4178686996 wait complete. 2024-04-02T07:25:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e7182000 1 -- start start 2024-04-02T07:25:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e7182000 1 Processor -- start 2024-04-02T07:25:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e7182000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55bc81b4c1b0 0x55bc81bf3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e7182000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b95290 0x55bc81bf3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e7182000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95bb0 0x55bc81ba6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e7182000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc81996f90 con 0x55bc81b95bb0 2024-04-02T07:25:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e7182000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bc81964ad0 con 0x55bc81b95290 2024-04-02T07:25:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e7182000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55bc81b435e0 con 0x55bc81b4c1b0 2024-04-02T07:25:59.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e7182000 10 client.0 _ll_register_callbacks cb 0x55bc81a37870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:25:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95bb0 0x55bc81ba6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95bb0 0x55bc81ba6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35464/0 (socket says 172.21.15.55:35464) 2024-04-02T07:25:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e1e00640 1 -- 172.21.15.55:0/3646340385 learned_addr learned my addr 172.21.15.55:0/3646340385 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e1400640 1 --2- 172.21.15.55:0/3646340385 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55bc81b4c1b0 0x55bc81bf3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e0a00640 1 --2- 172.21.15.55:0/3646340385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b95290 0x55bc81bf3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e1e00640 1 -- 172.21.15.55:0/3646340385 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55bc81b4c1b0 msgr2=0x55bc81bf3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e1e00640 1 --2- 172.21.15.55:0/3646340385 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55bc81b4c1b0 0x55bc81bf3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e1e00640 1 -- 172.21.15.55:0/3646340385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b95290 msgr2=0x55bc81bf3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e1e00640 1 --2- 172.21.15.55:0/3646340385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b95290 0x55bc81bf3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e1e00640 1 -- 172.21.15.55:0/3646340385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bc8168c4b0 con 0x55bc81b95bb0 2024-04-02T07:25:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e1e00640 1 --2- 172.21.15.55:0/3646340385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95bb0 0x55bc81ba6e70 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f74d40a5980 tx=0x7f74d40b6000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f0d8f5d2a4a1419 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74c2a00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:25:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74c2a00640 1 -- 172.21.15.55:0/3646340385 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74d411f0b0 con 0x55bc81b95bb0 2024-04-02T07:25:59.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74c2a00640 1 -- 172.21.15.55:0/3646340385 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f74d411f210 con 0x55bc81b95bb0 2024-04-02T07:25:59.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.689+0000 7f74e7182000 1 -- 172.21.15.55:0/3646340385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bc81949620 con 0x55bc81b95bb0 2024-04-02T07:25:59.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74c2a00640 1 -- 172.21.15.55:0/3646340385 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74d40f0900 con 0x55bc81b95bb0 2024-04-02T07:25:59.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e7182000 10 client.6429 fetch_fsmap learned FSMap version 34 2024-04-02T07:25:59.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e7182000 1 -- 172.21.15.55:0/3646340385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x55bc81695fc0 con 0x55bc81b95bb0 2024-04-02T07:25:59.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74c2a00640 1 -- 172.21.15.55:0/3646340385 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55bc81949620 con 0x55bc81b95bb0 2024-04-02T07:25:59.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74c2a00640 1 -- 172.21.15.55:0/3646340385 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 34) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f74d4005d20 con 0x55bc81b95bb0 2024-04-02T07:25:59.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e7182000 10 client.6429 fetch_fsmap finished waiting for FSMap version 34 2024-04-02T07:25:59.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e7182000 10 client.6429 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-02T07:25:59.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e7182000 20 client.6429 populate_metadata read hostname 'smithi055' 2024-04-02T07:25:59.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e7182000 1 --2- 172.21.15.55:0/3646340385 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55bc81ba73b0 0x55bc81ba7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e7182000 4 client.6429 mds_command: new command op to 6138 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-02T07:25:59.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e7182000 1 -- 172.21.15.55:0/3646340385 --> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x55bc819984e0 con 0x55bc81ba73b0 2024-04-02T07:25:59.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e1400640 1 --2- 172.21.15.55:0/3646340385 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55bc81ba73b0 0x55bc81ba7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e1400640 1 --2- 172.21.15.55:0/3646340385 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55bc81ba73b0 0x55bc81ba7790 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34db2bbc6ebcd381 server_cookie=1a08dc8f8f6d8c56 in_seq=0 out_seq=0 2024-04-02T07:25:59.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74c2a00640 10 client.6429 ms_handle_connect on v2:172.21.15.106:6835/1050953219 2024-04-02T07:25:59.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74c2a00640 1 -- 172.21.15.55:0/3646340385 <== mds.0 v2:172.21.15.106:6835/1050953219 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+141 (crc 0 0 0) 0x55bc819984e0 con 0x55bc81ba73b0 2024-04-02T07:25:59.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74c2a00640 10 client.6429 handle_command_reply: tid=0 2024-04-02T07:25:59.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e7182000 1 client.6429 shutdown 2024-04-02T07:25:59.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e7182000 1 -- 172.21.15.55:0/3646340385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95bb0 msgr2=0x55bc81ba6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e7182000 1 --2- 172.21.15.55:0/3646340385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95bb0 0x55bc81ba6e70 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f74d40a5980 tx=0x7f74d40b6000 comp rx=0 tx=0).stop 2024-04-02T07:25:59.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e7182000 1 -- 172.21.15.55:0/3646340385 shutdown_connections 2024-04-02T07:25:59.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e7182000 1 --2- 172.21.15.55:0/3646340385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55bc81b95bb0 0x55bc81ba6e70 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e7182000 1 --2- 172.21.15.55:0/3646340385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55bc81b95290 0x55bc81bf3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e7182000 1 --2- 172.21.15.55:0/3646340385 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55bc81ba73b0 0x55bc81ba7790 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e7182000 1 --2- 172.21.15.55:0/3646340385 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55bc81b4c1b0 0x55bc81bf3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e7182000 1 -- 172.21.15.55:0/3646340385 >> 172.21.15.55:0/3646340385 conn(0x55bc81b48160 msgr2=0x55bc81b93dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:59.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74c2a00640 0 client.6429 ms_handle_reset on v2:172.21.15.106:6835/1050953219 2024-04-02T07:25:59.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e7182000 1 -- 172.21.15.55:0/3646340385 shutdown_connections 2024-04-02T07:25:59.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e7182000 1 -- 172.21.15.55:0/3646340385 wait complete. 2024-04-02T07:25:59.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e7182000 20 client.6429 trim_cache size 0 max 16384 2024-04-02T07:25:59.702 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:25:59.702 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-02T07:25:59.702 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:25:59.703 INFO:teuthology.orchestra.run.smithi055.stdout: "damage_type": "backtrace", 2024-04-02T07:25:59.703 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 1472407387, 2024-04-02T07:25:59.703 INFO:teuthology.orchestra.run.smithi055.stdout: "ino": 1099511627777, 2024-04-02T07:25:59.703 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/dir_test/file" 2024-04-02T07:25:59.703 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:25:59.703 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-02T07:25:59.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e3e00640 1 -- 172.21.15.55:0/3519248603 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f74bc066690 msgr2=0x7f74bc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e3e00640 1 --2- 172.21.15.55:0/3519248603 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f74bc066690 0x7f74bc068b50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f74d00011f0 tx=0x7f74d0009040 comp rx=0 tx=0).stop 2024-04-02T07:25:59.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e3e00640 1 -- 172.21.15.55:0/3519248603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74dc144260 msgr2=0x7f74dc15ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e3e00640 1 --2- 172.21.15.55:0/3519248603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74dc144260 0x7f74dc15ca10 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f74d40195a0 tx=0x7f74d4019730 comp rx=0 tx=0).stop 2024-04-02T07:25:59.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e3e00640 1 -- 172.21.15.55:0/3519248603 shutdown_connections 2024-04-02T07:25:59.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e3e00640 1 --2- 172.21.15.55:0/3519248603 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74dc144260 0x7f74dc15ca10 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e3e00640 1 --2- 172.21.15.55:0/3519248603 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74dc0b31a0 0x7f74dc13d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e3e00640 1 --2- 172.21.15.55:0/3519248603 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f74bc066690 0x7f74bc068b50 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e3e00640 1 --2- 172.21.15.55:0/3519248603 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74dc0709b0 0x7f74dc0afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e3e00640 1 -- 172.21.15.55:0/3519248603 >> 172.21.15.55:0/3519248603 conn(0x7f74dc06a390 msgr2=0x7f74dc0b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:59.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e3e00640 1 -- 172.21.15.55:0/3519248603 shutdown_connections 2024-04-02T07:25:59.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.693+0000 7f74e3e00640 1 -- 172.21.15.55:0/3519248603 wait complete. 2024-04-02T07:25:59.718 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-02T07:25:59.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.853+0000 7faa48000640 1 Processor -- start 2024-04-02T07:25:59.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.853+0000 7faa48000640 1 -- start start 2024-04-02T07:25:59.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.853+0000 7faa48000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faa40156f70 0x7faa4015d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.853+0000 7faa48000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa400b26b0 0x7faa400b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.853+0000 7faa48000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4015d950 con 0x7faa40157350 2024-04-02T07:25:59.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.853+0000 7faa48000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4015dc30 con 0x7faa400b26b0 2024-04-02T07:25:59.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.853+0000 7faa48000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa4015df10 con 0x7faa40156f70 2024-04-02T07:25:59.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.853+0000 7faa46000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa400b26b0 0x7faa400b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.853+0000 7faa46000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa400b26b0 0x7faa400b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35472/0 (socket says 172.21.15.55:35472) 2024-04-02T07:25:59.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.853+0000 7faa46000640 1 -- 172.21.15.55:0/1950425861 learned_addr learned my addr 172.21.15.55:0/1950425861 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:59.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.853+0000 7faa45600640 1 --2- 172.21.15.55:0/1950425861 >> v2:172.21.15.106:3300/0 conn(0x7faa40156f70 0x7faa4015d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.857+0000 7faa46000640 1 -- 172.21.15.55:0/1950425861 >> v2:172.21.15.106:3300/0 conn(0x7faa40156f70 msgr2=0x7faa4015d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:25:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.857+0000 7faa46000640 1 --2- 172.21.15.55:0/1950425861 >> v2:172.21.15.106:3300/0 conn(0x7faa40156f70 0x7faa4015d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.857+0000 7faa46000640 1 -- 172.21.15.55:0/1950425861 >> v1:172.21.15.106:6789/0 conn(0x7faa40157350 legacy=0x7faa400cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.857+0000 7faa46000640 1 -- 172.21.15.55:0/1950425861 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa400cf560 con 0x7faa400b26b0 2024-04-02T07:25:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.857+0000 7faa46000640 1 --2- 172.21.15.55:0/1950425861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa400b26b0 0x7faa400b31c0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7faa4006ae70 tx=0x7faa3801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af46e740f2d7dcc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.857+0000 7faa3fe00640 1 -- 172.21.15.55:0/1950425861 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa380a5790 con 0x7faa400b26b0 2024-04-02T07:25:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.857+0000 7faa3fe00640 1 -- 172.21.15.55:0/1950425861 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa380a58f0 con 0x7faa400b26b0 2024-04-02T07:25:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.857+0000 7faa3fe00640 1 -- 172.21.15.55:0/1950425861 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa380a5c80 con 0x7faa400b26b0 2024-04-02T07:25:59.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.857+0000 7faa48000640 1 -- 172.21.15.55:0/1950425861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa400b26b0 msgr2=0x7faa400b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.857+0000 7faa48000640 1 --2- 172.21.15.55:0/1950425861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa400b26b0 0x7faa400b31c0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7faa4006ae70 tx=0x7faa3801c9c0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.857+0000 7faa48000640 1 -- 172.21.15.55:0/1950425861 shutdown_connections 2024-04-02T07:25:59.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.857+0000 7faa48000640 1 --2- 172.21.15.55:0/1950425861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa400b26b0 0x7faa400b31c0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.857+0000 7faa48000640 1 --2- 172.21.15.55:0/1950425861 >> v2:172.21.15.106:3300/0 conn(0x7faa40156f70 0x7faa4015d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.857+0000 7faa48000640 1 -- 172.21.15.55:0/1950425861 >> 172.21.15.55:0/1950425861 conn(0x7faa400b13b0 msgr2=0x7faa400b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:25:59.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.857+0000 7faa48000640 1 -- 172.21.15.55:0/1950425861 shutdown_connections 2024-04-02T07:25:59.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa48000640 1 -- 172.21.15.55:0/1950425861 wait complete. 2024-04-02T07:25:59.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa48000640 1 Processor -- start 2024-04-02T07:25:59.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa48000640 1 -- start start 2024-04-02T07:25:59.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa48000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faa400b26b0 0x7faa400cdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa48000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa40156f70 0x7faa4013bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa48000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa40157350 0x7faa4013c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa48000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa40153330 con 0x7faa40157350 2024-04-02T07:25:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa48000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa401504c0 con 0x7faa40156f70 2024-04-02T07:25:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa48000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa40152720 con 0x7faa400b26b0 2024-04-02T07:25:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa46000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa40157350 0x7faa4013c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa46000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa40157350 0x7faa4013c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35488/0 (socket says 172.21.15.55:35488) 2024-04-02T07:25:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa46000640 1 -- 172.21.15.55:0/1684379361 learned_addr learned my addr 172.21.15.55:0/1684379361 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:25:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa45600640 1 --2- 172.21.15.55:0/1684379361 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faa400b26b0 0x7faa400cdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa44c00640 1 --2- 172.21.15.55:0/1684379361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa40156f70 0x7faa4013bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa46000640 1 -- 172.21.15.55:0/1684379361 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faa400b26b0 msgr2=0x7faa400cdb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa46000640 1 --2- 172.21.15.55:0/1684379361 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faa400b26b0 0x7faa400cdb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa46000640 1 -- 172.21.15.55:0/1684379361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa40156f70 msgr2=0x7faa4013bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:25:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa46000640 1 --2- 172.21.15.55:0/1684379361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa40156f70 0x7faa4013bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:25:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa46000640 1 -- 172.21.15.55:0/1684379361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa38009b30 con 0x7faa40157350 2024-04-02T07:25:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa46000640 1 --2- 172.21.15.55:0/1684379361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa40157350 0x7faa4013c080 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7faa380af040 tx=0x7faa38019760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:59.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa3d600640 1 -- 172.21.15.55:0/1684379361 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa380b8670 con 0x7faa40157350 2024-04-02T07:25:59.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa3d600640 1 -- 172.21.15.55:0/1684379361 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa380b87d0 con 0x7faa40157350 2024-04-02T07:25:59.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa48000640 1 -- 172.21.15.55:0/1684379361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa40152a00 con 0x7faa40157350 2024-04-02T07:25:59.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.861+0000 7faa3d600640 1 -- 172.21.15.55:0/1684379361 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa380b8b80 con 0x7faa40157350 2024-04-02T07:25:59.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.865+0000 7faa48000640 1 -- 172.21.15.55:0/1684379361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa40152fc0 con 0x7faa40157350 2024-04-02T07:25:59.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.865+0000 7faa48000640 1 -- 172.21.15.55:0/1684379361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa401534e0 con 0x7faa40157350 2024-04-02T07:25:59.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.865+0000 7faa3d600640 1 -- 172.21.15.55:0/1684379361 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7faa380b8ce0 con 0x7faa40157350 2024-04-02T07:25:59.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.865+0000 7faa3d600640 1 --2- 172.21.15.55:0/1684379361 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faa20066690 0x7faa20068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:25:59.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.865+0000 7faa3d600640 1 -- 172.21.15.55:0/1684379361 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa3811f800 con 0x7faa40157350 2024-04-02T07:25:59.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.865+0000 7faa45600640 1 --2- 172.21.15.55:0/1684379361 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faa20066690 0x7faa20068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:25:59.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.865+0000 7faa45600640 1 --2- 172.21.15.55:0/1684379361 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faa20066690 0x7faa20068b50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7faa34007a60 tx=0x7faa34008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:25:59.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:25:59.869+0000 7faa3d600640 1 -- 172.21.15.55:0/1684379361 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7faa401534e0 con 0x7faa40157350 2024-04-02T07:26:00.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.065+0000 7faa48000640 1 -- 172.21.15.55:0/1684379361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7faa401534e0 con 0x7faa40157350 2024-04-02T07:26:00.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.065+0000 7faa3d600640 1 -- 172.21.15.55:0/1684379361 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7faa401534e0 con 0x7faa40157350 2024-04-02T07:26:00.070 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:00.070 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-02T07:26:00.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.069+0000 7faa48000640 1 -- 172.21.15.55:0/1684379361 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faa20066690 msgr2=0x7faa20068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.069+0000 7faa48000640 1 --2- 172.21.15.55:0/1684379361 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faa20066690 0x7faa20068b50 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7faa34007a60 tx=0x7faa34008040 comp rx=0 tx=0).stop 2024-04-02T07:26:00.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.069+0000 7faa48000640 1 -- 172.21.15.55:0/1684379361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa40157350 msgr2=0x7faa4013c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.069+0000 7faa48000640 1 --2- 172.21.15.55:0/1684379361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa40157350 0x7faa4013c080 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7faa380af040 tx=0x7faa38019760 comp rx=0 tx=0).stop 2024-04-02T07:26:00.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.069+0000 7faa48000640 1 -- 172.21.15.55:0/1684379361 shutdown_connections 2024-04-02T07:26:00.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.069+0000 7faa48000640 1 --2- 172.21.15.55:0/1684379361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa40157350 0x7faa4013c080 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.069+0000 7faa48000640 1 --2- 172.21.15.55:0/1684379361 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faa20066690 0x7faa20068b50 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.069+0000 7faa48000640 1 --2- 172.21.15.55:0/1684379361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa40156f70 0x7faa4013bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.069+0000 7faa48000640 1 --2- 172.21.15.55:0/1684379361 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faa400b26b0 0x7faa400cdb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.069+0000 7faa48000640 1 -- 172.21.15.55:0/1684379361 >> 172.21.15.55:0/1684379361 conn(0x7faa400b13b0 msgr2=0x7faa400b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:00.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.069+0000 7faa48000640 1 -- 172.21.15.55:0/1684379361 shutdown_connections 2024-04-02T07:26:00.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.069+0000 7faa48000640 1 -- 172.21.15.55:0/1684379361 wait complete. 2024-04-02T07:26:00.091 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-02T07:26:00.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:26:00.092 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub start / repair,recursive,force 2024-04-02T07:26:00.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.233+0000 7fe366000640 1 Processor -- start 2024-04-02T07:26:00.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.233+0000 7fe366000640 1 -- start start 2024-04-02T07:26:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.233+0000 7fe366000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe3600cc700 0x7fe36006bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.233+0000 7fe366000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe360099120 0x7fe36015c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.233+0000 7fe366000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3600ccae0 con 0x7fe3600cead0 2024-04-02T07:26:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.233+0000 7fe366000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3600d0300 con 0x7fe360099120 2024-04-02T07:26:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.233+0000 7fe366000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3600cf260 con 0x7fe3600cc700 2024-04-02T07:26:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.233+0000 7fe35fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe360099120 0x7fe36015c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.233+0000 7fe35fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe360099120 0x7fe36015c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35500/0 (socket says 172.21.15.55:35500) 2024-04-02T07:26:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.233+0000 7fe35fe00640 1 -- 172.21.15.55:0/1705753035 learned_addr learned my addr 172.21.15.55:0/1705753035 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:00.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.233+0000 7fe35f400640 1 --2- 172.21.15.55:0/1705753035 >> v2:172.21.15.106:3300/0 conn(0x7fe3600cc700 0x7fe36006bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.233+0000 7fe35fe00640 1 -- 172.21.15.55:0/1705753035 >> v2:172.21.15.106:3300/0 conn(0x7fe3600cc700 msgr2=0x7fe36006bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:00.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.233+0000 7fe35fe00640 1 --2- 172.21.15.55:0/1705753035 >> v2:172.21.15.106:3300/0 conn(0x7fe3600cc700 0x7fe36006bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.233+0000 7fe35fe00640 1 -- 172.21.15.55:0/1705753035 >> v1:172.21.15.106:6789/0 conn(0x7fe3600cead0 legacy=0x7fe360098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:00.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.233+0000 7fe35fe00640 1 -- 172.21.15.55:0/1705753035 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3600cf540 con 0x7fe360099120 2024-04-02T07:26:00.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.237+0000 7fe35fe00640 1 --2- 172.21.15.55:0/1705753035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe360099120 0x7fe36015c2d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe360070cc0 tx=0x7fe35801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a88f730624a867 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:00.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.237+0000 7fe35ea00640 1 -- 172.21.15.55:0/1705753035 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3580a5870 con 0x7fe360099120 2024-04-02T07:26:00.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.237+0000 7fe35ea00640 1 -- 172.21.15.55:0/1705753035 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3580a59d0 con 0x7fe360099120 2024-04-02T07:26:00.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.237+0000 7fe35ea00640 1 -- 172.21.15.55:0/1705753035 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3580a5d60 con 0x7fe360099120 2024-04-02T07:26:00.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.237+0000 7fe366000640 1 -- 172.21.15.55:0/1705753035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe360099120 msgr2=0x7fe36015c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.237+0000 7fe366000640 1 --2- 172.21.15.55:0/1705753035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe360099120 0x7fe36015c2d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe360070cc0 tx=0x7fe35801c9b0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.237+0000 7fe366000640 1 -- 172.21.15.55:0/1705753035 shutdown_connections 2024-04-02T07:26:00.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.237+0000 7fe366000640 1 --2- 172.21.15.55:0/1705753035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe360099120 0x7fe36015c2d0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.237+0000 7fe366000640 1 --2- 172.21.15.55:0/1705753035 >> v2:172.21.15.106:3300/0 conn(0x7fe3600cc700 0x7fe36006bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.237+0000 7fe366000640 1 -- 172.21.15.55:0/1705753035 >> 172.21.15.55:0/1705753035 conn(0x7fe3600b2150 msgr2=0x7fe3600b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:00.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.237+0000 7fe366000640 1 -- 172.21.15.55:0/1705753035 shutdown_connections 2024-04-02T07:26:00.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.237+0000 7fe366000640 1 -- 172.21.15.55:0/1705753035 wait complete. 2024-04-02T07:26:00.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe366000640 1 Processor -- start 2024-04-02T07:26:00.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe366000640 1 -- start start 2024-04-02T07:26:00.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe366000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe360099120 0x7fe36015f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe366000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3600cc700 0x7fe360154780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe366000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3600cead0 0x7fe360154cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe366000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe360157d20 con 0x7fe3600cead0 2024-04-02T07:26:00.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe366000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3600ca880 con 0x7fe3600cc700 2024-04-02T07:26:00.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe366000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe360155200 con 0x7fe360099120 2024-04-02T07:26:00.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe35fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3600cead0 0x7fe360154cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe35fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3600cead0 0x7fe360154cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35512/0 (socket says 172.21.15.55:35512) 2024-04-02T07:26:00.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe35fe00640 1 -- 172.21.15.55:0/2078269757 learned_addr learned my addr 172.21.15.55:0/2078269757 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:00.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe35f400640 1 --2- 172.21.15.55:0/2078269757 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe360099120 0x7fe36015f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe356a00640 1 --2- 172.21.15.55:0/2078269757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3600cc700 0x7fe360154780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe35fe00640 1 -- 172.21.15.55:0/2078269757 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe360099120 msgr2=0x7fe36015f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe35fe00640 1 --2- 172.21.15.55:0/2078269757 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe360099120 0x7fe36015f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe35fe00640 1 -- 172.21.15.55:0/2078269757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3600cc700 msgr2=0x7fe360154780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe35fe00640 1 --2- 172.21.15.55:0/2078269757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3600cc700 0x7fe360154780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe35fe00640 1 -- 172.21.15.55:0/2078269757 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe358009b30 con 0x7fe3600cead0 2024-04-02T07:26:00.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe35f400640 1 --2- 172.21.15.55:0/2078269757 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe360099120 0x7fe36015f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:00.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe356a00640 1 --2- 172.21.15.55:0/2078269757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3600cc700 0x7fe360154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:00.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.241+0000 7fe35fe00640 1 --2- 172.21.15.55:0/2078269757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3600cead0 0x7fe360154cc0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fe35801b060 tx=0x7fe358019750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:00.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.249+0000 7fe357e00640 1 -- 172.21.15.55:0/2078269757 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3580b8670 con 0x7fe3600cead0 2024-04-02T07:26:00.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.249+0000 7fe357e00640 1 -- 172.21.15.55:0/2078269757 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3580b87d0 con 0x7fe3600cead0 2024-04-02T07:26:00.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.249+0000 7fe357e00640 1 -- 172.21.15.55:0/2078269757 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3580b8b80 con 0x7fe3600cead0 2024-04-02T07:26:00.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.249+0000 7fe366000640 1 -- 172.21.15.55:0/2078269757 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3600b17b0 con 0x7fe3600cead0 2024-04-02T07:26:00.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.249+0000 7fe366000640 1 -- 172.21.15.55:0/2078269757 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3600ca5a0 con 0x7fe3600cead0 2024-04-02T07:26:00.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.249+0000 7fe357e00640 1 -- 172.21.15.55:0/2078269757 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe3580b8ce0 con 0x7fe3600cead0 2024-04-02T07:26:00.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.249+0000 7fe357e00640 1 --2- 172.21.15.55:0/2078269757 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe33c066690 0x7fe33c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.249+0000 7fe357e00640 1 -- 172.21.15.55:0/2078269757 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe35811f6c0 con 0x7fe3600cead0 2024-04-02T07:26:00.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.249+0000 7fe35f400640 1 --2- 172.21.15.55:0/2078269757 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe33c066690 0x7fe33c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.249+0000 7fe3693fb000 1 Processor -- start 2024-04-02T07:26:00.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe3693fb000 1 -- start start 2024-04-02T07:26:00.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe35f400640 1 --2- 172.21.15.55:0/2078269757 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe33c066690 0x7fe33c068b50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe350007a70 tx=0x7fe350008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:00.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe3693fb000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b70db8b20 0x564b70db8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe3693fb000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70db9440 0x564b70d6e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe3693fb000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b70d6ee80 0x564b70d6f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe3693fb000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b70c375c0 con 0x564b70db9440 2024-04-02T07:26:00.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe3693fb000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b70bc3a00 con 0x564b70db8b20 2024-04-02T07:26:00.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe3693fb000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b70bc0fd0 con 0x564b70d6ee80 2024-04-02T07:26:00.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe356a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70db9440 0x564b70d6e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe35f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b70db8b20 0x564b70db8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe356a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70db9440 0x564b70d6e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35524/0 (socket says 172.21.15.55:35524) 2024-04-02T07:26:00.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe356a00640 1 -- 172.21.15.55:0/112774930 learned_addr learned my addr 172.21.15.55:0/112774930 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:00.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe35fe00640 1 --2- 172.21.15.55:0/112774930 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b70d6ee80 0x564b70d6f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe356a00640 1 -- 172.21.15.55:0/112774930 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b70d6ee80 msgr2=0x564b70d6f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe356a00640 1 --2- 172.21.15.55:0/112774930 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b70d6ee80 0x564b70d6f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe356a00640 1 -- 172.21.15.55:0/112774930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b70db8b20 msgr2=0x564b70db8f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe356a00640 1 --2- 172.21.15.55:0/112774930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b70db8b20 0x564b70db8f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe356a00640 1 -- 172.21.15.55:0/112774930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b70b5d8c0 con 0x564b70db9440 2024-04-02T07:26:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe356a00640 1 --2- 172.21.15.55:0/112774930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70db9440 0x564b70d6e940 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe348009810 tx=0x7fe348009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80e53d2690cb284 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe34fe00640 1 -- 172.21.15.55:0/112774930 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe348018070 con 0x564b70db9440 2024-04-02T07:26:00.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe34fe00640 1 -- 172.21.15.55:0/112774930 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe348004020 con 0x564b70db9440 2024-04-02T07:26:00.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe34fe00640 1 -- 172.21.15.55:0/112774930 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3480041b0 con 0x564b70db9440 2024-04-02T07:26:00.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe3693fb000 1 -- 172.21.15.55:0/112774930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70db9440 msgr2=0x564b70d6e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe3693fb000 1 --2- 172.21.15.55:0/112774930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70db9440 0x564b70d6e940 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fe348009810 tx=0x7fe348009cd0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe3693fb000 1 -- 172.21.15.55:0/112774930 shutdown_connections 2024-04-02T07:26:00.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe3693fb000 1 --2- 172.21.15.55:0/112774930 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b70d6ee80 0x564b70d6f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe3693fb000 1 --2- 172.21.15.55:0/112774930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70db9440 0x564b70d6e940 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe3693fb000 1 --2- 172.21.15.55:0/112774930 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b70db8b20 0x564b70db8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe3693fb000 1 -- 172.21.15.55:0/112774930 >> 172.21.15.55:0/112774930 conn(0x564b70d75400 msgr2=0x564b70d6d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:00.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe3693fb000 1 -- 172.21.15.55:0/112774930 shutdown_connections 2024-04-02T07:26:00.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe3693fb000 1 -- 172.21.15.55:0/112774930 wait complete. 2024-04-02T07:26:00.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe3693fb000 1 -- start start 2024-04-02T07:26:00.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.253+0000 7fe3693fb000 1 Processor -- start 2024-04-02T07:26:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe3693fb000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70d6ee80 0x564b70d79cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe3693fb000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b70db8b20 0x564b70d7a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe3693fb000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b70db9440 0x564b70d7a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe3693fb000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b70bbc8c0 con 0x564b70d6ee80 2024-04-02T07:26:00.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe3693fb000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b70b5c160 con 0x564b70db9440 2024-04-02T07:26:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe3693fb000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b70b5be00 con 0x564b70db8b20 2024-04-02T07:26:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe3693fb000 10 client.0 _ll_register_callbacks cb 0x564b70d5a820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:26:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe35f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70d6ee80 0x564b70d79cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe35f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70d6ee80 0x564b70d79cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35526/0 (socket says 172.21.15.55:35526) 2024-04-02T07:26:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe35f400640 1 -- 172.21.15.55:0/3880420650 learned_addr learned my addr 172.21.15.55:0/3880420650 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe35fe00640 1 --2- 172.21.15.55:0/3880420650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b70db9440 0x564b70d7a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe356a00640 1 --2- 172.21.15.55:0/3880420650 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b70db8b20 0x564b70d7a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe35f400640 1 -- 172.21.15.55:0/3880420650 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b70db8b20 msgr2=0x564b70d7a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe35f400640 1 --2- 172.21.15.55:0/3880420650 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b70db8b20 0x564b70d7a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe35f400640 1 -- 172.21.15.55:0/3880420650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b70db9440 msgr2=0x564b70d7a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe35f400640 1 --2- 172.21.15.55:0/3880420650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b70db9440 0x564b70d7a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe35f400640 1 -- 172.21.15.55:0/3880420650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe34800e040 con 0x564b70d6ee80 2024-04-02T07:26:00.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe35f400640 1 --2- 172.21.15.55:0/3880420650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70d6ee80 0x564b70d79cf0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe350014710 tx=0x7fe3500046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731f5cf8d3a6094f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe34cc00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:26:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe34cc00640 1 -- 172.21.15.55:0/3880420650 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3500159e0 con 0x564b70d6ee80 2024-04-02T07:26:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe3693fb000 1 -- 172.21.15.55:0/3880420650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b70bbb210 con 0x564b70d6ee80 2024-04-02T07:26:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe34cc00640 1 -- 172.21.15.55:0/3880420650 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe350015b40 con 0x564b70d6ee80 2024-04-02T07:26:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe34cc00640 1 -- 172.21.15.55:0/3880420650 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe350015d00 con 0x564b70d6ee80 2024-04-02T07:26:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe3693fb000 10 client.6447 fetch_fsmap learned FSMap version 34 2024-04-02T07:26:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe3693fb000 1 -- 172.21.15.55:0/3880420650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x564b708b8d50 con 0x564b70d6ee80 2024-04-02T07:26:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe34cc00640 1 -- 172.21.15.55:0/3880420650 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564b70bbb210 con 0x564b70d6ee80 2024-04-02T07:26:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe34cc00640 1 -- 172.21.15.55:0/3880420650 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 34) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fe35002a440 con 0x564b70d6ee80 2024-04-02T07:26:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe3693fb000 10 client.6447 fetch_fsmap finished waiting for FSMap version 34 2024-04-02T07:26:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe3693fb000 10 client.6447 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-04-02T07:26:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe3693fb000 20 client.6447 populate_metadata read hostname 'smithi055' 2024-04-02T07:26:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe3693fb000 1 --2- 172.21.15.55:0/3880420650 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x564b70dc7dc0 0x564b70dca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe3693fb000 4 client.6447 mds_command: new command op to 6138 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:26:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe3693fb000 1 -- 172.21.15.55:0/3880420650 --> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b70b7aaa0 con 0x564b70dc7dc0 2024-04-02T07:26:00.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe356a00640 1 --2- 172.21.15.55:0/3880420650 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x564b70dc7dc0 0x564b70dca1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe356a00640 1 --2- 172.21.15.55:0/3880420650 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x564b70dc7dc0 0x564b70dca1b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bce5440e6c1be6a4 server_cookie=c44fb74909d8aff5 in_seq=0 out_seq=0 2024-04-02T07:26:00.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.257+0000 7fe34cc00640 10 client.6447 ms_handle_connect on v2:172.21.15.106:6835/1050953219 2024-04-02T07:26:00.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.261+0000 7fe34cc00640 1 -- 172.21.15.55:0/3880420650 <== mds.0 v2:172.21.15.106:6835/1050953219 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x564b70b7aaa0 con 0x564b70dc7dc0 2024-04-02T07:26:00.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.261+0000 7fe34cc00640 10 client.6447 handle_command_reply: tid=0 2024-04-02T07:26:00.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.261+0000 7fe3693fb000 1 client.6447 shutdown 2024-04-02T07:26:00.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.261+0000 7fe3693fb000 1 -- 172.21.15.55:0/3880420650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70d6ee80 msgr2=0x564b70d79cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.261+0000 7fe3693fb000 1 --2- 172.21.15.55:0/3880420650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70d6ee80 0x564b70d79cf0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fe350014710 tx=0x7fe3500046d0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.261+0000 7fe3693fb000 1 -- 172.21.15.55:0/3880420650 shutdown_connections 2024-04-02T07:26:00.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.261+0000 7fe3693fb000 1 --2- 172.21.15.55:0/3880420650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b70db9440 0x564b70d7a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.261+0000 7fe3693fb000 1 --2- 172.21.15.55:0/3880420650 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x564b70dc7dc0 0x564b70dca1b0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.261+0000 7fe3693fb000 1 --2- 172.21.15.55:0/3880420650 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b70db8b20 0x564b70d7a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.261+0000 7fe3693fb000 1 --2- 172.21.15.55:0/3880420650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70d6ee80 0x564b70d79cf0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.261+0000 7fe34cc00640 0 client.6447 ms_handle_reset on v2:172.21.15.106:6835/1050953219 2024-04-02T07:26:00.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.261+0000 7fe3693fb000 1 -- 172.21.15.55:0/3880420650 >> 172.21.15.55:0/3880420650 conn(0x564b70d75400 msgr2=0x564b70d6d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:00.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.261+0000 7fe3693fb000 1 -- 172.21.15.55:0/3880420650 shutdown_connections 2024-04-02T07:26:00.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.261+0000 7fe3693fb000 1 -- 172.21.15.55:0/3880420650 wait complete. 2024-04-02T07:26:00.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.261+0000 7fe3693fb000 20 client.6447 trim_cache size 0 max 16384 2024-04-02T07:26:00.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.273+0000 7fe3693fb000 1 Processor -- start 2024-04-02T07:26:00.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.273+0000 7fe3693fb000 1 -- start start 2024-04-02T07:26:00.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe3693fb000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b70d6ee80 0x564b70e12d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe3693fb000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70db8b20 0x564b70e132c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe3693fb000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b70db9440 0x564b70e13800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe3693fb000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b708799d0 con 0x564b70db8b20 2024-04-02T07:26:00.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe3693fb000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b70bc4c90 con 0x564b70d6ee80 2024-04-02T07:26:00.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe3693fb000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b70dceb40 con 0x564b70db9440 2024-04-02T07:26:00.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe356a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70db8b20 0x564b70e132c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe356a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70db8b20 0x564b70e132c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35536/0 (socket says 172.21.15.55:35536) 2024-04-02T07:26:00.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe35f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b70d6ee80 0x564b70e12d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe356a00640 1 -- 172.21.15.55:0/1015950848 learned_addr learned my addr 172.21.15.55:0/1015950848 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:00.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe35fe00640 1 --2- 172.21.15.55:0/1015950848 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b70db9440 0x564b70e13800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe356a00640 1 -- 172.21.15.55:0/1015950848 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b70db9440 msgr2=0x564b70e13800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:00.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe356a00640 1 --2- 172.21.15.55:0/1015950848 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b70db9440 0x564b70e13800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe356a00640 1 -- 172.21.15.55:0/1015950848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b70d6ee80 msgr2=0x564b70e12d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:00.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe356a00640 1 --2- 172.21.15.55:0/1015950848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b70d6ee80 0x564b70e12d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe356a00640 1 -- 172.21.15.55:0/1015950848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b70b81ba0 con 0x564b70db8b20 2024-04-02T07:26:00.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe356a00640 1 --2- 172.21.15.55:0/1015950848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70db8b20 0x564b70e132c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe348015000 tx=0x7fe348013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e033f057657b53 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:00.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe354c00640 1 -- 172.21.15.55:0/1015950848 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe348018040 con 0x564b70db8b20 2024-04-02T07:26:00.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe354c00640 1 -- 172.21.15.55:0/1015950848 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe348024040 con 0x564b70db8b20 2024-04-02T07:26:00.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe354c00640 1 -- 172.21.15.55:0/1015950848 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe348004480 con 0x564b70db8b20 2024-04-02T07:26:00.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe3693fb000 1 -- 172.21.15.55:0/1015950848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70db8b20 msgr2=0x564b70e132c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe3693fb000 1 --2- 172.21.15.55:0/1015950848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70db8b20 0x564b70e132c0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fe348015000 tx=0x7fe348013000 comp rx=0 tx=0).stop 2024-04-02T07:26:00.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe3693fb000 1 -- 172.21.15.55:0/1015950848 shutdown_connections 2024-04-02T07:26:00.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe3693fb000 1 --2- 172.21.15.55:0/1015950848 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b70db9440 0x564b70e13800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe3693fb000 1 --2- 172.21.15.55:0/1015950848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70db8b20 0x564b70e132c0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe3693fb000 1 --2- 172.21.15.55:0/1015950848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b70d6ee80 0x564b70e12d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe3693fb000 1 -- 172.21.15.55:0/1015950848 >> 172.21.15.55:0/1015950848 conn(0x564b70d75400 msgr2=0x564b70dcaa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:00.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe3693fb000 1 -- 172.21.15.55:0/1015950848 shutdown_connections 2024-04-02T07:26:00.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe3693fb000 1 -- 172.21.15.55:0/1015950848 wait complete. 2024-04-02T07:26:00.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe3693fb000 1 -- start start 2024-04-02T07:26:00.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.277+0000 7fe3693fb000 1 Processor -- start 2024-04-02T07:26:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70d6ee80 0x564b70db6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b70db8b20 0x564b70e161c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b70db9440 0x564b70e16700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b70d73590 con 0x564b70d6ee80 2024-04-02T07:26:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b70b59ea0 con 0x564b70db8b20 2024-04-02T07:26:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x564b70bc4e60 con 0x564b70db9440 2024-04-02T07:26:00.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 10 client.0 _ll_register_callbacks cb 0x564b70b6af80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:26:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe35f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70d6ee80 0x564b70db6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe35f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70d6ee80 0x564b70db6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35550/0 (socket says 172.21.15.55:35550) 2024-04-02T07:26:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe35f400640 1 -- 172.21.15.55:0/2315668346 learned_addr learned my addr 172.21.15.55:0/2315668346 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe356a00640 1 --2- 172.21.15.55:0/2315668346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b70db8b20 0x564b70e161c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe35fe00640 1 --2- 172.21.15.55:0/2315668346 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b70db9440 0x564b70e16700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe35f400640 1 -- 172.21.15.55:0/2315668346 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b70db9440 msgr2=0x564b70e16700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe35f400640 1 --2- 172.21.15.55:0/2315668346 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b70db9440 0x564b70e16700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe35f400640 1 -- 172.21.15.55:0/2315668346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b70db8b20 msgr2=0x564b70e161c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe35f400640 1 --2- 172.21.15.55:0/2315668346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b70db8b20 0x564b70e161c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe35f400640 1 -- 172.21.15.55:0/2315668346 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b70b5d8c0 con 0x564b70d6ee80 2024-04-02T07:26:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe35f400640 1 --2- 172.21.15.55:0/2315668346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70d6ee80 0x564b70db6df0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe350007410 tx=0x7fe350016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=717dd8e4345fdf9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe34cc00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:26:00.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe34cc00640 1 -- 172.21.15.55:0/2315668346 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe350007710 con 0x564b70d6ee80 2024-04-02T07:26:00.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe34cc00640 1 -- 172.21.15.55:0/2315668346 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe35000fe70 con 0x564b70d6ee80 2024-04-02T07:26:00.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 1 -- 172.21.15.55:0/2315668346 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b70bb96a0 con 0x564b70d6ee80 2024-04-02T07:26:00.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe34cc00640 1 -- 172.21.15.55:0/2315668346 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe35002a950 con 0x564b70d6ee80 2024-04-02T07:26:00.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 10 client.6453 fetch_fsmap learned FSMap version 34 2024-04-02T07:26:00.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 1 -- 172.21.15.55:0/2315668346 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x564b70b67cf0 con 0x564b70d6ee80 2024-04-02T07:26:00.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe34cc00640 1 -- 172.21.15.55:0/2315668346 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564b70bb96a0 con 0x564b70d6ee80 2024-04-02T07:26:00.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe34cc00640 1 -- 172.21.15.55:0/2315668346 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 34) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fe3500059a0 con 0x564b70d6ee80 2024-04-02T07:26:00.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 10 client.6453 fetch_fsmap finished waiting for FSMap version 34 2024-04-02T07:26:00.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 10 client.6453 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-04-02T07:26:00.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 20 client.6453 populate_metadata read hostname 'smithi055' 2024-04-02T07:26:00.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 1 --2- 172.21.15.55:0/2315668346 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x564b70dd3db0 0x564b70e1fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 4 client.6453 mds_command: new command op to 6138 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}] 2024-04-02T07:26:00.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 1 -- 172.21.15.55:0/2315668346 --> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive", "force"]}) v1 -- 0x564b70b84440 con 0x564b70dd3db0 2024-04-02T07:26:00.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe356a00640 1 --2- 172.21.15.55:0/2315668346 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x564b70dd3db0 0x564b70e1fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe34cc00640 10 client.6453 ms_handle_connect on v2:172.21.15.106:6835/1050953219 2024-04-02T07:26:00.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe356a00640 1 --2- 172.21.15.55:0/2315668346 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x564b70dd3db0 0x564b70e1fe50 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebf7bbdd7ac26ab5 server_cookie=53d245a6d46df3da in_seq=0 out_seq=0 2024-04-02T07:26:00.289 INFO:tasks.ceph.mds.d.smithi106.stderr:2024-04-02T07:26:00.283+0000 7f442aa00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v4 ap=1 DIRTYPARENT s=0 n(v0 rc2024-04-02T07:25:27.335533+0000 1=1+0) (iversion lock) caps={6327=pAsLsXsFs/-@2},l=6327(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 scrubqueue=0 0x563cd6c1bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v4>,<0x1/dir_test v7>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-02T07:26:00.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe34cc00640 1 -- 172.21.15.55:0/2315668346 <== mds.0 v2:172.21.15.106:6835/1050953219 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x564b70b84440 con 0x564b70dd3db0 2024-04-02T07:26:00.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe34cc00640 10 client.6453 handle_command_reply: tid=0 2024-04-02T07:26:00.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 1 client.6453 shutdown 2024-04-02T07:26:00.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 1 -- 172.21.15.55:0/2315668346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70d6ee80 msgr2=0x564b70db6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 1 --2- 172.21.15.55:0/2315668346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70d6ee80 0x564b70db6df0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fe350007410 tx=0x7fe350016000 comp rx=0 tx=0).stop 2024-04-02T07:26:00.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 1 -- 172.21.15.55:0/2315668346 shutdown_connections 2024-04-02T07:26:00.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.281+0000 7fe3693fb000 1 --2- 172.21.15.55:0/2315668346 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x564b70dd3db0 0x564b70e1fe50 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.285+0000 7fe3693fb000 1 --2- 172.21.15.55:0/2315668346 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x564b70db9440 0x564b70e16700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.285+0000 7fe3693fb000 1 --2- 172.21.15.55:0/2315668346 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x564b70db8b20 0x564b70e161c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.285+0000 7fe3693fb000 1 --2- 172.21.15.55:0/2315668346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x564b70d6ee80 0x564b70db6df0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.285+0000 7fe3693fb000 1 -- 172.21.15.55:0/2315668346 >> 172.21.15.55:0/2315668346 conn(0x564b70d75400 msgr2=0x564b70dcb140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:00.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.285+0000 7fe34cc00640 0 client.6453 ms_handle_reset on v2:172.21.15.106:6835/1050953219 2024-04-02T07:26:00.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.285+0000 7fe3693fb000 1 -- 172.21.15.55:0/2315668346 shutdown_connections 2024-04-02T07:26:00.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.285+0000 7fe3693fb000 1 -- 172.21.15.55:0/2315668346 wait complete. 2024-04-02T07:26:00.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.285+0000 7fe3693fb000 20 client.6453 trim_cache size 0 max 16384 2024-04-02T07:26:00.291 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:26:00.291 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-04-02T07:26:00.291 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "751686f3-4a74-4d85-8ac2-77a830500589", 2024-04-02T07:26:00.291 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-04-02T07:26:00.291 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:26:00.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.285+0000 7fe366000640 1 -- 172.21.15.55:0/2078269757 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe33c066690 msgr2=0x7fe33c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.285+0000 7fe366000640 1 --2- 172.21.15.55:0/2078269757 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe33c066690 0x7fe33c068b50 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe350007a70 tx=0x7fe350008040 comp rx=0 tx=0).stop 2024-04-02T07:26:00.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.285+0000 7fe366000640 1 -- 172.21.15.55:0/2078269757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3600cead0 msgr2=0x7fe360154cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.285+0000 7fe366000640 1 --2- 172.21.15.55:0/2078269757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3600cead0 0x7fe360154cc0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fe35801b060 tx=0x7fe358019750 comp rx=0 tx=0).stop 2024-04-02T07:26:00.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.285+0000 7fe366000640 1 -- 172.21.15.55:0/2078269757 shutdown_connections 2024-04-02T07:26:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.285+0000 7fe366000640 1 --2- 172.21.15.55:0/2078269757 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3600cead0 0x7fe360154cc0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.285+0000 7fe366000640 1 --2- 172.21.15.55:0/2078269757 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe33c066690 0x7fe33c068b50 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.285+0000 7fe366000640 1 --2- 172.21.15.55:0/2078269757 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe3600cc700 0x7fe360154780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.285+0000 7fe366000640 1 --2- 172.21.15.55:0/2078269757 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe360099120 0x7fe36015f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.285+0000 7fe366000640 1 -- 172.21.15.55:0/2078269757 >> 172.21.15.55:0/2078269757 conn(0x7fe3600b2150 msgr2=0x7fe3600aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.285+0000 7fe366000640 1 -- 172.21.15.55:0/2078269757 shutdown_connections 2024-04-02T07:26:00.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.285+0000 7fe366000640 1 -- 172.21.15.55:0/2078269757 wait complete. 2024-04-02T07:26:00.306 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:26:00.307 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-02T07:26:00.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.445+0000 7fa4f0200640 1 Processor -- start 2024-04-02T07:26:00.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.445+0000 7fa4f0200640 1 -- start start 2024-04-02T07:26:00.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.445+0000 7fa4f0200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4e8160580 0x7fa4e8098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.449+0000 7fa4f0200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e80cfee0 con 0x7fa4e80b19b0 2024-04-02T07:26:00.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.449+0000 7fa4f0200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e80d01c0 con 0x7fa4e81601a0 2024-04-02T07:26:00.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.449+0000 7fa4f0200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e80d04a0 con 0x7fa4e8160580 2024-04-02T07:26:00.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.449+0000 7fa4ee200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa4e80b19b0 0x7fa4e80cb5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43842/0 (socket says 172.21.15.55:43842) 2024-04-02T07:26:00.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.449+0000 7fa4ee200640 1 -- 172.21.15.55:0/2586352809 learned_addr learned my addr 172.21.15.55:0/2586352809 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:26:00.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.449+0000 7fa4ece00640 1 --2- 172.21.15.55:0/2586352809 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4e8160580 0x7fa4e8098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.449+0000 7fa4e7e00640 1 -- 172.21.15.55:0/2586352809 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3277835152 0 0) 0x7fa4e80cfee0 con 0x7fa4e80b19b0 2024-04-02T07:26:00.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.449+0000 7fa4e7e00640 1 -- 172.21.15.55:0/2586352809 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4d0003530 con 0x7fa4e80b19b0 2024-04-02T07:26:00.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.449+0000 7fa4e7e00640 1 -- 172.21.15.55:0/2586352809 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667172182 0 0) 0x7fa4e80d01c0 con 0x7fa4e81601a0 2024-04-02T07:26:00.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.449+0000 7fa4e7e00640 1 -- 172.21.15.55:0/2586352809 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4e80cfee0 con 0x7fa4e81601a0 2024-04-02T07:26:00.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.449+0000 7fa4e7e00640 1 -- 172.21.15.55:0/2586352809 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 712126619 0 0) 0x7fa4d0003530 con 0x7fa4e80b19b0 2024-04-02T07:26:00.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.449+0000 7fa4ece00640 1 -- 172.21.15.55:0/2586352809 >> v1:172.21.15.106:6789/0 conn(0x7fa4e81601a0 legacy=0x7fa4e80cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.449+0000 7fa4ece00640 1 -- 172.21.15.55:0/2586352809 >> v1:172.21.15.55:6789/0 conn(0x7fa4e80b19b0 legacy=0x7fa4e80cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.449+0000 7fa4ece00640 1 -- 172.21.15.55:0/2586352809 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e80cade0 con 0x7fa4e8160580 2024-04-02T07:26:00.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.449+0000 7fa4ece00640 1 --2- 172.21.15.55:0/2586352809 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4e8160580 0x7fa4e8098a10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40097f0 tx=0x7fa4d401c2e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce4284afa9238d4a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:00.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4e7e00640 1 -- 172.21.15.55:0/2586352809 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e0001a00 con 0x7fa4e8160580 2024-04-02T07:26:00.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4e7e00640 1 -- 172.21.15.55:0/2586352809 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d40a7050 con 0x7fa4e8160580 2024-04-02T07:26:00.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4e7e00640 1 -- 172.21.15.55:0/2586352809 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d40ab620 con 0x7fa4e8160580 2024-04-02T07:26:00.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4f0200640 1 -- 172.21.15.55:0/2586352809 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4e8160580 msgr2=0x7fa4e8098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4f0200640 1 --2- 172.21.15.55:0/2586352809 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4e8160580 0x7fa4e8098a10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40097f0 tx=0x7fa4d401c2e0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4f0200640 1 -- 172.21.15.55:0/2586352809 shutdown_connections 2024-04-02T07:26:00.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4f0200640 1 --2- 172.21.15.55:0/2586352809 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4e8160580 0x7fa4e8098a10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4f0200640 1 -- 172.21.15.55:0/2586352809 >> 172.21.15.55:0/2586352809 conn(0x7fa4e80b2150 msgr2=0x7fa4e80b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:00.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4f0200640 1 -- 172.21.15.55:0/2586352809 shutdown_connections 2024-04-02T07:26:00.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4f0200640 1 -- 172.21.15.55:0/2586352809 wait complete. 2024-04-02T07:26:00.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4f0200640 1 Processor -- start 2024-04-02T07:26:00.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4f0200640 1 -- start start 2024-04-02T07:26:00.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4f0200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4e80b19b0 0x7fa4e80b3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4f0200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4e81601a0 0x7fa4e8152aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4f0200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4e8160580 0x7fa4e8157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4f0200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e80ca630 con 0x7fa4e80b19b0 2024-04-02T07:26:00.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4f0200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e8156650 con 0x7fa4e8160580 2024-04-02T07:26:00.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4f0200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e80c47f0 con 0x7fa4e81601a0 2024-04-02T07:26:00.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4ed800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4e80b19b0 0x7fa4e80b3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4ed800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4e80b19b0 0x7fa4e80b3030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35562/0 (socket says 172.21.15.55:35562) 2024-04-02T07:26:00.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4ed800640 1 -- 172.21.15.55:0/4243427093 learned_addr learned my addr 172.21.15.55:0/4243427093 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:00.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4ece00640 1 --2- 172.21.15.55:0/4243427093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4e81601a0 0x7fa4e8152aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.453+0000 7fa4ee200640 1 --2- 172.21.15.55:0/4243427093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4e8160580 0x7fa4e8157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.457+0000 7fa4ed800640 1 -- 172.21.15.55:0/4243427093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4e81601a0 msgr2=0x7fa4e8152aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.457+0000 7fa4ed800640 1 --2- 172.21.15.55:0/4243427093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4e81601a0 0x7fa4e8152aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.457+0000 7fa4ed800640 1 -- 172.21.15.55:0/4243427093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4e8160580 msgr2=0x7fa4e8157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.457+0000 7fa4ed800640 1 --2- 172.21.15.55:0/4243427093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4e8160580 0x7fa4e8157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.457+0000 7fa4ed800640 1 -- 172.21.15.55:0/4243427093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d4009420 con 0x7fa4e80b19b0 2024-04-02T07:26:00.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.457+0000 7fa4ece00640 1 --2- 172.21.15.55:0/4243427093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4e81601a0 0x7fa4e8152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:00.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.457+0000 7fa4ed800640 1 --2- 172.21.15.55:0/4243427093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4e80b19b0 0x7fa4e80b3030 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00c490 tx=0x7fa4dc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:00.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.457+0000 7fa4e5600640 1 -- 172.21.15.55:0/4243427093 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc0052d0 con 0x7fa4e80b19b0 2024-04-02T07:26:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.457+0000 7fa4e5600640 1 -- 172.21.15.55:0/4243427093 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4dc005430 con 0x7fa4e80b19b0 2024-04-02T07:26:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.457+0000 7fa4f0200640 1 -- 172.21.15.55:0/4243427093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e81568a0 con 0x7fa4e80b19b0 2024-04-02T07:26:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.457+0000 7fa4e5600640 1 -- 172.21.15.55:0/4243427093 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc012870 con 0x7fa4e80b19b0 2024-04-02T07:26:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.457+0000 7fa4f0200640 1 -- 172.21.15.55:0/4243427093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e8156e60 con 0x7fa4e80b19b0 2024-04-02T07:26:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.457+0000 7fa4e5600640 1 -- 172.21.15.55:0/4243427093 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa4dc0129d0 con 0x7fa4e80b19b0 2024-04-02T07:26:00.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.457+0000 7fa4e5600640 1 --2- 172.21.15.55:0/4243427093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4c80666c0 0x7fa4c8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.457+0000 7fa4e5600640 1 -- 172.21.15.55:0/4243427093 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4dc083d10 con 0x7fa4e80b19b0 2024-04-02T07:26:00.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.457+0000 7fa4ece00640 1 --2- 172.21.15.55:0/4243427093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4c80666c0 0x7fa4c8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4f3752000 1 Processor -- start 2024-04-02T07:26:00.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4f3752000 1 -- start start 2024-04-02T07:26:00.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4ece00640 1 --2- 172.21.15.55:0/4243427093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4c80666c0 0x7fa4c8068b80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40ad000 tx=0x7fa4d40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:00.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4f3752000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 0x561d4a264e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4f3752000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a265390 0x561d4a2184c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4f3752000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a218a00 0x561d4a218de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4f3752000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d4a0e3630 con 0x561d4a264a70 2024-04-02T07:26:00.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4f3752000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d4a070bd0 con 0x561d4a265390 2024-04-02T07:26:00.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4f3752000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d4a06e1a0 con 0x561d4a218a00 2024-04-02T07:26:00.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4ed800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 0x561d4a264e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4ed800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 0x561d4a264e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35578/0 (socket says 172.21.15.55:35578) 2024-04-02T07:26:00.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4ed800640 1 -- 172.21.15.55:0/280632769 learned_addr learned my addr 172.21.15.55:0/280632769 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:00.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4ece00640 1 --2- 172.21.15.55:0/280632769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a265390 0x561d4a2184c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4ee200640 1 --2- 172.21.15.55:0/280632769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a218a00 0x561d4a218de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4ed800640 1 -- 172.21.15.55:0/280632769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a218a00 msgr2=0x561d4a218de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:00.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4ed800640 1 --2- 172.21.15.55:0/280632769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a218a00 0x561d4a218de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4ed800640 1 -- 172.21.15.55:0/280632769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a265390 msgr2=0x561d4a2184c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:00.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4ed800640 1 --2- 172.21.15.55:0/280632769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a265390 0x561d4a2184c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4ed800640 1 -- 172.21.15.55:0/280632769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d49d65e20 con 0x561d4a264a70 2024-04-02T07:26:00.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4ece00640 1 --2- 172.21.15.55:0/280632769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a265390 0x561d4a2184c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:00.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4ed800640 1 --2- 172.21.15.55:0/280632769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 0x561d4a264e50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00ce50 tx=0x7fa4dc0554f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=979210130e74c582 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:00.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4da000640 1 -- 172.21.15.55:0/280632769 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc05d120 con 0x561d4a264a70 2024-04-02T07:26:00.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4da000640 1 -- 172.21.15.55:0/280632769 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4dc0530d0 con 0x561d4a264a70 2024-04-02T07:26:00.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4da000640 1 -- 172.21.15.55:0/280632769 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc012c80 con 0x561d4a264a70 2024-04-02T07:26:00.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4f3752000 1 -- 172.21.15.55:0/280632769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 msgr2=0x561d4a264e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4f3752000 1 --2- 172.21.15.55:0/280632769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 0x561d4a264e50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00ce50 tx=0x7fa4dc0554f0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4f3752000 1 -- 172.21.15.55:0/280632769 shutdown_connections 2024-04-02T07:26:00.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4f3752000 1 --2- 172.21.15.55:0/280632769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a218a00 0x561d4a218de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4f3752000 1 --2- 172.21.15.55:0/280632769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a265390 0x561d4a2184c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4f3752000 1 --2- 172.21.15.55:0/280632769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 0x561d4a264e50 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4f3752000 1 -- 172.21.15.55:0/280632769 >> 172.21.15.55:0/280632769 conn(0x561d4a019160 msgr2=0x561d4a247820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:00.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4f3752000 1 -- 172.21.15.55:0/280632769 shutdown_connections 2024-04-02T07:26:00.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4f3752000 1 -- 172.21.15.55:0/280632769 wait complete. 2024-04-02T07:26:00.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4f3752000 1 -- start start 2024-04-02T07:26:00.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.461+0000 7fa4f3752000 1 Processor -- start 2024-04-02T07:26:00.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4f3752000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a218a00 0x561d4a221810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4f3752000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 0x561d4a248a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4f3752000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a265390 0x561d4a248f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4f3752000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d4a069a90 con 0x561d4a264a70 2024-04-02T07:26:00.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4f3752000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d4a008d40 con 0x561d4a265390 2024-04-02T07:26:00.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4f3752000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d4a026f30 con 0x561d4a218a00 2024-04-02T07:26:00.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4f3752000 10 client.0 _ll_register_callbacks cb 0x561d4a0cb810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:26:00.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4ece00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 0x561d4a248a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4ece00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 0x561d4a248a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35580/0 (socket says 172.21.15.55:35580) 2024-04-02T07:26:00.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4ed800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a218a00 0x561d4a221810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4ece00640 1 -- 172.21.15.55:0/2706376628 learned_addr learned my addr 172.21.15.55:0/2706376628 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:00.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4ee200640 1 --2- 172.21.15.55:0/2706376628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a265390 0x561d4a248f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4ed800640 1 -- 172.21.15.55:0/2706376628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a265390 msgr2=0x561d4a248f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:00.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4ed800640 1 --2- 172.21.15.55:0/2706376628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a265390 0x561d4a248f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4ed800640 1 -- 172.21.15.55:0/2706376628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 msgr2=0x561d4a248a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:00.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4ed800640 1 --2- 172.21.15.55:0/2706376628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 0x561d4a248a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4ed800640 1 -- 172.21.15.55:0/2706376628 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e8156e60 con 0x561d4a218a00 2024-04-02T07:26:00.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4ece00640 1 --2- 172.21.15.55:0/2706376628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 0x561d4a248a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:26:00.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4ed800640 1 --2- 172.21.15.55:0/2706376628 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a218a00 0x561d4a221810 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc082230 tx=0x7fa4dc000ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5e50aafc8afeea5 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:00.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4cea00640 10 client.0 ms_handle_connect on v2:172.21.15.106:3301/0 2024-04-02T07:26:00.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4cea00640 1 -- 172.21.15.55:0/2706376628 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc07d030 con 0x561d4a218a00 2024-04-02T07:26:00.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4cea00640 1 -- 172.21.15.55:0/2706376628 <== mon.2 v2:172.21.15.106:3301/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4dc07e070 con 0x561d4a218a00 2024-04-02T07:26:00.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4f3752000 1 -- 172.21.15.55:0/2706376628 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d4a0683e0 con 0x561d4a218a00 2024-04-02T07:26:00.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4cea00640 1 -- 172.21.15.55:0/2706376628 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4dc012e80 con 0x561d4a218a00 2024-04-02T07:26:00.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4f3752000 10 client.5753 fetch_fsmap learned FSMap version 34 2024-04-02T07:26:00.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4f3752000 1 -- 172.21.15.55:0/2706376628 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x561d4a02eaa0 con 0x561d4a218a00 2024-04-02T07:26:00.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4cea00640 1 -- 172.21.15.55:0/2706376628 <== mon.2 v2:172.21.15.106:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561d4a0683e0 con 0x561d4a218a00 2024-04-02T07:26:00.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4cea00640 1 -- 172.21.15.55:0/2706376628 <== mon.2 v2:172.21.15.106:3301/0 5 ==== fsmap(e 34) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fa4dc019020 con 0x561d4a218a00 2024-04-02T07:26:00.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4f3752000 10 client.5753 fetch_fsmap finished waiting for FSMap version 34 2024-04-02T07:26:00.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4f3752000 10 client.5753 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-04-02T07:26:00.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4f3752000 20 client.5753 populate_metadata read hostname 'smithi055' 2024-04-02T07:26:00.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4f3752000 1 --2- 172.21.15.55:0/2706376628 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x561d4a26c2d0 0x561d4a26c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4f3752000 4 client.5753 mds_command: new command op to 6138 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:26:00.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4f3752000 1 -- 172.21.15.55:0/2706376628 --> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d4a039d00 con 0x561d4a26c2d0 2024-04-02T07:26:00.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4ece00640 1 --2- 172.21.15.55:0/2706376628 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x561d4a26c2d0 0x561d4a26c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4ece00640 1 --2- 172.21.15.55:0/2706376628 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x561d4a26c2d0 0x561d4a26c6b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=505dfab2d27569c7 server_cookie=bf2f944a9ca60ffb in_seq=0 out_seq=0 2024-04-02T07:26:00.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.465+0000 7fa4cea00640 10 client.5753 ms_handle_connect on v2:172.21.15.106:6835/1050953219 2024-04-02T07:26:00.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.469+0000 7fa4cea00640 1 -- 172.21.15.55:0/2706376628 <== mds.0 v2:172.21.15.106:6835/1050953219 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561d4a039d00 con 0x561d4a26c2d0 2024-04-02T07:26:00.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.469+0000 7fa4cea00640 10 client.5753 handle_command_reply: tid=0 2024-04-02T07:26:00.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.469+0000 7fa4f3752000 1 client.5753 shutdown 2024-04-02T07:26:00.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.469+0000 7fa4f3752000 1 -- 172.21.15.55:0/2706376628 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a218a00 msgr2=0x561d4a221810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.469+0000 7fa4f3752000 1 --2- 172.21.15.55:0/2706376628 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a218a00 0x561d4a221810 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc082230 tx=0x7fa4dc000ee0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.469+0000 7fa4f3752000 1 -- 172.21.15.55:0/2706376628 shutdown_connections 2024-04-02T07:26:00.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.469+0000 7fa4f3752000 1 --2- 172.21.15.55:0/2706376628 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a265390 0x561d4a248f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.469+0000 7fa4f3752000 1 --2- 172.21.15.55:0/2706376628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 0x561d4a248a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.469+0000 7fa4f3752000 1 --2- 172.21.15.55:0/2706376628 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x561d4a26c2d0 0x561d4a26c6b0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.469+0000 7fa4f3752000 1 --2- 172.21.15.55:0/2706376628 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a218a00 0x561d4a221810 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.469+0000 7fa4f3752000 1 -- 172.21.15.55:0/2706376628 >> 172.21.15.55:0/2706376628 conn(0x561d4a019160 msgr2=0x561d4a217bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:00.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.469+0000 7fa4cea00640 0 client.5753 ms_handle_reset on v2:172.21.15.106:6835/1050953219 2024-04-02T07:26:00.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.469+0000 7fa4f3752000 1 -- 172.21.15.55:0/2706376628 shutdown_connections 2024-04-02T07:26:00.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.469+0000 7fa4f3752000 1 -- 172.21.15.55:0/2706376628 wait complete. 2024-04-02T07:26:00.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.469+0000 7fa4f3752000 20 client.5753 trim_cache size 0 max 16384 2024-04-02T07:26:00.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.481+0000 7fa4f3752000 1 Processor -- start 2024-04-02T07:26:00.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.481+0000 7fa4f3752000 1 -- start start 2024-04-02T07:26:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4f3752000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a218a00 0x561d4a218470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4f3752000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 0x561d4a2206f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4f3752000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a265390 0x561d4a220c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4f3752000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d49d26aa0 con 0x561d4a264a70 2024-04-02T07:26:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4f3752000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d4a0c1920 con 0x561d4a218a00 2024-04-02T07:26:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4f3752000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d4a033640 con 0x561d4a265390 2024-04-02T07:26:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4ece00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 0x561d4a2206f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4ece00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 0x561d4a2206f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35596/0 (socket says 172.21.15.55:35596) 2024-04-02T07:26:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4ece00640 1 -- 172.21.15.55:0/1485651370 learned_addr learned my addr 172.21.15.55:0/1485651370 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4ed800640 1 --2- 172.21.15.55:0/1485651370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a218a00 0x561d4a218470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4ece00640 1 -- 172.21.15.55:0/1485651370 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a265390 msgr2=0x561d4a220c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:00.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4ee200640 1 --2- 172.21.15.55:0/1485651370 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a265390 0x561d4a220c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4ece00640 1 --2- 172.21.15.55:0/1485651370 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a265390 0x561d4a220c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4ece00640 1 -- 172.21.15.55:0/1485651370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a218a00 msgr2=0x561d4a218470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:00.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4ece00640 1 --2- 172.21.15.55:0/1485651370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a218a00 0x561d4a218470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4ece00640 1 -- 172.21.15.55:0/1485651370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d4a014df0 con 0x561d4a264a70 2024-04-02T07:26:00.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4ed800640 1 --2- 172.21.15.55:0/1485651370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a218a00 0x561d4a218470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:26:00.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4ee200640 1 --2- 172.21.15.55:0/1485651370 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a265390 0x561d4a220c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:26:00.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4ece00640 1 --2- 172.21.15.55:0/1485651370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 0x561d4a2206f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4018ef0 tx=0x7fa4d40a8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53870f6dc1f11c13 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:00.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4daa00640 1 -- 172.21.15.55:0/1485651370 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d40c8370 con 0x561d4a264a70 2024-04-02T07:26:00.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4daa00640 1 -- 172.21.15.55:0/1485651370 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d40bf040 con 0x561d4a264a70 2024-04-02T07:26:00.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4daa00640 1 -- 172.21.15.55:0/1485651370 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d4003620 con 0x561d4a264a70 2024-04-02T07:26:00.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4f3752000 1 -- 172.21.15.55:0/1485651370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 msgr2=0x561d4a2206f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4f3752000 1 --2- 172.21.15.55:0/1485651370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 0x561d4a2206f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4018ef0 tx=0x7fa4d40a8000 comp rx=0 tx=0).stop 2024-04-02T07:26:00.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4f3752000 1 -- 172.21.15.55:0/1485651370 shutdown_connections 2024-04-02T07:26:00.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4f3752000 1 --2- 172.21.15.55:0/1485651370 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a265390 0x561d4a220c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4f3752000 1 --2- 172.21.15.55:0/1485651370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a264a70 0x561d4a2206f0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4f3752000 1 --2- 172.21.15.55:0/1485651370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a218a00 0x561d4a218470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4f3752000 1 -- 172.21.15.55:0/1485651370 >> 172.21.15.55:0/1485651370 conn(0x561d4a019160 msgr2=0x561d4a21ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:00.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4f3752000 1 -- 172.21.15.55:0/1485651370 shutdown_connections 2024-04-02T07:26:00.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4f3752000 1 -- 172.21.15.55:0/1485651370 wait complete. 2024-04-02T07:26:00.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4f3752000 1 -- start start 2024-04-02T07:26:00.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.485+0000 7fa4f3752000 1 Processor -- start 2024-04-02T07:26:00.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a218a00 0x561d4a2bfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a264a70 0x561d4a21b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a265390 0x561d4a21bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d4a221860 con 0x561d4a218a00 2024-04-02T07:26:00.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d4a071e60 con 0x561d4a264a70 2024-04-02T07:26:00.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x561d4a13a470 con 0x561d4a265390 2024-04-02T07:26:00.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 10 client.0 _ll_register_callbacks cb 0x7fa4dc054b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:26:00.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4ed800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a218a00 0x561d4a2bfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4ed800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a218a00 0x561d4a2bfec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:35598/0 (socket says 172.21.15.55:35598) 2024-04-02T07:26:00.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4ed800640 1 -- 172.21.15.55:0/1785689684 learned_addr learned my addr 172.21.15.55:0/1785689684 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:00.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4ee200640 1 --2- 172.21.15.55:0/1785689684 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a265390 0x561d4a21bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4ece00640 1 --2- 172.21.15.55:0/1785689684 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a264a70 0x561d4a21b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4ed800640 1 -- 172.21.15.55:0/1785689684 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a265390 msgr2=0x561d4a21bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:00.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4ed800640 1 --2- 172.21.15.55:0/1785689684 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a265390 0x561d4a21bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4ed800640 1 -- 172.21.15.55:0/1785689684 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a264a70 msgr2=0x561d4a21b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:00.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4ed800640 1 --2- 172.21.15.55:0/1785689684 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a264a70 0x561d4a21b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4ed800640 1 -- 172.21.15.55:0/1785689684 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e80cade0 con 0x561d4a218a00 2024-04-02T07:26:00.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4ed800640 1 --2- 172.21.15.55:0/1785689684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a218a00 0x561d4a2bfec0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc05cbf0 tx=0x7fa4dc001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e197c96fe21123d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:00.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4cea00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:26:00.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4cea00640 1 -- 172.21.15.55:0/1785689684 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc07d030 con 0x561d4a218a00 2024-04-02T07:26:00.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4cea00640 1 -- 172.21.15.55:0/1785689684 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4dc07e070 con 0x561d4a218a00 2024-04-02T07:26:00.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 -- 172.21.15.55:0/1785689684 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d4a026970 con 0x561d4a218a00 2024-04-02T07:26:00.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4cea00640 1 -- 172.21.15.55:0/1785689684 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4dc00e040 con 0x561d4a218a00 2024-04-02T07:26:00.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 10 client.6471 fetch_fsmap learned FSMap version 34 2024-04-02T07:26:00.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 -- 172.21.15.55:0/1785689684 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=2+}) v3 -- 0x561d4a008960 con 0x561d4a218a00 2024-04-02T07:26:00.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4cea00640 1 -- 172.21.15.55:0/1785689684 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561d4a026970 con 0x561d4a218a00 2024-04-02T07:26:00.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4cea00640 1 -- 172.21.15.55:0/1785689684 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 34) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fa4dc068b70 con 0x561d4a218a00 2024-04-02T07:26:00.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 10 client.6471 fetch_fsmap finished waiting for FSMap version 34 2024-04-02T07:26:00.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 10 client.6471 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-04-02T07:26:00.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 20 client.6471 populate_metadata read hostname 'smithi055' 2024-04-02T07:26:00.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 --2- 172.21.15.55:0/1785689684 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x561d4a21c080 0x561d4a21c460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:00.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 4 client.6471 mds_command: new command op to 6138 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-02T07:26:00.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 -- 172.21.15.55:0/1785689684 --> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561d4a098a20 con 0x561d4a21c080 2024-04-02T07:26:00.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4ece00640 1 --2- 172.21.15.55:0/1785689684 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x561d4a21c080 0x561d4a21c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:00.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4ece00640 1 --2- 172.21.15.55:0/1785689684 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x561d4a21c080 0x561d4a21c460 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4087d6122a04b05 server_cookie=3be8d263f4f6bda8 in_seq=0 out_seq=0 2024-04-02T07:26:00.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4cea00640 10 client.6471 ms_handle_connect on v2:172.21.15.106:6835/1050953219 2024-04-02T07:26:00.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4cea00640 1 -- 172.21.15.55:0/1785689684 <== mds.0 v2:172.21.15.106:6835/1050953219 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x561d4a098a20 con 0x561d4a21c080 2024-04-02T07:26:00.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4cea00640 10 client.6471 handle_command_reply: tid=0 2024-04-02T07:26:00.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 client.6471 shutdown 2024-04-02T07:26:00.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 -- 172.21.15.55:0/1785689684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a218a00 msgr2=0x561d4a2bfec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 --2- 172.21.15.55:0/1785689684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a218a00 0x561d4a2bfec0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc05cbf0 tx=0x7fa4dc001160 comp rx=0 tx=0).stop 2024-04-02T07:26:00.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 -- 172.21.15.55:0/1785689684 shutdown_connections 2024-04-02T07:26:00.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 --2- 172.21.15.55:0/1785689684 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x561d4a21c080 0x561d4a21c460 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 --2- 172.21.15.55:0/1785689684 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561d4a265390 0x561d4a21bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 --2- 172.21.15.55:0/1785689684 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561d4a264a70 0x561d4a21b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4cea00640 0 client.6471 ms_handle_reset on v2:172.21.15.106:6835/1050953219 2024-04-02T07:26:00.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 --2- 172.21.15.55:0/1785689684 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561d4a218a00 0x561d4a2bfec0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 -- 172.21.15.55:0/1785689684 >> 172.21.15.55:0/1785689684 conn(0x561d4a019160 msgr2=0x561d4a220870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:00.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 -- 172.21.15.55:0/1785689684 shutdown_connections 2024-04-02T07:26:00.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 1 -- 172.21.15.55:0/1785689684 wait complete. 2024-04-02T07:26:00.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.489+0000 7fa4f3752000 20 client.6471 trim_cache size 0 max 16384 2024-04-02T07:26:00.500 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:26:00.500 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-02T07:26:00.500 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-04-02T07:26:00.500 INFO:teuthology.orchestra.run.smithi055.stdout: "751686f3-4a74-4d85-8ac2-77a830500589": { 2024-04-02T07:26:00.500 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/", 2024-04-02T07:26:00.500 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "751686f3-4a74-4d85-8ac2-77a830500589", 2024-04-02T07:26:00.500 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive,repair,force" 2024-04-02T07:26:00.500 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:00.500 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:00.500 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:26:00.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.493+0000 7fa4f0200640 1 -- 172.21.15.55:0/4243427093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4c80666c0 msgr2=0x7fa4c8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.493+0000 7fa4f0200640 1 --2- 172.21.15.55:0/4243427093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4c80666c0 0x7fa4c8068b80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40ad000 tx=0x7fa4d40a6000 comp rx=0 tx=0).stop 2024-04-02T07:26:00.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.493+0000 7fa4f0200640 1 -- 172.21.15.55:0/4243427093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4e80b19b0 msgr2=0x7fa4e80b3030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:00.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.493+0000 7fa4f0200640 1 --2- 172.21.15.55:0/4243427093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4e80b19b0 0x7fa4e80b3030 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc00c490 tx=0x7fa4dc00c950 comp rx=0 tx=0).stop 2024-04-02T07:26:00.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.493+0000 7fa4f0200640 1 -- 172.21.15.55:0/4243427093 shutdown_connections 2024-04-02T07:26:00.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.493+0000 7fa4f0200640 1 --2- 172.21.15.55:0/4243427093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4c80666c0 0x7fa4c8068b80 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.493+0000 7fa4f0200640 1 --2- 172.21.15.55:0/4243427093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4e8160580 0x7fa4e8157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.493+0000 7fa4f0200640 1 --2- 172.21.15.55:0/4243427093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4e81601a0 0x7fa4e8152aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.493+0000 7fa4f0200640 1 --2- 172.21.15.55:0/4243427093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4e80b19b0 0x7fa4e80b3030 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:00.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.493+0000 7fa4f0200640 1 -- 172.21.15.55:0/4243427093 >> 172.21.15.55:0/4243427093 conn(0x7fa4e80b2150 msgr2=0x7fa4e8159330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:00.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.493+0000 7fa4f0200640 1 -- 172.21.15.55:0/4243427093 shutdown_connections 2024-04-02T07:26:00.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:00.493+0000 7fa4f0200640 1 -- 172.21.15.55:0/4243427093 wait complete. 2024-04-02T07:26:00.514 INFO:tasks.cephfs.filesystem:scrub status for tag:751686f3-4a74-4d85-8ac2-77a830500589 - {'path': '/', 'tag': '751686f3-4a74-4d85-8ac2-77a830500589', 'options': 'recursive,repair,force'} 2024-04-02T07:26:13.753 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:26:13.757 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:26:30.514 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:26:30.515 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.4:0 scrub status 2024-04-02T07:26:30.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.664+0000 7fc814600640 1 Processor -- start 2024-04-02T07:26:30.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.664+0000 7fc814600640 1 -- start start 2024-04-02T07:26:30.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.664+0000 7fc814600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc80c065a80 0x7fc80c150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.664+0000 7fc814600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc80c15b130 con 0x7fc80c0cb280 2024-04-02T07:26:30.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.664+0000 7fc814600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc80c15b410 con 0x7fc80c06dde0 2024-04-02T07:26:30.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.664+0000 7fc814600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc80c0b3710 con 0x7fc80c065a80 2024-04-02T07:26:30.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.664+0000 7fc811200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc80c065a80 0x7fc80c150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.664+0000 7fc812600640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc80c0cb280 0x7fc80c151520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46024/0 (socket says 172.21.15.55:46024) 2024-04-02T07:26:30.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.664+0000 7fc812600640 1 -- 172.21.15.55:0/2807500887 learned_addr learned my addr 172.21.15.55:0/2807500887 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:26:30.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.664+0000 7fc811200640 1 -- 172.21.15.55:0/2807500887 >> v1:172.21.15.106:6789/0 conn(0x7fc80c06dde0 legacy=0x7fc80c06e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:30.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.664+0000 7fc811200640 1 -- 172.21.15.55:0/2807500887 >> v1:172.21.15.55:6789/0 conn(0x7fc80c0cb280 legacy=0x7fc80c151520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:30.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.664+0000 7fc811200640 1 -- 172.21.15.55:0/2807500887 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80c15b6f0 con 0x7fc80c065a80 2024-04-02T07:26:30.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.664+0000 7fc80be00640 1 -- 172.21.15.55:0/2807500887 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584286480 0 0) 0x7fc80c15b130 con 0x7fc80c0cb280 2024-04-02T07:26:30.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.668+0000 7fc811200640 1 --2- 172.21.15.55:0/2807500887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc80c065a80 0x7fc80c150fe0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80097c0 tx=0x7fc7f801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c094599714bd80ad server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:30.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.668+0000 7fc80be00640 1 -- 172.21.15.55:0/2807500887 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f80ab600 con 0x7fc80c065a80 2024-04-02T07:26:30.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.668+0000 7fc80be00640 1 -- 172.21.15.55:0/2807500887 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f80a7050 con 0x7fc80c065a80 2024-04-02T07:26:30.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.668+0000 7fc80be00640 1 -- 172.21.15.55:0/2807500887 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f80ab980 con 0x7fc80c065a80 2024-04-02T07:26:30.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.668+0000 7fc814600640 1 -- 172.21.15.55:0/2807500887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc80c065a80 msgr2=0x7fc80c150fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:30.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.668+0000 7fc814600640 1 --2- 172.21.15.55:0/2807500887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc80c065a80 0x7fc80c150fe0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fc7f80097c0 tx=0x7fc7f801c460 comp rx=0 tx=0).stop 2024-04-02T07:26:30.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.668+0000 7fc814600640 1 -- 172.21.15.55:0/2807500887 shutdown_connections 2024-04-02T07:26:30.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.668+0000 7fc814600640 1 --2- 172.21.15.55:0/2807500887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc80c065a80 0x7fc80c150fe0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.668+0000 7fc814600640 1 -- 172.21.15.55:0/2807500887 >> 172.21.15.55:0/2807500887 conn(0x7fc80c0ced90 msgr2=0x7fc80c0cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:30.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.668+0000 7fc814600640 1 -- 172.21.15.55:0/2807500887 shutdown_connections 2024-04-02T07:26:30.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.668+0000 7fc814600640 1 -- 172.21.15.55:0/2807500887 wait complete. 2024-04-02T07:26:30.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc814600640 1 Processor -- start 2024-04-02T07:26:30.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc814600640 1 -- start start 2024-04-02T07:26:30.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc814600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc80c065a80 0x7fc80c1550c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc814600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc80c06dde0 0x7fc80c165af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc814600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc80c0cb280 0x7fc80c151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc814600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c0ac760 con 0x7fc80c0cb280 2024-04-02T07:26:30.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc814600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c15a9d0 con 0x7fc80c06dde0 2024-04-02T07:26:30.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc814600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c150b60 con 0x7fc80c065a80 2024-04-02T07:26:30.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc812600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc80c0cb280 0x7fc80c151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc812600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc80c0cb280 0x7fc80c151f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43104/0 (socket says 172.21.15.55:43104) 2024-04-02T07:26:30.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc812600640 1 -- 172.21.15.55:0/2040961467 learned_addr learned my addr 172.21.15.55:0/2040961467 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:30.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc811200640 1 --2- 172.21.15.55:0/2040961467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc80c06dde0 0x7fc80c165af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc811c00640 1 --2- 172.21.15.55:0/2040961467 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc80c065a80 0x7fc80c1550c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc812600640 1 -- 172.21.15.55:0/2040961467 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc80c065a80 msgr2=0x7fc80c1550c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:30.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc812600640 1 --2- 172.21.15.55:0/2040961467 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc80c065a80 0x7fc80c1550c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc812600640 1 -- 172.21.15.55:0/2040961467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc80c06dde0 msgr2=0x7fc80c165af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:30.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc812600640 1 --2- 172.21.15.55:0/2040961467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc80c06dde0 0x7fc80c165af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc812600640 1 -- 172.21.15.55:0/2040961467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f8009420 con 0x7fc80c0cb280 2024-04-02T07:26:30.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc811200640 1 --2- 172.21.15.55:0/2040961467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc80c06dde0 0x7fc80c165af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:30.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc812600640 1 --2- 172.21.15.55:0/2040961467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc80c0cb280 0x7fc80c151f40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc80400c780 tx=0x7fc80400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:30.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc809600640 1 -- 172.21.15.55:0/2040961467 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80400ce90 con 0x7fc80c0cb280 2024-04-02T07:26:30.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc809600640 1 -- 172.21.15.55:0/2040961467 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80400a640 con 0x7fc80c0cb280 2024-04-02T07:26:30.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc809600640 1 -- 172.21.15.55:0/2040961467 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80400a9b0 con 0x7fc80c0cb280 2024-04-02T07:26:30.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc814600640 1 -- 172.21.15.55:0/2040961467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80c154aa0 con 0x7fc80c0cb280 2024-04-02T07:26:30.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.672+0000 7fc814600640 1 -- 172.21.15.55:0/2040961467 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80c0acc20 con 0x7fc80c0cb280 2024-04-02T07:26:30.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.676+0000 7fc809600640 1 -- 172.21.15.55:0/2040961467 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc80400ab10 con 0x7fc80c0cb280 2024-04-02T07:26:30.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.676+0000 7fc809600640 1 --2- 172.21.15.55:0/2040961467 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc7ec066690 0x7fc7ec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.676+0000 7fc809600640 1 -- 172.21.15.55:0/2040961467 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc804083730 con 0x7fc80c0cb280 2024-04-02T07:26:30.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.676+0000 7fc811c00640 1 --2- 172.21.15.55:0/2040961467 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc7ec066690 0x7fc7ec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.676+0000 7fc817a1f000 1 Processor -- start 2024-04-02T07:26:30.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.676+0000 7fc817a1f000 1 -- start start 2024-04-02T07:26:30.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.676+0000 7fc811c00640 1 --2- 172.21.15.55:0/2040961467 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc7ec066690 0x7fc7ec068b50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc800004e30 tx=0x7fc800009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:30.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.676+0000 7fc817a1f000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547e3ba70 0x55e547e3be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.676+0000 7fc817a1f000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547e3c390 0x55e547def4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.676+0000 7fc817a1f000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547defa00 0x55e547defde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.676+0000 7fc817a1f000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e547cba630 con 0x55e547defa00 2024-04-02T07:26:30.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.676+0000 7fc817a1f000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e547c47bd0 con 0x55e547e3c390 2024-04-02T07:26:30.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.676+0000 7fc817a1f000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e547c451a0 con 0x55e547e3ba70 2024-04-02T07:26:30.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.676+0000 7fc812600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547defa00 0x55e547defde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.676+0000 7fc812600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547defa00 0x55e547defde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43116/0 (socket says 172.21.15.55:43116) 2024-04-02T07:26:30.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.676+0000 7fc812600640 1 -- 172.21.15.55:0/3239690653 learned_addr learned my addr 172.21.15.55:0/3239690653 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:30.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.676+0000 7fc811200640 1 --2- 172.21.15.55:0/3239690653 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547e3c390 0x55e547def4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.676+0000 7fc811c00640 1 --2- 172.21.15.55:0/3239690653 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547e3ba70 0x55e547e3be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc812600640 1 -- 172.21.15.55:0/3239690653 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547e3ba70 msgr2=0x55e547e3be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:30.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc812600640 1 --2- 172.21.15.55:0/3239690653 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547e3ba70 0x55e547e3be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc812600640 1 -- 172.21.15.55:0/3239690653 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547e3c390 msgr2=0x55e547def4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:30.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc812600640 1 --2- 172.21.15.55:0/3239690653 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547e3c390 0x55e547def4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc812600640 1 -- 172.21.15.55:0/3239690653 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e54793ce20 con 0x55e547defa00 2024-04-02T07:26:30.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc811c00640 1 --2- 172.21.15.55:0/3239690653 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547e3ba70 0x55e547e3be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:30.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc812600640 1 --2- 172.21.15.55:0/3239690653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547defa00 0x55e547defde0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc8040543c0 tx=0x7fc804054150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bb0c9e3786b2ae9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:30.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc7fe000640 1 -- 172.21.15.55:0/3239690653 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80405cab0 con 0x55e547defa00 2024-04-02T07:26:30.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc7fe000640 1 -- 172.21.15.55:0/3239690653 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc80400adc0 con 0x55e547defa00 2024-04-02T07:26:30.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc7fe000640 1 -- 172.21.15.55:0/3239690653 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc804058160 con 0x55e547defa00 2024-04-02T07:26:30.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc817a1f000 1 -- 172.21.15.55:0/3239690653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547defa00 msgr2=0x55e547defde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:30.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc817a1f000 1 --2- 172.21.15.55:0/3239690653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547defa00 0x55e547defde0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc8040543c0 tx=0x7fc804054150 comp rx=0 tx=0).stop 2024-04-02T07:26:30.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc817a1f000 1 -- 172.21.15.55:0/3239690653 shutdown_connections 2024-04-02T07:26:30.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc817a1f000 1 --2- 172.21.15.55:0/3239690653 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547defa00 0x55e547defde0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc817a1f000 1 --2- 172.21.15.55:0/3239690653 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547e3c390 0x55e547def4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc817a1f000 1 --2- 172.21.15.55:0/3239690653 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547e3ba70 0x55e547e3be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc817a1f000 1 -- 172.21.15.55:0/3239690653 >> 172.21.15.55:0/3239690653 conn(0x55e547bf0160 msgr2=0x55e547e1e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:30.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc817a1f000 1 -- 172.21.15.55:0/3239690653 shutdown_connections 2024-04-02T07:26:30.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc817a1f000 1 -- 172.21.15.55:0/3239690653 wait complete. 2024-04-02T07:26:30.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc817a1f000 1 -- start start 2024-04-02T07:26:30.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc817a1f000 1 Processor -- start 2024-04-02T07:26:30.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc817a1f000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547defa00 0x55e547df8810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc817a1f000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547e3ba70 0x55e547e1fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc817a1f000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 0x55e547e1ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc817a1f000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e547c40a90 con 0x55e547e3c390 2024-04-02T07:26:30.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc817a1f000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e547bdfd40 con 0x55e547defa00 2024-04-02T07:26:30.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc817a1f000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e547bfdf30 con 0x55e547e3ba70 2024-04-02T07:26:30.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc817a1f000 10 client.0 _ll_register_callbacks cb 0x55e547ca2810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:26:30.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc812600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 0x55e547e1ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc812600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 0x55e547e1ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43130/0 (socket says 172.21.15.55:43130) 2024-04-02T07:26:30.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc812600640 1 -- 172.21.15.55:0/3446794421 learned_addr learned my addr 172.21.15.55:0/3446794421 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:30.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc811c00640 1 --2- 172.21.15.55:0/3446794421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547defa00 0x55e547df8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc811200640 1 --2- 172.21.15.55:0/3446794421 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547e3ba70 0x55e547e1fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc812600640 1 -- 172.21.15.55:0/3446794421 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547e3ba70 msgr2=0x55e547e1fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:30.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc812600640 1 --2- 172.21.15.55:0/3446794421 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547e3ba70 0x55e547e1fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc812600640 1 -- 172.21.15.55:0/3446794421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547defa00 msgr2=0x55e547df8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:30.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc812600640 1 --2- 172.21.15.55:0/3446794421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547defa00 0x55e547df8810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc812600640 1 -- 172.21.15.55:0/3446794421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80c0acc20 con 0x55e547e3c390 2024-04-02T07:26:30.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc811c00640 1 --2- 172.21.15.55:0/3446794421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547defa00 0x55e547df8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:30.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.680+0000 7fc811200640 1 --2- 172.21.15.55:0/3446794421 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547e3ba70 0x55e547e1fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:30.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc812600640 1 --2- 172.21.15.55:0/3446794421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 0x55e547e1ff90 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc804054370 tx=0x7fc804001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220bbc4c58bff830 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:30.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc7f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:26:30.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc7f2a00640 1 -- 172.21.15.55:0/3446794421 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80405cab0 con 0x55e547e3c390 2024-04-02T07:26:30.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc7f2a00640 1 -- 172.21.15.55:0/3446794421 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc804050dd0 con 0x55e547e3c390 2024-04-02T07:26:30.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 1 -- 172.21.15.55:0/3446794421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e547c3f3e0 con 0x55e547e3c390 2024-04-02T07:26:30.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc7f2a00640 1 -- 172.21.15.55:0/3446794421 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc804050f90 con 0x55e547e3c390 2024-04-02T07:26:30.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 10 client.6486 fetch_fsmap learned FSMap version 35 2024-04-02T07:26:30.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 1 -- 172.21.15.55:0/3446794421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x55e547c05aa0 con 0x55e547e3c390 2024-04-02T07:26:30.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc7f2a00640 1 -- 172.21.15.55:0/3446794421 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc804076020 con 0x55e547e3c390 2024-04-02T07:26:30.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc7f2a00640 1 -- 172.21.15.55:0/3446794421 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 35) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc80405c620 con 0x55e547e3c390 2024-04-02T07:26:30.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 10 client.6486 fetch_fsmap finished waiting for FSMap version 35 2024-04-02T07:26:30.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 10 client.6486 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-04-02T07:26:30.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 20 client.6486 populate_metadata read hostname 'smithi055' 2024-04-02T07:26:30.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 1 --2- 172.21.15.55:0/3446794421 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55e547e432d0 0x55e547e436b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 4 client.6486 mds_command: new command op to 6138 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:26:30.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 1 -- 172.21.15.55:0/3446794421 --> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e547c10d00 con 0x55e547e432d0 2024-04-02T07:26:30.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc811c00640 1 --2- 172.21.15.55:0/3446794421 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55e547e432d0 0x55e547e436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc811c00640 1 --2- 172.21.15.55:0/3446794421 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55e547e432d0 0x55e547e436b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28d59b439c331932 server_cookie=a92dc927552dd4ff in_seq=0 out_seq=0 2024-04-02T07:26:30.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc7f2a00640 10 client.6486 ms_handle_connect on v2:172.21.15.106:6835/1050953219 2024-04-02T07:26:30.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc7f2a00640 1 -- 172.21.15.55:0/3446794421 <== mds.0 v2:172.21.15.106:6835/1050953219 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e547c10d00 con 0x55e547e432d0 2024-04-02T07:26:30.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc7f2a00640 10 client.6486 handle_command_reply: tid=0 2024-04-02T07:26:30.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 1 client.6486 shutdown 2024-04-02T07:26:30.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 1 -- 172.21.15.55:0/3446794421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 msgr2=0x55e547e1ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:30.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 1 --2- 172.21.15.55:0/3446794421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 0x55e547e1ff90 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc804054370 tx=0x7fc804001260 comp rx=0 tx=0).stop 2024-04-02T07:26:30.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 1 -- 172.21.15.55:0/3446794421 shutdown_connections 2024-04-02T07:26:30.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 1 --2- 172.21.15.55:0/3446794421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 0x55e547e1ff90 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 1 --2- 172.21.15.55:0/3446794421 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55e547e432d0 0x55e547e436b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 1 --2- 172.21.15.55:0/3446794421 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547e3ba70 0x55e547e1fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 1 --2- 172.21.15.55:0/3446794421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547defa00 0x55e547df8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc7f2a00640 0 client.6486 ms_handle_reset on v2:172.21.15.106:6835/1050953219 2024-04-02T07:26:30.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 1 -- 172.21.15.55:0/3446794421 >> 172.21.15.55:0/3446794421 conn(0x55e547bf0160 msgr2=0x55e547deebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:30.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 1 -- 172.21.15.55:0/3446794421 shutdown_connections 2024-04-02T07:26:30.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 1 -- 172.21.15.55:0/3446794421 wait complete. 2024-04-02T07:26:30.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.684+0000 7fc817a1f000 20 client.6486 trim_cache size 0 max 16384 2024-04-02T07:26:30.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.700+0000 7fc817a1f000 1 Processor -- start 2024-04-02T07:26:30.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.700+0000 7fc817a1f000 1 -- start start 2024-04-02T07:26:30.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.700+0000 7fc817a1f000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547defa00 0x55e547deec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.700+0000 7fc817a1f000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547e3ba70 0x55e547def170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.700+0000 7fc817a1f000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 0x55e547defde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.700+0000 7fc817a1f000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5478fdaa0 con 0x55e547e3c390 2024-04-02T07:26:30.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.700+0000 7fc817a1f000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e547c42020 con 0x55e547e3ba70 2024-04-02T07:26:30.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.700+0000 7fc817a1f000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e547c0aee0 con 0x55e547defa00 2024-04-02T07:26:30.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.700+0000 7fc812600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 0x55e547defde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.700+0000 7fc812600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 0x55e547defde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43138/0 (socket says 172.21.15.55:43138) 2024-04-02T07:26:30.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.700+0000 7fc812600640 1 -- 172.21.15.55:0/3668094184 learned_addr learned my addr 172.21.15.55:0/3668094184 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:30.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.700+0000 7fc812600640 1 -- 172.21.15.55:0/3668094184 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547defa00 msgr2=0x55e547deec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:30.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.700+0000 7fc812600640 1 --2- 172.21.15.55:0/3668094184 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547defa00 0x55e547deec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.700+0000 7fc812600640 1 -- 172.21.15.55:0/3668094184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547e3ba70 msgr2=0x55e547def170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:30.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.700+0000 7fc812600640 1 --2- 172.21.15.55:0/3668094184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547e3ba70 0x55e547def170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.700+0000 7fc812600640 1 -- 172.21.15.55:0/3668094184 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e547bebdf0 con 0x55e547e3c390 2024-04-02T07:26:30.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc812600640 1 --2- 172.21.15.55:0/3668094184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 0x55e547defde0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc804081b00 tx=0x7fc80406a070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389f60656c668b38 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:30.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc7fea00640 1 -- 172.21.15.55:0/3668094184 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80405cab0 con 0x55e547e3c390 2024-04-02T07:26:30.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc7fea00640 1 -- 172.21.15.55:0/3668094184 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc804076070 con 0x55e547e3c390 2024-04-02T07:26:30.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc7fea00640 1 -- 172.21.15.55:0/3668094184 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8040504b0 con 0x55e547e3c390 2024-04-02T07:26:30.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc817a1f000 1 -- 172.21.15.55:0/3668094184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 msgr2=0x55e547defde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:30.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc817a1f000 1 --2- 172.21.15.55:0/3668094184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 0x55e547defde0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc804081b00 tx=0x7fc80406a070 comp rx=0 tx=0).stop 2024-04-02T07:26:30.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc817a1f000 1 -- 172.21.15.55:0/3668094184 shutdown_connections 2024-04-02T07:26:30.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc817a1f000 1 --2- 172.21.15.55:0/3668094184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 0x55e547defde0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc817a1f000 1 --2- 172.21.15.55:0/3668094184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547e3ba70 0x55e547def170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc817a1f000 1 --2- 172.21.15.55:0/3668094184 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547defa00 0x55e547deec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc817a1f000 1 -- 172.21.15.55:0/3668094184 >> 172.21.15.55:0/3668094184 conn(0x55e547bf0160 msgr2=0x55e547df7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:30.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc817a1f000 1 -- 172.21.15.55:0/3668094184 shutdown_connections 2024-04-02T07:26:30.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc817a1f000 1 -- 172.21.15.55:0/3668094184 wait complete. 2024-04-02T07:26:30.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc817a1f000 1 -- start start 2024-04-02T07:26:30.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc817a1f000 1 Processor -- start 2024-04-02T07:26:30.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc817a1f000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547defa00 0x55e547df3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc817a1f000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547e3ba70 0x55e547e571e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc817a1f000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 0x55e547e57720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc817a1f000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e547c84170 con 0x55e547e3c390 2024-04-02T07:26:30.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc817a1f000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e547df8cc0 con 0x55e547defa00 2024-04-02T07:26:30.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc817a1f000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e547e1fc80 con 0x55e547e3ba70 2024-04-02T07:26:30.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc817a1f000 10 client.0 _ll_register_callbacks cb 0x7fc804050a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:26:30.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc812600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 0x55e547e57720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc812600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 0x55e547e57720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43144/0 (socket says 172.21.15.55:43144) 2024-04-02T07:26:30.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc812600640 1 -- 172.21.15.55:0/974550077 learned_addr learned my addr 172.21.15.55:0/974550077 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:30.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc811200640 1 --2- 172.21.15.55:0/974550077 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547e3ba70 0x55e547e571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc811c00640 1 --2- 172.21.15.55:0/974550077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547defa00 0x55e547df3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc812600640 1 -- 172.21.15.55:0/974550077 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547e3ba70 msgr2=0x55e547e571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:30.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc812600640 1 --2- 172.21.15.55:0/974550077 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547e3ba70 0x55e547e571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc812600640 1 -- 172.21.15.55:0/974550077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547defa00 msgr2=0x55e547df3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:30.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc812600640 1 --2- 172.21.15.55:0/974550077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547defa00 0x55e547df3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc812600640 1 -- 172.21.15.55:0/974550077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e547c05aa0 con 0x55e547e3c390 2024-04-02T07:26:30.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc811200640 1 --2- 172.21.15.55:0/974550077 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547e3ba70 0x55e547e571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:30.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc811c00640 1 --2- 172.21.15.55:0/974550077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547defa00 0x55e547df3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:30.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc812600640 1 --2- 172.21.15.55:0/974550077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 0x55e547e57720 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc804081b00 tx=0x7fc80405a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1885287f3a6eb24 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:30.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc7f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:26:30.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc7f2a00640 1 -- 172.21.15.55:0/974550077 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc80405cab0 con 0x55e547e3c390 2024-04-02T07:26:30.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc817a1f000 1 -- 172.21.15.55:0/974550077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e547bfd970 con 0x55e547e3c390 2024-04-02T07:26:30.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.704+0000 7fc7f2a00640 1 -- 172.21.15.55:0/974550077 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc804077080 con 0x55e547e3c390 2024-04-02T07:26:30.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc7f2a00640 1 -- 172.21.15.55:0/974550077 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8040504b0 con 0x55e547e3c390 2024-04-02T07:26:30.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc817a1f000 10 client.6492 fetch_fsmap learned FSMap version 35 2024-04-02T07:26:30.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc817a1f000 1 -- 172.21.15.55:0/974550077 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x55e547bdf960 con 0x55e547e3c390 2024-04-02T07:26:30.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc7f2a00640 1 -- 172.21.15.55:0/974550077 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e547bfd970 con 0x55e547e3c390 2024-04-02T07:26:30.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc7f2a00640 1 -- 172.21.15.55:0/974550077 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 35) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc8040506e0 con 0x55e547e3c390 2024-04-02T07:26:30.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc817a1f000 10 client.6492 fetch_fsmap finished waiting for FSMap version 35 2024-04-02T07:26:30.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc817a1f000 10 client.6492 resolve_mds: resolved 4:0 to role '4:0' aka daemon mds.d 2024-04-02T07:26:30.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc817a1f000 20 client.6492 populate_metadata read hostname 'smithi055' 2024-04-02T07:26:30.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc817a1f000 1 --2- 172.21.15.55:0/974550077 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55e547e57c60 0x55e547e9b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc817a1f000 4 client.6492 mds_command: new command op to 6138 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-02T07:26:30.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc817a1f000 1 -- 172.21.15.55:0/974550077 --> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e547c6fa20 con 0x55e547e57c60 2024-04-02T07:26:30.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc811c00640 1 --2- 172.21.15.55:0/974550077 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55e547e57c60 0x55e547e9b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc811c00640 1 --2- 172.21.15.55:0/974550077 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55e547e57c60 0x55e547e9b8a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee34f004f223b6ec server_cookie=588a843b79b60d1e in_seq=0 out_seq=0 2024-04-02T07:26:30.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc7f2a00640 10 client.6492 ms_handle_connect on v2:172.21.15.106:6835/1050953219 2024-04-02T07:26:30.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc7f2a00640 1 -- 172.21.15.55:0/974550077 <== mds.0 v2:172.21.15.106:6835/1050953219 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e547c6fa20 con 0x55e547e57c60 2024-04-02T07:26:30.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc7f2a00640 10 client.6492 handle_command_reply: tid=0 2024-04-02T07:26:30.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc817a1f000 1 client.6492 shutdown 2024-04-02T07:26:30.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc817a1f000 1 -- 172.21.15.55:0/974550077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 msgr2=0x55e547e57720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:30.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc817a1f000 1 --2- 172.21.15.55:0/974550077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 0x55e547e57720 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc804081b00 tx=0x7fc80405a000 comp rx=0 tx=0).stop 2024-04-02T07:26:30.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc817a1f000 1 -- 172.21.15.55:0/974550077 shutdown_connections 2024-04-02T07:26:30.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc817a1f000 1 --2- 172.21.15.55:0/974550077 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e547e3c390 0x55e547e57720 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc817a1f000 1 --2- 172.21.15.55:0/974550077 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x55e547e57c60 0x55e547e9b8a0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc817a1f000 1 --2- 172.21.15.55:0/974550077 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e547e3ba70 0x55e547e571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc817a1f000 1 --2- 172.21.15.55:0/974550077 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e547defa00 0x55e547df3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc7f2a00640 0 client.6492 ms_handle_reset on v2:172.21.15.106:6835/1050953219 2024-04-02T07:26:30.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc817a1f000 1 -- 172.21.15.55:0/974550077 >> 172.21.15.55:0/974550077 conn(0x55e547bf0160 msgr2=0x55e547dedc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:30.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc817a1f000 1 -- 172.21.15.55:0/974550077 shutdown_connections 2024-04-02T07:26:30.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc817a1f000 1 -- 172.21.15.55:0/974550077 wait complete. 2024-04-02T07:26:30.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc817a1f000 20 client.6492 trim_cache size 0 max 16384 2024-04-02T07:26:30.718 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:26:30.718 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-04-02T07:26:30.718 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-04-02T07:26:30.718 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:26:30.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc814600640 1 -- 172.21.15.55:0/2040961467 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc7ec066690 msgr2=0x7fc7ec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:30.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc814600640 1 --2- 172.21.15.55:0/2040961467 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc7ec066690 0x7fc7ec068b50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fc800004e30 tx=0x7fc800009040 comp rx=0 tx=0).stop 2024-04-02T07:26:30.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc814600640 1 -- 172.21.15.55:0/2040961467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc80c0cb280 msgr2=0x7fc80c151f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:30.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc814600640 1 --2- 172.21.15.55:0/2040961467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc80c0cb280 0x7fc80c151f40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fc80400c780 tx=0x7fc80400cc40 comp rx=0 tx=0).stop 2024-04-02T07:26:30.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc814600640 1 -- 172.21.15.55:0/2040961467 shutdown_connections 2024-04-02T07:26:30.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc814600640 1 --2- 172.21.15.55:0/2040961467 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc80c0cb280 0x7fc80c151f40 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc814600640 1 --2- 172.21.15.55:0/2040961467 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc7ec066690 0x7fc7ec068b50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc814600640 1 --2- 172.21.15.55:0/2040961467 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc80c06dde0 0x7fc80c165af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc814600640 1 --2- 172.21.15.55:0/2040961467 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc80c065a80 0x7fc80c1550c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc814600640 1 -- 172.21.15.55:0/2040961467 >> 172.21.15.55:0/2040961467 conn(0x7fc80c0ced90 msgr2=0x7fc80c0ccc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:30.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc814600640 1 -- 172.21.15.55:0/2040961467 shutdown_connections 2024-04-02T07:26:30.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.708+0000 7fc814600640 1 -- 172.21.15.55:0/2040961467 wait complete. 2024-04-02T07:26:30.733 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-02T07:26:30.733 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:26:30.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac33600640 1 Processor -- start 2024-04-02T07:26:30.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac33600640 1 -- start start 2024-04-02T07:26:30.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac33600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac2c06c0d0 0x7fac2c098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac33600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c0993a0 con 0x7fac2c098f50 2024-04-02T07:26:30.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac33600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac2c0cf3d0 con 0x7fac2c0b19d0 2024-04-02T07:26:30.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac33600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c0cf6b0 con 0x7fac2c06c0d0 2024-04-02T07:26:30.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac31600640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fac2c098f50 0x7fac2c15c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46030/0 (socket says 172.21.15.55:46030) 2024-04-02T07:26:30.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac31600640 1 -- 172.21.15.55:0/866356118 learned_addr learned my addr 172.21.15.55:0/866356118 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:26:30.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac23e00640 1 --2- 172.21.15.55:0/866356118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac2c06c0d0 0x7fac2c098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac2be00640 1 -- 172.21.15.55:0/866356118 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177706029 0 0) 0x7fac240014a0 con 0x7fac2c098f50 2024-04-02T07:26:30.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac2be00640 1 -- 172.21.15.55:0/866356118 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac10003530 con 0x7fac2c098f50 2024-04-02T07:26:30.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac2be00640 1 -- 172.21.15.55:0/866356118 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3032887755 0 0) 0x7fac2c0cf3d0 con 0x7fac2c0b19d0 2024-04-02T07:26:30.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac2be00640 1 -- 172.21.15.55:0/866356118 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac240014a0 con 0x7fac2c0b19d0 2024-04-02T07:26:30.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac2be00640 1 -- 172.21.15.55:0/866356118 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2101852046 0 0) 0x7fac10003530 con 0x7fac2c098f50 2024-04-02T07:26:30.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac2be00640 1 -- 172.21.15.55:0/866356118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac2c06c0d0 msgr2=0x7fac2c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:30.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac2be00640 1 --2- 172.21.15.55:0/866356118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac2c06c0d0 0x7fac2c098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac2be00640 1 -- 172.21.15.55:0/866356118 >> v1:172.21.15.106:6789/0 conn(0x7fac2c0b19d0 legacy=0x7fac2c0ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:30.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac2be00640 1 -- 172.21.15.55:0/866356118 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c0cf990 con 0x7fac2c098f50 2024-04-02T07:26:30.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac2be00640 1 -- 172.21.15.55:0/866356118 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fac24001b90 con 0x7fac2c098f50 2024-04-02T07:26:30.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac2be00640 1 -- 172.21.15.55:0/866356118 >> v1:172.21.15.55:6789/0 conn(0x7fac2c098f50 legacy=0x7fac2c15c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:30.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac2be00640 1 --2- 172.21.15.55:0/866356118 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac10003b40 0x7fac10003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac2be00640 1 --2- 172.21.15.55:0/866356118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac100047d0 0x7fac10004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac2be00640 1 --2- 172.21.15.55:0/866356118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac2c06c0d0 0x7fac10005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac2be00640 1 -- 172.21.15.55:0/866356118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c0cf6b0 con 0x7fac100047d0 2024-04-02T07:26:30.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac2be00640 1 -- 172.21.15.55:0/866356118 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1000ba40 con 0x7fac10003b40 2024-04-02T07:26:30.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac2be00640 1 -- 172.21.15.55:0/866356118 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1000bc00 con 0x7fac2c06c0d0 2024-04-02T07:26:30.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac23e00640 1 --2- 172.21.15.55:0/866356118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac100047d0 0x7fac10004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac30c00640 1 --2- 172.21.15.55:0/866356118 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac10003b40 0x7fac10003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.868+0000 7fac31600640 1 --2- 172.21.15.55:0/866356118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac2c06c0d0 0x7fac10005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.872+0000 7fac23e00640 1 -- 172.21.15.55:0/866356118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac2c06c0d0 msgr2=0x7fac10005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:30.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.872+0000 7fac23e00640 1 --2- 172.21.15.55:0/866356118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac2c06c0d0 0x7fac10005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.872+0000 7fac23e00640 1 -- 172.21.15.55:0/866356118 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac10003b40 msgr2=0x7fac10003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:30.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.872+0000 7fac23e00640 1 --2- 172.21.15.55:0/866356118 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac10003b40 0x7fac10003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.872+0000 7fac23e00640 1 -- 172.21.15.55:0/866356118 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac10003530 con 0x7fac100047d0 2024-04-02T07:26:30.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.872+0000 7fac31600640 1 --2- 172.21.15.55:0/866356118 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac2c06c0d0 0x7fac10005190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:30.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.872+0000 7fac23e00640 1 --2- 172.21.15.55:0/866356118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac100047d0 0x7fac10004c50 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fac2c06c4b0 tx=0x7fac1401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27fbc2d16378315f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:30.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.872+0000 7fac2be00640 1 -- 172.21.15.55:0/866356118 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac140a55e0 con 0x7fac100047d0 2024-04-02T07:26:30.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.872+0000 7fac2be00640 1 -- 172.21.15.55:0/866356118 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac140a5740 con 0x7fac100047d0 2024-04-02T07:26:30.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.872+0000 7fac2be00640 1 -- 172.21.15.55:0/866356118 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac140a5af0 con 0x7fac100047d0 2024-04-02T07:26:30.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.872+0000 7fac33600640 1 -- 172.21.15.55:0/866356118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac100047d0 msgr2=0x7fac10004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:30.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.872+0000 7fac33600640 1 --2- 172.21.15.55:0/866356118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac100047d0 0x7fac10004c50 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fac2c06c4b0 tx=0x7fac1401c9f0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.872+0000 7fac31600640 1 -- 172.21.15.55:0/866356118 reap_dead start 2024-04-02T07:26:30.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.872+0000 7fac33600640 1 -- 172.21.15.55:0/866356118 shutdown_connections 2024-04-02T07:26:30.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.872+0000 7fac33600640 1 -- 172.21.15.55:0/866356118 >> 172.21.15.55:0/866356118 conn(0x7fac2c0b2150 msgr2=0x7fac2c0b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:30.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac33600640 1 -- 172.21.15.55:0/866356118 shutdown_connections 2024-04-02T07:26:30.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac33600640 1 -- 172.21.15.55:0/866356118 wait complete. 2024-04-02T07:26:30.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac33600640 1 Processor -- start 2024-04-02T07:26:30.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac33600640 1 -- start start 2024-04-02T07:26:30.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac33600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac100047d0 0x7fac2c14dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac33600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac2c09dca0 0x7fac2c09b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac33600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2c09e100 0x7fac2c149b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac33600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c14b4b0 con 0x7fac2c09e100 2024-04-02T07:26:30.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac33600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c14a830 con 0x7fac2c09dca0 2024-04-02T07:26:30.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac33600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac2c14ab10 con 0x7fac100047d0 2024-04-02T07:26:30.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac31600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2c09e100 0x7fac2c149b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac23e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac2c09dca0 0x7fac2c09b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac30c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac100047d0 0x7fac2c14dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac23e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac2c09dca0 0x7fac2c09b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:56616/0 (socket says 172.21.15.55:56616) 2024-04-02T07:26:30.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac31600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2c09e100 0x7fac2c149b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43166/0 (socket says 172.21.15.55:43166) 2024-04-02T07:26:30.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac23e00640 1 -- 172.21.15.55:0/1882441925 learned_addr learned my addr 172.21.15.55:0/1882441925 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:30.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac23e00640 1 -- 172.21.15.55:0/1882441925 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac100047d0 msgr2=0x7fac2c14dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:30.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac23e00640 1 --2- 172.21.15.55:0/1882441925 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac100047d0 0x7fac2c14dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac23e00640 1 -- 172.21.15.55:0/1882441925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2c09e100 msgr2=0x7fac2c149b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:30.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac23e00640 1 --2- 172.21.15.55:0/1882441925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2c09e100 0x7fac2c149b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:30.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac23e00640 1 -- 172.21.15.55:0/1882441925 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2c14adf0 con 0x7fac2c09dca0 2024-04-02T07:26:30.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac31600640 1 --2- 172.21.15.55:0/1882441925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2c09e100 0x7fac2c149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:26:30.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.876+0000 7fac23e00640 1 --2- 172.21.15.55:0/1882441925 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac2c09dca0 0x7fac2c09b690 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fac1401c820 tx=0x7fac10005800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:30.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.880+0000 7fac29600640 1 -- 172.21.15.55:0/1882441925 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac140bc070 con 0x7fac2c09dca0 2024-04-02T07:26:30.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.880+0000 7fac29600640 1 -- 172.21.15.55:0/1882441925 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac14004020 con 0x7fac2c09dca0 2024-04-02T07:26:30.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.880+0000 7fac29600640 1 -- 172.21.15.55:0/1882441925 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac140043d0 con 0x7fac2c09dca0 2024-04-02T07:26:30.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.880+0000 7fac33600640 1 -- 172.21.15.55:0/1882441925 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac2c14b0d0 con 0x7fac2c09dca0 2024-04-02T07:26:30.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.880+0000 7fac33600640 1 -- 172.21.15.55:0/1882441925 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac2c09bda0 con 0x7fac2c09dca0 2024-04-02T07:26:30.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.880+0000 7fac33600640 1 -- 172.21.15.55:0/1882441925 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2c066c90 con 0x7fac2c09dca0 2024-04-02T07:26:30.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.880+0000 7fac29600640 1 -- 172.21.15.55:0/1882441925 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fac140b4040 con 0x7fac2c09dca0 2024-04-02T07:26:30.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.880+0000 7fac29600640 1 --2- 172.21.15.55:0/1882441925 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fac080666c0 0x7fac08068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:30.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.880+0000 7fac29600640 1 -- 172.21.15.55:0/1882441925 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac1c001d30 con 0x7fac2c09dca0 2024-04-02T07:26:30.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.880+0000 7fac30c00640 1 --2- 172.21.15.55:0/1882441925 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fac080666c0 0x7fac08068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:30.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.884+0000 7fac30c00640 1 --2- 172.21.15.55:0/1882441925 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fac080666c0 0x7fac08068b80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fac1c005630 tx=0x7fac1c001490 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:30.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:30.884+0000 7fac29600640 1 -- 172.21.15.55:0/1882441925 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fac140eba10 con 0x7fac2c09dca0 2024-04-02T07:26:31.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.080+0000 7fac33600640 1 -- 172.21.15.55:0/1882441925 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac2c06cc10 con 0x7fac2c09dca0 2024-04-02T07:26:31.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.084+0000 7fac29600640 1 -- 172.21.15.55:0/1882441925 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4741 (secure 0 0 0) 0x7fac140ef030 con 0x7fac2c09dca0 2024-04-02T07:26:31.088 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:31.088 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5510,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3429221899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3429221899},{"type":"v1","addr":"172.21.15.55:6835","nonce":3429221899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5513,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/4033456774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4033456774},{"type":"v1","addr":"172.21.15.106:6836","nonce":4033456774}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6129,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2170345840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2170345840},{"type":"v1","addr":"172.21.15.55:6834","nonce":2170345840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:25:13.807869+0000","modified":"2024-04-02T07:26:06.283152+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6138":{"gid":6138,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":16,"addr":"172.21.15.106:6837/1050953219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1050953219},{"type":"v1","addr":"172.21.15.106:6837","nonce":1050953219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-02T07:26:31.088 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 35 2024-04-02T07:26:31.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.084+0000 7fac33600640 1 -- 172.21.15.55:0/1882441925 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fac080666c0 msgr2=0x7fac08068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.084+0000 7fac33600640 1 --2- 172.21.15.55:0/1882441925 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fac080666c0 0x7fac08068b80 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fac1c005630 tx=0x7fac1c001490 comp rx=0 tx=0).stop 2024-04-02T07:26:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.084+0000 7fac33600640 1 -- 172.21.15.55:0/1882441925 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac2c09dca0 msgr2=0x7fac2c09b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.084+0000 7fac33600640 1 --2- 172.21.15.55:0/1882441925 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac2c09dca0 0x7fac2c09b690 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fac1401c820 tx=0x7fac10005800 comp rx=0 tx=0).stop 2024-04-02T07:26:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.084+0000 7fac33600640 1 -- 172.21.15.55:0/1882441925 shutdown_connections 2024-04-02T07:26:31.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.084+0000 7fac33600640 1 --2- 172.21.15.55:0/1882441925 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac2c09e100 0x7fac2c149b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.084+0000 7fac33600640 1 --2- 172.21.15.55:0/1882441925 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fac080666c0 0x7fac08068b80 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.084+0000 7fac33600640 1 --2- 172.21.15.55:0/1882441925 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac2c09dca0 0x7fac2c09b690 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.084+0000 7fac33600640 1 --2- 172.21.15.55:0/1882441925 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac100047d0 0x7fac2c14dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.084+0000 7fac33600640 1 -- 172.21.15.55:0/1882441925 >> 172.21.15.55:0/1882441925 conn(0x7fac2c0b2150 msgr2=0x7fac2c06b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:31.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.084+0000 7fac33600640 1 -- 172.21.15.55:0/1882441925 shutdown_connections 2024-04-02T07:26:31.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.084+0000 7fac33600640 1 -- 172.21.15.55:0/1882441925 wait complete. 2024-04-02T07:26:31.111 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d damage ls --format=json-pretty 2024-04-02T07:26:31.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.248+0000 7fe43c800640 1 Processor -- start 2024-04-02T07:26:31.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.248+0000 7fe43c800640 1 -- start start 2024-04-02T07:26:31.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.248+0000 7fe43c800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe43406c030 0x7fe434098e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.248+0000 7fe43c800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe43415ce40 con 0x7fe43415ca60 2024-04-02T07:26:31.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.248+0000 7fe43c800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4340ceeb0 con 0x7fe434098a10 2024-04-02T07:26:31.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.248+0000 7fe43c800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe43406c440 con 0x7fe43406c030 2024-04-02T07:26:31.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.248+0000 7fe43a800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe43406c030 0x7fe434098e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.248+0000 7fe439e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe43415ca60 0x7fe4340cfc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46036/0 (socket says 172.21.15.55:46036) 2024-04-02T07:26:31.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.248+0000 7fe439e00640 1 -- 172.21.15.55:0/3912929590 learned_addr learned my addr 172.21.15.55:0/3912929590 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:26:31.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.248+0000 7fe43a800640 1 -- 172.21.15.55:0/3912929590 >> v1:172.21.15.106:6789/0 conn(0x7fe434098a10 legacy=0x7fe43406b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:31.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.248+0000 7fe43a800640 1 -- 172.21.15.55:0/3912929590 >> v1:172.21.15.55:6789/0 conn(0x7fe43415ca60 legacy=0x7fe4340cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:31.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.248+0000 7fe43a800640 1 -- 172.21.15.55:0/3912929590 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4340cf190 con 0x7fe43406c030 2024-04-02T07:26:31.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.248+0000 7fe438a00640 1 -- 172.21.15.55:0/3912929590 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3008520612 0 0) 0x7fe43415ce40 con 0x7fe43415ca60 2024-04-02T07:26:31.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.252+0000 7fe43a800640 1 --2- 172.21.15.55:0/3912929590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe43406c030 0x7fe434098e80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe430009d90 tx=0x7fe43001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1684c20271a7b4f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:31.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.252+0000 7fe438a00640 1 -- 172.21.15.55:0/3912929590 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4300a5850 con 0x7fe43406c030 2024-04-02T07:26:31.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.252+0000 7fe438a00640 1 -- 172.21.15.55:0/3912929590 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4300a59b0 con 0x7fe43406c030 2024-04-02T07:26:31.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.252+0000 7fe438a00640 1 -- 172.21.15.55:0/3912929590 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4300a5d40 con 0x7fe43406c030 2024-04-02T07:26:31.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.252+0000 7fe43c800640 1 -- 172.21.15.55:0/3912929590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe43406c030 msgr2=0x7fe434098e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:31.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.252+0000 7fe43c800640 1 --2- 172.21.15.55:0/3912929590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe43406c030 0x7fe434098e80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fe430009d90 tx=0x7fe43001c8a0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.252+0000 7fe43c800640 1 -- 172.21.15.55:0/3912929590 shutdown_connections 2024-04-02T07:26:31.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.252+0000 7fe43c800640 1 --2- 172.21.15.55:0/3912929590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe43406c030 0x7fe434098e80 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.252+0000 7fe43c800640 1 -- 172.21.15.55:0/3912929590 >> 172.21.15.55:0/3912929590 conn(0x7fe4340b2150 msgr2=0x7fe4340b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:31.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.252+0000 7fe43c800640 1 -- 172.21.15.55:0/3912929590 shutdown_connections 2024-04-02T07:26:31.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.252+0000 7fe43c800640 1 -- 172.21.15.55:0/3912929590 wait complete. 2024-04-02T07:26:31.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe43c800640 1 Processor -- start 2024-04-02T07:26:31.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe43c800640 1 -- start start 2024-04-02T07:26:31.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe43c800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe43406c030 0x7fe4340b4880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe43c800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe434098a10 0x7fe434158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe43c800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe43415ca60 0x7fe43415a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe43c800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe434151df0 con 0x7fe434098a10 2024-04-02T07:26:31.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe43c800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe434151b10 con 0x7fe43406c030 2024-04-02T07:26:31.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe43c800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4340b3dc0 con 0x7fe43415ca60 2024-04-02T07:26:31.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe439400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe434098a10 0x7fe434158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe439400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe434098a10 0x7fe434158f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43186/0 (socket says 172.21.15.55:43186) 2024-04-02T07:26:31.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe439400640 1 -- 172.21.15.55:0/4294870146 learned_addr learned my addr 172.21.15.55:0/4294870146 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:31.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe439e00640 1 --2- 172.21.15.55:0/4294870146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe43406c030 0x7fe4340b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe43a800640 1 --2- 172.21.15.55:0/4294870146 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe43415ca60 0x7fe43415a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe439400640 1 -- 172.21.15.55:0/4294870146 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe43415ca60 msgr2=0x7fe43415a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:31.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe439400640 1 --2- 172.21.15.55:0/4294870146 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe43415ca60 0x7fe43415a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe439400640 1 -- 172.21.15.55:0/4294870146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe43406c030 msgr2=0x7fe4340b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:31.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe439400640 1 --2- 172.21.15.55:0/4294870146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe43406c030 0x7fe4340b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe439400640 1 -- 172.21.15.55:0/4294870146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe430009a70 con 0x7fe434098a10 2024-04-02T07:26:31.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe43a800640 1 --2- 172.21.15.55:0/4294870146 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe43415ca60 0x7fe43415a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:26:31.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe439400640 1 --2- 172.21.15.55:0/4294870146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe434098a10 0x7fe434158f90 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe42400b410 tx=0x7fe42400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:31.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe42e000640 1 -- 172.21.15.55:0/4294870146 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424004020 con 0x7fe434098a10 2024-04-02T07:26:31.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe42e000640 1 -- 172.21.15.55:0/4294870146 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe424004180 con 0x7fe434098a10 2024-04-02T07:26:31.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe43c800640 1 -- 172.21.15.55:0/4294870146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4340b40a0 con 0x7fe434098a10 2024-04-02T07:26:31.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe42e000640 1 -- 172.21.15.55:0/4294870146 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe424011630 con 0x7fe434098a10 2024-04-02T07:26:31.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.256+0000 7fe43c800640 1 -- 172.21.15.55:0/4294870146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4341516e0 con 0x7fe434098a10 2024-04-02T07:26:31.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.260+0000 7fe42e000640 1 -- 172.21.15.55:0/4294870146 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe424011790 con 0x7fe434098a10 2024-04-02T07:26:31.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.260+0000 7fe42e000640 1 --2- 172.21.15.55:0/4294870146 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe418066690 0x7fe418068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.260+0000 7fe42e000640 1 -- 172.21.15.55:0/4294870146 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe424083f10 con 0x7fe434098a10 2024-04-02T07:26:31.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.260+0000 7fe439e00640 1 --2- 172.21.15.55:0/4294870146 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe418066690 0x7fe418068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.260+0000 7fe43fd53000 1 Processor -- start 2024-04-02T07:26:31.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.260+0000 7fe43fd53000 1 -- start start 2024-04-02T07:26:31.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.260+0000 7fe439e00640 1 --2- 172.21.15.55:0/4294870146 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe418066690 0x7fe418068b50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe428000f70 tx=0x7fe428007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:31.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.260+0000 7fe43fd53000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac603290 0x5595ac603670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.260+0000 7fe43fd53000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 0x5595ac5b9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.260+0000 7fe43fd53000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac5ba1b0 0x5595ac5ba590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.260+0000 7fe43fd53000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ac482340 con 0x5595ac603290 2024-04-02T07:26:31.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.260+0000 7fe43fd53000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ac40ecd0 con 0x5595ac603bb0 2024-04-02T07:26:31.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.260+0000 7fe43fd53000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595ac40c2a0 con 0x5595ac5ba1b0 2024-04-02T07:26:31.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.260+0000 7fe439e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac603290 0x5595ac603670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.260+0000 7fe439e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac603290 0x5595ac603670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43200/0 (socket says 172.21.15.55:43200) 2024-04-02T07:26:31.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.260+0000 7fe439e00640 1 -- 172.21.15.55:0/1726066885 learned_addr learned my addr 172.21.15.55:0/1726066885 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:31.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe439400640 1 --2- 172.21.15.55:0/1726066885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 0x5595ac5b9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43a800640 1 --2- 172.21.15.55:0/1726066885 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac5ba1b0 0x5595ac5ba590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe439e00640 1 -- 172.21.15.55:0/1726066885 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac5ba1b0 msgr2=0x5595ac5ba590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:31.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe439e00640 1 --2- 172.21.15.55:0/1726066885 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac5ba1b0 0x5595ac5ba590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe439e00640 1 -- 172.21.15.55:0/1726066885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 msgr2=0x5595ac5b9c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:31.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe439e00640 1 --2- 172.21.15.55:0/1726066885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 0x5595ac5b9c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe439e00640 1 -- 172.21.15.55:0/1726066885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595ac0fa4b0 con 0x5595ac603290 2024-04-02T07:26:31.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43a800640 1 --2- 172.21.15.55:0/1726066885 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac5ba1b0 0x5595ac5ba590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:31.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe439e00640 1 --2- 172.21.15.55:0/1726066885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac603290 0x5595ac603670 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe428005dd0 tx=0x7fe428012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4350089be98b5b17 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:31.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe422a00640 1 -- 172.21.15.55:0/1726066885 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428015110 con 0x5595ac603290 2024-04-02T07:26:31.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe422a00640 1 -- 172.21.15.55:0/1726066885 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe428015270 con 0x5595ac603290 2024-04-02T07:26:31.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe422a00640 1 -- 172.21.15.55:0/1726066885 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428015bc0 con 0x5595ac603290 2024-04-02T07:26:31.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43fd53000 1 -- 172.21.15.55:0/1726066885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac603290 msgr2=0x5595ac603670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:31.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43fd53000 1 --2- 172.21.15.55:0/1726066885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac603290 0x5595ac603670 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fe428005dd0 tx=0x7fe428012000 comp rx=0 tx=0).stop 2024-04-02T07:26:31.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43fd53000 1 -- 172.21.15.55:0/1726066885 shutdown_connections 2024-04-02T07:26:31.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43fd53000 1 --2- 172.21.15.55:0/1726066885 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac5ba1b0 0x5595ac5ba590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43fd53000 1 --2- 172.21.15.55:0/1726066885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 0x5595ac5b9c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43fd53000 1 --2- 172.21.15.55:0/1726066885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac603290 0x5595ac603670 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43fd53000 1 -- 172.21.15.55:0/1726066885 >> 172.21.15.55:0/1726066885 conn(0x5595ac5b6160 msgr2=0x5595ac5b8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:31.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43fd53000 1 -- 172.21.15.55:0/1726066885 shutdown_connections 2024-04-02T07:26:31.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43fd53000 1 -- 172.21.15.55:0/1726066885 wait complete. 2024-04-02T07:26:31.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43fd53000 1 -- start start 2024-04-02T07:26:31.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43fd53000 1 Processor -- start 2024-04-02T07:26:31.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43fd53000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 0x5595ac5bf730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43fd53000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac603290 0x5595ac5bfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43fd53000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 0x5595ac5c4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43fd53000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ac407b90 con 0x5595ac5ba1b0 2024-04-02T07:26:31.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43fd53000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ac3c50a0 con 0x5595ac603bb0 2024-04-02T07:26:31.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43fd53000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595ac3c4d40 con 0x5595ac603290 2024-04-02T07:26:31.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43fd53000 10 client.0 _ll_register_callbacks cb 0x5595ac4bcc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:26:31.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe439e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 0x5595ac5bf730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe439e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 0x5595ac5bf730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43204/0 (socket says 172.21.15.55:43204) 2024-04-02T07:26:31.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe439e00640 1 -- 172.21.15.55:0/4120097340 learned_addr learned my addr 172.21.15.55:0/4120097340 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:31.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe43a800640 1 --2- 172.21.15.55:0/4120097340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 0x5595ac5c4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.264+0000 7fe439400640 1 --2- 172.21.15.55:0/4120097340 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac603290 0x5595ac5bfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe439e00640 1 -- 172.21.15.55:0/4120097340 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac603290 msgr2=0x5595ac5bfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:31.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe439e00640 1 --2- 172.21.15.55:0/4120097340 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac603290 0x5595ac5bfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe439e00640 1 -- 172.21.15.55:0/4120097340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 msgr2=0x5595ac5c4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:31.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe439e00640 1 --2- 172.21.15.55:0/4120097340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 0x5595ac5c4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe439e00640 1 -- 172.21.15.55:0/4120097340 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe42800f040 con 0x5595ac5ba1b0 2024-04-02T07:26:31.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43a800640 1 --2- 172.21.15.55:0/4120097340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 0x5595ac5c4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:31.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe439400640 1 --2- 172.21.15.55:0/4120097340 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac603290 0x5595ac5bfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:31.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe439e00640 1 --2- 172.21.15.55:0/4120097340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 0x5595ac5bf730 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x5595ac403490 tx=0x7fe428011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a4af6bab5edc226 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe417400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:26:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe417400640 1 -- 172.21.15.55:0/4120097340 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428028040 con 0x5595ac5ba1b0 2024-04-02T07:26:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe417400640 1 -- 172.21.15.55:0/4120097340 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe428015bd0 con 0x5595ac5ba1b0 2024-04-02T07:26:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 1 -- 172.21.15.55:0/4120097340 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5595ac3d7550 con 0x5595ac5ba1b0 2024-04-02T07:26:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe417400640 1 -- 172.21.15.55:0/4120097340 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe428015d90 con 0x5595ac5ba1b0 2024-04-02T07:26:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 10 client.6513 fetch_fsmap learned FSMap version 35 2024-04-02T07:26:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 1 -- 172.21.15.55:0/4120097340 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x5595ac3ccba0 con 0x5595ac5ba1b0 2024-04-02T07:26:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe417400640 1 -- 172.21.15.55:0/4120097340 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5595ac3d7550 con 0x5595ac5ba1b0 2024-04-02T07:26:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe417400640 1 -- 172.21.15.55:0/4120097340 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 35) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fe428021450 con 0x5595ac5ba1b0 2024-04-02T07:26:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 10 client.6513 fetch_fsmap finished waiting for FSMap version 35 2024-04-02T07:26:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 10 client.6513 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-02T07:26:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 20 client.6513 populate_metadata read hostname 'smithi055' 2024-04-02T07:26:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 1 --2- 172.21.15.55:0/4120097340 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x5595ac612320 0x5595ac614710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 4 client.6513 mds_command: new command op to 6138 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:26:31.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 1 -- 172.21.15.55:0/4120097340 --> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5595ac404970 con 0x5595ac612320 2024-04-02T07:26:31.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe439400640 1 --2- 172.21.15.55:0/4120097340 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x5595ac612320 0x5595ac614710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe439400640 1 --2- 172.21.15.55:0/4120097340 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x5595ac612320 0x5595ac614710 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf0cc4676236ece server_cookie=f920dae1d384bd02 in_seq=0 out_seq=0 2024-04-02T07:26:31.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe417400640 10 client.6513 ms_handle_connect on v2:172.21.15.106:6835/1050953219 2024-04-02T07:26:31.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe417400640 1 -- 172.21.15.55:0/4120097340 <== mds.0 v2:172.21.15.106:6835/1050953219 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5595ac404970 con 0x5595ac612320 2024-04-02T07:26:31.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe417400640 10 client.6513 handle_command_reply: tid=0 2024-04-02T07:26:31.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 1 client.6513 shutdown 2024-04-02T07:26:31.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 1 -- 172.21.15.55:0/4120097340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 msgr2=0x5595ac5bf730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:31.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 1 --2- 172.21.15.55:0/4120097340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 0x5595ac5bf730 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x5595ac403490 tx=0x7fe428011000 comp rx=0 tx=0).stop 2024-04-02T07:26:31.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 1 -- 172.21.15.55:0/4120097340 shutdown_connections 2024-04-02T07:26:31.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 1 --2- 172.21.15.55:0/4120097340 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 0x5595ac5c4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 1 --2- 172.21.15.55:0/4120097340 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x5595ac612320 0x5595ac614710 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 1 --2- 172.21.15.55:0/4120097340 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac603290 0x5595ac5bfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 1 --2- 172.21.15.55:0/4120097340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 0x5595ac5bf730 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe417400640 0 client.6513 ms_handle_reset on v2:172.21.15.106:6835/1050953219 2024-04-02T07:26:31.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 1 -- 172.21.15.55:0/4120097340 >> 172.21.15.55:0/4120097340 conn(0x5595ac5b6160 msgr2=0x5595ac5b8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:31.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 1 -- 172.21.15.55:0/4120097340 shutdown_connections 2024-04-02T07:26:31.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 1 -- 172.21.15.55:0/4120097340 wait complete. 2024-04-02T07:26:31.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.268+0000 7fe43fd53000 20 client.6513 trim_cache size 0 max 16384 2024-04-02T07:26:31.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.280+0000 7fe43fd53000 1 Processor -- start 2024-04-02T07:26:31.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.280+0000 7fe43fd53000 1 -- start start 2024-04-02T07:26:31.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 0x5595ac616260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac603290 0x5595ac6167a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 0x5595ac612700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ac0c4c40 con 0x5595ac5ba1b0 2024-04-02T07:26:31.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ac404f90 con 0x5595ac603bb0 2024-04-02T07:26:31.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595ac3a4a40 con 0x5595ac603290 2024-04-02T07:26:31.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe439e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 0x5595ac616260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe439e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 0x5595ac616260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43214/0 (socket says 172.21.15.55:43214) 2024-04-02T07:26:31.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe439e00640 1 -- 172.21.15.55:0/4291392811 learned_addr learned my addr 172.21.15.55:0/4291392811 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:31.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43a800640 1 --2- 172.21.15.55:0/4291392811 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 0x5595ac612700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe439400640 1 --2- 172.21.15.55:0/4291392811 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac603290 0x5595ac6167a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe439e00640 1 -- 172.21.15.55:0/4291392811 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac603290 msgr2=0x5595ac6167a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:31.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe439e00640 1 --2- 172.21.15.55:0/4291392811 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac603290 0x5595ac6167a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe439e00640 1 -- 172.21.15.55:0/4291392811 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 msgr2=0x5595ac612700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:31.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe439e00640 1 --2- 172.21.15.55:0/4291392811 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 0x5595ac612700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe439e00640 1 -- 172.21.15.55:0/4291392811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5595ac602ce0 con 0x5595ac5ba1b0 2024-04-02T07:26:31.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe439e00640 1 --2- 172.21.15.55:0/4291392811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 0x5595ac616260 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe428001130 tx=0x7fe428017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ecc16f716c00dc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:31.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe423400640 1 -- 172.21.15.55:0/4291392811 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428028040 con 0x5595ac5ba1b0 2024-04-02T07:26:31.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe423400640 1 -- 172.21.15.55:0/4291392811 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe428019070 con 0x5595ac5ba1b0 2024-04-02T07:26:31.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe423400640 1 -- 172.21.15.55:0/4291392811 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428015dd0 con 0x5595ac5ba1b0 2024-04-02T07:26:31.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 -- 172.21.15.55:0/4291392811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 msgr2=0x5595ac616260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:31.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 --2- 172.21.15.55:0/4291392811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 0x5595ac616260 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fe428001130 tx=0x7fe428017070 comp rx=0 tx=0).stop 2024-04-02T07:26:31.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 -- 172.21.15.55:0/4291392811 shutdown_connections 2024-04-02T07:26:31.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 --2- 172.21.15.55:0/4291392811 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 0x5595ac612700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 --2- 172.21.15.55:0/4291392811 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac603290 0x5595ac6167a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 --2- 172.21.15.55:0/4291392811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 0x5595ac616260 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 -- 172.21.15.55:0/4291392811 >> 172.21.15.55:0/4291392811 conn(0x5595ac5b6160 msgr2=0x5595ac5b9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 -- 172.21.15.55:0/4291392811 shutdown_connections 2024-04-02T07:26:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 -- 172.21.15.55:0/4291392811 wait complete. 2024-04-02T07:26:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 -- start start 2024-04-02T07:26:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 Processor -- start 2024-04-02T07:26:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 0x5595ac615d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac603290 0x5595ac61dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 0x5595ac61e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ac3c1300 con 0x5595ac5ba1b0 2024-04-02T07:26:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.284+0000 7fe43fd53000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5595ac40bb90 con 0x5595ac603bb0 2024-04-02T07:26:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5595ac40a6f0 con 0x5595ac603290 2024-04-02T07:26:31.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 10 client.0 _ll_register_callbacks cb 0x5595ac4a5870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:26:31.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe439e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 0x5595ac615d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe439e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 0x5595ac615d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43228/0 (socket says 172.21.15.55:43228) 2024-04-02T07:26:31.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe439e00640 1 -- 172.21.15.55:0/3288697640 learned_addr learned my addr 172.21.15.55:0/3288697640 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:31.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43a800640 1 --2- 172.21.15.55:0/3288697640 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 0x5595ac61e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe439400640 1 --2- 172.21.15.55:0/3288697640 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac603290 0x5595ac61dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe439e00640 1 -- 172.21.15.55:0/3288697640 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac603290 msgr2=0x5595ac61dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:31.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe439e00640 1 --2- 172.21.15.55:0/3288697640 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac603290 0x5595ac61dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe439e00640 1 -- 172.21.15.55:0/3288697640 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 msgr2=0x5595ac61e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:31.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe439e00640 1 --2- 172.21.15.55:0/3288697640 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 0x5595ac61e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe439e00640 1 -- 172.21.15.55:0/3288697640 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5595ac3ccba0 con 0x5595ac5ba1b0 2024-04-02T07:26:31.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe439e00640 1 --2- 172.21.15.55:0/3288697640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 0x5595ac615d10 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe42803a040 tx=0x7fe428000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6094910e712dc35b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:31.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe417400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:26:31.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe417400640 1 -- 172.21.15.55:0/3288697640 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe428015810 con 0x5595ac5ba1b0 2024-04-02T07:26:31.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe417400640 1 -- 172.21.15.55:0/3288697640 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe428021960 con 0x5595ac5ba1b0 2024-04-02T07:26:31.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 1 -- 172.21.15.55:0/3288697640 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5595ac3b7620 con 0x5595ac5ba1b0 2024-04-02T07:26:31.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe417400640 1 -- 172.21.15.55:0/3288697640 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe428015de0 con 0x5595ac5ba1b0 2024-04-02T07:26:31.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 10 client.6519 fetch_fsmap learned FSMap version 35 2024-04-02T07:26:31.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 1 -- 172.21.15.55:0/3288697640 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=2+}) v3 -- 0x5595ac3b2ef0 con 0x5595ac5ba1b0 2024-04-02T07:26:31.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe417400640 1 -- 172.21.15.55:0/3288697640 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5595ac3b7620 con 0x5595ac5ba1b0 2024-04-02T07:26:31.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe417400640 1 -- 172.21.15.55:0/3288697640 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 35) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fe42802d420 con 0x5595ac5ba1b0 2024-04-02T07:26:31.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 10 client.6519 fetch_fsmap finished waiting for FSMap version 35 2024-04-02T07:26:31.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 10 client.6519 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-02T07:26:31.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 20 client.6519 populate_metadata read hostname 'smithi055' 2024-04-02T07:26:31.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 1 --2- 172.21.15.55:0/3288697640 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x5595ac61e550 0x5595ac6614b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 4 client.6519 mds_command: new command op to 6138 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-02T07:26:31.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 1 -- 172.21.15.55:0/3288697640 --> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x5595ac4064e0 con 0x5595ac61e550 2024-04-02T07:26:31.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe439400640 1 --2- 172.21.15.55:0/3288697640 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x5595ac61e550 0x5595ac6614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe439400640 1 --2- 172.21.15.55:0/3288697640 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x5595ac61e550 0x5595ac6614b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1e5071a9eda676b server_cookie=47a7b9cb8a90276c in_seq=0 out_seq=0 2024-04-02T07:26:31.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe417400640 10 client.6519 ms_handle_connect on v2:172.21.15.106:6835/1050953219 2024-04-02T07:26:31.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe417400640 1 -- 172.21.15.55:0/3288697640 <== mds.0 v2:172.21.15.106:6835/1050953219 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5595ac4064e0 con 0x5595ac61e550 2024-04-02T07:26:31.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe417400640 10 client.6519 handle_command_reply: tid=0 2024-04-02T07:26:31.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 1 client.6519 shutdown 2024-04-02T07:26:31.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 1 -- 172.21.15.55:0/3288697640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 msgr2=0x5595ac615d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:31.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 1 --2- 172.21.15.55:0/3288697640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 0x5595ac615d10 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fe42803a040 tx=0x7fe428000ee0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 1 -- 172.21.15.55:0/3288697640 shutdown_connections 2024-04-02T07:26:31.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 1 --2- 172.21.15.55:0/3288697640 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5595ac603bb0 0x5595ac61e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 1 --2- 172.21.15.55:0/3288697640 >> [v2:172.21.15.106:6835/1050953219,v1:172.21.15.106:6837/1050953219] conn(0x5595ac61e550 0x5595ac6614b0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 1 --2- 172.21.15.55:0/3288697640 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5595ac603290 0x5595ac61dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 1 --2- 172.21.15.55:0/3288697640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5595ac5ba1b0 0x5595ac615d10 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe417400640 0 client.6519 ms_handle_reset on v2:172.21.15.106:6835/1050953219 2024-04-02T07:26:31.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 1 -- 172.21.15.55:0/3288697640 >> 172.21.15.55:0/3288697640 conn(0x5595ac5b6160 msgr2=0x5595ac5be6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:31.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 1 -- 172.21.15.55:0/3288697640 shutdown_connections 2024-04-02T07:26:31.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 1 -- 172.21.15.55:0/3288697640 wait complete. 2024-04-02T07:26:31.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.288+0000 7fe43fd53000 20 client.6519 trim_cache size 0 max 16384 2024-04-02T07:26:31.300 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:31.300 INFO:teuthology.orchestra.run.smithi055.stdout:[] 2024-04-02T07:26:31.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.292+0000 7fe43c800640 1 -- 172.21.15.55:0/4294870146 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe418066690 msgr2=0x7fe418068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:31.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.292+0000 7fe43c800640 1 --2- 172.21.15.55:0/4294870146 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe418066690 0x7fe418068b50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe428000f70 tx=0x7fe428007c10 comp rx=0 tx=0).stop 2024-04-02T07:26:31.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.292+0000 7fe43c800640 1 -- 172.21.15.55:0/4294870146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe434098a10 msgr2=0x7fe434158f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:31.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.292+0000 7fe43c800640 1 --2- 172.21.15.55:0/4294870146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe434098a10 0x7fe434158f90 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fe42400b410 tx=0x7fe42400b8d0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.292+0000 7fe43c800640 1 -- 172.21.15.55:0/4294870146 shutdown_connections 2024-04-02T07:26:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.292+0000 7fe43c800640 1 --2- 172.21.15.55:0/4294870146 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe43415ca60 0x7fe43415a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.292+0000 7fe43c800640 1 --2- 172.21.15.55:0/4294870146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe434098a10 0x7fe434158f90 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.292+0000 7fe43c800640 1 --2- 172.21.15.55:0/4294870146 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe418066690 0x7fe418068b50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.292+0000 7fe43c800640 1 --2- 172.21.15.55:0/4294870146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe43406c030 0x7fe4340b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.292+0000 7fe43c800640 1 -- 172.21.15.55:0/4294870146 >> 172.21.15.55:0/4294870146 conn(0x7fe4340b2150 msgr2=0x7fe4340aff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.292+0000 7fe43c800640 1 -- 172.21.15.55:0/4294870146 shutdown_connections 2024-04-02T07:26:31.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.292+0000 7fe43c800640 1 -- 172.21.15.55:0/4294870146 wait complete. 2024-04-02T07:26:31.314 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-02T07:26:31.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.448+0000 7fac06200640 1 Processor -- start 2024-04-02T07:26:31.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.448+0000 7fac06200640 1 -- start start 2024-04-02T07:26:31.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.448+0000 7fac06200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac000cfdf0 0x7fac0006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.452+0000 7fac06200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac000b16e0 0x7fac000b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.452+0000 7fac06200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fac000b11f0 0x7fac00098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.452+0000 7fac06200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac000d01d0 con 0x7fac000b16e0 2024-04-02T07:26:31.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.452+0000 7fac06200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac0006c0e0 con 0x7fac000b11f0 2024-04-02T07:26:31.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.452+0000 7fac06200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac000b01d0 con 0x7fac000cfdf0 2024-04-02T07:26:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.452+0000 7fabfea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac000b16e0 0x7fac000b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.452+0000 7fabfea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fac000b16e0 0x7fac000b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43244/0 (socket says 172.21.15.55:43244) 2024-04-02T07:26:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.452+0000 7fabfea00640 1 -- 172.21.15.55:0/511078124 learned_addr learned my addr 172.21.15.55:0/511078124 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.452+0000 7fabffe00640 1 --2- 172.21.15.55:0/511078124 >> v2:172.21.15.106:3300/0 conn(0x7fac000b11f0 0x7fac00098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.452+0000 7fabff400640 1 --2- 172.21.15.55:0/511078124 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac000cfdf0 0x7fac0006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.452+0000 7fabfea00640 1 -- 172.21.15.55:0/511078124 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac000cfdf0 msgr2=0x7fac0006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.452+0000 7fabfea00640 1 --2- 172.21.15.55:0/511078124 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac000cfdf0 0x7fac0006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.452+0000 7fabfea00640 1 -- 172.21.15.55:0/511078124 >> v2:172.21.15.106:3300/0 conn(0x7fac000b11f0 msgr2=0x7fac00098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.452+0000 7fabfea00640 1 --2- 172.21.15.55:0/511078124 >> v2:172.21.15.106:3300/0 conn(0x7fac000b11f0 0x7fac00098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.452+0000 7fabfea00640 1 -- 172.21.15.55:0/511078124 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac000b04b0 con 0x7fac000b16e0 2024-04-02T07:26:31.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.452+0000 7fabfea00640 1 --2- 172.21.15.55:0/511078124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac000b16e0 0x7fac000b0cb0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fac000723f0 tx=0x7fabec01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282416da92211722 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:31.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.452+0000 7fabfe000640 1 -- 172.21.15.55:0/511078124 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0ac620 con 0x7fac000b16e0 2024-04-02T07:26:31.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.452+0000 7fabfe000640 1 -- 172.21.15.55:0/511078124 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec0ac780 con 0x7fac000b16e0 2024-04-02T07:26:31.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.452+0000 7fabfe000640 1 -- 172.21.15.55:0/511078124 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0acb10 con 0x7fac000b16e0 2024-04-02T07:26:31.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fac06200640 1 -- 172.21.15.55:0/511078124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac000b16e0 msgr2=0x7fac000b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:31.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fac06200640 1 --2- 172.21.15.55:0/511078124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac000b16e0 0x7fac000b0cb0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fac000723f0 tx=0x7fabec01c4f0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fac06200640 1 -- 172.21.15.55:0/511078124 shutdown_connections 2024-04-02T07:26:31.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fac06200640 1 --2- 172.21.15.55:0/511078124 >> v2:172.21.15.106:3300/0 conn(0x7fac000b11f0 0x7fac00098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fac06200640 1 --2- 172.21.15.55:0/511078124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac000b16e0 0x7fac000b0cb0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fac06200640 1 --2- 172.21.15.55:0/511078124 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac000cfdf0 0x7fac0006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fac06200640 1 -- 172.21.15.55:0/511078124 >> 172.21.15.55:0/511078124 conn(0x7fac000b2210 msgr2=0x7fac000b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:31.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fac06200640 1 -- 172.21.15.55:0/511078124 shutdown_connections 2024-04-02T07:26:31.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fac06200640 1 -- 172.21.15.55:0/511078124 wait complete. 2024-04-02T07:26:31.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fac06200640 1 Processor -- start 2024-04-02T07:26:31.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fac06200640 1 -- start start 2024-04-02T07:26:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fac06200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac000b11f0 0x7fac0014ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fac06200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac000b16e0 0x7fac000b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fac06200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac000cfdf0 0x7fac000b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fac06200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac00159da0 con 0x7fac000b16e0 2024-04-02T07:26:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fac06200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0015a080 con 0x7fac000b11f0 2024-04-02T07:26:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fac06200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac000cad50 con 0x7fac000cfdf0 2024-04-02T07:26:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fabfea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac000b16e0 0x7fac000b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fabfea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac000b16e0 0x7fac000b3240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43248/0 (socket says 172.21.15.55:43248) 2024-04-02T07:26:31.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fabfea00640 1 -- 172.21.15.55:0/1661779840 learned_addr learned my addr 172.21.15.55:0/1661779840 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fabff400640 1 --2- 172.21.15.55:0/1661779840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac000b11f0 0x7fac0014ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fabffe00640 1 --2- 172.21.15.55:0/1661779840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac000cfdf0 0x7fac000b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fabfea00640 1 -- 172.21.15.55:0/1661779840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac000cfdf0 msgr2=0x7fac000b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fabfea00640 1 --2- 172.21.15.55:0/1661779840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac000cfdf0 0x7fac000b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fabfea00640 1 -- 172.21.15.55:0/1661779840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac000b11f0 msgr2=0x7fac0014ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fabfea00640 1 --2- 172.21.15.55:0/1661779840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac000b11f0 0x7fac0014ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fabfea00640 1 -- 172.21.15.55:0/1661779840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec0094d0 con 0x7fac000b16e0 2024-04-02T07:26:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fabff400640 1 --2- 172.21.15.55:0/1661779840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac000b11f0 0x7fac0014ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.456+0000 7fabfea00640 1 --2- 172.21.15.55:0/1661779840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac000b16e0 0x7fac000b3240 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fabec01aba0 tx=0x7fabec019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.460+0000 7fabf7400640 1 -- 172.21.15.55:0/1661779840 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0acbf0 con 0x7fac000b16e0 2024-04-02T07:26:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.460+0000 7fabf7400640 1 -- 172.21.15.55:0/1661779840 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec0acd50 con 0x7fac000b16e0 2024-04-02T07:26:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.460+0000 7fabf7400640 1 -- 172.21.15.55:0/1661779840 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0b5660 con 0x7fac000b16e0 2024-04-02T07:26:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.460+0000 7fac06200640 1 -- 172.21.15.55:0/1661779840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac000cb030 con 0x7fac000b16e0 2024-04-02T07:26:31.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.460+0000 7fac06200640 1 -- 172.21.15.55:0/1661779840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac000b3780 con 0x7fac000b16e0 2024-04-02T07:26:31.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.460+0000 7fac06200640 1 -- 172.21.15.55:0/1661779840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac00066c90 con 0x7fac000b16e0 2024-04-02T07:26:31.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.460+0000 7fabf7400640 1 -- 172.21.15.55:0/1661779840 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fabec0b3070 con 0x7fac000b16e0 2024-04-02T07:26:31.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.460+0000 7fabf7400640 1 --2- 172.21.15.55:0/1661779840 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fabe0066690 0x7fabe0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:31.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.460+0000 7fabf7400640 1 -- 172.21.15.55:0/1661779840 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabec11def0 con 0x7fac000b16e0 2024-04-02T07:26:31.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.460+0000 7fabff400640 1 --2- 172.21.15.55:0/1661779840 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fabe0066690 0x7fabe0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:31.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.460+0000 7fabff400640 1 --2- 172.21.15.55:0/1661779840 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fabe0066690 0x7fabe0068b50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fabf000b970 tx=0x7fabf0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:31.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.464+0000 7fabf7400640 1 -- 172.21.15.55:0/1661779840 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fabec0eb250 con 0x7fac000b16e0 2024-04-02T07:26:31.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.660+0000 7fac06200640 1 -- 172.21.15.55:0/1661779840 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fac00167330 con 0x7fac000b16e0 2024-04-02T07:26:31.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.660+0000 7fabf7400640 1 -- 172.21.15.55:0/1661779840 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fabec0ee870 con 0x7fac000b16e0 2024-04-02T07:26:31.668 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:31.668 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-02T07:26:31.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.664+0000 7fac06200640 1 -- 172.21.15.55:0/1661779840 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fabe0066690 msgr2=0x7fabe0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:31.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.664+0000 7fac06200640 1 --2- 172.21.15.55:0/1661779840 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fabe0066690 0x7fabe0068b50 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fabf000b970 tx=0x7fabf0008040 comp rx=0 tx=0).stop 2024-04-02T07:26:31.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.664+0000 7fac06200640 1 -- 172.21.15.55:0/1661779840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac000b16e0 msgr2=0x7fac000b3240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:31.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.664+0000 7fac06200640 1 --2- 172.21.15.55:0/1661779840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac000b16e0 0x7fac000b3240 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7fabec01aba0 tx=0x7fabec019290 comp rx=0 tx=0).stop 2024-04-02T07:26:31.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.664+0000 7fac06200640 1 -- 172.21.15.55:0/1661779840 shutdown_connections 2024-04-02T07:26:31.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.664+0000 7fac06200640 1 --2- 172.21.15.55:0/1661779840 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fac000cfdf0 0x7fac000b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.664+0000 7fac06200640 1 --2- 172.21.15.55:0/1661779840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac000b16e0 0x7fac000b3240 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.664+0000 7fac06200640 1 --2- 172.21.15.55:0/1661779840 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fabe0066690 0x7fabe0068b50 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.664+0000 7fac06200640 1 --2- 172.21.15.55:0/1661779840 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fac000b11f0 0x7fac0014ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:31.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.664+0000 7fac06200640 1 -- 172.21.15.55:0/1661779840 >> 172.21.15.55:0/1661779840 conn(0x7fac000b2210 msgr2=0x7fac000af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:31.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.664+0000 7fac06200640 1 -- 172.21.15.55:0/1661779840 shutdown_connections 2024-04-02T07:26:31.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:31.664+0000 7fac06200640 1 -- 172.21.15.55:0/1661779840 wait complete. 2024-04-02T07:26:31.689 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-02T07:26:31.689 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-02T07:26:31.690 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:26:31.782 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:26:31.851 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-02T07:26:31.851 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:26:31.851 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:26:31.860 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:26:32.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.036+0000 7fbfb9800640 1 Processor -- start 2024-04-02T07:26:32.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.036+0000 7fbfb9800640 1 -- start start 2024-04-02T07:26:32.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.036+0000 7fbfb9800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfb40c4120 0x7fbfb40b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:32.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.036+0000 7fbfb9800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbfb40b36f0 0x7fbfb413d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:32.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.036+0000 7fbfb9800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfb413d0c0 con 0x7fbfb4153ea0 2024-04-02T07:26:32.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.036+0000 7fbfb9800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfb415a2f0 con 0x7fbfb40c4120 2024-04-02T07:26:32.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.036+0000 7fbfb9800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfb40b3b20 con 0x7fbfb40b36f0 2024-04-02T07:26:32.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.040+0000 7fbfaa000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbfb40c4120 0x7fbfb40b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:32.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.040+0000 7fbfb2a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbfb4153ea0 0x7fbfb4159be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46044/0 (socket says 172.21.15.55:46044) 2024-04-02T07:26:32.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.040+0000 7fbfb2a00640 1 -- 172.21.15.55:0/1144924822 learned_addr learned my addr 172.21.15.55:0/1144924822 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:26:32.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.040+0000 7fbfb3400640 1 --2- 172.21.15.55:0/1144924822 >> v2:172.21.15.106:3300/0 conn(0x7fbfb40b36f0 0x7fbfb413d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:32.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.040+0000 7fbfaa000640 1 -- 172.21.15.55:0/1144924822 >> v2:172.21.15.106:3300/0 conn(0x7fbfb40b36f0 msgr2=0x7fbfb413d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:32.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.040+0000 7fbfaa000640 1 --2- 172.21.15.55:0/1144924822 >> v2:172.21.15.106:3300/0 conn(0x7fbfb40b36f0 0x7fbfb413d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.040+0000 7fbfaa000640 1 -- 172.21.15.55:0/1144924822 >> v1:172.21.15.55:6789/0 conn(0x7fbfb4153ea0 legacy=0x7fbfb4159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:32.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.040+0000 7fbfaa000640 1 -- 172.21.15.55:0/1144924822 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfb415a4f0 con 0x7fbfb40c4120 2024-04-02T07:26:32.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.040+0000 7fbfb2000640 1 -- 172.21.15.55:0/1144924822 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359702450 0 0) 0x7fbfb413d0c0 con 0x7fbfb4153ea0 2024-04-02T07:26:32.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.040+0000 7fbfaa000640 1 --2- 172.21.15.55:0/1144924822 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfb40c4120 0x7fbfb40b31b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4143320 tx=0x7fbf9c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9f21538e0d9bd86 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:32.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.040+0000 7fbfb2000640 1 -- 172.21.15.55:0/1144924822 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c0a8050 con 0x7fbfb40c4120 2024-04-02T07:26:32.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.040+0000 7fbfb2000640 1 -- 172.21.15.55:0/1144924822 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c0ac5f0 con 0x7fbfb40c4120 2024-04-02T07:26:32.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.040+0000 7fbfb2000640 1 -- 172.21.15.55:0/1144924822 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c0ac980 con 0x7fbfb40c4120 2024-04-02T07:26:32.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb9800640 1 -- 172.21.15.55:0/1144924822 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfb40c4120 msgr2=0x7fbfb40b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:32.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb9800640 1 --2- 172.21.15.55:0/1144924822 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfb40c4120 0x7fbfb40b31b0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fbfb4143320 tx=0x7fbf9c01c480 comp rx=0 tx=0).stop 2024-04-02T07:26:32.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb9800640 1 -- 172.21.15.55:0/1144924822 shutdown_connections 2024-04-02T07:26:32.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb9800640 1 --2- 172.21.15.55:0/1144924822 >> v2:172.21.15.106:3300/0 conn(0x7fbfb40b36f0 0x7fbfb413d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb9800640 1 --2- 172.21.15.55:0/1144924822 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfb40c4120 0x7fbfb40b31b0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb9800640 1 -- 172.21.15.55:0/1144924822 >> 172.21.15.55:0/1144924822 conn(0x7fbfb4066080 msgr2=0x7fbfb4069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:32.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb9800640 1 -- 172.21.15.55:0/1144924822 shutdown_connections 2024-04-02T07:26:32.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb9800640 1 -- 172.21.15.55:0/1144924822 wait complete. 2024-04-02T07:26:32.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb9800640 1 Processor -- start 2024-04-02T07:26:32.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb9800640 1 -- start start 2024-04-02T07:26:32.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb9800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfb40b36f0 0x7fbfb4150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:32.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb9800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfb40c4120 0x7fbfb414f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:32.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb9800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb4153ea0 0x7fbfb414b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:32.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb9800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb40cbf60 con 0x7fbfb40b36f0 2024-04-02T07:26:32.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb9800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb414c1d0 con 0x7fbfb4153ea0 2024-04-02T07:26:32.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb9800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfb40cbc80 con 0x7fbfb40c4120 2024-04-02T07:26:32.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfb40b36f0 0x7fbfb4150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:32.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfb40b36f0 0x7fbfb4150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43254/0 (socket says 172.21.15.55:43254) 2024-04-02T07:26:32.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb2a00640 1 -- 172.21.15.55:0/415606554 learned_addr learned my addr 172.21.15.55:0/415606554 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:32.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfaa000640 1 --2- 172.21.15.55:0/415606554 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfb40c4120 0x7fbfb414f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:32.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb3400640 1 --2- 172.21.15.55:0/415606554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb4153ea0 0x7fbfb414b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:32.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb2a00640 1 -- 172.21.15.55:0/415606554 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfb40c4120 msgr2=0x7fbfb414f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:32.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb2a00640 1 --2- 172.21.15.55:0/415606554 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfb40c4120 0x7fbfb414f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb2a00640 1 -- 172.21.15.55:0/415606554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb4153ea0 msgr2=0x7fbfb414b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:32.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb2a00640 1 --2- 172.21.15.55:0/415606554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb4153ea0 0x7fbfb414b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.044+0000 7fbfb2a00640 1 -- 172.21.15.55:0/415606554 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c009420 con 0x7fbfb40b36f0 2024-04-02T07:26:32.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.048+0000 7fbfb2a00640 1 --2- 172.21.15.55:0/415606554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfb40b36f0 0x7fbfb4150cf0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400c480 tx=0x7fbfa400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:32.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.048+0000 7fbfab400640 1 -- 172.21.15.55:0/415606554 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa40074e0 con 0x7fbfb40b36f0 2024-04-02T07:26:32.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.048+0000 7fbfab400640 1 -- 172.21.15.55:0/415606554 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfa4007660 con 0x7fbfb40b36f0 2024-04-02T07:26:32.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.048+0000 7fbfb9800640 1 -- 172.21.15.55:0/415606554 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfb40cc440 con 0x7fbfb40b36f0 2024-04-02T07:26:32.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.048+0000 7fbfab400640 1 -- 172.21.15.55:0/415606554 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfa4004a30 con 0x7fbfb40b36f0 2024-04-02T07:26:32.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.048+0000 7fbfb9800640 1 -- 172.21.15.55:0/415606554 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfb414fd80 con 0x7fbfb40b36f0 2024-04-02T07:26:32.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.048+0000 7fbfb9800640 1 -- 172.21.15.55:0/415606554 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfb40b2c00 con 0x7fbfb40b36f0 2024-04-02T07:26:32.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.048+0000 7fbfab400640 1 -- 172.21.15.55:0/415606554 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fbfa4004b90 con 0x7fbfb40b36f0 2024-04-02T07:26:32.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.048+0000 7fbfab400640 1 --2- 172.21.15.55:0/415606554 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbf90066690 0x7fbf90068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:32.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.048+0000 7fbfab400640 1 -- 172.21.15.55:0/415606554 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbfa4083610 con 0x7fbfb40b36f0 2024-04-02T07:26:32.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.048+0000 7fbfaa000640 1 --2- 172.21.15.55:0/415606554 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbf90066690 0x7fbf90068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:32.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.052+0000 7fbfaa000640 1 --2- 172.21.15.55:0/415606554 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbf90066690 0x7fbf90068b50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c0ae000 tx=0x7fbf9c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:32.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.052+0000 7fbfab400640 1 -- 172.21.15.55:0/415606554 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fbfa40544b0 con 0x7fbfb40b36f0 2024-04-02T07:26:32.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.216+0000 7fbfb9800640 1 -- 172.21.15.55:0/415606554 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbfb4066c90 con 0x7fbfb40b36f0 2024-04-02T07:26:32.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.220+0000 7fbfab400640 1 -- 172.21.15.55:0/415606554 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16097 (secure 0 0 0) 0x7fbfa4054040 con 0x7fbfb40b36f0 2024-04-02T07:26:32.224 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:32.224 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":60,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:25:14.810503+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:25:12.332239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-02T07:25:12.785664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:26:32.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.220+0000 7fbfb9800640 1 -- 172.21.15.55:0/415606554 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbf90066690 msgr2=0x7fbf90068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:32.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.220+0000 7fbfb9800640 1 --2- 172.21.15.55:0/415606554 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbf90066690 0x7fbf90068b50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c0ae000 tx=0x7fbf9c0a7000 comp rx=0 tx=0).stop 2024-04-02T07:26:32.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.220+0000 7fbfb9800640 1 -- 172.21.15.55:0/415606554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfb40b36f0 msgr2=0x7fbfb4150cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:32.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.220+0000 7fbfb9800640 1 --2- 172.21.15.55:0/415606554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfb40b36f0 0x7fbfb4150cf0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fbfa400c480 tx=0x7fbfa400c940 comp rx=0 tx=0).stop 2024-04-02T07:26:32.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.220+0000 7fbfb9800640 1 -- 172.21.15.55:0/415606554 shutdown_connections 2024-04-02T07:26:32.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.220+0000 7fbfb9800640 1 --2- 172.21.15.55:0/415606554 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbf90066690 0x7fbf90068b50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.220+0000 7fbfb9800640 1 --2- 172.21.15.55:0/415606554 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbfb4153ea0 0x7fbfb414b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.220+0000 7fbfb9800640 1 --2- 172.21.15.55:0/415606554 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbfb40c4120 0x7fbfb414f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.220+0000 7fbfb9800640 1 --2- 172.21.15.55:0/415606554 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbfb40b36f0 0x7fbfb4150cf0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.220+0000 7fbfb9800640 1 -- 172.21.15.55:0/415606554 >> 172.21.15.55:0/415606554 conn(0x7fbfb4066080 msgr2=0x7fbfb4071a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:32.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.220+0000 7fbfb9800640 1 -- 172.21.15.55:0/415606554 shutdown_connections 2024-04-02T07:26:32.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.220+0000 7fbfb9800640 1 -- 172.21.15.55:0/415606554 wait complete. 2024-04-02T07:26:32.245 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:25:12.332239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:25:12.785664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:26:32.246 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:26:32.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.384+0000 7f149fe00640 1 Processor -- start 2024-04-02T07:26:32.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.384+0000 7f149fe00640 1 -- start start 2024-04-02T07:26:32.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.384+0000 7f149fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f14980b3dc0 0x7f14980ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:32.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.384+0000 7f149fe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14980ade90 0x7f149806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:32.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.384+0000 7f149fe00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149806c630 con 0x7f14980b41a0 2024-04-02T07:26:32.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.384+0000 7f149fe00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149806c8f0 con 0x7f14980b3dc0 2024-04-02T07:26:32.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.384+0000 7f149fe00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f149806cbd0 con 0x7f14980ade90 2024-04-02T07:26:32.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.384+0000 7f149d400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f14980b3dc0 0x7f14980ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:32.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.384+0000 7f149d400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f14980b3dc0 0x7f14980ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43268/0 (socket says 172.21.15.55:43268) 2024-04-02T07:26:32.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.384+0000 7f149d400640 1 -- 172.21.15.55:0/1487949651 learned_addr learned my addr 172.21.15.55:0/1487949651 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:32.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.384+0000 7f149ca00640 1 --2- 172.21.15.55:0/1487949651 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14980ade90 0x7f149806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:32.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.384+0000 7f149d400640 1 -- 172.21.15.55:0/1487949651 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14980ade90 msgr2=0x7f149806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:32.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.384+0000 7f149d400640 1 --2- 172.21.15.55:0/1487949651 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14980ade90 0x7f149806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.384+0000 7f149d400640 1 -- 172.21.15.55:0/1487949651 >> v1:172.21.15.106:6789/0 conn(0x7f14980b41a0 legacy=0x7f1498142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:32.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.384+0000 7f149d400640 1 -- 172.21.15.55:0/1487949651 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149806ceb0 con 0x7f14980b3dc0 2024-04-02T07:26:32.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.384+0000 7f149ca00640 1 --2- 172.21.15.55:0/1487949651 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14980ade90 0x7f149806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:32.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.388+0000 7f149d400640 1 --2- 172.21.15.55:0/1487949651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14980b3dc0 0x7f14980ca770 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f148c00bb10 tx=0x7f148c01eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40f0f1a5914ed38d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:32.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.388+0000 7f1497e00640 1 -- 172.21.15.55:0/1487949651 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0a7c60 con 0x7f14980b3dc0 2024-04-02T07:26:32.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.388+0000 7f1497e00640 1 -- 172.21.15.55:0/1487949651 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c0a7dc0 con 0x7f14980b3dc0 2024-04-02T07:26:32.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.388+0000 7f1497e00640 1 -- 172.21.15.55:0/1487949651 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0af660 con 0x7f14980b3dc0 2024-04-02T07:26:32.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.388+0000 7f149fe00640 1 -- 172.21.15.55:0/1487949651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14980b3dc0 msgr2=0x7f14980ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:32.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.388+0000 7f149fe00640 1 --2- 172.21.15.55:0/1487949651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14980b3dc0 0x7f14980ca770 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f148c00bb10 tx=0x7f148c01eb70 comp rx=0 tx=0).stop 2024-04-02T07:26:32.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.388+0000 7f149fe00640 1 -- 172.21.15.55:0/1487949651 shutdown_connections 2024-04-02T07:26:32.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.388+0000 7f149fe00640 1 --2- 172.21.15.55:0/1487949651 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14980ade90 0x7f149806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.388+0000 7f149fe00640 1 --2- 172.21.15.55:0/1487949651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14980b3dc0 0x7f14980ca770 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.388+0000 7f149fe00640 1 -- 172.21.15.55:0/1487949651 >> 172.21.15.55:0/1487949651 conn(0x7f149806a390 msgr2=0x7f14980b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:32.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.388+0000 7f149fe00640 1 -- 172.21.15.55:0/1487949651 shutdown_connections 2024-04-02T07:26:32.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.388+0000 7f149fe00640 1 -- 172.21.15.55:0/1487949651 wait complete. 2024-04-02T07:26:32.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149fe00640 1 Processor -- start 2024-04-02T07:26:32.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149fe00640 1 -- start start 2024-04-02T07:26:32.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14980ade90 0x7f14981521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:32.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149fe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14980b3dc0 0x7f1498157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:32.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14980b41a0 0x7f1498154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:32.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149fe00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1498150270 con 0x7f14980ade90 2024-04-02T07:26:32.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149fe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1498157a80 con 0x7f14980b41a0 2024-04-02T07:26:32.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149fe00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14981504e0 con 0x7f14980b3dc0 2024-04-02T07:26:32.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14980ade90 0x7f14981521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:32.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14980ade90 0x7f14981521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43274/0 (socket says 172.21.15.55:43274) 2024-04-02T07:26:32.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149d400640 1 -- 172.21.15.55:0/4075470897 learned_addr learned my addr 172.21.15.55:0/4075470897 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:32.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149ca00640 1 --2- 172.21.15.55:0/4075470897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14980b3dc0 0x7f1498157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:32.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149de00640 1 --2- 172.21.15.55:0/4075470897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14980b41a0 0x7f1498154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:32.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149d400640 1 -- 172.21.15.55:0/4075470897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14980b3dc0 msgr2=0x7f1498157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:32.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149d400640 1 --2- 172.21.15.55:0/4075470897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14980b3dc0 0x7f1498157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149d400640 1 -- 172.21.15.55:0/4075470897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14980b41a0 msgr2=0x7f1498154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:32.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149d400640 1 --2- 172.21.15.55:0/4075470897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14980b41a0 0x7f1498154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149d400640 1 -- 172.21.15.55:0/4075470897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148c00b770 con 0x7f14980ade90 2024-04-02T07:26:32.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149ca00640 1 --2- 172.21.15.55:0/4075470897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14980b3dc0 0x7f1498157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:26:32.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149de00640 1 --2- 172.21.15.55:0/4075470897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14980b41a0 0x7f1498154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:26:32.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149d400640 1 --2- 172.21.15.55:0/4075470897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14980ade90 0x7f14981521d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f148c00b2c0 tx=0x7f148c01b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:32.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f1495600640 1 -- 172.21.15.55:0/4075470897 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c006ee0 con 0x7f14980ade90 2024-04-02T07:26:32.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f1495600640 1 -- 172.21.15.55:0/4075470897 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f148c0ba420 con 0x7f14980ade90 2024-04-02T07:26:32.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f1495600640 1 -- 172.21.15.55:0/4075470897 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f148c0ba7d0 con 0x7f14980ade90 2024-04-02T07:26:32.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149fe00640 1 -- 172.21.15.55:0/4075470897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14981507c0 con 0x7f14980ade90 2024-04-02T07:26:32.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149fe00640 1 -- 172.21.15.55:0/4075470897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1498139450 con 0x7f14980ade90 2024-04-02T07:26:32.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.392+0000 7f149fe00640 1 -- 172.21.15.55:0/4075470897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1498073530 con 0x7f14980ade90 2024-04-02T07:26:32.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.396+0000 7f1495600640 1 -- 172.21.15.55:0/4075470897 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f148c0b6040 con 0x7f14980ade90 2024-04-02T07:26:32.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.396+0000 7f1495600640 1 --2- 172.21.15.55:0/4075470897 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f14780666c0 0x7f1478068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:32.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.396+0000 7f1495600640 1 -- 172.21.15.55:0/4075470897 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f148c121460 con 0x7f14980ade90 2024-04-02T07:26:32.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.396+0000 7f149ca00640 1 --2- 172.21.15.55:0/4075470897 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f14780666c0 0x7f1478068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:32.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.396+0000 7f149ca00640 1 --2- 172.21.15.55:0/4075470897 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f14780666c0 0x7f1478068b80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f14981f4c00 tx=0x7f1484008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:32.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.400+0000 7f1495600640 1 -- 172.21.15.55:0/4075470897 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f148c0ee6a0 con 0x7f14980ade90 2024-04-02T07:26:32.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.564+0000 7f149fe00640 1 -- 172.21.15.55:0/4075470897 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1498066c90 con 0x7f14980ade90 2024-04-02T07:26:32.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.564+0000 7f1495600640 1 -- 172.21.15.55:0/4075470897 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7f148c0f1cc0 con 0x7f14980ade90 2024-04-02T07:26:32.569 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:26:32.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.564+0000 7f149fe00640 1 -- 172.21.15.55:0/4075470897 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f14780666c0 msgr2=0x7f1478068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:32.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.564+0000 7f149fe00640 1 --2- 172.21.15.55:0/4075470897 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f14780666c0 0x7f1478068b80 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f14981f4c00 tx=0x7f1484008040 comp rx=0 tx=0).stop 2024-04-02T07:26:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.564+0000 7f149fe00640 1 -- 172.21.15.55:0/4075470897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14980ade90 msgr2=0x7f14981521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.564+0000 7f149fe00640 1 --2- 172.21.15.55:0/4075470897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14980ade90 0x7f14981521d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f148c00b2c0 tx=0x7f148c01b910 comp rx=0 tx=0).stop 2024-04-02T07:26:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.564+0000 7f149fe00640 1 -- 172.21.15.55:0/4075470897 shutdown_connections 2024-04-02T07:26:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.564+0000 7f149fe00640 1 --2- 172.21.15.55:0/4075470897 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f14780666c0 0x7f1478068b80 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.564+0000 7f149fe00640 1 --2- 172.21.15.55:0/4075470897 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14980b41a0 0x7f1498154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.564+0000 7f149fe00640 1 --2- 172.21.15.55:0/4075470897 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14980b3dc0 0x7f1498157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.564+0000 7f149fe00640 1 --2- 172.21.15.55:0/4075470897 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14980ade90 0x7f14981521d0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.564+0000 7f149fe00640 1 -- 172.21.15.55:0/4075470897 >> 172.21.15.55:0/4075470897 conn(0x7f149806a390 msgr2=0x7f14980af720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.564+0000 7f149fe00640 1 -- 172.21.15.55:0/4075470897 shutdown_connections 2024-04-02T07:26:32.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.564+0000 7f149fe00640 1 -- 172.21.15.55:0/4075470897 wait complete. 2024-04-02T07:26:32.590 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:26:32.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.728+0000 7f79f3a00640 1 Processor -- start 2024-04-02T07:26:32.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.728+0000 7f79f3a00640 1 -- start start 2024-04-02T07:26:32.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.728+0000 7f79f3a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f79ec15a9f0 0x7f79ec0cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:32.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.728+0000 7f79f3a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79ec0ce230 con 0x7f79ec0cbd30 2024-04-02T07:26:32.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.728+0000 7f79f3a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79ec0ce510 con 0x7f79ec099120 2024-04-02T07:26:32.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.728+0000 7f79f3a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79ec15add0 con 0x7f79ec15a9f0 2024-04-02T07:26:32.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.728+0000 7f79e3e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f79ec0cbd30 0x7f79ec098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46058/0 (socket says 172.21.15.55:46058) 2024-04-02T07:26:32.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.728+0000 7f79e3e00640 1 -- 172.21.15.55:0/632329699 learned_addr learned my addr 172.21.15.55:0/632329699 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:26:32.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.728+0000 7f79f1000640 1 --2- 172.21.15.55:0/632329699 >> v2:172.21.15.106:3300/0 conn(0x7f79ec15a9f0 0x7f79ec0cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:32.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.732+0000 7f79ebe00640 1 -- 172.21.15.55:0/632329699 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 211590454 0 0) 0x7f79ec0ce230 con 0x7f79ec0cbd30 2024-04-02T07:26:32.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.732+0000 7f79ebe00640 1 -- 172.21.15.55:0/632329699 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79d0003530 con 0x7f79ec0cbd30 2024-04-02T07:26:32.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.732+0000 7f79ebe00640 1 -- 172.21.15.55:0/632329699 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135730767 0 0) 0x7f79ec0ce510 con 0x7f79ec099120 2024-04-02T07:26:32.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.732+0000 7f79ebe00640 1 -- 172.21.15.55:0/632329699 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79ec0ce230 con 0x7f79ec099120 2024-04-02T07:26:32.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.732+0000 7f79f1000640 1 -- 172.21.15.55:0/632329699 >> v1:172.21.15.106:6789/0 conn(0x7f79ec099120 legacy=0x7f79ec0afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:32.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.732+0000 7f79f1000640 1 -- 172.21.15.55:0/632329699 >> v1:172.21.15.55:6789/0 conn(0x7f79ec0cbd30 legacy=0x7f79ec098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:32.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.732+0000 7f79ebe00640 1 -- 172.21.15.55:0/632329699 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1922039201 0 0) 0x7f79d0003530 con 0x7f79ec0cbd30 2024-04-02T07:26:32.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.732+0000 7f79f1000640 1 -- 172.21.15.55:0/632329699 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ec0ce7f0 con 0x7f79ec15a9f0 2024-04-02T07:26:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.732+0000 7f79f1000640 1 --2- 172.21.15.55:0/632329699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ec15a9f0 0x7f79ec0cf2d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0097c0 tx=0x7f79dc01c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e02101b7ad77d5a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.732+0000 7f79ebe00640 1 -- 172.21.15.55:0/632329699 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79d4001680 con 0x7f79ec15a9f0 2024-04-02T07:26:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.732+0000 7f79ebe00640 1 -- 172.21.15.55:0/632329699 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79dc0a7050 con 0x7f79ec15a9f0 2024-04-02T07:26:32.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.732+0000 7f79ebe00640 1 -- 172.21.15.55:0/632329699 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79dc0ab620 con 0x7f79ec15a9f0 2024-04-02T07:26:32.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f3a00640 1 -- 172.21.15.55:0/632329699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ec15a9f0 msgr2=0x7f79ec0cf2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:32.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f3a00640 1 --2- 172.21.15.55:0/632329699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ec15a9f0 0x7f79ec0cf2d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0097c0 tx=0x7f79dc01c3c0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f3a00640 1 -- 172.21.15.55:0/632329699 shutdown_connections 2024-04-02T07:26:32.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f3a00640 1 --2- 172.21.15.55:0/632329699 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ec15a9f0 0x7f79ec0cf2d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f3a00640 1 -- 172.21.15.55:0/632329699 >> 172.21.15.55:0/632329699 conn(0x7f79ec0b2150 msgr2=0x7f79ec0b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:32.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f3a00640 1 -- 172.21.15.55:0/632329699 shutdown_connections 2024-04-02T07:26:32.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f3a00640 1 -- 172.21.15.55:0/632329699 wait complete. 2024-04-02T07:26:32.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f3a00640 1 Processor -- start 2024-04-02T07:26:32.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f3a00640 1 -- start start 2024-04-02T07:26:32.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f3a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f79ec099120 0x7f79ec1517c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:32.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f3a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ec0cbd30 0x7f79ec0afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:32.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f3a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79ec15a9f0 0x7f79ec0b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:32.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f3a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec0b54b0 con 0x7f79ec15a9f0 2024-04-02T07:26:32.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f3a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec0b3280 con 0x7f79ec0cbd30 2024-04-02T07:26:32.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f3a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec0b3520 con 0x7f79ec099120 2024-04-02T07:26:32.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f1a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79ec15a9f0 0x7f79ec0b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:32.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f1a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79ec15a9f0 0x7f79ec0b39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43284/0 (socket says 172.21.15.55:43284) 2024-04-02T07:26:32.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f1a00640 1 -- 172.21.15.55:0/2412728361 learned_addr learned my addr 172.21.15.55:0/2412728361 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:32.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79e3e00640 1 --2- 172.21.15.55:0/2412728361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ec0cbd30 0x7f79ec0afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:32.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f1000640 1 --2- 172.21.15.55:0/2412728361 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f79ec099120 0x7f79ec1517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:32.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f1a00640 1 -- 172.21.15.55:0/2412728361 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f79ec099120 msgr2=0x7f79ec1517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:32.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f1a00640 1 --2- 172.21.15.55:0/2412728361 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f79ec099120 0x7f79ec1517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f1a00640 1 -- 172.21.15.55:0/2412728361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ec0cbd30 msgr2=0x7f79ec0afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:32.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f1a00640 1 --2- 172.21.15.55:0/2412728361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ec0cbd30 0x7f79ec0afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.736+0000 7f79f1a00640 1 -- 172.21.15.55:0/2412728361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc009420 con 0x7f79ec15a9f0 2024-04-02T07:26:32.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.740+0000 7f79f1a00640 1 --2- 172.21.15.55:0/2412728361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79ec15a9f0 0x7f79ec0b39b0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f79e400c730 tx=0x7f79e400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:32.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.740+0000 7f79e9600640 1 -- 172.21.15.55:0/2412728361 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e4003b80 con 0x7f79ec15a9f0 2024-04-02T07:26:32.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.740+0000 7f79e9600640 1 -- 172.21.15.55:0/2412728361 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e4003ce0 con 0x7f79ec15a9f0 2024-04-02T07:26:32.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.740+0000 7f79e9600640 1 -- 172.21.15.55:0/2412728361 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e400aa90 con 0x7f79ec15a9f0 2024-04-02T07:26:32.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.740+0000 7f79f3a00640 1 -- 172.21.15.55:0/2412728361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79ec0b4ef0 con 0x7f79ec15a9f0 2024-04-02T07:26:32.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.740+0000 7f79f3a00640 1 -- 172.21.15.55:0/2412728361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79ec151d00 con 0x7f79ec15a9f0 2024-04-02T07:26:32.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.740+0000 7f79f3a00640 1 -- 172.21.15.55:0/2412728361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79ec0b36b0 con 0x7f79ec15a9f0 2024-04-02T07:26:32.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.740+0000 7f79e9600640 1 -- 172.21.15.55:0/2412728361 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f79e400abf0 con 0x7f79ec15a9f0 2024-04-02T07:26:32.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.740+0000 7f79e9600640 1 --2- 172.21.15.55:0/2412728361 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f79c806aaa0 0x7f79c806cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:32.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.740+0000 7f79e9600640 1 -- 172.21.15.55:0/2412728361 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79e4084090 con 0x7f79ec15a9f0 2024-04-02T07:26:32.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.740+0000 7f79f1000640 1 --2- 172.21.15.55:0/2412728361 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f79c806aaa0 0x7f79c806cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:32.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.744+0000 7f79f1000640 1 --2- 172.21.15.55:0/2412728361 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f79c806aaa0 0x7f79c806cf60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0ad000 tx=0x7f79dc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:32.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.744+0000 7f79e9600640 1 -- 172.21.15.55:0/2412728361 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f79e4051360 con 0x7f79ec15a9f0 2024-04-02T07:26:32.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.904+0000 7f79f3a00640 1 -- 172.21.15.55:0/2412728361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f79ec066c90 con 0x7f79ec15a9f0 2024-04-02T07:26:32.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.904+0000 7f79e9600640 1 -- 172.21.15.55:0/2412728361 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7f79e4054980 con 0x7f79ec15a9f0 2024-04-02T07:26:32.910 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:26:32.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.908+0000 7f79f3a00640 1 -- 172.21.15.55:0/2412728361 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f79c806aaa0 msgr2=0x7f79c806cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:32.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.908+0000 7f79f3a00640 1 --2- 172.21.15.55:0/2412728361 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f79c806aaa0 0x7f79c806cf60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f79dc0ad000 tx=0x7f79dc008040 comp rx=0 tx=0).stop 2024-04-02T07:26:32.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.908+0000 7f79f3a00640 1 -- 172.21.15.55:0/2412728361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79ec15a9f0 msgr2=0x7f79ec0b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:32.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.908+0000 7f79f3a00640 1 --2- 172.21.15.55:0/2412728361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79ec15a9f0 0x7f79ec0b39b0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f79e400c730 tx=0x7f79e400cbf0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.908+0000 7f79f3a00640 1 -- 172.21.15.55:0/2412728361 shutdown_connections 2024-04-02T07:26:32.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.908+0000 7f79f3a00640 1 --2- 172.21.15.55:0/2412728361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f79ec15a9f0 0x7f79ec0b39b0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.908+0000 7f79f3a00640 1 --2- 172.21.15.55:0/2412728361 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f79c806aaa0 0x7f79c806cf60 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.908+0000 7f79f3a00640 1 --2- 172.21.15.55:0/2412728361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f79ec0cbd30 0x7f79ec0afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.908+0000 7f79f3a00640 1 --2- 172.21.15.55:0/2412728361 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f79ec099120 0x7f79ec1517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:32.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.908+0000 7f79f3a00640 1 -- 172.21.15.55:0/2412728361 >> 172.21.15.55:0/2412728361 conn(0x7f79ec0b2150 msgr2=0x7f79ec152f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:32.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.908+0000 7f79f3a00640 1 -- 172.21.15.55:0/2412728361 shutdown_connections 2024-04-02T07:26:32.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:32.908+0000 7f79f3a00640 1 -- 172.21.15.55:0/2412728361 wait complete. 2024-04-02T07:26:32.931 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:26:33.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.068+0000 7f2bf0200640 1 Processor -- start 2024-04-02T07:26:33.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.068+0000 7f2bf0200640 1 -- start start 2024-04-02T07:26:33.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.068+0000 7f2bf0200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2be80709b0 0x7f2be80b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:33.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.068+0000 7f2bf0200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be80b2fd0 0x7f2be80b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:33.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.068+0000 7f2bf0200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be815e3a0 con 0x7f2be8144260 2024-04-02T07:26:33.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.068+0000 7f2bf0200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be80b37c0 con 0x7f2be80709b0 2024-04-02T07:26:33.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.068+0000 7f2bf0200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be815e5f0 con 0x7f2be80b2fd0 2024-04-02T07:26:33.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.068+0000 7f2bece00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2be80709b0 0x7f2be80b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:33.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.068+0000 7f2bed800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2be8144260 0x7f2be80702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46068/0 (socket says 172.21.15.55:46068) 2024-04-02T07:26:33.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.068+0000 7f2bed800640 1 -- 172.21.15.55:0/4109009791 learned_addr learned my addr 172.21.15.55:0/4109009791 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:26:33.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.068+0000 7f2bee200640 1 --2- 172.21.15.55:0/4109009791 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be80b2fd0 0x7f2be80b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:33.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.068+0000 7f2bece00640 1 -- 172.21.15.55:0/4109009791 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be80b2fd0 msgr2=0x7f2be80b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:33.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.068+0000 7f2bece00640 1 --2- 172.21.15.55:0/4109009791 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be80b2fd0 0x7f2be80b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.068+0000 7f2bece00640 1 -- 172.21.15.55:0/4109009791 >> v1:172.21.15.55:6789/0 conn(0x7f2be8144260 legacy=0x7f2be80702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:33.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.068+0000 7f2bece00640 1 -- 172.21.15.55:0/4109009791 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be815e8d0 con 0x7f2be80709b0 2024-04-02T07:26:33.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.068+0000 7f2be7e00640 1 -- 172.21.15.55:0/4109009791 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2445908777 0 0) 0x7f2be815e3a0 con 0x7f2be8144260 2024-04-02T07:26:33.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.072+0000 7f2bece00640 1 --2- 172.21.15.55:0/4109009791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be80709b0 0x7f2be80b2a90 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40097c0 tx=0x7f2bd401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0d62e341790a933 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:33.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.072+0000 7f2be7e00640 1 -- 172.21.15.55:0/4109009791 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40ad640 con 0x7f2be80709b0 2024-04-02T07:26:33.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.072+0000 7f2be7e00640 1 -- 172.21.15.55:0/4109009791 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd40ad7a0 con 0x7f2be80709b0 2024-04-02T07:26:33.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.072+0000 7f2be7e00640 1 -- 172.21.15.55:0/4109009791 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd40adb30 con 0x7f2be80709b0 2024-04-02T07:26:33.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.072+0000 7f2bf0200640 1 -- 172.21.15.55:0/4109009791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be80709b0 msgr2=0x7f2be80b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:33.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.072+0000 7f2bf0200640 1 --2- 172.21.15.55:0/4109009791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be80709b0 0x7f2be80b2a90 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40097c0 tx=0x7f2bd401c4a0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.072+0000 7f2bf0200640 1 -- 172.21.15.55:0/4109009791 shutdown_connections 2024-04-02T07:26:33.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.072+0000 7f2bf0200640 1 --2- 172.21.15.55:0/4109009791 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be80b2fd0 0x7f2be80b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.072+0000 7f2bf0200640 1 --2- 172.21.15.55:0/4109009791 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be80709b0 0x7f2be80b2a90 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.072+0000 7f2bf0200640 1 -- 172.21.15.55:0/4109009791 >> 172.21.15.55:0/4109009791 conn(0x7f2be806a390 msgr2=0x7f2be80b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:33.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.072+0000 7f2bf0200640 1 -- 172.21.15.55:0/4109009791 shutdown_connections 2024-04-02T07:26:33.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.072+0000 7f2bf0200640 1 -- 172.21.15.55:0/4109009791 wait complete. 2024-04-02T07:26:33.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bf0200640 1 Processor -- start 2024-04-02T07:26:33.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bf0200640 1 -- start start 2024-04-02T07:26:33.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bf0200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be80709b0 0x7f2be813d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:33.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bf0200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be80b2fd0 0x7f2be8139e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:33.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bf0200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be8144260 0x7f2be813ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:33.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bf0200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be813da10 con 0x7f2be80709b0 2024-04-02T07:26:33.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bf0200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be815c120 con 0x7f2be80b2fd0 2024-04-02T07:26:33.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bf0200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be815c400 con 0x7f2be8144260 2024-04-02T07:26:33.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bed800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be80709b0 0x7f2be813d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:33.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bed800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be80709b0 0x7f2be813d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43302/0 (socket says 172.21.15.55:43302) 2024-04-02T07:26:33.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bed800640 1 -- 172.21.15.55:0/2069824799 learned_addr learned my addr 172.21.15.55:0/2069824799 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:33.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bece00640 1 --2- 172.21.15.55:0/2069824799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be80b2fd0 0x7f2be8139e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:33.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bee200640 1 --2- 172.21.15.55:0/2069824799 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be8144260 0x7f2be813ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:33.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bed800640 1 -- 172.21.15.55:0/2069824799 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be8144260 msgr2=0x7f2be813ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:33.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bed800640 1 --2- 172.21.15.55:0/2069824799 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be8144260 0x7f2be813ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bed800640 1 -- 172.21.15.55:0/2069824799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be80b2fd0 msgr2=0x7f2be8139e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:33.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bed800640 1 --2- 172.21.15.55:0/2069824799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be80b2fd0 0x7f2be8139e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bed800640 1 -- 172.21.15.55:0/2069824799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd4009420 con 0x7f2be80709b0 2024-04-02T07:26:33.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bed800640 1 --2- 172.21.15.55:0/2069824799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be80709b0 0x7f2be813d4d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc00c480 tx=0x7f2bdc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:33.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2be5600640 1 -- 172.21.15.55:0/2069824799 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc0074e0 con 0x7f2be80709b0 2024-04-02T07:26:33.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2be5600640 1 -- 172.21.15.55:0/2069824799 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bdc007660 con 0x7f2be80709b0 2024-04-02T07:26:33.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2be5600640 1 -- 172.21.15.55:0/2069824799 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bdc004a30 con 0x7f2be80709b0 2024-04-02T07:26:33.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bf0200640 1 -- 172.21.15.55:0/2069824799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be815c6e0 con 0x7f2be80709b0 2024-04-02T07:26:33.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.076+0000 7f2bf0200640 1 -- 172.21.15.55:0/2069824799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be813a390 con 0x7f2be80709b0 2024-04-02T07:26:33.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.080+0000 7f2bf0200640 1 -- 172.21.15.55:0/2069824799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be8073530 con 0x7f2be80709b0 2024-04-02T07:26:33.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.080+0000 7f2be5600640 1 -- 172.21.15.55:0/2069824799 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2bdc004b90 con 0x7f2be80709b0 2024-04-02T07:26:33.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.080+0000 7f2be5600640 1 --2- 172.21.15.55:0/2069824799 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2bc8066690 0x7f2bc8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:33.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.080+0000 7f2be5600640 1 -- 172.21.15.55:0/2069824799 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2bdc0832b0 con 0x7f2be80709b0 2024-04-02T07:26:33.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.080+0000 7f2bece00640 1 --2- 172.21.15.55:0/2069824799 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2bc8066690 0x7f2bc8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:33.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.080+0000 7f2bece00640 1 --2- 172.21.15.55:0/2069824799 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2bc8066690 0x7f2bc8068b50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40af000 tx=0x7f2bd4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:33.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.084+0000 7f2be5600640 1 -- 172.21.15.55:0/2069824799 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2bdc054150 con 0x7f2be80709b0 2024-04-02T07:26:33.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.248+0000 7f2bf0200640 1 -- 172.21.15.55:0/2069824799 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2be8066c90 con 0x7f2be80709b0 2024-04-02T07:26:33.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.248+0000 7f2be5600640 1 -- 172.21.15.55:0/2069824799 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2bdc018020 con 0x7f2be80709b0 2024-04-02T07:26:33.252 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:26:33.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.248+0000 7f2bf0200640 1 -- 172.21.15.55:0/2069824799 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2bc8066690 msgr2=0x7f2bc8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:33.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.248+0000 7f2bf0200640 1 --2- 172.21.15.55:0/2069824799 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2bc8066690 0x7f2bc8068b50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2bd40af000 tx=0x7f2bd4008040 comp rx=0 tx=0).stop 2024-04-02T07:26:33.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.248+0000 7f2bf0200640 1 -- 172.21.15.55:0/2069824799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be80709b0 msgr2=0x7f2be813d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:33.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.248+0000 7f2bf0200640 1 --2- 172.21.15.55:0/2069824799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be80709b0 0x7f2be813d4d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f2bdc00c480 tx=0x7f2bdc00c940 comp rx=0 tx=0).stop 2024-04-02T07:26:33.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.248+0000 7f2bf0200640 1 -- 172.21.15.55:0/2069824799 shutdown_connections 2024-04-02T07:26:33.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.248+0000 7f2bf0200640 1 --2- 172.21.15.55:0/2069824799 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be8144260 0x7f2be813ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.248+0000 7f2bf0200640 1 --2- 172.21.15.55:0/2069824799 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2bc8066690 0x7f2bc8068b50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.248+0000 7f2bf0200640 1 --2- 172.21.15.55:0/2069824799 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be80b2fd0 0x7f2be8139e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.248+0000 7f2bf0200640 1 --2- 172.21.15.55:0/2069824799 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be80709b0 0x7f2be813d4d0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.248+0000 7f2bf0200640 1 -- 172.21.15.55:0/2069824799 >> 172.21.15.55:0/2069824799 conn(0x7f2be806a390 msgr2=0x7f2be80ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:33.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.248+0000 7f2bf0200640 1 -- 172.21.15.55:0/2069824799 shutdown_connections 2024-04-02T07:26:33.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.248+0000 7f2bf0200640 1 -- 172.21.15.55:0/2069824799 wait complete. 2024-04-02T07:26:33.274 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:26:33.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.408+0000 7f7e74a00640 1 Processor -- start 2024-04-02T07:26:33.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.412+0000 7f7e74a00640 1 -- start start 2024-04-02T07:26:33.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.412+0000 7f7e74a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e700cb5b0 0x7f7e7006ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:33.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.412+0000 7f7e74a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e700af920 0x7f7e7006cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:33.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.412+0000 7f7e74a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e700c9ff0 con 0x7f7e7015aad0 2024-04-02T07:26:33.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.412+0000 7f7e74a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e700c93e0 con 0x7f7e700cb5b0 2024-04-02T07:26:33.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.412+0000 7f7e74a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e700c96c0 con 0x7f7e700af920 2024-04-02T07:26:33.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.412+0000 7f7e67e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e700cb5b0 0x7f7e7006ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:33.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.412+0000 7f7e67e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e700cb5b0 0x7f7e7006ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43304/0 (socket says 172.21.15.55:43304) 2024-04-02T07:26:33.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.412+0000 7f7e67e00640 1 -- 172.21.15.55:0/2883098143 learned_addr learned my addr 172.21.15.55:0/2883098143 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:33.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.412+0000 7f7e6e800640 1 --2- 172.21.15.55:0/2883098143 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e700af920 0x7f7e7006cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:33.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.412+0000 7f7e67e00640 1 -- 172.21.15.55:0/2883098143 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e700af920 msgr2=0x7f7e7006cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:33.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.412+0000 7f7e67e00640 1 --2- 172.21.15.55:0/2883098143 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e700af920 0x7f7e7006cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.412+0000 7f7e67e00640 1 -- 172.21.15.55:0/2883098143 >> v1:172.21.15.106:6789/0 conn(0x7f7e7015aad0 legacy=0x7f7e700caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:33.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.412+0000 7f7e67e00640 1 -- 172.21.15.55:0/2883098143 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e700c99a0 con 0x7f7e700cb5b0 2024-04-02T07:26:33.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.416+0000 7f7e67e00640 1 --2- 172.21.15.55:0/2883098143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e700cb5b0 0x7f7e7006ca00 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009870 tx=0x7f7e5801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=531dee49d7981b3f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:33.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.416+0000 7f7e6d400640 1 -- 172.21.15.55:0/2883098143 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e580aa620 con 0x7f7e700cb5b0 2024-04-02T07:26:33.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.416+0000 7f7e6d400640 1 -- 172.21.15.55:0/2883098143 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e580aa780 con 0x7f7e700cb5b0 2024-04-02T07:26:33.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.416+0000 7f7e6d400640 1 -- 172.21.15.55:0/2883098143 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e580aab10 con 0x7f7e700cb5b0 2024-04-02T07:26:33.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.416+0000 7f7e74a00640 1 -- 172.21.15.55:0/2883098143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e700cb5b0 msgr2=0x7f7e7006ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:33.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.416+0000 7f7e74a00640 1 --2- 172.21.15.55:0/2883098143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e700cb5b0 0x7f7e7006ca00 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f7e58009870 tx=0x7f7e5801c4a0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.416+0000 7f7e74a00640 1 -- 172.21.15.55:0/2883098143 shutdown_connections 2024-04-02T07:26:33.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.416+0000 7f7e74a00640 1 --2- 172.21.15.55:0/2883098143 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e700af920 0x7f7e7006cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.416+0000 7f7e74a00640 1 --2- 172.21.15.55:0/2883098143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e700cb5b0 0x7f7e7006ca00 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.416+0000 7f7e74a00640 1 -- 172.21.15.55:0/2883098143 >> 172.21.15.55:0/2883098143 conn(0x7f7e70069d90 msgr2=0x7f7e7006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:33.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.416+0000 7f7e74a00640 1 -- 172.21.15.55:0/2883098143 shutdown_connections 2024-04-02T07:26:33.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.416+0000 7f7e74a00640 1 -- 172.21.15.55:0/2883098143 wait complete. 2024-04-02T07:26:33.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e74a00640 1 Processor -- start 2024-04-02T07:26:33.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e74a00640 1 -- start start 2024-04-02T07:26:33.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e74a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e700af920 0x7f7e70145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:33.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e74a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e700cb5b0 0x7f7e700c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:33.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e74a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e7015aad0 0x7f7e700c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:33.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e74a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e70155430 con 0x7f7e700af920 2024-04-02T07:26:33.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e74a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e70155710 con 0x7f7e700cb5b0 2024-04-02T07:26:33.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e74a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e701559f0 con 0x7f7e7015aad0 2024-04-02T07:26:33.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e6de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e700af920 0x7f7e70145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:33.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e6de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e700af920 0x7f7e70145fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43314/0 (socket says 172.21.15.55:43314) 2024-04-02T07:26:33.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e6de00640 1 -- 172.21.15.55:0/2087740069 learned_addr learned my addr 172.21.15.55:0/2087740069 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:33.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e6e800640 1 --2- 172.21.15.55:0/2087740069 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e7015aad0 0x7f7e700c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:33.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e67e00640 1 --2- 172.21.15.55:0/2087740069 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e700cb5b0 0x7f7e700c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:33.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e6de00640 1 -- 172.21.15.55:0/2087740069 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e7015aad0 msgr2=0x7f7e700c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:33.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e6de00640 1 --2- 172.21.15.55:0/2087740069 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e7015aad0 0x7f7e700c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e6de00640 1 -- 172.21.15.55:0/2087740069 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e700cb5b0 msgr2=0x7f7e700c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:33.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e6de00640 1 --2- 172.21.15.55:0/2087740069 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e700cb5b0 0x7f7e700c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e6de00640 1 -- 172.21.15.55:0/2087740069 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e580094d0 con 0x7f7e700af920 2024-04-02T07:26:33.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e6de00640 1 --2- 172.21.15.55:0/2087740069 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e700af920 0x7f7e70145fb0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000c500 tx=0x7f7e6000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:33.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e66000640 1 -- 172.21.15.55:0/2087740069 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60005220 con 0x7f7e700af920 2024-04-02T07:26:33.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e66000640 1 -- 172.21.15.55:0/2087740069 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e60005380 con 0x7f7e700af920 2024-04-02T07:26:33.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e66000640 1 -- 172.21.15.55:0/2087740069 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e60007270 con 0x7f7e700af920 2024-04-02T07:26:33.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e74a00640 1 -- 172.21.15.55:0/2087740069 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e70155cd0 con 0x7f7e700af920 2024-04-02T07:26:33.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.420+0000 7f7e74a00640 1 -- 172.21.15.55:0/2087740069 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e70155140 con 0x7f7e700af920 2024-04-02T07:26:33.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.424+0000 7f7e74a00640 1 -- 172.21.15.55:0/2087740069 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e7006e240 con 0x7f7e700af920 2024-04-02T07:26:33.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.424+0000 7f7e66000640 1 -- 172.21.15.55:0/2087740069 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7e600073d0 con 0x7f7e700af920 2024-04-02T07:26:33.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.424+0000 7f7e66000640 1 --2- 172.21.15.55:0/2087740069 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e4c066690 0x7f7e4c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:33.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.424+0000 7f7e66000640 1 -- 172.21.15.55:0/2087740069 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e600839e0 con 0x7f7e700af920 2024-04-02T07:26:33.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.424+0000 7f7e67e00640 1 --2- 172.21.15.55:0/2087740069 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e4c066690 0x7f7e4c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:33.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.424+0000 7f7e67e00640 1 --2- 172.21.15.55:0/2087740069 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e4c066690 0x7f7e4c068b50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7e580ae000 tx=0x7f7e580b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:33.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.428+0000 7f7e66000640 1 -- 172.21.15.55:0/2087740069 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7e60050d70 con 0x7f7e700af920 2024-04-02T07:26:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.600+0000 7f7e74a00640 1 -- 172.21.15.55:0/2087740069 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f7e70066c90 con 0x7f7e700af920 2024-04-02T07:26:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.600+0000 7f7e66000640 1 -- 172.21.15.55:0/2087740069 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v60) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7e60054390 con 0x7f7e700af920 2024-04-02T07:26:33.607 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:26:33.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.604+0000 7f7e74a00640 1 -- 172.21.15.55:0/2087740069 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e4c066690 msgr2=0x7f7e4c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:33.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.604+0000 7f7e74a00640 1 --2- 172.21.15.55:0/2087740069 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e4c066690 0x7f7e4c068b50 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7e580ae000 tx=0x7f7e580b5040 comp rx=0 tx=0).stop 2024-04-02T07:26:33.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.604+0000 7f7e74a00640 1 -- 172.21.15.55:0/2087740069 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e700af920 msgr2=0x7f7e70145fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:33.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.604+0000 7f7e74a00640 1 --2- 172.21.15.55:0/2087740069 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e700af920 0x7f7e70145fb0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000c500 tx=0x7f7e6000c9c0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.604+0000 7f7e74a00640 1 -- 172.21.15.55:0/2087740069 shutdown_connections 2024-04-02T07:26:33.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.604+0000 7f7e74a00640 1 --2- 172.21.15.55:0/2087740069 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e7015aad0 0x7f7e700c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.604+0000 7f7e74a00640 1 --2- 172.21.15.55:0/2087740069 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e4c066690 0x7f7e4c068b50 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.604+0000 7f7e74a00640 1 --2- 172.21.15.55:0/2087740069 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e700cb5b0 0x7f7e700c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.604+0000 7f7e74a00640 1 --2- 172.21.15.55:0/2087740069 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e700af920 0x7f7e70145fb0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:33.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.604+0000 7f7e74a00640 1 -- 172.21.15.55:0/2087740069 >> 172.21.15.55:0/2087740069 conn(0x7f7e70069d90 msgr2=0x7f7e7006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:33.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.604+0000 7f7e74a00640 1 -- 172.21.15.55:0/2087740069 shutdown_connections 2024-04-02T07:26:33.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:33.604+0000 7f7e74a00640 1 -- 172.21.15.55:0/2087740069 wait complete. 2024-04-02T07:26:33.628 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi055.front.sepia.ceph.com... 2024-04-02T07:26:33.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:26:33.629 DEBUG:teuthology.orchestra.run.smithi055:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-02T07:26:33.647 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[41155]: fuse finished with error 0 and tester_r 0 2024-04-02T07:26:33.649 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:26:33.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:26:33.650 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-02T07:26:33.816 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:26:33.816 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:26:33.825 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:26:33.825 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:26:33.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:26:33.826 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-02T07:26:33.879 INFO:teuthology.orchestra.run.smithi106.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-04-02T07:26:33.880 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:26:33.880 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:26:33.880 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:26:33.890 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:26:33.890 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:26:33.890 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:26:33.890 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-02T07:26:33.939 INFO:teuthology.orchestra.run.smithi055.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-04-02T07:26:33.939 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:26:33.940 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:26:33.940 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:26:33.948 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:26:33.948 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:26:33.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:26:33.948 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-02T07:26:33.999 INFO:teuthology.orchestra.run.smithi106.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-04-02T07:26:34.000 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:26:34.001 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:26:34.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.136+0000 7f5b4a800640 1 Processor -- start 2024-04-02T07:26:34.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.136+0000 7f5b4a800640 1 -- start start 2024-04-02T07:26:34.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.136+0000 7f5b4a800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5b440b16e0 0x7f5b440b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:34.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.136+0000 7f5b4a800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b440b11f0 0x7f5b44098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:34.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.136+0000 7f5b4a800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b440d01d0 con 0x7f5b440cfdf0 2024-04-02T07:26:34.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.136+0000 7f5b4a800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b4406c0e0 con 0x7f5b440b16e0 2024-04-02T07:26:34.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.136+0000 7f5b4a800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b440b01d0 con 0x7f5b440b11f0 2024-04-02T07:26:34.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.136+0000 7f5b3aa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5b440b16e0 0x7f5b440b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:34.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.136+0000 7f5b3aa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5b440b16e0 0x7f5b440b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43330/0 (socket says 172.21.15.55:43330) 2024-04-02T07:26:34.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.136+0000 7f5b3aa00640 1 -- 172.21.15.55:0/1821204891 learned_addr learned my addr 172.21.15.55:0/1821204891 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:34.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.136+0000 7f5b43e00640 1 --2- 172.21.15.55:0/1821204891 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b440b11f0 0x7f5b44098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:34.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.136+0000 7f5b3aa00640 1 -- 172.21.15.55:0/1821204891 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b440b11f0 msgr2=0x7f5b44098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:34.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.136+0000 7f5b3aa00640 1 --2- 172.21.15.55:0/1821204891 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b440b11f0 0x7f5b44098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.136+0000 7f5b3aa00640 1 -- 172.21.15.55:0/1821204891 >> v1:172.21.15.106:6789/0 conn(0x7f5b440cfdf0 legacy=0x7f5b4406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:34.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.136+0000 7f5b3aa00640 1 -- 172.21.15.55:0/1821204891 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b440b04b0 con 0x7f5b440b16e0 2024-04-02T07:26:34.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.140+0000 7f5b3aa00640 1 --2- 172.21.15.55:0/1821204891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b440b16e0 0x7f5b440b0cb0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009870 tx=0x7f5b2c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9851e23dee76dd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:34.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.140+0000 7f5b42a00640 1 -- 172.21.15.55:0/1821204891 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c0ab640 con 0x7f5b440b16e0 2024-04-02T07:26:34.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.140+0000 7f5b42a00640 1 -- 172.21.15.55:0/1821204891 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b2c0a7070 con 0x7f5b440b16e0 2024-04-02T07:26:34.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.140+0000 7f5b42a00640 1 -- 172.21.15.55:0/1821204891 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2c0ab9c0 con 0x7f5b440b16e0 2024-04-02T07:26:34.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.140+0000 7f5b4a800640 1 -- 172.21.15.55:0/1821204891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b440b16e0 msgr2=0x7f5b440b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:34.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.140+0000 7f5b4a800640 1 --2- 172.21.15.55:0/1821204891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b440b16e0 0x7f5b440b0cb0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c009870 tx=0x7f5b2c01c530 comp rx=0 tx=0).stop 2024-04-02T07:26:34.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.140+0000 7f5b4a800640 1 -- 172.21.15.55:0/1821204891 shutdown_connections 2024-04-02T07:26:34.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.140+0000 7f5b4a800640 1 --2- 172.21.15.55:0/1821204891 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b440b11f0 0x7f5b44098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.140+0000 7f5b4a800640 1 --2- 172.21.15.55:0/1821204891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b440b16e0 0x7f5b440b0cb0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.140+0000 7f5b4a800640 1 -- 172.21.15.55:0/1821204891 >> 172.21.15.55:0/1821204891 conn(0x7f5b440b2210 msgr2=0x7f5b440b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:34.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.140+0000 7f5b4a800640 1 -- 172.21.15.55:0/1821204891 shutdown_connections 2024-04-02T07:26:34.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.140+0000 7f5b4a800640 1 -- 172.21.15.55:0/1821204891 wait complete. 2024-04-02T07:26:34.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b4a800640 1 Processor -- start 2024-04-02T07:26:34.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b4a800640 1 -- start start 2024-04-02T07:26:34.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b4a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b440b11f0 0x7f5b441486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:34.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b4a800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b440b16e0 0x7f5b4414d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:34.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b4a800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b440cfdf0 0x7f5b4414acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:34.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b4a800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4414a820 con 0x7f5b440b11f0 2024-04-02T07:26:34.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b4a800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b44148c20 con 0x7f5b440cfdf0 2024-04-02T07:26:34.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b4a800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b44149f30 con 0x7f5b440b16e0 2024-04-02T07:26:34.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b43400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b440b11f0 0x7f5b441486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:34.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b43400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b440b11f0 0x7f5b441486e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43340/0 (socket says 172.21.15.55:43340) 2024-04-02T07:26:34.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b43400640 1 -- 172.21.15.55:0/173644334 learned_addr learned my addr 172.21.15.55:0/173644334 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:34.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b43e00640 1 --2- 172.21.15.55:0/173644334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b440cfdf0 0x7f5b4414acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:34.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b3aa00640 1 --2- 172.21.15.55:0/173644334 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b440b16e0 0x7f5b4414d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:34.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b43400640 1 -- 172.21.15.55:0/173644334 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b440b16e0 msgr2=0x7f5b4414d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:34.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b43400640 1 --2- 172.21.15.55:0/173644334 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b440b16e0 0x7f5b4414d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b43400640 1 -- 172.21.15.55:0/173644334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b440cfdf0 msgr2=0x7f5b4414acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:34.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b43400640 1 --2- 172.21.15.55:0/173644334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b440cfdf0 0x7f5b4414acb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b43400640 1 -- 172.21.15.55:0/173644334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b2c0094d0 con 0x7f5b440b11f0 2024-04-02T07:26:34.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b43400640 1 --2- 172.21.15.55:0/173644334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b440b11f0 0x7f5b441486e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5b3400c3f0 tx=0x7f5b3400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:34.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b3be00640 1 -- 172.21.15.55:0/173644334 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b340052d0 con 0x7f5b440b11f0 2024-04-02T07:26:34.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b3be00640 1 -- 172.21.15.55:0/173644334 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b34005430 con 0x7f5b440b11f0 2024-04-02T07:26:34.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b3be00640 1 -- 172.21.15.55:0/173644334 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b34003840 con 0x7f5b440b11f0 2024-04-02T07:26:34.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b4a800640 1 -- 172.21.15.55:0/173644334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b4414a1d0 con 0x7f5b440b11f0 2024-04-02T07:26:34.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.144+0000 7f5b4a800640 1 -- 172.21.15.55:0/173644334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b4414e190 con 0x7f5b440b11f0 2024-04-02T07:26:34.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.148+0000 7f5b4a800640 1 -- 172.21.15.55:0/173644334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b44066c90 con 0x7f5b440b11f0 2024-04-02T07:26:34.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.148+0000 7f5b3be00640 1 -- 172.21.15.55:0/173644334 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5b340039a0 con 0x7f5b440b11f0 2024-04-02T07:26:34.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.148+0000 7f5b3be00640 1 --2- 172.21.15.55:0/173644334 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5b20066690 0x7f5b20068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:34.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.148+0000 7f5b3be00640 1 -- 172.21.15.55:0/173644334 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b340834c0 con 0x7f5b440b11f0 2024-04-02T07:26:34.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.148+0000 7f5b3aa00640 1 --2- 172.21.15.55:0/173644334 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5b20066690 0x7f5b20068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:34.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.148+0000 7f5b3aa00640 1 --2- 172.21.15.55:0/173644334 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5b20066690 0x7f5b20068b50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0af000 tx=0x7f5b2c0b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:34.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.152+0000 7f5b3be00640 1 -- 172.21.15.55:0/173644334 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5b340508d0 con 0x7f5b440b11f0 2024-04-02T07:26:34.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.344+0000 7f5b4a800640 1 -- 172.21.15.55:0/173644334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b440d01d0 con 0x7f5b440b11f0 2024-04-02T07:26:34.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.344+0000 7f5b3be00640 1 -- 172.21.15.55:0/173644334 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4741 (secure 0 0 0) 0x7f5b440d01d0 con 0x7f5b440b11f0 2024-04-02T07:26:34.352 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:34.352 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5510,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3429221899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3429221899},{"type":"v1","addr":"172.21.15.55:6835","nonce":3429221899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5513,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/4033456774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4033456774},{"type":"v1","addr":"172.21.15.106:6836","nonce":4033456774}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6129,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2170345840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2170345840},{"type":"v1","addr":"172.21.15.55:6834","nonce":2170345840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:25:13.807869+0000","modified":"2024-04-02T07:26:06.283152+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6138":{"gid":6138,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":16,"addr":"172.21.15.106:6837/1050953219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1050953219},{"type":"v1","addr":"172.21.15.106:6837","nonce":1050953219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-02T07:26:34.352 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 35 2024-04-02T07:26:34.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.348+0000 7f5b4a800640 1 -- 172.21.15.55:0/173644334 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5b20066690 msgr2=0x7f5b20068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:34.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.348+0000 7f5b4a800640 1 --2- 172.21.15.55:0/173644334 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5b20066690 0x7f5b20068b50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5b2c0af000 tx=0x7f5b2c0b6040 comp rx=0 tx=0).stop 2024-04-02T07:26:34.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.348+0000 7f5b4a800640 1 -- 172.21.15.55:0/173644334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b440b11f0 msgr2=0x7f5b441486e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:34.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.348+0000 7f5b4a800640 1 --2- 172.21.15.55:0/173644334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b440b11f0 0x7f5b441486e0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5b3400c3f0 tx=0x7f5b3400c8b0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.348+0000 7f5b4a800640 1 -- 172.21.15.55:0/173644334 shutdown_connections 2024-04-02T07:26:34.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.348+0000 7f5b4a800640 1 --2- 172.21.15.55:0/173644334 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5b20066690 0x7f5b20068b50 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.348+0000 7f5b4a800640 1 --2- 172.21.15.55:0/173644334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5b440cfdf0 0x7f5b4414acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.348+0000 7f5b4a800640 1 --2- 172.21.15.55:0/173644334 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5b440b16e0 0x7f5b4414d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.348+0000 7f5b4a800640 1 --2- 172.21.15.55:0/173644334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5b440b11f0 0x7f5b441486e0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.348+0000 7f5b4a800640 1 -- 172.21.15.55:0/173644334 >> 172.21.15.55:0/173644334 conn(0x7f5b440b2210 msgr2=0x7f5b44157400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:34.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.348+0000 7f5b4a800640 1 -- 172.21.15.55:0/173644334 shutdown_connections 2024-04-02T07:26:34.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.348+0000 7f5b4a800640 1 -- 172.21.15.55:0/173644334 wait complete. 2024-04-02T07:26:34.374 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:26:34.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.508+0000 7fbe29200640 1 Processor -- start 2024-04-02T07:26:34.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.508+0000 7fbe29200640 1 -- start start 2024-04-02T07:26:34.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.508+0000 7fbe29200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbe2415a480 0x7fbe240ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:34.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.508+0000 7fbe29200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe240ca9a0 0x7fbe240b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:34.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.508+0000 7fbe29200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbe240b0ea0 0x7fbe24160460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:34.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.508+0000 7fbe29200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe2415a860 con 0x7fbe240b0ea0 2024-04-02T07:26:34.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.508+0000 7fbe29200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe2415ce20 con 0x7fbe2415a480 2024-04-02T07:26:34.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.508+0000 7fbe29200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe240cade0 con 0x7fbe240ca9a0 2024-04-02T07:26:34.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.512+0000 7fbe22800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbe240b0ea0 0x7fbe24160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:34.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.512+0000 7fbe22800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbe240b0ea0 0x7fbe24160460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43356/0 (socket says 172.21.15.55:43356) 2024-04-02T07:26:34.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.512+0000 7fbe22800640 1 -- 172.21.15.55:0/985150129 learned_addr learned my addr 172.21.15.55:0/985150129 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:34.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.512+0000 7fbe21e00640 1 --2- 172.21.15.55:0/985150129 >> v2:172.21.15.106:3300/0 conn(0x7fbe2415a480 0x7fbe240ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:34.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.512+0000 7fbe1be00640 1 --2- 172.21.15.55:0/985150129 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe240ca9a0 0x7fbe240b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:34.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.512+0000 7fbe22800640 1 -- 172.21.15.55:0/985150129 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe240ca9a0 msgr2=0x7fbe240b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:34.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.512+0000 7fbe22800640 1 --2- 172.21.15.55:0/985150129 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe240ca9a0 0x7fbe240b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.512+0000 7fbe22800640 1 -- 172.21.15.55:0/985150129 >> v2:172.21.15.106:3300/0 conn(0x7fbe2415a480 msgr2=0x7fbe240ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:34.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.512+0000 7fbe22800640 1 --2- 172.21.15.55:0/985150129 >> v2:172.21.15.106:3300/0 conn(0x7fbe2415a480 0x7fbe240ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.512+0000 7fbe22800640 1 -- 172.21.15.55:0/985150129 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe240b1330 con 0x7fbe240b0ea0 2024-04-02T07:26:34.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.512+0000 7fbe21e00640 1 --2- 172.21.15.55:0/985150129 >> v2:172.21.15.106:3300/0 conn(0x7fbe2415a480 0x7fbe240ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:34.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.512+0000 7fbe22800640 1 --2- 172.21.15.55:0/985150129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe240b0ea0 0x7fbe24160460 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fbe2406e4e0 tx=0x7fbe1c01c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc698e71ba6af588 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:34.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.512+0000 7fbe21400640 1 -- 172.21.15.55:0/985150129 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c0a64b0 con 0x7fbe240b0ea0 2024-04-02T07:26:34.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.512+0000 7fbe21400640 1 -- 172.21.15.55:0/985150129 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1c0a6610 con 0x7fbe240b0ea0 2024-04-02T07:26:34.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.512+0000 7fbe21400640 1 -- 172.21.15.55:0/985150129 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c0a69a0 con 0x7fbe240b0ea0 2024-04-02T07:26:34.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe29200640 1 -- 172.21.15.55:0/985150129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe240b0ea0 msgr2=0x7fbe24160460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:34.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe29200640 1 --2- 172.21.15.55:0/985150129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe240b0ea0 0x7fbe24160460 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fbe2406e4e0 tx=0x7fbe1c01c730 comp rx=0 tx=0).stop 2024-04-02T07:26:34.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe29200640 1 -- 172.21.15.55:0/985150129 shutdown_connections 2024-04-02T07:26:34.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe29200640 1 --2- 172.21.15.55:0/985150129 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe240b0ea0 0x7fbe24160460 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe29200640 1 --2- 172.21.15.55:0/985150129 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe240ca9a0 0x7fbe240b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe29200640 1 --2- 172.21.15.55:0/985150129 >> v2:172.21.15.106:3300/0 conn(0x7fbe2415a480 0x7fbe240ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe29200640 1 -- 172.21.15.55:0/985150129 >> 172.21.15.55:0/985150129 conn(0x7fbe24066080 msgr2=0x7fbe24069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:34.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe29200640 1 -- 172.21.15.55:0/985150129 shutdown_connections 2024-04-02T07:26:34.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe29200640 1 -- 172.21.15.55:0/985150129 wait complete. 2024-04-02T07:26:34.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe29200640 1 Processor -- start 2024-04-02T07:26:34.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe29200640 1 -- start start 2024-04-02T07:26:34.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe29200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe240b0ea0 0x7fbe24157a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:34.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe29200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe240ca9a0 0x7fbe2414b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:34.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe29200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe2415a480 0x7fbe2414f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:34.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe29200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe240b3470 con 0x7fbe240b0ea0 2024-04-02T07:26:34.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe29200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe240b27f0 con 0x7fbe2415a480 2024-04-02T07:26:34.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe29200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe240b2ad0 con 0x7fbe240ca9a0 2024-04-02T07:26:34.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe21e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe240b0ea0 0x7fbe24157a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:34.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe21e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe240b0ea0 0x7fbe24157a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43368/0 (socket says 172.21.15.55:43368) 2024-04-02T07:26:34.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe21e00640 1 -- 172.21.15.55:0/280901385 learned_addr learned my addr 172.21.15.55:0/280901385 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:34.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe1be00640 1 --2- 172.21.15.55:0/280901385 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe240ca9a0 0x7fbe2414b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:34.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe22800640 1 --2- 172.21.15.55:0/280901385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe2415a480 0x7fbe2414f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:34.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe21e00640 1 -- 172.21.15.55:0/280901385 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe240ca9a0 msgr2=0x7fbe2414b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:34.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe21e00640 1 --2- 172.21.15.55:0/280901385 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe240ca9a0 0x7fbe2414b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe21e00640 1 -- 172.21.15.55:0/280901385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe2415a480 msgr2=0x7fbe2414f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:34.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe21e00640 1 --2- 172.21.15.55:0/280901385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe2415a480 0x7fbe2414f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe21e00640 1 -- 172.21.15.55:0/280901385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe1c009b30 con 0x7fbe240b0ea0 2024-04-02T07:26:34.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.516+0000 7fbe21e00640 1 --2- 172.21.15.55:0/280901385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe240b0ea0 0x7fbe24157a80 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400d800 tx=0x7fbe1400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:34.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.520+0000 7fbe1a000640 1 -- 172.21.15.55:0/280901385 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe140096c0 con 0x7fbe240b0ea0 2024-04-02T07:26:34.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.520+0000 7fbe1a000640 1 -- 172.21.15.55:0/280901385 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe14009820 con 0x7fbe240b0ea0 2024-04-02T07:26:34.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.520+0000 7fbe1a000640 1 -- 172.21.15.55:0/280901385 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe14009bd0 con 0x7fbe240b0ea0 2024-04-02T07:26:34.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.520+0000 7fbe29200640 1 -- 172.21.15.55:0/280901385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe240b2db0 con 0x7fbe240b0ea0 2024-04-02T07:26:34.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.520+0000 7fbe29200640 1 -- 172.21.15.55:0/280901385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2414bdb0 con 0x7fbe240b0ea0 2024-04-02T07:26:34.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.520+0000 7fbe29200640 1 -- 172.21.15.55:0/280901385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe24066c90 con 0x7fbe240b0ea0 2024-04-02T07:26:34.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.520+0000 7fbe1a000640 1 -- 172.21.15.55:0/280901385 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fbe14009d30 con 0x7fbe240b0ea0 2024-04-02T07:26:34.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.520+0000 7fbe1a000640 1 --2- 172.21.15.55:0/280901385 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbe00066690 0x7fbe00068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:34.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.520+0000 7fbe1a000640 1 -- 172.21.15.55:0/280901385 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbe14084720 con 0x7fbe240b0ea0 2024-04-02T07:26:34.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.520+0000 7fbe1be00640 1 --2- 172.21.15.55:0/280901385 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbe00066690 0x7fbe00068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:34.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.520+0000 7fbe1be00640 1 --2- 172.21.15.55:0/280901385 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbe00066690 0x7fbe00068b50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbe240c9b40 tx=0x7fbe0c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:34.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.524+0000 7fbe1a000640 1 -- 172.21.15.55:0/280901385 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fbe14051b30 con 0x7fbe240b0ea0 2024-04-02T07:26:34.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.684+0000 7fbe29200640 1 -- 172.21.15.55:0/280901385 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbe240b3af0 con 0x7fbe240b0ea0 2024-04-02T07:26:34.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.688+0000 7fbe1a000640 1 -- 172.21.15.55:0/280901385 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16097 (secure 0 0 0) 0x7fbe14055150 con 0x7fbe240b0ea0 2024-04-02T07:26:34.692 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:34.692 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":60,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:25:14.810503+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:25:12.332239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-02T07:25:12.785664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:26:34.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.688+0000 7fbe29200640 1 -- 172.21.15.55:0/280901385 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbe00066690 msgr2=0x7fbe00068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:34.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.688+0000 7fbe29200640 1 --2- 172.21.15.55:0/280901385 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbe00066690 0x7fbe00068b50 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fbe240c9b40 tx=0x7fbe0c008040 comp rx=0 tx=0).stop 2024-04-02T07:26:34.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.688+0000 7fbe29200640 1 -- 172.21.15.55:0/280901385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe240b0ea0 msgr2=0x7fbe24157a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:34.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.688+0000 7fbe29200640 1 --2- 172.21.15.55:0/280901385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe240b0ea0 0x7fbe24157a80 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fbe1400d800 tx=0x7fbe1400dcc0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.688+0000 7fbe29200640 1 -- 172.21.15.55:0/280901385 shutdown_connections 2024-04-02T07:26:34.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.688+0000 7fbe29200640 1 --2- 172.21.15.55:0/280901385 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbe00066690 0x7fbe00068b50 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.688+0000 7fbe29200640 1 --2- 172.21.15.55:0/280901385 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbe2415a480 0x7fbe2414f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.688+0000 7fbe29200640 1 --2- 172.21.15.55:0/280901385 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbe240ca9a0 0x7fbe2414b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.688+0000 7fbe29200640 1 --2- 172.21.15.55:0/280901385 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe240b0ea0 0x7fbe24157a80 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.688+0000 7fbe29200640 1 -- 172.21.15.55:0/280901385 >> 172.21.15.55:0/280901385 conn(0x7fbe24066080 msgr2=0x7fbe240cd230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:34.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.688+0000 7fbe29200640 1 -- 172.21.15.55:0/280901385 shutdown_connections 2024-04-02T07:26:34.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.688+0000 7fbe29200640 1 -- 172.21.15.55:0/280901385 wait complete. 2024-04-02T07:26:34.714 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:25:12.332239+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '59', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:25:12.785664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:26:34.715 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:26:34.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.852+0000 7fb681600640 1 Processor -- start 2024-04-02T07:26:34.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.852+0000 7fb681600640 1 -- start start 2024-04-02T07:26:34.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.852+0000 7fb681600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb67c0709b0 0x7fb67c0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:34.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.852+0000 7fb681600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb67c0b2fd0 0x7fb67c0b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:34.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.852+0000 7fb681600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb67c15e3a0 con 0x7fb67c144260 2024-04-02T07:26:34.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.852+0000 7fb681600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb67c0b37c0 con 0x7fb67c0b2fd0 2024-04-02T07:26:34.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.852+0000 7fb681600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb67c15e5f0 con 0x7fb67c0709b0 2024-04-02T07:26:34.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.852+0000 7fb67b400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb67c0b2fd0 0x7fb67c0b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:34.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.852+0000 7fb67b400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb67c0b2fd0 0x7fb67c0b1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43380/0 (socket says 172.21.15.55:43380) 2024-04-02T07:26:34.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.852+0000 7fb67b400640 1 -- 172.21.15.55:0/967480756 learned_addr learned my addr 172.21.15.55:0/967480756 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:34.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.852+0000 7fb67a000640 1 --2- 172.21.15.55:0/967480756 >> v2:172.21.15.106:3300/0 conn(0x7fb67c0709b0 0x7fb67c0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:34.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.856+0000 7fb67b400640 1 -- 172.21.15.55:0/967480756 >> v2:172.21.15.106:3300/0 conn(0x7fb67c0709b0 msgr2=0x7fb67c0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:34.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.856+0000 7fb67b400640 1 --2- 172.21.15.55:0/967480756 >> v2:172.21.15.106:3300/0 conn(0x7fb67c0709b0 0x7fb67c0b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.856+0000 7fb67b400640 1 -- 172.21.15.55:0/967480756 >> v1:172.21.15.106:6789/0 conn(0x7fb67c144260 legacy=0x7fb67c0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:34.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.856+0000 7fb67b400640 1 -- 172.21.15.55:0/967480756 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb67c15e8d0 con 0x7fb67c0b2fd0 2024-04-02T07:26:34.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.856+0000 7fb67b400640 1 --2- 172.21.15.55:0/967480756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb67c0b2fd0 0x7fb67c0b1670 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fb67c0b1410 tx=0x7fb67401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176b4d9b2dbb5b20 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:34.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.856+0000 7fb679600640 1 -- 172.21.15.55:0/967480756 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6740ab610 con 0x7fb67c0b2fd0 2024-04-02T07:26:34.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.856+0000 7fb679600640 1 -- 172.21.15.55:0/967480756 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6740ab770 con 0x7fb67c0b2fd0 2024-04-02T07:26:34.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.856+0000 7fb679600640 1 -- 172.21.15.55:0/967480756 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6740abb00 con 0x7fb67c0b2fd0 2024-04-02T07:26:34.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.856+0000 7fb681600640 1 -- 172.21.15.55:0/967480756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb67c0b2fd0 msgr2=0x7fb67c0b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:34.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.856+0000 7fb681600640 1 --2- 172.21.15.55:0/967480756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb67c0b2fd0 0x7fb67c0b1670 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fb67c0b1410 tx=0x7fb67401c520 comp rx=0 tx=0).stop 2024-04-02T07:26:34.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.856+0000 7fb681600640 1 -- 172.21.15.55:0/967480756 shutdown_connections 2024-04-02T07:26:34.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.856+0000 7fb681600640 1 --2- 172.21.15.55:0/967480756 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb67c0b2fd0 0x7fb67c0b1670 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.856+0000 7fb681600640 1 --2- 172.21.15.55:0/967480756 >> v2:172.21.15.106:3300/0 conn(0x7fb67c0709b0 0x7fb67c0b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.856+0000 7fb681600640 1 -- 172.21.15.55:0/967480756 >> 172.21.15.55:0/967480756 conn(0x7fb67c06a390 msgr2=0x7fb67c0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:34.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.856+0000 7fb681600640 1 -- 172.21.15.55:0/967480756 shutdown_connections 2024-04-02T07:26:34.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.856+0000 7fb681600640 1 -- 172.21.15.55:0/967480756 wait complete. 2024-04-02T07:26:34.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb681600640 1 Processor -- start 2024-04-02T07:26:34.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb681600640 1 -- start start 2024-04-02T07:26:34.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb681600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb67c0709b0 0x7fb67c136e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:34.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb681600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb67c0b2fd0 0x7fb67c155290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:34.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb681600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb67c144260 0x7fb67c1564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:34.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb681600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c154b20 con 0x7fb67c144260 2024-04-02T07:26:34.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb681600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c154e00 con 0x7fb67c0709b0 2024-04-02T07:26:34.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb681600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67c1373d0 con 0x7fb67c0b2fd0 2024-04-02T07:26:34.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb67b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb67c144260 0x7fb67c1564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:34.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb67b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb67c144260 0x7fb67c1564e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43388/0 (socket says 172.21.15.55:43388) 2024-04-02T07:26:34.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb67b400640 1 -- 172.21.15.55:0/916875744 learned_addr learned my addr 172.21.15.55:0/916875744 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:34.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb67aa00640 1 --2- 172.21.15.55:0/916875744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb67c0709b0 0x7fb67c136e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:34.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb67a000640 1 --2- 172.21.15.55:0/916875744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb67c0b2fd0 0x7fb67c155290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:34.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb67b400640 1 -- 172.21.15.55:0/916875744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb67c0b2fd0 msgr2=0x7fb67c155290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:34.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb67b400640 1 --2- 172.21.15.55:0/916875744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb67c0b2fd0 0x7fb67c155290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb67b400640 1 -- 172.21.15.55:0/916875744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb67c0709b0 msgr2=0x7fb67c136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:34.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb67b400640 1 --2- 172.21.15.55:0/916875744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb67c0709b0 0x7fb67c136e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:34.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb67b400640 1 -- 172.21.15.55:0/916875744 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6740094d0 con 0x7fb67c144260 2024-04-02T07:26:34.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb67b400640 1 --2- 172.21.15.55:0/916875744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb67c144260 0x7fb67c1564e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb67401a150 tx=0x7fb67401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:34.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb672a00640 1 -- 172.21.15.55:0/916875744 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6740be5f0 con 0x7fb67c144260 2024-04-02T07:26:34.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb672a00640 1 -- 172.21.15.55:0/916875744 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6740be770 con 0x7fb67c144260 2024-04-02T07:26:34.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb672a00640 1 -- 172.21.15.55:0/916875744 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6740beb20 con 0x7fb67c144260 2024-04-02T07:26:34.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb681600640 1 -- 172.21.15.55:0/916875744 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb67c159d60 con 0x7fb67c144260 2024-04-02T07:26:34.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.860+0000 7fb681600640 1 -- 172.21.15.55:0/916875744 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb67c15a320 con 0x7fb67c144260 2024-04-02T07:26:34.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.864+0000 7fb681600640 1 -- 172.21.15.55:0/916875744 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb67c073530 con 0x7fb67c144260 2024-04-02T07:26:34.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.864+0000 7fb672a00640 1 -- 172.21.15.55:0/916875744 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb6740b43f0 con 0x7fb67c144260 2024-04-02T07:26:34.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.864+0000 7fb672a00640 1 --2- 172.21.15.55:0/916875744 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb65c0666c0 0x7fb65c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:34.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.864+0000 7fb672a00640 1 -- 172.21.15.55:0/916875744 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb67411e700 con 0x7fb67c144260 2024-04-02T07:26:34.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.864+0000 7fb67aa00640 1 --2- 172.21.15.55:0/916875744 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb65c0666c0 0x7fb65c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:34.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.868+0000 7fb67aa00640 1 --2- 172.21.15.55:0/916875744 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb65c0666c0 0x7fb65c068b80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0012f0 tx=0x7fb66c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:34.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:34.868+0000 7fb672a00640 1 -- 172.21.15.55:0/916875744 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fb6740eba80 con 0x7fb67c144260 2024-04-02T07:26:35.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.028+0000 7fb681600640 1 -- 172.21.15.55:0/916875744 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb67c154fb0 con 0x7fb67c144260 2024-04-02T07:26:35.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.028+0000 7fb672a00640 1 -- 172.21.15.55:0/916875744 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v60) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb67c154fb0 con 0x7fb67c144260 2024-04-02T07:26:35.035 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:26:35.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.032+0000 7fb681600640 1 -- 172.21.15.55:0/916875744 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb65c0666c0 msgr2=0x7fb65c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:35.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.032+0000 7fb681600640 1 --2- 172.21.15.55:0/916875744 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb65c0666c0 0x7fb65c068b80 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb66c0012f0 tx=0x7fb66c009040 comp rx=0 tx=0).stop 2024-04-02T07:26:35.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.032+0000 7fb681600640 1 -- 172.21.15.55:0/916875744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb67c144260 msgr2=0x7fb67c1564e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:35.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.032+0000 7fb681600640 1 --2- 172.21.15.55:0/916875744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb67c144260 0x7fb67c1564e0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb67401a150 tx=0x7fb67401ad60 comp rx=0 tx=0).stop 2024-04-02T07:26:35.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.032+0000 7fb681600640 1 -- 172.21.15.55:0/916875744 shutdown_connections 2024-04-02T07:26:35.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.032+0000 7fb681600640 1 --2- 172.21.15.55:0/916875744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb67c144260 0x7fb67c1564e0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.032+0000 7fb681600640 1 --2- 172.21.15.55:0/916875744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb67c0b2fd0 0x7fb67c155290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.032+0000 7fb681600640 1 --2- 172.21.15.55:0/916875744 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb65c0666c0 0x7fb65c068b80 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.032+0000 7fb681600640 1 --2- 172.21.15.55:0/916875744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb67c0709b0 0x7fb67c136e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.032+0000 7fb681600640 1 -- 172.21.15.55:0/916875744 >> 172.21.15.55:0/916875744 conn(0x7fb67c06a390 msgr2=0x7fb67c1406c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:35.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.032+0000 7fb681600640 1 -- 172.21.15.55:0/916875744 shutdown_connections 2024-04-02T07:26:35.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.032+0000 7fb681600640 1 -- 172.21.15.55:0/916875744 wait complete. 2024-04-02T07:26:35.056 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:26:35.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.192+0000 7f5cb9c00640 1 Processor -- start 2024-04-02T07:26:35.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.192+0000 7f5cb9c00640 1 -- start start 2024-04-02T07:26:35.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.196+0000 7f5cb9c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5cb4098a10 0x7f5cb4098e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:35.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.196+0000 7f5cb9c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5cb406b920 0x7f5cb406bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:35.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.196+0000 7f5cb9c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cb415ce40 con 0x7f5cb415ca60 2024-04-02T07:26:35.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.196+0000 7f5cb9c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb40993c0 con 0x7f5cb4098a10 2024-04-02T07:26:35.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.196+0000 7f5cb9c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cb40ceeb0 con 0x7f5cb406b920 2024-04-02T07:26:35.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.196+0000 7f5caa000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5cb4098a10 0x7f5cb4098e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:35.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.196+0000 7f5caa000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5cb4098a10 0x7f5cb4098e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43404/0 (socket says 172.21.15.55:43404) 2024-04-02T07:26:35.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.196+0000 7f5caa000640 1 -- 172.21.15.55:0/4257305853 learned_addr learned my addr 172.21.15.55:0/4257305853 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:35.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.196+0000 7f5cb3400640 1 --2- 172.21.15.55:0/4257305853 >> v2:172.21.15.106:3300/0 conn(0x7f5cb406b920 0x7f5cb406bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:35.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.196+0000 7f5caa000640 1 -- 172.21.15.55:0/4257305853 >> v2:172.21.15.106:3300/0 conn(0x7f5cb406b920 msgr2=0x7f5cb406bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:35.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.196+0000 7f5caa000640 1 --2- 172.21.15.55:0/4257305853 >> v2:172.21.15.106:3300/0 conn(0x7f5cb406b920 0x7f5cb406bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.196+0000 7f5caa000640 1 -- 172.21.15.55:0/4257305853 >> v1:172.21.15.106:6789/0 conn(0x7f5cb415ca60 legacy=0x7f5cb40cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:35.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.196+0000 7f5caa000640 1 -- 172.21.15.55:0/4257305853 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb40cf190 con 0x7f5cb4098a10 2024-04-02T07:26:35.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.196+0000 7f5cb3400640 1 --2- 172.21.15.55:0/4257305853 >> v2:172.21.15.106:3300/0 conn(0x7f5cb406b920 0x7f5cb406bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:35.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.200+0000 7f5caa000640 1 --2- 172.21.15.55:0/4257305853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cb4098a10 0x7f5cb4098e80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5cb409e5a0 tx=0x7f5c9c01c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b402f98e8e92d487 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:35.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.200+0000 7f5cb2000640 1 -- 172.21.15.55:0/4257305853 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c0ab620 con 0x7f5cb4098a10 2024-04-02T07:26:35.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.200+0000 7f5cb2000640 1 -- 172.21.15.55:0/4257305853 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c0ab780 con 0x7f5cb4098a10 2024-04-02T07:26:35.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.200+0000 7f5cb2000640 1 -- 172.21.15.55:0/4257305853 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c0abb10 con 0x7f5cb4098a10 2024-04-02T07:26:35.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.200+0000 7f5cb9c00640 1 -- 172.21.15.55:0/4257305853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cb4098a10 msgr2=0x7f5cb4098e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:35.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.200+0000 7f5cb9c00640 1 --2- 172.21.15.55:0/4257305853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cb4098a10 0x7f5cb4098e80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f5cb409e5a0 tx=0x7f5c9c01c420 comp rx=0 tx=0).stop 2024-04-02T07:26:35.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.200+0000 7f5cb9c00640 1 -- 172.21.15.55:0/4257305853 shutdown_connections 2024-04-02T07:26:35.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.200+0000 7f5cb9c00640 1 --2- 172.21.15.55:0/4257305853 >> v2:172.21.15.106:3300/0 conn(0x7f5cb406b920 0x7f5cb406bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.200+0000 7f5cb9c00640 1 --2- 172.21.15.55:0/4257305853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cb4098a10 0x7f5cb4098e80 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.200+0000 7f5cb9c00640 1 -- 172.21.15.55:0/4257305853 >> 172.21.15.55:0/4257305853 conn(0x7f5cb40b2150 msgr2=0x7f5cb40b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:35.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.200+0000 7f5cb9c00640 1 -- 172.21.15.55:0/4257305853 shutdown_connections 2024-04-02T07:26:35.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.200+0000 7f5cb9c00640 1 -- 172.21.15.55:0/4257305853 wait complete. 2024-04-02T07:26:35.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.200+0000 7f5cb9c00640 1 Processor -- start 2024-04-02T07:26:35.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.200+0000 7f5cb9c00640 1 -- start start 2024-04-02T07:26:35.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5cb9c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5cb406b920 0x7f5cb40b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:35.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5cb9c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cb4098a10 0x7f5cb415acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:35.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5cb9c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cb415ca60 0x7f5cb41546f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:35.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5cb9c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb40c8aa0 con 0x7f5cb4098a10 2024-04-02T07:26:35.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5cb9c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb40b43e0 con 0x7f5cb415ca60 2024-04-02T07:26:35.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5cb9c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cb40c8c80 con 0x7f5cb406b920 2024-04-02T07:26:35.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5caa000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cb4098a10 0x7f5cb415acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:35.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5caa000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cb4098a10 0x7f5cb415acc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43418/0 (socket says 172.21.15.55:43418) 2024-04-02T07:26:35.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5caa000640 1 -- 172.21.15.55:0/3637887097 learned_addr learned my addr 172.21.15.55:0/3637887097 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:35.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5cb3400640 1 --2- 172.21.15.55:0/3637887097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cb415ca60 0x7f5cb41546f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:35.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5cb2a00640 1 --2- 172.21.15.55:0/3637887097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5cb406b920 0x7f5cb40b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:35.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5caa000640 1 -- 172.21.15.55:0/3637887097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5cb406b920 msgr2=0x7f5cb40b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:35.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5caa000640 1 --2- 172.21.15.55:0/3637887097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5cb406b920 0x7f5cb40b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5caa000640 1 -- 172.21.15.55:0/3637887097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cb415ca60 msgr2=0x7f5cb41546f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:35.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5caa000640 1 --2- 172.21.15.55:0/3637887097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cb415ca60 0x7f5cb41546f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5caa000640 1 -- 172.21.15.55:0/3637887097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c9c0094d0 con 0x7f5cb4098a10 2024-04-02T07:26:35.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5caa000640 1 --2- 172.21.15.55:0/3637887097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cb4098a10 0x7f5cb415acc0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c01aad0 tx=0x7f5c9c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:35.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5cab400640 1 -- 172.21.15.55:0/3637887097 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c0be3f0 con 0x7f5cb4098a10 2024-04-02T07:26:35.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5cab400640 1 -- 172.21.15.55:0/3637887097 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c0be570 con 0x7f5cb4098a10 2024-04-02T07:26:35.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5cb9c00640 1 -- 172.21.15.55:0/3637887097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cb40c8f60 con 0x7f5cb4098a10 2024-04-02T07:26:35.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5cab400640 1 -- 172.21.15.55:0/3637887097 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c0be920 con 0x7f5cb4098a10 2024-04-02T07:26:35.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5cb9c00640 1 -- 172.21.15.55:0/3637887097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cb40c9520 con 0x7f5cb4098a10 2024-04-02T07:26:35.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5cb9c00640 1 -- 172.21.15.55:0/3637887097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cb4066c90 con 0x7f5cb4098a10 2024-04-02T07:26:35.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.204+0000 7f5cab400640 1 -- 172.21.15.55:0/3637887097 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5c9c0bea80 con 0x7f5cb4098a10 2024-04-02T07:26:35.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.208+0000 7f5cab400640 1 --2- 172.21.15.55:0/3637887097 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5c900666c0 0x7f5c90068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:35.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.208+0000 7f5cab400640 1 -- 172.21.15.55:0/3637887097 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c9c11ea00 con 0x7f5cb4098a10 2024-04-02T07:26:35.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.208+0000 7f5cb2a00640 1 --2- 172.21.15.55:0/3637887097 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5c900666c0 0x7f5c90068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:35.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.208+0000 7f5cb2a00640 1 --2- 172.21.15.55:0/3637887097 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5c900666c0 0x7f5c90068b80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5cb40ca730 tx=0x7f5ca4009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:35.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.212+0000 7f5cab400640 1 -- 172.21.15.55:0/3637887097 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5c9c0ebe10 con 0x7f5cb4098a10 2024-04-02T07:26:35.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.372+0000 7f5cb9c00640 1 -- 172.21.15.55:0/3637887097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5cb40b2ff0 con 0x7f5cb4098a10 2024-04-02T07:26:35.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.372+0000 7f5cab400640 1 -- 172.21.15.55:0/3637887097 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v60) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5c9c0ef430 con 0x7f5cb4098a10 2024-04-02T07:26:35.451 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:26:35.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.376+0000 7f5cb9c00640 1 -- 172.21.15.55:0/3637887097 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5c900666c0 msgr2=0x7f5c90068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:35.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.376+0000 7f5cb9c00640 1 --2- 172.21.15.55:0/3637887097 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5c900666c0 0x7f5c90068b80 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f5cb40ca730 tx=0x7f5ca4009060 comp rx=0 tx=0).stop 2024-04-02T07:26:35.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.376+0000 7f5cb9c00640 1 -- 172.21.15.55:0/3637887097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cb4098a10 msgr2=0x7f5cb415acc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:35.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.376+0000 7f5cb9c00640 1 --2- 172.21.15.55:0/3637887097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cb4098a10 0x7f5cb415acc0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c01aad0 tx=0x7f5c9c01ac60 comp rx=0 tx=0).stop 2024-04-02T07:26:35.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.376+0000 7f5cb9c00640 1 -- 172.21.15.55:0/3637887097 shutdown_connections 2024-04-02T07:26:35.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.376+0000 7f5cb9c00640 1 --2- 172.21.15.55:0/3637887097 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5c900666c0 0x7f5c90068b80 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.376+0000 7f5cb9c00640 1 --2- 172.21.15.55:0/3637887097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cb415ca60 0x7f5cb41546f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.376+0000 7f5cb9c00640 1 --2- 172.21.15.55:0/3637887097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cb4098a10 0x7f5cb415acc0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.376+0000 7f5cb9c00640 1 --2- 172.21.15.55:0/3637887097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5cb406b920 0x7f5cb40b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.376+0000 7f5cb9c00640 1 -- 172.21.15.55:0/3637887097 >> 172.21.15.55:0/3637887097 conn(0x7f5cb40b2150 msgr2=0x7f5cb40afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:35.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.376+0000 7f5cb9c00640 1 -- 172.21.15.55:0/3637887097 shutdown_connections 2024-04-02T07:26:35.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.376+0000 7f5cb9c00640 1 -- 172.21.15.55:0/3637887097 wait complete. 2024-04-02T07:26:35.453 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:26:35.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.588+0000 7fa7d6600640 1 Processor -- start 2024-04-02T07:26:35.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.588+0000 7fa7d6600640 1 -- start start 2024-04-02T07:26:35.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.592+0000 7fa7d6600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa7d0144260 0x7fa7d00702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:35.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.592+0000 7fa7d6600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d00b31a0 0x7fa7d00b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:35.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.592+0000 7fa7d6600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7d0070c90 con 0x7fa7d00707e0 2024-04-02T07:26:35.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.592+0000 7fa7d6600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7d00b35b0 con 0x7fa7d0144260 2024-04-02T07:26:35.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.592+0000 7fa7d6600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d00b37c0 con 0x7fa7d00b31a0 2024-04-02T07:26:35.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.592+0000 7fa7cf400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa7d0144260 0x7fa7d00702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:35.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.592+0000 7fa7cf400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa7d0144260 0x7fa7d00702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42242/0 (socket says 172.21.15.55:42242) 2024-04-02T07:26:35.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.592+0000 7fa7cf400640 1 -- 172.21.15.55:0/1640282345 learned_addr learned my addr 172.21.15.55:0/1640282345 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:35.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.592+0000 7fa7cfe00640 1 --2- 172.21.15.55:0/1640282345 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d00b31a0 0x7fa7d00b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:35.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.592+0000 7fa7cf400640 1 -- 172.21.15.55:0/1640282345 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d00b31a0 msgr2=0x7fa7d00b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:35.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.592+0000 7fa7cf400640 1 --2- 172.21.15.55:0/1640282345 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d00b31a0 0x7fa7d00b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.592+0000 7fa7cf400640 1 -- 172.21.15.55:0/1640282345 >> v1:172.21.15.106:6789/0 conn(0x7fa7d00707e0 legacy=0x7fa7d00b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:35.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.592+0000 7fa7cf400640 1 -- 172.21.15.55:0/1640282345 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d015e3a0 con 0x7fa7d0144260 2024-04-02T07:26:35.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.596+0000 7fa7cf400640 1 --2- 172.21.15.55:0/1640282345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7d0144260 0x7fa7d00702a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0009870 tx=0x7fa7c001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f05ff73897432888 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:35.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.596+0000 7fa7cea00640 1 -- 172.21.15.55:0/1640282345 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c00ab650 con 0x7fa7d0144260 2024-04-02T07:26:35.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.596+0000 7fa7cea00640 1 -- 172.21.15.55:0/1640282345 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c00ab7b0 con 0x7fa7d0144260 2024-04-02T07:26:35.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.596+0000 7fa7cea00640 1 -- 172.21.15.55:0/1640282345 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c00abb40 con 0x7fa7d0144260 2024-04-02T07:26:35.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.596+0000 7fa7d6600640 1 -- 172.21.15.55:0/1640282345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7d0144260 msgr2=0x7fa7d00702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:35.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.596+0000 7fa7d6600640 1 --2- 172.21.15.55:0/1640282345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7d0144260 0x7fa7d00702a0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa7c0009870 tx=0x7fa7c001c560 comp rx=0 tx=0).stop 2024-04-02T07:26:35.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.596+0000 7fa7d6600640 1 -- 172.21.15.55:0/1640282345 shutdown_connections 2024-04-02T07:26:35.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.596+0000 7fa7d6600640 1 --2- 172.21.15.55:0/1640282345 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d00b31a0 0x7fa7d00b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.596+0000 7fa7d6600640 1 --2- 172.21.15.55:0/1640282345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7d0144260 0x7fa7d00702a0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.596+0000 7fa7d6600640 1 -- 172.21.15.55:0/1640282345 >> 172.21.15.55:0/1640282345 conn(0x7fa7d006a390 msgr2=0x7fa7d00b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:35.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.596+0000 7fa7d6600640 1 -- 172.21.15.55:0/1640282345 shutdown_connections 2024-04-02T07:26:35.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.596+0000 7fa7d6600640 1 -- 172.21.15.55:0/1640282345 wait complete. 2024-04-02T07:26:35.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.596+0000 7fa7d6600640 1 Processor -- start 2024-04-02T07:26:35.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.596+0000 7fa7d6600640 1 -- start start 2024-04-02T07:26:35.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.596+0000 7fa7d6600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7d00707e0 0x7fa7d0155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:35.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.596+0000 7fa7d6600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7d00b31a0 0x7fa7d01f8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:35.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.596+0000 7fa7d6600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d0144260 0x7fa7d0141090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:35.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.596+0000 7fa7d6600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d013a9d0 con 0x7fa7d00707e0 2024-04-02T07:26:35.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.596+0000 7fa7d6600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d0141920 con 0x7fa7d00b31a0 2024-04-02T07:26:35.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7d6600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7d0141c00 con 0x7fa7d0144260 2024-04-02T07:26:35.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7cf400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7d00707e0 0x7fa7d0155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:35.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7cf400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7d00707e0 0x7fa7d0155d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42250/0 (socket says 172.21.15.55:42250) 2024-04-02T07:26:35.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7cf400640 1 -- 172.21.15.55:0/586991049 learned_addr learned my addr 172.21.15.55:0/586991049 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:35.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7c7e00640 1 --2- 172.21.15.55:0/586991049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7d00b31a0 0x7fa7d01f8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:35.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7cfe00640 1 --2- 172.21.15.55:0/586991049 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d0144260 0x7fa7d0141090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:35.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7cf400640 1 -- 172.21.15.55:0/586991049 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d0144260 msgr2=0x7fa7d0141090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7cf400640 1 --2- 172.21.15.55:0/586991049 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d0144260 0x7fa7d0141090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7cf400640 1 -- 172.21.15.55:0/586991049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7d00b31a0 msgr2=0x7fa7d01f8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7cf400640 1 --2- 172.21.15.55:0/586991049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7d00b31a0 0x7fa7d01f8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7cf400640 1 -- 172.21.15.55:0/586991049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7c00094d0 con 0x7fa7d00707e0 2024-04-02T07:26:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7cfe00640 1 --2- 172.21.15.55:0/586991049 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d0144260 0x7fa7d0141090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7cf400640 1 --2- 172.21.15.55:0/586991049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7d00707e0 0x7fa7d0155d90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa7c001a190 tx=0x7fa7c001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7c7400640 1 -- 172.21.15.55:0/586991049 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c00b4800 con 0x7fa7d00707e0 2024-04-02T07:26:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7c7400640 1 -- 172.21.15.55:0/586991049 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7c00b4980 con 0x7fa7d00707e0 2024-04-02T07:26:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7c7400640 1 -- 172.21.15.55:0/586991049 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7c00b4d30 con 0x7fa7d00707e0 2024-04-02T07:26:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7d6600640 1 -- 172.21.15.55:0/586991049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7d0141ee0 con 0x7fa7d00707e0 2024-04-02T07:26:35.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7d6600640 1 -- 172.21.15.55:0/586991049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7d01424a0 con 0x7fa7d00707e0 2024-04-02T07:26:35.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7d6600640 1 -- 172.21.15.55:0/586991049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7d0073530 con 0x7fa7d00707e0 2024-04-02T07:26:35.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7c7400640 1 -- 172.21.15.55:0/586991049 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa7c00c83a0 con 0x7fa7d00707e0 2024-04-02T07:26:35.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.600+0000 7fa7c7400640 1 --2- 172.21.15.55:0/586991049 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa7ac0666c0 0x7fa7ac068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:35.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.604+0000 7fa7c7400640 1 -- 172.21.15.55:0/586991049 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7c011ebc0 con 0x7fa7d00707e0 2024-04-02T07:26:35.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.604+0000 7fa7c7e00640 1 --2- 172.21.15.55:0/586991049 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa7ac0666c0 0x7fa7ac068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:35.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.604+0000 7fa7c7e00640 1 --2- 172.21.15.55:0/586991049 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa7ac0666c0 0x7fa7ac068b80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8007fd0 tx=0x7fa7b8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:35.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.604+0000 7fa7c7400640 1 -- 172.21.15.55:0/586991049 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa7c00ebfc0 con 0x7fa7d00707e0 2024-04-02T07:26:35.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.764+0000 7fa7d6600640 1 -- 172.21.15.55:0/586991049 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa7d0066c90 con 0x7fa7d00707e0 2024-04-02T07:26:35.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.764+0000 7fa7c7400640 1 -- 172.21.15.55:0/586991049 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v60) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa7c00c40a0 con 0x7fa7d00707e0 2024-04-02T07:26:35.774 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:26:35.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.768+0000 7fa7d6600640 1 -- 172.21.15.55:0/586991049 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa7ac0666c0 msgr2=0x7fa7ac068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:35.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.768+0000 7fa7d6600640 1 --2- 172.21.15.55:0/586991049 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa7ac0666c0 0x7fa7ac068b80 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa7b8007fd0 tx=0x7fa7b8009040 comp rx=0 tx=0).stop 2024-04-02T07:26:35.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.768+0000 7fa7d6600640 1 -- 172.21.15.55:0/586991049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7d00707e0 msgr2=0x7fa7d0155d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:35.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.768+0000 7fa7d6600640 1 --2- 172.21.15.55:0/586991049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7d00707e0 0x7fa7d0155d90 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa7c001a190 tx=0x7fa7c001ada0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.768+0000 7fa7d6600640 1 -- 172.21.15.55:0/586991049 shutdown_connections 2024-04-02T07:26:35.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.768+0000 7fa7d6600640 1 --2- 172.21.15.55:0/586991049 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7d0144260 0x7fa7d0141090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.768+0000 7fa7d6600640 1 --2- 172.21.15.55:0/586991049 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa7ac0666c0 0x7fa7ac068b80 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.768+0000 7fa7d6600640 1 --2- 172.21.15.55:0/586991049 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa7d00b31a0 0x7fa7d01f8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.768+0000 7fa7d6600640 1 --2- 172.21.15.55:0/586991049 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7d00707e0 0x7fa7d0155d90 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.768+0000 7fa7d6600640 1 -- 172.21.15.55:0/586991049 >> 172.21.15.55:0/586991049 conn(0x7fa7d006a390 msgr2=0x7fa7d015afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:35.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.768+0000 7fa7d6600640 1 -- 172.21.15.55:0/586991049 shutdown_connections 2024-04-02T07:26:35.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.768+0000 7fa7d6600640 1 -- 172.21.15.55:0/586991049 wait complete. 2024-04-02T07:26:35.792 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:26:35.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.928+0000 7f9819600640 1 Processor -- start 2024-04-02T07:26:35.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.928+0000 7f9819600640 1 -- start start 2024-04-02T07:26:35.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.928+0000 7f9819600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f981415ee70 0x7f9814099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:35.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.928+0000 7f9819600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f981415f250 0x7f98140b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:35.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.928+0000 7f9819600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9814098a10 0x7f9814098e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:35.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.928+0000 7f9819600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98140b0840 con 0x7f981415f250 2024-04-02T07:26:35.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.928+0000 7f9819600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98140993c0 con 0x7f9814098a10 2024-04-02T07:26:35.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.928+0000 7f9819600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98140ad270 con 0x7f981415ee70 2024-04-02T07:26:35.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.928+0000 7f9812000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f981415f250 0x7f98140b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:35.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.928+0000 7f9812000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f981415f250 0x7f98140b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42264/0 (socket says 172.21.15.55:42264) 2024-04-02T07:26:35.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.928+0000 7f9812000640 1 -- 172.21.15.55:0/77601008 learned_addr learned my addr 172.21.15.55:0/77601008 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:35.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.928+0000 7f9812a00640 1 --2- 172.21.15.55:0/77601008 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f981415ee70 0x7f9814099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:35.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.928+0000 7f9813400640 1 --2- 172.21.15.55:0/77601008 >> v2:172.21.15.106:3300/0 conn(0x7f9814098a10 0x7f9814098e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:35.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.928+0000 7f9812000640 1 -- 172.21.15.55:0/77601008 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f981415ee70 msgr2=0x7f9814099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:35.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.928+0000 7f9812000640 1 --2- 172.21.15.55:0/77601008 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f981415ee70 0x7f9814099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.928+0000 7f9812000640 1 -- 172.21.15.55:0/77601008 >> v2:172.21.15.106:3300/0 conn(0x7f9814098a10 msgr2=0x7f9814098e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:35.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.928+0000 7f9812000640 1 --2- 172.21.15.55:0/77601008 >> v2:172.21.15.106:3300/0 conn(0x7f9814098a10 0x7f9814098e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.928+0000 7f9812000640 1 -- 172.21.15.55:0/77601008 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98140b0a50 con 0x7f981415f250 2024-04-02T07:26:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.932+0000 7f9812000640 1 --2- 172.21.15.55:0/77601008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f981415f250 0x7f98140b12f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f98140b6610 tx=0x7f980001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9549a39fd63a1c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.932+0000 7f9811600640 1 -- 172.21.15.55:0/77601008 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98000aa640 con 0x7f981415f250 2024-04-02T07:26:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.932+0000 7f9811600640 1 -- 172.21.15.55:0/77601008 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98000aa7a0 con 0x7f981415f250 2024-04-02T07:26:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.932+0000 7f9811600640 1 -- 172.21.15.55:0/77601008 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98000aab30 con 0x7f981415f250 2024-04-02T07:26:35.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.932+0000 7f9819600640 1 -- 172.21.15.55:0/77601008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f981415f250 msgr2=0x7f98140b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:35.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.932+0000 7f9819600640 1 --2- 172.21.15.55:0/77601008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f981415f250 0x7f98140b12f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f98140b6610 tx=0x7f980001c520 comp rx=0 tx=0).stop 2024-04-02T07:26:35.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.932+0000 7f9819600640 1 -- 172.21.15.55:0/77601008 shutdown_connections 2024-04-02T07:26:35.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.932+0000 7f9819600640 1 --2- 172.21.15.55:0/77601008 >> v2:172.21.15.106:3300/0 conn(0x7f9814098a10 0x7f9814098e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.932+0000 7f9819600640 1 --2- 172.21.15.55:0/77601008 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f981415f250 0x7f98140b12f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.932+0000 7f9819600640 1 --2- 172.21.15.55:0/77601008 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f981415ee70 0x7f9814099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.932+0000 7f9819600640 1 -- 172.21.15.55:0/77601008 >> 172.21.15.55:0/77601008 conn(0x7f98140b21d0 msgr2=0x7f98140b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:35.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.932+0000 7f9819600640 1 -- 172.21.15.55:0/77601008 shutdown_connections 2024-04-02T07:26:35.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.932+0000 7f9819600640 1 -- 172.21.15.55:0/77601008 wait complete. 2024-04-02T07:26:35.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.932+0000 7f9819600640 1 Processor -- start 2024-04-02T07:26:35.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.932+0000 7f9819600640 1 -- start start 2024-04-02T07:26:35.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f9819600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9814098a10 0x7f98140c3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:35.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f9819600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f981415ee70 0x7f9814143230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:35.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f9819600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f981415f250 0x7f9814143770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:35.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f9819600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9814144120 con 0x7f981415f250 2024-04-02T07:26:35.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f9819600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98140c3e90 con 0x7f981415ee70 2024-04-02T07:26:35.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f9819600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98140b3590 con 0x7f9814098a10 2024-04-02T07:26:35.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f9813400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f981415f250 0x7f9814143770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:35.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f9812a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9814098a10 0x7f98140c3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:35.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f9813400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f981415f250 0x7f9814143770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42280/0 (socket says 172.21.15.55:42280) 2024-04-02T07:26:35.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f9813400640 1 -- 172.21.15.55:0/1926065262 learned_addr learned my addr 172.21.15.55:0/1926065262 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:35.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f9812000640 1 --2- 172.21.15.55:0/1926065262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f981415ee70 0x7f9814143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:35.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f9813400640 1 -- 172.21.15.55:0/1926065262 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9814098a10 msgr2=0x7f98140c3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:35.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f9813400640 1 --2- 172.21.15.55:0/1926065262 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9814098a10 0x7f98140c3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f9813400640 1 -- 172.21.15.55:0/1926065262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f981415ee70 msgr2=0x7f9814143230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:35.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f9813400640 1 --2- 172.21.15.55:0/1926065262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f981415ee70 0x7f9814143230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:35.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f9813400640 1 -- 172.21.15.55:0/1926065262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98000094d0 con 0x7f981415f250 2024-04-02T07:26:35.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f9813400640 1 --2- 172.21.15.55:0/1926065262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f981415f250 0x7f9814143770 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f980c009dd0 tx=0x7f980c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:35.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f980aa00640 1 -- 172.21.15.55:0/1926065262 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c014480 con 0x7f981415f250 2024-04-02T07:26:35.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f980aa00640 1 -- 172.21.15.55:0/1926065262 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980c00f040 con 0x7f981415f250 2024-04-02T07:26:35.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f980aa00640 1 -- 172.21.15.55:0/1926065262 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980c014840 con 0x7f981415f250 2024-04-02T07:26:35.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f9819600640 1 -- 172.21.15.55:0/1926065262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f981406ba50 con 0x7f981415f250 2024-04-02T07:26:35.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f9819600640 1 -- 172.21.15.55:0/1926065262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f981406c010 con 0x7f981415f250 2024-04-02T07:26:35.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.936+0000 7f9819600640 1 -- 172.21.15.55:0/1926065262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f981406b8b0 con 0x7f981415f250 2024-04-02T07:26:35.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.940+0000 7f980aa00640 1 -- 172.21.15.55:0/1926065262 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f980c0149a0 con 0x7f981415f250 2024-04-02T07:26:35.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.940+0000 7f980aa00640 1 --2- 172.21.15.55:0/1926065262 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97f4066690 0x7f97f4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:35.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.940+0000 7f980aa00640 1 -- 172.21.15.55:0/1926065262 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f980c084b70 con 0x7f981415f250 2024-04-02T07:26:35.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.940+0000 7f9812a00640 1 --2- 172.21.15.55:0/1926065262 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97f4066690 0x7f97f4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:35.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.940+0000 7f9812a00640 1 --2- 172.21.15.55:0/1926065262 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97f4066690 0x7f97f4068b50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9804009ae0 tx=0x7f9804009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:35.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:35.944+0000 7f980aa00640 1 -- 172.21.15.55:0/1926065262 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f981406b8b0 con 0x7f981415f250 2024-04-02T07:26:36.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.140+0000 7f9819600640 1 -- 172.21.15.55:0/1926065262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f981406b8b0 con 0x7f981415f250 2024-04-02T07:26:36.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.140+0000 7f980aa00640 1 -- 172.21.15.55:0/1926065262 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4741 (secure 0 0 0) 0x7f981406b8b0 con 0x7f981415f250 2024-04-02T07:26:36.146 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:36.146 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5510,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3429221899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3429221899},{"type":"v1","addr":"172.21.15.55:6835","nonce":3429221899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5513,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/4033456774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4033456774},{"type":"v1","addr":"172.21.15.106:6836","nonce":4033456774}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6129,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2170345840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2170345840},{"type":"v1","addr":"172.21.15.55:6834","nonce":2170345840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:25:13.807869+0000","modified":"2024-04-02T07:26:06.283152+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6138":{"gid":6138,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":16,"addr":"172.21.15.106:6837/1050953219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1050953219},{"type":"v1","addr":"172.21.15.106:6837","nonce":1050953219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-02T07:26:36.146 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 35 2024-04-02T07:26:36.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.144+0000 7f9819600640 1 -- 172.21.15.55:0/1926065262 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97f4066690 msgr2=0x7f97f4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:36.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.144+0000 7f9819600640 1 --2- 172.21.15.55:0/1926065262 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97f4066690 0x7f97f4068b50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f9804009ae0 tx=0x7f9804009190 comp rx=0 tx=0).stop 2024-04-02T07:26:36.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.144+0000 7f9819600640 1 -- 172.21.15.55:0/1926065262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f981415f250 msgr2=0x7f9814143770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:36.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.144+0000 7f9819600640 1 --2- 172.21.15.55:0/1926065262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f981415f250 0x7f9814143770 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f980c009dd0 tx=0x7f980c00c490 comp rx=0 tx=0).stop 2024-04-02T07:26:36.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.144+0000 7f9819600640 1 -- 172.21.15.55:0/1926065262 shutdown_connections 2024-04-02T07:26:36.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.144+0000 7f9819600640 1 --2- 172.21.15.55:0/1926065262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f981415f250 0x7f9814143770 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.144+0000 7f9819600640 1 --2- 172.21.15.55:0/1926065262 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f97f4066690 0x7f97f4068b50 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.144+0000 7f9819600640 1 --2- 172.21.15.55:0/1926065262 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f981415ee70 0x7f9814143230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.144+0000 7f9819600640 1 --2- 172.21.15.55:0/1926065262 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9814098a10 0x7f98140c3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.144+0000 7f9819600640 1 -- 172.21.15.55:0/1926065262 >> 172.21.15.55:0/1926065262 conn(0x7f98140b21d0 msgr2=0x7f981415cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:36.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.144+0000 7f9819600640 1 -- 172.21.15.55:0/1926065262 shutdown_connections 2024-04-02T07:26:36.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.144+0000 7f9819600640 1 -- 172.21.15.55:0/1926065262 wait complete. 2024-04-02T07:26:36.167 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:26:36.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.300+0000 7fcdd9800640 1 Processor -- start 2024-04-02T07:26:36.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.300+0000 7fcdd9800640 1 -- start start 2024-04-02T07:26:36.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd9800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcdd40ce630 0x7fcdd4065d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:36.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd9800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdd4070a80 0x7fcdd4070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:36.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd9800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdd406d5b0 con 0x7fcdd415cbe0 2024-04-02T07:26:36.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd9800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdd40cec10 con 0x7fcdd40ce630 2024-04-02T07:26:36.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd9800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd4071430 con 0x7fcdd4070a80 2024-04-02T07:26:36.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcdd415cbe0 0x7fcdd40b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57024/0 (socket says 172.21.15.55:57024) 2024-04-02T07:26:36.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2a00640 1 -- 172.21.15.55:0/2376057242 learned_addr learned my addr 172.21.15.55:0/2376057242 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:26:36.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdcbe00640 1 --2- 172.21.15.55:0/2376057242 >> v2:172.21.15.106:3300/0 conn(0x7fcdd40ce630 0x7fcdd4065d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:36.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd3400640 1 --2- 172.21.15.55:0/2376057242 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdd4070a80 0x7fcdd4070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:36.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2000640 1 -- 172.21.15.55:0/2376057242 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2620274072 0 0) 0x7fcdd406d5b0 con 0x7fcdd415cbe0 2024-04-02T07:26:36.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2000640 1 -- 172.21.15.55:0/2376057242 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdb8003530 con 0x7fcdd415cbe0 2024-04-02T07:26:36.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2000640 1 -- 172.21.15.55:0/2376057242 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3117250547 0 0) 0x7fcdb8003530 con 0x7fcdd415cbe0 2024-04-02T07:26:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2000640 1 -- 172.21.15.55:0/2376057242 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdd4070a80 msgr2=0x7fcdd4070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2000640 1 --2- 172.21.15.55:0/2376057242 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdd4070a80 0x7fcdd4070ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2000640 1 -- 172.21.15.55:0/2376057242 >> v2:172.21.15.106:3300/0 conn(0x7fcdd40ce630 msgr2=0x7fcdd4065d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2000640 1 --2- 172.21.15.55:0/2376057242 >> v2:172.21.15.106:3300/0 conn(0x7fcdd40ce630 0x7fcdd4065d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2000640 1 -- 172.21.15.55:0/2376057242 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd406cc80 con 0x7fcdd415cbe0 2024-04-02T07:26:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2000640 1 -- 172.21.15.55:0/2376057242 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fcdc4001680 con 0x7fcdd415cbe0 2024-04-02T07:26:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2000640 1 -- 172.21.15.55:0/2376057242 >> v1:172.21.15.55:6789/0 conn(0x7fcdd415cbe0 legacy=0x7fcdd40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2000640 1 --2- 172.21.15.55:0/2376057242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdb80039b0 0x7fcdb8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2000640 1 --2- 172.21.15.55:0/2376057242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdb80047d0 0x7fcdb8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:36.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2000640 1 --2- 172.21.15.55:0/2376057242 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdd4070a80 0x7fcdb8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:36.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2000640 1 -- 172.21.15.55:0/2376057242 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd40cec10 con 0x7fcdb80039b0 2024-04-02T07:26:36.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2000640 1 -- 172.21.15.55:0/2376057242 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd4071430 con 0x7fcdb80047d0 2024-04-02T07:26:36.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2000640 1 -- 172.21.15.55:0/2376057242 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb800b990 con 0x7fcdd4070a80 2024-04-02T07:26:36.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2a00640 1 --2- 172.21.15.55:0/2376057242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdb80039b0 0x7fcdb8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:36.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd3400640 1 --2- 172.21.15.55:0/2376057242 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdd4070a80 0x7fcdb8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:36.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdcbe00640 1 --2- 172.21.15.55:0/2376057242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdb80047d0 0x7fcdb8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:36.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2a00640 1 -- 172.21.15.55:0/2376057242 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdd4070a80 msgr2=0x7fcdb8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:36.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2a00640 1 --2- 172.21.15.55:0/2376057242 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdd4070a80 0x7fcdb8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2a00640 1 -- 172.21.15.55:0/2376057242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdb80047d0 msgr2=0x7fcdb8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:36.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2a00640 1 --2- 172.21.15.55:0/2376057242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdb80047d0 0x7fcdb8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.304+0000 7fcdd2a00640 1 -- 172.21.15.55:0/2376057242 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb8003530 con 0x7fcdb80039b0 2024-04-02T07:26:36.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.308+0000 7fcdd2a00640 1 --2- 172.21.15.55:0/2376057242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdb80039b0 0x7fcdb8003dd0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400c240 tx=0x7fcdc401cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f6577d97faa59d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:36.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.308+0000 7fcdd2000640 1 -- 172.21.15.55:0/2376057242 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4005ae0 con 0x7fcdb80039b0 2024-04-02T07:26:36.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.308+0000 7fcdd2000640 1 -- 172.21.15.55:0/2376057242 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc4005c60 con 0x7fcdb80039b0 2024-04-02T07:26:36.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.308+0000 7fcdd2000640 1 -- 172.21.15.55:0/2376057242 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc4007070 con 0x7fcdb80039b0 2024-04-02T07:26:36.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.308+0000 7fcdd9800640 1 -- 172.21.15.55:0/2376057242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdb80039b0 msgr2=0x7fcdb8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:36.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.308+0000 7fcdd9800640 1 --2- 172.21.15.55:0/2376057242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdb80039b0 0x7fcdb8003dd0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400c240 tx=0x7fcdc401cc60 comp rx=0 tx=0).stop 2024-04-02T07:26:36.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.308+0000 7fcdd3400640 1 -- 172.21.15.55:0/2376057242 reap_dead start 2024-04-02T07:26:36.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.308+0000 7fcdd9800640 1 -- 172.21.15.55:0/2376057242 shutdown_connections 2024-04-02T07:26:36.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.308+0000 7fcdd9800640 1 -- 172.21.15.55:0/2376057242 >> 172.21.15.55:0/2376057242 conn(0x7fcdd40ced50 msgr2=0x7fcdd40cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:36.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.308+0000 7fcdd9800640 1 -- 172.21.15.55:0/2376057242 shutdown_connections 2024-04-02T07:26:36.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.308+0000 7fcdd9800640 1 -- 172.21.15.55:0/2376057242 wait complete. 2024-04-02T07:26:36.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.308+0000 7fcdd9800640 1 Processor -- start 2024-04-02T07:26:36.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.308+0000 7fcdd9800640 1 -- start start 2024-04-02T07:26:36.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdd9800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdb80039b0 0x7fcdd415af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:36.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdd9800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdd40b2c90 0x7fcdd414aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:36.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdd9800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd40aced0 0x7fcdd40ad350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:36.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdd9800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd40ad890 con 0x7fcdd40aced0 2024-04-02T07:26:36.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdd9800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd415aac0 con 0x7fcdb80039b0 2024-04-02T07:26:36.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdd9800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdd4157a10 con 0x7fcdd40b2c90 2024-04-02T07:26:36.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdd3400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd40aced0 0x7fcdd40ad350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:36.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdd3400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd40aced0 0x7fcdd40ad350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42288/0 (socket says 172.21.15.55:42288) 2024-04-02T07:26:36.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdd3400640 1 -- 172.21.15.55:0/680274557 learned_addr learned my addr 172.21.15.55:0/680274557 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:36.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdcbe00640 1 --2- 172.21.15.55:0/680274557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdd40b2c90 0x7fcdd414aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:36.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdd2a00640 1 --2- 172.21.15.55:0/680274557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdb80039b0 0x7fcdd415af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:36.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdd3400640 1 -- 172.21.15.55:0/680274557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdd40b2c90 msgr2=0x7fcdd414aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:36.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdd3400640 1 --2- 172.21.15.55:0/680274557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdd40b2c90 0x7fcdd414aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdd3400640 1 -- 172.21.15.55:0/680274557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdb80039b0 msgr2=0x7fcdd415af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:36.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdd3400640 1 --2- 172.21.15.55:0/680274557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdb80039b0 0x7fcdd415af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdd3400640 1 -- 172.21.15.55:0/680274557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd40712a0 con 0x7fcdd40aced0 2024-04-02T07:26:36.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdd3400640 1 --2- 172.21.15.55:0/680274557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd40aced0 0x7fcdd40ad350 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40cb3e0 tx=0x7fcdcc00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:36.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdcaa00640 1 -- 172.21.15.55:0/680274557 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc00e040 con 0x7fcdd40aced0 2024-04-02T07:26:36.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdcaa00640 1 -- 172.21.15.55:0/680274557 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdcc00f040 con 0x7fcdd40aced0 2024-04-02T07:26:36.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdcaa00640 1 -- 172.21.15.55:0/680274557 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdcc015430 con 0x7fcdd40aced0 2024-04-02T07:26:36.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdd9800640 1 -- 172.21.15.55:0/680274557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdd4157730 con 0x7fcdd40aced0 2024-04-02T07:26:36.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdd9800640 1 -- 172.21.15.55:0/680274557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdd415a750 con 0x7fcdd40aced0 2024-04-02T07:26:36.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.312+0000 7fcdd9800640 1 -- 172.21.15.55:0/680274557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdd4066c90 con 0x7fcdd40aced0 2024-04-02T07:26:36.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.316+0000 7fcdcaa00640 1 -- 172.21.15.55:0/680274557 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fcdcc015590 con 0x7fcdd40aced0 2024-04-02T07:26:36.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.316+0000 7fcdcaa00640 1 --2- 172.21.15.55:0/680274557 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcdb0066690 0x7fcdb0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:36.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.316+0000 7fcdcaa00640 1 -- 172.21.15.55:0/680274557 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcdcc084710 con 0x7fcdd40aced0 2024-04-02T07:26:36.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.316+0000 7fcdd2a00640 1 --2- 172.21.15.55:0/680274557 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcdb0066690 0x7fcdb0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:36.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.316+0000 7fcdd2a00640 1 --2- 172.21.15.55:0/680274557 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcdb0066690 0x7fcdb0068b50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40ab000 tx=0x7fcdc40a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:36.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.320+0000 7fcdcaa00640 1 -- 172.21.15.55:0/680274557 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fcdcc051a70 con 0x7fcdd40aced0 2024-04-02T07:26:36.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.480+0000 7fcdd9800640 1 -- 172.21.15.55:0/680274557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcdd415c380 con 0x7fcdd40aced0 2024-04-02T07:26:36.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.480+0000 7fcdcaa00640 1 -- 172.21.15.55:0/680274557 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16097 (secure 0 0 0) 0x7fcdcc055090 con 0x7fcdd40aced0 2024-04-02T07:26:36.488 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:36.488 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":60,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:25:14.810503+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:25:12.332239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-02T07:25:12.785664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:26:36.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.484+0000 7fcdd9800640 1 -- 172.21.15.55:0/680274557 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcdb0066690 msgr2=0x7fcdb0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:36.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.484+0000 7fcdd9800640 1 --2- 172.21.15.55:0/680274557 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcdb0066690 0x7fcdb0068b50 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcdc40ab000 tx=0x7fcdc40a7070 comp rx=0 tx=0).stop 2024-04-02T07:26:36.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.484+0000 7fcdd9800640 1 -- 172.21.15.55:0/680274557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd40aced0 msgr2=0x7fcdd40ad350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:36.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.484+0000 7fcdd9800640 1 --2- 172.21.15.55:0/680274557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd40aced0 0x7fcdd40ad350 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fcdd40cb3e0 tx=0x7fcdcc00f1b0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.484+0000 7fcdd9800640 1 -- 172.21.15.55:0/680274557 shutdown_connections 2024-04-02T07:26:36.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.484+0000 7fcdd9800640 1 --2- 172.21.15.55:0/680274557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdd40aced0 0x7fcdd40ad350 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.484+0000 7fcdd9800640 1 --2- 172.21.15.55:0/680274557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcdd40b2c90 0x7fcdd414aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.484+0000 7fcdd9800640 1 --2- 172.21.15.55:0/680274557 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcdb0066690 0x7fcdb0068b50 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.484+0000 7fcdd9800640 1 --2- 172.21.15.55:0/680274557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcdb80039b0 0x7fcdd415af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.484+0000 7fcdd9800640 1 -- 172.21.15.55:0/680274557 >> 172.21.15.55:0/680274557 conn(0x7fcdd40ced50 msgr2=0x7fcdd40cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:36.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.484+0000 7fcdd9800640 1 -- 172.21.15.55:0/680274557 shutdown_connections 2024-04-02T07:26:36.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.484+0000 7fcdd9800640 1 -- 172.21.15.55:0/680274557 wait complete. 2024-04-02T07:26:36.509 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-02T07:26:36.509 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:26:36.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.644+0000 7f0e85a00640 1 Processor -- start 2024-04-02T07:26:36.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.644+0000 7f0e85a00640 1 -- start start 2024-04-02T07:26:36.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.644+0000 7f0e85a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e80099120 0x7f0e80099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:36.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.644+0000 7f0e85a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0e8015f250 0x7f0e800b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:36.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.644+0000 7f0e85a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e800ad270 con 0x7f0e8015ee70 2024-04-02T07:26:36.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.644+0000 7f0e85a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e800b0840 con 0x7f0e8015f250 2024-04-02T07:26:36.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.644+0000 7f0e85a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800cf6a0 con 0x7f0e80099120 2024-04-02T07:26:36.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.644+0000 7f0e77e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e80099120 0x7f0e80099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:36.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.644+0000 7f0e7f400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0e8015f250 0x7f0e800b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:36.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.644+0000 7f0e7f400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0e8015f250 0x7f0e800b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:46230/0 (socket says 172.21.15.55:46230) 2024-04-02T07:26:36.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.644+0000 7f0e7f400640 1 -- 172.21.15.55:0/3854372793 learned_addr learned my addr 172.21.15.55:0/3854372793 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:36.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.644+0000 7f0e77e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e80099120 0x7f0e80099830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:37592/0 (socket says 172.21.15.55:37592) 2024-04-02T07:26:36.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.644+0000 7f0e7ea00640 1 --1- 172.21.15.55:0/3854372793 >> v1:172.21.15.106:6789/0 conn(0x7f0e8015ee70 0x7f0e80098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:47394/0 (socket says 172.21.15.55:47394) 2024-04-02T07:26:36.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.644+0000 7f0e7f400640 1 -- 172.21.15.55:0/3854372793 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e80099120 msgr2=0x7f0e80099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:36.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.644+0000 7f0e7f400640 1 --2- 172.21.15.55:0/3854372793 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e80099120 0x7f0e80099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.644+0000 7f0e7f400640 1 -- 172.21.15.55:0/3854372793 >> v1:172.21.15.106:6789/0 conn(0x7f0e8015ee70 legacy=0x7f0e80098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:36.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.644+0000 7f0e7f400640 1 -- 172.21.15.55:0/3854372793 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e800b0a50 con 0x7f0e8015f250 2024-04-02T07:26:36.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.644+0000 7f0e7e000640 1 -- 172.21.15.55:0/3854372793 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2871999028 0 0) 0x7f0e800ad270 con 0x7f0e8015ee70 2024-04-02T07:26:36.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.648+0000 7f0e7f400640 1 --2- 172.21.15.55:0/3854372793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e8015f250 0x7f0e800b12f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0e78009e50 tx=0x7f0e7801ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72af4defdb901542 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:36.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.648+0000 7f0e7e000640 1 -- 172.21.15.55:0/3854372793 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e780a5900 con 0x7f0e8015f250 2024-04-02T07:26:36.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.648+0000 7f0e7e000640 1 -- 172.21.15.55:0/3854372793 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e780a5a60 con 0x7f0e8015f250 2024-04-02T07:26:36.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.648+0000 7f0e7e000640 1 -- 172.21.15.55:0/3854372793 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e780a5df0 con 0x7f0e8015f250 2024-04-02T07:26:36.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.648+0000 7f0e85a00640 1 -- 172.21.15.55:0/3854372793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e8015f250 msgr2=0x7f0e800b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:36.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.648+0000 7f0e85a00640 1 --2- 172.21.15.55:0/3854372793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e8015f250 0x7f0e800b12f0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f0e78009e50 tx=0x7f0e7801ca30 comp rx=0 tx=0).stop 2024-04-02T07:26:36.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.648+0000 7f0e85a00640 1 -- 172.21.15.55:0/3854372793 shutdown_connections 2024-04-02T07:26:36.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.648+0000 7f0e85a00640 1 --2- 172.21.15.55:0/3854372793 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e8015f250 0x7f0e800b12f0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.648+0000 7f0e85a00640 1 --2- 172.21.15.55:0/3854372793 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e80099120 0x7f0e80099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.648+0000 7f0e85a00640 1 -- 172.21.15.55:0/3854372793 >> 172.21.15.55:0/3854372793 conn(0x7f0e800b21d0 msgr2=0x7f0e800b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:36.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.648+0000 7f0e85a00640 1 -- 172.21.15.55:0/3854372793 shutdown_connections 2024-04-02T07:26:36.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.648+0000 7f0e85a00640 1 -- 172.21.15.55:0/3854372793 wait complete. 2024-04-02T07:26:36.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e85a00640 1 Processor -- start 2024-04-02T07:26:36.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e85a00640 1 -- start start 2024-04-02T07:26:36.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e85a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e80099120 0x7f0e8015d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:36.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e85a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e8015ee70 0x7f0e8015de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:36.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e85a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e8015f250 0x7f0e800c5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:36.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e85a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800c8d50 con 0x7f0e80099120 2024-04-02T07:26:36.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e85a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800c7cb0 con 0x7f0e8015ee70 2024-04-02T07:26:36.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e85a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e800c7f90 con 0x7f0e8015f250 2024-04-02T07:26:36.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e7ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e80099120 0x7f0e8015d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:36.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e7ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e80099120 0x7f0e8015d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42298/0 (socket says 172.21.15.55:42298) 2024-04-02T07:26:36.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e7ea00640 1 -- 172.21.15.55:0/1820463002 learned_addr learned my addr 172.21.15.55:0/1820463002 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:36.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e77e00640 1 --2- 172.21.15.55:0/1820463002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e8015ee70 0x7f0e8015de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:36.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e7f400640 1 --2- 172.21.15.55:0/1820463002 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e8015f250 0x7f0e800c5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:36.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e7ea00640 1 -- 172.21.15.55:0/1820463002 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e8015f250 msgr2=0x7f0e800c5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:36.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e7ea00640 1 --2- 172.21.15.55:0/1820463002 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e8015f250 0x7f0e800c5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e7ea00640 1 -- 172.21.15.55:0/1820463002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e8015ee70 msgr2=0x7f0e8015de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:36.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e7ea00640 1 --2- 172.21.15.55:0/1820463002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e8015ee70 0x7f0e8015de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e7ea00640 1 -- 172.21.15.55:0/1820463002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e78009b30 con 0x7f0e80099120 2024-04-02T07:26:36.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e7ea00640 1 --2- 172.21.15.55:0/1820463002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e80099120 0x7f0e8015d920 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0e700011f0 tx=0x7f0e7000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:36.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e76a00640 1 -- 172.21.15.55:0/1820463002 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e700074e0 con 0x7f0e80099120 2024-04-02T07:26:36.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e76a00640 1 -- 172.21.15.55:0/1820463002 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e70007640 con 0x7f0e80099120 2024-04-02T07:26:36.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e76a00640 1 -- 172.21.15.55:0/1820463002 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e70004a10 con 0x7f0e80099120 2024-04-02T07:26:36.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e85a00640 1 -- 172.21.15.55:0/1820463002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e800c8270 con 0x7f0e80099120 2024-04-02T07:26:36.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.652+0000 7f0e85a00640 1 -- 172.21.15.55:0/1820463002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e800c8830 con 0x7f0e80099120 2024-04-02T07:26:36.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.656+0000 7f0e85a00640 1 -- 172.21.15.55:0/1820463002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e80066c90 con 0x7f0e80099120 2024-04-02T07:26:36.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.656+0000 7f0e76a00640 1 -- 172.21.15.55:0/1820463002 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f0e70004b70 con 0x7f0e80099120 2024-04-02T07:26:36.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.656+0000 7f0e76a00640 1 --2- 172.21.15.55:0/1820463002 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0e5c0666c0 0x7f0e5c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:36.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.656+0000 7f0e76a00640 1 -- 172.21.15.55:0/1820463002 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e700832c0 con 0x7f0e80099120 2024-04-02T07:26:36.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.656+0000 7f0e77e00640 1 --2- 172.21.15.55:0/1820463002 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0e5c0666c0 0x7f0e5c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:36.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.656+0000 7f0e77e00640 1 --2- 172.21.15.55:0/1820463002 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0e5c0666c0 0x7f0e5c068b80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0e80099c80 tx=0x7f0e68009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:36.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.660+0000 7f0e76a00640 1 -- 172.21.15.55:0/1820463002 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0e70050640 con 0x7f0e80099120 2024-04-02T07:26:36.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.856+0000 7f0e85a00640 1 -- 172.21.15.55:0/1820463002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e80099fc0 con 0x7f0e80099120 2024-04-02T07:26:36.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.856+0000 7f0e76a00640 1 -- 172.21.15.55:0/1820463002 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4741 (secure 0 0 0) 0x7f0e70053c60 con 0x7f0e80099120 2024-04-02T07:26:36.861 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:36.862 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5510,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3429221899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3429221899},{"type":"v1","addr":"172.21.15.55:6835","nonce":3429221899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5513,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/4033456774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4033456774},{"type":"v1","addr":"172.21.15.106:6836","nonce":4033456774}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6129,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2170345840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2170345840},{"type":"v1","addr":"172.21.15.55:6834","nonce":2170345840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:25:13.807869+0000","modified":"2024-04-02T07:26:06.283152+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6138":{"gid":6138,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":16,"addr":"172.21.15.106:6837/1050953219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1050953219},{"type":"v1","addr":"172.21.15.106:6837","nonce":1050953219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-02T07:26:36.862 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 35 2024-04-02T07:26:36.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.856+0000 7f0e85a00640 1 -- 172.21.15.55:0/1820463002 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0e5c0666c0 msgr2=0x7f0e5c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:36.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.856+0000 7f0e85a00640 1 --2- 172.21.15.55:0/1820463002 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0e5c0666c0 0x7f0e5c068b80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0e80099c80 tx=0x7f0e68009190 comp rx=0 tx=0).stop 2024-04-02T07:26:36.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.856+0000 7f0e85a00640 1 -- 172.21.15.55:0/1820463002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e80099120 msgr2=0x7f0e8015d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:36.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.856+0000 7f0e85a00640 1 --2- 172.21.15.55:0/1820463002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e80099120 0x7f0e8015d920 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0e700011f0 tx=0x7f0e7000c9b0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.856+0000 7f0e85a00640 1 -- 172.21.15.55:0/1820463002 shutdown_connections 2024-04-02T07:26:36.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.856+0000 7f0e85a00640 1 --2- 172.21.15.55:0/1820463002 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0e8015f250 0x7f0e800c5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.856+0000 7f0e85a00640 1 --2- 172.21.15.55:0/1820463002 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0e5c0666c0 0x7f0e5c068b80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.856+0000 7f0e85a00640 1 --2- 172.21.15.55:0/1820463002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0e8015ee70 0x7f0e8015de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.856+0000 7f0e85a00640 1 --2- 172.21.15.55:0/1820463002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0e80099120 0x7f0e8015d920 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:36.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.856+0000 7f0e85a00640 1 -- 172.21.15.55:0/1820463002 >> 172.21.15.55:0/1820463002 conn(0x7f0e800b21d0 msgr2=0x7f0e8015bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:36.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.856+0000 7f0e85a00640 1 -- 172.21.15.55:0/1820463002 shutdown_connections 2024-04-02T07:26:36.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:36.856+0000 7f0e85a00640 1 -- 172.21.15.55:0/1820463002 wait complete. 2024-04-02T07:26:36.882 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:26:37.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.016+0000 7fc7ffc00640 1 Processor -- start 2024-04-02T07:26:37.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.016+0000 7fc7ffc00640 1 -- start start 2024-04-02T07:26:37.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.016+0000 7fc7ffc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7f80afe30 0x7fc7f8099750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:37.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.016+0000 7fc7ffc00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f80ce2f0 con 0x7fc7f8098a10 2024-04-02T07:26:37.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.016+0000 7fc7ffc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f80ce5d0 con 0x7fc7f80b1430 2024-04-02T07:26:37.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.016+0000 7fc7ffc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80cbe10 con 0x7fc7f80afe30 2024-04-02T07:26:37.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.016+0000 7fc7fd200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc7f8098a10 0x7fc7f8098df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57030/0 (socket says 172.21.15.55:57030) 2024-04-02T07:26:37.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.016+0000 7fc7fd200640 1 -- 172.21.15.55:0/834794384 learned_addr learned my addr 172.21.15.55:0/834794384 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:26:37.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.016+0000 7fc7fdc00640 1 --2- 172.21.15.55:0/834794384 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7f80afe30 0x7fc7f8099750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:37.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.020+0000 7fc7f7e00640 1 -- 172.21.15.55:0/834794384 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 751649249 0 0) 0x7fc7f80ce2f0 con 0x7fc7f8098a10 2024-04-02T07:26:37.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.020+0000 7fc7f7e00640 1 -- 172.21.15.55:0/834794384 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7dc003530 con 0x7fc7f8098a10 2024-04-02T07:26:37.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.020+0000 7fc7f7e00640 1 -- 172.21.15.55:0/834794384 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1217201145 0 0) 0x7fc7f80ce5d0 con 0x7fc7f80b1430 2024-04-02T07:26:37.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.020+0000 7fc7f7e00640 1 -- 172.21.15.55:0/834794384 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7f80ce2f0 con 0x7fc7f80b1430 2024-04-02T07:26:37.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.020+0000 7fc7f7e00640 1 -- 172.21.15.55:0/834794384 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1891532905 0 0) 0x7fc7dc003530 con 0x7fc7f8098a10 2024-04-02T07:26:37.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.020+0000 7fc7fdc00640 1 -- 172.21.15.55:0/834794384 >> v1:172.21.15.106:6789/0 conn(0x7fc7f80b1430 legacy=0x7fc7f80cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:37.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.020+0000 7fc7fdc00640 1 -- 172.21.15.55:0/834794384 >> v1:172.21.15.55:6789/0 conn(0x7fc7f8098a10 legacy=0x7fc7f8098df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:37.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.020+0000 7fc7fdc00640 1 -- 172.21.15.55:0/834794384 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f80cc000 con 0x7fc7f80afe30 2024-04-02T07:26:37.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.020+0000 7fc7fdc00640 1 --2- 172.21.15.55:0/834794384 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7f80afe30 0x7fc7f8099750 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0009dc0 tx=0x7fc7f001c7c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f2949e542c03ede server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:37.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.020+0000 7fc7f7e00640 1 -- 172.21.15.55:0/834794384 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8001680 con 0x7fc7f80afe30 2024-04-02T07:26:37.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.020+0000 7fc7f7e00640 1 -- 172.21.15.55:0/834794384 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f00a6410 con 0x7fc7f80afe30 2024-04-02T07:26:37.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.020+0000 7fc7f7e00640 1 -- 172.21.15.55:0/834794384 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f00a67a0 con 0x7fc7f80afe30 2024-04-02T07:26:37.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7ffc00640 1 -- 172.21.15.55:0/834794384 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7f80afe30 msgr2=0x7fc7f8099750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:37.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7ffc00640 1 --2- 172.21.15.55:0/834794384 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7f80afe30 0x7fc7f8099750 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0009dc0 tx=0x7fc7f001c7c0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7ffc00640 1 -- 172.21.15.55:0/834794384 shutdown_connections 2024-04-02T07:26:37.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7ffc00640 1 --2- 172.21.15.55:0/834794384 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7f80afe30 0x7fc7f8099750 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7ffc00640 1 -- 172.21.15.55:0/834794384 >> 172.21.15.55:0/834794384 conn(0x7fc7f80b2210 msgr2=0x7fc7f80b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:37.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7ffc00640 1 -- 172.21.15.55:0/834794384 shutdown_connections 2024-04-02T07:26:37.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7ffc00640 1 -- 172.21.15.55:0/834794384 wait complete. 2024-04-02T07:26:37.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7ffc00640 1 Processor -- start 2024-04-02T07:26:37.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7ffc00640 1 -- start start 2024-04-02T07:26:37.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7ffc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7f8098a10 0x7fc7f814b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:37.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7ffc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7f80afe30 0x7fc7f8150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:37.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7ffc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7f80b1430 0x7fc7f8165790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:37.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7ffc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80afb10 con 0x7fc7f80afe30 2024-04-02T07:26:37.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7ffc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f8150500 con 0x7fc7f8098a10 2024-04-02T07:26:37.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7ffc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80ad8f0 con 0x7fc7f80b1430 2024-04-02T07:26:37.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7efe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7f80afe30 0x7fc7f8150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:37.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7efe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7f80afe30 0x7fc7f8150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42302/0 (socket says 172.21.15.55:42302) 2024-04-02T07:26:37.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7efe00640 1 -- 172.21.15.55:0/4247107718 learned_addr learned my addr 172.21.15.55:0/4247107718 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:37.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7fd200640 1 --2- 172.21.15.55:0/4247107718 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7f8098a10 0x7fc7f814b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:37.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7fdc00640 1 --2- 172.21.15.55:0/4247107718 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7f80b1430 0x7fc7f8165790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:37.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7efe00640 1 -- 172.21.15.55:0/4247107718 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7f80b1430 msgr2=0x7fc7f8165790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:37.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7efe00640 1 --2- 172.21.15.55:0/4247107718 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7f80b1430 0x7fc7f8165790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7efe00640 1 -- 172.21.15.55:0/4247107718 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7f8098a10 msgr2=0x7fc7f814b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:37.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7efe00640 1 --2- 172.21.15.55:0/4247107718 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7f8098a10 0x7fc7f814b4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7efe00640 1 -- 172.21.15.55:0/4247107718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f0009a70 con 0x7fc7f80afe30 2024-04-02T07:26:37.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.024+0000 7fc7efe00640 1 --2- 172.21.15.55:0/4247107718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7f80afe30 0x7fc7f8150fa0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000c430 tx=0x7fc7e000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:37.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.028+0000 7fc7f5600640 1 -- 172.21.15.55:0/4247107718 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e00052d0 con 0x7fc7f80afe30 2024-04-02T07:26:37.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.028+0000 7fc7f5600640 1 -- 172.21.15.55:0/4247107718 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e0005450 con 0x7fc7f80afe30 2024-04-02T07:26:37.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.028+0000 7fc7f5600640 1 -- 172.21.15.55:0/4247107718 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0003840 con 0x7fc7f80afe30 2024-04-02T07:26:37.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.028+0000 7fc7ffc00640 1 -- 172.21.15.55:0/4247107718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f81507a0 con 0x7fc7f80afe30 2024-04-02T07:26:37.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.028+0000 7fc7ffc00640 1 -- 172.21.15.55:0/4247107718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f81514e0 con 0x7fc7f80afe30 2024-04-02T07:26:37.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.028+0000 7fc7ffc00640 1 -- 172.21.15.55:0/4247107718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f8066c90 con 0x7fc7f80afe30 2024-04-02T07:26:37.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.028+0000 7fc7f5600640 1 -- 172.21.15.55:0/4247107718 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc7e00039a0 con 0x7fc7f80afe30 2024-04-02T07:26:37.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.028+0000 7fc7f5600640 1 --2- 172.21.15.55:0/4247107718 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc7d4066690 0x7fc7d4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:37.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.028+0000 7fc7f5600640 1 -- 172.21.15.55:0/4247107718 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7e0083760 con 0x7fc7f80afe30 2024-04-02T07:26:37.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.028+0000 7fc7fd200640 1 --2- 172.21.15.55:0/4247107718 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc7d4066690 0x7fc7d4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:37.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.032+0000 7fc7fd200640 1 --2- 172.21.15.55:0/4247107718 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc7d4066690 0x7fc7d4068b50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8000f70 tx=0x7fc7e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:37.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.032+0000 7fc7f5600640 1 -- 172.21.15.55:0/4247107718 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc7e0050b60 con 0x7fc7f80afe30 2024-04-02T07:26:37.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.228+0000 7fc7ffc00640 1 -- 172.21.15.55:0/4247107718 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc7f8150c50 con 0x7fc7f80afe30 2024-04-02T07:26:37.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.228+0000 7fc7f5600640 1 -- 172.21.15.55:0/4247107718 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) v1 ==== 94+0+4741 (secure 0 0 0) 0x7fc7e0054180 con 0x7fc7f80afe30 2024-04-02T07:26:37.234 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:37.234 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":35,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5510,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3429221899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3429221899},{"type":"v1","addr":"172.21.15.55:6835","nonce":3429221899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5513,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/4033456774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4033456774},{"type":"v1","addr":"172.21.15.106:6836","nonce":4033456774}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6129,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2170345840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2170345840},{"type":"v1","addr":"172.21.15.55:6834","nonce":2170345840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:25:13.807869+0000","modified":"2024-04-02T07:26:06.283152+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6138},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6138":{"gid":6138,"name":"d","rank":0,"incarnation":29,"state":"up:active","state_seq":16,"addr":"172.21.15.106:6837/1050953219","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":1050953219},{"type":"v1","addr":"172.21.15.106:6837","nonce":1050953219}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2024-04-02T07:26:37.234 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 35 2024-04-02T07:26:37.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.232+0000 7fc7ffc00640 1 -- 172.21.15.55:0/4247107718 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc7d4066690 msgr2=0x7fc7d4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:37.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.232+0000 7fc7ffc00640 1 --2- 172.21.15.55:0/4247107718 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc7d4066690 0x7fc7d4068b50 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8000f70 tx=0x7fc7e8009040 comp rx=0 tx=0).stop 2024-04-02T07:26:37.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.232+0000 7fc7ffc00640 1 -- 172.21.15.55:0/4247107718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7f80afe30 msgr2=0x7fc7f8150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:37.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.232+0000 7fc7ffc00640 1 --2- 172.21.15.55:0/4247107718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7f80afe30 0x7fc7f8150fa0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fc7e000c430 tx=0x7fc7e000c8f0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.232+0000 7fc7ffc00640 1 -- 172.21.15.55:0/4247107718 shutdown_connections 2024-04-02T07:26:37.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.232+0000 7fc7ffc00640 1 --2- 172.21.15.55:0/4247107718 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7f80b1430 0x7fc7f8165790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.232+0000 7fc7ffc00640 1 --2- 172.21.15.55:0/4247107718 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7f80afe30 0x7fc7f8150fa0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.232+0000 7fc7ffc00640 1 --2- 172.21.15.55:0/4247107718 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc7d4066690 0x7fc7d4068b50 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.232+0000 7fc7ffc00640 1 --2- 172.21.15.55:0/4247107718 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc7f8098a10 0x7fc7f814b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.232+0000 7fc7ffc00640 1 -- 172.21.15.55:0/4247107718 >> 172.21.15.55:0/4247107718 conn(0x7fc7f80b2210 msgr2=0x7fc7f806af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:37.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.232+0000 7fc7ffc00640 1 -- 172.21.15.55:0/4247107718 shutdown_connections 2024-04-02T07:26:37.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.232+0000 7fc7ffc00640 1 -- 172.21.15.55:0/4247107718 wait complete. 2024-04-02T07:26:37.255 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:26:37.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.392+0000 7fd3c3e00640 1 Processor -- start 2024-04-02T07:26:37.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.392+0000 7fd3c3e00640 1 -- start start 2024-04-02T07:26:37.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.392+0000 7fd3c3e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd3c415cb60 0x7fd3c40ae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:37.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.392+0000 7fd3c3e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3c40b09b0 0x7fd3c40ac730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:37.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.392+0000 7fd3c3e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c40af460 con 0x7fd3c40aef60 2024-04-02T07:26:37.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.392+0000 7fd3c3e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c40ac2e0 con 0x7fd3c415cb60 2024-04-02T07:26:37.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.392+0000 7fd3c3e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40af740 con 0x7fd3c40b09b0 2024-04-02T07:26:37.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.392+0000 7fd3c2a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd3c415cb60 0x7fd3c40ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:37.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.392+0000 7fd3c3400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3c40b09b0 0x7fd3c40ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:37.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.392+0000 7fd3c2a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd3c415cb60 0x7fd3c40ae630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:46264/0 (socket says 172.21.15.55:46264) 2024-04-02T07:26:37.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.392+0000 7fd3c2a00640 1 -- 172.21.15.55:0/2326554175 learned_addr learned my addr 172.21.15.55:0/2326554175 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:37.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.392+0000 7fd3c2a00640 1 -- 172.21.15.55:0/2326554175 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3c40b09b0 msgr2=0x7fd3c40ac730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:37.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.392+0000 7fd3c2a00640 1 --2- 172.21.15.55:0/2326554175 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3c40b09b0 0x7fd3c40ac730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.392+0000 7fd3c2a00640 1 -- 172.21.15.55:0/2326554175 >> v1:172.21.15.106:6789/0 conn(0x7fd3c40aef60 legacy=0x7fd3c40b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:37.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.392+0000 7fd3c2a00640 1 -- 172.21.15.55:0/2326554175 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c40afa20 con 0x7fd3c415cb60 2024-04-02T07:26:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.396+0000 7fd3c2a00640 1 --2- 172.21.15.55:0/2326554175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3c415cb60 0x7fd3c40ae630 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4009870 tx=0x7fd3b401c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1ac824be28df588 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.396+0000 7fd3c2000640 1 -- 172.21.15.55:0/2326554175 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b40a9610 con 0x7fd3c415cb60 2024-04-02T07:26:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.396+0000 7fd3c2000640 1 -- 172.21.15.55:0/2326554175 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b40a9770 con 0x7fd3c415cb60 2024-04-02T07:26:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.396+0000 7fd3c2000640 1 -- 172.21.15.55:0/2326554175 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b40a9b00 con 0x7fd3c415cb60 2024-04-02T07:26:37.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.396+0000 7fd3c3e00640 1 -- 172.21.15.55:0/2326554175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3c415cb60 msgr2=0x7fd3c40ae630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:37.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.396+0000 7fd3c3e00640 1 --2- 172.21.15.55:0/2326554175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3c415cb60 0x7fd3c40ae630 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd3b4009870 tx=0x7fd3b401c530 comp rx=0 tx=0).stop 2024-04-02T07:26:37.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.396+0000 7fd3c3e00640 1 -- 172.21.15.55:0/2326554175 shutdown_connections 2024-04-02T07:26:37.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.396+0000 7fd3c3e00640 1 --2- 172.21.15.55:0/2326554175 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3c40b09b0 0x7fd3c40ac730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.396+0000 7fd3c3e00640 1 --2- 172.21.15.55:0/2326554175 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3c415cb60 0x7fd3c40ae630 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.396+0000 7fd3c3e00640 1 -- 172.21.15.55:0/2326554175 >> 172.21.15.55:0/2326554175 conn(0x7fd3c4098a10 msgr2=0x7fd3c40cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:37.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.396+0000 7fd3c3e00640 1 -- 172.21.15.55:0/2326554175 shutdown_connections 2024-04-02T07:26:37.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.396+0000 7fd3c3e00640 1 -- 172.21.15.55:0/2326554175 wait complete. 2024-04-02T07:26:37.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.396+0000 7fd3c3e00640 1 Processor -- start 2024-04-02T07:26:37.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3c3e00640 1 -- start start 2024-04-02T07:26:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3c3e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3c40aef60 0x7fd3c41f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3c3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3c40b09b0 0x7fd3c41f77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3c3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3c415cb60 0x7fd3c40c5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3c3e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40c5f60 con 0x7fd3c40b09b0 2024-04-02T07:26:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3c3e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40c59a0 con 0x7fd3c415cb60 2024-04-02T07:26:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3c3e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40c5c80 con 0x7fd3c40aef60 2024-04-02T07:26:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3bbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3c40b09b0 0x7fd3c41f77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3bbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3c40b09b0 0x7fd3c41f77a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42314/0 (socket says 172.21.15.55:42314) 2024-04-02T07:26:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3bbe00640 1 -- 172.21.15.55:0/3090151712 learned_addr learned my addr 172.21.15.55:0/3090151712 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3c3400640 1 --2- 172.21.15.55:0/3090151712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3c415cb60 0x7fd3c40c5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3c2a00640 1 --2- 172.21.15.55:0/3090151712 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3c40aef60 0x7fd3c41f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3bbe00640 1 -- 172.21.15.55:0/3090151712 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3c40aef60 msgr2=0x7fd3c41f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3bbe00640 1 --2- 172.21.15.55:0/3090151712 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3c40aef60 0x7fd3c41f4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3bbe00640 1 -- 172.21.15.55:0/3090151712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3c415cb60 msgr2=0x7fd3c40c5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3bbe00640 1 --2- 172.21.15.55:0/3090151712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3c415cb60 0x7fd3c40c5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3bbe00640 1 -- 172.21.15.55:0/3090151712 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b40094d0 con 0x7fd3c40b09b0 2024-04-02T07:26:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3bbe00640 1 --2- 172.21.15.55:0/3090151712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3c40b09b0 0x7fd3c41f77a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00c4d0 tx=0x7fd3ac00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3baa00640 1 -- 172.21.15.55:0/3090151712 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac0052d0 con 0x7fd3c40b09b0 2024-04-02T07:26:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3baa00640 1 -- 172.21.15.55:0/3090151712 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3ac005430 con 0x7fd3c40b09b0 2024-04-02T07:26:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3baa00640 1 -- 172.21.15.55:0/3090151712 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3ac012830 con 0x7fd3c40b09b0 2024-04-02T07:26:37.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3c3e00640 1 -- 172.21.15.55:0/3090151712 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c4155690 con 0x7fd3c40b09b0 2024-04-02T07:26:37.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3c3e00640 1 -- 172.21.15.55:0/3090151712 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c41f7ce0 con 0x7fd3c40b09b0 2024-04-02T07:26:37.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.400+0000 7fd3c3e00640 1 -- 172.21.15.55:0/3090151712 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c4073fa0 con 0x7fd3c40b09b0 2024-04-02T07:26:37.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.404+0000 7fd3baa00640 1 -- 172.21.15.55:0/3090151712 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd3ac012990 con 0x7fd3c40b09b0 2024-04-02T07:26:37.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.404+0000 7fd3baa00640 1 --2- 172.21.15.55:0/3090151712 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd3a0066690 0x7fd3a0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:37.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.404+0000 7fd3baa00640 1 -- 172.21.15.55:0/3090151712 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3ac083ad0 con 0x7fd3c40b09b0 2024-04-02T07:26:37.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.404+0000 7fd3c2a00640 1 --2- 172.21.15.55:0/3090151712 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd3a0066690 0x7fd3a0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:37.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.404+0000 7fd3c2a00640 1 --2- 172.21.15.55:0/3090151712 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd3a0066690 0x7fd3a0068b50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40ae000 tx=0x7fd3b40b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:37.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.408+0000 7fd3baa00640 1 -- 172.21.15.55:0/3090151712 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd3ac050f80 con 0x7fd3c40b09b0 2024-04-02T07:26:37.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.568+0000 7fd3c3e00640 1 -- 172.21.15.55:0/3090151712 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3c406d6a0 con 0x7fd3c40b09b0 2024-04-02T07:26:37.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.572+0000 7fd3baa00640 1 -- 172.21.15.55:0/3090151712 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v60) v1 ==== 74+0+16097 (secure 0 0 0) 0x7fd3ac0545a0 con 0x7fd3c40b09b0 2024-04-02T07:26:37.576 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:37.577 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":60,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:25:14.810503+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:25:12.332239+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"59","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-04-02T07:25:12.785664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:26:37.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.572+0000 7fd3c3e00640 1 -- 172.21.15.55:0/3090151712 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd3a0066690 msgr2=0x7fd3a0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:37.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.572+0000 7fd3c3e00640 1 --2- 172.21.15.55:0/3090151712 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd3a0066690 0x7fd3a0068b50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40ae000 tx=0x7fd3b40b3040 comp rx=0 tx=0).stop 2024-04-02T07:26:37.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.572+0000 7fd3c3e00640 1 -- 172.21.15.55:0/3090151712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3c40b09b0 msgr2=0x7fd3c41f77a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:37.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.572+0000 7fd3c3e00640 1 --2- 172.21.15.55:0/3090151712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3c40b09b0 0x7fd3c41f77a0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac00c4d0 tx=0x7fd3ac00c990 comp rx=0 tx=0).stop 2024-04-02T07:26:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.572+0000 7fd3c3e00640 1 -- 172.21.15.55:0/3090151712 shutdown_connections 2024-04-02T07:26:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.572+0000 7fd3c3e00640 1 --2- 172.21.15.55:0/3090151712 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd3a0066690 0x7fd3a0068b50 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.572+0000 7fd3c3e00640 1 --2- 172.21.15.55:0/3090151712 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd3c415cb60 0x7fd3c40c5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.572+0000 7fd3c3e00640 1 --2- 172.21.15.55:0/3090151712 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3c40b09b0 0x7fd3c41f77a0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.572+0000 7fd3c3e00640 1 --2- 172.21.15.55:0/3090151712 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3c40aef60 0x7fd3c41f4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.572+0000 7fd3c3e00640 1 -- 172.21.15.55:0/3090151712 >> 172.21.15.55:0/3090151712 conn(0x7fd3c4098a10 msgr2=0x7fd3c41591e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.572+0000 7fd3c3e00640 1 -- 172.21.15.55:0/3090151712 shutdown_connections 2024-04-02T07:26:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.572+0000 7fd3c3e00640 1 -- 172.21.15.55:0/3090151712 wait complete. 2024-04-02T07:26:37.598 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-02T07:26:37.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.732+0000 7fc18c400640 1 Processor -- start 2024-04-02T07:26:37.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.732+0000 7fc18c400640 1 -- start start 2024-04-02T07:26:37.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.732+0000 7fc18c400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc184159890 0x7fc1840cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:37.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.736+0000 7fc18c400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc184071440 0x7fc1840718a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:37.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.736+0000 7fc18c400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc18406ecc0 0x7fc18406f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:37.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.736+0000 7fc18c400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc184071de0 con 0x7fc184159890 2024-04-02T07:26:37.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.736+0000 7fc18c400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc184159c70 con 0x7fc18406ecc0 2024-04-02T07:26:37.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.736+0000 7fc18c400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1840cf2a0 con 0x7fc184071440 2024-04-02T07:26:37.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.736+0000 7fc189a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc184159890 0x7fc1840cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:37.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.736+0000 7fc189a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc184159890 0x7fc1840cd690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42324/0 (socket says 172.21.15.55:42324) 2024-04-02T07:26:37.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.736+0000 7fc189a00640 1 -- 172.21.15.55:0/2786351108 learned_addr learned my addr 172.21.15.55:0/2786351108 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:37.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.736+0000 7fc18a400640 1 --2- 172.21.15.55:0/2786351108 >> v2:172.21.15.106:3300/0 conn(0x7fc18406ecc0 0x7fc18406f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:37.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.736+0000 7fc189a00640 1 -- 172.21.15.55:0/2786351108 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc184071440 msgr2=0x7fc1840718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:37.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.736+0000 7fc189000640 1 --2- 172.21.15.55:0/2786351108 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc184071440 0x7fc1840718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:37.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.736+0000 7fc189a00640 1 --2- 172.21.15.55:0/2786351108 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc184071440 0x7fc1840718a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.736+0000 7fc189a00640 1 -- 172.21.15.55:0/2786351108 >> v2:172.21.15.106:3300/0 conn(0x7fc18406ecc0 msgr2=0x7fc18406f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:37.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.736+0000 7fc189a00640 1 --2- 172.21.15.55:0/2786351108 >> v2:172.21.15.106:3300/0 conn(0x7fc18406ecc0 0x7fc18406f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.736+0000 7fc189a00640 1 -- 172.21.15.55:0/2786351108 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1840cea00 con 0x7fc184159890 2024-04-02T07:26:37.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.736+0000 7fc18a400640 1 --2- 172.21.15.55:0/2786351108 >> v2:172.21.15.106:3300/0 conn(0x7fc18406ecc0 0x7fc18406f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:26:37.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.736+0000 7fc189000640 1 --2- 172.21.15.55:0/2786351108 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc184071440 0x7fc1840718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:26:37.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc189a00640 1 --2- 172.21.15.55:0/2786351108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc184159890 0x7fc1840cd690 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc184070870 tx=0x7fc17801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a71d7a4be41cf694 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:37.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc183e00640 1 -- 172.21.15.55:0/2786351108 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1780aa610 con 0x7fc184159890 2024-04-02T07:26:37.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc183e00640 1 -- 172.21.15.55:0/2786351108 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1780a6040 con 0x7fc184159890 2024-04-02T07:26:37.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc183e00640 1 -- 172.21.15.55:0/2786351108 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1780aa990 con 0x7fc184159890 2024-04-02T07:26:37.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc18c400640 1 -- 172.21.15.55:0/2786351108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc184159890 msgr2=0x7fc1840cd690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:37.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc18c400640 1 --2- 172.21.15.55:0/2786351108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc184159890 0x7fc1840cd690 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fc184070870 tx=0x7fc17801c4f0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc18c400640 1 -- 172.21.15.55:0/2786351108 shutdown_connections 2024-04-02T07:26:37.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc18c400640 1 --2- 172.21.15.55:0/2786351108 >> v2:172.21.15.106:3300/0 conn(0x7fc18406ecc0 0x7fc18406f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc18c400640 1 --2- 172.21.15.55:0/2786351108 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc184071440 0x7fc1840718a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc18c400640 1 --2- 172.21.15.55:0/2786351108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc184159890 0x7fc1840cd690 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc18c400640 1 -- 172.21.15.55:0/2786351108 >> 172.21.15.55:0/2786351108 conn(0x7fc1840b1420 msgr2=0x7fc1840b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:37.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc18c400640 1 -- 172.21.15.55:0/2786351108 shutdown_connections 2024-04-02T07:26:37.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc18c400640 1 -- 172.21.15.55:0/2786351108 wait complete. 2024-04-02T07:26:37.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc18c400640 1 Processor -- start 2024-04-02T07:26:37.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc18c400640 1 -- start start 2024-04-02T07:26:37.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc18c400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18406ecc0 0x7fc18415ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:37.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc18c400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc184071440 0x7fc18413eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:37.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc18c400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc184159890 0x7fc18415b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:37.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc18c400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18415a780 con 0x7fc18406ecc0 2024-04-02T07:26:37.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc18c400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc18415b150 con 0x7fc184159890 2024-04-02T07:26:37.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc18c400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc18415bf60 con 0x7fc184071440 2024-04-02T07:26:37.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc189a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18406ecc0 0x7fc18415ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:37.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc189a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18406ecc0 0x7fc18415ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42326/0 (socket says 172.21.15.55:42326) 2024-04-02T07:26:37.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc189a00640 1 -- 172.21.15.55:0/901063896 learned_addr learned my addr 172.21.15.55:0/901063896 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:37.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc18a400640 1 --2- 172.21.15.55:0/901063896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc184159890 0x7fc18415b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:37.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.740+0000 7fc189000640 1 --2- 172.21.15.55:0/901063896 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc184071440 0x7fc18413eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:37.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.744+0000 7fc189a00640 1 -- 172.21.15.55:0/901063896 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc184071440 msgr2=0x7fc18413eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:37.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.744+0000 7fc189a00640 1 --2- 172.21.15.55:0/901063896 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc184071440 0x7fc18413eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.744+0000 7fc189a00640 1 -- 172.21.15.55:0/901063896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc184159890 msgr2=0x7fc18415b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:37.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.744+0000 7fc189a00640 1 --2- 172.21.15.55:0/901063896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc184159890 0x7fc18415b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.744+0000 7fc189a00640 1 -- 172.21.15.55:0/901063896 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1780094d0 con 0x7fc18406ecc0 2024-04-02T07:26:37.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.744+0000 7fc189a00640 1 --2- 172.21.15.55:0/901063896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18406ecc0 0x7fc18415ac10 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fc1780ac040 tx=0x7fc17801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:37.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.744+0000 7fc181600640 1 -- 172.21.15.55:0/901063896 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1780bd5f0 con 0x7fc18406ecc0 2024-04-02T07:26:37.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.744+0000 7fc181600640 1 -- 172.21.15.55:0/901063896 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1780bd770 con 0x7fc18406ecc0 2024-04-02T07:26:37.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.744+0000 7fc181600640 1 -- 172.21.15.55:0/901063896 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1780bdb20 con 0x7fc18406ecc0 2024-04-02T07:26:37.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.744+0000 7fc18c400640 1 -- 172.21.15.55:0/901063896 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc184159e50 con 0x7fc18406ecc0 2024-04-02T07:26:37.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.744+0000 7fc18c400640 1 -- 172.21.15.55:0/901063896 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc18415a410 con 0x7fc18406ecc0 2024-04-02T07:26:37.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.744+0000 7fc18c400640 1 -- 172.21.15.55:0/901063896 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc184066c90 con 0x7fc18406ecc0 2024-04-02T07:26:37.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.744+0000 7fc181600640 1 -- 172.21.15.55:0/901063896 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc1780b33f0 con 0x7fc18406ecc0 2024-04-02T07:26:37.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.748+0000 7fc181600640 1 --2- 172.21.15.55:0/901063896 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc164066690 0x7fc164068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:37.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.748+0000 7fc181600640 1 -- 172.21.15.55:0/901063896 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc17811eec0 con 0x7fc18406ecc0 2024-04-02T07:26:37.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.748+0000 7fc189000640 1 --2- 172.21.15.55:0/901063896 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc164066690 0x7fc164068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:37.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.748+0000 7fc189000640 1 --2- 172.21.15.55:0/901063896 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc164066690 0x7fc164068b50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc1841f6940 tx=0x7fc170008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:37.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.752+0000 7fc181600640 1 -- 172.21.15.55:0/901063896 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc1780ec1b0 con 0x7fc18406ecc0 2024-04-02T07:26:37.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.944+0000 7fc18c400640 1 -- 172.21.15.55:0/901063896 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc18413f420 con 0x7fc18406ecc0 2024-04-02T07:26:37.950 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-02T07:26:37.944+0000 7f8f18800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-02T07:26:37.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.964+0000 7fc181600640 1 -- 172.21.15.55:0/901063896 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v36) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc1780c3070 con 0x7fc18406ecc0 2024-04-02T07:26:37.969 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-02T07:26:37.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.964+0000 7fc18c400640 1 -- 172.21.15.55:0/901063896 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc164066690 msgr2=0x7fc164068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:37.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.964+0000 7fc18c400640 1 --2- 172.21.15.55:0/901063896 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc164066690 0x7fc164068b50 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc1841f6940 tx=0x7fc170008040 comp rx=0 tx=0).stop 2024-04-02T07:26:37.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.964+0000 7fc18c400640 1 -- 172.21.15.55:0/901063896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18406ecc0 msgr2=0x7fc18415ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:37.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.964+0000 7fc18c400640 1 --2- 172.21.15.55:0/901063896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18406ecc0 0x7fc18415ac10 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7fc1780ac040 tx=0x7fc17801ad30 comp rx=0 tx=0).stop 2024-04-02T07:26:37.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.964+0000 7fc18c400640 1 -- 172.21.15.55:0/901063896 shutdown_connections 2024-04-02T07:26:37.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.964+0000 7fc18c400640 1 --2- 172.21.15.55:0/901063896 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc164066690 0x7fc164068b50 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.964+0000 7fc18c400640 1 --2- 172.21.15.55:0/901063896 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc184159890 0x7fc18415b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.964+0000 7fc18c400640 1 --2- 172.21.15.55:0/901063896 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc184071440 0x7fc18413eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.964+0000 7fc18c400640 1 --2- 172.21.15.55:0/901063896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc18406ecc0 0x7fc18415ac10 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:37.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.964+0000 7fc18c400640 1 -- 172.21.15.55:0/901063896 >> 172.21.15.55:0/901063896 conn(0x7fc1840b1420 msgr2=0x7fc1840aff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:37.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.964+0000 7fc18c400640 1 -- 172.21.15.55:0/901063896 shutdown_connections 2024-04-02T07:26:37.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:37.964+0000 7fc18c400640 1 -- 172.21.15.55:0/901063896 wait complete. 2024-04-02T07:26:37.980 INFO:tasks.ceph.mds.d.smithi106.stderr: -6381> 2024-04-02T07:25:15.319+0000 7f442f000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:26:37.984 INFO:tasks.ceph.mds.d.smithi106.stderr: -4587> 2024-04-02T07:25:28.683+0000 7f442aa00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) (iversion lock) cr={6327=0-4194304@1} caps={6327=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@2},l=6327 | request=0 caps=1 dirtyparent=0 dirty=0 authpin=1 scrubqueue=0 0x563cd6c1bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v2>,<0x1/dir_test v4>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-02T07:26:37.986 INFO:tasks.ceph.mds.d.smithi106.stderr: -2763> 2024-04-02T07:26:00.283+0000 7f442aa00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [2,head] /dir_test/file auth v4 ap=1 DIRTYPARENT s=0 n(v0 rc2024-04-02T07:25:27.335533+0000 1=1+0) (iversion lock) caps={6327=pAsLsXsFs/-@2},l=6327(-1) | ptrwaiter=0 request=0 lock=0 caps=1 dirtyparent=1 dirty=1 authpin=1 scrubqueue=0 0x563cd6c1bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(9)0x10000000001:[<0x10000000000/file v4>,<0x1/dir_test v7>]//[]","error_str":"failed to decode on-disk backtrace (26 bytes)!"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-02T07:26:37.991 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-02T07:26:38.030 INFO:tasks.ceph.mds.d.smithi106.stdout:starting mds.d at 2024-04-02T07:26:38.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.128+0000 7f1445e00640 1 Processor -- start 2024-04-02T07:26:38.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.128+0000 7f1445e00640 1 -- start start 2024-04-02T07:26:38.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.128+0000 7f1445e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1440098a10 0x7f1440098e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:38.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.128+0000 7f1445e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f144006b920 0x7f144006bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:38.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.128+0000 7f1445e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f144015ce40 con 0x7f144015ca60 2024-04-02T07:26:38.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.128+0000 7f1445e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14400993c0 con 0x7f1440098a10 2024-04-02T07:26:38.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.128+0000 7f1445e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14400ceeb0 con 0x7f144006b920 2024-04-02T07:26:38.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.132+0000 7f143ea00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f144015ca60 0x7f14400cfc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57046/0 (socket says 172.21.15.55:57046) 2024-04-02T07:26:38.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.132+0000 7f143ea00640 1 -- 172.21.15.55:0/2066466041 learned_addr learned my addr 172.21.15.55:0/2066466041 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:26:38.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.132+0000 7f1437e00640 1 --2- 172.21.15.55:0/2066466041 >> v2:172.21.15.55:3300/0 conn(0x7f1440098a10 0x7f1440098e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:38.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.132+0000 7f143f400640 1 --2- 172.21.15.55:0/2066466041 >> v2:172.21.15.106:3300/0 conn(0x7f144006b920 0x7f144006bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:38.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.132+0000 7f1437e00640 1 -- 172.21.15.55:0/2066466041 >> v2:172.21.15.106:3300/0 conn(0x7f144006b920 msgr2=0x7f144006bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:38.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.132+0000 7f1437e00640 1 --2- 172.21.15.55:0/2066466041 >> v2:172.21.15.106:3300/0 conn(0x7f144006b920 0x7f144006bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:38.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.132+0000 7f1437e00640 1 -- 172.21.15.55:0/2066466041 >> v1:172.21.15.55:6789/0 conn(0x7f144015ca60 legacy=0x7f14400cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:38.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.132+0000 7f143e000640 1 -- 172.21.15.55:0/2066466041 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3334339260 0 0) 0x7f144015ce40 con 0x7f144015ca60 2024-04-02T07:26:38.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.132+0000 7f1437e00640 1 -- 172.21.15.55:0/2066466041 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14400cf190 con 0x7f1440098a10 2024-04-02T07:26:38.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.132+0000 7f1437e00640 1 --2- 172.21.15.55:0/2066466041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1440098a10 0x7f1440098e80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f144009e5a0 tx=0x7f142801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311569e1255f73af server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:38.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.132+0000 7f143e000640 1 -- 172.21.15.55:0/2066466041 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14280ac620 con 0x7f1440098a10 2024-04-02T07:26:38.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.132+0000 7f143e000640 1 -- 172.21.15.55:0/2066466041 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14280ac780 con 0x7f1440098a10 2024-04-02T07:26:38.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.132+0000 7f143e000640 1 -- 172.21.15.55:0/2066466041 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14280acb10 con 0x7f1440098a10 2024-04-02T07:26:38.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f1445e00640 1 -- 172.21.15.55:0/2066466041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1440098a10 msgr2=0x7f1440098e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:38.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f1445e00640 1 --2- 172.21.15.55:0/2066466041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1440098a10 0x7f1440098e80 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f144009e5a0 tx=0x7f142801c3c0 comp rx=0 tx=0).stop 2024-04-02T07:26:38.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f1445e00640 1 -- 172.21.15.55:0/2066466041 shutdown_connections 2024-04-02T07:26:38.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f1445e00640 1 --2- 172.21.15.55:0/2066466041 >> v2:172.21.15.106:3300/0 conn(0x7f144006b920 0x7f144006bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:38.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f1445e00640 1 --2- 172.21.15.55:0/2066466041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1440098a10 0x7f1440098e80 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:38.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f1445e00640 1 -- 172.21.15.55:0/2066466041 >> 172.21.15.55:0/2066466041 conn(0x7f14400b2150 msgr2=0x7f14400b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:38.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f1445e00640 1 -- 172.21.15.55:0/2066466041 shutdown_connections 2024-04-02T07:26:38.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f1445e00640 1 -- 172.21.15.55:0/2066466041 wait complete. 2024-04-02T07:26:38.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f1445e00640 1 Processor -- start 2024-04-02T07:26:38.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f1445e00640 1 -- start start 2024-04-02T07:26:38.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f1445e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f144006b920 0x7f1440148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:38.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f1445e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1440098a10 0x7f14400c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:38.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f1445e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f144015ca60 0x7f14400c7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:38.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f1445e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1440149020 con 0x7f144006b920 2024-04-02T07:26:38.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f1445e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14400b6020 con 0x7f144015ca60 2024-04-02T07:26:38.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f1445e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14401f4d20 con 0x7f1440098a10 2024-04-02T07:26:38.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f143ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f144006b920 0x7f1440148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:38.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f143ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f144006b920 0x7f1440148ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42334/0 (socket says 172.21.15.55:42334) 2024-04-02T07:26:38.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f143ea00640 1 -- 172.21.15.55:0/3061586885 learned_addr learned my addr 172.21.15.55:0/3061586885 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:38.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f143ea00640 1 -- 172.21.15.55:0/3061586885 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1440098a10 msgr2=0x7f14400c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:38.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f143ea00640 1 --2- 172.21.15.55:0/3061586885 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1440098a10 0x7f14400c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:38.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f143ea00640 1 -- 172.21.15.55:0/3061586885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f144015ca60 msgr2=0x7f14400c7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:38.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f143f400640 1 --2- 172.21.15.55:0/3061586885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f144015ca60 0x7f14400c7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:38.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f143ea00640 1 --2- 172.21.15.55:0/3061586885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f144015ca60 0x7f14400c7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:38.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f143ea00640 1 -- 172.21.15.55:0/3061586885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1428009420 con 0x7f144006b920 2024-04-02T07:26:38.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f143f400640 1 --2- 172.21.15.55:0/3061586885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f144015ca60 0x7f14400c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:26:38.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f143ea00640 1 --2- 172.21.15.55:0/3061586885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f144006b920 0x7f1440148ae0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f143000c480 tx=0x7f143000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:38.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.136+0000 7f1437400640 1 -- 172.21.15.55:0/3061586885 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14300074e0 con 0x7f144006b920 2024-04-02T07:26:38.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.140+0000 7f1437400640 1 -- 172.21.15.55:0/3061586885 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1430007660 con 0x7f144006b920 2024-04-02T07:26:38.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.140+0000 7f1437400640 1 -- 172.21.15.55:0/3061586885 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1430004a30 con 0x7f144006b920 2024-04-02T07:26:38.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.140+0000 7f1445e00640 1 -- 172.21.15.55:0/3061586885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14400c8280 con 0x7f144006b920 2024-04-02T07:26:38.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.140+0000 7f1445e00640 1 -- 172.21.15.55:0/3061586885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14400c8840 con 0x7f144006b920 2024-04-02T07:26:38.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.140+0000 7f1445e00640 1 -- 172.21.15.55:0/3061586885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1440066c90 con 0x7f144006b920 2024-04-02T07:26:38.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.140+0000 7f1437400640 1 -- 172.21.15.55:0/3061586885 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1430004b90 con 0x7f144006b920 2024-04-02T07:26:38.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.140+0000 7f1437400640 1 --2- 172.21.15.55:0/3061586885 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f141c066690 0x7f141c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:38.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.140+0000 7f1437400640 1 -- 172.21.15.55:0/3061586885 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f14300833e0 con 0x7f144006b920 2024-04-02T07:26:38.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.140+0000 7f1437e00640 1 --2- 172.21.15.55:0/3061586885 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f141c066690 0x7f141c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:38.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.140+0000 7f1437e00640 1 --2- 172.21.15.55:0/3061586885 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f141c066690 0x7f141c068b50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f14280ae000 tx=0x7f1428008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:38.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.148+0000 7f1437400640 1 -- 172.21.15.55:0/3061586885 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f1430054170 con 0x7f144006b920 2024-04-02T07:26:38.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.340+0000 7f1445e00640 1 -- 172.21.15.55:0/3061586885 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f14400b2ff0 con 0x7f144006b920 2024-04-02T07:26:38.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.968+0000 7f1437400640 1 -- 172.21.15.55:0/3061586885 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1430053d00 con 0x7f144006b920 2024-04-02T07:26:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.972+0000 7f1445e00640 1 -- 172.21.15.55:0/3061586885 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f141c066690 msgr2=0x7f141c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.972+0000 7f1445e00640 1 --2- 172.21.15.55:0/3061586885 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f141c066690 0x7f141c068b50 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f14280ae000 tx=0x7f1428008040 comp rx=0 tx=0).stop 2024-04-02T07:26:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.972+0000 7f1445e00640 1 -- 172.21.15.55:0/3061586885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f144006b920 msgr2=0x7f1440148ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.972+0000 7f1445e00640 1 --2- 172.21.15.55:0/3061586885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f144006b920 0x7f1440148ae0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f143000c480 tx=0x7f143000c940 comp rx=0 tx=0).stop 2024-04-02T07:26:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.972+0000 7f1445e00640 1 -- 172.21.15.55:0/3061586885 shutdown_connections 2024-04-02T07:26:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.972+0000 7f1445e00640 1 --2- 172.21.15.55:0/3061586885 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f141c066690 0x7f141c068b50 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.972+0000 7f1445e00640 1 --2- 172.21.15.55:0/3061586885 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f144015ca60 0x7f14400c7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.972+0000 7f1445e00640 1 --2- 172.21.15.55:0/3061586885 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1440098a10 0x7f14400c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:38.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.972+0000 7f1445e00640 1 --2- 172.21.15.55:0/3061586885 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f144006b920 0x7f1440148ae0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:38.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.972+0000 7f1445e00640 1 -- 172.21.15.55:0/3061586885 >> 172.21.15.55:0/3061586885 conn(0x7f14400b2150 msgr2=0x7f14400cfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:38.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.972+0000 7f1445e00640 1 -- 172.21.15.55:0/3061586885 shutdown_connections 2024-04-02T07:26:38.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:38.972+0000 7f1445e00640 1 -- 172.21.15.55:0/3061586885 wait complete. 2024-04-02T07:26:39.001 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-02T07:26:39.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.144+0000 7f0d36800640 1 Processor -- start 2024-04-02T07:26:39.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.144+0000 7f0d36800640 1 -- start start 2024-04-02T07:26:39.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.144+0000 7f0d36800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0d3015ce40 0x7f0d300b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:39.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.144+0000 7f0d36800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0d3006d1c0 0x7f0d300b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.144+0000 7f0d36800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d300afe70 0x7f0d300b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.144+0000 7f0d36800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d3006cda0 con 0x7f0d3015ce40 2024-04-02T07:26:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.144+0000 7f0d36800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d300b3c60 con 0x7f0d3006d1c0 2024-04-02T07:26:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.144+0000 7f0d36800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d300b1d60 con 0x7f0d300afe70 2024-04-02T07:26:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.144+0000 7f0d2f400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0d3015ce40 0x7f0d300b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.144+0000 7f0d2f400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0d3015ce40 0x7f0d300b1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42346/0 (socket says 172.21.15.55:42346) 2024-04-02T07:26:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.144+0000 7f0d2f400640 1 -- 172.21.15.55:0/1217618698 learned_addr learned my addr 172.21.15.55:0/1217618698 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.144+0000 7f0d26a00640 1 --2- 172.21.15.55:0/1217618698 >> v2:172.21.15.106:3300/0 conn(0x7f0d3006d1c0 0x7f0d300b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.144+0000 7f0d2fe00640 1 --2- 172.21.15.55:0/1217618698 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d300afe70 0x7f0d300b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.144+0000 7f0d2f400640 1 -- 172.21.15.55:0/1217618698 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d300afe70 msgr2=0x7f0d300b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.144+0000 7f0d2f400640 1 --2- 172.21.15.55:0/1217618698 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d300afe70 0x7f0d300b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.144+0000 7f0d2f400640 1 -- 172.21.15.55:0/1217618698 >> v2:172.21.15.106:3300/0 conn(0x7f0d3006d1c0 msgr2=0x7f0d300b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:39.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.144+0000 7f0d2f400640 1 --2- 172.21.15.55:0/1217618698 >> v2:172.21.15.106:3300/0 conn(0x7f0d3006d1c0 0x7f0d300b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:39.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.148+0000 7f0d2f400640 1 -- 172.21.15.55:0/1217618698 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d3006c400 con 0x7f0d3015ce40 2024-04-02T07:26:39.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.148+0000 7f0d2f400640 1 --2- 172.21.15.55:0/1217618698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d3015ce40 0x7f0d300b1780 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f0d3006aad0 tx=0x7f0d2001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7078c6c450dec64 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:39.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.148+0000 7f0d2ea00640 1 -- 172.21.15.55:0/1217618698 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d200ab600 con 0x7f0d3015ce40 2024-04-02T07:26:39.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.148+0000 7f0d2ea00640 1 -- 172.21.15.55:0/1217618698 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d200a7050 con 0x7f0d3015ce40 2024-04-02T07:26:39.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.148+0000 7f0d2ea00640 1 -- 172.21.15.55:0/1217618698 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d200ab980 con 0x7f0d3015ce40 2024-04-02T07:26:39.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.148+0000 7f0d36800640 1 -- 172.21.15.55:0/1217618698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d3015ce40 msgr2=0x7f0d300b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:39.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.148+0000 7f0d36800640 1 --2- 172.21.15.55:0/1217618698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d3015ce40 0x7f0d300b1780 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f0d3006aad0 tx=0x7f0d2001c490 comp rx=0 tx=0).stop 2024-04-02T07:26:39.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d36800640 1 -- 172.21.15.55:0/1217618698 shutdown_connections 2024-04-02T07:26:39.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d36800640 1 --2- 172.21.15.55:0/1217618698 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d300afe70 0x7f0d300b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:39.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d36800640 1 --2- 172.21.15.55:0/1217618698 >> v2:172.21.15.106:3300/0 conn(0x7f0d3006d1c0 0x7f0d300b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:39.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d36800640 1 --2- 172.21.15.55:0/1217618698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d3015ce40 0x7f0d300b1780 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:39.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d36800640 1 -- 172.21.15.55:0/1217618698 >> 172.21.15.55:0/1217618698 conn(0x7f0d30069d90 msgr2=0x7f0d3006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:39.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d36800640 1 -- 172.21.15.55:0/1217618698 shutdown_connections 2024-04-02T07:26:39.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d36800640 1 -- 172.21.15.55:0/1217618698 wait complete. 2024-04-02T07:26:39.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d36800640 1 Processor -- start 2024-04-02T07:26:39.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d36800640 1 -- start start 2024-04-02T07:26:39.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d36800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d3006d1c0 0x7f0d300c7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:39.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d36800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d300afe70 0x7f0d300c3730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:39.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d36800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d3015ce40 0x7f0d300c72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:39.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d36800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d300c50e0 con 0x7f0d3015ce40 2024-04-02T07:26:39.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d36800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d300c3c70 con 0x7f0d300afe70 2024-04-02T07:26:39.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d36800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d300c84d0 con 0x7f0d3006d1c0 2024-04-02T07:26:39.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d2fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d3015ce40 0x7f0d300c72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:39.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d2fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d3015ce40 0x7f0d300c72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42350/0 (socket says 172.21.15.55:42350) 2024-04-02T07:26:39.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d2fe00640 1 -- 172.21.15.55:0/170413422 learned_addr learned my addr 172.21.15.55:0/170413422 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:39.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d26a00640 1 --2- 172.21.15.55:0/170413422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d300afe70 0x7f0d300c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:39.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d2f400640 1 --2- 172.21.15.55:0/170413422 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d3006d1c0 0x7f0d300c7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:39.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d2fe00640 1 -- 172.21.15.55:0/170413422 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d3006d1c0 msgr2=0x7f0d300c7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:39.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d2fe00640 1 --2- 172.21.15.55:0/170413422 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d3006d1c0 0x7f0d300c7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:39.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d2fe00640 1 -- 172.21.15.55:0/170413422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d300afe70 msgr2=0x7f0d300c3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:39.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d2fe00640 1 --2- 172.21.15.55:0/170413422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d300afe70 0x7f0d300c3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:39.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d2fe00640 1 -- 172.21.15.55:0/170413422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d200094d0 con 0x7f0d3015ce40 2024-04-02T07:26:39.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d2f400640 1 --2- 172.21.15.55:0/170413422 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d3006d1c0 0x7f0d300c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:26:39.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.152+0000 7f0d2fe00640 1 --2- 172.21.15.55:0/170413422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d3015ce40 0x7f0d300c72e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800efc0 tx=0x7f0d2800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:39.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.156+0000 7f0d27e00640 1 -- 172.21.15.55:0/170413422 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d28014480 con 0x7f0d3015ce40 2024-04-02T07:26:39.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.156+0000 7f0d27e00640 1 -- 172.21.15.55:0/170413422 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d2800f040 con 0x7f0d3015ce40 2024-04-02T07:26:39.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.156+0000 7f0d27e00640 1 -- 172.21.15.55:0/170413422 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d28014820 con 0x7f0d3015ce40 2024-04-02T07:26:39.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.156+0000 7f0d36800640 1 -- 172.21.15.55:0/170413422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d300c6800 con 0x7f0d3015ce40 2024-04-02T07:26:39.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.156+0000 7f0d36800640 1 -- 172.21.15.55:0/170413422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d300c6dc0 con 0x7f0d3015ce40 2024-04-02T07:26:39.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.156+0000 7f0d36800640 1 -- 172.21.15.55:0/170413422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d3006e270 con 0x7f0d3015ce40 2024-04-02T07:26:39.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.156+0000 7f0d27e00640 1 -- 172.21.15.55:0/170413422 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f0d28014980 con 0x7f0d3015ce40 2024-04-02T07:26:39.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.160+0000 7f0d27e00640 1 --2- 172.21.15.55:0/170413422 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0d0c066690 0x7f0d0c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:39.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.160+0000 7f0d27e00640 1 -- 172.21.15.55:0/170413422 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f0d28084d40 con 0x7f0d3015ce40 2024-04-02T07:26:39.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.160+0000 7f0d2f400640 1 --2- 172.21.15.55:0/170413422 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0d0c066690 0x7f0d0c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:39.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.160+0000 7f0d2f400640 1 --2- 172.21.15.55:0/170413422 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0d0c066690 0x7f0d0c068b50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0d300b1520 tx=0x7f0d200a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:39.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.164+0000 7f0d27e00640 1 -- 172.21.15.55:0/170413422 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0d28052040 con 0x7f0d3015ce40 2024-04-02T07:26:39.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:39.324+0000 7f0d36800640 1 -- 172.21.15.55:0/170413422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0d300c6fe0 con 0x7f0d3015ce40 2024-04-02T07:26:40.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.184+0000 7f0d27e00640 1 -- 172.21.15.55:0/170413422 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v62) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0d280180d0 con 0x7f0d3015ce40 2024-04-02T07:26:40.191 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2024-04-02T07:26:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.188+0000 7f0d36800640 1 -- 172.21.15.55:0/170413422 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0d0c066690 msgr2=0x7f0d0c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.188+0000 7f0d36800640 1 --2- 172.21.15.55:0/170413422 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0d0c066690 0x7f0d0c068b50 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f0d300b1520 tx=0x7f0d200a6000 comp rx=0 tx=0).stop 2024-04-02T07:26:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.188+0000 7f0d36800640 1 -- 172.21.15.55:0/170413422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d3015ce40 msgr2=0x7f0d300c72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.188+0000 7f0d36800640 1 --2- 172.21.15.55:0/170413422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d3015ce40 0x7f0d300c72e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f0d2800efc0 tx=0x7f0d2800c490 comp rx=0 tx=0).stop 2024-04-02T07:26:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.188+0000 7f0d36800640 1 -- 172.21.15.55:0/170413422 shutdown_connections 2024-04-02T07:26:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.188+0000 7f0d36800640 1 --2- 172.21.15.55:0/170413422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0d3015ce40 0x7f0d300c72e0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.188+0000 7f0d36800640 1 --2- 172.21.15.55:0/170413422 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0d0c066690 0x7f0d0c068b50 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.188+0000 7f0d36800640 1 --2- 172.21.15.55:0/170413422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0d300afe70 0x7f0d300c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.188+0000 7f0d36800640 1 --2- 172.21.15.55:0/170413422 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0d3006d1c0 0x7f0d300c7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:40.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.188+0000 7f0d36800640 1 -- 172.21.15.55:0/170413422 >> 172.21.15.55:0/170413422 conn(0x7f0d30069d90 msgr2=0x7f0d300c90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:40.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.188+0000 7f0d36800640 1 -- 172.21.15.55:0/170413422 shutdown_connections 2024-04-02T07:26:40.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.188+0000 7f0d36800640 1 -- 172.21.15.55:0/170413422 wait complete. 2024-04-02T07:26:40.223 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-02T07:26:40.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.364+0000 7fd4eac00640 1 Processor -- start 2024-04-02T07:26:40.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.364+0000 7fd4eac00640 1 -- start start 2024-04-02T07:26:40.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.364+0000 7fd4eac00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4e40cb5b0 0x7fd4e406ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:40.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.364+0000 7fd4eac00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e40ca030 con 0x7fd4e415aa40 2024-04-02T07:26:40.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.364+0000 7fd4eac00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4e40c9420 con 0x7fd4e40af920 2024-04-02T07:26:40.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.364+0000 7fd4eac00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4e40c9700 con 0x7fd4e40cb5b0 2024-04-02T07:26:40.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.364+0000 7fd4dbe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd4e40cb5b0 0x7fd4e406ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:40.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.364+0000 7fd4e3e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd4e415aa40 0x7fd4e40caea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57056/0 (socket says 172.21.15.55:57056) 2024-04-02T07:26:40.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.364+0000 7fd4e3e00640 1 -- 172.21.15.55:0/57379629 learned_addr learned my addr 172.21.15.55:0/57379629 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:26:40.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.368+0000 7fd4dbe00640 1 -- 172.21.15.55:0/57379629 >> v1:172.21.15.106:6789/0 conn(0x7fd4e40af920 legacy=0x7fd4e406cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:40.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.368+0000 7fd4dbe00640 1 -- 172.21.15.55:0/57379629 >> v1:172.21.15.55:6789/0 conn(0x7fd4e415aa40 legacy=0x7fd4e40caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:40.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.368+0000 7fd4dbe00640 1 -- 172.21.15.55:0/57379629 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e40c99e0 con 0x7fd4e40cb5b0 2024-04-02T07:26:40.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.368+0000 7fd4e3400640 1 -- 172.21.15.55:0/57379629 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 838683167 0 0) 0x7fd4e40ca030 con 0x7fd4e415aa40 2024-04-02T07:26:40.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.368+0000 7fd4dbe00640 1 --2- 172.21.15.55:0/57379629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4e40cb5b0 0x7fd4e406ca00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0097c0 tx=0x7fd4e406de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f91fcead49f85854 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:40.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.368+0000 7fd4e3400640 1 -- 172.21.15.55:0/57379629 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc0ab650 con 0x7fd4e40cb5b0 2024-04-02T07:26:40.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.368+0000 7fd4e3400640 1 -- 172.21.15.55:0/57379629 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4cc0ab7b0 con 0x7fd4e40cb5b0 2024-04-02T07:26:40.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.368+0000 7fd4e3400640 1 -- 172.21.15.55:0/57379629 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4cc0abb40 con 0x7fd4e40cb5b0 2024-04-02T07:26:40.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.368+0000 7fd4eac00640 1 -- 172.21.15.55:0/57379629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4e40cb5b0 msgr2=0x7fd4e406ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:40.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.368+0000 7fd4eac00640 1 --2- 172.21.15.55:0/57379629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4e40cb5b0 0x7fd4e406ca00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fd4cc0097c0 tx=0x7fd4e406de60 comp rx=0 tx=0).stop 2024-04-02T07:26:40.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4eac00640 1 -- 172.21.15.55:0/57379629 shutdown_connections 2024-04-02T07:26:40.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4eac00640 1 --2- 172.21.15.55:0/57379629 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4e40cb5b0 0x7fd4e406ca00 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:40.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4eac00640 1 -- 172.21.15.55:0/57379629 >> 172.21.15.55:0/57379629 conn(0x7fd4e4069d90 msgr2=0x7fd4e406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:40.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4eac00640 1 -- 172.21.15.55:0/57379629 shutdown_connections 2024-04-02T07:26:40.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4eac00640 1 -- 172.21.15.55:0/57379629 wait complete. 2024-04-02T07:26:40.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4eac00640 1 Processor -- start 2024-04-02T07:26:40.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4eac00640 1 -- start start 2024-04-02T07:26:40.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4eac00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4e40af920 0x7fd4e4154d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:40.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4eac00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4e40cb5b0 0x7fd4e4159a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4eac00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4e415aa40 0x7fd4e414ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4eac00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e4155940 con 0x7fd4e415aa40 2024-04-02T07:26:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4eac00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e4143550 con 0x7fd4e40cb5b0 2024-04-02T07:26:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4eac00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4e4155380 con 0x7fd4e40af920 2024-04-02T07:26:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4e8c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4e415aa40 0x7fd4e414ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4e8c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4e415aa40 0x7fd4e414ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42358/0 (socket says 172.21.15.55:42358) 2024-04-02T07:26:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4e8c00640 1 -- 172.21.15.55:0/2748671407 learned_addr learned my addr 172.21.15.55:0/2748671407 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4e3e00640 1 --2- 172.21.15.55:0/2748671407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4e40af920 0x7fd4e4154d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4dbe00640 1 --2- 172.21.15.55:0/2748671407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4e40cb5b0 0x7fd4e4159a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4e8c00640 1 -- 172.21.15.55:0/2748671407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4e40af920 msgr2=0x7fd4e4154d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4e8c00640 1 --2- 172.21.15.55:0/2748671407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4e40af920 0x7fd4e4154d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4e8c00640 1 -- 172.21.15.55:0/2748671407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4e40cb5b0 msgr2=0x7fd4e4159a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4e8c00640 1 --2- 172.21.15.55:0/2748671407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4e40cb5b0 0x7fd4e4159a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:40.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4e8c00640 1 -- 172.21.15.55:0/2748671407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4cc009420 con 0x7fd4e415aa40 2024-04-02T07:26:40.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4e8c00640 1 --2- 172.21.15.55:0/2748671407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4e415aa40 0x7fd4e414ec10 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00c780 tx=0x7fd4dc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:40.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4e0c00640 1 -- 172.21.15.55:0/2748671407 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc00a9f0 con 0x7fd4e415aa40 2024-04-02T07:26:40.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.372+0000 7fd4e0c00640 1 -- 172.21.15.55:0/2748671407 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4dc00ce90 con 0x7fd4e415aa40 2024-04-02T07:26:40.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.376+0000 7fd4e0c00640 1 -- 172.21.15.55:0/2748671407 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4dc00add0 con 0x7fd4e415aa40 2024-04-02T07:26:40.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.376+0000 7fd4eac00640 1 -- 172.21.15.55:0/2748671407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4e4155660 con 0x7fd4e415aa40 2024-04-02T07:26:40.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.376+0000 7fd4eac00640 1 -- 172.21.15.55:0/2748671407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4e4159fd0 con 0x7fd4e415aa40 2024-04-02T07:26:40.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.376+0000 7fd4eac00640 1 -- 172.21.15.55:0/2748671407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4e4143040 con 0x7fd4e415aa40 2024-04-02T07:26:40.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.376+0000 7fd4e0c00640 1 -- 172.21.15.55:0/2748671407 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd4dc012420 con 0x7fd4e415aa40 2024-04-02T07:26:40.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.376+0000 7fd4e0c00640 1 --2- 172.21.15.55:0/2748671407 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd4c0066690 0x7fd4c0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:40.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.376+0000 7fd4e0c00640 1 -- 172.21.15.55:0/2748671407 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fd4dc083e50 con 0x7fd4e415aa40 2024-04-02T07:26:40.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.376+0000 7fd4e3e00640 1 --2- 172.21.15.55:0/2748671407 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd4c0066690 0x7fd4c0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:40.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.376+0000 7fd4e3e00640 1 --2- 172.21.15.55:0/2748671407 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd4c0066690 0x7fd4c0068b50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4000f70 tx=0x7fd4d4007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:40.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.380+0000 7fd4e0c00640 1 -- 172.21.15.55:0/2748671407 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd4e4143040 con 0x7fd4e415aa40 2024-04-02T07:26:40.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:40.544+0000 7fd4eac00640 1 -- 172.21.15.55:0/2748671407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd4e4143700 con 0x7fd4e415aa40 2024-04-02T07:26:41.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.196+0000 7fd4e0c00640 1 -- 172.21.15.55:0/2748671407 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v63) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd4e4143700 con 0x7fd4e415aa40 2024-04-02T07:26:41.203 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2024-04-02T07:26:41.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.200+0000 7fd4eac00640 1 -- 172.21.15.55:0/2748671407 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd4c0066690 msgr2=0x7fd4c0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:41.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.200+0000 7fd4eac00640 1 --2- 172.21.15.55:0/2748671407 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd4c0066690 0x7fd4c0068b50 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd4d4000f70 tx=0x7fd4d4007df0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.200+0000 7fd4eac00640 1 -- 172.21.15.55:0/2748671407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4e415aa40 msgr2=0x7fd4e414ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.200+0000 7fd4eac00640 1 --2- 172.21.15.55:0/2748671407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4e415aa40 0x7fd4e414ec10 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fd4dc00c780 tx=0x7fd4dc00cc40 comp rx=0 tx=0).stop 2024-04-02T07:26:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.200+0000 7fd4eac00640 1 -- 172.21.15.55:0/2748671407 shutdown_connections 2024-04-02T07:26:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.200+0000 7fd4eac00640 1 --2- 172.21.15.55:0/2748671407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd4e415aa40 0x7fd4e414ec10 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.200+0000 7fd4eac00640 1 --2- 172.21.15.55:0/2748671407 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd4c0066690 0x7fd4c0068b50 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.200+0000 7fd4eac00640 1 --2- 172.21.15.55:0/2748671407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd4e40cb5b0 0x7fd4e4159a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.200+0000 7fd4eac00640 1 --2- 172.21.15.55:0/2748671407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd4e40af920 0x7fd4e4154d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.200+0000 7fd4eac00640 1 -- 172.21.15.55:0/2748671407 >> 172.21.15.55:0/2748671407 conn(0x7fd4e4069d90 msgr2=0x7fd4e4156fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.200+0000 7fd4eac00640 1 -- 172.21.15.55:0/2748671407 shutdown_connections 2024-04-02T07:26:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.200+0000 7fd4eac00640 1 -- 172.21.15.55:0/2748671407 wait complete. 2024-04-02T07:26:41.230 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-02T07:26:41.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.368+0000 7f4d81000640 1 Processor -- start 2024-04-02T07:26:41.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.368+0000 7f4d81000640 1 -- start start 2024-04-02T07:26:41.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.368+0000 7f4d81000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d7c159900 0x7f4d7c0ce130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:41.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.368+0000 7f4d81000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4d7c0ce670 0x7f4d7c0b3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:41.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.368+0000 7f4d81000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d7c0cff60 con 0x7f4d7c0b42e0 2024-04-02T07:26:41.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.368+0000 7f4d81000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d7c159ce0 con 0x7f4d7c0ce670 2024-04-02T07:26:41.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.368+0000 7f4d81000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0b4770 con 0x7f4d7c159900 2024-04-02T07:26:41.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d7a800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4d7c0b42e0 0x7f4d7c0713d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57060/0 (socket says 172.21.15.55:57060) 2024-04-02T07:26:41.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d7a800640 1 -- 172.21.15.55:0/1198782751 learned_addr learned my addr 172.21.15.55:0/1198782751 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:26:41.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79e00640 1 --2- 172.21.15.55:0/1198782751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d7c159900 0x7f4d7c0ce130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:41.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d71400640 1 --2- 172.21.15.55:0/1198782751 >> v2:172.21.15.106:3300/0 conn(0x7f4d7c0ce670 0x7f4d7c0b3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:41.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79400640 1 -- 172.21.15.55:0/1198782751 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3954483925 0 0) 0x7f4d7c0cff60 con 0x7f4d7c0b42e0 2024-04-02T07:26:41.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79400640 1 -- 172.21.15.55:0/1198782751 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d60003530 con 0x7f4d7c0b42e0 2024-04-02T07:26:41.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79400640 1 -- 172.21.15.55:0/1198782751 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4133427387 0 0) 0x7f4d60003530 con 0x7f4d7c0b42e0 2024-04-02T07:26:41.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79400640 1 -- 172.21.15.55:0/1198782751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d7c159900 msgr2=0x7f4d7c0ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:41.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79400640 1 --2- 172.21.15.55:0/1198782751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d7c159900 0x7f4d7c0ce130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79400640 1 -- 172.21.15.55:0/1198782751 >> v2:172.21.15.106:3300/0 conn(0x7f4d7c0ce670 msgr2=0x7f4d7c0b3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79400640 1 --2- 172.21.15.55:0/1198782751 >> v2:172.21.15.106:3300/0 conn(0x7f4d7c0ce670 0x7f4d7c0b3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79400640 1 -- 172.21.15.55:0/1198782751 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c0cf350 con 0x7f4d7c0b42e0 2024-04-02T07:26:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79400640 1 -- 172.21.15.55:0/1198782751 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f4d74001680 con 0x7f4d7c0b42e0 2024-04-02T07:26:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79400640 1 -- 172.21.15.55:0/1198782751 >> v1:172.21.15.55:6789/0 conn(0x7f4d7c0b42e0 legacy=0x7f4d7c0713d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79400640 1 --2- 172.21.15.55:0/1198782751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d60003980 0x7f4d60003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79400640 1 --2- 172.21.15.55:0/1198782751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d600047d0 0x7f4d60004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79400640 1 --2- 172.21.15.55:0/1198782751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d60005190 0x7f4d6000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79400640 1 -- 172.21.15.55:0/1198782751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c159ce0 con 0x7f4d60003980 2024-04-02T07:26:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79400640 1 -- 172.21.15.55:0/1198782751 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c0b4770 con 0x7f4d600047d0 2024-04-02T07:26:41.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79400640 1 -- 172.21.15.55:0/1198782751 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6000bed0 con 0x7f4d60005190 2024-04-02T07:26:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79e00640 1 --2- 172.21.15.55:0/1198782751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d7c159900 0x7f4d7c0ce130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:26:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79e00640 1 --2- 172.21.15.55:0/1198782751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d60003980 0x7f4d60003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d71400640 1 --2- 172.21.15.55:0/1198782751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d600047d0 0x7f4d60004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d7a800640 1 --2- 172.21.15.55:0/1198782751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d60005190 0x7f4d6000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79e00640 1 -- 172.21.15.55:0/1198782751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d60005190 msgr2=0x7f4d6000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79e00640 1 --2- 172.21.15.55:0/1198782751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d60005190 0x7f4d6000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79e00640 1 -- 172.21.15.55:0/1198782751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d600047d0 msgr2=0x7f4d60004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79e00640 1 --2- 172.21.15.55:0/1198782751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d600047d0 0x7f4d60004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.372+0000 7f4d79e00640 1 -- 172.21.15.55:0/1198782751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d60003530 con 0x7f4d60003980 2024-04-02T07:26:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.376+0000 7f4d79e00640 1 --2- 172.21.15.55:0/1198782751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d60003980 0x7f4d60003da0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c00e1f0 tx=0x7f4d6c01ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abac855b681f1c3c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.376+0000 7f4d79400640 1 -- 172.21.15.55:0/1198782751 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c0a5d20 con 0x7f4d60003980 2024-04-02T07:26:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.376+0000 7f4d79400640 1 -- 172.21.15.55:0/1198782751 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6c00f040 con 0x7f4d60003980 2024-04-02T07:26:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.376+0000 7f4d79400640 1 -- 172.21.15.55:0/1198782751 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c003bc0 con 0x7f4d60003980 2024-04-02T07:26:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.376+0000 7f4d81000640 1 -- 172.21.15.55:0/1198782751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d60003980 msgr2=0x7f4d60003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.376+0000 7f4d81000640 1 --2- 172.21.15.55:0/1198782751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d60003980 0x7f4d60003da0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c00e1f0 tx=0x7f4d6c01ccf0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.376+0000 7f4d7a800640 1 -- 172.21.15.55:0/1198782751 reap_dead start 2024-04-02T07:26:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.376+0000 7f4d81000640 1 -- 172.21.15.55:0/1198782751 shutdown_connections 2024-04-02T07:26:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.376+0000 7f4d81000640 1 -- 172.21.15.55:0/1198782751 >> 172.21.15.55:0/1198782751 conn(0x7f4d7c0b13b0 msgr2=0x7f4d7c0b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.376+0000 7f4d81000640 1 -- 172.21.15.55:0/1198782751 shutdown_connections 2024-04-02T07:26:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.376+0000 7f4d81000640 1 -- 172.21.15.55:0/1198782751 wait complete. 2024-04-02T07:26:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.376+0000 7f4d81000640 1 Processor -- start 2024-04-02T07:26:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.376+0000 7f4d81000640 1 -- start start 2024-04-02T07:26:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d81000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d60003980 0x7f4d7c0b0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d81000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d7c0c8a30 0x7f4d7c14cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d81000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d7c1603c0 0x7f4d7c0af2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d81000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c15b200 con 0x7f4d7c1603c0 2024-04-02T07:26:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d81000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c14d050 con 0x7f4d60003980 2024-04-02T07:26:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d81000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7c15aed0 con 0x7f4d7c0c8a30 2024-04-02T07:26:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d7a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d7c1603c0 0x7f4d7c0af2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d7a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d7c1603c0 0x7f4d7c0af2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42374/0 (socket says 172.21.15.55:42374) 2024-04-02T07:26:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d7a800640 1 -- 172.21.15.55:0/2743563610 learned_addr learned my addr 172.21.15.55:0/2743563610 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d71400640 1 --2- 172.21.15.55:0/2743563610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d7c0c8a30 0x7f4d7c14cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d79e00640 1 --2- 172.21.15.55:0/2743563610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d60003980 0x7f4d7c0b0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d7a800640 1 -- 172.21.15.55:0/2743563610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d7c0c8a30 msgr2=0x7f4d7c14cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d7a800640 1 --2- 172.21.15.55:0/2743563610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d7c0c8a30 0x7f4d7c14cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d7a800640 1 -- 172.21.15.55:0/2743563610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d60003980 msgr2=0x7f4d7c0b0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d7a800640 1 --2- 172.21.15.55:0/2743563610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d60003980 0x7f4d7c0b0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d7a800640 1 -- 172.21.15.55:0/2743563610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d7c0c8eb0 con 0x7f4d7c1603c0 2024-04-02T07:26:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d79e00640 1 --2- 172.21.15.55:0/2743563610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d60003980 0x7f4d7c0b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d7a800640 1 --2- 172.21.15.55:0/2743563610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d7c1603c0 0x7f4d7c0af2b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f4d74001ec0 tx=0x7f4d74007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d72a00640 1 -- 172.21.15.55:0/2743563610 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7400f6a0 con 0x7f4d7c1603c0 2024-04-02T07:26:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d72a00640 1 -- 172.21.15.55:0/2743563610 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d7400f820 con 0x7f4d7c1603c0 2024-04-02T07:26:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d72a00640 1 -- 172.21.15.55:0/2743563610 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7400fbd0 con 0x7f4d7c1603c0 2024-04-02T07:26:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d81000640 1 -- 172.21.15.55:0/2743563610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7c0c9160 con 0x7f4d7c1603c0 2024-04-02T07:26:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d81000640 1 -- 172.21.15.55:0/2743563610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d7c160840 con 0x7f4d7c1603c0 2024-04-02T07:26:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d81000640 1 -- 172.21.15.55:0/2743563610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d7c15b3b0 con 0x7f4d7c1603c0 2024-04-02T07:26:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.380+0000 7f4d72a00640 1 -- 172.21.15.55:0/2743563610 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f4d7400fd30 con 0x7f4d7c1603c0 2024-04-02T07:26:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.384+0000 7f4d72a00640 1 --2- 172.21.15.55:0/2743563610 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4d580666c0 0x7f4d58068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.384+0000 7f4d72a00640 1 -- 172.21.15.55:0/2743563610 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f4d74083250 con 0x7f4d7c1603c0 2024-04-02T07:26:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.384+0000 7f4d79e00640 1 --2- 172.21.15.55:0/2743563610 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4d580666c0 0x7f4d58068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.384+0000 7f4d79e00640 1 --2- 172.21.15.55:0/2743563610 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4d580666c0 0x7f4d58068b80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0ae000 tx=0x7f4d6c004ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.388+0000 7f4d72a00640 1 -- 172.21.15.55:0/2743563610 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f4d7c15b3b0 con 0x7f4d7c1603c0 2024-04-02T07:26:41.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.552+0000 7f4d81000640 1 -- 172.21.15.55:0/2743563610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f4d7c066c90 con 0x7f4d7c1603c0 2024-04-02T07:26:41.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.556+0000 7f4d72a00640 1 -- 172.21.15.55:0/2743563610 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4d74050820 con 0x7f4d7c1603c0 2024-04-02T07:26:41.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.560+0000 7f4d81000640 1 -- 172.21.15.55:0/2743563610 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4d580666c0 msgr2=0x7f4d58068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:41.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.560+0000 7f4d81000640 1 --2- 172.21.15.55:0/2743563610 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4d580666c0 0x7f4d58068b80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0ae000 tx=0x7f4d6c004ac0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.560+0000 7f4d81000640 1 -- 172.21.15.55:0/2743563610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d7c1603c0 msgr2=0x7f4d7c0af2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:41.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.560+0000 7f4d81000640 1 --2- 172.21.15.55:0/2743563610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d7c1603c0 0x7f4d7c0af2b0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f4d74001ec0 tx=0x7f4d74007430 comp rx=0 tx=0).stop 2024-04-02T07:26:41.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.560+0000 7f4d81000640 1 -- 172.21.15.55:0/2743563610 shutdown_connections 2024-04-02T07:26:41.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.560+0000 7f4d81000640 1 --2- 172.21.15.55:0/2743563610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d7c1603c0 0x7f4d7c0af2b0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.560+0000 7f4d81000640 1 --2- 172.21.15.55:0/2743563610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d7c0c8a30 0x7f4d7c14cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.560+0000 7f4d81000640 1 --2- 172.21.15.55:0/2743563610 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4d580666c0 0x7f4d58068b80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.560+0000 7f4d81000640 1 --2- 172.21.15.55:0/2743563610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d60003980 0x7f4d7c0b0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.560+0000 7f4d81000640 1 -- 172.21.15.55:0/2743563610 >> 172.21.15.55:0/2743563610 conn(0x7f4d7c0b13b0 msgr2=0x7f4d7c15dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:41.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.560+0000 7f4d81000640 1 -- 172.21.15.55:0/2743563610 shutdown_connections 2024-04-02T07:26:41.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.560+0000 7f4d81000640 1 -- 172.21.15.55:0/2743563610 wait complete. 2024-04-02T07:26:41.583 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair' 2024-04-02T07:26:41.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.716+0000 7f93ae800640 1 Processor -- start 2024-04-02T07:26:41.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.716+0000 7f93ae800640 1 -- start start 2024-04-02T07:26:41.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.720+0000 7f93ae800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93a8153ea0 0x7f93a80c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:41.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.720+0000 7f93ae800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f93a815a040 0x7f93a813d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:41.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.720+0000 7f93ae800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a813d0c0 con 0x7f93a8159be0 2024-04-02T07:26:41.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.720+0000 7f93ae800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a815a4f0 con 0x7f93a815a040 2024-04-02T07:26:41.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.720+0000 7f93ae800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a815a7d0 con 0x7f93a8153ea0 2024-04-02T07:26:41.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.720+0000 7f939fe00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f93a8159be0 0x7f93a80b31b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57072/0 (socket says 172.21.15.55:57072) 2024-04-02T07:26:41.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.720+0000 7f939fe00640 1 -- 172.21.15.55:0/4096140883 learned_addr learned my addr 172.21.15.55:0/4096140883 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:26:41.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.720+0000 7f93a7400640 1 --2- 172.21.15.55:0/4096140883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93a8153ea0 0x7f93a80c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:41.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.720+0000 7f93a7e00640 1 --2- 172.21.15.55:0/4096140883 >> v2:172.21.15.106:3300/0 conn(0x7f93a815a040 0x7f93a813d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:41.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.720+0000 7f93a6a00640 1 -- 172.21.15.55:0/4096140883 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1205049439 0 0) 0x7f93a813d0c0 con 0x7f93a8159be0 2024-04-02T07:26:41.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.720+0000 7f93a6a00640 1 -- 172.21.15.55:0/4096140883 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f938c003530 con 0x7f93a8159be0 2024-04-02T07:26:41.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.720+0000 7f93a7400640 1 -- 172.21.15.55:0/4096140883 >> v2:172.21.15.106:3300/0 conn(0x7f93a815a040 msgr2=0x7f93a813d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:41.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.720+0000 7f93a7400640 1 --2- 172.21.15.55:0/4096140883 >> v2:172.21.15.106:3300/0 conn(0x7f93a815a040 0x7f93a813d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.720+0000 7f93a7400640 1 -- 172.21.15.55:0/4096140883 >> v1:172.21.15.55:6789/0 conn(0x7f93a8159be0 legacy=0x7f93a80b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:41.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.720+0000 7f93a7400640 1 -- 172.21.15.55:0/4096140883 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a815aab0 con 0x7f93a8153ea0 2024-04-02T07:26:41.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93a7400640 1 --2- 172.21.15.55:0/4096140883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93a8153ea0 0x7f93a80c4120 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f93980097c0 tx=0x7f939801e6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d81d226d61310f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:41.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93a6a00640 1 -- 172.21.15.55:0/4096140883 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93980a86a0 con 0x7f93a8153ea0 2024-04-02T07:26:41.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93a6a00640 1 -- 172.21.15.55:0/4096140883 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93980a8800 con 0x7f93a8153ea0 2024-04-02T07:26:41.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93a6a00640 1 -- 172.21.15.55:0/4096140883 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93980a8b90 con 0x7f93a8153ea0 2024-04-02T07:26:41.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93ae800640 1 -- 172.21.15.55:0/4096140883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93a8153ea0 msgr2=0x7f93a80c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:41.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93ae800640 1 --2- 172.21.15.55:0/4096140883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93a8153ea0 0x7f93a80c4120 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f93980097c0 tx=0x7f939801e6b0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93ae800640 1 -- 172.21.15.55:0/4096140883 shutdown_connections 2024-04-02T07:26:41.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93ae800640 1 --2- 172.21.15.55:0/4096140883 >> v2:172.21.15.106:3300/0 conn(0x7f93a815a040 0x7f93a813d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93ae800640 1 --2- 172.21.15.55:0/4096140883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93a8153ea0 0x7f93a80c4120 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93ae800640 1 -- 172.21.15.55:0/4096140883 >> 172.21.15.55:0/4096140883 conn(0x7f93a8066080 msgr2=0x7f93a8069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:41.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93ae800640 1 -- 172.21.15.55:0/4096140883 shutdown_connections 2024-04-02T07:26:41.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93ae800640 1 -- 172.21.15.55:0/4096140883 wait complete. 2024-04-02T07:26:41.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93ae800640 1 Processor -- start 2024-04-02T07:26:41.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93ae800640 1 -- start start 2024-04-02T07:26:41.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93ae800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93a8153ea0 0x7f93a80c7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:41.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93ae800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93a8159be0 0x7f93a8139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:41.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93ae800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a815a040 0x7f93a81379f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:41.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93ae800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a813a1e0 con 0x7f93a8153ea0 2024-04-02T07:26:41.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93ae800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a813a480 con 0x7f93a815a040 2024-04-02T07:26:41.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93ae800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a813a760 con 0x7f93a8159be0 2024-04-02T07:26:41.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93a7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93a8153ea0 0x7f93a80c7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:41.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93a7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93a8153ea0 0x7f93a80c7670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42376/0 (socket says 172.21.15.55:42376) 2024-04-02T07:26:41.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.724+0000 7f93a7400640 1 -- 172.21.15.55:0/2933947247 learned_addr learned my addr 172.21.15.55:0/2933947247 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:41.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.728+0000 7f939fe00640 1 --2- 172.21.15.55:0/2933947247 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93a8159be0 0x7f93a8139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:41.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.728+0000 7f93a7e00640 1 --2- 172.21.15.55:0/2933947247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a815a040 0x7f93a81379f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:41.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.728+0000 7f93a7400640 1 -- 172.21.15.55:0/2933947247 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93a8159be0 msgr2=0x7f93a8139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:41.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.728+0000 7f93a7400640 1 --2- 172.21.15.55:0/2933947247 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93a8159be0 0x7f93a8139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.728+0000 7f93a7400640 1 -- 172.21.15.55:0/2933947247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a815a040 msgr2=0x7f93a81379f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:41.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.728+0000 7f93a7400640 1 --2- 172.21.15.55:0/2933947247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a815a040 0x7f93a81379f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:41.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.728+0000 7f93a7400640 1 -- 172.21.15.55:0/2933947247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9398009420 con 0x7f93a8153ea0 2024-04-02T07:26:41.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.728+0000 7f93a7400640 1 --2- 172.21.15.55:0/2933947247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93a8153ea0 0x7f93a80c7670 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f939801c2e0 tx=0x7f939801b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:41.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.728+0000 7f939f400640 1 -- 172.21.15.55:0/2933947247 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93980a9480 con 0x7f93a8153ea0 2024-04-02T07:26:41.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.728+0000 7f939f400640 1 -- 172.21.15.55:0/2933947247 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93980a9620 con 0x7f93a8153ea0 2024-04-02T07:26:41.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.728+0000 7f939f400640 1 -- 172.21.15.55:0/2933947247 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93980a99d0 con 0x7f93a8153ea0 2024-04-02T07:26:41.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.728+0000 7f93ae800640 1 -- 172.21.15.55:0/2933947247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a813aa40 con 0x7f93a8153ea0 2024-04-02T07:26:41.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.728+0000 7f93ae800640 1 -- 172.21.15.55:0/2933947247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a813b000 con 0x7f93a8153ea0 2024-04-02T07:26:41.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.728+0000 7f93ae800640 1 -- 172.21.15.55:0/2933947247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a8066c90 con 0x7f93a8153ea0 2024-04-02T07:26:41.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.728+0000 7f939f400640 1 -- 172.21.15.55:0/2933947247 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f93980a9b30 con 0x7f93a8153ea0 2024-04-02T07:26:41.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.728+0000 7f939f400640 1 --2- 172.21.15.55:0/2933947247 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9384066690 0x7f9384068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:41.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.728+0000 7f939f400640 1 -- 172.21.15.55:0/2933947247 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f939811e480 con 0x7f93a8153ea0 2024-04-02T07:26:41.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.732+0000 7f939fe00640 1 --2- 172.21.15.55:0/2933947247 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9384066690 0x7f9384068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:41.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.732+0000 7f939fe00640 1 --2- 172.21.15.55:0/2933947247 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9384066690 0x7f9384068b50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f93a80c5d40 tx=0x7f9390009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:41.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.732+0000 7f939f400640 1 -- 172.21.15.55:0/2933947247 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f93980eba50 con 0x7f93a8153ea0 2024-04-02T07:26:41.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:41.952+0000 7f93ae800640 1 -- 172.21.15.55:0/2933947247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]} v 0) v1 -- 0x7f93a813bf90 con 0x7f93a8153ea0 2024-04-02T07:26:42.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.192+0000 7f939f400640 1 -- 172.21.15.55:0/2933947247 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_backtrace_repair"]}]=0 v226) v1 ==== 169+0+0 (secure 0 0 0) 0x7f93980ae0f0 con 0x7f93a8153ea0 2024-04-02T07:26:42.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.192+0000 7f93ae800640 1 -- 172.21.15.55:0/2933947247 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9384066690 msgr2=0x7f9384068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:42.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.192+0000 7f93ae800640 1 --2- 172.21.15.55:0/2933947247 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9384066690 0x7f9384068b50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f93a80c5d40 tx=0x7f9390009040 comp rx=0 tx=0).stop 2024-04-02T07:26:42.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.192+0000 7f93ae800640 1 -- 172.21.15.55:0/2933947247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93a8153ea0 msgr2=0x7f93a80c7670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:42.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.192+0000 7f93ae800640 1 --2- 172.21.15.55:0/2933947247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93a8153ea0 0x7f93a80c7670 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f939801c2e0 tx=0x7f939801b450 comp rx=0 tx=0).stop 2024-04-02T07:26:42.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.192+0000 7f93ae800640 1 -- 172.21.15.55:0/2933947247 shutdown_connections 2024-04-02T07:26:42.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.192+0000 7f93ae800640 1 --2- 172.21.15.55:0/2933947247 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9384066690 0x7f9384068b50 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:42.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.192+0000 7f93ae800640 1 --2- 172.21.15.55:0/2933947247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93a815a040 0x7f93a81379f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:42.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.192+0000 7f93ae800640 1 --2- 172.21.15.55:0/2933947247 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93a8159be0 0x7f93a8139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:42.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.192+0000 7f93ae800640 1 --2- 172.21.15.55:0/2933947247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93a8153ea0 0x7f93a80c7670 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:42.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.192+0000 7f93ae800640 1 -- 172.21.15.55:0/2933947247 >> 172.21.15.55:0/2933947247 conn(0x7f93a8066080 msgr2=0x7f93a8071100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:42.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.192+0000 7f93ae800640 1 -- 172.21.15.55:0/2933947247 shutdown_connections 2024-04-02T07:26:42.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.192+0000 7f93ae800640 1 -- 172.21.15.55:0/2933947247 wait complete. 2024-04-02T07:26:42.218 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-02T07:26:42.218 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-02T07:26:42.219 INFO:tasks.cephfs_test_runner:test_health_status_after_dentry_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-02T07:26:42.219 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-04-02T07:26:42.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.352+0000 7fcbc1e00640 1 Processor -- start 2024-04-02T07:26:42.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.356+0000 7fcbc1e00640 1 -- start start 2024-04-02T07:26:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.356+0000 7fcbc1e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcbbc153ea0 0x7fcbbc0c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.356+0000 7fcbc1e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbbc159be0 0x7fcbbc0b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.356+0000 7fcbc1e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbbc13d0c0 con 0x7fcbbc15a040 2024-04-02T07:26:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.356+0000 7fcbc1e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbbc15a4f0 con 0x7fcbbc153ea0 2024-04-02T07:26:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.356+0000 7fcbc1e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc15a7d0 con 0x7fcbbc159be0 2024-04-02T07:26:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.356+0000 7fcbbaa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcbbc153ea0 0x7fcbbc0c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.356+0000 7fcbbaa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcbbc153ea0 0x7fcbbc0c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42388/0 (socket says 172.21.15.55:42388) 2024-04-02T07:26:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.356+0000 7fcbbaa00640 1 -- 172.21.15.55:0/2952641305 learned_addr learned my addr 172.21.15.55:0/2952641305 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.356+0000 7fcbb2000640 1 --2- 172.21.15.55:0/2952641305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbbc159be0 0x7fcbbc0b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.356+0000 7fcbbaa00640 1 -- 172.21.15.55:0/2952641305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbbc159be0 msgr2=0x7fcbbc0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.356+0000 7fcbbaa00640 1 --2- 172.21.15.55:0/2952641305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbbc159be0 0x7fcbbc0b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.356+0000 7fcbbaa00640 1 -- 172.21.15.55:0/2952641305 >> v1:172.21.15.55:6789/0 conn(0x7fcbbc15a040 legacy=0x7fcbbc13ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.356+0000 7fcbbaa00640 1 -- 172.21.15.55:0/2952641305 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbbc15aab0 con 0x7fcbbc153ea0 2024-04-02T07:26:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.356+0000 7fcbb2000640 1 --2- 172.21.15.55:0/2952641305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbbc159be0 0x7fcbbc0b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:26:42.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.360+0000 7fcbbaa00640 1 --2- 172.21.15.55:0/2952641305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbbc153ea0 0x7fcbbc0c4120 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009870 tx=0x7fcbac01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909d61025624b21b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:42.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.360+0000 7fcbba000640 1 -- 172.21.15.55:0/2952641305 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac0a9640 con 0x7fcbbc153ea0 2024-04-02T07:26:42.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.360+0000 7fcbba000640 1 -- 172.21.15.55:0/2952641305 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac0a97a0 con 0x7fcbbc153ea0 2024-04-02T07:26:42.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.360+0000 7fcbba000640 1 -- 172.21.15.55:0/2952641305 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac0a9b30 con 0x7fcbbc153ea0 2024-04-02T07:26:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.360+0000 7fcbc1e00640 1 -- 172.21.15.55:0/2952641305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbbc153ea0 msgr2=0x7fcbbc0c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.360+0000 7fcbc1e00640 1 --2- 172.21.15.55:0/2952641305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbbc153ea0 0x7fcbbc0c4120 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009870 tx=0x7fcbac01c560 comp rx=0 tx=0).stop 2024-04-02T07:26:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.360+0000 7fcbc1e00640 1 -- 172.21.15.55:0/2952641305 shutdown_connections 2024-04-02T07:26:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.360+0000 7fcbc1e00640 1 --2- 172.21.15.55:0/2952641305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbbc159be0 0x7fcbbc0b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.360+0000 7fcbc1e00640 1 --2- 172.21.15.55:0/2952641305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbbc153ea0 0x7fcbbc0c4120 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.360+0000 7fcbc1e00640 1 -- 172.21.15.55:0/2952641305 >> 172.21.15.55:0/2952641305 conn(0x7fcbbc066080 msgr2=0x7fcbbc069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.360+0000 7fcbc1e00640 1 -- 172.21.15.55:0/2952641305 shutdown_connections 2024-04-02T07:26:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.360+0000 7fcbc1e00640 1 -- 172.21.15.55:0/2952641305 wait complete. 2024-04-02T07:26:42.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.360+0000 7fcbc1e00640 1 Processor -- start 2024-04-02T07:26:42.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.360+0000 7fcbc1e00640 1 -- start start 2024-04-02T07:26:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbc1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbbc153ea0 0x7fcbbc1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbc1e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbbc159be0 0x7fcbbc0cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbc1e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbbc15a040 0x7fcbbc1586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbc1e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc152060 con 0x7fcbbc153ea0 2024-04-02T07:26:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbc1e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc152340 con 0x7fcbbc15a040 2024-04-02T07:26:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbc1e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbbc152620 con 0x7fcbbc159be0 2024-04-02T07:26:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbbaa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbbc153ea0 0x7fcbbc1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbbaa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbbc153ea0 0x7fcbbc1516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42400/0 (socket says 172.21.15.55:42400) 2024-04-02T07:26:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbbaa00640 1 -- 172.21.15.55:0/647790851 learned_addr learned my addr 172.21.15.55:0/647790851 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbbaa00640 1 -- 172.21.15.55:0/647790851 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbbc159be0 msgr2=0x7fcbbc0cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbbaa00640 1 --2- 172.21.15.55:0/647790851 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbbc159be0 0x7fcbbc0cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbbaa00640 1 -- 172.21.15.55:0/647790851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbbc15a040 msgr2=0x7fcbbc1586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbbaa00640 1 --2- 172.21.15.55:0/647790851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbbc15a040 0x7fcbbc1586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbbaa00640 1 -- 172.21.15.55:0/647790851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac0094d0 con 0x7fcbbc153ea0 2024-04-02T07:26:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbbaa00640 1 --2- 172.21.15.55:0/647790851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbbc153ea0 0x7fcbbc1516b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0ab040 tx=0x7fcbac01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbb3e00640 1 -- 172.21.15.55:0/647790851 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac0b1800 con 0x7fcbbc153ea0 2024-04-02T07:26:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbb3e00640 1 -- 172.21.15.55:0/647790851 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac0b1960 con 0x7fcbbc153ea0 2024-04-02T07:26:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbc1e00640 1 -- 172.21.15.55:0/647790851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbbc152900 con 0x7fcbbc153ea0 2024-04-02T07:26:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbb3e00640 1 -- 172.21.15.55:0/647790851 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac0b1d10 con 0x7fcbbc153ea0 2024-04-02T07:26:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbc1e00640 1 -- 172.21.15.55:0/647790851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbbc151cc0 con 0x7fcbbc153ea0 2024-04-02T07:26:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbc1e00640 1 -- 172.21.15.55:0/647790851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbbc066c90 con 0x7fcbbc153ea0 2024-04-02T07:26:42.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.364+0000 7fcbb3e00640 1 -- 172.21.15.55:0/647790851 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fcbac0a7070 con 0x7fcbbc153ea0 2024-04-02T07:26:42.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.368+0000 7fcbb3e00640 1 --2- 172.21.15.55:0/647790851 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcb98066690 0x7fcb98068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:42.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.368+0000 7fcbb3e00640 1 -- 172.21.15.55:0/647790851 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcbac11ea30 con 0x7fcbbc153ea0 2024-04-02T07:26:42.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.368+0000 7fcbb2000640 1 --2- 172.21.15.55:0/647790851 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcb98066690 0x7fcb98068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:42.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.368+0000 7fcbb2000640 1 --2- 172.21.15.55:0/647790851 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcb98066690 0x7fcb98068b50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc13ec40 tx=0x7fcba4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:42.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.372+0000 7fcbb3e00640 1 -- 172.21.15.55:0/647790851 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fcbac0ec1b0 con 0x7fcbbc153ea0 2024-04-02T07:26:42.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:42.600+0000 7fcbc1e00640 1 -- 172.21.15.55:0/647790851 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) v1 -- 0x7fcbbc071e50 con 0x7fcbbc153ea0 2024-04-02T07:26:43.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.196+0000 7fcbb3e00640 1 -- 172.21.15.55:0/647790851 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v227) v1 ==== 169+0+0 (secure 0 0 0) 0x7fcbac0ef7d0 con 0x7fcbbc153ea0 2024-04-02T07:26:43.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.200+0000 7fcbc1e00640 1 -- 172.21.15.55:0/647790851 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcb98066690 msgr2=0x7fcb98068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:43.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.200+0000 7fcbc1e00640 1 --2- 172.21.15.55:0/647790851 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcb98066690 0x7fcb98068b50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fcbbc13ec40 tx=0x7fcba4008040 comp rx=0 tx=0).stop 2024-04-02T07:26:43.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.200+0000 7fcbc1e00640 1 -- 172.21.15.55:0/647790851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbbc153ea0 msgr2=0x7fcbbc1516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.200+0000 7fcbc1e00640 1 --2- 172.21.15.55:0/647790851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbbc153ea0 0x7fcbbc1516b0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fcbac0ab040 tx=0x7fcbac01ada0 comp rx=0 tx=0).stop 2024-04-02T07:26:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.200+0000 7fcbc1e00640 1 -- 172.21.15.55:0/647790851 shutdown_connections 2024-04-02T07:26:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.200+0000 7fcbc1e00640 1 --2- 172.21.15.55:0/647790851 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcb98066690 0x7fcb98068b50 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.200+0000 7fcbc1e00640 1 --2- 172.21.15.55:0/647790851 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcbbc15a040 0x7fcbbc1586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.200+0000 7fcbc1e00640 1 --2- 172.21.15.55:0/647790851 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcbbc159be0 0x7fcbbc0cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.200+0000 7fcbc1e00640 1 --2- 172.21.15.55:0/647790851 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcbbc153ea0 0x7fcbbc1516b0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.200+0000 7fcbc1e00640 1 -- 172.21.15.55:0/647790851 >> 172.21.15.55:0/647790851 conn(0x7fcbbc066080 msgr2=0x7fcbbc0c3cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:43.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.200+0000 7fcbc1e00640 1 -- 172.21.15.55:0/647790851 shutdown_connections 2024-04-02T07:26:43.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.200+0000 7fcbc1e00640 1 -- 172.21.15.55:0/647790851 wait complete. 2024-04-02T07:26:43.227 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-02T07:26:43.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.368+0000 7f9e26600640 1 Processor -- start 2024-04-02T07:26:43.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.368+0000 7f9e26600640 1 -- start start 2024-04-02T07:26:43.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.368+0000 7f9e26600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e200709b0 0x7f9e2015cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:43.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.368+0000 7f9e26600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e2015dc70 con 0x7f9e201611f0 2024-04-02T07:26:43.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.368+0000 7f9e26600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e20160710 con 0x7f9e20142f70 2024-04-02T07:26:43.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.368+0000 7f9e26600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e2015df50 con 0x7f9e200709b0 2024-04-02T07:26:43.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.368+0000 7f9e17e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e200709b0 0x7f9e2015cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:43.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.368+0000 7f9e17e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e200709b0 0x7f9e2015cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42408/0 (socket says 172.21.15.55:42408) 2024-04-02T07:26:43.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.368+0000 7f9e17e00640 1 -- 172.21.15.55:0/2443153163 learned_addr learned my addr 172.21.15.55:0/2443153163 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:43.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.368+0000 7f9e17e00640 1 -- 172.21.15.55:0/2443153163 >> v1:172.21.15.106:6789/0 conn(0x7f9e20142f70 legacy=0x7f9e200702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:43.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.368+0000 7f9e17e00640 1 -- 172.21.15.55:0/2443153163 >> v1:172.21.15.55:6789/0 conn(0x7f9e201611f0 legacy=0x7f9e2015d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:43.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.368+0000 7f9e17e00640 1 -- 172.21.15.55:0/2443153163 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e201609f0 con 0x7f9e200709b0 2024-04-02T07:26:43.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.372+0000 7f9e17e00640 1 --2- 172.21.15.55:0/2443153163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e200709b0 0x7f9e2015cf50 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f9e08009870 tx=0x7f9e0801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8d53857097a9f86 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:43.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.372+0000 7f9e1ea00640 1 -- 172.21.15.55:0/2443153163 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e080aa670 con 0x7f9e200709b0 2024-04-02T07:26:43.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.372+0000 7f9e1ea00640 1 -- 172.21.15.55:0/2443153163 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e080aa7d0 con 0x7f9e200709b0 2024-04-02T07:26:43.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.372+0000 7f9e1ea00640 1 -- 172.21.15.55:0/2443153163 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e080aab60 con 0x7f9e200709b0 2024-04-02T07:26:43.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.372+0000 7f9e26600640 1 -- 172.21.15.55:0/2443153163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e200709b0 msgr2=0x7f9e2015cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:43.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.372+0000 7f9e26600640 1 --2- 172.21.15.55:0/2443153163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e200709b0 0x7f9e2015cf50 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f9e08009870 tx=0x7f9e0801c4f0 comp rx=0 tx=0).stop 2024-04-02T07:26:43.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.372+0000 7f9e26600640 1 -- 172.21.15.55:0/2443153163 shutdown_connections 2024-04-02T07:26:43.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.372+0000 7f9e26600640 1 --2- 172.21.15.55:0/2443153163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e200709b0 0x7f9e2015cf50 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:43.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.372+0000 7f9e26600640 1 -- 172.21.15.55:0/2443153163 >> 172.21.15.55:0/2443153163 conn(0x7f9e2006a390 msgr2=0x7f9e200b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:43.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.372+0000 7f9e26600640 1 -- 172.21.15.55:0/2443153163 shutdown_connections 2024-04-02T07:26:43.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.372+0000 7f9e26600640 1 -- 172.21.15.55:0/2443153163 wait complete. 2024-04-02T07:26:43.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e26600640 1 Processor -- start 2024-04-02T07:26:43.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e26600640 1 -- start start 2024-04-02T07:26:43.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e26600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e200709b0 0x7f9e20159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:43.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e26600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9e20142f70 0x7f9e2013b790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:43.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e26600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e201611f0 0x7f9e201398d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:43.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e26600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e200b01f0 con 0x7f9e200709b0 2024-04-02T07:26:43.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e26600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2006d1b0 con 0x7f9e201611f0 2024-04-02T07:26:43.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e26600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e200b1a00 con 0x7f9e20142f70 2024-04-02T07:26:43.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e1f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e200709b0 0x7f9e20159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:43.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e1f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e200709b0 0x7f9e20159f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42412/0 (socket says 172.21.15.55:42412) 2024-04-02T07:26:43.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e1f400640 1 -- 172.21.15.55:0/1216226731 learned_addr learned my addr 172.21.15.55:0/1216226731 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:43.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e17e00640 1 --2- 172.21.15.55:0/1216226731 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9e20142f70 0x7f9e2013b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:43.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e1fe00640 1 --2- 172.21.15.55:0/1216226731 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e201611f0 0x7f9e201398d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:43.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e1f400640 1 -- 172.21.15.55:0/1216226731 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9e20142f70 msgr2=0x7f9e2013b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:43.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e1f400640 1 --2- 172.21.15.55:0/1216226731 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9e20142f70 0x7f9e2013b790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:43.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e1f400640 1 -- 172.21.15.55:0/1216226731 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e201611f0 msgr2=0x7f9e201398d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:43.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e1f400640 1 --2- 172.21.15.55:0/1216226731 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e201611f0 0x7f9e201398d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:43.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e1f400640 1 -- 172.21.15.55:0/1216226731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e080094d0 con 0x7f9e200709b0 2024-04-02T07:26:43.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e1fe00640 1 --2- 172.21.15.55:0/1216226731 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e201611f0 0x7f9e201398d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:26:43.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e1f400640 1 --2- 172.21.15.55:0/1216226731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e200709b0 0x7f9e20159f20 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000c480 tx=0x7f9e1000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:43.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e17400640 1 -- 172.21.15.55:0/1216226731 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e10012830 con 0x7f9e200709b0 2024-04-02T07:26:43.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e17400640 1 -- 172.21.15.55:0/1216226731 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e100129b0 con 0x7f9e200709b0 2024-04-02T07:26:43.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e17400640 1 -- 172.21.15.55:0/1216226731 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e10012d60 con 0x7f9e200709b0 2024-04-02T07:26:43.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e26600640 1 -- 172.21.15.55:0/1216226731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e200b2260 con 0x7f9e200709b0 2024-04-02T07:26:43.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e26600640 1 -- 172.21.15.55:0/1216226731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e200b1c10 con 0x7f9e200709b0 2024-04-02T07:26:43.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.376+0000 7f9e26600640 1 -- 172.21.15.55:0/1216226731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e20073530 con 0x7f9e200709b0 2024-04-02T07:26:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.380+0000 7f9e17400640 1 -- 172.21.15.55:0/1216226731 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f9e1001c460 con 0x7f9e200709b0 2024-04-02T07:26:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.380+0000 7f9e17400640 1 --2- 172.21.15.55:0/1216226731 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9dfc066690 0x7f9dfc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.380+0000 7f9e17400640 1 -- 172.21.15.55:0/1216226731 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9e10083de0 con 0x7f9e200709b0 2024-04-02T07:26:43.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.380+0000 7f9e17e00640 1 --2- 172.21.15.55:0/1216226731 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9dfc066690 0x7f9dfc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:43.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.380+0000 7f9e17e00640 1 --2- 172.21.15.55:0/1216226731 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9dfc066690 0x7f9dfc068b50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9e080ae000 tx=0x7f9e080a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:43.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.384+0000 7f9e17400640 1 -- 172.21.15.55:0/1216226731 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f9e100513b0 con 0x7f9e200709b0 2024-04-02T07:26:43.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.544+0000 7f9e26600640 1 -- 172.21.15.55:0/1216226731 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f9e20066c90 con 0x7f9e200709b0 2024-04-02T07:26:43.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.548+0000 7f9e17400640 1 -- 172.21.15.55:0/1216226731 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9e100549d0 con 0x7f9e200709b0 2024-04-02T07:26:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.552+0000 7f9e26600640 1 -- 172.21.15.55:0/1216226731 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9dfc066690 msgr2=0x7f9dfc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.552+0000 7f9e26600640 1 --2- 172.21.15.55:0/1216226731 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9dfc066690 0x7f9dfc068b50 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f9e080ae000 tx=0x7f9e080a7000 comp rx=0 tx=0).stop 2024-04-02T07:26:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.552+0000 7f9e26600640 1 -- 172.21.15.55:0/1216226731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e200709b0 msgr2=0x7f9e20159f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.552+0000 7f9e26600640 1 --2- 172.21.15.55:0/1216226731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e200709b0 0x7f9e20159f20 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f9e1000c480 tx=0x7f9e1000c940 comp rx=0 tx=0).stop 2024-04-02T07:26:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.552+0000 7f9e26600640 1 -- 172.21.15.55:0/1216226731 shutdown_connections 2024-04-02T07:26:43.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.552+0000 7f9e26600640 1 --2- 172.21.15.55:0/1216226731 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9dfc066690 0x7f9dfc068b50 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:43.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.552+0000 7f9e26600640 1 --2- 172.21.15.55:0/1216226731 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9e201611f0 0x7f9e201398d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:43.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.552+0000 7f9e26600640 1 --2- 172.21.15.55:0/1216226731 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9e20142f70 0x7f9e2013b790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:43.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.552+0000 7f9e26600640 1 --2- 172.21.15.55:0/1216226731 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e200709b0 0x7f9e20159f20 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:43.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.552+0000 7f9e26600640 1 -- 172.21.15.55:0/1216226731 >> 172.21.15.55:0/1216226731 conn(0x7f9e2006a390 msgr2=0x7f9e2006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:43.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.552+0000 7f9e26600640 1 -- 172.21.15.55:0/1216226731 shutdown_connections 2024-04-02T07:26:43.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.552+0000 7f9e26600640 1 -- 172.21.15.55:0/1216226731 wait complete. 2024-04-02T07:26:43.576 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-02T07:26:43.576 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:26:43.670 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:26:43.758 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-02T07:26:43.759 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:26:43.759 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:26:43.767 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:26:43.767 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:26:43.767 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:26:43.777 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:26:43.777 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:26:43.777 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:26:43.817 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:26:43.819 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:26:43.819 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:26:43.819 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:26:43.820 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:26:43.829 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:26:43.829 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-02T07:26:43.829 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:26:44.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.996+0000 7ffaa9200640 1 Processor -- start 2024-04-02T07:26:44.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.996+0000 7ffaa9200640 1 -- start start 2024-04-02T07:26:44.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.996+0000 7ffaa9200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffaa4153ea0 0x7ffaa40c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:44.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.996+0000 7ffaa9200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ffaa4159be0 0x7ffaa40b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:44.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.996+0000 7ffaa9200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffaa413d0c0 con 0x7ffaa415a040 2024-04-02T07:26:44.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.996+0000 7ffaa9200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffaa415a4f0 con 0x7ffaa4159be0 2024-04-02T07:26:44.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:43.996+0000 7ffaa9200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa415a7d0 con 0x7ffaa4153ea0 2024-04-02T07:26:44.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.000+0000 7ffaa2800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ffaa415a040 0x7ffaa413ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57098/0 (socket says 172.21.15.55:57098) 2024-04-02T07:26:44.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.000+0000 7ffaa2800640 1 -- 172.21.15.55:0/2894180485 learned_addr learned my addr 172.21.15.55:0/2894180485 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:26:44.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.000+0000 7ffaa1e00640 1 --2- 172.21.15.55:0/2894180485 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffaa4153ea0 0x7ffaa40c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:44.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.000+0000 7ffa9be00640 1 --2- 172.21.15.55:0/2894180485 >> v2:172.21.15.106:3300/0 conn(0x7ffaa4159be0 0x7ffaa40b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:44.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.000+0000 7ffaa1400640 1 -- 172.21.15.55:0/2894180485 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2981799810 0 0) 0x7ffaa413d0c0 con 0x7ffaa415a040 2024-04-02T07:26:44.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.000+0000 7ffaa1400640 1 -- 172.21.15.55:0/2894180485 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffa88003530 con 0x7ffaa415a040 2024-04-02T07:26:44.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.000+0000 7ffaa1e00640 1 -- 172.21.15.55:0/2894180485 >> v2:172.21.15.106:3300/0 conn(0x7ffaa4159be0 msgr2=0x7ffaa40b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:44.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.000+0000 7ffaa1e00640 1 --2- 172.21.15.55:0/2894180485 >> v2:172.21.15.106:3300/0 conn(0x7ffaa4159be0 0x7ffaa40b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:44.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.000+0000 7ffaa1e00640 1 -- 172.21.15.55:0/2894180485 >> v1:172.21.15.55:6789/0 conn(0x7ffaa415a040 legacy=0x7ffaa413ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:44.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.000+0000 7ffaa1e00640 1 -- 172.21.15.55:0/2894180485 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaa415aab0 con 0x7ffaa4153ea0 2024-04-02T07:26:44.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.000+0000 7ffa9be00640 1 --2- 172.21.15.55:0/2894180485 >> v2:172.21.15.106:3300/0 conn(0x7ffaa4159be0 0x7ffaa40b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:26:44.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.000+0000 7ffaa1e00640 1 --2- 172.21.15.55:0/2894180485 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffaa4153ea0 0x7ffaa40c4120 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffa940097c0 tx=0x7ffa9401c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=470f48c5dca96913 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:44.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa1400640 1 -- 172.21.15.55:0/2894180485 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa940aa620 con 0x7ffaa4153ea0 2024-04-02T07:26:44.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa1400640 1 -- 172.21.15.55:0/2894180485 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa940aa780 con 0x7ffaa4153ea0 2024-04-02T07:26:44.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa1400640 1 -- 172.21.15.55:0/2894180485 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa940aab10 con 0x7ffaa4153ea0 2024-04-02T07:26:44.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa9200640 1 -- 172.21.15.55:0/2894180485 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffaa4153ea0 msgr2=0x7ffaa40c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:44.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa9200640 1 --2- 172.21.15.55:0/2894180485 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffaa4153ea0 0x7ffaa40c4120 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ffa940097c0 tx=0x7ffa9401c4a0 comp rx=0 tx=0).stop 2024-04-02T07:26:44.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa9200640 1 -- 172.21.15.55:0/2894180485 shutdown_connections 2024-04-02T07:26:44.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa9200640 1 --2- 172.21.15.55:0/2894180485 >> v2:172.21.15.106:3300/0 conn(0x7ffaa4159be0 0x7ffaa40b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:44.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa9200640 1 --2- 172.21.15.55:0/2894180485 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffaa4153ea0 0x7ffaa40c4120 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:44.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa9200640 1 -- 172.21.15.55:0/2894180485 >> 172.21.15.55:0/2894180485 conn(0x7ffaa4066080 msgr2=0x7ffaa4069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:44.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa9200640 1 -- 172.21.15.55:0/2894180485 shutdown_connections 2024-04-02T07:26:44.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa9200640 1 -- 172.21.15.55:0/2894180485 wait complete. 2024-04-02T07:26:44.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa9200640 1 Processor -- start 2024-04-02T07:26:44.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa9200640 1 -- start start 2024-04-02T07:26:44.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa9200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffaa4153ea0 0x7ffaa415acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:44.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa9200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaa4159be0 0x7ffaa415b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:44.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa9200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa415a040 0x7ffaa4154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa9200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa4155240 con 0x7ffaa415a040 2024-04-02T07:26:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa9200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa4155520 con 0x7ffaa4159be0 2024-04-02T07:26:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa9200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffaa4155800 con 0x7ffaa4153ea0 2024-04-02T07:26:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa2800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa415a040 0x7ffaa4154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa2800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa415a040 0x7ffaa4154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42424/0 (socket says 172.21.15.55:42424) 2024-04-02T07:26:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa2800640 1 -- 172.21.15.55:0/2749912995 learned_addr learned my addr 172.21.15.55:0/2749912995 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffaa1e00640 1 --2- 172.21.15.55:0/2749912995 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffaa4153ea0 0x7ffaa415acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.004+0000 7ffa9be00640 1 --2- 172.21.15.55:0/2749912995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaa4159be0 0x7ffaa415b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.008+0000 7ffaa2800640 1 -- 172.21.15.55:0/2749912995 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffaa4153ea0 msgr2=0x7ffaa415acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.008+0000 7ffaa2800640 1 --2- 172.21.15.55:0/2749912995 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffaa4153ea0 0x7ffaa415acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.008+0000 7ffaa2800640 1 -- 172.21.15.55:0/2749912995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaa4159be0 msgr2=0x7ffaa415b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.008+0000 7ffaa2800640 1 --2- 172.21.15.55:0/2749912995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaa4159be0 0x7ffaa415b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.008+0000 7ffaa2800640 1 -- 172.21.15.55:0/2749912995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa8c009420 con 0x7ffaa415a040 2024-04-02T07:26:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.008+0000 7ffa9be00640 1 --2- 172.21.15.55:0/2749912995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaa4159be0 0x7ffaa415b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:44.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.008+0000 7ffaa2800640 1 --2- 172.21.15.55:0/2749912995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa415a040 0x7ffaa4154470 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00caa0 tx=0x7ffa9c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:44.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.008+0000 7ffa9a000640 1 -- 172.21.15.55:0/2749912995 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c00aba0 con 0x7ffaa415a040 2024-04-02T07:26:44.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.008+0000 7ffa9a000640 1 -- 172.21.15.55:0/2749912995 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9c00ad00 con 0x7ffaa415a040 2024-04-02T07:26:44.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.008+0000 7ffa9a000640 1 -- 172.21.15.55:0/2749912995 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9c012640 con 0x7ffaa415a040 2024-04-02T07:26:44.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.008+0000 7ffaa9200640 1 -- 172.21.15.55:0/2749912995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa94009420 con 0x7ffaa415a040 2024-04-02T07:26:44.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.008+0000 7ffaa9200640 1 -- 172.21.15.55:0/2749912995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaa4155dc0 con 0x7ffaa415a040 2024-04-02T07:26:44.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.008+0000 7ffaa9200640 1 -- 172.21.15.55:0/2749912995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaa4066c90 con 0x7ffaa415a040 2024-04-02T07:26:44.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.008+0000 7ffa9a000640 1 -- 172.21.15.55:0/2749912995 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ffa9c007070 con 0x7ffaa415a040 2024-04-02T07:26:44.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.008+0000 7ffa9a000640 1 --2- 172.21.15.55:0/2749912995 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffa80066690 0x7ffa80068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:44.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.008+0000 7ffa9a000640 1 -- 172.21.15.55:0/2749912995 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ffa9c083d60 con 0x7ffaa415a040 2024-04-02T07:26:44.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.008+0000 7ffaa1e00640 1 --2- 172.21.15.55:0/2749912995 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffa80066690 0x7ffa80068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:44.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.012+0000 7ffaa1e00640 1 --2- 172.21.15.55:0/2749912995 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffa80066690 0x7ffa80068b50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ffa940ae000 tx=0x7ffa940a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:44.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.012+0000 7ffa9a000640 1 -- 172.21.15.55:0/2749912995 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ffa9c0513e0 con 0x7ffaa415a040 2024-04-02T07:26:44.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.208+0000 7ffaa9200640 1 -- 172.21.15.55:0/2749912995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffaa40ce350 con 0x7ffaa415a040 2024-04-02T07:26:44.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.208+0000 7ffa9a000640 1 -- 172.21.15.55:0/2749912995 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 37 v37) v1 ==== 94+0+3535 (secure 0 0 0) 0x7ffa9c017090 con 0x7ffaa415a040 2024-04-02T07:26:44.214 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:44.214 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":37,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5510,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/3429221899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":3429221899},{"type":"v1","addr":"172.21.15.55:6835","nonce":3429221899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":5513,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/4033456774","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":4033456774},{"type":"v1","addr":"172.21.15.106:6836","nonce":4033456774}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6129,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2170345840","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2170345840},{"type":"v1","addr":"172.21.15.55:6834","nonce":2170345840}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6394,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/4237420366","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":4237420366},{"type":"v1","addr":"172.21.15.106:6837","nonce":4237420366}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":37}],"filesystems":[]} 2024-04-02T07:26:44.215 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 37 2024-04-02T07:26:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.212+0000 7ffaa9200640 1 -- 172.21.15.55:0/2749912995 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffa80066690 msgr2=0x7ffa80068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.212+0000 7ffaa9200640 1 --2- 172.21.15.55:0/2749912995 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffa80066690 0x7ffa80068b50 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7ffa940ae000 tx=0x7ffa940a7000 comp rx=0 tx=0).stop 2024-04-02T07:26:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.212+0000 7ffaa9200640 1 -- 172.21.15.55:0/2749912995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa415a040 msgr2=0x7ffaa4154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.212+0000 7ffaa9200640 1 --2- 172.21.15.55:0/2749912995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa415a040 0x7ffaa4154470 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7ffa9c00caa0 tx=0x7ffa9c00cf60 comp rx=0 tx=0).stop 2024-04-02T07:26:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.212+0000 7ffaa9200640 1 -- 172.21.15.55:0/2749912995 shutdown_connections 2024-04-02T07:26:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.212+0000 7ffaa9200640 1 --2- 172.21.15.55:0/2749912995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffaa415a040 0x7ffaa4154470 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.212+0000 7ffaa9200640 1 --2- 172.21.15.55:0/2749912995 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffa80066690 0x7ffa80068b50 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.212+0000 7ffaa9200640 1 --2- 172.21.15.55:0/2749912995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffaa4159be0 0x7ffaa415b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.212+0000 7ffaa9200640 1 --2- 172.21.15.55:0/2749912995 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffaa4153ea0 0x7ffaa415acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.212+0000 7ffaa9200640 1 -- 172.21.15.55:0/2749912995 >> 172.21.15.55:0/2749912995 conn(0x7ffaa4066080 msgr2=0x7ffaa406c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.212+0000 7ffaa9200640 1 -- 172.21.15.55:0/2749912995 shutdown_connections 2024-04-02T07:26:44.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:44.212+0000 7ffaa9200640 1 -- 172.21.15.55:0/2749912995 wait complete. 2024-04-02T07:26:44.236 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-02T07:26:44.236 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-02T07:26:44.236 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-02T07:26:44.236 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:26:44.236 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-02T07:26:44.237 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-02T07:26:44.237 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-02T07:26:44.237 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:26:44.237 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-02T07:26:44.237 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-02T07:26:44.237 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-02T07:26:44.237 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:26:44.237 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-02T07:26:44.238 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-02T07:26:44.238 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-02T07:26:44.238 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:26:44.250 INFO:tasks.ceph.mds.a:Stopped 2024-04-02T07:26:44.250 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-02T07:26:44.252 INFO:tasks.ceph.mds.d:Stopped 2024-04-02T07:26:44.253 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-02T07:26:44.253 INFO:tasks.ceph.mds.b:Stopped 2024-04-02T07:26:44.254 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-02T07:26:44.298 INFO:tasks.ceph.mds.a:Started 2024-04-02T07:26:44.299 DEBUG:teuthology.parallel:result is None 2024-04-02T07:26:44.302 INFO:tasks.ceph.mds.d:Started 2024-04-02T07:26:44.302 DEBUG:teuthology.parallel:result is None 2024-04-02T07:26:44.304 INFO:tasks.ceph.mds.b:Started 2024-04-02T07:26:44.304 DEBUG:teuthology.parallel:result is None 2024-04-02T07:26:44.382 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-02T07:26:44.392 INFO:tasks.ceph.mds.b.smithi106.stdout:starting mds.b at 2024-04-02T07:26:44.398 INFO:tasks.ceph.mds.d.smithi106.stdout:starting mds.d at 2024-04-02T07:26:46.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-04-02T07:26:50.250 INFO:tasks.ceph.mds.c:Stopped 2024-04-02T07:26:50.250 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-02T07:26:50.254 INFO:tasks.ceph.mds.c:Started 2024-04-02T07:26:50.254 DEBUG:teuthology.parallel:result is None 2024-04-02T07:26:50.254 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-02T07:26:50.340 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-02T07:26:50.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.396+0000 7f2625c00640 1 Processor -- start 2024-04-02T07:26:50.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.396+0000 7f2625c00640 1 -- start start 2024-04-02T07:26:50.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.396+0000 7f2625c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f262015a950 0x7f26200cd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:50.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.396+0000 7f2625c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26200cd630 0x7f26200ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:50.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.396+0000 7f2625c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26200cb280 con 0x7f26200ce8f0 2024-04-02T07:26:50.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.396+0000 7f2625c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26200c4250 con 0x7f262015a950 2024-04-02T07:26:50.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.396+0000 7f2625c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26200cb7e0 con 0x7f26200cd630 2024-04-02T07:26:50.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.396+0000 7f261f400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f26200ce8f0 0x7f2620098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34192/0 (socket says 172.21.15.55:34192) 2024-04-02T07:26:50.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.396+0000 7f261f400640 1 -- 172.21.15.55:0/2100850893 learned_addr learned my addr 172.21.15.55:0/2100850893 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:26:50.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.396+0000 7f261ea00640 1 --2- 172.21.15.55:0/2100850893 >> v2:172.21.15.55:3300/0 conn(0x7f262015a950 0x7f26200cd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:50.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.396+0000 7f2617e00640 1 --2- 172.21.15.55:0/2100850893 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26200cd630 0x7f26200ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:50.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.396+0000 7f261e000640 1 -- 172.21.15.55:0/2100850893 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2946488753 0 0) 0x7f26200cb280 con 0x7f26200ce8f0 2024-04-02T07:26:50.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.396+0000 7f261e000640 1 -- 172.21.15.55:0/2100850893 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2604003530 con 0x7f26200ce8f0 2024-04-02T07:26:50.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.396+0000 7f261ea00640 1 -- 172.21.15.55:0/2100850893 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26200cd630 msgr2=0x7f26200ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:50.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.396+0000 7f261ea00640 1 --2- 172.21.15.55:0/2100850893 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26200cd630 0x7f26200ce3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:50.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.396+0000 7f261ea00640 1 -- 172.21.15.55:0/2100850893 >> v1:172.21.15.55:6789/0 conn(0x7f26200ce8f0 legacy=0x7f2620098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:50.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.396+0000 7f261ea00640 1 -- 172.21.15.55:0/2100850893 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26200cda90 con 0x7f262015a950 2024-04-02T07:26:50.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.400+0000 7f261ea00640 1 --2- 172.21.15.55:0/2100850893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f262015a950 0x7f26200cd0f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f26100097c0 tx=0x7f261001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625e286e1de9a6f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:50.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.400+0000 7f261e000640 1 -- 172.21.15.55:0/2100850893 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26100ab600 con 0x7f262015a950 2024-04-02T07:26:50.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.400+0000 7f261e000640 1 -- 172.21.15.55:0/2100850893 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26100a7050 con 0x7f262015a950 2024-04-02T07:26:50.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.400+0000 7f261e000640 1 -- 172.21.15.55:0/2100850893 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26100ab980 con 0x7f262015a950 2024-04-02T07:26:50.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.400+0000 7f2625c00640 1 -- 172.21.15.55:0/2100850893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f262015a950 msgr2=0x7f26200cd0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:50.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.400+0000 7f2625c00640 1 --2- 172.21.15.55:0/2100850893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f262015a950 0x7f26200cd0f0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f26100097c0 tx=0x7f261001c4a0 comp rx=0 tx=0).stop 2024-04-02T07:26:50.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.400+0000 7f2625c00640 1 -- 172.21.15.55:0/2100850893 shutdown_connections 2024-04-02T07:26:50.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.400+0000 7f2625c00640 1 --2- 172.21.15.55:0/2100850893 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26200cd630 0x7f26200ce3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:50.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.400+0000 7f2625c00640 1 --2- 172.21.15.55:0/2100850893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f262015a950 0x7f26200cd0f0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:50.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.400+0000 7f2625c00640 1 -- 172.21.15.55:0/2100850893 >> 172.21.15.55:0/2100850893 conn(0x7f26200d0700 msgr2=0x7f26200d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:50.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.400+0000 7f2625c00640 1 -- 172.21.15.55:0/2100850893 shutdown_connections 2024-04-02T07:26:50.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.400+0000 7f2625c00640 1 -- 172.21.15.55:0/2100850893 wait complete. 2024-04-02T07:26:50.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2625c00640 1 Processor -- start 2024-04-02T07:26:50.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2625c00640 1 -- start start 2024-04-02T07:26:50.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2625c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26200cd630 0x7f262014e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:50.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2625c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26200ce8f0 0x7f2620164d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:50.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2625c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f262015a950 0x7f262006c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:50.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2625c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2620163970 con 0x7f26200ce8f0 2024-04-02T07:26:50.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2625c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f262006ceb0 con 0x7f26200cd630 2024-04-02T07:26:50.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2625c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f262006b8d0 con 0x7f262015a950 2024-04-02T07:26:50.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2617e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26200ce8f0 0x7f2620164d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:50.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2617e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26200ce8f0 0x7f2620164d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36358/0 (socket says 172.21.15.55:36358) 2024-04-02T07:26:50.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2617e00640 1 -- 172.21.15.55:0/2471380764 learned_addr learned my addr 172.21.15.55:0/2471380764 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:50.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f261f400640 1 --2- 172.21.15.55:0/2471380764 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f262015a950 0x7f262006c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:50.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f261ea00640 1 --2- 172.21.15.55:0/2471380764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26200cd630 0x7f262014e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:50.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2617e00640 1 -- 172.21.15.55:0/2471380764 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f262015a950 msgr2=0x7f262006c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:50.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2617e00640 1 --2- 172.21.15.55:0/2471380764 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f262015a950 0x7f262006c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:50.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2617e00640 1 -- 172.21.15.55:0/2471380764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26200cd630 msgr2=0x7f262014e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:50.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2617e00640 1 --2- 172.21.15.55:0/2471380764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26200cd630 0x7f262014e720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:50.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2617e00640 1 -- 172.21.15.55:0/2471380764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2610009420 con 0x7f26200ce8f0 2024-04-02T07:26:50.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2617e00640 1 --2- 172.21.15.55:0/2471380764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26200ce8f0 0x7f2620164d30 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f260800e930 tx=0x7f260800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:50.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2616a00640 1 -- 172.21.15.55:0/2471380764 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2608009690 con 0x7f26200ce8f0 2024-04-02T07:26:50.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2616a00640 1 -- 172.21.15.55:0/2471380764 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260800ca00 con 0x7f26200ce8f0 2024-04-02T07:26:50.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2625c00640 1 -- 172.21.15.55:0/2471380764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f262006bbb0 con 0x7f26200ce8f0 2024-04-02T07:26:50.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2616a00640 1 -- 172.21.15.55:0/2471380764 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260800cd70 con 0x7f26200ce8f0 2024-04-02T07:26:50.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.404+0000 7f2625c00640 1 -- 172.21.15.55:0/2471380764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f262006c170 con 0x7f26200ce8f0 2024-04-02T07:26:50.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.408+0000 7f2625c00640 1 -- 172.21.15.55:0/2471380764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2620066c90 con 0x7f26200ce8f0 2024-04-02T07:26:50.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.408+0000 7f2616a00640 1 -- 172.21.15.55:0/2471380764 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2608013470 con 0x7f26200ce8f0 2024-04-02T07:26:50.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.408+0000 7f2616a00640 1 --2- 172.21.15.55:0/2471380764 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25fc066690 0x7f25fc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:50.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.408+0000 7f2616a00640 1 -- 172.21.15.55:0/2471380764 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2608084440 con 0x7f26200ce8f0 2024-04-02T07:26:50.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.408+0000 7f261ea00640 1 --2- 172.21.15.55:0/2471380764 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25fc066690 0x7f25fc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:50.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.408+0000 7f261ea00640 1 --2- 172.21.15.55:0/2471380764 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25fc066690 0x7f25fc068b50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f26100ad000 tx=0x7f26100a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:50.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.412+0000 7f2616a00640 1 -- 172.21.15.55:0/2471380764 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2608051b90 con 0x7f26200ce8f0 2024-04-02T07:26:50.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:50.584+0000 7f2625c00640 1 -- 172.21.15.55:0/2471380764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f262015df10 con 0x7f26200ce8f0 2024-04-02T07:26:51.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.372+0000 7f2616a00640 1 -- 172.21.15.55:0/2471380764 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v68) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2608017080 con 0x7f26200ce8f0 2024-04-02T07:26:51.376 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2024-04-02T07:26:51.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.372+0000 7f2625c00640 1 -- 172.21.15.55:0/2471380764 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25fc066690 msgr2=0x7f25fc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:51.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.372+0000 7f2625c00640 1 --2- 172.21.15.55:0/2471380764 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25fc066690 0x7f25fc068b50 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f26100ad000 tx=0x7f26100a6000 comp rx=0 tx=0).stop 2024-04-02T07:26:51.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.372+0000 7f2625c00640 1 -- 172.21.15.55:0/2471380764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26200ce8f0 msgr2=0x7f2620164d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:51.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.372+0000 7f2625c00640 1 --2- 172.21.15.55:0/2471380764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26200ce8f0 0x7f2620164d30 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f260800e930 tx=0x7f260800edf0 comp rx=0 tx=0).stop 2024-04-02T07:26:51.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.372+0000 7f2625c00640 1 -- 172.21.15.55:0/2471380764 shutdown_connections 2024-04-02T07:26:51.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.372+0000 7f2625c00640 1 --2- 172.21.15.55:0/2471380764 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f262015a950 0x7f262006c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:51.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.372+0000 7f2625c00640 1 --2- 172.21.15.55:0/2471380764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26200ce8f0 0x7f2620164d30 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:51.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.372+0000 7f2625c00640 1 --2- 172.21.15.55:0/2471380764 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25fc066690 0x7f25fc068b50 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:51.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.372+0000 7f2625c00640 1 --2- 172.21.15.55:0/2471380764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26200cd630 0x7f262014e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:51.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.372+0000 7f2625c00640 1 -- 172.21.15.55:0/2471380764 >> 172.21.15.55:0/2471380764 conn(0x7f26200d0700 msgr2=0x7f26200c43a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:51.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.372+0000 7f2625c00640 1 -- 172.21.15.55:0/2471380764 shutdown_connections 2024-04-02T07:26:51.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.372+0000 7f2625c00640 1 -- 172.21.15.55:0/2471380764 wait complete. 2024-04-02T07:26:51.403 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-02T07:26:51.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.540+0000 7f6a52a00640 1 Processor -- start 2024-04-02T07:26:51.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.540+0000 7f6a52a00640 1 -- start start 2024-04-02T07:26:51.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.544+0000 7f6a52a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a4c15ee70 0x7f6a4c099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:51.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.544+0000 7f6a52a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6a4c15f250 0x7f6a4c0b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:51.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.544+0000 7f6a52a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4c0cf6a0 con 0x7f6a4c098a10 2024-04-02T07:26:51.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.544+0000 7f6a52a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a4c0b0840 con 0x7f6a4c15f250 2024-04-02T07:26:51.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.544+0000 7f6a52a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c0ad270 con 0x7f6a4c15ee70 2024-04-02T07:26:51.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.544+0000 7f6a43e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6a4c15f250 0x7f6a4c0b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:51.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.544+0000 7f6a4be00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a4c15ee70 0x7f6a4c099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:51.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.544+0000 7f6a4be00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a4c15ee70 0x7f6a4c099830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:51672/0 (socket says 172.21.15.55:51672) 2024-04-02T07:26:51.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.544+0000 7f6a4be00640 1 -- 172.21.15.55:0/3461170556 learned_addr learned my addr 172.21.15.55:0/3461170556 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:51.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.544+0000 7f6a43e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6a4c15f250 0x7f6a4c0b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:58968/0 (socket says 172.21.15.55:58968) 2024-04-02T07:26:51.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.544+0000 7f6a4be00640 1 -- 172.21.15.55:0/3461170556 >> v2:172.21.15.106:3300/0 conn(0x7f6a4c15f250 msgr2=0x7f6a4c0b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:51.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.544+0000 7f6a4be00640 1 --2- 172.21.15.55:0/3461170556 >> v2:172.21.15.106:3300/0 conn(0x7f6a4c15f250 0x7f6a4c0b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:51.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.544+0000 7f6a4be00640 1 -- 172.21.15.55:0/3461170556 >> v1:172.21.15.106:6789/0 conn(0x7f6a4c098a10 legacy=0x7f6a4c0cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:51.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.544+0000 7f6a4be00640 1 -- 172.21.15.55:0/3461170556 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c0b0a50 con 0x7f6a4c15ee70 2024-04-02T07:26:51.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.548+0000 7f6a4be00640 1 --2- 172.21.15.55:0/3461170556 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a4c15ee70 0x7f6a4c099830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009870 tx=0x7f6a3c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c734b9010fec5a1d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:51.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.548+0000 7f6a4b400640 1 -- 172.21.15.55:0/3461170556 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c0a9620 con 0x7f6a4c15ee70 2024-04-02T07:26:51.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.548+0000 7f6a4b400640 1 -- 172.21.15.55:0/3461170556 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c0a9780 con 0x7f6a4c15ee70 2024-04-02T07:26:51.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.548+0000 7f6a4b400640 1 -- 172.21.15.55:0/3461170556 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c0a9b10 con 0x7f6a4c15ee70 2024-04-02T07:26:51.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.548+0000 7f6a52a00640 1 -- 172.21.15.55:0/3461170556 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a4c15ee70 msgr2=0x7f6a4c099830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:51.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.548+0000 7f6a52a00640 1 --2- 172.21.15.55:0/3461170556 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a4c15ee70 0x7f6a4c099830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c009870 tx=0x7f6a3c01c560 comp rx=0 tx=0).stop 2024-04-02T07:26:51.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.548+0000 7f6a52a00640 1 -- 172.21.15.55:0/3461170556 shutdown_connections 2024-04-02T07:26:51.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.548+0000 7f6a52a00640 1 --2- 172.21.15.55:0/3461170556 >> v2:172.21.15.106:3300/0 conn(0x7f6a4c15f250 0x7f6a4c0b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:51.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.548+0000 7f6a52a00640 1 --2- 172.21.15.55:0/3461170556 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a4c15ee70 0x7f6a4c099830 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:51.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.548+0000 7f6a52a00640 1 -- 172.21.15.55:0/3461170556 >> 172.21.15.55:0/3461170556 conn(0x7f6a4c0b21d0 msgr2=0x7f6a4c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:51.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.548+0000 7f6a52a00640 1 -- 172.21.15.55:0/3461170556 shutdown_connections 2024-04-02T07:26:51.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.548+0000 7f6a52a00640 1 -- 172.21.15.55:0/3461170556 wait complete. 2024-04-02T07:26:51.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.548+0000 7f6a52a00640 1 Processor -- start 2024-04-02T07:26:51.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.548+0000 7f6a52a00640 1 -- start start 2024-04-02T07:26:51.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a52a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a4c098a10 0x7f6a4c154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:51.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a52a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a4c15ee70 0x7f6a4c0c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:51.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a52a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a4c15f250 0x7f6a4c0c4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:51.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a52a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c15c550 con 0x7f6a4c15ee70 2024-04-02T07:26:51.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a52a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c15c830 con 0x7f6a4c15f250 2024-04-02T07:26:51.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a52a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c15cb10 con 0x7f6a4c098a10 2024-04-02T07:26:51.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a43e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a4c15ee70 0x7f6a4c0c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:51.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a43e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a4c15ee70 0x7f6a4c0c6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36372/0 (socket says 172.21.15.55:36372) 2024-04-02T07:26:51.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a43e00640 1 -- 172.21.15.55:0/4272318649 learned_addr learned my addr 172.21.15.55:0/4272318649 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:51.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a4be00640 1 --2- 172.21.15.55:0/4272318649 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a4c098a10 0x7f6a4c154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:51.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a50a00640 1 --2- 172.21.15.55:0/4272318649 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a4c15f250 0x7f6a4c0c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:51.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a43e00640 1 -- 172.21.15.55:0/4272318649 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a4c098a10 msgr2=0x7f6a4c154400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:51.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a43e00640 1 --2- 172.21.15.55:0/4272318649 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a4c098a10 0x7f6a4c154400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:51.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a43e00640 1 -- 172.21.15.55:0/4272318649 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a4c15f250 msgr2=0x7f6a4c0c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:51.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a43e00640 1 --2- 172.21.15.55:0/4272318649 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a4c15f250 0x7f6a4c0c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:51.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a43e00640 1 -- 172.21.15.55:0/4272318649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a3c0094d0 con 0x7f6a4c15ee70 2024-04-02T07:26:51.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a43e00640 1 --2- 172.21.15.55:0/4272318649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a4c15ee70 0x7f6a4c0c6dc0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400e930 tx=0x7f6a3400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:51.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a48c00640 1 -- 172.21.15.55:0/4272318649 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a34009690 con 0x7f6a4c15ee70 2024-04-02T07:26:51.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a48c00640 1 -- 172.21.15.55:0/4272318649 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3400ca00 con 0x7f6a4c15ee70 2024-04-02T07:26:51.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a48c00640 1 -- 172.21.15.55:0/4272318649 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3400cd70 con 0x7f6a4c15ee70 2024-04-02T07:26:51.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a52a00640 1 -- 172.21.15.55:0/4272318649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4c0993b0 con 0x7f6a4c15ee70 2024-04-02T07:26:51.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a52a00640 1 -- 172.21.15.55:0/4272318649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4c15d0d0 con 0x7f6a4c15ee70 2024-04-02T07:26:51.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.552+0000 7f6a52a00640 1 -- 172.21.15.55:0/4272318649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4c066c90 con 0x7f6a4c15ee70 2024-04-02T07:26:51.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.556+0000 7f6a48c00640 1 -- 172.21.15.55:0/4272318649 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6a34013470 con 0x7f6a4c15ee70 2024-04-02T07:26:51.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.556+0000 7f6a48c00640 1 --2- 172.21.15.55:0/4272318649 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a28066690 0x7f6a28068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:51.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.556+0000 7f6a48c00640 1 -- 172.21.15.55:0/4272318649 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6a34083fe0 con 0x7f6a4c15ee70 2024-04-02T07:26:51.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.556+0000 7f6a4be00640 1 --2- 172.21.15.55:0/4272318649 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a28066690 0x7f6a28068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:51.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.556+0000 7f6a4be00640 1 --2- 172.21.15.55:0/4272318649 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a28066690 0x7f6a28068b50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0ae000 tx=0x7f6a3c0b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:51.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.560+0000 7f6a48c00640 1 -- 172.21.15.55:0/4272318649 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6a34051820 con 0x7f6a4c15ee70 2024-04-02T07:26:51.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.772+0000 7f6a52a00640 1 -- 172.21.15.55:0/4272318649 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f6a4c0cc3e0 con 0x7f6a4c15ee70 2024-04-02T07:26:51.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.772+0000 7f6a48c00640 1 -- 172.21.15.55:0/4272318649 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f6a34017090 con 0x7f6a4c15ee70 2024-04-02T07:26:51.779 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:51.779 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:26:51.779 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2024-04-02T07:26:51.779 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:26:51.779 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2024-04-02T07:26:51.779 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFL1DHxAAuUs47l42sADNRgxi4BeNrA==", 2024-04-02T07:26:51.779 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:26:51.780 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:26:51.780 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:26:51.780 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:26:51.780 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:26:51.780 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:51.780 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:26:51.780 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:26:51.780 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2024-04-02T07:26:51.780 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFZB+KxAAeKnfP4Z1UkLura+bQrG5mA==", 2024-04-02T07:26:51.780 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:26:51.780 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:26:51.780 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:26:51.780 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:26:51.780 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:26:51.781 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:51.781 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:26:51.781 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:26:51.781 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2024-04-02T07:26:51.781 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmUQR/JhAA9LNK5gHJ1NiiqNrfxL4mIA==", 2024-04-02T07:26:51.781 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:26:51.781 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:26:51.781 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:26:51.781 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:26:51.781 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:26:51.781 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:51.781 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:26:51.781 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:26:51.781 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2024-04-02T07:26:51.782 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmotumMhAASI1PogpVSHXWIv9xq3qs4Q==", 2024-04-02T07:26:51.782 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:26:51.782 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:26:51.782 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:26:51.782 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:26:51.782 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:26:51.782 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:51.782 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:26:51.782 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:26:51.782 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2024-04-02T07:26:51.783 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDysQtmsM9JIxAAZNjTGYW74kqz5NM9NyPSWQ==", 2024-04-02T07:26:51.783 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:26:51.783 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:26:51.783 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:26:51.783 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:26:51.783 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:51.783 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:26:51.783 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:26:51.783 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2024-04-02T07:26:51.783 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD1sQtmJaorKhAAtujPXPmQVX3QUG1ANqEphQ==", 2024-04-02T07:26:51.783 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:26:51.783 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:26:51.783 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:26:51.784 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:26:51.784 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:51.784 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:26:51.784 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:26:51.784 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2024-04-02T07:26:51.784 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD4sQtm1fdwMhAAOxlYwaBnPKhSQODMLVbaSQ==", 2024-04-02T07:26:51.784 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:26:51.784 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:26:51.784 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:26:51.784 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:26:51.784 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:51.784 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:26:51.784 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:26:51.784 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2024-04-02T07:26:51.785 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD7sQtmo9OaORAAsjpiVkG9vZV1QxpvgbrFmg==", 2024-04-02T07:26:51.785 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:26:51.785 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:26:51.785 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:26:51.785 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:26:51.785 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:51.785 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:26:51.785 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:26:51.785 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2024-04-02T07:26:51.785 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQACsgtmTyOkAxAARfxuj/YCM6FWNDhCkLQV3g==", 2024-04-02T07:26:51.785 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:26:51.785 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:26:51.785 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:26:51.786 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:26:51.786 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:51.786 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:26:51.786 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:26:51.786 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2024-04-02T07:26:51.786 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAFsgtmimDECRAAh/XVN7rICihc8NlxhDJB6Q==", 2024-04-02T07:26:51.786 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:26:51.786 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:26:51.786 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:26:51.786 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:26:51.786 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:51.786 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:26:51.787 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:26:51.787 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2024-04-02T07:26:51.787 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAIsgtmreHiDhAAISQbxixad17TRrz7MHQTxA==", 2024-04-02T07:26:51.787 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:26:51.787 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:26:51.787 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:26:51.787 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:26:51.787 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:51.787 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:26:51.787 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:26:51.787 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2024-04-02T07:26:51.787 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQALsgtmHVTlExAAT/6jK+czOZ3+4nwpgZOmow==", 2024-04-02T07:26:51.787 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:26:51.788 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:26:51.788 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:26:51.788 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:26:51.788 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:51.788 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:26:51.788 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:26:51.788 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2024-04-02T07:26:51.788 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmkS2QNhAAt+q0y1TDn03hqM/Y6uKq6g==", 2024-04-02T07:26:51.788 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:26:51.788 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:26:51.788 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2024-04-02T07:26:51.789 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-02T07:26:51.789 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:51.789 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:26:51.789 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:26:51.789 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2024-04-02T07:26:51.789 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmjCzTBBAAVYyat2dGZSTquRQoB+7JMg==", 2024-04-02T07:26:51.789 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:26:51.789 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:26:51.789 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:26:51.789 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:26:51.790 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:26:51.790 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:51.790 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:26:51.790 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:26:51.790 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2024-04-02T07:26:51.790 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmq45FARAAY6/caSeqvTn7/BThOodYIA==", 2024-04-02T07:26:51.790 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:26:51.790 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:26:51.790 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:26:51.790 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:26:51.790 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:26:51.790 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:51.790 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:26:51.790 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:26:51.791 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2024-04-02T07:26:51.791 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmmjDeChAAL2RsY5VlAy/KZ5go5ZJoBA==", 2024-04-02T07:26:51.791 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:26:51.791 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:26:51.791 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:26:51.791 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:26:51.791 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:26:51.791 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:51.791 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:26:51.791 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:26:51.791 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2024-04-02T07:26:51.791 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtm1hiMAxAAarlHR9VHGrkPCXhksMM/1w==", 2024-04-02T07:26:51.792 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:26:51.792 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:26:51.792 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:26:51.792 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:26:51.792 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:26:51.792 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:51.792 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:26:51.792 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:26:51.792 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2024-04-02T07:26:51.792 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFyktGxAAJC7ezewbXwDQue+qjpTfYw==", 2024-04-02T07:26:51.792 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:26:51.792 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:26:51.792 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-02T07:26:51.793 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:26:51.793 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:51.793 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:26:51.793 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:26:51.793 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2024-04-02T07:26:51.793 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmUcxUFxAA8NUHdxhUfp3/AILMIbS1fw==", 2024-04-02T07:26:51.793 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:26:51.793 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:26:51.793 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-02T07:26:51.793 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:26:51.793 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:51.793 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:51.793 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-04-02T07:26:51.793 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:26:51.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.776+0000 7f6a52a00640 1 -- 172.21.15.55:0/4272318649 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a28066690 msgr2=0x7f6a28068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:51.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.776+0000 7f6a52a00640 1 --2- 172.21.15.55:0/4272318649 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a28066690 0x7f6a28068b50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c0ae000 tx=0x7f6a3c0b3040 comp rx=0 tx=0).stop 2024-04-02T07:26:51.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.776+0000 7f6a52a00640 1 -- 172.21.15.55:0/4272318649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a4c15ee70 msgr2=0x7f6a4c0c6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:51.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.776+0000 7f6a52a00640 1 --2- 172.21.15.55:0/4272318649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a4c15ee70 0x7f6a4c0c6dc0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f6a3400e930 tx=0x7f6a3400edf0 comp rx=0 tx=0).stop 2024-04-02T07:26:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.776+0000 7f6a52a00640 1 -- 172.21.15.55:0/4272318649 shutdown_connections 2024-04-02T07:26:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.776+0000 7f6a52a00640 1 --2- 172.21.15.55:0/4272318649 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a28066690 0x7f6a28068b50 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.776+0000 7f6a52a00640 1 --2- 172.21.15.55:0/4272318649 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6a4c15f250 0x7f6a4c0c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.776+0000 7f6a52a00640 1 --2- 172.21.15.55:0/4272318649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6a4c15ee70 0x7f6a4c0c6dc0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.776+0000 7f6a52a00640 1 --2- 172.21.15.55:0/4272318649 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6a4c098a10 0x7f6a4c154400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.776+0000 7f6a52a00640 1 -- 172.21.15.55:0/4272318649 >> 172.21.15.55:0/4272318649 conn(0x7f6a4c0b21d0 msgr2=0x7f6a4c0afec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.776+0000 7f6a52a00640 1 -- 172.21.15.55:0/4272318649 shutdown_connections 2024-04-02T07:26:51.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.776+0000 7f6a52a00640 1 -- 172.21.15.55:0/4272318649 wait complete. 2024-04-02T07:26:51.800 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:26:51.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.932+0000 7fd149200640 1 Processor -- start 2024-04-02T07:26:51.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.936+0000 7fd149200640 1 -- start start 2024-04-02T07:26:51.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.936+0000 7fd149200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd144099120 0x7fd1440b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:51.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.936+0000 7fd149200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd14406aff0 0x7fd14406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:51.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.936+0000 7fd149200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd14415ce50 con 0x7fd14415ca70 2024-04-02T07:26:51.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.936+0000 7fd149200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1440cef60 con 0x7fd14406aff0 2024-04-02T07:26:51.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.936+0000 7fd149200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14406bd60 con 0x7fd144099120 2024-04-02T07:26:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.936+0000 7fd141e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd14415ca70 0x7fd144098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34202/0 (socket says 172.21.15.55:34202) 2024-04-02T07:26:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.936+0000 7fd141e00640 1 -- 172.21.15.55:0/1113009001 learned_addr learned my addr 172.21.15.55:0/1113009001 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:26:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.936+0000 7fd142800640 1 --2- 172.21.15.55:0/1113009001 >> v2:172.21.15.55:3300/0 conn(0x7fd14406aff0 0x7fd14406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.936+0000 7fd139400640 1 --2- 172.21.15.55:0/1113009001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd144099120 0x7fd1440b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.936+0000 7fd142800640 1 -- 172.21.15.55:0/1113009001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd144099120 msgr2=0x7fd1440b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.936+0000 7fd142800640 1 --2- 172.21.15.55:0/1113009001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd144099120 0x7fd1440b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.936+0000 7fd142800640 1 -- 172.21.15.55:0/1113009001 >> v1:172.21.15.55:6789/0 conn(0x7fd14415ca70 legacy=0x7fd144098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.936+0000 7fd142800640 1 -- 172.21.15.55:0/1113009001 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd14406c040 con 0x7fd14406aff0 2024-04-02T07:26:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.936+0000 7fd141400640 1 -- 172.21.15.55:0/1113009001 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3814615327 0 0) 0x7fd14415ce50 con 0x7fd14415ca70 2024-04-02T07:26:51.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.936+0000 7fd139400640 1 --2- 172.21.15.55:0/1113009001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd144099120 0x7fd1440b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:26:51.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.940+0000 7fd142800640 1 --2- 172.21.15.55:0/1113009001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd14406aff0 0x7fd14406b480 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd13c0097c0 tx=0x7fd13c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b0d05a77baac381 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:51.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.940+0000 7fd141400640 1 -- 172.21.15.55:0/1113009001 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c0aa5f0 con 0x7fd14406aff0 2024-04-02T07:26:51.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.940+0000 7fd141400640 1 -- 172.21.15.55:0/1113009001 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13c0aa750 con 0x7fd14406aff0 2024-04-02T07:26:51.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.940+0000 7fd141400640 1 -- 172.21.15.55:0/1113009001 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13c0aaae0 con 0x7fd14406aff0 2024-04-02T07:26:51.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.940+0000 7fd149200640 1 -- 172.21.15.55:0/1113009001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd14406aff0 msgr2=0x7fd14406b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:51.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.940+0000 7fd149200640 1 --2- 172.21.15.55:0/1113009001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd14406aff0 0x7fd14406b480 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fd13c0097c0 tx=0x7fd13c01c470 comp rx=0 tx=0).stop 2024-04-02T07:26:51.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.940+0000 7fd149200640 1 -- 172.21.15.55:0/1113009001 shutdown_connections 2024-04-02T07:26:51.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.940+0000 7fd149200640 1 --2- 172.21.15.55:0/1113009001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd144099120 0x7fd1440b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:51.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.940+0000 7fd149200640 1 --2- 172.21.15.55:0/1113009001 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd14406aff0 0x7fd14406b480 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:51.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.940+0000 7fd149200640 1 -- 172.21.15.55:0/1113009001 >> 172.21.15.55:0/1113009001 conn(0x7fd1440b21d0 msgr2=0x7fd1440b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:51.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.940+0000 7fd149200640 1 -- 172.21.15.55:0/1113009001 shutdown_connections 2024-04-02T07:26:51.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.940+0000 7fd149200640 1 -- 172.21.15.55:0/1113009001 wait complete. 2024-04-02T07:26:51.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.940+0000 7fd149200640 1 Processor -- start 2024-04-02T07:26:51.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.940+0000 7fd149200640 1 -- start start 2024-04-02T07:26:51.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd149200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd14406aff0 0x7fd1440c6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:51.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd149200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd144099120 0x7fd14414abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:51.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd149200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd14415ca70 0x7fd1440ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:51.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd149200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14415e0d0 con 0x7fd144099120 2024-04-02T07:26:51.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd149200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14415b350 con 0x7fd14406aff0 2024-04-02T07:26:51.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd149200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14415bb20 con 0x7fd14415ca70 2024-04-02T07:26:51.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd139400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd144099120 0x7fd14414abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:51.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd139400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd144099120 0x7fd14414abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36392/0 (socket says 172.21.15.55:36392) 2024-04-02T07:26:51.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd139400640 1 -- 172.21.15.55:0/2208795274 learned_addr learned my addr 172.21.15.55:0/2208795274 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:51.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd141e00640 1 --2- 172.21.15.55:0/2208795274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd14406aff0 0x7fd1440c6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:51.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd142800640 1 --2- 172.21.15.55:0/2208795274 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd14415ca70 0x7fd1440ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:51.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd139400640 1 -- 172.21.15.55:0/2208795274 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd14415ca70 msgr2=0x7fd1440ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:51.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd139400640 1 --2- 172.21.15.55:0/2208795274 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd14415ca70 0x7fd1440ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:51.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd139400640 1 -- 172.21.15.55:0/2208795274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd14406aff0 msgr2=0x7fd1440c6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:51.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd139400640 1 --2- 172.21.15.55:0/2208795274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd14406aff0 0x7fd1440c6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:51.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd139400640 1 -- 172.21.15.55:0/2208795274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c009420 con 0x7fd144099120 2024-04-02T07:26:51.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd139400640 1 --2- 172.21.15.55:0/2208795274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd144099120 0x7fd14414abf0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00cf90 tx=0x7fd12c00a7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:51.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd13aa00640 1 -- 172.21.15.55:0/2208795274 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c00d840 con 0x7fd144099120 2024-04-02T07:26:51.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd13aa00640 1 -- 172.21.15.55:0/2208795274 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd12c00d9a0 con 0x7fd144099120 2024-04-02T07:26:51.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd13aa00640 1 -- 172.21.15.55:0/2208795274 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12c00dd30 con 0x7fd144099120 2024-04-02T07:26:51.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd149200640 1 -- 172.21.15.55:0/2208795274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1440c43b0 con 0x7fd144099120 2024-04-02T07:26:51.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd149200640 1 -- 172.21.15.55:0/2208795274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd14415b840 con 0x7fd144099120 2024-04-02T07:26:51.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd149200640 1 -- 172.21.15.55:0/2208795274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1440c4210 con 0x7fd144099120 2024-04-02T07:26:51.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.944+0000 7fd13aa00640 1 -- 172.21.15.55:0/2208795274 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd12c015440 con 0x7fd144099120 2024-04-02T07:26:51.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.948+0000 7fd13aa00640 1 --2- 172.21.15.55:0/2208795274 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd120066690 0x7fd120068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:51.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.948+0000 7fd13aa00640 1 -- 172.21.15.55:0/2208795274 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd12c084760 con 0x7fd144099120 2024-04-02T07:26:51.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.948+0000 7fd141e00640 1 --2- 172.21.15.55:0/2208795274 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd120066690 0x7fd120068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:51.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.948+0000 7fd141e00640 1 --2- 172.21.15.55:0/2208795274 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd120066690 0x7fd120068b50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd134000f70 tx=0x7fd134007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:51.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:51.952+0000 7fd13aa00640 1 -- 172.21.15.55:0/2208795274 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd1440c4210 con 0x7fd144099120 2024-04-02T07:26:52.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.112+0000 7fd149200640 1 -- 172.21.15.55:0/2208795274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1440c4210 con 0x7fd144099120 2024-04-02T07:26:52.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.116+0000 7fd13aa00640 1 -- 172.21.15.55:0/2208795274 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) v1 ==== 74+0+12389 (secure 0 0 0) 0x7fd1440c4210 con 0x7fd144099120 2024-04-02T07:26:52.120 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:52.120 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":68,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:26:51.366658+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:26:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.116+0000 7fd149200640 1 -- 172.21.15.55:0/2208795274 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd120066690 msgr2=0x7fd120068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.116+0000 7fd149200640 1 --2- 172.21.15.55:0/2208795274 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd120066690 0x7fd120068b50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd134000f70 tx=0x7fd134007c10 comp rx=0 tx=0).stop 2024-04-02T07:26:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.116+0000 7fd149200640 1 -- 172.21.15.55:0/2208795274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd144099120 msgr2=0x7fd14414abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.116+0000 7fd149200640 1 --2- 172.21.15.55:0/2208795274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd144099120 0x7fd14414abf0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd12c00cf90 tx=0x7fd12c00a7d0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.116+0000 7fd149200640 1 -- 172.21.15.55:0/2208795274 shutdown_connections 2024-04-02T07:26:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.116+0000 7fd149200640 1 --2- 172.21.15.55:0/2208795274 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd14415ca70 0x7fd1440ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.116+0000 7fd149200640 1 --2- 172.21.15.55:0/2208795274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd144099120 0x7fd14414abf0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.116+0000 7fd149200640 1 --2- 172.21.15.55:0/2208795274 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd120066690 0x7fd120068b50 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.116+0000 7fd149200640 1 --2- 172.21.15.55:0/2208795274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd14406aff0 0x7fd1440c6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.116+0000 7fd149200640 1 -- 172.21.15.55:0/2208795274 >> 172.21.15.55:0/2208795274 conn(0x7fd1440b21d0 msgr2=0x7fd1440b0420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:52.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.116+0000 7fd149200640 1 -- 172.21.15.55:0/2208795274 shutdown_connections 2024-04-02T07:26:52.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.116+0000 7fd149200640 1 -- 172.21.15.55:0/2208795274 wait complete. 2024-04-02T07:26:52.141 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:26:52.141 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:26:52.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.280+0000 7f1326800640 1 Processor -- start 2024-04-02T07:26:52.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.280+0000 7f1326800640 1 -- start start 2024-04-02T07:26:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.284+0000 7f1326800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1320160580 0x7f1320098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.284+0000 7f1326800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13200b19b0 0x7f1320098f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.284+0000 7f1326800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13200cfee0 con 0x7f13201601a0 2024-04-02T07:26:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.284+0000 7f1326800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13200d04a0 con 0x7f1320160580 2024-04-02T07:26:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.284+0000 7f1326800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13200cfcf0 con 0x7f13200b19b0 2024-04-02T07:26:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.284+0000 7f1316a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1320160580 0x7f1320098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.284+0000 7f131fe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13200b19b0 0x7f1320098f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.284+0000 7f131fe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13200b19b0 0x7f1320098f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:51714/0 (socket says 172.21.15.55:51714) 2024-04-02T07:26:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.284+0000 7f131fe00640 1 -- 172.21.15.55:0/785048380 learned_addr learned my addr 172.21.15.55:0/785048380 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.284+0000 7f131f400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f13201601a0 0x7f13200cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:55182/0 (socket says 172.21.15.55:55182) 2024-04-02T07:26:52.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.284+0000 7f131fe00640 1 -- 172.21.15.55:0/785048380 >> v2:172.21.15.106:3300/0 conn(0x7f1320160580 msgr2=0x7f1320098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:52.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.284+0000 7f131fe00640 1 --2- 172.21.15.55:0/785048380 >> v2:172.21.15.106:3300/0 conn(0x7f1320160580 0x7f1320098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.284+0000 7f131fe00640 1 -- 172.21.15.55:0/785048380 >> v1:172.21.15.106:6789/0 conn(0x7f13201601a0 legacy=0x7f13200cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:52.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.284+0000 7f131ea00640 1 -- 172.21.15.55:0/785048380 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800026330 0 0) 0x7f13200cfee0 con 0x7f13201601a0 2024-04-02T07:26:52.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.284+0000 7f131fe00640 1 -- 172.21.15.55:0/785048380 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13200d01c0 con 0x7f13200b19b0 2024-04-02T07:26:52.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f131fe00640 1 --2- 172.21.15.55:0/785048380 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13200b19b0 0x7f1320098f50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1318009e50 tx=0x7f131801c8e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9799ea8595828223 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f131ea00640 1 -- 172.21.15.55:0/785048380 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13180a57a0 con 0x7f13200b19b0 2024-04-02T07:26:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f131ea00640 1 -- 172.21.15.55:0/785048380 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13180a5900 con 0x7f13200b19b0 2024-04-02T07:26:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f131ea00640 1 -- 172.21.15.55:0/785048380 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13180a5c90 con 0x7f13200b19b0 2024-04-02T07:26:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f1326800640 1 -- 172.21.15.55:0/785048380 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13200b19b0 msgr2=0x7f1320098f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f1326800640 1 --2- 172.21.15.55:0/785048380 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13200b19b0 0x7f1320098f50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1318009e50 tx=0x7f131801c8e0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f1326800640 1 -- 172.21.15.55:0/785048380 shutdown_connections 2024-04-02T07:26:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f1326800640 1 --2- 172.21.15.55:0/785048380 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13200b19b0 0x7f1320098f50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f1326800640 1 --2- 172.21.15.55:0/785048380 >> v2:172.21.15.106:3300/0 conn(0x7f1320160580 0x7f1320098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f1326800640 1 -- 172.21.15.55:0/785048380 >> 172.21.15.55:0/785048380 conn(0x7f13200b2150 msgr2=0x7f13200b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f1326800640 1 -- 172.21.15.55:0/785048380 shutdown_connections 2024-04-02T07:26:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f1326800640 1 -- 172.21.15.55:0/785048380 wait complete. 2024-04-02T07:26:52.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f1326800640 1 Processor -- start 2024-04-02T07:26:52.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f1326800640 1 -- start start 2024-04-02T07:26:52.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f1326800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13200b19b0 0x7f13200c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:52.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f1326800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13201601a0 0x7f132015b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:52.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f1326800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1320160580 0x7f132015b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:52.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f1326800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1320153c60 con 0x7f13200b19b0 2024-04-02T07:26:52.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f1326800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13200c8a60 con 0x7f13201601a0 2024-04-02T07:26:52.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f1326800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f132015bfa0 con 0x7f1320160580 2024-04-02T07:26:52.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.288+0000 7f131f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13200b19b0 0x7f13200c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:52.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.292+0000 7f131f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13200b19b0 0x7f13200c9600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36408/0 (socket says 172.21.15.55:36408) 2024-04-02T07:26:52.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.292+0000 7f131f400640 1 -- 172.21.15.55:0/2761062024 learned_addr learned my addr 172.21.15.55:0/2761062024 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:52.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.292+0000 7f1316a00640 1 --2- 172.21.15.55:0/2761062024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13201601a0 0x7f132015b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:52.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.292+0000 7f131fe00640 1 --2- 172.21.15.55:0/2761062024 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1320160580 0x7f132015b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:52.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.292+0000 7f131f400640 1 -- 172.21.15.55:0/2761062024 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1320160580 msgr2=0x7f132015b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:52.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.292+0000 7f131f400640 1 --2- 172.21.15.55:0/2761062024 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1320160580 0x7f132015b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.292+0000 7f131f400640 1 -- 172.21.15.55:0/2761062024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13201601a0 msgr2=0x7f132015b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:52.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.292+0000 7f131f400640 1 --2- 172.21.15.55:0/2761062024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13201601a0 0x7f132015b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.292+0000 7f131f400640 1 -- 172.21.15.55:0/2761062024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1318009b30 con 0x7f13200b19b0 2024-04-02T07:26:52.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.292+0000 7f1316a00640 1 --2- 172.21.15.55:0/2761062024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13201601a0 0x7f132015b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:26:52.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.292+0000 7f131f400640 1 --2- 172.21.15.55:0/2761062024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13200b19b0 0x7f13200c9600 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f13100011f0 tx=0x7f131000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:52.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.292+0000 7f1317e00640 1 -- 172.21.15.55:0/2761062024 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13100074e0 con 0x7f13200b19b0 2024-04-02T07:26:52.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.292+0000 7f1317e00640 1 -- 172.21.15.55:0/2761062024 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1310007640 con 0x7f13200b19b0 2024-04-02T07:26:52.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.292+0000 7f1326800640 1 -- 172.21.15.55:0/2761062024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f132015c280 con 0x7f13200b19b0 2024-04-02T07:26:52.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.292+0000 7f1317e00640 1 -- 172.21.15.55:0/2761062024 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1310004a10 con 0x7f13200b19b0 2024-04-02T07:26:52.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.292+0000 7f1326800640 1 -- 172.21.15.55:0/2761062024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f132015c840 con 0x7f13200b19b0 2024-04-02T07:26:52.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.292+0000 7f1326800640 1 -- 172.21.15.55:0/2761062024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13200723d0 con 0x7f13200b19b0 2024-04-02T07:26:52.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.292+0000 7f1317e00640 1 -- 172.21.15.55:0/2761062024 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1310004b70 con 0x7f13200b19b0 2024-04-02T07:26:52.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.296+0000 7f1317e00640 1 --2- 172.21.15.55:0/2761062024 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f12fc066690 0x7f12fc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:52.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.296+0000 7f1317e00640 1 -- 172.21.15.55:0/2761062024 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1310083130 con 0x7f13200b19b0 2024-04-02T07:26:52.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.296+0000 7f1316a00640 1 --2- 172.21.15.55:0/2761062024 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f12fc066690 0x7f12fc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:52.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.296+0000 7f1316a00640 1 --2- 172.21.15.55:0/2761062024 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f12fc066690 0x7f12fc068b50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f132006cc70 tx=0x7f1308008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:52.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.300+0000 7f1317e00640 1 -- 172.21.15.55:0/2761062024 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f13100507e0 con 0x7f13200b19b0 2024-04-02T07:26:52.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.460+0000 7f1326800640 1 -- 172.21.15.55:0/2761062024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1320066c90 con 0x7f13200b19b0 2024-04-02T07:26:52.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.460+0000 7f1317e00640 1 -- 172.21.15.55:0/2761062024 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v68) v1 ==== 93+0+10 (secure 0 0 0) 0x7f13100180a0 con 0x7f13200b19b0 2024-04-02T07:26:52.466 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:26:52.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.464+0000 7f1326800640 1 -- 172.21.15.55:0/2761062024 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f12fc066690 msgr2=0x7f12fc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:52.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.464+0000 7f1326800640 1 --2- 172.21.15.55:0/2761062024 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f12fc066690 0x7f12fc068b50 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f132006cc70 tx=0x7f1308008040 comp rx=0 tx=0).stop 2024-04-02T07:26:52.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.464+0000 7f1326800640 1 -- 172.21.15.55:0/2761062024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13200b19b0 msgr2=0x7f13200c9600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:52.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.464+0000 7f1326800640 1 --2- 172.21.15.55:0/2761062024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13200b19b0 0x7f13200c9600 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f13100011f0 tx=0x7f131000c9b0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.464+0000 7f1326800640 1 -- 172.21.15.55:0/2761062024 shutdown_connections 2024-04-02T07:26:52.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.464+0000 7f1326800640 1 --2- 172.21.15.55:0/2761062024 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1320160580 0x7f132015b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.464+0000 7f1326800640 1 --2- 172.21.15.55:0/2761062024 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f12fc066690 0x7f12fc068b50 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.464+0000 7f1326800640 1 --2- 172.21.15.55:0/2761062024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13201601a0 0x7f132015b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.464+0000 7f1326800640 1 --2- 172.21.15.55:0/2761062024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13200b19b0 0x7f13200c9600 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.464+0000 7f1326800640 1 -- 172.21.15.55:0/2761062024 >> 172.21.15.55:0/2761062024 conn(0x7f13200b2150 msgr2=0x7f132015ccf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:52.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.464+0000 7f1326800640 1 -- 172.21.15.55:0/2761062024 shutdown_connections 2024-04-02T07:26:52.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.464+0000 7f1326800640 1 -- 172.21.15.55:0/2761062024 wait complete. 2024-04-02T07:26:52.487 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-02T07:26:52.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.624+0000 7f5216e00640 1 Processor -- start 2024-04-02T07:26:52.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.624+0000 7f5216e00640 1 -- start start 2024-04-02T07:26:52.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.624+0000 7f5216e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f521015cb60 0x7f52100ae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:52.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.624+0000 7f5216e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f52100b09b0 0x7f52100ac730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:52.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.624+0000 7f5216e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52100af460 con 0x7f52100aef60 2024-04-02T07:26:52.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.624+0000 7f5216e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52100ac2e0 con 0x7f52100b09b0 2024-04-02T07:26:52.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.624+0000 7f5216e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52100af740 con 0x7f521015cb60 2024-04-02T07:26:52.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.624+0000 7f5216400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f52100b09b0 0x7f52100ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:52.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.624+0000 7f5216400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f52100b09b0 0x7f52100ac730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36412/0 (socket says 172.21.15.55:36412) 2024-04-02T07:26:52.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.624+0000 7f5216400640 1 -- 172.21.15.55:0/203334079 learned_addr learned my addr 172.21.15.55:0/203334079 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:52.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.624+0000 7f5215000640 1 --1- 172.21.15.55:0/203334079 >> v1:172.21.15.55:6789/0 conn(0x7f52100aef60 0x7f52100b02a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34214/0 (socket says 172.21.15.55:34214) 2024-04-02T07:26:52.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.624+0000 7f5215a00640 1 --2- 172.21.15.55:0/203334079 >> v2:172.21.15.106:3300/0 conn(0x7f521015cb60 0x7f52100ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:52.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.624+0000 7f5216400640 1 -- 172.21.15.55:0/203334079 >> v2:172.21.15.106:3300/0 conn(0x7f521015cb60 msgr2=0x7f52100ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:52.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.624+0000 7f5216400640 1 --2- 172.21.15.55:0/203334079 >> v2:172.21.15.106:3300/0 conn(0x7f521015cb60 0x7f52100ae630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.624+0000 7f5216400640 1 -- 172.21.15.55:0/203334079 >> v1:172.21.15.55:6789/0 conn(0x7f52100aef60 legacy=0x7f52100b02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:52.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.624+0000 7f5216400640 1 -- 172.21.15.55:0/203334079 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52100afa20 con 0x7f52100b09b0 2024-04-02T07:26:52.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.624+0000 7f520fe00640 1 -- 172.21.15.55:0/203334079 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3457512713 0 0) 0x7f52100af460 con 0x7f52100aef60 2024-04-02T07:26:52.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.628+0000 7f5216400640 1 --2- 172.21.15.55:0/203334079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52100b09b0 0x7f52100ac730 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f52100cf580 tx=0x7f520801c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c68809db01dbc8 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:52.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.628+0000 7f520fe00640 1 -- 172.21.15.55:0/203334079 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52080a58a0 con 0x7f52100b09b0 2024-04-02T07:26:52.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.628+0000 7f520fe00640 1 -- 172.21.15.55:0/203334079 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52080a5a00 con 0x7f52100b09b0 2024-04-02T07:26:52.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.628+0000 7f520fe00640 1 -- 172.21.15.55:0/203334079 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52080a5d90 con 0x7f52100b09b0 2024-04-02T07:26:52.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.628+0000 7f5216e00640 1 -- 172.21.15.55:0/203334079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52100b09b0 msgr2=0x7f52100ac730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:52.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.628+0000 7f5216e00640 1 --2- 172.21.15.55:0/203334079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52100b09b0 0x7f52100ac730 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f52100cf580 tx=0x7f520801c9c0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.628+0000 7f5216e00640 1 -- 172.21.15.55:0/203334079 shutdown_connections 2024-04-02T07:26:52.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.628+0000 7f5216e00640 1 --2- 172.21.15.55:0/203334079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52100b09b0 0x7f52100ac730 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.628+0000 7f5216e00640 1 --2- 172.21.15.55:0/203334079 >> v2:172.21.15.106:3300/0 conn(0x7f521015cb60 0x7f52100ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.628+0000 7f5216e00640 1 -- 172.21.15.55:0/203334079 >> 172.21.15.55:0/203334079 conn(0x7f5210098a10 msgr2=0x7f52100cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:52.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.628+0000 7f5216e00640 1 -- 172.21.15.55:0/203334079 shutdown_connections 2024-04-02T07:26:52.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.628+0000 7f5216e00640 1 -- 172.21.15.55:0/203334079 wait complete. 2024-04-02T07:26:52.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.628+0000 7f5216e00640 1 Processor -- start 2024-04-02T07:26:52.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.628+0000 7f5216e00640 1 -- start start 2024-04-02T07:26:52.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5216e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52100aef60 0x7f5210157360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:52.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5216e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52100b09b0 0x7f52100b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:52.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5216e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f521015cb60 0x7f52101589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:52.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5216e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5210158550 con 0x7f52100b09b0 2024-04-02T07:26:52.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5216e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5210152270 con 0x7f52100aef60 2024-04-02T07:26:52.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5216e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5210157940 con 0x7f521015cb60 2024-04-02T07:26:52.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5215000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52100b09b0 0x7f52100b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:52.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5215000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52100b09b0 0x7f52100b4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36416/0 (socket says 172.21.15.55:36416) 2024-04-02T07:26:52.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5215000640 1 -- 172.21.15.55:0/1594277707 learned_addr learned my addr 172.21.15.55:0/1594277707 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:52.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5215a00640 1 --2- 172.21.15.55:0/1594277707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52100aef60 0x7f5210157360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:52.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5216400640 1 --2- 172.21.15.55:0/1594277707 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f521015cb60 0x7f52101589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:52.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5215000640 1 -- 172.21.15.55:0/1594277707 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f521015cb60 msgr2=0x7f52101589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:52.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5215000640 1 --2- 172.21.15.55:0/1594277707 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f521015cb60 0x7f52101589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5215000640 1 -- 172.21.15.55:0/1594277707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52100aef60 msgr2=0x7f5210157360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:52.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5215000640 1 --2- 172.21.15.55:0/1594277707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52100aef60 0x7f5210157360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5215000640 1 -- 172.21.15.55:0/1594277707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5208009b30 con 0x7f52100b09b0 2024-04-02T07:26:52.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5216400640 1 --2- 172.21.15.55:0/1594277707 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f521015cb60 0x7f52101589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:52.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5215000640 1 --2- 172.21.15.55:0/1594277707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52100b09b0 0x7f52100b4cd0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00c4e0 tx=0x7f51fc00c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:52.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f520d600640 1 -- 172.21.15.55:0/1594277707 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc0074e0 con 0x7f52100b09b0 2024-04-02T07:26:52.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f520d600640 1 -- 172.21.15.55:0/1594277707 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc007660 con 0x7f52100b09b0 2024-04-02T07:26:52.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f520d600640 1 -- 172.21.15.55:0/1594277707 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc004a30 con 0x7f52100b09b0 2024-04-02T07:26:52.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5216e00640 1 -- 172.21.15.55:0/1594277707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5210157c20 con 0x7f52100b09b0 2024-04-02T07:26:52.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5216e00640 1 -- 172.21.15.55:0/1594277707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52101581e0 con 0x7f52100b09b0 2024-04-02T07:26:52.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f5216e00640 1 -- 172.21.15.55:0/1594277707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5210158700 con 0x7f52100b09b0 2024-04-02T07:26:52.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.632+0000 7f520d600640 1 -- 172.21.15.55:0/1594277707 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f51fc004b90 con 0x7f52100b09b0 2024-04-02T07:26:52.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.636+0000 7f520d600640 1 --2- 172.21.15.55:0/1594277707 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51f0066690 0x7f51f0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:52.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.636+0000 7f520d600640 1 -- 172.21.15.55:0/1594277707 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f51fc083130 con 0x7f52100b09b0 2024-04-02T07:26:52.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.636+0000 7f5215a00640 1 --2- 172.21.15.55:0/1594277707 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51f0066690 0x7f51f0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:52.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.636+0000 7f5215a00640 1 --2- 172.21.15.55:0/1594277707 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51f0066690 0x7f51f0068b50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f52100b2a30 tx=0x7f5204009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:52.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.640+0000 7f520d600640 1 -- 172.21.15.55:0/1594277707 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5210158700 con 0x7f52100b09b0 2024-04-02T07:26:52.758 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-04-02T07:26:52.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.800+0000 7f5216e00640 1 -- 172.21.15.55:0/1594277707 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f5210158700 con 0x7f52100b09b0 2024-04-02T07:26:52.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.800+0000 7f520d600640 1 -- 172.21.15.55:0/1594277707 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v68) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5210158700 con 0x7f52100b09b0 2024-04-02T07:26:52.807 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:52.807 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-02T07:26:52.807 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:26:52.807 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-04-02T07:26:52.807 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-04-02T07:26:52.807 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:26:52.808 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-02T07:26:52.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.804+0000 7f5216e00640 1 -- 172.21.15.55:0/1594277707 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51f0066690 msgr2=0x7f51f0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:52.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.804+0000 7f5216e00640 1 --2- 172.21.15.55:0/1594277707 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51f0066690 0x7f51f0068b50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f52100b2a30 tx=0x7f5204009190 comp rx=0 tx=0).stop 2024-04-02T07:26:52.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.804+0000 7f5216e00640 1 -- 172.21.15.55:0/1594277707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52100b09b0 msgr2=0x7f52100b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:52.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.804+0000 7f5216e00640 1 --2- 172.21.15.55:0/1594277707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52100b09b0 0x7f52100b4cd0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f51fc00c4e0 tx=0x7f51fc00c9a0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.804+0000 7f5216e00640 1 -- 172.21.15.55:0/1594277707 shutdown_connections 2024-04-02T07:26:52.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.804+0000 7f5216e00640 1 --2- 172.21.15.55:0/1594277707 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f521015cb60 0x7f52101589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.804+0000 7f5216e00640 1 --2- 172.21.15.55:0/1594277707 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52100b09b0 0x7f52100b4cd0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.804+0000 7f5216e00640 1 --2- 172.21.15.55:0/1594277707 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51f0066690 0x7f51f0068b50 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.804+0000 7f5216e00640 1 --2- 172.21.15.55:0/1594277707 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f52100aef60 0x7f5210157360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.804+0000 7f5216e00640 1 -- 172.21.15.55:0/1594277707 >> 172.21.15.55:0/1594277707 conn(0x7f5210098a10 msgr2=0x7f52100cf600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:52.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.804+0000 7f5216e00640 1 -- 172.21.15.55:0/1594277707 shutdown_connections 2024-04-02T07:26:52.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.804+0000 7f5216e00640 1 -- 172.21.15.55:0/1594277707 wait complete. 2024-04-02T07:26:52.828 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-02T07:26:52.828 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-02T07:26:52.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.968+0000 7f6740e00640 1 Processor -- start 2024-04-02T07:26:52.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.968+0000 7f6740e00640 1 -- start start 2024-04-02T07:26:52.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.968+0000 7f6740e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f673c159a60 0x7f673c06ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:52.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.968+0000 7f6740e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f673c159ee0 0x7f673c06b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:52.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.968+0000 7f6740e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f673c0b3270 con 0x7f673c153ad0 2024-04-02T07:26:52.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.968+0000 7f6740e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f673c15aa50 con 0x7f673c159ee0 2024-04-02T07:26:52.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.968+0000 7f6740e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673c153eb0 con 0x7f673c159a60 2024-04-02T07:26:52.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.968+0000 7f673aa00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f673c159a60 0x7f673c06ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:52.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.968+0000 7f673be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f673c159ee0 0x7f673c06b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:52.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.968+0000 7f673aa00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f673c159a60 0x7f673c06ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:51748/0 (socket says 172.21.15.55:51748) 2024-04-02T07:26:52.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.968+0000 7f673aa00640 1 -- 172.21.15.55:0/3428109867 learned_addr learned my addr 172.21.15.55:0/3428109867 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:52.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.968+0000 7f673b400640 1 --1- 172.21.15.55:0/3428109867 >> v1:172.21.15.106:6789/0 conn(0x7f673c153ad0 0x7f673c0b3700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:55188/0 (socket says 172.21.15.55:55188) 2024-04-02T07:26:52.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.968+0000 7f673aa00640 1 -- 172.21.15.55:0/3428109867 >> v2:172.21.15.106:3300/0 conn(0x7f673c159ee0 msgr2=0x7f673c06b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:52.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.968+0000 7f673aa00640 1 --2- 172.21.15.55:0/3428109867 >> v2:172.21.15.106:3300/0 conn(0x7f673c159ee0 0x7f673c06b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.968+0000 7f673aa00640 1 -- 172.21.15.55:0/3428109867 >> v1:172.21.15.106:6789/0 conn(0x7f673c153ad0 legacy=0x7f673c0b3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:52.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.968+0000 7f673aa00640 1 -- 172.21.15.55:0/3428109867 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f673c0b2f20 con 0x7f673c159a60 2024-04-02T07:26:52.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.968+0000 7f673a000640 1 -- 172.21.15.55:0/3428109867 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2353158891 0 0) 0x7f673c0b3270 con 0x7f673c153ad0 2024-04-02T07:26:52.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.972+0000 7f673aa00640 1 --2- 172.21.15.55:0/3428109867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f673c159a60 0x7f673c06ada0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6728009870 tx=0x7f672801c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11feefa8285492ac server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:52.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.972+0000 7f673a000640 1 -- 172.21.15.55:0/3428109867 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67280ac620 con 0x7f673c159a60 2024-04-02T07:26:52.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.972+0000 7f673a000640 1 -- 172.21.15.55:0/3428109867 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67280ac780 con 0x7f673c159a60 2024-04-02T07:26:52.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.972+0000 7f673a000640 1 -- 172.21.15.55:0/3428109867 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67280acb10 con 0x7f673c159a60 2024-04-02T07:26:52.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.972+0000 7f6740e00640 1 -- 172.21.15.55:0/3428109867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f673c159a60 msgr2=0x7f673c06ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:52.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.972+0000 7f6740e00640 1 --2- 172.21.15.55:0/3428109867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f673c159a60 0x7f673c06ada0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6728009870 tx=0x7f672801c4d0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.972+0000 7f6740e00640 1 -- 172.21.15.55:0/3428109867 shutdown_connections 2024-04-02T07:26:52.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.972+0000 7f6740e00640 1 --2- 172.21.15.55:0/3428109867 >> v2:172.21.15.106:3300/0 conn(0x7f673c159ee0 0x7f673c06b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.972+0000 7f6740e00640 1 --2- 172.21.15.55:0/3428109867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f673c159a60 0x7f673c06ada0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.972+0000 7f6740e00640 1 -- 172.21.15.55:0/3428109867 >> 172.21.15.55:0/3428109867 conn(0x7f673c0709a0 msgr2=0x7f673c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:52.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.972+0000 7f6740e00640 1 -- 172.21.15.55:0/3428109867 shutdown_connections 2024-04-02T07:26:52.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.972+0000 7f6740e00640 1 -- 172.21.15.55:0/3428109867 wait complete. 2024-04-02T07:26:52.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.972+0000 7f6740e00640 1 Processor -- start 2024-04-02T07:26:52.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.972+0000 7f6740e00640 1 -- start start 2024-04-02T07:26:52.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f6740e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673c153ad0 0x7f673c138f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:52.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f6740e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f673c159a60 0x7f673c1387b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:52.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f6740e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f673c159ee0 0x7f673c0b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:52.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f6740e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c13bec0 con 0x7f673c153ad0 2024-04-02T07:26:52.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f6740e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c138cf0 con 0x7f673c159a60 2024-04-02T07:26:52.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f6740e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f673c13af90 con 0x7f673c159ee0 2024-04-02T07:26:52.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f673b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673c153ad0 0x7f673c138f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:52.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f673b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673c153ad0 0x7f673c138f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36424/0 (socket says 172.21.15.55:36424) 2024-04-02T07:26:52.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f673b400640 1 -- 172.21.15.55:0/1137446776 learned_addr learned my addr 172.21.15.55:0/1137446776 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:52.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f673aa00640 1 --2- 172.21.15.55:0/1137446776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f673c159a60 0x7f673c1387b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:52.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f673be00640 1 --2- 172.21.15.55:0/1137446776 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f673c159ee0 0x7f673c0b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:52.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f673b400640 1 -- 172.21.15.55:0/1137446776 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f673c159ee0 msgr2=0x7f673c0b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:52.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f673b400640 1 --2- 172.21.15.55:0/1137446776 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f673c159ee0 0x7f673c0b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f673b400640 1 -- 172.21.15.55:0/1137446776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f673c159a60 msgr2=0x7f673c1387b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:52.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f673b400640 1 --2- 172.21.15.55:0/1137446776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f673c159a60 0x7f673c1387b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:52.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f673b400640 1 -- 172.21.15.55:0/1137446776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67280094d0 con 0x7f673c153ad0 2024-04-02T07:26:52.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f673aa00640 1 --2- 172.21.15.55:0/1137446776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f673c159a60 0x7f673c1387b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:52.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f673b400640 1 --2- 172.21.15.55:0/1137446776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673c153ad0 0x7f673c138f60 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f672c0011f0 tx=0x7f672c00c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:52.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f6733400640 1 -- 172.21.15.55:0/1137446776 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0074e0 con 0x7f673c153ad0 2024-04-02T07:26:52.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f6733400640 1 -- 172.21.15.55:0/1137446776 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f672c007640 con 0x7f673c153ad0 2024-04-02T07:26:52.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f6733400640 1 -- 172.21.15.55:0/1137446776 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c004a10 con 0x7f673c153ad0 2024-04-02T07:26:52.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f6740e00640 1 -- 172.21.15.55:0/1137446776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f673c13b240 con 0x7f673c153ad0 2024-04-02T07:26:52.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f6740e00640 1 -- 172.21.15.55:0/1137446776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673c13b800 con 0x7f673c153ad0 2024-04-02T07:26:52.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f6740e00640 1 -- 172.21.15.55:0/1137446776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f673c073fa0 con 0x7f673c153ad0 2024-04-02T07:26:52.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.976+0000 7f6733400640 1 -- 172.21.15.55:0/1137446776 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f672c004b70 con 0x7f673c153ad0 2024-04-02T07:26:52.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.980+0000 7f6733400640 1 --2- 172.21.15.55:0/1137446776 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f671c066690 0x7f671c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:52.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.980+0000 7f6733400640 1 -- 172.21.15.55:0/1137446776 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f672c083140 con 0x7f673c153ad0 2024-04-02T07:26:52.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.980+0000 7f673aa00640 1 --2- 172.21.15.55:0/1137446776 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f671c066690 0x7f671c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:52.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.980+0000 7f673aa00640 1 --2- 172.21.15.55:0/1137446776 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f671c066690 0x7f671c068b50 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f67280ae000 tx=0x7f6728008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:52.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:52.984+0000 7f6733400640 1 -- 172.21.15.55:0/1137446776 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f672c0507e0 con 0x7f673c153ad0 2024-04-02T07:26:53.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:53.144+0000 7f6740e00640 1 -- 172.21.15.55:0/1137446776 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f673c0cb350 con 0x7f673c153ad0 2024-04-02T07:26:54.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.100+0000 7f6733400640 1 -- 172.21.15.55:0/1137446776 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v69) v1 ==== 138+0+0 (secure 0 0 0) 0x7f672c0180b0 con 0x7f673c153ad0 2024-04-02T07:26:54.105 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-04-02T07:26:54.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.104+0000 7f6740e00640 1 -- 172.21.15.55:0/1137446776 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f671c066690 msgr2=0x7f671c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:54.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.104+0000 7f6740e00640 1 --2- 172.21.15.55:0/1137446776 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f671c066690 0x7f671c068b50 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f67280ae000 tx=0x7f6728008040 comp rx=0 tx=0).stop 2024-04-02T07:26:54.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.104+0000 7f6740e00640 1 -- 172.21.15.55:0/1137446776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673c153ad0 msgr2=0x7f673c138f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:54.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.104+0000 7f6740e00640 1 --2- 172.21.15.55:0/1137446776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673c153ad0 0x7f673c138f60 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f672c0011f0 tx=0x7f672c00c9b0 comp rx=0 tx=0).stop 2024-04-02T07:26:54.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.104+0000 7f6740e00640 1 -- 172.21.15.55:0/1137446776 shutdown_connections 2024-04-02T07:26:54.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.104+0000 7f6740e00640 1 --2- 172.21.15.55:0/1137446776 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f673c159ee0 0x7f673c0b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:54.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.104+0000 7f6740e00640 1 --2- 172.21.15.55:0/1137446776 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f671c066690 0x7f671c068b50 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:54.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.104+0000 7f6740e00640 1 --2- 172.21.15.55:0/1137446776 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f673c159a60 0x7f673c1387b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:54.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.104+0000 7f6740e00640 1 --2- 172.21.15.55:0/1137446776 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f673c153ad0 0x7f673c138f60 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:54.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.104+0000 7f6740e00640 1 -- 172.21.15.55:0/1137446776 >> 172.21.15.55:0/1137446776 conn(0x7f673c0709a0 msgr2=0x7f673c14fc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:54.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.104+0000 7f6740e00640 1 -- 172.21.15.55:0/1137446776 shutdown_connections 2024-04-02T07:26:54.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.104+0000 7f6740e00640 1 -- 172.21.15.55:0/1137446776 wait complete. 2024-04-02T07:26:54.135 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-02T07:26:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.280+0000 7fad49e00640 1 Processor -- start 2024-04-02T07:26:54.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.280+0000 7fad49e00640 1 -- start start 2024-04-02T07:26:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.284+0000 7fad49e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fad4415a6a0 0x7fad440cba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.284+0000 7fad49e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad440ce090 con 0x7fad4415e9c0 2024-04-02T07:26:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.284+0000 7fad49e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad440ce2e0 con 0x7fad440cbfb0 2024-04-02T07:26:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.284+0000 7fad49e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad440ce5c0 con 0x7fad4415a6a0 2024-04-02T07:26:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.284+0000 7fad49400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fad4415e9c0 0x7fad4415aa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34228/0 (socket says 172.21.15.55:34228) 2024-04-02T07:26:54.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.284+0000 7fad49400640 1 -- 172.21.15.55:0/3679282453 learned_addr learned my addr 172.21.15.55:0/3679282453 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:26:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.284+0000 7fad48a00640 1 --2- 172.21.15.55:0/3679282453 >> v2:172.21.15.106:3300/0 conn(0x7fad4415a6a0 0x7fad440cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.284+0000 7fad43e00640 1 -- 172.21.15.55:0/3679282453 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649355566 0 0) 0x7fad440ce090 con 0x7fad4415e9c0 2024-04-02T07:26:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.284+0000 7fad43e00640 1 -- 172.21.15.55:0/3679282453 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad28003530 con 0x7fad4415e9c0 2024-04-02T07:26:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.284+0000 7fad48a00640 1 -- 172.21.15.55:0/3679282453 >> v1:172.21.15.106:6789/0 conn(0x7fad440cbfb0 legacy=0x7fad4415e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.284+0000 7fad48a00640 1 -- 172.21.15.55:0/3679282453 >> v1:172.21.15.55:6789/0 conn(0x7fad4415e9c0 legacy=0x7fad4415aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:54.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.284+0000 7fad48a00640 1 -- 172.21.15.55:0/3679282453 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad440ce8a0 con 0x7fad4415a6a0 2024-04-02T07:26:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.288+0000 7fad48a00640 1 --2- 172.21.15.55:0/3679282453 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad4415a6a0 0x7fad440cba70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fad340097c0 tx=0x7fad3401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6cfe34d596863e42 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.288+0000 7fad43e00640 1 -- 172.21.15.55:0/3679282453 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad340a8050 con 0x7fad4415a6a0 2024-04-02T07:26:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.288+0000 7fad43e00640 1 -- 172.21.15.55:0/3679282453 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad340ac5f0 con 0x7fad4415a6a0 2024-04-02T07:26:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.288+0000 7fad43e00640 1 -- 172.21.15.55:0/3679282453 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad340ac980 con 0x7fad4415a6a0 2024-04-02T07:26:54.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.288+0000 7fad49e00640 1 -- 172.21.15.55:0/3679282453 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad4415a6a0 msgr2=0x7fad440cba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:54.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.288+0000 7fad49e00640 1 --2- 172.21.15.55:0/3679282453 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad4415a6a0 0x7fad440cba70 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fad340097c0 tx=0x7fad3401c4a0 comp rx=0 tx=0).stop 2024-04-02T07:26:54.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.288+0000 7fad49e00640 1 -- 172.21.15.55:0/3679282453 shutdown_connections 2024-04-02T07:26:54.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.288+0000 7fad49e00640 1 --2- 172.21.15.55:0/3679282453 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad4415a6a0 0x7fad440cba70 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:54.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.288+0000 7fad49e00640 1 -- 172.21.15.55:0/3679282453 >> 172.21.15.55:0/3679282453 conn(0x7fad440b1fb0 msgr2=0x7fad440b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:54.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.288+0000 7fad49e00640 1 -- 172.21.15.55:0/3679282453 shutdown_connections 2024-04-02T07:26:54.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.288+0000 7fad49e00640 1 -- 172.21.15.55:0/3679282453 wait complete. 2024-04-02T07:26:54.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.288+0000 7fad49e00640 1 Processor -- start 2024-04-02T07:26:54.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.288+0000 7fad49e00640 1 -- start start 2024-04-02T07:26:54.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad49e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad440cbfb0 0x7fad440c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:54.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad49e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fad4415a6a0 0x7fad44157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:54.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad49e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad4415e9c0 0x7fad440b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:54.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad49e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad440b3ef0 con 0x7fad440cbfb0 2024-04-02T07:26:54.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad49e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad440c81e0 con 0x7fad4415e9c0 2024-04-02T07:26:54.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad49e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad440c84c0 con 0x7fad4415a6a0 2024-04-02T07:26:54.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad48a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad440cbfb0 0x7fad440c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:54.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad48a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad440cbfb0 0x7fad440c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36428/0 (socket says 172.21.15.55:36428) 2024-04-02T07:26:54.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad48a00640 1 -- 172.21.15.55:0/72882710 learned_addr learned my addr 172.21.15.55:0/72882710 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:54.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad3be00640 1 --2- 172.21.15.55:0/72882710 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fad4415a6a0 0x7fad44157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:54.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad49400640 1 --2- 172.21.15.55:0/72882710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad4415e9c0 0x7fad440b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:54.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad48a00640 1 -- 172.21.15.55:0/72882710 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fad4415a6a0 msgr2=0x7fad44157310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:54.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad48a00640 1 --2- 172.21.15.55:0/72882710 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fad4415a6a0 0x7fad44157310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:54.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad48a00640 1 -- 172.21.15.55:0/72882710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad4415e9c0 msgr2=0x7fad440b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:54.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad48a00640 1 --2- 172.21.15.55:0/72882710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad4415e9c0 0x7fad440b30e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:54.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad48a00640 1 -- 172.21.15.55:0/72882710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad34009420 con 0x7fad440cbfb0 2024-04-02T07:26:54.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad48a00640 1 --2- 172.21.15.55:0/72882710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad440cbfb0 0x7fad440c9280 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fad3401a0d0 tx=0x7fad34019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:54.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad41600640 1 -- 172.21.15.55:0/72882710 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad34006e20 con 0x7fad440cbfb0 2024-04-02T07:26:54.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad41600640 1 -- 172.21.15.55:0/72882710 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad340b5620 con 0x7fad440cbfb0 2024-04-02T07:26:54.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad41600640 1 -- 172.21.15.55:0/72882710 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad340b59b0 con 0x7fad440cbfb0 2024-04-02T07:26:54.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad49e00640 1 -- 172.21.15.55:0/72882710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad440c87a0 con 0x7fad440cbfb0 2024-04-02T07:26:54.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad49e00640 1 -- 172.21.15.55:0/72882710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad440c8d60 con 0x7fad440cbfb0 2024-04-02T07:26:54.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad49e00640 1 -- 172.21.15.55:0/72882710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad44073670 con 0x7fad440cbfb0 2024-04-02T07:26:54.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.292+0000 7fad41600640 1 -- 172.21.15.55:0/72882710 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fad340b3040 con 0x7fad440cbfb0 2024-04-02T07:26:54.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.296+0000 7fad41600640 1 --2- 172.21.15.55:0/72882710 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fad20066690 0x7fad20068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:54.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.296+0000 7fad41600640 1 -- 172.21.15.55:0/72882710 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fad3411db40 con 0x7fad440cbfb0 2024-04-02T07:26:54.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.296+0000 7fad3be00640 1 --2- 172.21.15.55:0/72882710 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fad20066690 0x7fad20068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:54.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.296+0000 7fad3be00640 1 --2- 172.21.15.55:0/72882710 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fad20066690 0x7fad20068b50 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fad440b64a0 tx=0x7fad2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:54.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.300+0000 7fad41600640 1 -- 172.21.15.55:0/72882710 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fad44073670 con 0x7fad440cbfb0 2024-04-02T07:26:54.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:54.464+0000 7fad49e00640 1 -- 172.21.15.55:0/72882710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fad44073670 con 0x7fad440cbfb0 2024-04-02T07:26:55.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.108+0000 7fad41600640 1 -- 172.21.15.55:0/72882710 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v70) v1 ==== 170+0+0 (secure 0 0 0) 0x7fad44073670 con 0x7fad440cbfb0 2024-04-02T07:26:55.116 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-04-02T07:26:55.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.120+0000 7fad49e00640 1 -- 172.21.15.55:0/72882710 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fad20066690 msgr2=0x7fad20068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:55.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.120+0000 7fad49e00640 1 --2- 172.21.15.55:0/72882710 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fad20066690 0x7fad20068b50 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fad440b64a0 tx=0x7fad2c009040 comp rx=0 tx=0).stop 2024-04-02T07:26:55.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.120+0000 7fad49e00640 1 -- 172.21.15.55:0/72882710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad440cbfb0 msgr2=0x7fad440c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:55.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.120+0000 7fad49e00640 1 --2- 172.21.15.55:0/72882710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad440cbfb0 0x7fad440c9280 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fad3401a0d0 tx=0x7fad34019240 comp rx=0 tx=0).stop 2024-04-02T07:26:55.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.120+0000 7fad49e00640 1 -- 172.21.15.55:0/72882710 shutdown_connections 2024-04-02T07:26:55.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.120+0000 7fad49e00640 1 --2- 172.21.15.55:0/72882710 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fad20066690 0x7fad20068b50 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.120+0000 7fad49e00640 1 --2- 172.21.15.55:0/72882710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fad4415e9c0 0x7fad440b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.120+0000 7fad49e00640 1 --2- 172.21.15.55:0/72882710 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fad4415a6a0 0x7fad44157310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.120+0000 7fad49e00640 1 --2- 172.21.15.55:0/72882710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fad440cbfb0 0x7fad440c9280 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.120+0000 7fad49e00640 1 -- 172.21.15.55:0/72882710 >> 172.21.15.55:0/72882710 conn(0x7fad440b1fb0 msgr2=0x7fad4406c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:55.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.120+0000 7fad49e00640 1 -- 172.21.15.55:0/72882710 shutdown_connections 2024-04-02T07:26:55.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.120+0000 7fad49e00640 1 -- 172.21.15.55:0/72882710 wait complete. 2024-04-02T07:26:55.156 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-02T07:26:55.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.296+0000 7f5106400640 1 Processor -- start 2024-04-02T07:26:55.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.296+0000 7f5106400640 1 -- start start 2024-04-02T07:26:55.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.300+0000 7f5106400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51000b3dc0 0x7f51000ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:55.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.300+0000 7f5106400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51000ade90 0x7f510006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:55.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.300+0000 7f5106400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f51000b41a0 0x7f5100142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:55.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.300+0000 7f5106400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510006c630 con 0x7f51000b3dc0 2024-04-02T07:26:55.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.300+0000 7f5106400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f510006c8f0 con 0x7f51000b41a0 2024-04-02T07:26:55.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.300+0000 7f5106400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510006cbd0 con 0x7f51000ade90 2024-04-02T07:26:55.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.300+0000 7f50ff400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51000b3dc0 0x7f51000ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:55.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.300+0000 7f50ff400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f51000b3dc0 0x7f51000ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36430/0 (socket says 172.21.15.55:36430) 2024-04-02T07:26:55.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.300+0000 7f50ff400640 1 -- 172.21.15.55:0/11628163 learned_addr learned my addr 172.21.15.55:0/11628163 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:55.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.300+0000 7f50ffe00640 1 --2- 172.21.15.55:0/11628163 >> v2:172.21.15.106:3300/0 conn(0x7f51000b41a0 0x7f5100142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:55.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.300+0000 7f50f7e00640 1 --2- 172.21.15.55:0/11628163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51000ade90 0x7f510006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:55.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.300+0000 7f50ff400640 1 -- 172.21.15.55:0/11628163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51000ade90 msgr2=0x7f510006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:55.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.300+0000 7f50ff400640 1 --2- 172.21.15.55:0/11628163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51000ade90 0x7f510006d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.300+0000 7f50ff400640 1 -- 172.21.15.55:0/11628163 >> v2:172.21.15.106:3300/0 conn(0x7f51000b41a0 msgr2=0x7f5100142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:55.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.300+0000 7f50ff400640 1 --2- 172.21.15.55:0/11628163 >> v2:172.21.15.106:3300/0 conn(0x7f51000b41a0 0x7f5100142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.300+0000 7f50ff400640 1 -- 172.21.15.55:0/11628163 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f510006ceb0 con 0x7f51000b3dc0 2024-04-02T07:26:55.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.304+0000 7f50ff400640 1 --2- 172.21.15.55:0/11628163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51000b3dc0 0x7f51000ca770 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f51000b11e0 tx=0x7f50f001e670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a929111ce9a9286 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:55.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.304+0000 7f50fea00640 1 -- 172.21.15.55:0/11628163 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00ab610 con 0x7f51000b3dc0 2024-04-02T07:26:55.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.304+0000 7f50fea00640 1 -- 172.21.15.55:0/11628163 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f00ab770 con 0x7f51000b3dc0 2024-04-02T07:26:55.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.304+0000 7f50fea00640 1 -- 172.21.15.55:0/11628163 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f00abb00 con 0x7f51000b3dc0 2024-04-02T07:26:55.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.304+0000 7f5106400640 1 -- 172.21.15.55:0/11628163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51000b3dc0 msgr2=0x7f51000ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:55.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.304+0000 7f5106400640 1 --2- 172.21.15.55:0/11628163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51000b3dc0 0x7f51000ca770 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f51000b11e0 tx=0x7f50f001e670 comp rx=0 tx=0).stop 2024-04-02T07:26:55.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.304+0000 7f5106400640 1 -- 172.21.15.55:0/11628163 shutdown_connections 2024-04-02T07:26:55.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.304+0000 7f5106400640 1 --2- 172.21.15.55:0/11628163 >> v2:172.21.15.106:3300/0 conn(0x7f51000b41a0 0x7f5100142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.304+0000 7f5106400640 1 --2- 172.21.15.55:0/11628163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51000ade90 0x7f510006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.304+0000 7f5106400640 1 --2- 172.21.15.55:0/11628163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51000b3dc0 0x7f51000ca770 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.304+0000 7f5106400640 1 -- 172.21.15.55:0/11628163 >> 172.21.15.55:0/11628163 conn(0x7f510006a390 msgr2=0x7f51000b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:55.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.304+0000 7f5106400640 1 -- 172.21.15.55:0/11628163 shutdown_connections 2024-04-02T07:26:55.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.304+0000 7f5106400640 1 -- 172.21.15.55:0/11628163 wait complete. 2024-04-02T07:26:55.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.304+0000 7f5106400640 1 Processor -- start 2024-04-02T07:26:55.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.304+0000 7f5106400640 1 -- start start 2024-04-02T07:26:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f5106400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51000ade90 0x7f5100138c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f5106400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51000b3dc0 0x7f51000b0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f5106400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51000b41a0 0x7f51000b0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f5106400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51001374a0 con 0x7f51000b41a0 2024-04-02T07:26:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f5106400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51001532a0 con 0x7f51000ade90 2024-04-02T07:26:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f5106400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5100153580 con 0x7f51000b3dc0 2024-04-02T07:26:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f50ffe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51000b41a0 0x7f51000b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f50ff400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51000ade90 0x7f5100138c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f50ffe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51000b41a0 0x7f51000b0650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36446/0 (socket says 172.21.15.55:36446) 2024-04-02T07:26:55.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f50ffe00640 1 -- 172.21.15.55:0/3906159120 learned_addr learned my addr 172.21.15.55:0/3906159120 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:55.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f50ff400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51000ade90 0x7f5100138c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:59090/0 (socket says 172.21.15.55:59090) 2024-04-02T07:26:55.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f50f7e00640 1 --2- 172.21.15.55:0/3906159120 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51000b3dc0 0x7f51000b0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:55.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f50ffe00640 1 -- 172.21.15.55:0/3906159120 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51000b3dc0 msgr2=0x7f51000b0110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:55.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f50ffe00640 1 --2- 172.21.15.55:0/3906159120 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51000b3dc0 0x7f51000b0110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f50ffe00640 1 -- 172.21.15.55:0/3906159120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51000ade90 msgr2=0x7f5100138c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:55.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f50ffe00640 1 --2- 172.21.15.55:0/3906159120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51000ade90 0x7f5100138c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f50ffe00640 1 -- 172.21.15.55:0/3906159120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f00094d0 con 0x7f51000b41a0 2024-04-02T07:26:55.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f50ff400640 1 --2- 172.21.15.55:0/3906159120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51000ade90 0x7f5100138c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:26:55.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f50ffe00640 1 --2- 172.21.15.55:0/3906159120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51000b41a0 0x7f51000b0650 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f50f8007e60 tx=0x7f50f800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:55.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f50f7400640 1 -- 172.21.15.55:0/3906159120 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8014420 con 0x7f51000b41a0 2024-04-02T07:26:55.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f50f7400640 1 -- 172.21.15.55:0/3906159120 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50f80145a0 con 0x7f51000b41a0 2024-04-02T07:26:55.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f50f7400640 1 -- 172.21.15.55:0/3906159120 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50f8014950 con 0x7f51000b41a0 2024-04-02T07:26:55.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f5106400640 1 -- 172.21.15.55:0/3906159120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f510006de00 con 0x7f51000b41a0 2024-04-02T07:26:55.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f5106400640 1 -- 172.21.15.55:0/3906159120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5100153b40 con 0x7f51000b41a0 2024-04-02T07:26:55.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f5106400640 1 -- 172.21.15.55:0/3906159120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5100073530 con 0x7f51000b41a0 2024-04-02T07:26:55.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.308+0000 7f50f7400640 1 -- 172.21.15.55:0/3906159120 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f50f8014ab0 con 0x7f51000b41a0 2024-04-02T07:26:55.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.312+0000 7f50f7400640 1 --2- 172.21.15.55:0/3906159120 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f50dc066690 0x7f50dc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:55.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.312+0000 7f50f7400640 1 -- 172.21.15.55:0/3906159120 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f50f8085800 con 0x7f51000b41a0 2024-04-02T07:26:55.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.312+0000 7f50ff400640 1 --2- 172.21.15.55:0/3906159120 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f50dc066690 0x7f50dc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:55.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.312+0000 7f50ff400640 1 --2- 172.21.15.55:0/3906159120 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f50dc066690 0x7f50dc068b50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f50f00b0000 tx=0x7f50f00b9040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:55.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.316+0000 7f50f7400640 1 -- 172.21.15.55:0/3906159120 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f50f8052c60 con 0x7f51000b41a0 2024-04-02T07:26:55.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.520+0000 7f5106400640 1 -- 172.21.15.55:0/3906159120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f5100066c90 con 0x7f51000b41a0 2024-04-02T07:26:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.532+0000 7f50f7400640 1 -- 172.21.15.55:0/3906159120 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v40) v1 ==== 174+0+0 (secure 0 0 0) 0x7f50f8056280 con 0x7f51000b41a0 2024-04-02T07:26:55.539 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 10 and data pool 11 2024-04-02T07:26:55.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.540+0000 7f5106400640 1 -- 172.21.15.55:0/3906159120 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f50dc066690 msgr2=0x7f50dc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:55.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.540+0000 7f5106400640 1 --2- 172.21.15.55:0/3906159120 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f50dc066690 0x7f50dc068b50 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f50f00b0000 tx=0x7f50f00b9040 comp rx=0 tx=0).stop 2024-04-02T07:26:55.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.540+0000 7f5106400640 1 -- 172.21.15.55:0/3906159120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51000b41a0 msgr2=0x7f51000b0650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:55.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.540+0000 7f5106400640 1 --2- 172.21.15.55:0/3906159120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51000b41a0 0x7f51000b0650 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f50f8007e60 tx=0x7f50f800e4b0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.544+0000 7f5106400640 1 -- 172.21.15.55:0/3906159120 shutdown_connections 2024-04-02T07:26:55.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.544+0000 7f5106400640 1 --2- 172.21.15.55:0/3906159120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f51000b41a0 0x7f51000b0650 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.544+0000 7f5106400640 1 --2- 172.21.15.55:0/3906159120 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f51000b3dc0 0x7f51000b0110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.544+0000 7f5106400640 1 --2- 172.21.15.55:0/3906159120 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f50dc066690 0x7f50dc068b50 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.544+0000 7f5106400640 1 --2- 172.21.15.55:0/3906159120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f51000ade90 0x7f5100138c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.544+0000 7f5106400640 1 -- 172.21.15.55:0/3906159120 >> 172.21.15.55:0/3906159120 conn(0x7f510006a390 msgr2=0x7f51000aefd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:55.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.544+0000 7f5106400640 1 -- 172.21.15.55:0/3906159120 shutdown_connections 2024-04-02T07:26:55.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.544+0000 7f5106400640 1 -- 172.21.15.55:0/3906159120 wait complete. 2024-04-02T07:26:55.579 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:26:55.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.712+0000 7feb49600640 1 Processor -- start 2024-04-02T07:26:55.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.712+0000 7feb49600640 1 -- start start 2024-04-02T07:26:55.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.716+0000 7feb49600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb44153ea0 0x7feb440c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:55.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.716+0000 7feb49600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feb4415a040 0x7feb4413d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:55.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.716+0000 7feb49600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4413d0c0 con 0x7feb44159be0 2024-04-02T07:26:55.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.716+0000 7feb49600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb4415a4f0 con 0x7feb4415a040 2024-04-02T07:26:55.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.716+0000 7feb49600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4415a7d0 con 0x7feb44153ea0 2024-04-02T07:26:55.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.716+0000 7feb3a000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feb44159be0 0x7feb440b31b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35766/0 (socket says 172.21.15.55:35766) 2024-04-02T07:26:55.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.716+0000 7feb3a000640 1 -- 172.21.15.55:0/1695613223 learned_addr learned my addr 172.21.15.55:0/1695613223 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:26:55.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.716+0000 7feb42a00640 1 --2- 172.21.15.55:0/1695613223 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb44153ea0 0x7feb440c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:55.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.716+0000 7feb43400640 1 --2- 172.21.15.55:0/1695613223 >> v2:172.21.15.106:3300/0 conn(0x7feb4415a040 0x7feb4413d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:55.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.716+0000 7feb42000640 1 -- 172.21.15.55:0/1695613223 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 74138166 0 0) 0x7feb4413d0c0 con 0x7feb44159be0 2024-04-02T07:26:55.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.716+0000 7feb42000640 1 -- 172.21.15.55:0/1695613223 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb28003530 con 0x7feb44159be0 2024-04-02T07:26:55.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.716+0000 7feb42a00640 1 -- 172.21.15.55:0/1695613223 >> v2:172.21.15.106:3300/0 conn(0x7feb4415a040 msgr2=0x7feb4413d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:55.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.716+0000 7feb42a00640 1 --2- 172.21.15.55:0/1695613223 >> v2:172.21.15.106:3300/0 conn(0x7feb4415a040 0x7feb4413d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.716+0000 7feb42a00640 1 -- 172.21.15.55:0/1695613223 >> v1:172.21.15.55:6789/0 conn(0x7feb44159be0 legacy=0x7feb440b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:55.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.716+0000 7feb42a00640 1 -- 172.21.15.55:0/1695613223 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4415aab0 con 0x7feb44153ea0 2024-04-02T07:26:55.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.716+0000 7feb43400640 1 --2- 172.21.15.55:0/1695613223 >> v2:172.21.15.106:3300/0 conn(0x7feb4415a040 0x7feb4413d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:26:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.720+0000 7feb42a00640 1 --2- 172.21.15.55:0/1695613223 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb44153ea0 0x7feb440c4120 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feb340097c0 tx=0x7feb3401e6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a19c43f02df22656 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.720+0000 7feb42000640 1 -- 172.21.15.55:0/1695613223 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb340a86a0 con 0x7feb44153ea0 2024-04-02T07:26:55.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.720+0000 7feb42000640 1 -- 172.21.15.55:0/1695613223 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb340a8800 con 0x7feb44153ea0 2024-04-02T07:26:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.720+0000 7feb42000640 1 -- 172.21.15.55:0/1695613223 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb340a8b70 con 0x7feb44153ea0 2024-04-02T07:26:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.720+0000 7feb49600640 1 -- 172.21.15.55:0/1695613223 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb44153ea0 msgr2=0x7feb440c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.720+0000 7feb49600640 1 --2- 172.21.15.55:0/1695613223 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb44153ea0 0x7feb440c4120 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7feb340097c0 tx=0x7feb3401e6b0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.720+0000 7feb49600640 1 -- 172.21.15.55:0/1695613223 shutdown_connections 2024-04-02T07:26:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.720+0000 7feb49600640 1 --2- 172.21.15.55:0/1695613223 >> v2:172.21.15.106:3300/0 conn(0x7feb4415a040 0x7feb4413d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.720+0000 7feb49600640 1 --2- 172.21.15.55:0/1695613223 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb44153ea0 0x7feb440c4120 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.720+0000 7feb49600640 1 -- 172.21.15.55:0/1695613223 >> 172.21.15.55:0/1695613223 conn(0x7feb44066080 msgr2=0x7feb44069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:55.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.720+0000 7feb49600640 1 -- 172.21.15.55:0/1695613223 shutdown_connections 2024-04-02T07:26:55.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.720+0000 7feb49600640 1 -- 172.21.15.55:0/1695613223 wait complete. 2024-04-02T07:26:55.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.720+0000 7feb49600640 1 Processor -- start 2024-04-02T07:26:55.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.720+0000 7feb49600640 1 -- start start 2024-04-02T07:26:55.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb49600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb44153ea0 0x7feb44138040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:55.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb49600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb44159be0 0x7feb44138ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:55.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb49600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb4415a040 0x7feb440c7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:55.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb49600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb440c6000 con 0x7feb44153ea0 2024-04-02T07:26:55.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb49600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb440c89c0 con 0x7feb44159be0 2024-04-02T07:26:55.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb49600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb440c59d0 con 0x7feb4415a040 2024-04-02T07:26:55.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb42a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb44153ea0 0x7feb44138040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:55.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb42a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb44153ea0 0x7feb44138040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41640/0 (socket says 172.21.15.55:41640) 2024-04-02T07:26:55.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb42a00640 1 -- 172.21.15.55:0/2420258115 learned_addr learned my addr 172.21.15.55:0/2420258115 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:55.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb43400640 1 --2- 172.21.15.55:0/2420258115 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb4415a040 0x7feb440c7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:55.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb3a000640 1 --2- 172.21.15.55:0/2420258115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb44159be0 0x7feb44138ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:55.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb42a00640 1 -- 172.21.15.55:0/2420258115 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb4415a040 msgr2=0x7feb440c7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:55.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb42a00640 1 --2- 172.21.15.55:0/2420258115 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb4415a040 0x7feb440c7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb42a00640 1 -- 172.21.15.55:0/2420258115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb44159be0 msgr2=0x7feb44138ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:55.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb42a00640 1 --2- 172.21.15.55:0/2420258115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb44159be0 0x7feb44138ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb42a00640 1 -- 172.21.15.55:0/2420258115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb3c009a70 con 0x7feb44153ea0 2024-04-02T07:26:55.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb42a00640 1 --2- 172.21.15.55:0/2420258115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb44153ea0 0x7feb44138040 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7feb34000c10 tx=0x7feb3401b450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:55.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb3b400640 1 -- 172.21.15.55:0/2420258115 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb340a86a0 con 0x7feb44153ea0 2024-04-02T07:26:55.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb3b400640 1 -- 172.21.15.55:0/2420258115 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb340a8970 con 0x7feb44153ea0 2024-04-02T07:26:55.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb49600640 1 -- 172.21.15.55:0/2420258115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb34009420 con 0x7feb44153ea0 2024-04-02T07:26:55.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb3b400640 1 -- 172.21.15.55:0/2420258115 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb340a8d00 con 0x7feb44153ea0 2024-04-02T07:26:55.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb49600640 1 -- 172.21.15.55:0/2420258115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb440c8400 con 0x7feb44153ea0 2024-04-02T07:26:55.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.724+0000 7feb49600640 1 -- 172.21.15.55:0/2420258115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb440c6140 con 0x7feb44153ea0 2024-04-02T07:26:55.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.728+0000 7feb3b400640 1 -- 172.21.15.55:0/2420258115 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7feb34003620 con 0x7feb44153ea0 2024-04-02T07:26:55.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.728+0000 7feb3b400640 1 --2- 172.21.15.55:0/2420258115 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feb20066690 0x7feb20068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:55.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.728+0000 7feb3b400640 1 -- 172.21.15.55:0/2420258115 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb3411e460 con 0x7feb44153ea0 2024-04-02T07:26:55.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.728+0000 7feb3a000640 1 --2- 172.21.15.55:0/2420258115 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feb20066690 0x7feb20068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:55.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.728+0000 7feb3a000640 1 --2- 172.21.15.55:0/2420258115 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feb20066690 0x7feb20068b50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7feb4413ca60 tx=0x7feb2c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:55.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.732+0000 7feb3b400640 1 -- 172.21.15.55:0/2420258115 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7feb440c6140 con 0x7feb44153ea0 2024-04-02T07:26:55.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.896+0000 7feb49600640 1 -- 172.21.15.55:0/2420258115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feb440c6140 con 0x7feb44153ea0 2024-04-02T07:26:55.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.896+0000 7feb3b400640 1 -- 172.21.15.55:0/2420258115 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16113 (secure 0 0 0) 0x7feb440c6140 con 0x7feb44153ea0 2024-04-02T07:26:55.902 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:55.903 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":71,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:26:55.524880+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:26:53.196912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-02T07:26:54.514963+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:26:55.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.900+0000 7feb49600640 1 -- 172.21.15.55:0/2420258115 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feb20066690 msgr2=0x7feb20068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:55.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.900+0000 7feb49600640 1 --2- 172.21.15.55:0/2420258115 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feb20066690 0x7feb20068b50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7feb4413ca60 tx=0x7feb2c009040 comp rx=0 tx=0).stop 2024-04-02T07:26:55.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.900+0000 7feb49600640 1 -- 172.21.15.55:0/2420258115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb44153ea0 msgr2=0x7feb44138040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:55.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.900+0000 7feb49600640 1 --2- 172.21.15.55:0/2420258115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb44153ea0 0x7feb44138040 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7feb34000c10 tx=0x7feb3401b450 comp rx=0 tx=0).stop 2024-04-02T07:26:55.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.900+0000 7feb49600640 1 -- 172.21.15.55:0/2420258115 shutdown_connections 2024-04-02T07:26:55.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.900+0000 7feb49600640 1 --2- 172.21.15.55:0/2420258115 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb4415a040 0x7feb440c7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.900+0000 7feb49600640 1 --2- 172.21.15.55:0/2420258115 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feb20066690 0x7feb20068b50 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.900+0000 7feb49600640 1 --2- 172.21.15.55:0/2420258115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb44159be0 0x7feb44138ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.900+0000 7feb49600640 1 --2- 172.21.15.55:0/2420258115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb44153ea0 0x7feb44138040 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:55.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.900+0000 7feb49600640 1 -- 172.21.15.55:0/2420258115 >> 172.21.15.55:0/2420258115 conn(0x7feb44066080 msgr2=0x7feb44071100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:55.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.900+0000 7feb49600640 1 -- 172.21.15.55:0/2420258115 shutdown_connections 2024-04-02T07:26:55.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:55.900+0000 7feb49600640 1 -- 172.21.15.55:0/2420258115 wait complete. 2024-04-02T07:26:55.923 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:26:56.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.056+0000 7f85e4200640 1 Processor -- start 2024-04-02T07:26:56.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.056+0000 7f85e4200640 1 -- start start 2024-04-02T07:26:56.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.060+0000 7f85e4200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85dc143f90 0x7f85dc15ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:56.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.060+0000 7f85e4200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f85dc0cda80 0x7f85dc0c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:56.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.060+0000 7f85e4200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85dc15b270 con 0x7f85dc0b34f0 2024-04-02T07:26:56.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.060+0000 7f85e4200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85dc144370 con 0x7f85dc0cda80 2024-04-02T07:26:56.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.060+0000 7f85e4200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc0c37b0 con 0x7f85dc143f90 2024-04-02T07:26:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.060+0000 7f85e1800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85dc143f90 0x7f85dc15ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.060+0000 7f85e2200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f85dc0cda80 0x7f85dc0c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.060+0000 7f85e2200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f85dc0cda80 0x7f85dc0c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:44648/0 (socket says 172.21.15.55:44648) 2024-04-02T07:26:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.060+0000 7f85e2200640 1 -- 172.21.15.55:0/1746564132 learned_addr learned my addr 172.21.15.55:0/1746564132 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.060+0000 7f85e0e00640 1 --1- 172.21.15.55:0/1746564132 >> v1:172.21.15.106:6789/0 conn(0x7f85dc0b34f0 0x7f85dc0cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:52956/0 (socket says 172.21.15.55:52956) 2024-04-02T07:26:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.060+0000 7f85e1800640 1 -- 172.21.15.55:0/1746564132 >> v2:172.21.15.106:3300/0 conn(0x7f85dc0cda80 msgr2=0x7f85dc0c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.060+0000 7f85e1800640 1 --2- 172.21.15.55:0/1746564132 >> v2:172.21.15.106:3300/0 conn(0x7f85dc0cda80 0x7f85dc0c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.060+0000 7f85e1800640 1 -- 172.21.15.55:0/1746564132 >> v1:172.21.15.106:6789/0 conn(0x7f85dc0b34f0 legacy=0x7f85dc0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.060+0000 7f85e1800640 1 -- 172.21.15.55:0/1746564132 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85dc0c3a90 con 0x7f85dc143f90 2024-04-02T07:26:56.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.060+0000 7f85dbe00640 1 -- 172.21.15.55:0/1746564132 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4289057548 0 0) 0x7f85dc15b270 con 0x7f85dc0b34f0 2024-04-02T07:26:56.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85e1800640 1 --2- 172.21.15.55:0/1746564132 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85dc143f90 0x7f85dc15ad30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f85d00097c0 tx=0x7f85d001c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f15e216770516823 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:56.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85dbe00640 1 -- 172.21.15.55:0/1746564132 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d00ac640 con 0x7f85dc143f90 2024-04-02T07:26:56.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85dbe00640 1 -- 172.21.15.55:0/1746564132 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d00ac7a0 con 0x7f85dc143f90 2024-04-02T07:26:56.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85dbe00640 1 -- 172.21.15.55:0/1746564132 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d00acb30 con 0x7f85dc143f90 2024-04-02T07:26:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85e4200640 1 -- 172.21.15.55:0/1746564132 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85dc143f90 msgr2=0x7f85dc15ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85e4200640 1 --2- 172.21.15.55:0/1746564132 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85dc143f90 0x7f85dc15ad30 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f85d00097c0 tx=0x7f85d001c3e0 comp rx=0 tx=0).stop 2024-04-02T07:26:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85e4200640 1 -- 172.21.15.55:0/1746564132 shutdown_connections 2024-04-02T07:26:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85e4200640 1 --2- 172.21.15.55:0/1746564132 >> v2:172.21.15.106:3300/0 conn(0x7f85dc0cda80 0x7f85dc0c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85e4200640 1 --2- 172.21.15.55:0/1746564132 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85dc143f90 0x7f85dc15ad30 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85e4200640 1 -- 172.21.15.55:0/1746564132 >> 172.21.15.55:0/1746564132 conn(0x7f85dc066080 msgr2=0x7f85dc069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85e4200640 1 -- 172.21.15.55:0/1746564132 shutdown_connections 2024-04-02T07:26:56.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85e4200640 1 -- 172.21.15.55:0/1746564132 wait complete. 2024-04-02T07:26:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85e4200640 1 Processor -- start 2024-04-02T07:26:56.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85e4200640 1 -- start start 2024-04-02T07:26:56.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85e4200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85dc0b34f0 0x7f85dc139ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:56.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85e4200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85dc0cda80 0x7f85dc0cb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:56.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85e4200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85dc143f90 0x7f85dc0c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:56.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85e4200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc0cc830 con 0x7f85dc0b34f0 2024-04-02T07:26:56.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85e4200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc0ccc50 con 0x7f85dc0cda80 2024-04-02T07:26:56.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85e4200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85dc0cbbb0 con 0x7f85dc143f90 2024-04-02T07:26:56.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.064+0000 7f85e1800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85dc0b34f0 0x7f85dc139ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:56.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.068+0000 7f85e1800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85dc0b34f0 0x7f85dc139ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41642/0 (socket says 172.21.15.55:41642) 2024-04-02T07:26:56.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.068+0000 7f85e1800640 1 -- 172.21.15.55:0/392856148 learned_addr learned my addr 172.21.15.55:0/392856148 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:56.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.068+0000 7f85e2200640 1 --2- 172.21.15.55:0/392856148 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85dc143f90 0x7f85dc0c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:56.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.068+0000 7f85e0e00640 1 --2- 172.21.15.55:0/392856148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85dc0cda80 0x7f85dc0cb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:56.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.068+0000 7f85e1800640 1 -- 172.21.15.55:0/392856148 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85dc143f90 msgr2=0x7f85dc0c8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:56.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.068+0000 7f85e1800640 1 --2- 172.21.15.55:0/392856148 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85dc143f90 0x7f85dc0c8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:56.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.068+0000 7f85e1800640 1 -- 172.21.15.55:0/392856148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85dc0cda80 msgr2=0x7f85dc0cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:56.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.068+0000 7f85e1800640 1 --2- 172.21.15.55:0/392856148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85dc0cda80 0x7f85dc0cb160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:56.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.068+0000 7f85e1800640 1 -- 172.21.15.55:0/392856148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d0009420 con 0x7f85dc0b34f0 2024-04-02T07:26:56.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.068+0000 7f85e1800640 1 --2- 172.21.15.55:0/392856148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85dc0b34f0 0x7f85dc139ef0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f85d001a010 tx=0x7f85d0019180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:56.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.068+0000 7f85d9600640 1 -- 172.21.15.55:0/392856148 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d00b6670 con 0x7f85dc0b34f0 2024-04-02T07:26:56.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.068+0000 7f85d9600640 1 -- 172.21.15.55:0/392856148 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85d00b67f0 con 0x7f85dc0b34f0 2024-04-02T07:26:56.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.068+0000 7f85d9600640 1 -- 172.21.15.55:0/392856148 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85d00b6ba0 con 0x7f85dc0b34f0 2024-04-02T07:26:56.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.068+0000 7f85e4200640 1 -- 172.21.15.55:0/392856148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85dc0cbe90 con 0x7f85dc0b34f0 2024-04-02T07:26:56.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.068+0000 7f85e4200640 1 -- 172.21.15.55:0/392856148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85dc0cc450 con 0x7f85dc0b34f0 2024-04-02T07:26:56.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.068+0000 7f85e4200640 1 -- 172.21.15.55:0/392856148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85dc066c90 con 0x7f85dc0b34f0 2024-04-02T07:26:56.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.068+0000 7f85d9600640 1 -- 172.21.15.55:0/392856148 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f85d00b3040 con 0x7f85dc0b34f0 2024-04-02T07:26:56.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.068+0000 7f85d9600640 1 --2- 172.21.15.55:0/392856148 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f85bc066690 0x7f85bc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:56.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.068+0000 7f85d9600640 1 -- 172.21.15.55:0/392856148 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85dc0c55a0 con 0x7f85dc0b34f0 2024-04-02T07:26:56.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.072+0000 7f85e0e00640 1 --2- 172.21.15.55:0/392856148 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f85bc066690 0x7f85bc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:56.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.072+0000 7f85e0e00640 1 --2- 172.21.15.55:0/392856148 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f85bc066690 0x7f85bc068b50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0b3220 tx=0x7f85c8007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:56.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.072+0000 7f85d9600640 1 -- 172.21.15.55:0/392856148 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f85d00ebc40 con 0x7f85dc0b34f0 2024-04-02T07:26:56.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.236+0000 7f85e4200640 1 -- 172.21.15.55:0/392856148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85dc0b2880 con 0x7f85dc0b34f0 2024-04-02T07:26:56.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.236+0000 7f85d9600640 1 -- 172.21.15.55:0/392856148 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v71) v1 ==== 74+0+16113 (secure 0 0 0) 0x7f85d00ef260 con 0x7f85dc0b34f0 2024-04-02T07:26:56.243 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:56.243 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":71,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:26:55.524880+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:26:53.196912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-02T07:26:54.514963+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:26:56.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.240+0000 7f85e4200640 1 -- 172.21.15.55:0/392856148 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f85bc066690 msgr2=0x7f85bc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:56.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.240+0000 7f85e4200640 1 --2- 172.21.15.55:0/392856148 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f85bc066690 0x7f85bc068b50 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0b3220 tx=0x7f85c8007d60 comp rx=0 tx=0).stop 2024-04-02T07:26:56.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.240+0000 7f85e4200640 1 -- 172.21.15.55:0/392856148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85dc0b34f0 msgr2=0x7f85dc139ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:56.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.240+0000 7f85e4200640 1 --2- 172.21.15.55:0/392856148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85dc0b34f0 0x7f85dc139ef0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f85d001a010 tx=0x7f85d0019180 comp rx=0 tx=0).stop 2024-04-02T07:26:56.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.240+0000 7f85e4200640 1 -- 172.21.15.55:0/392856148 shutdown_connections 2024-04-02T07:26:56.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.240+0000 7f85e4200640 1 --2- 172.21.15.55:0/392856148 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85dc143f90 0x7f85dc0c8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:56.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.240+0000 7f85e4200640 1 --2- 172.21.15.55:0/392856148 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f85bc066690 0x7f85bc068b50 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:56.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.240+0000 7f85e4200640 1 --2- 172.21.15.55:0/392856148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85dc0cda80 0x7f85dc0cb160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:56.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.240+0000 7f85e4200640 1 --2- 172.21.15.55:0/392856148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85dc0b34f0 0x7f85dc139ef0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:56.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.240+0000 7f85e4200640 1 -- 172.21.15.55:0/392856148 >> 172.21.15.55:0/392856148 conn(0x7f85dc066080 msgr2=0x7f85dc143230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:56.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.240+0000 7f85e4200640 1 -- 172.21.15.55:0/392856148 shutdown_connections 2024-04-02T07:26:56.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.240+0000 7f85e4200640 1 -- 172.21.15.55:0/392856148 wait complete. 2024-04-02T07:26:56.266 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-02T07:26:56.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.404+0000 7f2b2fc00640 1 Processor -- start 2024-04-02T07:26:56.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.404+0000 7f2b2fc00640 1 -- start start 2024-04-02T07:26:56.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.404+0000 7f2b2fc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b280709b0 0x7f2b280b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:56.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.404+0000 7f2b2fc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2b280b2fd0 0x7f2b280b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:56.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.404+0000 7f2b2fc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2815e3a0 con 0x7f2b28144260 2024-04-02T07:26:56.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.404+0000 7f2b2fc00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b280b37c0 con 0x7f2b280709b0 2024-04-02T07:26:56.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.404+0000 7f2b2fc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2815e5f0 con 0x7f2b280b2fd0 2024-04-02T07:26:56.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.408+0000 7f2b27e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b280709b0 0x7f2b280b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:56.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.408+0000 7f2b27e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2b280709b0 0x7f2b280b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41650/0 (socket says 172.21.15.55:41650) 2024-04-02T07:26:56.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.408+0000 7f2b27e00640 1 -- 172.21.15.55:0/4061911418 learned_addr learned my addr 172.21.15.55:0/4061911418 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:56.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.408+0000 7f2b2dc00640 1 --2- 172.21.15.55:0/4061911418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2b280b2fd0 0x7f2b280b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:56.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.408+0000 7f2b27e00640 1 -- 172.21.15.55:0/4061911418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2b280b2fd0 msgr2=0x7f2b280b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:56.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.408+0000 7f2b27e00640 1 --2- 172.21.15.55:0/4061911418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2b280b2fd0 0x7f2b280b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:56.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.408+0000 7f2b27e00640 1 -- 172.21.15.55:0/4061911418 >> v1:172.21.15.106:6789/0 conn(0x7f2b28144260 legacy=0x7f2b280702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:56.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.408+0000 7f2b27e00640 1 -- 172.21.15.55:0/4061911418 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2815e8d0 con 0x7f2b280709b0 2024-04-02T07:26:56.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.408+0000 7f2b27e00640 1 --2- 172.21.15.55:0/4061911418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b280709b0 0x7f2b280b2a90 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2b14009870 tx=0x7f2b1401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e729e1a0c0941925 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:56.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.408+0000 7f2b27400640 1 -- 172.21.15.55:0/4061911418 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b140ab650 con 0x7f2b280709b0 2024-04-02T07:26:56.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.408+0000 7f2b27400640 1 -- 172.21.15.55:0/4061911418 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b140ab7b0 con 0x7f2b280709b0 2024-04-02T07:26:56.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.408+0000 7f2b27400640 1 -- 172.21.15.55:0/4061911418 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b140abb40 con 0x7f2b280709b0 2024-04-02T07:26:56.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2fc00640 1 -- 172.21.15.55:0/4061911418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b280709b0 msgr2=0x7f2b280b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:56.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2fc00640 1 --2- 172.21.15.55:0/4061911418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b280709b0 0x7f2b280b2a90 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f2b14009870 tx=0x7f2b1401c560 comp rx=0 tx=0).stop 2024-04-02T07:26:56.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2fc00640 1 -- 172.21.15.55:0/4061911418 shutdown_connections 2024-04-02T07:26:56.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2fc00640 1 --2- 172.21.15.55:0/4061911418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2b280b2fd0 0x7f2b280b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:56.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2fc00640 1 --2- 172.21.15.55:0/4061911418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b280709b0 0x7f2b280b2a90 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:56.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2fc00640 1 -- 172.21.15.55:0/4061911418 >> 172.21.15.55:0/4061911418 conn(0x7f2b2806a390 msgr2=0x7f2b280b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:56.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2fc00640 1 -- 172.21.15.55:0/4061911418 shutdown_connections 2024-04-02T07:26:56.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2fc00640 1 -- 172.21.15.55:0/4061911418 wait complete. 2024-04-02T07:26:56.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2fc00640 1 Processor -- start 2024-04-02T07:26:56.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2fc00640 1 -- start start 2024-04-02T07:26:56.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2fc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2b280709b0 0x7f2b2813d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:56.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2fc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b280b2fd0 0x7f2b28153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:56.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2fc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b28144260 0x7f2b28153640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:56.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2fc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2815aed0 con 0x7f2b28144260 2024-04-02T07:26:56.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2fc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2815b1b0 con 0x7f2b280b2fd0 2024-04-02T07:26:56.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2fc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2815b490 con 0x7f2b280709b0 2024-04-02T07:26:56.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2dc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b28144260 0x7f2b28153640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:56.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2dc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b28144260 0x7f2b28153640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41652/0 (socket says 172.21.15.55:41652) 2024-04-02T07:26:56.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2dc00640 1 -- 172.21.15.55:0/3513045168 learned_addr learned my addr 172.21.15.55:0/3513045168 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:56.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b27e00640 1 --2- 172.21.15.55:0/3513045168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b280b2fd0 0x7f2b28153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:56.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2d200640 1 --2- 172.21.15.55:0/3513045168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2b280709b0 0x7f2b2813d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:56.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2dc00640 1 -- 172.21.15.55:0/3513045168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2b280709b0 msgr2=0x7f2b2813d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:56.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2dc00640 1 --2- 172.21.15.55:0/3513045168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2b280709b0 0x7f2b2813d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:56.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2dc00640 1 -- 172.21.15.55:0/3513045168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b280b2fd0 msgr2=0x7f2b28153100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:56.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2dc00640 1 --2- 172.21.15.55:0/3513045168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b280b2fd0 0x7f2b28153100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:56.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2dc00640 1 -- 172.21.15.55:0/3513045168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b140094d0 con 0x7f2b28144260 2024-04-02T07:26:56.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2d200640 1 --2- 172.21.15.55:0/3513045168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2b280709b0 0x7f2b2813d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:56.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.412+0000 7f2b2dc00640 1 --2- 172.21.15.55:0/3513045168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b28144260 0x7f2b28153640 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000efc0 tx=0x7f2b2000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:56.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.416+0000 7f2b24c00640 1 -- 172.21.15.55:0/3513045168 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b20014480 con 0x7f2b28144260 2024-04-02T07:26:56.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.416+0000 7f2b24c00640 1 -- 172.21.15.55:0/3513045168 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2000f040 con 0x7f2b28144260 2024-04-02T07:26:56.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.416+0000 7f2b24c00640 1 -- 172.21.15.55:0/3513045168 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b20014820 con 0x7f2b28144260 2024-04-02T07:26:56.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.416+0000 7f2b2fc00640 1 -- 172.21.15.55:0/3513045168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b2815d600 con 0x7f2b28144260 2024-04-02T07:26:56.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.416+0000 7f2b2fc00640 1 -- 172.21.15.55:0/3513045168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b28153df0 con 0x7f2b28144260 2024-04-02T07:26:56.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.416+0000 7f2b2fc00640 1 -- 172.21.15.55:0/3513045168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b28073530 con 0x7f2b28144260 2024-04-02T07:26:56.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.416+0000 7f2b24c00640 1 -- 172.21.15.55:0/3513045168 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2b20014980 con 0x7f2b28144260 2024-04-02T07:26:56.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.416+0000 7f2b24c00640 1 --2- 172.21.15.55:0/3513045168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2b080666c0 0x7f2b08068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:56.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.416+0000 7f2b24c00640 1 -- 172.21.15.55:0/3513045168 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b20084cc0 con 0x7f2b28144260 2024-04-02T07:26:56.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.416+0000 7f2b2d200640 1 --2- 172.21.15.55:0/3513045168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2b080666c0 0x7f2b08068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:56.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.420+0000 7f2b2d200640 1 --2- 172.21.15.55:0/3513045168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2b080666c0 0x7f2b08068b80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c000f70 tx=0x7f2b1c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:56.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.420+0000 7f2b24c00640 1 -- 172.21.15.55:0/3513045168 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2b2008b080 con 0x7f2b28144260 2024-04-02T07:26:56.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:56.620+0000 7f2b2fc00640 1 -- 172.21.15.55:0/3513045168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2b28066c90 con 0x7f2b28144260 2024-04-02T07:26:57.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.536+0000 7f2b24c00640 1 -- 172.21.15.55:0/3513045168 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v43) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2b200180b0 con 0x7f2b28144260 2024-04-02T07:26:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.540+0000 7f2b2fc00640 1 -- 172.21.15.55:0/3513045168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2b080666c0 msgr2=0x7f2b08068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.540+0000 7f2b2fc00640 1 --2- 172.21.15.55:0/3513045168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2b080666c0 0x7f2b08068b80 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c000f70 tx=0x7f2b1c009040 comp rx=0 tx=0).stop 2024-04-02T07:26:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.540+0000 7f2b2fc00640 1 -- 172.21.15.55:0/3513045168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b28144260 msgr2=0x7f2b28153640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.540+0000 7f2b2fc00640 1 --2- 172.21.15.55:0/3513045168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b28144260 0x7f2b28153640 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f2b2000efc0 tx=0x7f2b2000c490 comp rx=0 tx=0).stop 2024-04-02T07:26:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.540+0000 7f2b2fc00640 1 -- 172.21.15.55:0/3513045168 shutdown_connections 2024-04-02T07:26:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.540+0000 7f2b2fc00640 1 --2- 172.21.15.55:0/3513045168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2b28144260 0x7f2b28153640 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.540+0000 7f2b2fc00640 1 --2- 172.21.15.55:0/3513045168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2b080666c0 0x7f2b08068b80 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:57.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.540+0000 7f2b2fc00640 1 --2- 172.21.15.55:0/3513045168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2b280b2fd0 0x7f2b28153100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:57.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.540+0000 7f2b2fc00640 1 --2- 172.21.15.55:0/3513045168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2b280709b0 0x7f2b2813d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:57.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.540+0000 7f2b2fc00640 1 -- 172.21.15.55:0/3513045168 >> 172.21.15.55:0/3513045168 conn(0x7f2b2806a390 msgr2=0x7f2b281405c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:57.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.540+0000 7f2b2fc00640 1 -- 172.21.15.55:0/3513045168 shutdown_connections 2024-04-02T07:26:57.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.540+0000 7f2b2fc00640 1 -- 172.21.15.55:0/3513045168 wait complete. 2024-04-02T07:26:57.569 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-02T07:26:57.570 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-02T07:26:57.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.712+0000 7fb00d600640 1 Processor -- start 2024-04-02T07:26:57.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.712+0000 7fb00d600640 1 -- start start 2024-04-02T07:26:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.712+0000 7fb00d600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb0080cfb50 0x7fb00806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.712+0000 7fb00d600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb00806bdf0 0x7fb00815c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.712+0000 7fb00d600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb00806c240 con 0x7fb0080cc7b0 2024-04-02T07:26:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.712+0000 7fb00d600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb008099de0 con 0x7fb0080cfb50 2024-04-02T07:26:57.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.712+0000 7fb00d600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0081613b0 con 0x7fb00806bdf0 2024-04-02T07:26:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.716+0000 7fafffe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb0080cfb50 0x7fb00806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.716+0000 7fb007400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb00806bdf0 0x7fb00815c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.716+0000 7fafffe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb0080cfb50 0x7fb00806b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:44676/0 (socket says 172.21.15.55:44676) 2024-04-02T07:26:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.716+0000 7fb007400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb00806bdf0 0x7fb00815c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:54166/0 (socket says 172.21.15.55:54166) 2024-04-02T07:26:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.716+0000 7fafffe00640 1 -- 172.21.15.55:0/2170341099 learned_addr learned my addr 172.21.15.55:0/2170341099 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.716+0000 7fb006000640 1 -- 172.21.15.55:0/2170341099 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1792836591 0 0) 0x7faff8001120 con 0x7fb0080cc7b0 2024-04-02T07:26:57.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.716+0000 7fb007400640 1 -- 172.21.15.55:0/2170341099 >> v2:172.21.15.106:3300/0 conn(0x7fb0080cfb50 msgr2=0x7fb00806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:57.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.716+0000 7fb007400640 1 --2- 172.21.15.55:0/2170341099 >> v2:172.21.15.106:3300/0 conn(0x7fb0080cfb50 0x7fb00806b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:57.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.716+0000 7fb007400640 1 -- 172.21.15.55:0/2170341099 >> v1:172.21.15.106:6789/0 conn(0x7fb0080cc7b0 legacy=0x7fb0080996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:57.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.716+0000 7fb007400640 1 -- 172.21.15.55:0/2170341099 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0080ccb90 con 0x7fb00806bdf0 2024-04-02T07:26:57.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.716+0000 7fafffe00640 1 --2- 172.21.15.55:0/2170341099 >> v2:172.21.15.106:3300/0 conn(0x7fb0080cfb50 0x7fb00806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:26:57.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.716+0000 7fb007400640 1 --2- 172.21.15.55:0/2170341099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb00806bdf0 0x7fb00815c370 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb000009d90 tx=0x7fb00001c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6d7dae04f68ef23 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:57.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.716+0000 7fb006000640 1 -- 172.21.15.55:0/2170341099 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0000a5970 con 0x7fb00806bdf0 2024-04-02T07:26:57.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.716+0000 7fb006000640 1 -- 172.21.15.55:0/2170341099 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0000a5ad0 con 0x7fb00806bdf0 2024-04-02T07:26:57.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.716+0000 7fb006000640 1 -- 172.21.15.55:0/2170341099 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0000a5e60 con 0x7fb00806bdf0 2024-04-02T07:26:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb00d600640 1 -- 172.21.15.55:0/2170341099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb00806bdf0 msgr2=0x7fb00815c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb00d600640 1 --2- 172.21.15.55:0/2170341099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb00806bdf0 0x7fb00815c370 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb000009d90 tx=0x7fb00001c8b0 comp rx=0 tx=0).stop 2024-04-02T07:26:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb00d600640 1 -- 172.21.15.55:0/2170341099 shutdown_connections 2024-04-02T07:26:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb00d600640 1 --2- 172.21.15.55:0/2170341099 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb00806bdf0 0x7fb00815c370 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb00d600640 1 --2- 172.21.15.55:0/2170341099 >> v2:172.21.15.106:3300/0 conn(0x7fb0080cfb50 0x7fb00806b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb00d600640 1 -- 172.21.15.55:0/2170341099 >> 172.21.15.55:0/2170341099 conn(0x7fb0080b21f0 msgr2=0x7fb0080b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:57.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb00d600640 1 -- 172.21.15.55:0/2170341099 shutdown_connections 2024-04-02T07:26:57.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb00d600640 1 -- 172.21.15.55:0/2170341099 wait complete. 2024-04-02T07:26:57.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb00d600640 1 Processor -- start 2024-04-02T07:26:57.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb00d600640 1 -- start start 2024-04-02T07:26:57.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb00d600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb00806bdf0 0x7fb008158a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:57.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb00d600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0080cc7b0 0x7fb00814acc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:57.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb00d600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0080cfb50 0x7fb00815bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:57.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb00d600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb008158fc0 con 0x7fb0080cfb50 2024-04-02T07:26:57.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb00d600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0080b3fd0 con 0x7fb00806bdf0 2024-04-02T07:26:57.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb00d600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb00814b200 con 0x7fb0080cc7b0 2024-04-02T07:26:57.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb007400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0080cfb50 0x7fb00815bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:57.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb007400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0080cfb50 0x7fb00815bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41664/0 (socket says 172.21.15.55:41664) 2024-04-02T07:26:57.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb007400640 1 -- 172.21.15.55:0/1775892281 learned_addr learned my addr 172.21.15.55:0/1775892281 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:57.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fafffe00640 1 --2- 172.21.15.55:0/1775892281 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0080cc7b0 0x7fb00814acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:57.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb006a00640 1 --2- 172.21.15.55:0/1775892281 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb00806bdf0 0x7fb008158a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:57.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb007400640 1 -- 172.21.15.55:0/1775892281 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0080cc7b0 msgr2=0x7fb00814acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:57.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb007400640 1 --2- 172.21.15.55:0/1775892281 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0080cc7b0 0x7fb00814acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:57.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.720+0000 7fb007400640 1 -- 172.21.15.55:0/1775892281 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb00806bdf0 msgr2=0x7fb008158a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:57.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.724+0000 7fb007400640 1 --2- 172.21.15.55:0/1775892281 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb00806bdf0 0x7fb008158a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:57.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.724+0000 7fb007400640 1 -- 172.21.15.55:0/1775892281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faff00094d0 con 0x7fb0080cfb50 2024-04-02T07:26:57.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.724+0000 7fb006a00640 1 --2- 172.21.15.55:0/1775892281 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb00806bdf0 0x7fb008158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:26:57.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.724+0000 7fb007400640 1 --2- 172.21.15.55:0/1775892281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0080cfb50 0x7fb00815bd50 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb00001af60 tx=0x7fb000019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:57.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.724+0000 7faffea00640 1 -- 172.21.15.55:0/1775892281 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0000add90 con 0x7fb0080cfb50 2024-04-02T07:26:57.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.724+0000 7faffea00640 1 -- 172.21.15.55:0/1775892281 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb000009450 con 0x7fb0080cfb50 2024-04-02T07:26:57.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.724+0000 7fb00d600640 1 -- 172.21.15.55:0/1775892281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb000009a70 con 0x7fb0080cfb50 2024-04-02T07:26:57.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.724+0000 7faffea00640 1 -- 172.21.15.55:0/1775892281 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0000b9670 con 0x7fb0080cfb50 2024-04-02T07:26:57.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.724+0000 7fb00d600640 1 -- 172.21.15.55:0/1775892281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0080b36a0 con 0x7fb0080cfb50 2024-04-02T07:26:57.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.724+0000 7fb00d600640 1 -- 172.21.15.55:0/1775892281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb008066c90 con 0x7fb0080cfb50 2024-04-02T07:26:57.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.724+0000 7faffea00640 1 -- 172.21.15.55:0/1775892281 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb0000b97d0 con 0x7fb0080cfb50 2024-04-02T07:26:57.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.724+0000 7faffea00640 1 --2- 172.21.15.55:0/1775892281 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fafe40666c0 0x7fafe4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:57.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.724+0000 7faffea00640 1 -- 172.21.15.55:0/1775892281 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb00011f910 con 0x7fb0080cfb50 2024-04-02T07:26:57.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.724+0000 7fb006a00640 1 --2- 172.21.15.55:0/1775892281 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fafe40666c0 0x7fafe4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:57.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.728+0000 7fb006a00640 1 --2- 172.21.15.55:0/1775892281 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fafe40666c0 0x7fafe4068b80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7faff8007fd0 tx=0x7faff8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:57.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.728+0000 7faffea00640 1 -- 172.21.15.55:0/1775892281 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fb0000ecc70 con 0x7fb0080cfb50 2024-04-02T07:26:57.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:57.924+0000 7fb00d600640 1 -- 172.21.15.55:0/1775892281 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb0080b4110 con 0x7fb0080cfb50 2024-04-02T07:26:58.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.540+0000 7faffea00640 1 -- 172.21.15.55:0/1775892281 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v44) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb0000f0290 con 0x7fb0080cfb50 2024-04-02T07:26:58.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.544+0000 7fb00d600640 1 -- 172.21.15.55:0/1775892281 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fafe40666c0 msgr2=0x7fafe4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:58.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.544+0000 7fb00d600640 1 --2- 172.21.15.55:0/1775892281 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fafe40666c0 0x7fafe4068b80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7faff8007fd0 tx=0x7faff8009040 comp rx=0 tx=0).stop 2024-04-02T07:26:58.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.544+0000 7fb00d600640 1 -- 172.21.15.55:0/1775892281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0080cfb50 msgr2=0x7fb00815bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:58.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.544+0000 7fb00d600640 1 --2- 172.21.15.55:0/1775892281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0080cfb50 0x7fb00815bd50 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb00001af60 tx=0x7fb000019650 comp rx=0 tx=0).stop 2024-04-02T07:26:58.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.544+0000 7fb00d600640 1 -- 172.21.15.55:0/1775892281 shutdown_connections 2024-04-02T07:26:58.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.544+0000 7fb00d600640 1 --2- 172.21.15.55:0/1775892281 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb0080cfb50 0x7fb00815bd50 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:58.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.544+0000 7fb00d600640 1 --2- 172.21.15.55:0/1775892281 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb0080cc7b0 0x7fb00814acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:58.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.544+0000 7fb00d600640 1 --2- 172.21.15.55:0/1775892281 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fafe40666c0 0x7fafe4068b80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:58.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.544+0000 7fb00d600640 1 --2- 172.21.15.55:0/1775892281 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb00806bdf0 0x7fb008158a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:58.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.544+0000 7fb00d600640 1 -- 172.21.15.55:0/1775892281 >> 172.21.15.55:0/1775892281 conn(0x7fb0080b21f0 msgr2=0x7fb0080996d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:58.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.544+0000 7fb00d600640 1 -- 172.21.15.55:0/1775892281 shutdown_connections 2024-04-02T07:26:58.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.544+0000 7fb00d600640 1 -- 172.21.15.55:0/1775892281 wait complete. 2024-04-02T07:26:58.571 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-02T07:26:58.571 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:26:58.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.708+0000 7f0366e00640 1 Processor -- start 2024-04-02T07:26:58.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.708+0000 7f0366e00640 1 -- start start 2024-04-02T07:26:58.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.712+0000 7f0366e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f036015cbe0 0x7f03600ce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:58.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.712+0000 7f0366e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0360065d20 0x7f03600b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:58.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.712+0000 7f0366e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f036006d5b0 con 0x7f0360070a80 2024-04-02T07:26:58.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.712+0000 7f0366e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03600cec10 con 0x7f0360065d20 2024-04-02T07:26:58.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.712+0000 7f0366e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036006cc80 con 0x7f036015cbe0 2024-04-02T07:26:58.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.712+0000 7f0357e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0360065d20 0x7f03600b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:58.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.712+0000 7f0357e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0360065d20 0x7f03600b1c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41672/0 (socket says 172.21.15.55:41672) 2024-04-02T07:26:58.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.712+0000 7f0357e00640 1 -- 172.21.15.55:0/174231031 learned_addr learned my addr 172.21.15.55:0/174231031 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:58.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.712+0000 7f035fe00640 1 --2- 172.21.15.55:0/174231031 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f036015cbe0 0x7f03600ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:58.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.712+0000 7f0357e00640 1 -- 172.21.15.55:0/174231031 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f036015cbe0 msgr2=0x7f03600ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:58.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.712+0000 7f0357e00640 1 --2- 172.21.15.55:0/174231031 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f036015cbe0 0x7f03600ce630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:58.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.712+0000 7f0357e00640 1 -- 172.21.15.55:0/174231031 >> v1:172.21.15.55:6789/0 conn(0x7f0360070a80 legacy=0x7f036006da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:58.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.712+0000 7f0357e00640 1 -- 172.21.15.55:0/174231031 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036006cf60 con 0x7f0360065d20 2024-04-02T07:26:58.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.712+0000 7f035fe00640 1 --2- 172.21.15.55:0/174231031 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f036015cbe0 0x7f03600ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:26:58.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.716+0000 7f0357e00640 1 --2- 172.21.15.55:0/174231031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360065d20 0x7f03600b1c00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0348009870 tx=0x7f034801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c583e35915799dd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:58.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.716+0000 7f035f400640 1 -- 172.21.15.55:0/174231031 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03480ab650 con 0x7f0360065d20 2024-04-02T07:26:58.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.716+0000 7f035f400640 1 -- 172.21.15.55:0/174231031 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03480ab7b0 con 0x7f0360065d20 2024-04-02T07:26:58.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.716+0000 7f035f400640 1 -- 172.21.15.55:0/174231031 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03480abb40 con 0x7f0360065d20 2024-04-02T07:26:58.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.716+0000 7f0366e00640 1 -- 172.21.15.55:0/174231031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360065d20 msgr2=0x7f03600b1c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:58.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.716+0000 7f0366e00640 1 --2- 172.21.15.55:0/174231031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360065d20 0x7f03600b1c00 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f0348009870 tx=0x7f034801c560 comp rx=0 tx=0).stop 2024-04-02T07:26:58.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.716+0000 7f0366e00640 1 -- 172.21.15.55:0/174231031 shutdown_connections 2024-04-02T07:26:58.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.716+0000 7f0366e00640 1 --2- 172.21.15.55:0/174231031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360065d20 0x7f03600b1c00 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:58.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.716+0000 7f0366e00640 1 --2- 172.21.15.55:0/174231031 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f036015cbe0 0x7f03600ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:58.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.716+0000 7f0366e00640 1 -- 172.21.15.55:0/174231031 >> 172.21.15.55:0/174231031 conn(0x7f03600ced50 msgr2=0x7f03600cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:58.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.716+0000 7f0366e00640 1 -- 172.21.15.55:0/174231031 shutdown_connections 2024-04-02T07:26:58.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.716+0000 7f0366e00640 1 -- 172.21.15.55:0/174231031 wait complete. 2024-04-02T07:26:58.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.716+0000 7f0366e00640 1 Processor -- start 2024-04-02T07:26:58.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.716+0000 7f0366e00640 1 -- start start 2024-04-02T07:26:58.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f0366e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0360065d20 0x7f036014bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:58.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f0366e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360070a80 0x7f03600ac760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:58.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f0366e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f036015cbe0 0x7f0360151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:58.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f0366e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f036015f260 con 0x7f0360070a80 2024-04-02T07:26:58.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f0366e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03600acca0 con 0x7f0360065d20 2024-04-02T07:26:58.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f0366e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f036015e1c0 con 0x7f036015cbe0 2024-04-02T07:26:58.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f0357e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360070a80 0x7f03600ac760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:58.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f0357e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360070a80 0x7f03600ac760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41686/0 (socket says 172.21.15.55:41686) 2024-04-02T07:26:58.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f0357e00640 1 -- 172.21.15.55:0/3873882656 learned_addr learned my addr 172.21.15.55:0/3873882656 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:58.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f035fe00640 1 --2- 172.21.15.55:0/3873882656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0360065d20 0x7f036014bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:58.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f0357e00640 1 -- 172.21.15.55:0/3873882656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f036015cbe0 msgr2=0x7f0360151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:58.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f0364e00640 1 --2- 172.21.15.55:0/3873882656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f036015cbe0 0x7f0360151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:58.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f0357e00640 1 --2- 172.21.15.55:0/3873882656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f036015cbe0 0x7f0360151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:58.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f0357e00640 1 -- 172.21.15.55:0/3873882656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0360065d20 msgr2=0x7f036014bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:58.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f0357e00640 1 --2- 172.21.15.55:0/3873882656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0360065d20 0x7f036014bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:58.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f0357e00640 1 -- 172.21.15.55:0/3873882656 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03480094d0 con 0x7f0360070a80 2024-04-02T07:26:58.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f035fe00640 1 --2- 172.21.15.55:0/3873882656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0360065d20 0x7f036014bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:26:58.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f0364e00640 1 --2- 172.21.15.55:0/3873882656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f036015cbe0 0x7f0360151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:26:58.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f0357e00640 1 --2- 172.21.15.55:0/3873882656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360070a80 0x7f03600ac760 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f034801a190 tx=0x7f034801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:58.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f035cc00640 1 -- 172.21.15.55:0/3873882656 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03480b48c0 con 0x7f0360070a80 2024-04-02T07:26:58.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f035cc00640 1 -- 172.21.15.55:0/3873882656 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03480b4a40 con 0x7f0360070a80 2024-04-02T07:26:58.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f0366e00640 1 -- 172.21.15.55:0/3873882656 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0360071420 con 0x7f0360070a80 2024-04-02T07:26:58.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f035cc00640 1 -- 172.21.15.55:0/3873882656 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03480b4df0 con 0x7f0360070a80 2024-04-02T07:26:58.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f0366e00640 1 -- 172.21.15.55:0/3873882656 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f036015e780 con 0x7f0360070a80 2024-04-02T07:26:58.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f0366e00640 1 -- 172.21.15.55:0/3873882656 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0360066c90 con 0x7f0360070a80 2024-04-02T07:26:58.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.720+0000 7f035cc00640 1 -- 172.21.15.55:0/3873882656 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f03480c7390 con 0x7f0360070a80 2024-04-02T07:26:58.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.724+0000 7f035cc00640 1 --2- 172.21.15.55:0/3873882656 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f033c066690 0x7f033c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:58.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.724+0000 7f035cc00640 1 -- 172.21.15.55:0/3873882656 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f034811ee80 con 0x7f0360070a80 2024-04-02T07:26:58.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.724+0000 7f035fe00640 1 --2- 172.21.15.55:0/3873882656 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f033c066690 0x7f033c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:58.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.724+0000 7f035fe00640 1 --2- 172.21.15.55:0/3873882656 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f033c066690 0x7f033c068b50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0360152420 tx=0x7f0350008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:58.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.728+0000 7f035cc00640 1 -- 172.21.15.55:0/3873882656 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f03480ec150 con 0x7f0360070a80 2024-04-02T07:26:58.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.924+0000 7f0366e00640 1 -- 172.21.15.55:0/3873882656 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03600b2570 con 0x7f0360070a80 2024-04-02T07:26:58.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.924+0000 7f035cc00640 1 -- 172.21.15.55:0/3873882656 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4739 (secure 0 0 0) 0x7f03480ef770 con 0x7f0360070a80 2024-04-02T07:26:58.929 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:58.929 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2000687874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2000687874},{"type":"v1","addr":"172.21.15.106:6835","nonce":2000687874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/823234890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":823234890},{"type":"v1","addr":"172.21.15.55:6835","nonce":823234890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6439,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1803758651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1803758651},{"type":"v1","addr":"172.21.15.106:6837","nonce":1803758651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:26:55.525186+0000","modified":"2024-04-02T07:26:58.541802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6696},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6696":{"gid":6696,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6833/1576619269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1576619269},{"type":"v1","addr":"172.21.15.55:6833","nonce":1576619269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-02T07:26:58.930 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 44 2024-04-02T07:26:58.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.924+0000 7f0366e00640 1 -- 172.21.15.55:0/3873882656 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f033c066690 msgr2=0x7f033c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:58.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.924+0000 7f0366e00640 1 --2- 172.21.15.55:0/3873882656 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f033c066690 0x7f033c068b50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0360152420 tx=0x7f0350008040 comp rx=0 tx=0).stop 2024-04-02T07:26:58.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.924+0000 7f0366e00640 1 -- 172.21.15.55:0/3873882656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360070a80 msgr2=0x7f03600ac760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:58.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.924+0000 7f0366e00640 1 --2- 172.21.15.55:0/3873882656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360070a80 0x7f03600ac760 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f034801a190 tx=0x7f034801ada0 comp rx=0 tx=0).stop 2024-04-02T07:26:58.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.924+0000 7f0366e00640 1 -- 172.21.15.55:0/3873882656 shutdown_connections 2024-04-02T07:26:58.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.924+0000 7f0366e00640 1 --2- 172.21.15.55:0/3873882656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f036015cbe0 0x7f0360151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:58.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.924+0000 7f0366e00640 1 --2- 172.21.15.55:0/3873882656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0360070a80 0x7f03600ac760 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:58.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.924+0000 7f0366e00640 1 --2- 172.21.15.55:0/3873882656 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f033c066690 0x7f033c068b50 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:58.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.924+0000 7f0366e00640 1 --2- 172.21.15.55:0/3873882656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0360065d20 0x7f036014bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:58.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.924+0000 7f0366e00640 1 -- 172.21.15.55:0/3873882656 >> 172.21.15.55:0/3873882656 conn(0x7f03600ced50 msgr2=0x7f03600affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:58.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.924+0000 7f0366e00640 1 -- 172.21.15.55:0/3873882656 shutdown_connections 2024-04-02T07:26:58.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:58.924+0000 7f0366e00640 1 -- 172.21.15.55:0/3873882656 wait complete. 2024-04-02T07:26:58.951 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:26:59.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.084+0000 7fa32d000640 1 Processor -- start 2024-04-02T07:26:59.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.084+0000 7fa32d000640 1 -- start start 2024-04-02T07:26:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.088+0000 7fa32d000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa328153ea0 0x7fa3280c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.088+0000 7fa32d000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa328159be0 0x7fa3280b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.088+0000 7fa32d000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa32815a040 0x7fa3280b36f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.088+0000 7fa32d000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32813d0c0 con 0x7fa32815a040 2024-04-02T07:26:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.088+0000 7fa32d000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa32815a4f0 con 0x7fa328153ea0 2024-04-02T07:26:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.088+0000 7fa32d000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa32815a7d0 con 0x7fa328159be0 2024-04-02T07:26:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.088+0000 7fa326800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa32815a040 0x7fa3280b36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.088+0000 7fa326800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa32815a040 0x7fa3280b36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41688/0 (socket says 172.21.15.55:41688) 2024-04-02T07:26:59.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.088+0000 7fa326800640 1 -- 172.21.15.55:0/203190369 learned_addr learned my addr 172.21.15.55:0/203190369 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:59.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.088+0000 7fa325e00640 1 --2- 172.21.15.55:0/203190369 >> v2:172.21.15.106:3300/0 conn(0x7fa328153ea0 0x7fa3280c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:59.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.088+0000 7fa31d400640 1 --2- 172.21.15.55:0/203190369 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa328159be0 0x7fa3280b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:59.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.088+0000 7fa326800640 1 -- 172.21.15.55:0/203190369 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa328159be0 msgr2=0x7fa3280b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:59.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.088+0000 7fa326800640 1 --2- 172.21.15.55:0/203190369 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa328159be0 0x7fa3280b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.088+0000 7fa326800640 1 -- 172.21.15.55:0/203190369 >> v2:172.21.15.106:3300/0 conn(0x7fa328153ea0 msgr2=0x7fa3280c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:26:59.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.088+0000 7fa326800640 1 --2- 172.21.15.55:0/203190369 >> v2:172.21.15.106:3300/0 conn(0x7fa328153ea0 0x7fa3280c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.088+0000 7fa326800640 1 -- 172.21.15.55:0/203190369 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32815aab0 con 0x7fa32815a040 2024-04-02T07:26:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.092+0000 7fa326800640 1 --2- 172.21.15.55:0/203190369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa32815a040 0x7fa3280b36f0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fa32806e720 tx=0x7fa32001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a22b59578f424d54 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.092+0000 7fa325400640 1 -- 172.21.15.55:0/203190369 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3200a5890 con 0x7fa32815a040 2024-04-02T07:26:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.092+0000 7fa325400640 1 -- 172.21.15.55:0/203190369 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3200a59f0 con 0x7fa32815a040 2024-04-02T07:26:59.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.092+0000 7fa325400640 1 -- 172.21.15.55:0/203190369 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3200a5d80 con 0x7fa32815a040 2024-04-02T07:26:59.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.092+0000 7fa32d000640 1 -- 172.21.15.55:0/203190369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa32815a040 msgr2=0x7fa3280b36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:59.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.092+0000 7fa32d000640 1 --2- 172.21.15.55:0/203190369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa32815a040 0x7fa3280b36f0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7fa32806e720 tx=0x7fa32001c9f0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.092+0000 7fa32d000640 1 -- 172.21.15.55:0/203190369 shutdown_connections 2024-04-02T07:26:59.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.092+0000 7fa32d000640 1 --2- 172.21.15.55:0/203190369 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa32815a040 0x7fa3280b36f0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.092+0000 7fa32d000640 1 --2- 172.21.15.55:0/203190369 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa328159be0 0x7fa3280b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.092+0000 7fa32d000640 1 --2- 172.21.15.55:0/203190369 >> v2:172.21.15.106:3300/0 conn(0x7fa328153ea0 0x7fa3280c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.092+0000 7fa32d000640 1 -- 172.21.15.55:0/203190369 >> 172.21.15.55:0/203190369 conn(0x7fa328066080 msgr2=0x7fa328069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.092+0000 7fa32d000640 1 -- 172.21.15.55:0/203190369 shutdown_connections 2024-04-02T07:26:59.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.092+0000 7fa32d000640 1 -- 172.21.15.55:0/203190369 wait complete. 2024-04-02T07:26:59.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.092+0000 7fa32d000640 1 Processor -- start 2024-04-02T07:26:59.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.092+0000 7fa32d000640 1 -- start start 2024-04-02T07:26:59.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa32d000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa328153ea0 0x7fa328157c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:59.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa32d000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa328159be0 0x7fa3280cd760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:59.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa32d000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa32815a040 0x7fa328137ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:59.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa32d000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa328159180 con 0x7fa328153ea0 2024-04-02T07:26:59.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa32d000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa328158570 con 0x7fa328159be0 2024-04-02T07:26:59.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa32d000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa328158850 con 0x7fa32815a040 2024-04-02T07:26:59.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa325e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa328153ea0 0x7fa328157c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:59.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa325e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa328153ea0 0x7fa328157c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41690/0 (socket says 172.21.15.55:41690) 2024-04-02T07:26:59.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa325e00640 1 -- 172.21.15.55:0/2031380887 learned_addr learned my addr 172.21.15.55:0/2031380887 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:59.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa31d400640 1 --2- 172.21.15.55:0/2031380887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa328159be0 0x7fa3280cd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:59.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa326800640 1 --2- 172.21.15.55:0/2031380887 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa32815a040 0x7fa328137ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:59.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa325e00640 1 -- 172.21.15.55:0/2031380887 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa32815a040 msgr2=0x7fa328137ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:59.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa325e00640 1 --2- 172.21.15.55:0/2031380887 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa32815a040 0x7fa328137ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa325e00640 1 -- 172.21.15.55:0/2031380887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa328159be0 msgr2=0x7fa3280cd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:59.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa325e00640 1 --2- 172.21.15.55:0/2031380887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa328159be0 0x7fa3280cd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa325e00640 1 -- 172.21.15.55:0/2031380887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa320009b30 con 0x7fa328153ea0 2024-04-02T07:26:59.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa325e00640 1 --2- 172.21.15.55:0/2031380887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa328153ea0 0x7fa328157c20 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa31800e870 tx=0x7fa31800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:59.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa31ea00640 1 -- 172.21.15.55:0/2031380887 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31800ee60 con 0x7fa328153ea0 2024-04-02T07:26:59.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa31ea00640 1 -- 172.21.15.55:0/2031380887 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa31800c940 con 0x7fa328153ea0 2024-04-02T07:26:59.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa32d000640 1 -- 172.21.15.55:0/2031380887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa328158b30 con 0x7fa328153ea0 2024-04-02T07:26:59.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa31ea00640 1 -- 172.21.15.55:0/2031380887 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa31800ccf0 con 0x7fa328153ea0 2024-04-02T07:26:59.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa32d000640 1 -- 172.21.15.55:0/2031380887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa328158160 con 0x7fa328153ea0 2024-04-02T07:26:59.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.096+0000 7fa32d000640 1 -- 172.21.15.55:0/2031380887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3280cb070 con 0x7fa328153ea0 2024-04-02T07:26:59.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.100+0000 7fa31ea00640 1 -- 172.21.15.55:0/2031380887 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa318013470 con 0x7fa328153ea0 2024-04-02T07:26:59.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.100+0000 7fa31ea00640 1 --2- 172.21.15.55:0/2031380887 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa304066690 0x7fa304068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:59.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.100+0000 7fa31ea00640 1 -- 172.21.15.55:0/2031380887 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa318084200 con 0x7fa328153ea0 2024-04-02T07:26:59.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.100+0000 7fa31d400640 1 --2- 172.21.15.55:0/2031380887 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa304066690 0x7fa304068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:59.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.100+0000 7fa31d400640 1 --2- 172.21.15.55:0/2031380887 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa304066690 0x7fa304068b50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa3281f7ce0 tx=0x7fa310009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:59.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.104+0000 7fa31ea00640 1 -- 172.21.15.55:0/2031380887 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa318051580 con 0x7fa328153ea0 2024-04-02T07:26:59.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.264+0000 7fa32d000640 1 -- 172.21.15.55:0/2031380887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa328066c90 con 0x7fa328153ea0 2024-04-02T07:26:59.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.268+0000 7fa31ea00640 1 -- 172.21.15.55:0/2031380887 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) v1 ==== 74+0+16100 (secure 0 0 0) 0x7fa318054ba0 con 0x7fa328153ea0 2024-04-02T07:26:59.272 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:59.272 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":72,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:26:56.531720+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:26:53.196912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-02T07:26:54.514963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:26:59.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.268+0000 7fa32d000640 1 -- 172.21.15.55:0/2031380887 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa304066690 msgr2=0x7fa304068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:59.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.268+0000 7fa32d000640 1 --2- 172.21.15.55:0/2031380887 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa304066690 0x7fa304068b50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa3281f7ce0 tx=0x7fa310009190 comp rx=0 tx=0).stop 2024-04-02T07:26:59.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.268+0000 7fa32d000640 1 -- 172.21.15.55:0/2031380887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa328153ea0 msgr2=0x7fa328157c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.268+0000 7fa32d000640 1 --2- 172.21.15.55:0/2031380887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa328153ea0 0x7fa328157c20 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fa31800e870 tx=0x7fa31800ed30 comp rx=0 tx=0).stop 2024-04-02T07:26:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.268+0000 7fa32d000640 1 -- 172.21.15.55:0/2031380887 shutdown_connections 2024-04-02T07:26:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.268+0000 7fa32d000640 1 --2- 172.21.15.55:0/2031380887 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa32815a040 0x7fa328137ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.268+0000 7fa32d000640 1 --2- 172.21.15.55:0/2031380887 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa304066690 0x7fa304068b50 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.268+0000 7fa32d000640 1 --2- 172.21.15.55:0/2031380887 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa328159be0 0x7fa3280cd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.268+0000 7fa32d000640 1 --2- 172.21.15.55:0/2031380887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa328153ea0 0x7fa328157c20 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.268+0000 7fa32d000640 1 -- 172.21.15.55:0/2031380887 >> 172.21.15.55:0/2031380887 conn(0x7fa328066080 msgr2=0x7fa3280702a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.268+0000 7fa32d000640 1 -- 172.21.15.55:0/2031380887 shutdown_connections 2024-04-02T07:26:59.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.268+0000 7fa32d000640 1 -- 172.21.15.55:0/2031380887 wait complete. 2024-04-02T07:26:59.293 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-02T07:26:59.294 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:26:59.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.428+0000 7f013cc00640 1 Processor -- start 2024-04-02T07:26:59.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.428+0000 7f013cc00640 1 -- start start 2024-04-02T07:26:59.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.432+0000 7f013cc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01380cda80 0x7f01380c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:59.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.432+0000 7f013cc00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01380b3c00 con 0x7f0138143f90 2024-04-02T07:26:59.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.432+0000 7f013cc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0138144370 con 0x7f013815ad30 2024-04-02T07:26:59.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.432+0000 7f013cc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01380c37b0 con 0x7f01380cda80 2024-04-02T07:26:59.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.432+0000 7f0135e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0138143f90 0x7f01380b34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35786/0 (socket says 172.21.15.55:35786) 2024-04-02T07:26:59.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.432+0000 7f0135e00640 1 -- 172.21.15.55:0/3415352532 learned_addr learned my addr 172.21.15.55:0/3415352532 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:26:59.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.432+0000 7f0136800640 1 --2- 172.21.15.55:0/3415352532 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01380cda80 0x7f01380c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:59.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.432+0000 7f0135400640 1 -- 172.21.15.55:0/3415352532 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 904876870 0 0) 0x7f01380b3c00 con 0x7f0138143f90 2024-04-02T07:26:59.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.432+0000 7f0135400640 1 -- 172.21.15.55:0/3415352532 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f011c003530 con 0x7f0138143f90 2024-04-02T07:26:59.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.432+0000 7f0135400640 1 -- 172.21.15.55:0/3415352532 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 417677189 0 0) 0x7f0138144370 con 0x7f013815ad30 2024-04-02T07:26:59.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.432+0000 7f0135400640 1 -- 172.21.15.55:0/3415352532 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01380b3c00 con 0x7f013815ad30 2024-04-02T07:26:59.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.432+0000 7f0136800640 1 -- 172.21.15.55:0/3415352532 >> v1:172.21.15.106:6789/0 conn(0x7f013815ad30 legacy=0x7f01380cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:59.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.432+0000 7f0136800640 1 -- 172.21.15.55:0/3415352532 >> v1:172.21.15.55:6789/0 conn(0x7f0138143f90 legacy=0x7f01380b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:59.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.432+0000 7f0136800640 1 -- 172.21.15.55:0/3415352532 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01380c3a90 con 0x7f01380cda80 2024-04-02T07:26:59.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.436+0000 7f0136800640 1 --2- 172.21.15.55:0/3415352532 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01380cda80 0x7f01380c4850 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0130009dc0 tx=0x7f013001c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab4a61d993955243 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:59.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.436+0000 7f0135400640 1 -- 172.21.15.55:0/3415352532 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01300a5990 con 0x7f01380cda80 2024-04-02T07:26:59.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.436+0000 7f0135400640 1 -- 172.21.15.55:0/3415352532 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01300a5af0 con 0x7f01380cda80 2024-04-02T07:26:59.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.436+0000 7f0135400640 1 -- 172.21.15.55:0/3415352532 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01300a5e80 con 0x7f01380cda80 2024-04-02T07:26:59.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.436+0000 7f013cc00640 1 -- 172.21.15.55:0/3415352532 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01380cda80 msgr2=0x7f01380c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:59.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.436+0000 7f013cc00640 1 --2- 172.21.15.55:0/3415352532 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01380cda80 0x7f01380c4850 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f0130009dc0 tx=0x7f013001c8d0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.436+0000 7f013cc00640 1 -- 172.21.15.55:0/3415352532 shutdown_connections 2024-04-02T07:26:59.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.436+0000 7f013cc00640 1 --2- 172.21.15.55:0/3415352532 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01380cda80 0x7f01380c4850 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.436+0000 7f013cc00640 1 -- 172.21.15.55:0/3415352532 >> 172.21.15.55:0/3415352532 conn(0x7f0138066080 msgr2=0x7f0138069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:59.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.436+0000 7f013cc00640 1 -- 172.21.15.55:0/3415352532 shutdown_connections 2024-04-02T07:26:59.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.436+0000 7f013cc00640 1 -- 172.21.15.55:0/3415352532 wait complete. 2024-04-02T07:26:59.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.436+0000 7f013cc00640 1 Processor -- start 2024-04-02T07:26:59.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.436+0000 7f013cc00640 1 -- start start 2024-04-02T07:26:59.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.436+0000 7f013cc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01380cda80 0x7f01380c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:59.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.436+0000 7f013cc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0138143f90 0x7f0138141da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:59.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f013cc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f013815ad30 0x7f01380cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:59.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f013cc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013812dbc0 con 0x7f013815ad30 2024-04-02T07:26:59.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f013cc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01381422e0 con 0x7f0138143f90 2024-04-02T07:26:59.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f013cc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01380c8e30 con 0x7f01380cda80 2024-04-02T07:26:59.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f0136800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f013815ad30 0x7f01380cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:59.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f0136800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f013815ad30 0x7f01380cb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41704/0 (socket says 172.21.15.55:41704) 2024-04-02T07:26:59.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f0136800640 1 -- 172.21.15.55:0/2233005009 learned_addr learned my addr 172.21.15.55:0/2233005009 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:59.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f0135e00640 1 --2- 172.21.15.55:0/2233005009 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01380cda80 0x7f01380c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:59.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f012fe00640 1 --2- 172.21.15.55:0/2233005009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0138143f90 0x7f0138141da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:59.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f0136800640 1 -- 172.21.15.55:0/2233005009 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01380cda80 msgr2=0x7f01380c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:59.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f0136800640 1 --2- 172.21.15.55:0/2233005009 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01380cda80 0x7f01380c6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f0136800640 1 -- 172.21.15.55:0/2233005009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0138143f90 msgr2=0x7f0138141da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:59.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f0136800640 1 --2- 172.21.15.55:0/2233005009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0138143f90 0x7f0138141da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f0136800640 1 -- 172.21.15.55:0/2233005009 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0130009a70 con 0x7f013815ad30 2024-04-02T07:26:59.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f0136800640 1 --2- 172.21.15.55:0/2233005009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f013815ad30 0x7f01380cb710 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f013001a500 tx=0x7f0130019670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:59.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f012e000640 1 -- 172.21.15.55:0/2233005009 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01300adce0 con 0x7f013815ad30 2024-04-02T07:26:59.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f012e000640 1 -- 172.21.15.55:0/2233005009 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01300ade40 con 0x7f013815ad30 2024-04-02T07:26:59.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f012e000640 1 -- 172.21.15.55:0/2233005009 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01300b7630 con 0x7f013815ad30 2024-04-02T07:26:59.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f013cc00640 1 -- 172.21.15.55:0/2233005009 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013812cf80 con 0x7f013815ad30 2024-04-02T07:26:59.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f013cc00640 1 -- 172.21.15.55:0/2233005009 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013812d500 con 0x7f013815ad30 2024-04-02T07:26:59.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f013cc00640 1 -- 172.21.15.55:0/2233005009 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013812dd00 con 0x7f013815ad30 2024-04-02T07:26:59.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.440+0000 7f012e000640 1 -- 172.21.15.55:0/2233005009 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f01300b4050 con 0x7f013815ad30 2024-04-02T07:26:59.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.444+0000 7f012e000640 1 --2- 172.21.15.55:0/2233005009 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0114066690 0x7f0114068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:59.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.444+0000 7f012e000640 1 -- 172.21.15.55:0/2233005009 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01380c55a0 con 0x7f013815ad30 2024-04-02T07:26:59.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.444+0000 7f0135e00640 1 --2- 172.21.15.55:0/2233005009 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0114066690 0x7f0114068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:59.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.444+0000 7f0135e00640 1 --2- 172.21.15.55:0/2233005009 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0114066690 0x7f0114068b50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0128007fd0 tx=0x7f0128007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:59.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.448+0000 7f012e000640 1 -- 172.21.15.55:0/2233005009 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f013812dd00 con 0x7f013815ad30 2024-04-02T07:26:59.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.604+0000 7f013cc00640 1 -- 172.21.15.55:0/2233005009 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f013815b140 con 0x7f0114066690 2024-04-02T07:26:59.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.616+0000 7f012e000640 1 -- 172.21.15.55:0/2233005009 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288978 (secure 0 0 0) 0x7f0128001510 con 0x7f0114066690 2024-04-02T07:26:59.623 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:26:59.625 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:26:59.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.620+0000 7f013cc00640 1 -- 172.21.15.55:0/2233005009 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0114066690 msgr2=0x7f0114068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:59.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.620+0000 7f013cc00640 1 --2- 172.21.15.55:0/2233005009 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0114066690 0x7f0114068b50 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f0128007fd0 tx=0x7f0128007d60 comp rx=0 tx=0).stop 2024-04-02T07:26:59.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.620+0000 7f013cc00640 1 -- 172.21.15.55:0/2233005009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f013815ad30 msgr2=0x7f01380cb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:59.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.620+0000 7f013cc00640 1 --2- 172.21.15.55:0/2233005009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f013815ad30 0x7f01380cb710 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f013001a500 tx=0x7f0130019670 comp rx=0 tx=0).stop 2024-04-02T07:26:59.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.620+0000 7f013cc00640 1 -- 172.21.15.55:0/2233005009 shutdown_connections 2024-04-02T07:26:59.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.620+0000 7f013cc00640 1 --2- 172.21.15.55:0/2233005009 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f013815ad30 0x7f01380cb710 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.620+0000 7f013cc00640 1 --2- 172.21.15.55:0/2233005009 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0114066690 0x7f0114068b50 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.620+0000 7f013cc00640 1 --2- 172.21.15.55:0/2233005009 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0138143f90 0x7f0138141da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.620+0000 7f013cc00640 1 --2- 172.21.15.55:0/2233005009 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01380cda80 0x7f01380c6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.620+0000 7f013cc00640 1 -- 172.21.15.55:0/2233005009 >> 172.21.15.55:0/2233005009 conn(0x7f0138066080 msgr2=0x7f013806c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:59.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.620+0000 7f013cc00640 1 -- 172.21.15.55:0/2233005009 shutdown_connections 2024-04-02T07:26:59.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.620+0000 7f013cc00640 1 -- 172.21.15.55:0/2233005009 wait complete. 2024-04-02T07:26:59.644 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-04-02T07:26:58.400791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248700,"kb_used_data":7956,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754726020,"statfs":{"total":773094113280,"available":772839444480,"internally_reserved":0,"allocated":8146944,"data_stored":4084849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":246402616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.297405"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.571713+0000","last_change":"2024-04-02T07:26:55.569759+0000","last_active":"2024-04-02T07:26:55.571713+0000","last_peered":"2024-04-02T07:26:55.571713+0000","last_clean":"2024-04-02T07:26:55.571713+0000","last_became_active":"2024-04-02T07:26:55.568889+0000","last_became_peered":"2024-04-02T07:26:55.568889+0000","last_unstale":"2024-04-02T07:26:55.571713+0000","last_undegraded":"2024-04-02T07:26:55.571713+0000","last_fullsized":"2024-04-02T07:26:55.571713+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:28:45.947477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.564241+0000","last_change":"2024-04-02T07:26:55.558556+0000","last_active":"2024-04-02T07:26:55.564241+0000","last_peered":"2024-04-02T07:26:55.564241+0000","last_clean":"2024-04-02T07:26:55.564241+0000","last_became_active":"2024-04-02T07:26:55.558074+0000","last_became_peered":"2024-04-02T07:26:55.558074+0000","last_unstale":"2024-04-02T07:26:55.564241+0000","last_undegraded":"2024-04-02T07:26:55.564241+0000","last_fullsized":"2024-04-02T07:26:55.564241+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:33:54.603553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.562447+0000","last_change":"2024-04-02T07:26:55.556387+0000","last_active":"2024-04-02T07:26:55.562447+0000","last_peered":"2024-04-02T07:26:55.562447+0000","last_clean":"2024-04-02T07:26:55.562447+0000","last_became_active":"2024-04-02T07:26:55.556071+0000","last_became_peered":"2024-04-02T07:26:55.556071+0000","last_unstale":"2024-04-02T07:26:55.562447+0000","last_undegraded":"2024-04-02T07:26:55.562447+0000","last_fullsized":"2024-04-02T07:26:55.562447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:42:38.173156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.558031+0000","last_change":"2024-04-02T07:26:55.553769+0000","last_active":"2024-04-02T07:26:55.558031+0000","last_peered":"2024-04-02T07:26:55.558031+0000","last_clean":"2024-04-02T07:26:55.558031+0000","last_became_active":"2024-04-02T07:26:55.553511+0000","last_became_peered":"2024-04-02T07:26:55.553511+0000","last_unstale":"2024-04-02T07:26:55.558031+0000","last_undegraded":"2024-04-02T07:26:55.558031+0000","last_fullsized":"2024-04-02T07:26:55.558031+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:12:56.952324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.561387+0000","last_change":"2024-04-02T07:26:55.559087+0000","last_active":"2024-04-02T07:26:55.561387+0000","last_peered":"2024-04-02T07:26:55.561387+0000","last_clean":"2024-04-02T07:26:55.561387+0000","last_became_active":"2024-04-02T07:26:55.557552+0000","last_became_peered":"2024-04-02T07:26:55.557552+0000","last_unstale":"2024-04-02T07:26:55.561387+0000","last_undegraded":"2024-04-02T07:26:55.561387+0000","last_fullsized":"2024-04-02T07:26:55.561387+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:06:46.852147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566305+0000","last_change":"2024-04-02T07:26:55.561489+0000","last_active":"2024-04-02T07:26:55.566305+0000","last_peered":"2024-04-02T07:26:55.566305+0000","last_clean":"2024-04-02T07:26:55.566305+0000","last_became_active":"2024-04-02T07:26:55.561022+0000","last_became_peered":"2024-04-02T07:26:55.561022+0000","last_unstale":"2024-04-02T07:26:55.566305+0000","last_undegraded":"2024-04-02T07:26:55.566305+0000","last_fullsized":"2024-04-02T07:26:55.566305+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:40:44.112650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566830+0000","last_change":"2024-04-02T07:26:55.555297+0000","last_active":"2024-04-02T07:26:55.566830+0000","last_peered":"2024-04-02T07:26:55.566830+0000","last_clean":"2024-04-02T07:26:55.566830+0000","last_became_active":"2024-04-02T07:26:55.555050+0000","last_became_peered":"2024-04-02T07:26:55.555050+0000","last_unstale":"2024-04-02T07:26:55.566830+0000","last_undegraded":"2024-04-02T07:26:55.566830+0000","last_fullsized":"2024-04-02T07:26:55.566830+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:46:06.244742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566771+0000","last_change":"2024-04-02T07:26:55.563146+0000","last_active":"2024-04-02T07:26:55.566771+0000","last_peered":"2024-04-02T07:26:55.566771+0000","last_clean":"2024-04-02T07:26:55.566771+0000","last_became_active":"2024-04-02T07:26:55.562833+0000","last_became_peered":"2024-04-02T07:26:55.562833+0000","last_unstale":"2024-04-02T07:26:55.566771+0000","last_undegraded":"2024-04-02T07:26:55.566771+0000","last_fullsized":"2024-04-02T07:26:55.566771+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:33:37.303936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.564035+0000","last_change":"2024-04-02T07:26:55.562198+0000","last_active":"2024-04-02T07:26:55.564035+0000","last_peered":"2024-04-02T07:26:55.564035+0000","last_clean":"2024-04-02T07:26:55.564035+0000","last_became_active":"2024-04-02T07:26:55.561625+0000","last_became_peered":"2024-04-02T07:26:55.561625+0000","last_unstale":"2024-04-02T07:26:55.564035+0000","last_undegraded":"2024-04-02T07:26:55.564035+0000","last_fullsized":"2024-04-02T07:26:55.564035+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:00:13.787059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.556558+0000","last_change":"2024-04-02T07:26:55.549628+0000","last_active":"2024-04-02T07:26:55.556558+0000","last_peered":"2024-04-02T07:26:55.556558+0000","last_clean":"2024-04-02T07:26:55.556558+0000","last_became_active":"2024-04-02T07:26:55.549351+0000","last_became_peered":"2024-04-02T07:26:55.549351+0000","last_unstale":"2024-04-02T07:26:55.556558+0000","last_undegraded":"2024-04-02T07:26:55.556558+0000","last_fullsized":"2024-04-02T07:26:55.556558+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:33:54.632716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.572362+0000","last_change":"2024-04-02T07:26:55.569793+0000","last_active":"2024-04-02T07:26:55.572362+0000","last_peered":"2024-04-02T07:26:55.572362+0000","last_clean":"2024-04-02T07:26:55.572362+0000","last_became_active":"2024-04-02T07:26:55.569106+0000","last_became_peered":"2024-04-02T07:26:55.569106+0000","last_unstale":"2024-04-02T07:26:55.572362+0000","last_undegraded":"2024-04-02T07:26:55.572362+0000","last_fullsized":"2024-04-02T07:26:55.572362+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:42:32.776650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.558048+0000","last_change":"2024-04-02T07:26:55.553729+0000","last_active":"2024-04-02T07:26:55.558048+0000","last_peered":"2024-04-02T07:26:55.558048+0000","last_clean":"2024-04-02T07:26:55.558048+0000","last_became_active":"2024-04-02T07:26:55.553032+0000","last_became_peered":"2024-04-02T07:26:55.553032+0000","last_unstale":"2024-04-02T07:26:55.558048+0000","last_undegraded":"2024-04-02T07:26:55.558048+0000","last_fullsized":"2024-04-02T07:26:55.558048+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:51:58.691640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.567376+0000","last_change":"2024-04-02T07:26:55.564722+0000","last_active":"2024-04-02T07:26:55.567376+0000","last_peered":"2024-04-02T07:26:55.567376+0000","last_clean":"2024-04-02T07:26:55.567376+0000","last_became_active":"2024-04-02T07:26:55.564470+0000","last_became_peered":"2024-04-02T07:26:55.564470+0000","last_unstale":"2024-04-02T07:26:55.567376+0000","last_undegraded":"2024-04-02T07:26:55.567376+0000","last_fullsized":"2024-04-02T07:26:55.567376+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:06:17.075180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.560609+0000","last_change":"2024-04-02T07:26:55.551729+0000","last_active":"2024-04-02T07:26:55.560609+0000","last_peered":"2024-04-02T07:26:55.560609+0000","last_clean":"2024-04-02T07:26:55.560609+0000","last_became_active":"2024-04-02T07:26:55.551370+0000","last_became_peered":"2024-04-02T07:26:55.551370+0000","last_unstale":"2024-04-02T07:26:55.560609+0000","last_undegraded":"2024-04-02T07:26:55.560609+0000","last_fullsized":"2024-04-02T07:26:55.560609+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:39:54.311803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.565609+0000","last_change":"2024-04-02T07:26:55.562811+0000","last_active":"2024-04-02T07:26:55.565609+0000","last_peered":"2024-04-02T07:26:55.565609+0000","last_clean":"2024-04-02T07:26:55.565609+0000","last_became_active":"2024-04-02T07:26:55.562352+0000","last_became_peered":"2024-04-02T07:26:55.562352+0000","last_unstale":"2024-04-02T07:26:55.565609+0000","last_undegraded":"2024-04-02T07:26:55.565609+0000","last_fullsized":"2024-04-02T07:26:55.565609+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:06:07.970840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.572444+0000","last_change":"2024-04-02T07:26:55.566384+0000","last_active":"2024-04-02T07:26:55.572444+0000","last_peered":"2024-04-02T07:26:55.572444+0000","last_clean":"2024-04-02T07:26:55.572444+0000","last_became_active":"2024-04-02T07:26:55.563318+0000","last_became_peered":"2024-04-02T07:26:55.563318+0000","last_unstale":"2024-04-02T07:26:55.572444+0000","last_undegraded":"2024-04-02T07:26:55.572444+0000","last_fullsized":"2024-04-02T07:26:55.572444+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:07:06.022343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.561783+0000","last_change":"2024-04-02T07:26:55.558198+0000","last_active":"2024-04-02T07:26:55.561783+0000","last_peered":"2024-04-02T07:26:55.561783+0000","last_clean":"2024-04-02T07:26:55.561783+0000","last_became_active":"2024-04-02T07:26:55.557961+0000","last_became_peered":"2024-04-02T07:26:55.557961+0000","last_unstale":"2024-04-02T07:26:55.561783+0000","last_undegraded":"2024-04-02T07:26:55.561783+0000","last_fullsized":"2024-04-02T07:26:55.561783+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:07:52.027218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.560477+0000","last_change":"2024-04-02T07:26:55.559171+0000","last_active":"2024-04-02T07:26:55.560477+0000","last_peered":"2024-04-02T07:26:55.560477+0000","last_clean":"2024-04-02T07:26:55.560477+0000","last_became_active":"2024-04-02T07:26:55.558906+0000","last_became_peered":"2024-04-02T07:26:55.558906+0000","last_unstale":"2024-04-02T07:26:55.560477+0000","last_undegraded":"2024-04-02T07:26:55.560477+0000","last_fullsized":"2024-04-02T07:26:55.560477+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:36:10.868785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.563585+0000","last_change":"2024-04-02T07:26:55.559175+0000","last_active":"2024-04-02T07:26:55.563585+0000","last_peered":"2024-04-02T07:26:55.563585+0000","last_clean":"2024-04-02T07:26:55.563585+0000","last_became_active":"2024-04-02T07:26:55.558838+0000","last_became_peered":"2024-04-02T07:26:55.558838+0000","last_unstale":"2024-04-02T07:26:55.563585+0000","last_undegraded":"2024-04-02T07:26:55.563585+0000","last_fullsized":"2024-04-02T07:26:55.563585+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:00:35.917054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.559775+0000","last_change":"2024-04-02T07:26:55.555096+0000","last_active":"2024-04-02T07:26:55.559775+0000","last_peered":"2024-04-02T07:26:55.559775+0000","last_clean":"2024-04-02T07:26:55.559775+0000","last_became_active":"2024-04-02T07:26:55.554866+0000","last_became_peered":"2024-04-02T07:26:55.554866+0000","last_unstale":"2024-04-02T07:26:55.559775+0000","last_undegraded":"2024-04-02T07:26:55.559775+0000","last_fullsized":"2024-04-02T07:26:55.559775+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:24:41.768841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566070+0000","last_change":"2024-04-02T07:26:55.556479+0000","last_active":"2024-04-02T07:26:55.566070+0000","last_peered":"2024-04-02T07:26:55.566070+0000","last_clean":"2024-04-02T07:26:55.566070+0000","last_became_active":"2024-04-02T07:26:55.556147+0000","last_became_peered":"2024-04-02T07:26:55.556147+0000","last_unstale":"2024-04-02T07:26:55.566070+0000","last_undegraded":"2024-04-02T07:26:55.566070+0000","last_fullsized":"2024-04-02T07:26:55.566070+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:00:35.917054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.567764+0000","last_change":"2024-04-02T07:26:55.559460+0000","last_active":"2024-04-02T07:26:55.567764+0000","last_peered":"2024-04-02T07:26:55.567764+0000","last_clean":"2024-04-02T07:26:55.567764+0000","last_became_active":"2024-04-02T07:26:55.559137+0000","last_became_peered":"2024-04-02T07:26:55.559137+0000","last_unstale":"2024-04-02T07:26:55.567764+0000","last_undegraded":"2024-04-02T07:26:55.567764+0000","last_fullsized":"2024-04-02T07:26:55.567764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:33:54.603553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.571670+0000","last_change":"2024-04-02T07:26:55.569593+0000","last_active":"2024-04-02T07:26:55.571670+0000","last_peered":"2024-04-02T07:26:55.571670+0000","last_clean":"2024-04-02T07:26:55.571670+0000","last_became_active":"2024-04-02T07:26:55.569118+0000","last_became_peered":"2024-04-02T07:26:55.569118+0000","last_unstale":"2024-04-02T07:26:55.571670+0000","last_undegraded":"2024-04-02T07:26:55.571670+0000","last_fullsized":"2024-04-02T07:26:55.571670+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:55:12.848274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.570811+0000","last_change":"2024-04-02T07:26:55.566234+0000","last_active":"2024-04-02T07:26:55.570811+0000","last_peered":"2024-04-02T07:26:55.570811+0000","last_clean":"2024-04-02T07:26:55.570811+0000","last_became_active":"2024-04-02T07:26:55.564231+0000","last_became_peered":"2024-04-02T07:26:55.564231+0000","last_unstale":"2024-04-02T07:26:55.570811+0000","last_undegraded":"2024-04-02T07:26:55.570811+0000","last_fullsized":"2024-04-02T07:26:55.570811+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:30.445895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566458+0000","last_change":"2024-04-02T07:26:55.555939+0000","last_active":"2024-04-02T07:26:55.566458+0000","last_peered":"2024-04-02T07:26:55.566458+0000","last_clean":"2024-04-02T07:26:55.566458+0000","last_became_active":"2024-04-02T07:26:55.554985+0000","last_became_peered":"2024-04-02T07:26:55.554985+0000","last_unstale":"2024-04-02T07:26:55.566458+0000","last_undegraded":"2024-04-02T07:26:55.566458+0000","last_fullsized":"2024-04-02T07:26:55.566458+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:40:44.112650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.568724+0000","last_change":"2024-04-02T07:26:55.562049+0000","last_active":"2024-04-02T07:26:55.568724+0000","last_peered":"2024-04-02T07:26:55.568724+0000","last_clean":"2024-04-02T07:26:55.568724+0000","last_became_active":"2024-04-02T07:26:55.561806+0000","last_became_peered":"2024-04-02T07:26:55.561806+0000","last_unstale":"2024-04-02T07:26:55.568724+0000","last_undegraded":"2024-04-02T07:26:55.568724+0000","last_fullsized":"2024-04-02T07:26:55.568724+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:24:41.768841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.562466+0000","last_change":"2024-04-02T07:26:55.557565+0000","last_active":"2024-04-02T07:26:55.562466+0000","last_peered":"2024-04-02T07:26:55.562466+0000","last_clean":"2024-04-02T07:26:55.562466+0000","last_became_active":"2024-04-02T07:26:55.556387+0000","last_became_peered":"2024-04-02T07:26:55.556387+0000","last_unstale":"2024-04-02T07:26:55.562466+0000","last_undegraded":"2024-04-02T07:26:55.562466+0000","last_fullsized":"2024-04-02T07:26:55.562466+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:36:23.479706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.567726+0000","last_change":"2024-04-02T07:26:55.559665+0000","last_active":"2024-04-02T07:26:55.567726+0000","last_peered":"2024-04-02T07:26:55.567726+0000","last_clean":"2024-04-02T07:26:55.567726+0000","last_became_active":"2024-04-02T07:26:55.559348+0000","last_became_peered":"2024-04-02T07:26:55.559348+0000","last_unstale":"2024-04-02T07:26:55.567726+0000","last_undegraded":"2024-04-02T07:26:55.567726+0000","last_fullsized":"2024-04-02T07:26:55.567726+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:08:46.605892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.561487+0000","last_change":"2024-04-02T07:26:55.547715+0000","last_active":"2024-04-02T07:26:55.561487+0000","last_peered":"2024-04-02T07:26:55.561487+0000","last_clean":"2024-04-02T07:26:55.561487+0000","last_became_active":"2024-04-02T07:26:55.547468+0000","last_became_peered":"2024-04-02T07:26:55.547468+0000","last_unstale":"2024-04-02T07:26:55.561487+0000","last_undegraded":"2024-04-02T07:26:55.561487+0000","last_fullsized":"2024-04-02T07:26:55.561487+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:46:03.101079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.573757+0000","last_change":"2024-04-02T07:26:55.571562+0000","last_active":"2024-04-02T07:26:55.573757+0000","last_peered":"2024-04-02T07:26:55.573757+0000","last_clean":"2024-04-02T07:26:55.573757+0000","last_became_active":"2024-04-02T07:26:55.567429+0000","last_became_peered":"2024-04-02T07:26:55.567429+0000","last_unstale":"2024-04-02T07:26:55.573757+0000","last_undegraded":"2024-04-02T07:26:55.573757+0000","last_fullsized":"2024-04-02T07:26:55.573757+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:33:05.922119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566851+0000","last_change":"2024-04-02T07:26:55.556990+0000","last_active":"2024-04-02T07:26:55.566851+0000","last_peered":"2024-04-02T07:26:55.566851+0000","last_clean":"2024-04-02T07:26:55.566851+0000","last_became_active":"2024-04-02T07:26:55.556754+0000","last_became_peered":"2024-04-02T07:26:55.556754+0000","last_unstale":"2024-04-02T07:26:55.566851+0000","last_undegraded":"2024-04-02T07:26:55.566851+0000","last_fullsized":"2024-04-02T07:26:55.566851+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:07:06.022343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.562112+0000","last_change":"2024-04-02T07:26:55.558327+0000","last_active":"2024-04-02T07:26:55.562112+0000","last_peered":"2024-04-02T07:26:55.562112+0000","last_clean":"2024-04-02T07:26:55.562112+0000","last_became_active":"2024-04-02T07:26:55.558008+0000","last_became_peered":"2024-04-02T07:26:55.558008+0000","last_unstale":"2024-04-02T07:26:55.562112+0000","last_undegraded":"2024-04-02T07:26:55.562112+0000","last_fullsized":"2024-04-02T07:26:55.562112+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:44:08.157369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.571571+0000","last_change":"2024-04-02T07:26:55.569415+0000","last_active":"2024-04-02T07:26:55.571571+0000","last_peered":"2024-04-02T07:26:55.571571+0000","last_clean":"2024-04-02T07:26:55.571571+0000","last_became_active":"2024-04-02T07:26:55.568725+0000","last_became_peered":"2024-04-02T07:26:55.568725+0000","last_unstale":"2024-04-02T07:26:55.571571+0000","last_undegraded":"2024-04-02T07:26:55.571571+0000","last_fullsized":"2024-04-02T07:26:55.571571+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:36:23.479706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.569158+0000","last_change":"2024-04-02T07:26:55.140943+0000","last_active":"2024-04-02T07:26:55.569158+0000","last_peered":"2024-04-02T07:26:55.569158+0000","last_clean":"2024-04-02T07:26:55.569158+0000","last_became_active":"2024-04-02T07:26:55.140641+0000","last_became_peered":"2024-04-02T07:26:55.140641+0000","last_unstale":"2024-04-02T07:26:55.569158+0000","last_undegraded":"2024-04-02T07:26:55.569158+0000","last_fullsized":"2024-04-02T07:26:55.569158+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:40:43.109858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566797+0000","last_change":"2024-04-02T07:26:55.562400+0000","last_active":"2024-04-02T07:26:55.566797+0000","last_peered":"2024-04-02T07:26:55.566797+0000","last_clean":"2024-04-02T07:26:55.566797+0000","last_became_active":"2024-04-02T07:26:55.561971+0000","last_became_peered":"2024-04-02T07:26:55.561971+0000","last_unstale":"2024-04-02T07:26:55.566797+0000","last_undegraded":"2024-04-02T07:26:55.566797+0000","last_fullsized":"2024-04-02T07:26:55.566797+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:43:03.581785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.561890+0000","last_change":"2024-04-02T07:26:55.139123+0000","last_active":"2024-04-02T07:26:55.561890+0000","last_peered":"2024-04-02T07:26:55.561890+0000","last_clean":"2024-04-02T07:26:55.561890+0000","last_became_active":"2024-04-02T07:26:55.138768+0000","last_became_peered":"2024-04-02T07:26:55.138768+0000","last_unstale":"2024-04-02T07:26:55.561890+0000","last_undegraded":"2024-04-02T07:26:55.561890+0000","last_fullsized":"2024-04-02T07:26:55.561890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:00:34.914262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.559951+0000","last_change":"2024-04-02T07:26:55.555325+0000","last_active":"2024-04-02T07:26:55.559951+0000","last_peered":"2024-04-02T07:26:55.559951+0000","last_clean":"2024-04-02T07:26:55.559951+0000","last_became_active":"2024-04-02T07:26:55.554995+0000","last_became_peered":"2024-04-02T07:26:55.554995+0000","last_unstale":"2024-04-02T07:26:55.559951+0000","last_undegraded":"2024-04-02T07:26:55.559951+0000","last_fullsized":"2024-04-02T07:26:55.559951+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:59:47.185971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.567841+0000","last_change":"2024-04-02T07:26:55.131778+0000","last_active":"2024-04-02T07:26:55.567841+0000","last_peered":"2024-04-02T07:26:55.567841+0000","last_clean":"2024-04-02T07:26:55.567841+0000","last_became_active":"2024-04-02T07:26:55.131492+0000","last_became_peered":"2024-04-02T07:26:55.131492+0000","last_unstale":"2024-04-02T07:26:55.567841+0000","last_undegraded":"2024-04-02T07:26:55.567841+0000","last_fullsized":"2024-04-02T07:26:55.567841+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:36:09.865994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.567217+0000","last_change":"2024-04-02T07:26:55.560809+0000","last_active":"2024-04-02T07:26:55.567217+0000","last_peered":"2024-04-02T07:26:55.567217+0000","last_clean":"2024-04-02T07:26:55.567217+0000","last_became_active":"2024-04-02T07:26:55.560527+0000","last_became_peered":"2024-04-02T07:26:55.560527+0000","last_unstale":"2024-04-02T07:26:55.567217+0000","last_undegraded":"2024-04-02T07:26:55.567217+0000","last_fullsized":"2024-04-02T07:26:55.567217+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:17:47.619696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.559136+0000","last_change":"2024-04-02T07:26:55.140927+0000","last_active":"2024-04-02T07:26:55.559136+0000","last_peered":"2024-04-02T07:26:55.559136+0000","last_clean":"2024-04-02T07:26:55.559136+0000","last_became_active":"2024-04-02T07:26:55.140600+0000","last_became_peered":"2024-04-02T07:26:55.140600+0000","last_unstale":"2024-04-02T07:26:55.559136+0000","last_undegraded":"2024-04-02T07:26:55.559136+0000","last_fullsized":"2024-04-02T07:26:55.559136+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:44:29.844247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.570372+0000","last_change":"2024-04-02T07:26:55.566588+0000","last_active":"2024-04-02T07:26:55.570372+0000","last_peered":"2024-04-02T07:26:55.570372+0000","last_clean":"2024-04-02T07:26:55.570372+0000","last_became_active":"2024-04-02T07:26:55.560256+0000","last_became_peered":"2024-04-02T07:26:55.560256+0000","last_unstale":"2024-04-02T07:26:55.570372+0000","last_undegraded":"2024-04-02T07:26:55.570372+0000","last_fullsized":"2024-04-02T07:26:55.570372+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:06:07.970840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.565960+0000","last_change":"2024-04-02T07:26:55.122131+0000","last_active":"2024-04-02T07:26:55.565960+0000","last_peered":"2024-04-02T07:26:55.565960+0000","last_clean":"2024-04-02T07:26:55.565960+0000","last_became_active":"2024-04-02T07:26:55.121661+0000","last_became_peered":"2024-04-02T07:26:55.121661+0000","last_unstale":"2024-04-02T07:26:55.565960+0000","last_undegraded":"2024-04-02T07:26:55.565960+0000","last_fullsized":"2024-04-02T07:26:55.565960+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:24:46.173824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566036+0000","last_change":"2024-04-02T07:26:55.555864+0000","last_active":"2024-04-02T07:26:55.566036+0000","last_peered":"2024-04-02T07:26:55.566036+0000","last_clean":"2024-04-02T07:26:55.566036+0000","last_became_active":"2024-04-02T07:26:55.555522+0000","last_became_peered":"2024-04-02T07:26:55.555522+0000","last_unstale":"2024-04-02T07:26:55.566036+0000","last_undegraded":"2024-04-02T07:26:55.566036+0000","last_fullsized":"2024-04-02T07:26:55.566036+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:03:24.285790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.564414+0000","last_change":"2024-04-02T07:26:55.142458+0000","last_active":"2024-04-02T07:26:55.564414+0000","last_peered":"2024-04-02T07:26:55.564414+0000","last_clean":"2024-04-02T07:26:55.564414+0000","last_became_active":"2024-04-02T07:26:55.142197+0000","last_became_peered":"2024-04-02T07:26:55.142197+0000","last_unstale":"2024-04-02T07:26:55.564414+0000","last_undegraded":"2024-04-02T07:26:55.564414+0000","last_fullsized":"2024-04-02T07:26:55.564414+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:35:01.659688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.559377+0000","last_change":"2024-04-02T07:26:55.555935+0000","last_active":"2024-04-02T07:26:55.559377+0000","last_peered":"2024-04-02T07:26:55.559377+0000","last_clean":"2024-04-02T07:26:55.559377+0000","last_became_active":"2024-04-02T07:26:55.555672+0000","last_became_peered":"2024-04-02T07:26:55.555672+0000","last_unstale":"2024-04-02T07:26:55.559377+0000","last_undegraded":"2024-04-02T07:26:55.559377+0000","last_fullsized":"2024-04-02T07:26:55.559377+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:46:35.449383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.538556+0000","last_change":"2024-04-02T07:26:55.126027+0000","last_active":"2024-04-02T07:26:55.538556+0000","last_peered":"2024-04-02T07:26:55.538556+0000","last_clean":"2024-04-02T07:26:55.538556+0000","last_became_active":"2024-04-02T07:26:55.125588+0000","last_became_peered":"2024-04-02T07:26:55.125588+0000","last_unstale":"2024-04-02T07:26:55.538556+0000","last_undegraded":"2024-04-02T07:26:55.538556+0000","last_fullsized":"2024-04-02T07:26:55.538556+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:43:02.578994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.559711+0000","last_change":"2024-04-02T07:26:55.554587+0000","last_active":"2024-04-02T07:26:55.559711+0000","last_peered":"2024-04-02T07:26:55.559711+0000","last_clean":"2024-04-02T07:26:55.559711+0000","last_became_active":"2024-04-02T07:26:55.554351+0000","last_became_peered":"2024-04-02T07:26:55.554351+0000","last_unstale":"2024-04-02T07:26:55.559711+0000","last_undegraded":"2024-04-02T07:26:55.559711+0000","last_fullsized":"2024-04-02T07:26:55.559711+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:33:17.008424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.545179+0000","last_change":"2024-04-02T07:26:55.134187+0000","last_active":"2024-04-02T07:26:55.545179+0000","last_peered":"2024-04-02T07:26:55.545179+0000","last_clean":"2024-04-02T07:26:55.545179+0000","last_became_active":"2024-04-02T07:26:55.133763+0000","last_became_peered":"2024-04-02T07:26:55.133763+0000","last_unstale":"2024-04-02T07:26:55.545179+0000","last_undegraded":"2024-04-02T07:26:55.545179+0000","last_fullsized":"2024-04-02T07:26:55.545179+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:09:36.184976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.568704+0000","last_change":"2024-04-02T07:26:55.559549+0000","last_active":"2024-04-02T07:26:55.568704+0000","last_peered":"2024-04-02T07:26:55.568704+0000","last_clean":"2024-04-02T07:26:55.568704+0000","last_became_active":"2024-04-02T07:26:55.559283+0000","last_became_peered":"2024-04-02T07:26:55.559283+0000","last_unstale":"2024-04-02T07:26:55.568704+0000","last_undegraded":"2024-04-02T07:26:55.568704+0000","last_fullsized":"2024-04-02T07:26:55.568704+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:40:44.112650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.537621+0000","last_change":"2024-04-02T07:26:55.121970+0000","last_active":"2024-04-02T07:26:55.537621+0000","last_peered":"2024-04-02T07:26:55.537621+0000","last_clean":"2024-04-02T07:26:55.537621+0000","last_became_active":"2024-04-02T07:26:55.121381+0000","last_became_peered":"2024-04-02T07:26:55.121381+0000","last_unstale":"2024-04-02T07:26:55.537621+0000","last_undegraded":"2024-04-02T07:26:55.537621+0000","last_fullsized":"2024-04-02T07:26:55.537621+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:20:16.244811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.571732+0000","last_change":"2024-04-02T07:26:55.569973+0000","last_active":"2024-04-02T07:26:55.571732+0000","last_peered":"2024-04-02T07:26:55.571732+0000","last_clean":"2024-04-02T07:26:55.571732+0000","last_became_active":"2024-04-02T07:26:55.569488+0000","last_became_peered":"2024-04-02T07:26:55.569488+0000","last_unstale":"2024-04-02T07:26:55.571732+0000","last_undegraded":"2024-04-02T07:26:55.571732+0000","last_fullsized":"2024-04-02T07:26:55.571732+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:25.905083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.544859+0000","last_change":"2024-04-02T07:26:55.132553+0000","last_active":"2024-04-02T07:26:55.544859+0000","last_peered":"2024-04-02T07:26:55.544859+0000","last_clean":"2024-04-02T07:26:55.544859+0000","last_became_active":"2024-04-02T07:26:55.131895+0000","last_became_peered":"2024-04-02T07:26:55.131895+0000","last_unstale":"2024-04-02T07:26:55.544859+0000","last_undegraded":"2024-04-02T07:26:55.544859+0000","last_fullsized":"2024-04-02T07:26:55.544859+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:51:57.688849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566564+0000","last_change":"2024-04-02T07:26:55.562073+0000","last_active":"2024-04-02T07:26:55.566564+0000","last_peered":"2024-04-02T07:26:55.566564+0000","last_clean":"2024-04-02T07:26:55.566564+0000","last_became_active":"2024-04-02T07:26:55.561826+0000","last_became_peered":"2024-04-02T07:26:55.561826+0000","last_unstale":"2024-04-02T07:26:55.566564+0000","last_undegraded":"2024-04-02T07:26:55.566564+0000","last_fullsized":"2024-04-02T07:26:55.566564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:49:45.785181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.563188+0000","last_change":"2024-04-02T07:26:55.129033+0000","last_active":"2024-04-02T07:26:55.563188+0000","last_peered":"2024-04-02T07:26:55.563188+0000","last_clean":"2024-04-02T07:26:55.563188+0000","last_became_active":"2024-04-02T07:26:55.128756+0000","last_became_peered":"2024-04-02T07:26:55.128756+0000","last_unstale":"2024-04-02T07:26:55.563188+0000","last_undegraded":"2024-04-02T07:26:55.563188+0000","last_fullsized":"2024-04-02T07:26:55.563188+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:33:16.005633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.557142+0000","last_change":"2024-04-02T07:26:55.553378+0000","last_active":"2024-04-02T07:26:55.557142+0000","last_peered":"2024-04-02T07:26:55.557142+0000","last_clean":"2024-04-02T07:26:55.557142+0000","last_became_active":"2024-04-02T07:26:55.552510+0000","last_became_peered":"2024-04-02T07:26:55.552510+0000","last_unstale":"2024-04-02T07:26:55.557142+0000","last_undegraded":"2024-04-02T07:26:55.557142+0000","last_fullsized":"2024-04-02T07:26:55.557142+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:10:01.053910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"71'6","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.569402+0000","last_change":"2024-04-02T07:26:55.135420+0000","last_active":"2024-04-02T07:26:55.569402+0000","last_peered":"2024-04-02T07:26:55.569402+0000","last_clean":"2024-04-02T07:26:55.569402+0000","last_became_active":"2024-04-02T07:26:55.134895+0000","last_became_peered":"2024-04-02T07:26:55.134895+0000","last_unstale":"2024-04-02T07:26:55.569402+0000","last_undegraded":"2024-04-02T07:26:55.569402+0000","last_fullsized":"2024-04-02T07:26:55.569402+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:07:51.024426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.567542+0000","last_change":"2024-04-02T07:26:55.563205+0000","last_active":"2024-04-02T07:26:55.567542+0000","last_peered":"2024-04-02T07:26:55.567542+0000","last_clean":"2024-04-02T07:26:55.567542+0000","last_became_active":"2024-04-02T07:26:55.562951+0000","last_became_peered":"2024-04-02T07:26:55.562951+0000","last_unstale":"2024-04-02T07:26:55.567542+0000","last_undegraded":"2024-04-02T07:26:55.567542+0000","last_fullsized":"2024-04-02T07:26:55.567542+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:35:54.923733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.563841+0000","last_change":"2024-04-02T07:26:55.129263+0000","last_active":"2024-04-02T07:26:55.563841+0000","last_peered":"2024-04-02T07:26:55.563841+0000","last_clean":"2024-04-02T07:26:55.563841+0000","last_became_active":"2024-04-02T07:26:55.128943+0000","last_became_peered":"2024-04-02T07:26:55.128943+0000","last_unstale":"2024-04-02T07:26:55.563841+0000","last_undegraded":"2024-04-02T07:26:55.563841+0000","last_fullsized":"2024-04-02T07:26:55.563841+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:11:02.945262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566447+0000","last_change":"2024-04-02T07:26:55.554753+0000","last_active":"2024-04-02T07:26:55.566447+0000","last_peered":"2024-04-02T07:26:55.566447+0000","last_clean":"2024-04-02T07:26:55.566447+0000","last_became_active":"2024-04-02T07:26:55.554466+0000","last_became_peered":"2024-04-02T07:26:55.554466+0000","last_unstale":"2024-04-02T07:26:55.566447+0000","last_undegraded":"2024-04-02T07:26:55.566447+0000","last_fullsized":"2024-04-02T07:26:55.566447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:03:24.285790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.543693+0000","last_change":"2024-04-02T07:26:55.140635+0000","last_active":"2024-04-02T07:26:55.543693+0000","last_peered":"2024-04-02T07:26:55.543693+0000","last_clean":"2024-04-02T07:26:55.543693+0000","last_became_active":"2024-04-02T07:26:55.140327+0000","last_became_peered":"2024-04-02T07:26:55.140327+0000","last_unstale":"2024-04-02T07:26:55.543693+0000","last_undegraded":"2024-04-02T07:26:55.543693+0000","last_fullsized":"2024-04-02T07:26:55.543693+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:56:23.779984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.567342+0000","last_change":"2024-04-02T07:26:55.564555+0000","last_active":"2024-04-02T07:26:55.567342+0000","last_peered":"2024-04-02T07:26:55.567342+0000","last_clean":"2024-04-02T07:26:55.567342+0000","last_became_active":"2024-04-02T07:26:55.564294+0000","last_became_peered":"2024-04-02T07:26:55.564294+0000","last_unstale":"2024-04-02T07:26:55.567342+0000","last_undegraded":"2024-04-02T07:26:55.567342+0000","last_fullsized":"2024-04-02T07:26:55.567342+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:24:47.176616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.544658+0000","last_change":"2024-04-02T07:26:55.141789+0000","last_active":"2024-04-02T07:26:55.544658+0000","last_peered":"2024-04-02T07:26:55.544658+0000","last_clean":"2024-04-02T07:26:55.544658+0000","last_became_active":"2024-04-02T07:26:55.141470+0000","last_became_peered":"2024-04-02T07:26:55.141470+0000","last_unstale":"2024-04-02T07:26:55.544658+0000","last_undegraded":"2024-04-02T07:26:55.544658+0000","last_fullsized":"2024-04-02T07:26:55.544658+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:23:01.660123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.561272+0000","last_change":"2024-04-02T07:26:55.558676+0000","last_active":"2024-04-02T07:26:55.561272+0000","last_peered":"2024-04-02T07:26:55.561272+0000","last_clean":"2024-04-02T07:26:55.561272+0000","last_became_active":"2024-04-02T07:26:55.558443+0000","last_became_peered":"2024-04-02T07:26:55.558443+0000","last_unstale":"2024-04-02T07:26:55.561272+0000","last_undegraded":"2024-04-02T07:26:55.561272+0000","last_fullsized":"2024-04-02T07:26:55.561272+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:44:48.005855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.572394+0000","last_change":"2024-04-02T07:26:55.133669+0000","last_active":"2024-04-02T07:26:55.572394+0000","last_peered":"2024-04-02T07:26:55.572394+0000","last_clean":"2024-04-02T07:26:55.572394+0000","last_became_active":"2024-04-02T07:26:55.133420+0000","last_became_peered":"2024-04-02T07:26:55.133420+0000","last_unstale":"2024-04-02T07:26:55.572394+0000","last_undegraded":"2024-04-02T07:26:55.572394+0000","last_fullsized":"2024-04-02T07:26:55.572394+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:38:24.642284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.556578+0000","last_change":"2024-04-02T07:26:55.550003+0000","last_active":"2024-04-02T07:26:55.556578+0000","last_peered":"2024-04-02T07:26:55.556578+0000","last_clean":"2024-04-02T07:26:55.556578+0000","last_became_active":"2024-04-02T07:26:55.549113+0000","last_became_peered":"2024-04-02T07:26:55.549113+0000","last_unstale":"2024-04-02T07:26:55.556578+0000","last_undegraded":"2024-04-02T07:26:55.556578+0000","last_fullsized":"2024-04-02T07:26:55.556578+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:49:45.785181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.565717+0000","last_change":"2024-04-02T07:26:55.136973+0000","last_active":"2024-04-02T07:26:55.565717+0000","last_peered":"2024-04-02T07:26:55.565717+0000","last_clean":"2024-04-02T07:26:55.565717+0000","last_became_active":"2024-04-02T07:26:55.136699+0000","last_became_peered":"2024-04-02T07:26:55.136699+0000","last_unstale":"2024-04-02T07:26:55.565717+0000","last_undegraded":"2024-04-02T07:26:55.565717+0000","last_fullsized":"2024-04-02T07:26:55.565717+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:45:33.303503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.569248+0000","last_change":"2024-04-02T07:26:55.562959+0000","last_active":"2024-04-02T07:26:55.569248+0000","last_peered":"2024-04-02T07:26:55.569248+0000","last_clean":"2024-04-02T07:26:55.569248+0000","last_became_active":"2024-04-02T07:26:55.562267+0000","last_became_peered":"2024-04-02T07:26:55.562267+0000","last_unstale":"2024-04-02T07:26:55.569248+0000","last_undegraded":"2024-04-02T07:26:55.569248+0000","last_fullsized":"2024-04-02T07:26:55.569248+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:06:17.075180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.570772+0000","last_change":"2024-04-02T07:26:55.132776+0000","last_active":"2024-04-02T07:26:55.570772+0000","last_peered":"2024-04-02T07:26:55.570772+0000","last_clean":"2024-04-02T07:26:55.570772+0000","last_became_active":"2024-04-02T07:26:55.132477+0000","last_became_peered":"2024-04-02T07:26:55.132477+0000","last_unstale":"2024-04-02T07:26:55.570772+0000","last_undegraded":"2024-04-02T07:26:55.570772+0000","last_fullsized":"2024-04-02T07:26:55.570772+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:51:57.688849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.558012+0000","last_change":"2024-04-02T07:26:55.553061+0000","last_active":"2024-04-02T07:26:55.558012+0000","last_peered":"2024-04-02T07:26:55.558012+0000","last_clean":"2024-04-02T07:26:55.558012+0000","last_became_active":"2024-04-02T07:26:55.552611+0000","last_became_peered":"2024-04-02T07:26:55.552611+0000","last_unstale":"2024-04-02T07:26:55.558012+0000","last_undegraded":"2024-04-02T07:26:55.558012+0000","last_fullsized":"2024-04-02T07:26:55.558012+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:45:34.306295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.567636+0000","last_change":"2024-04-02T07:26:55.135245+0000","last_active":"2024-04-02T07:26:55.567636+0000","last_peered":"2024-04-02T07:26:55.567636+0000","last_clean":"2024-04-02T07:26:55.567636+0000","last_became_active":"2024-04-02T07:26:55.134878+0000","last_became_peered":"2024-04-02T07:26:55.134878+0000","last_unstale":"2024-04-02T07:26:55.567636+0000","last_undegraded":"2024-04-02T07:26:55.567636+0000","last_fullsized":"2024-04-02T07:26:55.567636+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:00:05.487395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.557162+0000","last_change":"2024-04-02T07:26:55.553419+0000","last_active":"2024-04-02T07:26:55.557162+0000","last_peered":"2024-04-02T07:26:55.557162+0000","last_clean":"2024-04-02T07:26:55.557162+0000","last_became_active":"2024-04-02T07:26:55.553192+0000","last_became_peered":"2024-04-02T07:26:55.553192+0000","last_unstale":"2024-04-02T07:26:55.557162+0000","last_undegraded":"2024-04-02T07:26:55.557162+0000","last_fullsized":"2024-04-02T07:26:55.557162+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:18:41.669297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.550607+0000","last_change":"2024-04-02T07:26:55.134447+0000","last_active":"2024-04-02T07:26:55.550607+0000","last_peered":"2024-04-02T07:26:55.550607+0000","last_clean":"2024-04-02T07:26:55.550607+0000","last_became_active":"2024-04-02T07:26:55.134135+0000","last_became_peered":"2024-04-02T07:26:55.134135+0000","last_unstale":"2024-04-02T07:26:55.550607+0000","last_undegraded":"2024-04-02T07:26:55.550607+0000","last_fullsized":"2024-04-02T07:26:55.550607+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:49:44.782390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.561506+0000","last_change":"2024-04-02T07:26:55.547872+0000","last_active":"2024-04-02T07:26:55.561506+0000","last_peered":"2024-04-02T07:26:55.561506+0000","last_clean":"2024-04-02T07:26:55.561506+0000","last_became_active":"2024-04-02T07:26:55.547607+0000","last_became_peered":"2024-04-02T07:26:55.547607+0000","last_unstale":"2024-04-02T07:26:55.561506+0000","last_undegraded":"2024-04-02T07:26:55.561506+0000","last_fullsized":"2024-04-02T07:26:55.561506+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:30.445895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.543810+0000","last_change":"2024-04-02T07:26:55.143130+0000","last_active":"2024-04-02T07:26:55.543810+0000","last_peered":"2024-04-02T07:26:55.543810+0000","last_clean":"2024-04-02T07:26:55.543810+0000","last_became_active":"2024-04-02T07:26:55.142936+0000","last_became_peered":"2024-04-02T07:26:55.142936+0000","last_unstale":"2024-04-02T07:26:55.543810+0000","last_undegraded":"2024-04-02T07:26:55.543810+0000","last_fullsized":"2024-04-02T07:26:55.543810+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:46:55.823866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.562169+0000","last_change":"2024-04-02T07:26:55.555468+0000","last_active":"2024-04-02T07:26:55.562169+0000","last_peered":"2024-04-02T07:26:55.562169+0000","last_clean":"2024-04-02T07:26:55.562169+0000","last_became_active":"2024-04-02T07:26:55.554565+0000","last_became_peered":"2024-04-02T07:26:55.554565+0000","last_unstale":"2024-04-02T07:26:55.562169+0000","last_undegraded":"2024-04-02T07:26:55.562169+0000","last_fullsized":"2024-04-02T07:26:55.562169+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:25.905083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.544769+0000","last_change":"2024-04-02T07:26:55.135999+0000","last_active":"2024-04-02T07:26:55.544769+0000","last_peered":"2024-04-02T07:26:55.544769+0000","last_clean":"2024-04-02T07:26:55.544769+0000","last_became_active":"2024-04-02T07:26:55.135604+0000","last_became_peered":"2024-04-02T07:26:55.135604+0000","last_unstale":"2024-04-02T07:26:55.544769+0000","last_undegraded":"2024-04-02T07:26:55.544769+0000","last_fullsized":"2024-04-02T07:26:55.544769+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:44:07.154577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.562426+0000","last_change":"2024-04-02T07:26:55.556726+0000","last_active":"2024-04-02T07:26:55.562426+0000","last_peered":"2024-04-02T07:26:55.562426+0000","last_clean":"2024-04-02T07:26:55.562426+0000","last_became_active":"2024-04-02T07:26:55.556466+0000","last_became_peered":"2024-04-02T07:26:55.556466+0000","last_unstale":"2024-04-02T07:26:55.562426+0000","last_undegraded":"2024-04-02T07:26:55.562426+0000","last_fullsized":"2024-04-02T07:26:55.562426+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:39:20.897683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.544137+0000","last_change":"2024-04-02T07:26:55.135780+0000","last_active":"2024-04-02T07:26:55.544137+0000","last_peered":"2024-04-02T07:26:55.544137+0000","last_clean":"2024-04-02T07:26:55.544137+0000","last_became_active":"2024-04-02T07:26:55.135458+0000","last_became_peered":"2024-04-02T07:26:55.135458+0000","last_unstale":"2024-04-02T07:26:55.544137+0000","last_undegraded":"2024-04-02T07:26:55.544137+0000","last_fullsized":"2024-04-02T07:26:55.544137+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:33:36.301144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.565512+0000","last_change":"2024-04-02T07:26:55.563785+0000","last_active":"2024-04-02T07:26:55.565512+0000","last_peered":"2024-04-02T07:26:55.565512+0000","last_clean":"2024-04-02T07:26:55.565512+0000","last_became_active":"2024-04-02T07:26:55.563540+0000","last_became_peered":"2024-04-02T07:26:55.563540+0000","last_unstale":"2024-04-02T07:26:55.565512+0000","last_undegraded":"2024-04-02T07:26:55.565512+0000","last_fullsized":"2024-04-02T07:26:55.565512+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:41:13.484059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566079+0000","last_change":"2024-04-02T07:26:55.136738+0000","last_active":"2024-04-02T07:26:55.566079+0000","last_peered":"2024-04-02T07:26:55.566079+0000","last_clean":"2024-04-02T07:26:55.566079+0000","last_became_active":"2024-04-02T07:26:55.136361+0000","last_became_peered":"2024-04-02T07:26:55.136361+0000","last_unstale":"2024-04-02T07:26:55.566079+0000","last_undegraded":"2024-04-02T07:26:55.566079+0000","last_fullsized":"2024-04-02T07:26:55.566079+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:35:29.337331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.565576+0000","last_change":"2024-04-02T07:26:55.555964+0000","last_active":"2024-04-02T07:26:55.565576+0000","last_peered":"2024-04-02T07:26:55.565576+0000","last_clean":"2024-04-02T07:26:55.565576+0000","last_became_active":"2024-04-02T07:26:55.555711+0000","last_became_peered":"2024-04-02T07:26:55.555711+0000","last_unstale":"2024-04-02T07:26:55.565576+0000","last_undegraded":"2024-04-02T07:26:55.565576+0000","last_fullsized":"2024-04-02T07:26:55.565576+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:08:46.605892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.545357+0000","last_change":"2024-04-02T07:26:55.142193+0000","last_active":"2024-04-02T07:26:55.545357+0000","last_peered":"2024-04-02T07:26:55.545357+0000","last_clean":"2024-04-02T07:26:55.545357+0000","last_became_active":"2024-04-02T07:26:55.141075+0000","last_became_peered":"2024-04-02T07:26:55.141075+0000","last_unstale":"2024-04-02T07:26:55.545357+0000","last_undegraded":"2024-04-02T07:26:55.545357+0000","last_fullsized":"2024-04-02T07:26:55.545357+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:10:38.596186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.570217+0000","last_change":"2024-04-02T07:26:55.564048+0000","last_active":"2024-04-02T07:26:55.570217+0000","last_peered":"2024-04-02T07:26:55.570217+0000","last_clean":"2024-04-02T07:26:55.570217+0000","last_became_active":"2024-04-02T07:26:55.563596+0000","last_became_peered":"2024-04-02T07:26:55.563596+0000","last_unstale":"2024-04-02T07:26:55.570217+0000","last_undegraded":"2024-04-02T07:26:55.570217+0000","last_fullsized":"2024-04-02T07:26:55.570217+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:40:15.917351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.545762+0000","last_change":"2024-04-02T07:26:55.140142+0000","last_active":"2024-04-02T07:26:55.545762+0000","last_peered":"2024-04-02T07:26:55.545762+0000","last_clean":"2024-04-02T07:26:55.545762+0000","last_became_active":"2024-04-02T07:26:55.139839+0000","last_became_peered":"2024-04-02T07:26:55.139839+0000","last_unstale":"2024-04-02T07:26:55.545762+0000","last_undegraded":"2024-04-02T07:26:55.545762+0000","last_fullsized":"2024-04-02T07:26:55.545762+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:17:53.590832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.572381+0000","last_change":"2024-04-02T07:26:55.570038+0000","last_active":"2024-04-02T07:26:55.572381+0000","last_peered":"2024-04-02T07:26:55.572381+0000","last_clean":"2024-04-02T07:26:55.572381+0000","last_became_active":"2024-04-02T07:26:55.569519+0000","last_became_peered":"2024-04-02T07:26:55.569519+0000","last_unstale":"2024-04-02T07:26:55.572381+0000","last_undegraded":"2024-04-02T07:26:55.572381+0000","last_fullsized":"2024-04-02T07:26:55.572381+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:10:49.028400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.544675+0000","last_change":"2024-04-02T07:26:55.133763+0000","last_active":"2024-04-02T07:26:55.544675+0000","last_peered":"2024-04-02T07:26:55.544675+0000","last_clean":"2024-04-02T07:26:55.544675+0000","last_became_active":"2024-04-02T07:26:55.133498+0000","last_became_peered":"2024-04-02T07:26:55.133498+0000","last_unstale":"2024-04-02T07:26:55.544675+0000","last_undegraded":"2024-04-02T07:26:55.544675+0000","last_fullsized":"2024-04-02T07:26:55.544675+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:59:46.183180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.563973+0000","last_change":"2024-04-02T07:26:55.560488+0000","last_active":"2024-04-02T07:26:55.563973+0000","last_peered":"2024-04-02T07:26:55.563973+0000","last_clean":"2024-04-02T07:26:55.563973+0000","last_became_active":"2024-04-02T07:26:55.560203+0000","last_became_peered":"2024-04-02T07:26:55.560203+0000","last_unstale":"2024-04-02T07:26:55.563973+0000","last_undegraded":"2024-04-02T07:26:55.563973+0000","last_fullsized":"2024-04-02T07:26:55.563973+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:29:34.917878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.545385+0000","last_change":"2024-04-02T07:26:55.130331+0000","last_active":"2024-04-02T07:26:55.545385+0000","last_peered":"2024-04-02T07:26:55.545385+0000","last_clean":"2024-04-02T07:26:55.545385+0000","last_became_active":"2024-04-02T07:26:55.129988+0000","last_became_peered":"2024-04-02T07:26:55.129988+0000","last_unstale":"2024-04-02T07:26:55.545385+0000","last_undegraded":"2024-04-02T07:26:55.545385+0000","last_fullsized":"2024-04-02T07:26:55.545385+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:05:20.023359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.570981+0000","last_change":"2024-04-02T07:26:55.567697+0000","last_active":"2024-04-02T07:26:55.570981+0000","last_peered":"2024-04-02T07:26:55.570981+0000","last_clean":"2024-04-02T07:26:55.570981+0000","last_became_active":"2024-04-02T07:26:55.564797+0000","last_became_peered":"2024-04-02T07:26:55.564797+0000","last_unstale":"2024-04-02T07:26:55.570981+0000","last_undegraded":"2024-04-02T07:26:55.570981+0000","last_fullsized":"2024-04-02T07:26:55.570981+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:42:43.011738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.538613+0000","last_change":"2024-04-02T07:26:55.124379+0000","last_active":"2024-04-02T07:26:55.538613+0000","last_peered":"2024-04-02T07:26:55.538613+0000","last_clean":"2024-04-02T07:26:55.538613+0000","last_became_active":"2024-04-02T07:26:55.122838+0000","last_became_peered":"2024-04-02T07:26:55.122838+0000","last_unstale":"2024-04-02T07:26:55.538613+0000","last_undegraded":"2024-04-02T07:26:55.538613+0000","last_fullsized":"2024-04-02T07:26:55.538613+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:00:12.784268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.555476+0000","last_change":"2024-04-02T07:26:55.548084+0000","last_active":"2024-04-02T07:26:55.555476+0000","last_peered":"2024-04-02T07:26:55.555476+0000","last_clean":"2024-04-02T07:26:55.555476+0000","last_became_active":"2024-04-02T07:26:55.547740+0000","last_became_peered":"2024-04-02T07:26:55.547740+0000","last_unstale":"2024-04-02T07:26:55.555476+0000","last_undegraded":"2024-04-02T07:26:55.555476+0000","last_fullsized":"2024-04-02T07:26:55.555476+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:35:30.340123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.537121+0000","last_change":"2024-04-02T07:26:55.134207+0000","last_active":"2024-04-02T07:26:55.537121+0000","last_peered":"2024-04-02T07:26:55.537121+0000","last_clean":"2024-04-02T07:26:55.537121+0000","last_became_active":"2024-04-02T07:26:55.133870+0000","last_became_peered":"2024-04-02T07:26:55.133870+0000","last_unstale":"2024-04-02T07:26:55.537121+0000","last_undegraded":"2024-04-02T07:26:55.537121+0000","last_fullsized":"2024-04-02T07:26:55.537121+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:12:55.949533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.570152+0000","last_change":"2024-04-02T07:26:55.565711+0000","last_active":"2024-04-02T07:26:55.570152+0000","last_peered":"2024-04-02T07:26:55.570152+0000","last_clean":"2024-04-02T07:26:55.570152+0000","last_became_active":"2024-04-02T07:26:55.565306+0000","last_became_peered":"2024-04-02T07:26:55.565306+0000","last_unstale":"2024-04-02T07:26:55.570152+0000","last_undegraded":"2024-04-02T07:26:55.570152+0000","last_fullsized":"2024-04-02T07:26:55.570152+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:53:45.552348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.546158+0000","last_change":"2024-04-02T07:26:55.142287+0000","last_active":"2024-04-02T07:26:55.546158+0000","last_peered":"2024-04-02T07:26:55.546158+0000","last_clean":"2024-04-02T07:26:55.546158+0000","last_became_active":"2024-04-02T07:26:55.141836+0000","last_became_peered":"2024-04-02T07:26:55.141836+0000","last_unstale":"2024-04-02T07:26:55.546158+0000","last_undegraded":"2024-04-02T07:26:55.546158+0000","last_fullsized":"2024-04-02T07:26:55.546158+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:04:13.736619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.567289+0000","last_change":"2024-04-02T07:26:55.563372+0000","last_active":"2024-04-02T07:26:55.567289+0000","last_peered":"2024-04-02T07:26:55.567289+0000","last_clean":"2024-04-02T07:26:55.567289+0000","last_became_active":"2024-04-02T07:26:55.561047+0000","last_became_peered":"2024-04-02T07:26:55.561047+0000","last_unstale":"2024-04-02T07:26:55.567289+0000","last_undegraded":"2024-04-02T07:26:55.567289+0000","last_fullsized":"2024-04-02T07:26:55.567289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:52:11.390884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.560559+0000","last_change":"2024-04-02T07:26:55.140819+0000","last_active":"2024-04-02T07:26:55.560559+0000","last_peered":"2024-04-02T07:26:55.560559+0000","last_clean":"2024-04-02T07:26:55.560559+0000","last_became_active":"2024-04-02T07:26:55.140500+0000","last_became_peered":"2024-04-02T07:26:55.140500+0000","last_unstale":"2024-04-02T07:26:55.560559+0000","last_undegraded":"2024-04-02T07:26:55.560559+0000","last_fullsized":"2024-04-02T07:26:55.560559+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:56:35.734077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":209,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.126730+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:26:55.126730+0000","last_peered":"2024-04-02T07:26:55.126730+0000","last_clean":"2024-04-02T07:26:55.126730+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:26:55.126730+0000","last_undegraded":"2024-04-02T07:26:55.126730+0000","last_fullsized":"2024-04-02T07:26:55.126730+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1466368,"data_stored":954266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.65800000000000003,"15min":0.64600000000000002},"min":{"1min":0.47699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92200000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.64800000000000002,"15min":0.61099999999999999},"min":{"1min":0.47499999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83999999999999997,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.748}]},{"osd":1,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64800000000000002,"15min":0.63},"min":{"1min":0.49199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.89200000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.67500000000000004,"15min":0.65800000000000003},"min":{"1min":0.496,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95899999999999996,"5min":1.113,"15min":1.113},"last":0.625}]},{"osd":2,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.752,"15min":0.752},"min":{"1min":0.53900000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.97699999999999998,"5min":1.139,"15min":1.139},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.52600000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96499999999999997,"5min":1.522,"15min":1.522},"last":0.69399999999999995}]},{"osd":3,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70799999999999996,"15min":0.70299999999999996},"min":{"1min":0.52400000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89100000000000001,"5min":1.405,"15min":1.405},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72299999999999998,"15min":0.72699999999999998},"min":{"1min":0.52800000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98099999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.66400000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65000000000000002,"15min":0.68999999999999995},"min":{"1min":0.441,"5min":0.377,"15min":0.377},"max":{"1min":0.83199999999999996,"5min":1.633,"15min":1.633},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70299999999999996,"15min":0.73899999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.78800000000000003,"5min":1.079,"15min":1.079},"last":0.73299999999999998}]},{"osd":5,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.67500000000000004,"15min":0.72499999999999998},"min":{"1min":0.41799999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85999999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.73999999999999999,"15min":0.78400000000000003},"min":{"1min":0.435,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.89900000000000002,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.86699999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.68999999999999995,"15min":0.73299999999999998},"min":{"1min":0.46200000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.876,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.65800000000000003,"15min":0.70199999999999996},"min":{"1min":0.42799999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80900000000000005,"5min":1,"15min":1},"last":0.77200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":356507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.443,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88100000000000001,"5min":1.399,"15min":1.399},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.77400000000000002,"15min":0.88400000000000001},"min":{"1min":0.50800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89600000000000002,"5min":5.7569999999999997,"15min":5.7569999999999997},"last":0.82199999999999995}]},{"osd":1,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91600000000000004,"5min":1.95,"15min":1.95},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.48999999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97599999999999998,"5min":1.248,"15min":1.248},"last":0.752}]},{"osd":2,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66800000000000004,"15min":0.68899999999999995},"min":{"1min":0.499,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93000000000000005,"5min":1.226,"15min":1.226},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.47499999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.83699999999999997,"5min":0.997,"15min":0.997},"last":0.94199999999999995}]},{"osd":3,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.75700000000000001,"15min":0.80700000000000005},"min":{"1min":0.59799999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.83899999999999997,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.747,"15min":0.79300000000000004},"min":{"1min":0.52300000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93100000000000005,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.95399999999999996}]},{"osd":4,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63700000000000001,"15min":0.66300000000000003},"min":{"1min":0.41399999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88200000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65400000000000003,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83099999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.70599999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.63300000000000001,"15min":0.67300000000000004},"min":{"1min":0.42799999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.74199999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71199999999999997,"15min":0.73199999999999998},"min":{"1min":0.60799999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85599999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.623}]},{"osd":7,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71399999999999997,"15min":0.74199999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.85699999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.71499999999999997,"15min":0.74399999999999999},"min":{"1min":0.56499999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.81399999999999995,"5min":0.999,"15min":0.999},"last":0.67400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":363372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83499999999999996,"5min":1.25,"15min":1.25},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93600000000000005,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.53400000000000003}]},{"osd":1,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.69899999999999995,"15min":0.69199999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94699999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69899999999999995,"15min":0.72099999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.026,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.629}]},{"osd":2,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78200000000000003,"15min":0.82199999999999995},"min":{"1min":0.504,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98299999999999998,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.753},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71999999999999997,"15min":0.74399999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.872,"5min":1.696,"15min":1.696},"last":0.73599999999999999}]},{"osd":3,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73299999999999998,"15min":0.76300000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90700000000000003,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.76600000000000001,"15min":0.82199999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91300000000000003,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.69699999999999995}]},{"osd":4,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.63,"15min":0.71299999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71699999999999997,"5min":1.911,"15min":1.911},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.68500000000000005,"15min":0.77900000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.86699999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.71699999999999997}]},{"osd":6,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.73299999999999998,"15min":0.85099999999999998},"min":{"1min":0.44,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83299999999999996,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.72699999999999998,"15min":0.83799999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76900000000000002,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.79100000000000004}]},{"osd":7,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.76300000000000001,"15min":0.86099999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92200000000000004,"5min":1.887,"15min":1.887},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.79300000000000004,"15min":0.90800000000000003},"min":{"1min":0.48599999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.97999999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.0109999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":868352,"data_stored":363352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71399999999999997,"15min":0.748},"min":{"1min":0.48399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95999999999999996,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.751,"15min":0.82699999999999996},"min":{"1min":0.58699999999999997,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.88500000000000001,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.57899999999999996}]},{"osd":1,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73299999999999998,"15min":0.76000000000000001},"min":{"1min":0.58899999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89900000000000002,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.81200000000000006,"15min":0.91000000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94499999999999995,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":0.65900000000000003}]},{"osd":2,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76600000000000001,"15min":0.80200000000000005},"min":{"1min":0.52600000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.995,"5min":2.056,"15min":2.056},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.80700000000000005,"15min":0.878},"min":{"1min":0.59299999999999997,"5min":0.498,"15min":0.498},"max":{"1min":0.89400000000000002,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.68200000000000005}]},{"osd":3,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.877,"15min":0.996},"min":{"1min":0.58599999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.93700000000000006,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.89600000000000002,"15min":1.012},"min":{"1min":0.65600000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.97599999999999998,"5min":3.9750000000000001,"15min":3.9750000000000001},"last":0.70399999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.67800000000000005,"15min":0.71099999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84899999999999998,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.70499999999999996,"15min":0.749},"min":{"1min":0.47299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.73299999999999998,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.73399999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.68799999999999994,"15min":0.71599999999999997},"min":{"1min":0.48299999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79200000000000004,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.748},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.74299999999999999,"15min":0.77700000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91300000000000003,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.88}]},{"osd":7,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.77700000000000002,"15min":0.80200000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.82799999999999996,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.83799999999999997,"15min":0.86799999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93999999999999995,"5min":1.353,"15min":1.353},"last":0.91100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574909,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":872448,"data_stored":363394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.433,"15min":0.44900000000000001},"min":{"1min":0.30399999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.58799999999999997,"5min":0.622,"15min":0.622},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.48299999999999998,"15min":0.48399999999999999},"min":{"1min":0.33200000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.748,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.34899999999999998}]},{"osd":1,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45100000000000001,"15min":0.44},"min":{"1min":0.32300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.499,"15min":0.50600000000000001},"min":{"1min":0.35299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.68500000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.41199999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54500000000000004,"15min":0.53200000000000003},"min":{"1min":0.44,"5min":0.374,"15min":0.374},"max":{"1min":0.73699999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.41599999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75800000000000001,"5min":1.306,"15min":1.306},"last":0.45000000000000001}]},{"osd":4,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.74099999999999999,"15min":0.75800000000000001},"min":{"1min":0.61199999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.01,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.54900000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.155,"15min":1.155},"last":0.46500000000000002}]},{"osd":5,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77300000000000002,"15min":0.77500000000000002},"min":{"1min":0.56899999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.97399999999999998,"5min":1.198,"15min":1.198},"last":0.501},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.753,"15min":0.747},"min":{"1min":0.61799999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95799999999999996,"5min":1.135,"15min":1.135},"last":0.49199999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.53700000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.046,"5min":1.25,"15min":1.25},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79000000000000004,"15min":0.78400000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0349999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.53800000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.56100000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.99099999999999999,"5min":1.216,"15min":1.216},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79100000000000004,"15min":0.79700000000000004},"min":{"1min":0.56599999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.077,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.69799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":876544,"data_stored":364846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.441,"15min":0.45000000000000001},"min":{"1min":0.28699999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.60299999999999998,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.48399999999999999,"15min":0.48499999999999999},"min":{"1min":0.33700000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.57799999999999996}]},{"osd":1,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.40899999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69399999999999995,"5min":1.171,"15min":1.171},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48999999999999999,"15min":0.49299999999999999},"min":{"1min":0.35899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71199999999999997,"5min":1.333,"15min":1.333},"last":0.55200000000000005}]},{"osd":3,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80000000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.41899999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.70299999999999996,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.64500000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76300000000000001,"15min":0.77400000000000002},"min":{"1min":0.52400000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.05,"5min":2.254,"15min":2.254},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77100000000000002,"15min":0.76800000000000002},"min":{"1min":0.629,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.077,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.02,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79800000000000004,"15min":0.81399999999999995},"min":{"1min":0.57499999999999996,"5min":0.443,"15min":0.443},"max":{"1min":1.0700000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.83199999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.82299999999999995,"15min":0.82599999999999996},"min":{"1min":0.71899999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0840000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.82799999999999996,"15min":0.82599999999999996},"min":{"1min":0.621,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0680000000000001,"5min":1.425,"15min":1.425},"last":0.85199999999999998}]},{"osd":7,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.81699999999999995,"15min":0.83699999999999997},"min":{"1min":0.63500000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.105,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.65300000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.006,"5min":1.377,"15min":1.377},"last":0.81000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":884736,"data_stored":365462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46200000000000002,"15min":0.48399999999999999},"min":{"1min":0.33400000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.67000000000000004,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.58099999999999996,"15min":0.65100000000000002},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.73099999999999998,"5min":4.157,"15min":4.157},"last":0.27500000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.57399999999999995,"15min":0.66500000000000004},"min":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70099999999999996,"5min":4.282,"15min":4.282},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56999999999999995,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70799999999999996,"5min":1.625,"15min":1.625},"last":0.495}]},{"osd":3,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.42499999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97299999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.73099999999999998,"15min":0.91200000000000003},"min":{"1min":0.41899999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79200000000000004,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.40200000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.86099999999999999,"15min":0.97099999999999997},"min":{"1min":0.56599999999999995,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.997,"5min":4.7400000000000002,"15min":4.7400000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.79400000000000004,"15min":0.82899999999999996},"min":{"1min":0.59799999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97099999999999997,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.64100000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.871,"15min":0.95299999999999996},"min":{"1min":0.61099999999999999,"5min":0.497,"15min":0.497},"max":{"1min":1.0700000000000001,"5min":4.5759999999999996,"15min":4.5759999999999996},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.86699999999999999,"15min":0.95699999999999996},"min":{"1min":0.66600000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92500000000000004,"5min":4.7949999999999999,"15min":4.7949999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.89100000000000001,"15min":1.002},"min":{"1min":0.57799999999999996,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.96299999999999997,"5min":4.6890000000000001,"15min":4.6890000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.88,"15min":0.97899999999999998},"min":{"1min":0.58199999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.036,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.66000000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80800000000000005,"15min":0.83999999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.94499999999999995,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.90200000000000002,"15min":0.98399999999999999},"min":{"1min":0.60899999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.0580000000000001,"5min":4.6420000000000003,"15min":4.6420000000000003},"last":0.73699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32540,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1458176,"data_stored":953650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46000000000000002,"15min":0.47799999999999998},"min":{"1min":0.33800000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71699999999999997,"5min":1.48,"15min":1.48},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.51700000000000002,"15min":0.51300000000000001},"min":{"1min":0.40799999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.76800000000000002,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.48299999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71999999999999997,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.54300000000000004,"15min":0.52600000000000002},"min":{"1min":0.47899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.82399999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.434}]},{"osd":3,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.47599999999999998,"15min":0.47299999999999998},"min":{"1min":0.36299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68100000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.504},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60699999999999998,"15min":0.627},"min":{"1min":0.46000000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.98099999999999998,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.56799999999999995}]},{"osd":4,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.747,"15min":0.73599999999999999},"min":{"1min":0.61399999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.036,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.752,"15min":0.748},"min":{"1min":0.53900000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.008,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.55400000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.61099999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0289999999999999,"5min":1.371,"15min":1.371},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.76800000000000002,"15min":0.76700000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.54100000000000004}]},{"osd":6,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.80000000000000004,"15min":0.80500000000000005},"min":{"1min":0.58799999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1719999999999999,"5min":1.177,"15min":1.177},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82899999999999996,"15min":0.84699999999999998},"min":{"1min":0.626,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1839999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.79000000000000004,"15min":0.80000000000000004},"min":{"1min":0.58099999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98399999999999999,"5min":1.135,"15min":1.135},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.63200000000000001,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1279999999999999,"5min":1.141,"15min":1.141},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:26:59.652 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:26:59.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.820+0000 7f04c6000640 1 Processor -- start 2024-04-02T07:26:59.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.820+0000 7f04c6000640 1 -- start start 2024-04-02T07:26:59.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.824+0000 7f04c6000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f04c00b38c0 0x7f04c0164210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:59.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.824+0000 7f04c6000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c013d0c0 con 0x7f04c00c4120 2024-04-02T07:26:59.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.824+0000 7f04c6000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c015a4f0 con 0x7f04c0153ea0 2024-04-02T07:26:59.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.824+0000 7f04c6000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c015a2f0 con 0x7f04c00b38c0 2024-04-02T07:26:59.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.824+0000 7f04b6a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f04c00c4120 0x7f04c00b31b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35800/0 (socket says 172.21.15.55:35800) 2024-04-02T07:26:59.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.824+0000 7f04b6a00640 1 -- 172.21.15.55:0/2233103468 learned_addr learned my addr 172.21.15.55:0/2233103468 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:26:59.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.824+0000 7f04bfe00640 1 --2- 172.21.15.55:0/2233103468 >> v2:172.21.15.55:3300/0 conn(0x7f04c00b38c0 0x7f04c0164210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:59.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.824+0000 7f04bfe00640 1 -- 172.21.15.55:0/2233103468 >> v1:172.21.15.106:6789/0 conn(0x7f04c0153ea0 legacy=0x7f04c0159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:59.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.824+0000 7f04bfe00640 1 -- 172.21.15.55:0/2233103468 >> v1:172.21.15.55:6789/0 conn(0x7f04c00c4120 legacy=0x7f04c00b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:59.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.824+0000 7f04bfe00640 1 -- 172.21.15.55:0/2233103468 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c015a7d0 con 0x7f04c00b38c0 2024-04-02T07:26:59.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.824+0000 7f04bea00640 1 -- 172.21.15.55:0/2233103468 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3120687243 0 0) 0x7f04c013d0c0 con 0x7f04c00c4120 2024-04-02T07:26:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.828+0000 7f04bfe00640 1 --2- 172.21.15.55:0/2233103468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04c00b38c0 0x7f04c0164210 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f04b80097c0 tx=0x7f04b801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3c61d24f85cc9f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.828+0000 7f04bea00640 1 -- 172.21.15.55:0/2233103468 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b80ac410 con 0x7f04c00b38c0 2024-04-02T07:26:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.828+0000 7f04bea00640 1 -- 172.21.15.55:0/2233103468 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b80ac570 con 0x7f04c00b38c0 2024-04-02T07:26:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.828+0000 7f04bea00640 1 -- 172.21.15.55:0/2233103468 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b80ac900 con 0x7f04c00b38c0 2024-04-02T07:26:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.828+0000 7f04c6000640 1 -- 172.21.15.55:0/2233103468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04c00b38c0 msgr2=0x7f04c0164210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.828+0000 7f04c6000640 1 --2- 172.21.15.55:0/2233103468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04c00b38c0 0x7f04c0164210 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f04b80097c0 tx=0x7f04b801c4a0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.828+0000 7f04c6000640 1 -- 172.21.15.55:0/2233103468 shutdown_connections 2024-04-02T07:26:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.828+0000 7f04c6000640 1 --2- 172.21.15.55:0/2233103468 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04c00b38c0 0x7f04c0164210 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.828+0000 7f04c6000640 1 -- 172.21.15.55:0/2233103468 >> 172.21.15.55:0/2233103468 conn(0x7f04c0066080 msgr2=0x7f04c0069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:26:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.828+0000 7f04c6000640 1 -- 172.21.15.55:0/2233103468 shutdown_connections 2024-04-02T07:26:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.828+0000 7f04c6000640 1 -- 172.21.15.55:0/2233103468 wait complete. 2024-04-02T07:26:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.828+0000 7f04c6000640 1 Processor -- start 2024-04-02T07:26:59.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.828+0000 7f04c6000640 1 -- start start 2024-04-02T07:26:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.828+0000 7f04c6000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04c00b38c0 0x7f04c006c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.828+0000 7f04c6000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04c00c4120 0x7f04c0152780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.828+0000 7f04c6000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04c0153ea0 0x7f04c0152cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.828+0000 7f04c6000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c01264e0 con 0x7f04c00c4120 2024-04-02T07:26:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.828+0000 7f04c6000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c0129240 con 0x7f04c00b38c0 2024-04-02T07:26:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.828+0000 7f04c6000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c012b7d0 con 0x7f04c0153ea0 2024-04-02T07:26:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.832+0000 7f04b6a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04c00c4120 0x7f04c0152780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.832+0000 7f04b6a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04c00c4120 0x7f04c0152780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41712/0 (socket says 172.21.15.55:41712) 2024-04-02T07:26:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.832+0000 7f04b6a00640 1 -- 172.21.15.55:0/4126981311 learned_addr learned my addr 172.21.15.55:0/4126981311 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:26:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.832+0000 7f04bfe00640 1 --2- 172.21.15.55:0/4126981311 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04c0153ea0 0x7f04c0152cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.832+0000 7f04bf400640 1 --2- 172.21.15.55:0/4126981311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04c00b38c0 0x7f04c006c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:59.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.832+0000 7f04b6a00640 1 -- 172.21.15.55:0/4126981311 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04c0153ea0 msgr2=0x7f04c0152cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:59.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.832+0000 7f04b6a00640 1 --2- 172.21.15.55:0/4126981311 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04c0153ea0 0x7f04c0152cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.832+0000 7f04b6a00640 1 -- 172.21.15.55:0/4126981311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04c00b38c0 msgr2=0x7f04c006c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:26:59.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.832+0000 7f04b6a00640 1 --2- 172.21.15.55:0/4126981311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04c00b38c0 0x7f04c006c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:26:59.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.832+0000 7f04b6a00640 1 -- 172.21.15.55:0/4126981311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b8009420 con 0x7f04c00c4120 2024-04-02T07:26:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.832+0000 7f04b6a00640 1 --2- 172.21.15.55:0/4126981311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04c00c4120 0x7f04c0152780 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f04a800c8c0 tx=0x7f04a800cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.832+0000 7f04b7e00640 1 -- 172.21.15.55:0/4126981311 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a800a5e0 con 0x7f04c00c4120 2024-04-02T07:26:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.832+0000 7f04b7e00640 1 -- 172.21.15.55:0/4126981311 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a800a740 con 0x7f04c00c4120 2024-04-02T07:26:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.832+0000 7f04b7e00640 1 -- 172.21.15.55:0/4126981311 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a800ab30 con 0x7f04c00c4120 2024-04-02T07:26:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.832+0000 7f04c6000640 1 -- 172.21.15.55:0/4126981311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c0128bf0 con 0x7f04c00c4120 2024-04-02T07:26:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.832+0000 7f04c6000640 1 -- 172.21.15.55:0/4126981311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c006cba0 con 0x7f04c00c4120 2024-04-02T07:26:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.832+0000 7f04c6000640 1 -- 172.21.15.55:0/4126981311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c0128a50 con 0x7f04c00c4120 2024-04-02T07:26:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.832+0000 7f04b7e00640 1 -- 172.21.15.55:0/4126981311 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f04a800ac90 con 0x7f04c00c4120 2024-04-02T07:26:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.832+0000 7f04b7e00640 1 --2- 172.21.15.55:0/4126981311 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f049c066690 0x7f049c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:26:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.836+0000 7f04b7e00640 1 -- 172.21.15.55:0/4126981311 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04a80836c0 con 0x7f04c00c4120 2024-04-02T07:26:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.836+0000 7f04bf400640 1 --2- 172.21.15.55:0/4126981311 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f049c066690 0x7f049c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:26:59.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.836+0000 7f04bf400640 1 --2- 172.21.15.55:0/4126981311 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f049c066690 0x7f049c068b50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f04b0007fd0 tx=0x7f04b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:26:59.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.836+0000 7f04b7e00640 1 -- 172.21.15.55:0/4126981311 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f04c0128a50 con 0x7f04c00c4120 2024-04-02T07:26:59.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:26:59.992+0000 7f04c6000640 1 -- 172.21.15.55:0/4126981311 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f04c01290a0 con 0x7f049c066690 2024-04-02T07:27:00.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.004+0000 7f04b7e00640 1 -- 172.21.15.55:0/4126981311 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+288978 (secure 0 0 0) 0x7f04b0001450 con 0x7f049c066690 2024-04-02T07:27:00.010 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:27:00.012 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:27:00.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.004+0000 7f04c6000640 1 -- 172.21.15.55:0/4126981311 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f049c066690 msgr2=0x7f049c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:00.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.004+0000 7f04c6000640 1 --2- 172.21.15.55:0/4126981311 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f049c066690 0x7f049c068b50 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f04b0007fd0 tx=0x7f04b0009040 comp rx=0 tx=0).stop 2024-04-02T07:27:00.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.004+0000 7f04c6000640 1 -- 172.21.15.55:0/4126981311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04c00c4120 msgr2=0x7f04c0152780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:00.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.004+0000 7f04c6000640 1 --2- 172.21.15.55:0/4126981311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04c00c4120 0x7f04c0152780 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f04a800c8c0 tx=0x7f04a800cd80 comp rx=0 tx=0).stop 2024-04-02T07:27:00.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.008+0000 7f04c6000640 1 -- 172.21.15.55:0/4126981311 shutdown_connections 2024-04-02T07:27:00.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.008+0000 7f04c6000640 1 --2- 172.21.15.55:0/4126981311 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04c0153ea0 0x7f04c0152cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.008+0000 7f04c6000640 1 --2- 172.21.15.55:0/4126981311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04c00c4120 0x7f04c0152780 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.008+0000 7f04c6000640 1 --2- 172.21.15.55:0/4126981311 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f049c066690 0x7f049c068b50 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.008+0000 7f04c6000640 1 --2- 172.21.15.55:0/4126981311 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04c00b38c0 0x7f04c006c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.008+0000 7f04c6000640 1 -- 172.21.15.55:0/4126981311 >> 172.21.15.55:0/4126981311 conn(0x7f04c0066080 msgr2=0x7f04c00c3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:00.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.008+0000 7f04c6000640 1 -- 172.21.15.55:0/4126981311 shutdown_connections 2024-04-02T07:27:00.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.008+0000 7f04c6000640 1 -- 172.21.15.55:0/4126981311 wait complete. 2024-04-02T07:27:00.031 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2024-04-02T07:26:58.400791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":89,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":248700,"kb_used_data":7956,"kb_used_omap":12,"kb_used_meta":240627,"kb_avail":754726020,"statfs":{"total":773094113280,"available":772839444480,"internally_reserved":0,"allocated":8146944,"data_stored":4084849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":246402616},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":42,"apply_latency_ms":42,"commit_latency_ns":42000000,"apply_latency_ns":42000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.297405"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.571713+0000","last_change":"2024-04-02T07:26:55.569759+0000","last_active":"2024-04-02T07:26:55.571713+0000","last_peered":"2024-04-02T07:26:55.571713+0000","last_clean":"2024-04-02T07:26:55.571713+0000","last_became_active":"2024-04-02T07:26:55.568889+0000","last_became_peered":"2024-04-02T07:26:55.568889+0000","last_unstale":"2024-04-02T07:26:55.571713+0000","last_undegraded":"2024-04-02T07:26:55.571713+0000","last_fullsized":"2024-04-02T07:26:55.571713+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:28:45.947477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.564241+0000","last_change":"2024-04-02T07:26:55.558556+0000","last_active":"2024-04-02T07:26:55.564241+0000","last_peered":"2024-04-02T07:26:55.564241+0000","last_clean":"2024-04-02T07:26:55.564241+0000","last_became_active":"2024-04-02T07:26:55.558074+0000","last_became_peered":"2024-04-02T07:26:55.558074+0000","last_unstale":"2024-04-02T07:26:55.564241+0000","last_undegraded":"2024-04-02T07:26:55.564241+0000","last_fullsized":"2024-04-02T07:26:55.564241+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:33:54.603553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.562447+0000","last_change":"2024-04-02T07:26:55.556387+0000","last_active":"2024-04-02T07:26:55.562447+0000","last_peered":"2024-04-02T07:26:55.562447+0000","last_clean":"2024-04-02T07:26:55.562447+0000","last_became_active":"2024-04-02T07:26:55.556071+0000","last_became_peered":"2024-04-02T07:26:55.556071+0000","last_unstale":"2024-04-02T07:26:55.562447+0000","last_undegraded":"2024-04-02T07:26:55.562447+0000","last_fullsized":"2024-04-02T07:26:55.562447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:42:38.173156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.558031+0000","last_change":"2024-04-02T07:26:55.553769+0000","last_active":"2024-04-02T07:26:55.558031+0000","last_peered":"2024-04-02T07:26:55.558031+0000","last_clean":"2024-04-02T07:26:55.558031+0000","last_became_active":"2024-04-02T07:26:55.553511+0000","last_became_peered":"2024-04-02T07:26:55.553511+0000","last_unstale":"2024-04-02T07:26:55.558031+0000","last_undegraded":"2024-04-02T07:26:55.558031+0000","last_fullsized":"2024-04-02T07:26:55.558031+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:12:56.952324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.561387+0000","last_change":"2024-04-02T07:26:55.559087+0000","last_active":"2024-04-02T07:26:55.561387+0000","last_peered":"2024-04-02T07:26:55.561387+0000","last_clean":"2024-04-02T07:26:55.561387+0000","last_became_active":"2024-04-02T07:26:55.557552+0000","last_became_peered":"2024-04-02T07:26:55.557552+0000","last_unstale":"2024-04-02T07:26:55.561387+0000","last_undegraded":"2024-04-02T07:26:55.561387+0000","last_fullsized":"2024-04-02T07:26:55.561387+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:06:46.852147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566305+0000","last_change":"2024-04-02T07:26:55.561489+0000","last_active":"2024-04-02T07:26:55.566305+0000","last_peered":"2024-04-02T07:26:55.566305+0000","last_clean":"2024-04-02T07:26:55.566305+0000","last_became_active":"2024-04-02T07:26:55.561022+0000","last_became_peered":"2024-04-02T07:26:55.561022+0000","last_unstale":"2024-04-02T07:26:55.566305+0000","last_undegraded":"2024-04-02T07:26:55.566305+0000","last_fullsized":"2024-04-02T07:26:55.566305+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:40:44.112650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566830+0000","last_change":"2024-04-02T07:26:55.555297+0000","last_active":"2024-04-02T07:26:55.566830+0000","last_peered":"2024-04-02T07:26:55.566830+0000","last_clean":"2024-04-02T07:26:55.566830+0000","last_became_active":"2024-04-02T07:26:55.555050+0000","last_became_peered":"2024-04-02T07:26:55.555050+0000","last_unstale":"2024-04-02T07:26:55.566830+0000","last_undegraded":"2024-04-02T07:26:55.566830+0000","last_fullsized":"2024-04-02T07:26:55.566830+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:46:06.244742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566771+0000","last_change":"2024-04-02T07:26:55.563146+0000","last_active":"2024-04-02T07:26:55.566771+0000","last_peered":"2024-04-02T07:26:55.566771+0000","last_clean":"2024-04-02T07:26:55.566771+0000","last_became_active":"2024-04-02T07:26:55.562833+0000","last_became_peered":"2024-04-02T07:26:55.562833+0000","last_unstale":"2024-04-02T07:26:55.566771+0000","last_undegraded":"2024-04-02T07:26:55.566771+0000","last_fullsized":"2024-04-02T07:26:55.566771+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:33:37.303936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.564035+0000","last_change":"2024-04-02T07:26:55.562198+0000","last_active":"2024-04-02T07:26:55.564035+0000","last_peered":"2024-04-02T07:26:55.564035+0000","last_clean":"2024-04-02T07:26:55.564035+0000","last_became_active":"2024-04-02T07:26:55.561625+0000","last_became_peered":"2024-04-02T07:26:55.561625+0000","last_unstale":"2024-04-02T07:26:55.564035+0000","last_undegraded":"2024-04-02T07:26:55.564035+0000","last_fullsized":"2024-04-02T07:26:55.564035+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:00:13.787059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.556558+0000","last_change":"2024-04-02T07:26:55.549628+0000","last_active":"2024-04-02T07:26:55.556558+0000","last_peered":"2024-04-02T07:26:55.556558+0000","last_clean":"2024-04-02T07:26:55.556558+0000","last_became_active":"2024-04-02T07:26:55.549351+0000","last_became_peered":"2024-04-02T07:26:55.549351+0000","last_unstale":"2024-04-02T07:26:55.556558+0000","last_undegraded":"2024-04-02T07:26:55.556558+0000","last_fullsized":"2024-04-02T07:26:55.556558+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:33:54.632716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.572362+0000","last_change":"2024-04-02T07:26:55.569793+0000","last_active":"2024-04-02T07:26:55.572362+0000","last_peered":"2024-04-02T07:26:55.572362+0000","last_clean":"2024-04-02T07:26:55.572362+0000","last_became_active":"2024-04-02T07:26:55.569106+0000","last_became_peered":"2024-04-02T07:26:55.569106+0000","last_unstale":"2024-04-02T07:26:55.572362+0000","last_undegraded":"2024-04-02T07:26:55.572362+0000","last_fullsized":"2024-04-02T07:26:55.572362+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:42:32.776650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.558048+0000","last_change":"2024-04-02T07:26:55.553729+0000","last_active":"2024-04-02T07:26:55.558048+0000","last_peered":"2024-04-02T07:26:55.558048+0000","last_clean":"2024-04-02T07:26:55.558048+0000","last_became_active":"2024-04-02T07:26:55.553032+0000","last_became_peered":"2024-04-02T07:26:55.553032+0000","last_unstale":"2024-04-02T07:26:55.558048+0000","last_undegraded":"2024-04-02T07:26:55.558048+0000","last_fullsized":"2024-04-02T07:26:55.558048+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:51:58.691640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.567376+0000","last_change":"2024-04-02T07:26:55.564722+0000","last_active":"2024-04-02T07:26:55.567376+0000","last_peered":"2024-04-02T07:26:55.567376+0000","last_clean":"2024-04-02T07:26:55.567376+0000","last_became_active":"2024-04-02T07:26:55.564470+0000","last_became_peered":"2024-04-02T07:26:55.564470+0000","last_unstale":"2024-04-02T07:26:55.567376+0000","last_undegraded":"2024-04-02T07:26:55.567376+0000","last_fullsized":"2024-04-02T07:26:55.567376+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:06:17.075180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.560609+0000","last_change":"2024-04-02T07:26:55.551729+0000","last_active":"2024-04-02T07:26:55.560609+0000","last_peered":"2024-04-02T07:26:55.560609+0000","last_clean":"2024-04-02T07:26:55.560609+0000","last_became_active":"2024-04-02T07:26:55.551370+0000","last_became_peered":"2024-04-02T07:26:55.551370+0000","last_unstale":"2024-04-02T07:26:55.560609+0000","last_undegraded":"2024-04-02T07:26:55.560609+0000","last_fullsized":"2024-04-02T07:26:55.560609+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:39:54.311803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.565609+0000","last_change":"2024-04-02T07:26:55.562811+0000","last_active":"2024-04-02T07:26:55.565609+0000","last_peered":"2024-04-02T07:26:55.565609+0000","last_clean":"2024-04-02T07:26:55.565609+0000","last_became_active":"2024-04-02T07:26:55.562352+0000","last_became_peered":"2024-04-02T07:26:55.562352+0000","last_unstale":"2024-04-02T07:26:55.565609+0000","last_undegraded":"2024-04-02T07:26:55.565609+0000","last_fullsized":"2024-04-02T07:26:55.565609+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:06:07.970840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.572444+0000","last_change":"2024-04-02T07:26:55.566384+0000","last_active":"2024-04-02T07:26:55.572444+0000","last_peered":"2024-04-02T07:26:55.572444+0000","last_clean":"2024-04-02T07:26:55.572444+0000","last_became_active":"2024-04-02T07:26:55.563318+0000","last_became_peered":"2024-04-02T07:26:55.563318+0000","last_unstale":"2024-04-02T07:26:55.572444+0000","last_undegraded":"2024-04-02T07:26:55.572444+0000","last_fullsized":"2024-04-02T07:26:55.572444+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:07:06.022343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.561783+0000","last_change":"2024-04-02T07:26:55.558198+0000","last_active":"2024-04-02T07:26:55.561783+0000","last_peered":"2024-04-02T07:26:55.561783+0000","last_clean":"2024-04-02T07:26:55.561783+0000","last_became_active":"2024-04-02T07:26:55.557961+0000","last_became_peered":"2024-04-02T07:26:55.557961+0000","last_unstale":"2024-04-02T07:26:55.561783+0000","last_undegraded":"2024-04-02T07:26:55.561783+0000","last_fullsized":"2024-04-02T07:26:55.561783+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:07:52.027218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.560477+0000","last_change":"2024-04-02T07:26:55.559171+0000","last_active":"2024-04-02T07:26:55.560477+0000","last_peered":"2024-04-02T07:26:55.560477+0000","last_clean":"2024-04-02T07:26:55.560477+0000","last_became_active":"2024-04-02T07:26:55.558906+0000","last_became_peered":"2024-04-02T07:26:55.558906+0000","last_unstale":"2024-04-02T07:26:55.560477+0000","last_undegraded":"2024-04-02T07:26:55.560477+0000","last_fullsized":"2024-04-02T07:26:55.560477+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:36:10.868785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.563585+0000","last_change":"2024-04-02T07:26:55.559175+0000","last_active":"2024-04-02T07:26:55.563585+0000","last_peered":"2024-04-02T07:26:55.563585+0000","last_clean":"2024-04-02T07:26:55.563585+0000","last_became_active":"2024-04-02T07:26:55.558838+0000","last_became_peered":"2024-04-02T07:26:55.558838+0000","last_unstale":"2024-04-02T07:26:55.563585+0000","last_undegraded":"2024-04-02T07:26:55.563585+0000","last_fullsized":"2024-04-02T07:26:55.563585+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:00:35.917054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.559775+0000","last_change":"2024-04-02T07:26:55.555096+0000","last_active":"2024-04-02T07:26:55.559775+0000","last_peered":"2024-04-02T07:26:55.559775+0000","last_clean":"2024-04-02T07:26:55.559775+0000","last_became_active":"2024-04-02T07:26:55.554866+0000","last_became_peered":"2024-04-02T07:26:55.554866+0000","last_unstale":"2024-04-02T07:26:55.559775+0000","last_undegraded":"2024-04-02T07:26:55.559775+0000","last_fullsized":"2024-04-02T07:26:55.559775+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:24:41.768841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566070+0000","last_change":"2024-04-02T07:26:55.556479+0000","last_active":"2024-04-02T07:26:55.566070+0000","last_peered":"2024-04-02T07:26:55.566070+0000","last_clean":"2024-04-02T07:26:55.566070+0000","last_became_active":"2024-04-02T07:26:55.556147+0000","last_became_peered":"2024-04-02T07:26:55.556147+0000","last_unstale":"2024-04-02T07:26:55.566070+0000","last_undegraded":"2024-04-02T07:26:55.566070+0000","last_fullsized":"2024-04-02T07:26:55.566070+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:00:35.917054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.567764+0000","last_change":"2024-04-02T07:26:55.559460+0000","last_active":"2024-04-02T07:26:55.567764+0000","last_peered":"2024-04-02T07:26:55.567764+0000","last_clean":"2024-04-02T07:26:55.567764+0000","last_became_active":"2024-04-02T07:26:55.559137+0000","last_became_peered":"2024-04-02T07:26:55.559137+0000","last_unstale":"2024-04-02T07:26:55.567764+0000","last_undegraded":"2024-04-02T07:26:55.567764+0000","last_fullsized":"2024-04-02T07:26:55.567764+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:33:54.603553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.571670+0000","last_change":"2024-04-02T07:26:55.569593+0000","last_active":"2024-04-02T07:26:55.571670+0000","last_peered":"2024-04-02T07:26:55.571670+0000","last_clean":"2024-04-02T07:26:55.571670+0000","last_became_active":"2024-04-02T07:26:55.569118+0000","last_became_peered":"2024-04-02T07:26:55.569118+0000","last_unstale":"2024-04-02T07:26:55.571670+0000","last_undegraded":"2024-04-02T07:26:55.571670+0000","last_fullsized":"2024-04-02T07:26:55.571670+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:55:12.848274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.570811+0000","last_change":"2024-04-02T07:26:55.566234+0000","last_active":"2024-04-02T07:26:55.570811+0000","last_peered":"2024-04-02T07:26:55.570811+0000","last_clean":"2024-04-02T07:26:55.570811+0000","last_became_active":"2024-04-02T07:26:55.564231+0000","last_became_peered":"2024-04-02T07:26:55.564231+0000","last_unstale":"2024-04-02T07:26:55.570811+0000","last_undegraded":"2024-04-02T07:26:55.570811+0000","last_fullsized":"2024-04-02T07:26:55.570811+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:30.445895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566458+0000","last_change":"2024-04-02T07:26:55.555939+0000","last_active":"2024-04-02T07:26:55.566458+0000","last_peered":"2024-04-02T07:26:55.566458+0000","last_clean":"2024-04-02T07:26:55.566458+0000","last_became_active":"2024-04-02T07:26:55.554985+0000","last_became_peered":"2024-04-02T07:26:55.554985+0000","last_unstale":"2024-04-02T07:26:55.566458+0000","last_undegraded":"2024-04-02T07:26:55.566458+0000","last_fullsized":"2024-04-02T07:26:55.566458+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:40:44.112650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.568724+0000","last_change":"2024-04-02T07:26:55.562049+0000","last_active":"2024-04-02T07:26:55.568724+0000","last_peered":"2024-04-02T07:26:55.568724+0000","last_clean":"2024-04-02T07:26:55.568724+0000","last_became_active":"2024-04-02T07:26:55.561806+0000","last_became_peered":"2024-04-02T07:26:55.561806+0000","last_unstale":"2024-04-02T07:26:55.568724+0000","last_undegraded":"2024-04-02T07:26:55.568724+0000","last_fullsized":"2024-04-02T07:26:55.568724+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:24:41.768841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.562466+0000","last_change":"2024-04-02T07:26:55.557565+0000","last_active":"2024-04-02T07:26:55.562466+0000","last_peered":"2024-04-02T07:26:55.562466+0000","last_clean":"2024-04-02T07:26:55.562466+0000","last_became_active":"2024-04-02T07:26:55.556387+0000","last_became_peered":"2024-04-02T07:26:55.556387+0000","last_unstale":"2024-04-02T07:26:55.562466+0000","last_undegraded":"2024-04-02T07:26:55.562466+0000","last_fullsized":"2024-04-02T07:26:55.562466+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:36:23.479706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.567726+0000","last_change":"2024-04-02T07:26:55.559665+0000","last_active":"2024-04-02T07:26:55.567726+0000","last_peered":"2024-04-02T07:26:55.567726+0000","last_clean":"2024-04-02T07:26:55.567726+0000","last_became_active":"2024-04-02T07:26:55.559348+0000","last_became_peered":"2024-04-02T07:26:55.559348+0000","last_unstale":"2024-04-02T07:26:55.567726+0000","last_undegraded":"2024-04-02T07:26:55.567726+0000","last_fullsized":"2024-04-02T07:26:55.567726+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:08:46.605892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.561487+0000","last_change":"2024-04-02T07:26:55.547715+0000","last_active":"2024-04-02T07:26:55.561487+0000","last_peered":"2024-04-02T07:26:55.561487+0000","last_clean":"2024-04-02T07:26:55.561487+0000","last_became_active":"2024-04-02T07:26:55.547468+0000","last_became_peered":"2024-04-02T07:26:55.547468+0000","last_unstale":"2024-04-02T07:26:55.561487+0000","last_undegraded":"2024-04-02T07:26:55.561487+0000","last_fullsized":"2024-04-02T07:26:55.561487+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:46:03.101079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.573757+0000","last_change":"2024-04-02T07:26:55.571562+0000","last_active":"2024-04-02T07:26:55.573757+0000","last_peered":"2024-04-02T07:26:55.573757+0000","last_clean":"2024-04-02T07:26:55.573757+0000","last_became_active":"2024-04-02T07:26:55.567429+0000","last_became_peered":"2024-04-02T07:26:55.567429+0000","last_unstale":"2024-04-02T07:26:55.573757+0000","last_undegraded":"2024-04-02T07:26:55.573757+0000","last_fullsized":"2024-04-02T07:26:55.573757+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:33:05.922119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566851+0000","last_change":"2024-04-02T07:26:55.556990+0000","last_active":"2024-04-02T07:26:55.566851+0000","last_peered":"2024-04-02T07:26:55.566851+0000","last_clean":"2024-04-02T07:26:55.566851+0000","last_became_active":"2024-04-02T07:26:55.556754+0000","last_became_peered":"2024-04-02T07:26:55.556754+0000","last_unstale":"2024-04-02T07:26:55.566851+0000","last_undegraded":"2024-04-02T07:26:55.566851+0000","last_fullsized":"2024-04-02T07:26:55.566851+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:07:06.022343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.562112+0000","last_change":"2024-04-02T07:26:55.558327+0000","last_active":"2024-04-02T07:26:55.562112+0000","last_peered":"2024-04-02T07:26:55.562112+0000","last_clean":"2024-04-02T07:26:55.562112+0000","last_became_active":"2024-04-02T07:26:55.558008+0000","last_became_peered":"2024-04-02T07:26:55.558008+0000","last_unstale":"2024-04-02T07:26:55.562112+0000","last_undegraded":"2024-04-02T07:26:55.562112+0000","last_fullsized":"2024-04-02T07:26:55.562112+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:44:08.157369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.571571+0000","last_change":"2024-04-02T07:26:55.569415+0000","last_active":"2024-04-02T07:26:55.571571+0000","last_peered":"2024-04-02T07:26:55.571571+0000","last_clean":"2024-04-02T07:26:55.571571+0000","last_became_active":"2024-04-02T07:26:55.568725+0000","last_became_peered":"2024-04-02T07:26:55.568725+0000","last_unstale":"2024-04-02T07:26:55.571571+0000","last_undegraded":"2024-04-02T07:26:55.571571+0000","last_fullsized":"2024-04-02T07:26:55.571571+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:36:23.479706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"71'4","reported_seq":14,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.569158+0000","last_change":"2024-04-02T07:26:55.140943+0000","last_active":"2024-04-02T07:26:55.569158+0000","last_peered":"2024-04-02T07:26:55.569158+0000","last_clean":"2024-04-02T07:26:55.569158+0000","last_became_active":"2024-04-02T07:26:55.140641+0000","last_became_peered":"2024-04-02T07:26:55.140641+0000","last_unstale":"2024-04-02T07:26:55.569158+0000","last_undegraded":"2024-04-02T07:26:55.569158+0000","last_fullsized":"2024-04-02T07:26:55.569158+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:40:43.109858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566797+0000","last_change":"2024-04-02T07:26:55.562400+0000","last_active":"2024-04-02T07:26:55.566797+0000","last_peered":"2024-04-02T07:26:55.566797+0000","last_clean":"2024-04-02T07:26:55.566797+0000","last_became_active":"2024-04-02T07:26:55.561971+0000","last_became_peered":"2024-04-02T07:26:55.561971+0000","last_unstale":"2024-04-02T07:26:55.566797+0000","last_undegraded":"2024-04-02T07:26:55.566797+0000","last_fullsized":"2024-04-02T07:26:55.566797+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:43:03.581785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.561890+0000","last_change":"2024-04-02T07:26:55.139123+0000","last_active":"2024-04-02T07:26:55.561890+0000","last_peered":"2024-04-02T07:26:55.561890+0000","last_clean":"2024-04-02T07:26:55.561890+0000","last_became_active":"2024-04-02T07:26:55.138768+0000","last_became_peered":"2024-04-02T07:26:55.138768+0000","last_unstale":"2024-04-02T07:26:55.561890+0000","last_undegraded":"2024-04-02T07:26:55.561890+0000","last_fullsized":"2024-04-02T07:26:55.561890+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:00:34.914262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.559951+0000","last_change":"2024-04-02T07:26:55.555325+0000","last_active":"2024-04-02T07:26:55.559951+0000","last_peered":"2024-04-02T07:26:55.559951+0000","last_clean":"2024-04-02T07:26:55.559951+0000","last_became_active":"2024-04-02T07:26:55.554995+0000","last_became_peered":"2024-04-02T07:26:55.554995+0000","last_unstale":"2024-04-02T07:26:55.559951+0000","last_undegraded":"2024-04-02T07:26:55.559951+0000","last_fullsized":"2024-04-02T07:26:55.559951+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:59:47.185971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.567841+0000","last_change":"2024-04-02T07:26:55.131778+0000","last_active":"2024-04-02T07:26:55.567841+0000","last_peered":"2024-04-02T07:26:55.567841+0000","last_clean":"2024-04-02T07:26:55.567841+0000","last_became_active":"2024-04-02T07:26:55.131492+0000","last_became_peered":"2024-04-02T07:26:55.131492+0000","last_unstale":"2024-04-02T07:26:55.567841+0000","last_undegraded":"2024-04-02T07:26:55.567841+0000","last_fullsized":"2024-04-02T07:26:55.567841+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:36:09.865994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.567217+0000","last_change":"2024-04-02T07:26:55.560809+0000","last_active":"2024-04-02T07:26:55.567217+0000","last_peered":"2024-04-02T07:26:55.567217+0000","last_clean":"2024-04-02T07:26:55.567217+0000","last_became_active":"2024-04-02T07:26:55.560527+0000","last_became_peered":"2024-04-02T07:26:55.560527+0000","last_unstale":"2024-04-02T07:26:55.567217+0000","last_undegraded":"2024-04-02T07:26:55.567217+0000","last_fullsized":"2024-04-02T07:26:55.567217+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:17:47.619696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.559136+0000","last_change":"2024-04-02T07:26:55.140927+0000","last_active":"2024-04-02T07:26:55.559136+0000","last_peered":"2024-04-02T07:26:55.559136+0000","last_clean":"2024-04-02T07:26:55.559136+0000","last_became_active":"2024-04-02T07:26:55.140600+0000","last_became_peered":"2024-04-02T07:26:55.140600+0000","last_unstale":"2024-04-02T07:26:55.559136+0000","last_undegraded":"2024-04-02T07:26:55.559136+0000","last_fullsized":"2024-04-02T07:26:55.559136+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:44:29.844247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.570372+0000","last_change":"2024-04-02T07:26:55.566588+0000","last_active":"2024-04-02T07:26:55.570372+0000","last_peered":"2024-04-02T07:26:55.570372+0000","last_clean":"2024-04-02T07:26:55.570372+0000","last_became_active":"2024-04-02T07:26:55.560256+0000","last_became_peered":"2024-04-02T07:26:55.560256+0000","last_unstale":"2024-04-02T07:26:55.570372+0000","last_undegraded":"2024-04-02T07:26:55.570372+0000","last_fullsized":"2024-04-02T07:26:55.570372+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:06:07.970840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.565960+0000","last_change":"2024-04-02T07:26:55.122131+0000","last_active":"2024-04-02T07:26:55.565960+0000","last_peered":"2024-04-02T07:26:55.565960+0000","last_clean":"2024-04-02T07:26:55.565960+0000","last_became_active":"2024-04-02T07:26:55.121661+0000","last_became_peered":"2024-04-02T07:26:55.121661+0000","last_unstale":"2024-04-02T07:26:55.565960+0000","last_undegraded":"2024-04-02T07:26:55.565960+0000","last_fullsized":"2024-04-02T07:26:55.565960+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:24:46.173824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566036+0000","last_change":"2024-04-02T07:26:55.555864+0000","last_active":"2024-04-02T07:26:55.566036+0000","last_peered":"2024-04-02T07:26:55.566036+0000","last_clean":"2024-04-02T07:26:55.566036+0000","last_became_active":"2024-04-02T07:26:55.555522+0000","last_became_peered":"2024-04-02T07:26:55.555522+0000","last_unstale":"2024-04-02T07:26:55.566036+0000","last_undegraded":"2024-04-02T07:26:55.566036+0000","last_fullsized":"2024-04-02T07:26:55.566036+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:03:24.285790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.564414+0000","last_change":"2024-04-02T07:26:55.142458+0000","last_active":"2024-04-02T07:26:55.564414+0000","last_peered":"2024-04-02T07:26:55.564414+0000","last_clean":"2024-04-02T07:26:55.564414+0000","last_became_active":"2024-04-02T07:26:55.142197+0000","last_became_peered":"2024-04-02T07:26:55.142197+0000","last_unstale":"2024-04-02T07:26:55.564414+0000","last_undegraded":"2024-04-02T07:26:55.564414+0000","last_fullsized":"2024-04-02T07:26:55.564414+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:35:01.659688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.559377+0000","last_change":"2024-04-02T07:26:55.555935+0000","last_active":"2024-04-02T07:26:55.559377+0000","last_peered":"2024-04-02T07:26:55.559377+0000","last_clean":"2024-04-02T07:26:55.559377+0000","last_became_active":"2024-04-02T07:26:55.555672+0000","last_became_peered":"2024-04-02T07:26:55.555672+0000","last_unstale":"2024-04-02T07:26:55.559377+0000","last_undegraded":"2024-04-02T07:26:55.559377+0000","last_fullsized":"2024-04-02T07:26:55.559377+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:46:35.449383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.538556+0000","last_change":"2024-04-02T07:26:55.126027+0000","last_active":"2024-04-02T07:26:55.538556+0000","last_peered":"2024-04-02T07:26:55.538556+0000","last_clean":"2024-04-02T07:26:55.538556+0000","last_became_active":"2024-04-02T07:26:55.125588+0000","last_became_peered":"2024-04-02T07:26:55.125588+0000","last_unstale":"2024-04-02T07:26:55.538556+0000","last_undegraded":"2024-04-02T07:26:55.538556+0000","last_fullsized":"2024-04-02T07:26:55.538556+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:43:02.578994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.559711+0000","last_change":"2024-04-02T07:26:55.554587+0000","last_active":"2024-04-02T07:26:55.559711+0000","last_peered":"2024-04-02T07:26:55.559711+0000","last_clean":"2024-04-02T07:26:55.559711+0000","last_became_active":"2024-04-02T07:26:55.554351+0000","last_became_peered":"2024-04-02T07:26:55.554351+0000","last_unstale":"2024-04-02T07:26:55.559711+0000","last_undegraded":"2024-04-02T07:26:55.559711+0000","last_fullsized":"2024-04-02T07:26:55.559711+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:33:17.008424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.545179+0000","last_change":"2024-04-02T07:26:55.134187+0000","last_active":"2024-04-02T07:26:55.545179+0000","last_peered":"2024-04-02T07:26:55.545179+0000","last_clean":"2024-04-02T07:26:55.545179+0000","last_became_active":"2024-04-02T07:26:55.133763+0000","last_became_peered":"2024-04-02T07:26:55.133763+0000","last_unstale":"2024-04-02T07:26:55.545179+0000","last_undegraded":"2024-04-02T07:26:55.545179+0000","last_fullsized":"2024-04-02T07:26:55.545179+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:09:36.184976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.568704+0000","last_change":"2024-04-02T07:26:55.559549+0000","last_active":"2024-04-02T07:26:55.568704+0000","last_peered":"2024-04-02T07:26:55.568704+0000","last_clean":"2024-04-02T07:26:55.568704+0000","last_became_active":"2024-04-02T07:26:55.559283+0000","last_became_peered":"2024-04-02T07:26:55.559283+0000","last_unstale":"2024-04-02T07:26:55.568704+0000","last_undegraded":"2024-04-02T07:26:55.568704+0000","last_fullsized":"2024-04-02T07:26:55.568704+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:40:44.112650+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.537621+0000","last_change":"2024-04-02T07:26:55.121970+0000","last_active":"2024-04-02T07:26:55.537621+0000","last_peered":"2024-04-02T07:26:55.537621+0000","last_clean":"2024-04-02T07:26:55.537621+0000","last_became_active":"2024-04-02T07:26:55.121381+0000","last_became_peered":"2024-04-02T07:26:55.121381+0000","last_unstale":"2024-04-02T07:26:55.537621+0000","last_undegraded":"2024-04-02T07:26:55.537621+0000","last_fullsized":"2024-04-02T07:26:55.537621+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:20:16.244811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.571732+0000","last_change":"2024-04-02T07:26:55.569973+0000","last_active":"2024-04-02T07:26:55.571732+0000","last_peered":"2024-04-02T07:26:55.571732+0000","last_clean":"2024-04-02T07:26:55.571732+0000","last_became_active":"2024-04-02T07:26:55.569488+0000","last_became_peered":"2024-04-02T07:26:55.569488+0000","last_unstale":"2024-04-02T07:26:55.571732+0000","last_undegraded":"2024-04-02T07:26:55.571732+0000","last_fullsized":"2024-04-02T07:26:55.571732+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:25.905083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.544859+0000","last_change":"2024-04-02T07:26:55.132553+0000","last_active":"2024-04-02T07:26:55.544859+0000","last_peered":"2024-04-02T07:26:55.544859+0000","last_clean":"2024-04-02T07:26:55.544859+0000","last_became_active":"2024-04-02T07:26:55.131895+0000","last_became_peered":"2024-04-02T07:26:55.131895+0000","last_unstale":"2024-04-02T07:26:55.544859+0000","last_undegraded":"2024-04-02T07:26:55.544859+0000","last_fullsized":"2024-04-02T07:26:55.544859+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:51:57.688849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566564+0000","last_change":"2024-04-02T07:26:55.562073+0000","last_active":"2024-04-02T07:26:55.566564+0000","last_peered":"2024-04-02T07:26:55.566564+0000","last_clean":"2024-04-02T07:26:55.566564+0000","last_became_active":"2024-04-02T07:26:55.561826+0000","last_became_peered":"2024-04-02T07:26:55.561826+0000","last_unstale":"2024-04-02T07:26:55.566564+0000","last_undegraded":"2024-04-02T07:26:55.566564+0000","last_fullsized":"2024-04-02T07:26:55.566564+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:49:45.785181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"71'3","reported_seq":13,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.563188+0000","last_change":"2024-04-02T07:26:55.129033+0000","last_active":"2024-04-02T07:26:55.563188+0000","last_peered":"2024-04-02T07:26:55.563188+0000","last_clean":"2024-04-02T07:26:55.563188+0000","last_became_active":"2024-04-02T07:26:55.128756+0000","last_became_peered":"2024-04-02T07:26:55.128756+0000","last_unstale":"2024-04-02T07:26:55.563188+0000","last_undegraded":"2024-04-02T07:26:55.563188+0000","last_fullsized":"2024-04-02T07:26:55.563188+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:33:16.005633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.557142+0000","last_change":"2024-04-02T07:26:55.553378+0000","last_active":"2024-04-02T07:26:55.557142+0000","last_peered":"2024-04-02T07:26:55.557142+0000","last_clean":"2024-04-02T07:26:55.557142+0000","last_became_active":"2024-04-02T07:26:55.552510+0000","last_became_peered":"2024-04-02T07:26:55.552510+0000","last_unstale":"2024-04-02T07:26:55.557142+0000","last_undegraded":"2024-04-02T07:26:55.557142+0000","last_fullsized":"2024-04-02T07:26:55.557142+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:10:01.053910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"71'6","reported_seq":16,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.569402+0000","last_change":"2024-04-02T07:26:55.135420+0000","last_active":"2024-04-02T07:26:55.569402+0000","last_peered":"2024-04-02T07:26:55.569402+0000","last_clean":"2024-04-02T07:26:55.569402+0000","last_became_active":"2024-04-02T07:26:55.134895+0000","last_became_peered":"2024-04-02T07:26:55.134895+0000","last_unstale":"2024-04-02T07:26:55.569402+0000","last_undegraded":"2024-04-02T07:26:55.569402+0000","last_fullsized":"2024-04-02T07:26:55.569402+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:07:51.024426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.567542+0000","last_change":"2024-04-02T07:26:55.563205+0000","last_active":"2024-04-02T07:26:55.567542+0000","last_peered":"2024-04-02T07:26:55.567542+0000","last_clean":"2024-04-02T07:26:55.567542+0000","last_became_active":"2024-04-02T07:26:55.562951+0000","last_became_peered":"2024-04-02T07:26:55.562951+0000","last_unstale":"2024-04-02T07:26:55.567542+0000","last_undegraded":"2024-04-02T07:26:55.567542+0000","last_fullsized":"2024-04-02T07:26:55.567542+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:35:54.923733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.563841+0000","last_change":"2024-04-02T07:26:55.129263+0000","last_active":"2024-04-02T07:26:55.563841+0000","last_peered":"2024-04-02T07:26:55.563841+0000","last_clean":"2024-04-02T07:26:55.563841+0000","last_became_active":"2024-04-02T07:26:55.128943+0000","last_became_peered":"2024-04-02T07:26:55.128943+0000","last_unstale":"2024-04-02T07:26:55.563841+0000","last_undegraded":"2024-04-02T07:26:55.563841+0000","last_fullsized":"2024-04-02T07:26:55.563841+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:11:02.945262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566447+0000","last_change":"2024-04-02T07:26:55.554753+0000","last_active":"2024-04-02T07:26:55.566447+0000","last_peered":"2024-04-02T07:26:55.566447+0000","last_clean":"2024-04-02T07:26:55.566447+0000","last_became_active":"2024-04-02T07:26:55.554466+0000","last_became_peered":"2024-04-02T07:26:55.554466+0000","last_unstale":"2024-04-02T07:26:55.566447+0000","last_undegraded":"2024-04-02T07:26:55.566447+0000","last_fullsized":"2024-04-02T07:26:55.566447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:03:24.285790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.543693+0000","last_change":"2024-04-02T07:26:55.140635+0000","last_active":"2024-04-02T07:26:55.543693+0000","last_peered":"2024-04-02T07:26:55.543693+0000","last_clean":"2024-04-02T07:26:55.543693+0000","last_became_active":"2024-04-02T07:26:55.140327+0000","last_became_peered":"2024-04-02T07:26:55.140327+0000","last_unstale":"2024-04-02T07:26:55.543693+0000","last_undegraded":"2024-04-02T07:26:55.543693+0000","last_fullsized":"2024-04-02T07:26:55.543693+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:56:23.779984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.567342+0000","last_change":"2024-04-02T07:26:55.564555+0000","last_active":"2024-04-02T07:26:55.567342+0000","last_peered":"2024-04-02T07:26:55.567342+0000","last_clean":"2024-04-02T07:26:55.567342+0000","last_became_active":"2024-04-02T07:26:55.564294+0000","last_became_peered":"2024-04-02T07:26:55.564294+0000","last_unstale":"2024-04-02T07:26:55.567342+0000","last_undegraded":"2024-04-02T07:26:55.567342+0000","last_fullsized":"2024-04-02T07:26:55.567342+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:24:47.176616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.544658+0000","last_change":"2024-04-02T07:26:55.141789+0000","last_active":"2024-04-02T07:26:55.544658+0000","last_peered":"2024-04-02T07:26:55.544658+0000","last_clean":"2024-04-02T07:26:55.544658+0000","last_became_active":"2024-04-02T07:26:55.141470+0000","last_became_peered":"2024-04-02T07:26:55.141470+0000","last_unstale":"2024-04-02T07:26:55.544658+0000","last_undegraded":"2024-04-02T07:26:55.544658+0000","last_fullsized":"2024-04-02T07:26:55.544658+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:23:01.660123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.561272+0000","last_change":"2024-04-02T07:26:55.558676+0000","last_active":"2024-04-02T07:26:55.561272+0000","last_peered":"2024-04-02T07:26:55.561272+0000","last_clean":"2024-04-02T07:26:55.561272+0000","last_became_active":"2024-04-02T07:26:55.558443+0000","last_became_peered":"2024-04-02T07:26:55.558443+0000","last_unstale":"2024-04-02T07:26:55.561272+0000","last_undegraded":"2024-04-02T07:26:55.561272+0000","last_fullsized":"2024-04-02T07:26:55.561272+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:44:48.005855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"71'8","reported_seq":18,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.572394+0000","last_change":"2024-04-02T07:26:55.133669+0000","last_active":"2024-04-02T07:26:55.572394+0000","last_peered":"2024-04-02T07:26:55.572394+0000","last_clean":"2024-04-02T07:26:55.572394+0000","last_became_active":"2024-04-02T07:26:55.133420+0000","last_became_peered":"2024-04-02T07:26:55.133420+0000","last_unstale":"2024-04-02T07:26:55.572394+0000","last_undegraded":"2024-04-02T07:26:55.572394+0000","last_fullsized":"2024-04-02T07:26:55.572394+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:38:24.642284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.556578+0000","last_change":"2024-04-02T07:26:55.550003+0000","last_active":"2024-04-02T07:26:55.556578+0000","last_peered":"2024-04-02T07:26:55.556578+0000","last_clean":"2024-04-02T07:26:55.556578+0000","last_became_active":"2024-04-02T07:26:55.549113+0000","last_became_peered":"2024-04-02T07:26:55.549113+0000","last_unstale":"2024-04-02T07:26:55.556578+0000","last_undegraded":"2024-04-02T07:26:55.556578+0000","last_fullsized":"2024-04-02T07:26:55.556578+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:49:45.785181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.565717+0000","last_change":"2024-04-02T07:26:55.136973+0000","last_active":"2024-04-02T07:26:55.565717+0000","last_peered":"2024-04-02T07:26:55.565717+0000","last_clean":"2024-04-02T07:26:55.565717+0000","last_became_active":"2024-04-02T07:26:55.136699+0000","last_became_peered":"2024-04-02T07:26:55.136699+0000","last_unstale":"2024-04-02T07:26:55.565717+0000","last_undegraded":"2024-04-02T07:26:55.565717+0000","last_fullsized":"2024-04-02T07:26:55.565717+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:45:33.303503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.569248+0000","last_change":"2024-04-02T07:26:55.562959+0000","last_active":"2024-04-02T07:26:55.569248+0000","last_peered":"2024-04-02T07:26:55.569248+0000","last_clean":"2024-04-02T07:26:55.569248+0000","last_became_active":"2024-04-02T07:26:55.562267+0000","last_became_peered":"2024-04-02T07:26:55.562267+0000","last_unstale":"2024-04-02T07:26:55.569248+0000","last_undegraded":"2024-04-02T07:26:55.569248+0000","last_fullsized":"2024-04-02T07:26:55.569248+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:06:17.075180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.570772+0000","last_change":"2024-04-02T07:26:55.132776+0000","last_active":"2024-04-02T07:26:55.570772+0000","last_peered":"2024-04-02T07:26:55.570772+0000","last_clean":"2024-04-02T07:26:55.570772+0000","last_became_active":"2024-04-02T07:26:55.132477+0000","last_became_peered":"2024-04-02T07:26:55.132477+0000","last_unstale":"2024-04-02T07:26:55.570772+0000","last_undegraded":"2024-04-02T07:26:55.570772+0000","last_fullsized":"2024-04-02T07:26:55.570772+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:51:57.688849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.558012+0000","last_change":"2024-04-02T07:26:55.553061+0000","last_active":"2024-04-02T07:26:55.558012+0000","last_peered":"2024-04-02T07:26:55.558012+0000","last_clean":"2024-04-02T07:26:55.558012+0000","last_became_active":"2024-04-02T07:26:55.552611+0000","last_became_peered":"2024-04-02T07:26:55.552611+0000","last_unstale":"2024-04-02T07:26:55.558012+0000","last_undegraded":"2024-04-02T07:26:55.558012+0000","last_fullsized":"2024-04-02T07:26:55.558012+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:45:34.306295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"71'1","reported_seq":11,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.567636+0000","last_change":"2024-04-02T07:26:55.135245+0000","last_active":"2024-04-02T07:26:55.567636+0000","last_peered":"2024-04-02T07:26:55.567636+0000","last_clean":"2024-04-02T07:26:55.567636+0000","last_became_active":"2024-04-02T07:26:55.134878+0000","last_became_peered":"2024-04-02T07:26:55.134878+0000","last_unstale":"2024-04-02T07:26:55.567636+0000","last_undegraded":"2024-04-02T07:26:55.567636+0000","last_fullsized":"2024-04-02T07:26:55.567636+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:00:05.487395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.557162+0000","last_change":"2024-04-02T07:26:55.553419+0000","last_active":"2024-04-02T07:26:55.557162+0000","last_peered":"2024-04-02T07:26:55.557162+0000","last_clean":"2024-04-02T07:26:55.557162+0000","last_became_active":"2024-04-02T07:26:55.553192+0000","last_became_peered":"2024-04-02T07:26:55.553192+0000","last_unstale":"2024-04-02T07:26:55.557162+0000","last_undegraded":"2024-04-02T07:26:55.557162+0000","last_fullsized":"2024-04-02T07:26:55.557162+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:18:41.669297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.550607+0000","last_change":"2024-04-02T07:26:55.134447+0000","last_active":"2024-04-02T07:26:55.550607+0000","last_peered":"2024-04-02T07:26:55.550607+0000","last_clean":"2024-04-02T07:26:55.550607+0000","last_became_active":"2024-04-02T07:26:55.134135+0000","last_became_peered":"2024-04-02T07:26:55.134135+0000","last_unstale":"2024-04-02T07:26:55.550607+0000","last_undegraded":"2024-04-02T07:26:55.550607+0000","last_fullsized":"2024-04-02T07:26:55.550607+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:49:44.782390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.561506+0000","last_change":"2024-04-02T07:26:55.547872+0000","last_active":"2024-04-02T07:26:55.561506+0000","last_peered":"2024-04-02T07:26:55.561506+0000","last_clean":"2024-04-02T07:26:55.561506+0000","last_became_active":"2024-04-02T07:26:55.547607+0000","last_became_peered":"2024-04-02T07:26:55.547607+0000","last_unstale":"2024-04-02T07:26:55.561506+0000","last_undegraded":"2024-04-02T07:26:55.561506+0000","last_fullsized":"2024-04-02T07:26:55.561506+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:30.445895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.543810+0000","last_change":"2024-04-02T07:26:55.143130+0000","last_active":"2024-04-02T07:26:55.543810+0000","last_peered":"2024-04-02T07:26:55.543810+0000","last_clean":"2024-04-02T07:26:55.543810+0000","last_became_active":"2024-04-02T07:26:55.142936+0000","last_became_peered":"2024-04-02T07:26:55.142936+0000","last_unstale":"2024-04-02T07:26:55.543810+0000","last_undegraded":"2024-04-02T07:26:55.543810+0000","last_fullsized":"2024-04-02T07:26:55.543810+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:46:55.823866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.562169+0000","last_change":"2024-04-02T07:26:55.555468+0000","last_active":"2024-04-02T07:26:55.562169+0000","last_peered":"2024-04-02T07:26:55.562169+0000","last_clean":"2024-04-02T07:26:55.562169+0000","last_became_active":"2024-04-02T07:26:55.554565+0000","last_became_peered":"2024-04-02T07:26:55.554565+0000","last_unstale":"2024-04-02T07:26:55.562169+0000","last_undegraded":"2024-04-02T07:26:55.562169+0000","last_fullsized":"2024-04-02T07:26:55.562169+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:25.905083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.544769+0000","last_change":"2024-04-02T07:26:55.135999+0000","last_active":"2024-04-02T07:26:55.544769+0000","last_peered":"2024-04-02T07:26:55.544769+0000","last_clean":"2024-04-02T07:26:55.544769+0000","last_became_active":"2024-04-02T07:26:55.135604+0000","last_became_peered":"2024-04-02T07:26:55.135604+0000","last_unstale":"2024-04-02T07:26:55.544769+0000","last_undegraded":"2024-04-02T07:26:55.544769+0000","last_fullsized":"2024-04-02T07:26:55.544769+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:44:07.154577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.562426+0000","last_change":"2024-04-02T07:26:55.556726+0000","last_active":"2024-04-02T07:26:55.562426+0000","last_peered":"2024-04-02T07:26:55.562426+0000","last_clean":"2024-04-02T07:26:55.562426+0000","last_became_active":"2024-04-02T07:26:55.556466+0000","last_became_peered":"2024-04-02T07:26:55.556466+0000","last_unstale":"2024-04-02T07:26:55.562426+0000","last_undegraded":"2024-04-02T07:26:55.562426+0000","last_fullsized":"2024-04-02T07:26:55.562426+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:39:20.897683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.544137+0000","last_change":"2024-04-02T07:26:55.135780+0000","last_active":"2024-04-02T07:26:55.544137+0000","last_peered":"2024-04-02T07:26:55.544137+0000","last_clean":"2024-04-02T07:26:55.544137+0000","last_became_active":"2024-04-02T07:26:55.135458+0000","last_became_peered":"2024-04-02T07:26:55.135458+0000","last_unstale":"2024-04-02T07:26:55.544137+0000","last_undegraded":"2024-04-02T07:26:55.544137+0000","last_fullsized":"2024-04-02T07:26:55.544137+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:33:36.301144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.565512+0000","last_change":"2024-04-02T07:26:55.563785+0000","last_active":"2024-04-02T07:26:55.565512+0000","last_peered":"2024-04-02T07:26:55.565512+0000","last_clean":"2024-04-02T07:26:55.565512+0000","last_became_active":"2024-04-02T07:26:55.563540+0000","last_became_peered":"2024-04-02T07:26:55.563540+0000","last_unstale":"2024-04-02T07:26:55.565512+0000","last_undegraded":"2024-04-02T07:26:55.565512+0000","last_fullsized":"2024-04-02T07:26:55.565512+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:41:13.484059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.566079+0000","last_change":"2024-04-02T07:26:55.136738+0000","last_active":"2024-04-02T07:26:55.566079+0000","last_peered":"2024-04-02T07:26:55.566079+0000","last_clean":"2024-04-02T07:26:55.566079+0000","last_became_active":"2024-04-02T07:26:55.136361+0000","last_became_peered":"2024-04-02T07:26:55.136361+0000","last_unstale":"2024-04-02T07:26:55.566079+0000","last_undegraded":"2024-04-02T07:26:55.566079+0000","last_fullsized":"2024-04-02T07:26:55.566079+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:35:29.337331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.565576+0000","last_change":"2024-04-02T07:26:55.555964+0000","last_active":"2024-04-02T07:26:55.565576+0000","last_peered":"2024-04-02T07:26:55.565576+0000","last_clean":"2024-04-02T07:26:55.565576+0000","last_became_active":"2024-04-02T07:26:55.555711+0000","last_became_peered":"2024-04-02T07:26:55.555711+0000","last_unstale":"2024-04-02T07:26:55.565576+0000","last_undegraded":"2024-04-02T07:26:55.565576+0000","last_fullsized":"2024-04-02T07:26:55.565576+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:08:46.605892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.545357+0000","last_change":"2024-04-02T07:26:55.142193+0000","last_active":"2024-04-02T07:26:55.545357+0000","last_peered":"2024-04-02T07:26:55.545357+0000","last_clean":"2024-04-02T07:26:55.545357+0000","last_became_active":"2024-04-02T07:26:55.141075+0000","last_became_peered":"2024-04-02T07:26:55.141075+0000","last_unstale":"2024-04-02T07:26:55.545357+0000","last_undegraded":"2024-04-02T07:26:55.545357+0000","last_fullsized":"2024-04-02T07:26:55.545357+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:10:38.596186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.570217+0000","last_change":"2024-04-02T07:26:55.564048+0000","last_active":"2024-04-02T07:26:55.570217+0000","last_peered":"2024-04-02T07:26:55.570217+0000","last_clean":"2024-04-02T07:26:55.570217+0000","last_became_active":"2024-04-02T07:26:55.563596+0000","last_became_peered":"2024-04-02T07:26:55.563596+0000","last_unstale":"2024-04-02T07:26:55.570217+0000","last_undegraded":"2024-04-02T07:26:55.570217+0000","last_fullsized":"2024-04-02T07:26:55.570217+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:40:15.917351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.545762+0000","last_change":"2024-04-02T07:26:55.140142+0000","last_active":"2024-04-02T07:26:55.545762+0000","last_peered":"2024-04-02T07:26:55.545762+0000","last_clean":"2024-04-02T07:26:55.545762+0000","last_became_active":"2024-04-02T07:26:55.139839+0000","last_became_peered":"2024-04-02T07:26:55.139839+0000","last_unstale":"2024-04-02T07:26:55.545762+0000","last_undegraded":"2024-04-02T07:26:55.545762+0000","last_fullsized":"2024-04-02T07:26:55.545762+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:17:53.590832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.572381+0000","last_change":"2024-04-02T07:26:55.570038+0000","last_active":"2024-04-02T07:26:55.572381+0000","last_peered":"2024-04-02T07:26:55.572381+0000","last_clean":"2024-04-02T07:26:55.572381+0000","last_became_active":"2024-04-02T07:26:55.569519+0000","last_became_peered":"2024-04-02T07:26:55.569519+0000","last_unstale":"2024-04-02T07:26:55.572381+0000","last_undegraded":"2024-04-02T07:26:55.572381+0000","last_fullsized":"2024-04-02T07:26:55.572381+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:10:49.028400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.544675+0000","last_change":"2024-04-02T07:26:55.133763+0000","last_active":"2024-04-02T07:26:55.544675+0000","last_peered":"2024-04-02T07:26:55.544675+0000","last_clean":"2024-04-02T07:26:55.544675+0000","last_became_active":"2024-04-02T07:26:55.133498+0000","last_became_peered":"2024-04-02T07:26:55.133498+0000","last_unstale":"2024-04-02T07:26:55.544675+0000","last_undegraded":"2024-04-02T07:26:55.544675+0000","last_fullsized":"2024-04-02T07:26:55.544675+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:59:46.183180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.563973+0000","last_change":"2024-04-02T07:26:55.560488+0000","last_active":"2024-04-02T07:26:55.563973+0000","last_peered":"2024-04-02T07:26:55.563973+0000","last_clean":"2024-04-02T07:26:55.563973+0000","last_became_active":"2024-04-02T07:26:55.560203+0000","last_became_peered":"2024-04-02T07:26:55.560203+0000","last_unstale":"2024-04-02T07:26:55.563973+0000","last_undegraded":"2024-04-02T07:26:55.563973+0000","last_fullsized":"2024-04-02T07:26:55.563973+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:29:34.917878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.545385+0000","last_change":"2024-04-02T07:26:55.130331+0000","last_active":"2024-04-02T07:26:55.545385+0000","last_peered":"2024-04-02T07:26:55.545385+0000","last_clean":"2024-04-02T07:26:55.545385+0000","last_became_active":"2024-04-02T07:26:55.129988+0000","last_became_peered":"2024-04-02T07:26:55.129988+0000","last_unstale":"2024-04-02T07:26:55.545385+0000","last_undegraded":"2024-04-02T07:26:55.545385+0000","last_fullsized":"2024-04-02T07:26:55.545385+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:05:20.023359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.570981+0000","last_change":"2024-04-02T07:26:55.567697+0000","last_active":"2024-04-02T07:26:55.570981+0000","last_peered":"2024-04-02T07:26:55.570981+0000","last_clean":"2024-04-02T07:26:55.570981+0000","last_became_active":"2024-04-02T07:26:55.564797+0000","last_became_peered":"2024-04-02T07:26:55.564797+0000","last_unstale":"2024-04-02T07:26:55.570981+0000","last_undegraded":"2024-04-02T07:26:55.570981+0000","last_fullsized":"2024-04-02T07:26:55.570981+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:42:43.011738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.538613+0000","last_change":"2024-04-02T07:26:55.124379+0000","last_active":"2024-04-02T07:26:55.538613+0000","last_peered":"2024-04-02T07:26:55.538613+0000","last_clean":"2024-04-02T07:26:55.538613+0000","last_became_active":"2024-04-02T07:26:55.122838+0000","last_became_peered":"2024-04-02T07:26:55.122838+0000","last_unstale":"2024-04-02T07:26:55.538613+0000","last_undegraded":"2024-04-02T07:26:55.538613+0000","last_fullsized":"2024-04-02T07:26:55.538613+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:00:12.784268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.555476+0000","last_change":"2024-04-02T07:26:55.548084+0000","last_active":"2024-04-02T07:26:55.555476+0000","last_peered":"2024-04-02T07:26:55.555476+0000","last_clean":"2024-04-02T07:26:55.555476+0000","last_became_active":"2024-04-02T07:26:55.547740+0000","last_became_peered":"2024-04-02T07:26:55.547740+0000","last_unstale":"2024-04-02T07:26:55.555476+0000","last_undegraded":"2024-04-02T07:26:55.555476+0000","last_fullsized":"2024-04-02T07:26:55.555476+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:35:30.340123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.537121+0000","last_change":"2024-04-02T07:26:55.134207+0000","last_active":"2024-04-02T07:26:55.537121+0000","last_peered":"2024-04-02T07:26:55.537121+0000","last_clean":"2024-04-02T07:26:55.537121+0000","last_became_active":"2024-04-02T07:26:55.133870+0000","last_became_peered":"2024-04-02T07:26:55.133870+0000","last_unstale":"2024-04-02T07:26:55.537121+0000","last_undegraded":"2024-04-02T07:26:55.537121+0000","last_fullsized":"2024-04-02T07:26:55.537121+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:12:55.949533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.570152+0000","last_change":"2024-04-02T07:26:55.565711+0000","last_active":"2024-04-02T07:26:55.570152+0000","last_peered":"2024-04-02T07:26:55.570152+0000","last_clean":"2024-04-02T07:26:55.570152+0000","last_became_active":"2024-04-02T07:26:55.565306+0000","last_became_peered":"2024-04-02T07:26:55.565306+0000","last_unstale":"2024-04-02T07:26:55.570152+0000","last_undegraded":"2024-04-02T07:26:55.570152+0000","last_fullsized":"2024-04-02T07:26:55.570152+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:53:45.552348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.546158+0000","last_change":"2024-04-02T07:26:55.142287+0000","last_active":"2024-04-02T07:26:55.546158+0000","last_peered":"2024-04-02T07:26:55.546158+0000","last_clean":"2024-04-02T07:26:55.546158+0000","last_became_active":"2024-04-02T07:26:55.141836+0000","last_became_peered":"2024-04-02T07:26:55.141836+0000","last_unstale":"2024-04-02T07:26:55.546158+0000","last_undegraded":"2024-04-02T07:26:55.546158+0000","last_fullsized":"2024-04-02T07:26:55.546158+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:04:13.736619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.567289+0000","last_change":"2024-04-02T07:26:55.563372+0000","last_active":"2024-04-02T07:26:55.567289+0000","last_peered":"2024-04-02T07:26:55.567289+0000","last_clean":"2024-04-02T07:26:55.567289+0000","last_became_active":"2024-04-02T07:26:55.561047+0000","last_became_peered":"2024-04-02T07:26:55.561047+0000","last_unstale":"2024-04-02T07:26:55.567289+0000","last_undegraded":"2024-04-02T07:26:55.567289+0000","last_fullsized":"2024-04-02T07:26:55.567289+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:55.100540+0000","last_clean_scrub_stamp":"2024-04-02T07:26:55.100540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:52:11.390884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"71'2","reported_seq":12,"reported_epoch":71,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.560559+0000","last_change":"2024-04-02T07:26:55.140819+0000","last_active":"2024-04-02T07:26:55.560559+0000","last_peered":"2024-04-02T07:26:55.560559+0000","last_clean":"2024-04-02T07:26:55.560559+0000","last_became_active":"2024-04-02T07:26:55.140500+0000","last_became_peered":"2024-04-02T07:26:55.140500+0000","last_unstale":"2024-04-02T07:26:55.560559+0000","last_undegraded":"2024-04-02T07:26:55.560559+0000","last_fullsized":"2024-04-02T07:26:55.560559+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":69,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:26:54.097748+0000","last_clean_scrub_stamp":"2024-04-02T07:26:54.097748+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:56:35.734077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":209,"reported_epoch":70,"state":"active+clean","last_fresh":"2024-04-02T07:26:55.126730+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:26:55.126730+0000","last_peered":"2024-04-02T07:26:55.126730+0000","last_clean":"2024-04-02T07:26:55.126730+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:26:55.126730+0000","last_undegraded":"2024-04-02T07:26:55.126730+0000","last_fullsized":"2024-04-02T07:26:55.126730+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574908,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32552,"kb_used_data":1432,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339288,"statfs":{"total":96636764160,"available":96603430912,"internally_reserved":0,"allocated":1466368,"data_stored":954266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.65800000000000003,"15min":0.64600000000000002},"min":{"1min":0.47699999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.92200000000000004,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.64800000000000002,"15min":0.61099999999999999},"min":{"1min":0.47499999999999998,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.83999999999999997,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.748}]},{"osd":1,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.64800000000000002,"15min":0.63},"min":{"1min":0.49199999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.89200000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.67500000000000004,"15min":0.65800000000000003},"min":{"1min":0.496,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.95899999999999996,"5min":1.113,"15min":1.113},"last":0.625}]},{"osd":2,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78400000000000003,"5min":0.752,"15min":0.752},"min":{"1min":0.53900000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.97699999999999998,"5min":1.139,"15min":1.139},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.72999999999999998,"15min":0.72799999999999998},"min":{"1min":0.52600000000000002,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":0.96499999999999997,"5min":1.522,"15min":1.522},"last":0.69399999999999995}]},{"osd":3,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.70799999999999996,"15min":0.70299999999999996},"min":{"1min":0.52400000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.89100000000000001,"5min":1.405,"15min":1.405},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.72299999999999998,"15min":0.72699999999999998},"min":{"1min":0.52800000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.98099999999999998,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.66400000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.65000000000000002,"15min":0.68999999999999995},"min":{"1min":0.441,"5min":0.377,"15min":0.377},"max":{"1min":0.83199999999999996,"5min":1.633,"15min":1.633},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.70299999999999996,"15min":0.73899999999999999},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.78800000000000003,"5min":1.079,"15min":1.079},"last":0.73299999999999998}]},{"osd":5,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.67500000000000004,"15min":0.72499999999999998},"min":{"1min":0.41799999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.85999999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.73999999999999999,"15min":0.78400000000000003},"min":{"1min":0.435,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.89900000000000002,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.86699999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.68999999999999995,"15min":0.73299999999999998},"min":{"1min":0.46200000000000002,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.876,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.624,"5min":0.65800000000000003,"15min":0.70199999999999996},"min":{"1min":0.42799999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.80900000000000005,"5min":1,"15min":1},"last":0.77200000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":851968,"data_stored":356507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.65800000000000003,"15min":0.66200000000000003},"min":{"1min":0.443,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88100000000000001,"5min":1.399,"15min":1.399},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.77400000000000002,"15min":0.88400000000000001},"min":{"1min":0.50800000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.89600000000000002,"5min":5.7569999999999997,"15min":5.7569999999999997},"last":0.82199999999999995}]},{"osd":1,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.72699999999999998},"min":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.91600000000000004,"5min":1.95,"15min":1.95},"last":0.98199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.71699999999999997,"15min":0.72899999999999998},"min":{"1min":0.48999999999999999,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.97599999999999998,"5min":1.248,"15min":1.248},"last":0.752}]},{"osd":2,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.66800000000000004,"15min":0.68899999999999995},"min":{"1min":0.499,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.93000000000000005,"5min":1.226,"15min":1.226},"last":0.83199999999999996},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.70699999999999996,"15min":0.70899999999999996},"min":{"1min":0.47499999999999998,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.83699999999999997,"5min":0.997,"15min":0.997},"last":0.94199999999999995}]},{"osd":3,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.75700000000000001,"15min":0.80700000000000005},"min":{"1min":0.59799999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.83899999999999997,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.747,"15min":0.79300000000000004},"min":{"1min":0.52300000000000002,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":0.93100000000000005,"5min":2.6389999999999998,"15min":2.6389999999999998},"last":0.95399999999999996}]},{"osd":4,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.63700000000000001,"15min":0.66300000000000003},"min":{"1min":0.41399999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88200000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.65400000000000003,"15min":0.66800000000000004},"min":{"1min":0.49099999999999999,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.83099999999999996,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.70599999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.63300000000000001,"15min":0.67300000000000004},"min":{"1min":0.42799999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.74199999999999999,"5min":0.95999999999999996,"15min":0.95999999999999996},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.71199999999999997,"15min":0.73199999999999998},"min":{"1min":0.60799999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85599999999999998,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.623}]},{"osd":7,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.71399999999999997,"15min":0.74199999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.85699999999999998,"5min":1.0209999999999999,"15min":1.0209999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.71499999999999997,"15min":0.74399999999999999},"min":{"1min":0.56499999999999995,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.81399999999999995,"5min":0.999,"15min":0.999},"last":0.67400000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574909,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":363372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.66100000000000003,"15min":0.64900000000000002},"min":{"1min":0.42499999999999999,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83499999999999996,"5min":1.25,"15min":1.25},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.69799999999999995,"15min":0.70599999999999996},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93600000000000005,"5min":1.5289999999999999,"15min":1.5289999999999999},"last":0.53400000000000003}]},{"osd":1,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73299999999999998,"5min":0.69899999999999995,"15min":0.69199999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.94699999999999995,"5min":1.1830000000000001,"15min":1.1830000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.69899999999999995,"15min":0.72099999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.026,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.629}]},{"osd":2,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.78200000000000003,"15min":0.82199999999999995},"min":{"1min":0.504,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.98299999999999998,"5min":1.8280000000000001,"15min":1.8280000000000001},"last":0.753},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.71999999999999997,"15min":0.74399999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.872,"5min":1.696,"15min":1.696},"last":0.73599999999999999}]},{"osd":3,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.73299999999999998,"15min":0.76300000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.90700000000000003,"5min":1.6399999999999999,"15min":1.6399999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.745,"5min":0.76600000000000001,"15min":0.82199999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91300000000000003,"5min":2.0219999999999998,"15min":2.0219999999999998},"last":0.69699999999999995}]},{"osd":4,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.63,"15min":0.71299999999999997},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71699999999999997,"5min":1.911,"15min":1.911},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.68500000000000005,"15min":0.77900000000000003},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.86699999999999999,"5min":1.7829999999999999,"15min":1.7829999999999999},"last":0.71699999999999997}]},{"osd":6,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.73299999999999998,"15min":0.85099999999999998},"min":{"1min":0.44,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83299999999999996,"5min":2.1829999999999998,"15min":2.1829999999999998},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.72699999999999998,"15min":0.83799999999999997},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.76900000000000002,"5min":2.1280000000000001,"15min":2.1280000000000001},"last":0.79100000000000004}]},{"osd":7,"last update":"Tue Apr 2 07:26:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.76300000000000001,"15min":0.86099999999999999},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.92200000000000004,"5min":1.887,"15min":1.887},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.79300000000000004,"15min":0.90800000000000003},"min":{"1min":0.48599999999999999,"5min":0.439,"15min":0.439},"max":{"1min":0.97999999999999998,"5min":2.2599999999999998,"15min":2.2599999999999998},"last":1.0109999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574911,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31964,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339876,"statfs":{"total":96636764160,"available":96604033024,"internally_reserved":0,"allocated":868352,"data_stored":363352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.71399999999999997,"15min":0.748},"min":{"1min":0.48399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.95999999999999996,"5min":2.4929999999999999,"15min":2.4929999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.751,"15min":0.82699999999999996},"min":{"1min":0.58699999999999997,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.88500000000000001,"5min":3.2519999999999998,"15min":3.2519999999999998},"last":0.57899999999999996}]},{"osd":1,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.73299999999999998,"15min":0.76000000000000001},"min":{"1min":0.58899999999999997,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.89900000000000002,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.81200000000000006,"15min":0.91000000000000003},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.94499999999999995,"5min":4.3810000000000002,"15min":4.3810000000000002},"last":0.65900000000000003}]},{"osd":2,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76600000000000001,"15min":0.80200000000000005},"min":{"1min":0.52600000000000002,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.995,"5min":2.056,"15min":2.056},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.80700000000000005,"15min":0.878},"min":{"1min":0.59299999999999997,"5min":0.498,"15min":0.498},"max":{"1min":0.89400000000000002,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.68200000000000005}]},{"osd":3,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.877,"15min":0.996},"min":{"1min":0.58599999999999997,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":0.93700000000000006,"5min":3.9180000000000001,"15min":3.9180000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.79400000000000004,"5min":0.89600000000000002,"15min":1.012},"min":{"1min":0.65600000000000003,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":0.97599999999999998,"5min":3.9750000000000001,"15min":3.9750000000000001},"last":0.70399999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.67800000000000005,"15min":0.71099999999999997},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.84899999999999998,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.70499999999999996,"15min":0.749},"min":{"1min":0.47299999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.73299999999999998,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.73399999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.68799999999999994,"15min":0.71599999999999997},"min":{"1min":0.48299999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79200000000000004,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.748},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.74299999999999999,"15min":0.77700000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.91300000000000003,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.88}]},{"osd":7,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.77700000000000002,"15min":0.80200000000000005},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.82799999999999996,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.752,"5min":0.83799999999999997,"15min":0.86799999999999999},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.93999999999999995,"5min":1.353,"15min":1.353},"last":0.91100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574909,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31968,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339872,"statfs":{"total":96636764160,"available":96604028928,"internally_reserved":0,"allocated":872448,"data_stored":363394,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.433,"15min":0.44900000000000001},"min":{"1min":0.30399999999999999,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.58799999999999997,"5min":0.622,"15min":0.622},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.48299999999999998,"15min":0.48399999999999999},"min":{"1min":0.33200000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.748,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.34899999999999998}]},{"osd":1,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.45100000000000001,"15min":0.44},"min":{"1min":0.32300000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.499,"15min":0.50600000000000001},"min":{"1min":0.35299999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.68500000000000005,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.41199999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.54500000000000004,"15min":0.53200000000000003},"min":{"1min":0.44,"5min":0.374,"15min":0.374},"max":{"1min":0.73699999999999999,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57699999999999996,"15min":0.58899999999999997},"min":{"1min":0.41599999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.75800000000000001,"5min":1.306,"15min":1.306},"last":0.45000000000000001}]},{"osd":4,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.74099999999999999,"15min":0.75800000000000001},"min":{"1min":0.61199999999999999,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.01,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.753,"15min":0.75700000000000001},"min":{"1min":0.54900000000000004,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0089999999999999,"5min":1.155,"15min":1.155},"last":0.46500000000000002}]},{"osd":5,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77300000000000002,"15min":0.77500000000000002},"min":{"1min":0.56899999999999995,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.97399999999999998,"5min":1.198,"15min":1.198},"last":0.501},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.753,"15min":0.747},"min":{"1min":0.61799999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":0.95799999999999996,"5min":1.135,"15min":1.135},"last":0.49199999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.76300000000000001,"15min":0.76900000000000002},"min":{"1min":0.53700000000000003,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.046,"5min":1.25,"15min":1.25},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79000000000000004,"15min":0.78400000000000003},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.0349999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.53800000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.76100000000000001,"15min":0.75900000000000001},"min":{"1min":0.56100000000000005,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":0.99099999999999999,"5min":1.216,"15min":1.216},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.79100000000000004,"15min":0.79700000000000004},"min":{"1min":0.56599999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.077,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.69799999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574909,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31972,"kb_used_data":856,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339868,"statfs":{"total":96636764160,"available":96604024832,"internally_reserved":0,"allocated":876544,"data_stored":364846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.441,"15min":0.45000000000000001},"min":{"1min":0.28699999999999998,"5min":0.253,"15min":0.253},"max":{"1min":0.60299999999999998,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.48399999999999999,"15min":0.48499999999999999},"min":{"1min":0.33700000000000002,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.57799999999999996}]},{"osd":1,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53100000000000003,"15min":0.54400000000000004},"min":{"1min":0.40899999999999997,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.69399999999999995,"5min":1.171,"15min":1.171},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.48999999999999999,"15min":0.49299999999999999},"min":{"1min":0.35899999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.71199999999999997,"5min":1.333,"15min":1.333},"last":0.55200000000000005}]},{"osd":3,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.52600000000000002,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.80000000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56999999999999995,"15min":0.56799999999999995},"min":{"1min":0.41899999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.70299999999999996,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.64500000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76300000000000001,"15min":0.77400000000000002},"min":{"1min":0.52400000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.05,"5min":2.254,"15min":2.254},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.77100000000000002,"15min":0.76800000000000002},"min":{"1min":0.629,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.077,"5min":1.3420000000000001,"15min":1.3420000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.75900000000000001,"15min":0.75900000000000001},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.02,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79800000000000004,"15min":0.81399999999999995},"min":{"1min":0.57499999999999996,"5min":0.443,"15min":0.443},"max":{"1min":1.0700000000000001,"5min":2.0840000000000001,"15min":2.0840000000000001},"last":0.83199999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.85799999999999998,"5min":0.82299999999999995,"15min":0.82599999999999996},"min":{"1min":0.71899999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.0840000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.82799999999999996,"15min":0.82599999999999996},"min":{"1min":0.621,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0680000000000001,"5min":1.425,"15min":1.425},"last":0.85199999999999998}]},{"osd":7,"last update":"Tue Apr 2 07:26:12 2024","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.81699999999999995,"15min":0.83699999999999997},"min":{"1min":0.63500000000000001,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.105,"5min":2.3580000000000001,"15min":2.3580000000000001},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.65300000000000002,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.006,"5min":1.377,"15min":1.377},"last":0.81000000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31980,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339860,"statfs":{"total":96636764160,"available":96604016640,"internally_reserved":0,"allocated":884736,"data_stored":365462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.46200000000000002,"15min":0.48399999999999999},"min":{"1min":0.33400000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.67000000000000004,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.58099999999999996,"15min":0.65100000000000002},"min":{"1min":0.316,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.73099999999999998,"5min":4.157,"15min":4.157},"last":0.27500000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.57399999999999995,"15min":0.66500000000000004},"min":{"1min":0.32600000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70099999999999996,"5min":4.282,"15min":4.282},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.56999999999999995,"15min":0.60799999999999998},"min":{"1min":0.38100000000000001,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.70799999999999996,"5min":1.625,"15min":1.625},"last":0.495}]},{"osd":3,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.60099999999999998,"15min":0.61499999999999999},"min":{"1min":0.42499999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.97299999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.73099999999999998,"15min":0.91200000000000003},"min":{"1min":0.41899999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79200000000000004,"5min":8.1620000000000008,"15min":8.1620000000000008},"last":0.40200000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.86099999999999999,"15min":0.97099999999999997},"min":{"1min":0.56599999999999995,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.997,"5min":4.7400000000000002,"15min":4.7400000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.79400000000000004,"15min":0.82899999999999996},"min":{"1min":0.59799999999999998,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97099999999999997,"5min":1.7070000000000001,"15min":1.7070000000000001},"last":0.64100000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.871,"15min":0.95299999999999996},"min":{"1min":0.61099999999999999,"5min":0.497,"15min":0.497},"max":{"1min":1.0700000000000001,"5min":4.5759999999999996,"15min":4.5759999999999996},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.86699999999999999,"15min":0.95699999999999996},"min":{"1min":0.66600000000000004,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":0.92500000000000004,"5min":4.7949999999999999,"15min":4.7949999999999999},"last":0.69799999999999995}]},{"osd":6,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.89100000000000001,"15min":1.002},"min":{"1min":0.57799999999999996,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.96299999999999997,"5min":4.6890000000000001,"15min":4.6890000000000001},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.88,"15min":0.97899999999999998},"min":{"1min":0.58199999999999996,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.036,"5min":4.6059999999999999,"15min":4.6059999999999999},"last":0.66000000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:26:17 2024","interfaces":[{"interface":"back","average":{"1min":0.78300000000000003,"5min":0.80800000000000005,"15min":0.83999999999999997},"min":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":0.94499999999999995,"5min":1.8759999999999999,"15min":1.8759999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.90200000000000002,"15min":0.98399999999999999},"min":{"1min":0.60899999999999999,"5min":0.5,"15min":0.5},"max":{"1min":1.0580000000000001,"5min":4.6420000000000003,"15min":4.6420000000000003},"last":0.73699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574909,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32540,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1458176,"data_stored":953650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.46000000000000002,"15min":0.47799999999999998},"min":{"1min":0.33800000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71699999999999997,"5min":1.48,"15min":1.48},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.51700000000000002,"15min":0.51300000000000001},"min":{"1min":0.40799999999999997,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.76800000000000002,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.48299999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52200000000000002,"15min":0.52900000000000003},"min":{"1min":0.38400000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71999999999999997,"5min":1.3129999999999999,"15min":1.3129999999999999},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.54300000000000004,"15min":0.52600000000000002},"min":{"1min":0.47899999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.82399999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.434}]},{"osd":3,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.47599999999999998,"15min":0.47299999999999998},"min":{"1min":0.36299999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.68100000000000005,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.504},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.60699999999999998,"15min":0.627},"min":{"1min":0.46000000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.98099999999999998,"5min":1.4430000000000001,"15min":1.4430000000000001},"last":0.56799999999999995}]},{"osd":4,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.747,"15min":0.73599999999999999},"min":{"1min":0.61399999999999999,"5min":0.504,"15min":0.504},"max":{"1min":1.036,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.752,"15min":0.748},"min":{"1min":0.53900000000000003,"5min":0.501,"15min":0.501},"max":{"1min":1.008,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.55400000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78200000000000003,"15min":0.79600000000000004},"min":{"1min":0.61099999999999999,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0289999999999999,"5min":1.371,"15min":1.371},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.82299999999999995,"5min":0.76800000000000002,"15min":0.76700000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.54100000000000004}]},{"osd":6,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.85699999999999998,"5min":0.80000000000000004,"15min":0.80500000000000005},"min":{"1min":0.58799999999999997,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.1719999999999999,"5min":1.177,"15min":1.177},"last":0.64800000000000002},{"interface":"front","average":{"1min":0.89500000000000002,"5min":0.82899999999999996,"15min":0.84699999999999998},"min":{"1min":0.626,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.1839999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.63400000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:26:14 2024","interfaces":[{"interface":"back","average":{"1min":0.83499999999999996,"5min":0.79000000000000004,"15min":0.80000000000000004},"min":{"1min":0.58099999999999996,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":0.98399999999999999,"5min":1.135,"15min":1.135},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.876,"5min":0.79200000000000004,"15min":0.79400000000000004},"min":{"1min":0.63200000000000001,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.1279999999999999,"5min":1.141,"15min":1.141},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:27:00.035 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-02T07:27:00.036 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-02T07:27:00.213 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-04-02T07:27:00.208+0000 7f9e7e400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:27:00.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80f0600640 1 Processor -- start 2024-04-02T07:27:00.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80f0600640 1 -- start start 2024-04-02T07:27:00.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80f0600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f80e80ccf10 0x7f80e80cd2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:00.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80f0600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80e815cd70 0x7f80e80cf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:00.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80f0600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80e806ebc0 con 0x7f80e80afba0 2024-04-02T07:27:00.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80f0600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80e80cd830 con 0x7f80e80ccf10 2024-04-02T07:27:00.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80f0600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80cfd00 con 0x7f80e815cd70 2024-04-02T07:27:00.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80ee600640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f80e80afba0 0x7f80e806f050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35808/0 (socket says 172.21.15.55:35808) 2024-04-02T07:27:00.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80ee600640 1 -- 172.21.15.55:0/1781308337 learned_addr learned my addr 172.21.15.55:0/1781308337 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:27:00.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80edc00640 1 --2- 172.21.15.55:0/1781308337 >> v2:172.21.15.106:3300/0 conn(0x7f80e80ccf10 0x7f80e80cd2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:00.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80ed200640 1 --2- 172.21.15.55:0/1781308337 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80e815cd70 0x7f80e80cf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:00.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80e7e00640 1 -- 172.21.15.55:0/1781308337 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2774373404 0 0) 0x7f80e806ebc0 con 0x7f80e80afba0 2024-04-02T07:27:00.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80e7e00640 1 -- 172.21.15.55:0/1781308337 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80d0003530 con 0x7f80e80afba0 2024-04-02T07:27:00.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80e7e00640 1 -- 172.21.15.55:0/1781308337 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2165013833 0 0) 0x7f80d0003530 con 0x7f80e80afba0 2024-04-02T07:27:00.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80e7e00640 1 -- 172.21.15.55:0/1781308337 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80e815cd70 msgr2=0x7f80e80cf4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:00.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80e7e00640 1 --2- 172.21.15.55:0/1781308337 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80e815cd70 0x7f80e80cf4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80e7e00640 1 -- 172.21.15.55:0/1781308337 >> v2:172.21.15.106:3300/0 conn(0x7f80e80ccf10 msgr2=0x7f80e80cd2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:00.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80e7e00640 1 --2- 172.21.15.55:0/1781308337 >> v2:172.21.15.106:3300/0 conn(0x7f80e80ccf10 0x7f80e80cd2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80e7e00640 1 -- 172.21.15.55:0/1781308337 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e806e290 con 0x7f80e80afba0 2024-04-02T07:27:00.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80e7e00640 1 -- 172.21.15.55:0/1781308337 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f80e0001a00 con 0x7f80e80afba0 2024-04-02T07:27:00.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.216+0000 7f80e7e00640 1 -- 172.21.15.55:0/1781308337 >> v1:172.21.15.55:6789/0 conn(0x7f80e80afba0 legacy=0x7f80e806f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:00.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.220+0000 7f80e7e00640 1 --2- 172.21.15.55:0/1781308337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d0003980 0x7f80d0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:00.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.220+0000 7f80e7e00640 1 --2- 172.21.15.55:0/1781308337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80d00047d0 0x7f80d0004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:00.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.220+0000 7f80e7e00640 1 --2- 172.21.15.55:0/1781308337 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80e815cd70 0x7f80d0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:00.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.220+0000 7f80e7e00640 1 -- 172.21.15.55:0/1781308337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80cd830 con 0x7f80d0003980 2024-04-02T07:27:00.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.220+0000 7f80e7e00640 1 -- 172.21.15.55:0/1781308337 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80cfd00 con 0x7f80d00047d0 2024-04-02T07:27:00.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.220+0000 7f80e7e00640 1 -- 172.21.15.55:0/1781308337 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80d000b990 con 0x7f80e815cd70 2024-04-02T07:27:00.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.220+0000 7f80edc00640 1 --2- 172.21.15.55:0/1781308337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d0003980 0x7f80d0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:00.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.220+0000 7f80ed200640 1 --2- 172.21.15.55:0/1781308337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80d00047d0 0x7f80d0004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:00.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.220+0000 7f80ee600640 1 --2- 172.21.15.55:0/1781308337 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80e815cd70 0x7f80d0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:00.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.220+0000 7f80edc00640 1 -- 172.21.15.55:0/1781308337 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80e815cd70 msgr2=0x7f80d0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:00.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.220+0000 7f80edc00640 1 --2- 172.21.15.55:0/1781308337 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80e815cd70 0x7f80d0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.220+0000 7f80edc00640 1 -- 172.21.15.55:0/1781308337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80d00047d0 msgr2=0x7f80d0004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:00.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.220+0000 7f80edc00640 1 --2- 172.21.15.55:0/1781308337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80d00047d0 0x7f80d0004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.220+0000 7f80edc00640 1 -- 172.21.15.55:0/1781308337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80d0003530 con 0x7f80d0003980 2024-04-02T07:27:00.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.220+0000 7f80ed200640 1 --2- 172.21.15.55:0/1781308337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80d00047d0 0x7f80d0004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:00.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.220+0000 7f80edc00640 1 --2- 172.21.15.55:0/1781308337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d0003980 0x7f80d0003da0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f80dc009ae0 tx=0x7f80dc01ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aae0f10d806252df server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:00.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.220+0000 7f80e7e00640 1 -- 172.21.15.55:0/1781308337 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0a5570 con 0x7f80d0003980 2024-04-02T07:27:00.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.220+0000 7f80e7e00640 1 -- 172.21.15.55:0/1781308337 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc0a56d0 con 0x7f80d0003980 2024-04-02T07:27:00.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.220+0000 7f80e7e00640 1 -- 172.21.15.55:0/1781308337 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0a5a80 con 0x7f80d0003980 2024-04-02T07:27:00.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80f0600640 1 -- 172.21.15.55:0/1781308337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d0003980 msgr2=0x7f80d0003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:00.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80f0600640 1 --2- 172.21.15.55:0/1781308337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80d0003980 0x7f80d0003da0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f80dc009ae0 tx=0x7f80dc01ca80 comp rx=0 tx=0).stop 2024-04-02T07:27:00.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80ee600640 1 -- 172.21.15.55:0/1781308337 reap_dead start 2024-04-02T07:27:00.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80f0600640 1 -- 172.21.15.55:0/1781308337 shutdown_connections 2024-04-02T07:27:00.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80f0600640 1 -- 172.21.15.55:0/1781308337 >> 172.21.15.55:0/1781308337 conn(0x7f80e80d0690 msgr2=0x7f80e80d0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:00.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80f0600640 1 -- 172.21.15.55:0/1781308337 shutdown_connections 2024-04-02T07:27:00.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80f0600640 1 -- 172.21.15.55:0/1781308337 wait complete. 2024-04-02T07:27:00.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80f0600640 1 Processor -- start 2024-04-02T07:27:00.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80f0600640 1 -- start start 2024-04-02T07:27:00.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80f0600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80d0003980 0x7f80e80c60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:00.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80f0600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80e80c9840 0x7f80e8154810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:00.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80f0600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80e8154d50 0x7f80e8161610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:00.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80f0600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80c85d0 con 0x7f80e8154d50 2024-04-02T07:27:00.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80f0600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80b06d0 con 0x7f80d0003980 2024-04-02T07:27:00.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80f0600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80e80c7a70 con 0x7f80e80c9840 2024-04-02T07:27:00.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80ee600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80e8154d50 0x7f80e8161610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:00.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80ee600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80e8154d50 0x7f80e8161610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41720/0 (socket says 172.21.15.55:41720) 2024-04-02T07:27:00.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80ee600640 1 -- 172.21.15.55:0/754906242 learned_addr learned my addr 172.21.15.55:0/754906242 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:00.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80ed200640 1 --2- 172.21.15.55:0/754906242 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80e80c9840 0x7f80e8154810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:00.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80edc00640 1 --2- 172.21.15.55:0/754906242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80d0003980 0x7f80e80c60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:00.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80ee600640 1 -- 172.21.15.55:0/754906242 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80e80c9840 msgr2=0x7f80e8154810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:00.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80ee600640 1 --2- 172.21.15.55:0/754906242 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80e80c9840 0x7f80e8154810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80ee600640 1 -- 172.21.15.55:0/754906242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80d0003980 msgr2=0x7f80e80c60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:00.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80ee600640 1 --2- 172.21.15.55:0/754906242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80d0003980 0x7f80e80c60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80ee600640 1 -- 172.21.15.55:0/754906242 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e80c7d30 con 0x7f80e8154d50 2024-04-02T07:27:00.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.224+0000 7f80ed200640 1 --2- 172.21.15.55:0/754906242 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80e80c9840 0x7f80e8154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:00.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.228+0000 7f80ee600640 1 --2- 172.21.15.55:0/754906242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80e8154d50 0x7f80e8161610 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f80e0000f90 tx=0x7f80e000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:00.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.228+0000 7f80e5600640 1 -- 172.21.15.55:0/754906242 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e000eb90 con 0x7f80e8154d50 2024-04-02T07:27:00.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.228+0000 7f80e5600640 1 -- 172.21.15.55:0/754906242 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e000ecf0 con 0x7f80e8154d50 2024-04-02T07:27:00.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.228+0000 7f80e5600640 1 -- 172.21.15.55:0/754906242 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0013660 con 0x7f80e8154d50 2024-04-02T07:27:00.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.228+0000 7f80f0600640 1 -- 172.21.15.55:0/754906242 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80e80c8010 con 0x7f80e8154d50 2024-04-02T07:27:00.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.228+0000 7f80f0600640 1 -- 172.21.15.55:0/754906242 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80e80c7760 con 0x7f80e8154d50 2024-04-02T07:27:00.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.228+0000 7f80f0600640 1 -- 172.21.15.55:0/754906242 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80e8066c90 con 0x7f80e8154d50 2024-04-02T07:27:00.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.228+0000 7f80e5600640 1 -- 172.21.15.55:0/754906242 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f80e00137c0 con 0x7f80e8154d50 2024-04-02T07:27:00.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.228+0000 7f80e5600640 1 --2- 172.21.15.55:0/754906242 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f80c8066690 0x7f80c8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:00.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.228+0000 7f80e5600640 1 -- 172.21.15.55:0/754906242 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f80e0084560 con 0x7f80e8154d50 2024-04-02T07:27:00.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.228+0000 7f80edc00640 1 --2- 172.21.15.55:0/754906242 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f80c8066690 0x7f80c8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:00.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.232+0000 7f80edc00640 1 --2- 172.21.15.55:0/754906242 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f80c8066690 0x7f80c8068b50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0af000 tx=0x7f80dc0046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.232+0000 7f80e5600640 1 -- 172.21.15.55:0/754906242 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f80e00517f0 con 0x7f80e8154d50 2024-04-02T07:27:00.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.448+0000 7f80f0600640 1 -- 172.21.15.55:0/754906242 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f80e80d13e0 con 0x7f80e8154d50 2024-04-02T07:27:00.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.456+0000 7f80e5600640 1 -- 172.21.15.55:0/754906242 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f80e0054e10 con 0x7f80e8154d50 2024-04-02T07:27:00.459 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2024-04-02T07:27:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.456+0000 7f80f0600640 1 -- 172.21.15.55:0/754906242 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f80c8066690 msgr2=0x7f80c8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.456+0000 7f80f0600640 1 --2- 172.21.15.55:0/754906242 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f80c8066690 0x7f80c8068b50 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f80dc0af000 tx=0x7f80dc0046d0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.456+0000 7f80f0600640 1 -- 172.21.15.55:0/754906242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80e8154d50 msgr2=0x7f80e8161610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.456+0000 7f80f0600640 1 --2- 172.21.15.55:0/754906242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80e8154d50 0x7f80e8161610 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f80e0000f90 tx=0x7f80e000e530 comp rx=0 tx=0).stop 2024-04-02T07:27:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.456+0000 7f80f0600640 1 -- 172.21.15.55:0/754906242 shutdown_connections 2024-04-02T07:27:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.456+0000 7f80f0600640 1 --2- 172.21.15.55:0/754906242 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80e8154d50 0x7f80e8161610 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.456+0000 7f80f0600640 1 --2- 172.21.15.55:0/754906242 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80e80c9840 0x7f80e8154810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.456+0000 7f80f0600640 1 --2- 172.21.15.55:0/754906242 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f80c8066690 0x7f80c8068b50 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.456+0000 7f80f0600640 1 --2- 172.21.15.55:0/754906242 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80d0003980 0x7f80e80c60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.456+0000 7f80f0600640 1 -- 172.21.15.55:0/754906242 >> 172.21.15.55:0/754906242 conn(0x7f80e80d0690 msgr2=0x7f80e806c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:00.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.456+0000 7f80f0600640 1 -- 172.21.15.55:0/754906242 shutdown_connections 2024-04-02T07:27:00.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.456+0000 7f80f0600640 1 -- 172.21.15.55:0/754906242 wait complete. 2024-04-02T07:27:00.480 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:27:00.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f925dc00640 1 Processor -- start 2024-04-02T07:27:00.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f925dc00640 1 -- start start 2024-04-02T07:27:00.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f925dc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9258157350 0x7f92580cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:00.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f925dc00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925815d950 con 0x7f92580d02a0 2024-04-02T07:27:00.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f925dc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925815dc30 con 0x7f9258156f70 2024-04-02T07:27:00.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f925dc00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f925815df10 con 0x7f9258157350 2024-04-02T07:27:00.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9257400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f92580d02a0 0x7f92580b31c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35820/0 (socket says 172.21.15.55:35820) 2024-04-02T07:27:00.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9257400640 1 -- 172.21.15.55:0/2810278345 learned_addr learned my addr 172.21.15.55:0/2810278345 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:27:00.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9256000640 1 --2- 172.21.15.55:0/2810278345 >> v2:172.21.15.106:3300/0 conn(0x7f9258157350 0x7f92580cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:00.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9255600640 1 -- 172.21.15.55:0/2810278345 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4230771925 0 0) 0x7f925815d950 con 0x7f92580d02a0 2024-04-02T07:27:00.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9255600640 1 -- 172.21.15.55:0/2810278345 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f923c003530 con 0x7f92580d02a0 2024-04-02T07:27:00.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9255600640 1 -- 172.21.15.55:0/2810278345 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 134573826 0 0) 0x7f923c003530 con 0x7f92580d02a0 2024-04-02T07:27:00.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9255600640 1 -- 172.21.15.55:0/2810278345 >> v2:172.21.15.106:3300/0 conn(0x7f9258157350 msgr2=0x7f92580cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:00.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9255600640 1 --2- 172.21.15.55:0/2810278345 >> v2:172.21.15.106:3300/0 conn(0x7f9258157350 0x7f92580cfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9255600640 1 -- 172.21.15.55:0/2810278345 >> v1:172.21.15.106:6789/0 conn(0x7f9258156f70 legacy=0x7f925815d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:00.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9255600640 1 -- 172.21.15.55:0/2810278345 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92580cf560 con 0x7f92580d02a0 2024-04-02T07:27:00.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9255600640 1 -- 172.21.15.55:0/2810278345 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f9250001a20 con 0x7f92580d02a0 2024-04-02T07:27:00.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9255600640 1 -- 172.21.15.55:0/2810278345 >> v1:172.21.15.55:6789/0 conn(0x7f92580d02a0 legacy=0x7f92580b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:00.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9255600640 1 --2- 172.21.15.55:0/2810278345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f923c0039d0 0x7f923c003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:00.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9255600640 1 --2- 172.21.15.55:0/2810278345 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f923c0047d0 0x7f923c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:00.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9255600640 1 --2- 172.21.15.55:0/2810278345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f923c005190 0x7f923c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:00.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9255600640 1 -- 172.21.15.55:0/2810278345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f925815df10 con 0x7f923c0039d0 2024-04-02T07:27:00.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9255600640 1 -- 172.21.15.55:0/2810278345 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f923c00c090 con 0x7f923c005190 2024-04-02T07:27:00.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9255600640 1 -- 172.21.15.55:0/2810278345 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f923c00c250 con 0x7f923c0047d0 2024-04-02T07:27:00.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9256a00640 1 --2- 172.21.15.55:0/2810278345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f923c0039d0 0x7f923c003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:00.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9256000640 1 --2- 172.21.15.55:0/2810278345 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f923c0047d0 0x7f923c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:00.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9257400640 1 --2- 172.21.15.55:0/2810278345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f923c005190 0x7f923c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:00.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9256a00640 1 -- 172.21.15.55:0/2810278345 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f923c0047d0 msgr2=0x7f923c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:00.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9256a00640 1 --2- 172.21.15.55:0/2810278345 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f923c0047d0 0x7f923c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9256a00640 1 -- 172.21.15.55:0/2810278345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f923c005190 msgr2=0x7f923c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:00.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9256a00640 1 --2- 172.21.15.55:0/2810278345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f923c005190 0x7f923c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9256a00640 1 -- 172.21.15.55:0/2810278345 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c003530 con 0x7f923c0039d0 2024-04-02T07:27:00.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9257400640 1 --2- 172.21.15.55:0/2810278345 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f923c005190 0x7f923c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:00.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9256000640 1 --2- 172.21.15.55:0/2810278345 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f923c0047d0 0x7f923c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:27:00.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.616+0000 7f9257400640 1 -- 172.21.15.55:0/2810278345 reap_dead start 2024-04-02T07:27:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.620+0000 7f9256a00640 1 --2- 172.21.15.55:0/2810278345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f923c0039d0 0x7f923c003df0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9248001780 tx=0x7f924801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b869a9bb6089e1c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.620+0000 7f9255600640 1 -- 172.21.15.55:0/2810278345 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92480052d0 con 0x7f923c0039d0 2024-04-02T07:27:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.620+0000 7f9255600640 1 -- 172.21.15.55:0/2810278345 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9248005450 con 0x7f923c0039d0 2024-04-02T07:27:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.620+0000 7f9255600640 1 -- 172.21.15.55:0/2810278345 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9248003840 con 0x7f923c0039d0 2024-04-02T07:27:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.620+0000 7f925dc00640 1 -- 172.21.15.55:0/2810278345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f923c0039d0 msgr2=0x7f923c003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.620+0000 7f925dc00640 1 --2- 172.21.15.55:0/2810278345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f923c0039d0 0x7f923c003df0 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9248001780 tx=0x7f924801c3d0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.620+0000 7f925dc00640 1 -- 172.21.15.55:0/2810278345 shutdown_connections 2024-04-02T07:27:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.620+0000 7f925dc00640 1 --2- 172.21.15.55:0/2810278345 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f923c0039d0 0x7f923c003df0 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.620+0000 7f925dc00640 1 -- 172.21.15.55:0/2810278345 >> 172.21.15.55:0/2810278345 conn(0x7f92580b13b0 msgr2=0x7f92580b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.620+0000 7f925dc00640 1 -- 172.21.15.55:0/2810278345 shutdown_connections 2024-04-02T07:27:00.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.620+0000 7f925dc00640 1 -- 172.21.15.55:0/2810278345 wait complete. 2024-04-02T07:27:00.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f925dc00640 1 Processor -- start 2024-04-02T07:27:00.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f925dc00640 1 -- start start 2024-04-02T07:27:00.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f925dc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f923c0039d0 0x7f92581ea960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:00.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f925dc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92580ca520 0x7f92581532c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:00.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f925dc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9258151e50 0x7f92581522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:00.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f925dc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92580cb890 con 0x7f9258151e50 2024-04-02T07:27:00.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f925dc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92581f5ef0 con 0x7f923c0039d0 2024-04-02T07:27:00.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f925dc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9258152810 con 0x7f92580ca520 2024-04-02T07:27:00.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f9257400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9258151e50 0x7f92581522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:00.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f9257400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9258151e50 0x7f92581522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41746/0 (socket says 172.21.15.55:41746) 2024-04-02T07:27:00.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f9257400640 1 -- 172.21.15.55:0/3764485652 learned_addr learned my addr 172.21.15.55:0/3764485652 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:00.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f9256a00640 1 --2- 172.21.15.55:0/3764485652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f923c0039d0 0x7f92581ea960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:00.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f9256000640 1 --2- 172.21.15.55:0/3764485652 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92580ca520 0x7f92581532c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:00.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f9257400640 1 -- 172.21.15.55:0/3764485652 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92580ca520 msgr2=0x7f92581532c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:00.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f9257400640 1 --2- 172.21.15.55:0/3764485652 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92580ca520 0x7f92581532c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f9257400640 1 -- 172.21.15.55:0/3764485652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f923c0039d0 msgr2=0x7f92581ea960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:00.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f9257400640 1 --2- 172.21.15.55:0/3764485652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f923c0039d0 0x7f92581ea960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f9257400640 1 -- 172.21.15.55:0/3764485652 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92580cad10 con 0x7f9258151e50 2024-04-02T07:27:00.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f9256a00640 1 --2- 172.21.15.55:0/3764485652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f923c0039d0 0x7f92581ea960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:27:00.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f9256000640 1 --2- 172.21.15.55:0/3764485652 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92580ca520 0x7f92581532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:27:00.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f9257400640 1 --2- 172.21.15.55:0/3764485652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9258151e50 0x7f92581522d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f92580b2f70 tx=0x7f9250007bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:00.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f924ea00640 1 -- 172.21.15.55:0/3764485652 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92500020a0 con 0x7f9258151e50 2024-04-02T07:27:00.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f924ea00640 1 -- 172.21.15.55:0/3764485652 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925000ea20 con 0x7f9258151e50 2024-04-02T07:27:00.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f924ea00640 1 -- 172.21.15.55:0/3764485652 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925000edb0 con 0x7f9258151e50 2024-04-02T07:27:00.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f925dc00640 1 -- 172.21.15.55:0/3764485652 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92580caff0 con 0x7f9258151e50 2024-04-02T07:27:00.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.624+0000 7f925dc00640 1 -- 172.21.15.55:0/3764485652 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92580cb5b0 con 0x7f9258151e50 2024-04-02T07:27:00.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.628+0000 7f925dc00640 1 -- 172.21.15.55:0/3764485652 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92581f6060 con 0x7f9258151e50 2024-04-02T07:27:00.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.628+0000 7f924ea00640 1 -- 172.21.15.55:0/3764485652 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f925001d460 con 0x7f9258151e50 2024-04-02T07:27:00.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.628+0000 7f924ea00640 1 --2- 172.21.15.55:0/3764485652 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9238066690 0x7f9238068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:00.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.628+0000 7f924ea00640 1 -- 172.21.15.55:0/3764485652 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f92500845f0 con 0x7f9258151e50 2024-04-02T07:27:00.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.628+0000 7f9256a00640 1 --2- 172.21.15.55:0/3764485652 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9238066690 0x7f9238068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:00.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.628+0000 7f9256a00640 1 --2- 172.21.15.55:0/3764485652 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9238066690 0x7f9238068b50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9248001750 tx=0x7f92480011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:00.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.632+0000 7f924ea00640 1 -- 172.21.15.55:0/3764485652 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f92581f6060 con 0x7f9258151e50 2024-04-02T07:27:00.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.824+0000 7f925dc00640 1 -- 172.21.15.55:0/3764485652 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92581f6060 con 0x7f9258151e50 2024-04-02T07:27:00.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.824+0000 7f924ea00640 1 -- 172.21.15.55:0/3764485652 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4739 (secure 0 0 0) 0x7f92581f6060 con 0x7f9258151e50 2024-04-02T07:27:00.831 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:27:00.831 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2000687874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2000687874},{"type":"v1","addr":"172.21.15.106:6835","nonce":2000687874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/823234890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":823234890},{"type":"v1","addr":"172.21.15.55:6835","nonce":823234890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6439,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1803758651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1803758651},{"type":"v1","addr":"172.21.15.106:6837","nonce":1803758651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:26:55.525186+0000","modified":"2024-04-02T07:26:58.541802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6696},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6696":{"gid":6696,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6833/1576619269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1576619269},{"type":"v1","addr":"172.21.15.55:6833","nonce":1576619269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-02T07:27:00.831 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 44 2024-04-02T07:27:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.828+0000 7f925dc00640 1 -- 172.21.15.55:0/3764485652 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9238066690 msgr2=0x7f9238068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.828+0000 7f925dc00640 1 --2- 172.21.15.55:0/3764485652 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9238066690 0x7f9238068b50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9248001750 tx=0x7f92480011a0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.828+0000 7f925dc00640 1 -- 172.21.15.55:0/3764485652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9258151e50 msgr2=0x7f92581522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.828+0000 7f925dc00640 1 --2- 172.21.15.55:0/3764485652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9258151e50 0x7f92581522d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f92580b2f70 tx=0x7f9250007bc0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.828+0000 7f925dc00640 1 -- 172.21.15.55:0/3764485652 shutdown_connections 2024-04-02T07:27:00.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.828+0000 7f925dc00640 1 --2- 172.21.15.55:0/3764485652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9258151e50 0x7f92581522d0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.828+0000 7f925dc00640 1 --2- 172.21.15.55:0/3764485652 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f92580ca520 0x7f92581532c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.828+0000 7f925dc00640 1 --2- 172.21.15.55:0/3764485652 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9238066690 0x7f9238068b50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.828+0000 7f925dc00640 1 --2- 172.21.15.55:0/3764485652 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f923c0039d0 0x7f92581ea960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:00.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.828+0000 7f925dc00640 1 -- 172.21.15.55:0/3764485652 >> 172.21.15.55:0/3764485652 conn(0x7f92580b13b0 msgr2=0x7f92580b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:00.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.828+0000 7f925dc00640 1 -- 172.21.15.55:0/3764485652 shutdown_connections 2024-04-02T07:27:00.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:00.828+0000 7f925dc00640 1 -- 172.21.15.55:0/3764485652 wait complete. 2024-04-02T07:27:01.255 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 44, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:26:55.525186+0000', 'modified': '2024-04-02T07:26:58.541802+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6696}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6696': {'gid': 6696, 'name': 'a', 'rank': 0, 'incarnation': 40, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.55:6833/1576619269', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 1576619269}, {'type': 'v1', 'addr': '172.21.15.55:6833', 'nonce': 1576619269}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:27:01.255 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-02T07:27:01.255 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-02T07:27:01.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.392+0000 7f3c29a00640 1 Processor -- start 2024-04-02T07:27:01.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.392+0000 7f3c29a00640 1 -- start start 2024-04-02T07:27:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.392+0000 7f3c29a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c240cb5b0 0x7f3c2406ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.392+0000 7f3c29a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3c240af920 0x7f3c2406cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.392+0000 7f3c29a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c240c9ff0 con 0x7f3c2415aad0 2024-04-02T07:27:01.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.392+0000 7f3c29a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c240c93e0 con 0x7f3c240af920 2024-04-02T07:27:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.392+0000 7f3c29a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c240c96c0 con 0x7f3c240cb5b0 2024-04-02T07:27:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.392+0000 7f3c23400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3c240af920 0x7f3c2406cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.392+0000 7f3c23400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3c240af920 0x7f3c2406cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41762/0 (socket says 172.21.15.55:41762) 2024-04-02T07:27:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.392+0000 7f3c23400640 1 -- 172.21.15.55:0/880637793 learned_addr learned my addr 172.21.15.55:0/880637793 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.392+0000 7f3c1a000640 1 --2- 172.21.15.55:0/880637793 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c240cb5b0 0x7f3c2406ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.396+0000 7f3c23400640 1 -- 172.21.15.55:0/880637793 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c240cb5b0 msgr2=0x7f3c2406ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.396+0000 7f3c23400640 1 --2- 172.21.15.55:0/880637793 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c240cb5b0 0x7f3c2406ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.396+0000 7f3c23400640 1 -- 172.21.15.55:0/880637793 >> v1:172.21.15.106:6789/0 conn(0x7f3c2415aad0 legacy=0x7f3c240caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:01.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.396+0000 7f3c23400640 1 -- 172.21.15.55:0/880637793 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c240c99a0 con 0x7f3c240af920 2024-04-02T07:27:01.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.396+0000 7f3c23400640 1 --2- 172.21.15.55:0/880637793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c240af920 0x7f3c2406cf40 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c009870 tx=0x7f3c1c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d56b54c3a0a26b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:01.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.396+0000 7f3c22000640 1 -- 172.21.15.55:0/880637793 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0ab640 con 0x7f3c240af920 2024-04-02T07:27:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.396+0000 7f3c22000640 1 -- 172.21.15.55:0/880637793 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1c0a7070 con 0x7f3c240af920 2024-04-02T07:27:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.396+0000 7f3c22000640 1 -- 172.21.15.55:0/880637793 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0ab9c0 con 0x7f3c240af920 2024-04-02T07:27:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.396+0000 7f3c29a00640 1 -- 172.21.15.55:0/880637793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c240af920 msgr2=0x7f3c2406cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:01.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.396+0000 7f3c29a00640 1 --2- 172.21.15.55:0/880637793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c240af920 0x7f3c2406cf40 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c009870 tx=0x7f3c1c01c460 comp rx=0 tx=0).stop 2024-04-02T07:27:01.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.396+0000 7f3c29a00640 1 -- 172.21.15.55:0/880637793 shutdown_connections 2024-04-02T07:27:01.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.396+0000 7f3c29a00640 1 --2- 172.21.15.55:0/880637793 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c240af920 0x7f3c2406cf40 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.396+0000 7f3c29a00640 1 --2- 172.21.15.55:0/880637793 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c240cb5b0 0x7f3c2406ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.396+0000 7f3c29a00640 1 -- 172.21.15.55:0/880637793 >> 172.21.15.55:0/880637793 conn(0x7f3c24069d90 msgr2=0x7f3c2406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:01.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.396+0000 7f3c29a00640 1 -- 172.21.15.55:0/880637793 shutdown_connections 2024-04-02T07:27:01.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.396+0000 7f3c29a00640 1 -- 172.21.15.55:0/880637793 wait complete. 2024-04-02T07:27:01.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c29a00640 1 Processor -- start 2024-04-02T07:27:01.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c29a00640 1 -- start start 2024-04-02T07:27:01.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c29a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c240af920 0x7f3c24137600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c29a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c240cb5b0 0x7f3c24155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c29a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c2415aad0 0x7f3c24155b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c29a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c2413ad70 con 0x7f3c240af920 2024-04-02T07:27:01.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c29a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c24137170 con 0x7f3c2415aad0 2024-04-02T07:27:01.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c29a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c241f9e00 con 0x7f3c240cb5b0 2024-04-02T07:27:01.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c22a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c240af920 0x7f3c24137600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c22a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c240af920 0x7f3c24137600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41764/0 (socket says 172.21.15.55:41764) 2024-04-02T07:27:01.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c22a00640 1 -- 172.21.15.55:0/3304679625 learned_addr learned my addr 172.21.15.55:0/3304679625 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:01.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c1a000640 1 --2- 172.21.15.55:0/3304679625 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c240cb5b0 0x7f3c24155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c23400640 1 --2- 172.21.15.55:0/3304679625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c2415aad0 0x7f3c24155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c22a00640 1 -- 172.21.15.55:0/3304679625 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c240cb5b0 msgr2=0x7f3c24155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:01.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c22a00640 1 --2- 172.21.15.55:0/3304679625 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c240cb5b0 0x7f3c24155630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c22a00640 1 -- 172.21.15.55:0/3304679625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c2415aad0 msgr2=0x7f3c24155b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c22a00640 1 --2- 172.21.15.55:0/3304679625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c2415aad0 0x7f3c24155b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c22a00640 1 -- 172.21.15.55:0/3304679625 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c1c0094d0 con 0x7f3c240af920 2024-04-02T07:27:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c22a00640 1 --2- 172.21.15.55:0/3304679625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c240af920 0x7f3c24137600 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f3c1400ba50 tx=0x7f3c1400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c1b400640 1 -- 172.21.15.55:0/3304679625 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1400cc10 con 0x7f3c240af920 2024-04-02T07:27:01.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c1b400640 1 -- 172.21.15.55:0/3304679625 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1400cd70 con 0x7f3c240af920 2024-04-02T07:27:01.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c1b400640 1 -- 172.21.15.55:0/3304679625 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c14014680 con 0x7f3c240af920 2024-04-02T07:27:01.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.400+0000 7f3c29a00640 1 -- 172.21.15.55:0/3304679625 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c2414b7d0 con 0x7f3c240af920 2024-04-02T07:27:01.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.404+0000 7f3c29a00640 1 -- 172.21.15.55:0/3304679625 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c24136b20 con 0x7f3c240af920 2024-04-02T07:27:01.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.404+0000 7f3c1b400640 1 -- 172.21.15.55:0/3304679625 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3c1401d3b0 con 0x7f3c240af920 2024-04-02T07:27:01.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.404+0000 7f3c1b400640 1 --2- 172.21.15.55:0/3304679625 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3c00066690 0x7f3c00068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.404+0000 7f3c1b400640 1 -- 172.21.15.55:0/3304679625 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3c14084120 con 0x7f3c240af920 2024-04-02T07:27:01.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.404+0000 7f3c1a000640 1 --2- 172.21.15.55:0/3304679625 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3c00066690 0x7f3c00068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.404+0000 7f3c2cd73000 1 Processor -- start 2024-04-02T07:27:01.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.404+0000 7f3c2cd73000 1 -- start start 2024-04-02T07:27:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.404+0000 7f3c1a000640 1 --2- 172.21.15.55:0/3304679625 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3c00066690 0x7f3c00068b50 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3c24134830 tx=0x7f3c0c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c2cd73000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651c5326db0 0x5651c5327190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c2cd73000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c53276d0 0x5651c52dcf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c2cd73000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c52dd4c0 0x5651c52dd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c2cd73000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c51a55a0 con 0x5651c52dd4c0 2024-04-02T07:27:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c2cd73000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c5132af0 con 0x5651c5326db0 2024-04-02T07:27:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c2cd73000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651c51300c0 con 0x5651c53276d0 2024-04-02T07:27:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c23400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c52dd4c0 0x5651c52dd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c1a000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c53276d0 0x5651c52dcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c23400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c52dd4c0 0x5651c52dd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41770/0 (socket says 172.21.15.55:41770) 2024-04-02T07:27:01.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c23400640 1 -- 172.21.15.55:0/585102995 learned_addr learned my addr 172.21.15.55:0/585102995 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:01.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c22a00640 1 --2- 172.21.15.55:0/585102995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651c5326db0 0x5651c5327190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c23400640 1 -- 172.21.15.55:0/585102995 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c53276d0 msgr2=0x5651c52dcf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:01.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c23400640 1 --2- 172.21.15.55:0/585102995 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c53276d0 0x5651c52dcf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c23400640 1 -- 172.21.15.55:0/585102995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651c5326db0 msgr2=0x5651c5327190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:01.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c23400640 1 --2- 172.21.15.55:0/585102995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651c5326db0 0x5651c5327190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c23400640 1 -- 172.21.15.55:0/585102995 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651c4e27890 con 0x5651c52dd4c0 2024-04-02T07:27:01.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c23400640 1 --2- 172.21.15.55:0/585102995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c52dd4c0 0x5651c52dd8a0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0ad040 tx=0x7f3c1c0a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf1fa593b10fa66 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:01.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c13400640 1 -- 172.21.15.55:0/585102995 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0ab7f0 con 0x5651c52dd4c0 2024-04-02T07:27:01.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c13400640 1 -- 172.21.15.55:0/585102995 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c1c0ab970 con 0x5651c52dd4c0 2024-04-02T07:27:01.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c13400640 1 -- 172.21.15.55:0/585102995 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0abd20 con 0x5651c52dd4c0 2024-04-02T07:27:01.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c2cd73000 1 -- 172.21.15.55:0/585102995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c52dd4c0 msgr2=0x5651c52dd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:01.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c2cd73000 1 --2- 172.21.15.55:0/585102995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c52dd4c0 0x5651c52dd8a0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c0ad040 tx=0x7f3c1c0a7000 comp rx=0 tx=0).stop 2024-04-02T07:27:01.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c2cd73000 1 -- 172.21.15.55:0/585102995 shutdown_connections 2024-04-02T07:27:01.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c2cd73000 1 --2- 172.21.15.55:0/585102995 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c52dd4c0 0x5651c52dd8a0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c2cd73000 1 --2- 172.21.15.55:0/585102995 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c53276d0 0x5651c52dcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c2cd73000 1 --2- 172.21.15.55:0/585102995 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651c5326db0 0x5651c5327190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c2cd73000 1 -- 172.21.15.55:0/585102995 >> 172.21.15.55:0/585102995 conn(0x5651c52e3830 msgr2=0x5651c52db860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:01.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c2cd73000 1 -- 172.21.15.55:0/585102995 shutdown_connections 2024-04-02T07:27:01.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c2cd73000 1 -- 172.21.15.55:0/585102995 wait complete. 2024-04-02T07:27:01.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c2cd73000 1 -- start start 2024-04-02T07:27:01.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.408+0000 7f3c2cd73000 1 Processor -- start 2024-04-02T07:27:01.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c52dd4c0 0x5651c52e1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651c5326db0 0x5651c52e1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c53276d0 0x5651c52e1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c512b9b0 con 0x5651c53276d0 2024-04-02T07:27:01.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c50cac00 con 0x5651c5326db0 2024-04-02T07:27:01.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651c50e9070 con 0x5651c52dd4c0 2024-04-02T07:27:01.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 10 client.0 _ll_register_callbacks cb 0x5651c52c90e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:27:01.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c23400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c53276d0 0x5651c52e1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c23400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c53276d0 0x5651c52e1cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41778/0 (socket says 172.21.15.55:41778) 2024-04-02T07:27:01.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c23400640 1 -- 172.21.15.55:0/3265510852 learned_addr learned my addr 172.21.15.55:0/3265510852 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:01.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c22a00640 1 --2- 172.21.15.55:0/3265510852 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c52dd4c0 0x5651c52e1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c1a000640 1 --2- 172.21.15.55:0/3265510852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651c5326db0 0x5651c52e1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c23400640 1 -- 172.21.15.55:0/3265510852 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c52dd4c0 msgr2=0x5651c52e1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:01.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c23400640 1 --2- 172.21.15.55:0/3265510852 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c52dd4c0 0x5651c52e1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c23400640 1 -- 172.21.15.55:0/3265510852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651c5326db0 msgr2=0x5651c52e1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:01.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c23400640 1 --2- 172.21.15.55:0/3265510852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651c5326db0 0x5651c52e1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c23400640 1 -- 172.21.15.55:0/3265510852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c240c99a0 con 0x5651c53276d0 2024-04-02T07:27:01.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c22a00640 1 --2- 172.21.15.55:0/3265510852 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c52dd4c0 0x5651c52e1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:01.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c1a000640 1 --2- 172.21.15.55:0/3265510852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651c5326db0 0x5651c52e1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:01.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c23400640 1 --2- 172.21.15.55:0/3265510852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c53276d0 0x5651c52e1cb0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c01c4a0 tx=0x7f3c1c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760752cddd7f1adc server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:01.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c07e00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:27:01.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c07e00640 1 -- 172.21.15.55:0/3265510852 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1c0ab9f0 con 0x5651c53276d0 2024-04-02T07:27:01.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 1 -- 172.21.15.55:0/3265510852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651c50e85f0 con 0x5651c53276d0 2024-04-02T07:27:01.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c07e00640 1 -- 172.21.15.55:0/3265510852 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3c1c0abb50 con 0x5651c53276d0 2024-04-02T07:27:01.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c07e00640 1 -- 172.21.15.55:0/3265510852 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c1c0abd10 con 0x5651c53276d0 2024-04-02T07:27:01.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 10 client.6831 fetch_fsmap learned FSMap version 44 2024-04-02T07:27:01.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 1 -- 172.21.15.55:0/3265510852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x5651c50f0ab0 con 0x5651c53276d0 2024-04-02T07:27:01.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c07e00640 1 -- 172.21.15.55:0/3265510852 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5651c50e85f0 con 0x5651c53276d0 2024-04-02T07:27:01.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c07e00640 1 -- 172.21.15.55:0/3265510852 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 44) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3c1c003620 con 0x5651c53276d0 2024-04-02T07:27:01.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 10 client.6831 fetch_fsmap finished waiting for FSMap version 44 2024-04-02T07:27:01.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 10 client.6831 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:27:01.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 20 client.6831 populate_metadata read hostname 'smithi055' 2024-04-02T07:27:01.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 1 --2- 172.21.15.55:0/3265510852 >> [v2:172.21.15.55:6832/1576619269,v1:172.21.15.55:6833/1576619269] conn(0x5651c5335e40 0x5651c5338230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 4 client.6831 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:27:01.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 1 -- 172.21.15.55:0/3265510852 --> [v2:172.21.15.55:6832/1576619269,v1:172.21.15.55:6833/1576619269] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5651c5128790 con 0x5651c5335e40 2024-04-02T07:27:01.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c22a00640 1 --2- 172.21.15.55:0/3265510852 >> [v2:172.21.15.55:6832/1576619269,v1:172.21.15.55:6833/1576619269] conn(0x5651c5335e40 0x5651c5338230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c22a00640 1 --2- 172.21.15.55:0/3265510852 >> [v2:172.21.15.55:6832/1576619269,v1:172.21.15.55:6833/1576619269] conn(0x5651c5335e40 0x5651c5338230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae3ed8f70733dc52 server_cookie=42c6d0fe0a6bae84 in_seq=0 out_seq=0 2024-04-02T07:27:01.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c07e00640 10 client.6831 ms_handle_connect on v2:172.21.15.55:6832/1576619269 2024-04-02T07:27:01.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c07e00640 1 -- 172.21.15.55:0/3265510852 <== mds.0 v2:172.21.15.55:6832/1576619269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5651c5128790 con 0x5651c5335e40 2024-04-02T07:27:01.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c07e00640 10 client.6831 handle_command_reply: tid=0 2024-04-02T07:27:01.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 1 client.6831 shutdown 2024-04-02T07:27:01.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 1 -- 172.21.15.55:0/3265510852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c53276d0 msgr2=0x5651c52e1cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:01.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 1 --2- 172.21.15.55:0/3265510852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c53276d0 0x5651c52e1cb0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f3c1c01c4a0 tx=0x7f3c1c01aca0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 1 -- 172.21.15.55:0/3265510852 shutdown_connections 2024-04-02T07:27:01.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 1 --2- 172.21.15.55:0/3265510852 >> [v2:172.21.15.55:6832/1576619269,v1:172.21.15.55:6833/1576619269] conn(0x5651c5335e40 0x5651c5338230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 1 --2- 172.21.15.55:0/3265510852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c53276d0 0x5651c52e1cb0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 1 --2- 172.21.15.55:0/3265510852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651c5326db0 0x5651c52e1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c07e00640 0 client.6831 ms_handle_reset on v2:172.21.15.55:6832/1576619269 2024-04-02T07:27:01.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 1 --2- 172.21.15.55:0/3265510852 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c52dd4c0 0x5651c52e1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 1 -- 172.21.15.55:0/3265510852 >> 172.21.15.55:0/3265510852 conn(0x5651c52e3830 msgr2=0x5651c52dbf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:01.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.412+0000 7f3c2cd73000 1 -- 172.21.15.55:0/3265510852 shutdown_connections 2024-04-02T07:27:01.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.416+0000 7f3c2cd73000 1 -- 172.21.15.55:0/3265510852 wait complete. 2024-04-02T07:27:01.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.416+0000 7f3c2cd73000 20 client.6831 trim_cache size 0 max 16384 2024-04-02T07:27:01.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.428+0000 7f3c2cd73000 1 Processor -- start 2024-04-02T07:27:01.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.428+0000 7f3c2cd73000 1 -- start start 2024-04-02T07:27:01.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c52dd4c0 0x5651c5320770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651c5326db0 0x5651c5320cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c53276d0 0x5651c53211f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c4de8940 con 0x5651c52dd4c0 2024-04-02T07:27:01.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c516eac0 con 0x5651c5326db0 2024-04-02T07:27:01.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651c5133d80 con 0x5651c53276d0 2024-04-02T07:27:01.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c22a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c52dd4c0 0x5651c5320770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c22a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c52dd4c0 0x5651c5320770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41782/0 (socket says 172.21.15.55:41782) 2024-04-02T07:27:01.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c22a00640 1 -- 172.21.15.55:0/2075096574 learned_addr learned my addr 172.21.15.55:0/2075096574 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:01.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c22a00640 1 -- 172.21.15.55:0/2075096574 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c53276d0 msgr2=0x5651c53211f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:01.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c22a00640 1 --2- 172.21.15.55:0/2075096574 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c53276d0 0x5651c53211f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c22a00640 1 -- 172.21.15.55:0/2075096574 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651c5326db0 msgr2=0x5651c5320cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:01.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c22a00640 1 --2- 172.21.15.55:0/2075096574 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651c5326db0 0x5651c5320cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c22a00640 1 -- 172.21.15.55:0/2075096574 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651c50d6c00 con 0x5651c52dd4c0 2024-04-02T07:27:01.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c22a00640 1 --2- 172.21.15.55:0/2075096574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c52dd4c0 0x5651c5320770 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f3c14082600 tx=0x7f3c1400e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38cd1fdc6299c8cd server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:01.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c13e00640 1 -- 172.21.15.55:0/2075096574 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c14082740 con 0x5651c52dd4c0 2024-04-02T07:27:01.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c13e00640 1 -- 172.21.15.55:0/2075096574 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c14053550 con 0x5651c52dd4c0 2024-04-02T07:27:01.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c13e00640 1 -- 172.21.15.55:0/2075096574 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c1405b0b0 con 0x5651c52dd4c0 2024-04-02T07:27:01.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 -- 172.21.15.55:0/2075096574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c52dd4c0 msgr2=0x5651c5320770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:01.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 --2- 172.21.15.55:0/2075096574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c52dd4c0 0x5651c5320770 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f3c14082600 tx=0x7f3c1400e040 comp rx=0 tx=0).stop 2024-04-02T07:27:01.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 -- 172.21.15.55:0/2075096574 shutdown_connections 2024-04-02T07:27:01.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 --2- 172.21.15.55:0/2075096574 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c53276d0 0x5651c53211f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 --2- 172.21.15.55:0/2075096574 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651c5326db0 0x5651c5320cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 --2- 172.21.15.55:0/2075096574 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c52dd4c0 0x5651c5320770 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 -- 172.21.15.55:0/2075096574 >> 172.21.15.55:0/2075096574 conn(0x5651c52e3830 msgr2=0x5651c52e07c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:01.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 -- 172.21.15.55:0/2075096574 shutdown_connections 2024-04-02T07:27:01.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 -- 172.21.15.55:0/2075096574 wait complete. 2024-04-02T07:27:01.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 -- start start 2024-04-02T07:27:01.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 Processor -- start 2024-04-02T07:27:01.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651c52dd4c0 0x5651c5385690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c5326db0 0x5651c5385bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c53276d0 0x5651c5324400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c50f7b60 con 0x5651c5326db0 2024-04-02T07:27:01.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651c50d04d0 con 0x5651c52dd4c0 2024-04-02T07:27:01.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5651c52ac530 con 0x5651c53276d0 2024-04-02T07:27:01.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c2cd73000 10 client.0 _ll_register_callbacks cb 0x5651c50f0590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:27:01.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c1a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c5326db0 0x5651c5385bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c1a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c5326db0 0x5651c5385bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41792/0 (socket says 172.21.15.55:41792) 2024-04-02T07:27:01.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c1a000640 1 -- 172.21.15.55:0/3923509298 learned_addr learned my addr 172.21.15.55:0/3923509298 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:01.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c22a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651c52dd4c0 0x5651c5385690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.432+0000 7f3c23400640 1 --2- 172.21.15.55:0/3923509298 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c53276d0 0x5651c5324400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c1a000640 1 -- 172.21.15.55:0/3923509298 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c53276d0 msgr2=0x5651c5324400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:01.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c1a000640 1 --2- 172.21.15.55:0/3923509298 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c53276d0 0x5651c5324400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c1a000640 1 -- 172.21.15.55:0/3923509298 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651c52dd4c0 msgr2=0x5651c5385690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:01.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c1a000640 1 --2- 172.21.15.55:0/3923509298 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651c52dd4c0 0x5651c5385690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c1a000640 1 -- 172.21.15.55:0/3923509298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c24136b20 con 0x5651c5326db0 2024-04-02T07:27:01.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c23400640 1 --2- 172.21.15.55:0/3923509298 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c53276d0 0x5651c5324400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:01.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c1a000640 1 --2- 172.21.15.55:0/3923509298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c5326db0 0x5651c5385bd0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c010f70 tx=0x7f3c0c016850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb160f963e98c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:01.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c07e00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:27:01.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c07e00640 1 -- 172.21.15.55:0/3923509298 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c004020 con 0x5651c5326db0 2024-04-02T07:27:01.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c07e00640 1 -- 172.21.15.55:0/3923509298 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3c0c004180 con 0x5651c5326db0 2024-04-02T07:27:01.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 1 -- 172.21.15.55:0/3923509298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651c50fb460 con 0x5651c5326db0 2024-04-02T07:27:01.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c07e00640 1 -- 172.21.15.55:0/3923509298 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3c0c004340 con 0x5651c5326db0 2024-04-02T07:27:01.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 10 client.6837 fetch_fsmap learned FSMap version 44 2024-04-02T07:27:01.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 1 -- 172.21.15.55:0/3923509298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=2+}) v3 -- 0x5651c4e27cc0 con 0x5651c5326db0 2024-04-02T07:27:01.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c07e00640 1 -- 172.21.15.55:0/3923509298 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5651c50fb460 con 0x5651c5326db0 2024-04-02T07:27:01.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c07e00640 1 -- 172.21.15.55:0/3923509298 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 44) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3c0c023670 con 0x5651c5326db0 2024-04-02T07:27:01.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 10 client.6837 fetch_fsmap finished waiting for FSMap version 44 2024-04-02T07:27:01.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 10 client.6837 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:27:01.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 20 client.6837 populate_metadata read hostname 'smithi055' 2024-04-02T07:27:01.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 1 --2- 172.21.15.55:0/3923509298 >> [v2:172.21.15.55:6832/1576619269,v1:172.21.15.55:6833/1576619269] conn(0x5651c5324940 0x5651c5324d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 4 client.6837 mds_command: new command op to 6696 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-02T07:27:01.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 1 -- 172.21.15.55:0/3923509298 --> [v2:172.21.15.55:6832/1576619269,v1:172.21.15.55:6833/1576619269] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5651c50f49c0 con 0x5651c5324940 2024-04-02T07:27:01.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c22a00640 1 --2- 172.21.15.55:0/3923509298 >> [v2:172.21.15.55:6832/1576619269,v1:172.21.15.55:6833/1576619269] conn(0x5651c5324940 0x5651c5324d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c22a00640 1 --2- 172.21.15.55:0/3923509298 >> [v2:172.21.15.55:6832/1576619269,v1:172.21.15.55:6833/1576619269] conn(0x5651c5324940 0x5651c5324d20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5faf87f67b51d980 server_cookie=c8681825327547c0 in_seq=0 out_seq=0 2024-04-02T07:27:01.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c07e00640 10 client.6837 ms_handle_connect on v2:172.21.15.55:6832/1576619269 2024-04-02T07:27:01.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c07e00640 1 -- 172.21.15.55:0/3923509298 <== mds.0 v2:172.21.15.55:6832/1576619269 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5651c50f49c0 con 0x5651c5324940 2024-04-02T07:27:01.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c07e00640 10 client.6837 handle_command_reply: tid=0 2024-04-02T07:27:01.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 1 client.6837 shutdown 2024-04-02T07:27:01.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 1 -- 172.21.15.55:0/3923509298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c5326db0 msgr2=0x5651c5385bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:01.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 1 --2- 172.21.15.55:0/3923509298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c5326db0 0x5651c5385bd0 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f3c0c010f70 tx=0x7f3c0c016850 comp rx=0 tx=0).stop 2024-04-02T07:27:01.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 1 -- 172.21.15.55:0/3923509298 shutdown_connections 2024-04-02T07:27:01.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 1 --2- 172.21.15.55:0/3923509298 >> [v2:172.21.15.55:6832/1576619269,v1:172.21.15.55:6833/1576619269] conn(0x5651c5324940 0x5651c5324d20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 1 --2- 172.21.15.55:0/3923509298 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5651c53276d0 0x5651c5324400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 1 --2- 172.21.15.55:0/3923509298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5651c5326db0 0x5651c5385bd0 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c07e00640 0 client.6837 ms_handle_reset on v2:172.21.15.55:6832/1576619269 2024-04-02T07:27:01.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 1 --2- 172.21.15.55:0/3923509298 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5651c52dd4c0 0x5651c5385690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 1 -- 172.21.15.55:0/3923509298 >> 172.21.15.55:0/3923509298 conn(0x5651c52e3830 msgr2=0x5651c52e0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:01.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 1 -- 172.21.15.55:0/3923509298 shutdown_connections 2024-04-02T07:27:01.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 1 -- 172.21.15.55:0/3923509298 wait complete. 2024-04-02T07:27:01.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c2cd73000 20 client.6837 trim_cache size 0 max 16384 2024-04-02T07:27:01.446 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:27:01.447 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "642a0456-a2ac-49a4-91a5-3b3449b512da", 2024-04-02T07:27:01.447 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-02T07:27:01.447 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 6696, 2024-04-02T07:27:01.447 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-02T07:27:01.447 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-02T07:27:01.447 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-02T07:27:01.447 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 5.9104548299999999, 2024-04-02T07:27:01.447 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 44, 2024-04-02T07:27:01.447 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 74, 2024-04-02T07:27:01.447 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 72, 2024-04-02T07:27:01.447 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 17.056282225 2024-04-02T07:27:01.447 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:27:01.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c29a00640 1 -- 172.21.15.55:0/3304679625 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3c00066690 msgr2=0x7f3c00068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:01.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c29a00640 1 --2- 172.21.15.55:0/3304679625 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3c00066690 0x7f3c00068b50 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f3c24134830 tx=0x7f3c0c008040 comp rx=0 tx=0).stop 2024-04-02T07:27:01.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c29a00640 1 -- 172.21.15.55:0/3304679625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c240af920 msgr2=0x7f3c24137600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:01.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c29a00640 1 --2- 172.21.15.55:0/3304679625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c240af920 0x7f3c24137600 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f3c1400ba50 tx=0x7f3c1400bf10 comp rx=0 tx=0).stop 2024-04-02T07:27:01.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c29a00640 1 -- 172.21.15.55:0/3304679625 shutdown_connections 2024-04-02T07:27:01.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c29a00640 1 --2- 172.21.15.55:0/3304679625 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3c00066690 0x7f3c00068b50 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c29a00640 1 --2- 172.21.15.55:0/3304679625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c2415aad0 0x7f3c24155b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c29a00640 1 --2- 172.21.15.55:0/3304679625 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c240cb5b0 0x7f3c24155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c29a00640 1 --2- 172.21.15.55:0/3304679625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c240af920 0x7f3c24137600 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c29a00640 1 -- 172.21.15.55:0/3304679625 >> 172.21.15.55:0/3304679625 conn(0x7f3c24069d90 msgr2=0x7f3c2406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:01.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c29a00640 1 -- 172.21.15.55:0/3304679625 shutdown_connections 2024-04-02T07:27:01.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.436+0000 7f3c29a00640 1 -- 172.21.15.55:0/3304679625 wait complete. 2024-04-02T07:27:01.461 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-02T07:27:01.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23b3c00640 1 Processor -- start 2024-04-02T07:27:01.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23b3c00640 1 -- start start 2024-04-02T07:27:01.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23b3c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f23ac15ee70 0x7f23ac099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23b3c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac0ad270 con 0x7f23ac099120 2024-04-02T07:27:01.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23b3c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23ac0b0a50 con 0x7f23ac15f250 2024-04-02T07:27:01.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23b3c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0b0840 con 0x7f23ac15ee70 2024-04-02T07:27:01.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23b1c00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f23ac099120 0x7f23ac0ce690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35824/0 (socket says 172.21.15.55:35824) 2024-04-02T07:27:01.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23b1c00640 1 -- 172.21.15.55:0/704882084 learned_addr learned my addr 172.21.15.55:0/704882084 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:27:01.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23b1200640 1 --2- 172.21.15.55:0/704882084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f23ac15ee70 0x7f23ac099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23ab400640 1 -- 172.21.15.55:0/704882084 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2458594600 0 0) 0x7f23ac0ad270 con 0x7f23ac099120 2024-04-02T07:27:01.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23ab400640 1 -- 172.21.15.55:0/704882084 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2394003530 con 0x7f23ac099120 2024-04-02T07:27:01.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23ab400640 1 -- 172.21.15.55:0/704882084 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3055354948 0 0) 0x7f23ac0b0a50 con 0x7f23ac15f250 2024-04-02T07:27:01.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23ab400640 1 -- 172.21.15.55:0/704882084 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23ac0ad270 con 0x7f23ac15f250 2024-04-02T07:27:01.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23ab400640 1 -- 172.21.15.55:0/704882084 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 753348458 0 0) 0x7f2394003530 con 0x7f23ac099120 2024-04-02T07:27:01.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23ab400640 1 -- 172.21.15.55:0/704882084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f23ac15ee70 msgr2=0x7f23ac099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:01.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23ab400640 1 --2- 172.21.15.55:0/704882084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f23ac15ee70 0x7f23ac099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23ab400640 1 -- 172.21.15.55:0/704882084 >> v1:172.21.15.106:6789/0 conn(0x7f23ac15f250 legacy=0x7f23ac098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:01.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23ab400640 1 -- 172.21.15.55:0/704882084 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac0b0d30 con 0x7f23ac099120 2024-04-02T07:27:01.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23ab400640 1 -- 172.21.15.55:0/704882084 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f23a4001980 con 0x7f23ac099120 2024-04-02T07:27:01.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23ab400640 1 -- 172.21.15.55:0/704882084 >> v1:172.21.15.55:6789/0 conn(0x7f23ac099120 legacy=0x7f23ac0ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:01.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23ab400640 1 --2- 172.21.15.55:0/704882084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2394003b40 0x7f2394003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23ab400640 1 --2- 172.21.15.55:0/704882084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23940047d0 0x7f2394004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23ab400640 1 --2- 172.21.15.55:0/704882084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2394005190 0x7f239400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23ab400640 1 -- 172.21.15.55:0/704882084 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0b0840 con 0x7f2394005190 2024-04-02T07:27:01.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23ab400640 1 -- 172.21.15.55:0/704882084 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239400bfb0 con 0x7f23940047d0 2024-04-02T07:27:01.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23ab400640 1 -- 172.21.15.55:0/704882084 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239400c170 con 0x7f2394003b40 2024-04-02T07:27:01.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.596+0000 7f23b1200640 1 --2- 172.21.15.55:0/704882084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f23ac15ee70 0x7f23ac099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:27:01.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.600+0000 7f23b1c00640 1 --2- 172.21.15.55:0/704882084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2394005190 0x7f239400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.600+0000 7f23abe00640 1 --2- 172.21.15.55:0/704882084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23940047d0 0x7f2394004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.600+0000 7f23b1200640 1 --2- 172.21.15.55:0/704882084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2394003b40 0x7f2394003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.600+0000 7f23b1c00640 1 -- 172.21.15.55:0/704882084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2394003b40 msgr2=0x7f2394003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:01.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.600+0000 7f23b1c00640 1 --2- 172.21.15.55:0/704882084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2394003b40 0x7f2394003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.600+0000 7f23b1c00640 1 -- 172.21.15.55:0/704882084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23940047d0 msgr2=0x7f2394004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:01.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.600+0000 7f23b1c00640 1 --2- 172.21.15.55:0/704882084 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f23940047d0 0x7f2394004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.600+0000 7f23b1c00640 1 -- 172.21.15.55:0/704882084 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2394003530 con 0x7f2394005190 2024-04-02T07:27:01.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.600+0000 7f23b1200640 1 --2- 172.21.15.55:0/704882084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2394003b40 0x7f2394003f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:01.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.600+0000 7f23b1c00640 1 --2- 172.21.15.55:0/704882084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2394005190 0x7f239400b990 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0c7760 tx=0x7f23a401f880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c44525041df6bd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:01.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.600+0000 7f23ab400640 1 -- 172.21.15.55:0/704882084 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a40072d0 con 0x7f2394005190 2024-04-02T07:27:01.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.600+0000 7f23ab400640 1 -- 172.21.15.55:0/704882084 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a4007450 con 0x7f2394005190 2024-04-02T07:27:01.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.600+0000 7f23ab400640 1 -- 172.21.15.55:0/704882084 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a4007840 con 0x7f2394005190 2024-04-02T07:27:01.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23b3c00640 1 -- 172.21.15.55:0/704882084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2394005190 msgr2=0x7f239400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:01.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23b3c00640 1 --2- 172.21.15.55:0/704882084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2394005190 0x7f239400b990 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0c7760 tx=0x7f23a401f880 comp rx=0 tx=0).stop 2024-04-02T07:27:01.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23b1c00640 1 -- 172.21.15.55:0/704882084 reap_dead start 2024-04-02T07:27:01.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23b3c00640 1 -- 172.21.15.55:0/704882084 shutdown_connections 2024-04-02T07:27:01.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23b3c00640 1 -- 172.21.15.55:0/704882084 >> 172.21.15.55:0/704882084 conn(0x7f23ac0b21d0 msgr2=0x7f23ac0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:01.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23b3c00640 1 -- 172.21.15.55:0/704882084 shutdown_connections 2024-04-02T07:27:01.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23b3c00640 1 -- 172.21.15.55:0/704882084 wait complete. 2024-04-02T07:27:01.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23b3c00640 1 Processor -- start 2024-04-02T07:27:01.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23b3c00640 1 -- start start 2024-04-02T07:27:01.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23b3c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2394005190 0x7f23ac1efc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23b3c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23ac1528b0 0x7f23ac1f41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23b3c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f23ac06f790 0x7f23ac06fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23b3c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac070180 con 0x7f23ac1528b0 2024-04-02T07:27:01.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23b3c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0b50d0 con 0x7f2394005190 2024-04-02T07:27:01.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23b3c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23ac0c7850 con 0x7f23ac06f790 2024-04-02T07:27:01.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23abe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23ac1528b0 0x7f23ac1f41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23abe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23ac1528b0 0x7f23ac1f41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41824/0 (socket says 172.21.15.55:41824) 2024-04-02T07:27:01.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23abe00640 1 -- 172.21.15.55:0/2936592168 learned_addr learned my addr 172.21.15.55:0/2936592168 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:01.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23b1200640 1 --2- 172.21.15.55:0/2936592168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2394005190 0x7f23ac1efc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23b1c00640 1 --2- 172.21.15.55:0/2936592168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f23ac06f790 0x7f23ac06fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23abe00640 1 -- 172.21.15.55:0/2936592168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f23ac06f790 msgr2=0x7f23ac06fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:01.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23abe00640 1 --2- 172.21.15.55:0/2936592168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f23ac06f790 0x7f23ac06fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23abe00640 1 -- 172.21.15.55:0/2936592168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2394005190 msgr2=0x7f23ac1efc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:01.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23abe00640 1 --2- 172.21.15.55:0/2936592168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2394005190 0x7f23ac1efc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.604+0000 7f23abe00640 1 -- 172.21.15.55:0/2936592168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23ac1f4720 con 0x7f23ac1528b0 2024-04-02T07:27:01.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.608+0000 7f23abe00640 1 --2- 172.21.15.55:0/2936592168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23ac1528b0 0x7f23ac1f41e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f239800f770 tx=0x7f239800fb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:01.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.608+0000 7f23a8c00640 1 -- 172.21.15.55:0/2936592168 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23980050d0 con 0x7f23ac1528b0 2024-04-02T07:27:01.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.608+0000 7f23a8c00640 1 -- 172.21.15.55:0/2936592168 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2398005270 con 0x7f23ac1528b0 2024-04-02T07:27:01.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.608+0000 7f23a8c00640 1 -- 172.21.15.55:0/2936592168 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f239800d730 con 0x7f23ac1528b0 2024-04-02T07:27:01.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.608+0000 7f23b3c00640 1 -- 172.21.15.55:0/2936592168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23ac0b52e0 con 0x7f23ac1528b0 2024-04-02T07:27:01.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.608+0000 7f23b3c00640 1 -- 172.21.15.55:0/2936592168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23ac0c7dd0 con 0x7f23ac1528b0 2024-04-02T07:27:01.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.608+0000 7f23b3c00640 1 -- 172.21.15.55:0/2936592168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23ac0c7ff0 con 0x7f23ac1528b0 2024-04-02T07:27:01.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.608+0000 7f23a8c00640 1 -- 172.21.15.55:0/2936592168 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f239800d890 con 0x7f23ac1528b0 2024-04-02T07:27:01.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.608+0000 7f23a8c00640 1 --2- 172.21.15.55:0/2936592168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f238c066690 0x7f238c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:01.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.608+0000 7f23a8c00640 1 -- 172.21.15.55:0/2936592168 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2398084200 con 0x7f23ac1528b0 2024-04-02T07:27:01.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.608+0000 7f23b1200640 1 --2- 172.21.15.55:0/2936592168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f238c066690 0x7f238c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:01.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.612+0000 7f23b1200640 1 --2- 172.21.15.55:0/2936592168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f238c066690 0x7f238c068b50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0719c0 tx=0x7f23a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:01.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.612+0000 7f23a8c00640 1 -- 172.21.15.55:0/2936592168 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2398051490 con 0x7f23ac1528b0 2024-04-02T07:27:01.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.812+0000 7f23b3c00640 1 -- 172.21.15.55:0/2936592168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f23ac066c90 con 0x7f23ac1528b0 2024-04-02T07:27:01.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.812+0000 7f23a8c00640 1 -- 172.21.15.55:0/2936592168 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v44) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2398054ab0 con 0x7f23ac1528b0 2024-04-02T07:27:01.817 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-02T07:27:01.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.812+0000 7f23b3c00640 1 -- 172.21.15.55:0/2936592168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f238c066690 msgr2=0x7f238c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:01.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.812+0000 7f23b3c00640 1 --2- 172.21.15.55:0/2936592168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f238c066690 0x7f238c068b50 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f23ac0719c0 tx=0x7f23a0008040 comp rx=0 tx=0).stop 2024-04-02T07:27:01.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.812+0000 7f23b3c00640 1 -- 172.21.15.55:0/2936592168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23ac1528b0 msgr2=0x7f23ac1f41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:01.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.812+0000 7f23b3c00640 1 --2- 172.21.15.55:0/2936592168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23ac1528b0 0x7f23ac1f41e0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f239800f770 tx=0x7f239800fb70 comp rx=0 tx=0).stop 2024-04-02T07:27:01.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.812+0000 7f23b3c00640 1 -- 172.21.15.55:0/2936592168 shutdown_connections 2024-04-02T07:27:01.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.812+0000 7f23b3c00640 1 --2- 172.21.15.55:0/2936592168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f23ac06f790 0x7f23ac06fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.812+0000 7f23b3c00640 1 --2- 172.21.15.55:0/2936592168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23ac1528b0 0x7f23ac1f41e0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.812+0000 7f23b3c00640 1 --2- 172.21.15.55:0/2936592168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f238c066690 0x7f238c068b50 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.812+0000 7f23b3c00640 1 --2- 172.21.15.55:0/2936592168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2394005190 0x7f23ac1efc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:01.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.812+0000 7f23b3c00640 1 -- 172.21.15.55:0/2936592168 >> 172.21.15.55:0/2936592168 conn(0x7f23ac0b21d0 msgr2=0x7f23ac0ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:01.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.812+0000 7f23b3c00640 1 -- 172.21.15.55:0/2936592168 shutdown_connections 2024-04-02T07:27:01.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:01.812+0000 7f23b3c00640 1 -- 172.21.15.55:0/2936592168 wait complete. 2024-04-02T07:27:01.838 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-02T07:27:01.839 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-02T07:27:01.839 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-02T07:27:01.839 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-02T07:27:01.839 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-02T07:27:01.839 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-02T07:27:01.839 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-02T07:27:01.839 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-02T07:27:01.839 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:27:01.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:01.839 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-02T07:27:01.849 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:27:01.849 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:27:01.849 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:27:01.849 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:27:01.849 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-02T07:27:01.849 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:27:01.849 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:27:01.850 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:27:01.850 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-02T07:27:01.850 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:27:01.850 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:27:01.850 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-02T07:27:01.850 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-02T07:27:01.850 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:27:01.850 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-02T07:27:01.850 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-02T07:27:01.850 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42173sec preferred_lft 42173sec 2024-04-02T07:27:01.850 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2024-04-02T07:27:01.850 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:27:01.850 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:27:01.850 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:27:01.851 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-02T07:27:01.851 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-02T07:27:01.851 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:81:5a:89:17 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:27:01.851 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-02T07:27:01.851 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:27:01.851 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:27:01.851 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-02T07:27:01.851 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-02T07:27:01.851 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:27:01.851 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-02T07:27:01.851 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:27:01.851 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:27:01.851 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-02T07:27:01.852 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-02T07:27:01.852 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:27:01.852 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:27:01.852 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-02T07:27:01.852 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-02T07:27:01.852 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:27:01.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:01.852 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-02T07:27:01.909 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:27:01.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:01.912 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-02T07:27:01.964 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-02T07:27:01.964 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-02T07:27:01.964 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-02T07:27:01.964 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-02T07:27:01.965 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-02T07:27:01.965 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-02T07:27:01.965 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:01.965 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:27:01.965 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:27:01.965 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-02T07:27:01.965 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-02T07:27:01.965 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-02T07:27:01.965 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:27:02.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:02.056 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-02T07:27:02.065 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-02T07:27:02.065 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-02T07:27:02.066 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:27:02.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:02.067 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-02T07:27:02.129 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-02T07:27:02.129 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:27:02.129 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-02T07:27:02.183 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:27:02.184 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:27:02.184 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:27:02.235 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:27:02.299 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:27:02.299 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:27:02.361 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:27:02.362 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:27:02.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:02.363 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:27:02.415 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-02T07:27:02.415 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-02T07:27:02.462 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:27:02.483 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:27:02.483 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:27:02.545 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:27:02.547 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:27:02.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:02.548 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:27:02.557 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:2024-04-02T07:27:02.552+0000 7f1c4bc60580 -1 init, newargv = 0x56231915dcb0 newargc=15 2024-04-02T07:27:02.558 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[43074]: starting ceph client 2024-04-02T07:27:02.564 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[43074]: starting fuse 2024-04-02T07:27:02.566 INFO:teuthology.orchestra.run.smithi055.stdout:43 2024-04-02T07:27:02.566 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-02T07:27:02.566 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:27:02.566 DEBUG:teuthology.orchestra.run.smithi055:> import glob 2024-04-02T07:27:02.566 DEBUG:teuthology.orchestra.run.smithi055:> import re 2024-04-02T07:27:02.566 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:27:02.567 DEBUG:teuthology.orchestra.run.smithi055:> import subprocess 2024-04-02T07:27:02.567 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:27:02.567 DEBUG:teuthology.orchestra.run.smithi055:> def _find_admin_socket(client_name): 2024-04-02T07:27:02.567 DEBUG:teuthology.orchestra.run.smithi055:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-02T07:27:02.567 DEBUG:teuthology.orchestra.run.smithi055:> files = glob.glob(asok_path) 2024-04-02T07:27:02.567 DEBUG:teuthology.orchestra.run.smithi055:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-02T07:27:02.567 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:27:02.567 DEBUG:teuthology.orchestra.run.smithi055:> # Given a non-glob path, it better be there 2024-04-02T07:27:02.567 DEBUG:teuthology.orchestra.run.smithi055:> if "*" not in asok_path: 2024-04-02T07:27:02.567 DEBUG:teuthology.orchestra.run.smithi055:> assert(len(files) == 1) 2024-04-02T07:27:02.567 DEBUG:teuthology.orchestra.run.smithi055:> return files[0] 2024-04-02T07:27:02.567 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:27:02.567 DEBUG:teuthology.orchestra.run.smithi055:> for f in files: 2024-04-02T07:27:02.567 DEBUG:teuthology.orchestra.run.smithi055:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-02T07:27:02.567 DEBUG:teuthology.orchestra.run.smithi055:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-02T07:27:02.567 DEBUG:teuthology.orchestra.run.smithi055:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-02T07:27:02.567 DEBUG:teuthology.orchestra.run.smithi055:> contents = proc_f.read() 2024-04-02T07:27:02.567 DEBUG:teuthology.orchestra.run.smithi055:> if mountpoint in contents: 2024-04-02T07:27:02.568 DEBUG:teuthology.orchestra.run.smithi055:> return f 2024-04-02T07:27:02.568 DEBUG:teuthology.orchestra.run.smithi055:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-02T07:27:02.568 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:27:02.568 DEBUG:teuthology.orchestra.run.smithi055:> print(_find_admin_socket("client.0")) 2024-04-02T07:27:02.568 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:27:02.686 INFO:teuthology.orchestra.run.smithi055.stdout:/var/run/ceph/ceph-client.0.43074.asok 2024-04-02T07:27:02.870 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.43074.asok 2024-04-02T07:27:02.871 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:02.871 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.43074.asok status 2024-04-02T07:27:03.047 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:27:03.048 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": { 2024-04-02T07:27:03.048 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_sha1": "d0e392d9aee635f2b65768c460c7a151ead7a5e2", 2024-04-02T07:27:03.048 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)", 2024-04-02T07:27:03.048 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "0", 2024-04-02T07:27:03.048 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2024-04-02T07:27:03.048 INFO:teuthology.orchestra.run.smithi055.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-02T07:27:03.048 INFO:teuthology.orchestra.run.smithi055.stdout: "pid": "43074", 2024-04-02T07:27:03.048 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2024-04-02T07:27:03.048 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:27:03.048 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_count": 0, 2024-04-02T07:27:03.048 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_pinned_count": 0, 2024-04-02T07:27:03.048 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 6849, 2024-04-02T07:27:03.049 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": { 2024-04-02T07:27:03.049 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2024-04-02T07:27:03.049 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2024-04-02T07:27:03.049 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 6849 2024-04-02T07:27:03.049 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:27:03.049 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:27:03.049 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:27:03.049 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:27:03.049 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 1625272363 2024-04-02T07:27:03.049 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:27:03.049 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:27:03.049 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:27:03.049 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:27:03.049 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:27:03.049 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 1625272363 2024-04-02T07:27:03.049 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:27:03.050 INFO:teuthology.orchestra.run.smithi055.stdout: "inst_str": "client.6849 192.168.0.1:0/1625272363", 2024-04-02T07:27:03.050 INFO:teuthology.orchestra.run.smithi055.stdout: "addr_str": "192.168.0.1:0/1625272363", 2024-04-02T07:27:03.050 INFO:teuthology.orchestra.run.smithi055.stdout: "inode_count": 1, 2024-04-02T07:27:03.050 INFO:teuthology.orchestra.run.smithi055.stdout: "mds_epoch": 44, 2024-04-02T07:27:03.050 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch": 74, 2024-04-02T07:27:03.050 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch_barrier": 0, 2024-04-02T07:27:03.050 INFO:teuthology.orchestra.run.smithi055.stdout: "blocklisted": false, 2024-04-02T07:27:03.050 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs" 2024-04-02T07:27:03.050 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:27:03.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:03.063 DEBUG:teuthology.orchestra.run.smithi055:> stat --file-system '--printf=%T 2024-04-02T07:27:03.064 DEBUG:teuthology.orchestra.run.smithi055:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-02T07:27:03.073 INFO:teuthology.orchestra.run.smithi055.stdout:fuseblk 2024-04-02T07:27:03.073 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-02T07:27:03.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:03.073 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:27:03.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:03.140 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir/) 2024-04-02T07:27:03.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:03.198 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_undamaged) 2024-04-02T07:27:03.251 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:03.251 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch subdir/file_to_be_damaged) 2024-04-02T07:27:03.309 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:27:03.310 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:27:03.310 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:27:03.310 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:27:03.310 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/subdir").st_ino) 2024-04-02T07:27:03.310 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:27:03.414 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627776 2024-04-02T07:27:03.603 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:27:03.604 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:27:03.656 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:27:03.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.832+0000 7f06a7e00640 1 Processor -- start 2024-04-02T07:27:03.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.832+0000 7f06a7e00640 1 -- start start 2024-04-02T07:27:03.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.836+0000 7f06a7e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06a00cfdf0 0x7f06a006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:03.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.836+0000 7f06a7e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f06a0098a10 0x7f06a0098e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:03.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.836+0000 7f06a7e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06a00d01d0 con 0x7f06a00b16e0 2024-04-02T07:27:03.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.836+0000 7f06a7e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a0099360 con 0x7f06a00cfdf0 2024-04-02T07:27:03.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.836+0000 7f06a7e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06a006c0e0 con 0x7f06a0098a10 2024-04-02T07:27:03.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.836+0000 7f06a5400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06a00cfdf0 0x7f06a006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:03.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.836+0000 7f06a5400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06a00cfdf0 0x7f06a006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41840/0 (socket says 172.21.15.55:41840) 2024-04-02T07:27:03.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.836+0000 7f06a5400640 1 -- 172.21.15.55:0/1963650124 learned_addr learned my addr 172.21.15.55:0/1963650124 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:03.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.836+0000 7f06a5e00640 1 --2- 172.21.15.55:0/1963650124 >> v2:172.21.15.106:3300/0 conn(0x7f06a0098a10 0x7f06a0098e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:03.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.836+0000 7f06a5400640 1 -- 172.21.15.55:0/1963650124 >> v2:172.21.15.106:3300/0 conn(0x7f06a0098a10 msgr2=0x7f06a0098e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:03.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.836+0000 7f06a5400640 1 --2- 172.21.15.55:0/1963650124 >> v2:172.21.15.106:3300/0 conn(0x7f06a0098a10 0x7f06a0098e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:03.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.836+0000 7f06a5400640 1 -- 172.21.15.55:0/1963650124 >> v1:172.21.15.106:6789/0 conn(0x7f06a00b16e0 legacy=0x7f06a00b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:03.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.836+0000 7f06a5400640 1 -- 172.21.15.55:0/1963650124 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a00b01d0 con 0x7f06a00cfdf0 2024-04-02T07:27:03.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.840+0000 7f06a5400640 1 --2- 172.21.15.55:0/1963650124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06a00cfdf0 0x7f06a006b8b0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f06a0160770 tx=0x7f069401c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ca0befe6834c644 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:03.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.840+0000 7f069fe00640 1 -- 172.21.15.55:0/1963650124 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06940aa610 con 0x7f06a00cfdf0 2024-04-02T07:27:03.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.840+0000 7f069fe00640 1 -- 172.21.15.55:0/1963650124 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06940a6040 con 0x7f06a00cfdf0 2024-04-02T07:27:03.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.840+0000 7f069fe00640 1 -- 172.21.15.55:0/1963650124 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06940aa990 con 0x7f06a00cfdf0 2024-04-02T07:27:03.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.840+0000 7f06a7e00640 1 -- 172.21.15.55:0/1963650124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06a00cfdf0 msgr2=0x7f06a006b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:03.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.840+0000 7f06a7e00640 1 --2- 172.21.15.55:0/1963650124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06a00cfdf0 0x7f06a006b8b0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f06a0160770 tx=0x7f069401c4b0 comp rx=0 tx=0).stop 2024-04-02T07:27:03.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.840+0000 7f06a7e00640 1 -- 172.21.15.55:0/1963650124 shutdown_connections 2024-04-02T07:27:03.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.840+0000 7f06a7e00640 1 --2- 172.21.15.55:0/1963650124 >> v2:172.21.15.106:3300/0 conn(0x7f06a0098a10 0x7f06a0098e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:03.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.840+0000 7f06a7e00640 1 --2- 172.21.15.55:0/1963650124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06a00cfdf0 0x7f06a006b8b0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:03.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.840+0000 7f06a7e00640 1 -- 172.21.15.55:0/1963650124 >> 172.21.15.55:0/1963650124 conn(0x7f06a00b2210 msgr2=0x7f06a00b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:03.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.840+0000 7f06a7e00640 1 -- 172.21.15.55:0/1963650124 shutdown_connections 2024-04-02T07:27:03.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.840+0000 7f06a7e00640 1 -- 172.21.15.55:0/1963650124 wait complete. 2024-04-02T07:27:03.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.840+0000 7f06a7e00640 1 Processor -- start 2024-04-02T07:27:03.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.840+0000 7f06a7e00640 1 -- start start 2024-04-02T07:27:03.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f06a7e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06a0098a10 0x7f06a00c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:03.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f06a7e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06a00b16e0 0x7f06a0156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:03.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f06a7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06a00cfdf0 0x7f06a014ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:03.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f06a7e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a00cadd0 con 0x7f06a00cfdf0 2024-04-02T07:27:03.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f06a7e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06a00cc6e0 con 0x7f06a00b16e0 2024-04-02T07:27:03.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f06a7e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06a00cc9c0 con 0x7f06a0098a10 2024-04-02T07:27:03.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f06a5e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06a00cfdf0 0x7f06a014ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:03.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f06a5e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06a00cfdf0 0x7f06a014ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41856/0 (socket says 172.21.15.55:41856) 2024-04-02T07:27:03.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f06a5e00640 1 -- 172.21.15.55:0/2816807940 learned_addr learned my addr 172.21.15.55:0/2816807940 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:03.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f06a5400640 1 --2- 172.21.15.55:0/2816807940 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06a0098a10 0x7f06a00c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:03.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f06a4a00640 1 --2- 172.21.15.55:0/2816807940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06a00b16e0 0x7f06a0156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:03.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f06a5e00640 1 -- 172.21.15.55:0/2816807940 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06a0098a10 msgr2=0x7f06a00c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:03.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f06a5e00640 1 --2- 172.21.15.55:0/2816807940 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06a0098a10 0x7f06a00c5cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:03.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f06a5e00640 1 -- 172.21.15.55:0/2816807940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06a00b16e0 msgr2=0x7f06a0156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:03.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f06a5e00640 1 --2- 172.21.15.55:0/2816807940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06a00b16e0 0x7f06a0156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:03.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f06a5e00640 1 -- 172.21.15.55:0/2816807940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06940094d0 con 0x7f06a00cfdf0 2024-04-02T07:27:03.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f06a5e00640 1 --2- 172.21.15.55:0/2816807940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06a00cfdf0 0x7f06a014ca00 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f0698007e60 tx=0x7f069800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:03.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f069d600640 1 -- 172.21.15.55:0/2816807940 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698014420 con 0x7f06a00cfdf0 2024-04-02T07:27:03.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f069d600640 1 -- 172.21.15.55:0/2816807940 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06980145a0 con 0x7f06a00cfdf0 2024-04-02T07:27:03.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f06a7e00640 1 -- 172.21.15.55:0/2816807940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06a00cb040 con 0x7f06a00cfdf0 2024-04-02T07:27:03.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f069d600640 1 -- 172.21.15.55:0/2816807940 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0698014950 con 0x7f06a00cfdf0 2024-04-02T07:27:03.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f06a7e00640 1 -- 172.21.15.55:0/2816807940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06a01569c0 con 0x7f06a00cfdf0 2024-04-02T07:27:03.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f06a7e00640 1 -- 172.21.15.55:0/2816807940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06a00cb280 con 0x7f06a00cfdf0 2024-04-02T07:27:03.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.844+0000 7f069d600640 1 -- 172.21.15.55:0/2816807940 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f0698014ab0 con 0x7f06a00cfdf0 2024-04-02T07:27:03.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.848+0000 7f069d600640 1 --2- 172.21.15.55:0/2816807940 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0680066690 0x7f0680068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:03.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.848+0000 7f069d600640 1 -- 172.21.15.55:0/2816807940 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0698084a30 con 0x7f06a00cfdf0 2024-04-02T07:27:03.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.848+0000 7f06a5400640 1 --2- 172.21.15.55:0/2816807940 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0680066690 0x7f0680068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:03.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.848+0000 7f06a5400640 1 --2- 172.21.15.55:0/2816807940 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0680066690 0x7f0680068b50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f06940ae000 tx=0x7f06940b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:03.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:03.852+0000 7f069d600640 1 -- 172.21.15.55:0/2816807940 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f06a00cb280 con 0x7f06a00cfdf0 2024-04-02T07:27:04.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.016+0000 7f06a7e00640 1 -- 172.21.15.55:0/2816807940 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06a00cb280 con 0x7f06a00cfdf0 2024-04-02T07:27:04.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.016+0000 7f069d600640 1 -- 172.21.15.55:0/2816807940 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16198 (secure 0 0 0) 0x7f06a00cb280 con 0x7f06a00cfdf0 2024-04-02T07:27:04.021 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:27:04.021 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":74,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:27:01.102865+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:26:53.196912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-02T07:26:54.514963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.2e","mappings":[{"from":6,"to":0}]},{"pgid":"11.3c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:27:04.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.016+0000 7f06a7e00640 1 -- 172.21.15.55:0/2816807940 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0680066690 msgr2=0x7f0680068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:04.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.016+0000 7f06a7e00640 1 --2- 172.21.15.55:0/2816807940 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0680066690 0x7f0680068b50 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f06940ae000 tx=0x7f06940b5040 comp rx=0 tx=0).stop 2024-04-02T07:27:04.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.016+0000 7f06a7e00640 1 -- 172.21.15.55:0/2816807940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06a00cfdf0 msgr2=0x7f06a014ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:04.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.016+0000 7f06a7e00640 1 --2- 172.21.15.55:0/2816807940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06a00cfdf0 0x7f06a014ca00 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f0698007e60 tx=0x7f069800e4b0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.016+0000 7f06a7e00640 1 -- 172.21.15.55:0/2816807940 shutdown_connections 2024-04-02T07:27:04.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.016+0000 7f06a7e00640 1 --2- 172.21.15.55:0/2816807940 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06a00cfdf0 0x7f06a014ca00 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.016+0000 7f06a7e00640 1 --2- 172.21.15.55:0/2816807940 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0680066690 0x7f0680068b50 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.016+0000 7f06a7e00640 1 --2- 172.21.15.55:0/2816807940 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06a00b16e0 0x7f06a0156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.016+0000 7f06a7e00640 1 --2- 172.21.15.55:0/2816807940 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06a0098a10 0x7f06a00c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.016+0000 7f06a7e00640 1 -- 172.21.15.55:0/2816807940 >> 172.21.15.55:0/2816807940 conn(0x7f06a00b2210 msgr2=0x7f06a00aed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:04.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.016+0000 7f06a7e00640 1 -- 172.21.15.55:0/2816807940 shutdown_connections 2024-04-02T07:27:04.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.016+0000 7f06a7e00640 1 -- 172.21.15.55:0/2816807940 wait complete. 2024-04-02T07:27:04.042 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:26:53.196912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:26:54.514963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:27:04.043 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:27:04.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.180+0000 7f7bbde00640 1 Processor -- start 2024-04-02T07:27:04.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.180+0000 7f7bbde00640 1 -- start start 2024-04-02T07:27:04.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.180+0000 7f7bbde00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7bb80cc880 0x7f7bb806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:04.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.180+0000 7f7bbde00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb8099a70 con 0x7f7bb8098a10 2024-04-02T07:27:04.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.180+0000 7f7bbde00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bb806b5f0 con 0x7f7bb8098e70 2024-04-02T07:27:04.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.180+0000 7f7bbde00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb806bc90 con 0x7f7bb80cc880 2024-04-02T07:27:04.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.180+0000 7f7bb7e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7bb8098a10 0x7f7bb815c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35826/0 (socket says 172.21.15.55:35826) 2024-04-02T07:27:04.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.180+0000 7f7bb7e00640 1 -- 172.21.15.55:0/3347178723 learned_addr learned my addr 172.21.15.55:0/3347178723 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:27:04.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.180+0000 7f7bbca00640 1 --2- 172.21.15.55:0/3347178723 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7bb80cc880 0x7f7bb806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:04.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.180+0000 7f7bb7400640 1 -- 172.21.15.55:0/3347178723 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2453266929 0 0) 0x7f7bb8099a70 con 0x7f7bb8098a10 2024-04-02T07:27:04.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.180+0000 7f7bb7400640 1 -- 172.21.15.55:0/3347178723 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ba0003530 con 0x7f7bb8098a10 2024-04-02T07:27:04.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.180+0000 7f7bb7400640 1 -- 172.21.15.55:0/3347178723 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412933556 0 0) 0x7f7bb806b5f0 con 0x7f7bb8098e70 2024-04-02T07:27:04.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.180+0000 7f7bb7400640 1 -- 172.21.15.55:0/3347178723 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7bb8099a70 con 0x7f7bb8098e70 2024-04-02T07:27:04.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.180+0000 7f7bbca00640 1 -- 172.21.15.55:0/3347178723 >> v1:172.21.15.106:6789/0 conn(0x7f7bb8098e70 legacy=0x7f7bb815c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:04.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.180+0000 7f7bbca00640 1 -- 172.21.15.55:0/3347178723 >> v1:172.21.15.55:6789/0 conn(0x7f7bb8098a10 legacy=0x7f7bb815c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:04.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.180+0000 7f7bb7400640 1 -- 172.21.15.55:0/3347178723 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 869565260 0 0) 0x7f7ba0003530 con 0x7f7bb8098a10 2024-04-02T07:27:04.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.184+0000 7f7bbca00640 1 -- 172.21.15.55:0/3347178723 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bb806bf70 con 0x7f7bb80cc880 2024-04-02T07:27:04.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.184+0000 7f7bbca00640 1 --2- 172.21.15.55:0/3347178723 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7bb80cc880 0x7f7bb806b0b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7bac0097f0 tx=0x7f7bac01c3d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8381f4f783edc87b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.184+0000 7f7bb7400640 1 -- 172.21.15.55:0/3347178723 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4001680 con 0x7f7bb80cc880 2024-04-02T07:27:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.184+0000 7f7bb7400640 1 -- 172.21.15.55:0/3347178723 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bac0a7050 con 0x7f7bb80cc880 2024-04-02T07:27:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.184+0000 7f7bb7400640 1 -- 172.21.15.55:0/3347178723 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac004250 con 0x7f7bb80cc880 2024-04-02T07:27:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.184+0000 7f7bbde00640 1 -- 172.21.15.55:0/3347178723 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7bb80cc880 msgr2=0x7f7bb806b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.184+0000 7f7bbde00640 1 --2- 172.21.15.55:0/3347178723 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7bb80cc880 0x7f7bb806b0b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f7bac0097f0 tx=0x7f7bac01c3d0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.184+0000 7f7bbde00640 1 -- 172.21.15.55:0/3347178723 shutdown_connections 2024-04-02T07:27:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.184+0000 7f7bbde00640 1 --2- 172.21.15.55:0/3347178723 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7bb80cc880 0x7f7bb806b0b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.184+0000 7f7bbde00640 1 -- 172.21.15.55:0/3347178723 >> 172.21.15.55:0/3347178723 conn(0x7f7bb80b1fb0 msgr2=0x7f7bb80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:04.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.184+0000 7f7bbde00640 1 -- 172.21.15.55:0/3347178723 shutdown_connections 2024-04-02T07:27:04.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.184+0000 7f7bbde00640 1 -- 172.21.15.55:0/3347178723 wait complete. 2024-04-02T07:27:04.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bbde00640 1 Processor -- start 2024-04-02T07:27:04.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bbde00640 1 -- start start 2024-04-02T07:27:04.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bbde00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7bb8098a10 0x7f7bb81481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:04.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bbde00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bb8098e70 0x7f7bb80ce750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:04.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bbde00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7bb80cc880 0x7f7bb80cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:04.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bbde00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8159fa0 con 0x7f7bb8098e70 2024-04-02T07:27:04.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bbde00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb815a280 con 0x7f7bb8098a10 2024-04-02T07:27:04.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bbde00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb815a560 con 0x7f7bb80cc880 2024-04-02T07:27:04.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bb7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bb8098e70 0x7f7bb80ce750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:04.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bb7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bb8098e70 0x7f7bb80ce750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41870/0 (socket says 172.21.15.55:41870) 2024-04-02T07:27:04.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bb7e00640 1 -- 172.21.15.55:0/2464318282 learned_addr learned my addr 172.21.15.55:0/2464318282 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:04.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bbca00640 1 --2- 172.21.15.55:0/2464318282 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7bb8098a10 0x7f7bb81481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:04.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bbd400640 1 --2- 172.21.15.55:0/2464318282 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7bb80cc880 0x7f7bb80cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bb7e00640 1 -- 172.21.15.55:0/2464318282 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7bb80cc880 msgr2=0x7f7bb80cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bb7e00640 1 --2- 172.21.15.55:0/2464318282 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7bb80cc880 0x7f7bb80cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bb7e00640 1 -- 172.21.15.55:0/2464318282 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7bb8098a10 msgr2=0x7f7bb81481c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bb7e00640 1 --2- 172.21.15.55:0/2464318282 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7bb8098a10 0x7f7bb81481c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bb7e00640 1 -- 172.21.15.55:0/2464318282 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bac009420 con 0x7f7bb8098e70 2024-04-02T07:27:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bb7e00640 1 --2- 172.21.15.55:0/2464318282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bb8098e70 0x7f7bb80ce750 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f7ba400c6e0 tx=0x7f7ba400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bb4c00640 1 -- 172.21.15.55:0/2464318282 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4005ae0 con 0x7f7bb8098e70 2024-04-02T07:27:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bb4c00640 1 -- 172.21.15.55:0/2464318282 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ba4005c60 con 0x7f7bb8098e70 2024-04-02T07:27:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bb4c00640 1 -- 172.21.15.55:0/2464318282 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba4007070 con 0x7f7bb8098e70 2024-04-02T07:27:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bbde00640 1 -- 172.21.15.55:0/2464318282 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bb815a840 con 0x7f7bb8098e70 2024-04-02T07:27:04.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.188+0000 7f7bbde00640 1 -- 172.21.15.55:0/2464318282 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb815b040 con 0x7f7bb8098e70 2024-04-02T07:27:04.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.192+0000 7f7bbde00640 1 -- 172.21.15.55:0/2464318282 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bb80671b0 con 0x7f7bb8098e70 2024-04-02T07:27:04.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.192+0000 7f7bb4c00640 1 -- 172.21.15.55:0/2464318282 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7ba40071d0 con 0x7f7bb8098e70 2024-04-02T07:27:04.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.192+0000 7f7bb4c00640 1 --2- 172.21.15.55:0/2464318282 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b98066690 0x7f7b98068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:04.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.192+0000 7f7bb4c00640 1 -- 172.21.15.55:0/2464318282 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7ba4083a60 con 0x7f7bb8098e70 2024-04-02T07:27:04.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.192+0000 7f7bbca00640 1 --2- 172.21.15.55:0/2464318282 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b98066690 0x7f7b98068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:04.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.192+0000 7f7bbca00640 1 --2- 172.21.15.55:0/2464318282 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b98066690 0x7f7b98068b50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7bac0ad000 tx=0x7f7bac0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:04.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.196+0000 7f7bb4c00640 1 -- 172.21.15.55:0/2464318282 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7ba4050cf0 con 0x7f7bb8098e70 2024-04-02T07:27:04.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.360+0000 7f7bbde00640 1 -- 172.21.15.55:0/2464318282 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7bb806cf00 con 0x7f7bb8098e70 2024-04-02T07:27:04.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.360+0000 7f7bb4c00640 1 -- 172.21.15.55:0/2464318282 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7ba4017020 con 0x7f7bb8098e70 2024-04-02T07:27:04.366 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:27:04.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.364+0000 7f7bbde00640 1 -- 172.21.15.55:0/2464318282 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b98066690 msgr2=0x7f7b98068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:04.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.364+0000 7f7bbde00640 1 --2- 172.21.15.55:0/2464318282 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b98066690 0x7f7b98068b50 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7bac0ad000 tx=0x7f7bac0a6000 comp rx=0 tx=0).stop 2024-04-02T07:27:04.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.364+0000 7f7bbde00640 1 -- 172.21.15.55:0/2464318282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bb8098e70 msgr2=0x7f7bb80ce750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:04.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.364+0000 7f7bbde00640 1 --2- 172.21.15.55:0/2464318282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bb8098e70 0x7f7bb80ce750 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f7ba400c6e0 tx=0x7f7ba400cba0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.364+0000 7f7bbde00640 1 -- 172.21.15.55:0/2464318282 shutdown_connections 2024-04-02T07:27:04.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.364+0000 7f7bbde00640 1 --2- 172.21.15.55:0/2464318282 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7bb80cc880 0x7f7bb80cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.364+0000 7f7bbde00640 1 --2- 172.21.15.55:0/2464318282 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7bb8098e70 0x7f7bb80ce750 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.364+0000 7f7bbde00640 1 --2- 172.21.15.55:0/2464318282 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7b98066690 0x7f7b98068b50 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.364+0000 7f7bbde00640 1 --2- 172.21.15.55:0/2464318282 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7bb8098a10 0x7f7bb81481c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.364+0000 7f7bbde00640 1 -- 172.21.15.55:0/2464318282 >> 172.21.15.55:0/2464318282 conn(0x7f7bb80b1fb0 msgr2=0x7f7bb8157f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:04.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.364+0000 7f7bbde00640 1 -- 172.21.15.55:0/2464318282 shutdown_connections 2024-04-02T07:27:04.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.364+0000 7f7bbde00640 1 -- 172.21.15.55:0/2464318282 wait complete. 2024-04-02T07:27:04.387 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:27:04.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.524+0000 7fd86b600640 1 Processor -- start 2024-04-02T07:27:04.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.524+0000 7fd86b600640 1 -- start start 2024-04-02T07:27:04.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.524+0000 7fd86b600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8641442f0 0x7fd86415b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:04.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.524+0000 7fd86b600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd864143da0 0x7fd86415e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:04.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.524+0000 7fd86b600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd86415e3a0 con 0x7fd864069d90 2024-04-02T07:27:04.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.528+0000 7fd86b600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8640714e0 con 0x7fd8641442f0 2024-04-02T07:27:04.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.528+0000 7fd86b600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8640717c0 con 0x7fd864143da0 2024-04-02T07:27:04.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.528+0000 7fd863e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8641442f0 0x7fd86415b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:04.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.528+0000 7fd863e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8641442f0 0x7fd86415b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41874/0 (socket says 172.21.15.55:41874) 2024-04-02T07:27:04.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.528+0000 7fd863e00640 1 -- 172.21.15.55:0/796088349 learned_addr learned my addr 172.21.15.55:0/796088349 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.528+0000 7fd869600640 1 --2- 172.21.15.55:0/796088349 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd864143da0 0x7fd86415e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.528+0000 7fd863e00640 1 -- 172.21.15.55:0/796088349 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd864143da0 msgr2=0x7fd86415e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.528+0000 7fd863e00640 1 --2- 172.21.15.55:0/796088349 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd864143da0 0x7fd86415e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.528+0000 7fd863e00640 1 -- 172.21.15.55:0/796088349 >> v1:172.21.15.55:6789/0 conn(0x7fd864069d90 legacy=0x7fd86406a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:04.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.528+0000 7fd863e00640 1 -- 172.21.15.55:0/796088349 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd864071aa0 con 0x7fd8641442f0 2024-04-02T07:27:04.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.528+0000 7fd863e00640 1 --2- 172.21.15.55:0/796088349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8641442f0 0x7fd86415b000 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fd850009870 tx=0x7fd85001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b65d04a452e5eb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:04.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.528+0000 7fd863400640 1 -- 172.21.15.55:0/796088349 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8500ab660 con 0x7fd8641442f0 2024-04-02T07:27:04.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.528+0000 7fd863400640 1 -- 172.21.15.55:0/796088349 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8500ab7c0 con 0x7fd8641442f0 2024-04-02T07:27:04.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.528+0000 7fd863400640 1 -- 172.21.15.55:0/796088349 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8500abb50 con 0x7fd8641442f0 2024-04-02T07:27:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd86b600640 1 -- 172.21.15.55:0/796088349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8641442f0 msgr2=0x7fd86415b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd86b600640 1 --2- 172.21.15.55:0/796088349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8641442f0 0x7fd86415b000 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fd850009870 tx=0x7fd85001c440 comp rx=0 tx=0).stop 2024-04-02T07:27:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd86b600640 1 -- 172.21.15.55:0/796088349 shutdown_connections 2024-04-02T07:27:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd86b600640 1 --2- 172.21.15.55:0/796088349 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd864143da0 0x7fd86415e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd86b600640 1 --2- 172.21.15.55:0/796088349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8641442f0 0x7fd86415b000 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd86b600640 1 -- 172.21.15.55:0/796088349 >> 172.21.15.55:0/796088349 conn(0x7fd8640b1420 msgr2=0x7fd8640b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd86b600640 1 -- 172.21.15.55:0/796088349 shutdown_connections 2024-04-02T07:27:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd86b600640 1 -- 172.21.15.55:0/796088349 wait complete. 2024-04-02T07:27:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd86b600640 1 Processor -- start 2024-04-02T07:27:04.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd86b600640 1 -- start start 2024-04-02T07:27:04.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd86b600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd864069d90 0x7fd8640b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:04.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd86b600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd864143da0 0x7fd86413b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:04.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd86b600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8641442f0 0x7fd86413c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:04.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd86b600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8640b1240 con 0x7fd8641442f0 2024-04-02T07:27:04.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd86b600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8640b0a00 con 0x7fd864143da0 2024-04-02T07:27:04.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd86b600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd86413b660 con 0x7fd864069d90 2024-04-02T07:27:04.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd869600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8641442f0 0x7fd86413c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:04.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd869600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8641442f0 0x7fd86413c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41878/0 (socket says 172.21.15.55:41878) 2024-04-02T07:27:04.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd869600640 1 -- 172.21.15.55:0/1998547960 learned_addr learned my addr 172.21.15.55:0/1998547960 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:04.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd868c00640 1 --2- 172.21.15.55:0/1998547960 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd864069d90 0x7fd8640b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:04.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd863e00640 1 --2- 172.21.15.55:0/1998547960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd864143da0 0x7fd86413b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:04.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd869600640 1 -- 172.21.15.55:0/1998547960 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd864069d90 msgr2=0x7fd8640b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:04.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd869600640 1 --2- 172.21.15.55:0/1998547960 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd864069d90 0x7fd8640b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd869600640 1 -- 172.21.15.55:0/1998547960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd864143da0 msgr2=0x7fd86413b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:04.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd869600640 1 --2- 172.21.15.55:0/1998547960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd864143da0 0x7fd86413b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd869600640 1 -- 172.21.15.55:0/1998547960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8500094d0 con 0x7fd8641442f0 2024-04-02T07:27:04.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.532+0000 7fd863e00640 1 --2- 172.21.15.55:0/1998547960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd864143da0 0x7fd86413b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:27:04.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.536+0000 7fd869600640 1 --2- 172.21.15.55:0/1998547960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8641442f0 0x7fd86413c710 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fd85c007e60 tx=0x7fd85c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:04.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.536+0000 7fd860c00640 1 -- 172.21.15.55:0/1998547960 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c014420 con 0x7fd8641442f0 2024-04-02T07:27:04.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.536+0000 7fd860c00640 1 -- 172.21.15.55:0/1998547960 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd85c0145a0 con 0x7fd8641442f0 2024-04-02T07:27:04.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.536+0000 7fd86b600640 1 -- 172.21.15.55:0/1998547960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8640b0c80 con 0x7fd8641442f0 2024-04-02T07:27:04.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.536+0000 7fd860c00640 1 -- 172.21.15.55:0/1998547960 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd85c014950 con 0x7fd8641442f0 2024-04-02T07:27:04.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.536+0000 7fd86b600640 1 -- 172.21.15.55:0/1998547960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd864163c90 con 0x7fd8641442f0 2024-04-02T07:27:04.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.536+0000 7fd86b600640 1 -- 172.21.15.55:0/1998547960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd864163af0 con 0x7fd8641442f0 2024-04-02T07:27:04.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.536+0000 7fd860c00640 1 -- 172.21.15.55:0/1998547960 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd85c014ab0 con 0x7fd8641442f0 2024-04-02T07:27:04.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.536+0000 7fd860c00640 1 --2- 172.21.15.55:0/1998547960 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd844066690 0x7fd844068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:04.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.536+0000 7fd860c00640 1 -- 172.21.15.55:0/1998547960 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd85c084bc0 con 0x7fd8641442f0 2024-04-02T07:27:04.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.540+0000 7fd868c00640 1 --2- 172.21.15.55:0/1998547960 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd844066690 0x7fd844068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:04.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.540+0000 7fd868c00640 1 --2- 172.21.15.55:0/1998547960 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd844066690 0x7fd844068b50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd858000f70 tx=0x7fd858009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:04.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.540+0000 7fd860c00640 1 -- 172.21.15.55:0/1998547960 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd864163af0 con 0x7fd8641442f0 2024-04-02T07:27:04.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.708+0000 7fd86b600640 1 -- 172.21.15.55:0/1998547960 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd864163af0 con 0x7fd8641442f0 2024-04-02T07:27:04.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.708+0000 7fd860c00640 1 -- 172.21.15.55:0/1998547960 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd864163af0 con 0x7fd8641442f0 2024-04-02T07:27:04.713 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:27:04.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.708+0000 7fd86b600640 1 -- 172.21.15.55:0/1998547960 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd844066690 msgr2=0x7fd844068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:04.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.708+0000 7fd86b600640 1 --2- 172.21.15.55:0/1998547960 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd844066690 0x7fd844068b50 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fd858000f70 tx=0x7fd858009040 comp rx=0 tx=0).stop 2024-04-02T07:27:04.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.708+0000 7fd86b600640 1 -- 172.21.15.55:0/1998547960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8641442f0 msgr2=0x7fd86413c710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:04.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.708+0000 7fd86b600640 1 --2- 172.21.15.55:0/1998547960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8641442f0 0x7fd86413c710 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7fd85c007e60 tx=0x7fd85c00e4b0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.708+0000 7fd86b600640 1 -- 172.21.15.55:0/1998547960 shutdown_connections 2024-04-02T07:27:04.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.708+0000 7fd86b600640 1 --2- 172.21.15.55:0/1998547960 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8641442f0 0x7fd86413c710 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.708+0000 7fd86b600640 1 --2- 172.21.15.55:0/1998547960 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd844066690 0x7fd844068b50 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.708+0000 7fd86b600640 1 --2- 172.21.15.55:0/1998547960 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd864143da0 0x7fd86413b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.708+0000 7fd86b600640 1 --2- 172.21.15.55:0/1998547960 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd864069d90 0x7fd8640b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.708+0000 7fd86b600640 1 -- 172.21.15.55:0/1998547960 >> 172.21.15.55:0/1998547960 conn(0x7fd8640b1420 msgr2=0x7fd864142c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:04.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.708+0000 7fd86b600640 1 -- 172.21.15.55:0/1998547960 shutdown_connections 2024-04-02T07:27:04.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.708+0000 7fd86b600640 1 -- 172.21.15.55:0/1998547960 wait complete. 2024-04-02T07:27:04.735 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:27:04.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.872+0000 7fb97d800640 1 Processor -- start 2024-04-02T07:27:04.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.872+0000 7fb97d800640 1 -- start start 2024-04-02T07:27:04.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.872+0000 7fb97d800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9780709b0 0x7fb9780b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:04.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.872+0000 7fb97d800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb9780b2fd0 0x7fb9780b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:04.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.872+0000 7fb97d800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97815e3a0 con 0x7fb978144260 2024-04-02T07:27:04.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.872+0000 7fb97d800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9780b37c0 con 0x7fb9780b2fd0 2024-04-02T07:27:04.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.872+0000 7fb97d800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97815e5f0 con 0x7fb9780709b0 2024-04-02T07:27:04.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.872+0000 7fb976a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb978144260 0x7fb9780702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35844/0 (socket says 172.21.15.55:35844) 2024-04-02T07:27:04.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.872+0000 7fb976a00640 1 -- 172.21.15.55:0/1696840474 learned_addr learned my addr 172.21.15.55:0/1696840474 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:27:04.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.872+0000 7fb96e000640 1 --2- 172.21.15.55:0/1696840474 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9780709b0 0x7fb9780b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:04.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.872+0000 7fb977400640 1 --2- 172.21.15.55:0/1696840474 >> v2:172.21.15.106:3300/0 conn(0x7fb9780b2fd0 0x7fb9780b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:04.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.872+0000 7fb976000640 1 -- 172.21.15.55:0/1696840474 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717183777 0 0) 0x7fb97815e3a0 con 0x7fb978144260 2024-04-02T07:27:04.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.872+0000 7fb976000640 1 -- 172.21.15.55:0/1696840474 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb95c003530 con 0x7fb978144260 2024-04-02T07:27:04.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.872+0000 7fb96e000640 1 -- 172.21.15.55:0/1696840474 >> v2:172.21.15.106:3300/0 conn(0x7fb9780b2fd0 msgr2=0x7fb9780b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:04.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.872+0000 7fb96e000640 1 --2- 172.21.15.55:0/1696840474 >> v2:172.21.15.106:3300/0 conn(0x7fb9780b2fd0 0x7fb9780b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.872+0000 7fb96e000640 1 -- 172.21.15.55:0/1696840474 >> v1:172.21.15.55:6789/0 conn(0x7fb978144260 legacy=0x7fb9780702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:04.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.872+0000 7fb96e000640 1 -- 172.21.15.55:0/1696840474 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb97815e8d0 con 0x7fb9780709b0 2024-04-02T07:27:04.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.876+0000 7fb96e000640 1 --2- 172.21.15.55:0/1696840474 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9780709b0 0x7fb9780b2a90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb9600097c0 tx=0x7fb96001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab7b4106a3e9dc77 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:04.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.876+0000 7fb976000640 1 -- 172.21.15.55:0/1696840474 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9600ad640 con 0x7fb9780709b0 2024-04-02T07:27:04.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.876+0000 7fb976000640 1 -- 172.21.15.55:0/1696840474 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9600ad7a0 con 0x7fb9780709b0 2024-04-02T07:27:04.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.876+0000 7fb976000640 1 -- 172.21.15.55:0/1696840474 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9600adb10 con 0x7fb9780709b0 2024-04-02T07:27:04.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.876+0000 7fb97d800640 1 -- 172.21.15.55:0/1696840474 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9780709b0 msgr2=0x7fb9780b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:04.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.876+0000 7fb97d800640 1 --2- 172.21.15.55:0/1696840474 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9780709b0 0x7fb9780b2a90 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb9600097c0 tx=0x7fb96001c4a0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.876+0000 7fb97d800640 1 -- 172.21.15.55:0/1696840474 shutdown_connections 2024-04-02T07:27:04.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.876+0000 7fb97d800640 1 --2- 172.21.15.55:0/1696840474 >> v2:172.21.15.106:3300/0 conn(0x7fb9780b2fd0 0x7fb9780b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.876+0000 7fb97d800640 1 --2- 172.21.15.55:0/1696840474 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9780709b0 0x7fb9780b2a90 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.876+0000 7fb97d800640 1 -- 172.21.15.55:0/1696840474 >> 172.21.15.55:0/1696840474 conn(0x7fb97806a390 msgr2=0x7fb9780b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:04.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.876+0000 7fb97d800640 1 -- 172.21.15.55:0/1696840474 shutdown_connections 2024-04-02T07:27:04.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb97d800640 1 -- 172.21.15.55:0/1696840474 wait complete. 2024-04-02T07:27:04.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb97d800640 1 Processor -- start 2024-04-02T07:27:04.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb97d800640 1 -- start start 2024-04-02T07:27:04.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb97d800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9780709b0 0x7fb97815ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:04.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb97d800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9780b2fd0 0x7fb978139c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:04.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb97d800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb978144260 0x7fb97813e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:04.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb97d800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97815bf00 con 0x7fb9780b2fd0 2024-04-02T07:27:04.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb97d800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb97815c740 con 0x7fb9780709b0 2024-04-02T07:27:04.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb97d800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb97815b660 con 0x7fb978144260 2024-04-02T07:27:04.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb96e000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9780b2fd0 0x7fb978139c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:04.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb96e000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9780b2fd0 0x7fb978139c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41880/0 (socket says 172.21.15.55:41880) 2024-04-02T07:27:04.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb96e000640 1 -- 172.21.15.55:0/3348211040 learned_addr learned my addr 172.21.15.55:0/3348211040 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:04.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb977400640 1 --2- 172.21.15.55:0/3348211040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb978144260 0x7fb97813e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:04.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb976a00640 1 --2- 172.21.15.55:0/3348211040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9780709b0 0x7fb97815ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:04.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb96e000640 1 -- 172.21.15.55:0/3348211040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb978144260 msgr2=0x7fb97813e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:04.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb96e000640 1 --2- 172.21.15.55:0/3348211040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb978144260 0x7fb97813e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb96e000640 1 -- 172.21.15.55:0/3348211040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9780709b0 msgr2=0x7fb97815ae30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:04.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb96e000640 1 --2- 172.21.15.55:0/3348211040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9780709b0 0x7fb97815ae30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:04.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb96e000640 1 -- 172.21.15.55:0/3348211040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb960009420 con 0x7fb9780b2fd0 2024-04-02T07:27:04.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb976a00640 1 --2- 172.21.15.55:0/3348211040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9780709b0 0x7fb97815ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:04.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb96e000640 1 --2- 172.21.15.55:0/3348211040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9780b2fd0 0x7fb978139c10 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb960000c10 tx=0x7fb960019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:04.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb96f400640 1 -- 172.21.15.55:0/3348211040 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9600adb10 con 0x7fb9780b2fd0 2024-04-02T07:27:04.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb96f400640 1 -- 172.21.15.55:0/3348211040 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9600a6070 con 0x7fb9780b2fd0 2024-04-02T07:27:04.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb97d800640 1 -- 172.21.15.55:0/3348211040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb97815b940 con 0x7fb9780b2fd0 2024-04-02T07:27:04.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb96f400640 1 -- 172.21.15.55:0/3348211040 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9600ade70 con 0x7fb9780b2fd0 2024-04-02T07:27:04.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.880+0000 7fb97d800640 1 -- 172.21.15.55:0/3348211040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb97815b370 con 0x7fb9780b2fd0 2024-04-02T07:27:04.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.884+0000 7fb97d800640 1 -- 172.21.15.55:0/3348211040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb978073530 con 0x7fb9780b2fd0 2024-04-02T07:27:04.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.884+0000 7fb96f400640 1 -- 172.21.15.55:0/3348211040 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb9600b4040 con 0x7fb9780b2fd0 2024-04-02T07:27:04.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.884+0000 7fb96f400640 1 --2- 172.21.15.55:0/3348211040 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb954066690 0x7fb954068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:04.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.884+0000 7fb96f400640 1 -- 172.21.15.55:0/3348211040 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb96011eca0 con 0x7fb9780b2fd0 2024-04-02T07:27:04.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.884+0000 7fb976a00640 1 --2- 172.21.15.55:0/3348211040 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb954066690 0x7fb954068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:04.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.884+0000 7fb976a00640 1 --2- 172.21.15.55:0/3348211040 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb954066690 0x7fb954068b50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb968005890 tx=0x7fb968009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:04.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:04.888+0000 7fb96f400640 1 -- 172.21.15.55:0/3348211040 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fb9600ebfb0 con 0x7fb9780b2fd0 2024-04-02T07:27:05.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.048+0000 7fb97d800640 1 -- 172.21.15.55:0/3348211040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb97815c8f0 con 0x7fb9780b2fd0 2024-04-02T07:27:05.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.048+0000 7fb96f400640 1 -- 172.21.15.55:0/3348211040 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb97815c8f0 con 0x7fb9780b2fd0 2024-04-02T07:27:05.053 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:27:05.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.048+0000 7fb97d800640 1 -- 172.21.15.55:0/3348211040 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb954066690 msgr2=0x7fb954068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:05.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.048+0000 7fb97d800640 1 --2- 172.21.15.55:0/3348211040 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb954066690 0x7fb954068b50 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fb968005890 tx=0x7fb968009040 comp rx=0 tx=0).stop 2024-04-02T07:27:05.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.048+0000 7fb97d800640 1 -- 172.21.15.55:0/3348211040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9780b2fd0 msgr2=0x7fb978139c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:05.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.048+0000 7fb97d800640 1 --2- 172.21.15.55:0/3348211040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9780b2fd0 0x7fb978139c10 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7fb960000c10 tx=0x7fb960019240 comp rx=0 tx=0).stop 2024-04-02T07:27:05.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.048+0000 7fb97d800640 1 -- 172.21.15.55:0/3348211040 shutdown_connections 2024-04-02T07:27:05.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.048+0000 7fb97d800640 1 --2- 172.21.15.55:0/3348211040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb978144260 0x7fb97813e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.048+0000 7fb97d800640 1 --2- 172.21.15.55:0/3348211040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9780b2fd0 0x7fb978139c10 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.048+0000 7fb97d800640 1 --2- 172.21.15.55:0/3348211040 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb954066690 0x7fb954068b50 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.048+0000 7fb97d800640 1 --2- 172.21.15.55:0/3348211040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9780709b0 0x7fb97815ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.048+0000 7fb97d800640 1 -- 172.21.15.55:0/3348211040 >> 172.21.15.55:0/3348211040 conn(0x7fb97806a390 msgr2=0x7fb9781638d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:05.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.048+0000 7fb97d800640 1 -- 172.21.15.55:0/3348211040 shutdown_connections 2024-04-02T07:27:05.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.048+0000 7fb97d800640 1 -- 172.21.15.55:0/3348211040 wait complete. 2024-04-02T07:27:05.075 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:27:05.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.216+0000 7fa793000640 1 Processor -- start 2024-04-02T07:27:05.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.216+0000 7fa793000640 1 -- start start 2024-04-02T07:27:05.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.216+0000 7fa793000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa78c1599c0 0x7fa78c0b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:05.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.216+0000 7fa793000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa78c06d1c0 0x7fa78c0b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:05.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.216+0000 7fa793000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa78c0afe70 0x7fa78c0b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:05.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.216+0000 7fa793000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78c06cda0 con 0x7fa78c0afe70 2024-04-02T07:27:05.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.216+0000 7fa793000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa78c0b3c60 con 0x7fa78c1599c0 2024-04-02T07:27:05.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.216+0000 7fa793000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c0b1d60 con 0x7fa78c06d1c0 2024-04-02T07:27:05.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.216+0000 7fa791000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa78c0afe70 0x7fa78c0b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:05.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.216+0000 7fa791000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa78c0afe70 0x7fa78c0b3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41886/0 (socket says 172.21.15.55:41886) 2024-04-02T07:27:05.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.216+0000 7fa791000640 1 -- 172.21.15.55:0/2499166361 learned_addr learned my addr 172.21.15.55:0/2499166361 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:05.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.216+0000 7fa78be00640 1 --2- 172.21.15.55:0/2499166361 >> v2:172.21.15.106:3300/0 conn(0x7fa78c1599c0 0x7fa78c0b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:05.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.216+0000 7fa78b400640 1 --2- 172.21.15.55:0/2499166361 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa78c06d1c0 0x7fa78c0b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:05.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.216+0000 7fa791000640 1 -- 172.21.15.55:0/2499166361 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa78c06d1c0 msgr2=0x7fa78c0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:05.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.216+0000 7fa791000640 1 --2- 172.21.15.55:0/2499166361 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa78c06d1c0 0x7fa78c0b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.216+0000 7fa791000640 1 -- 172.21.15.55:0/2499166361 >> v2:172.21.15.106:3300/0 conn(0x7fa78c1599c0 msgr2=0x7fa78c0b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:05.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.216+0000 7fa791000640 1 --2- 172.21.15.55:0/2499166361 >> v2:172.21.15.106:3300/0 conn(0x7fa78c1599c0 0x7fa78c0b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.216+0000 7fa791000640 1 -- 172.21.15.55:0/2499166361 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa78c06c400 con 0x7fa78c0afe70 2024-04-02T07:27:05.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.220+0000 7fa791000640 1 --2- 172.21.15.55:0/2499166361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa78c0afe70 0x7fa78c0b3720 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0b1520 tx=0x7fa78401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce046711ce076504 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:05.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.220+0000 7fa78aa00640 1 -- 172.21.15.55:0/2499166361 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7840a5760 con 0x7fa78c0afe70 2024-04-02T07:27:05.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.220+0000 7fa78aa00640 1 -- 172.21.15.55:0/2499166361 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7840a58c0 con 0x7fa78c0afe70 2024-04-02T07:27:05.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.220+0000 7fa78aa00640 1 -- 172.21.15.55:0/2499166361 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7840a5c50 con 0x7fa78c0afe70 2024-04-02T07:27:05.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.220+0000 7fa793000640 1 -- 172.21.15.55:0/2499166361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa78c0afe70 msgr2=0x7fa78c0b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:05.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.220+0000 7fa793000640 1 --2- 172.21.15.55:0/2499166361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa78c0afe70 0x7fa78c0b3720 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0b1520 tx=0x7fa78401c9f0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.220+0000 7fa793000640 1 -- 172.21.15.55:0/2499166361 shutdown_connections 2024-04-02T07:27:05.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.220+0000 7fa793000640 1 --2- 172.21.15.55:0/2499166361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa78c0afe70 0x7fa78c0b3720 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.220+0000 7fa793000640 1 --2- 172.21.15.55:0/2499166361 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa78c06d1c0 0x7fa78c0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.220+0000 7fa793000640 1 --2- 172.21.15.55:0/2499166361 >> v2:172.21.15.106:3300/0 conn(0x7fa78c1599c0 0x7fa78c0b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.220+0000 7fa793000640 1 -- 172.21.15.55:0/2499166361 >> 172.21.15.55:0/2499166361 conn(0x7fa78c069d90 msgr2=0x7fa78c06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:05.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.220+0000 7fa793000640 1 -- 172.21.15.55:0/2499166361 shutdown_connections 2024-04-02T07:27:05.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.220+0000 7fa793000640 1 -- 172.21.15.55:0/2499166361 wait complete. 2024-04-02T07:27:05.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.220+0000 7fa793000640 1 Processor -- start 2024-04-02T07:27:05.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.220+0000 7fa793000640 1 -- start start 2024-04-02T07:27:05.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa793000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa78c06d1c0 0x7fa78c0c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:05.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa793000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa78c0afe70 0x7fa78c157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:05.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa793000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa78c1599c0 0x7fa78c158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:05.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa793000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c144bb0 con 0x7fa78c06d1c0 2024-04-02T07:27:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa793000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c159fb0 con 0x7fa78c0afe70 2024-04-02T07:27:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa793000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa78c158b60 con 0x7fa78c1599c0 2024-04-02T07:27:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa78be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa78c06d1c0 0x7fa78c0c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa78be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa78c06d1c0 0x7fa78c0c7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41888/0 (socket says 172.21.15.55:41888) 2024-04-02T07:27:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa78be00640 1 -- 172.21.15.55:0/285951342 learned_addr learned my addr 172.21.15.55:0/285951342 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa78b400640 1 --2- 172.21.15.55:0/285951342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa78c0afe70 0x7fa78c157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa791000640 1 --2- 172.21.15.55:0/285951342 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa78c1599c0 0x7fa78c158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa78be00640 1 -- 172.21.15.55:0/285951342 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa78c1599c0 msgr2=0x7fa78c158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa78be00640 1 --2- 172.21.15.55:0/285951342 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa78c1599c0 0x7fa78c158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa78be00640 1 -- 172.21.15.55:0/285951342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa78c0afe70 msgr2=0x7fa78c157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa78be00640 1 --2- 172.21.15.55:0/285951342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa78c0afe70 0x7fa78c157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa78be00640 1 -- 172.21.15.55:0/285951342 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa784009b30 con 0x7fa78c06d1c0 2024-04-02T07:27:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa78be00640 1 --2- 172.21.15.55:0/285951342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa78c06d1c0 0x7fa78c0c7d60 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00d5f0 tx=0x7fa77c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:05.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa783e00640 1 -- 172.21.15.55:0/285951342 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c0125f0 con 0x7fa78c06d1c0 2024-04-02T07:27:05.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa783e00640 1 -- 172.21.15.55:0/285951342 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa77c012750 con 0x7fa78c06d1c0 2024-04-02T07:27:05.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa783e00640 1 -- 172.21.15.55:0/285951342 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa77c012ae0 con 0x7fa78c06d1c0 2024-04-02T07:27:05.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa793000640 1 -- 172.21.15.55:0/285951342 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78c158e40 con 0x7fa78c06d1c0 2024-04-02T07:27:05.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa793000640 1 -- 172.21.15.55:0/285951342 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa78c15a4e0 con 0x7fa78c06d1c0 2024-04-02T07:27:05.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.224+0000 7fa793000640 1 -- 172.21.15.55:0/285951342 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78c06e270 con 0x7fa78c06d1c0 2024-04-02T07:27:05.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.228+0000 7fa783e00640 1 -- 172.21.15.55:0/285951342 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa77c012c40 con 0x7fa78c06d1c0 2024-04-02T07:27:05.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.228+0000 7fa783e00640 1 --2- 172.21.15.55:0/285951342 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa76c066690 0x7fa76c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:05.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.228+0000 7fa783e00640 1 -- 172.21.15.55:0/285951342 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa77c084650 con 0x7fa78c06d1c0 2024-04-02T07:27:05.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.228+0000 7fa78b400640 1 --2- 172.21.15.55:0/285951342 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa76c066690 0x7fa76c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:05.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.228+0000 7fa78b400640 1 --2- 172.21.15.55:0/285951342 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa76c066690 0x7fa76c068b50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0b3460 tx=0x7fa778008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:05.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.232+0000 7fa783e00640 1 -- 172.21.15.55:0/285951342 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa77c051990 con 0x7fa78c06d1c0 2024-04-02T07:27:05.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.404+0000 7fa793000640 1 -- 172.21.15.55:0/285951342 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa78c066c90 con 0x7fa78c06d1c0 2024-04-02T07:27:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.404+0000 7fa783e00640 1 -- 172.21.15.55:0/285951342 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v74) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa77c054fb0 con 0x7fa78c06d1c0 2024-04-02T07:27:05.409 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:27:05.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.404+0000 7fa793000640 1 -- 172.21.15.55:0/285951342 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa76c066690 msgr2=0x7fa76c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:05.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.404+0000 7fa793000640 1 --2- 172.21.15.55:0/285951342 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa76c066690 0x7fa76c068b50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fa78c0b3460 tx=0x7fa778008040 comp rx=0 tx=0).stop 2024-04-02T07:27:05.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.404+0000 7fa793000640 1 -- 172.21.15.55:0/285951342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa78c06d1c0 msgr2=0x7fa78c0c7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:05.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.404+0000 7fa793000640 1 --2- 172.21.15.55:0/285951342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa78c06d1c0 0x7fa78c0c7d60 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fa77c00d5f0 tx=0x7fa77c00dab0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.404+0000 7fa793000640 1 -- 172.21.15.55:0/285951342 shutdown_connections 2024-04-02T07:27:05.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.404+0000 7fa793000640 1 --2- 172.21.15.55:0/285951342 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa78c1599c0 0x7fa78c158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.404+0000 7fa793000640 1 --2- 172.21.15.55:0/285951342 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa76c066690 0x7fa76c068b50 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.404+0000 7fa793000640 1 --2- 172.21.15.55:0/285951342 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa78c0afe70 0x7fa78c157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.404+0000 7fa793000640 1 --2- 172.21.15.55:0/285951342 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa78c06d1c0 0x7fa78c0c7d60 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.404+0000 7fa793000640 1 -- 172.21.15.55:0/285951342 >> 172.21.15.55:0/285951342 conn(0x7fa78c069d90 msgr2=0x7fa78c06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:05.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.404+0000 7fa793000640 1 -- 172.21.15.55:0/285951342 shutdown_connections 2024-04-02T07:27:05.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.404+0000 7fa793000640 1 -- 172.21.15.55:0/285951342 wait complete. 2024-04-02T07:27:05.430 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:27:05.430 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:27:05.438 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:27:05.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.612+0000 7fd26fe00640 1 Processor -- start 2024-04-02T07:27:05.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.612+0000 7fd26fe00640 1 -- start start 2024-04-02T07:27:05.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.612+0000 7fd26fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd27015ff90 0x7fd270098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:05.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.612+0000 7fd26fe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd2700cadf0 0x7fd2700cb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:05.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.612+0000 7fd26fe00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2700af460 con 0x7fd2700d0050 2024-04-02T07:27:05.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.612+0000 7fd26fe00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2700cf0f0 con 0x7fd27015ff90 2024-04-02T07:27:05.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.612+0000 7fd26fe00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2700af690 con 0x7fd2700cadf0 2024-04-02T07:27:05.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.612+0000 7fd26ea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd27015ff90 0x7fd270098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:05.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.612+0000 7fd26ea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd27015ff90 0x7fd270098a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42070/0 (socket says 172.21.15.55:42070) 2024-04-02T07:27:05.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.612+0000 7fd26ea00640 1 -- 172.21.15.55:0/1962724935 learned_addr learned my addr 172.21.15.55:0/1962724935 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:05.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.612+0000 7fd26f400640 1 --2- 172.21.15.55:0/1962724935 >> v2:172.21.15.106:3300/0 conn(0x7fd2700cadf0 0x7fd2700cb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:05.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.612+0000 7fd26ea00640 1 -- 172.21.15.55:0/1962724935 >> v2:172.21.15.106:3300/0 conn(0x7fd2700cadf0 msgr2=0x7fd2700cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:05.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.612+0000 7fd26ea00640 1 --2- 172.21.15.55:0/1962724935 >> v2:172.21.15.106:3300/0 conn(0x7fd2700cadf0 0x7fd2700cb260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.612+0000 7fd26ea00640 1 -- 172.21.15.55:0/1962724935 >> v1:172.21.15.106:6789/0 conn(0x7fd2700d0050 legacy=0x7fd270098f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:05.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.612+0000 7fd26ea00640 1 -- 172.21.15.55:0/1962724935 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2700cf3b0 con 0x7fd27015ff90 2024-04-02T07:27:05.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.616+0000 7fd26ea00640 1 --2- 172.21.15.55:0/1962724935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd27015ff90 0x7fd270098a10 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd270071590 tx=0x7fd26001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418ff68e9ec97a8a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:05.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.616+0000 7fd26e000640 1 -- 172.21.15.55:0/1962724935 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2600aa610 con 0x7fd27015ff90 2024-04-02T07:27:05.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.616+0000 7fd26e000640 1 -- 172.21.15.55:0/1962724935 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2600a6040 con 0x7fd27015ff90 2024-04-02T07:27:05.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.616+0000 7fd26e000640 1 -- 172.21.15.55:0/1962724935 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2600aa990 con 0x7fd27015ff90 2024-04-02T07:27:05.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.616+0000 7fd26fe00640 1 -- 172.21.15.55:0/1962724935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd27015ff90 msgr2=0x7fd270098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:05.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.616+0000 7fd26fe00640 1 --2- 172.21.15.55:0/1962724935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd27015ff90 0x7fd270098a10 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fd270071590 tx=0x7fd26001c4b0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.616+0000 7fd26fe00640 1 -- 172.21.15.55:0/1962724935 shutdown_connections 2024-04-02T07:27:05.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.616+0000 7fd26fe00640 1 --2- 172.21.15.55:0/1962724935 >> v2:172.21.15.106:3300/0 conn(0x7fd2700cadf0 0x7fd2700cb260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.616+0000 7fd26fe00640 1 --2- 172.21.15.55:0/1962724935 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd27015ff90 0x7fd270098a10 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.616+0000 7fd26fe00640 1 -- 172.21.15.55:0/1962724935 >> 172.21.15.55:0/1962724935 conn(0x7fd2700b1fb0 msgr2=0x7fd2700b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:05.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.616+0000 7fd26fe00640 1 -- 172.21.15.55:0/1962724935 shutdown_connections 2024-04-02T07:27:05.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.616+0000 7fd26fe00640 1 -- 172.21.15.55:0/1962724935 wait complete. 2024-04-02T07:27:05.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd26fe00640 1 Processor -- start 2024-04-02T07:27:05.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd26fe00640 1 -- start start 2024-04-02T07:27:05.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd26fe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd2700cadf0 0x7fd270151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:05.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd26fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2700d0050 0x7fd2700c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:05.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd26fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd27015ff90 0x7fd2700ae180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:05.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd26fe00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd270152390 con 0x7fd27015ff90 2024-04-02T07:27:05.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd26fe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2701525e0 con 0x7fd2700d0050 2024-04-02T07:27:05.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd26fe00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2701528c0 con 0x7fd2700cadf0 2024-04-02T07:27:05.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd26f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd27015ff90 0x7fd2700ae180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:05.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd26f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd27015ff90 0x7fd2700ae180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42072/0 (socket says 172.21.15.55:42072) 2024-04-02T07:27:05.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd26f400640 1 -- 172.21.15.55:0/4211619334 learned_addr learned my addr 172.21.15.55:0/4211619334 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:05.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd26ea00640 1 --2- 172.21.15.55:0/4211619334 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd2700cadf0 0x7fd270151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:05.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd266000640 1 --2- 172.21.15.55:0/4211619334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2700d0050 0x7fd2700c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:05.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd26f400640 1 -- 172.21.15.55:0/4211619334 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd2700cadf0 msgr2=0x7fd270151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:05.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd26f400640 1 --2- 172.21.15.55:0/4211619334 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd2700cadf0 0x7fd270151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd26f400640 1 -- 172.21.15.55:0/4211619334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2700d0050 msgr2=0x7fd2700c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:05.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd26f400640 1 --2- 172.21.15.55:0/4211619334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2700d0050 0x7fd2700c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd26f400640 1 -- 172.21.15.55:0/4211619334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2600094d0 con 0x7fd27015ff90 2024-04-02T07:27:05.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd26f400640 1 --2- 172.21.15.55:0/4211619334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd27015ff90 0x7fd2700ae180 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fd26800d560 tx=0x7fd26800da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:05.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd267400640 1 -- 172.21.15.55:0/4211619334 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2680125f0 con 0x7fd27015ff90 2024-04-02T07:27:05.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd267400640 1 -- 172.21.15.55:0/4211619334 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd268012770 con 0x7fd27015ff90 2024-04-02T07:27:05.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd267400640 1 -- 172.21.15.55:0/4211619334 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268012b20 con 0x7fd27015ff90 2024-04-02T07:27:05.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd26fe00640 1 -- 172.21.15.55:0/4211619334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd270152ba0 con 0x7fd27015ff90 2024-04-02T07:27:05.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.620+0000 7fd26fe00640 1 -- 172.21.15.55:0/4211619334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd270153160 con 0x7fd27015ff90 2024-04-02T07:27:05.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.624+0000 7fd26fe00640 1 -- 172.21.15.55:0/4211619334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd270073fa0 con 0x7fd27015ff90 2024-04-02T07:27:05.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.624+0000 7fd267400640 1 -- 172.21.15.55:0/4211619334 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd268012c80 con 0x7fd27015ff90 2024-04-02T07:27:05.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.624+0000 7fd267400640 1 --2- 172.21.15.55:0/4211619334 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd24c066690 0x7fd24c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:05.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.624+0000 7fd267400640 1 -- 172.21.15.55:0/4211619334 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd268084550 con 0x7fd27015ff90 2024-04-02T07:27:05.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.624+0000 7fd26ea00640 1 --2- 172.21.15.55:0/4211619334 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd24c066690 0x7fd24c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:05.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.624+0000 7fd26ea00640 1 --2- 172.21.15.55:0/4211619334 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd24c066690 0x7fd24c068b50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd2600ae000 tx=0x7fd2600b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:05.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.628+0000 7fd267400640 1 -- 172.21.15.55:0/4211619334 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd268051920 con 0x7fd27015ff90 2024-04-02T07:27:05.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.788+0000 7fd26fe00640 1 -- 172.21.15.55:0/4211619334 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd27015a650 con 0x7fd27015ff90 2024-04-02T07:27:05.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.792+0000 7fd267400640 1 -- 172.21.15.55:0/4211619334 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v74) v1 ==== 74+0+16198 (secure 0 0 0) 0x7fd268054f40 con 0x7fd27015ff90 2024-04-02T07:27:05.796 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:27:05.796 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":74,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:27:01.102865+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:26:53.196912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-02T07:26:54.514963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.2e","mappings":[{"from":6,"to":0}]},{"pgid":"11.3c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:27:05.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.792+0000 7fd26fe00640 1 -- 172.21.15.55:0/4211619334 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd24c066690 msgr2=0x7fd24c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:05.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.792+0000 7fd26fe00640 1 --2- 172.21.15.55:0/4211619334 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd24c066690 0x7fd24c068b50 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd2600ae000 tx=0x7fd2600b5040 comp rx=0 tx=0).stop 2024-04-02T07:27:05.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.792+0000 7fd26fe00640 1 -- 172.21.15.55:0/4211619334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd27015ff90 msgr2=0x7fd2700ae180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:05.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.792+0000 7fd26fe00640 1 --2- 172.21.15.55:0/4211619334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd27015ff90 0x7fd2700ae180 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7fd26800d560 tx=0x7fd26800da20 comp rx=0 tx=0).stop 2024-04-02T07:27:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.792+0000 7fd26fe00640 1 -- 172.21.15.55:0/4211619334 shutdown_connections 2024-04-02T07:27:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.792+0000 7fd26fe00640 1 --2- 172.21.15.55:0/4211619334 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd27015ff90 0x7fd2700ae180 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.792+0000 7fd26fe00640 1 --2- 172.21.15.55:0/4211619334 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd24c066690 0x7fd24c068b50 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.792+0000 7fd26fe00640 1 --2- 172.21.15.55:0/4211619334 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd2700d0050 0x7fd2700c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.792+0000 7fd26fe00640 1 --2- 172.21.15.55:0/4211619334 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd2700cadf0 0x7fd270151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.792+0000 7fd26fe00640 1 -- 172.21.15.55:0/4211619334 >> 172.21.15.55:0/4211619334 conn(0x7fd2700b1fb0 msgr2=0x7fd27006e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.792+0000 7fd26fe00640 1 -- 172.21.15.55:0/4211619334 shutdown_connections 2024-04-02T07:27:05.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.792+0000 7fd26fe00640 1 -- 172.21.15.55:0/4211619334 wait complete. 2024-04-02T07:27:05.818 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:26:53.196912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:26:54.514963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:27:05.819 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:27:05.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.956+0000 7f176d400640 1 Processor -- start 2024-04-02T07:27:05.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.956+0000 7f176d400640 1 -- start start 2024-04-02T07:27:05.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.956+0000 7f176d400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f17680b3dc0 0x7f17680ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:05.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.956+0000 7f176d400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f17680b41a0 0x7f1768142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:05.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.956+0000 7f176d400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f176806ddc0 con 0x7f17680ade90 2024-04-02T07:27:05.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.956+0000 7f176d400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176806c630 con 0x7f17680b41a0 2024-04-02T07:27:05.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.956+0000 7f176d400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f176806c8f0 con 0x7f17680b3dc0 2024-04-02T07:27:05.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.960+0000 7f1767200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f17680b41a0 0x7f1768142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:05.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.956+0000 7f175de00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f17680ade90 0x7f176806d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39314/0 (socket says 172.21.15.55:39314) 2024-04-02T07:27:05.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.960+0000 7f175de00640 1 -- 172.21.15.55:0/1685406182 learned_addr learned my addr 172.21.15.55:0/1685406182 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:27:05.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.960+0000 7f1766800640 1 --2- 172.21.15.55:0/1685406182 >> v2:172.21.15.106:3300/0 conn(0x7f17680b3dc0 0x7f17680ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:05.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.960+0000 7f1765e00640 1 -- 172.21.15.55:0/1685406182 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577662464 0 0) 0x7f176806ddc0 con 0x7f17680ade90 2024-04-02T07:27:05.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.960+0000 7f1767200640 1 -- 172.21.15.55:0/1685406182 >> v2:172.21.15.106:3300/0 conn(0x7f17680b3dc0 msgr2=0x7f17680ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:05.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.960+0000 7f1767200640 1 --2- 172.21.15.55:0/1685406182 >> v2:172.21.15.106:3300/0 conn(0x7f17680b3dc0 0x7f17680ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.960+0000 7f1767200640 1 -- 172.21.15.55:0/1685406182 >> v1:172.21.15.55:6789/0 conn(0x7f17680ade90 legacy=0x7f176806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:05.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.960+0000 7f1767200640 1 -- 172.21.15.55:0/1685406182 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f176806cbd0 con 0x7f17680b41a0 2024-04-02T07:27:05.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.960+0000 7f1767200640 1 --2- 172.21.15.55:0/1685406182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17680b41a0 0x7f1768142ac0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f17680b1900 tx=0x7f176001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9007baff99bcb0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:05.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.960+0000 7f1765e00640 1 -- 172.21.15.55:0/1685406182 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17600a58d0 con 0x7f17680b41a0 2024-04-02T07:27:05.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.960+0000 7f1765e00640 1 -- 172.21.15.55:0/1685406182 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17600a5a30 con 0x7f17680b41a0 2024-04-02T07:27:05.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.960+0000 7f1765e00640 1 -- 172.21.15.55:0/1685406182 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17600a5dc0 con 0x7f17680b41a0 2024-04-02T07:27:05.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.960+0000 7f176d400640 1 -- 172.21.15.55:0/1685406182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17680b41a0 msgr2=0x7f1768142ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:05.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.960+0000 7f176d400640 1 --2- 172.21.15.55:0/1685406182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17680b41a0 0x7f1768142ac0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f17680b1900 tx=0x7f176001c900 comp rx=0 tx=0).stop 2024-04-02T07:27:05.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f176d400640 1 -- 172.21.15.55:0/1685406182 shutdown_connections 2024-04-02T07:27:05.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f176d400640 1 --2- 172.21.15.55:0/1685406182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17680b41a0 0x7f1768142ac0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f176d400640 1 --2- 172.21.15.55:0/1685406182 >> v2:172.21.15.106:3300/0 conn(0x7f17680b3dc0 0x7f17680ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f176d400640 1 -- 172.21.15.55:0/1685406182 >> 172.21.15.55:0/1685406182 conn(0x7f176806a390 msgr2=0x7f17680b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:05.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f176d400640 1 -- 172.21.15.55:0/1685406182 shutdown_connections 2024-04-02T07:27:05.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f176d400640 1 -- 172.21.15.55:0/1685406182 wait complete. 2024-04-02T07:27:05.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f176d400640 1 Processor -- start 2024-04-02T07:27:05.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f176d400640 1 -- start start 2024-04-02T07:27:05.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f176d400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17680ade90 0x7f17681582f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:05.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f176d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17680b3dc0 0x7f1768159d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:05.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f176d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17680b41a0 0x7f176815a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f176d400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176813a130 con 0x7f17680b3dc0 2024-04-02T07:27:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f176d400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f176815c260 con 0x7f17680b41a0 2024-04-02T07:27:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f176d400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f176815c540 con 0x7f17680ade90 2024-04-02T07:27:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f175de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17680b3dc0 0x7f1768159d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f175de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17680b3dc0 0x7f1768159d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42080/0 (socket says 172.21.15.55:42080) 2024-04-02T07:27:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f175de00640 1 -- 172.21.15.55:0/1435378437 learned_addr learned my addr 172.21.15.55:0/1435378437 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f1766800640 1 --2- 172.21.15.55:0/1435378437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17680ade90 0x7f17681582f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f1767200640 1 --2- 172.21.15.55:0/1435378437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17680b41a0 0x7f176815a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f175de00640 1 -- 172.21.15.55:0/1435378437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17680ade90 msgr2=0x7f17681582f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f175de00640 1 --2- 172.21.15.55:0/1435378437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17680ade90 0x7f17681582f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f175de00640 1 -- 172.21.15.55:0/1435378437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17680b41a0 msgr2=0x7f176815a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f175de00640 1 --2- 172.21.15.55:0/1435378437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17680b41a0 0x7f176815a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f175de00640 1 -- 172.21.15.55:0/1435378437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1760009a70 con 0x7f17680b3dc0 2024-04-02T07:27:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f1766800640 1 --2- 172.21.15.55:0/1435378437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17680ade90 0x7f17681582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:05.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.964+0000 7f175de00640 1 --2- 172.21.15.55:0/1435378437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17680b3dc0 0x7f1768159d20 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f17500011f0 tx=0x7f175000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:05.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.968+0000 7f175f400640 1 -- 172.21.15.55:0/1435378437 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17500074e0 con 0x7f17680b3dc0 2024-04-02T07:27:05.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.968+0000 7f175f400640 1 -- 172.21.15.55:0/1435378437 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1750007640 con 0x7f17680b3dc0 2024-04-02T07:27:05.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.968+0000 7f175f400640 1 -- 172.21.15.55:0/1435378437 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1750004a10 con 0x7f17680b3dc0 2024-04-02T07:27:05.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.968+0000 7f176d400640 1 -- 172.21.15.55:0/1435378437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f176815c820 con 0x7f17680b3dc0 2024-04-02T07:27:05.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.968+0000 7f176d400640 1 -- 172.21.15.55:0/1435378437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1768158830 con 0x7f17680b3dc0 2024-04-02T07:27:05.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.968+0000 7f176d400640 1 -- 172.21.15.55:0/1435378437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1768073530 con 0x7f17680b3dc0 2024-04-02T07:27:05.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.968+0000 7f175f400640 1 -- 172.21.15.55:0/1435378437 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1750004b70 con 0x7f17680b3dc0 2024-04-02T07:27:05.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.968+0000 7f175f400640 1 --2- 172.21.15.55:0/1435378437 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1744066690 0x7f1744068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:05.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.968+0000 7f175f400640 1 -- 172.21.15.55:0/1435378437 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1750083530 con 0x7f17680b3dc0 2024-04-02T07:27:05.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.968+0000 7f1766800640 1 --2- 172.21.15.55:0/1435378437 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1744066690 0x7f1744068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:05.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.972+0000 7f1766800640 1 --2- 172.21.15.55:0/1435378437 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1744066690 0x7f1744068b50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1758007a70 tx=0x7f1758008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:05.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:05.972+0000 7f175f400640 1 -- 172.21.15.55:0/1435378437 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f17500507c0 con 0x7f17680b3dc0 2024-04-02T07:27:06.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.132+0000 7f176d400640 1 -- 172.21.15.55:0/1435378437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f17680b49e0 con 0x7f17680b3dc0 2024-04-02T07:27:06.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.132+0000 7f175f400640 1 -- 172.21.15.55:0/1435378437 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v74) v1 ==== 93+0+10 (secure 0 0 0) 0x7f17500180a0 con 0x7f17680b3dc0 2024-04-02T07:27:06.138 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:27:06.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.136+0000 7f176d400640 1 -- 172.21.15.55:0/1435378437 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1744066690 msgr2=0x7f1744068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:06.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.136+0000 7f176d400640 1 --2- 172.21.15.55:0/1435378437 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1744066690 0x7f1744068b50 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f1758007a70 tx=0x7f1758008040 comp rx=0 tx=0).stop 2024-04-02T07:27:06.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.136+0000 7f176d400640 1 -- 172.21.15.55:0/1435378437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17680b3dc0 msgr2=0x7f1768159d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:06.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.136+0000 7f176d400640 1 --2- 172.21.15.55:0/1435378437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17680b3dc0 0x7f1768159d20 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f17500011f0 tx=0x7f175000c9b0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.136+0000 7f176d400640 1 -- 172.21.15.55:0/1435378437 shutdown_connections 2024-04-02T07:27:06.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.136+0000 7f176d400640 1 --2- 172.21.15.55:0/1435378437 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1744066690 0x7f1744068b50 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.136+0000 7f176d400640 1 --2- 172.21.15.55:0/1435378437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17680b41a0 0x7f176815a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.136+0000 7f176d400640 1 --2- 172.21.15.55:0/1435378437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17680b3dc0 0x7f1768159d20 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.136+0000 7f176d400640 1 --2- 172.21.15.55:0/1435378437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17680ade90 0x7f17681582f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.136+0000 7f176d400640 1 -- 172.21.15.55:0/1435378437 >> 172.21.15.55:0/1435378437 conn(0x7f176806a390 msgr2=0x7f17680cd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:06.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.136+0000 7f176d400640 1 -- 172.21.15.55:0/1435378437 shutdown_connections 2024-04-02T07:27:06.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.136+0000 7f176d400640 1 -- 172.21.15.55:0/1435378437 wait complete. 2024-04-02T07:27:06.159 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:27:06.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.296+0000 7f4503000640 1 Processor -- start 2024-04-02T07:27:06.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.300+0000 7f4503000640 1 -- start start 2024-04-02T07:27:06.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.300+0000 7f4503000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f44fc144260 0x7f44fc0702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:06.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.300+0000 7f4503000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc0707e0 0x7f44fc0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:06.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.300+0000 7f4503000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44fc0b2fd0 0x7f44fc0cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:06.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.300+0000 7f4503000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44fc0b37c0 con 0x7f44fc0b2fd0 2024-04-02T07:27:06.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.300+0000 7f4503000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44fc15e3a0 con 0x7f44fc144260 2024-04-02T07:27:06.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.300+0000 7f4503000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc070c60 con 0x7f44fc0707e0 2024-04-02T07:27:06.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.300+0000 7f4501000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44fc0b2fd0 0x7f44fc0cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:06.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.300+0000 7f4501000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44fc0b2fd0 0x7f44fc0cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42086/0 (socket says 172.21.15.55:42086) 2024-04-02T07:27:06.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.300+0000 7f4501000640 1 -- 172.21.15.55:0/671500801 learned_addr learned my addr 172.21.15.55:0/671500801 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:06.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.300+0000 7f4501000640 1 -- 172.21.15.55:0/671500801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc0707e0 msgr2=0x7f44fc0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:06.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.300+0000 7f44f3e00640 1 --2- 172.21.15.55:0/671500801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc0707e0 0x7f44fc0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:06.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.300+0000 7f44fbe00640 1 --2- 172.21.15.55:0/671500801 >> v2:172.21.15.106:3300/0 conn(0x7f44fc144260 0x7f44fc0702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:06.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.300+0000 7f4501000640 1 --2- 172.21.15.55:0/671500801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc0707e0 0x7f44fc0b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.300+0000 7f4501000640 1 -- 172.21.15.55:0/671500801 >> v2:172.21.15.106:3300/0 conn(0x7f44fc144260 msgr2=0x7f44fc0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:06.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.300+0000 7f4501000640 1 --2- 172.21.15.55:0/671500801 >> v2:172.21.15.106:3300/0 conn(0x7f44fc144260 0x7f44fc0702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.300+0000 7f4501000640 1 -- 172.21.15.55:0/671500801 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44fc15e5f0 con 0x7f44fc0b2fd0 2024-04-02T07:27:06.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.300+0000 7f44f3e00640 1 --2- 172.21.15.55:0/671500801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc0707e0 0x7f44fc0b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:27:06.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.300+0000 7f44fbe00640 1 --2- 172.21.15.55:0/671500801 >> v2:172.21.15.106:3300/0 conn(0x7f44fc144260 0x7f44fc0702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:27:06.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.304+0000 7f4501000640 1 --2- 172.21.15.55:0/671500801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0b2fd0 0x7f44fc0cc4c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f44fc06aa30 tx=0x7f44f401c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4a40f898b68f99 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.304+0000 7f44fb400640 1 -- 172.21.15.55:0/671500801 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f40a64b0 con 0x7f44fc0b2fd0 2024-04-02T07:27:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.304+0000 7f44fb400640 1 -- 172.21.15.55:0/671500801 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f40a6610 con 0x7f44fc0b2fd0 2024-04-02T07:27:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.304+0000 7f44fb400640 1 -- 172.21.15.55:0/671500801 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f40a69a0 con 0x7f44fc0b2fd0 2024-04-02T07:27:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.304+0000 7f4503000640 1 -- 172.21.15.55:0/671500801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0b2fd0 msgr2=0x7f44fc0cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.304+0000 7f4503000640 1 --2- 172.21.15.55:0/671500801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0b2fd0 0x7f44fc0cc4c0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f44fc06aa30 tx=0x7f44f401c730 comp rx=0 tx=0).stop 2024-04-02T07:27:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.304+0000 7f4503000640 1 -- 172.21.15.55:0/671500801 shutdown_connections 2024-04-02T07:27:06.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.304+0000 7f4503000640 1 --2- 172.21.15.55:0/671500801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0b2fd0 0x7f44fc0cc4c0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.304+0000 7f4503000640 1 --2- 172.21.15.55:0/671500801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc0707e0 0x7f44fc0b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.304+0000 7f4503000640 1 --2- 172.21.15.55:0/671500801 >> v2:172.21.15.106:3300/0 conn(0x7f44fc144260 0x7f44fc0702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.304+0000 7f4503000640 1 -- 172.21.15.55:0/671500801 >> 172.21.15.55:0/671500801 conn(0x7f44fc06a390 msgr2=0x7f44fc0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:06.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.304+0000 7f4503000640 1 -- 172.21.15.55:0/671500801 shutdown_connections 2024-04-02T07:27:06.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.304+0000 7f4503000640 1 -- 172.21.15.55:0/671500801 wait complete. 2024-04-02T07:27:06.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.304+0000 7f4503000640 1 Processor -- start 2024-04-02T07:27:06.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.304+0000 7f4503000640 1 -- start start 2024-04-02T07:27:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f4503000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0707e0 0x7f44fc13a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f4503000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc0b2fd0 0x7f44fc138610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f4503000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44fc144260 0x7f44fc142170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f4503000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc1f35c0 con 0x7f44fc0707e0 2024-04-02T07:27:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f4503000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc15b2d0 con 0x7f44fc144260 2024-04-02T07:27:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f4503000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc15b730 con 0x7f44fc0b2fd0 2024-04-02T07:27:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f44fbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0707e0 0x7f44fc13a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f44fbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0707e0 0x7f44fc13a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42094/0 (socket says 172.21.15.55:42094) 2024-04-02T07:27:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f44fbe00640 1 -- 172.21.15.55:0/3254196618 learned_addr learned my addr 172.21.15.55:0/3254196618 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:06.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f44f3e00640 1 --2- 172.21.15.55:0/3254196618 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc0b2fd0 0x7f44fc138610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:06.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f4501000640 1 --2- 172.21.15.55:0/3254196618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44fc144260 0x7f44fc142170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:06.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f44fbe00640 1 -- 172.21.15.55:0/3254196618 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc0b2fd0 msgr2=0x7f44fc138610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:06.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f44fbe00640 1 --2- 172.21.15.55:0/3254196618 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc0b2fd0 0x7f44fc138610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f44fbe00640 1 -- 172.21.15.55:0/3254196618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44fc144260 msgr2=0x7f44fc142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:06.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f44fbe00640 1 --2- 172.21.15.55:0/3254196618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44fc144260 0x7f44fc142170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f44fbe00640 1 -- 172.21.15.55:0/3254196618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f4009b30 con 0x7f44fc0707e0 2024-04-02T07:27:06.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f44fbe00640 1 --2- 172.21.15.55:0/3254196618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0707e0 0x7f44fc13a310 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00c7f0 tx=0x7f44ec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:06.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f44f8c00640 1 -- 172.21.15.55:0/3254196618 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec007820 con 0x7f44fc0707e0 2024-04-02T07:27:06.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f44f8c00640 1 -- 172.21.15.55:0/3254196618 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ec007980 con 0x7f44fc0707e0 2024-04-02T07:27:06.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f44f8c00640 1 -- 172.21.15.55:0/3254196618 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec007d30 con 0x7f44fc0707e0 2024-04-02T07:27:06.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f4503000640 1 -- 172.21.15.55:0/3254196618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44fc15ba10 con 0x7f44fc0707e0 2024-04-02T07:27:06.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f4503000640 1 -- 172.21.15.55:0/3254196618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44fc138b50 con 0x7f44fc0707e0 2024-04-02T07:27:06.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f4503000640 1 -- 172.21.15.55:0/3254196618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44fc073530 con 0x7f44fc0707e0 2024-04-02T07:27:06.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.308+0000 7f44f8c00640 1 -- 172.21.15.55:0/3254196618 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f44ec0113f0 con 0x7f44fc0707e0 2024-04-02T07:27:06.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.312+0000 7f44f8c00640 1 --2- 172.21.15.55:0/3254196618 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f44d8066690 0x7f44d8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:06.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.312+0000 7f44f8c00640 1 -- 172.21.15.55:0/3254196618 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f44ec084450 con 0x7f44fc0707e0 2024-04-02T07:27:06.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.312+0000 7f44f3e00640 1 --2- 172.21.15.55:0/3254196618 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f44d8066690 0x7f44d8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:06.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.312+0000 7f44f3e00640 1 --2- 172.21.15.55:0/3254196618 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f44d8066690 0x7f44d8068b50 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f44fc15e2e0 tx=0x7f44e4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:06.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.316+0000 7f44f8c00640 1 -- 172.21.15.55:0/3254196618 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f44ec051830 con 0x7f44fc0707e0 2024-04-02T07:27:06.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.488+0000 7f4503000640 1 -- 172.21.15.55:0/3254196618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f44fc0703b0 con 0x7f44fc0707e0 2024-04-02T07:27:06.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.488+0000 7f44f8c00640 1 -- 172.21.15.55:0/3254196618 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v74) v1 ==== 104+0+11 (secure 0 0 0) 0x7f44ec054e50 con 0x7f44fc0707e0 2024-04-02T07:27:06.493 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:27:06.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.488+0000 7f4503000640 1 -- 172.21.15.55:0/3254196618 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f44d8066690 msgr2=0x7f44d8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:06.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.488+0000 7f4503000640 1 --2- 172.21.15.55:0/3254196618 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f44d8066690 0x7f44d8068b50 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f44fc15e2e0 tx=0x7f44e4008040 comp rx=0 tx=0).stop 2024-04-02T07:27:06.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.488+0000 7f4503000640 1 -- 172.21.15.55:0/3254196618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0707e0 msgr2=0x7f44fc13a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:06.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.488+0000 7f4503000640 1 --2- 172.21.15.55:0/3254196618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0707e0 0x7f44fc13a310 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f44ec00c7f0 tx=0x7f44ec00ccb0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.488+0000 7f4503000640 1 -- 172.21.15.55:0/3254196618 shutdown_connections 2024-04-02T07:27:06.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.488+0000 7f4503000640 1 --2- 172.21.15.55:0/3254196618 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f44d8066690 0x7f44d8068b50 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.488+0000 7f4503000640 1 --2- 172.21.15.55:0/3254196618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44fc144260 0x7f44fc142170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.488+0000 7f4503000640 1 --2- 172.21.15.55:0/3254196618 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44fc0b2fd0 0x7f44fc138610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.488+0000 7f4503000640 1 --2- 172.21.15.55:0/3254196618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44fc0707e0 0x7f44fc13a310 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.488+0000 7f4503000640 1 -- 172.21.15.55:0/3254196618 >> 172.21.15.55:0/3254196618 conn(0x7f44fc06a390 msgr2=0x7f44fc13ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:06.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.488+0000 7f4503000640 1 -- 172.21.15.55:0/3254196618 shutdown_connections 2024-04-02T07:27:06.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.488+0000 7f4503000640 1 -- 172.21.15.55:0/3254196618 wait complete. 2024-04-02T07:27:06.515 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:27:06.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.652+0000 7f98e3c00640 1 Processor -- start 2024-04-02T07:27:06.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.652+0000 7f98e3c00640 1 -- start start 2024-04-02T07:27:06.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.652+0000 7f98e3c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f98dc15ca60 0x7f98dc0cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:06.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.656+0000 7f98e3c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f98dc098a10 0x7f98dc098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:06.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.656+0000 7f98e3c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98dc0993b0 con 0x7f98dc06b920 2024-04-02T07:27:06.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.656+0000 7f98e3c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98dc06c460 con 0x7f98dc15ca60 2024-04-02T07:27:06.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.656+0000 7f98e3c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc15ce40 con 0x7f98dc098a10 2024-04-02T07:27:06.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.656+0000 7f98dbe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f98dc098a10 0x7f98dc098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:06.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.656+0000 7f98e1200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f98dc15ca60 0x7f98dc0cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:06.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.656+0000 7f98e1c00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f98dc06b920 0x7f98dc06bd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:34292/0 (socket says 172.21.15.55:34292) 2024-04-02T07:27:06.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.656+0000 7f98e1c00640 1 -- 172.21.15.55:0/47402486 learned_addr learned my addr 172.21.15.55:0/47402486 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:27:06.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.656+0000 7f98dbe00640 1 -- 172.21.15.55:0/47402486 >> v2:172.21.15.106:3300/0 conn(0x7f98dc15ca60 msgr2=0x7f98dc0cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:06.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.656+0000 7f98dbe00640 1 --2- 172.21.15.55:0/47402486 >> v2:172.21.15.106:3300/0 conn(0x7f98dc15ca60 0x7f98dc0cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.656+0000 7f98dbe00640 1 -- 172.21.15.55:0/47402486 >> v1:172.21.15.106:6789/0 conn(0x7f98dc06b920 legacy=0x7f98dc06bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:06.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.656+0000 7f98dbe00640 1 -- 172.21.15.55:0/47402486 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc0d01b0 con 0x7f98dc098a10 2024-04-02T07:27:06.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.660+0000 7f98dbe00640 1 --2- 172.21.15.55:0/47402486 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f98dc098a10 0x7f98dc098e70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f98c80097c0 tx=0x7f98c801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16d70241204e42de server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:06.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.660+0000 7f98db400640 1 -- 172.21.15.55:0/47402486 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c80ac640 con 0x7f98dc098a10 2024-04-02T07:27:06.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.660+0000 7f98db400640 1 -- 172.21.15.55:0/47402486 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c80ac7a0 con 0x7f98dc098a10 2024-04-02T07:27:06.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.660+0000 7f98db400640 1 -- 172.21.15.55:0/47402486 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98c80acb30 con 0x7f98dc098a10 2024-04-02T07:27:06.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.660+0000 7f98e3c00640 1 -- 172.21.15.55:0/47402486 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f98dc098a10 msgr2=0x7f98dc098e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:06.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.660+0000 7f98e3c00640 1 --2- 172.21.15.55:0/47402486 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f98dc098a10 0x7f98dc098e70 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f98c80097c0 tx=0x7f98c801c3e0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.660+0000 7f98e3c00640 1 -- 172.21.15.55:0/47402486 shutdown_connections 2024-04-02T07:27:06.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.660+0000 7f98e3c00640 1 --2- 172.21.15.55:0/47402486 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f98dc098a10 0x7f98dc098e70 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.660+0000 7f98e3c00640 1 --2- 172.21.15.55:0/47402486 >> v2:172.21.15.106:3300/0 conn(0x7f98dc15ca60 0x7f98dc0cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.660+0000 7f98e3c00640 1 -- 172.21.15.55:0/47402486 >> 172.21.15.55:0/47402486 conn(0x7f98dc0b2150 msgr2=0x7f98dc0b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:06.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.660+0000 7f98e3c00640 1 -- 172.21.15.55:0/47402486 shutdown_connections 2024-04-02T07:27:06.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.660+0000 7f98e3c00640 1 -- 172.21.15.55:0/47402486 wait complete. 2024-04-02T07:27:06.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.660+0000 7f98e3c00640 1 Processor -- start 2024-04-02T07:27:06.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.660+0000 7f98e3c00640 1 -- start start 2024-04-02T07:27:06.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.660+0000 7f98e3c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98dc06b920 0x7f98dc152f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:06.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.660+0000 7f98e3c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f98dc098a10 0x7f98dc1534d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:06.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.660+0000 7f98e3c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98dc15ca60 0x7f98dc153a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:06.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.660+0000 7f98e3c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc155150 con 0x7f98dc15ca60 2024-04-02T07:27:06.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.660+0000 7f98e3c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0b5150 con 0x7f98dc06b920 2024-04-02T07:27:06.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.660+0000 7f98e3c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0b4e70 con 0x7f98dc098a10 2024-04-02T07:27:06.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.664+0000 7f98e1c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98dc15ca60 0x7f98dc153a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:06.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.664+0000 7f98e1200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98dc06b920 0x7f98dc152f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:06.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.664+0000 7f98dbe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f98dc098a10 0x7f98dc1534d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:06.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.664+0000 7f98dbe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f98dc098a10 0x7f98dc1534d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:44926/0 (socket says 172.21.15.55:44926) 2024-04-02T07:27:06.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.664+0000 7f98dbe00640 1 -- 172.21.15.55:0/678788677 learned_addr learned my addr 172.21.15.55:0/678788677 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:06.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.664+0000 7f98e1200640 1 -- 172.21.15.55:0/678788677 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f98dc098a10 msgr2=0x7f98dc1534d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:06.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.664+0000 7f98e1200640 1 --2- 172.21.15.55:0/678788677 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f98dc098a10 0x7f98dc1534d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.664+0000 7f98e1200640 1 -- 172.21.15.55:0/678788677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98dc15ca60 msgr2=0x7f98dc153a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:06.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.664+0000 7f98e1200640 1 --2- 172.21.15.55:0/678788677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98dc15ca60 0x7f98dc153a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.664+0000 7f98e1200640 1 -- 172.21.15.55:0/678788677 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c8009420 con 0x7f98dc06b920 2024-04-02T07:27:06.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.664+0000 7f98e1c00640 1 --2- 172.21.15.55:0/678788677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98dc15ca60 0x7f98dc153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:27:06.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.664+0000 7f98e1200640 1 --2- 172.21.15.55:0/678788677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98dc06b920 0x7f98dc152f90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f98d000e8a0 tx=0x7f98d000ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:06.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.664+0000 7f98d8c00640 1 -- 172.21.15.55:0/678788677 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d000c940 con 0x7f98dc06b920 2024-04-02T07:27:06.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.664+0000 7f98d8c00640 1 -- 172.21.15.55:0/678788677 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d000caa0 con 0x7f98dc06b920 2024-04-02T07:27:06.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.664+0000 7f98d8c00640 1 -- 172.21.15.55:0/678788677 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d000ce10 con 0x7f98dc06b920 2024-04-02T07:27:06.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.664+0000 7f98e3c00640 1 -- 172.21.15.55:0/678788677 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98dc0c7b30 con 0x7f98dc06b920 2024-04-02T07:27:06.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.664+0000 7f98e3c00640 1 -- 172.21.15.55:0/678788677 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98dc0c80f0 con 0x7f98dc06b920 2024-04-02T07:27:06.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.664+0000 7f98e3c00640 1 -- 172.21.15.55:0/678788677 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98dc06f360 con 0x7f98dc06b920 2024-04-02T07:27:06.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.664+0000 7f98d8c00640 1 -- 172.21.15.55:0/678788677 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f98d0013470 con 0x7f98dc06b920 2024-04-02T07:27:06.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.668+0000 7f98d8c00640 1 --2- 172.21.15.55:0/678788677 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f98bc066690 0x7f98bc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:06.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.668+0000 7f98d8c00640 1 -- 172.21.15.55:0/678788677 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f98d0084390 con 0x7f98dc06b920 2024-04-02T07:27:06.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.668+0000 7f98dbe00640 1 --2- 172.21.15.55:0/678788677 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f98bc066690 0x7f98bc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:06.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.668+0000 7f98dbe00640 1 --2- 172.21.15.55:0/678788677 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f98bc066690 0x7f98bc068b50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f98c801c420 tx=0x7f98c80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:06.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.672+0000 7f98d8c00640 1 -- 172.21.15.55:0/678788677 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f98d00516d0 con 0x7f98dc06b920 2024-04-02T07:27:06.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.828+0000 7f98e3c00640 1 -- 172.21.15.55:0/678788677 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f98dc066c90 con 0x7f98dc06b920 2024-04-02T07:27:06.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.832+0000 7f98d8c00640 1 -- 172.21.15.55:0/678788677 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v74) v1 ==== 100+0+11 (secure 0 0 0) 0x7f98d0054cf0 con 0x7f98dc06b920 2024-04-02T07:27:06.836 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:27:06.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.832+0000 7f98e3c00640 1 -- 172.21.15.55:0/678788677 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f98bc066690 msgr2=0x7f98bc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:06.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.832+0000 7f98e3c00640 1 --2- 172.21.15.55:0/678788677 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f98bc066690 0x7f98bc068b50 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f98c801c420 tx=0x7f98c80a7000 comp rx=0 tx=0).stop 2024-04-02T07:27:06.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.832+0000 7f98e3c00640 1 -- 172.21.15.55:0/678788677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98dc06b920 msgr2=0x7f98dc152f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:06.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.832+0000 7f98e3c00640 1 --2- 172.21.15.55:0/678788677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98dc06b920 0x7f98dc152f90 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f98d000e8a0 tx=0x7f98d000ed60 comp rx=0 tx=0).stop 2024-04-02T07:27:06.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.832+0000 7f98e3c00640 1 -- 172.21.15.55:0/678788677 shutdown_connections 2024-04-02T07:27:06.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.832+0000 7f98e3c00640 1 --2- 172.21.15.55:0/678788677 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98dc15ca60 0x7f98dc153a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.832+0000 7f98e3c00640 1 --2- 172.21.15.55:0/678788677 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f98dc098a10 0x7f98dc1534d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.832+0000 7f98e3c00640 1 --2- 172.21.15.55:0/678788677 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f98bc066690 0x7f98bc068b50 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.832+0000 7f98e3c00640 1 --2- 172.21.15.55:0/678788677 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f98dc06b920 0x7f98dc152f90 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:06.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.832+0000 7f98e3c00640 1 -- 172.21.15.55:0/678788677 >> 172.21.15.55:0/678788677 conn(0x7f98dc0b2150 msgr2=0x7f98dc06e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:06.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.832+0000 7f98e3c00640 1 -- 172.21.15.55:0/678788677 shutdown_connections 2024-04-02T07:27:06.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.832+0000 7f98e3c00640 1 -- 172.21.15.55:0/678788677 wait complete. 2024-04-02T07:27:06.856 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:27:06.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.992+0000 7f74d5400640 1 Processor -- start 2024-04-02T07:27:06.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.992+0000 7f74d5400640 1 -- start start 2024-04-02T07:27:06.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.992+0000 7f74d5400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f74d00cfef0 0x7f74d0098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.992+0000 7f74d5400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74d0098f50 0x7f74d00b5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.992+0000 7f74d5400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d00d0350 con 0x7f74d015cd50 2024-04-02T07:27:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.992+0000 7f74d5400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d00993e0 con 0x7f74d00cfef0 2024-04-02T07:27:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.992+0000 7f74d5400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d00ccb30 con 0x7f74d0098f50 2024-04-02T07:27:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.992+0000 7f74c7e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f74d00cfef0 0x7f74d0098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.992+0000 7f74ce800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f74d015cd50 0x7f74d006bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39320/0 (socket says 172.21.15.55:39320) 2024-04-02T07:27:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.992+0000 7f74ce800640 1 -- 172.21.15.55:0/1588251410 learned_addr learned my addr 172.21.15.55:0/1588251410 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:27:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.996+0000 7f74cf200640 1 --2- 172.21.15.55:0/1588251410 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74d0098f50 0x7f74d00b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.996+0000 7f74c7e00640 1 -- 172.21.15.55:0/1588251410 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74d0098f50 msgr2=0x7f74d00b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.996+0000 7f74c7e00640 1 --2- 172.21.15.55:0/1588251410 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74d0098f50 0x7f74d00b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.996+0000 7f74c7e00640 1 -- 172.21.15.55:0/1588251410 >> v1:172.21.15.55:6789/0 conn(0x7f74d015cd50 legacy=0x7f74d006bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:07.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.996+0000 7f74c7e00640 1 -- 172.21.15.55:0/1588251410 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d006c2a0 con 0x7f74d00cfef0 2024-04-02T07:27:07.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.996+0000 7f74cde00640 1 -- 172.21.15.55:0/1588251410 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530784490 0 0) 0x7f74d00d0350 con 0x7f74d015cd50 2024-04-02T07:27:07.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.996+0000 7f74cf200640 1 --2- 172.21.15.55:0/1588251410 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74d0098f50 0x7f74d00b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:07.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.996+0000 7f74c7e00640 1 --2- 172.21.15.55:0/1588251410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74d00cfef0 0x7f74d0098a10 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f74b80097c0 tx=0x7f74b801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108b5216934790a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:07.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.996+0000 7f74cde00640 1 -- 172.21.15.55:0/1588251410 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80ac640 con 0x7f74d00cfef0 2024-04-02T07:27:07.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.996+0000 7f74cde00640 1 -- 172.21.15.55:0/1588251410 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b80ac7a0 con 0x7f74d00cfef0 2024-04-02T07:27:07.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.996+0000 7f74cde00640 1 -- 172.21.15.55:0/1588251410 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b80acb30 con 0x7f74d00cfef0 2024-04-02T07:27:07.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.996+0000 7f74d5400640 1 -- 172.21.15.55:0/1588251410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74d00cfef0 msgr2=0x7f74d0098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:07.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:06.996+0000 7f74d5400640 1 --2- 172.21.15.55:0/1588251410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74d00cfef0 0x7f74d0098a10 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f74b80097c0 tx=0x7f74b801c3e0 comp rx=0 tx=0).stop 2024-04-02T07:27:07.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74d5400640 1 -- 172.21.15.55:0/1588251410 shutdown_connections 2024-04-02T07:27:07.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74d5400640 1 --2- 172.21.15.55:0/1588251410 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74d0098f50 0x7f74d00b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:07.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74d5400640 1 --2- 172.21.15.55:0/1588251410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74d00cfef0 0x7f74d0098a10 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:07.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74d5400640 1 -- 172.21.15.55:0/1588251410 >> 172.21.15.55:0/1588251410 conn(0x7f74d00b2160 msgr2=0x7f74d00b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:07.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74d5400640 1 -- 172.21.15.55:0/1588251410 shutdown_connections 2024-04-02T07:27:07.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74d5400640 1 -- 172.21.15.55:0/1588251410 wait complete. 2024-04-02T07:27:07.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74d5400640 1 Processor -- start 2024-04-02T07:27:07.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74d5400640 1 -- start start 2024-04-02T07:27:07.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74d5400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74d0098f50 0x7f74d00c7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:07.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74d5400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74d00cfef0 0x7f74d015ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:07.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74d5400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74d015cd50 0x7f74d015f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:07.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74d5400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d00c9030 con 0x7f74d0098f50 2024-04-02T07:27:07.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74d5400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d00c7f90 con 0x7f74d015cd50 2024-04-02T07:27:07.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74d5400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d00c8270 con 0x7f74d00cfef0 2024-04-02T07:27:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74ce800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74d0098f50 0x7f74d00c7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74ce800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74d0098f50 0x7f74d00c7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42118/0 (socket says 172.21.15.55:42118) 2024-04-02T07:27:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74ce800640 1 -- 172.21.15.55:0/3916392988 learned_addr learned my addr 172.21.15.55:0/3916392988 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74c7e00640 1 --2- 172.21.15.55:0/3916392988 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74d00cfef0 0x7f74d015ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74cf200640 1 --2- 172.21.15.55:0/3916392988 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74d015cd50 0x7f74d015f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74ce800640 1 -- 172.21.15.55:0/3916392988 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74d00cfef0 msgr2=0x7f74d015ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74ce800640 1 --2- 172.21.15.55:0/3916392988 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74d00cfef0 0x7f74d015ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74ce800640 1 -- 172.21.15.55:0/3916392988 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74d015cd50 msgr2=0x7f74d015f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74ce800640 1 --2- 172.21.15.55:0/3916392988 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74d015cd50 0x7f74d015f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74ce800640 1 -- 172.21.15.55:0/3916392988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b8009420 con 0x7f74d0098f50 2024-04-02T07:27:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74ce800640 1 --2- 172.21.15.55:0/3916392988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74d0098f50 0x7f74d00c7740 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f74c000c480 tx=0x7f74c000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.000+0000 7f74c6a00640 1 -- 172.21.15.55:0/3916392988 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c00074e0 con 0x7f74d0098f50 2024-04-02T07:27:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.004+0000 7f74c6a00640 1 -- 172.21.15.55:0/3916392988 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c0007660 con 0x7f74d0098f50 2024-04-02T07:27:07.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.004+0000 7f74d5400640 1 -- 172.21.15.55:0/3916392988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d00c8550 con 0x7f74d0098f50 2024-04-02T07:27:07.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.004+0000 7f74c6a00640 1 -- 172.21.15.55:0/3916392988 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c0004a30 con 0x7f74d0098f50 2024-04-02T07:27:07.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.004+0000 7f74d5400640 1 -- 172.21.15.55:0/3916392988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d00c8b10 con 0x7f74d0098f50 2024-04-02T07:27:07.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.004+0000 7f74d5400640 1 -- 172.21.15.55:0/3916392988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d006cf20 con 0x7f74d0098f50 2024-04-02T07:27:07.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.004+0000 7f74c6a00640 1 -- 172.21.15.55:0/3916392988 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f74c0004b90 con 0x7f74d0098f50 2024-04-02T07:27:07.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.004+0000 7f74c6a00640 1 --2- 172.21.15.55:0/3916392988 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f74ac066690 0x7f74ac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:07.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.004+0000 7f74c6a00640 1 -- 172.21.15.55:0/3916392988 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f74c00835b0 con 0x7f74d0098f50 2024-04-02T07:27:07.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.004+0000 7f74c7e00640 1 --2- 172.21.15.55:0/3916392988 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f74ac066690 0x7f74ac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:07.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.004+0000 7f74c7e00640 1 --2- 172.21.15.55:0/3916392988 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f74ac066690 0x7f74ac068b50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f74b80ae000 tx=0x7f74b80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:07.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.008+0000 7f74c6a00640 1 -- 172.21.15.55:0/3916392988 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f74c0050a20 con 0x7f74d0098f50 2024-04-02T07:27:07.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.184+0000 7f74d5400640 1 -- 172.21.15.55:0/3916392988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f74d0066c90 con 0x7f74d0098f50 2024-04-02T07:27:07.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.184+0000 7f74c6a00640 1 -- 172.21.15.55:0/3916392988 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v74) v1 ==== 80+0+0 (secure 0 0 0) 0x7f74c0054040 con 0x7f74d0098f50 2024-04-02T07:27:07.188 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:27:07.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.184+0000 7f74d5400640 1 -- 172.21.15.55:0/3916392988 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f74ac066690 msgr2=0x7f74ac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:07.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.184+0000 7f74d5400640 1 --2- 172.21.15.55:0/3916392988 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f74ac066690 0x7f74ac068b50 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f74b80ae000 tx=0x7f74b80a7000 comp rx=0 tx=0).stop 2024-04-02T07:27:07.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.184+0000 7f74d5400640 1 -- 172.21.15.55:0/3916392988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74d0098f50 msgr2=0x7f74d00c7740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:07.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.184+0000 7f74d5400640 1 --2- 172.21.15.55:0/3916392988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74d0098f50 0x7f74d00c7740 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f74c000c480 tx=0x7f74c000c940 comp rx=0 tx=0).stop 2024-04-02T07:27:07.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.184+0000 7f74d5400640 1 -- 172.21.15.55:0/3916392988 shutdown_connections 2024-04-02T07:27:07.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.184+0000 7f74d5400640 1 --2- 172.21.15.55:0/3916392988 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f74ac066690 0x7f74ac068b50 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:07.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.184+0000 7f74d5400640 1 --2- 172.21.15.55:0/3916392988 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74d015cd50 0x7f74d015f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:07.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.184+0000 7f74d5400640 1 --2- 172.21.15.55:0/3916392988 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74d00cfef0 0x7f74d015ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:07.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.184+0000 7f74d5400640 1 --2- 172.21.15.55:0/3916392988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74d0098f50 0x7f74d00c7740 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:07.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.184+0000 7f74d5400640 1 -- 172.21.15.55:0/3916392988 >> 172.21.15.55:0/3916392988 conn(0x7f74d00b2160 msgr2=0x7f74d006fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:07.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.184+0000 7f74d5400640 1 -- 172.21.15.55:0/3916392988 shutdown_connections 2024-04-02T07:27:07.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:07.184+0000 7f74d5400640 1 -- 172.21.15.55:0/3916392988 wait complete. 2024-04-02T07:27:07.208 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi055.front.sepia.ceph.com... 2024-04-02T07:27:07.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:07.209 DEBUG:teuthology.orchestra.run.smithi055:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-02T07:27:07.227 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[43074]: fuse finished with error 0 and tester_r 0 2024-04-02T07:27:07.230 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:27:13.332 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:27:13.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:13.332 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-02T07:27:13.343 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:27:13.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.536+0000 7fc2d5e00640 1 Processor -- start 2024-04-02T07:27:13.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.536+0000 7fc2d5e00640 1 -- start start 2024-04-02T07:27:13.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.540+0000 7fc2d5e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2d00cfdf0 0x7fc2d006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:13.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.540+0000 7fc2d5e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc2d00b16e0 0x7fc2d00b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:13.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.540+0000 7fc2d5e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d00d01d0 con 0x7fc2d00b11f0 2024-04-02T07:27:13.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.540+0000 7fc2d5e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d006c0e0 con 0x7fc2d00b16e0 2024-04-02T07:27:13.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.540+0000 7fc2d5e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d00b01d0 con 0x7fc2d00cfdf0 2024-04-02T07:27:13.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.540+0000 7fc2c6000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc2d00b16e0 0x7fc2d00b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:13.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.540+0000 7fc2c6000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc2d00b16e0 0x7fc2d00b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42122/0 (socket says 172.21.15.55:42122) 2024-04-02T07:27:13.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.540+0000 7fc2c6000640 1 -- 172.21.15.55:0/2104017685 learned_addr learned my addr 172.21.15.55:0/2104017685 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:13.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.540+0000 7fc2cea00640 1 --2- 172.21.15.55:0/2104017685 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2d00cfdf0 0x7fc2d006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:13.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.540+0000 7fc2c6000640 1 -- 172.21.15.55:0/2104017685 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2d00cfdf0 msgr2=0x7fc2d006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:13.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.540+0000 7fc2c6000640 1 --2- 172.21.15.55:0/2104017685 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2d00cfdf0 0x7fc2d006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:13.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.540+0000 7fc2c6000640 1 -- 172.21.15.55:0/2104017685 >> v1:172.21.15.106:6789/0 conn(0x7fc2d00b11f0 legacy=0x7fc2d0098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:13.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.540+0000 7fc2ce000640 1 -- 172.21.15.55:0/2104017685 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 363816851 0 0) 0x7fc2c8001120 con 0x7fc2d00b11f0 2024-04-02T07:27:13.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.540+0000 7fc2c6000640 1 -- 172.21.15.55:0/2104017685 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d00b04b0 con 0x7fc2d00b16e0 2024-04-02T07:27:13.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2c6000640 1 --2- 172.21.15.55:0/2104017685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2d00b16e0 0x7fc2d00b0cb0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009870 tx=0x7fc2b801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1636696c43ad574d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:13.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2ce000640 1 -- 172.21.15.55:0/2104017685 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b80aa670 con 0x7fc2d00b16e0 2024-04-02T07:27:13.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2ce000640 1 -- 172.21.15.55:0/2104017685 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b80aa7d0 con 0x7fc2d00b16e0 2024-04-02T07:27:13.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2ce000640 1 -- 172.21.15.55:0/2104017685 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b80aab60 con 0x7fc2d00b16e0 2024-04-02T07:27:13.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2d5e00640 1 -- 172.21.15.55:0/2104017685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2d00b16e0 msgr2=0x7fc2d00b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:13.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2d5e00640 1 --2- 172.21.15.55:0/2104017685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2d00b16e0 0x7fc2d00b0cb0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8009870 tx=0x7fc2b801c530 comp rx=0 tx=0).stop 2024-04-02T07:27:13.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2d5e00640 1 -- 172.21.15.55:0/2104017685 shutdown_connections 2024-04-02T07:27:13.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2d5e00640 1 --2- 172.21.15.55:0/2104017685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2d00b16e0 0x7fc2d00b0cb0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:13.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2d5e00640 1 --2- 172.21.15.55:0/2104017685 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2d00cfdf0 0x7fc2d006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:13.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2d5e00640 1 -- 172.21.15.55:0/2104017685 >> 172.21.15.55:0/2104017685 conn(0x7fc2d00b2210 msgr2=0x7fc2d00b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:13.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2d5e00640 1 -- 172.21.15.55:0/2104017685 shutdown_connections 2024-04-02T07:27:13.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2d5e00640 1 -- 172.21.15.55:0/2104017685 wait complete. 2024-04-02T07:27:13.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2d5e00640 1 Processor -- start 2024-04-02T07:27:13.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2d5e00640 1 -- start start 2024-04-02T07:27:13.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2d5e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2d00b11f0 0x7fc2d01f8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:13.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2d5e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2d00b16e0 0x7fc2d00cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:13.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2d5e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2d00cfdf0 0x7fc2d01f5250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:13.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2d5e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d00c9400 con 0x7fc2d00cfdf0 2024-04-02T07:27:13.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2d5e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d01f8590 con 0x7fc2d00b11f0 2024-04-02T07:27:13.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2d5e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d00c87f0 con 0x7fc2d00b16e0 2024-04-02T07:27:13.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2cf400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2d00cfdf0 0x7fc2d01f5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:13.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2cf400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2d00cfdf0 0x7fc2d01f5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42138/0 (socket says 172.21.15.55:42138) 2024-04-02T07:27:13.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.544+0000 7fc2cf400640 1 -- 172.21.15.55:0/954326922 learned_addr learned my addr 172.21.15.55:0/954326922 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:13.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.548+0000 7fc2cea00640 1 --2- 172.21.15.55:0/954326922 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2d00b11f0 0x7fc2d01f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:13.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.548+0000 7fc2c6000640 1 --2- 172.21.15.55:0/954326922 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2d00b16e0 0x7fc2d00cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:13.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.548+0000 7fc2cf400640 1 -- 172.21.15.55:0/954326922 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2d00b16e0 msgr2=0x7fc2d00cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:13.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.548+0000 7fc2cf400640 1 --2- 172.21.15.55:0/954326922 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2d00b16e0 0x7fc2d00cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:13.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.548+0000 7fc2cf400640 1 -- 172.21.15.55:0/954326922 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2d00b11f0 msgr2=0x7fc2d01f8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:13.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.548+0000 7fc2cf400640 1 --2- 172.21.15.55:0/954326922 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2d00b11f0 0x7fc2d01f8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:13.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.548+0000 7fc2cf400640 1 -- 172.21.15.55:0/954326922 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b80094d0 con 0x7fc2d00cfdf0 2024-04-02T07:27:13.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.548+0000 7fc2cf400640 1 --2- 172.21.15.55:0/954326922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2d00cfdf0 0x7fc2d01f5250 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800c410 tx=0x7fc2c800c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:13.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.548+0000 7fc2c7e00640 1 -- 172.21.15.55:0/954326922 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80054e0 con 0x7fc2d00cfdf0 2024-04-02T07:27:13.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.548+0000 7fc2c7e00640 1 -- 172.21.15.55:0/954326922 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2c8003600 con 0x7fc2d00cfdf0 2024-04-02T07:27:13.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.548+0000 7fc2d5e00640 1 -- 172.21.15.55:0/954326922 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d00c8ad0 con 0x7fc2d00cfdf0 2024-04-02T07:27:13.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.548+0000 7fc2c7e00640 1 -- 172.21.15.55:0/954326922 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80039b0 con 0x7fc2d00cfdf0 2024-04-02T07:27:13.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.548+0000 7fc2d5e00640 1 -- 172.21.15.55:0/954326922 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d00c9090 con 0x7fc2d00cfdf0 2024-04-02T07:27:13.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.548+0000 7fc2d5e00640 1 -- 172.21.15.55:0/954326922 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d00c9570 con 0x7fc2d00cfdf0 2024-04-02T07:27:13.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.548+0000 7fc2c7e00640 1 -- 172.21.15.55:0/954326922 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc2c8003b10 con 0x7fc2d00cfdf0 2024-04-02T07:27:13.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.548+0000 7fc2c7e00640 1 --2- 172.21.15.55:0/954326922 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2ac066690 0x7fc2ac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:13.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.548+0000 7fc2c7e00640 1 -- 172.21.15.55:0/954326922 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc2c80835a0 con 0x7fc2d00cfdf0 2024-04-02T07:27:13.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.552+0000 7fc2cea00640 1 --2- 172.21.15.55:0/954326922 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2ac066690 0x7fc2ac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:13.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.552+0000 7fc2cea00640 1 --2- 172.21.15.55:0/954326922 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2ac066690 0x7fc2ac068b50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00cb050 tx=0x7fc2c000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:13.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.556+0000 7fc2c7e00640 1 -- 172.21.15.55:0/954326922 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc2c80508e0 con 0x7fc2d00cfdf0 2024-04-02T07:27:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.752+0000 7fc2d5e00640 1 -- 172.21.15.55:0/954326922 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc2d00d01d0 con 0x7fc2d00cfdf0 2024-04-02T07:27:13.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.752+0000 7fc2c7e00640 1 -- 172.21.15.55:0/954326922 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) v1 ==== 94+0+4739 (secure 0 0 0) 0x7fc2d00d01d0 con 0x7fc2d00cfdf0 2024-04-02T07:27:13.757 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:27:13.757 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":44,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2000687874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2000687874},{"type":"v1","addr":"172.21.15.106:6835","nonce":2000687874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/823234890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":823234890},{"type":"v1","addr":"172.21.15.55:6835","nonce":823234890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6439,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1803758651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1803758651},{"type":"v1","addr":"172.21.15.106:6837","nonce":1803758651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":44,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:26:55.525186+0000","modified":"2024-04-02T07:26:58.541802+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6696},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6696":{"gid":6696,"name":"a","rank":0,"incarnation":40,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6833/1576619269","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1576619269},{"type":"v1","addr":"172.21.15.55:6833","nonce":1576619269}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-02T07:27:13.757 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 44 2024-04-02T07:27:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.752+0000 7fc2d5e00640 1 -- 172.21.15.55:0/954326922 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2ac066690 msgr2=0x7fc2ac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.752+0000 7fc2d5e00640 1 --2- 172.21.15.55:0/954326922 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2ac066690 0x7fc2ac068b50 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00cb050 tx=0x7fc2c000b040 comp rx=0 tx=0).stop 2024-04-02T07:27:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.752+0000 7fc2d5e00640 1 -- 172.21.15.55:0/954326922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2d00cfdf0 msgr2=0x7fc2d01f5250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.752+0000 7fc2d5e00640 1 --2- 172.21.15.55:0/954326922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2d00cfdf0 0x7fc2d01f5250 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800c410 tx=0x7fc2c800c810 comp rx=0 tx=0).stop 2024-04-02T07:27:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.752+0000 7fc2d5e00640 1 -- 172.21.15.55:0/954326922 shutdown_connections 2024-04-02T07:27:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.752+0000 7fc2d5e00640 1 --2- 172.21.15.55:0/954326922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2d00cfdf0 0x7fc2d01f5250 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.752+0000 7fc2d5e00640 1 --2- 172.21.15.55:0/954326922 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2d00b16e0 0x7fc2d00cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.752+0000 7fc2d5e00640 1 --2- 172.21.15.55:0/954326922 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2ac066690 0x7fc2ac068b50 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.752+0000 7fc2d5e00640 1 --2- 172.21.15.55:0/954326922 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2d00b11f0 0x7fc2d01f8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:13.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.752+0000 7fc2d5e00640 1 -- 172.21.15.55:0/954326922 >> 172.21.15.55:0/954326922 conn(0x7fc2d00b2210 msgr2=0x7fc2d00ad3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.752+0000 7fc2d5e00640 1 -- 172.21.15.55:0/954326922 shutdown_connections 2024-04-02T07:27:13.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:13.752+0000 7fc2d5e00640 1 -- 172.21.15.55:0/954326922 wait complete. 2024-04-02T07:27:13.779 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-02T07:27:13.881 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:27:13.885 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:27:13.952 INFO:teuthology.orchestra.run.smithi055.stdout:{"message":"","return_code":0} 2024-04-02T07:27:13.952 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-02T07:27:13.953 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-02T07:27:14.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.136+0000 7feb56c00640 1 Processor -- start 2024-04-02T07:27:14.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.136+0000 7feb56c00640 1 -- start start 2024-04-02T07:27:14.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.136+0000 7feb56c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feb50159350 0x7feb500c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:14.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.136+0000 7feb56c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feb5015d6f0 0x7feb50070310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:14.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.136+0000 7feb56c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb500b3750 con 0x7feb50070850 2024-04-02T07:27:14.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.136+0000 7feb56c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb50070ce0 con 0x7feb5015d6f0 2024-04-02T07:27:14.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.136+0000 7feb56c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb500b28c0 con 0x7feb50159350 2024-04-02T07:27:14.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.136+0000 7feb47e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feb5015d6f0 0x7feb50070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.136+0000 7feb47e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feb5015d6f0 0x7feb50070310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42152/0 (socket says 172.21.15.55:42152) 2024-04-02T07:27:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.136+0000 7feb54c00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feb50070850 0x7feb50159730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39328/0 (socket says 172.21.15.55:39328) 2024-04-02T07:27:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.136+0000 7feb47e00640 1 -- 172.21.15.55:0/3919129260 learned_addr learned my addr 172.21.15.55:0/3919129260 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.136+0000 7feb4fe00640 1 --2- 172.21.15.55:0/3919129260 >> v2:172.21.15.106:3300/0 conn(0x7feb50159350 0x7feb500c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.136+0000 7feb47e00640 1 -- 172.21.15.55:0/3919129260 >> v2:172.21.15.106:3300/0 conn(0x7feb50159350 msgr2=0x7feb500c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.136+0000 7feb47e00640 1 --2- 172.21.15.55:0/3919129260 >> v2:172.21.15.106:3300/0 conn(0x7feb50159350 0x7feb500c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.136+0000 7feb47e00640 1 -- 172.21.15.55:0/3919129260 >> v1:172.21.15.55:6789/0 conn(0x7feb50070850 legacy=0x7feb50159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.136+0000 7feb4f400640 1 -- 172.21.15.55:0/3919129260 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2950943538 0 0) 0x7feb500b3750 con 0x7feb50070850 2024-04-02T07:27:14.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.136+0000 7feb47e00640 1 -- 172.21.15.55:0/3919129260 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb500b2b40 con 0x7feb5015d6f0 2024-04-02T07:27:14.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.140+0000 7feb47e00640 1 --2- 172.21.15.55:0/3919129260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb5015d6f0 0x7feb50070310 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7feb5006abf0 tx=0x7feb3801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d163a03681d410f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:14.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.140+0000 7feb4f400640 1 -- 172.21.15.55:0/3919129260 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb380ad660 con 0x7feb5015d6f0 2024-04-02T07:27:14.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.140+0000 7feb4f400640 1 -- 172.21.15.55:0/3919129260 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb380ad7c0 con 0x7feb5015d6f0 2024-04-02T07:27:14.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.140+0000 7feb4f400640 1 -- 172.21.15.55:0/3919129260 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb380adb50 con 0x7feb5015d6f0 2024-04-02T07:27:14.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.140+0000 7feb56c00640 1 -- 172.21.15.55:0/3919129260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb5015d6f0 msgr2=0x7feb50070310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:14.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.140+0000 7feb56c00640 1 --2- 172.21.15.55:0/3919129260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb5015d6f0 0x7feb50070310 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7feb5006abf0 tx=0x7feb3801c4f0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.140+0000 7feb56c00640 1 -- 172.21.15.55:0/3919129260 shutdown_connections 2024-04-02T07:27:14.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.140+0000 7feb56c00640 1 --2- 172.21.15.55:0/3919129260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb5015d6f0 0x7feb50070310 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.140+0000 7feb56c00640 1 --2- 172.21.15.55:0/3919129260 >> v2:172.21.15.106:3300/0 conn(0x7feb50159350 0x7feb500c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.140+0000 7feb56c00640 1 -- 172.21.15.55:0/3919129260 >> 172.21.15.55:0/3919129260 conn(0x7feb50069d90 msgr2=0x7feb5006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:14.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.140+0000 7feb56c00640 1 -- 172.21.15.55:0/3919129260 shutdown_connections 2024-04-02T07:27:14.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.140+0000 7feb56c00640 1 -- 172.21.15.55:0/3919129260 wait complete. 2024-04-02T07:27:14.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb56c00640 1 Processor -- start 2024-04-02T07:27:14.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb56c00640 1 -- start start 2024-04-02T07:27:14.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb56c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb50070850 0x7feb5014ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:14.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb56c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb50159350 0x7feb500c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:14.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb56c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb5015d6f0 0x7feb5014d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:14.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb56c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5014eb60 con 0x7feb50159350 2024-04-02T07:27:14.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb56c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5014f420 con 0x7feb50070850 2024-04-02T07:27:14.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb56c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb5014f700 con 0x7feb5015d6f0 2024-04-02T07:27:14.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb47e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb50159350 0x7feb500c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:14.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb47e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb50159350 0x7feb500c7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42158/0 (socket says 172.21.15.55:42158) 2024-04-02T07:27:14.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb47e00640 1 -- 172.21.15.55:0/4111622893 learned_addr learned my addr 172.21.15.55:0/4111622893 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:14.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb4fe00640 1 --2- 172.21.15.55:0/4111622893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb50070850 0x7feb5014ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:14.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb54c00640 1 --2- 172.21.15.55:0/4111622893 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb5015d6f0 0x7feb5014d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:14.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb47e00640 1 -- 172.21.15.55:0/4111622893 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb5015d6f0 msgr2=0x7feb5014d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:14.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb47e00640 1 --2- 172.21.15.55:0/4111622893 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb5015d6f0 0x7feb5014d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb47e00640 1 -- 172.21.15.55:0/4111622893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb50070850 msgr2=0x7feb5014ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:14.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb47e00640 1 --2- 172.21.15.55:0/4111622893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb50070850 0x7feb5014ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb47e00640 1 -- 172.21.15.55:0/4111622893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb380094d0 con 0x7feb50159350 2024-04-02T07:27:14.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb4fe00640 1 --2- 172.21.15.55:0/4111622893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb50070850 0x7feb5014ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:14.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb47e00640 1 --2- 172.21.15.55:0/4111622893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb50159350 0x7feb500c7d60 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7feb380b0040 tx=0x7feb38019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:14.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb4cc00640 1 -- 172.21.15.55:0/4111622893 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb380b9650 con 0x7feb50159350 2024-04-02T07:27:14.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb4cc00640 1 -- 172.21.15.55:0/4111622893 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb380b97d0 con 0x7feb50159350 2024-04-02T07:27:14.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb4cc00640 1 -- 172.21.15.55:0/4111622893 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb380b9b80 con 0x7feb50159350 2024-04-02T07:27:14.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb56c00640 1 -- 172.21.15.55:0/4111622893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb5014f9e0 con 0x7feb50159350 2024-04-02T07:27:14.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.144+0000 7feb56c00640 1 -- 172.21.15.55:0/4111622893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5014ffa0 con 0x7feb50159350 2024-04-02T07:27:14.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.148+0000 7feb56c00640 1 -- 172.21.15.55:0/4111622893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5006e270 con 0x7feb50159350 2024-04-02T07:27:14.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.148+0000 7feb4cc00640 1 -- 172.21.15.55:0/4111622893 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7feb380c4460 con 0x7feb50159350 2024-04-02T07:27:14.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.148+0000 7feb4cc00640 1 --2- 172.21.15.55:0/4111622893 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feb2c066690 0x7feb2c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:14.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.148+0000 7feb4cc00640 1 -- 172.21.15.55:0/4111622893 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5767+0+0 (secure 0 0 0) 0x7feb3811efd0 con 0x7feb50159350 2024-04-02T07:27:14.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.148+0000 7feb4fe00640 1 --2- 172.21.15.55:0/4111622893 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feb2c066690 0x7feb2c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:14.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.148+0000 7feb4fe00640 1 --2- 172.21.15.55:0/4111622893 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feb2c066690 0x7feb2c068b50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7feb500cc320 tx=0x7feb40008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:14.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.152+0000 7feb4cc00640 1 -- 172.21.15.55:0/4111622893 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7feb380ec260 con 0x7feb50159350 2024-04-02T07:27:14.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.352+0000 7feb56c00640 1 -- 172.21.15.55:0/4111622893 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7feb50150190 con 0x7feb50159350 2024-04-02T07:27:14.356 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-02T07:27:14.352+0000 7f8f18800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-02T07:27:14.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.368+0000 7feb4cc00640 1 -- 172.21.15.55:0/4111622893 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v45) v1 ==== 161+0+0 (secure 0 0 0) 0x7feb380ef880 con 0x7feb50159350 2024-04-02T07:27:14.374 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-02T07:27:14.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.372+0000 7feb56c00640 1 -- 172.21.15.55:0/4111622893 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feb2c066690 msgr2=0x7feb2c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:14.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.372+0000 7feb56c00640 1 --2- 172.21.15.55:0/4111622893 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feb2c066690 0x7feb2c068b50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7feb500cc320 tx=0x7feb40008040 comp rx=0 tx=0).stop 2024-04-02T07:27:14.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.372+0000 7feb56c00640 1 -- 172.21.15.55:0/4111622893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb50159350 msgr2=0x7feb500c7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:14.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.372+0000 7feb56c00640 1 --2- 172.21.15.55:0/4111622893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb50159350 0x7feb500c7d60 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7feb380b0040 tx=0x7feb38019290 comp rx=0 tx=0).stop 2024-04-02T07:27:14.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.372+0000 7feb56c00640 1 -- 172.21.15.55:0/4111622893 shutdown_connections 2024-04-02T07:27:14.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.372+0000 7feb56c00640 1 --2- 172.21.15.55:0/4111622893 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feb5015d6f0 0x7feb5014d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.372+0000 7feb56c00640 1 --2- 172.21.15.55:0/4111622893 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb50159350 0x7feb500c7d60 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.372+0000 7feb56c00640 1 --2- 172.21.15.55:0/4111622893 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feb2c066690 0x7feb2c068b50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.372+0000 7feb56c00640 1 --2- 172.21.15.55:0/4111622893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feb50070850 0x7feb5014ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.372+0000 7feb56c00640 1 -- 172.21.15.55:0/4111622893 >> 172.21.15.55:0/4111622893 conn(0x7feb50069d90 msgr2=0x7feb501517f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:14.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.372+0000 7feb56c00640 1 -- 172.21.15.55:0/4111622893 shutdown_connections 2024-04-02T07:27:14.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.372+0000 7feb56c00640 1 -- 172.21.15.55:0/4111622893 wait complete. 2024-04-02T07:27:14.382 INFO:tasks.ceph.mds.a.smithi055.stderr: -3366> 2024-04-02T07:27:00.208+0000 7f9e7e400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:27:14.397 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-04-02T07:27:14.432 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-02T07:27:14.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e2ffce080 1 Processor -- start 2024-04-02T07:27:14.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e2ffce080 1 -- start start 2024-04-02T07:27:14.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e2ffce080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x563cbe01a860 0x563cbe000820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:14.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e2ffce080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cbe0a5600 0x563cbe0a75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:14.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e2ffce080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563cbe0a59e0 0x563cbe087300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:14.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e2ffce080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cbdf17960 con 0x563cbe0a5600 2024-04-02T07:27:14.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e2ffce080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cbdf17600 con 0x563cbe0a59e0 2024-04-02T07:27:14.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e2ffce080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x563cbdf0e690 con 0x563cbe01a860 2024-04-02T07:27:14.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e27e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cbe0a5600 0x563cbe0a75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:14.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e27e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cbe0a5600 0x563cbe0a75a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42172/0 (socket says 172.21.15.55:42172) 2024-04-02T07:27:14.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e27e00640 1 -- 172.21.15.55:0/2334455403 learned_addr learned my addr 172.21.15.55:0/2334455403 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:14.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e2d200640 1 --2- 172.21.15.55:0/2334455403 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x563cbe01a860 0x563cbe000820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:14.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e2dc00640 1 --2- 172.21.15.55:0/2334455403 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563cbe0a59e0 0x563cbe087300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:14.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e27e00640 1 -- 172.21.15.55:0/2334455403 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x563cbe01a860 msgr2=0x563cbe000820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:14.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e27e00640 1 --2- 172.21.15.55:0/2334455403 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x563cbe01a860 0x563cbe000820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e27e00640 1 -- 172.21.15.55:0/2334455403 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563cbe0a59e0 msgr2=0x563cbe087300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:14.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e27e00640 1 --2- 172.21.15.55:0/2334455403 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563cbe0a59e0 0x563cbe087300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e27e00640 1 -- 172.21.15.55:0/2334455403 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e18005d30 con 0x563cbe0a5600 2024-04-02T07:27:14.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e2dc00640 1 --2- 172.21.15.55:0/2334455403 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563cbe0a59e0 0x563cbe087300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:27:14.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e2d200640 1 --2- 172.21.15.55:0/2334455403 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x563cbe01a860 0x563cbe000820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:27:14.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e27e00640 1 --2- 172.21.15.55:0/2334455403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cbe0a5600 0x563cbe0a75a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800a500 tx=0x7f0e18003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7bfb17a154f265 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:14.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e26a00640 1 -- 172.21.15.55:0/2334455403 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e180b6070 con 0x563cbe0a5600 2024-04-02T07:27:14.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e26a00640 1 -- 172.21.15.55:0/2334455403 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e180a5590 con 0x563cbe0a5600 2024-04-02T07:27:14.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.440+0000 7f0e26a00640 1 -- 172.21.15.55:0/2334455403 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e180a5b00 con 0x563cbe0a5600 2024-04-02T07:27:14.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2ffce080 1 -- 172.21.15.55:0/2334455403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cbe0a5600 msgr2=0x563cbe0a75a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:14.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2ffce080 1 --2- 172.21.15.55:0/2334455403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cbe0a5600 0x563cbe0a75a0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f0e1800a500 tx=0x7f0e18003030 comp rx=0 tx=0).stop 2024-04-02T07:27:14.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2ffce080 1 -- 172.21.15.55:0/2334455403 shutdown_connections 2024-04-02T07:27:14.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2ffce080 1 --2- 172.21.15.55:0/2334455403 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563cbe0a59e0 0x563cbe087300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2ffce080 1 --2- 172.21.15.55:0/2334455403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cbe0a5600 0x563cbe0a75a0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2ffce080 1 --2- 172.21.15.55:0/2334455403 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x563cbe01a860 0x563cbe000820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2ffce080 1 -- 172.21.15.55:0/2334455403 >> 172.21.15.55:0/2334455403 conn(0x563cbdffc1c0 msgr2=0x563cbe0a5e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:14.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2ffce080 1 -- 172.21.15.55:0/2334455403 shutdown_connections 2024-04-02T07:27:14.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2ffce080 1 -- 172.21.15.55:0/2334455403 wait complete. 2024-04-02T07:27:14.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2ffce080 1 Processor -- start 2024-04-02T07:27:14.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2ffce080 1 -- start start 2024-04-02T07:27:14.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2ffce080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563cbe01a860 0x563cbe0a4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:14.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2ffce080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x563cbe0a5600 0x563cbe08cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:14.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2ffce080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cbe0a59e0 0x563cbe08d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:14.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2ffce080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cbe08ebb0 con 0x563cbe0a59e0 2024-04-02T07:27:14.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2ffce080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cbe08dc90 con 0x563cbe01a860 2024-04-02T07:27:14.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2ffce080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x563cbe08df30 con 0x563cbe0a5600 2024-04-02T07:27:14.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2dc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cbe0a59e0 0x563cbe08d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:14.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2dc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cbe0a59e0 0x563cbe08d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42178/0 (socket says 172.21.15.55:42178) 2024-04-02T07:27:14.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2dc00640 1 -- 172.21.15.55:0/811100109 learned_addr learned my addr 172.21.15.55:0/811100109 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:14.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2d200640 1 --2- 172.21.15.55:0/811100109 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563cbe01a860 0x563cbe0a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:14.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e27e00640 1 --2- 172.21.15.55:0/811100109 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x563cbe0a5600 0x563cbe08cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:14.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2dc00640 1 -- 172.21.15.55:0/811100109 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x563cbe0a5600 msgr2=0x563cbe08cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:14.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2dc00640 1 --2- 172.21.15.55:0/811100109 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x563cbe0a5600 0x563cbe08cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2dc00640 1 -- 172.21.15.55:0/811100109 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563cbe01a860 msgr2=0x563cbe0a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:14.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2dc00640 1 --2- 172.21.15.55:0/811100109 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x563cbe01a860 0x563cbe0a4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2dc00640 1 -- 172.21.15.55:0/811100109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cbdf40a60 con 0x563cbe0a59e0 2024-04-02T07:27:14.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2dc00640 1 --2- 172.21.15.55:0/811100109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cbe0a59e0 0x563cbe08d470 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800e280 tx=0x7f0e2800e740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:14.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e25600640 1 -- 172.21.15.55:0/811100109 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e28013870 con 0x563cbe0a59e0 2024-04-02T07:27:14.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e25600640 1 -- 172.21.15.55:0/811100109 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e280139d0 con 0x563cbe0a59e0 2024-04-02T07:27:14.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e25600640 1 -- 172.21.15.55:0/811100109 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e28013d60 con 0x563cbe0a59e0 2024-04-02T07:27:14.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2ffce080 1 -- 172.21.15.55:0/811100109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x563cbdf268c0 con 0x563cbe0a59e0 2024-04-02T07:27:14.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.444+0000 7f0e2ffce080 1 -- 172.21.15.55:0/811100109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563cbdf19d00 con 0x563cbe0a59e0 2024-04-02T07:27:14.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.448+0000 7f0e25600640 1 -- 172.21.15.55:0/811100109 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f0e28014410 con 0x563cbe0a59e0 2024-04-02T07:27:14.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.448+0000 7f0e25600640 1 --2- 172.21.15.55:0/811100109 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0e0c0650a0 0x7f0e0c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:14.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.448+0000 7f0e25600640 1 -- 172.21.15.55:0/811100109 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f0e28083560 con 0x563cbe0a59e0 2024-04-02T07:27:14.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.448+0000 7f0e2d200640 1 --2- 172.21.15.55:0/811100109 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0e0c0650a0 0x7f0e0c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:14.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.448+0000 7f0e2ffce080 1 --2- 172.21.15.55:0/811100109 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x563cbe018940 0x563cbe018d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:14.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.448+0000 7f0e2ffce080 1 -- 172.21.15.55:0/811100109 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:1 10.10 10:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75) v8 -- 0x563cbe019290 con 0x563cbe018940 2024-04-02T07:27:14.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.448+0000 7f0e27e00640 1 --2- 172.21.15.55:0/811100109 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x563cbe018940 0x563cbe018d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:14.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.448+0000 7f0e2d200640 1 --2- 172.21.15.55:0/811100109 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0e0c0650a0 0x7f0e0c067560 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0e20004180 tx=0x7f0e200015e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:14.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.448+0000 7f0e27e00640 1 --2- 172.21.15.55:0/811100109 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x563cbe018940 0x563cbe018d50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:14.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.456+0000 7f0e27e00640 1 -- 172.21.15.55:0/811100109 <== osd.4 v2:172.21.15.106:6801/27677 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v75'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f0e180a5cf0 con 0x563cbe018940 2024-04-02T07:27:14.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.456+0000 7f0e2ffce080 1 -- 172.21.15.55:0/811100109 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x563cbe018940 msgr2=0x563cbe018d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:14.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.456+0000 7f0e2ffce080 1 --2- 172.21.15.55:0/811100109 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x563cbe018940 0x563cbe018d50 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.456+0000 7f0e2ffce080 1 -- 172.21.15.55:0/811100109 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0e0c0650a0 msgr2=0x7f0e0c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:14.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.456+0000 7f0e2ffce080 1 --2- 172.21.15.55:0/811100109 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0e0c0650a0 0x7f0e0c067560 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f0e20004180 tx=0x7f0e200015e0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.456+0000 7f0e2ffce080 1 -- 172.21.15.55:0/811100109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cbe0a59e0 msgr2=0x563cbe08d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:14.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.456+0000 7f0e2ffce080 1 --2- 172.21.15.55:0/811100109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x563cbe0a59e0 0x563cbe08d470 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f0e2800e280 tx=0x7f0e2800e740 comp rx=0 tx=0).stop 2024-04-02T07:27:14.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.456+0000 7f0e2dc00640 1 -- 172.21.15.55:0/811100109 reap_dead start 2024-04-02T07:27:14.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.456+0000 7f0e2ffce080 1 -- 172.21.15.55:0/811100109 shutdown_connections 2024-04-02T07:27:14.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.456+0000 7f0e2ffce080 1 -- 172.21.15.55:0/811100109 >> 172.21.15.55:0/811100109 conn(0x563cbdffc1c0 msgr2=0x563cbe08ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:14.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.456+0000 7f0e2ffce080 1 -- 172.21.15.55:0/811100109 shutdown_connections 2024-04-02T07:27:14.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.456+0000 7f0e2ffce080 1 -- 172.21.15.55:0/811100109 wait complete. 2024-04-02T07:27:14.464 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-02T07:27:14.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.648+0000 7f3b00400640 1 Processor -- start 2024-04-02T07:27:14.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.648+0000 7f3b00400640 1 -- start start 2024-04-02T07:27:14.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.648+0000 7f3b00400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3af80709b0 0x7f3af80b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:14.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.648+0000 7f3b00400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af815e3a0 con 0x7f3af8144260 2024-04-02T07:27:14.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.648+0000 7f3b00400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3af815e5f0 con 0x7f3af80b2fd0 2024-04-02T07:27:14.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.648+0000 7f3b00400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3af80b37c0 con 0x7f3af80709b0 2024-04-02T07:27:14.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.648+0000 7f3afda00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3af8144260 0x7f3af80702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:39350/0 (socket says 172.21.15.55:39350) 2024-04-02T07:27:14.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.648+0000 7f3afda00640 1 -- 172.21.15.55:0/2760896245 learned_addr learned my addr 172.21.15.55:0/2760896245 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:27:14.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.648+0000 7f3afd000640 1 --2- 172.21.15.55:0/2760896245 >> v2:172.21.15.55:3300/0 conn(0x7f3af80709b0 0x7f3af80b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.648+0000 7f3af7e00640 1 -- 172.21.15.55:0/2760896245 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2827783946 0 0) 0x7f3af815e3a0 con 0x7f3af8144260 2024-04-02T07:27:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.652+0000 7f3af7e00640 1 -- 172.21.15.55:0/2760896245 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ae0003530 con 0x7f3af8144260 2024-04-02T07:27:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.652+0000 7f3afd000640 1 -- 172.21.15.55:0/2760896245 >> v1:172.21.15.106:6789/0 conn(0x7f3af80b2fd0 legacy=0x7f3af80b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.652+0000 7f3afd000640 1 -- 172.21.15.55:0/2760896245 >> v1:172.21.15.55:6789/0 conn(0x7f3af8144260 legacy=0x7f3af80702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:14.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.652+0000 7f3afd000640 1 -- 172.21.15.55:0/2760896245 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af815e8d0 con 0x7f3af80709b0 2024-04-02T07:27:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.652+0000 7f3afd000640 1 --2- 172.21.15.55:0/2760896245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af80709b0 0x7f3af80b2a90 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40097c0 tx=0x7f3ae401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e39fc69c8ee8b7b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.652+0000 7f3af7e00640 1 -- 172.21.15.55:0/2760896245 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40a8050 con 0x7f3af80709b0 2024-04-02T07:27:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.652+0000 7f3af7e00640 1 -- 172.21.15.55:0/2760896245 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae40ac5f0 con 0x7f3af80709b0 2024-04-02T07:27:14.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.652+0000 7f3af7e00640 1 -- 172.21.15.55:0/2760896245 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae40ac960 con 0x7f3af80709b0 2024-04-02T07:27:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.652+0000 7f3b00400640 1 -- 172.21.15.55:0/2760896245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af80709b0 msgr2=0x7f3af80b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.652+0000 7f3b00400640 1 --2- 172.21.15.55:0/2760896245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af80709b0 0x7f3af80b2a90 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f3ae40097c0 tx=0x7f3ae401c4a0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.652+0000 7f3b00400640 1 -- 172.21.15.55:0/2760896245 shutdown_connections 2024-04-02T07:27:14.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.652+0000 7f3b00400640 1 --2- 172.21.15.55:0/2760896245 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af80709b0 0x7f3af80b2a90 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.652+0000 7f3b00400640 1 -- 172.21.15.55:0/2760896245 >> 172.21.15.55:0/2760896245 conn(0x7f3af806a390 msgr2=0x7f3af80b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.652+0000 7f3b00400640 1 -- 172.21.15.55:0/2760896245 shutdown_connections 2024-04-02T07:27:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.652+0000 7f3b00400640 1 -- 172.21.15.55:0/2760896245 wait complete. 2024-04-02T07:27:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3b00400640 1 Processor -- start 2024-04-02T07:27:14.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3b00400640 1 -- start start 2024-04-02T07:27:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3b00400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3af80709b0 0x7f3af80afc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3b00400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3af80b2fd0 0x7f3af8136760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3b00400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af8144260 0x7f3af806c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3b00400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af80ca4e0 con 0x7f3af8144260 2024-04-02T07:27:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3b00400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3af80c8490 con 0x7f3af80709b0 2024-04-02T07:27:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3b00400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3af80c9f20 con 0x7f3af80b2fd0 2024-04-02T07:27:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3afe400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af8144260 0x7f3af806c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3afe400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af8144260 0x7f3af806c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42206/0 (socket says 172.21.15.55:42206) 2024-04-02T07:27:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3afe400640 1 -- 172.21.15.55:0/2516438279 learned_addr learned my addr 172.21.15.55:0/2516438279 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3afd000640 1 --2- 172.21.15.55:0/2516438279 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3af80b2fd0 0x7f3af8136760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3afda00640 1 --2- 172.21.15.55:0/2516438279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3af80709b0 0x7f3af80afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3afe400640 1 -- 172.21.15.55:0/2516438279 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3af80b2fd0 msgr2=0x7f3af8136760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3afe400640 1 --2- 172.21.15.55:0/2516438279 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3af80b2fd0 0x7f3af8136760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3afe400640 1 -- 172.21.15.55:0/2516438279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3af80709b0 msgr2=0x7f3af80afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3afe400640 1 --2- 172.21.15.55:0/2516438279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3af80709b0 0x7f3af80afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3afe400640 1 -- 172.21.15.55:0/2516438279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae4009420 con 0x7f3af8144260 2024-04-02T07:27:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3afe400640 1 --2- 172.21.15.55:0/2516438279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af8144260 0x7f3af806c400 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3af000c770 tx=0x7f3af000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3af5600640 1 -- 172.21.15.55:0/2516438279 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af0003b80 con 0x7f3af8144260 2024-04-02T07:27:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3af5600640 1 -- 172.21.15.55:0/2516438279 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af0003ce0 con 0x7f3af8144260 2024-04-02T07:27:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3af5600640 1 -- 172.21.15.55:0/2516438279 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af000aa90 con 0x7f3af8144260 2024-04-02T07:27:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3b00400640 1 -- 172.21.15.55:0/2516438279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3af80ca200 con 0x7f3af8144260 2024-04-02T07:27:14.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.656+0000 7f3b00400640 1 -- 172.21.15.55:0/2516438279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3af81401c0 con 0x7f3af8144260 2024-04-02T07:27:14.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.660+0000 7f3b00400640 1 -- 172.21.15.55:0/2516438279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3af8073530 con 0x7f3af8144260 2024-04-02T07:27:14.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.660+0000 7f3af5600640 1 -- 172.21.15.55:0/2516438279 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3af000abf0 con 0x7f3af8144260 2024-04-02T07:27:14.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.660+0000 7f3af5600640 1 --2- 172.21.15.55:0/2516438279 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3ad8066690 0x7f3ad8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:14.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.660+0000 7f3af5600640 1 -- 172.21.15.55:0/2516438279 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f3af0083fc0 con 0x7f3af8144260 2024-04-02T07:27:14.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.660+0000 7f3afda00640 1 --2- 172.21.15.55:0/2516438279 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3ad8066690 0x7f3ad8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:14.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.664+0000 7f3afda00640 1 --2- 172.21.15.55:0/2516438279 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3ad8066690 0x7f3ad8068b50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3aec0011f0 tx=0x7f3aec007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:14.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.664+0000 7f3af5600640 1 -- 172.21.15.55:0/2516438279 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3af00512b0 con 0x7f3af8144260 2024-04-02T07:27:14.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:14.864+0000 7f3b00400640 1 -- 172.21.15.55:0/2516438279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f3af813abd0 con 0x7f3af8144260 2024-04-02T07:27:15.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.380+0000 7f3af5600640 1 -- 172.21.15.55:0/2516438279 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v46) v1 ==== 162+0+0 (secure 0 0 0) 0x7f3af00548d0 con 0x7f3af8144260 2024-04-02T07:27:15.387 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-02T07:27:15.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.384+0000 7f3b00400640 1 -- 172.21.15.55:0/2516438279 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3ad8066690 msgr2=0x7f3ad8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:15.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.384+0000 7f3b00400640 1 --2- 172.21.15.55:0/2516438279 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3ad8066690 0x7f3ad8068b50 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3aec0011f0 tx=0x7f3aec007d40 comp rx=0 tx=0).stop 2024-04-02T07:27:15.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.384+0000 7f3b00400640 1 -- 172.21.15.55:0/2516438279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af8144260 msgr2=0x7f3af806c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:15.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.384+0000 7f3b00400640 1 --2- 172.21.15.55:0/2516438279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af8144260 0x7f3af806c400 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f3af000c770 tx=0x7f3af000cc30 comp rx=0 tx=0).stop 2024-04-02T07:27:15.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.384+0000 7f3b00400640 1 -- 172.21.15.55:0/2516438279 shutdown_connections 2024-04-02T07:27:15.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.384+0000 7f3b00400640 1 --2- 172.21.15.55:0/2516438279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3af8144260 0x7f3af806c400 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:15.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.384+0000 7f3b00400640 1 --2- 172.21.15.55:0/2516438279 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3af80b2fd0 0x7f3af8136760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:15.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.384+0000 7f3b00400640 1 --2- 172.21.15.55:0/2516438279 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3ad8066690 0x7f3ad8068b50 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:15.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.384+0000 7f3b00400640 1 --2- 172.21.15.55:0/2516438279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3af80709b0 0x7f3af80afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:15.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.384+0000 7f3b00400640 1 -- 172.21.15.55:0/2516438279 >> 172.21.15.55:0/2516438279 conn(0x7f3af806a390 msgr2=0x7f3af8152b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:15.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.384+0000 7f3b00400640 1 -- 172.21.15.55:0/2516438279 shutdown_connections 2024-04-02T07:27:15.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.384+0000 7f3b00400640 1 -- 172.21.15.55:0/2516438279 wait complete. 2024-04-02T07:27:15.414 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:27:15.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.548+0000 7f6009600640 1 Processor -- start 2024-04-02T07:27:15.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.548+0000 7f6009600640 1 -- start start 2024-04-02T07:27:15.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.556+0000 7f6009600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60040b1430 0x7f60040afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:15.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.556+0000 7f6009600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60040ce2f0 con 0x7f6004099750 2024-04-02T07:27:15.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.556+0000 7f6009600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60040ce5d0 con 0x7f6004098a10 2024-04-02T07:27:15.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.556+0000 7f6009600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60040cbe10 con 0x7f60040b1430 2024-04-02T07:27:15.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.556+0000 7f5ffa000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60040b1430 0x7f60040afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:15.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.556+0000 7f6003400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6004099750 0x7f60040cea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53002/0 (socket says 172.21.15.55:53002) 2024-04-02T07:27:15.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.556+0000 7f6003400640 1 -- 172.21.15.55:0/251315580 learned_addr learned my addr 172.21.15.55:0/251315580 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:27:15.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.556+0000 7f5ffa000640 1 -- 172.21.15.55:0/251315580 >> v1:172.21.15.106:6789/0 conn(0x7f6004098a10 legacy=0x7f6004098df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:15.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.556+0000 7f5ffa000640 1 -- 172.21.15.55:0/251315580 >> v1:172.21.15.55:6789/0 conn(0x7f6004099750 legacy=0x7f60040cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:15.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.556+0000 7f5ffa000640 1 -- 172.21.15.55:0/251315580 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6004099be0 con 0x7f60040b1430 2024-04-02T07:27:15.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.556+0000 7f6002000640 1 -- 172.21.15.55:0/251315580 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84121340 0 0) 0x7f60040ce2f0 con 0x7f6004099750 2024-04-02T07:27:15.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f5ffa000640 1 --2- 172.21.15.55:0/251315580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60040b1430 0x7f60040afe30 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5fec0097c0 tx=0x7f5fec01c370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61e8be4a66d1523 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:15.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6002000640 1 -- 172.21.15.55:0/251315580 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0ab600 con 0x7f60040b1430 2024-04-02T07:27:15.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6002000640 1 -- 172.21.15.55:0/251315580 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fec0a7050 con 0x7f60040b1430 2024-04-02T07:27:15.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6002000640 1 -- 172.21.15.55:0/251315580 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fec0ab980 con 0x7f60040b1430 2024-04-02T07:27:15.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6009600640 1 -- 172.21.15.55:0/251315580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60040b1430 msgr2=0x7f60040afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:15.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6009600640 1 --2- 172.21.15.55:0/251315580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60040b1430 0x7f60040afe30 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f5fec0097c0 tx=0x7f5fec01c370 comp rx=0 tx=0).stop 2024-04-02T07:27:15.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6009600640 1 -- 172.21.15.55:0/251315580 shutdown_connections 2024-04-02T07:27:15.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6009600640 1 --2- 172.21.15.55:0/251315580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60040b1430 0x7f60040afe30 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:15.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6009600640 1 -- 172.21.15.55:0/251315580 >> 172.21.15.55:0/251315580 conn(0x7f60040b2210 msgr2=0x7f60040b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:15.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6009600640 1 -- 172.21.15.55:0/251315580 shutdown_connections 2024-04-02T07:27:15.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6009600640 1 -- 172.21.15.55:0/251315580 wait complete. 2024-04-02T07:27:15.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6009600640 1 Processor -- start 2024-04-02T07:27:15.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6009600640 1 -- start start 2024-04-02T07:27:15.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6009600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6004098a10 0x7f6004146c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:15.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6009600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6004099750 0x7f60040c3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:15.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6009600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60040b1430 0x7f600415d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6009600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60040ca640 con 0x7f6004098a10 2024-04-02T07:27:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6009600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60040c7ba0 con 0x7f60040b1430 2024-04-02T07:27:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6009600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60040ca360 con 0x7f6004099750 2024-04-02T07:27:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6002a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6004098a10 0x7f6004146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6002a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6004098a10 0x7f6004146c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37610/0 (socket says 172.21.15.55:37610) 2024-04-02T07:27:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6002a00640 1 -- 172.21.15.55:0/472569115 learned_addr learned my addr 172.21.15.55:0/472569115 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6003400640 1 --2- 172.21.15.55:0/472569115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60040b1430 0x7f600415d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f5ffa000640 1 --2- 172.21.15.55:0/472569115 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6004099750 0x7f60040c3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6002a00640 1 -- 172.21.15.55:0/472569115 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6004099750 msgr2=0x7f60040c3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6002a00640 1 --2- 172.21.15.55:0/472569115 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6004099750 0x7f60040c3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6002a00640 1 -- 172.21.15.55:0/472569115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60040b1430 msgr2=0x7f600415d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6002a00640 1 --2- 172.21.15.55:0/472569115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60040b1430 0x7f600415d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6002a00640 1 -- 172.21.15.55:0/472569115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fec009420 con 0x7f6004098a10 2024-04-02T07:27:15.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f5ffa000640 1 --2- 172.21.15.55:0/472569115 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6004099750 0x7f60040c3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:15.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6002a00640 1 --2- 172.21.15.55:0/472569115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6004098a10 0x7f6004146c70 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400ba50 tx=0x7f5ff400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:15.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f5ffb400640 1 -- 172.21.15.55:0/472569115 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff400cc10 con 0x7f6004098a10 2024-04-02T07:27:15.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f5ffb400640 1 -- 172.21.15.55:0/472569115 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ff400cd70 con 0x7f6004098a10 2024-04-02T07:27:15.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f5ffb400640 1 -- 172.21.15.55:0/472569115 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4014680 con 0x7f6004098a10 2024-04-02T07:27:15.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6009600640 1 -- 172.21.15.55:0/472569115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600415ec10 con 0x7f6004098a10 2024-04-02T07:27:15.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6009600640 1 -- 172.21.15.55:0/472569115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600415de80 con 0x7f6004098a10 2024-04-02T07:27:15.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f6009600640 1 -- 172.21.15.55:0/472569115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f600415b060 con 0x7f6004098a10 2024-04-02T07:27:15.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f5ffb400640 1 -- 172.21.15.55:0/472569115 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5ff4007370 con 0x7f6004098a10 2024-04-02T07:27:15.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f5ffb400640 1 --2- 172.21.15.55:0/472569115 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5fe00666c0 0x7f5fe0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:15.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.560+0000 7f5ffb400640 1 -- 172.21.15.55:0/472569115 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f5ff4083ce0 con 0x7f6004098a10 2024-04-02T07:27:15.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.564+0000 7f5ffa000640 1 --2- 172.21.15.55:0/472569115 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5fe00666c0 0x7f5fe0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:15.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.564+0000 7f5ffa000640 1 --2- 172.21.15.55:0/472569115 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5fe00666c0 0x7f5fe0068b80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5fec0ad000 tx=0x7f5fec0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:15.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.564+0000 7f5ffb400640 1 -- 172.21.15.55:0/472569115 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5ff4051060 con 0x7f6004098a10 2024-04-02T07:27:15.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.759+0000 7f6009600640 1 -- 172.21.15.55:0/472569115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6004066c90 con 0x7f6004098a10 2024-04-02T07:27:15.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.759+0000 7f5ffb400640 1 -- 172.21.15.55:0/472569115 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f5ff4054680 con 0x7f6004098a10 2024-04-02T07:27:15.765 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:27:15.765 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":47,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2000687874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2000687874},{"type":"v1","addr":"172.21.15.106:6835","nonce":2000687874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/823234890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":823234890},{"type":"v1","addr":"172.21.15.55:6835","nonce":823234890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6439,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1803758651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1803758651},{"type":"v1","addr":"172.21.15.106:6837","nonce":1803758651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":47,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:26:55.525186+0000","modified":"2024-04-02T07:27:15.387111+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"a","rank":0,"incarnation":47,"state":"up:replay","state_seq":1,"addr":"172.21.15.55:6833/1965896660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1965896660},{"type":"v1","addr":"172.21.15.55:6833","nonce":1965896660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-02T07:27:15.765 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 47 2024-04-02T07:27:15.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.759+0000 7f6009600640 1 -- 172.21.15.55:0/472569115 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5fe00666c0 msgr2=0x7f5fe0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:15.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.759+0000 7f6009600640 1 --2- 172.21.15.55:0/472569115 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5fe00666c0 0x7f5fe0068b80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f5fec0ad000 tx=0x7f5fec0a6000 comp rx=0 tx=0).stop 2024-04-02T07:27:15.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.759+0000 7f6009600640 1 -- 172.21.15.55:0/472569115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6004098a10 msgr2=0x7f6004146c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:15.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.759+0000 7f6009600640 1 --2- 172.21.15.55:0/472569115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6004098a10 0x7f6004146c70 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f5ff400ba50 tx=0x7f5ff400bf10 comp rx=0 tx=0).stop 2024-04-02T07:27:15.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.759+0000 7f6009600640 1 -- 172.21.15.55:0/472569115 shutdown_connections 2024-04-02T07:27:15.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.759+0000 7f6009600640 1 --2- 172.21.15.55:0/472569115 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5fe00666c0 0x7f5fe0068b80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:15.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.759+0000 7f6009600640 1 --2- 172.21.15.55:0/472569115 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60040b1430 0x7f600415d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:15.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.759+0000 7f6009600640 1 --2- 172.21.15.55:0/472569115 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6004099750 0x7f60040c3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:15.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.759+0000 7f6009600640 1 --2- 172.21.15.55:0/472569115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6004098a10 0x7f6004146c70 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:15.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.759+0000 7f6009600640 1 -- 172.21.15.55:0/472569115 >> 172.21.15.55:0/472569115 conn(0x7f60040b2210 msgr2=0x7f60040ada00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:15.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.759+0000 7f6009600640 1 -- 172.21.15.55:0/472569115 shutdown_connections 2024-04-02T07:27:15.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:15.759+0000 7f6009600640 1 -- 172.21.15.55:0/472569115 wait complete. 2024-04-02T07:27:16.188 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 47, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:26:55.525186+0000', 'modified': '2024-04-02T07:27:15.387111+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 75, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6936}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6936': {'gid': 6936, 'name': 'a', 'rank': 0, 'incarnation': 47, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.55:6833/1965896660', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 1965896660}, {'type': 'v1', 'addr': '172.21.15.55:6833', 'nonce': 1965896660}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:27:16.189 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6936:up:replay 2024-04-02T07:27:17.190 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:27:17.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.339+0000 7f098f600640 1 Processor -- start 2024-04-02T07:27:17.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.339+0000 7f098f600640 1 -- start start 2024-04-02T07:27:17.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.343+0000 7f098f600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f098815a480 0x7f09880ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:17.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.343+0000 7f098f600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f09880ca9a0 0x7f09880b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:17.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.343+0000 7f098f600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f098815a860 con 0x7f09880b0ea0 2024-04-02T07:27:17.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.343+0000 7f098f600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f098815ce20 con 0x7f098815a480 2024-04-02T07:27:17.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.343+0000 7f098f600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09880cade0 con 0x7f09880ca9a0 2024-04-02T07:27:17.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.343+0000 7f098cc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f098815a480 0x7f09880ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:17.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.343+0000 7f098cc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f098815a480 0x7f09880ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37624/0 (socket says 172.21.15.55:37624) 2024-04-02T07:27:17.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.343+0000 7f098cc00640 1 -- 172.21.15.55:0/53567606 learned_addr learned my addr 172.21.15.55:0/53567606 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:17.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.343+0000 7f097fe00640 1 --2- 172.21.15.55:0/53567606 >> v2:172.21.15.106:3300/0 conn(0x7f09880ca9a0 0x7f09880b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:17.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.343+0000 7f098cc00640 1 -- 172.21.15.55:0/53567606 >> v2:172.21.15.106:3300/0 conn(0x7f09880ca9a0 msgr2=0x7f09880b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:17.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.343+0000 7f098cc00640 1 --2- 172.21.15.55:0/53567606 >> v2:172.21.15.106:3300/0 conn(0x7f09880ca9a0 0x7f09880b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:17.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.343+0000 7f098cc00640 1 -- 172.21.15.55:0/53567606 >> v1:172.21.15.106:6789/0 conn(0x7f09880b0ea0 legacy=0x7f0988160460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:17.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.343+0000 7f098cc00640 1 -- 172.21.15.55:0/53567606 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09880cb570 con 0x7f098815a480 2024-04-02T07:27:17.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.343+0000 7f097fe00640 1 --2- 172.21.15.55:0/53567606 >> v2:172.21.15.106:3300/0 conn(0x7f09880ca9a0 0x7f09880b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:27:17.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.347+0000 7f098cc00640 1 --2- 172.21.15.55:0/53567606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f098815a480 0x7f09880ca460 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f098806d470 tx=0x7f097801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=256666f7364ad20f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:17.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.347+0000 7f0987e00640 1 -- 172.21.15.55:0/53567606 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09780ab600 con 0x7f098815a480 2024-04-02T07:27:17.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.347+0000 7f0987e00640 1 -- 172.21.15.55:0/53567606 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09780a7050 con 0x7f098815a480 2024-04-02T07:27:17.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.347+0000 7f0987e00640 1 -- 172.21.15.55:0/53567606 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09780ab980 con 0x7f098815a480 2024-04-02T07:27:17.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.347+0000 7f098f600640 1 -- 172.21.15.55:0/53567606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f098815a480 msgr2=0x7f09880ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:17.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.347+0000 7f098f600640 1 --2- 172.21.15.55:0/53567606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f098815a480 0x7f09880ca460 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f098806d470 tx=0x7f097801c450 comp rx=0 tx=0).stop 2024-04-02T07:27:17.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.347+0000 7f098f600640 1 -- 172.21.15.55:0/53567606 shutdown_connections 2024-04-02T07:27:17.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.347+0000 7f098f600640 1 --2- 172.21.15.55:0/53567606 >> v2:172.21.15.106:3300/0 conn(0x7f09880ca9a0 0x7f09880b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:17.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.347+0000 7f098f600640 1 --2- 172.21.15.55:0/53567606 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f098815a480 0x7f09880ca460 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:17.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.347+0000 7f098f600640 1 -- 172.21.15.55:0/53567606 >> 172.21.15.55:0/53567606 conn(0x7f0988066080 msgr2=0x7f0988069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:17.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.347+0000 7f098f600640 1 -- 172.21.15.55:0/53567606 shutdown_connections 2024-04-02T07:27:17.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.347+0000 7f098f600640 1 -- 172.21.15.55:0/53567606 wait complete. 2024-04-02T07:27:17.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.347+0000 7f098f600640 1 Processor -- start 2024-04-02T07:27:17.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.347+0000 7f098f600640 1 -- start start 2024-04-02T07:27:17.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.347+0000 7f098f600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09880b0ea0 0x7f09880b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:17.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f098f600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09880ca9a0 0x7f098815f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:17.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f098f600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f098815a480 0x7f0988145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:17.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f098f600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0988147120 con 0x7f09880ca9a0 2024-04-02T07:27:17.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f098f600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098815b8f0 con 0x7f098815a480 2024-04-02T07:27:17.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f098f600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f098815bbd0 con 0x7f09880b0ea0 2024-04-02T07:27:17.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f097fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09880ca9a0 0x7f098815f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:17.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f097fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09880ca9a0 0x7f098815f1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37634/0 (socket says 172.21.15.55:37634) 2024-04-02T07:27:17.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f097fe00640 1 -- 172.21.15.55:0/1363208402 learned_addr learned my addr 172.21.15.55:0/1363208402 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:17.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f098cc00640 1 --2- 172.21.15.55:0/1363208402 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09880b0ea0 0x7f09880b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:17.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f098d600640 1 --2- 172.21.15.55:0/1363208402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f098815a480 0x7f0988145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:17.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f097fe00640 1 -- 172.21.15.55:0/1363208402 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09880b0ea0 msgr2=0x7f09880b1ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:17.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f097fe00640 1 --2- 172.21.15.55:0/1363208402 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09880b0ea0 0x7f09880b1ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:17.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f097fe00640 1 -- 172.21.15.55:0/1363208402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f098815a480 msgr2=0x7f0988145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:17.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f097fe00640 1 --2- 172.21.15.55:0/1363208402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f098815a480 0x7f0988145fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:17.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f097fe00640 1 -- 172.21.15.55:0/1363208402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09780094d0 con 0x7f09880ca9a0 2024-04-02T07:27:17.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f098cc00640 1 --2- 172.21.15.55:0/1363208402 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09880b0ea0 0x7f09880b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:17.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f097fe00640 1 --2- 172.21.15.55:0/1363208402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09880ca9a0 0x7f098815f1c0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f097000c7c0 tx=0x7f097000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:17.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f0985600640 1 -- 172.21.15.55:0/1363208402 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0970007a30 con 0x7f09880ca9a0 2024-04-02T07:27:17.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f0985600640 1 -- 172.21.15.55:0/1363208402 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0970007b90 con 0x7f09880ca9a0 2024-04-02T07:27:17.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f0985600640 1 -- 172.21.15.55:0/1363208402 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097000ce70 con 0x7f09880ca9a0 2024-04-02T07:27:17.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f098f600640 1 -- 172.21.15.55:0/1363208402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098815beb0 con 0x7f09880ca9a0 2024-04-02T07:27:17.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f098f600640 1 -- 172.21.15.55:0/1363208402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09880b23e0 con 0x7f09880ca9a0 2024-04-02T07:27:17.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f098f600640 1 -- 172.21.15.55:0/1363208402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0988146f80 con 0x7f09880ca9a0 2024-04-02T07:27:17.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.351+0000 7f0985600640 1 -- 172.21.15.55:0/1363208402 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f09700113f0 con 0x7f09880ca9a0 2024-04-02T07:27:17.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.355+0000 7f0985600640 1 --2- 172.21.15.55:0/1363208402 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0964066690 0x7f0964068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:17.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.355+0000 7f0985600640 1 -- 172.21.15.55:0/1363208402 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f09700846d0 con 0x7f09880ca9a0 2024-04-02T07:27:17.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.355+0000 7f098cc00640 1 --2- 172.21.15.55:0/1363208402 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0964066690 0x7f0964068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:17.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.355+0000 7f098cc00640 1 --2- 172.21.15.55:0/1363208402 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0964066690 0x7f0964068b50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f09780ad000 tx=0x7f0978008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:17.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.359+0000 7f0985600640 1 -- 172.21.15.55:0/1363208402 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0988146f80 con 0x7f09880ca9a0 2024-04-02T07:27:17.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.555+0000 7f098f600640 1 -- 172.21.15.55:0/1363208402 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0988147320 con 0x7f09880ca9a0 2024-04-02T07:27:17.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.555+0000 7f0985600640 1 -- 172.21.15.55:0/1363208402 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f0988147320 con 0x7f09880ca9a0 2024-04-02T07:27:17.557 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:27:17.558 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":49,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2000687874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2000687874},{"type":"v1","addr":"172.21.15.106:6835","nonce":2000687874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/823234890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":823234890},{"type":"v1","addr":"172.21.15.55:6835","nonce":823234890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6439,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1803758651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1803758651},{"type":"v1","addr":"172.21.15.106:6837","nonce":1803758651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:26:55.525186+0000","modified":"2024-04-02T07:27:17.394324+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"a","rank":0,"incarnation":47,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.55:6833/1965896660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1965896660},{"type":"v1","addr":"172.21.15.55:6833","nonce":1965896660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-02T07:27:17.558 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 49 2024-04-02T07:27:17.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.555+0000 7f098f600640 1 -- 172.21.15.55:0/1363208402 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0964066690 msgr2=0x7f0964068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:17.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.555+0000 7f098f600640 1 --2- 172.21.15.55:0/1363208402 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0964066690 0x7f0964068b50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f09780ad000 tx=0x7f0978008040 comp rx=0 tx=0).stop 2024-04-02T07:27:17.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.555+0000 7f098f600640 1 -- 172.21.15.55:0/1363208402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09880ca9a0 msgr2=0x7f098815f1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:17.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.555+0000 7f098f600640 1 --2- 172.21.15.55:0/1363208402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09880ca9a0 0x7f098815f1c0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f097000c7c0 tx=0x7f097000cc80 comp rx=0 tx=0).stop 2024-04-02T07:27:17.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.555+0000 7f098f600640 1 -- 172.21.15.55:0/1363208402 shutdown_connections 2024-04-02T07:27:17.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.555+0000 7f098f600640 1 --2- 172.21.15.55:0/1363208402 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0964066690 0x7f0964068b50 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:17.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.555+0000 7f098f600640 1 --2- 172.21.15.55:0/1363208402 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f098815a480 0x7f0988145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:17.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.555+0000 7f098f600640 1 --2- 172.21.15.55:0/1363208402 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09880ca9a0 0x7f098815f1c0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:17.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.555+0000 7f098f600640 1 --2- 172.21.15.55:0/1363208402 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09880b0ea0 0x7f09880b1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:17.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.555+0000 7f098f600640 1 -- 172.21.15.55:0/1363208402 >> 172.21.15.55:0/1363208402 conn(0x7f0988066080 msgr2=0x7f0988153770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:17.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.555+0000 7f098f600640 1 -- 172.21.15.55:0/1363208402 shutdown_connections 2024-04-02T07:27:17.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:17.555+0000 7f098f600640 1 -- 172.21.15.55:0/1363208402 wait complete. 2024-04-02T07:27:17.982 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:26:55.525186+0000', 'modified': '2024-04-02T07:27:17.394324+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 75, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6936}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6936': {'gid': 6936, 'name': 'a', 'rank': 0, 'incarnation': 47, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.55:6833/1965896660', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 1965896660}, {'type': 'v1', 'addr': '172.21.15.55:6833', 'nonce': 1965896660}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:27:17.982 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_6936:up:rejoin 2024-04-02T07:27:18.984 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:27:19.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.135+0000 7ff864800640 1 Processor -- start 2024-04-02T07:27:19.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.135+0000 7ff864800640 1 -- start start 2024-04-02T07:27:19.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.135+0000 7ff864800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff85c0b1dc0 0x7ff85c159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.135+0000 7ff864800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85c0b2e80 con 0x7ff85c0b21a0 2024-04-02T07:27:19.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.135+0000 7ff864800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff85c15a4e0 con 0x7ff85c0ce720 2024-04-02T07:27:19.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.135+0000 7ff864800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c15a7c0 con 0x7ff85c0b1dc0 2024-04-02T07:27:19.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.135+0000 7ff861400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff85c0b21a0 0x7ff85c0b3640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53016/0 (socket says 172.21.15.55:53016) 2024-04-02T07:27:19.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.135+0000 7ff861400640 1 -- 172.21.15.55:0/3552381432 learned_addr learned my addr 172.21.15.55:0/3552381432 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:27:19.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.135+0000 7ff861e00640 1 --2- 172.21.15.55:0/3552381432 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff85c0b1dc0 0x7ff85c159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.135+0000 7ff860a00640 1 -- 172.21.15.55:0/3552381432 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 501594698 0 0) 0x7ff85c0b2e80 con 0x7ff85c0b21a0 2024-04-02T07:27:19.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.135+0000 7ff860a00640 1 -- 172.21.15.55:0/3552381432 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff844005740 con 0x7ff85c0b21a0 2024-04-02T07:27:19.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.135+0000 7ff860a00640 1 -- 172.21.15.55:0/3552381432 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3792420064 0 0) 0x7ff85c15a4e0 con 0x7ff85c0ce720 2024-04-02T07:27:19.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.135+0000 7ff860a00640 1 -- 172.21.15.55:0/3552381432 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff85c0b2e80 con 0x7ff85c0ce720 2024-04-02T07:27:19.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.135+0000 7ff861e00640 1 -- 172.21.15.55:0/3552381432 >> v1:172.21.15.106:6789/0 conn(0x7ff85c0ce720 legacy=0x7ff85c14fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:19.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.135+0000 7ff861e00640 1 -- 172.21.15.55:0/3552381432 >> v1:172.21.15.55:6789/0 conn(0x7ff85c0b21a0 legacy=0x7ff85c0b3640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:19.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.135+0000 7ff861e00640 1 -- 172.21.15.55:0/3552381432 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85c15aaa0 con 0x7ff85c0b1dc0 2024-04-02T07:27:19.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.139+0000 7ff861e00640 1 --2- 172.21.15.55:0/3552381432 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff85c0b1dc0 0x7ff85c159c20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff8500097f0 tx=0x7ff85001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7188e6eddff769f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:19.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.139+0000 7ff860a00640 1 -- 172.21.15.55:0/3552381432 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8500ab600 con 0x7ff85c0b1dc0 2024-04-02T07:27:19.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.139+0000 7ff860a00640 1 -- 172.21.15.55:0/3552381432 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8500a7050 con 0x7ff85c0b1dc0 2024-04-02T07:27:19.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.139+0000 7ff860a00640 1 -- 172.21.15.55:0/3552381432 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8500ab960 con 0x7ff85c0b1dc0 2024-04-02T07:27:19.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.139+0000 7ff864800640 1 -- 172.21.15.55:0/3552381432 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff85c0b1dc0 msgr2=0x7ff85c159c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:19.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.139+0000 7ff864800640 1 --2- 172.21.15.55:0/3552381432 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff85c0b1dc0 0x7ff85c159c20 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff8500097f0 tx=0x7ff85001c420 comp rx=0 tx=0).stop 2024-04-02T07:27:19.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.139+0000 7ff864800640 1 -- 172.21.15.55:0/3552381432 shutdown_connections 2024-04-02T07:27:19.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.139+0000 7ff864800640 1 --2- 172.21.15.55:0/3552381432 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff85c0b1dc0 0x7ff85c159c20 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.139+0000 7ff864800640 1 -- 172.21.15.55:0/3552381432 >> 172.21.15.55:0/3552381432 conn(0x7ff85c0cec70 msgr2=0x7ff85c0cf080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:19.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.139+0000 7ff864800640 1 -- 172.21.15.55:0/3552381432 shutdown_connections 2024-04-02T07:27:19.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.139+0000 7ff864800640 1 -- 172.21.15.55:0/3552381432 wait complete. 2024-04-02T07:27:19.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff864800640 1 Processor -- start 2024-04-02T07:27:19.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff864800640 1 -- start start 2024-04-02T07:27:19.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff864800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff85c0b1dc0 0x7ff85c141c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff864800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff85c0b21a0 0x7ff85c14e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff864800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff85c0ce720 0x7ff85c14a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff864800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c14e110 con 0x7ff85c0b21a0 2024-04-02T07:27:19.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff864800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c14d500 con 0x7ff85c0ce720 2024-04-02T07:27:19.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff864800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c14d7e0 con 0x7ff85c0b1dc0 2024-04-02T07:27:19.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff861400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff85c0b21a0 0x7ff85c14e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff861400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff85c0b21a0 0x7ff85c14e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37650/0 (socket says 172.21.15.55:37650) 2024-04-02T07:27:19.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff861400640 1 -- 172.21.15.55:0/422573817 learned_addr learned my addr 172.21.15.55:0/422573817 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:19.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff861e00640 1 --2- 172.21.15.55:0/422573817 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff85c0b1dc0 0x7ff85c141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff862800640 1 --2- 172.21.15.55:0/422573817 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff85c0ce720 0x7ff85c14a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff861400640 1 -- 172.21.15.55:0/422573817 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff85c0b1dc0 msgr2=0x7ff85c141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff861400640 1 --2- 172.21.15.55:0/422573817 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff85c0b1dc0 0x7ff85c141c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff861400640 1 -- 172.21.15.55:0/422573817 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff85c0ce720 msgr2=0x7ff85c14a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff861400640 1 --2- 172.21.15.55:0/422573817 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff85c0ce720 0x7ff85c14a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff861400640 1 -- 172.21.15.55:0/422573817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff850009420 con 0x7ff85c0b21a0 2024-04-02T07:27:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff861e00640 1 --2- 172.21.15.55:0/422573817 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff85c0b1dc0 0x7ff85c141c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff861400640 1 --2- 172.21.15.55:0/422573817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff85c0b21a0 0x7ff85c14e5a0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00c410 tx=0x7ff84c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff856000640 1 -- 172.21.15.55:0/422573817 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c005cf0 con 0x7ff85c0b21a0 2024-04-02T07:27:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff856000640 1 -- 172.21.15.55:0/422573817 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff84c005e50 con 0x7ff85c0b21a0 2024-04-02T07:27:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff856000640 1 -- 172.21.15.55:0/422573817 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff84c0072d0 con 0x7ff85c0b21a0 2024-04-02T07:27:19.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff864800640 1 -- 172.21.15.55:0/422573817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff85c14dac0 con 0x7ff85c0b21a0 2024-04-02T07:27:19.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.143+0000 7ff864800640 1 -- 172.21.15.55:0/422573817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff85c1428f0 con 0x7ff85c0b21a0 2024-04-02T07:27:19.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.147+0000 7ff864800640 1 -- 172.21.15.55:0/422573817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff85c142ae0 con 0x7ff85c0b21a0 2024-04-02T07:27:19.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.147+0000 7ff856000640 1 -- 172.21.15.55:0/422573817 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff84c007430 con 0x7ff85c0b21a0 2024-04-02T07:27:19.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.147+0000 7ff856000640 1 --2- 172.21.15.55:0/422573817 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff840066690 0x7ff840068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.147+0000 7ff856000640 1 -- 172.21.15.55:0/422573817 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7ff84c0837e0 con 0x7ff85c0b21a0 2024-04-02T07:27:19.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.147+0000 7ff861e00640 1 --2- 172.21.15.55:0/422573817 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff840066690 0x7ff840068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.151+0000 7ff861e00640 1 --2- 172.21.15.55:0/422573817 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff840066690 0x7ff840068b50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff8500ad000 tx=0x7ff850008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:19.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.151+0000 7ff856000640 1 -- 172.21.15.55:0/422573817 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff85c142ae0 con 0x7ff85c0b21a0 2024-04-02T07:27:19.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.351+0000 7ff864800640 1 -- 172.21.15.55:0/422573817 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff85c142ae0 con 0x7ff85c0b21a0 2024-04-02T07:27:19.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.351+0000 7ff856000640 1 -- 172.21.15.55:0/422573817 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4740 (secure 0 0 0) 0x7ff85c142ae0 con 0x7ff85c0b21a0 2024-04-02T07:27:19.354 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:27:19.355 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":50,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2000687874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2000687874},{"type":"v1","addr":"172.21.15.106:6835","nonce":2000687874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/823234890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":823234890},{"type":"v1","addr":"172.21.15.55:6835","nonce":823234890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6439,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1803758651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1803758651},{"type":"v1","addr":"172.21.15.106:6837","nonce":1803758651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":50,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:26:55.525186+0000","modified":"2024-04-02T07:27:18.403575+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6833/1965896660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1965896660},{"type":"v1","addr":"172.21.15.55:6833","nonce":1965896660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-02T07:27:19.355 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 50 2024-04-02T07:27:19.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.355+0000 7ff864800640 1 -- 172.21.15.55:0/422573817 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff840066690 msgr2=0x7ff840068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:19.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.355+0000 7ff864800640 1 --2- 172.21.15.55:0/422573817 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff840066690 0x7ff840068b50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff8500ad000 tx=0x7ff850008040 comp rx=0 tx=0).stop 2024-04-02T07:27:19.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.355+0000 7ff864800640 1 -- 172.21.15.55:0/422573817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff85c0b21a0 msgr2=0x7ff85c14e5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:19.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.355+0000 7ff864800640 1 --2- 172.21.15.55:0/422573817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff85c0b21a0 0x7ff85c14e5a0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7ff84c00c410 tx=0x7ff84c00c8d0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.355+0000 7ff864800640 1 -- 172.21.15.55:0/422573817 shutdown_connections 2024-04-02T07:27:19.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.355+0000 7ff864800640 1 --2- 172.21.15.55:0/422573817 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff840066690 0x7ff840068b50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.355+0000 7ff864800640 1 --2- 172.21.15.55:0/422573817 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff85c0ce720 0x7ff85c14a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.355+0000 7ff864800640 1 --2- 172.21.15.55:0/422573817 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff85c0b21a0 0x7ff85c14e5a0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.355+0000 7ff864800640 1 --2- 172.21.15.55:0/422573817 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff85c0b1dc0 0x7ff85c141c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.355+0000 7ff864800640 1 -- 172.21.15.55:0/422573817 >> 172.21.15.55:0/422573817 conn(0x7ff85c0cec70 msgr2=0x7ff85c0cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:19.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.355+0000 7ff864800640 1 -- 172.21.15.55:0/422573817 shutdown_connections 2024-04-02T07:27:19.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.355+0000 7ff864800640 1 -- 172.21.15.55:0/422573817 wait complete. 2024-04-02T07:27:19.777 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 50, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:26:55.525186+0000', 'modified': '2024-04-02T07:27:18.403575+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 75, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6936}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6936': {'gid': 6936, 'name': 'a', 'rank': 0, 'incarnation': 47, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.55:6833/1965896660', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 1965896660}, {'type': 'v1', 'addr': '172.21.15.55:6833', 'nonce': 1965896660}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:27:19.777 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-02T07:27:19.777 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-02T07:27:19.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.919+0000 7fa70b600640 1 Processor -- start 2024-04-02T07:27:19.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.919+0000 7fa70b600640 1 -- start start 2024-04-02T07:27:19.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.919+0000 7fa70b600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa7041599c0 0x7fa7040b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.919+0000 7fa70b600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa70406d1c0 0x7fa7040b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.919+0000 7fa70b600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7040afe70 0x7fa7040b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.919+0000 7fa70b600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa70406cda0 con 0x7fa70406d1c0 2024-04-02T07:27:19.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.919+0000 7fa70b600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7040b3c60 con 0x7fa7041599c0 2024-04-02T07:27:19.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.919+0000 7fa70b600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7040b1d60 con 0x7fa7040afe70 2024-04-02T07:27:19.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.919+0000 7fa703e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa70406d1c0 0x7fa7040b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.919+0000 7fa703e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa70406d1c0 0x7fa7040b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37660/0 (socket says 172.21.15.55:37660) 2024-04-02T07:27:19.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.919+0000 7fa703e00640 1 -- 172.21.15.55:0/2271322892 learned_addr learned my addr 172.21.15.55:0/2271322892 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:19.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.923+0000 7fa708c00640 1 --2- 172.21.15.55:0/2271322892 >> v2:172.21.15.106:3300/0 conn(0x7fa7041599c0 0x7fa7040b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.923+0000 7fa709600640 1 --2- 172.21.15.55:0/2271322892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7040afe70 0x7fa7040b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.923+0000 7fa703e00640 1 -- 172.21.15.55:0/2271322892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7040afe70 msgr2=0x7fa7040b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:19.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.923+0000 7fa703e00640 1 --2- 172.21.15.55:0/2271322892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7040afe70 0x7fa7040b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.923+0000 7fa703e00640 1 -- 172.21.15.55:0/2271322892 >> v2:172.21.15.106:3300/0 conn(0x7fa7041599c0 msgr2=0x7fa7040b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:19.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.923+0000 7fa703e00640 1 --2- 172.21.15.55:0/2271322892 >> v2:172.21.15.106:3300/0 conn(0x7fa7041599c0 0x7fa7040b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.923+0000 7fa703e00640 1 -- 172.21.15.55:0/2271322892 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa70406c400 con 0x7fa70406d1c0 2024-04-02T07:27:19.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.923+0000 7fa703e00640 1 --2- 172.21.15.55:0/2271322892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa70406d1c0 0x7fa7040b31e0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fa7040b1520 tx=0x7fa6f001ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce5d374dda424ab7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:19.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.923+0000 7fa703400640 1 -- 172.21.15.55:0/2271322892 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f00a7b90 con 0x7fa70406d1c0 2024-04-02T07:27:19.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.923+0000 7fa703400640 1 -- 172.21.15.55:0/2271322892 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f00a7cf0 con 0x7fa70406d1c0 2024-04-02T07:27:19.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.923+0000 7fa703400640 1 -- 172.21.15.55:0/2271322892 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f00af660 con 0x7fa70406d1c0 2024-04-02T07:27:19.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa70b600640 1 -- 172.21.15.55:0/2271322892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa70406d1c0 msgr2=0x7fa7040b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:19.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa70b600640 1 --2- 172.21.15.55:0/2271322892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa70406d1c0 0x7fa7040b31e0 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7fa7040b1520 tx=0x7fa6f001ebf0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa70b600640 1 -- 172.21.15.55:0/2271322892 shutdown_connections 2024-04-02T07:27:19.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa70b600640 1 --2- 172.21.15.55:0/2271322892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7040afe70 0x7fa7040b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa70b600640 1 --2- 172.21.15.55:0/2271322892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa70406d1c0 0x7fa7040b31e0 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa70b600640 1 --2- 172.21.15.55:0/2271322892 >> v2:172.21.15.106:3300/0 conn(0x7fa7041599c0 0x7fa7040b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa70b600640 1 -- 172.21.15.55:0/2271322892 >> 172.21.15.55:0/2271322892 conn(0x7fa704069d90 msgr2=0x7fa70406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:19.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa70b600640 1 -- 172.21.15.55:0/2271322892 shutdown_connections 2024-04-02T07:27:19.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa70b600640 1 -- 172.21.15.55:0/2271322892 wait complete. 2024-04-02T07:27:19.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa70b600640 1 Processor -- start 2024-04-02T07:27:19.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa70b600640 1 -- start start 2024-04-02T07:27:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa70b600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa70406d1c0 0x7fa70414fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa70b600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7040afe70 0x7fa7041f4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa70b600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7041599c0 0x7fa70415c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa70b600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa704151b70 con 0x7fa7040afe70 2024-04-02T07:27:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa70b600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7041f50e0 con 0x7fa70406d1c0 2024-04-02T07:27:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa70b600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa70415ce10 con 0x7fa7041599c0 2024-04-02T07:27:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa703e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7040afe70 0x7fa7041f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa703e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7040afe70 0x7fa7041f4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37664/0 (socket says 172.21.15.55:37664) 2024-04-02T07:27:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa703e00640 1 -- 172.21.15.55:0/2233683962 learned_addr learned my addr 172.21.15.55:0/2233683962 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa708c00640 1 --2- 172.21.15.55:0/2233683962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa70406d1c0 0x7fa70414fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa709600640 1 --2- 172.21.15.55:0/2233683962 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7041599c0 0x7fa70415c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa703e00640 1 -- 172.21.15.55:0/2233683962 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7041599c0 msgr2=0x7fa70415c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:19.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa703e00640 1 --2- 172.21.15.55:0/2233683962 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7041599c0 0x7fa70415c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa703e00640 1 -- 172.21.15.55:0/2233683962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa70406d1c0 msgr2=0x7fa70414fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:19.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa703e00640 1 --2- 172.21.15.55:0/2233683962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa70406d1c0 0x7fa70414fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.927+0000 7fa703e00640 1 -- 172.21.15.55:0/2233683962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f000b770 con 0x7fa7040afe70 2024-04-02T07:27:19.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.931+0000 7fa703e00640 1 --2- 172.21.15.55:0/2233683962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7040afe70 0x7fa7041f4ba0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fa6f001d2a0 tx=0x7fa6f001b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:19.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.931+0000 7fa700c00640 1 -- 172.21.15.55:0/2233683962 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f00afd60 con 0x7fa7040afe70 2024-04-02T07:27:19.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.931+0000 7fa700c00640 1 -- 172.21.15.55:0/2233683962 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f00ba410 con 0x7fa7040afe70 2024-04-02T07:27:19.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.931+0000 7fa700c00640 1 -- 172.21.15.55:0/2233683962 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f00ba7c0 con 0x7fa7040afe70 2024-04-02T07:27:19.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.931+0000 7fa70b600640 1 -- 172.21.15.55:0/2233683962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa70413f640 con 0x7fa7040afe70 2024-04-02T07:27:19.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.931+0000 7fa70b600640 1 -- 172.21.15.55:0/2233683962 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa704151800 con 0x7fa7040afe70 2024-04-02T07:27:19.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.931+0000 7fa700c00640 1 -- 172.21.15.55:0/2233683962 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa6f00c3450 con 0x7fa7040afe70 2024-04-02T07:27:19.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa700c00640 1 --2- 172.21.15.55:0/2233683962 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa6e40666c0 0x7fa6e4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa700c00640 1 -- 172.21.15.55:0/2233683962 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fa6f011e730 con 0x7fa7040afe70 2024-04-02T07:27:19.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa70e9cb000 1 Processor -- start 2024-04-02T07:27:19.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa708c00640 1 --2- 172.21.15.55:0/2233683962 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa6e40666c0 0x7fa6e4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa70e9cb000 1 -- start start 2024-04-02T07:27:19.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa708c00640 1 --2- 172.21.15.55:0/2233683962 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa6e40666c0 0x7fa6e4068b80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009ac0 tx=0x7fa6f8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:19.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa70e9cb000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578920f2db0 0x5578920f3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa70e9cb000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578920f36d0 0x5578920a8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa70e9cb000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920a94c0 0x5578920a98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa70e9cb000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557891f715a0 con 0x5578920a94c0 2024-04-02T07:27:19.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa70e9cb000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557891efeaf0 con 0x5578920f36d0 2024-04-02T07:27:19.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa70e9cb000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x557891efc0c0 con 0x5578920f2db0 2024-04-02T07:27:19.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa709600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920a94c0 0x5578920a98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa708c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578920f2db0 0x5578920f3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa703e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578920f36d0 0x5578920a8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa709600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920a94c0 0x5578920a98a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37676/0 (socket says 172.21.15.55:37676) 2024-04-02T07:27:19.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa709600640 1 -- 172.21.15.55:0/1631574125 learned_addr learned my addr 172.21.15.55:0/1631574125 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:19.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa709600640 1 -- 172.21.15.55:0/1631574125 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578920f2db0 msgr2=0x5578920f3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:19.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa709600640 1 --2- 172.21.15.55:0/1631574125 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578920f2db0 0x5578920f3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa709600640 1 -- 172.21.15.55:0/1631574125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578920f36d0 msgr2=0x5578920a8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:19.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa709600640 1 --2- 172.21.15.55:0/1631574125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578920f36d0 0x5578920a8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa709600640 1 -- 172.21.15.55:0/1631574125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557891bf3890 con 0x5578920a94c0 2024-04-02T07:27:19.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa709600640 1 --2- 172.21.15.55:0/1631574125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920a94c0 0x5578920a98a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc011420 tx=0x7fa6fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567ed449674c5911 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:19.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa6f5600640 1 -- 172.21.15.55:0/1631574125 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc010040 con 0x5578920a94c0 2024-04-02T07:27:19.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa6f5600640 1 -- 172.21.15.55:0/1631574125 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6fc016860 con 0x5578920a94c0 2024-04-02T07:27:19.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa6f5600640 1 -- 172.21.15.55:0/1631574125 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc016bd0 con 0x5578920a94c0 2024-04-02T07:27:19.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa70e9cb000 1 -- 172.21.15.55:0/1631574125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920a94c0 msgr2=0x5578920a98a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:19.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa70e9cb000 1 --2- 172.21.15.55:0/1631574125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920a94c0 0x5578920a98a0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc011420 tx=0x7fa6fc00b040 comp rx=0 tx=0).stop 2024-04-02T07:27:19.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa70e9cb000 1 -- 172.21.15.55:0/1631574125 shutdown_connections 2024-04-02T07:27:19.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa70e9cb000 1 --2- 172.21.15.55:0/1631574125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920a94c0 0x5578920a98a0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa70e9cb000 1 --2- 172.21.15.55:0/1631574125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578920f36d0 0x5578920a8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa70e9cb000 1 --2- 172.21.15.55:0/1631574125 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578920f2db0 0x5578920f3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa70e9cb000 1 -- 172.21.15.55:0/1631574125 >> 172.21.15.55:0/1631574125 conn(0x5578920af830 msgr2=0x5578920a7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:19.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa70e9cb000 1 -- 172.21.15.55:0/1631574125 shutdown_connections 2024-04-02T07:27:19.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.935+0000 7fa70e9cb000 1 -- 172.21.15.55:0/1631574125 wait complete. 2024-04-02T07:27:19.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa70e9cb000 1 -- start start 2024-04-02T07:27:19.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa70e9cb000 1 Processor -- start 2024-04-02T07:27:19.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa70e9cb000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578920a94c0 0x5578920ad230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa70e9cb000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920f2db0 0x5578920ad770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa70e9cb000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578920f36d0 0x5578920adcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa70e9cb000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557891ef79b0 con 0x5578920f2db0 2024-04-02T07:27:19.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa70e9cb000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557891e96c00 con 0x5578920a94c0 2024-04-02T07:27:19.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa70e9cb000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x557891eb5070 con 0x5578920f36d0 2024-04-02T07:27:19.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa70e9cb000 10 client.0 _ll_register_callbacks cb 0x5578920950e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:27:19.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa703e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920f2db0 0x5578920ad770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa703e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920f2db0 0x5578920ad770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37692/0 (socket says 172.21.15.55:37692) 2024-04-02T07:27:19.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa703e00640 1 -- 172.21.15.55:0/4068394403 learned_addr learned my addr 172.21.15.55:0/4068394403 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:19.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa708c00640 1 --2- 172.21.15.55:0/4068394403 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578920a94c0 0x5578920ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa709600640 1 --2- 172.21.15.55:0/4068394403 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578920f36d0 0x5578920adcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa703e00640 1 -- 172.21.15.55:0/4068394403 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578920f36d0 msgr2=0x5578920adcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:19.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa703e00640 1 --2- 172.21.15.55:0/4068394403 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578920f36d0 0x5578920adcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa703e00640 1 -- 172.21.15.55:0/4068394403 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578920a94c0 msgr2=0x5578920ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:19.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa703e00640 1 --2- 172.21.15.55:0/4068394403 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578920a94c0 0x5578920ad230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa703e00640 1 -- 172.21.15.55:0/4068394403 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6fc0111b0 con 0x5578920f2db0 2024-04-02T07:27:19.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa703e00640 1 --2- 172.21.15.55:0/4068394403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920f2db0 0x5578920ad770 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00251c0 tx=0x7fa6f011cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16c54326866275a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:19.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa6ea000640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:27:19.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa6ea000640 1 -- 172.21.15.55:0/4068394403 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f00f3610 con 0x5578920f2db0 2024-04-02T07:27:19.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa6ea000640 1 -- 172.21.15.55:0/4068394403 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fa6f00f7bd0 con 0x5578920f2db0 2024-04-02T07:27:19.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa70e9cb000 1 -- 172.21.15.55:0/4068394403 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557891eb45f0 con 0x5578920f2db0 2024-04-02T07:27:19.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa6ea000640 1 -- 172.21.15.55:0/4068394403 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6f00eed80 con 0x5578920f2db0 2024-04-02T07:27:19.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa70e9cb000 10 client.6987 fetch_fsmap learned FSMap version 50 2024-04-02T07:27:19.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa70e9cb000 1 -- 172.21.15.55:0/4068394403 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x557891ebcab0 con 0x5578920f2db0 2024-04-02T07:27:19.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa6ea000640 1 -- 172.21.15.55:0/4068394403 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557891eb45f0 con 0x5578920f2db0 2024-04-02T07:27:19.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa6ea000640 1 -- 172.21.15.55:0/4068394403 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 50) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fa6f00b6070 con 0x5578920f2db0 2024-04-02T07:27:19.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa70e9cb000 10 client.6987 fetch_fsmap finished waiting for FSMap version 50 2024-04-02T07:27:19.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa70e9cb000 10 client.6987 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:27:19.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa70e9cb000 20 client.6987 populate_metadata read hostname 'smithi055' 2024-04-02T07:27:19.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa70e9cb000 1 --2- 172.21.15.55:0/4068394403 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x5578920ae6c0 0x557892103e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa70e9cb000 4 client.6987 mds_command: new command op to 6936 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:27:19.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa70e9cb000 1 -- 172.21.15.55:0/4068394403 --> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557891ef4790 con 0x5578920ae6c0 2024-04-02T07:27:19.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa708c00640 1 --2- 172.21.15.55:0/4068394403 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x5578920ae6c0 0x557892103e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa6ea000640 10 client.6987 ms_handle_connect on v2:172.21.15.55:6832/1965896660 2024-04-02T07:27:19.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.939+0000 7fa708c00640 1 --2- 172.21.15.55:0/4068394403 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x5578920ae6c0 0x557892103e50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47f7e52027e8ebab server_cookie=3a38bcdadd0b6753 in_seq=0 out_seq=0 2024-04-02T07:27:19.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.943+0000 7fa6ea000640 1 -- 172.21.15.55:0/4068394403 <== mds.0 v2:172.21.15.55:6832/1965896660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x557891ef4790 con 0x5578920ae6c0 2024-04-02T07:27:19.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.943+0000 7fa6ea000640 10 client.6987 handle_command_reply: tid=0 2024-04-02T07:27:19.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.943+0000 7fa70e9cb000 1 client.6987 shutdown 2024-04-02T07:27:19.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.943+0000 7fa70e9cb000 1 -- 172.21.15.55:0/4068394403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920f2db0 msgr2=0x5578920ad770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:19.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.943+0000 7fa70e9cb000 1 --2- 172.21.15.55:0/4068394403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920f2db0 0x5578920ad770 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00251c0 tx=0x7fa6f011cf90 comp rx=0 tx=0).stop 2024-04-02T07:27:19.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.943+0000 7fa70e9cb000 1 -- 172.21.15.55:0/4068394403 shutdown_connections 2024-04-02T07:27:19.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.943+0000 7fa70e9cb000 1 --2- 172.21.15.55:0/4068394403 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x5578920ae6c0 0x557892103e50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.943+0000 7fa70e9cb000 1 --2- 172.21.15.55:0/4068394403 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578920f36d0 0x5578920adcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.943+0000 7fa70e9cb000 1 --2- 172.21.15.55:0/4068394403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920f2db0 0x5578920ad770 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.943+0000 7fa70e9cb000 1 --2- 172.21.15.55:0/4068394403 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578920a94c0 0x5578920ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.943+0000 7fa70e9cb000 1 -- 172.21.15.55:0/4068394403 >> 172.21.15.55:0/4068394403 conn(0x5578920af830 msgr2=0x5578920a7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:19.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.943+0000 7fa6ea000640 0 client.6987 ms_handle_reset on v2:172.21.15.55:6832/1965896660 2024-04-02T07:27:19.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.943+0000 7fa70e9cb000 1 -- 172.21.15.55:0/4068394403 shutdown_connections 2024-04-02T07:27:19.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.943+0000 7fa70e9cb000 1 -- 172.21.15.55:0/4068394403 wait complete. 2024-04-02T07:27:19.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.943+0000 7fa70e9cb000 20 client.6987 trim_cache size 0 max 16384 2024-04-02T07:27:19.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa70e9cb000 1 Processor -- start 2024-04-02T07:27:19.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa70e9cb000 1 -- start start 2024-04-02T07:27:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa70e9cb000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920a94c0 0x55789214cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa70e9cb000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578920f2db0 0x55789214d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa70e9cb000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578920f36d0 0x55789214d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa70e9cb000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557891bb4940 con 0x5578920a94c0 2024-04-02T07:27:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa70e9cb000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557891ef71c0 con 0x5578920f2db0 2024-04-02T07:27:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa70e9cb000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x557891ec3b60 con 0x5578920f36d0 2024-04-02T07:27:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa708c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920a94c0 0x55789214cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa708c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920a94c0 0x55789214cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37694/0 (socket says 172.21.15.55:37694) 2024-04-02T07:27:19.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa708c00640 1 -- 172.21.15.55:0/3019464231 learned_addr learned my addr 172.21.15.55:0/3019464231 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:19.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa708c00640 1 -- 172.21.15.55:0/3019464231 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578920f36d0 msgr2=0x55789214d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:19.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa708c00640 1 --2- 172.21.15.55:0/3019464231 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578920f36d0 0x55789214d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa708c00640 1 -- 172.21.15.55:0/3019464231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578920f2db0 msgr2=0x55789214d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:19.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa708c00640 1 --2- 172.21.15.55:0/3019464231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578920f2db0 0x55789214d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa708c00640 1 -- 172.21.15.55:0/3019464231 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557891ea2c00 con 0x5578920a94c0 2024-04-02T07:27:19.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa708c00640 1 --2- 172.21.15.55:0/3019464231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920a94c0 0x55789214cc30 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8011690 tx=0x7fa6f8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39580b4f213db19a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:19.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa6f6000640 1 -- 172.21.15.55:0/3019464231 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f801c040 con 0x5578920a94c0 2024-04-02T07:27:19.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa6f6000640 1 -- 172.21.15.55:0/3019464231 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6f802c460 con 0x5578920a94c0 2024-04-02T07:27:19.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa6f6000640 1 -- 172.21.15.55:0/3019464231 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6f802c5d0 con 0x5578920a94c0 2024-04-02T07:27:19.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa70e9cb000 1 -- 172.21.15.55:0/3019464231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920a94c0 msgr2=0x55789214cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:19.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa70e9cb000 1 --2- 172.21.15.55:0/3019464231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920a94c0 0x55789214cc30 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8011690 tx=0x7fa6f8018000 comp rx=0 tx=0).stop 2024-04-02T07:27:19.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa70e9cb000 1 -- 172.21.15.55:0/3019464231 shutdown_connections 2024-04-02T07:27:19.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa70e9cb000 1 --2- 172.21.15.55:0/3019464231 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578920f36d0 0x55789214d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa70e9cb000 1 --2- 172.21.15.55:0/3019464231 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578920f2db0 0x55789214d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa70e9cb000 1 --2- 172.21.15.55:0/3019464231 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920a94c0 0x55789214cc30 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa70e9cb000 1 -- 172.21.15.55:0/3019464231 >> 172.21.15.55:0/3019464231 conn(0x5578920af830 msgr2=0x5578920f1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:19.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa70e9cb000 1 -- 172.21.15.55:0/3019464231 shutdown_connections 2024-04-02T07:27:19.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa70e9cb000 1 -- 172.21.15.55:0/3019464231 wait complete. 2024-04-02T07:27:19.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.959+0000 7fa70e9cb000 1 -- start start 2024-04-02T07:27:19.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 1 Processor -- start 2024-04-02T07:27:19.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578920a94c0 0x55789214d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578920f2db0 0x5578920eff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920f36d0 0x5578920f0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x557891ec2820 con 0x5578920f36d0 2024-04-02T07:27:19.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x557891ec5420 con 0x5578920a94c0 2024-04-02T07:27:19.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x557892078530 con 0x5578920f2db0 2024-04-02T07:27:19.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 10 client.0 _ll_register_callbacks cb 0x557891ebc590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:27:19.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa709600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920f36d0 0x5578920f0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa709600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920f36d0 0x5578920f0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37704/0 (socket says 172.21.15.55:37704) 2024-04-02T07:27:19.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa709600640 1 -- 172.21.15.55:0/1608885072 learned_addr learned my addr 172.21.15.55:0/1608885072 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:19.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa708c00640 1 --2- 172.21.15.55:0/1608885072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578920a94c0 0x55789214d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa703e00640 1 --2- 172.21.15.55:0/1608885072 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578920f2db0 0x5578920eff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa709600640 1 -- 172.21.15.55:0/1608885072 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578920f2db0 msgr2=0x5578920eff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:19.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa709600640 1 --2- 172.21.15.55:0/1608885072 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578920f2db0 0x5578920eff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa709600640 1 -- 172.21.15.55:0/1608885072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578920a94c0 msgr2=0x55789214d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:19.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa709600640 1 --2- 172.21.15.55:0/1608885072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578920a94c0 0x55789214d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa709600640 1 -- 172.21.15.55:0/1608885072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f8004250 con 0x5578920f36d0 2024-04-02T07:27:19.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa708c00640 1 --2- 172.21.15.55:0/1608885072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578920a94c0 0x55789214d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:19.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa709600640 1 --2- 172.21.15.55:0/1608885072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920f36d0 0x5578920f0470 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc019000 tx=0x7fa6fc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc83b2fb62ac445a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:19.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa6ea000640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:27:19.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa6ea000640 1 -- 172.21.15.55:0/1608885072 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6fc010040 con 0x5578920f36d0 2024-04-02T07:27:19.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa6ea000640 1 -- 172.21.15.55:0/1608885072 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fa6fc009d60 con 0x5578920f36d0 2024-04-02T07:27:19.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 1 -- 172.21.15.55:0/1608885072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557891ec7460 con 0x5578920f36d0 2024-04-02T07:27:19.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa6ea000640 1 -- 172.21.15.55:0/1608885072 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa6fc007000 con 0x5578920f36d0 2024-04-02T07:27:19.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 10 client.6993 fetch_fsmap learned FSMap version 50 2024-04-02T07:27:19.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 1 -- 172.21.15.55:0/1608885072 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=2+}) v3 -- 0x557891bf3cc0 con 0x5578920f36d0 2024-04-02T07:27:19.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa6ea000640 1 -- 172.21.15.55:0/1608885072 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557891ec7460 con 0x5578920f36d0 2024-04-02T07:27:19.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa6ea000640 1 -- 172.21.15.55:0/1608885072 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 50) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fa6fc004050 con 0x5578920f36d0 2024-04-02T07:27:19.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 10 client.6993 fetch_fsmap finished waiting for FSMap version 50 2024-04-02T07:27:19.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 10 client.6993 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:27:19.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 20 client.6993 populate_metadata read hostname 'smithi055' 2024-04-02T07:27:19.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 1 --2- 172.21.15.55:0/1608885072 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x5578920f09b0 0x5578920f0d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:19.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 4 client.6993 mds_command: new command op to 6936 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-02T07:27:19.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 1 -- 172.21.15.55:0/1608885072 --> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557891ec09c0 con 0x5578920f09b0 2024-04-02T07:27:19.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa708c00640 1 --2- 172.21.15.55:0/1608885072 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x5578920f09b0 0x5578920f0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:19.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa6ea000640 10 client.6993 ms_handle_connect on v2:172.21.15.55:6832/1965896660 2024-04-02T07:27:19.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa708c00640 1 --2- 172.21.15.55:0/1608885072 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x5578920f09b0 0x5578920f0d90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9c1d648e2b217d5 server_cookie=663dffdb47dab76c in_seq=0 out_seq=0 2024-04-02T07:27:19.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa6ea000640 1 -- 172.21.15.55:0/1608885072 <== mds.0 v2:172.21.15.55:6832/1965896660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x557891ec09c0 con 0x5578920f09b0 2024-04-02T07:27:19.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa6ea000640 10 client.6993 handle_command_reply: tid=0 2024-04-02T07:27:19.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 1 client.6993 shutdown 2024-04-02T07:27:19.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 1 -- 172.21.15.55:0/1608885072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920f36d0 msgr2=0x5578920f0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:19.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 1 --2- 172.21.15.55:0/1608885072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920f36d0 0x5578920f0470 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fa6fc019000 tx=0x7fa6fc009750 comp rx=0 tx=0).stop 2024-04-02T07:27:19.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 1 -- 172.21.15.55:0/1608885072 shutdown_connections 2024-04-02T07:27:19.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 1 --2- 172.21.15.55:0/1608885072 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x5578920f09b0 0x5578920f0d90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 1 --2- 172.21.15.55:0/1608885072 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5578920f36d0 0x5578920f0470 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 1 --2- 172.21.15.55:0/1608885072 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5578920f2db0 0x5578920eff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa6ea000640 0 client.6993 ms_handle_reset on v2:172.21.15.55:6832/1965896660 2024-04-02T07:27:19.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.963+0000 7fa70e9cb000 1 --2- 172.21.15.55:0/1608885072 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5578920a94c0 0x55789214d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.967+0000 7fa70e9cb000 1 -- 172.21.15.55:0/1608885072 >> 172.21.15.55:0/1608885072 conn(0x5578920af830 msgr2=0x5578920ac7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:19.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.967+0000 7fa70e9cb000 1 -- 172.21.15.55:0/1608885072 shutdown_connections 2024-04-02T07:27:19.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.967+0000 7fa70e9cb000 1 -- 172.21.15.55:0/1608885072 wait complete. 2024-04-02T07:27:19.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.967+0000 7fa70e9cb000 20 client.6993 trim_cache size 0 max 16384 2024-04-02T07:27:19.972 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:27:19.972 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "642a0456-a2ac-49a4-91a5-3b3449b512da", 2024-04-02T07:27:19.972 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-02T07:27:19.972 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 6936, 2024-04-02T07:27:19.973 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-02T07:27:19.973 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-02T07:27:19.973 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-02T07:27:19.973 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 4.5746222100000002, 2024-04-02T07:27:19.973 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 50, 2024-04-02T07:27:19.973 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 75, 2024-04-02T07:27:19.973 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 75, 2024-04-02T07:27:19.973 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 5.5321970389999997 2024-04-02T07:27:19.973 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:27:19.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.967+0000 7fa70b600640 1 -- 172.21.15.55:0/2233683962 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa6e40666c0 msgr2=0x7fa6e4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:19.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.967+0000 7fa70b600640 1 --2- 172.21.15.55:0/2233683962 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa6e40666c0 0x7fa6e4068b80 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009ac0 tx=0x7fa6f8009190 comp rx=0 tx=0).stop 2024-04-02T07:27:19.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.967+0000 7fa70b600640 1 -- 172.21.15.55:0/2233683962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7040afe70 msgr2=0x7fa7041f4ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:19.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.967+0000 7fa70b600640 1 --2- 172.21.15.55:0/2233683962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7040afe70 0x7fa7041f4ba0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fa6f001d2a0 tx=0x7fa6f001b990 comp rx=0 tx=0).stop 2024-04-02T07:27:19.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.967+0000 7fa70b600640 1 -- 172.21.15.55:0/2233683962 shutdown_connections 2024-04-02T07:27:19.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.967+0000 7fa70b600640 1 --2- 172.21.15.55:0/2233683962 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa7041599c0 0x7fa70415c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.967+0000 7fa70b600640 1 --2- 172.21.15.55:0/2233683962 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa7040afe70 0x7fa7041f4ba0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.967+0000 7fa70b600640 1 --2- 172.21.15.55:0/2233683962 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa6e40666c0 0x7fa6e4068b80 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.967+0000 7fa70b600640 1 --2- 172.21.15.55:0/2233683962 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa70406d1c0 0x7fa70414fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:19.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.967+0000 7fa70b600640 1 -- 172.21.15.55:0/2233683962 >> 172.21.15.55:0/2233683962 conn(0x7fa704069d90 msgr2=0x7fa70406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:19.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.967+0000 7fa70b600640 1 -- 172.21.15.55:0/2233683962 shutdown_connections 2024-04-02T07:27:19.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:19.967+0000 7fa70b600640 1 -- 172.21.15.55:0/2233683962 wait complete. 2024-04-02T07:27:19.987 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-02T07:27:20.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.127+0000 7f0052000640 1 Processor -- start 2024-04-02T07:27:20.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.127+0000 7f0052000640 1 -- start start 2024-04-02T07:27:20.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.127+0000 7f0052000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f004c15cad0 0x7f004c0b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:20.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.127+0000 7f0052000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f004c06ec10 0x7f004c069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:20.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.127+0000 7f0052000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f004c0b26b0 con 0x7f004c06a2d0 2024-04-02T07:27:20.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.127+0000 7f0052000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f004c06a740 con 0x7f004c15cad0 2024-04-02T07:27:20.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.127+0000 7f0052000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f004c15ceb0 con 0x7f004c06ec10 2024-04-02T07:27:20.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.127+0000 7f004b400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f004c15cad0 0x7f004c0b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:20.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.127+0000 7f004b400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f004c15cad0 0x7f004c0b43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37710/0 (socket says 172.21.15.55:37710) 2024-04-02T07:27:20.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.127+0000 7f004b400640 1 -- 172.21.15.55:0/3925082803 learned_addr learned my addr 172.21.15.55:0/3925082803 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:20.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.127+0000 7f0042a00640 1 --2- 172.21.15.55:0/3925082803 >> v2:172.21.15.106:3300/0 conn(0x7f004c06ec10 0x7f004c069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:20.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.127+0000 7f004b400640 1 -- 172.21.15.55:0/3925082803 >> v2:172.21.15.106:3300/0 conn(0x7f004c06ec10 msgr2=0x7f004c069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:20.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.127+0000 7f004b400640 1 --2- 172.21.15.55:0/3925082803 >> v2:172.21.15.106:3300/0 conn(0x7f004c06ec10 0x7f004c069d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:20.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.127+0000 7f004b400640 1 -- 172.21.15.55:0/3925082803 >> v1:172.21.15.106:6789/0 conn(0x7f004c06a2d0 legacy=0x7f004c160640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:20.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.127+0000 7f004b400640 1 -- 172.21.15.55:0/3925082803 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f004c0cd640 con 0x7f004c15cad0 2024-04-02T07:27:20.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.131+0000 7f004b400640 1 --2- 172.21.15.55:0/3925082803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f004c15cad0 0x7f004c0b43d0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f004c0b4020 tx=0x7f003c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934f091c86849a62 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:20.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.131+0000 7f004aa00640 1 -- 172.21.15.55:0/3925082803 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c0ab600 con 0x7f004c15cad0 2024-04-02T07:27:20.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.131+0000 7f004aa00640 1 -- 172.21.15.55:0/3925082803 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003c0a7050 con 0x7f004c15cad0 2024-04-02T07:27:20.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.131+0000 7f004aa00640 1 -- 172.21.15.55:0/3925082803 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003c0ab980 con 0x7f004c15cad0 2024-04-02T07:27:20.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.131+0000 7f0052000640 1 -- 172.21.15.55:0/3925082803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f004c15cad0 msgr2=0x7f004c0b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:20.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.131+0000 7f0052000640 1 --2- 172.21.15.55:0/3925082803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f004c15cad0 0x7f004c0b43d0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f004c0b4020 tx=0x7f003c01c3d0 comp rx=0 tx=0).stop 2024-04-02T07:27:20.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.131+0000 7f0052000640 1 -- 172.21.15.55:0/3925082803 shutdown_connections 2024-04-02T07:27:20.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.131+0000 7f0052000640 1 --2- 172.21.15.55:0/3925082803 >> v2:172.21.15.106:3300/0 conn(0x7f004c06ec10 0x7f004c069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:20.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.131+0000 7f0052000640 1 --2- 172.21.15.55:0/3925082803 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f004c15cad0 0x7f004c0b43d0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:20.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.131+0000 7f0052000640 1 -- 172.21.15.55:0/3925082803 >> 172.21.15.55:0/3925082803 conn(0x7f004c0b13b0 msgr2=0x7f004c0b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:20.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.131+0000 7f0052000640 1 -- 172.21.15.55:0/3925082803 shutdown_connections 2024-04-02T07:27:20.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.131+0000 7f0052000640 1 -- 172.21.15.55:0/3925082803 wait complete. 2024-04-02T07:27:20.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f0052000640 1 Processor -- start 2024-04-02T07:27:20.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f0052000640 1 -- start start 2024-04-02T07:27:20.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f0052000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f004c06a2d0 0x7f004c0b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:20.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f0052000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f004c06ec10 0x7f004c14b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:20.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f0052000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f004c15cad0 0x7f004c154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:20.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f0052000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c0b0d40 con 0x7f004c15cad0 2024-04-02T07:27:20.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f0052000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f004c0b0370 con 0x7f004c06ec10 2024-04-02T07:27:20.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f0052000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f004c0af760 con 0x7f004c06a2d0 2024-04-02T07:27:20.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f004be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f004c15cad0 0x7f004c154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:20.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f004be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f004c15cad0 0x7f004c154860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37714/0 (socket says 172.21.15.55:37714) 2024-04-02T07:27:20.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f004be00640 1 -- 172.21.15.55:0/4253258534 learned_addr learned my addr 172.21.15.55:0/4253258534 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:20.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f0042a00640 1 --2- 172.21.15.55:0/4253258534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f004c06ec10 0x7f004c14b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:20.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f004b400640 1 --2- 172.21.15.55:0/4253258534 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f004c06a2d0 0x7f004c0b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:20.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f004be00640 1 -- 172.21.15.55:0/4253258534 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f004c06a2d0 msgr2=0x7f004c0b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:20.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f004be00640 1 --2- 172.21.15.55:0/4253258534 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f004c06a2d0 0x7f004c0b0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:20.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f004be00640 1 -- 172.21.15.55:0/4253258534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f004c06ec10 msgr2=0x7f004c14b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:20.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f004be00640 1 --2- 172.21.15.55:0/4253258534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f004c06ec10 0x7f004c14b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:20.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f004be00640 1 -- 172.21.15.55:0/4253258534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003c0094d0 con 0x7f004c15cad0 2024-04-02T07:27:20.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f004be00640 1 --2- 172.21.15.55:0/4253258534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f004c15cad0 0x7f004c154860 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f004400c730 tx=0x7f004400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:20.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f0043e00640 1 -- 172.21.15.55:0/4253258534 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0044003b80 con 0x7f004c15cad0 2024-04-02T07:27:20.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f0043e00640 1 -- 172.21.15.55:0/4253258534 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0044003ce0 con 0x7f004c15cad0 2024-04-02T07:27:20.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f0052000640 1 -- 172.21.15.55:0/4253258534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f004c0afa40 con 0x7f004c15cad0 2024-04-02T07:27:20.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f0043e00640 1 -- 172.21.15.55:0/4253258534 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f004400aa30 con 0x7f004c15cad0 2024-04-02T07:27:20.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.135+0000 7f0052000640 1 -- 172.21.15.55:0/4253258534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f004c0b0000 con 0x7f004c15cad0 2024-04-02T07:27:20.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.139+0000 7f0052000640 1 -- 172.21.15.55:0/4253258534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f004c0706a0 con 0x7f004c15cad0 2024-04-02T07:27:20.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.139+0000 7f0043e00640 1 -- 172.21.15.55:0/4253258534 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f004400ab90 con 0x7f004c15cad0 2024-04-02T07:27:20.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.139+0000 7f0043e00640 1 --2- 172.21.15.55:0/4253258534 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0028066690 0x7f0028068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:20.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.139+0000 7f0043e00640 1 -- 172.21.15.55:0/4253258534 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f0044083f00 con 0x7f004c15cad0 2024-04-02T07:27:20.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.139+0000 7f004b400640 1 --2- 172.21.15.55:0/4253258534 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0028066690 0x7f0028068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:20.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.139+0000 7f004b400640 1 --2- 172.21.15.55:0/4253258534 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0028066690 0x7f0028068b50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f003c0ad000 tx=0x7f003c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:20.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.143+0000 7f0043e00640 1 -- 172.21.15.55:0/4253258534 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f00440511f0 con 0x7f004c15cad0 2024-04-02T07:27:20.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.339+0000 7f0052000640 1 -- 172.21.15.55:0/4253258534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f004c0b04e0 con 0x7f004c15cad0 2024-04-02T07:27:20.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.339+0000 7f0043e00640 1 -- 172.21.15.55:0/4253258534 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v50) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0044054810 con 0x7f004c15cad0 2024-04-02T07:27:20.341 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-02T07:27:20.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.339+0000 7f0052000640 1 -- 172.21.15.55:0/4253258534 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0028066690 msgr2=0x7f0028068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:20.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.339+0000 7f0052000640 1 --2- 172.21.15.55:0/4253258534 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0028066690 0x7f0028068b50 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f003c0ad000 tx=0x7f003c0a6000 comp rx=0 tx=0).stop 2024-04-02T07:27:20.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.339+0000 7f0052000640 1 -- 172.21.15.55:0/4253258534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f004c15cad0 msgr2=0x7f004c154860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:20.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.339+0000 7f0052000640 1 --2- 172.21.15.55:0/4253258534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f004c15cad0 0x7f004c154860 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f004400c730 tx=0x7f004400cbf0 comp rx=0 tx=0).stop 2024-04-02T07:27:20.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.339+0000 7f0052000640 1 -- 172.21.15.55:0/4253258534 shutdown_connections 2024-04-02T07:27:20.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.339+0000 7f0052000640 1 --2- 172.21.15.55:0/4253258534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f004c15cad0 0x7f004c154860 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:20.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.339+0000 7f0052000640 1 --2- 172.21.15.55:0/4253258534 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0028066690 0x7f0028068b50 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:20.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.339+0000 7f0052000640 1 --2- 172.21.15.55:0/4253258534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f004c06ec10 0x7f004c14b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:20.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.339+0000 7f0052000640 1 --2- 172.21.15.55:0/4253258534 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f004c06a2d0 0x7f004c0b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:20.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.339+0000 7f0052000640 1 -- 172.21.15.55:0/4253258534 >> 172.21.15.55:0/4253258534 conn(0x7f004c0b13b0 msgr2=0x7f004c0cbe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:20.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.339+0000 7f0052000640 1 -- 172.21.15.55:0/4253258534 shutdown_connections 2024-04-02T07:27:20.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:20.339+0000 7f0052000640 1 -- 172.21.15.55:0/4253258534 wait complete. 2024-04-02T07:27:20.361 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-02T07:27:20.361 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-02T07:27:20.361 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-02T07:27:20.361 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-02T07:27:20.361 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-02T07:27:20.361 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-02T07:27:20.361 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-02T07:27:20.361 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-02T07:27:20.362 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:27:20.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:20.362 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-02T07:27:20.372 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:27:20.372 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:27:20.372 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:27:20.372 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:27:20.372 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-02T07:27:20.372 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:27:20.372 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:27:20.372 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:27:20.372 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-02T07:27:20.373 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:27:20.373 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:27:20.373 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-02T07:27:20.373 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-02T07:27:20.373 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:27:20.373 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-02T07:27:20.373 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-02T07:27:20.373 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42154sec preferred_lft 42154sec 2024-04-02T07:27:20.374 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2024-04-02T07:27:20.374 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:27:20.374 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:27:20.374 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:27:20.374 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-02T07:27:20.374 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-02T07:27:20.374 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:81:5a:89:17 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:27:20.374 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-02T07:27:20.374 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:27:20.374 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:27:20.374 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-02T07:27:20.374 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-02T07:27:20.374 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:27:20.374 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-02T07:27:20.375 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:27:20.375 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:27:20.375 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-02T07:27:20.375 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-02T07:27:20.375 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:27:20.375 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:27:20.375 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-02T07:27:20.375 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-02T07:27:20.375 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:27:20.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:20.375 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-02T07:27:20.437 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:27:20.439 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:20.439 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-02T07:27:20.493 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-02T07:27:20.494 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-02T07:27:20.494 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-02T07:27:20.494 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-02T07:27:20.494 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-02T07:27:20.494 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-02T07:27:20.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:20.494 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:27:20.494 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:27:20.494 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-02T07:27:20.495 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-02T07:27:20.495 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-02T07:27:20.495 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:27:20.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:20.584 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-02T07:27:20.593 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-02T07:27:20.593 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-02T07:27:20.593 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:27:20.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:20.594 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-02T07:27:20.655 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-02T07:27:20.656 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:27:20.656 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-02T07:27:20.707 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:27:20.707 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:27:20.707 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:27:20.758 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:27:20.819 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:27:20.819 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:27:20.880 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:27:20.882 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:27:20.882 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:20.882 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:27:20.935 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-02T07:27:20.935 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-02T07:27:20.981 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:27:21.002 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:27:21.002 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:27:21.061 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:27:21.063 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:27:21.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:21.063 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:27:21.075 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:2024-04-02T07:27:21.071+0000 7fe10c748580 -1 init, newargv = 0x559c830d2ee0 newargc=15 2024-04-02T07:27:21.075 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[43718]: starting ceph client 2024-04-02T07:27:21.082 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[43718]: starting fuse 2024-04-02T07:27:21.086 INFO:teuthology.orchestra.run.smithi055.stdout:43 2024-04-02T07:27:21.086 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-02T07:27:21.086 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:27:21.086 DEBUG:teuthology.orchestra.run.smithi055:> import glob 2024-04-02T07:27:21.086 DEBUG:teuthology.orchestra.run.smithi055:> import re 2024-04-02T07:27:21.086 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:27:21.087 DEBUG:teuthology.orchestra.run.smithi055:> import subprocess 2024-04-02T07:27:21.087 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:27:21.087 DEBUG:teuthology.orchestra.run.smithi055:> def _find_admin_socket(client_name): 2024-04-02T07:27:21.087 DEBUG:teuthology.orchestra.run.smithi055:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-02T07:27:21.087 DEBUG:teuthology.orchestra.run.smithi055:> files = glob.glob(asok_path) 2024-04-02T07:27:21.087 DEBUG:teuthology.orchestra.run.smithi055:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-02T07:27:21.087 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:27:21.087 DEBUG:teuthology.orchestra.run.smithi055:> # Given a non-glob path, it better be there 2024-04-02T07:27:21.087 DEBUG:teuthology.orchestra.run.smithi055:> if "*" not in asok_path: 2024-04-02T07:27:21.087 DEBUG:teuthology.orchestra.run.smithi055:> assert(len(files) == 1) 2024-04-02T07:27:21.087 DEBUG:teuthology.orchestra.run.smithi055:> return files[0] 2024-04-02T07:27:21.087 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:27:21.087 DEBUG:teuthology.orchestra.run.smithi055:> for f in files: 2024-04-02T07:27:21.087 DEBUG:teuthology.orchestra.run.smithi055:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-02T07:27:21.088 DEBUG:teuthology.orchestra.run.smithi055:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-02T07:27:21.088 DEBUG:teuthology.orchestra.run.smithi055:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-02T07:27:21.088 DEBUG:teuthology.orchestra.run.smithi055:> contents = proc_f.read() 2024-04-02T07:27:21.088 DEBUG:teuthology.orchestra.run.smithi055:> if mountpoint in contents: 2024-04-02T07:27:21.088 DEBUG:teuthology.orchestra.run.smithi055:> return f 2024-04-02T07:27:21.088 DEBUG:teuthology.orchestra.run.smithi055:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-02T07:27:21.088 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:27:21.088 DEBUG:teuthology.orchestra.run.smithi055:> print(_find_admin_socket("client.0")) 2024-04-02T07:27:21.088 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:27:21.207 INFO:teuthology.orchestra.run.smithi055.stdout:/var/run/ceph/ceph-client.0.43718.asok 2024-04-02T07:27:21.391 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.43718.asok 2024-04-02T07:27:21.392 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:21.392 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.43718.asok status 2024-04-02T07:27:21.393 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-04-02T07:27:21.391+0000 7faf6dc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:27:21.525 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:27:21.525 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": { 2024-04-02T07:27:21.525 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_sha1": "d0e392d9aee635f2b65768c460c7a151ead7a5e2", 2024-04-02T07:27:21.525 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)", 2024-04-02T07:27:21.525 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "0", 2024-04-02T07:27:21.526 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2024-04-02T07:27:21.526 INFO:teuthology.orchestra.run.smithi055.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-02T07:27:21.526 INFO:teuthology.orchestra.run.smithi055.stdout: "pid": "43718", 2024-04-02T07:27:21.526 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2024-04-02T07:27:21.526 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:27:21.526 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_count": 0, 2024-04-02T07:27:21.526 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_pinned_count": 0, 2024-04-02T07:27:21.526 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 7005, 2024-04-02T07:27:21.526 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": { 2024-04-02T07:27:21.526 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2024-04-02T07:27:21.526 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2024-04-02T07:27:21.526 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 7005 2024-04-02T07:27:21.527 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:27:21.527 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:27:21.527 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:27:21.527 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:27:21.527 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 2664274518 2024-04-02T07:27:21.527 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:27:21.527 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:27:21.527 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:27:21.527 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:27:21.527 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:27:21.527 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 2664274518 2024-04-02T07:27:21.527 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:27:21.527 INFO:teuthology.orchestra.run.smithi055.stdout: "inst_str": "client.7005 192.168.0.1:0/2664274518", 2024-04-02T07:27:21.527 INFO:teuthology.orchestra.run.smithi055.stdout: "addr_str": "192.168.0.1:0/2664274518", 2024-04-02T07:27:21.528 INFO:teuthology.orchestra.run.smithi055.stdout: "inode_count": 1, 2024-04-02T07:27:21.528 INFO:teuthology.orchestra.run.smithi055.stdout: "mds_epoch": 50, 2024-04-02T07:27:21.528 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch": 75, 2024-04-02T07:27:21.528 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch_barrier": 0, 2024-04-02T07:27:21.528 INFO:teuthology.orchestra.run.smithi055.stdout: "blocklisted": false, 2024-04-02T07:27:21.528 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs" 2024-04-02T07:27:21.528 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:27:21.540 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:21.540 DEBUG:teuthology.orchestra.run.smithi055:> stat --file-system '--printf=%T 2024-04-02T07:27:21.540 DEBUG:teuthology.orchestra.run.smithi055:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-02T07:27:21.549 INFO:teuthology.orchestra.run.smithi055.stdout:fuseblk 2024-04-02T07:27:21.549 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-02T07:27:21.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:21.550 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:27:21.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:21.610 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ls subdir/) 2024-04-02T07:27:21.668 INFO:teuthology.orchestra.run.smithi055.stdout:file_undamaged 2024-04-02T07:27:21.669 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:27:21.669 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:27:21.669 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:27:21.670 DEBUG:teuthology.orchestra.run.smithi055:> import json 2024-04-02T07:27:21.670 DEBUG:teuthology.orchestra.run.smithi055:> import sys 2024-04-02T07:27:21.670 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:27:21.670 DEBUG:teuthology.orchestra.run.smithi055:> try: 2024-04-02T07:27:21.670 DEBUG:teuthology.orchestra.run.smithi055:> s = os.stat('"'"'/home/ubuntu/cephtest/mnt.0/subdir/file_to_be_damaged'"'"') 2024-04-02T07:27:21.670 DEBUG:teuthology.orchestra.run.smithi055:> except OSError as e: 2024-04-02T07:27:21.670 DEBUG:teuthology.orchestra.run.smithi055:> sys.exit(e.errno) 2024-04-02T07:27:21.670 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:27:21.670 DEBUG:teuthology.orchestra.run.smithi055:> attrs = ["st_mode", "st_ino", "st_dev", "st_nlink", "st_uid", "st_gid", "st_size", "st_atime", "st_mtime", "st_ctime"] 2024-04-02T07:27:21.670 DEBUG:teuthology.orchestra.run.smithi055:> print(json.dumps( 2024-04-02T07:27:21.670 DEBUG:teuthology.orchestra.run.smithi055:> dict([(a, getattr(s, a)) for a in attrs]), 2024-04-02T07:27:21.670 DEBUG:teuthology.orchestra.run.smithi055:> indent=2)) 2024-04-02T07:27:21.670 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:27:21.956 INFO:teuthology.orchestra.run.smithi055.stderr:daemon-helper: command failed with exit status 2 2024-04-02T07:27:21.963 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-04-02T07:27:21.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:21.964 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-04-02T07:27:22.043 INFO:teuthology.orchestra.run.smithi055.stdout:2 2024-04-02T07:27:22.043 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:27:22.043 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:27:22.099 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:27:22.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.279+0000 7f0271a00640 1 Processor -- start 2024-04-02T07:27:22.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.279+0000 7f0271a00640 1 -- start start 2024-04-02T07:27:22.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.283+0000 7f0271a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f026c153ea0 0x7f026c0c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:22.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.283+0000 7f0271a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f026c15a070 0x7f026c13d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:22.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.283+0000 7f0271a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f026c13d0c0 con 0x7f026c159be0 2024-04-02T07:27:22.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.283+0000 7f0271a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026c15a4f0 con 0x7f026c153ea0 2024-04-02T07:27:22.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.283+0000 7f0271a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f026c15a7d0 con 0x7f026c15a070 2024-04-02T07:27:22.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.283+0000 7f026aa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f026c153ea0 0x7f026c0c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:22.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.283+0000 7f026aa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f026c153ea0 0x7f026c0c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37718/0 (socket says 172.21.15.55:37718) 2024-04-02T07:27:22.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.283+0000 7f026aa00640 1 -- 172.21.15.55:0/939707705 learned_addr learned my addr 172.21.15.55:0/939707705 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:22.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.283+0000 7f026b400640 1 --2- 172.21.15.55:0/939707705 >> v2:172.21.15.106:3300/0 conn(0x7f026c15a070 0x7f026c13d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:22.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.283+0000 7f026aa00640 1 -- 172.21.15.55:0/939707705 >> v2:172.21.15.106:3300/0 conn(0x7f026c15a070 msgr2=0x7f026c13d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:22.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.283+0000 7f026aa00640 1 --2- 172.21.15.55:0/939707705 >> v2:172.21.15.106:3300/0 conn(0x7f026c15a070 0x7f026c13d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.283+0000 7f026aa00640 1 -- 172.21.15.55:0/939707705 >> v1:172.21.15.106:6789/0 conn(0x7f026c159be0 legacy=0x7f026c0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:22.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.283+0000 7f026aa00640 1 -- 172.21.15.55:0/939707705 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f026c15aab0 con 0x7f026c153ea0 2024-04-02T07:27:22.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.283+0000 7f026b400640 1 --2- 172.21.15.55:0/939707705 >> v2:172.21.15.106:3300/0 conn(0x7f026c15a070 0x7f026c13d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:22.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f026aa00640 1 --2- 172.21.15.55:0/939707705 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f026c153ea0 0x7f026c0c4120 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f026c143320 tx=0x7f025c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad40be4a364be17 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:22.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f026a000640 1 -- 172.21.15.55:0/939707705 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c0a9400 con 0x7f026c153ea0 2024-04-02T07:27:22.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f026a000640 1 -- 172.21.15.55:0/939707705 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f025c0a9560 con 0x7f026c153ea0 2024-04-02T07:27:22.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f026a000640 1 -- 172.21.15.55:0/939707705 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025c0a98f0 con 0x7f026c153ea0 2024-04-02T07:27:22.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f0271a00640 1 -- 172.21.15.55:0/939707705 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f026c153ea0 msgr2=0x7f026c0c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f0271a00640 1 --2- 172.21.15.55:0/939707705 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f026c153ea0 0x7f026c0c4120 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f026c143320 tx=0x7f025c01c520 comp rx=0 tx=0).stop 2024-04-02T07:27:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f0271a00640 1 -- 172.21.15.55:0/939707705 shutdown_connections 2024-04-02T07:27:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f0271a00640 1 --2- 172.21.15.55:0/939707705 >> v2:172.21.15.106:3300/0 conn(0x7f026c15a070 0x7f026c13d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f0271a00640 1 --2- 172.21.15.55:0/939707705 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f026c153ea0 0x7f026c0c4120 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f0271a00640 1 -- 172.21.15.55:0/939707705 >> 172.21.15.55:0/939707705 conn(0x7f026c066080 msgr2=0x7f026c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f0271a00640 1 -- 172.21.15.55:0/939707705 shutdown_connections 2024-04-02T07:27:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f0271a00640 1 -- 172.21.15.55:0/939707705 wait complete. 2024-04-02T07:27:22.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f0271a00640 1 Processor -- start 2024-04-02T07:27:22.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f0271a00640 1 -- start start 2024-04-02T07:27:22.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f0271a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f026c153ea0 0x7f026c150920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:22.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f0271a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f026c159be0 0x7f026c14ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:22.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f0271a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026c15a070 0x7f026c14f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:22.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f0271a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c14f260 con 0x7f026c159be0 2024-04-02T07:27:22.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f0271a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f026c0cca20 con 0x7f026c15a070 2024-04-02T07:27:22.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f0271a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f026c13bcd0 con 0x7f026c153ea0 2024-04-02T07:27:22.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f0262000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f026c159be0 0x7f026c14ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:22.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f0262000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f026c159be0 0x7f026c14ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37722/0 (socket says 172.21.15.55:37722) 2024-04-02T07:27:22.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f0262000640 1 -- 172.21.15.55:0/918379182 learned_addr learned my addr 172.21.15.55:0/918379182 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:22.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f026b400640 1 --2- 172.21.15.55:0/918379182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026c15a070 0x7f026c14f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:22.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.287+0000 7f026aa00640 1 --2- 172.21.15.55:0/918379182 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f026c153ea0 0x7f026c150920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:22.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.291+0000 7f0262000640 1 -- 172.21.15.55:0/918379182 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f026c153ea0 msgr2=0x7f026c150920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:22.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.291+0000 7f0262000640 1 --2- 172.21.15.55:0/918379182 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f026c153ea0 0x7f026c150920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.291+0000 7f0262000640 1 -- 172.21.15.55:0/918379182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026c15a070 msgr2=0x7f026c14f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:22.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.291+0000 7f0262000640 1 --2- 172.21.15.55:0/918379182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026c15a070 0x7f026c14f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.291+0000 7f0262000640 1 -- 172.21.15.55:0/918379182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f025c0094d0 con 0x7f026c159be0 2024-04-02T07:27:22.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.291+0000 7f0262000640 1 --2- 172.21.15.55:0/918379182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f026c159be0 0x7f026c14ed20 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f025400c7f0 tx=0x7f025400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:22.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.291+0000 7f0263400640 1 -- 172.21.15.55:0/918379182 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0254003b80 con 0x7f026c159be0 2024-04-02T07:27:22.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.291+0000 7f0263400640 1 -- 172.21.15.55:0/918379182 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0254003ce0 con 0x7f026c159be0 2024-04-02T07:27:22.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.291+0000 7f0263400640 1 -- 172.21.15.55:0/918379182 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f025400aa90 con 0x7f026c159be0 2024-04-02T07:27:22.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.291+0000 7f0271a00640 1 -- 172.21.15.55:0/918379182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f026c15b130 con 0x7f026c159be0 2024-04-02T07:27:22.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.291+0000 7f0271a00640 1 -- 172.21.15.55:0/918379182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f026c15b410 con 0x7f026c159be0 2024-04-02T07:27:22.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.291+0000 7f0271a00640 1 -- 172.21.15.55:0/918379182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f026c066c90 con 0x7f026c159be0 2024-04-02T07:27:22.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.291+0000 7f0263400640 1 -- 172.21.15.55:0/918379182 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f025400abf0 con 0x7f026c159be0 2024-04-02T07:27:22.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.291+0000 7f0263400640 1 --2- 172.21.15.55:0/918379182 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f02480666c0 0x7f0248068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:22.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.291+0000 7f0263400640 1 -- 172.21.15.55:0/918379182 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f0254083fe0 con 0x7f026c159be0 2024-04-02T07:27:22.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.291+0000 7f026aa00640 1 --2- 172.21.15.55:0/918379182 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f02480666c0 0x7f0248068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:22.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.295+0000 7f026aa00640 1 --2- 172.21.15.55:0/918379182 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f02480666c0 0x7f0248068b80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f025c0ae000 tx=0x7f025c0b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:22.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.295+0000 7f0263400640 1 -- 172.21.15.55:0/918379182 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0254051310 con 0x7f026c159be0 2024-04-02T07:27:22.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.459+0000 7f0271a00640 1 -- 172.21.15.55:0/918379182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f026c0c4250 con 0x7f026c159be0 2024-04-02T07:27:22.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.459+0000 7f0263400640 1 -- 172.21.15.55:0/918379182 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16327 (secure 0 0 0) 0x7f0254054930 con 0x7f026c159be0 2024-04-02T07:27:22.463 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:27:22.463 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":75,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:27:14.356458+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:26:53.196912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-02T07:26:54.514963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.2e","mappings":[{"from":6,"to":0}]},{"pgid":"11.3c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6833/1576619269":"2024-04-03T07:27:14.356430+0000","172.21.15.55:6832/1576619269":"2024-04-03T07:27:14.356430+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:27:22.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.463+0000 7f0271a00640 1 -- 172.21.15.55:0/918379182 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f02480666c0 msgr2=0x7f0248068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:22.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.463+0000 7f0271a00640 1 --2- 172.21.15.55:0/918379182 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f02480666c0 0x7f0248068b80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f025c0ae000 tx=0x7f025c0b3040 comp rx=0 tx=0).stop 2024-04-02T07:27:22.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.463+0000 7f0271a00640 1 -- 172.21.15.55:0/918379182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f026c159be0 msgr2=0x7f026c14ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:22.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.463+0000 7f0271a00640 1 --2- 172.21.15.55:0/918379182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f026c159be0 0x7f026c14ed20 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f025400c7f0 tx=0x7f025400ccb0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.463+0000 7f0271a00640 1 -- 172.21.15.55:0/918379182 shutdown_connections 2024-04-02T07:27:22.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.463+0000 7f0271a00640 1 --2- 172.21.15.55:0/918379182 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f02480666c0 0x7f0248068b80 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.463+0000 7f0271a00640 1 --2- 172.21.15.55:0/918379182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f026c15a070 0x7f026c14f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.463+0000 7f0271a00640 1 --2- 172.21.15.55:0/918379182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f026c159be0 0x7f026c14ed20 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.463+0000 7f0271a00640 1 --2- 172.21.15.55:0/918379182 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f026c153ea0 0x7f026c150920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.463+0000 7f0271a00640 1 -- 172.21.15.55:0/918379182 >> 172.21.15.55:0/918379182 conn(0x7f026c066080 msgr2=0x7f026c0b1ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:22.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.463+0000 7f0271a00640 1 -- 172.21.15.55:0/918379182 shutdown_connections 2024-04-02T07:27:22.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.463+0000 7f0271a00640 1 -- 172.21.15.55:0/918379182 wait complete. 2024-04-02T07:27:22.484 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:26:53.196912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:26:54.514963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:27:22.485 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:27:22.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.623+0000 7faeb5800640 1 Processor -- start 2024-04-02T07:27:22.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.623+0000 7faeb5800640 1 -- start start 2024-04-02T07:27:22.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.627+0000 7faeb5800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faeb00ade90 0x7faeb006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:22.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.627+0000 7faeb5800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb006c630 con 0x7faeb00b3dc0 2024-04-02T07:27:22.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.627+0000 7faeb5800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeb006c8f0 con 0x7faeb00b41a0 2024-04-02T07:27:22.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.627+0000 7faeb5800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeb00cae80 con 0x7faeb00ade90 2024-04-02T07:27:22.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.627+0000 7faeaea00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faeb00b3dc0 0x7faeb00ca770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53018/0 (socket says 172.21.15.55:53018) 2024-04-02T07:27:22.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.627+0000 7faeaea00640 1 -- 172.21.15.55:0/367009100 learned_addr learned my addr 172.21.15.55:0/367009100 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:27:22.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.627+0000 7faea6000640 1 --2- 172.21.15.55:0/367009100 >> v2:172.21.15.55:3300/0 conn(0x7faeb00ade90 0x7faeb006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:22.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.627+0000 7faea6000640 1 -- 172.21.15.55:0/367009100 >> v1:172.21.15.106:6789/0 conn(0x7faeb00b41a0 legacy=0x7faeb0142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:22.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.627+0000 7faea6000640 1 -- 172.21.15.55:0/367009100 >> v1:172.21.15.55:6789/0 conn(0x7faeb00b3dc0 legacy=0x7faeb00ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:22.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.627+0000 7faea6000640 1 -- 172.21.15.55:0/367009100 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeb006cbd0 con 0x7faeb00ade90 2024-04-02T07:27:22.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.627+0000 7faeae000640 1 -- 172.21.15.55:0/367009100 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 246756469 0 0) 0x7faeb006c630 con 0x7faeb00b3dc0 2024-04-02T07:27:22.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.631+0000 7faea6000640 1 --2- 172.21.15.55:0/367009100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeb00ade90 0x7faeb006d6b0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fae980097c0 tx=0x7fae9801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8be5e6751564d7dd server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:22.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.631+0000 7faeae000640 1 -- 172.21.15.55:0/367009100 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae980ab670 con 0x7faeb00ade90 2024-04-02T07:27:22.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.631+0000 7faeae000640 1 -- 172.21.15.55:0/367009100 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae980ab7d0 con 0x7faeb00ade90 2024-04-02T07:27:22.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.631+0000 7faeae000640 1 -- 172.21.15.55:0/367009100 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae980abb60 con 0x7faeb00ade90 2024-04-02T07:27:22.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.631+0000 7faeb5800640 1 -- 172.21.15.55:0/367009100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeb00ade90 msgr2=0x7faeb006d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:22.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.631+0000 7faeb5800640 1 --2- 172.21.15.55:0/367009100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeb00ade90 0x7faeb006d6b0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fae980097c0 tx=0x7fae9801c470 comp rx=0 tx=0).stop 2024-04-02T07:27:22.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.631+0000 7faeb5800640 1 -- 172.21.15.55:0/367009100 shutdown_connections 2024-04-02T07:27:22.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.631+0000 7faeb5800640 1 --2- 172.21.15.55:0/367009100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeb00ade90 0x7faeb006d6b0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.631+0000 7faeb5800640 1 -- 172.21.15.55:0/367009100 >> 172.21.15.55:0/367009100 conn(0x7faeb006a390 msgr2=0x7faeb00b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:22.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.631+0000 7faeb5800640 1 -- 172.21.15.55:0/367009100 shutdown_connections 2024-04-02T07:27:22.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.631+0000 7faeb5800640 1 -- 172.21.15.55:0/367009100 wait complete. 2024-04-02T07:27:22.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.631+0000 7faeb5800640 1 Processor -- start 2024-04-02T07:27:22.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.631+0000 7faeb5800640 1 -- start start 2024-04-02T07:27:22.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faeb5800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faeb00ade90 0x7faeb00ab880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:22.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faeb5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeb00b3dc0 0x7faeb01388d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:22.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faeb5800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faeb00b41a0 0x7faeb01f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:22.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faeb5800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb0138e10 con 0x7faeb00b3dc0 2024-04-02T07:27:22.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faeb5800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeb01f68a0 con 0x7faeb00ade90 2024-04-02T07:27:22.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faeb5800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeb01f62e0 con 0x7faeb00b41a0 2024-04-02T07:27:22.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faea6000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeb00b3dc0 0x7faeb01388d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:22.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faea6000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeb00b3dc0 0x7faeb01388d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37738/0 (socket says 172.21.15.55:37738) 2024-04-02T07:27:22.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faea6000640 1 -- 172.21.15.55:0/1450699646 learned_addr learned my addr 172.21.15.55:0/1450699646 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:22.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faeaea00640 1 --2- 172.21.15.55:0/1450699646 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faeb00ade90 0x7faeb00ab880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:22.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faeaf400640 1 --2- 172.21.15.55:0/1450699646 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faeb00b41a0 0x7faeb01f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:22.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faea6000640 1 -- 172.21.15.55:0/1450699646 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faeb00b41a0 msgr2=0x7faeb01f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:22.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faea6000640 1 --2- 172.21.15.55:0/1450699646 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faeb00b41a0 0x7faeb01f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faea6000640 1 -- 172.21.15.55:0/1450699646 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faeb00ade90 msgr2=0x7faeb00ab880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:22.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faea6000640 1 --2- 172.21.15.55:0/1450699646 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faeb00ade90 0x7faeb00ab880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faea6000640 1 -- 172.21.15.55:0/1450699646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae98009420 con 0x7faeb00b3dc0 2024-04-02T07:27:22.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faeaf400640 1 --2- 172.21.15.55:0/1450699646 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faeb00b41a0 0x7faeb01f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:27:22.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faea6000640 1 --2- 172.21.15.55:0/1450699646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeb00b3dc0 0x7faeb01388d0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fae980ad040 tx=0x7fae9801acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:22.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faea7400640 1 -- 172.21.15.55:0/1450699646 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae980b5810 con 0x7faeb00b3dc0 2024-04-02T07:27:22.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faea7400640 1 -- 172.21.15.55:0/1450699646 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae980b5990 con 0x7faeb00b3dc0 2024-04-02T07:27:22.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faeb5800640 1 -- 172.21.15.55:0/1450699646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeb006de00 con 0x7faeb00b3dc0 2024-04-02T07:27:22.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faea7400640 1 -- 172.21.15.55:0/1450699646 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae980b5d40 con 0x7faeb00b3dc0 2024-04-02T07:27:22.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faeb5800640 1 -- 172.21.15.55:0/1450699646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeb01515d0 con 0x7faeb00b3dc0 2024-04-02T07:27:22.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faeb5800640 1 -- 172.21.15.55:0/1450699646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeb0151430 con 0x7faeb00b3dc0 2024-04-02T07:27:22.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.635+0000 7faea7400640 1 -- 172.21.15.55:0/1450699646 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fae980bf410 con 0x7faeb00b3dc0 2024-04-02T07:27:22.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.639+0000 7faea7400640 1 --2- 172.21.15.55:0/1450699646 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fae8c066690 0x7fae8c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:22.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.639+0000 7faea7400640 1 -- 172.21.15.55:0/1450699646 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fae9811f2b0 con 0x7faeb00b3dc0 2024-04-02T07:27:22.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.639+0000 7faeaea00640 1 --2- 172.21.15.55:0/1450699646 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fae8c066690 0x7fae8c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:22.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.639+0000 7faeaea00640 1 --2- 172.21.15.55:0/1450699646 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fae8c066690 0x7fae8c068b50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7faea0007fd0 tx=0x7faea0007f40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:22.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.643+0000 7faea7400640 1 -- 172.21.15.55:0/1450699646 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7faeb0151430 con 0x7faeb00b3dc0 2024-04-02T07:27:22.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.799+0000 7faeb5800640 1 -- 172.21.15.55:0/1450699646 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faeb0151430 con 0x7faeb00b3dc0 2024-04-02T07:27:22.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.803+0000 7faea7400640 1 -- 172.21.15.55:0/1450699646 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7faeb0151430 con 0x7faeb00b3dc0 2024-04-02T07:27:22.804 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:27:22.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.803+0000 7faeb5800640 1 -- 172.21.15.55:0/1450699646 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fae8c066690 msgr2=0x7fae8c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:22.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.803+0000 7faeb5800640 1 --2- 172.21.15.55:0/1450699646 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fae8c066690 0x7fae8c068b50 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7faea0007fd0 tx=0x7faea0007f40 comp rx=0 tx=0).stop 2024-04-02T07:27:22.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.803+0000 7faeb5800640 1 -- 172.21.15.55:0/1450699646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeb00b3dc0 msgr2=0x7faeb01388d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:22.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.803+0000 7faeb5800640 1 --2- 172.21.15.55:0/1450699646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeb00b3dc0 0x7faeb01388d0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fae980ad040 tx=0x7fae9801acb0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.803+0000 7faeb5800640 1 -- 172.21.15.55:0/1450699646 shutdown_connections 2024-04-02T07:27:22.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.803+0000 7faeb5800640 1 --2- 172.21.15.55:0/1450699646 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faeb00b41a0 0x7faeb01f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.803+0000 7faeb5800640 1 --2- 172.21.15.55:0/1450699646 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faeb00b3dc0 0x7faeb01388d0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.803+0000 7faeb5800640 1 --2- 172.21.15.55:0/1450699646 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fae8c066690 0x7fae8c068b50 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.803+0000 7faeb5800640 1 --2- 172.21.15.55:0/1450699646 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faeb00ade90 0x7faeb00ab880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.803+0000 7faeb5800640 1 -- 172.21.15.55:0/1450699646 >> 172.21.15.55:0/1450699646 conn(0x7faeb006a390 msgr2=0x7faeb013cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:22.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.803+0000 7faeb5800640 1 -- 172.21.15.55:0/1450699646 shutdown_connections 2024-04-02T07:27:22.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.803+0000 7faeb5800640 1 -- 172.21.15.55:0/1450699646 wait complete. 2024-04-02T07:27:22.825 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:27:22.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.967+0000 7f204de00640 1 Processor -- start 2024-04-02T07:27:22.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.967+0000 7f204de00640 1 -- start start 2024-04-02T07:27:22.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.967+0000 7f204de00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f204815ca60 0x7f20480cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:22.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.967+0000 7f204de00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2048098a10 0x7f2048098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:22.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.967+0000 7f204de00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f204806b920 0x7f204806bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:22.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.967+0000 7f204de00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20480993b0 con 0x7f204806b920 2024-04-02T07:27:22.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.967+0000 7f204de00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204815ce40 con 0x7f2048098a10 2024-04-02T07:27:22.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.967+0000 7f204de00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20480d01b0 con 0x7f204815ca60 2024-04-02T07:27:22.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.967+0000 7f2047400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f204806b920 0x7f204806bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:22.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.967+0000 7f2047400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f204806b920 0x7f204806bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37752/0 (socket says 172.21.15.55:37752) 2024-04-02T07:27:22.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.967+0000 7f2047400640 1 -- 172.21.15.55:0/3291188777 learned_addr learned my addr 172.21.15.55:0/3291188777 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:22.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.967+0000 7f2046a00640 1 --2- 172.21.15.55:0/3291188777 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f204815ca60 0x7f20480cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:22.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.967+0000 7f2046000640 1 --2- 172.21.15.55:0/3291188777 >> v2:172.21.15.106:3300/0 conn(0x7f2048098a10 0x7f2048098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:22.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.967+0000 7f2047400640 1 -- 172.21.15.55:0/3291188777 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f204815ca60 msgr2=0x7f20480cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:22.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.967+0000 7f2047400640 1 --2- 172.21.15.55:0/3291188777 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f204815ca60 0x7f20480cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.967+0000 7f2047400640 1 -- 172.21.15.55:0/3291188777 >> v2:172.21.15.106:3300/0 conn(0x7f2048098a10 msgr2=0x7f2048098e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:22.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.967+0000 7f2047400640 1 --2- 172.21.15.55:0/3291188777 >> v2:172.21.15.106:3300/0 conn(0x7f2048098a10 0x7f2048098e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.967+0000 7f2047400640 1 -- 172.21.15.55:0/3291188777 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20480ceeb0 con 0x7f204806b920 2024-04-02T07:27:22.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.971+0000 7f2047400640 1 --2- 172.21.15.55:0/3291188777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f204806b920 0x7f204806bd50 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f2048071ad0 tx=0x7f204001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673702137bf84641 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:22.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.971+0000 7f2045600640 1 -- 172.21.15.55:0/3291188777 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20400a57b0 con 0x7f204806b920 2024-04-02T07:27:22.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.971+0000 7f2045600640 1 -- 172.21.15.55:0/3291188777 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20400a5910 con 0x7f204806b920 2024-04-02T07:27:22.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.971+0000 7f2045600640 1 -- 172.21.15.55:0/3291188777 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20400a5ca0 con 0x7f204806b920 2024-04-02T07:27:22.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.971+0000 7f204de00640 1 -- 172.21.15.55:0/3291188777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f204806b920 msgr2=0x7f204806bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:22.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.971+0000 7f204de00640 1 --2- 172.21.15.55:0/3291188777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f204806b920 0x7f204806bd50 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f2048071ad0 tx=0x7f204001c930 comp rx=0 tx=0).stop 2024-04-02T07:27:22.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.971+0000 7f204de00640 1 -- 172.21.15.55:0/3291188777 shutdown_connections 2024-04-02T07:27:22.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.971+0000 7f204de00640 1 --2- 172.21.15.55:0/3291188777 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f204806b920 0x7f204806bd50 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.971+0000 7f204de00640 1 --2- 172.21.15.55:0/3291188777 >> v2:172.21.15.106:3300/0 conn(0x7f2048098a10 0x7f2048098e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.971+0000 7f204de00640 1 --2- 172.21.15.55:0/3291188777 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f204815ca60 0x7f20480cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.971+0000 7f204de00640 1 -- 172.21.15.55:0/3291188777 >> 172.21.15.55:0/3291188777 conn(0x7f20480b2150 msgr2=0x7f20480b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:22.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.971+0000 7f204de00640 1 -- 172.21.15.55:0/3291188777 shutdown_connections 2024-04-02T07:27:22.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.971+0000 7f204de00640 1 -- 172.21.15.55:0/3291188777 wait complete. 2024-04-02T07:27:22.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.971+0000 7f204de00640 1 Processor -- start 2024-04-02T07:27:22.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.971+0000 7f204de00640 1 -- start start 2024-04-02T07:27:22.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f204de00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f204806b920 0x7f2048156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:22.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f204de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2048098a10 0x7f2048157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:22.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f204de00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f204815ca60 0x7f2048158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:22.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f204de00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20480c9510 con 0x7f2048098a10 2024-04-02T07:27:22.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f204de00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2048158750 con 0x7f204815ca60 2024-04-02T07:27:22.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f204de00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2048158a30 con 0x7f204806b920 2024-04-02T07:27:22.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f2046000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2048098a10 0x7f2048157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:22.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f2046000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2048098a10 0x7f2048157be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37764/0 (socket says 172.21.15.55:37764) 2024-04-02T07:27:22.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f2046000640 1 -- 172.21.15.55:0/4210195610 learned_addr learned my addr 172.21.15.55:0/4210195610 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:22.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f2046a00640 1 --2- 172.21.15.55:0/4210195610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f204806b920 0x7f2048156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:22.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f2047400640 1 --2- 172.21.15.55:0/4210195610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f204815ca60 0x7f2048158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:22.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f2046000640 1 -- 172.21.15.55:0/4210195610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f204806b920 msgr2=0x7f2048156a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:22.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f2046000640 1 --2- 172.21.15.55:0/4210195610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f204806b920 0x7f2048156a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f2046000640 1 -- 172.21.15.55:0/4210195610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f204815ca60 msgr2=0x7f2048158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:22.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f2046000640 1 --2- 172.21.15.55:0/4210195610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f204815ca60 0x7f2048158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:22.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f2046000640 1 -- 172.21.15.55:0/4210195610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2040009b30 con 0x7f2048098a10 2024-04-02T07:27:22.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f2046000640 1 --2- 172.21.15.55:0/4210195610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2048098a10 0x7f2048157be0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f203400e870 tx=0x7f203400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:22.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f203f400640 1 -- 172.21.15.55:0/4210195610 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2034009510 con 0x7f2048098a10 2024-04-02T07:27:22.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f203f400640 1 -- 172.21.15.55:0/4210195610 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f203400eec0 con 0x7f2048098a10 2024-04-02T07:27:22.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f204de00640 1 -- 172.21.15.55:0/4210195610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2048158d10 con 0x7f2048098a10 2024-04-02T07:27:22.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f203f400640 1 -- 172.21.15.55:0/4210195610 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f203400cb40 con 0x7f2048098a10 2024-04-02T07:27:22.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f204de00640 1 -- 172.21.15.55:0/4210195610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20481592d0 con 0x7f2048098a10 2024-04-02T07:27:22.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.975+0000 7f204de00640 1 -- 172.21.15.55:0/4210195610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2048066c90 con 0x7f2048098a10 2024-04-02T07:27:22.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.979+0000 7f203f400640 1 -- 172.21.15.55:0/4210195610 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f203400cca0 con 0x7f2048098a10 2024-04-02T07:27:22.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.979+0000 7f203f400640 1 --2- 172.21.15.55:0/4210195610 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2028066690 0x7f2028068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:22.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.979+0000 7f203f400640 1 -- 172.21.15.55:0/4210195610 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f2034084310 con 0x7f2048098a10 2024-04-02T07:27:22.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.979+0000 7f2046a00640 1 --2- 172.21.15.55:0/4210195610 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2028066690 0x7f2028068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:22.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.979+0000 7f2046a00640 1 --2- 172.21.15.55:0/4210195610 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2028066690 0x7f2028068b50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2038009ae0 tx=0x7f2038009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:22.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:22.983+0000 7f203f400640 1 -- 172.21.15.55:0/4210195610 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2034051600 con 0x7f2048098a10 2024-04-02T07:27:23.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.143+0000 7f204de00640 1 -- 172.21.15.55:0/4210195610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f20480ccde0 con 0x7f2048098a10 2024-04-02T07:27:23.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.143+0000 7f203f400640 1 -- 172.21.15.55:0/4210195610 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2034054c20 con 0x7f2048098a10 2024-04-02T07:27:23.147 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:27:23.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.147+0000 7f204de00640 1 -- 172.21.15.55:0/4210195610 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2028066690 msgr2=0x7f2028068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.147+0000 7f204de00640 1 --2- 172.21.15.55:0/4210195610 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2028066690 0x7f2028068b50 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2038009ae0 tx=0x7f2038009190 comp rx=0 tx=0).stop 2024-04-02T07:27:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.147+0000 7f204de00640 1 -- 172.21.15.55:0/4210195610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2048098a10 msgr2=0x7f2048157be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.147+0000 7f204de00640 1 --2- 172.21.15.55:0/4210195610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2048098a10 0x7f2048157be0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f203400e870 tx=0x7f203400ec70 comp rx=0 tx=0).stop 2024-04-02T07:27:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.147+0000 7f204de00640 1 -- 172.21.15.55:0/4210195610 shutdown_connections 2024-04-02T07:27:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.147+0000 7f204de00640 1 --2- 172.21.15.55:0/4210195610 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2028066690 0x7f2028068b50 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.147+0000 7f204de00640 1 --2- 172.21.15.55:0/4210195610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f204815ca60 0x7f2048158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.147+0000 7f204de00640 1 --2- 172.21.15.55:0/4210195610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2048098a10 0x7f2048157be0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.147+0000 7f204de00640 1 --2- 172.21.15.55:0/4210195610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f204806b920 0x7f2048156a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.147+0000 7f204de00640 1 -- 172.21.15.55:0/4210195610 >> 172.21.15.55:0/4210195610 conn(0x7f20480b2150 msgr2=0x7f20480b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.147+0000 7f204de00640 1 -- 172.21.15.55:0/4210195610 shutdown_connections 2024-04-02T07:27:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.147+0000 7f204de00640 1 -- 172.21.15.55:0/4210195610 wait complete. 2024-04-02T07:27:23.168 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:27:23.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.307+0000 7fa4fec00640 1 Processor -- start 2024-04-02T07:27:23.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.307+0000 7fa4fec00640 1 -- start start 2024-04-02T07:27:23.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.307+0000 7fa4fec00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4f815ca60 0x7fa4f80cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:23.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.307+0000 7fa4fec00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa4f8098a10 0x7fa4f8098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:23.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.307+0000 7fa4fec00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4f80993b0 con 0x7fa4f806b920 2024-04-02T07:27:23.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.307+0000 7fa4fec00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f806c460 con 0x7fa4f8098a10 2024-04-02T07:27:23.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.307+0000 7fa4fec00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f815ce40 con 0x7fa4f815ca60 2024-04-02T07:27:23.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.311+0000 7fa4efe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa4f8098a10 0x7fa4f8098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:23.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.311+0000 7fa4efe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa4f8098a10 0x7fa4f8098e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37772/0 (socket says 172.21.15.55:37772) 2024-04-02T07:27:23.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.311+0000 7fa4efe00640 1 -- 172.21.15.55:0/3728885505 learned_addr learned my addr 172.21.15.55:0/3728885505 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:23.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.311+0000 7fa4f7e00640 1 --2- 172.21.15.55:0/3728885505 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4f815ca60 0x7fa4f80cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:23.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.311+0000 7fa4efe00640 1 -- 172.21.15.55:0/3728885505 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4f815ca60 msgr2=0x7fa4f80cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:23.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.311+0000 7fa4efe00640 1 --2- 172.21.15.55:0/3728885505 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4f815ca60 0x7fa4f80cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.311+0000 7fa4efe00640 1 -- 172.21.15.55:0/3728885505 >> v1:172.21.15.106:6789/0 conn(0x7fa4f806b920 legacy=0x7fa4f806bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:23.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.311+0000 7fa4efe00640 1 -- 172.21.15.55:0/3728885505 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f80d01b0 con 0x7fa4f8098a10 2024-04-02T07:27:23.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.311+0000 7fa4efe00640 1 --2- 172.21.15.55:0/3728885505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4f8098a10 0x7fa4f8098e70 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009870 tx=0x7fa4e001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f65c04444cd5538 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:23.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.311+0000 7fa4f7400640 1 -- 172.21.15.55:0/3728885505 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e00a6040 con 0x7fa4f8098a10 2024-04-02T07:27:23.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.311+0000 7fa4f7400640 1 -- 172.21.15.55:0/3728885505 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e00aa600 con 0x7fa4f8098a10 2024-04-02T07:27:23.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.311+0000 7fa4f7400640 1 -- 172.21.15.55:0/3728885505 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e00aa990 con 0x7fa4f8098a10 2024-04-02T07:27:23.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4fec00640 1 -- 172.21.15.55:0/3728885505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4f8098a10 msgr2=0x7fa4f8098e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:23.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4fec00640 1 --2- 172.21.15.55:0/3728885505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4f8098a10 0x7fa4f8098e70 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009870 tx=0x7fa4e001c4a0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4fec00640 1 -- 172.21.15.55:0/3728885505 shutdown_connections 2024-04-02T07:27:23.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4fec00640 1 --2- 172.21.15.55:0/3728885505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4f8098a10 0x7fa4f8098e70 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4fec00640 1 --2- 172.21.15.55:0/3728885505 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4f815ca60 0x7fa4f80cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4fec00640 1 -- 172.21.15.55:0/3728885505 >> 172.21.15.55:0/3728885505 conn(0x7fa4f80b2150 msgr2=0x7fa4f80b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:23.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4fec00640 1 -- 172.21.15.55:0/3728885505 shutdown_connections 2024-04-02T07:27:23.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4fec00640 1 -- 172.21.15.55:0/3728885505 wait complete. 2024-04-02T07:27:23.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4fec00640 1 Processor -- start 2024-04-02T07:27:23.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4fec00640 1 -- start start 2024-04-02T07:27:23.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4fec00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4f806b920 0x7fa4f81555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:23.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4fec00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4f8098a10 0x7fa4f80c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:23.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4fec00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4f815ca60 0x7fa4f81574c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:23.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4fec00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80ad960 con 0x7fa4f8098a10 2024-04-02T07:27:23.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4fec00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80ca240 con 0x7fa4f806b920 2024-04-02T07:27:23.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4fec00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80ca520 con 0x7fa4f815ca60 2024-04-02T07:27:23.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4efe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4f8098a10 0x7fa4f80c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:23.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4efe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4f8098a10 0x7fa4f80c9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37782/0 (socket says 172.21.15.55:37782) 2024-04-02T07:27:23.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4efe00640 1 -- 172.21.15.55:0/2361876293 learned_addr learned my addr 172.21.15.55:0/2361876293 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:23.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4f7e00640 1 --2- 172.21.15.55:0/2361876293 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4f806b920 0x7fa4f81555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:23.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4fcc00640 1 --2- 172.21.15.55:0/2361876293 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4f815ca60 0x7fa4f81574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:23.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4efe00640 1 -- 172.21.15.55:0/2361876293 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4f815ca60 msgr2=0x7fa4f81574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:23.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4efe00640 1 --2- 172.21.15.55:0/2361876293 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4f815ca60 0x7fa4f81574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4efe00640 1 -- 172.21.15.55:0/2361876293 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4f806b920 msgr2=0x7fa4f81555a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:23.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4efe00640 1 --2- 172.21.15.55:0/2361876293 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4f806b920 0x7fa4f81555a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4efe00640 1 -- 172.21.15.55:0/2361876293 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e00094d0 con 0x7fa4f8098a10 2024-04-02T07:27:23.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.315+0000 7fa4efe00640 1 --2- 172.21.15.55:0/2361876293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4f8098a10 0x7fa4f80c9840 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa4e001ab50 tx=0x7fa4e001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:23.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.319+0000 7fa4f4c00640 1 -- 172.21.15.55:0/2361876293 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e00b3800 con 0x7fa4f8098a10 2024-04-02T07:27:23.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.319+0000 7fa4f4c00640 1 -- 172.21.15.55:0/2361876293 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e00b3960 con 0x7fa4f8098a10 2024-04-02T07:27:23.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.319+0000 7fa4fec00640 1 -- 172.21.15.55:0/2361876293 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4f80ad310 con 0x7fa4f8098a10 2024-04-02T07:27:23.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.319+0000 7fa4f4c00640 1 -- 172.21.15.55:0/2361876293 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e00b3d10 con 0x7fa4f8098a10 2024-04-02T07:27:23.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.319+0000 7fa4fec00640 1 -- 172.21.15.55:0/2361876293 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f8155ae0 con 0x7fa4f8098a10 2024-04-02T07:27:23.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.319+0000 7fa4fec00640 1 -- 172.21.15.55:0/2361876293 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f80adb10 con 0x7fa4f8098a10 2024-04-02T07:27:23.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.319+0000 7fa4f4c00640 1 -- 172.21.15.55:0/2361876293 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa4e00c6430 con 0x7fa4f8098a10 2024-04-02T07:27:23.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.319+0000 7fa4f4c00640 1 --2- 172.21.15.55:0/2361876293 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4d4066690 0x7fa4d4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:23.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.319+0000 7fa4f4c00640 1 -- 172.21.15.55:0/2361876293 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fa4e011ed10 con 0x7fa4f8098a10 2024-04-02T07:27:23.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.319+0000 7fa4f7e00640 1 --2- 172.21.15.55:0/2361876293 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4d4066690 0x7fa4d4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:23.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.323+0000 7fa4f7e00640 1 --2- 172.21.15.55:0/2361876293 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4d4066690 0x7fa4d4068b50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8007a60 tx=0x7fa4e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:23.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.323+0000 7fa4f4c00640 1 -- 172.21.15.55:0/2361876293 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa4f80adb10 con 0x7fa4f8098a10 2024-04-02T07:27:23.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.483+0000 7fa4fec00640 1 -- 172.21.15.55:0/2361876293 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa4f8066c90 con 0x7fa4f8098a10 2024-04-02T07:27:23.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.483+0000 7fa4f4c00640 1 -- 172.21.15.55:0/2361876293 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa4e00ec090 con 0x7fa4f8098a10 2024-04-02T07:27:23.487 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:27:23.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.487+0000 7fa4fec00640 1 -- 172.21.15.55:0/2361876293 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4d4066690 msgr2=0x7fa4d4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:23.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.487+0000 7fa4fec00640 1 --2- 172.21.15.55:0/2361876293 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4d4066690 0x7fa4d4068b50 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8007a60 tx=0x7fa4e8008040 comp rx=0 tx=0).stop 2024-04-02T07:27:23.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.487+0000 7fa4fec00640 1 -- 172.21.15.55:0/2361876293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4f8098a10 msgr2=0x7fa4f80c9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:23.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.487+0000 7fa4fec00640 1 --2- 172.21.15.55:0/2361876293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4f8098a10 0x7fa4f80c9840 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fa4e001ab50 tx=0x7fa4e001ace0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.487+0000 7fa4fec00640 1 -- 172.21.15.55:0/2361876293 shutdown_connections 2024-04-02T07:27:23.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.487+0000 7fa4fec00640 1 --2- 172.21.15.55:0/2361876293 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4f815ca60 0x7fa4f81574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.487+0000 7fa4fec00640 1 --2- 172.21.15.55:0/2361876293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4f8098a10 0x7fa4f80c9840 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.487+0000 7fa4fec00640 1 --2- 172.21.15.55:0/2361876293 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4d4066690 0x7fa4d4068b50 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.487+0000 7fa4fec00640 1 --2- 172.21.15.55:0/2361876293 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4f806b920 0x7fa4f81555a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.487+0000 7fa4fec00640 1 -- 172.21.15.55:0/2361876293 >> 172.21.15.55:0/2361876293 conn(0x7fa4f80b2150 msgr2=0x7fa4f8159150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:23.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.487+0000 7fa4fec00640 1 -- 172.21.15.55:0/2361876293 shutdown_connections 2024-04-02T07:27:23.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.487+0000 7fa4fec00640 1 -- 172.21.15.55:0/2361876293 wait complete. 2024-04-02T07:27:23.509 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:27:23.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.647+0000 7fa5a5200640 1 Processor -- start 2024-04-02T07:27:23.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.647+0000 7fa5a5200640 1 -- start start 2024-04-02T07:27:23.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.651+0000 7fa5a5200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5a0160230 0x7fa5a00b1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:23.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.651+0000 7fa5a5200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa5a006bac0 0x7fa5a00cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:23.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.651+0000 7fa5a5200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa5a00cb1f0 0x7fa5a00cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:23.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.651+0000 7fa5a5200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a0160610 con 0x7fa5a00cb1f0 2024-04-02T07:27:23.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.651+0000 7fa5a5200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a00ce990 con 0x7fa5a006bac0 2024-04-02T07:27:23.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.651+0000 7fa5a5200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a00cf4f0 con 0x7fa5a0160230 2024-04-02T07:27:23.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.651+0000 7fa59e800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa5a00cb1f0 0x7fa5a00cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:23.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.651+0000 7fa59e800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa5a00cb1f0 0x7fa5a00cf980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37786/0 (socket says 172.21.15.55:37786) 2024-04-02T07:27:23.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.651+0000 7fa59e800640 1 -- 172.21.15.55:0/4073016294 learned_addr learned my addr 172.21.15.55:0/4073016294 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:23.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.651+0000 7fa59de00640 1 --2- 172.21.15.55:0/4073016294 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5a0160230 0x7fa5a00b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:23.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.651+0000 7fa595400640 1 --2- 172.21.15.55:0/4073016294 >> v2:172.21.15.106:3300/0 conn(0x7fa5a006bac0 0x7fa5a00cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:23.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.651+0000 7fa59e800640 1 -- 172.21.15.55:0/4073016294 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5a0160230 msgr2=0x7fa5a00b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:23.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.651+0000 7fa59e800640 1 --2- 172.21.15.55:0/4073016294 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5a0160230 0x7fa5a00b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.651+0000 7fa59e800640 1 -- 172.21.15.55:0/4073016294 >> v2:172.21.15.106:3300/0 conn(0x7fa5a006bac0 msgr2=0x7fa5a00cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.651+0000 7fa59e800640 1 --2- 172.21.15.55:0/4073016294 >> v2:172.21.15.106:3300/0 conn(0x7fa5a006bac0 0x7fa5a00cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.651+0000 7fa59e800640 1 -- 172.21.15.55:0/4073016294 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a00cebc0 con 0x7fa5a00cb1f0 2024-04-02T07:27:23.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.651+0000 7fa595400640 1 --2- 172.21.15.55:0/4073016294 >> v2:172.21.15.106:3300/0 conn(0x7fa5a006bac0 0x7fa5a00cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:23.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa59e800640 1 --2- 172.21.15.55:0/4073016294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a00cb1f0 0x7fa5a00cf980 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0071ae0 tx=0x7fa59801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cafef579259902 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:23.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa59d400640 1 -- 172.21.15.55:0/4073016294 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5980a56c0 con 0x7fa5a00cb1f0 2024-04-02T07:27:23.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa59d400640 1 -- 172.21.15.55:0/4073016294 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5980a5820 con 0x7fa5a00cb1f0 2024-04-02T07:27:23.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa59d400640 1 -- 172.21.15.55:0/4073016294 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5980a5bb0 con 0x7fa5a00cb1f0 2024-04-02T07:27:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa5a5200640 1 -- 172.21.15.55:0/4073016294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a00cb1f0 msgr2=0x7fa5a00cf980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa5a5200640 1 --2- 172.21.15.55:0/4073016294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a00cb1f0 0x7fa5a00cf980 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fa5a0071ae0 tx=0x7fa59801c930 comp rx=0 tx=0).stop 2024-04-02T07:27:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa5a5200640 1 -- 172.21.15.55:0/4073016294 shutdown_connections 2024-04-02T07:27:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa5a5200640 1 --2- 172.21.15.55:0/4073016294 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a00cb1f0 0x7fa5a00cf980 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa5a5200640 1 --2- 172.21.15.55:0/4073016294 >> v2:172.21.15.106:3300/0 conn(0x7fa5a006bac0 0x7fa5a00cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa5a5200640 1 --2- 172.21.15.55:0/4073016294 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5a0160230 0x7fa5a00b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa5a5200640 1 -- 172.21.15.55:0/4073016294 >> 172.21.15.55:0/4073016294 conn(0x7fa5a00b2150 msgr2=0x7fa5a00b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa5a5200640 1 -- 172.21.15.55:0/4073016294 shutdown_connections 2024-04-02T07:27:23.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa5a5200640 1 -- 172.21.15.55:0/4073016294 wait complete. 2024-04-02T07:27:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa5a5200640 1 Processor -- start 2024-04-02T07:27:23.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa5a5200640 1 -- start start 2024-04-02T07:27:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa5a5200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5a006bac0 0x7fa5a00c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa5a5200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5a00cb1f0 0x7fa5a0151c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa5a5200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a0160230 0x7fa5a0157570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:23.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa5a5200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a0152140 con 0x7fa5a0160230 2024-04-02T07:27:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa5a5200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a00c8920 con 0x7fa5a00cb1f0 2024-04-02T07:27:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.655+0000 7fa5a5200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a0157ab0 con 0x7fa5a006bac0 2024-04-02T07:27:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.659+0000 7fa59e800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a0160230 0x7fa5a0157570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.659+0000 7fa59e800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a0160230 0x7fa5a0157570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37802/0 (socket says 172.21.15.55:37802) 2024-04-02T07:27:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.659+0000 7fa59e800640 1 -- 172.21.15.55:0/3864204298 learned_addr learned my addr 172.21.15.55:0/3864204298 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.659+0000 7fa595400640 1 --2- 172.21.15.55:0/3864204298 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5a00cb1f0 0x7fa5a0151c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:23.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.659+0000 7fa59de00640 1 --2- 172.21.15.55:0/3864204298 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5a006bac0 0x7fa5a00c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:23.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.659+0000 7fa59e800640 1 -- 172.21.15.55:0/3864204298 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5a006bac0 msgr2=0x7fa5a00c7730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:23.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.659+0000 7fa59e800640 1 --2- 172.21.15.55:0/3864204298 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5a006bac0 0x7fa5a00c7730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.659+0000 7fa59e800640 1 -- 172.21.15.55:0/3864204298 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5a00cb1f0 msgr2=0x7fa5a0151c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:23.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.659+0000 7fa59e800640 1 --2- 172.21.15.55:0/3864204298 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5a00cb1f0 0x7fa5a0151c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.659+0000 7fa59e800640 1 -- 172.21.15.55:0/3864204298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa598009b30 con 0x7fa5a0160230 2024-04-02T07:27:23.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.659+0000 7fa59e800640 1 --2- 172.21.15.55:0/3864204298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a0160230 0x7fa5a0157570 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fa59801afe0 tx=0x7fa5980196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:23.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.659+0000 7fa596a00640 1 -- 172.21.15.55:0/3864204298 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5980b8670 con 0x7fa5a0160230 2024-04-02T07:27:23.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.659+0000 7fa596a00640 1 -- 172.21.15.55:0/3864204298 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5980b87d0 con 0x7fa5a0160230 2024-04-02T07:27:23.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.659+0000 7fa5a5200640 1 -- 172.21.15.55:0/3864204298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a00c7d10 con 0x7fa5a0160230 2024-04-02T07:27:23.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.659+0000 7fa596a00640 1 -- 172.21.15.55:0/3864204298 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5980b8b80 con 0x7fa5a0160230 2024-04-02T07:27:23.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.659+0000 7fa5a5200640 1 -- 172.21.15.55:0/3864204298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a00c82d0 con 0x7fa5a0160230 2024-04-02T07:27:23.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.659+0000 7fa5a5200640 1 -- 172.21.15.55:0/3864204298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a0066c90 con 0x7fa5a0160230 2024-04-02T07:27:23.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.659+0000 7fa596a00640 1 -- 172.21.15.55:0/3864204298 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa5980b8ce0 con 0x7fa5a0160230 2024-04-02T07:27:23.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.659+0000 7fa596a00640 1 --2- 172.21.15.55:0/3864204298 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa57c066690 0x7fa57c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:23.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.663+0000 7fa596a00640 1 -- 172.21.15.55:0/3864204298 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fa59811f7a0 con 0x7fa5a0160230 2024-04-02T07:27:23.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.663+0000 7fa59de00640 1 --2- 172.21.15.55:0/3864204298 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa57c066690 0x7fa57c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:23.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.663+0000 7fa59de00640 1 --2- 172.21.15.55:0/3864204298 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa57c066690 0x7fa57c068b50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa590009ac0 tx=0x7fa590009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:23.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.663+0000 7fa596a00640 1 -- 172.21.15.55:0/3864204298 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa5980ecbb0 con 0x7fa5a0160230 2024-04-02T07:27:23.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.835+0000 7fa5a5200640 1 -- 172.21.15.55:0/3864204298 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa5a00c6ee0 con 0x7fa5a0160230 2024-04-02T07:27:23.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.835+0000 7fa596a00640 1 -- 172.21.15.55:0/3864204298 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v75) v1 ==== 80+0+122 (secure 0 0 0) 0x7fa5980bc090 con 0x7fa5a0160230 2024-04-02T07:27:23.839 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6833/1576619269 2024-04-03T07:27:14.356430+0000 2024-04-02T07:27:23.840 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6832/1576619269 2024-04-03T07:27:14.356430+0000 2024-04-02T07:27:23.840 INFO:teuthology.orchestra.run.smithi055.stderr:listed 2 entries 2024-04-02T07:27:23.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.839+0000 7fa5a5200640 1 -- 172.21.15.55:0/3864204298 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa57c066690 msgr2=0x7fa57c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:23.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.839+0000 7fa5a5200640 1 --2- 172.21.15.55:0/3864204298 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa57c066690 0x7fa57c068b50 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fa590009ac0 tx=0x7fa590009190 comp rx=0 tx=0).stop 2024-04-02T07:27:23.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.839+0000 7fa5a5200640 1 -- 172.21.15.55:0/3864204298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a0160230 msgr2=0x7fa5a0157570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:23.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.839+0000 7fa5a5200640 1 --2- 172.21.15.55:0/3864204298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a0160230 0x7fa5a0157570 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fa59801afe0 tx=0x7fa5980196d0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.839+0000 7fa5a5200640 1 -- 172.21.15.55:0/3864204298 shutdown_connections 2024-04-02T07:27:23.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.839+0000 7fa5a5200640 1 --2- 172.21.15.55:0/3864204298 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa5a0160230 0x7fa5a0157570 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.839+0000 7fa5a5200640 1 --2- 172.21.15.55:0/3864204298 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa57c066690 0x7fa57c068b50 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.839+0000 7fa5a5200640 1 --2- 172.21.15.55:0/3864204298 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa5a00cb1f0 0x7fa5a0151c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.839+0000 7fa5a5200640 1 --2- 172.21.15.55:0/3864204298 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5a006bac0 0x7fa5a00c7730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:23.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.839+0000 7fa5a5200640 1 -- 172.21.15.55:0/3864204298 >> 172.21.15.55:0/3864204298 conn(0x7fa5a00b2150 msgr2=0x7fa5a006f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:23.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.839+0000 7fa5a5200640 1 -- 172.21.15.55:0/3864204298 shutdown_connections 2024-04-02T07:27:23.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:23.839+0000 7fa5a5200640 1 -- 172.21.15.55:0/3864204298 wait complete. 2024-04-02T07:27:23.860 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:27:23.860 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:27:23.870 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:27:24.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.047+0000 7f7e30c00640 1 Processor -- start 2024-04-02T07:27:24.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.047+0000 7f7e30c00640 1 -- start start 2024-04-02T07:27:24.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.051+0000 7f7e30c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e2c0c9790 0x7f7e2c0c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:24.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.051+0000 7f7e30c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e2c0ca4f0 0x7f7e2c0ca980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:24.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.051+0000 7f7e30c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2c0b1710 con 0x7f7e2c145680 2024-04-02T07:27:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.051+0000 7f7e30c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2c0caec0 con 0x7f7e2c0c9790 2024-04-02T07:27:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.051+0000 7f7e30c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c0b1960 con 0x7f7e2c0ca4f0 2024-04-02T07:27:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.051+0000 7f7e21400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e2c0c9790 0x7f7e2c0c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.051+0000 7f7e21400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e2c0c9790 0x7f7e2c0c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37814/0 (socket says 172.21.15.55:37814) 2024-04-02T07:27:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.051+0000 7f7e21400640 1 -- 172.21.15.55:0/3728276410 learned_addr learned my addr 172.21.15.55:0/3728276410 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.051+0000 7f7e29e00640 1 --1- 172.21.15.55:0/3728276410 >> v1:172.21.15.55:6789/0 conn(0x7f7e2c145680 0x7f7e2c0cb630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53026/0 (socket says 172.21.15.55:53026) 2024-04-02T07:27:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.051+0000 7f7e2a800640 1 --2- 172.21.15.55:0/3728276410 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e2c0ca4f0 0x7f7e2c0ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.051+0000 7f7e21400640 1 -- 172.21.15.55:0/3728276410 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e2c0ca4f0 msgr2=0x7f7e2c0ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.051+0000 7f7e21400640 1 --2- 172.21.15.55:0/3728276410 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e2c0ca4f0 0x7f7e2c0ca980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.051+0000 7f7e21400640 1 -- 172.21.15.55:0/3728276410 >> v1:172.21.15.55:6789/0 conn(0x7f7e2c145680 legacy=0x7f7e2c0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.051+0000 7f7e21400640 1 -- 172.21.15.55:0/3728276410 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e2c0b1c40 con 0x7f7e2c0c9790 2024-04-02T07:27:24.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.051+0000 7f7e29400640 1 -- 172.21.15.55:0/3728276410 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435696625 0 0) 0x7f7e2c0b1710 con 0x7f7e2c145680 2024-04-02T07:27:24.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.051+0000 7f7e21400640 1 --2- 172.21.15.55:0/3728276410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e2c0c9790 0x7f7e2c0c9c20 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f7e14009870 tx=0x7f7e1401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3fa9bb28447ff4 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:24.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.051+0000 7f7e29400640 1 -- 172.21.15.55:0/3728276410 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e140a6040 con 0x7f7e2c0c9790 2024-04-02T07:27:24.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e29400640 1 -- 172.21.15.55:0/3728276410 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e140aa600 con 0x7f7e2c0c9790 2024-04-02T07:27:24.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e29400640 1 -- 172.21.15.55:0/3728276410 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e140aa990 con 0x7f7e2c0c9790 2024-04-02T07:27:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e30c00640 1 -- 172.21.15.55:0/3728276410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e2c0c9790 msgr2=0x7f7e2c0c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e30c00640 1 --2- 172.21.15.55:0/3728276410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e2c0c9790 0x7f7e2c0c9c20 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f7e14009870 tx=0x7f7e1401c4a0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e30c00640 1 -- 172.21.15.55:0/3728276410 shutdown_connections 2024-04-02T07:27:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e30c00640 1 --2- 172.21.15.55:0/3728276410 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e2c0ca4f0 0x7f7e2c0ca980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e30c00640 1 --2- 172.21.15.55:0/3728276410 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e2c0c9790 0x7f7e2c0c9c20 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e30c00640 1 -- 172.21.15.55:0/3728276410 >> 172.21.15.55:0/3728276410 conn(0x7f7e2c06a640 msgr2=0x7f7e2c06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:24.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e30c00640 1 -- 172.21.15.55:0/3728276410 shutdown_connections 2024-04-02T07:27:24.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e30c00640 1 -- 172.21.15.55:0/3728276410 wait complete. 2024-04-02T07:27:24.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e30c00640 1 Processor -- start 2024-04-02T07:27:24.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e30c00640 1 -- start start 2024-04-02T07:27:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e30c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e2c0c9790 0x7f7e2c13e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e30c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e2c0ca4f0 0x7f7e2c141f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e30c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e2c145680 0x7f7e2c167070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:24.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e30c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c1675b0 con 0x7f7e2c145680 2024-04-02T07:27:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e30c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c13d4c0 con 0x7f7e2c0c9790 2024-04-02T07:27:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e30c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2c13e040 con 0x7f7e2c0ca4f0 2024-04-02T07:27:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e2a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e2c145680 0x7f7e2c167070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e2a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e2c145680 0x7f7e2c167070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37820/0 (socket says 172.21.15.55:37820) 2024-04-02T07:27:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e2a800640 1 -- 172.21.15.55:0/4018914947 learned_addr learned my addr 172.21.15.55:0/4018914947 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e21400640 1 --2- 172.21.15.55:0/4018914947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e2c0ca4f0 0x7f7e2c141f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e29e00640 1 --2- 172.21.15.55:0/4018914947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e2c0c9790 0x7f7e2c13e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e2a800640 1 -- 172.21.15.55:0/4018914947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e2c0ca4f0 msgr2=0x7f7e2c141f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e2a800640 1 --2- 172.21.15.55:0/4018914947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e2c0ca4f0 0x7f7e2c141f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e2a800640 1 -- 172.21.15.55:0/4018914947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e2c0c9790 msgr2=0x7f7e2c13e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e2a800640 1 --2- 172.21.15.55:0/4018914947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e2c0c9790 0x7f7e2c13e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.055+0000 7f7e2a800640 1 -- 172.21.15.55:0/4018914947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e140094d0 con 0x7f7e2c145680 2024-04-02T07:27:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.059+0000 7f7e2a800640 1 --2- 172.21.15.55:0/4018914947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e2c145680 0x7f7e2c167070 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400e820 tx=0x7f7e2400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:24.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.059+0000 7f7e22a00640 1 -- 172.21.15.55:0/4018914947 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e24009530 con 0x7f7e2c145680 2024-04-02T07:27:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.059+0000 7f7e22a00640 1 -- 172.21.15.55:0/4018914947 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e2400eed0 con 0x7f7e2c145680 2024-04-02T07:27:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.059+0000 7f7e22a00640 1 -- 172.21.15.55:0/4018914947 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e2400cb60 con 0x7f7e2c145680 2024-04-02T07:27:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.059+0000 7f7e30c00640 1 -- 172.21.15.55:0/4018914947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2c13d710 con 0x7f7e2c145680 2024-04-02T07:27:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.059+0000 7f7e30c00640 1 -- 172.21.15.55:0/4018914947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2c13dcd0 con 0x7f7e2c145680 2024-04-02T07:27:24.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.059+0000 7f7e30c00640 1 -- 172.21.15.55:0/4018914947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e2c13e1d0 con 0x7f7e2c145680 2024-04-02T07:27:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.059+0000 7f7e22a00640 1 -- 172.21.15.55:0/4018914947 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7e2400cce0 con 0x7f7e2c145680 2024-04-02T07:27:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.059+0000 7f7e22a00640 1 --2- 172.21.15.55:0/4018914947 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e08066690 0x7f7e08068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.059+0000 7f7e22a00640 1 -- 172.21.15.55:0/4018914947 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f7e24084210 con 0x7f7e2c145680 2024-04-02T07:27:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.059+0000 7f7e29e00640 1 --2- 172.21.15.55:0/4018914947 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e08066690 0x7f7e08068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:24.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.063+0000 7f7e29e00640 1 --2- 172.21.15.55:0/4018914947 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e08066690 0x7f7e08068b50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c004fd0 tx=0x7f7e1c001770 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:24.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.063+0000 7f7e22a00640 1 -- 172.21.15.55:0/4018914947 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7e240515a0 con 0x7f7e2c145680 2024-04-02T07:27:24.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.231+0000 7f7e30c00640 1 -- 172.21.15.55:0/4018914947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e2c066c90 con 0x7f7e2c145680 2024-04-02T07:27:24.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.231+0000 7f7e22a00640 1 -- 172.21.15.55:0/4018914947 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16327 (secure 0 0 0) 0x7f7e24054bc0 con 0x7f7e2c145680 2024-04-02T07:27:24.234 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:27:24.235 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":75,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:27:14.356458+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:26:53.196912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-02T07:26:54.514963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.2e","mappings":[{"from":6,"to":0}]},{"pgid":"11.3c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6833/1576619269":"2024-04-03T07:27:14.356430+0000","172.21.15.55:6832/1576619269":"2024-04-03T07:27:14.356430+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:27:24.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.235+0000 7f7e30c00640 1 -- 172.21.15.55:0/4018914947 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e08066690 msgr2=0x7f7e08068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:24.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.235+0000 7f7e30c00640 1 --2- 172.21.15.55:0/4018914947 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e08066690 0x7f7e08068b50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c004fd0 tx=0x7f7e1c001770 comp rx=0 tx=0).stop 2024-04-02T07:27:24.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.235+0000 7f7e30c00640 1 -- 172.21.15.55:0/4018914947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e2c145680 msgr2=0x7f7e2c167070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:24.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.235+0000 7f7e30c00640 1 --2- 172.21.15.55:0/4018914947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e2c145680 0x7f7e2c167070 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f7e2400e820 tx=0x7f7e2400ece0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.235+0000 7f7e30c00640 1 -- 172.21.15.55:0/4018914947 shutdown_connections 2024-04-02T07:27:24.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.235+0000 7f7e30c00640 1 --2- 172.21.15.55:0/4018914947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e2c145680 0x7f7e2c167070 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.235+0000 7f7e30c00640 1 --2- 172.21.15.55:0/4018914947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e2c0ca4f0 0x7f7e2c141f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.235+0000 7f7e30c00640 1 --2- 172.21.15.55:0/4018914947 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e08066690 0x7f7e08068b50 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.235+0000 7f7e30c00640 1 --2- 172.21.15.55:0/4018914947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e2c0c9790 0x7f7e2c13e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.235+0000 7f7e30c00640 1 -- 172.21.15.55:0/4018914947 >> 172.21.15.55:0/4018914947 conn(0x7f7e2c06a640 msgr2=0x7f7e2c0b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:24.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.235+0000 7f7e30c00640 1 -- 172.21.15.55:0/4018914947 shutdown_connections 2024-04-02T07:27:24.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.235+0000 7f7e30c00640 1 -- 172.21.15.55:0/4018914947 wait complete. 2024-04-02T07:27:24.256 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:26:53.196912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:26:54.514963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:27:24.256 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:27:24.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.395+0000 7f2fdb600640 1 Processor -- start 2024-04-02T07:27:24.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.395+0000 7f2fdb600640 1 -- start start 2024-04-02T07:27:24.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.399+0000 7f2fdb600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2fd406a4a0 0x7f2fd406ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:24.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.399+0000 7f2fdb600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd415de90 con 0x7f2fd4157000 2024-04-02T07:27:24.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.399+0000 7f2fdb600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd415d280 con 0x7f2fd4072130 2024-04-02T07:27:24.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.399+0000 7f2fdb600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd415d070 con 0x7f2fd406a4a0 2024-04-02T07:27:24.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.399+0000 7f2fd9600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2fd406a4a0 0x7f2fd406ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:24.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.399+0000 7f2fd9600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2fd406a4a0 0x7f2fd406ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37830/0 (socket says 172.21.15.55:37830) 2024-04-02T07:27:24.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.399+0000 7f2fd9600640 1 -- 172.21.15.55:0/3378656408 learned_addr learned my addr 172.21.15.55:0/3378656408 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:24.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.399+0000 7f2fd9600640 1 -- 172.21.15.55:0/3378656408 >> v1:172.21.15.106:6789/0 conn(0x7f2fd4072130 legacy=0x7f2fd4069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:24.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.399+0000 7f2fd9600640 1 -- 172.21.15.55:0/3378656408 >> v1:172.21.15.55:6789/0 conn(0x7f2fd4157000 legacy=0x7f2fd4071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:24.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.399+0000 7f2fd9600640 1 -- 172.21.15.55:0/3378656408 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd415d560 con 0x7f2fd406a4a0 2024-04-02T07:27:24.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.399+0000 7f2fd3e00640 1 -- 172.21.15.55:0/3378656408 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850062086 0 0) 0x7f2fd415de90 con 0x7f2fd4157000 2024-04-02T07:27:24.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.403+0000 7f2fd9600640 1 --2- 172.21.15.55:0/3378656408 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd406a4a0 0x7f2fd406ec30 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009e50 tx=0x7f2fcc01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21041c4ba5ab757d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:24.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.403+0000 7f2fd3e00640 1 -- 172.21.15.55:0/3378656408 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc0a58d0 con 0x7f2fd406a4a0 2024-04-02T07:27:24.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.403+0000 7f2fd3e00640 1 -- 172.21.15.55:0/3378656408 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc0a5a30 con 0x7f2fd406a4a0 2024-04-02T07:27:24.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.403+0000 7f2fd3e00640 1 -- 172.21.15.55:0/3378656408 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc0a5dc0 con 0x7f2fd406a4a0 2024-04-02T07:27:24.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.403+0000 7f2fdb600640 1 -- 172.21.15.55:0/3378656408 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd406a4a0 msgr2=0x7f2fd406ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:24.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.403+0000 7f2fdb600640 1 --2- 172.21.15.55:0/3378656408 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd406a4a0 0x7f2fd406ec30 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009e50 tx=0x7f2fcc01ca00 comp rx=0 tx=0).stop 2024-04-02T07:27:24.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.403+0000 7f2fdb600640 1 -- 172.21.15.55:0/3378656408 shutdown_connections 2024-04-02T07:27:24.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.403+0000 7f2fdb600640 1 --2- 172.21.15.55:0/3378656408 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd406a4a0 0x7f2fd406ec30 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.403+0000 7f2fdb600640 1 -- 172.21.15.55:0/3378656408 >> 172.21.15.55:0/3378656408 conn(0x7f2fd40b13b0 msgr2=0x7f2fd40b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:24.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.403+0000 7f2fdb600640 1 -- 172.21.15.55:0/3378656408 shutdown_connections 2024-04-02T07:27:24.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.403+0000 7f2fdb600640 1 -- 172.21.15.55:0/3378656408 wait complete. 2024-04-02T07:27:24.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.403+0000 7f2fdb600640 1 Processor -- start 2024-04-02T07:27:24.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.403+0000 7f2fdb600640 1 -- start start 2024-04-02T07:27:24.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fdb600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2fd406a4a0 0x7f2fd40ccf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:24.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fdb600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd4072130 0x7f2fd414ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:24.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fdb600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fd4157000 0x7f2fd4151ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:24.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fdb600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd40cd4b0 con 0x7f2fd4072130 2024-04-02T07:27:24.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fdb600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd414dd70 con 0x7f2fd4157000 2024-04-02T07:27:24.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fdb600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd40ce4c0 con 0x7f2fd406a4a0 2024-04-02T07:27:24.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fcbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd4072130 0x7f2fd414ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:24.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fcbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd4072130 0x7f2fd414ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37840/0 (socket says 172.21.15.55:37840) 2024-04-02T07:27:24.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fcbe00640 1 -- 172.21.15.55:0/2667052279 learned_addr learned my addr 172.21.15.55:0/2667052279 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:24.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fd8c00640 1 --2- 172.21.15.55:0/2667052279 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2fd406a4a0 0x7f2fd40ccf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:24.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fd9600640 1 --2- 172.21.15.55:0/2667052279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fd4157000 0x7f2fd4151ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:24.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fcbe00640 1 -- 172.21.15.55:0/2667052279 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2fd406a4a0 msgr2=0x7f2fd40ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:24.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fcbe00640 1 --2- 172.21.15.55:0/2667052279 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2fd406a4a0 0x7f2fd40ccf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fcbe00640 1 -- 172.21.15.55:0/2667052279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fd4157000 msgr2=0x7f2fd4151ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:24.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fcbe00640 1 --2- 172.21.15.55:0/2667052279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fd4157000 0x7f2fd4151ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fcbe00640 1 -- 172.21.15.55:0/2667052279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fcc009b30 con 0x7f2fd4072130 2024-04-02T07:27:24.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fcbe00640 1 --2- 172.21.15.55:0/2667052279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd4072130 0x7f2fd414ac90 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00c3c0 tx=0x7f2fbc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:24.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fd1600640 1 -- 172.21.15.55:0/2667052279 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc0052d0 con 0x7f2fd4072130 2024-04-02T07:27:24.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fd1600640 1 -- 172.21.15.55:0/2667052279 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fbc005430 con 0x7f2fd4072130 2024-04-02T07:27:24.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fdb600640 1 -- 172.21.15.55:0/2667052279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd4155d80 con 0x7f2fd4072130 2024-04-02T07:27:24.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fd1600640 1 -- 172.21.15.55:0/2667052279 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fbc003840 con 0x7f2fd4072130 2024-04-02T07:27:24.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fdb600640 1 -- 172.21.15.55:0/2667052279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd40ce1e0 con 0x7f2fd4072130 2024-04-02T07:27:24.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fdb600640 1 -- 172.21.15.55:0/2667052279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd40cdd60 con 0x7f2fd4072130 2024-04-02T07:27:24.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.407+0000 7f2fd1600640 1 -- 172.21.15.55:0/2667052279 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2fbc0039a0 con 0x7f2fd4072130 2024-04-02T07:27:24.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.411+0000 7f2fd1600640 1 --2- 172.21.15.55:0/2667052279 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2fb0066690 0x7f2fb0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:24.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.411+0000 7f2fd1600640 1 -- 172.21.15.55:0/2667052279 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f2fbc083740 con 0x7f2fd4072130 2024-04-02T07:27:24.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.411+0000 7f2fd8c00640 1 --2- 172.21.15.55:0/2667052279 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2fb0066690 0x7f2fb0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:24.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.411+0000 7f2fd8c00640 1 --2- 172.21.15.55:0/2667052279 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2fb0066690 0x7f2fb0068b50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4007fd0 tx=0x7f2fc4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:24.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.415+0000 7f2fd1600640 1 -- 172.21.15.55:0/2667052279 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2fd40cdd60 con 0x7f2fd4072130 2024-04-02T07:27:24.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.575+0000 7f2fdb600640 1 -- 172.21.15.55:0/2667052279 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2fd40cdd60 con 0x7f2fd4072130 2024-04-02T07:27:24.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.575+0000 7f2fd1600640 1 -- 172.21.15.55:0/2667052279 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2fd40cdd60 con 0x7f2fd4072130 2024-04-02T07:27:24.578 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:27:24.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.579+0000 7f2fdb600640 1 -- 172.21.15.55:0/2667052279 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2fb0066690 msgr2=0x7f2fb0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:24.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.579+0000 7f2fdb600640 1 --2- 172.21.15.55:0/2667052279 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2fb0066690 0x7f2fb0068b50 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2fc4007fd0 tx=0x7f2fc4009040 comp rx=0 tx=0).stop 2024-04-02T07:27:24.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.579+0000 7f2fdb600640 1 -- 172.21.15.55:0/2667052279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd4072130 msgr2=0x7f2fd414ac90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:24.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.579+0000 7f2fdb600640 1 --2- 172.21.15.55:0/2667052279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd4072130 0x7f2fd414ac90 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f2fbc00c3c0 tx=0x7f2fbc00c880 comp rx=0 tx=0).stop 2024-04-02T07:27:24.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.579+0000 7f2fdb600640 1 -- 172.21.15.55:0/2667052279 shutdown_connections 2024-04-02T07:27:24.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.579+0000 7f2fdb600640 1 --2- 172.21.15.55:0/2667052279 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2fb0066690 0x7f2fb0068b50 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.579+0000 7f2fdb600640 1 --2- 172.21.15.55:0/2667052279 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fd4157000 0x7f2fd4151ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.579+0000 7f2fdb600640 1 --2- 172.21.15.55:0/2667052279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd4072130 0x7f2fd414ac90 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.579+0000 7f2fdb600640 1 --2- 172.21.15.55:0/2667052279 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2fd406a4a0 0x7f2fd40ccf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.579+0000 7f2fdb600640 1 -- 172.21.15.55:0/2667052279 >> 172.21.15.55:0/2667052279 conn(0x7f2fd40b13b0 msgr2=0x7f2fd40ce830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:24.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.579+0000 7f2fdb600640 1 -- 172.21.15.55:0/2667052279 shutdown_connections 2024-04-02T07:27:24.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.579+0000 7f2fdb600640 1 -- 172.21.15.55:0/2667052279 wait complete. 2024-04-02T07:27:24.600 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:27:24.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cf4000640 1 Processor -- start 2024-04-02T07:27:24.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cf4000640 1 -- start start 2024-04-02T07:27:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cf4000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cec099120 0x7f1cec1656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cf4000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cec0afbc0 con 0x7f1cec15e230 2024-04-02T07:27:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cf4000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cec099be0 con 0x7f1cec15de50 2024-04-02T07:27:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cf4000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0cf740 con 0x7f1cec099120 2024-04-02T07:27:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cf0c00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1cec15e230 0x7f1cec098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53040/0 (socket says 172.21.15.55:53040) 2024-04-02T07:27:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cf0c00640 1 -- 172.21.15.55:0/2719875387 learned_addr learned my addr 172.21.15.55:0/2719875387 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:27:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cf2000640 1 --2- 172.21.15.55:0/2719875387 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cec099120 0x7f1cec1656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cebe00640 1 -- 172.21.15.55:0/2719875387 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3271589951 0 0) 0x7f1cec0afbc0 con 0x7f1cec15e230 2024-04-02T07:27:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cebe00640 1 -- 172.21.15.55:0/2719875387 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1cd4003530 con 0x7f1cec15e230 2024-04-02T07:27:24.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cebe00640 1 -- 172.21.15.55:0/2719875387 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1362489214 0 0) 0x7f1cd4003530 con 0x7f1cec15e230 2024-04-02T07:27:24.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cebe00640 1 -- 172.21.15.55:0/2719875387 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cec099120 msgr2=0x7f1cec1656d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:24.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cebe00640 1 --2- 172.21.15.55:0/2719875387 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cec099120 0x7f1cec1656d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cebe00640 1 -- 172.21.15.55:0/2719875387 >> v1:172.21.15.106:6789/0 conn(0x7f1cec15de50 legacy=0x7f1cec0cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:24.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cebe00640 1 -- 172.21.15.55:0/2719875387 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec0afe10 con 0x7f1cec15e230 2024-04-02T07:27:24.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cebe00640 1 -- 172.21.15.55:0/2719875387 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f1cd8001680 con 0x7f1cec15e230 2024-04-02T07:27:24.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cebe00640 1 -- 172.21.15.55:0/2719875387 >> v1:172.21.15.55:6789/0 conn(0x7f1cec15e230 legacy=0x7f1cec098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cebe00640 1 --2- 172.21.15.55:0/2719875387 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cec099120 0x7f1cd40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cebe00640 1 --2- 172.21.15.55:0/2719875387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd4003ef0 0x7f1cd40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cebe00640 1 --2- 172.21.15.55:0/2719875387 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cd4004d10 0x7f1cd4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cebe00640 1 -- 172.21.15.55:0/2719875387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0cf740 con 0x7f1cd4003ef0 2024-04-02T07:27:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cebe00640 1 -- 172.21.15.55:0/2719875387 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd400b9f0 con 0x7f1cd4004d10 2024-04-02T07:27:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cebe00640 1 -- 172.21.15.55:0/2719875387 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd400bbb0 con 0x7f1cec099120 2024-04-02T07:27:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cf0c00640 1 --2- 172.21.15.55:0/2719875387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd4003ef0 0x7f1cd40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cf1600640 1 --2- 172.21.15.55:0/2719875387 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cec099120 0x7f1cd40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cf2000640 1 --2- 172.21.15.55:0/2719875387 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cd4004d10 0x7f1cd4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cf0c00640 1 -- 172.21.15.55:0/2719875387 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cec099120 msgr2=0x7f1cd40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cf0c00640 1 --2- 172.21.15.55:0/2719875387 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cec099120 0x7f1cd40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cf0c00640 1 -- 172.21.15.55:0/2719875387 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cd4004d10 msgr2=0x7f1cd4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cf0c00640 1 --2- 172.21.15.55:0/2719875387 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cd4004d10 0x7f1cd4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.743+0000 7f1cf0c00640 1 -- 172.21.15.55:0/2719875387 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd4003530 con 0x7f1cd4003ef0 2024-04-02T07:27:24.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.747+0000 7f1cf0c00640 1 --2- 172.21.15.55:0/2719875387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd4003ef0 0x7f1cd40047d0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800c190 tx=0x7f1cd801cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e73331fb0763a2d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:24.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.747+0000 7f1cebe00640 1 -- 172.21.15.55:0/2719875387 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd8005ae0 con 0x7f1cd4003ef0 2024-04-02T07:27:24.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.747+0000 7f1cebe00640 1 -- 172.21.15.55:0/2719875387 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd8005c60 con 0x7f1cd4003ef0 2024-04-02T07:27:24.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.747+0000 7f1cebe00640 1 -- 172.21.15.55:0/2719875387 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd80a5a60 con 0x7f1cd4003ef0 2024-04-02T07:27:24.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.747+0000 7f1cf4000640 1 -- 172.21.15.55:0/2719875387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd4003ef0 msgr2=0x7f1cd40047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:24.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.747+0000 7f1cf4000640 1 --2- 172.21.15.55:0/2719875387 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd4003ef0 0x7f1cd40047d0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f1cd800c190 tx=0x7f1cd801cb20 comp rx=0 tx=0).stop 2024-04-02T07:27:24.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.747+0000 7f1cf2000640 1 -- 172.21.15.55:0/2719875387 reap_dead start 2024-04-02T07:27:24.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.747+0000 7f1cf4000640 1 -- 172.21.15.55:0/2719875387 shutdown_connections 2024-04-02T07:27:24.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.747+0000 7f1cf4000640 1 -- 172.21.15.55:0/2719875387 >> 172.21.15.55:0/2719875387 conn(0x7f1cec0b2150 msgr2=0x7f1cec0b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:24.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.747+0000 7f1cf4000640 1 -- 172.21.15.55:0/2719875387 shutdown_connections 2024-04-02T07:27:24.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.747+0000 7f1cf4000640 1 -- 172.21.15.55:0/2719875387 wait complete. 2024-04-02T07:27:24.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf4000640 1 Processor -- start 2024-04-02T07:27:24.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf4000640 1 -- start start 2024-04-02T07:27:24.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf4000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cd4003ef0 0x7f1cec1f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:24.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf4000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cec0c9360 0x7f1cec06be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:24.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf4000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cec0c97e0 0x7f1cec06c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:24.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf4000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0ca300 con 0x7f1cec0c97e0 2024-04-02T07:27:24.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf4000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0b33b0 con 0x7f1cec0c9360 2024-04-02T07:27:24.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf4000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cec0c9d40 con 0x7f1cd4003ef0 2024-04-02T07:27:24.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf2000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cec0c97e0 0x7f1cec06c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:24.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf2000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cec0c97e0 0x7f1cec06c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37870/0 (socket says 172.21.15.55:37870) 2024-04-02T07:27:24.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf2000640 1 -- 172.21.15.55:0/3464460307 learned_addr learned my addr 172.21.15.55:0/3464460307 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:24.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf1600640 1 --2- 172.21.15.55:0/3464460307 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cd4003ef0 0x7f1cec1f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:24.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf0c00640 1 --2- 172.21.15.55:0/3464460307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cec0c9360 0x7f1cec06be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:24.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf2000640 1 -- 172.21.15.55:0/3464460307 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cd4003ef0 msgr2=0x7f1cec1f1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:24.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf2000640 1 --2- 172.21.15.55:0/3464460307 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cd4003ef0 0x7f1cec1f1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf2000640 1 -- 172.21.15.55:0/3464460307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cec0c9360 msgr2=0x7f1cec06be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:24.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf2000640 1 --2- 172.21.15.55:0/3464460307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cec0c9360 0x7f1cec06be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf2000640 1 -- 172.21.15.55:0/3464460307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cec0ca020 con 0x7f1cec0c97e0 2024-04-02T07:27:24.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf0c00640 1 --2- 172.21.15.55:0/3464460307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cec0c9360 0x7f1cec06be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:24.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf2000640 1 --2- 172.21.15.55:0/3464460307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cec0c97e0 0x7f1cec06c340 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f1cec0b6710 tx=0x7f1ce400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:24.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1ce9600640 1 -- 172.21.15.55:0/3464460307 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce400e040 con 0x7f1cec0c97e0 2024-04-02T07:27:24.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1ce9600640 1 -- 172.21.15.55:0/3464460307 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce400f040 con 0x7f1cec0c97e0 2024-04-02T07:27:24.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1ce9600640 1 -- 172.21.15.55:0/3464460307 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce4015430 con 0x7f1cec0c97e0 2024-04-02T07:27:24.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf4000640 1 -- 172.21.15.55:0/3464460307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cec0b3650 con 0x7f1cec0c97e0 2024-04-02T07:27:24.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.751+0000 7f1cf4000640 1 -- 172.21.15.55:0/3464460307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cec0c3150 con 0x7f1cec0c97e0 2024-04-02T07:27:24.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.755+0000 7f1cf4000640 1 -- 172.21.15.55:0/3464460307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cec0723d0 con 0x7f1cec0c97e0 2024-04-02T07:27:24.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.755+0000 7f1ce9600640 1 -- 172.21.15.55:0/3464460307 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1ce4015590 con 0x7f1cec0c97e0 2024-04-02T07:27:24.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.755+0000 7f1ce9600640 1 --2- 172.21.15.55:0/3464460307 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1ccc0666c0 0x7f1ccc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:24.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.755+0000 7f1ce9600640 1 -- 172.21.15.55:0/3464460307 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f1ce40847b0 con 0x7f1cec0c97e0 2024-04-02T07:27:24.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.755+0000 7f1cf1600640 1 --2- 172.21.15.55:0/3464460307 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1ccc0666c0 0x7f1ccc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:24.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.755+0000 7f1cf1600640 1 --2- 172.21.15.55:0/3464460307 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1ccc0666c0 0x7f1ccc068b80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00014e0 tx=0x7f1ce0007cd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:24.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.759+0000 7f1ce9600640 1 -- 172.21.15.55:0/3464460307 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f1ce4051b20 con 0x7f1cec0c97e0 2024-04-02T07:27:24.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.919+0000 7f1cf4000640 1 -- 172.21.15.55:0/3464460307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1cec066c90 con 0x7f1cec0c97e0 2024-04-02T07:27:24.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.919+0000 7f1ce9600640 1 -- 172.21.15.55:0/3464460307 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1ce4055140 con 0x7f1cec0c97e0 2024-04-02T07:27:24.921 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:27:24.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.919+0000 7f1cf4000640 1 -- 172.21.15.55:0/3464460307 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1ccc0666c0 msgr2=0x7f1ccc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:24.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.919+0000 7f1cf4000640 1 --2- 172.21.15.55:0/3464460307 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1ccc0666c0 0x7f1ccc068b80 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f1ce00014e0 tx=0x7f1ce0007cd0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.919+0000 7f1cf4000640 1 -- 172.21.15.55:0/3464460307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cec0c97e0 msgr2=0x7f1cec06c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:24.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.919+0000 7f1cf4000640 1 --2- 172.21.15.55:0/3464460307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cec0c97e0 0x7f1cec06c340 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f1cec0b6710 tx=0x7f1ce400f580 comp rx=0 tx=0).stop 2024-04-02T07:27:24.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.919+0000 7f1cf4000640 1 -- 172.21.15.55:0/3464460307 shutdown_connections 2024-04-02T07:27:24.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.919+0000 7f1cf4000640 1 --2- 172.21.15.55:0/3464460307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cec0c97e0 0x7f1cec06c340 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.919+0000 7f1cf4000640 1 --2- 172.21.15.55:0/3464460307 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1ccc0666c0 0x7f1ccc068b80 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.919+0000 7f1cf4000640 1 --2- 172.21.15.55:0/3464460307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cec0c9360 0x7f1cec06be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.919+0000 7f1cf4000640 1 --2- 172.21.15.55:0/3464460307 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cd4003ef0 0x7f1cec1f1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:24.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.919+0000 7f1cf4000640 1 -- 172.21.15.55:0/3464460307 >> 172.21.15.55:0/3464460307 conn(0x7f1cec0b2150 msgr2=0x7f1cec0af280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:24.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.919+0000 7f1cf4000640 1 -- 172.21.15.55:0/3464460307 shutdown_connections 2024-04-02T07:27:24.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:24.919+0000 7f1cf4000640 1 -- 172.21.15.55:0/3464460307 wait complete. 2024-04-02T07:27:24.941 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:27:25.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.083+0000 7f8e8a400640 1 Processor -- start 2024-04-02T07:27:25.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.083+0000 7f8e8a400640 1 -- start start 2024-04-02T07:27:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.083+0000 7f8e8a400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e84144260 0x7f8e840702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.083+0000 7f8e8a400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8e840707e0 0x7f8e840b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:25.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.083+0000 7f8e8a400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e84070c90 con 0x7f8e840b2fd0 2024-04-02T07:27:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.083+0000 7f8e8a400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e840b37c0 con 0x7f8e84144260 2024-04-02T07:27:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.083+0000 7f8e8a400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8415e3a0 con 0x7f8e840707e0 2024-04-02T07:27:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.083+0000 7f8e83400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e84144260 0x7f8e840702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.083+0000 7f8e83400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e84144260 0x7f8e840702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37884/0 (socket says 172.21.15.55:37884) 2024-04-02T07:27:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.083+0000 7f8e83400640 1 -- 172.21.15.55:0/3987181277 learned_addr learned my addr 172.21.15.55:0/3987181277 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.083+0000 7f8e82a00640 1 --2- 172.21.15.55:0/3987181277 >> v2:172.21.15.106:3300/0 conn(0x7f8e840707e0 0x7f8e840b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.083+0000 7f8e83400640 1 -- 172.21.15.55:0/3987181277 >> v2:172.21.15.106:3300/0 conn(0x7f8e840707e0 msgr2=0x7f8e840b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.083+0000 7f8e83400640 1 --2- 172.21.15.55:0/3987181277 >> v2:172.21.15.106:3300/0 conn(0x7f8e840707e0 0x7f8e840b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.083+0000 7f8e83400640 1 -- 172.21.15.55:0/3987181277 >> v1:172.21.15.106:6789/0 conn(0x7f8e840b2fd0 legacy=0x7f8e840cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:25.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.083+0000 7f8e83400640 1 -- 172.21.15.55:0/3987181277 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8415e5f0 con 0x7f8e84144260 2024-04-02T07:27:25.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.087+0000 7f8e83400640 1 --2- 172.21.15.55:0/3987181277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e84144260 0x7f8e840702a0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f8e840b1410 tx=0x7f8e7401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a323d6b27f3ce0a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.087+0000 7f8e82000640 1 -- 172.21.15.55:0/3987181277 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e740ab600 con 0x7f8e84144260 2024-04-02T07:27:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.087+0000 7f8e82000640 1 -- 172.21.15.55:0/3987181277 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e740a7050 con 0x7f8e84144260 2024-04-02T07:27:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.087+0000 7f8e82000640 1 -- 172.21.15.55:0/3987181277 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e740ab980 con 0x7f8e84144260 2024-04-02T07:27:25.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.087+0000 7f8e8a400640 1 -- 172.21.15.55:0/3987181277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e84144260 msgr2=0x7f8e840702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.087+0000 7f8e8a400640 1 --2- 172.21.15.55:0/3987181277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e84144260 0x7f8e840702a0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f8e840b1410 tx=0x7f8e7401c4e0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.087+0000 7f8e8a400640 1 -- 172.21.15.55:0/3987181277 shutdown_connections 2024-04-02T07:27:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.087+0000 7f8e8a400640 1 --2- 172.21.15.55:0/3987181277 >> v2:172.21.15.106:3300/0 conn(0x7f8e840707e0 0x7f8e840b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.087+0000 7f8e8a400640 1 --2- 172.21.15.55:0/3987181277 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e84144260 0x7f8e840702a0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.087+0000 7f8e8a400640 1 -- 172.21.15.55:0/3987181277 >> 172.21.15.55:0/3987181277 conn(0x7f8e8406a390 msgr2=0x7f8e840b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.087+0000 7f8e8a400640 1 -- 172.21.15.55:0/3987181277 shutdown_connections 2024-04-02T07:27:25.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.087+0000 7f8e8a400640 1 -- 172.21.15.55:0/3987181277 wait complete. 2024-04-02T07:27:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.087+0000 7f8e8a400640 1 Processor -- start 2024-04-02T07:27:25.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.087+0000 7f8e8a400640 1 -- start start 2024-04-02T07:27:25.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e8a400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e840707e0 0x7f8e8415afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:25.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e8a400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e840b2fd0 0x7f8e8413a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:25.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e8a400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e84144260 0x7f8e8413a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:25.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e8a400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e84143170 con 0x7f8e84144260 2024-04-02T07:27:25.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e8a400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e841424f0 con 0x7f8e840b2fd0 2024-04-02T07:27:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e8a400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e841427d0 con 0x7f8e840707e0 2024-04-02T07:27:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e83e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e84144260 0x7f8e8413a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e83e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e84144260 0x7f8e8413a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37890/0 (socket says 172.21.15.55:37890) 2024-04-02T07:27:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e83e00640 1 -- 172.21.15.55:0/3033849907 learned_addr learned my addr 172.21.15.55:0/3033849907 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e83400640 1 --2- 172.21.15.55:0/3033849907 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e840707e0 0x7f8e8415afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e82a00640 1 --2- 172.21.15.55:0/3033849907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e840b2fd0 0x7f8e8413a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e83e00640 1 -- 172.21.15.55:0/3033849907 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e840707e0 msgr2=0x7f8e8415afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e83e00640 1 --2- 172.21.15.55:0/3033849907 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e840707e0 0x7f8e8415afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e83e00640 1 -- 172.21.15.55:0/3033849907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e840b2fd0 msgr2=0x7f8e8413a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:25.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e83e00640 1 --2- 172.21.15.55:0/3033849907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e840b2fd0 0x7f8e8413a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e83e00640 1 -- 172.21.15.55:0/3033849907 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e740094d0 con 0x7f8e84144260 2024-04-02T07:27:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e83e00640 1 --2- 172.21.15.55:0/3033849907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e84144260 0x7f8e8413a6f0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00c780 tx=0x7f8e7c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e7b400640 1 -- 172.21.15.55:0/3033849907 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c004b70 con 0x7f8e84144260 2024-04-02T07:27:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e7b400640 1 -- 172.21.15.55:0/3033849907 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7c00ce90 con 0x7f8e84144260 2024-04-02T07:27:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e7b400640 1 -- 172.21.15.55:0/3033849907 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7c00a850 con 0x7f8e84144260 2024-04-02T07:27:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e8a400640 1 -- 172.21.15.55:0/3033849907 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e84142ab0 con 0x7f8e84144260 2024-04-02T07:27:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e8a400640 1 -- 172.21.15.55:0/3033849907 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8415b520 con 0x7f8e84144260 2024-04-02T07:27:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e8a400640 1 -- 172.21.15.55:0/3033849907 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e84073530 con 0x7f8e84144260 2024-04-02T07:27:25.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.091+0000 7f8e7b400640 1 -- 172.21.15.55:0/3033849907 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8e7c00a9b0 con 0x7f8e84144260 2024-04-02T07:27:25.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.095+0000 7f8e7b400640 1 --2- 172.21.15.55:0/3033849907 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8e64066690 0x7f8e64068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:25.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.095+0000 7f8e7b400640 1 -- 172.21.15.55:0/3033849907 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8e7c0843e0 con 0x7f8e84144260 2024-04-02T07:27:25.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.095+0000 7f8e83400640 1 --2- 172.21.15.55:0/3033849907 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8e64066690 0x7f8e64068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:25.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.095+0000 7f8e83400640 1 --2- 172.21.15.55:0/3033849907 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8e64066690 0x7f8e64068b50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8e740ad000 tx=0x7f8e740a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.099+0000 7f8e7b400640 1 -- 172.21.15.55:0/3033849907 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f8e7c0516b0 con 0x7f8e84144260 2024-04-02T07:27:25.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.259+0000 7f8e8a400640 1 -- 172.21.15.55:0/3033849907 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8e8413c030 con 0x7f8e84144260 2024-04-02T07:27:25.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.259+0000 7f8e7b400640 1 -- 172.21.15.55:0/3033849907 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8e7c054cd0 con 0x7f8e84144260 2024-04-02T07:27:25.261 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:27:25.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.259+0000 7f8e8a400640 1 -- 172.21.15.55:0/3033849907 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8e64066690 msgr2=0x7f8e64068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:25.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.259+0000 7f8e8a400640 1 --2- 172.21.15.55:0/3033849907 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8e64066690 0x7f8e64068b50 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f8e740ad000 tx=0x7f8e740a6000 comp rx=0 tx=0).stop 2024-04-02T07:27:25.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.259+0000 7f8e8a400640 1 -- 172.21.15.55:0/3033849907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e84144260 msgr2=0x7f8e8413a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:25.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.259+0000 7f8e8a400640 1 --2- 172.21.15.55:0/3033849907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e84144260 0x7f8e8413a6f0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f8e7c00c780 tx=0x7f8e7c00cc40 comp rx=0 tx=0).stop 2024-04-02T07:27:25.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.259+0000 7f8e8a400640 1 -- 172.21.15.55:0/3033849907 shutdown_connections 2024-04-02T07:27:25.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.259+0000 7f8e8a400640 1 --2- 172.21.15.55:0/3033849907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e84144260 0x7f8e8413a6f0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.259+0000 7f8e8a400640 1 --2- 172.21.15.55:0/3033849907 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8e64066690 0x7f8e64068b50 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.259+0000 7f8e8a400640 1 --2- 172.21.15.55:0/3033849907 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e840b2fd0 0x7f8e8413a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.259+0000 7f8e8a400640 1 --2- 172.21.15.55:0/3033849907 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e840707e0 0x7f8e8415afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.259+0000 7f8e8a400640 1 -- 172.21.15.55:0/3033849907 >> 172.21.15.55:0/3033849907 conn(0x7f8e8406a390 msgr2=0x7f8e8415da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:25.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.259+0000 7f8e8a400640 1 -- 172.21.15.55:0/3033849907 shutdown_connections 2024-04-02T07:27:25.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.259+0000 7f8e8a400640 1 -- 172.21.15.55:0/3033849907 wait complete. 2024-04-02T07:27:25.281 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:27:25.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.419+0000 7f1ff6800640 1 Processor -- start 2024-04-02T07:27:25.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.419+0000 7f1ff6800640 1 -- start start 2024-04-02T07:27:25.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.423+0000 7f1ff6800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1ff0160230 0x7f1ff00b1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:25.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.423+0000 7f1ff6800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ff006bac0 0x7f1ff00cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:25.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.423+0000 7f1ff6800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ff00ce990 con 0x7f1ff00cb1f0 2024-04-02T07:27:25.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.423+0000 7f1ff6800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ff0160610 con 0x7f1ff0160230 2024-04-02T07:27:25.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.423+0000 7f1ff6800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff00cf4f0 con 0x7f1ff006bac0 2024-04-02T07:27:25.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.423+0000 7f1fef400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1ff0160230 0x7f1ff00b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:25.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.423+0000 7f1fe7e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ff006bac0 0x7f1ff00cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:25.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.423+0000 7f1fefe00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1ff00cb1f0 0x7f1ff00cf980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:38568/0 (socket says 172.21.15.55:38568) 2024-04-02T07:27:25.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.423+0000 7f1fefe00640 1 -- 172.21.15.55:0/4072273091 learned_addr learned my addr 172.21.15.55:0/4072273091 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:27:25.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.423+0000 7f1fe7e00640 1 -- 172.21.15.55:0/4072273091 >> v2:172.21.15.106:3300/0 conn(0x7f1ff0160230 msgr2=0x7f1ff00b1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:25.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.423+0000 7f1fe7e00640 1 --2- 172.21.15.55:0/4072273091 >> v2:172.21.15.106:3300/0 conn(0x7f1ff0160230 0x7f1ff00b1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.423+0000 7f1feea00640 1 -- 172.21.15.55:0/4072273091 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107338612 0 0) 0x7f1ff00ce990 con 0x7f1ff00cb1f0 2024-04-02T07:27:25.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.423+0000 7f1fe7e00640 1 -- 172.21.15.55:0/4072273091 >> v1:172.21.15.106:6789/0 conn(0x7f1ff00cb1f0 legacy=0x7f1ff00cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:25.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.423+0000 7f1fe7e00640 1 -- 172.21.15.55:0/4072273091 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ff00cebc0 con 0x7f1ff006bac0 2024-04-02T07:27:25.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1fe7e00640 1 --2- 172.21.15.55:0/4072273091 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ff006bac0 0x7f1ff00cacb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80097c0 tx=0x7f1fd801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6150dc2502083dc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:25.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1feea00640 1 -- 172.21.15.55:0/4072273091 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd80ac640 con 0x7f1ff006bac0 2024-04-02T07:27:25.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1feea00640 1 -- 172.21.15.55:0/4072273091 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fd80ac7a0 con 0x7f1ff006bac0 2024-04-02T07:27:25.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1feea00640 1 -- 172.21.15.55:0/4072273091 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fd80acb30 con 0x7f1ff006bac0 2024-04-02T07:27:25.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1ff6800640 1 -- 172.21.15.55:0/4072273091 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ff006bac0 msgr2=0x7f1ff00cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:25.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1ff6800640 1 --2- 172.21.15.55:0/4072273091 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ff006bac0 0x7f1ff00cacb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1fd80097c0 tx=0x7f1fd801c3e0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1ff6800640 1 -- 172.21.15.55:0/4072273091 shutdown_connections 2024-04-02T07:27:25.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1ff6800640 1 --2- 172.21.15.55:0/4072273091 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ff006bac0 0x7f1ff00cacb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1ff6800640 1 --2- 172.21.15.55:0/4072273091 >> v2:172.21.15.106:3300/0 conn(0x7f1ff0160230 0x7f1ff00b1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1ff6800640 1 -- 172.21.15.55:0/4072273091 >> 172.21.15.55:0/4072273091 conn(0x7f1ff00b2150 msgr2=0x7f1ff00b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:25.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1ff6800640 1 -- 172.21.15.55:0/4072273091 shutdown_connections 2024-04-02T07:27:25.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1ff6800640 1 -- 172.21.15.55:0/4072273091 wait complete. 2024-04-02T07:27:25.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1ff6800640 1 Processor -- start 2024-04-02T07:27:25.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1ff6800640 1 -- start start 2024-04-02T07:27:25.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1ff6800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ff006bac0 0x7f1ff0154f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:25.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1ff6800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ff00cb1f0 0x7f1ff00c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:25.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1ff6800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ff0160230 0x7f1ff015c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:25.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1ff6800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff0155490 con 0x7f1ff0160230 2024-04-02T07:27:25.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1ff6800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff00c8c60 con 0x7f1ff00cb1f0 2024-04-02T07:27:25.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1ff6800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ff00c8f40 con 0x7f1ff006bac0 2024-04-02T07:27:25.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.427+0000 7f1fefe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ff0160230 0x7f1ff015c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:25.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.431+0000 7f1fefe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ff0160230 0x7f1ff015c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37900/0 (socket says 172.21.15.55:37900) 2024-04-02T07:27:25.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.431+0000 7f1fefe00640 1 -- 172.21.15.55:0/1459344689 learned_addr learned my addr 172.21.15.55:0/1459344689 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:25.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.431+0000 7f1fe7e00640 1 --2- 172.21.15.55:0/1459344689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ff00cb1f0 0x7f1ff00c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.431+0000 7f1fef400640 1 --2- 172.21.15.55:0/1459344689 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ff006bac0 0x7f1ff0154f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.431+0000 7f1fefe00640 1 -- 172.21.15.55:0/1459344689 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ff006bac0 msgr2=0x7f1ff0154f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.431+0000 7f1fefe00640 1 --2- 172.21.15.55:0/1459344689 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ff006bac0 0x7f1ff0154f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.431+0000 7f1fefe00640 1 -- 172.21.15.55:0/1459344689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ff00cb1f0 msgr2=0x7f1ff00c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.431+0000 7f1fefe00640 1 --2- 172.21.15.55:0/1459344689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ff00cb1f0 0x7f1ff00c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.431+0000 7f1fefe00640 1 -- 172.21.15.55:0/1459344689 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fd8009420 con 0x7f1ff0160230 2024-04-02T07:27:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.431+0000 7f1fefe00640 1 --2- 172.21.15.55:0/1459344689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ff0160230 0x7f1ff015c220 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800c700 tx=0x7f1fe800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.431+0000 7f1fe7400640 1 -- 172.21.15.55:0/1459344689 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe800ce10 con 0x7f1ff0160230 2024-04-02T07:27:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.431+0000 7f1fe7400640 1 -- 172.21.15.55:0/1459344689 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fe800a640 con 0x7f1ff0160230 2024-04-02T07:27:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.431+0000 7f1fe7400640 1 -- 172.21.15.55:0/1459344689 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fe800aa70 con 0x7f1ff0160230 2024-04-02T07:27:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.431+0000 7f1ff6800640 1 -- 172.21.15.55:0/1459344689 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ff00c9220 con 0x7f1ff0160230 2024-04-02T07:27:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.431+0000 7f1ff6800640 1 -- 172.21.15.55:0/1459344689 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ff00c97e0 con 0x7f1ff0160230 2024-04-02T07:27:25.436 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-02T07:27:25.431+0000 7f8f1ba00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-02T07:27:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.431+0000 7f1ff6800640 1 -- 172.21.15.55:0/1459344689 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ff00c99d0 con 0x7f1ff0160230 2024-04-02T07:27:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.431+0000 7f1fe7400640 1 -- 172.21.15.55:0/1459344689 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1fe800abd0 con 0x7f1ff0160230 2024-04-02T07:27:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.435+0000 7f1fe7400640 1 --2- 172.21.15.55:0/1459344689 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1fcc066690 0x7f1fcc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.435+0000 7f1fe7400640 1 -- 172.21.15.55:0/1459344689 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f1fe8083950 con 0x7f1ff0160230 2024-04-02T07:27:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.435+0000 7f1fef400640 1 --2- 172.21.15.55:0/1459344689 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1fcc066690 0x7f1fcc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.435+0000 7f1fef400640 1 --2- 172.21.15.55:0/1459344689 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1fcc066690 0x7f1fcc068b50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1ff01f8540 tx=0x7f1fe0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:25.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.435+0000 7f1fe7400640 1 -- 172.21.15.55:0/1459344689 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f1fe8050e50 con 0x7f1ff0160230 2024-04-02T07:27:25.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.611+0000 7f1ff6800640 1 -- 172.21.15.55:0/1459344689 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f1ff0066c90 con 0x7f1ff0160230 2024-04-02T07:27:25.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.611+0000 7f1fe7400640 1 -- 172.21.15.55:0/1459344689 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v75) v1 ==== 80+0+122 (secure 0 0 0) 0x7f1fe8018020 con 0x7f1ff0160230 2024-04-02T07:27:25.612 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6833/1576619269 2024-04-03T07:27:14.356430+0000 2024-04-02T07:27:25.612 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6832/1576619269 2024-04-03T07:27:14.356430+0000 2024-04-02T07:27:25.613 INFO:teuthology.orchestra.run.smithi055.stderr:listed 2 entries 2024-04-02T07:27:25.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.611+0000 7f1ff6800640 1 -- 172.21.15.55:0/1459344689 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1fcc066690 msgr2=0x7f1fcc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:25.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.611+0000 7f1ff6800640 1 --2- 172.21.15.55:0/1459344689 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1fcc066690 0x7f1fcc068b50 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f1ff01f8540 tx=0x7f1fe0009190 comp rx=0 tx=0).stop 2024-04-02T07:27:25.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.611+0000 7f1ff6800640 1 -- 172.21.15.55:0/1459344689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ff0160230 msgr2=0x7f1ff015c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:25.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.611+0000 7f1ff6800640 1 --2- 172.21.15.55:0/1459344689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ff0160230 0x7f1ff015c220 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f1fe800c700 tx=0x7f1fe800cbc0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.611+0000 7f1ff6800640 1 -- 172.21.15.55:0/1459344689 shutdown_connections 2024-04-02T07:27:25.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.611+0000 7f1ff6800640 1 --2- 172.21.15.55:0/1459344689 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1ff0160230 0x7f1ff015c220 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.611+0000 7f1ff6800640 1 --2- 172.21.15.55:0/1459344689 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1fcc066690 0x7f1fcc068b50 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.611+0000 7f1ff6800640 1 --2- 172.21.15.55:0/1459344689 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1ff00cb1f0 0x7f1ff00c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.611+0000 7f1ff6800640 1 --2- 172.21.15.55:0/1459344689 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1ff006bac0 0x7f1ff0154f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:25.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.611+0000 7f1ff6800640 1 -- 172.21.15.55:0/1459344689 >> 172.21.15.55:0/1459344689 conn(0x7f1ff00b2150 msgr2=0x7f1ff00cb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:25.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.611+0000 7f1ff6800640 1 -- 172.21.15.55:0/1459344689 shutdown_connections 2024-04-02T07:27:25.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:25.611+0000 7f1ff6800640 1 -- 172.21.15.55:0/1459344689 wait complete. 2024-04-02T07:27:25.632 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi055.front.sepia.ceph.com... 2024-04-02T07:27:25.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:25.632 DEBUG:teuthology.orchestra.run.smithi055:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-02T07:27:25.650 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[43718]: fuse finished with error 0 and tester_r 0 2024-04-02T07:27:25.653 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:27:31.755 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:27:31.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:31.755 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-02T07:27:31.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:31.766 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir recursive 2024-04-02T07:27:31.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.959+0000 7f8440600640 1 Processor -- start 2024-04-02T07:27:31.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.959+0000 7f8440600640 1 -- start start 2024-04-02T07:27:31.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.959+0000 7f8440600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f843815ce40 0x7f84380b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:31.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.959+0000 7f8440600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f843806d1c0 0x7f84380b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.959+0000 7f8440600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84380b1d60 con 0x7f84380afe70 2024-04-02T07:27:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.959+0000 7f8440600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843806cda0 con 0x7f843815ce40 2024-04-02T07:27:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.959+0000 7f8440600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f843806c400 con 0x7f843806d1c0 2024-04-02T07:27:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.959+0000 7f843dc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f843815ce40 0x7f84380b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.959+0000 7f843dc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f843815ce40 0x7f84380b1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48860/0 (socket says 172.21.15.55:48860) 2024-04-02T07:27:31.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.959+0000 7f843dc00640 1 -- 172.21.15.55:0/3994988637 learned_addr learned my addr 172.21.15.55:0/3994988637 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:31.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.963+0000 7f843d200640 1 --2- 172.21.15.55:0/3994988637 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f843806d1c0 0x7f84380b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:31.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.963+0000 7f843dc00640 1 -- 172.21.15.55:0/3994988637 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f843806d1c0 msgr2=0x7f84380b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:31.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.963+0000 7f843dc00640 1 --2- 172.21.15.55:0/3994988637 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f843806d1c0 0x7f84380b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:31.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.963+0000 7f843dc00640 1 -- 172.21.15.55:0/3994988637 >> v1:172.21.15.106:6789/0 conn(0x7f84380afe70 legacy=0x7f843815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:31.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.963+0000 7f843dc00640 1 -- 172.21.15.55:0/3994988637 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843806c6e0 con 0x7f843815ce40 2024-04-02T07:27:31.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.963+0000 7f843dc00640 1 --2- 172.21.15.55:0/3994988637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843815ce40 0x7f84380b1780 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f842c009870 tx=0x7f842c01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fdfc204b6f706cb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:31.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.963+0000 7f8437e00640 1 -- 172.21.15.55:0/3994988637 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c0ad660 con 0x7f843815ce40 2024-04-02T07:27:31.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.963+0000 7f8437e00640 1 -- 172.21.15.55:0/3994988637 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c0ad7c0 con 0x7f843815ce40 2024-04-02T07:27:31.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.963+0000 7f8437e00640 1 -- 172.21.15.55:0/3994988637 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c0adb50 con 0x7f843815ce40 2024-04-02T07:27:31.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f8440600640 1 -- 172.21.15.55:0/3994988637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843815ce40 msgr2=0x7f84380b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:31.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f8440600640 1 --2- 172.21.15.55:0/3994988637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843815ce40 0x7f84380b1780 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f842c009870 tx=0x7f842c01c490 comp rx=0 tx=0).stop 2024-04-02T07:27:31.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f8440600640 1 -- 172.21.15.55:0/3994988637 shutdown_connections 2024-04-02T07:27:31.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f8440600640 1 --2- 172.21.15.55:0/3994988637 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f843806d1c0 0x7f84380b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:31.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f8440600640 1 --2- 172.21.15.55:0/3994988637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f843815ce40 0x7f84380b1780 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:31.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f8440600640 1 -- 172.21.15.55:0/3994988637 >> 172.21.15.55:0/3994988637 conn(0x7f8438069d90 msgr2=0x7f843806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:31.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f8440600640 1 -- 172.21.15.55:0/3994988637 shutdown_connections 2024-04-02T07:27:31.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f8440600640 1 -- 172.21.15.55:0/3994988637 wait complete. 2024-04-02T07:27:31.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f8440600640 1 Processor -- start 2024-04-02T07:27:31.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f8440600640 1 -- start start 2024-04-02T07:27:31.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f8440600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f843806d1c0 0x7f84380c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:31.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f8440600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84380afe70 0x7f84381f6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:31.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f8440600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f843815ce40 0x7f84381516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:31.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f8440600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8438149130 con 0x7f84380afe70 2024-04-02T07:27:31.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f8440600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f843814de10 con 0x7f843815ce40 2024-04-02T07:27:31.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f8440600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84380c8670 con 0x7f843806d1c0 2024-04-02T07:27:31.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f843d200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84380afe70 0x7f84381f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:31.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f843d200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84380afe70 0x7f84381f6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48862/0 (socket says 172.21.15.55:48862) 2024-04-02T07:27:31.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f843d200640 1 -- 172.21.15.55:0/4158912155 learned_addr learned my addr 172.21.15.55:0/4158912155 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:31.972 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f843e600640 1 --2- 172.21.15.55:0/4158912155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f843815ce40 0x7f84381516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:31.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f843dc00640 1 --2- 172.21.15.55:0/4158912155 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f843806d1c0 0x7f84380c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:31.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f843d200640 1 -- 172.21.15.55:0/4158912155 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f843806d1c0 msgr2=0x7f84380c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:31.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f843d200640 1 --2- 172.21.15.55:0/4158912155 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f843806d1c0 0x7f84380c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:31.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f843d200640 1 -- 172.21.15.55:0/4158912155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f843815ce40 msgr2=0x7f84381516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:31.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f843d200640 1 --2- 172.21.15.55:0/4158912155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f843815ce40 0x7f84381516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:31.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.967+0000 7f843d200640 1 -- 172.21.15.55:0/4158912155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c0094d0 con 0x7f84380afe70 2024-04-02T07:27:31.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.971+0000 7f843d200640 1 --2- 172.21.15.55:0/4158912155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84380afe70 0x7f84381f6070 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f842400d800 tx=0x7f842400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:31.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.971+0000 7f8435600640 1 -- 172.21.15.55:0/4158912155 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842400b6c0 con 0x7f84380afe70 2024-04-02T07:27:31.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.971+0000 7f8435600640 1 -- 172.21.15.55:0/4158912155 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842400b820 con 0x7f84380afe70 2024-04-02T07:27:31.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.971+0000 7f8440600640 1 -- 172.21.15.55:0/4158912155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8438149340 con 0x7f84380afe70 2024-04-02T07:27:31.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.971+0000 7f8435600640 1 -- 172.21.15.55:0/4158912155 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842400bb90 con 0x7f84380afe70 2024-04-02T07:27:31.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.971+0000 7f8440600640 1 -- 172.21.15.55:0/4158912155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8438149900 con 0x7f84380afe70 2024-04-02T07:27:31.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.971+0000 7f8435600640 1 -- 172.21.15.55:0/4158912155 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f842400bcf0 con 0x7f84380afe70 2024-04-02T07:27:31.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.971+0000 7f8435600640 1 --2- 172.21.15.55:0/4158912155 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8418066690 0x7f8418068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:31.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.971+0000 7f8435600640 1 -- 172.21.15.55:0/4158912155 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8424084650 con 0x7f84380afe70 2024-04-02T07:27:31.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.971+0000 7f843dc00640 1 --2- 172.21.15.55:0/4158912155 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8418066690 0x7f8418068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:31.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.971+0000 7f8443a15000 1 Processor -- start 2024-04-02T07:27:31.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f8443a15000 1 -- start start 2024-04-02T07:27:31.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f843dc00640 1 --2- 172.21.15.55:0/4158912155 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8418066690 0x7f8418068b50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f842c0af000 tx=0x7f842c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:31.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f8443a15000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339dde8a0 0x565339ddec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:31.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f8443a15000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339ddf1c0 0x565339d94cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:31.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f8443a15000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339d95230 0x565339d95610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:31.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f8443a15000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x565339c5d3a0 con 0x565339dde8a0 2024-04-02T07:27:31.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f8443a15000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x565339beaab0 con 0x565339ddf1c0 2024-04-02T07:27:31.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f8443a15000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x565339be8080 con 0x565339d95230 2024-04-02T07:27:31.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f843dc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339dde8a0 0x565339ddec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:31.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f843dc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339dde8a0 0x565339ddec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48878/0 (socket says 172.21.15.55:48878) 2024-04-02T07:27:31.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f843dc00640 1 -- 172.21.15.55:0/488609027 learned_addr learned my addr 172.21.15.55:0/488609027 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:31.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f843e600640 1 --2- 172.21.15.55:0/488609027 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339d95230 0x565339d95610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:31.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f843d200640 1 --2- 172.21.15.55:0/488609027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339ddf1c0 0x565339d94cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:31.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f843dc00640 1 -- 172.21.15.55:0/488609027 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339d95230 msgr2=0x565339d95610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:31.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f843dc00640 1 --2- 172.21.15.55:0/488609027 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339d95230 0x565339d95610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:31.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f843dc00640 1 -- 172.21.15.55:0/488609027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339ddf1c0 msgr2=0x565339d94cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:31.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f843dc00640 1 --2- 172.21.15.55:0/488609027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339ddf1c0 0x565339d94cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:31.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f843dc00640 1 -- 172.21.15.55:0/488609027 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653398e0000 con 0x565339dde8a0 2024-04-02T07:27:31.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f843d200640 1 --2- 172.21.15.55:0/488609027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339ddf1c0 0x565339d94cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:31.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f843e600640 1 --2- 172.21.15.55:0/488609027 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339d95230 0x565339d95610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:31.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f843dc00640 1 --2- 172.21.15.55:0/488609027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339dde8a0 0x565339ddec80 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f842c01ab40 tx=0x7f842c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e40bffcc0f70b5a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:31.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f842a000640 1 -- 172.21.15.55:0/488609027 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c004230 con 0x565339dde8a0 2024-04-02T07:27:31.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f842a000640 1 -- 172.21.15.55:0/488609027 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c004390 con 0x565339dde8a0 2024-04-02T07:27:31.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f842a000640 1 -- 172.21.15.55:0/488609027 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c0b7b90 con 0x565339dde8a0 2024-04-02T07:27:31.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f8443a15000 1 -- 172.21.15.55:0/488609027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339dde8a0 msgr2=0x565339ddec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:31.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f8443a15000 1 --2- 172.21.15.55:0/488609027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339dde8a0 0x565339ddec80 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f842c01ab40 tx=0x7f842c004740 comp rx=0 tx=0).stop 2024-04-02T07:27:31.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f8443a15000 1 -- 172.21.15.55:0/488609027 shutdown_connections 2024-04-02T07:27:31.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f8443a15000 1 --2- 172.21.15.55:0/488609027 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339d95230 0x565339d95610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:31.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f8443a15000 1 --2- 172.21.15.55:0/488609027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339ddf1c0 0x565339d94cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:31.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f8443a15000 1 --2- 172.21.15.55:0/488609027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339dde8a0 0x565339ddec80 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:31.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f8443a15000 1 -- 172.21.15.55:0/488609027 >> 172.21.15.55:0/488609027 conn(0x565339d9b5a0 msgr2=0x565339d935d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:31.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f8443a15000 1 -- 172.21.15.55:0/488609027 shutdown_connections 2024-04-02T07:27:31.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f8443a15000 1 -- 172.21.15.55:0/488609027 wait complete. 2024-04-02T07:27:31.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f8443a15000 1 -- start start 2024-04-02T07:27:31.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.975+0000 7f8443a15000 1 Processor -- start 2024-04-02T07:27:31.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f8443a15000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339d95230 0x565339d99d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:31.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f8443a15000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339dde8a0 0x565339d9a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:31.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f8443a15000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339ddf1c0 0x565339da00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:31.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f8443a15000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x565339be3970 con 0x565339ddf1c0 2024-04-02T07:27:31.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f8443a15000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x565339b83a00 con 0x565339d95230 2024-04-02T07:27:31.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f8443a15000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x565339b836a0 con 0x565339dde8a0 2024-04-02T07:27:31.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f8443a15000 10 client.0 _ll_register_callbacks cb 0x565339d80bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:27:31.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f843e600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339ddf1c0 0x565339da00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:31.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f843e600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339ddf1c0 0x565339da00a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48880/0 (socket says 172.21.15.55:48880) 2024-04-02T07:27:31.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f843e600640 1 -- 172.21.15.55:0/2377487477 learned_addr learned my addr 172.21.15.55:0/2377487477 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:31.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f843dc00640 1 --2- 172.21.15.55:0/2377487477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339d95230 0x565339d99d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:31.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f843d200640 1 --2- 172.21.15.55:0/2377487477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339dde8a0 0x565339d9a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:31.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f843e600640 1 -- 172.21.15.55:0/2377487477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339dde8a0 msgr2=0x565339d9a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:31.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f843e600640 1 --2- 172.21.15.55:0/2377487477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339dde8a0 0x565339d9a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:31.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f843e600640 1 -- 172.21.15.55:0/2377487477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339d95230 msgr2=0x565339d99d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:31.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f843e600640 1 --2- 172.21.15.55:0/2377487477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339d95230 0x565339d99d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:31.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f843e600640 1 -- 172.21.15.55:0/2377487477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f843806c6e0 con 0x565339ddf1c0 2024-04-02T07:27:31.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f843e600640 1 --2- 172.21.15.55:0/2377487477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339ddf1c0 0x565339da00a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f84300116c0 tx=0x7f8430011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d21d06d816e7ea73 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:31.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f841ea00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:27:31.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f841ea00640 1 -- 172.21.15.55:0/2377487477 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8430006b60 con 0x565339ddf1c0 2024-04-02T07:27:31.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f841ea00640 1 -- 172.21.15.55:0/2377487477 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8430006cc0 con 0x565339ddf1c0 2024-04-02T07:27:31.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f8443a15000 1 -- 172.21.15.55:0/2377487477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565339b93370 con 0x565339ddf1c0 2024-04-02T07:27:31.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f841ea00640 1 -- 172.21.15.55:0/2377487477 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f843000f710 con 0x565339ddf1c0 2024-04-02T07:27:31.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f8443a15000 10 client.7083 fetch_fsmap learned FSMap version 51 2024-04-02T07:27:31.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f8443a15000 1 -- 172.21.15.55:0/2377487477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x565339ba88f0 con 0x565339ddf1c0 2024-04-02T07:27:31.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f841ea00640 1 -- 172.21.15.55:0/2377487477 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565339b93370 con 0x565339ddf1c0 2024-04-02T07:27:31.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f841ea00640 1 -- 172.21.15.55:0/2377487477 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 51) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f843000f870 con 0x565339ddf1c0 2024-04-02T07:27:31.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f8443a15000 10 client.7083 fetch_fsmap finished waiting for FSMap version 51 2024-04-02T07:27:31.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f8443a15000 10 client.7083 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-02T07:27:31.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f8443a15000 20 client.7083 populate_metadata read hostname 'smithi055' 2024-04-02T07:27:31.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f8443a15000 1 --2- 172.21.15.55:0/2377487477 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x565339ded930 0x565339defd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:31.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f8443a15000 4 client.7083 mds_command: new command op to 6936 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:27:31.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f8443a15000 1 -- 172.21.15.55:0/2377487477 --> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565339be22c0 con 0x565339ded930 2024-04-02T07:27:31.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f843dc00640 1 --2- 172.21.15.55:0/2377487477 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x565339ded930 0x565339defd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:31.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f843dc00640 1 --2- 172.21.15.55:0/2377487477 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x565339ded930 0x565339defd20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d2e129c22d7e6bc server_cookie=3be68dac4b24fa1b in_seq=0 out_seq=0 2024-04-02T07:27:31.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f841ea00640 10 client.7083 ms_handle_connect on v2:172.21.15.55:6832/1965896660 2024-04-02T07:27:31.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f841ea00640 1 -- 172.21.15.55:0/2377487477 <== mds.0 v2:172.21.15.55:6832/1965896660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x565339be22c0 con 0x565339ded930 2024-04-02T07:27:31.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.979+0000 7f841ea00640 10 client.7083 handle_command_reply: tid=0 2024-04-02T07:27:31.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.983+0000 7f8443a15000 1 client.7083 shutdown 2024-04-02T07:27:31.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.983+0000 7f8443a15000 1 -- 172.21.15.55:0/2377487477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339ddf1c0 msgr2=0x565339da00a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:31.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.983+0000 7f8443a15000 1 --2- 172.21.15.55:0/2377487477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339ddf1c0 0x565339da00a0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f84300116c0 tx=0x7f8430011ac0 comp rx=0 tx=0).stop 2024-04-02T07:27:31.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.983+0000 7f8443a15000 1 -- 172.21.15.55:0/2377487477 shutdown_connections 2024-04-02T07:27:31.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.983+0000 7f8443a15000 1 --2- 172.21.15.55:0/2377487477 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x565339ded930 0x565339defd20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:31.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.983+0000 7f8443a15000 1 --2- 172.21.15.55:0/2377487477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339ddf1c0 0x565339da00a0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:31.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.983+0000 7f8443a15000 1 --2- 172.21.15.55:0/2377487477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339dde8a0 0x565339d9a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:31.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.983+0000 7f841ea00640 0 client.7083 ms_handle_reset on v2:172.21.15.55:6832/1965896660 2024-04-02T07:27:31.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.983+0000 7f8443a15000 1 --2- 172.21.15.55:0/2377487477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339d95230 0x565339d99d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:31.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.983+0000 7f8443a15000 1 -- 172.21.15.55:0/2377487477 >> 172.21.15.55:0/2377487477 conn(0x565339d9b5a0 msgr2=0x565339d93cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:31.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.983+0000 7f8443a15000 1 -- 172.21.15.55:0/2377487477 shutdown_connections 2024-04-02T07:27:31.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.983+0000 7f8443a15000 1 -- 172.21.15.55:0/2377487477 wait complete. 2024-04-02T07:27:31.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.983+0000 7f8443a15000 20 client.7083 trim_cache size 0 max 16384 2024-04-02T07:27:31.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.995+0000 7f8443a15000 1 Processor -- start 2024-04-02T07:27:31.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.995+0000 7f8443a15000 1 -- start start 2024-04-02T07:27:32.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.995+0000 7f8443a15000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339d95230 0x565339df1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339dde8a0 0x565339df1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339ddf1c0 0x565339dd9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653398a0c80 con 0x565339dde8a0 2024-04-02T07:27:32.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x565339d8ca40 con 0x565339ddf1c0 2024-04-02T07:27:32.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x565339b8c270 con 0x565339d95230 2024-04-02T07:27:32.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f843d200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339dde8a0 0x565339df1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f843d200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339dde8a0 0x565339df1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48896/0 (socket says 172.21.15.55:48896) 2024-04-02T07:27:32.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f843d200640 1 -- 172.21.15.55:0/3209988002 learned_addr learned my addr 172.21.15.55:0/3209988002 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:32.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f843dc00640 1 --2- 172.21.15.55:0/3209988002 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339d95230 0x565339df1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f843e600640 1 --2- 172.21.15.55:0/3209988002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339ddf1c0 0x565339dd9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f843d200640 1 -- 172.21.15.55:0/3209988002 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339d95230 msgr2=0x565339df1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:32.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f843d200640 1 --2- 172.21.15.55:0/3209988002 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339d95230 0x565339df1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f843d200640 1 -- 172.21.15.55:0/3209988002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339ddf1c0 msgr2=0x565339dd9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:32.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f843d200640 1 --2- 172.21.15.55:0/3209988002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339ddf1c0 0x565339dd9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f843d200640 1 -- 172.21.15.55:0/3209988002 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565339b8ec40 con 0x565339dde8a0 2024-04-02T07:27:32.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f843dc00640 1 --2- 172.21.15.55:0/3209988002 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339d95230 0x565339df1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:32.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f843d200640 1 --2- 172.21.15.55:0/3209988002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339dde8a0 0x565339df1980 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8424082ae0 tx=0x7f8424055690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1047b1f1652de4 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:32.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f842aa00640 1 -- 172.21.15.55:0/3209988002 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424053a30 con 0x565339dde8a0 2024-04-02T07:27:32.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f842aa00640 1 -- 172.21.15.55:0/3209988002 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84240590b0 con 0x565339dde8a0 2024-04-02T07:27:32.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f842aa00640 1 -- 172.21.15.55:0/3209988002 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424059220 con 0x565339dde8a0 2024-04-02T07:27:32.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 -- 172.21.15.55:0/3209988002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339dde8a0 msgr2=0x565339df1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:32.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 --2- 172.21.15.55:0/3209988002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339dde8a0 0x565339df1980 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f8424082ae0 tx=0x7f8424055690 comp rx=0 tx=0).stop 2024-04-02T07:27:32.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 -- 172.21.15.55:0/3209988002 shutdown_connections 2024-04-02T07:27:32.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 --2- 172.21.15.55:0/3209988002 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339ddf1c0 0x565339dd9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 --2- 172.21.15.55:0/3209988002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339dde8a0 0x565339df1980 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 --2- 172.21.15.55:0/3209988002 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339d95230 0x565339df1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 -- 172.21.15.55:0/3209988002 >> 172.21.15.55:0/3209988002 conn(0x565339d9b5a0 msgr2=0x565339defd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:32.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 -- 172.21.15.55:0/3209988002 shutdown_connections 2024-04-02T07:27:32.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 -- 172.21.15.55:0/3209988002 wait complete. 2024-04-02T07:27:32.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 -- start start 2024-04-02T07:27:32.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 Processor -- start 2024-04-02T07:27:32.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339d95230 0x565339e3d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339dde8a0 0x565339ddc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339ddf1c0 0x565339ddc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x565339dde5c0 con 0x565339d95230 2024-04-02T07:27:32.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x565339bddb90 con 0x565339ddf1c0 2024-04-02T07:27:32.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x565339be64d0 con 0x565339dde8a0 2024-04-02T07:27:32.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f8443a15000 10 client.0 _ll_register_callbacks cb 0x565339b82110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:27:32.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f843dc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339d95230 0x565339e3d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f843dc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339d95230 0x565339e3d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48908/0 (socket says 172.21.15.55:48908) 2024-04-02T07:27:32.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:31.999+0000 7f843dc00640 1 -- 172.21.15.55:0/866973106 learned_addr learned my addr 172.21.15.55:0/866973106 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:32.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f843e600640 1 --2- 172.21.15.55:0/866973106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339ddf1c0 0x565339ddc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f843d200640 1 --2- 172.21.15.55:0/866973106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339dde8a0 0x565339ddc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f843dc00640 1 -- 172.21.15.55:0/866973106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339dde8a0 msgr2=0x565339ddc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:32.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f843dc00640 1 --2- 172.21.15.55:0/866973106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339dde8a0 0x565339ddc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f843dc00640 1 -- 172.21.15.55:0/866973106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339ddf1c0 msgr2=0x565339ddc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:32.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f843dc00640 1 --2- 172.21.15.55:0/866973106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339ddf1c0 0x565339ddc760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f843dc00640 1 -- 172.21.15.55:0/866973106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8438149900 con 0x565339d95230 2024-04-02T07:27:32.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f843e600640 1 --2- 172.21.15.55:0/866973106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339ddf1c0 0x565339ddc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:32.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f843dc00640 1 --2- 172.21.15.55:0/866973106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339d95230 0x565339e3d160 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f842c01ab40 tx=0x7f842c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f4c710c8a0a7f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:32.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f841ea00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:27:32.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f841ea00640 1 -- 172.21.15.55:0/866973106 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c0041b0 con 0x565339d95230 2024-04-02T07:27:32.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f841ea00640 1 -- 172.21.15.55:0/866973106 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f842c0d2040 con 0x565339d95230 2024-04-02T07:27:32.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 1 -- 172.21.15.55:0/866973106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565339be0750 con 0x565339d95230 2024-04-02T07:27:32.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f841ea00640 1 -- 172.21.15.55:0/866973106 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f842c004310 con 0x565339d95230 2024-04-02T07:27:32.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 10 client.7089 fetch_fsmap learned FSMap version 51 2024-04-02T07:27:32.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 1 -- 172.21.15.55:0/866973106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x565339b82970 con 0x565339d95230 2024-04-02T07:27:32.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f841ea00640 1 -- 172.21.15.55:0/866973106 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565339be0750 con 0x565339d95230 2024-04-02T07:27:32.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f841ea00640 1 -- 172.21.15.55:0/866973106 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 51) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f842c0c9020 con 0x565339d95230 2024-04-02T07:27:32.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 10 client.7089 fetch_fsmap finished waiting for FSMap version 51 2024-04-02T07:27:32.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 10 client.7089 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-02T07:27:32.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 20 client.7089 populate_metadata read hostname 'smithi055' 2024-04-02T07:27:32.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 1 --2- 172.21.15.55:0/866973106 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x565339df90e0 0x565339df94f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 4 client.7089 mds_command: new command op to 6936 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}] 2024-04-02T07:27:32.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 1 -- 172.21.15.55:0/866973106 --> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["recursive"]}) v1 -- 0x565339babed0 con 0x565339df90e0 2024-04-02T07:27:32.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f843d200640 1 --2- 172.21.15.55:0/866973106 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x565339df90e0 0x565339df94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f843d200640 1 --2- 172.21.15.55:0/866973106 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x565339df90e0 0x565339df94f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55a30eb031a7eef6 server_cookie=f1e808cea9980176 in_seq=0 out_seq=0 2024-04-02T07:27:32.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f841ea00640 10 client.7089 ms_handle_connect on v2:172.21.15.55:6832/1965896660 2024-04-02T07:27:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f841ea00640 1 -- 172.21.15.55:0/866973106 <== mds.0 v2:172.21.15.55:6832/1965896660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x565339babed0 con 0x565339df90e0 2024-04-02T07:27:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f841ea00640 10 client.7089 handle_command_reply: tid=0 2024-04-02T07:27:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 1 client.7089 shutdown 2024-04-02T07:27:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 1 -- 172.21.15.55:0/866973106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339d95230 msgr2=0x565339e3d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 1 --2- 172.21.15.55:0/866973106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339d95230 0x565339e3d160 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f842c01ab40 tx=0x7f842c0046d0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 1 -- 172.21.15.55:0/866973106 shutdown_connections 2024-04-02T07:27:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 1 --2- 172.21.15.55:0/866973106 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x565339df90e0 0x565339df94f0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 1 --2- 172.21.15.55:0/866973106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565339ddf1c0 0x565339ddc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 1 --2- 172.21.15.55:0/866973106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565339dde8a0 0x565339ddc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 1 --2- 172.21.15.55:0/866973106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565339d95230 0x565339e3d160 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 1 -- 172.21.15.55:0/866973106 >> 172.21.15.55:0/866973106 conn(0x565339d9b5a0 msgr2=0x565339df05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f841ea00640 0 client.7089 ms_handle_reset on v2:172.21.15.55:6832/1965896660 2024-04-02T07:27:32.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 1 -- 172.21.15.55:0/866973106 shutdown_connections 2024-04-02T07:27:32.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 1 -- 172.21.15.55:0/866973106 wait complete. 2024-04-02T07:27:32.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8443a15000 20 client.7089 trim_cache size 0 max 16384 2024-04-02T07:27:32.011 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:27:32.011 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-04-02T07:27:32.011 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "f98faabe-15a7-48aa-96e0-75d543bc1db6", 2024-04-02T07:27:32.011 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-04-02T07:27:32.011 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:27:32.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8440600640 1 -- 172.21.15.55:0/4158912155 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8418066690 msgr2=0x7f8418068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:32.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8440600640 1 --2- 172.21.15.55:0/4158912155 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8418066690 0x7f8418068b50 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f842c0af000 tx=0x7f842c0a7000 comp rx=0 tx=0).stop 2024-04-02T07:27:32.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8440600640 1 -- 172.21.15.55:0/4158912155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84380afe70 msgr2=0x7f84381f6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:32.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8440600640 1 --2- 172.21.15.55:0/4158912155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84380afe70 0x7f84381f6070 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f842400d800 tx=0x7f842400dcc0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8440600640 1 -- 172.21.15.55:0/4158912155 shutdown_connections 2024-04-02T07:27:32.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8440600640 1 --2- 172.21.15.55:0/4158912155 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8418066690 0x7f8418068b50 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8440600640 1 --2- 172.21.15.55:0/4158912155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f843815ce40 0x7f84381516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8440600640 1 --2- 172.21.15.55:0/4158912155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84380afe70 0x7f84381f6070 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8440600640 1 --2- 172.21.15.55:0/4158912155 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f843806d1c0 0x7f84380c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8440600640 1 -- 172.21.15.55:0/4158912155 >> 172.21.15.55:0/4158912155 conn(0x7f8438069d90 msgr2=0x7f84380b0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:32.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8440600640 1 -- 172.21.15.55:0/4158912155 shutdown_connections 2024-04-02T07:27:32.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.003+0000 7f8440600640 1 -- 172.21.15.55:0/4158912155 wait complete. 2024-04-02T07:27:32.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:27:32.026 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-02T07:27:32.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.167+0000 7f27c8200640 1 Processor -- start 2024-04-02T07:27:32.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.167+0000 7f27c8200640 1 -- start start 2024-04-02T07:27:32.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.167+0000 7f27c8200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27c015cd20 0x7f27c0065a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.167+0000 7f27c8200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c00660d0 con 0x7f27c006e4f0 2024-04-02T07:27:32.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.167+0000 7f27c8200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27c01609b0 con 0x7f27c0161490 2024-04-02T07:27:32.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.167+0000 7f27c8200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c01607a0 con 0x7f27c015cd20 2024-04-02T07:27:32.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.167+0000 7f27c6200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f27c006e4f0 0x7f27c00cdc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:32828/0 (socket says 172.21.15.55:32828) 2024-04-02T07:27:32.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.167+0000 7f27c6200640 1 -- 172.21.15.55:0/2394991794 learned_addr learned my addr 172.21.15.55:0/2394991794 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:27:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.167+0000 7f27c5800640 1 --2- 172.21.15.55:0/2394991794 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27c015cd20 0x7f27c0065a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.167+0000 7f27bfe00640 1 -- 172.21.15.55:0/2394991794 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1911343125 0 0) 0x7f27c00660d0 con 0x7f27c006e4f0 2024-04-02T07:27:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.167+0000 7f27bfe00640 1 -- 172.21.15.55:0/2394991794 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27a8003530 con 0x7f27c006e4f0 2024-04-02T07:27:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27bfe00640 1 -- 172.21.15.55:0/2394991794 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3663049520 0 0) 0x7f27a8003530 con 0x7f27c006e4f0 2024-04-02T07:27:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27bfe00640 1 -- 172.21.15.55:0/2394991794 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27c015cd20 msgr2=0x7f27c0065a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27bfe00640 1 --2- 172.21.15.55:0/2394991794 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27c015cd20 0x7f27c0065a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27bfe00640 1 -- 172.21.15.55:0/2394991794 >> v1:172.21.15.106:6789/0 conn(0x7f27c0161490 legacy=0x7f27c006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27bfe00640 1 -- 172.21.15.55:0/2394991794 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c0160c90 con 0x7f27c006e4f0 2024-04-02T07:27:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27bfe00640 1 -- 172.21.15.55:0/2394991794 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f27b8001a00 con 0x7f27c006e4f0 2024-04-02T07:27:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27bfe00640 1 -- 172.21.15.55:0/2394991794 >> v1:172.21.15.55:6789/0 conn(0x7f27c006e4f0 legacy=0x7f27c00cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27bfe00640 1 --2- 172.21.15.55:0/2394991794 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27c015cd20 0x7f27a80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27bfe00640 1 --2- 172.21.15.55:0/2394991794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27a8003ef0 0x7f27a80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27bfe00640 1 --2- 172.21.15.55:0/2394991794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27a8004d10 0x7f27a8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27bfe00640 1 -- 172.21.15.55:0/2394991794 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c01607a0 con 0x7f27a8004d10 2024-04-02T07:27:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27bfe00640 1 -- 172.21.15.55:0/2394991794 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27a800b9f0 con 0x7f27a8003ef0 2024-04-02T07:27:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27bfe00640 1 -- 172.21.15.55:0/2394991794 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27a800bbb0 con 0x7f27c015cd20 2024-04-02T07:27:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27c6200640 1 --2- 172.21.15.55:0/2394991794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27a8004d10 0x7f27a8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27c5800640 1 --2- 172.21.15.55:0/2394991794 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27c015cd20 0x7f27a80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27c4e00640 1 --2- 172.21.15.55:0/2394991794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27a8003ef0 0x7f27a80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27c5800640 1 -- 172.21.15.55:0/2394991794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27a8003ef0 msgr2=0x7f27a80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27c5800640 1 --2- 172.21.15.55:0/2394991794 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27a8003ef0 0x7f27a80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27c5800640 1 -- 172.21.15.55:0/2394991794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27a8004d10 msgr2=0x7f27a8005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27c5800640 1 --2- 172.21.15.55:0/2394991794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27a8004d10 0x7f27a8005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27c5800640 1 -- 172.21.15.55:0/2394991794 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27a8003530 con 0x7f27c015cd20 2024-04-02T07:27:32.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.171+0000 7f27c5800640 1 --2- 172.21.15.55:0/2394991794 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27c015cd20 0x7f27a80039b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009ae0 tx=0x7f27b401c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9d5bb84f6c10570 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:32.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27bfe00640 1 -- 172.21.15.55:0/2394991794 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b40a64e0 con 0x7f27c015cd20 2024-04-02T07:27:32.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27bfe00640 1 -- 172.21.15.55:0/2394991794 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b40a6640 con 0x7f27c015cd20 2024-04-02T07:27:32.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27bfe00640 1 -- 172.21.15.55:0/2394991794 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b40a69f0 con 0x7f27c015cd20 2024-04-02T07:27:32.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27c8200640 1 -- 172.21.15.55:0/2394991794 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27c015cd20 msgr2=0x7f27a80039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:32.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27c8200640 1 --2- 172.21.15.55:0/2394991794 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27c015cd20 0x7f27a80039b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009ae0 tx=0x7f27b401c9f0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27c6200640 1 -- 172.21.15.55:0/2394991794 reap_dead start 2024-04-02T07:27:32.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27c8200640 1 -- 172.21.15.55:0/2394991794 shutdown_connections 2024-04-02T07:27:32.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27c8200640 1 -- 172.21.15.55:0/2394991794 >> 172.21.15.55:0/2394991794 conn(0x7f27c00ced90 msgr2=0x7f27c00cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:32.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27c8200640 1 -- 172.21.15.55:0/2394991794 shutdown_connections 2024-04-02T07:27:32.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27c8200640 1 -- 172.21.15.55:0/2394991794 wait complete. 2024-04-02T07:27:32.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27c8200640 1 Processor -- start 2024-04-02T07:27:32.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27c8200640 1 -- start start 2024-04-02T07:27:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27c8200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27c015cd20 0x7f27c0158900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27c8200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27c015b150 0x7f27c0159680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27c8200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27c00af5f0 0x7f27c00afa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27c8200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c015ba30 con 0x7f27c00af5f0 2024-04-02T07:27:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27c8200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27c00affb0 con 0x7f27c015b150 2024-04-02T07:27:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27c8200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27c01f66b0 con 0x7f27c015cd20 2024-04-02T07:27:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27c6200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27c00af5f0 0x7f27c00afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27c6200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27c00af5f0 0x7f27c00afa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48928/0 (socket says 172.21.15.55:48928) 2024-04-02T07:27:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.175+0000 7f27c6200640 1 -- 172.21.15.55:0/3920770020 learned_addr learned my addr 172.21.15.55:0/3920770020 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.179+0000 7f27c5800640 1 --2- 172.21.15.55:0/3920770020 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27c015cd20 0x7f27c0158900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.179+0000 7f27c4e00640 1 --2- 172.21.15.55:0/3920770020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27c015b150 0x7f27c0159680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.179+0000 7f27c6200640 1 -- 172.21.15.55:0/3920770020 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27c015cd20 msgr2=0x7f27c0158900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:32.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.179+0000 7f27c6200640 1 --2- 172.21.15.55:0/3920770020 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27c015cd20 0x7f27c0158900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.179+0000 7f27c6200640 1 -- 172.21.15.55:0/3920770020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27c015b150 msgr2=0x7f27c0159680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:32.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.179+0000 7f27c6200640 1 --2- 172.21.15.55:0/3920770020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27c015b150 0x7f27c0159680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.179+0000 7f27c6200640 1 -- 172.21.15.55:0/3920770020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c01f58f0 con 0x7f27c00af5f0 2024-04-02T07:27:32.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.179+0000 7f27c5800640 1 --2- 172.21.15.55:0/3920770020 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27c015cd20 0x7f27c0158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:27:32.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.179+0000 7f27c4e00640 1 --2- 172.21.15.55:0/3920770020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27c015b150 0x7f27c0159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:27:32.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.179+0000 7f27c6200640 1 --2- 172.21.15.55:0/3920770020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27c00af5f0 0x7f27c00afa70 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f27c009d060 tx=0x7f27b80115c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:32.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.179+0000 7f27bd600640 1 -- 172.21.15.55:0/3920770020 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b8004b70 con 0x7f27c00af5f0 2024-04-02T07:27:32.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.179+0000 7f27bd600640 1 -- 172.21.15.55:0/3920770020 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b8004cd0 con 0x7f27c00af5f0 2024-04-02T07:27:32.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.179+0000 7f27bd600640 1 -- 172.21.15.55:0/3920770020 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b80062b0 con 0x7f27c00af5f0 2024-04-02T07:27:32.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.179+0000 7f27c8200640 1 -- 172.21.15.55:0/3920770020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27c01f5bd0 con 0x7f27c00af5f0 2024-04-02T07:27:32.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.179+0000 7f27c8200640 1 -- 172.21.15.55:0/3920770020 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27c01f6190 con 0x7f27c00af5f0 2024-04-02T07:27:32.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.179+0000 7f27bd600640 1 -- 172.21.15.55:0/3920770020 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f27b8006410 con 0x7f27c00af5f0 2024-04-02T07:27:32.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.179+0000 7f27bd600640 1 --2- 172.21.15.55:0/3920770020 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f27a0066690 0x7f27a0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.179+0000 7f27bd600640 1 -- 172.21.15.55:0/3920770020 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f27b8086ff0 con 0x7f27c00af5f0 2024-04-02T07:27:32.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.179+0000 7f27c5800640 1 --2- 172.21.15.55:0/3920770020 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f27a0066690 0x7f27a0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27cb574000 1 Processor -- start 2024-04-02T07:27:32.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27cb574000 1 -- start start 2024-04-02T07:27:32.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27c5800640 1 --2- 172.21.15.55:0/3920770020 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f27a0066690 0x7f27a0068b50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f27b40af000 tx=0x7f27b40046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:32.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27cb574000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d4113a70 0x55f7d4113e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27cb574000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4114390 0x55f7d40c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27cb574000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f7d40c7a00 0x55f7d40c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27cb574000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d3f92630 con 0x55f7d4113a70 2024-04-02T07:27:32.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27cb574000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d3f1fbd0 con 0x55f7d4114390 2024-04-02T07:27:32.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27cb574000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f7d3f1d1a0 con 0x55f7d40c7a00 2024-04-02T07:27:32.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27c5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d4113a70 0x55f7d4113e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27c5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d4113a70 0x55f7d4113e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48938/0 (socket says 172.21.15.55:48938) 2024-04-02T07:27:32.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27c5800640 1 -- 172.21.15.55:0/1581194783 learned_addr learned my addr 172.21.15.55:0/1581194783 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:32.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27c6200640 1 --2- 172.21.15.55:0/1581194783 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f7d40c7a00 0x55f7d40c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27c4e00640 1 --2- 172.21.15.55:0/1581194783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4114390 0x55f7d40c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27c5800640 1 -- 172.21.15.55:0/1581194783 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f7d40c7a00 msgr2=0x55f7d40c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:32.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27c5800640 1 --2- 172.21.15.55:0/1581194783 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f7d40c7a00 0x55f7d40c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27c5800640 1 -- 172.21.15.55:0/1581194783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4114390 msgr2=0x55f7d40c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:32.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27c5800640 1 --2- 172.21.15.55:0/1581194783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4114390 0x55f7d40c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27c5800640 1 -- 172.21.15.55:0/1581194783 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7d3c14e20 con 0x55f7d4113a70 2024-04-02T07:27:32.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27c4e00640 1 --2- 172.21.15.55:0/1581194783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4114390 0x55f7d40c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:27:32.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27c5800640 1 --2- 172.21.15.55:0/1581194783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d4113a70 0x55f7d4113e50 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f27b401ca30 tx=0x7f27b4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e4a768c7c31e37d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:32.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27b2000640 1 -- 172.21.15.55:0/1581194783 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b40c0070 con 0x55f7d4113a70 2024-04-02T07:27:32.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27b2000640 1 -- 172.21.15.55:0/1581194783 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b40a6c80 con 0x55f7d4113a70 2024-04-02T07:27:32.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27b2000640 1 -- 172.21.15.55:0/1581194783 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b4006040 con 0x55f7d4113a70 2024-04-02T07:27:32.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27cb574000 1 -- 172.21.15.55:0/1581194783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d4113a70 msgr2=0x55f7d4113e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:32.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27cb574000 1 --2- 172.21.15.55:0/1581194783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d4113a70 0x55f7d4113e50 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f27b401ca30 tx=0x7f27b4004740 comp rx=0 tx=0).stop 2024-04-02T07:27:32.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27cb574000 1 -- 172.21.15.55:0/1581194783 shutdown_connections 2024-04-02T07:27:32.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27cb574000 1 --2- 172.21.15.55:0/1581194783 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f7d40c7a00 0x55f7d40c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27cb574000 1 --2- 172.21.15.55:0/1581194783 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4114390 0x55f7d40c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27cb574000 1 --2- 172.21.15.55:0/1581194783 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d4113a70 0x55f7d4113e50 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27cb574000 1 -- 172.21.15.55:0/1581194783 >> 172.21.15.55:0/1581194783 conn(0x55f7d3ec8160 msgr2=0x55f7d40f6820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:32.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27cb574000 1 -- 172.21.15.55:0/1581194783 shutdown_connections 2024-04-02T07:27:32.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27cb574000 1 -- 172.21.15.55:0/1581194783 wait complete. 2024-04-02T07:27:32.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27cb574000 1 -- start start 2024-04-02T07:27:32.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.183+0000 7f27cb574000 1 Processor -- start 2024-04-02T07:27:32.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27cb574000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d40c7a00 0x55f7d40d0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27cb574000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d4113a70 0x55f7d40f7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27cb574000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f7d4114390 0x55f7d40f7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27cb574000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d3f18a90 con 0x55f7d4113a70 2024-04-02T07:27:32.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27cb574000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d3eb7d40 con 0x55f7d40c7a00 2024-04-02T07:27:32.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27cb574000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f7d3ed5f30 con 0x55f7d4114390 2024-04-02T07:27:32.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27cb574000 10 client.0 _ll_register_callbacks cb 0x55f7d3f7a810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:27:32.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27c4e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d4113a70 0x55f7d40f7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27c4e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d4113a70 0x55f7d40f7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48954/0 (socket says 172.21.15.55:48954) 2024-04-02T07:27:32.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27c4e00640 1 -- 172.21.15.55:0/1372137823 learned_addr learned my addr 172.21.15.55:0/1372137823 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:32.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27c6200640 1 --2- 172.21.15.55:0/1372137823 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f7d4114390 0x55f7d40f7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27c5800640 1 --2- 172.21.15.55:0/1372137823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d40c7a00 0x55f7d40d0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27c4e00640 1 -- 172.21.15.55:0/1372137823 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f7d4114390 msgr2=0x55f7d40f7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:32.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27c4e00640 1 --2- 172.21.15.55:0/1372137823 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f7d4114390 0x55f7d40f7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27c4e00640 1 -- 172.21.15.55:0/1372137823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d40c7a00 msgr2=0x55f7d40d0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:32.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27c4e00640 1 --2- 172.21.15.55:0/1372137823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d40c7a00 0x55f7d40d0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27c4e00640 1 -- 172.21.15.55:0/1372137823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27a8003530 con 0x55f7d4113a70 2024-04-02T07:27:32.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27c4e00640 1 --2- 172.21.15.55:0/1372137823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d4113a70 0x55f7d40f7a50 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f27ac003bc0 tx=0x7f27ac001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=846bcb5b703aee53 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:32.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:27:32.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27a6a00640 1 -- 172.21.15.55:0/1372137823 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27ac016480 con 0x55f7d4113a70 2024-04-02T07:27:32.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27a6a00640 1 -- 172.21.15.55:0/1372137823 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f27ac0165e0 con 0x55f7d4113a70 2024-04-02T07:27:32.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27cb574000 1 -- 172.21.15.55:0/1372137823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f7d3f173e0 con 0x55f7d4113a70 2024-04-02T07:27:32.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27a6a00640 1 -- 172.21.15.55:0/1372137823 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27ac0167a0 con 0x55f7d4113a70 2024-04-02T07:27:32.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27cb574000 10 client.7101 fetch_fsmap learned FSMap version 51 2024-04-02T07:27:32.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27cb574000 1 -- 172.21.15.55:0/1372137823 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55f7d3eddaa0 con 0x55f7d4113a70 2024-04-02T07:27:32.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27a6a00640 1 -- 172.21.15.55:0/1372137823 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f7d3f173e0 con 0x55f7d4113a70 2024-04-02T07:27:32.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27a6a00640 1 -- 172.21.15.55:0/1372137823 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 51) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f27ac016900 con 0x55f7d4113a70 2024-04-02T07:27:32.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27cb574000 10 client.7101 fetch_fsmap finished waiting for FSMap version 51 2024-04-02T07:27:32.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27cb574000 10 client.7101 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-02T07:27:32.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27cb574000 20 client.7101 populate_metadata read hostname 'smithi055' 2024-04-02T07:27:32.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27cb574000 1 --2- 172.21.15.55:0/1372137823 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55f7d411b2d0 0x55f7d411b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27cb574000 4 client.7101 mds_command: new command op to 6936 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:27:32.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27cb574000 1 -- 172.21.15.55:0/1372137823 --> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f7d3ee8d00 con 0x55f7d411b2d0 2024-04-02T07:27:32.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27c5800640 1 --2- 172.21.15.55:0/1372137823 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55f7d411b2d0 0x55f7d411b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27c5800640 1 --2- 172.21.15.55:0/1372137823 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55f7d411b2d0 0x55f7d411b6b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96a297a33e9ae5d2 server_cookie=79f312b722d914e1 in_seq=0 out_seq=0 2024-04-02T07:27:32.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.187+0000 7f27a6a00640 10 client.7101 ms_handle_connect on v2:172.21.15.55:6832/1965896660 2024-04-02T07:27:32.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.191+0000 7f27a6a00640 1 -- 172.21.15.55:0/1372137823 <== mds.0 v2:172.21.15.55:6832/1965896660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f7d3ee8d00 con 0x55f7d411b2d0 2024-04-02T07:27:32.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.191+0000 7f27a6a00640 10 client.7101 handle_command_reply: tid=0 2024-04-02T07:27:32.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.191+0000 7f27cb574000 1 client.7101 shutdown 2024-04-02T07:27:32.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.191+0000 7f27cb574000 1 -- 172.21.15.55:0/1372137823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d4113a70 msgr2=0x55f7d40f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:32.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.191+0000 7f27cb574000 1 --2- 172.21.15.55:0/1372137823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d4113a70 0x55f7d40f7a50 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f27ac003bc0 tx=0x7f27ac001710 comp rx=0 tx=0).stop 2024-04-02T07:27:32.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.191+0000 7f27cb574000 1 -- 172.21.15.55:0/1372137823 shutdown_connections 2024-04-02T07:27:32.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.191+0000 7f27cb574000 1 --2- 172.21.15.55:0/1372137823 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55f7d411b2d0 0x55f7d411b6b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.191+0000 7f27cb574000 1 --2- 172.21.15.55:0/1372137823 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f7d4114390 0x55f7d40f7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.191+0000 7f27cb574000 1 --2- 172.21.15.55:0/1372137823 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d4113a70 0x55f7d40f7a50 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.191+0000 7f27cb574000 1 --2- 172.21.15.55:0/1372137823 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d40c7a00 0x55f7d40d0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.191+0000 7f27a6a00640 0 client.7101 ms_handle_reset on v2:172.21.15.55:6832/1965896660 2024-04-02T07:27:32.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.191+0000 7f27cb574000 1 -- 172.21.15.55:0/1372137823 >> 172.21.15.55:0/1372137823 conn(0x55f7d3ec8160 msgr2=0x55f7d40c6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:32.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.191+0000 7f27cb574000 1 -- 172.21.15.55:0/1372137823 shutdown_connections 2024-04-02T07:27:32.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.191+0000 7f27cb574000 1 -- 172.21.15.55:0/1372137823 wait complete. 2024-04-02T07:27:32.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.191+0000 7f27cb574000 20 client.7101 trim_cache size 0 max 16384 2024-04-02T07:27:32.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.203+0000 7f27cb574000 1 Processor -- start 2024-04-02T07:27:32.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.203+0000 7f27cb574000 1 -- start start 2024-04-02T07:27:32.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d40c7a00 0x55f7d40c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f7d4113a70 0x55f7d40c7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4114390 0x55f7d40c7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d3bd5aa0 con 0x55f7d40c7a00 2024-04-02T07:27:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d40c1930 con 0x55f7d4114390 2024-04-02T07:27:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f7d3f17920 con 0x55f7d4113a70 2024-04-02T07:27:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27c5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d40c7a00 0x55f7d40c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27c5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d40c7a00 0x55f7d40c6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48958/0 (socket says 172.21.15.55:48958) 2024-04-02T07:27:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27c5800640 1 -- 172.21.15.55:0/2717494450 learned_addr learned my addr 172.21.15.55:0/2717494450 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27c4e00640 1 --2- 172.21.15.55:0/2717494450 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f7d4113a70 0x55f7d40c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27c6200640 1 --2- 172.21.15.55:0/2717494450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4114390 0x55f7d40c7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27c5800640 1 -- 172.21.15.55:0/2717494450 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f7d4113a70 msgr2=0x55f7d40c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:32.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27c5800640 1 --2- 172.21.15.55:0/2717494450 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f7d4113a70 0x55f7d40c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27c5800640 1 -- 172.21.15.55:0/2717494450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4114390 msgr2=0x55f7d40c7de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:32.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27c5800640 1 --2- 172.21.15.55:0/2717494450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4114390 0x55f7d40c7de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27c5800640 1 -- 172.21.15.55:0/2717494450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7d3ec3df0 con 0x55f7d40c7a00 2024-04-02T07:27:32.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27c6200640 1 --2- 172.21.15.55:0/2717494450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4114390 0x55f7d40c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:27:32.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27c5800640 1 --2- 172.21.15.55:0/2717494450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d40c7a00 0x55f7d40c6c30 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009ab0 tx=0x7f27b40b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d71052b5850e360e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:32.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27b2a00640 1 -- 172.21.15.55:0/2717494450 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b40c0040 con 0x55f7d40c7a00 2024-04-02T07:27:32.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27b2a00640 1 -- 172.21.15.55:0/2717494450 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27b40d4cd0 con 0x55f7d40c7a00 2024-04-02T07:27:32.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27b2a00640 1 -- 172.21.15.55:0/2717494450 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b40d4370 con 0x55f7d40c7a00 2024-04-02T07:27:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 -- 172.21.15.55:0/2717494450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d40c7a00 msgr2=0x55f7d40c6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 --2- 172.21.15.55:0/2717494450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d40c7a00 0x55f7d40c6c30 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009ab0 tx=0x7f27b40b7000 comp rx=0 tx=0).stop 2024-04-02T07:27:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 -- 172.21.15.55:0/2717494450 shutdown_connections 2024-04-02T07:27:32.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 --2- 172.21.15.55:0/2717494450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4114390 0x55f7d40c7de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 --2- 172.21.15.55:0/2717494450 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f7d4113a70 0x55f7d40c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 --2- 172.21.15.55:0/2717494450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d40c7a00 0x55f7d40c6c30 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 -- 172.21.15.55:0/2717494450 >> 172.21.15.55:0/2717494450 conn(0x55f7d3ec8160 msgr2=0x55f7d40cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 -- 172.21.15.55:0/2717494450 shutdown_connections 2024-04-02T07:27:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 -- 172.21.15.55:0/2717494450 wait complete. 2024-04-02T07:27:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 -- start start 2024-04-02T07:27:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 Processor -- start 2024-04-02T07:27:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d40c7a00 0x55f7d4159da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4113a70 0x55f7d40ca600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f7d4114390 0x55f7d40cab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d3f1b5f0 con 0x55f7d40c7a00 2024-04-02T07:27:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d3fd1ec0 con 0x55f7d4113a70 2024-04-02T07:27:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f7d40f7c80 con 0x55f7d4114390 2024-04-02T07:27:32.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.207+0000 7f27cb574000 10 client.0 _ll_register_callbacks cb 0x7f27a80036c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:27:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d40c7a00 0x55f7d4159da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d40c7a00 0x55f7d4159da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48964/0 (socket says 172.21.15.55:48964) 2024-04-02T07:27:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c5800640 1 -- 172.21.15.55:0/405119891 learned_addr learned my addr 172.21.15.55:0/405119891 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:27:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c4e00640 1 --2- 172.21.15.55:0/405119891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4113a70 0x55f7d40ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c6200640 1 --2- 172.21.15.55:0/405119891 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f7d4114390 0x55f7d40cab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c5800640 1 -- 172.21.15.55:0/405119891 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f7d4114390 msgr2=0x55f7d40cab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c5800640 1 --2- 172.21.15.55:0/405119891 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f7d4114390 0x55f7d40cab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c5800640 1 -- 172.21.15.55:0/405119891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4113a70 msgr2=0x55f7d40ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:27:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c5800640 1 --2- 172.21.15.55:0/405119891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4113a70 0x55f7d40ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c5800640 1 -- 172.21.15.55:0/405119891 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f7d3c14e20 con 0x55f7d40c7a00 2024-04-02T07:27:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c5800640 1 --2- 172.21.15.55:0/405119891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d40c7a00 0x55f7d4159da0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009ab0 tx=0x7f27b4019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eeeef1dd56e2c1d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:27:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27a6a00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:27:32.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27a6a00640 1 -- 172.21.15.55:0/405119891 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27b40c0070 con 0x55f7d40c7a00 2024-04-02T07:27:32.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27a6a00640 1 -- 172.21.15.55:0/405119891 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f27b40d4e40 con 0x55f7d40c7a00 2024-04-02T07:27:32.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 1 -- 172.21.15.55:0/405119891 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f7d3ed5970 con 0x55f7d40c7a00 2024-04-02T07:27:32.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27a6a00640 1 -- 172.21.15.55:0/405119891 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f27b4005fb0 con 0x55f7d40c7a00 2024-04-02T07:27:32.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 10 client.7107 fetch_fsmap learned FSMap version 51 2024-04-02T07:27:32.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 1 -- 172.21.15.55:0/405119891 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55f7d3eb7960 con 0x55f7d40c7a00 2024-04-02T07:27:32.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27a6a00640 1 -- 172.21.15.55:0/405119891 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f7d3ed5970 con 0x55f7d40c7a00 2024-04-02T07:27:32.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27a6a00640 1 -- 172.21.15.55:0/405119891 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 51) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f27b40b6040 con 0x55f7d40c7a00 2024-04-02T07:27:32.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 10 client.7107 fetch_fsmap finished waiting for FSMap version 51 2024-04-02T07:27:32.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 10 client.7107 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-02T07:27:32.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 20 client.7107 populate_metadata read hostname 'smithi055' 2024-04-02T07:27:32.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 1 --2- 172.21.15.55:0/405119891 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55f7d40cb080 0x55f7d40cb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:27:32.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 4 client.7107 mds_command: new command op to 6936 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-02T07:27:32.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 1 -- 172.21.15.55:0/405119891 --> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f7d3f47a20 con 0x55f7d40cb080 2024-04-02T07:27:32.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c4e00640 1 --2- 172.21.15.55:0/405119891 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55f7d40cb080 0x55f7d40cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:27:32.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c4e00640 1 --2- 172.21.15.55:0/405119891 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55f7d40cb080 0x55f7d40cb460 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=313b8d34b4796479 server_cookie=2e64f848943d9158 in_seq=0 out_seq=0 2024-04-02T07:27:32.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27a6a00640 10 client.7107 ms_handle_connect on v2:172.21.15.55:6832/1965896660 2024-04-02T07:27:32.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27a6a00640 1 -- 172.21.15.55:0/405119891 <== mds.0 v2:172.21.15.55:6832/1965896660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f7d3f47a20 con 0x55f7d40cb080 2024-04-02T07:27:32.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27a6a00640 10 client.7107 handle_command_reply: tid=0 2024-04-02T07:27:32.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 1 client.7107 shutdown 2024-04-02T07:27:32.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 1 -- 172.21.15.55:0/405119891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d40c7a00 msgr2=0x55f7d4159da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:32.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 1 --2- 172.21.15.55:0/405119891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d40c7a00 0x55f7d4159da0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f27b4009ab0 tx=0x7f27b4019790 comp rx=0 tx=0).stop 2024-04-02T07:27:32.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 1 -- 172.21.15.55:0/405119891 shutdown_connections 2024-04-02T07:27:32.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 1 --2- 172.21.15.55:0/405119891 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55f7d40cb080 0x55f7d40cb460 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 1 --2- 172.21.15.55:0/405119891 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f7d4114390 0x55f7d40cab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 1 --2- 172.21.15.55:0/405119891 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f7d4113a70 0x55f7d40ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27a6a00640 0 client.7107 ms_handle_reset on v2:172.21.15.55:6832/1965896660 2024-04-02T07:27:32.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 1 --2- 172.21.15.55:0/405119891 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f7d40c7a00 0x55f7d4159da0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 1 -- 172.21.15.55:0/405119891 >> 172.21.15.55:0/405119891 conn(0x55f7d3ec8160 msgr2=0x55f7d40cf870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:32.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 1 -- 172.21.15.55:0/405119891 shutdown_connections 2024-04-02T07:27:32.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 1 -- 172.21.15.55:0/405119891 wait complete. 2024-04-02T07:27:32.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27cb574000 20 client.7107 trim_cache size 0 max 16384 2024-04-02T07:27:32.219 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:27:32.219 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-02T07:27:32.219 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-04-02T07:27:32.219 INFO:teuthology.orchestra.run.smithi055.stdout: "f98faabe-15a7-48aa-96e0-75d543bc1db6": { 2024-04-02T07:27:32.220 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/subdir", 2024-04-02T07:27:32.220 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "f98faabe-15a7-48aa-96e0-75d543bc1db6", 2024-04-02T07:27:32.220 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive" 2024-04-02T07:27:32.220 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:27:32.220 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:27:32.220 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:27:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c8200640 1 -- 172.21.15.55:0/3920770020 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f27a0066690 msgr2=0x7f27a0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c8200640 1 --2- 172.21.15.55:0/3920770020 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f27a0066690 0x7f27a0068b50 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f27b40af000 tx=0x7f27b40046d0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c8200640 1 -- 172.21.15.55:0/3920770020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27c00af5f0 msgr2=0x7f27c00afa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:27:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c8200640 1 --2- 172.21.15.55:0/3920770020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27c00af5f0 0x7f27c00afa70 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f27c009d060 tx=0x7f27b80115c0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c8200640 1 -- 172.21.15.55:0/3920770020 shutdown_connections 2024-04-02T07:27:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c8200640 1 --2- 172.21.15.55:0/3920770020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f27c00af5f0 0x7f27c00afa70 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c8200640 1 --2- 172.21.15.55:0/3920770020 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f27a0066690 0x7f27a0068b50 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c8200640 1 --2- 172.21.15.55:0/3920770020 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27c015b150 0x7f27c0159680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c8200640 1 --2- 172.21.15.55:0/3920770020 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27c015cd20 0x7f27c0158900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:27:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.211+0000 7f27c8200640 1 -- 172.21.15.55:0/3920770020 >> 172.21.15.55:0/3920770020 conn(0x7f27c00ced90 msgr2=0x7f27c00cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:27:32.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.215+0000 7f27c8200640 1 -- 172.21.15.55:0/3920770020 shutdown_connections 2024-04-02T07:27:32.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:27:32.215+0000 7f27c8200640 1 -- 172.21.15.55:0/3920770020 wait complete. 2024-04-02T07:27:32.236 INFO:tasks.cephfs.filesystem:scrub status for tag:f98faabe-15a7-48aa-96e0-75d543bc1db6 - {'path': '/subdir', 'tag': 'f98faabe-15a7-48aa-96e0-75d543bc1db6', 'options': 'recursive'} 2024-04-02T07:27:43.938 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:27:43.942 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:28:02.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:02.238 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-02T07:28:02.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.395+0000 7f2a57200640 1 Processor -- start 2024-04-02T07:28:02.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.395+0000 7f2a57200640 1 -- start start 2024-04-02T07:28:02.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.395+0000 7f2a57200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a58099a90 0x7f2a580ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.395+0000 7f2a57200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2a580ceac0 0x7f2a580b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.395+0000 7f2a57200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a580ceef0 con 0x7f2a5815a770 2024-04-02T07:28:02.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.395+0000 7f2a57200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a58099ed0 con 0x7f2a58099a90 2024-04-02T07:28:02.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.395+0000 7f2a57200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a5815ab50 con 0x7f2a580ceac0 2024-04-02T07:28:02.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.395+0000 7f2a4fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a58099a90 0x7f2a580ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.395+0000 7f2a4fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2a58099a90 0x7f2a580ce580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51830/0 (socket says 172.21.15.55:51830) 2024-04-02T07:28:02.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.395+0000 7f2a4fe00640 1 -- 172.21.15.55:0/2310989483 learned_addr learned my addr 172.21.15.55:0/2310989483 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:02.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.399+0000 7f2a56800640 1 --2- 172.21.15.55:0/2310989483 >> v2:172.21.15.106:3300/0 conn(0x7f2a580ceac0 0x7f2a580b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.399+0000 7f2a4fe00640 1 -- 172.21.15.55:0/2310989483 >> v2:172.21.15.106:3300/0 conn(0x7f2a580ceac0 msgr2=0x7f2a580b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:02.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.399+0000 7f2a4fe00640 1 --2- 172.21.15.55:0/2310989483 >> v2:172.21.15.106:3300/0 conn(0x7f2a580ceac0 0x7f2a580b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.399+0000 7f2a4fe00640 1 -- 172.21.15.55:0/2310989483 >> v1:172.21.15.106:6789/0 conn(0x7f2a5815a770 legacy=0x7f2a580cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:02.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.399+0000 7f2a4fe00640 1 -- 172.21.15.55:0/2310989483 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a58098a10 con 0x7f2a58099a90 2024-04-02T07:28:02.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.399+0000 7f2a4fe00640 1 --2- 172.21.15.55:0/2310989483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a58099a90 0x7f2a580ce580 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f2a58071a80 tx=0x7f2a4001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c75c5f49e580714 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:02.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.399+0000 7f2a55400640 1 -- 172.21.15.55:0/2310989483 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a400aa610 con 0x7f2a58099a90 2024-04-02T07:28:02.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.399+0000 7f2a55400640 1 -- 172.21.15.55:0/2310989483 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a400a6040 con 0x7f2a58099a90 2024-04-02T07:28:02.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.399+0000 7f2a55400640 1 -- 172.21.15.55:0/2310989483 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a400aa990 con 0x7f2a58099a90 2024-04-02T07:28:02.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.399+0000 7f2a57200640 1 -- 172.21.15.55:0/2310989483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a58099a90 msgr2=0x7f2a580ce580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:02.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.399+0000 7f2a57200640 1 --2- 172.21.15.55:0/2310989483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a58099a90 0x7f2a580ce580 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f2a58071a80 tx=0x7f2a4001c4b0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.399+0000 7f2a57200640 1 -- 172.21.15.55:0/2310989483 shutdown_connections 2024-04-02T07:28:02.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.399+0000 7f2a57200640 1 --2- 172.21.15.55:0/2310989483 >> v2:172.21.15.106:3300/0 conn(0x7f2a580ceac0 0x7f2a580b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.399+0000 7f2a57200640 1 --2- 172.21.15.55:0/2310989483 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a58099a90 0x7f2a580ce580 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.399+0000 7f2a57200640 1 -- 172.21.15.55:0/2310989483 >> 172.21.15.55:0/2310989483 conn(0x7f2a580b1ff0 msgr2=0x7f2a580b2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:02.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a57200640 1 -- 172.21.15.55:0/2310989483 shutdown_connections 2024-04-02T07:28:02.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a57200640 1 -- 172.21.15.55:0/2310989483 wait complete. 2024-04-02T07:28:02.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a57200640 1 Processor -- start 2024-04-02T07:28:02.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a57200640 1 -- start start 2024-04-02T07:28:02.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a57200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a58099a90 0x7f2a581528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a57200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2a580ceac0 0x7f2a5814fa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a57200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a5815a770 0x7f2a581f8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a57200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a58152df0 con 0x7f2a58099a90 2024-04-02T07:28:02.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a57200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a58156a20 con 0x7f2a5815a770 2024-04-02T07:28:02.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a57200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a58150eb0 con 0x7f2a580ceac0 2024-04-02T07:28:02.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a55e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a58099a90 0x7f2a581528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a55e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a58099a90 0x7f2a581528b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51838/0 (socket says 172.21.15.55:51838) 2024-04-02T07:28:02.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a55e00640 1 -- 172.21.15.55:0/768619479 learned_addr learned my addr 172.21.15.55:0/768619479 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:02.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a4fe00640 1 --2- 172.21.15.55:0/768619479 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2a580ceac0 0x7f2a5814fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a56800640 1 --2- 172.21.15.55:0/768619479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a5815a770 0x7f2a581f8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a55e00640 1 -- 172.21.15.55:0/768619479 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2a580ceac0 msgr2=0x7f2a5814fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:02.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a55e00640 1 --2- 172.21.15.55:0/768619479 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2a580ceac0 0x7f2a5814fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a55e00640 1 -- 172.21.15.55:0/768619479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a5815a770 msgr2=0x7f2a581f8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:02.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a55e00640 1 --2- 172.21.15.55:0/768619479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a5815a770 0x7f2a581f8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a55e00640 1 -- 172.21.15.55:0/768619479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a400094d0 con 0x7f2a58099a90 2024-04-02T07:28:02.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a56800640 1 --2- 172.21.15.55:0/768619479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a5815a770 0x7f2a581f8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:28:02.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a55e00640 1 --2- 172.21.15.55:0/768619479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a58099a90 0x7f2a581528b0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800c450 tx=0x7f2a4800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:02.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a4e000640 1 -- 172.21.15.55:0/768619479 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48012830 con 0x7f2a58099a90 2024-04-02T07:28:02.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a4e000640 1 -- 172.21.15.55:0/768619479 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a480129b0 con 0x7f2a58099a90 2024-04-02T07:28:02.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a4e000640 1 -- 172.21.15.55:0/768619479 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a48012d60 con 0x7f2a58099a90 2024-04-02T07:28:02.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.403+0000 7f2a57200640 1 -- 172.21.15.55:0/768619479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a58151190 con 0x7f2a58099a90 2024-04-02T07:28:02.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.407+0000 7f2a57200640 1 -- 172.21.15.55:0/768619479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a58156c70 con 0x7f2a58099a90 2024-04-02T07:28:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.407+0000 7f2a4e000640 1 -- 172.21.15.55:0/768619479 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2a4801c460 con 0x7f2a58099a90 2024-04-02T07:28:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.407+0000 7f2a4e000640 1 --2- 172.21.15.55:0/768619479 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2a34066690 0x7f2a34068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.407+0000 7f2a4e000640 1 -- 172.21.15.55:0/768619479 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f2a480841a0 con 0x7f2a58099a90 2024-04-02T07:28:02.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.407+0000 7f2a4fe00640 1 --2- 172.21.15.55:0/768619479 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2a34066690 0x7f2a34068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.407+0000 7f2a60464000 1 Processor -- start 2024-04-02T07:28:02.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.407+0000 7f2a60464000 1 -- start start 2024-04-02T07:28:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a4fe00640 1 --2- 172.21.15.55:0/768619479 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2a34066690 0x7f2a34068b50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2a400ae000 tx=0x7f2a400a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:02.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a60464000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd84a70 0x555cedd84e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a60464000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd85390 0x555cedd384c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a60464000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd38a00 0x555cedd38de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a60464000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cedc03630 con 0x555cedd85390 2024-04-02T07:28:02.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a60464000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cedb90bd0 con 0x555cedd38a00 2024-04-02T07:28:02.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a60464000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x555cedb8e1a0 con 0x555cedd84a70 2024-04-02T07:28:02.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a4fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd85390 0x555cedd384c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a4fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd85390 0x555cedd384c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51844/0 (socket says 172.21.15.55:51844) 2024-04-02T07:28:02.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a4fe00640 1 -- 172.21.15.55:0/1350479924 learned_addr learned my addr 172.21.15.55:0/1350479924 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:02.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a55e00640 1 --2- 172.21.15.55:0/1350479924 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd84a70 0x555cedd84e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a56800640 1 --2- 172.21.15.55:0/1350479924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd38a00 0x555cedd38de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a4fe00640 1 -- 172.21.15.55:0/1350479924 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd84a70 msgr2=0x555cedd84e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:02.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a4fe00640 1 --2- 172.21.15.55:0/1350479924 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd84a70 0x555cedd84e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a4fe00640 1 -- 172.21.15.55:0/1350479924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd38a00 msgr2=0x555cedd38de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:02.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a4fe00640 1 --2- 172.21.15.55:0/1350479924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd38a00 0x555cedd38de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a4fe00640 1 -- 172.21.15.55:0/1350479924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555ced885e20 con 0x555cedd85390 2024-04-02T07:28:02.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a4fe00640 1 --2- 172.21.15.55:0/1350479924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd85390 0x555cedd384c0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f2a40097f80 tx=0x7f2a40004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8d7458ad71c7f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:02.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a46a00640 1 -- 172.21.15.55:0/1350479924 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a400c8630 con 0x555cedd85390 2024-04-02T07:28:02.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a46a00640 1 -- 172.21.15.55:0/1350479924 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a400c3070 con 0x555cedd85390 2024-04-02T07:28:02.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a46a00640 1 -- 172.21.15.55:0/1350479924 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a400c89d0 con 0x555cedd85390 2024-04-02T07:28:02.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a60464000 1 -- 172.21.15.55:0/1350479924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd85390 msgr2=0x555cedd384c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:02.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a60464000 1 --2- 172.21.15.55:0/1350479924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd85390 0x555cedd384c0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f2a40097f80 tx=0x7f2a40004740 comp rx=0 tx=0).stop 2024-04-02T07:28:02.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a60464000 1 -- 172.21.15.55:0/1350479924 shutdown_connections 2024-04-02T07:28:02.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a60464000 1 --2- 172.21.15.55:0/1350479924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd38a00 0x555cedd38de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a60464000 1 --2- 172.21.15.55:0/1350479924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd85390 0x555cedd384c0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a60464000 1 --2- 172.21.15.55:0/1350479924 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd84a70 0x555cedd84e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a60464000 1 -- 172.21.15.55:0/1350479924 >> 172.21.15.55:0/1350479924 conn(0x555cedb39160 msgr2=0x555cedd67820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:02.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a60464000 1 -- 172.21.15.55:0/1350479924 shutdown_connections 2024-04-02T07:28:02.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a60464000 1 -- 172.21.15.55:0/1350479924 wait complete. 2024-04-02T07:28:02.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a60464000 1 -- start start 2024-04-02T07:28:02.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.411+0000 7f2a60464000 1 Processor -- start 2024-04-02T07:28:02.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd38a00 0x555cedd41810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd84a70 0x555cedd68a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd85390 0x555cedd68f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cedb89a90 con 0x555cedd38a00 2024-04-02T07:28:02.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cedb28d40 con 0x555cedd85390 2024-04-02T07:28:02.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x555cedb46f30 con 0x555cedd84a70 2024-04-02T07:28:02.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 10 client.0 _ll_register_callbacks cb 0x555cedbeb810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:28:02.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a55e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd38a00 0x555cedd41810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a55e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd38a00 0x555cedd41810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51856/0 (socket says 172.21.15.55:51856) 2024-04-02T07:28:02.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a55e00640 1 -- 172.21.15.55:0/1102667303 learned_addr learned my addr 172.21.15.55:0/1102667303 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:02.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a4fe00640 1 --2- 172.21.15.55:0/1102667303 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd84a70 0x555cedd68a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a56800640 1 --2- 172.21.15.55:0/1102667303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd85390 0x555cedd68f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a55e00640 1 -- 172.21.15.55:0/1102667303 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd84a70 msgr2=0x555cedd68a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:02.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a55e00640 1 --2- 172.21.15.55:0/1102667303 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd84a70 0x555cedd68a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a55e00640 1 -- 172.21.15.55:0/1102667303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd85390 msgr2=0x555cedd68f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:02.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a55e00640 1 --2- 172.21.15.55:0/1102667303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd85390 0x555cedd68f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a55e00640 1 -- 172.21.15.55:0/1102667303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a400b9070 con 0x555cedd38a00 2024-04-02T07:28:02.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a55e00640 1 --2- 172.21.15.55:0/1102667303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd38a00 0x555cedd41810 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2a480825a0 tx=0x7f2a48058f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac30574882c9b77 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:02.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a3b400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:28:02.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a3b400640 1 -- 172.21.15.55:0/1102667303 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a4805b0b0 con 0x555cedd38a00 2024-04-02T07:28:02.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a3b400640 1 -- 172.21.15.55:0/1102667303 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f2a480517b0 con 0x555cedd38a00 2024-04-02T07:28:02.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 1 -- 172.21.15.55:0/1102667303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555cedb883e0 con 0x555cedd38a00 2024-04-02T07:28:02.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a3b400640 1 -- 172.21.15.55:0/1102667303 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a48051970 con 0x555cedd38a00 2024-04-02T07:28:02.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 10 client.7119 fetch_fsmap learned FSMap version 51 2024-04-02T07:28:02.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 1 -- 172.21.15.55:0/1102667303 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x555cedb4eaa0 con 0x555cedd38a00 2024-04-02T07:28:02.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a3b400640 1 -- 172.21.15.55:0/1102667303 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555cedb883e0 con 0x555cedd38a00 2024-04-02T07:28:02.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a3b400640 1 -- 172.21.15.55:0/1102667303 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 51) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2a48054590 con 0x555cedd38a00 2024-04-02T07:28:02.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 10 client.7119 fetch_fsmap finished waiting for FSMap version 51 2024-04-02T07:28:02.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 10 client.7119 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-02T07:28:02.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 20 client.7119 populate_metadata read hostname 'smithi055' 2024-04-02T07:28:02.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 1 --2- 172.21.15.55:0/1102667303 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x555cedd8c2d0 0x555cedd8c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 4 client.7119 mds_command: new command op to 6936 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:28:02.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 1 -- 172.21.15.55:0/1102667303 --> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555cedb59d00 con 0x555cedd8c2d0 2024-04-02T07:28:02.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a4fe00640 1 --2- 172.21.15.55:0/1102667303 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x555cedd8c2d0 0x555cedd8c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a4fe00640 1 --2- 172.21.15.55:0/1102667303 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x555cedd8c2d0 0x555cedd8c6b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfd61301ff9e568b server_cookie=a18bc8dfba352200 in_seq=0 out_seq=0 2024-04-02T07:28:02.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a3b400640 10 client.7119 ms_handle_connect on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:02.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a3b400640 1 -- 172.21.15.55:0/1102667303 <== mds.0 v2:172.21.15.55:6832/1965896660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555cedb59d00 con 0x555cedd8c2d0 2024-04-02T07:28:02.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a3b400640 10 client.7119 handle_command_reply: tid=0 2024-04-02T07:28:02.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 1 client.7119 shutdown 2024-04-02T07:28:02.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 1 -- 172.21.15.55:0/1102667303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd38a00 msgr2=0x555cedd41810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:02.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 1 --2- 172.21.15.55:0/1102667303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd38a00 0x555cedd41810 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f2a480825a0 tx=0x7f2a48058f90 comp rx=0 tx=0).stop 2024-04-02T07:28:02.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 1 -- 172.21.15.55:0/1102667303 shutdown_connections 2024-04-02T07:28:02.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 1 --2- 172.21.15.55:0/1102667303 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x555cedd8c2d0 0x555cedd8c6b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 1 --2- 172.21.15.55:0/1102667303 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd85390 0x555cedd68f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 1 --2- 172.21.15.55:0/1102667303 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd84a70 0x555cedd68a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 1 --2- 172.21.15.55:0/1102667303 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd38a00 0x555cedd41810 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a3b400640 0 client.7119 ms_handle_reset on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:02.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.415+0000 7f2a60464000 1 -- 172.21.15.55:0/1102667303 >> 172.21.15.55:0/1102667303 conn(0x555cedb39160 msgr2=0x555cedd37bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:02.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.419+0000 7f2a60464000 1 -- 172.21.15.55:0/1102667303 shutdown_connections 2024-04-02T07:28:02.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.419+0000 7f2a60464000 1 -- 172.21.15.55:0/1102667303 wait complete. 2024-04-02T07:28:02.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.419+0000 7f2a60464000 20 client.7119 trim_cache size 0 max 16384 2024-04-02T07:28:02.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.431+0000 7f2a60464000 1 Processor -- start 2024-04-02T07:28:02.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.431+0000 7f2a60464000 1 -- start start 2024-04-02T07:28:02.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.431+0000 7f2a60464000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd84a70 0x555cedd37c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.431+0000 7f2a60464000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd85390 0x555cedd38170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.431+0000 7f2a60464000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd38de0 0x555cedd391c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.431+0000 7f2a60464000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555ced846aa0 con 0x555cedd38de0 2024-04-02T07:28:02.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.431+0000 7f2a60464000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cedb8da90 con 0x555cedd85390 2024-04-02T07:28:02.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.431+0000 7f2a60464000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x555cedb872a0 con 0x555cedd84a70 2024-04-02T07:28:02.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a56800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd38de0 0x555cedd391c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a56800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd38de0 0x555cedd391c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51872/0 (socket says 172.21.15.55:51872) 2024-04-02T07:28:02.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a56800640 1 -- 172.21.15.55:0/528351168 learned_addr learned my addr 172.21.15.55:0/528351168 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:02.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a55e00640 1 --2- 172.21.15.55:0/528351168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd84a70 0x555cedd37c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a4fe00640 1 --2- 172.21.15.55:0/528351168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd85390 0x555cedd38170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a56800640 1 -- 172.21.15.55:0/528351168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd84a70 msgr2=0x555cedd37c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a56800640 1 --2- 172.21.15.55:0/528351168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd84a70 0x555cedd37c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a56800640 1 -- 172.21.15.55:0/528351168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd85390 msgr2=0x555cedd38170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a56800640 1 --2- 172.21.15.55:0/528351168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd85390 0x555cedd38170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a56800640 1 -- 172.21.15.55:0/528351168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555cedb34df0 con 0x555cedd38de0 2024-04-02T07:28:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a55e00640 1 --2- 172.21.15.55:0/528351168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd84a70 0x555cedd37c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:28:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a4fe00640 1 --2- 172.21.15.55:0/528351168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd85390 0x555cedd38170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:28:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a56800640 1 --2- 172.21.15.55:0/528351168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd38de0 0x555cedd391c0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f2a500154f0 tx=0x7f2a500159b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0678cdcfb07979d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:02.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a47400640 1 -- 172.21.15.55:0/528351168 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a500178e0 con 0x555cedd38de0 2024-04-02T07:28:02.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a47400640 1 -- 172.21.15.55:0/528351168 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5000f040 con 0x555cedd38de0 2024-04-02T07:28:02.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a47400640 1 -- 172.21.15.55:0/528351168 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a50017c80 con 0x555cedd38de0 2024-04-02T07:28:02.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a60464000 1 -- 172.21.15.55:0/528351168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd38de0 msgr2=0x555cedd391c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:02.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a60464000 1 --2- 172.21.15.55:0/528351168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd38de0 0x555cedd391c0 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f2a500154f0 tx=0x7f2a500159b0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a60464000 1 -- 172.21.15.55:0/528351168 shutdown_connections 2024-04-02T07:28:02.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a60464000 1 --2- 172.21.15.55:0/528351168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd38de0 0x555cedd391c0 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a60464000 1 --2- 172.21.15.55:0/528351168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd85390 0x555cedd38170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a60464000 1 --2- 172.21.15.55:0/528351168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd84a70 0x555cedd37c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a60464000 1 -- 172.21.15.55:0/528351168 >> 172.21.15.55:0/528351168 conn(0x555cedb39160 msgr2=0x555cedd40870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:02.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a60464000 1 -- 172.21.15.55:0/528351168 shutdown_connections 2024-04-02T07:28:02.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a60464000 1 -- 172.21.15.55:0/528351168 wait complete. 2024-04-02T07:28:02.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a60464000 1 -- start start 2024-04-02T07:28:02.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a60464000 1 Processor -- start 2024-04-02T07:28:02.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a60464000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd38de0 0x555cedd3c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a60464000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd84a70 0x555cedd3cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a60464000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd85390 0x555ceddcc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a60464000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cedb53ee0 con 0x555cedd84a70 2024-04-02T07:28:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a60464000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cedd68c80 con 0x555cedd85390 2024-04-02T07:28:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a60464000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x555cedc5a470 con 0x555cedd38de0 2024-04-02T07:28:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a60464000 10 client.0 _ll_register_callbacks cb 0x7f2a400096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:28:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a4fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd84a70 0x555cedd3cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a4fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd84a70 0x555cedd3cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51886/0 (socket says 172.21.15.55:51886) 2024-04-02T07:28:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.435+0000 7f2a4fe00640 1 -- 172.21.15.55:0/200399813 learned_addr learned my addr 172.21.15.55:0/200399813 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a55e00640 1 --2- 172.21.15.55:0/200399813 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd38de0 0x555cedd3c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a56800640 1 --2- 172.21.15.55:0/200399813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd85390 0x555ceddcc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a4fe00640 1 -- 172.21.15.55:0/200399813 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd38de0 msgr2=0x555cedd3c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a4fe00640 1 --2- 172.21.15.55:0/200399813 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd38de0 0x555cedd3c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a4fe00640 1 -- 172.21.15.55:0/200399813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd85390 msgr2=0x555ceddcc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:02.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a4fe00640 1 --2- 172.21.15.55:0/200399813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd85390 0x555ceddcc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a4fe00640 1 -- 172.21.15.55:0/200399813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a50009e10 con 0x555cedd84a70 2024-04-02T07:28:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a4fe00640 1 --2- 172.21.15.55:0/200399813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd84a70 0x555cedd3cd10 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f2a400ac040 tx=0x7f2a400046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ab2ead9062066c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a3b400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:28:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a3b400640 1 -- 172.21.15.55:0/200399813 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a400aa4d0 con 0x555cedd84a70 2024-04-02T07:28:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a3b400640 1 -- 172.21.15.55:0/200399813 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f2a400d2030 con 0x555cedd84a70 2024-04-02T07:28:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 1 -- 172.21.15.55:0/200399813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555cedb46970 con 0x555cedd84a70 2024-04-02T07:28:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a3b400640 1 -- 172.21.15.55:0/200399813 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2a400d21f0 con 0x555cedd84a70 2024-04-02T07:28:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 10 client.7125 fetch_fsmap learned FSMap version 51 2024-04-02T07:28:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 1 -- 172.21.15.55:0/200399813 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x555cedb28960 con 0x555cedd84a70 2024-04-02T07:28:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a3b400640 1 -- 172.21.15.55:0/200399813 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555cedb46970 con 0x555cedd84a70 2024-04-02T07:28:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a3b400640 1 -- 172.21.15.55:0/200399813 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 51) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2a400cf040 con 0x555cedd84a70 2024-04-02T07:28:02.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 10 client.7125 fetch_fsmap finished waiting for FSMap version 51 2024-04-02T07:28:02.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 10 client.7125 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-02T07:28:02.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 20 client.7125 populate_metadata read hostname 'smithi055' 2024-04-02T07:28:02.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 1 --2- 172.21.15.55:0/200399813 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x555cedd69320 0x555ceddccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 4 client.7125 mds_command: new command op to 6936 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-02T07:28:02.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 1 -- 172.21.15.55:0/200399813 --> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555cedbb8a20 con 0x555cedd69320 2024-04-02T07:28:02.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a55e00640 1 --2- 172.21.15.55:0/200399813 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x555cedd69320 0x555ceddccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a55e00640 1 --2- 172.21.15.55:0/200399813 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x555cedd69320 0x555ceddccbf0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14b49aa067552ac9 server_cookie=ed3325d63d29374d in_seq=0 out_seq=0 2024-04-02T07:28:02.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a3b400640 10 client.7125 ms_handle_connect on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:02.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a3b400640 1 -- 172.21.15.55:0/200399813 <== mds.0 v2:172.21.15.55:6832/1965896660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x555cedbb8a20 con 0x555cedd69320 2024-04-02T07:28:02.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a3b400640 10 client.7125 handle_command_reply: tid=0 2024-04-02T07:28:02.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 1 client.7125 shutdown 2024-04-02T07:28:02.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 1 -- 172.21.15.55:0/200399813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd84a70 msgr2=0x555cedd3cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:02.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 1 --2- 172.21.15.55:0/200399813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd84a70 0x555cedd3cd10 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f2a400ac040 tx=0x7f2a400046d0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 1 -- 172.21.15.55:0/200399813 shutdown_connections 2024-04-02T07:28:02.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 1 --2- 172.21.15.55:0/200399813 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x555cedd69320 0x555ceddccbf0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 1 --2- 172.21.15.55:0/200399813 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555cedd85390 0x555ceddcc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 1 --2- 172.21.15.55:0/200399813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555cedd84a70 0x555cedd3cd10 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a3b400640 0 client.7125 ms_handle_reset on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:02.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 1 --2- 172.21.15.55:0/200399813 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555cedd38de0 0x555cedd3c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 1 -- 172.21.15.55:0/200399813 >> 172.21.15.55:0/200399813 conn(0x555cedb39160 msgr2=0x555cedd36c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:02.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 1 -- 172.21.15.55:0/200399813 shutdown_connections 2024-04-02T07:28:02.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 1 -- 172.21.15.55:0/200399813 wait complete. 2024-04-02T07:28:02.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a60464000 20 client.7125 trim_cache size 0 max 16384 2024-04-02T07:28:02.448 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:28:02.449 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-04-02T07:28:02.449 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-04-02T07:28:02.449 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:28:02.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a57200640 1 -- 172.21.15.55:0/768619479 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2a34066690 msgr2=0x7f2a34068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:02.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a57200640 1 --2- 172.21.15.55:0/768619479 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2a34066690 0x7f2a34068b50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f2a400ae000 tx=0x7f2a400a7000 comp rx=0 tx=0).stop 2024-04-02T07:28:02.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a57200640 1 -- 172.21.15.55:0/768619479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a58099a90 msgr2=0x7f2a581528b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:02.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a57200640 1 --2- 172.21.15.55:0/768619479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a58099a90 0x7f2a581528b0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f2a4800c450 tx=0x7f2a4800c910 comp rx=0 tx=0).stop 2024-04-02T07:28:02.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a57200640 1 -- 172.21.15.55:0/768619479 shutdown_connections 2024-04-02T07:28:02.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a57200640 1 --2- 172.21.15.55:0/768619479 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2a34066690 0x7f2a34068b50 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a57200640 1 --2- 172.21.15.55:0/768619479 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2a5815a770 0x7f2a581f8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a57200640 1 --2- 172.21.15.55:0/768619479 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2a580ceac0 0x7f2a5814fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a57200640 1 --2- 172.21.15.55:0/768619479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2a58099a90 0x7f2a581528b0 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a57200640 1 -- 172.21.15.55:0/768619479 >> 172.21.15.55:0/768619479 conn(0x7f2a580b1ff0 msgr2=0x7f2a58159a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:02.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a57200640 1 -- 172.21.15.55:0/768619479 shutdown_connections 2024-04-02T07:28:02.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.439+0000 7f2a57200640 1 -- 172.21.15.55:0/768619479 wait complete. 2024-04-02T07:28:02.462 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-02T07:28:02.462 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:28:02.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.603+0000 7f8dc8800640 1 Processor -- start 2024-04-02T07:28:02.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.603+0000 7f8dc8800640 1 -- start start 2024-04-02T07:28:02.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.603+0000 7f8dc8800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8dc0143f90 0x7f8dc015ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.603+0000 7f8dc8800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8dc00b34f0 0x7f8dc00cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.603+0000 7f8dc8800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dc015b270 con 0x7f8dc00b3980 2024-04-02T07:28:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.603+0000 7f8dc8800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc0144370 con 0x7f8dc0143f90 2024-04-02T07:28:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.603+0000 7f8dc8800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dc00c37b0 con 0x7f8dc00b34f0 2024-04-02T07:28:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.603+0000 7f8dc5e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8dc0143f90 0x7f8dc015ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.603+0000 7f8dc5e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8dc0143f90 0x7f8dc015ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51892/0 (socket says 172.21.15.55:51892) 2024-04-02T07:28:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.603+0000 7f8dc5e00640 1 -- 172.21.15.55:0/397211640 learned_addr learned my addr 172.21.15.55:0/397211640 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:02.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.603+0000 7f8dc5400640 1 --2- 172.21.15.55:0/397211640 >> v2:172.21.15.106:3300/0 conn(0x7f8dc00b34f0 0x7f8dc00cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.603+0000 7f8dc5e00640 1 -- 172.21.15.55:0/397211640 >> v2:172.21.15.106:3300/0 conn(0x7f8dc00b34f0 msgr2=0x7f8dc00cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:02.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.603+0000 7f8dc5e00640 1 --2- 172.21.15.55:0/397211640 >> v2:172.21.15.106:3300/0 conn(0x7f8dc00b34f0 0x7f8dc00cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.603+0000 7f8dc5e00640 1 -- 172.21.15.55:0/397211640 >> v1:172.21.15.106:6789/0 conn(0x7f8dc00b3980 legacy=0x7f8dc00c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:02.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.603+0000 7f8dc5e00640 1 -- 172.21.15.55:0/397211640 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dc00c3a90 con 0x7f8dc0143f90 2024-04-02T07:28:02.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.607+0000 7f8dc5e00640 1 --2- 172.21.15.55:0/397211640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dc0143f90 0x7f8dc015ad30 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00b2d40 tx=0x7f8db401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcdfa6798ad91a8c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:02.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.607+0000 7f8dc4a00640 1 -- 172.21.15.55:0/397211640 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db40ab600 con 0x7f8dc0143f90 2024-04-02T07:28:02.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.607+0000 7f8dc4a00640 1 -- 172.21.15.55:0/397211640 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db40a7050 con 0x7f8dc0143f90 2024-04-02T07:28:02.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.607+0000 7f8dc4a00640 1 -- 172.21.15.55:0/397211640 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db40ab980 con 0x7f8dc0143f90 2024-04-02T07:28:02.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.607+0000 7f8dc8800640 1 -- 172.21.15.55:0/397211640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dc0143f90 msgr2=0x7f8dc015ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:02.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.607+0000 7f8dc8800640 1 --2- 172.21.15.55:0/397211640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dc0143f90 0x7f8dc015ad30 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f8dc00b2d40 tx=0x7f8db401c460 comp rx=0 tx=0).stop 2024-04-02T07:28:02.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.607+0000 7f8dc8800640 1 -- 172.21.15.55:0/397211640 shutdown_connections 2024-04-02T07:28:02.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.607+0000 7f8dc8800640 1 --2- 172.21.15.55:0/397211640 >> v2:172.21.15.106:3300/0 conn(0x7f8dc00b34f0 0x7f8dc00cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.607+0000 7f8dc8800640 1 --2- 172.21.15.55:0/397211640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dc0143f90 0x7f8dc015ad30 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.607+0000 7f8dc8800640 1 -- 172.21.15.55:0/397211640 >> 172.21.15.55:0/397211640 conn(0x7f8dc0066080 msgr2=0x7f8dc0069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:02.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.607+0000 7f8dc8800640 1 -- 172.21.15.55:0/397211640 shutdown_connections 2024-04-02T07:28:02.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.607+0000 7f8dc8800640 1 -- 172.21.15.55:0/397211640 wait complete. 2024-04-02T07:28:02.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.607+0000 7f8dc8800640 1 Processor -- start 2024-04-02T07:28:02.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.607+0000 7f8dc8800640 1 -- start start 2024-04-02T07:28:02.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dc8800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8dc00b34f0 0x7f8dc00c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dc8800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dc00b3980 0x7f8dc013ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dc8800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8dc0143f90 0x7f8dc0159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dc8800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc00ca130 con 0x7f8dc00b3980 2024-04-02T07:28:02.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dc8800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc00c9520 con 0x7f8dc0143f90 2024-04-02T07:28:02.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dc8800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dc00c9800 con 0x7f8dc00b34f0 2024-04-02T07:28:02.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dc5400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dc00b3980 0x7f8dc013ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dc5400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dc00b3980 0x7f8dc013ec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51904/0 (socket says 172.21.15.55:51904) 2024-04-02T07:28:02.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dc5400640 1 -- 172.21.15.55:0/1526016714 learned_addr learned my addr 172.21.15.55:0/1526016714 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:02.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dc5e00640 1 --2- 172.21.15.55:0/1526016714 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8dc00b34f0 0x7f8dc00c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dc6800640 1 --2- 172.21.15.55:0/1526016714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8dc0143f90 0x7f8dc0159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dc5400640 1 -- 172.21.15.55:0/1526016714 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8dc00b34f0 msgr2=0x7f8dc00c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:02.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dc5400640 1 --2- 172.21.15.55:0/1526016714 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8dc00b34f0 0x7f8dc00c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dc5400640 1 -- 172.21.15.55:0/1526016714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8dc0143f90 msgr2=0x7f8dc0159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:02.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dc5400640 1 --2- 172.21.15.55:0/1526016714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8dc0143f90 0x7f8dc0159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dc5400640 1 -- 172.21.15.55:0/1526016714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8db40094d0 con 0x7f8dc00b3980 2024-04-02T07:28:02.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dc5400640 1 --2- 172.21.15.55:0/1526016714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dc00b3980 0x7f8dc013ec60 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f8db000e930 tx=0x7f8db000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:02.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dba000640 1 -- 172.21.15.55:0/1526016714 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db0009690 con 0x7f8dc00b3980 2024-04-02T07:28:02.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dba000640 1 -- 172.21.15.55:0/1526016714 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8db000ca00 con 0x7f8dc00b3980 2024-04-02T07:28:02.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dba000640 1 -- 172.21.15.55:0/1526016714 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8db000cd70 con 0x7f8dc00b3980 2024-04-02T07:28:02.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dc8800640 1 -- 172.21.15.55:0/1526016714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc00c9ae0 con 0x7f8dc00b3980 2024-04-02T07:28:02.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dc8800640 1 -- 172.21.15.55:0/1526016714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dc00c9110 con 0x7f8dc00b3980 2024-04-02T07:28:02.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.611+0000 7f8dc8800640 1 -- 172.21.15.55:0/1526016714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dc0066c90 con 0x7f8dc00b3980 2024-04-02T07:28:02.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.615+0000 7f8dba000640 1 -- 172.21.15.55:0/1526016714 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8db0013470 con 0x7f8dc00b3980 2024-04-02T07:28:02.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.615+0000 7f8dba000640 1 --2- 172.21.15.55:0/1526016714 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8da40666c0 0x7f8da4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.615+0000 7f8dba000640 1 -- 172.21.15.55:0/1526016714 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8db0084480 con 0x7f8dc00b3980 2024-04-02T07:28:02.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.615+0000 7f8dc5e00640 1 --2- 172.21.15.55:0/1526016714 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8da40666c0 0x7f8da4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.615+0000 7f8dc5e00640 1 --2- 172.21.15.55:0/1526016714 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8da40666c0 0x7f8da4068b80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8db40ad000 tx=0x7f8db4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:02.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.619+0000 7f8dba000640 1 -- 172.21.15.55:0/1526016714 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f8db0051830 con 0x7f8dc00b3980 2024-04-02T07:28:02.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.819+0000 7f8dc8800640 1 -- 172.21.15.55:0/1526016714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8dc00b2880 con 0x7f8dc00b3980 2024-04-02T07:28:02.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.819+0000 7f8dba000640 1 -- 172.21.15.55:0/1526016714 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f8db0054e50 con 0x7f8dc00b3980 2024-04-02T07:28:02.822 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:02.823 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":51,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2000687874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2000687874},{"type":"v1","addr":"172.21.15.106:6835","nonce":2000687874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/823234890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":823234890},{"type":"v1","addr":"172.21.15.55:6835","nonce":823234890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6439,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1803758651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1803758651},{"type":"v1","addr":"172.21.15.106:6837","nonce":1803758651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:26:55.525186+0000","modified":"2024-04-02T07:27:25.433771+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":6,"addr":"172.21.15.55:6833/1965896660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1965896660},{"type":"v1","addr":"172.21.15.55:6833","nonce":1965896660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-02T07:28:02.823 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 51 2024-04-02T07:28:02.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.823+0000 7f8dc8800640 1 -- 172.21.15.55:0/1526016714 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8da40666c0 msgr2=0x7f8da4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:02.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.823+0000 7f8dc8800640 1 --2- 172.21.15.55:0/1526016714 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8da40666c0 0x7f8da4068b80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8db40ad000 tx=0x7f8db4008040 comp rx=0 tx=0).stop 2024-04-02T07:28:02.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.823+0000 7f8dc8800640 1 -- 172.21.15.55:0/1526016714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dc00b3980 msgr2=0x7f8dc013ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:02.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.823+0000 7f8dc8800640 1 --2- 172.21.15.55:0/1526016714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dc00b3980 0x7f8dc013ec60 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f8db000e930 tx=0x7f8db000edf0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.823+0000 7f8dc8800640 1 -- 172.21.15.55:0/1526016714 shutdown_connections 2024-04-02T07:28:02.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.823+0000 7f8dc8800640 1 --2- 172.21.15.55:0/1526016714 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8da40666c0 0x7f8da4068b80 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.823+0000 7f8dc8800640 1 --2- 172.21.15.55:0/1526016714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8dc0143f90 0x7f8dc0159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.823+0000 7f8dc8800640 1 --2- 172.21.15.55:0/1526016714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8dc00b3980 0x7f8dc013ec60 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.823+0000 7f8dc8800640 1 --2- 172.21.15.55:0/1526016714 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8dc00b34f0 0x7f8dc00c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.823+0000 7f8dc8800640 1 -- 172.21.15.55:0/1526016714 >> 172.21.15.55:0/1526016714 conn(0x7f8dc0066080 msgr2=0x7f8dc0164d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:02.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.823+0000 7f8dc8800640 1 -- 172.21.15.55:0/1526016714 shutdown_connections 2024-04-02T07:28:02.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.823+0000 7f8dc8800640 1 -- 172.21.15.55:0/1526016714 wait complete. 2024-04-02T07:28:02.844 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-02T07:28:02.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.983+0000 7f8fa8e00640 1 Processor -- start 2024-04-02T07:28:02.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.983+0000 7f8fa8e00640 1 -- start start 2024-04-02T07:28:02.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.983+0000 7f8fa8e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8fa4157000 0x7f8fa4071a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.983+0000 7f8fa8e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8fa406a4a0 0x7f8fa4160760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.983+0000 7f8fa8e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa415de90 con 0x7f8fa4071f60 2024-04-02T07:28:02.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.983+0000 7f8fa8e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa415d070 con 0x7f8fa4157000 2024-04-02T07:28:02.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.983+0000 7f8fa8e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa40723e0 con 0x7f8fa406a4a0 2024-04-02T07:28:02.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.987+0000 7f8fa1e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8fa4157000 0x7f8fa4071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.987+0000 7f8fa1e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8fa4157000 0x7f8fa4071a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51920/0 (socket says 172.21.15.55:51920) 2024-04-02T07:28:02.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.987+0000 7f8fa1e00640 1 -- 172.21.15.55:0/3937887080 learned_addr learned my addr 172.21.15.55:0/3937887080 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:02.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.987+0000 7f8fa2800640 1 --2- 172.21.15.55:0/3937887080 >> v2:172.21.15.106:3300/0 conn(0x7f8fa406a4a0 0x7f8fa4160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.987+0000 7f8fa1e00640 1 -- 172.21.15.55:0/3937887080 >> v2:172.21.15.106:3300/0 conn(0x7f8fa406a4a0 msgr2=0x7f8fa4160760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:02.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.987+0000 7f8fa1e00640 1 --2- 172.21.15.55:0/3937887080 >> v2:172.21.15.106:3300/0 conn(0x7f8fa406a4a0 0x7f8fa4160760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.987+0000 7f8fa1e00640 1 -- 172.21.15.55:0/3937887080 >> v1:172.21.15.106:6789/0 conn(0x7f8fa4071f60 legacy=0x7f8fa4069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:02.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.987+0000 7f8fa1e00640 1 -- 172.21.15.55:0/3937887080 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa415d280 con 0x7f8fa4157000 2024-04-02T07:28:02.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.987+0000 7f8fa1e00640 1 --2- 172.21.15.55:0/3937887080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa4157000 0x7f8fa4071a20 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40cc250 tx=0x7f8f9401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c693ce3709452a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:02.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.987+0000 7f8fa1400640 1 -- 172.21.15.55:0/3937887080 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f940aa650 con 0x7f8fa4157000 2024-04-02T07:28:02.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.987+0000 7f8fa1400640 1 -- 172.21.15.55:0/3937887080 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f940aa7b0 con 0x7f8fa4157000 2024-04-02T07:28:02.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.987+0000 7f8fa1400640 1 -- 172.21.15.55:0/3937887080 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f940aab40 con 0x7f8fa4157000 2024-04-02T07:28:02.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8fa8e00640 1 -- 172.21.15.55:0/3937887080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa4157000 msgr2=0x7f8fa4071a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:02.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8fa8e00640 1 --2- 172.21.15.55:0/3937887080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa4157000 0x7f8fa4071a20 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f8fa40cc250 tx=0x7f8f9401c4f0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8fa8e00640 1 -- 172.21.15.55:0/3937887080 shutdown_connections 2024-04-02T07:28:02.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8fa8e00640 1 --2- 172.21.15.55:0/3937887080 >> v2:172.21.15.106:3300/0 conn(0x7f8fa406a4a0 0x7f8fa4160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8fa8e00640 1 --2- 172.21.15.55:0/3937887080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa4157000 0x7f8fa4071a20 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8fa8e00640 1 -- 172.21.15.55:0/3937887080 >> 172.21.15.55:0/3937887080 conn(0x7f8fa40b13b0 msgr2=0x7f8fa40b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:02.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8fa8e00640 1 -- 172.21.15.55:0/3937887080 shutdown_connections 2024-04-02T07:28:02.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8fa8e00640 1 -- 172.21.15.55:0/3937887080 wait complete. 2024-04-02T07:28:02.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8fa8e00640 1 Processor -- start 2024-04-02T07:28:02.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8fa8e00640 1 -- start start 2024-04-02T07:28:02.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8fa8e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fa406a4a0 0x7f8fa40cb240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8fa8e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa4071f60 0x7f8fa4152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8fa8e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fa4157000 0x7f8fa40c9420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8fa8e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa40cadb0 con 0x7f8fa4071f60 2024-04-02T07:28:02.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8fa8e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa40ca1a0 con 0x7f8fa4157000 2024-04-02T07:28:02.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8fa8e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa40ca480 con 0x7f8fa406a4a0 2024-04-02T07:28:02.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8f9be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa4071f60 0x7f8fa4152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8f9be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa4071f60 0x7f8fa4152670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51924/0 (socket says 172.21.15.55:51924) 2024-04-02T07:28:02.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8f9be00640 1 -- 172.21.15.55:0/1254651477 learned_addr learned my addr 172.21.15.55:0/1254651477 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:02.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8fa2800640 1 --2- 172.21.15.55:0/1254651477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fa4157000 0x7f8fa40c9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8fa1e00640 1 --2- 172.21.15.55:0/1254651477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fa406a4a0 0x7f8fa40cb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8f9be00640 1 -- 172.21.15.55:0/1254651477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fa406a4a0 msgr2=0x7f8fa40cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:02.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8f9be00640 1 --2- 172.21.15.55:0/1254651477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fa406a4a0 0x7f8fa40cb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8f9be00640 1 -- 172.21.15.55:0/1254651477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fa4157000 msgr2=0x7f8fa40c9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:02.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8f9be00640 1 --2- 172.21.15.55:0/1254651477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fa4157000 0x7f8fa40c9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:02.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8f9be00640 1 -- 172.21.15.55:0/1254651477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f940094d0 con 0x7f8fa4071f60 2024-04-02T07:28:02.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.991+0000 7f8f9be00640 1 --2- 172.21.15.55:0/1254651477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa4071f60 0x7f8fa4152670 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00c500 tx=0x7f8f8c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:02.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.995+0000 7f8f9a000640 1 -- 172.21.15.55:0/1254651477 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c005220 con 0x7f8fa4071f60 2024-04-02T07:28:02.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.995+0000 7f8f9a000640 1 -- 172.21.15.55:0/1254651477 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c005380 con 0x7f8fa4071f60 2024-04-02T07:28:02.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.995+0000 7f8fa8e00640 1 -- 172.21.15.55:0/1254651477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa40ca760 con 0x7f8fa4071f60 2024-04-02T07:28:02.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.995+0000 7f8f9a000640 1 -- 172.21.15.55:0/1254651477 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c007270 con 0x7f8fa4071f60 2024-04-02T07:28:02.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.995+0000 7f8fa8e00640 1 -- 172.21.15.55:0/1254651477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa40cb780 con 0x7f8fa4071f60 2024-04-02T07:28:02.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.995+0000 7f8f9a000640 1 -- 172.21.15.55:0/1254651477 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8f8c0073d0 con 0x7f8fa4071f60 2024-04-02T07:28:02.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.995+0000 7f8f9a000640 1 --2- 172.21.15.55:0/1254651477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8f80066690 0x7f8f80068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:02.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.995+0000 7f8f9a000640 1 -- 172.21.15.55:0/1254651477 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8f8c083a80 con 0x7f8fa4071f60 2024-04-02T07:28:02.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fa1e00640 1 --2- 172.21.15.55:0/1254651477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8f80066690 0x7f8f80068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:02.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fac1bc000 1 Processor -- start 2024-04-02T07:28:02.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fac1bc000 1 -- start start 2024-04-02T07:28:03.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fa1e00640 1 --2- 172.21.15.55:0/1254651477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8f80066690 0x7f8f80068b50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8f940ae000 tx=0x7f8f940b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fac1bc000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 0x55e73cde6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fac1bc000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e73cde6bb0 0x55e73cd9cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fac1bc000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e73cd9d1b0 0x55e73cd9d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fac1bc000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e73cc65340 con 0x55e73cde6290 2024-04-02T07:28:03.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fac1bc000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e73cbf1cd0 con 0x55e73cd9d1b0 2024-04-02T07:28:03.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fac1bc000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e73cbef2a0 con 0x55e73cde6bb0 2024-04-02T07:28:03.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fa1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 0x55e73cde6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fa1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 0x55e73cde6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51938/0 (socket says 172.21.15.55:51938) 2024-04-02T07:28:03.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fa1e00640 1 -- 172.21.15.55:0/2544833987 learned_addr learned my addr 172.21.15.55:0/2544833987 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:03.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8f9be00640 1 --2- 172.21.15.55:0/2544833987 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e73cde6bb0 0x55e73cd9cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fa2800640 1 --2- 172.21.15.55:0/2544833987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e73cd9d1b0 0x55e73cd9d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fa1e00640 1 -- 172.21.15.55:0/2544833987 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e73cde6bb0 msgr2=0x55e73cd9cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fa1e00640 1 --2- 172.21.15.55:0/2544833987 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e73cde6bb0 0x55e73cd9cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fa1e00640 1 -- 172.21.15.55:0/2544833987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e73cd9d1b0 msgr2=0x55e73cd9d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fa1e00640 1 --2- 172.21.15.55:0/2544833987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e73cd9d1b0 0x55e73cd9d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fa1e00640 1 -- 172.21.15.55:0/2544833987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e73c8dd4b0 con 0x55e73cde6290 2024-04-02T07:28:03.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fa1e00640 1 --2- 172.21.15.55:0/2544833987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 0x55e73cde6670 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f8f94019100 tx=0x7f8f94004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9314ee5a3ce91d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8f92a00640 1 -- 172.21.15.55:0/2544833987 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f940bf960 con 0x55e73cde6290 2024-04-02T07:28:03.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8f92a00640 1 -- 172.21.15.55:0/2544833987 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f940bfac0 con 0x55e73cde6290 2024-04-02T07:28:03.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8f92a00640 1 -- 172.21.15.55:0/2544833987 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f940bfe30 con 0x55e73cde6290 2024-04-02T07:28:03.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fac1bc000 1 -- 172.21.15.55:0/2544833987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 msgr2=0x55e73cde6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fac1bc000 1 --2- 172.21.15.55:0/2544833987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 0x55e73cde6670 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f8f94019100 tx=0x7f8f94004740 comp rx=0 tx=0).stop 2024-04-02T07:28:03.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fac1bc000 1 -- 172.21.15.55:0/2544833987 shutdown_connections 2024-04-02T07:28:03.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fac1bc000 1 --2- 172.21.15.55:0/2544833987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e73cd9d1b0 0x55e73cd9d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fac1bc000 1 --2- 172.21.15.55:0/2544833987 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e73cde6bb0 0x55e73cd9cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fac1bc000 1 --2- 172.21.15.55:0/2544833987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 0x55e73cde6670 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fac1bc000 1 -- 172.21.15.55:0/2544833987 >> 172.21.15.55:0/2544833987 conn(0x55e73cd99160 msgr2=0x55e73cd9b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:03.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fac1bc000 1 -- 172.21.15.55:0/2544833987 shutdown_connections 2024-04-02T07:28:03.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fac1bc000 1 -- 172.21.15.55:0/2544833987 wait complete. 2024-04-02T07:28:03.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:02.999+0000 7f8fac1bc000 1 -- start start 2024-04-02T07:28:03.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fac1bc000 1 Processor -- start 2024-04-02T07:28:03.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fac1bc000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cd9d1b0 0x55e73cda26e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fac1bc000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e73cde6290 0x55e73cda2c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fac1bc000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e73cde6bb0 0x55e73cda7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fac1bc000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e73cbeab90 con 0x55e73cd9d1b0 2024-04-02T07:28:03.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fac1bc000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e73cba80a0 con 0x55e73cde6bb0 2024-04-02T07:28:03.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fac1bc000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e73cba7d40 con 0x55e73cde6290 2024-04-02T07:28:03.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fac1bc000 10 client.0 _ll_register_callbacks cb 0x55e73cc9fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:28:03.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fa1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cd9d1b0 0x55e73cda26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fa1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cd9d1b0 0x55e73cda26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51948/0 (socket says 172.21.15.55:51948) 2024-04-02T07:28:03.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fa1e00640 1 -- 172.21.15.55:0/314335919 learned_addr learned my addr 172.21.15.55:0/314335919 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:03.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fa2800640 1 --2- 172.21.15.55:0/314335919 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e73cde6bb0 0x55e73cda7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8f9be00640 1 --2- 172.21.15.55:0/314335919 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e73cde6290 0x55e73cda2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fa1e00640 1 -- 172.21.15.55:0/314335919 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e73cde6290 msgr2=0x55e73cda2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fa1e00640 1 --2- 172.21.15.55:0/314335919 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e73cde6290 0x55e73cda2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fa1e00640 1 -- 172.21.15.55:0/314335919 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e73cde6bb0 msgr2=0x55e73cda7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fa1e00640 1 --2- 172.21.15.55:0/314335919 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e73cde6bb0 0x55e73cda7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fa1e00640 1 -- 172.21.15.55:0/314335919 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa415d280 con 0x55e73cd9d1b0 2024-04-02T07:28:03.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fa1e00640 1 --2- 172.21.15.55:0/314335919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cd9d1b0 0x55e73cda26e0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f8f9401c9d0 tx=0x7f8f9401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f7a3319c183c7d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8f87400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:28:03.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8f87400640 1 -- 172.21.15.55:0/314335919 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f940d4480 con 0x55e73cd9d1b0 2024-04-02T07:28:03.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8f87400640 1 -- 172.21.15.55:0/314335919 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8f940d45e0 con 0x55e73cd9d1b0 2024-04-02T07:28:03.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fac1bc000 1 -- 172.21.15.55:0/314335919 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e73cbba550 con 0x55e73cd9d1b0 2024-04-02T07:28:03.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8f87400640 1 -- 172.21.15.55:0/314335919 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f940d47a0 con 0x55e73cd9d1b0 2024-04-02T07:28:03.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fac1bc000 10 client.7143 fetch_fsmap learned FSMap version 51 2024-04-02T07:28:03.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fac1bc000 1 -- 172.21.15.55:0/314335919 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55e73cbafba0 con 0x55e73cd9d1b0 2024-04-02T07:28:03.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8f87400640 1 -- 172.21.15.55:0/314335919 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e73cbba550 con 0x55e73cd9d1b0 2024-04-02T07:28:03.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8f87400640 1 -- 172.21.15.55:0/314335919 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 51) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8f940d4900 con 0x55e73cd9d1b0 2024-04-02T07:28:03.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fac1bc000 10 client.7143 fetch_fsmap finished waiting for FSMap version 51 2024-04-02T07:28:03.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fac1bc000 10 client.7143 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:28:03.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fac1bc000 20 client.7143 populate_metadata read hostname 'smithi055' 2024-04-02T07:28:03.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fac1bc000 1 --2- 172.21.15.55:0/314335919 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55e73cdf5320 0x55e73cdf7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fac1bc000 4 client.7143 mds_command: new command op to 6936 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:28:03.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8fac1bc000 1 -- 172.21.15.55:0/314335919 --> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e73cbe7970 con 0x55e73cdf5320 2024-04-02T07:28:03.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8f9be00640 1 --2- 172.21.15.55:0/314335919 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55e73cdf5320 0x55e73cdf7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8f9be00640 1 --2- 172.21.15.55:0/314335919 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55e73cdf5320 0x55e73cdf7710 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8184c66c621e6dd server_cookie=80edcce07496288a in_seq=0 out_seq=0 2024-04-02T07:28:03.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.003+0000 7f8f87400640 10 client.7143 ms_handle_connect on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:03.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.007+0000 7f8f87400640 1 -- 172.21.15.55:0/314335919 <== mds.0 v2:172.21.15.55:6832/1965896660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e73cbe7970 con 0x55e73cdf5320 2024-04-02T07:28:03.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.007+0000 7f8f87400640 10 client.7143 handle_command_reply: tid=0 2024-04-02T07:28:03.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.007+0000 7f8fac1bc000 1 client.7143 shutdown 2024-04-02T07:28:03.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.007+0000 7f8fac1bc000 1 -- 172.21.15.55:0/314335919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cd9d1b0 msgr2=0x55e73cda26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.007+0000 7f8fac1bc000 1 --2- 172.21.15.55:0/314335919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cd9d1b0 0x55e73cda26e0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f8f9401c9d0 tx=0x7f8f9401ad30 comp rx=0 tx=0).stop 2024-04-02T07:28:03.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.007+0000 7f8fac1bc000 1 -- 172.21.15.55:0/314335919 shutdown_connections 2024-04-02T07:28:03.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.007+0000 7f8fac1bc000 1 --2- 172.21.15.55:0/314335919 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55e73cdf5320 0x55e73cdf7710 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.007+0000 7f8fac1bc000 1 --2- 172.21.15.55:0/314335919 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e73cde6bb0 0x55e73cda7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.007+0000 7f8fac1bc000 1 --2- 172.21.15.55:0/314335919 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e73cde6290 0x55e73cda2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.007+0000 7f8fac1bc000 1 --2- 172.21.15.55:0/314335919 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cd9d1b0 0x55e73cda26e0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.007+0000 7f8f87400640 0 client.7143 ms_handle_reset on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:03.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.007+0000 7f8fac1bc000 1 -- 172.21.15.55:0/314335919 >> 172.21.15.55:0/314335919 conn(0x55e73cd99160 msgr2=0x55e73cd9bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:03.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.007+0000 7f8fac1bc000 1 -- 172.21.15.55:0/314335919 shutdown_connections 2024-04-02T07:28:03.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.007+0000 7f8fac1bc000 1 -- 172.21.15.55:0/314335919 wait complete. 2024-04-02T07:28:03.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.007+0000 7f8fac1bc000 20 client.7143 trim_cache size 0 max 16384 2024-04-02T07:28:03.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fac1bc000 1 Processor -- start 2024-04-02T07:28:03.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fac1bc000 1 -- start start 2024-04-02T07:28:03.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fac1bc000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e73cd9d1b0 0x55e73cd9c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fac1bc000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 0x55e73cd9caa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fac1bc000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e73cde6bb0 0x55e73cdf5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fac1bc000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e73c8a7c40 con 0x55e73cde6290 2024-04-02T07:28:03.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fac1bc000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e73cd945e0 con 0x55e73cde6bb0 2024-04-02T07:28:03.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fac1bc000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e73cbe9a20 con 0x55e73cd9d1b0 2024-04-02T07:28:03.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8f9be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 0x55e73cd9caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8f9be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 0x55e73cd9caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51954/0 (socket says 172.21.15.55:51954) 2024-04-02T07:28:03.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8f9be00640 1 -- 172.21.15.55:0/1760582119 learned_addr learned my addr 172.21.15.55:0/1760582119 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:03.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fa1e00640 1 --2- 172.21.15.55:0/1760582119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e73cd9d1b0 0x55e73cd9c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fa2800640 1 --2- 172.21.15.55:0/1760582119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e73cde6bb0 0x55e73cdf5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8f9be00640 1 -- 172.21.15.55:0/1760582119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e73cd9d1b0 msgr2=0x55e73cd9c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8f9be00640 1 --2- 172.21.15.55:0/1760582119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e73cd9d1b0 0x55e73cd9c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8f9be00640 1 -- 172.21.15.55:0/1760582119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e73cde6bb0 msgr2=0x55e73cdf5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8f9be00640 1 --2- 172.21.15.55:0/1760582119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e73cde6bb0 0x55e73cdf5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8f9be00640 1 -- 172.21.15.55:0/1760582119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e73cb95ef0 con 0x55e73cde6290 2024-04-02T07:28:03.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8f9be00640 1 --2- 172.21.15.55:0/1760582119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 0x55e73cd9caa0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c005630 tx=0x7f8f8c0012e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6446d5c53dc3b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8f93400640 1 -- 172.21.15.55:0/1760582119 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c081f90 con 0x55e73cde6290 2024-04-02T07:28:03.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8f93400640 1 -- 172.21.15.55:0/1760582119 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c070070 con 0x55e73cde6290 2024-04-02T07:28:03.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8f93400640 1 -- 172.21.15.55:0/1760582119 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c071230 con 0x55e73cde6290 2024-04-02T07:28:03.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fac1bc000 1 -- 172.21.15.55:0/1760582119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 msgr2=0x55e73cd9caa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fac1bc000 1 --2- 172.21.15.55:0/1760582119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 0x55e73cd9caa0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c005630 tx=0x7f8f8c0012e0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fac1bc000 1 -- 172.21.15.55:0/1760582119 shutdown_connections 2024-04-02T07:28:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fac1bc000 1 --2- 172.21.15.55:0/1760582119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e73cde6bb0 0x55e73cdf5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fac1bc000 1 --2- 172.21.15.55:0/1760582119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 0x55e73cd9caa0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fac1bc000 1 --2- 172.21.15.55:0/1760582119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e73cd9d1b0 0x55e73cd9c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fac1bc000 1 -- 172.21.15.55:0/1760582119 >> 172.21.15.55:0/1760582119 conn(0x55e73cd99160 msgr2=0x55e73cde4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fac1bc000 1 -- 172.21.15.55:0/1760582119 shutdown_connections 2024-04-02T07:28:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fac1bc000 1 -- 172.21.15.55:0/1760582119 wait complete. 2024-04-02T07:28:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fac1bc000 1 -- start start 2024-04-02T07:28:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.019+0000 7f8fac1bc000 1 Processor -- start 2024-04-02T07:28:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e73cd9d1b0 0x55e73cdf8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 0x55e73ce00ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e73cde6bb0 0x55e73ce01010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e73cbe6380 con 0x55e73cde6290 2024-04-02T07:28:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e73cb87a40 con 0x55e73cd9d1b0 2024-04-02T07:28:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e73cbb1e70 con 0x55e73cde6bb0 2024-04-02T07:28:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 10 client.0 _ll_register_callbacks cb 0x55e73cc88870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:28:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8f9be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 0x55e73ce00ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8f9be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 0x55e73ce00ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51962/0 (socket says 172.21.15.55:51962) 2024-04-02T07:28:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8f9be00640 1 -- 172.21.15.55:0/3393645956 learned_addr learned my addr 172.21.15.55:0/3393645956 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fa2800640 1 --2- 172.21.15.55:0/3393645956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e73cde6bb0 0x55e73ce01010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fa1e00640 1 --2- 172.21.15.55:0/3393645956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e73cd9d1b0 0x55e73cdf8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8f9be00640 1 -- 172.21.15.55:0/3393645956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e73cde6bb0 msgr2=0x55e73ce01010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8f9be00640 1 --2- 172.21.15.55:0/3393645956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e73cde6bb0 0x55e73ce01010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8f9be00640 1 -- 172.21.15.55:0/3393645956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e73cd9d1b0 msgr2=0x55e73cdf8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8f9be00640 1 --2- 172.21.15.55:0/3393645956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e73cd9d1b0 0x55e73cdf8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8f9be00640 1 -- 172.21.15.55:0/3393645956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa40cb780 con 0x55e73cde6290 2024-04-02T07:28:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8f9be00640 1 --2- 172.21.15.55:0/3393645956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 0x55e73ce00ad0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00cec0 tx=0x7f8f8c001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4fb4eed8a0bb3b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8f87400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:28:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8f87400640 1 -- 172.21.15.55:0/3393645956 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c081070 con 0x55e73cde6290 2024-04-02T07:28:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8f87400640 1 -- 172.21.15.55:0/3393645956 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8f8c071230 con 0x55e73cde6290 2024-04-02T07:28:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 1 -- 172.21.15.55:0/3393645956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e73cda0070 con 0x55e73cde6290 2024-04-02T07:28:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8f87400640 1 -- 172.21.15.55:0/3393645956 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f8c051150 con 0x55e73cde6290 2024-04-02T07:28:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 10 client.7149 fetch_fsmap learned FSMap version 51 2024-04-02T07:28:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 1 -- 172.21.15.55:0/3393645956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55e73c8e6fc0 con 0x55e73cde6290 2024-04-02T07:28:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8f87400640 1 -- 172.21.15.55:0/3393645956 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e73cda0070 con 0x55e73cde6290 2024-04-02T07:28:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8f87400640 1 -- 172.21.15.55:0/3393645956 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 51) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8f8c019030 con 0x55e73cde6290 2024-04-02T07:28:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 10 client.7149 fetch_fsmap finished waiting for FSMap version 51 2024-04-02T07:28:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 10 client.7149 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:28:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 20 client.7149 populate_metadata read hostname 'smithi055' 2024-04-02T07:28:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 1 --2- 172.21.15.55:0/3393645956 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55e73ce01550 0x55e73ce44ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 4 client.7149 mds_command: new command op to 6936 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-02T07:28:03.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 1 -- 172.21.15.55:0/3393645956 --> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x55e73cb9a620 con 0x55e73ce01550 2024-04-02T07:28:03.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fa1e00640 1 --2- 172.21.15.55:0/3393645956 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55e73ce01550 0x55e73ce44ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fa1e00640 1 --2- 172.21.15.55:0/3393645956 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55e73ce01550 0x55e73ce44ab0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96edef90e260d946 server_cookie=7747629482163f05 in_seq=0 out_seq=0 2024-04-02T07:28:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8f87400640 10 client.7149 ms_handle_connect on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8f87400640 1 -- 172.21.15.55:0/3393645956 <== mds.0 v2:172.21.15.55:6832/1965896660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+237 (crc 0 0 0) 0x55e73cb9a620 con 0x55e73ce01550 2024-04-02T07:28:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8f87400640 10 client.7149 handle_command_reply: tid=0 2024-04-02T07:28:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 1 client.7149 shutdown 2024-04-02T07:28:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 1 -- 172.21.15.55:0/3393645956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 msgr2=0x55e73ce00ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 1 --2- 172.21.15.55:0/3393645956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 0x55e73ce00ad0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00cec0 tx=0x7f8f8c001130 comp rx=0 tx=0).stop 2024-04-02T07:28:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 1 -- 172.21.15.55:0/3393645956 shutdown_connections 2024-04-02T07:28:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 1 --2- 172.21.15.55:0/3393645956 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55e73ce01550 0x55e73ce44ab0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 1 --2- 172.21.15.55:0/3393645956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e73cde6bb0 0x55e73ce01010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 1 --2- 172.21.15.55:0/3393645956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e73cde6290 0x55e73ce00ad0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8f87400640 0 client.7149 ms_handle_reset on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:03.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 1 --2- 172.21.15.55:0/3393645956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e73cd9d1b0 0x55e73cdf8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 1 -- 172.21.15.55:0/3393645956 >> 172.21.15.55:0/3393645956 conn(0x55e73cd99160 msgr2=0x55e73cde4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:03.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.023+0000 7f8fac1bc000 1 -- 172.21.15.55:0/3393645956 shutdown_connections 2024-04-02T07:28:03.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.027+0000 7f8fac1bc000 1 -- 172.21.15.55:0/3393645956 wait complete. 2024-04-02T07:28:03.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.027+0000 7f8fac1bc000 20 client.7149 trim_cache size 0 max 16384 2024-04-02T07:28:03.031 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:03.031 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-02T07:28:03.031 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:03.031 INFO:teuthology.orchestra.run.smithi055.stdout: "damage_type": "dentry", 2024-04-02T07:28:03.031 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 2223227260, 2024-04-02T07:28:03.031 INFO:teuthology.orchestra.run.smithi055.stdout: "ino": 1099511627776, 2024-04-02T07:28:03.032 INFO:teuthology.orchestra.run.smithi055.stdout: "frag": "*", 2024-04-02T07:28:03.032 INFO:teuthology.orchestra.run.smithi055.stdout: "dname": "file_to_be_damaged", 2024-04-02T07:28:03.032 INFO:teuthology.orchestra.run.smithi055.stdout: "snap_id": "head", 2024-04-02T07:28:03.032 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/subdir/file_to_be_damaged" 2024-04-02T07:28:03.032 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:03.032 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-02T07:28:03.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.027+0000 7f8fa8e00640 1 -- 172.21.15.55:0/1254651477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8f80066690 msgr2=0x7f8f80068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.027+0000 7f8fa8e00640 1 --2- 172.21.15.55:0/1254651477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8f80066690 0x7f8f80068b50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f8f940ae000 tx=0x7f8f940b5040 comp rx=0 tx=0).stop 2024-04-02T07:28:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.027+0000 7f8fa8e00640 1 -- 172.21.15.55:0/1254651477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa4071f60 msgr2=0x7f8fa4152670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.027+0000 7f8fa8e00640 1 --2- 172.21.15.55:0/1254651477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa4071f60 0x7f8fa4152670 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c00c500 tx=0x7f8f8c00c9c0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.027+0000 7f8fa8e00640 1 -- 172.21.15.55:0/1254651477 shutdown_connections 2024-04-02T07:28:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.027+0000 7f8fa8e00640 1 --2- 172.21.15.55:0/1254651477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8f80066690 0x7f8f80068b50 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.027+0000 7f8fa8e00640 1 --2- 172.21.15.55:0/1254651477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fa4157000 0x7f8fa40c9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.027+0000 7f8fa8e00640 1 --2- 172.21.15.55:0/1254651477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa4071f60 0x7f8fa4152670 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.027+0000 7f8fa8e00640 1 --2- 172.21.15.55:0/1254651477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fa406a4a0 0x7f8fa40cb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.027+0000 7f8fa8e00640 1 -- 172.21.15.55:0/1254651477 >> 172.21.15.55:0/1254651477 conn(0x7f8fa40b13b0 msgr2=0x7f8fa40ceb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.027+0000 7f8fa8e00640 1 -- 172.21.15.55:0/1254651477 shutdown_connections 2024-04-02T07:28:03.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.027+0000 7f8fa8e00640 1 -- 172.21.15.55:0/1254651477 wait complete. 2024-04-02T07:28:03.046 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-02T07:28:03.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.183+0000 7fd8cae00640 1 Processor -- start 2024-04-02T07:28:03.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.183+0000 7fd8cae00640 1 -- start start 2024-04-02T07:28:03.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.187+0000 7fd8cae00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c4071190 0x7fd8c4065d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.187+0000 7fd8cae00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c406d5b0 con 0x7fd8c415cbe0 2024-04-02T07:28:03.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.187+0000 7fd8cae00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c406cc80 con 0x7fd8c40ce630 2024-04-02T07:28:03.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.187+0000 7fd8cae00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c40cec10 con 0x7fd8c4071190 2024-04-02T07:28:03.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.187+0000 7fd8c3e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd8c415cbe0 0x7fd8c40b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44132/0 (socket says 172.21.15.55:44132) 2024-04-02T07:28:03.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.187+0000 7fd8c3e00640 1 -- 172.21.15.55:0/2760269613 learned_addr learned my addr 172.21.15.55:0/2760269613 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:03.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.187+0000 7fd8c8e00640 1 --2- 172.21.15.55:0/2760269613 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c4071190 0x7fd8c4065d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.187+0000 7fd8c3400640 1 -- 172.21.15.55:0/2760269613 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1070455445 0 0) 0x7fd8c406d5b0 con 0x7fd8c415cbe0 2024-04-02T07:28:03.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.187+0000 7fd8c3400640 1 -- 172.21.15.55:0/2760269613 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8a8003530 con 0x7fd8c415cbe0 2024-04-02T07:28:03.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.187+0000 7fd8c3400640 1 -- 172.21.15.55:0/2760269613 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427775261 0 0) 0x7fd8c406cc80 con 0x7fd8c40ce630 2024-04-02T07:28:03.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.187+0000 7fd8c3400640 1 -- 172.21.15.55:0/2760269613 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd8c406d5b0 con 0x7fd8c40ce630 2024-04-02T07:28:03.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.187+0000 7fd8c8e00640 1 -- 172.21.15.55:0/2760269613 >> v1:172.21.15.106:6789/0 conn(0x7fd8c40ce630 legacy=0x7fd8c4070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.187+0000 7fd8c8e00640 1 -- 172.21.15.55:0/2760269613 >> v1:172.21.15.55:6789/0 conn(0x7fd8c415cbe0 legacy=0x7fd8c40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.187+0000 7fd8c8e00640 1 -- 172.21.15.55:0/2760269613 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c406cf60 con 0x7fd8c4071190 2024-04-02T07:28:03.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.191+0000 7fd8c8e00640 1 --2- 172.21.15.55:0/2760269613 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c4071190 0x7fd8c4065d20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc009dc0 tx=0x7fd8bc01c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44291836bb462fc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.191+0000 7fd8c3400640 1 -- 172.21.15.55:0/2760269613 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc0a5850 con 0x7fd8c4071190 2024-04-02T07:28:03.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.191+0000 7fd8c3400640 1 -- 172.21.15.55:0/2760269613 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc0a59b0 con 0x7fd8c4071190 2024-04-02T07:28:03.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.191+0000 7fd8c3400640 1 -- 172.21.15.55:0/2760269613 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc0a5d40 con 0x7fd8c4071190 2024-04-02T07:28:03.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.191+0000 7fd8cae00640 1 -- 172.21.15.55:0/2760269613 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c4071190 msgr2=0x7fd8c4065d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.191+0000 7fd8cae00640 1 --2- 172.21.15.55:0/2760269613 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c4071190 0x7fd8c4065d20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc009dc0 tx=0x7fd8bc01c990 comp rx=0 tx=0).stop 2024-04-02T07:28:03.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.191+0000 7fd8cae00640 1 -- 172.21.15.55:0/2760269613 shutdown_connections 2024-04-02T07:28:03.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.191+0000 7fd8cae00640 1 --2- 172.21.15.55:0/2760269613 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c4071190 0x7fd8c4065d20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.191+0000 7fd8cae00640 1 -- 172.21.15.55:0/2760269613 >> 172.21.15.55:0/2760269613 conn(0x7fd8c40ced50 msgr2=0x7fd8c40cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:03.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.191+0000 7fd8cae00640 1 -- 172.21.15.55:0/2760269613 shutdown_connections 2024-04-02T07:28:03.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.191+0000 7fd8cae00640 1 -- 172.21.15.55:0/2760269613 wait complete. 2024-04-02T07:28:03.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.191+0000 7fd8cae00640 1 Processor -- start 2024-04-02T07:28:03.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.191+0000 7fd8cae00640 1 -- start start 2024-04-02T07:28:03.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8cae00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8c4071190 0x7fd8c41508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8cae00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c40ce630 0x7fd8c415f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8cae00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c415cbe0 0x7fd8c415d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8cae00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c4151130 con 0x7fd8c415cbe0 2024-04-02T07:28:03.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8cae00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c41f4ca0 con 0x7fd8c4071190 2024-04-02T07:28:03.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8cae00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c414f820 con 0x7fd8c40ce630 2024-04-02T07:28:03.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8c8e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c415cbe0 0x7fd8c415d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8c8e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c415cbe0 0x7fd8c415d430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51976/0 (socket says 172.21.15.55:51976) 2024-04-02T07:28:03.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8c8e00640 1 -- 172.21.15.55:0/1546126939 learned_addr learned my addr 172.21.15.55:0/1546126939 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:03.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8c3e00640 1 --2- 172.21.15.55:0/1546126939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8c4071190 0x7fd8c41508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8bb400640 1 --2- 172.21.15.55:0/1546126939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c40ce630 0x7fd8c415f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8c8e00640 1 -- 172.21.15.55:0/1546126939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c40ce630 msgr2=0x7fd8c415f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8c8e00640 1 --2- 172.21.15.55:0/1546126939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c40ce630 0x7fd8c415f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8c8e00640 1 -- 172.21.15.55:0/1546126939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8c4071190 msgr2=0x7fd8c41508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8c8e00640 1 --2- 172.21.15.55:0/1546126939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8c4071190 0x7fd8c41508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8c8e00640 1 -- 172.21.15.55:0/1546126939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8bc009a70 con 0x7fd8c415cbe0 2024-04-02T07:28:03.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8c8e00640 1 --2- 172.21.15.55:0/1546126939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c415cbe0 0x7fd8c415d430 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0195a0 tx=0x7fd8bc019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8c0c00640 1 -- 172.21.15.55:0/1546126939 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc0ad640 con 0x7fd8c415cbe0 2024-04-02T07:28:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8c0c00640 1 -- 172.21.15.55:0/1546126939 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc0ad7a0 con 0x7fd8c415cbe0 2024-04-02T07:28:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8cae00640 1 -- 172.21.15.55:0/1546126939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c414fb00 con 0x7fd8c415cbe0 2024-04-02T07:28:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8c0c00640 1 -- 172.21.15.55:0/1546126939 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc0adb90 con 0x7fd8c415cbe0 2024-04-02T07:28:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8cae00640 1 -- 172.21.15.55:0/1546126939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c41500c0 con 0x7fd8c415cbe0 2024-04-02T07:28:03.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8cae00640 1 -- 172.21.15.55:0/1546126939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c4066c90 con 0x7fd8c415cbe0 2024-04-02T07:28:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.195+0000 7fd8c0c00640 1 -- 172.21.15.55:0/1546126939 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd8bc0b4050 con 0x7fd8c415cbe0 2024-04-02T07:28:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.199+0000 7fd8c0c00640 1 --2- 172.21.15.55:0/1546126939 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd8a0066690 0x7fd8a0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.199+0000 7fd8c0c00640 1 -- 172.21.15.55:0/1546126939 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd8bc11f1e0 con 0x7fd8c415cbe0 2024-04-02T07:28:03.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.199+0000 7fd8c3e00640 1 --2- 172.21.15.55:0/1546126939 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd8a0066690 0x7fd8a0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.199+0000 7fd8c3e00640 1 --2- 172.21.15.55:0/1546126939 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd8a0066690 0x7fd8a0068b50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4007fd0 tx=0x7fd8b4007d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.203+0000 7fd8c0c00640 1 -- 172.21.15.55:0/1546126939 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd8bc0ec7e0 con 0x7fd8c415cbe0 2024-04-02T07:28:03.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.399+0000 7fd8cae00640 1 -- 172.21.15.55:0/1546126939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd8c4070c90 con 0x7fd8c415cbe0 2024-04-02T07:28:03.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.399+0000 7fd8c0c00640 1 -- 172.21.15.55:0/1546126939 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7fd8bc0efe00 con 0x7fd8c415cbe0 2024-04-02T07:28:03.401 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:03.401 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-02T07:28:03.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.399+0000 7fd8cae00640 1 -- 172.21.15.55:0/1546126939 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd8a0066690 msgr2=0x7fd8a0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.399+0000 7fd8cae00640 1 --2- 172.21.15.55:0/1546126939 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd8a0066690 0x7fd8a0068b50 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd8b4007fd0 tx=0x7fd8b4007d80 comp rx=0 tx=0).stop 2024-04-02T07:28:03.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.399+0000 7fd8cae00640 1 -- 172.21.15.55:0/1546126939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c415cbe0 msgr2=0x7fd8c415d430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.399+0000 7fd8cae00640 1 --2- 172.21.15.55:0/1546126939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c415cbe0 0x7fd8c415d430 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc0195a0 tx=0x7fd8bc019730 comp rx=0 tx=0).stop 2024-04-02T07:28:03.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.399+0000 7fd8cae00640 1 -- 172.21.15.55:0/1546126939 shutdown_connections 2024-04-02T07:28:03.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.399+0000 7fd8cae00640 1 --2- 172.21.15.55:0/1546126939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c415cbe0 0x7fd8c415d430 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.399+0000 7fd8cae00640 1 --2- 172.21.15.55:0/1546126939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c40ce630 0x7fd8c415f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.399+0000 7fd8cae00640 1 --2- 172.21.15.55:0/1546126939 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd8a0066690 0x7fd8a0068b50 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.399+0000 7fd8cae00640 1 --2- 172.21.15.55:0/1546126939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8c4071190 0x7fd8c41508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.399+0000 7fd8cae00640 1 -- 172.21.15.55:0/1546126939 >> 172.21.15.55:0/1546126939 conn(0x7fd8c40ced50 msgr2=0x7fd8c40cdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:03.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.399+0000 7fd8cae00640 1 -- 172.21.15.55:0/1546126939 shutdown_connections 2024-04-02T07:28:03.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.399+0000 7fd8cae00640 1 -- 172.21.15.55:0/1546126939 wait complete. 2024-04-02T07:28:03.422 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-02T07:28:03.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:03.423 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub start /subdir repair,recursive 2024-04-02T07:28:03.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4149600640 1 Processor -- start 2024-04-02T07:28:03.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4149600640 1 -- start start 2024-04-02T07:28:03.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4149600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f414406d1c0 0x7f41440b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4149600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41440afe70 0x7f41440c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4149600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41440b1d60 con 0x7f414415ce40 2024-04-02T07:28:03.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4149600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f414406cda0 con 0x7f414406d1c0 2024-04-02T07:28:03.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4149600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f414406c400 con 0x7f41440afe70 2024-04-02T07:28:03.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4142a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f414415ce40 0x7f41440b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44138/0 (socket says 172.21.15.55:44138) 2024-04-02T07:28:03.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4142a00640 1 -- 172.21.15.55:0/1873188140 learned_addr learned my addr 172.21.15.55:0/1873188140 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:03.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4142000640 1 -- 172.21.15.55:0/1873188140 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3133194234 0 0) 0x7f41440b1d60 con 0x7f414415ce40 2024-04-02T07:28:03.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f413be00640 1 --2- 172.21.15.55:0/1873188140 >> v2:172.21.15.106:3300/0 conn(0x7f414406d1c0 0x7f41440b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4143400640 1 --2- 172.21.15.55:0/1873188140 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41440afe70 0x7f41440c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4142000640 1 -- 172.21.15.55:0/1873188140 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4128003530 con 0x7f414415ce40 2024-04-02T07:28:03.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4142000640 1 -- 172.21.15.55:0/1873188140 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4264136404 0 0) 0x7f4128003530 con 0x7f414415ce40 2024-04-02T07:28:03.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4142000640 1 -- 172.21.15.55:0/1873188140 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41440afe70 msgr2=0x7f41440c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4142000640 1 --2- 172.21.15.55:0/1873188140 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41440afe70 0x7f41440c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4142000640 1 -- 172.21.15.55:0/1873188140 >> v2:172.21.15.106:3300/0 conn(0x7f414406d1c0 msgr2=0x7f41440b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4142000640 1 --2- 172.21.15.55:0/1873188140 >> v2:172.21.15.106:3300/0 conn(0x7f414406d1c0 0x7f41440b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4142000640 1 -- 172.21.15.55:0/1873188140 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414406c6e0 con 0x7f414415ce40 2024-04-02T07:28:03.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4142000640 1 -- 172.21.15.55:0/1873188140 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f41340016a0 con 0x7f414415ce40 2024-04-02T07:28:03.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4142000640 1 -- 172.21.15.55:0/1873188140 >> v1:172.21.15.55:6789/0 conn(0x7f414415ce40 legacy=0x7f41440b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4142000640 1 --2- 172.21.15.55:0/1873188140 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41440afe70 0x7f4128003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4142000640 1 --2- 172.21.15.55:0/1873188140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4128003f50 0x7f41280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4142000640 1 --2- 172.21.15.55:0/1873188140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4128004d10 0x7f4128005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4142000640 1 -- 172.21.15.55:0/1873188140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414406cda0 con 0x7f4128004d10 2024-04-02T07:28:03.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4142000640 1 -- 172.21.15.55:0/1873188140 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414406c400 con 0x7f4128003f50 2024-04-02T07:28:03.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.567+0000 7f4142000640 1 -- 172.21.15.55:0/1873188140 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f412800ba40 con 0x7f41440afe70 2024-04-02T07:28:03.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.571+0000 7f4143400640 1 --2- 172.21.15.55:0/1873188140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4128004d10 0x7f4128005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.571+0000 7f4142a00640 1 --2- 172.21.15.55:0/1873188140 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41440afe70 0x7f4128003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.571+0000 7f413be00640 1 --2- 172.21.15.55:0/1873188140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4128003f50 0x7f41280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.571+0000 7f4143400640 1 -- 172.21.15.55:0/1873188140 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41440afe70 msgr2=0x7f4128003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.571+0000 7f4143400640 1 --2- 172.21.15.55:0/1873188140 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41440afe70 0x7f4128003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.571+0000 7f4143400640 1 -- 172.21.15.55:0/1873188140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4128003f50 msgr2=0x7f41280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.571+0000 7f4143400640 1 --2- 172.21.15.55:0/1873188140 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4128003f50 0x7f41280047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.571+0000 7f4143400640 1 -- 172.21.15.55:0/1873188140 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4128003530 con 0x7f4128004d10 2024-04-02T07:28:03.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.571+0000 7f4143400640 1 --2- 172.21.15.55:0/1873188140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4128004d10 0x7f4128005190 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f413c009fc0 tx=0x7f413c01cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce11c9f0abb1604 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.571+0000 7f4142000640 1 -- 172.21.15.55:0/1873188140 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c0a5c90 con 0x7f4128004d10 2024-04-02T07:28:03.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.571+0000 7f4142000640 1 -- 172.21.15.55:0/1873188140 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c00f040 con 0x7f4128004d10 2024-04-02T07:28:03.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.571+0000 7f4142000640 1 -- 172.21.15.55:0/1873188140 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c0ad440 con 0x7f4128004d10 2024-04-02T07:28:03.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f4149600640 1 -- 172.21.15.55:0/1873188140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4128004d10 msgr2=0x7f4128005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f4149600640 1 --2- 172.21.15.55:0/1873188140 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4128004d10 0x7f4128005190 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f413c009fc0 tx=0x7f413c01cc80 comp rx=0 tx=0).stop 2024-04-02T07:28:03.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f4143400640 1 -- 172.21.15.55:0/1873188140 reap_dead start 2024-04-02T07:28:03.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f4149600640 1 -- 172.21.15.55:0/1873188140 shutdown_connections 2024-04-02T07:28:03.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f4149600640 1 -- 172.21.15.55:0/1873188140 >> 172.21.15.55:0/1873188140 conn(0x7f4144069d90 msgr2=0x7f414406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:03.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f4149600640 1 -- 172.21.15.55:0/1873188140 shutdown_connections 2024-04-02T07:28:03.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f4149600640 1 -- 172.21.15.55:0/1873188140 wait complete. 2024-04-02T07:28:03.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f4149600640 1 Processor -- start 2024-04-02T07:28:03.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f4149600640 1 -- start start 2024-04-02T07:28:03.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f4149600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4128004d10 0x7f4144158670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f4149600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41441f6080 0x7f4144149ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f4149600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41440c9e50 0x7f41440ca2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f4149600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41440ca810 con 0x7f41441f6080 2024-04-02T07:28:03.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f4149600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f414415a440 con 0x7f4128004d10 2024-04-02T07:28:03.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f4149600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4144158cc0 con 0x7f41440c9e50 2024-04-02T07:28:03.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f413be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41441f6080 0x7f4144149ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f413be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41441f6080 0x7f4144149ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51994/0 (socket says 172.21.15.55:51994) 2024-04-02T07:28:03.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f413be00640 1 -- 172.21.15.55:0/1647931186 learned_addr learned my addr 172.21.15.55:0/1647931186 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:03.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f4142a00640 1 --2- 172.21.15.55:0/1647931186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4128004d10 0x7f4144158670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f4143400640 1 --2- 172.21.15.55:0/1647931186 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41440c9e50 0x7f41440ca2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f413be00640 1 -- 172.21.15.55:0/1647931186 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41440c9e50 msgr2=0x7f41440ca2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f413be00640 1 --2- 172.21.15.55:0/1647931186 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41440c9e50 0x7f41440ca2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f413be00640 1 -- 172.21.15.55:0/1647931186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4128004d10 msgr2=0x7f4144158670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f413be00640 1 --2- 172.21.15.55:0/1647931186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4128004d10 0x7f4144158670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f413be00640 1 -- 172.21.15.55:0/1647931186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414415a690 con 0x7f41441f6080 2024-04-02T07:28:03.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.575+0000 7f413be00640 1 --2- 172.21.15.55:0/1647931186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41441f6080 0x7f4144149ca0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f412c011a00 tx=0x7f412c011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.579+0000 7f413aa00640 1 -- 172.21.15.55:0/1647931186 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c00faf0 con 0x7f41441f6080 2024-04-02T07:28:03.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.579+0000 7f413aa00640 1 -- 172.21.15.55:0/1647931186 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412c00fc50 con 0x7f41441f6080 2024-04-02T07:28:03.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.579+0000 7f413aa00640 1 -- 172.21.15.55:0/1647931186 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c014440 con 0x7f41441f6080 2024-04-02T07:28:03.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.579+0000 7f4149600640 1 -- 172.21.15.55:0/1647931186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f414415a970 con 0x7f41441f6080 2024-04-02T07:28:03.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.579+0000 7f4149600640 1 -- 172.21.15.55:0/1647931186 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41441f64e0 con 0x7f41441f6080 2024-04-02T07:28:03.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.579+0000 7f413aa00640 1 -- 172.21.15.55:0/1647931186 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f412c0145a0 con 0x7f41441f6080 2024-04-02T07:28:03.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.579+0000 7f413aa00640 1 --2- 172.21.15.55:0/1647931186 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41200666e0 0x7f4120068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.579+0000 7f413aa00640 1 -- 172.21.15.55:0/1647931186 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f412c084b10 con 0x7f41441f6080 2024-04-02T07:28:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f4142a00640 1 --2- 172.21.15.55:0/1647931186 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41200666e0 0x7f4120068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f414cad8000 1 Processor -- start 2024-04-02T07:28:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f414cad8000 1 -- start start 2024-04-02T07:28:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f4142a00640 1 --2- 172.21.15.55:0/1647931186 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41200666e0 0x7f4120068ba0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4134001ec0 tx=0x7f4134009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f414cad8000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187ca2a00 0x55c187ca2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f414cad8000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca3320 0x55c187c58830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f414cad8000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187c58d70 0x55c187c59150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f414cad8000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c187b20820 con 0x55c187c58d70 2024-04-02T07:28:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f414cad8000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c187aada20 con 0x55c187ca2a00 2024-04-02T07:28:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f414cad8000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c187aaaff0 con 0x55c187ca3320 2024-04-02T07:28:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f4143400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187c58d70 0x55c187c59150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f4143400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187c58d70 0x55c187c59150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52010/0 (socket says 172.21.15.55:52010) 2024-04-02T07:28:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f4143400640 1 -- 172.21.15.55:0/1157343643 learned_addr learned my addr 172.21.15.55:0/1157343643 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f4142a00640 1 --2- 172.21.15.55:0/1157343643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187ca2a00 0x55c187ca2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f413be00640 1 --2- 172.21.15.55:0/1157343643 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca3320 0x55c187c58830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f4143400640 1 -- 172.21.15.55:0/1157343643 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca3320 msgr2=0x55c187c58830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f4143400640 1 --2- 172.21.15.55:0/1157343643 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca3320 0x55c187c58830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f4143400640 1 -- 172.21.15.55:0/1157343643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187ca2a00 msgr2=0x55c187ca2de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f4143400640 1 --2- 172.21.15.55:0/1157343643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187ca2a00 0x55c187ca2de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f4143400640 1 -- 172.21.15.55:0/1157343643 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c1877a2c90 con 0x55c187c58d70 2024-04-02T07:28:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f4142a00640 1 --2- 172.21.15.55:0/1157343643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187ca2a00 0x55c187ca2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f4143400640 1 --2- 172.21.15.55:0/1157343643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187c58d70 0x55c187c59150 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f413c002240 tx=0x7f413c01b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de02a9eb89bc5670 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f4133400640 1 -- 172.21.15.55:0/1157343643 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c0a5a90 con 0x55c187c58d70 2024-04-02T07:28:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f4133400640 1 -- 172.21.15.55:0/1157343643 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f413c0a5bf0 con 0x55c187c58d70 2024-04-02T07:28:03.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f4133400640 1 -- 172.21.15.55:0/1157343643 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c0039a0 con 0x55c187c58d70 2024-04-02T07:28:03.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f414cad8000 1 -- 172.21.15.55:0/1157343643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187c58d70 msgr2=0x55c187c59150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f414cad8000 1 --2- 172.21.15.55:0/1157343643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187c58d70 0x55c187c59150 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f413c002240 tx=0x7f413c01b4c0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f414cad8000 1 -- 172.21.15.55:0/1157343643 shutdown_connections 2024-04-02T07:28:03.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f414cad8000 1 --2- 172.21.15.55:0/1157343643 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187c58d70 0x55c187c59150 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f414cad8000 1 --2- 172.21.15.55:0/1157343643 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca3320 0x55c187c58830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f414cad8000 1 --2- 172.21.15.55:0/1157343643 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187ca2a00 0x55c187ca2de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f414cad8000 1 -- 172.21.15.55:0/1157343643 >> 172.21.15.55:0/1157343643 conn(0x55c187c5f2f0 msgr2=0x55c187c57110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:03.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f414cad8000 1 -- 172.21.15.55:0/1157343643 shutdown_connections 2024-04-02T07:28:03.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f414cad8000 1 -- 172.21.15.55:0/1157343643 wait complete. 2024-04-02T07:28:03.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.583+0000 7f414cad8000 1 -- start start 2024-04-02T07:28:03.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f414cad8000 1 Processor -- start 2024-04-02T07:28:03.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f414cad8000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187c58d70 0x55c187c5df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f414cad8000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca2a00 0x55c187c5e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f414cad8000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca3320 0x55c187c64c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f414cad8000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c187aa68e0 con 0x55c187ca3320 2024-04-02T07:28:03.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f414cad8000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c187a46230 con 0x55c187c58d70 2024-04-02T07:28:03.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f414cad8000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c187a45ed0 con 0x55c187ca2a00 2024-04-02T07:28:03.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f414cad8000 10 client.0 _ll_register_callbacks cb 0x55c187c44700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:28:03.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f4143400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca3320 0x55c187c64c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f4142a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187c58d70 0x55c187c5df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f413be00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca2a00 0x55c187c5e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f4143400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca3320 0x55c187c64c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52012/0 (socket says 172.21.15.55:52012) 2024-04-02T07:28:03.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f4143400640 1 -- 172.21.15.55:0/2035234610 learned_addr learned my addr 172.21.15.55:0/2035234610 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:03.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f4142a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187c58d70 0x55c187c5df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:47650/0 (socket says 172.21.15.55:47650) 2024-04-02T07:28:03.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f413be00640 1 -- 172.21.15.55:0/2035234610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187c58d70 msgr2=0x55c187c5df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f413be00640 1 --2- 172.21.15.55:0/2035234610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187c58d70 0x55c187c5df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f413be00640 1 -- 172.21.15.55:0/2035234610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca3320 msgr2=0x55c187c64c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f413be00640 1 --2- 172.21.15.55:0/2035234610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca3320 0x55c187c64c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f413be00640 1 -- 172.21.15.55:0/2035234610 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4128003530 con 0x55c187ca2a00 2024-04-02T07:28:03.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f4143400640 1 --2- 172.21.15.55:0/2035234610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca3320 0x55c187c64c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:28:03.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f413be00640 1 --2- 172.21.15.55:0/2035234610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca2a00 0x55c187c5e480 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f412c082f90 tx=0x7f412c059a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10b4e731e699bd3e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f4127e00640 10 client.0 ms_handle_connect on v2:172.21.15.106:3301/0 2024-04-02T07:28:03.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f4127e00640 1 -- 172.21.15.55:0/2035234610 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c053fb0 con 0x55c187ca2a00 2024-04-02T07:28:03.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f414cad8000 1 -- 172.21.15.55:0/2035234610 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c187a5f6c0 con 0x55c187ca2a00 2024-04-02T07:28:03.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f4127e00640 1 -- 172.21.15.55:0/2035234610 <== mon.2 v2:172.21.15.106:3301/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f412c080070 con 0x55c187ca2a00 2024-04-02T07:28:03.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f4127e00640 1 -- 172.21.15.55:0/2035234610 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f412c05dab0 con 0x55c187ca2a00 2024-04-02T07:28:03.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f414cad8000 10 client.6254 fetch_fsmap learned FSMap version 51 2024-04-02T07:28:03.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f414cad8000 1 -- 172.21.15.55:0/2035234610 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55c187a6bbe0 con 0x55c187ca2a00 2024-04-02T07:28:03.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f4127e00640 1 -- 172.21.15.55:0/2035234610 <== mon.2 v2:172.21.15.106:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c187a5f6c0 con 0x55c187ca2a00 2024-04-02T07:28:03.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f4127e00640 1 -- 172.21.15.55:0/2035234610 <== mon.2 v2:172.21.15.106:3301/0 5 ==== fsmap(e 51) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f412c01b020 con 0x55c187ca2a00 2024-04-02T07:28:03.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f414cad8000 10 client.6254 fetch_fsmap finished waiting for FSMap version 51 2024-04-02T07:28:03.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f414cad8000 10 client.6254 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-02T07:28:03.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f414cad8000 20 client.6254 populate_metadata read hostname 'smithi055' 2024-04-02T07:28:03.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f414cad8000 1 --2- 172.21.15.55:0/2035234610 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55c187c65630 0x55c187cb4cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f414cad8000 4 client.6254 mds_command: new command op to 6936 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:28:03.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f414cad8000 1 -- 172.21.15.55:0/2035234610 --> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c187a6fb40 con 0x55c187c65630 2024-04-02T07:28:03.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f4142a00640 1 --2- 172.21.15.55:0/2035234610 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55c187c65630 0x55c187cb4cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f4142a00640 1 --2- 172.21.15.55:0/2035234610 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55c187c65630 0x55c187cb4cc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa338f04b51ab93a server_cookie=85d1b90d8053bb36 in_seq=0 out_seq=0 2024-04-02T07:28:03.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.587+0000 7f4127e00640 10 client.6254 ms_handle_connect on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.591+0000 7f4127e00640 1 -- 172.21.15.55:0/2035234610 <== mds.0 v2:172.21.15.55:6832/1965896660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c187a6fb40 con 0x55c187c65630 2024-04-02T07:28:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.591+0000 7f4127e00640 10 client.6254 handle_command_reply: tid=0 2024-04-02T07:28:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.591+0000 7f414cad8000 1 client.6254 shutdown 2024-04-02T07:28:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.591+0000 7f414cad8000 1 -- 172.21.15.55:0/2035234610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca2a00 msgr2=0x55c187c5e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.591+0000 7f414cad8000 1 --2- 172.21.15.55:0/2035234610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca2a00 0x55c187c5e480 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f412c082f90 tx=0x7f412c059a40 comp rx=0 tx=0).stop 2024-04-02T07:28:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.591+0000 7f414cad8000 1 -- 172.21.15.55:0/2035234610 shutdown_connections 2024-04-02T07:28:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.591+0000 7f414cad8000 1 --2- 172.21.15.55:0/2035234610 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55c187c65630 0x55c187cb4cc0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.591+0000 7f414cad8000 1 --2- 172.21.15.55:0/2035234610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca3320 0x55c187c64c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.591+0000 7f414cad8000 1 --2- 172.21.15.55:0/2035234610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca2a00 0x55c187c5e480 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.591+0000 7f414cad8000 1 --2- 172.21.15.55:0/2035234610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187c58d70 0x55c187c5df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.591+0000 7f4127e00640 0 client.6254 ms_handle_reset on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.591+0000 7f414cad8000 1 -- 172.21.15.55:0/2035234610 >> 172.21.15.55:0/2035234610 conn(0x55c187c5f2f0 msgr2=0x55c187c57810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.591+0000 7f414cad8000 1 -- 172.21.15.55:0/2035234610 shutdown_connections 2024-04-02T07:28:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.591+0000 7f414cad8000 1 -- 172.21.15.55:0/2035234610 wait complete. 2024-04-02T07:28:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.591+0000 7f414cad8000 20 client.6254 trim_cache size 0 max 16384 2024-04-02T07:28:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f414cad8000 1 Processor -- start 2024-04-02T07:28:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f414cad8000 1 -- start start 2024-04-02T07:28:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f414cad8000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187c58d70 0x55c187cb63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f414cad8000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca2a00 0x55c187cb6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f414cad8000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca3320 0x55c187c9dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f414cad8000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c187763d40 con 0x55c187ca2a00 2024-04-02T07:28:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f414cad8000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c187c63e00 con 0x55c187c58d70 2024-04-02T07:28:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f414cad8000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c187aa5600 con 0x55c187ca3320 2024-04-02T07:28:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f413be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca2a00 0x55c187cb6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f413be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca2a00 0x55c187cb6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52022/0 (socket says 172.21.15.55:52022) 2024-04-02T07:28:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f413be00640 1 -- 172.21.15.55:0/2071713614 learned_addr learned my addr 172.21.15.55:0/2071713614 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f4142a00640 1 --2- 172.21.15.55:0/2071713614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187c58d70 0x55c187cb63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f4143400640 1 --2- 172.21.15.55:0/2071713614 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca3320 0x55c187c9dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f413be00640 1 -- 172.21.15.55:0/2071713614 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca3320 msgr2=0x55c187c9dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f413be00640 1 --2- 172.21.15.55:0/2071713614 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca3320 0x55c187c9dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f413be00640 1 -- 172.21.15.55:0/2071713614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187c58d70 msgr2=0x55c187cb63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f413be00640 1 --2- 172.21.15.55:0/2071713614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187c58d70 0x55c187cb63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f413be00640 1 -- 172.21.15.55:0/2071713614 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c187a51d30 con 0x55c187ca2a00 2024-04-02T07:28:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f4143400640 1 --2- 172.21.15.55:0/2071713614 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca3320 0x55c187c9dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f413be00640 1 --2- 172.21.15.55:0/2071713614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca2a00 0x55c187cb6920 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f412c009160 tx=0x7f412c07d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0d180f8d193412 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f4133e00640 1 -- 172.21.15.55:0/2071713614 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c056250 con 0x55c187ca2a00 2024-04-02T07:28:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f4133e00640 1 -- 172.21.15.55:0/2071713614 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f412c07ce90 con 0x55c187ca2a00 2024-04-02T07:28:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f4133e00640 1 -- 172.21.15.55:0/2071713614 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f412c053fb0 con 0x55c187ca2a00 2024-04-02T07:28:03.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f414cad8000 1 -- 172.21.15.55:0/2071713614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca2a00 msgr2=0x55c187cb6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f414cad8000 1 --2- 172.21.15.55:0/2071713614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca2a00 0x55c187cb6920 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f412c009160 tx=0x7f412c07d000 comp rx=0 tx=0).stop 2024-04-02T07:28:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f414cad8000 1 -- 172.21.15.55:0/2071713614 shutdown_connections 2024-04-02T07:28:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f414cad8000 1 --2- 172.21.15.55:0/2071713614 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca3320 0x55c187c9dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f414cad8000 1 --2- 172.21.15.55:0/2071713614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca2a00 0x55c187cb6920 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f414cad8000 1 --2- 172.21.15.55:0/2071713614 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187c58d70 0x55c187cb63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f414cad8000 1 -- 172.21.15.55:0/2071713614 >> 172.21.15.55:0/2071713614 conn(0x55c187c5f2f0 msgr2=0x55c187cb4cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f414cad8000 1 -- 172.21.15.55:0/2071713614 shutdown_connections 2024-04-02T07:28:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f414cad8000 1 -- 172.21.15.55:0/2071713614 wait complete. 2024-04-02T07:28:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f414cad8000 1 -- start start 2024-04-02T07:28:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.607+0000 7f414cad8000 1 Processor -- start 2024-04-02T07:28:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f414cad8000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187c58d70 0x55c187ca11e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f414cad8000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca2a00 0x55c187cbe080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f414cad8000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca3320 0x55c187cbe5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f414cad8000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c187aaa8e0 con 0x55c187ca3320 2024-04-02T07:28:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f414cad8000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c187aea5c0 con 0x55c187c58d70 2024-04-02T07:28:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f414cad8000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c187a4f1e0 con 0x55c187ca2a00 2024-04-02T07:28:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f414cad8000 10 client.0 _ll_register_callbacks cb 0x55c187c24b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:28:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4143400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca3320 0x55c187cbe5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4143400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca3320 0x55c187cbe5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52032/0 (socket says 172.21.15.55:52032) 2024-04-02T07:28:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4143400640 1 -- 172.21.15.55:0/1149957600 learned_addr learned my addr 172.21.15.55:0/1149957600 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f413be00640 1 --2- 172.21.15.55:0/1149957600 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca2a00 0x55c187cbe080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4142a00640 1 --2- 172.21.15.55:0/1149957600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187c58d70 0x55c187ca11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4143400640 1 -- 172.21.15.55:0/1149957600 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca2a00 msgr2=0x55c187cbe080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4143400640 1 --2- 172.21.15.55:0/1149957600 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca2a00 0x55c187cbe080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4143400640 1 -- 172.21.15.55:0/1149957600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187c58d70 msgr2=0x55c187ca11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4143400640 1 --2- 172.21.15.55:0/1149957600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187c58d70 0x55c187ca11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4143400640 1 -- 172.21.15.55:0/1149957600 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c187a6bbe0 con 0x55c187ca3320 2024-04-02T07:28:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4143400640 1 --2- 172.21.15.55:0/1149957600 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca3320 0x55c187cbe5c0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f413c01ccc0 tx=0x7f4128005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4784e423ad673a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4127e00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:28:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4127e00640 1 -- 172.21.15.55:0/1149957600 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f413c0c4070 con 0x55c187ca3320 2024-04-02T07:28:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4127e00640 1 -- 172.21.15.55:0/1149957600 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f413c0039a0 con 0x55c187ca3320 2024-04-02T07:28:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f414cad8000 1 -- 172.21.15.55:0/1149957600 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c187a4cfa0 con 0x55c187ca3320 2024-04-02T07:28:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4127e00640 1 -- 172.21.15.55:0/1149957600 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f413c003b80 con 0x55c187ca3320 2024-04-02T07:28:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f414cad8000 10 client.7173 fetch_fsmap learned FSMap version 51 2024-04-02T07:28:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f414cad8000 1 -- 172.21.15.55:0/1149957600 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55c1877a30c0 con 0x55c187ca3320 2024-04-02T07:28:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4127e00640 1 -- 172.21.15.55:0/1149957600 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c187a4cfa0 con 0x55c187ca3320 2024-04-02T07:28:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4127e00640 1 -- 172.21.15.55:0/1149957600 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 51) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f413c0c7030 con 0x55c187ca3320 2024-04-02T07:28:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f414cad8000 10 client.7173 fetch_fsmap finished waiting for FSMap version 51 2024-04-02T07:28:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f414cad8000 10 client.7173 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-02T07:28:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f414cad8000 20 client.7173 populate_metadata read hostname 'smithi055' 2024-04-02T07:28:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f414cad8000 1 --2- 172.21.15.55:0/1149957600 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55c187d014b0 0x55c187d018c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f414cad8000 4 client.7173 mds_command: new command op to 6936 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}] 2024-04-02T07:28:03.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f414cad8000 1 -- 172.21.15.55:0/1149957600 --> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] -- command(tid 0: {"prefix": "scrub start", "path": "/subdir", "scrubops": ["repair", "recursive"]}) v1 -- 0x55c187aa36c0 con 0x55c187d014b0 2024-04-02T07:28:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4142a00640 1 --2- 172.21.15.55:0/1149957600 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55c187d014b0 0x55c187d018c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4142a00640 1 --2- 172.21.15.55:0/1149957600 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55c187d014b0 0x55c187d018c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=971e5e8b392b1d61 server_cookie=67619cbed56e7cda in_seq=0 out_seq=0 2024-04-02T07:28:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4127e00640 10 client.7173 ms_handle_connect on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4127e00640 1 -- 172.21.15.55:0/1149957600 <== mds.0 v2:172.21.15.55:6832/1965896660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55c187aa36c0 con 0x55c187d014b0 2024-04-02T07:28:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f4127e00640 10 client.7173 handle_command_reply: tid=0 2024-04-02T07:28:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.611+0000 7f414cad8000 1 client.7173 shutdown 2024-04-02T07:28:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f414cad8000 1 -- 172.21.15.55:0/1149957600 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca3320 msgr2=0x55c187cbe5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f414cad8000 1 --2- 172.21.15.55:0/1149957600 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca3320 0x55c187cbe5c0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f413c01ccc0 tx=0x7f4128005800 comp rx=0 tx=0).stop 2024-04-02T07:28:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f414cad8000 1 -- 172.21.15.55:0/1149957600 shutdown_connections 2024-04-02T07:28:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f414cad8000 1 --2- 172.21.15.55:0/1149957600 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x55c187d014b0 0x55c187d018c0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f414cad8000 1 --2- 172.21.15.55:0/1149957600 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c187ca3320 0x55c187cbe5c0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f414cad8000 1 --2- 172.21.15.55:0/1149957600 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c187ca2a00 0x55c187cbe080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f414cad8000 1 --2- 172.21.15.55:0/1149957600 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c187c58d70 0x55c187ca11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f414cad8000 1 -- 172.21.15.55:0/1149957600 >> 172.21.15.55:0/1149957600 conn(0x55c187c5f2f0 msgr2=0x55c187cb5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:03.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f4127e00640 0 client.7173 ms_handle_reset on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:03.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f414cad8000 1 -- 172.21.15.55:0/1149957600 shutdown_connections 2024-04-02T07:28:03.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f414cad8000 1 -- 172.21.15.55:0/1149957600 wait complete. 2024-04-02T07:28:03.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f414cad8000 20 client.7173 trim_cache size 0 max 16384 2024-04-02T07:28:03.621 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:28:03.621 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-04-02T07:28:03.621 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "463bf7bd-1293-444e-b4c1-82c6b48033a8", 2024-04-02T07:28:03.621 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-04-02T07:28:03.621 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:28:03.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f4149600640 1 -- 172.21.15.55:0/1647931186 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41200666e0 msgr2=0x7f4120068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f4149600640 1 --2- 172.21.15.55:0/1647931186 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41200666e0 0x7f4120068ba0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4134001ec0 tx=0x7f4134009040 comp rx=0 tx=0).stop 2024-04-02T07:28:03.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f4149600640 1 -- 172.21.15.55:0/1647931186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41441f6080 msgr2=0x7f4144149ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f4149600640 1 --2- 172.21.15.55:0/1647931186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41441f6080 0x7f4144149ca0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f412c011a00 tx=0x7f412c011ec0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f4149600640 1 -- 172.21.15.55:0/1647931186 shutdown_connections 2024-04-02T07:28:03.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f4149600640 1 --2- 172.21.15.55:0/1647931186 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41440c9e50 0x7f41440ca2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f4149600640 1 --2- 172.21.15.55:0/1647931186 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41441f6080 0x7f4144149ca0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f4149600640 1 --2- 172.21.15.55:0/1647931186 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41200666e0 0x7f4120068ba0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f4149600640 1 --2- 172.21.15.55:0/1647931186 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4128004d10 0x7f4144158670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f4149600640 1 -- 172.21.15.55:0/1647931186 >> 172.21.15.55:0/1647931186 conn(0x7f4144069d90 msgr2=0x7f414406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:03.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f4149600640 1 -- 172.21.15.55:0/1647931186 shutdown_connections 2024-04-02T07:28:03.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.615+0000 7f4149600640 1 -- 172.21.15.55:0/1647931186 wait complete. 2024-04-02T07:28:03.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:03.635 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-02T07:28:03.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.775+0000 7f37a6a00640 1 Processor -- start 2024-04-02T07:28:03.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.775+0000 7f37a6a00640 1 -- start start 2024-04-02T07:28:03.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.775+0000 7f37a6a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f37a0161490 0x7f37a0065a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.775+0000 7f37a6a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a00660d0 con 0x7f37a006e4f0 2024-04-02T07:28:03.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.775+0000 7f37a6a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37a01609b0 con 0x7f37a015cd20 2024-04-02T07:28:03.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.775+0000 7f37a6a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37a01607a0 con 0x7f37a0161490 2024-04-02T07:28:03.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.775+0000 7f3797e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f37a006e4f0 0x7f37a00cdc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44144/0 (socket says 172.21.15.55:44144) 2024-04-02T07:28:03.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.775+0000 7f3797e00640 1 -- 172.21.15.55:0/3538733270 learned_addr learned my addr 172.21.15.55:0/3538733270 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:03.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.775+0000 7f37a4a00640 1 --2- 172.21.15.55:0/3538733270 >> v2:172.21.15.106:3300/0 conn(0x7f37a0161490 0x7f37a0065a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.775+0000 7f379f400640 1 -- 172.21.15.55:0/3538733270 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245561360 0 0) 0x7f37a00660d0 con 0x7f37a006e4f0 2024-04-02T07:28:03.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f379f400640 1 -- 172.21.15.55:0/3538733270 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3784003530 con 0x7f37a006e4f0 2024-04-02T07:28:03.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f379f400640 1 -- 172.21.15.55:0/3538733270 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3492769504 0 0) 0x7f3784003530 con 0x7f37a006e4f0 2024-04-02T07:28:03.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f379f400640 1 -- 172.21.15.55:0/3538733270 >> v2:172.21.15.106:3300/0 conn(0x7f37a0161490 msgr2=0x7f37a0065a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f379f400640 1 --2- 172.21.15.55:0/3538733270 >> v2:172.21.15.106:3300/0 conn(0x7f37a0161490 0x7f37a0065a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f379f400640 1 -- 172.21.15.55:0/3538733270 >> v1:172.21.15.106:6789/0 conn(0x7f37a015cd20 legacy=0x7f37a006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f379f400640 1 -- 172.21.15.55:0/3538733270 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a0160c90 con 0x7f37a006e4f0 2024-04-02T07:28:03.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f379f400640 1 -- 172.21.15.55:0/3538733270 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f3788001680 con 0x7f37a006e4f0 2024-04-02T07:28:03.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f379f400640 1 -- 172.21.15.55:0/3538733270 >> v1:172.21.15.55:6789/0 conn(0x7f37a006e4f0 legacy=0x7f37a00cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f379f400640 1 --2- 172.21.15.55:0/3538733270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37840039d0 0x7f3784003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f379f400640 1 --2- 172.21.15.55:0/3538733270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37840047d0 0x7f3784004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f379f400640 1 --2- 172.21.15.55:0/3538733270 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3784005190 0x7f378400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f379f400640 1 -- 172.21.15.55:0/3538733270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a01607a0 con 0x7f37840047d0 2024-04-02T07:28:03.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f379f400640 1 -- 172.21.15.55:0/3538733270 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f378400c090 con 0x7f37840039d0 2024-04-02T07:28:03.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f379f400640 1 -- 172.21.15.55:0/3538733270 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378400c250 con 0x7f3784005190 2024-04-02T07:28:03.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f3797e00640 1 --2- 172.21.15.55:0/3538733270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37840047d0 0x7f3784004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f379fe00640 1 --2- 172.21.15.55:0/3538733270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37840039d0 0x7f3784003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f37a4a00640 1 --2- 172.21.15.55:0/3538733270 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3784005190 0x7f378400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f3797e00640 1 -- 172.21.15.55:0/3538733270 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3784005190 msgr2=0x7f378400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f3797e00640 1 --2- 172.21.15.55:0/3538733270 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3784005190 0x7f378400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f3797e00640 1 -- 172.21.15.55:0/3538733270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37840039d0 msgr2=0x7f3784003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f3797e00640 1 --2- 172.21.15.55:0/3538733270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37840039d0 0x7f3784003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f3797e00640 1 -- 172.21.15.55:0/3538733270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3784003530 con 0x7f37840047d0 2024-04-02T07:28:03.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f37a4a00640 1 --2- 172.21.15.55:0/3538733270 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3784005190 0x7f378400b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:03.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f37a4a00640 1 -- 172.21.15.55:0/3538733270 reap_dead start 2024-04-02T07:28:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.779+0000 7f3797e00640 1 --2- 172.21.15.55:0/3538733270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37840047d0 0x7f3784004c50 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f378800c0e0 tx=0x7f378801f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16139389e6289c30 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f379f400640 1 -- 172.21.15.55:0/3538733270 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37880a8e90 con 0x7f37840047d0 2024-04-02T07:28:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f379f400640 1 -- 172.21.15.55:0/3538733270 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37880058e0 con 0x7f37840047d0 2024-04-02T07:28:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f379f400640 1 -- 172.21.15.55:0/3538733270 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3788005d10 con 0x7f37840047d0 2024-04-02T07:28:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f37a6a00640 1 -- 172.21.15.55:0/3538733270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37840047d0 msgr2=0x7f3784004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f37a6a00640 1 --2- 172.21.15.55:0/3538733270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37840047d0 0x7f3784004c50 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f378800c0e0 tx=0x7f378801f270 comp rx=0 tx=0).stop 2024-04-02T07:28:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f37a6a00640 1 -- 172.21.15.55:0/3538733270 shutdown_connections 2024-04-02T07:28:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f37a6a00640 1 --2- 172.21.15.55:0/3538733270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37840047d0 0x7f3784004c50 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f37a6a00640 1 -- 172.21.15.55:0/3538733270 >> 172.21.15.55:0/3538733270 conn(0x7f37a00ced90 msgr2=0x7f37a00cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f37a6a00640 1 -- 172.21.15.55:0/3538733270 shutdown_connections 2024-04-02T07:28:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f37a6a00640 1 -- 172.21.15.55:0/3538733270 wait complete. 2024-04-02T07:28:03.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f37a6a00640 1 Processor -- start 2024-04-02T07:28:03.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f37a6a00640 1 -- start start 2024-04-02T07:28:03.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f37a6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37840047d0 0x7f37a015bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f37a6a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37a0159b00 0x7f37a014d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f37a6a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a00b2c10 0x7f37a00b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f37a6a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a00b35d0 con 0x7f37a00b2c10 2024-04-02T07:28:03.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f37a6a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37a015c310 con 0x7f37840047d0 2024-04-02T07:28:03.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f37a6a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37a015aeb0 con 0x7f37a0159b00 2024-04-02T07:28:03.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f37a4a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a00b2c10 0x7f37a00b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f37a4a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a00b2c10 0x7f37a00b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52056/0 (socket says 172.21.15.55:52056) 2024-04-02T07:28:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f37a4a00640 1 -- 172.21.15.55:0/658319017 learned_addr learned my addr 172.21.15.55:0/658319017 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f3797e00640 1 --2- 172.21.15.55:0/658319017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37a0159b00 0x7f37a014d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.783+0000 7f379fe00640 1 --2- 172.21.15.55:0/658319017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37840047d0 0x7f37a015bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.787+0000 7f37a4a00640 1 -- 172.21.15.55:0/658319017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37a0159b00 msgr2=0x7f37a014d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.787+0000 7f37a4a00640 1 --2- 172.21.15.55:0/658319017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37a0159b00 0x7f37a014d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.787+0000 7f37a4a00640 1 -- 172.21.15.55:0/658319017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37840047d0 msgr2=0x7f37a015bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.787+0000 7f37a4a00640 1 --2- 172.21.15.55:0/658319017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37840047d0 0x7f37a015bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.787+0000 7f37a4a00640 1 -- 172.21.15.55:0/658319017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37a015a2a0 con 0x7f37a00b2c10 2024-04-02T07:28:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.787+0000 7f37a4a00640 1 --2- 172.21.15.55:0/658319017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a00b2c10 0x7f37a00b3090 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f37a009d040 tx=0x7f3798010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.787+0000 7f379cc00640 1 -- 172.21.15.55:0/658319017 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379801b070 con 0x7f37a00b2c10 2024-04-02T07:28:03.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.787+0000 7f379cc00640 1 -- 172.21.15.55:0/658319017 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f379800f040 con 0x7f37a00b2c10 2024-04-02T07:28:03.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.787+0000 7f379cc00640 1 -- 172.21.15.55:0/658319017 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f379800e050 con 0x7f37a00b2c10 2024-04-02T07:28:03.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.787+0000 7f37a6a00640 1 -- 172.21.15.55:0/658319017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37a015a580 con 0x7f37a00b2c10 2024-04-02T07:28:03.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.787+0000 7f37a6a00640 1 -- 172.21.15.55:0/658319017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a015ab40 con 0x7f37a00b2c10 2024-04-02T07:28:03.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.787+0000 7f379cc00640 1 -- 172.21.15.55:0/658319017 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3798015440 con 0x7f37a00b2c10 2024-04-02T07:28:03.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.787+0000 7f379cc00640 1 --2- 172.21.15.55:0/658319017 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f377c066690 0x7f377c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.787+0000 7f379cc00640 1 -- 172.21.15.55:0/658319017 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f3798084490 con 0x7f37a00b2c10 2024-04-02T07:28:03.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f379fe00640 1 --2- 172.21.15.55:0/658319017 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f377c066690 0x7f377c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a9e1f000 1 Processor -- start 2024-04-02T07:28:03.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a9e1f000 1 -- start start 2024-04-02T07:28:03.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f379fe00640 1 --2- 172.21.15.55:0/658319017 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f377c066690 0x7f377c068b50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3790007fd0 tx=0x7f3790009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a9e1f000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98ea70 0x5628ad98ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a9e1f000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5628ad98f390 0x5628ad9424c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a9e1f000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad942a00 0x5628ad942de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a9e1f000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ad80d630 con 0x5628ad942a00 2024-04-02T07:28:03.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a9e1f000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ad79abd0 con 0x5628ad98ea70 2024-04-02T07:28:03.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a9e1f000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628ad7981a0 con 0x5628ad98f390 2024-04-02T07:28:03.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a4a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad942a00 0x5628ad942de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a4a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad942a00 0x5628ad942de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52068/0 (socket says 172.21.15.55:52068) 2024-04-02T07:28:03.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a4a00640 1 -- 172.21.15.55:0/3662943062 learned_addr learned my addr 172.21.15.55:0/3662943062 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:03.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f379fe00640 1 --2- 172.21.15.55:0/3662943062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98ea70 0x5628ad98ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f3797e00640 1 --2- 172.21.15.55:0/3662943062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5628ad98f390 0x5628ad9424c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a4a00640 1 -- 172.21.15.55:0/3662943062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5628ad98f390 msgr2=0x5628ad9424c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a4a00640 1 --2- 172.21.15.55:0/3662943062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5628ad98f390 0x5628ad9424c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a4a00640 1 -- 172.21.15.55:0/3662943062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98ea70 msgr2=0x5628ad98ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a4a00640 1 --2- 172.21.15.55:0/3662943062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98ea70 0x5628ad98ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a4a00640 1 -- 172.21.15.55:0/3662943062 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628ad48fe20 con 0x5628ad942a00 2024-04-02T07:28:03.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a4a00640 1 --2- 172.21.15.55:0/3662943062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad942a00 0x5628ad942de0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f3798002240 tx=0x7f3798055500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58b8ac6aa59df989 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f3794c00640 1 -- 172.21.15.55:0/3662943062 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798053580 con 0x5628ad942a00 2024-04-02T07:28:03.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f3794c00640 1 -- 172.21.15.55:0/3662943062 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37980537e0 con 0x5628ad942a00 2024-04-02T07:28:03.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f3794c00640 1 -- 172.21.15.55:0/3662943062 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798084030 con 0x5628ad942a00 2024-04-02T07:28:03.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a9e1f000 1 -- 172.21.15.55:0/3662943062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad942a00 msgr2=0x5628ad942de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a9e1f000 1 --2- 172.21.15.55:0/3662943062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad942a00 0x5628ad942de0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f3798002240 tx=0x7f3798055500 comp rx=0 tx=0).stop 2024-04-02T07:28:03.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a9e1f000 1 -- 172.21.15.55:0/3662943062 shutdown_connections 2024-04-02T07:28:03.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a9e1f000 1 --2- 172.21.15.55:0/3662943062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad942a00 0x5628ad942de0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a9e1f000 1 --2- 172.21.15.55:0/3662943062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5628ad98f390 0x5628ad9424c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a9e1f000 1 --2- 172.21.15.55:0/3662943062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98ea70 0x5628ad98ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a9e1f000 1 -- 172.21.15.55:0/3662943062 >> 172.21.15.55:0/3662943062 conn(0x5628ad743160 msgr2=0x5628ad971820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:03.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a9e1f000 1 -- 172.21.15.55:0/3662943062 shutdown_connections 2024-04-02T07:28:03.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a9e1f000 1 -- 172.21.15.55:0/3662943062 wait complete. 2024-04-02T07:28:03.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.791+0000 7f37a9e1f000 1 -- start start 2024-04-02T07:28:03.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f37a9e1f000 1 Processor -- start 2024-04-02T07:28:03.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f37a9e1f000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5628ad942a00 0x5628ad94aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f37a9e1f000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98ea70 0x5628ad972a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f37a9e1f000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98f390 0x5628ad972f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f37a9e1f000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ad793a90 con 0x5628ad98ea70 2024-04-02T07:28:03.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f37a9e1f000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ad732d40 con 0x5628ad98f390 2024-04-02T07:28:03.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f37a9e1f000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628ad750f30 con 0x5628ad942a00 2024-04-02T07:28:03.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f37a9e1f000 10 client.0 _ll_register_callbacks cb 0x5628ad7f5810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:28:03.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f3797e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98ea70 0x5628ad972a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f3797e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98ea70 0x5628ad972a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52076/0 (socket says 172.21.15.55:52076) 2024-04-02T07:28:03.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f3797e00640 1 -- 172.21.15.55:0/548326268 learned_addr learned my addr 172.21.15.55:0/548326268 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:03.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f379fe00640 1 --2- 172.21.15.55:0/548326268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5628ad942a00 0x5628ad94aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f37a4a00640 1 --2- 172.21.15.55:0/548326268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98f390 0x5628ad972f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f3797e00640 1 -- 172.21.15.55:0/548326268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5628ad942a00 msgr2=0x5628ad94aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f3797e00640 1 --2- 172.21.15.55:0/548326268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5628ad942a00 0x5628ad94aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f3797e00640 1 -- 172.21.15.55:0/548326268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98f390 msgr2=0x5628ad972f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f3797e00640 1 --2- 172.21.15.55:0/548326268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98f390 0x5628ad972f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f3797e00640 1 -- 172.21.15.55:0/548326268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37a015ab40 con 0x5628ad98ea70 2024-04-02T07:28:03.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f37a4a00640 1 --2- 172.21.15.55:0/548326268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98f390 0x5628ad972f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:03.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f3797e00640 1 --2- 172.21.15.55:0/548326268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98ea70 0x5628ad972a50 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f378801f0a0 tx=0x7f378801c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4183a5e74e30755 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f378d600640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:28:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f378d600640 1 -- 172.21.15.55:0/548326268 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37880b7070 con 0x5628ad98ea70 2024-04-02T07:28:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f378d600640 1 -- 172.21.15.55:0/548326268 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f3788005c50 con 0x5628ad98ea70 2024-04-02T07:28:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f37a9e1f000 1 -- 172.21.15.55:0/548326268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628ad7923e0 con 0x5628ad98ea70 2024-04-02T07:28:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f378d600640 1 -- 172.21.15.55:0/548326268 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3788000ee0 con 0x5628ad98ea70 2024-04-02T07:28:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f37a9e1f000 10 client.7185 fetch_fsmap learned FSMap version 51 2024-04-02T07:28:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f37a9e1f000 1 -- 172.21.15.55:0/548326268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x5628ad758aa0 con 0x5628ad98ea70 2024-04-02T07:28:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f378d600640 1 -- 172.21.15.55:0/548326268 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5628ad7923e0 con 0x5628ad98ea70 2024-04-02T07:28:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f378d600640 1 -- 172.21.15.55:0/548326268 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 51) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f37880070c0 con 0x5628ad98ea70 2024-04-02T07:28:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f37a9e1f000 10 client.7185 fetch_fsmap finished waiting for FSMap version 51 2024-04-02T07:28:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f37a9e1f000 10 client.7185 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-02T07:28:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f37a9e1f000 20 client.7185 populate_metadata read hostname 'smithi055' 2024-04-02T07:28:03.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f37a9e1f000 1 --2- 172.21.15.55:0/548326268 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x5628ad99e1e0 0x5628ad9a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f37a9e1f000 4 client.7185 mds_command: new command op to 6936 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:28:03.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f37a9e1f000 1 -- 172.21.15.55:0/548326268 --> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5628ad763d00 con 0x5628ad99e1e0 2024-04-02T07:28:03.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f379fe00640 1 --2- 172.21.15.55:0/548326268 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x5628ad99e1e0 0x5628ad9a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f379fe00640 1 --2- 172.21.15.55:0/548326268 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x5628ad99e1e0 0x5628ad9a05d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78356ce4962c2b19 server_cookie=73241a4f41e807d5 in_seq=0 out_seq=0 2024-04-02T07:28:03.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.795+0000 7f378d600640 10 client.7185 ms_handle_connect on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:03.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.799+0000 7f378d600640 1 -- 172.21.15.55:0/548326268 <== mds.0 v2:172.21.15.55:6832/1965896660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5628ad763d00 con 0x5628ad99e1e0 2024-04-02T07:28:03.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.799+0000 7f378d600640 10 client.7185 handle_command_reply: tid=0 2024-04-02T07:28:03.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.799+0000 7f37a9e1f000 1 client.7185 shutdown 2024-04-02T07:28:03.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.799+0000 7f37a9e1f000 1 -- 172.21.15.55:0/548326268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98ea70 msgr2=0x5628ad972a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.799+0000 7f37a9e1f000 1 --2- 172.21.15.55:0/548326268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98ea70 0x5628ad972a50 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f378801f0a0 tx=0x7f378801c010 comp rx=0 tx=0).stop 2024-04-02T07:28:03.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.799+0000 7f37a9e1f000 1 -- 172.21.15.55:0/548326268 shutdown_connections 2024-04-02T07:28:03.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.799+0000 7f37a9e1f000 1 --2- 172.21.15.55:0/548326268 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x5628ad99e1e0 0x5628ad9a05d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.799+0000 7f37a9e1f000 1 --2- 172.21.15.55:0/548326268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98f390 0x5628ad972f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.799+0000 7f37a9e1f000 1 --2- 172.21.15.55:0/548326268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98ea70 0x5628ad972a50 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.799+0000 7f37a9e1f000 1 --2- 172.21.15.55:0/548326268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5628ad942a00 0x5628ad94aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.799+0000 7f378d600640 0 client.7185 ms_handle_reset on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:03.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.799+0000 7f37a9e1f000 1 -- 172.21.15.55:0/548326268 >> 172.21.15.55:0/548326268 conn(0x5628ad743160 msgr2=0x5628ad941bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:03.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.799+0000 7f37a9e1f000 1 -- 172.21.15.55:0/548326268 shutdown_connections 2024-04-02T07:28:03.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.799+0000 7f37a9e1f000 1 -- 172.21.15.55:0/548326268 wait complete. 2024-04-02T07:28:03.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.799+0000 7f37a9e1f000 20 client.7185 trim_cache size 0 max 16384 2024-04-02T07:28:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.811+0000 7f37a9e1f000 1 Processor -- start 2024-04-02T07:28:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.811+0000 7f37a9e1f000 1 -- start start 2024-04-02T07:28:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5628ad942a00 0x5628ad9e7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98ea70 0x5628ad9e84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98f390 0x5628ad9e8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ad450aa0 con 0x5628ad98f390 2024-04-02T07:28:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ad795020 con 0x5628ad98ea70 2024-04-02T07:28:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628ad98db30 con 0x5628ad942a00 2024-04-02T07:28:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a4a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98f390 0x5628ad9e8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a4a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98f390 0x5628ad9e8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52086/0 (socket says 172.21.15.55:52086) 2024-04-02T07:28:03.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a4a00640 1 -- 172.21.15.55:0/4056445205 learned_addr learned my addr 172.21.15.55:0/4056445205 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f3797e00640 1 --2- 172.21.15.55:0/4056445205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98ea70 0x5628ad9e84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a4a00640 1 -- 172.21.15.55:0/4056445205 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5628ad942a00 msgr2=0x5628ad9e7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a4a00640 1 --2- 172.21.15.55:0/4056445205 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5628ad942a00 0x5628ad9e7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a4a00640 1 -- 172.21.15.55:0/4056445205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98ea70 msgr2=0x5628ad9e84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a4a00640 1 --2- 172.21.15.55:0/4056445205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98ea70 0x5628ad9e84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a4a00640 1 -- 172.21.15.55:0/4056445205 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628ad73edf0 con 0x5628ad98f390 2024-04-02T07:28:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f3797e00640 1 --2- 172.21.15.55:0/4056445205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98ea70 0x5628ad9e84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:28:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a4a00640 1 --2- 172.21.15.55:0/4056445205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98f390 0x5628ad9e8a00 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f3798059040 tx=0x7f3798021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85fef0aab0db25c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f3795600640 1 -- 172.21.15.55:0/4056445205 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798053580 con 0x5628ad98f390 2024-04-02T07:28:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f3795600640 1 -- 172.21.15.55:0/4056445205 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37980537e0 con 0x5628ad98f390 2024-04-02T07:28:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f3795600640 1 -- 172.21.15.55:0/4056445205 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3798084040 con 0x5628ad98f390 2024-04-02T07:28:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 -- 172.21.15.55:0/4056445205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98f390 msgr2=0x5628ad9e8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 --2- 172.21.15.55:0/4056445205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98f390 0x5628ad9e8a00 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f3798059040 tx=0x7f3798021000 comp rx=0 tx=0).stop 2024-04-02T07:28:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 -- 172.21.15.55:0/4056445205 shutdown_connections 2024-04-02T07:28:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 --2- 172.21.15.55:0/4056445205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98f390 0x5628ad9e8a00 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 --2- 172.21.15.55:0/4056445205 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98ea70 0x5628ad9e84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 --2- 172.21.15.55:0/4056445205 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5628ad942a00 0x5628ad9e7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 -- 172.21.15.55:0/4056445205 >> 172.21.15.55:0/4056445205 conn(0x5628ad743160 msgr2=0x5628ad940c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 -- 172.21.15.55:0/4056445205 shutdown_connections 2024-04-02T07:28:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 -- 172.21.15.55:0/4056445205 wait complete. 2024-04-02T07:28:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 -- start start 2024-04-02T07:28:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 Processor -- start 2024-04-02T07:28:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5628ad942a00 0x5628ad9e9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98ea70 0x5628ad9450f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98f390 0x5628ad945630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ad864470 con 0x5628ad98ea70 2024-04-02T07:28:03.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628ad797a90 con 0x5628ad98f390 2024-04-02T07:28:03.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5628ad75f390 con 0x5628ad942a00 2024-04-02T07:28:03.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.815+0000 7f37a9e1f000 10 client.0 _ll_register_callbacks cb 0x7f3798051780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:28:03.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f3797e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98ea70 0x5628ad9450f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f3797e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98ea70 0x5628ad9450f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52094/0 (socket says 172.21.15.55:52094) 2024-04-02T07:28:03.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f379fe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5628ad942a00 0x5628ad9e9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f3797e00640 1 -- 172.21.15.55:0/98097134 learned_addr learned my addr 172.21.15.55:0/98097134 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:03.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a4a00640 1 --2- 172.21.15.55:0/98097134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98f390 0x5628ad945630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f3797e00640 1 -- 172.21.15.55:0/98097134 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5628ad942a00 msgr2=0x5628ad9e9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f3797e00640 1 --2- 172.21.15.55:0/98097134 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5628ad942a00 0x5628ad9e9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f3797e00640 1 -- 172.21.15.55:0/98097134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98f390 msgr2=0x5628ad945630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f3797e00640 1 --2- 172.21.15.55:0/98097134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98f390 0x5628ad945630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f3797e00640 1 -- 172.21.15.55:0/98097134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5628ad48fe20 con 0x5628ad98ea70 2024-04-02T07:28:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f3797e00640 1 --2- 172.21.15.55:0/98097134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98ea70 0x5628ad9450f0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f378801c050 tx=0x7f3788001db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c34080d4f29553b1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f378d600640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:28:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f378d600640 1 -- 172.21.15.55:0/98097134 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37880a8970 con 0x5628ad98ea70 2024-04-02T07:28:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f378d600640 1 -- 172.21.15.55:0/98097134 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f3788007580 con 0x5628ad98ea70 2024-04-02T07:28:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 1 -- 172.21.15.55:0/98097134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628ad750970 con 0x5628ad98ea70 2024-04-02T07:28:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f378d600640 1 -- 172.21.15.55:0/98097134 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3788001b60 con 0x5628ad98ea70 2024-04-02T07:28:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 10 client.7191 fetch_fsmap learned FSMap version 51 2024-04-02T07:28:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 1 -- 172.21.15.55:0/98097134 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x5628ad732960 con 0x5628ad98ea70 2024-04-02T07:28:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f378d600640 1 -- 172.21.15.55:0/98097134 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37880d0080 con 0x5628ad98ea70 2024-04-02T07:28:03.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f378d600640 1 -- 172.21.15.55:0/98097134 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 51) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f37880b17b0 con 0x5628ad98ea70 2024-04-02T07:28:03.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 10 client.7191 fetch_fsmap finished waiting for FSMap version 51 2024-04-02T07:28:03.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 10 client.7191 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-02T07:28:03.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 20 client.7191 populate_metadata read hostname 'smithi055' 2024-04-02T07:28:03.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 1 --2- 172.21.15.55:0/98097134 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x5628ad945b70 0x5628ad945f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:03.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 4 client.7191 mds_command: new command op to 6936 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-02T07:28:03.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 1 -- 172.21.15.55:0/98097134 --> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5628ad7c2a20 con 0x5628ad945b70 2024-04-02T07:28:03.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f379fe00640 1 --2- 172.21.15.55:0/98097134 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x5628ad945b70 0x5628ad945f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:03.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f379fe00640 1 --2- 172.21.15.55:0/98097134 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x5628ad945b70 0x5628ad945f80 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d435ea3bee75d382 server_cookie=2e7b4596843f15b in_seq=0 out_seq=0 2024-04-02T07:28:03.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f378d600640 10 client.7191 ms_handle_connect on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:03.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f378d600640 1 -- 172.21.15.55:0/98097134 <== mds.0 v2:172.21.15.55:6832/1965896660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+266 (crc 0 0 0) 0x5628ad7c2a20 con 0x5628ad945b70 2024-04-02T07:28:03.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f378d600640 10 client.7191 handle_command_reply: tid=0 2024-04-02T07:28:03.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 1 client.7191 shutdown 2024-04-02T07:28:03.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 1 -- 172.21.15.55:0/98097134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98ea70 msgr2=0x5628ad9450f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 1 --2- 172.21.15.55:0/98097134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98ea70 0x5628ad9450f0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f378801c050 tx=0x7f3788001db0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 1 -- 172.21.15.55:0/98097134 shutdown_connections 2024-04-02T07:28:03.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 1 --2- 172.21.15.55:0/98097134 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x5628ad945b70 0x5628ad945f80 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 1 --2- 172.21.15.55:0/98097134 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5628ad98f390 0x5628ad945630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 1 --2- 172.21.15.55:0/98097134 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5628ad98ea70 0x5628ad9450f0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f378d600640 0 client.7191 ms_handle_reset on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:03.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 1 --2- 172.21.15.55:0/98097134 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5628ad942a00 0x5628ad9e9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 1 -- 172.21.15.55:0/98097134 >> 172.21.15.55:0/98097134 conn(0x5628ad743160 msgr2=0x5628ad9414b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:03.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 1 -- 172.21.15.55:0/98097134 shutdown_connections 2024-04-02T07:28:03.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 1 -- 172.21.15.55:0/98097134 wait complete. 2024-04-02T07:28:03.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a9e1f000 20 client.7191 trim_cache size 0 max 16384 2024-04-02T07:28:03.832 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:28:03.832 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-02T07:28:03.832 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-04-02T07:28:03.832 INFO:teuthology.orchestra.run.smithi055.stdout: "463bf7bd-1293-444e-b4c1-82c6b48033a8": { 2024-04-02T07:28:03.832 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/subdir", 2024-04-02T07:28:03.832 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "463bf7bd-1293-444e-b4c1-82c6b48033a8", 2024-04-02T07:28:03.832 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive,repair" 2024-04-02T07:28:03.832 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:03.832 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:03.833 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:28:03.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a6a00640 1 -- 172.21.15.55:0/658319017 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f377c066690 msgr2=0x7f377c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a6a00640 1 --2- 172.21.15.55:0/658319017 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f377c066690 0x7f377c068b50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f3790007fd0 tx=0x7f3790009040 comp rx=0 tx=0).stop 2024-04-02T07:28:03.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a6a00640 1 -- 172.21.15.55:0/658319017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a00b2c10 msgr2=0x7f37a00b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:03.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a6a00640 1 --2- 172.21.15.55:0/658319017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a00b2c10 0x7f37a00b3090 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f37a009d040 tx=0x7f3798010590 comp rx=0 tx=0).stop 2024-04-02T07:28:03.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a6a00640 1 -- 172.21.15.55:0/658319017 shutdown_connections 2024-04-02T07:28:03.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a6a00640 1 --2- 172.21.15.55:0/658319017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37a00b2c10 0x7f37a00b3090 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a6a00640 1 --2- 172.21.15.55:0/658319017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37a0159b00 0x7f37a014d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a6a00640 1 --2- 172.21.15.55:0/658319017 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f377c066690 0x7f377c068b50 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a6a00640 1 --2- 172.21.15.55:0/658319017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37840047d0 0x7f37a015bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:03.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a6a00640 1 -- 172.21.15.55:0/658319017 >> 172.21.15.55:0/658319017 conn(0x7f37a00ced90 msgr2=0x7f37a0069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:03.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.819+0000 7f37a6a00640 1 -- 172.21.15.55:0/658319017 shutdown_connections 2024-04-02T07:28:03.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:03.823+0000 7f37a6a00640 1 -- 172.21.15.55:0/658319017 wait complete. 2024-04-02T07:28:03.841 INFO:tasks.cephfs.filesystem:scrub status for tag:463bf7bd-1293-444e-b4c1-82c6b48033a8 - {'path': '/subdir', 'tag': '463bf7bd-1293-444e-b4c1-82c6b48033a8', 'options': 'recursive,repair'} 2024-04-02T07:28:14.276 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:28:14.280 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:28:33.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:33.842 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.5:0 scrub status 2024-04-02T07:28:33.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.995+0000 7f58d2600640 1 Processor -- start 2024-04-02T07:28:33.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.995+0000 7f58d2600640 1 -- start start 2024-04-02T07:28:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.995+0000 7f58d2600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f58cc0b3dc0 0x7f58cc0ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.995+0000 7f58d2600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f58cc0ade90 0x7f58cc06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.995+0000 7f58d2600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58cc06c630 con 0x7f58cc0b41a0 2024-04-02T07:28:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.995+0000 7f58d2600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58cc06c8f0 con 0x7f58cc0ade90 2024-04-02T07:28:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.995+0000 7f58d2600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58cc06cbd0 con 0x7f58cc0b3dc0 2024-04-02T07:28:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.995+0000 7f58caa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f58cc0ade90 0x7f58cc06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:33.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.995+0000 7f58caa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f58cc0ade90 0x7f58cc06d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47746/0 (socket says 172.21.15.55:47746) 2024-04-02T07:28:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.995+0000 7f58caa00640 1 -- 172.21.15.55:0/3553808964 learned_addr learned my addr 172.21.15.55:0/3553808964 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.995+0000 7f58cb400640 1 --2- 172.21.15.55:0/3553808964 >> v2:172.21.15.106:3300/0 conn(0x7f58cc0b3dc0 0x7f58cc0ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.995+0000 7f58caa00640 1 -- 172.21.15.55:0/3553808964 >> v2:172.21.15.106:3300/0 conn(0x7f58cc0b3dc0 msgr2=0x7f58cc0ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.995+0000 7f58caa00640 1 --2- 172.21.15.55:0/3553808964 >> v2:172.21.15.106:3300/0 conn(0x7f58cc0b3dc0 0x7f58cc0ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.995+0000 7f58caa00640 1 -- 172.21.15.55:0/3553808964 >> v1:172.21.15.106:6789/0 conn(0x7f58cc0b41a0 legacy=0x7f58cc142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:33.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.995+0000 7f58caa00640 1 -- 172.21.15.55:0/3553808964 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58cc06ceb0 con 0x7f58cc0ade90 2024-04-02T07:28:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.999+0000 7f58caa00640 1 --2- 172.21.15.55:0/3553808964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58cc0ade90 0x7f58cc06d6b0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f58cc06c820 tx=0x7f58b801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ddfff1d827352c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.999+0000 7f58ca000640 1 -- 172.21.15.55:0/3553808964 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80aa670 con 0x7f58cc0ade90 2024-04-02T07:28:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.999+0000 7f58ca000640 1 -- 172.21.15.55:0/3553808964 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b80aa7d0 con 0x7f58cc0ade90 2024-04-02T07:28:34.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.999+0000 7f58ca000640 1 -- 172.21.15.55:0/3553808964 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80aab60 con 0x7f58cc0ade90 2024-04-02T07:28:34.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.999+0000 7f58d2600640 1 -- 172.21.15.55:0/3553808964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58cc0ade90 msgr2=0x7f58cc06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.999+0000 7f58d2600640 1 --2- 172.21.15.55:0/3553808964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58cc0ade90 0x7f58cc06d6b0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f58cc06c820 tx=0x7f58b801c4f0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.999+0000 7f58d2600640 1 -- 172.21.15.55:0/3553808964 shutdown_connections 2024-04-02T07:28:34.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.999+0000 7f58d2600640 1 --2- 172.21.15.55:0/3553808964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58cc0ade90 0x7f58cc06d6b0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.999+0000 7f58d2600640 1 --2- 172.21.15.55:0/3553808964 >> v2:172.21.15.106:3300/0 conn(0x7f58cc0b3dc0 0x7f58cc0ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.999+0000 7f58d2600640 1 -- 172.21.15.55:0/3553808964 >> 172.21.15.55:0/3553808964 conn(0x7f58cc06a390 msgr2=0x7f58cc0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:34.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.999+0000 7f58d2600640 1 -- 172.21.15.55:0/3553808964 shutdown_connections 2024-04-02T07:28:34.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:33.999+0000 7f58d2600640 1 -- 172.21.15.55:0/3553808964 wait complete. 2024-04-02T07:28:34.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58d2600640 1 Processor -- start 2024-04-02T07:28:34.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58d2600640 1 -- start start 2024-04-02T07:28:34.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58d2600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58cc0ade90 0x7f58cc15c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58d2600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58cc0b3dc0 0x7f58cc137bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58d2600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58cc0b41a0 0x7f58cc13bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58d2600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc0aea20 con 0x7f58cc0b41a0 2024-04-02T07:28:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58d2600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc0aefe0 con 0x7f58cc0b3dc0 2024-04-02T07:28:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58d2600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58cc15cc20 con 0x7f58cc0ade90 2024-04-02T07:28:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58cbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58cc0b41a0 0x7f58cc13bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58cbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58cc0b41a0 0x7f58cc13bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47756/0 (socket says 172.21.15.55:47756) 2024-04-02T07:28:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58cbe00640 1 -- 172.21.15.55:0/1565913523 learned_addr learned my addr 172.21.15.55:0/1565913523 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58cb400640 1 --2- 172.21.15.55:0/1565913523 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58cc0ade90 0x7f58cc15c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58caa00640 1 --2- 172.21.15.55:0/1565913523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58cc0b3dc0 0x7f58cc137bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58cbe00640 1 -- 172.21.15.55:0/1565913523 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58cc0ade90 msgr2=0x7f58cc15c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58cbe00640 1 --2- 172.21.15.55:0/1565913523 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58cc0ade90 0x7f58cc15c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58cbe00640 1 -- 172.21.15.55:0/1565913523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58cc0b3dc0 msgr2=0x7f58cc137bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58cbe00640 1 --2- 172.21.15.55:0/1565913523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58cc0b3dc0 0x7f58cc137bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58cbe00640 1 -- 172.21.15.55:0/1565913523 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58b80094d0 con 0x7f58cc0b41a0 2024-04-02T07:28:34.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58cb400640 1 --2- 172.21.15.55:0/1565913523 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58cc0ade90 0x7f58cc15c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58cbe00640 1 --2- 172.21.15.55:0/1565913523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58cc0b41a0 0x7f58cc13bc00 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f58c400c730 tx=0x7f58c400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58c3400640 1 -- 172.21.15.55:0/1565913523 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c4003b80 con 0x7f58cc0b41a0 2024-04-02T07:28:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58c3400640 1 -- 172.21.15.55:0/1565913523 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c4003ce0 con 0x7f58cc0b41a0 2024-04-02T07:28:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58c3400640 1 -- 172.21.15.55:0/1565913523 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c400aa30 con 0x7f58cc0b41a0 2024-04-02T07:28:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58d2600640 1 -- 172.21.15.55:0/1565913523 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58cc06de00 con 0x7f58cc0b41a0 2024-04-02T07:28:34.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.003+0000 7f58d2600640 1 -- 172.21.15.55:0/1565913523 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58cc1387d0 con 0x7f58cc0b41a0 2024-04-02T07:28:34.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.007+0000 7f58c3400640 1 -- 172.21.15.55:0/1565913523 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f58c400ab90 con 0x7f58cc0b41a0 2024-04-02T07:28:34.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.007+0000 7f58c3400640 1 --2- 172.21.15.55:0/1565913523 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f58ac0666c0 0x7f58ac068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.007+0000 7f58c3400640 1 -- 172.21.15.55:0/1565913523 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f58c4083f00 con 0x7f58cc0b41a0 2024-04-02T07:28:34.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.007+0000 7f58d5a51000 1 Processor -- start 2024-04-02T07:28:34.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.007+0000 7f58cb400640 1 --2- 172.21.15.55:0/1565913523 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f58ac0666c0 0x7f58ac068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.007+0000 7f58d5a51000 1 -- start start 2024-04-02T07:28:34.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58cb400640 1 --2- 172.21.15.55:0/1565913523 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f58ac0666c0 0x7f58ac068b80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f58bc007a70 tx=0x7f58bc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58d5a51000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d904a70 0x555f5d904e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58d5a51000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d905390 0x555f5d8b84c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58d5a51000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555f5d8b8a00 0x555f5d8b8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58d5a51000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5d783630 con 0x555f5d904a70 2024-04-02T07:28:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58d5a51000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5d710bd0 con 0x555f5d8b8a00 2024-04-02T07:28:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58d5a51000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f5d70e1a0 con 0x555f5d905390 2024-04-02T07:28:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58cb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d904a70 0x555f5d904e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58cb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d904a70 0x555f5d904e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47762/0 (socket says 172.21.15.55:47762) 2024-04-02T07:28:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58cb400640 1 -- 172.21.15.55:0/1463140193 learned_addr learned my addr 172.21.15.55:0/1463140193 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58caa00640 1 --2- 172.21.15.55:0/1463140193 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d905390 0x555f5d8b84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58cbe00640 1 --2- 172.21.15.55:0/1463140193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555f5d8b8a00 0x555f5d8b8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58cb400640 1 -- 172.21.15.55:0/1463140193 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d905390 msgr2=0x555f5d8b84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58cb400640 1 --2- 172.21.15.55:0/1463140193 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d905390 0x555f5d8b84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58cb400640 1 -- 172.21.15.55:0/1463140193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555f5d8b8a00 msgr2=0x555f5d8b8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58cb400640 1 --2- 172.21.15.55:0/1463140193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555f5d8b8a00 0x555f5d8b8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58cb400640 1 -- 172.21.15.55:0/1463140193 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f5d405e20 con 0x555f5d904a70 2024-04-02T07:28:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58caa00640 1 --2- 172.21.15.55:0/1463140193 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d905390 0x555f5d8b84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:34.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58cb400640 1 --2- 172.21.15.55:0/1463140193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d904a70 0x555f5d904e50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00fb10 tx=0x7f58bc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=643549e8bc3b05bd server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58b7e00640 1 -- 172.21.15.55:0/1463140193 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc014ca0 con 0x555f5d904a70 2024-04-02T07:28:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58b7e00640 1 -- 172.21.15.55:0/1463140193 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58bc019070 con 0x555f5d904a70 2024-04-02T07:28:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58b7e00640 1 -- 172.21.15.55:0/1463140193 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc020440 con 0x555f5d904a70 2024-04-02T07:28:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58d5a51000 1 -- 172.21.15.55:0/1463140193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d904a70 msgr2=0x555f5d904e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58d5a51000 1 --2- 172.21.15.55:0/1463140193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d904a70 0x555f5d904e50 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7f58bc00fb10 tx=0x7f58bc012000 comp rx=0 tx=0).stop 2024-04-02T07:28:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58d5a51000 1 -- 172.21.15.55:0/1463140193 shutdown_connections 2024-04-02T07:28:34.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58d5a51000 1 --2- 172.21.15.55:0/1463140193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555f5d8b8a00 0x555f5d8b8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58d5a51000 1 --2- 172.21.15.55:0/1463140193 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d905390 0x555f5d8b84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58d5a51000 1 --2- 172.21.15.55:0/1463140193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d904a70 0x555f5d904e50 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58d5a51000 1 -- 172.21.15.55:0/1463140193 >> 172.21.15.55:0/1463140193 conn(0x555f5d6b9160 msgr2=0x555f5d8e7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:34.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58d5a51000 1 -- 172.21.15.55:0/1463140193 shutdown_connections 2024-04-02T07:28:34.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58d5a51000 1 -- 172.21.15.55:0/1463140193 wait complete. 2024-04-02T07:28:34.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58d5a51000 1 -- start start 2024-04-02T07:28:34.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.011+0000 7f58d5a51000 1 Processor -- start 2024-04-02T07:28:34.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58d5a51000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d8b8a00 0x555f5d8c0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58d5a51000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d904a70 0x555f5d8e8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58d5a51000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555f5d905390 0x555f5d8e8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58d5a51000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5d709a90 con 0x555f5d904a70 2024-04-02T07:28:34.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58d5a51000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5d6a8d40 con 0x555f5d905390 2024-04-02T07:28:34.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58d5a51000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f5d6c6f30 con 0x555f5d8b8a00 2024-04-02T07:28:34.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58d5a51000 10 client.0 _ll_register_callbacks cb 0x555f5d76b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:28:34.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58caa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d904a70 0x555f5d8e8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58caa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d904a70 0x555f5d8e8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47774/0 (socket says 172.21.15.55:47774) 2024-04-02T07:28:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58caa00640 1 -- 172.21.15.55:0/3610890974 learned_addr learned my addr 172.21.15.55:0/3610890974 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58cb400640 1 --2- 172.21.15.55:0/3610890974 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d8b8a00 0x555f5d8c0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58cbe00640 1 --2- 172.21.15.55:0/3610890974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555f5d905390 0x555f5d8e8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58caa00640 1 -- 172.21.15.55:0/3610890974 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d8b8a00 msgr2=0x555f5d8c0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58caa00640 1 --2- 172.21.15.55:0/3610890974 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d8b8a00 0x555f5d8c0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58caa00640 1 -- 172.21.15.55:0/3610890974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555f5d905390 msgr2=0x555f5d8e8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58caa00640 1 --2- 172.21.15.55:0/3610890974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555f5d905390 0x555f5d8e8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58caa00640 1 -- 172.21.15.55:0/3610890974 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58bc00e040 con 0x555f5d904a70 2024-04-02T07:28:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58caa00640 1 --2- 172.21.15.55:0/3610890974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d904a70 0x555f5d8e8a50 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f58b8008010 tx=0x7f58b80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4892a5c48538c957 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58b4c00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:28:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58b4c00640 1 -- 172.21.15.55:0/3610890974 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b80be670 con 0x555f5d904a70 2024-04-02T07:28:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58b4c00640 1 -- 172.21.15.55:0/3610890974 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f58b80b8040 con 0x555f5d904a70 2024-04-02T07:28:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58d5a51000 1 -- 172.21.15.55:0/3610890974 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f5d7083e0 con 0x555f5d904a70 2024-04-02T07:28:34.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58b4c00640 1 -- 172.21.15.55:0/3610890974 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58b80be7d0 con 0x555f5d904a70 2024-04-02T07:28:34.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58d5a51000 10 client.7203 fetch_fsmap learned FSMap version 52 2024-04-02T07:28:34.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58d5a51000 1 -- 172.21.15.55:0/3610890974 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x555f5d6ceaa0 con 0x555f5d904a70 2024-04-02T07:28:34.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58b4c00640 1 -- 172.21.15.55:0/3610890974 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f5d7083e0 con 0x555f5d904a70 2024-04-02T07:28:34.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58b4c00640 1 -- 172.21.15.55:0/3610890974 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 52) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f58b80bc050 con 0x555f5d904a70 2024-04-02T07:28:34.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58d5a51000 10 client.7203 fetch_fsmap finished waiting for FSMap version 52 2024-04-02T07:28:34.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58d5a51000 10 client.7203 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-02T07:28:34.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58d5a51000 20 client.7203 populate_metadata read hostname 'smithi055' 2024-04-02T07:28:34.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58d5a51000 1 --2- 172.21.15.55:0/3610890974 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x555f5d90beb0 0x555f5d90c290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58d5a51000 4 client.7203 mds_command: new command op to 6936 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:28:34.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58d5a51000 1 -- 172.21.15.55:0/3610890974 --> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555f5d6d9d00 con 0x555f5d90beb0 2024-04-02T07:28:34.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58cb400640 1 --2- 172.21.15.55:0/3610890974 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x555f5d90beb0 0x555f5d90c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58b4c00640 10 client.7203 ms_handle_connect on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:34.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58cb400640 1 --2- 172.21.15.55:0/3610890974 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x555f5d90beb0 0x555f5d90c290 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3006e388e86d952a server_cookie=61c0744dbd26f36a in_seq=0 out_seq=0 2024-04-02T07:28:34.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58b4c00640 1 -- 172.21.15.55:0/3610890974 <== mds.0 v2:172.21.15.55:6832/1965896660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555f5d6d9d00 con 0x555f5d90beb0 2024-04-02T07:28:34.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58b4c00640 10 client.7203 handle_command_reply: tid=0 2024-04-02T07:28:34.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.015+0000 7f58d5a51000 1 client.7203 shutdown 2024-04-02T07:28:34.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.019+0000 7f58d5a51000 1 -- 172.21.15.55:0/3610890974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d904a70 msgr2=0x555f5d8e8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.019+0000 7f58d5a51000 1 --2- 172.21.15.55:0/3610890974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d904a70 0x555f5d8e8a50 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f58b8008010 tx=0x7f58b80046d0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.019+0000 7f58d5a51000 1 -- 172.21.15.55:0/3610890974 shutdown_connections 2024-04-02T07:28:34.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.019+0000 7f58d5a51000 1 --2- 172.21.15.55:0/3610890974 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x555f5d90beb0 0x555f5d90c290 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.019+0000 7f58d5a51000 1 --2- 172.21.15.55:0/3610890974 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555f5d905390 0x555f5d8e8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.019+0000 7f58d5a51000 1 --2- 172.21.15.55:0/3610890974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d904a70 0x555f5d8e8a50 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.019+0000 7f58b4c00640 0 client.7203 ms_handle_reset on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:34.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.019+0000 7f58d5a51000 1 --2- 172.21.15.55:0/3610890974 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d8b8a00 0x555f5d8c0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.019+0000 7f58d5a51000 1 -- 172.21.15.55:0/3610890974 >> 172.21.15.55:0/3610890974 conn(0x555f5d6b9160 msgr2=0x555f5d8b7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:34.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.019+0000 7f58d5a51000 1 -- 172.21.15.55:0/3610890974 shutdown_connections 2024-04-02T07:28:34.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.019+0000 7f58d5a51000 1 -- 172.21.15.55:0/3610890974 wait complete. 2024-04-02T07:28:34.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.019+0000 7f58d5a51000 20 client.7203 trim_cache size 0 max 16384 2024-04-02T07:28:34.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.031+0000 7f58d5a51000 1 Processor -- start 2024-04-02T07:28:34.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.031+0000 7f58d5a51000 1 -- start start 2024-04-02T07:28:34.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.031+0000 7f58d5a51000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d8b8a00 0x555f5d8bf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.031+0000 7f58d5a51000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555f5d904a70 0x555f5d8bfeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.031+0000 7f58d5a51000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d905390 0x555f5d91fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5d3c6aa0 con 0x555f5d8b8a00 2024-04-02T07:28:34.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5d70c5f0 con 0x555f5d904a70 2024-04-02T07:28:34.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f5d7da470 con 0x555f5d905390 2024-04-02T07:28:34.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58cb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d8b8a00 0x555f5d8bf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58cb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d8b8a00 0x555f5d8bf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47780/0 (socket says 172.21.15.55:47780) 2024-04-02T07:28:34.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58cb400640 1 -- 172.21.15.55:0/1044380386 learned_addr learned my addr 172.21.15.55:0/1044380386 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:34.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58cbe00640 1 --2- 172.21.15.55:0/1044380386 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d905390 0x555f5d91fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58caa00640 1 --2- 172.21.15.55:0/1044380386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555f5d904a70 0x555f5d8bfeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58cb400640 1 -- 172.21.15.55:0/1044380386 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d905390 msgr2=0x555f5d91fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:34.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58cb400640 1 --2- 172.21.15.55:0/1044380386 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d905390 0x555f5d91fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58cb400640 1 -- 172.21.15.55:0/1044380386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555f5d904a70 msgr2=0x555f5d8bfeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:34.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58cb400640 1 --2- 172.21.15.55:0/1044380386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555f5d904a70 0x555f5d8bfeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58cb400640 1 -- 172.21.15.55:0/1044380386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555f5d6b4df0 con 0x555f5d8b8a00 2024-04-02T07:28:34.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58cb400640 1 --2- 172.21.15.55:0/1044380386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d8b8a00 0x555f5d8bf970 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f58bc022040 tx=0x7f58bc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae55bfaa46071fc server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:34.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58c0c00640 1 -- 172.21.15.55:0/1044380386 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc02f040 con 0x555f5d8b8a00 2024-04-02T07:28:34.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58c0c00640 1 -- 172.21.15.55:0/1044380386 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58bc019040 con 0x555f5d8b8a00 2024-04-02T07:28:34.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58c0c00640 1 -- 172.21.15.55:0/1044380386 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc035970 con 0x555f5d8b8a00 2024-04-02T07:28:34.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 1 -- 172.21.15.55:0/1044380386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d8b8a00 msgr2=0x555f5d8bf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 1 --2- 172.21.15.55:0/1044380386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d8b8a00 0x555f5d8bf970 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f58bc022040 tx=0x7f58bc014000 comp rx=0 tx=0).stop 2024-04-02T07:28:34.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 1 -- 172.21.15.55:0/1044380386 shutdown_connections 2024-04-02T07:28:34.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 1 --2- 172.21.15.55:0/1044380386 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d905390 0x555f5d91fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 1 --2- 172.21.15.55:0/1044380386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555f5d904a70 0x555f5d8bfeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 1 --2- 172.21.15.55:0/1044380386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d8b8a00 0x555f5d8bf970 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 1 -- 172.21.15.55:0/1044380386 >> 172.21.15.55:0/1044380386 conn(0x555f5d6b9160 msgr2=0x555f5d8bf260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:34.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 1 -- 172.21.15.55:0/1044380386 shutdown_connections 2024-04-02T07:28:34.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 1 -- 172.21.15.55:0/1044380386 wait complete. 2024-04-02T07:28:34.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 1 -- start start 2024-04-02T07:28:34.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 1 Processor -- start 2024-04-02T07:28:34.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d8b8a00 0x555f5d968a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d904a70 0x555f5d968f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555f5d905390 0x555f5d94c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5d70b020 con 0x555f5d8b8a00 2024-04-02T07:28:34.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555f5d690830 con 0x555f5d905390 2024-04-02T07:28:34.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x555f5d8c0b20 con 0x555f5d904a70 2024-04-02T07:28:34.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58d5a51000 10 client.0 _ll_register_callbacks cb 0x7f58bc0076a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:28:34.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58cb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d8b8a00 0x555f5d968a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58cb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d8b8a00 0x555f5d968a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47794/0 (socket says 172.21.15.55:47794) 2024-04-02T07:28:34.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58cb400640 1 -- 172.21.15.55:0/3272566863 learned_addr learned my addr 172.21.15.55:0/3272566863 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:34.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58caa00640 1 --2- 172.21.15.55:0/3272566863 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d904a70 0x555f5d968f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.035+0000 7f58cbe00640 1 --2- 172.21.15.55:0/3272566863 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555f5d905390 0x555f5d94c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58cb400640 1 -- 172.21.15.55:0/3272566863 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d904a70 msgr2=0x555f5d968f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:34.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58cb400640 1 --2- 172.21.15.55:0/3272566863 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d904a70 0x555f5d968f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58cb400640 1 -- 172.21.15.55:0/3272566863 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555f5d905390 msgr2=0x555f5d94c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:34.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58cb400640 1 --2- 172.21.15.55:0/3272566863 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555f5d905390 0x555f5d94c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58cb400640 1 -- 172.21.15.55:0/3272566863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555f5d405e20 con 0x555f5d8b8a00 2024-04-02T07:28:34.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58caa00640 1 --2- 172.21.15.55:0/3272566863 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d904a70 0x555f5d968f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:34.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58cb400640 1 --2- 172.21.15.55:0/3272566863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d8b8a00 0x555f5d968a40 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f58bc010010 tx=0x7f58bc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3680f6f9bfd49f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:34.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58b4c00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:28:34.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58b4c00640 1 -- 172.21.15.55:0/3272566863 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc02f050 con 0x555f5d8b8a00 2024-04-02T07:28:34.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58b4c00640 1 -- 172.21.15.55:0/3272566863 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f58bc014e20 con 0x555f5d8b8a00 2024-04-02T07:28:34.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 1 -- 172.21.15.55:0/3272566863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555f5d6c6970 con 0x555f5d8b8a00 2024-04-02T07:28:34.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58b4c00640 1 -- 172.21.15.55:0/3272566863 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58bc035b70 con 0x555f5d8b8a00 2024-04-02T07:28:34.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 10 client.7209 fetch_fsmap learned FSMap version 52 2024-04-02T07:28:34.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 1 -- 172.21.15.55:0/3272566863 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x555f5d6a8960 con 0x555f5d8b8a00 2024-04-02T07:28:34.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58b4c00640 1 -- 172.21.15.55:0/3272566863 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555f5d6c6970 con 0x555f5d8b8a00 2024-04-02T07:28:34.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58b4c00640 1 -- 172.21.15.55:0/3272566863 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 52) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f58bc035cd0 con 0x555f5d8b8a00 2024-04-02T07:28:34.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 10 client.7209 fetch_fsmap finished waiting for FSMap version 52 2024-04-02T07:28:34.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 10 client.7209 resolve_mds: resolved 5:0 to role '5:0' aka daemon mds.a 2024-04-02T07:28:34.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 20 client.7209 populate_metadata read hostname 'smithi055' 2024-04-02T07:28:34.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 1 --2- 172.21.15.55:0/3272566863 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x555f5d94cc50 0x555f5d94d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 4 client.7209 mds_command: new command op to 6936 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-02T07:28:34.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 1 -- 172.21.15.55:0/3272566863 --> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x555f5d738a20 con 0x555f5d94cc50 2024-04-02T07:28:34.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58caa00640 1 --2- 172.21.15.55:0/3272566863 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x555f5d94cc50 0x555f5d94d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58caa00640 1 --2- 172.21.15.55:0/3272566863 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x555f5d94cc50 0x555f5d94d060 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=736b833d613e26ea server_cookie=d954f42c4b84c9c8 in_seq=0 out_seq=0 2024-04-02T07:28:34.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58b4c00640 10 client.7209 ms_handle_connect on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:34.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58b4c00640 1 -- 172.21.15.55:0/3272566863 <== mds.0 v2:172.21.15.55:6832/1965896660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x555f5d738a20 con 0x555f5d94cc50 2024-04-02T07:28:34.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58b4c00640 10 client.7209 handle_command_reply: tid=0 2024-04-02T07:28:34.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 1 client.7209 shutdown 2024-04-02T07:28:34.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 1 -- 172.21.15.55:0/3272566863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d8b8a00 msgr2=0x555f5d968a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 1 --2- 172.21.15.55:0/3272566863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d8b8a00 0x555f5d968a40 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f58bc010010 tx=0x7f58bc004740 comp rx=0 tx=0).stop 2024-04-02T07:28:34.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 1 -- 172.21.15.55:0/3272566863 shutdown_connections 2024-04-02T07:28:34.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 1 --2- 172.21.15.55:0/3272566863 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x555f5d94cc50 0x555f5d94d060 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 1 --2- 172.21.15.55:0/3272566863 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555f5d905390 0x555f5d94c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 1 --2- 172.21.15.55:0/3272566863 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555f5d904a70 0x555f5d968f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 1 --2- 172.21.15.55:0/3272566863 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555f5d8b8a00 0x555f5d968a40 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58b4c00640 0 client.7209 ms_handle_reset on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:34.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 1 -- 172.21.15.55:0/3272566863 >> 172.21.15.55:0/3272566863 conn(0x555f5d6b9160 msgr2=0x555f5d8bf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:34.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 1 -- 172.21.15.55:0/3272566863 shutdown_connections 2024-04-02T07:28:34.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 1 -- 172.21.15.55:0/3272566863 wait complete. 2024-04-02T07:28:34.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d5a51000 20 client.7209 trim_cache size 0 max 16384 2024-04-02T07:28:34.046 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:28:34.046 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-04-02T07:28:34.046 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-04-02T07:28:34.046 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:28:34.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d2600640 1 -- 172.21.15.55:0/1565913523 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f58ac0666c0 msgr2=0x7f58ac068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d2600640 1 --2- 172.21.15.55:0/1565913523 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f58ac0666c0 0x7f58ac068b80 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f58bc007a70 tx=0x7f58bc008040 comp rx=0 tx=0).stop 2024-04-02T07:28:34.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d2600640 1 -- 172.21.15.55:0/1565913523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58cc0b41a0 msgr2=0x7f58cc13bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d2600640 1 --2- 172.21.15.55:0/1565913523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58cc0b41a0 0x7f58cc13bc00 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f58c400c730 tx=0x7f58c400cbf0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d2600640 1 -- 172.21.15.55:0/1565913523 shutdown_connections 2024-04-02T07:28:34.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d2600640 1 --2- 172.21.15.55:0/1565913523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58cc0b41a0 0x7f58cc13bc00 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d2600640 1 --2- 172.21.15.55:0/1565913523 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f58ac0666c0 0x7f58ac068b80 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d2600640 1 --2- 172.21.15.55:0/1565913523 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58cc0b3dc0 0x7f58cc137bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d2600640 1 --2- 172.21.15.55:0/1565913523 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58cc0ade90 0x7f58cc15c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d2600640 1 -- 172.21.15.55:0/1565913523 >> 172.21.15.55:0/1565913523 conn(0x7f58cc06a390 msgr2=0x7f58cc140560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:34.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d2600640 1 -- 172.21.15.55:0/1565913523 shutdown_connections 2024-04-02T07:28:34.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.039+0000 7f58d2600640 1 -- 172.21.15.55:0/1565913523 wait complete. 2024-04-02T07:28:34.061 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-02T07:28:34.062 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:28:34.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.199+0000 7fc9c8400640 1 Processor -- start 2024-04-02T07:28:34.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.199+0000 7fc9c8400640 1 -- start start 2024-04-02T07:28:34.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.203+0000 7fc9c8400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc9c015a480 0x7fc9c00ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.203+0000 7fc9c8400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9c00b1070 0x7fc9c00c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.203+0000 7fc9c8400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9c015a860 con 0x7fc9c00ca9a0 2024-04-02T07:28:34.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.203+0000 7fc9c8400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c015ce20 con 0x7fc9c00b1070 2024-04-02T07:28:34.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.203+0000 7fc9c8400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c00cade0 con 0x7fc9c015a480 2024-04-02T07:28:34.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.203+0000 7fc9c6400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9c00b1070 0x7fc9c00c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.203+0000 7fc9c5000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc9c00ca9a0 0x7fc9c00b0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59918/0 (socket says 172.21.15.55:59918) 2024-04-02T07:28:34.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.203+0000 7fc9c5000640 1 -- 172.21.15.55:0/1661128857 learned_addr learned my addr 172.21.15.55:0/1661128857 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:34.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.203+0000 7fc9c5a00640 1 --2- 172.21.15.55:0/1661128857 >> v2:172.21.15.106:3300/0 conn(0x7fc9c015a480 0x7fc9c00ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.203+0000 7fc9c6400640 1 -- 172.21.15.55:0/1661128857 >> v2:172.21.15.106:3300/0 conn(0x7fc9c015a480 msgr2=0x7fc9c00ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:34.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.203+0000 7fc9c6400640 1 --2- 172.21.15.55:0/1661128857 >> v2:172.21.15.106:3300/0 conn(0x7fc9c015a480 0x7fc9c00ca460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.203+0000 7fc9c6400640 1 -- 172.21.15.55:0/1661128857 >> v1:172.21.15.55:6789/0 conn(0x7fc9c00ca9a0 legacy=0x7fc9c00b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.203+0000 7fc9c6400640 1 -- 172.21.15.55:0/1661128857 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c00cb570 con 0x7fc9c00b1070 2024-04-02T07:28:34.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.203+0000 7fc9bfe00640 1 -- 172.21.15.55:0/1661128857 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 454566357 0 0) 0x7fc9ac001120 con 0x7fc9c00ca9a0 2024-04-02T07:28:34.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.207+0000 7fc9c6400640 1 --2- 172.21.15.55:0/1661128857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9c00b1070 0x7fc9c00c8f10 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fc9c006e4e0 tx=0x7fc9b801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4abaa0e71a749cb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:34.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.207+0000 7fc9bfe00640 1 -- 172.21.15.55:0/1661128857 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80a58e0 con 0x7fc9c00b1070 2024-04-02T07:28:34.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.207+0000 7fc9bfe00640 1 -- 172.21.15.55:0/1661128857 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b80a5a40 con 0x7fc9c00b1070 2024-04-02T07:28:34.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.207+0000 7fc9bfe00640 1 -- 172.21.15.55:0/1661128857 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80a5dd0 con 0x7fc9c00b1070 2024-04-02T07:28:34.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.207+0000 7fc9c8400640 1 -- 172.21.15.55:0/1661128857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9c00b1070 msgr2=0x7fc9c00c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.207+0000 7fc9c8400640 1 --2- 172.21.15.55:0/1661128857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9c00b1070 0x7fc9c00c8f10 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7fc9c006e4e0 tx=0x7fc9b801c930 comp rx=0 tx=0).stop 2024-04-02T07:28:34.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.207+0000 7fc9c8400640 1 -- 172.21.15.55:0/1661128857 shutdown_connections 2024-04-02T07:28:34.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.207+0000 7fc9c8400640 1 --2- 172.21.15.55:0/1661128857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9c00b1070 0x7fc9c00c8f10 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.207+0000 7fc9c8400640 1 --2- 172.21.15.55:0/1661128857 >> v2:172.21.15.106:3300/0 conn(0x7fc9c015a480 0x7fc9c00ca460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.207+0000 7fc9c8400640 1 -- 172.21.15.55:0/1661128857 >> 172.21.15.55:0/1661128857 conn(0x7fc9c0066080 msgr2=0x7fc9c0069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:34.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.207+0000 7fc9c8400640 1 -- 172.21.15.55:0/1661128857 shutdown_connections 2024-04-02T07:28:34.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.207+0000 7fc9c8400640 1 -- 172.21.15.55:0/1661128857 wait complete. 2024-04-02T07:28:34.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.207+0000 7fc9c8400640 1 Processor -- start 2024-04-02T07:28:34.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.207+0000 7fc9c8400640 1 -- start start 2024-04-02T07:28:34.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9c8400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9c00b1070 0x7fc9c015fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9c8400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9c00ca9a0 0x7fc9c015b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9c8400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9c015a480 0x7fc9c01481c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9c8400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c015f730 con 0x7fc9c015a480 2024-04-02T07:28:34.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9c8400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c015f430 con 0x7fc9c00ca9a0 2024-04-02T07:28:34.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9c8400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c015c1c0 con 0x7fc9c00b1070 2024-04-02T07:28:34.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9c6400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9c015a480 0x7fc9c01481c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9c6400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9c015a480 0x7fc9c01481c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47814/0 (socket says 172.21.15.55:47814) 2024-04-02T07:28:34.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9c6400640 1 -- 172.21.15.55:0/1909743748 learned_addr learned my addr 172.21.15.55:0/1909743748 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:34.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9c5a00640 1 --2- 172.21.15.55:0/1909743748 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9c00b1070 0x7fc9c015fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9c5000640 1 --2- 172.21.15.55:0/1909743748 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9c00ca9a0 0x7fc9c015b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9c6400640 1 -- 172.21.15.55:0/1909743748 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9c00b1070 msgr2=0x7fc9c015fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9c6400640 1 --2- 172.21.15.55:0/1909743748 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9c00b1070 0x7fc9c015fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9c6400640 1 -- 172.21.15.55:0/1909743748 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9c00ca9a0 msgr2=0x7fc9c015b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9c6400640 1 --2- 172.21.15.55:0/1909743748 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9c00ca9a0 0x7fc9c015b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9c6400640 1 -- 172.21.15.55:0/1909743748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b8009a70 con 0x7fc9c015a480 2024-04-02T07:28:34.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9c6400640 1 --2- 172.21.15.55:0/1909743748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9c015a480 0x7fc9c01481c0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80b0040 tx=0x7fc9b80196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:34.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9bd600640 1 -- 172.21.15.55:0/1909743748 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80b9860 con 0x7fc9c015a480 2024-04-02T07:28:34.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9bd600640 1 -- 172.21.15.55:0/1909743748 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b80b99c0 con 0x7fc9c015a480 2024-04-02T07:28:34.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9bd600640 1 -- 172.21.15.55:0/1909743748 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b80b9d70 con 0x7fc9c015a480 2024-04-02T07:28:34.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9c8400640 1 -- 172.21.15.55:0/1909743748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c015c460 con 0x7fc9c015a480 2024-04-02T07:28:34.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9c8400640 1 -- 172.21.15.55:0/1909743748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c0145520 con 0x7fc9c015a480 2024-04-02T07:28:34.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9c8400640 1 -- 172.21.15.55:0/1909743748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c015f8a0 con 0x7fc9c015a480 2024-04-02T07:28:34.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.211+0000 7fc9bd600640 1 -- 172.21.15.55:0/1909743748 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc9b80c4460 con 0x7fc9c015a480 2024-04-02T07:28:34.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.215+0000 7fc9bd600640 1 --2- 172.21.15.55:0/1909743748 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc9a0066690 0x7fc9a0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.215+0000 7fc9bd600640 1 -- 172.21.15.55:0/1909743748 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc9b811f680 con 0x7fc9c015a480 2024-04-02T07:28:34.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.215+0000 7fc9c5a00640 1 --2- 172.21.15.55:0/1909743748 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc9a0066690 0x7fc9a0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.215+0000 7fc9c5a00640 1 --2- 172.21.15.55:0/1909743748 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc9a0066690 0x7fc9a0068b50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0145ad0 tx=0x7fc9b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:34.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.219+0000 7fc9bd600640 1 -- 172.21.15.55:0/1909743748 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc9b80eca70 con 0x7fc9c015a480 2024-04-02T07:28:34.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.415+0000 7fc9c8400640 1 -- 172.21.15.55:0/1909743748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc9c0066c90 con 0x7fc9c015a480 2024-04-02T07:28:34.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.415+0000 7fc9bd600640 1 -- 172.21.15.55:0/1909743748 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4741 (secure 0 0 0) 0x7fc9b80f0090 con 0x7fc9c015a480 2024-04-02T07:28:34.417 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:34.417 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":52,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2000687874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2000687874},{"type":"v1","addr":"172.21.15.106:6835","nonce":2000687874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/823234890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":823234890},{"type":"v1","addr":"172.21.15.55:6835","nonce":823234890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6439,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1803758651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1803758651},{"type":"v1","addr":"172.21.15.106:6837","nonce":1803758651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:26:55.525186+0000","modified":"2024-04-02T07:28:06.241662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":16,"addr":"172.21.15.55:6833/1965896660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1965896660},{"type":"v1","addr":"172.21.15.55:6833","nonce":1965896660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-02T07:28:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 52 2024-04-02T07:28:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.415+0000 7fc9c8400640 1 -- 172.21.15.55:0/1909743748 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc9a0066690 msgr2=0x7fc9a0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.415+0000 7fc9c8400640 1 --2- 172.21.15.55:0/1909743748 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc9a0066690 0x7fc9a0068b50 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0145ad0 tx=0x7fc9b4008040 comp rx=0 tx=0).stop 2024-04-02T07:28:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.415+0000 7fc9c8400640 1 -- 172.21.15.55:0/1909743748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9c015a480 msgr2=0x7fc9c01481c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.415+0000 7fc9c8400640 1 --2- 172.21.15.55:0/1909743748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9c015a480 0x7fc9c01481c0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fc9b80b0040 tx=0x7fc9b80196d0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.415+0000 7fc9c8400640 1 -- 172.21.15.55:0/1909743748 shutdown_connections 2024-04-02T07:28:34.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.415+0000 7fc9c8400640 1 --2- 172.21.15.55:0/1909743748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9c015a480 0x7fc9c01481c0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.415+0000 7fc9c8400640 1 --2- 172.21.15.55:0/1909743748 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc9a0066690 0x7fc9a0068b50 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.415+0000 7fc9c8400640 1 --2- 172.21.15.55:0/1909743748 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9c00ca9a0 0x7fc9c015b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.415+0000 7fc9c8400640 1 --2- 172.21.15.55:0/1909743748 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9c00b1070 0x7fc9c015fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.415+0000 7fc9c8400640 1 -- 172.21.15.55:0/1909743748 >> 172.21.15.55:0/1909743748 conn(0x7fc9c0066080 msgr2=0x7fc9c006c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:34.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.415+0000 7fc9c8400640 1 -- 172.21.15.55:0/1909743748 shutdown_connections 2024-04-02T07:28:34.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.415+0000 7fc9c8400640 1 -- 172.21.15.55:0/1909743748 wait complete. 2024-04-02T07:28:34.438 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-02T07:28:34.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.579+0000 7fc5c8a00640 1 Processor -- start 2024-04-02T07:28:34.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.579+0000 7fc5c8a00640 1 -- start start 2024-04-02T07:28:34.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.579+0000 7fc5c8a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5c4098a10 0x7fc5c4098e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.579+0000 7fc5c8a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc5c406b920 0x7fc5c406bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.579+0000 7fc5c8a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5c415ce40 con 0x7fc5c415ca60 2024-04-02T07:28:34.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.579+0000 7fc5c8a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5c4099390 con 0x7fc5c406b920 2024-04-02T07:28:34.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.579+0000 7fc5c8a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40ceeb0 con 0x7fc5c4098a10 2024-04-02T07:28:34.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.583+0000 7fc5c2800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc5c406b920 0x7fc5c406bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.583+0000 7fc5c2800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc5c406b920 0x7fc5c406bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47824/0 (socket says 172.21.15.55:47824) 2024-04-02T07:28:34.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.583+0000 7fc5c2800640 1 -- 172.21.15.55:0/3572502702 learned_addr learned my addr 172.21.15.55:0/3572502702 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:34.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.583+0000 7fc5bbe00640 1 --2- 172.21.15.55:0/3572502702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5c4098a10 0x7fc5c4098e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.583+0000 7fc5c2800640 1 -- 172.21.15.55:0/3572502702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5c4098a10 msgr2=0x7fc5c4098e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:34.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.583+0000 7fc5c2800640 1 --2- 172.21.15.55:0/3572502702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5c4098a10 0x7fc5c4098e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.583+0000 7fc5c2800640 1 -- 172.21.15.55:0/3572502702 >> v1:172.21.15.106:6789/0 conn(0x7fc5c415ca60 legacy=0x7fc5c40cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.583+0000 7fc5c2800640 1 -- 172.21.15.55:0/3572502702 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c40cf190 con 0x7fc5c406b920 2024-04-02T07:28:34.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.583+0000 7fc5c2800640 1 --2- 172.21.15.55:0/3572502702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c406b920 0x7fc5c406bd50 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009e50 tx=0x7fc5bc01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bffda3e04a53b7b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:34.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.583+0000 7fc5c1400640 1 -- 172.21.15.55:0/3572502702 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc0a5830 con 0x7fc5c406b920 2024-04-02T07:28:34.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.583+0000 7fc5c1400640 1 -- 172.21.15.55:0/3572502702 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc0a5990 con 0x7fc5c406b920 2024-04-02T07:28:34.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c1400640 1 -- 172.21.15.55:0/3572502702 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc0a5d20 con 0x7fc5c406b920 2024-04-02T07:28:34.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c8a00640 1 -- 172.21.15.55:0/3572502702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c406b920 msgr2=0x7fc5c406bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c8a00640 1 --2- 172.21.15.55:0/3572502702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c406b920 0x7fc5c406bd50 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc009e50 tx=0x7fc5bc01c970 comp rx=0 tx=0).stop 2024-04-02T07:28:34.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c8a00640 1 -- 172.21.15.55:0/3572502702 shutdown_connections 2024-04-02T07:28:34.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c8a00640 1 --2- 172.21.15.55:0/3572502702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c406b920 0x7fc5c406bd50 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c8a00640 1 --2- 172.21.15.55:0/3572502702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5c4098a10 0x7fc5c4098e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c8a00640 1 -- 172.21.15.55:0/3572502702 >> 172.21.15.55:0/3572502702 conn(0x7fc5c40b2150 msgr2=0x7fc5c40b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:34.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c8a00640 1 -- 172.21.15.55:0/3572502702 shutdown_connections 2024-04-02T07:28:34.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c8a00640 1 -- 172.21.15.55:0/3572502702 wait complete. 2024-04-02T07:28:34.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c8a00640 1 Processor -- start 2024-04-02T07:28:34.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c8a00640 1 -- start start 2024-04-02T07:28:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c8a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5c406b920 0x7fc5c40c8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c8a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5c4098a10 0x7fc5c4158e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c8a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c415ca60 0x7fc5c40b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c8a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40c8d80 con 0x7fc5c415ca60 2024-04-02T07:28:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c8a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40c9060 con 0x7fc5c4098a10 2024-04-02T07:28:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c8a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5c40c9340 con 0x7fc5c406b920 2024-04-02T07:28:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c2800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c415ca60 0x7fc5c40b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c2800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c415ca60 0x7fc5c40b0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47830/0 (socket says 172.21.15.55:47830) 2024-04-02T07:28:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c2800640 1 -- 172.21.15.55:0/1996971092 learned_addr learned my addr 172.21.15.55:0/1996971092 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5bbe00640 1 --2- 172.21.15.55:0/1996971092 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5c4098a10 0x7fc5c4158e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c1e00640 1 --2- 172.21.15.55:0/1996971092 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5c406b920 0x7fc5c40c8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c2800640 1 -- 172.21.15.55:0/1996971092 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5c406b920 msgr2=0x7fc5c40c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c2800640 1 --2- 172.21.15.55:0/1996971092 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5c406b920 0x7fc5c40c8780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c2800640 1 -- 172.21.15.55:0/1996971092 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5c4098a10 msgr2=0x7fc5c4158e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c2800640 1 --2- 172.21.15.55:0/1996971092 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5c4098a10 0x7fc5c4158e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.587+0000 7fc5c2800640 1 -- 172.21.15.55:0/1996971092 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5bc009b30 con 0x7fc5c415ca60 2024-04-02T07:28:34.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.591+0000 7fc5c2800640 1 --2- 172.21.15.55:0/1996971092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c415ca60 0x7fc5c40b0b60 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc01a5a0 tx=0x7fc5bc019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:34.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.591+0000 7fc5ba000640 1 -- 172.21.15.55:0/1996971092 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc0b8670 con 0x7fc5c415ca60 2024-04-02T07:28:34.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.591+0000 7fc5ba000640 1 -- 172.21.15.55:0/1996971092 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5bc0b87d0 con 0x7fc5c415ca60 2024-04-02T07:28:34.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.591+0000 7fc5ba000640 1 -- 172.21.15.55:0/1996971092 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5bc0b8b60 con 0x7fc5c415ca60 2024-04-02T07:28:34.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.591+0000 7fc5c8a00640 1 -- 172.21.15.55:0/1996971092 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5c40c9620 con 0x7fc5c415ca60 2024-04-02T07:28:34.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.591+0000 7fc5c8a00640 1 -- 172.21.15.55:0/1996971092 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c40c9d40 con 0x7fc5c415ca60 2024-04-02T07:28:34.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.591+0000 7fc5ba000640 1 -- 172.21.15.55:0/1996971092 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc5bc0b8cc0 con 0x7fc5c415ca60 2024-04-02T07:28:34.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.591+0000 7fc5ba000640 1 --2- 172.21.15.55:0/1996971092 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc5a0066690 0x7fc5a0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.591+0000 7fc5ba000640 1 -- 172.21.15.55:0/1996971092 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc5bc11f760 con 0x7fc5c415ca60 2024-04-02T07:28:34.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.591+0000 7fc5c1e00640 1 --2- 172.21.15.55:0/1996971092 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc5a0066690 0x7fc5a0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.591+0000 7fc5cbf46000 1 Processor -- start 2024-04-02T07:28:34.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5cbf46000 1 -- start start 2024-04-02T07:28:34.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5c1e00640 1 --2- 172.21.15.55:0/1996971092 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc5a0066690 0x7fc5a0068b50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4007fd0 tx=0x7fc5b4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:34.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5cbf46000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 0x558a6c8b6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5cbf46000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558a6c8b6bb0 0x558a6c86cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5cbf46000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a6c86d1b0 0x558a6c86d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5cbf46000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a6c735340 con 0x558a6c8b6290 2024-04-02T07:28:34.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5cbf46000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a6c6c1cd0 con 0x558a6c86d1b0 2024-04-02T07:28:34.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5cbf46000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a6c6bf2a0 con 0x558a6c8b6bb0 2024-04-02T07:28:34.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5c1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 0x558a6c8b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5c1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 0x558a6c8b6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47844/0 (socket says 172.21.15.55:47844) 2024-04-02T07:28:34.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5c1e00640 1 -- 172.21.15.55:0/1128000769 learned_addr learned my addr 172.21.15.55:0/1128000769 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:34.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5bbe00640 1 --2- 172.21.15.55:0/1128000769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558a6c8b6bb0 0x558a6c86cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5c2800640 1 --2- 172.21.15.55:0/1128000769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a6c86d1b0 0x558a6c86d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5c1e00640 1 -- 172.21.15.55:0/1128000769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558a6c8b6bb0 msgr2=0x558a6c86cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:34.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5c1e00640 1 --2- 172.21.15.55:0/1128000769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558a6c8b6bb0 0x558a6c86cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5c1e00640 1 -- 172.21.15.55:0/1128000769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a6c86d1b0 msgr2=0x558a6c86d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:34.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5c1e00640 1 --2- 172.21.15.55:0/1128000769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a6c86d1b0 0x558a6c86d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5c1e00640 1 -- 172.21.15.55:0/1128000769 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a6c3ad4b0 con 0x558a6c8b6290 2024-04-02T07:28:34.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5c1e00640 1 --2- 172.21.15.55:0/1128000769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 0x558a6c8b6670 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40015e0 tx=0x7fc5b4012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4439db3354d025 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:34.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5b2a00640 1 -- 172.21.15.55:0/1128000769 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b40149d0 con 0x558a6c8b6290 2024-04-02T07:28:34.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5b2a00640 1 -- 172.21.15.55:0/1128000769 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b4014b30 con 0x558a6c8b6290 2024-04-02T07:28:34.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5b2a00640 1 -- 172.21.15.55:0/1128000769 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4014ea0 con 0x558a6c8b6290 2024-04-02T07:28:34.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5cbf46000 1 -- 172.21.15.55:0/1128000769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 msgr2=0x558a6c8b6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5cbf46000 1 --2- 172.21.15.55:0/1128000769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 0x558a6c8b6670 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40015e0 tx=0x7fc5b4012000 comp rx=0 tx=0).stop 2024-04-02T07:28:34.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5cbf46000 1 -- 172.21.15.55:0/1128000769 shutdown_connections 2024-04-02T07:28:34.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5cbf46000 1 --2- 172.21.15.55:0/1128000769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a6c86d1b0 0x558a6c86d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5cbf46000 1 --2- 172.21.15.55:0/1128000769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558a6c8b6bb0 0x558a6c86cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5cbf46000 1 --2- 172.21.15.55:0/1128000769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 0x558a6c8b6670 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5cbf46000 1 -- 172.21.15.55:0/1128000769 >> 172.21.15.55:0/1128000769 conn(0x558a6c869160 msgr2=0x558a6c86b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:34.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5cbf46000 1 -- 172.21.15.55:0/1128000769 shutdown_connections 2024-04-02T07:28:34.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5cbf46000 1 -- 172.21.15.55:0/1128000769 wait complete. 2024-04-02T07:28:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5cbf46000 1 -- start start 2024-04-02T07:28:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.595+0000 7fc5cbf46000 1 Processor -- start 2024-04-02T07:28:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5cbf46000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a6c86d1b0 0x558a6c872740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5cbf46000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 0x558a6c872c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5cbf46000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558a6c8b6bb0 0x558a6c877e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5cbf46000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a6c6bab90 con 0x558a6c8b6290 2024-04-02T07:28:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5cbf46000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a6c6780a0 con 0x558a6c86d1b0 2024-04-02T07:28:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5cbf46000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a6c677d40 con 0x558a6c8b6bb0 2024-04-02T07:28:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5cbf46000 10 client.0 _ll_register_callbacks cb 0x558a6c76fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:28:34.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5bbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 0x558a6c872c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5bbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 0x558a6c872c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47854/0 (socket says 172.21.15.55:47854) 2024-04-02T07:28:34.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5bbe00640 1 -- 172.21.15.55:0/2515261868 learned_addr learned my addr 172.21.15.55:0/2515261868 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:34.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5c1e00640 1 --2- 172.21.15.55:0/2515261868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a6c86d1b0 0x558a6c872740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5c2800640 1 --2- 172.21.15.55:0/2515261868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558a6c8b6bb0 0x558a6c877e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5bbe00640 1 -- 172.21.15.55:0/2515261868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558a6c8b6bb0 msgr2=0x558a6c877e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:34.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5bbe00640 1 --2- 172.21.15.55:0/2515261868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558a6c8b6bb0 0x558a6c877e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5bbe00640 1 -- 172.21.15.55:0/2515261868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a6c86d1b0 msgr2=0x558a6c872740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:34.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5bbe00640 1 --2- 172.21.15.55:0/2515261868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a6c86d1b0 0x558a6c872740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5bbe00640 1 -- 172.21.15.55:0/2515261868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c415ce40 con 0x558a6c8b6290 2024-04-02T07:28:34.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5bbe00640 1 --2- 172.21.15.55:0/2515261868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 0x558a6c872c80 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac0147a0 tx=0x7fc5ac014c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db73048d4aab6d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:34.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5a7400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:28:34.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5a7400640 1 -- 172.21.15.55:0/2515261868 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac014eb0 con 0x558a6c8b6290 2024-04-02T07:28:34.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5a7400640 1 -- 172.21.15.55:0/2515261868 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc5ac01a070 con 0x558a6c8b6290 2024-04-02T07:28:34.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5cbf46000 1 -- 172.21.15.55:0/2515261868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a6c68a550 con 0x558a6c8b6290 2024-04-02T07:28:34.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5a7400640 1 -- 172.21.15.55:0/2515261868 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5ac012ac0 con 0x558a6c8b6290 2024-04-02T07:28:34.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5cbf46000 10 client.7230 fetch_fsmap learned FSMap version 52 2024-04-02T07:28:34.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5cbf46000 1 -- 172.21.15.55:0/2515261868 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x558a6c67fba0 con 0x558a6c8b6290 2024-04-02T07:28:34.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5a7400640 1 -- 172.21.15.55:0/2515261868 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558a6c68a550 con 0x558a6c8b6290 2024-04-02T07:28:34.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5a7400640 1 -- 172.21.15.55:0/2515261868 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 52) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc5ac011030 con 0x558a6c8b6290 2024-04-02T07:28:34.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5cbf46000 10 client.7230 fetch_fsmap finished waiting for FSMap version 52 2024-04-02T07:28:34.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5cbf46000 10 client.7230 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:28:34.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5cbf46000 20 client.7230 populate_metadata read hostname 'smithi055' 2024-04-02T07:28:34.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5cbf46000 1 --2- 172.21.15.55:0/2515261868 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x558a6c8c5320 0x558a6c8c7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5cbf46000 4 client.7230 mds_command: new command op to 6936 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:28:34.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5cbf46000 1 -- 172.21.15.55:0/2515261868 --> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a6c6b7970 con 0x558a6c8c5320 2024-04-02T07:28:34.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5c1e00640 1 --2- 172.21.15.55:0/2515261868 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x558a6c8c5320 0x558a6c8c7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5c1e00640 1 --2- 172.21.15.55:0/2515261868 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x558a6c8c5320 0x558a6c8c7710 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd98493b5b820114 server_cookie=d0ae540507663efd in_seq=0 out_seq=0 2024-04-02T07:28:34.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5a7400640 10 client.7230 ms_handle_connect on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:34.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5a7400640 1 -- 172.21.15.55:0/2515261868 <== mds.0 v2:172.21.15.55:6832/1965896660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x558a6c6b7970 con 0x558a6c8c5320 2024-04-02T07:28:34.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5a7400640 10 client.7230 handle_command_reply: tid=0 2024-04-02T07:28:34.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.599+0000 7fc5cbf46000 1 client.7230 shutdown 2024-04-02T07:28:34.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.603+0000 7fc5cbf46000 1 -- 172.21.15.55:0/2515261868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 msgr2=0x558a6c872c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.603+0000 7fc5cbf46000 1 --2- 172.21.15.55:0/2515261868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 0x558a6c872c80 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac0147a0 tx=0x7fc5ac014c60 comp rx=0 tx=0).stop 2024-04-02T07:28:34.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.603+0000 7fc5cbf46000 1 -- 172.21.15.55:0/2515261868 shutdown_connections 2024-04-02T07:28:34.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.603+0000 7fc5cbf46000 1 --2- 172.21.15.55:0/2515261868 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x558a6c8c5320 0x558a6c8c7710 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.603+0000 7fc5cbf46000 1 --2- 172.21.15.55:0/2515261868 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558a6c8b6bb0 0x558a6c877e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.603+0000 7fc5cbf46000 1 --2- 172.21.15.55:0/2515261868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 0x558a6c872c80 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.603+0000 7fc5cbf46000 1 --2- 172.21.15.55:0/2515261868 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a6c86d1b0 0x558a6c872740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.603+0000 7fc5cbf46000 1 -- 172.21.15.55:0/2515261868 >> 172.21.15.55:0/2515261868 conn(0x558a6c869160 msgr2=0x558a6c86bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:34.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.603+0000 7fc5a7400640 0 client.7230 ms_handle_reset on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:34.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.603+0000 7fc5cbf46000 1 -- 172.21.15.55:0/2515261868 shutdown_connections 2024-04-02T07:28:34.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.603+0000 7fc5cbf46000 1 -- 172.21.15.55:0/2515261868 wait complete. 2024-04-02T07:28:34.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.603+0000 7fc5cbf46000 20 client.7230 trim_cache size 0 max 16384 2024-04-02T07:28:34.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5cbf46000 1 Processor -- start 2024-04-02T07:28:34.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5cbf46000 1 -- start start 2024-04-02T07:28:34.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5cbf46000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c86d1b0 0x558a6c90f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5cbf46000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a6c8b6290 0x558a6c90fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5cbf46000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558a6c8b6bb0 0x558a6c910170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5cbf46000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a6c377c40 con 0x558a6c86d1b0 2024-04-02T07:28:34.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5cbf46000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a6c6c2f60 con 0x558a6c8b6290 2024-04-02T07:28:34.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5cbf46000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a6c663520 con 0x558a6c8b6bb0 2024-04-02T07:28:34.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5c1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c86d1b0 0x558a6c90f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5c1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c86d1b0 0x558a6c90f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47866/0 (socket says 172.21.15.55:47866) 2024-04-02T07:28:34.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5c1e00640 1 -- 172.21.15.55:0/1902206398 learned_addr learned my addr 172.21.15.55:0/1902206398 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:34.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5c2800640 1 --2- 172.21.15.55:0/1902206398 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558a6c8b6bb0 0x558a6c910170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5bbe00640 1 --2- 172.21.15.55:0/1902206398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a6c8b6290 0x558a6c90fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5c1e00640 1 -- 172.21.15.55:0/1902206398 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558a6c8b6bb0 msgr2=0x558a6c910170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:34.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5c1e00640 1 --2- 172.21.15.55:0/1902206398 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558a6c8b6bb0 0x558a6c910170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5c1e00640 1 -- 172.21.15.55:0/1902206398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a6c8b6290 msgr2=0x558a6c90fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:34.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5c1e00640 1 --2- 172.21.15.55:0/1902206398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a6c8b6290 0x558a6c90fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5c1e00640 1 -- 172.21.15.55:0/1902206398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a6c665ef0 con 0x558a6c86d1b0 2024-04-02T07:28:34.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5c1e00640 1 --2- 172.21.15.55:0/1902206398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c86d1b0 0x558a6c90f6f0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4023040 tx=0x7fc5b4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fe179f2d89664a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:34.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5b3400640 1 -- 172.21.15.55:0/1902206398 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4030040 con 0x558a6c86d1b0 2024-04-02T07:28:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5b3400640 1 -- 172.21.15.55:0/1902206398 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5b4033340 con 0x558a6c86d1b0 2024-04-02T07:28:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5b3400640 1 -- 172.21.15.55:0/1902206398 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5b4033880 con 0x558a6c86d1b0 2024-04-02T07:28:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5cbf46000 1 -- 172.21.15.55:0/1902206398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c86d1b0 msgr2=0x558a6c90f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5cbf46000 1 --2- 172.21.15.55:0/1902206398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c86d1b0 0x558a6c90f6f0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4023040 tx=0x7fc5b4015000 comp rx=0 tx=0).stop 2024-04-02T07:28:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5cbf46000 1 -- 172.21.15.55:0/1902206398 shutdown_connections 2024-04-02T07:28:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5cbf46000 1 --2- 172.21.15.55:0/1902206398 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558a6c8b6bb0 0x558a6c910170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5cbf46000 1 --2- 172.21.15.55:0/1902206398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a6c8b6290 0x558a6c90fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5cbf46000 1 --2- 172.21.15.55:0/1902206398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c86d1b0 0x558a6c90f6f0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5cbf46000 1 -- 172.21.15.55:0/1902206398 >> 172.21.15.55:0/1902206398 conn(0x558a6c869160 msgr2=0x558a6c872a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5cbf46000 1 -- 172.21.15.55:0/1902206398 shutdown_connections 2024-04-02T07:28:34.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5cbf46000 1 -- 172.21.15.55:0/1902206398 wait complete. 2024-04-02T07:28:34.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5cbf46000 1 -- start start 2024-04-02T07:28:34.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.615+0000 7fc5cbf46000 1 Processor -- start 2024-04-02T07:28:34.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558a6c86d1b0 0x558a6c913720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 0x558a6c8c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a6c8b6bb0 0x558a6c8c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a6c8645e0 con 0x558a6c8b6290 2024-04-02T07:28:34.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a6c674040 con 0x558a6c8b6bb0 2024-04-02T07:28:34.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x558a6c6bbe20 con 0x558a6c86d1b0 2024-04-02T07:28:34.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 10 client.0 _ll_register_callbacks cb 0x558a6c758870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:28:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5bbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 0x558a6c8c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5bbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 0x558a6c8c7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47878/0 (socket says 172.21.15.55:47878) 2024-04-02T07:28:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5bbe00640 1 -- 172.21.15.55:0/3192531416 learned_addr learned my addr 172.21.15.55:0/3192531416 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5c1e00640 1 --2- 172.21.15.55:0/3192531416 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558a6c86d1b0 0x558a6c913720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5c2800640 1 --2- 172.21.15.55:0/3192531416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a6c8b6bb0 0x558a6c8c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5bbe00640 1 -- 172.21.15.55:0/3192531416 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558a6c86d1b0 msgr2=0x558a6c913720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5bbe00640 1 --2- 172.21.15.55:0/3192531416 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558a6c86d1b0 0x558a6c913720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5bbe00640 1 -- 172.21.15.55:0/3192531416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a6c8b6bb0 msgr2=0x558a6c8c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5bbe00640 1 --2- 172.21.15.55:0/3192531416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a6c8b6bb0 0x558a6c8c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5bbe00640 1 -- 172.21.15.55:0/3192531416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558a6c3ad4b0 con 0x558a6c8b6290 2024-04-02T07:28:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5bbe00640 1 --2- 172.21.15.55:0/3192531416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 0x558a6c8c7e70 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac001ec0 tx=0x7fc5ac0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e084afe64c6142eb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5a7400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:28:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5a7400640 1 -- 172.21.15.55:0/3192531416 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5ac014eb0 con 0x558a6c8b6290 2024-04-02T07:28:34.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5a7400640 1 -- 172.21.15.55:0/3192531416 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fc5ac0167a0 con 0x558a6c8b6290 2024-04-02T07:28:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 -- 172.21.15.55:0/3192531416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a6c66a620 con 0x558a6c8b6290 2024-04-02T07:28:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5a7400640 1 -- 172.21.15.55:0/3192531416 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5ac012d10 con 0x558a6c8b6290 2024-04-02T07:28:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 10 client.7236 fetch_fsmap learned FSMap version 52 2024-04-02T07:28:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 -- 172.21.15.55:0/3192531416 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=2+}) v3 -- 0x558a6c3b6fc0 con 0x558a6c8b6290 2024-04-02T07:28:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5a7400640 1 -- 172.21.15.55:0/3192531416 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558a6c66a620 con 0x558a6c8b6290 2024-04-02T07:28:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5a7400640 1 -- 172.21.15.55:0/3192531416 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 52) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc5ac011040 con 0x558a6c8b6290 2024-04-02T07:28:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 10 client.7236 fetch_fsmap finished waiting for FSMap version 52 2024-04-02T07:28:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 10 client.7236 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:28:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 20 client.7236 populate_metadata read hostname 'smithi055' 2024-04-02T07:28:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 --2- 172.21.15.55:0/3192531416 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x558a6c8c88f0 0x558a6c8c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 4 client.7236 mds_command: new command op to 6936 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-02T07:28:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 -- 172.21.15.55:0/3192531416 --> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x558a6c6b94e0 con 0x558a6c8c88f0 2024-04-02T07:28:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5c1e00640 1 --2- 172.21.15.55:0/3192531416 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x558a6c8c88f0 0x558a6c8c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5c1e00640 1 --2- 172.21.15.55:0/3192531416 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x558a6c8c88f0 0x558a6c8c8cd0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fbc38297d25b5c52 server_cookie=f51026839a643a05 in_seq=0 out_seq=0 2024-04-02T07:28:34.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5a7400640 10 client.7236 ms_handle_connect on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5a7400640 1 -- 172.21.15.55:0/3192531416 <== mds.0 v2:172.21.15.55:6832/1965896660 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x558a6c6b94e0 con 0x558a6c8c88f0 2024-04-02T07:28:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5a7400640 10 client.7236 handle_command_reply: tid=0 2024-04-02T07:28:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 client.7236 shutdown 2024-04-02T07:28:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 -- 172.21.15.55:0/3192531416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 msgr2=0x558a6c8c7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 --2- 172.21.15.55:0/3192531416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 0x558a6c8c7e70 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fc5ac001ec0 tx=0x7fc5ac0046d0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 -- 172.21.15.55:0/3192531416 shutdown_connections 2024-04-02T07:28:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 --2- 172.21.15.55:0/3192531416 >> [v2:172.21.15.55:6832/1965896660,v1:172.21.15.55:6833/1965896660] conn(0x558a6c8c88f0 0x558a6c8c8cd0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 --2- 172.21.15.55:0/3192531416 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558a6c8b6bb0 0x558a6c8c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 --2- 172.21.15.55:0/3192531416 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558a6c8b6290 0x558a6c8c7e70 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5a7400640 0 client.7236 ms_handle_reset on v2:172.21.15.55:6832/1965896660 2024-04-02T07:28:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 --2- 172.21.15.55:0/3192531416 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558a6c86d1b0 0x558a6c913720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 -- 172.21.15.55:0/3192531416 >> 172.21.15.55:0/3192531416 conn(0x558a6c869160 msgr2=0x558a6c8b4d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:34.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 -- 172.21.15.55:0/3192531416 shutdown_connections 2024-04-02T07:28:34.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.619+0000 7fc5cbf46000 1 -- 172.21.15.55:0/3192531416 wait complete. 2024-04-02T07:28:34.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.623+0000 7fc5cbf46000 20 client.7236 trim_cache size 0 max 16384 2024-04-02T07:28:34.628 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:34.628 INFO:teuthology.orchestra.run.smithi055.stdout:[] 2024-04-02T07:28:34.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.623+0000 7fc5c8a00640 1 -- 172.21.15.55:0/1996971092 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc5a0066690 msgr2=0x7fc5a0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.623+0000 7fc5c8a00640 1 --2- 172.21.15.55:0/1996971092 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc5a0066690 0x7fc5a0068b50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4007fd0 tx=0x7fc5b4009040 comp rx=0 tx=0).stop 2024-04-02T07:28:34.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.623+0000 7fc5c8a00640 1 -- 172.21.15.55:0/1996971092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c415ca60 msgr2=0x7fc5c40b0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.623+0000 7fc5c8a00640 1 --2- 172.21.15.55:0/1996971092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c415ca60 0x7fc5c40b0b60 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fc5bc01a5a0 tx=0x7fc5bc019710 comp rx=0 tx=0).stop 2024-04-02T07:28:34.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.623+0000 7fc5c8a00640 1 -- 172.21.15.55:0/1996971092 shutdown_connections 2024-04-02T07:28:34.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.623+0000 7fc5c8a00640 1 --2- 172.21.15.55:0/1996971092 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc5c415ca60 0x7fc5c40b0b60 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.623+0000 7fc5c8a00640 1 --2- 172.21.15.55:0/1996971092 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc5a0066690 0x7fc5a0068b50 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.623+0000 7fc5c8a00640 1 --2- 172.21.15.55:0/1996971092 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc5c4098a10 0x7fc5c4158e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.623+0000 7fc5c8a00640 1 --2- 172.21.15.55:0/1996971092 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc5c406b920 0x7fc5c40c8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.623+0000 7fc5c8a00640 1 -- 172.21.15.55:0/1996971092 >> 172.21.15.55:0/1996971092 conn(0x7fc5c40b2150 msgr2=0x7fc5c40ad5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:34.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.623+0000 7fc5c8a00640 1 -- 172.21.15.55:0/1996971092 shutdown_connections 2024-04-02T07:28:34.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.623+0000 7fc5c8a00640 1 -- 172.21.15.55:0/1996971092 wait complete. 2024-04-02T07:28:34.642 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-02T07:28:34.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.779+0000 7f424a600640 1 Processor -- start 2024-04-02T07:28:34.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.779+0000 7f424a600640 1 -- start start 2024-04-02T07:28:34.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.779+0000 7f424a600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f424415ad30 0x7f42440cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.779+0000 7f424a600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f42440cd8b0 0x7f42440c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.779+0000 7f424a600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42440b3c00 con 0x7f4244143f90 2024-04-02T07:28:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.779+0000 7f424a600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42440cdd20 con 0x7f42440cd8b0 2024-04-02T07:28:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.779+0000 7f424a600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4244144370 con 0x7f424415ad30 2024-04-02T07:28:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.779+0000 7f4243e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f42440cd8b0 0x7f42440c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.779+0000 7f4243400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4244143f90 0x7f42440b34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59920/0 (socket says 172.21.15.55:59920) 2024-04-02T07:28:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.779+0000 7f4243400640 1 -- 172.21.15.55:0/366055991 learned_addr learned my addr 172.21.15.55:0/366055991 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.779+0000 7f423be00640 1 --2- 172.21.15.55:0/366055991 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f424415ad30 0x7f42440cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.779+0000 7f4243e00640 1 -- 172.21.15.55:0/366055991 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f424415ad30 msgr2=0x7f42440cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.779+0000 7f4243e00640 1 --2- 172.21.15.55:0/366055991 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f424415ad30 0x7f42440cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.779+0000 7f4243e00640 1 -- 172.21.15.55:0/366055991 >> v1:172.21.15.55:6789/0 conn(0x7f4244143f90 legacy=0x7f42440b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.779+0000 7f4242a00640 1 -- 172.21.15.55:0/366055991 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396231379 0 0) 0x7f42440b3c00 con 0x7f4244143f90 2024-04-02T07:28:34.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.779+0000 7f4243e00640 1 -- 172.21.15.55:0/366055991 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42440c37b0 con 0x7f42440cd8b0 2024-04-02T07:28:34.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.783+0000 7f4243e00640 1 --2- 172.21.15.55:0/366055991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42440cd8b0 0x7f42440c4850 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f423c009d90 tx=0x7f423c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c0f7a48c80d7502 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:34.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.783+0000 7f4242a00640 1 -- 172.21.15.55:0/366055991 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c0a5970 con 0x7f42440cd8b0 2024-04-02T07:28:34.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.783+0000 7f4242a00640 1 -- 172.21.15.55:0/366055991 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423c0a5ad0 con 0x7f42440cd8b0 2024-04-02T07:28:34.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.783+0000 7f4242a00640 1 -- 172.21.15.55:0/366055991 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423c0a5e60 con 0x7f42440cd8b0 2024-04-02T07:28:34.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.783+0000 7f424a600640 1 -- 172.21.15.55:0/366055991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42440cd8b0 msgr2=0x7f42440c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.783+0000 7f424a600640 1 --2- 172.21.15.55:0/366055991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42440cd8b0 0x7f42440c4850 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f423c009d90 tx=0x7f423c01c8b0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.783+0000 7f424a600640 1 -- 172.21.15.55:0/366055991 shutdown_connections 2024-04-02T07:28:34.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.783+0000 7f424a600640 1 --2- 172.21.15.55:0/366055991 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f424415ad30 0x7f42440cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.783+0000 7f424a600640 1 --2- 172.21.15.55:0/366055991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42440cd8b0 0x7f42440c4850 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.783+0000 7f424a600640 1 -- 172.21.15.55:0/366055991 >> 172.21.15.55:0/366055991 conn(0x7f4244066080 msgr2=0x7f4244069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:34.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.783+0000 7f424a600640 1 -- 172.21.15.55:0/366055991 shutdown_connections 2024-04-02T07:28:34.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.783+0000 7f424a600640 1 -- 172.21.15.55:0/366055991 wait complete. 2024-04-02T07:28:34.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f424a600640 1 Processor -- start 2024-04-02T07:28:34.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f424a600640 1 -- start start 2024-04-02T07:28:34.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f424a600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42440cd8b0 0x7f4244158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f424a600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4244143f90 0x7f4244141be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f424a600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f424415ad30 0x7f4244142120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f424a600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4244141750 con 0x7f4244143f90 2024-04-02T07:28:34.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f424a600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4244140e20 con 0x7f424415ad30 2024-04-02T07:28:34.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f424a600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4244141100 con 0x7f42440cd8b0 2024-04-02T07:28:34.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f423be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4244143f90 0x7f4244141be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f423be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4244143f90 0x7f4244141be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47896/0 (socket says 172.21.15.55:47896) 2024-04-02T07:28:34.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f423be00640 1 -- 172.21.15.55:0/998416618 learned_addr learned my addr 172.21.15.55:0/998416618 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:34.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f4243400640 1 --2- 172.21.15.55:0/998416618 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42440cd8b0 0x7f4244158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f4243e00640 1 --2- 172.21.15.55:0/998416618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f424415ad30 0x7f4244142120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f423be00640 1 -- 172.21.15.55:0/998416618 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42440cd8b0 msgr2=0x7f4244158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f423be00640 1 --2- 172.21.15.55:0/998416618 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42440cd8b0 0x7f4244158440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f423be00640 1 -- 172.21.15.55:0/998416618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f424415ad30 msgr2=0x7f4244142120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f423be00640 1 --2- 172.21.15.55:0/998416618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f424415ad30 0x7f4244142120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f423be00640 1 -- 172.21.15.55:0/998416618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c009a70 con 0x7f4244143f90 2024-04-02T07:28:34.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f4243400640 1 --2- 172.21.15.55:0/998416618 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42440cd8b0 0x7f4244158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:34.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f4243e00640 1 --2- 172.21.15.55:0/998416618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f424415ad30 0x7f4244142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:34.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f423be00640 1 --2- 172.21.15.55:0/998416618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4244143f90 0x7f4244141be0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f422c00e870 tx=0x7f422c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:34.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f423b400640 1 -- 172.21.15.55:0/998416618 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c009510 con 0x7f4244143f90 2024-04-02T07:28:34.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f423b400640 1 -- 172.21.15.55:0/998416618 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c00eec0 con 0x7f4244143f90 2024-04-02T07:28:34.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f423b400640 1 -- 172.21.15.55:0/998416618 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c00cb40 con 0x7f4244143f90 2024-04-02T07:28:34.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f424a600640 1 -- 172.21.15.55:0/998416618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42441413e0 con 0x7f4244143f90 2024-04-02T07:28:34.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.787+0000 7f424a600640 1 -- 172.21.15.55:0/998416618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f424413a350 con 0x7f4244143f90 2024-04-02T07:28:34.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.791+0000 7f424a600640 1 -- 172.21.15.55:0/998416618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42441418c0 con 0x7f4244143f90 2024-04-02T07:28:34.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.791+0000 7f423b400640 1 -- 172.21.15.55:0/998416618 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f422c00cca0 con 0x7f4244143f90 2024-04-02T07:28:34.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.791+0000 7f423b400640 1 --2- 172.21.15.55:0/998416618 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4220066690 0x7f4220068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:34.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.791+0000 7f423b400640 1 -- 172.21.15.55:0/998416618 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f422c084330 con 0x7f4244143f90 2024-04-02T07:28:34.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.791+0000 7f4243400640 1 --2- 172.21.15.55:0/998416618 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4220066690 0x7f4220068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:34.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.791+0000 7f4243400640 1 --2- 172.21.15.55:0/998416618 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4220066690 0x7f4220068b50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4234007fd0 tx=0x7f4234007c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:34.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.795+0000 7f423b400640 1 -- 172.21.15.55:0/998416618 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f422c051600 con 0x7f4244143f90 2024-04-02T07:28:34.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.991+0000 7f424a600640 1 -- 172.21.15.55:0/998416618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f424413a5a0 con 0x7f4244143f90 2024-04-02T07:28:34.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.991+0000 7f423b400640 1 -- 172.21.15.55:0/998416618 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f422c054c20 con 0x7f4244143f90 2024-04-02T07:28:34.994 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:34.994 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-02T07:28:34.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.995+0000 7f424a600640 1 -- 172.21.15.55:0/998416618 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4220066690 msgr2=0x7f4220068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.995+0000 7f424a600640 1 --2- 172.21.15.55:0/998416618 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4220066690 0x7f4220068b50 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f4234007fd0 tx=0x7f4234007c20 comp rx=0 tx=0).stop 2024-04-02T07:28:34.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.995+0000 7f424a600640 1 -- 172.21.15.55:0/998416618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4244143f90 msgr2=0x7f4244141be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:34.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.995+0000 7f424a600640 1 --2- 172.21.15.55:0/998416618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4244143f90 0x7f4244141be0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f422c00e870 tx=0x7f422c00ec70 comp rx=0 tx=0).stop 2024-04-02T07:28:34.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.995+0000 7f424a600640 1 -- 172.21.15.55:0/998416618 shutdown_connections 2024-04-02T07:28:34.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.995+0000 7f424a600640 1 --2- 172.21.15.55:0/998416618 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4220066690 0x7f4220068b50 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.995+0000 7f424a600640 1 --2- 172.21.15.55:0/998416618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f424415ad30 0x7f4244142120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.995+0000 7f424a600640 1 --2- 172.21.15.55:0/998416618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4244143f90 0x7f4244141be0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.995+0000 7f424a600640 1 --2- 172.21.15.55:0/998416618 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42440cd8b0 0x7f4244158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:34.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.995+0000 7f424a600640 1 -- 172.21.15.55:0/998416618 >> 172.21.15.55:0/998416618 conn(0x7f4244066080 msgr2=0x7f42440b1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:34.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.995+0000 7f424a600640 1 -- 172.21.15.55:0/998416618 shutdown_connections 2024-04-02T07:28:34.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:34.995+0000 7f424a600640 1 -- 172.21.15.55:0/998416618 wait complete. 2024-04-02T07:28:35.015 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-02T07:28:35.015 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-02T07:28:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.155+0000 7f3645e00640 1 Processor -- start 2024-04-02T07:28:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.155+0000 7f3645e00640 1 -- start start 2024-04-02T07:28:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.155+0000 7f3645e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3640157350 0x7f36400cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.155+0000 7f3645e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f36400d02a0 0x7f36400b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.155+0000 7f3645e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f364015d950 con 0x7f3640156f70 2024-04-02T07:28:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.155+0000 7f3645e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f364015dc30 con 0x7f3640157350 2024-04-02T07:28:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.155+0000 7f3645e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364015df10 con 0x7f36400d02a0 2024-04-02T07:28:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.155+0000 7f363ea00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3640156f70 0x7f364015d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:59934/0 (socket says 172.21.15.55:59934) 2024-04-02T07:28:35.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.155+0000 7f363ea00640 1 -- 172.21.15.55:0/2122032362 learned_addr learned my addr 172.21.15.55:0/2122032362 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:35.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.155+0000 7f363e000640 1 --2- 172.21.15.55:0/2122032362 >> v2:172.21.15.106:3300/0 conn(0x7f3640157350 0x7f36400cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:35.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.155+0000 7f363f400640 1 --2- 172.21.15.55:0/2122032362 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f36400d02a0 0x7f36400b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:35.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.155+0000 7f363d600640 1 -- 172.21.15.55:0/2122032362 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 738878270 0 0) 0x7f364015d950 con 0x7f3640156f70 2024-04-02T07:28:35.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.155+0000 7f363d600640 1 -- 172.21.15.55:0/2122032362 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3624003530 con 0x7f3640156f70 2024-04-02T07:28:35.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.155+0000 7f363f400640 1 -- 172.21.15.55:0/2122032362 >> v2:172.21.15.106:3300/0 conn(0x7f3640157350 msgr2=0x7f36400cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:35.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.155+0000 7f363f400640 1 --2- 172.21.15.55:0/2122032362 >> v2:172.21.15.106:3300/0 conn(0x7f3640157350 0x7f36400cfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.155+0000 7f363f400640 1 -- 172.21.15.55:0/2122032362 >> v1:172.21.15.55:6789/0 conn(0x7f3640156f70 legacy=0x7f364015d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.155+0000 7f363f400640 1 -- 172.21.15.55:0/2122032362 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36400cf560 con 0x7f36400d02a0 2024-04-02T07:28:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.155+0000 7f363e000640 1 --2- 172.21.15.55:0/2122032362 >> v2:172.21.15.106:3300/0 conn(0x7f3640157350 0x7f36400cfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:28:35.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.159+0000 7f363f400640 1 --2- 172.21.15.55:0/2122032362 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f36400d02a0 0x7f36400b31c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f36380097c0 tx=0x7f363801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41b879bee5a0f693 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:35.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.159+0000 7f363d600640 1 -- 172.21.15.55:0/2122032362 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36380aa5f0 con 0x7f36400d02a0 2024-04-02T07:28:35.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.159+0000 7f363d600640 1 -- 172.21.15.55:0/2122032362 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36380aa750 con 0x7f36400d02a0 2024-04-02T07:28:35.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.159+0000 7f363d600640 1 -- 172.21.15.55:0/2122032362 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36380aaae0 con 0x7f36400d02a0 2024-04-02T07:28:35.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.159+0000 7f3645e00640 1 -- 172.21.15.55:0/2122032362 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f36400d02a0 msgr2=0x7f36400b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:35.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.159+0000 7f3645e00640 1 --2- 172.21.15.55:0/2122032362 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f36400d02a0 0x7f36400b31c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f36380097c0 tx=0x7f363801c470 comp rx=0 tx=0).stop 2024-04-02T07:28:35.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.159+0000 7f3645e00640 1 -- 172.21.15.55:0/2122032362 shutdown_connections 2024-04-02T07:28:35.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.159+0000 7f3645e00640 1 --2- 172.21.15.55:0/2122032362 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f36400d02a0 0x7f36400b31c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:35.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.159+0000 7f3645e00640 1 --2- 172.21.15.55:0/2122032362 >> v2:172.21.15.106:3300/0 conn(0x7f3640157350 0x7f36400cfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:35.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.159+0000 7f3645e00640 1 -- 172.21.15.55:0/2122032362 >> 172.21.15.55:0/2122032362 conn(0x7f36400b13b0 msgr2=0x7f36400b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:35.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.159+0000 7f3645e00640 1 -- 172.21.15.55:0/2122032362 shutdown_connections 2024-04-02T07:28:35.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.159+0000 7f3645e00640 1 -- 172.21.15.55:0/2122032362 wait complete. 2024-04-02T07:28:35.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f3645e00640 1 Processor -- start 2024-04-02T07:28:35.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f3645e00640 1 -- start start 2024-04-02T07:28:35.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f3645e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36400d02a0 0x7f364014bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f3645e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3640156f70 0x7f3640154a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f3645e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3640157350 0x7f3640146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f3645e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36400c96e0 con 0x7f36400d02a0 2024-04-02T07:28:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f3645e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36400c8ad0 con 0x7f3640156f70 2024-04-02T07:28:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f3645e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36400c8db0 con 0x7f3640157350 2024-04-02T07:28:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f363ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36400d02a0 0x7f364014bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f363ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36400d02a0 0x7f364014bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47900/0 (socket says 172.21.15.55:47900) 2024-04-02T07:28:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f363ea00640 1 -- 172.21.15.55:0/11503637 learned_addr learned my addr 172.21.15.55:0/11503637 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f363e000640 1 --2- 172.21.15.55:0/11503637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3640156f70 0x7f3640154a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f363f400640 1 --2- 172.21.15.55:0/11503637 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3640157350 0x7f3640146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f363ea00640 1 -- 172.21.15.55:0/11503637 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3640157350 msgr2=0x7f3640146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f363ea00640 1 --2- 172.21.15.55:0/11503637 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3640157350 0x7f3640146500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f363ea00640 1 -- 172.21.15.55:0/11503637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3640156f70 msgr2=0x7f3640154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f363ea00640 1 --2- 172.21.15.55:0/11503637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3640156f70 0x7f3640154a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f363ea00640 1 -- 172.21.15.55:0/11503637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c009420 con 0x7f36400d02a0 2024-04-02T07:28:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f363ea00640 1 --2- 172.21.15.55:0/11503637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36400d02a0 0x7f364014bf90 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f363000cbc0 tx=0x7f363000a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f3637400640 1 -- 172.21.15.55:0/11503637 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363000ad40 con 0x7f36400d02a0 2024-04-02T07:28:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f3637400640 1 -- 172.21.15.55:0/11503637 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3630012400 con 0x7f36400d02a0 2024-04-02T07:28:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f3645e00640 1 -- 172.21.15.55:0/11503637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3638009420 con 0x7f36400d02a0 2024-04-02T07:28:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f3637400640 1 -- 172.21.15.55:0/11503637 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363000aea0 con 0x7f36400d02a0 2024-04-02T07:28:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.163+0000 7f3645e00640 1 -- 172.21.15.55:0/11503637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36400c9370 con 0x7f36400d02a0 2024-04-02T07:28:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.167+0000 7f3645e00640 1 -- 172.21.15.55:0/11503637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3640066c90 con 0x7f36400d02a0 2024-04-02T07:28:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.167+0000 7f3637400640 1 -- 172.21.15.55:0/11503637 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3630007070 con 0x7f36400d02a0 2024-04-02T07:28:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.167+0000 7f3637400640 1 --2- 172.21.15.55:0/11503637 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f36200666c0 0x7f3620068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.167+0000 7f3637400640 1 -- 172.21.15.55:0/11503637 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f3630084260 con 0x7f36400d02a0 2024-04-02T07:28:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.167+0000 7f363e000640 1 --2- 172.21.15.55:0/11503637 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f36200666c0 0x7f3620068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.167+0000 7f363e000640 1 --2- 172.21.15.55:0/11503637 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f36200666c0 0x7f3620068b80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f36400af780 tx=0x7f362c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:35.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.171+0000 7f3637400640 1 -- 172.21.15.55:0/11503637 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f36300514c0 con 0x7f36400d02a0 2024-04-02T07:28:35.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.367+0000 7f3645e00640 1 -- 172.21.15.55:0/11503637 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3640071870 con 0x7f36400d02a0 2024-04-02T07:28:35.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.367+0000 7f3637400640 1 -- 172.21.15.55:0/11503637 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v52) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3630017070 con 0x7f36400d02a0 2024-04-02T07:28:35.368 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-02T07:28:35.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.367+0000 7f3645e00640 1 -- 172.21.15.55:0/11503637 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f36200666c0 msgr2=0x7f3620068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:35.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.367+0000 7f3645e00640 1 --2- 172.21.15.55:0/11503637 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f36200666c0 0x7f3620068b80 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f36400af780 tx=0x7f362c008040 comp rx=0 tx=0).stop 2024-04-02T07:28:35.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.367+0000 7f3645e00640 1 -- 172.21.15.55:0/11503637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36400d02a0 msgr2=0x7f364014bf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:35.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.367+0000 7f3645e00640 1 --2- 172.21.15.55:0/11503637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36400d02a0 0x7f364014bf90 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f363000cbc0 tx=0x7f363000a430 comp rx=0 tx=0).stop 2024-04-02T07:28:35.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.367+0000 7f3645e00640 1 -- 172.21.15.55:0/11503637 shutdown_connections 2024-04-02T07:28:35.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.367+0000 7f3645e00640 1 --2- 172.21.15.55:0/11503637 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3640157350 0x7f3640146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:35.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.367+0000 7f3645e00640 1 --2- 172.21.15.55:0/11503637 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f36200666c0 0x7f3620068b80 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:35.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.367+0000 7f3645e00640 1 --2- 172.21.15.55:0/11503637 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3640156f70 0x7f3640154a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:35.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.367+0000 7f3645e00640 1 --2- 172.21.15.55:0/11503637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36400d02a0 0x7f364014bf90 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:35.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.367+0000 7f3645e00640 1 -- 172.21.15.55:0/11503637 >> 172.21.15.55:0/11503637 conn(0x7f36400b13b0 msgr2=0x7f36400b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:35.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.367+0000 7f3645e00640 1 -- 172.21.15.55:0/11503637 shutdown_connections 2024-04-02T07:28:35.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:35.367+0000 7f3645e00640 1 -- 172.21.15.55:0/11503637 wait complete. 2024-04-02T07:28:35.388 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-02T07:28:35.388 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-02T07:28:35.388 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-02T07:28:35.388 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-02T07:28:35.388 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-02T07:28:35.389 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-02T07:28:35.389 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-02T07:28:35.389 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-02T07:28:35.389 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:28:35.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:35.389 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-02T07:28:35.398 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:28:35.398 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:28:35.398 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:28:35.398 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:28:35.398 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-02T07:28:35.398 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:28:35.398 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:28:35.398 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:28:35.398 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-02T07:28:35.399 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:28:35.399 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:28:35.399 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-02T07:28:35.399 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-02T07:28:35.399 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:28:35.399 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-02T07:28:35.399 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-02T07:28:35.399 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42079sec preferred_lft 42079sec 2024-04-02T07:28:35.399 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2024-04-02T07:28:35.399 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:28:35.399 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:28:35.399 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:28:35.399 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-02T07:28:35.399 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-02T07:28:35.400 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:81:5a:89:17 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:28:35.400 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-02T07:28:35.400 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:28:35.400 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:28:35.400 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-02T07:28:35.400 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-02T07:28:35.400 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:28:35.400 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-02T07:28:35.400 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:28:35.400 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:28:35.400 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-02T07:28:35.400 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-02T07:28:35.400 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:28:35.400 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:28:35.401 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-02T07:28:35.401 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-02T07:28:35.401 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:28:35.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:35.402 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-02T07:28:35.460 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:28:35.462 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:35.462 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-02T07:28:35.516 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-02T07:28:35.516 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-02T07:28:35.516 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-02T07:28:35.516 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-02T07:28:35.516 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-02T07:28:35.516 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-02T07:28:35.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:35.517 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:28:35.517 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:28:35.517 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-02T07:28:35.517 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-02T07:28:35.517 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-02T07:28:35.517 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:28:35.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:35.608 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-02T07:28:35.617 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-02T07:28:35.617 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-02T07:28:35.617 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:28:35.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:35.617 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-02T07:28:35.678 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-02T07:28:35.678 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:28:35.678 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-02T07:28:35.730 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:28:35.731 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:28:35.731 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:28:35.781 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:28:35.843 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:28:35.843 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:28:35.904 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:28:35.906 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:28:35.907 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:35.907 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:28:35.959 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-02T07:28:35.959 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-02T07:28:36.005 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:28:36.025 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:28:36.025 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:28:36.084 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:28:36.086 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:28:36.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:36.087 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:28:36.100 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:2024-04-02T07:28:36.099+0000 7f036f847580 -1 init, newargv = 0x56165da2ff20 newargc=15 2024-04-02T07:28:36.100 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[44605]: starting ceph client 2024-04-02T07:28:36.107 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[44605]: starting fuse 2024-04-02T07:28:36.110 INFO:teuthology.orchestra.run.smithi055.stdout:43 2024-04-02T07:28:36.110 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-02T07:28:36.111 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:28:36.111 DEBUG:teuthology.orchestra.run.smithi055:> import glob 2024-04-02T07:28:36.111 DEBUG:teuthology.orchestra.run.smithi055:> import re 2024-04-02T07:28:36.111 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:28:36.111 DEBUG:teuthology.orchestra.run.smithi055:> import subprocess 2024-04-02T07:28:36.111 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:28:36.111 DEBUG:teuthology.orchestra.run.smithi055:> def _find_admin_socket(client_name): 2024-04-02T07:28:36.112 DEBUG:teuthology.orchestra.run.smithi055:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-02T07:28:36.112 DEBUG:teuthology.orchestra.run.smithi055:> files = glob.glob(asok_path) 2024-04-02T07:28:36.112 DEBUG:teuthology.orchestra.run.smithi055:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-02T07:28:36.112 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:28:36.112 DEBUG:teuthology.orchestra.run.smithi055:> # Given a non-glob path, it better be there 2024-04-02T07:28:36.112 DEBUG:teuthology.orchestra.run.smithi055:> if "*" not in asok_path: 2024-04-02T07:28:36.112 DEBUG:teuthology.orchestra.run.smithi055:> assert(len(files) == 1) 2024-04-02T07:28:36.113 DEBUG:teuthology.orchestra.run.smithi055:> return files[0] 2024-04-02T07:28:36.113 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:28:36.113 DEBUG:teuthology.orchestra.run.smithi055:> for f in files: 2024-04-02T07:28:36.113 DEBUG:teuthology.orchestra.run.smithi055:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-02T07:28:36.113 DEBUG:teuthology.orchestra.run.smithi055:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-02T07:28:36.113 DEBUG:teuthology.orchestra.run.smithi055:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-02T07:28:36.113 DEBUG:teuthology.orchestra.run.smithi055:> contents = proc_f.read() 2024-04-02T07:28:36.114 DEBUG:teuthology.orchestra.run.smithi055:> if mountpoint in contents: 2024-04-02T07:28:36.114 DEBUG:teuthology.orchestra.run.smithi055:> return f 2024-04-02T07:28:36.114 DEBUG:teuthology.orchestra.run.smithi055:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-02T07:28:36.114 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:28:36.114 DEBUG:teuthology.orchestra.run.smithi055:> print(_find_admin_socket("client.0")) 2024-04-02T07:28:36.114 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:28:36.235 INFO:teuthology.orchestra.run.smithi055.stdout:/var/run/ceph/ceph-client.0.44605.asok 2024-04-02T07:28:36.419 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.44605.asok 2024-04-02T07:28:36.419 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:36.419 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.44605.asok status 2024-04-02T07:28:36.599 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:28:36.599 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": { 2024-04-02T07:28:36.599 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_sha1": "d0e392d9aee635f2b65768c460c7a151ead7a5e2", 2024-04-02T07:28:36.599 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)", 2024-04-02T07:28:36.599 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "0", 2024-04-02T07:28:36.599 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2024-04-02T07:28:36.599 INFO:teuthology.orchestra.run.smithi055.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-02T07:28:36.599 INFO:teuthology.orchestra.run.smithi055.stdout: "pid": "44605", 2024-04-02T07:28:36.599 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2024-04-02T07:28:36.599 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:36.600 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_count": 0, 2024-04-02T07:28:36.600 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_pinned_count": 0, 2024-04-02T07:28:36.600 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 7254, 2024-04-02T07:28:36.600 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": { 2024-04-02T07:28:36.600 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2024-04-02T07:28:36.600 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2024-04-02T07:28:36.600 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 7254 2024-04-02T07:28:36.600 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:36.600 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:28:36.600 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:28:36.600 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:28:36.600 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 868232850 2024-04-02T07:28:36.600 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:36.600 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:36.600 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:28:36.601 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:28:36.601 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:28:36.601 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 868232850 2024-04-02T07:28:36.601 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:36.601 INFO:teuthology.orchestra.run.smithi055.stdout: "inst_str": "client.7254 192.168.0.1:0/868232850", 2024-04-02T07:28:36.601 INFO:teuthology.orchestra.run.smithi055.stdout: "addr_str": "192.168.0.1:0/868232850", 2024-04-02T07:28:36.601 INFO:teuthology.orchestra.run.smithi055.stdout: "inode_count": 1, 2024-04-02T07:28:36.601 INFO:teuthology.orchestra.run.smithi055.stdout: "mds_epoch": 52, 2024-04-02T07:28:36.601 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch": 75, 2024-04-02T07:28:36.601 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch_barrier": 0, 2024-04-02T07:28:36.601 INFO:teuthology.orchestra.run.smithi055.stdout: "blocklisted": false, 2024-04-02T07:28:36.601 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs" 2024-04-02T07:28:36.601 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:28:36.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:36.614 DEBUG:teuthology.orchestra.run.smithi055:> stat --file-system '--printf=%T 2024-04-02T07:28:36.614 DEBUG:teuthology.orchestra.run.smithi055:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-02T07:28:36.623 INFO:teuthology.orchestra.run.smithi055.stdout:fuseblk 2024-04-02T07:28:36.624 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-02T07:28:36.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:36.624 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:28:36.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:36.686 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.files ./subdir) 2024-04-02T07:28:36.741 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:28:36.742 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata setomapval 10000000000.00000000 file_to_be_damaged_head deadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeefdeadbeef 2024-04-02T07:28:36.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.827+0000 7fac23a94080 1 Processor -- start 2024-04-02T07:28:36.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.827+0000 7fac23a94080 1 -- start start 2024-04-02T07:28:36.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.827+0000 7fac23a94080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5624fd4dd130 0x5624fd463f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:36.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.827+0000 7fac23a94080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5624fd4dd510 0x5624fd4dc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:36.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.827+0000 7fac23a94080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624fd4f56e0 0x5624fd44bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:36.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.827+0000 7fac23a94080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624fd3ca1e0 con 0x5624fd4dd130 2024-04-02T07:28:36.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.827+0000 7fac23a94080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624fd365960 con 0x5624fd4f56e0 2024-04-02T07:28:36.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.827+0000 7fac23a94080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624fd365600 con 0x5624fd4dd510 2024-04-02T07:28:36.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.827+0000 7fac20c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5624fd4dd130 0x5624fd463f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:36.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.827+0000 7fac20c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5624fd4dd130 0x5624fd463f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59294/0 (socket says 172.21.15.55:59294) 2024-04-02T07:28:36.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.827+0000 7fac20c00640 1 -- 172.21.15.55:0/2717250503 learned_addr learned my addr 172.21.15.55:0/2717250503 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:36.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.827+0000 7fac1be00640 1 --2- 172.21.15.55:0/2717250503 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5624fd4dd510 0x5624fd4dc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:36.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.827+0000 7fac21600640 1 --2- 172.21.15.55:0/2717250503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624fd4f56e0 0x5624fd44bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:36.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.827+0000 7fac20c00640 1 -- 172.21.15.55:0/2717250503 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5624fd4dd510 msgr2=0x5624fd4dc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:36.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.827+0000 7fac20c00640 1 --2- 172.21.15.55:0/2717250503 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5624fd4dd510 0x5624fd4dc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:36.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.827+0000 7fac20c00640 1 -- 172.21.15.55:0/2717250503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624fd4f56e0 msgr2=0x5624fd44bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:36.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.827+0000 7fac20c00640 1 --2- 172.21.15.55:0/2717250503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624fd4f56e0 0x5624fd44bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:36.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.827+0000 7fac20c00640 1 -- 172.21.15.55:0/2717250503 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac0c005d30 con 0x5624fd4dd130 2024-04-02T07:28:36.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac20c00640 1 --2- 172.21.15.55:0/2717250503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5624fd4dd130 0x5624fd463f00 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fac1400b330 tx=0x7fac1400b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18bf1babf2675ec1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:36.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac1aa00640 1 -- 172.21.15.55:0/2717250503 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14014070 con 0x5624fd4dd130 2024-04-02T07:28:36.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac1aa00640 1 -- 172.21.15.55:0/2717250503 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1400d510 con 0x5624fd4dd130 2024-04-02T07:28:36.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac1aa00640 1 -- 172.21.15.55:0/2717250503 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1400d8c0 con 0x5624fd4dd130 2024-04-02T07:28:36.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac23a94080 1 -- 172.21.15.55:0/2717250503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5624fd4dd130 msgr2=0x5624fd463f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:36.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac23a94080 1 --2- 172.21.15.55:0/2717250503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5624fd4dd130 0x5624fd463f00 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7fac1400b330 tx=0x7fac1400b7f0 comp rx=0 tx=0).stop 2024-04-02T07:28:36.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac23a94080 1 -- 172.21.15.55:0/2717250503 shutdown_connections 2024-04-02T07:28:36.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac23a94080 1 --2- 172.21.15.55:0/2717250503 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624fd4f56e0 0x5624fd44bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:36.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac23a94080 1 --2- 172.21.15.55:0/2717250503 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5624fd4dd510 0x5624fd4dc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:36.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac23a94080 1 --2- 172.21.15.55:0/2717250503 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5624fd4dd130 0x5624fd463f00 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:36.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac23a94080 1 -- 172.21.15.55:0/2717250503 >> 172.21.15.55:0/2717250503 conn(0x5624fd44bbf0 msgr2=0x5624fd41cb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:36.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac23a94080 1 -- 172.21.15.55:0/2717250503 shutdown_connections 2024-04-02T07:28:36.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac23a94080 1 -- 172.21.15.55:0/2717250503 wait complete. 2024-04-02T07:28:36.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac23a94080 1 Processor -- start 2024-04-02T07:28:36.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac23a94080 1 -- start start 2024-04-02T07:28:36.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac23a94080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5624fd4dd130 0x5624fd4daf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:36.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac23a94080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5624fd4dd510 0x5624fd4d72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:36.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac23a94080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624fd4f56e0 0x5624fd4f7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:36.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac23a94080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624fd35c690 con 0x5624fd4dd510 2024-04-02T07:28:36.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac23a94080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5624fd4dbdb0 con 0x5624fd4f56e0 2024-04-02T07:28:36.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac23a94080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5624fd4646f0 con 0x5624fd4dd130 2024-04-02T07:28:36.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac1be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5624fd4dd510 0x5624fd4d72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:36.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac20c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5624fd4dd130 0x5624fd4daf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:36.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac1be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5624fd4dd510 0x5624fd4d72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59308/0 (socket says 172.21.15.55:59308) 2024-04-02T07:28:36.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac1be00640 1 -- 172.21.15.55:0/1057147278 learned_addr learned my addr 172.21.15.55:0/1057147278 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:36.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac21600640 1 --2- 172.21.15.55:0/1057147278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624fd4f56e0 0x5624fd4f7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:36.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac1be00640 1 -- 172.21.15.55:0/1057147278 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5624fd4dd130 msgr2=0x5624fd4daf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:36.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac1be00640 1 --2- 172.21.15.55:0/1057147278 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5624fd4dd130 0x5624fd4daf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:36.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac1be00640 1 -- 172.21.15.55:0/1057147278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624fd4f56e0 msgr2=0x5624fd4f7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:36.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac1be00640 1 --2- 172.21.15.55:0/1057147278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624fd4f56e0 0x5624fd4f7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:36.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac1be00640 1 -- 172.21.15.55:0/1057147278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac14001bb0 con 0x5624fd4dd510 2024-04-02T07:28:36.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac21600640 1 --2- 172.21.15.55:0/1057147278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5624fd4f56e0 0x5624fd4f7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:36.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.831+0000 7fac1be00640 1 --2- 172.21.15.55:0/1057147278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5624fd4dd510 0x5624fd4d72f0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fac0c019400 tx=0x7fac0c018570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:36.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.835+0000 7fac19600640 1 -- 172.21.15.55:0/1057147278 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c0ac910 con 0x5624fd4dd510 2024-04-02T07:28:36.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.835+0000 7fac19600640 1 -- 172.21.15.55:0/1057147278 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c0aca70 con 0x5624fd4dd510 2024-04-02T07:28:36.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.835+0000 7fac19600640 1 -- 172.21.15.55:0/1057147278 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c0acde0 con 0x5624fd4dd510 2024-04-02T07:28:36.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.835+0000 7fac23a94080 1 -- 172.21.15.55:0/1057147278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5624fd367d00 con 0x5624fd4dd510 2024-04-02T07:28:36.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.835+0000 7fac23a94080 1 -- 172.21.15.55:0/1057147278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5624fd367760 con 0x5624fd4dd510 2024-04-02T07:28:36.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.835+0000 7fac19600640 1 -- 172.21.15.55:0/1057147278 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fac0c0b3030 con 0x5624fd4dd510 2024-04-02T07:28:36.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.835+0000 7fac19600640 1 --2- 172.21.15.55:0/1057147278 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fac000650a0 0x7fac00067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:36.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.835+0000 7fac19600640 1 -- 172.21.15.55:0/1057147278 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fac0c11e440 con 0x5624fd4dd510 2024-04-02T07:28:36.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.835+0000 7fac23a94080 1 --2- 172.21.15.55:0/1057147278 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x5624fd4d7830 0x5624fd58d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:36.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.835+0000 7fac23a94080 1 -- 172.21.15.55:0/1057147278 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:1 10.10 10:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=115b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e75) v8 -- 0x5624fd4f79d0 con 0x5624fd4d7830 2024-04-02T07:28:36.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.835+0000 7fac20c00640 1 --2- 172.21.15.55:0/1057147278 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fac000650a0 0x7fac00067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:36.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.835+0000 7fac21600640 1 --2- 172.21.15.55:0/1057147278 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x5624fd4d7830 0x5624fd58d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:36.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.839+0000 7fac20c00640 1 --2- 172.21.15.55:0/1057147278 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fac000650a0 0x7fac00067560 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fac14000fc0 tx=0x7fac14009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:36.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.839+0000 7fac21600640 1 --2- 172.21.15.55:0/1057147278 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x5624fd4d7830 0x5624fd58d230 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:36.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.839+0000 7fac21600640 1 -- 172.21.15.55:0/1057147278 <== osd.4 v2:172.21.15.106:6801/27677 1 ==== osd_op_reply(1 10000000000.00000000 [omap-set-vals] v75'12 uv12 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7fac1c0016b0 con 0x5624fd4d7830 2024-04-02T07:28:36.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.839+0000 7fac23a94080 1 -- 172.21.15.55:0/1057147278 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x5624fd4d7830 msgr2=0x5624fd58d230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:36.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.839+0000 7fac23a94080 1 --2- 172.21.15.55:0/1057147278 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x5624fd4d7830 0x5624fd58d230 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:36.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.839+0000 7fac23a94080 1 -- 172.21.15.55:0/1057147278 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fac000650a0 msgr2=0x7fac00067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:36.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.839+0000 7fac23a94080 1 --2- 172.21.15.55:0/1057147278 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fac000650a0 0x7fac00067560 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fac14000fc0 tx=0x7fac14009000 comp rx=0 tx=0).stop 2024-04-02T07:28:36.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.839+0000 7fac23a94080 1 -- 172.21.15.55:0/1057147278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5624fd4dd510 msgr2=0x5624fd4d72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:36.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.839+0000 7fac23a94080 1 --2- 172.21.15.55:0/1057147278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5624fd4dd510 0x5624fd4d72f0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7fac0c019400 tx=0x7fac0c018570 comp rx=0 tx=0).stop 2024-04-02T07:28:36.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.839+0000 7fac21600640 1 -- 172.21.15.55:0/1057147278 reap_dead start 2024-04-02T07:28:36.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.839+0000 7fac23a94080 1 -- 172.21.15.55:0/1057147278 shutdown_connections 2024-04-02T07:28:36.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.839+0000 7fac23a94080 1 -- 172.21.15.55:0/1057147278 >> 172.21.15.55:0/1057147278 conn(0x5624fd44bbf0 msgr2=0x5624fd463310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:36.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.839+0000 7fac23a94080 1 -- 172.21.15.55:0/1057147278 shutdown_connections 2024-04-02T07:28:36.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:36.839+0000 7fac23a94080 1 -- 172.21.15.55:0/1057147278 wait complete. 2024-04-02T07:28:36.845 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-02T07:28:36.845 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:28:36.921 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:28:37.005 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-02T07:28:37.005 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:28:37.005 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:28:37.015 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:28:37.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.195+0000 7f3842200640 1 Processor -- start 2024-04-02T07:28:37.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.195+0000 7f3842200640 1 -- start start 2024-04-02T07:28:37.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f3842200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f383c159480 0x7f383c15d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:37.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f3842200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383c15dec0 con 0x7f383c0cc030 2024-04-02T07:28:37.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f3842200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f383c0b35e0 con 0x7f383c0b0700 2024-04-02T07:28:37.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f3842200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f383c159860 con 0x7f383c159480 2024-04-02T07:28:37.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383be00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f383c0cc030 0x7f383c0afff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37112/0 (socket says 172.21.15.55:37112) 2024-04-02T07:28:37.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383be00640 1 -- 172.21.15.55:0/3392008473 learned_addr learned my addr 172.21.15.55:0/3392008473 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:37.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f3840e00640 1 --2- 172.21.15.55:0/3392008473 >> v2:172.21.15.106:3300/0 conn(0x7f383c159480 0x7f383c15d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:37.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383b400640 1 -- 172.21.15.55:0/3392008473 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882826284 0 0) 0x7f3828001120 con 0x7f383c0cc030 2024-04-02T07:28:37.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383b400640 1 -- 172.21.15.55:0/3392008473 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3824003530 con 0x7f383c0cc030 2024-04-02T07:28:37.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383b400640 1 -- 172.21.15.55:0/3392008473 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 348072611 0 0) 0x7f3824003530 con 0x7f383c0cc030 2024-04-02T07:28:37.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383b400640 1 -- 172.21.15.55:0/3392008473 >> v2:172.21.15.106:3300/0 conn(0x7f383c159480 msgr2=0x7f383c15d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:37.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383b400640 1 --2- 172.21.15.55:0/3392008473 >> v2:172.21.15.106:3300/0 conn(0x7f383c159480 0x7f383c15d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383b400640 1 -- 172.21.15.55:0/3392008473 >> v1:172.21.15.106:6789/0 conn(0x7f383c0b0700 legacy=0x7f383c0b1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:37.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383b400640 1 -- 172.21.15.55:0/3392008473 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c0b29d0 con 0x7f383c0cc030 2024-04-02T07:28:37.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383b400640 1 -- 172.21.15.55:0/3392008473 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f3828001810 con 0x7f383c0cc030 2024-04-02T07:28:37.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383b400640 1 -- 172.21.15.55:0/3392008473 >> v1:172.21.15.55:6789/0 conn(0x7f383c0cc030 legacy=0x7f383c0afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:37.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383b400640 1 --2- 172.21.15.55:0/3392008473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3824003980 0x7f3824003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:37.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383b400640 1 --2- 172.21.15.55:0/3392008473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38240047d0 0x7f3824004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:37.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383b400640 1 --2- 172.21.15.55:0/3392008473 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3824005190 0x7f382400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:37.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383b400640 1 -- 172.21.15.55:0/3392008473 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c159860 con 0x7f38240047d0 2024-04-02T07:28:37.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383b400640 1 -- 172.21.15.55:0/3392008473 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f382400c030 con 0x7f3824003980 2024-04-02T07:28:37.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383b400640 1 -- 172.21.15.55:0/3392008473 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f382400c1f0 con 0x7f3824005190 2024-04-02T07:28:37.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383be00640 1 --2- 172.21.15.55:0/3392008473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38240047d0 0x7f3824004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:37.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f3840e00640 1 --2- 172.21.15.55:0/3392008473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3824003980 0x7f3824003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:37.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f3841800640 1 --2- 172.21.15.55:0/3392008473 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3824005190 0x7f382400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:37.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383be00640 1 -- 172.21.15.55:0/3392008473 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3824005190 msgr2=0x7f382400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:37.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383be00640 1 --2- 172.21.15.55:0/3392008473 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3824005190 0x7f382400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383be00640 1 -- 172.21.15.55:0/3392008473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3824003980 msgr2=0x7f3824003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:37.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383be00640 1 --2- 172.21.15.55:0/3392008473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3824003980 0x7f3824003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f383be00640 1 -- 172.21.15.55:0/3392008473 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3824003530 con 0x7f38240047d0 2024-04-02T07:28:37.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f3840e00640 1 --2- 172.21.15.55:0/3392008473 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3824003980 0x7f3824003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:37.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.199+0000 7f3841800640 1 -- 172.21.15.55:0/3392008473 reap_dead start 2024-04-02T07:28:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.203+0000 7f383be00640 1 --2- 172.21.15.55:0/3392008473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38240047d0 0x7f3824004c50 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f383c06fec0 tx=0x7f382801f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2aabce4c40731c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.203+0000 7f383b400640 1 -- 172.21.15.55:0/3392008473 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3828005ae0 con 0x7f38240047d0 2024-04-02T07:28:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.203+0000 7f383b400640 1 -- 172.21.15.55:0/3392008473 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38280ab070 con 0x7f38240047d0 2024-04-02T07:28:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.203+0000 7f383b400640 1 -- 172.21.15.55:0/3392008473 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3828007070 con 0x7f38240047d0 2024-04-02T07:28:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.203+0000 7f3842200640 1 -- 172.21.15.55:0/3392008473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38240047d0 msgr2=0x7f3824004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.203+0000 7f3842200640 1 --2- 172.21.15.55:0/3392008473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38240047d0 0x7f3824004c50 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f383c06fec0 tx=0x7f382801f370 comp rx=0 tx=0).stop 2024-04-02T07:28:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.203+0000 7f3842200640 1 -- 172.21.15.55:0/3392008473 shutdown_connections 2024-04-02T07:28:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.203+0000 7f3842200640 1 --2- 172.21.15.55:0/3392008473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38240047d0 0x7f3824004c50 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.203+0000 7f3842200640 1 -- 172.21.15.55:0/3392008473 >> 172.21.15.55:0/3392008473 conn(0x7f383c066080 msgr2=0x7f383c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.203+0000 7f3842200640 1 -- 172.21.15.55:0/3392008473 shutdown_connections 2024-04-02T07:28:37.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.203+0000 7f3842200640 1 -- 172.21.15.55:0/3392008473 wait complete. 2024-04-02T07:28:37.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3842200640 1 Processor -- start 2024-04-02T07:28:37.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3842200640 1 -- start start 2024-04-02T07:28:37.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3842200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38240047d0 0x7f383c1507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:37.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3842200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f383c140170 0x7f383c13cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3842200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f383c0ab880 0x7f383c0abd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3842200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c0ac240 con 0x7f383c0ab880 2024-04-02T07:28:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3842200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f383c157280 con 0x7f38240047d0 2024-04-02T07:28:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3842200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f383c15c2f0 con 0x7f383c140170 2024-04-02T07:28:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3841800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f383c0ab880 0x7f383c0abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3841800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f383c0ab880 0x7f383c0abd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59314/0 (socket says 172.21.15.55:59314) 2024-04-02T07:28:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3841800640 1 -- 172.21.15.55:0/3999971125 learned_addr learned my addr 172.21.15.55:0/3999971125 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f383be00640 1 --2- 172.21.15.55:0/3999971125 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f383c140170 0x7f383c13cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3840e00640 1 --2- 172.21.15.55:0/3999971125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38240047d0 0x7f383c1507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3841800640 1 -- 172.21.15.55:0/3999971125 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f383c140170 msgr2=0x7f383c13cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3841800640 1 --2- 172.21.15.55:0/3999971125 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f383c140170 0x7f383c13cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3841800640 1 -- 172.21.15.55:0/3999971125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38240047d0 msgr2=0x7f383c1507f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3841800640 1 --2- 172.21.15.55:0/3999971125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38240047d0 0x7f383c1507f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3841800640 1 -- 172.21.15.55:0/3999971125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f383c15c590 con 0x7f383c0ab880 2024-04-02T07:28:37.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f383be00640 1 --2- 172.21.15.55:0/3999971125 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f383c140170 0x7f383c13cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:28:37.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3840e00640 1 --2- 172.21.15.55:0/3999971125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38240047d0 0x7f383c1507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:28:37.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3841800640 1 --2- 172.21.15.55:0/3999971125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f383c0ab880 0x7f383c0abd00 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f383c06aa30 tx=0x7f383400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:37.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3838c00640 1 -- 172.21.15.55:0/3999971125 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3834003980 con 0x7f383c0ab880 2024-04-02T07:28:37.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3838c00640 1 -- 172.21.15.55:0/3999971125 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3834003ae0 con 0x7f383c0ab880 2024-04-02T07:28:37.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3838c00640 1 -- 172.21.15.55:0/3999971125 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38340050d0 con 0x7f383c0ab880 2024-04-02T07:28:37.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3842200640 1 -- 172.21.15.55:0/3999971125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f383c15c870 con 0x7f383c0ab880 2024-04-02T07:28:37.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3842200640 1 -- 172.21.15.55:0/3999971125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f383c1405f0 con 0x7f383c0ab880 2024-04-02T07:28:37.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.207+0000 7f3842200640 1 -- 172.21.15.55:0/3999971125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f383c156d70 con 0x7f383c0ab880 2024-04-02T07:28:37.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.211+0000 7f3838c00640 1 -- 172.21.15.55:0/3999971125 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3834005230 con 0x7f383c0ab880 2024-04-02T07:28:37.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.211+0000 7f3838c00640 1 --2- 172.21.15.55:0/3999971125 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f381c0666c0 0x7f381c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:37.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.211+0000 7f3838c00640 1 -- 172.21.15.55:0/3999971125 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f3834083f60 con 0x7f383c0ab880 2024-04-02T07:28:37.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.211+0000 7f3840e00640 1 --2- 172.21.15.55:0/3999971125 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f381c0666c0 0x7f381c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:37.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.211+0000 7f3840e00640 1 --2- 172.21.15.55:0/3999971125 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f381c0666c0 0x7f381c068b80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f383c1546e0 tx=0x7f3830008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:37.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.215+0000 7f3838c00640 1 -- 172.21.15.55:0/3999971125 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f383c156d70 con 0x7f383c0ab880 2024-04-02T07:28:37.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.375+0000 7f3842200640 1 -- 172.21.15.55:0/3999971125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f383c156d70 con 0x7f383c0ab880 2024-04-02T07:28:37.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.379+0000 7f3838c00640 1 -- 172.21.15.55:0/3999971125 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16327 (secure 0 0 0) 0x7f383c156d70 con 0x7f383c0ab880 2024-04-02T07:28:37.380 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:37.380 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":75,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:27:14.356458+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:26:53.196912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-02T07:26:54.514963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.2e","mappings":[{"from":6,"to":0}]},{"pgid":"11.3c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6833/1576619269":"2024-04-03T07:27:14.356430+0000","172.21.15.55:6832/1576619269":"2024-04-03T07:27:14.356430+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:28:37.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.379+0000 7f3842200640 1 -- 172.21.15.55:0/3999971125 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f381c0666c0 msgr2=0x7f381c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:37.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.379+0000 7f3842200640 1 --2- 172.21.15.55:0/3999971125 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f381c0666c0 0x7f381c068b80 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f383c1546e0 tx=0x7f3830008040 comp rx=0 tx=0).stop 2024-04-02T07:28:37.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.379+0000 7f3842200640 1 -- 172.21.15.55:0/3999971125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f383c0ab880 msgr2=0x7f383c0abd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:37.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.379+0000 7f3842200640 1 --2- 172.21.15.55:0/3999971125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f383c0ab880 0x7f383c0abd00 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f383c06aa30 tx=0x7f383400ec10 comp rx=0 tx=0).stop 2024-04-02T07:28:37.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.379+0000 7f3842200640 1 -- 172.21.15.55:0/3999971125 shutdown_connections 2024-04-02T07:28:37.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.379+0000 7f3842200640 1 --2- 172.21.15.55:0/3999971125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f383c0ab880 0x7f383c0abd00 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.379+0000 7f3842200640 1 --2- 172.21.15.55:0/3999971125 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f383c140170 0x7f383c13cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.379+0000 7f3842200640 1 --2- 172.21.15.55:0/3999971125 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f381c0666c0 0x7f381c068b80 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.379+0000 7f3842200640 1 --2- 172.21.15.55:0/3999971125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f38240047d0 0x7f383c1507f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.379+0000 7f3842200640 1 -- 172.21.15.55:0/3999971125 >> 172.21.15.55:0/3999971125 conn(0x7f383c066080 msgr2=0x7f383c0ce450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:37.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.379+0000 7f3842200640 1 -- 172.21.15.55:0/3999971125 shutdown_connections 2024-04-02T07:28:37.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.379+0000 7f3842200640 1 -- 172.21.15.55:0/3999971125 wait complete. 2024-04-02T07:28:37.401 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:26:53.196912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:26:54.514963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:28:37.401 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:28:37.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.543+0000 7f3f61c00640 1 Processor -- start 2024-04-02T07:28:37.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.543+0000 7f3f61c00640 1 -- start start 2024-04-02T07:28:37.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.543+0000 7f3f61c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3f5c0ceb50 0x7f3f5c0cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:37.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.543+0000 7f3f61c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5c0cb0e0 con 0x7f3f5c0b0800 2024-04-02T07:28:37.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.543+0000 7f3f61c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5c0cf470 con 0x7f3f5c0cc5b0 2024-04-02T07:28:37.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.543+0000 7f3f61c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f5c0b1560 con 0x7f3f5c0ceb50 2024-04-02T07:28:37.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.543+0000 7f3f5aa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3f5c0ceb50 0x7f3f5c0cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:37.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.543+0000 7f3f52000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3f5c0b0800 0x7f3f5c0b0c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37116/0 (socket says 172.21.15.55:37116) 2024-04-02T07:28:37.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.543+0000 7f3f52000640 1 -- 172.21.15.55:0/2659430725 learned_addr learned my addr 172.21.15.55:0/2659430725 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:37.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.543+0000 7f3f5aa00640 1 -- 172.21.15.55:0/2659430725 >> v1:172.21.15.106:6789/0 conn(0x7f3f5c0cc5b0 legacy=0x7f3f5c164390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:37.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.543+0000 7f3f5aa00640 1 -- 172.21.15.55:0/2659430725 >> v1:172.21.15.55:6789/0 conn(0x7f3f5c0b0800 legacy=0x7f3f5c0b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:37.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.543+0000 7f3f5aa00640 1 -- 172.21.15.55:0/2659430725 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c0b1840 con 0x7f3f5c0ceb50 2024-04-02T07:28:37.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.543+0000 7f3f5a000640 1 -- 172.21.15.55:0/2659430725 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2412805050 0 0) 0x7f3f5c0cb0e0 con 0x7f3f5c0b0800 2024-04-02T07:28:37.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.547+0000 7f3f5aa00640 1 --2- 172.21.15.55:0/2659430725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f5c0ceb50 0x7f3f5c0cef30 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0097c0 tx=0x7f3f4c01c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aece2221830fc2ae server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:37.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.547+0000 7f3f5a000640 1 -- 172.21.15.55:0/2659430725 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c0ab600 con 0x7f3f5c0ceb50 2024-04-02T07:28:37.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.547+0000 7f3f5a000640 1 -- 172.21.15.55:0/2659430725 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c0a7050 con 0x7f3f5c0ceb50 2024-04-02T07:28:37.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.547+0000 7f3f5a000640 1 -- 172.21.15.55:0/2659430725 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c0ab980 con 0x7f3f5c0ceb50 2024-04-02T07:28:37.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.547+0000 7f3f61c00640 1 -- 172.21.15.55:0/2659430725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f5c0ceb50 msgr2=0x7f3f5c0cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:37.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.547+0000 7f3f61c00640 1 --2- 172.21.15.55:0/2659430725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f5c0ceb50 0x7f3f5c0cef30 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0097c0 tx=0x7f3f4c01c3d0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.547+0000 7f3f61c00640 1 -- 172.21.15.55:0/2659430725 shutdown_connections 2024-04-02T07:28:37.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.547+0000 7f3f61c00640 1 --2- 172.21.15.55:0/2659430725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f5c0ceb50 0x7f3f5c0cef30 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.547+0000 7f3f61c00640 1 -- 172.21.15.55:0/2659430725 >> 172.21.15.55:0/2659430725 conn(0x7f3f5c0d0700 msgr2=0x7f3f5c0d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:37.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.547+0000 7f3f61c00640 1 -- 172.21.15.55:0/2659430725 shutdown_connections 2024-04-02T07:28:37.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.547+0000 7f3f61c00640 1 -- 172.21.15.55:0/2659430725 wait complete. 2024-04-02T07:28:37.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f61c00640 1 Processor -- start 2024-04-02T07:28:37.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f61c00640 1 -- start start 2024-04-02T07:28:37.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f61c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f5c0b0800 0x7f3f5c1511e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:37.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f61c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f5c0cc5b0 0x7f3f5c15c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:37.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f61c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f5c0ceb50 0x7f3f5c0b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:37.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f61c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0c54e0 con 0x7f3f5c0cc5b0 2024-04-02T07:28:37.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f61c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c15cdd0 con 0x7f3f5c0b0800 2024-04-02T07:28:37.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f61c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0c4ed0 con 0x7f3f5c0ceb50 2024-04-02T07:28:37.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f52000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f5c0cc5b0 0x7f3f5c15c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:37.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f52000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f5c0cc5b0 0x7f3f5c15c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59332/0 (socket says 172.21.15.55:59332) 2024-04-02T07:28:37.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f52000640 1 -- 172.21.15.55:0/1189289487 learned_addr learned my addr 172.21.15.55:0/1189289487 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:37.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f5aa00640 1 --2- 172.21.15.55:0/1189289487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f5c0b0800 0x7f3f5c1511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:37.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f5b400640 1 --2- 172.21.15.55:0/1189289487 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f5c0ceb50 0x7f3f5c0b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:37.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f52000640 1 -- 172.21.15.55:0/1189289487 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f5c0ceb50 msgr2=0x7f3f5c0b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:37.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f52000640 1 --2- 172.21.15.55:0/1189289487 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f5c0ceb50 0x7f3f5c0b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f52000640 1 -- 172.21.15.55:0/1189289487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f5c0b0800 msgr2=0x7f3f5c1511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:37.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f52000640 1 --2- 172.21.15.55:0/1189289487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f5c0b0800 0x7f3f5c1511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f52000640 1 -- 172.21.15.55:0/1189289487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c009420 con 0x7f3f5c0cc5b0 2024-04-02T07:28:37.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f52000640 1 --2- 172.21.15.55:0/1189289487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f5c0cc5b0 0x7f3f5c15c0a0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400c480 tx=0x7f3f4400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:37.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f53400640 1 -- 172.21.15.55:0/1189289487 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f440074e0 con 0x7f3f5c0cc5b0 2024-04-02T07:28:37.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f53400640 1 -- 172.21.15.55:0/1189289487 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f44007660 con 0x7f3f5c0cc5b0 2024-04-02T07:28:37.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f53400640 1 -- 172.21.15.55:0/1189289487 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f44004a30 con 0x7f3f5c0cc5b0 2024-04-02T07:28:37.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f61c00640 1 -- 172.21.15.55:0/1189289487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5c15caf0 con 0x7f3f5c0cc5b0 2024-04-02T07:28:37.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.551+0000 7f3f61c00640 1 -- 172.21.15.55:0/1189289487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5c151720 con 0x7f3f5c0cc5b0 2024-04-02T07:28:37.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.555+0000 7f3f61c00640 1 -- 172.21.15.55:0/1189289487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5c0c5650 con 0x7f3f5c0cc5b0 2024-04-02T07:28:37.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.555+0000 7f3f53400640 1 -- 172.21.15.55:0/1189289487 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3f44004b90 con 0x7f3f5c0cc5b0 2024-04-02T07:28:37.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.555+0000 7f3f53400640 1 --2- 172.21.15.55:0/1189289487 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f38066690 0x7f3f38068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:37.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.555+0000 7f3f53400640 1 -- 172.21.15.55:0/1189289487 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f3f44083340 con 0x7f3f5c0cc5b0 2024-04-02T07:28:37.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.555+0000 7f3f5aa00640 1 --2- 172.21.15.55:0/1189289487 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f38066690 0x7f3f38068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:37.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.555+0000 7f3f5aa00640 1 --2- 172.21.15.55:0/1189289487 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f38066690 0x7f3f38068b50 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0ad000 tx=0x7f3f4c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:37.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.559+0000 7f3f53400640 1 -- 172.21.15.55:0/1189289487 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3f440506c0 con 0x7f3f5c0cc5b0 2024-04-02T07:28:37.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.719+0000 7f3f61c00640 1 -- 172.21.15.55:0/1189289487 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3f5c066c90 con 0x7f3f5c0cc5b0 2024-04-02T07:28:37.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.719+0000 7f3f53400640 1 -- 172.21.15.55:0/1189289487 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f44018020 con 0x7f3f5c0cc5b0 2024-04-02T07:28:37.719 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:28:37.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.719+0000 7f3f61c00640 1 -- 172.21.15.55:0/1189289487 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f38066690 msgr2=0x7f3f38068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:37.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.719+0000 7f3f61c00640 1 --2- 172.21.15.55:0/1189289487 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f38066690 0x7f3f38068b50 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0ad000 tx=0x7f3f4c0a6000 comp rx=0 tx=0).stop 2024-04-02T07:28:37.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.719+0000 7f3f61c00640 1 -- 172.21.15.55:0/1189289487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f5c0cc5b0 msgr2=0x7f3f5c15c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:37.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.719+0000 7f3f61c00640 1 --2- 172.21.15.55:0/1189289487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f5c0cc5b0 0x7f3f5c15c0a0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400c480 tx=0x7f3f4400c940 comp rx=0 tx=0).stop 2024-04-02T07:28:37.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.719+0000 7f3f61c00640 1 -- 172.21.15.55:0/1189289487 shutdown_connections 2024-04-02T07:28:37.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.719+0000 7f3f61c00640 1 --2- 172.21.15.55:0/1189289487 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f5c0ceb50 0x7f3f5c0b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.719+0000 7f3f61c00640 1 --2- 172.21.15.55:0/1189289487 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f5c0cc5b0 0x7f3f5c15c0a0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.719+0000 7f3f61c00640 1 --2- 172.21.15.55:0/1189289487 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f38066690 0x7f3f38068b50 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.719+0000 7f3f61c00640 1 --2- 172.21.15.55:0/1189289487 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f5c0b0800 0x7f3f5c1511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.719+0000 7f3f61c00640 1 -- 172.21.15.55:0/1189289487 >> 172.21.15.55:0/1189289487 conn(0x7f3f5c0d0700 msgr2=0x7f3f5c0b21f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:37.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.719+0000 7f3f61c00640 1 -- 172.21.15.55:0/1189289487 shutdown_connections 2024-04-02T07:28:37.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.719+0000 7f3f61c00640 1 -- 172.21.15.55:0/1189289487 wait complete. 2024-04-02T07:28:37.741 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:28:37.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.883+0000 7f8854a00640 1 Processor -- start 2024-04-02T07:28:37.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.883+0000 7f8854a00640 1 -- start start 2024-04-02T07:28:37.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.883+0000 7f8854a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88500ceb50 0x7f88500cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:37.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.883+0000 7f8854a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f88500cc5b0 0x7f8850164390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:37.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.883+0000 7f8854a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88500cb0e0 con 0x7f88500b0800 2024-04-02T07:28:37.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.883+0000 7f8854a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88500cf470 con 0x7f88500cc5b0 2024-04-02T07:28:37.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.883+0000 7f8854a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88500b1560 con 0x7f88500ceb50 2024-04-02T07:28:37.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.883+0000 7f884de00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88500ceb50 0x7f88500cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:37.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.883+0000 7f884de00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88500ceb50 0x7f88500cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:37962/0 (socket says 172.21.15.55:37962) 2024-04-02T07:28:37.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.883+0000 7f884de00640 1 -- 172.21.15.55:0/3751751192 learned_addr learned my addr 172.21.15.55:0/3751751192 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:37.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.883+0000 7f884e800640 1 --2- 172.21.15.55:0/3751751192 >> v2:172.21.15.106:3300/0 conn(0x7f88500cc5b0 0x7f8850164390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:37.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.883+0000 7f884de00640 1 -- 172.21.15.55:0/3751751192 >> v2:172.21.15.106:3300/0 conn(0x7f88500cc5b0 msgr2=0x7f8850164390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:37.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.883+0000 7f884de00640 1 --2- 172.21.15.55:0/3751751192 >> v2:172.21.15.106:3300/0 conn(0x7f88500cc5b0 0x7f8850164390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.883+0000 7f884de00640 1 -- 172.21.15.55:0/3751751192 >> v1:172.21.15.106:6789/0 conn(0x7f88500b0800 legacy=0x7f88500b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:37.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.883+0000 7f884de00640 1 -- 172.21.15.55:0/3751751192 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88500b1840 con 0x7f88500ceb50 2024-04-02T07:28:37.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.887+0000 7f884de00640 1 --2- 172.21.15.55:0/3751751192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88500ceb50 0x7f88500cef30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8840009870 tx=0x7f884001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c73a2b7b5b13df66 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:37.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.887+0000 7f884d400640 1 -- 172.21.15.55:0/3751751192 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88400ab600 con 0x7f88500ceb50 2024-04-02T07:28:37.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.887+0000 7f884d400640 1 -- 172.21.15.55:0/3751751192 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88400a7050 con 0x7f88500ceb50 2024-04-02T07:28:37.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.887+0000 7f884d400640 1 -- 172.21.15.55:0/3751751192 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88400ab980 con 0x7f88500ceb50 2024-04-02T07:28:37.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.887+0000 7f8854a00640 1 -- 172.21.15.55:0/3751751192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88500ceb50 msgr2=0x7f88500cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:37.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.887+0000 7f8854a00640 1 --2- 172.21.15.55:0/3751751192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88500ceb50 0x7f88500cef30 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8840009870 tx=0x7f884001c4d0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.887+0000 7f8854a00640 1 -- 172.21.15.55:0/3751751192 shutdown_connections 2024-04-02T07:28:37.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.887+0000 7f8854a00640 1 --2- 172.21.15.55:0/3751751192 >> v2:172.21.15.106:3300/0 conn(0x7f88500cc5b0 0x7f8850164390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.887+0000 7f8854a00640 1 --2- 172.21.15.55:0/3751751192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88500ceb50 0x7f88500cef30 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.887+0000 7f8854a00640 1 -- 172.21.15.55:0/3751751192 >> 172.21.15.55:0/3751751192 conn(0x7f88500d0700 msgr2=0x7f88500d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:37.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.887+0000 7f8854a00640 1 -- 172.21.15.55:0/3751751192 shutdown_connections 2024-04-02T07:28:37.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.887+0000 7f8854a00640 1 -- 172.21.15.55:0/3751751192 wait complete. 2024-04-02T07:28:37.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f8854a00640 1 Processor -- start 2024-04-02T07:28:37.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f8854a00640 1 -- start start 2024-04-02T07:28:37.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f8854a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88500b0800 0x7f8850158910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:37.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f8854a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88500cc5b0 0x7f88500add10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:37.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f8854a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88500ceb50 0x7f885006f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:37.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f8854a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8850158fa0 con 0x7f88500b0800 2024-04-02T07:28:37.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f8854a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88500ae250 con 0x7f88500cc5b0 2024-04-02T07:28:37.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f8854a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88501578f0 con 0x7f88500ceb50 2024-04-02T07:28:37.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f884de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88500b0800 0x7f8850158910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:37.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f884de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88500b0800 0x7f8850158910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59344/0 (socket says 172.21.15.55:59344) 2024-04-02T07:28:37.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f884de00640 1 -- 172.21.15.55:0/2013314694 learned_addr learned my addr 172.21.15.55:0/2013314694 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:37.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f8845400640 1 --2- 172.21.15.55:0/2013314694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88500cc5b0 0x7f88500add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:37.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f884e800640 1 --2- 172.21.15.55:0/2013314694 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88500ceb50 0x7f885006f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:37.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f884de00640 1 -- 172.21.15.55:0/2013314694 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88500ceb50 msgr2=0x7f885006f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:37.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f884de00640 1 --2- 172.21.15.55:0/2013314694 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88500ceb50 0x7f885006f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f884de00640 1 -- 172.21.15.55:0/2013314694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88500cc5b0 msgr2=0x7f88500add10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:37.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f884de00640 1 --2- 172.21.15.55:0/2013314694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88500cc5b0 0x7f88500add10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:37.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f884de00640 1 -- 172.21.15.55:0/2013314694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88400094d0 con 0x7f88500b0800 2024-04-02T07:28:37.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f884e800640 1 --2- 172.21.15.55:0/2013314694 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88500ceb50 0x7f885006f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:37.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f884de00640 1 --2- 172.21.15.55:0/2013314694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88500b0800 0x7f8850158910 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f88400ae040 tx=0x7f884001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:37.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f8846a00640 1 -- 172.21.15.55:0/2013314694 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88400b6420 con 0x7f88500b0800 2024-04-02T07:28:37.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f8846a00640 1 -- 172.21.15.55:0/2013314694 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88400b65a0 con 0x7f88500b0800 2024-04-02T07:28:37.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f8846a00640 1 -- 172.21.15.55:0/2013314694 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88400b6950 con 0x7f88500b0800 2024-04-02T07:28:37.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f8854a00640 1 -- 172.21.15.55:0/2013314694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8850157bd0 con 0x7f88500b0800 2024-04-02T07:28:37.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.891+0000 7f8854a00640 1 -- 172.21.15.55:0/2013314694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8850158190 con 0x7f88500b0800 2024-04-02T07:28:37.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.895+0000 7f8854a00640 1 -- 172.21.15.55:0/2013314694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8850158380 con 0x7f88500b0800 2024-04-02T07:28:37.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.895+0000 7f8846a00640 1 -- 172.21.15.55:0/2013314694 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f88400b2040 con 0x7f88500b0800 2024-04-02T07:28:37.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.895+0000 7f8846a00640 1 --2- 172.21.15.55:0/2013314694 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f882c066690 0x7f882c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:37.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.895+0000 7f8846a00640 1 -- 172.21.15.55:0/2013314694 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f884011e3f0 con 0x7f88500b0800 2024-04-02T07:28:37.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.895+0000 7f8845400640 1 --2- 172.21.15.55:0/2013314694 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f882c066690 0x7f882c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:37.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.895+0000 7f8845400640 1 --2- 172.21.15.55:0/2013314694 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f882c066690 0x7f882c068b50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8838007fd0 tx=0x7f8838009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:37.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:37.899+0000 7f8846a00640 1 -- 172.21.15.55:0/2013314694 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f88400eb630 con 0x7f88500b0800 2024-04-02T07:28:38.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.059+0000 7f8854a00640 1 -- 172.21.15.55:0/2013314694 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8850066c90 con 0x7f88500b0800 2024-04-02T07:28:38.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.059+0000 7f8846a00640 1 -- 172.21.15.55:0/2013314694 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7f88400a4f00 con 0x7f88500b0800 2024-04-02T07:28:38.062 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:28:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.063+0000 7f8854a00640 1 -- 172.21.15.55:0/2013314694 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f882c066690 msgr2=0x7f882c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.063+0000 7f8854a00640 1 --2- 172.21.15.55:0/2013314694 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f882c066690 0x7f882c068b50 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f8838007fd0 tx=0x7f8838009040 comp rx=0 tx=0).stop 2024-04-02T07:28:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.063+0000 7f8854a00640 1 -- 172.21.15.55:0/2013314694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88500b0800 msgr2=0x7f8850158910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.063+0000 7f8854a00640 1 --2- 172.21.15.55:0/2013314694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88500b0800 0x7f8850158910 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f88400ae040 tx=0x7f884001ad10 comp rx=0 tx=0).stop 2024-04-02T07:28:38.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.063+0000 7f8854a00640 1 -- 172.21.15.55:0/2013314694 shutdown_connections 2024-04-02T07:28:38.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.063+0000 7f8854a00640 1 --2- 172.21.15.55:0/2013314694 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88500ceb50 0x7f885006f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.063+0000 7f8854a00640 1 --2- 172.21.15.55:0/2013314694 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f882c066690 0x7f882c068b50 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.063+0000 7f8854a00640 1 --2- 172.21.15.55:0/2013314694 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88500cc5b0 0x7f88500add10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.063+0000 7f8854a00640 1 --2- 172.21.15.55:0/2013314694 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88500b0800 0x7f8850158910 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.063+0000 7f8854a00640 1 -- 172.21.15.55:0/2013314694 >> 172.21.15.55:0/2013314694 conn(0x7f88500d0700 msgr2=0x7f88500cca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:38.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.063+0000 7f8854a00640 1 -- 172.21.15.55:0/2013314694 shutdown_connections 2024-04-02T07:28:38.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.063+0000 7f8854a00640 1 -- 172.21.15.55:0/2013314694 wait complete. 2024-04-02T07:28:38.083 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:28:38.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.227+0000 7ff6b6600640 1 Processor -- start 2024-04-02T07:28:38.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.227+0000 7ff6b6600640 1 -- start start 2024-04-02T07:28:38.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.227+0000 7ff6b6600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff6b00b3dc0 0x7ff6b00ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:38.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.227+0000 7ff6b6600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b00b41a0 0x7ff6b0142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:38.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.227+0000 7ff6b6600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6b006ddc0 con 0x7ff6b00ade90 2024-04-02T07:28:38.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.227+0000 7ff6b6600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6b006c630 con 0x7ff6b00b3dc0 2024-04-02T07:28:38.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.227+0000 7ff6b6600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b006c8f0 con 0x7ff6b00b41a0 2024-04-02T07:28:38.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.227+0000 7ff6aea00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff6b00ade90 0x7ff6b006d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37124/0 (socket says 172.21.15.55:37124) 2024-04-02T07:28:38.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.227+0000 7ff6aea00640 1 -- 172.21.15.55:0/2521740940 learned_addr learned my addr 172.21.15.55:0/2521740940 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:38.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.227+0000 7ff6afe00640 1 --2- 172.21.15.55:0/2521740940 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b00b41a0 0x7ff6b0142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:38.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.227+0000 7ff6af400640 1 --2- 172.21.15.55:0/2521740940 >> v2:172.21.15.106:3300/0 conn(0x7ff6b00b3dc0 0x7ff6b00ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:38.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.227+0000 7ff6ae000640 1 -- 172.21.15.55:0/2521740940 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2909258842 0 0) 0x7ff6b006ddc0 con 0x7ff6b00ade90 2024-04-02T07:28:38.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.227+0000 7ff6ae000640 1 -- 172.21.15.55:0/2521740940 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff694003530 con 0x7ff6b00ade90 2024-04-02T07:28:38.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.227+0000 7ff6afe00640 1 -- 172.21.15.55:0/2521740940 >> v2:172.21.15.106:3300/0 conn(0x7ff6b00b3dc0 msgr2=0x7ff6b00ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:38.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.227+0000 7ff6afe00640 1 --2- 172.21.15.55:0/2521740940 >> v2:172.21.15.106:3300/0 conn(0x7ff6b00b3dc0 0x7ff6b00ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.227+0000 7ff6afe00640 1 -- 172.21.15.55:0/2521740940 >> v1:172.21.15.55:6789/0 conn(0x7ff6b00ade90 legacy=0x7ff6b006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:38.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.227+0000 7ff6afe00640 1 -- 172.21.15.55:0/2521740940 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b006cbd0 con 0x7ff6b00b41a0 2024-04-02T07:28:38.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.227+0000 7ff6af400640 1 --2- 172.21.15.55:0/2521740940 >> v2:172.21.15.106:3300/0 conn(0x7ff6b00b3dc0 0x7ff6b00ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:28:38.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.231+0000 7ff6afe00640 1 --2- 172.21.15.55:0/2521740940 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b00b41a0 0x7ff6b0142ac0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009d90 tx=0x7ff6a801c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f417fd8055abd529 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:38.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.231+0000 7ff6ae000640 1 -- 172.21.15.55:0/2521740940 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80a5880 con 0x7ff6b00b41a0 2024-04-02T07:28:38.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.231+0000 7ff6ae000640 1 -- 172.21.15.55:0/2521740940 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6a80a59e0 con 0x7ff6b00b41a0 2024-04-02T07:28:38.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.231+0000 7ff6ae000640 1 -- 172.21.15.55:0/2521740940 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6a80a5d70 con 0x7ff6b00b41a0 2024-04-02T07:28:38.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.231+0000 7ff6b6600640 1 -- 172.21.15.55:0/2521740940 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b00b41a0 msgr2=0x7ff6b0142ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:38.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.231+0000 7ff6b6600640 1 --2- 172.21.15.55:0/2521740940 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b00b41a0 0x7ff6b0142ac0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff6a8009d90 tx=0x7ff6a801c8b0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.231+0000 7ff6b6600640 1 -- 172.21.15.55:0/2521740940 shutdown_connections 2024-04-02T07:28:38.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.231+0000 7ff6b6600640 1 --2- 172.21.15.55:0/2521740940 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b00b41a0 0x7ff6b0142ac0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.231+0000 7ff6b6600640 1 --2- 172.21.15.55:0/2521740940 >> v2:172.21.15.106:3300/0 conn(0x7ff6b00b3dc0 0x7ff6b00ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.231+0000 7ff6b6600640 1 -- 172.21.15.55:0/2521740940 >> 172.21.15.55:0/2521740940 conn(0x7ff6b006a390 msgr2=0x7ff6b00b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:38.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.231+0000 7ff6b6600640 1 -- 172.21.15.55:0/2521740940 shutdown_connections 2024-04-02T07:28:38.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.231+0000 7ff6b6600640 1 -- 172.21.15.55:0/2521740940 wait complete. 2024-04-02T07:28:38.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6b6600640 1 Processor -- start 2024-04-02T07:28:38.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6b6600640 1 -- start start 2024-04-02T07:28:38.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6b6600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6b00ade90 0x7ff6b0165640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:38.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6b6600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6b00b3dc0 0x7ff6b0166f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:38.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6b6600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b00b41a0 0x7ff6b0133510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:38.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6b6600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b015a9f0 con 0x7ff6b00b3dc0 2024-04-02T07:28:38.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6b6600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b0165e90 con 0x7ff6b00ade90 2024-04-02T07:28:38.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6b6600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6b0166170 con 0x7ff6b00b41a0 2024-04-02T07:28:38.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6aea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6b00b3dc0 0x7ff6b0166f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:38.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6aea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6b00b3dc0 0x7ff6b0166f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59352/0 (socket says 172.21.15.55:59352) 2024-04-02T07:28:38.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6aea00640 1 -- 172.21.15.55:0/2468419526 learned_addr learned my addr 172.21.15.55:0/2468419526 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:38.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6af400640 1 --2- 172.21.15.55:0/2468419526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6b00ade90 0x7ff6b0165640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:38.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6afe00640 1 --2- 172.21.15.55:0/2468419526 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b00b41a0 0x7ff6b0133510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:38.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6aea00640 1 -- 172.21.15.55:0/2468419526 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b00b41a0 msgr2=0x7ff6b0133510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:38.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6aea00640 1 --2- 172.21.15.55:0/2468419526 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b00b41a0 0x7ff6b0133510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6aea00640 1 -- 172.21.15.55:0/2468419526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6b00ade90 msgr2=0x7ff6b0165640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:38.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6aea00640 1 --2- 172.21.15.55:0/2468419526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6b00ade90 0x7ff6b0165640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6aea00640 1 -- 172.21.15.55:0/2468419526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a0009420 con 0x7ff6b00b3dc0 2024-04-02T07:28:38.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6af400640 1 --2- 172.21.15.55:0/2468419526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6b00ade90 0x7ff6b0165640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:38.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6aea00640 1 --2- 172.21.15.55:0/2468419526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6b00b3dc0 0x7ff6b0166f30 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00c4d0 tx=0x7ff69c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:38.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6a7400640 1 -- 172.21.15.55:0/2468419526 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c005cf0 con 0x7ff6b00b3dc0 2024-04-02T07:28:38.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6a7400640 1 -- 172.21.15.55:0/2468419526 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff69c005e50 con 0x7ff6b00b3dc0 2024-04-02T07:28:38.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6b6600640 1 -- 172.21.15.55:0/2468419526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a8009a70 con 0x7ff6b00b3dc0 2024-04-02T07:28:38.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6a7400640 1 -- 172.21.15.55:0/2468419526 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff69c007270 con 0x7ff6b00b3dc0 2024-04-02T07:28:38.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6b6600640 1 -- 172.21.15.55:0/2468419526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6b0166730 con 0x7ff6b00b3dc0 2024-04-02T07:28:38.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.235+0000 7ff6b6600640 1 -- 172.21.15.55:0/2468419526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6b0073530 con 0x7ff6b00b3dc0 2024-04-02T07:28:38.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.239+0000 7ff6a7400640 1 -- 172.21.15.55:0/2468419526 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff69c0073d0 con 0x7ff6b00b3dc0 2024-04-02T07:28:38.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.239+0000 7ff6a7400640 1 --2- 172.21.15.55:0/2468419526 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff690066690 0x7ff690068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:38.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.239+0000 7ff6a7400640 1 -- 172.21.15.55:0/2468419526 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7ff69c083790 con 0x7ff6b00b3dc0 2024-04-02T07:28:38.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.239+0000 7ff6af400640 1 --2- 172.21.15.55:0/2468419526 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff690066690 0x7ff690068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:38.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.239+0000 7ff6af400640 1 --2- 172.21.15.55:0/2468419526 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff690066690 0x7ff690068b50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0009d40 tx=0x7ff6a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:38.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.243+0000 7ff6a7400640 1 -- 172.21.15.55:0/2468419526 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff69c050a80 con 0x7ff6b00b3dc0 2024-04-02T07:28:38.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.407+0000 7ff6b6600640 1 -- 172.21.15.55:0/2468419526 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff6b0066c90 con 0x7ff6b00b3dc0 2024-04-02T07:28:38.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.407+0000 7ff6a7400640 1 -- 172.21.15.55:0/2468419526 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff69c0540a0 con 0x7ff6b00b3dc0 2024-04-02T07:28:38.414 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:28:38.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.411+0000 7ff6b6600640 1 -- 172.21.15.55:0/2468419526 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff690066690 msgr2=0x7ff690068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:38.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.411+0000 7ff6b6600640 1 --2- 172.21.15.55:0/2468419526 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff690066690 0x7ff690068b50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0009d40 tx=0x7ff6a0008040 comp rx=0 tx=0).stop 2024-04-02T07:28:38.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.411+0000 7ff6b6600640 1 -- 172.21.15.55:0/2468419526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6b00b3dc0 msgr2=0x7ff6b0166f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:38.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.411+0000 7ff6b6600640 1 --2- 172.21.15.55:0/2468419526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6b00b3dc0 0x7ff6b0166f30 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00c4d0 tx=0x7ff69c00c990 comp rx=0 tx=0).stop 2024-04-02T07:28:38.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.411+0000 7ff6b6600640 1 -- 172.21.15.55:0/2468419526 shutdown_connections 2024-04-02T07:28:38.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.411+0000 7ff6b6600640 1 --2- 172.21.15.55:0/2468419526 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6b00b41a0 0x7ff6b0133510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.411+0000 7ff6b6600640 1 --2- 172.21.15.55:0/2468419526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6b00b3dc0 0x7ff6b0166f30 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.411+0000 7ff6b6600640 1 --2- 172.21.15.55:0/2468419526 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff690066690 0x7ff690068b50 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.411+0000 7ff6b6600640 1 --2- 172.21.15.55:0/2468419526 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6b00ade90 0x7ff6b0165640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.411+0000 7ff6b6600640 1 -- 172.21.15.55:0/2468419526 >> 172.21.15.55:0/2468419526 conn(0x7ff6b006a390 msgr2=0x7ff6b0153f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:38.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.411+0000 7ff6b6600640 1 -- 172.21.15.55:0/2468419526 shutdown_connections 2024-04-02T07:28:38.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.411+0000 7ff6b6600640 1 -- 172.21.15.55:0/2468419526 wait complete. 2024-04-02T07:28:38.431 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:28:38.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.571+0000 7f9d12600640 1 Processor -- start 2024-04-02T07:28:38.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.571+0000 7f9d12600640 1 -- start start 2024-04-02T07:28:38.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.571+0000 7f9d12600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9d0c0cb5b0 0x7f9d0c06ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:38.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.571+0000 7f9d12600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0c0c9ff0 con 0x7f9d0c15aad0 2024-04-02T07:28:38.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.571+0000 7f9d12600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d0c0c93e0 con 0x7f9d0c0af920 2024-04-02T07:28:38.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.571+0000 7f9d12600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d0c0c96c0 con 0x7f9d0c0cb5b0 2024-04-02T07:28:38.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.571+0000 7f9d03e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9d0c0cb5b0 0x7f9d0c06ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:38.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.571+0000 7f9d0b400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9d0c15aad0 0x7f9d0c0caea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37140/0 (socket says 172.21.15.55:37140) 2024-04-02T07:28:38.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.571+0000 7f9d0b400640 1 -- 172.21.15.55:0/3670614983 learned_addr learned my addr 172.21.15.55:0/3670614983 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:38.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.571+0000 7f9d03e00640 1 -- 172.21.15.55:0/3670614983 >> v1:172.21.15.106:6789/0 conn(0x7f9d0c0af920 legacy=0x7f9d0c06cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:38.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.571+0000 7f9d03e00640 1 -- 172.21.15.55:0/3670614983 >> v1:172.21.15.55:6789/0 conn(0x7f9d0c15aad0 legacy=0x7f9d0c0caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:38.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.575+0000 7f9d03e00640 1 -- 172.21.15.55:0/3670614983 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d0c0c99a0 con 0x7f9d0c0cb5b0 2024-04-02T07:28:38.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.575+0000 7f9d0aa00640 1 -- 172.21.15.55:0/3670614983 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2021457475 0 0) 0x7f9d0c0c9ff0 con 0x7f9d0c15aad0 2024-04-02T07:28:38.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.575+0000 7f9d03e00640 1 --2- 172.21.15.55:0/3670614983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d0c0cb5b0 0x7f9d0c06ca00 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40097c0 tx=0x7f9d0c06de60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ef9e01531e6dcad server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:38.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.575+0000 7f9d0aa00640 1 -- 172.21.15.55:0/3670614983 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf40ac620 con 0x7f9d0c0cb5b0 2024-04-02T07:28:38.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.575+0000 7f9d0aa00640 1 -- 172.21.15.55:0/3670614983 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf40ac780 con 0x7f9d0c0cb5b0 2024-04-02T07:28:38.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.575+0000 7f9d0aa00640 1 -- 172.21.15.55:0/3670614983 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf40acb10 con 0x7f9d0c0cb5b0 2024-04-02T07:28:38.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.575+0000 7f9d12600640 1 -- 172.21.15.55:0/3670614983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d0c0cb5b0 msgr2=0x7f9d0c06ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:38.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.575+0000 7f9d12600640 1 --2- 172.21.15.55:0/3670614983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d0c0cb5b0 0x7f9d0c06ca00 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f9cf40097c0 tx=0x7f9d0c06de60 comp rx=0 tx=0).stop 2024-04-02T07:28:38.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.575+0000 7f9d12600640 1 -- 172.21.15.55:0/3670614983 shutdown_connections 2024-04-02T07:28:38.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.575+0000 7f9d12600640 1 --2- 172.21.15.55:0/3670614983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d0c0cb5b0 0x7f9d0c06ca00 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.575+0000 7f9d12600640 1 -- 172.21.15.55:0/3670614983 >> 172.21.15.55:0/3670614983 conn(0x7f9d0c069d90 msgr2=0x7f9d0c06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:38.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.575+0000 7f9d12600640 1 -- 172.21.15.55:0/3670614983 shutdown_connections 2024-04-02T07:28:38.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.575+0000 7f9d12600640 1 -- 172.21.15.55:0/3670614983 wait complete. 2024-04-02T07:28:38.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d12600640 1 Processor -- start 2024-04-02T07:28:38.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d12600640 1 -- start start 2024-04-02T07:28:38.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d12600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d0c0af920 0x7f9d0c149430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:38.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d12600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d0c0cb5b0 0x7f9d0c0cd880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:38.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d12600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d0c15aad0 0x7f9d0c155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:38.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d12600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c153650 con 0x7f9d0c15aad0 2024-04-02T07:28:38.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d12600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c153930 con 0x7f9d0c0af920 2024-04-02T07:28:38.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d12600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d0c153c10 con 0x7f9d0c0cb5b0 2024-04-02T07:28:38.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d0be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d0c15aad0 0x7f9d0c155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:38.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d0be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d0c15aad0 0x7f9d0c155ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59374/0 (socket says 172.21.15.55:59374) 2024-04-02T07:28:38.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d0be00640 1 -- 172.21.15.55:0/4221002674 learned_addr learned my addr 172.21.15.55:0/4221002674 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:38.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d03e00640 1 --2- 172.21.15.55:0/4221002674 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d0c0cb5b0 0x7f9d0c0cd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:38.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d0b400640 1 --2- 172.21.15.55:0/4221002674 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d0c0af920 0x7f9d0c149430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:38.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d0be00640 1 -- 172.21.15.55:0/4221002674 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d0c0cb5b0 msgr2=0x7f9d0c0cd880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:38.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d0be00640 1 --2- 172.21.15.55:0/4221002674 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d0c0cb5b0 0x7f9d0c0cd880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d0be00640 1 -- 172.21.15.55:0/4221002674 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d0c0af920 msgr2=0x7f9d0c149430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:38.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d0be00640 1 --2- 172.21.15.55:0/4221002674 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d0c0af920 0x7f9d0c149430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d0be00640 1 -- 172.21.15.55:0/4221002674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf4009420 con 0x7f9d0c15aad0 2024-04-02T07:28:38.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d0b400640 1 --2- 172.21.15.55:0/4221002674 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d0c0af920 0x7f9d0c149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:38.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d0be00640 1 --2- 172.21.15.55:0/4221002674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d0c15aad0 0x7f9d0c155ed0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400c780 tx=0x7f9d0400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:38.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d03400640 1 -- 172.21.15.55:0/4221002674 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d04004b70 con 0x7f9d0c15aad0 2024-04-02T07:28:38.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d03400640 1 -- 172.21.15.55:0/4221002674 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d0400ce90 con 0x7f9d0c15aad0 2024-04-02T07:28:38.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d03400640 1 -- 172.21.15.55:0/4221002674 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d0400a850 con 0x7f9d0c15aad0 2024-04-02T07:28:38.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d12600640 1 -- 172.21.15.55:0/4221002674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d0c143ec0 con 0x7f9d0c15aad0 2024-04-02T07:28:38.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.579+0000 7f9d12600640 1 -- 172.21.15.55:0/4221002674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d0c145c20 con 0x7f9d0c15aad0 2024-04-02T07:28:38.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.583+0000 7f9d12600640 1 -- 172.21.15.55:0/4221002674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d0c06e240 con 0x7f9d0c15aad0 2024-04-02T07:28:38.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.583+0000 7f9d03400640 1 -- 172.21.15.55:0/4221002674 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f9d0400a9b0 con 0x7f9d0c15aad0 2024-04-02T07:28:38.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.583+0000 7f9d03400640 1 --2- 172.21.15.55:0/4221002674 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9ce8066690 0x7f9ce8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:38.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.583+0000 7f9d03400640 1 -- 172.21.15.55:0/4221002674 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f9d04084310 con 0x7f9d0c15aad0 2024-04-02T07:28:38.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.583+0000 7f9d0b400640 1 --2- 172.21.15.55:0/4221002674 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9ce8066690 0x7f9ce8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:38.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.583+0000 7f9d0b400640 1 --2- 172.21.15.55:0/4221002674 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9ce8066690 0x7f9ce8068b50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc000f70 tx=0x7f9cfc007cb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:38.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.587+0000 7f9d03400640 1 -- 172.21.15.55:0/4221002674 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f9d040515e0 con 0x7f9d0c15aad0 2024-04-02T07:28:38.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.763+0000 7f9d12600640 1 -- 172.21.15.55:0/4221002674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9d0c1440b0 con 0x7f9d0c15aad0 2024-04-02T07:28:38.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.763+0000 7f9d03400640 1 -- 172.21.15.55:0/4221002674 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v75) v1 ==== 80+0+122 (secure 0 0 0) 0x7f9d04054c00 con 0x7f9d0c15aad0 2024-04-02T07:28:38.765 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6833/1576619269 2024-04-03T07:27:14.356430+0000 2024-04-02T07:28:38.765 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6832/1576619269 2024-04-03T07:27:14.356430+0000 2024-04-02T07:28:38.765 INFO:teuthology.orchestra.run.smithi055.stderr:listed 2 entries 2024-04-02T07:28:38.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.767+0000 7f9d12600640 1 -- 172.21.15.55:0/4221002674 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9ce8066690 msgr2=0x7f9ce8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:38.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.767+0000 7f9d12600640 1 --2- 172.21.15.55:0/4221002674 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9ce8066690 0x7f9ce8068b50 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc000f70 tx=0x7f9cfc007cb0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.767+0000 7f9d12600640 1 -- 172.21.15.55:0/4221002674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d0c15aad0 msgr2=0x7f9d0c155ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:38.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.767+0000 7f9d12600640 1 --2- 172.21.15.55:0/4221002674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d0c15aad0 0x7f9d0c155ed0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f9d0400c780 tx=0x7f9d0400cc40 comp rx=0 tx=0).stop 2024-04-02T07:28:38.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.767+0000 7f9d12600640 1 -- 172.21.15.55:0/4221002674 shutdown_connections 2024-04-02T07:28:38.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.767+0000 7f9d12600640 1 --2- 172.21.15.55:0/4221002674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d0c15aad0 0x7f9d0c155ed0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.767+0000 7f9d12600640 1 --2- 172.21.15.55:0/4221002674 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d0c0cb5b0 0x7f9d0c0cd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.767+0000 7f9d12600640 1 --2- 172.21.15.55:0/4221002674 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9ce8066690 0x7f9ce8068b50 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.767+0000 7f9d12600640 1 --2- 172.21.15.55:0/4221002674 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d0c0af920 0x7f9d0c149430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:38.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.767+0000 7f9d12600640 1 -- 172.21.15.55:0/4221002674 >> 172.21.15.55:0/4221002674 conn(0x7f9d0c069d90 msgr2=0x7f9d0c0caea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:38.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.767+0000 7f9d12600640 1 -- 172.21.15.55:0/4221002674 shutdown_connections 2024-04-02T07:28:38.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:38.767+0000 7f9d12600640 1 -- 172.21.15.55:0/4221002674 wait complete. 2024-04-02T07:28:38.786 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi055.front.sepia.ceph.com... 2024-04-02T07:28:38.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:38.786 DEBUG:teuthology.orchestra.run.smithi055:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-02T07:28:38.804 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[44605]: fuse finished with error 0 and tester_r 0 2024-04-02T07:28:38.807 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:28:38.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:38.807 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-02T07:28:38.884 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:28:38.884 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:28:38.893 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:28:38.893 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:28:38.893 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:38.894 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-02T07:28:38.942 INFO:teuthology.orchestra.run.smithi106.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-04-02T07:28:38.943 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:28:38.944 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:28:38.944 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:28:38.953 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:28:38.954 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:28:38.954 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:38.954 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-02T07:28:39.006 INFO:teuthology.orchestra.run.smithi055.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-04-02T07:28:39.007 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:28:39.008 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:28:39.008 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:28:39.016 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:28:39.017 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:28:39.017 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:28:39.017 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-02T07:28:39.065 INFO:teuthology.orchestra.run.smithi106.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-04-02T07:28:39.066 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:28:39.067 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:28:39.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.207+0000 7faa43400640 1 Processor -- start 2024-04-02T07:28:39.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.207+0000 7faa43400640 1 -- start start 2024-04-02T07:28:39.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.207+0000 7faa43400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faa3c0cc520 0x7faa3c098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:39.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.207+0000 7faa43400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa3c0ce520 0x7faa3c098f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:39.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.207+0000 7faa43400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa3c0cb250 con 0x7faa3c15aa60 2024-04-02T07:28:39.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.207+0000 7faa43400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa3c15ae40 con 0x7faa3c0ce520 2024-04-02T07:28:39.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.207+0000 7faa43400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa3c0cb480 con 0x7faa3c0cc520 2024-04-02T07:28:39.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.207+0000 7faa41400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa3c0ce520 0x7faa3c098f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:39.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.207+0000 7faa41400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faa3c0ce520 0x7faa3c098f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59388/0 (socket says 172.21.15.55:59388) 2024-04-02T07:28:39.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.207+0000 7faa41400640 1 -- 172.21.15.55:0/890234235 learned_addr learned my addr 172.21.15.55:0/890234235 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:39.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.207+0000 7faa3be00640 1 --2- 172.21.15.55:0/890234235 >> v2:172.21.15.106:3300/0 conn(0x7faa3c0cc520 0x7faa3c098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:39.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.207+0000 7faa41400640 1 -- 172.21.15.55:0/890234235 >> v2:172.21.15.106:3300/0 conn(0x7faa3c0cc520 msgr2=0x7faa3c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:39.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.207+0000 7faa41400640 1 --2- 172.21.15.55:0/890234235 >> v2:172.21.15.106:3300/0 conn(0x7faa3c0cc520 0x7faa3c098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.207+0000 7faa41400640 1 -- 172.21.15.55:0/890234235 >> v1:172.21.15.106:6789/0 conn(0x7faa3c15aa60 legacy=0x7faa3c099750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:39.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.211+0000 7faa41400640 1 -- 172.21.15.55:0/890234235 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3c0cb760 con 0x7faa3c0ce520 2024-04-02T07:28:39.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.211+0000 7faa41400640 1 --2- 172.21.15.55:0/890234235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa3c0ce520 0x7faa3c098f50 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7faa3c071980 tx=0x7faa3401c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c955bac91160381c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:39.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.211+0000 7faa3b400640 1 -- 172.21.15.55:0/890234235 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa340a5760 con 0x7faa3c0ce520 2024-04-02T07:28:39.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.211+0000 7faa3b400640 1 -- 172.21.15.55:0/890234235 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa340a58c0 con 0x7faa3c0ce520 2024-04-02T07:28:39.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.211+0000 7faa3b400640 1 -- 172.21.15.55:0/890234235 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa340a5c50 con 0x7faa3c0ce520 2024-04-02T07:28:39.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.211+0000 7faa43400640 1 -- 172.21.15.55:0/890234235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa3c0ce520 msgr2=0x7faa3c098f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:39.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.211+0000 7faa43400640 1 --2- 172.21.15.55:0/890234235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa3c0ce520 0x7faa3c098f50 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7faa3c071980 tx=0x7faa3401c9b0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.211+0000 7faa43400640 1 -- 172.21.15.55:0/890234235 shutdown_connections 2024-04-02T07:28:39.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.211+0000 7faa43400640 1 --2- 172.21.15.55:0/890234235 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa3c0ce520 0x7faa3c098f50 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.211+0000 7faa43400640 1 --2- 172.21.15.55:0/890234235 >> v2:172.21.15.106:3300/0 conn(0x7faa3c0cc520 0x7faa3c098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.211+0000 7faa43400640 1 -- 172.21.15.55:0/890234235 >> 172.21.15.55:0/890234235 conn(0x7faa3c0b2150 msgr2=0x7faa3c0b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:39.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.211+0000 7faa43400640 1 -- 172.21.15.55:0/890234235 shutdown_connections 2024-04-02T07:28:39.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.211+0000 7faa43400640 1 -- 172.21.15.55:0/890234235 wait complete. 2024-04-02T07:28:39.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa43400640 1 Processor -- start 2024-04-02T07:28:39.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa43400640 1 -- start start 2024-04-02T07:28:39.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa43400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faa3c0cc520 0x7faa3c156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:39.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa43400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa3c0ce520 0x7faa3c0b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:39.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa43400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa3c15aa60 0x7faa3c0b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:39.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa43400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c0c55b0 con 0x7faa3c0ce520 2024-04-02T07:28:39.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa43400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c0c4930 con 0x7faa3c15aa60 2024-04-02T07:28:39.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa43400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3c0c4c10 con 0x7faa3c0cc520 2024-04-02T07:28:39.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa3be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa3c0ce520 0x7faa3c0b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:39.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa3be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa3c0ce520 0x7faa3c0b3280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59390/0 (socket says 172.21.15.55:59390) 2024-04-02T07:28:39.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa3be00640 1 -- 172.21.15.55:0/307851959 learned_addr learned my addr 172.21.15.55:0/307851959 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:39.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa41400640 1 --2- 172.21.15.55:0/307851959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa3c15aa60 0x7faa3c0b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:39.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa40a00640 1 --2- 172.21.15.55:0/307851959 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faa3c0cc520 0x7faa3c156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:39.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa3be00640 1 -- 172.21.15.55:0/307851959 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faa3c0cc520 msgr2=0x7faa3c156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:39.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa3be00640 1 --2- 172.21.15.55:0/307851959 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faa3c0cc520 0x7faa3c156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa3be00640 1 -- 172.21.15.55:0/307851959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa3c15aa60 msgr2=0x7faa3c0b37c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:39.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa3be00640 1 --2- 172.21.15.55:0/307851959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa3c15aa60 0x7faa3c0b37c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa3be00640 1 -- 172.21.15.55:0/307851959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa34009b30 con 0x7faa3c0ce520 2024-04-02T07:28:39.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa41400640 1 --2- 172.21.15.55:0/307851959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa3c15aa60 0x7faa3c0b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:28:39.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa40a00640 1 --2- 172.21.15.55:0/307851959 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faa3c0cc520 0x7faa3c156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:28:39.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa3be00640 1 --2- 172.21.15.55:0/307851959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa3c0ce520 0x7faa3c0b3280 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7faa2800d800 tx=0x7faa2800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:39.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa38c00640 1 -- 172.21.15.55:0/307851959 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2800b6c0 con 0x7faa3c0ce520 2024-04-02T07:28:39.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa38c00640 1 -- 172.21.15.55:0/307851959 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2800b820 con 0x7faa3c0ce520 2024-04-02T07:28:39.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa38c00640 1 -- 172.21.15.55:0/307851959 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa2800bb90 con 0x7faa3c0ce520 2024-04-02T07:28:39.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.215+0000 7faa43400640 1 -- 172.21.15.55:0/307851959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa3c0c4ef0 con 0x7faa3c0ce520 2024-04-02T07:28:39.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.219+0000 7faa43400640 1 -- 172.21.15.55:0/307851959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa3c1573a0 con 0x7faa3c0ce520 2024-04-02T07:28:39.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.219+0000 7faa43400640 1 -- 172.21.15.55:0/307851959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa3c0c56f0 con 0x7faa3c0ce520 2024-04-02T07:28:39.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.219+0000 7faa38c00640 1 -- 172.21.15.55:0/307851959 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7faa2800bcf0 con 0x7faa3c0ce520 2024-04-02T07:28:39.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.219+0000 7faa38c00640 1 --2- 172.21.15.55:0/307851959 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faa1c066690 0x7faa1c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:39.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.219+0000 7faa38c00640 1 -- 172.21.15.55:0/307851959 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7faa280848e0 con 0x7faa3c0ce520 2024-04-02T07:28:39.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.219+0000 7faa40a00640 1 --2- 172.21.15.55:0/307851959 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faa1c066690 0x7faa1c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:39.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.219+0000 7faa40a00640 1 --2- 172.21.15.55:0/307851959 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faa1c066690 0x7faa1c068b50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7faa3000a850 tx=0x7faa30008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:39.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.223+0000 7faa38c00640 1 -- 172.21.15.55:0/307851959 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7faa3c0c56f0 con 0x7faa3c0ce520 2024-04-02T07:28:39.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.423+0000 7faa43400640 1 -- 172.21.15.55:0/307851959 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faa3c0c56f0 con 0x7faa3c0ce520 2024-04-02T07:28:39.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.423+0000 7faa38c00640 1 -- 172.21.15.55:0/307851959 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4741 (secure 0 0 0) 0x7faa3c0c56f0 con 0x7faa3c0ce520 2024-04-02T07:28:39.423 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:39.424 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":52,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2000687874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2000687874},{"type":"v1","addr":"172.21.15.106:6835","nonce":2000687874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/823234890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":823234890},{"type":"v1","addr":"172.21.15.55:6835","nonce":823234890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6439,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1803758651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1803758651},{"type":"v1","addr":"172.21.15.106:6837","nonce":1803758651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:26:55.525186+0000","modified":"2024-04-02T07:28:06.241662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":16,"addr":"172.21.15.55:6833/1965896660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1965896660},{"type":"v1","addr":"172.21.15.55:6833","nonce":1965896660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-02T07:28:39.424 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 52 2024-04-02T07:28:39.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.423+0000 7faa43400640 1 -- 172.21.15.55:0/307851959 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faa1c066690 msgr2=0x7faa1c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:39.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.423+0000 7faa43400640 1 --2- 172.21.15.55:0/307851959 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faa1c066690 0x7faa1c068b50 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7faa3000a850 tx=0x7faa30008040 comp rx=0 tx=0).stop 2024-04-02T07:28:39.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.423+0000 7faa43400640 1 -- 172.21.15.55:0/307851959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa3c0ce520 msgr2=0x7faa3c0b3280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:39.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.423+0000 7faa43400640 1 --2- 172.21.15.55:0/307851959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa3c0ce520 0x7faa3c0b3280 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7faa2800d800 tx=0x7faa2800dcc0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.423+0000 7faa43400640 1 -- 172.21.15.55:0/307851959 shutdown_connections 2024-04-02T07:28:39.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.423+0000 7faa43400640 1 --2- 172.21.15.55:0/307851959 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faa1c066690 0x7faa1c068b50 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.423+0000 7faa43400640 1 --2- 172.21.15.55:0/307851959 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faa3c15aa60 0x7faa3c0b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.423+0000 7faa43400640 1 --2- 172.21.15.55:0/307851959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faa3c0ce520 0x7faa3c0b3280 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.423+0000 7faa43400640 1 --2- 172.21.15.55:0/307851959 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faa3c0cc520 0x7faa3c156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.423+0000 7faa43400640 1 -- 172.21.15.55:0/307851959 >> 172.21.15.55:0/307851959 conn(0x7faa3c0b2150 msgr2=0x7faa3c06e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:39.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.423+0000 7faa43400640 1 -- 172.21.15.55:0/307851959 shutdown_connections 2024-04-02T07:28:39.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.423+0000 7faa43400640 1 -- 172.21.15.55:0/307851959 wait complete. 2024-04-02T07:28:39.445 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:28:39.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.583+0000 7f714b200640 1 Processor -- start 2024-04-02T07:28:39.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.583+0000 7f714b200640 1 -- start start 2024-04-02T07:28:39.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.587+0000 7f714b200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71440b19d0 0x7f71440ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:39.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.587+0000 7f714b200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f714406c0d0 0x7f7144098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:39.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.587+0000 7f714b200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f71440cef10 0x7f7144098f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:39.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.587+0000 7f714b200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71440cf3d0 con 0x7f71440cef10 2024-04-02T07:28:39.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.587+0000 7f714b200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71440cf6b0 con 0x7f714406c0d0 2024-04-02T07:28:39.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.587+0000 7f714b200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71440cf990 con 0x7f71440b19d0 2024-04-02T07:28:39.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.587+0000 7f7149200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f71440cef10 0x7f7144098f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:39.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.587+0000 7f7149200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f71440cef10 0x7f7144098f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59392/0 (socket says 172.21.15.55:59392) 2024-04-02T07:28:39.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.587+0000 7f7149200640 1 -- 172.21.15.55:0/2220943024 learned_addr learned my addr 172.21.15.55:0/2220943024 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:39.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.587+0000 7f713be00640 1 --2- 172.21.15.55:0/2220943024 >> v2:172.21.15.106:3300/0 conn(0x7f714406c0d0 0x7f7144098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:39.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.587+0000 7f7143e00640 1 --2- 172.21.15.55:0/2220943024 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71440b19d0 0x7f71440ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:39.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.587+0000 7f7149200640 1 -- 172.21.15.55:0/2220943024 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71440b19d0 msgr2=0x7f71440ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:39.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.587+0000 7f7149200640 1 --2- 172.21.15.55:0/2220943024 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71440b19d0 0x7f71440ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.587+0000 7f7149200640 1 -- 172.21.15.55:0/2220943024 >> v2:172.21.15.106:3300/0 conn(0x7f714406c0d0 msgr2=0x7f7144098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:39.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.587+0000 7f7149200640 1 --2- 172.21.15.55:0/2220943024 >> v2:172.21.15.106:3300/0 conn(0x7f714406c0d0 0x7f7144098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.587+0000 7f7149200640 1 -- 172.21.15.55:0/2220943024 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71440cfc70 con 0x7f71440cef10 2024-04-02T07:28:39.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.591+0000 7f7149200640 1 --2- 172.21.15.55:0/2220943024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71440cef10 0x7f7144098f50 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f71440719b0 tx=0x7f713c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca0421b882b03b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:39.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.591+0000 7f7143400640 1 -- 172.21.15.55:0/2220943024 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c0a5780 con 0x7f71440cef10 2024-04-02T07:28:39.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.591+0000 7f7143400640 1 -- 172.21.15.55:0/2220943024 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713c0a58e0 con 0x7f71440cef10 2024-04-02T07:28:39.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.591+0000 7f7143400640 1 -- 172.21.15.55:0/2220943024 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c0a5c70 con 0x7f71440cef10 2024-04-02T07:28:39.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.591+0000 7f714b200640 1 -- 172.21.15.55:0/2220943024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71440cef10 msgr2=0x7f7144098f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:39.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.591+0000 7f714b200640 1 --2- 172.21.15.55:0/2220943024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71440cef10 0x7f7144098f50 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f71440719b0 tx=0x7f713c01c9f0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.591+0000 7f714b200640 1 -- 172.21.15.55:0/2220943024 shutdown_connections 2024-04-02T07:28:39.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.591+0000 7f714b200640 1 --2- 172.21.15.55:0/2220943024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71440cef10 0x7f7144098f50 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.591+0000 7f714b200640 1 --2- 172.21.15.55:0/2220943024 >> v2:172.21.15.106:3300/0 conn(0x7f714406c0d0 0x7f7144098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.591+0000 7f714b200640 1 --2- 172.21.15.55:0/2220943024 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71440b19d0 0x7f71440ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.591+0000 7f714b200640 1 -- 172.21.15.55:0/2220943024 >> 172.21.15.55:0/2220943024 conn(0x7f71440b2150 msgr2=0x7f71440b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:39.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.591+0000 7f714b200640 1 -- 172.21.15.55:0/2220943024 shutdown_connections 2024-04-02T07:28:39.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.591+0000 7f714b200640 1 -- 172.21.15.55:0/2220943024 wait complete. 2024-04-02T07:28:39.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.591+0000 7f714b200640 1 Processor -- start 2024-04-02T07:28:39.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.591+0000 7f714b200640 1 -- start start 2024-04-02T07:28:39.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f714b200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f714406c0d0 0x7f714415f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:39.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f714b200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71440b19d0 0x7f71441f88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:39.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f714b200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71440cef10 0x7f71441f8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:39.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f714b200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71440b5450 con 0x7f71440cef10 2024-04-02T07:28:39.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f714b200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7144151e50 con 0x7f714406c0d0 2024-04-02T07:28:39.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f714b200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71440b56a0 con 0x7f71440b19d0 2024-04-02T07:28:39.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f7149200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71440cef10 0x7f71441f8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:39.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f7149200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71440cef10 0x7f71441f8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59404/0 (socket says 172.21.15.55:59404) 2024-04-02T07:28:39.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f7149200640 1 -- 172.21.15.55:0/4159878043 learned_addr learned my addr 172.21.15.55:0/4159878043 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:39.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f713be00640 1 --2- 172.21.15.55:0/4159878043 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71440b19d0 0x7f71441f88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:39.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f7143e00640 1 --2- 172.21.15.55:0/4159878043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f714406c0d0 0x7f714415f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:39.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f7149200640 1 -- 172.21.15.55:0/4159878043 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71440b19d0 msgr2=0x7f71441f88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:39.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f7149200640 1 --2- 172.21.15.55:0/4159878043 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71440b19d0 0x7f71441f88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f7149200640 1 -- 172.21.15.55:0/4159878043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f714406c0d0 msgr2=0x7f714415f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:39.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f7149200640 1 --2- 172.21.15.55:0/4159878043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f714406c0d0 0x7f714415f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f7149200640 1 -- 172.21.15.55:0/4159878043 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c009b30 con 0x7f71440cef10 2024-04-02T07:28:39.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f7149200640 1 --2- 172.21.15.55:0/4159878043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71440cef10 0x7f71441f8e30 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f713c01d290 tx=0x7f713c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:39.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f7140c00640 1 -- 172.21.15.55:0/4159878043 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c0b8670 con 0x7f71440cef10 2024-04-02T07:28:39.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f7140c00640 1 -- 172.21.15.55:0/4159878043 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713c0b87d0 con 0x7f71440cef10 2024-04-02T07:28:39.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f7140c00640 1 -- 172.21.15.55:0/4159878043 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c0b8b80 con 0x7f71440cef10 2024-04-02T07:28:39.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f714b200640 1 -- 172.21.15.55:0/4159878043 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71440b5980 con 0x7f71440cef10 2024-04-02T07:28:39.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f714b200640 1 -- 172.21.15.55:0/4159878043 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714415e6d0 con 0x7f71440cef10 2024-04-02T07:28:39.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f714b200640 1 -- 172.21.15.55:0/4159878043 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714415e8c0 con 0x7f71440cef10 2024-04-02T07:28:39.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.595+0000 7f7140c00640 1 -- 172.21.15.55:0/4159878043 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f713c0b8ce0 con 0x7f71440cef10 2024-04-02T07:28:39.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.599+0000 7f7140c00640 1 --2- 172.21.15.55:0/4159878043 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7120066690 0x7f7120068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:39.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.599+0000 7f7140c00640 1 -- 172.21.15.55:0/4159878043 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f713c11f880 con 0x7f71440cef10 2024-04-02T07:28:39.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.599+0000 7f7143e00640 1 --2- 172.21.15.55:0/4159878043 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7120066690 0x7f7120068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:39.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.599+0000 7f7143e00640 1 --2- 172.21.15.55:0/4159878043 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7120066690 0x7f7120068b50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7134009af0 tx=0x7f7134008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:39.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.603+0000 7f7140c00640 1 -- 172.21.15.55:0/4159878043 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f713c0ecca0 con 0x7f71440cef10 2024-04-02T07:28:39.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.767+0000 7f714b200640 1 -- 172.21.15.55:0/4159878043 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f714415e8c0 con 0x7f71440cef10 2024-04-02T07:28:39.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.767+0000 7f7140c00640 1 -- 172.21.15.55:0/4159878043 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16327 (secure 0 0 0) 0x7f713c009510 con 0x7f71440cef10 2024-04-02T07:28:39.768 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:39.768 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":75,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:27:14.356458+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:26:53.196912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-02T07:26:54.514963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.2e","mappings":[{"from":6,"to":0}]},{"pgid":"11.3c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6833/1576619269":"2024-04-03T07:27:14.356430+0000","172.21.15.55:6832/1576619269":"2024-04-03T07:27:14.356430+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:28:39.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.767+0000 7f714b200640 1 -- 172.21.15.55:0/4159878043 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7120066690 msgr2=0x7f7120068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:39.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.767+0000 7f714b200640 1 --2- 172.21.15.55:0/4159878043 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7120066690 0x7f7120068b50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7134009af0 tx=0x7f7134008040 comp rx=0 tx=0).stop 2024-04-02T07:28:39.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.767+0000 7f714b200640 1 -- 172.21.15.55:0/4159878043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71440cef10 msgr2=0x7f71441f8e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:39.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.767+0000 7f714b200640 1 --2- 172.21.15.55:0/4159878043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71440cef10 0x7f71441f8e30 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f713c01d290 tx=0x7f713c019790 comp rx=0 tx=0).stop 2024-04-02T07:28:39.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.767+0000 7f714b200640 1 -- 172.21.15.55:0/4159878043 shutdown_connections 2024-04-02T07:28:39.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.767+0000 7f714b200640 1 --2- 172.21.15.55:0/4159878043 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71440cef10 0x7f71441f8e30 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.767+0000 7f714b200640 1 --2- 172.21.15.55:0/4159878043 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71440b19d0 0x7f71441f88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.767+0000 7f714b200640 1 --2- 172.21.15.55:0/4159878043 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7120066690 0x7f7120068b50 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.767+0000 7f714b200640 1 --2- 172.21.15.55:0/4159878043 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f714406c0d0 0x7f714415f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.767+0000 7f714b200640 1 -- 172.21.15.55:0/4159878043 >> 172.21.15.55:0/4159878043 conn(0x7f71440b2150 msgr2=0x7f7144157fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:39.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.767+0000 7f714b200640 1 -- 172.21.15.55:0/4159878043 shutdown_connections 2024-04-02T07:28:39.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.767+0000 7f714b200640 1 -- 172.21.15.55:0/4159878043 wait complete. 2024-04-02T07:28:39.791 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:26:53.196912+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '71', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:26:54.514963+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:28:39.792 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:28:39.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.935+0000 7efe3f600640 1 Processor -- start 2024-04-02T07:28:39.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.935+0000 7efe3f600640 1 -- start start 2024-04-02T07:28:39.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.935+0000 7efe3f600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe38144260 0x7efe380702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:39.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.935+0000 7efe3f600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe380707e0 0x7efe380b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:39.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.935+0000 7efe3f600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe3815e3a0 con 0x7efe380b2fd0 2024-04-02T07:28:39.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.935+0000 7efe3f600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe380b37c0 con 0x7efe380707e0 2024-04-02T07:28:39.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.935+0000 7efe3f600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe38070c60 con 0x7efe38144260 2024-04-02T07:28:39.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.935+0000 7efe2fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe380707e0 0x7efe380b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:39.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.935+0000 7efe2fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efe380707e0 0x7efe380b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59410/0 (socket says 172.21.15.55:59410) 2024-04-02T07:28:39.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.935+0000 7efe2fe00640 1 -- 172.21.15.55:0/1241659674 learned_addr learned my addr 172.21.15.55:0/1241659674 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:39.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.935+0000 7efe3cc00640 1 --2- 172.21.15.55:0/1241659674 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe38144260 0x7efe380702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:39.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.935+0000 7efe2fe00640 1 -- 172.21.15.55:0/1241659674 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe38144260 msgr2=0x7efe380702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:39.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.935+0000 7efe2fe00640 1 --2- 172.21.15.55:0/1241659674 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe38144260 0x7efe380702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.935+0000 7efe2fe00640 1 -- 172.21.15.55:0/1241659674 >> v1:172.21.15.106:6789/0 conn(0x7efe380b2fd0 legacy=0x7efe380cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:39.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.939+0000 7efe2fe00640 1 -- 172.21.15.55:0/1241659674 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe3815e5f0 con 0x7efe380707e0 2024-04-02T07:28:39.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.939+0000 7efe3cc00640 1 --2- 172.21.15.55:0/1241659674 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe38144260 0x7efe380702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:28:39.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.939+0000 7efe2fe00640 1 --2- 172.21.15.55:0/1241659674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe380707e0 0x7efe380b2a90 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7efe20009870 tx=0x7efe2001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdcb07c6c1ade465 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:39.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.939+0000 7efe37e00640 1 -- 172.21.15.55:0/1241659674 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe200ab600 con 0x7efe380707e0 2024-04-02T07:28:39.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.939+0000 7efe37e00640 1 -- 172.21.15.55:0/1241659674 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe200a7050 con 0x7efe380707e0 2024-04-02T07:28:39.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.939+0000 7efe37e00640 1 -- 172.21.15.55:0/1241659674 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe200ab980 con 0x7efe380707e0 2024-04-02T07:28:39.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.939+0000 7efe3f600640 1 -- 172.21.15.55:0/1241659674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe380707e0 msgr2=0x7efe380b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:39.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.939+0000 7efe3f600640 1 --2- 172.21.15.55:0/1241659674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe380707e0 0x7efe380b2a90 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7efe20009870 tx=0x7efe2001c520 comp rx=0 tx=0).stop 2024-04-02T07:28:39.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.939+0000 7efe3f600640 1 -- 172.21.15.55:0/1241659674 shutdown_connections 2024-04-02T07:28:39.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.939+0000 7efe3f600640 1 --2- 172.21.15.55:0/1241659674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe380707e0 0x7efe380b2a90 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.939+0000 7efe3f600640 1 --2- 172.21.15.55:0/1241659674 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe38144260 0x7efe380702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.939+0000 7efe3f600640 1 -- 172.21.15.55:0/1241659674 >> 172.21.15.55:0/1241659674 conn(0x7efe3806a390 msgr2=0x7efe380b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:39.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.939+0000 7efe3f600640 1 -- 172.21.15.55:0/1241659674 shutdown_connections 2024-04-02T07:28:39.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.939+0000 7efe3f600640 1 -- 172.21.15.55:0/1241659674 wait complete. 2024-04-02T07:28:39.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe3f600640 1 Processor -- start 2024-04-02T07:28:39.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe3f600640 1 -- start start 2024-04-02T07:28:39.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe3f600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe380707e0 0x7efe38135270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:39.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe3f600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe380b2fd0 0x7efe38138290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:39.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe3f600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe38144260 0x7efe3815af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:39.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe3f600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe38135850 con 0x7efe38144260 2024-04-02T07:28:39.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe3f600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe38135b30 con 0x7efe380707e0 2024-04-02T07:28:39.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe3f600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe38135e10 con 0x7efe380b2fd0 2024-04-02T07:28:39.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe3d600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe38144260 0x7efe3815af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:39.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe3d600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe38144260 0x7efe3815af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59416/0 (socket says 172.21.15.55:59416) 2024-04-02T07:28:39.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe3d600640 1 -- 172.21.15.55:0/1589379861 learned_addr learned my addr 172.21.15.55:0/1589379861 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:39.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe3cc00640 1 --2- 172.21.15.55:0/1589379861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe380707e0 0x7efe38135270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:39.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe2fe00640 1 --2- 172.21.15.55:0/1589379861 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe380b2fd0 0x7efe38138290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:39.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe3d600640 1 -- 172.21.15.55:0/1589379861 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe380b2fd0 msgr2=0x7efe38138290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:39.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe3d600640 1 --2- 172.21.15.55:0/1589379861 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe380b2fd0 0x7efe38138290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe3d600640 1 -- 172.21.15.55:0/1589379861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe380707e0 msgr2=0x7efe38135270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:39.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe3d600640 1 --2- 172.21.15.55:0/1589379861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe380707e0 0x7efe38135270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:39.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe3d600640 1 -- 172.21.15.55:0/1589379861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe200094d0 con 0x7efe38144260 2024-04-02T07:28:39.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe3cc00640 1 --2- 172.21.15.55:0/1589379861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe380707e0 0x7efe38135270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:28:39.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe3d600640 1 --2- 172.21.15.55:0/1589379861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe38144260 0x7efe3815af80 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7efe3000c780 tx=0x7efe3000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:39.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe35600640 1 -- 172.21.15.55:0/1589379861 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe30004b70 con 0x7efe38144260 2024-04-02T07:28:39.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe35600640 1 -- 172.21.15.55:0/1589379861 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe3000ce90 con 0x7efe38144260 2024-04-02T07:28:39.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe3f600640 1 -- 172.21.15.55:0/1589379861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe381360f0 con 0x7efe38144260 2024-04-02T07:28:39.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.943+0000 7efe35600640 1 -- 172.21.15.55:0/1589379861 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe3000a7f0 con 0x7efe38144260 2024-04-02T07:28:39.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.947+0000 7efe3f600640 1 -- 172.21.15.55:0/1589379861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe3815b4c0 con 0x7efe38144260 2024-04-02T07:28:39.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.947+0000 7efe3f600640 1 -- 172.21.15.55:0/1589379861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe38073530 con 0x7efe38144260 2024-04-02T07:28:39.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.947+0000 7efe35600640 1 -- 172.21.15.55:0/1589379861 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7efe3000a950 con 0x7efe38144260 2024-04-02T07:28:39.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.947+0000 7efe35600640 1 --2- 172.21.15.55:0/1589379861 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efe14066690 0x7efe14068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:39.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.947+0000 7efe35600640 1 -- 172.21.15.55:0/1589379861 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7efe30084230 con 0x7efe38144260 2024-04-02T07:28:39.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.947+0000 7efe3cc00640 1 --2- 172.21.15.55:0/1589379861 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efe14066690 0x7efe14068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:39.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.947+0000 7efe3cc00640 1 --2- 172.21.15.55:0/1589379861 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efe14066690 0x7efe14068b50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7efe28006fd0 tx=0x7efe28008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:39.953 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:39.951+0000 7efe35600640 1 -- 172.21.15.55:0/1589379861 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7efe300515b0 con 0x7efe38144260 2024-04-02T07:28:40.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.115+0000 7efe3f600640 1 -- 172.21.15.55:0/1589379861 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7efe38066c90 con 0x7efe38144260 2024-04-02T07:28:40.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.115+0000 7efe35600640 1 -- 172.21.15.55:0/1589379861 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) v1 ==== 93+0+10 (secure 0 0 0) 0x7efe30054bd0 con 0x7efe38144260 2024-04-02T07:28:40.119 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:28:40.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.119+0000 7efe3f600640 1 -- 172.21.15.55:0/1589379861 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efe14066690 msgr2=0x7efe14068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:40.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.119+0000 7efe3f600640 1 --2- 172.21.15.55:0/1589379861 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efe14066690 0x7efe14068b50 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7efe28006fd0 tx=0x7efe28008040 comp rx=0 tx=0).stop 2024-04-02T07:28:40.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.119+0000 7efe3f600640 1 -- 172.21.15.55:0/1589379861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe38144260 msgr2=0x7efe3815af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:40.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.119+0000 7efe3f600640 1 --2- 172.21.15.55:0/1589379861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe38144260 0x7efe3815af80 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7efe3000c780 tx=0x7efe3000cc40 comp rx=0 tx=0).stop 2024-04-02T07:28:40.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.119+0000 7efe3f600640 1 -- 172.21.15.55:0/1589379861 shutdown_connections 2024-04-02T07:28:40.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.119+0000 7efe3f600640 1 --2- 172.21.15.55:0/1589379861 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe38144260 0x7efe3815af80 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.119+0000 7efe3f600640 1 --2- 172.21.15.55:0/1589379861 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efe380b2fd0 0x7efe38138290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.119+0000 7efe3f600640 1 --2- 172.21.15.55:0/1589379861 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efe14066690 0x7efe14068b50 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.119+0000 7efe3f600640 1 --2- 172.21.15.55:0/1589379861 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efe380707e0 0x7efe38135270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.119+0000 7efe3f600640 1 -- 172.21.15.55:0/1589379861 >> 172.21.15.55:0/1589379861 conn(0x7efe3806a390 msgr2=0x7efe3813e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:40.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.119+0000 7efe3f600640 1 -- 172.21.15.55:0/1589379861 shutdown_connections 2024-04-02T07:28:40.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.119+0000 7efe3f600640 1 -- 172.21.15.55:0/1589379861 wait complete. 2024-04-02T07:28:40.140 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:28:40.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.283+0000 7fcb67800640 1 Processor -- start 2024-04-02T07:28:40.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.283+0000 7fcb67800640 1 -- start start 2024-04-02T07:28:40.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.283+0000 7fcb67800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcb60157000 0x7fcb60071a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:40.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.283+0000 7fcb67800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb60071f60 0x7fcb60069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:40.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.283+0000 7fcb67800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb6015de90 con 0x7fcb6006a2d0 2024-04-02T07:28:40.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.283+0000 7fcb67800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb6015d070 con 0x7fcb60071f60 2024-04-02T07:28:40.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.283+0000 7fcb67800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb600723e0 con 0x7fcb60157000 2024-04-02T07:28:40.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.283+0000 7fcb5fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb60071f60 0x7fcb60069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:40.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.283+0000 7fcb65800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcb6006a2d0 0x7fcb600cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37146/0 (socket says 172.21.15.55:37146) 2024-04-02T07:28:40.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.283+0000 7fcb65800640 1 -- 172.21.15.55:0/453645946 learned_addr learned my addr 172.21.15.55:0/453645946 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:40.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.283+0000 7fcb64e00640 1 --2- 172.21.15.55:0/453645946 >> v2:172.21.15.106:3300/0 conn(0x7fcb60157000 0x7fcb60071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:40.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.283+0000 7fcb5fe00640 1 -- 172.21.15.55:0/453645946 >> v2:172.21.15.106:3300/0 conn(0x7fcb60157000 msgr2=0x7fcb60071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:40.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.283+0000 7fcb5fe00640 1 --2- 172.21.15.55:0/453645946 >> v2:172.21.15.106:3300/0 conn(0x7fcb60157000 0x7fcb60071a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.283+0000 7fcb5fe00640 1 -- 172.21.15.55:0/453645946 >> v1:172.21.15.55:6789/0 conn(0x7fcb6006a2d0 legacy=0x7fcb600cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:40.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.283+0000 7fcb5fe00640 1 -- 172.21.15.55:0/453645946 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb6015d280 con 0x7fcb60071f60 2024-04-02T07:28:40.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.283+0000 7fcb5f400640 1 -- 172.21.15.55:0/453645946 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 31565051 0 0) 0x7fcb6015de90 con 0x7fcb6006a2d0 2024-04-02T07:28:40.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.287+0000 7fcb5fe00640 1 --2- 172.21.15.55:0/453645946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb60071f60 0x7fcb60069d90 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fcb6006c770 tx=0x7fcb4c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11e94bc78f37524 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:40.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.287+0000 7fcb5f400640 1 -- 172.21.15.55:0/453645946 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c0ab600 con 0x7fcb60071f60 2024-04-02T07:28:40.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.287+0000 7fcb5f400640 1 -- 172.21.15.55:0/453645946 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c0a7050 con 0x7fcb60071f60 2024-04-02T07:28:40.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.287+0000 7fcb5f400640 1 -- 172.21.15.55:0/453645946 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c0ab980 con 0x7fcb60071f60 2024-04-02T07:28:40.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.287+0000 7fcb67800640 1 -- 172.21.15.55:0/453645946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb60071f60 msgr2=0x7fcb60069d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:40.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.287+0000 7fcb67800640 1 --2- 172.21.15.55:0/453645946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb60071f60 0x7fcb60069d90 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fcb6006c770 tx=0x7fcb4c01c450 comp rx=0 tx=0).stop 2024-04-02T07:28:40.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.287+0000 7fcb67800640 1 -- 172.21.15.55:0/453645946 shutdown_connections 2024-04-02T07:28:40.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.287+0000 7fcb67800640 1 --2- 172.21.15.55:0/453645946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb60071f60 0x7fcb60069d90 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.287+0000 7fcb67800640 1 --2- 172.21.15.55:0/453645946 >> v2:172.21.15.106:3300/0 conn(0x7fcb60157000 0x7fcb60071a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.287+0000 7fcb67800640 1 -- 172.21.15.55:0/453645946 >> 172.21.15.55:0/453645946 conn(0x7fcb600b13b0 msgr2=0x7fcb600b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:40.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.287+0000 7fcb67800640 1 -- 172.21.15.55:0/453645946 shutdown_connections 2024-04-02T07:28:40.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.287+0000 7fcb67800640 1 -- 172.21.15.55:0/453645946 wait complete. 2024-04-02T07:28:40.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.287+0000 7fcb67800640 1 Processor -- start 2024-04-02T07:28:40.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.287+0000 7fcb67800640 1 -- start start 2024-04-02T07:28:40.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb67800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb6006a2d0 0x7fcb60141670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:40.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb67800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb60071f60 0x7fcb601532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:40.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb67800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcb60157000 0x7fcb6013eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:40.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb67800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb60141bb0 con 0x7fcb60071f60 2024-04-02T07:28:40.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb67800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb60155e30 con 0x7fcb6006a2d0 2024-04-02T07:28:40.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb67800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb60154680 con 0x7fcb60157000 2024-04-02T07:28:40.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb5fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb60071f60 0x7fcb601532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:40.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb5fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb60071f60 0x7fcb601532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59430/0 (socket says 172.21.15.55:59430) 2024-04-02T07:28:40.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb5fe00640 1 -- 172.21.15.55:0/2895056270 learned_addr learned my addr 172.21.15.55:0/2895056270 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:40.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb64e00640 1 --2- 172.21.15.55:0/2895056270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb6006a2d0 0x7fcb60141670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:40.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb65800640 1 --2- 172.21.15.55:0/2895056270 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcb60157000 0x7fcb6013eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:40.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb5fe00640 1 -- 172.21.15.55:0/2895056270 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcb60157000 msgr2=0x7fcb6013eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:40.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb5fe00640 1 --2- 172.21.15.55:0/2895056270 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcb60157000 0x7fcb6013eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb5fe00640 1 -- 172.21.15.55:0/2895056270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb6006a2d0 msgr2=0x7fcb60141670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:40.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb5fe00640 1 --2- 172.21.15.55:0/2895056270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb6006a2d0 0x7fcb60141670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb5fe00640 1 -- 172.21.15.55:0/2895056270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb4c009420 con 0x7fcb60071f60 2024-04-02T07:28:40.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb65800640 1 --2- 172.21.15.55:0/2895056270 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcb60157000 0x7fcb6013eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:40.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb64e00640 1 --2- 172.21.15.55:0/2895056270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb6006a2d0 0x7fcb60141670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:40.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb5fe00640 1 --2- 172.21.15.55:0/2895056270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb60071f60 0x7fcb601532e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c019060 tx=0x7fcb4c0191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:40.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb5cc00640 1 -- 172.21.15.55:0/2895056270 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c004230 con 0x7fcb60071f60 2024-04-02T07:28:40.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb5cc00640 1 -- 172.21.15.55:0/2895056270 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4c004390 con 0x7fcb60071f60 2024-04-02T07:28:40.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb67800640 1 -- 172.21.15.55:0/2895056270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb60154960 con 0x7fcb60071f60 2024-04-02T07:28:40.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb5cc00640 1 -- 172.21.15.55:0/2895056270 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4c003820 con 0x7fcb60071f60 2024-04-02T07:28:40.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb67800640 1 -- 172.21.15.55:0/2895056270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb60154f20 con 0x7fcb60071f60 2024-04-02T07:28:40.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.291+0000 7fcb67800640 1 -- 172.21.15.55:0/2895056270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb60066c90 con 0x7fcb60071f60 2024-04-02T07:28:40.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.295+0000 7fcb5cc00640 1 -- 172.21.15.55:0/2895056270 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fcb4c0b2040 con 0x7fcb60071f60 2024-04-02T07:28:40.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.295+0000 7fcb5cc00640 1 --2- 172.21.15.55:0/2895056270 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcb40066690 0x7fcb40068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:40.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.295+0000 7fcb5cc00640 1 -- 172.21.15.55:0/2895056270 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fcb4c11d8c0 con 0x7fcb60071f60 2024-04-02T07:28:40.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.295+0000 7fcb64e00640 1 --2- 172.21.15.55:0/2895056270 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcb40066690 0x7fcb40068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:40.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.295+0000 7fcb64e00640 1 --2- 172.21.15.55:0/2895056270 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcb40066690 0x7fcb40068b50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400b9f0 tx=0x7fcb54008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:40.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.299+0000 7fcb5cc00640 1 -- 172.21.15.55:0/2895056270 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fcb4c0eaba0 con 0x7fcb60071f60 2024-04-02T07:28:40.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.467+0000 7fcb67800640 1 -- 172.21.15.55:0/2895056270 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcb6006c470 con 0x7fcb60071f60 2024-04-02T07:28:40.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.467+0000 7fcb5cc00640 1 -- 172.21.15.55:0/2895056270 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v75) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcb4c0bc020 con 0x7fcb60071f60 2024-04-02T07:28:40.470 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:28:40.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.471+0000 7fcb67800640 1 -- 172.21.15.55:0/2895056270 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcb40066690 msgr2=0x7fcb40068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:40.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.471+0000 7fcb67800640 1 --2- 172.21.15.55:0/2895056270 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcb40066690 0x7fcb40068b50 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fcb5400b9f0 tx=0x7fcb54008040 comp rx=0 tx=0).stop 2024-04-02T07:28:40.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.471+0000 7fcb67800640 1 -- 172.21.15.55:0/2895056270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb60071f60 msgr2=0x7fcb601532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.471+0000 7fcb67800640 1 --2- 172.21.15.55:0/2895056270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb60071f60 0x7fcb601532e0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7fcb4c019060 tx=0x7fcb4c0191f0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.471+0000 7fcb67800640 1 -- 172.21.15.55:0/2895056270 shutdown_connections 2024-04-02T07:28:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.471+0000 7fcb67800640 1 --2- 172.21.15.55:0/2895056270 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcb60157000 0x7fcb6013eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.471+0000 7fcb67800640 1 --2- 172.21.15.55:0/2895056270 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb60071f60 0x7fcb601532e0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.471+0000 7fcb67800640 1 --2- 172.21.15.55:0/2895056270 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcb40066690 0x7fcb40068b50 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.471+0000 7fcb67800640 1 --2- 172.21.15.55:0/2895056270 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb6006a2d0 0x7fcb60141670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.471+0000 7fcb67800640 1 -- 172.21.15.55:0/2895056270 >> 172.21.15.55:0/2895056270 conn(0x7fcb600b13b0 msgr2=0x7fcb6015e540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.471+0000 7fcb67800640 1 -- 172.21.15.55:0/2895056270 shutdown_connections 2024-04-02T07:28:40.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.471+0000 7fcb67800640 1 -- 172.21.15.55:0/2895056270 wait complete. 2024-04-02T07:28:40.491 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:28:40.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.635+0000 7f60cfc00640 1 Processor -- start 2024-04-02T07:28:40.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.635+0000 7f60cfc00640 1 -- start start 2024-04-02T07:28:40.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.635+0000 7f60cfc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f60c80b3dc0 0x7f60c80ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:40.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.635+0000 7f60cfc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60c80ade90 0x7f60c806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:40.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.635+0000 7f60cfc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c806c630 con 0x7f60c80b41a0 2024-04-02T07:28:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.635+0000 7f60cfc00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c806c8f0 con 0x7f60c80ade90 2024-04-02T07:28:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.635+0000 7f60cfc00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60c806cbd0 con 0x7f60c80b3dc0 2024-04-02T07:28:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.635+0000 7f60bfe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60c80ade90 0x7f60c806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.635+0000 7f60bfe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f60c80ade90 0x7f60c806d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59440/0 (socket says 172.21.15.55:59440) 2024-04-02T07:28:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.635+0000 7f60bfe00640 1 -- 172.21.15.55:0/1745788139 learned_addr learned my addr 172.21.15.55:0/1745788139 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.635+0000 7f60cd200640 1 --2- 172.21.15.55:0/1745788139 >> v2:172.21.15.106:3300/0 conn(0x7f60c80b3dc0 0x7f60c80ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.635+0000 7f60bfe00640 1 -- 172.21.15.55:0/1745788139 >> v2:172.21.15.106:3300/0 conn(0x7f60c80b3dc0 msgr2=0x7f60c80ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.635+0000 7f60bfe00640 1 --2- 172.21.15.55:0/1745788139 >> v2:172.21.15.106:3300/0 conn(0x7f60c80b3dc0 0x7f60c80ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.635+0000 7f60bfe00640 1 -- 172.21.15.55:0/1745788139 >> v1:172.21.15.106:6789/0 conn(0x7f60c80b41a0 legacy=0x7f60c8142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:40.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.635+0000 7f60bfe00640 1 -- 172.21.15.55:0/1745788139 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c806ceb0 con 0x7f60c80ade90 2024-04-02T07:28:40.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.639+0000 7f60bfe00640 1 --2- 172.21.15.55:0/1745788139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60c80ade90 0x7f60c806d6b0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f60c806c820 tx=0x7f60b001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3a1c4f7b492aa6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:40.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.639+0000 7f60c7e00640 1 -- 172.21.15.55:0/1745788139 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b00a7c90 con 0x7f60c80ade90 2024-04-02T07:28:40.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.639+0000 7f60c7e00640 1 -- 172.21.15.55:0/1745788139 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b00a7df0 con 0x7f60c80ade90 2024-04-02T07:28:40.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.639+0000 7f60c7e00640 1 -- 172.21.15.55:0/1745788139 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b00af660 con 0x7f60c80ade90 2024-04-02T07:28:40.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.639+0000 7f60cfc00640 1 -- 172.21.15.55:0/1745788139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60c80ade90 msgr2=0x7f60c806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:40.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.639+0000 7f60cfc00640 1 --2- 172.21.15.55:0/1745788139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60c80ade90 0x7f60c806d6b0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f60c806c820 tx=0x7f60b001eba0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.639+0000 7f60cfc00640 1 -- 172.21.15.55:0/1745788139 shutdown_connections 2024-04-02T07:28:40.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.639+0000 7f60cfc00640 1 --2- 172.21.15.55:0/1745788139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60c80ade90 0x7f60c806d6b0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.639+0000 7f60cfc00640 1 --2- 172.21.15.55:0/1745788139 >> v2:172.21.15.106:3300/0 conn(0x7f60c80b3dc0 0x7f60c80ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.639+0000 7f60cfc00640 1 -- 172.21.15.55:0/1745788139 >> 172.21.15.55:0/1745788139 conn(0x7f60c806a390 msgr2=0x7f60c80b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:40.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.639+0000 7f60cfc00640 1 -- 172.21.15.55:0/1745788139 shutdown_connections 2024-04-02T07:28:40.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.639+0000 7f60cfc00640 1 -- 172.21.15.55:0/1745788139 wait complete. 2024-04-02T07:28:40.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.639+0000 7f60cfc00640 1 Processor -- start 2024-04-02T07:28:40.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.639+0000 7f60cfc00640 1 -- start start 2024-04-02T07:28:40.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60cfc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60c80ade90 0x7f60c8134010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:40.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60cfc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f60c80b3dc0 0x7f60c81363c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:40.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60cfc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60c80b41a0 0x7f60c8138c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:40.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60cfc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c8135fa0 con 0x7f60c80ade90 2024-04-02T07:28:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60cfc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c8135110 con 0x7f60c80b41a0 2024-04-02T07:28:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60cfc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c8135320 con 0x7f60c80b3dc0 2024-04-02T07:28:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60cd200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60c80ade90 0x7f60c8134010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60cd200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60c80ade90 0x7f60c8134010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59450/0 (socket says 172.21.15.55:59450) 2024-04-02T07:28:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60cd200640 1 -- 172.21.15.55:0/1593758883 learned_addr learned my addr 172.21.15.55:0/1593758883 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60cd200640 1 -- 172.21.15.55:0/1593758883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f60c80b3dc0 msgr2=0x7f60c81363c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60cd200640 1 --2- 172.21.15.55:0/1593758883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f60c80b3dc0 0x7f60c81363c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60cd200640 1 -- 172.21.15.55:0/1593758883 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60c80b41a0 msgr2=0x7f60c8138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60cd200640 1 --2- 172.21.15.55:0/1593758883 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60c80b41a0 0x7f60c8138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60cd200640 1 -- 172.21.15.55:0/1593758883 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b000b770 con 0x7f60c80ade90 2024-04-02T07:28:40.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60cd200640 1 --2- 172.21.15.55:0/1593758883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60c80ade90 0x7f60c8134010 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f60b800e9b0 tx=0x7f60b800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:40.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60c5600640 1 -- 172.21.15.55:0/1593758883 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b800c9a0 con 0x7f60c80ade90 2024-04-02T07:28:40.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60c5600640 1 -- 172.21.15.55:0/1593758883 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60b800cb00 con 0x7f60c80ade90 2024-04-02T07:28:40.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60c5600640 1 -- 172.21.15.55:0/1593758883 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60b800ce90 con 0x7f60c80ade90 2024-04-02T07:28:40.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60cfc00640 1 -- 172.21.15.55:0/1593758883 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c806de00 con 0x7f60c80ade90 2024-04-02T07:28:40.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60cfc00640 1 -- 172.21.15.55:0/1593758883 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c81358e0 con 0x7f60c80ade90 2024-04-02T07:28:40.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60cfc00640 1 -- 172.21.15.55:0/1593758883 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c8136900 con 0x7f60c80ade90 2024-04-02T07:28:40.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.643+0000 7f60c5600640 1 -- 172.21.15.55:0/1593758883 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f60b8013470 con 0x7f60c80ade90 2024-04-02T07:28:40.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.647+0000 7f60c5600640 1 --2- 172.21.15.55:0/1593758883 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f60a40666c0 0x7f60a4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:40.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.647+0000 7f60c5600640 1 -- 172.21.15.55:0/1593758883 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f60b80847a0 con 0x7f60c80ade90 2024-04-02T07:28:40.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.647+0000 7f60bfe00640 1 --2- 172.21.15.55:0/1593758883 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f60a40666c0 0x7f60a4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:40.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.647+0000 7f60bfe00640 1 --2- 172.21.15.55:0/1593758883 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f60a40666c0 0x7f60a4068b80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f60b00b1000 tx=0x7f60b0004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:40.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.651+0000 7f60c5600640 1 -- 172.21.15.55:0/1593758883 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f60b8051a70 con 0x7f60c80ade90 2024-04-02T07:28:40.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.811+0000 7f60cfc00640 1 -- 172.21.15.55:0/1593758883 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f60c80b2b70 con 0x7f60c80ade90 2024-04-02T07:28:40.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.811+0000 7f60c5600640 1 -- 172.21.15.55:0/1593758883 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v75) v1 ==== 100+0+11 (secure 0 0 0) 0x7f60b8055090 con 0x7f60c80ade90 2024-04-02T07:28:40.816 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:28:40.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.815+0000 7f60cfc00640 1 -- 172.21.15.55:0/1593758883 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f60a40666c0 msgr2=0x7f60a4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:40.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.815+0000 7f60cfc00640 1 --2- 172.21.15.55:0/1593758883 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f60a40666c0 0x7f60a4068b80 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f60b00b1000 tx=0x7f60b0004740 comp rx=0 tx=0).stop 2024-04-02T07:28:40.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.815+0000 7f60cfc00640 1 -- 172.21.15.55:0/1593758883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60c80ade90 msgr2=0x7f60c8134010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:40.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.815+0000 7f60cfc00640 1 --2- 172.21.15.55:0/1593758883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60c80ade90 0x7f60c8134010 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f60b800e9b0 tx=0x7f60b800ee70 comp rx=0 tx=0).stop 2024-04-02T07:28:40.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.815+0000 7f60cfc00640 1 -- 172.21.15.55:0/1593758883 shutdown_connections 2024-04-02T07:28:40.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.815+0000 7f60cfc00640 1 --2- 172.21.15.55:0/1593758883 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f60a40666c0 0x7f60a4068b80 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.815+0000 7f60cfc00640 1 --2- 172.21.15.55:0/1593758883 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f60c80b41a0 0x7f60c8138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.815+0000 7f60cfc00640 1 --2- 172.21.15.55:0/1593758883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f60c80b3dc0 0x7f60c81363c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.815+0000 7f60cfc00640 1 --2- 172.21.15.55:0/1593758883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60c80ade90 0x7f60c8134010 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.815+0000 7f60cfc00640 1 -- 172.21.15.55:0/1593758883 >> 172.21.15.55:0/1593758883 conn(0x7f60c806a390 msgr2=0x7f60c815d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:40.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.815+0000 7f60cfc00640 1 -- 172.21.15.55:0/1593758883 shutdown_connections 2024-04-02T07:28:40.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.815+0000 7f60cfc00640 1 -- 172.21.15.55:0/1593758883 wait complete. 2024-04-02T07:28:40.835 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:28:40.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.975+0000 7f2754400640 1 Processor -- start 2024-04-02T07:28:40.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.975+0000 7f2754400640 1 -- start start 2024-04-02T07:28:40.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.975+0000 7f2754400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f274c15ce80 0x7f274c161370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:40.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.975+0000 7f2754400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f274c0d18f0 0x7f274c06b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:40.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.975+0000 7f2754400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274c06bc60 con 0x7f274c06b2c0 2024-04-02T07:28:40.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.975+0000 7f2754400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274c0cd990 con 0x7f274c15ce80 2024-04-02T07:28:40.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.975+0000 7f2754400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c0cdc30 con 0x7f274c0d18f0 2024-04-02T07:28:40.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.975+0000 7f2751a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f274c15ce80 0x7f274c161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:40.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.975+0000 7f2751a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f274c15ce80 0x7f274c161370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59458/0 (socket says 172.21.15.55:59458) 2024-04-02T07:28:40.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.975+0000 7f2751a00640 1 -- 172.21.15.55:0/201639543 learned_addr learned my addr 172.21.15.55:0/201639543 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:40.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.975+0000 7f2751000640 1 --1- 172.21.15.55:0/201639543 >> v1:172.21.15.55:6789/0 conn(0x7f274c06b2c0 0x7f274c15d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37158/0 (socket says 172.21.15.55:37158) 2024-04-02T07:28:40.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.975+0000 7f2752400640 1 --2- 172.21.15.55:0/201639543 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f274c0d18f0 0x7f274c06b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:40.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.975+0000 7f2751a00640 1 -- 172.21.15.55:0/201639543 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f274c0d18f0 msgr2=0x7f274c06b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:40.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.975+0000 7f2751a00640 1 --2- 172.21.15.55:0/201639543 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f274c0d18f0 0x7f274c06b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.975+0000 7f2751a00640 1 -- 172.21.15.55:0/201639543 >> v1:172.21.15.55:6789/0 conn(0x7f274c06b2c0 legacy=0x7f274c15d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:40.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.975+0000 7f274be00640 1 -- 172.21.15.55:0/201639543 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3177436634 0 0) 0x7f274c06bc60 con 0x7f274c06b2c0 2024-04-02T07:28:40.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.975+0000 7f2751a00640 1 -- 172.21.15.55:0/201639543 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c0cdf10 con 0x7f274c15ce80 2024-04-02T07:28:40.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.979+0000 7f2751a00640 1 --2- 172.21.15.55:0/201639543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f274c15ce80 0x7f274c161370 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f2740009870 tx=0x7f274001c2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad821739b9ad461 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:40.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.979+0000 7f274be00640 1 -- 172.21.15.55:0/201639543 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27400ab600 con 0x7f274c15ce80 2024-04-02T07:28:40.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.979+0000 7f274be00640 1 -- 172.21.15.55:0/201639543 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27400a7050 con 0x7f274c15ce80 2024-04-02T07:28:40.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.979+0000 7f274be00640 1 -- 172.21.15.55:0/201639543 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27400ab980 con 0x7f274c15ce80 2024-04-02T07:28:40.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.979+0000 7f2754400640 1 -- 172.21.15.55:0/201639543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f274c15ce80 msgr2=0x7f274c161370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:40.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.979+0000 7f2754400640 1 --2- 172.21.15.55:0/201639543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f274c15ce80 0x7f274c161370 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f2740009870 tx=0x7f274001c2a0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.979+0000 7f2754400640 1 -- 172.21.15.55:0/201639543 shutdown_connections 2024-04-02T07:28:40.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.979+0000 7f2754400640 1 --2- 172.21.15.55:0/201639543 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f274c0d18f0 0x7f274c06b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.979+0000 7f2754400640 1 --2- 172.21.15.55:0/201639543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f274c15ce80 0x7f274c161370 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.979+0000 7f2754400640 1 -- 172.21.15.55:0/201639543 >> 172.21.15.55:0/201639543 conn(0x7f274c0cf440 msgr2=0x7f274c0cf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:40.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.979+0000 7f2754400640 1 -- 172.21.15.55:0/201639543 shutdown_connections 2024-04-02T07:28:40.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.979+0000 7f2754400640 1 -- 172.21.15.55:0/201639543 wait complete. 2024-04-02T07:28:40.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.979+0000 7f2754400640 1 Processor -- start 2024-04-02T07:28:40.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2754400640 1 -- start start 2024-04-02T07:28:40.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2754400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f274c06b2c0 0x7f274c15adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:40.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2754400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f274c0d18f0 0x7f274c0ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:40.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2754400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f274c15ce80 0x7f274c155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:40.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2754400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c1579a0 con 0x7f274c0d18f0 2024-04-02T07:28:40.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2754400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274c15b4f0 con 0x7f274c15ce80 2024-04-02T07:28:40.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2754400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f274c15b7d0 con 0x7f274c06b2c0 2024-04-02T07:28:40.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2751000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f274c0d18f0 0x7f274c0ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:40.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2751000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f274c0d18f0 0x7f274c0ccd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59462/0 (socket says 172.21.15.55:59462) 2024-04-02T07:28:40.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2751000640 1 -- 172.21.15.55:0/2791129675 learned_addr learned my addr 172.21.15.55:0/2791129675 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:40.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2751a00640 1 --2- 172.21.15.55:0/2791129675 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f274c06b2c0 0x7f274c15adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:40.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2752400640 1 --2- 172.21.15.55:0/2791129675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f274c15ce80 0x7f274c155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:40.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2751000640 1 -- 172.21.15.55:0/2791129675 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f274c06b2c0 msgr2=0x7f274c15adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:40.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2751000640 1 --2- 172.21.15.55:0/2791129675 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f274c06b2c0 0x7f274c15adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2751000640 1 -- 172.21.15.55:0/2791129675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f274c15ce80 msgr2=0x7f274c155ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:40.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2751000640 1 --2- 172.21.15.55:0/2791129675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f274c15ce80 0x7f274c155ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:40.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2751000640 1 -- 172.21.15.55:0/2791129675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27400094d0 con 0x7f274c0d18f0 2024-04-02T07:28:40.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2751000640 1 --2- 172.21.15.55:0/2791129675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f274c0d18f0 0x7f274c0ccd20 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f27380011f0 tx=0x7f273800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:40.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2749600640 1 -- 172.21.15.55:0/2791129675 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27380074e0 con 0x7f274c0d18f0 2024-04-02T07:28:40.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2749600640 1 -- 172.21.15.55:0/2791129675 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2738007640 con 0x7f274c0d18f0 2024-04-02T07:28:40.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2749600640 1 -- 172.21.15.55:0/2791129675 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2738004a10 con 0x7f274c0d18f0 2024-04-02T07:28:40.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2754400640 1 -- 172.21.15.55:0/2791129675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f274c15bab0 con 0x7f274c0d18f0 2024-04-02T07:28:40.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2754400640 1 -- 172.21.15.55:0/2791129675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f274c156430 con 0x7f274c0d18f0 2024-04-02T07:28:40.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.983+0000 7f2754400640 1 -- 172.21.15.55:0/2791129675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f274c072410 con 0x7f274c0d18f0 2024-04-02T07:28:40.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.987+0000 7f2749600640 1 -- 172.21.15.55:0/2791129675 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2738004b70 con 0x7f274c0d18f0 2024-04-02T07:28:40.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.987+0000 7f2749600640 1 --2- 172.21.15.55:0/2791129675 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f272c0666c0 0x7f272c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:40.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.987+0000 7f2749600640 1 -- 172.21.15.55:0/2791129675 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f27380832b0 con 0x7f274c0d18f0 2024-04-02T07:28:40.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.987+0000 7f2751a00640 1 --2- 172.21.15.55:0/2791129675 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f272c0666c0 0x7f272c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:40.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.987+0000 7f2751a00640 1 --2- 172.21.15.55:0/2791129675 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f272c0666c0 0x7f272c068b80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f27400ad000 tx=0x7f27400a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:40.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:40.991+0000 7f2749600640 1 -- 172.21.15.55:0/2791129675 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2738050640 con 0x7f274c0d18f0 2024-04-02T07:28:41.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.183+0000 7f2754400640 1 -- 172.21.15.55:0/2791129675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f274c066c90 con 0x7f274c0d18f0 2024-04-02T07:28:41.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.183+0000 7f2749600640 1 -- 172.21.15.55:0/2791129675 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4741 (secure 0 0 0) 0x7f2738053c60 con 0x7f274c0d18f0 2024-04-02T07:28:41.186 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:41.186 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":52,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2000687874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2000687874},{"type":"v1","addr":"172.21.15.106:6835","nonce":2000687874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/823234890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":823234890},{"type":"v1","addr":"172.21.15.55:6835","nonce":823234890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6439,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1803758651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1803758651},{"type":"v1","addr":"172.21.15.106:6837","nonce":1803758651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:26:55.525186+0000","modified":"2024-04-02T07:28:06.241662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":16,"addr":"172.21.15.55:6833/1965896660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1965896660},{"type":"v1","addr":"172.21.15.55:6833","nonce":1965896660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-02T07:28:41.186 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 52 2024-04-02T07:28:41.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.187+0000 7f2754400640 1 -- 172.21.15.55:0/2791129675 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f272c0666c0 msgr2=0x7f272c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:41.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.187+0000 7f2754400640 1 --2- 172.21.15.55:0/2791129675 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f272c0666c0 0x7f272c068b80 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f27400ad000 tx=0x7f27400a6000 comp rx=0 tx=0).stop 2024-04-02T07:28:41.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.187+0000 7f2754400640 1 -- 172.21.15.55:0/2791129675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f274c0d18f0 msgr2=0x7f274c0ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:41.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.187+0000 7f2754400640 1 --2- 172.21.15.55:0/2791129675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f274c0d18f0 0x7f274c0ccd20 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f27380011f0 tx=0x7f273800c9b0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.187+0000 7f2754400640 1 -- 172.21.15.55:0/2791129675 shutdown_connections 2024-04-02T07:28:41.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.187+0000 7f2754400640 1 --2- 172.21.15.55:0/2791129675 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f272c0666c0 0x7f272c068b80 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.187+0000 7f2754400640 1 --2- 172.21.15.55:0/2791129675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f274c15ce80 0x7f274c155ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.187+0000 7f2754400640 1 --2- 172.21.15.55:0/2791129675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f274c0d18f0 0x7f274c0ccd20 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.187+0000 7f2754400640 1 --2- 172.21.15.55:0/2791129675 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f274c06b2c0 0x7f274c15adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.187+0000 7f2754400640 1 -- 172.21.15.55:0/2791129675 >> 172.21.15.55:0/2791129675 conn(0x7f274c0cf440 msgr2=0x7f274c15f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:41.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.187+0000 7f2754400640 1 -- 172.21.15.55:0/2791129675 shutdown_connections 2024-04-02T07:28:41.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.187+0000 7f2754400640 1 -- 172.21.15.55:0/2791129675 wait complete. 2024-04-02T07:28:41.207 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:28:41.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.347+0000 7f873c800640 1 Processor -- start 2024-04-02T07:28:41.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.347+0000 7f873c800640 1 -- start start 2024-04-02T07:28:41.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.347+0000 7f873c800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87340b4760 0x7f87340ce710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:41.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.347+0000 7f873c800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f87340b3b80 0x7f87340cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:41.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.347+0000 7f873c800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87340cf190 con 0x7f87341598e0 2024-04-02T07:28:41.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.347+0000 7f873c800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87340ccc90 con 0x7f87340b4760 2024-04-02T07:28:41.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.347+0000 7f873c800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f873406f970 con 0x7f87340b3b80 2024-04-02T07:28:41.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.347+0000 7f8739400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87340b4760 0x7f87340ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:41.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.347+0000 7f8739400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87340b4760 0x7f87340ce710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59472/0 (socket says 172.21.15.55:59472) 2024-04-02T07:28:41.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.347+0000 7f8739400640 1 -- 172.21.15.55:0/2973233205 learned_addr learned my addr 172.21.15.55:0/2973233205 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:41.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.347+0000 7f8739e00640 1 --1- 172.21.15.55:0/2973233205 >> v1:172.21.15.55:6789/0 conn(0x7f87341598e0 0x7f873406f260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37174/0 (socket says 172.21.15.55:37174) 2024-04-02T07:28:41.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.347+0000 7f873a800640 1 --2- 172.21.15.55:0/2973233205 >> v2:172.21.15.106:3300/0 conn(0x7f87340b3b80 0x7f87340cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:41.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.347+0000 7f8739400640 1 -- 172.21.15.55:0/2973233205 >> v2:172.21.15.106:3300/0 conn(0x7f87340b3b80 msgr2=0x7f87340cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:41.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.347+0000 7f8739400640 1 --2- 172.21.15.55:0/2973233205 >> v2:172.21.15.106:3300/0 conn(0x7f87340b3b80 0x7f87340cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.347+0000 7f8739400640 1 -- 172.21.15.55:0/2973233205 >> v1:172.21.15.55:6789/0 conn(0x7f87341598e0 legacy=0x7f873406f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:41.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.347+0000 7f8739400640 1 -- 172.21.15.55:0/2973233205 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87340ccf50 con 0x7f87340b4760 2024-04-02T07:28:41.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.351+0000 7f8739400640 1 --2- 172.21.15.55:0/2973233205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87340b4760 0x7f87340ce710 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f87340b41f0 tx=0x7f872401eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37d2590ec68d437 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:41.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.351+0000 7f8738a00640 1 -- 172.21.15.55:0/2973233205 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87240a7b40 con 0x7f87340b4760 2024-04-02T07:28:41.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.351+0000 7f8738a00640 1 -- 172.21.15.55:0/2973233205 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87240a7ca0 con 0x7f87340b4760 2024-04-02T07:28:41.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.351+0000 7f8738a00640 1 -- 172.21.15.55:0/2973233205 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87240af660 con 0x7f87340b4760 2024-04-02T07:28:41.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.351+0000 7f873c800640 1 -- 172.21.15.55:0/2973233205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87340b4760 msgr2=0x7f87340ce710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:41.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.351+0000 7f873c800640 1 --2- 172.21.15.55:0/2973233205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87340b4760 0x7f87340ce710 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f87340b41f0 tx=0x7f872401eb60 comp rx=0 tx=0).stop 2024-04-02T07:28:41.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.351+0000 7f873c800640 1 -- 172.21.15.55:0/2973233205 shutdown_connections 2024-04-02T07:28:41.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.351+0000 7f873c800640 1 --2- 172.21.15.55:0/2973233205 >> v2:172.21.15.106:3300/0 conn(0x7f87340b3b80 0x7f87340cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.351+0000 7f873c800640 1 --2- 172.21.15.55:0/2973233205 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87340b4760 0x7f87340ce710 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.351+0000 7f873c800640 1 -- 172.21.15.55:0/2973233205 >> 172.21.15.55:0/2973233205 conn(0x7f87340b13b0 msgr2=0x7f87340b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:41.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.351+0000 7f873c800640 1 -- 172.21.15.55:0/2973233205 shutdown_connections 2024-04-02T07:28:41.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.351+0000 7f873c800640 1 -- 172.21.15.55:0/2973233205 wait complete. 2024-04-02T07:28:41.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.351+0000 7f873c800640 1 Processor -- start 2024-04-02T07:28:41.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.351+0000 7f873c800640 1 -- start start 2024-04-02T07:28:41.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f873c800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87340b3b80 0x7f873413be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:41.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f873c800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87340b4760 0x7f8734069d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:41.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f873c800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87341598e0 0x7f873406a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:41.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f873c800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87340ca490 con 0x7f87340b3b80 2024-04-02T07:28:41.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f873c800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f873413c3d0 con 0x7f87340b4760 2024-04-02T07:28:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f873c800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87340c9810 con 0x7f87341598e0 2024-04-02T07:28:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f8739e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87340b3b80 0x7f873413be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f8739e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87340b3b80 0x7f873413be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59480/0 (socket says 172.21.15.55:59480) 2024-04-02T07:28:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f8739e00640 1 -- 172.21.15.55:0/3201718686 learned_addr learned my addr 172.21.15.55:0/3201718686 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f8739400640 1 --2- 172.21.15.55:0/3201718686 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87340b4760 0x7f8734069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f873a800640 1 --2- 172.21.15.55:0/3201718686 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87341598e0 0x7f873406a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f8739e00640 1 -- 172.21.15.55:0/3201718686 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87341598e0 msgr2=0x7f873406a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f8739e00640 1 --2- 172.21.15.55:0/3201718686 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87341598e0 0x7f873406a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f8739e00640 1 -- 172.21.15.55:0/3201718686 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87340b4760 msgr2=0x7f8734069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f8739e00640 1 --2- 172.21.15.55:0/3201718686 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87340b4760 0x7f8734069d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f8739e00640 1 -- 172.21.15.55:0/3201718686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f872400b770 con 0x7f87340b3b80 2024-04-02T07:28:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f8739400640 1 --2- 172.21.15.55:0/3201718686 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87340b4760 0x7f8734069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f8739e00640 1 --2- 172.21.15.55:0/3201718686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87340b3b80 0x7f873413be90 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f872800c430 tx=0x7f872800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:41.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f872e000640 1 -- 172.21.15.55:0/3201718686 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87280074e0 con 0x7f87340b3b80 2024-04-02T07:28:41.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f872e000640 1 -- 172.21.15.55:0/3201718686 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8728007640 con 0x7f87340b3b80 2024-04-02T07:28:41.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f872e000640 1 -- 172.21.15.55:0/3201718686 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8728004a10 con 0x7f87340b3b80 2024-04-02T07:28:41.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f873c800640 1 -- 172.21.15.55:0/3201718686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87340c9af0 con 0x7f87340b3b80 2024-04-02T07:28:41.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f873c800640 1 -- 172.21.15.55:0/3201718686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87340ca0b0 con 0x7f87340b3b80 2024-04-02T07:28:41.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f873c800640 1 -- 172.21.15.55:0/3201718686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8734066c90 con 0x7f87340b3b80 2024-04-02T07:28:41.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.355+0000 7f872e000640 1 -- 172.21.15.55:0/3201718686 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8728004b70 con 0x7f87340b3b80 2024-04-02T07:28:41.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.359+0000 7f872e000640 1 --2- 172.21.15.55:0/3201718686 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8718066690 0x7f8718068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:41.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.359+0000 7f872e000640 1 -- 172.21.15.55:0/3201718686 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8728083ca0 con 0x7f87340b3b80 2024-04-02T07:28:41.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.359+0000 7f8739400640 1 --2- 172.21.15.55:0/3201718686 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8718066690 0x7f8718068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:41.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.359+0000 7f8739400640 1 --2- 172.21.15.55:0/3201718686 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8718066690 0x7f8718068b50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f87240b1000 tx=0x7f8724008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:41.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.363+0000 7f872e000640 1 -- 172.21.15.55:0/3201718686 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f8728050ee0 con 0x7f87340b3b80 2024-04-02T07:28:41.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.527+0000 7f873c800640 1 -- 172.21.15.55:0/3201718686 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f873406aa60 con 0x7f87340b3b80 2024-04-02T07:28:41.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.527+0000 7f872e000640 1 -- 172.21.15.55:0/3201718686 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16327 (secure 0 0 0) 0x7f8728054500 con 0x7f87340b3b80 2024-04-02T07:28:41.529 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:41.529 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":75,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:27:14.356458+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:26:53.196912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-02T07:26:54.514963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.2e","mappings":[{"from":6,"to":0}]},{"pgid":"11.3c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6833/1576619269":"2024-04-03T07:27:14.356430+0000","172.21.15.55:6832/1576619269":"2024-04-03T07:27:14.356430+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:28:41.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.531+0000 7f873c800640 1 -- 172.21.15.55:0/3201718686 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8718066690 msgr2=0x7f8718068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:41.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.531+0000 7f873c800640 1 --2- 172.21.15.55:0/3201718686 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8718066690 0x7f8718068b50 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f87240b1000 tx=0x7f8724008040 comp rx=0 tx=0).stop 2024-04-02T07:28:41.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.531+0000 7f873c800640 1 -- 172.21.15.55:0/3201718686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87340b3b80 msgr2=0x7f873413be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:41.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.531+0000 7f873c800640 1 --2- 172.21.15.55:0/3201718686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87340b3b80 0x7f873413be90 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f872800c430 tx=0x7f872800c8f0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.531+0000 7f873c800640 1 -- 172.21.15.55:0/3201718686 shutdown_connections 2024-04-02T07:28:41.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.531+0000 7f873c800640 1 --2- 172.21.15.55:0/3201718686 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87341598e0 0x7f873406a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.531+0000 7f873c800640 1 --2- 172.21.15.55:0/3201718686 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8718066690 0x7f8718068b50 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.531+0000 7f873c800640 1 --2- 172.21.15.55:0/3201718686 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87340b4760 0x7f8734069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.531+0000 7f873c800640 1 --2- 172.21.15.55:0/3201718686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87340b3b80 0x7f873413be90 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.531+0000 7f873c800640 1 -- 172.21.15.55:0/3201718686 >> 172.21.15.55:0/3201718686 conn(0x7f87340b13b0 msgr2=0x7f8734157ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:41.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.531+0000 7f873c800640 1 -- 172.21.15.55:0/3201718686 shutdown_connections 2024-04-02T07:28:41.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.531+0000 7f873c800640 1 -- 172.21.15.55:0/3201718686 wait complete. 2024-04-02T07:28:41.551 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-02T07:28:41.551 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:28:41.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.691+0000 7fa3b5e00640 1 Processor -- start 2024-04-02T07:28:41.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.691+0000 7fa3b5e00640 1 -- start start 2024-04-02T07:28:41.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.691+0000 7fa3b5e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b0099120 0x7fa3b00b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:41.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.691+0000 7fa3b5e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa3b006aff0 0x7fa3b006b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:41.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.691+0000 7fa3b5e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b015ce50 con 0x7fa3b015ca70 2024-04-02T07:28:41.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.691+0000 7fa3b5e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b00cef60 con 0x7fa3b006aff0 2024-04-02T07:28:41.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.691+0000 7fa3b5e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b006bd60 con 0x7fa3b0099120 2024-04-02T07:28:41.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.691+0000 7fa3aea00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa3b015ca70 0x7fa3b0098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37178/0 (socket says 172.21.15.55:37178) 2024-04-02T07:28:41.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.691+0000 7fa3aea00640 1 -- 172.21.15.55:0/3115745815 learned_addr learned my addr 172.21.15.55:0/3115745815 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:41.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.691+0000 7fa3ae000640 1 --2- 172.21.15.55:0/3115745815 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b0099120 0x7fa3b00b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:41.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.691+0000 7fa3af400640 1 --2- 172.21.15.55:0/3115745815 >> v2:172.21.15.106:3300/0 conn(0x7fa3b006aff0 0x7fa3b006b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:41.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.691+0000 7fa3ad600640 1 -- 172.21.15.55:0/3115745815 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3519533283 0 0) 0x7fa3b015ce50 con 0x7fa3b015ca70 2024-04-02T07:28:41.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.691+0000 7fa3ad600640 1 -- 172.21.15.55:0/3115745815 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa394003530 con 0x7fa3b015ca70 2024-04-02T07:28:41.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.691+0000 7fa3ae000640 1 -- 172.21.15.55:0/3115745815 >> v2:172.21.15.106:3300/0 conn(0x7fa3b006aff0 msgr2=0x7fa3b006b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:41.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.691+0000 7fa3ae000640 1 --2- 172.21.15.55:0/3115745815 >> v2:172.21.15.106:3300/0 conn(0x7fa3b006aff0 0x7fa3b006b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.691+0000 7fa3ae000640 1 -- 172.21.15.55:0/3115745815 >> v1:172.21.15.55:6789/0 conn(0x7fa3b015ca70 legacy=0x7fa3b0098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:41.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.691+0000 7fa3ae000640 1 -- 172.21.15.55:0/3115745815 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b006c040 con 0x7fa3b0099120 2024-04-02T07:28:41.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.695+0000 7fa3ae000640 1 --2- 172.21.15.55:0/3115745815 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b0099120 0x7fa3b00b0040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0097c0 tx=0x7fa39c01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59377ba5ae511219 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:41.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.695+0000 7fa3ad600640 1 -- 172.21.15.55:0/3115745815 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0aa5f0 con 0x7fa3b0099120 2024-04-02T07:28:41.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.695+0000 7fa3ad600640 1 -- 172.21.15.55:0/3115745815 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa39c0aa750 con 0x7fa3b0099120 2024-04-02T07:28:41.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.695+0000 7fa3ad600640 1 -- 172.21.15.55:0/3115745815 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa39c0aaae0 con 0x7fa3b0099120 2024-04-02T07:28:41.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.695+0000 7fa3b5e00640 1 -- 172.21.15.55:0/3115745815 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b0099120 msgr2=0x7fa3b00b0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:41.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.695+0000 7fa3b5e00640 1 --2- 172.21.15.55:0/3115745815 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b0099120 0x7fa3b00b0040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0097c0 tx=0x7fa39c01c470 comp rx=0 tx=0).stop 2024-04-02T07:28:41.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.695+0000 7fa3b5e00640 1 -- 172.21.15.55:0/3115745815 shutdown_connections 2024-04-02T07:28:41.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.695+0000 7fa3b5e00640 1 --2- 172.21.15.55:0/3115745815 >> v2:172.21.15.106:3300/0 conn(0x7fa3b006aff0 0x7fa3b006b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.695+0000 7fa3b5e00640 1 --2- 172.21.15.55:0/3115745815 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b0099120 0x7fa3b00b0040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.695+0000 7fa3b5e00640 1 -- 172.21.15.55:0/3115745815 >> 172.21.15.55:0/3115745815 conn(0x7fa3b00b21d0 msgr2=0x7fa3b00b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:41.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.695+0000 7fa3b5e00640 1 -- 172.21.15.55:0/3115745815 shutdown_connections 2024-04-02T07:28:41.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.695+0000 7fa3b5e00640 1 -- 172.21.15.55:0/3115745815 wait complete. 2024-04-02T07:28:41.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3b5e00640 1 Processor -- start 2024-04-02T07:28:41.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3b5e00640 1 -- start start 2024-04-02T07:28:41.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3b5e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3b006aff0 0x7fa3b01582b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:41.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3b5e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3b0099120 0x7fa3b00b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:41.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3b5e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b015ca70 0x7fa3b00b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:41.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3b5e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b015f840 con 0x7fa3b006aff0 2024-04-02T07:28:41.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3b5e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b015fb20 con 0x7fa3b0099120 2024-04-02T07:28:41.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3b5e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00b3120 con 0x7fa3b015ca70 2024-04-02T07:28:41.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3aea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3b006aff0 0x7fa3b01582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:41.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3aea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3b006aff0 0x7fa3b01582b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59484/0 (socket says 172.21.15.55:59484) 2024-04-02T07:28:41.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3aea00640 1 -- 172.21.15.55:0/4004730952 learned_addr learned my addr 172.21.15.55:0/4004730952 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:41.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3ae000640 1 --2- 172.21.15.55:0/4004730952 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3b0099120 0x7fa3b00b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:41.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3af400640 1 --2- 172.21.15.55:0/4004730952 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b015ca70 0x7fa3b00b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:41.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3aea00640 1 -- 172.21.15.55:0/4004730952 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b015ca70 msgr2=0x7fa3b00b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:41.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3aea00640 1 --2- 172.21.15.55:0/4004730952 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b015ca70 0x7fa3b00b5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3aea00640 1 -- 172.21.15.55:0/4004730952 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3b0099120 msgr2=0x7fa3b00b5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:41.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3aea00640 1 --2- 172.21.15.55:0/4004730952 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3b0099120 0x7fa3b00b5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3aea00640 1 -- 172.21.15.55:0/4004730952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c009420 con 0x7fa3b006aff0 2024-04-02T07:28:41.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3aea00640 1 --2- 172.21.15.55:0/4004730952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3b006aff0 0x7fa3b01582b0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000c420 tx=0x7fa3a000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:41.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3a7400640 1 -- 172.21.15.55:0/4004730952 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0005cf0 con 0x7fa3b006aff0 2024-04-02T07:28:41.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3a7400640 1 -- 172.21.15.55:0/4004730952 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a0005e50 con 0x7fa3b006aff0 2024-04-02T07:28:41.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3b5e00640 1 -- 172.21.15.55:0/4004730952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b00b3400 con 0x7fa3b006aff0 2024-04-02T07:28:41.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3a7400640 1 -- 172.21.15.55:0/4004730952 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a00072d0 con 0x7fa3b006aff0 2024-04-02T07:28:41.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3b5e00640 1 -- 172.21.15.55:0/4004730952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b01587f0 con 0x7fa3b006aff0 2024-04-02T07:28:41.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.699+0000 7fa3b5e00640 1 -- 172.21.15.55:0/4004730952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b0066c90 con 0x7fa3b006aff0 2024-04-02T07:28:41.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.703+0000 7fa3a7400640 1 -- 172.21.15.55:0/4004730952 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa3a0007430 con 0x7fa3b006aff0 2024-04-02T07:28:41.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.703+0000 7fa3a7400640 1 --2- 172.21.15.55:0/4004730952 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa390066690 0x7fa390068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:41.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.703+0000 7fa3a7400640 1 -- 172.21.15.55:0/4004730952 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fa3a0083830 con 0x7fa3b006aff0 2024-04-02T07:28:41.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.703+0000 7fa3ae000640 1 --2- 172.21.15.55:0/4004730952 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa390066690 0x7fa390068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:41.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.703+0000 7fa3ae000640 1 --2- 172.21.15.55:0/4004730952 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa390066690 0x7fa390068b50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0ae000 tx=0x7fa39c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:41.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.707+0000 7fa3a7400640 1 -- 172.21.15.55:0/4004730952 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa3a0050b20 con 0x7fa3b006aff0 2024-04-02T07:28:41.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.907+0000 7fa3b5e00640 1 -- 172.21.15.55:0/4004730952 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3b009e3d0 con 0x7fa3b006aff0 2024-04-02T07:28:41.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.907+0000 7fa3a7400640 1 -- 172.21.15.55:0/4004730952 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4741 (secure 0 0 0) 0x7fa3a0017090 con 0x7fa3b006aff0 2024-04-02T07:28:41.908 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:41.908 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":52,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2000687874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2000687874},{"type":"v1","addr":"172.21.15.106:6835","nonce":2000687874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/823234890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":823234890},{"type":"v1","addr":"172.21.15.55:6835","nonce":823234890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6439,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1803758651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1803758651},{"type":"v1","addr":"172.21.15.106:6837","nonce":1803758651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:26:55.525186+0000","modified":"2024-04-02T07:28:06.241662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":16,"addr":"172.21.15.55:6833/1965896660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1965896660},{"type":"v1","addr":"172.21.15.55:6833","nonce":1965896660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-02T07:28:41.908 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 52 2024-04-02T07:28:41.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.907+0000 7fa3b5e00640 1 -- 172.21.15.55:0/4004730952 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa390066690 msgr2=0x7fa390068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:41.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.907+0000 7fa3b5e00640 1 --2- 172.21.15.55:0/4004730952 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa390066690 0x7fa390068b50 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fa39c0ae000 tx=0x7fa39c0a7000 comp rx=0 tx=0).stop 2024-04-02T07:28:41.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.907+0000 7fa3b5e00640 1 -- 172.21.15.55:0/4004730952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3b006aff0 msgr2=0x7fa3b01582b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:41.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.907+0000 7fa3b5e00640 1 --2- 172.21.15.55:0/4004730952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3b006aff0 0x7fa3b01582b0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fa3a000c420 tx=0x7fa3a000c8e0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.907+0000 7fa3b5e00640 1 -- 172.21.15.55:0/4004730952 shutdown_connections 2024-04-02T07:28:41.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.907+0000 7fa3b5e00640 1 --2- 172.21.15.55:0/4004730952 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b015ca70 0x7fa3b00b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.907+0000 7fa3b5e00640 1 --2- 172.21.15.55:0/4004730952 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa390066690 0x7fa390068b50 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.907+0000 7fa3b5e00640 1 --2- 172.21.15.55:0/4004730952 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3b0099120 0x7fa3b00b5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.907+0000 7fa3b5e00640 1 --2- 172.21.15.55:0/4004730952 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3b006aff0 0x7fa3b01582b0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:41.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.907+0000 7fa3b5e00640 1 -- 172.21.15.55:0/4004730952 >> 172.21.15.55:0/4004730952 conn(0x7fa3b00b21d0 msgr2=0x7fa3b00b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:41.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.907+0000 7fa3b5e00640 1 -- 172.21.15.55:0/4004730952 shutdown_connections 2024-04-02T07:28:41.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:41.907+0000 7fa3b5e00640 1 -- 172.21.15.55:0/4004730952 wait complete. 2024-04-02T07:28:41.929 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:28:42.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.067+0000 7f6827c00640 1 Processor -- start 2024-04-02T07:28:42.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.067+0000 7f6827c00640 1 -- start start 2024-04-02T07:28:42.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.067+0000 7f6827c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6820099120 0x7f6820099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:42.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.067+0000 7f6827c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68200ad270 con 0x7f682015ee70 2024-04-02T07:28:42.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.067+0000 7f6827c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68200b0a50 con 0x7f682015f250 2024-04-02T07:28:42.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.067+0000 7f6827c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68200b0840 con 0x7f6820099120 2024-04-02T07:28:42.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.071+0000 7f6817e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6820099120 0x7f6820099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:42.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.071+0000 7f6817e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6820099120 0x7f6820099830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59490/0 (socket says 172.21.15.55:59490) 2024-04-02T07:28:42.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.071+0000 7f6825200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f682015ee70 0x7f6820098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37194/0 (socket says 172.21.15.55:37194) 2024-04-02T07:28:42.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.071+0000 7f6817e00640 1 -- 172.21.15.55:0/732097170 learned_addr learned my addr 172.21.15.55:0/732097170 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:42.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.071+0000 7f6817e00640 1 -- 172.21.15.55:0/732097170 >> v1:172.21.15.106:6789/0 conn(0x7f682015f250 legacy=0x7f68200ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:42.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.071+0000 7f6817e00640 1 -- 172.21.15.55:0/732097170 >> v1:172.21.15.55:6789/0 conn(0x7f682015ee70 legacy=0x7f6820098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:42.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.071+0000 7f6817e00640 1 -- 172.21.15.55:0/732097170 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68200b0d30 con 0x7f6820099120 2024-04-02T07:28:42.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.071+0000 7f681fe00640 1 -- 172.21.15.55:0/732097170 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269974178 0 0) 0x7f68200ad270 con 0x7f682015ee70 2024-04-02T07:28:42.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.071+0000 7f6817e00640 1 --2- 172.21.15.55:0/732097170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6820099120 0x7f6820099830 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f6808009870 tx=0x7f680801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b6f905e4520d715 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:42.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.071+0000 7f681fe00640 1 -- 172.21.15.55:0/732097170 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68080aa670 con 0x7f6820099120 2024-04-02T07:28:42.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.071+0000 7f681fe00640 1 -- 172.21.15.55:0/732097170 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68080aa7d0 con 0x7f6820099120 2024-04-02T07:28:42.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.071+0000 7f681fe00640 1 -- 172.21.15.55:0/732097170 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68080aab60 con 0x7f6820099120 2024-04-02T07:28:42.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6827c00640 1 -- 172.21.15.55:0/732097170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6820099120 msgr2=0x7f6820099830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:42.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6827c00640 1 --2- 172.21.15.55:0/732097170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6820099120 0x7f6820099830 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f6808009870 tx=0x7f680801c530 comp rx=0 tx=0).stop 2024-04-02T07:28:42.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6827c00640 1 -- 172.21.15.55:0/732097170 shutdown_connections 2024-04-02T07:28:42.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6827c00640 1 --2- 172.21.15.55:0/732097170 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6820099120 0x7f6820099830 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6827c00640 1 -- 172.21.15.55:0/732097170 >> 172.21.15.55:0/732097170 conn(0x7f68200b21d0 msgr2=0x7f68200b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:42.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6827c00640 1 -- 172.21.15.55:0/732097170 shutdown_connections 2024-04-02T07:28:42.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6827c00640 1 -- 172.21.15.55:0/732097170 wait complete. 2024-04-02T07:28:42.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6827c00640 1 Processor -- start 2024-04-02T07:28:42.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6827c00640 1 -- start start 2024-04-02T07:28:42.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6827c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6820099120 0x7f682014b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:42.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6827c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f682015ee70 0x7f68201643e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6827c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f682015f250 0x7f6820165e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6827c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6820164e10 con 0x7f682015f250 2024-04-02T07:28:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6827c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68201650b0 con 0x7f6820099120 2024-04-02T07:28:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6827c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6820165390 con 0x7f682015ee70 2024-04-02T07:28:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6825c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f682015f250 0x7f6820165e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6825c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f682015f250 0x7f6820165e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59504/0 (socket says 172.21.15.55:59504) 2024-04-02T07:28:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6825c00640 1 -- 172.21.15.55:0/3114913947 learned_addr learned my addr 172.21.15.55:0/3114913947 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6817e00640 1 --2- 172.21.15.55:0/3114913947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f682015ee70 0x7f68201643e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6825200640 1 --2- 172.21.15.55:0/3114913947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6820099120 0x7f682014b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6825c00640 1 -- 172.21.15.55:0/3114913947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f682015ee70 msgr2=0x7f68201643e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6825c00640 1 --2- 172.21.15.55:0/3114913947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f682015ee70 0x7f68201643e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6825c00640 1 -- 172.21.15.55:0/3114913947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6820099120 msgr2=0x7f682014b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6825c00640 1 --2- 172.21.15.55:0/3114913947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6820099120 0x7f682014b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6825c00640 1 -- 172.21.15.55:0/3114913947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68080094d0 con 0x7f682015f250 2024-04-02T07:28:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6825c00640 1 --2- 172.21.15.55:0/3114913947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f682015f250 0x7f6820165e70 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f681800c770 tx=0x7f681800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:42.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f681d600640 1 -- 172.21.15.55:0/3114913947 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6818003b80 con 0x7f682015f250 2024-04-02T07:28:42.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f681d600640 1 -- 172.21.15.55:0/3114913947 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6818003ce0 con 0x7f682015f250 2024-04-02T07:28:42.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f681d600640 1 -- 172.21.15.55:0/3114913947 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681800aa90 con 0x7f682015f250 2024-04-02T07:28:42.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.075+0000 7f6827c00640 1 -- 172.21.15.55:0/3114913947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6820165670 con 0x7f682015f250 2024-04-02T07:28:42.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.079+0000 7f6827c00640 1 -- 172.21.15.55:0/3114913947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f682014b9e0 con 0x7f682015f250 2024-04-02T07:28:42.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.079+0000 7f6827c00640 1 -- 172.21.15.55:0/3114913947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6820066c90 con 0x7f682015f250 2024-04-02T07:28:42.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.079+0000 7f681d600640 1 -- 172.21.15.55:0/3114913947 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f681800abf0 con 0x7f682015f250 2024-04-02T07:28:42.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.079+0000 7f681d600640 1 --2- 172.21.15.55:0/3114913947 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f67fc066690 0x7f67fc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:42.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.079+0000 7f681d600640 1 -- 172.21.15.55:0/3114913947 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f6818083f40 con 0x7f682015f250 2024-04-02T07:28:42.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.079+0000 7f6825200640 1 --2- 172.21.15.55:0/3114913947 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f67fc066690 0x7f67fc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:42.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.079+0000 7f6825200640 1 --2- 172.21.15.55:0/3114913947 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f67fc066690 0x7f67fc068b50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6810000f70 tx=0x7f6810007b60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:42.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.083+0000 7f681d600640 1 -- 172.21.15.55:0/3114913947 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f68180512b0 con 0x7f682015f250 2024-04-02T07:28:42.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.275+0000 7f6827c00640 1 -- 172.21.15.55:0/3114913947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6820165b20 con 0x7f682015f250 2024-04-02T07:28:42.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.279+0000 7f681d600640 1 -- 172.21.15.55:0/3114913947 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+4741 (secure 0 0 0) 0x7f68180548d0 con 0x7f682015f250 2024-04-02T07:28:42.279 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:42.279 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":52,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2000687874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2000687874},{"type":"v1","addr":"172.21.15.106:6835","nonce":2000687874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/823234890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":823234890},{"type":"v1","addr":"172.21.15.55:6835","nonce":823234890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6439,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1803758651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1803758651},{"type":"v1","addr":"172.21.15.106:6837","nonce":1803758651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":52,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:26:55.525186+0000","modified":"2024-04-02T07:28:06.241662+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":75,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6936},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6936":{"gid":6936,"name":"a","rank":0,"incarnation":47,"state":"up:active","state_seq":16,"addr":"172.21.15.55:6833/1965896660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1965896660},{"type":"v1","addr":"172.21.15.55:6833","nonce":1965896660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2024-04-02T07:28:42.279 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 52 2024-04-02T07:28:42.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.279+0000 7f6827c00640 1 -- 172.21.15.55:0/3114913947 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f67fc066690 msgr2=0x7f67fc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:42.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.279+0000 7f6827c00640 1 --2- 172.21.15.55:0/3114913947 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f67fc066690 0x7f67fc068b50 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f6810000f70 tx=0x7f6810007b60 comp rx=0 tx=0).stop 2024-04-02T07:28:42.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.279+0000 7f6827c00640 1 -- 172.21.15.55:0/3114913947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f682015f250 msgr2=0x7f6820165e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:42.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.279+0000 7f6827c00640 1 --2- 172.21.15.55:0/3114913947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f682015f250 0x7f6820165e70 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f681800c770 tx=0x7f681800cc30 comp rx=0 tx=0).stop 2024-04-02T07:28:42.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.279+0000 7f6827c00640 1 -- 172.21.15.55:0/3114913947 shutdown_connections 2024-04-02T07:28:42.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.279+0000 7f6827c00640 1 --2- 172.21.15.55:0/3114913947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f682015f250 0x7f6820165e70 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.279+0000 7f6827c00640 1 --2- 172.21.15.55:0/3114913947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f682015ee70 0x7f68201643e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.279+0000 7f6827c00640 1 --2- 172.21.15.55:0/3114913947 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f67fc066690 0x7f67fc068b50 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.279+0000 7f6827c00640 1 --2- 172.21.15.55:0/3114913947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6820099120 0x7f682014b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.279+0000 7f6827c00640 1 -- 172.21.15.55:0/3114913947 >> 172.21.15.55:0/3114913947 conn(0x7f68200b21d0 msgr2=0x7f68200cc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:42.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.279+0000 7f6827c00640 1 -- 172.21.15.55:0/3114913947 shutdown_connections 2024-04-02T07:28:42.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.279+0000 7f6827c00640 1 -- 172.21.15.55:0/3114913947 wait complete. 2024-04-02T07:28:42.300 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:28:42.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.439+0000 7f65b0600640 1 Processor -- start 2024-04-02T07:28:42.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.439+0000 7f65b0600640 1 -- start start 2024-04-02T07:28:42.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.443+0000 7f65b0600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f65a8143f90 0x7f65a815ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:42.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.443+0000 7f65b0600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f65a80cda80 0x7f65a80c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:42.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.443+0000 7f65b0600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65a815b270 con 0x7f65a80b34f0 2024-04-02T07:28:42.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.443+0000 7f65b0600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65a8144370 con 0x7f65a8143f90 2024-04-02T07:28:42.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.443+0000 7f65b0600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a80c37b0 con 0x7f65a80cda80 2024-04-02T07:28:42.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.443+0000 7f65adc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f65a8143f90 0x7f65a815ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:42.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.443+0000 7f65ad200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f65a80b34f0 0x7f65a80cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37200/0 (socket says 172.21.15.55:37200) 2024-04-02T07:28:42.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.443+0000 7f65ad200640 1 -- 172.21.15.55:0/1239471866 learned_addr learned my addr 172.21.15.55:0/1239471866 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:42.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.443+0000 7f65ae600640 1 --2- 172.21.15.55:0/1239471866 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f65a80cda80 0x7f65a80c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:42.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.443+0000 7f65adc00640 1 -- 172.21.15.55:0/1239471866 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f65a80cda80 msgr2=0x7f65a80c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:42.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.443+0000 7f65adc00640 1 --2- 172.21.15.55:0/1239471866 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f65a80cda80 0x7f65a80c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.443+0000 7f65adc00640 1 -- 172.21.15.55:0/1239471866 >> v1:172.21.15.55:6789/0 conn(0x7f65a80b34f0 legacy=0x7f65a80cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:42.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.443+0000 7f65a7e00640 1 -- 172.21.15.55:0/1239471866 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176353285 0 0) 0x7f65a815b270 con 0x7f65a80b34f0 2024-04-02T07:28:42.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.443+0000 7f65adc00640 1 -- 172.21.15.55:0/1239471866 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a80c3a90 con 0x7f65a8143f90 2024-04-02T07:28:42.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65adc00640 1 --2- 172.21.15.55:0/1239471866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a8143f90 0x7f65a815ad30 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f659c0097c0 tx=0x7f659c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c94a4c1b349002d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:42.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65a7e00640 1 -- 172.21.15.55:0/1239471866 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c0ac640 con 0x7f65a8143f90 2024-04-02T07:28:42.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65a7e00640 1 -- 172.21.15.55:0/1239471866 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659c0ac7a0 con 0x7f65a8143f90 2024-04-02T07:28:42.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65a7e00640 1 -- 172.21.15.55:0/1239471866 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659c0acb30 con 0x7f65a8143f90 2024-04-02T07:28:42.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65b0600640 1 -- 172.21.15.55:0/1239471866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a8143f90 msgr2=0x7f65a815ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:42.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65b0600640 1 --2- 172.21.15.55:0/1239471866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a8143f90 0x7f65a815ad30 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f659c0097c0 tx=0x7f659c01c3e0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65b0600640 1 -- 172.21.15.55:0/1239471866 shutdown_connections 2024-04-02T07:28:42.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65b0600640 1 --2- 172.21.15.55:0/1239471866 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f65a80cda80 0x7f65a80c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65b0600640 1 --2- 172.21.15.55:0/1239471866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a8143f90 0x7f65a815ad30 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65b0600640 1 -- 172.21.15.55:0/1239471866 >> 172.21.15.55:0/1239471866 conn(0x7f65a8066080 msgr2=0x7f65a8069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:42.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65b0600640 1 -- 172.21.15.55:0/1239471866 shutdown_connections 2024-04-02T07:28:42.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65b0600640 1 -- 172.21.15.55:0/1239471866 wait complete. 2024-04-02T07:28:42.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65b0600640 1 Processor -- start 2024-04-02T07:28:42.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65b0600640 1 -- start start 2024-04-02T07:28:42.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65b0600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f65a80b34f0 0x7f65a812b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:42.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65b0600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a80cda80 0x7f65a812e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:42.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65b0600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65a8143f90 0x7f65a815a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:42.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65b0600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a815a6a0 con 0x7f65a80cda80 2024-04-02T07:28:42.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65b0600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65a80cb6b0 con 0x7f65a8143f90 2024-04-02T07:28:42.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65b0600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65a815b670 con 0x7f65a80b34f0 2024-04-02T07:28:42.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65ad200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a80cda80 0x7f65a812e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:42.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65ad200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a80cda80 0x7f65a812e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59524/0 (socket says 172.21.15.55:59524) 2024-04-02T07:28:42.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.447+0000 7f65ad200640 1 -- 172.21.15.55:0/1799032654 learned_addr learned my addr 172.21.15.55:0/1799032654 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:42.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.451+0000 7f65ae600640 1 --2- 172.21.15.55:0/1799032654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65a8143f90 0x7f65a815a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:42.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.451+0000 7f65adc00640 1 --2- 172.21.15.55:0/1799032654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f65a80b34f0 0x7f65a812b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:42.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.451+0000 7f65ad200640 1 -- 172.21.15.55:0/1799032654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f65a80b34f0 msgr2=0x7f65a812b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:42.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.451+0000 7f65ad200640 1 --2- 172.21.15.55:0/1799032654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f65a80b34f0 0x7f65a812b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.451+0000 7f65ad200640 1 -- 172.21.15.55:0/1799032654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65a8143f90 msgr2=0x7f65a815a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:42.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.451+0000 7f65ad200640 1 --2- 172.21.15.55:0/1799032654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65a8143f90 0x7f65a815a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.451+0000 7f65ad200640 1 -- 172.21.15.55:0/1799032654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c009420 con 0x7f65a80cda80 2024-04-02T07:28:42.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.451+0000 7f65adc00640 1 --2- 172.21.15.55:0/1799032654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f65a80b34f0 0x7f65a812b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:42.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.451+0000 7f65ae600640 1 --2- 172.21.15.55:0/1799032654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65a8143f90 0x7f65a815a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:42.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.451+0000 7f65ad200640 1 --2- 172.21.15.55:0/1799032654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a80cda80 0x7f65a812e580 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f659400c520 tx=0x7f659400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:42.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.451+0000 7f65a5600640 1 -- 172.21.15.55:0/1799032654 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65940074e0 con 0x7f65a80cda80 2024-04-02T07:28:42.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.451+0000 7f65a5600640 1 -- 172.21.15.55:0/1799032654 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6594007640 con 0x7f65a80cda80 2024-04-02T07:28:42.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.451+0000 7f65b0600640 1 -- 172.21.15.55:0/1799032654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65a80cbec0 con 0x7f65a80cda80 2024-04-02T07:28:42.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.451+0000 7f65a5600640 1 -- 172.21.15.55:0/1799032654 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65940049f0 con 0x7f65a80cda80 2024-04-02T07:28:42.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.451+0000 7f65b0600640 1 -- 172.21.15.55:0/1799032654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a80cbbe0 con 0x7f65a80cda80 2024-04-02T07:28:42.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.451+0000 7f65b0600640 1 -- 172.21.15.55:0/1799032654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65a815b440 con 0x7f65a80cda80 2024-04-02T07:28:42.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.451+0000 7f65a5600640 1 -- 172.21.15.55:0/1799032654 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6594004b50 con 0x7f65a80cda80 2024-04-02T07:28:42.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.451+0000 7f65a5600640 1 --2- 172.21.15.55:0/1799032654 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6588066690 0x7f6588068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:42.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.451+0000 7f65a5600640 1 -- 172.21.15.55:0/1799032654 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f65940833b0 con 0x7f65a80cda80 2024-04-02T07:28:42.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.455+0000 7f65adc00640 1 --2- 172.21.15.55:0/1799032654 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6588066690 0x7f6588068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:42.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.455+0000 7f65adc00640 1 --2- 172.21.15.55:0/1799032654 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6588066690 0x7f6588068b50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f659c0ae000 tx=0x7f659c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:42.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.455+0000 7f65a5600640 1 -- 172.21.15.55:0/1799032654 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f65a815b440 con 0x7f65a80cda80 2024-04-02T07:28:42.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.619+0000 7f65b0600640 1 -- 172.21.15.55:0/1799032654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65a815b440 con 0x7f65a80cda80 2024-04-02T07:28:42.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.623+0000 7f65a5600640 1 -- 172.21.15.55:0/1799032654 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) v1 ==== 74+0+16327 (secure 0 0 0) 0x7f65a815b440 con 0x7f65a80cda80 2024-04-02T07:28:42.623 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:42.623 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":75,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:27:14.356458+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:26:53.196912+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"71","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-04-02T07:26:54.514963+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.2e","mappings":[{"from":6,"to":0}]},{"pgid":"11.3c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6833/1576619269":"2024-04-03T07:27:14.356430+0000","172.21.15.55:6832/1576619269":"2024-04-03T07:27:14.356430+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:28:42.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.623+0000 7f65b0600640 1 -- 172.21.15.55:0/1799032654 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6588066690 msgr2=0x7f6588068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:42.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.623+0000 7f65b0600640 1 --2- 172.21.15.55:0/1799032654 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6588066690 0x7f6588068b50 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f659c0ae000 tx=0x7f659c0a7000 comp rx=0 tx=0).stop 2024-04-02T07:28:42.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.623+0000 7f65b0600640 1 -- 172.21.15.55:0/1799032654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a80cda80 msgr2=0x7f65a812e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:42.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.623+0000 7f65b0600640 1 --2- 172.21.15.55:0/1799032654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a80cda80 0x7f65a812e580 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f659400c520 tx=0x7f659400c9e0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.623+0000 7f65b0600640 1 -- 172.21.15.55:0/1799032654 shutdown_connections 2024-04-02T07:28:42.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.623+0000 7f65b0600640 1 --2- 172.21.15.55:0/1799032654 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6588066690 0x7f6588068b50 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.623+0000 7f65b0600640 1 --2- 172.21.15.55:0/1799032654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f65a8143f90 0x7f65a815a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.623+0000 7f65b0600640 1 --2- 172.21.15.55:0/1799032654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f65a80cda80 0x7f65a812e580 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.623+0000 7f65b0600640 1 --2- 172.21.15.55:0/1799032654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f65a80b34f0 0x7f65a812b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.623+0000 7f65b0600640 1 -- 172.21.15.55:0/1799032654 >> 172.21.15.55:0/1799032654 conn(0x7f65a8066080 msgr2=0x7f65a8142010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:42.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.623+0000 7f65b0600640 1 -- 172.21.15.55:0/1799032654 shutdown_connections 2024-04-02T07:28:42.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.623+0000 7f65b0600640 1 -- 172.21.15.55:0/1799032654 wait complete. 2024-04-02T07:28:42.645 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-02T07:28:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.783+0000 7fccfe400640 1 Processor -- start 2024-04-02T07:28:42.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.783+0000 7fccfe400640 1 -- start start 2024-04-02T07:28:42.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.787+0000 7fccfe400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccf81599c0 0x7fccf80b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:42.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.787+0000 7fccfe400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fccf806d1c0 0x7fccf80b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:42.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.787+0000 7fccfe400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fccf80afe70 0x7fccf80b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:42.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.787+0000 7fccfe400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf806cda0 con 0x7fccf80afe70 2024-04-02T07:28:42.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.787+0000 7fccfe400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccf80b3c60 con 0x7fccf806d1c0 2024-04-02T07:28:42.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.787+0000 7fccfe400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf80b1d60 con 0x7fccf81599c0 2024-04-02T07:28:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.787+0000 7fccf7e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fccf80afe70 0x7fccf80b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.787+0000 7fccf7e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fccf80afe70 0x7fccf80b3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59540/0 (socket says 172.21.15.55:59540) 2024-04-02T07:28:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.787+0000 7fccf7e00640 1 -- 172.21.15.55:0/1674115939 learned_addr learned my addr 172.21.15.55:0/1674115939 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.787+0000 7fccefe00640 1 --2- 172.21.15.55:0/1674115939 >> v2:172.21.15.106:3300/0 conn(0x7fccf806d1c0 0x7fccf80b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.787+0000 7fccf7400640 1 --2- 172.21.15.55:0/1674115939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccf81599c0 0x7fccf80b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.787+0000 7fccf7e00640 1 -- 172.21.15.55:0/1674115939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccf81599c0 msgr2=0x7fccf80b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.787+0000 7fccf7e00640 1 --2- 172.21.15.55:0/1674115939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccf81599c0 0x7fccf80b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.787+0000 7fccf7e00640 1 -- 172.21.15.55:0/1674115939 >> v2:172.21.15.106:3300/0 conn(0x7fccf806d1c0 msgr2=0x7fccf80b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.787+0000 7fccf7e00640 1 --2- 172.21.15.55:0/1674115939 >> v2:172.21.15.106:3300/0 conn(0x7fccf806d1c0 0x7fccf80b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.787+0000 7fccf7e00640 1 -- 172.21.15.55:0/1674115939 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf806c400 con 0x7fccf80afe70 2024-04-02T07:28:42.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.787+0000 7fccf7400640 1 --2- 172.21.15.55:0/1674115939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccf81599c0 0x7fccf80b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:42.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccf7e00640 1 --2- 172.21.15.55:0/1674115939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccf80afe70 0x7fccf80b3720 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fccf806ab00 tx=0x7fccf001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09499bcf5a6b25 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:42.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccf6a00640 1 -- 172.21.15.55:0/1674115939 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf00a5760 con 0x7fccf80afe70 2024-04-02T07:28:42.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccf6a00640 1 -- 172.21.15.55:0/1674115939 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccf00a58c0 con 0x7fccf80afe70 2024-04-02T07:28:42.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccf6a00640 1 -- 172.21.15.55:0/1674115939 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccf00a5c50 con 0x7fccf80afe70 2024-04-02T07:28:42.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccfe400640 1 -- 172.21.15.55:0/1674115939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccf80afe70 msgr2=0x7fccf80b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:42.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccfe400640 1 --2- 172.21.15.55:0/1674115939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccf80afe70 0x7fccf80b3720 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fccf806ab00 tx=0x7fccf001c9f0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccfe400640 1 -- 172.21.15.55:0/1674115939 shutdown_connections 2024-04-02T07:28:42.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccfe400640 1 --2- 172.21.15.55:0/1674115939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccf80afe70 0x7fccf80b3720 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccfe400640 1 --2- 172.21.15.55:0/1674115939 >> v2:172.21.15.106:3300/0 conn(0x7fccf806d1c0 0x7fccf80b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccfe400640 1 --2- 172.21.15.55:0/1674115939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccf81599c0 0x7fccf80b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccfe400640 1 -- 172.21.15.55:0/1674115939 >> 172.21.15.55:0/1674115939 conn(0x7fccf8069d90 msgr2=0x7fccf806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:42.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccfe400640 1 -- 172.21.15.55:0/1674115939 shutdown_connections 2024-04-02T07:28:42.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccfe400640 1 -- 172.21.15.55:0/1674115939 wait complete. 2024-04-02T07:28:42.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccfe400640 1 Processor -- start 2024-04-02T07:28:42.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccfe400640 1 -- start start 2024-04-02T07:28:42.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccfe400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccf806d1c0 0x7fccf80cc830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:42.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccfe400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccf80afe70 0x7fccf813ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:42.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccfe400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccf81599c0 0x7fccf813f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:42.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccfe400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf813f8f0 con 0x7fccf806d1c0 2024-04-02T07:28:42.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccfe400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccf80cd920 con 0x7fccf81599c0 2024-04-02T07:28:42.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.791+0000 7fccfe400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccf815c4a0 con 0x7fccf80afe70 2024-04-02T07:28:42.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.795+0000 7fccf7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccf806d1c0 0x7fccf80cc830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:42.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.795+0000 7fccf7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccf806d1c0 0x7fccf80cc830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59556/0 (socket says 172.21.15.55:59556) 2024-04-02T07:28:42.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.795+0000 7fccf7400640 1 -- 172.21.15.55:0/3702971060 learned_addr learned my addr 172.21.15.55:0/3702971060 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:42.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.795+0000 7fccf7e00640 1 --2- 172.21.15.55:0/3702971060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccf81599c0 0x7fccf813f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:42.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.795+0000 7fccefe00640 1 --2- 172.21.15.55:0/3702971060 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccf80afe70 0x7fccf813ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:42.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.795+0000 7fccf7400640 1 -- 172.21.15.55:0/3702971060 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccf80afe70 msgr2=0x7fccf813ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:42.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.795+0000 7fccf7400640 1 --2- 172.21.15.55:0/3702971060 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccf80afe70 0x7fccf813ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.795+0000 7fccf7400640 1 -- 172.21.15.55:0/3702971060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccf81599c0 msgr2=0x7fccf813f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:42.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.795+0000 7fccf7400640 1 --2- 172.21.15.55:0/3702971060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccf81599c0 0x7fccf813f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:42.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.795+0000 7fccf7400640 1 -- 172.21.15.55:0/3702971060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccf0009b30 con 0x7fccf806d1c0 2024-04-02T07:28:42.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.795+0000 7fccf7400640 1 --2- 172.21.15.55:0/3702971060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccf806d1c0 0x7fccf80cc830 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fcce800d800 tx=0x7fcce800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:42.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.795+0000 7fccef400640 1 -- 172.21.15.55:0/3702971060 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce80096c0 con 0x7fccf806d1c0 2024-04-02T07:28:42.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.795+0000 7fccef400640 1 -- 172.21.15.55:0/3702971060 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcce8009820 con 0x7fccf806d1c0 2024-04-02T07:28:42.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.795+0000 7fccef400640 1 -- 172.21.15.55:0/3702971060 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcce8009bd0 con 0x7fccf806d1c0 2024-04-02T07:28:42.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.795+0000 7fccfe400640 1 -- 172.21.15.55:0/3702971060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccf815c780 con 0x7fccf806d1c0 2024-04-02T07:28:42.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.795+0000 7fccfe400640 1 -- 172.21.15.55:0/3702971060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccf815cd40 con 0x7fccf806d1c0 2024-04-02T07:28:42.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.795+0000 7fccfe400640 1 -- 172.21.15.55:0/3702971060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccf806e270 con 0x7fccf806d1c0 2024-04-02T07:28:42.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.795+0000 7fccef400640 1 -- 172.21.15.55:0/3702971060 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fcce8009d30 con 0x7fccf806d1c0 2024-04-02T07:28:42.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.795+0000 7fccef400640 1 --2- 172.21.15.55:0/3702971060 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fccd4066690 0x7fccd4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:42.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.799+0000 7fccef400640 1 -- 172.21.15.55:0/3702971060 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fcce80849c0 con 0x7fccf806d1c0 2024-04-02T07:28:42.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.799+0000 7fccefe00640 1 --2- 172.21.15.55:0/3702971060 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fccd4066690 0x7fccd4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:42.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.799+0000 7fccefe00640 1 --2- 172.21.15.55:0/3702971060 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fccd4066690 0x7fccd4068b50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fccf81590e0 tx=0x7fcce0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:42.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.799+0000 7fccef400640 1 -- 172.21.15.55:0/3702971060 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fcce8051c00 con 0x7fccf806d1c0 2024-04-02T07:28:42.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:42.995+0000 7fccfe400640 1 -- 172.21.15.55:0/3702971060 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fccf8066c90 con 0x7fccf806d1c0 2024-04-02T07:28:42.997 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-02T07:28:42.995+0000 7f8f18800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-02T07:28:43.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.003+0000 7fccef400640 1 -- 172.21.15.55:0/3702971060 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v53) v1 ==== 161+0+0 (secure 0 0 0) 0x7fcce8055220 con 0x7fccf806d1c0 2024-04-02T07:28:43.006 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-02T07:28:43.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.007+0000 7fccfe400640 1 -- 172.21.15.55:0/3702971060 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fccd4066690 msgr2=0x7fccd4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:43.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.007+0000 7fccfe400640 1 --2- 172.21.15.55:0/3702971060 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fccd4066690 0x7fccd4068b50 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fccf81590e0 tx=0x7fcce0008040 comp rx=0 tx=0).stop 2024-04-02T07:28:43.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.007+0000 7fccfe400640 1 -- 172.21.15.55:0/3702971060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccf806d1c0 msgr2=0x7fccf80cc830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:43.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.007+0000 7fccfe400640 1 --2- 172.21.15.55:0/3702971060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccf806d1c0 0x7fccf80cc830 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7fcce800d800 tx=0x7fcce800dcc0 comp rx=0 tx=0).stop 2024-04-02T07:28:43.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.007+0000 7fccfe400640 1 -- 172.21.15.55:0/3702971060 shutdown_connections 2024-04-02T07:28:43.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.007+0000 7fccfe400640 1 --2- 172.21.15.55:0/3702971060 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fccd4066690 0x7fccd4068b50 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:43.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.007+0000 7fccfe400640 1 --2- 172.21.15.55:0/3702971060 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fccf81599c0 0x7fccf813f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:43.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.007+0000 7fccfe400640 1 --2- 172.21.15.55:0/3702971060 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fccf80afe70 0x7fccf813ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:43.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.007+0000 7fccfe400640 1 --2- 172.21.15.55:0/3702971060 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fccf806d1c0 0x7fccf80cc830 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:43.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.007+0000 7fccfe400640 1 -- 172.21.15.55:0/3702971060 >> 172.21.15.55:0/3702971060 conn(0x7fccf8069d90 msgr2=0x7fccf8156040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:43.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.007+0000 7fccfe400640 1 -- 172.21.15.55:0/3702971060 shutdown_connections 2024-04-02T07:28:43.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.007+0000 7fccfe400640 1 -- 172.21.15.55:0/3702971060 wait complete. 2024-04-02T07:28:43.015 INFO:tasks.ceph.mds.a.smithi055.stderr: -3917> 2024-04-02T07:27:21.391+0000 7faf6dc00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:28:43.032 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-02T07:28:43.065 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-02T07:28:43.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.175+0000 7f1b06c00640 1 Processor -- start 2024-04-02T07:28:43.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.175+0000 7f1b06c00640 1 -- start start 2024-04-02T07:28:43.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.179+0000 7f1b06c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1b000709b0 0x7f1b000b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:43.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.179+0000 7f1b06c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b000cd430 con 0x7f1b001590d0 2024-04-02T07:28:43.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.179+0000 7f1b06c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b0015d640 con 0x7f1b000ccfa0 2024-04-02T07:28:43.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.179+0000 7f1b06c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b0015d920 con 0x7f1b000709b0 2024-04-02T07:28:43.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.179+0000 7f1b04c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1b000709b0 0x7f1b000b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:43.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.179+0000 7f1affe00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1b001590d0 0x7f1b0015cb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37216/0 (socket says 172.21.15.55:37216) 2024-04-02T07:28:43.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.179+0000 7f1affe00640 1 -- 172.21.15.55:0/2315516255 learned_addr learned my addr 172.21.15.55:0/2315516255 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:43.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.179+0000 7f1b04c00640 1 -- 172.21.15.55:0/2315516255 >> v1:172.21.15.106:6789/0 conn(0x7f1b000ccfa0 legacy=0x7f1b000702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:43.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.179+0000 7f1b04c00640 1 -- 172.21.15.55:0/2315516255 >> v1:172.21.15.55:6789/0 conn(0x7f1b001590d0 legacy=0x7f1b0015cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:43.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.179+0000 7f1b04c00640 1 -- 172.21.15.55:0/2315516255 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b000cc4c0 con 0x7f1b000709b0 2024-04-02T07:28:43.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.179+0000 7f1aff400640 1 -- 172.21.15.55:0/2315516255 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3986893108 0 0) 0x7f1b000cd430 con 0x7f1b001590d0 2024-04-02T07:28:43.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.179+0000 7f1b04c00640 1 --2- 172.21.15.55:0/2315516255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b000709b0 0x7f1b000b31f0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f1af80097c0 tx=0x7f1af801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4374f8c65b4689 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:43.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1aff400640 1 -- 172.21.15.55:0/2315516255 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af80ac640 con 0x7f1b000709b0 2024-04-02T07:28:43.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1aff400640 1 -- 172.21.15.55:0/2315516255 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af80ac7a0 con 0x7f1b000709b0 2024-04-02T07:28:43.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1aff400640 1 -- 172.21.15.55:0/2315516255 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af80acb30 con 0x7f1b000709b0 2024-04-02T07:28:43.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1b06c00640 1 -- 172.21.15.55:0/2315516255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b000709b0 msgr2=0x7f1b000b31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:43.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1b06c00640 1 --2- 172.21.15.55:0/2315516255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b000709b0 0x7f1b000b31f0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f1af80097c0 tx=0x7f1af801c3e0 comp rx=0 tx=0).stop 2024-04-02T07:28:43.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1b06c00640 1 -- 172.21.15.55:0/2315516255 shutdown_connections 2024-04-02T07:28:43.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1b06c00640 1 --2- 172.21.15.55:0/2315516255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b000709b0 0x7f1b000b31f0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:43.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1b06c00640 1 -- 172.21.15.55:0/2315516255 >> 172.21.15.55:0/2315516255 conn(0x7f1b0006a390 msgr2=0x7f1b000b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:43.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1b06c00640 1 -- 172.21.15.55:0/2315516255 shutdown_connections 2024-04-02T07:28:43.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1b06c00640 1 -- 172.21.15.55:0/2315516255 wait complete. 2024-04-02T07:28:43.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1b06c00640 1 Processor -- start 2024-04-02T07:28:43.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1b06c00640 1 -- start start 2024-04-02T07:28:43.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1b06c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b000709b0 0x7f1b00148660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:43.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1b06c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b000ccfa0 0x7f1b001538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:43.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1b06c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b001590d0 0x7f1b00153de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:43.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1b06c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b001503d0 con 0x7f1b000ccfa0 2024-04-02T07:28:43.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1b06c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b00150670 con 0x7f1b001590d0 2024-04-02T07:28:43.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1b06c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b0015bdb0 con 0x7f1b000709b0 2024-04-02T07:28:43.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1af7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b000ccfa0 0x7f1b001538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:43.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1affe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b000709b0 0x7f1b00148660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:43.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1af7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b000ccfa0 0x7f1b001538a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59592/0 (socket says 172.21.15.55:59592) 2024-04-02T07:28:43.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1af7400640 1 -- 172.21.15.55:0/2901376041 learned_addr learned my addr 172.21.15.55:0/2901376041 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:43.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.183+0000 7f1b04c00640 1 --2- 172.21.15.55:0/2901376041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b001590d0 0x7f1b00153de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:43.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.187+0000 7f1af7400640 1 -- 172.21.15.55:0/2901376041 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b000709b0 msgr2=0x7f1b00148660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:43.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.187+0000 7f1af7400640 1 --2- 172.21.15.55:0/2901376041 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b000709b0 0x7f1b00148660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:43.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.187+0000 7f1af7400640 1 -- 172.21.15.55:0/2901376041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b001590d0 msgr2=0x7f1b00153de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:43.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.187+0000 7f1af7400640 1 --2- 172.21.15.55:0/2901376041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b001590d0 0x7f1b00153de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:43.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.187+0000 7f1af7400640 1 -- 172.21.15.55:0/2901376041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af8009420 con 0x7f1b000ccfa0 2024-04-02T07:28:43.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.187+0000 7f1af7400640 1 --2- 172.21.15.55:0/2901376041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b000ccfa0 0x7f1b001538a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f1ae800c500 tx=0x7f1ae800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:43.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.187+0000 7f1afcc00640 1 -- 172.21.15.55:0/2901376041 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8005220 con 0x7f1b000ccfa0 2024-04-02T07:28:43.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.187+0000 7f1afcc00640 1 -- 172.21.15.55:0/2901376041 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae8005380 con 0x7f1b000ccfa0 2024-04-02T07:28:43.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.187+0000 7f1b06c00640 1 -- 172.21.15.55:0/2901376041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b0015c050 con 0x7f1b000ccfa0 2024-04-02T07:28:43.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.187+0000 7f1afcc00640 1 -- 172.21.15.55:0/2901376041 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae8007270 con 0x7f1b000ccfa0 2024-04-02T07:28:43.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.187+0000 7f1b06c00640 1 -- 172.21.15.55:0/2901376041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b00148ba0 con 0x7f1b000ccfa0 2024-04-02T07:28:43.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.187+0000 7f1b06c00640 1 -- 172.21.15.55:0/2901376041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b00073530 con 0x7f1b000ccfa0 2024-04-02T07:28:43.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.187+0000 7f1afcc00640 1 -- 172.21.15.55:0/2901376041 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1ae80073d0 con 0x7f1b000ccfa0 2024-04-02T07:28:43.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.187+0000 7f1afcc00640 1 --2- 172.21.15.55:0/2901376041 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1adc066690 0x7f1adc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:43.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.187+0000 7f1afcc00640 1 -- 172.21.15.55:0/2901376041 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f1ae8083ad0 con 0x7f1b000ccfa0 2024-04-02T07:28:43.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.187+0000 7f1affe00640 1 --2- 172.21.15.55:0/2901376041 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1adc066690 0x7f1adc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:43.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.191+0000 7f1affe00640 1 --2- 172.21.15.55:0/2901376041 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1adc066690 0x7f1adc068b50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1af00012f0 tx=0x7f1af0004d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:43.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.195+0000 7f1afcc00640 1 -- 172.21.15.55:0/2901376041 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f1ae8050d70 con 0x7f1b000ccfa0 2024-04-02T07:28:43.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:43.391+0000 7f1b06c00640 1 -- 172.21.15.55:0/2901376041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1b001507e0 con 0x7f1b000ccfa0 2024-04-02T07:28:44.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.007+0000 7f1afcc00640 1 -- 172.21.15.55:0/2901376041 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v54) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1ae8054390 con 0x7f1b000ccfa0 2024-04-02T07:28:44.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.011+0000 7f1b06c00640 1 -- 172.21.15.55:0/2901376041 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1adc066690 msgr2=0x7f1adc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:44.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.011+0000 7f1b06c00640 1 --2- 172.21.15.55:0/2901376041 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1adc066690 0x7f1adc068b50 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f1af00012f0 tx=0x7f1af0004d50 comp rx=0 tx=0).stop 2024-04-02T07:28:44.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.011+0000 7f1b06c00640 1 -- 172.21.15.55:0/2901376041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b000ccfa0 msgr2=0x7f1b001538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:44.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.011+0000 7f1b06c00640 1 --2- 172.21.15.55:0/2901376041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b000ccfa0 0x7f1b001538a0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f1ae800c500 tx=0x7f1ae800c9c0 comp rx=0 tx=0).stop 2024-04-02T07:28:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.011+0000 7f1b06c00640 1 -- 172.21.15.55:0/2901376041 shutdown_connections 2024-04-02T07:28:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.011+0000 7f1b06c00640 1 --2- 172.21.15.55:0/2901376041 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1adc066690 0x7f1adc068b50 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.011+0000 7f1b06c00640 1 --2- 172.21.15.55:0/2901376041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b001590d0 0x7f1b00153de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.011+0000 7f1b06c00640 1 --2- 172.21.15.55:0/2901376041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b000ccfa0 0x7f1b001538a0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.011+0000 7f1b06c00640 1 --2- 172.21.15.55:0/2901376041 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b000709b0 0x7f1b00148660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.011+0000 7f1b06c00640 1 -- 172.21.15.55:0/2901376041 >> 172.21.15.55:0/2901376041 conn(0x7f1b0006a390 msgr2=0x7f1b000ae2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.011+0000 7f1b06c00640 1 -- 172.21.15.55:0/2901376041 shutdown_connections 2024-04-02T07:28:44.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.011+0000 7f1b06c00640 1 -- 172.21.15.55:0/2901376041 wait complete. 2024-04-02T07:28:44.035 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-02T07:28:44.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.227+0000 7f29aea00640 1 Processor -- start 2024-04-02T07:28:44.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.227+0000 7f29aea00640 1 -- start start 2024-04-02T07:28:44.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.227+0000 7f29aea00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f29a8098a10 0x7f29a8098df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:44.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.227+0000 7f29aea00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29a80b11d0 0x7f29a806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:44.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.227+0000 7f29aea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29a80b16a0 0x7f29a81607f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:44.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.227+0000 7f29aea00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a80ce530 con 0x7f29a80b16a0 2024-04-02T07:28:44.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.227+0000 7f29aea00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29a8099330 con 0x7f29a8098a10 2024-04-02T07:28:44.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.227+0000 7f29aea00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a80b0130 con 0x7f29a80b11d0 2024-04-02T07:28:44.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.227+0000 7f29aca00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29a80b16a0 0x7f29a81607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:44.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.227+0000 7f29aca00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f29a80b16a0 0x7f29a81607f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59604/0 (socket says 172.21.15.55:59604) 2024-04-02T07:28:44.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.227+0000 7f29aca00640 1 -- 172.21.15.55:0/3846734614 learned_addr learned my addr 172.21.15.55:0/3846734614 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:44.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.227+0000 7f29a7e00640 1 --2- 172.21.15.55:0/3846734614 >> v2:172.21.15.106:3300/0 conn(0x7f29a8098a10 0x7f29a8098df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:44.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.227+0000 7f299f400640 1 --2- 172.21.15.55:0/3846734614 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29a80b11d0 0x7f29a806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:44.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.227+0000 7f29aca00640 1 -- 172.21.15.55:0/3846734614 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29a80b11d0 msgr2=0x7f29a806b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:44.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.227+0000 7f29aca00640 1 --2- 172.21.15.55:0/3846734614 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29a80b11d0 0x7f29a806b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:44.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.227+0000 7f29aca00640 1 -- 172.21.15.55:0/3846734614 >> v2:172.21.15.106:3300/0 conn(0x7f29a8098a10 msgr2=0x7f29a8098df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:44.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.227+0000 7f29aca00640 1 --2- 172.21.15.55:0/3846734614 >> v2:172.21.15.106:3300/0 conn(0x7f29a8098a10 0x7f29a8098df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:44.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.227+0000 7f29aca00640 1 -- 172.21.15.55:0/3846734614 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a80b0410 con 0x7f29a80b16a0 2024-04-02T07:28:44.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.231+0000 7f29aca00640 1 --2- 172.21.15.55:0/3846734614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29a80b16a0 0x7f29a81607f0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f29a80b21a0 tx=0x7f29a001c670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=966ba8de128ad002 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:44.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.231+0000 7f29a7400640 1 -- 172.21.15.55:0/3846734614 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00a6500 con 0x7f29a80b16a0 2024-04-02T07:28:44.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.231+0000 7f29a7400640 1 -- 172.21.15.55:0/3846734614 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a00a6660 con 0x7f29a80b16a0 2024-04-02T07:28:44.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.231+0000 7f29a7400640 1 -- 172.21.15.55:0/3846734614 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a00a69f0 con 0x7f29a80b16a0 2024-04-02T07:28:44.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.231+0000 7f29aea00640 1 -- 172.21.15.55:0/3846734614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29a80b16a0 msgr2=0x7f29a81607f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:44.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.231+0000 7f29aea00640 1 --2- 172.21.15.55:0/3846734614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29a80b16a0 0x7f29a81607f0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f29a80b21a0 tx=0x7f29a001c670 comp rx=0 tx=0).stop 2024-04-02T07:28:44.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.231+0000 7f29aea00640 1 -- 172.21.15.55:0/3846734614 shutdown_connections 2024-04-02T07:28:44.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.231+0000 7f29aea00640 1 --2- 172.21.15.55:0/3846734614 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29a80b16a0 0x7f29a81607f0 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:44.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.231+0000 7f29aea00640 1 --2- 172.21.15.55:0/3846734614 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29a80b11d0 0x7f29a806b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:44.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.231+0000 7f29aea00640 1 --2- 172.21.15.55:0/3846734614 >> v2:172.21.15.106:3300/0 conn(0x7f29a8098a10 0x7f29a8098df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:44.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.231+0000 7f29aea00640 1 -- 172.21.15.55:0/3846734614 >> 172.21.15.55:0/3846734614 conn(0x7f29a80b21d0 msgr2=0x7f29a80b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:44.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.231+0000 7f29aea00640 1 -- 172.21.15.55:0/3846734614 shutdown_connections 2024-04-02T07:28:44.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.231+0000 7f29aea00640 1 -- 172.21.15.55:0/3846734614 wait complete. 2024-04-02T07:28:44.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f29aea00640 1 Processor -- start 2024-04-02T07:28:44.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f29aea00640 1 -- start start 2024-04-02T07:28:44.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f29aea00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29a8098a10 0x7f29a8157ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:44.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f29aea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29a80b11d0 0x7f29a815cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:44.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f29aea00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29a80b16a0 0x7f29a815dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:44.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f29aea00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a815d8d0 con 0x7f29a80b11d0 2024-04-02T07:28:44.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f29aea00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a8158220 con 0x7f29a80b16a0 2024-04-02T07:28:44.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f29aea00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29a815d5f0 con 0x7f29a8098a10 2024-04-02T07:28:44.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f299f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29a80b11d0 0x7f29a815cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:44.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f299f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29a80b11d0 0x7f29a815cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59606/0 (socket says 172.21.15.55:59606) 2024-04-02T07:28:44.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f299f400640 1 -- 172.21.15.55:0/2884055314 learned_addr learned my addr 172.21.15.55:0/2884055314 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:44.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f29aca00640 1 --2- 172.21.15.55:0/2884055314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29a80b16a0 0x7f29a815dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:44.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f29a7e00640 1 --2- 172.21.15.55:0/2884055314 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29a8098a10 0x7f29a8157ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:44.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f299f400640 1 -- 172.21.15.55:0/2884055314 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29a8098a10 msgr2=0x7f29a8157ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:44.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f299f400640 1 --2- 172.21.15.55:0/2884055314 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29a8098a10 0x7f29a8157ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:44.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f299f400640 1 -- 172.21.15.55:0/2884055314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29a80b16a0 msgr2=0x7f29a815dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:44.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f299f400640 1 --2- 172.21.15.55:0/2884055314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29a80b16a0 0x7f29a815dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:44.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f299f400640 1 -- 172.21.15.55:0/2884055314 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29a0009b30 con 0x7f29a80b11d0 2024-04-02T07:28:44.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f29aca00640 1 --2- 172.21.15.55:0/2884055314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29a80b16a0 0x7f29a815dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:44.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f299f400640 1 --2- 172.21.15.55:0/2884055314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29a80b11d0 0x7f29a815cda0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f299000d800 tx=0x7f299000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:44.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f29a4c00640 1 -- 172.21.15.55:0/2884055314 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299000b6c0 con 0x7f29a80b11d0 2024-04-02T07:28:44.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f29a4c00640 1 -- 172.21.15.55:0/2884055314 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299000b820 con 0x7f29a80b11d0 2024-04-02T07:28:44.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f29a4c00640 1 -- 172.21.15.55:0/2884055314 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299000bb90 con 0x7f29a80b11d0 2024-04-02T07:28:44.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f29aea00640 1 -- 172.21.15.55:0/2884055314 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a80b34a0 con 0x7f29a80b11d0 2024-04-02T07:28:44.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f29aea00640 1 -- 172.21.15.55:0/2884055314 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a80b3a60 con 0x7f29a80b11d0 2024-04-02T07:28:44.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.235+0000 7f29aea00640 1 -- 172.21.15.55:0/2884055314 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a80b3c20 con 0x7f29a80b11d0 2024-04-02T07:28:44.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.239+0000 7f29a4c00640 1 -- 172.21.15.55:0/2884055314 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f299000bcf0 con 0x7f29a80b11d0 2024-04-02T07:28:44.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.239+0000 7f29a4c00640 1 --2- 172.21.15.55:0/2884055314 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2984066690 0x7f2984068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:44.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.239+0000 7f29a4c00640 1 -- 172.21.15.55:0/2884055314 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f29900847e0 con 0x7f29a80b11d0 2024-04-02T07:28:44.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.239+0000 7f29a7e00640 1 --2- 172.21.15.55:0/2884055314 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2984066690 0x7f2984068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:44.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.239+0000 7f29a7e00640 1 --2- 172.21.15.55:0/2884055314 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2984066690 0x7f2984068b50 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f299800ba30 tx=0x7f2998008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:44.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.243+0000 7f29a4c00640 1 -- 172.21.15.55:0/2884055314 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2990051a50 con 0x7f29a80b11d0 2024-04-02T07:28:44.359 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:28:44.363 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:28:44.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:44.407+0000 7f29aea00640 1 -- 172.21.15.55:0/2884055314 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f29a8066c90 con 0x7f29a80b11d0 2024-04-02T07:28:45.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.415+0000 7f29a4c00640 1 -- 172.21.15.55:0/2884055314 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v77) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2990055070 con 0x7f29a80b11d0 2024-04-02T07:28:45.417 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2024-04-02T07:28:45.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.419+0000 7f29aea00640 1 -- 172.21.15.55:0/2884055314 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2984066690 msgr2=0x7f2984068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:45.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.419+0000 7f29aea00640 1 --2- 172.21.15.55:0/2884055314 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2984066690 0x7f2984068b50 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f299800ba30 tx=0x7f2998008040 comp rx=0 tx=0).stop 2024-04-02T07:28:45.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.419+0000 7f29aea00640 1 -- 172.21.15.55:0/2884055314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29a80b11d0 msgr2=0x7f29a815cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:45.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.419+0000 7f29aea00640 1 --2- 172.21.15.55:0/2884055314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29a80b11d0 0x7f29a815cda0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f299000d800 tx=0x7f299000dcc0 comp rx=0 tx=0).stop 2024-04-02T07:28:45.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.419+0000 7f29aea00640 1 -- 172.21.15.55:0/2884055314 shutdown_connections 2024-04-02T07:28:45.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.419+0000 7f29aea00640 1 --2- 172.21.15.55:0/2884055314 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2984066690 0x7f2984068b50 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:45.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.419+0000 7f29aea00640 1 --2- 172.21.15.55:0/2884055314 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f29a80b16a0 0x7f29a815dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:45.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.419+0000 7f29aea00640 1 --2- 172.21.15.55:0/2884055314 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29a80b11d0 0x7f29a815cda0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:45.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.419+0000 7f29aea00640 1 --2- 172.21.15.55:0/2884055314 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29a8098a10 0x7f29a8157ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:45.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.419+0000 7f29aea00640 1 -- 172.21.15.55:0/2884055314 >> 172.21.15.55:0/2884055314 conn(0x7f29a80b21d0 msgr2=0x7f29a815b060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:45.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.419+0000 7f29aea00640 1 -- 172.21.15.55:0/2884055314 shutdown_connections 2024-04-02T07:28:45.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.419+0000 7f29aea00640 1 -- 172.21.15.55:0/2884055314 wait complete. 2024-04-02T07:28:45.445 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-02T07:28:45.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.591+0000 7fc0a6c00640 1 Processor -- start 2024-04-02T07:28:45.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.591+0000 7fc0a6c00640 1 -- start start 2024-04-02T07:28:45.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.595+0000 7fc0a6c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0a0069e90 0x7fc0a00cc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:45.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.595+0000 7fc0a6c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc0a00ccea0 0x7fc0a006da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:45.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.595+0000 7fc0a6c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0a006d590 con 0x7fc0a00b3bb0 2024-04-02T07:28:45.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.595+0000 7fc0a6c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a00cd2d0 con 0x7fc0a0069e90 2024-04-02T07:28:45.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.595+0000 7fc0a6c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0a006b690 con 0x7fc0a00ccea0 2024-04-02T07:28:45.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.595+0000 7fc097e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0a0069e90 0x7fc0a00cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:45.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.595+0000 7fc097e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc0a0069e90 0x7fc0a00cc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55032/0 (socket says 172.21.15.55:55032) 2024-04-02T07:28:45.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.595+0000 7fc097e00640 1 -- 172.21.15.55:0/510713569 learned_addr learned my addr 172.21.15.55:0/510713569 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:45.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.595+0000 7fc097e00640 1 -- 172.21.15.55:0/510713569 >> v2:172.21.15.106:3300/0 conn(0x7fc0a00ccea0 msgr2=0x7fc0a006da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:45.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.595+0000 7fc0a4c00640 1 --2- 172.21.15.55:0/510713569 >> v2:172.21.15.106:3300/0 conn(0x7fc0a00ccea0 0x7fc0a006da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:45.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.595+0000 7fc097e00640 1 --2- 172.21.15.55:0/510713569 >> v2:172.21.15.106:3300/0 conn(0x7fc0a00ccea0 0x7fc0a006da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:45.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.595+0000 7fc097e00640 1 -- 172.21.15.55:0/510713569 >> v1:172.21.15.106:6789/0 conn(0x7fc0a00b3bb0 legacy=0x7fc0a006ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:45.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.595+0000 7fc097e00640 1 -- 172.21.15.55:0/510713569 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a006cc60 con 0x7fc0a0069e90 2024-04-02T07:28:45.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.595+0000 7fc0a4c00640 1 --2- 172.21.15.55:0/510713569 >> v2:172.21.15.106:3300/0 conn(0x7fc0a00ccea0 0x7fc0a006da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:28:45.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.595+0000 7fc097e00640 1 --2- 172.21.15.55:0/510713569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0a0069e90 0x7fc0a00cc960 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00cfcf0 tx=0x7fc08801d880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc74852539d3cde7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc09f400640 1 -- 172.21.15.55:0/510713569 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0880a68b0 con 0x7fc0a0069e90 2024-04-02T07:28:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc09f400640 1 -- 172.21.15.55:0/510713569 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0880a6a10 con 0x7fc0a0069e90 2024-04-02T07:28:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc09f400640 1 -- 172.21.15.55:0/510713569 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0880a6da0 con 0x7fc0a0069e90 2024-04-02T07:28:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc0a6c00640 1 -- 172.21.15.55:0/510713569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0a0069e90 msgr2=0x7fc0a00cc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc0a6c00640 1 --2- 172.21.15.55:0/510713569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0a0069e90 0x7fc0a00cc960 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7fc0a00cfcf0 tx=0x7fc08801d880 comp rx=0 tx=0).stop 2024-04-02T07:28:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc0a6c00640 1 -- 172.21.15.55:0/510713569 shutdown_connections 2024-04-02T07:28:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc0a6c00640 1 --2- 172.21.15.55:0/510713569 >> v2:172.21.15.106:3300/0 conn(0x7fc0a00ccea0 0x7fc0a006da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:45.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc0a6c00640 1 --2- 172.21.15.55:0/510713569 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0a0069e90 0x7fc0a00cc960 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:45.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc0a6c00640 1 -- 172.21.15.55:0/510713569 >> 172.21.15.55:0/510713569 conn(0x7fc0a00ced90 msgr2=0x7fc0a00cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:45.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc0a6c00640 1 -- 172.21.15.55:0/510713569 shutdown_connections 2024-04-02T07:28:45.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc0a6c00640 1 -- 172.21.15.55:0/510713569 wait complete. 2024-04-02T07:28:45.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc0a6c00640 1 Processor -- start 2024-04-02T07:28:45.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc0a6c00640 1 -- start start 2024-04-02T07:28:45.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc0a6c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0a0069e90 0x7fc0a009b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:45.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc0a6c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0a00ccea0 0x7fc0a009b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:45.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc0a6c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0a0142290 0x7fc0a0142740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:45.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc0a6c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a009cc40 con 0x7fc0a0142290 2024-04-02T07:28:45.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc0a6c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a0154bb0 con 0x7fc0a0069e90 2024-04-02T07:28:45.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc0a6c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a0157890 con 0x7fc0a00ccea0 2024-04-02T07:28:45.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc0a4c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0a0142290 0x7fc0a0142740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:45.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc0a4c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0a0142290 0x7fc0a0142740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55048/0 (socket says 172.21.15.55:55048) 2024-04-02T07:28:45.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc0a4c00640 1 -- 172.21.15.55:0/3359487089 learned_addr learned my addr 172.21.15.55:0/3359487089 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:45.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc097e00640 1 --2- 172.21.15.55:0/3359487089 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0a00ccea0 0x7fc0a009b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:45.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.599+0000 7fc09fe00640 1 --2- 172.21.15.55:0/3359487089 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0a0069e90 0x7fc0a009b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:45.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.603+0000 7fc0a4c00640 1 -- 172.21.15.55:0/3359487089 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0a00ccea0 msgr2=0x7fc0a009b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:45.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.603+0000 7fc0a4c00640 1 --2- 172.21.15.55:0/3359487089 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0a00ccea0 0x7fc0a009b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:45.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.603+0000 7fc0a4c00640 1 -- 172.21.15.55:0/3359487089 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0a0069e90 msgr2=0x7fc0a009b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:45.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.603+0000 7fc0a4c00640 1 --2- 172.21.15.55:0/3359487089 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0a0069e90 0x7fc0a009b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:45.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.603+0000 7fc0a4c00640 1 -- 172.21.15.55:0/3359487089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc08800a670 con 0x7fc0a0142290 2024-04-02T07:28:45.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.603+0000 7fc0a4c00640 1 --2- 172.21.15.55:0/3359487089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0a0142290 0x7fc0a0142740 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fc09800cd80 tx=0x7fc09800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:45.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.603+0000 7fc09cc00640 1 -- 172.21.15.55:0/3359487089 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09800f680 con 0x7fc0a0142290 2024-04-02T07:28:45.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.603+0000 7fc09cc00640 1 -- 172.21.15.55:0/3359487089 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc09800f800 con 0x7fc0a0142290 2024-04-02T07:28:45.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.603+0000 7fc09cc00640 1 -- 172.21.15.55:0/3359487089 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09800fbb0 con 0x7fc0a0142290 2024-04-02T07:28:45.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.603+0000 7fc0a6c00640 1 -- 172.21.15.55:0/3359487089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a01575b0 con 0x7fc0a0142290 2024-04-02T07:28:45.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.603+0000 7fc0a6c00640 1 -- 172.21.15.55:0/3359487089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a0140610 con 0x7fc0a0142290 2024-04-02T07:28:45.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.603+0000 7fc0a6c00640 1 -- 172.21.15.55:0/3359487089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0a00cc770 con 0x7fc0a0142290 2024-04-02T07:28:45.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.603+0000 7fc09cc00640 1 -- 172.21.15.55:0/3359487089 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc09800b040 con 0x7fc0a0142290 2024-04-02T07:28:45.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.603+0000 7fc09cc00640 1 --2- 172.21.15.55:0/3359487089 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc07c0666c0 0x7fc07c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:45.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.603+0000 7fc09cc00640 1 -- 172.21.15.55:0/3359487089 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5501+0+0 (secure 0 0 0) 0x7fc098084840 con 0x7fc0a0142290 2024-04-02T07:28:45.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.603+0000 7fc09fe00640 1 --2- 172.21.15.55:0/3359487089 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc07c0666c0 0x7fc07c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:45.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.607+0000 7fc09fe00640 1 --2- 172.21.15.55:0/3359487089 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc07c0666c0 0x7fc07c068b80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc090007fd0 tx=0x7fc090007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:45.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.607+0000 7fc09cc00640 1 -- 172.21.15.55:0/3359487089 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc098051dc0 con 0x7fc0a0142290 2024-04-02T07:28:45.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:45.771+0000 7fc0a6c00640 1 -- 172.21.15.55:0/3359487089 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc0a0066c90 con 0x7fc0a0142290 2024-04-02T07:28:46.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.419+0000 7fc09cc00640 1 -- 172.21.15.55:0/3359487089 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v78) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc09801d020 con 0x7fc0a0142290 2024-04-02T07:28:46.421 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2024-04-02T07:28:46.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.423+0000 7fc0a6c00640 1 -- 172.21.15.55:0/3359487089 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc07c0666c0 msgr2=0x7fc07c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:46.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.423+0000 7fc0a6c00640 1 --2- 172.21.15.55:0/3359487089 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc07c0666c0 0x7fc07c068b80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc090007fd0 tx=0x7fc090007e40 comp rx=0 tx=0).stop 2024-04-02T07:28:46.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.423+0000 7fc0a6c00640 1 -- 172.21.15.55:0/3359487089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0a0142290 msgr2=0x7fc0a0142740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:46.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.423+0000 7fc0a6c00640 1 --2- 172.21.15.55:0/3359487089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0a0142290 0x7fc0a0142740 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7fc09800cd80 tx=0x7fc09800a650 comp rx=0 tx=0).stop 2024-04-02T07:28:46.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.423+0000 7fc0a6c00640 1 -- 172.21.15.55:0/3359487089 shutdown_connections 2024-04-02T07:28:46.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.423+0000 7fc0a6c00640 1 --2- 172.21.15.55:0/3359487089 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0a0142290 0x7fc0a0142740 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:46.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.423+0000 7fc0a6c00640 1 --2- 172.21.15.55:0/3359487089 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0a00ccea0 0x7fc0a009b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:46.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.423+0000 7fc0a6c00640 1 --2- 172.21.15.55:0/3359487089 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc07c0666c0 0x7fc07c068b80 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:46.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.423+0000 7fc0a6c00640 1 --2- 172.21.15.55:0/3359487089 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0a0069e90 0x7fc0a009b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:46.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.423+0000 7fc0a6c00640 1 -- 172.21.15.55:0/3359487089 >> 172.21.15.55:0/3359487089 conn(0x7fc0a00ced90 msgr2=0x7fc0a01585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:46.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.423+0000 7fc0a6c00640 1 -- 172.21.15.55:0/3359487089 shutdown_connections 2024-04-02T07:28:46.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.423+0000 7fc0a6c00640 1 -- 172.21.15.55:0/3359487089 wait complete. 2024-04-02T07:28:46.453 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-02T07:28:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.607+0000 7f8d54200640 1 Processor -- start 2024-04-02T07:28:46.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.607+0000 7f8d54200640 1 -- start start 2024-04-02T07:28:46.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.607+0000 7f8d54200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8d4c15ca60 0x7f8d4c0cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:46.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.607+0000 7f8d54200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8d4c06c030 0x7f8d4c098ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.607+0000 7f8d54200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4c15ce40 con 0x7f8d4c098a10 2024-04-02T07:28:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.607+0000 7f8d54200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4c0993e0 con 0x7f8d4c15ca60 2024-04-02T07:28:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.607+0000 7f8d54200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4c06c440 con 0x7f8d4c06c030 2024-04-02T07:28:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.607+0000 7f8d51800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8d4c15ca60 0x7f8d4c0cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.607+0000 7f8d50e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8d4c098a10 0x7f8d4c06b920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34874/0 (socket says 172.21.15.55:34874) 2024-04-02T07:28:46.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.607+0000 7f8d50e00640 1 -- 172.21.15.55:0/913361832 learned_addr learned my addr 172.21.15.55:0/913361832 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:46.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.611+0000 7f8d52200640 1 --2- 172.21.15.55:0/913361832 >> v2:172.21.15.106:3300/0 conn(0x7f8d4c06c030 0x7f8d4c098ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:46.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.611+0000 7f8d4be00640 1 -- 172.21.15.55:0/913361832 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3959798201 0 0) 0x7f8d4c15ce40 con 0x7f8d4c098a10 2024-04-02T07:28:46.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.611+0000 7f8d51800640 1 -- 172.21.15.55:0/913361832 >> v2:172.21.15.106:3300/0 conn(0x7f8d4c06c030 msgr2=0x7f8d4c098ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:46.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.611+0000 7f8d51800640 1 --2- 172.21.15.55:0/913361832 >> v2:172.21.15.106:3300/0 conn(0x7f8d4c06c030 0x7f8d4c098ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:46.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.611+0000 7f8d51800640 1 -- 172.21.15.55:0/913361832 >> v1:172.21.15.55:6789/0 conn(0x7f8d4c098a10 legacy=0x7f8d4c06b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:46.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.611+0000 7f8d51800640 1 -- 172.21.15.55:0/913361832 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4c0d01b0 con 0x7f8d4c15ca60 2024-04-02T07:28:46.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.611+0000 7f8d52200640 1 --2- 172.21.15.55:0/913361832 >> v2:172.21.15.106:3300/0 conn(0x7f8d4c06c030 0x7f8d4c098ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:46.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.611+0000 7f8d51800640 1 --2- 172.21.15.55:0/913361832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d4c15ca60 0x7f8d4c0cfc70 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c09e5a0 tx=0x7f8d4001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fa01e2693b70e5e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:46.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.611+0000 7f8d4be00640 1 -- 172.21.15.55:0/913361832 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d400ac620 con 0x7f8d4c15ca60 2024-04-02T07:28:46.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.611+0000 7f8d4be00640 1 -- 172.21.15.55:0/913361832 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d400ac780 con 0x7f8d4c15ca60 2024-04-02T07:28:46.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.611+0000 7f8d4be00640 1 -- 172.21.15.55:0/913361832 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d400acb10 con 0x7f8d4c15ca60 2024-04-02T07:28:46.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d54200640 1 -- 172.21.15.55:0/913361832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d4c15ca60 msgr2=0x7f8d4c0cfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:46.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d54200640 1 --2- 172.21.15.55:0/913361832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d4c15ca60 0x7f8d4c0cfc70 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c09e5a0 tx=0x7f8d4001c3c0 comp rx=0 tx=0).stop 2024-04-02T07:28:46.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d54200640 1 -- 172.21.15.55:0/913361832 shutdown_connections 2024-04-02T07:28:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d54200640 1 --2- 172.21.15.55:0/913361832 >> v2:172.21.15.106:3300/0 conn(0x7f8d4c06c030 0x7f8d4c098ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d54200640 1 --2- 172.21.15.55:0/913361832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d4c15ca60 0x7f8d4c0cfc70 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d54200640 1 -- 172.21.15.55:0/913361832 >> 172.21.15.55:0/913361832 conn(0x7f8d4c0b2150 msgr2=0x7f8d4c0b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d54200640 1 -- 172.21.15.55:0/913361832 shutdown_connections 2024-04-02T07:28:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d54200640 1 -- 172.21.15.55:0/913361832 wait complete. 2024-04-02T07:28:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d54200640 1 Processor -- start 2024-04-02T07:28:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d54200640 1 -- start start 2024-04-02T07:28:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d54200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d4c06c030 0x7f8d4c152e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d54200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d4c098a10 0x7f8d4c0b5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:46.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d54200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8d4c15ca60 0x7f8d4c0c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:46.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d54200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c159ab0 con 0x7f8d4c06c030 2024-04-02T07:28:46.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d54200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c159d90 con 0x7f8d4c098a10 2024-04-02T07:28:46.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d54200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4c15a070 con 0x7f8d4c15ca60 2024-04-02T07:28:46.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d51800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d4c06c030 0x7f8d4c152e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:46.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d51800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d4c06c030 0x7f8d4c152e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55062/0 (socket says 172.21.15.55:55062) 2024-04-02T07:28:46.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d51800640 1 -- 172.21.15.55:0/846229054 learned_addr learned my addr 172.21.15.55:0/846229054 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:46.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d50e00640 1 --2- 172.21.15.55:0/846229054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d4c098a10 0x7f8d4c0b5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:46.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d52200640 1 --2- 172.21.15.55:0/846229054 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8d4c15ca60 0x7f8d4c0c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d51800640 1 -- 172.21.15.55:0/846229054 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8d4c15ca60 msgr2=0x7f8d4c0c4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d51800640 1 --2- 172.21.15.55:0/846229054 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8d4c15ca60 0x7f8d4c0c4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d51800640 1 -- 172.21.15.55:0/846229054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d4c098a10 msgr2=0x7f8d4c0b5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d51800640 1 --2- 172.21.15.55:0/846229054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d4c098a10 0x7f8d4c0b5830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d51800640 1 -- 172.21.15.55:0/846229054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d40009420 con 0x7f8d4c06c030 2024-04-02T07:28:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d52200640 1 --2- 172.21.15.55:0/846229054 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8d4c15ca60 0x7f8d4c0c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.615+0000 7f8d51800640 1 --2- 172.21.15.55:0/846229054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d4c06c030 0x7f8d4c152e60 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f8d40000c10 tx=0x7f8d4001ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:46.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.619+0000 7f8d49600640 1 -- 172.21.15.55:0/846229054 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d400ac620 con 0x7f8d4c06c030 2024-04-02T07:28:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.619+0000 7f8d49600640 1 -- 172.21.15.55:0/846229054 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d40004030 con 0x7f8d4c06c030 2024-04-02T07:28:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.619+0000 7f8d49600640 1 -- 172.21.15.55:0/846229054 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d400043c0 con 0x7f8d4c06c030 2024-04-02T07:28:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.619+0000 7f8d54200640 1 -- 172.21.15.55:0/846229054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4c15a350 con 0x7f8d4c06c030 2024-04-02T07:28:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.619+0000 7f8d54200640 1 -- 172.21.15.55:0/846229054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d4c0c6ed0 con 0x7f8d4c06c030 2024-04-02T07:28:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.619+0000 7f8d54200640 1 -- 172.21.15.55:0/846229054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4c159bf0 con 0x7f8d4c06c030 2024-04-02T07:28:46.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.619+0000 7f8d49600640 1 -- 172.21.15.55:0/846229054 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8d400aa070 con 0x7f8d4c06c030 2024-04-02T07:28:46.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.619+0000 7f8d49600640 1 --2- 172.21.15.55:0/846229054 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8d2c066690 0x7f8d2c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:46.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.619+0000 7f8d49600640 1 -- 172.21.15.55:0/846229054 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8d4011e4e0 con 0x7f8d4c06c030 2024-04-02T07:28:46.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.619+0000 7f8d50e00640 1 --2- 172.21.15.55:0/846229054 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8d2c066690 0x7f8d2c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:46.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.623+0000 7f8d50e00640 1 --2- 172.21.15.55:0/846229054 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8d2c066690 0x7f8d2c068b50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c0b6240 tx=0x7f8d38007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:46.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.623+0000 7f8d49600640 1 -- 172.21.15.55:0/846229054 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f8d4c159bf0 con 0x7f8d4c06c030 2024-04-02T07:28:46.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.783+0000 7f8d54200640 1 -- 172.21.15.55:0/846229054 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8d4c159bf0 con 0x7f8d4c06c030 2024-04-02T07:28:46.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.791+0000 7f8d49600640 1 -- 172.21.15.55:0/846229054 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8d4c159bf0 con 0x7f8d4c06c030 2024-04-02T07:28:46.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.791+0000 7f8d54200640 1 -- 172.21.15.55:0/846229054 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8d2c066690 msgr2=0x7f8d2c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:46.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.791+0000 7f8d54200640 1 --2- 172.21.15.55:0/846229054 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8d2c066690 0x7f8d2c068b50 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c0b6240 tx=0x7f8d38007df0 comp rx=0 tx=0).stop 2024-04-02T07:28:46.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.791+0000 7f8d54200640 1 -- 172.21.15.55:0/846229054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d4c06c030 msgr2=0x7f8d4c152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:46.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.791+0000 7f8d54200640 1 --2- 172.21.15.55:0/846229054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d4c06c030 0x7f8d4c152e60 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f8d40000c10 tx=0x7f8d4001ac00 comp rx=0 tx=0).stop 2024-04-02T07:28:46.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.791+0000 7f8d54200640 1 -- 172.21.15.55:0/846229054 shutdown_connections 2024-04-02T07:28:46.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.791+0000 7f8d54200640 1 --2- 172.21.15.55:0/846229054 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8d4c15ca60 0x7f8d4c0c4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:46.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.791+0000 7f8d54200640 1 --2- 172.21.15.55:0/846229054 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8d2c066690 0x7f8d2c068b50 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:46.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.791+0000 7f8d54200640 1 --2- 172.21.15.55:0/846229054 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8d4c098a10 0x7f8d4c0b5830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:46.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.791+0000 7f8d54200640 1 --2- 172.21.15.55:0/846229054 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8d4c06c030 0x7f8d4c152e60 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:46.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.791+0000 7f8d54200640 1 -- 172.21.15.55:0/846229054 >> 172.21.15.55:0/846229054 conn(0x7f8d4c0b2150 msgr2=0x7f8d4c0aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:46.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.791+0000 7f8d54200640 1 -- 172.21.15.55:0/846229054 shutdown_connections 2024-04-02T07:28:46.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.791+0000 7f8d54200640 1 -- 172.21.15.55:0/846229054 wait complete. 2024-04-02T07:28:46.812 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair' 2024-04-02T07:28:46.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.951+0000 7f1d25800640 1 Processor -- start 2024-04-02T07:28:46.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.951+0000 7f1d25800640 1 -- start start 2024-04-02T07:28:46.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.955+0000 7f1d25800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d200b0cb0 0x7f1d200b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:46.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.955+0000 7f1d25800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1d200c3680 0x7f1d2015c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:46.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.955+0000 7f1d25800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2015d250 con 0x7f1d2015ce40 2024-04-02T07:28:46.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.955+0000 7f1d25800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d200b1090 con 0x7f1d200b0cb0 2024-04-02T07:28:46.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.955+0000 7f1d25800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d200cac90 con 0x7f1d200c3680 2024-04-02T07:28:46.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.955+0000 7f1d1ea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d200b0cb0 0x7f1d200b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:46.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.955+0000 7f1d1f400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1d2015ce40 0x7f1d200cbe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34884/0 (socket says 172.21.15.55:34884) 2024-04-02T07:28:46.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.955+0000 7f1d1f400640 1 -- 172.21.15.55:0/1525505333 learned_addr learned my addr 172.21.15.55:0/1525505333 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:46.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.955+0000 7f1d16000640 1 --2- 172.21.15.55:0/1525505333 >> v2:172.21.15.106:3300/0 conn(0x7f1d200c3680 0x7f1d2015c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:46.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.955+0000 7f1d1ea00640 1 -- 172.21.15.55:0/1525505333 >> v2:172.21.15.106:3300/0 conn(0x7f1d200c3680 msgr2=0x7f1d2015c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:46.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.955+0000 7f1d1ea00640 1 --2- 172.21.15.55:0/1525505333 >> v2:172.21.15.106:3300/0 conn(0x7f1d200c3680 0x7f1d2015c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:46.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.955+0000 7f1d1ea00640 1 -- 172.21.15.55:0/1525505333 >> v1:172.21.15.55:6789/0 conn(0x7f1d2015ce40 legacy=0x7f1d200cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:46.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.955+0000 7f1d1e000640 1 -- 172.21.15.55:0/1525505333 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 212387644 0 0) 0x7f1d2015d250 con 0x7f1d2015ce40 2024-04-02T07:28:46.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.955+0000 7f1d1ea00640 1 -- 172.21.15.55:0/1525505333 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d200caf70 con 0x7f1d200b0cb0 2024-04-02T07:28:46.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d1ea00640 1 --2- 172.21.15.55:0/1525505333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d200b0cb0 0x7f1d200b3590 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f1d200b13f0 tx=0x7f1d1001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b246d54e47a39840 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:46.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d1e000640 1 -- 172.21.15.55:0/1525505333 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d100ab600 con 0x7f1d200b0cb0 2024-04-02T07:28:46.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d1e000640 1 -- 172.21.15.55:0/1525505333 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d100a7050 con 0x7f1d200b0cb0 2024-04-02T07:28:46.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d1e000640 1 -- 172.21.15.55:0/1525505333 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d100ab980 con 0x7f1d200b0cb0 2024-04-02T07:28:46.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d25800640 1 -- 172.21.15.55:0/1525505333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d200b0cb0 msgr2=0x7f1d200b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:46.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d25800640 1 --2- 172.21.15.55:0/1525505333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d200b0cb0 0x7f1d200b3590 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f1d200b13f0 tx=0x7f1d1001c450 comp rx=0 tx=0).stop 2024-04-02T07:28:46.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d25800640 1 -- 172.21.15.55:0/1525505333 shutdown_connections 2024-04-02T07:28:46.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d25800640 1 --2- 172.21.15.55:0/1525505333 >> v2:172.21.15.106:3300/0 conn(0x7f1d200c3680 0x7f1d2015c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:46.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d25800640 1 --2- 172.21.15.55:0/1525505333 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d200b0cb0 0x7f1d200b3590 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:46.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d25800640 1 -- 172.21.15.55:0/1525505333 >> 172.21.15.55:0/1525505333 conn(0x7f1d20066080 msgr2=0x7f1d20069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:46.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d25800640 1 -- 172.21.15.55:0/1525505333 shutdown_connections 2024-04-02T07:28:46.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d25800640 1 -- 172.21.15.55:0/1525505333 wait complete. 2024-04-02T07:28:46.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d25800640 1 Processor -- start 2024-04-02T07:28:46.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d25800640 1 -- start start 2024-04-02T07:28:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d25800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1d200b0cb0 0x7f1d2013b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d25800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d200c3680 0x7f1d2013ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d25800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2015ce40 0x7f1d20156010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d25800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d201568b0 con 0x7f1d2015ce40 2024-04-02T07:28:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d25800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d20156b90 con 0x7f1d200c3680 2024-04-02T07:28:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d25800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d20156e70 con 0x7f1d200b0cb0 2024-04-02T07:28:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d1f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2015ce40 0x7f1d20156010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d1f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2015ce40 0x7f1d20156010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55086/0 (socket says 172.21.15.55:55086) 2024-04-02T07:28:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d1f400640 1 -- 172.21.15.55:0/2352897406 learned_addr learned my addr 172.21.15.55:0/2352897406 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:46.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.959+0000 7f1d16000640 1 --2- 172.21.15.55:0/2352897406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d200c3680 0x7f1d2013ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.963+0000 7f1d1ea00640 1 --2- 172.21.15.55:0/2352897406 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1d200b0cb0 0x7f1d2013b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.963+0000 7f1d1f400640 1 -- 172.21.15.55:0/2352897406 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1d200b0cb0 msgr2=0x7f1d2013b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.963+0000 7f1d1f400640 1 --2- 172.21.15.55:0/2352897406 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1d200b0cb0 0x7f1d2013b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.963+0000 7f1d1f400640 1 -- 172.21.15.55:0/2352897406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d200c3680 msgr2=0x7f1d2013ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.963+0000 7f1d1f400640 1 --2- 172.21.15.55:0/2352897406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d200c3680 0x7f1d2013ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.963+0000 7f1d1f400640 1 -- 172.21.15.55:0/2352897406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d10009420 con 0x7f1d2015ce40 2024-04-02T07:28:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.963+0000 7f1d1f400640 1 --2- 172.21.15.55:0/2352897406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2015ce40 0x7f1d20156010 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800caf0 tx=0x7f1d180021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.963+0000 7f1d17400640 1 -- 172.21.15.55:0/2352897406 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1800ac00 con 0x7f1d2015ce40 2024-04-02T07:28:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.963+0000 7f1d17400640 1 -- 172.21.15.55:0/2352897406 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1800ad60 con 0x7f1d2015ce40 2024-04-02T07:28:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.963+0000 7f1d17400640 1 -- 172.21.15.55:0/2352897406 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d18012640 con 0x7f1d2015ce40 2024-04-02T07:28:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.963+0000 7f1d25800640 1 -- 172.21.15.55:0/2352897406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d20157150 con 0x7f1d2015ce40 2024-04-02T07:28:46.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.963+0000 7f1d25800640 1 -- 172.21.15.55:0/2352897406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d20156550 con 0x7f1d2015ce40 2024-04-02T07:28:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.963+0000 7f1d25800640 1 -- 172.21.15.55:0/2352897406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2013f3a0 con 0x7f1d2015ce40 2024-04-02T07:28:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.963+0000 7f1d17400640 1 -- 172.21.15.55:0/2352897406 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1d180127a0 con 0x7f1d2015ce40 2024-04-02T07:28:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.963+0000 7f1d17400640 1 --2- 172.21.15.55:0/2352897406 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1cfc066690 0x7f1cfc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.963+0000 7f1d17400640 1 -- 172.21.15.55:0/2352897406 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f1d180842f0 con 0x7f1d2015ce40 2024-04-02T07:28:46.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.967+0000 7f1d1ea00640 1 --2- 172.21.15.55:0/2352897406 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1cfc066690 0x7f1cfc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:46.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.967+0000 7f1d1ea00640 1 --2- 172.21.15.55:0/2352897406 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1cfc066690 0x7f1cfc068b50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1d100ad000 tx=0x7f1d100a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:46.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:46.967+0000 7f1d17400640 1 -- 172.21.15.55:0/2352897406 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f1d18051910 con 0x7f1d2015ce40 2024-04-02T07:28:47.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.187+0000 7f1d25800640 1 -- 172.21.15.55:0/2352897406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]} v 0) v1 -- 0x7f1d20066c90 con 0x7f1d2015ce40 2024-04-02T07:28:47.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.435+0000 7f1d17400640 1 -- 172.21.15.55:0/2352897406 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dentry_repair"]}]=0 v312) v1 ==== 166+0+0 (secure 0 0 0) 0x7f1d18054f30 con 0x7f1d2015ce40 2024-04-02T07:28:47.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.435+0000 7f1d25800640 1 -- 172.21.15.55:0/2352897406 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1cfc066690 msgr2=0x7f1cfc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:47.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.439+0000 7f1d25800640 1 --2- 172.21.15.55:0/2352897406 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1cfc066690 0x7f1cfc068b50 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1d100ad000 tx=0x7f1d100a6000 comp rx=0 tx=0).stop 2024-04-02T07:28:47.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.439+0000 7f1d25800640 1 -- 172.21.15.55:0/2352897406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2015ce40 msgr2=0x7f1d20156010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:47.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.439+0000 7f1d25800640 1 --2- 172.21.15.55:0/2352897406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2015ce40 0x7f1d20156010 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800caf0 tx=0x7f1d180021d0 comp rx=0 tx=0).stop 2024-04-02T07:28:47.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.439+0000 7f1d25800640 1 -- 172.21.15.55:0/2352897406 shutdown_connections 2024-04-02T07:28:47.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.439+0000 7f1d25800640 1 --2- 172.21.15.55:0/2352897406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d2015ce40 0x7f1d20156010 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:47.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.439+0000 7f1d25800640 1 --2- 172.21.15.55:0/2352897406 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1cfc066690 0x7f1cfc068b50 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:47.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.439+0000 7f1d25800640 1 --2- 172.21.15.55:0/2352897406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1d200c3680 0x7f1d2013ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:47.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.439+0000 7f1d25800640 1 --2- 172.21.15.55:0/2352897406 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1d200b0cb0 0x7f1d2013b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:47.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.439+0000 7f1d25800640 1 -- 172.21.15.55:0/2352897406 >> 172.21.15.55:0/2352897406 conn(0x7f1d20066080 msgr2=0x7f1d200cd200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:47.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.439+0000 7f1d25800640 1 -- 172.21.15.55:0/2352897406 shutdown_connections 2024-04-02T07:28:47.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.439+0000 7f1d25800640 1 -- 172.21.15.55:0/2352897406 wait complete. 2024-04-02T07:28:47.460 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-02T07:28:47.460 INFO:tasks.cephfs_test_runner:Starting test: test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) Test that the damage health status is cleared 2024-04-02T07:28:47.460 INFO:tasks.cephfs_test_runner:test_health_status_after_dirfrag_repair (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-02T07:28:47.461 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-04-02T07:28:47.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.599+0000 7f2ce3800640 1 Processor -- start 2024-04-02T07:28:47.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.599+0000 7f2ce3800640 1 -- start start 2024-04-02T07:28:47.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.603+0000 7f2ce3800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cdc0b1430 0x7f2cdc0afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:47.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.603+0000 7f2ce3800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cdc0ce2f0 con 0x7f2cdc098a10 2024-04-02T07:28:47.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.603+0000 7f2ce3800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cdc0ce5d0 con 0x7f2cdc099750 2024-04-02T07:28:47.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.603+0000 7f2ce3800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc0cbe10 con 0x7f2cdc0b1430 2024-04-02T07:28:47.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.603+0000 7f2ce0e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2cdc098a10 0x7f2cdc098df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34894/0 (socket says 172.21.15.55:34894) 2024-04-02T07:28:47.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.603+0000 7f2ce0e00640 1 -- 172.21.15.55:0/1355198097 learned_addr learned my addr 172.21.15.55:0/1355198097 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:47.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.603+0000 7f2cd3e00640 1 --2- 172.21.15.55:0/1355198097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cdc0b1430 0x7f2cdc0afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:47.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.603+0000 7f2cdbe00640 1 -- 172.21.15.55:0/1355198097 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3448277336 0 0) 0x7f2cdc0ce2f0 con 0x7f2cdc098a10 2024-04-02T07:28:47.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.603+0000 7f2cdbe00640 1 -- 172.21.15.55:0/1355198097 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cc0003530 con 0x7f2cdc098a10 2024-04-02T07:28:47.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.603+0000 7f2cdbe00640 1 -- 172.21.15.55:0/1355198097 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 79113653 0 0) 0x7f2cdc0ce5d0 con 0x7f2cdc099750 2024-04-02T07:28:47.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.603+0000 7f2cd3e00640 1 -- 172.21.15.55:0/1355198097 >> v1:172.21.15.106:6789/0 conn(0x7f2cdc099750 legacy=0x7f2cdc0cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:47.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.603+0000 7f2cd3e00640 1 -- 172.21.15.55:0/1355198097 >> v1:172.21.15.55:6789/0 conn(0x7f2cdc098a10 legacy=0x7f2cdc098df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:47.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.603+0000 7f2cd3e00640 1 -- 172.21.15.55:0/1355198097 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc099be0 con 0x7f2cdc0b1430 2024-04-02T07:28:47.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.607+0000 7f2cd3e00640 1 --2- 172.21.15.55:0/1355198097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cdc0b1430 0x7f2cdc0afe30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40097f0 tx=0x7f2cc401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1dc95a0ea57b93c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:47.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.607+0000 7f2cdbe00640 1 -- 172.21.15.55:0/1355198097 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc40ab5f0 con 0x7f2cdc0b1430 2024-04-02T07:28:47.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.607+0000 7f2cdbe00640 1 -- 172.21.15.55:0/1355198097 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc40ab750 con 0x7f2cdc0b1430 2024-04-02T07:28:47.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.607+0000 7f2cdbe00640 1 -- 172.21.15.55:0/1355198097 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cc40abae0 con 0x7f2cdc0b1430 2024-04-02T07:28:47.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.607+0000 7f2ce3800640 1 -- 172.21.15.55:0/1355198097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cdc0b1430 msgr2=0x7f2cdc0afe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:47.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.607+0000 7f2ce3800640 1 --2- 172.21.15.55:0/1355198097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cdc0b1430 0x7f2cdc0afe30 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2cc40097f0 tx=0x7f2cc401c3f0 comp rx=0 tx=0).stop 2024-04-02T07:28:47.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.607+0000 7f2ce3800640 1 -- 172.21.15.55:0/1355198097 shutdown_connections 2024-04-02T07:28:47.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.607+0000 7f2ce3800640 1 --2- 172.21.15.55:0/1355198097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cdc0b1430 0x7f2cdc0afe30 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:47.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.607+0000 7f2ce3800640 1 -- 172.21.15.55:0/1355198097 >> 172.21.15.55:0/1355198097 conn(0x7f2cdc0b2210 msgr2=0x7f2cdc0b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:47.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.607+0000 7f2ce3800640 1 -- 172.21.15.55:0/1355198097 shutdown_connections 2024-04-02T07:28:47.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.607+0000 7f2ce3800640 1 -- 172.21.15.55:0/1355198097 wait complete. 2024-04-02T07:28:47.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.607+0000 7f2ce3800640 1 Processor -- start 2024-04-02T07:28:47.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.607+0000 7f2ce3800640 1 -- start start 2024-04-02T07:28:47.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.607+0000 7f2ce3800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cdc098a10 0x7f2cdc15ded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:47.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.607+0000 7f2ce3800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cdc099750 0x7f2cdc1f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:47.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.607+0000 7f2ce3800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc0b1430 0x7f2cdc1f7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:47.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.607+0000 7f2ce3800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc0c4c60 con 0x7f2cdc0b1430 2024-04-02T07:28:47.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.607+0000 7f2ce3800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc0c4f00 con 0x7f2cdc098a10 2024-04-02T07:28:47.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.607+0000 7f2ce3800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cdc15eb50 con 0x7f2cdc099750 2024-04-02T07:28:47.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.607+0000 7f2ce1800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc0b1430 0x7f2cdc1f7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:47.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.611+0000 7f2ce1800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc0b1430 0x7f2cdc1f7410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55092/0 (socket says 172.21.15.55:55092) 2024-04-02T07:28:47.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.611+0000 7f2ce1800640 1 -- 172.21.15.55:0/3124513397 learned_addr learned my addr 172.21.15.55:0/3124513397 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:47.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.611+0000 7f2ce0e00640 1 --2- 172.21.15.55:0/3124513397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cdc098a10 0x7f2cdc15ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:47.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.611+0000 7f2cd3e00640 1 --2- 172.21.15.55:0/3124513397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cdc099750 0x7f2cdc1f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:47.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.611+0000 7f2ce1800640 1 -- 172.21.15.55:0/3124513397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cdc099750 msgr2=0x7f2cdc1f6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:47.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.611+0000 7f2ce1800640 1 --2- 172.21.15.55:0/3124513397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cdc099750 0x7f2cdc1f6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:47.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.611+0000 7f2ce1800640 1 -- 172.21.15.55:0/3124513397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cdc098a10 msgr2=0x7f2cdc15ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:47.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.611+0000 7f2ce1800640 1 --2- 172.21.15.55:0/3124513397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cdc098a10 0x7f2cdc15ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:47.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.611+0000 7f2ce1800640 1 -- 172.21.15.55:0/3124513397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cc4009420 con 0x7f2cdc0b1430 2024-04-02T07:28:47.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.611+0000 7f2ce0e00640 1 --2- 172.21.15.55:0/3124513397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cdc098a10 0x7f2cdc15ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:28:47.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.611+0000 7f2ce1800640 1 --2- 172.21.15.55:0/3124513397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc0b1430 0x7f2cdc1f7410 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4002240 tx=0x7f2cd400cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:47.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.611+0000 7f2cd9600640 1 -- 172.21.15.55:0/3124513397 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4003db0 con 0x7f2cdc0b1430 2024-04-02T07:28:47.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.611+0000 7f2cd9600640 1 -- 172.21.15.55:0/3124513397 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd400ce30 con 0x7f2cdc0b1430 2024-04-02T07:28:47.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.611+0000 7f2ce3800640 1 -- 172.21.15.55:0/3124513397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cdc15edf0 con 0x7f2cdc0b1430 2024-04-02T07:28:47.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.611+0000 7f2cd9600640 1 -- 172.21.15.55:0/3124513397 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4005270 con 0x7f2cdc0b1430 2024-04-02T07:28:47.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.611+0000 7f2ce3800640 1 -- 172.21.15.55:0/3124513397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cdc1f7950 con 0x7f2cdc0b1430 2024-04-02T07:28:47.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.611+0000 7f2ce3800640 1 -- 172.21.15.55:0/3124513397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cdc0c5070 con 0x7f2cdc0b1430 2024-04-02T07:28:47.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.611+0000 7f2cd9600640 1 -- 172.21.15.55:0/3124513397 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2cd40053d0 con 0x7f2cdc0b1430 2024-04-02T07:28:47.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.611+0000 7f2cd9600640 1 --2- 172.21.15.55:0/3124513397 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2cb80666c0 0x7f2cb8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:47.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.615+0000 7f2cd9600640 1 -- 172.21.15.55:0/3124513397 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f2cd4083670 con 0x7f2cdc0b1430 2024-04-02T07:28:47.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.615+0000 7f2ce0e00640 1 --2- 172.21.15.55:0/3124513397 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2cb80666c0 0x7f2cb8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:47.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.615+0000 7f2ce0e00640 1 --2- 172.21.15.55:0/3124513397 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2cb80666c0 0x7f2cb8068b80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc005890 tx=0x7f2ccc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:47.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.615+0000 7f2cd9600640 1 -- 172.21.15.55:0/3124513397 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2cd4050c90 con 0x7f2cdc0b1430 2024-04-02T07:28:47.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:47.835+0000 7f2ce3800640 1 -- 172.21.15.55:0/3124513397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) v1 -- 0x7f2cdc066c90 con 0x7f2cdc0b1430 2024-04-02T07:28:48.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.435+0000 7f2cd9600640 1 -- 172.21.15.55:0/3124513397 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v313) v1 ==== 170+0+0 (secure 0 0 0) 0x7f2cd4017020 con 0x7f2cdc0b1430 2024-04-02T07:28:48.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.439+0000 7f2ce3800640 1 -- 172.21.15.55:0/3124513397 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2cb80666c0 msgr2=0x7f2cb8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:48.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.439+0000 7f2ce3800640 1 --2- 172.21.15.55:0/3124513397 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2cb80666c0 0x7f2cb8068b80 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc005890 tx=0x7f2ccc009040 comp rx=0 tx=0).stop 2024-04-02T07:28:48.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.439+0000 7f2ce3800640 1 -- 172.21.15.55:0/3124513397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc0b1430 msgr2=0x7f2cdc1f7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:48.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.439+0000 7f2ce3800640 1 --2- 172.21.15.55:0/3124513397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc0b1430 0x7f2cdc1f7410 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f2cd4002240 tx=0x7f2cd400cbe0 comp rx=0 tx=0).stop 2024-04-02T07:28:48.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.439+0000 7f2ce3800640 1 -- 172.21.15.55:0/3124513397 shutdown_connections 2024-04-02T07:28:48.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.439+0000 7f2ce3800640 1 --2- 172.21.15.55:0/3124513397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cdc0b1430 0x7f2cdc1f7410 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:48.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.439+0000 7f2ce3800640 1 --2- 172.21.15.55:0/3124513397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cdc099750 0x7f2cdc1f6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:48.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.439+0000 7f2ce3800640 1 --2- 172.21.15.55:0/3124513397 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2cb80666c0 0x7f2cb8068b80 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:48.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.439+0000 7f2ce3800640 1 --2- 172.21.15.55:0/3124513397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cdc098a10 0x7f2cdc15ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:48.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.439+0000 7f2ce3800640 1 -- 172.21.15.55:0/3124513397 >> 172.21.15.55:0/3124513397 conn(0x7f2cdc0b2210 msgr2=0x7f2cdc0ad9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:48.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.439+0000 7f2ce3800640 1 -- 172.21.15.55:0/3124513397 shutdown_connections 2024-04-02T07:28:48.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.439+0000 7f2ce3800640 1 -- 172.21.15.55:0/3124513397 wait complete. 2024-04-02T07:28:48.462 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-02T07:28:48.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa88c600640 1 Processor -- start 2024-04-02T07:28:48.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa88c600640 1 -- start start 2024-04-02T07:28:48.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa88c600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa8840ade90 0x7fa88406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:48.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa88c600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88406c630 con 0x7fa8840b41a0 2024-04-02T07:28:48.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa88c600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa88406c8f0 con 0x7fa8840b3dc0 2024-04-02T07:28:48.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa88c600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8840cae80 con 0x7fa8840ade90 2024-04-02T07:28:48.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa88a600640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa8840b41a0 0x7fa884142ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34900/0 (socket says 172.21.15.55:34900) 2024-04-02T07:28:48.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa88a600640 1 -- 172.21.15.55:0/1048685658 learned_addr learned my addr 172.21.15.55:0/1048685658 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:48.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa889200640 1 --2- 172.21.15.55:0/1048685658 >> v2:172.21.15.106:3300/0 conn(0x7fa8840ade90 0x7fa88406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:48.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa883e00640 1 -- 172.21.15.55:0/1048685658 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 358766802 0 0) 0x7fa88406c630 con 0x7fa8840b41a0 2024-04-02T07:28:48.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa883e00640 1 -- 172.21.15.55:0/1048685658 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa86c003530 con 0x7fa8840b41a0 2024-04-02T07:28:48.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa883e00640 1 -- 172.21.15.55:0/1048685658 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3313846878 0 0) 0x7fa86c003530 con 0x7fa8840b41a0 2024-04-02T07:28:48.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa883e00640 1 -- 172.21.15.55:0/1048685658 >> v2:172.21.15.106:3300/0 conn(0x7fa8840ade90 msgr2=0x7fa88406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:48.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa883e00640 1 --2- 172.21.15.55:0/1048685658 >> v2:172.21.15.106:3300/0 conn(0x7fa8840ade90 0x7fa88406d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:48.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa883e00640 1 -- 172.21.15.55:0/1048685658 >> v1:172.21.15.106:6789/0 conn(0x7fa8840b3dc0 legacy=0x7fa8840ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:48.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa883e00640 1 -- 172.21.15.55:0/1048685658 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88406cbd0 con 0x7fa8840b41a0 2024-04-02T07:28:48.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa883e00640 1 -- 172.21.15.55:0/1048685658 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fa87c001a00 con 0x7fa8840b41a0 2024-04-02T07:28:48.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa883e00640 1 -- 172.21.15.55:0/1048685658 >> v1:172.21.15.55:6789/0 conn(0x7fa8840b41a0 legacy=0x7fa884142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:48.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa883e00640 1 --2- 172.21.15.55:0/1048685658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa86c003980 0x7fa86c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:48.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa883e00640 1 --2- 172.21.15.55:0/1048685658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa86c0047d0 0x7fa86c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:48.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa883e00640 1 --2- 172.21.15.55:0/1048685658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa86c005190 0x7fa86c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:48.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa883e00640 1 -- 172.21.15.55:0/1048685658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8840cae80 con 0x7fa86c003980 2024-04-02T07:28:48.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa883e00640 1 -- 172.21.15.55:0/1048685658 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c00c030 con 0x7fa86c0047d0 2024-04-02T07:28:48.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa883e00640 1 -- 172.21.15.55:0/1048685658 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa86c00c1f0 con 0x7fa86c005190 2024-04-02T07:28:48.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa889c00640 1 --2- 172.21.15.55:0/1048685658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa86c003980 0x7fa86c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:48.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa88a600640 1 --2- 172.21.15.55:0/1048685658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa86c005190 0x7fa86c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:48.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa889200640 1 --2- 172.21.15.55:0/1048685658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa86c0047d0 0x7fa86c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:48.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa889c00640 1 -- 172.21.15.55:0/1048685658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa86c005190 msgr2=0x7fa86c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:48.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa889c00640 1 --2- 172.21.15.55:0/1048685658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa86c005190 0x7fa86c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:48.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa889c00640 1 -- 172.21.15.55:0/1048685658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa86c0047d0 msgr2=0x7fa86c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:48.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa889c00640 1 --2- 172.21.15.55:0/1048685658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa86c0047d0 0x7fa86c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:48.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa889c00640 1 -- 172.21.15.55:0/1048685658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c003530 con 0x7fa86c003980 2024-04-02T07:28:48.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.611+0000 7fa88a600640 1 -- 172.21.15.55:0/1048685658 reap_dead start 2024-04-02T07:28:48.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.615+0000 7fa889c00640 1 --2- 172.21.15.55:0/1048685658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa86c003980 0x7fa86c003da0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fa878001780 tx=0x7fa87801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4f93c1bb9d12f74 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:48.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.615+0000 7fa883e00640 1 -- 172.21.15.55:0/1048685658 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8780052d0 con 0x7fa86c003980 2024-04-02T07:28:48.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.615+0000 7fa883e00640 1 -- 172.21.15.55:0/1048685658 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8780a7050 con 0x7fa86c003980 2024-04-02T07:28:48.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.615+0000 7fa883e00640 1 -- 172.21.15.55:0/1048685658 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa878003600 con 0x7fa86c003980 2024-04-02T07:28:48.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.615+0000 7fa88c600640 1 -- 172.21.15.55:0/1048685658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa86c003980 msgr2=0x7fa86c003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:48.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.615+0000 7fa88c600640 1 --2- 172.21.15.55:0/1048685658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa86c003980 0x7fa86c003da0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fa878001780 tx=0x7fa87801c3d0 comp rx=0 tx=0).stop 2024-04-02T07:28:48.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.615+0000 7fa88c600640 1 -- 172.21.15.55:0/1048685658 shutdown_connections 2024-04-02T07:28:48.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.615+0000 7fa88c600640 1 --2- 172.21.15.55:0/1048685658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa86c003980 0x7fa86c003da0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:48.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.615+0000 7fa88c600640 1 -- 172.21.15.55:0/1048685658 >> 172.21.15.55:0/1048685658 conn(0x7fa88406a390 msgr2=0x7fa8840b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:48.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.615+0000 7fa88c600640 1 -- 172.21.15.55:0/1048685658 shutdown_connections 2024-04-02T07:28:48.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.615+0000 7fa88c600640 1 -- 172.21.15.55:0/1048685658 wait complete. 2024-04-02T07:28:48.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa88c600640 1 Processor -- start 2024-04-02T07:28:48.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa88c600640 1 -- start start 2024-04-02T07:28:48.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa88c600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa86c003980 0x7fa8841f9d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:48.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa88c600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa884159500 0x7fa8840aebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:48.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa88c600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8840af130 0x7fa884140f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:48.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa88c600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8841357f0 con 0x7fa884159500 2024-04-02T07:28:48.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa88c600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8840af5b0 con 0x7fa8840af130 2024-04-02T07:28:48.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa88c600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8841584f0 con 0x7fa86c003980 2024-04-02T07:28:48.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa889200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa884159500 0x7fa8840aebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:48.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa889200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa884159500 0x7fa8840aebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55116/0 (socket says 172.21.15.55:55116) 2024-04-02T07:28:48.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa889200640 1 -- 172.21.15.55:0/2491769505 learned_addr learned my addr 172.21.15.55:0/2491769505 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:48.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa889c00640 1 --2- 172.21.15.55:0/2491769505 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa86c003980 0x7fa8841f9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:48.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa88a600640 1 --2- 172.21.15.55:0/2491769505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8840af130 0x7fa884140f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:48.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa889200640 1 -- 172.21.15.55:0/2491769505 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa86c003980 msgr2=0x7fa8841f9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:48.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa889200640 1 --2- 172.21.15.55:0/2491769505 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa86c003980 0x7fa8841f9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:48.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa889200640 1 -- 172.21.15.55:0/2491769505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8840af130 msgr2=0x7fa884140f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:48.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa889200640 1 --2- 172.21.15.55:0/2491769505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8840af130 0x7fa884140f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:48.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa889200640 1 -- 172.21.15.55:0/2491769505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8841fa2b0 con 0x7fa884159500 2024-04-02T07:28:48.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa889200640 1 --2- 172.21.15.55:0/2491769505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa884159500 0x7fa8840aebf0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fa870011500 tx=0x7fa8700119c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:48.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa881600640 1 -- 172.21.15.55:0/2491769505 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870015870 con 0x7fa884159500 2024-04-02T07:28:48.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa881600640 1 -- 172.21.15.55:0/2491769505 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8700159d0 con 0x7fa884159500 2024-04-02T07:28:48.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa881600640 1 -- 172.21.15.55:0/2491769505 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870015d40 con 0x7fa884159500 2024-04-02T07:28:48.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa88c600640 1 -- 172.21.15.55:0/2491769505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa884158740 con 0x7fa884159500 2024-04-02T07:28:48.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.619+0000 7fa88c600640 1 -- 172.21.15.55:0/2491769505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa884158d00 con 0x7fa884159500 2024-04-02T07:28:48.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.623+0000 7fa88c600640 1 -- 172.21.15.55:0/2491769505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa884066c90 con 0x7fa884159500 2024-04-02T07:28:48.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.623+0000 7fa881600640 1 -- 172.21.15.55:0/2491769505 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa870013400 con 0x7fa884159500 2024-04-02T07:28:48.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.623+0000 7fa881600640 1 --2- 172.21.15.55:0/2491769505 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa864066690 0x7fa864068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:48.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.623+0000 7fa881600640 1 -- 172.21.15.55:0/2491769505 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fa870084100 con 0x7fa884159500 2024-04-02T07:28:48.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.623+0000 7fa889c00640 1 --2- 172.21.15.55:0/2491769505 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa864066690 0x7fa864068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:48.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.623+0000 7fa889c00640 1 --2- 172.21.15.55:0/2491769505 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa864066690 0x7fa864068b50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa878001750 tx=0x7fa8780011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:48.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.627+0000 7fa881600640 1 -- 172.21.15.55:0/2491769505 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa8700517b0 con 0x7fa884159500 2024-04-02T07:28:48.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.787+0000 7fa88c600640 1 -- 172.21.15.55:0/2491769505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fa8840b1240 con 0x7fa884159500 2024-04-02T07:28:48.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.791+0000 7fa881600640 1 -- 172.21.15.55:0/2491769505 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa870054dd0 con 0x7fa884159500 2024-04-02T07:28:48.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.795+0000 7fa88c600640 1 -- 172.21.15.55:0/2491769505 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa864066690 msgr2=0x7fa864068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:48.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.795+0000 7fa88c600640 1 --2- 172.21.15.55:0/2491769505 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa864066690 0x7fa864068b50 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fa878001750 tx=0x7fa8780011a0 comp rx=0 tx=0).stop 2024-04-02T07:28:48.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.795+0000 7fa88c600640 1 -- 172.21.15.55:0/2491769505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa884159500 msgr2=0x7fa8840aebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:48.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.795+0000 7fa88c600640 1 --2- 172.21.15.55:0/2491769505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa884159500 0x7fa8840aebf0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fa870011500 tx=0x7fa8700119c0 comp rx=0 tx=0).stop 2024-04-02T07:28:48.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.795+0000 7fa88c600640 1 -- 172.21.15.55:0/2491769505 shutdown_connections 2024-04-02T07:28:48.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.795+0000 7fa88c600640 1 --2- 172.21.15.55:0/2491769505 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa864066690 0x7fa864068b50 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:48.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.795+0000 7fa88c600640 1 --2- 172.21.15.55:0/2491769505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8840af130 0x7fa884140f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:48.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.795+0000 7fa88c600640 1 --2- 172.21.15.55:0/2491769505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa884159500 0x7fa8840aebf0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:48.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.795+0000 7fa88c600640 1 --2- 172.21.15.55:0/2491769505 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa86c003980 0x7fa8841f9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:48.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.795+0000 7fa88c600640 1 -- 172.21.15.55:0/2491769505 >> 172.21.15.55:0/2491769505 conn(0x7fa88406a390 msgr2=0x7fa8840cdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:48.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.795+0000 7fa88c600640 1 -- 172.21.15.55:0/2491769505 shutdown_connections 2024-04-02T07:28:48.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:48.795+0000 7fa88c600640 1 -- 172.21.15.55:0/2491769505 wait complete. 2024-04-02T07:28:48.814 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-02T07:28:48.815 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:28:48.866 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:28:48.940 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-02T07:28:48.941 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:28:48.941 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:28:48.949 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:28:48.950 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:28:48.950 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:28:48.961 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:28:48.962 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:28:48.962 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:28:48.998 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:28:48.998 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:28:48.998 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:28:49.014 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:28:49.015 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-02T07:28:49.015 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:28:49.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.183+0000 7f84f4200640 1 Processor -- start 2024-04-02T07:28:49.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.183+0000 7f84f4200640 1 -- start start 2024-04-02T07:28:49.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.183+0000 7f84f4200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f84ec0c4120 0x7f84ec0b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:49.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.183+0000 7f84f4200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84ec0b36f0 0x7f84ec13d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:49.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.183+0000 7f84f4200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ec13d0c0 con 0x7f84ec153ea0 2024-04-02T07:28:49.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.183+0000 7f84f4200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84ec15a2f0 con 0x7f84ec0b36f0 2024-04-02T07:28:49.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.183+0000 7f84f4200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84ec0b3b20 con 0x7f84ec0c4120 2024-04-02T07:28:49.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.183+0000 7f84f2200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84ec0b36f0 0x7f84ec13d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:49.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.183+0000 7f84f2200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f84ec0b36f0 0x7f84ec13d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55132/0 (socket says 172.21.15.55:55132) 2024-04-02T07:28:49.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.183+0000 7f84f2200640 1 -- 172.21.15.55:0/859913858 learned_addr learned my addr 172.21.15.55:0/859913858 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:49.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.183+0000 7f84f0e00640 1 --2- 172.21.15.55:0/859913858 >> v2:172.21.15.106:3300/0 conn(0x7f84ec0c4120 0x7f84ec0b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:49.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.183+0000 7f84f2200640 1 -- 172.21.15.55:0/859913858 >> v2:172.21.15.106:3300/0 conn(0x7f84ec0c4120 msgr2=0x7f84ec0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:49.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.183+0000 7f84f2200640 1 --2- 172.21.15.55:0/859913858 >> v2:172.21.15.106:3300/0 conn(0x7f84ec0c4120 0x7f84ec0b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:49.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.183+0000 7f84f2200640 1 -- 172.21.15.55:0/859913858 >> v1:172.21.15.106:6789/0 conn(0x7f84ec153ea0 legacy=0x7f84ec159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:49.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.183+0000 7f84f2200640 1 -- 172.21.15.55:0/859913858 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec15a4f0 con 0x7f84ec0b36f0 2024-04-02T07:28:49.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.187+0000 7f84f2200640 1 --2- 172.21.15.55:0/859913858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec0b36f0 0x7f84ec13d550 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f84ec06d470 tx=0x7f84e401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c9b9ec5a77942b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:49.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.187+0000 7f84ebe00640 1 -- 172.21.15.55:0/859913858 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e40a57d0 con 0x7f84ec0b36f0 2024-04-02T07:28:49.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.187+0000 7f84ebe00640 1 -- 172.21.15.55:0/859913858 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e40a5930 con 0x7f84ec0b36f0 2024-04-02T07:28:49.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.187+0000 7f84ebe00640 1 -- 172.21.15.55:0/859913858 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e40a5cc0 con 0x7f84ec0b36f0 2024-04-02T07:28:49.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.187+0000 7f84f4200640 1 -- 172.21.15.55:0/859913858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec0b36f0 msgr2=0x7f84ec13d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:49.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.187+0000 7f84f4200640 1 --2- 172.21.15.55:0/859913858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec0b36f0 0x7f84ec13d550 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f84ec06d470 tx=0x7f84e401c9f0 comp rx=0 tx=0).stop 2024-04-02T07:28:49.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.187+0000 7f84f4200640 1 -- 172.21.15.55:0/859913858 shutdown_connections 2024-04-02T07:28:49.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.187+0000 7f84f4200640 1 --2- 172.21.15.55:0/859913858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec0b36f0 0x7f84ec13d550 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:49.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.187+0000 7f84f4200640 1 --2- 172.21.15.55:0/859913858 >> v2:172.21.15.106:3300/0 conn(0x7f84ec0c4120 0x7f84ec0b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:49.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.187+0000 7f84f4200640 1 -- 172.21.15.55:0/859913858 >> 172.21.15.55:0/859913858 conn(0x7f84ec066080 msgr2=0x7f84ec069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:49.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.187+0000 7f84f4200640 1 -- 172.21.15.55:0/859913858 shutdown_connections 2024-04-02T07:28:49.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.187+0000 7f84f4200640 1 -- 172.21.15.55:0/859913858 wait complete. 2024-04-02T07:28:49.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f4200640 1 Processor -- start 2024-04-02T07:28:49.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f4200640 1 -- start start 2024-04-02T07:28:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f4200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f84ec0b36f0 0x7f84ec0c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f4200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84ec0c4120 0x7f84ec071520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f4200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec153ea0 0x7f84ec0c8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f4200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec0c6920 con 0x7f84ec153ea0 2024-04-02T07:28:49.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f4200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec0c6c00 con 0x7f84ec0c4120 2024-04-02T07:28:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f4200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec0c6ee0 con 0x7f84ec0b36f0 2024-04-02T07:28:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f2200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec153ea0 0x7f84ec0c8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f1800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f84ec0b36f0 0x7f84ec0c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f2200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec153ea0 0x7f84ec0c8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55144/0 (socket says 172.21.15.55:55144) 2024-04-02T07:28:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f1800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f84ec0b36f0 0x7f84ec0c5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:38618/0 (socket says 172.21.15.55:38618) 2024-04-02T07:28:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f2200640 1 -- 172.21.15.55:0/4104259721 learned_addr learned my addr 172.21.15.55:0/4104259721 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f0e00640 1 --2- 172.21.15.55:0/4104259721 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84ec0c4120 0x7f84ec071520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f2200640 1 -- 172.21.15.55:0/4104259721 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f84ec0b36f0 msgr2=0x7f84ec0c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f2200640 1 --2- 172.21.15.55:0/4104259721 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f84ec0b36f0 0x7f84ec0c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f2200640 1 -- 172.21.15.55:0/4104259721 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84ec0c4120 msgr2=0x7f84ec071520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f2200640 1 --2- 172.21.15.55:0/4104259721 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84ec0c4120 0x7f84ec071520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:49.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f2200640 1 -- 172.21.15.55:0/4104259721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e4009b30 con 0x7f84ec153ea0 2024-04-02T07:28:49.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f2200640 1 --2- 172.21.15.55:0/4104259721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec153ea0 0x7f84ec0c8550 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f84e40af040 tx=0x7f84e4019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:49.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84e9600640 1 -- 172.21.15.55:0/4104259721 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e40b8670 con 0x7f84ec153ea0 2024-04-02T07:28:49.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84e9600640 1 -- 172.21.15.55:0/4104259721 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e40b87d0 con 0x7f84ec153ea0 2024-04-02T07:28:49.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84e9600640 1 -- 172.21.15.55:0/4104259721 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e40b8b80 con 0x7f84ec153ea0 2024-04-02T07:28:49.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f4200640 1 -- 172.21.15.55:0/4104259721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ec138d10 con 0x7f84ec153ea0 2024-04-02T07:28:49.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f4200640 1 -- 172.21.15.55:0/4104259721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ec0c6010 con 0x7f84ec153ea0 2024-04-02T07:28:49.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.191+0000 7f84f4200640 1 -- 172.21.15.55:0/4104259721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ec0c7100 con 0x7f84ec153ea0 2024-04-02T07:28:49.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.195+0000 7f84e9600640 1 -- 172.21.15.55:0/4104259721 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f84e40b8ce0 con 0x7f84ec153ea0 2024-04-02T07:28:49.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.195+0000 7f84e9600640 1 --2- 172.21.15.55:0/4104259721 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f84cc0666c0 0x7f84cc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:49.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.195+0000 7f84e9600640 1 -- 172.21.15.55:0/4104259721 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f84e411f360 con 0x7f84ec153ea0 2024-04-02T07:28:49.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.195+0000 7f84f1800640 1 --2- 172.21.15.55:0/4104259721 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f84cc0666c0 0x7f84cc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:49.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.195+0000 7f84f1800640 1 --2- 172.21.15.55:0/4104259721 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f84cc0666c0 0x7f84cc068b80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f84e0007fd0 tx=0x7f84e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:49.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.199+0000 7f84e9600640 1 -- 172.21.15.55:0/4104259721 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f84e40ec9b0 con 0x7f84ec153ea0 2024-04-02T07:28:49.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.395+0000 7f84f4200640 1 -- 172.21.15.55:0/4104259721 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84ec066c90 con 0x7f84ec153ea0 2024-04-02T07:28:49.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.395+0000 7f84e9600640 1 -- 172.21.15.55:0/4104259721 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) v1 ==== 94+0+3532 (secure 0 0 0) 0x7f84e40effd0 con 0x7f84ec153ea0 2024-04-02T07:28:49.399 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:49.399 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":54,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5912,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/2000687874","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2000687874},{"type":"v1","addr":"172.21.15.106:6835","nonce":2000687874}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":5921,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/823234890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":823234890},{"type":"v1","addr":"172.21.15.55:6835","nonce":823234890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":39},{"gid":6439,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1803758651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1803758651},{"type":"v1","addr":"172.21.15.106:6837","nonce":1803758651}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":38},{"gid":7386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/2920284466","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2920284466},{"type":"v1","addr":"172.21.15.55:6833","nonce":2920284466}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[]} 2024-04-02T07:28:49.399 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 54 2024-04-02T07:28:49.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.399+0000 7f84f4200640 1 -- 172.21.15.55:0/4104259721 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f84cc0666c0 msgr2=0x7f84cc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:49.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.399+0000 7f84f4200640 1 --2- 172.21.15.55:0/4104259721 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f84cc0666c0 0x7f84cc068b80 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f84e0007fd0 tx=0x7f84e0009040 comp rx=0 tx=0).stop 2024-04-02T07:28:49.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.399+0000 7f84f4200640 1 -- 172.21.15.55:0/4104259721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec153ea0 msgr2=0x7f84ec0c8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:49.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.399+0000 7f84f4200640 1 --2- 172.21.15.55:0/4104259721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec153ea0 0x7f84ec0c8550 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f84e40af040 tx=0x7f84e4019790 comp rx=0 tx=0).stop 2024-04-02T07:28:49.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.399+0000 7f84f4200640 1 -- 172.21.15.55:0/4104259721 shutdown_connections 2024-04-02T07:28:49.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.399+0000 7f84f4200640 1 --2- 172.21.15.55:0/4104259721 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f84ec153ea0 0x7f84ec0c8550 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:49.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.399+0000 7f84f4200640 1 --2- 172.21.15.55:0/4104259721 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f84cc0666c0 0x7f84cc068b80 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:49.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.399+0000 7f84f4200640 1 --2- 172.21.15.55:0/4104259721 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f84ec0c4120 0x7f84ec071520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:49.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.399+0000 7f84f4200640 1 --2- 172.21.15.55:0/4104259721 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f84ec0b36f0 0x7f84ec0c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:49.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.399+0000 7f84f4200640 1 -- 172.21.15.55:0/4104259721 >> 172.21.15.55:0/4104259721 conn(0x7f84ec066080 msgr2=0x7f84ec0cb2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:49.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.399+0000 7f84f4200640 1 -- 172.21.15.55:0/4104259721 shutdown_connections 2024-04-02T07:28:49.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.399+0000 7f84f4200640 1 -- 172.21.15.55:0/4104259721 wait complete. 2024-04-02T07:28:49.420 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-02T07:28:49.420 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-02T07:28:49.420 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-02T07:28:49.420 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:28:49.420 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-02T07:28:49.421 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-02T07:28:49.421 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-02T07:28:49.421 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:28:49.421 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-02T07:28:49.421 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-02T07:28:49.421 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-02T07:28:49.421 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:28:49.422 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-02T07:28:49.422 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-02T07:28:49.422 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-02T07:28:49.422 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:28:49.433 INFO:tasks.ceph.mds.c:Stopped 2024-04-02T07:28:49.433 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-02T07:28:49.434 INFO:tasks.ceph.mds.a:Stopped 2024-04-02T07:28:49.434 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-02T07:28:49.435 INFO:tasks.ceph.mds.d:Stopped 2024-04-02T07:28:49.436 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-02T07:28:49.437 INFO:tasks.ceph.mds.b:Stopped 2024-04-02T07:28:49.437 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-02T07:28:49.477 INFO:tasks.ceph.mds.c:Started 2024-04-02T07:28:49.477 DEBUG:teuthology.parallel:result is None 2024-04-02T07:28:49.479 INFO:tasks.ceph.mds.a:Started 2024-04-02T07:28:49.479 DEBUG:teuthology.parallel:result is None 2024-04-02T07:28:49.480 INFO:tasks.ceph.mds.d:Started 2024-04-02T07:28:49.480 DEBUG:teuthology.parallel:result is None 2024-04-02T07:28:49.483 INFO:tasks.ceph.mds.b:Started 2024-04-02T07:28:49.483 DEBUG:teuthology.parallel:result is None 2024-04-02T07:28:49.483 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-02T07:28:49.563 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-02T07:28:49.564 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-02T07:28:49.569 INFO:tasks.ceph.mds.d.smithi106.stdout:starting mds.d at 2024-04-02T07:28:49.571 INFO:tasks.ceph.mds.b.smithi106.stdout:starting mds.b at 2024-04-02T07:28:49.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.631+0000 7f08b1000640 1 Processor -- start 2024-04-02T07:28:49.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.631+0000 7f08b1000640 1 -- start start 2024-04-02T07:28:49.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.631+0000 7f08b1000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f08ac1599c0 0x7f08ac0b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:49.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.631+0000 7f08b1000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08ac0b38f0 0x7f08ac0c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:49.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.631+0000 7f08b1000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08ac0b1d60 con 0x7f08ac06d1c0 2024-04-02T07:28:49.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.631+0000 7f08b1000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08ac06cda0 con 0x7f08ac0b38f0 2024-04-02T07:28:49.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.631+0000 7f08b1000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac06c400 con 0x7f08ac1599c0 2024-04-02T07:28:49.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.631+0000 7f08aa800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08ac0b38f0 0x7f08ac0c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:49.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.631+0000 7f08aa800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f08ac0b38f0 0x7f08ac0c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55180/0 (socket says 172.21.15.55:55180) 2024-04-02T07:28:49.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.631+0000 7f08aa800640 1 -- 172.21.15.55:0/104648367 learned_addr learned my addr 172.21.15.55:0/104648367 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:49.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.631+0000 7f08a9e00640 1 --2- 172.21.15.55:0/104648367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f08ac1599c0 0x7f08ac0b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:49.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.631+0000 7f08aa800640 1 -- 172.21.15.55:0/104648367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f08ac1599c0 msgr2=0x7f08ac0b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:49.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.631+0000 7f08aa800640 1 --2- 172.21.15.55:0/104648367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f08ac1599c0 0x7f08ac0b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:49.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.631+0000 7f08aa800640 1 -- 172.21.15.55:0/104648367 >> v1:172.21.15.106:6789/0 conn(0x7f08ac06d1c0 legacy=0x7f08ac0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:49.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.631+0000 7f08aa800640 1 -- 172.21.15.55:0/104648367 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08ac06c6e0 con 0x7f08ac0b38f0 2024-04-02T07:28:49.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.635+0000 7f08aa800640 1 --2- 172.21.15.55:0/104648367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08ac0b38f0 0x7f08ac0c90d0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f08a4009e50 tx=0x7f08a401c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99df8b31df0dc0a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:49.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.635+0000 7f08a9400640 1 -- 172.21.15.55:0/104648367 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a40a5650 con 0x7f08ac0b38f0 2024-04-02T07:28:49.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.635+0000 7f08a9400640 1 -- 172.21.15.55:0/104648367 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a40a57b0 con 0x7f08ac0b38f0 2024-04-02T07:28:49.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.635+0000 7f08a9400640 1 -- 172.21.15.55:0/104648367 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a40a5b40 con 0x7f08ac0b38f0 2024-04-02T07:28:49.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.635+0000 7f08b1000640 1 -- 172.21.15.55:0/104648367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08ac0b38f0 msgr2=0x7f08ac0c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:49.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.635+0000 7f08b1000640 1 --2- 172.21.15.55:0/104648367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08ac0b38f0 0x7f08ac0c90d0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f08a4009e50 tx=0x7f08a401c830 comp rx=0 tx=0).stop 2024-04-02T07:28:49.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.635+0000 7f08b1000640 1 -- 172.21.15.55:0/104648367 shutdown_connections 2024-04-02T07:28:49.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.635+0000 7f08b1000640 1 --2- 172.21.15.55:0/104648367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08ac0b38f0 0x7f08ac0c90d0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:49.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.635+0000 7f08b1000640 1 --2- 172.21.15.55:0/104648367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f08ac1599c0 0x7f08ac0b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:49.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.635+0000 7f08b1000640 1 -- 172.21.15.55:0/104648367 >> 172.21.15.55:0/104648367 conn(0x7f08ac069d90 msgr2=0x7f08ac06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:49.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.635+0000 7f08b1000640 1 -- 172.21.15.55:0/104648367 shutdown_connections 2024-04-02T07:28:49.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.635+0000 7f08b1000640 1 -- 172.21.15.55:0/104648367 wait complete. 2024-04-02T07:28:49.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08b1000640 1 Processor -- start 2024-04-02T07:28:49.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08b1000640 1 -- start start 2024-04-02T07:28:49.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08b1000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08ac06d1c0 0x7f08ac146790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:49.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08b1000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08ac0b38f0 0x7f08ac0c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:49.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08b1000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f08ac1599c0 0x7f08ac0c8040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:49.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08b1000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac1497e0 con 0x7f08ac06d1c0 2024-04-02T07:28:49.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08b1000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac166370 con 0x7f08ac0b38f0 2024-04-02T07:28:49.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08b1000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08ac166650 con 0x7f08ac1599c0 2024-04-02T07:28:49.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08a9e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08ac06d1c0 0x7f08ac146790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:49.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08aa800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f08ac1599c0 0x7f08ac0c8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:49.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08a9e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08ac06d1c0 0x7f08ac146790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55190/0 (socket says 172.21.15.55:55190) 2024-04-02T07:28:49.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08a9e00640 1 -- 172.21.15.55:0/566444316 learned_addr learned my addr 172.21.15.55:0/566444316 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:49.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08a1400640 1 --2- 172.21.15.55:0/566444316 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08ac0b38f0 0x7f08ac0c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:49.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08aa800640 1 -- 172.21.15.55:0/566444316 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08ac0b38f0 msgr2=0x7f08ac0c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:49.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08aa800640 1 --2- 172.21.15.55:0/566444316 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08ac0b38f0 0x7f08ac0c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:49.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08aa800640 1 -- 172.21.15.55:0/566444316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08ac06d1c0 msgr2=0x7f08ac146790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08aa800640 1 --2- 172.21.15.55:0/566444316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08ac06d1c0 0x7f08ac146790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08aa800640 1 -- 172.21.15.55:0/566444316 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a4009b30 con 0x7f08ac1599c0 2024-04-02T07:28:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08a9e00640 1 --2- 172.21.15.55:0/566444316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08ac06d1c0 0x7f08ac146790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:28:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08aa800640 1 --2- 172.21.15.55:0/566444316 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f08ac1599c0 0x7f08ac0c8040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f08a40ab000 tx=0x7f08a40195d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08a2a00640 1 -- 172.21.15.55:0/566444316 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a40a5650 con 0x7f08ac1599c0 2024-04-02T07:28:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08a2a00640 1 -- 172.21.15.55:0/566444316 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08a4009510 con 0x7f08ac1599c0 2024-04-02T07:28:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08a2a00640 1 -- 172.21.15.55:0/566444316 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a4007bf0 con 0x7f08ac1599c0 2024-04-02T07:28:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08b1000640 1 -- 172.21.15.55:0/566444316 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ac166930 con 0x7f08ac1599c0 2024-04-02T07:28:49.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.639+0000 7f08b1000640 1 -- 172.21.15.55:0/566444316 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ac166ef0 con 0x7f08ac1599c0 2024-04-02T07:28:49.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.643+0000 7f08b1000640 1 -- 172.21.15.55:0/566444316 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ac06e270 con 0x7f08ac1599c0 2024-04-02T07:28:49.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.643+0000 7f08a2a00640 1 -- 172.21.15.55:0/566444316 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f08a4007d50 con 0x7f08ac1599c0 2024-04-02T07:28:49.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.643+0000 7f08a2a00640 1 --2- 172.21.15.55:0/566444316 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0888066690 0x7f0888068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:49.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.643+0000 7f08a2a00640 1 -- 172.21.15.55:0/566444316 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f08a411f060 con 0x7f08ac1599c0 2024-04-02T07:28:49.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.643+0000 7f08a9e00640 1 --2- 172.21.15.55:0/566444316 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0888066690 0x7f0888068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:49.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.643+0000 7f08a9e00640 1 --2- 172.21.15.55:0/566444316 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0888066690 0x7f0888068b50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f089c009f70 tx=0x7f089c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:49.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.647+0000 7f08a2a00640 1 -- 172.21.15.55:0/566444316 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f08a40ec680 con 0x7f08ac1599c0 2024-04-02T07:28:49.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:49.819+0000 7f08b1000640 1 -- 172.21.15.55:0/566444316 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f08ac06e270 con 0x7f08ac1599c0 2024-04-02T07:28:50.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.627+0000 7f08a2a00640 1 -- 172.21.15.55:0/566444316 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v83) v1 ==== 97+0+0 (secure 0 0 0) 0x7f08a40efca0 con 0x7f08ac1599c0 2024-04-02T07:28:50.628 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2024-04-02T07:28:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.627+0000 7f08b1000640 1 -- 172.21.15.55:0/566444316 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0888066690 msgr2=0x7f0888068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.627+0000 7f08b1000640 1 --2- 172.21.15.55:0/566444316 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0888066690 0x7f0888068b50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f089c009f70 tx=0x7f089c009190 comp rx=0 tx=0).stop 2024-04-02T07:28:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.627+0000 7f08b1000640 1 -- 172.21.15.55:0/566444316 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f08ac1599c0 msgr2=0x7f08ac0c8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.627+0000 7f08b1000640 1 --2- 172.21.15.55:0/566444316 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f08ac1599c0 0x7f08ac0c8040 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f08a40ab000 tx=0x7f08a40195d0 comp rx=0 tx=0).stop 2024-04-02T07:28:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.627+0000 7f08b1000640 1 -- 172.21.15.55:0/566444316 shutdown_connections 2024-04-02T07:28:50.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.627+0000 7f08b1000640 1 --2- 172.21.15.55:0/566444316 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f08ac1599c0 0x7f08ac0c8040 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:50.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.627+0000 7f08b1000640 1 --2- 172.21.15.55:0/566444316 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0888066690 0x7f0888068b50 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:50.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.627+0000 7f08b1000640 1 --2- 172.21.15.55:0/566444316 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f08ac0b38f0 0x7f08ac0c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:50.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.627+0000 7f08b1000640 1 --2- 172.21.15.55:0/566444316 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f08ac06d1c0 0x7f08ac146790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:50.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.627+0000 7f08b1000640 1 -- 172.21.15.55:0/566444316 >> 172.21.15.55:0/566444316 conn(0x7f08ac069d90 msgr2=0x7f08ac0ca170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:50.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.627+0000 7f08b1000640 1 -- 172.21.15.55:0/566444316 shutdown_connections 2024-04-02T07:28:50.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.627+0000 7f08b1000640 1 -- 172.21.15.55:0/566444316 wait complete. 2024-04-02T07:28:50.652 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-02T07:28:50.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.795+0000 7fecace00640 1 Processor -- start 2024-04-02T07:28:50.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.795+0000 7fecace00640 1 -- start start 2024-04-02T07:28:50.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.795+0000 7fecace00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feca815ee70 0x7feca8099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:50.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.795+0000 7fecace00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feca815f250 0x7feca80b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:50.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.795+0000 7fecace00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feca80cf6a0 con 0x7feca8098a10 2024-04-02T07:28:50.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.795+0000 7fecace00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feca80b0840 con 0x7feca815f250 2024-04-02T07:28:50.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.795+0000 7fecace00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca80ad270 con 0x7feca815ee70 2024-04-02T07:28:50.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.795+0000 7feca6800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feca8098a10 0x7feca80cb2f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34922/0 (socket says 172.21.15.55:34922) 2024-04-02T07:28:50.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.795+0000 7feca6800640 1 -- 172.21.15.55:0/1627480965 learned_addr learned my addr 172.21.15.55:0/1627480965 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:50.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.795+0000 7feca5e00640 1 --2- 172.21.15.55:0/1627480965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feca815ee70 0x7feca8099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:50.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.795+0000 7fec9d400640 1 --2- 172.21.15.55:0/1627480965 >> v2:172.21.15.106:3300/0 conn(0x7feca815f250 0x7feca80b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:50.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.795+0000 7feca5400640 1 -- 172.21.15.55:0/1627480965 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3904298498 0 0) 0x7feca80cf6a0 con 0x7feca8098a10 2024-04-02T07:28:50.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.795+0000 7feca5400640 1 -- 172.21.15.55:0/1627480965 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec8c003530 con 0x7feca8098a10 2024-04-02T07:28:50.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.795+0000 7fec9d400640 1 -- 172.21.15.55:0/1627480965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feca815ee70 msgr2=0x7feca8099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:50.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.795+0000 7fec9d400640 1 --2- 172.21.15.55:0/1627480965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feca815ee70 0x7feca8099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:50.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.795+0000 7fec9d400640 1 -- 172.21.15.55:0/1627480965 >> v1:172.21.15.55:6789/0 conn(0x7feca8098a10 legacy=0x7feca80cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:50.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.795+0000 7fec9d400640 1 -- 172.21.15.55:0/1627480965 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feca80b0a50 con 0x7feca815f250 2024-04-02T07:28:50.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.799+0000 7fec9d400640 1 --2- 172.21.15.55:0/1627480965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feca815f250 0x7feca80b12f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fec900097c0 tx=0x7fec9001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6180f41d2c3313a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:50.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.799+0000 7feca5400640 1 -- 172.21.15.55:0/1627480965 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec900a6040 con 0x7feca815f250 2024-04-02T07:28:50.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.799+0000 7feca5400640 1 -- 172.21.15.55:0/1627480965 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec900aa600 con 0x7feca815f250 2024-04-02T07:28:50.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.799+0000 7feca5400640 1 -- 172.21.15.55:0/1627480965 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec900aa970 con 0x7feca815f250 2024-04-02T07:28:50.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.799+0000 7fecace00640 1 -- 172.21.15.55:0/1627480965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feca815f250 msgr2=0x7feca80b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:50.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.799+0000 7fecace00640 1 --2- 172.21.15.55:0/1627480965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feca815f250 0x7feca80b12f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fec900097c0 tx=0x7fec9001c4a0 comp rx=0 tx=0).stop 2024-04-02T07:28:50.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.799+0000 7fecace00640 1 -- 172.21.15.55:0/1627480965 shutdown_connections 2024-04-02T07:28:50.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.799+0000 7fecace00640 1 --2- 172.21.15.55:0/1627480965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feca815f250 0x7feca80b12f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:50.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.799+0000 7fecace00640 1 --2- 172.21.15.55:0/1627480965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feca815ee70 0x7feca8099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:50.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.799+0000 7fecace00640 1 -- 172.21.15.55:0/1627480965 >> 172.21.15.55:0/1627480965 conn(0x7feca80b21d0 msgr2=0x7feca80b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:50.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.799+0000 7fecace00640 1 -- 172.21.15.55:0/1627480965 shutdown_connections 2024-04-02T07:28:50.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.799+0000 7fecace00640 1 -- 172.21.15.55:0/1627480965 wait complete. 2024-04-02T07:28:50.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7fecace00640 1 Processor -- start 2024-04-02T07:28:50.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7fecace00640 1 -- start start 2024-04-02T07:28:50.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7fecace00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feca8098a10 0x7feca815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:50.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7fecace00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feca815ee70 0x7feca80c6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:50.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7fecace00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feca815f250 0x7feca80c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:50.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7fecace00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca80b3df0 con 0x7feca8098a10 2024-04-02T07:28:50.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7fecace00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feca815c030 con 0x7feca815ee70 2024-04-02T07:28:50.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7fecace00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feca81f98f0 con 0x7feca815f250 2024-04-02T07:28:50.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7feca5e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feca8098a10 0x7feca815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:50.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7feca5e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feca8098a10 0x7feca815baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55196/0 (socket says 172.21.15.55:55196) 2024-04-02T07:28:50.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7feca5e00640 1 -- 172.21.15.55:0/3416708259 learned_addr learned my addr 172.21.15.55:0/3416708259 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:50.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7fec9d400640 1 --2- 172.21.15.55:0/3416708259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feca815ee70 0x7feca80c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:50.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7feca6800640 1 --2- 172.21.15.55:0/3416708259 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feca815f250 0x7feca80c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:50.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7feca5e00640 1 -- 172.21.15.55:0/3416708259 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feca815f250 msgr2=0x7feca80c6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:50.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7feca5e00640 1 --2- 172.21.15.55:0/3416708259 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feca815f250 0x7feca80c6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:50.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7feca5e00640 1 -- 172.21.15.55:0/3416708259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feca815ee70 msgr2=0x7feca80c6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:50.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7feca5e00640 1 --2- 172.21.15.55:0/3416708259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feca815ee70 0x7feca80c6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:50.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7feca5e00640 1 -- 172.21.15.55:0/3416708259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec90009420 con 0x7feca8098a10 2024-04-02T07:28:50.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7fec9d400640 1 --2- 172.21.15.55:0/3416708259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feca815ee70 0x7feca80c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:50.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7feca5e00640 1 --2- 172.21.15.55:0/3416708259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feca8098a10 0x7feca815baf0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fec9800efc0 tx=0x7fec9800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:50.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7fec9ea00640 1 -- 172.21.15.55:0/3416708259 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98014480 con 0x7feca8098a10 2024-04-02T07:28:50.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7fec9ea00640 1 -- 172.21.15.55:0/3416708259 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec9800f040 con 0x7feca8098a10 2024-04-02T07:28:50.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7fecace00640 1 -- 172.21.15.55:0/3416708259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feca80993b0 con 0x7feca8098a10 2024-04-02T07:28:50.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7fec9ea00640 1 -- 172.21.15.55:0/3416708259 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec98014800 con 0x7feca8098a10 2024-04-02T07:28:50.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7fecace00640 1 -- 172.21.15.55:0/3416708259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feca80b34c0 con 0x7feca8098a10 2024-04-02T07:28:50.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.803+0000 7fecace00640 1 -- 172.21.15.55:0/3416708259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feca8066c90 con 0x7feca8098a10 2024-04-02T07:28:50.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.807+0000 7fec9ea00640 1 -- 172.21.15.55:0/3416708259 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fec98014960 con 0x7feca8098a10 2024-04-02T07:28:50.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.807+0000 7fec9ea00640 1 --2- 172.21.15.55:0/3416708259 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec84066690 0x7fec84068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:50.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.807+0000 7fec9ea00640 1 -- 172.21.15.55:0/3416708259 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fec98084a50 con 0x7feca8098a10 2024-04-02T07:28:50.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.807+0000 7fec9d400640 1 --2- 172.21.15.55:0/3416708259 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec84066690 0x7fec84068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:50.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.807+0000 7fec9d400640 1 --2- 172.21.15.55:0/3416708259 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec84066690 0x7fec84068b50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fec900ae000 tx=0x7fec90008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:50.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:50.811+0000 7fec9ea00640 1 -- 172.21.15.55:0/3416708259 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fec98052100 con 0x7feca8098a10 2024-04-02T07:28:51.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.035+0000 7fecace00640 1 -- 172.21.15.55:0/3416708259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7feca80cc3e0 con 0x7feca8098a10 2024-04-02T07:28:51.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.035+0000 7fec9ea00640 1 -- 172.21.15.55:0/3416708259 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fec98055720 con 0x7feca8098a10 2024-04-02T07:28:51.036 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:51.037 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:28:51.037 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2024-04-02T07:28:51.037 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:51.037 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2024-04-02T07:28:51.037 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFL1DHxAAuUs47l42sADNRgxi4BeNrA==", 2024-04-02T07:28:51.037 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:28:51.038 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:28:51.038 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:28:51.038 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:28:51.038 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:28:51.038 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:51.038 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:51.039 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:51.039 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2024-04-02T07:28:51.039 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFZB+KxAAeKnfP4Z1UkLura+bQrG5mA==", 2024-04-02T07:28:51.039 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:28:51.039 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:28:51.039 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:28:51.040 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:28:51.040 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:28:51.040 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:51.040 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:51.040 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:51.040 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2024-04-02T07:28:51.041 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmUQR/JhAA9LNK5gHJ1NiiqNrfxL4mIA==", 2024-04-02T07:28:51.041 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:28:51.041 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:28:51.041 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:28:51.041 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:28:51.041 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:28:51.042 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:51.042 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:51.042 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:51.042 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2024-04-02T07:28:51.042 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmotumMhAASI1PogpVSHXWIv9xq3qs4Q==", 2024-04-02T07:28:51.043 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:28:51.043 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:28:51.043 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:28:51.043 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:28:51.043 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:28:51.043 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:51.044 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:51.044 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:51.044 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2024-04-02T07:28:51.044 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDysQtmsM9JIxAAZNjTGYW74kqz5NM9NyPSWQ==", 2024-04-02T07:28:51.044 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:28:51.044 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:28:51.045 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:28:51.045 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:28:51.045 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:51.045 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:51.045 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:51.045 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2024-04-02T07:28:51.046 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD1sQtmJaorKhAAtujPXPmQVX3QUG1ANqEphQ==", 2024-04-02T07:28:51.046 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:28:51.046 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:28:51.046 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:28:51.046 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:28:51.046 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:51.047 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:51.047 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:51.047 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2024-04-02T07:28:51.047 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD4sQtm1fdwMhAAOxlYwaBnPKhSQODMLVbaSQ==", 2024-04-02T07:28:51.047 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:28:51.048 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:28:51.048 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:28:51.048 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:28:51.048 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:51.048 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:51.048 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:51.048 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2024-04-02T07:28:51.049 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD7sQtmo9OaORAAsjpiVkG9vZV1QxpvgbrFmg==", 2024-04-02T07:28:51.049 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:28:51.049 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:28:51.049 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:28:51.049 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:28:51.049 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:51.050 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:51.050 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:51.050 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2024-04-02T07:28:51.050 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQACsgtmTyOkAxAARfxuj/YCM6FWNDhCkLQV3g==", 2024-04-02T07:28:51.050 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:28:51.050 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:28:51.050 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:28:51.050 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:28:51.050 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:51.051 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:51.051 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:51.051 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2024-04-02T07:28:51.051 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAFsgtmimDECRAAh/XVN7rICihc8NlxhDJB6Q==", 2024-04-02T07:28:51.051 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:28:51.051 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:28:51.051 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:28:51.051 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:28:51.052 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:51.052 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:51.052 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:51.052 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2024-04-02T07:28:51.052 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAIsgtmreHiDhAAISQbxixad17TRrz7MHQTxA==", 2024-04-02T07:28:51.052 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:28:51.052 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:28:51.052 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:28:51.053 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:28:51.053 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:51.053 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:51.054 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:51.054 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2024-04-02T07:28:51.054 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQALsgtmHVTlExAAT/6jK+czOZ3+4nwpgZOmow==", 2024-04-02T07:28:51.054 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:28:51.054 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:28:51.055 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:28:51.055 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:28:51.055 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:51.055 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:51.055 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:51.055 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2024-04-02T07:28:51.055 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmkS2QNhAAt+q0y1TDn03hqM/Y6uKq6g==", 2024-04-02T07:28:51.055 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:28:51.055 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:28:51.055 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2024-04-02T07:28:51.055 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-02T07:28:51.056 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:51.056 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:51.056 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:51.056 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2024-04-02T07:28:51.056 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmjCzTBBAAVYyat2dGZSTquRQoB+7JMg==", 2024-04-02T07:28:51.056 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:28:51.056 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:28:51.056 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:28:51.057 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:28:51.057 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:28:51.057 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:51.057 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:51.057 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:51.057 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2024-04-02T07:28:51.057 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmq45FARAAY6/caSeqvTn7/BThOodYIA==", 2024-04-02T07:28:51.057 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:28:51.057 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:28:51.057 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:28:51.057 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:28:51.058 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:28:51.058 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:51.058 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:51.058 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:51.058 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2024-04-02T07:28:51.058 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmmjDeChAAL2RsY5VlAy/KZ5go5ZJoBA==", 2024-04-02T07:28:51.058 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:28:51.058 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:28:51.058 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:28:51.058 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:28:51.058 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:28:51.058 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:51.058 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:51.058 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:51.059 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2024-04-02T07:28:51.059 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtm1hiMAxAAarlHR9VHGrkPCXhksMM/1w==", 2024-04-02T07:28:51.059 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:28:51.059 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:28:51.059 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:28:51.059 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:28:51.059 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:28:51.059 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:51.059 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:51.059 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:51.059 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2024-04-02T07:28:51.059 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFyktGxAAJC7ezewbXwDQue+qjpTfYw==", 2024-04-02T07:28:51.059 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:28:51.059 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:28:51.059 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-02T07:28:51.060 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:28:51.060 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:51.060 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:28:51.060 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:51.060 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2024-04-02T07:28:51.060 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmUcxUFxAA8NUHdxhUfp3/AILMIbS1fw==", 2024-04-02T07:28:51.060 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:28:51.060 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:28:51.060 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-02T07:28:51.060 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:28:51.060 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:51.060 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:51.060 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-04-02T07:28:51.060 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:28:51.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.035+0000 7fecace00640 1 -- 172.21.15.55:0/3416708259 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec84066690 msgr2=0x7fec84068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:51.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.035+0000 7fecace00640 1 --2- 172.21.15.55:0/3416708259 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec84066690 0x7fec84068b50 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fec900ae000 tx=0x7fec90008040 comp rx=0 tx=0).stop 2024-04-02T07:28:51.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.035+0000 7fecace00640 1 -- 172.21.15.55:0/3416708259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feca8098a10 msgr2=0x7feca815baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:51.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.035+0000 7fecace00640 1 --2- 172.21.15.55:0/3416708259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feca8098a10 0x7feca815baf0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fec9800efc0 tx=0x7fec9800c490 comp rx=0 tx=0).stop 2024-04-02T07:28:51.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.035+0000 7fecace00640 1 -- 172.21.15.55:0/3416708259 shutdown_connections 2024-04-02T07:28:51.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.035+0000 7fecace00640 1 --2- 172.21.15.55:0/3416708259 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feca815f250 0x7feca80c6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.035+0000 7fecace00640 1 --2- 172.21.15.55:0/3416708259 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec84066690 0x7fec84068b50 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.035+0000 7fecace00640 1 --2- 172.21.15.55:0/3416708259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feca815ee70 0x7feca80c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.035+0000 7fecace00640 1 --2- 172.21.15.55:0/3416708259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feca8098a10 0x7feca815baf0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.035+0000 7fecace00640 1 -- 172.21.15.55:0/3416708259 >> 172.21.15.55:0/3416708259 conn(0x7feca80b21d0 msgr2=0x7feca806f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:51.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.035+0000 7fecace00640 1 -- 172.21.15.55:0/3416708259 shutdown_connections 2024-04-02T07:28:51.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.035+0000 7fecace00640 1 -- 172.21.15.55:0/3416708259 wait complete. 2024-04-02T07:28:51.064 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:28:51.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.203+0000 7f3c70600640 1 Processor -- start 2024-04-02T07:28:51.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.203+0000 7f3c70600640 1 -- start start 2024-04-02T07:28:51.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.203+0000 7f3c70600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3c68156f70 0x7f3c6815d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:51.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.203+0000 7f3c70600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3c68157350 0x7f3c680cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:51.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.203+0000 7f3c70600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c6815d950 con 0x7f3c680d02a0 2024-04-02T07:28:51.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.203+0000 7f3c70600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6815dc30 con 0x7f3c68157350 2024-04-02T07:28:51.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.203+0000 7f3c70600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c6815df10 con 0x7f3c68156f70 2024-04-02T07:28:51.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.203+0000 7f3c6d200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3c68157350 0x7f3c680cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:51.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.203+0000 7f3c6e600640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3c680d02a0 0x7f3c680b31c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34928/0 (socket says 172.21.15.55:34928) 2024-04-02T07:28:51.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.203+0000 7f3c6d200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3c68157350 0x7f3c680cfd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55204/0 (socket says 172.21.15.55:55204) 2024-04-02T07:28:51.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.203+0000 7f3c6e600640 1 -- 172.21.15.55:0/1413012179 learned_addr learned my addr 172.21.15.55:0/1413012179 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:51.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.203+0000 7f3c6dc00640 1 --2- 172.21.15.55:0/1413012179 >> v2:172.21.15.106:3300/0 conn(0x7f3c68156f70 0x7f3c6815d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:51.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.203+0000 7f3c6dc00640 1 -- 172.21.15.55:0/1413012179 >> v2:172.21.15.55:3300/0 conn(0x7f3c68157350 msgr2=0x7f3c680cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:51.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.207+0000 7f3c6dc00640 1 --2- 172.21.15.55:0/1413012179 >> v2:172.21.15.55:3300/0 conn(0x7f3c68157350 0x7f3c680cfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.203+0000 7f3c67e00640 1 -- 172.21.15.55:0/1413012179 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3937414828 0 0) 0x7f3c6815d950 con 0x7f3c680d02a0 2024-04-02T07:28:51.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.207+0000 7f3c6dc00640 1 -- 172.21.15.55:0/1413012179 >> v1:172.21.15.55:6789/0 conn(0x7f3c680d02a0 legacy=0x7f3c680b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:51.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.207+0000 7f3c6dc00640 1 -- 172.21.15.55:0/1413012179 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c680cf560 con 0x7f3c68156f70 2024-04-02T07:28:51.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.207+0000 7f3c6dc00640 1 --2- 172.21.15.55:0/1413012179 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c68156f70 0x7f3c6815d0b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3c6806ae70 tx=0x7f3c5c01c450 comp rx=0 tx=0).ready entity=mon.1 client_cookie=921ebccff783658d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:51.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.207+0000 7f3c67e00640 1 -- 172.21.15.55:0/1413012179 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c0ab670 con 0x7f3c68156f70 2024-04-02T07:28:51.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.207+0000 7f3c67e00640 1 -- 172.21.15.55:0/1413012179 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c5c0ab7d0 con 0x7f3c68156f70 2024-04-02T07:28:51.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.207+0000 7f3c67e00640 1 -- 172.21.15.55:0/1413012179 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c5c0abb60 con 0x7f3c68156f70 2024-04-02T07:28:51.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.207+0000 7f3c70600640 1 -- 172.21.15.55:0/1413012179 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c68156f70 msgr2=0x7f3c6815d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:51.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.207+0000 7f3c70600640 1 --2- 172.21.15.55:0/1413012179 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c68156f70 0x7f3c6815d0b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3c6806ae70 tx=0x7f3c5c01c450 comp rx=0 tx=0).stop 2024-04-02T07:28:51.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.207+0000 7f3c70600640 1 -- 172.21.15.55:0/1413012179 shutdown_connections 2024-04-02T07:28:51.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.207+0000 7f3c70600640 1 --2- 172.21.15.55:0/1413012179 >> v2:172.21.15.55:3300/0 conn(0x7f3c68157350 0x7f3c680cfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.207+0000 7f3c70600640 1 --2- 172.21.15.55:0/1413012179 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c68156f70 0x7f3c6815d0b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.207+0000 7f3c70600640 1 -- 172.21.15.55:0/1413012179 >> 172.21.15.55:0/1413012179 conn(0x7f3c680b13b0 msgr2=0x7f3c680b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:51.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c70600640 1 -- 172.21.15.55:0/1413012179 shutdown_connections 2024-04-02T07:28:51.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c70600640 1 -- 172.21.15.55:0/1413012179 wait complete. 2024-04-02T07:28:51.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c70600640 1 Processor -- start 2024-04-02T07:28:51.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c70600640 1 -- start start 2024-04-02T07:28:51.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c70600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c680d02a0 0x7f3c6813d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:51.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c70600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c68156f70 0x7f3c68157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:51.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c70600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c68157350 0x7f3c68158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:51.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c70600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c680c9400 con 0x7f3c68157350 2024-04-02T07:28:51.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c70600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c680ca260 con 0x7f3c68156f70 2024-04-02T07:28:51.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c70600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c680c95e0 con 0x7f3c680d02a0 2024-04-02T07:28:51.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c6e600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c68157350 0x7f3c68158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c6e600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c68157350 0x7f3c68158470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55214/0 (socket says 172.21.15.55:55214) 2024-04-02T07:28:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c6e600640 1 -- 172.21.15.55:0/955031370 learned_addr learned my addr 172.21.15.55:0/955031370 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c6dc00640 1 --2- 172.21.15.55:0/955031370 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c680d02a0 0x7f3c6813d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c6d200640 1 --2- 172.21.15.55:0/955031370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c68156f70 0x7f3c68157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c6e600640 1 -- 172.21.15.55:0/955031370 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c680d02a0 msgr2=0x7f3c6813d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c6e600640 1 --2- 172.21.15.55:0/955031370 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c680d02a0 0x7f3c6813d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c6e600640 1 -- 172.21.15.55:0/955031370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c68156f70 msgr2=0x7f3c68157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c6e600640 1 --2- 172.21.15.55:0/955031370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c68156f70 0x7f3c68157730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c6e600640 1 -- 172.21.15.55:0/955031370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c5c009420 con 0x7f3c68157350 2024-04-02T07:28:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c6d200640 1 --2- 172.21.15.55:0/955031370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c68156f70 0x7f3c68157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c6e600640 1 --2- 172.21.15.55:0/955031370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c68157350 0x7f3c68158470 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000cac0 tx=0x7f3c6000cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c65600640 1 -- 172.21.15.55:0/955031370 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c6000ac30 con 0x7f3c68157350 2024-04-02T07:28:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c65600640 1 -- 172.21.15.55:0/955031370 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c6000ad90 con 0x7f3c68157350 2024-04-02T07:28:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c65600640 1 -- 172.21.15.55:0/955031370 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c60012640 con 0x7f3c68157350 2024-04-02T07:28:51.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c70600640 1 -- 172.21.15.55:0/955031370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c680c98c0 con 0x7f3c68157350 2024-04-02T07:28:51.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.211+0000 7f3c70600640 1 -- 172.21.15.55:0/955031370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c680c9e80 con 0x7f3c68157350 2024-04-02T07:28:51.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.215+0000 7f3c70600640 1 -- 172.21.15.55:0/955031370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c68066c90 con 0x7f3c68157350 2024-04-02T07:28:51.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.215+0000 7f3c65600640 1 -- 172.21.15.55:0/955031370 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3c600127a0 con 0x7f3c68157350 2024-04-02T07:28:51.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.215+0000 7f3c65600640 1 --2- 172.21.15.55:0/955031370 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3c48066690 0x7f3c48068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:51.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.215+0000 7f3c65600640 1 -- 172.21.15.55:0/955031370 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3c600842e0 con 0x7f3c68157350 2024-04-02T07:28:51.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.215+0000 7f3c6dc00640 1 --2- 172.21.15.55:0/955031370 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3c48066690 0x7f3c48068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:51.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.215+0000 7f3c6dc00640 1 --2- 172.21.15.55:0/955031370 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3c48066690 0x7f3c48068b50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c0af000 tx=0x7f3c5c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:51.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.219+0000 7f3c65600640 1 -- 172.21.15.55:0/955031370 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3c60051990 con 0x7f3c68157350 2024-04-02T07:28:51.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.383+0000 7f3c70600640 1 -- 172.21.15.55:0/955031370 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3c68071870 con 0x7f3c68157350 2024-04-02T07:28:51.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.383+0000 7f3c65600640 1 -- 172.21.15.55:0/955031370 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) v1 ==== 74+0+12390 (secure 0 0 0) 0x7f3c60054fb0 con 0x7f3c68157350 2024-04-02T07:28:51.387 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:51.387 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":83,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:28:50.613160+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":73,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:28:51.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.387+0000 7f3c70600640 1 -- 172.21.15.55:0/955031370 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3c48066690 msgr2=0x7f3c48068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:51.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.387+0000 7f3c70600640 1 --2- 172.21.15.55:0/955031370 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3c48066690 0x7f3c48068b50 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c0af000 tx=0x7f3c5c0a7000 comp rx=0 tx=0).stop 2024-04-02T07:28:51.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.387+0000 7f3c70600640 1 -- 172.21.15.55:0/955031370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c68157350 msgr2=0x7f3c68158470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:51.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.387+0000 7f3c70600640 1 --2- 172.21.15.55:0/955031370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c68157350 0x7f3c68158470 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f3c6000cac0 tx=0x7f3c6000cf80 comp rx=0 tx=0).stop 2024-04-02T07:28:51.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.387+0000 7f3c70600640 1 -- 172.21.15.55:0/955031370 shutdown_connections 2024-04-02T07:28:51.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.387+0000 7f3c70600640 1 --2- 172.21.15.55:0/955031370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c68157350 0x7f3c68158470 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.387+0000 7f3c70600640 1 --2- 172.21.15.55:0/955031370 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3c48066690 0x7f3c48068b50 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.387+0000 7f3c70600640 1 --2- 172.21.15.55:0/955031370 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3c68156f70 0x7f3c68157730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.387+0000 7f3c70600640 1 --2- 172.21.15.55:0/955031370 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3c680d02a0 0x7f3c6813d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.387+0000 7f3c70600640 1 -- 172.21.15.55:0/955031370 >> 172.21.15.55:0/955031370 conn(0x7f3c680b13b0 msgr2=0x7f3c680b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:51.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.387+0000 7f3c70600640 1 -- 172.21.15.55:0/955031370 shutdown_connections 2024-04-02T07:28:51.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.387+0000 7f3c70600640 1 -- 172.21.15.55:0/955031370 wait complete. 2024-04-02T07:28:51.407 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:28:51.407 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:28:51.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.551+0000 7f0109600640 1 Processor -- start 2024-04-02T07:28:51.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.551+0000 7f0109600640 1 -- start start 2024-04-02T07:28:51.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.551+0000 7f0109600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f01040709b0 0x7f01040b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:51.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.551+0000 7f0109600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01040b2fd0 0x7f01040b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:51.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.551+0000 7f0109600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010415e3a0 con 0x7f0104144260 2024-04-02T07:28:51.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.551+0000 7f0109600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01040b37c0 con 0x7f01040709b0 2024-04-02T07:28:51.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.551+0000 7f0109600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f010415e5f0 con 0x7f01040b2fd0 2024-04-02T07:28:51.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.551+0000 7f00fa000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f01040709b0 0x7f01040b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:51.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.551+0000 7f0102a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0104144260 0x7f01040702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34936/0 (socket says 172.21.15.55:34936) 2024-04-02T07:28:51.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.551+0000 7f0102a00640 1 -- 172.21.15.55:0/2276043896 learned_addr learned my addr 172.21.15.55:0/2276043896 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:51.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.551+0000 7f0103400640 1 --2- 172.21.15.55:0/2276043896 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01040b2fd0 0x7f01040b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:51.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.551+0000 7f00fa000640 1 -- 172.21.15.55:0/2276043896 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01040b2fd0 msgr2=0x7f01040b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:51.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.551+0000 7f00fa000640 1 --2- 172.21.15.55:0/2276043896 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01040b2fd0 0x7f01040b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.551+0000 7f00fa000640 1 -- 172.21.15.55:0/2276043896 >> v1:172.21.15.55:6789/0 conn(0x7f0104144260 legacy=0x7f01040702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:51.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.551+0000 7f00fa000640 1 -- 172.21.15.55:0/2276043896 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010415e8d0 con 0x7f01040709b0 2024-04-02T07:28:51.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.551+0000 7f0103400640 1 --2- 172.21.15.55:0/2276043896 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01040b2fd0 0x7f01040b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:28:51.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.555+0000 7f00fa000640 1 --2- 172.21.15.55:0/2276043896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01040709b0 0x7f01040b2a90 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0097c0 tx=0x7f00ec01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dcc7810fe8c2a9a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:51.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.555+0000 7f0102000640 1 -- 172.21.15.55:0/2276043896 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec0ad640 con 0x7f01040709b0 2024-04-02T07:28:51.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.555+0000 7f0102000640 1 -- 172.21.15.55:0/2276043896 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec0ad7a0 con 0x7f01040709b0 2024-04-02T07:28:51.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.555+0000 7f0102000640 1 -- 172.21.15.55:0/2276043896 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec0adb30 con 0x7f01040709b0 2024-04-02T07:28:51.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.555+0000 7f0109600640 1 -- 172.21.15.55:0/2276043896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01040709b0 msgr2=0x7f01040b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:51.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.555+0000 7f0109600640 1 --2- 172.21.15.55:0/2276043896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01040709b0 0x7f01040b2a90 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0097c0 tx=0x7f00ec01c4a0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.555+0000 7f0109600640 1 -- 172.21.15.55:0/2276043896 shutdown_connections 2024-04-02T07:28:51.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.555+0000 7f0109600640 1 --2- 172.21.15.55:0/2276043896 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01040b2fd0 0x7f01040b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.555+0000 7f0109600640 1 --2- 172.21.15.55:0/2276043896 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01040709b0 0x7f01040b2a90 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.555+0000 7f0109600640 1 -- 172.21.15.55:0/2276043896 >> 172.21.15.55:0/2276043896 conn(0x7f010406a390 msgr2=0x7f01040b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:51.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.555+0000 7f0109600640 1 -- 172.21.15.55:0/2276043896 shutdown_connections 2024-04-02T07:28:51.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.555+0000 7f0109600640 1 -- 172.21.15.55:0/2276043896 wait complete. 2024-04-02T07:28:51.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.555+0000 7f0109600640 1 Processor -- start 2024-04-02T07:28:51.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.555+0000 7f0109600640 1 -- start start 2024-04-02T07:28:51.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f0109600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01040709b0 0x7f010406d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:51.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f0109600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01040b2fd0 0x7f01041642b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:51.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f0109600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0104144260 0x7f0104137d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:51.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f0109600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01041647f0 con 0x7f01040b2fd0 2024-04-02T07:28:51.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f0109600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0104164ac0 con 0x7f0104144260 2024-04-02T07:28:51.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f0109600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0104164da0 con 0x7f01040709b0 2024-04-02T07:28:51.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f00fa000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01040b2fd0 0x7f01041642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:51.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f00fa000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01040b2fd0 0x7f01041642b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55224/0 (socket says 172.21.15.55:55224) 2024-04-02T07:28:51.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f00fa000640 1 -- 172.21.15.55:0/3937382852 learned_addr learned my addr 172.21.15.55:0/3937382852 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:51.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f0102a00640 1 --2- 172.21.15.55:0/3937382852 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01040709b0 0x7f010406d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:51.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f0103400640 1 --2- 172.21.15.55:0/3937382852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0104144260 0x7f0104137d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:51.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f00fa000640 1 -- 172.21.15.55:0/3937382852 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01040709b0 msgr2=0x7f010406d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:51.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f00fa000640 1 --2- 172.21.15.55:0/3937382852 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01040709b0 0x7f010406d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f00fa000640 1 -- 172.21.15.55:0/3937382852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0104144260 msgr2=0x7f0104137d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:51.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f00fa000640 1 --2- 172.21.15.55:0/3937382852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0104144260 0x7f0104137d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f00fa000640 1 -- 172.21.15.55:0/3937382852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00ec009420 con 0x7f01040b2fd0 2024-04-02T07:28:51.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f0103400640 1 --2- 172.21.15.55:0/3937382852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0104144260 0x7f0104137d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:28:51.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f00fa000640 1 --2- 172.21.15.55:0/3937382852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01040b2fd0 0x7f01041642b0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0b0040 tx=0x7f00ec019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:51.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f00fb400640 1 -- 172.21.15.55:0/3937382852 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec0b6820 con 0x7f01040b2fd0 2024-04-02T07:28:51.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f00fb400640 1 -- 172.21.15.55:0/3937382852 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00ec0a6040 con 0x7f01040b2fd0 2024-04-02T07:28:51.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f00fb400640 1 -- 172.21.15.55:0/3937382852 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00ec0b6be0 con 0x7f01040b2fd0 2024-04-02T07:28:51.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f0109600640 1 -- 172.21.15.55:0/3937382852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0104165080 con 0x7f01040b2fd0 2024-04-02T07:28:51.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f0109600640 1 -- 172.21.15.55:0/3937382852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0104138240 con 0x7f01040b2fd0 2024-04-02T07:28:51.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f0109600640 1 -- 172.21.15.55:0/3937382852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01041655a0 con 0x7f01040b2fd0 2024-04-02T07:28:51.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.559+0000 7f00fb400640 1 -- 172.21.15.55:0/3937382852 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f00ec0b4040 con 0x7f01040b2fd0 2024-04-02T07:28:51.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.563+0000 7f00fb400640 1 --2- 172.21.15.55:0/3937382852 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f00e0066690 0x7f00e0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:51.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.563+0000 7f00fb400640 1 -- 172.21.15.55:0/3937382852 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f00ec11e280 con 0x7f01040b2fd0 2024-04-02T07:28:51.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.563+0000 7f0102a00640 1 --2- 172.21.15.55:0/3937382852 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f00e0066690 0x7f00e0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:51.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.563+0000 7f0102a00640 1 --2- 172.21.15.55:0/3937382852 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f00e0066690 0x7f00e0068b50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f00f4005890 tx=0x7f00f4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:51.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.567+0000 7f00fb400640 1 -- 172.21.15.55:0/3937382852 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f00ec0eb9c0 con 0x7f01040b2fd0 2024-04-02T07:28:51.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.727+0000 7f0109600640 1 -- 172.21.15.55:0/3937382852 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f01040734d0 con 0x7f01040b2fd0 2024-04-02T07:28:51.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.731+0000 7f00fb400640 1 -- 172.21.15.55:0/3937382852 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v83) v1 ==== 93+0+10 (secure 0 0 0) 0x7f00ec0b20a0 con 0x7f01040b2fd0 2024-04-02T07:28:51.731 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:28:51.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.731+0000 7f0109600640 1 -- 172.21.15.55:0/3937382852 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f00e0066690 msgr2=0x7f00e0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:51.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.731+0000 7f0109600640 1 --2- 172.21.15.55:0/3937382852 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f00e0066690 0x7f00e0068b50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f00f4005890 tx=0x7f00f4009040 comp rx=0 tx=0).stop 2024-04-02T07:28:51.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.731+0000 7f0109600640 1 -- 172.21.15.55:0/3937382852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01040b2fd0 msgr2=0x7f01041642b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:51.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.731+0000 7f0109600640 1 --2- 172.21.15.55:0/3937382852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01040b2fd0 0x7f01041642b0 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f00ec0b0040 tx=0x7f00ec019240 comp rx=0 tx=0).stop 2024-04-02T07:28:51.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.731+0000 7f0109600640 1 -- 172.21.15.55:0/3937382852 shutdown_connections 2024-04-02T07:28:51.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.731+0000 7f0109600640 1 --2- 172.21.15.55:0/3937382852 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f00e0066690 0x7f00e0068b50 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.731+0000 7f0109600640 1 --2- 172.21.15.55:0/3937382852 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0104144260 0x7f0104137d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.731+0000 7f0109600640 1 --2- 172.21.15.55:0/3937382852 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01040b2fd0 0x7f01041642b0 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.731+0000 7f0109600640 1 --2- 172.21.15.55:0/3937382852 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f01040709b0 0x7f010406d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.731+0000 7f0109600640 1 -- 172.21.15.55:0/3937382852 >> 172.21.15.55:0/3937382852 conn(0x7f010406a390 msgr2=0x7f0104142ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:51.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.731+0000 7f0109600640 1 -- 172.21.15.55:0/3937382852 shutdown_connections 2024-04-02T07:28:51.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.731+0000 7f0109600640 1 -- 172.21.15.55:0/3937382852 wait complete. 2024-04-02T07:28:51.752 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-02T07:28:51.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.891+0000 7f6e38a00640 1 Processor -- start 2024-04-02T07:28:51.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.891+0000 7f6e38a00640 1 -- start start 2024-04-02T07:28:51.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.891+0000 7f6e38a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6e341600b0 0x7f6e3406eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:51.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.891+0000 7f6e38a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6e3406f090 0x7f6e340ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:51.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.891+0000 7f6e38a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e3415d0f0 con 0x7f6e340ced30 2024-04-02T07:28:51.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.891+0000 7f6e38a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e341615e0 con 0x7f6e341600b0 2024-04-02T07:28:51.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.891+0000 7f6e38a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e3415d3d0 con 0x7f6e3406f090 2024-04-02T07:28:51.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.891+0000 7f6e31e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6e341600b0 0x7f6e3406eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:51.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.891+0000 7f6e32800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6e340ced30 0x7f6e3415c1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34950/0 (socket says 172.21.15.55:34950) 2024-04-02T07:28:51.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.891+0000 7f6e32800640 1 -- 172.21.15.55:0/1637885264 learned_addr learned my addr 172.21.15.55:0/1637885264 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:51.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.891+0000 7f6e31e00640 1 --2- 172.21.15.55:0/1637885264 >> v2:172.21.15.55:3300/0 conn(0x7f6e341600b0 0x7f6e3406eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55240/0 (socket says 172.21.15.55:55240) 2024-04-02T07:28:51.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.891+0000 7f6e29400640 1 --2- 172.21.15.55:0/1637885264 >> v2:172.21.15.106:3300/0 conn(0x7f6e3406f090 0x7f6e340ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:51.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.891+0000 7f6e31e00640 1 -- 172.21.15.55:0/1637885264 >> v2:172.21.15.106:3300/0 conn(0x7f6e3406f090 msgr2=0x7f6e340ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:51.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.891+0000 7f6e31e00640 1 --2- 172.21.15.55:0/1637885264 >> v2:172.21.15.106:3300/0 conn(0x7f6e3406f090 0x7f6e340ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.891+0000 7f6e31e00640 1 -- 172.21.15.55:0/1637885264 >> v1:172.21.15.55:6789/0 conn(0x7f6e340ced30 legacy=0x7f6e3415c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:51.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.891+0000 7f6e31e00640 1 -- 172.21.15.55:0/1637885264 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3415d6b0 con 0x7f6e341600b0 2024-04-02T07:28:51.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.895+0000 7f6e31e00640 1 --2- 172.21.15.55:0/1637885264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e341600b0 0x7f6e3406eb50 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f6e340cf510 tx=0x7f6e2401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35801b9e0567983 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:51.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.895+0000 7f6e31400640 1 -- 172.21.15.55:0/1637885264 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e240ab610 con 0x7f6e341600b0 2024-04-02T07:28:51.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.895+0000 7f6e31400640 1 -- 172.21.15.55:0/1637885264 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e240ab770 con 0x7f6e341600b0 2024-04-02T07:28:51.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.895+0000 7f6e31400640 1 -- 172.21.15.55:0/1637885264 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e240abb00 con 0x7f6e341600b0 2024-04-02T07:28:51.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.895+0000 7f6e38a00640 1 -- 172.21.15.55:0/1637885264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e341600b0 msgr2=0x7f6e3406eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:51.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.895+0000 7f6e38a00640 1 --2- 172.21.15.55:0/1637885264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e341600b0 0x7f6e3406eb50 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f6e340cf510 tx=0x7f6e2401c3f0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.895+0000 7f6e38a00640 1 -- 172.21.15.55:0/1637885264 shutdown_connections 2024-04-02T07:28:51.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.895+0000 7f6e38a00640 1 --2- 172.21.15.55:0/1637885264 >> v2:172.21.15.106:3300/0 conn(0x7f6e3406f090 0x7f6e340ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.895+0000 7f6e38a00640 1 --2- 172.21.15.55:0/1637885264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e341600b0 0x7f6e3406eb50 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.895+0000 7f6e38a00640 1 -- 172.21.15.55:0/1637885264 >> 172.21.15.55:0/1637885264 conn(0x7f6e34098a10 msgr2=0x7f6e340b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:51.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.895+0000 7f6e38a00640 1 -- 172.21.15.55:0/1637885264 shutdown_connections 2024-04-02T07:28:51.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.895+0000 7f6e38a00640 1 -- 172.21.15.55:0/1637885264 wait complete. 2024-04-02T07:28:51.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e38a00640 1 Processor -- start 2024-04-02T07:28:51.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e38a00640 1 -- start start 2024-04-02T07:28:51.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e38a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e3406f090 0x7f6e3414b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:51.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e38a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e340ced30 0x7f6e3414c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:51.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e38a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e341600b0 0x7f6e3414ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:51.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e38a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e340b2180 con 0x7f6e3406f090 2024-04-02T07:28:51.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e38a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3414e200 con 0x7f6e340ced30 2024-04-02T07:28:51.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e38a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3414e4e0 con 0x7f6e341600b0 2024-04-02T07:28:51.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e31e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e3406f090 0x7f6e3414b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:51.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e31e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e3406f090 0x7f6e3414b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55242/0 (socket says 172.21.15.55:55242) 2024-04-02T07:28:51.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e31e00640 1 -- 172.21.15.55:0/502182591 learned_addr learned my addr 172.21.15.55:0/502182591 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:51.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e29400640 1 --2- 172.21.15.55:0/502182591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e340ced30 0x7f6e3414c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:51.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e32800640 1 --2- 172.21.15.55:0/502182591 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e341600b0 0x7f6e3414ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:51.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e31e00640 1 -- 172.21.15.55:0/502182591 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e341600b0 msgr2=0x7f6e3414ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:51.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e31e00640 1 --2- 172.21.15.55:0/502182591 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e341600b0 0x7f6e3414ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e31e00640 1 -- 172.21.15.55:0/502182591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e340ced30 msgr2=0x7f6e3414c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:51.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e31e00640 1 --2- 172.21.15.55:0/502182591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e340ced30 0x7f6e3414c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:51.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e31e00640 1 -- 172.21.15.55:0/502182591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e24009420 con 0x7f6e3406f090 2024-04-02T07:28:51.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e31e00640 1 --2- 172.21.15.55:0/502182591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e3406f090 0x7f6e3414b880 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f6e24019000 tx=0x7f6e2401ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:51.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e2aa00640 1 -- 172.21.15.55:0/502182591 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e240b5810 con 0x7f6e3406f090 2024-04-02T07:28:51.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e2aa00640 1 -- 172.21.15.55:0/502182591 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e240b5990 con 0x7f6e3406f090 2024-04-02T07:28:51.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e2aa00640 1 -- 172.21.15.55:0/502182591 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e240b5d40 con 0x7f6e3406f090 2024-04-02T07:28:51.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e38a00640 1 -- 172.21.15.55:0/502182591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e3414e7c0 con 0x7f6e3406f090 2024-04-02T07:28:51.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e38a00640 1 -- 172.21.15.55:0/502182591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e3414bdc0 con 0x7f6e3406f090 2024-04-02T07:28:51.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.899+0000 7f6e38a00640 1 -- 172.21.15.55:0/502182591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e34066c90 con 0x7f6e3406f090 2024-04-02T07:28:51.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.903+0000 7f6e2aa00640 1 -- 172.21.15.55:0/502182591 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6e240bf410 con 0x7f6e3406f090 2024-04-02T07:28:51.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.903+0000 7f6e2aa00640 1 --2- 172.21.15.55:0/502182591 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6e10066690 0x7f6e10068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:51.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.903+0000 7f6e2aa00640 1 -- 172.21.15.55:0/502182591 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6e2411eb30 con 0x7f6e3406f090 2024-04-02T07:28:51.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.903+0000 7f6e29400640 1 --2- 172.21.15.55:0/502182591 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6e10066690 0x7f6e10068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:51.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.903+0000 7f6e29400640 1 --2- 172.21.15.55:0/502182591 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6e10066690 0x7f6e10068b50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6e341f8e40 tx=0x7f6e1c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:51.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:51.907+0000 7f6e2aa00640 1 -- 172.21.15.55:0/502182591 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6e240ec280 con 0x7f6e3406f090 2024-04-02T07:28:52.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.071+0000 7f6e38a00640 1 -- 172.21.15.55:0/502182591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f6e3406a990 con 0x7f6e3406f090 2024-04-02T07:28:52.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.071+0000 7f6e2aa00640 1 -- 172.21.15.55:0/502182591 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v83) v1 ==== 84+0+65 (secure 0 0 0) 0x7f6e240ab5d0 con 0x7f6e3406f090 2024-04-02T07:28:52.072 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:52.072 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-02T07:28:52.072 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:28:52.072 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-04-02T07:28:52.073 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-04-02T07:28:52.073 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:28:52.073 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-02T07:28:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.071+0000 7f6e38a00640 1 -- 172.21.15.55:0/502182591 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6e10066690 msgr2=0x7f6e10068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.071+0000 7f6e38a00640 1 --2- 172.21.15.55:0/502182591 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6e10066690 0x7f6e10068b50 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6e341f8e40 tx=0x7f6e1c008040 comp rx=0 tx=0).stop 2024-04-02T07:28:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.071+0000 7f6e38a00640 1 -- 172.21.15.55:0/502182591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e3406f090 msgr2=0x7f6e3414b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.071+0000 7f6e38a00640 1 --2- 172.21.15.55:0/502182591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e3406f090 0x7f6e3414b880 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f6e24019000 tx=0x7f6e2401ac30 comp rx=0 tx=0).stop 2024-04-02T07:28:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.071+0000 7f6e38a00640 1 -- 172.21.15.55:0/502182591 shutdown_connections 2024-04-02T07:28:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.071+0000 7f6e38a00640 1 --2- 172.21.15.55:0/502182591 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e341600b0 0x7f6e3414ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.071+0000 7f6e38a00640 1 --2- 172.21.15.55:0/502182591 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6e10066690 0x7f6e10068b50 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.071+0000 7f6e38a00640 1 --2- 172.21.15.55:0/502182591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e340ced30 0x7f6e3414c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.071+0000 7f6e38a00640 1 --2- 172.21.15.55:0/502182591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e3406f090 0x7f6e3414b880 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.071+0000 7f6e38a00640 1 -- 172.21.15.55:0/502182591 >> 172.21.15.55:0/502182591 conn(0x7f6e34098a10 msgr2=0x7f6e340aefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.071+0000 7f6e38a00640 1 -- 172.21.15.55:0/502182591 shutdown_connections 2024-04-02T07:28:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.071+0000 7f6e38a00640 1 -- 172.21.15.55:0/502182591 wait complete. 2024-04-02T07:28:52.093 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-02T07:28:52.093 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-02T07:28:52.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.235+0000 7f1a0a800640 1 Processor -- start 2024-04-02T07:28:52.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.235+0000 7f1a0a800640 1 -- start start 2024-04-02T07:28:52.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.239+0000 7f1a0a800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1a04142d20 0x7f1a0406d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:52.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.239+0000 7f1a0a800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a040b1cb0 0x7f1a0406d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:52.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.239+0000 7f1a0a800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1a040cb3c0 0x7f1a040cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:52.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.239+0000 7f1a0a800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0415dec0 con 0x7f1a04142d20 2024-04-02T07:28:52.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.239+0000 7f1a0a800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a0415d240 con 0x7f1a040cb3c0 2024-04-02T07:28:52.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.239+0000 7f1a0a800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0415d520 con 0x7f1a040b1cb0 2024-04-02T07:28:52.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.239+0000 7f1a09400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1a04142d20 0x7f1a0406d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:52.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.239+0000 7f1a09400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1a04142d20 0x7f1a0406d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55248/0 (socket says 172.21.15.55:55248) 2024-04-02T07:28:52.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.239+0000 7f1a09400640 1 -- 172.21.15.55:0/2242735663 learned_addr learned my addr 172.21.15.55:0/2242735663 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:52.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.239+0000 7f1a08a00640 1 --2- 172.21.15.55:0/2242735663 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a040b1cb0 0x7f1a0406d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:52.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.239+0000 7f1a09e00640 1 --2- 172.21.15.55:0/2242735663 >> v2:172.21.15.106:3300/0 conn(0x7f1a040cb3c0 0x7f1a040cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:52.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.239+0000 7f1a09400640 1 -- 172.21.15.55:0/2242735663 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a040b1cb0 msgr2=0x7f1a0406d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:52.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.239+0000 7f1a09400640 1 --2- 172.21.15.55:0/2242735663 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a040b1cb0 0x7f1a0406d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:52.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.239+0000 7f1a09400640 1 -- 172.21.15.55:0/2242735663 >> v2:172.21.15.106:3300/0 conn(0x7f1a040cb3c0 msgr2=0x7f1a040cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:52.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.239+0000 7f1a09400640 1 --2- 172.21.15.55:0/2242735663 >> v2:172.21.15.106:3300/0 conn(0x7f1a040cb3c0 0x7f1a040cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:52.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.239+0000 7f1a09400640 1 -- 172.21.15.55:0/2242735663 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a0415d800 con 0x7f1a04142d20 2024-04-02T07:28:52.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.239+0000 7f1a08a00640 1 --2- 172.21.15.55:0/2242735663 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a040b1cb0 0x7f1a0406d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:52.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.243+0000 7f1a09400640 1 --2- 172.21.15.55:0/2242735663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a04142d20 0x7f1a0406d2c0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f1a040715d0 tx=0x7f19f801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf62f8c397eb16a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:52.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.243+0000 7f1a03e00640 1 -- 172.21.15.55:0/2242735663 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f80ab600 con 0x7f1a04142d20 2024-04-02T07:28:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.243+0000 7f1a03e00640 1 -- 172.21.15.55:0/2242735663 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f80a7050 con 0x7f1a04142d20 2024-04-02T07:28:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.243+0000 7f1a03e00640 1 -- 172.21.15.55:0/2242735663 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f80ab980 con 0x7f1a04142d20 2024-04-02T07:28:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.243+0000 7f1a0a800640 1 -- 172.21.15.55:0/2242735663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a04142d20 msgr2=0x7f1a0406d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.243+0000 7f1a0a800640 1 --2- 172.21.15.55:0/2242735663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a04142d20 0x7f1a0406d2c0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f1a040715d0 tx=0x7f19f801c3d0 comp rx=0 tx=0).stop 2024-04-02T07:28:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.243+0000 7f1a0a800640 1 -- 172.21.15.55:0/2242735663 shutdown_connections 2024-04-02T07:28:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.243+0000 7f1a0a800640 1 --2- 172.21.15.55:0/2242735663 >> v2:172.21.15.106:3300/0 conn(0x7f1a040cb3c0 0x7f1a040cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.243+0000 7f1a0a800640 1 --2- 172.21.15.55:0/2242735663 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a040b1cb0 0x7f1a0406d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.243+0000 7f1a0a800640 1 --2- 172.21.15.55:0/2242735663 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a04142d20 0x7f1a0406d2c0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.243+0000 7f1a0a800640 1 -- 172.21.15.55:0/2242735663 >> 172.21.15.55:0/2242735663 conn(0x7f1a04069d90 msgr2=0x7f1a0406a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.243+0000 7f1a0a800640 1 -- 172.21.15.55:0/2242735663 shutdown_connections 2024-04-02T07:28:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.243+0000 7f1a0a800640 1 -- 172.21.15.55:0/2242735663 wait complete. 2024-04-02T07:28:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.243+0000 7f1a0a800640 1 Processor -- start 2024-04-02T07:28:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.243+0000 7f1a0a800640 1 -- start start 2024-04-02T07:28:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a0a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a040b1cb0 0x7f1a04155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:52.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a0a800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a040cb3c0 0x7f1a0415e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:52.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a0a800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a04142d20 0x7f1a0415bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:52.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a0a800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a0412a3f0 con 0x7f1a040b1cb0 2024-04-02T07:28:52.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a0a800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a041f4600 con 0x7f1a040cb3c0 2024-04-02T07:28:52.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a0a800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a041f48e0 con 0x7f1a04142d20 2024-04-02T07:28:52.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a09400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a040b1cb0 0x7f1a04155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:52.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a09400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a040b1cb0 0x7f1a04155690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55260/0 (socket says 172.21.15.55:55260) 2024-04-02T07:28:52.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a09400640 1 -- 172.21.15.55:0/2040472832 learned_addr learned my addr 172.21.15.55:0/2040472832 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:52.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a08a00640 1 --2- 172.21.15.55:0/2040472832 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a040cb3c0 0x7f1a0415e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:52.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a09e00640 1 --2- 172.21.15.55:0/2040472832 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a04142d20 0x7f1a0415bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:52.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a09400640 1 -- 172.21.15.55:0/2040472832 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a04142d20 msgr2=0x7f1a0415bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:52.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a09400640 1 --2- 172.21.15.55:0/2040472832 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a04142d20 0x7f1a0415bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:52.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a09400640 1 -- 172.21.15.55:0/2040472832 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a040cb3c0 msgr2=0x7f1a0415e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:52.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a09400640 1 --2- 172.21.15.55:0/2040472832 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a040cb3c0 0x7f1a0415e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:52.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a09400640 1 -- 172.21.15.55:0/2040472832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f80094d0 con 0x7f1a040b1cb0 2024-04-02T07:28:52.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a09400640 1 --2- 172.21.15.55:0/2040472832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a040b1cb0 0x7f1a04155690 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f19f80ae040 tx=0x7f19f801ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:52.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a01600640 1 -- 172.21.15.55:0/2040472832 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f80b6620 con 0x7f1a040b1cb0 2024-04-02T07:28:52.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a01600640 1 -- 172.21.15.55:0/2040472832 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19f80abe90 con 0x7f1a040b1cb0 2024-04-02T07:28:52.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a01600640 1 -- 172.21.15.55:0/2040472832 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f80b69e0 con 0x7f1a040b1cb0 2024-04-02T07:28:52.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a0a800640 1 -- 172.21.15.55:0/2040472832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a041f4bc0 con 0x7f1a040b1cb0 2024-04-02T07:28:52.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a0a800640 1 -- 172.21.15.55:0/2040472832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a041561c0 con 0x7f1a040b1cb0 2024-04-02T07:28:52.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a0a800640 1 -- 172.21.15.55:0/2040472832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a04155bd0 con 0x7f1a040b1cb0 2024-04-02T07:28:52.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.247+0000 7f1a01600640 1 -- 172.21.15.55:0/2040472832 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f19f80b2040 con 0x7f1a040b1cb0 2024-04-02T07:28:52.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.251+0000 7f1a01600640 1 --2- 172.21.15.55:0/2040472832 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f19e4066690 0x7f19e4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:52.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.251+0000 7f1a01600640 1 -- 172.21.15.55:0/2040472832 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f19f811e330 con 0x7f1a040b1cb0 2024-04-02T07:28:52.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.251+0000 7f1a08a00640 1 --2- 172.21.15.55:0/2040472832 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f19e4066690 0x7f19e4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:52.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.251+0000 7f1a08a00640 1 --2- 172.21.15.55:0/2040472832 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f19e4066690 0x7f19e4068b50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1a0415cc40 tx=0x7f19f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:52.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.255+0000 7f1a01600640 1 -- 172.21.15.55:0/2040472832 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f19f80eb950 con 0x7f1a040b1cb0 2024-04-02T07:28:52.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.415+0000 7f1a0a800640 1 -- 172.21.15.55:0/2040472832 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1a04073fa0 con 0x7f1a040b1cb0 2024-04-02T07:28:52.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.515+0000 7f1a01600640 1 -- 172.21.15.55:0/2040472832 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v84) v1 ==== 138+0+0 (secure 0 0 0) 0x7f19f80eef70 con 0x7f1a040b1cb0 2024-04-02T07:28:52.518 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-04-02T07:28:52.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.519+0000 7f1a0a800640 1 -- 172.21.15.55:0/2040472832 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f19e4066690 msgr2=0x7f19e4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:52.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.519+0000 7f1a0a800640 1 --2- 172.21.15.55:0/2040472832 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f19e4066690 0x7f19e4068b50 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f1a0415cc40 tx=0x7f19f0008040 comp rx=0 tx=0).stop 2024-04-02T07:28:52.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.519+0000 7f1a0a800640 1 -- 172.21.15.55:0/2040472832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a040b1cb0 msgr2=0x7f1a04155690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:52.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.519+0000 7f1a0a800640 1 --2- 172.21.15.55:0/2040472832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a040b1cb0 0x7f1a04155690 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f19f80ae040 tx=0x7f19f801ac10 comp rx=0 tx=0).stop 2024-04-02T07:28:52.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.519+0000 7f1a0a800640 1 -- 172.21.15.55:0/2040472832 shutdown_connections 2024-04-02T07:28:52.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.519+0000 7f1a0a800640 1 --2- 172.21.15.55:0/2040472832 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1a04142d20 0x7f1a0415bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:52.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.519+0000 7f1a0a800640 1 --2- 172.21.15.55:0/2040472832 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f19e4066690 0x7f19e4068b50 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:52.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.519+0000 7f1a0a800640 1 --2- 172.21.15.55:0/2040472832 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1a040cb3c0 0x7f1a0415e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:52.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.519+0000 7f1a0a800640 1 --2- 172.21.15.55:0/2040472832 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1a040b1cb0 0x7f1a04155690 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:52.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.519+0000 7f1a0a800640 1 -- 172.21.15.55:0/2040472832 >> 172.21.15.55:0/2040472832 conn(0x7f1a04069d90 msgr2=0x7f1a040cd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:52.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.519+0000 7f1a0a800640 1 -- 172.21.15.55:0/2040472832 shutdown_connections 2024-04-02T07:28:52.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.519+0000 7f1a0a800640 1 -- 172.21.15.55:0/2040472832 wait complete. 2024-04-02T07:28:52.545 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-02T07:28:52.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.691+0000 7f162d600640 1 Processor -- start 2024-04-02T07:28:52.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.691+0000 7f162d600640 1 -- start start 2024-04-02T07:28:52.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.691+0000 7f162d600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1628143f00 0x7f16280cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:52.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.691+0000 7f162d600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16280ced70 con 0x7f16280cd4a0 2024-04-02T07:28:52.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.691+0000 7f162d600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16280cad40 con 0x7f16280ce1d0 2024-04-02T07:28:52.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.691+0000 7f162d600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16280cdff0 con 0x7f1628143f00 2024-04-02T07:28:52.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.691+0000 7f161fe00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f16280cd4a0 0x7f16280cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34952/0 (socket says 172.21.15.55:34952) 2024-04-02T07:28:52.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.691+0000 7f161fe00640 1 -- 172.21.15.55:0/3452860044 learned_addr learned my addr 172.21.15.55:0/3452860044 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:52.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.691+0000 7f1626a00640 1 --2- 172.21.15.55:0/3452860044 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1628143f00 0x7f16280cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:52.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.691+0000 7f1626000640 1 -- 172.21.15.55:0/3452860044 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 448684694 0 0) 0x7f16280ced70 con 0x7f16280cd4a0 2024-04-02T07:28:52.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.691+0000 7f1626000640 1 -- 172.21.15.55:0/3452860044 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f160c003530 con 0x7f16280cd4a0 2024-04-02T07:28:52.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.691+0000 7f1626000640 1 -- 172.21.15.55:0/3452860044 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3839379064 0 0) 0x7f16280cad40 con 0x7f16280ce1d0 2024-04-02T07:28:52.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.691+0000 7f1626000640 1 -- 172.21.15.55:0/3452860044 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f16280ced70 con 0x7f16280ce1d0 2024-04-02T07:28:52.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.691+0000 7f1626000640 1 -- 172.21.15.55:0/3452860044 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1712729441 0 0) 0x7f160c003530 con 0x7f16280cd4a0 2024-04-02T07:28:52.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.691+0000 7f1626a00640 1 -- 172.21.15.55:0/3452860044 >> v1:172.21.15.106:6789/0 conn(0x7f16280ce1d0 legacy=0x7f16280ce660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:52.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.691+0000 7f1626a00640 1 -- 172.21.15.55:0/3452860044 >> v1:172.21.15.55:6789/0 conn(0x7f16280cd4a0 legacy=0x7f16280cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:52.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.691+0000 7f1626a00640 1 -- 172.21.15.55:0/3452860044 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16280cb020 con 0x7f1628143f00 2024-04-02T07:28:52.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.695+0000 7f1626a00640 1 --2- 172.21.15.55:0/3452860044 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1628143f00 0x7f16280cbb00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1618009820 tx=0x7f161801c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2a337ed28d03c87 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:52.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.695+0000 7f1626000640 1 -- 172.21.15.55:0/3452860044 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1610001600 con 0x7f1628143f00 2024-04-02T07:28:52.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.695+0000 7f1626000640 1 -- 172.21.15.55:0/3452860044 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16180a8050 con 0x7f1628143f00 2024-04-02T07:28:52.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.695+0000 7f1626000640 1 -- 172.21.15.55:0/3452860044 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180ac620 con 0x7f1628143f00 2024-04-02T07:28:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.695+0000 7f162d600640 1 -- 172.21.15.55:0/3452860044 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1628143f00 msgr2=0x7f16280cbb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.695+0000 7f162d600640 1 --2- 172.21.15.55:0/3452860044 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1628143f00 0x7f16280cbb00 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1618009820 tx=0x7f161801c3e0 comp rx=0 tx=0).stop 2024-04-02T07:28:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.695+0000 7f162d600640 1 -- 172.21.15.55:0/3452860044 shutdown_connections 2024-04-02T07:28:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.695+0000 7f162d600640 1 --2- 172.21.15.55:0/3452860044 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1628143f00 0x7f16280cbb00 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.695+0000 7f162d600640 1 -- 172.21.15.55:0/3452860044 >> 172.21.15.55:0/3452860044 conn(0x7f1628066110 msgr2=0x7f1628069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:52.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.695+0000 7f162d600640 1 -- 172.21.15.55:0/3452860044 shutdown_connections 2024-04-02T07:28:52.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.695+0000 7f162d600640 1 -- 172.21.15.55:0/3452860044 wait complete. 2024-04-02T07:28:52.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f162d600640 1 Processor -- start 2024-04-02T07:28:52.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f162d600640 1 -- start start 2024-04-02T07:28:52.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f162d600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16280cd4a0 0x7f162813bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:52.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f162d600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16280ce1d0 0x7f162813e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:52.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f162d600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1628143f00 0x7f16281424d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:52.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f162d600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162813aba0 con 0x7f16280cd4a0 2024-04-02T07:28:52.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f162d600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f162813ae80 con 0x7f16280ce1d0 2024-04-02T07:28:52.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f162d600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f162813b160 con 0x7f1628143f00 2024-04-02T07:28:52.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f1626a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16280cd4a0 0x7f162813bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:52.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f1626a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16280cd4a0 0x7f162813bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55266/0 (socket says 172.21.15.55:55266) 2024-04-02T07:28:52.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f1626a00640 1 -- 172.21.15.55:0/3188848695 learned_addr learned my addr 172.21.15.55:0/3188848695 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:52.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f161fe00640 1 --2- 172.21.15.55:0/3188848695 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16280ce1d0 0x7f162813e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:52.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f1627400640 1 --2- 172.21.15.55:0/3188848695 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1628143f00 0x7f16281424d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:52.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f1626a00640 1 -- 172.21.15.55:0/3188848695 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1628143f00 msgr2=0x7f16281424d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:52.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f1626a00640 1 --2- 172.21.15.55:0/3188848695 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1628143f00 0x7f16281424d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:52.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f1626a00640 1 -- 172.21.15.55:0/3188848695 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16280ce1d0 msgr2=0x7f162813e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:52.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f1626a00640 1 --2- 172.21.15.55:0/3188848695 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16280ce1d0 0x7f162813e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:52.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f1626a00640 1 -- 172.21.15.55:0/3188848695 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1618009420 con 0x7f16280cd4a0 2024-04-02T07:28:52.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f1626a00640 1 --2- 172.21.15.55:0/3188848695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16280cd4a0 0x7f162813bc40 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f16180af040 tx=0x7f161801ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:52.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f161ea00640 1 -- 172.21.15.55:0/3188848695 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180bd070 con 0x7f16280cd4a0 2024-04-02T07:28:52.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f161ea00640 1 -- 172.21.15.55:0/3188848695 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16180acd10 con 0x7f16280cd4a0 2024-04-02T07:28:52.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f161ea00640 1 -- 172.21.15.55:0/3188848695 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16180b7620 con 0x7f16280cd4a0 2024-04-02T07:28:52.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f162d600640 1 -- 172.21.15.55:0/3188848695 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f162813b440 con 0x7f16280cd4a0 2024-04-02T07:28:52.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.699+0000 7f162d600640 1 -- 172.21.15.55:0/3188848695 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1628142a10 con 0x7f16280cd4a0 2024-04-02T07:28:52.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.703+0000 7f162d600640 1 -- 172.21.15.55:0/3188848695 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16280b1040 con 0x7f16280cd4a0 2024-04-02T07:28:52.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.703+0000 7f161ea00640 1 -- 172.21.15.55:0/3188848695 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f16180b3040 con 0x7f16280cd4a0 2024-04-02T07:28:52.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.703+0000 7f161ea00640 1 --2- 172.21.15.55:0/3188848695 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1604066690 0x7f1604068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:52.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.703+0000 7f161ea00640 1 -- 172.21.15.55:0/3188848695 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f161811d3c0 con 0x7f16280cd4a0 2024-04-02T07:28:52.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.703+0000 7f161fe00640 1 --2- 172.21.15.55:0/3188848695 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1604066690 0x7f1604068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:52.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.703+0000 7f161fe00640 1 --2- 172.21.15.55:0/3188848695 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1604066690 0x7f1604068b50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1610000fe0 tx=0x7f1610001380 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:52.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.707+0000 7f161ea00640 1 -- 172.21.15.55:0/3188848695 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f16180ea920 con 0x7f16280cd4a0 2024-04-02T07:28:52.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:52.871+0000 7f162d600640 1 -- 172.21.15.55:0/3188848695 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1628066c90 con 0x7f16280cd4a0 2024-04-02T07:28:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.519+0000 7f161ea00640 1 -- 172.21.15.55:0/3188848695 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v85) v1 ==== 170+0+0 (secure 0 0 0) 0x7f16180edf40 con 0x7f16280cd4a0 2024-04-02T07:28:53.521 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-04-02T07:28:53.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.527+0000 7f162d600640 1 -- 172.21.15.55:0/3188848695 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1604066690 msgr2=0x7f1604068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:53.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.527+0000 7f162d600640 1 --2- 172.21.15.55:0/3188848695 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1604066690 0x7f1604068b50 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f1610000fe0 tx=0x7f1610001380 comp rx=0 tx=0).stop 2024-04-02T07:28:53.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.527+0000 7f162d600640 1 -- 172.21.15.55:0/3188848695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16280cd4a0 msgr2=0x7f162813bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.527+0000 7f162d600640 1 --2- 172.21.15.55:0/3188848695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16280cd4a0 0x7f162813bc40 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f16180af040 tx=0x7f161801ac20 comp rx=0 tx=0).stop 2024-04-02T07:28:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.527+0000 7f162d600640 1 -- 172.21.15.55:0/3188848695 shutdown_connections 2024-04-02T07:28:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.527+0000 7f162d600640 1 --2- 172.21.15.55:0/3188848695 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1628143f00 0x7f16281424d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.527+0000 7f162d600640 1 --2- 172.21.15.55:0/3188848695 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1604066690 0x7f1604068b50 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.527+0000 7f162d600640 1 --2- 172.21.15.55:0/3188848695 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16280ce1d0 0x7f162813e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.527+0000 7f162d600640 1 --2- 172.21.15.55:0/3188848695 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16280cd4a0 0x7f162813bc40 secure :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f16180af040 tx=0x7f161801ac20 comp rx=0 tx=0).stop 2024-04-02T07:28:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.527+0000 7f162d600640 1 -- 172.21.15.55:0/3188848695 >> 172.21.15.55:0/3188848695 conn(0x7f1628066110 msgr2=0x7f16280cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.527+0000 7f162d600640 1 -- 172.21.15.55:0/3188848695 shutdown_connections 2024-04-02T07:28:53.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.527+0000 7f162d600640 1 -- 172.21.15.55:0/3188848695 wait complete. 2024-04-02T07:28:53.562 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-02T07:28:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.707+0000 7f58de800640 1 Processor -- start 2024-04-02T07:28:53.707 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.707+0000 7f58de800640 1 -- start start 2024-04-02T07:28:53.708 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.707+0000 7f58de800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f58d80ade90 0x7f58d806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:53.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.707+0000 7f58de800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d806c630 con 0x7f58d80b41a0 2024-04-02T07:28:53.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.707+0000 7f58de800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58d806c8f0 con 0x7f58d80b3dc0 2024-04-02T07:28:53.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.707+0000 7f58de800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58d80cae80 con 0x7f58d80ade90 2024-04-02T07:28:53.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.707+0000 7f58cfe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f58d80ade90 0x7f58d806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:53.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.707+0000 7f58d7e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f58d80b41a0 0x7f58d8142ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34966/0 (socket says 172.21.15.55:34966) 2024-04-02T07:28:53.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.707+0000 7f58d7e00640 1 -- 172.21.15.55:0/9873393 learned_addr learned my addr 172.21.15.55:0/9873393 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:53.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.707+0000 7f58cfe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f58d80ade90 0x7f58d806d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55268/0 (socket says 172.21.15.55:55268) 2024-04-02T07:28:53.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.707+0000 7f58cfe00640 1 -- 172.21.15.55:0/9873393 >> v1:172.21.15.106:6789/0 conn(0x7f58d80b3dc0 legacy=0x7f58d80ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:53.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.707+0000 7f58cfe00640 1 -- 172.21.15.55:0/9873393 >> v1:172.21.15.55:6789/0 conn(0x7f58d80b41a0 legacy=0x7f58d8142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:53.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.707+0000 7f58cfe00640 1 -- 172.21.15.55:0/9873393 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58d806cbd0 con 0x7f58d80ade90 2024-04-02T07:28:53.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.707+0000 7f58d6a00640 1 -- 172.21.15.55:0/9873393 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 854060971 0 0) 0x7f58d806c630 con 0x7f58d80b41a0 2024-04-02T07:28:53.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.711+0000 7f58cfe00640 1 --2- 172.21.15.55:0/9873393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58d80ade90 0x7f58d806d6b0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f58c00097c0 tx=0x7f58c001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6401bee34d310571 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:53.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.711+0000 7f58d6a00640 1 -- 172.21.15.55:0/9873393 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c00ab670 con 0x7f58d80ade90 2024-04-02T07:28:53.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.711+0000 7f58d6a00640 1 -- 172.21.15.55:0/9873393 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c00ab7d0 con 0x7f58d80ade90 2024-04-02T07:28:53.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.711+0000 7f58d6a00640 1 -- 172.21.15.55:0/9873393 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c00abb60 con 0x7f58d80ade90 2024-04-02T07:28:53.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.711+0000 7f58de800640 1 -- 172.21.15.55:0/9873393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58d80ade90 msgr2=0x7f58d806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:53.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.711+0000 7f58de800640 1 --2- 172.21.15.55:0/9873393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58d80ade90 0x7f58d806d6b0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f58c00097c0 tx=0x7f58c001c470 comp rx=0 tx=0).stop 2024-04-02T07:28:53.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.711+0000 7f58de800640 1 -- 172.21.15.55:0/9873393 shutdown_connections 2024-04-02T07:28:53.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.711+0000 7f58de800640 1 --2- 172.21.15.55:0/9873393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58d80ade90 0x7f58d806d6b0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:53.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.711+0000 7f58de800640 1 -- 172.21.15.55:0/9873393 >> 172.21.15.55:0/9873393 conn(0x7f58d806a390 msgr2=0x7f58d80b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:53.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.711+0000 7f58de800640 1 -- 172.21.15.55:0/9873393 shutdown_connections 2024-04-02T07:28:53.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.711+0000 7f58de800640 1 -- 172.21.15.55:0/9873393 wait complete. 2024-04-02T07:28:53.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58de800640 1 Processor -- start 2024-04-02T07:28:53.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58de800640 1 -- start start 2024-04-02T07:28:53.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58de800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58d80ade90 0x7f58d8152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:53.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58de800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58d80b3dc0 0x7f58d8136f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:53.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58de800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58d80b41a0 0x7f58d8137460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:53.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58de800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d81575f0 con 0x7f58d80ade90 2024-04-02T07:28:53.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58de800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58d813c3f0 con 0x7f58d80b41a0 2024-04-02T07:28:53.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58de800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58d813c6d0 con 0x7f58d80b3dc0 2024-04-02T07:28:53.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58d7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58d80ade90 0x7f58d8152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:53.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58d7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58d80ade90 0x7f58d8152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55278/0 (socket says 172.21.15.55:55278) 2024-04-02T07:28:53.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58d7400640 1 -- 172.21.15.55:0/248874517 learned_addr learned my addr 172.21.15.55:0/248874517 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:53.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58d7e00640 1 --2- 172.21.15.55:0/248874517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58d80b41a0 0x7f58d8137460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58cfe00640 1 --2- 172.21.15.55:0/248874517 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58d80b3dc0 0x7f58d8136f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58d7400640 1 -- 172.21.15.55:0/248874517 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58d80b3dc0 msgr2=0x7f58d8136f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58d7400640 1 --2- 172.21.15.55:0/248874517 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58d80b3dc0 0x7f58d8136f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58d7400640 1 -- 172.21.15.55:0/248874517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58d80b41a0 msgr2=0x7f58d8137460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58d7400640 1 --2- 172.21.15.55:0/248874517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58d80b41a0 0x7f58d8137460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58d7400640 1 -- 172.21.15.55:0/248874517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c0009420 con 0x7f58d80ade90 2024-04-02T07:28:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58cfe00640 1 --2- 172.21.15.55:0/248874517 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58d80b3dc0 0x7f58d8136f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58d7e00640 1 --2- 172.21.15.55:0/248874517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58d80b41a0 0x7f58d8137460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58d7400640 1 --2- 172.21.15.55:0/248874517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58d80ade90 0x7f58d8152280 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f58c800c500 tx=0x7f58c800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58cf400640 1 -- 172.21.15.55:0/248874517 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8005220 con 0x7f58d80ade90 2024-04-02T07:28:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58cf400640 1 -- 172.21.15.55:0/248874517 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58c8005380 con 0x7f58d80ade90 2024-04-02T07:28:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58cf400640 1 -- 172.21.15.55:0/248874517 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58c8007270 con 0x7f58d80ade90 2024-04-02T07:28:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58de800640 1 -- 172.21.15.55:0/248874517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58d806de00 con 0x7f58d80ade90 2024-04-02T07:28:53.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58de800640 1 -- 172.21.15.55:0/248874517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58d8157280 con 0x7f58d80ade90 2024-04-02T07:28:53.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.715+0000 7f58de800640 1 -- 172.21.15.55:0/248874517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58d8066c90 con 0x7f58d80ade90 2024-04-02T07:28:53.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.719+0000 7f58cf400640 1 -- 172.21.15.55:0/248874517 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f58c80073d0 con 0x7f58d80ade90 2024-04-02T07:28:53.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.719+0000 7f58cf400640 1 --2- 172.21.15.55:0/248874517 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f58b4066690 0x7f58b4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:53.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.719+0000 7f58cf400640 1 -- 172.21.15.55:0/248874517 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f58c8084830 con 0x7f58d80ade90 2024-04-02T07:28:53.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.719+0000 7f58cfe00640 1 --2- 172.21.15.55:0/248874517 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f58b4066690 0x7f58b4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:53.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.719+0000 7f58cfe00640 1 --2- 172.21.15.55:0/248874517 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f58b4066690 0x7f58b4068b50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f58c00af000 tx=0x7f58c00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:53.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.723+0000 7f58cf400640 1 -- 172.21.15.55:0/248874517 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f58c8051c90 con 0x7f58d80ade90 2024-04-02T07:28:53.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.915+0000 7f58de800640 1 -- 172.21.15.55:0/248874517 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f58d80b1240 con 0x7f58d80ade90 2024-04-02T07:28:53.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.923+0000 7f58cf400640 1 -- 172.21.15.55:0/248874517 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v56) v1 ==== 174+0+0 (secure 0 0 0) 0x7f58c80552b0 con 0x7f58d80ade90 2024-04-02T07:28:53.926 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 12 and data pool 13 2024-04-02T07:28:53.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.927+0000 7f58de800640 1 -- 172.21.15.55:0/248874517 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f58b4066690 msgr2=0x7f58b4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:53.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.927+0000 7f58de800640 1 --2- 172.21.15.55:0/248874517 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f58b4066690 0x7f58b4068b50 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f58c00af000 tx=0x7f58c00a7000 comp rx=0 tx=0).stop 2024-04-02T07:28:53.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.927+0000 7f58de800640 1 -- 172.21.15.55:0/248874517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58d80ade90 msgr2=0x7f58d8152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:53.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.927+0000 7f58de800640 1 --2- 172.21.15.55:0/248874517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58d80ade90 0x7f58d8152280 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f58c800c500 tx=0x7f58c800c9c0 comp rx=0 tx=0).stop 2024-04-02T07:28:53.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.931+0000 7f58de800640 1 -- 172.21.15.55:0/248874517 shutdown_connections 2024-04-02T07:28:53.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.931+0000 7f58de800640 1 --2- 172.21.15.55:0/248874517 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f58b4066690 0x7f58b4068b50 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:53.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.931+0000 7f58de800640 1 --2- 172.21.15.55:0/248874517 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f58d80b41a0 0x7f58d8137460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:53.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.931+0000 7f58de800640 1 --2- 172.21.15.55:0/248874517 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f58d80b3dc0 0x7f58d8136f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:53.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.931+0000 7f58de800640 1 --2- 172.21.15.55:0/248874517 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f58d80ade90 0x7f58d8152280 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:53.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.931+0000 7f58de800640 1 -- 172.21.15.55:0/248874517 >> 172.21.15.55:0/248874517 conn(0x7f58d806a390 msgr2=0x7f58d80702a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:53.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.931+0000 7f58de800640 1 -- 172.21.15.55:0/248874517 shutdown_connections 2024-04-02T07:28:53.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:53.931+0000 7f58de800640 1 -- 172.21.15.55:0/248874517 wait complete. 2024-04-02T07:28:53.969 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:28:54.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.107+0000 7fdc18c00640 1 Processor -- start 2024-04-02T07:28:54.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.107+0000 7fdc18c00640 1 -- start start 2024-04-02T07:28:54.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc18c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdc14098a10 0x7fdc14098e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:54.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc18c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc140d01d0 con 0x7fdc140cfdf0 2024-04-02T07:28:54.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc18c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc14099360 con 0x7fdc140b16e0 2024-04-02T07:28:54.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc18c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1406c0e0 con 0x7fdc14098a10 2024-04-02T07:28:54.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc11e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdc140cfdf0 0x7fdc1406b8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34982/0 (socket says 172.21.15.55:34982) 2024-04-02T07:28:54.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc11e00640 1 -- 172.21.15.55:0/3142844462 learned_addr learned my addr 172.21.15.55:0/3142844462 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:54.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc12800640 1 --2- 172.21.15.55:0/3142844462 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdc14098a10 0x7fdc14098e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:54.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc11400640 1 -- 172.21.15.55:0/3142844462 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1990123406 0 0) 0x7fdc04001120 con 0x7fdc140cfdf0 2024-04-02T07:28:54.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc11400640 1 -- 172.21.15.55:0/3142844462 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbf8003530 con 0x7fdc140cfdf0 2024-04-02T07:28:54.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc11400640 1 -- 172.21.15.55:0/3142844462 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1694120865 0 0) 0x7fdc14099360 con 0x7fdc140b16e0 2024-04-02T07:28:54.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc11400640 1 -- 172.21.15.55:0/3142844462 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc04001120 con 0x7fdc140b16e0 2024-04-02T07:28:54.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc11400640 1 -- 172.21.15.55:0/3142844462 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1236102991 0 0) 0x7fdbf8003530 con 0x7fdc140cfdf0 2024-04-02T07:28:54.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc11400640 1 -- 172.21.15.55:0/3142844462 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdc14098a10 msgr2=0x7fdc14098e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:54.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc11400640 1 --2- 172.21.15.55:0/3142844462 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdc14098a10 0x7fdc14098e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc11400640 1 -- 172.21.15.55:0/3142844462 >> v1:172.21.15.106:6789/0 conn(0x7fdc140b16e0 legacy=0x7fdc140b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:54.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc11400640 1 -- 172.21.15.55:0/3142844462 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc140b01d0 con 0x7fdc140cfdf0 2024-04-02T07:28:54.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc11400640 1 -- 172.21.15.55:0/3142844462 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fdc04001810 con 0x7fdc140cfdf0 2024-04-02T07:28:54.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc11400640 1 -- 172.21.15.55:0/3142844462 >> v1:172.21.15.55:6789/0 conn(0x7fdc140cfdf0 legacy=0x7fdc1406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:54.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc11400640 1 --2- 172.21.15.55:0/3142844462 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdc14098a10 0x7fdbf8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:54.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc11400640 1 --2- 172.21.15.55:0/3142844462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbf80040a0 0x7fdbf80047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:54.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc11400640 1 --2- 172.21.15.55:0/3142844462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf8004d10 0x7fdbf8005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:54.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc11400640 1 -- 172.21.15.55:0/3142844462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1406c0e0 con 0x7fdbf8004d10 2024-04-02T07:28:54.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc11400640 1 -- 172.21.15.55:0/3142844462 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf800ba70 con 0x7fdbf80040a0 2024-04-02T07:28:54.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc11400640 1 -- 172.21.15.55:0/3142844462 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbf800bc30 con 0x7fdc14098a10 2024-04-02T07:28:54.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc12800640 1 --2- 172.21.15.55:0/3142844462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf8004d10 0x7fdbf8005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:54.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc11e00640 1 --2- 172.21.15.55:0/3142844462 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdc14098a10 0x7fdbf8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:54.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc09400640 1 --2- 172.21.15.55:0/3142844462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbf80040a0 0x7fdbf80047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:54.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc12800640 1 -- 172.21.15.55:0/3142844462 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdc14098a10 msgr2=0x7fdbf8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:54.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc12800640 1 --2- 172.21.15.55:0/3142844462 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdc14098a10 0x7fdbf8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc12800640 1 -- 172.21.15.55:0/3142844462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbf80040a0 msgr2=0x7fdbf80047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:54.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc12800640 1 --2- 172.21.15.55:0/3142844462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbf80040a0 0x7fdbf80047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc12800640 1 -- 172.21.15.55:0/3142844462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbf8003530 con 0x7fdbf8004d10 2024-04-02T07:28:54.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.111+0000 7fdc09400640 1 --2- 172.21.15.55:0/3142844462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdbf80040a0 0x7fdbf80047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:54.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.115+0000 7fdc12800640 1 --2- 172.21.15.55:0/3142844462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf8004d10 0x7fdbf8005190 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009ae0 tx=0x7fdc0c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e462f084a5b11034 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:54.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.115+0000 7fdc11400640 1 -- 172.21.15.55:0/3142844462 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c0a6450 con 0x7fdbf8004d10 2024-04-02T07:28:54.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.115+0000 7fdc11400640 1 -- 172.21.15.55:0/3142844462 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc0c0a65b0 con 0x7fdbf8004d10 2024-04-02T07:28:54.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.115+0000 7fdc11400640 1 -- 172.21.15.55:0/3142844462 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc0c0a6960 con 0x7fdbf8004d10 2024-04-02T07:28:54.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.115+0000 7fdc18c00640 1 -- 172.21.15.55:0/3142844462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf8004d10 msgr2=0x7fdbf8005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:54.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.115+0000 7fdc18c00640 1 --2- 172.21.15.55:0/3142844462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf8004d10 0x7fdbf8005190 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009ae0 tx=0x7fdc0c01ca70 comp rx=0 tx=0).stop 2024-04-02T07:28:54.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.115+0000 7fdc12800640 1 -- 172.21.15.55:0/3142844462 reap_dead start 2024-04-02T07:28:54.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.115+0000 7fdc18c00640 1 -- 172.21.15.55:0/3142844462 shutdown_connections 2024-04-02T07:28:54.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.115+0000 7fdc18c00640 1 -- 172.21.15.55:0/3142844462 >> 172.21.15.55:0/3142844462 conn(0x7fdc140b2210 msgr2=0x7fdc140b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:54.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.115+0000 7fdc18c00640 1 -- 172.21.15.55:0/3142844462 shutdown_connections 2024-04-02T07:28:54.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.115+0000 7fdc18c00640 1 -- 172.21.15.55:0/3142844462 wait complete. 2024-04-02T07:28:54.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.115+0000 7fdc18c00640 1 Processor -- start 2024-04-02T07:28:54.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc18c00640 1 -- start start 2024-04-02T07:28:54.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc18c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf8004d10 0x7fdc140c5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:54.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc18c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc141540c0 0x7fdc140b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:54.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc18c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdc140cc070 0x7fdc140cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:54.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc18c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140cca30 con 0x7fdbf8004d10 2024-04-02T07:28:54.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc18c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140c5730 con 0x7fdc141540c0 2024-04-02T07:28:54.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc18c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140c5a10 con 0x7fdc140cc070 2024-04-02T07:28:54.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc11e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf8004d10 0x7fdc140c5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:54.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc11e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf8004d10 0x7fdc140c5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55308/0 (socket says 172.21.15.55:55308) 2024-04-02T07:28:54.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc11e00640 1 -- 172.21.15.55:0/635579083 learned_addr learned my addr 172.21.15.55:0/635579083 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:54.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc09400640 1 --2- 172.21.15.55:0/635579083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc141540c0 0x7fdc140b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:54.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc12800640 1 --2- 172.21.15.55:0/635579083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdc140cc070 0x7fdc140cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:54.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc11e00640 1 -- 172.21.15.55:0/635579083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdc140cc070 msgr2=0x7fdc140cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:54.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc11e00640 1 --2- 172.21.15.55:0/635579083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdc140cc070 0x7fdc140cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc11e00640 1 -- 172.21.15.55:0/635579083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc141540c0 msgr2=0x7fdc140b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:54.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc11e00640 1 --2- 172.21.15.55:0/635579083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc141540c0 0x7fdc140b5c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc11e00640 1 -- 172.21.15.55:0/635579083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc140c5cf0 con 0x7fdbf8004d10 2024-04-02T07:28:54.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc12800640 1 --2- 172.21.15.55:0/635579083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdc140cc070 0x7fdc140cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:54.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc11e00640 1 --2- 172.21.15.55:0/635579083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf8004d10 0x7fdc140c5090 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fdc04012510 tx=0x7fdc04012910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:54.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc0aa00640 1 -- 172.21.15.55:0/635579083 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04014750 con 0x7fdbf8004d10 2024-04-02T07:28:54.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc0aa00640 1 -- 172.21.15.55:0/635579083 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc040148b0 con 0x7fdbf8004d10 2024-04-02T07:28:54.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc0aa00640 1 -- 172.21.15.55:0/635579083 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04014c20 con 0x7fdbf8004d10 2024-04-02T07:28:54.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc18c00640 1 -- 172.21.15.55:0/635579083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc140c5fd0 con 0x7fdbf8004d10 2024-04-02T07:28:54.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc18c00640 1 -- 172.21.15.55:0/635579083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc140b6190 con 0x7fdbf8004d10 2024-04-02T07:28:54.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.119+0000 7fdc18c00640 1 -- 172.21.15.55:0/635579083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc14066c90 con 0x7fdbf8004d10 2024-04-02T07:28:54.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.123+0000 7fdc0aa00640 1 -- 172.21.15.55:0/635579083 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fdc040153e0 con 0x7fdbf8004d10 2024-04-02T07:28:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.123+0000 7fdc0aa00640 1 --2- 172.21.15.55:0/635579083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdbf0066690 0x7fdbf0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.123+0000 7fdc0aa00640 1 -- 172.21.15.55:0/635579083 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc04086a20 con 0x7fdbf8004d10 2024-04-02T07:28:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.123+0000 7fdc09400640 1 --2- 172.21.15.55:0/635579083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdbf0066690 0x7fdbf0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:54.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.123+0000 7fdc09400640 1 --2- 172.21.15.55:0/635579083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdbf0066690 0x7fdbf0068b50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc001630 tx=0x7fdbfc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:54.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.127+0000 7fdc0aa00640 1 -- 172.21.15.55:0/635579083 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fdc04053cf0 con 0x7fdbf8004d10 2024-04-02T07:28:54.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.291+0000 7fdc18c00640 1 -- 172.21.15.55:0/635579083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc140d01d0 con 0x7fdbf8004d10 2024-04-02T07:28:54.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.291+0000 7fdc0aa00640 1 -- 172.21.15.55:0/635579083 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16105 (secure 0 0 0) 0x7fdc140d01d0 con 0x7fdbf8004d10 2024-04-02T07:28:54.293 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:54.293 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":86,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:28:53.919652+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:28:52.464907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-02T07:28:52.918058+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:28:54.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.295+0000 7fdc18c00640 1 -- 172.21.15.55:0/635579083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdbf0066690 msgr2=0x7fdbf0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:54.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.295+0000 7fdc18c00640 1 --2- 172.21.15.55:0/635579083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdbf0066690 0x7fdbf0068b50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc001630 tx=0x7fdbfc009040 comp rx=0 tx=0).stop 2024-04-02T07:28:54.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.295+0000 7fdc18c00640 1 -- 172.21.15.55:0/635579083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf8004d10 msgr2=0x7fdc140c5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:54.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.295+0000 7fdc18c00640 1 --2- 172.21.15.55:0/635579083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf8004d10 0x7fdc140c5090 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fdc04012510 tx=0x7fdc04012910 comp rx=0 tx=0).stop 2024-04-02T07:28:54.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.295+0000 7fdc18c00640 1 -- 172.21.15.55:0/635579083 shutdown_connections 2024-04-02T07:28:54.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.295+0000 7fdc18c00640 1 --2- 172.21.15.55:0/635579083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdc140cc070 0x7fdc140cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.295+0000 7fdc18c00640 1 --2- 172.21.15.55:0/635579083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdbf0066690 0x7fdbf0068b50 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.295+0000 7fdc18c00640 1 --2- 172.21.15.55:0/635579083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc141540c0 0x7fdc140b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.295+0000 7fdc18c00640 1 --2- 172.21.15.55:0/635579083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbf8004d10 0x7fdc140c5090 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.295+0000 7fdc18c00640 1 -- 172.21.15.55:0/635579083 >> 172.21.15.55:0/635579083 conn(0x7fdc140b2210 msgr2=0x7fdc1415b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:54.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.295+0000 7fdc18c00640 1 -- 172.21.15.55:0/635579083 shutdown_connections 2024-04-02T07:28:54.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.295+0000 7fdc18c00640 1 -- 172.21.15.55:0/635579083 wait complete. 2024-04-02T07:28:54.316 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:28:54.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.455+0000 7f4fab600640 1 Processor -- start 2024-04-02T07:28:54.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.455+0000 7f4fab600640 1 -- start start 2024-04-02T07:28:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.455+0000 7f4fab600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4fa415cbe0 0x7f4fa40ce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.455+0000 7f4fab600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f4fa4065d20 0x7f4fa40b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.455+0000 7f4fab600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa406d5b0 con 0x7f4fa4070a80 2024-04-02T07:28:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.455+0000 7f4fab600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa40cec10 con 0x7f4fa415cbe0 2024-04-02T07:28:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.455+0000 7f4fab600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa406cc80 con 0x7f4fa4065d20 2024-04-02T07:28:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.459+0000 7f4fa8c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4fa415cbe0 0x7f4fa40ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.459+0000 7f4fa9600640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4fa4070a80 0x7f4fa406da40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34998/0 (socket says 172.21.15.55:34998) 2024-04-02T07:28:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.459+0000 7f4fa9600640 1 -- 172.21.15.55:0/1947305208 learned_addr learned my addr 172.21.15.55:0/1947305208 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.459+0000 7f4f9be00640 1 --2- 172.21.15.55:0/1947305208 >> v2:172.21.15.106:3300/0 conn(0x7f4fa4065d20 0x7f4fa40b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.459+0000 7f4fa8c00640 1 -- 172.21.15.55:0/1947305208 >> v2:172.21.15.106:3300/0 conn(0x7f4fa4065d20 msgr2=0x7f4fa40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:54.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.459+0000 7f4fa8c00640 1 --2- 172.21.15.55:0/1947305208 >> v2:172.21.15.106:3300/0 conn(0x7f4fa4065d20 0x7f4fa40b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.459+0000 7f4fa8c00640 1 -- 172.21.15.55:0/1947305208 >> v1:172.21.15.55:6789/0 conn(0x7f4fa4070a80 legacy=0x7f4fa406da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:54.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.459+0000 7f4fa8c00640 1 -- 172.21.15.55:0/1947305208 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa406cf60 con 0x7f4fa415cbe0 2024-04-02T07:28:54.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.459+0000 7f4fa3e00640 1 -- 172.21.15.55:0/1947305208 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876814960 0 0) 0x7f4fa406d5b0 con 0x7f4fa4070a80 2024-04-02T07:28:54.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.459+0000 7f4fa8c00640 1 --2- 172.21.15.55:0/1947305208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fa415cbe0 0x7f4fa40ce630 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f4fa406c8a0 tx=0x7f4f9401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33a8b007c0d7b29a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:54.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.459+0000 7f4fa3e00640 1 -- 172.21.15.55:0/1947305208 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f940ab600 con 0x7f4fa415cbe0 2024-04-02T07:28:54.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.459+0000 7f4fa3e00640 1 -- 172.21.15.55:0/1947305208 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f940a7050 con 0x7f4fa415cbe0 2024-04-02T07:28:54.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.459+0000 7f4fa3e00640 1 -- 172.21.15.55:0/1947305208 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f940ab980 con 0x7f4fa415cbe0 2024-04-02T07:28:54.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fab600640 1 -- 172.21.15.55:0/1947305208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fa415cbe0 msgr2=0x7f4fa40ce630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:54.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fab600640 1 --2- 172.21.15.55:0/1947305208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fa415cbe0 0x7f4fa40ce630 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f4fa406c8a0 tx=0x7f4f9401c480 comp rx=0 tx=0).stop 2024-04-02T07:28:54.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fab600640 1 -- 172.21.15.55:0/1947305208 shutdown_connections 2024-04-02T07:28:54.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fab600640 1 --2- 172.21.15.55:0/1947305208 >> v2:172.21.15.106:3300/0 conn(0x7f4fa4065d20 0x7f4fa40b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fab600640 1 --2- 172.21.15.55:0/1947305208 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fa415cbe0 0x7f4fa40ce630 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fab600640 1 -- 172.21.15.55:0/1947305208 >> 172.21.15.55:0/1947305208 conn(0x7f4fa40ced50 msgr2=0x7f4fa40cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:54.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fab600640 1 -- 172.21.15.55:0/1947305208 shutdown_connections 2024-04-02T07:28:54.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fab600640 1 -- 172.21.15.55:0/1947305208 wait complete. 2024-04-02T07:28:54.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fab600640 1 Processor -- start 2024-04-02T07:28:54.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fab600640 1 -- start start 2024-04-02T07:28:54.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fab600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fa4065d20 0x7f4fa415fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:54.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fab600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4fa4070a80 0x7f4fa415e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:54.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fab600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fa415cbe0 0x7f4fa4145ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:54.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fab600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa415e8b0 con 0x7f4fa4065d20 2024-04-02T07:28:54.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fab600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa415eb30 con 0x7f4fa415cbe0 2024-04-02T07:28:54.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fab600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa415ee10 con 0x7f4fa4070a80 2024-04-02T07:28:54.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fa8c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fa4065d20 0x7f4fa415fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:54.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fa8c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fa4065d20 0x7f4fa415fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55332/0 (socket says 172.21.15.55:55332) 2024-04-02T07:28:54.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fa8c00640 1 -- 172.21.15.55:0/3798525691 learned_addr learned my addr 172.21.15.55:0/3798525691 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:54.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fa8c00640 1 -- 172.21.15.55:0/3798525691 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4fa4070a80 msgr2=0x7f4fa415e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:54.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4f9be00640 1 --2- 172.21.15.55:0/3798525691 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4fa4070a80 0x7f4fa415e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:54.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fa9600640 1 --2- 172.21.15.55:0/3798525691 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fa415cbe0 0x7f4fa4145ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:54.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fa8c00640 1 --2- 172.21.15.55:0/3798525691 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4fa4070a80 0x7f4fa415e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fa8c00640 1 -- 172.21.15.55:0/3798525691 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fa415cbe0 msgr2=0x7f4fa4145ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:54.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fa8c00640 1 --2- 172.21.15.55:0/3798525691 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fa415cbe0 0x7f4fa4145ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fa8c00640 1 -- 172.21.15.55:0/3798525691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f94009420 con 0x7f4fa4065d20 2024-04-02T07:28:54.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4f9be00640 1 --2- 172.21.15.55:0/3798525691 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4fa4070a80 0x7f4fa415e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:28:54.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fa9600640 1 --2- 172.21.15.55:0/3798525691 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fa415cbe0 0x7f4fa4145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:28:54.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fa8c00640 1 --2- 172.21.15.55:0/3798525691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fa4065d20 0x7f4fa415fce0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f4f940ae040 tx=0x7f4f94019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:54.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.463+0000 7f4fa1600640 1 -- 172.21.15.55:0/3798525691 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f940b4610 con 0x7f4fa4065d20 2024-04-02T07:28:54.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.467+0000 7f4fa1600640 1 -- 172.21.15.55:0/3798525691 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f940b4770 con 0x7f4fa4065d20 2024-04-02T07:28:54.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.467+0000 7f4fa1600640 1 -- 172.21.15.55:0/3798525691 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f940b4b20 con 0x7f4fa4065d20 2024-04-02T07:28:54.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.467+0000 7f4fab600640 1 -- 172.21.15.55:0/3798525691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa4071420 con 0x7f4fa4065d20 2024-04-02T07:28:54.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.467+0000 7f4fab600640 1 -- 172.21.15.55:0/3798525691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa415f3d0 con 0x7f4fa4065d20 2024-04-02T07:28:54.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.467+0000 7f4fab600640 1 -- 172.21.15.55:0/3798525691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa4066c90 con 0x7f4fa4065d20 2024-04-02T07:28:54.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.467+0000 7f4fa1600640 1 -- 172.21.15.55:0/3798525691 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f4f940b2040 con 0x7f4fa4065d20 2024-04-02T07:28:54.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.467+0000 7f4fa1600640 1 --2- 172.21.15.55:0/3798525691 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4f80066690 0x7f4f80068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:54.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.467+0000 7f4fa1600640 1 -- 172.21.15.55:0/3798525691 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f9411e1f0 con 0x7f4fa4065d20 2024-04-02T07:28:54.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.467+0000 7f4f9be00640 1 --2- 172.21.15.55:0/3798525691 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4f80066690 0x7f4f80068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:54.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.467+0000 7f4f9be00640 1 --2- 172.21.15.55:0/3798525691 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4f80066690 0x7f4f80068b50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4fa406b9f0 tx=0x7f4f8c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:54.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.471+0000 7f4fa1600640 1 -- 172.21.15.55:0/3798525691 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f4f940eb4c0 con 0x7f4fa4065d20 2024-04-02T07:28:54.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.635+0000 7f4fab600640 1 -- 172.21.15.55:0/3798525691 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4fa40b01d0 con 0x7f4fa4065d20 2024-04-02T07:28:54.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.635+0000 7f4fa1600640 1 -- 172.21.15.55:0/3798525691 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16105 (secure 0 0 0) 0x7f4f940eeae0 con 0x7f4fa4065d20 2024-04-02T07:28:54.637 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:54.637 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":86,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:28:53.919652+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:28:52.464907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-02T07:28:52.918058+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:28:54.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.635+0000 7f4fab600640 1 -- 172.21.15.55:0/3798525691 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4f80066690 msgr2=0x7f4f80068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:54.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.635+0000 7f4fab600640 1 --2- 172.21.15.55:0/3798525691 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4f80066690 0x7f4f80068b50 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f4fa406b9f0 tx=0x7f4f8c008040 comp rx=0 tx=0).stop 2024-04-02T07:28:54.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.635+0000 7f4fab600640 1 -- 172.21.15.55:0/3798525691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fa4065d20 msgr2=0x7f4fa415fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:54.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.635+0000 7f4fab600640 1 --2- 172.21.15.55:0/3798525691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fa4065d20 0x7f4fa415fce0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f4f940ae040 tx=0x7f4f94019220 comp rx=0 tx=0).stop 2024-04-02T07:28:54.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.635+0000 7f4fab600640 1 -- 172.21.15.55:0/3798525691 shutdown_connections 2024-04-02T07:28:54.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.635+0000 7f4fab600640 1 --2- 172.21.15.55:0/3798525691 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4f80066690 0x7f4f80068b50 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.635+0000 7f4fab600640 1 --2- 172.21.15.55:0/3798525691 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4fa415cbe0 0x7f4fa4145ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.639+0000 7f4fab600640 1 --2- 172.21.15.55:0/3798525691 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4fa4070a80 0x7f4fa415e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.639+0000 7f4fab600640 1 --2- 172.21.15.55:0/3798525691 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4fa4065d20 0x7f4fa415fce0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.639+0000 7f4fab600640 1 -- 172.21.15.55:0/3798525691 >> 172.21.15.55:0/3798525691 conn(0x7f4fa40ced50 msgr2=0x7f4fa406da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:54.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.639+0000 7f4fab600640 1 -- 172.21.15.55:0/3798525691 shutdown_connections 2024-04-02T07:28:54.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.639+0000 7f4fab600640 1 -- 172.21.15.55:0/3798525691 wait complete. 2024-04-02T07:28:54.660 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-02T07:28:54.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.803+0000 7f8de7e00640 1 Processor -- start 2024-04-02T07:28:54.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.803+0000 7f8de7e00640 1 -- start start 2024-04-02T07:28:54.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.803+0000 7f8de7e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8de815c8f0 0x7f8de80cd200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:54.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.803+0000 7f8de7e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8de80b2300 0x7f8de80b2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:54.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.803+0000 7f8de7e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8de815ccd0 con 0x7f8de80d23d0 2024-04-02T07:28:54.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.803+0000 7f8de7e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de80b2e10 con 0x7f8de80b2300 2024-04-02T07:28:54.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.803+0000 7f8de7e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de80b30f0 con 0x7f8de815c8f0 2024-04-02T07:28:54.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.803+0000 7f8de6a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8de815c8f0 0x7f8de80cd200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:54.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.803+0000 7f8ddfe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8de80b2300 0x7f8de80b2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:54.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.803+0000 7f8de6a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8de815c8f0 0x7f8de80cd200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:38842/0 (socket says 172.21.15.55:38842) 2024-04-02T07:28:54.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.803+0000 7f8de6a00640 1 -- 172.21.15.55:0/3947884741 learned_addr learned my addr 172.21.15.55:0/3947884741 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:54.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.803+0000 7f8de6a00640 1 -- 172.21.15.55:0/3947884741 >> v2:172.21.15.106:3300/0 conn(0x7f8de80b2300 msgr2=0x7f8de80b2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:54.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.803+0000 7f8de6a00640 1 --2- 172.21.15.55:0/3947884741 >> v2:172.21.15.106:3300/0 conn(0x7f8de80b2300 0x7f8de80b2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.803+0000 7f8de6a00640 1 -- 172.21.15.55:0/3947884741 >> v1:172.21.15.106:6789/0 conn(0x7f8de80d23d0 legacy=0x7f8de80d2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:54.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.803+0000 7f8de6a00640 1 -- 172.21.15.55:0/3947884741 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de80b33d0 con 0x7f8de815c8f0 2024-04-02T07:28:54.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.807+0000 7f8de6a00640 1 --2- 172.21.15.55:0/3947884741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8de815c8f0 0x7f8de80cd200 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009870 tx=0x7f8dd801c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d3e1f371df08752 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:54.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.807+0000 7f8de6000640 1 -- 172.21.15.55:0/3947884741 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd80a95f0 con 0x7f8de815c8f0 2024-04-02T07:28:54.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.807+0000 7f8de6000640 1 -- 172.21.15.55:0/3947884741 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd80a9750 con 0x7f8de815c8f0 2024-04-02T07:28:54.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.807+0000 7f8de6000640 1 -- 172.21.15.55:0/3947884741 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd80a9ae0 con 0x7f8de815c8f0 2024-04-02T07:28:54.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.807+0000 7f8de7e00640 1 -- 172.21.15.55:0/3947884741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8de815c8f0 msgr2=0x7f8de80cd200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:54.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.807+0000 7f8de7e00640 1 --2- 172.21.15.55:0/3947884741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8de815c8f0 0x7f8de80cd200 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8009870 tx=0x7f8dd801c530 comp rx=0 tx=0).stop 2024-04-02T07:28:54.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.807+0000 7f8de7e00640 1 -- 172.21.15.55:0/3947884741 shutdown_connections 2024-04-02T07:28:54.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.807+0000 7f8de7e00640 1 --2- 172.21.15.55:0/3947884741 >> v2:172.21.15.106:3300/0 conn(0x7f8de80b2300 0x7f8de80b2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.807+0000 7f8de7e00640 1 --2- 172.21.15.55:0/3947884741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8de815c8f0 0x7f8de80cd200 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.807+0000 7f8de7e00640 1 -- 172.21.15.55:0/3947884741 >> 172.21.15.55:0/3947884741 conn(0x7f8de809b9f0 msgr2=0x7f8de8089fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:54.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.807+0000 7f8de7e00640 1 -- 172.21.15.55:0/3947884741 shutdown_connections 2024-04-02T07:28:54.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.807+0000 7f8de7e00640 1 -- 172.21.15.55:0/3947884741 wait complete. 2024-04-02T07:28:54.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.807+0000 7f8de7e00640 1 Processor -- start 2024-04-02T07:28:54.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.807+0000 7f8de7e00640 1 -- start start 2024-04-02T07:28:54.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8de7e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8de80b2300 0x7f8de81f7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:54.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8de7e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8de80d23d0 0x7f8de81f4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8de7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8de815c8f0 0x7f8de80b7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8de7e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de806b8d0 con 0x7f8de815c8f0 2024-04-02T07:28:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8de7e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de81f8030 con 0x7f8de80b2300 2024-04-02T07:28:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8de7e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de806af70 con 0x7f8de80d23d0 2024-04-02T07:28:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8de7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8de815c8f0 0x7f8de80b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8de7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8de815c8f0 0x7f8de80b7490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55338/0 (socket says 172.21.15.55:55338) 2024-04-02T07:28:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8de7400640 1 -- 172.21.15.55:0/2579019764 learned_addr learned my addr 172.21.15.55:0/2579019764 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8de6a00640 1 --2- 172.21.15.55:0/2579019764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8de80b2300 0x7f8de81f7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8ddfe00640 1 --2- 172.21.15.55:0/2579019764 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8de80d23d0 0x7f8de81f4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8de7400640 1 -- 172.21.15.55:0/2579019764 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8de80d23d0 msgr2=0x7f8de81f4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8de7400640 1 --2- 172.21.15.55:0/2579019764 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8de80d23d0 0x7f8de81f4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8de7400640 1 -- 172.21.15.55:0/2579019764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8de80b2300 msgr2=0x7f8de81f7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8de7400640 1 --2- 172.21.15.55:0/2579019764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8de80b2300 0x7f8de81f7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8de7400640 1 -- 172.21.15.55:0/2579019764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd80094d0 con 0x7f8de815c8f0 2024-04-02T07:28:54.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8de6a00640 1 --2- 172.21.15.55:0/2579019764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8de80b2300 0x7f8de81f7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:54.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8de7400640 1 --2- 172.21.15.55:0/2579019764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8de815c8f0 0x7f8de80b7490 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f8de000c730 tx=0x7f8de000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:54.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8ddea00640 1 -- 172.21.15.55:0/2579019764 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0003b80 con 0x7f8de815c8f0 2024-04-02T07:28:54.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8ddea00640 1 -- 172.21.15.55:0/2579019764 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8de0003ce0 con 0x7f8de815c8f0 2024-04-02T07:28:54.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8de7e00640 1 -- 172.21.15.55:0/2579019764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de815eeb0 con 0x7f8de815c8f0 2024-04-02T07:28:54.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8ddea00640 1 -- 172.21.15.55:0/2579019764 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8de0005310 con 0x7f8de815c8f0 2024-04-02T07:28:54.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8de7e00640 1 -- 172.21.15.55:0/2579019764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de806b4f0 con 0x7f8de815c8f0 2024-04-02T07:28:54.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.811+0000 7f8de7e00640 1 -- 172.21.15.55:0/2579019764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de806ba10 con 0x7f8de815c8f0 2024-04-02T07:28:54.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.815+0000 7f8ddea00640 1 -- 172.21.15.55:0/2579019764 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8de0005680 con 0x7f8de815c8f0 2024-04-02T07:28:54.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.815+0000 7f8ddea00640 1 --2- 172.21.15.55:0/2579019764 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8dc4066690 0x7f8dc4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:54.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.815+0000 7f8ddea00640 1 -- 172.21.15.55:0/2579019764 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8de00840b0 con 0x7f8de815c8f0 2024-04-02T07:28:54.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.815+0000 7f8de6a00640 1 --2- 172.21.15.55:0/2579019764 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8dc4066690 0x7f8dc4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:54.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.815+0000 7f8de6a00640 1 --2- 172.21.15.55:0/2579019764 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8dc4066690 0x7f8dc4068b50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80ae000 tx=0x7f8dd80b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:54.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:54.819+0000 7f8ddea00640 1 -- 172.21.15.55:0/2579019764 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f8de806ba10 con 0x7f8de815c8f0 2024-04-02T07:28:55.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:55.015+0000 7f8de7e00640 1 -- 172.21.15.55:0/2579019764 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8de806ba10 con 0x7f8de815c8f0 2024-04-02T07:28:55.452 INFO:tasks.ceph.mds.b.smithi106.stderr:2024-04-02T07:28:55.449+0000 7f8466400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:28:55.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:55.943+0000 7f8ddea00640 1 -- 172.21.15.55:0/2579019764 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v59) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8de806ba10 con 0x7f8de815c8f0 2024-04-02T07:28:55.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:55.947+0000 7f8de7e00640 1 -- 172.21.15.55:0/2579019764 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8dc4066690 msgr2=0x7f8dc4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:55.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:55.947+0000 7f8de7e00640 1 --2- 172.21.15.55:0/2579019764 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8dc4066690 0x7f8dc4068b50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8dd80ae000 tx=0x7f8dd80b3040 comp rx=0 tx=0).stop 2024-04-02T07:28:55.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:55.947+0000 7f8de7e00640 1 -- 172.21.15.55:0/2579019764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8de815c8f0 msgr2=0x7f8de80b7490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:55.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:55.947+0000 7f8de7e00640 1 --2- 172.21.15.55:0/2579019764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8de815c8f0 0x7f8de80b7490 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f8de000c730 tx=0x7f8de000cbf0 comp rx=0 tx=0).stop 2024-04-02T07:28:55.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:55.947+0000 7f8de7e00640 1 -- 172.21.15.55:0/2579019764 shutdown_connections 2024-04-02T07:28:55.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:55.947+0000 7f8de7e00640 1 --2- 172.21.15.55:0/2579019764 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8de815c8f0 0x7f8de80b7490 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:55.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:55.947+0000 7f8de7e00640 1 --2- 172.21.15.55:0/2579019764 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8de80d23d0 0x7f8de81f4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:55.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:55.947+0000 7f8de7e00640 1 --2- 172.21.15.55:0/2579019764 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8dc4066690 0x7f8dc4068b50 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:55.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:55.947+0000 7f8de7e00640 1 --2- 172.21.15.55:0/2579019764 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8de80b2300 0x7f8de81f7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:55.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:55.947+0000 7f8de7e00640 1 -- 172.21.15.55:0/2579019764 >> 172.21.15.55:0/2579019764 conn(0x7f8de809b9f0 msgr2=0x7f8de80b1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:55.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:55.947+0000 7f8de7e00640 1 -- 172.21.15.55:0/2579019764 shutdown_connections 2024-04-02T07:28:55.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:55.947+0000 7f8de7e00640 1 -- 172.21.15.55:0/2579019764 wait complete. 2024-04-02T07:28:55.973 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-02T07:28:55.973 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-02T07:28:56.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.119+0000 7f1344600640 1 Processor -- start 2024-04-02T07:28:56.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.119+0000 7f1344600640 1 -- start start 2024-04-02T07:28:56.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.119+0000 7f1344600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c144260 0x7f133c0702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:56.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.119+0000 7f1344600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f133c0b31a0 0x7f133c0b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:56.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.119+0000 7f1344600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f133c15e3a0 con 0x7f133c0707e0 2024-04-02T07:28:56.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.119+0000 7f1344600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f133c0b35d0 con 0x7f133c0b31a0 2024-04-02T07:28:56.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.119+0000 7f1344600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0b37c0 con 0x7f133c144260 2024-04-02T07:28:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.119+0000 7f1341c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c144260 0x7f133c0702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.119+0000 7f1342600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f133c0b31a0 0x7f133c0b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.119+0000 7f1341c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c144260 0x7f133c0702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:55852/0 (socket says 172.21.15.55:55852) 2024-04-02T07:28:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.119+0000 7f1341c00640 1 -- 172.21.15.55:0/599532106 learned_addr learned my addr 172.21.15.55:0/599532106 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.123+0000 7f1341c00640 1 -- 172.21.15.55:0/599532106 >> v2:172.21.15.106:3300/0 conn(0x7f133c0b31a0 msgr2=0x7f133c0b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.123+0000 7f1341c00640 1 --2- 172.21.15.55:0/599532106 >> v2:172.21.15.106:3300/0 conn(0x7f133c0b31a0 0x7f133c0b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.123+0000 7f1341c00640 1 -- 172.21.15.55:0/599532106 >> v1:172.21.15.106:6789/0 conn(0x7f133c0707e0 legacy=0x7f133c0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:56.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.123+0000 7f1341c00640 1 -- 172.21.15.55:0/599532106 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c070c60 con 0x7f133c144260 2024-04-02T07:28:56.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.123+0000 7f1341c00640 1 --2- 172.21.15.55:0/599532106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c144260 0x7f133c0702a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1330009870 tx=0x7f133001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13309a526b0528af server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:56.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.123+0000 7f133be00640 1 -- 172.21.15.55:0/599532106 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13300ab650 con 0x7f133c144260 2024-04-02T07:28:56.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.123+0000 7f133be00640 1 -- 172.21.15.55:0/599532106 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13300ab7b0 con 0x7f133c144260 2024-04-02T07:28:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.123+0000 7f133be00640 1 -- 172.21.15.55:0/599532106 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13300abb40 con 0x7f133c144260 2024-04-02T07:28:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1344600640 1 -- 172.21.15.55:0/599532106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c144260 msgr2=0x7f133c0702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1344600640 1 --2- 172.21.15.55:0/599532106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c144260 0x7f133c0702a0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f1330009870 tx=0x7f133001c560 comp rx=0 tx=0).stop 2024-04-02T07:28:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1344600640 1 -- 172.21.15.55:0/599532106 shutdown_connections 2024-04-02T07:28:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1344600640 1 --2- 172.21.15.55:0/599532106 >> v2:172.21.15.106:3300/0 conn(0x7f133c0b31a0 0x7f133c0b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1344600640 1 --2- 172.21.15.55:0/599532106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c144260 0x7f133c0702a0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1344600640 1 -- 172.21.15.55:0/599532106 >> 172.21.15.55:0/599532106 conn(0x7f133c06a390 msgr2=0x7f133c0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1344600640 1 -- 172.21.15.55:0/599532106 shutdown_connections 2024-04-02T07:28:56.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1344600640 1 -- 172.21.15.55:0/599532106 wait complete. 2024-04-02T07:28:56.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1344600640 1 Processor -- start 2024-04-02T07:28:56.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1344600640 1 -- start start 2024-04-02T07:28:56.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1344600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f133c0707e0 0x7f133c1555a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:56.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1344600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c0b31a0 0x7f133c138860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:56.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1344600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f133c144260 0x7f133c138da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:56.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1344600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c154340 con 0x7f133c0707e0 2024-04-02T07:28:56.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1344600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c154520 con 0x7f133c144260 2024-04-02T07:28:56.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1344600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c154800 con 0x7f133c0b31a0 2024-04-02T07:28:56.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1341c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f133c0707e0 0x7f133c1555a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:56.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1341c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f133c0707e0 0x7f133c1555a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51318/0 (socket says 172.21.15.55:51318) 2024-04-02T07:28:56.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1341c00640 1 -- 172.21.15.55:0/1833050916 learned_addr learned my addr 172.21.15.55:0/1833050916 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:56.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1342600640 1 --2- 172.21.15.55:0/1833050916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f133c144260 0x7f133c138da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:56.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1341200640 1 --2- 172.21.15.55:0/1833050916 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c0b31a0 0x7f133c138860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:56.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1341c00640 1 -- 172.21.15.55:0/1833050916 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c0b31a0 msgr2=0x7f133c138860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:56.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1341c00640 1 --2- 172.21.15.55:0/1833050916 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c0b31a0 0x7f133c138860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:56.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1341c00640 1 -- 172.21.15.55:0/1833050916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f133c144260 msgr2=0x7f133c138da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:56.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1341c00640 1 --2- 172.21.15.55:0/1833050916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f133c144260 0x7f133c138da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:56.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1341c00640 1 -- 172.21.15.55:0/1833050916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13300094d0 con 0x7f133c0707e0 2024-04-02T07:28:56.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.127+0000 7f1341200640 1 --2- 172.21.15.55:0/1833050916 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c0b31a0 0x7f133c138860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:56.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.131+0000 7f1341c00640 1 --2- 172.21.15.55:0/1833050916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f133c0707e0 0x7f133c1555a0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f13300ad040 tx=0x7f133001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:56.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.131+0000 7f1339600640 1 -- 172.21.15.55:0/1833050916 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13300b4800 con 0x7f133c0707e0 2024-04-02T07:28:56.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.131+0000 7f1339600640 1 -- 172.21.15.55:0/1833050916 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13300b4980 con 0x7f133c0707e0 2024-04-02T07:28:56.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.131+0000 7f1339600640 1 -- 172.21.15.55:0/1833050916 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13300b4d30 con 0x7f133c0707e0 2024-04-02T07:28:56.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.131+0000 7f1344600640 1 -- 172.21.15.55:0/1833050916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c154ae0 con 0x7f133c0707e0 2024-04-02T07:28:56.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.131+0000 7f1344600640 1 -- 172.21.15.55:0/1833050916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c1550a0 con 0x7f133c0707e0 2024-04-02T07:28:56.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.131+0000 7f1344600640 1 -- 172.21.15.55:0/1833050916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c073530 con 0x7f133c0707e0 2024-04-02T07:28:56.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.131+0000 7f1339600640 1 -- 172.21.15.55:0/1833050916 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f13300b3380 con 0x7f133c0707e0 2024-04-02T07:28:56.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.131+0000 7f1339600640 1 --2- 172.21.15.55:0/1833050916 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f131c066690 0x7f131c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:56.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.131+0000 7f1339600640 1 -- 172.21.15.55:0/1833050916 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f133011e840 con 0x7f133c0707e0 2024-04-02T07:28:56.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.131+0000 7f1341200640 1 --2- 172.21.15.55:0/1833050916 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f131c066690 0x7f131c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:56.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.135+0000 7f1341200640 1 --2- 172.21.15.55:0/1833050916 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f131c066690 0x7f131c068b50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f133c15a710 tx=0x7f1328009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:56.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.135+0000 7f1339600640 1 -- 172.21.15.55:0/1833050916 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f13300ebbc0 con 0x7f133c0707e0 2024-04-02T07:28:56.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.331+0000 7f1344600640 1 -- 172.21.15.55:0/1833050916 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f133c154940 con 0x7f133c0707e0 2024-04-02T07:28:56.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.959+0000 7f1339600640 1 -- 172.21.15.55:0/1833050916 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v60) v1 ==== 122+0+0 (secure 0 0 0) 0x7f133c154940 con 0x7f133c0707e0 2024-04-02T07:28:56.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.959+0000 7f1344600640 1 -- 172.21.15.55:0/1833050916 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f131c066690 msgr2=0x7f131c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:56.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.959+0000 7f1344600640 1 --2- 172.21.15.55:0/1833050916 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f131c066690 0x7f131c068b50 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f133c15a710 tx=0x7f1328009040 comp rx=0 tx=0).stop 2024-04-02T07:28:56.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.959+0000 7f1344600640 1 -- 172.21.15.55:0/1833050916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f133c0707e0 msgr2=0x7f133c1555a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:56.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.959+0000 7f1344600640 1 --2- 172.21.15.55:0/1833050916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f133c0707e0 0x7f133c1555a0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f13300ad040 tx=0x7f133001ada0 comp rx=0 tx=0).stop 2024-04-02T07:28:56.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.959+0000 7f1344600640 1 -- 172.21.15.55:0/1833050916 shutdown_connections 2024-04-02T07:28:56.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.959+0000 7f1344600640 1 --2- 172.21.15.55:0/1833050916 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f131c066690 0x7f131c068b50 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:56.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.959+0000 7f1344600640 1 --2- 172.21.15.55:0/1833050916 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f133c144260 0x7f133c138da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:56.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.959+0000 7f1344600640 1 --2- 172.21.15.55:0/1833050916 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f133c0b31a0 0x7f133c138860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:56.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.959+0000 7f1344600640 1 --2- 172.21.15.55:0/1833050916 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f133c0707e0 0x7f133c1555a0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:56.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.959+0000 7f1344600640 1 -- 172.21.15.55:0/1833050916 >> 172.21.15.55:0/1833050916 conn(0x7f133c06a390 msgr2=0x7f133c0b1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:56.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.959+0000 7f1344600640 1 -- 172.21.15.55:0/1833050916 shutdown_connections 2024-04-02T07:28:56.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:56.959+0000 7f1344600640 1 -- 172.21.15.55:0/1833050916 wait complete. 2024-04-02T07:28:56.983 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-02T07:28:56.983 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:28:57.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.127+0000 7f530d000640 1 Processor -- start 2024-04-02T07:28:57.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.127+0000 7f530d000640 1 -- start start 2024-04-02T07:28:57.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.127+0000 7f530d000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f530815ee70 0x7f5308099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:57.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.127+0000 7f530d000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f530815f250 0x7f53080b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:57.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.127+0000 7f530d000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53080ad270 con 0x7f5308098a10 2024-04-02T07:28:57.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.127+0000 7f530d000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53080b0840 con 0x7f530815f250 2024-04-02T07:28:57.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.127+0000 7f530d000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53080cf6a0 con 0x7f530815ee70 2024-04-02T07:28:57.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.127+0000 7f5305400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f530815f250 0x7f53080b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:57.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.127+0000 7f5305400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f530815f250 0x7f53080b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51330/0 (socket says 172.21.15.55:51330) 2024-04-02T07:28:57.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.127+0000 7f5305400640 1 -- 172.21.15.55:0/3583374523 learned_addr learned my addr 172.21.15.55:0/3583374523 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:57.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.127+0000 7f5305e00640 1 --2- 172.21.15.55:0/3583374523 >> v2:172.21.15.106:3300/0 conn(0x7f530815ee70 0x7f5308099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:57.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.127+0000 7f5305400640 1 -- 172.21.15.55:0/3583374523 >> v2:172.21.15.106:3300/0 conn(0x7f530815ee70 msgr2=0x7f5308099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:57.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.127+0000 7f5305400640 1 --2- 172.21.15.55:0/3583374523 >> v2:172.21.15.106:3300/0 conn(0x7f530815ee70 0x7f5308099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.127+0000 7f5305400640 1 -- 172.21.15.55:0/3583374523 >> v1:172.21.15.55:6789/0 conn(0x7f5308098a10 legacy=0x7f5308098e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:57.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.127+0000 7f5305400640 1 -- 172.21.15.55:0/3583374523 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53080b0a50 con 0x7f530815f250 2024-04-02T07:28:57.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.127+0000 7f5305e00640 1 --2- 172.21.15.55:0/3583374523 >> v2:172.21.15.106:3300/0 conn(0x7f530815ee70 0x7f5308099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:28:57.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.131+0000 7f5305400640 1 --2- 172.21.15.55:0/3583374523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530815f250 0x7f53080b12f0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f53080719c0 tx=0x7f52f401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a61663e2f798c02c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:57.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.131+0000 7f5304a00640 1 -- 172.21.15.55:0/3583374523 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f40aa680 con 0x7f530815f250 2024-04-02T07:28:57.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.131+0000 7f5304a00640 1 -- 172.21.15.55:0/3583374523 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f40aa7e0 con 0x7f530815f250 2024-04-02T07:28:57.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.131+0000 7f5304a00640 1 -- 172.21.15.55:0/3583374523 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f40aab70 con 0x7f530815f250 2024-04-02T07:28:57.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.131+0000 7f530d000640 1 -- 172.21.15.55:0/3583374523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530815f250 msgr2=0x7f53080b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:57.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.131+0000 7f530d000640 1 --2- 172.21.15.55:0/3583374523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530815f250 0x7f53080b12f0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f53080719c0 tx=0x7f52f401c520 comp rx=0 tx=0).stop 2024-04-02T07:28:57.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.131+0000 7f530d000640 1 -- 172.21.15.55:0/3583374523 shutdown_connections 2024-04-02T07:28:57.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.131+0000 7f530d000640 1 --2- 172.21.15.55:0/3583374523 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530815f250 0x7f53080b12f0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.131+0000 7f530d000640 1 --2- 172.21.15.55:0/3583374523 >> v2:172.21.15.106:3300/0 conn(0x7f530815ee70 0x7f5308099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.131+0000 7f530d000640 1 -- 172.21.15.55:0/3583374523 >> 172.21.15.55:0/3583374523 conn(0x7f53080b21d0 msgr2=0x7f53080b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:57.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.131+0000 7f530d000640 1 -- 172.21.15.55:0/3583374523 shutdown_connections 2024-04-02T07:28:57.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.131+0000 7f530d000640 1 -- 172.21.15.55:0/3583374523 wait complete. 2024-04-02T07:28:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.131+0000 7f530d000640 1 Processor -- start 2024-04-02T07:28:57.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.131+0000 7f530d000640 1 -- start start 2024-04-02T07:28:57.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f530d000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5308098a10 0x7f53080c6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f530d000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f530815ee70 0x7f530815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f530d000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530815f250 0x7f530815d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f530d000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53080c7530 con 0x7f530815f250 2024-04-02T07:28:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f530d000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53080b4110 con 0x7f530815ee70 2024-04-02T07:28:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f530d000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53080b3500 con 0x7f5308098a10 2024-04-02T07:28:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f5306800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530815f250 0x7f530815d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f5306800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530815f250 0x7f530815d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51338/0 (socket says 172.21.15.55:51338) 2024-04-02T07:28:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f5306800640 1 -- 172.21.15.55:0/3619003782 learned_addr learned my addr 172.21.15.55:0/3619003782 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f5305400640 1 --2- 172.21.15.55:0/3619003782 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f530815ee70 0x7f530815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:57.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f5305e00640 1 --2- 172.21.15.55:0/3619003782 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5308098a10 0x7f53080c6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:57.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f5306800640 1 -- 172.21.15.55:0/3619003782 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5308098a10 msgr2=0x7f53080c6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:57.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f5306800640 1 --2- 172.21.15.55:0/3619003782 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5308098a10 0x7f53080c6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f5306800640 1 -- 172.21.15.55:0/3619003782 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f530815ee70 msgr2=0x7f530815cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:57.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f5306800640 1 --2- 172.21.15.55:0/3619003782 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f530815ee70 0x7f530815cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f5306800640 1 -- 172.21.15.55:0/3619003782 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f40094d0 con 0x7f530815f250 2024-04-02T07:28:57.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f5306800640 1 --2- 172.21.15.55:0/3619003782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530815f250 0x7f530815d0c0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f530000c770 tx=0x7f530000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:57.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f52fe000640 1 -- 172.21.15.55:0/3619003782 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5300003b80 con 0x7f530815f250 2024-04-02T07:28:57.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f52fe000640 1 -- 172.21.15.55:0/3619003782 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5300003ce0 con 0x7f530815f250 2024-04-02T07:28:57.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f52fe000640 1 -- 172.21.15.55:0/3619003782 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f530000aa90 con 0x7f530815f250 2024-04-02T07:28:57.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f530d000640 1 -- 172.21.15.55:0/3619003782 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53080b37e0 con 0x7f530815f250 2024-04-02T07:28:57.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f530d000640 1 -- 172.21.15.55:0/3619003782 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53080b3da0 con 0x7f530815f250 2024-04-02T07:28:57.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.135+0000 7f530d000640 1 -- 172.21.15.55:0/3619003782 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53080b4280 con 0x7f530815f250 2024-04-02T07:28:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.139+0000 7f52fe000640 1 -- 172.21.15.55:0/3619003782 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f530000abf0 con 0x7f530815f250 2024-04-02T07:28:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.139+0000 7f52fe000640 1 --2- 172.21.15.55:0/3619003782 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f52e8066690 0x7f52e8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.139+0000 7f52fe000640 1 -- 172.21.15.55:0/3619003782 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5300083f20 con 0x7f530815f250 2024-04-02T07:28:57.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.139+0000 7f5305e00640 1 --2- 172.21.15.55:0/3619003782 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f52e8066690 0x7f52e8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:57.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.139+0000 7f5305e00640 1 --2- 172.21.15.55:0/3619003782 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f52e8066690 0x7f52e8068b50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f52f800ab60 tx=0x7f52f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:57.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.143+0000 7f52fe000640 1 -- 172.21.15.55:0/3619003782 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f53000512a0 con 0x7f530815f250 2024-04-02T07:28:57.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.339+0000 7f530d000640 1 -- 172.21.15.55:0/3619003782 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5308066c90 con 0x7f530815f250 2024-04-02T07:28:57.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.339+0000 7f52fe000640 1 -- 172.21.15.55:0/3619003782 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4739 (secure 0 0 0) 0x7f53000548c0 con 0x7f530815f250 2024-04-02T07:28:57.340 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:57.340 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2209852195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2209852195},{"type":"v1","addr":"172.21.15.55:6835","nonce":2209852195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1897181831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1897181831},{"type":"v1","addr":"172.21.15.106:6835","nonce":1897181831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":7455,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/821922065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":821922065},{"type":"v1","addr":"172.21.15.55:6834","nonce":821922065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:28:53.919977+0000","modified":"2024-04-02T07:28:56.946080+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7464":{"gid":7464,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6837/2582023800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":2582023800},{"type":"v1","addr":"172.21.15.106:6837","nonce":2582023800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-02T07:28:57.340 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 60 2024-04-02T07:28:57.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.339+0000 7f530d000640 1 -- 172.21.15.55:0/3619003782 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f52e8066690 msgr2=0x7f52e8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:57.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.339+0000 7f530d000640 1 --2- 172.21.15.55:0/3619003782 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f52e8066690 0x7f52e8068b50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f52f800ab60 tx=0x7f52f8008040 comp rx=0 tx=0).stop 2024-04-02T07:28:57.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.339+0000 7f530d000640 1 -- 172.21.15.55:0/3619003782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530815f250 msgr2=0x7f530815d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:57.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.339+0000 7f530d000640 1 --2- 172.21.15.55:0/3619003782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530815f250 0x7f530815d0c0 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f530000c770 tx=0x7f530000cc30 comp rx=0 tx=0).stop 2024-04-02T07:28:57.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.339+0000 7f530d000640 1 -- 172.21.15.55:0/3619003782 shutdown_connections 2024-04-02T07:28:57.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.339+0000 7f530d000640 1 --2- 172.21.15.55:0/3619003782 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530815f250 0x7f530815d0c0 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.339+0000 7f530d000640 1 --2- 172.21.15.55:0/3619003782 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f52e8066690 0x7f52e8068b50 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.339+0000 7f530d000640 1 --2- 172.21.15.55:0/3619003782 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f530815ee70 0x7f530815cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.339+0000 7f530d000640 1 --2- 172.21.15.55:0/3619003782 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5308098a10 0x7f53080c6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.339+0000 7f530d000640 1 -- 172.21.15.55:0/3619003782 >> 172.21.15.55:0/3619003782 conn(0x7f53080b21d0 msgr2=0x7f5308072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:57.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.339+0000 7f530d000640 1 -- 172.21.15.55:0/3619003782 shutdown_connections 2024-04-02T07:28:57.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.339+0000 7f530d000640 1 -- 172.21.15.55:0/3619003782 wait complete. 2024-04-02T07:28:57.361 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:28:57.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.499+0000 7fb366a00640 1 Processor -- start 2024-04-02T07:28:57.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.499+0000 7fb366a00640 1 -- start start 2024-04-02T07:28:57.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.503+0000 7fb366a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb3600b1430 0x7fb3600afe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:57.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.503+0000 7fb366a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb360099750 0x7fb3600cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:57.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.503+0000 7fb366a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3600ce2f0 con 0x7fb360098a10 2024-04-02T07:28:57.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.503+0000 7fb366a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3600cbe10 con 0x7fb360099750 2024-04-02T07:28:57.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.503+0000 7fb366a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3600ce5d0 con 0x7fb3600b1430 2024-04-02T07:28:57.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.503+0000 7fb364a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb360099750 0x7fb3600cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:57.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.503+0000 7fb35fe00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb360098a10 0x7fb360098df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37184/0 (socket says 172.21.15.55:37184) 2024-04-02T07:28:57.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.503+0000 7fb35fe00640 1 -- 172.21.15.55:0/4227849688 learned_addr learned my addr 172.21.15.55:0/4227849688 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:57.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.503+0000 7fb357400640 1 --2- 172.21.15.55:0/4227849688 >> v2:172.21.15.106:3300/0 conn(0x7fb3600b1430 0x7fb3600afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:57.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.503+0000 7fb364a00640 1 -- 172.21.15.55:0/4227849688 >> v2:172.21.15.106:3300/0 conn(0x7fb3600b1430 msgr2=0x7fb3600afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:57.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.503+0000 7fb364a00640 1 --2- 172.21.15.55:0/4227849688 >> v2:172.21.15.106:3300/0 conn(0x7fb3600b1430 0x7fb3600afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.503+0000 7fb364a00640 1 -- 172.21.15.55:0/4227849688 >> v1:172.21.15.55:6789/0 conn(0x7fb360098a10 legacy=0x7fb360098df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:57.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.503+0000 7fb364a00640 1 -- 172.21.15.55:0/4227849688 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb360099be0 con 0x7fb360099750 2024-04-02T07:28:57.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.503+0000 7fb35f400640 1 -- 172.21.15.55:0/4227849688 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1790107233 0 0) 0x7fb3600ce2f0 con 0x7fb360098a10 2024-04-02T07:28:57.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.503+0000 7fb357400640 1 --2- 172.21.15.55:0/4227849688 >> v2:172.21.15.106:3300/0 conn(0x7fb3600b1430 0x7fb3600afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:57.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.507+0000 7fb364a00640 1 --2- 172.21.15.55:0/4227849688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb360099750 0x7fb3600cea60 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fb360073650 tx=0x7fb35801c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d794b5c36a0302a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:57.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.507+0000 7fb35f400640 1 -- 172.21.15.55:0/4227849688 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3580a5960 con 0x7fb360099750 2024-04-02T07:28:57.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.507+0000 7fb35f400640 1 -- 172.21.15.55:0/4227849688 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3580a5ac0 con 0x7fb360099750 2024-04-02T07:28:57.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.507+0000 7fb35f400640 1 -- 172.21.15.55:0/4227849688 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3580a5e50 con 0x7fb360099750 2024-04-02T07:28:57.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.507+0000 7fb366a00640 1 -- 172.21.15.55:0/4227849688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb360099750 msgr2=0x7fb3600cea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:57.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.507+0000 7fb366a00640 1 --2- 172.21.15.55:0/4227849688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb360099750 0x7fb3600cea60 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fb360073650 tx=0x7fb35801c8a0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.507+0000 7fb366a00640 1 -- 172.21.15.55:0/4227849688 shutdown_connections 2024-04-02T07:28:57.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.507+0000 7fb366a00640 1 --2- 172.21.15.55:0/4227849688 >> v2:172.21.15.106:3300/0 conn(0x7fb3600b1430 0x7fb3600afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.507+0000 7fb366a00640 1 --2- 172.21.15.55:0/4227849688 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb360099750 0x7fb3600cea60 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.507+0000 7fb366a00640 1 -- 172.21.15.55:0/4227849688 >> 172.21.15.55:0/4227849688 conn(0x7fb3600b2210 msgr2=0x7fb3600b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:57.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.507+0000 7fb366a00640 1 -- 172.21.15.55:0/4227849688 shutdown_connections 2024-04-02T07:28:57.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.507+0000 7fb366a00640 1 -- 172.21.15.55:0/4227849688 wait complete. 2024-04-02T07:28:57.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.507+0000 7fb366a00640 1 Processor -- start 2024-04-02T07:28:57.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.507+0000 7fb366a00640 1 -- start start 2024-04-02T07:28:57.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.507+0000 7fb366a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb360098a10 0x7fb36015a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:57.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb366a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb360099750 0x7fb36014d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:57.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb366a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3600b1430 0x7fb36014d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:57.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb366a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3600b39e0 con 0x7fb3600b1430 2024-04-02T07:28:57.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb366a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb36006bbd0 con 0x7fb360098a10 2024-04-02T07:28:57.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb366a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb36006beb0 con 0x7fb360099750 2024-04-02T07:28:57.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb364a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3600b1430 0x7fb36014d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:57.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb364a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3600b1430 0x7fb36014d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51350/0 (socket says 172.21.15.55:51350) 2024-04-02T07:28:57.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb364a00640 1 -- 172.21.15.55:0/1392789450 learned_addr learned my addr 172.21.15.55:0/1392789450 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:57.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb35fe00640 1 --2- 172.21.15.55:0/1392789450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb360098a10 0x7fb36015a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:57.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb357400640 1 --2- 172.21.15.55:0/1392789450 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb360099750 0x7fb36014d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:57.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb364a00640 1 -- 172.21.15.55:0/1392789450 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb360099750 msgr2=0x7fb36014d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:57.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb364a00640 1 --2- 172.21.15.55:0/1392789450 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb360099750 0x7fb36014d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb364a00640 1 -- 172.21.15.55:0/1392789450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb360098a10 msgr2=0x7fb36015a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:57.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb364a00640 1 --2- 172.21.15.55:0/1392789450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb360098a10 0x7fb36015a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb364a00640 1 -- 172.21.15.55:0/1392789450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb358009a70 con 0x7fb3600b1430 2024-04-02T07:28:57.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb35fe00640 1 --2- 172.21.15.55:0/1392789450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb360098a10 0x7fb36015a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:28:57.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb364a00640 1 --2- 172.21.15.55:0/1392789450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3600b1430 0x7fb36014d7e0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fb35801cd80 tx=0x7fb358019640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:57.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb35cc00640 1 -- 172.21.15.55:0/1392789450 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3580ade70 con 0x7fb3600b1430 2024-04-02T07:28:57.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb35cc00640 1 -- 172.21.15.55:0/1392789450 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb358009450 con 0x7fb3600b1430 2024-04-02T07:28:57.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb35cc00640 1 -- 172.21.15.55:0/1392789450 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3580b8640 con 0x7fb3600b1430 2024-04-02T07:28:57.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb366a00640 1 -- 172.21.15.55:0/1392789450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb36006c190 con 0x7fb3600b1430 2024-04-02T07:28:57.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb366a00640 1 -- 172.21.15.55:0/1392789450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb36015a740 con 0x7fb3600b1430 2024-04-02T07:28:57.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb366a00640 1 -- 172.21.15.55:0/1392789450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb36015a930 con 0x7fb3600b1430 2024-04-02T07:28:57.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.511+0000 7fb35cc00640 1 -- 172.21.15.55:0/1392789450 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb3580b87a0 con 0x7fb3600b1430 2024-04-02T07:28:57.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.515+0000 7fb35cc00640 1 --2- 172.21.15.55:0/1392789450 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb33c066690 0x7fb33c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:57.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.515+0000 7fb35cc00640 1 -- 172.21.15.55:0/1392789450 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb35811f8c0 con 0x7fb3600b1430 2024-04-02T07:28:57.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.515+0000 7fb35fe00640 1 --2- 172.21.15.55:0/1392789450 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb33c066690 0x7fb33c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:57.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.515+0000 7fb35fe00640 1 --2- 172.21.15.55:0/1392789450 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb33c066690 0x7fb33c068b50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb350007fd0 tx=0x7fb350009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:57.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.519+0000 7fb35cc00640 1 -- 172.21.15.55:0/1392789450 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fb3580ecc20 con 0x7fb3600b1430 2024-04-02T07:28:57.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.683+0000 7fb366a00640 1 -- 172.21.15.55:0/1392789450 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb360066c90 con 0x7fb3600b1430 2024-04-02T07:28:57.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.683+0000 7fb35cc00640 1 -- 172.21.15.55:0/1392789450 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16092 (secure 0 0 0) 0x7fb35811f090 con 0x7fb3600b1430 2024-04-02T07:28:57.684 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:57.684 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":87,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:28:54.923225+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:28:52.464907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-02T07:28:52.918058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:28:57.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.683+0000 7fb366a00640 1 -- 172.21.15.55:0/1392789450 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb33c066690 msgr2=0x7fb33c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:57.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.683+0000 7fb366a00640 1 --2- 172.21.15.55:0/1392789450 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb33c066690 0x7fb33c068b50 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fb350007fd0 tx=0x7fb350009040 comp rx=0 tx=0).stop 2024-04-02T07:28:57.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.683+0000 7fb366a00640 1 -- 172.21.15.55:0/1392789450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3600b1430 msgr2=0x7fb36014d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:57.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.683+0000 7fb366a00640 1 --2- 172.21.15.55:0/1392789450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3600b1430 0x7fb36014d7e0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fb35801cd80 tx=0x7fb358019640 comp rx=0 tx=0).stop 2024-04-02T07:28:57.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.683+0000 7fb366a00640 1 -- 172.21.15.55:0/1392789450 shutdown_connections 2024-04-02T07:28:57.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.683+0000 7fb366a00640 1 --2- 172.21.15.55:0/1392789450 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3600b1430 0x7fb36014d7e0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.683+0000 7fb366a00640 1 --2- 172.21.15.55:0/1392789450 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb360099750 0x7fb36014d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.683+0000 7fb366a00640 1 --2- 172.21.15.55:0/1392789450 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb33c066690 0x7fb33c068b50 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.683+0000 7fb366a00640 1 --2- 172.21.15.55:0/1392789450 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb360098a10 0x7fb36015a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.683+0000 7fb366a00640 1 -- 172.21.15.55:0/1392789450 >> 172.21.15.55:0/1392789450 conn(0x7fb3600b2210 msgr2=0x7fb3600addf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:57.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.683+0000 7fb366a00640 1 -- 172.21.15.55:0/1392789450 shutdown_connections 2024-04-02T07:28:57.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.683+0000 7fb366a00640 1 -- 172.21.15.55:0/1392789450 wait complete. 2024-04-02T07:28:57.705 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-02T07:28:57.705 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:28:57.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.843+0000 7efdeda00640 1 Processor -- start 2024-04-02T07:28:57.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.843+0000 7efdeda00640 1 -- start start 2024-04-02T07:28:57.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.843+0000 7efdeda00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efde8153ea0 0x7efde80c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:57.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.843+0000 7efdeda00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efde815a070 0x7efde813d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:57.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.843+0000 7efdeda00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde813d0c0 con 0x7efde8159be0 2024-04-02T07:28:57.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.843+0000 7efdeda00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde815a4f0 con 0x7efde8153ea0 2024-04-02T07:28:57.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.843+0000 7efdeda00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde815a7d0 con 0x7efde815a070 2024-04-02T07:28:57.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.847+0000 7efde6a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efde8153ea0 0x7efde80c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:57.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.847+0000 7efde6a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efde8153ea0 0x7efde80c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51366/0 (socket says 172.21.15.55:51366) 2024-04-02T07:28:57.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.847+0000 7efde6a00640 1 -- 172.21.15.55:0/2166991016 learned_addr learned my addr 172.21.15.55:0/2166991016 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:57.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.847+0000 7efde7400640 1 --2- 172.21.15.55:0/2166991016 >> v2:172.21.15.106:3300/0 conn(0x7efde815a070 0x7efde813d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:57.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.847+0000 7efde6a00640 1 -- 172.21.15.55:0/2166991016 >> v2:172.21.15.106:3300/0 conn(0x7efde815a070 msgr2=0x7efde813d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:57.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.847+0000 7efde6a00640 1 --2- 172.21.15.55:0/2166991016 >> v2:172.21.15.106:3300/0 conn(0x7efde815a070 0x7efde813d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.847+0000 7efde6a00640 1 -- 172.21.15.55:0/2166991016 >> v1:172.21.15.106:6789/0 conn(0x7efde8159be0 legacy=0x7efde80b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:57.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.847+0000 7efde6a00640 1 -- 172.21.15.55:0/2166991016 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde815aab0 con 0x7efde8153ea0 2024-04-02T07:28:57.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.847+0000 7efde7400640 1 --2- 172.21.15.55:0/2166991016 >> v2:172.21.15.106:3300/0 conn(0x7efde815a070 0x7efde813d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:28:57.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.847+0000 7efde6a00640 1 --2- 172.21.15.55:0/2166991016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde8153ea0 0x7efde80c4120 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7efde8143320 tx=0x7efdd801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d368f8a3d39734c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:57.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.847+0000 7efde6000640 1 -- 172.21.15.55:0/2166991016 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd80aa660 con 0x7efde8153ea0 2024-04-02T07:28:57.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.847+0000 7efde6000640 1 -- 172.21.15.55:0/2166991016 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd80aa7c0 con 0x7efde8153ea0 2024-04-02T07:28:57.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.847+0000 7efde6000640 1 -- 172.21.15.55:0/2166991016 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd80aab50 con 0x7efde8153ea0 2024-04-02T07:28:57.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdeda00640 1 -- 172.21.15.55:0/2166991016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde8153ea0 msgr2=0x7efde80c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:57.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdeda00640 1 --2- 172.21.15.55:0/2166991016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde8153ea0 0x7efde80c4120 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7efde8143320 tx=0x7efdd801c4e0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdeda00640 1 -- 172.21.15.55:0/2166991016 shutdown_connections 2024-04-02T07:28:57.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdeda00640 1 --2- 172.21.15.55:0/2166991016 >> v2:172.21.15.106:3300/0 conn(0x7efde815a070 0x7efde813d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdeda00640 1 --2- 172.21.15.55:0/2166991016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde8153ea0 0x7efde80c4120 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdeda00640 1 -- 172.21.15.55:0/2166991016 >> 172.21.15.55:0/2166991016 conn(0x7efde8066080 msgr2=0x7efde8069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:57.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdeda00640 1 -- 172.21.15.55:0/2166991016 shutdown_connections 2024-04-02T07:28:57.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdeda00640 1 -- 172.21.15.55:0/2166991016 wait complete. 2024-04-02T07:28:57.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdeda00640 1 Processor -- start 2024-04-02T07:28:57.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdeda00640 1 -- start start 2024-04-02T07:28:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdeda00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efde8153ea0 0x7efde81373d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdeda00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde8159be0 0x7efde8152280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdeda00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efde815a070 0x7efde81358b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdeda00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde8136330 con 0x7efde8159be0 2024-04-02T07:28:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdeda00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde8136610 con 0x7efde815a070 2024-04-02T07:28:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdeda00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde81368f0 con 0x7efde8153ea0 2024-04-02T07:28:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdde000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde8159be0 0x7efde8152280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdde000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde8159be0 0x7efde8152280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51382/0 (socket says 172.21.15.55:51382) 2024-04-02T07:28:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdde000640 1 -- 172.21.15.55:0/2753866848 learned_addr learned my addr 172.21.15.55:0/2753866848 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efde6a00640 1 --2- 172.21.15.55:0/2753866848 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efde8153ea0 0x7efde81373d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efde7400640 1 --2- 172.21.15.55:0/2753866848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efde815a070 0x7efde81358b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:57.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdde000640 1 -- 172.21.15.55:0/2753866848 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efde8153ea0 msgr2=0x7efde81373d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:57.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdde000640 1 --2- 172.21.15.55:0/2753866848 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efde8153ea0 0x7efde81373d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdde000640 1 -- 172.21.15.55:0/2753866848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efde815a070 msgr2=0x7efde81358b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:57.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdde000640 1 --2- 172.21.15.55:0/2753866848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efde815a070 0x7efde81358b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:57.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdde000640 1 -- 172.21.15.55:0/2753866848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd80094d0 con 0x7efde8159be0 2024-04-02T07:28:57.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efde7400640 1 --2- 172.21.15.55:0/2753866848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efde815a070 0x7efde81358b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:57.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efdde000640 1 --2- 172.21.15.55:0/2753866848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde8159be0 0x7efde8152280 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7efdd000c450 tx=0x7efdd000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:57.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efddf400640 1 -- 172.21.15.55:0/2753866848 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0012830 con 0x7efde8159be0 2024-04-02T07:28:57.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efddf400640 1 -- 172.21.15.55:0/2753866848 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd00129b0 con 0x7efde8159be0 2024-04-02T07:28:57.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.851+0000 7efddf400640 1 -- 172.21.15.55:0/2753866848 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd0012d60 con 0x7efde8159be0 2024-04-02T07:28:57.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.855+0000 7efdeda00640 1 -- 172.21.15.55:0/2753866848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde8136bd0 con 0x7efde8159be0 2024-04-02T07:28:57.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.855+0000 7efdeda00640 1 -- 172.21.15.55:0/2753866848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde81533d0 con 0x7efde8159be0 2024-04-02T07:28:57.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.855+0000 7efdeda00640 1 -- 172.21.15.55:0/2753866848 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde8066c90 con 0x7efde8159be0 2024-04-02T07:28:57.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.855+0000 7efddf400640 1 -- 172.21.15.55:0/2753866848 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7efdd001c460 con 0x7efde8159be0 2024-04-02T07:28:57.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.855+0000 7efddf400640 1 --2- 172.21.15.55:0/2753866848 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdc4066690 0x7efdc4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:57.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.855+0000 7efddf400640 1 -- 172.21.15.55:0/2753866848 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efdd0083ee0 con 0x7efde8159be0 2024-04-02T07:28:57.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.855+0000 7efde6a00640 1 --2- 172.21.15.55:0/2753866848 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdc4066690 0x7efdc4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:57.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.859+0000 7efde6a00640 1 --2- 172.21.15.55:0/2753866848 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdc4066690 0x7efdc4068b50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7efdd80ae000 tx=0x7efdd80b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:57.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:57.859+0000 7efddf400640 1 -- 172.21.15.55:0/2753866848 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7efdd0051240 con 0x7efde8159be0 2024-04-02T07:28:58.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.019+0000 7efdeda00640 1 -- 172.21.15.55:0/2753866848 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7efde80c41f0 con 0x7efdc4066690 2024-04-02T07:28:58.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.027+0000 7efddf400640 1 -- 172.21.15.55:0/2753866848 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289086 (secure 0 0 0) 0x7efde80c41f0 con 0x7efdc4066690 2024-04-02T07:28:58.033 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:58.034 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:28:58.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.031+0000 7efdeda00640 1 -- 172.21.15.55:0/2753866848 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdc4066690 msgr2=0x7efdc4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:58.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.031+0000 7efdeda00640 1 --2- 172.21.15.55:0/2753866848 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdc4066690 0x7efdc4068b50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7efdd80ae000 tx=0x7efdd80b5040 comp rx=0 tx=0).stop 2024-04-02T07:28:58.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.031+0000 7efdeda00640 1 -- 172.21.15.55:0/2753866848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde8159be0 msgr2=0x7efde8152280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:58.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.031+0000 7efdeda00640 1 --2- 172.21.15.55:0/2753866848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde8159be0 0x7efde8152280 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7efdd000c450 tx=0x7efdd000c910 comp rx=0 tx=0).stop 2024-04-02T07:28:58.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.031+0000 7efdeda00640 1 -- 172.21.15.55:0/2753866848 shutdown_connections 2024-04-02T07:28:58.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.031+0000 7efdeda00640 1 --2- 172.21.15.55:0/2753866848 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdc4066690 0x7efdc4068b50 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.031+0000 7efdeda00640 1 --2- 172.21.15.55:0/2753866848 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efde815a070 0x7efde81358b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.031+0000 7efdeda00640 1 --2- 172.21.15.55:0/2753866848 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde8159be0 0x7efde8152280 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.031+0000 7efdeda00640 1 --2- 172.21.15.55:0/2753866848 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efde8153ea0 0x7efde81373d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.031+0000 7efdeda00640 1 -- 172.21.15.55:0/2753866848 >> 172.21.15.55:0/2753866848 conn(0x7efde8066080 msgr2=0x7efde80cc230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:58.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.031+0000 7efdeda00640 1 -- 172.21.15.55:0/2753866848 shutdown_connections 2024-04-02T07:28:58.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.031+0000 7efdeda00640 1 -- 172.21.15.55:0/2753866848 wait complete. 2024-04-02T07:28:58.052 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-04-02T07:28:56.431507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258528,"kb_used_data":9552,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754716192,"statfs":{"total":773094113280,"available":772829380608,"internally_reserved":0,"allocated":9781248,"data_stored":4829324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000966"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588844+0000","last_change":"2024-04-02T07:28:53.956384+0000","last_active":"2024-04-02T07:28:55.588844+0000","last_peered":"2024-04-02T07:28:55.588844+0000","last_clean":"2024-04-02T07:28:55.588844+0000","last_became_active":"2024-04-02T07:28:53.956124+0000","last_became_peered":"2024-04-02T07:28:53.956124+0000","last_unstale":"2024-04-02T07:28:55.588844+0000","last_undegraded":"2024-04-02T07:28:55.588844+0000","last_fullsized":"2024-04-02T07:28:55.588844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:47:06.026050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585941+0000","last_change":"2024-04-02T07:28:53.948860+0000","last_active":"2024-04-02T07:28:55.585941+0000","last_peered":"2024-04-02T07:28:55.585941+0000","last_clean":"2024-04-02T07:28:55.585941+0000","last_became_active":"2024-04-02T07:28:53.948532+0000","last_became_peered":"2024-04-02T07:28:53.948532+0000","last_unstale":"2024-04-02T07:28:55.585941+0000","last_undegraded":"2024-04-02T07:28:55.585941+0000","last_fullsized":"2024-04-02T07:28:55.585941+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:20:14.796287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.939948+0000","last_change":"2024-04-02T07:28:53.949315+0000","last_active":"2024-04-02T07:28:54.939948+0000","last_peered":"2024-04-02T07:28:54.939948+0000","last_clean":"2024-04-02T07:28:54.939948+0000","last_became_active":"2024-04-02T07:28:53.948458+0000","last_became_peered":"2024-04-02T07:28:53.948458+0000","last_unstale":"2024-04-02T07:28:54.939948+0000","last_undegraded":"2024-04-02T07:28:54.939948+0000","last_fullsized":"2024-04-02T07:28:54.939948+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:01:35.070038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585647+0000","last_change":"2024-04-02T07:28:53.950237+0000","last_active":"2024-04-02T07:28:55.585647+0000","last_peered":"2024-04-02T07:28:55.585647+0000","last_clean":"2024-04-02T07:28:55.585647+0000","last_became_active":"2024-04-02T07:28:53.949973+0000","last_became_peered":"2024-04-02T07:28:53.949973+0000","last_unstale":"2024-04-02T07:28:55.585647+0000","last_undegraded":"2024-04-02T07:28:55.585647+0000","last_fullsized":"2024-04-02T07:28:55.585647+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:57:45.518810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587939+0000","last_change":"2024-04-02T07:28:53.952907+0000","last_active":"2024-04-02T07:28:55.587939+0000","last_peered":"2024-04-02T07:28:55.587939+0000","last_clean":"2024-04-02T07:28:55.587939+0000","last_became_active":"2024-04-02T07:28:53.951263+0000","last_became_peered":"2024-04-02T07:28:53.951263+0000","last_unstale":"2024-04-02T07:28:55.587939+0000","last_undegraded":"2024-04-02T07:28:55.587939+0000","last_fullsized":"2024-04-02T07:28:55.587939+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:25:07.617763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587523+0000","last_change":"2024-04-02T07:28:53.955235+0000","last_active":"2024-04-02T07:28:55.587523+0000","last_peered":"2024-04-02T07:28:55.587523+0000","last_clean":"2024-04-02T07:28:55.587523+0000","last_became_active":"2024-04-02T07:28:53.954958+0000","last_became_peered":"2024-04-02T07:28:53.954958+0000","last_unstale":"2024-04-02T07:28:55.587523+0000","last_undegraded":"2024-04-02T07:28:55.587523+0000","last_fullsized":"2024-04-02T07:28:55.587523+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:29:17.610586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585360+0000","last_change":"2024-04-02T07:28:53.941580+0000","last_active":"2024-04-02T07:28:55.585360+0000","last_peered":"2024-04-02T07:28:55.585360+0000","last_clean":"2024-04-02T07:28:55.585360+0000","last_became_active":"2024-04-02T07:28:53.941318+0000","last_became_peered":"2024-04-02T07:28:53.941318+0000","last_unstale":"2024-04-02T07:28:55.585360+0000","last_undegraded":"2024-04-02T07:28:55.585360+0000","last_fullsized":"2024-04-02T07:28:55.585360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:58:13.516048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587281+0000","last_change":"2024-04-02T07:28:53.953416+0000","last_active":"2024-04-02T07:28:55.587281+0000","last_peered":"2024-04-02T07:28:55.587281+0000","last_clean":"2024-04-02T07:28:55.587281+0000","last_became_active":"2024-04-02T07:28:53.951634+0000","last_became_peered":"2024-04-02T07:28:53.951634+0000","last_unstale":"2024-04-02T07:28:55.587281+0000","last_undegraded":"2024-04-02T07:28:55.587281+0000","last_fullsized":"2024-04-02T07:28:55.587281+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:43:49.169530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587597+0000","last_change":"2024-04-02T07:28:53.955381+0000","last_active":"2024-04-02T07:28:55.587597+0000","last_peered":"2024-04-02T07:28:55.587597+0000","last_clean":"2024-04-02T07:28:55.587597+0000","last_became_active":"2024-04-02T07:28:53.954656+0000","last_became_peered":"2024-04-02T07:28:53.954656+0000","last_unstale":"2024-04-02T07:28:55.587597+0000","last_undegraded":"2024-04-02T07:28:55.587597+0000","last_fullsized":"2024-04-02T07:28:55.587597+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:27:23.479295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588807+0000","last_change":"2024-04-02T07:28:53.948749+0000","last_active":"2024-04-02T07:28:55.588807+0000","last_peered":"2024-04-02T07:28:55.588807+0000","last_clean":"2024-04-02T07:28:55.588807+0000","last_became_active":"2024-04-02T07:28:53.947253+0000","last_became_peered":"2024-04-02T07:28:53.947253+0000","last_unstale":"2024-04-02T07:28:55.588807+0000","last_undegraded":"2024-04-02T07:28:55.588807+0000","last_fullsized":"2024-04-02T07:28:55.588807+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:10:07.465691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.586357+0000","last_change":"2024-04-02T07:28:53.949056+0000","last_active":"2024-04-02T07:28:55.586357+0000","last_peered":"2024-04-02T07:28:55.586357+0000","last_clean":"2024-04-02T07:28:55.586357+0000","last_became_active":"2024-04-02T07:28:53.948770+0000","last_became_peered":"2024-04-02T07:28:53.948770+0000","last_unstale":"2024-04-02T07:28:55.586357+0000","last_undegraded":"2024-04-02T07:28:55.586357+0000","last_fullsized":"2024-04-02T07:28:55.586357+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:15:39.736958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588404+0000","last_change":"2024-04-02T07:28:53.948272+0000","last_active":"2024-04-02T07:28:55.588404+0000","last_peered":"2024-04-02T07:28:55.588404+0000","last_clean":"2024-04-02T07:28:55.588404+0000","last_became_active":"2024-04-02T07:28:53.947990+0000","last_became_peered":"2024-04-02T07:28:53.947990+0000","last_unstale":"2024-04-02T07:28:55.588404+0000","last_undegraded":"2024-04-02T07:28:55.588404+0000","last_fullsized":"2024-04-02T07:28:55.588404+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:14:11.790856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.939824+0000","last_change":"2024-04-02T07:28:53.948251+0000","last_active":"2024-04-02T07:28:54.939824+0000","last_peered":"2024-04-02T07:28:54.939824+0000","last_clean":"2024-04-02T07:28:54.939824+0000","last_became_active":"2024-04-02T07:28:53.947993+0000","last_became_peered":"2024-04-02T07:28:53.947993+0000","last_unstale":"2024-04-02T07:28:54.939824+0000","last_undegraded":"2024-04-02T07:28:54.939824+0000","last_fullsized":"2024-04-02T07:28:54.939824+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:35:13.926325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585907+0000","last_change":"2024-04-02T07:28:53.944203+0000","last_active":"2024-04-02T07:28:55.585907+0000","last_peered":"2024-04-02T07:28:55.585907+0000","last_clean":"2024-04-02T07:28:55.585907+0000","last_became_active":"2024-04-02T07:28:53.942810+0000","last_became_peered":"2024-04-02T07:28:53.942810+0000","last_unstale":"2024-04-02T07:28:55.585907+0000","last_undegraded":"2024-04-02T07:28:55.585907+0000","last_fullsized":"2024-04-02T07:28:55.585907+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:15:39.193096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937660+0000","last_change":"2024-04-02T07:28:53.939938+0000","last_active":"2024-04-02T07:28:54.937660+0000","last_peered":"2024-04-02T07:28:54.937660+0000","last_clean":"2024-04-02T07:28:54.937660+0000","last_became_active":"2024-04-02T07:28:53.939699+0000","last_became_peered":"2024-04-02T07:28:53.939699+0000","last_unstale":"2024-04-02T07:28:54.937660+0000","last_undegraded":"2024-04-02T07:28:54.937660+0000","last_fullsized":"2024-04-02T07:28:54.937660+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:14:11.790856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587725+0000","last_change":"2024-04-02T07:28:53.946125+0000","last_active":"2024-04-02T07:28:55.587725+0000","last_peered":"2024-04-02T07:28:55.587725+0000","last_clean":"2024-04-02T07:28:55.587725+0000","last_became_active":"2024-04-02T07:28:53.945876+0000","last_became_peered":"2024-04-02T07:28:53.945876+0000","last_unstale":"2024-04-02T07:28:55.587725+0000","last_undegraded":"2024-04-02T07:28:55.587725+0000","last_fullsized":"2024-04-02T07:28:55.587725+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:01:08.080021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588223+0000","last_change":"2024-04-02T07:28:53.951000+0000","last_active":"2024-04-02T07:28:55.588223+0000","last_peered":"2024-04-02T07:28:55.588223+0000","last_clean":"2024-04-02T07:28:55.588223+0000","last_became_active":"2024-04-02T07:28:53.950702+0000","last_became_peered":"2024-04-02T07:28:53.950702+0000","last_unstale":"2024-04-02T07:28:55.588223+0000","last_undegraded":"2024-04-02T07:28:55.588223+0000","last_fullsized":"2024-04-02T07:28:55.588223+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:25:33.948360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.586066+0000","last_change":"2024-04-02T07:28:53.945040+0000","last_active":"2024-04-02T07:28:55.586066+0000","last_peered":"2024-04-02T07:28:55.586066+0000","last_clean":"2024-04-02T07:28:55.586066+0000","last_became_active":"2024-04-02T07:28:53.943593+0000","last_became_peered":"2024-04-02T07:28:53.943593+0000","last_unstale":"2024-04-02T07:28:55.586066+0000","last_undegraded":"2024-04-02T07:28:55.586066+0000","last_fullsized":"2024-04-02T07:28:55.586066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:30:05.479404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937854+0000","last_change":"2024-04-02T07:28:53.945039+0000","last_active":"2024-04-02T07:28:54.937854+0000","last_peered":"2024-04-02T07:28:54.937854+0000","last_clean":"2024-04-02T07:28:54.937854+0000","last_became_active":"2024-04-02T07:28:53.944783+0000","last_became_peered":"2024-04-02T07:28:53.944783+0000","last_unstale":"2024-04-02T07:28:54.937854+0000","last_undegraded":"2024-04-02T07:28:54.937854+0000","last_fullsized":"2024-04-02T07:28:54.937854+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:10:07.465691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585741+0000","last_change":"2024-04-02T07:28:53.948048+0000","last_active":"2024-04-02T07:28:55.585741+0000","last_peered":"2024-04-02T07:28:55.585741+0000","last_clean":"2024-04-02T07:28:55.585741+0000","last_became_active":"2024-04-02T07:28:53.947792+0000","last_became_peered":"2024-04-02T07:28:53.947792+0000","last_unstale":"2024-04-02T07:28:55.585741+0000","last_undegraded":"2024-04-02T07:28:55.585741+0000","last_fullsized":"2024-04-02T07:28:55.585741+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:33:28.287915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585690+0000","last_change":"2024-04-02T07:28:53.942596+0000","last_active":"2024-04-02T07:28:55.585690+0000","last_peered":"2024-04-02T07:28:55.585690+0000","last_clean":"2024-04-02T07:28:55.585690+0000","last_became_active":"2024-04-02T07:28:53.942344+0000","last_became_peered":"2024-04-02T07:28:53.942344+0000","last_unstale":"2024-04-02T07:28:55.585690+0000","last_undegraded":"2024-04-02T07:28:55.585690+0000","last_fullsized":"2024-04-02T07:28:55.585690+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:23:17.051248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585920+0000","last_change":"2024-04-02T07:28:53.951093+0000","last_active":"2024-04-02T07:28:55.585920+0000","last_peered":"2024-04-02T07:28:55.585920+0000","last_clean":"2024-04-02T07:28:55.585920+0000","last_became_active":"2024-04-02T07:28:53.950817+0000","last_became_peered":"2024-04-02T07:28:53.950817+0000","last_unstale":"2024-04-02T07:28:55.585920+0000","last_undegraded":"2024-04-02T07:28:55.585920+0000","last_fullsized":"2024-04-02T07:28:55.585920+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:39:55.410899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588008+0000","last_change":"2024-04-02T07:28:53.952351+0000","last_active":"2024-04-02T07:28:55.588008+0000","last_peered":"2024-04-02T07:28:55.588008+0000","last_clean":"2024-04-02T07:28:55.588008+0000","last_became_active":"2024-04-02T07:28:53.952077+0000","last_became_peered":"2024-04-02T07:28:53.952077+0000","last_unstale":"2024-04-02T07:28:55.588008+0000","last_undegraded":"2024-04-02T07:28:55.588008+0000","last_fullsized":"2024-04-02T07:28:55.588008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:05:33.069753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585368+0000","last_change":"2024-04-02T07:28:53.945360+0000","last_active":"2024-04-02T07:28:55.585368+0000","last_peered":"2024-04-02T07:28:55.585368+0000","last_clean":"2024-04-02T07:28:55.585368+0000","last_became_active":"2024-04-02T07:28:53.943647+0000","last_became_peered":"2024-04-02T07:28:53.943647+0000","last_unstale":"2024-04-02T07:28:55.585368+0000","last_undegraded":"2024-04-02T07:28:55.585368+0000","last_fullsized":"2024-04-02T07:28:55.585368+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:01:48.456338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.586115+0000","last_change":"2024-04-02T07:28:53.948575+0000","last_active":"2024-04-02T07:28:55.586115+0000","last_peered":"2024-04-02T07:28:55.586115+0000","last_clean":"2024-04-02T07:28:55.586115+0000","last_became_active":"2024-04-02T07:28:53.948313+0000","last_became_peered":"2024-04-02T07:28:53.948313+0000","last_unstale":"2024-04-02T07:28:55.586115+0000","last_undegraded":"2024-04-02T07:28:55.586115+0000","last_fullsized":"2024-04-02T07:28:55.586115+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:09:15.409516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.940063+0000","last_change":"2024-04-02T07:28:53.952187+0000","last_active":"2024-04-02T07:28:54.940063+0000","last_peered":"2024-04-02T07:28:54.940063+0000","last_clean":"2024-04-02T07:28:54.940063+0000","last_became_active":"2024-04-02T07:28:53.951901+0000","last_became_peered":"2024-04-02T07:28:53.951901+0000","last_unstale":"2024-04-02T07:28:54.940063+0000","last_undegraded":"2024-04-02T07:28:54.940063+0000","last_fullsized":"2024-04-02T07:28:54.940063+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:14:11.790856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588273+0000","last_change":"2024-04-02T07:28:53.945699+0000","last_active":"2024-04-02T07:28:55.588273+0000","last_peered":"2024-04-02T07:28:55.588273+0000","last_clean":"2024-04-02T07:28:55.588273+0000","last_became_active":"2024-04-02T07:28:53.945452+0000","last_became_peered":"2024-04-02T07:28:53.945452+0000","last_unstale":"2024-04-02T07:28:55.588273+0000","last_undegraded":"2024-04-02T07:28:55.588273+0000","last_fullsized":"2024-04-02T07:28:55.588273+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:42:11.561150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588500+0000","last_change":"2024-04-02T07:28:53.953598+0000","last_active":"2024-04-02T07:28:55.588500+0000","last_peered":"2024-04-02T07:28:55.588500+0000","last_clean":"2024-04-02T07:28:55.588500+0000","last_became_active":"2024-04-02T07:28:53.953325+0000","last_became_peered":"2024-04-02T07:28:53.953325+0000","last_unstale":"2024-04-02T07:28:55.588500+0000","last_undegraded":"2024-04-02T07:28:55.588500+0000","last_fullsized":"2024-04-02T07:28:55.588500+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:48:15.622373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585968+0000","last_change":"2024-04-02T07:28:53.948707+0000","last_active":"2024-04-02T07:28:55.585968+0000","last_peered":"2024-04-02T07:28:55.585968+0000","last_clean":"2024-04-02T07:28:55.585968+0000","last_became_active":"2024-04-02T07:28:53.948435+0000","last_became_peered":"2024-04-02T07:28:53.948435+0000","last_unstale":"2024-04-02T07:28:55.585968+0000","last_undegraded":"2024-04-02T07:28:55.585968+0000","last_fullsized":"2024-04-02T07:28:55.585968+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:58:02.271747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.586020+0000","last_change":"2024-04-02T07:28:53.947016+0000","last_active":"2024-04-02T07:28:55.586020+0000","last_peered":"2024-04-02T07:28:55.586020+0000","last_clean":"2024-04-02T07:28:55.586020+0000","last_became_active":"2024-04-02T07:28:53.944676+0000","last_became_peered":"2024-04-02T07:28:53.944676+0000","last_unstale":"2024-04-02T07:28:55.586020+0000","last_undegraded":"2024-04-02T07:28:55.586020+0000","last_fullsized":"2024-04-02T07:28:55.586020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:34:54.076769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587871+0000","last_change":"2024-04-02T07:28:53.950179+0000","last_active":"2024-04-02T07:28:55.587871+0000","last_peered":"2024-04-02T07:28:55.587871+0000","last_clean":"2024-04-02T07:28:55.587871+0000","last_became_active":"2024-04-02T07:28:53.949931+0000","last_became_peered":"2024-04-02T07:28:53.949931+0000","last_unstale":"2024-04-02T07:28:55.587871+0000","last_undegraded":"2024-04-02T07:28:55.587871+0000","last_fullsized":"2024-04-02T07:28:55.587871+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:37:09.794797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587973+0000","last_change":"2024-04-02T07:28:53.952630+0000","last_active":"2024-04-02T07:28:55.587973+0000","last_peered":"2024-04-02T07:28:55.587973+0000","last_clean":"2024-04-02T07:28:55.587973+0000","last_became_active":"2024-04-02T07:28:53.952372+0000","last_became_peered":"2024-04-02T07:28:53.952372+0000","last_unstale":"2024-04-02T07:28:55.587973+0000","last_undegraded":"2024-04-02T07:28:55.587973+0000","last_fullsized":"2024-04-02T07:28:55.587973+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:25:33.948360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587994+0000","last_change":"2024-04-02T07:28:53.953810+0000","last_active":"2024-04-02T07:28:55.587994+0000","last_peered":"2024-04-02T07:28:55.587994+0000","last_clean":"2024-04-02T07:28:55.587994+0000","last_became_active":"2024-04-02T07:28:53.953555+0000","last_became_peered":"2024-04-02T07:28:53.953555+0000","last_unstale":"2024-04-02T07:28:55.587994+0000","last_undegraded":"2024-04-02T07:28:55.587994+0000","last_fullsized":"2024-04-02T07:28:55.587994+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:12:33.472756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"86'4","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588934+0000","last_change":"2024-04-02T07:28:53.542119+0000","last_active":"2024-04-02T07:28:55.588934+0000","last_peered":"2024-04-02T07:28:55.588934+0000","last_clean":"2024-04-02T07:28:55.588934+0000","last_became_active":"2024-04-02T07:28:53.541802+0000","last_became_peered":"2024-04-02T07:28:53.541802+0000","last_unstale":"2024-04-02T07:28:55.588934+0000","last_undegraded":"2024-04-02T07:28:55.588934+0000","last_fullsized":"2024-04-02T07:28:55.588934+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:09:14.407209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588869+0000","last_change":"2024-04-02T07:28:53.953739+0000","last_active":"2024-04-02T07:28:55.588869+0000","last_peered":"2024-04-02T07:28:55.588869+0000","last_clean":"2024-04-02T07:28:55.588869+0000","last_became_active":"2024-04-02T07:28:53.953451+0000","last_became_peered":"2024-04-02T07:28:53.953451+0000","last_unstale":"2024-04-02T07:28:55.588869+0000","last_undegraded":"2024-04-02T07:28:55.588869+0000","last_fullsized":"2024-04-02T07:28:55.588869+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:35:13.926325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"86'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588109+0000","last_change":"2024-04-02T07:28:53.545834+0000","last_active":"2024-04-02T07:28:55.588109+0000","last_peered":"2024-04-02T07:28:55.588109+0000","last_clean":"2024-04-02T07:28:55.588109+0000","last_became_active":"2024-04-02T07:28:53.545517+0000","last_became_peered":"2024-04-02T07:28:53.545517+0000","last_unstale":"2024-04-02T07:28:55.588109+0000","last_undegraded":"2024-04-02T07:28:55.588109+0000","last_fullsized":"2024-04-02T07:28:55.588109+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:19:24.051834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588553+0000","last_change":"2024-04-02T07:28:53.953027+0000","last_active":"2024-04-02T07:28:55.588553+0000","last_peered":"2024-04-02T07:28:55.588553+0000","last_clean":"2024-04-02T07:28:55.588553+0000","last_became_active":"2024-04-02T07:28:53.952617+0000","last_became_peered":"2024-04-02T07:28:53.952617+0000","last_unstale":"2024-04-02T07:28:55.588553+0000","last_undegraded":"2024-04-02T07:28:55.588553+0000","last_fullsized":"2024-04-02T07:28:55.588553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:18:11.660376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"86'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937931+0000","last_change":"2024-04-02T07:28:53.537781+0000","last_active":"2024-04-02T07:28:54.937931+0000","last_peered":"2024-04-02T07:28:54.937931+0000","last_clean":"2024-04-02T07:28:54.937931+0000","last_became_active":"2024-04-02T07:28:53.537499+0000","last_became_peered":"2024-04-02T07:28:53.537499+0000","last_unstale":"2024-04-02T07:28:54.937931+0000","last_undegraded":"2024-04-02T07:28:54.937931+0000","last_fullsized":"2024-04-02T07:28:54.937931+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:15:38.734651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.939975+0000","last_change":"2024-04-02T07:28:53.946536+0000","last_active":"2024-04-02T07:28:54.939975+0000","last_peered":"2024-04-02T07:28:54.939975+0000","last_clean":"2024-04-02T07:28:54.939975+0000","last_became_active":"2024-04-02T07:28:53.945532+0000","last_became_peered":"2024-04-02T07:28:53.945532+0000","last_unstale":"2024-04-02T07:28:54.939975+0000","last_undegraded":"2024-04-02T07:28:54.939975+0000","last_fullsized":"2024-04-02T07:28:54.939975+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:47:06.026050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"86'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937514+0000","last_change":"2024-04-02T07:28:53.543383+0000","last_active":"2024-04-02T07:28:54.937514+0000","last_peered":"2024-04-02T07:28:54.937514+0000","last_clean":"2024-04-02T07:28:54.937514+0000","last_became_active":"2024-04-02T07:28:53.542790+0000","last_became_peered":"2024-04-02T07:28:53.542790+0000","last_unstale":"2024-04-02T07:28:54.937514+0000","last_undegraded":"2024-04-02T07:28:54.937514+0000","last_fullsized":"2024-04-02T07:28:54.937514+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:09:14.407209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.586123+0000","last_change":"2024-04-02T07:28:53.945084+0000","last_active":"2024-04-02T07:28:55.586123+0000","last_peered":"2024-04-02T07:28:55.586123+0000","last_clean":"2024-04-02T07:28:55.586123+0000","last_became_active":"2024-04-02T07:28:53.944343+0000","last_became_peered":"2024-04-02T07:28:53.944343+0000","last_unstale":"2024-04-02T07:28:55.586123+0000","last_undegraded":"2024-04-02T07:28:55.586123+0000","last_fullsized":"2024-04-02T07:28:55.586123+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:53:09.735234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"86'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588244+0000","last_change":"2024-04-02T07:28:53.541120+0000","last_active":"2024-04-02T07:28:55.588244+0000","last_peered":"2024-04-02T07:28:55.588244+0000","last_clean":"2024-04-02T07:28:55.588244+0000","last_became_active":"2024-04-02T07:28:53.540792+0000","last_became_peered":"2024-04-02T07:28:53.540792+0000","last_unstale":"2024-04-02T07:28:55.588244+0000","last_undegraded":"2024-04-02T07:28:55.588244+0000","last_fullsized":"2024-04-02T07:28:55.588244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:20:13.793980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588054+0000","last_change":"2024-04-02T07:28:53.946786+0000","last_active":"2024-04-02T07:28:55.588054+0000","last_peered":"2024-04-02T07:28:55.588054+0000","last_clean":"2024-04-02T07:28:55.588054+0000","last_became_active":"2024-04-02T07:28:53.944711+0000","last_became_peered":"2024-04-02T07:28:53.944711+0000","last_unstale":"2024-04-02T07:28:55.588054+0000","last_undegraded":"2024-04-02T07:28:55.588054+0000","last_fullsized":"2024-04-02T07:28:55.588054+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:12:42.159370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"86'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587986+0000","last_change":"2024-04-02T07:28:53.545460+0000","last_active":"2024-04-02T07:28:55.587986+0000","last_peered":"2024-04-02T07:28:55.587986+0000","last_clean":"2024-04-02T07:28:55.587986+0000","last_became_active":"2024-04-02T07:28:53.545172+0000","last_became_peered":"2024-04-02T07:28:53.545172+0000","last_unstale":"2024-04-02T07:28:55.587986+0000","last_undegraded":"2024-04-02T07:28:55.587986+0000","last_fullsized":"2024-04-02T07:28:55.587986+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:49.307447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.939756+0000","last_change":"2024-04-02T07:28:53.946286+0000","last_active":"2024-04-02T07:28:54.939756+0000","last_peered":"2024-04-02T07:28:54.939756+0000","last_clean":"2024-04-02T07:28:54.939756+0000","last_became_active":"2024-04-02T07:28:53.945950+0000","last_became_peered":"2024-04-02T07:28:53.945950+0000","last_unstale":"2024-04-02T07:28:54.939756+0000","last_undegraded":"2024-04-02T07:28:54.939756+0000","last_fullsized":"2024-04-02T07:28:54.939756+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:48:15.622373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937141+0000","last_change":"2024-04-02T07:28:53.545481+0000","last_active":"2024-04-02T07:28:54.937141+0000","last_peered":"2024-04-02T07:28:54.937141+0000","last_clean":"2024-04-02T07:28:54.937141+0000","last_became_active":"2024-04-02T07:28:53.545109+0000","last_became_peered":"2024-04-02T07:28:53.545109+0000","last_unstale":"2024-04-02T07:28:54.937141+0000","last_undegraded":"2024-04-02T07:28:54.937141+0000","last_fullsized":"2024-04-02T07:28:54.937141+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:43:48.167224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937757+0000","last_change":"2024-04-02T07:28:53.939810+0000","last_active":"2024-04-02T07:28:54.937757+0000","last_peered":"2024-04-02T07:28:54.937757+0000","last_clean":"2024-04-02T07:28:54.937757+0000","last_became_active":"2024-04-02T07:28:53.939565+0000","last_became_peered":"2024-04-02T07:28:53.939565+0000","last_unstale":"2024-04-02T07:28:54.937757+0000","last_undegraded":"2024-04-02T07:28:54.937757+0000","last_fullsized":"2024-04-02T07:28:54.937757+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:35:13.926325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585729+0000","last_change":"2024-04-02T07:28:53.540095+0000","last_active":"2024-04-02T07:28:55.585729+0000","last_peered":"2024-04-02T07:28:55.585729+0000","last_clean":"2024-04-02T07:28:55.585729+0000","last_became_active":"2024-04-02T07:28:53.539748+0000","last_became_peered":"2024-04-02T07:28:53.539748+0000","last_unstale":"2024-04-02T07:28:55.585729+0000","last_undegraded":"2024-04-02T07:28:55.585729+0000","last_fullsized":"2024-04-02T07:28:55.585729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:34:28.923668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.938152+0000","last_change":"2024-04-02T07:28:53.951084+0000","last_active":"2024-04-02T07:28:54.938152+0000","last_peered":"2024-04-02T07:28:54.938152+0000","last_clean":"2024-04-02T07:28:54.938152+0000","last_became_active":"2024-04-02T07:28:53.950777+0000","last_became_peered":"2024-04-02T07:28:53.950777+0000","last_unstale":"2024-04-02T07:28:54.938152+0000","last_undegraded":"2024-04-02T07:28:54.938152+0000","last_fullsized":"2024-04-02T07:28:54.938152+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:50:00.479392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588989+0000","last_change":"2024-04-02T07:28:53.543582+0000","last_active":"2024-04-02T07:28:55.588989+0000","last_peered":"2024-04-02T07:28:55.588989+0000","last_clean":"2024-04-02T07:28:55.588989+0000","last_became_active":"2024-04-02T07:28:53.543180+0000","last_became_peered":"2024-04-02T07:28:53.543180+0000","last_unstale":"2024-04-02T07:28:55.588989+0000","last_undegraded":"2024-04-02T07:28:55.588989+0000","last_fullsized":"2024-04-02T07:28:55.588989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:29:16.608280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587703+0000","last_change":"2024-04-02T07:28:53.954053+0000","last_active":"2024-04-02T07:28:55.587703+0000","last_peered":"2024-04-02T07:28:55.587703+0000","last_clean":"2024-04-02T07:28:55.587703+0000","last_became_active":"2024-04-02T07:28:53.952948+0000","last_became_peered":"2024-04-02T07:28:53.952948+0000","last_unstale":"2024-04-02T07:28:55.587703+0000","last_undegraded":"2024-04-02T07:28:55.587703+0000","last_fullsized":"2024-04-02T07:28:55.587703+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:15:39.736958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588862+0000","last_change":"2024-04-02T07:28:53.543092+0000","last_active":"2024-04-02T07:28:55.588862+0000","last_peered":"2024-04-02T07:28:55.588862+0000","last_clean":"2024-04-02T07:28:55.588862+0000","last_became_active":"2024-04-02T07:28:53.542744+0000","last_became_peered":"2024-04-02T07:28:53.542744+0000","last_unstale":"2024-04-02T07:28:55.588862+0000","last_undegraded":"2024-04-02T07:28:55.588862+0000","last_fullsized":"2024-04-02T07:28:55.588862+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:42:11.962768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937428+0000","last_change":"2024-04-02T07:28:53.945681+0000","last_active":"2024-04-02T07:28:54.937428+0000","last_peered":"2024-04-02T07:28:54.937428+0000","last_clean":"2024-04-02T07:28:54.937428+0000","last_became_active":"2024-04-02T07:28:53.945355+0000","last_became_peered":"2024-04-02T07:28:53.945355+0000","last_unstale":"2024-04-02T07:28:54.937428+0000","last_undegraded":"2024-04-02T07:28:54.937428+0000","last_fullsized":"2024-04-02T07:28:54.937428+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:18:11.660376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"86'3","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588591+0000","last_change":"2024-04-02T07:28:53.545363+0000","last_active":"2024-04-02T07:28:55.588591+0000","last_peered":"2024-04-02T07:28:55.588591+0000","last_clean":"2024-04-02T07:28:55.588591+0000","last_became_active":"2024-04-02T07:28:53.545094+0000","last_became_peered":"2024-04-02T07:28:53.545094+0000","last_unstale":"2024-04-02T07:28:55.588591+0000","last_undegraded":"2024-04-02T07:28:55.588591+0000","last_fullsized":"2024-04-02T07:28:55.588591+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:39:54.408592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588342+0000","last_change":"2024-04-02T07:28:53.948744+0000","last_active":"2024-04-02T07:28:55.588342+0000","last_peered":"2024-04-02T07:28:55.588342+0000","last_clean":"2024-04-02T07:28:55.588342+0000","last_became_active":"2024-04-02T07:28:53.948052+0000","last_became_peered":"2024-04-02T07:28:53.948052+0000","last_unstale":"2024-04-02T07:28:55.588342+0000","last_undegraded":"2024-04-02T07:28:55.588342+0000","last_fullsized":"2024-04-02T07:28:55.588342+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:25:53.414562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"86'6","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587483+0000","last_change":"2024-04-02T07:28:53.541298+0000","last_active":"2024-04-02T07:28:55.587483+0000","last_peered":"2024-04-02T07:28:55.587483+0000","last_clean":"2024-04-02T07:28:55.587483+0000","last_became_active":"2024-04-02T07:28:53.541033+0000","last_became_peered":"2024-04-02T07:28:53.541033+0000","last_unstale":"2024-04-02T07:28:55.587483+0000","last_undegraded":"2024-04-02T07:28:55.587483+0000","last_fullsized":"2024-04-02T07:28:55.587483+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:54.076243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937045+0000","last_change":"2024-04-02T07:28:53.945798+0000","last_active":"2024-04-02T07:28:54.937045+0000","last_peered":"2024-04-02T07:28:54.937045+0000","last_clean":"2024-04-02T07:28:54.937045+0000","last_became_active":"2024-04-02T07:28:53.945561+0000","last_became_peered":"2024-04-02T07:28:53.945561+0000","last_unstale":"2024-04-02T07:28:54.937045+0000","last_undegraded":"2024-04-02T07:28:54.937045+0000","last_fullsized":"2024-04-02T07:28:54.937045+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:25:53.414562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"86'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.586022+0000","last_change":"2024-04-02T07:28:53.547402+0000","last_active":"2024-04-02T07:28:55.586022+0000","last_peered":"2024-04-02T07:28:55.586022+0000","last_clean":"2024-04-02T07:28:55.586022+0000","last_became_active":"2024-04-02T07:28:53.547110+0000","last_became_peered":"2024-04-02T07:28:53.547110+0000","last_unstale":"2024-04-02T07:28:55.586022+0000","last_undegraded":"2024-04-02T07:28:55.586022+0000","last_fullsized":"2024-04-02T07:28:55.586022+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:04:54.229901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.939936+0000","last_change":"2024-04-02T07:28:53.942037+0000","last_active":"2024-04-02T07:28:54.939936+0000","last_peered":"2024-04-02T07:28:54.939936+0000","last_clean":"2024-04-02T07:28:54.939936+0000","last_became_active":"2024-04-02T07:28:53.941703+0000","last_became_peered":"2024-04-02T07:28:53.941703+0000","last_unstale":"2024-04-02T07:28:54.939936+0000","last_undegraded":"2024-04-02T07:28:54.939936+0000","last_fullsized":"2024-04-02T07:28:54.939936+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:23:40.254146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937795+0000","last_change":"2024-04-02T07:28:53.545847+0000","last_active":"2024-04-02T07:28:54.937795+0000","last_peered":"2024-04-02T07:28:54.937795+0000","last_clean":"2024-04-02T07:28:54.937795+0000","last_became_active":"2024-04-02T07:28:53.545586+0000","last_became_peered":"2024-04-02T07:28:53.545586+0000","last_unstale":"2024-04-02T07:28:54.937795+0000","last_undegraded":"2024-04-02T07:28:54.937795+0000","last_fullsized":"2024-04-02T07:28:54.937795+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:25:52.412256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585634+0000","last_change":"2024-04-02T07:28:53.942614+0000","last_active":"2024-04-02T07:28:55.585634+0000","last_peered":"2024-04-02T07:28:55.585634+0000","last_clean":"2024-04-02T07:28:55.585634+0000","last_became_active":"2024-04-02T07:28:53.942349+0000","last_became_peered":"2024-04-02T07:28:53.942349+0000","last_unstale":"2024-04-02T07:28:55.585634+0000","last_undegraded":"2024-04-02T07:28:55.585634+0000","last_fullsized":"2024-04-02T07:28:55.585634+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:42:12.965075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587267+0000","last_change":"2024-04-02T07:28:53.547390+0000","last_active":"2024-04-02T07:28:55.587267+0000","last_peered":"2024-04-02T07:28:55.587267+0000","last_clean":"2024-04-02T07:28:55.587267+0000","last_became_active":"2024-04-02T07:28:53.547036+0000","last_became_peered":"2024-04-02T07:28:53.547036+0000","last_unstale":"2024-04-02T07:28:55.587267+0000","last_undegraded":"2024-04-02T07:28:55.587267+0000","last_fullsized":"2024-04-02T07:28:55.587267+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:19:24.051834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585560+0000","last_change":"2024-04-02T07:28:53.943581+0000","last_active":"2024-04-02T07:28:55.585560+0000","last_peered":"2024-04-02T07:28:55.585560+0000","last_clean":"2024-04-02T07:28:55.585560+0000","last_became_active":"2024-04-02T07:28:53.943319+0000","last_became_peered":"2024-04-02T07:28:53.943319+0000","last_unstale":"2024-04-02T07:28:55.585560+0000","last_undegraded":"2024-04-02T07:28:55.585560+0000","last_fullsized":"2024-04-02T07:28:55.585560+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:29:17.610586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"86'8","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.936945+0000","last_change":"2024-04-02T07:28:53.539967+0000","last_active":"2024-04-02T07:28:54.936945+0000","last_peered":"2024-04-02T07:28:54.936945+0000","last_clean":"2024-04-02T07:28:54.936945+0000","last_became_active":"2024-04-02T07:28:53.539668+0000","last_became_peered":"2024-04-02T07:28:53.539668+0000","last_unstale":"2024-04-02T07:28:54.936945+0000","last_undegraded":"2024-04-02T07:28:54.936945+0000","last_fullsized":"2024-04-02T07:28:54.936945+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:07:04.748500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.940049+0000","last_change":"2024-04-02T07:28:53.945973+0000","last_active":"2024-04-02T07:28:54.940049+0000","last_peered":"2024-04-02T07:28:54.940049+0000","last_clean":"2024-04-02T07:28:54.940049+0000","last_became_active":"2024-04-02T07:28:53.945708+0000","last_became_peered":"2024-04-02T07:28:53.945708+0000","last_unstale":"2024-04-02T07:28:54.940049+0000","last_undegraded":"2024-04-02T07:28:54.940049+0000","last_fullsized":"2024-04-02T07:28:54.940049+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:50:00.479392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"86'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.589057+0000","last_change":"2024-04-02T07:28:53.543424+0000","last_active":"2024-04-02T07:28:55.589057+0000","last_peered":"2024-04-02T07:28:55.589057+0000","last_clean":"2024-04-02T07:28:55.589057+0000","last_became_active":"2024-04-02T07:28:53.542832+0000","last_became_peered":"2024-04-02T07:28:53.542832+0000","last_unstale":"2024-04-02T07:28:55.589057+0000","last_undegraded":"2024-04-02T07:28:55.589057+0000","last_fullsized":"2024-04-02T07:28:55.589057+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:15:38.734651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588965+0000","last_change":"2024-04-02T07:28:53.947191+0000","last_active":"2024-04-02T07:28:55.588965+0000","last_peered":"2024-04-02T07:28:55.588965+0000","last_clean":"2024-04-02T07:28:55.588965+0000","last_became_active":"2024-04-02T07:28:53.946873+0000","last_became_peered":"2024-04-02T07:28:53.946873+0000","last_unstale":"2024-04-02T07:28:55.588965+0000","last_undegraded":"2024-04-02T07:28:55.588965+0000","last_fullsized":"2024-04-02T07:28:55.588965+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:17:57.271735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"86'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937490+0000","last_change":"2024-04-02T07:28:53.538793+0000","last_active":"2024-04-02T07:28:54.937490+0000","last_peered":"2024-04-02T07:28:54.937490+0000","last_clean":"2024-04-02T07:28:54.937490+0000","last_became_active":"2024-04-02T07:28:53.538513+0000","last_became_peered":"2024-04-02T07:28:53.538513+0000","last_unstale":"2024-04-02T07:28:54.937490+0000","last_undegraded":"2024-04-02T07:28:54.937490+0000","last_fullsized":"2024-04-02T07:28:54.937490+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:52:33.433841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588360+0000","last_change":"2024-04-02T07:28:53.952248+0000","last_active":"2024-04-02T07:28:55.588360+0000","last_peered":"2024-04-02T07:28:55.588360+0000","last_clean":"2024-04-02T07:28:55.588360+0000","last_became_active":"2024-04-02T07:28:53.951995+0000","last_became_peered":"2024-04-02T07:28:53.951995+0000","last_unstale":"2024-04-02T07:28:55.588360+0000","last_undegraded":"2024-04-02T07:28:55.588360+0000","last_fullsized":"2024-04-02T07:28:55.588360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:10:07.465691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937595+0000","last_change":"2024-04-02T07:28:53.542307+0000","last_active":"2024-04-02T07:28:54.937595+0000","last_peered":"2024-04-02T07:28:54.937595+0000","last_clean":"2024-04-02T07:28:54.937595+0000","last_became_active":"2024-04-02T07:28:53.541994+0000","last_became_peered":"2024-04-02T07:28:53.541994+0000","last_unstale":"2024-04-02T07:28:54.937595+0000","last_undegraded":"2024-04-02T07:28:54.937595+0000","last_fullsized":"2024-04-02T07:28:54.937595+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:27:22.476989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585928+0000","last_change":"2024-04-02T07:28:53.944195+0000","last_active":"2024-04-02T07:28:55.585928+0000","last_peered":"2024-04-02T07:28:55.585928+0000","last_clean":"2024-04-02T07:28:55.585928+0000","last_became_active":"2024-04-02T07:28:53.942519+0000","last_became_peered":"2024-04-02T07:28:53.942519+0000","last_unstale":"2024-04-02T07:28:55.585928+0000","last_undegraded":"2024-04-02T07:28:55.585928+0000","last_fullsized":"2024-04-02T07:28:55.585928+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:05:45.322434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"86'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937853+0000","last_change":"2024-04-02T07:28:53.539379+0000","last_active":"2024-04-02T07:28:54.937853+0000","last_peered":"2024-04-02T07:28:54.937853+0000","last_clean":"2024-04-02T07:28:54.937853+0000","last_became_active":"2024-04-02T07:28:53.539121+0000","last_became_peered":"2024-04-02T07:28:53.539121+0000","last_unstale":"2024-04-02T07:28:54.937853+0000","last_undegraded":"2024-04-02T07:28:54.937853+0000","last_fullsized":"2024-04-02T07:28:54.937853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:25:06.615456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587378+0000","last_change":"2024-04-02T07:28:53.946334+0000","last_active":"2024-04-02T07:28:55.587378+0000","last_peered":"2024-04-02T07:28:55.587378+0000","last_clean":"2024-04-02T07:28:55.587378+0000","last_became_active":"2024-04-02T07:28:53.946037+0000","last_became_peered":"2024-04-02T07:28:53.946037+0000","last_unstale":"2024-04-02T07:28:55.587378+0000","last_undegraded":"2024-04-02T07:28:55.587378+0000","last_fullsized":"2024-04-02T07:28:55.587378+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:53:09.735234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585998+0000","last_change":"2024-04-02T07:28:53.544491+0000","last_active":"2024-04-02T07:28:55.585998+0000","last_peered":"2024-04-02T07:28:55.585998+0000","last_clean":"2024-04-02T07:28:55.585998+0000","last_became_active":"2024-04-02T07:28:53.544217+0000","last_became_peered":"2024-04-02T07:28:53.544217+0000","last_unstale":"2024-04-02T07:28:55.585998+0000","last_undegraded":"2024-04-02T07:28:55.585998+0000","last_fullsized":"2024-04-02T07:28:55.585998+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:16:11.505703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585353+0000","last_change":"2024-04-02T07:28:53.940500+0000","last_active":"2024-04-02T07:28:55.585353+0000","last_peered":"2024-04-02T07:28:55.585353+0000","last_clean":"2024-04-02T07:28:55.585353+0000","last_became_active":"2024-04-02T07:28:53.940257+0000","last_became_peered":"2024-04-02T07:28:53.940257+0000","last_unstale":"2024-04-02T07:28:55.585353+0000","last_undegraded":"2024-04-02T07:28:55.585353+0000","last_fullsized":"2024-04-02T07:28:55.585353+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:43:25.076355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585377+0000","last_change":"2024-04-02T07:28:53.540316+0000","last_active":"2024-04-02T07:28:55.585377+0000","last_peered":"2024-04-02T07:28:55.585377+0000","last_clean":"2024-04-02T07:28:55.585377+0000","last_became_active":"2024-04-02T07:28:53.540025+0000","last_became_peered":"2024-04-02T07:28:53.540025+0000","last_unstale":"2024-04-02T07:28:55.585377+0000","last_undegraded":"2024-04-02T07:28:55.585377+0000","last_fullsized":"2024-04-02T07:28:55.585377+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:33:31.000139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587420+0000","last_change":"2024-04-02T07:28:53.951883+0000","last_active":"2024-04-02T07:28:55.587420+0000","last_peered":"2024-04-02T07:28:55.587420+0000","last_clean":"2024-04-02T07:28:55.587420+0000","last_became_active":"2024-04-02T07:28:53.951528+0000","last_became_peered":"2024-04-02T07:28:53.951528+0000","last_unstale":"2024-04-02T07:28:55.587420+0000","last_undegraded":"2024-04-02T07:28:55.587420+0000","last_fullsized":"2024-04-02T07:28:55.587420+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:52:34.436148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937542+0000","last_change":"2024-04-02T07:28:53.538514+0000","last_active":"2024-04-02T07:28:54.937542+0000","last_peered":"2024-04-02T07:28:54.937542+0000","last_clean":"2024-04-02T07:28:54.937542+0000","last_became_active":"2024-04-02T07:28:53.538205+0000","last_became_peered":"2024-04-02T07:28:53.538205+0000","last_unstale":"2024-04-02T07:28:54.937542+0000","last_undegraded":"2024-04-02T07:28:54.937542+0000","last_fullsized":"2024-04-02T07:28:54.937542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:10:06.463384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588053+0000","last_change":"2024-04-02T07:28:53.953793+0000","last_active":"2024-04-02T07:28:55.588053+0000","last_peered":"2024-04-02T07:28:55.588053+0000","last_clean":"2024-04-02T07:28:55.588053+0000","last_became_active":"2024-04-02T07:28:53.953519+0000","last_became_peered":"2024-04-02T07:28:53.953519+0000","last_unstale":"2024-04-02T07:28:55.588053+0000","last_undegraded":"2024-04-02T07:28:55.588053+0000","last_fullsized":"2024-04-02T07:28:55.588053+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:18:11.660376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"86'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.586156+0000","last_change":"2024-04-02T07:28:53.540111+0000","last_active":"2024-04-02T07:28:55.586156+0000","last_peered":"2024-04-02T07:28:55.586156+0000","last_clean":"2024-04-02T07:28:55.586156+0000","last_became_active":"2024-04-02T07:28:53.539778+0000","last_became_peered":"2024-04-02T07:28:53.539778+0000","last_unstale":"2024-04-02T07:28:55.586156+0000","last_undegraded":"2024-04-02T07:28:55.586156+0000","last_fullsized":"2024-04-02T07:28:55.586156+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:41:17.973477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.940201+0000","last_change":"2024-04-02T07:28:53.947368+0000","last_active":"2024-04-02T07:28:54.940201+0000","last_peered":"2024-04-02T07:28:54.940201+0000","last_clean":"2024-04-02T07:28:54.940201+0000","last_became_active":"2024-04-02T07:28:53.947033+0000","last_became_peered":"2024-04-02T07:28:53.947033+0000","last_unstale":"2024-04-02T07:28:54.940201+0000","last_undegraded":"2024-04-02T07:28:54.940201+0000","last_fullsized":"2024-04-02T07:28:54.940201+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:29:49.287555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.586039+0000","last_change":"2024-04-02T07:28:53.543724+0000","last_active":"2024-04-02T07:28:55.586039+0000","last_peered":"2024-04-02T07:28:55.586039+0000","last_clean":"2024-04-02T07:28:55.586039+0000","last_became_active":"2024-04-02T07:28:53.543406+0000","last_became_peered":"2024-04-02T07:28:53.543406+0000","last_unstale":"2024-04-02T07:28:55.586039+0000","last_undegraded":"2024-04-02T07:28:55.586039+0000","last_fullsized":"2024-04-02T07:28:55.586039+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:41:52.990728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588603+0000","last_change":"2024-04-02T07:28:53.958985+0000","last_active":"2024-04-02T07:28:55.588603+0000","last_peered":"2024-04-02T07:28:55.588603+0000","last_clean":"2024-04-02T07:28:55.588603+0000","last_became_active":"2024-04-02T07:28:53.958725+0000","last_became_peered":"2024-04-02T07:28:53.958725+0000","last_unstale":"2024-04-02T07:28:55.588603+0000","last_undegraded":"2024-04-02T07:28:55.588603+0000","last_fullsized":"2024-04-02T07:28:55.588603+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:50:00.479392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588711+0000","last_change":"2024-04-02T07:28:53.543067+0000","last_active":"2024-04-02T07:28:55.588711+0000","last_peered":"2024-04-02T07:28:55.588711+0000","last_clean":"2024-04-02T07:28:55.588711+0000","last_became_active":"2024-04-02T07:28:53.541921+0000","last_became_peered":"2024-04-02T07:28:53.541921+0000","last_unstale":"2024-04-02T07:28:55.588711+0000","last_undegraded":"2024-04-02T07:28:55.588711+0000","last_fullsized":"2024-04-02T07:28:55.588711+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:58:01.269440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588435+0000","last_change":"2024-04-02T07:28:53.948306+0000","last_active":"2024-04-02T07:28:55.588435+0000","last_peered":"2024-04-02T07:28:55.588435+0000","last_clean":"2024-04-02T07:28:55.588435+0000","last_became_active":"2024-04-02T07:28:53.947724+0000","last_became_peered":"2024-04-02T07:28:53.947724+0000","last_unstale":"2024-04-02T07:28:55.588435+0000","last_undegraded":"2024-04-02T07:28:55.588435+0000","last_fullsized":"2024-04-02T07:28:55.588435+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:07:05.750806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588669+0000","last_change":"2024-04-02T07:28:53.542156+0000","last_active":"2024-04-02T07:28:55.588669+0000","last_peered":"2024-04-02T07:28:55.588669+0000","last_clean":"2024-04-02T07:28:55.588669+0000","last_became_active":"2024-04-02T07:28:53.540629+0000","last_became_peered":"2024-04-02T07:28:53.540629+0000","last_unstale":"2024-04-02T07:28:55.588669+0000","last_undegraded":"2024-04-02T07:28:55.588669+0000","last_fullsized":"2024-04-02T07:28:55.588669+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:11:03.964147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587365+0000","last_change":"2024-04-02T07:28:53.946763+0000","last_active":"2024-04-02T07:28:55.587365+0000","last_peered":"2024-04-02T07:28:55.587365+0000","last_clean":"2024-04-02T07:28:55.587365+0000","last_became_active":"2024-04-02T07:28:53.946472+0000","last_became_peered":"2024-04-02T07:28:53.946472+0000","last_unstale":"2024-04-02T07:28:55.587365+0000","last_undegraded":"2024-04-02T07:28:55.587365+0000","last_fullsized":"2024-04-02T07:28:55.587365+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:09:15.409516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937365+0000","last_change":"2024-04-02T07:28:53.541627+0000","last_active":"2024-04-02T07:28:54.937365+0000","last_peered":"2024-04-02T07:28:54.937365+0000","last_clean":"2024-04-02T07:28:54.937365+0000","last_became_active":"2024-04-02T07:28:53.541367+0000","last_became_peered":"2024-04-02T07:28:53.541367+0000","last_unstale":"2024-04-02T07:28:54.937365+0000","last_undegraded":"2024-04-02T07:28:54.937365+0000","last_fullsized":"2024-04-02T07:28:54.937365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:01:07.077714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937332+0000","last_change":"2024-04-02T07:28:53.947390+0000","last_active":"2024-04-02T07:28:54.937332+0000","last_peered":"2024-04-02T07:28:54.937332+0000","last_clean":"2024-04-02T07:28:54.937332+0000","last_became_active":"2024-04-02T07:28:53.946291+0000","last_became_peered":"2024-04-02T07:28:53.946291+0000","last_unstale":"2024-04-02T07:28:54.937332+0000","last_undegraded":"2024-04-02T07:28:54.937332+0000","last_fullsized":"2024-04-02T07:28:54.937332+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:42:11.561150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588102+0000","last_change":"2024-04-02T07:28:53.544426+0000","last_active":"2024-04-02T07:28:55.588102+0000","last_peered":"2024-04-02T07:28:55.588102+0000","last_clean":"2024-04-02T07:28:55.588102+0000","last_became_active":"2024-04-02T07:28:53.542866+0000","last_became_peered":"2024-04-02T07:28:53.542866+0000","last_unstale":"2024-04-02T07:28:55.588102+0000","last_undegraded":"2024-04-02T07:28:55.588102+0000","last_fullsized":"2024-04-02T07:28:55.588102+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:54.076243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.939741+0000","last_change":"2024-04-02T07:28:53.947890+0000","last_active":"2024-04-02T07:28:54.939741+0000","last_peered":"2024-04-02T07:28:54.939741+0000","last_clean":"2024-04-02T07:28:54.939741+0000","last_became_active":"2024-04-02T07:28:53.947622+0000","last_became_peered":"2024-04-02T07:28:53.947622+0000","last_unstale":"2024-04-02T07:28:54.939741+0000","last_undegraded":"2024-04-02T07:28:54.939741+0000","last_fullsized":"2024-04-02T07:28:54.939741+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:05:33.069753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588379+0000","last_change":"2024-04-02T07:28:53.544885+0000","last_active":"2024-04-02T07:28:55.588379+0000","last_peered":"2024-04-02T07:28:55.588379+0000","last_clean":"2024-04-02T07:28:55.588379+0000","last_became_active":"2024-04-02T07:28:53.544186+0000","last_became_peered":"2024-04-02T07:28:53.544186+0000","last_unstale":"2024-04-02T07:28:55.588379+0000","last_undegraded":"2024-04-02T07:28:55.588379+0000","last_fullsized":"2024-04-02T07:28:55.588379+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:53:08.732927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588301+0000","last_change":"2024-04-02T07:28:53.949683+0000","last_active":"2024-04-02T07:28:55.588301+0000","last_peered":"2024-04-02T07:28:55.588301+0000","last_clean":"2024-04-02T07:28:55.588301+0000","last_became_active":"2024-04-02T07:28:53.949421+0000","last_became_peered":"2024-04-02T07:28:53.949421+0000","last_unstale":"2024-04-02T07:28:55.588301+0000","last_undegraded":"2024-04-02T07:28:55.588301+0000","last_fullsized":"2024-04-02T07:28:55.588301+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:49:12.365206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587731+0000","last_change":"2024-04-02T07:28:53.538569+0000","last_active":"2024-04-02T07:28:55.587731+0000","last_peered":"2024-04-02T07:28:55.587731+0000","last_clean":"2024-04-02T07:28:55.587731+0000","last_became_active":"2024-04-02T07:28:53.538318+0000","last_became_peered":"2024-04-02T07:28:53.538318+0000","last_unstale":"2024-04-02T07:28:55.587731+0000","last_undegraded":"2024-04-02T07:28:55.587731+0000","last_fullsized":"2024-04-02T07:28:55.587731+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:41:54.211173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.586200+0000","last_change":"2024-04-02T07:28:53.949669+0000","last_active":"2024-04-02T07:28:55.586200+0000","last_peered":"2024-04-02T07:28:55.586200+0000","last_clean":"2024-04-02T07:28:55.586200+0000","last_became_active":"2024-04-02T07:28:53.949098+0000","last_became_peered":"2024-04-02T07:28:53.949098+0000","last_unstale":"2024-04-02T07:28:55.586200+0000","last_undegraded":"2024-04-02T07:28:55.586200+0000","last_fullsized":"2024-04-02T07:28:55.586200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:11:04.966454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"86'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.940060+0000","last_change":"2024-04-02T07:28:53.547270+0000","last_active":"2024-04-02T07:28:54.940060+0000","last_peered":"2024-04-02T07:28:54.940060+0000","last_clean":"2024-04-02T07:28:54.940060+0000","last_became_active":"2024-04-02T07:28:53.546989+0000","last_became_peered":"2024-04-02T07:28:53.546989+0000","last_unstale":"2024-04-02T07:28:54.940060+0000","last_undegraded":"2024-04-02T07:28:54.940060+0000","last_fullsized":"2024-04-02T07:28:54.940060+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:12:32.470450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":224,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-02T07:28:53.930173+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:28:53.930173+0000","last_peered":"2024-04-02T07:28:53.930173+0000","last_clean":"2024-04-02T07:28:53.930173+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:28:53.930173+0000","last_undegraded":"2024-04-02T07:28:53.930173+0000","last_fullsized":"2024-04-02T07:28:53.930173+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574932,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32744,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339096,"statfs":{"total":96636764160,"available":96603234304,"internally_reserved":0,"allocated":1667072,"data_stored":1047496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:28:16 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.47499999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88900000000000001,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.433},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66900000000000004,"15min":0.61799999999999999},"min":{"1min":0.45800000000000002,"5min":0.40699999999999997,"15min":0.39900000000000002},"max":{"1min":0.90200000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.53100000000000003}]},{"osd":1,"last update":"Tue Apr 2 07:28:16 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.67000000000000004,"15min":0.63800000000000001},"min":{"1min":0.59099999999999997,"5min":0.432,"15min":0.379},"max":{"1min":0.85299999999999998,"5min":0.95999999999999996,"15min":1.0289999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68999999999999995,"15min":0.66300000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.877,"5min":0.95899999999999996,"15min":1.113},"last":0.55400000000000005}]},{"osd":2,"last update":"Tue Apr 2 07:28:16 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.755,"15min":0.753},"min":{"1min":0.66700000000000004,"5min":0.52800000000000002,"15min":0.435},"max":{"1min":0.92300000000000004,"5min":1.0149999999999999,"15min":1.139},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.56499999999999995,"5min":0.437,"15min":0.437},"max":{"1min":0.91500000000000004,"5min":0.96499999999999997,"15min":1.522},"last":0.503}]},{"osd":3,"last update":"Tue Apr 2 07:28:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.57799999999999996,"5min":0.46800000000000003,"15min":0.41999999999999998},"max":{"1min":0.85799999999999998,"5min":1.0369999999999999,"15min":1.405},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.58499999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92600000000000005,"5min":0.98099999999999998,"15min":1.0580000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Tue Apr 2 07:28:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60599999999999998,"15min":0.67600000000000005},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.88900000000000001,"5min":0.92500000000000004,"15min":1.633},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67000000000000004,"15min":0.72799999999999998},"min":{"1min":0.51900000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82499999999999996,"5min":0.93600000000000005,"15min":1.079},"last":0.69899999999999995}]},{"osd":5,"last update":"Tue Apr 2 07:28:16 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64200000000000002,"15min":0.71399999999999997},"min":{"1min":0.45800000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.92200000000000004,"5min":0.996,"15min":1.2250000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70399999999999996,"15min":0.77200000000000002},"min":{"1min":0.47899999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98799999999999999,"5min":1.0049999999999999,"15min":1.5609999999999999},"last":0.56899999999999995}]},{"osd":6,"last update":"Tue Apr 2 07:28:16 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65700000000000003,"15min":0.72199999999999998},"min":{"1min":0.51100000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93999999999999995,"5min":0.97199999999999998,"15min":1.5960000000000001},"last":0.629},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.64000000000000001,"15min":0.69599999999999995},"min":{"1min":0.45800000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.72499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574933,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1069056,"data_stored":451452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.68100000000000005,"15min":0.66900000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.995,"5min":0.995,"15min":1.399},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.69299999999999995,"15min":0.85699999999999998},"min":{"1min":0.47599999999999998,"5min":0.44800000000000001,"15min":0.39400000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":5.7569999999999997},"last":0.66200000000000003}]},{"osd":1,"last update":"Tue Apr 2 07:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.47999999999999998,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.95},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.72099999999999997,"15min":0.72999999999999998},"min":{"1min":0.58699999999999997,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90500000000000003,"5min":1.004,"15min":1.248},"last":0.69099999999999995}]},{"osd":2,"last update":"Tue Apr 2 07:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.68000000000000005,"15min":0.69299999999999995},"min":{"1min":0.503,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90500000000000003,"5min":1.0249999999999999,"15min":1.226},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.72899999999999998,"15min":0.71599999999999997},"min":{"1min":0.502,"5min":0.47499999999999998,"15min":0.46500000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.64200000000000002}]},{"osd":3,"last update":"Tue Apr 2 07:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.72599999999999998,"15min":0.79700000000000004},"min":{"1min":0.54500000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":2.3119999999999998},"last":0.625},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.72399999999999998,"15min":0.78500000000000003},"min":{"1min":0.56100000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.018,"5min":1.018,"15min":2.6389999999999998},"last":0.53900000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61299999999999999,"15min":0.65500000000000003},"min":{"1min":0.36099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76700000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.437},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63,"15min":0.66000000000000003},"min":{"1min":0.41399999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80700000000000005,"5min":0.91000000000000003,"15min":0.96999999999999997},"last":0.57599999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60799999999999998,"15min":0.66400000000000003},"min":{"1min":0.41899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.95999999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67800000000000005,"15min":0.71999999999999997},"min":{"1min":0.44700000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92200000000000004,"5min":0.98999999999999999,"15min":1.0529999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Tue Apr 2 07:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.68300000000000005,"15min":0.73199999999999998},"min":{"1min":0.48099999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86499999999999999,"5min":0.93400000000000005,"15min":1.0209999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69099999999999995,"15min":0.73599999999999999},"min":{"1min":0.51100000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88100000000000001,"5min":0.97099999999999997,"15min":0.999},"last":0.60599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574933,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1085440,"data_stored":458644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:28:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68000000000000005,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.25},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.69599999999999995,"15min":0.70499999999999996},"min":{"1min":0.57599999999999996,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.5289999999999999},"last":0.69599999999999995}]},{"osd":1,"last update":"Tue Apr 2 07:28:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.71899999999999997,"15min":0.69899999999999995},"min":{"1min":0.54800000000000004,"5min":0.371,"15min":0.371},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.1830000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.60999999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0169999999999999,"5min":1.026,"15min":1.3420000000000001},"last":0.74099999999999999}]},{"osd":2,"last update":"Tue Apr 2 07:28:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.76700000000000002,"15min":0.81699999999999995},"min":{"1min":0.72199999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.8280000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.70099999999999996,"15min":0.73799999999999999},"min":{"1min":0.436,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.696},"last":0.71399999999999997}]},{"osd":3,"last update":"Tue Apr 2 07:28:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71599999999999997,"15min":0.75800000000000001},"min":{"1min":0.497,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96099999999999997,"5min":0.99099999999999999,"15min":1.6399999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.72999999999999998,"15min":0.81000000000000005},"min":{"1min":0.64100000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.98799999999999999,"5min":0.998,"15min":2.0219999999999998},"last":0.505}]},{"osd":4,"last update":"Tue Apr 2 07:28:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56699999999999995,"15min":0.69199999999999995},"min":{"1min":0.46200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79200000000000004,"5min":0.90500000000000003,"15min":1.911},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61499999999999999,"15min":0.75600000000000001},"min":{"1min":0.47699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.88200000000000001,"5min":0.92400000000000004,"15min":1.7829999999999999},"last":0.53900000000000003}]},{"osd":6,"last update":"Tue Apr 2 07:28:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63400000000000001,"15min":0.81799999999999995},"min":{"1min":0.46600000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81799999999999995,"5min":0.95799999999999996,"15min":2.1829999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63,"15min":0.80600000000000005},"min":{"1min":0.51600000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86399999999999999,"5min":1.0269999999999999,"15min":2.1280000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:28:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68500000000000005,"15min":0.83499999999999996},"min":{"1min":0.501,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91800000000000004,"5min":1.038,"15min":1.887},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.70499999999999996,"15min":0.879},"min":{"1min":0.60299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.90500000000000003,"5min":1.012,"15min":2.2599999999999998},"last":0.66800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":1056768,"data_stored":450758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:28:23 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67400000000000004,"15min":0.73499999999999999},"min":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.85099999999999998,"5min":1.014,"15min":2.4929999999999999},"last":0.505},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.67100000000000004,"15min":0.80000000000000004},"min":{"1min":0.51100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91700000000000004,"5min":0.94899999999999995,"15min":3.2519999999999998},"last":0.52500000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:28:23 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70599999999999996,"15min":0.751},"min":{"1min":0.58699999999999997,"5min":0.499,"15min":0.44400000000000001},"max":{"1min":0.86699999999999999,"5min":1.042,"15min":1.4279999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71399999999999997,"15min":0.878},"min":{"1min":0.51900000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88300000000000001,"5min":0.97399999999999998,"15min":4.3810000000000002},"last":0.59499999999999997}]},{"osd":2,"last update":"Tue Apr 2 07:28:23 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73899999999999999,"15min":0.79300000000000004},"min":{"1min":0.55700000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.93200000000000005,"5min":0.995,"15min":2.056},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72799999999999998,"15min":0.85199999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89700000000000002,"5min":1.109,"15min":3.3420000000000001},"last":0.65900000000000003}]},{"osd":3,"last update":"Tue Apr 2 07:28:23 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.755,"15min":0.95499999999999996},"min":{"1min":0.48199999999999998,"5min":0.436,"15min":0.436},"max":{"1min":1.054,"5min":1.054,"15min":3.9180000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.76200000000000001,"15min":0.96799999999999997},"min":{"1min":0.60999999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0680000000000001,"5min":1.0920000000000001,"15min":3.9750000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Tue Apr 2 07:28:23 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.61899999999999999,"15min":0.69099999999999995},"min":{"1min":0.41899999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78200000000000003,"5min":1.0389999999999999,"15min":1.2509999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.64300000000000002,"15min":0.72799999999999998},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.69199999999999995,"5min":1.0640000000000001,"15min":1.4419999999999999},"last":0.71199999999999997}]},{"osd":6,"last update":"Tue Apr 2 07:28:23 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.629,"15min":0.69699999999999995},"min":{"1min":0.439,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83999999999999997,"5min":1.123,"15min":1.2949999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.68799999999999994,"15min":0.75900000000000001},"min":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82599999999999996,"5min":1.097,"15min":1.3069999999999999},"last":0.746}]},{"osd":7,"last update":"Tue Apr 2 07:28:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.71599999999999997,"15min":0.78200000000000003},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.873,"5min":1.1060000000000001,"15min":1.2689999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.78800000000000003,"15min":0.85199999999999998},"min":{"1min":0.53100000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.89300000000000002,"5min":1.1499999999999999,"15min":1.353},"last":0.83199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574933,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1081344,"data_stored":458622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.42999999999999999,"15min":0.44800000000000001},"min":{"1min":0.28699999999999998,"5min":0.26600000000000001,"15min":0.26300000000000001},"max":{"1min":0.621,"5min":0.623,"15min":0.623},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.311,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":1.0109999999999999},"last":0.46400000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.45200000000000001,"15min":0.44},"min":{"1min":0.32400000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.56100000000000005,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.377},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.371,"5min":0.309,"15min":0.309},"max":{"1min":0.71099999999999997,"5min":0.77500000000000002,"15min":0.79700000000000004},"last":0.54700000000000004}]},{"osd":2,"last update":"Tue Apr 2 07:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55500000000000005,"15min":0.53500000000000003},"min":{"1min":0.44600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.754,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.58599999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84399999999999997,"5min":0.93700000000000006,"15min":1.306},"last":0.60199999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71499999999999997,"15min":0.749},"min":{"1min":0.56499999999999995,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.1850000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.74199999999999999,"15min":0.754},"min":{"1min":0.56999999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.155},"last":0.75800000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.77400000000000002,"15min":0.77600000000000002},"min":{"1min":0.66800000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.0389999999999999,"5min":1.198,"15min":1.198},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.755,"15min":0.748},"min":{"1min":0.63600000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.135},"last":0.85299999999999998}]},{"osd":6,"last update":"Tue Apr 2 07:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.76600000000000001},"min":{"1min":0.55600000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0169999999999999,"5min":1.1060000000000001,"15min":1.25},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79000000000000004,"15min":0.78400000000000003},"min":{"1min":0.61299999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.034,"5min":1.1379999999999999,"15min":1.2010000000000001},"last":0.97299999999999998}]},{"osd":7,"last update":"Tue Apr 2 07:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0209999999999999,"5min":1.1319999999999999,"15min":1.216},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.78000000000000003,"15min":0.79300000000000004},"min":{"1min":0.57399999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.073,"5min":1.077,"15min":1.2869999999999999},"last":0.89300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1073152,"data_stored":457640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:28:22 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.435,"15min":0.44800000000000001},"min":{"1min":0.32600000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.54600000000000004,"5min":0.747,"15min":0.79100000000000004},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.5,"15min":0.48999999999999999},"min":{"1min":0.32000000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.70699999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.40899999999999997}]},{"osd":1,"last update":"Tue Apr 2 07:28:22 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52700000000000002,"15min":0.54300000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67500000000000004,"5min":0.80800000000000005,"15min":1.171},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.496,"15min":0.495},"min":{"1min":0.37,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.63600000000000001,"5min":0.74299999999999999,"15min":1.333},"last":0.438}]},{"osd":3,"last update":"Tue Apr 2 07:28:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53300000000000003,"15min":0.51900000000000002},"min":{"1min":0.46800000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68200000000000005,"5min":0.80000000000000004,"15min":0.86299999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.42199999999999999,"5min":0.39900000000000002,"15min":0.39800000000000002},"max":{"1min":0.72399999999999998,"5min":0.83099999999999996,"15min":1.1140000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Apr 2 07:28:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76300000000000001,"15min":0.77400000000000002},"min":{"1min":0.51100000000000001,"5min":0.47699999999999998,"15min":0.47199999999999998},"max":{"1min":1.0740000000000001,"5min":1.5309999999999999,"15min":2.254},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.78600000000000003,"15min":0.77300000000000002},"min":{"1min":0.59599999999999997,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0669999999999999,"5min":1.2210000000000001,"15min":1.3420000000000001},"last":0.80600000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:28:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77200000000000002,"15min":0.76300000000000001},"min":{"1min":0.63700000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98899999999999999,"5min":1.2629999999999999,"15min":1.3740000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.54900000000000004,"5min":0.443,"15min":0.443},"max":{"1min":0.96299999999999997,"5min":1.3149999999999999,"15min":2.0840000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Tue Apr 2 07:28:22 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.67500000000000004,"5min":0.60499999999999998,"15min":0.57099999999999995},"max":{"1min":1.0700000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.83299999999999996,"15min":0.82799999999999996},"min":{"1min":0.64000000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.087,"5min":1.425,"15min":1.425},"last":0.91500000000000004}]},{"osd":7,"last update":"Tue Apr 2 07:28:22 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.80300000000000005,"15min":0.83299999999999996},"min":{"1min":0.65300000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0189999999999999,"5min":1.4750000000000001,"15min":2.3580000000000001},"last":0.88},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.75900000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0029999999999999,"5min":1.377,"15min":1.377},"last":0.82599999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1081344,"data_stored":457252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.42999999999999999,"15min":0.47299999999999998},"min":{"1min":0.29599999999999999,"5min":0.254,"15min":0.251},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":1.2150000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.499,"15min":0.623},"min":{"1min":0.34799999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57599999999999996,"5min":1.093,"15min":4.157},"last":0.33900000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46200000000000002,"15min":0.628},"min":{"1min":0.33100000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69799999999999995,"5min":0.70099999999999996,"15min":4.282},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52100000000000002,"15min":0.59099999999999997},"min":{"1min":0.36299999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68300000000000005,"5min":0.79500000000000004,"15min":1.625},"last":0.503}]},{"osd":3,"last update":"Tue Apr 2 07:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57899999999999996,"15min":0.60799999999999998},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83199999999999996,"5min":0.97299999999999998,"15min":1.1120000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54100000000000004,"15min":0.84899999999999998},"min":{"1min":0.435,"5min":0.36299999999999999,"15min":0.35999999999999999},"max":{"1min":0.80200000000000005,"5min":1.052,"15min":8.1620000000000008},"last":0.57599999999999996}]},{"osd":4,"last update":"Tue Apr 2 07:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73499999999999999,"15min":0.92900000000000005},"min":{"1min":0.50800000000000001,"5min":0.46800000000000003,"15min":0.40000000000000002},"max":{"1min":1.0329999999999999,"5min":1.105,"15min":4.7400000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.755,"15min":0.81599999999999995},"min":{"1min":0.55100000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97099999999999997,"5min":0.996,"15min":1.7070000000000001},"last":0.63500000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77000000000000002,"15min":0.91900000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.497},"max":{"1min":1.018,"5min":1.163,"15min":4.5759999999999996},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76200000000000001,"15min":0.92200000000000004},"min":{"1min":0.52000000000000002,"5min":0.48999999999999999,"15min":0.47999999999999998},"max":{"1min":1,"5min":1.1539999999999999,"15min":4.7949999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Tue Apr 2 07:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.77000000000000002,"15min":0.96199999999999997},"min":{"1min":0.52800000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97999999999999998,"5min":1.129,"15min":4.6890000000000001},"last":0.621},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.94099999999999995},"min":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0589999999999999,"5min":1.0720000000000001,"15min":4.6059999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77200000000000002,"15min":0.82799999999999996},"min":{"1min":0.59699999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1200000000000001,"5min":1.137,"15min":1.8759999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79800000000000004,"15min":0.94999999999999996},"min":{"1min":0.59499999999999997,"5min":0.55800000000000005,"15min":0.5},"max":{"1min":1.0509999999999999,"5min":1.383,"15min":4.6420000000000003},"last":0.73699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32752,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339088,"statfs":{"total":96636764160,"available":96603226112,"internally_reserved":0,"allocated":1667072,"data_stored":1047460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.42199999999999999,"15min":0.46600000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.47899999999999998,"5min":0.71699999999999997,"15min":1.48},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.502,"15min":0.50800000000000001},"min":{"1min":0.39100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.63800000000000001,"5min":0.76800000000000002,"15min":1.2330000000000001},"last":0.48999999999999999}]},{"osd":2,"last update":"Tue Apr 2 07:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.496,"15min":0.52000000000000002},"min":{"1min":0.313,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.57799999999999996,"5min":0.79100000000000004,"15min":1.3129999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.42299999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68200000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54400000000000004}]},{"osd":3,"last update":"Tue Apr 2 07:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73899999999999999,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.441},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57699999999999996,"15min":0.61699999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40300000000000002},"max":{"1min":0.76300000000000001,"5min":0.98099999999999998,"15min":1.4430000000000001},"last":0.51600000000000001}]},{"osd":4,"last update":"Tue Apr 2 07:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.74399999999999999,"15min":0.73499999999999999},"min":{"1min":0.53400000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96899999999999997,"5min":1.036,"15min":1.0569999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.56699999999999995,"5min":0.51400000000000001,"15min":0.501},"max":{"1min":1.0840000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.752}]},{"osd":5,"last update":"Tue Apr 2 07:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.754,"15min":0.78700000000000003},"min":{"1min":0.54400000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.371},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.55800000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1000000000000001,"5min":1.143,"15min":1.143},"last":0.85799999999999998}]},{"osd":6,"last update":"Tue Apr 2 07:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.78600000000000003,"15min":0.80000000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.80200000000000005,"15min":0.83799999999999997},"min":{"1min":0.66200000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.1839999999999999,"15min":1.4099999999999999},"last":0.82799999999999996}]},{"osd":7,"last update":"Tue Apr 2 07:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77600000000000002,"15min":0.79500000000000004},"min":{"1min":0.59099999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.046,"5min":1.069,"15min":1.135},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.77500000000000002,"15min":0.78800000000000003},"min":{"1min":0.68799999999999994,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.079,"5min":1.1279999999999999,"15min":1.141},"last":0.78700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:28:58.058 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:28:58.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.235+0000 7f662da00640 1 Processor -- start 2024-04-02T07:28:58.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f662da00640 1 -- start start 2024-04-02T07:28:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f662da00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6628159480 0x7f662815d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f662da00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66280cc030 0x7f66280afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f662da00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f662815dec0 con 0x7f662806d960 2024-04-02T07:28:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f662da00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66280b35e0 con 0x7f6628159480 2024-04-02T07:28:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f662da00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66280b2470 con 0x7f66280cc030 2024-04-02T07:28:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f662d000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f662806d960 0x7f662806c0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37202/0 (socket says 172.21.15.55:37202) 2024-04-02T07:28:58.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f662d000640 1 -- 172.21.15.55:0/884434098 learned_addr learned my addr 172.21.15.55:0/884434098 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f6627e00640 1 --2- 172.21.15.55:0/884434098 >> v2:172.21.15.106:3300/0 conn(0x7f6628159480 0x7f662815d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f661f400640 1 --2- 172.21.15.55:0/884434098 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66280cc030 0x7f66280afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f6627400640 1 -- 172.21.15.55:0/884434098 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1477556424 0 0) 0x7f66200014a0 con 0x7f662806d960 2024-04-02T07:28:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f6627400640 1 -- 172.21.15.55:0/884434098 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f660c003530 con 0x7f662806d960 2024-04-02T07:28:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f6627400640 1 -- 172.21.15.55:0/884434098 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1257966090 0 0) 0x7f660c003530 con 0x7f662806d960 2024-04-02T07:28:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f6627400640 1 -- 172.21.15.55:0/884434098 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66280cc030 msgr2=0x7f66280afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:58.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f6627400640 1 --2- 172.21.15.55:0/884434098 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66280cc030 0x7f66280afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f6627400640 1 -- 172.21.15.55:0/884434098 >> v2:172.21.15.106:3300/0 conn(0x7f6628159480 msgr2=0x7f662815d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f6627400640 1 --2- 172.21.15.55:0/884434098 >> v2:172.21.15.106:3300/0 conn(0x7f6628159480 0x7f662815d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f6627400640 1 -- 172.21.15.55:0/884434098 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6628159860 con 0x7f662806d960 2024-04-02T07:28:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f6627400640 1 -- 172.21.15.55:0/884434098 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f6620001b90 con 0x7f662806d960 2024-04-02T07:28:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f6627400640 1 -- 172.21.15.55:0/884434098 >> v1:172.21.15.55:6789/0 conn(0x7f662806d960 legacy=0x7f662806c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f6627400640 1 --2- 172.21.15.55:0/884434098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f660c003980 0x7f660c003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f6627400640 1 --2- 172.21.15.55:0/884434098 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66280cc030 0x7f660c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f6627400640 1 --2- 172.21.15.55:0/884434098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f660c004d10 0x7f660c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f6627400640 1 -- 172.21.15.55:0/884434098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66280b35e0 con 0x7f660c004d10 2024-04-02T07:28:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f6627400640 1 -- 172.21.15.55:0/884434098 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66280b2470 con 0x7f660c003980 2024-04-02T07:28:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f6627400640 1 -- 172.21.15.55:0/884434098 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660c00b990 con 0x7f66280cc030 2024-04-02T07:28:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f662d000640 1 --2- 172.21.15.55:0/884434098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f660c004d10 0x7f660c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f6627e00640 1 --2- 172.21.15.55:0/884434098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f660c003980 0x7f660c003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f661f400640 1 --2- 172.21.15.55:0/884434098 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66280cc030 0x7f660c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:58.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f662d000640 1 -- 172.21.15.55:0/884434098 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66280cc030 msgr2=0x7f660c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:58.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f662d000640 1 --2- 172.21.15.55:0/884434098 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66280cc030 0x7f660c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f662d000640 1 -- 172.21.15.55:0/884434098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f660c003980 msgr2=0x7f660c003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:58.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f662d000640 1 --2- 172.21.15.55:0/884434098 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f660c003980 0x7f660c003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.239+0000 7f662d000640 1 -- 172.21.15.55:0/884434098 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f660c003530 con 0x7f660c004d10 2024-04-02T07:28:58.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.243+0000 7f662d000640 1 --2- 172.21.15.55:0/884434098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f660c004d10 0x7f660c005190 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f662000a840 tx=0x7f662001fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f8d03af67abb45 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:58.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.243+0000 7f6627400640 1 -- 172.21.15.55:0/884434098 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66200aa6f0 con 0x7f660c004d10 2024-04-02T07:28:58.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.243+0000 7f6627400640 1 -- 172.21.15.55:0/884434098 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66200aa850 con 0x7f660c004d10 2024-04-02T07:28:58.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.243+0000 7f6627400640 1 -- 172.21.15.55:0/884434098 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66200aac20 con 0x7f660c004d10 2024-04-02T07:28:58.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.243+0000 7f662da00640 1 -- 172.21.15.55:0/884434098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f660c004d10 msgr2=0x7f660c005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:58.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.243+0000 7f662da00640 1 --2- 172.21.15.55:0/884434098 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f660c004d10 0x7f660c005190 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f662000a840 tx=0x7f662001fac0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.243+0000 7f662d000640 1 -- 172.21.15.55:0/884434098 reap_dead start 2024-04-02T07:28:58.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.243+0000 7f662da00640 1 -- 172.21.15.55:0/884434098 shutdown_connections 2024-04-02T07:28:58.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.243+0000 7f662da00640 1 -- 172.21.15.55:0/884434098 >> 172.21.15.55:0/884434098 conn(0x7f6628066080 msgr2=0x7f6628069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:58.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.243+0000 7f662da00640 1 -- 172.21.15.55:0/884434098 shutdown_connections 2024-04-02T07:28:58.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.243+0000 7f662da00640 1 -- 172.21.15.55:0/884434098 wait complete. 2024-04-02T07:28:58.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f662da00640 1 Processor -- start 2024-04-02T07:28:58.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f662da00640 1 -- start start 2024-04-02T07:28:58.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f662da00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f660c004d10 0x7f6628149ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:58.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f662da00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66280ab880 0x7f662815c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:58.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f662da00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66280700e0 0x7f6628070590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f662da00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6628070ad0 con 0x7f66280700e0 2024-04-02T07:28:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f662da00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66280abd80 con 0x7f66280ab880 2024-04-02T07:28:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f662da00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66280ac060 con 0x7f660c004d10 2024-04-02T07:28:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f662d000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66280700e0 0x7f6628070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f662d000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66280700e0 0x7f6628070590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51406/0 (socket says 172.21.15.55:51406) 2024-04-02T07:28:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f662d000640 1 -- 172.21.15.55:0/50488146 learned_addr learned my addr 172.21.15.55:0/50488146 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f6627e00640 1 --2- 172.21.15.55:0/50488146 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f660c004d10 0x7f6628149ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f661f400640 1 --2- 172.21.15.55:0/50488146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66280ab880 0x7f662815c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f662d000640 1 -- 172.21.15.55:0/50488146 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f660c004d10 msgr2=0x7f6628149ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f662d000640 1 --2- 172.21.15.55:0/50488146 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f660c004d10 0x7f6628149ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f662d000640 1 -- 172.21.15.55:0/50488146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66280ab880 msgr2=0x7f662815c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f662d000640 1 --2- 172.21.15.55:0/50488146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66280ab880 0x7f662815c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f662d000640 1 -- 172.21.15.55:0/50488146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66280ac340 con 0x7f66280700e0 2024-04-02T07:28:58.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f662d000640 1 --2- 172.21.15.55:0/50488146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66280700e0 0x7f6628070590 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f662000a840 tx=0x7f660c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:58.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f6624c00640 1 -- 172.21.15.55:0/50488146 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66200014a0 con 0x7f66280700e0 2024-04-02T07:28:58.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f6624c00640 1 -- 172.21.15.55:0/50488146 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66200aa4f0 con 0x7f66280700e0 2024-04-02T07:28:58.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f662da00640 1 -- 172.21.15.55:0/50488146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66280ac620 con 0x7f66280700e0 2024-04-02T07:28:58.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f6624c00640 1 -- 172.21.15.55:0/50488146 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6620001b50 con 0x7f66280700e0 2024-04-02T07:28:58.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f662da00640 1 -- 172.21.15.55:0/50488146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f662815c710 con 0x7f66280700e0 2024-04-02T07:28:58.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.247+0000 7f662da00640 1 -- 172.21.15.55:0/50488146 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6628070ad0 con 0x7f66280700e0 2024-04-02T07:28:58.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.251+0000 7f6624c00640 1 -- 172.21.15.55:0/50488146 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6620004b70 con 0x7f66280700e0 2024-04-02T07:28:58.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.251+0000 7f6624c00640 1 --2- 172.21.15.55:0/50488146 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f66040666c0 0x7f6604068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:58.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.251+0000 7f6624c00640 1 -- 172.21.15.55:0/50488146 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6620121410 con 0x7f66280700e0 2024-04-02T07:28:58.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.251+0000 7f6627e00640 1 --2- 172.21.15.55:0/50488146 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f66040666c0 0x7f6604068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:58.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.251+0000 7f6627e00640 1 --2- 172.21.15.55:0/50488146 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f66040666c0 0x7f6604068b80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6618009be0 tx=0x7f6618009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:58.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.255+0000 7f6624c00640 1 -- 172.21.15.55:0/50488146 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6628070ad0 con 0x7f66280700e0 2024-04-02T07:28:58.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.415+0000 7f662da00640 1 -- 172.21.15.55:0/50488146 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f66280b2f90 con 0x7f66040666c0 2024-04-02T07:28:58.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.423+0000 7f6624c00640 1 -- 172.21.15.55:0/50488146 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289086 (secure 0 0 0) 0x7f6618019070 con 0x7f66040666c0 2024-04-02T07:28:58.428 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:58.429 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:28:58.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.427+0000 7f662da00640 1 -- 172.21.15.55:0/50488146 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f66040666c0 msgr2=0x7f6604068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:58.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.427+0000 7f662da00640 1 --2- 172.21.15.55:0/50488146 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f66040666c0 0x7f6604068b80 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f6618009be0 tx=0x7f6618009190 comp rx=0 tx=0).stop 2024-04-02T07:28:58.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.427+0000 7f662da00640 1 -- 172.21.15.55:0/50488146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66280700e0 msgr2=0x7f6628070590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:58.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.427+0000 7f662da00640 1 --2- 172.21.15.55:0/50488146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66280700e0 0x7f6628070590 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f662000a840 tx=0x7f660c005800 comp rx=0 tx=0).stop 2024-04-02T07:28:58.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.427+0000 7f662da00640 1 -- 172.21.15.55:0/50488146 shutdown_connections 2024-04-02T07:28:58.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.427+0000 7f662da00640 1 --2- 172.21.15.55:0/50488146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66280700e0 0x7f6628070590 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.427+0000 7f662da00640 1 --2- 172.21.15.55:0/50488146 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f66040666c0 0x7f6604068b80 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.427+0000 7f662da00640 1 --2- 172.21.15.55:0/50488146 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66280ab880 0x7f662815c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.427+0000 7f662da00640 1 --2- 172.21.15.55:0/50488146 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f660c004d10 0x7f6628149ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.427+0000 7f662da00640 1 -- 172.21.15.55:0/50488146 >> 172.21.15.55:0/50488146 conn(0x7f6628066080 msgr2=0x7f6628152c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:58.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.427+0000 7f662da00640 1 -- 172.21.15.55:0/50488146 shutdown_connections 2024-04-02T07:28:58.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.427+0000 7f662da00640 1 -- 172.21.15.55:0/50488146 wait complete. 2024-04-02T07:28:58.448 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":285,"stamp":"2024-04-02T07:28:56.431507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":258528,"kb_used_data":9552,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754716192,"statfs":{"total":773094113280,"available":772829380608,"internally_reserved":0,"allocated":9781248,"data_stored":4829324,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":45,"apply_latency_ms":45,"commit_latency_ns":45000000,"apply_latency_ns":45000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000966"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588844+0000","last_change":"2024-04-02T07:28:53.956384+0000","last_active":"2024-04-02T07:28:55.588844+0000","last_peered":"2024-04-02T07:28:55.588844+0000","last_clean":"2024-04-02T07:28:55.588844+0000","last_became_active":"2024-04-02T07:28:53.956124+0000","last_became_peered":"2024-04-02T07:28:53.956124+0000","last_unstale":"2024-04-02T07:28:55.588844+0000","last_undegraded":"2024-04-02T07:28:55.588844+0000","last_fullsized":"2024-04-02T07:28:55.588844+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:47:06.026050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585941+0000","last_change":"2024-04-02T07:28:53.948860+0000","last_active":"2024-04-02T07:28:55.585941+0000","last_peered":"2024-04-02T07:28:55.585941+0000","last_clean":"2024-04-02T07:28:55.585941+0000","last_became_active":"2024-04-02T07:28:53.948532+0000","last_became_peered":"2024-04-02T07:28:53.948532+0000","last_unstale":"2024-04-02T07:28:55.585941+0000","last_undegraded":"2024-04-02T07:28:55.585941+0000","last_fullsized":"2024-04-02T07:28:55.585941+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:20:14.796287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.939948+0000","last_change":"2024-04-02T07:28:53.949315+0000","last_active":"2024-04-02T07:28:54.939948+0000","last_peered":"2024-04-02T07:28:54.939948+0000","last_clean":"2024-04-02T07:28:54.939948+0000","last_became_active":"2024-04-02T07:28:53.948458+0000","last_became_peered":"2024-04-02T07:28:53.948458+0000","last_unstale":"2024-04-02T07:28:54.939948+0000","last_undegraded":"2024-04-02T07:28:54.939948+0000","last_fullsized":"2024-04-02T07:28:54.939948+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:01:35.070038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585647+0000","last_change":"2024-04-02T07:28:53.950237+0000","last_active":"2024-04-02T07:28:55.585647+0000","last_peered":"2024-04-02T07:28:55.585647+0000","last_clean":"2024-04-02T07:28:55.585647+0000","last_became_active":"2024-04-02T07:28:53.949973+0000","last_became_peered":"2024-04-02T07:28:53.949973+0000","last_unstale":"2024-04-02T07:28:55.585647+0000","last_undegraded":"2024-04-02T07:28:55.585647+0000","last_fullsized":"2024-04-02T07:28:55.585647+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:57:45.518810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587939+0000","last_change":"2024-04-02T07:28:53.952907+0000","last_active":"2024-04-02T07:28:55.587939+0000","last_peered":"2024-04-02T07:28:55.587939+0000","last_clean":"2024-04-02T07:28:55.587939+0000","last_became_active":"2024-04-02T07:28:53.951263+0000","last_became_peered":"2024-04-02T07:28:53.951263+0000","last_unstale":"2024-04-02T07:28:55.587939+0000","last_undegraded":"2024-04-02T07:28:55.587939+0000","last_fullsized":"2024-04-02T07:28:55.587939+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:25:07.617763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587523+0000","last_change":"2024-04-02T07:28:53.955235+0000","last_active":"2024-04-02T07:28:55.587523+0000","last_peered":"2024-04-02T07:28:55.587523+0000","last_clean":"2024-04-02T07:28:55.587523+0000","last_became_active":"2024-04-02T07:28:53.954958+0000","last_became_peered":"2024-04-02T07:28:53.954958+0000","last_unstale":"2024-04-02T07:28:55.587523+0000","last_undegraded":"2024-04-02T07:28:55.587523+0000","last_fullsized":"2024-04-02T07:28:55.587523+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:29:17.610586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585360+0000","last_change":"2024-04-02T07:28:53.941580+0000","last_active":"2024-04-02T07:28:55.585360+0000","last_peered":"2024-04-02T07:28:55.585360+0000","last_clean":"2024-04-02T07:28:55.585360+0000","last_became_active":"2024-04-02T07:28:53.941318+0000","last_became_peered":"2024-04-02T07:28:53.941318+0000","last_unstale":"2024-04-02T07:28:55.585360+0000","last_undegraded":"2024-04-02T07:28:55.585360+0000","last_fullsized":"2024-04-02T07:28:55.585360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:58:13.516048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587281+0000","last_change":"2024-04-02T07:28:53.953416+0000","last_active":"2024-04-02T07:28:55.587281+0000","last_peered":"2024-04-02T07:28:55.587281+0000","last_clean":"2024-04-02T07:28:55.587281+0000","last_became_active":"2024-04-02T07:28:53.951634+0000","last_became_peered":"2024-04-02T07:28:53.951634+0000","last_unstale":"2024-04-02T07:28:55.587281+0000","last_undegraded":"2024-04-02T07:28:55.587281+0000","last_fullsized":"2024-04-02T07:28:55.587281+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:43:49.169530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587597+0000","last_change":"2024-04-02T07:28:53.955381+0000","last_active":"2024-04-02T07:28:55.587597+0000","last_peered":"2024-04-02T07:28:55.587597+0000","last_clean":"2024-04-02T07:28:55.587597+0000","last_became_active":"2024-04-02T07:28:53.954656+0000","last_became_peered":"2024-04-02T07:28:53.954656+0000","last_unstale":"2024-04-02T07:28:55.587597+0000","last_undegraded":"2024-04-02T07:28:55.587597+0000","last_fullsized":"2024-04-02T07:28:55.587597+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:27:23.479295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588807+0000","last_change":"2024-04-02T07:28:53.948749+0000","last_active":"2024-04-02T07:28:55.588807+0000","last_peered":"2024-04-02T07:28:55.588807+0000","last_clean":"2024-04-02T07:28:55.588807+0000","last_became_active":"2024-04-02T07:28:53.947253+0000","last_became_peered":"2024-04-02T07:28:53.947253+0000","last_unstale":"2024-04-02T07:28:55.588807+0000","last_undegraded":"2024-04-02T07:28:55.588807+0000","last_fullsized":"2024-04-02T07:28:55.588807+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:10:07.465691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.586357+0000","last_change":"2024-04-02T07:28:53.949056+0000","last_active":"2024-04-02T07:28:55.586357+0000","last_peered":"2024-04-02T07:28:55.586357+0000","last_clean":"2024-04-02T07:28:55.586357+0000","last_became_active":"2024-04-02T07:28:53.948770+0000","last_became_peered":"2024-04-02T07:28:53.948770+0000","last_unstale":"2024-04-02T07:28:55.586357+0000","last_undegraded":"2024-04-02T07:28:55.586357+0000","last_fullsized":"2024-04-02T07:28:55.586357+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:15:39.736958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588404+0000","last_change":"2024-04-02T07:28:53.948272+0000","last_active":"2024-04-02T07:28:55.588404+0000","last_peered":"2024-04-02T07:28:55.588404+0000","last_clean":"2024-04-02T07:28:55.588404+0000","last_became_active":"2024-04-02T07:28:53.947990+0000","last_became_peered":"2024-04-02T07:28:53.947990+0000","last_unstale":"2024-04-02T07:28:55.588404+0000","last_undegraded":"2024-04-02T07:28:55.588404+0000","last_fullsized":"2024-04-02T07:28:55.588404+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:14:11.790856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.939824+0000","last_change":"2024-04-02T07:28:53.948251+0000","last_active":"2024-04-02T07:28:54.939824+0000","last_peered":"2024-04-02T07:28:54.939824+0000","last_clean":"2024-04-02T07:28:54.939824+0000","last_became_active":"2024-04-02T07:28:53.947993+0000","last_became_peered":"2024-04-02T07:28:53.947993+0000","last_unstale":"2024-04-02T07:28:54.939824+0000","last_undegraded":"2024-04-02T07:28:54.939824+0000","last_fullsized":"2024-04-02T07:28:54.939824+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:35:13.926325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585907+0000","last_change":"2024-04-02T07:28:53.944203+0000","last_active":"2024-04-02T07:28:55.585907+0000","last_peered":"2024-04-02T07:28:55.585907+0000","last_clean":"2024-04-02T07:28:55.585907+0000","last_became_active":"2024-04-02T07:28:53.942810+0000","last_became_peered":"2024-04-02T07:28:53.942810+0000","last_unstale":"2024-04-02T07:28:55.585907+0000","last_undegraded":"2024-04-02T07:28:55.585907+0000","last_fullsized":"2024-04-02T07:28:55.585907+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:15:39.193096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937660+0000","last_change":"2024-04-02T07:28:53.939938+0000","last_active":"2024-04-02T07:28:54.937660+0000","last_peered":"2024-04-02T07:28:54.937660+0000","last_clean":"2024-04-02T07:28:54.937660+0000","last_became_active":"2024-04-02T07:28:53.939699+0000","last_became_peered":"2024-04-02T07:28:53.939699+0000","last_unstale":"2024-04-02T07:28:54.937660+0000","last_undegraded":"2024-04-02T07:28:54.937660+0000","last_fullsized":"2024-04-02T07:28:54.937660+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:14:11.790856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587725+0000","last_change":"2024-04-02T07:28:53.946125+0000","last_active":"2024-04-02T07:28:55.587725+0000","last_peered":"2024-04-02T07:28:55.587725+0000","last_clean":"2024-04-02T07:28:55.587725+0000","last_became_active":"2024-04-02T07:28:53.945876+0000","last_became_peered":"2024-04-02T07:28:53.945876+0000","last_unstale":"2024-04-02T07:28:55.587725+0000","last_undegraded":"2024-04-02T07:28:55.587725+0000","last_fullsized":"2024-04-02T07:28:55.587725+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:01:08.080021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588223+0000","last_change":"2024-04-02T07:28:53.951000+0000","last_active":"2024-04-02T07:28:55.588223+0000","last_peered":"2024-04-02T07:28:55.588223+0000","last_clean":"2024-04-02T07:28:55.588223+0000","last_became_active":"2024-04-02T07:28:53.950702+0000","last_became_peered":"2024-04-02T07:28:53.950702+0000","last_unstale":"2024-04-02T07:28:55.588223+0000","last_undegraded":"2024-04-02T07:28:55.588223+0000","last_fullsized":"2024-04-02T07:28:55.588223+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:25:33.948360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.586066+0000","last_change":"2024-04-02T07:28:53.945040+0000","last_active":"2024-04-02T07:28:55.586066+0000","last_peered":"2024-04-02T07:28:55.586066+0000","last_clean":"2024-04-02T07:28:55.586066+0000","last_became_active":"2024-04-02T07:28:53.943593+0000","last_became_peered":"2024-04-02T07:28:53.943593+0000","last_unstale":"2024-04-02T07:28:55.586066+0000","last_undegraded":"2024-04-02T07:28:55.586066+0000","last_fullsized":"2024-04-02T07:28:55.586066+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:30:05.479404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937854+0000","last_change":"2024-04-02T07:28:53.945039+0000","last_active":"2024-04-02T07:28:54.937854+0000","last_peered":"2024-04-02T07:28:54.937854+0000","last_clean":"2024-04-02T07:28:54.937854+0000","last_became_active":"2024-04-02T07:28:53.944783+0000","last_became_peered":"2024-04-02T07:28:53.944783+0000","last_unstale":"2024-04-02T07:28:54.937854+0000","last_undegraded":"2024-04-02T07:28:54.937854+0000","last_fullsized":"2024-04-02T07:28:54.937854+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:10:07.465691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585741+0000","last_change":"2024-04-02T07:28:53.948048+0000","last_active":"2024-04-02T07:28:55.585741+0000","last_peered":"2024-04-02T07:28:55.585741+0000","last_clean":"2024-04-02T07:28:55.585741+0000","last_became_active":"2024-04-02T07:28:53.947792+0000","last_became_peered":"2024-04-02T07:28:53.947792+0000","last_unstale":"2024-04-02T07:28:55.585741+0000","last_undegraded":"2024-04-02T07:28:55.585741+0000","last_fullsized":"2024-04-02T07:28:55.585741+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:33:28.287915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585690+0000","last_change":"2024-04-02T07:28:53.942596+0000","last_active":"2024-04-02T07:28:55.585690+0000","last_peered":"2024-04-02T07:28:55.585690+0000","last_clean":"2024-04-02T07:28:55.585690+0000","last_became_active":"2024-04-02T07:28:53.942344+0000","last_became_peered":"2024-04-02T07:28:53.942344+0000","last_unstale":"2024-04-02T07:28:55.585690+0000","last_undegraded":"2024-04-02T07:28:55.585690+0000","last_fullsized":"2024-04-02T07:28:55.585690+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:23:17.051248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585920+0000","last_change":"2024-04-02T07:28:53.951093+0000","last_active":"2024-04-02T07:28:55.585920+0000","last_peered":"2024-04-02T07:28:55.585920+0000","last_clean":"2024-04-02T07:28:55.585920+0000","last_became_active":"2024-04-02T07:28:53.950817+0000","last_became_peered":"2024-04-02T07:28:53.950817+0000","last_unstale":"2024-04-02T07:28:55.585920+0000","last_undegraded":"2024-04-02T07:28:55.585920+0000","last_fullsized":"2024-04-02T07:28:55.585920+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:39:55.410899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588008+0000","last_change":"2024-04-02T07:28:53.952351+0000","last_active":"2024-04-02T07:28:55.588008+0000","last_peered":"2024-04-02T07:28:55.588008+0000","last_clean":"2024-04-02T07:28:55.588008+0000","last_became_active":"2024-04-02T07:28:53.952077+0000","last_became_peered":"2024-04-02T07:28:53.952077+0000","last_unstale":"2024-04-02T07:28:55.588008+0000","last_undegraded":"2024-04-02T07:28:55.588008+0000","last_fullsized":"2024-04-02T07:28:55.588008+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:05:33.069753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585368+0000","last_change":"2024-04-02T07:28:53.945360+0000","last_active":"2024-04-02T07:28:55.585368+0000","last_peered":"2024-04-02T07:28:55.585368+0000","last_clean":"2024-04-02T07:28:55.585368+0000","last_became_active":"2024-04-02T07:28:53.943647+0000","last_became_peered":"2024-04-02T07:28:53.943647+0000","last_unstale":"2024-04-02T07:28:55.585368+0000","last_undegraded":"2024-04-02T07:28:55.585368+0000","last_fullsized":"2024-04-02T07:28:55.585368+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:01:48.456338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.586115+0000","last_change":"2024-04-02T07:28:53.948575+0000","last_active":"2024-04-02T07:28:55.586115+0000","last_peered":"2024-04-02T07:28:55.586115+0000","last_clean":"2024-04-02T07:28:55.586115+0000","last_became_active":"2024-04-02T07:28:53.948313+0000","last_became_peered":"2024-04-02T07:28:53.948313+0000","last_unstale":"2024-04-02T07:28:55.586115+0000","last_undegraded":"2024-04-02T07:28:55.586115+0000","last_fullsized":"2024-04-02T07:28:55.586115+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:09:15.409516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.940063+0000","last_change":"2024-04-02T07:28:53.952187+0000","last_active":"2024-04-02T07:28:54.940063+0000","last_peered":"2024-04-02T07:28:54.940063+0000","last_clean":"2024-04-02T07:28:54.940063+0000","last_became_active":"2024-04-02T07:28:53.951901+0000","last_became_peered":"2024-04-02T07:28:53.951901+0000","last_unstale":"2024-04-02T07:28:54.940063+0000","last_undegraded":"2024-04-02T07:28:54.940063+0000","last_fullsized":"2024-04-02T07:28:54.940063+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:14:11.790856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588273+0000","last_change":"2024-04-02T07:28:53.945699+0000","last_active":"2024-04-02T07:28:55.588273+0000","last_peered":"2024-04-02T07:28:55.588273+0000","last_clean":"2024-04-02T07:28:55.588273+0000","last_became_active":"2024-04-02T07:28:53.945452+0000","last_became_peered":"2024-04-02T07:28:53.945452+0000","last_unstale":"2024-04-02T07:28:55.588273+0000","last_undegraded":"2024-04-02T07:28:55.588273+0000","last_fullsized":"2024-04-02T07:28:55.588273+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:42:11.561150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588500+0000","last_change":"2024-04-02T07:28:53.953598+0000","last_active":"2024-04-02T07:28:55.588500+0000","last_peered":"2024-04-02T07:28:55.588500+0000","last_clean":"2024-04-02T07:28:55.588500+0000","last_became_active":"2024-04-02T07:28:53.953325+0000","last_became_peered":"2024-04-02T07:28:53.953325+0000","last_unstale":"2024-04-02T07:28:55.588500+0000","last_undegraded":"2024-04-02T07:28:55.588500+0000","last_fullsized":"2024-04-02T07:28:55.588500+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:48:15.622373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585968+0000","last_change":"2024-04-02T07:28:53.948707+0000","last_active":"2024-04-02T07:28:55.585968+0000","last_peered":"2024-04-02T07:28:55.585968+0000","last_clean":"2024-04-02T07:28:55.585968+0000","last_became_active":"2024-04-02T07:28:53.948435+0000","last_became_peered":"2024-04-02T07:28:53.948435+0000","last_unstale":"2024-04-02T07:28:55.585968+0000","last_undegraded":"2024-04-02T07:28:55.585968+0000","last_fullsized":"2024-04-02T07:28:55.585968+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:58:02.271747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.586020+0000","last_change":"2024-04-02T07:28:53.947016+0000","last_active":"2024-04-02T07:28:55.586020+0000","last_peered":"2024-04-02T07:28:55.586020+0000","last_clean":"2024-04-02T07:28:55.586020+0000","last_became_active":"2024-04-02T07:28:53.944676+0000","last_became_peered":"2024-04-02T07:28:53.944676+0000","last_unstale":"2024-04-02T07:28:55.586020+0000","last_undegraded":"2024-04-02T07:28:55.586020+0000","last_fullsized":"2024-04-02T07:28:55.586020+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:34:54.076769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587871+0000","last_change":"2024-04-02T07:28:53.950179+0000","last_active":"2024-04-02T07:28:55.587871+0000","last_peered":"2024-04-02T07:28:55.587871+0000","last_clean":"2024-04-02T07:28:55.587871+0000","last_became_active":"2024-04-02T07:28:53.949931+0000","last_became_peered":"2024-04-02T07:28:53.949931+0000","last_unstale":"2024-04-02T07:28:55.587871+0000","last_undegraded":"2024-04-02T07:28:55.587871+0000","last_fullsized":"2024-04-02T07:28:55.587871+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:37:09.794797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587973+0000","last_change":"2024-04-02T07:28:53.952630+0000","last_active":"2024-04-02T07:28:55.587973+0000","last_peered":"2024-04-02T07:28:55.587973+0000","last_clean":"2024-04-02T07:28:55.587973+0000","last_became_active":"2024-04-02T07:28:53.952372+0000","last_became_peered":"2024-04-02T07:28:53.952372+0000","last_unstale":"2024-04-02T07:28:55.587973+0000","last_undegraded":"2024-04-02T07:28:55.587973+0000","last_fullsized":"2024-04-02T07:28:55.587973+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:25:33.948360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587994+0000","last_change":"2024-04-02T07:28:53.953810+0000","last_active":"2024-04-02T07:28:55.587994+0000","last_peered":"2024-04-02T07:28:55.587994+0000","last_clean":"2024-04-02T07:28:55.587994+0000","last_became_active":"2024-04-02T07:28:53.953555+0000","last_became_peered":"2024-04-02T07:28:53.953555+0000","last_unstale":"2024-04-02T07:28:55.587994+0000","last_undegraded":"2024-04-02T07:28:55.587994+0000","last_fullsized":"2024-04-02T07:28:55.587994+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:12:33.472756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"86'4","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588934+0000","last_change":"2024-04-02T07:28:53.542119+0000","last_active":"2024-04-02T07:28:55.588934+0000","last_peered":"2024-04-02T07:28:55.588934+0000","last_clean":"2024-04-02T07:28:55.588934+0000","last_became_active":"2024-04-02T07:28:53.541802+0000","last_became_peered":"2024-04-02T07:28:53.541802+0000","last_unstale":"2024-04-02T07:28:55.588934+0000","last_undegraded":"2024-04-02T07:28:55.588934+0000","last_fullsized":"2024-04-02T07:28:55.588934+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:09:14.407209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588869+0000","last_change":"2024-04-02T07:28:53.953739+0000","last_active":"2024-04-02T07:28:55.588869+0000","last_peered":"2024-04-02T07:28:55.588869+0000","last_clean":"2024-04-02T07:28:55.588869+0000","last_became_active":"2024-04-02T07:28:53.953451+0000","last_became_peered":"2024-04-02T07:28:53.953451+0000","last_unstale":"2024-04-02T07:28:55.588869+0000","last_undegraded":"2024-04-02T07:28:55.588869+0000","last_fullsized":"2024-04-02T07:28:55.588869+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:35:13.926325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"86'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588109+0000","last_change":"2024-04-02T07:28:53.545834+0000","last_active":"2024-04-02T07:28:55.588109+0000","last_peered":"2024-04-02T07:28:55.588109+0000","last_clean":"2024-04-02T07:28:55.588109+0000","last_became_active":"2024-04-02T07:28:53.545517+0000","last_became_peered":"2024-04-02T07:28:53.545517+0000","last_unstale":"2024-04-02T07:28:55.588109+0000","last_undegraded":"2024-04-02T07:28:55.588109+0000","last_fullsized":"2024-04-02T07:28:55.588109+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:19:24.051834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588553+0000","last_change":"2024-04-02T07:28:53.953027+0000","last_active":"2024-04-02T07:28:55.588553+0000","last_peered":"2024-04-02T07:28:55.588553+0000","last_clean":"2024-04-02T07:28:55.588553+0000","last_became_active":"2024-04-02T07:28:53.952617+0000","last_became_peered":"2024-04-02T07:28:53.952617+0000","last_unstale":"2024-04-02T07:28:55.588553+0000","last_undegraded":"2024-04-02T07:28:55.588553+0000","last_fullsized":"2024-04-02T07:28:55.588553+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:18:11.660376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"86'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937931+0000","last_change":"2024-04-02T07:28:53.537781+0000","last_active":"2024-04-02T07:28:54.937931+0000","last_peered":"2024-04-02T07:28:54.937931+0000","last_clean":"2024-04-02T07:28:54.937931+0000","last_became_active":"2024-04-02T07:28:53.537499+0000","last_became_peered":"2024-04-02T07:28:53.537499+0000","last_unstale":"2024-04-02T07:28:54.937931+0000","last_undegraded":"2024-04-02T07:28:54.937931+0000","last_fullsized":"2024-04-02T07:28:54.937931+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:15:38.734651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.939975+0000","last_change":"2024-04-02T07:28:53.946536+0000","last_active":"2024-04-02T07:28:54.939975+0000","last_peered":"2024-04-02T07:28:54.939975+0000","last_clean":"2024-04-02T07:28:54.939975+0000","last_became_active":"2024-04-02T07:28:53.945532+0000","last_became_peered":"2024-04-02T07:28:53.945532+0000","last_unstale":"2024-04-02T07:28:54.939975+0000","last_undegraded":"2024-04-02T07:28:54.939975+0000","last_fullsized":"2024-04-02T07:28:54.939975+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:47:06.026050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"86'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937514+0000","last_change":"2024-04-02T07:28:53.543383+0000","last_active":"2024-04-02T07:28:54.937514+0000","last_peered":"2024-04-02T07:28:54.937514+0000","last_clean":"2024-04-02T07:28:54.937514+0000","last_became_active":"2024-04-02T07:28:53.542790+0000","last_became_peered":"2024-04-02T07:28:53.542790+0000","last_unstale":"2024-04-02T07:28:54.937514+0000","last_undegraded":"2024-04-02T07:28:54.937514+0000","last_fullsized":"2024-04-02T07:28:54.937514+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:09:14.407209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.586123+0000","last_change":"2024-04-02T07:28:53.945084+0000","last_active":"2024-04-02T07:28:55.586123+0000","last_peered":"2024-04-02T07:28:55.586123+0000","last_clean":"2024-04-02T07:28:55.586123+0000","last_became_active":"2024-04-02T07:28:53.944343+0000","last_became_peered":"2024-04-02T07:28:53.944343+0000","last_unstale":"2024-04-02T07:28:55.586123+0000","last_undegraded":"2024-04-02T07:28:55.586123+0000","last_fullsized":"2024-04-02T07:28:55.586123+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:53:09.735234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"86'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588244+0000","last_change":"2024-04-02T07:28:53.541120+0000","last_active":"2024-04-02T07:28:55.588244+0000","last_peered":"2024-04-02T07:28:55.588244+0000","last_clean":"2024-04-02T07:28:55.588244+0000","last_became_active":"2024-04-02T07:28:53.540792+0000","last_became_peered":"2024-04-02T07:28:53.540792+0000","last_unstale":"2024-04-02T07:28:55.588244+0000","last_undegraded":"2024-04-02T07:28:55.588244+0000","last_fullsized":"2024-04-02T07:28:55.588244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:20:13.793980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588054+0000","last_change":"2024-04-02T07:28:53.946786+0000","last_active":"2024-04-02T07:28:55.588054+0000","last_peered":"2024-04-02T07:28:55.588054+0000","last_clean":"2024-04-02T07:28:55.588054+0000","last_became_active":"2024-04-02T07:28:53.944711+0000","last_became_peered":"2024-04-02T07:28:53.944711+0000","last_unstale":"2024-04-02T07:28:55.588054+0000","last_undegraded":"2024-04-02T07:28:55.588054+0000","last_fullsized":"2024-04-02T07:28:55.588054+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:12:42.159370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"86'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587986+0000","last_change":"2024-04-02T07:28:53.545460+0000","last_active":"2024-04-02T07:28:55.587986+0000","last_peered":"2024-04-02T07:28:55.587986+0000","last_clean":"2024-04-02T07:28:55.587986+0000","last_became_active":"2024-04-02T07:28:53.545172+0000","last_became_peered":"2024-04-02T07:28:53.545172+0000","last_unstale":"2024-04-02T07:28:55.587986+0000","last_undegraded":"2024-04-02T07:28:55.587986+0000","last_fullsized":"2024-04-02T07:28:55.587986+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:56:49.307447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.939756+0000","last_change":"2024-04-02T07:28:53.946286+0000","last_active":"2024-04-02T07:28:54.939756+0000","last_peered":"2024-04-02T07:28:54.939756+0000","last_clean":"2024-04-02T07:28:54.939756+0000","last_became_active":"2024-04-02T07:28:53.945950+0000","last_became_peered":"2024-04-02T07:28:53.945950+0000","last_unstale":"2024-04-02T07:28:54.939756+0000","last_undegraded":"2024-04-02T07:28:54.939756+0000","last_fullsized":"2024-04-02T07:28:54.939756+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:48:15.622373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937141+0000","last_change":"2024-04-02T07:28:53.545481+0000","last_active":"2024-04-02T07:28:54.937141+0000","last_peered":"2024-04-02T07:28:54.937141+0000","last_clean":"2024-04-02T07:28:54.937141+0000","last_became_active":"2024-04-02T07:28:53.545109+0000","last_became_peered":"2024-04-02T07:28:53.545109+0000","last_unstale":"2024-04-02T07:28:54.937141+0000","last_undegraded":"2024-04-02T07:28:54.937141+0000","last_fullsized":"2024-04-02T07:28:54.937141+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:43:48.167224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937757+0000","last_change":"2024-04-02T07:28:53.939810+0000","last_active":"2024-04-02T07:28:54.937757+0000","last_peered":"2024-04-02T07:28:54.937757+0000","last_clean":"2024-04-02T07:28:54.937757+0000","last_became_active":"2024-04-02T07:28:53.939565+0000","last_became_peered":"2024-04-02T07:28:53.939565+0000","last_unstale":"2024-04-02T07:28:54.937757+0000","last_undegraded":"2024-04-02T07:28:54.937757+0000","last_fullsized":"2024-04-02T07:28:54.937757+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:35:13.926325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585729+0000","last_change":"2024-04-02T07:28:53.540095+0000","last_active":"2024-04-02T07:28:55.585729+0000","last_peered":"2024-04-02T07:28:55.585729+0000","last_clean":"2024-04-02T07:28:55.585729+0000","last_became_active":"2024-04-02T07:28:53.539748+0000","last_became_peered":"2024-04-02T07:28:53.539748+0000","last_unstale":"2024-04-02T07:28:55.585729+0000","last_undegraded":"2024-04-02T07:28:55.585729+0000","last_fullsized":"2024-04-02T07:28:55.585729+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:34:28.923668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.938152+0000","last_change":"2024-04-02T07:28:53.951084+0000","last_active":"2024-04-02T07:28:54.938152+0000","last_peered":"2024-04-02T07:28:54.938152+0000","last_clean":"2024-04-02T07:28:54.938152+0000","last_became_active":"2024-04-02T07:28:53.950777+0000","last_became_peered":"2024-04-02T07:28:53.950777+0000","last_unstale":"2024-04-02T07:28:54.938152+0000","last_undegraded":"2024-04-02T07:28:54.938152+0000","last_fullsized":"2024-04-02T07:28:54.938152+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:50:00.479392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588989+0000","last_change":"2024-04-02T07:28:53.543582+0000","last_active":"2024-04-02T07:28:55.588989+0000","last_peered":"2024-04-02T07:28:55.588989+0000","last_clean":"2024-04-02T07:28:55.588989+0000","last_became_active":"2024-04-02T07:28:53.543180+0000","last_became_peered":"2024-04-02T07:28:53.543180+0000","last_unstale":"2024-04-02T07:28:55.588989+0000","last_undegraded":"2024-04-02T07:28:55.588989+0000","last_fullsized":"2024-04-02T07:28:55.588989+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:29:16.608280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587703+0000","last_change":"2024-04-02T07:28:53.954053+0000","last_active":"2024-04-02T07:28:55.587703+0000","last_peered":"2024-04-02T07:28:55.587703+0000","last_clean":"2024-04-02T07:28:55.587703+0000","last_became_active":"2024-04-02T07:28:53.952948+0000","last_became_peered":"2024-04-02T07:28:53.952948+0000","last_unstale":"2024-04-02T07:28:55.587703+0000","last_undegraded":"2024-04-02T07:28:55.587703+0000","last_fullsized":"2024-04-02T07:28:55.587703+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:15:39.736958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588862+0000","last_change":"2024-04-02T07:28:53.543092+0000","last_active":"2024-04-02T07:28:55.588862+0000","last_peered":"2024-04-02T07:28:55.588862+0000","last_clean":"2024-04-02T07:28:55.588862+0000","last_became_active":"2024-04-02T07:28:53.542744+0000","last_became_peered":"2024-04-02T07:28:53.542744+0000","last_unstale":"2024-04-02T07:28:55.588862+0000","last_undegraded":"2024-04-02T07:28:55.588862+0000","last_fullsized":"2024-04-02T07:28:55.588862+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:42:11.962768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937428+0000","last_change":"2024-04-02T07:28:53.945681+0000","last_active":"2024-04-02T07:28:54.937428+0000","last_peered":"2024-04-02T07:28:54.937428+0000","last_clean":"2024-04-02T07:28:54.937428+0000","last_became_active":"2024-04-02T07:28:53.945355+0000","last_became_peered":"2024-04-02T07:28:53.945355+0000","last_unstale":"2024-04-02T07:28:54.937428+0000","last_undegraded":"2024-04-02T07:28:54.937428+0000","last_fullsized":"2024-04-02T07:28:54.937428+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:18:11.660376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"86'3","reported_seq":14,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588591+0000","last_change":"2024-04-02T07:28:53.545363+0000","last_active":"2024-04-02T07:28:55.588591+0000","last_peered":"2024-04-02T07:28:55.588591+0000","last_clean":"2024-04-02T07:28:55.588591+0000","last_became_active":"2024-04-02T07:28:53.545094+0000","last_became_peered":"2024-04-02T07:28:53.545094+0000","last_unstale":"2024-04-02T07:28:55.588591+0000","last_undegraded":"2024-04-02T07:28:55.588591+0000","last_fullsized":"2024-04-02T07:28:55.588591+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:39:54.408592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588342+0000","last_change":"2024-04-02T07:28:53.948744+0000","last_active":"2024-04-02T07:28:55.588342+0000","last_peered":"2024-04-02T07:28:55.588342+0000","last_clean":"2024-04-02T07:28:55.588342+0000","last_became_active":"2024-04-02T07:28:53.948052+0000","last_became_peered":"2024-04-02T07:28:53.948052+0000","last_unstale":"2024-04-02T07:28:55.588342+0000","last_undegraded":"2024-04-02T07:28:55.588342+0000","last_fullsized":"2024-04-02T07:28:55.588342+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:25:53.414562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"86'6","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587483+0000","last_change":"2024-04-02T07:28:53.541298+0000","last_active":"2024-04-02T07:28:55.587483+0000","last_peered":"2024-04-02T07:28:55.587483+0000","last_clean":"2024-04-02T07:28:55.587483+0000","last_became_active":"2024-04-02T07:28:53.541033+0000","last_became_peered":"2024-04-02T07:28:53.541033+0000","last_unstale":"2024-04-02T07:28:55.587483+0000","last_undegraded":"2024-04-02T07:28:55.587483+0000","last_fullsized":"2024-04-02T07:28:55.587483+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:54.076243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937045+0000","last_change":"2024-04-02T07:28:53.945798+0000","last_active":"2024-04-02T07:28:54.937045+0000","last_peered":"2024-04-02T07:28:54.937045+0000","last_clean":"2024-04-02T07:28:54.937045+0000","last_became_active":"2024-04-02T07:28:53.945561+0000","last_became_peered":"2024-04-02T07:28:53.945561+0000","last_unstale":"2024-04-02T07:28:54.937045+0000","last_undegraded":"2024-04-02T07:28:54.937045+0000","last_fullsized":"2024-04-02T07:28:54.937045+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:25:53.414562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"86'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.586022+0000","last_change":"2024-04-02T07:28:53.547402+0000","last_active":"2024-04-02T07:28:55.586022+0000","last_peered":"2024-04-02T07:28:55.586022+0000","last_clean":"2024-04-02T07:28:55.586022+0000","last_became_active":"2024-04-02T07:28:53.547110+0000","last_became_peered":"2024-04-02T07:28:53.547110+0000","last_unstale":"2024-04-02T07:28:55.586022+0000","last_undegraded":"2024-04-02T07:28:55.586022+0000","last_fullsized":"2024-04-02T07:28:55.586022+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:04:54.229901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.939936+0000","last_change":"2024-04-02T07:28:53.942037+0000","last_active":"2024-04-02T07:28:54.939936+0000","last_peered":"2024-04-02T07:28:54.939936+0000","last_clean":"2024-04-02T07:28:54.939936+0000","last_became_active":"2024-04-02T07:28:53.941703+0000","last_became_peered":"2024-04-02T07:28:53.941703+0000","last_unstale":"2024-04-02T07:28:54.939936+0000","last_undegraded":"2024-04-02T07:28:54.939936+0000","last_fullsized":"2024-04-02T07:28:54.939936+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:23:40.254146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937795+0000","last_change":"2024-04-02T07:28:53.545847+0000","last_active":"2024-04-02T07:28:54.937795+0000","last_peered":"2024-04-02T07:28:54.937795+0000","last_clean":"2024-04-02T07:28:54.937795+0000","last_became_active":"2024-04-02T07:28:53.545586+0000","last_became_peered":"2024-04-02T07:28:53.545586+0000","last_unstale":"2024-04-02T07:28:54.937795+0000","last_undegraded":"2024-04-02T07:28:54.937795+0000","last_fullsized":"2024-04-02T07:28:54.937795+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:25:52.412256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585634+0000","last_change":"2024-04-02T07:28:53.942614+0000","last_active":"2024-04-02T07:28:55.585634+0000","last_peered":"2024-04-02T07:28:55.585634+0000","last_clean":"2024-04-02T07:28:55.585634+0000","last_became_active":"2024-04-02T07:28:53.942349+0000","last_became_peered":"2024-04-02T07:28:53.942349+0000","last_unstale":"2024-04-02T07:28:55.585634+0000","last_undegraded":"2024-04-02T07:28:55.585634+0000","last_fullsized":"2024-04-02T07:28:55.585634+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:42:12.965075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587267+0000","last_change":"2024-04-02T07:28:53.547390+0000","last_active":"2024-04-02T07:28:55.587267+0000","last_peered":"2024-04-02T07:28:55.587267+0000","last_clean":"2024-04-02T07:28:55.587267+0000","last_became_active":"2024-04-02T07:28:53.547036+0000","last_became_peered":"2024-04-02T07:28:53.547036+0000","last_unstale":"2024-04-02T07:28:55.587267+0000","last_undegraded":"2024-04-02T07:28:55.587267+0000","last_fullsized":"2024-04-02T07:28:55.587267+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:19:24.051834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585560+0000","last_change":"2024-04-02T07:28:53.943581+0000","last_active":"2024-04-02T07:28:55.585560+0000","last_peered":"2024-04-02T07:28:55.585560+0000","last_clean":"2024-04-02T07:28:55.585560+0000","last_became_active":"2024-04-02T07:28:53.943319+0000","last_became_peered":"2024-04-02T07:28:53.943319+0000","last_unstale":"2024-04-02T07:28:55.585560+0000","last_undegraded":"2024-04-02T07:28:55.585560+0000","last_fullsized":"2024-04-02T07:28:55.585560+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:29:17.610586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"86'8","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.936945+0000","last_change":"2024-04-02T07:28:53.539967+0000","last_active":"2024-04-02T07:28:54.936945+0000","last_peered":"2024-04-02T07:28:54.936945+0000","last_clean":"2024-04-02T07:28:54.936945+0000","last_became_active":"2024-04-02T07:28:53.539668+0000","last_became_peered":"2024-04-02T07:28:53.539668+0000","last_unstale":"2024-04-02T07:28:54.936945+0000","last_undegraded":"2024-04-02T07:28:54.936945+0000","last_fullsized":"2024-04-02T07:28:54.936945+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:07:04.748500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.940049+0000","last_change":"2024-04-02T07:28:53.945973+0000","last_active":"2024-04-02T07:28:54.940049+0000","last_peered":"2024-04-02T07:28:54.940049+0000","last_clean":"2024-04-02T07:28:54.940049+0000","last_became_active":"2024-04-02T07:28:53.945708+0000","last_became_peered":"2024-04-02T07:28:53.945708+0000","last_unstale":"2024-04-02T07:28:54.940049+0000","last_undegraded":"2024-04-02T07:28:54.940049+0000","last_fullsized":"2024-04-02T07:28:54.940049+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:50:00.479392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"86'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.589057+0000","last_change":"2024-04-02T07:28:53.543424+0000","last_active":"2024-04-02T07:28:55.589057+0000","last_peered":"2024-04-02T07:28:55.589057+0000","last_clean":"2024-04-02T07:28:55.589057+0000","last_became_active":"2024-04-02T07:28:53.542832+0000","last_became_peered":"2024-04-02T07:28:53.542832+0000","last_unstale":"2024-04-02T07:28:55.589057+0000","last_undegraded":"2024-04-02T07:28:55.589057+0000","last_fullsized":"2024-04-02T07:28:55.589057+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:15:38.734651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588965+0000","last_change":"2024-04-02T07:28:53.947191+0000","last_active":"2024-04-02T07:28:55.588965+0000","last_peered":"2024-04-02T07:28:55.588965+0000","last_clean":"2024-04-02T07:28:55.588965+0000","last_became_active":"2024-04-02T07:28:53.946873+0000","last_became_peered":"2024-04-02T07:28:53.946873+0000","last_unstale":"2024-04-02T07:28:55.588965+0000","last_undegraded":"2024-04-02T07:28:55.588965+0000","last_fullsized":"2024-04-02T07:28:55.588965+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:17:57.271735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"86'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937490+0000","last_change":"2024-04-02T07:28:53.538793+0000","last_active":"2024-04-02T07:28:54.937490+0000","last_peered":"2024-04-02T07:28:54.937490+0000","last_clean":"2024-04-02T07:28:54.937490+0000","last_became_active":"2024-04-02T07:28:53.538513+0000","last_became_peered":"2024-04-02T07:28:53.538513+0000","last_unstale":"2024-04-02T07:28:54.937490+0000","last_undegraded":"2024-04-02T07:28:54.937490+0000","last_fullsized":"2024-04-02T07:28:54.937490+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:52:33.433841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588360+0000","last_change":"2024-04-02T07:28:53.952248+0000","last_active":"2024-04-02T07:28:55.588360+0000","last_peered":"2024-04-02T07:28:55.588360+0000","last_clean":"2024-04-02T07:28:55.588360+0000","last_became_active":"2024-04-02T07:28:53.951995+0000","last_became_peered":"2024-04-02T07:28:53.951995+0000","last_unstale":"2024-04-02T07:28:55.588360+0000","last_undegraded":"2024-04-02T07:28:55.588360+0000","last_fullsized":"2024-04-02T07:28:55.588360+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:10:07.465691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937595+0000","last_change":"2024-04-02T07:28:53.542307+0000","last_active":"2024-04-02T07:28:54.937595+0000","last_peered":"2024-04-02T07:28:54.937595+0000","last_clean":"2024-04-02T07:28:54.937595+0000","last_became_active":"2024-04-02T07:28:53.541994+0000","last_became_peered":"2024-04-02T07:28:53.541994+0000","last_unstale":"2024-04-02T07:28:54.937595+0000","last_undegraded":"2024-04-02T07:28:54.937595+0000","last_fullsized":"2024-04-02T07:28:54.937595+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:27:22.476989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585928+0000","last_change":"2024-04-02T07:28:53.944195+0000","last_active":"2024-04-02T07:28:55.585928+0000","last_peered":"2024-04-02T07:28:55.585928+0000","last_clean":"2024-04-02T07:28:55.585928+0000","last_became_active":"2024-04-02T07:28:53.942519+0000","last_became_peered":"2024-04-02T07:28:53.942519+0000","last_unstale":"2024-04-02T07:28:55.585928+0000","last_undegraded":"2024-04-02T07:28:55.585928+0000","last_fullsized":"2024-04-02T07:28:55.585928+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:05:45.322434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"86'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937853+0000","last_change":"2024-04-02T07:28:53.539379+0000","last_active":"2024-04-02T07:28:54.937853+0000","last_peered":"2024-04-02T07:28:54.937853+0000","last_clean":"2024-04-02T07:28:54.937853+0000","last_became_active":"2024-04-02T07:28:53.539121+0000","last_became_peered":"2024-04-02T07:28:53.539121+0000","last_unstale":"2024-04-02T07:28:54.937853+0000","last_undegraded":"2024-04-02T07:28:54.937853+0000","last_fullsized":"2024-04-02T07:28:54.937853+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:25:06.615456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587378+0000","last_change":"2024-04-02T07:28:53.946334+0000","last_active":"2024-04-02T07:28:55.587378+0000","last_peered":"2024-04-02T07:28:55.587378+0000","last_clean":"2024-04-02T07:28:55.587378+0000","last_became_active":"2024-04-02T07:28:53.946037+0000","last_became_peered":"2024-04-02T07:28:53.946037+0000","last_unstale":"2024-04-02T07:28:55.587378+0000","last_undegraded":"2024-04-02T07:28:55.587378+0000","last_fullsized":"2024-04-02T07:28:55.587378+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:53:09.735234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585998+0000","last_change":"2024-04-02T07:28:53.544491+0000","last_active":"2024-04-02T07:28:55.585998+0000","last_peered":"2024-04-02T07:28:55.585998+0000","last_clean":"2024-04-02T07:28:55.585998+0000","last_became_active":"2024-04-02T07:28:53.544217+0000","last_became_peered":"2024-04-02T07:28:53.544217+0000","last_unstale":"2024-04-02T07:28:55.585998+0000","last_undegraded":"2024-04-02T07:28:55.585998+0000","last_fullsized":"2024-04-02T07:28:55.585998+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:16:11.505703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585353+0000","last_change":"2024-04-02T07:28:53.940500+0000","last_active":"2024-04-02T07:28:55.585353+0000","last_peered":"2024-04-02T07:28:55.585353+0000","last_clean":"2024-04-02T07:28:55.585353+0000","last_became_active":"2024-04-02T07:28:53.940257+0000","last_became_peered":"2024-04-02T07:28:53.940257+0000","last_unstale":"2024-04-02T07:28:55.585353+0000","last_undegraded":"2024-04-02T07:28:55.585353+0000","last_fullsized":"2024-04-02T07:28:55.585353+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:43:25.076355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.585377+0000","last_change":"2024-04-02T07:28:53.540316+0000","last_active":"2024-04-02T07:28:55.585377+0000","last_peered":"2024-04-02T07:28:55.585377+0000","last_clean":"2024-04-02T07:28:55.585377+0000","last_became_active":"2024-04-02T07:28:53.540025+0000","last_became_peered":"2024-04-02T07:28:53.540025+0000","last_unstale":"2024-04-02T07:28:55.585377+0000","last_undegraded":"2024-04-02T07:28:55.585377+0000","last_fullsized":"2024-04-02T07:28:55.585377+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:33:31.000139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587420+0000","last_change":"2024-04-02T07:28:53.951883+0000","last_active":"2024-04-02T07:28:55.587420+0000","last_peered":"2024-04-02T07:28:55.587420+0000","last_clean":"2024-04-02T07:28:55.587420+0000","last_became_active":"2024-04-02T07:28:53.951528+0000","last_became_peered":"2024-04-02T07:28:53.951528+0000","last_unstale":"2024-04-02T07:28:55.587420+0000","last_undegraded":"2024-04-02T07:28:55.587420+0000","last_fullsized":"2024-04-02T07:28:55.587420+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:52:34.436148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937542+0000","last_change":"2024-04-02T07:28:53.538514+0000","last_active":"2024-04-02T07:28:54.937542+0000","last_peered":"2024-04-02T07:28:54.937542+0000","last_clean":"2024-04-02T07:28:54.937542+0000","last_became_active":"2024-04-02T07:28:53.538205+0000","last_became_peered":"2024-04-02T07:28:53.538205+0000","last_unstale":"2024-04-02T07:28:54.937542+0000","last_undegraded":"2024-04-02T07:28:54.937542+0000","last_fullsized":"2024-04-02T07:28:54.937542+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:10:06.463384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588053+0000","last_change":"2024-04-02T07:28:53.953793+0000","last_active":"2024-04-02T07:28:55.588053+0000","last_peered":"2024-04-02T07:28:55.588053+0000","last_clean":"2024-04-02T07:28:55.588053+0000","last_became_active":"2024-04-02T07:28:53.953519+0000","last_became_peered":"2024-04-02T07:28:53.953519+0000","last_unstale":"2024-04-02T07:28:55.588053+0000","last_undegraded":"2024-04-02T07:28:55.588053+0000","last_fullsized":"2024-04-02T07:28:55.588053+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:18:11.660376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"86'2","reported_seq":13,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.586156+0000","last_change":"2024-04-02T07:28:53.540111+0000","last_active":"2024-04-02T07:28:55.586156+0000","last_peered":"2024-04-02T07:28:55.586156+0000","last_clean":"2024-04-02T07:28:55.586156+0000","last_became_active":"2024-04-02T07:28:53.539778+0000","last_became_peered":"2024-04-02T07:28:53.539778+0000","last_unstale":"2024-04-02T07:28:55.586156+0000","last_undegraded":"2024-04-02T07:28:55.586156+0000","last_fullsized":"2024-04-02T07:28:55.586156+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:41:17.973477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.940201+0000","last_change":"2024-04-02T07:28:53.947368+0000","last_active":"2024-04-02T07:28:54.940201+0000","last_peered":"2024-04-02T07:28:54.940201+0000","last_clean":"2024-04-02T07:28:54.940201+0000","last_became_active":"2024-04-02T07:28:53.947033+0000","last_became_peered":"2024-04-02T07:28:53.947033+0000","last_unstale":"2024-04-02T07:28:54.940201+0000","last_undegraded":"2024-04-02T07:28:54.940201+0000","last_fullsized":"2024-04-02T07:28:54.940201+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:29:49.287555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.586039+0000","last_change":"2024-04-02T07:28:53.543724+0000","last_active":"2024-04-02T07:28:55.586039+0000","last_peered":"2024-04-02T07:28:55.586039+0000","last_clean":"2024-04-02T07:28:55.586039+0000","last_became_active":"2024-04-02T07:28:53.543406+0000","last_became_peered":"2024-04-02T07:28:53.543406+0000","last_unstale":"2024-04-02T07:28:55.586039+0000","last_undegraded":"2024-04-02T07:28:55.586039+0000","last_fullsized":"2024-04-02T07:28:55.586039+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:41:52.990728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588603+0000","last_change":"2024-04-02T07:28:53.958985+0000","last_active":"2024-04-02T07:28:55.588603+0000","last_peered":"2024-04-02T07:28:55.588603+0000","last_clean":"2024-04-02T07:28:55.588603+0000","last_became_active":"2024-04-02T07:28:53.958725+0000","last_became_peered":"2024-04-02T07:28:53.958725+0000","last_unstale":"2024-04-02T07:28:55.588603+0000","last_undegraded":"2024-04-02T07:28:55.588603+0000","last_fullsized":"2024-04-02T07:28:55.588603+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:50:00.479392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588711+0000","last_change":"2024-04-02T07:28:53.543067+0000","last_active":"2024-04-02T07:28:55.588711+0000","last_peered":"2024-04-02T07:28:55.588711+0000","last_clean":"2024-04-02T07:28:55.588711+0000","last_became_active":"2024-04-02T07:28:53.541921+0000","last_became_peered":"2024-04-02T07:28:53.541921+0000","last_unstale":"2024-04-02T07:28:55.588711+0000","last_undegraded":"2024-04-02T07:28:55.588711+0000","last_fullsized":"2024-04-02T07:28:55.588711+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:58:01.269440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588435+0000","last_change":"2024-04-02T07:28:53.948306+0000","last_active":"2024-04-02T07:28:55.588435+0000","last_peered":"2024-04-02T07:28:55.588435+0000","last_clean":"2024-04-02T07:28:55.588435+0000","last_became_active":"2024-04-02T07:28:53.947724+0000","last_became_peered":"2024-04-02T07:28:53.947724+0000","last_unstale":"2024-04-02T07:28:55.588435+0000","last_undegraded":"2024-04-02T07:28:55.588435+0000","last_fullsized":"2024-04-02T07:28:55.588435+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:07:05.750806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588669+0000","last_change":"2024-04-02T07:28:53.542156+0000","last_active":"2024-04-02T07:28:55.588669+0000","last_peered":"2024-04-02T07:28:55.588669+0000","last_clean":"2024-04-02T07:28:55.588669+0000","last_became_active":"2024-04-02T07:28:53.540629+0000","last_became_peered":"2024-04-02T07:28:53.540629+0000","last_unstale":"2024-04-02T07:28:55.588669+0000","last_undegraded":"2024-04-02T07:28:55.588669+0000","last_fullsized":"2024-04-02T07:28:55.588669+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:11:03.964147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587365+0000","last_change":"2024-04-02T07:28:53.946763+0000","last_active":"2024-04-02T07:28:55.587365+0000","last_peered":"2024-04-02T07:28:55.587365+0000","last_clean":"2024-04-02T07:28:55.587365+0000","last_became_active":"2024-04-02T07:28:53.946472+0000","last_became_peered":"2024-04-02T07:28:53.946472+0000","last_unstale":"2024-04-02T07:28:55.587365+0000","last_undegraded":"2024-04-02T07:28:55.587365+0000","last_fullsized":"2024-04-02T07:28:55.587365+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:09:15.409516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937365+0000","last_change":"2024-04-02T07:28:53.541627+0000","last_active":"2024-04-02T07:28:54.937365+0000","last_peered":"2024-04-02T07:28:54.937365+0000","last_clean":"2024-04-02T07:28:54.937365+0000","last_became_active":"2024-04-02T07:28:53.541367+0000","last_became_peered":"2024-04-02T07:28:53.541367+0000","last_unstale":"2024-04-02T07:28:54.937365+0000","last_undegraded":"2024-04-02T07:28:54.937365+0000","last_fullsized":"2024-04-02T07:28:54.937365+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:01:07.077714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.937332+0000","last_change":"2024-04-02T07:28:53.947390+0000","last_active":"2024-04-02T07:28:54.937332+0000","last_peered":"2024-04-02T07:28:54.937332+0000","last_clean":"2024-04-02T07:28:54.937332+0000","last_became_active":"2024-04-02T07:28:53.946291+0000","last_became_peered":"2024-04-02T07:28:53.946291+0000","last_unstale":"2024-04-02T07:28:54.937332+0000","last_undegraded":"2024-04-02T07:28:54.937332+0000","last_fullsized":"2024-04-02T07:28:54.937332+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:42:11.561150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588102+0000","last_change":"2024-04-02T07:28:53.544426+0000","last_active":"2024-04-02T07:28:55.588102+0000","last_peered":"2024-04-02T07:28:55.588102+0000","last_clean":"2024-04-02T07:28:55.588102+0000","last_became_active":"2024-04-02T07:28:53.542866+0000","last_became_peered":"2024-04-02T07:28:53.542866+0000","last_unstale":"2024-04-02T07:28:55.588102+0000","last_undegraded":"2024-04-02T07:28:55.588102+0000","last_fullsized":"2024-04-02T07:28:55.588102+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:54.076243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.939741+0000","last_change":"2024-04-02T07:28:53.947890+0000","last_active":"2024-04-02T07:28:54.939741+0000","last_peered":"2024-04-02T07:28:54.939741+0000","last_clean":"2024-04-02T07:28:54.939741+0000","last_became_active":"2024-04-02T07:28:53.947622+0000","last_became_peered":"2024-04-02T07:28:53.947622+0000","last_unstale":"2024-04-02T07:28:54.939741+0000","last_undegraded":"2024-04-02T07:28:54.939741+0000","last_fullsized":"2024-04-02T07:28:54.939741+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:05:33.069753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588379+0000","last_change":"2024-04-02T07:28:53.544885+0000","last_active":"2024-04-02T07:28:55.588379+0000","last_peered":"2024-04-02T07:28:55.588379+0000","last_clean":"2024-04-02T07:28:55.588379+0000","last_became_active":"2024-04-02T07:28:53.544186+0000","last_became_peered":"2024-04-02T07:28:53.544186+0000","last_unstale":"2024-04-02T07:28:55.588379+0000","last_undegraded":"2024-04-02T07:28:55.588379+0000","last_fullsized":"2024-04-02T07:28:55.588379+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:53:08.732927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.588301+0000","last_change":"2024-04-02T07:28:53.949683+0000","last_active":"2024-04-02T07:28:55.588301+0000","last_peered":"2024-04-02T07:28:55.588301+0000","last_clean":"2024-04-02T07:28:55.588301+0000","last_became_active":"2024-04-02T07:28:53.949421+0000","last_became_peered":"2024-04-02T07:28:53.949421+0000","last_unstale":"2024-04-02T07:28:55.588301+0000","last_undegraded":"2024-04-02T07:28:55.588301+0000","last_fullsized":"2024-04-02T07:28:55.588301+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:49:12.365206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.587731+0000","last_change":"2024-04-02T07:28:53.538569+0000","last_active":"2024-04-02T07:28:55.587731+0000","last_peered":"2024-04-02T07:28:55.587731+0000","last_clean":"2024-04-02T07:28:55.587731+0000","last_became_active":"2024-04-02T07:28:53.538318+0000","last_became_peered":"2024-04-02T07:28:53.538318+0000","last_unstale":"2024-04-02T07:28:55.587731+0000","last_undegraded":"2024-04-02T07:28:55.587731+0000","last_fullsized":"2024-04-02T07:28:55.587731+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:41:54.211173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:55.586200+0000","last_change":"2024-04-02T07:28:53.949669+0000","last_active":"2024-04-02T07:28:55.586200+0000","last_peered":"2024-04-02T07:28:55.586200+0000","last_clean":"2024-04-02T07:28:55.586200+0000","last_became_active":"2024-04-02T07:28:53.949098+0000","last_became_peered":"2024-04-02T07:28:53.949098+0000","last_unstale":"2024-04-02T07:28:55.586200+0000","last_undegraded":"2024-04-02T07:28:55.586200+0000","last_fullsized":"2024-04-02T07:28:55.586200+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:53.517411+0000","last_clean_scrub_stamp":"2024-04-02T07:28:53.517411+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:11:04.966454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"86'1","reported_seq":12,"reported_epoch":87,"state":"active+clean","last_fresh":"2024-04-02T07:28:54.940060+0000","last_change":"2024-04-02T07:28:53.547270+0000","last_active":"2024-04-02T07:28:54.940060+0000","last_peered":"2024-04-02T07:28:54.940060+0000","last_clean":"2024-04-02T07:28:54.940060+0000","last_became_active":"2024-04-02T07:28:53.546989+0000","last_became_peered":"2024-04-02T07:28:53.546989+0000","last_unstale":"2024-04-02T07:28:54.940060+0000","last_undegraded":"2024-04-02T07:28:54.940060+0000","last_fullsized":"2024-04-02T07:28:54.940060+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:28:52.515104+0000","last_clean_scrub_stamp":"2024-04-02T07:28:52.515104+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:12:32.470450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":224,"reported_epoch":86,"state":"active+clean","last_fresh":"2024-04-02T07:28:53.930173+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:28:53.930173+0000","last_peered":"2024-04-02T07:28:53.930173+0000","last_clean":"2024-04-02T07:28:53.930173+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:28:53.930173+0000","last_undegraded":"2024-04-02T07:28:53.930173+0000","last_fullsized":"2024-04-02T07:28:53.930173+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574932,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32744,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339096,"statfs":{"total":96636764160,"available":96603234304,"internally_reserved":0,"allocated":1667072,"data_stored":1047496,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:28:16 2024","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.66400000000000003,"15min":0.64800000000000002},"min":{"1min":0.47499999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.88900000000000001,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.433},{"interface":"front","average":{"1min":0.66100000000000003,"5min":0.66900000000000004,"15min":0.61799999999999999},"min":{"1min":0.45800000000000002,"5min":0.40699999999999997,"15min":0.39900000000000002},"max":{"1min":0.90200000000000002,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.53100000000000003}]},{"osd":1,"last update":"Tue Apr 2 07:28:16 2024","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.67000000000000004,"15min":0.63800000000000001},"min":{"1min":0.59099999999999997,"5min":0.432,"15min":0.379},"max":{"1min":0.85299999999999998,"5min":0.95999999999999996,"15min":1.0289999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.68999999999999995,"15min":0.66300000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.877,"5min":0.95899999999999996,"15min":1.113},"last":0.55400000000000005}]},{"osd":2,"last update":"Tue Apr 2 07:28:16 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.755,"15min":0.753},"min":{"1min":0.66700000000000004,"5min":0.52800000000000002,"15min":0.435},"max":{"1min":0.92300000000000004,"5min":1.0149999999999999,"15min":1.139},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.748,"5min":0.72399999999999998,"15min":0.72599999999999998},"min":{"1min":0.56499999999999995,"5min":0.437,"15min":0.437},"max":{"1min":0.91500000000000004,"5min":0.96499999999999997,"15min":1.522},"last":0.503}]},{"osd":3,"last update":"Tue Apr 2 07:28:16 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.70599999999999996,"15min":0.70199999999999996},"min":{"1min":0.57799999999999996,"5min":0.46800000000000003,"15min":0.41999999999999998},"max":{"1min":0.85799999999999998,"5min":1.0369999999999999,"15min":1.405},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.72799999999999998,"15min":0.72799999999999998},"min":{"1min":0.58499999999999996,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.92600000000000005,"5min":0.98099999999999998,"15min":1.0580000000000001},"last":0.48799999999999999}]},{"osd":4,"last update":"Tue Apr 2 07:28:16 2024","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60599999999999998,"15min":0.67600000000000005},"min":{"1min":0.40999999999999998,"5min":0.377,"15min":0.377},"max":{"1min":0.88900000000000001,"5min":0.92500000000000004,"15min":1.633},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.67000000000000004,"15min":0.72799999999999998},"min":{"1min":0.51900000000000002,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82499999999999996,"5min":0.93600000000000005,"15min":1.079},"last":0.69899999999999995}]},{"osd":5,"last update":"Tue Apr 2 07:28:16 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.64200000000000002,"15min":0.71399999999999997},"min":{"1min":0.45800000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.92200000000000004,"5min":0.996,"15min":1.2250000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70399999999999996,"15min":0.77200000000000002},"min":{"1min":0.47899999999999998,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.98799999999999999,"5min":1.0049999999999999,"15min":1.5609999999999999},"last":0.56899999999999995}]},{"osd":6,"last update":"Tue Apr 2 07:28:16 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65700000000000003,"15min":0.72199999999999998},"min":{"1min":0.51100000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.93999999999999995,"5min":0.97199999999999998,"15min":1.5960000000000001},"last":0.629},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.64000000000000001,"15min":0.69599999999999995},"min":{"1min":0.45800000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.72499999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574933,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32164,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339676,"statfs":{"total":96636764160,"available":96603828224,"internally_reserved":0,"allocated":1069056,"data_stored":451452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.70399999999999996,"5min":0.68100000000000005,"15min":0.66900000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.995,"5min":0.995,"15min":1.399},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.69299999999999995,"15min":0.85699999999999998},"min":{"1min":0.47599999999999998,"5min":0.44800000000000001,"15min":0.39400000000000002},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":5.7569999999999997},"last":0.66200000000000003}]},{"osd":1,"last update":"Tue Apr 2 07:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70399999999999996,"15min":0.72399999999999998},"min":{"1min":0.47999999999999998,"5min":0.40000000000000002,"15min":0.38200000000000001},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.95},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.752,"5min":0.72099999999999997,"15min":0.72999999999999998},"min":{"1min":0.58699999999999997,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90500000000000003,"5min":1.004,"15min":1.248},"last":0.69099999999999995}]},{"osd":2,"last update":"Tue Apr 2 07:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.68000000000000005,"15min":0.69299999999999995},"min":{"1min":0.503,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.90500000000000003,"5min":1.0249999999999999,"15min":1.226},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.76700000000000002,"5min":0.72899999999999998,"15min":0.71599999999999997},"min":{"1min":0.502,"5min":0.47499999999999998,"15min":0.46500000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.64200000000000002}]},{"osd":3,"last update":"Tue Apr 2 07:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.72599999999999998,"15min":0.79700000000000004},"min":{"1min":0.54500000000000004,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":2.3119999999999998},"last":0.625},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.72399999999999998,"15min":0.78500000000000003},"min":{"1min":0.56100000000000005,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.018,"5min":1.018,"15min":2.6389999999999998},"last":0.53900000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.61299999999999999,"15min":0.65500000000000003},"min":{"1min":0.36099999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.76700000000000002,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.437},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.63,"15min":0.66000000000000003},"min":{"1min":0.41399999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80700000000000005,"5min":0.91000000000000003,"15min":0.96999999999999997},"last":0.57599999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.60799999999999998,"15min":0.66400000000000003},"min":{"1min":0.41899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.95999999999999996},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.67800000000000005,"15min":0.71999999999999997},"min":{"1min":0.44700000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92200000000000004,"5min":0.98999999999999999,"15min":1.0529999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Tue Apr 2 07:28:15 2024","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.68300000000000005,"15min":0.73199999999999998},"min":{"1min":0.48099999999999998,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.86499999999999999,"5min":0.93400000000000005,"15min":1.0209999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.69099999999999995,"15min":0.73599999999999999},"min":{"1min":0.51100000000000001,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.88100000000000001,"5min":0.97099999999999997,"15min":0.999},"last":0.60599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574933,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32184,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339656,"statfs":{"total":96636764160,"available":96603807744,"internally_reserved":0,"allocated":1085440,"data_stored":458644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:28:09 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68000000000000005,"15min":0.65600000000000003},"min":{"1min":0.52600000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.25},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.77000000000000002,"5min":0.69599999999999995,"15min":0.70499999999999996},"min":{"1min":0.57599999999999996,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.5289999999999999},"last":0.69599999999999995}]},{"osd":1,"last update":"Tue Apr 2 07:28:09 2024","interfaces":[{"interface":"back","average":{"1min":0.78600000000000003,"5min":0.71899999999999997,"15min":0.69899999999999995},"min":{"1min":0.54800000000000004,"5min":0.371,"15min":0.371},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":1.1830000000000001},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.68799999999999994,"15min":0.71799999999999997},"min":{"1min":0.60999999999999999,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.0169999999999999,"5min":1.026,"15min":1.3420000000000001},"last":0.74099999999999999}]},{"osd":2,"last update":"Tue Apr 2 07:28:09 2024","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.76700000000000002,"15min":0.81699999999999995},"min":{"1min":0.72199999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.8280000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.749,"5min":0.70099999999999996,"15min":0.73799999999999999},"min":{"1min":0.436,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.022,"5min":1.022,"15min":1.696},"last":0.71399999999999997}]},{"osd":3,"last update":"Tue Apr 2 07:28:09 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.71599999999999997,"15min":0.75800000000000001},"min":{"1min":0.497,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.96099999999999997,"5min":0.99099999999999999,"15min":1.6399999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.72999999999999998,"15min":0.81000000000000005},"min":{"1min":0.64100000000000001,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.98799999999999999,"5min":0.998,"15min":2.0219999999999998},"last":0.505}]},{"osd":4,"last update":"Tue Apr 2 07:28:09 2024","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56699999999999995,"15min":0.69199999999999995},"min":{"1min":0.46200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79200000000000004,"5min":0.90500000000000003,"15min":1.911},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.61499999999999999,"15min":0.75600000000000001},"min":{"1min":0.47699999999999998,"5min":0.307,"15min":0.307},"max":{"1min":0.88200000000000001,"5min":0.92400000000000004,"15min":1.7829999999999999},"last":0.53900000000000003}]},{"osd":6,"last update":"Tue Apr 2 07:28:09 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.63400000000000001,"15min":0.81799999999999995},"min":{"1min":0.46600000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.81799999999999995,"5min":0.95799999999999996,"15min":2.1829999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.63,"15min":0.80600000000000005},"min":{"1min":0.51600000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.86399999999999999,"5min":1.0269999999999999,"15min":2.1280000000000001},"last":0.67900000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:28:09 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.68500000000000005,"15min":0.83499999999999996},"min":{"1min":0.501,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.91800000000000004,"5min":1.038,"15min":1.887},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.70499999999999996,"15min":0.879},"min":{"1min":0.60299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.90500000000000003,"5min":1.012,"15min":2.2599999999999998},"last":0.66800000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574935,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32152,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339688,"statfs":{"total":96636764160,"available":96603840512,"internally_reserved":0,"allocated":1056768,"data_stored":450758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:28:23 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67400000000000004,"15min":0.73499999999999999},"min":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.85099999999999998,"5min":1.014,"15min":2.4929999999999999},"last":0.505},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.67100000000000004,"15min":0.80000000000000004},"min":{"1min":0.51100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.91700000000000004,"5min":0.94899999999999995,"15min":3.2519999999999998},"last":0.52500000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:28:23 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70599999999999996,"15min":0.751},"min":{"1min":0.58699999999999997,"5min":0.499,"15min":0.44400000000000001},"max":{"1min":0.86699999999999999,"5min":1.042,"15min":1.4279999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.71399999999999997,"15min":0.878},"min":{"1min":0.51900000000000002,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.88300000000000001,"5min":0.97399999999999998,"15min":4.3810000000000002},"last":0.59499999999999997}]},{"osd":2,"last update":"Tue Apr 2 07:28:23 2024","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.73899999999999999,"15min":0.79300000000000004},"min":{"1min":0.55700000000000005,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.93200000000000005,"5min":0.995,"15min":2.056},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.72799999999999998,"15min":0.85199999999999998},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.89700000000000002,"5min":1.109,"15min":3.3420000000000001},"last":0.65900000000000003}]},{"osd":3,"last update":"Tue Apr 2 07:28:23 2024","interfaces":[{"interface":"back","average":{"1min":0.751,"5min":0.755,"15min":0.95499999999999996},"min":{"1min":0.48199999999999998,"5min":0.436,"15min":0.436},"max":{"1min":1.054,"5min":1.054,"15min":3.9180000000000001},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.76200000000000001,"15min":0.96799999999999997},"min":{"1min":0.60999999999999999,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0680000000000001,"5min":1.0920000000000001,"15min":3.9750000000000001},"last":0.72399999999999998}]},{"osd":5,"last update":"Tue Apr 2 07:28:23 2024","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.61899999999999999,"15min":0.69099999999999995},"min":{"1min":0.41899999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.78200000000000003,"5min":1.0389999999999999,"15min":1.2509999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.64300000000000002,"15min":0.72799999999999998},"min":{"1min":0.45900000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.69199999999999995,"5min":1.0640000000000001,"15min":1.4419999999999999},"last":0.71199999999999997}]},{"osd":6,"last update":"Tue Apr 2 07:28:23 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.629,"15min":0.69699999999999995},"min":{"1min":0.439,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83999999999999997,"5min":1.123,"15min":1.2949999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.68799999999999994,"15min":0.75900000000000001},"min":{"1min":0.47299999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.82599999999999996,"5min":1.097,"15min":1.3069999999999999},"last":0.746}]},{"osd":7,"last update":"Tue Apr 2 07:28:23 2024","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.71599999999999997,"15min":0.78200000000000003},"min":{"1min":0.441,"5min":0.438,"15min":0.438},"max":{"1min":0.873,"5min":1.1060000000000001,"15min":1.2689999999999999},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.72299999999999998,"5min":0.78800000000000003,"15min":0.85199999999999998},"min":{"1min":0.53100000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.89300000000000002,"5min":1.1499999999999999,"15min":1.353},"last":0.83199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574933,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1081344,"data_stored":458622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.42999999999999999,"15min":0.44800000000000001},"min":{"1min":0.28699999999999998,"5min":0.26600000000000001,"15min":0.26300000000000001},"max":{"1min":0.621,"5min":0.623,"15min":0.623},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.311,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":1.0109999999999999},"last":0.46400000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.45200000000000001,"15min":0.44},"min":{"1min":0.32400000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.56100000000000005,"5min":0.68799999999999994,"15min":0.68799999999999994},"last":0.377},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.50800000000000001,"15min":0.50900000000000001},"min":{"1min":0.371,"5min":0.309,"15min":0.309},"max":{"1min":0.71099999999999997,"5min":0.77500000000000002,"15min":0.79700000000000004},"last":0.54700000000000004}]},{"osd":2,"last update":"Tue Apr 2 07:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55500000000000005,"15min":0.53500000000000003},"min":{"1min":0.44600000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.754,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.56599999999999995,"15min":0.58599999999999997},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.84399999999999997,"5min":0.93700000000000006,"15min":1.306},"last":0.60199999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71499999999999997,"15min":0.749},"min":{"1min":0.56499999999999995,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.1850000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.745,"5min":0.74199999999999999,"15min":0.754},"min":{"1min":0.56999999999999995,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.091,"5min":1.091,"15min":1.155},"last":0.75800000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.77400000000000002,"15min":0.77600000000000002},"min":{"1min":0.66800000000000004,"5min":0.501,"15min":0.501},"max":{"1min":1.0389999999999999,"5min":1.198,"15min":1.198},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.755,"15min":0.748},"min":{"1min":0.63600000000000001,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.056,"5min":1.056,"15min":1.135},"last":0.85299999999999998}]},{"osd":6,"last update":"Tue Apr 2 07:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.754,"15min":0.76600000000000001},"min":{"1min":0.55600000000000005,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.0169999999999999,"5min":1.1060000000000001,"15min":1.25},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.79000000000000004,"15min":0.78400000000000003},"min":{"1min":0.61299999999999999,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.034,"5min":1.1379999999999999,"15min":1.2010000000000001},"last":0.97299999999999998}]},{"osd":7,"last update":"Tue Apr 2 07:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.752,"5min":0.75600000000000001,"15min":0.75800000000000001},"min":{"1min":0.54600000000000004,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.0209999999999999,"5min":1.1319999999999999,"15min":1.216},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.753,"5min":0.78000000000000003,"15min":0.79300000000000004},"min":{"1min":0.57399999999999995,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.073,"5min":1.077,"15min":1.2869999999999999},"last":0.89300000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32172,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339668,"statfs":{"total":96636764160,"available":96603820032,"internally_reserved":0,"allocated":1073152,"data_stored":457640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:28:22 2024","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.435,"15min":0.44800000000000001},"min":{"1min":0.32600000000000001,"5min":0.253,"15min":0.253},"max":{"1min":0.54600000000000004,"5min":0.747,"15min":0.79100000000000004},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.5,"15min":0.48999999999999999},"min":{"1min":0.32000000000000001,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.70699999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.40899999999999997}]},{"osd":1,"last update":"Tue Apr 2 07:28:22 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52700000000000002,"15min":0.54300000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.67500000000000004,"5min":0.80800000000000005,"15min":1.171},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.496,"15min":0.495},"min":{"1min":0.37,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.63600000000000001,"5min":0.74299999999999999,"15min":1.333},"last":0.438}]},{"osd":3,"last update":"Tue Apr 2 07:28:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53300000000000003,"15min":0.51900000000000002},"min":{"1min":0.46800000000000003,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.68200000000000005,"5min":0.80000000000000004,"15min":0.86299999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57399999999999995,"15min":0.56899999999999995},"min":{"1min":0.42199999999999999,"5min":0.39900000000000002,"15min":0.39800000000000002},"max":{"1min":0.72399999999999998,"5min":0.83099999999999996,"15min":1.1140000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Apr 2 07:28:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77500000000000002,"5min":0.76300000000000001,"15min":0.77400000000000002},"min":{"1min":0.51100000000000001,"5min":0.47699999999999998,"15min":0.47199999999999998},"max":{"1min":1.0740000000000001,"5min":1.5309999999999999,"15min":2.254},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.82699999999999996,"5min":0.78600000000000003,"15min":0.77300000000000002},"min":{"1min":0.59599999999999997,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0669999999999999,"5min":1.2210000000000001,"15min":1.3420000000000001},"last":0.80600000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:28:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77200000000000002,"15min":0.76300000000000001},"min":{"1min":0.63700000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.98899999999999999,"5min":1.2629999999999999,"15min":1.3740000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.79300000000000004,"15min":0.81299999999999994},"min":{"1min":0.54900000000000004,"5min":0.443,"15min":0.443},"max":{"1min":0.96299999999999997,"5min":1.3149999999999999,"15min":2.0840000000000001},"last":0.76600000000000001}]},{"osd":6,"last update":"Tue Apr 2 07:28:22 2024","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.82799999999999996,"15min":0.82799999999999996},"min":{"1min":0.67500000000000004,"5min":0.60499999999999998,"15min":0.57099999999999995},"max":{"1min":1.0700000000000001,"5min":1.5029999999999999,"15min":1.5029999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.83299999999999996,"15min":0.82799999999999996},"min":{"1min":0.64000000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.087,"5min":1.425,"15min":1.425},"last":0.91500000000000004}]},{"osd":7,"last update":"Tue Apr 2 07:28:22 2024","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.80300000000000005,"15min":0.83299999999999996},"min":{"1min":0.65300000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0189999999999999,"5min":1.4750000000000001,"15min":2.3580000000000001},"last":0.88},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.81999999999999995,"15min":0.82699999999999996},"min":{"1min":0.75900000000000001,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":1.0029999999999999,"5min":1.377,"15min":1.377},"last":0.82599999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1081344,"data_stored":457252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.437,"5min":0.42999999999999999,"15min":0.47299999999999998},"min":{"1min":0.29599999999999999,"5min":0.254,"15min":0.251},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":1.2150000000000001},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.499,"15min":0.623},"min":{"1min":0.34799999999999998,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.57599999999999996,"5min":1.093,"15min":4.157},"last":0.33900000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46200000000000002,"15min":0.628},"min":{"1min":0.33100000000000002,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.69799999999999995,"5min":0.70099999999999996,"15min":4.282},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.52100000000000002,"15min":0.59099999999999997},"min":{"1min":0.36299999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.68300000000000005,"5min":0.79500000000000004,"15min":1.625},"last":0.503}]},{"osd":3,"last update":"Tue Apr 2 07:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57899999999999996,"15min":0.60799999999999998},"min":{"1min":0.46999999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.83199999999999996,"5min":0.97299999999999998,"15min":1.1120000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54100000000000004,"15min":0.84899999999999998},"min":{"1min":0.435,"5min":0.36299999999999999,"15min":0.35999999999999999},"max":{"1min":0.80200000000000005,"5min":1.052,"15min":8.1620000000000008},"last":0.57599999999999996}]},{"osd":4,"last update":"Tue Apr 2 07:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.73499999999999999,"15min":0.92900000000000005},"min":{"1min":0.50800000000000001,"5min":0.46800000000000003,"15min":0.40000000000000002},"max":{"1min":1.0329999999999999,"5min":1.105,"15min":4.7400000000000002},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.751,"5min":0.755,"15min":0.81599999999999995},"min":{"1min":0.55100000000000005,"5min":0.50600000000000001,"15min":0.50600000000000001},"max":{"1min":0.97099999999999997,"5min":0.996,"15min":1.7070000000000001},"last":0.63500000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77000000000000002,"15min":0.91900000000000004},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.497},"max":{"1min":1.018,"5min":1.163,"15min":4.5759999999999996},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76200000000000001,"15min":0.92200000000000004},"min":{"1min":0.52000000000000002,"5min":0.48999999999999999,"15min":0.47999999999999998},"max":{"1min":1,"5min":1.1539999999999999,"15min":4.7949999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Tue Apr 2 07:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.77000000000000002,"15min":0.96199999999999997},"min":{"1min":0.52800000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":0.97999999999999998,"5min":1.129,"15min":4.6890000000000001},"last":0.621},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.76600000000000001,"15min":0.94099999999999995},"min":{"1min":0.54700000000000004,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0589999999999999,"5min":1.0720000000000001,"15min":4.6059999999999999},"last":0.68000000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:28:20 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.77200000000000002,"15min":0.82799999999999996},"min":{"1min":0.59699999999999998,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.1200000000000001,"5min":1.137,"15min":1.8759999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.79800000000000004,"15min":0.94999999999999996},"min":{"1min":0.59499999999999997,"5min":0.55800000000000005,"15min":0.5},"max":{"1min":1.0509999999999999,"5min":1.383,"15min":4.6420000000000003},"last":0.73699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32752,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339088,"statfs":{"total":96636764160,"available":96603226112,"internally_reserved":0,"allocated":1667072,"data_stored":1047460,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.40000000000000002,"5min":0.42199999999999999,"15min":0.46600000000000003},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.47899999999999998,"5min":0.71699999999999997,"15min":1.48},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.502,"15min":0.50800000000000001},"min":{"1min":0.39100000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.63800000000000001,"5min":0.76800000000000002,"15min":1.2330000000000001},"last":0.48999999999999999}]},{"osd":2,"last update":"Tue Apr 2 07:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.496,"15min":0.52000000000000002},"min":{"1min":0.313,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.57799999999999996,"5min":0.79100000000000004,"15min":1.3129999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54200000000000004,"15min":0.52600000000000002},"min":{"1min":0.42299999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68200000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54400000000000004}]},{"osd":3,"last update":"Tue Apr 2 07:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.73899999999999999,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.441},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.57699999999999996,"15min":0.61699999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40300000000000002},"max":{"1min":0.76300000000000001,"5min":0.98099999999999998,"15min":1.4430000000000001},"last":0.51600000000000001}]},{"osd":4,"last update":"Tue Apr 2 07:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.74399999999999999,"15min":0.73499999999999999},"min":{"1min":0.53400000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.96899999999999997,"5min":1.036,"15min":1.0569999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.74299999999999999,"15min":0.745},"min":{"1min":0.56699999999999995,"5min":0.51400000000000001,"15min":0.501},"max":{"1min":1.0840000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.752}]},{"osd":5,"last update":"Tue Apr 2 07:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.754,"15min":0.78700000000000003},"min":{"1min":0.54400000000000004,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.371},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.76100000000000001,"15min":0.76500000000000001},"min":{"1min":0.55800000000000005,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.1000000000000001,"5min":1.143,"15min":1.143},"last":0.85799999999999998}]},{"osd":6,"last update":"Tue Apr 2 07:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.78600000000000003,"15min":0.80000000000000004},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.80200000000000005,"15min":0.83799999999999997},"min":{"1min":0.66200000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.1839999999999999,"15min":1.4099999999999999},"last":0.82799999999999996}]},{"osd":7,"last update":"Tue Apr 2 07:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.77600000000000002,"15min":0.79500000000000004},"min":{"1min":0.59099999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.046,"5min":1.069,"15min":1.135},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.77500000000000002,"15min":0.78800000000000003},"min":{"1min":0.68799999999999994,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.079,"5min":1.1279999999999999,"15min":1.141},"last":0.78700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:28:58.453 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-02T07:28:58.454 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-02T07:28:58.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.635+0000 7fa42a000640 1 Processor -- start 2024-04-02T07:28:58.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.635+0000 7fa42a000640 1 -- start start 2024-04-02T07:28:58.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.635+0000 7fa42a000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa4240cc7a0 0x7fa424069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:58.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa42a000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42415d0c0 con 0x7fa42406a2d0 2024-04-02T07:28:58.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa42a000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4240c9bb0 con 0x7fa42415cce0 2024-04-02T07:28:58.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa42a000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa42406a760 con 0x7fa4240cc7a0 2024-04-02T07:28:58.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa423e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa42406a2d0 0x7fa4240ca0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37212/0 (socket says 172.21.15.55:37212) 2024-04-02T07:28:58.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa423e00640 1 -- 172.21.15.55:0/3263492016 learned_addr learned my addr 172.21.15.55:0/3263492016 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:58.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa41be00640 1 --2- 172.21.15.55:0/3263492016 >> v2:172.21.15.106:3300/0 conn(0x7fa4240cc7a0 0x7fa424069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:58.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa422a00640 1 -- 172.21.15.55:0/3263492016 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 274552336 0 0) 0x7fa41c0014a0 con 0x7fa42406a2d0 2024-04-02T07:28:58.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa422a00640 1 -- 172.21.15.55:0/3263492016 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa408003530 con 0x7fa42406a2d0 2024-04-02T07:28:58.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa422a00640 1 -- 172.21.15.55:0/3263492016 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3288232386 0 0) 0x7fa408003530 con 0x7fa42406a2d0 2024-04-02T07:28:58.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa422a00640 1 -- 172.21.15.55:0/3263492016 >> v2:172.21.15.106:3300/0 conn(0x7fa4240cc7a0 msgr2=0x7fa424069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:58.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa422a00640 1 --2- 172.21.15.55:0/3263492016 >> v2:172.21.15.106:3300/0 conn(0x7fa4240cc7a0 0x7fa424069d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa422a00640 1 -- 172.21.15.55:0/3263492016 >> v1:172.21.15.106:6789/0 conn(0x7fa42415cce0 legacy=0x7fa4240cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:58.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa422a00640 1 -- 172.21.15.55:0/3263492016 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4240ccd10 con 0x7fa42406a2d0 2024-04-02T07:28:58.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa422a00640 1 -- 172.21.15.55:0/3263492016 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fa41c001b90 con 0x7fa42406a2d0 2024-04-02T07:28:58.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa422a00640 1 -- 172.21.15.55:0/3263492016 >> v1:172.21.15.55:6789/0 conn(0x7fa42406a2d0 legacy=0x7fa4240ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:58.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa422a00640 1 --2- 172.21.15.55:0/3263492016 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa408003980 0x7fa408003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:58.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa422a00640 1 --2- 172.21.15.55:0/3263492016 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4080047d0 0x7fa408004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:58.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa422a00640 1 --2- 172.21.15.55:0/3263492016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa408005190 0x7fa40800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:58.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa422a00640 1 -- 172.21.15.55:0/3263492016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42406a760 con 0x7fa408005190 2024-04-02T07:28:58.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa422a00640 1 -- 172.21.15.55:0/3263492016 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa40800c030 con 0x7fa408003980 2024-04-02T07:28:58.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa422a00640 1 -- 172.21.15.55:0/3263492016 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40800c1f0 con 0x7fa4080047d0 2024-04-02T07:28:58.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa423e00640 1 --2- 172.21.15.55:0/3263492016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa408005190 0x7fa40800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:58.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa423400640 1 --2- 172.21.15.55:0/3263492016 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa408003980 0x7fa408003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:58.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa41be00640 1 --2- 172.21.15.55:0/3263492016 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4080047d0 0x7fa408004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:58.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa423e00640 1 -- 172.21.15.55:0/3263492016 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4080047d0 msgr2=0x7fa408004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:58.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa423e00640 1 --2- 172.21.15.55:0/3263492016 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4080047d0 0x7fa408004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa423e00640 1 -- 172.21.15.55:0/3263492016 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa408003980 msgr2=0x7fa408003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:58.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa423e00640 1 --2- 172.21.15.55:0/3263492016 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa408003980 0x7fa408003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa423e00640 1 -- 172.21.15.55:0/3263492016 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa408003530 con 0x7fa408005190 2024-04-02T07:28:58.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.639+0000 7fa423400640 1 --2- 172.21.15.55:0/3263492016 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa408003980 0x7fa408003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:28:58.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.643+0000 7fa423e00640 1 -- 172.21.15.55:0/3263492016 reap_dead start 2024-04-02T07:28:58.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.643+0000 7fa423e00640 1 --2- 172.21.15.55:0/3263492016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa408005190 0x7fa40800b990 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00a830 tx=0x7fa41c01d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4edde5a1d8a79e53 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:58.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.643+0000 7fa422a00640 1 -- 172.21.15.55:0/3263492016 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c0ad630 con 0x7fa408005190 2024-04-02T07:28:58.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.643+0000 7fa422a00640 1 -- 172.21.15.55:0/3263492016 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41c0a8070 con 0x7fa408005190 2024-04-02T07:28:58.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.643+0000 7fa422a00640 1 -- 172.21.15.55:0/3263492016 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c0ad9f0 con 0x7fa408005190 2024-04-02T07:28:58.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.643+0000 7fa42a000640 1 -- 172.21.15.55:0/3263492016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa408005190 msgr2=0x7fa40800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:58.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.643+0000 7fa42a000640 1 --2- 172.21.15.55:0/3263492016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa408005190 0x7fa40800b990 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00a830 tx=0x7fa41c01d360 comp rx=0 tx=0).stop 2024-04-02T07:28:58.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.643+0000 7fa42a000640 1 -- 172.21.15.55:0/3263492016 shutdown_connections 2024-04-02T07:28:58.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.643+0000 7fa42a000640 1 --2- 172.21.15.55:0/3263492016 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa408005190 0x7fa40800b990 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.643+0000 7fa42a000640 1 -- 172.21.15.55:0/3263492016 >> 172.21.15.55:0/3263492016 conn(0x7fa424098a10 msgr2=0x7fa4240cf560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:58.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.643+0000 7fa42a000640 1 -- 172.21.15.55:0/3263492016 shutdown_connections 2024-04-02T07:28:58.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.643+0000 7fa42a000640 1 -- 172.21.15.55:0/3263492016 wait complete. 2024-04-02T07:28:58.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.643+0000 7fa42a000640 1 Processor -- start 2024-04-02T07:28:58.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.643+0000 7fa42a000640 1 -- start start 2024-04-02T07:28:58.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa42a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa408005190 0x7fa42414d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:58.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa42a000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa42415ffb0 0x7fa424146920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:58.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa42a000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa424146e60 0x7fa4241f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:58.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa42a000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa424147310 con 0x7fa408005190 2024-04-02T07:28:58.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa42a000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42415f5a0 con 0x7fa42415ffb0 2024-04-02T07:28:58.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa42a000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42415d5b0 con 0x7fa424146e60 2024-04-02T07:28:58.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa423400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa408005190 0x7fa42414d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:58.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa423400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa408005190 0x7fa42414d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51432/0 (socket says 172.21.15.55:51432) 2024-04-02T07:28:58.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa423400640 1 -- 172.21.15.55:0/2021557950 learned_addr learned my addr 172.21.15.55:0/2021557950 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:58.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa423e00640 1 --2- 172.21.15.55:0/2021557950 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa424146e60 0x7fa4241f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:58.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa41be00640 1 --2- 172.21.15.55:0/2021557950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa42415ffb0 0x7fa424146920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:58.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa423400640 1 -- 172.21.15.55:0/2021557950 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa424146e60 msgr2=0x7fa4241f5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:58.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa423400640 1 --2- 172.21.15.55:0/2021557950 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa424146e60 0x7fa4241f5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa423400640 1 -- 172.21.15.55:0/2021557950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa42415ffb0 msgr2=0x7fa424146920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:58.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa423400640 1 --2- 172.21.15.55:0/2021557950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa42415ffb0 0x7fa424146920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa423400640 1 -- 172.21.15.55:0/2021557950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4240c8fd0 con 0x7fa408005190 2024-04-02T07:28:58.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa423400640 1 --2- 172.21.15.55:0/2021557950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa408005190 0x7fa42414d050 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fa41400f7f0 tx=0x7fa41400fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:58.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa41b400640 1 -- 172.21.15.55:0/2021557950 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4140052e0 con 0x7fa408005190 2024-04-02T07:28:58.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa41b400640 1 -- 172.21.15.55:0/2021557950 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa414005440 con 0x7fa408005190 2024-04-02T07:28:58.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa41b400640 1 -- 172.21.15.55:0/2021557950 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41400d930 con 0x7fa408005190 2024-04-02T07:28:58.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa42a000640 1 -- 172.21.15.55:0/2021557950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4240c92b0 con 0x7fa408005190 2024-04-02T07:28:58.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa42a000640 1 -- 172.21.15.55:0/2021557950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42415fa90 con 0x7fa408005190 2024-04-02T07:28:58.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa42a000640 1 -- 172.21.15.55:0/2021557950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42415fc50 con 0x7fa408005190 2024-04-02T07:28:58.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.647+0000 7fa41b400640 1 -- 172.21.15.55:0/2021557950 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa41400da90 con 0x7fa408005190 2024-04-02T07:28:58.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.651+0000 7fa41b400640 1 --2- 172.21.15.55:0/2021557950 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa400066690 0x7fa400068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:58.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.651+0000 7fa41b400640 1 -- 172.21.15.55:0/2021557950 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa414084280 con 0x7fa408005190 2024-04-02T07:28:58.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.651+0000 7fa41be00640 1 --2- 172.21.15.55:0/2021557950 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa400066690 0x7fa400068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:58.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.651+0000 7fa41be00640 1 --2- 172.21.15.55:0/2021557950 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa400066690 0x7fa400068b50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa4241603f0 tx=0x7fa40c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:58.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.655+0000 7fa41b400640 1 -- 172.21.15.55:0/2021557950 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa414051550 con 0x7fa408005190 2024-04-02T07:28:58.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.867+0000 7fa42a000640 1 -- 172.21.15.55:0/2021557950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fa424066c90 con 0x7fa408005190 2024-04-02T07:28:58.874 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.871+0000 7fa41b400640 1 -- 172.21.15.55:0/2021557950 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7fa414054b70 con 0x7fa408005190 2024-04-02T07:28:58.874 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2024-04-02T07:28:58.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.875+0000 7fa42a000640 1 -- 172.21.15.55:0/2021557950 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa400066690 msgr2=0x7fa400068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:58.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.875+0000 7fa42a000640 1 --2- 172.21.15.55:0/2021557950 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa400066690 0x7fa400068b50 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa4241603f0 tx=0x7fa40c008040 comp rx=0 tx=0).stop 2024-04-02T07:28:58.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.875+0000 7fa42a000640 1 -- 172.21.15.55:0/2021557950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa408005190 msgr2=0x7fa42414d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.875+0000 7fa42a000640 1 --2- 172.21.15.55:0/2021557950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa408005190 0x7fa42414d050 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7fa41400f7f0 tx=0x7fa41400fcb0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.875+0000 7fa42a000640 1 -- 172.21.15.55:0/2021557950 shutdown_connections 2024-04-02T07:28:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.875+0000 7fa42a000640 1 --2- 172.21.15.55:0/2021557950 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa424146e60 0x7fa4241f5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.875+0000 7fa42a000640 1 --2- 172.21.15.55:0/2021557950 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa400066690 0x7fa400068b50 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.875+0000 7fa42a000640 1 --2- 172.21.15.55:0/2021557950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa42415ffb0 0x7fa424146920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.875+0000 7fa42a000640 1 --2- 172.21.15.55:0/2021557950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa408005190 0x7fa42414d050 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.875+0000 7fa42a000640 1 -- 172.21.15.55:0/2021557950 >> 172.21.15.55:0/2021557950 conn(0x7fa424098a10 msgr2=0x7fa4240b1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.875+0000 7fa42a000640 1 -- 172.21.15.55:0/2021557950 shutdown_connections 2024-04-02T07:28:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:58.875+0000 7fa42a000640 1 -- 172.21.15.55:0/2021557950 wait complete. 2024-04-02T07:28:58.895 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:28:59.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa580c00640 1 Processor -- start 2024-04-02T07:28:59.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa580c00640 1 -- start start 2024-04-02T07:28:59.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa580c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa57c15ca70 0x7fa57c0b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa580c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa57c15ce50 con 0x7fa57c098a10 2024-04-02T07:28:59.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa580c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa57c0cef60 con 0x7fa57c06b700 2024-04-02T07:28:59.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa580c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa57c06bd60 con 0x7fa57c15ca70 2024-04-02T07:28:59.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa579400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa57c098a10 0x7fa57c06aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37220/0 (socket says 172.21.15.55:37220) 2024-04-02T07:28:59.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa579400640 1 -- 172.21.15.55:0/1228788480 learned_addr learned my addr 172.21.15.55:0/1228788480 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:59.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa579e00640 1 --2- 172.21.15.55:0/1228788480 >> v2:172.21.15.106:3300/0 conn(0x7fa57c15ca70 0x7fa57c0b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa578a00640 1 -- 172.21.15.55:0/1228788480 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2447015845 0 0) 0x7fa57c15ce50 con 0x7fa57c098a10 2024-04-02T07:28:59.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa578a00640 1 -- 172.21.15.55:0/1228788480 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa560003530 con 0x7fa57c098a10 2024-04-02T07:28:59.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa578a00640 1 -- 172.21.15.55:0/1228788480 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 119129178 0 0) 0x7fa560003530 con 0x7fa57c098a10 2024-04-02T07:28:59.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa578a00640 1 -- 172.21.15.55:0/1228788480 >> v2:172.21.15.106:3300/0 conn(0x7fa57c15ca70 msgr2=0x7fa57c0b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:59.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa578a00640 1 --2- 172.21.15.55:0/1228788480 >> v2:172.21.15.106:3300/0 conn(0x7fa57c15ca70 0x7fa57c0b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa578a00640 1 -- 172.21.15.55:0/1228788480 >> v1:172.21.15.106:6789/0 conn(0x7fa57c06b700 legacy=0x7fa57c0cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:59.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa578a00640 1 -- 172.21.15.55:0/1228788480 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57c06c040 con 0x7fa57c098a10 2024-04-02T07:28:59.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa578a00640 1 -- 172.21.15.55:0/1228788480 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fa568001680 con 0x7fa57c098a10 2024-04-02T07:28:59.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa578a00640 1 -- 172.21.15.55:0/1228788480 >> v1:172.21.15.55:6789/0 conn(0x7fa57c098a10 legacy=0x7fa57c06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:59.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa578a00640 1 --2- 172.21.15.55:0/1228788480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa560003980 0x7fa560003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa578a00640 1 --2- 172.21.15.55:0/1228788480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5600047d0 0x7fa560004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa578a00640 1 --2- 172.21.15.55:0/1228788480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa560005190 0x7fa56000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa578a00640 1 -- 172.21.15.55:0/1228788480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c06bd60 con 0x7fa560005190 2024-04-02T07:28:59.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa578a00640 1 -- 172.21.15.55:0/1228788480 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56000c030 con 0x7fa560003980 2024-04-02T07:28:59.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa578a00640 1 -- 172.21.15.55:0/1228788480 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56000c1f0 con 0x7fa5600047d0 2024-04-02T07:28:59.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa579e00640 1 --2- 172.21.15.55:0/1228788480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa560003980 0x7fa560003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa57a800640 1 --2- 172.21.15.55:0/1228788480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa560005190 0x7fa56000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa579400640 1 --2- 172.21.15.55:0/1228788480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5600047d0 0x7fa560004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa57a800640 1 -- 172.21.15.55:0/1228788480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5600047d0 msgr2=0x7fa560004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:59.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa57a800640 1 --2- 172.21.15.55:0/1228788480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa5600047d0 0x7fa560004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa57a800640 1 -- 172.21.15.55:0/1228788480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa560003980 msgr2=0x7fa560003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:59.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa57a800640 1 --2- 172.21.15.55:0/1228788480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa560003980 0x7fa560003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa57a800640 1 -- 172.21.15.55:0/1228788480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa560003530 con 0x7fa560005190 2024-04-02T07:28:59.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.035+0000 7fa579e00640 1 --2- 172.21.15.55:0/1228788480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa560003980 0x7fa560003da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:28:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.039+0000 7fa57a800640 1 -- 172.21.15.55:0/1228788480 reap_dead start 2024-04-02T07:28:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.039+0000 7fa57a800640 1 --2- 172.21.15.55:0/1228788480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa560005190 0x7fa56000b990 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fa574001e70 tx=0x7fa57401c780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=304aa5cc286c05cd server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.039+0000 7fa578a00640 1 -- 172.21.15.55:0/1228788480 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574003b80 con 0x7fa560005190 2024-04-02T07:28:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.039+0000 7fa578a00640 1 -- 172.21.15.55:0/1228788480 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa574003d20 con 0x7fa560005190 2024-04-02T07:28:59.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.039+0000 7fa578a00640 1 -- 172.21.15.55:0/1228788480 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574005260 con 0x7fa560005190 2024-04-02T07:28:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.039+0000 7fa580c00640 1 -- 172.21.15.55:0/1228788480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa560005190 msgr2=0x7fa56000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.039+0000 7fa580c00640 1 --2- 172.21.15.55:0/1228788480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa560005190 0x7fa56000b990 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fa574001e70 tx=0x7fa57401c780 comp rx=0 tx=0).stop 2024-04-02T07:28:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.039+0000 7fa580c00640 1 -- 172.21.15.55:0/1228788480 shutdown_connections 2024-04-02T07:28:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.039+0000 7fa580c00640 1 --2- 172.21.15.55:0/1228788480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa560005190 0x7fa56000b990 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.039+0000 7fa580c00640 1 -- 172.21.15.55:0/1228788480 >> 172.21.15.55:0/1228788480 conn(0x7fa57c0b21d0 msgr2=0x7fa57c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.039+0000 7fa580c00640 1 -- 172.21.15.55:0/1228788480 shutdown_connections 2024-04-02T07:28:59.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.039+0000 7fa580c00640 1 -- 172.21.15.55:0/1228788480 wait complete. 2024-04-02T07:28:59.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa580c00640 1 Processor -- start 2024-04-02T07:28:59.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa580c00640 1 -- start start 2024-04-02T07:28:59.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa580c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa560005190 0x7fa57c0b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa580c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa57c0b44e0 0x7fa57c1f5d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa580c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa57c1f62b0 0x7fa57c14d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa580c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c0b4960 con 0x7fa57c1f62b0 2024-04-02T07:28:59.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa580c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c0b6350 con 0x7fa560005190 2024-04-02T07:28:59.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa580c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa57c15f4b0 con 0x7fa57c0b44e0 2024-04-02T07:28:59.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa57a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa57c1f62b0 0x7fa57c14d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa57a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa57c1f62b0 0x7fa57c14d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51456/0 (socket says 172.21.15.55:51456) 2024-04-02T07:28:59.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa57a800640 1 -- 172.21.15.55:0/3927177437 learned_addr learned my addr 172.21.15.55:0/3927177437 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:59.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa579e00640 1 --2- 172.21.15.55:0/3927177437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa560005190 0x7fa57c0b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa579400640 1 --2- 172.21.15.55:0/3927177437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa57c0b44e0 0x7fa57c1f5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa57a800640 1 -- 172.21.15.55:0/3927177437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa57c0b44e0 msgr2=0x7fa57c1f5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:59.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa57a800640 1 --2- 172.21.15.55:0/3927177437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa57c0b44e0 0x7fa57c1f5d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa57a800640 1 -- 172.21.15.55:0/3927177437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa560005190 msgr2=0x7fa57c0b3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:59.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa57a800640 1 --2- 172.21.15.55:0/3927177437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa560005190 0x7fa57c0b3fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa57a800640 1 -- 172.21.15.55:0/3927177437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa57c1f2750 con 0x7fa57c1f62b0 2024-04-02T07:28:59.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa57a800640 1 --2- 172.21.15.55:0/3927177437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa57c1f62b0 0x7fa57c14d260 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fa57401d020 tx=0x7fa560005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:59.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa572000640 1 -- 172.21.15.55:0/3927177437 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa574006d60 con 0x7fa57c1f62b0 2024-04-02T07:28:59.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa572000640 1 -- 172.21.15.55:0/3927177437 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa574007dc0 con 0x7fa57c1f62b0 2024-04-02T07:28:59.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa580c00640 1 -- 172.21.15.55:0/3927177437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa57c1f2a30 con 0x7fa57c1f62b0 2024-04-02T07:28:59.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa572000640 1 -- 172.21.15.55:0/3927177437 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5740a66a0 con 0x7fa57c1f62b0 2024-04-02T07:28:59.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.043+0000 7fa580c00640 1 -- 172.21.15.55:0/3927177437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa57c1f2400 con 0x7fa57c1f62b0 2024-04-02T07:28:59.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.047+0000 7fa580c00640 1 -- 172.21.15.55:0/3927177437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa57c0b48c0 con 0x7fa57c1f62b0 2024-04-02T07:28:59.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.047+0000 7fa572000640 1 -- 172.21.15.55:0/3927177437 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa5740a6800 con 0x7fa57c1f62b0 2024-04-02T07:28:59.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.047+0000 7fa572000640 1 --2- 172.21.15.55:0/3927177437 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa55c0666c0 0x7fa55c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.047+0000 7fa572000640 1 -- 172.21.15.55:0/3927177437 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa57411d4b0 con 0x7fa57c1f62b0 2024-04-02T07:28:59.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.047+0000 7fa579e00640 1 --2- 172.21.15.55:0/3927177437 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa55c0666c0 0x7fa55c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.047+0000 7fa579e00640 1 --2- 172.21.15.55:0/3927177437 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa55c0666c0 0x7fa55c068b80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa57c15f010 tx=0x7fa56c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:59.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.051+0000 7fa572000640 1 -- 172.21.15.55:0/3927177437 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa5740ea960 con 0x7fa57c1f62b0 2024-04-02T07:28:59.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.247+0000 7fa580c00640 1 -- 172.21.15.55:0/3927177437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa57c066c90 con 0x7fa57c1f62b0 2024-04-02T07:28:59.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.247+0000 7fa572000640 1 -- 172.21.15.55:0/3927177437 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4739 (secure 0 0 0) 0x7fa5740b6090 con 0x7fa57c1f62b0 2024-04-02T07:28:59.248 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:28:59.248 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2209852195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2209852195},{"type":"v1","addr":"172.21.15.55:6835","nonce":2209852195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1897181831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1897181831},{"type":"v1","addr":"172.21.15.106:6835","nonce":1897181831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":7455,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/821922065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":821922065},{"type":"v1","addr":"172.21.15.55:6834","nonce":821922065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:28:53.919977+0000","modified":"2024-04-02T07:28:56.946080+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7464":{"gid":7464,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6837/2582023800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":2582023800},{"type":"v1","addr":"172.21.15.106:6837","nonce":2582023800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-02T07:28:59.249 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 60 2024-04-02T07:28:59.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.247+0000 7fa580c00640 1 -- 172.21.15.55:0/3927177437 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa55c0666c0 msgr2=0x7fa55c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:59.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.247+0000 7fa580c00640 1 --2- 172.21.15.55:0/3927177437 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa55c0666c0 0x7fa55c068b80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa57c15f010 tx=0x7fa56c008040 comp rx=0 tx=0).stop 2024-04-02T07:28:59.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.247+0000 7fa580c00640 1 -- 172.21.15.55:0/3927177437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa57c1f62b0 msgr2=0x7fa57c14d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:59.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.247+0000 7fa580c00640 1 --2- 172.21.15.55:0/3927177437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa57c1f62b0 0x7fa57c14d260 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fa57401d020 tx=0x7fa560005800 comp rx=0 tx=0).stop 2024-04-02T07:28:59.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.247+0000 7fa580c00640 1 -- 172.21.15.55:0/3927177437 shutdown_connections 2024-04-02T07:28:59.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.247+0000 7fa580c00640 1 --2- 172.21.15.55:0/3927177437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa57c1f62b0 0x7fa57c14d260 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.247+0000 7fa580c00640 1 --2- 172.21.15.55:0/3927177437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa57c0b44e0 0x7fa57c1f5d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.247+0000 7fa580c00640 1 --2- 172.21.15.55:0/3927177437 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa55c0666c0 0x7fa55c068b80 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.247+0000 7fa580c00640 1 --2- 172.21.15.55:0/3927177437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa560005190 0x7fa57c0b3fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.247+0000 7fa580c00640 1 -- 172.21.15.55:0/3927177437 >> 172.21.15.55:0/3927177437 conn(0x7fa57c0b21d0 msgr2=0x7fa57c0ad270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:59.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.247+0000 7fa580c00640 1 -- 172.21.15.55:0/3927177437 shutdown_connections 2024-04-02T07:28:59.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.247+0000 7fa580c00640 1 -- 172.21.15.55:0/3927177437 wait complete. 2024-04-02T07:28:59.672 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:28:53.919977+0000', 'modified': '2024-04-02T07:28:56.946080+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7464}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7464': {'gid': 7464, 'name': 'b', 'rank': 0, 'incarnation': 56, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.106:6837/2582023800', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6836', 'nonce': 2582023800}, {'type': 'v1', 'addr': '172.21.15.106:6837', 'nonce': 2582023800}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:28:59.673 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-02T07:28:59.673 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-02T07:28:59.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.815+0000 7fc0d0a00640 1 Processor -- start 2024-04-02T07:28:59.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.815+0000 7fc0d0a00640 1 -- start start 2024-04-02T07:28:59.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.815+0000 7fc0d0a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0cc0cf420 0x7fc0cc0b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.815+0000 7fc0d0a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc0cc0b3350 0x7fc0cc0cb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.815+0000 7fc0d0a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0cc0b1e30 con 0x7fc0cc098a10 2024-04-02T07:28:59.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.815+0000 7fc0d0a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0cc099dc0 con 0x7fc0cc0b3350 2024-04-02T07:28:59.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.815+0000 7fc0d0a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc0ce170 con 0x7fc0cc0cf420 2024-04-02T07:28:59.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.815+0000 7fc0cb200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc0cc0b3350 0x7fc0cc0cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.815+0000 7fc0ca800640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc0cc098a10 0x7fc0cc098df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:57210/0 (socket says 172.21.15.55:57210) 2024-04-02T07:28:59.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.815+0000 7fc0cb200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc0cc0b3350 0x7fc0cc0cb720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:36630/0 (socket says 172.21.15.55:36630) 2024-04-02T07:28:59.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.815+0000 7fc0ca800640 1 -- 172.21.15.55:0/2309338867 learned_addr learned my addr 172.21.15.55:0/2309338867 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:28:59.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.815+0000 7fc0c1e00640 1 --2- 172.21.15.55:0/2309338867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0cc0cf420 0x7fc0cc0b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.815+0000 7fc0cb200640 1 -- 172.21.15.55:0/2309338867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0cc0cf420 msgr2=0x7fc0cc0b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:59.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.815+0000 7fc0cb200640 1 --2- 172.21.15.55:0/2309338867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0cc0cf420 0x7fc0cc0b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.815+0000 7fc0cb200640 1 -- 172.21.15.55:0/2309338867 >> v1:172.21.15.106:6789/0 conn(0x7fc0cc098a10 legacy=0x7fc0cc098df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:59.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.815+0000 7fc0cb200640 1 -- 172.21.15.55:0/2309338867 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0cc0ce450 con 0x7fc0cc0b3350 2024-04-02T07:28:59.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.819+0000 7fc0cb200640 1 --2- 172.21.15.55:0/2309338867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0cc0b3350 0x7fc0cc0cb720 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4009d90 tx=0x7fc0c401c6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb8129c3cbb932c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:59.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.819+0000 7fc0c9e00640 1 -- 172.21.15.55:0/2309338867 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c40a5790 con 0x7fc0cc0b3350 2024-04-02T07:28:59.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.819+0000 7fc0c9e00640 1 -- 172.21.15.55:0/2309338867 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0c40a58f0 con 0x7fc0cc0b3350 2024-04-02T07:28:59.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.819+0000 7fc0c9e00640 1 -- 172.21.15.55:0/2309338867 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0c40a5c80 con 0x7fc0cc0b3350 2024-04-02T07:28:59.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.819+0000 7fc0d0a00640 1 -- 172.21.15.55:0/2309338867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0cc0b3350 msgr2=0x7fc0cc0cb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:59.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.819+0000 7fc0d0a00640 1 --2- 172.21.15.55:0/2309338867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0cc0b3350 0x7fc0cc0cb720 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc0c4009d90 tx=0x7fc0c401c6d0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.819+0000 7fc0d0a00640 1 -- 172.21.15.55:0/2309338867 shutdown_connections 2024-04-02T07:28:59.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.819+0000 7fc0d0a00640 1 --2- 172.21.15.55:0/2309338867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0cc0b3350 0x7fc0cc0cb720 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.819+0000 7fc0d0a00640 1 --2- 172.21.15.55:0/2309338867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0cc0cf420 0x7fc0cc0b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.819+0000 7fc0d0a00640 1 -- 172.21.15.55:0/2309338867 >> 172.21.15.55:0/2309338867 conn(0x7fc0cc0ccf80 msgr2=0x7fc0cc0cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:59.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.819+0000 7fc0d0a00640 1 -- 172.21.15.55:0/2309338867 shutdown_connections 2024-04-02T07:28:59.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.819+0000 7fc0d0a00640 1 -- 172.21.15.55:0/2309338867 wait complete. 2024-04-02T07:28:59.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0d0a00640 1 Processor -- start 2024-04-02T07:28:59.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0d0a00640 1 -- start start 2024-04-02T07:28:59.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0d0a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0cc098a10 0x7fc0cc164970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0d0a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0cc0b3350 0x7fc0cc156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0d0a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0cc0cf420 0x7fc0cc158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0d0a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc0b37d0 con 0x7fc0cc0cf420 2024-04-02T07:28:59.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0d0a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc164eb0 con 0x7fc0cc0b3350 2024-04-02T07:28:59.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0d0a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0cc0b3a40 con 0x7fc0cc098a10 2024-04-02T07:28:59.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0cb200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0cc0cf420 0x7fc0cc158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0ca800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0cc098a10 0x7fc0cc164970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0c1e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0cc0b3350 0x7fc0cc156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0c1e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0cc0b3350 0x7fc0cc156fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:36646/0 (socket says 172.21.15.55:36646) 2024-04-02T07:28:59.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0ca800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0cc098a10 0x7fc0cc164970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:55950/0 (socket says 172.21.15.55:55950) 2024-04-02T07:28:59.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0c1e00640 1 -- 172.21.15.55:0/1483413463 learned_addr learned my addr 172.21.15.55:0/1483413463 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:59.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0cb200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0cc0cf420 0x7fc0cc158b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51462/0 (socket says 172.21.15.55:51462) 2024-04-02T07:28:59.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0c1e00640 1 -- 172.21.15.55:0/1483413463 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0cc098a10 msgr2=0x7fc0cc164970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:59.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0c1e00640 1 --2- 172.21.15.55:0/1483413463 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0cc098a10 0x7fc0cc164970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0c1e00640 1 -- 172.21.15.55:0/1483413463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0cc0cf420 msgr2=0x7fc0cc158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:59.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0c1e00640 1 --2- 172.21.15.55:0/1483413463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0cc0cf420 0x7fc0cc158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0c1e00640 1 -- 172.21.15.55:0/1483413463 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0c4009a70 con 0x7fc0cc0b3350 2024-04-02T07:28:59.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0cb200640 1 --2- 172.21.15.55:0/1483413463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0cc0cf420 0x7fc0cc158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:28:59.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0c1e00640 1 --2- 172.21.15.55:0/1483413463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0cc0b3350 0x7fc0cc156fb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400e900 tx=0x7fc0b400edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:59.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.823+0000 7fc0c3400640 1 -- 172.21.15.55:0/1483413463 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4009690 con 0x7fc0cc0b3350 2024-04-02T07:28:59.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.827+0000 7fc0c3400640 1 -- 172.21.15.55:0/1483413463 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b400ca00 con 0x7fc0cc0b3350 2024-04-02T07:28:59.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.827+0000 7fc0d0a00640 1 -- 172.21.15.55:0/1483413463 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0cc0b3d20 con 0x7fc0cc0b3350 2024-04-02T07:28:59.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.827+0000 7fc0c3400640 1 -- 172.21.15.55:0/1483413463 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b400cd90 con 0x7fc0cc0b3350 2024-04-02T07:28:59.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.827+0000 7fc0d0a00640 1 -- 172.21.15.55:0/1483413463 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0cc1574f0 con 0x7fc0cc0b3350 2024-04-02T07:28:59.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.827+0000 7fc0c3400640 1 -- 172.21.15.55:0/1483413463 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc0b4013470 con 0x7fc0cc0b3350 2024-04-02T07:28:59.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.827+0000 7fc0c3400640 1 --2- 172.21.15.55:0/1483413463 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc0a80666c0 0x7fc0a8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.827+0000 7fc0c3400640 1 -- 172.21.15.55:0/1483413463 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0b4084330 con 0x7fc0cc0b3350 2024-04-02T07:28:59.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.827+0000 7fc0d48f9000 1 Processor -- start 2024-04-02T07:28:59.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.827+0000 7fc0d48f9000 1 -- start start 2024-04-02T07:28:59.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.827+0000 7fc0ca800640 1 --2- 172.21.15.55:0/1483413463 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc0a80666c0 0x7fc0a8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0ca800640 1 --2- 172.21.15.55:0/1483413463 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc0a80666c0 0x7fc0a8068b80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc005890 tx=0x7fc0bc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0d48f9000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d73722db0 0x559d73723190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0d48f9000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d737236d0 0x559d736d8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0d48f9000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d736d94c0 0x559d736d98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0d48f9000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d735a15a0 con 0x559d737236d0 2024-04-02T07:28:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0d48f9000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d7352eaf0 con 0x559d73722db0 2024-04-02T07:28:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0d48f9000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d7352c0c0 con 0x559d736d94c0 2024-04-02T07:28:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0c1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d737236d0 0x559d736d8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0c1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d737236d0 0x559d736d8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51472/0 (socket says 172.21.15.55:51472) 2024-04-02T07:28:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0ca800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d73722db0 0x559d73723190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0c1e00640 1 -- 172.21.15.55:0/912259420 learned_addr learned my addr 172.21.15.55:0/912259420 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0cb200640 1 --2- 172.21.15.55:0/912259420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d736d94c0 0x559d736d98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0c1e00640 1 -- 172.21.15.55:0/912259420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d736d94c0 msgr2=0x559d736d98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0c1e00640 1 --2- 172.21.15.55:0/912259420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d736d94c0 0x559d736d98a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0c1e00640 1 -- 172.21.15.55:0/912259420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d73722db0 msgr2=0x559d73723190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0c1e00640 1 --2- 172.21.15.55:0/912259420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d73722db0 0x559d73723190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0c1e00640 1 -- 172.21.15.55:0/912259420 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d73223890 con 0x559d737236d0 2024-04-02T07:28:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0c1e00640 1 --2- 172.21.15.55:0/912259420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d737236d0 0x559d736d8f80 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4055070 tx=0x7fc0b4055370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=978a74ba27c39466 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0bb400640 1 -- 172.21.15.55:0/912259420 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b405d6b0 con 0x559d737236d0 2024-04-02T07:28:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0bb400640 1 -- 172.21.15.55:0/912259420 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b40840c0 con 0x559d737236d0 2024-04-02T07:28:59.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0bb400640 1 -- 172.21.15.55:0/912259420 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4051a80 con 0x559d737236d0 2024-04-02T07:28:59.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0d48f9000 1 -- 172.21.15.55:0/912259420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d737236d0 msgr2=0x559d736d8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:59.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0d48f9000 1 --2- 172.21.15.55:0/912259420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d737236d0 0x559d736d8f80 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4055070 tx=0x7fc0b4055370 comp rx=0 tx=0).stop 2024-04-02T07:28:59.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0d48f9000 1 -- 172.21.15.55:0/912259420 shutdown_connections 2024-04-02T07:28:59.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0d48f9000 1 --2- 172.21.15.55:0/912259420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d736d94c0 0x559d736d98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0d48f9000 1 --2- 172.21.15.55:0/912259420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d737236d0 0x559d736d8f80 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0d48f9000 1 --2- 172.21.15.55:0/912259420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d73722db0 0x559d73723190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0d48f9000 1 -- 172.21.15.55:0/912259420 >> 172.21.15.55:0/912259420 conn(0x559d736df830 msgr2=0x559d736d7860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:59.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0d48f9000 1 -- 172.21.15.55:0/912259420 shutdown_connections 2024-04-02T07:28:59.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0d48f9000 1 -- 172.21.15.55:0/912259420 wait complete. 2024-04-02T07:28:59.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0d48f9000 1 -- start start 2024-04-02T07:28:59.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.831+0000 7fc0d48f9000 1 Processor -- start 2024-04-02T07:28:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0d48f9000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d736d94c0 0x559d73722660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0d48f9000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d73722db0 0x559d736dd230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0d48f9000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d737236d0 0x559d736dd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0d48f9000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d735279b0 con 0x559d736d94c0 2024-04-02T07:28:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0d48f9000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d734c6c00 con 0x559d737236d0 2024-04-02T07:28:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0d48f9000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d734e5070 con 0x559d73722db0 2024-04-02T07:28:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0d48f9000 10 client.0 _ll_register_callbacks cb 0x559d736c50e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:28:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0ca800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d736d94c0 0x559d73722660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0ca800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d736d94c0 0x559d73722660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51476/0 (socket says 172.21.15.55:51476) 2024-04-02T07:28:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0ca800640 1 -- 172.21.15.55:0/2521373950 learned_addr learned my addr 172.21.15.55:0/2521373950 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0c1e00640 1 --2- 172.21.15.55:0/2521373950 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d73722db0 0x559d736dd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0cb200640 1 --2- 172.21.15.55:0/2521373950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d737236d0 0x559d736dd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0ca800640 1 -- 172.21.15.55:0/2521373950 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d73722db0 msgr2=0x559d736dd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:59.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0ca800640 1 --2- 172.21.15.55:0/2521373950 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d73722db0 0x559d736dd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0ca800640 1 -- 172.21.15.55:0/2521373950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d737236d0 msgr2=0x559d736dd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0ca800640 1 --2- 172.21.15.55:0/2521373950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d737236d0 0x559d736dd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0ca800640 1 -- 172.21.15.55:0/2521373950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0cc1574f0 con 0x559d736d94c0 2024-04-02T07:28:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0c1e00640 1 --2- 172.21.15.55:0/2521373950 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d73722db0 0x559d736dd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0cb200640 1 --2- 172.21.15.55:0/2521373950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d737236d0 0x559d736dd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0ca800640 1 --2- 172.21.15.55:0/2521373950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d736d94c0 0x559d73722660 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc001320 tx=0x7fc0bc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f34b83b3f83cf9ba server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0afe00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:28:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0afe00640 1 -- 172.21.15.55:0/2521373950 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc0216d0 con 0x559d736d94c0 2024-04-02T07:28:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0afe00640 1 -- 172.21.15.55:0/2521373950 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0bc01c040 con 0x559d736d94c0 2024-04-02T07:28:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2521373950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d734e45f0 con 0x559d736d94c0 2024-04-02T07:28:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0afe00640 1 -- 172.21.15.55:0/2521373950 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0bc021830 con 0x559d736d94c0 2024-04-02T07:28:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0d48f9000 10 client.7596 fetch_fsmap learned FSMap version 60 2024-04-02T07:28:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2521373950 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x559d734ecab0 con 0x559d736d94c0 2024-04-02T07:28:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0afe00640 1 -- 172.21.15.55:0/2521373950 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559d734e45f0 con 0x559d736d94c0 2024-04-02T07:28:59.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0afe00640 1 -- 172.21.15.55:0/2521373950 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 60) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc0bc012070 con 0x559d736d94c0 2024-04-02T07:28:59.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0d48f9000 10 client.7596 fetch_fsmap finished waiting for FSMap version 60 2024-04-02T07:28:59.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0d48f9000 10 client.7596 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-02T07:28:59.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0d48f9000 20 client.7596 populate_metadata read hostname 'smithi055' 2024-04-02T07:28:59.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0d48f9000 1 --2- 172.21.15.55:0/2521373950 >> [v2:172.21.15.106:6836/2582023800,v1:172.21.15.106:6837/2582023800] conn(0x559d736de180 0x559d736de560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0d48f9000 4 client.7596 mds_command: new command op to 7464 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:28:59.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2521373950 --> [v2:172.21.15.106:6836/2582023800,v1:172.21.15.106:6837/2582023800] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d73524790 con 0x559d736de180 2024-04-02T07:28:59.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0c1e00640 1 --2- 172.21.15.55:0/2521373950 >> [v2:172.21.15.106:6836/2582023800,v1:172.21.15.106:6837/2582023800] conn(0x559d736de180 0x559d736de560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0c1e00640 1 --2- 172.21.15.55:0/2521373950 >> [v2:172.21.15.106:6836/2582023800,v1:172.21.15.106:6837/2582023800] conn(0x559d736de180 0x559d736de560 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=611fe930678ea3be server_cookie=51c326bdff3dc763 in_seq=0 out_seq=0 2024-04-02T07:28:59.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0afe00640 10 client.7596 ms_handle_connect on v2:172.21.15.106:6836/2582023800 2024-04-02T07:28:59.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0afe00640 1 -- 172.21.15.55:0/2521373950 <== mds.0 v2:172.21.15.106:6836/2582023800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x559d73524790 con 0x559d736de180 2024-04-02T07:28:59.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0afe00640 10 client.7596 handle_command_reply: tid=0 2024-04-02T07:28:59.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0d48f9000 1 client.7596 shutdown 2024-04-02T07:28:59.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2521373950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d736d94c0 msgr2=0x559d73722660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:59.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.835+0000 7fc0d48f9000 1 --2- 172.21.15.55:0/2521373950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d736d94c0 0x559d73722660 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc001320 tx=0x7fc0bc005800 comp rx=0 tx=0).stop 2024-04-02T07:28:59.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.839+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2521373950 shutdown_connections 2024-04-02T07:28:59.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.839+0000 7fc0d48f9000 1 --2- 172.21.15.55:0/2521373950 >> [v2:172.21.15.106:6836/2582023800,v1:172.21.15.106:6837/2582023800] conn(0x559d736de180 0x559d736de560 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.839+0000 7fc0d48f9000 1 --2- 172.21.15.55:0/2521373950 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d737236d0 0x559d736dd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.839+0000 7fc0d48f9000 1 --2- 172.21.15.55:0/2521373950 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d73722db0 0x559d736dd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.839+0000 7fc0d48f9000 1 --2- 172.21.15.55:0/2521373950 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d736d94c0 0x559d73722660 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.839+0000 7fc0afe00640 0 client.7596 ms_handle_reset on v2:172.21.15.106:6836/2582023800 2024-04-02T07:28:59.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.839+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2521373950 >> 172.21.15.55:0/2521373950 conn(0x559d736df830 msgr2=0x559d736d7f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:59.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.839+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2521373950 shutdown_connections 2024-04-02T07:28:59.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.839+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2521373950 wait complete. 2024-04-02T07:28:59.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.839+0000 7fc0d48f9000 20 client.7596 trim_cache size 0 max 16384 2024-04-02T07:28:59.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.851+0000 7fc0d48f9000 1 Processor -- start 2024-04-02T07:28:59.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.851+0000 7fc0d48f9000 1 -- start start 2024-04-02T07:28:59.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0d48f9000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d736d94c0 0x559d737323f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0d48f9000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d73722db0 0x559d73732930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0d48f9000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d737236d0 0x559d73732e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0d48f9000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d731e4940 con 0x559d73722db0 2024-04-02T07:28:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0d48f9000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d734e0f80 con 0x559d736d94c0 2024-04-02T07:28:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0d48f9000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d7356aac0 con 0x559d737236d0 2024-04-02T07:28:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0c1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d73722db0 0x559d73732930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0c1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d73722db0 0x559d73732930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51482/0 (socket says 172.21.15.55:51482) 2024-04-02T07:28:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0c1e00640 1 -- 172.21.15.55:0/2904907475 learned_addr learned my addr 172.21.15.55:0/2904907475 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0ca800640 1 --2- 172.21.15.55:0/2904907475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d736d94c0 0x559d737323f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0cb200640 1 --2- 172.21.15.55:0/2904907475 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d737236d0 0x559d73732e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0c1e00640 1 -- 172.21.15.55:0/2904907475 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d737236d0 msgr2=0x559d73732e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0c1e00640 1 --2- 172.21.15.55:0/2904907475 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d737236d0 0x559d73732e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0c1e00640 1 -- 172.21.15.55:0/2904907475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d736d94c0 msgr2=0x559d737323f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:59.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0c1e00640 1 --2- 172.21.15.55:0/2904907475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d736d94c0 0x559d737323f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0c1e00640 1 -- 172.21.15.55:0/2904907475 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d734d2c00 con 0x559d73722db0 2024-04-02T07:28:59.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0ca800640 1 --2- 172.21.15.55:0/2904907475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d736d94c0 0x559d737323f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:28:59.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0c1e00640 1 --2- 172.21.15.55:0/2904907475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d73722db0 0x559d73732930 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4055070 tx=0x7fc0b4084050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff65ef34fd07c83 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:59.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0bbe00640 1 -- 172.21.15.55:0/2904907475 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4081040 con 0x559d73722db0 2024-04-02T07:28:59.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0bbe00640 1 -- 172.21.15.55:0/2904907475 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0b4055140 con 0x559d73722db0 2024-04-02T07:28:59.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0bbe00640 1 -- 172.21.15.55:0/2904907475 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0b4053530 con 0x559d73722db0 2024-04-02T07:28:59.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2904907475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d73722db0 msgr2=0x559d73732930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:59.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0d48f9000 1 --2- 172.21.15.55:0/2904907475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d73722db0 0x559d73732930 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fc0b4055070 tx=0x7fc0b4084050 comp rx=0 tx=0).stop 2024-04-02T07:28:59.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2904907475 shutdown_connections 2024-04-02T07:28:59.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0d48f9000 1 --2- 172.21.15.55:0/2904907475 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d737236d0 0x559d73732e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0d48f9000 1 --2- 172.21.15.55:0/2904907475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d73722db0 0x559d73732930 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0d48f9000 1 --2- 172.21.15.55:0/2904907475 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d736d94c0 0x559d737323f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2904907475 >> 172.21.15.55:0/2904907475 conn(0x559d736df830 msgr2=0x559d73720700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2904907475 shutdown_connections 2024-04-02T07:28:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2904907475 wait complete. 2024-04-02T07:28:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0d48f9000 1 -- start start 2024-04-02T07:28:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0d48f9000 1 Processor -- start 2024-04-02T07:28:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0d48f9000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d736d94c0 0x559d737381c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.855+0000 7fc0d48f9000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d73722db0 0x559d73778240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d737236d0 0x559d73778780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d734c4c10 con 0x559d736d94c0 2024-04-02T07:28:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d735271c0 con 0x559d73722db0 2024-04-02T07:28:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x559d7345e450 con 0x559d737236d0 2024-04-02T07:28:59.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 10 client.0 _ll_register_callbacks cb 0x559d734ec590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:28:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0ca800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d736d94c0 0x559d737381c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0ca800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d736d94c0 0x559d737381c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51496/0 (socket says 172.21.15.55:51496) 2024-04-02T07:28:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0ca800640 1 -- 172.21.15.55:0/2325563278 learned_addr learned my addr 172.21.15.55:0/2325563278 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:28:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0cb200640 1 --2- 172.21.15.55:0/2325563278 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d737236d0 0x559d73778780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0c1e00640 1 --2- 172.21.15.55:0/2325563278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d73722db0 0x559d73778240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0ca800640 1 -- 172.21.15.55:0/2325563278 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d737236d0 msgr2=0x559d73778780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0ca800640 1 --2- 172.21.15.55:0/2325563278 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d737236d0 0x559d73778780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0ca800640 1 -- 172.21.15.55:0/2325563278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d73722db0 msgr2=0x559d73778240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:28:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0ca800640 1 --2- 172.21.15.55:0/2325563278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d73722db0 0x559d73778240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0ca800640 1 -- 172.21.15.55:0/2325563278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d73223890 con 0x559d736d94c0 2024-04-02T07:28:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0ca800640 1 --2- 172.21.15.55:0/2325563278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d736d94c0 0x559d737381c0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc021e20 tx=0x7fc0bc014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a7cc21b3f8ceef server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:28:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0afe00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:28:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0afe00640 1 -- 172.21.15.55:0/2325563278 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0bc004c00 con 0x559d736d94c0 2024-04-02T07:28:59.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0afe00640 1 -- 172.21.15.55:0/2325563278 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc0bc004d60 con 0x559d736d94c0 2024-04-02T07:28:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2325563278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d734f7460 con 0x559d736d94c0 2024-04-02T07:28:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0afe00640 1 -- 172.21.15.55:0/2325563278 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc0bc00f640 con 0x559d736d94c0 2024-04-02T07:28:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 10 client.7602 fetch_fsmap learned FSMap version 60 2024-04-02T07:28:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2325563278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) v3 -- 0x559d73223cc0 con 0x559d736d94c0 2024-04-02T07:28:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0afe00640 1 -- 172.21.15.55:0/2325563278 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559d734f7460 con 0x559d736d94c0 2024-04-02T07:28:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0afe00640 1 -- 172.21.15.55:0/2325563278 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 60) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc0bc012070 con 0x559d736d94c0 2024-04-02T07:28:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 10 client.7602 fetch_fsmap finished waiting for FSMap version 60 2024-04-02T07:28:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 10 client.7602 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-02T07:28:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 20 client.7602 populate_metadata read hostname 'smithi055' 2024-04-02T07:28:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 1 --2- 172.21.15.55:0/2325563278 >> [v2:172.21.15.106:6836/2582023800,v1:172.21.15.106:6837/2582023800] conn(0x559d73787630 0x559d73789a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:28:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 4 client.7602 mds_command: new command op to 7464 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-02T07:28:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2325563278 --> [v2:172.21.15.106:6836/2582023800,v1:172.21.15.106:6837/2582023800] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559d734f09c0 con 0x559d73787630 2024-04-02T07:28:59.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0c1e00640 1 --2- 172.21.15.55:0/2325563278 >> [v2:172.21.15.106:6836/2582023800,v1:172.21.15.106:6837/2582023800] conn(0x559d73787630 0x559d73789a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:28:59.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0afe00640 10 client.7602 ms_handle_connect on v2:172.21.15.106:6836/2582023800 2024-04-02T07:28:59.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0c1e00640 1 --2- 172.21.15.55:0/2325563278 >> [v2:172.21.15.106:6836/2582023800,v1:172.21.15.106:6837/2582023800] conn(0x559d73787630 0x559d73789a20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7953ab1fe2c29bf2 server_cookie=9d7c8935c038b8b2 in_seq=0 out_seq=0 2024-04-02T07:28:59.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0afe00640 1 -- 172.21.15.55:0/2325563278 <== mds.0 v2:172.21.15.106:6836/2582023800 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x559d734f09c0 con 0x559d73787630 2024-04-02T07:28:59.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0afe00640 10 client.7602 handle_command_reply: tid=0 2024-04-02T07:28:59.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 1 client.7602 shutdown 2024-04-02T07:28:59.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2325563278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d736d94c0 msgr2=0x559d737381c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:59.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 1 --2- 172.21.15.55:0/2325563278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d736d94c0 0x559d737381c0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc021e20 tx=0x7fc0bc014000 comp rx=0 tx=0).stop 2024-04-02T07:28:59.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2325563278 shutdown_connections 2024-04-02T07:28:59.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 1 --2- 172.21.15.55:0/2325563278 >> [v2:172.21.15.106:6836/2582023800,v1:172.21.15.106:6837/2582023800] conn(0x559d73787630 0x559d73789a20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 1 --2- 172.21.15.55:0/2325563278 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559d737236d0 0x559d73778780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 1 --2- 172.21.15.55:0/2325563278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559d73722db0 0x559d73778240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0afe00640 0 client.7602 ms_handle_reset on v2:172.21.15.106:6836/2582023800 2024-04-02T07:28:59.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 1 --2- 172.21.15.55:0/2325563278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559d736d94c0 0x559d737381c0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2325563278 >> 172.21.15.55:0/2325563278 conn(0x559d736df830 msgr2=0x559d73720e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:59.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2325563278 shutdown_connections 2024-04-02T07:28:59.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 1 -- 172.21.15.55:0/2325563278 wait complete. 2024-04-02T07:28:59.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d48f9000 20 client.7602 trim_cache size 0 max 16384 2024-04-02T07:28:59.866 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:28:59.866 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "642a0456-a2ac-49a4-91a5-3b3449b512da", 2024-04-02T07:28:59.866 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-02T07:28:59.866 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 7464, 2024-04-02T07:28:59.866 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-02T07:28:59.867 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-02T07:28:59.867 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-02T07:28:59.867 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 5.9392715259999997, 2024-04-02T07:28:59.867 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 60, 2024-04-02T07:28:59.867 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 87, 2024-04-02T07:28:59.867 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 87, 2024-04-02T07:28:59.867 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 10.285650199000001 2024-04-02T07:28:59.867 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:28:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d0a00640 1 -- 172.21.15.55:0/1483413463 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc0a80666c0 msgr2=0x7fc0a8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.859+0000 7fc0d0a00640 1 --2- 172.21.15.55:0/1483413463 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc0a80666c0 0x7fc0a8068b80 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fc0bc005890 tx=0x7fc0bc009040 comp rx=0 tx=0).stop 2024-04-02T07:28:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.863+0000 7fc0d0a00640 1 -- 172.21.15.55:0/1483413463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0cc0b3350 msgr2=0x7fc0cc156fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:28:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.863+0000 7fc0d0a00640 1 --2- 172.21.15.55:0/1483413463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0cc0b3350 0x7fc0cc156fb0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc0b400e900 tx=0x7fc0b400edc0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.863+0000 7fc0d0a00640 1 -- 172.21.15.55:0/1483413463 shutdown_connections 2024-04-02T07:28:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.863+0000 7fc0d0a00640 1 --2- 172.21.15.55:0/1483413463 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc0cc0cf420 0x7fc0cc158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.863+0000 7fc0d0a00640 1 --2- 172.21.15.55:0/1483413463 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc0a80666c0 0x7fc0a8068b80 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.863+0000 7fc0d0a00640 1 --2- 172.21.15.55:0/1483413463 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc0cc0b3350 0x7fc0cc156fb0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.863+0000 7fc0d0a00640 1 --2- 172.21.15.55:0/1483413463 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc0cc098a10 0x7fc0cc164970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:28:59.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.863+0000 7fc0d0a00640 1 -- 172.21.15.55:0/1483413463 >> 172.21.15.55:0/1483413463 conn(0x7fc0cc0ccf80 msgr2=0x7fc0cc098df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:28:59.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.863+0000 7fc0d0a00640 1 -- 172.21.15.55:0/1483413463 shutdown_connections 2024-04-02T07:28:59.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:28:59.863+0000 7fc0d0a00640 1 -- 172.21.15.55:0/1483413463 wait complete. 2024-04-02T07:28:59.881 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-02T07:29:00.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.019+0000 7f2e7b800640 1 Processor -- start 2024-04-02T07:29:00.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.019+0000 7f2e7b800640 1 -- start start 2024-04-02T07:29:00.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.023+0000 7f2e7b800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2e74099120 0x7f2e74099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:00.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.023+0000 7f2e7b800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e7415f250 0x7f2e740b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:00.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.023+0000 7f2e7b800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e740ad270 con 0x7f2e7415ee70 2024-04-02T07:29:00.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.023+0000 7f2e7b800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e740b0840 con 0x7f2e7415f250 2024-04-02T07:29:00.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.023+0000 7f2e7b800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e740cf6a0 con 0x7f2e74099120 2024-04-02T07:29:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.023+0000 7f2e79800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2e7415f250 0x7f2e740b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.023+0000 7f2e78e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2e7415ee70 0x7f2e74098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37232/0 (socket says 172.21.15.55:37232) 2024-04-02T07:29:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.023+0000 7f2e78e00640 1 -- 172.21.15.55:0/1870807518 learned_addr learned my addr 172.21.15.55:0/1870807518 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:29:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.023+0000 7f2e73e00640 1 --2- 172.21.15.55:0/1870807518 >> v2:172.21.15.106:3300/0 conn(0x7f2e74099120 0x7f2e74099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.023+0000 7f2e79800640 1 -- 172.21.15.55:0/1870807518 >> v2:172.21.15.106:3300/0 conn(0x7f2e74099120 msgr2=0x7f2e74099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.023+0000 7f2e79800640 1 --2- 172.21.15.55:0/1870807518 >> v2:172.21.15.106:3300/0 conn(0x7f2e74099120 0x7f2e74099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.023+0000 7f2e79800640 1 -- 172.21.15.55:0/1870807518 >> v1:172.21.15.55:6789/0 conn(0x7f2e7415ee70 legacy=0x7f2e74098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:00.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.023+0000 7f2e79800640 1 -- 172.21.15.55:0/1870807518 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e740b0a50 con 0x7f2e7415f250 2024-04-02T07:29:00.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e79800640 1 --2- 172.21.15.55:0/1870807518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e7415f250 0x7f2e740b12f0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f2e74073b60 tx=0x7f2e6c01c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b21f7173944ddf7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:00.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e73400640 1 -- 172.21.15.55:0/1870807518 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c0a59f0 con 0x7f2e7415f250 2024-04-02T07:29:00.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e73400640 1 -- 172.21.15.55:0/1870807518 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e6c0a5b50 con 0x7f2e7415f250 2024-04-02T07:29:00.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e73400640 1 -- 172.21.15.55:0/1870807518 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e6c0ad440 con 0x7f2e7415f250 2024-04-02T07:29:00.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e7b800640 1 -- 172.21.15.55:0/1870807518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e7415f250 msgr2=0x7f2e740b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:00.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e7b800640 1 --2- 172.21.15.55:0/1870807518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e7415f250 0x7f2e740b12f0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f2e74073b60 tx=0x7f2e6c01c930 comp rx=0 tx=0).stop 2024-04-02T07:29:00.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e7b800640 1 -- 172.21.15.55:0/1870807518 shutdown_connections 2024-04-02T07:29:00.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e7b800640 1 --2- 172.21.15.55:0/1870807518 >> v2:172.21.15.106:3300/0 conn(0x7f2e74099120 0x7f2e74099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:00.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e7b800640 1 --2- 172.21.15.55:0/1870807518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e7415f250 0x7f2e740b12f0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:00.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e7b800640 1 -- 172.21.15.55:0/1870807518 >> 172.21.15.55:0/1870807518 conn(0x7f2e740b21d0 msgr2=0x7f2e740b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:00.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e7b800640 1 -- 172.21.15.55:0/1870807518 shutdown_connections 2024-04-02T07:29:00.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e7b800640 1 -- 172.21.15.55:0/1870807518 wait complete. 2024-04-02T07:29:00.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e7b800640 1 Processor -- start 2024-04-02T07:29:00.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e7b800640 1 -- start start 2024-04-02T07:29:00.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e7b800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e74099120 0x7f2e740b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:00.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e7b800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e7415ee70 0x7f2e740b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:00.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e7b800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e7415f250 0x7f2e740adb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:00.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e7b800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e740b3790 con 0x7f2e74099120 2024-04-02T07:29:00.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e7b800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e740b33f0 con 0x7f2e7415ee70 2024-04-02T07:29:00.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e7b800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e740af610 con 0x7f2e7415f250 2024-04-02T07:29:00.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.027+0000 7f2e78e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e74099120 0x7f2e740b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:00.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.031+0000 7f2e78e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e74099120 0x7f2e740b3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51516/0 (socket says 172.21.15.55:51516) 2024-04-02T07:29:00.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.031+0000 7f2e78e00640 1 -- 172.21.15.55:0/2369251037 learned_addr learned my addr 172.21.15.55:0/2369251037 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:00.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.031+0000 7f2e79800640 1 --2- 172.21.15.55:0/2369251037 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e7415f250 0x7f2e740adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:00.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.031+0000 7f2e73e00640 1 --2- 172.21.15.55:0/2369251037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e7415ee70 0x7f2e740b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:00.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.031+0000 7f2e78e00640 1 -- 172.21.15.55:0/2369251037 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e7415f250 msgr2=0x7f2e740adb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:00.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.031+0000 7f2e78e00640 1 --2- 172.21.15.55:0/2369251037 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e7415f250 0x7f2e740adb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:00.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.031+0000 7f2e78e00640 1 -- 172.21.15.55:0/2369251037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e7415ee70 msgr2=0x7f2e740b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:00.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.031+0000 7f2e78e00640 1 --2- 172.21.15.55:0/2369251037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e7415ee70 0x7f2e740b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:00.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.031+0000 7f2e78e00640 1 -- 172.21.15.55:0/2369251037 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e6c009a70 con 0x7f2e74099120 2024-04-02T07:29:00.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.031+0000 7f2e79800640 1 --2- 172.21.15.55:0/2369251037 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e7415f250 0x7f2e740adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:29:00.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.031+0000 7f2e78e00640 1 --2- 172.21.15.55:0/2369251037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e74099120 0x7f2e740b3bb0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800c500 tx=0x7f2e6800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:00.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.031+0000 7f2e70c00640 1 -- 172.21.15.55:0/2369251037 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e68005cf0 con 0x7f2e74099120 2024-04-02T07:29:00.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.031+0000 7f2e70c00640 1 -- 172.21.15.55:0/2369251037 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e68005e50 con 0x7f2e74099120 2024-04-02T07:29:00.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.031+0000 7f2e70c00640 1 -- 172.21.15.55:0/2369251037 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e680072f0 con 0x7f2e74099120 2024-04-02T07:29:00.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.031+0000 7f2e7b800640 1 -- 172.21.15.55:0/2369251037 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e740af330 con 0x7f2e74099120 2024-04-02T07:29:00.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.031+0000 7f2e7b800640 1 -- 172.21.15.55:0/2369251037 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e740b5f00 con 0x7f2e74099120 2024-04-02T07:29:00.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.031+0000 7f2e7b800640 1 -- 172.21.15.55:0/2369251037 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e740b38d0 con 0x7f2e74099120 2024-04-02T07:29:00.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.031+0000 7f2e70c00640 1 -- 172.21.15.55:0/2369251037 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2e68007450 con 0x7f2e74099120 2024-04-02T07:29:00.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.031+0000 7f2e70c00640 1 --2- 172.21.15.55:0/2369251037 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2e540666c0 0x7f2e54068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:00.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.035+0000 7f2e70c00640 1 -- 172.21.15.55:0/2369251037 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e68083620 con 0x7f2e74099120 2024-04-02T07:29:00.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.035+0000 7f2e73e00640 1 --2- 172.21.15.55:0/2369251037 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2e540666c0 0x7f2e54068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:00.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.035+0000 7f2e73e00640 1 --2- 172.21.15.55:0/2369251037 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2e540666c0 0x7f2e54068b80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2e60007a60 tx=0x7f2e60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:00.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.035+0000 7f2e70c00640 1 -- 172.21.15.55:0/2369251037 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2e68050a30 con 0x7f2e74099120 2024-04-02T07:29:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.235+0000 7f2e7b800640 1 -- 172.21.15.55:0/2369251037 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2e74066c90 con 0x7f2e74099120 2024-04-02T07:29:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.235+0000 7f2e70c00640 1 -- 172.21.15.55:0/2369251037 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v60) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2e68017060 con 0x7f2e74099120 2024-04-02T07:29:00.238 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-02T07:29:00.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.239+0000 7f2e7b800640 1 -- 172.21.15.55:0/2369251037 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2e540666c0 msgr2=0x7f2e54068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:00.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.239+0000 7f2e7b800640 1 --2- 172.21.15.55:0/2369251037 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2e540666c0 0x7f2e54068b80 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f2e60007a60 tx=0x7f2e60008040 comp rx=0 tx=0).stop 2024-04-02T07:29:00.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.239+0000 7f2e7b800640 1 -- 172.21.15.55:0/2369251037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e74099120 msgr2=0x7f2e740b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:00.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.239+0000 7f2e7b800640 1 --2- 172.21.15.55:0/2369251037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e74099120 0x7f2e740b3bb0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800c500 tx=0x7f2e6800c9c0 comp rx=0 tx=0).stop 2024-04-02T07:29:00.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.239+0000 7f2e7b800640 1 -- 172.21.15.55:0/2369251037 shutdown_connections 2024-04-02T07:29:00.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.239+0000 7f2e7b800640 1 --2- 172.21.15.55:0/2369251037 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2e7415f250 0x7f2e740adb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:00.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.239+0000 7f2e7b800640 1 --2- 172.21.15.55:0/2369251037 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2e540666c0 0x7f2e54068b80 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:00.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.239+0000 7f2e7b800640 1 --2- 172.21.15.55:0/2369251037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2e7415ee70 0x7f2e740b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:00.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.239+0000 7f2e7b800640 1 --2- 172.21.15.55:0/2369251037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e74099120 0x7f2e740b3bb0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:00.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.239+0000 7f2e7b800640 1 -- 172.21.15.55:0/2369251037 >> 172.21.15.55:0/2369251037 conn(0x7f2e740b21d0 msgr2=0x7f2e7415d570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:00.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.239+0000 7f2e7b800640 1 -- 172.21.15.55:0/2369251037 shutdown_connections 2024-04-02T07:29:00.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:00.239+0000 7f2e7b800640 1 -- 172.21.15.55:0/2369251037 wait complete. 2024-04-02T07:29:00.259 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-02T07:29:00.259 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-02T07:29:00.259 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-02T07:29:00.259 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-02T07:29:00.259 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-02T07:29:00.259 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-02T07:29:00.259 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-02T07:29:00.259 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-02T07:29:00.259 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:29:00.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:00.260 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-02T07:29:00.269 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:29:00.269 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:29:00.270 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:29:00.270 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:29:00.270 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-02T07:29:00.270 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:29:00.270 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:29:00.270 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:29:00.270 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-02T07:29:00.270 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:29:00.270 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:29:00.270 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-02T07:29:00.270 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-02T07:29:00.270 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:29:00.271 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-02T07:29:00.271 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-02T07:29:00.271 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42054sec preferred_lft 42054sec 2024-04-02T07:29:00.271 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2024-04-02T07:29:00.271 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:29:00.271 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:29:00.271 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:29:00.271 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-02T07:29:00.271 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-02T07:29:00.271 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:81:5a:89:17 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:29:00.271 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-02T07:29:00.271 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:29:00.272 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:29:00.272 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-02T07:29:00.272 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-02T07:29:00.272 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:29:00.272 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-02T07:29:00.272 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:29:00.272 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:29:00.272 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-02T07:29:00.272 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-02T07:29:00.272 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:29:00.272 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:29:00.272 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-02T07:29:00.272 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-02T07:29:00.273 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:29:00.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:00.273 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-02T07:29:00.334 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:29:00.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:00.338 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-02T07:29:00.387 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-02T07:29:00.387 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-02T07:29:00.388 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-02T07:29:00.388 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-02T07:29:00.388 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-02T07:29:00.388 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-02T07:29:00.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:00.388 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:29:00.388 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:29:00.388 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-02T07:29:00.388 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-02T07:29:00.388 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-02T07:29:00.389 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:29:00.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:00.483 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-02T07:29:00.492 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-02T07:29:00.492 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-02T07:29:00.493 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:29:00.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:00.493 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-02T07:29:00.554 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-02T07:29:00.554 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:29:00.554 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-02T07:29:00.610 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:29:00.610 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:29:00.610 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:29:00.661 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:29:00.722 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:29:00.722 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:29:00.784 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:29:00.786 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:29:00.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:00.787 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:29:00.838 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-02T07:29:00.838 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-02T07:29:00.880 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:29:00.901 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:29:00.901 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:29:00.960 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:29:00.962 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:29:00.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:00.962 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:29:00.976 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:2024-04-02T07:29:00.975+0000 7fea4c44b580 -1 init, newargv = 0x5599053373c0 newargc=15 2024-04-02T07:29:00.976 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[45967]: starting ceph client 2024-04-02T07:29:00.984 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[45967]: starting fuse 2024-04-02T07:29:02.086 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:29:02.110 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:29:02.110 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:29:02.175 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:29:02.176 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:29:02.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:02.177 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:29:02.231 INFO:teuthology.orchestra.run.smithi055.stdout:43 2024-04-02T07:29:02.231 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-02T07:29:02.231 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:29:02.231 DEBUG:teuthology.orchestra.run.smithi055:> import glob 2024-04-02T07:29:02.231 DEBUG:teuthology.orchestra.run.smithi055:> import re 2024-04-02T07:29:02.232 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:29:02.232 DEBUG:teuthology.orchestra.run.smithi055:> import subprocess 2024-04-02T07:29:02.232 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:29:02.232 DEBUG:teuthology.orchestra.run.smithi055:> def _find_admin_socket(client_name): 2024-04-02T07:29:02.232 DEBUG:teuthology.orchestra.run.smithi055:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-02T07:29:02.232 DEBUG:teuthology.orchestra.run.smithi055:> files = glob.glob(asok_path) 2024-04-02T07:29:02.232 DEBUG:teuthology.orchestra.run.smithi055:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-02T07:29:02.232 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:29:02.232 DEBUG:teuthology.orchestra.run.smithi055:> # Given a non-glob path, it better be there 2024-04-02T07:29:02.232 DEBUG:teuthology.orchestra.run.smithi055:> if "*" not in asok_path: 2024-04-02T07:29:02.232 DEBUG:teuthology.orchestra.run.smithi055:> assert(len(files) == 1) 2024-04-02T07:29:02.232 DEBUG:teuthology.orchestra.run.smithi055:> return files[0] 2024-04-02T07:29:02.232 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:29:02.232 DEBUG:teuthology.orchestra.run.smithi055:> for f in files: 2024-04-02T07:29:02.232 DEBUG:teuthology.orchestra.run.smithi055:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-02T07:29:02.233 DEBUG:teuthology.orchestra.run.smithi055:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-02T07:29:02.233 DEBUG:teuthology.orchestra.run.smithi055:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-02T07:29:02.233 DEBUG:teuthology.orchestra.run.smithi055:> contents = proc_f.read() 2024-04-02T07:29:02.233 DEBUG:teuthology.orchestra.run.smithi055:> if mountpoint in contents: 2024-04-02T07:29:02.233 DEBUG:teuthology.orchestra.run.smithi055:> return f 2024-04-02T07:29:02.233 DEBUG:teuthology.orchestra.run.smithi055:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-02T07:29:02.233 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:29:02.233 DEBUG:teuthology.orchestra.run.smithi055:> print(_find_admin_socket("client.0")) 2024-04-02T07:29:02.233 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:29:02.363 INFO:teuthology.orchestra.run.smithi055.stdout:/var/run/ceph/ceph-client.0.45967.asok 2024-04-02T07:29:02.547 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45967.asok 2024-04-02T07:29:02.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:02.547 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45967.asok status 2024-04-02T07:29:02.732 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:29:02.732 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": { 2024-04-02T07:29:02.733 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_sha1": "d0e392d9aee635f2b65768c460c7a151ead7a5e2", 2024-04-02T07:29:02.733 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)", 2024-04-02T07:29:02.733 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "0", 2024-04-02T07:29:02.733 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2024-04-02T07:29:02.733 INFO:teuthology.orchestra.run.smithi055.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-02T07:29:02.733 INFO:teuthology.orchestra.run.smithi055.stdout: "pid": "45967", 2024-04-02T07:29:02.733 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2024-04-02T07:29:02.733 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:29:02.733 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_count": 0, 2024-04-02T07:29:02.733 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_pinned_count": 0, 2024-04-02T07:29:02.733 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 7617, 2024-04-02T07:29:02.733 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": { 2024-04-02T07:29:02.733 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2024-04-02T07:29:02.733 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2024-04-02T07:29:02.734 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 7617 2024-04-02T07:29:02.734 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:29:02.734 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:29:02.734 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:29:02.734 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:29:02.734 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 233598795 2024-04-02T07:29:02.734 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:29:02.734 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:29:02.734 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:29:02.734 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:29:02.734 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:29:02.734 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 233598795 2024-04-02T07:29:02.734 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:29:02.735 INFO:teuthology.orchestra.run.smithi055.stdout: "inst_str": "client.7617 192.168.0.1:0/233598795", 2024-04-02T07:29:02.735 INFO:teuthology.orchestra.run.smithi055.stdout: "addr_str": "192.168.0.1:0/233598795", 2024-04-02T07:29:02.735 INFO:teuthology.orchestra.run.smithi055.stdout: "inode_count": 1, 2024-04-02T07:29:02.735 INFO:teuthology.orchestra.run.smithi055.stdout: "mds_epoch": 60, 2024-04-02T07:29:02.735 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch": 88, 2024-04-02T07:29:02.735 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch_barrier": 0, 2024-04-02T07:29:02.735 INFO:teuthology.orchestra.run.smithi055.stdout: "blocklisted": false, 2024-04-02T07:29:02.735 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs" 2024-04-02T07:29:02.735 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:29:02.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:02.748 DEBUG:teuthology.orchestra.run.smithi055:> stat --file-system '--printf=%T 2024-04-02T07:29:02.748 DEBUG:teuthology.orchestra.run.smithi055:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-02T07:29:02.757 INFO:teuthology.orchestra.run.smithi055.stdout:fuseblk 2024-04-02T07:29:02.757 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-02T07:29:02.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:02.758 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:29:02.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:02.823 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir dir) 2024-04-02T07:29:02.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:02.888 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec touch dir/file) 2024-04-02T07:29:02.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:02.943 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir testdir) 2024-04-02T07:29:03.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:03.002 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec ln dir/file testdir/hardlink) 2024-04-02T07:29:03.062 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:29:03.062 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:29:03.062 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:29:03.062 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:29:03.062 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/dir").st_ino) 2024-04-02T07:29:03.062 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:29:03.169 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627776 2024-04-02T07:29:03.359 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:29:03.359 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:29:03.415 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:29:03.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.603+0000 7f308da00640 1 Processor -- start 2024-04-02T07:29:03.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.603+0000 7f308da00640 1 -- start start 2024-04-02T07:29:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.603+0000 7f308da00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3088143f90 0x7f308815ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.603+0000 7f308da00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30880cda80 0x7f30880c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.603+0000 7f308da00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f308815b270 con 0x7f30880b34f0 2024-04-02T07:29:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.603+0000 7f308da00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3088144370 con 0x7f3088143f90 2024-04-02T07:29:03.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.603+0000 7f308da00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30880c37b0 con 0x7f30880cda80 2024-04-02T07:29:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.603+0000 7f3086a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3088143f90 0x7f308815ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.603+0000 7f3086a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3088143f90 0x7f308815ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51528/0 (socket says 172.21.15.55:51528) 2024-04-02T07:29:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.603+0000 7f3086a00640 1 -- 172.21.15.55:0/2477149975 learned_addr learned my addr 172.21.15.55:0/2477149975 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.603+0000 7f3087400640 1 --2- 172.21.15.55:0/2477149975 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30880cda80 0x7f30880c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.603+0000 7f3086a00640 1 -- 172.21.15.55:0/2477149975 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30880cda80 msgr2=0x7f30880c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.603+0000 7f3086a00640 1 --2- 172.21.15.55:0/2477149975 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30880cda80 0x7f30880c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:03.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.603+0000 7f3086a00640 1 -- 172.21.15.55:0/2477149975 >> v1:172.21.15.106:6789/0 conn(0x7f30880b34f0 legacy=0x7f30880cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:03.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.603+0000 7f3086a00640 1 -- 172.21.15.55:0/2477149975 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30880c3a90 con 0x7f3088143f90 2024-04-02T07:29:03.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.607+0000 7f3086a00640 1 --2- 172.21.15.55:0/2477149975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3088143f90 0x7f308815ad30 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f3078009870 tx=0x7f307801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4fd3b7546a2420 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.607+0000 7f3086000640 1 -- 172.21.15.55:0/2477149975 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30780a6040 con 0x7f3088143f90 2024-04-02T07:29:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.607+0000 7f3086000640 1 -- 172.21.15.55:0/2477149975 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30780aa600 con 0x7f3088143f90 2024-04-02T07:29:03.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.607+0000 7f3086000640 1 -- 172.21.15.55:0/2477149975 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30780aa990 con 0x7f3088143f90 2024-04-02T07:29:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.607+0000 7f308da00640 1 -- 172.21.15.55:0/2477149975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3088143f90 msgr2=0x7f308815ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.607+0000 7f308da00640 1 --2- 172.21.15.55:0/2477149975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3088143f90 0x7f308815ad30 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f3078009870 tx=0x7f307801c4a0 comp rx=0 tx=0).stop 2024-04-02T07:29:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.607+0000 7f308da00640 1 -- 172.21.15.55:0/2477149975 shutdown_connections 2024-04-02T07:29:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.607+0000 7f308da00640 1 --2- 172.21.15.55:0/2477149975 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30880cda80 0x7f30880c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.607+0000 7f308da00640 1 --2- 172.21.15.55:0/2477149975 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3088143f90 0x7f308815ad30 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.607+0000 7f308da00640 1 -- 172.21.15.55:0/2477149975 >> 172.21.15.55:0/2477149975 conn(0x7f3088066080 msgr2=0x7f3088069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.607+0000 7f308da00640 1 -- 172.21.15.55:0/2477149975 shutdown_connections 2024-04-02T07:29:03.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.607+0000 7f308da00640 1 -- 172.21.15.55:0/2477149975 wait complete. 2024-04-02T07:29:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.607+0000 7f308da00640 1 Processor -- start 2024-04-02T07:29:03.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f308da00640 1 -- start start 2024-04-02T07:29:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f308da00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30880b34f0 0x7f3088163890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f308da00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30880cda80 0x7f3088142b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f308da00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3088143f90 0x7f3088143040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f308da00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308813c860 con 0x7f30880b34f0 2024-04-02T07:29:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f308da00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3088141d40 con 0x7f3088143f90 2024-04-02T07:29:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f308da00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3088142020 con 0x7f30880cda80 2024-04-02T07:29:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f3086a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30880b34f0 0x7f3088163890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f3086a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30880b34f0 0x7f3088163890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51536/0 (socket says 172.21.15.55:51536) 2024-04-02T07:29:03.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f3086a00640 1 -- 172.21.15.55:0/3642253064 learned_addr learned my addr 172.21.15.55:0/3642253064 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f3087400640 1 --2- 172.21.15.55:0/3642253064 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3088143f90 0x7f3088143040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f307fe00640 1 --2- 172.21.15.55:0/3642253064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30880cda80 0x7f3088142b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f3086a00640 1 -- 172.21.15.55:0/3642253064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30880cda80 msgr2=0x7f3088142b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f3086a00640 1 --2- 172.21.15.55:0/3642253064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30880cda80 0x7f3088142b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f3086a00640 1 -- 172.21.15.55:0/3642253064 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3088143f90 msgr2=0x7f3088143040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f3086a00640 1 --2- 172.21.15.55:0/3642253064 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3088143f90 0x7f3088143040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:03.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f3086a00640 1 -- 172.21.15.55:0/3642253064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30780094d0 con 0x7f30880b34f0 2024-04-02T07:29:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f3086a00640 1 --2- 172.21.15.55:0/3642253064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30880b34f0 0x7f3088163890 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f307801a0d0 tx=0x7f307801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f307ea00640 1 -- 172.21.15.55:0/3642253064 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30780b3600 con 0x7f30880b34f0 2024-04-02T07:29:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f307ea00640 1 -- 172.21.15.55:0/3642253064 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30780b3760 con 0x7f30880b34f0 2024-04-02T07:29:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f307ea00640 1 -- 172.21.15.55:0/3642253064 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30780b3ad0 con 0x7f30880b34f0 2024-04-02T07:29:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f308da00640 1 -- 172.21.15.55:0/3642253064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3088142300 con 0x7f30880b34f0 2024-04-02T07:29:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f308da00640 1 -- 172.21.15.55:0/3642253064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30880cc7f0 con 0x7f30880b34f0 2024-04-02T07:29:03.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.611+0000 7f308da00640 1 -- 172.21.15.55:0/3642253064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3088141e80 con 0x7f30880b34f0 2024-04-02T07:29:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.615+0000 7f307ea00640 1 -- 172.21.15.55:0/3642253064 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f30780b3c30 con 0x7f30880b34f0 2024-04-02T07:29:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.615+0000 7f307ea00640 1 --2- 172.21.15.55:0/3642253064 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3064066690 0x7f3064068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:03.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.615+0000 7f307ea00640 1 -- 172.21.15.55:0/3642253064 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f30880c55a0 con 0x7f30880b34f0 2024-04-02T07:29:03.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.615+0000 7f307fe00640 1 --2- 172.21.15.55:0/3642253064 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3064066690 0x7f3064068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:03.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.615+0000 7f307fe00640 1 --2- 172.21.15.55:0/3642253064 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3064066690 0x7f3064068b50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f308815b150 tx=0x7f3070009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:03.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.619+0000 7f307ea00640 1 -- 172.21.15.55:0/3642253064 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3088141e80 con 0x7f30880b34f0 2024-04-02T07:29:03.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.779+0000 7f308da00640 1 -- 172.21.15.55:0/3642253064 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3088141e80 con 0x7f30880b34f0 2024-04-02T07:29:03.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.783+0000 7f307ea00640 1 -- 172.21.15.55:0/3642253064 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16141 (secure 0 0 0) 0x7f3088141e80 con 0x7f30880b34f0 2024-04-02T07:29:03.782 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:29:03.783 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":89,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:29:01.153144+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:28:52.464907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-02T07:28:52.918058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.c","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:29:03.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.783+0000 7f308da00640 1 -- 172.21.15.55:0/3642253064 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3064066690 msgr2=0x7f3064068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:03.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.783+0000 7f308da00640 1 --2- 172.21.15.55:0/3642253064 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3064066690 0x7f3064068b50 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f308815b150 tx=0x7f3070009040 comp rx=0 tx=0).stop 2024-04-02T07:29:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.783+0000 7f308da00640 1 -- 172.21.15.55:0/3642253064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30880b34f0 msgr2=0x7f3088163890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.783+0000 7f308da00640 1 --2- 172.21.15.55:0/3642253064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30880b34f0 0x7f3088163890 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f307801a0d0 tx=0x7f307801ace0 comp rx=0 tx=0).stop 2024-04-02T07:29:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.783+0000 7f308da00640 1 -- 172.21.15.55:0/3642253064 shutdown_connections 2024-04-02T07:29:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.783+0000 7f308da00640 1 --2- 172.21.15.55:0/3642253064 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3064066690 0x7f3064068b50 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.783+0000 7f308da00640 1 --2- 172.21.15.55:0/3642253064 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3088143f90 0x7f3088143040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.783+0000 7f308da00640 1 --2- 172.21.15.55:0/3642253064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f30880cda80 0x7f3088142b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.783+0000 7f308da00640 1 --2- 172.21.15.55:0/3642253064 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30880b34f0 0x7f3088163890 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.783+0000 7f308da00640 1 -- 172.21.15.55:0/3642253064 >> 172.21.15.55:0/3642253064 conn(0x7f3088066080 msgr2=0x7f3088070e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.783+0000 7f308da00640 1 -- 172.21.15.55:0/3642253064 shutdown_connections 2024-04-02T07:29:03.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.783+0000 7f308da00640 1 -- 172.21.15.55:0/3642253064 wait complete. 2024-04-02T07:29:03.805 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:28:52.464907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:28:52.918058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:29:03.805 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:29:03.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.947+0000 7f6c7d200640 1 Processor -- start 2024-04-02T07:29:03.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.947+0000 7f6c7d200640 1 -- start start 2024-04-02T07:29:03.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.947+0000 7f6c7d200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c780ade90 0x7f6c7806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:03.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.947+0000 7f6c7d200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6c780b41a0 0x7f6c78142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:03.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.947+0000 7f6c7d200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7806c630 con 0x7f6c780b3dc0 2024-04-02T07:29:03.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.947+0000 7f6c7d200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c780cae80 con 0x7f6c780b41a0 2024-04-02T07:29:03.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.947+0000 7f6c7d200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7806c8f0 con 0x7f6c780ade90 2024-04-02T07:29:03.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.951+0000 7f6c6d400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c780ade90 0x7f6c7806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:03.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.951+0000 7f6c76800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6c780b41a0 0x7f6c78142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:03.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.951+0000 7f6c6d400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c780ade90 0x7f6c7806d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:56034/0 (socket says 172.21.15.55:56034) 2024-04-02T07:29:03.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.951+0000 7f6c76800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6c780b41a0 0x7f6c78142ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:36706/0 (socket says 172.21.15.55:36706) 2024-04-02T07:29:03.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.951+0000 7f6c75e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6c780b3dc0 0x7f6c780ca770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:57228/0 (socket says 172.21.15.55:57228) 2024-04-02T07:29:03.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.951+0000 7f6c6d400640 1 -- 172.21.15.55:0/2731087183 learned_addr learned my addr 172.21.15.55:0/2731087183 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:03.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.951+0000 7f6c75400640 1 -- 172.21.15.55:0/2731087183 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 510440831 0 0) 0x7f6c7806c630 con 0x7f6c780b3dc0 2024-04-02T07:29:03.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.951+0000 7f6c76800640 1 -- 172.21.15.55:0/2731087183 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c780ade90 msgr2=0x7f6c7806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:03.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.951+0000 7f6c76800640 1 --2- 172.21.15.55:0/2731087183 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c780ade90 0x7f6c7806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:03.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.951+0000 7f6c76800640 1 -- 172.21.15.55:0/2731087183 >> v1:172.21.15.106:6789/0 conn(0x7f6c780b3dc0 legacy=0x7f6c780ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:03.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.951+0000 7f6c76800640 1 -- 172.21.15.55:0/2731087183 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c7806cbd0 con 0x7f6c780b41a0 2024-04-02T07:29:03.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.951+0000 7f6c6d400640 1 --2- 172.21.15.55:0/2731087183 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c780ade90 0x7f6c7806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:29:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.951+0000 7f6c76800640 1 --2- 172.21.15.55:0/2731087183 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c780b41a0 0x7f6c78142ac0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009d90 tx=0x7f6c7001c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6a1022f66a8ff3cb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c75400640 1 -- 172.21.15.55:0/2731087183 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c700a5880 con 0x7f6c780b41a0 2024-04-02T07:29:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c75400640 1 -- 172.21.15.55:0/2731087183 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c700a59e0 con 0x7f6c780b41a0 2024-04-02T07:29:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c75400640 1 -- 172.21.15.55:0/2731087183 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c700a5d70 con 0x7f6c780b41a0 2024-04-02T07:29:03.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c7d200640 1 -- 172.21.15.55:0/2731087183 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c780b41a0 msgr2=0x7f6c78142ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:03.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c7d200640 1 --2- 172.21.15.55:0/2731087183 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c780b41a0 0x7f6c78142ac0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009d90 tx=0x7f6c7001c8b0 comp rx=0 tx=0).stop 2024-04-02T07:29:03.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c7d200640 1 -- 172.21.15.55:0/2731087183 shutdown_connections 2024-04-02T07:29:03.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c7d200640 1 --2- 172.21.15.55:0/2731087183 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c780b41a0 0x7f6c78142ac0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:03.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c7d200640 1 --2- 172.21.15.55:0/2731087183 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c780ade90 0x7f6c7806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:03.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c7d200640 1 -- 172.21.15.55:0/2731087183 >> 172.21.15.55:0/2731087183 conn(0x7f6c7806a390 msgr2=0x7f6c780b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:03.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c7d200640 1 -- 172.21.15.55:0/2731087183 shutdown_connections 2024-04-02T07:29:03.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c7d200640 1 -- 172.21.15.55:0/2731087183 wait complete. 2024-04-02T07:29:03.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c7d200640 1 Processor -- start 2024-04-02T07:29:03.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c7d200640 1 -- start start 2024-04-02T07:29:03.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c7d200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c780ade90 0x7f6c78155af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:03.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c7d200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c780b3dc0 0x7f6c78138380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:03.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c7d200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c780b41a0 0x7f6c7813ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:03.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c7d200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c78141830 con 0x7f6c780b41a0 2024-04-02T07:29:03.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c7d200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c781553a0 con 0x7f6c780b3dc0 2024-04-02T07:29:03.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c7d200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c78141ad0 con 0x7f6c780ade90 2024-04-02T07:29:03.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c76800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c780b41a0 0x7f6c7813ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c76800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c780b41a0 0x7f6c7813ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51550/0 (socket says 172.21.15.55:51550) 2024-04-02T07:29:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c76800640 1 -- 172.21.15.55:0/3407250622 learned_addr learned my addr 172.21.15.55:0/3407250622 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c6d400640 1 --2- 172.21.15.55:0/3407250622 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c780b3dc0 0x7f6c78138380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.955+0000 7f6c75e00640 1 --2- 172.21.15.55:0/3407250622 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c780ade90 0x7f6c78155af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.959+0000 7f6c76800640 1 -- 172.21.15.55:0/3407250622 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c780ade90 msgr2=0x7f6c78155af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.959+0000 7f6c76800640 1 --2- 172.21.15.55:0/3407250622 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c780ade90 0x7f6c78155af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.959+0000 7f6c76800640 1 -- 172.21.15.55:0/3407250622 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c780b3dc0 msgr2=0x7f6c78138380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.959+0000 7f6c76800640 1 --2- 172.21.15.55:0/3407250622 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c780b3dc0 0x7f6c78138380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.959+0000 7f6c76800640 1 -- 172.21.15.55:0/3407250622 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c600094d0 con 0x7f6c780b41a0 2024-04-02T07:29:03.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.959+0000 7f6c76800640 1 --2- 172.21.15.55:0/3407250622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c780b41a0 0x7f6c7813ddf0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f6c700b0040 tx=0x7f6c70019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.959+0000 7f6c6ea00640 1 -- 172.21.15.55:0/3407250622 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c700b9650 con 0x7f6c780b41a0 2024-04-02T07:29:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.959+0000 7f6c6ea00640 1 -- 172.21.15.55:0/3407250622 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c700b97b0 con 0x7f6c780b41a0 2024-04-02T07:29:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.959+0000 7f6c6ea00640 1 -- 172.21.15.55:0/3407250622 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c700b9b40 con 0x7f6c780b41a0 2024-04-02T07:29:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.959+0000 7f6c7d200640 1 -- 172.21.15.55:0/3407250622 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c70009a70 con 0x7f6c780b41a0 2024-04-02T07:29:03.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.959+0000 7f6c7d200640 1 -- 172.21.15.55:0/3407250622 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7806de00 con 0x7f6c780b41a0 2024-04-02T07:29:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.959+0000 7f6c7d200640 1 -- 172.21.15.55:0/3407250622 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c78073530 con 0x7f6c780b41a0 2024-04-02T07:29:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.959+0000 7f6c6ea00640 1 -- 172.21.15.55:0/3407250622 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6c700b9ca0 con 0x7f6c780b41a0 2024-04-02T07:29:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.959+0000 7f6c6ea00640 1 --2- 172.21.15.55:0/3407250622 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6c54066690 0x7f6c54068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.959+0000 7f6c6ea00640 1 -- 172.21.15.55:0/3407250622 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6c7011f3e0 con 0x7f6c780b41a0 2024-04-02T07:29:03.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.959+0000 7f6c75e00640 1 --2- 172.21.15.55:0/3407250622 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6c54066690 0x7f6c54068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:03.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.963+0000 7f6c75e00640 1 --2- 172.21.15.55:0/3407250622 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6c54066690 0x7f6c54068b50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6c68007fd0 tx=0x7f6c68007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:03.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:03.963+0000 7f6c6ea00640 1 -- 172.21.15.55:0/3407250622 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6c700ec740 con 0x7f6c780b41a0 2024-04-02T07:29:04.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.123+0000 7f6c7d200640 1 -- 172.21.15.55:0/3407250622 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6c7813eff0 con 0x7f6c780b41a0 2024-04-02T07:29:04.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.127+0000 7f6c6ea00640 1 -- 172.21.15.55:0/3407250622 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6c700efd60 con 0x7f6c780b41a0 2024-04-02T07:29:04.127 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:29:04.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.127+0000 7f6c7d200640 1 -- 172.21.15.55:0/3407250622 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6c54066690 msgr2=0x7f6c54068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:04.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.127+0000 7f6c7d200640 1 --2- 172.21.15.55:0/3407250622 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6c54066690 0x7f6c54068b50 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f6c68007fd0 tx=0x7f6c68007d60 comp rx=0 tx=0).stop 2024-04-02T07:29:04.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.127+0000 7f6c7d200640 1 -- 172.21.15.55:0/3407250622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c780b41a0 msgr2=0x7f6c7813ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:04.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.127+0000 7f6c7d200640 1 --2- 172.21.15.55:0/3407250622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c780b41a0 0x7f6c7813ddf0 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f6c700b0040 tx=0x7f6c70019650 comp rx=0 tx=0).stop 2024-04-02T07:29:04.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.127+0000 7f6c7d200640 1 -- 172.21.15.55:0/3407250622 shutdown_connections 2024-04-02T07:29:04.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.127+0000 7f6c7d200640 1 --2- 172.21.15.55:0/3407250622 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c780b41a0 0x7f6c7813ddf0 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.127+0000 7f6c7d200640 1 --2- 172.21.15.55:0/3407250622 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6c54066690 0x7f6c54068b50 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.127+0000 7f6c7d200640 1 --2- 172.21.15.55:0/3407250622 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c780b3dc0 0x7f6c78138380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.127+0000 7f6c7d200640 1 --2- 172.21.15.55:0/3407250622 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c780ade90 0x7f6c78155af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.127+0000 7f6c7d200640 1 -- 172.21.15.55:0/3407250622 >> 172.21.15.55:0/3407250622 conn(0x7f6c7806a390 msgr2=0x7f6c781628e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:04.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.127+0000 7f6c7d200640 1 -- 172.21.15.55:0/3407250622 shutdown_connections 2024-04-02T07:29:04.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.127+0000 7f6c7d200640 1 -- 172.21.15.55:0/3407250622 wait complete. 2024-04-02T07:29:04.148 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:29:04.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.291+0000 7f2fb5a00640 1 Processor -- start 2024-04-02T07:29:04.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.291+0000 7f2fb5a00640 1 -- start start 2024-04-02T07:29:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.291+0000 7f2fb5a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2fb0144260 0x7f2fb00702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.291+0000 7f2fb5a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2fb00707e0 0x7f2fb00b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.291+0000 7f2fb5a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2fb00b2fd0 0x7f2fb00cc4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:04.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.291+0000 7f2fb5a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb00b37c0 con 0x7f2fb00b2fd0 2024-04-02T07:29:04.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.291+0000 7f2fb5a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fb015e3a0 con 0x7f2fb00707e0 2024-04-02T07:29:04.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.291+0000 7f2fb5a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb0070c60 con 0x7f2fb0144260 2024-04-02T07:29:04.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.291+0000 7f2faf400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2fb00b2fd0 0x7f2fb00cc4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:04.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.291+0000 7f2faf400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2fb00b2fd0 0x7f2fb00cc4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51560/0 (socket says 172.21.15.55:51560) 2024-04-02T07:29:04.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.291+0000 7f2faf400640 1 -- 172.21.15.55:0/2165223280 learned_addr learned my addr 172.21.15.55:0/2165223280 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:04.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.291+0000 7f2fa7e00640 1 --2- 172.21.15.55:0/2165223280 >> v2:172.21.15.106:3300/0 conn(0x7f2fb00707e0 0x7f2fb00b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:04.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.291+0000 7f2faea00640 1 --2- 172.21.15.55:0/2165223280 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2fb0144260 0x7f2fb00702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:04.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.291+0000 7f2faf400640 1 -- 172.21.15.55:0/2165223280 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2fb0144260 msgr2=0x7f2fb00702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:04.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.291+0000 7f2faf400640 1 --2- 172.21.15.55:0/2165223280 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2fb0144260 0x7f2fb00702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.291+0000 7f2faf400640 1 -- 172.21.15.55:0/2165223280 >> v2:172.21.15.106:3300/0 conn(0x7f2fb00707e0 msgr2=0x7f2fb00b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:04.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.291+0000 7f2faf400640 1 --2- 172.21.15.55:0/2165223280 >> v2:172.21.15.106:3300/0 conn(0x7f2fb00707e0 0x7f2fb00b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.291+0000 7f2faf400640 1 -- 172.21.15.55:0/2165223280 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb015e5f0 con 0x7f2fb00b2fd0 2024-04-02T07:29:04.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.295+0000 7f2faf400640 1 --2- 172.21.15.55:0/2165223280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb00b2fd0 0x7f2fb00cc4c0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0071740 tx=0x7f2fa801c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff0748d67264a93c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:04.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.295+0000 7f2fae000640 1 -- 172.21.15.55:0/2165223280 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa80a64b0 con 0x7f2fb00b2fd0 2024-04-02T07:29:04.297 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.295+0000 7f2fae000640 1 -- 172.21.15.55:0/2165223280 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa80a6610 con 0x7f2fb00b2fd0 2024-04-02T07:29:04.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.295+0000 7f2fae000640 1 -- 172.21.15.55:0/2165223280 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa80a69a0 con 0x7f2fb00b2fd0 2024-04-02T07:29:04.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.295+0000 7f2fb5a00640 1 -- 172.21.15.55:0/2165223280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb00b2fd0 msgr2=0x7f2fb00cc4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:04.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.295+0000 7f2fb5a00640 1 --2- 172.21.15.55:0/2165223280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb00b2fd0 0x7f2fb00cc4c0 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0071740 tx=0x7f2fa801c730 comp rx=0 tx=0).stop 2024-04-02T07:29:04.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.295+0000 7f2fb5a00640 1 -- 172.21.15.55:0/2165223280 shutdown_connections 2024-04-02T07:29:04.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.295+0000 7f2fb5a00640 1 --2- 172.21.15.55:0/2165223280 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb00b2fd0 0x7f2fb00cc4c0 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.295+0000 7f2fb5a00640 1 --2- 172.21.15.55:0/2165223280 >> v2:172.21.15.106:3300/0 conn(0x7f2fb00707e0 0x7f2fb00b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.295+0000 7f2fb5a00640 1 --2- 172.21.15.55:0/2165223280 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2fb0144260 0x7f2fb00702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.295+0000 7f2fb5a00640 1 -- 172.21.15.55:0/2165223280 >> 172.21.15.55:0/2165223280 conn(0x7f2fb006a390 msgr2=0x7f2fb00b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:04.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.295+0000 7f2fb5a00640 1 -- 172.21.15.55:0/2165223280 shutdown_connections 2024-04-02T07:29:04.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.295+0000 7f2fb5a00640 1 -- 172.21.15.55:0/2165223280 wait complete. 2024-04-02T07:29:04.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2fb5a00640 1 Processor -- start 2024-04-02T07:29:04.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2fb5a00640 1 -- start start 2024-04-02T07:29:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2fb5a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb00707e0 0x7f2fb013b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2fb5a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2fb00b2fd0 0x7f2fb0139870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2fb5a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fb0144260 0x7f2fb0158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2fb5a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb013bc80 con 0x7f2fb00707e0 2024-04-02T07:29:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2fb5a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb013bf50 con 0x7f2fb0144260 2024-04-02T07:29:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2fb5a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb013c230 con 0x7f2fb00b2fd0 2024-04-02T07:29:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2faea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb00707e0 0x7f2fb013b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2faea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb00707e0 0x7f2fb013b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51570/0 (socket says 172.21.15.55:51570) 2024-04-02T07:29:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2faea00640 1 -- 172.21.15.55:0/3430338844 learned_addr learned my addr 172.21.15.55:0/3430338844 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2fa7e00640 1 --2- 172.21.15.55:0/3430338844 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2fb00b2fd0 0x7f2fb0139870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2faf400640 1 --2- 172.21.15.55:0/3430338844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fb0144260 0x7f2fb0158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2faea00640 1 -- 172.21.15.55:0/3430338844 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2fb00b2fd0 msgr2=0x7f2fb0139870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2faea00640 1 --2- 172.21.15.55:0/3430338844 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2fb00b2fd0 0x7f2fb0139870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2faea00640 1 -- 172.21.15.55:0/3430338844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fb0144260 msgr2=0x7f2fb0158d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2faea00640 1 --2- 172.21.15.55:0/3430338844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fb0144260 0x7f2fb0158d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2faea00640 1 -- 172.21.15.55:0/3430338844 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa8009b30 con 0x7f2fb00707e0 2024-04-02T07:29:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2fa7e00640 1 --2- 172.21.15.55:0/3430338844 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2fb00b2fd0 0x7f2fb0139870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:29:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2faf400640 1 --2- 172.21.15.55:0/3430338844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fb0144260 0x7f2fb0158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:29:04.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2faea00640 1 --2- 172.21.15.55:0/3430338844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb00707e0 0x7f2fb013b740 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000d5f0 tx=0x7f2fa000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:04.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2fa6a00640 1 -- 172.21.15.55:0/3430338844 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa00125f0 con 0x7f2fb00707e0 2024-04-02T07:29:04.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2fa6a00640 1 -- 172.21.15.55:0/3430338844 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa0012750 con 0x7f2fb00707e0 2024-04-02T07:29:04.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2fb5a00640 1 -- 172.21.15.55:0/3430338844 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb013c510 con 0x7f2fb00707e0 2024-04-02T07:29:04.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2fa6a00640 1 -- 172.21.15.55:0/3430338844 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa0012ae0 con 0x7f2fb00707e0 2024-04-02T07:29:04.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.299+0000 7f2fb5a00640 1 -- 172.21.15.55:0/3430338844 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb0139db0 con 0x7f2fb00707e0 2024-04-02T07:29:04.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.303+0000 7f2fb5a00640 1 -- 172.21.15.55:0/3430338844 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb0073530 con 0x7f2fb00707e0 2024-04-02T07:29:04.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.303+0000 7f2fa6a00640 1 -- 172.21.15.55:0/3430338844 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2fa0012c40 con 0x7f2fb00707e0 2024-04-02T07:29:04.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.303+0000 7f2fa6a00640 1 --2- 172.21.15.55:0/3430338844 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2f8c066690 0x7f2f8c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:04.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.303+0000 7f2fa6a00640 1 -- 172.21.15.55:0/3430338844 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f2fa00847c0 con 0x7f2fb00707e0 2024-04-02T07:29:04.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.303+0000 7f2fa7e00640 1 --2- 172.21.15.55:0/3430338844 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2f8c066690 0x7f2f8c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:04.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.303+0000 7f2fa7e00640 1 --2- 172.21.15.55:0/3430338844 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2f8c066690 0x7f2f8c068b50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2f98004660 tx=0x7f2f98008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:04.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.307+0000 7f2fa6a00640 1 -- 172.21.15.55:0/3430338844 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2fa00519e0 con 0x7f2fb00707e0 2024-04-02T07:29:04.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.471+0000 7f2fb5a00640 1 -- 172.21.15.55:0/3430338844 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2fb0066c90 con 0x7f2fb00707e0 2024-04-02T07:29:04.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.471+0000 7f2fa6a00640 1 -- 172.21.15.55:0/3430338844 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2fa0055000 con 0x7f2fb00707e0 2024-04-02T07:29:04.471 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:29:04.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.471+0000 7f2fb5a00640 1 -- 172.21.15.55:0/3430338844 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2f8c066690 msgr2=0x7f2f8c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:04.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.471+0000 7f2fb5a00640 1 --2- 172.21.15.55:0/3430338844 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2f8c066690 0x7f2f8c068b50 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f2f98004660 tx=0x7f2f98008040 comp rx=0 tx=0).stop 2024-04-02T07:29:04.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.471+0000 7f2fb5a00640 1 -- 172.21.15.55:0/3430338844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb00707e0 msgr2=0x7f2fb013b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:04.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.471+0000 7f2fb5a00640 1 --2- 172.21.15.55:0/3430338844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb00707e0 0x7f2fb013b740 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f2fa000d5f0 tx=0x7f2fa000dab0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.471+0000 7f2fb5a00640 1 -- 172.21.15.55:0/3430338844 shutdown_connections 2024-04-02T07:29:04.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.471+0000 7f2fb5a00640 1 --2- 172.21.15.55:0/3430338844 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2f8c066690 0x7f2f8c068b50 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.471+0000 7f2fb5a00640 1 --2- 172.21.15.55:0/3430338844 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2fb0144260 0x7f2fb0158d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.471+0000 7f2fb5a00640 1 --2- 172.21.15.55:0/3430338844 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2fb00b2fd0 0x7f2fb0139870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.471+0000 7f2fb5a00640 1 --2- 172.21.15.55:0/3430338844 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fb00707e0 0x7f2fb013b740 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.471+0000 7f2fb5a00640 1 -- 172.21.15.55:0/3430338844 >> 172.21.15.55:0/3430338844 conn(0x7f2fb006a390 msgr2=0x7f2fb006c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:04.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.471+0000 7f2fb5a00640 1 -- 172.21.15.55:0/3430338844 shutdown_connections 2024-04-02T07:29:04.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.471+0000 7f2fb5a00640 1 -- 172.21.15.55:0/3430338844 wait complete. 2024-04-02T07:29:04.492 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:29:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.635+0000 7feaf3e00640 1 Processor -- start 2024-04-02T07:29:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.635+0000 7feaf3e00640 1 -- start start 2024-04-02T07:29:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.635+0000 7feaf3e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feaec098a10 0x7feaec098df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.635+0000 7feaf3e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaec0afc30 0x7feaec0cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.635+0000 7feaf3e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaec099330 con 0x7feaec099750 2024-04-02T07:29:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.635+0000 7feaf3e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaec0ce2b0 con 0x7feaec098a10 2024-04-02T07:29:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.635+0000 7feaf3e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaec0ce590 con 0x7feaec0afc30 2024-04-02T07:29:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.635+0000 7feaf1400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feaec098a10 0x7feaec098df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.635+0000 7feaf1400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feaec098a10 0x7feaec098df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51580/0 (socket says 172.21.15.55:51580) 2024-04-02T07:29:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.635+0000 7feaf1400640 1 -- 172.21.15.55:0/3121097560 learned_addr learned my addr 172.21.15.55:0/3121097560 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.635+0000 7feaf1e00640 1 --2- 172.21.15.55:0/3121097560 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaec0afc30 0x7feaec0cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.635+0000 7feaf1400640 1 -- 172.21.15.55:0/3121097560 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaec0afc30 msgr2=0x7feaec0cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.635+0000 7feaf1400640 1 --2- 172.21.15.55:0/3121097560 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaec0afc30 0x7feaec0cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.635+0000 7feaf1400640 1 -- 172.21.15.55:0/3121097560 >> v1:172.21.15.106:6789/0 conn(0x7feaec099750 legacy=0x7feaec0b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:04.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.635+0000 7feaf1400640 1 -- 172.21.15.55:0/3121097560 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaec0ce870 con 0x7feaec098a10 2024-04-02T07:29:04.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.639+0000 7feaf1400640 1 --2- 172.21.15.55:0/3121097560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaec098a10 0x7feaec098df0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7feaec0737e0 tx=0x7feae001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5a5845174c3613 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:04.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.639+0000 7feaebe00640 1 -- 172.21.15.55:0/3121097560 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae00aa620 con 0x7feaec098a10 2024-04-02T07:29:04.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.639+0000 7feaebe00640 1 -- 172.21.15.55:0/3121097560 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae00aa780 con 0x7feaec098a10 2024-04-02T07:29:04.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.639+0000 7feaebe00640 1 -- 172.21.15.55:0/3121097560 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae00aab10 con 0x7feaec098a10 2024-04-02T07:29:04.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.639+0000 7feaf3e00640 1 -- 172.21.15.55:0/3121097560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaec098a10 msgr2=0x7feaec098df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:04.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.639+0000 7feaf3e00640 1 --2- 172.21.15.55:0/3121097560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaec098a10 0x7feaec098df0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7feaec0737e0 tx=0x7feae001c4e0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.639+0000 7feaf3e00640 1 -- 172.21.15.55:0/3121097560 shutdown_connections 2024-04-02T07:29:04.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.639+0000 7feaf3e00640 1 --2- 172.21.15.55:0/3121097560 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaec0afc30 0x7feaec0cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.639+0000 7feaf3e00640 1 --2- 172.21.15.55:0/3121097560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaec098a10 0x7feaec098df0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.639+0000 7feaf3e00640 1 -- 172.21.15.55:0/3121097560 >> 172.21.15.55:0/3121097560 conn(0x7feaec0b21d0 msgr2=0x7feaec0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:04.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.639+0000 7feaf3e00640 1 -- 172.21.15.55:0/3121097560 shutdown_connections 2024-04-02T07:29:04.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.639+0000 7feaf3e00640 1 -- 172.21.15.55:0/3121097560 wait complete. 2024-04-02T07:29:04.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf3e00640 1 Processor -- start 2024-04-02T07:29:04.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf3e00640 1 -- start start 2024-04-02T07:29:04.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feaec098a10 0x7feaec156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:04.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf3e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaec099750 0x7feaec15dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaec0afc30 0x7feaec15e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf3e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaec156cc0 con 0x7feaec0afc30 2024-04-02T07:29:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf3e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaec06c150 con 0x7feaec098a10 2024-04-02T07:29:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf3e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaec161aa0 con 0x7feaec099750 2024-04-02T07:29:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaec0afc30 0x7feaec15e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaec0afc30 0x7feaec15e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51588/0 (socket says 172.21.15.55:51588) 2024-04-02T07:29:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf1e00640 1 -- 172.21.15.55:0/1878237438 learned_addr learned my addr 172.21.15.55:0/1878237438 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf1400640 1 --2- 172.21.15.55:0/1878237438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feaec098a10 0x7feaec156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:04.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf0a00640 1 --2- 172.21.15.55:0/1878237438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaec099750 0x7feaec15dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:04.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf1e00640 1 -- 172.21.15.55:0/1878237438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaec099750 msgr2=0x7feaec15dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:04.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf1e00640 1 --2- 172.21.15.55:0/1878237438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaec099750 0x7feaec15dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf1e00640 1 -- 172.21.15.55:0/1878237438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feaec098a10 msgr2=0x7feaec156780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:04.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf1e00640 1 --2- 172.21.15.55:0/1878237438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feaec098a10 0x7feaec156780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf1e00640 1 -- 172.21.15.55:0/1878237438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae00094d0 con 0x7feaec0afc30 2024-04-02T07:29:04.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf1e00640 1 --2- 172.21.15.55:0/1878237438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaec0afc30 0x7feaec15e4f0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7feae4007e90 tx=0x7feae400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:04.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feae9600640 1 -- 172.21.15.55:0/1878237438 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4014420 con 0x7feaec0afc30 2024-04-02T07:29:04.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feae9600640 1 -- 172.21.15.55:0/1878237438 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae4014580 con 0x7feaec0afc30 2024-04-02T07:29:04.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feae9600640 1 -- 172.21.15.55:0/1878237438 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4014930 con 0x7feaec0afc30 2024-04-02T07:29:04.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf3e00640 1 -- 172.21.15.55:0/1878237438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaec06bb00 con 0x7feaec0afc30 2024-04-02T07:29:04.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf3e00640 1 -- 172.21.15.55:0/1878237438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaec06b7b0 con 0x7feaec0afc30 2024-04-02T07:29:04.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.643+0000 7feaf3e00640 1 -- 172.21.15.55:0/1878237438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaec06c2e0 con 0x7feaec0afc30 2024-04-02T07:29:04.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.647+0000 7feae9600640 1 -- 172.21.15.55:0/1878237438 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7feae4014a90 con 0x7feaec0afc30 2024-04-02T07:29:04.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.647+0000 7feae9600640 1 --2- 172.21.15.55:0/1878237438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feacc066690 0x7feacc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:04.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.647+0000 7feae9600640 1 -- 172.21.15.55:0/1878237438 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5738+0+0 (secure 0 0 0) 0x7feae4084a30 con 0x7feaec0afc30 2024-04-02T07:29:04.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.647+0000 7feaf1400640 1 --2- 172.21.15.55:0/1878237438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feacc066690 0x7feacc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:04.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.647+0000 7feaf1400640 1 --2- 172.21.15.55:0/1878237438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feacc066690 0x7feacc068b50 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7feae00ae000 tx=0x7feae00b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:04.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.651+0000 7feae9600640 1 -- 172.21.15.55:0/1878237438 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7feae4051d90 con 0x7feaec0afc30 2024-04-02T07:29:04.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.811+0000 7feaf3e00640 1 -- 172.21.15.55:0/1878237438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feaec066c90 con 0x7feaec0afc30 2024-04-02T07:29:04.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.811+0000 7feae9600640 1 -- 172.21.15.55:0/1878237438 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7feae40553b0 con 0x7feaec0afc30 2024-04-02T07:29:04.811 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:29:04.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.811+0000 7feaf3e00640 1 -- 172.21.15.55:0/1878237438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feacc066690 msgr2=0x7feacc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:04.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.811+0000 7feaf3e00640 1 --2- 172.21.15.55:0/1878237438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feacc066690 0x7feacc068b50 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7feae00ae000 tx=0x7feae00b5040 comp rx=0 tx=0).stop 2024-04-02T07:29:04.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.811+0000 7feaf3e00640 1 -- 172.21.15.55:0/1878237438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaec0afc30 msgr2=0x7feaec15e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:04.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.811+0000 7feaf3e00640 1 --2- 172.21.15.55:0/1878237438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaec0afc30 0x7feaec15e4f0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7feae4007e90 tx=0x7feae400e4b0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.811+0000 7feaf3e00640 1 -- 172.21.15.55:0/1878237438 shutdown_connections 2024-04-02T07:29:04.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.811+0000 7feaf3e00640 1 --2- 172.21.15.55:0/1878237438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feaec0afc30 0x7feaec15e4f0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.811+0000 7feaf3e00640 1 --2- 172.21.15.55:0/1878237438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feaec099750 0x7feaec15dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.811+0000 7feaf3e00640 1 --2- 172.21.15.55:0/1878237438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feacc066690 0x7feacc068b50 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.811+0000 7feaf3e00640 1 --2- 172.21.15.55:0/1878237438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feaec098a10 0x7feaec156780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.811+0000 7feaf3e00640 1 -- 172.21.15.55:0/1878237438 >> 172.21.15.55:0/1878237438 conn(0x7feaec0b21d0 msgr2=0x7feaec0ada70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:04.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.811+0000 7feaf3e00640 1 -- 172.21.15.55:0/1878237438 shutdown_connections 2024-04-02T07:29:04.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.811+0000 7feaf3e00640 1 -- 172.21.15.55:0/1878237438 wait complete. 2024-04-02T07:29:04.832 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:29:04.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.971+0000 7f57bf600640 1 Processor -- start 2024-04-02T07:29:04.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.971+0000 7f57bf600640 1 -- start start 2024-04-02T07:29:04.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.971+0000 7f57bf600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57b8160230 0x7f57b80b1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:04.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.971+0000 7f57bf600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57b806bac0 0x7f57b80cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:04.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.971+0000 7f57bf600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57b80ce990 con 0x7f57b80cb1f0 2024-04-02T07:29:04.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.971+0000 7f57bf600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57b8160610 con 0x7f57b8160230 2024-04-02T07:29:04.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.971+0000 7f57bf600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b80cf4f0 con 0x7f57b806bac0 2024-04-02T07:29:04.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.975+0000 7f57bcc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57b8160230 0x7f57b80b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:04.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.975+0000 7f57bcc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f57b8160230 0x7f57b80b1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51604/0 (socket says 172.21.15.55:51604) 2024-04-02T07:29:04.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.975+0000 7f57bcc00640 1 -- 172.21.15.55:0/3803942377 learned_addr learned my addr 172.21.15.55:0/3803942377 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:04.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.975+0000 7f57afe00640 1 --2- 172.21.15.55:0/3803942377 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57b806bac0 0x7f57b80cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:04.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.975+0000 7f57bcc00640 1 -- 172.21.15.55:0/3803942377 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57b806bac0 msgr2=0x7f57b80cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:04.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.975+0000 7f57bcc00640 1 --2- 172.21.15.55:0/3803942377 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57b806bac0 0x7f57b80cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.975+0000 7f57bcc00640 1 -- 172.21.15.55:0/3803942377 >> v1:172.21.15.106:6789/0 conn(0x7f57b80cb1f0 legacy=0x7f57b80cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:04.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.975+0000 7f57bcc00640 1 -- 172.21.15.55:0/3803942377 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b80cebc0 con 0x7f57b8160230 2024-04-02T07:29:04.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.975+0000 7f57bcc00640 1 --2- 172.21.15.55:0/3803942377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b8160230 0x7f57b80b1650 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009870 tx=0x7f57a801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a05f44fc9bd9d82e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:04.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.975+0000 7f57b7e00640 1 -- 172.21.15.55:0/3803942377 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a80a6040 con 0x7f57b8160230 2024-04-02T07:29:04.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.975+0000 7f57b7e00640 1 -- 172.21.15.55:0/3803942377 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a80aa600 con 0x7f57b8160230 2024-04-02T07:29:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.975+0000 7f57b7e00640 1 -- 172.21.15.55:0/3803942377 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a80aa990 con 0x7f57b8160230 2024-04-02T07:29:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bf600640 1 -- 172.21.15.55:0/3803942377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b8160230 msgr2=0x7f57b80b1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bf600640 1 --2- 172.21.15.55:0/3803942377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b8160230 0x7f57b80b1650 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f57a8009870 tx=0x7f57a801c4a0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bf600640 1 -- 172.21.15.55:0/3803942377 shutdown_connections 2024-04-02T07:29:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bf600640 1 --2- 172.21.15.55:0/3803942377 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57b806bac0 0x7f57b80cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bf600640 1 --2- 172.21.15.55:0/3803942377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b8160230 0x7f57b80b1650 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bf600640 1 -- 172.21.15.55:0/3803942377 >> 172.21.15.55:0/3803942377 conn(0x7f57b80b2150 msgr2=0x7f57b80b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bf600640 1 -- 172.21.15.55:0/3803942377 shutdown_connections 2024-04-02T07:29:04.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bf600640 1 -- 172.21.15.55:0/3803942377 wait complete. 2024-04-02T07:29:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bf600640 1 Processor -- start 2024-04-02T07:29:04.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bf600640 1 -- start start 2024-04-02T07:29:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bf600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b806bac0 0x7f57b80c7730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:04.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bf600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57b80cb1f0 0x7f57b80c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bf600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57b8160230 0x7f57b815c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bf600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b8154db0 con 0x7f57b806bac0 2024-04-02T07:29:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bf600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57b815c640 con 0x7f57b80cb1f0 2024-04-02T07:29:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bf600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57b80c7d10 con 0x7f57b8160230 2024-04-02T07:29:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bcc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b806bac0 0x7f57b80c7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bcc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b806bac0 0x7f57b80c7730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51610/0 (socket says 172.21.15.55:51610) 2024-04-02T07:29:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bcc00640 1 -- 172.21.15.55:0/2400048310 learned_addr learned my addr 172.21.15.55:0/2400048310 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57afe00640 1 --2- 172.21.15.55:0/2400048310 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57b80cb1f0 0x7f57b80c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bd600640 1 --2- 172.21.15.55:0/2400048310 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57b8160230 0x7f57b815c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bcc00640 1 -- 172.21.15.55:0/2400048310 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57b8160230 msgr2=0x7f57b815c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bcc00640 1 --2- 172.21.15.55:0/2400048310 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57b8160230 0x7f57b815c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bcc00640 1 -- 172.21.15.55:0/2400048310 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57b80cb1f0 msgr2=0x7f57b80c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bcc00640 1 --2- 172.21.15.55:0/2400048310 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57b80cb1f0 0x7f57b80c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bcc00640 1 -- 172.21.15.55:0/2400048310 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a80094d0 con 0x7f57b806bac0 2024-04-02T07:29:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bd600640 1 --2- 172.21.15.55:0/2400048310 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57b8160230 0x7f57b815c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:29:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.979+0000 7f57bcc00640 1 --2- 172.21.15.55:0/2400048310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b806bac0 0x7f57b80c7730 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f57a801a0d0 tx=0x7f57a801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.983+0000 7f57b5600640 1 -- 172.21.15.55:0/2400048310 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a80b3600 con 0x7f57b806bac0 2024-04-02T07:29:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.983+0000 7f57b5600640 1 -- 172.21.15.55:0/2400048310 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a80b3760 con 0x7f57b806bac0 2024-04-02T07:29:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.983+0000 7f57b5600640 1 -- 172.21.15.55:0/2400048310 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a80b3af0 con 0x7f57b806bac0 2024-04-02T07:29:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.983+0000 7f57bf600640 1 -- 172.21.15.55:0/2400048310 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57b80c7ff0 con 0x7f57b806bac0 2024-04-02T07:29:04.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.983+0000 7f57bf600640 1 -- 172.21.15.55:0/2400048310 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57b80c85b0 con 0x7f57b806bac0 2024-04-02T07:29:04.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.983+0000 7f57bf600640 1 -- 172.21.15.55:0/2400048310 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57b8066c90 con 0x7f57b806bac0 2024-04-02T07:29:04.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.983+0000 7f57b5600640 1 -- 172.21.15.55:0/2400048310 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f57a80b3c50 con 0x7f57b806bac0 2024-04-02T07:29:04.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.983+0000 7f57b5600640 1 --2- 172.21.15.55:0/2400048310 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5794066690 0x7f5794068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:04.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.983+0000 7f57b5600640 1 -- 172.21.15.55:0/2400048310 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f57a811ec40 con 0x7f57b806bac0 2024-04-02T07:29:04.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.983+0000 7f57afe00640 1 --2- 172.21.15.55:0/2400048310 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5794066690 0x7f5794068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:04.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.987+0000 7f57afe00640 1 --2- 172.21.15.55:0/2400048310 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5794066690 0x7f5794068b50 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f57b8159ad0 tx=0x7f57a0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:04.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:04.987+0000 7f57b5600640 1 -- 172.21.15.55:0/2400048310 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f57a80ec030 con 0x7f57b806bac0 2024-04-02T07:29:05.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.159+0000 7f57bf600640 1 -- 172.21.15.55:0/2400048310 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f57b80b2f40 con 0x7f57b806bac0 2024-04-02T07:29:05.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.159+0000 7f57b5600640 1 -- 172.21.15.55:0/2400048310 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v89) v1 ==== 80+0+0 (secure 0 0 0) 0x7f57a80ef650 con 0x7f57b806bac0 2024-04-02T07:29:05.162 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:29:05.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.163+0000 7f57bf600640 1 -- 172.21.15.55:0/2400048310 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5794066690 msgr2=0x7f5794068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:05.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.163+0000 7f57bf600640 1 --2- 172.21.15.55:0/2400048310 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5794066690 0x7f5794068b50 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f57b8159ad0 tx=0x7f57a0009190 comp rx=0 tx=0).stop 2024-04-02T07:29:05.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.163+0000 7f57bf600640 1 -- 172.21.15.55:0/2400048310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b806bac0 msgr2=0x7f57b80c7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:05.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.163+0000 7f57bf600640 1 --2- 172.21.15.55:0/2400048310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b806bac0 0x7f57b80c7730 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f57a801a0d0 tx=0x7f57a801ace0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.163+0000 7f57bf600640 1 -- 172.21.15.55:0/2400048310 shutdown_connections 2024-04-02T07:29:05.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.163+0000 7f57bf600640 1 --2- 172.21.15.55:0/2400048310 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57b8160230 0x7f57b815c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.163+0000 7f57bf600640 1 --2- 172.21.15.55:0/2400048310 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5794066690 0x7f5794068b50 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.163+0000 7f57bf600640 1 --2- 172.21.15.55:0/2400048310 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57b80cb1f0 0x7f57b80c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.163+0000 7f57bf600640 1 --2- 172.21.15.55:0/2400048310 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57b806bac0 0x7f57b80c7730 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.163+0000 7f57bf600640 1 -- 172.21.15.55:0/2400048310 >> 172.21.15.55:0/2400048310 conn(0x7f57b80b2150 msgr2=0x7f57b806ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:05.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.163+0000 7f57bf600640 1 -- 172.21.15.55:0/2400048310 shutdown_connections 2024-04-02T07:29:05.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.163+0000 7f57bf600640 1 -- 172.21.15.55:0/2400048310 wait complete. 2024-04-02T07:29:05.184 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:29:05.184 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:29:05.193 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:29:05.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.371+0000 7f87b8200640 1 Processor -- start 2024-04-02T07:29:05.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.371+0000 7f87b8200640 1 -- start start 2024-04-02T07:29:05.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.375+0000 7f87b8200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87b0157350 0x7f87b00cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:05.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.375+0000 7f87b8200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87b00d02a0 0x7f87b00b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:05.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.375+0000 7f87b8200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87b015d950 con 0x7f87b0156f70 2024-04-02T07:29:05.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.375+0000 7f87b8200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87b015dc30 con 0x7f87b0157350 2024-04-02T07:29:05.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.375+0000 7f87b8200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b015df10 con 0x7f87b00d02a0 2024-04-02T07:29:05.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.375+0000 7f87b4e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f87b0157350 0x7f87b00cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:05.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.375+0000 7f87b5800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f87b0156f70 0x7f87b015d0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37238/0 (socket says 172.21.15.55:37238) 2024-04-02T07:29:05.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.375+0000 7f87b5800640 1 -- 172.21.15.55:0/686904769 learned_addr learned my addr 172.21.15.55:0/686904769 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:29:05.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.375+0000 7f87b6200640 1 --2- 172.21.15.55:0/686904769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87b00d02a0 0x7f87b00b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:05.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.375+0000 7f87b4e00640 1 -- 172.21.15.55:0/686904769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87b00d02a0 msgr2=0x7f87b00b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:05.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.375+0000 7f87b4e00640 1 --2- 172.21.15.55:0/686904769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87b00d02a0 0x7f87b00b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.375+0000 7f87b4e00640 1 -- 172.21.15.55:0/686904769 >> v1:172.21.15.55:6789/0 conn(0x7f87b0156f70 legacy=0x7f87b015d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:05.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.375+0000 7f87b4e00640 1 -- 172.21.15.55:0/686904769 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b00cf560 con 0x7f87b0157350 2024-04-02T07:29:05.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.375+0000 7f87afe00640 1 -- 172.21.15.55:0/686904769 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779938297 0 0) 0x7f87b015d950 con 0x7f87b0156f70 2024-04-02T07:29:05.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.375+0000 7f87b6200640 1 --2- 172.21.15.55:0/686904769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87b00d02a0 0x7f87b00b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:29:05.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.375+0000 7f87b4e00640 1 --2- 172.21.15.55:0/686904769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b0157350 0x7f87b00cfd60 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f879c0097c0 tx=0x7f879c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0678c85dadaa768 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:05.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87afe00640 1 -- 172.21.15.55:0/686904769 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c0aa5f0 con 0x7f87b0157350 2024-04-02T07:29:05.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87afe00640 1 -- 172.21.15.55:0/686904769 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c0aa750 con 0x7f87b0157350 2024-04-02T07:29:05.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87afe00640 1 -- 172.21.15.55:0/686904769 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c0aaae0 con 0x7f87b0157350 2024-04-02T07:29:05.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b8200640 1 -- 172.21.15.55:0/686904769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b0157350 msgr2=0x7f87b00cfd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:05.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b8200640 1 --2- 172.21.15.55:0/686904769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b0157350 0x7f87b00cfd60 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f879c0097c0 tx=0x7f879c01c470 comp rx=0 tx=0).stop 2024-04-02T07:29:05.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b8200640 1 -- 172.21.15.55:0/686904769 shutdown_connections 2024-04-02T07:29:05.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b8200640 1 --2- 172.21.15.55:0/686904769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87b00d02a0 0x7f87b00b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b8200640 1 --2- 172.21.15.55:0/686904769 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b0157350 0x7f87b00cfd60 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b8200640 1 -- 172.21.15.55:0/686904769 >> 172.21.15.55:0/686904769 conn(0x7f87b00b13b0 msgr2=0x7f87b00b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:05.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b8200640 1 -- 172.21.15.55:0/686904769 shutdown_connections 2024-04-02T07:29:05.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b8200640 1 -- 172.21.15.55:0/686904769 wait complete. 2024-04-02T07:29:05.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b8200640 1 Processor -- start 2024-04-02T07:29:05.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b8200640 1 -- start start 2024-04-02T07:29:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b8200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87b00d02a0 0x7f87b00cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b8200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87b0156f70 0x7f87b013c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b8200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b0157350 0x7f87b00ca0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b8200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b00cb770 con 0x7f87b0157350 2024-04-02T07:29:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b8200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87b00caaf0 con 0x7f87b00d02a0 2024-04-02T07:29:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b8200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87b00cadd0 con 0x7f87b0156f70 2024-04-02T07:29:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b6200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b0157350 0x7f87b00ca0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b6200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b0157350 0x7f87b00ca0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51616/0 (socket says 172.21.15.55:51616) 2024-04-02T07:29:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b6200640 1 -- 172.21.15.55:0/4264669155 learned_addr learned my addr 172.21.15.55:0/4264669155 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b4e00640 1 --2- 172.21.15.55:0/4264669155 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87b0156f70 0x7f87b013c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.379+0000 7f87b5800640 1 --2- 172.21.15.55:0/4264669155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87b00d02a0 0x7f87b00cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:05.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.383+0000 7f87b6200640 1 -- 172.21.15.55:0/4264669155 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87b0156f70 msgr2=0x7f87b013c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:05.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.383+0000 7f87b6200640 1 --2- 172.21.15.55:0/4264669155 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87b0156f70 0x7f87b013c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.383+0000 7f87b6200640 1 -- 172.21.15.55:0/4264669155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87b00d02a0 msgr2=0x7f87b00cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:05.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.383+0000 7f87b6200640 1 --2- 172.21.15.55:0/4264669155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87b00d02a0 0x7f87b00cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.383+0000 7f87b6200640 1 -- 172.21.15.55:0/4264669155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c009420 con 0x7f87b0157350 2024-04-02T07:29:05.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.383+0000 7f87b6200640 1 --2- 172.21.15.55:0/4264669155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b0157350 0x7f87b00ca0f0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f87a8009f70 tx=0x7f87a800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:05.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.383+0000 7f87ad600640 1 -- 172.21.15.55:0/4264669155 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8003ba0 con 0x7f87b0157350 2024-04-02T07:29:05.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.383+0000 7f87ad600640 1 -- 172.21.15.55:0/4264669155 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87a800f040 con 0x7f87b0157350 2024-04-02T07:29:05.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.383+0000 7f87b8200640 1 -- 172.21.15.55:0/4264669155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87b00cb0b0 con 0x7f87b0157350 2024-04-02T07:29:05.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.383+0000 7f87ad600640 1 -- 172.21.15.55:0/4264669155 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87a8004030 con 0x7f87b0157350 2024-04-02T07:29:05.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.383+0000 7f87b8200640 1 -- 172.21.15.55:0/4264669155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87b00ca630 con 0x7f87b0157350 2024-04-02T07:29:05.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.383+0000 7f87b8200640 1 -- 172.21.15.55:0/4264669155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87b00cb8b0 con 0x7f87b0157350 2024-04-02T07:29:05.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.383+0000 7f87ad600640 1 -- 172.21.15.55:0/4264669155 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f87a8004190 con 0x7f87b0157350 2024-04-02T07:29:05.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.383+0000 7f87ad600640 1 --2- 172.21.15.55:0/4264669155 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8790066690 0x7f8790068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:05.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.383+0000 7f87ad600640 1 -- 172.21.15.55:0/4264669155 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f87a80843f0 con 0x7f87b0157350 2024-04-02T07:29:05.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.383+0000 7f87b5800640 1 --2- 172.21.15.55:0/4264669155 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8790066690 0x7f8790068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:05.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.387+0000 7f87b5800640 1 --2- 172.21.15.55:0/4264669155 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8790066690 0x7f8790068b50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f87a4007fd0 tx=0x7f87a4007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:05.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.387+0000 7f87ad600640 1 -- 172.21.15.55:0/4264669155 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f87b00cb8b0 con 0x7f87b0157350 2024-04-02T07:29:05.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.547+0000 7f87b8200640 1 -- 172.21.15.55:0/4264669155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f87b00cb8b0 con 0x7f87b0157350 2024-04-02T07:29:05.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.551+0000 7f87ad600640 1 -- 172.21.15.55:0/4264669155 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+16141 (secure 0 0 0) 0x7f87b00cb8b0 con 0x7f87b0157350 2024-04-02T07:29:05.551 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:29:05.551 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":89,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:29:01.153144+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:28:52.464907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-02T07:28:52.918058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.c","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:29:05.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.551+0000 7f87b8200640 1 -- 172.21.15.55:0/4264669155 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8790066690 msgr2=0x7f8790068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:05.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.551+0000 7f87b8200640 1 --2- 172.21.15.55:0/4264669155 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8790066690 0x7f8790068b50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f87a4007fd0 tx=0x7f87a4007d60 comp rx=0 tx=0).stop 2024-04-02T07:29:05.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.551+0000 7f87b8200640 1 -- 172.21.15.55:0/4264669155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b0157350 msgr2=0x7f87b00ca0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:05.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.551+0000 7f87b8200640 1 --2- 172.21.15.55:0/4264669155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b0157350 0x7f87b00ca0f0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f87a8009f70 tx=0x7f87a800d560 comp rx=0 tx=0).stop 2024-04-02T07:29:05.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.551+0000 7f87b8200640 1 -- 172.21.15.55:0/4264669155 shutdown_connections 2024-04-02T07:29:05.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.551+0000 7f87b8200640 1 --2- 172.21.15.55:0/4264669155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87b0157350 0x7f87b00ca0f0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.551+0000 7f87b8200640 1 --2- 172.21.15.55:0/4264669155 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87b0156f70 0x7f87b013c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.551+0000 7f87b8200640 1 --2- 172.21.15.55:0/4264669155 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8790066690 0x7f8790068b50 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.551+0000 7f87b8200640 1 --2- 172.21.15.55:0/4264669155 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87b00d02a0 0x7f87b00cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.551+0000 7f87b8200640 1 -- 172.21.15.55:0/4264669155 >> 172.21.15.55:0/4264669155 conn(0x7f87b00b13b0 msgr2=0x7f87b015ecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:05.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.551+0000 7f87b8200640 1 -- 172.21.15.55:0/4264669155 shutdown_connections 2024-04-02T07:29:05.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.551+0000 7f87b8200640 1 -- 172.21.15.55:0/4264669155 wait complete. 2024-04-02T07:29:05.572 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:28:52.464907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:28:52.918058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:29:05.572 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:29:05.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.715+0000 7f5214200640 1 Processor -- start 2024-04-02T07:29:05.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.715+0000 7f5214200640 1 -- start start 2024-04-02T07:29:05.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.715+0000 7f5214200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f520c157000 0x7f520c071a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:05.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.715+0000 7f5214200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f520c071f60 0x7f520c069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:05.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.715+0000 7f5214200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520c15de90 con 0x7f520c06a2d0 2024-04-02T07:29:05.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.715+0000 7f5214200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c15d070 con 0x7f520c071f60 2024-04-02T07:29:05.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.715+0000 7f5214200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c0723e0 con 0x7f520c157000 2024-04-02T07:29:05.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.715+0000 7f5210e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f520c071f60 0x7f520c069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:05.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.715+0000 7f5212200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f520c06a2d0 0x7f520c0cf5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44078/0 (socket says 172.21.15.55:44078) 2024-04-02T07:29:05.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.715+0000 7f5212200640 1 -- 172.21.15.55:0/647849475 learned_addr learned my addr 172.21.15.55:0/647849475 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:29:05.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.715+0000 7f5211800640 1 --2- 172.21.15.55:0/647849475 >> v2:172.21.15.106:3300/0 conn(0x7f520c157000 0x7f520c071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:05.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.715+0000 7f520be00640 1 -- 172.21.15.55:0/647849475 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3320721511 0 0) 0x7f520c15de90 con 0x7f520c06a2d0 2024-04-02T07:29:05.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.715+0000 7f5210e00640 1 -- 172.21.15.55:0/647849475 >> v2:172.21.15.106:3300/0 conn(0x7f520c157000 msgr2=0x7f520c071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:05.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.715+0000 7f5210e00640 1 --2- 172.21.15.55:0/647849475 >> v2:172.21.15.106:3300/0 conn(0x7f520c157000 0x7f520c071a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.715+0000 7f5210e00640 1 -- 172.21.15.55:0/647849475 >> v1:172.21.15.55:6789/0 conn(0x7f520c06a2d0 legacy=0x7f520c0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:05.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.715+0000 7f5210e00640 1 -- 172.21.15.55:0/647849475 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c15d280 con 0x7f520c071f60 2024-04-02T07:29:05.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.719+0000 7f5210e00640 1 --2- 172.21.15.55:0/647849475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f520c071f60 0x7f520c069d90 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f520c06c770 tx=0x7f51f801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2760d265eda7af2d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:05.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.719+0000 7f520be00640 1 -- 172.21.15.55:0/647849475 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f80ab600 con 0x7f520c071f60 2024-04-02T07:29:05.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.719+0000 7f520be00640 1 -- 172.21.15.55:0/647849475 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f80a7050 con 0x7f520c071f60 2024-04-02T07:29:05.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.719+0000 7f520be00640 1 -- 172.21.15.55:0/647849475 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f80ab980 con 0x7f520c071f60 2024-04-02T07:29:05.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.719+0000 7f5214200640 1 -- 172.21.15.55:0/647849475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f520c071f60 msgr2=0x7f520c069d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:05.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.719+0000 7f5214200640 1 --2- 172.21.15.55:0/647849475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f520c071f60 0x7f520c069d90 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f520c06c770 tx=0x7f51f801c450 comp rx=0 tx=0).stop 2024-04-02T07:29:05.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.719+0000 7f5214200640 1 -- 172.21.15.55:0/647849475 shutdown_connections 2024-04-02T07:29:05.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.719+0000 7f5214200640 1 --2- 172.21.15.55:0/647849475 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f520c071f60 0x7f520c069d90 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.719+0000 7f5214200640 1 --2- 172.21.15.55:0/647849475 >> v2:172.21.15.106:3300/0 conn(0x7f520c157000 0x7f520c071a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.719+0000 7f5214200640 1 -- 172.21.15.55:0/647849475 >> 172.21.15.55:0/647849475 conn(0x7f520c0b13b0 msgr2=0x7f520c0b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:05.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.719+0000 7f5214200640 1 -- 172.21.15.55:0/647849475 shutdown_connections 2024-04-02T07:29:05.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.719+0000 7f5214200640 1 -- 172.21.15.55:0/647849475 wait complete. 2024-04-02T07:29:05.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.719+0000 7f5214200640 1 Processor -- start 2024-04-02T07:29:05.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.719+0000 7f5214200640 1 -- start start 2024-04-02T07:29:05.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5214200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f520c06a2d0 0x7f520c146e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:05.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5214200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f520c071f60 0x7f520c14cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:05.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5214200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f520c157000 0x7f520c14d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:05.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5214200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0cc6d0 con 0x7f520c06a2d0 2024-04-02T07:29:05.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5214200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0cc9b0 con 0x7f520c071f60 2024-04-02T07:29:05.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5214200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0ccc90 con 0x7f520c157000 2024-04-02T07:29:05.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5211800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f520c06a2d0 0x7f520c146e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:05.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5211800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f520c06a2d0 0x7f520c146e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40980/0 (socket says 172.21.15.55:40980) 2024-04-02T07:29:05.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5211800640 1 -- 172.21.15.55:0/957101610 learned_addr learned my addr 172.21.15.55:0/957101610 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:05.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5212200640 1 --2- 172.21.15.55:0/957101610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f520c157000 0x7f520c14d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:05.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5210e00640 1 --2- 172.21.15.55:0/957101610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f520c071f60 0x7f520c14cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:05.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5211800640 1 -- 172.21.15.55:0/957101610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f520c157000 msgr2=0x7f520c14d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:05.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5211800640 1 --2- 172.21.15.55:0/957101610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f520c157000 0x7f520c14d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5211800640 1 -- 172.21.15.55:0/957101610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f520c071f60 msgr2=0x7f520c14cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:05.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5211800640 1 --2- 172.21.15.55:0/957101610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f520c071f60 0x7f520c14cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5211800640 1 -- 172.21.15.55:0/957101610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f8009420 con 0x7f520c06a2d0 2024-04-02T07:29:05.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5210e00640 1 --2- 172.21.15.55:0/957101610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f520c071f60 0x7f520c14cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:29:05.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5212200640 1 --2- 172.21.15.55:0/957101610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f520c157000 0x7f520c14d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:29:05.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5211800640 1 --2- 172.21.15.55:0/957101610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f520c06a2d0 0x7f520c146e90 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f520000d5f0 tx=0x7f520000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:05.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5209600640 1 -- 172.21.15.55:0/957101610 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52000125f0 con 0x7f520c06a2d0 2024-04-02T07:29:05.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5209600640 1 -- 172.21.15.55:0/957101610 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5200012750 con 0x7f520c06a2d0 2024-04-02T07:29:05.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5214200640 1 -- 172.21.15.55:0/957101610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c0ccf70 con 0x7f520c06a2d0 2024-04-02T07:29:05.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5209600640 1 -- 172.21.15.55:0/957101610 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5200012ae0 con 0x7f520c06a2d0 2024-04-02T07:29:05.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5214200640 1 -- 172.21.15.55:0/957101610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c1473d0 con 0x7f520c06a2d0 2024-04-02T07:29:05.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5214200640 1 -- 172.21.15.55:0/957101610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520c066c90 con 0x7f520c06a2d0 2024-04-02T07:29:05.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.723+0000 7f5209600640 1 -- 172.21.15.55:0/957101610 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5200012c40 con 0x7f520c06a2d0 2024-04-02T07:29:05.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.727+0000 7f5209600640 1 --2- 172.21.15.55:0/957101610 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51ec066690 0x7f51ec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:05.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.727+0000 7f5209600640 1 -- 172.21.15.55:0/957101610 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f5200084750 con 0x7f520c06a2d0 2024-04-02T07:29:05.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.727+0000 7f5210e00640 1 --2- 172.21.15.55:0/957101610 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51ec066690 0x7f51ec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:05.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.727+0000 7f5210e00640 1 --2- 172.21.15.55:0/957101610 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51ec066690 0x7f51ec068b50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f51f80ad000 tx=0x7f51f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:05.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.731+0000 7f5209600640 1 -- 172.21.15.55:0/957101610 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5200051a00 con 0x7f520c06a2d0 2024-04-02T07:29:05.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.891+0000 7f5214200640 1 -- 172.21.15.55:0/957101610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f520c1687e0 con 0x7f520c06a2d0 2024-04-02T07:29:05.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.891+0000 7f5209600640 1 -- 172.21.15.55:0/957101610 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5200007380 con 0x7f520c06a2d0 2024-04-02T07:29:05.891 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:29:05.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.891+0000 7f5214200640 1 -- 172.21.15.55:0/957101610 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51ec066690 msgr2=0x7f51ec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:05.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.891+0000 7f5214200640 1 --2- 172.21.15.55:0/957101610 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51ec066690 0x7f51ec068b50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f51f80ad000 tx=0x7f51f8008040 comp rx=0 tx=0).stop 2024-04-02T07:29:05.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.891+0000 7f5214200640 1 -- 172.21.15.55:0/957101610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f520c06a2d0 msgr2=0x7f520c146e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:05.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.891+0000 7f5214200640 1 --2- 172.21.15.55:0/957101610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f520c06a2d0 0x7f520c146e90 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f520000d5f0 tx=0x7f520000dab0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.891+0000 7f5214200640 1 -- 172.21.15.55:0/957101610 shutdown_connections 2024-04-02T07:29:05.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.891+0000 7f5214200640 1 --2- 172.21.15.55:0/957101610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f520c157000 0x7f520c14d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.891+0000 7f5214200640 1 --2- 172.21.15.55:0/957101610 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51ec066690 0x7f51ec068b50 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.891+0000 7f5214200640 1 --2- 172.21.15.55:0/957101610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f520c071f60 0x7f520c14cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.891+0000 7f5214200640 1 --2- 172.21.15.55:0/957101610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f520c06a2d0 0x7f520c146e90 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:05.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.891+0000 7f5214200640 1 -- 172.21.15.55:0/957101610 >> 172.21.15.55:0/957101610 conn(0x7f520c0b13b0 msgr2=0x7f520c0b32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:05.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.891+0000 7f5214200640 1 -- 172.21.15.55:0/957101610 shutdown_connections 2024-04-02T07:29:05.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:05.891+0000 7f5214200640 1 -- 172.21.15.55:0/957101610 wait complete. 2024-04-02T07:29:05.913 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:29:06.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.055+0000 7f3244400640 1 Processor -- start 2024-04-02T07:29:06.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.055+0000 7f3244400640 1 -- start start 2024-04-02T07:29:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.055+0000 7f3244400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f323c0b3dc0 0x7f323c0ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.055+0000 7f3244400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323c06ddc0 con 0x7f323c0b41a0 2024-04-02T07:29:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.055+0000 7f3244400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323c06c630 con 0x7f323c0ade90 2024-04-02T07:29:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.055+0000 7f3244400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c06c8f0 con 0x7f323c0b3dc0 2024-04-02T07:29:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.055+0000 7f3242400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f323c0b41a0 0x7f323c142ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44084/0 (socket says 172.21.15.55:44084) 2024-04-02T07:29:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.055+0000 7f3242400640 1 -- 172.21.15.55:0/1890168873 learned_addr learned my addr 172.21.15.55:0/1890168873 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:29:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.055+0000 7f3241a00640 1 --2- 172.21.15.55:0/1890168873 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f323c0b3dc0 0x7f323c0ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.055+0000 7f323be00640 1 -- 172.21.15.55:0/1890168873 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942155251 0 0) 0x7f323c06ddc0 con 0x7f323c0b41a0 2024-04-02T07:29:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.055+0000 7f323be00640 1 -- 172.21.15.55:0/1890168873 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3224003530 con 0x7f323c0b41a0 2024-04-02T07:29:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.055+0000 7f323be00640 1 -- 172.21.15.55:0/1890168873 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 68512468 0 0) 0x7f323c06c630 con 0x7f323c0ade90 2024-04-02T07:29:06.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.055+0000 7f323be00640 1 -- 172.21.15.55:0/1890168873 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f323c06ddc0 con 0x7f323c0ade90 2024-04-02T07:29:06.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.055+0000 7f323be00640 1 -- 172.21.15.55:0/1890168873 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3701036442 0 0) 0x7f3224003530 con 0x7f323c0b41a0 2024-04-02T07:29:06.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.055+0000 7f3241a00640 1 -- 172.21.15.55:0/1890168873 >> v1:172.21.15.106:6789/0 conn(0x7f323c0ade90 legacy=0x7f323c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:06.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.055+0000 7f3241a00640 1 -- 172.21.15.55:0/1890168873 >> v1:172.21.15.55:6789/0 conn(0x7f323c0b41a0 legacy=0x7f323c142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:06.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.055+0000 7f3241a00640 1 -- 172.21.15.55:0/1890168873 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323c06cbd0 con 0x7f323c0b3dc0 2024-04-02T07:29:06.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.059+0000 7f3241a00640 1 --2- 172.21.15.55:0/1890168873 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f323c0b3dc0 0x7f323c0ca770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f32300097f0 tx=0x7f323001c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2c4aad7b0485cf1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:06.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.059+0000 7f323be00640 1 -- 172.21.15.55:0/1890168873 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3234001a00 con 0x7f323c0b3dc0 2024-04-02T07:29:06.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.059+0000 7f323be00640 1 -- 172.21.15.55:0/1890168873 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32300a7050 con 0x7f323c0b3dc0 2024-04-02T07:29:06.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.059+0000 7f323be00640 1 -- 172.21.15.55:0/1890168873 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32300ab620 con 0x7f323c0b3dc0 2024-04-02T07:29:06.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.059+0000 7f3244400640 1 -- 172.21.15.55:0/1890168873 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f323c0b3dc0 msgr2=0x7f323c0ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:06.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.059+0000 7f3244400640 1 --2- 172.21.15.55:0/1890168873 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f323c0b3dc0 0x7f323c0ca770 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f32300097f0 tx=0x7f323001c340 comp rx=0 tx=0).stop 2024-04-02T07:29:06.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.059+0000 7f3244400640 1 -- 172.21.15.55:0/1890168873 shutdown_connections 2024-04-02T07:29:06.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.059+0000 7f3244400640 1 --2- 172.21.15.55:0/1890168873 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f323c0b3dc0 0x7f323c0ca770 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.059+0000 7f3244400640 1 -- 172.21.15.55:0/1890168873 >> 172.21.15.55:0/1890168873 conn(0x7f323c06a390 msgr2=0x7f323c0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:06.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.059+0000 7f3244400640 1 -- 172.21.15.55:0/1890168873 shutdown_connections 2024-04-02T07:29:06.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.059+0000 7f3244400640 1 -- 172.21.15.55:0/1890168873 wait complete. 2024-04-02T07:29:06.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3244400640 1 Processor -- start 2024-04-02T07:29:06.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3244400640 1 -- start start 2024-04-02T07:29:06.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3244400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f323c0ade90 0x7f323c15c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3244400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f323c0b3dc0 0x7f323c14e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3244400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f323c0b41a0 0x7f323c141e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3244400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c154c90 con 0x7f323c0ade90 2024-04-02T07:29:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3244400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323c1423b0 con 0x7f323c0b41a0 2024-04-02T07:29:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3244400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f323c154480 con 0x7f323c0b3dc0 2024-04-02T07:29:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3241a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f323c0ade90 0x7f323c15c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3241a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f323c0ade90 0x7f323c15c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40996/0 (socket says 172.21.15.55:40996) 2024-04-02T07:29:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3241a00640 1 -- 172.21.15.55:0/1664250860 learned_addr learned my addr 172.21.15.55:0/1664250860 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3241000640 1 --2- 172.21.15.55:0/1664250860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f323c0b3dc0 0x7f323c14e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3242400640 1 --2- 172.21.15.55:0/1664250860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f323c0b41a0 0x7f323c141e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3241a00640 1 -- 172.21.15.55:0/1664250860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f323c0b3dc0 msgr2=0x7f323c14e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3241a00640 1 --2- 172.21.15.55:0/1664250860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f323c0b3dc0 0x7f323c14e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3241a00640 1 -- 172.21.15.55:0/1664250860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f323c0b41a0 msgr2=0x7f323c141e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:06.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3241a00640 1 --2- 172.21.15.55:0/1664250860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f323c0b41a0 0x7f323c141e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3241a00640 1 -- 172.21.15.55:0/1664250860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3230009420 con 0x7f323c0ade90 2024-04-02T07:29:06.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3242400640 1 --2- 172.21.15.55:0/1664250860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f323c0b41a0 0x7f323c141e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:29:06.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3241a00640 1 --2- 172.21.15.55:0/1664250860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f323c0ade90 0x7f323c15c580 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f3230009740 tx=0x7f32300190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:06.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3239600640 1 -- 172.21.15.55:0/1664250860 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3230004020 con 0x7f323c0ade90 2024-04-02T07:29:06.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3239600640 1 -- 172.21.15.55:0/1664250860 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3230004180 con 0x7f323c0ade90 2024-04-02T07:29:06.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3239600640 1 -- 172.21.15.55:0/1664250860 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32300044f0 con 0x7f323c0ade90 2024-04-02T07:29:06.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3244400640 1 -- 172.21.15.55:0/1664250860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f323c1f9300 con 0x7f323c0ade90 2024-04-02T07:29:06.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.063+0000 7f3244400640 1 -- 172.21.15.55:0/1664250860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f323c1549b0 con 0x7f323c0ade90 2024-04-02T07:29:06.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.067+0000 7f3244400640 1 -- 172.21.15.55:0/1664250860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f323c1f9160 con 0x7f323c0ade90 2024-04-02T07:29:06.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.067+0000 7f3239600640 1 -- 172.21.15.55:0/1664250860 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f32300b2040 con 0x7f323c0ade90 2024-04-02T07:29:06.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.067+0000 7f3239600640 1 --2- 172.21.15.55:0/1664250860 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f321c066690 0x7f321c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:06.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.067+0000 7f3239600640 1 -- 172.21.15.55:0/1664250860 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f323011dfd0 con 0x7f323c0ade90 2024-04-02T07:29:06.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.067+0000 7f3241000640 1 --2- 172.21.15.55:0/1664250860 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f321c066690 0x7f321c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:06.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.067+0000 7f3241000640 1 --2- 172.21.15.55:0/1664250860 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f321c066690 0x7f321c068b50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f323c0b46b0 tx=0x7f3228009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:06.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.071+0000 7f3239600640 1 -- 172.21.15.55:0/1664250860 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f323c1f9160 con 0x7f323c0ade90 2024-04-02T07:29:06.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.231+0000 7f3244400640 1 -- 172.21.15.55:0/1664250860 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f323c1f9160 con 0x7f323c0ade90 2024-04-02T07:29:06.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.231+0000 7f3239600640 1 -- 172.21.15.55:0/1664250860 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f323c1f9160 con 0x7f323c0ade90 2024-04-02T07:29:06.232 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:29:06.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.231+0000 7f3244400640 1 -- 172.21.15.55:0/1664250860 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f321c066690 msgr2=0x7f321c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:06.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.231+0000 7f3244400640 1 --2- 172.21.15.55:0/1664250860 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f321c066690 0x7f321c068b50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f323c0b46b0 tx=0x7f3228009040 comp rx=0 tx=0).stop 2024-04-02T07:29:06.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.231+0000 7f3244400640 1 -- 172.21.15.55:0/1664250860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f323c0ade90 msgr2=0x7f323c15c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:06.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.231+0000 7f3244400640 1 --2- 172.21.15.55:0/1664250860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f323c0ade90 0x7f323c15c580 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f3230009740 tx=0x7f32300190e0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.231+0000 7f3244400640 1 -- 172.21.15.55:0/1664250860 shutdown_connections 2024-04-02T07:29:06.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.231+0000 7f3244400640 1 --2- 172.21.15.55:0/1664250860 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f321c066690 0x7f321c068b50 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.231+0000 7f3244400640 1 --2- 172.21.15.55:0/1664250860 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f323c0b41a0 0x7f323c141e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.231+0000 7f3244400640 1 --2- 172.21.15.55:0/1664250860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f323c0b3dc0 0x7f323c14e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.231+0000 7f3244400640 1 --2- 172.21.15.55:0/1664250860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f323c0ade90 0x7f323c15c580 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.231+0000 7f3244400640 1 -- 172.21.15.55:0/1664250860 >> 172.21.15.55:0/1664250860 conn(0x7f323c06a390 msgr2=0x7f323c1556d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:06.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.231+0000 7f3244400640 1 -- 172.21.15.55:0/1664250860 shutdown_connections 2024-04-02T07:29:06.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.231+0000 7f3244400640 1 -- 172.21.15.55:0/1664250860 wait complete. 2024-04-02T07:29:06.252 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:29:06.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.395+0000 7f0f08a00640 1 Processor -- start 2024-04-02T07:29:06.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.395+0000 7f0f08a00640 1 -- start start 2024-04-02T07:29:06.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.395+0000 7f0f08a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0f04072130 0x7f0f04069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:06.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.395+0000 7f0f08a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f0406a2d0 0x7f0f04160760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:06.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.395+0000 7f0f08a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f0415de90 con 0x7f0f04157000 2024-04-02T07:29:06.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.395+0000 7f0f08a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0415d070 con 0x7f0f04072130 2024-04-02T07:29:06.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.395+0000 7f0f08a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0406a740 con 0x7f0f0406a2d0 2024-04-02T07:29:06.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.395+0000 7f0ef9400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0f04072130 0x7f0f04069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:06.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.395+0000 7f0ef9400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0f04072130 0x7f0f04069d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41012/0 (socket says 172.21.15.55:41012) 2024-04-02T07:29:06.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.395+0000 7f0ef9400640 1 -- 172.21.15.55:0/2359794732 learned_addr learned my addr 172.21.15.55:0/2359794732 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:06.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.395+0000 7f0f02800640 1 --2- 172.21.15.55:0/2359794732 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f0406a2d0 0x7f0f04160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:06.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.395+0000 7f0ef9400640 1 -- 172.21.15.55:0/2359794732 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f0406a2d0 msgr2=0x7f0f04160760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:06.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.395+0000 7f0ef9400640 1 --2- 172.21.15.55:0/2359794732 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f0406a2d0 0x7f0f04160760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.395+0000 7f0ef9400640 1 -- 172.21.15.55:0/2359794732 >> v1:172.21.15.106:6789/0 conn(0x7f0f04157000 legacy=0x7f0f04071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:06.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.395+0000 7f0ef9400640 1 -- 172.21.15.55:0/2359794732 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0415d280 con 0x7f0f04072130 2024-04-02T07:29:06.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.399+0000 7f0ef9400640 1 --2- 172.21.15.55:0/2359794732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f04072130 0x7f0f04069d90 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009870 tx=0x7f0eec01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb27c20071c722cf server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:06.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.399+0000 7f0f01400640 1 -- 172.21.15.55:0/2359794732 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec0a95f0 con 0x7f0f04072130 2024-04-02T07:29:06.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.399+0000 7f0f01400640 1 -- 172.21.15.55:0/2359794732 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eec0a9750 con 0x7f0f04072130 2024-04-02T07:29:06.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.399+0000 7f0f01400640 1 -- 172.21.15.55:0/2359794732 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec0a9ae0 con 0x7f0f04072130 2024-04-02T07:29:06.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.399+0000 7f0f08a00640 1 -- 172.21.15.55:0/2359794732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f04072130 msgr2=0x7f0f04069d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:06.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.399+0000 7f0f08a00640 1 --2- 172.21.15.55:0/2359794732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f04072130 0x7f0f04069d90 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f0eec009870 tx=0x7f0eec01c530 comp rx=0 tx=0).stop 2024-04-02T07:29:06.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.399+0000 7f0f08a00640 1 -- 172.21.15.55:0/2359794732 shutdown_connections 2024-04-02T07:29:06.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.399+0000 7f0f08a00640 1 --2- 172.21.15.55:0/2359794732 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f0406a2d0 0x7f0f04160760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.399+0000 7f0f08a00640 1 --2- 172.21.15.55:0/2359794732 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f04072130 0x7f0f04069d90 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.399+0000 7f0f08a00640 1 -- 172.21.15.55:0/2359794732 >> 172.21.15.55:0/2359794732 conn(0x7f0f040b13b0 msgr2=0x7f0f040b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:06.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.399+0000 7f0f08a00640 1 -- 172.21.15.55:0/2359794732 shutdown_connections 2024-04-02T07:29:06.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.399+0000 7f0f08a00640 1 -- 172.21.15.55:0/2359794732 wait complete. 2024-04-02T07:29:06.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0f08a00640 1 Processor -- start 2024-04-02T07:29:06.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0f08a00640 1 -- start start 2024-04-02T07:29:06.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0f08a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f0406a2d0 0x7f0f0414cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:06.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0f08a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f04072130 0x7f0f0414a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:06.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0f08a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f04157000 0x7f0f040cf300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:06.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0f08a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040cb840 con 0x7f0f04072130 2024-04-02T07:29:06.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0f08a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040ce590 con 0x7f0f0406a2d0 2024-04-02T07:29:06.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0f08a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f040c8b60 con 0x7f0f04157000 2024-04-02T07:29:06.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0ef9400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f04072130 0x7f0f0414a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:06.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0ef9400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f04072130 0x7f0f0414a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41016/0 (socket says 172.21.15.55:41016) 2024-04-02T07:29:06.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0ef9400640 1 -- 172.21.15.55:0/3264574834 learned_addr learned my addr 172.21.15.55:0/3264574834 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:06.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0f01e00640 1 --2- 172.21.15.55:0/3264574834 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f0406a2d0 0x7f0f0414cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:06.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0f02800640 1 --2- 172.21.15.55:0/3264574834 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f04157000 0x7f0f040cf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:06.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0ef9400640 1 -- 172.21.15.55:0/3264574834 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f04157000 msgr2=0x7f0f040cf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:06.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0ef9400640 1 --2- 172.21.15.55:0/3264574834 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f04157000 0x7f0f040cf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0ef9400640 1 -- 172.21.15.55:0/3264574834 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f0406a2d0 msgr2=0x7f0f0414cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:06.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0ef9400640 1 --2- 172.21.15.55:0/3264574834 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f0406a2d0 0x7f0f0414cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0ef9400640 1 -- 172.21.15.55:0/3264574834 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec0094d0 con 0x7f0f04072130 2024-04-02T07:29:06.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0ef9400640 1 --2- 172.21.15.55:0/3264574834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f04072130 0x7f0f0414a260 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0ab040 tx=0x7f0eec01ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:06.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0efaa00640 1 -- 172.21.15.55:0/3264574834 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec0a95f0 con 0x7f0f04072130 2024-04-02T07:29:06.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0efaa00640 1 -- 172.21.15.55:0/3264574834 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eec0b1820 con 0x7f0f04072130 2024-04-02T07:29:06.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0efaa00640 1 -- 172.21.15.55:0/3264574834 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eec0b1bd0 con 0x7f0f04072130 2024-04-02T07:29:06.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0f08a00640 1 -- 172.21.15.55:0/3264574834 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f040c8e40 con 0x7f0f04072130 2024-04-02T07:29:06.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.403+0000 7f0f08a00640 1 -- 172.21.15.55:0/3264574834 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f040c9400 con 0x7f0f04072130 2024-04-02T07:29:06.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.407+0000 7f0f08a00640 1 -- 172.21.15.55:0/3264574834 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f040c95f0 con 0x7f0f04072130 2024-04-02T07:29:06.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.407+0000 7f0efaa00640 1 -- 172.21.15.55:0/3264574834 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f0eec0b1d30 con 0x7f0f04072130 2024-04-02T07:29:06.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.407+0000 7f0efaa00640 1 --2- 172.21.15.55:0/3264574834 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ee0066690 0x7f0ee0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:06.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.407+0000 7f0efaa00640 1 -- 172.21.15.55:0/3264574834 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f0eec11eda0 con 0x7f0f04072130 2024-04-02T07:29:06.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.407+0000 7f0f01e00640 1 --2- 172.21.15.55:0/3264574834 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ee0066690 0x7f0ee0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:06.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.407+0000 7f0f01e00640 1 --2- 172.21.15.55:0/3264574834 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ee0066690 0x7f0ee0068b50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0f040cfec0 tx=0x7f0ef4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:06.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.411+0000 7f0efaa00640 1 -- 172.21.15.55:0/3264574834 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0eec0ec190 con 0x7f0f04072130 2024-04-02T07:29:06.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.571+0000 7f0f08a00640 1 -- 172.21.15.55:0/3264574834 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f040c8ca0 con 0x7f0f04072130 2024-04-02T07:29:06.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.571+0000 7f0efaa00640 1 -- 172.21.15.55:0/3264574834 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f040c8ca0 con 0x7f0f04072130 2024-04-02T07:29:06.572 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:29:06.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.571+0000 7f0f08a00640 1 -- 172.21.15.55:0/3264574834 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ee0066690 msgr2=0x7f0ee0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:06.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.571+0000 7f0f08a00640 1 --2- 172.21.15.55:0/3264574834 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ee0066690 0x7f0ee0068b50 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f0f040cfec0 tx=0x7f0ef4009040 comp rx=0 tx=0).stop 2024-04-02T07:29:06.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.571+0000 7f0f08a00640 1 -- 172.21.15.55:0/3264574834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f04072130 msgr2=0x7f0f0414a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:06.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.571+0000 7f0f08a00640 1 --2- 172.21.15.55:0/3264574834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f04072130 0x7f0f0414a260 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0ab040 tx=0x7f0eec01ad70 comp rx=0 tx=0).stop 2024-04-02T07:29:06.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.571+0000 7f0f08a00640 1 -- 172.21.15.55:0/3264574834 shutdown_connections 2024-04-02T07:29:06.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.571+0000 7f0f08a00640 1 --2- 172.21.15.55:0/3264574834 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f04157000 0x7f0f040cf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.571+0000 7f0f08a00640 1 --2- 172.21.15.55:0/3264574834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f04072130 0x7f0f0414a260 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.571+0000 7f0f08a00640 1 --2- 172.21.15.55:0/3264574834 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ee0066690 0x7f0ee0068b50 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.571+0000 7f0f08a00640 1 --2- 172.21.15.55:0/3264574834 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f0406a2d0 0x7f0f0414cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.571+0000 7f0f08a00640 1 -- 172.21.15.55:0/3264574834 >> 172.21.15.55:0/3264574834 conn(0x7f0f040b13b0 msgr2=0x7f0f040cea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:06.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.575+0000 7f0f08a00640 1 -- 172.21.15.55:0/3264574834 shutdown_connections 2024-04-02T07:29:06.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.575+0000 7f0f08a00640 1 -- 172.21.15.55:0/3264574834 wait complete. 2024-04-02T07:29:06.593 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:29:06.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.735+0000 7fe917e00640 1 Processor -- start 2024-04-02T07:29:06.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.735+0000 7fe917e00640 1 -- start start 2024-04-02T07:29:06.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.735+0000 7fe917e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe9181600e0 0x7fe91806b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:06.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.735+0000 7fe917e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9180ce6f0 0x7fe918098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:06.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.735+0000 7fe917e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe918098f50 0x7fe918160630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:06.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.735+0000 7fe917e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9180993e0 con 0x7fe918098f50 2024-04-02T07:29:06.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.735+0000 7fe917e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe918099a80 con 0x7fe9181600e0 2024-04-02T07:29:06.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.735+0000 7fe917e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe91806b5f0 con 0x7fe9180ce6f0 2024-04-02T07:29:06.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.735+0000 7fe917400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe918098f50 0x7fe918160630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:06.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.735+0000 7fe917400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe918098f50 0x7fe918160630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41030/0 (socket says 172.21.15.55:41030) 2024-04-02T07:29:06.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.735+0000 7fe917400640 1 -- 172.21.15.55:0/1265368437 learned_addr learned my addr 172.21.15.55:0/1265368437 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:06.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.735+0000 7fe916000640 1 --2- 172.21.15.55:0/1265368437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9180ce6f0 0x7fe918098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:06.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.735+0000 7fe917400640 1 -- 172.21.15.55:0/1265368437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9180ce6f0 msgr2=0x7fe918098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:06.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.735+0000 7fe916a00640 1 --2- 172.21.15.55:0/1265368437 >> v2:172.21.15.106:3300/0 conn(0x7fe9181600e0 0x7fe91806b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:06.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.735+0000 7fe917400640 1 --2- 172.21.15.55:0/1265368437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9180ce6f0 0x7fe918098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.735+0000 7fe917400640 1 -- 172.21.15.55:0/1265368437 >> v2:172.21.15.106:3300/0 conn(0x7fe9181600e0 msgr2=0x7fe91806b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:06.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.735+0000 7fe917400640 1 --2- 172.21.15.55:0/1265368437 >> v2:172.21.15.106:3300/0 conn(0x7fe9181600e0 0x7fe91806b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.735+0000 7fe917400640 1 -- 172.21.15.55:0/1265368437 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9180cec80 con 0x7fe918098f50 2024-04-02T07:29:06.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.735+0000 7fe916000640 1 --2- 172.21.15.55:0/1265368437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9180ce6f0 0x7fe918098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:29:06.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.735+0000 7fe916a00640 1 --2- 172.21.15.55:0/1265368437 >> v2:172.21.15.106:3300/0 conn(0x7fe9181600e0 0x7fe91806b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:29:06.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.739+0000 7fe917400640 1 --2- 172.21.15.55:0/1265368437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe918098f50 0x7fe918160630 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fe91806ad70 tx=0x7fe91001f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21e0e8d56228f29e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:06.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.739+0000 7fe915600640 1 -- 172.21.15.55:0/1265368437 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9100af400 con 0x7fe918098f50 2024-04-02T07:29:06.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.739+0000 7fe915600640 1 -- 172.21.15.55:0/1265368437 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9100ab050 con 0x7fe918098f50 2024-04-02T07:29:06.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.739+0000 7fe915600640 1 -- 172.21.15.55:0/1265368437 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9100af780 con 0x7fe918098f50 2024-04-02T07:29:06.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.739+0000 7fe917e00640 1 -- 172.21.15.55:0/1265368437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe918098f50 msgr2=0x7fe918160630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:06.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.739+0000 7fe917e00640 1 --2- 172.21.15.55:0/1265368437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe918098f50 0x7fe918160630 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7fe91806ad70 tx=0x7fe91001f1e0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.739+0000 7fe917e00640 1 -- 172.21.15.55:0/1265368437 shutdown_connections 2024-04-02T07:29:06.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.739+0000 7fe917e00640 1 --2- 172.21.15.55:0/1265368437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe918098f50 0x7fe918160630 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.739+0000 7fe917e00640 1 --2- 172.21.15.55:0/1265368437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9180ce6f0 0x7fe918098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.739+0000 7fe917e00640 1 --2- 172.21.15.55:0/1265368437 >> v2:172.21.15.106:3300/0 conn(0x7fe9181600e0 0x7fe91806b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.739+0000 7fe917e00640 1 -- 172.21.15.55:0/1265368437 >> 172.21.15.55:0/1265368437 conn(0x7fe9180b1fa0 msgr2=0x7fe9180b23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:06.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.739+0000 7fe917e00640 1 -- 172.21.15.55:0/1265368437 shutdown_connections 2024-04-02T07:29:06.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.739+0000 7fe917e00640 1 -- 172.21.15.55:0/1265368437 wait complete. 2024-04-02T07:29:06.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.739+0000 7fe917e00640 1 Processor -- start 2024-04-02T07:29:06.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.739+0000 7fe917e00640 1 -- start start 2024-04-02T07:29:06.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe917e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe918098f50 0x7fe91809b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:06.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe917e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9180ce6f0 0x7fe91809d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:06.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe917e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9181600e0 0x7fe918150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:06.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe917e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe91809dc90 con 0x7fe9180ce6f0 2024-04-02T07:29:06.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe917e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9180af9e0 con 0x7fe918098f50 2024-04-02T07:29:06.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe917e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe918150ff0 con 0x7fe9181600e0 2024-04-02T07:29:06.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe916000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9180ce6f0 0x7fe91809d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:06.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe916000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9180ce6f0 0x7fe91809d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41038/0 (socket says 172.21.15.55:41038) 2024-04-02T07:29:06.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe916000640 1 -- 172.21.15.55:0/2578549701 learned_addr learned my addr 172.21.15.55:0/2578549701 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:06.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe917400640 1 --2- 172.21.15.55:0/2578549701 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9181600e0 0x7fe918150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:06.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe916000640 1 -- 172.21.15.55:0/2578549701 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9181600e0 msgr2=0x7fe918150ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe916a00640 1 --2- 172.21.15.55:0/2578549701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe918098f50 0x7fe91809b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe916000640 1 --2- 172.21.15.55:0/2578549701 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9181600e0 0x7fe918150ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe916000640 1 -- 172.21.15.55:0/2578549701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe918098f50 msgr2=0x7fe91809b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe916000640 1 --2- 172.21.15.55:0/2578549701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe918098f50 0x7fe91809b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe916000640 1 -- 172.21.15.55:0/2578549701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe910009b30 con 0x7fe9180ce6f0 2024-04-02T07:29:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe917400640 1 --2- 172.21.15.55:0/2578549701 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9181600e0 0x7fe918150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:29:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe916a00640 1 --2- 172.21.15.55:0/2578549701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe918098f50 0x7fe91809b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:29:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe916000640 1 --2- 172.21.15.55:0/2578549701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9180ce6f0 0x7fe91809d750 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fe90400c7c0 tx=0x7fe90400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe90ea00640 1 -- 172.21.15.55:0/2578549701 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe904007a30 con 0x7fe9180ce6f0 2024-04-02T07:29:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe90ea00640 1 -- 172.21.15.55:0/2578549701 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe904007b90 con 0x7fe9180ce6f0 2024-04-02T07:29:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe90ea00640 1 -- 172.21.15.55:0/2578549701 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe90400ce70 con 0x7fe9180ce6f0 2024-04-02T07:29:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe917e00640 1 -- 172.21.15.55:0/2578549701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe91809dec0 con 0x7fe9180ce6f0 2024-04-02T07:29:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe917e00640 1 -- 172.21.15.55:0/2578549701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9180af390 con 0x7fe9180ce6f0 2024-04-02T07:29:06.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.743+0000 7fe917e00640 1 -- 172.21.15.55:0/2578549701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe918073fa0 con 0x7fe9180ce6f0 2024-04-02T07:29:06.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.747+0000 7fe90ea00640 1 -- 172.21.15.55:0/2578549701 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe9040113f0 con 0x7fe9180ce6f0 2024-04-02T07:29:06.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.747+0000 7fe90ea00640 1 --2- 172.21.15.55:0/2578549701 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe8f8066690 0x7fe8f8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:06.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.747+0000 7fe90ea00640 1 -- 172.21.15.55:0/2578549701 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe9040846f0 con 0x7fe9180ce6f0 2024-04-02T07:29:06.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.747+0000 7fe916a00640 1 --2- 172.21.15.55:0/2578549701 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe8f8066690 0x7fe8f8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:06.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.747+0000 7fe916a00640 1 --2- 172.21.15.55:0/2578549701 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe8f8066690 0x7fe8f8068b50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe90800b840 tx=0x7fe908008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:06.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.751+0000 7fe90ea00640 1 -- 172.21.15.55:0/2578549701 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe9040519a0 con 0x7fe9180ce6f0 2024-04-02T07:29:06.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.923+0000 7fe917e00640 1 -- 172.21.15.55:0/2578549701 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe9180cfa40 con 0x7fe9180ce6f0 2024-04-02T07:29:06.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.923+0000 7fe90ea00640 1 -- 172.21.15.55:0/2578549701 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v89) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe904054fc0 con 0x7fe9180ce6f0 2024-04-02T07:29:06.923 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:29:06.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.923+0000 7fe917e00640 1 -- 172.21.15.55:0/2578549701 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe8f8066690 msgr2=0x7fe8f8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:06.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.923+0000 7fe917e00640 1 --2- 172.21.15.55:0/2578549701 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe8f8066690 0x7fe8f8068b50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe90800b840 tx=0x7fe908008040 comp rx=0 tx=0).stop 2024-04-02T07:29:06.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.923+0000 7fe917e00640 1 -- 172.21.15.55:0/2578549701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9180ce6f0 msgr2=0x7fe91809d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:06.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.923+0000 7fe917e00640 1 --2- 172.21.15.55:0/2578549701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9180ce6f0 0x7fe91809d750 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7fe90400c7c0 tx=0x7fe90400cc80 comp rx=0 tx=0).stop 2024-04-02T07:29:06.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.923+0000 7fe917e00640 1 -- 172.21.15.55:0/2578549701 shutdown_connections 2024-04-02T07:29:06.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.923+0000 7fe917e00640 1 --2- 172.21.15.55:0/2578549701 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe9181600e0 0x7fe918150ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.923+0000 7fe917e00640 1 --2- 172.21.15.55:0/2578549701 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe9180ce6f0 0x7fe91809d750 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.923+0000 7fe917e00640 1 --2- 172.21.15.55:0/2578549701 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe8f8066690 0x7fe8f8068b50 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.923+0000 7fe917e00640 1 --2- 172.21.15.55:0/2578549701 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe918098f50 0x7fe91809b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:06.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.923+0000 7fe917e00640 1 -- 172.21.15.55:0/2578549701 >> 172.21.15.55:0/2578549701 conn(0x7fe9180b1fa0 msgr2=0x7fe91815d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:06.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.923+0000 7fe917e00640 1 -- 172.21.15.55:0/2578549701 shutdown_connections 2024-04-02T07:29:06.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:06.923+0000 7fe917e00640 1 -- 172.21.15.55:0/2578549701 wait complete. 2024-04-02T07:29:06.944 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi055.front.sepia.ceph.com... 2024-04-02T07:29:06.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:06.944 DEBUG:teuthology.orchestra.run.smithi055:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-02T07:29:06.962 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[45967]: fuse finished with error 0 and tester_r 0 2024-04-02T07:29:06.964 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:29:13.066 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:29:13.066 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:13.067 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-02T07:29:13.078 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:29:13.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.270+0000 7f2bddc00640 1 Processor -- start 2024-04-02T07:29:13.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.274+0000 7f2bddc00640 1 -- start start 2024-04-02T07:29:13.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.274+0000 7f2bddc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2bd815ff90 0x7f2bd8098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:13.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.274+0000 7f2bddc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2bd80d0050 0x7f2bd8098f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:13.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.274+0000 7f2bddc00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bd80af460 con 0x7f2bd8099490 2024-04-02T07:29:13.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.274+0000 7f2bddc00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd80cf0f0 con 0x7f2bd815ff90 2024-04-02T07:29:13.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.274+0000 7f2bddc00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bd80af690 con 0x7f2bd80d0050 2024-04-02T07:29:13.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.274+0000 7f2bd7e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2bd815ff90 0x7f2bd8098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:13.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.274+0000 7f2bdd200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2bd8099490 0x7f2bd806aea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44100/0 (socket says 172.21.15.55:44100) 2024-04-02T07:29:13.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.274+0000 7f2bdd200640 1 -- 172.21.15.55:0/3571840271 learned_addr learned my addr 172.21.15.55:0/3571840271 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:29:13.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.274+0000 7f2bcfe00640 1 --2- 172.21.15.55:0/3571840271 >> v2:172.21.15.106:3300/0 conn(0x7f2bd80d0050 0x7f2bd8098f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:13.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.274+0000 7f2bd7e00640 1 -- 172.21.15.55:0/3571840271 >> v2:172.21.15.106:3300/0 conn(0x7f2bd80d0050 msgr2=0x7f2bd8098f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:13.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.274+0000 7f2bd7e00640 1 --2- 172.21.15.55:0/3571840271 >> v2:172.21.15.106:3300/0 conn(0x7f2bd80d0050 0x7f2bd8098f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:13.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.274+0000 7f2bd7e00640 1 -- 172.21.15.55:0/3571840271 >> v1:172.21.15.55:6789/0 conn(0x7f2bd8099490 legacy=0x7f2bd806aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:13.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.274+0000 7f2bd7e00640 1 -- 172.21.15.55:0/3571840271 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd80cf3b0 con 0x7f2bd815ff90 2024-04-02T07:29:13.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.274+0000 7f2bd7400640 1 -- 172.21.15.55:0/3571840271 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4180299051 0 0) 0x7f2bd80af460 con 0x7f2bd8099490 2024-04-02T07:29:13.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.278+0000 7f2bd7e00640 1 --2- 172.21.15.55:0/3571840271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd815ff90 0x7f2bd8098a10 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f2bd806ad70 tx=0x7f2bc801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ead0f6464e70c53b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:13.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.278+0000 7f2bd7400640 1 -- 172.21.15.55:0/3571840271 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80ac620 con 0x7f2bd815ff90 2024-04-02T07:29:13.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.278+0000 7f2bd7400640 1 -- 172.21.15.55:0/3571840271 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc80ac780 con 0x7f2bd815ff90 2024-04-02T07:29:13.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.278+0000 7f2bd7400640 1 -- 172.21.15.55:0/3571840271 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80acb10 con 0x7f2bd815ff90 2024-04-02T07:29:13.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.278+0000 7f2bddc00640 1 -- 172.21.15.55:0/3571840271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd815ff90 msgr2=0x7f2bd8098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:13.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.278+0000 7f2bddc00640 1 --2- 172.21.15.55:0/3571840271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd815ff90 0x7f2bd8098a10 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f2bd806ad70 tx=0x7f2bc801c3c0 comp rx=0 tx=0).stop 2024-04-02T07:29:13.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.278+0000 7f2bddc00640 1 -- 172.21.15.55:0/3571840271 shutdown_connections 2024-04-02T07:29:13.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.278+0000 7f2bddc00640 1 --2- 172.21.15.55:0/3571840271 >> v2:172.21.15.106:3300/0 conn(0x7f2bd80d0050 0x7f2bd8098f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:13.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.278+0000 7f2bddc00640 1 --2- 172.21.15.55:0/3571840271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd815ff90 0x7f2bd8098a10 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:13.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.278+0000 7f2bddc00640 1 -- 172.21.15.55:0/3571840271 >> 172.21.15.55:0/3571840271 conn(0x7f2bd80b1fb0 msgr2=0x7f2bd80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:13.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.278+0000 7f2bddc00640 1 -- 172.21.15.55:0/3571840271 shutdown_connections 2024-04-02T07:29:13.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.278+0000 7f2bddc00640 1 -- 172.21.15.55:0/3571840271 wait complete. 2024-04-02T07:29:13.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.278+0000 7f2bddc00640 1 Processor -- start 2024-04-02T07:29:13.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.278+0000 7f2bddc00640 1 -- start start 2024-04-02T07:29:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bddc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd8099490 0x7f2bd81427d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bddc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2bd80d0050 0x7f2bd8142d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bddc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bd815ff90 0x7f2bd81545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bddc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd815a030 con 0x7f2bd8099490 2024-04-02T07:29:13.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bddc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd80b34f0 con 0x7f2bd815ff90 2024-04-02T07:29:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bddc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bd8159970 con 0x7f2bd80d0050 2024-04-02T07:29:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bd7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd8099490 0x7f2bd81427d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bd7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd8099490 0x7f2bd81427d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41052/0 (socket says 172.21.15.55:41052) 2024-04-02T07:29:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bd7e00640 1 -- 172.21.15.55:0/1092881367 learned_addr learned my addr 172.21.15.55:0/1092881367 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bcfe00640 1 --2- 172.21.15.55:0/1092881367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2bd80d0050 0x7f2bd8142d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bdd200640 1 --2- 172.21.15.55:0/1092881367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bd815ff90 0x7f2bd81545f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bd7e00640 1 -- 172.21.15.55:0/1092881367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2bd80d0050 msgr2=0x7f2bd8142d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bd7e00640 1 --2- 172.21.15.55:0/1092881367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2bd80d0050 0x7f2bd8142d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bd7e00640 1 -- 172.21.15.55:0/1092881367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bd815ff90 msgr2=0x7f2bd81545f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bd7e00640 1 --2- 172.21.15.55:0/1092881367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bd815ff90 0x7f2bd81545f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bd7e00640 1 -- 172.21.15.55:0/1092881367 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc8009420 con 0x7f2bd8099490 2024-04-02T07:29:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bdd200640 1 --2- 172.21.15.55:0/1092881367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bd815ff90 0x7f2bd81545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:29:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bd7e00640 1 --2- 172.21.15.55:0/1092881367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd8099490 0x7f2bd81427d0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8018fd0 tx=0x7f2bc8019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bd4c00640 1 -- 172.21.15.55:0/1092881367 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80ac620 con 0x7f2bd8099490 2024-04-02T07:29:13.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bd4c00640 1 -- 172.21.15.55:0/1092881367 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bc8004030 con 0x7f2bd8099490 2024-04-02T07:29:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bddc00640 1 -- 172.21.15.55:0/1092881367 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bd8159c50 con 0x7f2bd8099490 2024-04-02T07:29:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bd4c00640 1 -- 172.21.15.55:0/1092881367 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bc80043a0 con 0x7f2bd8099490 2024-04-02T07:29:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bddc00640 1 -- 172.21.15.55:0/1092881367 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bd80b37d0 con 0x7f2bd8099490 2024-04-02T07:29:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bddc00640 1 -- 172.21.15.55:0/1092881367 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bd8073fa0 con 0x7f2bd8099490 2024-04-02T07:29:13.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.282+0000 7f2bd4c00640 1 -- 172.21.15.55:0/1092881367 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2bc80b3040 con 0x7f2bd8099490 2024-04-02T07:29:13.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.286+0000 7f2bd4c00640 1 --2- 172.21.15.55:0/1092881367 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2bb4066690 0x7f2bb4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:13.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.286+0000 7f2bd4c00640 1 -- 172.21.15.55:0/1092881367 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f2bc811d940 con 0x7f2bd8099490 2024-04-02T07:29:13.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.286+0000 7f2bcfe00640 1 --2- 172.21.15.55:0/1092881367 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2bb4066690 0x7f2bb4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:13.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.286+0000 7f2bcfe00640 1 --2- 172.21.15.55:0/1092881367 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2bb4066690 0x7f2bb4068b50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2bd806e180 tx=0x7f2bc0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:13.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.290+0000 7f2bd4c00640 1 -- 172.21.15.55:0/1092881367 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2bc80eab60 con 0x7f2bd8099490 2024-04-02T07:29:13.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.486+0000 7f2bddc00640 1 -- 172.21.15.55:0/1092881367 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2bd806e7e0 con 0x7f2bd8099490 2024-04-02T07:29:13.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.486+0000 7f2bd4c00640 1 -- 172.21.15.55:0/1092881367 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) v1 ==== 94+0+4739 (secure 0 0 0) 0x7f2bc80bd090 con 0x7f2bd8099490 2024-04-02T07:29:13.488 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:29:13.488 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":60,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2209852195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2209852195},{"type":"v1","addr":"172.21.15.55:6835","nonce":2209852195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1897181831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1897181831},{"type":"v1","addr":"172.21.15.106:6835","nonce":1897181831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":7455,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/821922065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":821922065},{"type":"v1","addr":"172.21.15.55:6834","nonce":821922065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:28:53.919977+0000","modified":"2024-04-02T07:28:56.946080+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7464},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7464":{"gid":7464,"name":"b","rank":0,"incarnation":56,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6837/2582023800","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":2582023800},{"type":"v1","addr":"172.21.15.106:6837","nonce":2582023800}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-02T07:29:13.491 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 60 2024-04-02T07:29:13.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.486+0000 7f2bddc00640 1 -- 172.21.15.55:0/1092881367 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2bb4066690 msgr2=0x7f2bb4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:13.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.486+0000 7f2bddc00640 1 --2- 172.21.15.55:0/1092881367 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2bb4066690 0x7f2bb4068b50 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2bd806e180 tx=0x7f2bc0008040 comp rx=0 tx=0).stop 2024-04-02T07:29:13.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.486+0000 7f2bddc00640 1 -- 172.21.15.55:0/1092881367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd8099490 msgr2=0x7f2bd81427d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:13.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.486+0000 7f2bddc00640 1 --2- 172.21.15.55:0/1092881367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd8099490 0x7f2bd81427d0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f2bc8018fd0 tx=0x7f2bc8019160 comp rx=0 tx=0).stop 2024-04-02T07:29:13.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.486+0000 7f2bddc00640 1 -- 172.21.15.55:0/1092881367 shutdown_connections 2024-04-02T07:29:13.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.486+0000 7f2bddc00640 1 --2- 172.21.15.55:0/1092881367 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2bb4066690 0x7f2bb4068b50 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:13.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.486+0000 7f2bddc00640 1 --2- 172.21.15.55:0/1092881367 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2bd815ff90 0x7f2bd81545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:13.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.486+0000 7f2bddc00640 1 --2- 172.21.15.55:0/1092881367 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2bd80d0050 0x7f2bd8142d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:13.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.486+0000 7f2bddc00640 1 --2- 172.21.15.55:0/1092881367 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2bd8099490 0x7f2bd81427d0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:13.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.486+0000 7f2bddc00640 1 -- 172.21.15.55:0/1092881367 >> 172.21.15.55:0/1092881367 conn(0x7f2bd80b1fb0 msgr2=0x7f2bd80ae6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:13.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.486+0000 7f2bddc00640 1 -- 172.21.15.55:0/1092881367 shutdown_connections 2024-04-02T07:29:13.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.486+0000 7f2bddc00640 1 -- 172.21.15.55:0/1092881367 wait complete. 2024-04-02T07:29:13.510 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json flush journal 2024-04-02T07:29:13.684 INFO:teuthology.orchestra.run.smithi106.stdout:{"message":"","return_code":0} 2024-04-02T07:29:13.685 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-02T07:29:13.685 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-02T07:29:13.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.826+0000 7f04bde00640 1 Processor -- start 2024-04-02T07:29:13.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.826+0000 7f04bde00640 1 -- start start 2024-04-02T07:29:13.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.826+0000 7f04bde00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04b806ccc0 0x7f04b806c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:13.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.826+0000 7f04bde00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f04b806d0a0 0x7f04b806d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:13.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.826+0000 7f04bde00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b815d5d0 con 0x7f04b806dd60 2024-04-02T07:29:13.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.826+0000 7f04bde00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b815d8b0 con 0x7f04b806d0a0 2024-04-02T07:29:13.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.826+0000 7f04bde00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b815db90 con 0x7f04b806ccc0 2024-04-02T07:29:13.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.826+0000 7f04b6000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f04b806d0a0 0x7f04b806d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:13.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.826+0000 7f04b6000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f04b806d0a0 0x7f04b806d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41066/0 (socket says 172.21.15.55:41066) 2024-04-02T07:29:13.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.826+0000 7f04b6000640 1 -- 172.21.15.55:0/764977716 learned_addr learned my addr 172.21.15.55:0/764977716 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:13.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.826+0000 7f04b6a00640 1 --2- 172.21.15.55:0/764977716 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04b806ccc0 0x7f04b806c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:13.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.826+0000 7f04b6000640 1 -- 172.21.15.55:0/764977716 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04b806ccc0 msgr2=0x7f04b806c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:13.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.826+0000 7f04b6000640 1 --2- 172.21.15.55:0/764977716 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04b806ccc0 0x7f04b806c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:13.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.826+0000 7f04b6000640 1 -- 172.21.15.55:0/764977716 >> v1:172.21.15.106:6789/0 conn(0x7f04b806dd60 legacy=0x7f04b80cb160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:13.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.826+0000 7f04b6000640 1 -- 172.21.15.55:0/764977716 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b815de70 con 0x7f04b806d0a0 2024-04-02T07:29:13.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.826+0000 7f04b6a00640 1 --2- 172.21.15.55:0/764977716 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04b806ccc0 0x7f04b806c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:29:13.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.830+0000 7f04b6000640 1 --2- 172.21.15.55:0/764977716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b806d0a0 0x7f04b806d820 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009870 tx=0x7f04a401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58193875df301513 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:13.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.830+0000 7f04b5600640 1 -- 172.21.15.55:0/764977716 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a40ad660 con 0x7f04b806d0a0 2024-04-02T07:29:13.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.830+0000 7f04b5600640 1 -- 172.21.15.55:0/764977716 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a40ad7c0 con 0x7f04b806d0a0 2024-04-02T07:29:13.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.830+0000 7f04b5600640 1 -- 172.21.15.55:0/764977716 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a40adb50 con 0x7f04b806d0a0 2024-04-02T07:29:13.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.830+0000 7f04bde00640 1 -- 172.21.15.55:0/764977716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b806d0a0 msgr2=0x7f04b806d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:13.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.830+0000 7f04bde00640 1 --2- 172.21.15.55:0/764977716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b806d0a0 0x7f04b806d820 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f04a4009870 tx=0x7f04a401c520 comp rx=0 tx=0).stop 2024-04-02T07:29:13.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.830+0000 7f04bde00640 1 -- 172.21.15.55:0/764977716 shutdown_connections 2024-04-02T07:29:13.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.830+0000 7f04bde00640 1 --2- 172.21.15.55:0/764977716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b806d0a0 0x7f04b806d820 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:13.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.830+0000 7f04bde00640 1 --2- 172.21.15.55:0/764977716 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04b806ccc0 0x7f04b806c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:13.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.830+0000 7f04bde00640 1 -- 172.21.15.55:0/764977716 >> 172.21.15.55:0/764977716 conn(0x7f04b8069d90 msgr2=0x7f04b806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:13.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.830+0000 7f04bde00640 1 -- 172.21.15.55:0/764977716 shutdown_connections 2024-04-02T07:29:13.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.830+0000 7f04bde00640 1 -- 172.21.15.55:0/764977716 wait complete. 2024-04-02T07:29:13.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.830+0000 7f04bde00640 1 Processor -- start 2024-04-02T07:29:13.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.830+0000 7f04bde00640 1 -- start start 2024-04-02T07:29:13.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04bde00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04b806ccc0 0x7f04b81579e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:13.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04bde00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04b806dd60 0x7f04b8154910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:13.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04bde00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b8154e50 0x7f04b81527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:13.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04bde00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b8158830 con 0x7f04b8154e50 2024-04-02T07:29:13.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04bde00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b8153cb0 con 0x7f04b806ccc0 2024-04-02T07:29:13.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04bde00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b81552b0 con 0x7f04b806dd60 2024-04-02T07:29:13.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04b7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b8154e50 0x7f04b81527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:13.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04b6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04b806ccc0 0x7f04b81579e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:13.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04b7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b8154e50 0x7f04b81527f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41080/0 (socket says 172.21.15.55:41080) 2024-04-02T07:29:13.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04b7400640 1 -- 172.21.15.55:0/1093534913 learned_addr learned my addr 172.21.15.55:0/1093534913 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:13.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04b6000640 1 --2- 172.21.15.55:0/1093534913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04b806dd60 0x7f04b8154910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:13.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04b7400640 1 -- 172.21.15.55:0/1093534913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04b806dd60 msgr2=0x7f04b8154910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:13.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04b7400640 1 --2- 172.21.15.55:0/1093534913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04b806dd60 0x7f04b8154910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:13.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04b7400640 1 -- 172.21.15.55:0/1093534913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04b806ccc0 msgr2=0x7f04b81579e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:13.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04b7400640 1 --2- 172.21.15.55:0/1093534913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04b806ccc0 0x7f04b81579e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:13.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04b7400640 1 -- 172.21.15.55:0/1093534913 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a40094d0 con 0x7f04b8154e50 2024-04-02T07:29:13.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04b7400640 1 --2- 172.21.15.55:0/1093534913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b8154e50 0x7f04b81527f0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f04b000b970 tx=0x7f04b000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:13.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04af400640 1 -- 172.21.15.55:0/1093534913 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b000cb40 con 0x7f04b8154e50 2024-04-02T07:29:13.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04af400640 1 -- 172.21.15.55:0/1093534913 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b000cca0 con 0x7f04b8154e50 2024-04-02T07:29:13.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04af400640 1 -- 172.21.15.55:0/1093534913 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b0014680 con 0x7f04b8154e50 2024-04-02T07:29:13.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04bde00640 1 -- 172.21.15.55:0/1093534913 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b8157320 con 0x7f04b8154e50 2024-04-02T07:29:13.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04bde00640 1 -- 172.21.15.55:0/1093534913 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b8157040 con 0x7f04b8154e50 2024-04-02T07:29:13.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.834+0000 7f04bde00640 1 -- 172.21.15.55:0/1093534913 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b8066c90 con 0x7f04b8154e50 2024-04-02T07:29:13.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.838+0000 7f04af400640 1 -- 172.21.15.55:0/1093534913 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f04b001d3b0 con 0x7f04b8154e50 2024-04-02T07:29:13.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.838+0000 7f04af400640 1 --2- 172.21.15.55:0/1093534913 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0498066690 0x7f0498068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:13.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.838+0000 7f04af400640 1 -- 172.21.15.55:0/1093534913 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f04b0083f50 con 0x7f04b8154e50 2024-04-02T07:29:13.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.838+0000 7f04b6a00640 1 --2- 172.21.15.55:0/1093534913 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0498066690 0x7f0498068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:13.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.838+0000 7f04b6a00640 1 --2- 172.21.15.55:0/1093534913 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0498066690 0x7f0498068b50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f04b80cd6f0 tx=0x7f04a8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:13.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:13.842+0000 7f04af400640 1 -- 172.21.15.55:0/1093534913 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f04b0051340 con 0x7f04b8154e50 2024-04-02T07:29:14.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.034+0000 7f04bde00640 1 -- 172.21.15.55:0/1093534913 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f04b8073a10 con 0x7f04b8154e50 2024-04-02T07:29:14.039 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-02T07:29:14.038+0000 7f8f18800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-02T07:29:14.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.046+0000 7f04af400640 1 -- 172.21.15.55:0/1093534913 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v61) v1 ==== 161+0+0 (secure 0 0 0) 0x7f04b0054960 con 0x7f04b8154e50 2024-04-02T07:29:14.048 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-02T07:29:14.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.046+0000 7f04bde00640 1 -- 172.21.15.55:0/1093534913 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0498066690 msgr2=0x7f0498068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.046+0000 7f04bde00640 1 --2- 172.21.15.55:0/1093534913 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0498066690 0x7f0498068b50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f04b80cd6f0 tx=0x7f04a8008040 comp rx=0 tx=0).stop 2024-04-02T07:29:14.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.046+0000 7f04bde00640 1 -- 172.21.15.55:0/1093534913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b8154e50 msgr2=0x7f04b81527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.046+0000 7f04bde00640 1 --2- 172.21.15.55:0/1093534913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b8154e50 0x7f04b81527f0 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f04b000b970 tx=0x7f04b000be30 comp rx=0 tx=0).stop 2024-04-02T07:29:14.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.046+0000 7f04bde00640 1 -- 172.21.15.55:0/1093534913 shutdown_connections 2024-04-02T07:29:14.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.046+0000 7f04bde00640 1 --2- 172.21.15.55:0/1093534913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f04b8154e50 0x7f04b81527f0 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.046+0000 7f04bde00640 1 --2- 172.21.15.55:0/1093534913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f04b806dd60 0x7f04b8154910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.046+0000 7f04bde00640 1 --2- 172.21.15.55:0/1093534913 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0498066690 0x7f0498068b50 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.046+0000 7f04bde00640 1 --2- 172.21.15.55:0/1093534913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f04b806ccc0 0x7f04b81579e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.046+0000 7f04bde00640 1 -- 172.21.15.55:0/1093534913 >> 172.21.15.55:0/1093534913 conn(0x7f04b8069d90 msgr2=0x7f04b80ca7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:14.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.046+0000 7f04bde00640 1 -- 172.21.15.55:0/1093534913 shutdown_connections 2024-04-02T07:29:14.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.046+0000 7f04bde00640 1 -- 172.21.15.55:0/1093534913 wait complete. 2024-04-02T07:29:14.056 INFO:tasks.ceph.mds.b.smithi106.stderr: -3985> 2024-04-02T07:28:55.449+0000 7f8466400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:29:14.072 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rm 10000000000.00000000 2024-04-02T07:29:14.103 INFO:tasks.ceph.mds.b.smithi106.stdout:starting mds.b at 2024-04-02T07:29:14.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.118+0000 7f781ef31080 1 Processor -- start 2024-04-02T07:29:14.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.118+0000 7f781ef31080 1 -- start start 2024-04-02T07:29:14.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.118+0000 7f781ef31080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a24b4d67e0 0x55a24b561140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.118+0000 7f781ef31080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a24b4d77a0 0x55a24b5f8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.118+0000 7f781ef31080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a24b563a20 0x55a24b5f8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.118+0000 7f781ef31080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a24b3d3960 con 0x55a24b563a20 2024-04-02T07:29:14.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.118+0000 7f781ef31080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a24b3d3600 con 0x55a24b4d77a0 2024-04-02T07:29:14.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.118+0000 7f781ef31080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a24b3ca690 con 0x55a24b4d67e0 2024-04-02T07:29:14.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.118+0000 7f781cc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a24b563a20 0x55a24b5f8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.118+0000 7f781cc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a24b563a20 0x55a24b5f8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41100/0 (socket says 172.21.15.55:41100) 2024-04-02T07:29:14.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.118+0000 7f781cc00640 1 -- 172.21.15.55:0/3414918097 learned_addr learned my addr 172.21.15.55:0/3414918097 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:14.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.118+0000 7f781c200640 1 --2- 172.21.15.55:0/3414918097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a24b4d67e0 0x55a24b561140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.118+0000 7f781b800640 1 --2- 172.21.15.55:0/3414918097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a24b4d77a0 0x55a24b5f8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.118+0000 7f781cc00640 1 -- 172.21.15.55:0/3414918097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a24b4d67e0 msgr2=0x55a24b561140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:14.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.118+0000 7f781cc00640 1 --2- 172.21.15.55:0/3414918097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a24b4d67e0 0x55a24b561140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.118+0000 7f781cc00640 1 -- 172.21.15.55:0/3414918097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a24b4d77a0 msgr2=0x55a24b5f8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:14.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.118+0000 7f781cc00640 1 --2- 172.21.15.55:0/3414918097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a24b4d77a0 0x55a24b5f8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.118+0000 7f781cc00640 1 -- 172.21.15.55:0/3414918097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7808005df0 con 0x55a24b563a20 2024-04-02T07:29:14.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.118+0000 7f781cc00640 1 --2- 172.21.15.55:0/3414918097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a24b563a20 0x55a24b5f8b60 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f781400c470 tx=0x7f781400c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1d6a24b7d46cdf server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:14.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781a400640 1 -- 172.21.15.55:0/3414918097 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78140116b0 con 0x55a24b563a20 2024-04-02T07:29:14.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781a400640 1 -- 172.21.15.55:0/3414918097 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7814011810 con 0x55a24b563a20 2024-04-02T07:29:14.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781a400640 1 -- 172.21.15.55:0/3414918097 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7814011bc0 con 0x55a24b563a20 2024-04-02T07:29:14.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781ef31080 1 -- 172.21.15.55:0/3414918097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a24b563a20 msgr2=0x55a24b5f8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781ef31080 1 --2- 172.21.15.55:0/3414918097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a24b563a20 0x55a24b5f8b60 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f781400c470 tx=0x7f781400c930 comp rx=0 tx=0).stop 2024-04-02T07:29:14.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781ef31080 1 -- 172.21.15.55:0/3414918097 shutdown_connections 2024-04-02T07:29:14.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781ef31080 1 --2- 172.21.15.55:0/3414918097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a24b563a20 0x55a24b5f8b60 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781ef31080 1 --2- 172.21.15.55:0/3414918097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a24b4d77a0 0x55a24b5f8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781ef31080 1 --2- 172.21.15.55:0/3414918097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a24b4d67e0 0x55a24b561140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781ef31080 1 -- 172.21.15.55:0/3414918097 >> 172.21.15.55:0/3414918097 conn(0x55a24b4ba5a0 msgr2=0x55a24b5619b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:14.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781ef31080 1 -- 172.21.15.55:0/3414918097 shutdown_connections 2024-04-02T07:29:14.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781ef31080 1 -- 172.21.15.55:0/3414918097 wait complete. 2024-04-02T07:29:14.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781ef31080 1 Processor -- start 2024-04-02T07:29:14.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781ef31080 1 -- start start 2024-04-02T07:29:14.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781ef31080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a24b4d67e0 0x55a24b556380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781ef31080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a24b4d77a0 0x55a24b5f7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781ef31080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a24b563a20 0x55a24b565770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781ef31080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a24b5feee0 con 0x55a24b4d77a0 2024-04-02T07:29:14.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781ef31080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a24b5fbea0 con 0x55a24b4d67e0 2024-04-02T07:29:14.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781ef31080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a24b5fc140 con 0x55a24b563a20 2024-04-02T07:29:14.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781b800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a24b4d77a0 0x55a24b5f7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781b800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a24b4d77a0 0x55a24b5f7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41114/0 (socket says 172.21.15.55:41114) 2024-04-02T07:29:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781b800640 1 -- 172.21.15.55:0/3621771471 learned_addr learned my addr 172.21.15.55:0/3621771471 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781c200640 1 --2- 172.21.15.55:0/3621771471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a24b4d67e0 0x55a24b556380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781cc00640 1 --2- 172.21.15.55:0/3621771471 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a24b563a20 0x55a24b565770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781b800640 1 -- 172.21.15.55:0/3621771471 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a24b563a20 msgr2=0x55a24b565770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781b800640 1 --2- 172.21.15.55:0/3621771471 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a24b563a20 0x55a24b565770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781b800640 1 -- 172.21.15.55:0/3621771471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a24b4d67e0 msgr2=0x55a24b556380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781b800640 1 --2- 172.21.15.55:0/3621771471 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a24b4d67e0 0x55a24b556380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781b800640 1 -- 172.21.15.55:0/3621771471 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781400d040 con 0x55a24b4d77a0 2024-04-02T07:29:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781b800640 1 --2- 172.21.15.55:0/3621771471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a24b4d77a0 0x55a24b5f7080 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f7808019e20 tx=0x7f7808018510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f7819000640 1 -- 172.21.15.55:0/3621771471 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78080a5e20 con 0x55a24b4d77a0 2024-04-02T07:29:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f7819000640 1 -- 172.21.15.55:0/3621771471 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78080b7040 con 0x55a24b4d77a0 2024-04-02T07:29:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f7819000640 1 -- 172.21.15.55:0/3621771471 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78080b0670 con 0x55a24b4d77a0 2024-04-02T07:29:14.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781ef31080 1 -- 172.21.15.55:0/3621771471 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55a24b3e28c0 con 0x55a24b4d77a0 2024-04-02T07:29:14.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.122+0000 7f781ef31080 1 -- 172.21.15.55:0/3621771471 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a24b3d5d00 con 0x55a24b4d77a0 2024-04-02T07:29:14.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.126+0000 7f7819000640 1 -- 172.21.15.55:0/3621771471 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f78080b07d0 con 0x55a24b4d77a0 2024-04-02T07:29:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.126+0000 7f7819000640 1 --2- 172.21.15.55:0/3621771471 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f77fc065070 0x7f77fc067530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.126+0000 7f7819000640 1 -- 172.21.15.55:0/3621771471 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f780811e1b0 con 0x55a24b4d77a0 2024-04-02T07:29:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.126+0000 7f781ef31080 1 --2- 172.21.15.55:0/3621771471 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x55a24b5f5310 0x55a24b5f5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.126+0000 7f781ef31080 1 -- 172.21.15.55:0/3621771471 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:1 12.10 12:0cf6ad0f:::10000000000.00000000:head [delete] snapc 0=[] ondisk+write+peerstat_old+known_if_redirected+supports_pool_eio e90) v8 -- 0x55a24b5568c0 con 0x55a24b5f5310 2024-04-02T07:29:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.126+0000 7f781c200640 1 --2- 172.21.15.55:0/3621771471 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f77fc065070 0x7f77fc067530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.126+0000 7f781cc00640 1 --2- 172.21.15.55:0/3621771471 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x55a24b5f5310 0x55a24b5f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.126+0000 7f781c200640 1 --2- 172.21.15.55:0/3621771471 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f77fc065070 0x7f77fc067530 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f780c011490 tx=0x7f780c001700 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:14.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.126+0000 7f781cc00640 1 --2- 172.21.15.55:0/3621771471 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x55a24b5f5310 0x55a24b5f5720 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.130+0000 7f781cc00640 1 -- 172.21.15.55:0/3621771471 <== osd.0 v2:172.21.15.55:6800/27392 1 ==== osd_op_reply(1 10000000000.00000000 [delete] v90'11 uv11 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f7814018020 con 0x55a24b5f5310 2024-04-02T07:29:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.130+0000 7f781ef31080 1 -- 172.21.15.55:0/3621771471 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x55a24b5f5310 msgr2=0x55a24b5f5720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.130+0000 7f781ef31080 1 --2- 172.21.15.55:0/3621771471 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x55a24b5f5310 0x55a24b5f5720 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.130+0000 7f781ef31080 1 -- 172.21.15.55:0/3621771471 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f77fc065070 msgr2=0x7f77fc067530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.130+0000 7f781ef31080 1 --2- 172.21.15.55:0/3621771471 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f77fc065070 0x7f77fc067530 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f780c011490 tx=0x7f780c001700 comp rx=0 tx=0).stop 2024-04-02T07:29:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.130+0000 7f781ef31080 1 -- 172.21.15.55:0/3621771471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a24b4d77a0 msgr2=0x55a24b5f7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.130+0000 7f781ef31080 1 --2- 172.21.15.55:0/3621771471 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a24b4d77a0 0x55a24b5f7080 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f7808019e20 tx=0x7f7808018510 comp rx=0 tx=0).stop 2024-04-02T07:29:14.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.130+0000 7f781cc00640 1 -- 172.21.15.55:0/3621771471 reap_dead start 2024-04-02T07:29:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.130+0000 7f781ef31080 1 -- 172.21.15.55:0/3621771471 shutdown_connections 2024-04-02T07:29:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.130+0000 7f781ef31080 1 -- 172.21.15.55:0/3621771471 >> 172.21.15.55:0/3621771471 conn(0x55a24b4ba5a0 msgr2=0x55a24b5619b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.130+0000 7f781ef31080 1 -- 172.21.15.55:0/3621771471 shutdown_connections 2024-04-02T07:29:14.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.130+0000 7f781ef31080 1 -- 172.21.15.55:0/3621771471 wait complete. 2024-04-02T07:29:14.140 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset 2024-04-02T07:29:14.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec6603a400 1 -- start start 2024-04-02T07:29:14.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec6603a400 1 Processor -- start 2024-04-02T07:29:14.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec6603a400 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ede543800 0x558ede5ce580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec6603a400 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558ede543400 0x558ede5ceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec6603a400 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ede543000 0x558ede5cf080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec6603a400 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ede610a00 con 0x558ede543400 2024-04-02T07:29:14.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec6603a400 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ede610780 con 0x558ede543800 2024-04-02T07:29:14.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec6603a400 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ede610640 con 0x558ede543000 2024-04-02T07:29:14.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec63600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558ede543400 0x558ede5ceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec63600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558ede543400 0x558ede5ceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41126/0 (socket says 172.21.15.55:41126) 2024-04-02T07:29:14.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec63600640 1 -- 172.21.15.55:0/991706421 learned_addr learned my addr 172.21.15.55:0/991706421 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:14.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec64000640 1 --2- 172.21.15.55:0/991706421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ede543800 0x558ede5ce580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec64a00640 1 --2- 172.21.15.55:0/991706421 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ede543000 0x558ede5cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec63600640 1 -- 172.21.15.55:0/991706421 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ede543000 msgr2=0x558ede5cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:14.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec63600640 1 --2- 172.21.15.55:0/991706421 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ede543000 0x558ede5cf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec63600640 1 -- 172.21.15.55:0/991706421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ede543800 msgr2=0x558ede5ce580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:14.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec63600640 1 --2- 172.21.15.55:0/991706421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ede543800 0x558ede5ce580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec63600640 1 -- 172.21.15.55:0/991706421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ede5789c0 con 0x558ede543400 2024-04-02T07:29:14.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec64a00640 1 --2- 172.21.15.55:0/991706421 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ede543000 0x558ede5cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:29:14.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec63600640 1 --2- 172.21.15.55:0/991706421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558ede543400 0x558ede5ceb00 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x558edf3b2bd0 tx=0x558edf446120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47889b8915156093 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:14.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec60e00640 1 -- 172.21.15.55:0/991706421 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ede597080 con 0x558ede543400 2024-04-02T07:29:14.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec60e00640 1 -- 172.21.15.55:0/991706421 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558edf314300 con 0x558ede543400 2024-04-02T07:29:14.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec60e00640 1 -- 172.21.15.55:0/991706421 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ede597600 con 0x558ede543400 2024-04-02T07:29:14.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec6603a400 1 -- 172.21.15.55:0/991706421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ede5781a0 con 0x558ede543400 2024-04-02T07:29:14.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec6603a400 1 -- 172.21.15.55:0/991706421 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x558ede5789c0 con 0x558ede543400 2024-04-02T07:29:14.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.226+0000 7fec6603a400 4 waiting for MDS map... 2024-04-02T07:29:14.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec60e00640 1 -- 172.21.15.55:0/991706421 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x558ede582c40 con 0x558ede543400 2024-04-02T07:29:14.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec60e00640 1 -- 172.21.15.55:0/991706421 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 61) v1 ==== 2573+0+0 (secure 0 0 0) 0x558ede590f00 con 0x558ede543400 2024-04-02T07:29:14.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec6603a400 4 Got MDS map 61 2024-04-02T07:29:14.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec6603a400 10 main: JournalTool::main 2024-04-02T07:29:14.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec6603a400 4 main: JournalTool: connecting to RADOS... 2024-04-02T07:29:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec6603a400 1 Processor -- start 2024-04-02T07:29:14.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec6603a400 1 -- start start 2024-04-02T07:29:14.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec6603a400 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf31b800 0x558ede5cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec6603a400 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558edf31bc00 0x558ede5cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec6603a400 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558edf4b8000 0x558ede5d0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec6603a400 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ede589e00 con 0x558edf31b800 2024-04-02T07:29:14.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec6603a400 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ede610780 con 0x558edf31bc00 2024-04-02T07:29:14.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec6603a400 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ede610a00 con 0x558edf4b8000 2024-04-02T07:29:14.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec64a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf31b800 0x558ede5cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec64a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf31b800 0x558ede5cf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41140/0 (socket says 172.21.15.55:41140) 2024-04-02T07:29:14.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec64a00640 1 -- 172.21.15.55:0/2162479415 learned_addr learned my addr 172.21.15.55:0/2162479415 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:14.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec64000640 1 --2- 172.21.15.55:0/2162479415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558edf31bc00 0x558ede5cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec63600640 1 --2- 172.21.15.55:0/2162479415 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558edf4b8000 0x558ede5d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec64a00640 1 -- 172.21.15.55:0/2162479415 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558edf4b8000 msgr2=0x558ede5d0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec64a00640 1 --2- 172.21.15.55:0/2162479415 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558edf4b8000 0x558ede5d0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec64a00640 1 -- 172.21.15.55:0/2162479415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558edf31bc00 msgr2=0x558ede5cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec64a00640 1 --2- 172.21.15.55:0/2162479415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558edf31bc00 0x558ede5cfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec64a00640 1 -- 172.21.15.55:0/2162479415 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ede578b60 con 0x558edf31b800 2024-04-02T07:29:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec64a00640 1 --2- 172.21.15.55:0/2162479415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf31b800 0x558ede5cf600 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x558edf4ba0c0 tx=0x558edf46cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9ca840ff621bc1a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec5e600640 1 -- 172.21.15.55:0/2162479415 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ede597080 con 0x558edf31b800 2024-04-02T07:29:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec5e600640 1 -- 172.21.15.55:0/2162479415 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558edf314480 con 0x558edf31b800 2024-04-02T07:29:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec5e600640 1 -- 172.21.15.55:0/2162479415 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ede597600 con 0x558edf31b800 2024-04-02T07:29:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec6603a400 1 -- 172.21.15.55:0/2162479415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf31b800 msgr2=0x558ede5cf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec6603a400 1 --2- 172.21.15.55:0/2162479415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf31b800 0x558ede5cf600 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x558edf4ba0c0 tx=0x558edf46cc00 comp rx=0 tx=0).stop 2024-04-02T07:29:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec6603a400 1 -- 172.21.15.55:0/2162479415 shutdown_connections 2024-04-02T07:29:14.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec6603a400 1 --2- 172.21.15.55:0/2162479415 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558edf4b8000 0x558ede5d0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec6603a400 1 --2- 172.21.15.55:0/2162479415 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558edf31bc00 0x558ede5cfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec6603a400 1 --2- 172.21.15.55:0/2162479415 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf31b800 0x558ede5cf600 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec6603a400 1 -- 172.21.15.55:0/2162479415 >> 172.21.15.55:0/2162479415 conn(0x558ede542c00 msgr2=0x558ede571800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:14.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec6603a400 1 -- 172.21.15.55:0/2162479415 shutdown_connections 2024-04-02T07:29:14.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.230+0000 7fec6603a400 1 -- 172.21.15.55:0/2162479415 wait complete. 2024-04-02T07:29:14.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec6603a400 1 Processor -- start 2024-04-02T07:29:14.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec6603a400 1 -- start start 2024-04-02T07:29:14.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec6603a400 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558edf31bc00 0x558ede5d1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec6603a400 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf31b800 0x558ede5d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec6603a400 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558edf4b9800 0x558ede5d0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec6603a400 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ede610500 con 0x558edf31b800 2024-04-02T07:29:14.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec6603a400 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ede6103c0 con 0x558edf31bc00 2024-04-02T07:29:14.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec6603a400 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ede610280 con 0x558edf4b9800 2024-04-02T07:29:14.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec64000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf31b800 0x558ede5d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec64a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558edf31bc00 0x558ede5d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec64a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558edf31bc00 0x558ede5d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:57658/0 (socket says 172.21.15.55:57658) 2024-04-02T07:29:14.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec64000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf31b800 0x558ede5d0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41152/0 (socket says 172.21.15.55:41152) 2024-04-02T07:29:14.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec64a00640 1 -- 172.21.15.55:0/3864490093 learned_addr learned my addr 172.21.15.55:0/3864490093 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:14.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec63600640 1 --2- 172.21.15.55:0/3864490093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558edf4b9800 0x558ede5d0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec64000640 1 -- 172.21.15.55:0/3864490093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558edf4b9800 msgr2=0x558ede5d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec64000640 1 --2- 172.21.15.55:0/3864490093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558edf4b9800 0x558ede5d0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec64000640 1 -- 172.21.15.55:0/3864490093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558edf31bc00 msgr2=0x558ede5d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec64000640 1 --2- 172.21.15.55:0/3864490093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558edf31bc00 0x558ede5d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec64000640 1 -- 172.21.15.55:0/3864490093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ede578340 con 0x558edf31b800 2024-04-02T07:29:14.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec64a00640 1 --2- 172.21.15.55:0/3864490093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558edf31bc00 0x558ede5d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:29:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec63600640 1 --2- 172.21.15.55:0/3864490093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558edf4b9800 0x558ede5d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:29:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec64000640 1 --2- 172.21.15.55:0/3864490093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf31b800 0x558ede5d0c00 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x558edf4bae70 tx=0x558edf46cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec5c800640 1 -- 172.21.15.55:0/3864490093 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ede597080 con 0x558edf31b800 2024-04-02T07:29:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec5c800640 1 -- 172.21.15.55:0/3864490093 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558ede5a0180 con 0x558edf31b800 2024-04-02T07:29:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec5c800640 1 -- 172.21.15.55:0/3864490093 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ede597600 con 0x558edf31b800 2024-04-02T07:29:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec6603a400 1 -- 172.21.15.55:0/3864490093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x558ede578000 con 0x558edf31b800 2024-04-02T07:29:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec6603a400 1 -- 172.21.15.55:0/3864490093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ede578ea0 con 0x558edf31b800 2024-04-02T07:29:14.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.234+0000 7fec6603a400 4 main: JournalTool: resolving pool 12 2024-04-02T07:29:14.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec5c800640 1 -- 172.21.15.55:0/3864490093 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x558ede60e840 con 0x558edf31b800 2024-04-02T07:29:14.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec5c800640 1 --2- 172.21.15.55:0/3864490093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x558edf4cb400 0x558ede5d1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec5c800640 1 -- 172.21.15.55:0/3864490093 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x558ede582a80 con 0x558edf31b800 2024-04-02T07:29:14.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec6603a400 4 main: JournalTool: creating IoCtx.. 2024-04-02T07:29:14.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec6603a400 4 main: Executing for rank 0 2024-04-02T07:29:14.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec64a00640 1 --2- 172.21.15.55:0/3864490093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x558edf4cb400 0x558ede5d1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec64a00640 1 --2- 172.21.15.55:0/3864490093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x558edf4cb400 0x558ede5d1700 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x558edf4bad20 tx=0x558ede61d2c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:14.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec6603a400 1 -- start start 2024-04-02T07:29:14.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec6603a400 1 Processor -- start 2024-04-02T07:29:14.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec6603a400 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf4b9000 0x558ede5d0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec6603a400 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558edf4b8c00 0x558ede5cfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec6603a400 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558edf4b8800 0x558ede5cf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec6603a400 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ede6103c0 con 0x558edf4b9000 2024-04-02T07:29:14.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec6603a400 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ede610a00 con 0x558edf4b8c00 2024-04-02T07:29:14.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec6603a400 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x558ede610780 con 0x558edf4b8800 2024-04-02T07:29:14.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec64a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf4b9000 0x558ede5d0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec64a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf4b9000 0x558ede5d0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41156/0 (socket says 172.21.15.55:41156) 2024-04-02T07:29:14.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec64a00640 1 -- 172.21.15.55:0/3760445233 learned_addr learned my addr 172.21.15.55:0/3760445233 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:14.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec63600640 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558edf4b8800 0x558ede5cf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec64000640 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558edf4b8c00 0x558ede5cfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec64a00640 1 -- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558edf4b8800 msgr2=0x558ede5cf600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:14.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec64a00640 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558edf4b8800 0x558ede5cf600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec64a00640 1 -- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558edf4b8c00 msgr2=0x558ede5cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:14.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec64a00640 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558edf4b8c00 0x558ede5cfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec64a00640 1 -- 172.21.15.55:0/3760445233 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ede863520 con 0x558edf4b9000 2024-04-02T07:29:14.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.238+0000 7fec64a00640 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf4b9000 0x558ede5d0100 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x558ede8ecdb0 tx=0x558ede61d020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7542de339d0a55e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:14.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.242+0000 7fec58c00640 1 -- 172.21.15.55:0/3760445233 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ede596dc0 con 0x558edf4b9000 2024-04-02T07:29:14.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.242+0000 7fec58c00640 1 -- 172.21.15.55:0/3760445233 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x558edf314c00 con 0x558edf4b9000 2024-04-02T07:29:14.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.242+0000 7fec58c00640 1 -- 172.21.15.55:0/3760445233 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x558ede5966e0 con 0x558edf4b9000 2024-04-02T07:29:14.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.242+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558ede863380 con 0x558edf4b9000 2024-04-02T07:29:14.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.242+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x558ede8631e0 con 0x558edf4b9000 2024-04-02T07:29:14.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.242+0000 7fec6603a400 4 waiting for MDS map... 2024-04-02T07:29:14.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.242+0000 7fec58c00640 1 -- 172.21.15.55:0/3760445233 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x558ede5828c0 con 0x558edf4b9000 2024-04-02T07:29:14.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.242+0000 7fec58c00640 1 -- 172.21.15.55:0/3760445233 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 61) v1 ==== 2573+0+0 (secure 0 0 0) 0x558ede98a900 con 0x558edf4b9000 2024-04-02T07:29:14.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.242+0000 7fec6603a400 4 Got MDS map 61 2024-04-02T07:29:14.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.242+0000 7fec6603a400 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x558edf4b8400 0x558ede992000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.242+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:1 12.f 12:f1f69726:::400.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x558edf4b8000 con 0x558edf4b8400 2024-04-02T07:29:14.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.242+0000 7fec64000640 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x558edf4b8400 0x558ede992000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.242+0000 7fec64000640 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x558edf4b8400 0x558ede992000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=fe4bf5a960ae967a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:14.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.246+0000 7fec64000640 1 -- 172.21.15.55:0/3760445233 <== osd.6 v2:172.21.15.106:6816/27678 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x558edf440b40 con 0x558edf4b8400 2024-04-02T07:29:14.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.246+0000 7fec6603a400 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x558ede97d400 0x558ede992580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.246+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:2 12.14 12:292cf221:::200.00000000:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e90) v8 -- 0x558ede97d800 con 0x558ede97d400 2024-04-02T07:29:14.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.246+0000 7fec63600640 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x558ede97d400 0x558ede992580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.246+0000 7fec63600640 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x558ede97d400 0x558ede992580 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=d74c17622bf9974e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:14.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.246+0000 7fec63600640 1 -- 172.21.15.55:0/3760445233 <== osd.5 v2:172.21.15.106:6800/27676 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv19 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x558edf440d80 con 0x558ede97d400 2024-04-02T07:29:14.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.250+0000 7fec56e00640 1 -- 172.21.15.55:0/3760445233 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:3 12.14 12:2e2fa760:::200.00000001:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e90) v8 -- 0x558ede99c000 con 0x558ede97d400 2024-04-02T07:29:14.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.250+0000 7fec56e00640 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x558ede99c400 0x558ede994680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.250+0000 7fec56e00640 1 -- 172.21.15.55:0/3760445233 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:4 12.1b 12:ddb4e4d7:::200.00000002:head [stat] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e90) v8 -- 0x558ede99c800 con 0x558ede99c400 2024-04-02T07:29:14.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.250+0000 7fec63600640 1 -- 172.21.15.55:0/3760445233 <== osd.5 v2:172.21.15.106:6800/27676 2 ==== osd_op_reply(3 200.00000001 [stat out=16b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+16 (crc 0 0 0) 0x558edf440d80 con 0x558ede97d400 2024-04-02T07:29:14.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.250+0000 7fec64a00640 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x558ede99c400 0x558ede994680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.250+0000 7fec64a00640 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x558ede99c400 0x558ede994680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=f79c83272a5ef00b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:14.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.250+0000 7fec64a00640 1 -- 172.21.15.55:0/3760445233 <== osd.4 v2:172.21.15.106:6801/27677 1 ==== osd_op_reply(4 200.00000002 [stat] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558edf440fc0 con 0x558ede99c400 2024-04-02T07:29:14.252 INFO:teuthology.orchestra.run.smithi055.stdout:old journal was 4209788~892 2024-04-02T07:29:14.252 INFO:teuthology.orchestra.run.smithi055.stdout:new journal start will be 8388608 (4177928 bytes past old end) 2024-04-02T07:29:14.252 INFO:teuthology.orchestra.run.smithi055.stdout:writing journal head 2024-04-02T07:29:14.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.250+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:5 12.14 12:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x558ede97dc00 con 0x558ede97d400 2024-04-02T07:29:14.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.254+0000 7fec63600640 1 -- 172.21.15.55:0/3760445233 <== osd.5 v2:172.21.15.106:6800/27676 3 ==== osd_op_reply(5 200.00000000 [writefull 0~90] v90'20 uv20 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x558edf440d80 con 0x558ede97d400 2024-04-02T07:29:14.256 INFO:teuthology.orchestra.run.smithi055.stdout:writing EResetJournal entry 2024-04-02T07:29:14.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.254+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:6 12.1b 12:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x558ede99cc00 con 0x558ede99c400 2024-04-02T07:29:14.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.254+0000 7fec6603a400 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x558ede99d000 0x558ede992b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.254+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:7 12.b 12:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x558ede99d400 con 0x558ede99d000 2024-04-02T07:29:14.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.254+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:8 12.1f 12:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x558ede99d800 con 0x558edf4b8400 2024-04-02T07:29:14.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.254+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:9 12.1a 12:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x558ede99dc00 con 0x558ede99c400 2024-04-02T07:29:14.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.254+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:10 12.1e 12:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x558ede9aa000 con 0x558ede99c400 2024-04-02T07:29:14.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.254+0000 7fec6603a400 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x558ede9aa400 0x558ede993080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.254+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:11 12.1d 12:bec1251c:::200.00000007:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x558ede9aa800 con 0x558ede9aa400 2024-04-02T07:29:14.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.254+0000 7fec64000640 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x558ede99d000 0x558ede992b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.254+0000 7fec63600640 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x558ede9aa400 0x558ede993080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.254+0000 7fec64000640 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x558ede99d000 0x558ede992b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=57b3b5974fe064da server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:14.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.254+0000 7fec63600640 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x558ede9aa400 0x558ede993080 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=4ce3e3cc5772d415 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:14.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.254+0000 7fec64a00640 1 -- 172.21.15.55:0/3760445233 <== osd.4 v2:172.21.15.106:6801/27677 2 ==== osd_op_reply(9 200.00000005 [delete] v90'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558edf440fc0 con 0x558ede99c400 2024-04-02T07:29:14.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.254+0000 7fec64a00640 1 -- 172.21.15.55:0/3760445233 <== osd.4 v2:172.21.15.106:6801/27677 3 ==== osd_op_reply(6 200.00000002 [delete] v90'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558edf440fc0 con 0x558ede99c400 2024-04-02T07:29:14.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec64000640 1 -- 172.21.15.55:0/3760445233 <== osd.6 v2:172.21.15.106:6816/27678 2 ==== osd_op_reply(8 200.00000004 [delete] v90'7 uv6 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558edf440b40 con 0x558edf4b8400 2024-04-02T07:29:14.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec64a00640 1 -- 172.21.15.55:0/3760445233 <== osd.4 v2:172.21.15.106:6801/27677 4 ==== osd_op_reply(10 200.00000006 [delete] v90'2 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558edf440fc0 con 0x558ede99c400 2024-04-02T07:29:14.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec64000640 1 -- 172.21.15.55:0/3760445233 <== osd.3 v2:172.21.15.55:6824/27393 1 ==== osd_op_reply(7 200.00000003 [delete] v90'4 uv3 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558edf440b40 con 0x558ede99d000 2024-04-02T07:29:14.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec56e00640 1 -- 172.21.15.55:0/3760445233 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:12 12.1b 12:ddb4e4d7:::200.00000002:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e90) v8 -- 0x558ede97cc00 con 0x558ede99c400 2024-04-02T07:29:14.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec63600640 1 -- 172.21.15.55:0/3760445233 <== osd.0 v2:172.21.15.55:6800/27392 1 ==== osd_op_reply(11 200.00000007 [delete] v90'3 uv2 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x558edf440d80 con 0x558ede9aa400 2024-04-02T07:29:14.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec64a00640 1 -- 172.21.15.55:0/3760445233 <== osd.4 v2:172.21.15.106:6801/27677 5 ==== osd_op_reply(12 200.00000002 [write 0~48] v90'3 uv3 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x558edf440fc0 con 0x558ede99c400 2024-04-02T07:29:14.261 INFO:teuthology.orchestra.run.smithi055.stdout:done 2024-04-02T07:29:14.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x558ede9aa400 msgr2=0x558ede993080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec6603a400 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x558ede9aa400 0x558ede993080 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x558ede99d000 msgr2=0x558ede992b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec6603a400 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x558ede99d000 0x558ede992b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x558ede99c400 msgr2=0x558ede994680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec6603a400 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x558ede99c400 0x558ede994680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x558ede97d400 msgr2=0x558ede992580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec6603a400 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x558ede97d400 0x558ede992580 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x558edf4b8400 msgr2=0x558ede992000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec6603a400 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x558edf4b8400 0x558ede992000 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec63600640 1 -- 172.21.15.55:0/3760445233 reap_dead start 2024-04-02T07:29:14.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec63600640 1 -- 172.21.15.55:0/3760445233 reap_dead start 2024-04-02T07:29:14.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf4b9000 msgr2=0x558ede5d0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec6603a400 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf4b9000 0x558ede5d0100 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x558ede8ecdb0 tx=0x558ede61d020 comp rx=0 tx=0).stop 2024-04-02T07:29:14.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 shutdown_connections 2024-04-02T07:29:14.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec6603a400 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x558edf4b8400 0x558ede992000 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec6603a400 1 --2- 172.21.15.55:0/3760445233 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf4b9000 0x558ede5d0100 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 >> 172.21.15.55:0/3760445233 conn(0x558edf4b9400 msgr2=0x558ede962000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:14.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 shutdown_connections 2024-04-02T07:29:14.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.258+0000 7fec6603a400 1 -- 172.21.15.55:0/3760445233 wait complete. 2024-04-02T07:29:14.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 -- 172.21.15.55:0/3864490093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x558edf4cb400 msgr2=0x558ede5d1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 --2- 172.21.15.55:0/3864490093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x558edf4cb400 0x558ede5d1700 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x558edf4bad20 tx=0x558ede61d2c0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 -- 172.21.15.55:0/3864490093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf31b800 msgr2=0x558ede5d0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 --2- 172.21.15.55:0/3864490093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf31b800 0x558ede5d0c00 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x558edf4bae70 tx=0x558edf46cd20 comp rx=0 tx=0).stop 2024-04-02T07:29:14.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 -- 172.21.15.55:0/3864490093 shutdown_connections 2024-04-02T07:29:14.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 --2- 172.21.15.55:0/3864490093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558edf4b9800 0x558ede5d0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 --2- 172.21.15.55:0/3864490093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558edf31b800 0x558ede5d0c00 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 --2- 172.21.15.55:0/3864490093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x558edf4cb400 0x558ede5d1700 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 --2- 172.21.15.55:0/3864490093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558edf31bc00 0x558ede5d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 -- 172.21.15.55:0/3864490093 >> 172.21.15.55:0/3864490093 conn(0x558ede542c00 msgr2=0x558ede571800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:14.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 -- 172.21.15.55:0/3864490093 shutdown_connections 2024-04-02T07:29:14.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 -- 172.21.15.55:0/3864490093 wait complete. 2024-04-02T07:29:14.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 -- 172.21.15.55:0/991706421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558ede543400 msgr2=0x558ede5ceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 --2- 172.21.15.55:0/991706421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558ede543400 0x558ede5ceb00 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x558edf3b2bd0 tx=0x558edf446120 comp rx=0 tx=0).stop 2024-04-02T07:29:14.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 -- 172.21.15.55:0/991706421 shutdown_connections 2024-04-02T07:29:14.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 --2- 172.21.15.55:0/991706421 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x558ede543000 0x558ede5cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 --2- 172.21.15.55:0/991706421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x558ede543400 0x558ede5ceb00 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 --2- 172.21.15.55:0/991706421 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x558ede543800 0x558ede5ce580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 -- 172.21.15.55:0/991706421 >> 172.21.15.55:0/991706421 conn(0x558ede543c00 msgr2=0x558ede571000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:14.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 -- 172.21.15.55:0/991706421 shutdown_connections 2024-04-02T07:29:14.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.262+0000 7fec6603a400 1 -- 172.21.15.55:0/991706421 wait complete. 2024-04-02T07:29:14.269 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset'] in time 0:00:00.128386, result: old journal was 4209788~892 new journal start will be 8388608 (4177928 bytes past old end) writing journal head writing EResetJournal entry done 2024-04-02T07:29:14.269 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-02T07:29:14.423 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:29:14.427 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:29:14.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.454+0000 7fd811e00640 1 Processor -- start 2024-04-02T07:29:14.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.454+0000 7fd811e00640 1 -- start start 2024-04-02T07:29:14.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.454+0000 7fd811e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd80c0b31a0 0x7fd80c165730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.454+0000 7fd811e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80c15e3a0 con 0x7fd80c144260 2024-04-02T07:29:14.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.454+0000 7fd811e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80c15e5f0 con 0x7fd80c0709b0 2024-04-02T07:29:14.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.454+0000 7fd811e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80c0b37c0 con 0x7fd80c0b31a0 2024-04-02T07:29:14.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.454+0000 7fd80aa00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd80c144260 0x7fd80c0702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44118/0 (socket says 172.21.15.55:44118) 2024-04-02T07:29:14.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.454+0000 7fd80aa00640 1 -- 172.21.15.55:0/1663666221 learned_addr learned my addr 172.21.15.55:0/1663666221 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:29:14.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.454+0000 7fd80b400640 1 --2- 172.21.15.55:0/1663666221 >> v2:172.21.15.106:3300/0 conn(0x7fd80c0b31a0 0x7fd80c165730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.454+0000 7fd809600640 1 -- 172.21.15.55:0/1663666221 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666670060 0 0) 0x7fd80c15e3a0 con 0x7fd80c144260 2024-04-02T07:29:14.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.454+0000 7fd809600640 1 -- 172.21.15.55:0/1663666221 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7f0003530 con 0x7fd80c144260 2024-04-02T07:29:14.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.454+0000 7fd809600640 1 -- 172.21.15.55:0/1663666221 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2495848629 0 0) 0x7fd7f0003530 con 0x7fd80c144260 2024-04-02T07:29:14.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.454+0000 7fd80b400640 1 -- 172.21.15.55:0/1663666221 >> v1:172.21.15.106:6789/0 conn(0x7fd80c0709b0 legacy=0x7fd80c0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.454+0000 7fd80b400640 1 -- 172.21.15.55:0/1663666221 >> v1:172.21.15.55:6789/0 conn(0x7fd80c144260 legacy=0x7fd80c0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.454+0000 7fd80b400640 1 -- 172.21.15.55:0/1663666221 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c15e8d0 con 0x7fd80c0b31a0 2024-04-02T07:29:14.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.458+0000 7fd80b400640 1 --2- 172.21.15.55:0/1663666221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c0b31a0 0x7fd80c165730 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd804009d90 tx=0x7fd80401c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5437f299f9524b80 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:14.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.458+0000 7fd809600640 1 -- 172.21.15.55:0/1663666221 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc001680 con 0x7fd80c0b31a0 2024-04-02T07:29:14.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.458+0000 7fd809600640 1 -- 172.21.15.55:0/1663666221 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8040a64e0 con 0x7fd80c0b31a0 2024-04-02T07:29:14.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.458+0000 7fd809600640 1 -- 172.21.15.55:0/1663666221 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8040a6870 con 0x7fd80c0b31a0 2024-04-02T07:29:14.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.458+0000 7fd811e00640 1 -- 172.21.15.55:0/1663666221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c0b31a0 msgr2=0x7fd80c165730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.458+0000 7fd811e00640 1 --2- 172.21.15.55:0/1663666221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c0b31a0 0x7fd80c165730 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd804009d90 tx=0x7fd80401c890 comp rx=0 tx=0).stop 2024-04-02T07:29:14.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.458+0000 7fd811e00640 1 -- 172.21.15.55:0/1663666221 shutdown_connections 2024-04-02T07:29:14.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.458+0000 7fd811e00640 1 --2- 172.21.15.55:0/1663666221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c0b31a0 0x7fd80c165730 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.458+0000 7fd811e00640 1 -- 172.21.15.55:0/1663666221 >> 172.21.15.55:0/1663666221 conn(0x7fd80c06a390 msgr2=0x7fd80c0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:14.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.458+0000 7fd811e00640 1 -- 172.21.15.55:0/1663666221 shutdown_connections 2024-04-02T07:29:14.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.458+0000 7fd811e00640 1 -- 172.21.15.55:0/1663666221 wait complete. 2024-04-02T07:29:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd811e00640 1 Processor -- start 2024-04-02T07:29:14.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd811e00640 1 -- start start 2024-04-02T07:29:14.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd811e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd80c0709b0 0x7fd80c136030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd811e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c0b31a0 0x7fd80c14ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd811e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd80c144260 0x7fd80c1365b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd811e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c152920 con 0x7fd80c0709b0 2024-04-02T07:29:14.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd811e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c1523f0 con 0x7fd80c0b31a0 2024-04-02T07:29:14.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd811e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c06cfb0 con 0x7fd80c144260 2024-04-02T07:29:14.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd80aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd80c0709b0 0x7fd80c136030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd80aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd80c0709b0 0x7fd80c136030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41168/0 (socket says 172.21.15.55:41168) 2024-04-02T07:29:14.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd80aa00640 1 -- 172.21.15.55:0/1357295166 learned_addr learned my addr 172.21.15.55:0/1357295166 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:14.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd80b400640 1 --2- 172.21.15.55:0/1357295166 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd80c144260 0x7fd80c1365b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd80a000640 1 --2- 172.21.15.55:0/1357295166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c0b31a0 0x7fd80c14ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd80aa00640 1 -- 172.21.15.55:0/1357295166 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd80c144260 msgr2=0x7fd80c1365b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd80aa00640 1 --2- 172.21.15.55:0/1357295166 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd80c144260 0x7fd80c1365b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd80aa00640 1 -- 172.21.15.55:0/1357295166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c0b31a0 msgr2=0x7fd80c14ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:14.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd80aa00640 1 --2- 172.21.15.55:0/1357295166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c0b31a0 0x7fd80c14ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:14.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd80aa00640 1 -- 172.21.15.55:0/1357295166 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd804009a70 con 0x7fd80c0709b0 2024-04-02T07:29:14.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd80a000640 1 --2- 172.21.15.55:0/1357295166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c0b31a0 0x7fd80c14ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:29:14.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd80aa00640 1 --2- 172.21.15.55:0/1357295166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd80c0709b0 0x7fd80c136030 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00c750 tx=0x7fd7fc00cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:14.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd803400640 1 -- 172.21.15.55:0/1357295166 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc005ae0 con 0x7fd80c0709b0 2024-04-02T07:29:14.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd803400640 1 -- 172.21.15.55:0/1357295166 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7fc005c40 con 0x7fd80c0709b0 2024-04-02T07:29:14.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd811e00640 1 -- 172.21.15.55:0/1357295166 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80c06dff0 con 0x7fd80c0709b0 2024-04-02T07:29:14.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd803400640 1 -- 172.21.15.55:0/1357295166 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7fc007070 con 0x7fd80c0709b0 2024-04-02T07:29:14.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd811e00640 1 -- 172.21.15.55:0/1357295166 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80c152640 con 0x7fd80c0709b0 2024-04-02T07:29:14.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.462+0000 7fd811e00640 1 -- 172.21.15.55:0/1357295166 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd80c073530 con 0x7fd80c0709b0 2024-04-02T07:29:14.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.466+0000 7fd803400640 1 -- 172.21.15.55:0/1357295166 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd7fc0071f0 con 0x7fd80c0709b0 2024-04-02T07:29:14.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.466+0000 7fd803400640 1 --2- 172.21.15.55:0/1357295166 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd7ec066690 0x7fd7ec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:14.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.466+0000 7fd803400640 1 -- 172.21.15.55:0/1357295166 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fd7fc0838f0 con 0x7fd80c0709b0 2024-04-02T07:29:14.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.466+0000 7fd80a000640 1 --2- 172.21.15.55:0/1357295166 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd7ec066690 0x7fd7ec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:14.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.466+0000 7fd80a000640 1 --2- 172.21.15.55:0/1357295166 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd7ec066690 0x7fd7ec068b50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0b0da0 tx=0x7fd7f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:14.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.470+0000 7fd803400640 1 -- 172.21.15.55:0/1357295166 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd7fc050ce0 con 0x7fd80c0709b0 2024-04-02T07:29:14.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:14.666+0000 7fd811e00640 1 -- 172.21.15.55:0/1357295166 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fd80c066c90 con 0x7fd80c0709b0 2024-04-02T07:29:15.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.046+0000 7fd803400640 1 -- 172.21.15.55:0/1357295166 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v62) v1 ==== 162+0+0 (secure 0 0 0) 0x7fd7fc017020 con 0x7fd80c0709b0 2024-04-02T07:29:15.050 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-02T07:29:15.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.050+0000 7fd811e00640 1 -- 172.21.15.55:0/1357295166 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd7ec066690 msgr2=0x7fd7ec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:15.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.050+0000 7fd811e00640 1 --2- 172.21.15.55:0/1357295166 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd7ec066690 0x7fd7ec068b50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd80c0b0da0 tx=0x7fd7f8009040 comp rx=0 tx=0).stop 2024-04-02T07:29:15.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.050+0000 7fd811e00640 1 -- 172.21.15.55:0/1357295166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd80c0709b0 msgr2=0x7fd80c136030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:15.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.050+0000 7fd811e00640 1 --2- 172.21.15.55:0/1357295166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd80c0709b0 0x7fd80c136030 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7fd7fc00c750 tx=0x7fd7fc00cc10 comp rx=0 tx=0).stop 2024-04-02T07:29:15.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.050+0000 7fd811e00640 1 -- 172.21.15.55:0/1357295166 shutdown_connections 2024-04-02T07:29:15.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.050+0000 7fd811e00640 1 --2- 172.21.15.55:0/1357295166 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd80c144260 0x7fd80c1365b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:15.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.050+0000 7fd811e00640 1 --2- 172.21.15.55:0/1357295166 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd7ec066690 0x7fd7ec068b50 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:15.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.050+0000 7fd811e00640 1 --2- 172.21.15.55:0/1357295166 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c0b31a0 0x7fd80c14ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:15.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.050+0000 7fd811e00640 1 --2- 172.21.15.55:0/1357295166 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd80c0709b0 0x7fd80c136030 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:15.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.050+0000 7fd811e00640 1 -- 172.21.15.55:0/1357295166 >> 172.21.15.55:0/1357295166 conn(0x7fd80c06a390 msgr2=0x7fd80c0b0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:15.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.050+0000 7fd811e00640 1 -- 172.21.15.55:0/1357295166 shutdown_connections 2024-04-02T07:29:15.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.050+0000 7fd811e00640 1 -- 172.21.15.55:0/1357295166 wait complete. 2024-04-02T07:29:15.077 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:29:15.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.218+0000 7fb582e00640 1 Processor -- start 2024-04-02T07:29:15.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.218+0000 7fb582e00640 1 -- start start 2024-04-02T07:29:15.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.218+0000 7fb582e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb57c15ca70 0x7fb57c0b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:15.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.218+0000 7fb582e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb57c098a10 0x7fb57c098ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:15.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.218+0000 7fb582e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb57c15ce50 con 0x7fb57c06aff0 2024-04-02T07:29:15.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.218+0000 7fb582e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57c0993e0 con 0x7fb57c098a10 2024-04-02T07:29:15.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.218+0000 7fb582e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57c0cef60 con 0x7fb57c15ca70 2024-04-02T07:29:15.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.218+0000 7fb573e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb57c098a10 0x7fb57c098ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:15.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.218+0000 7fb580e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb57c06aff0 0x7fb57c06b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44126/0 (socket says 172.21.15.55:44126) 2024-04-02T07:29:15.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.218+0000 7fb580e00640 1 -- 172.21.15.55:0/2489785577 learned_addr learned my addr 172.21.15.55:0/2489785577 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:29:15.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.218+0000 7fb57be00640 1 --2- 172.21.15.55:0/2489785577 >> v2:172.21.15.106:3300/0 conn(0x7fb57c15ca70 0x7fb57c0b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:15.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.218+0000 7fb573e00640 1 -- 172.21.15.55:0/2489785577 >> v2:172.21.15.106:3300/0 conn(0x7fb57c15ca70 msgr2=0x7fb57c0b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:15.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.218+0000 7fb573e00640 1 --2- 172.21.15.55:0/2489785577 >> v2:172.21.15.106:3300/0 conn(0x7fb57c15ca70 0x7fb57c0b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:15.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.218+0000 7fb573e00640 1 -- 172.21.15.55:0/2489785577 >> v1:172.21.15.55:6789/0 conn(0x7fb57c06aff0 legacy=0x7fb57c06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:15.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.218+0000 7fb573e00640 1 -- 172.21.15.55:0/2489785577 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb57c06bd60 con 0x7fb57c098a10 2024-04-02T07:29:15.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.222+0000 7fb573e00640 1 --2- 172.21.15.55:0/2489785577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb57c098a10 0x7fb57c098ea0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fb57c071f60 tx=0x7fb56401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7436e4adaee4a21a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:15.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.222+0000 7fb57b400640 1 -- 172.21.15.55:0/2489785577 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5640ab600 con 0x7fb57c098a10 2024-04-02T07:29:15.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.222+0000 7fb57b400640 1 -- 172.21.15.55:0/2489785577 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb5640a7050 con 0x7fb57c098a10 2024-04-02T07:29:15.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.222+0000 7fb57b400640 1 -- 172.21.15.55:0/2489785577 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5640ab980 con 0x7fb57c098a10 2024-04-02T07:29:15.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.222+0000 7fb582e00640 1 -- 172.21.15.55:0/2489785577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb57c098a10 msgr2=0x7fb57c098ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:15.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.222+0000 7fb582e00640 1 --2- 172.21.15.55:0/2489785577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb57c098a10 0x7fb57c098ea0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fb57c071f60 tx=0x7fb56401c480 comp rx=0 tx=0).stop 2024-04-02T07:29:15.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.222+0000 7fb582e00640 1 -- 172.21.15.55:0/2489785577 shutdown_connections 2024-04-02T07:29:15.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.222+0000 7fb582e00640 1 --2- 172.21.15.55:0/2489785577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb57c098a10 0x7fb57c098ea0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:15.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.222+0000 7fb582e00640 1 --2- 172.21.15.55:0/2489785577 >> v2:172.21.15.106:3300/0 conn(0x7fb57c15ca70 0x7fb57c0b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:15.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.222+0000 7fb582e00640 1 -- 172.21.15.55:0/2489785577 >> 172.21.15.55:0/2489785577 conn(0x7fb57c0b21d0 msgr2=0x7fb57c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:15.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.222+0000 7fb582e00640 1 -- 172.21.15.55:0/2489785577 shutdown_connections 2024-04-02T07:29:15.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.222+0000 7fb582e00640 1 -- 172.21.15.55:0/2489785577 wait complete. 2024-04-02T07:29:15.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb582e00640 1 Processor -- start 2024-04-02T07:29:15.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb582e00640 1 -- start start 2024-04-02T07:29:15.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb582e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb57c06aff0 0x7fb57c157ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:15.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb582e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb57c098a10 0x7fb57c14b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:15.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb582e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb57c15ca70 0x7fb57c154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:15.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb582e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c14bd30 con 0x7fb57c06aff0 2024-04-02T07:29:15.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb582e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c157630 con 0x7fb57c15ca70 2024-04-02T07:29:15.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb582e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c158000 con 0x7fb57c098a10 2024-04-02T07:29:15.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb57be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb57c06aff0 0x7fb57c157ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:15.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb57be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb57c06aff0 0x7fb57c157ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:41196/0 (socket says 172.21.15.55:41196) 2024-04-02T07:29:15.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb57be00640 1 -- 172.21.15.55:0/1753193752 learned_addr learned my addr 172.21.15.55:0/1753193752 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:15.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb580e00640 1 --2- 172.21.15.55:0/1753193752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb57c15ca70 0x7fb57c154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:15.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb573e00640 1 --2- 172.21.15.55:0/1753193752 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb57c098a10 0x7fb57c14b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:15.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb57be00640 1 -- 172.21.15.55:0/1753193752 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb57c098a10 msgr2=0x7fb57c14b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:15.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb57be00640 1 --2- 172.21.15.55:0/1753193752 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb57c098a10 0x7fb57c14b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:15.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb57be00640 1 -- 172.21.15.55:0/1753193752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb57c15ca70 msgr2=0x7fb57c154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:15.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb57be00640 1 --2- 172.21.15.55:0/1753193752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb57c15ca70 0x7fb57c154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:15.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb57be00640 1 -- 172.21.15.55:0/1753193752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb564009420 con 0x7fb57c06aff0 2024-04-02T07:29:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb57be00640 1 --2- 172.21.15.55:0/1753193752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb57c06aff0 0x7fb57c157ac0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00d5f0 tx=0x7fb56c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb578c00640 1 -- 172.21.15.55:0/1753193752 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c0125f0 con 0x7fb57c06aff0 2024-04-02T07:29:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb578c00640 1 -- 172.21.15.55:0/1753193752 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56c012750 con 0x7fb57c06aff0 2024-04-02T07:29:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb582e00640 1 -- 172.21.15.55:0/1753193752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57c156a20 con 0x7fb57c06aff0 2024-04-02T07:29:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb578c00640 1 -- 172.21.15.55:0/1753193752 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56c012ae0 con 0x7fb57c06aff0 2024-04-02T07:29:15.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb582e00640 1 -- 172.21.15.55:0/1753193752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57c156fe0 con 0x7fb57c06aff0 2024-04-02T07:29:15.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.226+0000 7fb582e00640 1 -- 172.21.15.55:0/1753193752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57c066c90 con 0x7fb57c06aff0 2024-04-02T07:29:15.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.230+0000 7fb578c00640 1 -- 172.21.15.55:0/1753193752 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb56c012c40 con 0x7fb57c06aff0 2024-04-02T07:29:15.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.230+0000 7fb578c00640 1 --2- 172.21.15.55:0/1753193752 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb558066690 0x7fb558068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:15.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.230+0000 7fb578c00640 1 -- 172.21.15.55:0/1753193752 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fb56c0845b0 con 0x7fb57c06aff0 2024-04-02T07:29:15.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.230+0000 7fb573e00640 1 --2- 172.21.15.55:0/1753193752 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb558066690 0x7fb558068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:15.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.230+0000 7fb573e00640 1 --2- 172.21.15.55:0/1753193752 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb558066690 0x7fb558068b50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb5640ad000 tx=0x7fb5640a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:15.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.234+0000 7fb578c00640 1 -- 172.21.15.55:0/1753193752 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fb56c0518e0 con 0x7fb57c06aff0 2024-04-02T07:29:15.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.426+0000 7fb582e00640 1 -- 172.21.15.55:0/1753193752 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb57c0af7c0 con 0x7fb57c06aff0 2024-04-02T07:29:15.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.426+0000 7fb578c00640 1 -- 172.21.15.55:0/1753193752 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4740 (secure 0 0 0) 0x7fb56c054f00 con 0x7fb57c06aff0 2024-04-02T07:29:15.430 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:29:15.430 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":63,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2209852195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2209852195},{"type":"v1","addr":"172.21.15.55:6835","nonce":2209852195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1897181831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1897181831},{"type":"v1","addr":"172.21.15.106:6835","nonce":1897181831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1894364429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1894364429},{"type":"v1","addr":"172.21.15.106:6837","nonce":1894364429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:28:53.919977+0000","modified":"2024-04-02T07:29:15.051665+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7455":{"gid":7455,"name":"a","rank":0,"incarnation":63,"state":"up:replay","state_seq":1,"addr":"172.21.15.55:6834/821922065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":821922065},{"type":"v1","addr":"172.21.15.55:6834","nonce":821922065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-02T07:29:15.430 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 63 2024-04-02T07:29:15.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.430+0000 7fb582e00640 1 -- 172.21.15.55:0/1753193752 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb558066690 msgr2=0x7fb558068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:15.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.430+0000 7fb582e00640 1 --2- 172.21.15.55:0/1753193752 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb558066690 0x7fb558068b50 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fb5640ad000 tx=0x7fb5640a6000 comp rx=0 tx=0).stop 2024-04-02T07:29:15.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.430+0000 7fb582e00640 1 -- 172.21.15.55:0/1753193752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb57c06aff0 msgr2=0x7fb57c157ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:15.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.430+0000 7fb582e00640 1 --2- 172.21.15.55:0/1753193752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb57c06aff0 0x7fb57c157ac0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fb56c00d5f0 tx=0x7fb56c00dab0 comp rx=0 tx=0).stop 2024-04-02T07:29:15.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.430+0000 7fb582e00640 1 -- 172.21.15.55:0/1753193752 shutdown_connections 2024-04-02T07:29:15.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.430+0000 7fb582e00640 1 --2- 172.21.15.55:0/1753193752 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb558066690 0x7fb558068b50 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:15.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.430+0000 7fb582e00640 1 --2- 172.21.15.55:0/1753193752 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb57c15ca70 0x7fb57c154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:15.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.430+0000 7fb582e00640 1 --2- 172.21.15.55:0/1753193752 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb57c098a10 0x7fb57c14b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:15.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.430+0000 7fb582e00640 1 --2- 172.21.15.55:0/1753193752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb57c06aff0 0x7fb57c157ac0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:15.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.430+0000 7fb582e00640 1 -- 172.21.15.55:0/1753193752 >> 172.21.15.55:0/1753193752 conn(0x7fb57c0b21d0 msgr2=0x7fb57c0ad270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:15.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.430+0000 7fb582e00640 1 -- 172.21.15.55:0/1753193752 shutdown_connections 2024-04-02T07:29:15.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:15.430+0000 7fb582e00640 1 -- 172.21.15.55:0/1753193752 wait complete. 2024-04-02T07:29:15.853 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:28:53.919977+0000', 'modified': '2024-04-02T07:29:15.051665+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 90, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7455}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7455': {'gid': 7455, 'name': 'a', 'rank': 0, 'incarnation': 63, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.55:6834/821922065', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 821922065}, {'type': 'v1', 'addr': '172.21.15.55:6834', 'nonce': 821922065}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:29:15.853 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7455:up:replay 2024-04-02T07:29:16.854 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:29:17.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.002+0000 7f2708e00640 1 Processor -- start 2024-04-02T07:29:17.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.006+0000 7f2708e00640 1 -- start start 2024-04-02T07:29:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.006+0000 7f2708e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2704098a10 0x7f2704098e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.006+0000 7f2708e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27040d01d0 con 0x7f27040cfdf0 2024-04-02T07:29:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.006+0000 7f2708e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2704099360 con 0x7f27040b16e0 2024-04-02T07:29:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.006+0000 7f2708e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f270406c0e0 con 0x7f2704098a10 2024-04-02T07:29:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.006+0000 7f2701e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f27040cfdf0 0x7f270406b8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41386/0 (socket says 172.21.15.55:41386) 2024-04-02T07:29:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.006+0000 7f2701e00640 1 -- 172.21.15.55:0/685529979 learned_addr learned my addr 172.21.15.55:0/685529979 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:29:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.006+0000 7f2702800640 1 --2- 172.21.15.55:0/685529979 >> v2:172.21.15.55:3300/0 conn(0x7f2704098a10 0x7f2704098e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.006+0000 7f2702800640 1 -- 172.21.15.55:0/685529979 >> v1:172.21.15.106:6789/0 conn(0x7f27040b16e0 legacy=0x7f27040b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.006+0000 7f2702800640 1 -- 172.21.15.55:0/685529979 >> v1:172.21.15.55:6789/0 conn(0x7f27040cfdf0 legacy=0x7f270406b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.006+0000 7f2702800640 1 -- 172.21.15.55:0/685529979 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27040b01d0 con 0x7f2704098a10 2024-04-02T07:29:17.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.010+0000 7f2702800640 1 --2- 172.21.15.55:0/685529979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2704098a10 0x7f2704098e20 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009d90 tx=0x7f26fc01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce8fb74940901e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:17.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.010+0000 7f2701400640 1 -- 172.21.15.55:0/685529979 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc0a59c0 con 0x7f2704098a10 2024-04-02T07:29:17.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.010+0000 7f2701400640 1 -- 172.21.15.55:0/685529979 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26fc0a5b20 con 0x7f2704098a10 2024-04-02T07:29:17.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.010+0000 7f2701400640 1 -- 172.21.15.55:0/685529979 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26fc0ad440 con 0x7f2704098a10 2024-04-02T07:29:17.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.010+0000 7f2708e00640 1 -- 172.21.15.55:0/685529979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2704098a10 msgr2=0x7f2704098e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:17.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.010+0000 7f2708e00640 1 --2- 172.21.15.55:0/685529979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2704098a10 0x7f2704098e20 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f26fc009d90 tx=0x7f26fc01c900 comp rx=0 tx=0).stop 2024-04-02T07:29:17.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.010+0000 7f2708e00640 1 -- 172.21.15.55:0/685529979 shutdown_connections 2024-04-02T07:29:17.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.010+0000 7f2708e00640 1 --2- 172.21.15.55:0/685529979 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2704098a10 0x7f2704098e20 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:17.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.010+0000 7f2708e00640 1 -- 172.21.15.55:0/685529979 >> 172.21.15.55:0/685529979 conn(0x7f27040b2210 msgr2=0x7f27040b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:17.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.010+0000 7f2708e00640 1 -- 172.21.15.55:0/685529979 shutdown_connections 2024-04-02T07:29:17.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.010+0000 7f2708e00640 1 -- 172.21.15.55:0/685529979 wait complete. 2024-04-02T07:29:17.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.010+0000 7f2708e00640 1 Processor -- start 2024-04-02T07:29:17.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.010+0000 7f2708e00640 1 -- start start 2024-04-02T07:29:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f2708e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2704098a10 0x7f27041459d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f2708e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27040b16e0 0x7f27040cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f2708e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27040cfdf0 0x7f27040cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f2708e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2704158c80 con 0x7f2704098a10 2024-04-02T07:29:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f2708e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2704158980 con 0x7f27040cfdf0 2024-04-02T07:29:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f2708e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27041594d0 con 0x7f27040b16e0 2024-04-02T07:29:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f2701e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2704098a10 0x7f27041459d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f2701e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2704098a10 0x7f27041459d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50622/0 (socket says 172.21.15.55:50622) 2024-04-02T07:29:17.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f2701e00640 1 -- 172.21.15.55:0/2840196446 learned_addr learned my addr 172.21.15.55:0/2840196446 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:17.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f2702800640 1 --2- 172.21.15.55:0/2840196446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27040cfdf0 0x7f27040cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:17.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f26fbe00640 1 --2- 172.21.15.55:0/2840196446 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27040b16e0 0x7f27040cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:17.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f2701e00640 1 -- 172.21.15.55:0/2840196446 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27040b16e0 msgr2=0x7f27040cda60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:17.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f2701e00640 1 --2- 172.21.15.55:0/2840196446 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27040b16e0 0x7f27040cda60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:17.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f2701e00640 1 -- 172.21.15.55:0/2840196446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27040cfdf0 msgr2=0x7f27040cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:17.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f2701e00640 1 --2- 172.21.15.55:0/2840196446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27040cfdf0 0x7f27040cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:17.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f2701e00640 1 -- 172.21.15.55:0/2840196446 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26fc009a70 con 0x7f2704098a10 2024-04-02T07:29:17.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f2701e00640 1 --2- 172.21.15.55:0/2840196446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2704098a10 0x7f27041459d0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f26f400c430 tx=0x7f26f400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:17.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f26fa000640 1 -- 172.21.15.55:0/2840196446 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f4005cf0 con 0x7f2704098a10 2024-04-02T07:29:17.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f26fa000640 1 -- 172.21.15.55:0/2840196446 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26f4005e50 con 0x7f2704098a10 2024-04-02T07:29:17.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f26fa000640 1 -- 172.21.15.55:0/2840196446 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26f40072d0 con 0x7f2704098a10 2024-04-02T07:29:17.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f2708e00640 1 -- 172.21.15.55:0/2840196446 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27041597b0 con 0x7f2704098a10 2024-04-02T07:29:17.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f2708e00640 1 -- 172.21.15.55:0/2840196446 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2704159a90 con 0x7f2704098a10 2024-04-02T07:29:17.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f2708e00640 1 -- 172.21.15.55:0/2840196446 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2704066c90 con 0x7f2704098a10 2024-04-02T07:29:17.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.014+0000 7f26fa000640 1 -- 172.21.15.55:0/2840196446 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f26f4007430 con 0x7f2704098a10 2024-04-02T07:29:17.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.018+0000 7f26fa000640 1 --2- 172.21.15.55:0/2840196446 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f26e0066690 0x7f26e0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:17.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.018+0000 7f26fa000640 1 -- 172.21.15.55:0/2840196446 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f26f4083530 con 0x7f2704098a10 2024-04-02T07:29:17.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.018+0000 7f26fbe00640 1 --2- 172.21.15.55:0/2840196446 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f26e0066690 0x7f26e0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:17.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.018+0000 7f26fbe00640 1 --2- 172.21.15.55:0/2840196446 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f26e0066690 0x7f26e0068b50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f27040af360 tx=0x7f26ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:17.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.022+0000 7f26fa000640 1 -- 172.21.15.55:0/2840196446 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f26f40508f0 con 0x7f2704098a10 2024-04-02T07:29:17.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.218+0000 7f2708e00640 1 -- 172.21.15.55:0/2840196446 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f27040d01d0 con 0x7f2704098a10 2024-04-02T07:29:17.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.218+0000 7f26fa000640 1 -- 172.21.15.55:0/2840196446 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+4740 (secure 0 0 0) 0x7f27040d01d0 con 0x7f2704098a10 2024-04-02T07:29:17.220 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:29:17.220 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":65,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2209852195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2209852195},{"type":"v1","addr":"172.21.15.55:6835","nonce":2209852195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1897181831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1897181831},{"type":"v1","addr":"172.21.15.106:6835","nonce":1897181831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1894364429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1894364429},{"type":"v1","addr":"172.21.15.106:6837","nonce":1894364429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":65,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:28:53.919977+0000","modified":"2024-04-02T07:29:17.056875+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7455":{"gid":7455,"name":"a","rank":0,"incarnation":63,"state":"up:rejoin","state_seq":9,"addr":"172.21.15.55:6834/821922065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":821922065},{"type":"v1","addr":"172.21.15.55:6834","nonce":821922065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-02T07:29:17.221 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 65 2024-04-02T07:29:17.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.218+0000 7f2708e00640 1 -- 172.21.15.55:0/2840196446 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f26e0066690 msgr2=0x7f26e0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:17.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.218+0000 7f2708e00640 1 --2- 172.21.15.55:0/2840196446 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f26e0066690 0x7f26e0068b50 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f27040af360 tx=0x7f26ec008040 comp rx=0 tx=0).stop 2024-04-02T07:29:17.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.218+0000 7f2708e00640 1 -- 172.21.15.55:0/2840196446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2704098a10 msgr2=0x7f27041459d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:17.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.218+0000 7f2708e00640 1 --2- 172.21.15.55:0/2840196446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2704098a10 0x7f27041459d0 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f26f400c430 tx=0x7f26f400c8f0 comp rx=0 tx=0).stop 2024-04-02T07:29:17.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.222+0000 7f2708e00640 1 -- 172.21.15.55:0/2840196446 shutdown_connections 2024-04-02T07:29:17.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.222+0000 7f2708e00640 1 --2- 172.21.15.55:0/2840196446 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f26e0066690 0x7f26e0068b50 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:17.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.222+0000 7f2708e00640 1 --2- 172.21.15.55:0/2840196446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f27040cfdf0 0x7f27040cb990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:17.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.222+0000 7f2708e00640 1 --2- 172.21.15.55:0/2840196446 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f27040b16e0 0x7f27040cda60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:17.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.222+0000 7f2708e00640 1 --2- 172.21.15.55:0/2840196446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2704098a10 0x7f27041459d0 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:17.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.222+0000 7f2708e00640 1 -- 172.21.15.55:0/2840196446 >> 172.21.15.55:0/2840196446 conn(0x7f27040b2210 msgr2=0x7f27040b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:17.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.222+0000 7f2708e00640 1 -- 172.21.15.55:0/2840196446 shutdown_connections 2024-04-02T07:29:17.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:17.222+0000 7f2708e00640 1 -- 172.21.15.55:0/2840196446 wait complete. 2024-04-02T07:29:17.644 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 65, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:28:53.919977+0000', 'modified': '2024-04-02T07:29:17.056875+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 90, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7455}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7455': {'gid': 7455, 'name': 'a', 'rank': 0, 'incarnation': 63, 'state': 'up:rejoin', 'state_seq': 9, 'addr': '172.21.15.55:6834/821922065', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 821922065}, {'type': 'v1', 'addr': '172.21.15.55:6834', 'nonce': 821922065}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:29:17.644 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_7455:up:rejoin 2024-04-02T07:29:18.645 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:29:18.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.794+0000 7f8b92e00640 1 Processor -- start 2024-04-02T07:29:18.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.794+0000 7f8b92e00640 1 -- start start 2024-04-02T07:29:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.794+0000 7f8b92e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b8c0b26b0 0x7f8b8c0b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.794+0000 7f8b92e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b8c15d950 con 0x7f8b8c157350 2024-04-02T07:29:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.794+0000 7f8b92e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b8c15dc30 con 0x7f8b8c156f70 2024-04-02T07:29:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.794+0000 7f8b92e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c15df10 con 0x7f8b8c0b26b0 2024-04-02T07:29:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.794+0000 7f8b83400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8b8c157350 0x7f8b8c0cfd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41390/0 (socket says 172.21.15.55:41390) 2024-04-02T07:29:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.794+0000 7f8b83400640 1 -- 172.21.15.55:0/3988541107 learned_addr learned my addr 172.21.15.55:0/3988541107 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:29:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.794+0000 7f8b90e00640 1 --2- 172.21.15.55:0/3988541107 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b8c0b26b0 0x7f8b8c0b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:18.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b8b400640 1 -- 172.21.15.55:0/3988541107 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439295556 0 0) 0x7f8b8c15d950 con 0x7f8b8c157350 2024-04-02T07:29:18.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b8b400640 1 -- 172.21.15.55:0/3988541107 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b70003530 con 0x7f8b8c157350 2024-04-02T07:29:18.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b8b400640 1 -- 172.21.15.55:0/3988541107 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028554778 0 0) 0x7f8b8c15dc30 con 0x7f8b8c156f70 2024-04-02T07:29:18.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b8b400640 1 -- 172.21.15.55:0/3988541107 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b8c15d950 con 0x7f8b8c156f70 2024-04-02T07:29:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b8b400640 1 -- 172.21.15.55:0/3988541107 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 75257192 0 0) 0x7f8b70003530 con 0x7f8b8c157350 2024-04-02T07:29:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b8b400640 1 -- 172.21.15.55:0/3988541107 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b8c0b26b0 msgr2=0x7f8b8c0b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b8b400640 1 --2- 172.21.15.55:0/3988541107 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b8c0b26b0 0x7f8b8c0b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b8b400640 1 -- 172.21.15.55:0/3988541107 >> v1:172.21.15.106:6789/0 conn(0x7f8b8c156f70 legacy=0x7f8b8c15d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b8b400640 1 -- 172.21.15.55:0/3988541107 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c0cf560 con 0x7f8b8c157350 2024-04-02T07:29:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b8b400640 1 -- 172.21.15.55:0/3988541107 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f8b74001680 con 0x7f8b8c157350 2024-04-02T07:29:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b8b400640 1 -- 172.21.15.55:0/3988541107 >> v1:172.21.15.55:6789/0 conn(0x7f8b8c157350 legacy=0x7f8b8c0cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b8b400640 1 --2- 172.21.15.55:0/3988541107 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b70003b40 0x7f8b70003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b8b400640 1 --2- 172.21.15.55:0/3988541107 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b8c0b26b0 0x7f8b700047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b8b400640 1 --2- 172.21.15.55:0/3988541107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b70004d10 0x7f8b70005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b8b400640 1 -- 172.21.15.55:0/3988541107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c15df10 con 0x7f8b70004d10 2024-04-02T07:29:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b8b400640 1 -- 172.21.15.55:0/3988541107 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7000ba40 con 0x7f8b70003b40 2024-04-02T07:29:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b8b400640 1 -- 172.21.15.55:0/3988541107 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b7000bc00 con 0x7f8b8c0b26b0 2024-04-02T07:29:18.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b90e00640 1 --2- 172.21.15.55:0/3988541107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b70004d10 0x7f8b70005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:18.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b8be00640 1 --2- 172.21.15.55:0/3988541107 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b70003b40 0x7f8b70003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:18.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b83400640 1 --2- 172.21.15.55:0/3988541107 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b8c0b26b0 0x7f8b700047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:18.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b90e00640 1 -- 172.21.15.55:0/3988541107 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b8c0b26b0 msgr2=0x7f8b700047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:18.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b90e00640 1 --2- 172.21.15.55:0/3988541107 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b8c0b26b0 0x7f8b700047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:18.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b90e00640 1 -- 172.21.15.55:0/3988541107 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b70003b40 msgr2=0x7f8b70003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:18.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b90e00640 1 --2- 172.21.15.55:0/3988541107 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b70003b40 0x7f8b70003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:18.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.798+0000 7f8b90e00640 1 -- 172.21.15.55:0/3988541107 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b70003530 con 0x7f8b70004d10 2024-04-02T07:29:18.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b90e00640 1 --2- 172.21.15.55:0/3988541107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b70004d10 0x7f8b70005190 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f8b84009fc0 tx=0x7f8b8401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3481f69faefbbda server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:18.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b8b400640 1 -- 172.21.15.55:0/3988541107 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b840a5b80 con 0x7f8b70004d10 2024-04-02T07:29:18.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b8b400640 1 -- 172.21.15.55:0/3988541107 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b8400f040 con 0x7f8b70004d10 2024-04-02T07:29:18.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b8b400640 1 -- 172.21.15.55:0/3988541107 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b840ad440 con 0x7f8b70004d10 2024-04-02T07:29:18.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b92e00640 1 -- 172.21.15.55:0/3988541107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b70004d10 msgr2=0x7f8b70005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:18.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b92e00640 1 --2- 172.21.15.55:0/3988541107 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b70004d10 0x7f8b70005190 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f8b84009fc0 tx=0x7f8b8401cc80 comp rx=0 tx=0).stop 2024-04-02T07:29:18.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b90e00640 1 -- 172.21.15.55:0/3988541107 reap_dead start 2024-04-02T07:29:18.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b92e00640 1 -- 172.21.15.55:0/3988541107 shutdown_connections 2024-04-02T07:29:18.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b92e00640 1 -- 172.21.15.55:0/3988541107 >> 172.21.15.55:0/3988541107 conn(0x7f8b8c0b13b0 msgr2=0x7f8b8c0b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:18.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b92e00640 1 -- 172.21.15.55:0/3988541107 shutdown_connections 2024-04-02T07:29:18.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b92e00640 1 -- 172.21.15.55:0/3988541107 wait complete. 2024-04-02T07:29:18.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b92e00640 1 Processor -- start 2024-04-02T07:29:18.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b92e00640 1 -- start start 2024-04-02T07:29:18.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b92e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b70004d10 0x7f8b8c1597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:18.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b92e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b8c0c9a80 0x7f8b8c148990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:18.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b92e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b8c069d90 0x7f8b8c06a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:18.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b92e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c06a750 con 0x7f8b8c0c9a80 2024-04-02T07:29:18.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b92e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c0cab00 con 0x7f8b70004d10 2024-04-02T07:29:18.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b92e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8c15b110 con 0x7f8b8c069d90 2024-04-02T07:29:18.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b83400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b8c0c9a80 0x7f8b8c148990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:18.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b83400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b8c0c9a80 0x7f8b8c148990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50640/0 (socket says 172.21.15.55:50640) 2024-04-02T07:29:18.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.802+0000 7f8b83400640 1 -- 172.21.15.55:0/2755143198 learned_addr learned my addr 172.21.15.55:0/2755143198 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:18.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.806+0000 7f8b8be00640 1 --2- 172.21.15.55:0/2755143198 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b70004d10 0x7f8b8c1597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:18.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.806+0000 7f8b90e00640 1 --2- 172.21.15.55:0/2755143198 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b8c069d90 0x7f8b8c06a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:18.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.806+0000 7f8b83400640 1 -- 172.21.15.55:0/2755143198 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b8c069d90 msgr2=0x7f8b8c06a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:18.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.806+0000 7f8b83400640 1 --2- 172.21.15.55:0/2755143198 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b8c069d90 0x7f8b8c06a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:18.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.806+0000 7f8b83400640 1 -- 172.21.15.55:0/2755143198 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b70004d10 msgr2=0x7f8b8c1597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:18.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.806+0000 7f8b83400640 1 --2- 172.21.15.55:0/2755143198 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b70004d10 0x7f8b8c1597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:18.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.806+0000 7f8b83400640 1 -- 172.21.15.55:0/2755143198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8c0c9f80 con 0x7f8b8c0c9a80 2024-04-02T07:29:18.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.806+0000 7f8b8be00640 1 --2- 172.21.15.55:0/2755143198 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b70004d10 0x7f8b8c1597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:29:18.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.806+0000 7f8b83400640 1 --2- 172.21.15.55:0/2755143198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b8c0c9a80 0x7f8b8c148990 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f8b74012490 tx=0x7f8b74012950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:18.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.806+0000 7f8b88c00640 1 -- 172.21.15.55:0/2755143198 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74014810 con 0x7f8b8c0c9a80 2024-04-02T07:29:18.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.806+0000 7f8b88c00640 1 -- 172.21.15.55:0/2755143198 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b74014990 con 0x7f8b8c0c9a80 2024-04-02T07:29:18.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.806+0000 7f8b88c00640 1 -- 172.21.15.55:0/2755143198 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b74014d40 con 0x7f8b8c0c9a80 2024-04-02T07:29:18.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.806+0000 7f8b92e00640 1 -- 172.21.15.55:0/2755143198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8c0ca260 con 0x7f8b8c0c9a80 2024-04-02T07:29:18.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.806+0000 7f8b92e00640 1 -- 172.21.15.55:0/2755143198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b8c0ca820 con 0x7f8b8c0c9a80 2024-04-02T07:29:18.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.806+0000 7f8b92e00640 1 -- 172.21.15.55:0/2755143198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8c15b310 con 0x7f8b8c0c9a80 2024-04-02T07:29:18.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.806+0000 7f8b88c00640 1 -- 172.21.15.55:0/2755143198 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8b740153e0 con 0x7f8b8c0c9a80 2024-04-02T07:29:18.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.806+0000 7f8b88c00640 1 --2- 172.21.15.55:0/2755143198 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8b68066690 0x7f8b68068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:18.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.810+0000 7f8b88c00640 1 -- 172.21.15.55:0/2755143198 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f8b74086dd0 con 0x7f8b8c0c9a80 2024-04-02T07:29:18.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.810+0000 7f8b8be00640 1 --2- 172.21.15.55:0/2755143198 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8b68066690 0x7f8b68068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:18.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.810+0000 7f8b8be00640 1 --2- 172.21.15.55:0/2755143198 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8b68066690 0x7f8b68068b50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c007fd0 tx=0x7f8b7c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:18.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:18.814+0000 7f8b88c00640 1 -- 172.21.15.55:0/2755143198 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f8b8c15b310 con 0x7f8b8c0c9a80 2024-04-02T07:29:19.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.006+0000 7f8b92e00640 1 -- 172.21.15.55:0/2755143198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8b8c15b2d0 con 0x7f8b8c0c9a80 2024-04-02T07:29:19.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.006+0000 7f8b88c00640 1 -- 172.21.15.55:0/2755143198 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 66 v66) v1 ==== 94+0+4741 (secure 0 0 0) 0x7f8b7401c020 con 0x7f8b8c0c9a80 2024-04-02T07:29:19.008 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:29:19.008 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":66,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2209852195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2209852195},{"type":"v1","addr":"172.21.15.55:6835","nonce":2209852195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1897181831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1897181831},{"type":"v1","addr":"172.21.15.106:6835","nonce":1897181831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1894364429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1894364429},{"type":"v1","addr":"172.21.15.106:6837","nonce":1894364429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":66,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:28:53.919977+0000","modified":"2024-04-02T07:29:18.059559+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7455":{"gid":7455,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":10,"addr":"172.21.15.55:6834/821922065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":821922065},{"type":"v1","addr":"172.21.15.55:6834","nonce":821922065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-02T07:29:19.009 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 66 2024-04-02T07:29:19.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.006+0000 7f8b92e00640 1 -- 172.21.15.55:0/2755143198 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8b68066690 msgr2=0x7f8b68068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:19.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.006+0000 7f8b92e00640 1 --2- 172.21.15.55:0/2755143198 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8b68066690 0x7f8b68068b50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8b7c007fd0 tx=0x7f8b7c009040 comp rx=0 tx=0).stop 2024-04-02T07:29:19.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.006+0000 7f8b92e00640 1 -- 172.21.15.55:0/2755143198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b8c0c9a80 msgr2=0x7f8b8c148990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:19.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.006+0000 7f8b92e00640 1 --2- 172.21.15.55:0/2755143198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b8c0c9a80 0x7f8b8c148990 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f8b74012490 tx=0x7f8b74012950 comp rx=0 tx=0).stop 2024-04-02T07:29:19.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.006+0000 7f8b92e00640 1 -- 172.21.15.55:0/2755143198 shutdown_connections 2024-04-02T07:29:19.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.006+0000 7f8b92e00640 1 --2- 172.21.15.55:0/2755143198 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8b8c069d90 0x7f8b8c06a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.006+0000 7f8b92e00640 1 --2- 172.21.15.55:0/2755143198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8b8c0c9a80 0x7f8b8c148990 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.006+0000 7f8b92e00640 1 --2- 172.21.15.55:0/2755143198 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8b68066690 0x7f8b68068b50 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.006+0000 7f8b92e00640 1 --2- 172.21.15.55:0/2755143198 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8b70004d10 0x7f8b8c1597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.006+0000 7f8b92e00640 1 -- 172.21.15.55:0/2755143198 >> 172.21.15.55:0/2755143198 conn(0x7f8b8c0b13b0 msgr2=0x7f8b8c15cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:19.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.010+0000 7f8b92e00640 1 -- 172.21.15.55:0/2755143198 shutdown_connections 2024-04-02T07:29:19.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.010+0000 7f8b92e00640 1 -- 172.21.15.55:0/2755143198 wait complete. 2024-04-02T07:29:19.434 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 66, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:28:53.919977+0000', 'modified': '2024-04-02T07:29:18.059559+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 90, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7455}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7455': {'gid': 7455, 'name': 'a', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.55:6834/821922065', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 821922065}, {'type': 'v1', 'addr': '172.21.15.55:6834', 'nonce': 821922065}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:29:19.434 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-02T07:29:19.434 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-02T07:29:19.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.574+0000 7fc8e6a00640 1 Processor -- start 2024-04-02T07:29:19.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.574+0000 7fc8e6a00640 1 -- start start 2024-04-02T07:29:19.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.578+0000 7fc8e6a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc8e0160230 0x7fc8e00b1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.578+0000 7fc8e6a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc8e006bac0 0x7fc8e00cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.578+0000 7fc8e6a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e00ce990 con 0x7fc8e00cb1f0 2024-04-02T07:29:19.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.578+0000 7fc8e6a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e0160610 con 0x7fc8e0160230 2024-04-02T07:29:19.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.578+0000 7fc8e6a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e00cf4f0 con 0x7fc8e006bac0 2024-04-02T07:29:19.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.578+0000 7fc8dfe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc8e0160230 0x7fc8e00b1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.578+0000 7fc8e4a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc8e00cb1f0 0x7fc8e00cf980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41404/0 (socket says 172.21.15.55:41404) 2024-04-02T07:29:19.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.578+0000 7fc8e4a00640 1 -- 172.21.15.55:0/3369829190 learned_addr learned my addr 172.21.15.55:0/3369829190 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:29:19.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.578+0000 7fc8d7e00640 1 --2- 172.21.15.55:0/3369829190 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc8e006bac0 0x7fc8e00cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.578+0000 7fc8dfe00640 1 -- 172.21.15.55:0/3369829190 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc8e006bac0 msgr2=0x7fc8e00cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:19.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.578+0000 7fc8dfe00640 1 --2- 172.21.15.55:0/3369829190 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc8e006bac0 0x7fc8e00cacb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.578+0000 7fc8dfe00640 1 -- 172.21.15.55:0/3369829190 >> v1:172.21.15.55:6789/0 conn(0x7fc8e00cb1f0 legacy=0x7fc8e00cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:19.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.578+0000 7fc8df400640 1 -- 172.21.15.55:0/3369829190 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 693870794 0 0) 0x7fc8e00ce990 con 0x7fc8e00cb1f0 2024-04-02T07:29:19.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.578+0000 7fc8dfe00640 1 -- 172.21.15.55:0/3369829190 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e00cebc0 con 0x7fc8e0160230 2024-04-02T07:29:19.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.582+0000 7fc8dfe00640 1 --2- 172.21.15.55:0/3369829190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8e0160230 0x7fc8e00b1650 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00097c0 tx=0x7fc8d001c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c8bc6c7e7218566 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:19.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.582+0000 7fc8df400640 1 -- 172.21.15.55:0/3369829190 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d00ac640 con 0x7fc8e0160230 2024-04-02T07:29:19.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.582+0000 7fc8df400640 1 -- 172.21.15.55:0/3369829190 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d00ac7a0 con 0x7fc8e0160230 2024-04-02T07:29:19.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.582+0000 7fc8df400640 1 -- 172.21.15.55:0/3369829190 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d00acb30 con 0x7fc8e0160230 2024-04-02T07:29:19.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.582+0000 7fc8e6a00640 1 -- 172.21.15.55:0/3369829190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8e0160230 msgr2=0x7fc8e00b1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:19.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.582+0000 7fc8e6a00640 1 --2- 172.21.15.55:0/3369829190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8e0160230 0x7fc8e00b1650 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00097c0 tx=0x7fc8d001c3e0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.582+0000 7fc8e6a00640 1 -- 172.21.15.55:0/3369829190 shutdown_connections 2024-04-02T07:29:19.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.582+0000 7fc8e6a00640 1 --2- 172.21.15.55:0/3369829190 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc8e006bac0 0x7fc8e00cacb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.582+0000 7fc8e6a00640 1 --2- 172.21.15.55:0/3369829190 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8e0160230 0x7fc8e00b1650 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.582+0000 7fc8e6a00640 1 -- 172.21.15.55:0/3369829190 >> 172.21.15.55:0/3369829190 conn(0x7fc8e00b2150 msgr2=0x7fc8e00b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:19.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.582+0000 7fc8e6a00640 1 -- 172.21.15.55:0/3369829190 shutdown_connections 2024-04-02T07:29:19.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.582+0000 7fc8e6a00640 1 -- 172.21.15.55:0/3369829190 wait complete. 2024-04-02T07:29:19.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.582+0000 7fc8e6a00640 1 Processor -- start 2024-04-02T07:29:19.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.582+0000 7fc8e6a00640 1 -- start start 2024-04-02T07:29:19.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8e6a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc8e006bac0 0x7fc8e00b56c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8e6a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8e00cb1f0 0x7fc8e015c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8e6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc8e0160230 0x7fc8e015cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8e6a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e0155b10 con 0x7fc8e00cb1f0 2024-04-02T07:29:19.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8e6a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e00b5230 con 0x7fc8e0160230 2024-04-02T07:29:19.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8e6a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e00b4620 con 0x7fc8e006bac0 2024-04-02T07:29:19.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8d7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8e00cb1f0 0x7fc8e015c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8d7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8e00cb1f0 0x7fc8e015c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50668/0 (socket says 172.21.15.55:50668) 2024-04-02T07:29:19.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8d7e00640 1 -- 172.21.15.55:0/3784924238 learned_addr learned my addr 172.21.15.55:0/3784924238 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:19.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8dfe00640 1 --2- 172.21.15.55:0/3784924238 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc8e006bac0 0x7fc8e00b56c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8e4a00640 1 --2- 172.21.15.55:0/3784924238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc8e0160230 0x7fc8e015cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8d7e00640 1 -- 172.21.15.55:0/3784924238 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc8e006bac0 msgr2=0x7fc8e00b56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:19.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8d7e00640 1 --2- 172.21.15.55:0/3784924238 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc8e006bac0 0x7fc8e00b56c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8d7e00640 1 -- 172.21.15.55:0/3784924238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc8e0160230 msgr2=0x7fc8e015cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:19.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8d7e00640 1 --2- 172.21.15.55:0/3784924238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc8e0160230 0x7fc8e015cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8d7e00640 1 -- 172.21.15.55:0/3784924238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d0009420 con 0x7fc8e00cb1f0 2024-04-02T07:29:19.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8d7e00640 1 --2- 172.21.15.55:0/3784924238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8e00cb1f0 0x7fc8e015c820 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800d5f0 tx=0x7fc8c800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:19.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8dcc00640 1 -- 172.21.15.55:0/3784924238 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c80125f0 con 0x7fc8e00cb1f0 2024-04-02T07:29:19.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8dcc00640 1 -- 172.21.15.55:0/3784924238 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c8012750 con 0x7fc8e00cb1f0 2024-04-02T07:29:19.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8dcc00640 1 -- 172.21.15.55:0/3784924238 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8012ae0 con 0x7fc8e00cb1f0 2024-04-02T07:29:19.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8e6a00640 1 -- 172.21.15.55:0/3784924238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e00b4900 con 0x7fc8e00cb1f0 2024-04-02T07:29:19.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8e6a00640 1 -- 172.21.15.55:0/3784924238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e00b4ec0 con 0x7fc8e00cb1f0 2024-04-02T07:29:19.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.586+0000 7fc8dcc00640 1 -- 172.21.15.55:0/3784924238 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc8c8012c40 con 0x7fc8e00cb1f0 2024-04-02T07:29:19.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8dcc00640 1 --2- 172.21.15.55:0/3784924238 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc8bc0666c0 0x7fc8bc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8dcc00640 1 -- 172.21.15.55:0/3784924238 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fc8c8084640 con 0x7fc8e00cb1f0 2024-04-02T07:29:19.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8dfe00640 1 --2- 172.21.15.55:0/3784924238 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc8bc0666c0 0x7fc8bc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8e9e62000 1 Processor -- start 2024-04-02T07:29:19.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8e9e62000 1 -- start start 2024-04-02T07:29:19.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8dfe00640 1 --2- 172.21.15.55:0/3784924238 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc8bc0666c0 0x7fc8bc068b80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00ae000 tx=0x7fc8d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:19.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8e9e62000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b0e2db0 0x55f49b0e3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8e9e62000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b0e36d0 0x55f49b098f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8e9e62000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0994c0 0x55f49b0998a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8e9e62000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f49af615a0 con 0x55f49b0994c0 2024-04-02T07:29:19.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8e9e62000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f49aeeeaf0 con 0x55f49b0e36d0 2024-04-02T07:29:19.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8e9e62000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f49aeec0c0 con 0x55f49b0e2db0 2024-04-02T07:29:19.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8e4a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0994c0 0x55f49b0998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8e4a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0994c0 0x55f49b0998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50680/0 (socket says 172.21.15.55:50680) 2024-04-02T07:29:19.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8e4a00640 1 -- 172.21.15.55:0/1089523095 learned_addr learned my addr 172.21.15.55:0/1089523095 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:19.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8d7e00640 1 --2- 172.21.15.55:0/1089523095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b0e36d0 0x55f49b098f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8dfe00640 1 --2- 172.21.15.55:0/1089523095 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b0e2db0 0x55f49b0e3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8e4a00640 1 -- 172.21.15.55:0/1089523095 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b0e2db0 msgr2=0x55f49b0e3190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:19.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8e4a00640 1 --2- 172.21.15.55:0/1089523095 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b0e2db0 0x55f49b0e3190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8e4a00640 1 -- 172.21.15.55:0/1089523095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b0e36d0 msgr2=0x55f49b098f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:19.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8e4a00640 1 --2- 172.21.15.55:0/1089523095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b0e36d0 0x55f49b098f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8e4a00640 1 -- 172.21.15.55:0/1089523095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f49abe3890 con 0x55f49b0994c0 2024-04-02T07:29:19.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8e4a00640 1 --2- 172.21.15.55:0/1089523095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0994c0 0x55f49b0998a0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80072e0 tx=0x7fc8d80077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aef54892172e4a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:19.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8d4c00640 1 -- 172.21.15.55:0/1089523095 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8004d80 con 0x55f49b0994c0 2024-04-02T07:29:19.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8d4c00640 1 -- 172.21.15.55:0/1089523095 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8d8001bc0 con 0x55f49b0994c0 2024-04-02T07:29:19.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8d4c00640 1 -- 172.21.15.55:0/1089523095 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8001f70 con 0x55f49b0994c0 2024-04-02T07:29:19.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8e9e62000 1 -- 172.21.15.55:0/1089523095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0994c0 msgr2=0x55f49b0998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:19.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.590+0000 7fc8e9e62000 1 --2- 172.21.15.55:0/1089523095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0994c0 0x55f49b0998a0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80072e0 tx=0x7fc8d80077a0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 1 -- 172.21.15.55:0/1089523095 shutdown_connections 2024-04-02T07:29:19.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 1 --2- 172.21.15.55:0/1089523095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0994c0 0x55f49b0998a0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 1 --2- 172.21.15.55:0/1089523095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b0e36d0 0x55f49b098f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 1 --2- 172.21.15.55:0/1089523095 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b0e2db0 0x55f49b0e3190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 1 -- 172.21.15.55:0/1089523095 >> 172.21.15.55:0/1089523095 conn(0x55f49b09f830 msgr2=0x55f49b097860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:19.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 1 -- 172.21.15.55:0/1089523095 shutdown_connections 2024-04-02T07:29:19.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 1 -- 172.21.15.55:0/1089523095 wait complete. 2024-04-02T07:29:19.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 1 -- start start 2024-04-02T07:29:19.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 1 Processor -- start 2024-04-02T07:29:19.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b0994c0 0x55f49b09dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b0e2db0 0x55f49b09e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0e36d0 0x55f49b0e3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f49aee79b0 con 0x55f49b0e36d0 2024-04-02T07:29:19.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f49ae86c00 con 0x55f49b0e2db0 2024-04-02T07:29:19.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f49aea5070 con 0x55f49b0994c0 2024-04-02T07:29:19.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 10 client.0 _ll_register_callbacks cb 0x55f49b0850e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:29:19.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e4a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0e36d0 0x55f49b0e3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e4a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0e36d0 0x55f49b0e3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50696/0 (socket says 172.21.15.55:50696) 2024-04-02T07:29:19.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e4a00640 1 -- 172.21.15.55:0/1412894534 learned_addr learned my addr 172.21.15.55:0/1412894534 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:19.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8d7e00640 1 --2- 172.21.15.55:0/1412894534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b0e2db0 0x55f49b09e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8dfe00640 1 --2- 172.21.15.55:0/1412894534 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b0994c0 0x55f49b09dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e4a00640 1 -- 172.21.15.55:0/1412894534 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b0994c0 msgr2=0x55f49b09dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:19.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e4a00640 1 --2- 172.21.15.55:0/1412894534 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b0994c0 0x55f49b09dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e4a00640 1 -- 172.21.15.55:0/1412894534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b0e2db0 msgr2=0x55f49b09e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:19.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e4a00640 1 --2- 172.21.15.55:0/1412894534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b0e2db0 0x55f49b09e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e4a00640 1 -- 172.21.15.55:0/1412894534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8d800f040 con 0x55f49b0e36d0 2024-04-02T07:29:19.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e4a00640 1 --2- 172.21.15.55:0/1412894534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0e36d0 0x55f49b0e3ab0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80077e0 tx=0x7fc8d8007da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b07ded2378140f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:19.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8cd600640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:29:19.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8cd600640 1 -- 172.21.15.55:0/1412894534 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8001dd0 con 0x55f49b0e36d0 2024-04-02T07:29:19.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8cd600640 1 -- 172.21.15.55:0/1412894534 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fc8d8001f30 con 0x55f49b0e36d0 2024-04-02T07:29:19.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 1 -- 172.21.15.55:0/1412894534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f49aea45f0 con 0x55f49b0e36d0 2024-04-02T07:29:19.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8cd600640 1 -- 172.21.15.55:0/1412894534 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8d80020f0 con 0x55f49b0e36d0 2024-04-02T07:29:19.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 10 client.7773 fetch_fsmap learned FSMap version 66 2024-04-02T07:29:19.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 1 -- 172.21.15.55:0/1412894534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x55f49aeacab0 con 0x55f49b0e36d0 2024-04-02T07:29:19.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8cd600640 1 -- 172.21.15.55:0/1412894534 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f49aea45f0 con 0x55f49b0e36d0 2024-04-02T07:29:19.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8cd600640 1 -- 172.21.15.55:0/1412894534 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 66) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc8d801b070 con 0x55f49b0e36d0 2024-04-02T07:29:19.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 10 client.7773 fetch_fsmap finished waiting for FSMap version 66 2024-04-02T07:29:19.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 10 client.7773 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:29:19.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 20 client.7773 populate_metadata read hostname 'smithi055' 2024-04-02T07:29:19.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 1 --2- 172.21.15.55:0/1412894534 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55f49b0e44c0 0x55f49b0f3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 4 client.7773 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:29:19.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.594+0000 7fc8e9e62000 1 -- 172.21.15.55:0/1412894534 --> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f49aee4790 con 0x55f49b0e44c0 2024-04-02T07:29:19.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.598+0000 7fc8dfe00640 1 --2- 172.21.15.55:0/1412894534 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55f49b0e44c0 0x55f49b0f3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.598+0000 7fc8dfe00640 1 --2- 172.21.15.55:0/1412894534 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55f49b0e44c0 0x55f49b0f3e50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1507d77f178a9eef server_cookie=a38e89ab37a90163 in_seq=0 out_seq=0 2024-04-02T07:29:19.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.598+0000 7fc8cd600640 10 client.7773 ms_handle_connect on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:19.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.598+0000 7fc8cd600640 1 -- 172.21.15.55:0/1412894534 <== mds.0 v2:172.21.15.55:6832/821922065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55f49aee4790 con 0x55f49b0e44c0 2024-04-02T07:29:19.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.598+0000 7fc8cd600640 10 client.7773 handle_command_reply: tid=0 2024-04-02T07:29:19.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.598+0000 7fc8e9e62000 1 client.7773 shutdown 2024-04-02T07:29:19.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.598+0000 7fc8e9e62000 1 -- 172.21.15.55:0/1412894534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0e36d0 msgr2=0x55f49b0e3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:19.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.598+0000 7fc8e9e62000 1 --2- 172.21.15.55:0/1412894534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0e36d0 0x55f49b0e3ab0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fc8d80077e0 tx=0x7fc8d8007da0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.598+0000 7fc8e9e62000 1 -- 172.21.15.55:0/1412894534 shutdown_connections 2024-04-02T07:29:19.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.598+0000 7fc8e9e62000 1 --2- 172.21.15.55:0/1412894534 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55f49b0e44c0 0x55f49b0f3e50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.598+0000 7fc8e9e62000 1 --2- 172.21.15.55:0/1412894534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0e36d0 0x55f49b0e3ab0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.598+0000 7fc8e9e62000 1 --2- 172.21.15.55:0/1412894534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b0e2db0 0x55f49b09e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.598+0000 7fc8e9e62000 1 --2- 172.21.15.55:0/1412894534 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b0994c0 0x55f49b09dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.598+0000 7fc8e9e62000 1 -- 172.21.15.55:0/1412894534 >> 172.21.15.55:0/1412894534 conn(0x55f49b09f830 msgr2=0x55f49b097f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:19.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.598+0000 7fc8cd600640 0 client.7773 ms_handle_reset on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:19.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.598+0000 7fc8e9e62000 1 -- 172.21.15.55:0/1412894534 shutdown_connections 2024-04-02T07:29:19.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.598+0000 7fc8e9e62000 1 -- 172.21.15.55:0/1412894534 wait complete. 2024-04-02T07:29:19.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.598+0000 7fc8e9e62000 20 client.7773 trim_cache size 0 max 16384 2024-04-02T07:29:19.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8e9e62000 1 Processor -- start 2024-04-02T07:29:19.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8e9e62000 1 -- start start 2024-04-02T07:29:19.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8e9e62000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b09f830 0x55f49b0e17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8e9e62000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0994c0 0x55f49b0e1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8e9e62000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b0e2db0 0x55f49b0f1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8e9e62000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f49aba4940 con 0x55f49b0994c0 2024-04-02T07:29:19.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8e9e62000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f49aee51c0 con 0x55f49b09f830 2024-04-02T07:29:19.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8e9e62000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f49ae84c10 con 0x55f49b0e2db0 2024-04-02T07:29:19.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8d7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0994c0 0x55f49b0e1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8d7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0994c0 0x55f49b0e1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50710/0 (socket says 172.21.15.55:50710) 2024-04-02T07:29:19.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8d7e00640 1 -- 172.21.15.55:0/647324749 learned_addr learned my addr 172.21.15.55:0/647324749 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:19.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8e4a00640 1 --2- 172.21.15.55:0/647324749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b0e2db0 0x55f49b0f1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8dfe00640 1 --2- 172.21.15.55:0/647324749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b09f830 0x55f49b0e17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8d7e00640 1 -- 172.21.15.55:0/647324749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b0e2db0 msgr2=0x55f49b0f1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:19.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8d7e00640 1 --2- 172.21.15.55:0/647324749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b0e2db0 0x55f49b0f1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8d7e00640 1 -- 172.21.15.55:0/647324749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b09f830 msgr2=0x55f49b0e17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:19.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8d7e00640 1 --2- 172.21.15.55:0/647324749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b09f830 0x55f49b0e17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8d7e00640 1 -- 172.21.15.55:0/647324749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f49ae92c00 con 0x55f49b0994c0 2024-04-02T07:29:19.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8d7e00640 1 --2- 172.21.15.55:0/647324749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0994c0 0x55f49b0e1ce0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80555a0 tx=0x7fc8c8084040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b01498817158ff server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:19.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8d5600640 1 -- 172.21.15.55:0/647324749 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c8059440 con 0x55f49b0994c0 2024-04-02T07:29:19.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8d5600640 1 -- 172.21.15.55:0/647324749 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8c805da00 con 0x55f49b0994c0 2024-04-02T07:29:19.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8d5600640 1 -- 172.21.15.55:0/647324749 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8c80590b0 con 0x55f49b0994c0 2024-04-02T07:29:19.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8e9e62000 1 -- 172.21.15.55:0/647324749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0994c0 msgr2=0x55f49b0e1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:19.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8e9e62000 1 --2- 172.21.15.55:0/647324749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0994c0 0x55f49b0e1ce0 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fc8c80555a0 tx=0x7fc8c8084040 comp rx=0 tx=0).stop 2024-04-02T07:29:19.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8e9e62000 1 -- 172.21.15.55:0/647324749 shutdown_connections 2024-04-02T07:29:19.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8e9e62000 1 --2- 172.21.15.55:0/647324749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b0e2db0 0x55f49b0f1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8e9e62000 1 --2- 172.21.15.55:0/647324749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0994c0 0x55f49b0e1ce0 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8e9e62000 1 --2- 172.21.15.55:0/647324749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b09f830 0x55f49b0e17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8e9e62000 1 -- 172.21.15.55:0/647324749 >> 172.21.15.55:0/647324749 conn(0x55f49b0ef760 msgr2=0x55f49b09da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:19.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8e9e62000 1 -- 172.21.15.55:0/647324749 shutdown_connections 2024-04-02T07:29:19.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.614+0000 7fc8e9e62000 1 -- 172.21.15.55:0/647324749 wait complete. 2024-04-02T07:29:19.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e9e62000 1 -- start start 2024-04-02T07:29:19.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e9e62000 1 Processor -- start 2024-04-02T07:29:19.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e9e62000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b0994c0 0x55f49b1405d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e9e62000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b09f830 0x55f49b0f4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e9e62000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0e2db0 0x55f49b0f5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e9e62000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f49b0ef620 con 0x55f49b0e2db0 2024-04-02T07:29:19.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e9e62000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f49ae8c4d0 con 0x55f49b0994c0 2024-04-02T07:29:19.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e9e62000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f49b0e22e0 con 0x55f49b09f830 2024-04-02T07:29:19.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e9e62000 10 client.0 _ll_register_callbacks cb 0x55f49aeac590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:29:19.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e4a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0e2db0 0x55f49b0f5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e4a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0e2db0 0x55f49b0f5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50720/0 (socket says 172.21.15.55:50720) 2024-04-02T07:29:19.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e4a00640 1 -- 172.21.15.55:0/2146049305 learned_addr learned my addr 172.21.15.55:0/2146049305 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:19.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8d7e00640 1 --2- 172.21.15.55:0/2146049305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b09f830 0x55f49b0f4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e4a00640 1 -- 172.21.15.55:0/2146049305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b09f830 msgr2=0x55f49b0f4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:19.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8dfe00640 1 --2- 172.21.15.55:0/2146049305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b0994c0 0x55f49b1405d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e4a00640 1 --2- 172.21.15.55:0/2146049305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b09f830 0x55f49b0f4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e4a00640 1 -- 172.21.15.55:0/2146049305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b0994c0 msgr2=0x55f49b1405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:19.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e4a00640 1 --2- 172.21.15.55:0/2146049305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b0994c0 0x55f49b1405d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e4a00640 1 -- 172.21.15.55:0/2146049305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e00b4ec0 con 0x55f49b0e2db0 2024-04-02T07:29:19.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8d7e00640 1 --2- 172.21.15.55:0/2146049305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b09f830 0x55f49b0f4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:29:19.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8dfe00640 1 --2- 172.21.15.55:0/2146049305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b0994c0 0x55f49b1405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:29:19.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e4a00640 1 --2- 172.21.15.55:0/2146049305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0e2db0 0x55f49b0f5000 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8007b70 tx=0x7fc8d8005da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b078c33cd10711 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:19.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8cd600640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:29:19.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8cd600640 1 -- 172.21.15.55:0/2146049305 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8d80146e0 con 0x55f49b0e2db0 2024-04-02T07:29:19.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8cd600640 1 -- 172.21.15.55:0/2146049305 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fc8d8021b40 con 0x55f49b0e2db0 2024-04-02T07:29:19.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e9e62000 1 -- 172.21.15.55:0/2146049305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f49aeb7460 con 0x55f49b0e2db0 2024-04-02T07:29:19.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8cd600640 1 -- 172.21.15.55:0/2146049305 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8d8007d60 con 0x55f49b0e2db0 2024-04-02T07:29:19.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e9e62000 10 client.7779 fetch_fsmap learned FSMap version 66 2024-04-02T07:29:19.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e9e62000 1 -- 172.21.15.55:0/2146049305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x55f49abe3cc0 con 0x55f49b0e2db0 2024-04-02T07:29:19.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8cd600640 1 -- 172.21.15.55:0/2146049305 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55f49aeb7460 con 0x55f49b0e2db0 2024-04-02T07:29:19.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8cd600640 1 -- 172.21.15.55:0/2146049305 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 66) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc8d801b040 con 0x55f49b0e2db0 2024-04-02T07:29:19.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e9e62000 10 client.7779 fetch_fsmap finished waiting for FSMap version 66 2024-04-02T07:29:19.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e9e62000 10 client.7779 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:29:19.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e9e62000 20 client.7779 populate_metadata read hostname 'smithi055' 2024-04-02T07:29:19.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e9e62000 1 --2- 172.21.15.55:0/2146049305 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55f49b0e36d0 0x55f49b0fd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e9e62000 4 client.7779 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-02T07:29:19.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8e9e62000 1 -- 172.21.15.55:0/2146049305 --> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55f49aeb09c0 con 0x55f49b0e36d0 2024-04-02T07:29:19.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.618+0000 7fc8dfe00640 1 --2- 172.21.15.55:0/2146049305 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55f49b0e36d0 0x55f49b0fd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8dfe00640 1 --2- 172.21.15.55:0/2146049305 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55f49b0e36d0 0x55f49b0fd660 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c477e449247cb21e server_cookie=b002e33b5b1fe36f in_seq=0 out_seq=0 2024-04-02T07:29:19.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8cd600640 10 client.7779 ms_handle_connect on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:19.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8cd600640 1 -- 172.21.15.55:0/2146049305 <== mds.0 v2:172.21.15.55:6832/821922065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55f49aeb09c0 con 0x55f49b0e36d0 2024-04-02T07:29:19.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8cd600640 10 client.7779 handle_command_reply: tid=0 2024-04-02T07:29:19.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e9e62000 1 client.7779 shutdown 2024-04-02T07:29:19.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e9e62000 1 -- 172.21.15.55:0/2146049305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0e2db0 msgr2=0x55f49b0f5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:19.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e9e62000 1 --2- 172.21.15.55:0/2146049305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0e2db0 0x55f49b0f5000 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8007b70 tx=0x7fc8d8005da0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e9e62000 1 -- 172.21.15.55:0/2146049305 shutdown_connections 2024-04-02T07:29:19.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e9e62000 1 --2- 172.21.15.55:0/2146049305 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55f49b0e36d0 0x55f49b0fd660 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e9e62000 1 --2- 172.21.15.55:0/2146049305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f49b0e2db0 0x55f49b0f5000 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e9e62000 1 --2- 172.21.15.55:0/2146049305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f49b09f830 0x55f49b0f4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8cd600640 0 client.7779 ms_handle_reset on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:19.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e9e62000 1 --2- 172.21.15.55:0/2146049305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f49b0994c0 0x55f49b1405d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e9e62000 1 -- 172.21.15.55:0/2146049305 >> 172.21.15.55:0/2146049305 conn(0x55f49b0ef760 msgr2=0x55f49b09e180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:19.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e9e62000 1 -- 172.21.15.55:0/2146049305 shutdown_connections 2024-04-02T07:29:19.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e9e62000 1 -- 172.21.15.55:0/2146049305 wait complete. 2024-04-02T07:29:19.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e9e62000 20 client.7779 trim_cache size 0 max 16384 2024-04-02T07:29:19.627 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:29:19.627 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "642a0456-a2ac-49a4-91a5-3b3449b512da", 2024-04-02T07:29:19.628 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-02T07:29:19.628 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 7455, 2024-04-02T07:29:19.628 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-02T07:29:19.628 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-02T07:29:19.628 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-02T07:29:19.628 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 4.5687898450000004, 2024-04-02T07:29:19.628 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 66, 2024-04-02T07:29:19.628 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 90, 2024-04-02T07:29:19.628 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 90, 2024-04-02T07:29:19.628 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 30.056480351000001 2024-04-02T07:29:19.628 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:29:19.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e6a00640 1 -- 172.21.15.55:0/3784924238 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc8bc0666c0 msgr2=0x7fc8bc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:19.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e6a00640 1 --2- 172.21.15.55:0/3784924238 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc8bc0666c0 0x7fc8bc068b80 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fc8d00ae000 tx=0x7fc8d0008040 comp rx=0 tx=0).stop 2024-04-02T07:29:19.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e6a00640 1 -- 172.21.15.55:0/3784924238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8e00cb1f0 msgr2=0x7fc8e015c820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:19.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e6a00640 1 --2- 172.21.15.55:0/3784924238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8e00cb1f0 0x7fc8e015c820 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fc8c800d5f0 tx=0x7fc8c800dab0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e6a00640 1 -- 172.21.15.55:0/3784924238 shutdown_connections 2024-04-02T07:29:19.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e6a00640 1 --2- 172.21.15.55:0/3784924238 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc8bc0666c0 0x7fc8bc068b80 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e6a00640 1 --2- 172.21.15.55:0/3784924238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc8e0160230 0x7fc8e015cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e6a00640 1 --2- 172.21.15.55:0/3784924238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8e00cb1f0 0x7fc8e015c820 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e6a00640 1 --2- 172.21.15.55:0/3784924238 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc8e006bac0 0x7fc8e00b56c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e6a00640 1 -- 172.21.15.55:0/3784924238 >> 172.21.15.55:0/3784924238 conn(0x7fc8e00b2150 msgr2=0x7fc8e006e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:19.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e6a00640 1 -- 172.21.15.55:0/3784924238 shutdown_connections 2024-04-02T07:29:19.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.622+0000 7fc8e6a00640 1 -- 172.21.15.55:0/3784924238 wait complete. 2024-04-02T07:29:19.643 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-02T07:29:19.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.782+0000 7f5ea1600640 1 Processor -- start 2024-04-02T07:29:19.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.782+0000 7f5ea1600640 1 -- start start 2024-04-02T07:29:19.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.782+0000 7f5ea1600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5e9c143f90 0x7f5e9c15ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.782+0000 7f5ea1600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e9c0cda80 0x7f5e9c0c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.782+0000 7f5ea1600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9c15b270 con 0x7f5e9c0b34f0 2024-04-02T07:29:19.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.782+0000 7f5ea1600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e9c144370 con 0x7f5e9c143f90 2024-04-02T07:29:19.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.782+0000 7f5ea1600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c0c37b0 con 0x7f5e9c0cda80 2024-04-02T07:29:19.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.782+0000 7f5e9aa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5e9c143f90 0x7f5e9c15ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.782+0000 7f5e9b400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e9c0cda80 0x7f5e9c0c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.782+0000 7f5e93e00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5e9c0b34f0 0x7f5e9c0cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:41326/0 (socket says 172.21.15.55:41326) 2024-04-02T07:29:19.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.782+0000 7f5e93e00640 1 -- 172.21.15.55:0/2746634378 learned_addr learned my addr 172.21.15.55:0/2746634378 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:29:19.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.782+0000 7f5e9aa00640 1 -- 172.21.15.55:0/2746634378 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e9c0cda80 msgr2=0x7f5e9c0c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:19.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.782+0000 7f5e9aa00640 1 --2- 172.21.15.55:0/2746634378 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e9c0cda80 0x7f5e9c0c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.782+0000 7f5e9aa00640 1 -- 172.21.15.55:0/2746634378 >> v1:172.21.15.106:6789/0 conn(0x7f5e9c0b34f0 legacy=0x7f5e9c0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:19.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.782+0000 7f5e9aa00640 1 -- 172.21.15.55:0/2746634378 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9c0c3a90 con 0x7f5e9c143f90 2024-04-02T07:29:19.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.786+0000 7f5e9aa00640 1 --2- 172.21.15.55:0/2746634378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e9c143f90 0x7f5e9c15ad30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0097c0 tx=0x7f5e8c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8863a5826a82fd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:19.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.786+0000 7f5e9a000640 1 -- 172.21.15.55:0/2746634378 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c0ac640 con 0x7f5e9c143f90 2024-04-02T07:29:19.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.786+0000 7f5e9a000640 1 -- 172.21.15.55:0/2746634378 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c0ac7a0 con 0x7f5e9c143f90 2024-04-02T07:29:19.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.786+0000 7f5e9a000640 1 -- 172.21.15.55:0/2746634378 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c0acb30 con 0x7f5e9c143f90 2024-04-02T07:29:19.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.786+0000 7f5ea1600640 1 -- 172.21.15.55:0/2746634378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e9c143f90 msgr2=0x7f5e9c15ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:19.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.786+0000 7f5ea1600640 1 --2- 172.21.15.55:0/2746634378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e9c143f90 0x7f5e9c15ad30 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c0097c0 tx=0x7f5e8c01c3e0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.786+0000 7f5ea1600640 1 -- 172.21.15.55:0/2746634378 shutdown_connections 2024-04-02T07:29:19.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.786+0000 7f5ea1600640 1 --2- 172.21.15.55:0/2746634378 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e9c0cda80 0x7f5e9c0c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.786+0000 7f5ea1600640 1 --2- 172.21.15.55:0/2746634378 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e9c143f90 0x7f5e9c15ad30 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.786+0000 7f5ea1600640 1 -- 172.21.15.55:0/2746634378 >> 172.21.15.55:0/2746634378 conn(0x7f5e9c066080 msgr2=0x7f5e9c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:19.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.786+0000 7f5ea1600640 1 -- 172.21.15.55:0/2746634378 shutdown_connections 2024-04-02T07:29:19.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.786+0000 7f5ea1600640 1 -- 172.21.15.55:0/2746634378 wait complete. 2024-04-02T07:29:19.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5ea1600640 1 Processor -- start 2024-04-02T07:29:19.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5ea1600640 1 -- start start 2024-04-02T07:29:19.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5ea1600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e9c0b34f0 0x7f5e9c070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5ea1600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e9c0cda80 0x7f5e9c139c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5ea1600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e9c143f90 0x7f5e9c13a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5ea1600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c0ccdd0 con 0x7f5e9c143f90 2024-04-02T07:29:19.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5ea1600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c0cd0b0 con 0x7f5e9c0b34f0 2024-04-02T07:29:19.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5ea1600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c1639e0 con 0x7f5e9c0cda80 2024-04-02T07:29:19.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5e9b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e9c143f90 0x7f5e9c13a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5e9aa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e9c0b34f0 0x7f5e9c070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5e93e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e9c0cda80 0x7f5e9c139c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5e9aa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e9c0b34f0 0x7f5e9c070a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:44706/0 (socket says 172.21.15.55:44706) 2024-04-02T07:29:19.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5e9aa00640 1 -- 172.21.15.55:0/2256918413 learned_addr learned my addr 172.21.15.55:0/2256918413 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:19.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5e9b400640 1 -- 172.21.15.55:0/2256918413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e9c0cda80 msgr2=0x7f5e9c139c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:19.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5e9b400640 1 --2- 172.21.15.55:0/2256918413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e9c0cda80 0x7f5e9c139c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5e9b400640 1 -- 172.21.15.55:0/2256918413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e9c0b34f0 msgr2=0x7f5e9c070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:19.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5e9b400640 1 --2- 172.21.15.55:0/2256918413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e9c0b34f0 0x7f5e9c070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5e9b400640 1 -- 172.21.15.55:0/2256918413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c009420 con 0x7f5e9c143f90 2024-04-02T07:29:19.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5e9aa00640 1 --2- 172.21.15.55:0/2256918413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e9c0b34f0 0x7f5e9c070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:29:19.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5e9b400640 1 --2- 172.21.15.55:0/2256918413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e9c143f90 0x7f5e9c13a190 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c144690 tx=0x7f5e9400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:19.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5e92a00640 1 -- 172.21.15.55:0/2256918413 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e94009c00 con 0x7f5e9c143f90 2024-04-02T07:29:19.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5e92a00640 1 -- 172.21.15.55:0/2256918413 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e9400f040 con 0x7f5e9c143f90 2024-04-02T07:29:19.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5e92a00640 1 -- 172.21.15.55:0/2256918413 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e940146c0 con 0x7f5e9c143f90 2024-04-02T07:29:19.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5ea1600640 1 -- 172.21.15.55:0/2256918413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9c163cc0 con 0x7f5e9c143f90 2024-04-02T07:29:19.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.790+0000 7f5ea1600640 1 -- 172.21.15.55:0/2256918413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9c070f50 con 0x7f5e9c143f90 2024-04-02T07:29:19.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.794+0000 7f5ea1600640 1 -- 172.21.15.55:0/2256918413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e9c071170 con 0x7f5e9c143f90 2024-04-02T07:29:19.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.794+0000 7f5e92a00640 1 -- 172.21.15.55:0/2256918413 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5e94014820 con 0x7f5e9c143f90 2024-04-02T07:29:19.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.794+0000 7f5e92a00640 1 --2- 172.21.15.55:0/2256918413 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e78066690 0x7f5e78068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:19.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.794+0000 7f5e92a00640 1 -- 172.21.15.55:0/2256918413 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f5e94084ff0 con 0x7f5e9c143f90 2024-04-02T07:29:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.794+0000 7f5e9aa00640 1 --2- 172.21.15.55:0/2256918413 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e78066690 0x7f5e78068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:19.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.794+0000 7f5e9aa00640 1 --2- 172.21.15.55:0/2256918413 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e78066690 0x7f5e78068b50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c01c420 tx=0x7f5e8c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:19.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.798+0000 7f5e92a00640 1 -- 172.21.15.55:0/2256918413 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5e940b6980 con 0x7f5e9c143f90 2024-04-02T07:29:19.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.990+0000 7f5ea1600640 1 -- 172.21.15.55:0/2256918413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5e9c066c90 con 0x7f5e9c143f90 2024-04-02T07:29:19.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.990+0000 7f5e92a00640 1 -- 172.21.15.55:0/2256918413 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v66) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5e94018070 con 0x7f5e9c143f90 2024-04-02T07:29:19.994 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-02T07:29:19.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.994+0000 7f5ea1600640 1 -- 172.21.15.55:0/2256918413 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e78066690 msgr2=0x7f5e78068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:19.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.994+0000 7f5ea1600640 1 --2- 172.21.15.55:0/2256918413 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e78066690 0x7f5e78068b50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c01c420 tx=0x7f5e8c0a7000 comp rx=0 tx=0).stop 2024-04-02T07:29:19.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.994+0000 7f5ea1600640 1 -- 172.21.15.55:0/2256918413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e9c143f90 msgr2=0x7f5e9c13a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:19.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.994+0000 7f5ea1600640 1 --2- 172.21.15.55:0/2256918413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e9c143f90 0x7f5e9c13a190 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f5e9c144690 tx=0x7f5e9400ef90 comp rx=0 tx=0).stop 2024-04-02T07:29:19.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.994+0000 7f5ea1600640 1 -- 172.21.15.55:0/2256918413 shutdown_connections 2024-04-02T07:29:19.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.994+0000 7f5ea1600640 1 --2- 172.21.15.55:0/2256918413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e9c143f90 0x7f5e9c13a190 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.994+0000 7f5ea1600640 1 --2- 172.21.15.55:0/2256918413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e9c0cda80 0x7f5e9c139c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.994+0000 7f5ea1600640 1 --2- 172.21.15.55:0/2256918413 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e78066690 0x7f5e78068b50 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.994+0000 7f5ea1600640 1 --2- 172.21.15.55:0/2256918413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e9c0b34f0 0x7f5e9c070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:19.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.994+0000 7f5ea1600640 1 -- 172.21.15.55:0/2256918413 >> 172.21.15.55:0/2256918413 conn(0x7f5e9c066080 msgr2=0x7f5e9c0716c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:19.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.994+0000 7f5ea1600640 1 -- 172.21.15.55:0/2256918413 shutdown_connections 2024-04-02T07:29:19.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:19.994+0000 7f5ea1600640 1 -- 172.21.15.55:0/2256918413 wait complete. 2024-04-02T07:29:20.015 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-02T07:29:20.015 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-02T07:29:20.015 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-02T07:29:20.015 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-02T07:29:20.015 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-02T07:29:20.015 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-02T07:29:20.015 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-02T07:29:20.015 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-02T07:29:20.015 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:29:20.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:20.016 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-02T07:29:20.025 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:29:20.026 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:29:20.026 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:29:20.026 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:29:20.026 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-02T07:29:20.026 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:29:20.026 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:29:20.026 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:29:20.026 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-02T07:29:20.026 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:29:20.026 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:29:20.026 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-02T07:29:20.026 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-02T07:29:20.027 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:29:20.027 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-02T07:29:20.027 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-02T07:29:20.027 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 42034sec preferred_lft 42034sec 2024-04-02T07:29:20.027 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2024-04-02T07:29:20.027 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:29:20.027 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:29:20.027 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:29:20.027 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-02T07:29:20.027 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-02T07:29:20.027 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:81:5a:89:17 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:29:20.027 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-02T07:29:20.027 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:29:20.027 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:29:20.028 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-02T07:29:20.028 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-02T07:29:20.028 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:29:20.028 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-02T07:29:20.028 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:29:20.028 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:29:20.028 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-02T07:29:20.028 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-02T07:29:20.028 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:29:20.028 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:29:20.028 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-02T07:29:20.028 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-02T07:29:20.028 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:29:20.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:20.029 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-02T07:29:20.088 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:29:20.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:20.090 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-02T07:29:20.143 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-02T07:29:20.143 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-02T07:29:20.143 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-02T07:29:20.143 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-02T07:29:20.143 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-02T07:29:20.143 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-02T07:29:20.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:20.144 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:29:20.144 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:29:20.144 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-02T07:29:20.144 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-02T07:29:20.144 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-02T07:29:20.144 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:29:20.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:20.235 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-02T07:29:20.244 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-02T07:29:20.244 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-02T07:29:20.245 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:29:20.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:20.245 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-02T07:29:20.306 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-02T07:29:20.306 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:29:20.307 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-02T07:29:20.358 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:29:20.358 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:29:20.358 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:29:20.409 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:29:20.453 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-04-02T07:29:20.450+0000 7f3acb400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:29:20.471 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:29:20.471 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:29:20.532 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:29:20.533 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:29:20.534 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:20.534 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:29:20.586 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-02T07:29:20.586 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-02T07:29:20.632 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:29:20.653 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:29:20.653 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:29:20.712 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:29:20.714 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:29:20.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:20.714 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:29:20.727 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:2024-04-02T07:29:20.726+0000 7f4f8c80f580 -1 init, newargv = 0x561b5fe950e0 newargc=15 2024-04-02T07:29:20.727 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[46628]: starting ceph client 2024-04-02T07:29:20.734 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[46628]: starting fuse 2024-04-02T07:29:20.736 INFO:teuthology.orchestra.run.smithi055.stdout:43 2024-04-02T07:29:20.736 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-02T07:29:20.736 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:29:20.736 DEBUG:teuthology.orchestra.run.smithi055:> import glob 2024-04-02T07:29:20.736 DEBUG:teuthology.orchestra.run.smithi055:> import re 2024-04-02T07:29:20.736 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:29:20.736 DEBUG:teuthology.orchestra.run.smithi055:> import subprocess 2024-04-02T07:29:20.737 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:29:20.737 DEBUG:teuthology.orchestra.run.smithi055:> def _find_admin_socket(client_name): 2024-04-02T07:29:20.737 DEBUG:teuthology.orchestra.run.smithi055:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-02T07:29:20.737 DEBUG:teuthology.orchestra.run.smithi055:> files = glob.glob(asok_path) 2024-04-02T07:29:20.737 DEBUG:teuthology.orchestra.run.smithi055:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-02T07:29:20.737 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:29:20.737 DEBUG:teuthology.orchestra.run.smithi055:> # Given a non-glob path, it better be there 2024-04-02T07:29:20.737 DEBUG:teuthology.orchestra.run.smithi055:> if "*" not in asok_path: 2024-04-02T07:29:20.737 DEBUG:teuthology.orchestra.run.smithi055:> assert(len(files) == 1) 2024-04-02T07:29:20.737 DEBUG:teuthology.orchestra.run.smithi055:> return files[0] 2024-04-02T07:29:20.737 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:29:20.737 DEBUG:teuthology.orchestra.run.smithi055:> for f in files: 2024-04-02T07:29:20.737 DEBUG:teuthology.orchestra.run.smithi055:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-02T07:29:20.737 DEBUG:teuthology.orchestra.run.smithi055:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-02T07:29:20.737 DEBUG:teuthology.orchestra.run.smithi055:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-02T07:29:20.738 DEBUG:teuthology.orchestra.run.smithi055:> contents = proc_f.read() 2024-04-02T07:29:20.738 DEBUG:teuthology.orchestra.run.smithi055:> if mountpoint in contents: 2024-04-02T07:29:20.738 DEBUG:teuthology.orchestra.run.smithi055:> return f 2024-04-02T07:29:20.738 DEBUG:teuthology.orchestra.run.smithi055:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-02T07:29:20.738 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:29:20.738 DEBUG:teuthology.orchestra.run.smithi055:> print(_find_admin_socket("client.0")) 2024-04-02T07:29:20.738 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:29:20.858 INFO:teuthology.orchestra.run.smithi055.stdout:/var/run/ceph/ceph-client.0.46628.asok 2024-04-02T07:29:21.043 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.46628.asok 2024-04-02T07:29:21.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:21.043 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.46628.asok status 2024-04-02T07:29:21.222 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:29:21.223 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": { 2024-04-02T07:29:21.223 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_sha1": "d0e392d9aee635f2b65768c460c7a151ead7a5e2", 2024-04-02T07:29:21.223 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)", 2024-04-02T07:29:21.223 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "0", 2024-04-02T07:29:21.223 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2024-04-02T07:29:21.223 INFO:teuthology.orchestra.run.smithi055.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-02T07:29:21.223 INFO:teuthology.orchestra.run.smithi055.stdout: "pid": "46628", 2024-04-02T07:29:21.223 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2024-04-02T07:29:21.223 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:29:21.223 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_count": 0, 2024-04-02T07:29:21.224 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_pinned_count": 0, 2024-04-02T07:29:21.224 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 7788, 2024-04-02T07:29:21.224 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": { 2024-04-02T07:29:21.224 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2024-04-02T07:29:21.224 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2024-04-02T07:29:21.224 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 7788 2024-04-02T07:29:21.224 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:29:21.224 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:29:21.224 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:29:21.224 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:29:21.224 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 410133821 2024-04-02T07:29:21.224 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:29:21.224 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:29:21.225 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:29:21.225 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:29:21.225 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:29:21.225 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 410133821 2024-04-02T07:29:21.225 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:29:21.225 INFO:teuthology.orchestra.run.smithi055.stdout: "inst_str": "client.7788 192.168.0.1:0/410133821", 2024-04-02T07:29:21.225 INFO:teuthology.orchestra.run.smithi055.stdout: "addr_str": "192.168.0.1:0/410133821", 2024-04-02T07:29:21.225 INFO:teuthology.orchestra.run.smithi055.stdout: "inode_count": 1, 2024-04-02T07:29:21.225 INFO:teuthology.orchestra.run.smithi055.stdout: "mds_epoch": 66, 2024-04-02T07:29:21.225 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch": 90, 2024-04-02T07:29:21.225 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch_barrier": 0, 2024-04-02T07:29:21.225 INFO:teuthology.orchestra.run.smithi055.stdout: "blocklisted": false, 2024-04-02T07:29:21.226 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs" 2024-04-02T07:29:21.226 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:29:21.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:21.237 DEBUG:teuthology.orchestra.run.smithi055:> stat --file-system '--printf=%T 2024-04-02T07:29:21.237 DEBUG:teuthology.orchestra.run.smithi055:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-02T07:29:21.247 INFO:teuthology.orchestra.run.smithi055.stdout:fuseblk 2024-04-02T07:29:21.247 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-02T07:29:21.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:21.247 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:29:21.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:21.309 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat testdir/hardlink) 2024-04-02T07:29:21.362 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-04-02T07:29:21.358+0000 7f3ac6e00640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-02T07:29:21.363 INFO:teuthology.orchestra.run.smithi055.stderr:stat: cannot statx 'testdir/hardlink': Input/output error 2024-04-02T07:29:21.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:29:21.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:21.364 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive 2024-04-02T07:29:21.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.550+0000 7fcf32a00640 1 Processor -- start 2024-04-02T07:29:21.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.550+0000 7fcf32a00640 1 -- start start 2024-04-02T07:29:21.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.554+0000 7fcf32a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcf2c1694e0 0x7fcf2c06c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.554+0000 7fcf32a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2c070150 0x7fcf2c0705a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.554+0000 7fcf32a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2c070ae0 con 0x7fcf2c0892b0 2024-04-02T07:29:21.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.554+0000 7fcf32a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2c06c6f0 con 0x7fcf2c1694e0 2024-04-02T07:29:21.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.554+0000 7fcf32a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c06c970 con 0x7fcf2c070150 2024-04-02T07:29:21.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.554+0000 7fcf31600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcf2c1694e0 0x7fcf2c06c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.554+0000 7fcf31600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcf2c1694e0 0x7fcf2c06c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50740/0 (socket says 172.21.15.55:50740) 2024-04-02T07:29:21.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.554+0000 7fcf31600640 1 -- 172.21.15.55:0/1593046395 learned_addr learned my addr 172.21.15.55:0/1593046395 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:21.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.554+0000 7fcf2be00640 1 -- 172.21.15.55:0/1593046395 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1977451452 0 0) 0x7fcf18001120 con 0x7fcf2c0892b0 2024-04-02T07:29:21.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.554+0000 7fcf32000640 1 --2- 172.21.15.55:0/1593046395 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2c070150 0x7fcf2c0705a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.554+0000 7fcf2be00640 1 -- 172.21.15.55:0/1593046395 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf14003510 con 0x7fcf2c0892b0 2024-04-02T07:29:21.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.558+0000 7fcf31600640 1 -- 172.21.15.55:0/1593046395 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2c070150 msgr2=0x7fcf2c0705a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:21.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.558+0000 7fcf31600640 1 --2- 172.21.15.55:0/1593046395 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2c070150 0x7fcf2c0705a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.558+0000 7fcf31600640 1 -- 172.21.15.55:0/1593046395 >> v1:172.21.15.106:6789/0 conn(0x7fcf2c0892b0 legacy=0x7fcf2c0cc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.558+0000 7fcf31600640 1 -- 172.21.15.55:0/1593046395 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c06cc50 con 0x7fcf2c1694e0 2024-04-02T07:29:21.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.558+0000 7fcf31600640 1 --2- 172.21.15.55:0/1593046395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf2c1694e0 0x7fcf2c06c1b0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fcf200083f0 tx=0x7fcf2001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d740367817cb9a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:21.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.558+0000 7fcf2be00640 1 -- 172.21.15.55:0/1593046395 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20008be0 con 0x7fcf2c1694e0 2024-04-02T07:29:21.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.558+0000 7fcf2be00640 1 -- 172.21.15.55:0/1593046395 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf200a6040 con 0x7fcf2c1694e0 2024-04-02T07:29:21.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.558+0000 7fcf2be00640 1 -- 172.21.15.55:0/1593046395 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2000a0d0 con 0x7fcf2c1694e0 2024-04-02T07:29:21.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.558+0000 7fcf32a00640 1 -- 172.21.15.55:0/1593046395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf2c1694e0 msgr2=0x7fcf2c06c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.558+0000 7fcf32a00640 1 --2- 172.21.15.55:0/1593046395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf2c1694e0 0x7fcf2c06c1b0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fcf200083f0 tx=0x7fcf2001c490 comp rx=0 tx=0).stop 2024-04-02T07:29:21.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.558+0000 7fcf32a00640 1 -- 172.21.15.55:0/1593046395 shutdown_connections 2024-04-02T07:29:21.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.558+0000 7fcf32a00640 1 --2- 172.21.15.55:0/1593046395 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2c070150 0x7fcf2c0705a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.558+0000 7fcf32a00640 1 --2- 172.21.15.55:0/1593046395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf2c1694e0 0x7fcf2c06c1b0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.558+0000 7fcf32a00640 1 -- 172.21.15.55:0/1593046395 >> 172.21.15.55:0/1593046395 conn(0x7fcf2c069d90 msgr2=0x7fcf2c06a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:21.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.558+0000 7fcf32a00640 1 -- 172.21.15.55:0/1593046395 shutdown_connections 2024-04-02T07:29:21.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.558+0000 7fcf32a00640 1 -- 172.21.15.55:0/1593046395 wait complete. 2024-04-02T07:29:21.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.562+0000 7fcf32a00640 1 Processor -- start 2024-04-02T07:29:21.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.562+0000 7fcf32a00640 1 -- start start 2024-04-02T07:29:21.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.562+0000 7fcf32a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf2c070150 0x7fcf2c0b1c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.562+0000 7fcf32a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2c0892b0 0x7fcf2c159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.562+0000 7fcf32a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf2c1694e0 0x7fcf2c169ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.562+0000 7fcf32a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c158df0 con 0x7fcf2c070150 2024-04-02T07:29:21.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.562+0000 7fcf32a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c15ac50 con 0x7fcf2c1694e0 2024-04-02T07:29:21.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.562+0000 7fcf32a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c15af30 con 0x7fcf2c0892b0 2024-04-02T07:29:21.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.562+0000 7fcf31600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf2c070150 0x7fcf2c0b1c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.562+0000 7fcf31600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf2c070150 0x7fcf2c0b1c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50754/0 (socket says 172.21.15.55:50754) 2024-04-02T07:29:21.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.562+0000 7fcf31600640 1 -- 172.21.15.55:0/1019676748 learned_addr learned my addr 172.21.15.55:0/1019676748 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:21.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.562+0000 7fcf32000640 1 --2- 172.21.15.55:0/1019676748 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf2c1694e0 0x7fcf2c169ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.562+0000 7fcf30c00640 1 --2- 172.21.15.55:0/1019676748 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2c0892b0 0x7fcf2c159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.562+0000 7fcf31600640 1 -- 172.21.15.55:0/1019676748 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2c0892b0 msgr2=0x7fcf2c159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.562+0000 7fcf31600640 1 --2- 172.21.15.55:0/1019676748 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2c0892b0 0x7fcf2c159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.562+0000 7fcf31600640 1 -- 172.21.15.55:0/1019676748 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf2c1694e0 msgr2=0x7fcf2c169ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.562+0000 7fcf31600640 1 --2- 172.21.15.55:0/1019676748 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf2c1694e0 0x7fcf2c169ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.562+0000 7fcf31600640 1 -- 172.21.15.55:0/1019676748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf20008050 con 0x7fcf2c070150 2024-04-02T07:29:21.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.562+0000 7fcf31600640 1 --2- 172.21.15.55:0/1019676748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf2c070150 0x7fcf2c0b1c50 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fcf200ac040 tx=0x7fcf2000abe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:21.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.562+0000 7fcf29600640 1 -- 172.21.15.55:0/1019676748 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2000a6a0 con 0x7fcf2c070150 2024-04-02T07:29:21.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.566+0000 7fcf29600640 1 -- 172.21.15.55:0/1019676748 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2000a800 con 0x7fcf2c070150 2024-04-02T07:29:21.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.566+0000 7fcf29600640 1 -- 172.21.15.55:0/1019676748 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf200aa630 con 0x7fcf2c070150 2024-04-02T07:29:21.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.566+0000 7fcf32a00640 1 -- 172.21.15.55:0/1019676748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2c15b210 con 0x7fcf2c070150 2024-04-02T07:29:21.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.566+0000 7fcf32a00640 1 -- 172.21.15.55:0/1019676748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2c15b7d0 con 0x7fcf2c070150 2024-04-02T07:29:21.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.566+0000 7fcf29600640 1 -- 172.21.15.55:0/1019676748 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fcf200aa790 con 0x7fcf2c070150 2024-04-02T07:29:21.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.566+0000 7fcf29600640 1 --2- 172.21.15.55:0/1019676748 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf0c066690 0x7fcf0c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.566+0000 7fcf29600640 1 -- 172.21.15.55:0/1019676748 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fcf2011e920 con 0x7fcf2c070150 2024-04-02T07:29:21.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.566+0000 7fcf373ba000 1 Processor -- start 2024-04-02T07:29:21.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.566+0000 7fcf30c00640 1 --2- 172.21.15.55:0/1019676748 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf0c066690 0x7fcf0c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.566+0000 7fcf373ba000 1 -- start start 2024-04-02T07:29:21.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf30c00640 1 --2- 172.21.15.55:0/1019676748 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf0c066690 0x7fcf0c068b50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c16b3b0 tx=0x7fcf18009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:21.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf373ba000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555898b51820 0x555898b51c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf373ba000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898b08910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf373ba000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555898b08e50 0x555898b09230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf373ba000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558989d1100 con 0x555898b52140 2024-04-02T07:29:21.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf373ba000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55589895ed10 con 0x555898b51820 2024-04-02T07:29:21.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf373ba000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55589895c2e0 con 0x555898b08e50 2024-04-02T07:29:21.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf30c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898b08910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf31600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555898b51820 0x555898b51c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf30c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898b08910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50766/0 (socket says 172.21.15.55:50766) 2024-04-02T07:29:21.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf30c00640 1 -- 172.21.15.55:0/3859840193 learned_addr learned my addr 172.21.15.55:0/3859840193 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:21.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf32000640 1 --2- 172.21.15.55:0/3859840193 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555898b08e50 0x555898b09230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf30c00640 1 -- 172.21.15.55:0/3859840193 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555898b08e50 msgr2=0x555898b09230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:21.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf30c00640 1 --2- 172.21.15.55:0/3859840193 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555898b08e50 0x555898b09230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf30c00640 1 -- 172.21.15.55:0/3859840193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555898b51820 msgr2=0x555898b51c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:21.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf30c00640 1 --2- 172.21.15.55:0/3859840193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555898b51820 0x555898b51c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf30c00640 1 -- 172.21.15.55:0/3859840193 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555898653fb0 con 0x555898b52140 2024-04-02T07:29:21.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf30c00640 1 --2- 172.21.15.55:0/3859840193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898b08910 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fcf18005250 tx=0x7fcf18011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8928b61bfaf75054 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:21.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf1e000640 1 -- 172.21.15.55:0/3859840193 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf18005480 con 0x555898b52140 2024-04-02T07:29:21.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf1e000640 1 -- 172.21.15.55:0/3859840193 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1800e710 con 0x555898b52140 2024-04-02T07:29:21.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf1e000640 1 -- 172.21.15.55:0/3859840193 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1800eaa0 con 0x555898b52140 2024-04-02T07:29:21.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf373ba000 1 -- 172.21.15.55:0/3859840193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 msgr2=0x555898b08910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf373ba000 1 --2- 172.21.15.55:0/3859840193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898b08910 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7fcf18005250 tx=0x7fcf18011000 comp rx=0 tx=0).stop 2024-04-02T07:29:21.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf373ba000 1 -- 172.21.15.55:0/3859840193 shutdown_connections 2024-04-02T07:29:21.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf373ba000 1 --2- 172.21.15.55:0/3859840193 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555898b08e50 0x555898b09230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf373ba000 1 --2- 172.21.15.55:0/3859840193 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898b08910 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf373ba000 1 --2- 172.21.15.55:0/3859840193 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555898b51820 0x555898b51c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf373ba000 1 -- 172.21.15.55:0/3859840193 >> 172.21.15.55:0/3859840193 conn(0x555898907280 msgr2=0x555898b071f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:21.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf373ba000 1 -- 172.21.15.55:0/3859840193 shutdown_connections 2024-04-02T07:29:21.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf373ba000 1 -- 172.21.15.55:0/3859840193 wait complete. 2024-04-02T07:29:21.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf373ba000 1 -- start start 2024-04-02T07:29:21.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.570+0000 7fcf373ba000 1 Processor -- start 2024-04-02T07:29:21.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf373ba000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555898b08e50 0x555898b3c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf373ba000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555898b51820 0x555898b3c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf373ba000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898b3cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf373ba000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555898957bd0 con 0x555898b52140 2024-04-02T07:29:21.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf373ba000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558988f6f60 con 0x555898b51820 2024-04-02T07:29:21.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf373ba000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x555898915180 con 0x555898b08e50 2024-04-02T07:29:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf373ba000 10 client.0 _ll_register_callbacks cb 0x555898951240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:29:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf32000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898b3cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf32000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898b3cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50780/0 (socket says 172.21.15.55:50780) 2024-04-02T07:29:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf31600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555898b08e50 0x555898b3c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf32000640 1 -- 172.21.15.55:0/2928882040 learned_addr learned my addr 172.21.15.55:0/2928882040 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf30c00640 1 --2- 172.21.15.55:0/2928882040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555898b51820 0x555898b3c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf32000640 1 -- 172.21.15.55:0/2928882040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555898b08e50 msgr2=0x555898b3c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf32000640 1 --2- 172.21.15.55:0/2928882040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555898b08e50 0x555898b3c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf32000640 1 -- 172.21.15.55:0/2928882040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555898b51820 msgr2=0x555898b3c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf32000640 1 --2- 172.21.15.55:0/2928882040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555898b51820 0x555898b3c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf32000640 1 -- 172.21.15.55:0/2928882040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1800f040 con 0x555898b52140 2024-04-02T07:29:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf32000640 1 --2- 172.21.15.55:0/2928882040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898b3cea0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fcf240148f0 tx=0x7fcf24014cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=363a53448578da39 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf12a00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:29:21.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf12a00640 1 -- 172.21.15.55:0/2928882040 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf24012cc0 con 0x555898b52140 2024-04-02T07:29:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf373ba000 1 -- 172.21.15.55:0/2928882040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555898927850 con 0x555898b52140 2024-04-02T07:29:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf12a00640 1 -- 172.21.15.55:0/2928882040 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fcf2401b070 con 0x555898b52140 2024-04-02T07:29:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf12a00640 1 -- 172.21.15.55:0/2928882040 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf24012e20 con 0x555898b52140 2024-04-02T07:29:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf373ba000 10 client.7800 fetch_fsmap learned FSMap version 66 2024-04-02T07:29:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf373ba000 1 -- 172.21.15.55:0/2928882040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x55589891cbc0 con 0x555898b52140 2024-04-02T07:29:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf12a00640 1 -- 172.21.15.55:0/2928882040 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555898927850 con 0x555898b52140 2024-04-02T07:29:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf12a00640 1 -- 172.21.15.55:0/2928882040 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 66) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fcf24015440 con 0x555898b52140 2024-04-02T07:29:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf373ba000 10 client.7800 fetch_fsmap finished waiting for FSMap version 66 2024-04-02T07:29:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf373ba000 10 client.7800 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-02T07:29:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf373ba000 20 client.7800 populate_metadata read hostname 'smithi055' 2024-04-02T07:29:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf373ba000 1 --2- 172.21.15.55:0/2928882040 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x555898b3d8b0 0x555898b63e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf373ba000 4 client.7800 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:29:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf373ba000 1 -- 172.21.15.55:0/2928882040 --> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5558989549b0 con 0x555898b3d8b0 2024-04-02T07:29:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf31600640 1 --2- 172.21.15.55:0/2928882040 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x555898b3d8b0 0x555898b63e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf31600640 1 --2- 172.21.15.55:0/2928882040 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x555898b3d8b0 0x555898b63e40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59f91570f7fa688d server_cookie=7c15b83dfb90c372 in_seq=0 out_seq=0 2024-04-02T07:29:21.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf12a00640 10 client.7800 ms_handle_connect on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf12a00640 1 -- 172.21.15.55:0/2928882040 <== mds.0 v2:172.21.15.55:6832/821922065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5558989549b0 con 0x555898b3d8b0 2024-04-02T07:29:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf12a00640 10 client.7800 handle_command_reply: tid=0 2024-04-02T07:29:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf373ba000 1 client.7800 shutdown 2024-04-02T07:29:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf373ba000 1 -- 172.21.15.55:0/2928882040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 msgr2=0x555898b3cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.574+0000 7fcf373ba000 1 --2- 172.21.15.55:0/2928882040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898b3cea0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fcf240148f0 tx=0x7fcf24014cf0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.578+0000 7fcf373ba000 1 -- 172.21.15.55:0/2928882040 shutdown_connections 2024-04-02T07:29:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.578+0000 7fcf373ba000 1 --2- 172.21.15.55:0/2928882040 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x555898b3d8b0 0x555898b63e40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.578+0000 7fcf373ba000 1 --2- 172.21.15.55:0/2928882040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898b3cea0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.578+0000 7fcf373ba000 1 --2- 172.21.15.55:0/2928882040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555898b51820 0x555898b3c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.578+0000 7fcf373ba000 1 --2- 172.21.15.55:0/2928882040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555898b08e50 0x555898b3c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.578+0000 7fcf12a00640 0 client.7800 ms_handle_reset on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.578+0000 7fcf373ba000 1 -- 172.21.15.55:0/2928882040 >> 172.21.15.55:0/2928882040 conn(0x555898907280 msgr2=0x555898b078f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:21.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.578+0000 7fcf373ba000 1 -- 172.21.15.55:0/2928882040 shutdown_connections 2024-04-02T07:29:21.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.578+0000 7fcf373ba000 1 -- 172.21.15.55:0/2928882040 wait complete. 2024-04-02T07:29:21.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.578+0000 7fcf373ba000 20 client.7800 trim_cache size 0 max 16384 2024-04-02T07:29:21.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.590+0000 7fcf373ba000 1 Processor -- start 2024-04-02T07:29:21.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.590+0000 7fcf373ba000 1 -- start start 2024-04-02T07:29:21.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.590+0000 7fcf373ba000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555898b08e50 0x555898bac030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.590+0000 7fcf373ba000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555898b51820 0x555898bac570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.590+0000 7fcf373ba000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898bacab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.590+0000 7fcf373ba000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555898614c30 con 0x555898b52140 2024-04-02T07:29:21.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.590+0000 7fcf373ba000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558989533c0 con 0x555898b08e50 2024-04-02T07:29:21.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.590+0000 7fcf373ba000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55589899b2b0 con 0x555898b51820 2024-04-02T07:29:21.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf32000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898bacab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf32000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898bacab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50786/0 (socket says 172.21.15.55:50786) 2024-04-02T07:29:21.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf32000640 1 -- 172.21.15.55:0/3184771741 learned_addr learned my addr 172.21.15.55:0/3184771741 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:21.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf31600640 1 --2- 172.21.15.55:0/3184771741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555898b08e50 0x555898bac030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf30c00640 1 --2- 172.21.15.55:0/3184771741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555898b51820 0x555898bac570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf32000640 1 -- 172.21.15.55:0/3184771741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555898b51820 msgr2=0x555898bac570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:21.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf32000640 1 --2- 172.21.15.55:0/3184771741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555898b51820 0x555898bac570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf32000640 1 -- 172.21.15.55:0/3184771741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555898b08e50 msgr2=0x555898bac030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:21.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf32000640 1 --2- 172.21.15.55:0/3184771741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555898b08e50 0x555898bac030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf32000640 1 -- 172.21.15.55:0/3184771741 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555898902f10 con 0x555898b52140 2024-04-02T07:29:21.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf32000640 1 --2- 172.21.15.55:0/3184771741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898bacab0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fcf24014fe0 tx=0x7fcf24017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c7c8f8079964de server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:21.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf1ea00640 1 -- 172.21.15.55:0/3184771741 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf24015950 con 0x555898b52140 2024-04-02T07:29:21.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf1ea00640 1 -- 172.21.15.55:0/3184771741 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf24019070 con 0x555898b52140 2024-04-02T07:29:21.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf1ea00640 1 -- 172.21.15.55:0/3184771741 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2401f430 con 0x555898b52140 2024-04-02T07:29:21.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf373ba000 1 -- 172.21.15.55:0/3184771741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 msgr2=0x555898bacab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf373ba000 1 --2- 172.21.15.55:0/3184771741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898bacab0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fcf24014fe0 tx=0x7fcf24017000 comp rx=0 tx=0).stop 2024-04-02T07:29:21.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf373ba000 1 -- 172.21.15.55:0/3184771741 shutdown_connections 2024-04-02T07:29:21.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf373ba000 1 --2- 172.21.15.55:0/3184771741 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898bacab0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf373ba000 1 --2- 172.21.15.55:0/3184771741 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555898b51820 0x555898bac570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf373ba000 1 --2- 172.21.15.55:0/3184771741 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555898b08e50 0x555898bac030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf373ba000 1 -- 172.21.15.55:0/3184771741 >> 172.21.15.55:0/3184771741 conn(0x555898907280 msgr2=0x555898b3bfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:21.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf373ba000 1 -- 172.21.15.55:0/3184771741 shutdown_connections 2024-04-02T07:29:21.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf373ba000 1 -- 172.21.15.55:0/3184771741 wait complete. 2024-04-02T07:29:21.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf373ba000 1 -- start start 2024-04-02T07:29:21.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf373ba000 1 Processor -- start 2024-04-02T07:29:21.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf373ba000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555898b08e50 0x555898bb2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf373ba000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555898b51820 0x555898bb3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf373ba000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898bb79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf373ba000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55589895a730 con 0x555898b52140 2024-04-02T07:29:21.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf373ba000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5558989f7b30 con 0x555898b08e50 2024-04-02T07:29:21.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf373ba000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x555898a12430 con 0x555898b51820 2024-04-02T07:29:21.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf373ba000 10 client.0 _ll_register_callbacks cb 0x5558989087a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:29:21.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf32000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898bb79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf32000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898bb79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50802/0 (socket says 172.21.15.55:50802) 2024-04-02T07:29:21.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf32000640 1 -- 172.21.15.55:0/973928137 learned_addr learned my addr 172.21.15.55:0/973928137 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:21.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf31600640 1 --2- 172.21.15.55:0/973928137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555898b08e50 0x555898bb2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf30c00640 1 --2- 172.21.15.55:0/973928137 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555898b51820 0x555898bb3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf32000640 1 -- 172.21.15.55:0/973928137 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555898b51820 msgr2=0x555898bb3050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:21.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf32000640 1 --2- 172.21.15.55:0/973928137 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555898b51820 0x555898bb3050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf32000640 1 -- 172.21.15.55:0/973928137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555898b08e50 msgr2=0x555898bb2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:21.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf32000640 1 --2- 172.21.15.55:0/973928137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555898b08e50 0x555898bb2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.594+0000 7fcf32000640 1 -- 172.21.15.55:0/973928137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55589891cbc0 con 0x555898b52140 2024-04-02T07:29:21.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf32000640 1 --2- 172.21.15.55:0/973928137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898bb79d0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fcf24007fd0 tx=0x7fcf24004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1ff30dd8a271f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:21.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf12a00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:29:21.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf12a00640 1 -- 172.21.15.55:0/973928137 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf24015950 con 0x555898b52140 2024-04-02T07:29:21.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf12a00640 1 -- 172.21.15.55:0/973928137 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fcf2401b050 con 0x555898b52140 2024-04-02T07:29:21.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 1 -- 172.21.15.55:0/973928137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555898927570 con 0x555898b52140 2024-04-02T07:29:21.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf12a00640 1 -- 172.21.15.55:0/973928137 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf24015440 con 0x555898b52140 2024-04-02T07:29:21.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 10 client.7806 fetch_fsmap learned FSMap version 66 2024-04-02T07:29:21.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 1 -- 172.21.15.55:0/973928137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x5558988f6a80 con 0x555898b52140 2024-04-02T07:29:21.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf12a00640 1 -- 172.21.15.55:0/973928137 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555898927570 con 0x555898b52140 2024-04-02T07:29:21.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf12a00640 1 -- 172.21.15.55:0/973928137 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 66) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fcf2403b020 con 0x555898b52140 2024-04-02T07:29:21.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 10 client.7806 fetch_fsmap finished waiting for FSMap version 66 2024-04-02T07:29:21.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 10 client.7806 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-02T07:29:21.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 20 client.7806 populate_metadata read hostname 'smithi055' 2024-04-02T07:29:21.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 1 --2- 172.21.15.55:0/973928137 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x555898b6d200 0x555898bb9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 4 client.7806 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}] 2024-04-02T07:29:21.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 1 -- 172.21.15.55:0/973928137 --> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive"]}) v1 -- 0x555898956520 con 0x555898b6d200 2024-04-02T07:29:21.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf31600640 1 --2- 172.21.15.55:0/973928137 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x555898b6d200 0x555898bb9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf31600640 1 --2- 172.21.15.55:0/973928137 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x555898b6d200 0x555898bb9f20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42680497ec6c2501 server_cookie=8a125d764f24bf47 in_seq=0 out_seq=0 2024-04-02T07:29:21.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf12a00640 10 client.7806 ms_handle_connect on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:21.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf12a00640 1 -- 172.21.15.55:0/973928137 <== mds.0 v2:172.21.15.55:6832/821922065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x555898956520 con 0x555898b6d200 2024-04-02T07:29:21.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf12a00640 10 client.7806 handle_command_reply: tid=0 2024-04-02T07:29:21.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 1 client.7806 shutdown 2024-04-02T07:29:21.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 1 -- 172.21.15.55:0/973928137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 msgr2=0x555898bb79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 1 --2- 172.21.15.55:0/973928137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898bb79d0 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7fcf24007fd0 tx=0x7fcf24004a50 comp rx=0 tx=0).stop 2024-04-02T07:29:21.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 1 -- 172.21.15.55:0/973928137 shutdown_connections 2024-04-02T07:29:21.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 1 --2- 172.21.15.55:0/973928137 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x555898b6d200 0x555898bb9f20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 1 --2- 172.21.15.55:0/973928137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555898b52140 0x555898bb79d0 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 1 --2- 172.21.15.55:0/973928137 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555898b51820 0x555898bb3050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 1 --2- 172.21.15.55:0/973928137 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555898b08e50 0x555898bb2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 1 -- 172.21.15.55:0/973928137 >> 172.21.15.55:0/973928137 conn(0x555898907280 msgr2=0x555898b61e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:21.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf12a00640 0 client.7806 ms_handle_reset on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:21.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 1 -- 172.21.15.55:0/973928137 shutdown_connections 2024-04-02T07:29:21.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 1 -- 172.21.15.55:0/973928137 wait complete. 2024-04-02T07:29:21.605 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-04-02T07:29:21.598+0000 7f3ac6e00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v13 ap=1 f(v0 m2024-04-02T07:29:02.941529+0000 1=1+0) n(v0 rc2024-04-02T07:29:03.060803+0000 2=1+1) (iversion lock) | dirfrag=0 authpin=1 scrubqueue=0 0x55cb9380e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v13>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-02T07:29:02.941529+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-02T07:29:03.060803+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-02T07:29:21.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf373ba000 20 client.7806 trim_cache size 0 max 16384 2024-04-02T07:29:21.606 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:29:21.606 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-04-02T07:29:21.606 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "f090e825-14d0-459a-b046-2b80949a72c1", 2024-04-02T07:29:21.606 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-04-02T07:29:21.606 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:29:21.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf32a00640 1 -- 172.21.15.55:0/1019676748 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf0c066690 msgr2=0x7fcf0c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf32a00640 1 --2- 172.21.15.55:0/1019676748 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf0c066690 0x7fcf0c068b50 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c16b3b0 tx=0x7fcf18009040 comp rx=0 tx=0).stop 2024-04-02T07:29:21.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf32a00640 1 -- 172.21.15.55:0/1019676748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf2c070150 msgr2=0x7fcf2c0b1c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf32a00640 1 --2- 172.21.15.55:0/1019676748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf2c070150 0x7fcf2c0b1c50 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fcf200ac040 tx=0x7fcf2000abe0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf32a00640 1 -- 172.21.15.55:0/1019676748 shutdown_connections 2024-04-02T07:29:21.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf32a00640 1 --2- 172.21.15.55:0/1019676748 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcf0c066690 0x7fcf0c068b50 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf32a00640 1 --2- 172.21.15.55:0/1019676748 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcf2c1694e0 0x7fcf2c169ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf32a00640 1 --2- 172.21.15.55:0/1019676748 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcf2c0892b0 0x7fcf2c159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf32a00640 1 --2- 172.21.15.55:0/1019676748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcf2c070150 0x7fcf2c0b1c50 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf32a00640 1 -- 172.21.15.55:0/1019676748 >> 172.21.15.55:0/1019676748 conn(0x7fcf2c069d90 msgr2=0x7fcf2c0ad770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:21.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf32a00640 1 -- 172.21.15.55:0/1019676748 shutdown_connections 2024-04-02T07:29:21.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.598+0000 7fcf32a00640 1 -- 172.21.15.55:0/1019676748 wait complete. 2024-04-02T07:29:21.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:21.620 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-02T07:29:21.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.762+0000 7fba13200640 1 Processor -- start 2024-04-02T07:29:21.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.762+0000 7fba13200640 1 -- start start 2024-04-02T07:29:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.762+0000 7fba13200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fba0c0c9980 0x7fba0c069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.762+0000 7fba13200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0c06a710 con 0x7fba0c06a2d0 2024-04-02T07:29:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.762+0000 7fba13200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0c06a9e0 con 0x7fba0c13d700 2024-04-02T07:29:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.762+0000 7fba13200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0c06acc0 con 0x7fba0c0c9980 2024-04-02T07:29:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.762+0000 7fba11400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fba0c0c9980 0x7fba0c069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.762+0000 7fba12800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fba0c06a2d0 0x7fba0c06cb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41414/0 (socket says 172.21.15.55:41414) 2024-04-02T07:29:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.762+0000 7fba12800640 1 -- 172.21.15.55:0/1502959356 learned_addr learned my addr 172.21.15.55:0/1502959356 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:29:21.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.762+0000 7fba11400640 1 -- 172.21.15.55:0/1502959356 >> v1:172.21.15.106:6789/0 conn(0x7fba0c13d700 legacy=0x7fba0c0c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.762+0000 7fba11400640 1 -- 172.21.15.55:0/1502959356 >> v1:172.21.15.55:6789/0 conn(0x7fba0c06a2d0 legacy=0x7fba0c06cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.762+0000 7fba11400640 1 -- 172.21.15.55:0/1502959356 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c06afa0 con 0x7fba0c0c9980 2024-04-02T07:29:21.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.766+0000 7fba11400640 1 --2- 172.21.15.55:0/1502959356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c0c9980 0x7fba0c069d90 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0097c0 tx=0x7fb9fc01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a8a732a84f466a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:21.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.766+0000 7fba10a00640 1 -- 172.21.15.55:0/1502959356 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc0ab670 con 0x7fba0c0c9980 2024-04-02T07:29:21.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.766+0000 7fba10a00640 1 -- 172.21.15.55:0/1502959356 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc0ab7d0 con 0x7fba0c0c9980 2024-04-02T07:29:21.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.766+0000 7fba10a00640 1 -- 172.21.15.55:0/1502959356 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc0abb60 con 0x7fba0c0c9980 2024-04-02T07:29:21.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.766+0000 7fba13200640 1 -- 172.21.15.55:0/1502959356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c0c9980 msgr2=0x7fba0c069d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.766+0000 7fba13200640 1 --2- 172.21.15.55:0/1502959356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c0c9980 0x7fba0c069d90 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0097c0 tx=0x7fb9fc01c470 comp rx=0 tx=0).stop 2024-04-02T07:29:21.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.766+0000 7fba13200640 1 -- 172.21.15.55:0/1502959356 shutdown_connections 2024-04-02T07:29:21.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.766+0000 7fba13200640 1 --2- 172.21.15.55:0/1502959356 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c0c9980 0x7fba0c069d90 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.766+0000 7fba13200640 1 -- 172.21.15.55:0/1502959356 >> 172.21.15.55:0/1502959356 conn(0x7fba0c0cb6a0 msgr2=0x7fba0c0cbab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:21.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.766+0000 7fba13200640 1 -- 172.21.15.55:0/1502959356 shutdown_connections 2024-04-02T07:29:21.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.766+0000 7fba13200640 1 -- 172.21.15.55:0/1502959356 wait complete. 2024-04-02T07:29:21.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba13200640 1 Processor -- start 2024-04-02T07:29:21.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba13200640 1 -- start start 2024-04-02T07:29:21.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba13200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba0c06a2d0 0x7fba0c157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba13200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba0c0c9980 0x7fba0c0b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba13200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c13d700 0x7fba0c0b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba13200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c133040 con 0x7fba0c13d700 2024-04-02T07:29:21.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba13200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c157980 con 0x7fba0c06a2d0 2024-04-02T07:29:21.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba13200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c1582d0 con 0x7fba0c0c9980 2024-04-02T07:29:21.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba12800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c13d700 0x7fba0c0b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba12800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c13d700 0x7fba0c0b47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50822/0 (socket says 172.21.15.55:50822) 2024-04-02T07:29:21.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba12800640 1 -- 172.21.15.55:0/3989906800 learned_addr learned my addr 172.21.15.55:0/3989906800 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba11e00640 1 --2- 172.21.15.55:0/3989906800 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba0c06a2d0 0x7fba0c157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba11400640 1 --2- 172.21.15.55:0/3989906800 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba0c0c9980 0x7fba0c0b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba12800640 1 -- 172.21.15.55:0/3989906800 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba0c0c9980 msgr2=0x7fba0c0b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba12800640 1 --2- 172.21.15.55:0/3989906800 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba0c0c9980 0x7fba0c0b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba12800640 1 -- 172.21.15.55:0/3989906800 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba0c06a2d0 msgr2=0x7fba0c157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba12800640 1 --2- 172.21.15.55:0/3989906800 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba0c06a2d0 0x7fba0c157440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba12800640 1 -- 172.21.15.55:0/3989906800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc009420 con 0x7fba0c13d700 2024-04-02T07:29:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba12800640 1 --2- 172.21.15.55:0/3989906800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c13d700 0x7fba0c0b47c0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fba0800cbf0 tx=0x7fba0800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba06000640 1 -- 172.21.15.55:0/3989906800 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba0800ace0 con 0x7fba0c13d700 2024-04-02T07:29:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba06000640 1 -- 172.21.15.55:0/3989906800 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba0800ae40 con 0x7fba0c13d700 2024-04-02T07:29:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba06000640 1 -- 172.21.15.55:0/3989906800 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba08012600 con 0x7fba0c13d700 2024-04-02T07:29:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba13200640 1 -- 172.21.15.55:0/3989906800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0c157d10 con 0x7fba0c13d700 2024-04-02T07:29:21.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.770+0000 7fba13200640 1 -- 172.21.15.55:0/3989906800 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0c132cd0 con 0x7fba0c13d700 2024-04-02T07:29:21.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.774+0000 7fba06000640 1 -- 172.21.15.55:0/3989906800 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fba08007070 con 0x7fba0c13d700 2024-04-02T07:29:21.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.774+0000 7fba06000640 1 --2- 172.21.15.55:0/3989906800 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb9f0066690 0x7fb9f0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.774+0000 7fba06000640 1 -- 172.21.15.55:0/3989906800 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fba08083fe0 con 0x7fba0c13d700 2024-04-02T07:29:21.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.774+0000 7fba17d29000 1 Processor -- start 2024-04-02T07:29:21.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.774+0000 7fba11e00640 1 --2- 172.21.15.55:0/3989906800 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb9f0066690 0x7fb9f0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.774+0000 7fba17d29000 1 -- start start 2024-04-02T07:29:21.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.774+0000 7fba11e00640 1 --2- 172.21.15.55:0/3989906800 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb9f0066690 0x7fb9f0068b50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fba00007fd0 tx=0x7fba00009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:21.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.774+0000 7fba17d29000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 0x55e5ea5cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.774+0000 7fba17d29000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea5d0390 0x55e5ea5834c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.774+0000 7fba17d29000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea583a00 0x55e5ea583de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.774+0000 7fba17d29000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea44e630 con 0x55e5ea5cfa70 2024-04-02T07:29:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.774+0000 7fba17d29000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea3dbbd0 con 0x55e5ea583a00 2024-04-02T07:29:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.774+0000 7fba17d29000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea3d91a0 con 0x55e5ea5d0390 2024-04-02T07:29:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba11e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 0x55e5ea5cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba11e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 0x55e5ea5cfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50832/0 (socket says 172.21.15.55:50832) 2024-04-02T07:29:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba11e00640 1 -- 172.21.15.55:0/3016072976 learned_addr learned my addr 172.21.15.55:0/3016072976 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba11400640 1 --2- 172.21.15.55:0/3016072976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea5d0390 0x55e5ea5834c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba12800640 1 --2- 172.21.15.55:0/3016072976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea583a00 0x55e5ea583de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba11e00640 1 -- 172.21.15.55:0/3016072976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea5d0390 msgr2=0x55e5ea5834c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba11e00640 1 --2- 172.21.15.55:0/3016072976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea5d0390 0x55e5ea5834c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba11e00640 1 -- 172.21.15.55:0/3016072976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea583a00 msgr2=0x55e5ea583de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba11e00640 1 --2- 172.21.15.55:0/3016072976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea583a00 0x55e5ea583de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba11e00640 1 -- 172.21.15.55:0/3016072976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5ea0d0e20 con 0x55e5ea5cfa70 2024-04-02T07:29:21.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba12800640 1 --2- 172.21.15.55:0/3016072976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea583a00 0x55e5ea583de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:29:21.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba11e00640 1 --2- 172.21.15.55:0/3016072976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 0x55e5ea5cfe50 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fba000015e0 tx=0x7fba00012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5a353939513787 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:21.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fb9faa00640 1 -- 172.21.15.55:0/3016072976 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba000148a0 con 0x55e5ea5cfa70 2024-04-02T07:29:21.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fb9faa00640 1 -- 172.21.15.55:0/3016072976 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba00014a00 con 0x55e5ea5cfa70 2024-04-02T07:29:21.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fb9faa00640 1 -- 172.21.15.55:0/3016072976 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba00014d70 con 0x55e5ea5cfa70 2024-04-02T07:29:21.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba17d29000 1 -- 172.21.15.55:0/3016072976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 msgr2=0x55e5ea5cfe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba17d29000 1 --2- 172.21.15.55:0/3016072976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 0x55e5ea5cfe50 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fba000015e0 tx=0x7fba00012000 comp rx=0 tx=0).stop 2024-04-02T07:29:21.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba17d29000 1 -- 172.21.15.55:0/3016072976 shutdown_connections 2024-04-02T07:29:21.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba17d29000 1 --2- 172.21.15.55:0/3016072976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea583a00 0x55e5ea583de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba17d29000 1 --2- 172.21.15.55:0/3016072976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea5d0390 0x55e5ea5834c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba17d29000 1 --2- 172.21.15.55:0/3016072976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 0x55e5ea5cfe50 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba17d29000 1 -- 172.21.15.55:0/3016072976 >> 172.21.15.55:0/3016072976 conn(0x55e5ea384160 msgr2=0x55e5ea5b2820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:21.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba17d29000 1 -- 172.21.15.55:0/3016072976 shutdown_connections 2024-04-02T07:29:21.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba17d29000 1 -- 172.21.15.55:0/3016072976 wait complete. 2024-04-02T07:29:21.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba17d29000 1 -- start start 2024-04-02T07:29:21.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba17d29000 1 Processor -- start 2024-04-02T07:29:21.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba17d29000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea583a00 0x55e5ea58bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba17d29000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea5cfa70 0x55e5ea5b3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba17d29000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea5d0390 0x55e5ea5b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba17d29000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea3d4a90 con 0x55e5ea583a00 2024-04-02T07:29:21.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba17d29000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea373d40 con 0x55e5ea5d0390 2024-04-02T07:29:21.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba17d29000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea391f30 con 0x55e5ea5cfa70 2024-04-02T07:29:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba17d29000 10 client.0 _ll_register_callbacks cb 0x55e5ea436810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:29:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba11e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea583a00 0x55e5ea58bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba11e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea583a00 0x55e5ea58bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50836/0 (socket says 172.21.15.55:50836) 2024-04-02T07:29:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.778+0000 7fba11e00640 1 -- 172.21.15.55:0/3280059553 learned_addr learned my addr 172.21.15.55:0/3280059553 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba12800640 1 --2- 172.21.15.55:0/3280059553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea5d0390 0x55e5ea5b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba11400640 1 --2- 172.21.15.55:0/3280059553 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea5cfa70 0x55e5ea5b3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba11e00640 1 -- 172.21.15.55:0/3280059553 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea5cfa70 msgr2=0x55e5ea5b3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba11e00640 1 --2- 172.21.15.55:0/3280059553 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea5cfa70 0x55e5ea5b3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba11e00640 1 -- 172.21.15.55:0/3280059553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea5d0390 msgr2=0x55e5ea5b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba11e00640 1 --2- 172.21.15.55:0/3280059553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea5d0390 0x55e5ea5b3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba11e00640 1 -- 172.21.15.55:0/3280059553 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0c06a9e0 con 0x55e5ea583a00 2024-04-02T07:29:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba11400640 1 --2- 172.21.15.55:0/3280059553 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea5cfa70 0x55e5ea5b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:29:21.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba11e00640 1 --2- 172.21.15.55:0/3280059553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea583a00 0x55e5ea58bad0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fba00023040 tx=0x7fba00001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e354a31b05f1b220 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:21.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fb9ef400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:29:21.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fb9ef400640 1 -- 172.21.15.55:0/3280059553 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba000209e0 con 0x55e5ea583a00 2024-04-02T07:29:21.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 1 -- 172.21.15.55:0/3280059553 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5ea3d33e0 con 0x55e5ea583a00 2024-04-02T07:29:21.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fb9ef400640 1 -- 172.21.15.55:0/3280059553 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fba0001c040 con 0x55e5ea583a00 2024-04-02T07:29:21.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fb9ef400640 1 -- 172.21.15.55:0/3280059553 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba00020b40 con 0x55e5ea583a00 2024-04-02T07:29:21.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 10 client.7821 fetch_fsmap learned FSMap version 66 2024-04-02T07:29:21.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 1 -- 172.21.15.55:0/3280059553 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x55e5ea399aa0 con 0x55e5ea583a00 2024-04-02T07:29:21.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fb9ef400640 1 -- 172.21.15.55:0/3280059553 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e5ea3d33e0 con 0x55e5ea583a00 2024-04-02T07:29:21.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fb9ef400640 1 -- 172.21.15.55:0/3280059553 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 66) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fba00012070 con 0x55e5ea583a00 2024-04-02T07:29:21.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 10 client.7821 fetch_fsmap finished waiting for FSMap version 66 2024-04-02T07:29:21.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 10 client.7821 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-02T07:29:21.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 20 client.7821 populate_metadata read hostname 'smithi055' 2024-04-02T07:29:21.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 1 --2- 172.21.15.55:0/3280059553 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55e5ea5d6eb0 0x55e5ea5d7290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 4 client.7821 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:29:21.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 1 -- 172.21.15.55:0/3280059553 --> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e5ea3a4d00 con 0x55e5ea5d6eb0 2024-04-02T07:29:21.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba11400640 1 --2- 172.21.15.55:0/3280059553 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55e5ea5d6eb0 0x55e5ea5d7290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba11400640 1 --2- 172.21.15.55:0/3280059553 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55e5ea5d6eb0 0x55e5ea5d7290 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2b661197c6ae260 server_cookie=ea8d44c6970b379b in_seq=0 out_seq=0 2024-04-02T07:29:21.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fb9ef400640 10 client.7821 ms_handle_connect on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:21.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fb9ef400640 1 -- 172.21.15.55:0/3280059553 <== mds.0 v2:172.21.15.55:6832/821922065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e5ea3a4d00 con 0x55e5ea5d6eb0 2024-04-02T07:29:21.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fb9ef400640 10 client.7821 handle_command_reply: tid=0 2024-04-02T07:29:21.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 1 client.7821 shutdown 2024-04-02T07:29:21.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 1 -- 172.21.15.55:0/3280059553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea583a00 msgr2=0x55e5ea58bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 1 --2- 172.21.15.55:0/3280059553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea583a00 0x55e5ea58bad0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fba00023040 tx=0x7fba00001090 comp rx=0 tx=0).stop 2024-04-02T07:29:21.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 1 -- 172.21.15.55:0/3280059553 shutdown_connections 2024-04-02T07:29:21.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 1 --2- 172.21.15.55:0/3280059553 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55e5ea5d6eb0 0x55e5ea5d7290 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 1 --2- 172.21.15.55:0/3280059553 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea5d0390 0x55e5ea5b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 1 --2- 172.21.15.55:0/3280059553 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea5cfa70 0x55e5ea5b3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fb9ef400640 0 client.7821 ms_handle_reset on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:21.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 1 --2- 172.21.15.55:0/3280059553 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea583a00 0x55e5ea58bad0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 1 -- 172.21.15.55:0/3280059553 >> 172.21.15.55:0/3280059553 conn(0x55e5ea384160 msgr2=0x55e5ea582bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:21.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 1 -- 172.21.15.55:0/3280059553 shutdown_connections 2024-04-02T07:29:21.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 1 -- 172.21.15.55:0/3280059553 wait complete. 2024-04-02T07:29:21.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.782+0000 7fba17d29000 20 client.7821 trim_cache size 0 max 16384 2024-04-02T07:29:21.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.798+0000 7fba17d29000 1 Processor -- start 2024-04-02T07:29:21.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.798+0000 7fba17d29000 1 -- start start 2024-04-02T07:29:21.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.798+0000 7fba17d29000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea583a00 0x55e5ea58a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.798+0000 7fba17d29000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 0x55e5ea58aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.798+0000 7fba17d29000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea5d0390 0x55e5ea582e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.798+0000 7fba17d29000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea091aa0 con 0x55e5ea5cfa70 2024-04-02T07:29:21.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.798+0000 7fba17d29000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea418170 con 0x55e5ea5d0390 2024-04-02T07:29:21.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.798+0000 7fba17d29000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea39e640 con 0x55e5ea583a00 2024-04-02T07:29:21.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.798+0000 7fba11400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 0x55e5ea58aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.798+0000 7fba11400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 0x55e5ea58aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50852/0 (socket says 172.21.15.55:50852) 2024-04-02T07:29:21.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.798+0000 7fba11400640 1 -- 172.21.15.55:0/2306879358 learned_addr learned my addr 172.21.15.55:0/2306879358 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:21.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.798+0000 7fba12800640 1 --2- 172.21.15.55:0/2306879358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea5d0390 0x55e5ea582e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.798+0000 7fba11e00640 1 --2- 172.21.15.55:0/2306879358 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea583a00 0x55e5ea58a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.798+0000 7fba11400640 1 -- 172.21.15.55:0/2306879358 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea583a00 msgr2=0x55e5ea58a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:21.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.798+0000 7fba11400640 1 --2- 172.21.15.55:0/2306879358 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea583a00 0x55e5ea58a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.798+0000 7fba11400640 1 -- 172.21.15.55:0/2306879358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea5d0390 msgr2=0x55e5ea582e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:21.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.798+0000 7fba11400640 1 --2- 172.21.15.55:0/2306879358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea5d0390 0x55e5ea582e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.798+0000 7fba11400640 1 -- 172.21.15.55:0/2306879358 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5ea37fdf0 con 0x55e5ea5cfa70 2024-04-02T07:29:21.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.798+0000 7fba11e00640 1 --2- 172.21.15.55:0/2306879358 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea583a00 0x55e5ea58a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:29:21.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.798+0000 7fba11400640 1 --2- 172.21.15.55:0/2306879358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 0x55e5ea58aeb0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0097c0 tx=0x7fb9fc004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5017546517264dc server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:21.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fb9fb400640 1 -- 172.21.15.55:0/2306879358 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc0c4a60 con 0x55e5ea5cfa70 2024-04-02T07:29:21.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fb9fb400640 1 -- 172.21.15.55:0/2306879358 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc0c4bc0 con 0x55e5ea5cfa70 2024-04-02T07:29:21.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fb9fb400640 1 -- 172.21.15.55:0/2306879358 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc0c4070 con 0x55e5ea5cfa70 2024-04-02T07:29:21.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 1 -- 172.21.15.55:0/2306879358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 msgr2=0x55e5ea58aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 1 --2- 172.21.15.55:0/2306879358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 0x55e5ea58aeb0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0097c0 tx=0x7fb9fc004740 comp rx=0 tx=0).stop 2024-04-02T07:29:21.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 1 -- 172.21.15.55:0/2306879358 shutdown_connections 2024-04-02T07:29:21.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 1 --2- 172.21.15.55:0/2306879358 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea5d0390 0x55e5ea582e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 1 --2- 172.21.15.55:0/2306879358 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 0x55e5ea58aeb0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 1 --2- 172.21.15.55:0/2306879358 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea583a00 0x55e5ea58a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 1 -- 172.21.15.55:0/2306879358 >> 172.21.15.55:0/2306879358 conn(0x55e5ea384160 msgr2=0x55e5ea58a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:21.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 1 -- 172.21.15.55:0/2306879358 shutdown_connections 2024-04-02T07:29:21.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 1 -- 172.21.15.55:0/2306879358 wait complete. 2024-04-02T07:29:21.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 1 -- start start 2024-04-02T07:29:21.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 1 Processor -- start 2024-04-02T07:29:21.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea583a00 0x55e5ea62aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 0x55e5ea5860f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea5d0390 0x55e5ea586630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea3a0390 con 0x55e5ea5cfa70 2024-04-02T07:29:21.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea3dce60 con 0x55e5ea5d0390 2024-04-02T07:29:21.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e5ea3a40b0 con 0x55e5ea583a00 2024-04-02T07:29:21.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 10 client.0 _ll_register_callbacks cb 0x7fba00017040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:29:21.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba11400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 0x55e5ea5860f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba11400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 0x55e5ea5860f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50868/0 (socket says 172.21.15.55:50868) 2024-04-02T07:29:21.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba11400640 1 -- 172.21.15.55:0/2791396830 learned_addr learned my addr 172.21.15.55:0/2791396830 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:21.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba12800640 1 --2- 172.21.15.55:0/2791396830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea5d0390 0x55e5ea586630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba11e00640 1 --2- 172.21.15.55:0/2791396830 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea583a00 0x55e5ea62aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba11400640 1 -- 172.21.15.55:0/2791396830 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea583a00 msgr2=0x55e5ea62aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:21.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba11400640 1 --2- 172.21.15.55:0/2791396830 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea583a00 0x55e5ea62aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba11400640 1 -- 172.21.15.55:0/2791396830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea5d0390 msgr2=0x55e5ea586630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:21.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba11400640 1 --2- 172.21.15.55:0/2791396830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea5d0390 0x55e5ea586630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba11400640 1 -- 172.21.15.55:0/2791396830 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0c06afa0 con 0x55e5ea5cfa70 2024-04-02T07:29:21.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba11400640 1 --2- 172.21.15.55:0/2791396830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 0x55e5ea5860f0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009030 tx=0x7fb9fc01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=beb5a86f95b6d130 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:21.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fb9ef400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:29:21.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fb9ef400640 1 -- 172.21.15.55:0/2791396830 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc004030 con 0x55e5ea5cfa70 2024-04-02T07:29:21.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fb9ef400640 1 -- 172.21.15.55:0/2791396830 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fb9fc0ba040 con 0x55e5ea5cfa70 2024-04-02T07:29:21.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 1 -- 172.21.15.55:0/2791396830 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5ea391970 con 0x55e5ea5cfa70 2024-04-02T07:29:21.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fb9ef400640 1 -- 172.21.15.55:0/2791396830 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9fc004190 con 0x55e5ea5cfa70 2024-04-02T07:29:21.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 10 client.7827 fetch_fsmap learned FSMap version 66 2024-04-02T07:29:21.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.802+0000 7fba17d29000 1 -- 172.21.15.55:0/2791396830 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=2+}) v3 -- 0x55e5ea373960 con 0x55e5ea5cfa70 2024-04-02T07:29:21.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fb9ef400640 1 -- 172.21.15.55:0/2791396830 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e5ea391970 con 0x55e5ea5cfa70 2024-04-02T07:29:21.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fb9ef400640 1 -- 172.21.15.55:0/2791396830 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 66) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fb9fc0cb060 con 0x55e5ea5cfa70 2024-04-02T07:29:21.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba17d29000 10 client.7827 fetch_fsmap finished waiting for FSMap version 66 2024-04-02T07:29:21.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba17d29000 10 client.7827 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-02T07:29:21.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba17d29000 20 client.7827 populate_metadata read hostname 'smithi055' 2024-04-02T07:29:21.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba17d29000 1 --2- 172.21.15.55:0/2791396830 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55e5ea586b70 0x55e5ea586f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:21.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba17d29000 4 client.7827 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-02T07:29:21.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba17d29000 1 -- 172.21.15.55:0/2791396830 --> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e5ea403a20 con 0x55e5ea586b70 2024-04-02T07:29:21.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba11e00640 1 --2- 172.21.15.55:0/2791396830 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55e5ea586b70 0x55e5ea586f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:21.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba11e00640 1 --2- 172.21.15.55:0/2791396830 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55e5ea586b70 0x55e5ea586f80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f92ce990028c7bc server_cookie=db06e7335851a08b in_seq=0 out_seq=0 2024-04-02T07:29:21.811 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fb9ef400640 10 client.7827 ms_handle_connect on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:21.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fb9ef400640 1 -- 172.21.15.55:0/2791396830 <== mds.0 v2:172.21.15.55:6832/821922065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+256 (crc 0 0 0) 0x55e5ea403a20 con 0x55e5ea586b70 2024-04-02T07:29:21.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fb9ef400640 10 client.7827 handle_command_reply: tid=0 2024-04-02T07:29:21.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba17d29000 1 client.7827 shutdown 2024-04-02T07:29:21.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba17d29000 1 -- 172.21.15.55:0/2791396830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 msgr2=0x55e5ea5860f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba17d29000 1 --2- 172.21.15.55:0/2791396830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 0x55e5ea5860f0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc009030 tx=0x7fb9fc01acb0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba17d29000 1 -- 172.21.15.55:0/2791396830 shutdown_connections 2024-04-02T07:29:21.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba17d29000 1 --2- 172.21.15.55:0/2791396830 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55e5ea586b70 0x55e5ea586f80 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba17d29000 1 --2- 172.21.15.55:0/2791396830 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e5ea5d0390 0x55e5ea586630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba17d29000 1 --2- 172.21.15.55:0/2791396830 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e5ea5cfa70 0x55e5ea5860f0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba17d29000 1 --2- 172.21.15.55:0/2791396830 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e5ea583a00 0x55e5ea62aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fb9ef400640 0 client.7827 ms_handle_reset on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:21.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba17d29000 1 -- 172.21.15.55:0/2791396830 >> 172.21.15.55:0/2791396830 conn(0x55e5ea384160 msgr2=0x55e5ea58a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:21.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba17d29000 1 -- 172.21.15.55:0/2791396830 shutdown_connections 2024-04-02T07:29:21.812 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba17d29000 1 -- 172.21.15.55:0/2791396830 wait complete. 2024-04-02T07:29:21.813 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba17d29000 20 client.7827 trim_cache size 0 max 16384 2024-04-02T07:29:21.813 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:29:21.813 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-02T07:29:21.813 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-04-02T07:29:21.813 INFO:teuthology.orchestra.run.smithi055.stdout: "f090e825-14d0-459a-b046-2b80949a72c1": { 2024-04-02T07:29:21.813 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/dir", 2024-04-02T07:29:21.813 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "f090e825-14d0-459a-b046-2b80949a72c1", 2024-04-02T07:29:21.813 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive" 2024-04-02T07:29:21.813 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:29:21.813 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:29:21.814 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:29:21.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba13200640 1 -- 172.21.15.55:0/3989906800 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb9f0066690 msgr2=0x7fb9f0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba13200640 1 --2- 172.21.15.55:0/3989906800 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb9f0066690 0x7fb9f0068b50 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fba00007fd0 tx=0x7fba00009040 comp rx=0 tx=0).stop 2024-04-02T07:29:21.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba13200640 1 -- 172.21.15.55:0/3989906800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c13d700 msgr2=0x7fba0c0b47c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:21.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba13200640 1 --2- 172.21.15.55:0/3989906800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c13d700 0x7fba0c0b47c0 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7fba0800cbf0 tx=0x7fba0800a430 comp rx=0 tx=0).stop 2024-04-02T07:29:21.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba13200640 1 -- 172.21.15.55:0/3989906800 shutdown_connections 2024-04-02T07:29:21.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba13200640 1 --2- 172.21.15.55:0/3989906800 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c13d700 0x7fba0c0b47c0 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba13200640 1 --2- 172.21.15.55:0/3989906800 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fba0c0c9980 0x7fba0c0b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba13200640 1 --2- 172.21.15.55:0/3989906800 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb9f0066690 0x7fb9f0068b50 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba13200640 1 --2- 172.21.15.55:0/3989906800 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fba0c06a2d0 0x7fba0c157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:21.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba13200640 1 -- 172.21.15.55:0/3989906800 >> 172.21.15.55:0/3989906800 conn(0x7fba0c0cb6a0 msgr2=0x7fba0c0affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:21.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba13200640 1 -- 172.21.15.55:0/3989906800 shutdown_connections 2024-04-02T07:29:21.815 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:21.806+0000 7fba13200640 1 -- 172.21.15.55:0/3989906800 wait complete. 2024-04-02T07:29:21.827 INFO:tasks.cephfs.filesystem:scrub status for tag:f090e825-14d0-459a-b046-2b80949a72c1 - {'path': '/dir', 'tag': 'f090e825-14d0-459a-b046-2b80949a72c1', 'options': 'recursive'} 2024-04-02T07:29:25.156 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-02T07:29:25.154+0000 7f8f1ba00640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-04-02T07:29:44.736 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:29:44.740 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:29:51.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:51.829 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-02T07:29:51.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.982+0000 7f81d7200640 1 Processor -- start 2024-04-02T07:29:51.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.982+0000 7f81d7200640 1 -- start start 2024-04-02T07:29:51.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.982+0000 7f81d7200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81d00cb280 0x7f81d01516f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:51.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.982+0000 7f81d7200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d015b130 con 0x7f81d0065a80 2024-04-02T07:29:51.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.982+0000 7f81d7200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81d015b410 con 0x7f81d006dde0 2024-04-02T07:29:51.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.982+0000 7f81d7200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81d00b3710 con 0x7f81d00cb280 2024-04-02T07:29:51.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.982+0000 7f81d5200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81d00cb280 0x7f81d01516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:51.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.982+0000 7f81d5200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f81d00cb280 0x7f81d01516f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55698/0 (socket says 172.21.15.55:55698) 2024-04-02T07:29:51.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.982+0000 7f81d5200640 1 -- 172.21.15.55:0/2105116389 learned_addr learned my addr 172.21.15.55:0/2105116389 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:51.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.982+0000 7f81c7400640 1 --1- 172.21.15.55:0/2105116389 >> v1:172.21.15.55:6789/0 conn(0x7f81d0065a80 0x7f81d0150fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44784/0 (socket says 172.21.15.55:44784) 2024-04-02T07:29:51.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.982+0000 7f81d5200640 1 -- 172.21.15.55:0/2105116389 >> v1:172.21.15.106:6789/0 conn(0x7f81d006dde0 legacy=0x7f81d006e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:51.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.982+0000 7f81d5200640 1 -- 172.21.15.55:0/2105116389 >> v1:172.21.15.55:6789/0 conn(0x7f81d0065a80 legacy=0x7f81d0150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:51.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.982+0000 7f81d5200640 1 -- 172.21.15.55:0/2105116389 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81d015b6f0 con 0x7f81d00cb280 2024-04-02T07:29:51.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.982+0000 7f81cf400640 1 -- 172.21.15.55:0/2105116389 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4158404097 0 0) 0x7f81d015b130 con 0x7f81d0065a80 2024-04-02T07:29:51.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.986+0000 7f81d5200640 1 --2- 172.21.15.55:0/2105116389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81d00cb280 0x7f81d01516f0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009e50 tx=0x7f81c801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f5426599df592fe server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:51.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.986+0000 7f81cf400640 1 -- 172.21.15.55:0/2105116389 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c80a56c0 con 0x7f81d00cb280 2024-04-02T07:29:51.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.986+0000 7f81cf400640 1 -- 172.21.15.55:0/2105116389 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c80a5820 con 0x7f81d00cb280 2024-04-02T07:29:51.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.986+0000 7f81cf400640 1 -- 172.21.15.55:0/2105116389 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c80a5bb0 con 0x7f81d00cb280 2024-04-02T07:29:51.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.986+0000 7f81d7200640 1 -- 172.21.15.55:0/2105116389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81d00cb280 msgr2=0x7f81d01516f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:51.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.986+0000 7f81d7200640 1 --2- 172.21.15.55:0/2105116389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81d00cb280 0x7f81d01516f0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f81c8009e50 tx=0x7f81c801c9f0 comp rx=0 tx=0).stop 2024-04-02T07:29:51.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.986+0000 7f81d7200640 1 -- 172.21.15.55:0/2105116389 shutdown_connections 2024-04-02T07:29:51.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.986+0000 7f81d7200640 1 --2- 172.21.15.55:0/2105116389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81d00cb280 0x7f81d01516f0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:51.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.986+0000 7f81d7200640 1 -- 172.21.15.55:0/2105116389 >> 172.21.15.55:0/2105116389 conn(0x7f81d00ced90 msgr2=0x7f81d00cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:51.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.986+0000 7f81d7200640 1 -- 172.21.15.55:0/2105116389 shutdown_connections 2024-04-02T07:29:51.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.986+0000 7f81d7200640 1 -- 172.21.15.55:0/2105116389 wait complete. 2024-04-02T07:29:51.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81d7200640 1 Processor -- start 2024-04-02T07:29:51.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81d7200640 1 -- start start 2024-04-02T07:29:51.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81d7200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81d0065a80 0x7f81d0151e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:51.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81d7200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81d006dde0 0x7f81d013cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:51.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81d7200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81d00cb280 0x7f81d0150670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:51.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81d7200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d015e280 con 0x7f81d0065a80 2024-04-02T07:29:51.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81d7200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d014f430 con 0x7f81d00cb280 2024-04-02T07:29:51.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81d7200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81d014f710 con 0x7f81d006dde0 2024-04-02T07:29:51.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81cfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81d0065a80 0x7f81d0151e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:51.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81cfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81d0065a80 0x7f81d0151e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55710/0 (socket says 172.21.15.55:55710) 2024-04-02T07:29:51.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81cfe00640 1 -- 172.21.15.55:0/1792629088 learned_addr learned my addr 172.21.15.55:0/1792629088 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:51.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81d5200640 1 --2- 172.21.15.55:0/1792629088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81d00cb280 0x7f81d0150670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:51.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81c7400640 1 --2- 172.21.15.55:0/1792629088 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81d006dde0 0x7f81d013cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:51.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81cfe00640 1 -- 172.21.15.55:0/1792629088 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81d006dde0 msgr2=0x7f81d013cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:51.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81cfe00640 1 --2- 172.21.15.55:0/1792629088 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81d006dde0 0x7f81d013cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:51.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81cfe00640 1 -- 172.21.15.55:0/1792629088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81d00cb280 msgr2=0x7f81d0150670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:51.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81cfe00640 1 --2- 172.21.15.55:0/1792629088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81d00cb280 0x7f81d0150670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:51.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81cfe00640 1 -- 172.21.15.55:0/1792629088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c8009b30 con 0x7f81d0065a80 2024-04-02T07:29:51.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81d5200640 1 --2- 172.21.15.55:0/1792629088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81d00cb280 0x7f81d0150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:29:51.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81cfe00640 1 --2- 172.21.15.55:0/1792629088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81d0065a80 0x7f81d0151e40 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f81c000c450 tx=0x7f81c000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:51.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81ccc00640 1 -- 172.21.15.55:0/1792629088 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0012830 con 0x7f81d0065a80 2024-04-02T07:29:51.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81ccc00640 1 -- 172.21.15.55:0/1792629088 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c00129b0 con 0x7f81d0065a80 2024-04-02T07:29:51.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81ccc00640 1 -- 172.21.15.55:0/1792629088 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0012d60 con 0x7f81d0065a80 2024-04-02T07:29:51.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81d7200640 1 -- 172.21.15.55:0/1792629088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d014f9f0 con 0x7f81d0065a80 2024-04-02T07:29:51.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.990+0000 7f81d7200640 1 -- 172.21.15.55:0/1792629088 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d013d450 con 0x7f81d0065a80 2024-04-02T07:29:51.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.994+0000 7f81ccc00640 1 -- 172.21.15.55:0/1792629088 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f81c001c460 con 0x7f81d0065a80 2024-04-02T07:29:51.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.994+0000 7f81ccc00640 1 --2- 172.21.15.55:0/1792629088 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f81ac066690 0x7f81ac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:51.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.994+0000 7f81ccc00640 1 -- 172.21.15.55:0/1792629088 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f81c0084110 con 0x7f81d0065a80 2024-04-02T07:29:51.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.994+0000 7f81c7400640 1 --2- 172.21.15.55:0/1792629088 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f81ac066690 0x7f81ac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:51.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.994+0000 7f81da63a000 1 Processor -- start 2024-04-02T07:29:51.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.994+0000 7f81da63a000 1 -- start start 2024-04-02T07:29:51.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.994+0000 7f81c7400640 1 --2- 172.21.15.55:0/1792629088 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f81ac066690 0x7f81ac068b50 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f81d006f190 tx=0x7f81b8007c10 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:51.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.994+0000 7f81da63a000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51ba70 0x55e7be51be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:51.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.994+0000 7f81da63a000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be51c390 0x55e7be4cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:51.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.994+0000 7f81da63a000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e7be4cfa00 0x55e7be4cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:51.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.994+0000 7f81da63a000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7be39a630 con 0x55e7be51c390 2024-04-02T07:29:51.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.994+0000 7f81da63a000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7be327bd0 con 0x55e7be51ba70 2024-04-02T07:29:51.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.994+0000 7f81da63a000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7be3251a0 con 0x55e7be4cfa00 2024-04-02T07:29:51.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.994+0000 7f81c7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be51c390 0x55e7be4cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:51.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.994+0000 7f81c7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be51c390 0x55e7be4cf4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55720/0 (socket says 172.21.15.55:55720) 2024-04-02T07:29:51.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.994+0000 7f81c7400640 1 -- 172.21.15.55:0/2826178819 learned_addr learned my addr 172.21.15.55:0/2826178819 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:51.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.994+0000 7f81cfe00640 1 --2- 172.21.15.55:0/2826178819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51ba70 0x55e7be51be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:51.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81d5200640 1 --2- 172.21.15.55:0/2826178819 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e7be4cfa00 0x55e7be4cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:51.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81c7400640 1 -- 172.21.15.55:0/2826178819 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e7be4cfa00 msgr2=0x55e7be4cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:51.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81c7400640 1 --2- 172.21.15.55:0/2826178819 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e7be4cfa00 0x55e7be4cfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:51.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81c7400640 1 -- 172.21.15.55:0/2826178819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51ba70 msgr2=0x55e7be51be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:51.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81c7400640 1 --2- 172.21.15.55:0/2826178819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51ba70 0x55e7be51be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:51.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81c7400640 1 -- 172.21.15.55:0/2826178819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7be01ce20 con 0x55e7be51c390 2024-04-02T07:29:51.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81cfe00640 1 --2- 172.21.15.55:0/2826178819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51ba70 0x55e7be51be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:29:52.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81c7400640 1 --2- 172.21.15.55:0/2826178819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be51c390 0x55e7be4cf4c0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f81b8005d90 tx=0x7f81b8012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b50a397c9068005 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:52.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81c4c00640 1 -- 172.21.15.55:0/2826178819 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8005e80 con 0x55e7be51c390 2024-04-02T07:29:52.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81c4c00640 1 -- 172.21.15.55:0/2826178819 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81b8015110 con 0x55e7be51c390 2024-04-02T07:29:52.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81c4c00640 1 -- 172.21.15.55:0/2826178819 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81b8015bc0 con 0x55e7be51c390 2024-04-02T07:29:52.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81da63a000 1 -- 172.21.15.55:0/2826178819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be51c390 msgr2=0x55e7be4cf4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81da63a000 1 --2- 172.21.15.55:0/2826178819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be51c390 0x55e7be4cf4c0 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f81b8005d90 tx=0x7f81b8012000 comp rx=0 tx=0).stop 2024-04-02T07:29:52.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81da63a000 1 -- 172.21.15.55:0/2826178819 shutdown_connections 2024-04-02T07:29:52.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81da63a000 1 --2- 172.21.15.55:0/2826178819 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e7be4cfa00 0x55e7be4cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81da63a000 1 --2- 172.21.15.55:0/2826178819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be51c390 0x55e7be4cf4c0 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81da63a000 1 --2- 172.21.15.55:0/2826178819 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51ba70 0x55e7be51be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81da63a000 1 -- 172.21.15.55:0/2826178819 >> 172.21.15.55:0/2826178819 conn(0x55e7be2d0160 msgr2=0x55e7be4fe820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:52.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81da63a000 1 -- 172.21.15.55:0/2826178819 shutdown_connections 2024-04-02T07:29:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81da63a000 1 -- 172.21.15.55:0/2826178819 wait complete. 2024-04-02T07:29:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81da63a000 1 -- start start 2024-04-02T07:29:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81da63a000 1 Processor -- start 2024-04-02T07:29:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81da63a000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be4cfa00 0x55e7be4d87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81da63a000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e7be51ba70 0x55e7be4ffa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81da63a000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51c390 0x55e7be4fff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81da63a000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7be320a90 con 0x55e7be4cfa00 2024-04-02T07:29:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81da63a000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7be2bfd40 con 0x55e7be51c390 2024-04-02T07:29:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81da63a000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7be2ddf30 con 0x55e7be51ba70 2024-04-02T07:29:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81da63a000 10 client.0 _ll_register_callbacks cb 0x55e7be382810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:29:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81cfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be4cfa00 0x55e7be4d87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81cfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be4cfa00 0x55e7be4d87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55726/0 (socket says 172.21.15.55:55726) 2024-04-02T07:29:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81cfe00640 1 -- 172.21.15.55:0/1717160035 learned_addr learned my addr 172.21.15.55:0/1717160035 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81c7400640 1 --2- 172.21.15.55:0/1717160035 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e7be51ba70 0x55e7be4ffa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:51.998+0000 7f81d5200640 1 --2- 172.21.15.55:0/1717160035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51c390 0x55e7be4fff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81cfe00640 1 -- 172.21.15.55:0/1717160035 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e7be51ba70 msgr2=0x55e7be4ffa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:52.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81cfe00640 1 --2- 172.21.15.55:0/1717160035 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e7be51ba70 0x55e7be4ffa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81cfe00640 1 -- 172.21.15.55:0/1717160035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51c390 msgr2=0x55e7be4fff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:52.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81cfe00640 1 --2- 172.21.15.55:0/1717160035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51c390 0x55e7be4fff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81cfe00640 1 -- 172.21.15.55:0/1717160035 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d013d450 con 0x55e7be4cfa00 2024-04-02T07:29:52.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81d5200640 1 --2- 172.21.15.55:0/1717160035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51c390 0x55e7be4fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:29:52.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81cfe00640 1 --2- 172.21.15.55:0/1717160035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be4cfa00 0x55e7be4d87b0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f81c00824f0 tx=0x7f81c0058e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e3d70b74e712e46 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:52.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81bd600640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:29:52.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81bd600640 1 -- 172.21.15.55:0/1717160035 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0051760 con 0x55e7be4cfa00 2024-04-02T07:29:52.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81bd600640 1 -- 172.21.15.55:0/1717160035 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f81c00518c0 con 0x55e7be4cfa00 2024-04-02T07:29:52.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 1 -- 172.21.15.55:0/1717160035 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7be31f3e0 con 0x55e7be4cfa00 2024-04-02T07:29:52.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81bd600640 1 -- 172.21.15.55:0/1717160035 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81c0082250 con 0x55e7be4cfa00 2024-04-02T07:29:52.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 10 client.7842 fetch_fsmap learned FSMap version 67 2024-04-02T07:29:52.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 1 -- 172.21.15.55:0/1717160035 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x7f81b800f040 con 0x55e7be4cfa00 2024-04-02T07:29:52.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81bd600640 1 -- 172.21.15.55:0/1717160035 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e7be31f3e0 con 0x55e7be4cfa00 2024-04-02T07:29:52.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81bd600640 1 -- 172.21.15.55:0/1717160035 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 67) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f81c0054540 con 0x55e7be4cfa00 2024-04-02T07:29:52.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 10 client.7842 fetch_fsmap finished waiting for FSMap version 67 2024-04-02T07:29:52.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 10 client.7842 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-02T07:29:52.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 20 client.7842 populate_metadata read hostname 'smithi055' 2024-04-02T07:29:52.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 1 --2- 172.21.15.55:0/1717160035 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55e7be5232d0 0x55e7be5236b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 4 client.7842 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:29:52.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 1 -- 172.21.15.55:0/1717160035 --> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e7be2f0d00 con 0x55e7be5232d0 2024-04-02T07:29:52.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81c7400640 1 --2- 172.21.15.55:0/1717160035 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55e7be5232d0 0x55e7be5236b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81c7400640 1 --2- 172.21.15.55:0/1717160035 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55e7be5232d0 0x55e7be5236b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a80344b9bd1f83a6 server_cookie=eb16edec30644d7f in_seq=0 out_seq=0 2024-04-02T07:29:52.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81bd600640 10 client.7842 ms_handle_connect on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:52.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81bd600640 1 -- 172.21.15.55:0/1717160035 <== mds.0 v2:172.21.15.55:6832/821922065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e7be2f0d00 con 0x55e7be5232d0 2024-04-02T07:29:52.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81bd600640 10 client.7842 handle_command_reply: tid=0 2024-04-02T07:29:52.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 1 client.7842 shutdown 2024-04-02T07:29:52.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 1 -- 172.21.15.55:0/1717160035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be4cfa00 msgr2=0x55e7be4d87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 1 --2- 172.21.15.55:0/1717160035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be4cfa00 0x55e7be4d87b0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f81c00824f0 tx=0x7f81c0058e80 comp rx=0 tx=0).stop 2024-04-02T07:29:52.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 1 -- 172.21.15.55:0/1717160035 shutdown_connections 2024-04-02T07:29:52.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 1 --2- 172.21.15.55:0/1717160035 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55e7be5232d0 0x55e7be5236b0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 1 --2- 172.21.15.55:0/1717160035 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51c390 0x55e7be4fff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 1 --2- 172.21.15.55:0/1717160035 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e7be51ba70 0x55e7be4ffa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81bd600640 0 client.7842 ms_handle_reset on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:52.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 1 --2- 172.21.15.55:0/1717160035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be4cfa00 0x55e7be4d87b0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 1 -- 172.21.15.55:0/1717160035 >> 172.21.15.55:0/1717160035 conn(0x55e7be2d0160 msgr2=0x55e7be4cebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:52.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 1 -- 172.21.15.55:0/1717160035 shutdown_connections 2024-04-02T07:29:52.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 1 -- 172.21.15.55:0/1717160035 wait complete. 2024-04-02T07:29:52.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.002+0000 7f81da63a000 20 client.7842 trim_cache size 0 max 16384 2024-04-02T07:29:52.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.018+0000 7f81da63a000 1 Processor -- start 2024-04-02T07:29:52.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.018+0000 7f81da63a000 1 -- start start 2024-04-02T07:29:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.018+0000 7f81da63a000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be4cfa00 0x55e7be4cec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.018+0000 7f81da63a000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51ba70 0x55e7be4cf170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.018+0000 7f81da63a000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e7be51c390 0x55e7be4cfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.018+0000 7f81da63a000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7bdfddaa0 con 0x55e7be4cfa00 2024-04-02T07:29:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.018+0000 7f81da63a000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7be31e2a0 con 0x55e7be51ba70 2024-04-02T07:29:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.018+0000 7f81da63a000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7be4d8a30 con 0x55e7be51c390 2024-04-02T07:29:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.018+0000 7f81cfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be4cfa00 0x55e7be4cec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.018+0000 7f81cfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be4cfa00 0x55e7be4cec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55740/0 (socket says 172.21.15.55:55740) 2024-04-02T07:29:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.018+0000 7f81cfe00640 1 -- 172.21.15.55:0/466803418 learned_addr learned my addr 172.21.15.55:0/466803418 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:52.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.018+0000 7f81cfe00640 1 -- 172.21.15.55:0/466803418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e7be51c390 msgr2=0x55e7be4cfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.018+0000 7f81cfe00640 1 --2- 172.21.15.55:0/466803418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e7be51c390 0x55e7be4cfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.018+0000 7f81cfe00640 1 -- 172.21.15.55:0/466803418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51ba70 msgr2=0x55e7be4cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.018+0000 7f81c7400640 1 --2- 172.21.15.55:0/466803418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51ba70 0x55e7be4cf170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.018+0000 7f81cfe00640 1 --2- 172.21.15.55:0/466803418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51ba70 0x55e7be4cf170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.018+0000 7f81cfe00640 1 -- 172.21.15.55:0/466803418 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e7be2e5aa0 con 0x55e7be4cfa00 2024-04-02T07:29:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.018+0000 7f81c7400640 1 --2- 172.21.15.55:0/466803418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51ba70 0x55e7be4cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:29:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.018+0000 7f81cfe00640 1 --2- 172.21.15.55:0/466803418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be4cfa00 0x55e7be4cec30 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f81c0051020 tx=0x7f81c001e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b95ad8cd91369f38 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.018+0000 7f81c5600640 1 -- 172.21.15.55:0/466803418 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c000e040 con 0x55e7be4cfa00 2024-04-02T07:29:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81c5600640 1 -- 172.21.15.55:0/466803418 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81c0068e90 con 0x55e7be4cfa00 2024-04-02T07:29:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81c5600640 1 -- 172.21.15.55:0/466803418 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c0050e40 con 0x55e7be4cfa00 2024-04-02T07:29:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81da63a000 1 -- 172.21.15.55:0/466803418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be4cfa00 msgr2=0x55e7be4cec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81da63a000 1 --2- 172.21.15.55:0/466803418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be4cfa00 0x55e7be4cec30 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f81c0051020 tx=0x7f81c001e000 comp rx=0 tx=0).stop 2024-04-02T07:29:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81da63a000 1 -- 172.21.15.55:0/466803418 shutdown_connections 2024-04-02T07:29:52.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81da63a000 1 --2- 172.21.15.55:0/466803418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e7be51c390 0x55e7be4cfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81da63a000 1 --2- 172.21.15.55:0/466803418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51ba70 0x55e7be4cf170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81da63a000 1 --2- 172.21.15.55:0/466803418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be4cfa00 0x55e7be4cec30 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81da63a000 1 -- 172.21.15.55:0/466803418 >> 172.21.15.55:0/466803418 conn(0x55e7be2d0160 msgr2=0x55e7be4d7810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:52.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81da63a000 1 -- 172.21.15.55:0/466803418 shutdown_connections 2024-04-02T07:29:52.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81da63a000 1 -- 172.21.15.55:0/466803418 wait complete. 2024-04-02T07:29:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81da63a000 1 -- start start 2024-04-02T07:29:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81da63a000 1 Processor -- start 2024-04-02T07:29:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81da63a000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e7be4cfa00 0x55e7be4d33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81da63a000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51ba70 0x55e7be5778d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81da63a000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be51c390 0x55e7be577e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81da63a000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7be5000e0 con 0x55e7be51c390 2024-04-02T07:29:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81da63a000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e7be2e2980 con 0x55e7be51ba70 2024-04-02T07:29:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81da63a000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e7be31c280 con 0x55e7be4cfa00 2024-04-02T07:29:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81da63a000 10 client.0 _ll_register_callbacks cb 0x7f81b8007da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:29:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81d5200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be51c390 0x55e7be577e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81d5200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be51c390 0x55e7be577e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55750/0 (socket says 172.21.15.55:55750) 2024-04-02T07:29:52.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81d5200640 1 -- 172.21.15.55:0/1129578211 learned_addr learned my addr 172.21.15.55:0/1129578211 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81cfe00640 1 --2- 172.21.15.55:0/1129578211 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e7be4cfa00 0x55e7be4d33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81c7400640 1 --2- 172.21.15.55:0/1129578211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51ba70 0x55e7be5778d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81d5200640 1 -- 172.21.15.55:0/1129578211 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e7be4cfa00 msgr2=0x55e7be4d33f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81d5200640 1 --2- 172.21.15.55:0/1129578211 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e7be4cfa00 0x55e7be4d33f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81d5200640 1 -- 172.21.15.55:0/1129578211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51ba70 msgr2=0x55e7be5778d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81d5200640 1 --2- 172.21.15.55:0/1129578211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51ba70 0x55e7be5778d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81d5200640 1 -- 172.21.15.55:0/1129578211 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b800f040 con 0x55e7be51c390 2024-04-02T07:29:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81d5200640 1 --2- 172.21.15.55:0/1129578211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be51c390 0x55e7be577e10 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f81c8019600 tx=0x7f81c801b230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e60cf34e2042fca8 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81bd600640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:29:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81bd600640 1 -- 172.21.15.55:0/1129578211 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81c80a5d10 con 0x55e7be51c390 2024-04-02T07:29:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81bd600640 1 -- 172.21.15.55:0/1129578211 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f81c80c2b40 con 0x55e7be51c390 2024-04-02T07:29:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.022+0000 7f81da63a000 1 -- 172.21.15.55:0/1129578211 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e7be2dd970 con 0x55e7be51c390 2024-04-02T07:29:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81bd600640 1 -- 172.21.15.55:0/1129578211 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81c80a5e70 con 0x55e7be51c390 2024-04-02T07:29:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81da63a000 10 client.7848 fetch_fsmap learned FSMap version 67 2024-04-02T07:29:52.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81da63a000 1 -- 172.21.15.55:0/1129578211 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x55e7be2cbdf0 con 0x55e7be51c390 2024-04-02T07:29:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81bd600640 1 -- 172.21.15.55:0/1129578211 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e7be2dd970 con 0x55e7be51c390 2024-04-02T07:29:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81bd600640 1 -- 172.21.15.55:0/1129578211 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 67) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f81c8005d20 con 0x55e7be51c390 2024-04-02T07:29:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81da63a000 10 client.7848 fetch_fsmap finished waiting for FSMap version 67 2024-04-02T07:29:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81da63a000 10 client.7848 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-02T07:29:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81da63a000 20 client.7848 populate_metadata read hostname 'smithi055' 2024-04-02T07:29:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81da63a000 1 --2- 172.21.15.55:0/1129578211 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55e7be578350 0x55e7be578760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81da63a000 4 client.7848 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-02T07:29:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81da63a000 1 -- 172.21.15.55:0/1129578211 --> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e7be34fa20 con 0x55e7be578350 2024-04-02T07:29:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81cfe00640 1 --2- 172.21.15.55:0/1129578211 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55e7be578350 0x55e7be578760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81cfe00640 1 --2- 172.21.15.55:0/1129578211 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55e7be578350 0x55e7be578760 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=931a9728210b8bff server_cookie=8792fe64e8ad8ece in_seq=0 out_seq=0 2024-04-02T07:29:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81bd600640 10 client.7848 ms_handle_connect on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81bd600640 1 -- 172.21.15.55:0/1129578211 <== mds.0 v2:172.21.15.55:6832/821922065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55e7be34fa20 con 0x55e7be578350 2024-04-02T07:29:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81bd600640 10 client.7848 handle_command_reply: tid=0 2024-04-02T07:29:52.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81da63a000 1 client.7848 shutdown 2024-04-02T07:29:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81da63a000 1 -- 172.21.15.55:0/1129578211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be51c390 msgr2=0x55e7be577e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81da63a000 1 --2- 172.21.15.55:0/1129578211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be51c390 0x55e7be577e10 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f81c8019600 tx=0x7f81c801b230 comp rx=0 tx=0).stop 2024-04-02T07:29:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81da63a000 1 -- 172.21.15.55:0/1129578211 shutdown_connections 2024-04-02T07:29:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81da63a000 1 --2- 172.21.15.55:0/1129578211 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55e7be578350 0x55e7be578760 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81da63a000 1 --2- 172.21.15.55:0/1129578211 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e7be51c390 0x55e7be577e10 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81da63a000 1 --2- 172.21.15.55:0/1129578211 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e7be51ba70 0x55e7be5778d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81bd600640 0 client.7848 ms_handle_reset on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81da63a000 1 --2- 172.21.15.55:0/1129578211 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e7be4cfa00 0x55e7be4d33f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81da63a000 1 -- 172.21.15.55:0/1129578211 >> 172.21.15.55:0/1129578211 conn(0x55e7be2d0160 msgr2=0x55e7be4cdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81da63a000 1 -- 172.21.15.55:0/1129578211 shutdown_connections 2024-04-02T07:29:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81da63a000 1 -- 172.21.15.55:0/1129578211 wait complete. 2024-04-02T07:29:52.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81da63a000 20 client.7848 trim_cache size 0 max 16384 2024-04-02T07:29:52.032 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:29:52.032 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-04-02T07:29:52.032 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-04-02T07:29:52.032 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:29:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81d7200640 1 -- 172.21.15.55:0/1792629088 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f81ac066690 msgr2=0x7f81ac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81d7200640 1 --2- 172.21.15.55:0/1792629088 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f81ac066690 0x7f81ac068b50 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f81d006f190 tx=0x7f81b8007c10 comp rx=0 tx=0).stop 2024-04-02T07:29:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81d7200640 1 -- 172.21.15.55:0/1792629088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81d0065a80 msgr2=0x7f81d0151e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81d7200640 1 --2- 172.21.15.55:0/1792629088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81d0065a80 0x7f81d0151e40 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f81c000c450 tx=0x7f81c000c910 comp rx=0 tx=0).stop 2024-04-02T07:29:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81d7200640 1 -- 172.21.15.55:0/1792629088 shutdown_connections 2024-04-02T07:29:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81d7200640 1 --2- 172.21.15.55:0/1792629088 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f81ac066690 0x7f81ac068b50 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81d7200640 1 --2- 172.21.15.55:0/1792629088 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81d00cb280 0x7f81d0150670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81d7200640 1 --2- 172.21.15.55:0/1792629088 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81d006dde0 0x7f81d013cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81d7200640 1 --2- 172.21.15.55:0/1792629088 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81d0065a80 0x7f81d0151e40 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81d7200640 1 -- 172.21.15.55:0/1792629088 >> 172.21.15.55:0/1792629088 conn(0x7f81d00ced90 msgr2=0x7f81d0151200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81d7200640 1 -- 172.21.15.55:0/1792629088 shutdown_connections 2024-04-02T07:29:52.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.026+0000 7f81d7200640 1 -- 172.21.15.55:0/1792629088 wait complete. 2024-04-02T07:29:52.047 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-02T07:29:52.047 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:29:52.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.186+0000 7ff331400640 1 Processor -- start 2024-04-02T07:29:52.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.186+0000 7ff331400640 1 -- start start 2024-04-02T07:29:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.186+0000 7ff331400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff32c15cbe0 0x7ff32c0ce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.186+0000 7ff331400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff32c065d20 0x7ff32c0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.186+0000 7ff331400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff32c070a80 0x7ff32c070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.186+0000 7ff331400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff32c0cec10 con 0x7ff32c070a80 2024-04-02T07:29:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.186+0000 7ff331400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff32c071450 con 0x7ff32c065d20 2024-04-02T07:29:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.186+0000 7ff331400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c06d5b0 con 0x7ff32c15cbe0 2024-04-02T07:29:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.186+0000 7ff32b200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff32c070a80 0x7ff32c070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.186+0000 7ff32b200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff32c070a80 0x7ff32c070f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55766/0 (socket says 172.21.15.55:55766) 2024-04-02T07:29:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.186+0000 7ff32b200640 1 -- 172.21.15.55:0/2540026474 learned_addr learned my addr 172.21.15.55:0/2540026474 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.186+0000 7ff32a800640 1 --2- 172.21.15.55:0/2540026474 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff32c15cbe0 0x7ff32c0ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.186+0000 7ff321e00640 1 --2- 172.21.15.55:0/2540026474 >> v2:172.21.15.106:3300/0 conn(0x7ff32c065d20 0x7ff32c0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.186+0000 7ff32b200640 1 -- 172.21.15.55:0/2540026474 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff32c15cbe0 msgr2=0x7ff32c0ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.186+0000 7ff32b200640 1 --2- 172.21.15.55:0/2540026474 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff32c15cbe0 0x7ff32c0ce630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.186+0000 7ff32b200640 1 -- 172.21.15.55:0/2540026474 >> v2:172.21.15.106:3300/0 conn(0x7ff32c065d20 msgr2=0x7ff32c0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.186+0000 7ff32b200640 1 --2- 172.21.15.55:0/2540026474 >> v2:172.21.15.106:3300/0 conn(0x7ff32c065d20 0x7ff32c0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.186+0000 7ff32b200640 1 -- 172.21.15.55:0/2540026474 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff32c06cc80 con 0x7ff32c070a80 2024-04-02T07:29:52.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.190+0000 7ff32b200640 1 --2- 172.21.15.55:0/2540026474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff32c070a80 0x7ff32c070f10 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7ff32c06c7b0 tx=0x7ff32401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1aff04464d144c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:52.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.190+0000 7ff329e00640 1 -- 172.21.15.55:0/2540026474 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3240a5760 con 0x7ff32c070a80 2024-04-02T07:29:52.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.190+0000 7ff329e00640 1 -- 172.21.15.55:0/2540026474 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3240a58c0 con 0x7ff32c070a80 2024-04-02T07:29:52.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.190+0000 7ff329e00640 1 -- 172.21.15.55:0/2540026474 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3240a5c50 con 0x7ff32c070a80 2024-04-02T07:29:52.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.190+0000 7ff331400640 1 -- 172.21.15.55:0/2540026474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff32c070a80 msgr2=0x7ff32c070f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.190+0000 7ff331400640 1 --2- 172.21.15.55:0/2540026474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff32c070a80 0x7ff32c070f10 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7ff32c06c7b0 tx=0x7ff32401c9f0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.190+0000 7ff331400640 1 -- 172.21.15.55:0/2540026474 shutdown_connections 2024-04-02T07:29:52.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.190+0000 7ff331400640 1 --2- 172.21.15.55:0/2540026474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff32c070a80 0x7ff32c070f10 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.190+0000 7ff331400640 1 --2- 172.21.15.55:0/2540026474 >> v2:172.21.15.106:3300/0 conn(0x7ff32c065d20 0x7ff32c0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.190+0000 7ff331400640 1 --2- 172.21.15.55:0/2540026474 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff32c15cbe0 0x7ff32c0ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.190+0000 7ff331400640 1 -- 172.21.15.55:0/2540026474 >> 172.21.15.55:0/2540026474 conn(0x7ff32c0ced50 msgr2=0x7ff32c0cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:52.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.190+0000 7ff331400640 1 -- 172.21.15.55:0/2540026474 shutdown_connections 2024-04-02T07:29:52.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.190+0000 7ff331400640 1 -- 172.21.15.55:0/2540026474 wait complete. 2024-04-02T07:29:52.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff331400640 1 Processor -- start 2024-04-02T07:29:52.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff331400640 1 -- start start 2024-04-02T07:29:52.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff331400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff32c065d20 0x7ff32c151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff331400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff32c070a80 0x7ff32c0abd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff331400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff32c15cbe0 0x7ff32c0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff331400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c148440 con 0x7ff32c065d20 2024-04-02T07:29:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff331400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c151e60 con 0x7ff32c15cbe0 2024-04-02T07:29:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff331400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff32c152140 con 0x7ff32c070a80 2024-04-02T07:29:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff32a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff32c065d20 0x7ff32c151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff32a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff32c065d20 0x7ff32c151860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55778/0 (socket says 172.21.15.55:55778) 2024-04-02T07:29:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff32a800640 1 -- 172.21.15.55:0/372627639 learned_addr learned my addr 172.21.15.55:0/372627639 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff32b200640 1 --2- 172.21.15.55:0/372627639 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff32c15cbe0 0x7ff32c0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff321e00640 1 --2- 172.21.15.55:0/372627639 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff32c070a80 0x7ff32c0abd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff32a800640 1 -- 172.21.15.55:0/372627639 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff32c070a80 msgr2=0x7ff32c0abd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff32a800640 1 --2- 172.21.15.55:0/372627639 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff32c070a80 0x7ff32c0abd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff32a800640 1 -- 172.21.15.55:0/372627639 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff32c15cbe0 msgr2=0x7ff32c0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff32a800640 1 --2- 172.21.15.55:0/372627639 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff32c15cbe0 0x7ff32c0b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff32a800640 1 -- 172.21.15.55:0/372627639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff324009b30 con 0x7ff32c065d20 2024-04-02T07:29:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff32b200640 1 --2- 172.21.15.55:0/372627639 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff32c15cbe0 0x7ff32c0b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:29:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff32a800640 1 --2- 172.21.15.55:0/372627639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff32c065d20 0x7ff32c151860 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00d5f0 tx=0x7ff31c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff323400640 1 -- 172.21.15.55:0/372627639 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c0125f0 con 0x7ff32c065d20 2024-04-02T07:29:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff323400640 1 -- 172.21.15.55:0/372627639 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff31c012750 con 0x7ff32c065d20 2024-04-02T07:29:52.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff323400640 1 -- 172.21.15.55:0/372627639 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff31c012ae0 con 0x7ff32c065d20 2024-04-02T07:29:52.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff331400640 1 -- 172.21.15.55:0/372627639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff32c152420 con 0x7ff32c065d20 2024-04-02T07:29:52.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.194+0000 7ff331400640 1 -- 172.21.15.55:0/372627639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff32c149dd0 con 0x7ff32c065d20 2024-04-02T07:29:52.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.198+0000 7ff331400640 1 -- 172.21.15.55:0/372627639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff32c152660 con 0x7ff32c065d20 2024-04-02T07:29:52.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.198+0000 7ff323400640 1 -- 172.21.15.55:0/372627639 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff31c012c40 con 0x7ff32c065d20 2024-04-02T07:29:52.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.198+0000 7ff323400640 1 --2- 172.21.15.55:0/372627639 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff308066690 0x7ff308068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.198+0000 7ff323400640 1 -- 172.21.15.55:0/372627639 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7ff31c084670 con 0x7ff32c065d20 2024-04-02T07:29:52.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.198+0000 7ff321e00640 1 --2- 172.21.15.55:0/372627639 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff308066690 0x7ff308068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.198+0000 7ff321e00640 1 --2- 172.21.15.55:0/372627639 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff308066690 0x7ff308068b50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff32c167790 tx=0x7ff314008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:52.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.202+0000 7ff323400640 1 -- 172.21.15.55:0/372627639 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff31c0518f0 con 0x7ff32c065d20 2024-04-02T07:29:52.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.394+0000 7ff331400640 1 -- 172.21.15.55:0/372627639 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff32c066c90 con 0x7ff32c065d20 2024-04-02T07:29:52.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.398+0000 7ff323400640 1 -- 172.21.15.55:0/372627639 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4741 (secure 0 0 0) 0x7ff31c007380 con 0x7ff32c065d20 2024-04-02T07:29:52.399 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:29:52.399 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":67,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2209852195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2209852195},{"type":"v1","addr":"172.21.15.55:6835","nonce":2209852195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1897181831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1897181831},{"type":"v1","addr":"172.21.15.106:6835","nonce":1897181831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1894364429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1894364429},{"type":"v1","addr":"172.21.15.106:6837","nonce":1894364429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:28:53.919977+0000","modified":"2024-04-02T07:29:25.157357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7455":{"gid":7455,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":12,"addr":"172.21.15.55:6834/821922065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":821922065},{"type":"v1","addr":"172.21.15.55:6834","nonce":821922065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-02T07:29:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 67 2024-04-02T07:29:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.398+0000 7ff331400640 1 -- 172.21.15.55:0/372627639 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff308066690 msgr2=0x7ff308068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.398+0000 7ff331400640 1 --2- 172.21.15.55:0/372627639 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff308066690 0x7ff308068b50 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7ff32c167790 tx=0x7ff314008040 comp rx=0 tx=0).stop 2024-04-02T07:29:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.398+0000 7ff331400640 1 -- 172.21.15.55:0/372627639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff32c065d20 msgr2=0x7ff32c151860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.398+0000 7ff331400640 1 --2- 172.21.15.55:0/372627639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff32c065d20 0x7ff32c151860 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7ff31c00d5f0 tx=0x7ff31c00dab0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.398+0000 7ff331400640 1 -- 172.21.15.55:0/372627639 shutdown_connections 2024-04-02T07:29:52.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.398+0000 7ff331400640 1 --2- 172.21.15.55:0/372627639 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff308066690 0x7ff308068b50 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.398+0000 7ff331400640 1 --2- 172.21.15.55:0/372627639 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff32c15cbe0 0x7ff32c0b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.398+0000 7ff331400640 1 --2- 172.21.15.55:0/372627639 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff32c070a80 0x7ff32c0abd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.398+0000 7ff331400640 1 --2- 172.21.15.55:0/372627639 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff32c065d20 0x7ff32c151860 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.398+0000 7ff331400640 1 -- 172.21.15.55:0/372627639 >> 172.21.15.55:0/372627639 conn(0x7ff32c0ced50 msgr2=0x7ff32c0ae750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:52.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.398+0000 7ff331400640 1 -- 172.21.15.55:0/372627639 shutdown_connections 2024-04-02T07:29:52.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.398+0000 7ff331400640 1 -- 172.21.15.55:0/372627639 wait complete. 2024-04-02T07:29:52.420 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-02T07:29:52.562 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.562+0000 7f8818800640 1 Processor -- start 2024-04-02T07:29:52.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.562+0000 7f8818800640 1 -- start start 2024-04-02T07:29:52.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.562+0000 7f8818800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f88100b41a0 0x7f8810142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.562+0000 7f8818800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f881006ddc0 con 0x7f88100ade90 2024-04-02T07:29:52.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.562+0000 7f8818800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f881006c630 con 0x7f88100b3dc0 2024-04-02T07:29:52.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.562+0000 7f8818800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88100cae80 con 0x7f88100b41a0 2024-04-02T07:29:52.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.562+0000 7f8816800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f88100b41a0 0x7f8810142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.562+0000 7f8815400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f88100ade90 0x7f881006d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44792/0 (socket says 172.21.15.55:44792) 2024-04-02T07:29:52.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.562+0000 7f8815400640 1 -- 172.21.15.55:0/4176851329 learned_addr learned my addr 172.21.15.55:0/4176851329 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:29:52.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.562+0000 7f8816800640 1 -- 172.21.15.55:0/4176851329 >> v1:172.21.15.106:6789/0 conn(0x7f88100b3dc0 legacy=0x7f88100ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:52.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.562+0000 7f8816800640 1 -- 172.21.15.55:0/4176851329 >> v1:172.21.15.55:6789/0 conn(0x7f88100ade90 legacy=0x7f881006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.562+0000 7f8814a00640 1 -- 172.21.15.55:0/4176851329 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1245939305 0 0) 0x7f881006ddc0 con 0x7f88100ade90 2024-04-02T07:29:52.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.562+0000 7f8816800640 1 -- 172.21.15.55:0/4176851329 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881006c8f0 con 0x7f88100b41a0 2024-04-02T07:29:52.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.566+0000 7f8816800640 1 --2- 172.21.15.55:0/4176851329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88100b41a0 0x7f8810142ac0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f880c009d90 tx=0x7f880c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963f196a38413df2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:52.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.566+0000 7f8814a00640 1 -- 172.21.15.55:0/4176851329 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0a58d0 con 0x7f88100b41a0 2024-04-02T07:29:52.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.566+0000 7f8814a00640 1 -- 172.21.15.55:0/4176851329 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c0a5a30 con 0x7f88100b41a0 2024-04-02T07:29:52.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.566+0000 7f8814a00640 1 -- 172.21.15.55:0/4176851329 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0a5dc0 con 0x7f88100b41a0 2024-04-02T07:29:52.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.566+0000 7f8818800640 1 -- 172.21.15.55:0/4176851329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88100b41a0 msgr2=0x7f8810142ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.566+0000 7f8818800640 1 --2- 172.21.15.55:0/4176851329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88100b41a0 0x7f8810142ac0 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f880c009d90 tx=0x7f880c01c900 comp rx=0 tx=0).stop 2024-04-02T07:29:52.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.566+0000 7f8818800640 1 -- 172.21.15.55:0/4176851329 shutdown_connections 2024-04-02T07:29:52.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.566+0000 7f8818800640 1 --2- 172.21.15.55:0/4176851329 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88100b41a0 0x7f8810142ac0 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.566+0000 7f8818800640 1 -- 172.21.15.55:0/4176851329 >> 172.21.15.55:0/4176851329 conn(0x7f881006a390 msgr2=0x7f88100b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:52.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.566+0000 7f8818800640 1 -- 172.21.15.55:0/4176851329 shutdown_connections 2024-04-02T07:29:52.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.566+0000 7f8818800640 1 -- 172.21.15.55:0/4176851329 wait complete. 2024-04-02T07:29:52.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.566+0000 7f8818800640 1 Processor -- start 2024-04-02T07:29:52.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8818800640 1 -- start start 2024-04-02T07:29:52.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8818800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88100ade90 0x7f8810135ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8818800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88100b3dc0 0x7f8810150810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8818800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88100b41a0 0x7f8810150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8818800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881006e670 con 0x7f88100ade90 2024-04-02T07:29:52.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8818800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8810152500 con 0x7f88100b41a0 2024-04-02T07:29:52.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8818800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8810152990 con 0x7f88100b3dc0 2024-04-02T07:29:52.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8815e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88100ade90 0x7f8810135ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8815e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88100ade90 0x7f8810135ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55800/0 (socket says 172.21.15.55:55800) 2024-04-02T07:29:52.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8815e00640 1 -- 172.21.15.55:0/257939801 learned_addr learned my addr 172.21.15.55:0/257939801 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:52.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8815400640 1 --2- 172.21.15.55:0/257939801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88100b3dc0 0x7f8810150810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8816800640 1 --2- 172.21.15.55:0/257939801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88100b41a0 0x7f8810150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8815e00640 1 -- 172.21.15.55:0/257939801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88100b3dc0 msgr2=0x7f8810150810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8815e00640 1 --2- 172.21.15.55:0/257939801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88100b3dc0 0x7f8810150810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8815e00640 1 -- 172.21.15.55:0/257939801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88100b41a0 msgr2=0x7f8810150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8815e00640 1 --2- 172.21.15.55:0/257939801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88100b41a0 0x7f8810150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8815e00640 1 -- 172.21.15.55:0/257939801 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880c009a70 con 0x7f88100ade90 2024-04-02T07:29:52.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8815400640 1 --2- 172.21.15.55:0/257939801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88100b3dc0 0x7f8810150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:29:52.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8815e00640 1 --2- 172.21.15.55:0/257939801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88100ade90 0x7f8810135ef0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f880400c450 tx=0x7f880400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:52.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f880a000640 1 -- 172.21.15.55:0/257939801 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804012830 con 0x7f88100ade90 2024-04-02T07:29:52.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f880a000640 1 -- 172.21.15.55:0/257939801 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88040129b0 con 0x7f88100ade90 2024-04-02T07:29:52.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f880a000640 1 -- 172.21.15.55:0/257939801 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804012d60 con 0x7f88100ade90 2024-04-02T07:29:52.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8818800640 1 -- 172.21.15.55:0/257939801 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88101573b0 con 0x7f88100ade90 2024-04-02T07:29:52.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.570+0000 7f8818800640 1 -- 172.21.15.55:0/257939801 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8810152190 con 0x7f88100ade90 2024-04-02T07:29:52.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f880a000640 1 -- 172.21.15.55:0/257939801 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f880401c460 con 0x7f88100ade90 2024-04-02T07:29:52.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f880a000640 1 --2- 172.21.15.55:0/257939801 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f87f40666c0 0x7f87f4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f880a000640 1 -- 172.21.15.55:0/257939801 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f8804083fe0 con 0x7f88100ade90 2024-04-02T07:29:52.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f8815400640 1 --2- 172.21.15.55:0/257939801 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f87f40666c0 0x7f87f4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f881bbb7000 1 Processor -- start 2024-04-02T07:29:52.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f881bbb7000 1 -- start start 2024-04-02T07:29:52.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f8815400640 1 --2- 172.21.15.55:0/257939801 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f87f40666c0 0x7f87f4068b80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8800007fd0 tx=0x7f8800007c20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:52.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f881bbb7000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c64447dd0 0x561c644481b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f881bbb7000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64446080 0x561c64446460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f881bbb7000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c644469a0 0x561c6448faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f881bbb7000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c6430a340 con 0x561c644469a0 2024-04-02T07:29:52.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f881bbb7000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c64296cd0 con 0x561c64446080 2024-04-02T07:29:52.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f881bbb7000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c642942a0 con 0x561c64447dd0 2024-04-02T07:29:52.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f8816800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c644469a0 0x561c6448faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f8816800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c644469a0 0x561c6448faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55810/0 (socket says 172.21.15.55:55810) 2024-04-02T07:29:52.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f8816800640 1 -- 172.21.15.55:0/940771040 learned_addr learned my addr 172.21.15.55:0/940771040 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:52.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f8815e00640 1 --2- 172.21.15.55:0/940771040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c64447dd0 0x561c644481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f8815400640 1 --2- 172.21.15.55:0/940771040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64446080 0x561c64446460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f8816800640 1 -- 172.21.15.55:0/940771040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c64447dd0 msgr2=0x561c644481b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:52.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f8816800640 1 --2- 172.21.15.55:0/940771040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c64447dd0 0x561c644481b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f8816800640 1 -- 172.21.15.55:0/940771040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64446080 msgr2=0x561c64446460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:52.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f8816800640 1 --2- 172.21.15.55:0/940771040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64446080 0x561c64446460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f8816800640 1 -- 172.21.15.55:0/940771040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c63f824b0 con 0x561c644469a0 2024-04-02T07:29:52.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f8815e00640 1 --2- 172.21.15.55:0/940771040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c64447dd0 0x561c644481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:29:52.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.574+0000 7f8816800640 1 --2- 172.21.15.55:0/940771040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c644469a0 0x561c6448faa0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f880c0b0040 tx=0x7f880c004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5a8b21fb5ec52b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:52.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f87fea00640 1 -- 172.21.15.55:0/940771040 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0a5da0 con 0x561c644469a0 2024-04-02T07:29:52.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f87fea00640 1 -- 172.21.15.55:0/940771040 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f880c0bc070 con 0x561c644469a0 2024-04-02T07:29:52.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f87fea00640 1 -- 172.21.15.55:0/940771040 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880c0c36c0 con 0x561c644469a0 2024-04-02T07:29:52.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f881bbb7000 1 -- 172.21.15.55:0/940771040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c644469a0 msgr2=0x561c6448faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f881bbb7000 1 --2- 172.21.15.55:0/940771040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c644469a0 0x561c6448faa0 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f880c0b0040 tx=0x7f880c004ac0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f881bbb7000 1 -- 172.21.15.55:0/940771040 shutdown_connections 2024-04-02T07:29:52.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f881bbb7000 1 --2- 172.21.15.55:0/940771040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c644469a0 0x561c6448faa0 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f881bbb7000 1 --2- 172.21.15.55:0/940771040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64446080 0x561c64446460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f881bbb7000 1 --2- 172.21.15.55:0/940771040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c64447dd0 0x561c644481b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f881bbb7000 1 -- 172.21.15.55:0/940771040 >> 172.21.15.55:0/940771040 conn(0x561c6443e160 msgr2=0x561c64440550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f881bbb7000 1 -- 172.21.15.55:0/940771040 shutdown_connections 2024-04-02T07:29:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f881bbb7000 1 -- 172.21.15.55:0/940771040 wait complete. 2024-04-02T07:29:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f881bbb7000 1 -- start start 2024-04-02T07:29:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f881bbb7000 1 Processor -- start 2024-04-02T07:29:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f881bbb7000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c64446080 0x561c64495f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f881bbb7000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c644469a0 0x561c64496480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f881bbb7000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64447dd0 0x561c6444fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f881bbb7000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c6428fb90 con 0x561c644469a0 2024-04-02T07:29:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f881bbb7000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c6424d0a0 con 0x561c64447dd0 2024-04-02T07:29:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f881bbb7000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c6424cd40 con 0x561c64446080 2024-04-02T07:29:52.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f881bbb7000 10 client.0 _ll_register_callbacks cb 0x561c64344c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:29:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f8815400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c644469a0 0x561c64496480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f8815400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c644469a0 0x561c64496480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55818/0 (socket says 172.21.15.55:55818) 2024-04-02T07:29:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f8815400640 1 -- 172.21.15.55:0/2603785239 learned_addr learned my addr 172.21.15.55:0/2603785239 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f8815e00640 1 --2- 172.21.15.55:0/2603785239 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c64446080 0x561c64495f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f8816800640 1 --2- 172.21.15.55:0/2603785239 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64447dd0 0x561c6444fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f8815400640 1 -- 172.21.15.55:0/2603785239 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c64446080 msgr2=0x561c64495f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f8815400640 1 --2- 172.21.15.55:0/2603785239 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c64446080 0x561c64495f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f8815400640 1 -- 172.21.15.55:0/2603785239 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64447dd0 msgr2=0x561c6444fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f8815400640 1 --2- 172.21.15.55:0/2603785239 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64447dd0 0x561c6444fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f8815400640 1 -- 172.21.15.55:0/2603785239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f881006c8f0 con 0x561c644469a0 2024-04-02T07:29:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f8816800640 1 --2- 172.21.15.55:0/2603785239 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64447dd0 0x561c6444fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:29:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f8815e00640 1 --2- 172.21.15.55:0/2603785239 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c64446080 0x561c64495f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:29:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f8815400640 1 --2- 172.21.15.55:0/2603785239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c644469a0 0x561c64496480 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f88000011f0 tx=0x7f8800011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e77d990f2fa4aaec server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:52.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.578+0000 7f87f3400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:29:52.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f87f3400640 1 -- 172.21.15.55:0/2603785239 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8800015110 con 0x561c644469a0 2024-04-02T07:29:52.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 1 -- 172.21.15.55:0/2603785239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c6425f550 con 0x561c644469a0 2024-04-02T07:29:52.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f87f3400640 1 -- 172.21.15.55:0/2603785239 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f8800015270 con 0x561c644469a0 2024-04-02T07:29:52.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f87f3400640 1 -- 172.21.15.55:0/2603785239 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8800013420 con 0x561c644469a0 2024-04-02T07:29:52.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 10 client.7869 fetch_fsmap learned FSMap version 67 2024-04-02T07:29:52.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 1 -- 172.21.15.55:0/2603785239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x561c64254ba0 con 0x561c644469a0 2024-04-02T07:29:52.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f87f3400640 1 -- 172.21.15.55:0/2603785239 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561c6425f550 con 0x561c644469a0 2024-04-02T07:29:52.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f87f3400640 1 -- 172.21.15.55:0/2603785239 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 67) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8800013580 con 0x561c644469a0 2024-04-02T07:29:52.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 10 client.7869 fetch_fsmap finished waiting for FSMap version 67 2024-04-02T07:29:52.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 10 client.7869 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:29:52.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 20 client.7869 populate_metadata read hostname 'smithi055' 2024-04-02T07:29:52.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 1 --2- 172.21.15.55:0/2603785239 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x561c64450bc0 0x561c64450fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 4 client.7869 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:29:52.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 1 -- 172.21.15.55:0/2603785239 --> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c6428c970 con 0x561c64450bc0 2024-04-02T07:29:52.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f8815e00640 1 --2- 172.21.15.55:0/2603785239 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x561c64450bc0 0x561c64450fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f8815e00640 1 --2- 172.21.15.55:0/2603785239 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x561c64450bc0 0x561c64450fa0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c23ac48ab7930741 server_cookie=e8bd24551047c070 in_seq=0 out_seq=0 2024-04-02T07:29:52.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f87f3400640 10 client.7869 ms_handle_connect on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:52.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f87f3400640 1 -- 172.21.15.55:0/2603785239 <== mds.0 v2:172.21.15.55:6832/821922065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561c6428c970 con 0x561c64450bc0 2024-04-02T07:29:52.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f87f3400640 10 client.7869 handle_command_reply: tid=0 2024-04-02T07:29:52.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 1 client.7869 shutdown 2024-04-02T07:29:52.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 1 -- 172.21.15.55:0/2603785239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c644469a0 msgr2=0x561c64496480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 1 --2- 172.21.15.55:0/2603785239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c644469a0 0x561c64496480 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f88000011f0 tx=0x7f8800011000 comp rx=0 tx=0).stop 2024-04-02T07:29:52.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 1 -- 172.21.15.55:0/2603785239 shutdown_connections 2024-04-02T07:29:52.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 1 --2- 172.21.15.55:0/2603785239 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x561c64450bc0 0x561c64450fa0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 1 --2- 172.21.15.55:0/2603785239 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64447dd0 0x561c6444fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 1 --2- 172.21.15.55:0/2603785239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c644469a0 0x561c64496480 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 1 --2- 172.21.15.55:0/2603785239 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c64446080 0x561c64495f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 1 -- 172.21.15.55:0/2603785239 >> 172.21.15.55:0/2603785239 conn(0x561c6443e160 msgr2=0x561c64446f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:52.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f87f3400640 0 client.7869 ms_handle_reset on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:52.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 1 -- 172.21.15.55:0/2603785239 shutdown_connections 2024-04-02T07:29:52.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 1 -- 172.21.15.55:0/2603785239 wait complete. 2024-04-02T07:29:52.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.582+0000 7f881bbb7000 20 client.7869 trim_cache size 0 max 16384 2024-04-02T07:29:52.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.594+0000 7f881bbb7000 1 Processor -- start 2024-04-02T07:29:52.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.594+0000 7f881bbb7000 1 -- start start 2024-04-02T07:29:52.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.594+0000 7f881bbb7000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c64446080 0x561c6444de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.594+0000 7f881bbb7000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c644469a0 0x561c6444e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.594+0000 7f881bbb7000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64447dd0 0x561c644a1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.594+0000 7f881bbb7000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c63f4cc40 con 0x561c64446080 2024-04-02T07:29:52.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.594+0000 7f881bbb7000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c642926f0 con 0x561c64447dd0 2024-04-02T07:29:52.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.594+0000 7f881bbb7000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c644395e0 con 0x561c644469a0 2024-04-02T07:29:52.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.594+0000 7f8815e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c64446080 0x561c6444de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.594+0000 7f8815e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c64446080 0x561c6444de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55830/0 (socket says 172.21.15.55:55830) 2024-04-02T07:29:52.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.594+0000 7f8815e00640 1 -- 172.21.15.55:0/2950648404 learned_addr learned my addr 172.21.15.55:0/2950648404 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:52.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.594+0000 7f8815400640 1 --2- 172.21.15.55:0/2950648404 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c644469a0 0x561c6444e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.594+0000 7f8816800640 1 --2- 172.21.15.55:0/2950648404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64447dd0 0x561c644a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.594+0000 7f8815e00640 1 -- 172.21.15.55:0/2950648404 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c644469a0 msgr2=0x561c6444e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:52.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.594+0000 7f8815e00640 1 --2- 172.21.15.55:0/2950648404 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c644469a0 0x561c6444e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.594+0000 7f8815e00640 1 -- 172.21.15.55:0/2950648404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64447dd0 msgr2=0x561c644a1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:52.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.594+0000 7f8815e00640 1 --2- 172.21.15.55:0/2950648404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64447dd0 0x561c644a1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.594+0000 7f8815e00640 1 -- 172.21.15.55:0/2950648404 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c6423aef0 con 0x561c64446080 2024-04-02T07:29:52.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.594+0000 7f8815e00640 1 --2- 172.21.15.55:0/2950648404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c64446080 0x561c6444de50 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f8804000c10 tx=0x7f8804082330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13004d86a5c314e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f87ff400640 1 -- 172.21.15.55:0/2950648404 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880405d350 con 0x561c64446080 2024-04-02T07:29:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f87ff400640 1 -- 172.21.15.55:0/2950648404 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88040530a0 con 0x561c64446080 2024-04-02T07:29:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f87ff400640 1 -- 172.21.15.55:0/2950648404 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8804051670 con 0x561c64446080 2024-04-02T07:29:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 1 -- 172.21.15.55:0/2950648404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c64446080 msgr2=0x561c6444de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 1 --2- 172.21.15.55:0/2950648404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c64446080 0x561c6444de50 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f8804000c10 tx=0x7f8804082330 comp rx=0 tx=0).stop 2024-04-02T07:29:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 1 -- 172.21.15.55:0/2950648404 shutdown_connections 2024-04-02T07:29:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 1 --2- 172.21.15.55:0/2950648404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64447dd0 0x561c644a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 1 --2- 172.21.15.55:0/2950648404 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c644469a0 0x561c6444e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 1 --2- 172.21.15.55:0/2950648404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c64446080 0x561c6444de50 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 1 -- 172.21.15.55:0/2950648404 >> 172.21.15.55:0/2950648404 conn(0x561c6443e160 msgr2=0x561c64440550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:52.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 1 -- 172.21.15.55:0/2950648404 shutdown_connections 2024-04-02T07:29:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 1 -- 172.21.15.55:0/2950648404 wait complete. 2024-04-02T07:29:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 1 -- start start 2024-04-02T07:29:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 1 Processor -- start 2024-04-02T07:29:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c64446080 0x561c644a3430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c644469a0 0x561c644a3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64447dd0 0x561c644a3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c6425e450 con 0x561c64446080 2024-04-02T07:29:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c6425f550 con 0x561c64447dd0 2024-04-02T07:29:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x561c6428c970 con 0x561c644469a0 2024-04-02T07:29:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 10 client.0 _ll_register_callbacks cb 0x561c6432d870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:29:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f8815e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c64446080 0x561c644a3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f8815e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c64446080 0x561c644a3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55840/0 (socket says 172.21.15.55:55840) 2024-04-02T07:29:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f8815e00640 1 -- 172.21.15.55:0/1453893728 learned_addr learned my addr 172.21.15.55:0/1453893728 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:52.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f8815400640 1 --2- 172.21.15.55:0/1453893728 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c644469a0 0x561c644a3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f8816800640 1 --2- 172.21.15.55:0/1453893728 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64447dd0 0x561c644a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f8815e00640 1 -- 172.21.15.55:0/1453893728 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c644469a0 msgr2=0x561c644a3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:52.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f8815e00640 1 --2- 172.21.15.55:0/1453893728 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c644469a0 0x561c644a3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f8815e00640 1 -- 172.21.15.55:0/1453893728 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64447dd0 msgr2=0x561c644a3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:52.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f8815e00640 1 --2- 172.21.15.55:0/1453893728 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64447dd0 0x561c644a3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f8815e00640 1 -- 172.21.15.55:0/1453893728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8810152190 con 0x561c64446080 2024-04-02T07:29:52.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f8815e00640 1 --2- 172.21.15.55:0/1453893728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c64446080 0x561c644a3430 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f8804054c60 tx=0x7f880401e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cf9b77629131851 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:52.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f87f3400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:29:52.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f87f3400640 1 -- 172.21.15.55:0/1453893728 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f880405d3d0 con 0x561c64446080 2024-04-02T07:29:52.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 1 -- 172.21.15.55:0/1453893728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c6423f620 con 0x561c64446080 2024-04-02T07:29:52.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f87f3400640 1 -- 172.21.15.55:0/1453893728 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f880405cec0 con 0x561c64446080 2024-04-02T07:29:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f87f3400640 1 -- 172.21.15.55:0/1453893728 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f880405d0c0 con 0x561c64446080 2024-04-02T07:29:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 10 client.7875 fetch_fsmap learned FSMap version 67 2024-04-02T07:29:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.598+0000 7f881bbb7000 1 -- 172.21.15.55:0/1453893728 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x561c63f8bfc0 con 0x561c64446080 2024-04-02T07:29:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f87f3400640 1 -- 172.21.15.55:0/1453893728 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8804061020 con 0x561c64446080 2024-04-02T07:29:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f87f3400640 1 -- 172.21.15.55:0/1453893728 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 67) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f880406cb70 con 0x561c64446080 2024-04-02T07:29:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f881bbb7000 10 client.7875 fetch_fsmap finished waiting for FSMap version 67 2024-04-02T07:29:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f881bbb7000 10 client.7875 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:29:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f881bbb7000 20 client.7875 populate_metadata read hostname 'smithi055' 2024-04-02T07:29:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f881bbb7000 1 --2- 172.21.15.55:0/1453893728 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x561c644a43f0 0x561c644a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f881bbb7000 4 client.7875 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-02T07:29:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f881bbb7000 1 -- 172.21.15.55:0/1453893728 --> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x561c6428e4e0 con 0x561c644a43f0 2024-04-02T07:29:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f8815400640 1 --2- 172.21.15.55:0/1453893728 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x561c644a43f0 0x561c644a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f8815400640 1 --2- 172.21.15.55:0/1453893728 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x561c644a43f0 0x561c644a47d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87cb677c56c2f66 server_cookie=b94df2a8f3b76b1e in_seq=0 out_seq=0 2024-04-02T07:29:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f87f3400640 10 client.7875 ms_handle_connect on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:52.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f87f3400640 1 -- 172.21.15.55:0/1453893728 <== mds.0 v2:172.21.15.55:6832/821922065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+418 (crc 0 0 0) 0x561c6428e4e0 con 0x561c644a43f0 2024-04-02T07:29:52.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f87f3400640 10 client.7875 handle_command_reply: tid=0 2024-04-02T07:29:52.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f881bbb7000 1 client.7875 shutdown 2024-04-02T07:29:52.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f881bbb7000 1 -- 172.21.15.55:0/1453893728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c64446080 msgr2=0x561c644a3430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f881bbb7000 1 --2- 172.21.15.55:0/1453893728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c64446080 0x561c644a3430 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f8804054c60 tx=0x7f880401e040 comp rx=0 tx=0).stop 2024-04-02T07:29:52.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f881bbb7000 1 -- 172.21.15.55:0/1453893728 shutdown_connections 2024-04-02T07:29:52.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f881bbb7000 1 --2- 172.21.15.55:0/1453893728 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x561c644a43f0 0x561c644a47d0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f881bbb7000 1 --2- 172.21.15.55:0/1453893728 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561c64447dd0 0x561c644a3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f881bbb7000 1 --2- 172.21.15.55:0/1453893728 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561c644469a0 0x561c644a3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f87f3400640 0 client.7875 ms_handle_reset on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:52.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f881bbb7000 1 --2- 172.21.15.55:0/1453893728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561c64446080 0x561c644a3430 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f881bbb7000 1 -- 172.21.15.55:0/1453893728 >> 172.21.15.55:0/1453893728 conn(0x561c6443e160 msgr2=0x561c64440de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:52.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f881bbb7000 1 -- 172.21.15.55:0/1453893728 shutdown_connections 2024-04-02T07:29:52.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f881bbb7000 1 -- 172.21.15.55:0/1453893728 wait complete. 2024-04-02T07:29:52.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f881bbb7000 20 client.7875 trim_cache size 0 max 16384 2024-04-02T07:29:52.608 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:29:52.608 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-02T07:29:52.608 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:29:52.608 INFO:teuthology.orchestra.run.smithi055.stdout: "damage_type": "dir_frag", 2024-04-02T07:29:52.608 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 129162911, 2024-04-02T07:29:52.608 INFO:teuthology.orchestra.run.smithi055.stdout: "ino": 1099511627776, 2024-04-02T07:29:52.608 INFO:teuthology.orchestra.run.smithi055.stdout: "frag": "*", 2024-04-02T07:29:52.608 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/dir" 2024-04-02T07:29:52.608 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:29:52.608 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:29:52.609 INFO:teuthology.orchestra.run.smithi055.stdout: "damage_type": "backtrace", 2024-04-02T07:29:52.609 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 336666322, 2024-04-02T07:29:52.609 INFO:teuthology.orchestra.run.smithi055.stdout: "ino": 1099511627776, 2024-04-02T07:29:52.609 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/dir" 2024-04-02T07:29:52.609 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:29:52.609 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:29:52.609 INFO:teuthology.orchestra.run.smithi055.stdout: "damage_type": "backtrace", 2024-04-02T07:29:52.609 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 3618010860, 2024-04-02T07:29:52.609 INFO:teuthology.orchestra.run.smithi055.stdout: "ino": 1099511627777, 2024-04-02T07:29:52.609 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/testdir/hardlink" 2024-04-02T07:29:52.609 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:29:52.609 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-02T07:29:52.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f8818800640 1 -- 172.21.15.55:0/257939801 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f87f40666c0 msgr2=0x7f87f4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f8818800640 1 --2- 172.21.15.55:0/257939801 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f87f40666c0 0x7f87f4068b80 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8800007fd0 tx=0x7f8800007c20 comp rx=0 tx=0).stop 2024-04-02T07:29:52.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f8818800640 1 -- 172.21.15.55:0/257939801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88100ade90 msgr2=0x7f8810135ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f8818800640 1 --2- 172.21.15.55:0/257939801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88100ade90 0x7f8810135ef0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f880400c450 tx=0x7f880400c910 comp rx=0 tx=0).stop 2024-04-02T07:29:52.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f8818800640 1 -- 172.21.15.55:0/257939801 shutdown_connections 2024-04-02T07:29:52.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f8818800640 1 --2- 172.21.15.55:0/257939801 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f87f40666c0 0x7f87f4068b80 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f8818800640 1 --2- 172.21.15.55:0/257939801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f88100b41a0 0x7f8810150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f8818800640 1 --2- 172.21.15.55:0/257939801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88100b3dc0 0x7f8810150810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f8818800640 1 --2- 172.21.15.55:0/257939801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88100ade90 0x7f8810135ef0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f8818800640 1 -- 172.21.15.55:0/257939801 >> 172.21.15.55:0/257939801 conn(0x7f881006a390 msgr2=0x7f8810156830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:52.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f8818800640 1 -- 172.21.15.55:0/257939801 shutdown_connections 2024-04-02T07:29:52.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.602+0000 7f8818800640 1 -- 172.21.15.55:0/257939801 wait complete. 2024-04-02T07:29:52.623 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-02T07:29:52.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.762+0000 7f8abe000640 1 Processor -- start 2024-04-02T07:29:52.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.762+0000 7f8abe000640 1 -- start start 2024-04-02T07:29:52.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.762+0000 7f8abe000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8ab8146fa0 0x7f8ab814a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.762+0000 7f8abe000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab80ce340 con 0x7f8ab8147a00 2024-04-02T07:29:52.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.762+0000 7f8abe000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab8164be0 con 0x7f8ab80b0390 2024-04-02T07:29:52.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.762+0000 7f8abe000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab8164ec0 con 0x7f8ab8146fa0 2024-04-02T07:29:52.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.762+0000 7f8ab7400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8ab8146fa0 0x7f8ab814a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.762+0000 7f8aafe00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8ab8147a00 0x7f8ab80afc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44802/0 (socket says 172.21.15.55:44802) 2024-04-02T07:29:52.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.762+0000 7f8ab7400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8ab8146fa0 0x7f8ab814a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55852/0 (socket says 172.21.15.55:55852) 2024-04-02T07:29:52.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.762+0000 7f8aafe00640 1 -- 172.21.15.55:0/3127006840 learned_addr learned my addr 172.21.15.55:0/3127006840 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:29:52.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.762+0000 7f8ab7400640 1 -- 172.21.15.55:0/3127006840 >> v1:172.21.15.106:6789/0 conn(0x7f8ab80b0390 legacy=0x7f8ab80b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:52.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.762+0000 7f8ab7400640 1 -- 172.21.15.55:0/3127006840 >> v1:172.21.15.55:6789/0 conn(0x7f8ab8147a00 legacy=0x7f8ab80afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.762+0000 7f8ab7400640 1 -- 172.21.15.55:0/3127006840 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab81651a0 con 0x7f8ab8146fa0 2024-04-02T07:29:52.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.766+0000 7f8ab7400640 1 --2- 172.21.15.55:0/3127006840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ab8146fa0 0x7f8ab814a290 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f8aa80097c0 tx=0x7f8aa801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33ffa67c5a188e20 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:52.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.766+0000 7f8ab6a00640 1 -- 172.21.15.55:0/3127006840 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80ab610 con 0x7f8ab8146fa0 2024-04-02T07:29:52.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.766+0000 7f8ab6a00640 1 -- 172.21.15.55:0/3127006840 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa80ab770 con 0x7f8ab8146fa0 2024-04-02T07:29:52.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.766+0000 7f8ab6a00640 1 -- 172.21.15.55:0/3127006840 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80abb00 con 0x7f8ab8146fa0 2024-04-02T07:29:52.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.766+0000 7f8abe000640 1 -- 172.21.15.55:0/3127006840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ab8146fa0 msgr2=0x7f8ab814a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.766+0000 7f8abe000640 1 --2- 172.21.15.55:0/3127006840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ab8146fa0 0x7f8ab814a290 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f8aa80097c0 tx=0x7f8aa801c430 comp rx=0 tx=0).stop 2024-04-02T07:29:52.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.766+0000 7f8abe000640 1 -- 172.21.15.55:0/3127006840 shutdown_connections 2024-04-02T07:29:52.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.766+0000 7f8abe000640 1 --2- 172.21.15.55:0/3127006840 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ab8146fa0 0x7f8ab814a290 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.766+0000 7f8abe000640 1 -- 172.21.15.55:0/3127006840 >> 172.21.15.55:0/3127006840 conn(0x7f8ab8066080 msgr2=0x7f8ab8069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:52.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.766+0000 7f8abe000640 1 -- 172.21.15.55:0/3127006840 shutdown_connections 2024-04-02T07:29:52.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.766+0000 7f8abe000640 1 -- 172.21.15.55:0/3127006840 wait complete. 2024-04-02T07:29:52.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8abe000640 1 Processor -- start 2024-04-02T07:29:52.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8abe000640 1 -- start start 2024-04-02T07:29:52.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8abe000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ab80b0390 0x7f8ab8134020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8abe000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ab8146fa0 0x7f8ab81351f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8abe000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ab8147a00 0x7f8ab8135730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8abe000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab8162210 con 0x7f8ab80b0390 2024-04-02T07:29:52.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8abe000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab81624f0 con 0x7f8ab8147a00 2024-04-02T07:29:52.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8abe000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab81627d0 con 0x7f8ab8146fa0 2024-04-02T07:29:52.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8ab7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ab80b0390 0x7f8ab8134020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8ab7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ab80b0390 0x7f8ab8134020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55866/0 (socket says 172.21.15.55:55866) 2024-04-02T07:29:52.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8ab7400640 1 -- 172.21.15.55:0/1240078931 learned_addr learned my addr 172.21.15.55:0/1240078931 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:52.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8aafe00640 1 --2- 172.21.15.55:0/1240078931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ab8146fa0 0x7f8ab81351f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8ab7e00640 1 --2- 172.21.15.55:0/1240078931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ab8147a00 0x7f8ab8135730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8ab7400640 1 -- 172.21.15.55:0/1240078931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ab8146fa0 msgr2=0x7f8ab81351f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8ab7400640 1 --2- 172.21.15.55:0/1240078931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ab8146fa0 0x7f8ab81351f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8ab7400640 1 -- 172.21.15.55:0/1240078931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ab8147a00 msgr2=0x7f8ab8135730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8ab7400640 1 --2- 172.21.15.55:0/1240078931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ab8147a00 0x7f8ab8135730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8ab7400640 1 -- 172.21.15.55:0/1240078931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa8009420 con 0x7f8ab80b0390 2024-04-02T07:29:52.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8ab7400640 1 --2- 172.21.15.55:0/1240078931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ab80b0390 0x7f8ab8134020 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f8aa80ad040 tx=0x7f8aa801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:52.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8aaf400640 1 -- 172.21.15.55:0/1240078931 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80b5810 con 0x7f8ab80b0390 2024-04-02T07:29:52.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8aaf400640 1 -- 172.21.15.55:0/1240078931 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa80b59b0 con 0x7f8ab80b0390 2024-04-02T07:29:52.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8abe000640 1 -- 172.21.15.55:0/1240078931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab8162ab0 con 0x7f8ab80b0390 2024-04-02T07:29:52.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8aaf400640 1 -- 172.21.15.55:0/1240078931 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80b5d60 con 0x7f8ab80b0390 2024-04-02T07:29:52.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.770+0000 7f8abe000640 1 -- 172.21.15.55:0/1240078931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab8134560 con 0x7f8ab80b0390 2024-04-02T07:29:52.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.774+0000 7f8abe000640 1 -- 172.21.15.55:0/1240078931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab8134750 con 0x7f8ab80b0390 2024-04-02T07:29:52.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.774+0000 7f8aaf400640 1 -- 172.21.15.55:0/1240078931 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8aa80c83f0 con 0x7f8ab80b0390 2024-04-02T07:29:52.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.774+0000 7f8aaf400640 1 --2- 172.21.15.55:0/1240078931 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8a94066690 0x7f8a94068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:52.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.774+0000 7f8aaf400640 1 -- 172.21.15.55:0/1240078931 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f8aa811f0d0 con 0x7f8ab80b0390 2024-04-02T07:29:52.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.774+0000 7f8aafe00640 1 --2- 172.21.15.55:0/1240078931 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8a94066690 0x7f8a94068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:52.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.774+0000 7f8aafe00640 1 --2- 172.21.15.55:0/1240078931 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8a94066690 0x7f8a94068b50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8136da0 tx=0x7f8aa0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:52.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.778+0000 7f8aaf400640 1 -- 172.21.15.55:0/1240078931 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f8ab8134750 con 0x7f8ab80b0390 2024-04-02T07:29:52.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.970+0000 7f8abe000640 1 -- 172.21.15.55:0/1240078931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8ab8134750 con 0x7f8ab80b0390 2024-04-02T07:29:52.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.970+0000 7f8aaf400640 1 -- 172.21.15.55:0/1240078931 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+164 (secure 0 0 0) 0x7f8ab8134750 con 0x7f8ab80b0390 2024-04-02T07:29:52.973 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:29:52.974 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MDS_DAMAGE":{"severity":"HEALTH_ERR","summary":{"message":"1 MDSs report damaged metadata","count":1},"muted":false}},"mutes":[]} 2024-04-02T07:29:52.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.974+0000 7f8abe000640 1 -- 172.21.15.55:0/1240078931 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8a94066690 msgr2=0x7f8a94068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.974+0000 7f8abe000640 1 --2- 172.21.15.55:0/1240078931 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8a94066690 0x7f8a94068b50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8136da0 tx=0x7f8aa0009040 comp rx=0 tx=0).stop 2024-04-02T07:29:52.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.974+0000 7f8abe000640 1 -- 172.21.15.55:0/1240078931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ab80b0390 msgr2=0x7f8ab8134020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:52.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.974+0000 7f8abe000640 1 --2- 172.21.15.55:0/1240078931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ab80b0390 0x7f8ab8134020 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f8aa80ad040 tx=0x7f8aa801ac70 comp rx=0 tx=0).stop 2024-04-02T07:29:52.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.974+0000 7f8abe000640 1 -- 172.21.15.55:0/1240078931 shutdown_connections 2024-04-02T07:29:52.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.974+0000 7f8abe000640 1 --2- 172.21.15.55:0/1240078931 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8a94066690 0x7f8a94068b50 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.974+0000 7f8abe000640 1 --2- 172.21.15.55:0/1240078931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ab8147a00 0x7f8ab8135730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.974+0000 7f8abe000640 1 --2- 172.21.15.55:0/1240078931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ab8146fa0 0x7f8ab81351f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.974+0000 7f8abe000640 1 --2- 172.21.15.55:0/1240078931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ab80b0390 0x7f8ab8134020 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:52.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.974+0000 7f8abe000640 1 -- 172.21.15.55:0/1240078931 >> 172.21.15.55:0/1240078931 conn(0x7f8ab8066080 msgr2=0x7f8ab813a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:52.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.974+0000 7f8abe000640 1 -- 172.21.15.55:0/1240078931 shutdown_connections 2024-04-02T07:29:52.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:52.974+0000 7f8abe000640 1 -- 172.21.15.55:0/1240078931 wait complete. 2024-04-02T07:29:52.995 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-02T07:29:52.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:52.995 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-04-02T07:29:53.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.138+0000 7f919c000640 1 Processor -- start 2024-04-02T07:29:53.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.138+0000 7f919c000640 1 -- start start 2024-04-02T07:29:53.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.138+0000 7f919c000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91941591c0 0x7f91940c8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.138+0000 7f919c000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f919415d700 0x7f9194070310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.138+0000 7f919c000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9194070850 0x7f91941595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.138+0000 7f919c000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9194070ce0 con 0x7f9194070850 2024-04-02T07:29:53.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.138+0000 7f919c000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91940b3750 con 0x7f919415d700 2024-04-02T07:29:53.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.138+0000 7f919c000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91940b28c0 con 0x7f91941591c0 2024-04-02T07:29:53.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.138+0000 7f919a000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9194070850 0x7f91941595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.138+0000 7f919a000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9194070850 0x7f91941595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55878/0 (socket says 172.21.15.55:55878) 2024-04-02T07:29:53.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.138+0000 7f919a000640 1 -- 172.21.15.55:0/3267695841 learned_addr learned my addr 172.21.15.55:0/3267695841 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:53.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.138+0000 7f9199600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91941591c0 0x7f91940c8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.138+0000 7f9198c00640 1 --2- 172.21.15.55:0/3267695841 >> v2:172.21.15.106:3300/0 conn(0x7f919415d700 0x7f9194070310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.138+0000 7f919a000640 1 -- 172.21.15.55:0/3267695841 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91941591c0 msgr2=0x7f91940c8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:53.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.138+0000 7f919a000640 1 --2- 172.21.15.55:0/3267695841 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91941591c0 0x7f91940c8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.138+0000 7f919a000640 1 -- 172.21.15.55:0/3267695841 >> v2:172.21.15.106:3300/0 conn(0x7f919415d700 msgr2=0x7f9194070310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:53.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.138+0000 7f919a000640 1 --2- 172.21.15.55:0/3267695841 >> v2:172.21.15.106:3300/0 conn(0x7f919415d700 0x7f9194070310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.138+0000 7f919a000640 1 -- 172.21.15.55:0/3267695841 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91940b2b40 con 0x7f9194070850 2024-04-02T07:29:53.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.142+0000 7f919a000640 1 --2- 172.21.15.55:0/3267695841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9194070850 0x7f91941595a0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f918c009e50 tx=0x7f918c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f2da6f7ffdfe12 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:53.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.142+0000 7f9193e00640 1 -- 172.21.15.55:0/3267695841 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c0a57c0 con 0x7f9194070850 2024-04-02T07:29:53.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.142+0000 7f9193e00640 1 -- 172.21.15.55:0/3267695841 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918c0a5920 con 0x7f9194070850 2024-04-02T07:29:53.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.142+0000 7f9193e00640 1 -- 172.21.15.55:0/3267695841 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c0a5cb0 con 0x7f9194070850 2024-04-02T07:29:53.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.142+0000 7f919c000640 1 -- 172.21.15.55:0/3267695841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9194070850 msgr2=0x7f91941595a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:53.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.142+0000 7f919c000640 1 --2- 172.21.15.55:0/3267695841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9194070850 0x7f91941595a0 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f918c009e50 tx=0x7f918c01c9c0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.142+0000 7f919c000640 1 -- 172.21.15.55:0/3267695841 shutdown_connections 2024-04-02T07:29:53.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.142+0000 7f919c000640 1 --2- 172.21.15.55:0/3267695841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9194070850 0x7f91941595a0 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.142+0000 7f919c000640 1 --2- 172.21.15.55:0/3267695841 >> v2:172.21.15.106:3300/0 conn(0x7f919415d700 0x7f9194070310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.142+0000 7f919c000640 1 --2- 172.21.15.55:0/3267695841 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91941591c0 0x7f91940c8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.142+0000 7f919c000640 1 -- 172.21.15.55:0/3267695841 >> 172.21.15.55:0/3267695841 conn(0x7f9194069d90 msgr2=0x7f919406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:53.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.142+0000 7f919c000640 1 -- 172.21.15.55:0/3267695841 shutdown_connections 2024-04-02T07:29:53.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.142+0000 7f919c000640 1 -- 172.21.15.55:0/3267695841 wait complete. 2024-04-02T07:29:53.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f919c000640 1 Processor -- start 2024-04-02T07:29:53.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f919c000640 1 -- start start 2024-04-02T07:29:53.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f919c000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9194070850 0x7f91941535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f919c000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91941591c0 0x7f919415bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f919c000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f919415d700 0x7f91940c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f919c000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919415c460 con 0x7f9194070850 2024-04-02T07:29:53.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f919c000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f919414e480 con 0x7f91941591c0 2024-04-02T07:29:53.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f919c000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9194152530 con 0x7f919415d700 2024-04-02T07:29:53.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f9199600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9194070850 0x7f91941535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f9199600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9194070850 0x7f91941535d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55886/0 (socket says 172.21.15.55:55886) 2024-04-02T07:29:53.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f9199600640 1 -- 172.21.15.55:0/2567747400 learned_addr learned my addr 172.21.15.55:0/2567747400 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:53.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f9198c00640 1 --2- 172.21.15.55:0/2567747400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91941591c0 0x7f919415bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f919a000640 1 --2- 172.21.15.55:0/2567747400 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f919415d700 0x7f91940c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f9199600640 1 -- 172.21.15.55:0/2567747400 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f919415d700 msgr2=0x7f91940c7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:53.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f9199600640 1 --2- 172.21.15.55:0/2567747400 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f919415d700 0x7f91940c7d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f9199600640 1 -- 172.21.15.55:0/2567747400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91941591c0 msgr2=0x7f919415bf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:53.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f9199600640 1 --2- 172.21.15.55:0/2567747400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91941591c0 0x7f919415bf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f9199600640 1 -- 172.21.15.55:0/2567747400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918c009b30 con 0x7f9194070850 2024-04-02T07:29:53.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f9199600640 1 --2- 172.21.15.55:0/2567747400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9194070850 0x7f91941535d0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f918800e8e0 tx=0x7f918800eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:53.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f9191600640 1 -- 172.21.15.55:0/2567747400 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918800ca00 con 0x7f9194070850 2024-04-02T07:29:53.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f9191600640 1 -- 172.21.15.55:0/2567747400 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918800cb60 con 0x7f9194070850 2024-04-02T07:29:53.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f9191600640 1 -- 172.21.15.55:0/2567747400 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9188013470 con 0x7f9194070850 2024-04-02T07:29:53.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f919c000640 1 -- 172.21.15.55:0/2567747400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9194152810 con 0x7f9194070850 2024-04-02T07:29:53.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.146+0000 7f919c000640 1 -- 172.21.15.55:0/2567747400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9194152dd0 con 0x7f9194070850 2024-04-02T07:29:53.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.150+0000 7f9191600640 1 -- 172.21.15.55:0/2567747400 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f91880135d0 con 0x7f9194070850 2024-04-02T07:29:53.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.150+0000 7f9191600640 1 --2- 172.21.15.55:0/2567747400 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9174066690 0x7f9174068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.150+0000 7f9191600640 1 -- 172.21.15.55:0/2567747400 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f91880843f0 con 0x7f9194070850 2024-04-02T07:29:53.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.150+0000 7f919f49d000 1 Processor -- start 2024-04-02T07:29:53.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.150+0000 7f9198c00640 1 --2- 172.21.15.55:0/2567747400 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9174066690 0x7f9174068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.150+0000 7f919f49d000 1 -- start start 2024-04-02T07:29:53.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.150+0000 7f9198c00640 1 --2- 172.21.15.55:0/2567747400 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9174066690 0x7f9174068b50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f919415b7d0 tx=0x7f918000b750 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:53.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.150+0000 7f919f49d000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 0x55a5b9b10110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.150+0000 7f919f49d000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 0x55a5b9ac6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.150+0000 7f919f49d000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9ac6f60 0x55a5b9ac7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.150+0000 7f919f49d000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5b998e170 con 0x55a5b9b10650 2024-04-02T07:29:53.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.150+0000 7f919f49d000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5b991bd80 con 0x55a5b9ac6f60 2024-04-02T07:29:53.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.150+0000 7f919f49d000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5b9919350 con 0x55a5b9b0fd30 2024-04-02T07:29:53.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.150+0000 7f9198c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 0x55a5b9ac6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.150+0000 7f9198c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 0x55a5b9ac6a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55896/0 (socket says 172.21.15.55:55896) 2024-04-02T07:29:53.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.150+0000 7f9198c00640 1 -- 172.21.15.55:0/4185199051 learned_addr learned my addr 172.21.15.55:0/4185199051 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:53.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f9199600640 1 --2- 172.21.15.55:0/4185199051 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 0x55a5b9b10110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919a000640 1 --2- 172.21.15.55:0/4185199051 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9ac6f60 0x55a5b9ac7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f9198c00640 1 -- 172.21.15.55:0/4185199051 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 msgr2=0x55a5b9b10110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:53.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f9198c00640 1 --2- 172.21.15.55:0/4185199051 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 0x55a5b9b10110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f9198c00640 1 -- 172.21.15.55:0/4185199051 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9ac6f60 msgr2=0x55a5b9ac7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:53.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f9198c00640 1 --2- 172.21.15.55:0/4185199051 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9ac6f60 0x55a5b9ac7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f9198c00640 1 -- 172.21.15.55:0/4185199051 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5b9611070 con 0x55a5b9b10650 2024-04-02T07:29:53.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919a000640 1 --2- 172.21.15.55:0/4185199051 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9ac6f60 0x55a5b9ac7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:29:53.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f9198c00640 1 --2- 172.21.15.55:0/4185199051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 0x55a5b9ac6a20 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f9180006450 tx=0x7f9180014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c77fdbf01bf03d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:53.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f9186000640 1 -- 172.21.15.55:0/4185199051 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9180010040 con 0x55a5b9b10650 2024-04-02T07:29:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f9186000640 1 -- 172.21.15.55:0/4185199051 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9180018e10 con 0x55a5b9b10650 2024-04-02T07:29:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f9186000640 1 -- 172.21.15.55:0/4185199051 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9180004220 con 0x55a5b9b10650 2024-04-02T07:29:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919f49d000 1 -- 172.21.15.55:0/4185199051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 msgr2=0x55a5b9ac6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919f49d000 1 --2- 172.21.15.55:0/4185199051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 0x55a5b9ac6a20 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f9180006450 tx=0x7f9180014000 comp rx=0 tx=0).stop 2024-04-02T07:29:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919f49d000 1 -- 172.21.15.55:0/4185199051 shutdown_connections 2024-04-02T07:29:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919f49d000 1 --2- 172.21.15.55:0/4185199051 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9ac6f60 0x55a5b9ac7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919f49d000 1 --2- 172.21.15.55:0/4185199051 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 0x55a5b9ac6a20 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919f49d000 1 --2- 172.21.15.55:0/4185199051 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 0x55a5b9b10110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919f49d000 1 -- 172.21.15.55:0/4185199051 >> 172.21.15.55:0/4185199051 conn(0x55a5b9ac2f10 msgr2=0x55a5b9ac5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:53.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919f49d000 1 -- 172.21.15.55:0/4185199051 shutdown_connections 2024-04-02T07:29:53.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919f49d000 1 -- 172.21.15.55:0/4185199051 wait complete. 2024-04-02T07:29:53.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919f49d000 1 -- start start 2024-04-02T07:29:53.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919f49d000 1 Processor -- start 2024-04-02T07:29:53.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919f49d000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9ac6f60 0x55a5b9acca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919f49d000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 0x55a5b9b10c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919f49d000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 0x55a5b9b11180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919f49d000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5b9914c40 con 0x55a5b9b10650 2024-04-02T07:29:53.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919f49d000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5b98b3fa0 con 0x55a5b9ac6f60 2024-04-02T07:29:53.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919f49d000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5b98d21c0 con 0x55a5b9b0fd30 2024-04-02T07:29:53.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919f49d000 10 client.0 _ll_register_callbacks cb 0x55a5b9ab2060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:29:53.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 0x55a5b9b11180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 0x55a5b9b11180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55904/0 (socket says 172.21.15.55:55904) 2024-04-02T07:29:53.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919a000640 1 -- 172.21.15.55:0/674177664 learned_addr learned my addr 172.21.15.55:0/674177664 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:53.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f9199600640 1 --2- 172.21.15.55:0/674177664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9ac6f60 0x55a5b9acca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f9198c00640 1 --2- 172.21.15.55:0/674177664 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 0x55a5b9b10c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919a000640 1 -- 172.21.15.55:0/674177664 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 msgr2=0x55a5b9b10c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:53.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919a000640 1 --2- 172.21.15.55:0/674177664 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 0x55a5b9b10c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919a000640 1 -- 172.21.15.55:0/674177664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9ac6f60 msgr2=0x55a5b9acca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:53.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919a000640 1 --2- 172.21.15.55:0/674177664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9ac6f60 0x55a5b9acca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.154+0000 7f919a000640 1 -- 172.21.15.55:0/674177664 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91800061c0 con 0x55a5b9b10650 2024-04-02T07:29:53.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919a000640 1 --2- 172.21.15.55:0/674177664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 0x55a5b9b11180 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f918c01b070 tx=0x7f918c01b200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a21087434e1d4b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:53.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f917aa00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:29:53.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f917aa00640 1 -- 172.21.15.55:0/674177664 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c0a5d50 con 0x55a5b9b10650 2024-04-02T07:29:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f917aa00640 1 -- 172.21.15.55:0/674177664 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f918c0c1b20 con 0x55a5b9b10650 2024-04-02T07:29:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 1 -- 172.21.15.55:0/674177664 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5b9911a20 con 0x55a5b9b10650 2024-04-02T07:29:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f917aa00640 1 -- 172.21.15.55:0/674177664 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f918c0c1ce0 con 0x55a5b9b10650 2024-04-02T07:29:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 10 client.7896 fetch_fsmap learned FSMap version 67 2024-04-02T07:29:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 1 -- 172.21.15.55:0/674177664 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x55a5b98d9ba0 con 0x55a5b9b10650 2024-04-02T07:29:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f917aa00640 1 -- 172.21.15.55:0/674177664 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a5b9911a20 con 0x55a5b9b10650 2024-04-02T07:29:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f917aa00640 1 -- 172.21.15.55:0/674177664 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 67) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f918c0c7020 con 0x55a5b9b10650 2024-04-02T07:29:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 10 client.7896 fetch_fsmap finished waiting for FSMap version 67 2024-04-02T07:29:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 10 client.7896 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-02T07:29:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 20 client.7896 populate_metadata read hostname 'smithi055' 2024-04-02T07:29:53.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 1 --2- 172.21.15.55:0/674177664 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55a5b9b17170 0x55a5b9b17580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 4 client.7896 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:29:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 1 -- 172.21.15.55:0/674177664 --> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a5b9913590 con 0x55a5b9b17170 2024-04-02T07:29:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f9199600640 1 --2- 172.21.15.55:0/674177664 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55a5b9b17170 0x55a5b9b17580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f917aa00640 10 client.7896 ms_handle_connect on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f9199600640 1 --2- 172.21.15.55:0/674177664 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55a5b9b17170 0x55a5b9b17580 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e939934be128477 server_cookie=97ce4e4ef3b77718 in_seq=0 out_seq=0 2024-04-02T07:29:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f917aa00640 1 -- 172.21.15.55:0/674177664 <== mds.0 v2:172.21.15.55:6832/821922065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a5b9913590 con 0x55a5b9b17170 2024-04-02T07:29:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f917aa00640 10 client.7896 handle_command_reply: tid=0 2024-04-02T07:29:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 1 client.7896 shutdown 2024-04-02T07:29:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 1 -- 172.21.15.55:0/674177664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 msgr2=0x55a5b9b11180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 1 --2- 172.21.15.55:0/674177664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 0x55a5b9b11180 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f918c01b070 tx=0x7f918c01b200 comp rx=0 tx=0).stop 2024-04-02T07:29:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 1 -- 172.21.15.55:0/674177664 shutdown_connections 2024-04-02T07:29:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 1 --2- 172.21.15.55:0/674177664 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55a5b9b17170 0x55a5b9b17580 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 1 --2- 172.21.15.55:0/674177664 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 0x55a5b9b11180 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 1 --2- 172.21.15.55:0/674177664 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 0x55a5b9b10c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 1 --2- 172.21.15.55:0/674177664 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9ac6f60 0x55a5b9acca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f917aa00640 0 client.7896 ms_handle_reset on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:53.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 1 -- 172.21.15.55:0/674177664 >> 172.21.15.55:0/674177664 conn(0x55a5b9ac2f10 msgr2=0x55a5b9ac5b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:53.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 1 -- 172.21.15.55:0/674177664 shutdown_connections 2024-04-02T07:29:53.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 1 -- 172.21.15.55:0/674177664 wait complete. 2024-04-02T07:29:53.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.158+0000 7f919f49d000 20 client.7896 trim_cache size 0 max 16384 2024-04-02T07:29:53.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f919f49d000 1 Processor -- start 2024-04-02T07:29:53.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f919f49d000 1 -- start start 2024-04-02T07:29:53.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f919f49d000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9ac6f60 0x55a5b9b11a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f919f49d000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 0x55a5b9b11f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f919f49d000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 0x55a5b9b124a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f919f49d000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5b95d1cf0 con 0x55a5b9b10650 2024-04-02T07:29:53.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f919f49d000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5b9ac9d80 con 0x55a5b9ac6f60 2024-04-02T07:29:53.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f919f49d000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5b98b1d30 con 0x55a5b9b0fd30 2024-04-02T07:29:53.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f919a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 0x55a5b9b124a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f919a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 0x55a5b9b124a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55920/0 (socket says 172.21.15.55:55920) 2024-04-02T07:29:53.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f919a000640 1 -- 172.21.15.55:0/2578152185 learned_addr learned my addr 172.21.15.55:0/2578152185 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:53.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f9199600640 1 --2- 172.21.15.55:0/2578152185 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9ac6f60 0x55a5b9b11a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f9198c00640 1 --2- 172.21.15.55:0/2578152185 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 0x55a5b9b11f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f919a000640 1 -- 172.21.15.55:0/2578152185 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 msgr2=0x55a5b9b11f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:53.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f919a000640 1 --2- 172.21.15.55:0/2578152185 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 0x55a5b9b11f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f919a000640 1 -- 172.21.15.55:0/2578152185 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9ac6f60 msgr2=0x55a5b9b11a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:53.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f919a000640 1 --2- 172.21.15.55:0/2578152185 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9ac6f60 0x55a5b9b11a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f919a000640 1 -- 172.21.15.55:0/2578152185 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a5b98bfef0 con 0x55a5b9b10650 2024-04-02T07:29:53.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f919a000640 1 --2- 172.21.15.55:0/2578152185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 0x55a5b9b124a0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f918c01cf30 tx=0x7f918c0b8070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8bb718bf172459 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:53.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f9186a00640 1 -- 172.21.15.55:0/2578152185 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c0a5d50 con 0x55a5b9b10650 2024-04-02T07:29:53.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f9186a00640 1 -- 172.21.15.55:0/2578152185 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918c0ba070 con 0x55a5b9b10650 2024-04-02T07:29:53.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.174+0000 7f9186a00640 1 -- 172.21.15.55:0/2578152185 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f918c0c1280 con 0x55a5b9b10650 2024-04-02T07:29:53.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 1 -- 172.21.15.55:0/2578152185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 msgr2=0x55a5b9b124a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:53.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 1 --2- 172.21.15.55:0/2578152185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 0x55a5b9b124a0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f918c01cf30 tx=0x7f918c0b8070 comp rx=0 tx=0).stop 2024-04-02T07:29:53.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 1 -- 172.21.15.55:0/2578152185 shutdown_connections 2024-04-02T07:29:53.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 1 --2- 172.21.15.55:0/2578152185 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9b10650 0x55a5b9b124a0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 1 --2- 172.21.15.55:0/2578152185 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 0x55a5b9b11f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 1 --2- 172.21.15.55:0/2578152185 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9ac6f60 0x55a5b9b11a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 1 -- 172.21.15.55:0/2578152185 >> 172.21.15.55:0/2578152185 conn(0x55a5b9ac2f10 msgr2=0x55a5b9acba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:53.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 1 -- 172.21.15.55:0/2578152185 shutdown_connections 2024-04-02T07:29:53.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 1 -- 172.21.15.55:0/2578152185 wait complete. 2024-04-02T07:29:53.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 1 -- start start 2024-04-02T07:29:53.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 1 Processor -- start 2024-04-02T07:29:53.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9ac6f60 0x55a5b9b6b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 0x55a5b9b147e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9b10650 0x55a5b9b14d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5b991d010 con 0x55a5b9ac6f60 2024-04-02T07:29:53.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5b98db420 con 0x55a5b9b10650 2024-04-02T07:29:53.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a5b9912450 con 0x55a5b9b0fd30 2024-04-02T07:29:53.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 10 client.0 _ll_register_callbacks cb 0x55a5b998e0c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:29:53.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f9199600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9ac6f60 0x55a5b9b6b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f9199600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9ac6f60 0x55a5b9b6b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55930/0 (socket says 172.21.15.55:55930) 2024-04-02T07:29:53.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f9199600640 1 -- 172.21.15.55:0/4087828047 learned_addr learned my addr 172.21.15.55:0/4087828047 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:53.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919a000640 1 --2- 172.21.15.55:0/4087828047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9b10650 0x55a5b9b14d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f9198c00640 1 --2- 172.21.15.55:0/4087828047 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 0x55a5b9b147e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f9199600640 1 -- 172.21.15.55:0/4087828047 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 msgr2=0x55a5b9b147e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:53.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f9199600640 1 --2- 172.21.15.55:0/4087828047 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 0x55a5b9b147e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f9199600640 1 -- 172.21.15.55:0/4087828047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9b10650 msgr2=0x55a5b9b14d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:53.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f9199600640 1 --2- 172.21.15.55:0/4087828047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9b10650 0x55a5b9b14d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f9199600640 1 -- 172.21.15.55:0/4087828047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a5b98d9ba0 con 0x55a5b9ac6f60 2024-04-02T07:29:53.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f9198c00640 1 --2- 172.21.15.55:0/4087828047 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 0x55a5b9b147e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:29:53.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f9199600640 1 --2- 172.21.15.55:0/4087828047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9ac6f60 0x55a5b9b6b130 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f9188009530 tx=0x7f91880518e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea514fda5761a726 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:53.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f917aa00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:29:53.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f917aa00640 1 -- 172.21.15.55:0/4087828047 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91880840b0 con 0x55a5b9ac6f60 2024-04-02T07:29:53.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f917aa00640 1 -- 172.21.15.55:0/4087828047 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f9188084210 con 0x55a5b9ac6f60 2024-04-02T07:29:53.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 1 -- 172.21.15.55:0/4087828047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5b98d15f0 con 0x55a5b9ac6f60 2024-04-02T07:29:53.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f917aa00640 1 -- 172.21.15.55:0/4087828047 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9188051b80 con 0x55a5b9ac6f60 2024-04-02T07:29:53.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 10 client.7902 fetch_fsmap learned FSMap version 67 2024-04-02T07:29:53.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f919f49d000 1 -- 172.21.15.55:0/4087828047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x55a5b98b3a60 con 0x55a5b9ac6f60 2024-04-02T07:29:53.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.178+0000 7f917aa00640 1 -- 172.21.15.55:0/4087828047 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a5b98d15f0 con 0x55a5b9ac6f60 2024-04-02T07:29:53.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f917aa00640 1 -- 172.21.15.55:0/4087828047 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 67) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f9188011070 con 0x55a5b9ac6f60 2024-04-02T07:29:53.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919f49d000 10 client.7902 fetch_fsmap finished waiting for FSMap version 67 2024-04-02T07:29:53.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919f49d000 10 client.7902 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-02T07:29:53.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919f49d000 20 client.7902 populate_metadata read hostname 'smithi055' 2024-04-02T07:29:53.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919f49d000 1 --2- 172.21.15.55:0/4087828047 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55a5b9b15260 0x55a5b9b15670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919f49d000 4 client.7902 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-04-02T07:29:53.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919f49d000 1 -- 172.21.15.55:0/4087828047 --> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) v1 -- 0x55a5b98d3410 con 0x55a5b9b15260 2024-04-02T07:29:53.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f9198c00640 1 --2- 172.21.15.55:0/4087828047 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55a5b9b15260 0x55a5b9b15670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f9198c00640 1 --2- 172.21.15.55:0/4087828047 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55a5b9b15260 0x55a5b9b15670 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47be53f321faed6e server_cookie=aa2de29aac3b4be9 in_seq=0 out_seq=0 2024-04-02T07:29:53.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f917aa00640 10 client.7902 ms_handle_connect on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:53.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f917aa00640 1 -- 172.21.15.55:0/4087828047 <== mds.0 v2:172.21.15.55:6832/821922065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55a5b98d3410 con 0x55a5b9b15260 2024-04-02T07:29:53.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f917aa00640 10 client.7902 handle_command_reply: tid=0 2024-04-02T07:29:53.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919f49d000 1 client.7902 shutdown 2024-04-02T07:29:53.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919f49d000 1 -- 172.21.15.55:0/4087828047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9ac6f60 msgr2=0x55a5b9b6b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:53.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919f49d000 1 --2- 172.21.15.55:0/4087828047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9ac6f60 0x55a5b9b6b130 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f9188009530 tx=0x7f91880518e0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919f49d000 1 -- 172.21.15.55:0/4087828047 shutdown_connections 2024-04-02T07:29:53.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919f49d000 1 --2- 172.21.15.55:0/4087828047 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55a5b9b15260 0x55a5b9b15670 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919f49d000 1 --2- 172.21.15.55:0/4087828047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5b9b10650 0x55a5b9b14d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919f49d000 1 --2- 172.21.15.55:0/4087828047 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5b9b0fd30 0x55a5b9b147e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919f49d000 1 --2- 172.21.15.55:0/4087828047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5b9ac6f60 0x55a5b9b6b130 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919f49d000 1 -- 172.21.15.55:0/4087828047 >> 172.21.15.55:0/4087828047 conn(0x55a5b9ac2f10 msgr2=0x55a5b9ac5300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:53.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f917aa00640 0 client.7902 ms_handle_reset on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:53.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919f49d000 1 -- 172.21.15.55:0/4087828047 shutdown_connections 2024-04-02T07:29:53.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919f49d000 1 -- 172.21.15.55:0/4087828047 wait complete. 2024-04-02T07:29:53.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919f49d000 20 client.7902 trim_cache size 0 max 16384 2024-04-02T07:29:53.189 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f3ac6e00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v13 pv17 ap=3 DIRTYPARENT f(v0 m2024-04-02T07:29:02.941529+0000 1=1+0)->f(v1 m2024-04-02T07:29:02.941529+0000) n(v0 rc2024-04-02T07:29:03.060803+0000 2=1+1)->n(v0 rc2024-04-02T07:29:03.060803+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyrstat=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x55cb9380e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v13>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-02T07:29:02.941529+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-02T07:29:03.060803+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-04-02T07:29:53.190 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:29:53.190 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-04-02T07:29:53.190 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "bfcf1b5b-f6f7-430d-ae38-650086a576bf", 2024-04-02T07:29:53.190 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-04-02T07:29:53.190 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:29:53.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919c000640 1 -- 172.21.15.55:0/2567747400 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9174066690 msgr2=0x7f9174068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:53.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919c000640 1 --2- 172.21.15.55:0/2567747400 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9174066690 0x7f9174068b50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f919415b7d0 tx=0x7f918000b750 comp rx=0 tx=0).stop 2024-04-02T07:29:53.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919c000640 1 -- 172.21.15.55:0/2567747400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9194070850 msgr2=0x7f91941535d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:53.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919c000640 1 --2- 172.21.15.55:0/2567747400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9194070850 0x7f91941535d0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f918800e8e0 tx=0x7f918800eda0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919c000640 1 -- 172.21.15.55:0/2567747400 shutdown_connections 2024-04-02T07:29:53.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919c000640 1 --2- 172.21.15.55:0/2567747400 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f919415d700 0x7f91940c7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919c000640 1 --2- 172.21.15.55:0/2567747400 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9174066690 0x7f9174068b50 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919c000640 1 --2- 172.21.15.55:0/2567747400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91941591c0 0x7f919415bf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919c000640 1 --2- 172.21.15.55:0/2567747400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9194070850 0x7f91941535d0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919c000640 1 -- 172.21.15.55:0/2567747400 >> 172.21.15.55:0/2567747400 conn(0x7f9194069d90 msgr2=0x7f9194150e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:53.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919c000640 1 -- 172.21.15.55:0/2567747400 shutdown_connections 2024-04-02T07:29:53.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.182+0000 7f919c000640 1 -- 172.21.15.55:0/2567747400 wait complete. 2024-04-02T07:29:53.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:29:53.204 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-02T07:29:53.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.346+0000 7fd814600640 1 Processor -- start 2024-04-02T07:29:53.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.346+0000 7fd814600640 1 -- start start 2024-04-02T07:29:53.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.346+0000 7fd814600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd80c0709b0 0x7fd80c0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.346+0000 7fd814600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd80c0b2fd0 0x7fd80c0b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.346+0000 7fd814600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd80c15e3a0 con 0x7fd80c144260 2024-04-02T07:29:53.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.346+0000 7fd814600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd80c0b37c0 con 0x7fd80c0709b0 2024-04-02T07:29:53.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.346+0000 7fd814600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c15e5f0 con 0x7fd80c0b2fd0 2024-04-02T07:29:53.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.346+0000 7fd811c00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd80c144260 0x7fd80c0702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:44814/0 (socket says 172.21.15.55:44814) 2024-04-02T07:29:53.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.346+0000 7fd811c00640 1 -- 172.21.15.55:0/438202966 learned_addr learned my addr 172.21.15.55:0/438202966 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:29:53.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.346+0000 7fd811200640 1 --2- 172.21.15.55:0/438202966 >> v2:172.21.15.106:3300/0 conn(0x7fd80c0709b0 0x7fd80c0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.346+0000 7fd812600640 1 --2- 172.21.15.55:0/438202966 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd80c0b2fd0 0x7fd80c0b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.346+0000 7fd80be00640 1 -- 172.21.15.55:0/438202966 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1462321994 0 0) 0x7fd80c15e3a0 con 0x7fd80c144260 2024-04-02T07:29:53.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.346+0000 7fd80be00640 1 -- 172.21.15.55:0/438202966 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7f4003530 con 0x7fd80c144260 2024-04-02T07:29:53.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.346+0000 7fd811200640 1 -- 172.21.15.55:0/438202966 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd80c0b2fd0 msgr2=0x7fd80c0b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:53.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.346+0000 7fd811200640 1 --2- 172.21.15.55:0/438202966 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd80c0b2fd0 0x7fd80c0b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.346+0000 7fd811200640 1 -- 172.21.15.55:0/438202966 >> v1:172.21.15.55:6789/0 conn(0x7fd80c144260 legacy=0x7fd80c0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:53.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.346+0000 7fd811200640 1 -- 172.21.15.55:0/438202966 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd80c15e8d0 con 0x7fd80c0709b0 2024-04-02T07:29:53.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.350+0000 7fd811200640 1 --2- 172.21.15.55:0/438202966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c0709b0 0x7fd80c0b2a90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80097c0 tx=0x7fd7f801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e7b39c71e308d8f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.350+0000 7fd80be00640 1 -- 172.21.15.55:0/438202966 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80ad640 con 0x7fd80c0709b0 2024-04-02T07:29:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.350+0000 7fd80be00640 1 -- 172.21.15.55:0/438202966 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7f80ad7a0 con 0x7fd80c0709b0 2024-04-02T07:29:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.350+0000 7fd80be00640 1 -- 172.21.15.55:0/438202966 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80adb30 con 0x7fd80c0709b0 2024-04-02T07:29:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.350+0000 7fd814600640 1 -- 172.21.15.55:0/438202966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c0709b0 msgr2=0x7fd80c0b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.350+0000 7fd814600640 1 --2- 172.21.15.55:0/438202966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c0709b0 0x7fd80c0b2a90 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fd7f80097c0 tx=0x7fd7f801c4a0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.350+0000 7fd814600640 1 -- 172.21.15.55:0/438202966 shutdown_connections 2024-04-02T07:29:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.350+0000 7fd814600640 1 --2- 172.21.15.55:0/438202966 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd80c0b2fd0 0x7fd80c0b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.350+0000 7fd814600640 1 --2- 172.21.15.55:0/438202966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c0709b0 0x7fd80c0b2a90 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.350+0000 7fd814600640 1 -- 172.21.15.55:0/438202966 >> 172.21.15.55:0/438202966 conn(0x7fd80c06a390 msgr2=0x7fd80c0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.350+0000 7fd814600640 1 -- 172.21.15.55:0/438202966 shutdown_connections 2024-04-02T07:29:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.350+0000 7fd814600640 1 -- 172.21.15.55:0/438202966 wait complete. 2024-04-02T07:29:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.350+0000 7fd814600640 1 Processor -- start 2024-04-02T07:29:53.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.350+0000 7fd814600640 1 -- start start 2024-04-02T07:29:53.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd814600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c0709b0 0x7fd80c1397b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd814600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd80c0b2fd0 0x7fd80c1f56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd814600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd80c144260 0x7fd80c140d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd814600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c13c570 con 0x7fd80c144260 2024-04-02T07:29:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd814600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c13c850 con 0x7fd80c0709b0 2024-04-02T07:29:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd814600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80c13cb30 con 0x7fd80c0b2fd0 2024-04-02T07:29:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd812600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd80c144260 0x7fd80c140d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd812600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd80c144260 0x7fd80c140d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55938/0 (socket says 172.21.15.55:55938) 2024-04-02T07:29:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd812600640 1 -- 172.21.15.55:0/631287924 learned_addr learned my addr 172.21.15.55:0/631287924 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd811200640 1 --2- 172.21.15.55:0/631287924 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd80c0b2fd0 0x7fd80c1f56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd812600640 1 -- 172.21.15.55:0/631287924 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd80c0b2fd0 msgr2=0x7fd80c1f56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd812600640 1 --2- 172.21.15.55:0/631287924 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd80c0b2fd0 0x7fd80c1f56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd812600640 1 -- 172.21.15.55:0/631287924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c0709b0 msgr2=0x7fd80c1397b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:53.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd811c00640 1 --2- 172.21.15.55:0/631287924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c0709b0 0x7fd80c1397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd812600640 1 --2- 172.21.15.55:0/631287924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c0709b0 0x7fd80c1397b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd812600640 1 -- 172.21.15.55:0/631287924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f8009420 con 0x7fd80c144260 2024-04-02T07:29:53.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd811200640 1 --2- 172.21.15.55:0/631287924 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd80c0b2fd0 0x7fd80c1f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:29:53.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd811c00640 1 --2- 172.21.15.55:0/631287924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c0709b0 0x7fd80c1397b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:29:53.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd812600640 1 --2- 172.21.15.55:0/631287924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd80c144260 0x7fd80c140d50 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fd80400efc0 tx=0x7fd80400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:53.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd809600640 1 -- 172.21.15.55:0/631287924 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd804014480 con 0x7fd80c144260 2024-04-02T07:29:53.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd809600640 1 -- 172.21.15.55:0/631287924 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80400f040 con 0x7fd80c144260 2024-04-02T07:29:53.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd809600640 1 -- 172.21.15.55:0/631287924 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd804014820 con 0x7fd80c144260 2024-04-02T07:29:53.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd814600640 1 -- 172.21.15.55:0/631287924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd80c13ce10 con 0x7fd80c144260 2024-04-02T07:29:53.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.354+0000 7fd814600640 1 -- 172.21.15.55:0/631287924 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80c13a280 con 0x7fd80c144260 2024-04-02T07:29:53.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd809600640 1 -- 172.21.15.55:0/631287924 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd804014980 con 0x7fd80c144260 2024-04-02T07:29:53.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd809600640 1 --2- 172.21.15.55:0/631287924 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd7ec066690 0x7fd7ec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd809600640 1 -- 172.21.15.55:0/631287924 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fd804085130 con 0x7fd80c144260 2024-04-02T07:29:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd817b05000 1 Processor -- start 2024-04-02T07:29:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd811c00640 1 --2- 172.21.15.55:0/631287924 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd7ec066690 0x7fd7ec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd817b05000 1 -- start start 2024-04-02T07:29:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd811c00640 1 --2- 172.21.15.55:0/631287924 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd7ec066690 0x7fd7ec068b50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd800005890 tx=0x7fd800009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd817b05000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a98fa70 0x55c02a98fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd817b05000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a990390 0x55c02a9434c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd817b05000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a943a00 0x55c02a943de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd817b05000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02a80e630 con 0x55c02a98fa70 2024-04-02T07:29:53.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd817b05000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02a79bbd0 con 0x55c02a943a00 2024-04-02T07:29:53.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd817b05000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c02a7991a0 con 0x55c02a990390 2024-04-02T07:29:53.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd811c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a98fa70 0x55c02a98fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd811c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a98fa70 0x55c02a98fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55940/0 (socket says 172.21.15.55:55940) 2024-04-02T07:29:53.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd811c00640 1 -- 172.21.15.55:0/1313521552 learned_addr learned my addr 172.21.15.55:0/1313521552 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:53.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd811200640 1 --2- 172.21.15.55:0/1313521552 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a990390 0x55c02a9434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd812600640 1 --2- 172.21.15.55:0/1313521552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a943a00 0x55c02a943de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd811c00640 1 -- 172.21.15.55:0/1313521552 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a990390 msgr2=0x55c02a9434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:53.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd811c00640 1 --2- 172.21.15.55:0/1313521552 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a990390 0x55c02a9434c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd811c00640 1 -- 172.21.15.55:0/1313521552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a943a00 msgr2=0x55c02a943de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:53.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd811c00640 1 --2- 172.21.15.55:0/1313521552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a943a00 0x55c02a943de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd811c00640 1 -- 172.21.15.55:0/1313521552 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c02a490e20 con 0x55c02a98fa70 2024-04-02T07:29:53.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd811c00640 1 --2- 172.21.15.55:0/1313521552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a98fa70 0x55c02a98fe50 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fd8000058f0 tx=0x7fd800010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41ec71ce8c96db69 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:53.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd7fe000640 1 -- 172.21.15.55:0/1313521552 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80000d940 con 0x55c02a98fa70 2024-04-02T07:29:53.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd7fe000640 1 -- 172.21.15.55:0/1313521552 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80000daa0 con 0x55c02a98fa70 2024-04-02T07:29:53.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.358+0000 7fd7fe000640 1 -- 172.21.15.55:0/1313521552 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80000de10 con 0x55c02a98fa70 2024-04-02T07:29:53.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 1 -- 172.21.15.55:0/1313521552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a98fa70 msgr2=0x55c02a98fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:53.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 1 --2- 172.21.15.55:0/1313521552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a98fa70 0x55c02a98fe50 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7fd8000058f0 tx=0x7fd800010000 comp rx=0 tx=0).stop 2024-04-02T07:29:53.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 1 -- 172.21.15.55:0/1313521552 shutdown_connections 2024-04-02T07:29:53.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 1 --2- 172.21.15.55:0/1313521552 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a943a00 0x55c02a943de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 1 --2- 172.21.15.55:0/1313521552 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a990390 0x55c02a9434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 1 --2- 172.21.15.55:0/1313521552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a98fa70 0x55c02a98fe50 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 1 -- 172.21.15.55:0/1313521552 >> 172.21.15.55:0/1313521552 conn(0x55c02a744160 msgr2=0x55c02a972820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:53.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 1 -- 172.21.15.55:0/1313521552 shutdown_connections 2024-04-02T07:29:53.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 1 -- 172.21.15.55:0/1313521552 wait complete. 2024-04-02T07:29:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 1 -- start start 2024-04-02T07:29:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 1 Processor -- start 2024-04-02T07:29:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a943a00 0x55c02a94bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a98fa70 0x55c02a973a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a990390 0x55c02a973f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02a794a90 con 0x55c02a943a00 2024-04-02T07:29:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02a733d40 con 0x55c02a990390 2024-04-02T07:29:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c02a751f30 con 0x55c02a98fa70 2024-04-02T07:29:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 10 client.0 _ll_register_callbacks cb 0x55c02a7f6810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:29:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd811c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a943a00 0x55c02a94bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd811c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a943a00 0x55c02a94bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55956/0 (socket says 172.21.15.55:55956) 2024-04-02T07:29:53.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd811c00640 1 -- 172.21.15.55:0/1998460272 learned_addr learned my addr 172.21.15.55:0/1998460272 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:53.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd812600640 1 --2- 172.21.15.55:0/1998460272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a990390 0x55c02a973f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd811200640 1 --2- 172.21.15.55:0/1998460272 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a98fa70 0x55c02a973a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd811c00640 1 -- 172.21.15.55:0/1998460272 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a98fa70 msgr2=0x55c02a973a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:53.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd811c00640 1 --2- 172.21.15.55:0/1998460272 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a98fa70 0x55c02a973a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd811c00640 1 -- 172.21.15.55:0/1998460272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a990390 msgr2=0x55c02a973f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:53.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd811c00640 1 --2- 172.21.15.55:0/1998460272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a990390 0x55c02a973f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd811c00640 1 -- 172.21.15.55:0/1998460272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f4003530 con 0x55c02a943a00 2024-04-02T07:29:53.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd811c00640 1 --2- 172.21.15.55:0/1998460272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a943a00 0x55c02a94bad0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fd800009010 tx=0x7fd800012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f6b889c7c15ff3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:53.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd7f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:29:53.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd7f2a00640 1 -- 172.21.15.55:0/1998460272 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd800027040 con 0x55c02a943a00 2024-04-02T07:29:53.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd7f2a00640 1 -- 172.21.15.55:0/1998460272 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fd800020660 con 0x55c02a943a00 2024-04-02T07:29:53.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 1 -- 172.21.15.55:0/1998460272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c02a7933e0 con 0x55c02a943a00 2024-04-02T07:29:53.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd7f2a00640 1 -- 172.21.15.55:0/1998460272 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd800005e70 con 0x55c02a943a00 2024-04-02T07:29:53.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 10 client.7914 fetch_fsmap learned FSMap version 67 2024-04-02T07:29:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.362+0000 7fd817b05000 1 -- 172.21.15.55:0/1998460272 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x55c02a759aa0 con 0x55c02a943a00 2024-04-02T07:29:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd7f2a00640 1 -- 172.21.15.55:0/1998460272 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c02a7933e0 con 0x55c02a943a00 2024-04-02T07:29:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd7f2a00640 1 -- 172.21.15.55:0/1998460272 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 67) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd800020820 con 0x55c02a943a00 2024-04-02T07:29:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd817b05000 10 client.7914 fetch_fsmap finished waiting for FSMap version 67 2024-04-02T07:29:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd817b05000 10 client.7914 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-02T07:29:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd817b05000 20 client.7914 populate_metadata read hostname 'smithi055' 2024-04-02T07:29:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd817b05000 1 --2- 172.21.15.55:0/1998460272 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55c02a99f1e0 0x55c02a9a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd817b05000 4 client.7914 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:29:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd817b05000 1 -- 172.21.15.55:0/1998460272 --> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c02a764d00 con 0x55c02a99f1e0 2024-04-02T07:29:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd811200640 1 --2- 172.21.15.55:0/1998460272 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55c02a99f1e0 0x55c02a9a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd811200640 1 --2- 172.21.15.55:0/1998460272 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55c02a99f1e0 0x55c02a9a15d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=189eeecd72248acf server_cookie=50bb3b9f25a6898 in_seq=0 out_seq=0 2024-04-02T07:29:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd7f2a00640 10 client.7914 ms_handle_connect on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd7f2a00640 1 -- 172.21.15.55:0/1998460272 <== mds.0 v2:172.21.15.55:6832/821922065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55c02a764d00 con 0x55c02a99f1e0 2024-04-02T07:29:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd7f2a00640 10 client.7914 handle_command_reply: tid=0 2024-04-02T07:29:53.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd817b05000 1 client.7914 shutdown 2024-04-02T07:29:53.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd817b05000 1 -- 172.21.15.55:0/1998460272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a943a00 msgr2=0x55c02a94bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:53.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd817b05000 1 --2- 172.21.15.55:0/1998460272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a943a00 0x55c02a94bad0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7fd800009010 tx=0x7fd800012000 comp rx=0 tx=0).stop 2024-04-02T07:29:53.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd817b05000 1 -- 172.21.15.55:0/1998460272 shutdown_connections 2024-04-02T07:29:53.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd817b05000 1 --2- 172.21.15.55:0/1998460272 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55c02a99f1e0 0x55c02a9a15d0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd817b05000 1 --2- 172.21.15.55:0/1998460272 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a990390 0x55c02a973f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd817b05000 1 --2- 172.21.15.55:0/1998460272 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a98fa70 0x55c02a973a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd817b05000 1 --2- 172.21.15.55:0/1998460272 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a943a00 0x55c02a94bad0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd7f2a00640 0 client.7914 ms_handle_reset on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:53.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd817b05000 1 -- 172.21.15.55:0/1998460272 >> 172.21.15.55:0/1998460272 conn(0x55c02a744160 msgr2=0x55c02a942bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:53.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd817b05000 1 -- 172.21.15.55:0/1998460272 shutdown_connections 2024-04-02T07:29:53.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd817b05000 1 -- 172.21.15.55:0/1998460272 wait complete. 2024-04-02T07:29:53.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.366+0000 7fd817b05000 20 client.7914 trim_cache size 0 max 16384 2024-04-02T07:29:53.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd817b05000 1 Processor -- start 2024-04-02T07:29:53.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd817b05000 1 -- start start 2024-04-02T07:29:53.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd817b05000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a943a00 0x55c02a942bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd817b05000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a98fa70 0x55c02a943100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd817b05000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a990390 0x55c02a943de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd817b05000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02a451aa0 con 0x55c02a990390 2024-04-02T07:29:53.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd817b05000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02a7922a0 con 0x55c02a943a00 2024-04-02T07:29:53.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd817b05000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c02a7975f0 con 0x55c02a98fa70 2024-04-02T07:29:53.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd812600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a990390 0x55c02a943de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd812600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a990390 0x55c02a943de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55966/0 (socket says 172.21.15.55:55966) 2024-04-02T07:29:53.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd812600640 1 -- 172.21.15.55:0/2544557268 learned_addr learned my addr 172.21.15.55:0/2544557268 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:53.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd811200640 1 --2- 172.21.15.55:0/2544557268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a98fa70 0x55c02a943100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd811c00640 1 --2- 172.21.15.55:0/2544557268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a943a00 0x55c02a942bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd812600640 1 -- 172.21.15.55:0/2544557268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a98fa70 msgr2=0x55c02a943100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:53.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd812600640 1 --2- 172.21.15.55:0/2544557268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a98fa70 0x55c02a943100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd812600640 1 -- 172.21.15.55:0/2544557268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a943a00 msgr2=0x55c02a942bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:53.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd812600640 1 --2- 172.21.15.55:0/2544557268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a943a00 0x55c02a942bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd812600640 1 -- 172.21.15.55:0/2544557268 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c02a73fdf0 con 0x55c02a990390 2024-04-02T07:29:53.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd811200640 1 --2- 172.21.15.55:0/2544557268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a98fa70 0x55c02a943100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:29:53.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd811c00640 1 --2- 172.21.15.55:0/2544557268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a943a00 0x55c02a942bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:29:53.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd812600640 1 --2- 172.21.15.55:0/2544557268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a990390 0x55c02a943de0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fd804009a40 tx=0x7fd80405c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28477f22baba1416 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:53.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd7fea00640 1 -- 172.21.15.55:0/2544557268 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd804083270 con 0x55c02a990390 2024-04-02T07:29:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd7fea00640 1 -- 172.21.15.55:0/2544557268 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd80406d070 con 0x55c02a990390 2024-04-02T07:29:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd7fea00640 1 -- 172.21.15.55:0/2544557268 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80405e460 con 0x55c02a990390 2024-04-02T07:29:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd817b05000 1 -- 172.21.15.55:0/2544557268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a990390 msgr2=0x55c02a943de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd817b05000 1 --2- 172.21.15.55:0/2544557268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a990390 0x55c02a943de0 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7fd804009a40 tx=0x7fd80405c040 comp rx=0 tx=0).stop 2024-04-02T07:29:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd817b05000 1 -- 172.21.15.55:0/2544557268 shutdown_connections 2024-04-02T07:29:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd817b05000 1 --2- 172.21.15.55:0/2544557268 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a990390 0x55c02a943de0 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd817b05000 1 --2- 172.21.15.55:0/2544557268 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a98fa70 0x55c02a943100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd817b05000 1 --2- 172.21.15.55:0/2544557268 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a943a00 0x55c02a942bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd817b05000 1 -- 172.21.15.55:0/2544557268 >> 172.21.15.55:0/2544557268 conn(0x55c02a744160 msgr2=0x55c02a9424b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:53.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd817b05000 1 -- 172.21.15.55:0/2544557268 shutdown_connections 2024-04-02T07:29:53.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.382+0000 7fd817b05000 1 -- 172.21.15.55:0/2544557268 wait complete. 2024-04-02T07:29:53.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd817b05000 1 -- start start 2024-04-02T07:29:53.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd817b05000 1 Processor -- start 2024-04-02T07:29:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd817b05000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a943a00 0x55c02a9d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd817b05000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a98fa70 0x55c02a9460f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd817b05000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a990390 0x55c02a946630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd817b05000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02a865470 con 0x55c02a98fa70 2024-04-02T07:29:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd817b05000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c02a75e640 con 0x55c02a990390 2024-04-02T07:29:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd817b05000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55c02a760390 con 0x55c02a943a00 2024-04-02T07:29:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd817b05000 10 client.0 _ll_register_callbacks cb 0x7fd800001440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:29:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd811200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a98fa70 0x55c02a9460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd811c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a943a00 0x55c02a9d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd811200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a98fa70 0x55c02a9460f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55978/0 (socket says 172.21.15.55:55978) 2024-04-02T07:29:53.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd811200640 1 -- 172.21.15.55:0/1615721615 learned_addr learned my addr 172.21.15.55:0/1615721615 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:29:53.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd812600640 1 --2- 172.21.15.55:0/1615721615 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a990390 0x55c02a946630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd811200640 1 -- 172.21.15.55:0/1615721615 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a943a00 msgr2=0x55c02a9d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:53.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd811200640 1 --2- 172.21.15.55:0/1615721615 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a943a00 0x55c02a9d2640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd811200640 1 -- 172.21.15.55:0/1615721615 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a990390 msgr2=0x55c02a946630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:29:53.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd811200640 1 --2- 172.21.15.55:0/1615721615 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a990390 0x55c02a946630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd811200640 1 -- 172.21.15.55:0/1615721615 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd80c13a280 con 0x55c02a98fa70 2024-04-02T07:29:53.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd811200640 1 --2- 172.21.15.55:0/1615721615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a98fa70 0x55c02a9460f0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fd7f801cd40 tx=0x7fd7f801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79be12b1f4844293 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:29:53.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd7f2a00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:29:53.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd7f2a00640 1 -- 172.21.15.55:0/1615721615 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7f80bf5c0 con 0x55c02a98fa70 2024-04-02T07:29:53.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd7f2a00640 1 -- 172.21.15.55:0/1615721615 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7fd7f80bc040 con 0x55c02a98fa70 2024-04-02T07:29:53.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd817b05000 1 -- 172.21.15.55:0/1615721615 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c02a751970 con 0x55c02a98fa70 2024-04-02T07:29:53.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd7f2a00640 1 -- 172.21.15.55:0/1615721615 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7f80ad910 con 0x55c02a98fa70 2024-04-02T07:29:53.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd817b05000 10 client.7920 fetch_fsmap learned FSMap version 67 2024-04-02T07:29:53.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd817b05000 1 -- 172.21.15.55:0/1615721615 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x55c02a733960 con 0x55c02a98fa70 2024-04-02T07:29:53.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd7f2a00640 1 -- 172.21.15.55:0/1615721615 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55c02a751970 con 0x55c02a98fa70 2024-04-02T07:29:53.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd7f2a00640 1 -- 172.21.15.55:0/1615721615 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 67) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd7f80c7020 con 0x55c02a98fa70 2024-04-02T07:29:53.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd817b05000 10 client.7920 fetch_fsmap finished waiting for FSMap version 67 2024-04-02T07:29:53.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd817b05000 10 client.7920 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-02T07:29:53.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd817b05000 20 client.7920 populate_metadata read hostname 'smithi055' 2024-04-02T07:29:53.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd817b05000 1 --2- 172.21.15.55:0/1615721615 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55c02a974310 0x55c02a946b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:29:53.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd817b05000 4 client.7920 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-02T07:29:53.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd817b05000 1 -- 172.21.15.55:0/1615721615 --> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55c02a7c3a20 con 0x55c02a974310 2024-04-02T07:29:53.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.386+0000 7fd811c00640 1 --2- 172.21.15.55:0/1615721615 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55c02a974310 0x55c02a946b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:29:53.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd811c00640 1 --2- 172.21.15.55:0/1615721615 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55c02a974310 0x55c02a946b70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=40574bdc450eca30 server_cookie=51ce2b6b25d1a870 in_seq=0 out_seq=0 2024-04-02T07:29:53.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd7f2a00640 10 client.7920 ms_handle_connect on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:53.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd7f2a00640 1 -- 172.21.15.55:0/1615721615 <== mds.0 v2:172.21.15.55:6832/821922065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+263 (crc 0 0 0) 0x55c02a7c3a20 con 0x55c02a974310 2024-04-02T07:29:53.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd7f2a00640 10 client.7920 handle_command_reply: tid=0 2024-04-02T07:29:53.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd817b05000 1 client.7920 shutdown 2024-04-02T07:29:53.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd817b05000 1 -- 172.21.15.55:0/1615721615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a98fa70 msgr2=0x55c02a9460f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:53.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd817b05000 1 --2- 172.21.15.55:0/1615721615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a98fa70 0x55c02a9460f0 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fd7f801cd40 tx=0x7fd7f801ace0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd817b05000 1 -- 172.21.15.55:0/1615721615 shutdown_connections 2024-04-02T07:29:53.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd817b05000 1 --2- 172.21.15.55:0/1615721615 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55c02a974310 0x55c02a946b70 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd817b05000 1 --2- 172.21.15.55:0/1615721615 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55c02a990390 0x55c02a946630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd817b05000 1 --2- 172.21.15.55:0/1615721615 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55c02a98fa70 0x55c02a9460f0 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd7f2a00640 0 client.7920 ms_handle_reset on v2:172.21.15.55:6832/821922065 2024-04-02T07:29:53.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd817b05000 1 --2- 172.21.15.55:0/1615721615 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55c02a943a00 0x55c02a9d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd817b05000 1 -- 172.21.15.55:0/1615721615 >> 172.21.15.55:0/1615721615 conn(0x55c02a744160 msgr2=0x55c02a942bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:53.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd817b05000 1 -- 172.21.15.55:0/1615721615 shutdown_connections 2024-04-02T07:29:53.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd817b05000 1 -- 172.21.15.55:0/1615721615 wait complete. 2024-04-02T07:29:53.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd817b05000 20 client.7920 trim_cache size 0 max 16384 2024-04-02T07:29:53.396 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:29:53.396 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-02T07:29:53.396 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-04-02T07:29:53.396 INFO:teuthology.orchestra.run.smithi055.stdout: "bfcf1b5b-f6f7-430d-ae38-650086a576bf": { 2024-04-02T07:29:53.396 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/dir", 2024-04-02T07:29:53.396 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "bfcf1b5b-f6f7-430d-ae38-650086a576bf", 2024-04-02T07:29:53.396 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive,repair" 2024-04-02T07:29:53.396 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:29:53.397 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:29:53.397 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:29:53.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd814600640 1 -- 172.21.15.55:0/631287924 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd7ec066690 msgr2=0x7fd7ec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:53.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd814600640 1 --2- 172.21.15.55:0/631287924 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd7ec066690 0x7fd7ec068b50 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd800005890 tx=0x7fd800009040 comp rx=0 tx=0).stop 2024-04-02T07:29:53.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd814600640 1 -- 172.21.15.55:0/631287924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd80c144260 msgr2=0x7fd80c140d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:29:53.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd814600640 1 --2- 172.21.15.55:0/631287924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd80c144260 0x7fd80c140d50 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7fd80400efc0 tx=0x7fd80400c490 comp rx=0 tx=0).stop 2024-04-02T07:29:53.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd814600640 1 -- 172.21.15.55:0/631287924 shutdown_connections 2024-04-02T07:29:53.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd814600640 1 --2- 172.21.15.55:0/631287924 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd80c144260 0x7fd80c140d50 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd814600640 1 --2- 172.21.15.55:0/631287924 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd80c0b2fd0 0x7fd80c1f56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd814600640 1 --2- 172.21.15.55:0/631287924 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd7ec066690 0x7fd7ec068b50 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd814600640 1 --2- 172.21.15.55:0/631287924 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd80c0709b0 0x7fd80c1397b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:29:53.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd814600640 1 -- 172.21.15.55:0/631287924 >> 172.21.15.55:0/631287924 conn(0x7fd80c06a390 msgr2=0x7fd80c164c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:29:53.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd814600640 1 -- 172.21.15.55:0/631287924 shutdown_connections 2024-04-02T07:29:53.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:29:53.390+0000 7fd814600640 1 -- 172.21.15.55:0/631287924 wait complete. 2024-04-02T07:29:53.410 INFO:tasks.cephfs.filesystem:scrub status for tag:bfcf1b5b-f6f7-430d-ae38-650086a576bf - {'path': '/dir', 'tag': 'bfcf1b5b-f6f7-430d-ae38-650086a576bf', 'options': 'recursive,repair'} 2024-04-02T07:29:59.998 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-02T07:29:59.998+0000 7f8f1ba00640 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 MDSs report damaged metadata 2024-04-02T07:30:14.796 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:30:14.800 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:30:23.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:30:23.411 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-02T07:30:23.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.562+0000 7f9ba9800640 1 Processor -- start 2024-04-02T07:30:23.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.562+0000 7f9ba9800640 1 -- start start 2024-04-02T07:30:23.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.562+0000 7f9ba9800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ba40ade90 0x7f9ba406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.562+0000 7f9ba9800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba406c630 con 0x7f9ba40b41a0 2024-04-02T07:30:23.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.562+0000 7f9ba9800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ba406c8f0 con 0x7f9ba40b3dc0 2024-04-02T07:30:23.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.562+0000 7f9ba9800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba40cae80 con 0x7f9ba40ade90 2024-04-02T07:30:23.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.566+0000 7f9ba3400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9ba40b41a0 0x7f9ba4142ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53546/0 (socket says 172.21.15.55:53546) 2024-04-02T07:30:23.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.566+0000 7f9ba3400640 1 -- 172.21.15.55:0/338615024 learned_addr learned my addr 172.21.15.55:0/338615024 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:30:23.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.566+0000 7f9b9be00640 1 --2- 172.21.15.55:0/338615024 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ba40ade90 0x7f9ba406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.566+0000 7f9ba2000640 1 -- 172.21.15.55:0/338615024 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2818490447 0 0) 0x7f9ba406c630 con 0x7f9ba40b41a0 2024-04-02T07:30:23.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.566+0000 7f9ba2000640 1 -- 172.21.15.55:0/338615024 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9b88003530 con 0x7f9ba40b41a0 2024-04-02T07:30:23.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.566+0000 7f9ba2000640 1 -- 172.21.15.55:0/338615024 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870311055 0 0) 0x7f9ba406c8f0 con 0x7f9ba40b3dc0 2024-04-02T07:30:23.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.566+0000 7f9ba2000640 1 -- 172.21.15.55:0/338615024 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ba406c630 con 0x7f9ba40b3dc0 2024-04-02T07:30:23.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.566+0000 7f9b9be00640 1 -- 172.21.15.55:0/338615024 >> v1:172.21.15.106:6789/0 conn(0x7f9ba40b3dc0 legacy=0x7f9ba40ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:23.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.566+0000 7f9b9be00640 1 -- 172.21.15.55:0/338615024 >> v1:172.21.15.55:6789/0 conn(0x7f9ba40b41a0 legacy=0x7f9ba4142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:23.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.566+0000 7f9b9be00640 1 -- 172.21.15.55:0/338615024 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba406cbd0 con 0x7f9ba40ade90 2024-04-02T07:30:23.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.566+0000 7f9b9be00640 1 --2- 172.21.15.55:0/338615024 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ba40ade90 0x7f9ba406d6b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9ba406c820 tx=0x7f9b8c01c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=765d31f6e783980e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:23.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba2000640 1 -- 172.21.15.55:0/338615024 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c0ab600 con 0x7f9ba40ade90 2024-04-02T07:30:23.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba2000640 1 -- 172.21.15.55:0/338615024 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c0ab760 con 0x7f9ba40ade90 2024-04-02T07:30:23.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba2000640 1 -- 172.21.15.55:0/338615024 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c0abaf0 con 0x7f9ba40ade90 2024-04-02T07:30:23.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba9800640 1 -- 172.21.15.55:0/338615024 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ba40ade90 msgr2=0x7f9ba406d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:23.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba9800640 1 --2- 172.21.15.55:0/338615024 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ba40ade90 0x7f9ba406d6b0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9ba406c820 tx=0x7f9b8c01c400 comp rx=0 tx=0).stop 2024-04-02T07:30:23.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba9800640 1 -- 172.21.15.55:0/338615024 shutdown_connections 2024-04-02T07:30:23.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba9800640 1 --2- 172.21.15.55:0/338615024 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ba40ade90 0x7f9ba406d6b0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba9800640 1 -- 172.21.15.55:0/338615024 >> 172.21.15.55:0/338615024 conn(0x7f9ba406a390 msgr2=0x7f9ba40b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:23.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba9800640 1 -- 172.21.15.55:0/338615024 shutdown_connections 2024-04-02T07:30:23.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba9800640 1 -- 172.21.15.55:0/338615024 wait complete. 2024-04-02T07:30:23.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba9800640 1 Processor -- start 2024-04-02T07:30:23.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba9800640 1 -- start start 2024-04-02T07:30:23.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba9800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ba40ade90 0x7f9ba4151f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba9800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ba40b3dc0 0x7f9ba413ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba9800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ba40b41a0 0x7f9ba4137530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba9800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba413eae0 con 0x7f9ba40b3dc0 2024-04-02T07:30:23.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba9800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba413d910 con 0x7f9ba40b41a0 2024-04-02T07:30:23.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba9800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba413dbf0 con 0x7f9ba40ade90 2024-04-02T07:30:23.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9b9be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ba40b3dc0 0x7f9ba413ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9b9be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ba40b3dc0 0x7f9ba413ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52202/0 (socket says 172.21.15.55:52202) 2024-04-02T07:30:23.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9b9be00640 1 -- 172.21.15.55:0/1666376406 learned_addr learned my addr 172.21.15.55:0/1666376406 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:23.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba2a00640 1 --2- 172.21.15.55:0/1666376406 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ba40ade90 0x7f9ba4151f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba3400640 1 --2- 172.21.15.55:0/1666376406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ba40b41a0 0x7f9ba4137530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9b9be00640 1 -- 172.21.15.55:0/1666376406 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ba40ade90 msgr2=0x7f9ba4151f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:23.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9b9be00640 1 --2- 172.21.15.55:0/1666376406 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ba40ade90 0x7f9ba4151f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9b9be00640 1 -- 172.21.15.55:0/1666376406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ba40b41a0 msgr2=0x7f9ba4137530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:23.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9b9be00640 1 --2- 172.21.15.55:0/1666376406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ba40b41a0 0x7f9ba4137530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9b9be00640 1 -- 172.21.15.55:0/1666376406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b8c009420 con 0x7f9ba40b3dc0 2024-04-02T07:30:23.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.570+0000 7f9ba2a00640 1 --2- 172.21.15.55:0/1666376406 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ba40ade90 0x7f9ba4151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:30:23.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.574+0000 7f9b9be00640 1 --2- 172.21.15.55:0/1666376406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ba40b3dc0 0x7f9ba413ef70 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0ad040 tx=0x7f9b8c01ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:23.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.574+0000 7f9b9aa00640 1 -- 172.21.15.55:0/1666376406 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c0bf610 con 0x7f9ba40b3dc0 2024-04-02T07:30:23.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.574+0000 7f9b9aa00640 1 -- 172.21.15.55:0/1666376406 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c0bf790 con 0x7f9ba40b3dc0 2024-04-02T07:30:23.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.574+0000 7f9b9aa00640 1 -- 172.21.15.55:0/1666376406 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c0bfb40 con 0x7f9ba40b3dc0 2024-04-02T07:30:23.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.574+0000 7f9ba9800640 1 -- 172.21.15.55:0/1666376406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba413e770 con 0x7f9ba40b3dc0 2024-04-02T07:30:23.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.574+0000 7f9ba9800640 1 -- 172.21.15.55:0/1666376406 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba41524d0 con 0x7f9ba40b3dc0 2024-04-02T07:30:23.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.574+0000 7f9b9aa00640 1 -- 172.21.15.55:0/1666376406 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f9b8c0b5400 con 0x7f9ba40b3dc0 2024-04-02T07:30:23.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.574+0000 7f9b9aa00640 1 --2- 172.21.15.55:0/1666376406 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9b80066690 0x7f9b80068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.574+0000 7f9b9aa00640 1 -- 172.21.15.55:0/1666376406 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f9b8c11e9c0 con 0x7f9ba40b3dc0 2024-04-02T07:30:23.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.574+0000 7f9ba2a00640 1 --2- 172.21.15.55:0/1666376406 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9b80066690 0x7f9b80068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9baccdd000 1 Processor -- start 2024-04-02T07:30:23.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9baccdd000 1 -- start start 2024-04-02T07:30:23.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9ba2a00640 1 --2- 172.21.15.55:0/1666376406 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9b80066690 0x7f9b80068b50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9b940011f0 tx=0x7f9b94009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:23.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9baccdd000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fc03935e60 0x55fc03936240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9baccdd000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc03936780 0x55fc038e98d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9baccdd000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc038e9e10 0x55fc038ea1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9baccdd000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc037b0630 con 0x55fc03936780 2024-04-02T07:30:23.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9baccdd000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc0373dbd0 con 0x55fc038e9e10 2024-04-02T07:30:23.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9baccdd000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc0373b1a0 con 0x55fc03935e60 2024-04-02T07:30:23.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9b9be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc03936780 0x55fc038e98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9ba3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc038e9e10 0x55fc038ea1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9ba2a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fc03935e60 0x55fc03936240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9ba3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc038e9e10 0x55fc038ea1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:43000/0 (socket says 172.21.15.55:43000) 2024-04-02T07:30:23.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9b9be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc03936780 0x55fc038e98d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52216/0 (socket says 172.21.15.55:52216) 2024-04-02T07:30:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9ba3400640 1 -- 172.21.15.55:0/3882530939 learned_addr learned my addr 172.21.15.55:0/3882530939 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9b9be00640 1 -- 172.21.15.55:0/3882530939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fc03935e60 msgr2=0x55fc03936240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9b9be00640 1 --2- 172.21.15.55:0/3882530939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fc03935e60 0x55fc03936240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9b9be00640 1 -- 172.21.15.55:0/3882530939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc038e9e10 msgr2=0x55fc038ea1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9b9be00640 1 --2- 172.21.15.55:0/3882530939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc038e9e10 0x55fc038ea1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9b9be00640 1 -- 172.21.15.55:0/3882530939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc03432e20 con 0x55fc03936780 2024-04-02T07:30:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9ba3400640 1 --2- 172.21.15.55:0/3882530939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc038e9e10 0x55fc038ea1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:30:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9b9be00640 1 --2- 172.21.15.55:0/3882530939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc03936780 0x55fc038e98d0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c000c10 tx=0x7f9b8c0ef310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1799dab68d9cdd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9b93400640 1 -- 172.21.15.55:0/3882530939 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c0f7cf0 con 0x55fc03936780 2024-04-02T07:30:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9b93400640 1 -- 172.21.15.55:0/3882530939 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b8c0edd50 con 0x55fc03936780 2024-04-02T07:30:23.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9b93400640 1 -- 172.21.15.55:0/3882530939 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c107120 con 0x55fc03936780 2024-04-02T07:30:23.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9baccdd000 1 -- 172.21.15.55:0/3882530939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc03936780 msgr2=0x55fc038e98d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:23.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9baccdd000 1 --2- 172.21.15.55:0/3882530939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc03936780 0x55fc038e98d0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c000c10 tx=0x7f9b8c0ef310 comp rx=0 tx=0).stop 2024-04-02T07:30:23.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9baccdd000 1 -- 172.21.15.55:0/3882530939 shutdown_connections 2024-04-02T07:30:23.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9baccdd000 1 --2- 172.21.15.55:0/3882530939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc038e9e10 0x55fc038ea1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9baccdd000 1 --2- 172.21.15.55:0/3882530939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc03936780 0x55fc038e98d0 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9baccdd000 1 --2- 172.21.15.55:0/3882530939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fc03935e60 0x55fc03936240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9baccdd000 1 -- 172.21.15.55:0/3882530939 >> 172.21.15.55:0/3882530939 conn(0x55fc036e6160 msgr2=0x55fc03914820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:23.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9baccdd000 1 -- 172.21.15.55:0/3882530939 shutdown_connections 2024-04-02T07:30:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9baccdd000 1 -- 172.21.15.55:0/3882530939 wait complete. 2024-04-02T07:30:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.578+0000 7f9baccdd000 1 -- start start 2024-04-02T07:30:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9baccdd000 1 Processor -- start 2024-04-02T07:30:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9baccdd000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc038e9e10 0x55fc0393d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9baccdd000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fc03935e60 0x55fc0393d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9baccdd000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc03936780 0x55fc03918cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9baccdd000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc03736a90 con 0x55fc038e9e10 2024-04-02T07:30:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9baccdd000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc036d5d40 con 0x55fc03936780 2024-04-02T07:30:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9baccdd000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc036f3f30 con 0x55fc03935e60 2024-04-02T07:30:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9baccdd000 10 client.0 _ll_register_callbacks cb 0x55fc03798810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:30:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9ba2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc038e9e10 0x55fc0393d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9ba2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc038e9e10 0x55fc0393d1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52222/0 (socket says 172.21.15.55:52222) 2024-04-02T07:30:23.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9ba2a00640 1 -- 172.21.15.55:0/1730963398 learned_addr learned my addr 172.21.15.55:0/1730963398 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:23.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9b9be00640 1 --2- 172.21.15.55:0/1730963398 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fc03935e60 0x55fc0393d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9ba3400640 1 --2- 172.21.15.55:0/1730963398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc03936780 0x55fc03918cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9ba2a00640 1 -- 172.21.15.55:0/1730963398 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fc03935e60 msgr2=0x55fc0393d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:23.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9ba2a00640 1 --2- 172.21.15.55:0/1730963398 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fc03935e60 0x55fc0393d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9ba2a00640 1 -- 172.21.15.55:0/1730963398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc03936780 msgr2=0x55fc03918cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:23.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9ba2a00640 1 --2- 172.21.15.55:0/1730963398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc03936780 0x55fc03918cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9ba2a00640 1 -- 172.21.15.55:0/1730963398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b88003530 con 0x55fc038e9e10 2024-04-02T07:30:23.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9ba3400640 1 --2- 172.21.15.55:0/1730963398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc03936780 0x55fc03918cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:30:23.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9ba2a00640 1 --2- 172.21.15.55:0/1730963398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc038e9e10 0x55fc0393d1c0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400ea40 tx=0x7f9b94001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6094654ddabd9c36 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:23.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9b87e00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:30:23.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9b87e00640 1 -- 172.21.15.55:0/1730963398 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94003d90 con 0x55fc038e9e10 2024-04-02T07:30:23.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9b87e00640 1 -- 172.21.15.55:0/1730963398 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f9b94023b70 con 0x55fc038e9e10 2024-04-02T07:30:23.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9baccdd000 1 -- 172.21.15.55:0/1730963398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc037353e0 con 0x55fc038e9e10 2024-04-02T07:30:23.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9b87e00640 1 -- 172.21.15.55:0/1730963398 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b94023d70 con 0x55fc038e9e10 2024-04-02T07:30:23.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9baccdd000 10 client.7932 fetch_fsmap learned FSMap version 67 2024-04-02T07:30:23.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9baccdd000 1 -- 172.21.15.55:0/1730963398 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x7f9ba41524d0 con 0x55fc038e9e10 2024-04-02T07:30:23.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9b87e00640 1 -- 172.21.15.55:0/1730963398 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc037353e0 con 0x55fc038e9e10 2024-04-02T07:30:23.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9b87e00640 1 -- 172.21.15.55:0/1730963398 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 67) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f9b94020070 con 0x55fc038e9e10 2024-04-02T07:30:23.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9baccdd000 10 client.7932 fetch_fsmap finished waiting for FSMap version 67 2024-04-02T07:30:23.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9baccdd000 10 client.7932 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-02T07:30:23.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9baccdd000 20 client.7932 populate_metadata read hostname 'smithi055' 2024-04-02T07:30:23.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9baccdd000 1 --2- 172.21.15.55:0/1730963398 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55fc03919a30 0x55fc03919e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9baccdd000 4 client.7932 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:30:23.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9baccdd000 1 -- 172.21.15.55:0/1730963398 --> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fc03706d00 con 0x55fc03919a30 2024-04-02T07:30:23.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9b9be00640 1 --2- 172.21.15.55:0/1730963398 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55fc03919a30 0x55fc03919e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9b9be00640 1 --2- 172.21.15.55:0/1730963398 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55fc03919a30 0x55fc03919e40 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db5d2c10967ee16b server_cookie=85ab0f2cac387d04 in_seq=0 out_seq=0 2024-04-02T07:30:23.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.582+0000 7f9b87e00640 10 client.7932 ms_handle_connect on v2:172.21.15.55:6832/821922065 2024-04-02T07:30:23.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.586+0000 7f9b87e00640 1 -- 172.21.15.55:0/1730963398 <== mds.0 v2:172.21.15.55:6832/821922065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55fc03706d00 con 0x55fc03919a30 2024-04-02T07:30:23.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.586+0000 7f9b87e00640 10 client.7932 handle_command_reply: tid=0 2024-04-02T07:30:23.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.586+0000 7f9baccdd000 1 client.7932 shutdown 2024-04-02T07:30:23.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.586+0000 7f9baccdd000 1 -- 172.21.15.55:0/1730963398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc038e9e10 msgr2=0x55fc0393d1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:23.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.586+0000 7f9baccdd000 1 --2- 172.21.15.55:0/1730963398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc038e9e10 0x55fc0393d1c0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400ea40 tx=0x7f9b94001160 comp rx=0 tx=0).stop 2024-04-02T07:30:23.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.586+0000 7f9baccdd000 1 -- 172.21.15.55:0/1730963398 shutdown_connections 2024-04-02T07:30:23.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.586+0000 7f9baccdd000 1 --2- 172.21.15.55:0/1730963398 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55fc03919a30 0x55fc03919e40 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.586+0000 7f9baccdd000 1 --2- 172.21.15.55:0/1730963398 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc03936780 0x55fc03918cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.586+0000 7f9baccdd000 1 --2- 172.21.15.55:0/1730963398 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fc03935e60 0x55fc0393d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.586+0000 7f9baccdd000 1 --2- 172.21.15.55:0/1730963398 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc038e9e10 0x55fc0393d1c0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.586+0000 7f9baccdd000 1 -- 172.21.15.55:0/1730963398 >> 172.21.15.55:0/1730963398 conn(0x55fc036e6160 msgr2=0x55fc038e4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:23.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.586+0000 7f9b87e00640 0 client.7932 ms_handle_reset on v2:172.21.15.55:6832/821922065 2024-04-02T07:30:23.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.586+0000 7f9baccdd000 1 -- 172.21.15.55:0/1730963398 shutdown_connections 2024-04-02T07:30:23.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.586+0000 7f9baccdd000 1 -- 172.21.15.55:0/1730963398 wait complete. 2024-04-02T07:30:23.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.586+0000 7f9baccdd000 20 client.7932 trim_cache size 0 max 16384 2024-04-02T07:30:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.598+0000 7f9baccdd000 1 Processor -- start 2024-04-02T07:30:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.598+0000 7f9baccdd000 1 -- start start 2024-04-02T07:30:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc038e9e10 0x55fc0398fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc03935e60 0x55fc03990100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fc03936780 0x55fc03990640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc033f3aa0 con 0x55fc038e9e10 2024-04-02T07:30:23.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc037efec0 con 0x55fc03935e60 2024-04-02T07:30:23.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc03735920 con 0x55fc03936780 2024-04-02T07:30:23.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9ba2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc038e9e10 0x55fc0398fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9ba2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc038e9e10 0x55fc0398fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52236/0 (socket says 172.21.15.55:52236) 2024-04-02T07:30:23.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9ba2a00640 1 -- 172.21.15.55:0/3788939147 learned_addr learned my addr 172.21.15.55:0/3788939147 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:23.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9ba3400640 1 --2- 172.21.15.55:0/3788939147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fc03936780 0x55fc03990640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9b9be00640 1 --2- 172.21.15.55:0/3788939147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc03935e60 0x55fc03990100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9ba2a00640 1 -- 172.21.15.55:0/3788939147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fc03936780 msgr2=0x55fc03990640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:23.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9ba2a00640 1 --2- 172.21.15.55:0/3788939147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fc03936780 0x55fc03990640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9ba2a00640 1 -- 172.21.15.55:0/3788939147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc03935e60 msgr2=0x55fc03990100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:23.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9ba2a00640 1 --2- 172.21.15.55:0/3788939147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc03935e60 0x55fc03990100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9ba2a00640 1 -- 172.21.15.55:0/3788939147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fc036fbaa0 con 0x55fc038e9e10 2024-04-02T07:30:23.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9ba2a00640 1 --2- 172.21.15.55:0/3788939147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc038e9e10 0x55fc0398fbc0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f9b94001670 tx=0x7f9b94017070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccecda72f04360ef server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:23.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9b93e00640 1 -- 172.21.15.55:0/3788939147 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94003d90 con 0x55fc038e9e10 2024-04-02T07:30:23.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9b93e00640 1 -- 172.21.15.55:0/3788939147 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b940039d0 con 0x55fc038e9e10 2024-04-02T07:30:23.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9b93e00640 1 -- 172.21.15.55:0/3788939147 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94013b20 con 0x55fc038e9e10 2024-04-02T07:30:23.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 -- 172.21.15.55:0/3788939147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc038e9e10 msgr2=0x55fc0398fbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:23.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 --2- 172.21.15.55:0/3788939147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc038e9e10 0x55fc0398fbc0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f9b94001670 tx=0x7f9b94017070 comp rx=0 tx=0).stop 2024-04-02T07:30:23.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 -- 172.21.15.55:0/3788939147 shutdown_connections 2024-04-02T07:30:23.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 --2- 172.21.15.55:0/3788939147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fc03936780 0x55fc03990640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 --2- 172.21.15.55:0/3788939147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc03935e60 0x55fc03990100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 --2- 172.21.15.55:0/3788939147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc038e9e10 0x55fc0398fbc0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 -- 172.21.15.55:0/3788939147 >> 172.21.15.55:0/3788939147 conn(0x55fc036e6160 msgr2=0x55fc03917880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:23.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 -- 172.21.15.55:0/3788939147 shutdown_connections 2024-04-02T07:30:23.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 -- 172.21.15.55:0/3788939147 wait complete. 2024-04-02T07:30:23.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 -- start start 2024-04-02T07:30:23.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 Processor -- start 2024-04-02T07:30:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fc038e9e10 0x55fc03995750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc03935e60 0x55fc03995c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc03936780 0x55fc0399a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc03700ee0 con 0x55fc03935e60 2024-04-02T07:30:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fc0394c580 con 0x55fc03936780 2024-04-02T07:30:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fc03943c00 con 0x55fc038e9e10 2024-04-02T07:30:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.602+0000 7f9baccdd000 10 client.0 _ll_register_callbacks cb 0x7f9b8c006c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:30:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9b9be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc03935e60 0x55fc03995c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9b9be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc03935e60 0x55fc03995c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52252/0 (socket says 172.21.15.55:52252) 2024-04-02T07:30:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9b9be00640 1 -- 172.21.15.55:0/1411051610 learned_addr learned my addr 172.21.15.55:0/1411051610 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9ba2a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fc038e9e10 0x55fc03995750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9ba3400640 1 --2- 172.21.15.55:0/1411051610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc03936780 0x55fc0399a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9b9be00640 1 -- 172.21.15.55:0/1411051610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fc038e9e10 msgr2=0x55fc03995750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9b9be00640 1 --2- 172.21.15.55:0/1411051610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fc038e9e10 0x55fc03995750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9b9be00640 1 -- 172.21.15.55:0/1411051610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc03936780 msgr2=0x55fc0399a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9b9be00640 1 --2- 172.21.15.55:0/1411051610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc03936780 0x55fc0399a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9b9be00640 1 -- 172.21.15.55:0/1411051610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba41524d0 con 0x55fc03935e60 2024-04-02T07:30:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9b9be00640 1 --2- 172.21.15.55:0/1411051610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc03935e60 0x55fc03995c90 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c01c970 tx=0x7f9b8c0f1000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d597a33dd6615581 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9b87e00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:30:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9b87e00640 1 -- 172.21.15.55:0/1411051610 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c11c040 con 0x55fc03935e60 2024-04-02T07:30:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9b87e00640 1 -- 172.21.15.55:0/1411051610 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f9b8c0ec0c0 con 0x55fc03935e60 2024-04-02T07:30:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 1 -- 172.21.15.55:0/1411051610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fc036f3970 con 0x55fc03935e60 2024-04-02T07:30:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9b87e00640 1 -- 172.21.15.55:0/1411051610 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b8c0ec280 con 0x55fc03935e60 2024-04-02T07:30:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 10 client.7938 fetch_fsmap learned FSMap version 67 2024-04-02T07:30:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 1 -- 172.21.15.55:0/1411051610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x55fc036e1df0 con 0x55fc03935e60 2024-04-02T07:30:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9b87e00640 1 -- 172.21.15.55:0/1411051610 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fc036f3970 con 0x55fc03935e60 2024-04-02T07:30:23.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9b87e00640 1 -- 172.21.15.55:0/1411051610 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 67) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f9b8c115050 con 0x55fc03935e60 2024-04-02T07:30:23.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 10 client.7938 fetch_fsmap finished waiting for FSMap version 67 2024-04-02T07:30:23.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 10 client.7938 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-02T07:30:23.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 20 client.7938 populate_metadata read hostname 'smithi055' 2024-04-02T07:30:23.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 1 --2- 172.21.15.55:0/1411051610 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55fc0399ab50 0x55fc0399cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 4 client.7938 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-02T07:30:23.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 1 -- 172.21.15.55:0/1411051610 --> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55fc03765a20 con 0x55fc0399ab50 2024-04-02T07:30:23.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9ba2a00640 1 --2- 172.21.15.55:0/1411051610 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55fc0399ab50 0x55fc0399cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9ba2a00640 1 --2- 172.21.15.55:0/1411051610 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55fc0399ab50 0x55fc0399cf40 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef24cd9075d824b5 server_cookie=bc843a1f27f9ba2b in_seq=0 out_seq=0 2024-04-02T07:30:23.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9b87e00640 10 client.7938 ms_handle_connect on v2:172.21.15.55:6832/821922065 2024-04-02T07:30:23.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9b87e00640 1 -- 172.21.15.55:0/1411051610 <== mds.0 v2:172.21.15.55:6832/821922065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55fc03765a20 con 0x55fc0399ab50 2024-04-02T07:30:23.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9b87e00640 10 client.7938 handle_command_reply: tid=0 2024-04-02T07:30:23.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 1 client.7938 shutdown 2024-04-02T07:30:23.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 1 -- 172.21.15.55:0/1411051610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc03935e60 msgr2=0x55fc03995c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:23.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 1 --2- 172.21.15.55:0/1411051610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc03935e60 0x55fc03995c90 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c01c970 tx=0x7f9b8c0f1000 comp rx=0 tx=0).stop 2024-04-02T07:30:23.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 1 -- 172.21.15.55:0/1411051610 shutdown_connections 2024-04-02T07:30:23.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 1 --2- 172.21.15.55:0/1411051610 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55fc0399ab50 0x55fc0399cf40 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 1 --2- 172.21.15.55:0/1411051610 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fc03936780 0x55fc0399a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 1 --2- 172.21.15.55:0/1411051610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fc03935e60 0x55fc03995c90 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 1 --2- 172.21.15.55:0/1411051610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fc038e9e10 0x55fc03995750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9b87e00640 0 client.7938 ms_handle_reset on v2:172.21.15.55:6832/821922065 2024-04-02T07:30:23.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 1 -- 172.21.15.55:0/1411051610 >> 172.21.15.55:0/1411051610 conn(0x55fc036e6160 msgr2=0x55fc03918110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:23.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 1 -- 172.21.15.55:0/1411051610 shutdown_connections 2024-04-02T07:30:23.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 1 -- 172.21.15.55:0/1411051610 wait complete. 2024-04-02T07:30:23.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9baccdd000 20 client.7938 trim_cache size 0 max 16384 2024-04-02T07:30:23.614 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:30:23.614 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-04-02T07:30:23.614 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-04-02T07:30:23.614 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:30:23.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9ba9800640 1 -- 172.21.15.55:0/1666376406 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9b80066690 msgr2=0x7f9b80068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:23.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9ba9800640 1 --2- 172.21.15.55:0/1666376406 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9b80066690 0x7f9b80068b50 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f9b940011f0 tx=0x7f9b94009040 comp rx=0 tx=0).stop 2024-04-02T07:30:23.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9ba9800640 1 -- 172.21.15.55:0/1666376406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ba40b3dc0 msgr2=0x7f9ba413ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:23.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9ba9800640 1 --2- 172.21.15.55:0/1666376406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ba40b3dc0 0x7f9ba413ef70 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f9b8c0ad040 tx=0x7f9b8c01ac40 comp rx=0 tx=0).stop 2024-04-02T07:30:23.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9ba9800640 1 -- 172.21.15.55:0/1666376406 shutdown_connections 2024-04-02T07:30:23.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9ba9800640 1 --2- 172.21.15.55:0/1666376406 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9b80066690 0x7f9b80068b50 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9ba9800640 1 --2- 172.21.15.55:0/1666376406 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ba40b41a0 0x7f9ba4137530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9ba9800640 1 --2- 172.21.15.55:0/1666376406 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ba40b3dc0 0x7f9ba413ef70 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9ba9800640 1 --2- 172.21.15.55:0/1666376406 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ba40ade90 0x7f9ba4151f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9ba9800640 1 -- 172.21.15.55:0/1666376406 >> 172.21.15.55:0/1666376406 conn(0x7f9ba406a390 msgr2=0x7f9ba40b1900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:23.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9ba9800640 1 -- 172.21.15.55:0/1666376406 shutdown_connections 2024-04-02T07:30:23.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.606+0000 7f9ba9800640 1 -- 172.21.15.55:0/1666376406 wait complete. 2024-04-02T07:30:23.628 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-02T07:30:23.629 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:30:23.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.770+0000 7ff6acc00640 1 Processor -- start 2024-04-02T07:30:23.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.770+0000 7ff6acc00640 1 -- start start 2024-04-02T07:30:23.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.770+0000 7ff6acc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff6a80c4120 0x7ff6a80b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.770+0000 7ff6acc00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a813d0c0 con 0x7ff6a80b36f0 2024-04-02T07:30:23.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.770+0000 7ff6acc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6a80b3b20 con 0x7ff6a8153ea0 2024-04-02T07:30:23.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.770+0000 7ff6acc00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6a815a2f0 con 0x7ff6a80c4120 2024-04-02T07:30:23.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.770+0000 7ff6a6800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff6a80b36f0 0x7ff6a813d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53552/0 (socket says 172.21.15.55:53552) 2024-04-02T07:30:23.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.770+0000 7ff6a6800640 1 -- 172.21.15.55:0/195464308 learned_addr learned my addr 172.21.15.55:0/195464308 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:30:23.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.770+0000 7ff6a5400640 1 --2- 172.21.15.55:0/195464308 >> v2:172.21.15.106:3300/0 conn(0x7ff6a80c4120 0x7ff6a80b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.770+0000 7ff6a4a00640 1 -- 172.21.15.55:0/195464308 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 150031485 0 0) 0x7ff6a813d0c0 con 0x7ff6a80b36f0 2024-04-02T07:30:23.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.770+0000 7ff6a4a00640 1 -- 172.21.15.55:0/195464308 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff68c003530 con 0x7ff6a80b36f0 2024-04-02T07:30:23.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.770+0000 7ff6a4a00640 1 -- 172.21.15.55:0/195464308 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1654085179 0 0) 0x7ff6a80b3b20 con 0x7ff6a8153ea0 2024-04-02T07:30:23.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.770+0000 7ff6a4a00640 1 -- 172.21.15.55:0/195464308 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6a813d0c0 con 0x7ff6a8153ea0 2024-04-02T07:30:23.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.770+0000 7ff6a5400640 1 -- 172.21.15.55:0/195464308 >> v1:172.21.15.106:6789/0 conn(0x7ff6a8153ea0 legacy=0x7ff6a8159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:23.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.770+0000 7ff6a5400640 1 -- 172.21.15.55:0/195464308 >> v1:172.21.15.55:6789/0 conn(0x7ff6a80b36f0 legacy=0x7ff6a813d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:23.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.770+0000 7ff6a5400640 1 -- 172.21.15.55:0/195464308 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6a815a4f0 con 0x7ff6a80c4120 2024-04-02T07:30:23.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.774+0000 7ff6a5400640 1 --2- 172.21.15.55:0/195464308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a80c4120 0x7ff6a80b31b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff6940097c0 tx=0x7ff69401c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b917a31c994f453 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.774+0000 7ff6a4a00640 1 -- 172.21.15.55:0/195464308 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6940ac410 con 0x7ff6a80c4120 2024-04-02T07:30:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.774+0000 7ff6a4a00640 1 -- 172.21.15.55:0/195464308 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6940ac570 con 0x7ff6a80c4120 2024-04-02T07:30:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.774+0000 7ff6a4a00640 1 -- 172.21.15.55:0/195464308 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6940ac900 con 0x7ff6a80c4120 2024-04-02T07:30:23.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.774+0000 7ff6acc00640 1 -- 172.21.15.55:0/195464308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a80c4120 msgr2=0x7ff6a80b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:23.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.774+0000 7ff6acc00640 1 --2- 172.21.15.55:0/195464308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a80c4120 0x7ff6a80b31b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7ff6940097c0 tx=0x7ff69401c4a0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.774+0000 7ff6acc00640 1 -- 172.21.15.55:0/195464308 shutdown_connections 2024-04-02T07:30:23.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.774+0000 7ff6acc00640 1 --2- 172.21.15.55:0/195464308 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a80c4120 0x7ff6a80b31b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.774+0000 7ff6acc00640 1 -- 172.21.15.55:0/195464308 >> 172.21.15.55:0/195464308 conn(0x7ff6a8066080 msgr2=0x7ff6a8069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:23.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.774+0000 7ff6acc00640 1 -- 172.21.15.55:0/195464308 shutdown_connections 2024-04-02T07:30:23.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.774+0000 7ff6acc00640 1 -- 172.21.15.55:0/195464308 wait complete. 2024-04-02T07:30:23.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff6acc00640 1 Processor -- start 2024-04-02T07:30:23.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff6acc00640 1 -- start start 2024-04-02T07:30:23.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff6acc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a80b36f0 0x7ff6a8152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff6acc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a80c4120 0x7ff6a81520e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff6acc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6a8153ea0 0x7ff6a813ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff6acc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80ce1b0 con 0x7ff6a80c4120 2024-04-02T07:30:23.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff6acc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a8153120 con 0x7ff6a80b36f0 2024-04-02T07:30:23.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff6acc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6a80c3e20 con 0x7ff6a8153ea0 2024-04-02T07:30:23.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff6a5400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a80c4120 0x7ff6a81520e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff6a5400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a80c4120 0x7ff6a81520e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52266/0 (socket says 172.21.15.55:52266) 2024-04-02T07:30:23.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff6a5400640 1 -- 172.21.15.55:0/3534634820 learned_addr learned my addr 172.21.15.55:0/3534634820 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:23.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff6a5400640 1 -- 172.21.15.55:0/3534634820 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6a8153ea0 msgr2=0x7ff6a813ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:23.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff6a5400640 1 --2- 172.21.15.55:0/3534634820 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6a8153ea0 0x7ff6a813ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff6a5400640 1 -- 172.21.15.55:0/3534634820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a80b36f0 msgr2=0x7ff6a8152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:23.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff6a5400640 1 --2- 172.21.15.55:0/3534634820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a80b36f0 0x7ff6a8152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff6a5400640 1 -- 172.21.15.55:0/3534634820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff694009420 con 0x7ff6a80c4120 2024-04-02T07:30:23.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff6a5400640 1 --2- 172.21.15.55:0/3534634820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a80c4120 0x7ff6a81520e0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7ff6940af040 tx=0x7ff694019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:23.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff69e000640 1 -- 172.21.15.55:0/3534634820 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff694006e20 con 0x7ff6a80c4120 2024-04-02T07:30:23.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff69e000640 1 -- 172.21.15.55:0/3534634820 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6940b5640 con 0x7ff6a80c4120 2024-04-02T07:30:23.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff6acc00640 1 -- 172.21.15.55:0/3534634820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6a80cc370 con 0x7ff6a80c4120 2024-04-02T07:30:23.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff69e000640 1 -- 172.21.15.55:0/3534634820 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6940b5810 con 0x7ff6a80c4120 2024-04-02T07:30:23.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff6acc00640 1 -- 172.21.15.55:0/3534634820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6a8152900 con 0x7ff6a80c4120 2024-04-02T07:30:23.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.778+0000 7ff6acc00640 1 -- 172.21.15.55:0/3534634820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6a80cc140 con 0x7ff6a80c4120 2024-04-02T07:30:23.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.782+0000 7ff69e000640 1 -- 172.21.15.55:0/3534634820 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff6940b3040 con 0x7ff6a80c4120 2024-04-02T07:30:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.782+0000 7ff69e000640 1 --2- 172.21.15.55:0/3534634820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff688066690 0x7ff688068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:23.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.782+0000 7ff69e000640 1 -- 172.21.15.55:0/3534634820 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7ff69411dec0 con 0x7ff6a80c4120 2024-04-02T07:30:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.782+0000 7ff6a5e00640 1 --2- 172.21.15.55:0/3534634820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff688066690 0x7ff688068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:23.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.782+0000 7ff6a5e00640 1 --2- 172.21.15.55:0/3534634820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff688066690 0x7ff688068b50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff698007fd0 tx=0x7ff698007960 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:23.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.786+0000 7ff69e000640 1 -- 172.21.15.55:0/3534634820 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff6a80cc140 con 0x7ff6a80c4120 2024-04-02T07:30:23.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.982+0000 7ff6acc00640 1 -- 172.21.15.55:0/3534634820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6a80cc140 con 0x7ff6a80c4120 2024-04-02T07:30:23.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.982+0000 7ff69e000640 1 -- 172.21.15.55:0/3534634820 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4741 (secure 0 0 0) 0x7ff6a80cc140 con 0x7ff6a80c4120 2024-04-02T07:30:23.984 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:30:23.984 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":67,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2209852195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2209852195},{"type":"v1","addr":"172.21.15.55:6835","nonce":2209852195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1897181831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1897181831},{"type":"v1","addr":"172.21.15.106:6835","nonce":1897181831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1894364429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1894364429},{"type":"v1","addr":"172.21.15.106:6837","nonce":1894364429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:28:53.919977+0000","modified":"2024-04-02T07:29:25.157357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7455":{"gid":7455,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":12,"addr":"172.21.15.55:6834/821922065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":821922065},{"type":"v1","addr":"172.21.15.55:6834","nonce":821922065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-02T07:30:23.984 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 67 2024-04-02T07:30:23.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.986+0000 7ff6acc00640 1 -- 172.21.15.55:0/3534634820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff688066690 msgr2=0x7ff688068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:23.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.986+0000 7ff6acc00640 1 --2- 172.21.15.55:0/3534634820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff688066690 0x7ff688068b50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff698007fd0 tx=0x7ff698007960 comp rx=0 tx=0).stop 2024-04-02T07:30:23.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.986+0000 7ff6acc00640 1 -- 172.21.15.55:0/3534634820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a80c4120 msgr2=0x7ff6a81520e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:23.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.986+0000 7ff6acc00640 1 --2- 172.21.15.55:0/3534634820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a80c4120 0x7ff6a81520e0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7ff6940af040 tx=0x7ff694019240 comp rx=0 tx=0).stop 2024-04-02T07:30:23.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.986+0000 7ff6acc00640 1 -- 172.21.15.55:0/3534634820 shutdown_connections 2024-04-02T07:30:23.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.986+0000 7ff6acc00640 1 --2- 172.21.15.55:0/3534634820 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff6a8153ea0 0x7ff6a813ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.986+0000 7ff6acc00640 1 --2- 172.21.15.55:0/3534634820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff6a80c4120 0x7ff6a81520e0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.986+0000 7ff6acc00640 1 --2- 172.21.15.55:0/3534634820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff688066690 0x7ff688068b50 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.986+0000 7ff6acc00640 1 --2- 172.21.15.55:0/3534634820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff6a80b36f0 0x7ff6a8152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:23.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.986+0000 7ff6acc00640 1 -- 172.21.15.55:0/3534634820 >> 172.21.15.55:0/3534634820 conn(0x7ff6a8066080 msgr2=0x7ff6a815af00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:23.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.986+0000 7ff6acc00640 1 -- 172.21.15.55:0/3534634820 shutdown_connections 2024-04-02T07:30:23.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:23.986+0000 7ff6acc00640 1 -- 172.21.15.55:0/3534634820 wait complete. 2024-04-02T07:30:24.011 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-02T07:30:24.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.150+0000 7f7177a00640 1 Processor -- start 2024-04-02T07:30:24.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.150+0000 7f7177a00640 1 -- start start 2024-04-02T07:30:24.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.154+0000 7f7177a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f71700b3dc0 0x7f71700ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.154+0000 7f7177a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f71700ade90 0x7f717006d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.154+0000 7f7177a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717006c630 con 0x7f71700b41a0 2024-04-02T07:30:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.154+0000 7f7177a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717006c8f0 con 0x7f71700b3dc0 2024-04-02T07:30:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.154+0000 7f7177a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717006cbd0 con 0x7f71700ade90 2024-04-02T07:30:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.154+0000 7f7175000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f71700b3dc0 0x7f71700ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.154+0000 7f7175000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f71700b3dc0 0x7f71700ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52274/0 (socket says 172.21.15.55:52274) 2024-04-02T07:30:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.154+0000 7f7175000640 1 -- 172.21.15.55:0/970041560 learned_addr learned my addr 172.21.15.55:0/970041560 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.154+0000 7f716fe00640 1 --2- 172.21.15.55:0/970041560 >> v2:172.21.15.106:3300/0 conn(0x7f71700ade90 0x7f717006d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.154+0000 7f7175000640 1 -- 172.21.15.55:0/970041560 >> v2:172.21.15.106:3300/0 conn(0x7f71700ade90 msgr2=0x7f717006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.154+0000 7f7175000640 1 --2- 172.21.15.55:0/970041560 >> v2:172.21.15.106:3300/0 conn(0x7f71700ade90 0x7f717006d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.154+0000 7f7175000640 1 -- 172.21.15.55:0/970041560 >> v1:172.21.15.55:6789/0 conn(0x7f71700b41a0 legacy=0x7f7170142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.154+0000 7f7175000640 1 -- 172.21.15.55:0/970041560 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717006ceb0 con 0x7f71700b3dc0 2024-04-02T07:30:24.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.154+0000 7f716f400640 1 -- 172.21.15.55:0/970041560 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1305391546 0 0) 0x7f717006c630 con 0x7f71700b41a0 2024-04-02T07:30:24.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.154+0000 7f7175000640 1 --2- 172.21.15.55:0/970041560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71700b3dc0 0x7f71700ca770 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f717006c820 tx=0x7f716401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6b708333a1e261f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:24.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f716f400640 1 -- 172.21.15.55:0/970041560 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71640aa670 con 0x7f71700b3dc0 2024-04-02T07:30:24.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f716f400640 1 -- 172.21.15.55:0/970041560 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71640aa7d0 con 0x7f71700b3dc0 2024-04-02T07:30:24.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f716f400640 1 -- 172.21.15.55:0/970041560 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71640aab60 con 0x7f71700b3dc0 2024-04-02T07:30:24.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f7177a00640 1 -- 172.21.15.55:0/970041560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71700b3dc0 msgr2=0x7f71700ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f7177a00640 1 --2- 172.21.15.55:0/970041560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71700b3dc0 0x7f71700ca770 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f717006c820 tx=0x7f716401c4f0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f7177a00640 1 -- 172.21.15.55:0/970041560 shutdown_connections 2024-04-02T07:30:24.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f7177a00640 1 --2- 172.21.15.55:0/970041560 >> v2:172.21.15.106:3300/0 conn(0x7f71700ade90 0x7f717006d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f7177a00640 1 --2- 172.21.15.55:0/970041560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71700b3dc0 0x7f71700ca770 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f7177a00640 1 -- 172.21.15.55:0/970041560 >> 172.21.15.55:0/970041560 conn(0x7f717006a390 msgr2=0x7f71700b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:24.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f7177a00640 1 -- 172.21.15.55:0/970041560 shutdown_connections 2024-04-02T07:30:24.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f7177a00640 1 -- 172.21.15.55:0/970041560 wait complete. 2024-04-02T07:30:24.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f7177a00640 1 Processor -- start 2024-04-02T07:30:24.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f7177a00640 1 -- start start 2024-04-02T07:30:24.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f7177a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71700ade90 0x7f717015c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f7177a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71700b3dc0 0x7f7170138db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f7177a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71700b41a0 0x7f717015a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f7177a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71701f5c50 con 0x7f71700b3dc0 2024-04-02T07:30:24.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f7177a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717014f4e0 con 0x7f71700b41a0 2024-04-02T07:30:24.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f7177a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717015ac40 con 0x7f71700ade90 2024-04-02T07:30:24.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f716fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71700b3dc0 0x7f7170138db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f716fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71700b3dc0 0x7f7170138db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52288/0 (socket says 172.21.15.55:52288) 2024-04-02T07:30:24.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f716fe00640 1 -- 172.21.15.55:0/1949696430 learned_addr learned my addr 172.21.15.55:0/1949696430 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:24.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f7175000640 1 --2- 172.21.15.55:0/1949696430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71700ade90 0x7f717015c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.158+0000 7f7175a00640 1 --2- 172.21.15.55:0/1949696430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71700b41a0 0x7f717015a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.162+0000 7f716fe00640 1 -- 172.21.15.55:0/1949696430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71700ade90 msgr2=0x7f717015c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.162+0000 7f716fe00640 1 --2- 172.21.15.55:0/1949696430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71700ade90 0x7f717015c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.162+0000 7f716fe00640 1 -- 172.21.15.55:0/1949696430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71700b41a0 msgr2=0x7f717015a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.162+0000 7f716fe00640 1 --2- 172.21.15.55:0/1949696430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71700b41a0 0x7f717015a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.162+0000 7f716fe00640 1 -- 172.21.15.55:0/1949696430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71640094d0 con 0x7f71700b3dc0 2024-04-02T07:30:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.162+0000 7f716fe00640 1 --2- 172.21.15.55:0/1949696430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71700b3dc0 0x7f7170138db0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f715c00d800 tx=0x7f715c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.162+0000 7f716cc00640 1 -- 172.21.15.55:0/1949696430 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c00b6c0 con 0x7f71700b3dc0 2024-04-02T07:30:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.162+0000 7f716cc00640 1 -- 172.21.15.55:0/1949696430 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715c00b820 con 0x7f71700b3dc0 2024-04-02T07:30:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.162+0000 7f716cc00640 1 -- 172.21.15.55:0/1949696430 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c00bb90 con 0x7f71700b3dc0 2024-04-02T07:30:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.162+0000 7f7177a00640 1 -- 172.21.15.55:0/1949696430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717006de00 con 0x7f71700b3dc0 2024-04-02T07:30:24.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.162+0000 7f7177a00640 1 -- 172.21.15.55:0/1949696430 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717014ed30 con 0x7f71700b3dc0 2024-04-02T07:30:24.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.162+0000 7f716cc00640 1 -- 172.21.15.55:0/1949696430 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f715c00bcf0 con 0x7f71700b3dc0 2024-04-02T07:30:24.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.162+0000 7f716cc00640 1 --2- 172.21.15.55:0/1949696430 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7150066690 0x7f7150068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.162+0000 7f716cc00640 1 -- 172.21.15.55:0/1949696430 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f715c084610 con 0x7f71700b3dc0 2024-04-02T07:30:24.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.162+0000 7f7175000640 1 --2- 172.21.15.55:0/1949696430 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7150066690 0x7f7150068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.162+0000 7f717aed7000 1 Processor -- start 2024-04-02T07:30:24.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f717aed7000 1 -- start start 2024-04-02T07:30:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f7175000640 1 --2- 172.21.15.55:0/1949696430 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7150066690 0x7f7150068b50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f71640ae000 tx=0x7f71640b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f717aed7000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43ea8290 0x55db43ea8670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f717aed7000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db43ea8bb0 0x55db43e5ec70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f717aed7000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55db43e5f1b0 0x55db43e5f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f717aed7000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db43d27340 con 0x55db43ea8290 2024-04-02T07:30:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f717aed7000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db43cb3cd0 con 0x55db43ea8bb0 2024-04-02T07:30:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f717aed7000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db43cb12a0 con 0x55db43e5f1b0 2024-04-02T07:30:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f7175000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43ea8290 0x55db43ea8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f7175000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43ea8290 0x55db43ea8670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52294/0 (socket says 172.21.15.55:52294) 2024-04-02T07:30:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f7175000640 1 -- 172.21.15.55:0/2198539829 learned_addr learned my addr 172.21.15.55:0/2198539829 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f7175a00640 1 --2- 172.21.15.55:0/2198539829 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55db43e5f1b0 0x55db43e5f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f716fe00640 1 --2- 172.21.15.55:0/2198539829 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db43ea8bb0 0x55db43e5ec70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f7175000640 1 -- 172.21.15.55:0/2198539829 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55db43e5f1b0 msgr2=0x55db43e5f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f7175000640 1 --2- 172.21.15.55:0/2198539829 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55db43e5f1b0 0x55db43e5f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f7175000640 1 -- 172.21.15.55:0/2198539829 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db43ea8bb0 msgr2=0x55db43e5ec70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f7175000640 1 --2- 172.21.15.55:0/2198539829 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db43ea8bb0 0x55db43e5ec70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f7175000640 1 -- 172.21.15.55:0/2198539829 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db4399f4b0 con 0x55db43ea8290 2024-04-02T07:30:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f7175000640 1 --2- 172.21.15.55:0/2198539829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43ea8290 0x55db43ea8670 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f7164000c10 tx=0x7f7164004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e5ee8c678b9280 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f7161600640 1 -- 172.21.15.55:0/2198539829 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71640bfa20 con 0x55db43ea8290 2024-04-02T07:30:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f7161600640 1 -- 172.21.15.55:0/2198539829 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71640bfb80 con 0x55db43ea8290 2024-04-02T07:30:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f7161600640 1 -- 172.21.15.55:0/2198539829 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71640bd400 con 0x55db43ea8290 2024-04-02T07:30:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f717aed7000 1 -- 172.21.15.55:0/2198539829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43ea8290 msgr2=0x55db43ea8670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f717aed7000 1 --2- 172.21.15.55:0/2198539829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43ea8290 0x55db43ea8670 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f7164000c10 tx=0x7f7164004740 comp rx=0 tx=0).stop 2024-04-02T07:30:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f717aed7000 1 -- 172.21.15.55:0/2198539829 shutdown_connections 2024-04-02T07:30:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f717aed7000 1 --2- 172.21.15.55:0/2198539829 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55db43e5f1b0 0x55db43e5f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f717aed7000 1 --2- 172.21.15.55:0/2198539829 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db43ea8bb0 0x55db43e5ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f717aed7000 1 --2- 172.21.15.55:0/2198539829 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43ea8290 0x55db43ea8670 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f717aed7000 1 -- 172.21.15.55:0/2198539829 >> 172.21.15.55:0/2198539829 conn(0x55db43e5b160 msgr2=0x55db43e5d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f717aed7000 1 -- 172.21.15.55:0/2198539829 shutdown_connections 2024-04-02T07:30:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f717aed7000 1 -- 172.21.15.55:0/2198539829 wait complete. 2024-04-02T07:30:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f717aed7000 1 -- start start 2024-04-02T07:30:24.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.166+0000 7f717aed7000 1 Processor -- start 2024-04-02T07:30:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f717aed7000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43e5f1b0 0x55db43e646e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f717aed7000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55db43ea8290 0x55db43e64c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f717aed7000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db43ea8bb0 0x55db43e69e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f717aed7000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db43cacb90 con 0x55db43e5f1b0 2024-04-02T07:30:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f717aed7000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db43c6a0a0 con 0x55db43ea8bb0 2024-04-02T07:30:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f717aed7000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db43c69d40 con 0x55db43ea8290 2024-04-02T07:30:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f717aed7000 10 client.0 _ll_register_callbacks cb 0x55db43d61c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:30:24.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f7175000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43e5f1b0 0x55db43e646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f7175000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43e5f1b0 0x55db43e646e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52304/0 (socket says 172.21.15.55:52304) 2024-04-02T07:30:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f7175000640 1 -- 172.21.15.55:0/1108269976 learned_addr learned my addr 172.21.15.55:0/1108269976 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f7175a00640 1 --2- 172.21.15.55:0/1108269976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db43ea8bb0 0x55db43e69e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f716fe00640 1 --2- 172.21.15.55:0/1108269976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55db43ea8290 0x55db43e64c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f7175000640 1 -- 172.21.15.55:0/1108269976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55db43ea8290 msgr2=0x55db43e64c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f7175000640 1 --2- 172.21.15.55:0/1108269976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55db43ea8290 0x55db43e64c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f7175000640 1 -- 172.21.15.55:0/1108269976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db43ea8bb0 msgr2=0x55db43e69e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f7175000640 1 --2- 172.21.15.55:0/1108269976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db43ea8bb0 0x55db43e69e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f7175000640 1 -- 172.21.15.55:0/1108269976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717006ceb0 con 0x55db43e5f1b0 2024-04-02T07:30:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f7175000640 1 --2- 172.21.15.55:0/1108269976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43e5f1b0 0x55db43e646e0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f7164097fe0 tx=0x7f716401ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ab7aa1df5254633 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f7156000640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:30:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f7156000640 1 -- 172.21.15.55:0/1108269976 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71640d1610 con 0x55db43e5f1b0 2024-04-02T07:30:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f7156000640 1 -- 172.21.15.55:0/1108269976 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f71640d1770 con 0x55db43e5f1b0 2024-04-02T07:30:24.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f717aed7000 1 -- 172.21.15.55:0/1108269976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55db43c7c550 con 0x55db43e5f1b0 2024-04-02T07:30:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f7156000640 1 -- 172.21.15.55:0/1108269976 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71640d1930 con 0x55db43e5f1b0 2024-04-02T07:30:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f717aed7000 10 client.7959 fetch_fsmap learned FSMap version 67 2024-04-02T07:30:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f717aed7000 1 -- 172.21.15.55:0/1108269976 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x55db43c71ba0 con 0x55db43e5f1b0 2024-04-02T07:30:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f7156000640 1 -- 172.21.15.55:0/1108269976 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55db43c7c550 con 0x55db43e5f1b0 2024-04-02T07:30:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f7156000640 1 -- 172.21.15.55:0/1108269976 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 67) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f71640a8050 con 0x55db43e5f1b0 2024-04-02T07:30:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f717aed7000 10 client.7959 fetch_fsmap finished waiting for FSMap version 67 2024-04-02T07:30:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f717aed7000 10 client.7959 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:30:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f717aed7000 20 client.7959 populate_metadata read hostname 'smithi055' 2024-04-02T07:30:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f717aed7000 1 --2- 172.21.15.55:0/1108269976 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55db43eb7320 0x55db43eb9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f717aed7000 4 client.7959 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:30:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f717aed7000 1 -- 172.21.15.55:0/1108269976 --> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55db43ca9970 con 0x55db43eb7320 2024-04-02T07:30:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f716fe00640 1 --2- 172.21.15.55:0/1108269976 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55db43eb7320 0x55db43eb9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f716fe00640 1 --2- 172.21.15.55:0/1108269976 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55db43eb7320 0x55db43eb9710 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12d458501a96a4e server_cookie=50f7514cf61940e8 in_seq=0 out_seq=0 2024-04-02T07:30:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f7156000640 10 client.7959 ms_handle_connect on v2:172.21.15.55:6832/821922065 2024-04-02T07:30:24.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f7156000640 1 -- 172.21.15.55:0/1108269976 <== mds.0 v2:172.21.15.55:6832/821922065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55db43ca9970 con 0x55db43eb7320 2024-04-02T07:30:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f7156000640 10 client.7959 handle_command_reply: tid=0 2024-04-02T07:30:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.170+0000 7f717aed7000 1 client.7959 shutdown 2024-04-02T07:30:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.174+0000 7f717aed7000 1 -- 172.21.15.55:0/1108269976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43e5f1b0 msgr2=0x55db43e646e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.174+0000 7f717aed7000 1 --2- 172.21.15.55:0/1108269976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43e5f1b0 0x55db43e646e0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f7164097fe0 tx=0x7f716401ad30 comp rx=0 tx=0).stop 2024-04-02T07:30:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.174+0000 7f717aed7000 1 -- 172.21.15.55:0/1108269976 shutdown_connections 2024-04-02T07:30:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.174+0000 7f717aed7000 1 --2- 172.21.15.55:0/1108269976 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55db43eb7320 0x55db43eb9710 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.174+0000 7f717aed7000 1 --2- 172.21.15.55:0/1108269976 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db43ea8bb0 0x55db43e69e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.174+0000 7f7156000640 0 client.7959 ms_handle_reset on v2:172.21.15.55:6832/821922065 2024-04-02T07:30:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.174+0000 7f717aed7000 1 --2- 172.21.15.55:0/1108269976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55db43ea8290 0x55db43e64c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.174+0000 7f717aed7000 1 --2- 172.21.15.55:0/1108269976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43e5f1b0 0x55db43e646e0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.174+0000 7f717aed7000 1 -- 172.21.15.55:0/1108269976 >> 172.21.15.55:0/1108269976 conn(0x55db43e5b160 msgr2=0x55db43e5dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.174+0000 7f717aed7000 1 -- 172.21.15.55:0/1108269976 shutdown_connections 2024-04-02T07:30:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.174+0000 7f717aed7000 1 -- 172.21.15.55:0/1108269976 wait complete. 2024-04-02T07:30:24.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.174+0000 7f717aed7000 20 client.7959 trim_cache size 0 max 16384 2024-04-02T07:30:24.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f717aed7000 1 Processor -- start 2024-04-02T07:30:24.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f717aed7000 1 -- start start 2024-04-02T07:30:24.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f717aed7000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55db43e5f1b0 0x55db43e646a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f717aed7000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43ea8290 0x55db43e64be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f717aed7000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db43ea8bb0 0x55db43eb7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f717aed7000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db43969c40 con 0x55db43ea8290 2024-04-02T07:30:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f717aed7000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db43caa3a0 con 0x55db43ea8bb0 2024-04-02T07:30:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f717aed7000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db43c55520 con 0x55db43e5f1b0 2024-04-02T07:30:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f716fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43ea8290 0x55db43e64be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f716fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43ea8290 0x55db43e64be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52312/0 (socket says 172.21.15.55:52312) 2024-04-02T07:30:24.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f716fe00640 1 -- 172.21.15.55:0/3829717326 learned_addr learned my addr 172.21.15.55:0/3829717326 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f716fe00640 1 -- 172.21.15.55:0/3829717326 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55db43e5f1b0 msgr2=0x55db43e646a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f716fe00640 1 --2- 172.21.15.55:0/3829717326 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55db43e5f1b0 0x55db43e646a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f716fe00640 1 -- 172.21.15.55:0/3829717326 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db43ea8bb0 msgr2=0x55db43eb7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f716fe00640 1 --2- 172.21.15.55:0/3829717326 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db43ea8bb0 0x55db43eb7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f716fe00640 1 -- 172.21.15.55:0/3829717326 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db43c57ef0 con 0x55db43ea8290 2024-04-02T07:30:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f716fe00640 1 --2- 172.21.15.55:0/3829717326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43ea8290 0x55db43e64be0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f715c0073f0 tx=0x7f715c020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c94b1be39f0f012 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f7162000640 1 -- 172.21.15.55:0/3829717326 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c053a30 con 0x55db43ea8290 2024-04-02T07:30:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f7162000640 1 -- 172.21.15.55:0/3829717326 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715c0590b0 con 0x55db43ea8290 2024-04-02T07:30:24.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f7162000640 1 -- 172.21.15.55:0/3829717326 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715c059220 con 0x55db43ea8290 2024-04-02T07:30:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f717aed7000 1 -- 172.21.15.55:0/3829717326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43ea8290 msgr2=0x55db43e64be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f717aed7000 1 --2- 172.21.15.55:0/3829717326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43ea8290 0x55db43e64be0 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f715c0073f0 tx=0x7f715c020040 comp rx=0 tx=0).stop 2024-04-02T07:30:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f717aed7000 1 -- 172.21.15.55:0/3829717326 shutdown_connections 2024-04-02T07:30:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f717aed7000 1 --2- 172.21.15.55:0/3829717326 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db43ea8bb0 0x55db43eb7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f717aed7000 1 --2- 172.21.15.55:0/3829717326 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43ea8290 0x55db43e64be0 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f717aed7000 1 --2- 172.21.15.55:0/3829717326 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55db43e5f1b0 0x55db43e646a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f717aed7000 1 -- 172.21.15.55:0/3829717326 >> 172.21.15.55:0/3829717326 conn(0x55db43e5b160 msgr2=0x55db43ea6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f717aed7000 1 -- 172.21.15.55:0/3829717326 shutdown_connections 2024-04-02T07:30:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f717aed7000 1 -- 172.21.15.55:0/3829717326 wait complete. 2024-04-02T07:30:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f717aed7000 1 -- start start 2024-04-02T07:30:24.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.186+0000 7f717aed7000 1 Processor -- start 2024-04-02T07:30:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43e5f1b0 0x55db43eba770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55db43ea8290 0x55db43ec2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db43ea8bb0 0x55db43ec3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db43e565e0 con 0x55db43e5f1b0 2024-04-02T07:30:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db43cb0b90 con 0x55db43ea8bb0 2024-04-02T07:30:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55db43cacb90 con 0x55db43ea8290 2024-04-02T07:30:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 10 client.0 _ll_register_callbacks cb 0x55db43d4a870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:30:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f7175000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43e5f1b0 0x55db43eba770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f7175000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43e5f1b0 0x55db43eba770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52322/0 (socket says 172.21.15.55:52322) 2024-04-02T07:30:24.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f7175000640 1 -- 172.21.15.55:0/1586762466 learned_addr learned my addr 172.21.15.55:0/1586762466 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f716fe00640 1 --2- 172.21.15.55:0/1586762466 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55db43ea8290 0x55db43ec2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f7175a00640 1 --2- 172.21.15.55:0/1586762466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db43ea8bb0 0x55db43ec3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f7175000640 1 -- 172.21.15.55:0/1586762466 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55db43ea8290 msgr2=0x55db43ec2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f7175000640 1 --2- 172.21.15.55:0/1586762466 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55db43ea8290 0x55db43ec2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f7175000640 1 -- 172.21.15.55:0/1586762466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db43ea8bb0 msgr2=0x55db43ec3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f7175000640 1 --2- 172.21.15.55:0/1586762466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db43ea8bb0 0x55db43ec3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f7175000640 1 -- 172.21.15.55:0/1586762466 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717014ed30 con 0x55db43e5f1b0 2024-04-02T07:30:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f7175000640 1 --2- 172.21.15.55:0/1586762466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43e5f1b0 0x55db43eba770 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f71640c1010 tx=0x7f7164019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f0a06625a3480f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f7156000640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:30:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f7156000640 1 -- 172.21.15.55:0/1586762466 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7164004450 con 0x55db43e5f1b0 2024-04-02T07:30:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f7156000640 1 -- 172.21.15.55:0/1586762466 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f71640d1b80 con 0x55db43e5f1b0 2024-04-02T07:30:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 -- 172.21.15.55:0/1586762466 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55db43c5c620 con 0x55db43e5f1b0 2024-04-02T07:30:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f7156000640 1 -- 172.21.15.55:0/1586762466 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71640bf7e0 con 0x55db43e5f1b0 2024-04-02T07:30:24.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 10 client.7965 fetch_fsmap learned FSMap version 67 2024-04-02T07:30:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 -- 172.21.15.55:0/1586762466 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x55db439a8fc0 con 0x55db43e5f1b0 2024-04-02T07:30:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f7156000640 1 -- 172.21.15.55:0/1586762466 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55db43c5c620 con 0x55db43e5f1b0 2024-04-02T07:30:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f7156000640 1 -- 172.21.15.55:0/1586762466 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 67) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f71640d1410 con 0x55db43e5f1b0 2024-04-02T07:30:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 10 client.7965 fetch_fsmap finished waiting for FSMap version 67 2024-04-02T07:30:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 10 client.7965 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:30:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 20 client.7965 populate_metadata read hostname 'smithi055' 2024-04-02T07:30:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 --2- 172.21.15.55:0/1586762466 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55db43ec3550 0x55db43f06360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 4 client.7965 mds_command: new command op to 7455 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-02T07:30:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 -- 172.21.15.55:0/1586762466 --> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x55db43cab4e0 con 0x55db43ec3550 2024-04-02T07:30:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f716fe00640 1 --2- 172.21.15.55:0/1586762466 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55db43ec3550 0x55db43f06360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f716fe00640 1 --2- 172.21.15.55:0/1586762466 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55db43ec3550 0x55db43f06360 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aeccfeb9ed9d9042 server_cookie=dff8990a743012c3 in_seq=0 out_seq=0 2024-04-02T07:30:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f7156000640 10 client.7965 ms_handle_connect on v2:172.21.15.55:6832/821922065 2024-04-02T07:30:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f7156000640 1 -- 172.21.15.55:0/1586762466 <== mds.0 v2:172.21.15.55:6832/821922065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+144 (crc 0 0 0) 0x55db43cab4e0 con 0x55db43ec3550 2024-04-02T07:30:24.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f7156000640 10 client.7965 handle_command_reply: tid=0 2024-04-02T07:30:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 client.7965 shutdown 2024-04-02T07:30:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 -- 172.21.15.55:0/1586762466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43e5f1b0 msgr2=0x55db43eba770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 --2- 172.21.15.55:0/1586762466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43e5f1b0 0x55db43eba770 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f71640c1010 tx=0x7f7164019290 comp rx=0 tx=0).stop 2024-04-02T07:30:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 -- 172.21.15.55:0/1586762466 shutdown_connections 2024-04-02T07:30:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 --2- 172.21.15.55:0/1586762466 >> [v2:172.21.15.55:6832/821922065,v1:172.21.15.55:6834/821922065] conn(0x55db43ec3550 0x55db43f06360 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 --2- 172.21.15.55:0/1586762466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55db43ea8bb0 0x55db43ec3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 --2- 172.21.15.55:0/1586762466 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55db43ea8290 0x55db43ec2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f7156000640 0 client.7965 ms_handle_reset on v2:172.21.15.55:6832/821922065 2024-04-02T07:30:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 --2- 172.21.15.55:0/1586762466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55db43e5f1b0 0x55db43eba770 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 -- 172.21.15.55:0/1586762466 >> 172.21.15.55:0/1586762466 conn(0x55db43e5b160 msgr2=0x55db43ea6dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 -- 172.21.15.55:0/1586762466 shutdown_connections 2024-04-02T07:30:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.190+0000 7f717aed7000 1 -- 172.21.15.55:0/1586762466 wait complete. 2024-04-02T07:30:24.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.194+0000 7f717aed7000 20 client.7965 trim_cache size 0 max 16384 2024-04-02T07:30:24.198 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:30:24.198 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-02T07:30:24.198 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:30:24.198 INFO:teuthology.orchestra.run.smithi055.stdout: "damage_type": "backtrace", 2024-04-02T07:30:24.198 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 3618010860, 2024-04-02T07:30:24.198 INFO:teuthology.orchestra.run.smithi055.stdout: "ino": 1099511627777, 2024-04-02T07:30:24.198 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/testdir/hardlink" 2024-04-02T07:30:24.198 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:30:24.198 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-02T07:30:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.194+0000 7f7177a00640 1 -- 172.21.15.55:0/1949696430 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7150066690 msgr2=0x7f7150068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.194+0000 7f7177a00640 1 --2- 172.21.15.55:0/1949696430 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7150066690 0x7f7150068b50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f71640ae000 tx=0x7f71640b5040 comp rx=0 tx=0).stop 2024-04-02T07:30:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.194+0000 7f7177a00640 1 -- 172.21.15.55:0/1949696430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71700b3dc0 msgr2=0x7f7170138db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.194+0000 7f7177a00640 1 --2- 172.21.15.55:0/1949696430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71700b3dc0 0x7f7170138db0 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f715c00d800 tx=0x7f715c00dcc0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.194+0000 7f7177a00640 1 -- 172.21.15.55:0/1949696430 shutdown_connections 2024-04-02T07:30:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.194+0000 7f7177a00640 1 --2- 172.21.15.55:0/1949696430 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7150066690 0x7f7150068b50 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.194+0000 7f7177a00640 1 --2- 172.21.15.55:0/1949696430 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71700b41a0 0x7f717015a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.194+0000 7f7177a00640 1 --2- 172.21.15.55:0/1949696430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f71700b3dc0 0x7f7170138db0 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.194+0000 7f7177a00640 1 --2- 172.21.15.55:0/1949696430 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71700ade90 0x7f717015c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.194+0000 7f7177a00640 1 -- 172.21.15.55:0/1949696430 >> 172.21.15.55:0/1949696430 conn(0x7f717006a390 msgr2=0x7f7170070a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:24.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.194+0000 7f7177a00640 1 -- 172.21.15.55:0/1949696430 shutdown_connections 2024-04-02T07:30:24.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.194+0000 7f7177a00640 1 -- 172.21.15.55:0/1949696430 wait complete. 2024-04-02T07:30:24.215 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:30:24.215 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:30:24.226 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:30:24.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.414+0000 7f3672a00640 1 Processor -- start 2024-04-02T07:30:24.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.414+0000 7f3672a00640 1 -- start start 2024-04-02T07:30:24.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.414+0000 7f3672a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f366c15ff90 0x7f366c098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.414+0000 7f3672a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f366c0d0050 0x7f366c098f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.414+0000 7f3672a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366c0af460 con 0x7f366c099490 2024-04-02T07:30:24.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.414+0000 7f3672a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366c0cf0f0 con 0x7f366c0d0050 2024-04-02T07:30:24.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.414+0000 7f3672a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366c0af690 con 0x7f366c15ff90 2024-04-02T07:30:24.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.414+0000 7f3670c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f366c0d0050 0x7f366c098f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.414+0000 7f3670c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f366c0d0050 0x7f366c098f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52330/0 (socket says 172.21.15.55:52330) 2024-04-02T07:30:24.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.414+0000 7f3670c00640 1 -- 172.21.15.55:0/218657209 learned_addr learned my addr 172.21.15.55:0/218657209 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:24.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.414+0000 7f3671600640 1 --2- 172.21.15.55:0/218657209 >> v2:172.21.15.106:3300/0 conn(0x7f366c15ff90 0x7f366c098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.414+0000 7f3670c00640 1 -- 172.21.15.55:0/218657209 >> v2:172.21.15.106:3300/0 conn(0x7f366c15ff90 msgr2=0x7f366c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:24.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.414+0000 7f3670c00640 1 --2- 172.21.15.55:0/218657209 >> v2:172.21.15.106:3300/0 conn(0x7f366c15ff90 0x7f366c098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.414+0000 7f3670c00640 1 -- 172.21.15.55:0/218657209 >> v1:172.21.15.55:6789/0 conn(0x7f366c099490 legacy=0x7f366c06aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.414+0000 7f3670c00640 1 -- 172.21.15.55:0/218657209 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c0cf3b0 con 0x7f366c0d0050 2024-04-02T07:30:24.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.414+0000 7f3671600640 1 --2- 172.21.15.55:0/218657209 >> v2:172.21.15.106:3300/0 conn(0x7f366c15ff90 0x7f366c098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:30:24.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.414+0000 7f366be00640 1 -- 172.21.15.55:0/218657209 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 636994584 0 0) 0x7f366c0af460 con 0x7f366c099490 2024-04-02T07:30:24.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.418+0000 7f3670c00640 1 --2- 172.21.15.55:0/218657209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f366c0d0050 0x7f366c098f50 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f366c06ac90 tx=0x7f365801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=687380cbcc4d10b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:24.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.418+0000 7f366be00640 1 -- 172.21.15.55:0/218657209 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580ab660 con 0x7f366c0d0050 2024-04-02T07:30:24.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.418+0000 7f366be00640 1 -- 172.21.15.55:0/218657209 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36580ab7c0 con 0x7f366c0d0050 2024-04-02T07:30:24.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.418+0000 7f366be00640 1 -- 172.21.15.55:0/218657209 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580abb50 con 0x7f366c0d0050 2024-04-02T07:30:24.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.418+0000 7f3672a00640 1 -- 172.21.15.55:0/218657209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f366c0d0050 msgr2=0x7f366c098f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.418+0000 7f3672a00640 1 --2- 172.21.15.55:0/218657209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f366c0d0050 0x7f366c098f50 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f366c06ac90 tx=0x7f365801c460 comp rx=0 tx=0).stop 2024-04-02T07:30:24.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.418+0000 7f3672a00640 1 -- 172.21.15.55:0/218657209 shutdown_connections 2024-04-02T07:30:24.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.418+0000 7f3672a00640 1 --2- 172.21.15.55:0/218657209 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f366c0d0050 0x7f366c098f50 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.418+0000 7f3672a00640 1 --2- 172.21.15.55:0/218657209 >> v2:172.21.15.106:3300/0 conn(0x7f366c15ff90 0x7f366c098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.418+0000 7f3672a00640 1 -- 172.21.15.55:0/218657209 >> 172.21.15.55:0/218657209 conn(0x7f366c0b1fb0 msgr2=0x7f366c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:24.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.418+0000 7f3672a00640 1 -- 172.21.15.55:0/218657209 shutdown_connections 2024-04-02T07:30:24.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.418+0000 7f3672a00640 1 -- 172.21.15.55:0/218657209 wait complete. 2024-04-02T07:30:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.418+0000 7f3672a00640 1 Processor -- start 2024-04-02T07:30:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.418+0000 7f3672a00640 1 -- start start 2024-04-02T07:30:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3672a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f366c099490 0x7f366c15d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3672a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f366c0d0050 0x7f366c153b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3672a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f366c15ff90 0x7f366c154220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3672a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c0c43c0 con 0x7f366c0d0050 2024-04-02T07:30:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3672a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c154050 con 0x7f366c099490 2024-04-02T07:30:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3672a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c15c350 con 0x7f366c15ff90 2024-04-02T07:30:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3670c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f366c0d0050 0x7f366c153b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3670c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f366c0d0050 0x7f366c153b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52344/0 (socket says 172.21.15.55:52344) 2024-04-02T07:30:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3670c00640 1 -- 172.21.15.55:0/2793142859 learned_addr learned my addr 172.21.15.55:0/2793142859 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3671600640 1 --2- 172.21.15.55:0/2793142859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f366c099490 0x7f366c15d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3672000640 1 --2- 172.21.15.55:0/2793142859 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f366c15ff90 0x7f366c154220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3670c00640 1 -- 172.21.15.55:0/2793142859 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f366c15ff90 msgr2=0x7f366c154220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3670c00640 1 --2- 172.21.15.55:0/2793142859 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f366c15ff90 0x7f366c154220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3670c00640 1 -- 172.21.15.55:0/2793142859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f366c099490 msgr2=0x7f366c15d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3670c00640 1 --2- 172.21.15.55:0/2793142859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f366c099490 0x7f366c15d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3670c00640 1 -- 172.21.15.55:0/2793142859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36580094d0 con 0x7f366c0d0050 2024-04-02T07:30:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3672000640 1 --2- 172.21.15.55:0/2793142859 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f366c15ff90 0x7f366c154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:30:24.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3671600640 1 --2- 172.21.15.55:0/2793142859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f366c099490 0x7f366c15d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:30:24.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3670c00640 1 --2- 172.21.15.55:0/2793142859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f366c0d0050 0x7f366c153b10 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f3658019070 tx=0x7f365801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:24.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3669600640 1 -- 172.21.15.55:0/2793142859 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580b4800 con 0x7f366c0d0050 2024-04-02T07:30:24.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3669600640 1 -- 172.21.15.55:0/2793142859 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36580b4980 con 0x7f366c0d0050 2024-04-02T07:30:24.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3669600640 1 -- 172.21.15.55:0/2793142859 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36580b4d30 con 0x7f366c0d0050 2024-04-02T07:30:24.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3672a00640 1 -- 172.21.15.55:0/2793142859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366c15bd90 con 0x7f366c0d0050 2024-04-02T07:30:24.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3672a00640 1 -- 172.21.15.55:0/2793142859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366c0c4050 con 0x7f366c0d0050 2024-04-02T07:30:24.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3672a00640 1 -- 172.21.15.55:0/2793142859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366c0c4570 con 0x7f366c0d0050 2024-04-02T07:30:24.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.422+0000 7f3669600640 1 -- 172.21.15.55:0/2793142859 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f36580a9070 con 0x7f366c0d0050 2024-04-02T07:30:24.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.426+0000 7f3669600640 1 --2- 172.21.15.55:0/2793142859 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f364c066690 0x7f364c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.426+0000 7f3669600640 1 -- 172.21.15.55:0/2793142859 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f365811ebd0 con 0x7f366c0d0050 2024-04-02T07:30:24.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.426+0000 7f3671600640 1 --2- 172.21.15.55:0/2793142859 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f364c066690 0x7f364c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.426+0000 7f3671600640 1 --2- 172.21.15.55:0/2793142859 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f364c066690 0x7f364c068b50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3660009970 tx=0x7f3660008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:24.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.430+0000 7f3669600640 1 -- 172.21.15.55:0/2793142859 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f366c0c4570 con 0x7f366c0d0050 2024-04-02T07:30:24.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.590+0000 7f3672a00640 1 -- 172.21.15.55:0/2793142859 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f366c073fa0 con 0x7f366c0d0050 2024-04-02T07:30:24.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.590+0000 7f3669600640 1 -- 172.21.15.55:0/2793142859 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16272 (secure 0 0 0) 0x7f36580ec000 con 0x7f366c0d0050 2024-04-02T07:30:24.593 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:30:24.593 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":90,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:29:14.039944+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:28:52.464907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-02T07:28:52.918058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.c","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.106:6837/2582023800":"2024-04-03T07:29:14.039921+0000","172.21.15.106:6836/2582023800":"2024-04-03T07:29:14.039921+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:30:24.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.594+0000 7f3672a00640 1 -- 172.21.15.55:0/2793142859 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f364c066690 msgr2=0x7f364c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.594+0000 7f3672a00640 1 --2- 172.21.15.55:0/2793142859 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f364c066690 0x7f364c068b50 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f3660009970 tx=0x7f3660008040 comp rx=0 tx=0).stop 2024-04-02T07:30:24.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.594+0000 7f3672a00640 1 -- 172.21.15.55:0/2793142859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f366c0d0050 msgr2=0x7f366c153b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.594+0000 7f3672a00640 1 --2- 172.21.15.55:0/2793142859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f366c0d0050 0x7f366c153b10 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7f3658019070 tx=0x7f365801aca0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.594+0000 7f3672a00640 1 -- 172.21.15.55:0/2793142859 shutdown_connections 2024-04-02T07:30:24.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.594+0000 7f3672a00640 1 --2- 172.21.15.55:0/2793142859 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f366c15ff90 0x7f366c154220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.594+0000 7f3672a00640 1 --2- 172.21.15.55:0/2793142859 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f366c0d0050 0x7f366c153b10 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.594+0000 7f3672a00640 1 --2- 172.21.15.55:0/2793142859 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f364c066690 0x7f364c068b50 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.594+0000 7f3672a00640 1 --2- 172.21.15.55:0/2793142859 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f366c099490 0x7f366c15d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.594+0000 7f3672a00640 1 -- 172.21.15.55:0/2793142859 >> 172.21.15.55:0/2793142859 conn(0x7f366c0b1fb0 msgr2=0x7f366c15e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:24.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.594+0000 7f3672a00640 1 -- 172.21.15.55:0/2793142859 shutdown_connections 2024-04-02T07:30:24.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.594+0000 7f3672a00640 1 -- 172.21.15.55:0/2793142859 wait complete. 2024-04-02T07:30:24.615 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:28:52.464907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:28:52.918058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:30:24.616 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:30:24.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f1087c00640 1 Processor -- start 2024-04-02T07:30:24.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f1087c00640 1 -- start start 2024-04-02T07:30:24.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f1087c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f108015c920 0x7f10800b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f1087c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f10800afa70 0x7f10800ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f1087c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10800cd910 con 0x7f10800cd4c0 2024-04-02T07:30:24.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f1087c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f108006beb0 con 0x7f10800afa70 2024-04-02T07:30:24.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f1087c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f108015de30 con 0x7f108015c920 2024-04-02T07:30:24.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f1085c00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f10800cd4c0 0x7f1080160550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53588/0 (socket says 172.21.15.55:53588) 2024-04-02T07:30:24.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f1085c00640 1 -- 172.21.15.55:0/1335828576 learned_addr learned my addr 172.21.15.55:0/1335828576 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:30:24.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f1085200640 1 --2- 172.21.15.55:0/1335828576 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f108015c920 0x7f10800b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f1077e00640 1 --2- 172.21.15.55:0/1335828576 >> v2:172.21.15.106:3300/0 conn(0x7f10800afa70 0x7f10800ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f107fe00640 1 -- 172.21.15.55:0/1335828576 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965030262 0 0) 0x7f10780014a0 con 0x7f10800cd4c0 2024-04-02T07:30:24.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f107fe00640 1 -- 172.21.15.55:0/1335828576 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1064003530 con 0x7f10800cd4c0 2024-04-02T07:30:24.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f107fe00640 1 -- 172.21.15.55:0/1335828576 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4006697551 0 0) 0x7f1064003530 con 0x7f10800cd4c0 2024-04-02T07:30:24.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f107fe00640 1 -- 172.21.15.55:0/1335828576 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f108015c920 msgr2=0x7f10800b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:24.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f107fe00640 1 --2- 172.21.15.55:0/1335828576 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f108015c920 0x7f10800b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f107fe00640 1 -- 172.21.15.55:0/1335828576 >> v2:172.21.15.106:3300/0 conn(0x7f10800afa70 msgr2=0x7f10800ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:24.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f107fe00640 1 --2- 172.21.15.55:0/1335828576 >> v2:172.21.15.106:3300/0 conn(0x7f10800afa70 0x7f10800ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f107fe00640 1 -- 172.21.15.55:0/1335828576 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1080098ab0 con 0x7f10800cd4c0 2024-04-02T07:30:24.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f107fe00640 1 -- 172.21.15.55:0/1335828576 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f1078001b90 con 0x7f10800cd4c0 2024-04-02T07:30:24.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f107fe00640 1 -- 172.21.15.55:0/1335828576 >> v1:172.21.15.55:6789/0 conn(0x7f10800cd4c0 legacy=0x7f1080160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f107fe00640 1 --2- 172.21.15.55:0/1335828576 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1064003980 0x7f1064003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f107fe00640 1 --2- 172.21.15.55:0/1335828576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10640047d0 0x7f1064004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f107fe00640 1 --2- 172.21.15.55:0/1335828576 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f108015c920 0x7f1064005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f107fe00640 1 -- 172.21.15.55:0/1335828576 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108006beb0 con 0x7f10640047d0 2024-04-02T07:30:24.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f107fe00640 1 -- 172.21.15.55:0/1335828576 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f108015de30 con 0x7f1064003980 2024-04-02T07:30:24.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.758+0000 7f107fe00640 1 -- 172.21.15.55:0/1335828576 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f106400b990 con 0x7f108015c920 2024-04-02T07:30:24.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.762+0000 7f1077e00640 1 --2- 172.21.15.55:0/1335828576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10640047d0 0x7f1064004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.762+0000 7f1085200640 1 --2- 172.21.15.55:0/1335828576 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1064003980 0x7f1064003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.762+0000 7f1085c00640 1 --2- 172.21.15.55:0/1335828576 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f108015c920 0x7f1064005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.762+0000 7f1077e00640 1 -- 172.21.15.55:0/1335828576 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f108015c920 msgr2=0x7f1064005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:24.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.762+0000 7f1077e00640 1 --2- 172.21.15.55:0/1335828576 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f108015c920 0x7f1064005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.762+0000 7f1077e00640 1 -- 172.21.15.55:0/1335828576 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1064003980 msgr2=0x7f1064003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:24.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.762+0000 7f1077e00640 1 --2- 172.21.15.55:0/1335828576 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1064003980 0x7f1064003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.762+0000 7f1077e00640 1 -- 172.21.15.55:0/1335828576 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1064003530 con 0x7f10640047d0 2024-04-02T07:30:24.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.762+0000 7f1077e00640 1 --2- 172.21.15.55:0/1335828576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10640047d0 0x7f1064004c50 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f1068009ae0 tx=0x7f106801cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a6658f5e128349 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:24.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.762+0000 7f107fe00640 1 -- 172.21.15.55:0/1335828576 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10680a64c0 con 0x7f10640047d0 2024-04-02T07:30:24.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.762+0000 7f107fe00640 1 -- 172.21.15.55:0/1335828576 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10680a6620 con 0x7f10640047d0 2024-04-02T07:30:24.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.762+0000 7f107fe00640 1 -- 172.21.15.55:0/1335828576 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10680a69d0 con 0x7f10640047d0 2024-04-02T07:30:24.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.762+0000 7f1087c00640 1 -- 172.21.15.55:0/1335828576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10640047d0 msgr2=0x7f1064004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.762+0000 7f1087c00640 1 --2- 172.21.15.55:0/1335828576 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f10640047d0 0x7f1064004c50 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f1068009ae0 tx=0x7f106801cab0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1085c00640 1 -- 172.21.15.55:0/1335828576 reap_dead start 2024-04-02T07:30:24.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1087c00640 1 -- 172.21.15.55:0/1335828576 shutdown_connections 2024-04-02T07:30:24.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1087c00640 1 -- 172.21.15.55:0/1335828576 >> 172.21.15.55:0/1335828576 conn(0x7f10800d0700 msgr2=0x7f10800d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:24.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1087c00640 1 -- 172.21.15.55:0/1335828576 shutdown_connections 2024-04-02T07:30:24.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1087c00640 1 -- 172.21.15.55:0/1335828576 wait complete. 2024-04-02T07:30:24.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1087c00640 1 Processor -- start 2024-04-02T07:30:24.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1087c00640 1 -- start start 2024-04-02T07:30:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1087c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10640047d0 0x7f10800c41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1087c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10800c4af0 0x7f10800c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1087c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f108015b670 0x7f108015baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1087c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10800c5370 con 0x7f108015b670 2024-04-02T07:30:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1087c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10800c5090 con 0x7f10800c4af0 2024-04-02T07:30:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1087c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10800b3450 con 0x7f10640047d0 2024-04-02T07:30:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1085c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f108015b670 0x7f108015baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1085c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f108015b670 0x7f108015baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52358/0 (socket says 172.21.15.55:52358) 2024-04-02T07:30:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1085c00640 1 -- 172.21.15.55:0/2216590744 learned_addr learned my addr 172.21.15.55:0/2216590744 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1085200640 1 --2- 172.21.15.55:0/2216590744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10640047d0 0x7f10800c41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1077e00640 1 --2- 172.21.15.55:0/2216590744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10800c4af0 0x7f10800c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1085c00640 1 -- 172.21.15.55:0/2216590744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10640047d0 msgr2=0x7f10800c41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1085c00640 1 --2- 172.21.15.55:0/2216590744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10640047d0 0x7f10800c41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1085c00640 1 -- 172.21.15.55:0/2216590744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10800c4af0 msgr2=0x7f10800c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1085c00640 1 --2- 172.21.15.55:0/2216590744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10800c4af0 0x7f10800c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1085c00640 1 -- 172.21.15.55:0/2216590744 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10800b3730 con 0x7f108015b670 2024-04-02T07:30:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1085200640 1 --2- 172.21.15.55:0/2216590744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10640047d0 0x7f10800c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:30:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1077e00640 1 --2- 172.21.15.55:0/2216590744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10800c4af0 0x7f10800c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:30:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.766+0000 7f1085c00640 1 --2- 172.21.15.55:0/2216590744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f108015b670 0x7f108015baf0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f10800b3230 tx=0x7f1078010910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.770+0000 7f107d600640 1 -- 172.21.15.55:0/2216590744 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1078007070 con 0x7f108015b670 2024-04-02T07:30:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.770+0000 7f107d600640 1 -- 172.21.15.55:0/2216590744 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f107800d070 con 0x7f108015b670 2024-04-02T07:30:24.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.770+0000 7f107d600640 1 -- 172.21.15.55:0/2216590744 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1078007410 con 0x7f108015b670 2024-04-02T07:30:24.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.770+0000 7f1087c00640 1 -- 172.21.15.55:0/2216590744 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10800b3a10 con 0x7f108015b670 2024-04-02T07:30:24.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.770+0000 7f1087c00640 1 -- 172.21.15.55:0/2216590744 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f108015c030 con 0x7f108015b670 2024-04-02T07:30:24.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.770+0000 7f1087c00640 1 -- 172.21.15.55:0/2216590744 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10800b32b0 con 0x7f108015b670 2024-04-02T07:30:24.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.770+0000 7f107d600640 1 -- 172.21.15.55:0/2216590744 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1078007570 con 0x7f108015b670 2024-04-02T07:30:24.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.770+0000 7f107d600640 1 --2- 172.21.15.55:0/2216590744 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f105c066690 0x7f105c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:24.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.770+0000 7f107d600640 1 -- 172.21.15.55:0/2216590744 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f1078085f70 con 0x7f108015b670 2024-04-02T07:30:24.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.770+0000 7f1085200640 1 --2- 172.21.15.55:0/2216590744 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f105c066690 0x7f105c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:24.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.774+0000 7f1085200640 1 --2- 172.21.15.55:0/2216590744 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f105c066690 0x7f105c068b50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1070009b00 tx=0x7f1070008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:24.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.774+0000 7f107d600640 1 -- 172.21.15.55:0/2216590744 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f10800b32b0 con 0x7f108015b670 2024-04-02T07:30:24.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.938+0000 7f1087c00640 1 -- 172.21.15.55:0/2216590744 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f10800cd910 con 0x7f108015b670 2024-04-02T07:30:24.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.942+0000 7f107d600640 1 -- 172.21.15.55:0/2216590744 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f10800cd910 con 0x7f108015b670 2024-04-02T07:30:24.942 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:30:24.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.942+0000 7f1087c00640 1 -- 172.21.15.55:0/2216590744 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f105c066690 msgr2=0x7f105c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.942+0000 7f1087c00640 1 --2- 172.21.15.55:0/2216590744 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f105c066690 0x7f105c068b50 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1070009b00 tx=0x7f1070008040 comp rx=0 tx=0).stop 2024-04-02T07:30:24.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.942+0000 7f1087c00640 1 -- 172.21.15.55:0/2216590744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f108015b670 msgr2=0x7f108015baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:24.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.942+0000 7f1087c00640 1 --2- 172.21.15.55:0/2216590744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f108015b670 0x7f108015baf0 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f10800b3230 tx=0x7f1078010910 comp rx=0 tx=0).stop 2024-04-02T07:30:24.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.942+0000 7f1087c00640 1 -- 172.21.15.55:0/2216590744 shutdown_connections 2024-04-02T07:30:24.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.942+0000 7f1087c00640 1 --2- 172.21.15.55:0/2216590744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f108015b670 0x7f108015baf0 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.942+0000 7f1087c00640 1 --2- 172.21.15.55:0/2216590744 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f105c066690 0x7f105c068b50 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.942+0000 7f1087c00640 1 --2- 172.21.15.55:0/2216590744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f10800c4af0 0x7f10800c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.942+0000 7f1087c00640 1 --2- 172.21.15.55:0/2216590744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10640047d0 0x7f10800c41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:24.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.942+0000 7f1087c00640 1 -- 172.21.15.55:0/2216590744 >> 172.21.15.55:0/2216590744 conn(0x7f10800d0700 msgr2=0x7f108006e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:24.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.942+0000 7f1087c00640 1 -- 172.21.15.55:0/2216590744 shutdown_connections 2024-04-02T07:30:24.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:24.942+0000 7f1087c00640 1 -- 172.21.15.55:0/2216590744 wait complete. 2024-04-02T07:30:24.963 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:30:25.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.106+0000 7f5226400640 1 Processor -- start 2024-04-02T07:30:25.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.106+0000 7f5226400640 1 -- start start 2024-04-02T07:30:25.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.106+0000 7f5226400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5220069d90 0x7f52200b03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:25.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.106+0000 7f5226400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f522006a220 0x7f52200b0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:25.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.106+0000 7f5226400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52200cb180 con 0x7f52201583d0 2024-04-02T07:30:25.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.106+0000 7f5226400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52201587b0 con 0x7f5220069d90 2024-04-02T07:30:25.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.106+0000 7f5226400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f522006a6c0 con 0x7f522006a220 2024-04-02T07:30:25.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.106+0000 7f5217e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5220069d90 0x7f52200b03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:25.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.106+0000 7f5217e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5220069d90 0x7f52200b03c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52370/0 (socket says 172.21.15.55:52370) 2024-04-02T07:30:25.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.106+0000 7f5217e00640 1 -- 172.21.15.55:0/2352705247 learned_addr learned my addr 172.21.15.55:0/2352705247 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:25.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.106+0000 7f521fe00640 1 --2- 172.21.15.55:0/2352705247 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f522006a220 0x7f52200b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:25.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.106+0000 7f5217e00640 1 -- 172.21.15.55:0/2352705247 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f522006a220 msgr2=0x7f52200b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:25.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.106+0000 7f5217e00640 1 --2- 172.21.15.55:0/2352705247 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f522006a220 0x7f52200b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.106+0000 7f5217e00640 1 -- 172.21.15.55:0/2352705247 >> v1:172.21.15.106:6789/0 conn(0x7f52201583d0 legacy=0x7f522015ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:25.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.106+0000 7f5217e00640 1 -- 172.21.15.55:0/2352705247 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52200cb400 con 0x7f5220069d90 2024-04-02T07:30:25.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.110+0000 7f5217e00640 1 --2- 172.21.15.55:0/2352705247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5220069d90 0x7f52200b03c0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f5208009870 tx=0x7f520801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823c1b6267656175 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:25.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.110+0000 7f521ea00640 1 -- 172.21.15.55:0/2352705247 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52080ab600 con 0x7f5220069d90 2024-04-02T07:30:25.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.110+0000 7f521ea00640 1 -- 172.21.15.55:0/2352705247 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52080a7050 con 0x7f5220069d90 2024-04-02T07:30:25.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.110+0000 7f521ea00640 1 -- 172.21.15.55:0/2352705247 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52080ab980 con 0x7f5220069d90 2024-04-02T07:30:25.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.110+0000 7f5226400640 1 -- 172.21.15.55:0/2352705247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5220069d90 msgr2=0x7f52200b03c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:25.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.110+0000 7f5226400640 1 --2- 172.21.15.55:0/2352705247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5220069d90 0x7f52200b03c0 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f5208009870 tx=0x7f520801c520 comp rx=0 tx=0).stop 2024-04-02T07:30:25.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.110+0000 7f5226400640 1 -- 172.21.15.55:0/2352705247 shutdown_connections 2024-04-02T07:30:25.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.110+0000 7f5226400640 1 --2- 172.21.15.55:0/2352705247 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f522006a220 0x7f52200b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.110+0000 7f5226400640 1 --2- 172.21.15.55:0/2352705247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5220069d90 0x7f52200b03c0 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.110+0000 7f5226400640 1 -- 172.21.15.55:0/2352705247 >> 172.21.15.55:0/2352705247 conn(0x7f52200cf550 msgr2=0x7f52200cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:25.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.110+0000 7f5226400640 1 -- 172.21.15.55:0/2352705247 shutdown_connections 2024-04-02T07:30:25.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.110+0000 7f5226400640 1 -- 172.21.15.55:0/2352705247 wait complete. 2024-04-02T07:30:25.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f5226400640 1 Processor -- start 2024-04-02T07:30:25.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f5226400640 1 -- start start 2024-04-02T07:30:25.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f5226400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5220069d90 0x7f5220152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:25.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f5226400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f522006a220 0x7f5220151a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:25.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f5226400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52201583d0 0x7f522015e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:25.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f5226400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52200cde70 con 0x7f52201583d0 2024-04-02T07:30:25.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f5226400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52200ce150 con 0x7f522006a220 2024-04-02T07:30:25.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f5226400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52200ce430 con 0x7f5220069d90 2024-04-02T07:30:25.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f521fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52201583d0 0x7f522015e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:25.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f521fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52201583d0 0x7f522015e420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52374/0 (socket says 172.21.15.55:52374) 2024-04-02T07:30:25.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f521fe00640 1 -- 172.21.15.55:0/3555692400 learned_addr learned my addr 172.21.15.55:0/3555692400 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:25.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f521f400640 1 --2- 172.21.15.55:0/3555692400 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5220069d90 0x7f5220152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:25.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f5217e00640 1 --2- 172.21.15.55:0/3555692400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f522006a220 0x7f5220151a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:25.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f521fe00640 1 -- 172.21.15.55:0/3555692400 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5220069d90 msgr2=0x7f5220152ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:25.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f521fe00640 1 --2- 172.21.15.55:0/3555692400 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5220069d90 0x7f5220152ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f521fe00640 1 -- 172.21.15.55:0/3555692400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f522006a220 msgr2=0x7f5220151a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:25.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f521fe00640 1 --2- 172.21.15.55:0/3555692400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f522006a220 0x7f5220151a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f521fe00640 1 -- 172.21.15.55:0/3555692400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52080094d0 con 0x7f52201583d0 2024-04-02T07:30:25.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f521fe00640 1 --2- 172.21.15.55:0/3555692400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52201583d0 0x7f522015e420 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f5218007e40 tx=0x7f521800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:25.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f5217400640 1 -- 172.21.15.55:0/3555692400 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5218014620 con 0x7f52201583d0 2024-04-02T07:30:25.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f5217400640 1 -- 172.21.15.55:0/3555692400 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f521800ee90 con 0x7f52201583d0 2024-04-02T07:30:25.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f5226400640 1 -- 172.21.15.55:0/3555692400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52200ce710 con 0x7f52201583d0 2024-04-02T07:30:25.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f5217400640 1 -- 172.21.15.55:0/3555692400 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52180149e0 con 0x7f52201583d0 2024-04-02T07:30:25.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.114+0000 7f5226400640 1 -- 172.21.15.55:0/3555692400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52200ce9f0 con 0x7f52201583d0 2024-04-02T07:30:25.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.118+0000 7f5226400640 1 -- 172.21.15.55:0/3555692400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5220066c90 con 0x7f52201583d0 2024-04-02T07:30:25.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.118+0000 7f5217400640 1 -- 172.21.15.55:0/3555692400 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5218014b40 con 0x7f52201583d0 2024-04-02T07:30:25.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.118+0000 7f5217400640 1 --2- 172.21.15.55:0/3555692400 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51fc066690 0x7f51fc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:25.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.118+0000 7f5217400640 1 -- 172.21.15.55:0/3555692400 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f5218084a50 con 0x7f52201583d0 2024-04-02T07:30:25.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.118+0000 7f521f400640 1 --2- 172.21.15.55:0/3555692400 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51fc066690 0x7f51fc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:25.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.118+0000 7f521f400640 1 --2- 172.21.15.55:0/3555692400 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51fc066690 0x7f51fc068b50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f52100098e0 tx=0x7f5210009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:25.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.122+0000 7f5217400640 1 -- 172.21.15.55:0/3555692400 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5218051e10 con 0x7f52201583d0 2024-04-02T07:30:25.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.286+0000 7f5226400640 1 -- 172.21.15.55:0/3555692400 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5220071e50 con 0x7f52201583d0 2024-04-02T07:30:25.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.286+0000 7f5217400640 1 -- 172.21.15.55:0/3555692400 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5218055430 con 0x7f52201583d0 2024-04-02T07:30:25.287 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:30:25.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.286+0000 7f5226400640 1 -- 172.21.15.55:0/3555692400 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51fc066690 msgr2=0x7f51fc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:25.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.286+0000 7f5226400640 1 --2- 172.21.15.55:0/3555692400 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51fc066690 0x7f51fc068b50 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f52100098e0 tx=0x7f5210009060 comp rx=0 tx=0).stop 2024-04-02T07:30:25.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.286+0000 7f5226400640 1 -- 172.21.15.55:0/3555692400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52201583d0 msgr2=0x7f522015e420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:25.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.286+0000 7f5226400640 1 --2- 172.21.15.55:0/3555692400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52201583d0 0x7f522015e420 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f5218007e40 tx=0x7f521800e4b0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.286+0000 7f5226400640 1 -- 172.21.15.55:0/3555692400 shutdown_connections 2024-04-02T07:30:25.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.286+0000 7f5226400640 1 --2- 172.21.15.55:0/3555692400 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f52201583d0 0x7f522015e420 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.286+0000 7f5226400640 1 --2- 172.21.15.55:0/3555692400 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51fc066690 0x7f51fc068b50 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.286+0000 7f5226400640 1 --2- 172.21.15.55:0/3555692400 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f522006a220 0x7f5220151a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.286+0000 7f5226400640 1 --2- 172.21.15.55:0/3555692400 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5220069d90 0x7f5220152ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.286+0000 7f5226400640 1 -- 172.21.15.55:0/3555692400 >> 172.21.15.55:0/3555692400 conn(0x7f52200cf550 msgr2=0x7f522006eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:25.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.286+0000 7f5226400640 1 -- 172.21.15.55:0/3555692400 shutdown_connections 2024-04-02T07:30:25.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.286+0000 7f5226400640 1 -- 172.21.15.55:0/3555692400 wait complete. 2024-04-02T07:30:25.307 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:30:25.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.450+0000 7f5d44600640 1 Processor -- start 2024-04-02T07:30:25.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.450+0000 7f5d44600640 1 -- start start 2024-04-02T07:30:25.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.450+0000 7f5d44600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d3c15c920 0x7f5d3c0b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:25.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.450+0000 7f5d44600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d3c0afa70 0x7f5d3c0ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:25.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.450+0000 7f5d44600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d3c0cd910 con 0x7f5d3c0cd4c0 2024-04-02T07:30:25.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.450+0000 7f5d44600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d3c06beb0 con 0x7f5d3c0afa70 2024-04-02T07:30:25.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.450+0000 7f5d44600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c15de30 con 0x7f5d3c15c920 2024-04-02T07:30:25.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.450+0000 7f5d41200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d3c0afa70 0x7f5d3c0ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:25.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.450+0000 7f5d41200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d3c0afa70 0x7f5d3c0ccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52378/0 (socket says 172.21.15.55:52378) 2024-04-02T07:30:25.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.450+0000 7f5d41200640 1 -- 172.21.15.55:0/1731187627 learned_addr learned my addr 172.21.15.55:0/1731187627 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:25.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.450+0000 7f5d41c00640 1 --2- 172.21.15.55:0/1731187627 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d3c15c920 0x7f5d3c0b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:25.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.450+0000 7f5d41200640 1 -- 172.21.15.55:0/1731187627 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d3c15c920 msgr2=0x7f5d3c0b1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:25.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.450+0000 7f5d41200640 1 --2- 172.21.15.55:0/1731187627 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d3c15c920 0x7f5d3c0b1ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.450+0000 7f5d41200640 1 -- 172.21.15.55:0/1731187627 >> v1:172.21.15.106:6789/0 conn(0x7f5d3c0cd4c0 legacy=0x7f5d3c160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:25.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.450+0000 7f5d41200640 1 -- 172.21.15.55:0/1731187627 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d3c098ab0 con 0x7f5d3c0afa70 2024-04-02T07:30:25.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.454+0000 7f5d41200640 1 --2- 172.21.15.55:0/1731187627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d3c0afa70 0x7f5d3c0ccf80 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009870 tx=0x7f5d2801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5482bf5155e7f15 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:25.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.454+0000 7f5d3be00640 1 -- 172.21.15.55:0/1731187627 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d280ab650 con 0x7f5d3c0afa70 2024-04-02T07:30:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.454+0000 7f5d3be00640 1 -- 172.21.15.55:0/1731187627 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d280ab7b0 con 0x7f5d3c0afa70 2024-04-02T07:30:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.454+0000 7f5d3be00640 1 -- 172.21.15.55:0/1731187627 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d280abb40 con 0x7f5d3c0afa70 2024-04-02T07:30:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.454+0000 7f5d44600640 1 -- 172.21.15.55:0/1731187627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d3c0afa70 msgr2=0x7f5d3c0ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.454+0000 7f5d44600640 1 --2- 172.21.15.55:0/1731187627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d3c0afa70 0x7f5d3c0ccf80 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f5d28009870 tx=0x7f5d2801c530 comp rx=0 tx=0).stop 2024-04-02T07:30:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.454+0000 7f5d44600640 1 -- 172.21.15.55:0/1731187627 shutdown_connections 2024-04-02T07:30:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.454+0000 7f5d44600640 1 --2- 172.21.15.55:0/1731187627 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d3c0afa70 0x7f5d3c0ccf80 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.454+0000 7f5d44600640 1 --2- 172.21.15.55:0/1731187627 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d3c15c920 0x7f5d3c0b1ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.454+0000 7f5d44600640 1 -- 172.21.15.55:0/1731187627 >> 172.21.15.55:0/1731187627 conn(0x7f5d3c0d0700 msgr2=0x7f5d3c0d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.454+0000 7f5d44600640 1 -- 172.21.15.55:0/1731187627 shutdown_connections 2024-04-02T07:30:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.454+0000 7f5d44600640 1 -- 172.21.15.55:0/1731187627 wait complete. 2024-04-02T07:30:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d44600640 1 Processor -- start 2024-04-02T07:30:25.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d44600640 1 -- start start 2024-04-02T07:30:25.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d44600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d3c0afa70 0x7f5d3c0cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:25.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d44600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d3c0cd4c0 0x7f5d3c0b1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:25.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d44600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d3c15c920 0x7f5d3c154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:25.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d44600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c0cc9f0 con 0x7f5d3c15c920 2024-04-02T07:30:25.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d44600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c0cbde0 con 0x7f5d3c0afa70 2024-04-02T07:30:25.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d44600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3c0cc050 con 0x7f5d3c0cd4c0 2024-04-02T07:30:25.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d42600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d3c15c920 0x7f5d3c154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:25.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d42600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d3c15c920 0x7f5d3c154c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52384/0 (socket says 172.21.15.55:52384) 2024-04-02T07:30:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d42600640 1 -- 172.21.15.55:0/789697305 learned_addr learned my addr 172.21.15.55:0/789697305 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d41200640 1 --2- 172.21.15.55:0/789697305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d3c0cd4c0 0x7f5d3c0b1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d41c00640 1 --2- 172.21.15.55:0/789697305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d3c0afa70 0x7f5d3c0cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d42600640 1 -- 172.21.15.55:0/789697305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d3c0cd4c0 msgr2=0x7f5d3c0b1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d42600640 1 --2- 172.21.15.55:0/789697305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d3c0cd4c0 0x7f5d3c0b1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d42600640 1 -- 172.21.15.55:0/789697305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d3c0afa70 msgr2=0x7f5d3c0cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d42600640 1 --2- 172.21.15.55:0/789697305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d3c0afa70 0x7f5d3c0cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d42600640 1 -- 172.21.15.55:0/789697305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d280094d0 con 0x7f5d3c15c920 2024-04-02T07:30:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d42600640 1 --2- 172.21.15.55:0/789697305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d3c15c920 0x7f5d3c154c20 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400c7a0 tx=0x7f5d3400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d39600640 1 -- 172.21.15.55:0/789697305 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d34003b80 con 0x7f5d3c15c920 2024-04-02T07:30:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d44600640 1 -- 172.21.15.55:0/789697305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d3c0cc330 con 0x7f5d3c15c920 2024-04-02T07:30:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d39600640 1 -- 172.21.15.55:0/789697305 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d34003ce0 con 0x7f5d3c15c920 2024-04-02T07:30:25.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d39600640 1 -- 172.21.15.55:0/789697305 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d3400aa90 con 0x7f5d3c15c920 2024-04-02T07:30:25.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.458+0000 7f5d44600640 1 -- 172.21.15.55:0/789697305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d3c0b2390 con 0x7f5d3c15c920 2024-04-02T07:30:25.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.462+0000 7f5d44600640 1 -- 172.21.15.55:0/789697305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d3c0ccb30 con 0x7f5d3c15c920 2024-04-02T07:30:25.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.462+0000 7f5d39600640 1 -- 172.21.15.55:0/789697305 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5d3400abf0 con 0x7f5d3c15c920 2024-04-02T07:30:25.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.462+0000 7f5d39600640 1 --2- 172.21.15.55:0/789697305 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d1c066690 0x7f5d1c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:25.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.462+0000 7f5d39600640 1 -- 172.21.15.55:0/789697305 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f5d34083dc0 con 0x7f5d3c15c920 2024-04-02T07:30:25.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.462+0000 7f5d41c00640 1 --2- 172.21.15.55:0/789697305 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d1c066690 0x7f5d1c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:25.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.462+0000 7f5d41c00640 1 --2- 172.21.15.55:0/789697305 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d1c066690 0x7f5d1c068b50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0af460 tx=0x7f5d30009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:25.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.466+0000 7f5d39600640 1 -- 172.21.15.55:0/789697305 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5d3c0ccb30 con 0x7f5d3c15c920 2024-04-02T07:30:25.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.626+0000 7f5d44600640 1 -- 172.21.15.55:0/789697305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d3c0ccb30 con 0x7f5d3c15c920 2024-04-02T07:30:25.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.626+0000 7f5d39600640 1 -- 172.21.15.55:0/789697305 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d3c0ccb30 con 0x7f5d3c15c920 2024-04-02T07:30:25.628 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:30:25.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.630+0000 7f5d44600640 1 -- 172.21.15.55:0/789697305 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d1c066690 msgr2=0x7f5d1c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:25.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.630+0000 7f5d44600640 1 --2- 172.21.15.55:0/789697305 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d1c066690 0x7f5d1c068b50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f5d3c0af460 tx=0x7f5d30009190 comp rx=0 tx=0).stop 2024-04-02T07:30:25.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.630+0000 7f5d44600640 1 -- 172.21.15.55:0/789697305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d3c15c920 msgr2=0x7f5d3c154c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.630+0000 7f5d44600640 1 --2- 172.21.15.55:0/789697305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d3c15c920 0x7f5d3c154c20 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400c7a0 tx=0x7f5d3400cc60 comp rx=0 tx=0).stop 2024-04-02T07:30:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.630+0000 7f5d44600640 1 -- 172.21.15.55:0/789697305 shutdown_connections 2024-04-02T07:30:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.630+0000 7f5d44600640 1 --2- 172.21.15.55:0/789697305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d3c15c920 0x7f5d3c154c20 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.630+0000 7f5d44600640 1 --2- 172.21.15.55:0/789697305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d3c0cd4c0 0x7f5d3c0b1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.630+0000 7f5d44600640 1 --2- 172.21.15.55:0/789697305 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d1c066690 0x7f5d1c068b50 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.630+0000 7f5d44600640 1 --2- 172.21.15.55:0/789697305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d3c0afa70 0x7f5d3c0cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.630+0000 7f5d44600640 1 -- 172.21.15.55:0/789697305 >> 172.21.15.55:0/789697305 conn(0x7f5d3c0d0700 msgr2=0x7f5d3c0cf430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.630+0000 7f5d44600640 1 -- 172.21.15.55:0/789697305 shutdown_connections 2024-04-02T07:30:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.630+0000 7f5d44600640 1 -- 172.21.15.55:0/789697305 wait complete. 2024-04-02T07:30:25.650 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:30:25.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.790+0000 7f9d62400640 1 Processor -- start 2024-04-02T07:30:25.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.790+0000 7f9d62400640 1 -- start start 2024-04-02T07:30:25.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.790+0000 7f9d62400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9d5c098a10 0x7f9d5c098df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:25.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.790+0000 7f9d62400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d5c0ce2d0 0x7f9d5c0ce720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:25.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.790+0000 7f9d62400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d5c099330 con 0x7f9d5c099800 2024-04-02T07:30:25.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.790+0000 7f9d62400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d5c0cc690 con 0x7f9d5c098a10 2024-04-02T07:30:25.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.790+0000 7f9d62400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0cb5f0 con 0x7f9d5c0ce2d0 2024-04-02T07:30:25.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.790+0000 7f9d5be00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d5c0ce2d0 0x7f9d5c0ce720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:25.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.790+0000 7f9d5b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9d5c098a10 0x7f9d5c098df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:25.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.790+0000 7f9d5b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9d5c098a10 0x7f9d5c098df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:59160/0 (socket says 172.21.15.55:59160) 2024-04-02T07:30:25.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.790+0000 7f9d5be00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d5c0ce2d0 0x7f9d5c0ce720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:39340/0 (socket says 172.21.15.55:39340) 2024-04-02T07:30:25.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.790+0000 7f9d5b400640 1 -- 172.21.15.55:0/2782872582 learned_addr learned my addr 172.21.15.55:0/2782872582 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.790+0000 7f9d52a00640 1 --1- 172.21.15.55:0/2782872582 >> v1:172.21.15.106:6789/0 conn(0x7f9d5c099800 0x7f9d5c15b510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:49482/0 (socket says 172.21.15.55:49482) 2024-04-02T07:30:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.790+0000 7f9d5be00640 1 -- 172.21.15.55:0/2782872582 >> v2:172.21.15.106:3300/0 conn(0x7f9d5c098a10 msgr2=0x7f9d5c098df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.790+0000 7f9d5be00640 1 --2- 172.21.15.55:0/2782872582 >> v2:172.21.15.106:3300/0 conn(0x7f9d5c098a10 0x7f9d5c098df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.790+0000 7f9d5be00640 1 -- 172.21.15.55:0/2782872582 >> v1:172.21.15.106:6789/0 conn(0x7f9d5c099800 legacy=0x7f9d5c15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.790+0000 7f9d5be00640 1 -- 172.21.15.55:0/2782872582 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d5c0cb8d0 con 0x7f9d5c0ce2d0 2024-04-02T07:30:25.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.794+0000 7f9d5be00640 1 --2- 172.21.15.55:0/2782872582 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d5c0ce2d0 0x7f9d5c0ce720 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009d90 tx=0x7f9d5401c760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=153b86919911b1fd server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:25.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.794+0000 7f9d5aa00640 1 -- 172.21.15.55:0/2782872582 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d540a5820 con 0x7f9d5c0ce2d0 2024-04-02T07:30:25.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.794+0000 7f9d5aa00640 1 -- 172.21.15.55:0/2782872582 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d540a5980 con 0x7f9d5c0ce2d0 2024-04-02T07:30:25.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.794+0000 7f9d5aa00640 1 -- 172.21.15.55:0/2782872582 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d540a5d10 con 0x7f9d5c0ce2d0 2024-04-02T07:30:25.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.794+0000 7f9d62400640 1 -- 172.21.15.55:0/2782872582 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d5c0ce2d0 msgr2=0x7f9d5c0ce720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:25.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.794+0000 7f9d62400640 1 --2- 172.21.15.55:0/2782872582 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d5c0ce2d0 0x7f9d5c0ce720 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009d90 tx=0x7f9d5401c760 comp rx=0 tx=0).stop 2024-04-02T07:30:25.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.794+0000 7f9d62400640 1 -- 172.21.15.55:0/2782872582 shutdown_connections 2024-04-02T07:30:25.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.794+0000 7f9d62400640 1 --2- 172.21.15.55:0/2782872582 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d5c0ce2d0 0x7f9d5c0ce720 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.794+0000 7f9d62400640 1 --2- 172.21.15.55:0/2782872582 >> v2:172.21.15.106:3300/0 conn(0x7f9d5c098a10 0x7f9d5c098df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.794+0000 7f9d62400640 1 -- 172.21.15.55:0/2782872582 >> 172.21.15.55:0/2782872582 conn(0x7f9d5c0b21f0 msgr2=0x7f9d5c0b2600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:25.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.794+0000 7f9d62400640 1 -- 172.21.15.55:0/2782872582 shutdown_connections 2024-04-02T07:30:25.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.794+0000 7f9d62400640 1 -- 172.21.15.55:0/2782872582 wait complete. 2024-04-02T07:30:25.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d62400640 1 Processor -- start 2024-04-02T07:30:25.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d62400640 1 -- start start 2024-04-02T07:30:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d62400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d5c098a10 0x7f9d5c154f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d62400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d5c099800 0x7f9d5c15d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d62400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d5c0ce2d0 0x7f9d5c153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d62400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0b4350 con 0x7f9d5c0ce2d0 2024-04-02T07:30:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d62400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0b3740 con 0x7f9d5c098a10 2024-04-02T07:30:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d62400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d5c0b3a20 con 0x7f9d5c099800 2024-04-02T07:30:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d5be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d5c0ce2d0 0x7f9d5c153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d5be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d5c0ce2d0 0x7f9d5c153130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57328/0 (socket says 172.21.15.55:57328) 2024-04-02T07:30:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d5be00640 1 -- 172.21.15.55:0/2993121485 learned_addr learned my addr 172.21.15.55:0/2993121485 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d52a00640 1 --2- 172.21.15.55:0/2993121485 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d5c099800 0x7f9d5c15d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d5b400640 1 --2- 172.21.15.55:0/2993121485 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d5c098a10 0x7f9d5c154f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d5be00640 1 -- 172.21.15.55:0/2993121485 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d5c099800 msgr2=0x7f9d5c15d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d5be00640 1 --2- 172.21.15.55:0/2993121485 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d5c099800 0x7f9d5c15d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d5be00640 1 -- 172.21.15.55:0/2993121485 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d5c098a10 msgr2=0x7f9d5c154f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d5be00640 1 --2- 172.21.15.55:0/2993121485 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d5c098a10 0x7f9d5c154f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d5be00640 1 -- 172.21.15.55:0/2993121485 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d54009a70 con 0x7f9d5c0ce2d0 2024-04-02T07:30:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d5be00640 1 --2- 172.21.15.55:0/2993121485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d5c0ce2d0 0x7f9d5c153130 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f9d5401a390 tx=0x7f9d54019500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:25.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d53e00640 1 -- 172.21.15.55:0/2993121485 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d540ad640 con 0x7f9d5c0ce2d0 2024-04-02T07:30:25.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d53e00640 1 -- 172.21.15.55:0/2993121485 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d540ad7a0 con 0x7f9d5c0ce2d0 2024-04-02T07:30:25.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d53e00640 1 -- 172.21.15.55:0/2993121485 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d540adb30 con 0x7f9d5c0ce2d0 2024-04-02T07:30:25.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.798+0000 7f9d62400640 1 -- 172.21.15.55:0/2993121485 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d5c0b3d00 con 0x7f9d5c0ce2d0 2024-04-02T07:30:25.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.802+0000 7f9d62400640 1 -- 172.21.15.55:0/2993121485 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d5c153f00 con 0x7f9d5c0ce2d0 2024-04-02T07:30:25.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.802+0000 7f9d62400640 1 -- 172.21.15.55:0/2993121485 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d5c0b44c0 con 0x7f9d5c0ce2d0 2024-04-02T07:30:25.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.802+0000 7f9d53e00640 1 -- 172.21.15.55:0/2993121485 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f9d540b4070 con 0x7f9d5c0ce2d0 2024-04-02T07:30:25.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.802+0000 7f9d53e00640 1 --2- 172.21.15.55:0/2993121485 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9d38066690 0x7f9d38068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:25.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.802+0000 7f9d53e00640 1 -- 172.21.15.55:0/2993121485 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f9d5411f500 con 0x7f9d5c0ce2d0 2024-04-02T07:30:25.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.802+0000 7f9d5b400640 1 --2- 172.21.15.55:0/2993121485 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9d38066690 0x7f9d38068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:25.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.806+0000 7f9d5b400640 1 --2- 172.21.15.55:0/2993121485 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9d38066690 0x7f9d38068b50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009ab0 tx=0x7f9d4c009240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:25.808 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.806+0000 7f9d53e00640 1 -- 172.21.15.55:0/2993121485 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f9d540ec940 con 0x7f9d5c0ce2d0 2024-04-02T07:30:25.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.978+0000 7f9d62400640 1 -- 172.21.15.55:0/2993121485 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9d5c066c90 con 0x7f9d5c0ce2d0 2024-04-02T07:30:25.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.978+0000 7f9d53e00640 1 -- 172.21.15.55:0/2993121485 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v90) v1 ==== 80+0+124 (secure 0 0 0) 0x7f9d540eff60 con 0x7f9d5c0ce2d0 2024-04-02T07:30:25.979 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.106:6837/2582023800 2024-04-03T07:29:14.039921+0000 2024-04-02T07:30:25.979 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.106:6836/2582023800 2024-04-03T07:29:14.039921+0000 2024-04-02T07:30:25.979 INFO:teuthology.orchestra.run.smithi055.stderr:listed 2 entries 2024-04-02T07:30:25.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.978+0000 7f9d62400640 1 -- 172.21.15.55:0/2993121485 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9d38066690 msgr2=0x7f9d38068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:25.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.978+0000 7f9d62400640 1 --2- 172.21.15.55:0/2993121485 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9d38066690 0x7f9d38068b50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f9d4c009ab0 tx=0x7f9d4c009240 comp rx=0 tx=0).stop 2024-04-02T07:30:25.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.978+0000 7f9d62400640 1 -- 172.21.15.55:0/2993121485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d5c0ce2d0 msgr2=0x7f9d5c153130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:25.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.978+0000 7f9d62400640 1 --2- 172.21.15.55:0/2993121485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d5c0ce2d0 0x7f9d5c153130 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f9d5401a390 tx=0x7f9d54019500 comp rx=0 tx=0).stop 2024-04-02T07:30:25.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.978+0000 7f9d62400640 1 -- 172.21.15.55:0/2993121485 shutdown_connections 2024-04-02T07:30:25.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.978+0000 7f9d62400640 1 --2- 172.21.15.55:0/2993121485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d5c0ce2d0 0x7f9d5c153130 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.978+0000 7f9d62400640 1 --2- 172.21.15.55:0/2993121485 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9d5c099800 0x7f9d5c15d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.978+0000 7f9d62400640 1 --2- 172.21.15.55:0/2993121485 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9d38066690 0x7f9d38068b50 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.978+0000 7f9d62400640 1 --2- 172.21.15.55:0/2993121485 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9d5c098a10 0x7f9d5c154f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:25.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.978+0000 7f9d62400640 1 -- 172.21.15.55:0/2993121485 >> 172.21.15.55:0/2993121485 conn(0x7f9d5c0b21f0 msgr2=0x7f9d5c06c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:25.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.978+0000 7f9d62400640 1 -- 172.21.15.55:0/2993121485 shutdown_connections 2024-04-02T07:30:25.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:25.978+0000 7f9d62400640 1 -- 172.21.15.55:0/2993121485 wait complete. 2024-04-02T07:30:25.999 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:30:26.000 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:30:26.009 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:30:26.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.190+0000 7f3b0d600640 1 Processor -- start 2024-04-02T07:30:26.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.190+0000 7f3b0d600640 1 -- start start 2024-04-02T07:30:26.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.194+0000 7f3b0d600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3b080cfdf0 0x7f3b0806b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:26.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.194+0000 7f3b0d600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b080d01d0 con 0x7f3b08098a10 2024-04-02T07:30:26.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.194+0000 7f3b0d600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b0806c0e0 con 0x7f3b080b16e0 2024-04-02T07:30:26.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.194+0000 7f3b0d600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b080b01d0 con 0x7f3b080cfdf0 2024-04-02T07:30:26.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.194+0000 7f3b06a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3b080cfdf0 0x7f3b0806b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:26.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.194+0000 7f3b07400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3b08098a10 0x7f3b08098e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40832/0 (socket says 172.21.15.55:40832) 2024-04-02T07:30:26.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.194+0000 7f3b07400640 1 -- 172.21.15.55:0/34223156 learned_addr learned my addr 172.21.15.55:0/34223156 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:30:26.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.194+0000 7f3b06a00640 1 -- 172.21.15.55:0/34223156 >> v1:172.21.15.106:6789/0 conn(0x7f3b080b16e0 legacy=0x7f3b080b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:26.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.194+0000 7f3b06a00640 1 -- 172.21.15.55:0/34223156 >> v1:172.21.15.55:6789/0 conn(0x7f3b08098a10 legacy=0x7f3b08098e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:26.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.194+0000 7f3b06a00640 1 -- 172.21.15.55:0/34223156 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b080b04b0 con 0x7f3b080cfdf0 2024-04-02T07:30:26.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.198+0000 7f3b06a00640 1 --2- 172.21.15.55:0/34223156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b080cfdf0 0x7f3b0806b8b0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f3af80097c0 tx=0x7f3af801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6f3355956b9fb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:26.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.198+0000 7f3b06000640 1 -- 172.21.15.55:0/34223156 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af80ab610 con 0x7f3b080cfdf0 2024-04-02T07:30:26.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.198+0000 7f3b06000640 1 -- 172.21.15.55:0/34223156 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af80ab770 con 0x7f3b080cfdf0 2024-04-02T07:30:26.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.198+0000 7f3b06000640 1 -- 172.21.15.55:0/34223156 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af80abb00 con 0x7f3b080cfdf0 2024-04-02T07:30:26.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.198+0000 7f3b0d600640 1 -- 172.21.15.55:0/34223156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b080cfdf0 msgr2=0x7f3b0806b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:26.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.198+0000 7f3b0d600640 1 --2- 172.21.15.55:0/34223156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b080cfdf0 0x7f3b0806b8b0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f3af80097c0 tx=0x7f3af801c430 comp rx=0 tx=0).stop 2024-04-02T07:30:26.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.198+0000 7f3b0d600640 1 -- 172.21.15.55:0/34223156 shutdown_connections 2024-04-02T07:30:26.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.198+0000 7f3b0d600640 1 --2- 172.21.15.55:0/34223156 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b080cfdf0 0x7f3b0806b8b0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.198+0000 7f3b0d600640 1 -- 172.21.15.55:0/34223156 >> 172.21.15.55:0/34223156 conn(0x7f3b080b2210 msgr2=0x7f3b080b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:26.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.198+0000 7f3b0d600640 1 -- 172.21.15.55:0/34223156 shutdown_connections 2024-04-02T07:30:26.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.198+0000 7f3b0d600640 1 -- 172.21.15.55:0/34223156 wait complete. 2024-04-02T07:30:26.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.198+0000 7f3b0d600640 1 Processor -- start 2024-04-02T07:30:26.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.198+0000 7f3b0d600640 1 -- start start 2024-04-02T07:30:26.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3b0d600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b08098a10 0x7f3b0809a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:26.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3b0d600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b080b16e0 0x7f3b08159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:26.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3b0d600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b080cfdf0 0x7f3b080c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:26.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3b0d600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b080b4990 con 0x7f3b08098a10 2024-04-02T07:30:26.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3b0d600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b0809aaa0 con 0x7f3b080cfdf0 2024-04-02T07:30:26.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3b0d600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b080b4200 con 0x7f3b080b16e0 2024-04-02T07:30:26.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3b06a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b08098a10 0x7f3b0809a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:26.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3b06a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b08098a10 0x7f3b0809a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57348/0 (socket says 172.21.15.55:57348) 2024-04-02T07:30:26.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3b06a00640 1 -- 172.21.15.55:0/509890736 learned_addr learned my addr 172.21.15.55:0/509890736 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:26.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3b07400640 1 --2- 172.21.15.55:0/509890736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b080cfdf0 0x7f3b080c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:26.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3afe000640 1 --2- 172.21.15.55:0/509890736 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b080b16e0 0x7f3b08159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:26.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3b06a00640 1 -- 172.21.15.55:0/509890736 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b080b16e0 msgr2=0x7f3b08159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:26.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3b06a00640 1 --2- 172.21.15.55:0/509890736 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b080b16e0 0x7f3b08159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3b06a00640 1 -- 172.21.15.55:0/509890736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b080cfdf0 msgr2=0x7f3b080c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:26.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3b06a00640 1 --2- 172.21.15.55:0/509890736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b080cfdf0 0x7f3b080c99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3b06a00640 1 -- 172.21.15.55:0/509890736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3af8009420 con 0x7f3b08098a10 2024-04-02T07:30:26.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3b06a00640 1 --2- 172.21.15.55:0/509890736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b08098a10 0x7f3b0809a560 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f3af801a060 tx=0x7f3af801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:26.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3aff400640 1 -- 172.21.15.55:0/509890736 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af80bf410 con 0x7f3b08098a10 2024-04-02T07:30:26.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3aff400640 1 -- 172.21.15.55:0/509890736 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3af80bf5b0 con 0x7f3b08098a10 2024-04-02T07:30:26.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3aff400640 1 -- 172.21.15.55:0/509890736 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3af80bf960 con 0x7f3b08098a10 2024-04-02T07:30:26.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3b0d600640 1 -- 172.21.15.55:0/509890736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b080b3f20 con 0x7f3b08098a10 2024-04-02T07:30:26.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3b0d600640 1 -- 172.21.15.55:0/509890736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b080b5020 con 0x7f3b08098a10 2024-04-02T07:30:26.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3b0d600640 1 -- 172.21.15.55:0/509890736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b08066c90 con 0x7f3b08098a10 2024-04-02T07:30:26.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.202+0000 7f3aff400640 1 -- 172.21.15.55:0/509890736 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3af80bfac0 con 0x7f3b08098a10 2024-04-02T07:30:26.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.206+0000 7f3aff400640 1 --2- 172.21.15.55:0/509890736 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3ae4066690 0x7f3ae4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:26.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.206+0000 7f3aff400640 1 -- 172.21.15.55:0/509890736 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f3af811e7e0 con 0x7f3b08098a10 2024-04-02T07:30:26.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.206+0000 7f3afe000640 1 --2- 172.21.15.55:0/509890736 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3ae4066690 0x7f3ae4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:26.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.206+0000 7f3afe000640 1 --2- 172.21.15.55:0/509890736 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3ae4066690 0x7f3ae4068b50 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3b080aeca0 tx=0x7f3af00094d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:26.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.210+0000 7f3aff400640 1 -- 172.21.15.55:0/509890736 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3af80ebae0 con 0x7f3b08098a10 2024-04-02T07:30:26.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.370+0000 7f3b0d600640 1 -- 172.21.15.55:0/509890736 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b080b3020 con 0x7f3b08098a10 2024-04-02T07:30:26.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.370+0000 7f3aff400640 1 -- 172.21.15.55:0/509890736 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) v1 ==== 74+0+16272 (secure 0 0 0) 0x7f3af80ef100 con 0x7f3b08098a10 2024-04-02T07:30:26.373 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:30:26.373 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":90,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:29:14.039944+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:28:52.464907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-02T07:28:52.918058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.c","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.106:6837/2582023800":"2024-04-03T07:29:14.039921+0000","172.21.15.106:6836/2582023800":"2024-04-03T07:29:14.039921+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:30:26.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.374+0000 7f3b0d600640 1 -- 172.21.15.55:0/509890736 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3ae4066690 msgr2=0x7f3ae4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:26.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.374+0000 7f3b0d600640 1 --2- 172.21.15.55:0/509890736 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3ae4066690 0x7f3ae4068b50 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3b080aeca0 tx=0x7f3af00094d0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.374+0000 7f3b0d600640 1 -- 172.21.15.55:0/509890736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b08098a10 msgr2=0x7f3b0809a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:26.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.374+0000 7f3b0d600640 1 --2- 172.21.15.55:0/509890736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b08098a10 0x7f3b0809a560 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f3af801a060 tx=0x7f3af801ac70 comp rx=0 tx=0).stop 2024-04-02T07:30:26.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.374+0000 7f3b0d600640 1 -- 172.21.15.55:0/509890736 shutdown_connections 2024-04-02T07:30:26.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.374+0000 7f3b0d600640 1 --2- 172.21.15.55:0/509890736 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3ae4066690 0x7f3ae4068b50 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.374+0000 7f3b0d600640 1 --2- 172.21.15.55:0/509890736 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b080cfdf0 0x7f3b080c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.374+0000 7f3b0d600640 1 --2- 172.21.15.55:0/509890736 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b080b16e0 0x7f3b08159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.374+0000 7f3b0d600640 1 --2- 172.21.15.55:0/509890736 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b08098a10 0x7f3b0809a560 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.374+0000 7f3b0d600640 1 -- 172.21.15.55:0/509890736 >> 172.21.15.55:0/509890736 conn(0x7f3b080b2210 msgr2=0x7f3b080b0bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:26.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.374+0000 7f3b0d600640 1 -- 172.21.15.55:0/509890736 shutdown_connections 2024-04-02T07:30:26.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.374+0000 7f3b0d600640 1 -- 172.21.15.55:0/509890736 wait complete. 2024-04-02T07:30:26.394 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:28:52.464907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:28:52.918058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:30:26.394 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:30:26.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.538+0000 7f7cd9800640 1 Processor -- start 2024-04-02T07:30:26.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.538+0000 7f7cd9800640 1 -- start start 2024-04-02T07:30:26.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.538+0000 7f7cd9800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7cd40b1600 0x7f7cd4099750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:26.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.538+0000 7f7cd9800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7cd40cf490 0x7f7cd40cf8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:26.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.538+0000 7f7cd9800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cd406c010 con 0x7f7cd40b1020 2024-04-02T07:30:26.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.538+0000 7f7cd9800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd40cfe00 con 0x7f7cd40b1600 2024-04-02T07:30:26.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.538+0000 7f7cd9800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd40b1d50 con 0x7f7cd40cf490 2024-04-02T07:30:26.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.538+0000 7f7ccbe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7cd40b1600 0x7f7cd4099750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:26.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.538+0000 7f7ccbe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7cd40b1600 0x7f7cd4099750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57362/0 (socket says 172.21.15.55:57362) 2024-04-02T07:30:26.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.538+0000 7f7ccbe00640 1 -- 172.21.15.55:0/1211456649 learned_addr learned my addr 172.21.15.55:0/1211456649 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:26.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.538+0000 7f7cd3400640 1 --2- 172.21.15.55:0/1211456649 >> v2:172.21.15.106:3300/0 conn(0x7f7cd40cf490 0x7f7cd40cf8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:26.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.538+0000 7f7ccbe00640 1 -- 172.21.15.55:0/1211456649 >> v2:172.21.15.106:3300/0 conn(0x7f7cd40cf490 msgr2=0x7f7cd40cf8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:26.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.538+0000 7f7ccbe00640 1 --2- 172.21.15.55:0/1211456649 >> v2:172.21.15.106:3300/0 conn(0x7f7cd40cf490 0x7f7cd40cf8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.538+0000 7f7ccbe00640 1 -- 172.21.15.55:0/1211456649 >> v1:172.21.15.106:6789/0 conn(0x7f7cd40b1020 legacy=0x7f7cd40aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:26.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.538+0000 7f7ccbe00640 1 -- 172.21.15.55:0/1211456649 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd40b1400 con 0x7f7cd40b1600 2024-04-02T07:30:26.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.542+0000 7f7ccbe00640 1 --2- 172.21.15.55:0/1211456649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cd40b1600 0x7f7cd4099750 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40d0640 tx=0x7f7cbc01c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1cc316f625edaf server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:26.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.542+0000 7f7cd2000640 1 -- 172.21.15.55:0/1211456649 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc0aa5f0 con 0x7f7cd40b1600 2024-04-02T07:30:26.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.542+0000 7f7cd2000640 1 -- 172.21.15.55:0/1211456649 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cbc0aa750 con 0x7f7cd40b1600 2024-04-02T07:30:26.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.542+0000 7f7cd2000640 1 -- 172.21.15.55:0/1211456649 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc0aaae0 con 0x7f7cd40b1600 2024-04-02T07:30:26.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.542+0000 7f7cd9800640 1 -- 172.21.15.55:0/1211456649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cd40b1600 msgr2=0x7f7cd4099750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:26.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.542+0000 7f7cd9800640 1 --2- 172.21.15.55:0/1211456649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cd40b1600 0x7f7cd4099750 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40d0640 tx=0x7f7cbc01c490 comp rx=0 tx=0).stop 2024-04-02T07:30:26.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.542+0000 7f7cd9800640 1 -- 172.21.15.55:0/1211456649 shutdown_connections 2024-04-02T07:30:26.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.542+0000 7f7cd9800640 1 --2- 172.21.15.55:0/1211456649 >> v2:172.21.15.106:3300/0 conn(0x7f7cd40cf490 0x7f7cd40cf8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.542+0000 7f7cd9800640 1 --2- 172.21.15.55:0/1211456649 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cd40b1600 0x7f7cd4099750 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.542+0000 7f7cd9800640 1 -- 172.21.15.55:0/1211456649 >> 172.21.15.55:0/1211456649 conn(0x7f7cd40b21a0 msgr2=0x7f7cd40b25b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:26.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.542+0000 7f7cd9800640 1 -- 172.21.15.55:0/1211456649 shutdown_connections 2024-04-02T07:30:26.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.542+0000 7f7cd9800640 1 -- 172.21.15.55:0/1211456649 wait complete. 2024-04-02T07:30:26.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.542+0000 7f7cd9800640 1 Processor -- start 2024-04-02T07:30:26.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7cd9800640 1 -- start start 2024-04-02T07:30:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7cd9800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7cd40b1020 0x7f7cd414fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7cd9800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cd40b1600 0x7f7cd4154190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7cd9800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cd40cf490 0x7f7cd415d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7cd9800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd41592a0 con 0x7f7cd40b1600 2024-04-02T07:30:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7cd9800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd4159b40 con 0x7f7cd40cf490 2024-04-02T07:30:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7cd9800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd4153850 con 0x7f7cd40b1020 2024-04-02T07:30:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7ccbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cd40b1600 0x7f7cd4154190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7ccbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cd40b1600 0x7f7cd4154190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57378/0 (socket says 172.21.15.55:57378) 2024-04-02T07:30:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7ccbe00640 1 -- 172.21.15.55:0/1379213365 learned_addr learned my addr 172.21.15.55:0/1379213365 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7cd3400640 1 --2- 172.21.15.55:0/1379213365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cd40cf490 0x7f7cd415d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7cd2a00640 1 --2- 172.21.15.55:0/1379213365 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7cd40b1020 0x7f7cd414fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:26.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7ccbe00640 1 -- 172.21.15.55:0/1379213365 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7cd40b1020 msgr2=0x7f7cd414fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:26.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7ccbe00640 1 --2- 172.21.15.55:0/1379213365 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7cd40b1020 0x7f7cd414fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7ccbe00640 1 -- 172.21.15.55:0/1379213365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cd40cf490 msgr2=0x7f7cd415d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:26.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7ccbe00640 1 --2- 172.21.15.55:0/1379213365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cd40cf490 0x7f7cd415d910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7ccbe00640 1 -- 172.21.15.55:0/1379213365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cbc0094d0 con 0x7f7cd40b1600 2024-04-02T07:30:26.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7ccbe00640 1 --2- 172.21.15.55:0/1379213365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cd40b1600 0x7f7cd4154190 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc01c970 tx=0x7f7cbc01acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:26.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7ccaa00640 1 -- 172.21.15.55:0/1379213365 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc0b3800 con 0x7f7cd40b1600 2024-04-02T07:30:26.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7ccaa00640 1 -- 172.21.15.55:0/1379213365 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cbc0b3980 con 0x7f7cd40b1600 2024-04-02T07:30:26.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7cd9800640 1 -- 172.21.15.55:0/1379213365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd4157b60 con 0x7f7cd40b1600 2024-04-02T07:30:26.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7ccaa00640 1 -- 172.21.15.55:0/1379213365 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc0b3d30 con 0x7f7cd40b1600 2024-04-02T07:30:26.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7cd9800640 1 -- 172.21.15.55:0/1379213365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd41597d0 con 0x7f7cd40b1600 2024-04-02T07:30:26.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.546+0000 7f7cd9800640 1 -- 172.21.15.55:0/1379213365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd4066c90 con 0x7f7cd40b1600 2024-04-02T07:30:26.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.550+0000 7f7ccaa00640 1 -- 172.21.15.55:0/1379213365 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7cbc0b1410 con 0x7f7cd40b1600 2024-04-02T07:30:26.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.550+0000 7f7ccaa00640 1 --2- 172.21.15.55:0/1379213365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7cb00666c0 0x7f7cb0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:26.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.550+0000 7f7ccaa00640 1 -- 172.21.15.55:0/1379213365 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f7cbc0a7070 con 0x7f7cd40b1600 2024-04-02T07:30:26.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.550+0000 7f7cd2a00640 1 --2- 172.21.15.55:0/1379213365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7cb00666c0 0x7f7cb0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:26.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.550+0000 7f7cd2a00640 1 --2- 172.21.15.55:0/1379213365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7cb00666c0 0x7f7cb0068b80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40ca940 tx=0x7f7cc4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:26.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.554+0000 7f7ccaa00640 1 -- 172.21.15.55:0/1379213365 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7cbc0ec0f0 con 0x7f7cd40b1600 2024-04-02T07:30:26.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.714+0000 7f7cd9800640 1 -- 172.21.15.55:0/1379213365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7cd4159c80 con 0x7f7cd40b1600 2024-04-02T07:30:26.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.714+0000 7f7ccaa00640 1 -- 172.21.15.55:0/1379213365 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7cbc0ef710 con 0x7f7cd40b1600 2024-04-02T07:30:26.715 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:30:26.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.714+0000 7f7cd9800640 1 -- 172.21.15.55:0/1379213365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7cb00666c0 msgr2=0x7f7cb0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:26.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.714+0000 7f7cd9800640 1 --2- 172.21.15.55:0/1379213365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7cb00666c0 0x7f7cb0068b80 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f7cd40ca940 tx=0x7f7cc4009040 comp rx=0 tx=0).stop 2024-04-02T07:30:26.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.714+0000 7f7cd9800640 1 -- 172.21.15.55:0/1379213365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cd40b1600 msgr2=0x7f7cd4154190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:26.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.714+0000 7f7cd9800640 1 --2- 172.21.15.55:0/1379213365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cd40b1600 0x7f7cd4154190 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f7cbc01c970 tx=0x7f7cbc01acd0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.714+0000 7f7cd9800640 1 -- 172.21.15.55:0/1379213365 shutdown_connections 2024-04-02T07:30:26.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.714+0000 7f7cd9800640 1 --2- 172.21.15.55:0/1379213365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7cb00666c0 0x7f7cb0068b80 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.714+0000 7f7cd9800640 1 --2- 172.21.15.55:0/1379213365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7cd40cf490 0x7f7cd415d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.714+0000 7f7cd9800640 1 --2- 172.21.15.55:0/1379213365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cd40b1600 0x7f7cd4154190 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.714+0000 7f7cd9800640 1 --2- 172.21.15.55:0/1379213365 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7cd40b1020 0x7f7cd414fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.714+0000 7f7cd9800640 1 -- 172.21.15.55:0/1379213365 >> 172.21.15.55:0/1379213365 conn(0x7f7cd40b21a0 msgr2=0x7f7cd406fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:26.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.714+0000 7f7cd9800640 1 -- 172.21.15.55:0/1379213365 shutdown_connections 2024-04-02T07:30:26.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.714+0000 7f7cd9800640 1 -- 172.21.15.55:0/1379213365 wait complete. 2024-04-02T07:30:26.737 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:30:26.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.878+0000 7f357f000640 1 Processor -- start 2024-04-02T07:30:26.881 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.878+0000 7f357f000640 1 -- start start 2024-04-02T07:30:26.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.882+0000 7f357f000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f357815a9f0 0x7f35780cf2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:26.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.882+0000 7f357f000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35780cbd30 0x7f35780cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:26.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.882+0000 7f357f000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35780ce230 con 0x7f3578098a10 2024-04-02T07:30:26.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.882+0000 7f357f000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f357815add0 con 0x7f35780cbd30 2024-04-02T07:30:26.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.882+0000 7f357f000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35780cf810 con 0x7f357815a9f0 2024-04-02T07:30:26.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.882+0000 7f356f400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35780cbd30 0x7f35780cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:26.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.882+0000 7f356f400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35780cbd30 0x7f35780cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57382/0 (socket says 172.21.15.55:57382) 2024-04-02T07:30:26.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.882+0000 7f356f400640 1 -- 172.21.15.55:0/1613155182 learned_addr learned my addr 172.21.15.55:0/1613155182 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:26.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.882+0000 7f3577e00640 1 --2- 172.21.15.55:0/1613155182 >> v2:172.21.15.106:3300/0 conn(0x7f357815a9f0 0x7f35780cf2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:26.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.882+0000 7f356f400640 1 -- 172.21.15.55:0/1613155182 >> v2:172.21.15.106:3300/0 conn(0x7f357815a9f0 msgr2=0x7f35780cf2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:26.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.882+0000 7f356f400640 1 --2- 172.21.15.55:0/1613155182 >> v2:172.21.15.106:3300/0 conn(0x7f357815a9f0 0x7f35780cf2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.882+0000 7f356f400640 1 -- 172.21.15.55:0/1613155182 >> v1:172.21.15.106:6789/0 conn(0x7f3578098a10 legacy=0x7f35780afec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:26.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.882+0000 7f356f400640 1 -- 172.21.15.55:0/1613155182 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35780ce510 con 0x7f35780cbd30 2024-04-02T07:30:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.882+0000 7f356f400640 1 --2- 172.21.15.55:0/1613155182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35780cbd30 0x7f35780cc1c0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f3578070e60 tx=0x7f356001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b39dd05fad66080 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.882+0000 7f3577400640 1 -- 172.21.15.55:0/1613155182 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35600aa610 con 0x7f35780cbd30 2024-04-02T07:30:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.882+0000 7f3577400640 1 -- 172.21.15.55:0/1613155182 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35600a6040 con 0x7f35780cbd30 2024-04-02T07:30:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.882+0000 7f3577400640 1 -- 172.21.15.55:0/1613155182 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35600aa990 con 0x7f35780cbd30 2024-04-02T07:30:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f357f000640 1 -- 172.21.15.55:0/1613155182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35780cbd30 msgr2=0x7f35780cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f357f000640 1 --2- 172.21.15.55:0/1613155182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35780cbd30 0x7f35780cc1c0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f3578070e60 tx=0x7f356001c4b0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f357f000640 1 -- 172.21.15.55:0/1613155182 shutdown_connections 2024-04-02T07:30:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f357f000640 1 --2- 172.21.15.55:0/1613155182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35780cbd30 0x7f35780cc1c0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f357f000640 1 --2- 172.21.15.55:0/1613155182 >> v2:172.21.15.106:3300/0 conn(0x7f357815a9f0 0x7f35780cf2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f357f000640 1 -- 172.21.15.55:0/1613155182 >> 172.21.15.55:0/1613155182 conn(0x7f35780b2150 msgr2=0x7f35780b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f357f000640 1 -- 172.21.15.55:0/1613155182 shutdown_connections 2024-04-02T07:30:26.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f357f000640 1 -- 172.21.15.55:0/1613155182 wait complete. 2024-04-02T07:30:26.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f357f000640 1 Processor -- start 2024-04-02T07:30:26.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f357f000640 1 -- start start 2024-04-02T07:30:26.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f357f000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3578098a10 0x7f35780c6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:26.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f357f000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35780cbd30 0x7f35781563d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:26.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f357f000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f357815a9f0 0x7f35780c4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:26.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f357f000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35780c6f60 con 0x7f3578098a10 2024-04-02T07:30:26.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f357f000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35780b42c0 con 0x7f35780cbd30 2024-04-02T07:30:26.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f357f000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35780b45a0 con 0x7f357815a9f0 2024-04-02T07:30:26.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f3577e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3578098a10 0x7f35780c6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:26.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f3577e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3578098a10 0x7f35780c6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57388/0 (socket says 172.21.15.55:57388) 2024-04-02T07:30:26.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f3577e00640 1 -- 172.21.15.55:0/3295285365 learned_addr learned my addr 172.21.15.55:0/3295285365 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:26.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f356f400640 1 --2- 172.21.15.55:0/3295285365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35780cbd30 0x7f35781563d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f357d000640 1 --2- 172.21.15.55:0/3295285365 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f357815a9f0 0x7f35780c4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f3577e00640 1 -- 172.21.15.55:0/3295285365 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f357815a9f0 msgr2=0x7f35780c4d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f3577e00640 1 --2- 172.21.15.55:0/3295285365 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f357815a9f0 0x7f35780c4d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f3577e00640 1 -- 172.21.15.55:0/3295285365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35780cbd30 msgr2=0x7f35781563d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f3577e00640 1 --2- 172.21.15.55:0/3295285365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35780cbd30 0x7f35781563d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.886+0000 7f3577e00640 1 -- 172.21.15.55:0/3295285365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35600094d0 con 0x7f3578098a10 2024-04-02T07:30:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.890+0000 7f3577e00640 1 --2- 172.21.15.55:0/3295285365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3578098a10 0x7f35780c6980 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f356800d5f0 tx=0x7f356800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.890+0000 7f3574c00640 1 -- 172.21.15.55:0/3295285365 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35680125f0 con 0x7f3578098a10 2024-04-02T07:30:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.890+0000 7f3574c00640 1 -- 172.21.15.55:0/3295285365 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3568012750 con 0x7f3578098a10 2024-04-02T07:30:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.890+0000 7f3574c00640 1 -- 172.21.15.55:0/3295285365 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3568012ae0 con 0x7f3578098a10 2024-04-02T07:30:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.890+0000 7f357f000640 1 -- 172.21.15.55:0/3295285365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35780b4880 con 0x7f3578098a10 2024-04-02T07:30:26.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.890+0000 7f357f000640 1 -- 172.21.15.55:0/3295285365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35780c52b0 con 0x7f3578098a10 2024-04-02T07:30:26.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.890+0000 7f357f000640 1 -- 172.21.15.55:0/3295285365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35780b4ed0 con 0x7f3578098a10 2024-04-02T07:30:26.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.890+0000 7f3574c00640 1 -- 172.21.15.55:0/3295285365 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3568012c40 con 0x7f3578098a10 2024-04-02T07:30:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.890+0000 7f3574c00640 1 --2- 172.21.15.55:0/3295285365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3554066690 0x7f3554068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.890+0000 7f3574c00640 1 -- 172.21.15.55:0/3295285365 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f35680845e0 con 0x7f3578098a10 2024-04-02T07:30:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.890+0000 7f356f400640 1 --2- 172.21.15.55:0/3295285365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3554066690 0x7f3554068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:26.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.894+0000 7f356f400640 1 --2- 172.21.15.55:0/3295285365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3554066690 0x7f3554068b50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f35600ae000 tx=0x7f35600b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:26.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:26.894+0000 7f3574c00640 1 -- 172.21.15.55:0/3295285365 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3568051990 con 0x7f3578098a10 2024-04-02T07:30:27.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.054+0000 7f357f000640 1 -- 172.21.15.55:0/3295285365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f35780c54a0 con 0x7f3578098a10 2024-04-02T07:30:27.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.054+0000 7f3574c00640 1 -- 172.21.15.55:0/3295285365 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) v1 ==== 104+0+11 (secure 0 0 0) 0x7f35780c54a0 con 0x7f3578098a10 2024-04-02T07:30:27.057 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:30:27.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.058+0000 7f357f000640 1 -- 172.21.15.55:0/3295285365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3554066690 msgr2=0x7f3554068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:27.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.058+0000 7f357f000640 1 --2- 172.21.15.55:0/3295285365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3554066690 0x7f3554068b50 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f35600ae000 tx=0x7f35600b5040 comp rx=0 tx=0).stop 2024-04-02T07:30:27.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.058+0000 7f357f000640 1 -- 172.21.15.55:0/3295285365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3578098a10 msgr2=0x7f35780c6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:27.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.058+0000 7f357f000640 1 --2- 172.21.15.55:0/3295285365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3578098a10 0x7f35780c6980 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f356800d5f0 tx=0x7f356800dab0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.058+0000 7f357f000640 1 -- 172.21.15.55:0/3295285365 shutdown_connections 2024-04-02T07:30:27.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.058+0000 7f357f000640 1 --2- 172.21.15.55:0/3295285365 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f357815a9f0 0x7f35780c4d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.058+0000 7f357f000640 1 --2- 172.21.15.55:0/3295285365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3554066690 0x7f3554068b50 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.058+0000 7f357f000640 1 --2- 172.21.15.55:0/3295285365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35780cbd30 0x7f35781563d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.058+0000 7f357f000640 1 --2- 172.21.15.55:0/3295285365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3578098a10 0x7f35780c6980 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.058+0000 7f357f000640 1 -- 172.21.15.55:0/3295285365 >> 172.21.15.55:0/3295285365 conn(0x7f35780b2150 msgr2=0x7f357806ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:27.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.058+0000 7f357f000640 1 -- 172.21.15.55:0/3295285365 shutdown_connections 2024-04-02T07:30:27.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.058+0000 7f357f000640 1 -- 172.21.15.55:0/3295285365 wait complete. 2024-04-02T07:30:27.078 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:30:27.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.222+0000 7f3538c00640 1 Processor -- start 2024-04-02T07:30:27.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.222+0000 7f3538c00640 1 -- start start 2024-04-02T07:30:27.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.222+0000 7f3538c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3534153c30 0x7f353415a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:27.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.222+0000 7f3538c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f353413c9b0 con 0x7f353415d1f0 2024-04-02T07:30:27.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.222+0000 7f3538c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35340c3b70 con 0x7f35340b3850 2024-04-02T07:30:27.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.222+0000 7f3538c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353413cc50 con 0x7f3534153c30 2024-04-02T07:30:27.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.222+0000 7f352be00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f353415d1f0 0x7f35340b3140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40834/0 (socket says 172.21.15.55:40834) 2024-04-02T07:30:27.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.222+0000 7f352be00640 1 -- 172.21.15.55:0/4242649807 learned_addr learned my addr 172.21.15.55:0/4242649807 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:30:27.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.222+0000 7f3531e00640 1 --2- 172.21.15.55:0/4242649807 >> v2:172.21.15.106:3300/0 conn(0x7f3534153c30 0x7f353415a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:27.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.222+0000 7f3531400640 1 -- 172.21.15.55:0/4242649807 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2046387277 0 0) 0x7f351c001120 con 0x7f353415d1f0 2024-04-02T07:30:27.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.222+0000 7f3531400640 1 -- 172.21.15.55:0/4242649807 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3518003530 con 0x7f353415d1f0 2024-04-02T07:30:27.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.222+0000 7f3531400640 1 -- 172.21.15.55:0/4242649807 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1849523804 0 0) 0x7f35340c3b70 con 0x7f35340b3850 2024-04-02T07:30:27.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.222+0000 7f3531400640 1 -- 172.21.15.55:0/4242649807 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f351c001120 con 0x7f35340b3850 2024-04-02T07:30:27.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.222+0000 7f3531e00640 1 -- 172.21.15.55:0/4242649807 >> v1:172.21.15.106:6789/0 conn(0x7f35340b3850 legacy=0x7f35340b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:27.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.222+0000 7f3531e00640 1 -- 172.21.15.55:0/4242649807 >> v1:172.21.15.55:6789/0 conn(0x7f353415d1f0 legacy=0x7f35340b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:27.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.222+0000 7f3531400640 1 -- 172.21.15.55:0/4242649807 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2665108502 0 0) 0x7f3518003530 con 0x7f353415d1f0 2024-04-02T07:30:27.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.222+0000 7f3531e00640 1 -- 172.21.15.55:0/4242649807 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353415abc0 con 0x7f3534153c30 2024-04-02T07:30:27.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.226+0000 7f3531e00640 1 --2- 172.21.15.55:0/4242649807 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3534153c30 0x7f353415a680 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f35240097c0 tx=0x7f352401c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=959906ea0cc822a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:27.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.226+0000 7f3531400640 1 -- 172.21.15.55:0/4242649807 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35240a4ea0 con 0x7f3534153c30 2024-04-02T07:30:27.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.226+0000 7f3531400640 1 -- 172.21.15.55:0/4242649807 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35240a7050 con 0x7f3534153c30 2024-04-02T07:30:27.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.226+0000 7f3531400640 1 -- 172.21.15.55:0/4242649807 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351c001810 con 0x7f3534153c30 2024-04-02T07:30:27.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.226+0000 7f3538c00640 1 -- 172.21.15.55:0/4242649807 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3534153c30 msgr2=0x7f353415a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:27.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.226+0000 7f3538c00640 1 --2- 172.21.15.55:0/4242649807 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3534153c30 0x7f353415a680 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f35240097c0 tx=0x7f352401c390 comp rx=0 tx=0).stop 2024-04-02T07:30:27.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.226+0000 7f3538c00640 1 -- 172.21.15.55:0/4242649807 shutdown_connections 2024-04-02T07:30:27.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.226+0000 7f3538c00640 1 --2- 172.21.15.55:0/4242649807 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3534153c30 0x7f353415a680 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.226+0000 7f3538c00640 1 -- 172.21.15.55:0/4242649807 >> 172.21.15.55:0/4242649807 conn(0x7f3534066080 msgr2=0x7f3534069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:27.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.226+0000 7f3538c00640 1 -- 172.21.15.55:0/4242649807 shutdown_connections 2024-04-02T07:30:27.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.226+0000 7f3538c00640 1 -- 172.21.15.55:0/4242649807 wait complete. 2024-04-02T07:30:27.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f3538c00640 1 Processor -- start 2024-04-02T07:30:27.230 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f3538c00640 1 -- start start 2024-04-02T07:30:27.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f3538c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35340b3850 0x7f353406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:27.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f3538c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3534153c30 0x7f35341568c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:27.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f3538c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f353415d1f0 0x7f353413bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:27.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f3538c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353413b0e0 con 0x7f353415d1f0 2024-04-02T07:30:27.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f3538c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3534156430 con 0x7f35340b3850 2024-04-02T07:30:27.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f3538c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3534133ca0 con 0x7f3534153c30 2024-04-02T07:30:27.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f3532800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f353415d1f0 0x7f353413bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:27.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f3532800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f353415d1f0 0x7f353413bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57392/0 (socket says 172.21.15.55:57392) 2024-04-02T07:30:27.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f3532800640 1 -- 172.21.15.55:0/2974883017 learned_addr learned my addr 172.21.15.55:0/2974883017 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:27.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f3531e00640 1 --2- 172.21.15.55:0/2974883017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35340b3850 0x7f353406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:27.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f352be00640 1 --2- 172.21.15.55:0/2974883017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3534153c30 0x7f35341568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:27.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f3532800640 1 -- 172.21.15.55:0/2974883017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3534153c30 msgr2=0x7f35341568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:27.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f3532800640 1 --2- 172.21.15.55:0/2974883017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3534153c30 0x7f35341568c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f3532800640 1 -- 172.21.15.55:0/2974883017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35340b3850 msgr2=0x7f353406cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:27.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f3532800640 1 --2- 172.21.15.55:0/2974883017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35340b3850 0x7f353406cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f3532800640 1 -- 172.21.15.55:0/2974883017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3524009420 con 0x7f353415d1f0 2024-04-02T07:30:27.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f352be00640 1 --2- 172.21.15.55:0/2974883017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3534153c30 0x7f35341568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:30:27.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f3532800640 1 --2- 172.21.15.55:0/2974883017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f353415d1f0 0x7f353413bc20 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f352c00c790 tx=0x7f352c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:27.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f352a000640 1 -- 172.21.15.55:0/2974883017 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c00cea0 con 0x7f353415d1f0 2024-04-02T07:30:27.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f352a000640 1 -- 172.21.15.55:0/2974883017 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f352c003b80 con 0x7f353415d1f0 2024-04-02T07:30:27.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f3538c00640 1 -- 172.21.15.55:0/2974883017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353414f140 con 0x7f353415d1f0 2024-04-02T07:30:27.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f352a000640 1 -- 172.21.15.55:0/2974883017 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352c00a850 con 0x7f353415d1f0 2024-04-02T07:30:27.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.230+0000 7f3538c00640 1 -- 172.21.15.55:0/2974883017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353414ee60 con 0x7f353415d1f0 2024-04-02T07:30:27.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.234+0000 7f3538c00640 1 -- 172.21.15.55:0/2974883017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35341565e0 con 0x7f353415d1f0 2024-04-02T07:30:27.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.234+0000 7f352a000640 1 -- 172.21.15.55:0/2974883017 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f352c00a9b0 con 0x7f353415d1f0 2024-04-02T07:30:27.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.234+0000 7f352a000640 1 --2- 172.21.15.55:0/2974883017 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f35100666c0 0x7f3510068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:27.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.234+0000 7f352a000640 1 -- 172.21.15.55:0/2974883017 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f352c0840b0 con 0x7f353415d1f0 2024-04-02T07:30:27.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.234+0000 7f3531e00640 1 --2- 172.21.15.55:0/2974883017 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f35100666c0 0x7f3510068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:27.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.234+0000 7f3531e00640 1 --2- 172.21.15.55:0/2974883017 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f35100666c0 0x7f3510068b80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f35240ad000 tx=0x7f35240a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:27.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.238+0000 7f352a000640 1 -- 172.21.15.55:0/2974883017 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f35341565e0 con 0x7f353415d1f0 2024-04-02T07:30:27.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.398+0000 7f3538c00640 1 -- 172.21.15.55:0/2974883017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f35341565e0 con 0x7f353415d1f0 2024-04-02T07:30:27.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.398+0000 7f352a000640 1 -- 172.21.15.55:0/2974883017 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) v1 ==== 100+0+11 (secure 0 0 0) 0x7f35341565e0 con 0x7f353415d1f0 2024-04-02T07:30:27.401 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:30:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.402+0000 7f3538c00640 1 -- 172.21.15.55:0/2974883017 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f35100666c0 msgr2=0x7f3510068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.402+0000 7f3538c00640 1 --2- 172.21.15.55:0/2974883017 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f35100666c0 0x7f3510068b80 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f35240ad000 tx=0x7f35240a6000 comp rx=0 tx=0).stop 2024-04-02T07:30:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.402+0000 7f3538c00640 1 -- 172.21.15.55:0/2974883017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f353415d1f0 msgr2=0x7f353413bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.402+0000 7f3538c00640 1 --2- 172.21.15.55:0/2974883017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f353415d1f0 0x7f353413bc20 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f352c00c790 tx=0x7f352c00cc50 comp rx=0 tx=0).stop 2024-04-02T07:30:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.402+0000 7f3538c00640 1 -- 172.21.15.55:0/2974883017 shutdown_connections 2024-04-02T07:30:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.402+0000 7f3538c00640 1 --2- 172.21.15.55:0/2974883017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f353415d1f0 0x7f353413bc20 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.402+0000 7f3538c00640 1 --2- 172.21.15.55:0/2974883017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3534153c30 0x7f35341568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.402+0000 7f3538c00640 1 --2- 172.21.15.55:0/2974883017 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f35100666c0 0x7f3510068b80 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.402+0000 7f3538c00640 1 --2- 172.21.15.55:0/2974883017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35340b3850 0x7f353406cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.402+0000 7f3538c00640 1 -- 172.21.15.55:0/2974883017 >> 172.21.15.55:0/2974883017 conn(0x7f3534066080 msgr2=0x7f353406c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:27.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.402+0000 7f3538c00640 1 -- 172.21.15.55:0/2974883017 shutdown_connections 2024-04-02T07:30:27.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.402+0000 7f3538c00640 1 -- 172.21.15.55:0/2974883017 wait complete. 2024-04-02T07:30:27.422 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:30:27.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.562+0000 7ff722200640 1 Processor -- start 2024-04-02T07:30:27.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.562+0000 7ff722200640 1 -- start start 2024-04-02T07:30:27.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.562+0000 7ff722200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff71c1599c0 0x7ff71c0b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:27.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.562+0000 7ff722200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff71c0b38f0 0x7ff71c0c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:27.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.562+0000 7ff722200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff71c0b1d60 con 0x7ff71c06d1c0 2024-04-02T07:30:27.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.562+0000 7ff722200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff71c06cda0 con 0x7ff71c0b38f0 2024-04-02T07:30:27.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.562+0000 7ff722200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c06c400 con 0x7ff71c1599c0 2024-04-02T07:30:27.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.562+0000 7ff712a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff71c06d1c0 0x7ff71c0b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40846/0 (socket says 172.21.15.55:40846) 2024-04-02T07:30:27.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.562+0000 7ff712a00640 1 -- 172.21.15.55:0/3931707255 learned_addr learned my addr 172.21.15.55:0/3931707255 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:30:27.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.562+0000 7ff71be00640 1 --2- 172.21.15.55:0/3931707255 >> v2:172.21.15.106:3300/0 conn(0x7ff71c0b38f0 0x7ff71c0c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:27.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.562+0000 7ff71b400640 1 --2- 172.21.15.55:0/3931707255 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff71c1599c0 0x7ff71c0b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:27.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.562+0000 7ff71aa00640 1 -- 172.21.15.55:0/3931707255 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1451300964 0 0) 0x7ff71c0b1d60 con 0x7ff71c06d1c0 2024-04-02T07:30:27.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.562+0000 7ff71aa00640 1 -- 172.21.15.55:0/3931707255 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff700003530 con 0x7ff71c06d1c0 2024-04-02T07:30:27.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.562+0000 7ff71b400640 1 -- 172.21.15.55:0/3931707255 >> v2:172.21.15.106:3300/0 conn(0x7ff71c0b38f0 msgr2=0x7ff71c0c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:27.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.562+0000 7ff71b400640 1 --2- 172.21.15.55:0/3931707255 >> v2:172.21.15.106:3300/0 conn(0x7ff71c0b38f0 0x7ff71c0c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.562+0000 7ff71b400640 1 -- 172.21.15.55:0/3931707255 >> v1:172.21.15.55:6789/0 conn(0x7ff71c06d1c0 legacy=0x7ff71c0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:27.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.562+0000 7ff71b400640 1 -- 172.21.15.55:0/3931707255 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff71c06c6e0 con 0x7ff71c1599c0 2024-04-02T07:30:27.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.566+0000 7ff71b400640 1 --2- 172.21.15.55:0/3931707255 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff71c1599c0 0x7ff71c0b1780 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0097c0 tx=0x7ff70c01c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38359724abd65ca7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:27.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.566+0000 7ff71aa00640 1 -- 172.21.15.55:0/3931707255 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c0ab600 con 0x7ff71c1599c0 2024-04-02T07:30:27.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.566+0000 7ff71aa00640 1 -- 172.21.15.55:0/3931707255 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70c0a7050 con 0x7ff71c1599c0 2024-04-02T07:30:27.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.566+0000 7ff71aa00640 1 -- 172.21.15.55:0/3931707255 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70c0ab960 con 0x7ff71c1599c0 2024-04-02T07:30:27.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.566+0000 7ff722200640 1 -- 172.21.15.55:0/3931707255 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff71c1599c0 msgr2=0x7ff71c0b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:27.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.566+0000 7ff722200640 1 --2- 172.21.15.55:0/3931707255 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff71c1599c0 0x7ff71c0b1780 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0097c0 tx=0x7ff70c01c410 comp rx=0 tx=0).stop 2024-04-02T07:30:27.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.566+0000 7ff722200640 1 -- 172.21.15.55:0/3931707255 shutdown_connections 2024-04-02T07:30:27.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.566+0000 7ff722200640 1 --2- 172.21.15.55:0/3931707255 >> v2:172.21.15.106:3300/0 conn(0x7ff71c0b38f0 0x7ff71c0c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.566+0000 7ff722200640 1 --2- 172.21.15.55:0/3931707255 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff71c1599c0 0x7ff71c0b1780 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.566+0000 7ff722200640 1 -- 172.21.15.55:0/3931707255 >> 172.21.15.55:0/3931707255 conn(0x7ff71c069d90 msgr2=0x7ff71c06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:27.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.566+0000 7ff722200640 1 -- 172.21.15.55:0/3931707255 shutdown_connections 2024-04-02T07:30:27.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.566+0000 7ff722200640 1 -- 172.21.15.55:0/3931707255 wait complete. 2024-04-02T07:30:27.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff722200640 1 Processor -- start 2024-04-02T07:30:27.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff722200640 1 -- start start 2024-04-02T07:30:27.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff722200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff71c06d1c0 0x7ff71c153520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:27.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff722200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71c0b38f0 0x7ff71c1550b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:27.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff722200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff71c1599c0 0x7ff71c1555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:27.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff722200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c15c380 con 0x7ff71c0b38f0 2024-04-02T07:30:27.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff722200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c15bab0 con 0x7ff71c1599c0 2024-04-02T07:30:27.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff722200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff71c14fa80 con 0x7ff71c06d1c0 2024-04-02T07:30:27.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff712a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71c0b38f0 0x7ff71c1550b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:27.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff712a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71c0b38f0 0x7ff71c1550b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57396/0 (socket says 172.21.15.55:57396) 2024-04-02T07:30:27.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff712a00640 1 -- 172.21.15.55:0/2364679100 learned_addr learned my addr 172.21.15.55:0/2364679100 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:27.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff71b400640 1 --2- 172.21.15.55:0/2364679100 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff71c06d1c0 0x7ff71c153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:27.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff71be00640 1 --2- 172.21.15.55:0/2364679100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff71c1599c0 0x7ff71c1555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:27.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff712a00640 1 -- 172.21.15.55:0/2364679100 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff71c06d1c0 msgr2=0x7ff71c153520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:27.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff712a00640 1 --2- 172.21.15.55:0/2364679100 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff71c06d1c0 0x7ff71c153520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff712a00640 1 -- 172.21.15.55:0/2364679100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff71c1599c0 msgr2=0x7ff71c1555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:27.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff712a00640 1 --2- 172.21.15.55:0/2364679100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff71c1599c0 0x7ff71c1555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff712a00640 1 -- 172.21.15.55:0/2364679100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff70c009420 con 0x7ff71c0b38f0 2024-04-02T07:30:27.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff712a00640 1 --2- 172.21.15.55:0/2364679100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71c0b38f0 0x7ff71c1550b0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7ff70400ca70 tx=0x7ff70400cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:27.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff713e00640 1 -- 172.21.15.55:0/2364679100 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff70400abd0 con 0x7ff71c0b38f0 2024-04-02T07:30:27.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff713e00640 1 -- 172.21.15.55:0/2364679100 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff70400ad50 con 0x7ff71c0b38f0 2024-04-02T07:30:27.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff713e00640 1 -- 172.21.15.55:0/2364679100 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff704012640 con 0x7ff71c0b38f0 2024-04-02T07:30:27.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff722200640 1 -- 172.21.15.55:0/2364679100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff71c15bcc0 con 0x7ff71c0b38f0 2024-04-02T07:30:27.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.570+0000 7ff722200640 1 -- 172.21.15.55:0/2364679100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff71c153a60 con 0x7ff71c0b38f0 2024-04-02T07:30:27.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.574+0000 7ff722200640 1 -- 172.21.15.55:0/2364679100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff71c06e270 con 0x7ff71c0b38f0 2024-04-02T07:30:27.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.574+0000 7ff713e00640 1 -- 172.21.15.55:0/2364679100 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff704007070 con 0x7ff71c0b38f0 2024-04-02T07:30:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.574+0000 7ff713e00640 1 --2- 172.21.15.55:0/2364679100 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff6f8066690 0x7ff6f8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.574+0000 7ff713e00640 1 -- 172.21.15.55:0/2364679100 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7ff704084160 con 0x7ff71c0b38f0 2024-04-02T07:30:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.574+0000 7ff71b400640 1 --2- 172.21.15.55:0/2364679100 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff6f8066690 0x7ff6f8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:27.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.574+0000 7ff71b400640 1 --2- 172.21.15.55:0/2364679100 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff6f8066690 0x7ff6f8068b50 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0ad000 tx=0x7ff70c0a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:27.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.578+0000 7ff713e00640 1 -- 172.21.15.55:0/2364679100 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff704051470 con 0x7ff71c0b38f0 2024-04-02T07:30:27.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.758+0000 7ff722200640 1 -- 172.21.15.55:0/2364679100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff71c15c4c0 con 0x7ff71c0b38f0 2024-04-02T07:30:27.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.758+0000 7ff713e00640 1 -- 172.21.15.55:0/2364679100 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v90) v1 ==== 80+0+124 (secure 0 0 0) 0x7ff704017090 con 0x7ff71c0b38f0 2024-04-02T07:30:27.759 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.106:6837/2582023800 2024-04-03T07:29:14.039921+0000 2024-04-02T07:30:27.759 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.106:6836/2582023800 2024-04-03T07:29:14.039921+0000 2024-04-02T07:30:27.759 INFO:teuthology.orchestra.run.smithi055.stderr:listed 2 entries 2024-04-02T07:30:27.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.758+0000 7ff722200640 1 -- 172.21.15.55:0/2364679100 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff6f8066690 msgr2=0x7ff6f8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.758+0000 7ff722200640 1 --2- 172.21.15.55:0/2364679100 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff6f8066690 0x7ff6f8068b50 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff70c0ad000 tx=0x7ff70c0a6000 comp rx=0 tx=0).stop 2024-04-02T07:30:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.758+0000 7ff722200640 1 -- 172.21.15.55:0/2364679100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71c0b38f0 msgr2=0x7ff71c1550b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.758+0000 7ff722200640 1 --2- 172.21.15.55:0/2364679100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71c0b38f0 0x7ff71c1550b0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7ff70400ca70 tx=0x7ff70400cf30 comp rx=0 tx=0).stop 2024-04-02T07:30:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.758+0000 7ff722200640 1 -- 172.21.15.55:0/2364679100 shutdown_connections 2024-04-02T07:30:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.758+0000 7ff722200640 1 --2- 172.21.15.55:0/2364679100 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff6f8066690 0x7ff6f8068b50 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.758+0000 7ff722200640 1 --2- 172.21.15.55:0/2364679100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff71c1599c0 0x7ff71c1555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.758+0000 7ff722200640 1 --2- 172.21.15.55:0/2364679100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff71c0b38f0 0x7ff71c1550b0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.758+0000 7ff722200640 1 --2- 172.21.15.55:0/2364679100 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff71c06d1c0 0x7ff71c153520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.758+0000 7ff722200640 1 -- 172.21.15.55:0/2364679100 >> 172.21.15.55:0/2364679100 conn(0x7ff71c069d90 msgr2=0x7ff71c0b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.758+0000 7ff722200640 1 -- 172.21.15.55:0/2364679100 shutdown_connections 2024-04-02T07:30:27.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:27.758+0000 7ff722200640 1 -- 172.21.15.55:0/2364679100 wait complete. 2024-04-02T07:30:27.780 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi055.front.sepia.ceph.com... 2024-04-02T07:30:27.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:30:27.780 DEBUG:teuthology.orchestra.run.smithi055:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-02T07:30:27.798 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[46628]: fuse finished with error 0 and tester_r 0 2024-04-02T07:30:27.801 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:30:33.903 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:30:33.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:30:33.903 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-02T07:30:33.914 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:30:34.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.106+0000 7f6d13e00640 1 Processor -- start 2024-04-02T07:30:34.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.106+0000 7f6d13e00640 1 -- start start 2024-04-02T07:30:34.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.106+0000 7f6d13e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d0c0c4120 0x7f6d0c0b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.106+0000 7f6d13e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6d0c0b36f0 0x7f6d0c13d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.106+0000 7f6d13e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d0c13d0c0 con 0x7f6d0c153ea0 2024-04-02T07:30:34.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.106+0000 7f6d13e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d0c0c4580 con 0x7f6d0c0b36f0 2024-04-02T07:30:34.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.106+0000 7f6d13e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c15a2f0 con 0x7f6d0c0c4120 2024-04-02T07:30:34.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.106+0000 7f6d11e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6d0c0b36f0 0x7f6d0c13d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.106+0000 7f6d11e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6d0c0b36f0 0x7f6d0c13d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57398/0 (socket says 172.21.15.55:57398) 2024-04-02T07:30:34.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.106+0000 7f6d11e00640 1 -- 172.21.15.55:0/4022579346 learned_addr learned my addr 172.21.15.55:0/4022579346 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:34.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.110+0000 7f6d10a00640 1 --2- 172.21.15.55:0/4022579346 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d0c0c4120 0x7f6d0c0b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.110+0000 7f6d11e00640 1 -- 172.21.15.55:0/4022579346 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d0c0c4120 msgr2=0x7f6d0c0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:34.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.110+0000 7f6d11e00640 1 --2- 172.21.15.55:0/4022579346 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d0c0c4120 0x7f6d0c0b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.110+0000 7f6d11e00640 1 -- 172.21.15.55:0/4022579346 >> v1:172.21.15.106:6789/0 conn(0x7f6d0c153ea0 legacy=0x7f6d0c159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:34.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.110+0000 7f6d11e00640 1 -- 172.21.15.55:0/4022579346 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d0c15a4f0 con 0x7f6d0c0b36f0 2024-04-02T07:30:34.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.110+0000 7f6d11e00640 1 --2- 172.21.15.55:0/4022579346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c0b36f0 0x7f6d0c13d550 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009e50 tx=0x7f6d0401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b93ea5ca9d1cf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:34.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.110+0000 7f6d0be00640 1 -- 172.21.15.55:0/4022579346 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d040a5810 con 0x7f6d0c0b36f0 2024-04-02T07:30:34.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.110+0000 7f6d0be00640 1 -- 172.21.15.55:0/4022579346 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d040a5970 con 0x7f6d0c0b36f0 2024-04-02T07:30:34.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.110+0000 7f6d0be00640 1 -- 172.21.15.55:0/4022579346 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d040a5d00 con 0x7f6d0c0b36f0 2024-04-02T07:30:34.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d13e00640 1 -- 172.21.15.55:0/4022579346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c0b36f0 msgr2=0x7f6d0c13d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:34.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d13e00640 1 --2- 172.21.15.55:0/4022579346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c0b36f0 0x7f6d0c13d550 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009e50 tx=0x7f6d0401ca30 comp rx=0 tx=0).stop 2024-04-02T07:30:34.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d13e00640 1 -- 172.21.15.55:0/4022579346 shutdown_connections 2024-04-02T07:30:34.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d13e00640 1 --2- 172.21.15.55:0/4022579346 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c0b36f0 0x7f6d0c13d550 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d13e00640 1 --2- 172.21.15.55:0/4022579346 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d0c0c4120 0x7f6d0c0b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d13e00640 1 -- 172.21.15.55:0/4022579346 >> 172.21.15.55:0/4022579346 conn(0x7f6d0c066080 msgr2=0x7f6d0c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:34.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d13e00640 1 -- 172.21.15.55:0/4022579346 shutdown_connections 2024-04-02T07:30:34.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d13e00640 1 -- 172.21.15.55:0/4022579346 wait complete. 2024-04-02T07:30:34.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d13e00640 1 Processor -- start 2024-04-02T07:30:34.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d13e00640 1 -- start start 2024-04-02T07:30:34.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d13e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c0b36f0 0x7f6d0c1264e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d13e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d0c0c4120 0x7f6d0c151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d13e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d0c153ea0 0x7f6d0c142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d13e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c136670 con 0x7f6d0c0b36f0 2024-04-02T07:30:34.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d13e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c13ef70 con 0x7f6d0c153ea0 2024-04-02T07:30:34.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d13e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d0c126a20 con 0x7f6d0c0c4120 2024-04-02T07:30:34.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d11400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c0b36f0 0x7f6d0c1264e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d11400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c0b36f0 0x7f6d0c1264e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57414/0 (socket says 172.21.15.55:57414) 2024-04-02T07:30:34.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d11400640 1 -- 172.21.15.55:0/381248142 learned_addr learned my addr 172.21.15.55:0/381248142 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:34.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d10a00640 1 --2- 172.21.15.55:0/381248142 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d0c0c4120 0x7f6d0c151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d11e00640 1 --2- 172.21.15.55:0/381248142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d0c153ea0 0x7f6d0c142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d11400640 1 -- 172.21.15.55:0/381248142 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d0c0c4120 msgr2=0x7f6d0c151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:34.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d11400640 1 --2- 172.21.15.55:0/381248142 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d0c0c4120 0x7f6d0c151e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d11400640 1 -- 172.21.15.55:0/381248142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d0c153ea0 msgr2=0x7f6d0c142940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:34.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d11400640 1 --2- 172.21.15.55:0/381248142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d0c153ea0 0x7f6d0c142940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.114+0000 7f6d11400640 1 -- 172.21.15.55:0/381248142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d04009b30 con 0x7f6d0c0b36f0 2024-04-02T07:30:34.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.118+0000 7f6d11400640 1 --2- 172.21.15.55:0/381248142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c0b36f0 0x7f6d0c1264e0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000c3f0 tx=0x7f6d0000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:34.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.118+0000 7f6d09600640 1 -- 172.21.15.55:0/381248142 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d000052d0 con 0x7f6d0c0b36f0 2024-04-02T07:30:34.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.118+0000 7f6d09600640 1 -- 172.21.15.55:0/381248142 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d00005430 con 0x7f6d0c0b36f0 2024-04-02T07:30:34.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.118+0000 7f6d09600640 1 -- 172.21.15.55:0/381248142 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d00003840 con 0x7f6d0c0b36f0 2024-04-02T07:30:34.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.118+0000 7f6d13e00640 1 -- 172.21.15.55:0/381248142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d0c1414d0 con 0x7f6d0c0b36f0 2024-04-02T07:30:34.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.118+0000 7f6d13e00640 1 -- 172.21.15.55:0/381248142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d0c140f10 con 0x7f6d0c0b36f0 2024-04-02T07:30:34.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.118+0000 7f6d13e00640 1 -- 172.21.15.55:0/381248142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d0c0caf60 con 0x7f6d0c0b36f0 2024-04-02T07:30:34.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.118+0000 7f6d09600640 1 -- 172.21.15.55:0/381248142 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6d000039a0 con 0x7f6d0c0b36f0 2024-04-02T07:30:34.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.118+0000 7f6d09600640 1 --2- 172.21.15.55:0/381248142 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6cec0666c0 0x7f6cec068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.118+0000 7f6d09600640 1 -- 172.21.15.55:0/381248142 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f6d000837e0 con 0x7f6d0c0b36f0 2024-04-02T07:30:34.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.118+0000 7f6d10a00640 1 --2- 172.21.15.55:0/381248142 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6cec0666c0 0x7f6cec068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.122+0000 7f6d10a00640 1 --2- 172.21.15.55:0/381248142 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6cec0666c0 0x7f6cec068b80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c1f6790 tx=0x7f6cf8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:34.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.122+0000 7f6d09600640 1 -- 172.21.15.55:0/381248142 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6d00050a80 con 0x7f6d0c0b36f0 2024-04-02T07:30:34.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.322+0000 7f6d13e00640 1 -- 172.21.15.55:0/381248142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d0c13ed40 con 0x7f6d0c0b36f0 2024-04-02T07:30:34.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.322+0000 7f6d09600640 1 -- 172.21.15.55:0/381248142 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4741 (secure 0 0 0) 0x7f6d0c13ed40 con 0x7f6d0c0b36f0 2024-04-02T07:30:34.322 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:30:34.322 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":67,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2209852195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2209852195},{"type":"v1","addr":"172.21.15.55:6835","nonce":2209852195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1897181831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1897181831},{"type":"v1","addr":"172.21.15.106:6835","nonce":1897181831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1894364429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1894364429},{"type":"v1","addr":"172.21.15.106:6837","nonce":1894364429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:28:53.919977+0000","modified":"2024-04-02T07:29:25.157357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":90,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7455},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7455":{"gid":7455,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":12,"addr":"172.21.15.55:6834/821922065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":821922065},{"type":"v1","addr":"172.21.15.55:6834","nonce":821922065}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-02T07:30:34.323 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 67 2024-04-02T07:30:34.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.322+0000 7f6d13e00640 1 -- 172.21.15.55:0/381248142 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6cec0666c0 msgr2=0x7f6cec068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:34.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.322+0000 7f6d13e00640 1 --2- 172.21.15.55:0/381248142 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6cec0666c0 0x7f6cec068b80 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c1f6790 tx=0x7f6cf8009190 comp rx=0 tx=0).stop 2024-04-02T07:30:34.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.322+0000 7f6d13e00640 1 -- 172.21.15.55:0/381248142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c0b36f0 msgr2=0x7f6d0c1264e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:34.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.322+0000 7f6d13e00640 1 --2- 172.21.15.55:0/381248142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c0b36f0 0x7f6d0c1264e0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f6d0000c3f0 tx=0x7f6d0000c8b0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.322+0000 7f6d13e00640 1 -- 172.21.15.55:0/381248142 shutdown_connections 2024-04-02T07:30:34.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.322+0000 7f6d13e00640 1 --2- 172.21.15.55:0/381248142 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6cec0666c0 0x7f6cec068b80 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.322+0000 7f6d13e00640 1 --2- 172.21.15.55:0/381248142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6d0c153ea0 0x7f6d0c142940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.322+0000 7f6d13e00640 1 --2- 172.21.15.55:0/381248142 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6d0c0c4120 0x7f6d0c151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.322+0000 7f6d13e00640 1 --2- 172.21.15.55:0/381248142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d0c0b36f0 0x7f6d0c1264e0 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.322+0000 7f6d13e00640 1 -- 172.21.15.55:0/381248142 >> 172.21.15.55:0/381248142 conn(0x7f6d0c066080 msgr2=0x7f6d0c0cb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:34.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.322+0000 7f6d13e00640 1 -- 172.21.15.55:0/381248142 shutdown_connections 2024-04-02T07:30:34.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.322+0000 7f6d13e00640 1 -- 172.21.15.55:0/381248142 wait complete. 2024-04-02T07:30:34.344 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-02T07:30:34.514 INFO:teuthology.orchestra.run.smithi055.stdout:{"message":"","return_code":0} 2024-04-02T07:30:34.515 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-02T07:30:34.515 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-02T07:30:34.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.654+0000 7f5d82000640 1 Processor -- start 2024-04-02T07:30:34.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.654+0000 7f5d82000640 1 -- start start 2024-04-02T07:30:34.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.654+0000 7f5d82000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d7c15fff0 0x7f5d7c0b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.654+0000 7f5d82000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d7c069d90 0x7f5d7c06a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.654+0000 7f5d82000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d7c0aea20 con 0x7f5d7c0aebd0 2024-04-02T07:30:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.654+0000 7f5d82000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d7c1603d0 con 0x7f5d7c069d90 2024-04-02T07:30:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.654+0000 7f5d82000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c06ecc0 con 0x7f5d7c15fff0 2024-04-02T07:30:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.654+0000 7f5d7be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d7c069d90 0x7f5d7c06a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.654+0000 7f5d73e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5d7c0aebd0 0x7f5d7c06f430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40856/0 (socket says 172.21.15.55:40856) 2024-04-02T07:30:34.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.654+0000 7f5d73e00640 1 -- 172.21.15.55:0/44402232 learned_addr learned my addr 172.21.15.55:0/44402232 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:30:34.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.654+0000 7f5d7be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d7c069d90 0x7f5d7c06a1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57416/0 (socket says 172.21.15.55:57416) 2024-04-02T07:30:34.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.654+0000 7f5d7b400640 1 --2- 172.21.15.55:0/44402232 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d7c15fff0 0x7f5d7c0b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.658+0000 7f5d7be00640 1 -- 172.21.15.55:0/44402232 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d7c15fff0 msgr2=0x7f5d7c0b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:34.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.658+0000 7f5d7be00640 1 --2- 172.21.15.55:0/44402232 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d7c15fff0 0x7f5d7c0b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.658+0000 7f5d7be00640 1 -- 172.21.15.55:0/44402232 >> v1:172.21.15.55:6789/0 conn(0x7f5d7c0aebd0 legacy=0x7f5d7c06f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:34.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.658+0000 7f5d7be00640 1 -- 172.21.15.55:0/44402232 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d7c06a730 con 0x7f5d7c069d90 2024-04-02T07:30:34.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.658+0000 7f5d7aa00640 1 -- 172.21.15.55:0/44402232 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3589962709 0 0) 0x7f5d7c0aea20 con 0x7f5d7c0aebd0 2024-04-02T07:30:34.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.658+0000 7f5d7be00640 1 --2- 172.21.15.55:0/44402232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d7c069d90 0x7f5d7c06a1f0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f5d74009d90 tx=0x7f5d7401c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47f02d5932a2f71d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:34.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.658+0000 7f5d7aa00640 1 -- 172.21.15.55:0/44402232 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d740a5800 con 0x7f5d7c069d90 2024-04-02T07:30:34.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.658+0000 7f5d7aa00640 1 -- 172.21.15.55:0/44402232 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d740a5960 con 0x7f5d7c069d90 2024-04-02T07:30:34.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.658+0000 7f5d7aa00640 1 -- 172.21.15.55:0/44402232 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d740a5cf0 con 0x7f5d7c069d90 2024-04-02T07:30:34.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.658+0000 7f5d82000640 1 -- 172.21.15.55:0/44402232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d7c069d90 msgr2=0x7f5d7c06a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:34.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.658+0000 7f5d82000640 1 --2- 172.21.15.55:0/44402232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d7c069d90 0x7f5d7c06a1f0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f5d74009d90 tx=0x7f5d7401c850 comp rx=0 tx=0).stop 2024-04-02T07:30:34.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.658+0000 7f5d82000640 1 -- 172.21.15.55:0/44402232 shutdown_connections 2024-04-02T07:30:34.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.658+0000 7f5d82000640 1 --2- 172.21.15.55:0/44402232 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d7c069d90 0x7f5d7c06a1f0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.658+0000 7f5d82000640 1 --2- 172.21.15.55:0/44402232 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d7c15fff0 0x7f5d7c0b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.658+0000 7f5d82000640 1 -- 172.21.15.55:0/44402232 >> 172.21.15.55:0/44402232 conn(0x7f5d7c0b1420 msgr2=0x7f5d7c0b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:34.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.658+0000 7f5d82000640 1 -- 172.21.15.55:0/44402232 shutdown_connections 2024-04-02T07:30:34.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d82000640 1 -- 172.21.15.55:0/44402232 wait complete. 2024-04-02T07:30:34.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d82000640 1 Processor -- start 2024-04-02T07:30:34.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d82000640 1 -- start start 2024-04-02T07:30:34.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d82000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d7c069d90 0x7f5d7c0cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d82000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d7c0aebd0 0x7f5d7c158b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d82000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d7c15fff0 0x7f5d7c159050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d82000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c159590 con 0x7f5d7c15fff0 2024-04-02T07:30:34.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d82000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c15cea0 con 0x7f5d7c069d90 2024-04-02T07:30:34.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d82000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d7c154350 con 0x7f5d7c0aebd0 2024-04-02T07:30:34.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d7be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d7c15fff0 0x7f5d7c159050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d7be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d7c15fff0 0x7f5d7c159050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57428/0 (socket says 172.21.15.55:57428) 2024-04-02T07:30:34.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d7be00640 1 -- 172.21.15.55:0/2278336911 learned_addr learned my addr 172.21.15.55:0/2278336911 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:34.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d73e00640 1 --2- 172.21.15.55:0/2278336911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d7c0aebd0 0x7f5d7c158b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d7b400640 1 --2- 172.21.15.55:0/2278336911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d7c069d90 0x7f5d7c0cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d7be00640 1 -- 172.21.15.55:0/2278336911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d7c0aebd0 msgr2=0x7f5d7c158b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:34.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d7be00640 1 --2- 172.21.15.55:0/2278336911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d7c0aebd0 0x7f5d7c158b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d7be00640 1 -- 172.21.15.55:0/2278336911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d7c069d90 msgr2=0x7f5d7c0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:34.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d7be00640 1 --2- 172.21.15.55:0/2278336911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d7c069d90 0x7f5d7c0cf5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d7be00640 1 -- 172.21.15.55:0/2278336911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d74009a70 con 0x7f5d7c15fff0 2024-04-02T07:30:34.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d73e00640 1 --2- 172.21.15.55:0/2278336911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d7c0aebd0 0x7f5d7c158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:30:34.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d7b400640 1 --2- 172.21.15.55:0/2278336911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d7c069d90 0x7f5d7c0cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:30:34.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d7be00640 1 --2- 172.21.15.55:0/2278336911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d7c15fff0 0x7f5d7c159050 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f5d7401af00 tx=0x7f5d740195f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:34.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d73400640 1 -- 172.21.15.55:0/2278336911 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d740ad8d0 con 0x7f5d7c15fff0 2024-04-02T07:30:34.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d73400640 1 -- 172.21.15.55:0/2278336911 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d740ada30 con 0x7f5d7c15fff0 2024-04-02T07:30:34.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d82000640 1 -- 172.21.15.55:0/2278336911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d7c0b3c00 con 0x7f5d7c15fff0 2024-04-02T07:30:34.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d73400640 1 -- 172.21.15.55:0/2278336911 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d740adda0 con 0x7f5d7c15fff0 2024-04-02T07:30:34.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.662+0000 7f5d82000640 1 -- 172.21.15.55:0/2278336911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d7c154910 con 0x7f5d7c15fff0 2024-04-02T07:30:34.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.666+0000 7f5d82000640 1 -- 172.21.15.55:0/2278336911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d7c066c90 con 0x7f5d7c15fff0 2024-04-02T07:30:34.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.666+0000 7f5d73400640 1 -- 172.21.15.55:0/2278336911 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5d740b9450 con 0x7f5d7c15fff0 2024-04-02T07:30:34.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.666+0000 7f5d73400640 1 --2- 172.21.15.55:0/2278336911 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d58066690 0x7f5d58068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.666+0000 7f5d73400640 1 -- 172.21.15.55:0/2278336911 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f5d7411f8d0 con 0x7f5d7c15fff0 2024-04-02T07:30:34.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.666+0000 7f5d7b400640 1 --2- 172.21.15.55:0/2278336911 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d58066690 0x7f5d58068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.666+0000 7f5d7b400640 1 --2- 172.21.15.55:0/2278336911 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d58066690 0x7f5d58068b50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c00b9f0 tx=0x7f5d6c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:34.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.670+0000 7f5d73400640 1 -- 172.21.15.55:0/2278336911 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5d740ecb60 con 0x7f5d7c15fff0 2024-04-02T07:30:34.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.866+0000 7f5d82000640 1 -- 172.21.15.55:0/2278336911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f5d7c06a370 con 0x7f5d7c15fff0 2024-04-02T07:30:34.867 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-02T07:30:34.866+0000 7f8f18800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-02T07:30:34.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.874+0000 7f5d73400640 1 -- 172.21.15.55:0/2278336911 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v68) v1 ==== 161+0+0 (secure 0 0 0) 0x7f5d740f0180 con 0x7f5d7c15fff0 2024-04-02T07:30:34.876 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-02T07:30:34.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.878+0000 7f5d82000640 1 -- 172.21.15.55:0/2278336911 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d58066690 msgr2=0x7f5d58068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:34.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.878+0000 7f5d82000640 1 --2- 172.21.15.55:0/2278336911 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d58066690 0x7f5d58068b50 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c00b9f0 tx=0x7f5d6c008040 comp rx=0 tx=0).stop 2024-04-02T07:30:34.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.878+0000 7f5d82000640 1 -- 172.21.15.55:0/2278336911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d7c15fff0 msgr2=0x7f5d7c159050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:34.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.878+0000 7f5d82000640 1 --2- 172.21.15.55:0/2278336911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d7c15fff0 0x7f5d7c159050 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f5d7401af00 tx=0x7f5d740195f0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.878+0000 7f5d82000640 1 -- 172.21.15.55:0/2278336911 shutdown_connections 2024-04-02T07:30:34.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.878+0000 7f5d82000640 1 --2- 172.21.15.55:0/2278336911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d7c15fff0 0x7f5d7c159050 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.878+0000 7f5d82000640 1 --2- 172.21.15.55:0/2278336911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d7c0aebd0 0x7f5d7c158b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.878+0000 7f5d82000640 1 --2- 172.21.15.55:0/2278336911 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d58066690 0x7f5d58068b50 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.878+0000 7f5d82000640 1 --2- 172.21.15.55:0/2278336911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d7c069d90 0x7f5d7c0cf5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.878+0000 7f5d82000640 1 -- 172.21.15.55:0/2278336911 >> 172.21.15.55:0/2278336911 conn(0x7f5d7c0b1420 msgr2=0x7f5d7c0b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:34.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.878+0000 7f5d82000640 1 -- 172.21.15.55:0/2278336911 shutdown_connections 2024-04-02T07:30:34.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.878+0000 7f5d82000640 1 -- 172.21.15.55:0/2278336911 wait complete. 2024-04-02T07:30:34.887 INFO:tasks.ceph.mds.a.smithi055.stderr: -4397> 2024-04-02T07:29:20.450+0000 7f3acb400640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:30:34.887 INFO:tasks.ceph.mds.a.smithi055.stderr: -4089> 2024-04-02T07:29:21.358+0000 7f3ac6e00640 -1 log_channel(cluster) log [ERR] : dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-02T07:30:34.888 INFO:tasks.ceph.mds.a.smithi055.stderr: -3916> 2024-04-02T07:29:21.598+0000 7f3ac6e00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v13 ap=1 f(v0 m2024-04-02T07:29:02.941529+0000 1=1+0) n(v0 rc2024-04-02T07:29:03.060803+0000 2=1+1) (iversion lock) | dirfrag=0 authpin=1 scrubqueue=0 0x55cb9380e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v13>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-02T07:29:02.941529+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-02T07:29:03.060803+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":-2} 2024-04-02T07:30:34.892 INFO:tasks.ceph.mds.a.smithi055.stderr: -2320> 2024-04-02T07:29:53.182+0000 7f3ac6e00640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000000 [...2,head] /dir/ auth v13 pv17 ap=3 DIRTYPARENT f(v0 m2024-04-02T07:29:02.941529+0000 1=1+0)->f(v1 m2024-04-02T07:29:02.941529+0000) n(v0 rc2024-04-02T07:29:03.060803+0000 2=1+1)->n(v0 rc2024-04-02T07:29:03.060803+0000 2=1+1) (inest lock dirty) (ifile lock->sync w=1 flushing) (iversion lock) | dirtyscattered=2 lock=1 dirfrag=1 dirtyrstat=1 dirtyparent=1 waiter=1 authpin=1 scrubqueue=0 0x55cb9380e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":-2,"ondisk_value":"(-1)0x0:[]//[]","memoryvalue":"(12)0x10000000000:[<0x1/dir v13>]//[]","error_str":"failed to decode on-disk backtrace (0 bytes)!"},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n(v0 1=0+1)","memory_value.dirstat":"f(v0 m2024-04-02T07:29:02.941529+0000 1=1+0)","memory_value.rstat":"n(v0 rc2024-04-02T07:29:03.060803+0000 2=1+1)","error_str":"freshly-calculated rstats don't match existing ones (will be fixed)"},"return_code":-2} 2024-04-02T07:30:34.899 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-04-02T07:30:34.936 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-02T07:30:34.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7e8bc8c0 1 -- start start 2024-04-02T07:30:34.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7e8bc8c0 1 Processor -- start 2024-04-02T07:30:34.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7e8bc8c0 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ce9a7b800 0x559ce9b06580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7e8bc8c0 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559ce9a7b400 0x559ce9b06b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7e8bc8c0 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559ce9a7b000 0x559ce9b07080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7e8bc8c0 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ce9b48a00 con 0x559ce9a7b000 2024-04-02T07:30:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7e8bc8c0 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ce9b48780 con 0x559ce9a7b800 2024-04-02T07:30:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7e8bc8c0 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ce9b48640 con 0x559ce9a7b400 2024-04-02T07:30:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559ce9a7b000 0x559ce9b07080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559ce9a7b000 0x559ce9b07080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57472/0 (socket says 172.21.15.55:57472) 2024-04-02T07:30:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7d400640 1 -- 172.21.15.55:0/3164993278 learned_addr learned my addr 172.21.15.55:0/3164993278 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7ca00640 1 --2- 172.21.15.55:0/3164993278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ce9a7b800 0x559ce9b06580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7c000640 1 --2- 172.21.15.55:0/3164993278 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559ce9a7b400 0x559ce9b06b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7d400640 1 -- 172.21.15.55:0/3164993278 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559ce9a7b400 msgr2=0x559ce9b06b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7d400640 1 --2- 172.21.15.55:0/3164993278 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559ce9a7b400 0x559ce9b06b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7d400640 1 -- 172.21.15.55:0/3164993278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ce9a7b800 msgr2=0x559ce9b06580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:34.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7d400640 1 --2- 172.21.15.55:0/3164993278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ce9a7b800 0x559ce9b06580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7d400640 1 -- 172.21.15.55:0/3164993278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ce9aae9c0 con 0x559ce9a7b000 2024-04-02T07:30:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7c000640 1 --2- 172.21.15.55:0/3164993278 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559ce9a7b400 0x559ce9b06b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:30:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7d400640 1 --2- 172.21.15.55:0/3164993278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559ce9a7b000 0x559ce9b07080 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x559cea8dc9f0 tx=0x559cea805080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db0e06397f46904 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa79800640 1 -- 172.21.15.55:0/3164993278 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559ce9acf080 con 0x559ce9a7b000 2024-04-02T07:30:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa79800640 1 -- 172.21.15.55:0/3164993278 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559cea854480 con 0x559ce9a7b000 2024-04-02T07:30:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa79800640 1 -- 172.21.15.55:0/3164993278 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559ce9acf600 con 0x559ce9a7b000 2024-04-02T07:30:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/3164993278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ce9aae1a0 con 0x559ce9a7b000 2024-04-02T07:30:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/3164993278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x559ce9aae9c0 con 0x559ce9a7b000 2024-04-02T07:30:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7e8bc8c0 4 waiting for MDS map... 2024-04-02T07:30:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa79800640 1 -- 172.21.15.55:0/3164993278 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x559ce9abac40 con 0x559ce9a7b000 2024-04-02T07:30:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa79800640 1 -- 172.21.15.55:0/3164993278 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 68) v1 ==== 2573+0+0 (secure 0 0 0) 0x559ce9ac8f00 con 0x559ce9a7b000 2024-04-02T07:30:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7e8bc8c0 4 Got MDS map 68 2024-04-02T07:30:34.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7e8bc8c0 4 datascan.main: Using metadata pool output 2024-04-02T07:30:34.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.946+0000 7faa7e8bc8c0 4 datascan.main: connecting to RADOS... 2024-04-02T07:30:34.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7e8bc8c0 1 Processor -- start 2024-04-02T07:30:34.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7e8bc8c0 1 -- start start 2024-04-02T07:30:34.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7e8bc8c0 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cea83d800 0x559ce9b07600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7e8bc8c0 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559cea83dc00 0x559ce9b07b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7e8bc8c0 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559cea9fa000 0x559ce9b08100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7e8bc8c0 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ce9ac1e00 con 0x559cea83d800 2024-04-02T07:30:34.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7e8bc8c0 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ce9b48780 con 0x559cea9fa000 2024-04-02T07:30:34.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7e8bc8c0 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ce9b48a00 con 0x559cea83dc00 2024-04-02T07:30:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7c000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cea83d800 0x559ce9b07600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7c000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cea83d800 0x559ce9b07600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57478/0 (socket says 172.21.15.55:57478) 2024-04-02T07:30:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7c000640 1 -- 172.21.15.55:0/647441420 learned_addr learned my addr 172.21.15.55:0/647441420 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7c000640 1 --2- 172.21.15.55:0/647441420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559cea9fa000 0x559ce9b08100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7ca00640 1 --2- 172.21.15.55:0/647441420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559cea83dc00 0x559ce9b07b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7c000640 1 -- 172.21.15.55:0/647441420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559cea83dc00 msgr2=0x559ce9b07b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7c000640 1 --2- 172.21.15.55:0/647441420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559cea83dc00 0x559ce9b07b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7c000640 1 -- 172.21.15.55:0/647441420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559cea9fa000 msgr2=0x559ce9b08100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7c000640 1 --2- 172.21.15.55:0/647441420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559cea9fa000 0x559ce9b08100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7c000640 1 -- 172.21.15.55:0/647441420 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ce9aaeb60 con 0x559cea83d800 2024-04-02T07:30:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7c000640 1 --2- 172.21.15.55:0/647441420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cea83d800 0x559ce9b07600 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x559cea97a930 tx=0x559cea99cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a64562f5937b9e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa77000640 1 -- 172.21.15.55:0/647441420 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559ce9acf080 con 0x559cea83d800 2024-04-02T07:30:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa77000640 1 -- 172.21.15.55:0/647441420 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559ce9ad8900 con 0x559cea83d800 2024-04-02T07:30:34.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa77000640 1 -- 172.21.15.55:0/647441420 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559ce9acf600 con 0x559cea83d800 2024-04-02T07:30:34.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/647441420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cea83d800 msgr2=0x559ce9b07600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:34.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/647441420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cea83d800 0x559ce9b07600 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x559cea97a930 tx=0x559cea99cc60 comp rx=0 tx=0).stop 2024-04-02T07:30:34.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/647441420 shutdown_connections 2024-04-02T07:30:34.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/647441420 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559cea9fa000 0x559ce9b08100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/647441420 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559cea83dc00 0x559ce9b07b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/647441420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cea83d800 0x559ce9b07600 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/647441420 >> 172.21.15.55:0/647441420 conn(0x559ce9a7ac00 msgr2=0x559ce9aa7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:34.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/647441420 shutdown_connections 2024-04-02T07:30:34.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/647441420 wait complete. 2024-04-02T07:30:34.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7e8bc8c0 1 Processor -- start 2024-04-02T07:30:34.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.950+0000 7faa7e8bc8c0 1 -- start start 2024-04-02T07:30:34.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7e8bc8c0 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559cea83dc00 0x559ce9b09180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7e8bc8c0 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559cea83d800 0x559ce9b08c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7e8bc8c0 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cea9fb800 0x559ce9b08680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7e8bc8c0 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ce9b48500 con 0x559cea9fb800 2024-04-02T07:30:34.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7e8bc8c0 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x559ce9b483c0 con 0x559cea83d800 2024-04-02T07:30:34.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7e8bc8c0 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x559ce9b48280 con 0x559cea83dc00 2024-04-02T07:30:34.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7c000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cea9fb800 0x559ce9b08680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7c000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cea9fb800 0x559ce9b08680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57480/0 (socket says 172.21.15.55:57480) 2024-04-02T07:30:34.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 learned_addr learned my addr 172.21.15.55:0/2636847706 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:34.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7ca00640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559cea83d800 0x559ce9b08c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7c000640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559cea83dc00 0x559ce9b09180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559cea83dc00 msgr2=0x559ce9b09180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:34.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7c000640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559cea83dc00 0x559ce9b09180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559cea83d800 msgr2=0x559ce9b08c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:34.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7c000640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559cea83d800 0x559ce9b08c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:34.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559ce9aae340 con 0x559cea9fb800 2024-04-02T07:30:34.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7c000640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cea9fb800 0x559ce9b08680 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x559cea97b5f0 tx=0x559cea852c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:34.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa75200640 1 -- 172.21.15.55:0/2636847706 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559ce9acedc0 con 0x559cea9fb800 2024-04-02T07:30:34.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa75200640 1 -- 172.21.15.55:0/2636847706 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559cea855500 con 0x559cea9fb800 2024-04-02T07:30:34.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x559ce9aae000 con 0x559cea9fb800 2024-04-02T07:30:34.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa75200640 1 -- 172.21.15.55:0/2636847706 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x559ce9acf080 con 0x559cea9fb800 2024-04-02T07:30:34.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559ce9aaeea0 con 0x559cea9fb800 2024-04-02T07:30:34.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7e8bc8c0 4 datascan.init: resolving metadata pool 12 2024-04-02T07:30:34.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa75200640 1 -- 172.21.15.55:0/2636847706 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x559ce9ab2840 con 0x559cea9fb800 2024-04-02T07:30:34.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa75200640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x559ce9d6a800 0x559ce9b09700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa75200640 1 -- 172.21.15.55:0/2636847706 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x559ce9abaa80 con 0x559cea9fb800 2024-04-02T07:30:34.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7e8bc8c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-02T07:30:34.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7e8bc8c0 4 datascan.main: data pool 'cephfs_data' has ID 13 2024-04-02T07:30:34.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7e8bc8c0 4 datascan.main: opening data pool 'cephfs_data' 2024-04-02T07:30:34.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x559cea9fb400 0x559ce9b08100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.954+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:1 13.0 13:00000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559cea9fb000 con 0x559cea9fb400 2024-04-02T07:30:34.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.958+0000 7faa7ca00640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x559ce9d6a800 0x559ce9b09700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.958+0000 7faa7c000640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x559cea9fb400 0x559ce9b08100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.958+0000 7faa7c000640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x559cea9fb400 0x559ce9b08100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:34.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.958+0000 7faa7ca00640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x559ce9d6a800 0x559ce9b09700 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x559ce9b8e6f0 tx=0x559cea99dda0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:34.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.958+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.7 v2:172.21.15.106:6824/27679 1 ==== osd_op_reply(1 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559cea9fb400 2024-04-02T07:30:34.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.958+0000 7faa76600640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x559ce9d6b800 0x559ce9e6e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.958+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:2 13.20 13:04000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9d6bc00 con 0x559ce9d6b800 2024-04-02T07:30:34.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.958+0000 7faa7d400640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x559ce9d6b800 0x559ce9e6e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.958+0000 7faa7d400640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x559ce9d6b800 0x559ce9e6e000 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:34.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.962+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.6 v2:172.21.15.106:6816/27678 1 ==== osd_op_reply(2 [pgnls start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9d6b800 2024-04-02T07:30:34.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.962+0000 7faa77000640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x559ce9e74000 0x559ce9e6e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.962+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:3 13.10 13:08000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e74400 con 0x559ce9e74000 2024-04-02T07:30:34.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.962+0000 7faa7ca00640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x559ce9e74000 0x559ce9e6e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.962+0000 7faa7ca00640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x559ce9e74000 0x559ce9e6e580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:34.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.962+0000 7faa7ca00640 1 -- 172.21.15.55:0/2636847706 <== osd.1 v2:172.21.15.55:6809/27391 1 ==== osd_op_reply(3 [pgnls start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842fc0 con 0x559ce9e74000 2024-04-02T07:30:34.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.962+0000 7faa76600640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x559ce9e74c00 0x559ce9e6eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.962+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:4 13.30 13:0c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e75000 con 0x559ce9e74c00 2024-04-02T07:30:34.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.966+0000 7faa7c000640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x559ce9e74c00 0x559ce9e6eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.966+0000 7faa7c000640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x559ce9e74c00 0x559ce9e6eb00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:34.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.966+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.4 v2:172.21.15.106:6801/27677 1 ==== osd_op_reply(4 [pgnls start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559ce9e74c00 2024-04-02T07:30:34.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.966+0000 7faa77000640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x559ce9e74800 0x559ce9e6f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.966+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:5 13.8 13:10000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e75800 con 0x559ce9e74800 2024-04-02T07:30:34.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.966+0000 7faa7d400640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x559ce9e74800 0x559ce9e6f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.970+0000 7faa7d400640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x559ce9e74800 0x559ce9e6f600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:34.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.970+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.2 v2:172.21.15.55:6808/27394 1 ==== osd_op_reply(5 [pgnls start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9e74800 2024-04-02T07:30:34.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.970+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:6 13.28 13:14000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e75400 con 0x559ce9e74800 2024-04-02T07:30:34.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.970+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.2 v2:172.21.15.55:6808/27394 2 ==== osd_op_reply(6 [pgnls start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9e74800 2024-04-02T07:30:34.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.970+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:7 13.18 13:18000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e75c00 con 0x559cea9fb400 2024-04-02T07:30:34.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.970+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.7 v2:172.21.15.106:6824/27679 2 ==== osd_op_reply(7 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559cea9fb400 2024-04-02T07:30:34.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.970+0000 7faa76600640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x559ce9e84000 0x559ce9e6f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.970+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:8 13.38 13:1c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e84400 con 0x559ce9e84000 2024-04-02T07:30:34.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.970+0000 7faa7ca00640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x559ce9e84000 0x559ce9e6f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.970+0000 7faa7ca00640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x559ce9e84000 0x559ce9e6f080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:34.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.974+0000 7faa7ca00640 1 -- 172.21.15.55:0/2636847706 <== osd.5 v2:172.21.15.106:6800/27676 1 ==== osd_op_reply(8 [pgnls start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842fc0 con 0x559ce9e84000 2024-04-02T07:30:34.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.974+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:9 13.4 13:20000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e85000 con 0x559ce9d6b800 2024-04-02T07:30:34.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.974+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.6 v2:172.21.15.106:6816/27678 2 ==== osd_op_reply(9 [pgnls start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9d6b800 2024-04-02T07:30:34.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.974+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:10 13.24 13:24000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e84800 con 0x559ce9d6b800 2024-04-02T07:30:34.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.974+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.6 v2:172.21.15.106:6816/27678 3 ==== osd_op_reply(10 [pgnls start_epoch 91 out=49b] v89'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9d6b800 2024-04-02T07:30:34.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.974+0000 7faa77000640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x559ce9e85400 0x559ce9e6fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.974+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:11 13.14 13:28000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e85800 con 0x559ce9e85400 2024-04-02T07:30:34.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.974+0000 7faa7c000640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x559ce9e85400 0x559ce9e6fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.974+0000 7faa7c000640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x559ce9e85400 0x559ce9e6fb80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.978+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.0 v2:172.21.15.55:6800/27392 1 ==== osd_op_reply(11 [pgnls start_epoch 91 out=49b] v89'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559ce9e85400 2024-04-02T07:30:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.978+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:12 13.34 13:2c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e84c00 con 0x559ce9d6b800 2024-04-02T07:30:34.978 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.978+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.6 v2:172.21.15.106:6816/27678 4 ==== osd_op_reply(12 [pgnls start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9d6b800 2024-04-02T07:30:34.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.978+0000 7faa77000640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x559ce9e85c00 0x559ce9e70100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:34.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.978+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:13 13.c 13:30000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e75000 con 0x559ce9e85c00 2024-04-02T07:30:34.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.978+0000 7faa7d400640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x559ce9e85c00 0x559ce9e70100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:34.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.978+0000 7faa7d400640 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x559ce9e85c00 0x559ce9e70100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:34.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.978+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.3 v2:172.21.15.55:6824/27393 1 ==== osd_op_reply(13 [pgnls start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9e85c00 2024-04-02T07:30:34.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.978+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:14 13.2c 13:34000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e85800 con 0x559ce9e74800 2024-04-02T07:30:34.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.978+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.2 v2:172.21.15.55:6808/27394 3 ==== osd_op_reply(14 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9e74800 2024-04-02T07:30:34.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.978+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:15 13.1c 13:38000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e75c00 con 0x559ce9d6b800 2024-04-02T07:30:34.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.978+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.6 v2:172.21.15.106:6816/27678 5 ==== osd_op_reply(15 [pgnls start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9d6b800 2024-04-02T07:30:34.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.978+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:16 13.3c 13:3c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e85000 con 0x559ce9e74800 2024-04-02T07:30:34.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.978+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.2 v2:172.21.15.55:6808/27394 4 ==== osd_op_reply(16 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9e74800 2024-04-02T07:30:34.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.978+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:17 13.2 13:40000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9d6bc00 con 0x559ce9e84000 2024-04-02T07:30:34.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.978+0000 7faa7ca00640 1 -- 172.21.15.55:0/2636847706 <== osd.5 v2:172.21.15.106:6800/27676 2 ==== osd_op_reply(17 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842fc0 con 0x559ce9e84000 2024-04-02T07:30:34.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.978+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:18 13.22 13:44000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e75800 con 0x559ce9e74000 2024-04-02T07:30:34.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.978+0000 7faa7ca00640 1 -- 172.21.15.55:0/2636847706 <== osd.1 v2:172.21.15.55:6809/27391 2 ==== osd_op_reply(18 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842fc0 con 0x559ce9e74000 2024-04-02T07:30:34.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.978+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:19 13.12 13:48000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559cea83d400 con 0x559ce9e85400 2024-04-02T07:30:34.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.0 v2:172.21.15.55:6800/27392 2 ==== osd_op_reply(19 [pgnls start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559ce9e85400 2024-04-02T07:30:34.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:20 13.32 13:4c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e75400 con 0x559ce9e74800 2024-04-02T07:30:34.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.2 v2:172.21.15.55:6808/27394 5 ==== osd_op_reply(20 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9e74800 2024-04-02T07:30:34.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:21 13.a 13:50000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559cea9fb000 con 0x559ce9e74800 2024-04-02T07:30:34.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.2 v2:172.21.15.55:6808/27394 6 ==== osd_op_reply(21 [pgnls start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9e74800 2024-04-02T07:30:34.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:22 13.2a 13:54000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e84400 con 0x559ce9e74000 2024-04-02T07:30:34.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa7ca00640 1 -- 172.21.15.55:0/2636847706 <== osd.1 v2:172.21.15.55:6809/27391 3 ==== osd_op_reply(22 [pgnls start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842fc0 con 0x559ce9e74000 2024-04-02T07:30:34.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:23 13.1a 13:58000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e84800 con 0x559ce9e74000 2024-04-02T07:30:34.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa7ca00640 1 -- 172.21.15.55:0/2636847706 <== osd.1 v2:172.21.15.55:6809/27391 4 ==== osd_op_reply(23 [pgnls start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842fc0 con 0x559ce9e74000 2024-04-02T07:30:34.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:24 13.3a 13:5c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e74400 con 0x559ce9e84000 2024-04-02T07:30:34.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa7ca00640 1 -- 172.21.15.55:0/2636847706 <== osd.5 v2:172.21.15.106:6800/27676 3 ==== osd_op_reply(24 [pgnls start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842fc0 con 0x559ce9e84000 2024-04-02T07:30:34.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:25 13.6 13:60000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e84c00 con 0x559ce9e74c00 2024-04-02T07:30:34.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.4 v2:172.21.15.106:6801/27677 2 ==== osd_op_reply(25 [pgnls start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559ce9e74c00 2024-04-02T07:30:34.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:26 13.26 13:64000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e75000 con 0x559cea9fb400 2024-04-02T07:30:34.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.7 v2:172.21.15.106:6824/27679 3 ==== osd_op_reply(26 [pgnls start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559cea9fb400 2024-04-02T07:30:34.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:27 13.16 13:68000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e85800 con 0x559ce9e85c00 2024-04-02T07:30:34.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.3 v2:172.21.15.55:6824/27393 2 ==== osd_op_reply(27 [pgnls start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9e85c00 2024-04-02T07:30:34.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:28 13.36 13:6c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e75c00 con 0x559ce9d6b800 2024-04-02T07:30:34.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.6 v2:172.21.15.106:6816/27678 6 ==== osd_op_reply(28 [pgnls start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9d6b800 2024-04-02T07:30:34.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:29 13.e 13:70000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e85000 con 0x559cea9fb400 2024-04-02T07:30:34.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.7 v2:172.21.15.106:6824/27679 4 ==== osd_op_reply(29 [pgnls start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559cea9fb400 2024-04-02T07:30:34.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:30 13.2e 13:74000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9d6b400 con 0x559ce9e74800 2024-04-02T07:30:34.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.2 v2:172.21.15.55:6808/27394 7 ==== osd_op_reply(30 [pgnls start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9e74800 2024-04-02T07:30:34.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.982+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:31 13.1e 13:78000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e9a000 con 0x559ce9e74c00 2024-04-02T07:30:34.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.4 v2:172.21.15.106:6801/27677 3 ==== osd_op_reply(31 [pgnls start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559ce9e74c00 2024-04-02T07:30:34.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:32 13.3e 13:7c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9d6bc00 con 0x559ce9e74000 2024-04-02T07:30:34.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa7ca00640 1 -- 172.21.15.55:0/2636847706 <== osd.1 v2:172.21.15.55:6809/27391 5 ==== osd_op_reply(32 [pgnls start_epoch 91 out=49b] v89'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842fc0 con 0x559ce9e74000 2024-04-02T07:30:34.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:33 13.1 13:80000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e9a400 con 0x559ce9d6b800 2024-04-02T07:30:34.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.6 v2:172.21.15.106:6816/27678 7 ==== osd_op_reply(33 [pgnls start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9d6b800 2024-04-02T07:30:34.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:34 13.21 13:84000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e84400 con 0x559ce9e74c00 2024-04-02T07:30:34.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.4 v2:172.21.15.106:6801/27677 4 ==== osd_op_reply(34 [pgnls start_epoch 91 out=49b] v89'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559ce9e74c00 2024-04-02T07:30:34.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:35 13.11 13:88000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e9a800 con 0x559ce9e74000 2024-04-02T07:30:34.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa7ca00640 1 -- 172.21.15.55:0/2636847706 <== osd.1 v2:172.21.15.55:6809/27391 6 ==== osd_op_reply(35 [pgnls start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842fc0 con 0x559ce9e74000 2024-04-02T07:30:34.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:36 13.31 13:8c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e84800 con 0x559ce9e85c00 2024-04-02T07:30:34.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.3 v2:172.21.15.55:6824/27393 3 ==== osd_op_reply(36 [pgnls start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9e85c00 2024-04-02T07:30:34.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:37 13.9 13:90000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e9ac00 con 0x559ce9e84000 2024-04-02T07:30:34.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa7ca00640 1 -- 172.21.15.55:0/2636847706 <== osd.5 v2:172.21.15.106:6800/27676 4 ==== osd_op_reply(37 [pgnls start_epoch 91 out=49b] v89'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842fc0 con 0x559ce9e84000 2024-04-02T07:30:34.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:38 13.29 13:94000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e75800 con 0x559ce9d6b800 2024-04-02T07:30:34.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.6 v2:172.21.15.106:6816/27678 8 ==== osd_op_reply(38 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9d6b800 2024-04-02T07:30:34.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:39 13.19 13:98000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e9b000 con 0x559ce9e85c00 2024-04-02T07:30:34.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.3 v2:172.21.15.55:6824/27393 4 ==== osd_op_reply(39 [pgnls start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9e85c00 2024-04-02T07:30:34.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:40 13.39 13:9c000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e74400 con 0x559ce9e74800 2024-04-02T07:30:34.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.2 v2:172.21.15.55:6808/27394 8 ==== osd_op_reply(40 [pgnls start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9e74800 2024-04-02T07:30:34.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:41 13.5 13:a0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e9b400 con 0x559ce9e74c00 2024-04-02T07:30:34.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.4 v2:172.21.15.106:6801/27677 5 ==== osd_op_reply(41 [pgnls start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559ce9e74c00 2024-04-02T07:30:34.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.986+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:42 13.25 13:a4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e75000 con 0x559ce9e74c00 2024-04-02T07:30:34.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.4 v2:172.21.15.106:6801/27677 6 ==== osd_op_reply(42 [pgnls start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559ce9e74c00 2024-04-02T07:30:34.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:43 13.15 13:a8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e9b800 con 0x559ce9e74c00 2024-04-02T07:30:34.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.4 v2:172.21.15.106:6801/27677 7 ==== osd_op_reply(43 [pgnls start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559ce9e74c00 2024-04-02T07:30:34.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:44 13.35 13:ac000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559cea83d400 con 0x559ce9e74000 2024-04-02T07:30:34.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa7ca00640 1 -- 172.21.15.55:0/2636847706 <== osd.1 v2:172.21.15.55:6809/27391 7 ==== osd_op_reply(44 [pgnls start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842fc0 con 0x559ce9e74000 2024-04-02T07:30:34.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:45 13.d 13:b0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e85800 con 0x559ce9e74c00 2024-04-02T07:30:34.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.4 v2:172.21.15.106:6801/27677 8 ==== osd_op_reply(45 [pgnls start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559ce9e74c00 2024-04-02T07:30:34.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:46 13.2d 13:b4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9d6bc00 con 0x559ce9e85400 2024-04-02T07:30:34.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.0 v2:172.21.15.55:6800/27392 3 ==== osd_op_reply(46 [pgnls start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559ce9e85400 2024-04-02T07:30:34.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:47 13.1d 13:b8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e84800 con 0x559cea9fb400 2024-04-02T07:30:34.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.7 v2:172.21.15.106:6824/27679 5 ==== osd_op_reply(47 [pgnls start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559cea9fb400 2024-04-02T07:30:34.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:48 13.3d 13:bc000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e9b400 con 0x559cea9fb400 2024-04-02T07:30:34.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.7 v2:172.21.15.106:6824/27679 6 ==== osd_op_reply(48 [pgnls start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559cea9fb400 2024-04-02T07:30:34.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:49 13.3 13:c0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e84c00 con 0x559ce9e85400 2024-04-02T07:30:34.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.0 v2:172.21.15.55:6800/27392 4 ==== osd_op_reply(49 [pgnls start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559ce9e85400 2024-04-02T07:30:34.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:50 13.23 13:c4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e9b800 con 0x559ce9e74000 2024-04-02T07:30:34.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa7ca00640 1 -- 172.21.15.55:0/2636847706 <== osd.1 v2:172.21.15.55:6809/27391 8 ==== osd_op_reply(50 [pgnls start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842fc0 con 0x559ce9e74000 2024-04-02T07:30:34.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:51 13.13 13:c8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e85000 con 0x559cea9fb400 2024-04-02T07:30:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.7 v2:172.21.15.106:6824/27679 7 ==== osd_op_reply(51 [pgnls start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559cea9fb400 2024-04-02T07:30:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:52 13.33 13:cc000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e9a400 con 0x559cea9fb400 2024-04-02T07:30:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.7 v2:172.21.15.106:6824/27679 8 ==== osd_op_reply(52 [pgnls start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559cea9fb400 2024-04-02T07:30:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:53 13.b 13:d0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9d6b400 con 0x559ce9e84000 2024-04-02T07:30:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa7ca00640 1 -- 172.21.15.55:0/2636847706 <== osd.5 v2:172.21.15.106:6800/27676 5 ==== osd_op_reply(53 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842fc0 con 0x559ce9e84000 2024-04-02T07:30:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.990+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:54 13.2b 13:d4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e9a000 con 0x559ce9e74800 2024-04-02T07:30:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.994+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.2 v2:172.21.15.55:6808/27394 9 ==== osd_op_reply(54 [pgnls start_epoch 91 out=49b] v89'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9e74800 2024-04-02T07:30:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.994+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:55 13.1b 13:d8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e75400 con 0x559ce9e74c00 2024-04-02T07:30:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.994+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.4 v2:172.21.15.106:6801/27677 9 ==== osd_op_reply(55 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559ce9e74c00 2024-04-02T07:30:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.994+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:56 13.3b 13:dc000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9d6bc00 con 0x559ce9e74c00 2024-04-02T07:30:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.994+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.4 v2:172.21.15.106:6801/27677 10 ==== osd_op_reply(56 [pgnls start_epoch 91 out=49b] v89'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559ce9e74c00 2024-04-02T07:30:34.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.994+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:57 13.7 13:e0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e75c00 con 0x559cea9fb400 2024-04-02T07:30:34.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.994+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.7 v2:172.21.15.106:6824/27679 9 ==== osd_op_reply(57 [pgnls start_epoch 91 out=81b] v89'6 uv6 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x559cea842b40 con 0x559cea9fb400 2024-04-02T07:30:34.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.994+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:58 13.7 13:e2e07930:::10000000001.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x559cea9fac00 con 0x559cea9fb400 2024-04-02T07:30:34.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.994+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.7 v2:172.21.15.106:6824/27679 10 ==== osd_op_reply(58 10000000001.00000000 [stat out=16b] v0'0 uv6 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x559cea842b40 con 0x559cea9fb400 2024-04-02T07:30:34.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.994+0000 7faa7e8bc8c0 10 datascan.operator(): handling object 1099511627777.0 2024-04-02T07:30:34.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.994+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:59 13.7 13:e2e07930:::10000000001.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) v8 -- 0x559cea9fa800 con 0x559cea9fb400 2024-04-02T07:30:34.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.994+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.7 v2:172.21.15.106:6824/27679 11 ==== osd_op_reply(59 10000000001.00000000 [call] v91'7 uv7 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x559cea842b40 con 0x559cea9fb400 2024-04-02T07:30:34.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.994+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:60 13.27 13:e4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559cea9fa400 con 0x559ce9e74000 2024-04-02T07:30:34.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.994+0000 7faa7ca00640 1 -- 172.21.15.55:0/2636847706 <== osd.1 v2:172.21.15.55:6809/27391 9 ==== osd_op_reply(60 [pgnls start_epoch 91 out=49b] v89'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842fc0 con 0x559ce9e74000 2024-04-02T07:30:34.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.994+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:61 13.17 13:e8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559cea9fb000 con 0x559ce9e84000 2024-04-02T07:30:35.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.994+0000 7faa7ca00640 1 -- 172.21.15.55:0/2636847706 <== osd.5 v2:172.21.15.106:6800/27676 6 ==== osd_op_reply(61 [pgnls start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842fc0 con 0x559ce9e84000 2024-04-02T07:30:35.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.994+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:62 13.37 13:ec000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e84400 con 0x559ce9e84000 2024-04-02T07:30:35.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7ca00640 1 -- 172.21.15.55:0/2636847706 <== osd.5 v2:172.21.15.106:6800/27676 7 ==== osd_op_reply(62 [pgnls start_epoch 91 out=49b] v89'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842fc0 con 0x559ce9e84000 2024-04-02T07:30:35.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:63 13.f 13:f0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e9a800 con 0x559ce9d6b800 2024-04-02T07:30:35.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.6 v2:172.21.15.106:6816/27678 9 ==== osd_op_reply(63 [pgnls start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9d6b800 2024-04-02T07:30:35.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:64 13.2f 13:f4000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e85800 con 0x559ce9e74c00 2024-04-02T07:30:35.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7c000640 1 -- 172.21.15.55:0/2636847706 <== osd.4 v2:172.21.15.106:6801/27677 11 ==== osd_op_reply(64 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842b40 con 0x559ce9e74c00 2024-04-02T07:30:35.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa77000640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:65 13.1f 13:f8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9d6b400 con 0x559ce9d6b800 2024-04-02T07:30:35.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.6 v2:172.21.15.106:6816/27678 10 ==== osd_op_reply(65 [pgnls start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9d6b800 2024-04-02T07:30:35.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa76600640 1 -- 172.21.15.55:0/2636847706 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:66 13.3f 13:fc000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x559ce9e75000 con 0x559ce9d6b800 2024-04-02T07:30:35.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7d400640 1 -- 172.21.15.55:0/2636847706 <== osd.6 v2:172.21.15.106:6816/27678 11 ==== osd_op_reply(66 [pgnls start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x559cea842d80 con 0x559ce9d6b800 2024-04-02T07:30:35.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x559ce9e85400 msgr2=0x559ce9e6fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x559ce9e85400 0x559ce9e6fb80 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x559ce9e74000 msgr2=0x559ce9e6e580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x559ce9e74000 0x559ce9e6e580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x559ce9e74800 msgr2=0x559ce9e6f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x559ce9e74800 0x559ce9e6f600 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x559ce9e85c00 msgr2=0x559ce9e70100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x559ce9e85c00 0x559ce9e70100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x559ce9e74c00 msgr2=0x559ce9e6eb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x559ce9e74c00 0x559ce9e6eb00 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x559ce9e84000 msgr2=0x559ce9e6f080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x559ce9e84000 0x559ce9e6f080 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x559ce9d6b800 msgr2=0x559ce9e6e000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x559ce9d6b800 0x559ce9e6e000 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x559cea9fb400 msgr2=0x559ce9b08100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x559cea9fb400 0x559ce9b08100 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7ca00640 1 -- 172.21.15.55:0/2636847706 reap_dead start 2024-04-02T07:30:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7ca00640 1 -- 172.21.15.55:0/2636847706 reap_dead start 2024-04-02T07:30:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7ca00640 1 -- 172.21.15.55:0/2636847706 reap_dead start 2024-04-02T07:30:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7ca00640 1 -- 172.21.15.55:0/2636847706 reap_dead start 2024-04-02T07:30:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x559ce9d6a800 msgr2=0x559ce9b09700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x559ce9d6a800 0x559ce9b09700 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x559ce9b8e6f0 tx=0x559cea99dda0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cea9fb800 msgr2=0x559ce9b08680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cea9fb800 0x559ce9b08680 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x559cea97b5f0 tx=0x559cea852c00 comp rx=0 tx=0).stop 2024-04-02T07:30:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/2636847706 shutdown_connections 2024-04-02T07:30:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559cea9fb800 0x559ce9b08680 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/2636847706 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x559ce9d6a800 0x559ce9b09700 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/2636847706 >> 172.21.15.55:0/2636847706 conn(0x559ce9a7ac00 msgr2=0x559ce9aa7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/2636847706 shutdown_connections 2024-04-02T07:30:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/2636847706 wait complete. 2024-04-02T07:30:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/3164993278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559ce9a7b000 msgr2=0x559ce9b07080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/3164993278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559ce9a7b000 0x559ce9b07080 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x559cea8dc9f0 tx=0x559cea805080 comp rx=0 tx=0).stop 2024-04-02T07:30:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/3164993278 shutdown_connections 2024-04-02T07:30:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/3164993278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x559ce9a7b000 0x559ce9b07080 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/3164993278 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x559ce9a7b400 0x559ce9b06b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 --2- 172.21.15.55:0/3164993278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x559ce9a7b800 0x559ce9b06580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/3164993278 >> 172.21.15.55:0/3164993278 conn(0x559ce9a7bc00 msgr2=0x559ce9aa7000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:35.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/3164993278 shutdown_connections 2024-04-02T07:30:35.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:34.998+0000 7faa7e8bc8c0 1 -- 172.21.15.55:0/3164993278 wait complete. 2024-04-02T07:30:35.005 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.105929, result: 2024-04-02T07:30:35.005 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes cephfs_data 2024-04-02T07:30:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f15138488c0 1 -- start start 2024-04-02T07:30:35.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f15138488c0 1 Processor -- start 2024-04-02T07:30:35.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f15138488c0 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa8b039800 0x55fa8b0c4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f15138488c0 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa8b039400 0x55fa8b0c4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f15138488c0 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa8b039000 0x55fa8b0c5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f15138488c0 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8b07fe00 con 0x55fa8b039800 2024-04-02T07:30:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f15138488c0 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8b106a00 con 0x55fa8b039000 2024-04-02T07:30:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f15138488c0 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa8b106640 con 0x55fa8b039400 2024-04-02T07:30:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f1510e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa8b039800 0x55fa8b0c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f1510e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa8b039800 0x55fa8b0c4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57488/0 (socket says 172.21.15.55:57488) 2024-04-02T07:30:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f1510e00640 1 -- 172.21.15.55:0/2123441616 learned_addr learned my addr 172.21.15.55:0/2123441616 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f1511800640 1 --2- 172.21.15.55:0/2123441616 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa8b039000 0x55fa8b0c5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f1510400640 1 --2- 172.21.15.55:0/2123441616 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa8b039400 0x55fa8b0c4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f1510e00640 1 -- 172.21.15.55:0/2123441616 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa8b039400 msgr2=0x55fa8b0c4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f1510e00640 1 --2- 172.21.15.55:0/2123441616 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa8b039400 0x55fa8b0c4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f1510e00640 1 -- 172.21.15.55:0/2123441616 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa8b039000 msgr2=0x55fa8b0c5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f1510e00640 1 --2- 172.21.15.55:0/2123441616 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa8b039000 0x55fa8b0c5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f1510e00640 1 -- 172.21.15.55:0/2123441616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa8b06c9c0 con 0x55fa8b039800 2024-04-02T07:30:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f1510400640 1 --2- 172.21.15.55:0/2123441616 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa8b039400 0x55fa8b0c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:30:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f1510e00640 1 --2- 172.21.15.55:0/2123441616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa8b039800 0x55fa8b0c4580 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x55fa8be99350 tx=0x55fa8bf50540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e10ac96b9259654 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f150dc00640 1 -- 172.21.15.55:0/2123441616 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa8b08d600 con 0x55fa8b039800 2024-04-02T07:30:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f150dc00640 1 -- 172.21.15.55:0/2123441616 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa8b096480 con 0x55fa8b039800 2024-04-02T07:30:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f150dc00640 1 -- 172.21.15.55:0/2123441616 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa8b08d1e0 con 0x55fa8b039800 2024-04-02T07:30:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f15138488c0 1 -- 172.21.15.55:0/2123441616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa8b06cb60 con 0x55fa8b039800 2024-04-02T07:30:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f15138488c0 1 -- 172.21.15.55:0/2123441616 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55fa8b06c340 con 0x55fa8b039800 2024-04-02T07:30:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f15138488c0 4 waiting for MDS map... 2024-04-02T07:30:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f150dc00640 1 -- 172.21.15.55:0/2123441616 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x55fa8b078c40 con 0x55fa8b039800 2024-04-02T07:30:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f150dc00640 1 -- 172.21.15.55:0/2123441616 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 68) v1 ==== 2573+0+0 (secure 0 0 0) 0x55fa8b086f00 con 0x55fa8b039800 2024-04-02T07:30:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.094+0000 7f15138488c0 4 Got MDS map 68 2024-04-02T07:30:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f15138488c0 4 datascan.main: Using metadata pool output 2024-04-02T07:30:35.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f15138488c0 4 datascan.main: connecting to RADOS... 2024-04-02T07:30:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f15138488c0 1 Processor -- start 2024-04-02T07:30:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f15138488c0 1 -- start start 2024-04-02T07:30:35.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f15138488c0 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa8be08c00 0x55fa8b0c5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f15138488c0 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa8be09000 0x55fa8b0c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f15138488c0 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa8be09400 0x55fa8b0c6100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f15138488c0 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8b106500 con 0x55fa8be09000 2024-04-02T07:30:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f15138488c0 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8b1063c0 con 0x55fa8be09400 2024-04-02T07:30:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f15138488c0 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa8b106a00 con 0x55fa8be08c00 2024-04-02T07:30:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f1510e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa8be09000 0x55fa8b0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f1510e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa8be09000 0x55fa8b0c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57494/0 (socket says 172.21.15.55:57494) 2024-04-02T07:30:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f1510e00640 1 -- 172.21.15.55:0/1807209524 learned_addr learned my addr 172.21.15.55:0/1807209524 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f1511800640 1 --2- 172.21.15.55:0/1807209524 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa8be08c00 0x55fa8b0c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f1510400640 1 --2- 172.21.15.55:0/1807209524 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa8be09400 0x55fa8b0c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f1510e00640 1 -- 172.21.15.55:0/1807209524 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa8be08c00 msgr2=0x55fa8b0c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:35.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f1510e00640 1 --2- 172.21.15.55:0/1807209524 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa8be08c00 0x55fa8b0c5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f1510e00640 1 -- 172.21.15.55:0/1807209524 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa8be09400 msgr2=0x55fa8b0c6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f1510e00640 1 --2- 172.21.15.55:0/1807209524 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa8be09400 0x55fa8b0c6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f1510e00640 1 -- 172.21.15.55:0/1807209524 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa8b06c000 con 0x55fa8be09000 2024-04-02T07:30:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f1510400640 1 --2- 172.21.15.55:0/1807209524 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa8be09400 0x55fa8b0c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:30:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f1510e00640 1 --2- 172.21.15.55:0/1807209524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa8be09000 0x55fa8b0c5b80 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x55fa8be99740 tx=0x55fa8bf50060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443d86673590db5e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f150b400640 1 -- 172.21.15.55:0/1807209524 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa8b08cf20 con 0x55fa8be09000 2024-04-02T07:30:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f150b400640 1 -- 172.21.15.55:0/1807209524 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa8bea6300 con 0x55fa8be09000 2024-04-02T07:30:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f150b400640 1 -- 172.21.15.55:0/1807209524 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa8b08d600 con 0x55fa8be09000 2024-04-02T07:30:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f15138488c0 1 -- 172.21.15.55:0/1807209524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa8be09000 msgr2=0x55fa8b0c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f15138488c0 1 --2- 172.21.15.55:0/1807209524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa8be09000 0x55fa8b0c5b80 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x55fa8be99740 tx=0x55fa8bf50060 comp rx=0 tx=0).stop 2024-04-02T07:30:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f15138488c0 1 -- 172.21.15.55:0/1807209524 shutdown_connections 2024-04-02T07:30:35.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f15138488c0 1 --2- 172.21.15.55:0/1807209524 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa8be09400 0x55fa8b0c6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f15138488c0 1 --2- 172.21.15.55:0/1807209524 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa8be09000 0x55fa8b0c5b80 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f15138488c0 1 --2- 172.21.15.55:0/1807209524 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa8be08c00 0x55fa8b0c5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f15138488c0 1 -- 172.21.15.55:0/1807209524 >> 172.21.15.55:0/1807209524 conn(0x55fa8b038c00 msgr2=0x55fa8b063000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:35.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f15138488c0 1 -- 172.21.15.55:0/1807209524 shutdown_connections 2024-04-02T07:30:35.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f15138488c0 1 -- 172.21.15.55:0/1807209524 wait complete. 2024-04-02T07:30:35.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.098+0000 7f15138488c0 1 Processor -- start 2024-04-02T07:30:35.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f15138488c0 1 -- start start 2024-04-02T07:30:35.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f15138488c0 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa8be08c00 0x55fa8b0c7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f15138488c0 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa8be09000 0x55fa8b0c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f15138488c0 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa8be09400 0x55fa8b0c6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f15138488c0 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8b106280 con 0x55fa8be09400 2024-04-02T07:30:35.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f15138488c0 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8b106140 con 0x55fa8be08c00 2024-04-02T07:30:35.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f15138488c0 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa8b106000 con 0x55fa8be09000 2024-04-02T07:30:35.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f1510400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa8be09400 0x55fa8b0c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f1511800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa8be08c00 0x55fa8b0c7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f1510e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa8be09000 0x55fa8b0c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f1510400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa8be09400 0x55fa8b0c6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57500/0 (socket says 172.21.15.55:57500) 2024-04-02T07:30:35.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 learned_addr learned my addr 172.21.15.55:0/1993164656 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:35.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f1511800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa8be08c00 0x55fa8b0c7180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:59326/0 (socket says 172.21.15.55:59326) 2024-04-02T07:30:35.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f1510e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa8be09000 0x55fa8b0c6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:39516/0 (socket says 172.21.15.55:39516) 2024-04-02T07:30:35.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa8be09000 msgr2=0x55fa8b0c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f1511800640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa8be09000 0x55fa8b0c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa8be09400 msgr2=0x55fa8b0c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f1511800640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa8be09400 0x55fa8b0c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa8b06c9c0 con 0x55fa8be08c00 2024-04-02T07:30:35.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f1510e00640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa8be09000 0x55fa8b0c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:30:35.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f1511800640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa8be08c00 0x55fa8b0c7180 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x55fa8be0b5c0 tx=0x55fa8bf6ae40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f1509600640 1 -- 172.21.15.55:0/1993164656 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa8b08cf20 con 0x55fa8be08c00 2024-04-02T07:30:35.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f1509600640 1 -- 172.21.15.55:0/1993164656 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa8bea7680 con 0x55fa8be08c00 2024-04-02T07:30:35.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fa8b06cb60 con 0x55fa8be08c00 2024-04-02T07:30:35.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f1509600640 1 -- 172.21.15.55:0/1993164656 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa8b08d600 con 0x55fa8be08c00 2024-04-02T07:30:35.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa8b06c340 con 0x55fa8be08c00 2024-04-02T07:30:35.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f15138488c0 4 datascan.init: resolving metadata pool 12 2024-04-02T07:30:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.102+0000 7f1509600640 1 -- 172.21.15.55:0/1993164656 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x55fa8b070840 con 0x55fa8be08c00 2024-04-02T07:30:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f1509600640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x55fa8b328c00 0x55fa8b0c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f1509600640 1 -- 172.21.15.55:0/1993164656 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x55fa8b078a80 con 0x55fa8be08c00 2024-04-02T07:30:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f15138488c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-02T07:30:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f15138488c0 4 datascan.main: data pool 'cephfs_data' has ID 13 2024-04-02T07:30:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f15138488c0 4 datascan.main: opening data pool 'cephfs_data' 2024-04-02T07:30:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f15138488c0 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x55fa8be09800 0x55fa8b0c6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:1 12.14 12:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8be09c00 con 0x55fa8be09800 2024-04-02T07:30:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f1510e00640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x55fa8b328c00 0x55fa8b0c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f1510400640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x55fa8be09800 0x55fa8b0c6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f1510e00640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x55fa8b328c00 0x55fa8b0c7700 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x55fa8be99740 tx=0x55fa8bf6ac00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f1510400640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x55fa8be09800 0x55fa8b0c6100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.5 v2:172.21.15.106:6800/27676 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv24 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8be09800 2024-04-02T07:30:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f15138488c0 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x55fa8be09c00 0x55fa8b0c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:2 12.1f 12:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8be07400 con 0x55fa8be09c00 2024-04-02T07:30:35.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f1511800640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x55fa8be09c00 0x55fa8b0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f1511800640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x55fa8be09c00 0x55fa8b0c5b80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f15138488c0 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x55fa8be07000 0x55fa8b0c5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:3 13.0 13:00000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8be06800 con 0x55fa8be07000 2024-04-02T07:30:35.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f1510e00640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x55fa8be07000 0x55fa8b0c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.106+0000 7f1510e00640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x55fa8be07000 0x55fa8b0c5600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.110+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.7 v2:172.21.15.106:6824/27679 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8be07000 2024-04-02T07:30:35.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.110+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:4 13.20 13:04000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b422000 con 0x55fa8be09c00 2024-04-02T07:30:35.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.110+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 2 ==== osd_op_reply(4 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.110+0000 7f150b400640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55fa8b422400 0x55fa8b428000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.110+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:5 13.10 13:08000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b422800 con 0x55fa8b422400 2024-04-02T07:30:35.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.110+0000 7f1510400640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55fa8b422400 0x55fa8b428000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.110+0000 7f1510400640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55fa8b422400 0x55fa8b428000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.110+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.1 v2:172.21.15.55:6809/27391 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b422400 2024-04-02T07:30:35.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.110+0000 7f150aa00640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x55fa8b423000 0x55fa8b428580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.110+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:6 13.30 13:0c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b423400 con 0x55fa8b423000 2024-04-02T07:30:35.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.110+0000 7f1511800640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x55fa8b423000 0x55fa8b428580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.110+0000 7f1511800640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x55fa8b423000 0x55fa8b428580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.110+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 1 ==== osd_op_reply(6 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.110+0000 7f150b400640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x55fa8b422c00 0x55fa8b428b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.110+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:7 13.8 13:10000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b423800 con 0x55fa8b422c00 2024-04-02T07:30:35.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.110+0000 7f1510e00640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x55fa8b422c00 0x55fa8b428b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.110+0000 7f1510e00640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x55fa8b422c00 0x55fa8b428b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.110+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.2 v2:172.21.15.55:6808/27394 1 ==== osd_op_reply(7 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8b422c00 2024-04-02T07:30:35.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.114+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:8 13.28 13:14000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43e000 con 0x55fa8b422c00 2024-04-02T07:30:35.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.114+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.2 v2:172.21.15.55:6808/27394 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8b422c00 2024-04-02T07:30:35.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.114+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:9 13.18 13:18000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b423c00 con 0x55fa8be07000 2024-04-02T07:30:35.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.114+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.7 v2:172.21.15.106:6824/27679 2 ==== osd_op_reply(9 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8be07000 2024-04-02T07:30:35.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.114+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:10 13.38 13:1c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43e400 con 0x55fa8be09800 2024-04-02T07:30:35.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.114+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.5 v2:172.21.15.106:6800/27676 2 ==== osd_op_reply(10 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8be09800 2024-04-02T07:30:35.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.114+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:11 13.4 13:20000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8be06800 con 0x55fa8be09c00 2024-04-02T07:30:35.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.114+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 3 ==== osd_op_reply(11 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.114+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:12 13.24 13:24000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43e800 con 0x55fa8be09c00 2024-04-02T07:30:35.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.114+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 4 ==== osd_op_reply(12 [pgnls-filter start_epoch 91 out=49b] v89'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.114+0000 7f150b400640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x55fa8b329c00 0x55fa8b429080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.114+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:13 13.14 13:28000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b329800 con 0x55fa8b329c00 2024-04-02T07:30:35.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.114+0000 7f1510400640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x55fa8b329c00 0x55fa8b429080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.114+0000 7f1510400640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x55fa8b329c00 0x55fa8b429080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.114+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.0 v2:172.21.15.55:6800/27392 1 ==== osd_op_reply(13 [pgnls-filter start_epoch 91 out=49b] v89'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b329c00 2024-04-02T07:30:35.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.114+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:14 13.34 13:2c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b422000 con 0x55fa8be09c00 2024-04-02T07:30:35.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.114+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 5 ==== osd_op_reply(14 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.114+0000 7f150b400640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55fa8b329400 0x55fa8b429600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.114+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:15 13.c 13:30000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43e000 con 0x55fa8b329400 2024-04-02T07:30:35.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.114+0000 7f1511800640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55fa8b329400 0x55fa8b429600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f1511800640 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55fa8b329400 0x55fa8b429600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.3 v2:172.21.15.55:6824/27393 1 ==== osd_op_reply(15 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b329400 2024-04-02T07:30:35.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:16 13.2c 13:34000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b423400 con 0x55fa8b422c00 2024-04-02T07:30:35.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.2 v2:172.21.15.55:6808/27394 3 ==== osd_op_reply(16 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8b422c00 2024-04-02T07:30:35.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:17 13.1c 13:38000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43ec00 con 0x55fa8be09c00 2024-04-02T07:30:35.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 6 ==== osd_op_reply(17 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:18 13.3c 13:3c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8be07400 con 0x55fa8b422c00 2024-04-02T07:30:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.2 v2:172.21.15.55:6808/27394 4 ==== osd_op_reply(18 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8b422c00 2024-04-02T07:30:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:19 13.2 13:40000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43f000 con 0x55fa8be09800 2024-04-02T07:30:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.5 v2:172.21.15.106:6800/27676 3 ==== osd_op_reply(19 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8be09800 2024-04-02T07:30:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:20 13.22 13:44000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8be06800 con 0x55fa8b422400 2024-04-02T07:30:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.1 v2:172.21.15.55:6809/27391 2 ==== osd_op_reply(20 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b422400 2024-04-02T07:30:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:21 13.12 13:48000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43f400 con 0x55fa8b329c00 2024-04-02T07:30:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.0 v2:172.21.15.55:6800/27392 2 ==== osd_op_reply(21 [pgnls-filter start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b329c00 2024-04-02T07:30:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:22 13.32 13:4c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43e400 con 0x55fa8b422c00 2024-04-02T07:30:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.2 v2:172.21.15.55:6808/27394 5 ==== osd_op_reply(22 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8b422c00 2024-04-02T07:30:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:23 13.a 13:50000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b423800 con 0x55fa8b422c00 2024-04-02T07:30:35.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.2 v2:172.21.15.55:6808/27394 6 ==== osd_op_reply(23 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8b422c00 2024-04-02T07:30:35.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:24 13.2a 13:54000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43f000 con 0x55fa8b422400 2024-04-02T07:30:35.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.1 v2:172.21.15.55:6809/27391 3 ==== osd_op_reply(24 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b422400 2024-04-02T07:30:35.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.118+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:25 13.1a 13:58000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43f400 con 0x55fa8b422400 2024-04-02T07:30:35.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.1 v2:172.21.15.55:6809/27391 4 ==== osd_op_reply(25 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b422400 2024-04-02T07:30:35.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:26 13.3a 13:5c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8be06800 con 0x55fa8be09800 2024-04-02T07:30:35.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.5 v2:172.21.15.106:6800/27676 4 ==== osd_op_reply(26 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8be09800 2024-04-02T07:30:35.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:27 13.6 13:60000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43f800 con 0x55fa8b423000 2024-04-02T07:30:35.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 2 ==== osd_op_reply(27 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:28 13.26 13:64000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b329800 con 0x55fa8be07000 2024-04-02T07:30:35.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.7 v2:172.21.15.106:6824/27679 3 ==== osd_op_reply(28 [pgnls-filter start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8be07000 2024-04-02T07:30:35.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:29 13.16 13:68000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43fc00 con 0x55fa8b329400 2024-04-02T07:30:35.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.3 v2:172.21.15.55:6824/27393 2 ==== osd_op_reply(29 [pgnls-filter start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b329400 2024-04-02T07:30:35.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:30 13.36 13:6c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b422800 con 0x55fa8be09c00 2024-04-02T07:30:35.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 7 ==== osd_op_reply(30 [pgnls-filter start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:31 13.e 13:70000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43e800 con 0x55fa8be07000 2024-04-02T07:30:35.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.7 v2:172.21.15.106:6824/27679 4 ==== osd_op_reply(31 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8be07000 2024-04-02T07:30:35.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:32 13.2e 13:74000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43e400 con 0x55fa8b422c00 2024-04-02T07:30:35.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.2 v2:172.21.15.55:6808/27394 7 ==== osd_op_reply(32 [pgnls-filter start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8b422c00 2024-04-02T07:30:35.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:33 13.1e 13:78000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43e000 con 0x55fa8b423000 2024-04-02T07:30:35.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 3 ==== osd_op_reply(33 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:34 13.3e 13:7c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b329800 con 0x55fa8b422400 2024-04-02T07:30:35.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.1 v2:172.21.15.55:6809/27391 5 ==== osd_op_reply(34 [pgnls-filter start_epoch 91 out=49b] v89'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b422400 2024-04-02T07:30:35.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:35 13.1 13:80000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43ec00 con 0x55fa8be09c00 2024-04-02T07:30:35.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 8 ==== osd_op_reply(35 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.122+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:36 13.21 13:84000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b423c00 con 0x55fa8b423000 2024-04-02T07:30:35.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 91 out=49b] v89'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:37 13.11 13:88000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43f800 con 0x55fa8b422400 2024-04-02T07:30:35.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.1 v2:172.21.15.55:6809/27391 6 ==== osd_op_reply(37 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b422400 2024-04-02T07:30:35.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:38 13.31 13:8c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b423400 con 0x55fa8b329400 2024-04-02T07:30:35.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.3 v2:172.21.15.55:6824/27393 3 ==== osd_op_reply(38 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b329400 2024-04-02T07:30:35.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:39 13.9 13:90000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b422000 con 0x55fa8be09800 2024-04-02T07:30:35.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.5 v2:172.21.15.106:6800/27676 5 ==== osd_op_reply(39 [pgnls-filter start_epoch 91 out=49b] v89'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8be09800 2024-04-02T07:30:35.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:40 13.29 13:94000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b423800 con 0x55fa8be09c00 2024-04-02T07:30:35.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 9 ==== osd_op_reply(40 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:41 13.19 13:98000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43fc00 con 0x55fa8b329400 2024-04-02T07:30:35.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.3 v2:172.21.15.55:6824/27393 4 ==== osd_op_reply(41 [pgnls-filter start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b329400 2024-04-02T07:30:35.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:42 13.39 13:9c000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8be07400 con 0x55fa8b422c00 2024-04-02T07:30:35.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.2 v2:172.21.15.55:6808/27394 8 ==== osd_op_reply(42 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8b422c00 2024-04-02T07:30:35.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:43 13.5 13:a0000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43e000 con 0x55fa8b423000 2024-04-02T07:30:35.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 5 ==== osd_op_reply(43 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:44 13.25 13:a4000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44e000 con 0x55fa8b423000 2024-04-02T07:30:35.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 6 ==== osd_op_reply(44 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:45 13.15 13:a8000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43ec00 con 0x55fa8b423000 2024-04-02T07:30:35.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 7 ==== osd_op_reply(45 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:46 13.35 13:ac000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44e400 con 0x55fa8b422400 2024-04-02T07:30:35.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.126+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.1 v2:172.21.15.55:6809/27391 7 ==== osd_op_reply(46 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b422400 2024-04-02T07:30:35.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:47 13.d 13:b0000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43e800 con 0x55fa8b423000 2024-04-02T07:30:35.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 8 ==== osd_op_reply(47 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:48 13.2d 13:b4000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44e800 con 0x55fa8b329c00 2024-04-02T07:30:35.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.0 v2:172.21.15.55:6800/27392 3 ==== osd_op_reply(48 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b329c00 2024-04-02T07:30:35.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:49 13.1d 13:b8000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b422800 con 0x55fa8be07000 2024-04-02T07:30:35.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.7 v2:172.21.15.106:6824/27679 5 ==== osd_op_reply(49 [pgnls-filter start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8be07000 2024-04-02T07:30:35.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:50 13.3d 13:bc000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44ec00 con 0x55fa8be07000 2024-04-02T07:30:35.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.7 v2:172.21.15.106:6824/27679 6 ==== osd_op_reply(50 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8be07000 2024-04-02T07:30:35.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:51 13.3 13:c0000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b423c00 con 0x55fa8b329c00 2024-04-02T07:30:35.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.0 v2:172.21.15.55:6800/27392 4 ==== osd_op_reply(51 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b329c00 2024-04-02T07:30:35.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:52 13.23 13:c4000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44f000 con 0x55fa8b422400 2024-04-02T07:30:35.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.1 v2:172.21.15.55:6809/27391 8 ==== osd_op_reply(52 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b422400 2024-04-02T07:30:35.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:53 13.13 13:c8000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b423400 con 0x55fa8be07000 2024-04-02T07:30:35.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.7 v2:172.21.15.106:6824/27679 7 ==== osd_op_reply(53 [pgnls-filter start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8be07000 2024-04-02T07:30:35.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:54 13.33 13:cc000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44f400 con 0x55fa8be07000 2024-04-02T07:30:35.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.7 v2:172.21.15.106:6824/27679 8 ==== osd_op_reply(54 [pgnls-filter start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8be07000 2024-04-02T07:30:35.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:55 13.b 13:d0000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44e400 con 0x55fa8be09800 2024-04-02T07:30:35.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.5 v2:172.21.15.106:6800/27676 6 ==== osd_op_reply(55 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8be09800 2024-04-02T07:30:35.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:56 13.2b 13:d4000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44f800 con 0x55fa8b422c00 2024-04-02T07:30:35.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.2 v2:172.21.15.55:6808/27394 9 ==== osd_op_reply(56 [pgnls-filter start_epoch 91 out=49b] v89'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8b422c00 2024-04-02T07:30:35.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.130+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:57 13.1b 13:d8000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44fc00 con 0x55fa8b423000 2024-04-02T07:30:35.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.134+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 9 ==== osd_op_reply(57 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.134+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:58 13.3b 13:dc000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44e000 con 0x55fa8b423000 2024-04-02T07:30:35.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.134+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 10 ==== osd_op_reply(58 [pgnls-filter start_epoch 91 out=49b] v89'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.134+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:59 13.7 13:e0000000::::head [pgnls-filter start_epoch 91 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b422000 con 0x55fa8be07000 2024-04-02T07:30:35.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.134+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.7 v2:172.21.15.106:6824/27679 9 ==== osd_op_reply(59 [pgnls-filter start_epoch 91 out=81b] v91'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8be07000 2024-04-02T07:30:35.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.134+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:60 13.0 13:00000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8be06c00 con 0x55fa8be07000 2024-04-02T07:30:35.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.134+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.7 v2:172.21.15.106:6824/27679 10 ==== osd_op_reply(60 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8be07000 2024-04-02T07:30:35.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.134+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:61 13.20 13:04000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43f000 con 0x55fa8be09c00 2024-04-02T07:30:35.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.134+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 10 ==== osd_op_reply(61 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.134+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:62 13.10 13:08000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44fc00 con 0x55fa8b422400 2024-04-02T07:30:35.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.134+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.1 v2:172.21.15.55:6809/27391 9 ==== osd_op_reply(62 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b422400 2024-04-02T07:30:35.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.134+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:63 13.30 13:0c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43f400 con 0x55fa8b423000 2024-04-02T07:30:35.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.134+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 11 ==== osd_op_reply(63 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.134+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:64 13.8 13:10000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43fc00 con 0x55fa8b422c00 2024-04-02T07:30:35.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.134+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.2 v2:172.21.15.55:6808/27394 10 ==== osd_op_reply(64 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8b422c00 2024-04-02T07:30:35.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.134+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:65 13.28 13:14000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43f800 con 0x55fa8b422c00 2024-04-02T07:30:35.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.134+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.2 v2:172.21.15.55:6808/27394 11 ==== osd_op_reply(65 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8b422c00 2024-04-02T07:30:35.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.134+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:66 13.18 13:18000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43e000 con 0x55fa8be07000 2024-04-02T07:30:35.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.7 v2:172.21.15.106:6824/27679 11 ==== osd_op_reply(66 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8be07000 2024-04-02T07:30:35.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:67 13.38 13:1c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b329800 con 0x55fa8be09800 2024-04-02T07:30:35.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.5 v2:172.21.15.106:6800/27676 7 ==== osd_op_reply(67 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8be09800 2024-04-02T07:30:35.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:68 13.4 13:20000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43ec00 con 0x55fa8be09c00 2024-04-02T07:30:35.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 11 ==== osd_op_reply(68 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:69 13.24 13:24000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8be06800 con 0x55fa8be09c00 2024-04-02T07:30:35.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 12 ==== osd_op_reply(69 [pgnls-filter start_epoch 91 out=49b] v89'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:70 13.14 13:28000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43e800 con 0x55fa8b329c00 2024-04-02T07:30:35.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.0 v2:172.21.15.55:6800/27392 5 ==== osd_op_reply(70 [pgnls-filter start_epoch 91 out=49b] v89'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b329c00 2024-04-02T07:30:35.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:71 13.34 13:2c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b422800 con 0x55fa8be09c00 2024-04-02T07:30:35.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 13 ==== osd_op_reply(71 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:72 13.c 13:30000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b423800 con 0x55fa8b329400 2024-04-02T07:30:35.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.3 v2:172.21.15.55:6824/27393 5 ==== osd_op_reply(72 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b329400 2024-04-02T07:30:35.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:73 13.2c 13:34000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b423400 con 0x55fa8b422c00 2024-04-02T07:30:35.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.2 v2:172.21.15.55:6808/27394 12 ==== osd_op_reply(73 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8b422c00 2024-04-02T07:30:35.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:74 13.1c 13:38000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b45a000 con 0x55fa8be09c00 2024-04-02T07:30:35.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 14 ==== osd_op_reply(74 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:75 13.3c 13:3c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b422000 con 0x55fa8b422c00 2024-04-02T07:30:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.2 v2:172.21.15.55:6808/27394 13 ==== osd_op_reply(75 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8b422c00 2024-04-02T07:30:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:76 13.2 13:40000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b45a400 con 0x55fa8be09800 2024-04-02T07:30:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.5 v2:172.21.15.106:6800/27676 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8be09800 2024-04-02T07:30:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:77 13.22 13:44000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44ec00 con 0x55fa8b422400 2024-04-02T07:30:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.1 v2:172.21.15.55:6809/27391 10 ==== osd_op_reply(77 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b422400 2024-04-02T07:30:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.138+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:78 13.12 13:48000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b45a800 con 0x55fa8b329c00 2024-04-02T07:30:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.0 v2:172.21.15.55:6800/27392 6 ==== osd_op_reply(78 [pgnls-filter start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b329c00 2024-04-02T07:30:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:79 13.32 13:4c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44f400 con 0x55fa8b422c00 2024-04-02T07:30:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.2 v2:172.21.15.55:6808/27394 14 ==== osd_op_reply(79 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8b422c00 2024-04-02T07:30:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:80 13.a 13:50000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b45ac00 con 0x55fa8b422c00 2024-04-02T07:30:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.2 v2:172.21.15.55:6808/27394 15 ==== osd_op_reply(80 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8b422c00 2024-04-02T07:30:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:81 13.2a 13:54000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44f800 con 0x55fa8b422400 2024-04-02T07:30:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.1 v2:172.21.15.55:6809/27391 11 ==== osd_op_reply(81 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b422400 2024-04-02T07:30:35.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:82 13.1a 13:58000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b45b000 con 0x55fa8b422400 2024-04-02T07:30:35.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.1 v2:172.21.15.55:6809/27391 12 ==== osd_op_reply(82 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b422400 2024-04-02T07:30:35.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:83 13.3a 13:5c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8be07400 con 0x55fa8be09800 2024-04-02T07:30:35.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.5 v2:172.21.15.106:6800/27676 9 ==== osd_op_reply(83 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8be09800 2024-04-02T07:30:35.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:84 13.6 13:60000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b45b400 con 0x55fa8b423000 2024-04-02T07:30:35.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 12 ==== osd_op_reply(84 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:85 13.26 13:64000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b43e400 con 0x55fa8be07000 2024-04-02T07:30:35.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.7 v2:172.21.15.106:6824/27679 12 ==== osd_op_reply(85 [pgnls-filter start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8be07000 2024-04-02T07:30:35.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:86 13.16 13:68000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b45b800 con 0x55fa8b329400 2024-04-02T07:30:35.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.3 v2:172.21.15.55:6824/27393 6 ==== osd_op_reply(86 [pgnls-filter start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b329400 2024-04-02T07:30:35.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:87 13.36 13:6c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b423400 con 0x55fa8be09c00 2024-04-02T07:30:35.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 15 ==== osd_op_reply(87 [pgnls-filter start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:88 13.e 13:70000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b45bc00 con 0x55fa8be07000 2024-04-02T07:30:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.7 v2:172.21.15.106:6824/27679 13 ==== osd_op_reply(88 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8be07000 2024-04-02T07:30:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:89 13.2e 13:74000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b422000 con 0x55fa8b422c00 2024-04-02T07:30:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.2 v2:172.21.15.55:6808/27394 16 ==== osd_op_reply(89 [pgnls-filter start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8b422c00 2024-04-02T07:30:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.142+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:90 13.1e 13:78000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b45ac00 con 0x55fa8b423000 2024-04-02T07:30:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.146+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 13 ==== osd_op_reply(90 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.146+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:91 13.3e 13:7c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8be06c00 con 0x55fa8b422400 2024-04-02T07:30:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.146+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.1 v2:172.21.15.55:6809/27391 13 ==== osd_op_reply(91 [pgnls-filter start_epoch 91 out=49b] v89'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b422400 2024-04-02T07:30:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.146+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:92 13.1 13:80000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b45a400 con 0x55fa8be09c00 2024-04-02T07:30:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.146+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 16 ==== osd_op_reply(92 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.146+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:93 13.21 13:84000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8be06800 con 0x55fa8b423000 2024-04-02T07:30:35.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.146+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 14 ==== osd_op_reply(93 [pgnls-filter start_epoch 91 out=49b] v89'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.146+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:94 13.11 13:88000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b45a000 con 0x55fa8b422400 2024-04-02T07:30:35.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.146+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.1 v2:172.21.15.55:6809/27391 14 ==== osd_op_reply(94 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b422400 2024-04-02T07:30:35.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.146+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:95 13.31 13:8c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44f400 con 0x55fa8b329400 2024-04-02T07:30:35.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.146+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.3 v2:172.21.15.55:6824/27393 7 ==== osd_op_reply(95 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b329400 2024-04-02T07:30:35.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.146+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:96 13.9 13:90000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b423c00 con 0x55fa8be09800 2024-04-02T07:30:35.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.146+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.5 v2:172.21.15.106:6800/27676 10 ==== osd_op_reply(96 [pgnls-filter start_epoch 91 out=49b] v89'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8be09800 2024-04-02T07:30:35.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.146+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:97 13.29 13:94000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44e800 con 0x55fa8be09c00 2024-04-02T07:30:35.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.146+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 17 ==== osd_op_reply(97 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.146+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:98 13.19 13:98000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b422800 con 0x55fa8b329400 2024-04-02T07:30:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.146+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.3 v2:172.21.15.55:6824/27393 8 ==== osd_op_reply(98 [pgnls-filter start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b329400 2024-04-02T07:30:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.146+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:99 13.39 13:9c000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44f000 con 0x55fa8b422c00 2024-04-02T07:30:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.146+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.2 v2:172.21.15.55:6808/27394 17 ==== osd_op_reply(99 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8b422c00 2024-04-02T07:30:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.146+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:100 13.5 13:a0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b423800 con 0x55fa8b423000 2024-04-02T07:30:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 15 ==== osd_op_reply(100 [pgnls-filter start_epoch 91 out=49b] v89'5 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:101 13.25 13:a4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44e400 con 0x55fa8b423000 2024-04-02T07:30:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 16 ==== osd_op_reply(101 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:102 13.15 13:a8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b423400 con 0x55fa8b423000 2024-04-02T07:30:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 17 ==== osd_op_reply(102 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:103 13.35 13:ac000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44fc00 con 0x55fa8b422400 2024-04-02T07:30:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.1 v2:172.21.15.55:6809/27391 15 ==== osd_op_reply(103 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b422400 2024-04-02T07:30:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:104 13.d 13:b0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b422800 con 0x55fa8b423000 2024-04-02T07:30:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 18 ==== osd_op_reply(104 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:105 13.2d 13:b4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44e000 con 0x55fa8b329c00 2024-04-02T07:30:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.0 v2:172.21.15.55:6800/27392 7 ==== osd_op_reply(105 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b329c00 2024-04-02T07:30:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:106 13.1d 13:b8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44f400 con 0x55fa8be07000 2024-04-02T07:30:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.7 v2:172.21.15.106:6824/27679 14 ==== osd_op_reply(106 [pgnls-filter start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8be07000 2024-04-02T07:30:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:107 13.3d 13:bc000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b329800 con 0x55fa8be07000 2024-04-02T07:30:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.7 v2:172.21.15.106:6824/27679 15 ==== osd_op_reply(107 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8be07000 2024-04-02T07:30:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:108 13.3 13:c0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44e800 con 0x55fa8b329c00 2024-04-02T07:30:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.0 v2:172.21.15.55:6800/27392 8 ==== osd_op_reply(108 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b329c00 2024-04-02T07:30:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:109 13.23 13:c4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44ec00 con 0x55fa8b422400 2024-04-02T07:30:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.1 v2:172.21.15.55:6809/27391 16 ==== osd_op_reply(109 [pgnls-filter start_epoch 91 out=49b] v89'7 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b422400 2024-04-02T07:30:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:110 13.13 13:c8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8be06800 con 0x55fa8be07000 2024-04-02T07:30:35.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.7 v2:172.21.15.106:6824/27679 16 ==== osd_op_reply(110 [pgnls-filter start_epoch 91 out=49b] v89'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8be07000 2024-04-02T07:30:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:111 13.33 13:cc000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44f800 con 0x55fa8be07000 2024-04-02T07:30:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.7 v2:172.21.15.106:6824/27679 17 ==== osd_op_reply(111 [pgnls-filter start_epoch 91 out=49b] v89'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8be07000 2024-04-02T07:30:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.150+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:112 13.b 13:d0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b45b400 con 0x55fa8be09800 2024-04-02T07:30:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.5 v2:172.21.15.106:6800/27676 11 ==== osd_op_reply(112 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8be09800 2024-04-02T07:30:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:113 13.2b 13:d4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b44fc00 con 0x55fa8b422c00 2024-04-02T07:30:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.2 v2:172.21.15.55:6808/27394 18 ==== osd_op_reply(113 [pgnls-filter start_epoch 91 out=49b] v89'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8b422c00 2024-04-02T07:30:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:114 13.1b 13:d8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b45b800 con 0x55fa8b423000 2024-04-02T07:30:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 19 ==== osd_op_reply(114 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:115 13.3b 13:dc000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b423c00 con 0x55fa8b423000 2024-04-02T07:30:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 20 ==== osd_op_reply(115 [pgnls-filter start_epoch 91 out=49b] v89'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:116 13.7 13:e0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b45ac00 con 0x55fa8be07000 2024-04-02T07:30:35.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.7 v2:172.21.15.106:6824/27679 18 ==== osd_op_reply(116 [pgnls-filter start_epoch 91 out=81b] v91'7 uv7 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8be07000 2024-04-02T07:30:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f15138488c0 20 datascan.forall_objects: OSD matched oid 10000000001.00000000 2024-04-02T07:30:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f15138488c0 10 datascan.operator(): handling object 10000000001.0 2024-04-02T07:30:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:117 13.7 13:e2e07930:::10000000001.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b462000 con 0x55fa8be07000 2024-04-02T07:30:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f1510e00640 1 -- 172.21.15.55:0/1993164656 <== osd.7 v2:172.21.15.106:6824/27679 19 ==== osd_op_reply(117 10000000001.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (89) out=89b,getxattr (30) out=30b,getxattr] v0'0 uv7 ondisk = 0) v8 ==== 416+0+157 (crc 0 0 0) 0x55fa8bf36fc0 con 0x55fa8be07000 2024-04-02T07:30:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f15138488c0 10 datascan.inject_with_backtrace: inode: 0x0x10000000001 2024-04-02T07:30:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f15138488c0 10 datascan.inject_with_backtrace: backptr: 0x0x10000000000/file 2024-04-02T07:30:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f15138488c0 20 datascan.get_frag_of: dirino=0x10000000000 target_dname=file 2024-04-02T07:30:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:118 12.10 12:0cf6ad0f:::10000000000.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b462400 con 0x55fa8b329c00 2024-04-02T07:30:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.0 v2:172.21.15.55:6800/27392 9 ==== osd_op_reply(118 10000000000.00000000 [getxattr (59) out=59b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+59 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b329c00 2024-04-02T07:30:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f15138488c0 20 datascan.get_frag_of: got backtrace parent 0x1/dir 2024-04-02T07:30:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:119 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-vals-by-keys in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b462800 con 0x55fa8be09c00 2024-04-02T07:30:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 18 ==== osd_op_reply(119 1.00000000 [omap-get-vals-by-keys out=520b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+520 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f15138488c0 20 datascan.read_dentry: oid=1.00000000 dname=dir frag=*, r=0 2024-04-02T07:30:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f15138488c0 20 datascan.get_frag_of: fast path, fragtree is fragtree_t() 2024-04-02T07:30:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f15138488c0 20 datascan.get_frag_of: frag is * 2024-04-02T07:30:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:120 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b462c00 con 0x55fa8b329c00 2024-04-02T07:30:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.0 v2:172.21.15.55:6800/27392 10 ==== osd_op_reply(120 10000000000.00000000 [omap-get-header out=274b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b329c00 2024-04-02T07:30:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f15138488c0 10 datascan.find_or_create_dirfrag: read_version = 17 2024-04-02T07:30:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f15138488c0 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000000 * 2024-04-02T07:30:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:121 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b463000 con 0x55fa8b329c00 2024-04-02T07:30:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.0 v2:172.21.15.55:6800/27392 11 ==== osd_op_reply(121 10000000000.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b329c00 2024-04-02T07:30:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f15138488c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-02T07:30:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f15138488c0 20 datascan.read_dentry: file_head not found in result 2024-04-02T07:30:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f15138488c0 10 datascan.inject_with_backtrace: Linking inode 0x0x10000000001 at 0x0x10000000000/file with size=0 bytes 2024-04-02T07:30:35.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.154+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:122 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b463400 con 0x55fa8b329c00 2024-04-02T07:30:35.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.0 v2:172.21.15.55:6800/27392 12 ==== osd_op_reply(122 10000000000.00000000 [omap-set-vals] v91'18 uv18 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b329c00 2024-04-02T07:30:35.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f15138488c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-02T07:30:35.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:123 13.27 13:e4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b463800 con 0x55fa8b422400 2024-04-02T07:30:35.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.1 v2:172.21.15.55:6809/27391 17 ==== osd_op_reply(123 [pgnls-filter start_epoch 91 out=49b] v89'2 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8b422400 2024-04-02T07:30:35.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:124 13.17 13:e8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b45a400 con 0x55fa8be09800 2024-04-02T07:30:35.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.5 v2:172.21.15.106:6800/27676 12 ==== osd_op_reply(124 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8be09800 2024-04-02T07:30:35.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:125 13.37 13:ec000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b45a800 con 0x55fa8be09800 2024-04-02T07:30:35.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 <== osd.5 v2:172.21.15.106:6800/27676 13 ==== osd_op_reply(125 [pgnls-filter start_epoch 91 out=49b] v89'11 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36b40 con 0x55fa8be09800 2024-04-02T07:30:35.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:126 13.f 13:f0000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b45b400 con 0x55fa8be09c00 2024-04-02T07:30:35.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 19 ==== osd_op_reply(126 [pgnls-filter start_epoch 91 out=49b] v89'9 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:127 13.2f 13:f4000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b45b000 con 0x55fa8b423000 2024-04-02T07:30:35.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.4 v2:172.21.15.106:6801/27677 21 ==== osd_op_reply(127 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8b423000 2024-04-02T07:30:35.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f150aa00640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:128 13.1f 13:f8000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b45a400 con 0x55fa8be09c00 2024-04-02T07:30:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 20 ==== osd_op_reply(128 [pgnls-filter start_epoch 91 out=49b] v89'6 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f150b400640 1 -- 172.21.15.55:0/1993164656 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:129 13.3f 13:fc000000::::head [pgnls-filter start_epoch 91 in=85b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55fa8b45a000 con 0x55fa8be09c00 2024-04-02T07:30:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f1511800640 1 -- 172.21.15.55:0/1993164656 <== osd.6 v2:172.21.15.106:6816/27678 21 ==== osd_op_reply(129 [pgnls-filter start_epoch 91 out=49b] v89'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55fa8bf36d80 con 0x55fa8be09c00 2024-04-02T07:30:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x55fa8b329c00 msgr2=0x55fa8b429080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f15138488c0 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x55fa8b329c00 0x55fa8b429080 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55fa8b422400 msgr2=0x55fa8b428000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f15138488c0 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55fa8b422400 0x55fa8b428000 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x55fa8b422c00 msgr2=0x55fa8b428b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f15138488c0 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x55fa8b422c00 0x55fa8b428b00 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55fa8b329400 msgr2=0x55fa8b429600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f15138488c0 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55fa8b329400 0x55fa8b429600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x55fa8b423000 msgr2=0x55fa8b428580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f15138488c0 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x55fa8b423000 0x55fa8b428580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x55fa8be09800 msgr2=0x55fa8b0c6100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f15138488c0 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x55fa8be09800 0x55fa8b0c6100 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x55fa8be09c00 msgr2=0x55fa8b0c5b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f15138488c0 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x55fa8be09c00 0x55fa8b0c5b80 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x55fa8be07000 msgr2=0x55fa8b0c5600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.158+0000 7f15138488c0 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x55fa8be07000 0x55fa8b0c5600 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 reap_dead start 2024-04-02T07:30:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 reap_dead start 2024-04-02T07:30:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f1510400640 1 -- 172.21.15.55:0/1993164656 reap_dead start 2024-04-02T07:30:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x55fa8b328c00 msgr2=0x55fa8b0c7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f15138488c0 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x55fa8b328c00 0x55fa8b0c7700 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x55fa8be99740 tx=0x55fa8bf6ac00 comp rx=0 tx=0).stop 2024-04-02T07:30:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa8be08c00 msgr2=0x55fa8b0c7180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f15138488c0 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa8be08c00 0x55fa8b0c7180 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x55fa8be0b5c0 tx=0x55fa8bf6ae40 comp rx=0 tx=0).stop 2024-04-02T07:30:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 shutdown_connections 2024-04-02T07:30:35.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f15138488c0 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x55fa8b328c00 0x55fa8b0c7700 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f15138488c0 1 --2- 172.21.15.55:0/1993164656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa8be08c00 0x55fa8b0c7180 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 >> 172.21.15.55:0/1993164656 conn(0x55fa8b038c00 msgr2=0x55fa8b063000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 shutdown_connections 2024-04-02T07:30:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f15138488c0 1 -- 172.21.15.55:0/1993164656 wait complete. 2024-04-02T07:30:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f15138488c0 1 -- 172.21.15.55:0/2123441616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa8b039800 msgr2=0x55fa8b0c4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f15138488c0 1 --2- 172.21.15.55:0/2123441616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa8b039800 0x55fa8b0c4580 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x55fa8be99350 tx=0x55fa8bf50540 comp rx=0 tx=0).stop 2024-04-02T07:30:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f15138488c0 1 -- 172.21.15.55:0/2123441616 shutdown_connections 2024-04-02T07:30:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f15138488c0 1 --2- 172.21.15.55:0/2123441616 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa8b039000 0x55fa8b0c5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f15138488c0 1 --2- 172.21.15.55:0/2123441616 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa8b039400 0x55fa8b0c4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f15138488c0 1 --2- 172.21.15.55:0/2123441616 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa8b039800 0x55fa8b0c4580 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f15138488c0 1 -- 172.21.15.55:0/2123441616 >> 172.21.15.55:0/2123441616 conn(0x55fa8b039c00 msgr2=0x55fa8b063800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f15138488c0 1 -- 172.21.15.55:0/2123441616 shutdown_connections 2024-04-02T07:30:35.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.162+0000 7f15138488c0 1 -- 172.21.15.55:0/2123441616 wait complete. 2024-04-02T07:30:35.171 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', 'cephfs_data'] in time 0:00:00.165933, result: 2024-04-02T07:30:35.172 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-04-02T07:30:35.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.210+0000 7faf9fe498c0 1 -- start start 2024-04-02T07:30:35.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.210+0000 7faf9fe498c0 1 Processor -- start 2024-04-02T07:30:35.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9fe498c0 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592e153800 0x55592e1de580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9fe498c0 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55592e153400 0x55592e1deb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9fe498c0 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55592e153000 0x55592e1df080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9fe498c0 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55592e199e00 con 0x55592e153800 2024-04-02T07:30:35.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9fe498c0 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55592e220a00 con 0x55592e153000 2024-04-02T07:30:35.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9fe498c0 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55592e220640 con 0x55592e153400 2024-04-02T07:30:35.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592e153800 0x55592e1de580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592e153800 0x55592e1de580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57506/0 (socket says 172.21.15.55:57506) 2024-04-02T07:30:35.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9d400640 1 -- 172.21.15.55:0/17206715 learned_addr learned my addr 172.21.15.55:0/17206715 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:35.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9de00640 1 --2- 172.21.15.55:0/17206715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55592e153000 0x55592e1df080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9ca00640 1 --2- 172.21.15.55:0/17206715 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55592e153400 0x55592e1deb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9d400640 1 -- 172.21.15.55:0/17206715 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55592e153400 msgr2=0x55592e1deb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:35.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9d400640 1 --2- 172.21.15.55:0/17206715 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55592e153400 0x55592e1deb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9d400640 1 -- 172.21.15.55:0/17206715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55592e153000 msgr2=0x55592e1df080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:35.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9d400640 1 --2- 172.21.15.55:0/17206715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55592e153000 0x55592e1df080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9d400640 1 -- 172.21.15.55:0/17206715 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55592e1869c0 con 0x55592e153800 2024-04-02T07:30:35.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9ca00640 1 --2- 172.21.15.55:0/17206715 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55592e153400 0x55592e1deb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:30:35.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9de00640 1 --2- 172.21.15.55:0/17206715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55592e153000 0x55592e1df080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:30:35.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9d400640 1 --2- 172.21.15.55:0/17206715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592e153800 0x55592e1de580 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x55592efb29c0 tx=0x55592f060120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fa9af585be381 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9a200640 1 -- 172.21.15.55:0/17206715 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55592e1a7080 con 0x55592e153800 2024-04-02T07:30:35.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9a200640 1 -- 172.21.15.55:0/17206715 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55592ef14180 con 0x55592e153800 2024-04-02T07:30:35.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9a200640 1 -- 172.21.15.55:0/17206715 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55592e1a7600 con 0x55592e153800 2024-04-02T07:30:35.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9fe498c0 1 -- 172.21.15.55:0/17206715 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55592e1861a0 con 0x55592e153800 2024-04-02T07:30:35.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9fe498c0 1 -- 172.21.15.55:0/17206715 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55592e1869c0 con 0x55592e153800 2024-04-02T07:30:35.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9fe498c0 4 waiting for MDS map... 2024-04-02T07:30:35.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9a200640 1 -- 172.21.15.55:0/17206715 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x55592e192c40 con 0x55592e153800 2024-04-02T07:30:35.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9a200640 1 -- 172.21.15.55:0/17206715 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 68) v1 ==== 2573+0+0 (secure 0 0 0) 0x55592e1a0f00 con 0x55592e153800 2024-04-02T07:30:35.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9fe498c0 4 Got MDS map 68 2024-04-02T07:30:35.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9fe498c0 4 datascan.main: Using metadata pool output 2024-04-02T07:30:35.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9fe498c0 4 datascan.main: connecting to RADOS... 2024-04-02T07:30:35.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9fe498c0 1 Processor -- start 2024-04-02T07:30:35.219 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9fe498c0 1 -- start start 2024-04-02T07:30:35.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9fe498c0 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592ef21800 0x55592e1df600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9fe498c0 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55592ef21c00 0x55592e1dfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9fe498c0 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55592f0c8000 0x55592e1e0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9fe498c0 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55592e220500 con 0x55592ef21800 2024-04-02T07:30:35.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.214+0000 7faf9fe498c0 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55592e2203c0 con 0x55592f0c8000 2024-04-02T07:30:35.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9fe498c0 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55592e220640 con 0x55592ef21c00 2024-04-02T07:30:35.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592ef21800 0x55592e1df600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592ef21800 0x55592e1df600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57510/0 (socket says 172.21.15.55:57510) 2024-04-02T07:30:35.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9de00640 1 -- 172.21.15.55:0/3598941624 learned_addr learned my addr 172.21.15.55:0/3598941624 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:35.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9ca00640 1 --2- 172.21.15.55:0/3598941624 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55592f0c8000 0x55592e1e0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9d400640 1 --2- 172.21.15.55:0/3598941624 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55592ef21c00 0x55592e1dfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9de00640 1 -- 172.21.15.55:0/3598941624 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55592ef21c00 msgr2=0x55592e1dfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:35.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9de00640 1 --2- 172.21.15.55:0/3598941624 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55592ef21c00 0x55592e1dfb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9de00640 1 -- 172.21.15.55:0/3598941624 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55592f0c8000 msgr2=0x55592e1e0100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:35.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9de00640 1 --2- 172.21.15.55:0/3598941624 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55592f0c8000 0x55592e1e0100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9de00640 1 -- 172.21.15.55:0/3598941624 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55592e186b60 con 0x55592ef21800 2024-04-02T07:30:35.224 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9de00640 1 --2- 172.21.15.55:0/3598941624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592ef21800 0x55592e1df600 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x55592f0ca510 tx=0x55592f084c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a151f66192d4602 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf97a00640 1 -- 172.21.15.55:0/3598941624 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55592e1a7080 con 0x55592ef21800 2024-04-02T07:30:35.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf97a00640 1 -- 172.21.15.55:0/3598941624 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55592ef14180 con 0x55592ef21800 2024-04-02T07:30:35.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf97a00640 1 -- 172.21.15.55:0/3598941624 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55592e1a7600 con 0x55592ef21800 2024-04-02T07:30:35.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9fe498c0 1 -- 172.21.15.55:0/3598941624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592ef21800 msgr2=0x55592e1df600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/3598941624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592ef21800 0x55592e1df600 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x55592f0ca510 tx=0x55592f084c00 comp rx=0 tx=0).stop 2024-04-02T07:30:35.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9fe498c0 1 -- 172.21.15.55:0/3598941624 shutdown_connections 2024-04-02T07:30:35.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/3598941624 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55592f0c8000 0x55592e1e0100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/3598941624 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55592ef21c00 0x55592e1dfb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/3598941624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592ef21800 0x55592e1df600 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9fe498c0 1 -- 172.21.15.55:0/3598941624 >> 172.21.15.55:0/3598941624 conn(0x55592e152c00 msgr2=0x55592e17d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:35.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9fe498c0 1 -- 172.21.15.55:0/3598941624 shutdown_connections 2024-04-02T07:30:35.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9fe498c0 1 -- 172.21.15.55:0/3598941624 wait complete. 2024-04-02T07:30:35.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9fe498c0 1 Processor -- start 2024-04-02T07:30:35.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9fe498c0 1 -- start start 2024-04-02T07:30:35.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9fe498c0 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592ef21c00 0x55592e1e1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9fe498c0 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55592ef21800 0x55592e1e0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9fe498c0 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55592f0c9800 0x55592e1e0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9fe498c0 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55592e220280 con 0x55592ef21c00 2024-04-02T07:30:35.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9fe498c0 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55592e220140 con 0x55592f0c9800 2024-04-02T07:30:35.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9fe498c0 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55592e220000 con 0x55592ef21800 2024-04-02T07:30:35.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592ef21c00 0x55592e1e1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592ef21c00 0x55592e1e1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57518/0 (socket says 172.21.15.55:57518) 2024-04-02T07:30:35.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 learned_addr learned my addr 172.21.15.55:0/207919725 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:35.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9ca00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55592f0c9800 0x55592e1e0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9d400640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55592ef21800 0x55592e1e0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55592ef21800 msgr2=0x55592e1e0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9de00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55592ef21800 0x55592e1e0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55592f0c9800 msgr2=0x55592e1e0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9de00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55592f0c9800 0x55592e1e0680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55592e186340 con 0x55592ef21c00 2024-04-02T07:30:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.218+0000 7faf9ca00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55592f0c9800 0x55592e1e0680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:30:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.222+0000 7faf9de00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592ef21c00 0x55592e1e1180 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x55592f0cb7d0 tx=0x55592f060480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.222+0000 7faf95c00640 1 -- 172.21.15.55:0/207919725 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55592e1a6dc0 con 0x55592ef21c00 2024-04-02T07:30:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.222+0000 7faf95c00640 1 -- 172.21.15.55:0/207919725 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55592ef15500 con 0x55592ef21c00 2024-04-02T07:30:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.222+0000 7faf95c00640 1 -- 172.21.15.55:0/207919725 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55592e1a7080 con 0x55592ef21c00 2024-04-02T07:30:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.222+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55592e186000 con 0x55592ef21c00 2024-04-02T07:30:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.222+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55592e186ea0 con 0x55592ef21c00 2024-04-02T07:30:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.222+0000 7faf9fe498c0 4 datascan.init: resolving metadata pool 12 2024-04-02T07:30:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.222+0000 7faf95c00640 1 -- 172.21.15.55:0/207919725 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x55592e18a840 con 0x55592ef21c00 2024-04-02T07:30:35.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.222+0000 7faf95c00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x55592e432c00 0x55592e1e1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.222+0000 7faf95c00640 1 -- 172.21.15.55:0/207919725 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x55592e192a80 con 0x55592ef21c00 2024-04-02T07:30:35.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.222+0000 7faf9fe498c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-02T07:30:35.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.222+0000 7faf9fe498c0 4 datascan.main: resolving metadata pool 12 2024-04-02T07:30:35.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.222+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x55592f0c9400 0x55592e1e0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.222+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:1 12.0 12:00000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c9000 con 0x55592f0c9400 2024-04-02T07:30:35.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.222+0000 7faf9d400640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x55592e432c00 0x55592e1e1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.222+0000 7faf9ca00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x55592f0c9400 0x55592e1e0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.222+0000 7faf9d400640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x55592e432c00 0x55592e1e1700 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x55592f0ca030 tx=0x55592f0601e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.222+0000 7faf9ca00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x55592f0c9400 0x55592e1e0100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.226+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.4 v2:172.21.15.106:6801/27677 1 ==== osd_op_reply(1 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1eb40 con 0x55592f0c9400 2024-04-02T07:30:35.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.226+0000 7faf9ca00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x55592f0c9000 0x55592e53a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.226+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:2 12.10 12:08000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53e000 con 0x55592f0c9000 2024-04-02T07:30:35.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.226+0000 7faf9de00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x55592f0c9000 0x55592e53a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.226+0000 7faf9de00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x55592f0c9000 0x55592e53a000 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.226+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 1 ==== osd_op_reply(2 [pgnls start_epoch 91 out=177b] v91'18 uv18 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.226+0000 7faf9de00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55592e53e000 0x55592e53a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.226+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:3 12.8 12:10000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53e800 con 0x55592e53e000 2024-04-02T07:30:35.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.226+0000 7faf9d400640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55592e53e000 0x55592e53a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.226+0000 7faf9d400640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55592e53e000 0x55592e53a580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.226+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 <== osd.3 v2:172.21.15.55:6824/27393 1 ==== osd_op_reply(3 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1efc0 con 0x55592e53e000 2024-04-02T07:30:35.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.226+0000 7faf9d400640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55592e53e800 0x55592e53ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.226+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:4 12.18 12:18000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e433400 con 0x55592e53e800 2024-04-02T07:30:35.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.226+0000 7faf9ca00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55592e53e800 0x55592e53ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.226+0000 7faf9ca00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55592e53e800 0x55592e53ab00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.226+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.1 v2:172.21.15.55:6809/27391 1 ==== osd_op_reply(4 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1eb40 con 0x55592e53e800 2024-04-02T07:30:35.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.226+0000 7faf9ca00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x55592e433400 0x55592e53b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.226+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:5 12.4 12:20000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53e400 con 0x55592e433400 2024-04-02T07:30:35.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.226+0000 7faf9de00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x55592e433400 0x55592e53b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.230+0000 7faf9de00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x55592e433400 0x55592e53b080 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.230+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.6 v2:172.21.15.106:6816/27678 1 ==== osd_op_reply(5 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433400 2024-04-02T07:30:35.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.230+0000 7faf9de00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x55592e53e400 0x55592e53bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.230+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:6 12.14 12:28000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53ec00 con 0x55592e53e400 2024-04-02T07:30:35.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.230+0000 7faf9d400640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x55592e53e400 0x55592e53bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.230+0000 7faf9d400640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x55592e53e400 0x55592e53bb80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.230+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 <== osd.5 v2:172.21.15.106:6800/27676 1 ==== osd_op_reply(6 [pgnls start_epoch 91 out=149b] v90'27 uv27 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x55592ef1efc0 con 0x55592e53e400 2024-04-02T07:30:35.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.230+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:7 12.c 12:30000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53ec00 con 0x55592f0c9000 2024-04-02T07:30:35.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.230+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 2 ==== osd_op_reply(7 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.230+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:8 12.1c 12:38000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53ec00 con 0x55592f0c9000 2024-04-02T07:30:35.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.230+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 3 ==== osd_op_reply(8 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.230+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:9 12.2 12:40000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53ec00 con 0x55592f0c9400 2024-04-02T07:30:35.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.230+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.4 v2:172.21.15.106:6801/27677 2 ==== osd_op_reply(9 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1eb40 con 0x55592f0c9400 2024-04-02T07:30:35.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.230+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:10 12.12 12:48000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53ec00 con 0x55592e53e000 2024-04-02T07:30:35.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.230+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 <== osd.3 v2:172.21.15.55:6824/27393 2 ==== osd_op_reply(10 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1efc0 con 0x55592e53e000 2024-04-02T07:30:35.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.230+0000 7faf9d400640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x55592e53ec00 0x55592e53c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.230+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:11 12.a 12:50000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e433800 con 0x55592e53ec00 2024-04-02T07:30:35.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.230+0000 7faf9ca00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x55592e53ec00 0x55592e53c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.230+0000 7faf9ca00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x55592e53ec00 0x55592e53c680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.230+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.2 v2:172.21.15.55:6808/27394 1 ==== osd_op_reply(11 [pgnls start_epoch 91 out=81b] v90'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55592ef1eb40 con 0x55592e53ec00 2024-04-02T07:30:35.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:12 12.1a 12:58000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e433800 con 0x55592f0c9400 2024-04-02T07:30:35.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.4 v2:172.21.15.106:6801/27677 3 ==== osd_op_reply(12 [pgnls start_epoch 91 out=49b] v90'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1eb40 con 0x55592f0c9400 2024-04-02T07:30:35.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:13 12.6 12:60000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e433800 con 0x55592e53e800 2024-04-02T07:30:35.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.1 v2:172.21.15.55:6809/27391 2 ==== osd_op_reply(13 [pgnls start_epoch 91 out=77b] v90'8 uv8 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55592ef1eb40 con 0x55592e53e800 2024-04-02T07:30:35.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:14 12.16 12:68000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e433800 con 0x55592e433400 2024-04-02T07:30:35.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.6 v2:172.21.15.106:6816/27678 2 ==== osd_op_reply(14 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433400 2024-04-02T07:30:35.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:15 12.e 12:70000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e433800 con 0x55592f0c9000 2024-04-02T07:30:35.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 4 ==== osd_op_reply(15 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:16 12.1e 12:78000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e433800 con 0x55592f0c9400 2024-04-02T07:30:35.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.4 v2:172.21.15.106:6801/27677 4 ==== osd_op_reply(16 [pgnls start_epoch 91 out=49b] v90'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1eb40 con 0x55592f0c9400 2024-04-02T07:30:35.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:17 12.1 12:80000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e433800 con 0x55592e433400 2024-04-02T07:30:35.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.6 v2:172.21.15.106:6816/27678 3 ==== osd_op_reply(17 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433400 2024-04-02T07:30:35.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:18 12.11 12:88000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e433800 con 0x55592e53e400 2024-04-02T07:30:35.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 <== osd.5 v2:172.21.15.106:6800/27676 2 ==== osd_op_reply(18 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1efc0 con 0x55592e53e400 2024-04-02T07:30:35.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:19 12.9 12:90000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e433800 con 0x55592e53ec00 2024-04-02T07:30:35.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.2 v2:172.21.15.55:6808/27394 2 ==== osd_op_reply(19 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1eb40 con 0x55592e53ec00 2024-04-02T07:30:35.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:20 12.19 12:98000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e433800 con 0x55592f0c9000 2024-04-02T07:30:35.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 5 ==== osd_op_reply(20 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:21 12.5 12:a0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e433800 con 0x55592e433400 2024-04-02T07:30:35.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.6 v2:172.21.15.106:6816/27678 4 ==== osd_op_reply(21 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433400 2024-04-02T07:30:35.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.234+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:22 12.15 12:a8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e433800 con 0x55592e433400 2024-04-02T07:30:35.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.6 v2:172.21.15.106:6816/27678 5 ==== osd_op_reply(22 [pgnls start_epoch 91 out=97b] v90'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433400 2024-04-02T07:30:35.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9de00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x55592e433800 0x55592e53c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:23 12.d 12:b0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53f000 con 0x55592e433800 2024-04-02T07:30:35.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9de00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x55592e433800 0x55592e53c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9de00640 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x55592e433800 0x55592e53c100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.7 v2:172.21.15.106:6824/27679 1 ==== osd_op_reply(23 [pgnls start_epoch 91 out=74b] v86'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433800 2024-04-02T07:30:35.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:24 12.1d 12:b8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53f000 con 0x55592f0c9000 2024-04-02T07:30:35.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 6 ==== osd_op_reply(24 [pgnls start_epoch 91 out=73b] v90'5 uv5 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:25 12.3 12:c0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53f000 con 0x55592f0c9000 2024-04-02T07:30:35.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 7 ==== osd_op_reply(25 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:26 12.13 12:c8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53f000 con 0x55592e53e800 2024-04-02T07:30:35.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.1 v2:172.21.15.55:6809/27391 3 ==== osd_op_reply(26 [pgnls start_epoch 91 out=98b] v90'4 uv4 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55592ef1eb40 con 0x55592e53e800 2024-04-02T07:30:35.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:27 12.b 12:d0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53f000 con 0x55592e53e000 2024-04-02T07:30:35.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 <== osd.3 v2:172.21.15.55:6824/27393 3 ==== osd_op_reply(27 [pgnls start_epoch 91 out=76b] v90'6 uv6 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55592ef1efc0 con 0x55592e53e000 2024-04-02T07:30:35.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:28 12.1b 12:d8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53f000 con 0x55592f0c9400 2024-04-02T07:30:35.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.4 v2:172.21.15.106:6801/27677 5 ==== osd_op_reply(28 [pgnls start_epoch 91 out=73b] v90'10 uv10 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55592ef1eb40 con 0x55592f0c9400 2024-04-02T07:30:35.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:29 12.7 12:e0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53f000 con 0x55592e53e800 2024-04-02T07:30:35.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.1 v2:172.21.15.55:6809/27391 4 ==== osd_op_reply(29 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55592ef1eb40 con 0x55592e53e800 2024-04-02T07:30:35.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:30 12.17 12:e8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53f000 con 0x55592e433400 2024-04-02T07:30:35.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.6 v2:172.21.15.106:6816/27678 6 ==== osd_op_reply(30 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433400 2024-04-02T07:30:35.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:31 12.f 12:f0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53f000 con 0x55592e433400 2024-04-02T07:30:35.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.6 v2:172.21.15.106:6816/27678 7 ==== osd_op_reply(31 [pgnls start_epoch 91 out=73b] v86'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433400 2024-04-02T07:30:35.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.238+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:32 12.1f 12:f8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53f000 con 0x55592e433400 2024-04-02T07:30:35.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.6 v2:172.21.15.106:6816/27678 8 ==== osd_op_reply(32 [pgnls start_epoch 91 out=101b] v90'9 uv9 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433400 2024-04-02T07:30:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 601.00000000 2024-04-02T07:30:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:33 12.10 12:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8c00 con 0x55592f0c9000 2024-04-02T07:30:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 8 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 602.00000000 2024-04-02T07:30:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:34 12.10 12:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8800 con 0x55592f0c9000 2024-04-02T07:30:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 9 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-04-02T07:30:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:35 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8400 con 0x55592f0c9000 2024-04-02T07:30:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 10 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 20 datascan.scan_links: injected ino detected 2024-04-02T07:30:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 600.00000000 2024-04-02T07:30:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:36 12.10 12:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592f0c9000 2024-04-02T07:30:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 11 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 603.00000000 2024-04-02T07:30:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:37 12.10 12:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53f000 con 0x55592f0c9000 2024-04-02T07:30:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 12 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-04-02T07:30:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-02T07:30:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 200.00000000 2024-04-02T07:30:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-02T07:30:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 200.00000001 2024-04-02T07:30:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-02T07:30:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 606.00000000 2024-04-02T07:30:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:38 12.14 12:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53f400 con 0x55592e53e400 2024-04-02T07:30:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 <== osd.5 v2:172.21.15.106:6800/27676 3 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv25 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55592ef1efc0 con 0x55592e53e400 2024-04-02T07:30:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 607.00000000 2024-04-02T07:30:35.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:39 12.1c 12:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53f800 con 0x55592f0c9000 2024-04-02T07:30:35.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 13 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 100000001f6.00000000 2024-04-02T07:30:35.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:40 12.a 12:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e53fc00 con 0x55592e53ec00 2024-04-02T07:30:35.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.2 v2:172.21.15.55:6808/27394 3 ==== osd_op_reply(40 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+54 (crc 0 0 0) 0x55592ef1eb40 con 0x55592e53ec00 2024-04-02T07:30:35.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-04-02T07:30:35.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-02T07:30:35.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 608.00000000 2024-04-02T07:30:35.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:41 12.e 12:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8c00 con 0x55592f0c9000 2024-04-02T07:30:35.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 14 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 604.00000000 2024-04-02T07:30:35.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:42 12.15 12:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8800 con 0x55592e433400 2024-04-02T07:30:35.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.6 v2:172.21.15.106:6816/27678 9 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433400 2024-04-02T07:30:35.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 500.00000000 2024-04-02T07:30:35.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-02T07:30:35.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-04-02T07:30:35.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-02T07:30:35.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 605.00000000 2024-04-02T07:30:35.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:43 12.1d 12:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8400 con 0x55592f0c9000 2024-04-02T07:30:35.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 15 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-04-02T07:30:35.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-02T07:30:35.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 100.00000000 2024-04-02T07:30:35.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.242+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:44 12.13 12:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e53e800 2024-04-02T07:30:35.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.1 v2:172.21.15.55:6809/27391 5 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x55592ef1eb40 con 0x55592e53e800 2024-04-02T07:30:35.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-04-02T07:30:35.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-02T07:30:35.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 200.00000002 2024-04-02T07:30:35.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-04-02T07:30:35.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 609.00000000 2024-04-02T07:30:35.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:45 12.7 12:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e568000 con 0x55592e53e800 2024-04-02T07:30:35.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.1 v2:172.21.15.55:6809/27391 6 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55592ef1eb40 con 0x55592e53e800 2024-04-02T07:30:35.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 400.00000000 2024-04-02T07:30:35.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-02T07:30:35.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-04-02T07:30:35.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-02T07:30:35.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9fe498c0 10 datascan.scan_links: step 1: handling object 1.00000000 2024-04-02T07:30:35.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:46 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e568400 con 0x55592e433400 2024-04-02T07:30:35.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.6 v2:172.21.15.106:6816/27678 10 ==== osd_op_reply(46 1.00000000 [omap-get-vals out=1041b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+1041 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433400 2024-04-02T07:30:35.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:47 12.0 12:00000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e568800 con 0x55592f0c9400 2024-04-02T07:30:35.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.4 v2:172.21.15.106:6801/27677 6 ==== osd_op_reply(47 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1eb40 con 0x55592f0c9400 2024-04-02T07:30:35.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:48 12.10 12:08000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592f0c9000 2024-04-02T07:30:35.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 16 ==== osd_op_reply(48 [pgnls start_epoch 91 out=177b] v91'18 uv18 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:49 12.8 12:10000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e53e000 2024-04-02T07:30:35.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 <== osd.3 v2:172.21.15.55:6824/27393 4 ==== osd_op_reply(49 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1efc0 con 0x55592e53e000 2024-04-02T07:30:35.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:50 12.18 12:18000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e53e800 2024-04-02T07:30:35.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.1 v2:172.21.15.55:6809/27391 7 ==== osd_op_reply(50 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1eb40 con 0x55592e53e800 2024-04-02T07:30:35.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:51 12.4 12:20000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e433400 2024-04-02T07:30:35.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.6 v2:172.21.15.106:6816/27678 11 ==== osd_op_reply(51 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433400 2024-04-02T07:30:35.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:52 12.14 12:28000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e53e400 2024-04-02T07:30:35.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 <== osd.5 v2:172.21.15.106:6800/27676 4 ==== osd_op_reply(52 [pgnls start_epoch 91 out=149b] v90'27 uv27 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x55592ef1efc0 con 0x55592e53e400 2024-04-02T07:30:35.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:53 12.c 12:30000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592f0c9000 2024-04-02T07:30:35.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.246+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 17 ==== osd_op_reply(53 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:54 12.1c 12:38000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592f0c9000 2024-04-02T07:30:35.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 18 ==== osd_op_reply(54 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:55 12.2 12:40000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592f0c9400 2024-04-02T07:30:35.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.4 v2:172.21.15.106:6801/27677 7 ==== osd_op_reply(55 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1eb40 con 0x55592f0c9400 2024-04-02T07:30:35.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:56 12.12 12:48000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e53e000 2024-04-02T07:30:35.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 <== osd.3 v2:172.21.15.55:6824/27393 5 ==== osd_op_reply(56 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1efc0 con 0x55592e53e000 2024-04-02T07:30:35.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:57 12.a 12:50000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e53ec00 2024-04-02T07:30:35.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.2 v2:172.21.15.55:6808/27394 4 ==== osd_op_reply(57 [pgnls start_epoch 91 out=81b] v90'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x55592ef1eb40 con 0x55592e53ec00 2024-04-02T07:30:35.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:58 12.1a 12:58000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592f0c9400 2024-04-02T07:30:35.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.4 v2:172.21.15.106:6801/27677 8 ==== osd_op_reply(58 [pgnls start_epoch 91 out=49b] v90'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1eb40 con 0x55592f0c9400 2024-04-02T07:30:35.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:59 12.6 12:60000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e53e800 2024-04-02T07:30:35.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.1 v2:172.21.15.55:6809/27391 8 ==== osd_op_reply(59 [pgnls start_epoch 91 out=77b] v90'8 uv8 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x55592ef1eb40 con 0x55592e53e800 2024-04-02T07:30:35.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:60 12.16 12:68000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e433400 2024-04-02T07:30:35.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.6 v2:172.21.15.106:6816/27678 12 ==== osd_op_reply(60 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433400 2024-04-02T07:30:35.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:61 12.e 12:70000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592f0c9000 2024-04-02T07:30:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 19 ==== osd_op_reply(61 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:62 12.1e 12:78000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592f0c9400 2024-04-02T07:30:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.4 v2:172.21.15.106:6801/27677 9 ==== osd_op_reply(62 [pgnls start_epoch 91 out=49b] v90'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1eb40 con 0x55592f0c9400 2024-04-02T07:30:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:63 12.1 12:80000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e433400 2024-04-02T07:30:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.6 v2:172.21.15.106:6816/27678 13 ==== osd_op_reply(63 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433400 2024-04-02T07:30:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:64 12.11 12:88000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e53e400 2024-04-02T07:30:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 <== osd.5 v2:172.21.15.106:6800/27676 5 ==== osd_op_reply(64 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1efc0 con 0x55592e53e400 2024-04-02T07:30:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:65 12.9 12:90000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e53ec00 2024-04-02T07:30:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.2 v2:172.21.15.55:6808/27394 5 ==== osd_op_reply(65 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1eb40 con 0x55592e53ec00 2024-04-02T07:30:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.250+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:66 12.19 12:98000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592f0c9000 2024-04-02T07:30:35.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 20 ==== osd_op_reply(66 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:67 12.5 12:a0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e433400 2024-04-02T07:30:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.6 v2:172.21.15.106:6816/27678 14 ==== osd_op_reply(67 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433400 2024-04-02T07:30:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:68 12.15 12:a8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e433400 2024-04-02T07:30:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.6 v2:172.21.15.106:6816/27678 15 ==== osd_op_reply(68 [pgnls start_epoch 91 out=97b] v90'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433400 2024-04-02T07:30:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:69 12.d 12:b0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e433800 2024-04-02T07:30:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.7 v2:172.21.15.106:6824/27679 2 ==== osd_op_reply(69 [pgnls start_epoch 91 out=74b] v86'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433800 2024-04-02T07:30:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:70 12.1d 12:b8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592f0c9000 2024-04-02T07:30:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 21 ==== osd_op_reply(70 [pgnls start_epoch 91 out=73b] v90'5 uv5 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:71 12.3 12:c0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592f0c9000 2024-04-02T07:30:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 22 ==== osd_op_reply(71 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:72 12.13 12:c8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e53e800 2024-04-02T07:30:35.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.1 v2:172.21.15.55:6809/27391 9 ==== osd_op_reply(72 [pgnls start_epoch 91 out=98b] v90'4 uv4 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x55592ef1eb40 con 0x55592e53e800 2024-04-02T07:30:35.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:73 12.b 12:d0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e53e000 2024-04-02T07:30:35.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 <== osd.3 v2:172.21.15.55:6824/27393 6 ==== osd_op_reply(73 [pgnls start_epoch 91 out=76b] v90'6 uv6 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x55592ef1efc0 con 0x55592e53e000 2024-04-02T07:30:35.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:74 12.1b 12:d8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592f0c9400 2024-04-02T07:30:35.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.4 v2:172.21.15.106:6801/27677 10 ==== osd_op_reply(74 [pgnls start_epoch 91 out=73b] v90'10 uv10 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55592ef1eb40 con 0x55592f0c9400 2024-04-02T07:30:35.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:75 12.7 12:e0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e53e800 2024-04-02T07:30:35.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.1 v2:172.21.15.55:6809/27391 10 ==== osd_op_reply(75 [pgnls start_epoch 91 out=73b] v90'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55592ef1eb40 con 0x55592e53e800 2024-04-02T07:30:35.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:76 12.17 12:e8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e433400 2024-04-02T07:30:35.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.6 v2:172.21.15.106:6816/27678 16 ==== osd_op_reply(76 [pgnls start_epoch 91 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433400 2024-04-02T07:30:35.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:77 12.f 12:f0000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e433400 2024-04-02T07:30:35.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.6 v2:172.21.15.106:6816/27678 17 ==== osd_op_reply(77 [pgnls start_epoch 91 out=73b] v86'1 uv1 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433400 2024-04-02T07:30:35.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.254+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:78 12.1f 12:f8000000::::head [pgnls start_epoch 91 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592e433400 2024-04-02T07:30:35.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.6 v2:172.21.15.106:6816/27678 18 ==== osd_op_reply(78 [pgnls start_epoch 91 out=101b] v90'9 uv9 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433400 2024-04-02T07:30:35.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 601.00000000 2024-04-02T07:30:35.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:79 12.10 12:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e568c00 con 0x55592f0c9000 2024-04-02T07:30:35.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 23 ==== osd_op_reply(79 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 602.00000000 2024-04-02T07:30:35.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:80 12.10 12:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e569000 con 0x55592f0c9000 2024-04-02T07:30:35.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 24 ==== osd_op_reply(80 602.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-04-02T07:30:35.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:81 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e569400 con 0x55592f0c9000 2024-04-02T07:30:35.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 25 ==== osd_op_reply(81 10000000000.00000000 [omap-get-vals out=506b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 20 datascan.scan_links: injected ino detected 2024-04-02T07:30:35.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 -1 datascan.scan_links: Bad nlink on 0x10000000001 expected 2 has 1 2024-04-02T07:30:35.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 20 datascan.scan_links: adding 0x10000000001 for future processing to fix dnfirst 2024-04-02T07:30:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 600.00000000 2024-04-02T07:30:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:82 12.10 12:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e569800 con 0x55592f0c9000 2024-04-02T07:30:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 26 ==== osd_op_reply(82 600.00000000 [omap-get-vals out=5b] v0'0 uv12 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 603.00000000 2024-04-02T07:30:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:83 12.10 12:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e569c00 con 0x55592f0c9000 2024-04-02T07:30:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 27 ==== osd_op_reply(83 603.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-04-02T07:30:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-02T07:30:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 200.00000000 2024-04-02T07:30:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-02T07:30:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 200.00000001 2024-04-02T07:30:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-02T07:30:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 606.00000000 2024-04-02T07:30:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:84 12.14 12:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e568000 con 0x55592e53e400 2024-04-02T07:30:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9d400640 1 -- 172.21.15.55:0/207919725 <== osd.5 v2:172.21.15.106:6800/27676 6 ==== osd_op_reply(84 606.00000000 [omap-get-vals out=5b] v0'0 uv25 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55592ef1efc0 con 0x55592e53e400 2024-04-02T07:30:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 607.00000000 2024-04-02T07:30:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:85 12.1c 12:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e568800 con 0x55592f0c9000 2024-04-02T07:30:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 28 ==== osd_op_reply(85 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 100000001f6.00000000 2024-04-02T07:30:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:86 12.a 12:57fe7535:::100000001f6.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e568400 con 0x55592e53ec00 2024-04-02T07:30:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.2 v2:172.21.15.55:6808/27394 6 ==== osd_op_reply(86 100000001f6.00000000 [omap-get-vals out=54b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+54 (crc 0 0 0) 0x55592ef1eb40 con 0x55592e53ec00 2024-04-02T07:30:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-04-02T07:30:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-02T07:30:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 608.00000000 2024-04-02T07:30:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:87 12.e 12:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8c00 con 0x55592f0c9000 2024-04-02T07:30:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 29 ==== osd_op_reply(87 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 604.00000000 2024-04-02T07:30:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.258+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:88 12.15 12:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8800 con 0x55592e433400 2024-04-02T07:30:35.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.6 v2:172.21.15.106:6816/27678 19 ==== osd_op_reply(88 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433400 2024-04-02T07:30:35.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 500.00000000 2024-04-02T07:30:35.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-02T07:30:35.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-04-02T07:30:35.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-02T07:30:35.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 605.00000000 2024-04-02T07:30:35.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:89 12.1d 12:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8400 con 0x55592f0c9000 2024-04-02T07:30:35.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 30 ==== osd_op_reply(89 605.00000000 [omap-get-vals out=5b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-04-02T07:30:35.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-02T07:30:35.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 100.00000000 2024-04-02T07:30:35.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:90 12.13 12:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e568c00 con 0x55592e53e800 2024-04-02T07:30:35.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.1 v2:172.21.15.55:6809/27391 11 ==== osd_op_reply(90 100.00000000 [omap-get-vals out=5195b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x55592ef1eb40 con 0x55592e53e800 2024-04-02T07:30:35.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-04-02T07:30:35.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-02T07:30:35.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 200.00000002 2024-04-02T07:30:35.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000002' 2024-04-02T07:30:35.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 609.00000000 2024-04-02T07:30:35.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:91 12.7 12:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e569000 con 0x55592e53e800 2024-04-02T07:30:35.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.1 v2:172.21.15.55:6809/27391 12 ==== osd_op_reply(91 609.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x55592ef1eb40 con 0x55592e53e800 2024-04-02T07:30:35.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 400.00000000 2024-04-02T07:30:35.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-02T07:30:35.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-04-02T07:30:35.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-02T07:30:35.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: step 2: handling object 1.00000000 2024-04-02T07:30:35.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:92 12.1f 12:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e569400 con 0x55592e433400 2024-04-02T07:30:35.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.6 v2:172.21.15.106:6816/27678 20 ==== osd_op_reply(92 1.00000000 [omap-get-vals out=1041b] v0'0 uv9 ondisk = 0) v8 ==== 154+0+1041 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433400 2024-04-02T07:30:35.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: processing 0 dup_primaries, 1 remote_links 2024-04-02T07:30:35.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: removing dup dentries from 0 objects 2024-04-02T07:30:35.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: processing 1 bad_nlink_inos 2024-04-02T07:30:35.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 10 datascan.scan_links: handling bad_nlink_ino 0x10000000001 2024-04-02T07:30:35.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:93 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e569800 con 0x55592f0c9000 2024-04-02T07:30:35.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 31 ==== osd_op_reply(93 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv18 ondisk = 0) v8 ==== 164+0+505 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-02T07:30:35.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.262+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:94 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e569c00 con 0x55592f0c9000 2024-04-02T07:30:35.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.266+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 32 ==== osd_op_reply(94 10000000000.00000000 [omap-set-vals] v91'19 uv19 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.266+0000 7faf9fe498c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-02T07:30:35.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.266+0000 7faf9fe498c0 10 datascan.scan_links: processing 1 injected_inos 2024-04-02T07:30:35.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.266+0000 7faf9fe498c0 10 datascan.scan_links: handling injected_ino 0x10000000001 2024-04-02T07:30:35.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.266+0000 7faf9fe498c0 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000000:file 2024-04-02T07:30:35.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.266+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:95 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=17b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e568800 con 0x55592f0c9000 2024-04-02T07:30:35.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.266+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 33 ==== osd_op_reply(95 10000000000.00000000 [omap-get-vals-by-keys out=505b] v0'0 uv19 ondisk = 0) v8 ==== 164+0+505 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.266+0000 7faf9fe498c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=file frag=*, r=0 2024-04-02T07:30:35.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.266+0000 7faf9fe498c0 20 datascan.scan_links: first is now 2 2024-04-02T07:30:35.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.266+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:96 12.10 12:0cf6ad0f:::10000000000.00000000:head [omap-set-vals in=505b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592f0c8000 con 0x55592f0c9000 2024-04-02T07:30:35.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.266+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.0 v2:172.21.15.55:6800/27392 34 ==== osd_op_reply(96 10000000000.00000000 [omap-set-vals] v91'20 uv20 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x55592ef1ed80 con 0x55592f0c9000 2024-04-02T07:30:35.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.266+0000 7faf9fe498c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000000/file pointing to 0x0x10000000001 2024-04-02T07:30:35.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.266+0000 7faf9fe498c0 10 datascan.scan_links: updating inotable 2024-04-02T07:30:35.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.266+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:97 12.13 12:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e569400 con 0x55592e53e800 2024-04-02T07:30:35.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.266+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.1 v2:172.21.15.55:6809/27391 13 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+50 (crc 0 0 0) 0x55592ef1eb40 con 0x55592e53e800 2024-04-02T07:30:35.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.266+0000 7faf9fe498c0 10 mds.0.inotable: skip_inos was [0x10000000002~0x1f4,0x100000001f7~0xfffffffe09] 2024-04-02T07:30:35.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.266+0000 7faf9fe498c0 10 mds.0.inotable: skip_inos now [0x100000001f7~0xfffffffe09] 2024-04-02T07:30:35.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.266+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:98 12.13 12:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e569800 con 0x55592e53e800 2024-04-02T07:30:35.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 <== osd.1 v2:172.21.15.55:6809/27391 14 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v91'5 uv5 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x55592ef1eb40 con 0x55592e53e800 2024-04-02T07:30:35.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 10 datascan.scan_links: updating snaptable 2024-04-02T07:30:35.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:99 12.d 12:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e91) v8 -- 0x55592e569c00 con 0x55592e433800 2024-04-02T07:30:35.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9de00640 1 -- 172.21.15.55:0/207919725 <== osd.7 v2:172.21.15.106:6824/27679 3 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x55592ef1ed80 con 0x55592e433800 2024-04-02T07:30:35.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x55592f0c9000 msgr2=0x55592e53a000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x55592f0c9000 0x55592e53a000 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55592e53e800 msgr2=0x55592e53ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55592e53e800 0x55592e53ab00 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x55592e53ec00 msgr2=0x55592e53c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x55592e53ec00 0x55592e53c680 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55592e53e000 msgr2=0x55592e53a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55592e53e000 0x55592e53a580 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x55592f0c9400 msgr2=0x55592e1e0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x55592f0c9400 0x55592e1e0100 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x55592e53e400 msgr2=0x55592e53bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x55592e53e400 0x55592e53bb80 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x55592e433400 msgr2=0x55592e53b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x55592e433400 0x55592e53b080 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x55592e433800 msgr2=0x55592e53c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x55592e433800 0x55592e53c100 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 reap_dead start 2024-04-02T07:30:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 reap_dead start 2024-04-02T07:30:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 reap_dead start 2024-04-02T07:30:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9ca00640 1 -- 172.21.15.55:0/207919725 reap_dead start 2024-04-02T07:30:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x55592e432c00 msgr2=0x55592e1e1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x55592e432c00 0x55592e1e1700 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x55592f0ca030 tx=0x55592f0601e0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592ef21c00 msgr2=0x55592e1e1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592ef21c00 0x55592e1e1180 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x55592f0cb7d0 tx=0x55592f060480 comp rx=0 tx=0).stop 2024-04-02T07:30:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 shutdown_connections 2024-04-02T07:30:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x55592e432c00 0x55592e1e1700 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/207919725 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592ef21c00 0x55592e1e1180 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 >> 172.21.15.55:0/207919725 conn(0x55592e152c00 msgr2=0x55592e17d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 shutdown_connections 2024-04-02T07:30:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 -- 172.21.15.55:0/207919725 wait complete. 2024-04-02T07:30:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 -- 172.21.15.55:0/17206715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592e153800 msgr2=0x55592e1de580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/17206715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592e153800 0x55592e1de580 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x55592efb29c0 tx=0x55592f060120 comp rx=0 tx=0).stop 2024-04-02T07:30:35.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 -- 172.21.15.55:0/17206715 shutdown_connections 2024-04-02T07:30:35.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/17206715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55592e153000 0x55592e1df080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/17206715 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55592e153400 0x55592e1deb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 --2- 172.21.15.55:0/17206715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55592e153800 0x55592e1de580 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 -- 172.21.15.55:0/17206715 >> 172.21.15.55:0/17206715 conn(0x55592e153c00 msgr2=0x55592e17d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:35.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 -- 172.21.15.55:0/17206715 shutdown_connections 2024-04-02T07:30:35.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.270+0000 7faf9fe498c0 1 -- 172.21.15.55:0/17206715 wait complete. 2024-04-02T07:30:35.282 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.110733, result: 2024-04-02T07:30:35.282 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-02T07:30:35.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.462+0000 7f40aa600640 1 Processor -- start 2024-04-02T07:30:35.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.462+0000 7f40aa600640 1 -- start start 2024-04-02T07:30:35.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.466+0000 7f40aa600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40a40cc880 0x7f40a406b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.466+0000 7f40aa600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f40a4098e70 0x7f40a415c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.466+0000 7f40aa600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40a4099a70 con 0x7f40a4098a10 2024-04-02T07:30:35.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.466+0000 7f40aa600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40a406b5f0 con 0x7f40a4098e70 2024-04-02T07:30:35.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.466+0000 7f40aa600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a415cd80 con 0x7f40a40cc880 2024-04-02T07:30:35.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.466+0000 7f40a9c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f40a4098e70 0x7f40a415c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.466+0000 7f40a9c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f40a4098e70 0x7f40a415c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57524/0 (socket says 172.21.15.55:57524) 2024-04-02T07:30:35.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.466+0000 7f40a9c00640 1 -- 172.21.15.55:0/1512263745 learned_addr learned my addr 172.21.15.55:0/1512263745 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:35.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.466+0000 7f40a9200640 1 --2- 172.21.15.55:0/1512263745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40a40cc880 0x7f40a406b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.466+0000 7f40a9c00640 1 -- 172.21.15.55:0/1512263745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40a40cc880 msgr2=0x7f40a406b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:35.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.466+0000 7f40a9c00640 1 --2- 172.21.15.55:0/1512263745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40a40cc880 0x7f40a406b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.466+0000 7f40a9c00640 1 -- 172.21.15.55:0/1512263745 >> v1:172.21.15.106:6789/0 conn(0x7f40a4098a10 legacy=0x7f40a415c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.466+0000 7f40a9c00640 1 -- 172.21.15.55:0/1512263745 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40a406bc90 con 0x7f40a4098e70 2024-04-02T07:30:35.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.466+0000 7f40a9c00640 1 --2- 172.21.15.55:0/1512263745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40a4098e70 0x7f40a415c840 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f409c009e50 tx=0x7f409c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6693b46b3c391e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40a3400640 1 -- 172.21.15.55:0/1512263745 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c0a58d0 con 0x7f40a4098e70 2024-04-02T07:30:35.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40a3400640 1 -- 172.21.15.55:0/1512263745 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409c0a5a30 con 0x7f40a4098e70 2024-04-02T07:30:35.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40a3400640 1 -- 172.21.15.55:0/1512263745 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c0a5dc0 con 0x7f40a4098e70 2024-04-02T07:30:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40aa600640 1 -- 172.21.15.55:0/1512263745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40a4098e70 msgr2=0x7f40a415c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40aa600640 1 --2- 172.21.15.55:0/1512263745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40a4098e70 0x7f40a415c840 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f409c009e50 tx=0x7f409c01ca00 comp rx=0 tx=0).stop 2024-04-02T07:30:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40aa600640 1 -- 172.21.15.55:0/1512263745 shutdown_connections 2024-04-02T07:30:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40aa600640 1 --2- 172.21.15.55:0/1512263745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40a4098e70 0x7f40a415c840 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40aa600640 1 --2- 172.21.15.55:0/1512263745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40a40cc880 0x7f40a406b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40aa600640 1 -- 172.21.15.55:0/1512263745 >> 172.21.15.55:0/1512263745 conn(0x7f40a40b1fb0 msgr2=0x7f40a40b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40aa600640 1 -- 172.21.15.55:0/1512263745 shutdown_connections 2024-04-02T07:30:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40aa600640 1 -- 172.21.15.55:0/1512263745 wait complete. 2024-04-02T07:30:35.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40aa600640 1 Processor -- start 2024-04-02T07:30:35.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40aa600640 1 -- start start 2024-04-02T07:30:35.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40aa600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40a4098a10 0x7f40a40c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40aa600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40a4098e70 0x7f40a414e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40aa600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40a40cc880 0x7f40a4153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40aa600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a4156db0 con 0x7f40a40cc880 2024-04-02T07:30:35.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40aa600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a414eb90 con 0x7f40a4098a10 2024-04-02T07:30:35.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40aa600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40a40c9e50 con 0x7f40a4098e70 2024-04-02T07:30:35.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40a9c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40a40cc880 0x7f40a4153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40a9c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40a40cc880 0x7f40a4153950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57530/0 (socket says 172.21.15.55:57530) 2024-04-02T07:30:35.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40a9c00640 1 -- 172.21.15.55:0/2003302623 learned_addr learned my addr 172.21.15.55:0/2003302623 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:35.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40a9200640 1 --2- 172.21.15.55:0/2003302623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40a4098a10 0x7f40a40c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.470+0000 7f40a3e00640 1 --2- 172.21.15.55:0/2003302623 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40a4098e70 0x7f40a414e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.474+0000 7f40a9c00640 1 -- 172.21.15.55:0/2003302623 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40a4098e70 msgr2=0x7f40a414e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.474+0000 7f40a9c00640 1 --2- 172.21.15.55:0/2003302623 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40a4098e70 0x7f40a414e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.474+0000 7f40a9c00640 1 -- 172.21.15.55:0/2003302623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40a4098a10 msgr2=0x7f40a40c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.474+0000 7f40a9c00640 1 --2- 172.21.15.55:0/2003302623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40a4098a10 0x7f40a40c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.474+0000 7f40a9c00640 1 -- 172.21.15.55:0/2003302623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c009b30 con 0x7f40a40cc880 2024-04-02T07:30:35.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.474+0000 7f40a9c00640 1 --2- 172.21.15.55:0/2003302623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40a40cc880 0x7f40a4153950 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f409c01a630 tx=0x7f409c0197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.474+0000 7f40a0c00640 1 -- 172.21.15.55:0/2003302623 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c0b8670 con 0x7f40a40cc880 2024-04-02T07:30:35.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.474+0000 7f40a0c00640 1 -- 172.21.15.55:0/2003302623 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f409c0b87d0 con 0x7f40a40cc880 2024-04-02T07:30:35.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.474+0000 7f40a0c00640 1 -- 172.21.15.55:0/2003302623 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409c0b8b80 con 0x7f40a40cc880 2024-04-02T07:30:35.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.474+0000 7f40aa600640 1 -- 172.21.15.55:0/2003302623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a414e640 con 0x7f40a40cc880 2024-04-02T07:30:35.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.474+0000 7f40aa600640 1 -- 172.21.15.55:0/2003302623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a40c8e30 con 0x7f40a40cc880 2024-04-02T07:30:35.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.474+0000 7f40aa600640 1 -- 172.21.15.55:0/2003302623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a406cf00 con 0x7f40a40cc880 2024-04-02T07:30:35.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.474+0000 7f40a0c00640 1 -- 172.21.15.55:0/2003302623 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f409c0b8ce0 con 0x7f40a40cc880 2024-04-02T07:30:35.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.474+0000 7f40a0c00640 1 --2- 172.21.15.55:0/2003302623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4084066690 0x7f4084068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:35.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.474+0000 7f40a0c00640 1 -- 172.21.15.55:0/2003302623 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f409c11f800 con 0x7f40a40cc880 2024-04-02T07:30:35.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.474+0000 7f40a9200640 1 --2- 172.21.15.55:0/2003302623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4084066690 0x7f4084068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:35.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.478+0000 7f40a9200640 1 --2- 172.21.15.55:0/2003302623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4084066690 0x7f4084068b50 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f40a41582a0 tx=0x7f4098009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:35.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.478+0000 7f40a0c00640 1 -- 172.21.15.55:0/2003302623 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f409c0ecd30 con 0x7f40a40cc880 2024-04-02T07:30:35.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.674+0000 7f40aa600640 1 -- 172.21.15.55:0/2003302623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f40a40676b0 con 0x7f40a40cc880 2024-04-02T07:30:35.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.878+0000 7f40a0c00640 1 -- 172.21.15.55:0/2003302623 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v69) v1 ==== 162+0+0 (secure 0 0 0) 0x7f409c0f0350 con 0x7f40a40cc880 2024-04-02T07:30:35.880 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-02T07:30:35.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.882+0000 7f40aa600640 1 -- 172.21.15.55:0/2003302623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4084066690 msgr2=0x7f4084068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.882+0000 7f40aa600640 1 --2- 172.21.15.55:0/2003302623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4084066690 0x7f4084068b50 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f40a41582a0 tx=0x7f4098009190 comp rx=0 tx=0).stop 2024-04-02T07:30:35.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.882+0000 7f40aa600640 1 -- 172.21.15.55:0/2003302623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40a40cc880 msgr2=0x7f40a4153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:35.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.882+0000 7f40aa600640 1 --2- 172.21.15.55:0/2003302623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40a40cc880 0x7f40a4153950 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f409c01a630 tx=0x7f409c0197a0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.882+0000 7f40aa600640 1 -- 172.21.15.55:0/2003302623 shutdown_connections 2024-04-02T07:30:35.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.882+0000 7f40aa600640 1 --2- 172.21.15.55:0/2003302623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40a40cc880 0x7f40a4153950 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.882+0000 7f40aa600640 1 --2- 172.21.15.55:0/2003302623 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40a4098e70 0x7f40a414e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.882+0000 7f40aa600640 1 --2- 172.21.15.55:0/2003302623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4084066690 0x7f4084068b50 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.882+0000 7f40aa600640 1 --2- 172.21.15.55:0/2003302623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40a4098a10 0x7f40a40c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:35.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.882+0000 7f40aa600640 1 -- 172.21.15.55:0/2003302623 >> 172.21.15.55:0/2003302623 conn(0x7f40a40b1fb0 msgr2=0x7f40a4158b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:35.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.882+0000 7f40aa600640 1 -- 172.21.15.55:0/2003302623 shutdown_connections 2024-04-02T07:30:35.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:35.882+0000 7f40aa600640 1 -- 172.21.15.55:0/2003302623 wait complete. 2024-04-02T07:30:35.905 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:30:36.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.042+0000 7f8e56200640 1 Processor -- start 2024-04-02T07:30:36.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.042+0000 7f8e56200640 1 -- start start 2024-04-02T07:30:36.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.046+0000 7f8e56200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e5015ad30 0x7f8e500cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:36.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.046+0000 7f8e56200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e500cd8b0 0x7f8e500c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:36.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.046+0000 7f8e56200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e500b3c00 con 0x7f8e50143f90 2024-04-02T07:30:36.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.046+0000 7f8e56200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e500cdd20 con 0x7f8e5015ad30 2024-04-02T07:30:36.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.046+0000 7f8e56200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e50144370 con 0x7f8e500cd8b0 2024-04-02T07:30:36.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.046+0000 7f8e4ea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e5015ad30 0x7f8e500cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:36.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.046+0000 7f8e4ea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e5015ad30 0x7f8e500cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59480/0 (socket says 172.21.15.55:59480) 2024-04-02T07:30:36.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.046+0000 7f8e4ea00640 1 -- 172.21.15.55:0/920379020 learned_addr learned my addr 172.21.15.55:0/920379020 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:36.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.046+0000 7f8e4fe00640 1 --2- 172.21.15.55:0/920379020 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e500cd8b0 0x7f8e500c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:36.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.046+0000 7f8e4ea00640 1 -- 172.21.15.55:0/920379020 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e500cd8b0 msgr2=0x7f8e500c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:36.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.046+0000 7f8e4ea00640 1 --2- 172.21.15.55:0/920379020 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e500cd8b0 0x7f8e500c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:36.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.046+0000 7f8e4ea00640 1 -- 172.21.15.55:0/920379020 >> v1:172.21.15.106:6789/0 conn(0x7f8e50143f90 legacy=0x7f8e500b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:36.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.046+0000 7f8e4ea00640 1 -- 172.21.15.55:0/920379020 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e500c37b0 con 0x7f8e5015ad30 2024-04-02T07:30:36.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.050+0000 7f8e4ea00640 1 --2- 172.21.15.55:0/920379020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e5015ad30 0x7f8e500cd370 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009870 tx=0x7f8e3c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6240454eca0ce137 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:36.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.050+0000 7f8e4e000640 1 -- 172.21.15.55:0/920379020 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c0a6040 con 0x7f8e5015ad30 2024-04-02T07:30:36.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.050+0000 7f8e4e000640 1 -- 172.21.15.55:0/920379020 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c0aa600 con 0x7f8e5015ad30 2024-04-02T07:30:36.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.050+0000 7f8e4e000640 1 -- 172.21.15.55:0/920379020 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c0aa990 con 0x7f8e5015ad30 2024-04-02T07:30:36.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.050+0000 7f8e56200640 1 -- 172.21.15.55:0/920379020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e5015ad30 msgr2=0x7f8e500cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:36.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.050+0000 7f8e56200640 1 --2- 172.21.15.55:0/920379020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e5015ad30 0x7f8e500cd370 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c009870 tx=0x7f8e3c01c4a0 comp rx=0 tx=0).stop 2024-04-02T07:30:36.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.050+0000 7f8e56200640 1 -- 172.21.15.55:0/920379020 shutdown_connections 2024-04-02T07:30:36.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.050+0000 7f8e56200640 1 --2- 172.21.15.55:0/920379020 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e500cd8b0 0x7f8e500c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:36.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.050+0000 7f8e56200640 1 --2- 172.21.15.55:0/920379020 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e5015ad30 0x7f8e500cd370 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:36.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.050+0000 7f8e56200640 1 -- 172.21.15.55:0/920379020 >> 172.21.15.55:0/920379020 conn(0x7f8e50066080 msgr2=0x7f8e50069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:36.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.050+0000 7f8e56200640 1 -- 172.21.15.55:0/920379020 shutdown_connections 2024-04-02T07:30:36.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.050+0000 7f8e56200640 1 -- 172.21.15.55:0/920379020 wait complete. 2024-04-02T07:30:36.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.050+0000 7f8e56200640 1 Processor -- start 2024-04-02T07:30:36.052 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.050+0000 7f8e56200640 1 -- start start 2024-04-02T07:30:36.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e56200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e500cd8b0 0x7f8e50071810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:36.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e56200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e50143f90 0x7f8e500cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:36.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e56200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e5015ad30 0x7f8e5013bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:36.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e56200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5015a7b0 con 0x7f8e50143f90 2024-04-02T07:30:36.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e56200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e501642a0 con 0x7f8e5015ad30 2024-04-02T07:30:36.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e56200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e50164560 con 0x7f8e500cd8b0 2024-04-02T07:30:36.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e4ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e50143f90 0x7f8e500cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:36.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e4ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e50143f90 0x7f8e500cbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59492/0 (socket says 172.21.15.55:59492) 2024-04-02T07:30:36.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e4ea00640 1 -- 172.21.15.55:0/1464225147 learned_addr learned my addr 172.21.15.55:0/1464225147 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:36.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e4fe00640 1 --2- 172.21.15.55:0/1464225147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e5015ad30 0x7f8e5013bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:36.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e4f400640 1 --2- 172.21.15.55:0/1464225147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e500cd8b0 0x7f8e50071810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:36.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e4ea00640 1 -- 172.21.15.55:0/1464225147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e500cd8b0 msgr2=0x7f8e50071810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:36.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e4ea00640 1 --2- 172.21.15.55:0/1464225147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e500cd8b0 0x7f8e50071810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:36.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e4ea00640 1 -- 172.21.15.55:0/1464225147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e5015ad30 msgr2=0x7f8e5013bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:36.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e4ea00640 1 --2- 172.21.15.55:0/1464225147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e5015ad30 0x7f8e5013bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:36.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e4ea00640 1 -- 172.21.15.55:0/1464225147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e3c0094d0 con 0x7f8e50143f90 2024-04-02T07:30:36.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e4ea00640 1 --2- 172.21.15.55:0/1464225147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e50143f90 0x7f8e500cbc40 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c01a0d0 tx=0x7f8e3c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:36.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e47400640 1 -- 172.21.15.55:0/1464225147 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c0aae30 con 0x7f8e50143f90 2024-04-02T07:30:36.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e47400640 1 -- 172.21.15.55:0/1464225147 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e3c0b7070 con 0x7f8e50143f90 2024-04-02T07:30:36.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e47400640 1 -- 172.21.15.55:0/1464225147 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c0bd640 con 0x7f8e50143f90 2024-04-02T07:30:36.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e56200640 1 -- 172.21.15.55:0/1464225147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e50164840 con 0x7f8e50143f90 2024-04-02T07:30:36.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e56200640 1 -- 172.21.15.55:0/1464225147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e50164e00 con 0x7f8e50143f90 2024-04-02T07:30:36.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e56200640 1 -- 172.21.15.55:0/1464225147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e50066c90 con 0x7f8e50143f90 2024-04-02T07:30:36.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.054+0000 7f8e47400640 1 -- 172.21.15.55:0/1464225147 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8e3c0c6450 con 0x7f8e50143f90 2024-04-02T07:30:36.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.058+0000 7f8e47400640 1 --2- 172.21.15.55:0/1464225147 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8e30066690 0x7f8e30068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:36.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.058+0000 7f8e47400640 1 -- 172.21.15.55:0/1464225147 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f8e500c55a0 con 0x7f8e50143f90 2024-04-02T07:30:36.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.058+0000 7f8e4f400640 1 --2- 172.21.15.55:0/1464225147 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8e30066690 0x7f8e30068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:36.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.058+0000 7f8e4f400640 1 --2- 172.21.15.55:0/1464225147 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8e30066690 0x7f8e30068b50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8e40001810 tx=0x7f8e40009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:36.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.062+0000 7f8e47400640 1 -- 172.21.15.55:0/1464225147 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f8e3c0eb860 con 0x7f8e50143f90 2024-04-02T07:30:36.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.254+0000 7f8e56200640 1 -- 172.21.15.55:0/1464225147 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e500b2880 con 0x7f8e50143f90 2024-04-02T07:30:36.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.254+0000 7f8e47400640 1 -- 172.21.15.55:0/1464225147 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f8e3c0eee80 con 0x7f8e50143f90 2024-04-02T07:30:36.256 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:30:36.256 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":70,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2209852195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2209852195},{"type":"v1","addr":"172.21.15.55:6835","nonce":2209852195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1897181831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1897181831},{"type":"v1","addr":"172.21.15.106:6835","nonce":1897181831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1894364429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1894364429},{"type":"v1","addr":"172.21.15.106:6837","nonce":1894364429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:28:53.919977+0000","modified":"2024-04-02T07:30:35.882231+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8052":{"gid":8052,"name":"a","rank":0,"incarnation":70,"state":"up:replay","state_seq":1,"addr":"172.21.15.55:6834/2658455613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2658455613},{"type":"v1","addr":"172.21.15.55:6834","nonce":2658455613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-02T07:30:36.256 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 70 2024-04-02T07:30:36.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.254+0000 7f8e56200640 1 -- 172.21.15.55:0/1464225147 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8e30066690 msgr2=0x7f8e30068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:36.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.254+0000 7f8e56200640 1 --2- 172.21.15.55:0/1464225147 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8e30066690 0x7f8e30068b50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8e40001810 tx=0x7f8e40009040 comp rx=0 tx=0).stop 2024-04-02T07:30:36.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.254+0000 7f8e56200640 1 -- 172.21.15.55:0/1464225147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e50143f90 msgr2=0x7f8e500cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:36.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.254+0000 7f8e56200640 1 --2- 172.21.15.55:0/1464225147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e50143f90 0x7f8e500cbc40 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c01a0d0 tx=0x7f8e3c019240 comp rx=0 tx=0).stop 2024-04-02T07:30:36.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.254+0000 7f8e56200640 1 -- 172.21.15.55:0/1464225147 shutdown_connections 2024-04-02T07:30:36.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.254+0000 7f8e56200640 1 --2- 172.21.15.55:0/1464225147 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8e30066690 0x7f8e30068b50 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:36.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.254+0000 7f8e56200640 1 --2- 172.21.15.55:0/1464225147 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e5015ad30 0x7f8e5013bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:36.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.254+0000 7f8e56200640 1 --2- 172.21.15.55:0/1464225147 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e50143f90 0x7f8e500cbc40 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:36.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.254+0000 7f8e56200640 1 --2- 172.21.15.55:0/1464225147 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e500cd8b0 0x7f8e50071810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:36.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.254+0000 7f8e56200640 1 -- 172.21.15.55:0/1464225147 >> 172.21.15.55:0/1464225147 conn(0x7f8e50066080 msgr2=0x7f8e5013fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:36.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.254+0000 7f8e56200640 1 -- 172.21.15.55:0/1464225147 shutdown_connections 2024-04-02T07:30:36.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:36.258+0000 7f8e56200640 1 -- 172.21.15.55:0/1464225147 wait complete. 2024-04-02T07:30:36.679 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:28:53.919977+0000', 'modified': '2024-04-02T07:30:35.882231+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 91, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8052}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8052': {'gid': 8052, 'name': 'a', 'rank': 0, 'incarnation': 70, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.55:6834/2658455613', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 2658455613}, {'type': 'v1', 'addr': '172.21.15.55:6834', 'nonce': 2658455613}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:30:36.679 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8052:up:replay 2024-04-02T07:30:37.680 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:30:37.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.830+0000 7fa432e00640 1 Processor -- start 2024-04-02T07:30:37.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.830+0000 7fa432e00640 1 -- start start 2024-04-02T07:30:37.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.830+0000 7fa432e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa42c0c4120 0x7fa42c0b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:37.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.830+0000 7fa432e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c13d0c0 con 0x7fa42c153ea0 2024-04-02T07:30:37.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.830+0000 7fa432e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa42c15a4f0 con 0x7fa42c0b36f0 2024-04-02T07:30:37.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.830+0000 7fa432e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0c4580 con 0x7fa42c0c4120 2024-04-02T07:30:37.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.830+0000 7fa42be00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa42c153ea0 0x7fa42c159be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58126/0 (socket says 172.21.15.55:58126) 2024-04-02T07:30:37.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.830+0000 7fa42be00640 1 -- 172.21.15.55:0/1282911362 learned_addr learned my addr 172.21.15.55:0/1282911362 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:30:37.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.830+0000 7fa423e00640 1 --2- 172.21.15.55:0/1282911362 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa42c0c4120 0x7fa42c0b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:37.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.830+0000 7fa42b400640 1 -- 172.21.15.55:0/1282911362 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 756558534 0 0) 0x7fa42c13d0c0 con 0x7fa42c153ea0 2024-04-02T07:30:37.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.830+0000 7fa42b400640 1 -- 172.21.15.55:0/1282911362 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa410003530 con 0x7fa42c153ea0 2024-04-02T07:30:37.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa42b400640 1 -- 172.21.15.55:0/1282911362 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1773939022 0 0) 0x7fa410003530 con 0x7fa42c153ea0 2024-04-02T07:30:37.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa42b400640 1 -- 172.21.15.55:0/1282911362 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa42c0c4120 msgr2=0x7fa42c0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:37.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa42b400640 1 --2- 172.21.15.55:0/1282911362 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa42c0c4120 0x7fa42c0b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:37.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa42b400640 1 -- 172.21.15.55:0/1282911362 >> v1:172.21.15.106:6789/0 conn(0x7fa42c0b36f0 legacy=0x7fa42c13d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:37.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa42b400640 1 -- 172.21.15.55:0/1282911362 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c15a7d0 con 0x7fa42c153ea0 2024-04-02T07:30:37.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa42b400640 1 -- 172.21.15.55:0/1282911362 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fa41c001680 con 0x7fa42c153ea0 2024-04-02T07:30:37.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa42b400640 1 -- 172.21.15.55:0/1282911362 >> v1:172.21.15.55:6789/0 conn(0x7fa42c153ea0 legacy=0x7fa42c159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:37.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa42b400640 1 --2- 172.21.15.55:0/1282911362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4100039b0 0x7fa410003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:37.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa42b400640 1 --2- 172.21.15.55:0/1282911362 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa410004360 0x7fa410004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:37.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa42b400640 1 --2- 172.21.15.55:0/1282911362 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa42c0c4120 0x7fa410005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:37.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa42b400640 1 -- 172.21.15.55:0/1282911362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c0c4580 con 0x7fa4100039b0 2024-04-02T07:30:37.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa42b400640 1 -- 172.21.15.55:0/1282911362 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41000b990 con 0x7fa410004360 2024-04-02T07:30:37.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa42b400640 1 -- 172.21.15.55:0/1282911362 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa41000bb50 con 0x7fa42c0c4120 2024-04-02T07:30:37.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa42be00640 1 --2- 172.21.15.55:0/1282911362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4100039b0 0x7fa410003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:37.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa423e00640 1 --2- 172.21.15.55:0/1282911362 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa410004360 0x7fa410004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:37.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa430e00640 1 --2- 172.21.15.55:0/1282911362 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa42c0c4120 0x7fa410005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:37.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa42be00640 1 -- 172.21.15.55:0/1282911362 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa42c0c4120 msgr2=0x7fa410005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:37.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa42be00640 1 --2- 172.21.15.55:0/1282911362 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa42c0c4120 0x7fa410005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:37.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa42be00640 1 -- 172.21.15.55:0/1282911362 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa410004360 msgr2=0x7fa410004830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:37.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa42be00640 1 --2- 172.21.15.55:0/1282911362 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa410004360 0x7fa410004830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:37.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa42be00640 1 -- 172.21.15.55:0/1282911362 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa410003530 con 0x7fa4100039b0 2024-04-02T07:30:37.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.834+0000 7fa42be00640 1 --2- 172.21.15.55:0/1282911362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4100039b0 0x7fa410003d90 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00c190 tx=0x7fa41c01cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67bd7612f0318d26 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:37.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa42b400640 1 -- 172.21.15.55:0/1282911362 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c005ae0 con 0x7fa4100039b0 2024-04-02T07:30:37.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa42b400640 1 -- 172.21.15.55:0/1282911362 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41c005c60 con 0x7fa4100039b0 2024-04-02T07:30:37.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa42b400640 1 -- 172.21.15.55:0/1282911362 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c0a57f0 con 0x7fa4100039b0 2024-04-02T07:30:37.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa432e00640 1 -- 172.21.15.55:0/1282911362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4100039b0 msgr2=0x7fa410003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:37.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa432e00640 1 --2- 172.21.15.55:0/1282911362 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4100039b0 0x7fa410003d90 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00c190 tx=0x7fa41c01cc00 comp rx=0 tx=0).stop 2024-04-02T07:30:37.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa430e00640 1 -- 172.21.15.55:0/1282911362 reap_dead start 2024-04-02T07:30:37.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa432e00640 1 -- 172.21.15.55:0/1282911362 shutdown_connections 2024-04-02T07:30:37.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa432e00640 1 -- 172.21.15.55:0/1282911362 >> 172.21.15.55:0/1282911362 conn(0x7fa42c066080 msgr2=0x7fa42c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:37.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa432e00640 1 -- 172.21.15.55:0/1282911362 shutdown_connections 2024-04-02T07:30:37.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa432e00640 1 -- 172.21.15.55:0/1282911362 wait complete. 2024-04-02T07:30:37.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa432e00640 1 Processor -- start 2024-04-02T07:30:37.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa432e00640 1 -- start start 2024-04-02T07:30:37.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa432e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4100039b0 0x7fa42c152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:37.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa432e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa42c154280 0x7fa42c158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:37.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa432e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa42c1589d0 0x7fa42c0cd100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:37.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa432e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c159150 con 0x7fa42c1589d0 2024-04-02T07:30:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa432e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c15e7e0 con 0x7fa4100039b0 2024-04-02T07:30:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa432e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa42c1532e0 con 0x7fa42c154280 2024-04-02T07:30:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa430e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa42c1589d0 0x7fa42c0cd100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa430e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa42c1589d0 0x7fa42c0cd100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59524/0 (socket says 172.21.15.55:59524) 2024-04-02T07:30:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.838+0000 7fa430e00640 1 -- 172.21.15.55:0/1069547738 learned_addr learned my addr 172.21.15.55:0/1069547738 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.842+0000 7fa423e00640 1 --2- 172.21.15.55:0/1069547738 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa42c154280 0x7fa42c158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.842+0000 7fa42be00640 1 --2- 172.21.15.55:0/1069547738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4100039b0 0x7fa42c152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.842+0000 7fa430e00640 1 -- 172.21.15.55:0/1069547738 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa42c154280 msgr2=0x7fa42c158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.842+0000 7fa430e00640 1 --2- 172.21.15.55:0/1069547738 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa42c154280 0x7fa42c158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.842+0000 7fa430e00640 1 -- 172.21.15.55:0/1069547738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4100039b0 msgr2=0x7fa42c152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.842+0000 7fa430e00640 1 --2- 172.21.15.55:0/1069547738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4100039b0 0x7fa42c152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.842+0000 7fa430e00640 1 -- 172.21.15.55:0/1069547738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa42c158e70 con 0x7fa42c1589d0 2024-04-02T07:30:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.842+0000 7fa430e00640 1 --2- 172.21.15.55:0/1069547738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa42c1589d0 0x7fa42c0cd100 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0b1430 tx=0x7fa42400ff50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:37.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.842+0000 7fa428c00640 1 -- 172.21.15.55:0/1069547738 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424006d70 con 0x7fa42c1589d0 2024-04-02T07:30:37.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.842+0000 7fa428c00640 1 -- 172.21.15.55:0/1069547738 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa424003980 con 0x7fa42c1589d0 2024-04-02T07:30:37.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.842+0000 7fa428c00640 1 -- 172.21.15.55:0/1069547738 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa424003d30 con 0x7fa42c1589d0 2024-04-02T07:30:37.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.842+0000 7fa432e00640 1 -- 172.21.15.55:0/1069547738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa42c15e190 con 0x7fa42c1589d0 2024-04-02T07:30:37.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.842+0000 7fa432e00640 1 -- 172.21.15.55:0/1069547738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa42c1330c0 con 0x7fa42c1589d0 2024-04-02T07:30:37.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.842+0000 7fa432e00640 1 -- 172.21.15.55:0/1069547738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa42c066c90 con 0x7fa42c1589d0 2024-04-02T07:30:37.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.842+0000 7fa428c00640 1 -- 172.21.15.55:0/1069547738 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa42400d740 con 0x7fa42c1589d0 2024-04-02T07:30:37.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.842+0000 7fa428c00640 1 --2- 172.21.15.55:0/1069547738 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4080666c0 0x7fa408068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:37.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.842+0000 7fa428c00640 1 -- 172.21.15.55:0/1069547738 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fa4240834b0 con 0x7fa42c1589d0 2024-04-02T07:30:37.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.842+0000 7fa42be00640 1 --2- 172.21.15.55:0/1069547738 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4080666c0 0x7fa408068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:37.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.846+0000 7fa42be00640 1 --2- 172.21.15.55:0/1069547738 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4080666c0 0x7fa408068b80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa41c005fd0 tx=0x7fa41c0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:37.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:37.846+0000 7fa428c00640 1 -- 172.21.15.55:0/1069547738 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa4240506b0 con 0x7fa42c1589d0 2024-04-02T07:30:38.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:38.046+0000 7fa432e00640 1 -- 172.21.15.55:0/1069547738 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa42c15e920 con 0x7fa42c1589d0 2024-04-02T07:30:38.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:38.046+0000 7fa428c00640 1 -- 172.21.15.55:0/1069547738 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+4743 (secure 0 0 0) 0x7fa424053cd0 con 0x7fa42c1589d0 2024-04-02T07:30:38.047 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:30:38.048 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":72,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2209852195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2209852195},{"type":"v1","addr":"172.21.15.55:6835","nonce":2209852195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1897181831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1897181831},{"type":"v1","addr":"172.21.15.106:6835","nonce":1897181831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1894364429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1894364429},{"type":"v1","addr":"172.21.15.106:6837","nonce":1894364429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":72,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:28:53.919977+0000","modified":"2024-04-02T07:30:37.886300+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8052":{"gid":8052,"name":"a","rank":0,"incarnation":70,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.55:6834/2658455613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2658455613},{"type":"v1","addr":"172.21.15.55:6834","nonce":2658455613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-02T07:30:38.048 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 72 2024-04-02T07:30:38.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:38.046+0000 7fa432e00640 1 -- 172.21.15.55:0/1069547738 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4080666c0 msgr2=0x7fa408068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:38.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:38.046+0000 7fa432e00640 1 --2- 172.21.15.55:0/1069547738 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4080666c0 0x7fa408068b80 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa41c005fd0 tx=0x7fa41c0a7070 comp rx=0 tx=0).stop 2024-04-02T07:30:38.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:38.046+0000 7fa432e00640 1 -- 172.21.15.55:0/1069547738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa42c1589d0 msgr2=0x7fa42c0cd100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:38.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:38.046+0000 7fa432e00640 1 --2- 172.21.15.55:0/1069547738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa42c1589d0 0x7fa42c0cd100 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7fa42c0b1430 tx=0x7fa42400ff50 comp rx=0 tx=0).stop 2024-04-02T07:30:38.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:38.046+0000 7fa432e00640 1 -- 172.21.15.55:0/1069547738 shutdown_connections 2024-04-02T07:30:38.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:38.046+0000 7fa432e00640 1 --2- 172.21.15.55:0/1069547738 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa42c1589d0 0x7fa42c0cd100 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:38.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:38.046+0000 7fa432e00640 1 --2- 172.21.15.55:0/1069547738 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa42c154280 0x7fa42c158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:38.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:38.046+0000 7fa432e00640 1 --2- 172.21.15.55:0/1069547738 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4080666c0 0x7fa408068b80 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:38.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:38.046+0000 7fa432e00640 1 --2- 172.21.15.55:0/1069547738 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4100039b0 0x7fa42c152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:38.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:38.046+0000 7fa432e00640 1 -- 172.21.15.55:0/1069547738 >> 172.21.15.55:0/1069547738 conn(0x7fa42c066080 msgr2=0x7fa42c0b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:38.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:38.046+0000 7fa432e00640 1 -- 172.21.15.55:0/1069547738 shutdown_connections 2024-04-02T07:30:38.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:38.046+0000 7fa432e00640 1 -- 172.21.15.55:0/1069547738 wait complete. 2024-04-02T07:30:38.471 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 72, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:28:53.919977+0000', 'modified': '2024-04-02T07:30:37.886300+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 91, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8052}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8052': {'gid': 8052, 'name': 'a', 'rank': 0, 'incarnation': 70, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.55:6834/2658455613', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 2658455613}, {'type': 'v1', 'addr': '172.21.15.55:6834', 'nonce': 2658455613}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:30:38.471 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8052:up:rejoin 2024-04-02T07:30:39.471 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:30:39.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.622+0000 7f3913800640 1 Processor -- start 2024-04-02T07:30:39.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.622+0000 7f3913800640 1 -- start start 2024-04-02T07:30:39.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.622+0000 7f3913800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f390c0c4120 0x7f390c0b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:39.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.622+0000 7f3913800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f390c0b36f0 0x7f390c13d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:39.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.622+0000 7f3913800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c13d0c0 con 0x7f390c153ea0 2024-04-02T07:30:39.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.622+0000 7f3913800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390c0c4580 con 0x7f390c0b36f0 2024-04-02T07:30:39.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.622+0000 7f3913800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c15a2f0 con 0x7f390c0c4120 2024-04-02T07:30:39.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.622+0000 7f3911800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f390c0b36f0 0x7f390c13d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:39.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.622+0000 7f3910e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f390c153ea0 0x7f390c159be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58128/0 (socket says 172.21.15.55:58128) 2024-04-02T07:30:39.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.622+0000 7f3910e00640 1 -- 172.21.15.55:0/383225770 learned_addr learned my addr 172.21.15.55:0/383225770 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:30:39.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.626+0000 7f390be00640 1 --2- 172.21.15.55:0/383225770 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f390c0c4120 0x7f390c0b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:39.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.626+0000 7f390b400640 1 -- 172.21.15.55:0/383225770 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3249105580 0 0) 0x7f390c13d0c0 con 0x7f390c153ea0 2024-04-02T07:30:39.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.626+0000 7f390b400640 1 -- 172.21.15.55:0/383225770 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38f4005740 con 0x7f390c153ea0 2024-04-02T07:30:39.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.626+0000 7f3911800640 1 -- 172.21.15.55:0/383225770 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f390c0c4120 msgr2=0x7f390c0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:39.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.626+0000 7f3911800640 1 --2- 172.21.15.55:0/383225770 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f390c0c4120 0x7f390c0b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:39.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.626+0000 7f3911800640 1 -- 172.21.15.55:0/383225770 >> v1:172.21.15.55:6789/0 conn(0x7f390c153ea0 legacy=0x7f390c159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:39.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.626+0000 7f3911800640 1 -- 172.21.15.55:0/383225770 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c15a4f0 con 0x7f390c0b36f0 2024-04-02T07:30:39.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.626+0000 7f3911800640 1 --2- 172.21.15.55:0/383225770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f390c0b36f0 0x7f390c13d550 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f3904009d90 tx=0x7f390401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b96c14abe7eb5a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:39.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.626+0000 7f390b400640 1 -- 172.21.15.55:0/383225770 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39040a5940 con 0x7f390c0b36f0 2024-04-02T07:30:39.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.626+0000 7f390b400640 1 -- 172.21.15.55:0/383225770 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39040a5aa0 con 0x7f390c0b36f0 2024-04-02T07:30:39.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.626+0000 7f390b400640 1 -- 172.21.15.55:0/383225770 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39040a5e30 con 0x7f390c0b36f0 2024-04-02T07:30:39.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.626+0000 7f3913800640 1 -- 172.21.15.55:0/383225770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f390c0b36f0 msgr2=0x7f390c13d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:39.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.626+0000 7f3913800640 1 --2- 172.21.15.55:0/383225770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f390c0b36f0 0x7f390c13d550 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f3904009d90 tx=0x7f390401c970 comp rx=0 tx=0).stop 2024-04-02T07:30:39.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3913800640 1 -- 172.21.15.55:0/383225770 shutdown_connections 2024-04-02T07:30:39.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3913800640 1 --2- 172.21.15.55:0/383225770 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f390c0c4120 0x7f390c0b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:39.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3913800640 1 --2- 172.21.15.55:0/383225770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f390c0b36f0 0x7f390c13d550 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:39.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3913800640 1 -- 172.21.15.55:0/383225770 >> 172.21.15.55:0/383225770 conn(0x7f390c066080 msgr2=0x7f390c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:39.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3913800640 1 -- 172.21.15.55:0/383225770 shutdown_connections 2024-04-02T07:30:39.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3913800640 1 -- 172.21.15.55:0/383225770 wait complete. 2024-04-02T07:30:39.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3913800640 1 Processor -- start 2024-04-02T07:30:39.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3913800640 1 -- start start 2024-04-02T07:30:39.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3913800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f390c0b36f0 0x7f390c0ccb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:39.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3913800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f390c0c4120 0x7f390c153040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:39.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3913800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f390c153ea0 0x7f390c0b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:39.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3913800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c153580 con 0x7f390c0b36f0 2024-04-02T07:30:39.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3913800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c0cd120 con 0x7f390c0c4120 2024-04-02T07:30:39.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3913800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c0cb5c0 con 0x7f390c153ea0 2024-04-02T07:30:39.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3910e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f390c0b36f0 0x7f390c0ccb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:39.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3910e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f390c0b36f0 0x7f390c0ccb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59540/0 (socket says 172.21.15.55:59540) 2024-04-02T07:30:39.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3910e00640 1 -- 172.21.15.55:0/2319733032 learned_addr learned my addr 172.21.15.55:0/2319733032 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:39.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3910e00640 1 -- 172.21.15.55:0/2319733032 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f390c153ea0 msgr2=0x7f390c0b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:39.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3911800640 1 --2- 172.21.15.55:0/2319733032 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f390c153ea0 0x7f390c0b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:39.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f390be00640 1 --2- 172.21.15.55:0/2319733032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f390c0c4120 0x7f390c153040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:39.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3910e00640 1 --2- 172.21.15.55:0/2319733032 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f390c153ea0 0x7f390c0b2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:39.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3910e00640 1 -- 172.21.15.55:0/2319733032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f390c0c4120 msgr2=0x7f390c153040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:39.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3910e00640 1 --2- 172.21.15.55:0/2319733032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f390c0c4120 0x7f390c153040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:39.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3910e00640 1 -- 172.21.15.55:0/2319733032 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3904009a70 con 0x7f390c0b36f0 2024-04-02T07:30:39.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f390be00640 1 --2- 172.21.15.55:0/2319733032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f390c0c4120 0x7f390c153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:30:39.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3910e00640 1 --2- 172.21.15.55:0/2319733032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f390c0b36f0 0x7f390c0ccb40 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f390000c420 tx=0x7f390000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:39.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3908c00640 1 -- 172.21.15.55:0/2319733032 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900005cf0 con 0x7f390c0b36f0 2024-04-02T07:30:39.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3908c00640 1 -- 172.21.15.55:0/2319733032 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3900005e50 con 0x7f390c0b36f0 2024-04-02T07:30:39.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3908c00640 1 -- 172.21.15.55:0/2319733032 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39000072d0 con 0x7f390c0b36f0 2024-04-02T07:30:39.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.630+0000 7f3913800640 1 -- 172.21.15.55:0/2319733032 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390c0cb8a0 con 0x7f390c0b36f0 2024-04-02T07:30:39.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.634+0000 7f3913800640 1 -- 172.21.15.55:0/2319733032 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390c0cbe60 con 0x7f390c0b36f0 2024-04-02T07:30:39.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.634+0000 7f3913800640 1 -- 172.21.15.55:0/2319733032 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390c066c90 con 0x7f390c0b36f0 2024-04-02T07:30:39.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.634+0000 7f3908c00640 1 -- 172.21.15.55:0/2319733032 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3900007430 con 0x7f390c0b36f0 2024-04-02T07:30:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.634+0000 7f3908c00640 1 --2- 172.21.15.55:0/2319733032 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f38ec066690 0x7f38ec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.634+0000 7f3908c00640 1 -- 172.21.15.55:0/2319733032 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f3900083870 con 0x7f390c0b36f0 2024-04-02T07:30:39.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.634+0000 7f390be00640 1 --2- 172.21.15.55:0/2319733032 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f38ec066690 0x7f38ec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:39.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.638+0000 7f390be00640 1 --2- 172.21.15.55:0/2319733032 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f38ec066690 0x7f38ec068b50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f390c067450 tx=0x7f38f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:39.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.638+0000 7f3908c00640 1 -- 172.21.15.55:0/2319733032 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3900050b20 con 0x7f390c0b36f0 2024-04-02T07:30:39.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.834+0000 7f3913800640 1 -- 172.21.15.55:0/2319733032 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f390c0cb3a0 con 0x7f390c0b36f0 2024-04-02T07:30:39.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.834+0000 7f3908c00640 1 -- 172.21.15.55:0/2319733032 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f3900017090 con 0x7f390c0b36f0 2024-04-02T07:30:39.836 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:30:39.836 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2209852195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2209852195},{"type":"v1","addr":"172.21.15.55:6835","nonce":2209852195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1897181831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1897181831},{"type":"v1","addr":"172.21.15.106:6835","nonce":1897181831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1894364429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1894364429},{"type":"v1","addr":"172.21.15.106:6837","nonce":1894364429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:28:53.919977+0000","modified":"2024-04-02T07:30:38.894246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8052":{"gid":8052,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6834/2658455613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2658455613},{"type":"v1","addr":"172.21.15.55:6834","nonce":2658455613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-02T07:30:39.837 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 73 2024-04-02T07:30:39.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.838+0000 7f3913800640 1 -- 172.21.15.55:0/2319733032 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f38ec066690 msgr2=0x7f38ec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:39.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.838+0000 7f3913800640 1 --2- 172.21.15.55:0/2319733032 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f38ec066690 0x7f38ec068b50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f390c067450 tx=0x7f38f8008040 comp rx=0 tx=0).stop 2024-04-02T07:30:39.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.838+0000 7f3913800640 1 -- 172.21.15.55:0/2319733032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f390c0b36f0 msgr2=0x7f390c0ccb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:39.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.838+0000 7f3913800640 1 --2- 172.21.15.55:0/2319733032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f390c0b36f0 0x7f390c0ccb40 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f390000c420 tx=0x7f390000c8e0 comp rx=0 tx=0).stop 2024-04-02T07:30:39.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.838+0000 7f3913800640 1 -- 172.21.15.55:0/2319733032 shutdown_connections 2024-04-02T07:30:39.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.838+0000 7f3913800640 1 --2- 172.21.15.55:0/2319733032 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f390c153ea0 0x7f390c0b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.838+0000 7f3913800640 1 --2- 172.21.15.55:0/2319733032 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f38ec066690 0x7f38ec068b50 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.838+0000 7f3913800640 1 --2- 172.21.15.55:0/2319733032 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f390c0c4120 0x7f390c153040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.838+0000 7f3913800640 1 --2- 172.21.15.55:0/2319733032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f390c0b36f0 0x7f390c0ccb40 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.838+0000 7f3913800640 1 -- 172.21.15.55:0/2319733032 >> 172.21.15.55:0/2319733032 conn(0x7f390c066080 msgr2=0x7f390c135d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.838+0000 7f3913800640 1 -- 172.21.15.55:0/2319733032 shutdown_connections 2024-04-02T07:30:39.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:39.838+0000 7f3913800640 1 -- 172.21.15.55:0/2319733032 wait complete. 2024-04-02T07:30:40.261 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 73, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:28:53.919977+0000', 'modified': '2024-04-02T07:30:38.894246+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 91, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8052}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8052': {'gid': 8052, 'name': 'a', 'rank': 0, 'incarnation': 70, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.55:6834/2658455613', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 2658455613}, {'type': 'v1', 'addr': '172.21.15.55:6834', 'nonce': 2658455613}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:30:40.261 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-02T07:30:40.261 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-02T07:30:40.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6747e00640 1 Processor -- start 2024-04-02T07:30:40.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6747e00640 1 -- start start 2024-04-02T07:30:40.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6747e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f67480b1150 0x7f67480b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6747e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67480b1e30 con 0x7f6748098a10 2024-04-02T07:30:40.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6747e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6748099dc0 con 0x7f67480cf420 2024-04-02T07:30:40.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6747e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67480ce170 con 0x7f67480b1150 2024-04-02T07:30:40.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6746a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6748098a10 0x7f6748098df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58132/0 (socket says 172.21.15.55:58132) 2024-04-02T07:30:40.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6746a00640 1 -- 172.21.15.55:0/1105523865 learned_addr learned my addr 172.21.15.55:0/1105523865 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:30:40.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6747400640 1 --2- 172.21.15.55:0/1105523865 >> v2:172.21.15.106:3300/0 conn(0x7f67480b1150 0x7f67480b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6746000640 1 -- 172.21.15.55:0/1105523865 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799529806 0 0) 0x7f67480b1e30 con 0x7f6748098a10 2024-04-02T07:30:40.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6746000640 1 -- 172.21.15.55:0/1105523865 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f672c003530 con 0x7f6748098a10 2024-04-02T07:30:40.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6746000640 1 -- 172.21.15.55:0/1105523865 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1636393636 0 0) 0x7f6748099dc0 con 0x7f67480cf420 2024-04-02T07:30:40.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6746000640 1 -- 172.21.15.55:0/1105523865 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f67480b1e30 con 0x7f67480cf420 2024-04-02T07:30:40.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6746000640 1 -- 172.21.15.55:0/1105523865 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 826522062 0 0) 0x7f672c003530 con 0x7f6748098a10 2024-04-02T07:30:40.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6746000640 1 -- 172.21.15.55:0/1105523865 >> v2:172.21.15.106:3300/0 conn(0x7f67480b1150 msgr2=0x7f67480b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:40.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6746000640 1 --2- 172.21.15.55:0/1105523865 >> v2:172.21.15.106:3300/0 conn(0x7f67480b1150 0x7f67480b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6746000640 1 -- 172.21.15.55:0/1105523865 >> v1:172.21.15.106:6789/0 conn(0x7f67480cf420 legacy=0x7f67480cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:40.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6746000640 1 -- 172.21.15.55:0/1105523865 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67480ce450 con 0x7f6748098a10 2024-04-02T07:30:40.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6746000640 1 -- 172.21.15.55:0/1105523865 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f6738001680 con 0x7f6748098a10 2024-04-02T07:30:40.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6746000640 1 -- 172.21.15.55:0/1105523865 >> v1:172.21.15.55:6789/0 conn(0x7f6748098a10 legacy=0x7f6748098df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:40.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6746000640 1 --2- 172.21.15.55:0/1105523865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f672c003b40 0x7f672c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6746000640 1 --2- 172.21.15.55:0/1105523865 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f672c0047d0 0x7f672c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6746000640 1 --2- 172.21.15.55:0/1105523865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c005190 0x7f672c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6746000640 1 -- 172.21.15.55:0/1105523865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67480ce170 con 0x7f672c005190 2024-04-02T07:30:40.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6746000640 1 -- 172.21.15.55:0/1105523865 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f672c00c0e0 con 0x7f672c003b40 2024-04-02T07:30:40.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6746000640 1 -- 172.21.15.55:0/1105523865 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f672c00c2a0 con 0x7f672c0047d0 2024-04-02T07:30:40.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6747400640 1 --2- 172.21.15.55:0/1105523865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c005190 0x7f672c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f6746a00640 1 --2- 172.21.15.55:0/1105523865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f672c003b40 0x7f672c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.406+0000 7f673fe00640 1 --2- 172.21.15.55:0/1105523865 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f672c0047d0 0x7f672c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.410+0000 7f6747400640 1 -- 172.21.15.55:0/1105523865 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f672c0047d0 msgr2=0x7f672c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:40.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.410+0000 7f6747400640 1 --2- 172.21.15.55:0/1105523865 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f672c0047d0 0x7f672c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.410+0000 7f6747400640 1 -- 172.21.15.55:0/1105523865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f672c003b40 msgr2=0x7f672c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:40.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.410+0000 7f6747400640 1 --2- 172.21.15.55:0/1105523865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f672c003b40 0x7f672c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.410+0000 7f6747400640 1 -- 172.21.15.55:0/1105523865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f672c003530 con 0x7f672c005190 2024-04-02T07:30:40.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.410+0000 7f6747400640 1 -- 172.21.15.55:0/1105523865 reap_dead start 2024-04-02T07:30:40.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.410+0000 7f6747400640 1 --2- 172.21.15.55:0/1105523865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c005190 0x7f672c00b990 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f6740009fc0 tx=0x7f674001ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6eb2cc777e8751c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:40.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.410+0000 7f6746000640 1 -- 172.21.15.55:0/1105523865 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67400a5cd0 con 0x7f672c005190 2024-04-02T07:30:40.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.410+0000 7f6746000640 1 -- 172.21.15.55:0/1105523865 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f674000f040 con 0x7f672c005190 2024-04-02T07:30:40.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.410+0000 7f6746000640 1 -- 172.21.15.55:0/1105523865 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740003be0 con 0x7f672c005190 2024-04-02T07:30:40.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.410+0000 7f6747e00640 1 -- 172.21.15.55:0/1105523865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c005190 msgr2=0x7f672c00b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:40.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.410+0000 7f6747e00640 1 --2- 172.21.15.55:0/1105523865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c005190 0x7f672c00b990 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f6740009fc0 tx=0x7f674001ccc0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.410+0000 7f6747e00640 1 -- 172.21.15.55:0/1105523865 shutdown_connections 2024-04-02T07:30:40.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.410+0000 7f6747e00640 1 --2- 172.21.15.55:0/1105523865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c005190 0x7f672c00b990 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.410+0000 7f6747e00640 1 -- 172.21.15.55:0/1105523865 >> 172.21.15.55:0/1105523865 conn(0x7f67480ccf80 msgr2=0x7f67480cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:40.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.410+0000 7f6747e00640 1 -- 172.21.15.55:0/1105523865 shutdown_connections 2024-04-02T07:30:40.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.410+0000 7f6747e00640 1 -- 172.21.15.55:0/1105523865 wait complete. 2024-04-02T07:30:40.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6747e00640 1 Processor -- start 2024-04-02T07:30:40.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6747e00640 1 -- start start 2024-04-02T07:30:40.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6747e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c005190 0x7f67481598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6747e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67480c7540 0x7f674806c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6747e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f674806c7a0 0x7f67480c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6747e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f674806cc20 con 0x7f672c005190 2024-04-02T07:30:40.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6747e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67481f58a0 con 0x7f67480c7540 2024-04-02T07:30:40.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6747e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67481f5b40 con 0x7f674806c7a0 2024-04-02T07:30:40.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6746a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c005190 0x7f67481598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6746a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c005190 0x7f67481598d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59562/0 (socket says 172.21.15.55:59562) 2024-04-02T07:30:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6746a00640 1 -- 172.21.15.55:0/3411995700 learned_addr learned my addr 172.21.15.55:0/3411995700 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6747400640 1 --2- 172.21.15.55:0/3411995700 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f674806c7a0 0x7f67480c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f673fe00640 1 --2- 172.21.15.55:0/3411995700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67480c7540 0x7f674806c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6746a00640 1 -- 172.21.15.55:0/3411995700 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f674806c7a0 msgr2=0x7f67480c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6746a00640 1 --2- 172.21.15.55:0/3411995700 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f674806c7a0 0x7f67480c8d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6746a00640 1 -- 172.21.15.55:0/3411995700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67480c7540 msgr2=0x7f674806c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6746a00640 1 --2- 172.21.15.55:0/3411995700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67480c7540 0x7f674806c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6746a00640 1 -- 172.21.15.55:0/3411995700 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67481f5e20 con 0x7f672c005190 2024-04-02T07:30:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6747400640 1 --2- 172.21.15.55:0/3411995700 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f674806c7a0 0x7f67480c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:30:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f673fe00640 1 --2- 172.21.15.55:0/3411995700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67480c7540 0x7f674806c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:30:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6746a00640 1 --2- 172.21.15.55:0/3411995700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c005190 0x7f67481598d0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f6738004e80 tx=0x7f6738007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f673ea00640 1 -- 172.21.15.55:0/3411995700 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673800f750 con 0x7f672c005190 2024-04-02T07:30:40.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f673ea00640 1 -- 172.21.15.55:0/3411995700 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673800f8f0 con 0x7f672c005190 2024-04-02T07:30:40.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f673ea00640 1 -- 172.21.15.55:0/3411995700 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673800fca0 con 0x7f672c005190 2024-04-02T07:30:40.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6747e00640 1 -- 172.21.15.55:0/3411995700 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67481f6100 con 0x7f672c005190 2024-04-02T07:30:40.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.414+0000 7f6747e00640 1 -- 172.21.15.55:0/3411995700 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6748159e10 con 0x7f672c005190 2024-04-02T07:30:40.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.418+0000 7f673ea00640 1 -- 172.21.15.55:0/3411995700 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f673801d460 con 0x7f672c005190 2024-04-02T07:30:40.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.418+0000 7f673ea00640 1 --2- 172.21.15.55:0/3411995700 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6724066690 0x7f6724068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.418+0000 7f673ea00640 1 -- 172.21.15.55:0/3411995700 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f6738084250 con 0x7f672c005190 2024-04-02T07:30:40.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.418+0000 7f6750e8d000 1 Processor -- start 2024-04-02T07:30:40.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.418+0000 7f6750e8d000 1 -- start start 2024-04-02T07:30:40.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.418+0000 7f673fe00640 1 --2- 172.21.15.55:0/3411995700 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6724066690 0x7f6724068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.418+0000 7f6750e8d000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4f6db0 0x55be4c4f7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.418+0000 7f6750e8d000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4f76d0 0x55be4c4acf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.418+0000 7f6750e8d000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4ad4c0 0x55be4c4ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.418+0000 7f6750e8d000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4c3755a0 con 0x55be4c4ad4c0 2024-04-02T07:30:40.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.418+0000 7f6750e8d000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4c302af0 con 0x55be4c4f6db0 2024-04-02T07:30:40.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.418+0000 7f6750e8d000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be4c3000c0 con 0x55be4c4f76d0 2024-04-02T07:30:40.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f673fe00640 1 --2- 172.21.15.55:0/3411995700 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6724066690 0x7f6724068b50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6730000f70 tx=0x7f6730000ee0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:40.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6747400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4ad4c0 0x55be4c4ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6747400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4ad4c0 0x55be4c4ad8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59574/0 (socket says 172.21.15.55:59574) 2024-04-02T07:30:40.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6747400640 1 -- 172.21.15.55:0/2017980331 learned_addr learned my addr 172.21.15.55:0/2017980331 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:40.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f673fe00640 1 --2- 172.21.15.55:0/2017980331 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4f76d0 0x55be4c4acf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6746a00640 1 --2- 172.21.15.55:0/2017980331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4f6db0 0x55be4c4f7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6747400640 1 -- 172.21.15.55:0/2017980331 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4f76d0 msgr2=0x55be4c4acf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:40.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6747400640 1 --2- 172.21.15.55:0/2017980331 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4f76d0 0x55be4c4acf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6747400640 1 -- 172.21.15.55:0/2017980331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4f6db0 msgr2=0x55be4c4f7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:40.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6747400640 1 --2- 172.21.15.55:0/2017980331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4f6db0 0x55be4c4f7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6747400640 1 -- 172.21.15.55:0/2017980331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be4bff7890 con 0x55be4c4ad4c0 2024-04-02T07:30:40.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6747400640 1 --2- 172.21.15.55:0/2017980331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4ad4c0 0x55be4c4ad8a0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f674001caf0 tx=0x7f674001b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45bb18ed65d7c9a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:40.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6737400640 1 -- 172.21.15.55:0/2017980331 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67400a5d90 con 0x55be4c4ad4c0 2024-04-02T07:30:40.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6737400640 1 -- 172.21.15.55:0/2017980331 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67400039a0 con 0x55be4c4ad4c0 2024-04-02T07:30:40.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6737400640 1 -- 172.21.15.55:0/2017980331 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740003d10 con 0x55be4c4ad4c0 2024-04-02T07:30:40.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6750e8d000 1 -- 172.21.15.55:0/2017980331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4ad4c0 msgr2=0x55be4c4ad8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:40.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6750e8d000 1 --2- 172.21.15.55:0/2017980331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4ad4c0 0x55be4c4ad8a0 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f674001caf0 tx=0x7f674001b500 comp rx=0 tx=0).stop 2024-04-02T07:30:40.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6750e8d000 1 -- 172.21.15.55:0/2017980331 shutdown_connections 2024-04-02T07:30:40.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6750e8d000 1 --2- 172.21.15.55:0/2017980331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4ad4c0 0x55be4c4ad8a0 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6750e8d000 1 --2- 172.21.15.55:0/2017980331 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4f76d0 0x55be4c4acf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6750e8d000 1 --2- 172.21.15.55:0/2017980331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4f6db0 0x55be4c4f7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6750e8d000 1 -- 172.21.15.55:0/2017980331 >> 172.21.15.55:0/2017980331 conn(0x55be4c4b3830 msgr2=0x55be4c4ab860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:40.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6750e8d000 1 -- 172.21.15.55:0/2017980331 shutdown_connections 2024-04-02T07:30:40.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6750e8d000 1 -- 172.21.15.55:0/2017980331 wait complete. 2024-04-02T07:30:40.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6750e8d000 1 -- start start 2024-04-02T07:30:40.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6750e8d000 1 Processor -- start 2024-04-02T07:30:40.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6750e8d000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4ad4c0 0x55be4c4f6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6750e8d000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4f6db0 0x55be4c4b1230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6750e8d000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f76d0 0x55be4c4b1770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6750e8d000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4c2fb9b0 con 0x55be4c4f76d0 2024-04-02T07:30:40.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6750e8d000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4c29ac00 con 0x55be4c4f6db0 2024-04-02T07:30:40.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6750e8d000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be4c2b9070 con 0x55be4c4ad4c0 2024-04-02T07:30:40.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6750e8d000 10 client.0 _ll_register_callbacks cb 0x55be4c4990e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:30:40.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.422+0000 7f6747400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f76d0 0x55be4c4b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6746a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4ad4c0 0x55be4c4f6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6747400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f76d0 0x55be4c4b1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59578/0 (socket says 172.21.15.55:59578) 2024-04-02T07:30:40.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6747400640 1 -- 172.21.15.55:0/1656337932 learned_addr learned my addr 172.21.15.55:0/1656337932 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:40.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f673fe00640 1 --2- 172.21.15.55:0/1656337932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4f6db0 0x55be4c4b1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6746a00640 1 -- 172.21.15.55:0/1656337932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4f6db0 msgr2=0x55be4c4b1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:40.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6746a00640 1 --2- 172.21.15.55:0/1656337932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4f6db0 0x55be4c4b1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6746a00640 1 -- 172.21.15.55:0/1656337932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f76d0 msgr2=0x55be4c4b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:40.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6746a00640 1 --2- 172.21.15.55:0/1656337932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f76d0 0x55be4c4b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6746a00640 1 -- 172.21.15.55:0/1656337932 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f672c003530 con 0x55be4c4ad4c0 2024-04-02T07:30:40.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6747400640 1 --2- 172.21.15.55:0/1656337932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f76d0 0x55be4c4b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:30:40.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6746a00640 1 --2- 172.21.15.55:0/1656337932 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4ad4c0 0x55be4c4f6740 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f67380826a0 tx=0x7f67380559e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba2d8e60a1099734 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:40.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f672be00640 10 client.0 ms_handle_connect on v2:172.21.15.106:3301/0 2024-04-02T07:30:40.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f672be00640 1 -- 172.21.15.55:0/1656337932 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673805d590 con 0x55be4c4ad4c0 2024-04-02T07:30:40.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f672be00640 1 -- 172.21.15.55:0/1656337932 <== mon.2 v2:172.21.15.106:3301/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f67380822a0 con 0x55be4c4ad4c0 2024-04-02T07:30:40.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 1 -- 172.21.15.55:0/1656337932 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be4c2b85f0 con 0x55be4c4ad4c0 2024-04-02T07:30:40.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f672be00640 1 -- 172.21.15.55:0/1656337932 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f673805b070 con 0x55be4c4ad4c0 2024-04-02T07:30:40.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 10 client.6920 fetch_fsmap learned FSMap version 73 2024-04-02T07:30:40.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 1 -- 172.21.15.55:0/1656337932 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x55be4c2c0ab0 con 0x55be4c4ad4c0 2024-04-02T07:30:40.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f672be00640 1 -- 172.21.15.55:0/1656337932 <== mon.2 v2:172.21.15.106:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be4c2b85f0 con 0x55be4c4ad4c0 2024-04-02T07:30:40.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f672be00640 1 -- 172.21.15.55:0/1656337932 <== mon.2 v2:172.21.15.106:3301/0 5 ==== fsmap(e 73) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f6738012070 con 0x55be4c4ad4c0 2024-04-02T07:30:40.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 10 client.6920 fetch_fsmap finished waiting for FSMap version 73 2024-04-02T07:30:40.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 10 client.6920 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:30:40.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 20 client.6920 populate_metadata read hostname 'smithi055' 2024-04-02T07:30:40.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 1 --2- 172.21.15.55:0/1656337932 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55be4c4b2180 0x55be4c4b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 4 client.6920 mds_command: new command op to 8052 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:30:40.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 1 -- 172.21.15.55:0/1656337932 --> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be4c2f8790 con 0x55be4c4b2180 2024-04-02T07:30:40.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f673fe00640 1 --2- 172.21.15.55:0/1656337932 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55be4c4b2180 0x55be4c4b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f673fe00640 1 --2- 172.21.15.55:0/1656337932 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55be4c4b2180 0x55be4c4b2560 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37481f91e30422c server_cookie=c7db3a29742569fd in_seq=0 out_seq=0 2024-04-02T07:30:40.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f672be00640 10 client.6920 ms_handle_connect on v2:172.21.15.55:6832/2658455613 2024-04-02T07:30:40.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f672be00640 1 -- 172.21.15.55:0/1656337932 <== mds.0 v2:172.21.15.55:6832/2658455613 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55be4c2f8790 con 0x55be4c4b2180 2024-04-02T07:30:40.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f672be00640 10 client.6920 handle_command_reply: tid=0 2024-04-02T07:30:40.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 1 client.6920 shutdown 2024-04-02T07:30:40.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 1 -- 172.21.15.55:0/1656337932 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4ad4c0 msgr2=0x55be4c4f6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:40.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 1 --2- 172.21.15.55:0/1656337932 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4ad4c0 0x55be4c4f6740 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f67380826a0 tx=0x7f67380559e0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 1 -- 172.21.15.55:0/1656337932 shutdown_connections 2024-04-02T07:30:40.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 1 --2- 172.21.15.55:0/1656337932 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55be4c4b2180 0x55be4c4b2560 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 1 --2- 172.21.15.55:0/1656337932 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f76d0 0x55be4c4b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 1 --2- 172.21.15.55:0/1656337932 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4f6db0 0x55be4c4b1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f672be00640 0 client.6920 ms_handle_reset on v2:172.21.15.55:6832/2658455613 2024-04-02T07:30:40.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 1 --2- 172.21.15.55:0/1656337932 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4ad4c0 0x55be4c4f6740 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 1 -- 172.21.15.55:0/1656337932 >> 172.21.15.55:0/1656337932 conn(0x55be4c4b3830 msgr2=0x55be4c4abf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:40.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 1 -- 172.21.15.55:0/1656337932 shutdown_connections 2024-04-02T07:30:40.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 1 -- 172.21.15.55:0/1656337932 wait complete. 2024-04-02T07:30:40.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.426+0000 7f6750e8d000 20 client.6920 trim_cache size 0 max 16384 2024-04-02T07:30:40.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.442+0000 7f6750e8d000 1 Processor -- start 2024-04-02T07:30:40.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.442+0000 7f6750e8d000 1 -- start start 2024-04-02T07:30:40.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.442+0000 7f6750e8d000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4ad4c0 0x55be4c5063f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.442+0000 7f6750e8d000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f6db0 0x55be4c506930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4f76d0 0x55be4c506e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4bfb8940 con 0x55be4c4f6db0 2024-04-02T07:30:40.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4c3cc3e0 con 0x55be4c4f76d0 2024-04-02T07:30:40.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be4c303d80 con 0x55be4c4ad4c0 2024-04-02T07:30:40.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f673fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f6db0 0x55be4c506930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f673fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f6db0 0x55be4c506930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59582/0 (socket says 172.21.15.55:59582) 2024-04-02T07:30:40.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f673fe00640 1 -- 172.21.15.55:0/2709060055 learned_addr learned my addr 172.21.15.55:0/2709060055 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:40.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6746a00640 1 --2- 172.21.15.55:0/2709060055 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4ad4c0 0x55be4c5063f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6747400640 1 --2- 172.21.15.55:0/2709060055 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4f76d0 0x55be4c506e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f673fe00640 1 -- 172.21.15.55:0/2709060055 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4ad4c0 msgr2=0x55be4c5063f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:40.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f673fe00640 1 --2- 172.21.15.55:0/2709060055 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4ad4c0 0x55be4c5063f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f673fe00640 1 -- 172.21.15.55:0/2709060055 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4f76d0 msgr2=0x55be4c506e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:40.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f673fe00640 1 --2- 172.21.15.55:0/2709060055 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4f76d0 0x55be4c506e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f673fe00640 1 -- 172.21.15.55:0/2709060055 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be4c2a6c00 con 0x55be4c4f6db0 2024-04-02T07:30:40.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6746a00640 1 --2- 172.21.15.55:0/2709060055 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4ad4c0 0x55be4c5063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:30:40.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6747400640 1 --2- 172.21.15.55:0/2709060055 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4f76d0 0x55be4c506e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:30:40.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f673fe00640 1 --2- 172.21.15.55:0/2709060055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f6db0 0x55be4c506930 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f6730007fd0 tx=0x7f6730018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c04eadb259a3a133 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:40.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6737e00640 1 -- 172.21.15.55:0/2709060055 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6730029050 con 0x55be4c4f6db0 2024-04-02T07:30:40.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6737e00640 1 -- 172.21.15.55:0/2709060055 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f673002a040 con 0x55be4c4f6db0 2024-04-02T07:30:40.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6737e00640 1 -- 172.21.15.55:0/2709060055 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673002b810 con 0x55be4c4f6db0 2024-04-02T07:30:40.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 -- 172.21.15.55:0/2709060055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f6db0 msgr2=0x55be4c506930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:40.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 --2- 172.21.15.55:0/2709060055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f6db0 0x55be4c506930 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f6730007fd0 tx=0x7f6730018000 comp rx=0 tx=0).stop 2024-04-02T07:30:40.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 -- 172.21.15.55:0/2709060055 shutdown_connections 2024-04-02T07:30:40.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 --2- 172.21.15.55:0/2709060055 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4f76d0 0x55be4c506e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 --2- 172.21.15.55:0/2709060055 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f6db0 0x55be4c506930 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 --2- 172.21.15.55:0/2709060055 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4ad4c0 0x55be4c5063f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 -- 172.21.15.55:0/2709060055 >> 172.21.15.55:0/2709060055 conn(0x55be4c4b3830 msgr2=0x55be4c4f4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:40.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 -- 172.21.15.55:0/2709060055 shutdown_connections 2024-04-02T07:30:40.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 -- 172.21.15.55:0/2709060055 wait complete. 2024-04-02T07:30:40.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 -- start start 2024-04-02T07:30:40.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 Processor -- start 2024-04-02T07:30:40.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4ad4c0 0x55be4c54cb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4f6db0 0x55be4c50a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f76d0 0x55be4c50a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4c2f8db0 con 0x55be4c4f76d0 2024-04-02T07:30:40.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be4c2f91c0 con 0x55be4c4ad4c0 2024-04-02T07:30:40.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55be4c2ff9b0 con 0x55be4c4f6db0 2024-04-02T07:30:40.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6750e8d000 10 client.0 _ll_register_callbacks cb 0x55be4c2c0590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:30:40.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6747400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f76d0 0x55be4c50a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6747400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f76d0 0x55be4c50a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59586/0 (socket says 172.21.15.55:59586) 2024-04-02T07:30:40.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6747400640 1 -- 172.21.15.55:0/938779939 learned_addr learned my addr 172.21.15.55:0/938779939 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:40.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f673fe00640 1 --2- 172.21.15.55:0/938779939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4f6db0 0x55be4c50a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.446+0000 7f6746a00640 1 --2- 172.21.15.55:0/938779939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4ad4c0 0x55be4c54cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6747400640 1 -- 172.21.15.55:0/938779939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4f6db0 msgr2=0x55be4c50a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:40.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6747400640 1 --2- 172.21.15.55:0/938779939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4f6db0 0x55be4c50a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6747400640 1 -- 172.21.15.55:0/938779939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4ad4c0 msgr2=0x55be4c54cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:40.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6747400640 1 --2- 172.21.15.55:0/938779939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4ad4c0 0x55be4c54cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6747400640 1 -- 172.21.15.55:0/938779939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67480b1e30 con 0x55be4c4f76d0 2024-04-02T07:30:40.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6747400640 1 --2- 172.21.15.55:0/938779939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f76d0 0x55be4c50a5c0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f674001cd00 tx=0x7f672c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dc6973cfaccb14c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:40.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f672be00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:30:40.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f672be00640 1 -- 172.21.15.55:0/938779939 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740004240 con 0x55be4c4f76d0 2024-04-02T07:30:40.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f672be00640 1 -- 172.21.15.55:0/938779939 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f6730001d30 con 0x55be4c4f76d0 2024-04-02T07:30:40.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 1 -- 172.21.15.55:0/938779939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be4c2cb460 con 0x55be4c4f76d0 2024-04-02T07:30:40.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f672be00640 1 -- 172.21.15.55:0/938779939 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67400043a0 con 0x55be4c4f76d0 2024-04-02T07:30:40.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 10 client.8136 fetch_fsmap learned FSMap version 73 2024-04-02T07:30:40.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 1 -- 172.21.15.55:0/938779939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x55be4bff7cc0 con 0x55be4c4f76d0 2024-04-02T07:30:40.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f672be00640 1 -- 172.21.15.55:0/938779939 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55be4c2cb460 con 0x55be4c4f76d0 2024-04-02T07:30:40.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f672be00640 1 -- 172.21.15.55:0/938779939 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 73) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f67400c0040 con 0x55be4c4f76d0 2024-04-02T07:30:40.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 10 client.8136 fetch_fsmap finished waiting for FSMap version 73 2024-04-02T07:30:40.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 10 client.8136 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:30:40.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 20 client.8136 populate_metadata read hostname 'smithi055' 2024-04-02T07:30:40.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 1 --2- 172.21.15.55:0/938779939 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55be4c50ab00 0x55be4c50aee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 4 client.8136 mds_command: new command op to 8052 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-02T07:30:40.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 1 -- 172.21.15.55:0/938779939 --> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55be4c2c49c0 con 0x55be4c50ab00 2024-04-02T07:30:40.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6746a00640 1 --2- 172.21.15.55:0/938779939 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55be4c50ab00 0x55be4c50aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6746a00640 1 --2- 172.21.15.55:0/938779939 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55be4c50ab00 0x55be4c50aee0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49fb3066ec620542 server_cookie=5b4b60767627e9ff in_seq=0 out_seq=0 2024-04-02T07:30:40.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f672be00640 10 client.8136 ms_handle_connect on v2:172.21.15.55:6832/2658455613 2024-04-02T07:30:40.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f672be00640 1 -- 172.21.15.55:0/938779939 <== mds.0 v2:172.21.15.55:6832/2658455613 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55be4c2c49c0 con 0x55be4c50ab00 2024-04-02T07:30:40.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f672be00640 10 client.8136 handle_command_reply: tid=0 2024-04-02T07:30:40.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 1 client.8136 shutdown 2024-04-02T07:30:40.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 1 -- 172.21.15.55:0/938779939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f76d0 msgr2=0x55be4c50a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:40.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 1 --2- 172.21.15.55:0/938779939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f76d0 0x55be4c50a5c0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f674001cd00 tx=0x7f672c005800 comp rx=0 tx=0).stop 2024-04-02T07:30:40.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 1 -- 172.21.15.55:0/938779939 shutdown_connections 2024-04-02T07:30:40.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 1 --2- 172.21.15.55:0/938779939 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55be4c50ab00 0x55be4c50aee0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 1 --2- 172.21.15.55:0/938779939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55be4c4f76d0 0x55be4c50a5c0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 1 --2- 172.21.15.55:0/938779939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55be4c4f6db0 0x55be4c50a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 1 --2- 172.21.15.55:0/938779939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55be4c4ad4c0 0x55be4c54cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f672be00640 0 client.8136 ms_handle_reset on v2:172.21.15.55:6832/2658455613 2024-04-02T07:30:40.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 1 -- 172.21.15.55:0/938779939 >> 172.21.15.55:0/938779939 conn(0x55be4c4b3830 msgr2=0x55be4c4f4e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:40.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 1 -- 172.21.15.55:0/938779939 shutdown_connections 2024-04-02T07:30:40.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 1 -- 172.21.15.55:0/938779939 wait complete. 2024-04-02T07:30:40.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6750e8d000 20 client.8136 trim_cache size 0 max 16384 2024-04-02T07:30:40.457 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:30:40.457 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "642a0456-a2ac-49a4-91a5-3b3449b512da", 2024-04-02T07:30:40.457 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-02T07:30:40.457 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 8052, 2024-04-02T07:30:40.457 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-02T07:30:40.457 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-02T07:30:40.457 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-02T07:30:40.457 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 4.5667890509999998, 2024-04-02T07:30:40.457 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 73, 2024-04-02T07:30:40.457 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 91, 2024-04-02T07:30:40.457 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 91, 2024-04-02T07:30:40.457 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 5.5120148499999999 2024-04-02T07:30:40.458 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:30:40.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6747e00640 1 -- 172.21.15.55:0/3411995700 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6724066690 msgr2=0x7f6724068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:40.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6747e00640 1 --2- 172.21.15.55:0/3411995700 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6724066690 0x7f6724068b50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f6730000f70 tx=0x7f6730000ee0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6747e00640 1 -- 172.21.15.55:0/3411995700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c005190 msgr2=0x7f67481598d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:40.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6747e00640 1 --2- 172.21.15.55:0/3411995700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c005190 0x7f67481598d0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f6738004e80 tx=0x7f6738007430 comp rx=0 tx=0).stop 2024-04-02T07:30:40.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6747e00640 1 -- 172.21.15.55:0/3411995700 shutdown_connections 2024-04-02T07:30:40.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6747e00640 1 --2- 172.21.15.55:0/3411995700 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f674806c7a0 0x7f67480c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6747e00640 1 --2- 172.21.15.55:0/3411995700 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6724066690 0x7f6724068b50 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6747e00640 1 --2- 172.21.15.55:0/3411995700 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f67480c7540 0x7f674806c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6747e00640 1 --2- 172.21.15.55:0/3411995700 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f672c005190 0x7f67481598d0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6747e00640 1 -- 172.21.15.55:0/3411995700 >> 172.21.15.55:0/3411995700 conn(0x7f67480ccf80 msgr2=0x7f67480b1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:40.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6747e00640 1 -- 172.21.15.55:0/3411995700 shutdown_connections 2024-04-02T07:30:40.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.450+0000 7f6747e00640 1 -- 172.21.15.55:0/3411995700 wait complete. 2024-04-02T07:30:40.472 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-02T07:30:40.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.610+0000 7fec88800640 1 Processor -- start 2024-04-02T07:30:40.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.610+0000 7fec88800640 1 -- start start 2024-04-02T07:30:40.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.614+0000 7fec88800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fec800cfdf0 0x7fec8006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.614+0000 7fec88800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fec800b16e0 0x7fec800b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.614+0000 7fec88800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec800d01d0 con 0x7fec800b11f0 2024-04-02T07:30:40.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.614+0000 7fec88800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8006c0e0 con 0x7fec800b16e0 2024-04-02T07:30:40.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.614+0000 7fec88800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec800b01d0 con 0x7fec800cfdf0 2024-04-02T07:30:40.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.614+0000 7fec85400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fec800b16e0 0x7fec800b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.614+0000 7fec85e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fec800cfdf0 0x7fec8006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.614+0000 7fec85400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fec800b16e0 0x7fec800b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59592/0 (socket says 172.21.15.55:59592) 2024-04-02T07:30:40.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.614+0000 7fec85400640 1 -- 172.21.15.55:0/383809079 learned_addr learned my addr 172.21.15.55:0/383809079 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:40.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.614+0000 7fec85400640 1 -- 172.21.15.55:0/383809079 >> v2:172.21.15.106:3300/0 conn(0x7fec800cfdf0 msgr2=0x7fec8006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:40.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.614+0000 7fec85400640 1 --2- 172.21.15.55:0/383809079 >> v2:172.21.15.106:3300/0 conn(0x7fec800cfdf0 0x7fec8006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.614+0000 7fec85400640 1 -- 172.21.15.55:0/383809079 >> v1:172.21.15.106:6789/0 conn(0x7fec800b11f0 legacy=0x7fec80098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:40.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.614+0000 7fec85400640 1 -- 172.21.15.55:0/383809079 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec800b04b0 con 0x7fec800b16e0 2024-04-02T07:30:40.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.614+0000 7fec85400640 1 --2- 172.21.15.55:0/383809079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec800b16e0 0x7fec800b0cb0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fec80073b60 tx=0x7fec7001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc97e78a5f682fe3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:40.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec84a00640 1 -- 172.21.15.55:0/383809079 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec700aa430 con 0x7fec800b16e0 2024-04-02T07:30:40.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec84a00640 1 -- 172.21.15.55:0/383809079 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec700aa590 con 0x7fec800b16e0 2024-04-02T07:30:40.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec84a00640 1 -- 172.21.15.55:0/383809079 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec700aa920 con 0x7fec800b16e0 2024-04-02T07:30:40.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec88800640 1 -- 172.21.15.55:0/383809079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec800b16e0 msgr2=0x7fec800b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:40.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec88800640 1 --2- 172.21.15.55:0/383809079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec800b16e0 0x7fec800b0cb0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7fec80073b60 tx=0x7fec7001c4f0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec88800640 1 -- 172.21.15.55:0/383809079 shutdown_connections 2024-04-02T07:30:40.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec88800640 1 --2- 172.21.15.55:0/383809079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec800b16e0 0x7fec800b0cb0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec88800640 1 --2- 172.21.15.55:0/383809079 >> v2:172.21.15.106:3300/0 conn(0x7fec800cfdf0 0x7fec8006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec88800640 1 -- 172.21.15.55:0/383809079 >> 172.21.15.55:0/383809079 conn(0x7fec800b2210 msgr2=0x7fec800b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:40.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec88800640 1 -- 172.21.15.55:0/383809079 shutdown_connections 2024-04-02T07:30:40.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec88800640 1 -- 172.21.15.55:0/383809079 wait complete. 2024-04-02T07:30:40.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec88800640 1 Processor -- start 2024-04-02T07:30:40.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec88800640 1 -- start start 2024-04-02T07:30:40.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec88800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec800b11f0 0x7fec801540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec88800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec800b16e0 0x7fec800cad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec88800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec800cfdf0 0x7fec800c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec88800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec800c4230 con 0x7fec800cfdf0 2024-04-02T07:30:40.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec88800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec800c4510 con 0x7fec800b16e0 2024-04-02T07:30:40.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec88800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec800c47f0 con 0x7fec800b11f0 2024-04-02T07:30:40.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec86800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec800cfdf0 0x7fec800c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec85e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec800b11f0 0x7fec801540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec85400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec800b16e0 0x7fec800cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec85e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec800b11f0 0x7fec801540a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:36950/0 (socket says 172.21.15.55:36950) 2024-04-02T07:30:40.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec86800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec800cfdf0 0x7fec800c9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59594/0 (socket says 172.21.15.55:59594) 2024-04-02T07:30:40.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.618+0000 7fec85e00640 1 -- 172.21.15.55:0/618396527 learned_addr learned my addr 172.21.15.55:0/618396527 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:40.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.622+0000 7fec85400640 1 -- 172.21.15.55:0/618396527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec800b11f0 msgr2=0x7fec801540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:40.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.622+0000 7fec85400640 1 --2- 172.21.15.55:0/618396527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec800b11f0 0x7fec801540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.622+0000 7fec85400640 1 -- 172.21.15.55:0/618396527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec800cfdf0 msgr2=0x7fec800c9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:40.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.622+0000 7fec85400640 1 --2- 172.21.15.55:0/618396527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec800cfdf0 0x7fec800c9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.622+0000 7fec85400640 1 -- 172.21.15.55:0/618396527 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec700094d0 con 0x7fec800b16e0 2024-04-02T07:30:40.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.622+0000 7fec86800640 1 --2- 172.21.15.55:0/618396527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec800cfdf0 0x7fec800c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:30:40.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.622+0000 7fec85400640 1 --2- 172.21.15.55:0/618396527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec800b16e0 0x7fec800cad30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fec700ab000 tx=0x7fec7001ad30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:40.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.622+0000 7fec7a000640 1 -- 172.21.15.55:0/618396527 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec700aa430 con 0x7fec800b16e0 2024-04-02T07:30:40.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.622+0000 7fec7a000640 1 -- 172.21.15.55:0/618396527 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec700b3820 con 0x7fec800b16e0 2024-04-02T07:30:40.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.622+0000 7fec88800640 1 -- 172.21.15.55:0/618396527 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec800c4ad0 con 0x7fec800b16e0 2024-04-02T07:30:40.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.622+0000 7fec7a000640 1 -- 172.21.15.55:0/618396527 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec700b3bd0 con 0x7fec800b16e0 2024-04-02T07:30:40.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.622+0000 7fec88800640 1 -- 172.21.15.55:0/618396527 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec8015fee0 con 0x7fec800b16e0 2024-04-02T07:30:40.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.622+0000 7fec88800640 1 -- 172.21.15.55:0/618396527 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec80066c90 con 0x7fec800b16e0 2024-04-02T07:30:40.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.622+0000 7fec7a000640 1 -- 172.21.15.55:0/618396527 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fec700b3d30 con 0x7fec800b16e0 2024-04-02T07:30:40.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.626+0000 7fec7a000640 1 --2- 172.21.15.55:0/618396527 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec640666c0 0x7fec64068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:40.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.626+0000 7fec7a000640 1 -- 172.21.15.55:0/618396527 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fec7011e700 con 0x7fec800b16e0 2024-04-02T07:30:40.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.626+0000 7fec85e00640 1 --2- 172.21.15.55:0/618396527 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec640666c0 0x7fec64068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:40.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.626+0000 7fec85e00640 1 --2- 172.21.15.55:0/618396527 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec640666c0 0x7fec64068b80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fec801f8710 tx=0x7fec74009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:40.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.626+0000 7fec7a000640 1 -- 172.21.15.55:0/618396527 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fec700ebac0 con 0x7fec800b16e0 2024-04-02T07:30:40.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.822+0000 7fec88800640 1 -- 172.21.15.55:0/618396527 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fec800c4f80 con 0x7fec800b16e0 2024-04-02T07:30:40.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.822+0000 7fec7a000640 1 -- 172.21.15.55:0/618396527 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v73) v1 ==== 53+0+73 (secure 0 0 0) 0x7fec700ef0e0 con 0x7fec800b16e0 2024-04-02T07:30:40.825 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-02T07:30:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.826+0000 7fec88800640 1 -- 172.21.15.55:0/618396527 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec640666c0 msgr2=0x7fec64068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.826+0000 7fec88800640 1 --2- 172.21.15.55:0/618396527 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec640666c0 0x7fec64068b80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fec801f8710 tx=0x7fec74009190 comp rx=0 tx=0).stop 2024-04-02T07:30:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.826+0000 7fec88800640 1 -- 172.21.15.55:0/618396527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec800b16e0 msgr2=0x7fec800cad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.826+0000 7fec88800640 1 --2- 172.21.15.55:0/618396527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec800b16e0 0x7fec800cad30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fec700ab000 tx=0x7fec7001ad30 comp rx=0 tx=0).stop 2024-04-02T07:30:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.826+0000 7fec88800640 1 -- 172.21.15.55:0/618396527 shutdown_connections 2024-04-02T07:30:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.826+0000 7fec88800640 1 --2- 172.21.15.55:0/618396527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec800cfdf0 0x7fec800c9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.826+0000 7fec88800640 1 --2- 172.21.15.55:0/618396527 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec640666c0 0x7fec64068b80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.826+0000 7fec88800640 1 --2- 172.21.15.55:0/618396527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec800b16e0 0x7fec800cad30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.826+0000 7fec88800640 1 --2- 172.21.15.55:0/618396527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec800b11f0 0x7fec801540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.826+0000 7fec88800640 1 -- 172.21.15.55:0/618396527 >> 172.21.15.55:0/618396527 conn(0x7fec800b2210 msgr2=0x7fec8015aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:40.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.826+0000 7fec88800640 1 -- 172.21.15.55:0/618396527 shutdown_connections 2024-04-02T07:30:40.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:40.826+0000 7fec88800640 1 -- 172.21.15.55:0/618396527 wait complete. 2024-04-02T07:30:40.846 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-02T07:30:40.846 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-02T07:30:40.846 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-02T07:30:40.846 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-02T07:30:40.846 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-02T07:30:40.846 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-02T07:30:40.846 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-02T07:30:40.846 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-02T07:30:40.846 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:30:40.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:30:40.847 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-02T07:30:40.856 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:30:40.856 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:30:40.856 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:30:40.856 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:30:40.856 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-02T07:30:40.856 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:30:40.856 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:30:40.856 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:30:40.856 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-02T07:30:40.856 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:30:40.856 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:30:40.857 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-02T07:30:40.857 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-02T07:30:40.857 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:30:40.857 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-02T07:30:40.857 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-02T07:30:40.857 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41954sec preferred_lft 41954sec 2024-04-02T07:30:40.857 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2024-04-02T07:30:40.857 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:30:40.857 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:30:40.857 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:30:40.857 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-02T07:30:40.857 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-02T07:30:40.857 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:81:5a:89:17 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:30:40.857 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-02T07:30:40.858 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:30:40.858 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:30:40.858 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-02T07:30:40.858 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-02T07:30:40.858 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:30:40.858 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-02T07:30:40.858 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:30:40.858 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:30:40.858 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-02T07:30:40.858 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-02T07:30:40.858 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:30:40.858 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:30:40.858 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-02T07:30:40.858 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-02T07:30:40.858 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:30:40.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:30:40.859 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-02T07:30:40.887 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-04-02T07:30:40.886+0000 7fe9afa00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:30:40.904 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:30:40.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:30:40.906 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-02T07:30:40.963 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-02T07:30:40.963 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-02T07:30:40.963 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-02T07:30:40.963 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-02T07:30:40.963 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-02T07:30:40.963 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-02T07:30:40.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:30:40.964 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:30:40.964 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:30:40.964 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-02T07:30:40.964 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-02T07:30:40.964 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-02T07:30:40.964 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:30:41.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:30:41.054 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-02T07:30:41.063 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-02T07:30:41.063 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-02T07:30:41.064 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:30:41.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:30:41.064 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-02T07:30:41.124 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-02T07:30:41.125 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:30:41.125 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-02T07:30:41.173 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:30:41.173 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:30:41.174 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:30:41.224 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:30:41.285 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:30:41.285 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:30:41.353 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:30:41.353 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:30:41.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:30:41.353 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:30:41.409 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-02T07:30:41.409 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-02T07:30:41.456 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:30:41.476 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:30:41.476 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:30:41.535 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:30:41.537 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:30:41.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:30:41.537 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:30:41.550 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:2024-04-02T07:30:41.550+0000 7fb0843a0580 -1 init, newargv = 0x562e39e24030 newargc=15 2024-04-02T07:30:41.550 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[47806]: starting ceph client 2024-04-02T07:30:41.558 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[47806]: starting fuse 2024-04-02T07:30:41.559 INFO:teuthology.orchestra.run.smithi055.stdout:43 2024-04-02T07:30:41.559 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-02T07:30:41.560 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:30:41.560 DEBUG:teuthology.orchestra.run.smithi055:> import glob 2024-04-02T07:30:41.560 DEBUG:teuthology.orchestra.run.smithi055:> import re 2024-04-02T07:30:41.560 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:30:41.560 DEBUG:teuthology.orchestra.run.smithi055:> import subprocess 2024-04-02T07:30:41.560 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:30:41.560 DEBUG:teuthology.orchestra.run.smithi055:> def _find_admin_socket(client_name): 2024-04-02T07:30:41.560 DEBUG:teuthology.orchestra.run.smithi055:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-02T07:30:41.560 DEBUG:teuthology.orchestra.run.smithi055:> files = glob.glob(asok_path) 2024-04-02T07:30:41.560 DEBUG:teuthology.orchestra.run.smithi055:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-02T07:30:41.560 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:30:41.560 DEBUG:teuthology.orchestra.run.smithi055:> # Given a non-glob path, it better be there 2024-04-02T07:30:41.560 DEBUG:teuthology.orchestra.run.smithi055:> if "*" not in asok_path: 2024-04-02T07:30:41.561 DEBUG:teuthology.orchestra.run.smithi055:> assert(len(files) == 1) 2024-04-02T07:30:41.561 DEBUG:teuthology.orchestra.run.smithi055:> return files[0] 2024-04-02T07:30:41.561 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:30:41.561 DEBUG:teuthology.orchestra.run.smithi055:> for f in files: 2024-04-02T07:30:41.561 DEBUG:teuthology.orchestra.run.smithi055:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-02T07:30:41.561 DEBUG:teuthology.orchestra.run.smithi055:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-02T07:30:41.561 DEBUG:teuthology.orchestra.run.smithi055:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-02T07:30:41.561 DEBUG:teuthology.orchestra.run.smithi055:> contents = proc_f.read() 2024-04-02T07:30:41.561 DEBUG:teuthology.orchestra.run.smithi055:> if mountpoint in contents: 2024-04-02T07:30:41.561 DEBUG:teuthology.orchestra.run.smithi055:> return f 2024-04-02T07:30:41.561 DEBUG:teuthology.orchestra.run.smithi055:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-02T07:30:41.561 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:30:41.561 DEBUG:teuthology.orchestra.run.smithi055:> print(_find_admin_socket("client.0")) 2024-04-02T07:30:41.561 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:30:41.685 INFO:teuthology.orchestra.run.smithi055.stdout:/var/run/ceph/ceph-client.0.47806.asok 2024-04-02T07:30:41.869 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.47806.asok 2024-04-02T07:30:41.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:30:41.869 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.47806.asok status 2024-04-02T07:30:42.045 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:30:42.045 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": { 2024-04-02T07:30:42.045 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_sha1": "d0e392d9aee635f2b65768c460c7a151ead7a5e2", 2024-04-02T07:30:42.045 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)", 2024-04-02T07:30:42.045 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "0", 2024-04-02T07:30:42.045 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2024-04-02T07:30:42.045 INFO:teuthology.orchestra.run.smithi055.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-02T07:30:42.045 INFO:teuthology.orchestra.run.smithi055.stdout: "pid": "47806", 2024-04-02T07:30:42.045 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2024-04-02T07:30:42.045 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:30:42.046 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_count": 0, 2024-04-02T07:30:42.046 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_pinned_count": 0, 2024-04-02T07:30:42.046 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 8151, 2024-04-02T07:30:42.046 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": { 2024-04-02T07:30:42.046 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2024-04-02T07:30:42.046 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2024-04-02T07:30:42.046 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 8151 2024-04-02T07:30:42.046 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:30:42.046 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:30:42.046 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:30:42.046 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:30:42.046 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 269872082 2024-04-02T07:30:42.046 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:30:42.047 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:30:42.047 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:30:42.047 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:30:42.047 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:30:42.047 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 269872082 2024-04-02T07:30:42.047 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:30:42.047 INFO:teuthology.orchestra.run.smithi055.stdout: "inst_str": "client.8151 192.168.0.1:0/269872082", 2024-04-02T07:30:42.047 INFO:teuthology.orchestra.run.smithi055.stdout: "addr_str": "192.168.0.1:0/269872082", 2024-04-02T07:30:42.047 INFO:teuthology.orchestra.run.smithi055.stdout: "inode_count": 1, 2024-04-02T07:30:42.047 INFO:teuthology.orchestra.run.smithi055.stdout: "mds_epoch": 73, 2024-04-02T07:30:42.047 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch": 91, 2024-04-02T07:30:42.047 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch_barrier": 0, 2024-04-02T07:30:42.047 INFO:teuthology.orchestra.run.smithi055.stdout: "blocklisted": false, 2024-04-02T07:30:42.047 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs" 2024-04-02T07:30:42.047 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:30:42.059 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:30:42.060 DEBUG:teuthology.orchestra.run.smithi055:> stat --file-system '--printf=%T 2024-04-02T07:30:42.060 DEBUG:teuthology.orchestra.run.smithi055:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-02T07:30:42.069 INFO:teuthology.orchestra.run.smithi055.stdout:fuseblk 2024-04-02T07:30:42.069 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-02T07:30:42.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:30:42.069 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:30:42.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:30:42.136 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub start /dir recursive,repair 2024-04-02T07:30:42.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.318+0000 7fefec200640 1 Processor -- start 2024-04-02T07:30:42.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.318+0000 7fefec200640 1 -- start start 2024-04-02T07:30:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.318+0000 7fefec200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fefe40cb5b0 0x7fefe406ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefec200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fefe40af920 0x7fefe406cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefec200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe40ca030 con 0x7fefe415aa40 2024-04-02T07:30:42.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefec200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe40c9420 con 0x7fefe40af920 2024-04-02T07:30:42.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefec200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40c9700 con 0x7fefe40cb5b0 2024-04-02T07:30:42.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe9800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fefe415aa40 0x7fefe40caea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58144/0 (socket says 172.21.15.55:58144) 2024-04-02T07:30:42.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe9800640 1 -- 172.21.15.55:0/2966957418 learned_addr learned my addr 172.21.15.55:0/2966957418 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:30:42.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefea200640 1 --2- 172.21.15.55:0/2966957418 >> v2:172.21.15.106:3300/0 conn(0x7fefe40af920 0x7fefe406cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe8e00640 1 --2- 172.21.15.55:0/2966957418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fefe40cb5b0 0x7fefe406ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe3e00640 1 -- 172.21.15.55:0/2966957418 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207671231 0 0) 0x7fefe40ca030 con 0x7fefe415aa40 2024-04-02T07:30:42.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe3e00640 1 -- 172.21.15.55:0/2966957418 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefcc003530 con 0x7fefe415aa40 2024-04-02T07:30:42.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe3e00640 1 -- 172.21.15.55:0/2966957418 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1030980411 0 0) 0x7fefcc003530 con 0x7fefe415aa40 2024-04-02T07:30:42.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe3e00640 1 -- 172.21.15.55:0/2966957418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fefe40cb5b0 msgr2=0x7fefe406ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:42.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe3e00640 1 --2- 172.21.15.55:0/2966957418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fefe40cb5b0 0x7fefe406ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe3e00640 1 -- 172.21.15.55:0/2966957418 >> v2:172.21.15.106:3300/0 conn(0x7fefe40af920 msgr2=0x7fefe406cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:42.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe3e00640 1 --2- 172.21.15.55:0/2966957418 >> v2:172.21.15.106:3300/0 conn(0x7fefe40af920 0x7fefe406cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe3e00640 1 -- 172.21.15.55:0/2966957418 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe40c99e0 con 0x7fefe415aa40 2024-04-02T07:30:42.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe3e00640 1 -- 172.21.15.55:0/2966957418 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fefd8001680 con 0x7fefe415aa40 2024-04-02T07:30:42.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe3e00640 1 -- 172.21.15.55:0/2966957418 >> v1:172.21.15.55:6789/0 conn(0x7fefe415aa40 legacy=0x7fefe40caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe3e00640 1 --2- 172.21.15.55:0/2966957418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fefe40cb5b0 0x7fefcc003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe3e00640 1 --2- 172.21.15.55:0/2966957418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefcc003f00 0x7fefcc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe3e00640 1 --2- 172.21.15.55:0/2966957418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fefcc004d10 0x7fefcc005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe3e00640 1 -- 172.21.15.55:0/2966957418 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40c9420 con 0x7fefcc003f00 2024-04-02T07:30:42.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe3e00640 1 -- 172.21.15.55:0/2966957418 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe40c9700 con 0x7fefcc004d10 2024-04-02T07:30:42.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe3e00640 1 -- 172.21.15.55:0/2966957418 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefcc00b990 con 0x7fefe40cb5b0 2024-04-02T07:30:42.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefea200640 1 --2- 172.21.15.55:0/2966957418 >> v2:172.21.15.106:3300/0 conn(0x7fefe40af920 0x7fefe406cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:30:42.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe8e00640 1 --2- 172.21.15.55:0/2966957418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefcc003f00 0x7fefcc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe9800640 1 --2- 172.21.15.55:0/2966957418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fefe40cb5b0 0x7fefcc003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefea200640 1 --2- 172.21.15.55:0/2966957418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fefcc004d10 0x7fefcc005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe8e00640 1 -- 172.21.15.55:0/2966957418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fefe40cb5b0 msgr2=0x7fefcc003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:42.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe8e00640 1 --2- 172.21.15.55:0/2966957418 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fefe40cb5b0 0x7fefcc003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe8e00640 1 -- 172.21.15.55:0/2966957418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fefcc004d10 msgr2=0x7fefcc005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:42.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe8e00640 1 --2- 172.21.15.55:0/2966957418 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fefcc004d10 0x7fefcc005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.322+0000 7fefe8e00640 1 -- 172.21.15.55:0/2966957418 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefcc003530 con 0x7fefcc003f00 2024-04-02T07:30:42.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.326+0000 7fefe8e00640 1 --2- 172.21.15.55:0/2966957418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefcc003f00 0x7fefcc0047d0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009ae0 tx=0x7fefd001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1bb68f9fee44c254 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:42.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.326+0000 7fefe3e00640 1 -- 172.21.15.55:0/2966957418 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd00a5560 con 0x7fefcc003f00 2024-04-02T07:30:42.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.326+0000 7fefe3e00640 1 -- 172.21.15.55:0/2966957418 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd00a56c0 con 0x7fefcc003f00 2024-04-02T07:30:42.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.326+0000 7fefe3e00640 1 -- 172.21.15.55:0/2966957418 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd00a5a70 con 0x7fefcc003f00 2024-04-02T07:30:42.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.326+0000 7fefec200640 1 -- 172.21.15.55:0/2966957418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefcc003f00 msgr2=0x7fefcc0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.326+0000 7fefec200640 1 --2- 172.21.15.55:0/2966957418 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefcc003f00 0x7fefcc0047d0 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009ae0 tx=0x7fefd001ca10 comp rx=0 tx=0).stop 2024-04-02T07:30:42.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.326+0000 7fefea200640 1 -- 172.21.15.55:0/2966957418 reap_dead start 2024-04-02T07:30:42.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.326+0000 7fefec200640 1 -- 172.21.15.55:0/2966957418 shutdown_connections 2024-04-02T07:30:42.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.326+0000 7fefec200640 1 -- 172.21.15.55:0/2966957418 >> 172.21.15.55:0/2966957418 conn(0x7fefe4069d90 msgr2=0x7fefe406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:42.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.326+0000 7fefec200640 1 -- 172.21.15.55:0/2966957418 shutdown_connections 2024-04-02T07:30:42.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.326+0000 7fefec200640 1 -- 172.21.15.55:0/2966957418 wait complete. 2024-04-02T07:30:42.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.326+0000 7fefec200640 1 Processor -- start 2024-04-02T07:30:42.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.326+0000 7fefec200640 1 -- start start 2024-04-02T07:30:42.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefec200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fefcc003f00 0x7fefe4150a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefec200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefe41596f0 0x7fefe41546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefec200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fefe4151990 0x7fefe4151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefec200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe4152350 con 0x7fefe41596f0 2024-04-02T07:30:42.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefec200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe4150f50 con 0x7fefcc003f00 2024-04-02T07:30:42.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefec200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe414f970 con 0x7fefe4151990 2024-04-02T07:30:42.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefe8e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefe41596f0 0x7fefe41546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefe8e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefe41596f0 0x7fefe41546b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59614/0 (socket says 172.21.15.55:59614) 2024-04-02T07:30:42.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefe8e00640 1 -- 172.21.15.55:0/977481591 learned_addr learned my addr 172.21.15.55:0/977481591 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:42.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefe9800640 1 --2- 172.21.15.55:0/977481591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fefcc003f00 0x7fefe4150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefea200640 1 --2- 172.21.15.55:0/977481591 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fefe4151990 0x7fefe4151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefe8e00640 1 -- 172.21.15.55:0/977481591 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fefe4151990 msgr2=0x7fefe4151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefe8e00640 1 --2- 172.21.15.55:0/977481591 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fefe4151990 0x7fefe4151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefe8e00640 1 -- 172.21.15.55:0/977481591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fefcc003f00 msgr2=0x7fefe4150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefe8e00640 1 --2- 172.21.15.55:0/977481591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fefcc003f00 0x7fefe4150a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefe8e00640 1 -- 172.21.15.55:0/977481591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe414fc50 con 0x7fefe41596f0 2024-04-02T07:30:42.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefe8e00640 1 --2- 172.21.15.55:0/977481591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefe41596f0 0x7fefe41546b0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fefd001d2b0 tx=0x7fefcc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:42.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefe1600640 1 -- 172.21.15.55:0/977481591 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0004220 con 0x7fefe41596f0 2024-04-02T07:30:42.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefe1600640 1 -- 172.21.15.55:0/977481591 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd00043e0 con 0x7fefe41596f0 2024-04-02T07:30:42.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefe1600640 1 -- 172.21.15.55:0/977481591 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0003860 con 0x7fefe41596f0 2024-04-02T07:30:42.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefec200640 1 -- 172.21.15.55:0/977481591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe414ff30 con 0x7fefe41596f0 2024-04-02T07:30:42.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefec200640 1 -- 172.21.15.55:0/977481591 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe41504f0 con 0x7fefe41596f0 2024-04-02T07:30:42.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.330+0000 7fefe1600640 1 -- 172.21.15.55:0/977481591 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fefd00b4040 con 0x7fefe41596f0 2024-04-02T07:30:42.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefe1600640 1 --2- 172.21.15.55:0/977481591 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fefc4066690 0x7fefc4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefe1600640 1 -- 172.21.15.55:0/977481591 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fefd011d9a0 con 0x7fefe41596f0 2024-04-02T07:30:42.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefe9800640 1 --2- 172.21.15.55:0/977481591 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fefc4066690 0x7fefc4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefef630000 1 Processor -- start 2024-04-02T07:30:42.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefef630000 1 -- start start 2024-04-02T07:30:42.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefe9800640 1 --2- 172.21.15.55:0/977481591 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fefc4066690 0x7fefc4068b50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fefd8000c10 tx=0x7fefd8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:42.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefef630000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00f3ad30 0x555e00f3b110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefef630000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555e00f3b650 0x555e00ef1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefef630000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 0x555e00ef2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefef630000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e00db9170 con 0x555e00ef1f60 2024-04-02T07:30:42.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefef630000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e00d46d80 con 0x555e00f3b650 2024-04-02T07:30:42.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefef630000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e00d44350 con 0x555e00f3ad30 2024-04-02T07:30:42.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefea200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 0x555e00ef2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefea200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 0x555e00ef2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59620/0 (socket says 172.21.15.55:59620) 2024-04-02T07:30:42.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefea200640 1 -- 172.21.15.55:0/665564120 learned_addr learned my addr 172.21.15.55:0/665564120 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:42.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefe9800640 1 --2- 172.21.15.55:0/665564120 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00f3ad30 0x555e00f3b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefe8e00640 1 --2- 172.21.15.55:0/665564120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555e00f3b650 0x555e00ef1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefea200640 1 -- 172.21.15.55:0/665564120 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00f3ad30 msgr2=0x555e00f3b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:42.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefea200640 1 --2- 172.21.15.55:0/665564120 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00f3ad30 0x555e00f3b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefea200640 1 -- 172.21.15.55:0/665564120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555e00f3b650 msgr2=0x555e00ef1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:42.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefea200640 1 --2- 172.21.15.55:0/665564120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555e00f3b650 0x555e00ef1a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefea200640 1 -- 172.21.15.55:0/665564120 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e00a3c070 con 0x555e00ef1f60 2024-04-02T07:30:42.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.334+0000 7fefea200640 1 --2- 172.21.15.55:0/665564120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 0x555e00ef2340 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fefe40c8be0 tx=0x7fefdc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18bf120fed79c3a9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:42.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefd6000640 1 -- 172.21.15.55:0/665564120 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc00e030 con 0x555e00ef1f60 2024-04-02T07:30:42.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefd6000640 1 -- 172.21.15.55:0/665564120 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefdc016460 con 0x555e00ef1f60 2024-04-02T07:30:42.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefd6000640 1 -- 172.21.15.55:0/665564120 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc0167f0 con 0x555e00ef1f60 2024-04-02T07:30:42.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefef630000 1 -- 172.21.15.55:0/665564120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 msgr2=0x555e00ef2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefef630000 1 --2- 172.21.15.55:0/665564120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 0x555e00ef2340 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7fefe40c8be0 tx=0x7fefdc009750 comp rx=0 tx=0).stop 2024-04-02T07:30:42.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefef630000 1 -- 172.21.15.55:0/665564120 shutdown_connections 2024-04-02T07:30:42.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefef630000 1 --2- 172.21.15.55:0/665564120 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 0x555e00ef2340 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefef630000 1 --2- 172.21.15.55:0/665564120 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555e00f3b650 0x555e00ef1a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefef630000 1 --2- 172.21.15.55:0/665564120 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00f3ad30 0x555e00f3b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefef630000 1 -- 172.21.15.55:0/665564120 >> 172.21.15.55:0/665564120 conn(0x555e00eedf10 msgr2=0x555e00ef0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:42.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefef630000 1 -- 172.21.15.55:0/665564120 shutdown_connections 2024-04-02T07:30:42.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefef630000 1 -- 172.21.15.55:0/665564120 wait complete. 2024-04-02T07:30:42.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefef630000 1 -- start start 2024-04-02T07:30:42.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefef630000 1 Processor -- start 2024-04-02T07:30:42.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefef630000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 0x555e00ef79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefef630000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555e00f3ad30 0x555e00f3bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefef630000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00f3b650 0x555e00f3c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefef630000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e00d3fc40 con 0x555e00ef1f60 2024-04-02T07:30:42.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefef630000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e00cdefa0 con 0x555e00f3ad30 2024-04-02T07:30:42.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefef630000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e00cfd1c0 con 0x555e00f3b650 2024-04-02T07:30:42.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefef630000 10 client.0 _ll_register_callbacks cb 0x555e00edd060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:30:42.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefe9800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 0x555e00ef79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefe9800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 0x555e00ef79d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59624/0 (socket says 172.21.15.55:59624) 2024-04-02T07:30:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefe9800640 1 -- 172.21.15.55:0/3818227080 learned_addr learned my addr 172.21.15.55:0/3818227080 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefea200640 1 --2- 172.21.15.55:0/3818227080 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00f3b650 0x555e00f3c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefe9800640 1 -- 172.21.15.55:0/3818227080 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00f3b650 msgr2=0x555e00f3c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefe9800640 1 --2- 172.21.15.55:0/3818227080 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00f3b650 0x555e00f3c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefe9800640 1 -- 172.21.15.55:0/3818227080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555e00f3ad30 msgr2=0x555e00f3bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefe9800640 1 --2- 172.21.15.55:0/3818227080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555e00f3ad30 0x555e00f3bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefe9800640 1 -- 172.21.15.55:0/3818227080 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefdc009a70 con 0x555e00ef1f60 2024-04-02T07:30:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefea200640 1 --2- 172.21.15.55:0/3818227080 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00f3b650 0x555e00f3c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:30:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefe9800640 1 --2- 172.21.15.55:0/3818227080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 0x555e00ef79d0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fefd8014d30 tx=0x7fefd8001e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2498a6c0b1b0178 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefcaa00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:30:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefcaa00640 1 -- 172.21.15.55:0/3818227080 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd802a030 con 0x555e00ef1f60 2024-04-02T07:30:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefcaa00640 1 -- 172.21.15.55:0/3818227080 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fefd802b070 con 0x555e00ef1f60 2024-04-02T07:30:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.338+0000 7fefef630000 1 -- 172.21.15.55:0/3818227080 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e00d3ca20 con 0x555e00ef1f60 2024-04-02T07:30:42.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefcaa00640 1 -- 172.21.15.55:0/3818227080 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefd801c040 con 0x555e00ef1f60 2024-04-02T07:30:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefef630000 10 client.8163 fetch_fsmap learned FSMap version 73 2024-04-02T07:30:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefef630000 1 -- 172.21.15.55:0/3818227080 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x555e00d04ba0 con 0x555e00ef1f60 2024-04-02T07:30:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefcaa00640 1 -- 172.21.15.55:0/3818227080 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd8035020 con 0x555e00ef1f60 2024-04-02T07:30:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefcaa00640 1 -- 172.21.15.55:0/3818227080 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 73) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fefd8022050 con 0x555e00ef1f60 2024-04-02T07:30:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefef630000 10 client.8163 fetch_fsmap finished waiting for FSMap version 73 2024-04-02T07:30:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefef630000 10 client.8163 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-02T07:30:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefef630000 20 client.8163 populate_metadata read hostname 'smithi055' 2024-04-02T07:30:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefef630000 1 --2- 172.21.15.55:0/3818227080 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x555e00f42330 0x555e00f42740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefef630000 4 client.8163 mds_command: new command op to 8052 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:30:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefef630000 1 -- 172.21.15.55:0/3818227080 --> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555e00d3e590 con 0x555e00f42330 2024-04-02T07:30:42.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefe8e00640 1 --2- 172.21.15.55:0/3818227080 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x555e00f42330 0x555e00f42740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefe8e00640 1 --2- 172.21.15.55:0/3818227080 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x555e00f42330 0x555e00f42740 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec34dbbb53bbb7e server_cookie=662e019c1420fc26 in_seq=0 out_seq=0 2024-04-02T07:30:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefcaa00640 10 client.8163 ms_handle_connect on v2:172.21.15.55:6832/2658455613 2024-04-02T07:30:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefcaa00640 1 -- 172.21.15.55:0/3818227080 <== mds.0 v2:172.21.15.55:6832/2658455613 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555e00d3e590 con 0x555e00f42330 2024-04-02T07:30:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefcaa00640 10 client.8163 handle_command_reply: tid=0 2024-04-02T07:30:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefef630000 1 client.8163 shutdown 2024-04-02T07:30:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefef630000 1 -- 172.21.15.55:0/3818227080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 msgr2=0x555e00ef79d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefef630000 1 --2- 172.21.15.55:0/3818227080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 0x555e00ef79d0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fefd8014d30 tx=0x7fefd8001e80 comp rx=0 tx=0).stop 2024-04-02T07:30:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefef630000 1 -- 172.21.15.55:0/3818227080 shutdown_connections 2024-04-02T07:30:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefef630000 1 --2- 172.21.15.55:0/3818227080 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x555e00f42330 0x555e00f42740 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefef630000 1 --2- 172.21.15.55:0/3818227080 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00f3b650 0x555e00f3c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefef630000 1 --2- 172.21.15.55:0/3818227080 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555e00f3ad30 0x555e00f3bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefef630000 1 --2- 172.21.15.55:0/3818227080 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 0x555e00ef79d0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefef630000 1 -- 172.21.15.55:0/3818227080 >> 172.21.15.55:0/3818227080 conn(0x555e00eedf10 msgr2=0x555e00ef0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefcaa00640 0 client.8163 ms_handle_reset on v2:172.21.15.55:6832/2658455613 2024-04-02T07:30:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefef630000 1 -- 172.21.15.55:0/3818227080 shutdown_connections 2024-04-02T07:30:42.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefef630000 1 -- 172.21.15.55:0/3818227080 wait complete. 2024-04-02T07:30:42.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.342+0000 7fefef630000 20 client.8163 trim_cache size 0 max 16384 2024-04-02T07:30:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefef630000 1 Processor -- start 2024-04-02T07:30:42.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefef630000 1 -- start start 2024-04-02T07:30:42.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefef630000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00ef1f60 0x555e00f958b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefef630000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555e00f3ad30 0x555e00f95df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefef630000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00f3b650 0x555e00f96330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefef630000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e009fccf0 con 0x555e00f3b650 2024-04-02T07:30:42.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefef630000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e00d830c0 con 0x555e00f3ad30 2024-04-02T07:30:42.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefef630000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e00eed8b0 con 0x555e00ef1f60 2024-04-02T07:30:42.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefea200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00f3b650 0x555e00f96330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefea200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00f3b650 0x555e00f96330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59634/0 (socket says 172.21.15.55:59634) 2024-04-02T07:30:42.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefea200640 1 -- 172.21.15.55:0/2093323297 learned_addr learned my addr 172.21.15.55:0/2093323297 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:42.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefe8e00640 1 --2- 172.21.15.55:0/2093323297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555e00f3ad30 0x555e00f95df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefe9800640 1 --2- 172.21.15.55:0/2093323297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00ef1f60 0x555e00f958b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefea200640 1 -- 172.21.15.55:0/2093323297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00ef1f60 msgr2=0x555e00f958b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:42.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefea200640 1 --2- 172.21.15.55:0/2093323297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00ef1f60 0x555e00f958b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefea200640 1 -- 172.21.15.55:0/2093323297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555e00f3ad30 msgr2=0x555e00f95df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:42.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefea200640 1 --2- 172.21.15.55:0/2093323297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555e00f3ad30 0x555e00f95df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefea200640 1 -- 172.21.15.55:0/2093323297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555e00ceaef0 con 0x555e00f3b650 2024-04-02T07:30:42.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefe9800640 1 --2- 172.21.15.55:0/2093323297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00ef1f60 0x555e00f958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:30:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefe8e00640 1 --2- 172.21.15.55:0/2093323297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555e00f3ad30 0x555e00f95df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:30:42.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefea200640 1 --2- 172.21.15.55:0/2093323297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00f3b650 0x555e00f96330 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fefdc000f90 tx=0x7fefdc016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c5a8c27880a896 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:42.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefd6a00640 1 -- 172.21.15.55:0/2093323297 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc00e040 con 0x555e00f3b650 2024-04-02T07:30:42.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefd6a00640 1 -- 172.21.15.55:0/2093323297 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefdc009da0 con 0x555e00f3b650 2024-04-02T07:30:42.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.358+0000 7fefd6a00640 1 -- 172.21.15.55:0/2093323297 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefdc0296c0 con 0x555e00f3b650 2024-04-02T07:30:42.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 1 -- 172.21.15.55:0/2093323297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00f3b650 msgr2=0x555e00f96330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 1 --2- 172.21.15.55:0/2093323297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00f3b650 0x555e00f96330 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fefdc000f90 tx=0x7fefdc016000 comp rx=0 tx=0).stop 2024-04-02T07:30:42.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 1 -- 172.21.15.55:0/2093323297 shutdown_connections 2024-04-02T07:30:42.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 1 --2- 172.21.15.55:0/2093323297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00f3b650 0x555e00f96330 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 1 --2- 172.21.15.55:0/2093323297 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555e00f3ad30 0x555e00f95df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 1 --2- 172.21.15.55:0/2093323297 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00ef1f60 0x555e00f958b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 1 -- 172.21.15.55:0/2093323297 >> 172.21.15.55:0/2093323297 conn(0x555e00eedf10 msgr2=0x555e00ef0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:42.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 1 -- 172.21.15.55:0/2093323297 shutdown_connections 2024-04-02T07:30:42.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 1 -- 172.21.15.55:0/2093323297 wait complete. 2024-04-02T07:30:42.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 1 -- start start 2024-04-02T07:30:42.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 1 Processor -- start 2024-04-02T07:30:42.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 0x555e00f7de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00f3ad30 0x555e00f401a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555e00f3b650 0x555e00f406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e00d3b430 con 0x555e00ef1f60 2024-04-02T07:30:42.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555e00d427a0 con 0x555e00f3b650 2024-04-02T07:30:42.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x555e00d3d040 con 0x555e00f3ad30 2024-04-02T07:30:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 10 client.0 _ll_register_callbacks cb 0x555e00db90c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:30:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefe9800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 0x555e00f7de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefe9800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 0x555e00f7de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59650/0 (socket says 172.21.15.55:59650) 2024-04-02T07:30:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefe9800640 1 -- 172.21.15.55:0/1668258911 learned_addr learned my addr 172.21.15.55:0/1668258911 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefe8e00640 1 --2- 172.21.15.55:0/1668258911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00f3ad30 0x555e00f401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefea200640 1 --2- 172.21.15.55:0/1668258911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555e00f3b650 0x555e00f406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefe9800640 1 -- 172.21.15.55:0/1668258911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00f3ad30 msgr2=0x555e00f401a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefe9800640 1 --2- 172.21.15.55:0/1668258911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00f3ad30 0x555e00f401a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefe9800640 1 -- 172.21.15.55:0/1668258911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555e00f3b650 msgr2=0x555e00f406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefe9800640 1 --2- 172.21.15.55:0/1668258911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555e00f3b650 0x555e00f406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefe9800640 1 -- 172.21.15.55:0/1668258911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555e00a3c070 con 0x555e00ef1f60 2024-04-02T07:30:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefe9800640 1 --2- 172.21.15.55:0/1668258911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 0x555e00f7de50 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fefd8025c90 tx=0x7fefd8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=438e042c3331049c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:42.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefcaa00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:30:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefcaa00640 1 -- 172.21.15.55:0/1668258911 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd802a070 con 0x555e00ef1f60 2024-04-02T07:30:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefcaa00640 1 -- 172.21.15.55:0/1668258911 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fefd8036080 con 0x555e00ef1f60 2024-04-02T07:30:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 1 -- 172.21.15.55:0/1668258911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555e00f519f0 con 0x555e00ef1f60 2024-04-02T07:30:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefcaa00640 1 -- 172.21.15.55:0/1668258911 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefd8025e70 con 0x555e00ef1f60 2024-04-02T07:30:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 10 client.8169 fetch_fsmap learned FSMap version 73 2024-04-02T07:30:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefef630000 1 -- 172.21.15.55:0/1668258911 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x555e00cdea60 con 0x555e00ef1f60 2024-04-02T07:30:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.362+0000 7fefcaa00640 1 -- 172.21.15.55:0/1668258911 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555e00f519f0 con 0x555e00ef1f60 2024-04-02T07:30:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefcaa00640 1 -- 172.21.15.55:0/1668258911 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 73) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fefd8042050 con 0x555e00ef1f60 2024-04-02T07:30:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefef630000 10 client.8169 fetch_fsmap finished waiting for FSMap version 73 2024-04-02T07:30:42.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefef630000 10 client.8169 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-02T07:30:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefef630000 20 client.8169 populate_metadata read hostname 'smithi055' 2024-04-02T07:30:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefef630000 1 --2- 172.21.15.55:0/1668258911 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x555e00f40c20 0x555e00f41030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefef630000 4 client.8169 mds_command: new command op to 8052 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}] 2024-04-02T07:30:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefef630000 1 -- 172.21.15.55:0/1668258911 --> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] -- command(tid 0: {"prefix": "scrub start", "path": "/dir", "scrubops": ["recursive", "repair"]}) v1 -- 0x555e00cfc5f0 con 0x555e00f40c20 2024-04-02T07:30:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefe8e00640 1 --2- 172.21.15.55:0/1668258911 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x555e00f40c20 0x555e00f41030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefe8e00640 1 --2- 172.21.15.55:0/1668258911 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x555e00f40c20 0x555e00f41030 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3cbe7a3107cc7db server_cookie=eb987e4c22b929c4 in_seq=0 out_seq=0 2024-04-02T07:30:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefcaa00640 10 client.8169 ms_handle_connect on v2:172.21.15.55:6832/2658455613 2024-04-02T07:30:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefcaa00640 1 -- 172.21.15.55:0/1668258911 <== mds.0 v2:172.21.15.55:6832/2658455613 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x555e00cfc5f0 con 0x555e00f40c20 2024-04-02T07:30:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefcaa00640 10 client.8169 handle_command_reply: tid=0 2024-04-02T07:30:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefef630000 1 client.8169 shutdown 2024-04-02T07:30:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefef630000 1 -- 172.21.15.55:0/1668258911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 msgr2=0x555e00f7de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefef630000 1 --2- 172.21.15.55:0/1668258911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 0x555e00f7de50 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fefd8025c90 tx=0x7fefd8019000 comp rx=0 tx=0).stop 2024-04-02T07:30:42.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefef630000 1 -- 172.21.15.55:0/1668258911 shutdown_connections 2024-04-02T07:30:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefef630000 1 --2- 172.21.15.55:0/1668258911 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x555e00f40c20 0x555e00f41030 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefef630000 1 --2- 172.21.15.55:0/1668258911 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555e00f3b650 0x555e00f406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefef630000 1 --2- 172.21.15.55:0/1668258911 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555e00f3ad30 0x555e00f401a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefef630000 1 --2- 172.21.15.55:0/1668258911 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555e00ef1f60 0x555e00f7de50 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefcaa00640 0 client.8169 ms_handle_reset on v2:172.21.15.55:6832/2658455613 2024-04-02T07:30:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefef630000 1 -- 172.21.15.55:0/1668258911 >> 172.21.15.55:0/1668258911 conn(0x555e00eedf10 msgr2=0x555e00ef0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefef630000 1 -- 172.21.15.55:0/1668258911 shutdown_connections 2024-04-02T07:30:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefef630000 1 -- 172.21.15.55:0/1668258911 wait complete. 2024-04-02T07:30:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefef630000 20 client.8169 trim_cache size 0 max 16384 2024-04-02T07:30:42.371 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:30:42.371 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-04-02T07:30:42.372 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "ea279c27-6e03-4c00-98a8-3f65ec862bea", 2024-04-02T07:30:42.372 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-04-02T07:30:42.372 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:30:42.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefec200640 1 -- 172.21.15.55:0/977481591 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fefc4066690 msgr2=0x7fefc4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefec200640 1 --2- 172.21.15.55:0/977481591 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fefc4066690 0x7fefc4068b50 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fefd8000c10 tx=0x7fefd8009040 comp rx=0 tx=0).stop 2024-04-02T07:30:42.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefec200640 1 -- 172.21.15.55:0/977481591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefe41596f0 msgr2=0x7fefe41546b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefec200640 1 --2- 172.21.15.55:0/977481591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefe41596f0 0x7fefe41546b0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7fefd001d2b0 tx=0x7fefcc005800 comp rx=0 tx=0).stop 2024-04-02T07:30:42.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefec200640 1 -- 172.21.15.55:0/977481591 shutdown_connections 2024-04-02T07:30:42.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefec200640 1 --2- 172.21.15.55:0/977481591 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fefe4151990 0x7fefe4151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefec200640 1 --2- 172.21.15.55:0/977481591 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fefe41596f0 0x7fefe41546b0 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefec200640 1 --2- 172.21.15.55:0/977481591 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fefc4066690 0x7fefc4068b50 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefec200640 1 --2- 172.21.15.55:0/977481591 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fefcc003f00 0x7fefe4150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefec200640 1 -- 172.21.15.55:0/977481591 >> 172.21.15.55:0/977481591 conn(0x7fefe4069d90 msgr2=0x7fefe4154f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:42.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefec200640 1 -- 172.21.15.55:0/977481591 shutdown_connections 2024-04-02T07:30:42.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fefec200640 1 -- 172.21.15.55:0/977481591 wait complete. 2024-04-02T07:30:42.373 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-04-02T07:30:42.366+0000 7fe9ab400640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55cbe304c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(13)0x10000000001:[<0x10000000000/file v6>,<0x1/dir v13>]//[]","memoryvalue":"(13)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v21>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-02T07:30:42.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:30:42.389 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-02T07:30:42.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.530+0000 7fce5fc00640 1 Processor -- start 2024-04-02T07:30:42.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.530+0000 7fce5fc00640 1 -- start start 2024-04-02T07:30:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.534+0000 7fce5fc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce58098a10 0x7fce58098e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.534+0000 7fce5fc00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce5815ce40 con 0x7fce5815ca60 2024-04-02T07:30:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.534+0000 7fce5fc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce58099390 con 0x7fce5806b920 2024-04-02T07:30:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.534+0000 7fce5fc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce5806c460 con 0x7fce58098a10 2024-04-02T07:30:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.534+0000 7fce5d200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fce5815ca60 0x7fce580cfc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58150/0 (socket says 172.21.15.55:58150) 2024-04-02T07:30:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.534+0000 7fce5d200640 1 -- 172.21.15.55:0/3352748390 learned_addr learned my addr 172.21.15.55:0/3352748390 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:30:42.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.534+0000 7fce4fe00640 1 --2- 172.21.15.55:0/3352748390 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce58098a10 0x7fce58098e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.534+0000 7fce57e00640 1 -- 172.21.15.55:0/3352748390 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 640573800 0 0) 0x7fce5815ce40 con 0x7fce5815ca60 2024-04-02T07:30:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.534+0000 7fce57e00640 1 -- 172.21.15.55:0/3352748390 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fce3c003530 con 0x7fce5815ca60 2024-04-02T07:30:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.534+0000 7fce4fe00640 1 -- 172.21.15.55:0/3352748390 >> v1:172.21.15.106:6789/0 conn(0x7fce5806b920 legacy=0x7fce5806bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.534+0000 7fce4fe00640 1 -- 172.21.15.55:0/3352748390 >> v1:172.21.15.55:6789/0 conn(0x7fce5815ca60 legacy=0x7fce580cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.534+0000 7fce4fe00640 1 -- 172.21.15.55:0/3352748390 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce580ceeb0 con 0x7fce58098a10 2024-04-02T07:30:42.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce4fe00640 1 --2- 172.21.15.55:0/3352748390 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce58098a10 0x7fce58098e50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fce400097f0 tx=0x7fce4001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36be98b5db3e0210 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:42.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce57e00640 1 -- 172.21.15.55:0/3352748390 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce400ab620 con 0x7fce58098a10 2024-04-02T07:30:42.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce57e00640 1 -- 172.21.15.55:0/3352748390 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce400ab780 con 0x7fce58098a10 2024-04-02T07:30:42.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce57e00640 1 -- 172.21.15.55:0/3352748390 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce400abb10 con 0x7fce58098a10 2024-04-02T07:30:42.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce5fc00640 1 -- 172.21.15.55:0/3352748390 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce58098a10 msgr2=0x7fce58098e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce5fc00640 1 --2- 172.21.15.55:0/3352748390 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce58098a10 0x7fce58098e50 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fce400097f0 tx=0x7fce4001c420 comp rx=0 tx=0).stop 2024-04-02T07:30:42.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce5fc00640 1 -- 172.21.15.55:0/3352748390 shutdown_connections 2024-04-02T07:30:42.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce5fc00640 1 --2- 172.21.15.55:0/3352748390 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce58098a10 0x7fce58098e50 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce5fc00640 1 -- 172.21.15.55:0/3352748390 >> 172.21.15.55:0/3352748390 conn(0x7fce580b2150 msgr2=0x7fce580b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:42.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce5fc00640 1 -- 172.21.15.55:0/3352748390 shutdown_connections 2024-04-02T07:30:42.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce5fc00640 1 -- 172.21.15.55:0/3352748390 wait complete. 2024-04-02T07:30:42.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce5fc00640 1 Processor -- start 2024-04-02T07:30:42.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce5fc00640 1 -- start start 2024-04-02T07:30:42.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce5fc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce5806b920 0x7fce58158d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce5fc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce58098a10 0x7fce580b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce5fc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce5815ca60 0x7fce580b5190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce5fc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5815bb10 con 0x7fce5806b920 2024-04-02T07:30:42.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce5fc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce581599f0 con 0x7fce5815ca60 2024-04-02T07:30:42.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce5fc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce580b56d0 con 0x7fce58098a10 2024-04-02T07:30:42.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce5d200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce5806b920 0x7fce58158d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce5d200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce5806b920 0x7fce58158d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59666/0 (socket says 172.21.15.55:59666) 2024-04-02T07:30:42.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.538+0000 7fce5d200640 1 -- 172.21.15.55:0/2476414535 learned_addr learned my addr 172.21.15.55:0/2476414535 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:42.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.542+0000 7fce4fe00640 1 --2- 172.21.15.55:0/2476414535 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce58098a10 0x7fce580b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.542+0000 7fce5dc00640 1 --2- 172.21.15.55:0/2476414535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce5815ca60 0x7fce580b5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.542+0000 7fce5d200640 1 -- 172.21.15.55:0/2476414535 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce58098a10 msgr2=0x7fce580b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.542+0000 7fce5d200640 1 --2- 172.21.15.55:0/2476414535 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce58098a10 0x7fce580b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.542+0000 7fce5d200640 1 -- 172.21.15.55:0/2476414535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce5815ca60 msgr2=0x7fce580b5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.542+0000 7fce5d200640 1 --2- 172.21.15.55:0/2476414535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce5815ca60 0x7fce580b5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.542+0000 7fce5d200640 1 -- 172.21.15.55:0/2476414535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce40009420 con 0x7fce5806b920 2024-04-02T07:30:42.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.542+0000 7fce5dc00640 1 --2- 172.21.15.55:0/2476414535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce5815ca60 0x7fce580b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:30:42.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.542+0000 7fce5d200640 1 --2- 172.21.15.55:0/2476414535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce5806b920 0x7fce58158d30 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fce4800c450 tx=0x7fce4800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:42.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.542+0000 7fce55600640 1 -- 172.21.15.55:0/2476414535 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce48005cf0 con 0x7fce5806b920 2024-04-02T07:30:42.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.542+0000 7fce55600640 1 -- 172.21.15.55:0/2476414535 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce48005e50 con 0x7fce5806b920 2024-04-02T07:30:42.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.542+0000 7fce55600640 1 -- 172.21.15.55:0/2476414535 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce48007270 con 0x7fce5806b920 2024-04-02T07:30:42.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.542+0000 7fce5fc00640 1 -- 172.21.15.55:0/2476414535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce580ae710 con 0x7fce5806b920 2024-04-02T07:30:42.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.542+0000 7fce5fc00640 1 -- 172.21.15.55:0/2476414535 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce580aecd0 con 0x7fce5806b920 2024-04-02T07:30:42.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.542+0000 7fce55600640 1 -- 172.21.15.55:0/2476414535 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fce480073d0 con 0x7fce5806b920 2024-04-02T07:30:42.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.542+0000 7fce55600640 1 --2- 172.21.15.55:0/2476414535 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fce340666c0 0x7fce34068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.542+0000 7fce55600640 1 -- 172.21.15.55:0/2476414535 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fce48083730 con 0x7fce5806b920 2024-04-02T07:30:42.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce63084000 1 Processor -- start 2024-04-02T07:30:42.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce4fe00640 1 --2- 172.21.15.55:0/2476414535 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fce340666c0 0x7fce34068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce63084000 1 -- start start 2024-04-02T07:30:42.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce4fe00640 1 --2- 172.21.15.55:0/2476414535 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fce340666c0 0x7fce34068b80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fce400af000 tx=0x7fce400a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:42.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce63084000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a7a70 0x55a5050a7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce63084000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5050a8390 0x55a50505b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce63084000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a50505ba00 0x55a50505bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce63084000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a504f26630 con 0x55a5050a8390 2024-04-02T07:30:42.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce63084000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a504eb3bd0 con 0x55a5050a7a70 2024-04-02T07:30:42.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce63084000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a504eb11a0 con 0x55a50505ba00 2024-04-02T07:30:42.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce4fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5050a8390 0x55a50505b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce4fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5050a8390 0x55a50505b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59680/0 (socket says 172.21.15.55:59680) 2024-04-02T07:30:42.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce4fe00640 1 -- 172.21.15.55:0/1139159485 learned_addr learned my addr 172.21.15.55:0/1139159485 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:42.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce5dc00640 1 --2- 172.21.15.55:0/1139159485 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a50505ba00 0x55a50505bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce5d200640 1 --2- 172.21.15.55:0/1139159485 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a7a70 0x55a5050a7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce4fe00640 1 -- 172.21.15.55:0/1139159485 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a50505ba00 msgr2=0x55a50505bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:42.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce4fe00640 1 --2- 172.21.15.55:0/1139159485 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a50505ba00 0x55a50505bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce4fe00640 1 -- 172.21.15.55:0/1139159485 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a7a70 msgr2=0x55a5050a7e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:42.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce4fe00640 1 --2- 172.21.15.55:0/1139159485 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a7a70 0x55a5050a7e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce4fe00640 1 -- 172.21.15.55:0/1139159485 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a504ba8e20 con 0x55a5050a8390 2024-04-02T07:30:42.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce4fe00640 1 --2- 172.21.15.55:0/1139159485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5050a8390 0x55a50505b4c0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fce400ad040 tx=0x7fce40004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278ff5229a0e2f5a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:42.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce4d600640 1 -- 172.21.15.55:0/1139159485 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce400c26d0 con 0x55a5050a8390 2024-04-02T07:30:42.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce4d600640 1 -- 172.21.15.55:0/1139159485 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce400c6070 con 0x55a5050a8390 2024-04-02T07:30:42.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce4d600640 1 -- 172.21.15.55:0/1139159485 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce400c2a30 con 0x55a5050a8390 2024-04-02T07:30:42.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce63084000 1 -- 172.21.15.55:0/1139159485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5050a8390 msgr2=0x55a50505b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce63084000 1 --2- 172.21.15.55:0/1139159485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5050a8390 0x55a50505b4c0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fce400ad040 tx=0x7fce40004740 comp rx=0 tx=0).stop 2024-04-02T07:30:42.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce63084000 1 -- 172.21.15.55:0/1139159485 shutdown_connections 2024-04-02T07:30:42.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce63084000 1 --2- 172.21.15.55:0/1139159485 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a50505ba00 0x55a50505bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce63084000 1 --2- 172.21.15.55:0/1139159485 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5050a8390 0x55a50505b4c0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce63084000 1 --2- 172.21.15.55:0/1139159485 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a7a70 0x55a5050a7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce63084000 1 -- 172.21.15.55:0/1139159485 >> 172.21.15.55:0/1139159485 conn(0x55a504e5c160 msgr2=0x55a50508a820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:42.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce63084000 1 -- 172.21.15.55:0/1139159485 shutdown_connections 2024-04-02T07:30:42.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce63084000 1 -- 172.21.15.55:0/1139159485 wait complete. 2024-04-02T07:30:42.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.546+0000 7fce63084000 1 -- start start 2024-04-02T07:30:42.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce63084000 1 Processor -- start 2024-04-02T07:30:42.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce63084000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a50505ba00 0x55a5050647b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce63084000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5050a7a70 0x55a50508ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce63084000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a8390 0x55a50508bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce63084000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a504eaca90 con 0x55a5050a7a70 2024-04-02T07:30:42.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce63084000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a504e4bd40 con 0x55a5050a8390 2024-04-02T07:30:42.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce63084000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a504e69f30 con 0x55a50505ba00 2024-04-02T07:30:42.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce63084000 10 client.0 _ll_register_callbacks cb 0x55a504f0e810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:30:42.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce4fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5050a7a70 0x55a50508ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce4fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5050a7a70 0x55a50508ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59682/0 (socket says 172.21.15.55:59682) 2024-04-02T07:30:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce4fe00640 1 -- 172.21.15.55:0/2007639119 learned_addr learned my addr 172.21.15.55:0/2007639119 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce5d200640 1 --2- 172.21.15.55:0/2007639119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a50505ba00 0x55a5050647b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce5dc00640 1 --2- 172.21.15.55:0/2007639119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a8390 0x55a50508bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce4fe00640 1 -- 172.21.15.55:0/2007639119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a50505ba00 msgr2=0x55a5050647b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce4fe00640 1 --2- 172.21.15.55:0/2007639119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a50505ba00 0x55a5050647b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce4fe00640 1 -- 172.21.15.55:0/2007639119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a8390 msgr2=0x55a50508bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce4fe00640 1 --2- 172.21.15.55:0/2007639119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a8390 0x55a50508bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce4fe00640 1 -- 172.21.15.55:0/2007639119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce400bc070 con 0x55a5050a7a70 2024-04-02T07:30:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce4fe00640 1 --2- 172.21.15.55:0/2007639119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5050a7a70 0x55a50508ba50 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fce4001c900 tx=0x7fce4001ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b65ab315239195 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce46000640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:30:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce46000640 1 -- 172.21.15.55:0/2007639119 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce400c27d0 con 0x55a5050a7a70 2024-04-02T07:30:42.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce46000640 1 -- 172.21.15.55:0/2007639119 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fce400d4b70 con 0x55a5050a7a70 2024-04-02T07:30:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce63084000 1 -- 172.21.15.55:0/2007639119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a504eab3e0 con 0x55a5050a7a70 2024-04-02T07:30:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce46000640 1 -- 172.21.15.55:0/2007639119 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce400d4d30 con 0x55a5050a7a70 2024-04-02T07:30:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce63084000 10 client.8181 fetch_fsmap learned FSMap version 73 2024-04-02T07:30:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce63084000 1 -- 172.21.15.55:0/2007639119 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x55a504e71aa0 con 0x55a5050a7a70 2024-04-02T07:30:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce46000640 1 -- 172.21.15.55:0/2007639119 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55a504eab3e0 con 0x55a5050a7a70 2024-04-02T07:30:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce46000640 1 -- 172.21.15.55:0/2007639119 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 73) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fce400c2930 con 0x55a5050a7a70 2024-04-02T07:30:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce63084000 10 client.8181 fetch_fsmap finished waiting for FSMap version 73 2024-04-02T07:30:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce63084000 10 client.8181 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-02T07:30:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce63084000 20 client.8181 populate_metadata read hostname 'smithi055' 2024-04-02T07:30:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce63084000 1 --2- 172.21.15.55:0/2007639119 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55a5050af2d0 0x55a5050af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce63084000 4 client.8181 mds_command: new command op to 8052 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:30:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce63084000 1 -- 172.21.15.55:0/2007639119 --> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a504e7cd00 con 0x55a5050af2d0 2024-04-02T07:30:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce5d200640 1 --2- 172.21.15.55:0/2007639119 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55a5050af2d0 0x55a5050af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.557 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce5d200640 1 --2- 172.21.15.55:0/2007639119 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55a5050af2d0 0x55a5050af6b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e800f6c78eab474 server_cookie=b768c5f7a199a95d in_seq=0 out_seq=0 2024-04-02T07:30:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.550+0000 7fce46000640 10 client.8181 ms_handle_connect on v2:172.21.15.55:6832/2658455613 2024-04-02T07:30:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.554+0000 7fce46000640 1 -- 172.21.15.55:0/2007639119 <== mds.0 v2:172.21.15.55:6832/2658455613 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55a504e7cd00 con 0x55a5050af2d0 2024-04-02T07:30:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.554+0000 7fce46000640 10 client.8181 handle_command_reply: tid=0 2024-04-02T07:30:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.554+0000 7fce63084000 1 client.8181 shutdown 2024-04-02T07:30:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.554+0000 7fce63084000 1 -- 172.21.15.55:0/2007639119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5050a7a70 msgr2=0x55a50508ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.554+0000 7fce63084000 1 --2- 172.21.15.55:0/2007639119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5050a7a70 0x55a50508ba50 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7fce4001c900 tx=0x7fce4001ac60 comp rx=0 tx=0).stop 2024-04-02T07:30:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.554+0000 7fce63084000 1 -- 172.21.15.55:0/2007639119 shutdown_connections 2024-04-02T07:30:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.554+0000 7fce63084000 1 --2- 172.21.15.55:0/2007639119 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55a5050af2d0 0x55a5050af6b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.554+0000 7fce63084000 1 --2- 172.21.15.55:0/2007639119 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a8390 0x55a50508bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.554+0000 7fce63084000 1 --2- 172.21.15.55:0/2007639119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a5050a7a70 0x55a50508ba50 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.554+0000 7fce63084000 1 --2- 172.21.15.55:0/2007639119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a50505ba00 0x55a5050647b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.558 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.554+0000 7fce46000640 0 client.8181 ms_handle_reset on v2:172.21.15.55:6832/2658455613 2024-04-02T07:30:42.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.554+0000 7fce63084000 1 -- 172.21.15.55:0/2007639119 >> 172.21.15.55:0/2007639119 conn(0x55a504e5c160 msgr2=0x55a50505abb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:42.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.554+0000 7fce63084000 1 -- 172.21.15.55:0/2007639119 shutdown_connections 2024-04-02T07:30:42.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.554+0000 7fce63084000 1 -- 172.21.15.55:0/2007639119 wait complete. 2024-04-02T07:30:42.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.554+0000 7fce63084000 20 client.8181 trim_cache size 0 max 16384 2024-04-02T07:30:42.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.566+0000 7fce63084000 1 Processor -- start 2024-04-02T07:30:42.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.566+0000 7fce63084000 1 -- start start 2024-04-02T07:30:42.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce63084000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a50505ba00 0x55a50505ac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce63084000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5050a7a70 0x55a50505b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce63084000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a8390 0x55a50505bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce63084000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a504b69aa0 con 0x55a50505ba00 2024-04-02T07:30:42.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce63084000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a50508bc80 con 0x55a5050a8390 2024-04-02T07:30:42.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce63084000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a504eaf5f0 con 0x55a5050a7a70 2024-04-02T07:30:42.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce5d200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a50505ba00 0x55a50505ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce5d200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a50505ba00 0x55a50505ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59690/0 (socket says 172.21.15.55:59690) 2024-04-02T07:30:42.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce5d200640 1 -- 172.21.15.55:0/3832985899 learned_addr learned my addr 172.21.15.55:0/3832985899 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:42.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce4fe00640 1 --2- 172.21.15.55:0/3832985899 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5050a7a70 0x55a50505b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce5dc00640 1 --2- 172.21.15.55:0/3832985899 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a8390 0x55a50505bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce5d200640 1 -- 172.21.15.55:0/3832985899 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5050a7a70 msgr2=0x55a50505b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:42.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce5d200640 1 --2- 172.21.15.55:0/3832985899 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5050a7a70 0x55a50505b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce5d200640 1 -- 172.21.15.55:0/3832985899 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a8390 msgr2=0x55a50505bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:42.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce5d200640 1 --2- 172.21.15.55:0/3832985899 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a8390 0x55a50505bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce5d200640 1 -- 172.21.15.55:0/3832985899 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a504e57df0 con 0x55a50505ba00 2024-04-02T07:30:42.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce4fe00640 1 --2- 172.21.15.55:0/3832985899 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5050a7a70 0x55a50505b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:30:42.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce5dc00640 1 --2- 172.21.15.55:0/3832985899 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a8390 0x55a50505bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:30:42.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce5d200640 1 --2- 172.21.15.55:0/3832985899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a50505ba00 0x55a50505ac30 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fce48000f70 tx=0x7fce4801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79fc82f47a02bd8c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:42.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce4e000640 1 -- 172.21.15.55:0/3832985899 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce48052a40 con 0x55a50505ba00 2024-04-02T07:30:42.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce4e000640 1 -- 172.21.15.55:0/3832985899 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce48007680 con 0x55a50505ba00 2024-04-02T07:30:42.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce4e000640 1 -- 172.21.15.55:0/3832985899 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce48050db0 con 0x55a50505ba00 2024-04-02T07:30:42.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce63084000 1 -- 172.21.15.55:0/3832985899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a50505ba00 msgr2=0x55a50505ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce63084000 1 --2- 172.21.15.55:0/3832985899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a50505ba00 0x55a50505ac30 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fce48000f70 tx=0x7fce4801e040 comp rx=0 tx=0).stop 2024-04-02T07:30:42.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce63084000 1 -- 172.21.15.55:0/3832985899 shutdown_connections 2024-04-02T07:30:42.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce63084000 1 --2- 172.21.15.55:0/3832985899 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a8390 0x55a50505bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce63084000 1 --2- 172.21.15.55:0/3832985899 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5050a7a70 0x55a50505b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce63084000 1 --2- 172.21.15.55:0/3832985899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a50505ba00 0x55a50505ac30 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce63084000 1 -- 172.21.15.55:0/3832985899 >> 172.21.15.55:0/3832985899 conn(0x55a504e5c160 msgr2=0x55a505062f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:42.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce63084000 1 -- 172.21.15.55:0/3832985899 shutdown_connections 2024-04-02T07:30:42.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce63084000 1 -- 172.21.15.55:0/3832985899 wait complete. 2024-04-02T07:30:42.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce63084000 1 -- start start 2024-04-02T07:30:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.570+0000 7fce63084000 1 Processor -- start 2024-04-02T07:30:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a50505ba00 0x55a50505ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5050a7a70 0x55a5051035e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a8390 0x55a505103b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a504ea8280 con 0x55a50505ba00 2024-04-02T07:30:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a504e6dc60 con 0x55a5050a8390 2024-04-02T07:30:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55a504eab920 con 0x55a5050a7a70 2024-04-02T07:30:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 10 client.0 _ll_register_callbacks cb 0x7fce40009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:30:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5d200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a50505ba00 0x55a50505ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5d200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a50505ba00 0x55a50505ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59706/0 (socket says 172.21.15.55:59706) 2024-04-02T07:30:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5d200640 1 -- 172.21.15.55:0/1871007038 learned_addr learned my addr 172.21.15.55:0/1871007038 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:30:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce4fe00640 1 --2- 172.21.15.55:0/1871007038 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5050a7a70 0x55a5051035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5dc00640 1 --2- 172.21.15.55:0/1871007038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a8390 0x55a505103b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5d200640 1 -- 172.21.15.55:0/1871007038 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5050a7a70 msgr2=0x55a5051035e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5d200640 1 --2- 172.21.15.55:0/1871007038 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5050a7a70 0x55a5051035e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5d200640 1 -- 172.21.15.55:0/1871007038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a8390 msgr2=0x55a505103b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:30:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5d200640 1 --2- 172.21.15.55:0/1871007038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a8390 0x55a505103b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5d200640 1 -- 172.21.15.55:0/1871007038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce580aecd0 con 0x55a50505ba00 2024-04-02T07:30:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5dc00640 1 --2- 172.21.15.55:0/1871007038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a8390 0x55a505103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:30:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5d200640 1 --2- 172.21.15.55:0/1871007038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a50505ba00 0x55a50505ee50 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fce4800c420 tx=0x7fce400b8040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854c6bf0a355994b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:30:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce46000640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:30:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce46000640 1 -- 172.21.15.55:0/1871007038 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce48053d90 con 0x55a50505ba00 2024-04-02T07:30:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce46000640 1 -- 172.21.15.55:0/1871007038 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fce480581e0 con 0x55a50505ba00 2024-04-02T07:30:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 -- 172.21.15.55:0/1871007038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a50508c360 con 0x55a50505ba00 2024-04-02T07:30:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce46000640 1 -- 172.21.15.55:0/1871007038 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fce4805c550 con 0x55a50505ba00 2024-04-02T07:30:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 10 client.8187 fetch_fsmap learned FSMap version 73 2024-04-02T07:30:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 -- 172.21.15.55:0/1871007038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x55a504e4b960 con 0x55a50505ba00 2024-04-02T07:30:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce46000640 1 -- 172.21.15.55:0/1871007038 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce48079070 con 0x55a50505ba00 2024-04-02T07:30:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce46000640 1 -- 172.21.15.55:0/1871007038 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 73) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fce4805a3b0 con 0x55a50505ba00 2024-04-02T07:30:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 10 client.8187 fetch_fsmap finished waiting for FSMap version 73 2024-04-02T07:30:42.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 10 client.8187 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-02T07:30:42.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 20 client.8187 populate_metadata read hostname 'smithi055' 2024-04-02T07:30:42.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 --2- 172.21.15.55:0/1871007038 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55a50505f390 0x55a505104060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:30:42.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 4 client.8187 mds_command: new command op to 8052 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-02T07:30:42.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 -- 172.21.15.55:0/1871007038 --> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a504e69970 con 0x55a50505f390 2024-04-02T07:30:42.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce4fe00640 1 --2- 172.21.15.55:0/1871007038 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55a50505f390 0x55a505104060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:30:42.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce4fe00640 1 --2- 172.21.15.55:0/1871007038 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55a50505f390 0x55a505104060 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98ff5746637ab65c server_cookie=1d95b8722aaa4899 in_seq=0 out_seq=0 2024-04-02T07:30:42.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce46000640 10 client.8187 ms_handle_connect on v2:172.21.15.55:6832/2658455613 2024-04-02T07:30:42.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce46000640 1 -- 172.21.15.55:0/1871007038 <== mds.0 v2:172.21.15.55:6832/2658455613 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+263 (crc 0 0 0) 0x55a504e69970 con 0x55a50505f390 2024-04-02T07:30:42.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce46000640 10 client.8187 handle_command_reply: tid=0 2024-04-02T07:30:42.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 client.8187 shutdown 2024-04-02T07:30:42.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 -- 172.21.15.55:0/1871007038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a50505ba00 msgr2=0x55a50505ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 --2- 172.21.15.55:0/1871007038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a50505ba00 0x55a50505ee50 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fce4800c420 tx=0x7fce400b8040 comp rx=0 tx=0).stop 2024-04-02T07:30:42.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 -- 172.21.15.55:0/1871007038 shutdown_connections 2024-04-02T07:30:42.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 --2- 172.21.15.55:0/1871007038 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55a50505f390 0x55a505104060 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 --2- 172.21.15.55:0/1871007038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55a5050a8390 0x55a505103b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 --2- 172.21.15.55:0/1871007038 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55a5050a7a70 0x55a5051035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 --2- 172.21.15.55:0/1871007038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55a50505ba00 0x55a50505ee50 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce46000640 0 client.8187 ms_handle_reset on v2:172.21.15.55:6832/2658455613 2024-04-02T07:30:42.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 -- 172.21.15.55:0/1871007038 >> 172.21.15.55:0/1871007038 conn(0x55a504e5c160 msgr2=0x55a505063810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:42.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 -- 172.21.15.55:0/1871007038 shutdown_connections 2024-04-02T07:30:42.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 1 -- 172.21.15.55:0/1871007038 wait complete. 2024-04-02T07:30:42.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce63084000 20 client.8187 trim_cache size 0 max 16384 2024-04-02T07:30:42.581 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:30:42.581 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-02T07:30:42.581 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-04-02T07:30:42.582 INFO:teuthology.orchestra.run.smithi055.stdout: "ea279c27-6e03-4c00-98a8-3f65ec862bea": { 2024-04-02T07:30:42.582 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/dir", 2024-04-02T07:30:42.582 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "ea279c27-6e03-4c00-98a8-3f65ec862bea", 2024-04-02T07:30:42.582 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive,repair" 2024-04-02T07:30:42.582 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:30:42.582 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:30:42.582 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:30:42.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5fc00640 1 -- 172.21.15.55:0/2476414535 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fce340666c0 msgr2=0x7fce34068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5fc00640 1 --2- 172.21.15.55:0/2476414535 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fce340666c0 0x7fce34068b80 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fce400af000 tx=0x7fce400a7000 comp rx=0 tx=0).stop 2024-04-02T07:30:42.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5fc00640 1 -- 172.21.15.55:0/2476414535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce5806b920 msgr2=0x7fce58158d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:30:42.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5fc00640 1 --2- 172.21.15.55:0/2476414535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce5806b920 0x7fce58158d30 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fce4800c450 tx=0x7fce4800c910 comp rx=0 tx=0).stop 2024-04-02T07:30:42.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5fc00640 1 -- 172.21.15.55:0/2476414535 shutdown_connections 2024-04-02T07:30:42.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5fc00640 1 --2- 172.21.15.55:0/2476414535 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fce340666c0 0x7fce34068b80 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5fc00640 1 --2- 172.21.15.55:0/2476414535 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce5815ca60 0x7fce580b5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5fc00640 1 --2- 172.21.15.55:0/2476414535 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce58098a10 0x7fce580b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5fc00640 1 --2- 172.21.15.55:0/2476414535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce5806b920 0x7fce58158d30 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:30:42.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.574+0000 7fce5fc00640 1 -- 172.21.15.55:0/2476414535 >> 172.21.15.55:0/2476414535 conn(0x7fce580b2150 msgr2=0x7fce580cc080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:30:42.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.578+0000 7fce5fc00640 1 -- 172.21.15.55:0/2476414535 shutdown_connections 2024-04-02T07:30:42.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:30:42.578+0000 7fce5fc00640 1 -- 172.21.15.55:0/2476414535 wait complete. 2024-04-02T07:30:42.596 INFO:tasks.cephfs.filesystem:scrub status for tag:ea279c27-6e03-4c00-98a8-3f65ec862bea - {'path': '/dir', 'tag': 'ea279c27-6e03-4c00-98a8-3f65ec862bea', 'options': 'recursive,repair'} 2024-04-02T07:30:44.980 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:30:44.985 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:31:12.597 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:12.598 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.6:0 scrub status 2024-04-02T07:31:12.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.749+0000 7f1954200640 1 Processor -- start 2024-04-02T07:31:12.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.749+0000 7f1954200640 1 -- start start 2024-04-02T07:31:12.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.749+0000 7f1954200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f194c0b29e0 0x7f194c071450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.749+0000 7f1954200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f194c070e20 0x7f194c06cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.749+0000 7f1954200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f194c071990 con 0x7f194c0b2dc0 2024-04-02T07:31:12.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.749+0000 7f1954200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194c15df80 con 0x7f194c0b29e0 2024-04-02T07:31:12.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.749+0000 7f1954200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f194c15d400 con 0x7f194c070e20 2024-04-02T07:31:12.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.749+0000 7f1951800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f194c0b29e0 0x7f194c071450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.749+0000 7f1950e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f194c0b2dc0 0x7f194c070710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47724/0 (socket says 172.21.15.55:47724) 2024-04-02T07:31:12.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.749+0000 7f1950e00640 1 -- 172.21.15.55:0/1674398921 learned_addr learned my addr 172.21.15.55:0/1674398921 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:12.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.749+0000 7f1952200640 1 --2- 172.21.15.55:0/1674398921 >> v2:172.21.15.106:3300/0 conn(0x7f194c070e20 0x7f194c06cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.749+0000 7f1951800640 1 -- 172.21.15.55:0/1674398921 >> v2:172.21.15.106:3300/0 conn(0x7f194c070e20 msgr2=0x7f194c06cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:12.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.749+0000 7f1951800640 1 --2- 172.21.15.55:0/1674398921 >> v2:172.21.15.106:3300/0 conn(0x7f194c070e20 0x7f194c06cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.749+0000 7f1951800640 1 -- 172.21.15.55:0/1674398921 >> v1:172.21.15.55:6789/0 conn(0x7f194c0b2dc0 legacy=0x7f194c070710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:12.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.749+0000 7f1951800640 1 -- 172.21.15.55:0/1674398921 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f194c15d6e0 con 0x7f194c0b29e0 2024-04-02T07:31:12.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.749+0000 7f1952200640 1 --2- 172.21.15.55:0/1674398921 >> v2:172.21.15.106:3300/0 conn(0x7f194c070e20 0x7f194c06cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:12.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.753+0000 7f1951800640 1 --2- 172.21.15.55:0/1674398921 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f194c0b29e0 0x7f194c071450 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f194c157640 tx=0x7f194001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee043a34f72f855 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:12.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.753+0000 7f194be00640 1 -- 172.21.15.55:0/1674398921 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19400ac620 con 0x7f194c0b29e0 2024-04-02T07:31:12.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.753+0000 7f194be00640 1 -- 172.21.15.55:0/1674398921 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19400ac780 con 0x7f194c0b29e0 2024-04-02T07:31:12.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.753+0000 7f194be00640 1 -- 172.21.15.55:0/1674398921 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19400acb10 con 0x7f194c0b29e0 2024-04-02T07:31:12.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.753+0000 7f1954200640 1 -- 172.21.15.55:0/1674398921 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f194c0b29e0 msgr2=0x7f194c071450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:12.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.753+0000 7f1954200640 1 --2- 172.21.15.55:0/1674398921 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f194c0b29e0 0x7f194c071450 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f194c157640 tx=0x7f194001c3c0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.753+0000 7f1954200640 1 -- 172.21.15.55:0/1674398921 shutdown_connections 2024-04-02T07:31:12.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.753+0000 7f1954200640 1 --2- 172.21.15.55:0/1674398921 >> v2:172.21.15.106:3300/0 conn(0x7f194c070e20 0x7f194c06cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.753+0000 7f1954200640 1 --2- 172.21.15.55:0/1674398921 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f194c0b29e0 0x7f194c071450 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.753+0000 7f1954200640 1 -- 172.21.15.55:0/1674398921 >> 172.21.15.55:0/1674398921 conn(0x7f194c0b06f0 msgr2=0x7f194c0b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:12.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.753+0000 7f1954200640 1 -- 172.21.15.55:0/1674398921 shutdown_connections 2024-04-02T07:31:12.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.753+0000 7f1954200640 1 -- 172.21.15.55:0/1674398921 wait complete. 2024-04-02T07:31:12.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1954200640 1 Processor -- start 2024-04-02T07:31:12.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1954200640 1 -- start start 2024-04-02T07:31:12.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1954200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f194c070e20 0x7f194c0ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1954200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f194c0b29e0 0x7f194c160340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1954200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f194c0b2dc0 0x7f194c160880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1954200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c1f8240 con 0x7f194c0b2dc0 2024-04-02T07:31:12.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1954200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f194c1f8490 con 0x7f194c0b29e0 2024-04-02T07:31:12.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1954200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f194c1f8770 con 0x7f194c070e20 2024-04-02T07:31:12.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1952200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f194c0b2dc0 0x7f194c160880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1952200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f194c0b2dc0 0x7f194c160880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48326/0 (socket says 172.21.15.55:48326) 2024-04-02T07:31:12.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1952200640 1 -- 172.21.15.55:0/17922164 learned_addr learned my addr 172.21.15.55:0/17922164 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:12.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1950e00640 1 --2- 172.21.15.55:0/17922164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f194c0b29e0 0x7f194c160340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1951800640 1 --2- 172.21.15.55:0/17922164 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f194c070e20 0x7f194c0ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1952200640 1 -- 172.21.15.55:0/17922164 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f194c070e20 msgr2=0x7f194c0ad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:12.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1952200640 1 --2- 172.21.15.55:0/17922164 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f194c070e20 0x7f194c0ad4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1952200640 1 -- 172.21.15.55:0/17922164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f194c0b29e0 msgr2=0x7f194c160340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:12.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1952200640 1 --2- 172.21.15.55:0/17922164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f194c0b29e0 0x7f194c160340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1952200640 1 -- 172.21.15.55:0/17922164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1940009420 con 0x7f194c0b2dc0 2024-04-02T07:31:12.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1951800640 1 --2- 172.21.15.55:0/17922164 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f194c070e20 0x7f194c0ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:12.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1950e00640 1 --2- 172.21.15.55:0/17922164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f194c0b29e0 0x7f194c160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:12.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1952200640 1 --2- 172.21.15.55:0/17922164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f194c0b2dc0 0x7f194c160880 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f194400cef0 tx=0x7f194400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:12.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1949600640 1 -- 172.21.15.55:0/17922164 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194400d840 con 0x7f194c0b2dc0 2024-04-02T07:31:12.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1949600640 1 -- 172.21.15.55:0/17922164 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194400d9c0 con 0x7f194c0b2dc0 2024-04-02T07:31:12.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1949600640 1 -- 172.21.15.55:0/17922164 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194400dd70 con 0x7f194c0b2dc0 2024-04-02T07:31:12.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1954200640 1 -- 172.21.15.55:0/17922164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f194c1f8a50 con 0x7f194c0b2dc0 2024-04-02T07:31:12.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.757+0000 7f1954200640 1 -- 172.21.15.55:0/17922164 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194c1f9010 con 0x7f194c0b2dc0 2024-04-02T07:31:12.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f1949600640 1 -- 172.21.15.55:0/17922164 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f194401e3b0 con 0x7f194c0b2dc0 2024-04-02T07:31:12.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f1949600640 1 --2- 172.21.15.55:0/17922164 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f192c066690 0x7f192c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f1949600640 1 -- 172.21.15.55:0/17922164 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f1944084d80 con 0x7f194c0b2dc0 2024-04-02T07:31:12.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f195774a000 1 Processor -- start 2024-04-02T07:31:12.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f195774a000 1 -- start start 2024-04-02T07:31:12.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f1951800640 1 --2- 172.21.15.55:0/17922164 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f192c066690 0x7f192c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f195774a000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 0x55650f320e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f195774a000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55650f321390 0x55650f2d44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f195774a000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f2d4a00 0x55650f2d4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f195774a000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55650f19f630 con 0x55650f320a70 2024-04-02T07:31:12.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f195774a000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55650f12cbd0 con 0x55650f321390 2024-04-02T07:31:12.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f195774a000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55650f12a1a0 con 0x55650f2d4a00 2024-04-02T07:31:12.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f1951800640 1 --2- 172.21.15.55:0/17922164 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f192c066690 0x7f192c068b50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f19400ae000 tx=0x7f1940008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:12.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f1951800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 0x55650f320e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f1951800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 0x55650f320e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48340/0 (socket says 172.21.15.55:48340) 2024-04-02T07:31:12.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f1951800640 1 -- 172.21.15.55:0/2060771636 learned_addr learned my addr 172.21.15.55:0/2060771636 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:12.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f1950e00640 1 --2- 172.21.15.55:0/2060771636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55650f321390 0x55650f2d44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f1952200640 1 --2- 172.21.15.55:0/2060771636 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f2d4a00 0x55650f2d4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f1951800640 1 -- 172.21.15.55:0/2060771636 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f2d4a00 msgr2=0x55650f2d4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:12.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f1951800640 1 --2- 172.21.15.55:0/2060771636 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f2d4a00 0x55650f2d4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f1951800640 1 -- 172.21.15.55:0/2060771636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55650f321390 msgr2=0x55650f2d44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:12.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f1951800640 1 --2- 172.21.15.55:0/2060771636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55650f321390 0x55650f2d44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f1951800640 1 -- 172.21.15.55:0/2060771636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55650ee21e20 con 0x55650f320a70 2024-04-02T07:31:12.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.761+0000 7f1952200640 1 --2- 172.21.15.55:0/2060771636 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f2d4a00 0x55650f2d4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:12.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f1951800640 1 --2- 172.21.15.55:0/2060771636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 0x55650f320e50 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f1940018fd0 tx=0x7f1940004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e708ea0c585b8a96 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:12.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f193e000640 1 -- 172.21.15.55:0/2060771636 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19400b6ae0 con 0x55650f320a70 2024-04-02T07:31:12.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f193e000640 1 -- 172.21.15.55:0/2060771636 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19400bd040 con 0x55650f320a70 2024-04-02T07:31:12.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f193e000640 1 -- 172.21.15.55:0/2060771636 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19400b6e80 con 0x55650f320a70 2024-04-02T07:31:12.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f195774a000 1 -- 172.21.15.55:0/2060771636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 msgr2=0x55650f320e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:12.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f195774a000 1 --2- 172.21.15.55:0/2060771636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 0x55650f320e50 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f1940018fd0 tx=0x7f1940004740 comp rx=0 tx=0).stop 2024-04-02T07:31:12.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f195774a000 1 -- 172.21.15.55:0/2060771636 shutdown_connections 2024-04-02T07:31:12.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f195774a000 1 --2- 172.21.15.55:0/2060771636 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f2d4a00 0x55650f2d4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f195774a000 1 --2- 172.21.15.55:0/2060771636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55650f321390 0x55650f2d44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f195774a000 1 --2- 172.21.15.55:0/2060771636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 0x55650f320e50 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f195774a000 1 -- 172.21.15.55:0/2060771636 >> 172.21.15.55:0/2060771636 conn(0x55650f0d5160 msgr2=0x55650f303820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:12.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f195774a000 1 -- 172.21.15.55:0/2060771636 shutdown_connections 2024-04-02T07:31:12.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f195774a000 1 -- 172.21.15.55:0/2060771636 wait complete. 2024-04-02T07:31:12.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f195774a000 1 -- start start 2024-04-02T07:31:12.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f195774a000 1 Processor -- start 2024-04-02T07:31:12.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f195774a000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55650f2d4a00 0x55650f2dd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f195774a000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 0x55650f304a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f195774a000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f321390 0x55650f304f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f195774a000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55650f125a90 con 0x55650f320a70 2024-04-02T07:31:12.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f195774a000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55650f0c4d40 con 0x55650f2d4a00 2024-04-02T07:31:12.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f195774a000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55650f0e2f30 con 0x55650f321390 2024-04-02T07:31:12.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f195774a000 10 client.0 _ll_register_callbacks cb 0x55650f187810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:31:12.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f1950e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 0x55650f304a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f1950e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 0x55650f304a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48344/0 (socket says 172.21.15.55:48344) 2024-04-02T07:31:12.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f1950e00640 1 -- 172.21.15.55:0/3393421131 learned_addr learned my addr 172.21.15.55:0/3393421131 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:12.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f1951800640 1 --2- 172.21.15.55:0/3393421131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55650f2d4a00 0x55650f2dd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f1952200640 1 --2- 172.21.15.55:0/3393421131 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f321390 0x55650f304f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f1950e00640 1 -- 172.21.15.55:0/3393421131 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f321390 msgr2=0x55650f304f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:12.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f1950e00640 1 --2- 172.21.15.55:0/3393421131 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f321390 0x55650f304f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f1950e00640 1 -- 172.21.15.55:0/3393421131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55650f2d4a00 msgr2=0x55650f2dd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:12.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f1950e00640 1 --2- 172.21.15.55:0/3393421131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55650f2d4a00 0x55650f2dd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f1950e00640 1 -- 172.21.15.55:0/3393421131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194c15d6e0 con 0x55650f320a70 2024-04-02T07:31:12.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f1950e00640 1 --2- 172.21.15.55:0/3393421131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 0x55650f304a50 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f1938000f70 tx=0x7f19380106d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ae3cd6f78263b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:12.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.765+0000 7f1932a00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:31:12.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f1932a00640 1 -- 172.21.15.55:0/3393421131 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1938005cf0 con 0x55650f320a70 2024-04-02T07:31:12.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f1932a00640 1 -- 172.21.15.55:0/3393421131 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f1938010e50 con 0x55650f320a70 2024-04-02T07:31:12.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 1 -- 172.21.15.55:0/3393421131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55650f1243e0 con 0x55650f320a70 2024-04-02T07:31:12.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f1932a00640 1 -- 172.21.15.55:0/3393421131 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1938005e50 con 0x55650f320a70 2024-04-02T07:31:12.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 10 client.8202 fetch_fsmap learned FSMap version 73 2024-04-02T07:31:12.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 1 -- 172.21.15.55:0/3393421131 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x55650f0eaaa0 con 0x55650f320a70 2024-04-02T07:31:12.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f1932a00640 1 -- 172.21.15.55:0/3393421131 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55650f1243e0 con 0x55650f320a70 2024-04-02T07:31:12.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f1932a00640 1 -- 172.21.15.55:0/3393421131 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 73) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f1938012040 con 0x55650f320a70 2024-04-02T07:31:12.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 10 client.8202 fetch_fsmap finished waiting for FSMap version 73 2024-04-02T07:31:12.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 10 client.8202 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-02T07:31:12.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 20 client.8202 populate_metadata read hostname 'smithi055' 2024-04-02T07:31:12.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 1 --2- 172.21.15.55:0/3393421131 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55650f3282d0 0x55650f3286b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 4 client.8202 mds_command: new command op to 8052 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:31:12.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 1 -- 172.21.15.55:0/3393421131 --> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55650f0f5d00 con 0x55650f3282d0 2024-04-02T07:31:12.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f1951800640 1 --2- 172.21.15.55:0/3393421131 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55650f3282d0 0x55650f3286b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f1951800640 1 --2- 172.21.15.55:0/3393421131 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55650f3282d0 0x55650f3286b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af49172a11fdf121 server_cookie=fc665bcad6933eb7 in_seq=0 out_seq=0 2024-04-02T07:31:12.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f1932a00640 10 client.8202 ms_handle_connect on v2:172.21.15.55:6832/2658455613 2024-04-02T07:31:12.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f1932a00640 1 -- 172.21.15.55:0/3393421131 <== mds.0 v2:172.21.15.55:6832/2658455613 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55650f0f5d00 con 0x55650f3282d0 2024-04-02T07:31:12.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f1932a00640 10 client.8202 handle_command_reply: tid=0 2024-04-02T07:31:12.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 1 client.8202 shutdown 2024-04-02T07:31:12.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 1 -- 172.21.15.55:0/3393421131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 msgr2=0x55650f304a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 1 --2- 172.21.15.55:0/3393421131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 0x55650f304a50 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f1938000f70 tx=0x7f19380106d0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 1 -- 172.21.15.55:0/3393421131 shutdown_connections 2024-04-02T07:31:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 1 --2- 172.21.15.55:0/3393421131 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55650f3282d0 0x55650f3286b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 1 --2- 172.21.15.55:0/3393421131 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f321390 0x55650f304f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 1 --2- 172.21.15.55:0/3393421131 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 0x55650f304a50 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f1932a00640 0 client.8202 ms_handle_reset on v2:172.21.15.55:6832/2658455613 2024-04-02T07:31:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 1 --2- 172.21.15.55:0/3393421131 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55650f2d4a00 0x55650f2dd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 1 -- 172.21.15.55:0/3393421131 >> 172.21.15.55:0/3393421131 conn(0x55650f0d5160 msgr2=0x55650f2d3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 1 -- 172.21.15.55:0/3393421131 shutdown_connections 2024-04-02T07:31:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 1 -- 172.21.15.55:0/3393421131 wait complete. 2024-04-02T07:31:12.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.769+0000 7f195774a000 20 client.8202 trim_cache size 0 max 16384 2024-04-02T07:31:12.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f195774a000 1 Processor -- start 2024-04-02T07:31:12.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f195774a000 1 -- start start 2024-04-02T07:31:12.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f195774a000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55650f0d5160 0x55650f2d3c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f195774a000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f2d4a00 0x55650f2d4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f195774a000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 0x55650f2d4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f195774a000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55650ede2aa0 con 0x55650f320a70 2024-04-02T07:31:12.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f195774a000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55650f129a90 con 0x55650f0d5160 2024-04-02T07:31:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f195774a000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55650f1285f0 con 0x55650f2d4a00 2024-04-02T07:31:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f1952200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 0x55650f2d4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f1952200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 0x55650f2d4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48360/0 (socket says 172.21.15.55:48360) 2024-04-02T07:31:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f1952200640 1 -- 172.21.15.55:0/1119866364 learned_addr learned my addr 172.21.15.55:0/1119866364 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f1951800640 1 --2- 172.21.15.55:0/1119866364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55650f0d5160 0x55650f2d3c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f1950e00640 1 --2- 172.21.15.55:0/1119866364 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f2d4a00 0x55650f2d4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f1952200640 1 -- 172.21.15.55:0/1119866364 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f2d4a00 msgr2=0x55650f2d4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f1952200640 1 --2- 172.21.15.55:0/1119866364 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f2d4a00 0x55650f2d4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f1952200640 1 -- 172.21.15.55:0/1119866364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55650f0d5160 msgr2=0x55650f2d3c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f1952200640 1 --2- 172.21.15.55:0/1119866364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55650f0d5160 0x55650f2d3c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f1952200640 1 -- 172.21.15.55:0/1119866364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55650f0d0df0 con 0x55650f320a70 2024-04-02T07:31:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f1950e00640 1 --2- 172.21.15.55:0/1119866364 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f2d4a00 0x55650f2d4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f1952200640 1 --2- 172.21.15.55:0/1119866364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 0x55650f2d4de0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f194400cec0 tx=0x7f1944055e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95520777238a721b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f193ea00640 1 -- 172.21.15.55:0/1119866364 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1944052410 con 0x55650f320a70 2024-04-02T07:31:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f193ea00640 1 -- 172.21.15.55:0/1119866364 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1944052570 con 0x55650f320a70 2024-04-02T07:31:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.785+0000 7f193ea00640 1 -- 172.21.15.55:0/1119866364 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19440553f0 con 0x55650f320a70 2024-04-02T07:31:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 1 -- 172.21.15.55:0/1119866364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 msgr2=0x55650f2d4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 1 --2- 172.21.15.55:0/1119866364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 0x55650f2d4de0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f194400cec0 tx=0x7f1944055e40 comp rx=0 tx=0).stop 2024-04-02T07:31:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 1 -- 172.21.15.55:0/1119866364 shutdown_connections 2024-04-02T07:31:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 1 --2- 172.21.15.55:0/1119866364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f320a70 0x55650f2d4de0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 1 --2- 172.21.15.55:0/1119866364 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f2d4a00 0x55650f2d4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 1 --2- 172.21.15.55:0/1119866364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55650f0d5160 0x55650f2d3c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 1 -- 172.21.15.55:0/1119866364 >> 172.21.15.55:0/1119866364 conn(0x55650f3203b0 msgr2=0x55650f2dc870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 1 -- 172.21.15.55:0/1119866364 shutdown_connections 2024-04-02T07:31:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 1 -- 172.21.15.55:0/1119866364 wait complete. 2024-04-02T07:31:12.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 1 -- start start 2024-04-02T07:31:12.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 1 Processor -- start 2024-04-02T07:31:12.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f0d5160 0x55650f364340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f2d4a00 0x55650f2d7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55650f320a70 0x55650f2d80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55650f121280 con 0x55650f2d4a00 2024-04-02T07:31:12.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55650f3377e0 con 0x55650f320a70 2024-04-02T07:31:12.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55650f0f1390 con 0x55650f0d5160 2024-04-02T07:31:12.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 10 client.0 _ll_register_callbacks cb 0x7f19400af070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:31:12.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f1950e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f2d4a00 0x55650f2d7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f1950e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f2d4a00 0x55650f2d7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48372/0 (socket says 172.21.15.55:48372) 2024-04-02T07:31:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f1950e00640 1 -- 172.21.15.55:0/2736731087 learned_addr learned my addr 172.21.15.55:0/2736731087 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f1951800640 1 --2- 172.21.15.55:0/2736731087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f0d5160 0x55650f364340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f1952200640 1 --2- 172.21.15.55:0/2736731087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55650f320a70 0x55650f2d80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f1950e00640 1 -- 172.21.15.55:0/2736731087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f0d5160 msgr2=0x55650f364340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f1950e00640 1 --2- 172.21.15.55:0/2736731087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f0d5160 0x55650f364340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f1950e00640 1 -- 172.21.15.55:0/2736731087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55650f320a70 msgr2=0x55650f2d80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f1950e00640 1 --2- 172.21.15.55:0/2736731087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55650f320a70 0x55650f2d80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f1950e00640 1 -- 172.21.15.55:0/2736731087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f194c1f9010 con 0x55650f2d4a00 2024-04-02T07:31:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f1950e00640 1 --2- 172.21.15.55:0/2736731087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f2d4a00 0x55650f2d7ba0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f1938007b10 tx=0x7f1938005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2113eed042f81d5a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f1932a00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:31:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f1932a00640 1 -- 172.21.15.55:0/2736731087 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1938001ae0 con 0x55650f2d4a00 2024-04-02T07:31:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f1932a00640 1 -- 172.21.15.55:0/2736731087 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f1938010e50 con 0x55650f2d4a00 2024-04-02T07:31:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 1 -- 172.21.15.55:0/2736731087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55650f337920 con 0x55650f2d4a00 2024-04-02T07:31:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f1932a00640 1 -- 172.21.15.55:0/2736731087 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19380071c0 con 0x55650f2d4a00 2024-04-02T07:31:12.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 10 client.8208 fetch_fsmap learned FSMap version 73 2024-04-02T07:31:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 1 -- 172.21.15.55:0/2736731087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x55650f0c4960 con 0x55650f2d4a00 2024-04-02T07:31:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f1932a00640 1 -- 172.21.15.55:0/2736731087 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55650f337920 con 0x55650f2d4a00 2024-04-02T07:31:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f1932a00640 1 -- 172.21.15.55:0/2736731087 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 73) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f1938012030 con 0x55650f2d4a00 2024-04-02T07:31:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 10 client.8208 fetch_fsmap finished waiting for FSMap version 73 2024-04-02T07:31:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 10 client.8208 resolve_mds: resolved 6:0 to role '6:0' aka daemon mds.a 2024-04-02T07:31:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.789+0000 7f195774a000 20 client.8208 populate_metadata read hostname 'smithi055' 2024-04-02T07:31:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f195774a000 1 --2- 172.21.15.55:0/2736731087 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55650f321390 0x55650f2d8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f195774a000 4 client.8208 mds_command: new command op to 8052 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-02T07:31:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f195774a000 1 -- 172.21.15.55:0/2736731087 --> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55650f0e2970 con 0x55650f321390 2024-04-02T07:31:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f1951800640 1 --2- 172.21.15.55:0/2736731087 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55650f321390 0x55650f2d8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f1951800640 1 --2- 172.21.15.55:0/2736731087 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55650f321390 0x55650f2d8620 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=284ca80860259898 server_cookie=52fd952fc0a60b9a in_seq=0 out_seq=0 2024-04-02T07:31:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f1932a00640 10 client.8208 ms_handle_connect on v2:172.21.15.55:6832/2658455613 2024-04-02T07:31:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f1932a00640 1 -- 172.21.15.55:0/2736731087 <== mds.0 v2:172.21.15.55:6832/2658455613 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55650f0e2970 con 0x55650f321390 2024-04-02T07:31:12.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f1932a00640 10 client.8208 handle_command_reply: tid=0 2024-04-02T07:31:12.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f195774a000 1 client.8208 shutdown 2024-04-02T07:31:12.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f195774a000 1 -- 172.21.15.55:0/2736731087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f2d4a00 msgr2=0x55650f2d7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:12.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f195774a000 1 --2- 172.21.15.55:0/2736731087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f2d4a00 0x55650f2d7ba0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f1938007b10 tx=0x7f1938005800 comp rx=0 tx=0).stop 2024-04-02T07:31:12.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f195774a000 1 -- 172.21.15.55:0/2736731087 shutdown_connections 2024-04-02T07:31:12.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f195774a000 1 --2- 172.21.15.55:0/2736731087 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x55650f321390 0x55650f2d8620 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f195774a000 1 --2- 172.21.15.55:0/2736731087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55650f320a70 0x55650f2d80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f195774a000 1 --2- 172.21.15.55:0/2736731087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55650f2d4a00 0x55650f2d7ba0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f195774a000 1 --2- 172.21.15.55:0/2736731087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55650f0d5160 0x55650f364340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f1932a00640 0 client.8208 ms_handle_reset on v2:172.21.15.55:6832/2658455613 2024-04-02T07:31:12.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f195774a000 1 -- 172.21.15.55:0/2736731087 >> 172.21.15.55:0/2736731087 conn(0x55650f3203b0 msgr2=0x55650f2d2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:12.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f195774a000 1 -- 172.21.15.55:0/2736731087 shutdown_connections 2024-04-02T07:31:12.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f195774a000 1 -- 172.21.15.55:0/2736731087 wait complete. 2024-04-02T07:31:12.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f195774a000 20 client.8208 trim_cache size 0 max 16384 2024-04-02T07:31:12.799 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:31:12.799 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-04-02T07:31:12.799 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-04-02T07:31:12.799 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:31:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f1954200640 1 -- 172.21.15.55:0/17922164 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f192c066690 msgr2=0x7f192c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f1954200640 1 --2- 172.21.15.55:0/17922164 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f192c066690 0x7f192c068b50 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f19400ae000 tx=0x7f1940008040 comp rx=0 tx=0).stop 2024-04-02T07:31:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f1954200640 1 -- 172.21.15.55:0/17922164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f194c0b2dc0 msgr2=0x7f194c160880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f1954200640 1 --2- 172.21.15.55:0/17922164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f194c0b2dc0 0x7f194c160880 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f194400cef0 tx=0x7f194400a710 comp rx=0 tx=0).stop 2024-04-02T07:31:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f1954200640 1 -- 172.21.15.55:0/17922164 shutdown_connections 2024-04-02T07:31:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f1954200640 1 --2- 172.21.15.55:0/17922164 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f194c0b2dc0 0x7f194c160880 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f1954200640 1 --2- 172.21.15.55:0/17922164 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f192c066690 0x7f192c068b50 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f1954200640 1 --2- 172.21.15.55:0/17922164 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f194c0b29e0 0x7f194c160340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f1954200640 1 --2- 172.21.15.55:0/17922164 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f194c070e20 0x7f194c0ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f1954200640 1 -- 172.21.15.55:0/17922164 >> 172.21.15.55:0/17922164 conn(0x7f194c0b06f0 msgr2=0x7f194c0b0ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:12.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f1954200640 1 -- 172.21.15.55:0/17922164 shutdown_connections 2024-04-02T07:31:12.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.793+0000 7f1954200640 1 -- 172.21.15.55:0/17922164 wait complete. 2024-04-02T07:31:12.814 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-02T07:31:12.814 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:31:12.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.953+0000 7fec0a000640 1 Processor -- start 2024-04-02T07:31:12.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.953+0000 7fec0a000640 1 -- start start 2024-04-02T07:31:12.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.953+0000 7fec0a000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fec04153ea0 0x7fec040c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.953+0000 7fec0a000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fec0415a070 0x7fec0413d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.953+0000 7fec0a000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0413d0c0 con 0x7fec04159be0 2024-04-02T07:31:12.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.953+0000 7fec0a000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0415a4f0 con 0x7fec04153ea0 2024-04-02T07:31:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.953+0000 7fec0a000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec0415a7d0 con 0x7fec0415a070 2024-04-02T07:31:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.953+0000 7fec03400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fec04153ea0 0x7fec040c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.953+0000 7fec03400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fec04153ea0 0x7fec040c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48384/0 (socket says 172.21.15.55:48384) 2024-04-02T07:31:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.953+0000 7fec03400640 1 -- 172.21.15.55:0/2627806432 learned_addr learned my addr 172.21.15.55:0/2627806432 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.953+0000 7fec03e00640 1 --2- 172.21.15.55:0/2627806432 >> v2:172.21.15.106:3300/0 conn(0x7fec0415a070 0x7fec0413d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.953+0000 7fec03400640 1 -- 172.21.15.55:0/2627806432 >> v2:172.21.15.106:3300/0 conn(0x7fec0415a070 msgr2=0x7fec0413d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.953+0000 7fec03400640 1 --2- 172.21.15.55:0/2627806432 >> v2:172.21.15.106:3300/0 conn(0x7fec0415a070 0x7fec0413d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.953+0000 7fec03400640 1 -- 172.21.15.55:0/2627806432 >> v1:172.21.15.106:6789/0 conn(0x7fec04159be0 legacy=0x7fec040b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:12.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.953+0000 7fec03400640 1 -- 172.21.15.55:0/2627806432 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0415aab0 con 0x7fec04153ea0 2024-04-02T07:31:12.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.957+0000 7fec03400640 1 --2- 172.21.15.55:0/2627806432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec04153ea0 0x7fec040c4120 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fec04143320 tx=0x7febf401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d40f6a7331a4fb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:12.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.957+0000 7fec02a00640 1 -- 172.21.15.55:0/2627806432 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf40a9400 con 0x7fec04153ea0 2024-04-02T07:31:12.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.957+0000 7fec02a00640 1 -- 172.21.15.55:0/2627806432 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf40a9560 con 0x7fec04153ea0 2024-04-02T07:31:12.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.957+0000 7fec02a00640 1 -- 172.21.15.55:0/2627806432 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf40a98f0 con 0x7fec04153ea0 2024-04-02T07:31:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.957+0000 7fec0a000640 1 -- 172.21.15.55:0/2627806432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec04153ea0 msgr2=0x7fec040c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.957+0000 7fec0a000640 1 --2- 172.21.15.55:0/2627806432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec04153ea0 0x7fec040c4120 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7fec04143320 tx=0x7febf401c520 comp rx=0 tx=0).stop 2024-04-02T07:31:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.957+0000 7fec0a000640 1 -- 172.21.15.55:0/2627806432 shutdown_connections 2024-04-02T07:31:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.957+0000 7fec0a000640 1 --2- 172.21.15.55:0/2627806432 >> v2:172.21.15.106:3300/0 conn(0x7fec0415a070 0x7fec0413d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.957+0000 7fec0a000640 1 --2- 172.21.15.55:0/2627806432 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec04153ea0 0x7fec040c4120 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.957+0000 7fec0a000640 1 -- 172.21.15.55:0/2627806432 >> 172.21.15.55:0/2627806432 conn(0x7fec04066080 msgr2=0x7fec04069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.957+0000 7fec0a000640 1 -- 172.21.15.55:0/2627806432 shutdown_connections 2024-04-02T07:31:12.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.957+0000 7fec0a000640 1 -- 172.21.15.55:0/2627806432 wait complete. 2024-04-02T07:31:12.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7fec0a000640 1 Processor -- start 2024-04-02T07:31:12.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7fec0a000640 1 -- start start 2024-04-02T07:31:12.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7fec0a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec04153ea0 0x7fec04138560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7fec0a000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec04159be0 0x7fec04152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7fec0a000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec0415a070 0x7fec040b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7fec0a000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0415c810 con 0x7fec04153ea0 2024-04-02T07:31:12.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7fec0a000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec0415cca0 con 0x7fec04159be0 2024-04-02T07:31:12.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7fec0a000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec0415bc00 con 0x7fec0415a070 2024-04-02T07:31:12.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7fec03400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec04153ea0 0x7fec04138560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7fec03400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec04153ea0 0x7fec04138560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48398/0 (socket says 172.21.15.55:48398) 2024-04-02T07:31:12.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7fec03400640 1 -- 172.21.15.55:0/2108361078 learned_addr learned my addr 172.21.15.55:0/2108361078 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:12.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7febfbe00640 1 --2- 172.21.15.55:0/2108361078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec04159be0 0x7fec04152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7fec03e00640 1 --2- 172.21.15.55:0/2108361078 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec0415a070 0x7fec040b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7fec03400640 1 -- 172.21.15.55:0/2108361078 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec0415a070 msgr2=0x7fec040b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:12.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7fec03400640 1 --2- 172.21.15.55:0/2108361078 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec0415a070 0x7fec040b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7fec03400640 1 -- 172.21.15.55:0/2108361078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec04159be0 msgr2=0x7fec04152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:12.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7fec03400640 1 --2- 172.21.15.55:0/2108361078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec04159be0 0x7fec04152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:12.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7fec03400640 1 -- 172.21.15.55:0/2108361078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf40094d0 con 0x7fec04153ea0 2024-04-02T07:31:12.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7fec03400640 1 --2- 172.21.15.55:0/2108361078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec04153ea0 0x7fec04138560 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7febf4019130 tx=0x7febf401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:12.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7febfb400640 1 -- 172.21.15.55:0/2108361078 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf40a9400 con 0x7fec04153ea0 2024-04-02T07:31:12.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7febfb400640 1 -- 172.21.15.55:0/2108361078 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf40bc650 con 0x7fec04153ea0 2024-04-02T07:31:12.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7febfb400640 1 -- 172.21.15.55:0/2108361078 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf40bc9c0 con 0x7fec04153ea0 2024-04-02T07:31:12.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7fec0a000640 1 -- 172.21.15.55:0/2108361078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec0415bee0 con 0x7fec04153ea0 2024-04-02T07:31:12.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.961+0000 7fec0a000640 1 -- 172.21.15.55:0/2108361078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec0415c4a0 con 0x7fec04153ea0 2024-04-02T07:31:12.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.965+0000 7fec0a000640 1 -- 172.21.15.55:0/2108361078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec04066c90 con 0x7fec04153ea0 2024-04-02T07:31:12.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.965+0000 7febfb400640 1 -- 172.21.15.55:0/2108361078 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7febf40bcb20 con 0x7fec04153ea0 2024-04-02T07:31:12.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.965+0000 7febfb400640 1 --2- 172.21.15.55:0/2108361078 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7febe0066690 0x7febe0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:12.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.965+0000 7febfb400640 1 -- 172.21.15.55:0/2108361078 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7febf411e490 con 0x7fec04153ea0 2024-04-02T07:31:12.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.965+0000 7febfbe00640 1 --2- 172.21.15.55:0/2108361078 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7febe0066690 0x7febe0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:12.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.965+0000 7febfbe00640 1 --2- 172.21.15.55:0/2108361078 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7febe0066690 0x7febe0068b50 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fec0406a470 tx=0x7febec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:12.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:12.969+0000 7febfb400640 1 -- 172.21.15.55:0/2108361078 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7febf40eb900 con 0x7fec04153ea0 2024-04-02T07:31:13.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.165+0000 7fec0a000640 1 -- 172.21.15.55:0/2108361078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec041535d0 con 0x7fec04153ea0 2024-04-02T07:31:13.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.165+0000 7febfb400640 1 -- 172.21.15.55:0/2108361078 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4743 (secure 0 0 0) 0x7febf40a6030 con 0x7fec04153ea0 2024-04-02T07:31:13.169 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:13.169 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2209852195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2209852195},{"type":"v1","addr":"172.21.15.55:6835","nonce":2209852195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1897181831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1897181831},{"type":"v1","addr":"172.21.15.106:6835","nonce":1897181831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1894364429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1894364429},{"type":"v1","addr":"172.21.15.106:6837","nonce":1894364429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:28:53.919977+0000","modified":"2024-04-02T07:30:38.894246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8052":{"gid":8052,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6834/2658455613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2658455613},{"type":"v1","addr":"172.21.15.55:6834","nonce":2658455613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-02T07:31:13.169 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 73 2024-04-02T07:31:13.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.169+0000 7fec0a000640 1 -- 172.21.15.55:0/2108361078 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7febe0066690 msgr2=0x7febe0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:13.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.169+0000 7fec0a000640 1 --2- 172.21.15.55:0/2108361078 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7febe0066690 0x7febe0068b50 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fec0406a470 tx=0x7febec009040 comp rx=0 tx=0).stop 2024-04-02T07:31:13.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.169+0000 7fec0a000640 1 -- 172.21.15.55:0/2108361078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec04153ea0 msgr2=0x7fec04138560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:13.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.169+0000 7fec0a000640 1 --2- 172.21.15.55:0/2108361078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec04153ea0 0x7fec04138560 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7febf4019130 tx=0x7febf401ad60 comp rx=0 tx=0).stop 2024-04-02T07:31:13.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.169+0000 7fec0a000640 1 -- 172.21.15.55:0/2108361078 shutdown_connections 2024-04-02T07:31:13.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.169+0000 7fec0a000640 1 --2- 172.21.15.55:0/2108361078 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec0415a070 0x7fec040b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.169+0000 7fec0a000640 1 --2- 172.21.15.55:0/2108361078 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7febe0066690 0x7febe0068b50 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.169+0000 7fec0a000640 1 --2- 172.21.15.55:0/2108361078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec04159be0 0x7fec04152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.169+0000 7fec0a000640 1 --2- 172.21.15.55:0/2108361078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec04153ea0 0x7fec04138560 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.169+0000 7fec0a000640 1 -- 172.21.15.55:0/2108361078 >> 172.21.15.55:0/2108361078 conn(0x7fec04066080 msgr2=0x7fec04136aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:13.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.169+0000 7fec0a000640 1 -- 172.21.15.55:0/2108361078 shutdown_connections 2024-04-02T07:31:13.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.169+0000 7fec0a000640 1 -- 172.21.15.55:0/2108361078 wait complete. 2024-04-02T07:31:13.190 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a damage ls --format=json-pretty 2024-04-02T07:31:13.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.329+0000 7f73a9000640 1 Processor -- start 2024-04-02T07:31:13.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.329+0000 7f73a9000640 1 -- start start 2024-04-02T07:31:13.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.333+0000 7f73a9000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73a4144260 0x7f73a40702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.333+0000 7f73a9000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f73a40b31a0 0x7f73a40b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.333+0000 7f73a9000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73a4070c90 con 0x7f73a40707e0 2024-04-02T07:31:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.333+0000 7f73a9000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a40b37c0 con 0x7f73a4144260 2024-04-02T07:31:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.333+0000 7f73a9000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73a40b3580 con 0x7f73a40b31a0 2024-04-02T07:31:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.333+0000 7f73a1e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73a4144260 0x7f73a40702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.333+0000 7f73a1e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73a4144260 0x7f73a40702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48408/0 (socket says 172.21.15.55:48408) 2024-04-02T07:31:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.333+0000 7f7399400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f73a40707e0 0x7f73a40b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47726/0 (socket says 172.21.15.55:47726) 2024-04-02T07:31:13.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.333+0000 7f73a1e00640 1 -- 172.21.15.55:0/2691427301 learned_addr learned my addr 172.21.15.55:0/2691427301 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:13.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.333+0000 7f73a2800640 1 --2- 172.21.15.55:0/2691427301 >> v2:172.21.15.106:3300/0 conn(0x7f73a40b31a0 0x7f73a40b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.333+0000 7f73a1e00640 1 -- 172.21.15.55:0/2691427301 >> v2:172.21.15.106:3300/0 conn(0x7f73a40b31a0 msgr2=0x7f73a40b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:13.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.333+0000 7f73a1e00640 1 --2- 172.21.15.55:0/2691427301 >> v2:172.21.15.106:3300/0 conn(0x7f73a40b31a0 0x7f73a40b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.333+0000 7f73a1e00640 1 -- 172.21.15.55:0/2691427301 >> v1:172.21.15.55:6789/0 conn(0x7f73a40707e0 legacy=0x7f73a40b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:13.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.333+0000 7f73a1e00640 1 -- 172.21.15.55:0/2691427301 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a415e3a0 con 0x7f73a4144260 2024-04-02T07:31:13.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.333+0000 7f73a1400640 1 -- 172.21.15.55:0/2691427301 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487923751 0 0) 0x7f73a4070c90 con 0x7f73a40707e0 2024-04-02T07:31:13.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a1e00640 1 --2- 172.21.15.55:0/2691427301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a4144260 0x7f73a40702a0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f73a406ac10 tx=0x7f739401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f6bab7c6e0e6fa server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:13.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a1400640 1 -- 172.21.15.55:0/2691427301 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73940a57a0 con 0x7f73a4144260 2024-04-02T07:31:13.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a1400640 1 -- 172.21.15.55:0/2691427301 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73940a5900 con 0x7f73a4144260 2024-04-02T07:31:13.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a1400640 1 -- 172.21.15.55:0/2691427301 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73940a5c90 con 0x7f73a4144260 2024-04-02T07:31:13.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a9000640 1 -- 172.21.15.55:0/2691427301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a4144260 msgr2=0x7f73a40702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:13.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a9000640 1 --2- 172.21.15.55:0/2691427301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a4144260 0x7f73a40702a0 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f73a406ac10 tx=0x7f739401c9f0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a9000640 1 -- 172.21.15.55:0/2691427301 shutdown_connections 2024-04-02T07:31:13.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a9000640 1 --2- 172.21.15.55:0/2691427301 >> v2:172.21.15.106:3300/0 conn(0x7f73a40b31a0 0x7f73a40b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a9000640 1 --2- 172.21.15.55:0/2691427301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a4144260 0x7f73a40702a0 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a9000640 1 -- 172.21.15.55:0/2691427301 >> 172.21.15.55:0/2691427301 conn(0x7f73a406a390 msgr2=0x7f73a40b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:13.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a9000640 1 -- 172.21.15.55:0/2691427301 shutdown_connections 2024-04-02T07:31:13.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a9000640 1 -- 172.21.15.55:0/2691427301 wait complete. 2024-04-02T07:31:13.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a9000640 1 Processor -- start 2024-04-02T07:31:13.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a9000640 1 -- start start 2024-04-02T07:31:13.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a9000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a40707e0 0x7f73a4153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a9000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f73a40b31a0 0x7f73a4155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a9000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73a4144260 0x7f73a413b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a9000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a4158160 con 0x7f73a40707e0 2024-04-02T07:31:13.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a9000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a41566b0 con 0x7f73a4144260 2024-04-02T07:31:13.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a9000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73a4155e10 con 0x7f73a40b31a0 2024-04-02T07:31:13.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a40707e0 0x7f73a4153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a40707e0 0x7f73a4153030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48414/0 (socket says 172.21.15.55:48414) 2024-04-02T07:31:13.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.337+0000 7f73a1e00640 1 -- 172.21.15.55:0/3061029704 learned_addr learned my addr 172.21.15.55:0/3061029704 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:13.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.341+0000 7f7399400640 1 --2- 172.21.15.55:0/3061029704 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f73a40b31a0 0x7f73a4155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.341+0000 7f73a2800640 1 --2- 172.21.15.55:0/3061029704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73a4144260 0x7f73a413b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.341+0000 7f73a1e00640 1 -- 172.21.15.55:0/3061029704 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f73a40b31a0 msgr2=0x7f73a4155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:13.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.341+0000 7f73a1e00640 1 --2- 172.21.15.55:0/3061029704 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f73a40b31a0 0x7f73a4155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.341+0000 7f73a1e00640 1 -- 172.21.15.55:0/3061029704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73a4144260 msgr2=0x7f73a413b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:13.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.341+0000 7f73a1e00640 1 --2- 172.21.15.55:0/3061029704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73a4144260 0x7f73a413b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.341+0000 7f73a1e00640 1 -- 172.21.15.55:0/3061029704 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7394009b30 con 0x7f73a40707e0 2024-04-02T07:31:13.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.341+0000 7f73a1e00640 1 --2- 172.21.15.55:0/3061029704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a40707e0 0x7f73a4153030 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f739401b0a0 tx=0x7f7394019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:13.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.341+0000 7f739aa00640 1 -- 172.21.15.55:0/3061029704 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73940b8670 con 0x7f73a40707e0 2024-04-02T07:31:13.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.341+0000 7f739aa00640 1 -- 172.21.15.55:0/3061029704 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73940b87d0 con 0x7f73a40707e0 2024-04-02T07:31:13.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.341+0000 7f739aa00640 1 -- 172.21.15.55:0/3061029704 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73940b8b40 con 0x7f73a40707e0 2024-04-02T07:31:13.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.341+0000 7f73a9000640 1 -- 172.21.15.55:0/3061029704 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a41560f0 con 0x7f73a40707e0 2024-04-02T07:31:13.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.341+0000 7f73a9000640 1 -- 172.21.15.55:0/3061029704 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a4153570 con 0x7f73a40707e0 2024-04-02T07:31:13.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.341+0000 7f739aa00640 1 -- 172.21.15.55:0/3061029704 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f73940b8ca0 con 0x7f73a40707e0 2024-04-02T07:31:13.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f739aa00640 1 --2- 172.21.15.55:0/3061029704 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7380066690 0x7f7380068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f739aa00640 1 -- 172.21.15.55:0/3061029704 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f739411f7f0 con 0x7f73a40707e0 2024-04-02T07:31:13.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73ac3ed000 1 Processor -- start 2024-04-02T07:31:13.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f7399400640 1 --2- 172.21.15.55:0/3061029704 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7380066690 0x7f7380068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73ac3ed000 1 -- start start 2024-04-02T07:31:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f7399400640 1 --2- 172.21.15.55:0/3061029704 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7380066690 0x7f7380068b50 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f73a4143340 tx=0x7f738c007b60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73ac3ed000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802edd0 0x5625e802f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73ac3ed000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625e802d080 0x5625e802d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73ac3ed000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5625e802d9a0 0x5625e8076aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73ac3ed000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e7ef1340 con 0x5625e802edd0 2024-04-02T07:31:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73ac3ed000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e7e7dcd0 con 0x5625e802d080 2024-04-02T07:31:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73ac3ed000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5625e7e7b2a0 con 0x5625e802d9a0 2024-04-02T07:31:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73a1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802edd0 0x5625e802f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73a1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802edd0 0x5625e802f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48416/0 (socket says 172.21.15.55:48416) 2024-04-02T07:31:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73a1e00640 1 -- 172.21.15.55:0/1029863818 learned_addr learned my addr 172.21.15.55:0/1029863818 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73a2800640 1 --2- 172.21.15.55:0/1029863818 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5625e802d9a0 0x5625e8076aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f7399400640 1 --2- 172.21.15.55:0/1029863818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625e802d080 0x5625e802d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73a1e00640 1 -- 172.21.15.55:0/1029863818 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5625e802d9a0 msgr2=0x5625e8076aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:13.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73a1e00640 1 --2- 172.21.15.55:0/1029863818 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5625e802d9a0 0x5625e8076aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73a1e00640 1 -- 172.21.15.55:0/1029863818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625e802d080 msgr2=0x5625e802d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:13.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73a1e00640 1 --2- 172.21.15.55:0/1029863818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625e802d080 0x5625e802d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73a1e00640 1 -- 172.21.15.55:0/1029863818 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625e7b694b0 con 0x5625e802edd0 2024-04-02T07:31:13.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73a1e00640 1 --2- 172.21.15.55:0/1029863818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802edd0 0x5625e802f1b0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f73940f8680 tx=0x7f7394009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c88f117e2f51e6a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:13.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f7392a00640 1 -- 172.21.15.55:0/1029863818 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73940eec10 con 0x5625e802edd0 2024-04-02T07:31:13.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f7392a00640 1 -- 172.21.15.55:0/1029863818 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73940ecf80 con 0x5625e802edd0 2024-04-02T07:31:13.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f7392a00640 1 -- 172.21.15.55:0/1029863818 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73940f0cd0 con 0x5625e802edd0 2024-04-02T07:31:13.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73ac3ed000 1 -- 172.21.15.55:0/1029863818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802edd0 msgr2=0x5625e802f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:13.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73ac3ed000 1 --2- 172.21.15.55:0/1029863818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802edd0 0x5625e802f1b0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f73940f8680 tx=0x7f7394009810 comp rx=0 tx=0).stop 2024-04-02T07:31:13.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73ac3ed000 1 -- 172.21.15.55:0/1029863818 shutdown_connections 2024-04-02T07:31:13.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73ac3ed000 1 --2- 172.21.15.55:0/1029863818 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5625e802d9a0 0x5625e8076aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73ac3ed000 1 --2- 172.21.15.55:0/1029863818 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625e802d080 0x5625e802d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73ac3ed000 1 --2- 172.21.15.55:0/1029863818 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802edd0 0x5625e802f1b0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73ac3ed000 1 -- 172.21.15.55:0/1029863818 >> 172.21.15.55:0/1029863818 conn(0x5625e8025160 msgr2=0x5625e8027550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:13.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73ac3ed000 1 -- 172.21.15.55:0/1029863818 shutdown_connections 2024-04-02T07:31:13.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.345+0000 7f73ac3ed000 1 -- 172.21.15.55:0/1029863818 wait complete. 2024-04-02T07:31:13.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73ac3ed000 1 -- start start 2024-04-02T07:31:13.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73ac3ed000 1 Processor -- start 2024-04-02T07:31:13.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73ac3ed000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625e802d080 0x5625e80796a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73ac3ed000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802d9a0 0x5625e8079be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73ac3ed000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5625e802edd0 0x5625e807a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73ac3ed000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e7e76b90 con 0x5625e802d9a0 2024-04-02T07:31:13.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73ac3ed000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e7e340a0 con 0x5625e802d080 2024-04-02T07:31:13.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73ac3ed000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5625e7e33d40 con 0x5625e802edd0 2024-04-02T07:31:13.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73ac3ed000 10 client.0 _ll_register_callbacks cb 0x5625e7f2bc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:31:13.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f7399400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802d9a0 0x5625e8079be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f7399400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802d9a0 0x5625e8079be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48424/0 (socket says 172.21.15.55:48424) 2024-04-02T07:31:13.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f7399400640 1 -- 172.21.15.55:0/4245373658 learned_addr learned my addr 172.21.15.55:0/4245373658 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:13.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73a1e00640 1 --2- 172.21.15.55:0/4245373658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625e802d080 0x5625e80796a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73a2800640 1 --2- 172.21.15.55:0/4245373658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5625e802edd0 0x5625e807a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f7399400640 1 -- 172.21.15.55:0/4245373658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5625e802edd0 msgr2=0x5625e807a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:13.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f7399400640 1 --2- 172.21.15.55:0/4245373658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5625e802edd0 0x5625e807a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f7399400640 1 -- 172.21.15.55:0/4245373658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625e802d080 msgr2=0x5625e80796a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:13.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f7399400640 1 --2- 172.21.15.55:0/4245373658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625e802d080 0x5625e80796a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f7399400640 1 -- 172.21.15.55:0/4245373658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a4153570 con 0x5625e802d9a0 2024-04-02T07:31:13.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73a2800640 1 --2- 172.21.15.55:0/4245373658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5625e802edd0 0x5625e807a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:13.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f7399400640 1 --2- 172.21.15.55:0/4245373658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802d9a0 0x5625e8079be0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f738c0011f0 tx=0x7f738c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe69834b08b36d6d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:13.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f7387400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:31:13.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f7387400640 1 -- 172.21.15.55:0/4245373658 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f738c001b90 con 0x5625e802d9a0 2024-04-02T07:31:13.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f7387400640 1 -- 172.21.15.55:0/4245373658 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f738c001cf0 con 0x5625e802d9a0 2024-04-02T07:31:13.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73ac3ed000 1 -- 172.21.15.55:0/4245373658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5625e7e46550 con 0x5625e802d9a0 2024-04-02T07:31:13.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f7387400640 1 -- 172.21.15.55:0/4245373658 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f738c022430 con 0x5625e802d9a0 2024-04-02T07:31:13.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73ac3ed000 10 client.8229 fetch_fsmap learned FSMap version 73 2024-04-02T07:31:13.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73ac3ed000 1 -- 172.21.15.55:0/4245373658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x5625e7e3bba0 con 0x5625e802d9a0 2024-04-02T07:31:13.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f7387400640 1 -- 172.21.15.55:0/4245373658 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5625e7e46550 con 0x5625e802d9a0 2024-04-02T07:31:13.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f7387400640 1 -- 172.21.15.55:0/4245373658 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 73) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f738c02d480 con 0x5625e802d9a0 2024-04-02T07:31:13.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73ac3ed000 10 client.8229 fetch_fsmap finished waiting for FSMap version 73 2024-04-02T07:31:13.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73ac3ed000 10 client.8229 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:31:13.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73ac3ed000 20 client.8229 populate_metadata read hostname 'smithi055' 2024-04-02T07:31:13.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73ac3ed000 1 --2- 172.21.15.55:0/4245373658 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x5625e807a9c0 0x5625e8087620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73ac3ed000 4 client.8229 mds_command: new command op to 8052 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:31:13.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73ac3ed000 1 -- 172.21.15.55:0/4245373658 --> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5625e7e73970 con 0x5625e807a9c0 2024-04-02T07:31:13.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.349+0000 7f73a1e00640 1 --2- 172.21.15.55:0/4245373658 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x5625e807a9c0 0x5625e8087620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.353+0000 7f73a1e00640 1 --2- 172.21.15.55:0/4245373658 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x5625e807a9c0 0x5625e8087620 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=edab45a7582a9ed8 server_cookie=48991bb1556ee53a in_seq=0 out_seq=0 2024-04-02T07:31:13.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.353+0000 7f7387400640 10 client.8229 ms_handle_connect on v2:172.21.15.55:6832/2658455613 2024-04-02T07:31:13.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.353+0000 7f7387400640 1 -- 172.21.15.55:0/4245373658 <== mds.0 v2:172.21.15.55:6832/2658455613 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5625e7e73970 con 0x5625e807a9c0 2024-04-02T07:31:13.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.353+0000 7f7387400640 10 client.8229 handle_command_reply: tid=0 2024-04-02T07:31:13.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.353+0000 7f73ac3ed000 1 client.8229 shutdown 2024-04-02T07:31:13.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.353+0000 7f73ac3ed000 1 -- 172.21.15.55:0/4245373658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802d9a0 msgr2=0x5625e8079be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:13.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.353+0000 7f73ac3ed000 1 --2- 172.21.15.55:0/4245373658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802d9a0 0x5625e8079be0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f738c0011f0 tx=0x7f738c011000 comp rx=0 tx=0).stop 2024-04-02T07:31:13.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.353+0000 7f73ac3ed000 1 -- 172.21.15.55:0/4245373658 shutdown_connections 2024-04-02T07:31:13.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.353+0000 7f73ac3ed000 1 --2- 172.21.15.55:0/4245373658 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x5625e807a9c0 0x5625e8087620 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.353+0000 7f73ac3ed000 1 --2- 172.21.15.55:0/4245373658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5625e802edd0 0x5625e807a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.353+0000 7f73ac3ed000 1 --2- 172.21.15.55:0/4245373658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802d9a0 0x5625e8079be0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.353+0000 7f7387400640 0 client.8229 ms_handle_reset on v2:172.21.15.55:6832/2658455613 2024-04-02T07:31:13.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.353+0000 7f73ac3ed000 1 --2- 172.21.15.55:0/4245373658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625e802d080 0x5625e80796a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.353+0000 7f73ac3ed000 1 -- 172.21.15.55:0/4245373658 >> 172.21.15.55:0/4245373658 conn(0x5625e8025160 msgr2=0x5625e802dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:13.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.353+0000 7f73ac3ed000 1 -- 172.21.15.55:0/4245373658 shutdown_connections 2024-04-02T07:31:13.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.353+0000 7f73ac3ed000 1 -- 172.21.15.55:0/4245373658 wait complete. 2024-04-02T07:31:13.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.353+0000 7f73ac3ed000 20 client.8229 trim_cache size 0 max 16384 2024-04-02T07:31:13.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73ac3ed000 1 Processor -- start 2024-04-02T07:31:13.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73ac3ed000 1 -- start start 2024-04-02T07:31:13.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73ac3ed000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802d080 0x5625e8034e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73ac3ed000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625e802d9a0 0x5625e8035390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73ac3ed000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5625e802edd0 0x5625e8085610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73ac3ed000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e7b33c40 con 0x5625e802d080 2024-04-02T07:31:13.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73ac3ed000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e7e72380 con 0x5625e802d9a0 2024-04-02T07:31:13.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73ac3ed000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5625e7f0de20 con 0x5625e802edd0 2024-04-02T07:31:13.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73a1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802d080 0x5625e8034e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73a1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802d080 0x5625e8034e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48430/0 (socket says 172.21.15.55:48430) 2024-04-02T07:31:13.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73a1e00640 1 -- 172.21.15.55:0/3439649578 learned_addr learned my addr 172.21.15.55:0/3439649578 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:13.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73a1e00640 1 -- 172.21.15.55:0/3439649578 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5625e802edd0 msgr2=0x5625e8085610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:13.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73a1e00640 1 --2- 172.21.15.55:0/3439649578 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5625e802edd0 0x5625e8085610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73a1e00640 1 -- 172.21.15.55:0/3439649578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625e802d9a0 msgr2=0x5625e8035390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:13.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73a1e00640 1 --2- 172.21.15.55:0/3439649578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625e802d9a0 0x5625e8035390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73a1e00640 1 -- 172.21.15.55:0/3439649578 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625e7e21ef0 con 0x5625e802d080 2024-04-02T07:31:13.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73a1e00640 1 --2- 172.21.15.55:0/3439649578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802d080 0x5625e8034e50 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f739401a620 tx=0x7f73940c3000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15946f3e31d57b5b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:13.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f7393400640 1 -- 172.21.15.55:0/3439649578 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7394108130 con 0x5625e802d080 2024-04-02T07:31:13.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f7393400640 1 -- 172.21.15.55:0/3439649578 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73940eec10 con 0x5625e802d080 2024-04-02T07:31:13.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f7393400640 1 -- 172.21.15.55:0/3439649578 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739411d7a0 con 0x5625e802d080 2024-04-02T07:31:13.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73ac3ed000 1 -- 172.21.15.55:0/3439649578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802d080 msgr2=0x5625e8034e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:13.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73ac3ed000 1 --2- 172.21.15.55:0/3439649578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802d080 0x5625e8034e50 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f739401a620 tx=0x7f73940c3000 comp rx=0 tx=0).stop 2024-04-02T07:31:13.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73ac3ed000 1 -- 172.21.15.55:0/3439649578 shutdown_connections 2024-04-02T07:31:13.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73ac3ed000 1 --2- 172.21.15.55:0/3439649578 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5625e802edd0 0x5625e8085610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73ac3ed000 1 --2- 172.21.15.55:0/3439649578 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625e802d9a0 0x5625e8035390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73ac3ed000 1 --2- 172.21.15.55:0/3439649578 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802d080 0x5625e8034e50 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73ac3ed000 1 -- 172.21.15.55:0/3439649578 >> 172.21.15.55:0/3439649578 conn(0x5625e8025160 msgr2=0x5625e8027de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:13.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73ac3ed000 1 -- 172.21.15.55:0/3439649578 shutdown_connections 2024-04-02T07:31:13.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.365+0000 7f73ac3ed000 1 -- 172.21.15.55:0/3439649578 wait complete. 2024-04-02T07:31:13.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73ac3ed000 1 -- start start 2024-04-02T07:31:13.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73ac3ed000 1 Processor -- start 2024-04-02T07:31:13.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73ac3ed000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5625e802d080 0x5625e80d4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73ac3ed000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625e802d9a0 0x5625e80d5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73ac3ed000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802edd0 0x5625e8087d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73ac3ed000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e7e1e9a0 con 0x5625e802edd0 2024-04-02T07:31:13.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73ac3ed000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e7e7ab90 con 0x5625e802d9a0 2024-04-02T07:31:13.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73ac3ed000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5625e807a2d0 con 0x5625e802d080 2024-04-02T07:31:13.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73ac3ed000 10 client.0 _ll_register_callbacks cb 0x5625e7f14870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:31:13.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73a2800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802edd0 0x5625e8087d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73a2800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802edd0 0x5625e8087d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48438/0 (socket says 172.21.15.55:48438) 2024-04-02T07:31:13.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73a2800640 1 -- 172.21.15.55:0/2815440259 learned_addr learned my addr 172.21.15.55:0/2815440259 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:13.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73a1e00640 1 --2- 172.21.15.55:0/2815440259 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5625e802d080 0x5625e80d4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f7399400640 1 --2- 172.21.15.55:0/2815440259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625e802d9a0 0x5625e80d5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73a2800640 1 -- 172.21.15.55:0/2815440259 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5625e802d080 msgr2=0x5625e80d4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:13.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73a2800640 1 --2- 172.21.15.55:0/2815440259 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5625e802d080 0x5625e80d4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73a2800640 1 -- 172.21.15.55:0/2815440259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625e802d9a0 msgr2=0x5625e80d5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:13.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73a2800640 1 --2- 172.21.15.55:0/2815440259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625e802d9a0 0x5625e80d5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73a2800640 1 -- 172.21.15.55:0/2815440259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5625e7b694b0 con 0x5625e802edd0 2024-04-02T07:31:13.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f7399400640 1 --2- 172.21.15.55:0/2815440259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625e802d9a0 0x5625e80d5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:13.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73a2800640 1 --2- 172.21.15.55:0/2815440259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802edd0 0x5625e8087d80 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f739c004710 tx=0x7f739c014830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2841f28262298dd1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:13.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f7387400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:31:13.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f7387400640 1 -- 172.21.15.55:0/2815440259 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f739c016640 con 0x5625e802edd0 2024-04-02T07:31:13.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f7387400640 1 -- 172.21.15.55:0/2815440259 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f739c0167a0 con 0x5625e802edd0 2024-04-02T07:31:13.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73ac3ed000 1 -- 172.21.15.55:0/2815440259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5625e7e26620 con 0x5625e802edd0 2024-04-02T07:31:13.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f7387400640 1 -- 172.21.15.55:0/2815440259 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7f739c016960 con 0x5625e802edd0 2024-04-02T07:31:13.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73ac3ed000 10 client.8235 fetch_fsmap learned FSMap version 73 2024-04-02T07:31:13.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73ac3ed000 1 -- 172.21.15.55:0/2815440259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=2+}) v3 -- 0x5625e7b72fc0 con 0x5625e802edd0 2024-04-02T07:31:13.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f7387400640 1 -- 172.21.15.55:0/2815440259 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5625e7e26620 con 0x5625e802edd0 2024-04-02T07:31:13.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f7387400640 1 -- 172.21.15.55:0/2815440259 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 73) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f739c016ac0 con 0x5625e802edd0 2024-04-02T07:31:13.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73ac3ed000 10 client.8235 fetch_fsmap finished waiting for FSMap version 73 2024-04-02T07:31:13.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73ac3ed000 10 client.8235 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:31:13.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73ac3ed000 20 client.8235 populate_metadata read hostname 'smithi055' 2024-04-02T07:31:13.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73ac3ed000 1 --2- 172.21.15.55:0/2815440259 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x5625e80882c0 0x5625e80886a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73ac3ed000 4 client.8235 mds_command: new command op to 8052 tid=0 multi_id=0 [{"prefix": "damage ls", "format": "json-pretty"}] 2024-04-02T07:31:13.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73ac3ed000 1 -- 172.21.15.55:0/2815440259 --> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] -- command(tid 0: {"prefix": "damage ls", "format": "json-pretty"}) v1 -- 0x5625e7e754e0 con 0x5625e80882c0 2024-04-02T07:31:13.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.369+0000 7f73a1e00640 1 --2- 172.21.15.55:0/2815440259 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x5625e80882c0 0x5625e80886a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f7387400640 10 client.8235 ms_handle_connect on v2:172.21.15.55:6832/2658455613 2024-04-02T07:31:13.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73a1e00640 1 --2- 172.21.15.55:0/2815440259 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x5625e80882c0 0x5625e80886a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86e62f6148caaaf4 server_cookie=cc34c06985b8fcf3 in_seq=0 out_seq=0 2024-04-02T07:31:13.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f7387400640 1 -- 172.21.15.55:0/2815440259 <== mds.0 v2:172.21.15.55:6832/2658455613 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5625e7e754e0 con 0x5625e80882c0 2024-04-02T07:31:13.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f7387400640 10 client.8235 handle_command_reply: tid=0 2024-04-02T07:31:13.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73ac3ed000 1 client.8235 shutdown 2024-04-02T07:31:13.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73ac3ed000 1 -- 172.21.15.55:0/2815440259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802edd0 msgr2=0x5625e8087d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:13.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73ac3ed000 1 --2- 172.21.15.55:0/2815440259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802edd0 0x5625e8087d80 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f739c004710 tx=0x7f739c014830 comp rx=0 tx=0).stop 2024-04-02T07:31:13.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73ac3ed000 1 -- 172.21.15.55:0/2815440259 shutdown_connections 2024-04-02T07:31:13.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73ac3ed000 1 --2- 172.21.15.55:0/2815440259 >> [v2:172.21.15.55:6832/2658455613,v1:172.21.15.55:6834/2658455613] conn(0x5625e80882c0 0x5625e80886a0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73ac3ed000 1 --2- 172.21.15.55:0/2815440259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5625e802edd0 0x5625e8087d80 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73ac3ed000 1 --2- 172.21.15.55:0/2815440259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5625e802d9a0 0x5625e80d5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73ac3ed000 1 --2- 172.21.15.55:0/2815440259 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5625e802d080 0x5625e80d4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73ac3ed000 1 -- 172.21.15.55:0/2815440259 >> 172.21.15.55:0/2815440259 conn(0x5625e8025160 msgr2=0x5625e80284e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:13.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f7387400640 0 client.8235 ms_handle_reset on v2:172.21.15.55:6832/2658455613 2024-04-02T07:31:13.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73ac3ed000 1 -- 172.21.15.55:0/2815440259 shutdown_connections 2024-04-02T07:31:13.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73ac3ed000 1 -- 172.21.15.55:0/2815440259 wait complete. 2024-04-02T07:31:13.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73ac3ed000 20 client.8235 trim_cache size 0 max 16384 2024-04-02T07:31:13.378 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:13.378 INFO:teuthology.orchestra.run.smithi055.stdout:[] 2024-04-02T07:31:13.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73a9000640 1 -- 172.21.15.55:0/3061029704 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7380066690 msgr2=0x7f7380068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:13.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73a9000640 1 --2- 172.21.15.55:0/3061029704 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7380066690 0x7f7380068b50 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f73a4143340 tx=0x7f738c007b60 comp rx=0 tx=0).stop 2024-04-02T07:31:13.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73a9000640 1 -- 172.21.15.55:0/3061029704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a40707e0 msgr2=0x7f73a4153030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:13.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73a9000640 1 --2- 172.21.15.55:0/3061029704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a40707e0 0x7f73a4153030 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f739401b0a0 tx=0x7f7394019790 comp rx=0 tx=0).stop 2024-04-02T07:31:13.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73a9000640 1 -- 172.21.15.55:0/3061029704 shutdown_connections 2024-04-02T07:31:13.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73a9000640 1 --2- 172.21.15.55:0/3061029704 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7380066690 0x7f7380068b50 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73a9000640 1 --2- 172.21.15.55:0/3061029704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73a4144260 0x7f73a413b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73a9000640 1 --2- 172.21.15.55:0/3061029704 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f73a40b31a0 0x7f73a4155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73a9000640 1 --2- 172.21.15.55:0/3061029704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73a40707e0 0x7f73a4153030 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73a9000640 1 -- 172.21.15.55:0/3061029704 >> 172.21.15.55:0/3061029704 conn(0x7f73a406a390 msgr2=0x7f73a4142c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:13.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73a9000640 1 -- 172.21.15.55:0/3061029704 shutdown_connections 2024-04-02T07:31:13.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.373+0000 7f73a9000640 1 -- 172.21.15.55:0/3061029704 wait complete. 2024-04-02T07:31:13.393 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-02T07:31:13.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.529+0000 7f3627e00640 1 Processor -- start 2024-04-02T07:31:13.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.529+0000 7f3627e00640 1 -- start start 2024-04-02T07:31:13.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.533+0000 7f3627e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3620099120 0x7f36200b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.533+0000 7f3627e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f362006aff0 0x7f362006b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.533+0000 7f3627e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362015ce50 con 0x7f362015ca70 2024-04-02T07:31:13.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.533+0000 7f3627e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36200cef60 con 0x7f3620099120 2024-04-02T07:31:13.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.533+0000 7f3627e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362006bd60 con 0x7f362006aff0 2024-04-02T07:31:13.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.533+0000 7f3624a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3620099120 0x7f36200b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.533+0000 7f3624a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3620099120 0x7f36200b0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:53164/0 (socket says 172.21.15.55:53164) 2024-04-02T07:31:13.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.533+0000 7f3625e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f362006aff0 0x7f362006b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.533+0000 7f3624a00640 1 -- 172.21.15.55:0/3548004973 learned_addr learned my addr 172.21.15.55:0/3548004973 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:13.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.533+0000 7f3625e00640 1 -- 172.21.15.55:0/3548004973 >> v2:172.21.15.106:3300/0 conn(0x7f3620099120 msgr2=0x7f36200b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:13.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.533+0000 7f3625e00640 1 --2- 172.21.15.55:0/3548004973 >> v2:172.21.15.106:3300/0 conn(0x7f3620099120 0x7f36200b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.533+0000 7f3625e00640 1 -- 172.21.15.55:0/3548004973 >> v1:172.21.15.106:6789/0 conn(0x7f362015ca70 legacy=0x7f3620098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:13.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.533+0000 7f3625e00640 1 -- 172.21.15.55:0/3548004973 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362006c040 con 0x7f362006aff0 2024-04-02T07:31:13.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.533+0000 7f3624a00640 1 --2- 172.21.15.55:0/3548004973 >> v2:172.21.15.106:3300/0 conn(0x7f3620099120 0x7f36200b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:31:13.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.537+0000 7f3625e00640 1 --2- 172.21.15.55:0/3548004973 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f362006aff0 0x7f362006b480 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3618009d90 tx=0x7f361801c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=245572f73a8848f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:13.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.537+0000 7f361fe00640 1 -- 172.21.15.55:0/3548004973 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36180a5a20 con 0x7f362006aff0 2024-04-02T07:31:13.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.537+0000 7f361fe00640 1 -- 172.21.15.55:0/3548004973 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36180a5b80 con 0x7f362006aff0 2024-04-02T07:31:13.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.537+0000 7f361fe00640 1 -- 172.21.15.55:0/3548004973 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36180ad440 con 0x7f362006aff0 2024-04-02T07:31:13.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.537+0000 7f3627e00640 1 -- 172.21.15.55:0/3548004973 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f362006aff0 msgr2=0x7f362006b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:13.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.537+0000 7f3627e00640 1 --2- 172.21.15.55:0/3548004973 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f362006aff0 0x7f362006b480 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3618009d90 tx=0x7f361801c940 comp rx=0 tx=0).stop 2024-04-02T07:31:13.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.537+0000 7f3627e00640 1 -- 172.21.15.55:0/3548004973 shutdown_connections 2024-04-02T07:31:13.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.537+0000 7f3627e00640 1 --2- 172.21.15.55:0/3548004973 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f362006aff0 0x7f362006b480 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.537+0000 7f3627e00640 1 --2- 172.21.15.55:0/3548004973 >> v2:172.21.15.106:3300/0 conn(0x7f3620099120 0x7f36200b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.537+0000 7f3627e00640 1 -- 172.21.15.55:0/3548004973 >> 172.21.15.55:0/3548004973 conn(0x7f36200b21d0 msgr2=0x7f36200b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:13.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.537+0000 7f3627e00640 1 -- 172.21.15.55:0/3548004973 shutdown_connections 2024-04-02T07:31:13.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.537+0000 7f3627e00640 1 -- 172.21.15.55:0/3548004973 wait complete. 2024-04-02T07:31:13.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.537+0000 7f3627e00640 1 Processor -- start 2024-04-02T07:31:13.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.537+0000 7f3627e00640 1 -- start start 2024-04-02T07:31:13.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.537+0000 7f3627e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f362006aff0 0x7f36200b5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.537+0000 7f3627e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3620099120 0x7f3620152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f3627e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f362015ca70 0x7f362006e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f3627e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36200cdc10 con 0x7f362006aff0 2024-04-02T07:31:13.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f3627e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36200cd650 con 0x7f3620099120 2024-04-02T07:31:13.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f3627e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36200cd930 con 0x7f362015ca70 2024-04-02T07:31:13.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f3625400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f362006aff0 0x7f36200b5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f3625400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f362006aff0 0x7f36200b5800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48448/0 (socket says 172.21.15.55:48448) 2024-04-02T07:31:13.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f3625400640 1 -- 172.21.15.55:0/1039399083 learned_addr learned my addr 172.21.15.55:0/1039399083 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:13.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f3624a00640 1 --2- 172.21.15.55:0/1039399083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3620099120 0x7f3620152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f3625e00640 1 --2- 172.21.15.55:0/1039399083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f362015ca70 0x7f362006e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f3625400640 1 -- 172.21.15.55:0/1039399083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f362015ca70 msgr2=0x7f362006e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:13.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f3625400640 1 --2- 172.21.15.55:0/1039399083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f362015ca70 0x7f362006e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f3625400640 1 -- 172.21.15.55:0/1039399083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3620099120 msgr2=0x7f3620152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:13.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f3625400640 1 --2- 172.21.15.55:0/1039399083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3620099120 0x7f3620152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f3625400640 1 -- 172.21.15.55:0/1039399083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f360c0094d0 con 0x7f362006aff0 2024-04-02T07:31:13.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f3624a00640 1 --2- 172.21.15.55:0/1039399083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3620099120 0x7f3620152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:13.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f3625e00640 1 --2- 172.21.15.55:0/1039399083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f362015ca70 0x7f362006e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:13.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f3625400640 1 --2- 172.21.15.55:0/1039399083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f362006aff0 0x7f36200b5800 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f361400c3c0 tx=0x7f361400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:13.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f361d600640 1 -- 172.21.15.55:0/1039399083 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36140052d0 con 0x7f362006aff0 2024-04-02T07:31:13.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f361d600640 1 -- 172.21.15.55:0/1039399083 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3614005430 con 0x7f362006aff0 2024-04-02T07:31:13.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f3627e00640 1 -- 172.21.15.55:0/1039399083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3618009a70 con 0x7f362006aff0 2024-04-02T07:31:13.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f361d600640 1 -- 172.21.15.55:0/1039399083 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3614003840 con 0x7f362006aff0 2024-04-02T07:31:13.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f3627e00640 1 -- 172.21.15.55:0/1039399083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3620159590 con 0x7f362006aff0 2024-04-02T07:31:13.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f3627e00640 1 -- 172.21.15.55:0/1039399083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3620066c90 con 0x7f362006aff0 2024-04-02T07:31:13.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.541+0000 7f361d600640 1 -- 172.21.15.55:0/1039399083 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f36140039a0 con 0x7f362006aff0 2024-04-02T07:31:13.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.545+0000 7f361d600640 1 --2- 172.21.15.55:0/1039399083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3600066690 0x7f3600068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:13.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.545+0000 7f361d600640 1 -- 172.21.15.55:0/1039399083 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f36140837b0 con 0x7f362006aff0 2024-04-02T07:31:13.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.545+0000 7f3624a00640 1 --2- 172.21.15.55:0/1039399083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3600066690 0x7f3600068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:13.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.545+0000 7f3624a00640 1 --2- 172.21.15.55:0/1039399083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3600066690 0x7f3600068b50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f360c009c60 tx=0x7f360c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:13.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.549+0000 7f361d600640 1 -- 172.21.15.55:0/1039399083 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3614050a40 con 0x7f362006aff0 2024-04-02T07:31:13.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.741+0000 7f3627e00640 1 -- 172.21.15.55:0/1039399083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f36200b6660 con 0x7f362006aff0 2024-04-02T07:31:13.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.741+0000 7f361d600640 1 -- 172.21.15.55:0/1039399083 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f3614054060 con 0x7f362006aff0 2024-04-02T07:31:13.744 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:13.744 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-02T07:31:13.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.745+0000 7f3627e00640 1 -- 172.21.15.55:0/1039399083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3600066690 msgr2=0x7f3600068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:13.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.745+0000 7f3627e00640 1 --2- 172.21.15.55:0/1039399083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3600066690 0x7f3600068b50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f360c009c60 tx=0x7f360c008040 comp rx=0 tx=0).stop 2024-04-02T07:31:13.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.745+0000 7f3627e00640 1 -- 172.21.15.55:0/1039399083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f362006aff0 msgr2=0x7f36200b5800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:13.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.745+0000 7f3627e00640 1 --2- 172.21.15.55:0/1039399083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f362006aff0 0x7f36200b5800 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f361400c3c0 tx=0x7f361400c880 comp rx=0 tx=0).stop 2024-04-02T07:31:13.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.745+0000 7f3627e00640 1 -- 172.21.15.55:0/1039399083 shutdown_connections 2024-04-02T07:31:13.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.745+0000 7f3627e00640 1 --2- 172.21.15.55:0/1039399083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f362015ca70 0x7f362006e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.745+0000 7f3627e00640 1 --2- 172.21.15.55:0/1039399083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3600066690 0x7f3600068b50 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.745+0000 7f3627e00640 1 --2- 172.21.15.55:0/1039399083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3620099120 0x7f3620152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.745+0000 7f3627e00640 1 --2- 172.21.15.55:0/1039399083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f362006aff0 0x7f36200b5800 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:13.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.745+0000 7f3627e00640 1 -- 172.21.15.55:0/1039399083 >> 172.21.15.55:0/1039399083 conn(0x7f36200b21d0 msgr2=0x7f36200b0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:13.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.745+0000 7f3627e00640 1 -- 172.21.15.55:0/1039399083 shutdown_connections 2024-04-02T07:31:13.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:13.745+0000 7f3627e00640 1 -- 172.21.15.55:0/1039399083 wait complete. 2024-04-02T07:31:13.765 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-04-02T07:31:13.765 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-02T07:31:13.766 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:31:13.847 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:31:13.899 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-02T07:31:13.899 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:31:13.900 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:31:13.908 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:31:14.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.089+0000 7fa42f800640 1 Processor -- start 2024-04-02T07:31:14.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.089+0000 7fa42f800640 1 -- start start 2024-04-02T07:31:14.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.089+0000 7fa42f800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa428099120 0x7fa428099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:14.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.089+0000 7fa42f800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4280ad270 con 0x7fa42815f250 2024-04-02T07:31:14.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.089+0000 7fa42f800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4280b0a50 con 0x7fa42815ee70 2024-04-02T07:31:14.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.089+0000 7fa42f800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4280b0840 con 0x7fa428099120 2024-04-02T07:31:14.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.089+0000 7fa427e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa428099120 0x7fa428099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:14.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.089+0000 7fa427e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa428099120 0x7fa428099830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48462/0 (socket says 172.21.15.55:48462) 2024-04-02T07:31:14.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.089+0000 7fa427e00640 1 -- 172.21.15.55:0/3861298229 learned_addr learned my addr 172.21.15.55:0/3861298229 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:14.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.089+0000 7fa427e00640 1 -- 172.21.15.55:0/3861298229 >> v1:172.21.15.106:6789/0 conn(0x7fa42815ee70 legacy=0x7fa428098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:14.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.089+0000 7fa427e00640 1 -- 172.21.15.55:0/3861298229 >> v1:172.21.15.55:6789/0 conn(0x7fa42815f250 legacy=0x7fa4280ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:14.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.089+0000 7fa427e00640 1 -- 172.21.15.55:0/3861298229 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4280b0d30 con 0x7fa428099120 2024-04-02T07:31:14.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.093+0000 7fa427e00640 1 --2- 172.21.15.55:0/3861298229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa428099120 0x7fa428099830 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fa414009870 tx=0x7fa41401c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf8a6732910b966 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:14.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.093+0000 7fa427400640 1 -- 172.21.15.55:0/3861298229 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4140aa430 con 0x7fa428099120 2024-04-02T07:31:14.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.093+0000 7fa427400640 1 -- 172.21.15.55:0/3861298229 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4140aa590 con 0x7fa428099120 2024-04-02T07:31:14.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.093+0000 7fa427400640 1 -- 172.21.15.55:0/3861298229 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4140aa920 con 0x7fa428099120 2024-04-02T07:31:14.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.093+0000 7fa42f800640 1 -- 172.21.15.55:0/3861298229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa428099120 msgr2=0x7fa428099830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:14.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.093+0000 7fa42f800640 1 --2- 172.21.15.55:0/3861298229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa428099120 0x7fa428099830 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fa414009870 tx=0x7fa41401c4f0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.093+0000 7fa42f800640 1 -- 172.21.15.55:0/3861298229 shutdown_connections 2024-04-02T07:31:14.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.093+0000 7fa42f800640 1 --2- 172.21.15.55:0/3861298229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa428099120 0x7fa428099830 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.093+0000 7fa42f800640 1 -- 172.21.15.55:0/3861298229 >> 172.21.15.55:0/3861298229 conn(0x7fa4280b21d0 msgr2=0x7fa4280b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:14.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.093+0000 7fa42f800640 1 -- 172.21.15.55:0/3861298229 shutdown_connections 2024-04-02T07:31:14.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.093+0000 7fa42f800640 1 -- 172.21.15.55:0/3861298229 wait complete. 2024-04-02T07:31:14.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.093+0000 7fa42f800640 1 Processor -- start 2024-04-02T07:31:14.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.093+0000 7fa42f800640 1 -- start start 2024-04-02T07:31:14.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa42f800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa428099120 0x7fa428153ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:14.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa42f800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa42815ee70 0x7fa4280c4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:14.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa42f800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa42815f250 0x7fa4280c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:14.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa42f800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4280b45c0 con 0x7fa428099120 2024-04-02T07:31:14.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa42f800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa428154400 con 0x7fa42815f250 2024-04-02T07:31:14.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa42f800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4280c7000 con 0x7fa42815ee70 2024-04-02T07:31:14.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa42ce00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa428099120 0x7fa428153ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:14.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa42ce00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa428099120 0x7fa428153ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48466/0 (socket says 172.21.15.55:48466) 2024-04-02T07:31:14.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa42ce00640 1 -- 172.21.15.55:0/794168693 learned_addr learned my addr 172.21.15.55:0/794168693 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:14.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa427e00640 1 --2- 172.21.15.55:0/794168693 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa42815ee70 0x7fa4280c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:14.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa42d800640 1 --2- 172.21.15.55:0/794168693 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa42815f250 0x7fa4280c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:14.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa42ce00640 1 -- 172.21.15.55:0/794168693 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa42815ee70 msgr2=0x7fa4280c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:14.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa42ce00640 1 --2- 172.21.15.55:0/794168693 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa42815ee70 0x7fa4280c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa42ce00640 1 -- 172.21.15.55:0/794168693 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa42815f250 msgr2=0x7fa4280c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:14.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa42ce00640 1 --2- 172.21.15.55:0/794168693 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa42815f250 0x7fa4280c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa42ce00640 1 -- 172.21.15.55:0/794168693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4140094d0 con 0x7fa428099120 2024-04-02T07:31:14.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa42ce00640 1 --2- 172.21.15.55:0/794168693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa428099120 0x7fa428153ec0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00c450 tx=0x7fa41c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:14.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa424c00640 1 -- 172.21.15.55:0/794168693 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c012830 con 0x7fa428099120 2024-04-02T07:31:14.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa424c00640 1 -- 172.21.15.55:0/794168693 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa41c0129b0 con 0x7fa428099120 2024-04-02T07:31:14.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa424c00640 1 -- 172.21.15.55:0/794168693 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa41c012d60 con 0x7fa428099120 2024-04-02T07:31:14.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa42f800640 1 -- 172.21.15.55:0/794168693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4280b3c90 con 0x7fa428099120 2024-04-02T07:31:14.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa42f800640 1 -- 172.21.15.55:0/794168693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4280b4250 con 0x7fa428099120 2024-04-02T07:31:14.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa42f800640 1 -- 172.21.15.55:0/794168693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa428066c90 con 0x7fa428099120 2024-04-02T07:31:14.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.097+0000 7fa424c00640 1 -- 172.21.15.55:0/794168693 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa41c01c460 con 0x7fa428099120 2024-04-02T07:31:14.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.101+0000 7fa424c00640 1 --2- 172.21.15.55:0/794168693 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa408066690 0x7fa408068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:14.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.101+0000 7fa424c00640 1 -- 172.21.15.55:0/794168693 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fa41c084190 con 0x7fa428099120 2024-04-02T07:31:14.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.101+0000 7fa427e00640 1 --2- 172.21.15.55:0/794168693 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa408066690 0x7fa408068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:14.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.101+0000 7fa427e00640 1 --2- 172.21.15.55:0/794168693 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa408066690 0x7fa408068b50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa4140ae000 tx=0x7fa4140a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:14.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.105+0000 7fa424c00640 1 -- 172.21.15.55:0/794168693 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa41c051390 con 0x7fa428099120 2024-04-02T07:31:14.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.265+0000 7fa42f800640 1 -- 172.21.15.55:0/794168693 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa428099fc0 con 0x7fa428099120 2024-04-02T07:31:14.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.269+0000 7fa424c00640 1 -- 172.21.15.55:0/794168693 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16400 (secure 0 0 0) 0x7fa41c0549b0 con 0x7fa428099120 2024-04-02T07:31:14.269 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:14.269 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:30:34.869319+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:28:52.464907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-02T07:28:52.918058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.c","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6834/821922065":"2024-04-03T07:30:34.869296+0000","172.21.15.55:6832/821922065":"2024-04-03T07:30:34.869296+0000","172.21.15.106:6837/2582023800":"2024-04-03T07:29:14.039921+0000","172.21.15.106:6836/2582023800":"2024-04-03T07:29:14.039921+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:31:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.269+0000 7fa42f800640 1 -- 172.21.15.55:0/794168693 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa408066690 msgr2=0x7fa408068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.269+0000 7fa42f800640 1 --2- 172.21.15.55:0/794168693 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa408066690 0x7fa408068b50 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fa4140ae000 tx=0x7fa4140a7000 comp rx=0 tx=0).stop 2024-04-02T07:31:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.269+0000 7fa42f800640 1 -- 172.21.15.55:0/794168693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa428099120 msgr2=0x7fa428153ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.269+0000 7fa42f800640 1 --2- 172.21.15.55:0/794168693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa428099120 0x7fa428153ec0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fa41c00c450 tx=0x7fa41c00c910 comp rx=0 tx=0).stop 2024-04-02T07:31:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.269+0000 7fa42f800640 1 -- 172.21.15.55:0/794168693 shutdown_connections 2024-04-02T07:31:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.269+0000 7fa42f800640 1 --2- 172.21.15.55:0/794168693 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa408066690 0x7fa408068b50 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.269+0000 7fa42f800640 1 --2- 172.21.15.55:0/794168693 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa42815f250 0x7fa4280c4750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.269+0000 7fa42f800640 1 --2- 172.21.15.55:0/794168693 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa42815ee70 0x7fa4280c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.269+0000 7fa42f800640 1 --2- 172.21.15.55:0/794168693 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa428099120 0x7fa428153ec0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.269+0000 7fa42f800640 1 -- 172.21.15.55:0/794168693 >> 172.21.15.55:0/794168693 conn(0x7fa4280b21d0 msgr2=0x7fa428072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.269+0000 7fa42f800640 1 -- 172.21.15.55:0/794168693 shutdown_connections 2024-04-02T07:31:14.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.269+0000 7fa42f800640 1 -- 172.21.15.55:0/794168693 wait complete. 2024-04-02T07:31:14.290 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:28:52.464907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:28:52.918058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:31:14.290 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:31:14.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.433+0000 7faed4600640 1 Processor -- start 2024-04-02T07:31:14.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.433+0000 7faed4600640 1 -- start start 2024-04-02T07:31:14.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.433+0000 7faed4600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faecc144260 0x7faecc0702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:14.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.433+0000 7faed4600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faecc0b31a0 0x7faecc0b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:14.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.433+0000 7faed4600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faecc15e3a0 con 0x7faecc0707e0 2024-04-02T07:31:14.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.433+0000 7faed4600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faecc0b35d0 con 0x7faecc0b31a0 2024-04-02T07:31:14.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.433+0000 7faed4600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc0b37c0 con 0x7faecc144260 2024-04-02T07:31:14.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.433+0000 7faed1200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faecc0707e0 0x7faecc0b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47756/0 (socket says 172.21.15.55:47756) 2024-04-02T07:31:14.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.433+0000 7faed1200640 1 -- 172.21.15.55:0/2510657266 learned_addr learned my addr 172.21.15.55:0/2510657266 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:14.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.433+0000 7faed2600640 1 --2- 172.21.15.55:0/2510657266 >> v2:172.21.15.55:3300/0 conn(0x7faecc0b31a0 0x7faecc0b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:14.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.433+0000 7faed1c00640 1 --2- 172.21.15.55:0/2510657266 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faecc144260 0x7faecc0702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:14.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.433+0000 7faecbe00640 1 -- 172.21.15.55:0/2510657266 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2840792006 0 0) 0x7faecc15e3a0 con 0x7faecc0707e0 2024-04-02T07:31:14.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.433+0000 7faecbe00640 1 -- 172.21.15.55:0/2510657266 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faeb4003530 con 0x7faecc0707e0 2024-04-02T07:31:14.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.433+0000 7faed2600640 1 -- 172.21.15.55:0/2510657266 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faecc144260 msgr2=0x7faecc0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:14.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.433+0000 7faed2600640 1 --2- 172.21.15.55:0/2510657266 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faecc144260 0x7faecc0702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.433+0000 7faed2600640 1 -- 172.21.15.55:0/2510657266 >> v1:172.21.15.55:6789/0 conn(0x7faecc0707e0 legacy=0x7faecc0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:14.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.433+0000 7faed2600640 1 -- 172.21.15.55:0/2510657266 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc070c60 con 0x7faecc0b31a0 2024-04-02T07:31:14.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.437+0000 7faed2600640 1 --2- 172.21.15.55:0/2510657266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0b31a0 0x7faecc0b1670 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7faec4009d90 tx=0x7faec401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2adf8da5ca1b519d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:14.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.437+0000 7faecbe00640 1 -- 172.21.15.55:0/2510657266 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec40a5920 con 0x7faecc0b31a0 2024-04-02T07:31:14.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.437+0000 7faecbe00640 1 -- 172.21.15.55:0/2510657266 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec40a5a80 con 0x7faecc0b31a0 2024-04-02T07:31:14.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.437+0000 7faecbe00640 1 -- 172.21.15.55:0/2510657266 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec40a5e10 con 0x7faecc0b31a0 2024-04-02T07:31:14.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.437+0000 7faed4600640 1 -- 172.21.15.55:0/2510657266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0b31a0 msgr2=0x7faecc0b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:14.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.437+0000 7faed4600640 1 --2- 172.21.15.55:0/2510657266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0b31a0 0x7faecc0b1670 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7faec4009d90 tx=0x7faec401c970 comp rx=0 tx=0).stop 2024-04-02T07:31:14.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.437+0000 7faed4600640 1 -- 172.21.15.55:0/2510657266 shutdown_connections 2024-04-02T07:31:14.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.437+0000 7faed4600640 1 --2- 172.21.15.55:0/2510657266 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0b31a0 0x7faecc0b1670 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.437+0000 7faed4600640 1 --2- 172.21.15.55:0/2510657266 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faecc144260 0x7faecc0702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.437+0000 7faed4600640 1 -- 172.21.15.55:0/2510657266 >> 172.21.15.55:0/2510657266 conn(0x7faecc06a390 msgr2=0x7faecc0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:14.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.437+0000 7faed4600640 1 -- 172.21.15.55:0/2510657266 shutdown_connections 2024-04-02T07:31:14.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.437+0000 7faed4600640 1 -- 172.21.15.55:0/2510657266 wait complete. 2024-04-02T07:31:14.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faed4600640 1 Processor -- start 2024-04-02T07:31:14.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faed4600640 1 -- start start 2024-04-02T07:31:14.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faed4600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0707e0 0x7faecc134c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:14.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faed4600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faecc0b31a0 0x7faecc13a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:14.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faed4600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faecc144260 0x7faecc15d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:14.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faed4600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc139410 con 0x7faecc0707e0 2024-04-02T07:31:14.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faed4600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faecc1351a0 con 0x7faecc144260 2024-04-02T07:31:14.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faed4600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faecc1396b0 con 0x7faecc0b31a0 2024-04-02T07:31:14.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faed1c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0707e0 0x7faecc134c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:14.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faed1c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0707e0 0x7faecc134c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48486/0 (socket says 172.21.15.55:48486) 2024-04-02T07:31:14.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faed1c00640 1 -- 172.21.15.55:0/280064675 learned_addr learned my addr 172.21.15.55:0/280064675 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:14.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faed1c00640 1 -- 172.21.15.55:0/280064675 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faecc0b31a0 msgr2=0x7faecc13a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:14.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faed1c00640 1 --2- 172.21.15.55:0/280064675 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faecc0b31a0 0x7faecc13a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faed1c00640 1 -- 172.21.15.55:0/280064675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faecc144260 msgr2=0x7faecc15d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:14.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faed1c00640 1 --2- 172.21.15.55:0/280064675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faecc144260 0x7faecc15d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faed1c00640 1 -- 172.21.15.55:0/280064675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec4009a70 con 0x7faecc0707e0 2024-04-02T07:31:14.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faed1c00640 1 --2- 172.21.15.55:0/280064675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0707e0 0x7faecc134c60 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7faec000e870 tx=0x7faec000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:14.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faec9600640 1 -- 172.21.15.55:0/280064675 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec0009510 con 0x7faecc0707e0 2024-04-02T07:31:14.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faec9600640 1 -- 172.21.15.55:0/280064675 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faec000eec0 con 0x7faecc0707e0 2024-04-02T07:31:14.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faed4600640 1 -- 172.21.15.55:0/280064675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faecc139990 con 0x7faecc0707e0 2024-04-02T07:31:14.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faec9600640 1 -- 172.21.15.55:0/280064675 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faec000cb40 con 0x7faecc0707e0 2024-04-02T07:31:14.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faed4600640 1 -- 172.21.15.55:0/280064675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faecc139f50 con 0x7faecc0707e0 2024-04-02T07:31:14.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.441+0000 7faed4600640 1 -- 172.21.15.55:0/280064675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faecc073530 con 0x7faecc0707e0 2024-04-02T07:31:14.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.445+0000 7faec9600640 1 -- 172.21.15.55:0/280064675 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7faec000cca0 con 0x7faecc0707e0 2024-04-02T07:31:14.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.445+0000 7faec9600640 1 --2- 172.21.15.55:0/280064675 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faeac066690 0x7faeac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:14.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.445+0000 7faec9600640 1 -- 172.21.15.55:0/280064675 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7faec0084410 con 0x7faecc0707e0 2024-04-02T07:31:14.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.445+0000 7faed1200640 1 --2- 172.21.15.55:0/280064675 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faeac066690 0x7faeac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:14.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.445+0000 7faed1200640 1 --2- 172.21.15.55:0/280064675 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faeac066690 0x7faeac068b50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7faeb8007fd0 tx=0x7faeb8007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:14.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.449+0000 7faec9600640 1 -- 172.21.15.55:0/280064675 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7faec0051600 con 0x7faecc0707e0 2024-04-02T07:31:14.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.609+0000 7faed4600640 1 -- 172.21.15.55:0/280064675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faecc066c90 con 0x7faecc0707e0 2024-04-02T07:31:14.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.609+0000 7faec9600640 1 -- 172.21.15.55:0/280064675 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7faec0054c20 con 0x7faecc0707e0 2024-04-02T07:31:14.612 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:31:14.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.613+0000 7faed4600640 1 -- 172.21.15.55:0/280064675 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faeac066690 msgr2=0x7faeac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:14.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.613+0000 7faed4600640 1 --2- 172.21.15.55:0/280064675 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faeac066690 0x7faeac068b50 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7faeb8007fd0 tx=0x7faeb8007900 comp rx=0 tx=0).stop 2024-04-02T07:31:14.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.613+0000 7faed4600640 1 -- 172.21.15.55:0/280064675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0707e0 msgr2=0x7faecc134c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:14.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.613+0000 7faed4600640 1 --2- 172.21.15.55:0/280064675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0707e0 0x7faecc134c60 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7faec000e870 tx=0x7faec000ec70 comp rx=0 tx=0).stop 2024-04-02T07:31:14.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.613+0000 7faed4600640 1 -- 172.21.15.55:0/280064675 shutdown_connections 2024-04-02T07:31:14.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.613+0000 7faed4600640 1 --2- 172.21.15.55:0/280064675 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faeac066690 0x7faeac068b50 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.613+0000 7faed4600640 1 --2- 172.21.15.55:0/280064675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faecc144260 0x7faecc15d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.613+0000 7faed4600640 1 --2- 172.21.15.55:0/280064675 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faecc0b31a0 0x7faecc13a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.613+0000 7faed4600640 1 --2- 172.21.15.55:0/280064675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faecc0707e0 0x7faecc134c60 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.613+0000 7faed4600640 1 -- 172.21.15.55:0/280064675 >> 172.21.15.55:0/280064675 conn(0x7faecc06a390 msgr2=0x7faecc0b0350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:14.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.613+0000 7faed4600640 1 -- 172.21.15.55:0/280064675 shutdown_connections 2024-04-02T07:31:14.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.613+0000 7faed4600640 1 -- 172.21.15.55:0/280064675 wait complete. 2024-04-02T07:31:14.633 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:31:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.773+0000 7fbede400640 1 Processor -- start 2024-04-02T07:31:14.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.773+0000 7fbede400640 1 -- start start 2024-04-02T07:31:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.773+0000 7fbede400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbed80afc30 0x7fbed80cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.773+0000 7fbede400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed80ce2b0 con 0x7fbed8098a10 2024-04-02T07:31:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.773+0000 7fbede400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbed80ce590 con 0x7fbed8099750 2024-04-02T07:31:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.773+0000 7fbede400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed80ce870 con 0x7fbed80afc30 2024-04-02T07:31:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.777+0000 7fbed7400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbed8098a10 0x7fbed8098df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47772/0 (socket says 172.21.15.55:47772) 2024-04-02T07:31:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.777+0000 7fbed7400640 1 -- 172.21.15.55:0/241267013 learned_addr learned my addr 172.21.15.55:0/241267013 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:14.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.777+0000 7fbed7e00640 1 --2- 172.21.15.55:0/241267013 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbed80afc30 0x7fbed80cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:14.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.777+0000 7fbed6a00640 1 -- 172.21.15.55:0/241267013 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 876815971 0 0) 0x7fbed80ce2b0 con 0x7fbed8098a10 2024-04-02T07:31:14.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.777+0000 7fbed6a00640 1 -- 172.21.15.55:0/241267013 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbebc003530 con 0x7fbed8098a10 2024-04-02T07:31:14.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.777+0000 7fbed6a00640 1 -- 172.21.15.55:0/241267013 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1519523382 0 0) 0x7fbed80ce590 con 0x7fbed8099750 2024-04-02T07:31:14.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.777+0000 7fbed6a00640 1 -- 172.21.15.55:0/241267013 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbed80ce2b0 con 0x7fbed8099750 2024-04-02T07:31:14.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.777+0000 7fbed7e00640 1 -- 172.21.15.55:0/241267013 >> v1:172.21.15.106:6789/0 conn(0x7fbed8099750 legacy=0x7fbed80b0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:14.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.777+0000 7fbed7e00640 1 -- 172.21.15.55:0/241267013 >> v1:172.21.15.55:6789/0 conn(0x7fbed8098a10 legacy=0x7fbed8098df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:14.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.777+0000 7fbed7e00640 1 -- 172.21.15.55:0/241267013 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed80cb690 con 0x7fbed80afc30 2024-04-02T07:31:14.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.777+0000 7fbed7e00640 1 --2- 172.21.15.55:0/241267013 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbed80afc30 0x7fbed80cbbb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009dc0 tx=0x7fbed001c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c6f30943600152ed server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:14.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbed6a00640 1 -- 172.21.15.55:0/241267013 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed00a5a70 con 0x7fbed80afc30 2024-04-02T07:31:14.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbed6a00640 1 -- 172.21.15.55:0/241267013 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed00a5bd0 con 0x7fbed80afc30 2024-04-02T07:31:14.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbed6a00640 1 -- 172.21.15.55:0/241267013 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed00ad440 con 0x7fbed80afc30 2024-04-02T07:31:14.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbede400640 1 -- 172.21.15.55:0/241267013 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbed80afc30 msgr2=0x7fbed80cbbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:14.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbede400640 1 --2- 172.21.15.55:0/241267013 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbed80afc30 0x7fbed80cbbb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbed0009dc0 tx=0x7fbed001c990 comp rx=0 tx=0).stop 2024-04-02T07:31:14.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbede400640 1 -- 172.21.15.55:0/241267013 shutdown_connections 2024-04-02T07:31:14.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbede400640 1 --2- 172.21.15.55:0/241267013 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbed80afc30 0x7fbed80cbbb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbede400640 1 -- 172.21.15.55:0/241267013 >> 172.21.15.55:0/241267013 conn(0x7fbed80b21d0 msgr2=0x7fbed80b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:14.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbede400640 1 -- 172.21.15.55:0/241267013 shutdown_connections 2024-04-02T07:31:14.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbede400640 1 -- 172.21.15.55:0/241267013 wait complete. 2024-04-02T07:31:14.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbede400640 1 Processor -- start 2024-04-02T07:31:14.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbede400640 1 -- start start 2024-04-02T07:31:14.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbede400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbed8098a10 0x7fbed8156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:14.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbede400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbed8099750 0x7fbed80c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:14.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbede400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbed80afc30 0x7fbed806be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:14.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbede400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed81f5690 con 0x7fbed80afc30 2024-04-02T07:31:14.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbede400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbed81f5950 con 0x7fbed8098a10 2024-04-02T07:31:14.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbede400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbed81f5c30 con 0x7fbed8099750 2024-04-02T07:31:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbed7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbed80afc30 0x7fbed806be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbed7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbed80afc30 0x7fbed806be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48498/0 (socket says 172.21.15.55:48498) 2024-04-02T07:31:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbed7e00640 1 -- 172.21.15.55:0/1426288931 learned_addr learned my addr 172.21.15.55:0/1426288931 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbed7400640 1 --2- 172.21.15.55:0/1426288931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbed8098a10 0x7fbed8156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.781+0000 7fbecfe00640 1 --2- 172.21.15.55:0/1426288931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbed8099750 0x7fbed80c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.785+0000 7fbed7e00640 1 -- 172.21.15.55:0/1426288931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbed8099750 msgr2=0x7fbed80c6a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.785+0000 7fbed7e00640 1 --2- 172.21.15.55:0/1426288931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbed8099750 0x7fbed80c6a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.785+0000 7fbed7e00640 1 -- 172.21.15.55:0/1426288931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbed8098a10 msgr2=0x7fbed8156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.785+0000 7fbed7e00640 1 --2- 172.21.15.55:0/1426288931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbed8098a10 0x7fbed8156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.785+0000 7fbed7e00640 1 -- 172.21.15.55:0/1426288931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed0009a70 con 0x7fbed80afc30 2024-04-02T07:31:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.785+0000 7fbecfe00640 1 --2- 172.21.15.55:0/1426288931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbed8099750 0x7fbed80c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:14.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.785+0000 7fbed7e00640 1 --2- 172.21.15.55:0/1426288931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbed80afc30 0x7fbed806be70 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fbed00195a0 tx=0x7fbed0019730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.785+0000 7fbecf400640 1 -- 172.21.15.55:0/1426288931 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed0004240 con 0x7fbed80afc30 2024-04-02T07:31:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.785+0000 7fbecf400640 1 -- 172.21.15.55:0/1426288931 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed00043a0 con 0x7fbed80afc30 2024-04-02T07:31:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.785+0000 7fbecf400640 1 -- 172.21.15.55:0/1426288931 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed0004710 con 0x7fbed80afc30 2024-04-02T07:31:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.785+0000 7fbede400640 1 -- 172.21.15.55:0/1426288931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbed80b0330 con 0x7fbed80afc30 2024-04-02T07:31:14.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.785+0000 7fbede400640 1 -- 172.21.15.55:0/1426288931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbed81f61f0 con 0x7fbed80afc30 2024-04-02T07:31:14.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.785+0000 7fbede400640 1 -- 172.21.15.55:0/1426288931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbed8066c90 con 0x7fbed80afc30 2024-04-02T07:31:14.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.785+0000 7fbecf400640 1 -- 172.21.15.55:0/1426288931 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fbed00c3460 con 0x7fbed80afc30 2024-04-02T07:31:14.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.789+0000 7fbecf400640 1 --2- 172.21.15.55:0/1426288931 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbeb4066690 0x7fbeb4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:14.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.789+0000 7fbecf400640 1 -- 172.21.15.55:0/1426288931 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fbed011f3f0 con 0x7fbed80afc30 2024-04-02T07:31:14.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.789+0000 7fbed7400640 1 --2- 172.21.15.55:0/1426288931 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbeb4066690 0x7fbeb4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:14.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.789+0000 7fbed7400640 1 --2- 172.21.15.55:0/1426288931 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbeb4066690 0x7fbeb4068b50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbec8007fd0 tx=0x7fbec8007d80 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:14.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.793+0000 7fbecf400640 1 -- 172.21.15.55:0/1426288931 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fbed00ec5f0 con 0x7fbed80afc30 2024-04-02T07:31:14.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.953+0000 7fbede400640 1 -- 172.21.15.55:0/1426288931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbed80cc980 con 0x7fbed80afc30 2024-04-02T07:31:14.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.953+0000 7fbecf400640 1 -- 172.21.15.55:0/1426288931 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbed0004870 con 0x7fbed80afc30 2024-04-02T07:31:14.954 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:31:14.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.953+0000 7fbede400640 1 -- 172.21.15.55:0/1426288931 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbeb4066690 msgr2=0x7fbeb4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:14.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.953+0000 7fbede400640 1 --2- 172.21.15.55:0/1426288931 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbeb4066690 0x7fbeb4068b50 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fbec8007fd0 tx=0x7fbec8007d80 comp rx=0 tx=0).stop 2024-04-02T07:31:14.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.953+0000 7fbede400640 1 -- 172.21.15.55:0/1426288931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbed80afc30 msgr2=0x7fbed806be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:14.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.953+0000 7fbede400640 1 --2- 172.21.15.55:0/1426288931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbed80afc30 0x7fbed806be70 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fbed00195a0 tx=0x7fbed0019730 comp rx=0 tx=0).stop 2024-04-02T07:31:14.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.953+0000 7fbede400640 1 -- 172.21.15.55:0/1426288931 shutdown_connections 2024-04-02T07:31:14.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.953+0000 7fbede400640 1 --2- 172.21.15.55:0/1426288931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbed80afc30 0x7fbed806be70 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.953+0000 7fbede400640 1 --2- 172.21.15.55:0/1426288931 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbed8099750 0x7fbed80c6a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.953+0000 7fbede400640 1 --2- 172.21.15.55:0/1426288931 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbeb4066690 0x7fbeb4068b50 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.953+0000 7fbede400640 1 --2- 172.21.15.55:0/1426288931 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbed8098a10 0x7fbed8156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:14.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.953+0000 7fbede400640 1 -- 172.21.15.55:0/1426288931 >> 172.21.15.55:0/1426288931 conn(0x7fbed80b21d0 msgr2=0x7fbed80b0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:14.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.953+0000 7fbede400640 1 -- 172.21.15.55:0/1426288931 shutdown_connections 2024-04-02T07:31:14.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:14.953+0000 7fbede400640 1 -- 172.21.15.55:0/1426288931 wait complete. 2024-04-02T07:31:14.975 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:31:15.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.117+0000 7fb1f2c00640 1 Processor -- start 2024-04-02T07:31:15.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.117+0000 7fb1f2c00640 1 -- start start 2024-04-02T07:31:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.117+0000 7fb1f2c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb1ec15ca60 0x7fb1ec0cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.117+0000 7fb1f2c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ec098a10 0x7fb1ec098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.117+0000 7fb1f2c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1ec06b920 0x7fb1ec06bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.117+0000 7fb1f2c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ec0993b0 con 0x7fb1ec06b920 2024-04-02T07:31:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.117+0000 7fb1f2c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1ec15ce40 con 0x7fb1ec15ca60 2024-04-02T07:31:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.117+0000 7fb1f2c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec0d01b0 con 0x7fb1ec098a10 2024-04-02T07:31:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.117+0000 7fb1f0c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1ec06b920 0x7fb1ec06bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.117+0000 7fb1f0c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1ec06b920 0x7fb1ec06bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48500/0 (socket says 172.21.15.55:48500) 2024-04-02T07:31:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.117+0000 7fb1f0c00640 1 -- 172.21.15.55:0/3025268683 learned_addr learned my addr 172.21.15.55:0/3025268683 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.117+0000 7fb1ebe00640 1 --2- 172.21.15.55:0/3025268683 >> v2:172.21.15.106:3300/0 conn(0x7fb1ec15ca60 0x7fb1ec0cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:15.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.117+0000 7fb1e3e00640 1 --2- 172.21.15.55:0/3025268683 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ec098a10 0x7fb1ec098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:15.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.117+0000 7fb1f0c00640 1 -- 172.21.15.55:0/3025268683 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ec098a10 msgr2=0x7fb1ec098e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:15.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.117+0000 7fb1f0c00640 1 --2- 172.21.15.55:0/3025268683 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ec098a10 0x7fb1ec098e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.117+0000 7fb1f0c00640 1 -- 172.21.15.55:0/3025268683 >> v2:172.21.15.106:3300/0 conn(0x7fb1ec15ca60 msgr2=0x7fb1ec0cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:15.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.117+0000 7fb1f0c00640 1 --2- 172.21.15.55:0/3025268683 >> v2:172.21.15.106:3300/0 conn(0x7fb1ec15ca60 0x7fb1ec0cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.117+0000 7fb1f0c00640 1 -- 172.21.15.55:0/3025268683 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1ec0ceeb0 con 0x7fb1ec06b920 2024-04-02T07:31:15.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.121+0000 7fb1f0c00640 1 --2- 172.21.15.55:0/3025268683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ec06b920 0x7fb1ec06bd50 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec0d1760 tx=0x7fb1e401c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bbd2ddcf328090c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:15.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.121+0000 7fb1eb400640 1 -- 172.21.15.55:0/3025268683 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e40a57b0 con 0x7fb1ec06b920 2024-04-02T07:31:15.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.121+0000 7fb1eb400640 1 -- 172.21.15.55:0/3025268683 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1e40a5910 con 0x7fb1ec06b920 2024-04-02T07:31:15.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.121+0000 7fb1eb400640 1 -- 172.21.15.55:0/3025268683 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1e40a5ca0 con 0x7fb1ec06b920 2024-04-02T07:31:15.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.121+0000 7fb1f2c00640 1 -- 172.21.15.55:0/3025268683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ec06b920 msgr2=0x7fb1ec06bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:15.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.121+0000 7fb1f2c00640 1 --2- 172.21.15.55:0/3025268683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ec06b920 0x7fb1ec06bd50 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec0d1760 tx=0x7fb1e401c930 comp rx=0 tx=0).stop 2024-04-02T07:31:15.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.121+0000 7fb1f2c00640 1 -- 172.21.15.55:0/3025268683 shutdown_connections 2024-04-02T07:31:15.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.121+0000 7fb1f2c00640 1 --2- 172.21.15.55:0/3025268683 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ec06b920 0x7fb1ec06bd50 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.121+0000 7fb1f2c00640 1 --2- 172.21.15.55:0/3025268683 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ec098a10 0x7fb1ec098e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.121+0000 7fb1f2c00640 1 --2- 172.21.15.55:0/3025268683 >> v2:172.21.15.106:3300/0 conn(0x7fb1ec15ca60 0x7fb1ec0cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.121+0000 7fb1f2c00640 1 -- 172.21.15.55:0/3025268683 >> 172.21.15.55:0/3025268683 conn(0x7fb1ec0b2150 msgr2=0x7fb1ec0b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:15.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.121+0000 7fb1f2c00640 1 -- 172.21.15.55:0/3025268683 shutdown_connections 2024-04-02T07:31:15.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.121+0000 7fb1f2c00640 1 -- 172.21.15.55:0/3025268683 wait complete. 2024-04-02T07:31:15.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1f2c00640 1 Processor -- start 2024-04-02T07:31:15.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1f2c00640 1 -- start start 2024-04-02T07:31:15.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1f2c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ec06b920 0x7fb1ec153730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:15.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1f2c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ec098a10 0x7fb1ec0c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:15.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1f2c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1ec15ca60 0x7fb1ec152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:15.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1f2c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec157c90 con 0x7fb1ec06b920 2024-04-02T07:31:15.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1f2c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec0c52f0 con 0x7fb1ec15ca60 2024-04-02T07:31:15.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1f2c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1ec0c5010 con 0x7fb1ec098a10 2024-04-02T07:31:15.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1ebe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ec06b920 0x7fb1ec153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:15.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1ebe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ec06b920 0x7fb1ec153730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48506/0 (socket says 172.21.15.55:48506) 2024-04-02T07:31:15.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1ebe00640 1 -- 172.21.15.55:0/1311423192 learned_addr learned my addr 172.21.15.55:0/1311423192 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:15.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1f0c00640 1 --2- 172.21.15.55:0/1311423192 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1ec15ca60 0x7fb1ec152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:15.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1e3e00640 1 --2- 172.21.15.55:0/1311423192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ec098a10 0x7fb1ec0c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:15.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1ebe00640 1 -- 172.21.15.55:0/1311423192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ec098a10 msgr2=0x7fb1ec0c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:15.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1ebe00640 1 --2- 172.21.15.55:0/1311423192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ec098a10 0x7fb1ec0c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1ebe00640 1 -- 172.21.15.55:0/1311423192 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1ec15ca60 msgr2=0x7fb1ec152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:15.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1ebe00640 1 --2- 172.21.15.55:0/1311423192 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1ec15ca60 0x7fb1ec152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1ebe00640 1 -- 172.21.15.55:0/1311423192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e4009b30 con 0x7fb1ec06b920 2024-04-02T07:31:15.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1ebe00640 1 --2- 172.21.15.55:0/1311423192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ec06b920 0x7fb1ec153730 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00d800 tx=0x7fb1dc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:15.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1e8c00640 1 -- 172.21.15.55:0/1311423192 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc00b6c0 con 0x7fb1ec06b920 2024-04-02T07:31:15.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1e8c00640 1 -- 172.21.15.55:0/1311423192 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1dc00b820 con 0x7fb1ec06b920 2024-04-02T07:31:15.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1e8c00640 1 -- 172.21.15.55:0/1311423192 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc00bb90 con 0x7fb1ec06b920 2024-04-02T07:31:15.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1f2c00640 1 -- 172.21.15.55:0/1311423192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1ec1575d0 con 0x7fb1ec06b920 2024-04-02T07:31:15.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.125+0000 7fb1f2c00640 1 -- 172.21.15.55:0/1311423192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1ec153c70 con 0x7fb1ec06b920 2024-04-02T07:31:15.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.129+0000 7fb1f2c00640 1 -- 172.21.15.55:0/1311423192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1ec157f00 con 0x7fb1ec06b920 2024-04-02T07:31:15.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.129+0000 7fb1e8c00640 1 -- 172.21.15.55:0/1311423192 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb1dc00bcf0 con 0x7fb1ec06b920 2024-04-02T07:31:15.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.129+0000 7fb1e8c00640 1 --2- 172.21.15.55:0/1311423192 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb1c8066690 0x7fb1c8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:15.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.129+0000 7fb1e8c00640 1 -- 172.21.15.55:0/1311423192 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fb1dc084620 con 0x7fb1ec06b920 2024-04-02T07:31:15.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.129+0000 7fb1e3e00640 1 --2- 172.21.15.55:0/1311423192 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb1c8066690 0x7fb1c8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:15.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.129+0000 7fb1e3e00640 1 --2- 172.21.15.55:0/1311423192 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb1c8066690 0x7fb1c8068b50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec156390 tx=0x7fb1d4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:15.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.133+0000 7fb1e8c00640 1 -- 172.21.15.55:0/1311423192 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fb1dc051960 con 0x7fb1ec06b920 2024-04-02T07:31:15.288 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:31:15.291 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:31:15.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.293+0000 7fb1f2c00640 1 -- 172.21.15.55:0/1311423192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb1ec066c90 con 0x7fb1ec06b920 2024-04-02T07:31:15.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.293+0000 7fb1e8c00640 1 -- 172.21.15.55:0/1311423192 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb1dc054f80 con 0x7fb1ec06b920 2024-04-02T07:31:15.296 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:31:15.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.297+0000 7fb1f2c00640 1 -- 172.21.15.55:0/1311423192 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb1c8066690 msgr2=0x7fb1c8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:15.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.297+0000 7fb1f2c00640 1 --2- 172.21.15.55:0/1311423192 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb1c8066690 0x7fb1c8068b50 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec156390 tx=0x7fb1d4008040 comp rx=0 tx=0).stop 2024-04-02T07:31:15.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.297+0000 7fb1f2c00640 1 -- 172.21.15.55:0/1311423192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ec06b920 msgr2=0x7fb1ec153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:15.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.297+0000 7fb1f2c00640 1 --2- 172.21.15.55:0/1311423192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ec06b920 0x7fb1ec153730 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00d800 tx=0x7fb1dc00dcc0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.297+0000 7fb1f2c00640 1 -- 172.21.15.55:0/1311423192 shutdown_connections 2024-04-02T07:31:15.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.297+0000 7fb1f2c00640 1 --2- 172.21.15.55:0/1311423192 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb1c8066690 0x7fb1c8068b50 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.297+0000 7fb1f2c00640 1 --2- 172.21.15.55:0/1311423192 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb1ec15ca60 0x7fb1ec152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.297+0000 7fb1f2c00640 1 --2- 172.21.15.55:0/1311423192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb1ec098a10 0x7fb1ec0c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.297+0000 7fb1f2c00640 1 --2- 172.21.15.55:0/1311423192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1ec06b920 0x7fb1ec153730 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.297+0000 7fb1f2c00640 1 -- 172.21.15.55:0/1311423192 >> 172.21.15.55:0/1311423192 conn(0x7fb1ec0b2150 msgr2=0x7fb1ec0afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:15.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.297+0000 7fb1f2c00640 1 -- 172.21.15.55:0/1311423192 shutdown_connections 2024-04-02T07:31:15.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.297+0000 7fb1f2c00640 1 -- 172.21.15.55:0/1311423192 wait complete. 2024-04-02T07:31:15.321 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:31:15.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.529+0000 7f7372600640 1 Processor -- start 2024-04-02T07:31:15.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.529+0000 7f7372600640 1 -- start start 2024-04-02T07:31:15.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.533+0000 7f7372600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f736c1599c0 0x7f736c0b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:15.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.533+0000 7f7372600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736c0b1d60 con 0x7f736c0b38f0 2024-04-02T07:31:15.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.533+0000 7f7372600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f736c06c400 con 0x7f736c06d1c0 2024-04-02T07:31:15.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.533+0000 7f7372600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f736c06cda0 con 0x7f736c1599c0 2024-04-02T07:31:15.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.533+0000 7f736b400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f736c1599c0 0x7f736c0b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:15.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.533+0000 7f736be00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f736c0b38f0 0x7f736c0c90d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47784/0 (socket says 172.21.15.55:47784) 2024-04-02T07:31:15.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.533+0000 7f736be00640 1 -- 172.21.15.55:0/1458849516 learned_addr learned my addr 172.21.15.55:0/1458849516 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:15.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.533+0000 7f736b400640 1 -- 172.21.15.55:0/1458849516 >> v1:172.21.15.106:6789/0 conn(0x7f736c06d1c0 legacy=0x7f736c0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:15.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.533+0000 7f736b400640 1 -- 172.21.15.55:0/1458849516 >> v1:172.21.15.55:6789/0 conn(0x7f736c0b38f0 legacy=0x7f736c0c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:15.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.533+0000 7f736b400640 1 -- 172.21.15.55:0/1458849516 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f736c06c6e0 con 0x7f736c1599c0 2024-04-02T07:31:15.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.533+0000 7f736aa00640 1 -- 172.21.15.55:0/1458849516 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1341260883 0 0) 0x7f736c0b1d60 con 0x7f736c0b38f0 2024-04-02T07:31:15.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.533+0000 7f736b400640 1 --2- 172.21.15.55:0/1458849516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f736c1599c0 0x7f736c0b1780 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f735c0097c0 tx=0x7f735c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd2eadad1261d27e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:15.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f736aa00640 1 -- 172.21.15.55:0/1458849516 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c0ab600 con 0x7f736c1599c0 2024-04-02T07:31:15.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f736aa00640 1 -- 172.21.15.55:0/1458849516 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735c0a7050 con 0x7f736c1599c0 2024-04-02T07:31:15.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f736aa00640 1 -- 172.21.15.55:0/1458849516 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c0ab980 con 0x7f736c1599c0 2024-04-02T07:31:15.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f7372600640 1 -- 172.21.15.55:0/1458849516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f736c1599c0 msgr2=0x7f736c0b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:15.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f7372600640 1 --2- 172.21.15.55:0/1458849516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f736c1599c0 0x7f736c0b1780 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f735c0097c0 tx=0x7f735c01c460 comp rx=0 tx=0).stop 2024-04-02T07:31:15.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f7372600640 1 -- 172.21.15.55:0/1458849516 shutdown_connections 2024-04-02T07:31:15.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f7372600640 1 --2- 172.21.15.55:0/1458849516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f736c1599c0 0x7f736c0b1780 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f7372600640 1 -- 172.21.15.55:0/1458849516 >> 172.21.15.55:0/1458849516 conn(0x7f736c069d90 msgr2=0x7f736c06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:15.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f7372600640 1 -- 172.21.15.55:0/1458849516 shutdown_connections 2024-04-02T07:31:15.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f7372600640 1 -- 172.21.15.55:0/1458849516 wait complete. 2024-04-02T07:31:15.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f7372600640 1 Processor -- start 2024-04-02T07:31:15.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f7372600640 1 -- start start 2024-04-02T07:31:15.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f7372600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f736c06d1c0 0x7f736c14e810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:15.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f7372600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f736c0b38f0 0x7f736c168940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:15.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f7372600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f736c1599c0 0x7f736c151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:15.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f7372600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c167760 con 0x7f736c06d1c0 2024-04-02T07:31:15.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f7372600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f736c1685c0 con 0x7f736c1599c0 2024-04-02T07:31:15.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f7372600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f736c1679b0 con 0x7f736c0b38f0 2024-04-02T07:31:15.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f736b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f736c06d1c0 0x7f736c14e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:15.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f736b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f736c06d1c0 0x7f736c14e810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48522/0 (socket says 172.21.15.55:48522) 2024-04-02T07:31:15.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f736b400640 1 -- 172.21.15.55:0/32631142 learned_addr learned my addr 172.21.15.55:0/32631142 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:15.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f736b400640 1 -- 172.21.15.55:0/32631142 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f736c0b38f0 msgr2=0x7f736c168940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:15.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f736b400640 1 --2- 172.21.15.55:0/32631142 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f736c0b38f0 0x7f736c168940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f736b400640 1 -- 172.21.15.55:0/32631142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f736c1599c0 msgr2=0x7f736c151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:15.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f736b400640 1 --2- 172.21.15.55:0/32631142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f736c1599c0 0x7f736c151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.537+0000 7f736b400640 1 -- 172.21.15.55:0/32631142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f735c009420 con 0x7f736c06d1c0 2024-04-02T07:31:15.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.541+0000 7f736b400640 1 --2- 172.21.15.55:0/32631142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f736c06d1c0 0x7f736c14e810 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f735c0ae040 tx=0x7f735c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:15.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.541+0000 7f7363400640 1 -- 172.21.15.55:0/32631142 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c0b7650 con 0x7f736c06d1c0 2024-04-02T07:31:15.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.541+0000 7f7363400640 1 -- 172.21.15.55:0/32631142 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f735c0b77b0 con 0x7f736c06d1c0 2024-04-02T07:31:15.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.541+0000 7f7372600640 1 -- 172.21.15.55:0/32631142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f736c167c90 con 0x7f736c06d1c0 2024-04-02T07:31:15.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.541+0000 7f7363400640 1 -- 172.21.15.55:0/32631142 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f735c0b7b60 con 0x7f736c06d1c0 2024-04-02T07:31:15.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.541+0000 7f7372600640 1 -- 172.21.15.55:0/32631142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f736c168250 con 0x7f736c06d1c0 2024-04-02T07:31:15.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.541+0000 7f7372600640 1 -- 172.21.15.55:0/32631142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f736c06e270 con 0x7f736c06d1c0 2024-04-02T07:31:15.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.541+0000 7f7363400640 1 -- 172.21.15.55:0/32631142 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f735c0b7cc0 con 0x7f736c06d1c0 2024-04-02T07:31:15.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.541+0000 7f7363400640 1 --2- 172.21.15.55:0/32631142 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7348066690 0x7f7348068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:15.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.541+0000 7f7363400640 1 -- 172.21.15.55:0/32631142 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f735c11eaa0 con 0x7f736c06d1c0 2024-04-02T07:31:15.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.541+0000 7f7363e00640 1 --2- 172.21.15.55:0/32631142 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7348066690 0x7f7348068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:15.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.545+0000 7f7363e00640 1 --2- 172.21.15.55:0/32631142 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7348066690 0x7f7348068b50 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f736c152e80 tx=0x7f73540079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:15.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.545+0000 7f7363400640 1 -- 172.21.15.55:0/32631142 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f735c0ebd40 con 0x7f736c06d1c0 2024-04-02T07:31:15.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.721+0000 7f7372600640 1 -- 172.21.15.55:0/32631142 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f736c06e270 con 0x7f736c06d1c0 2024-04-02T07:31:15.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.721+0000 7f7363400640 1 -- 172.21.15.55:0/32631142 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v91) v1 ==== 80+0+244 (secure 0 0 0) 0x7f735c0b0020 con 0x7f736c06d1c0 2024-04-02T07:31:15.723 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6834/821922065 2024-04-03T07:30:34.869296+0000 2024-04-02T07:31:15.723 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6832/821922065 2024-04-03T07:30:34.869296+0000 2024-04-02T07:31:15.723 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.106:6837/2582023800 2024-04-03T07:29:14.039921+0000 2024-04-02T07:31:15.723 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.106:6836/2582023800 2024-04-03T07:29:14.039921+0000 2024-04-02T07:31:15.723 INFO:teuthology.orchestra.run.smithi055.stderr:listed 4 entries 2024-04-02T07:31:15.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.721+0000 7f7372600640 1 -- 172.21.15.55:0/32631142 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7348066690 msgr2=0x7f7348068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:15.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.721+0000 7f7372600640 1 --2- 172.21.15.55:0/32631142 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7348066690 0x7f7348068b50 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f736c152e80 tx=0x7f73540079c0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.721+0000 7f7372600640 1 -- 172.21.15.55:0/32631142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f736c06d1c0 msgr2=0x7f736c14e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:15.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.721+0000 7f7372600640 1 --2- 172.21.15.55:0/32631142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f736c06d1c0 0x7f736c14e810 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7f735c0ae040 tx=0x7f735c01aca0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.721+0000 7f7372600640 1 -- 172.21.15.55:0/32631142 shutdown_connections 2024-04-02T07:31:15.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.721+0000 7f7372600640 1 --2- 172.21.15.55:0/32631142 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7348066690 0x7f7348068b50 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.721+0000 7f7372600640 1 --2- 172.21.15.55:0/32631142 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f736c1599c0 0x7f736c151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.721+0000 7f7372600640 1 --2- 172.21.15.55:0/32631142 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f736c0b38f0 0x7f736c168940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.721+0000 7f7372600640 1 --2- 172.21.15.55:0/32631142 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f736c06d1c0 0x7f736c14e810 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:15.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.721+0000 7f7372600640 1 -- 172.21.15.55:0/32631142 >> 172.21.15.55:0/32631142 conn(0x7f736c069d90 msgr2=0x7f736c0c90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:15.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.721+0000 7f7372600640 1 -- 172.21.15.55:0/32631142 shutdown_connections 2024-04-02T07:31:15.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:15.721+0000 7f7372600640 1 -- 172.21.15.55:0/32631142 wait complete. 2024-04-02T07:31:15.743 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi055.front.sepia.ceph.com... 2024-04-02T07:31:15.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:15.744 DEBUG:teuthology.orchestra.run.smithi055:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-02T07:31:15.761 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[47806]: fuse finished with error 0 and tester_r 0 2024-04-02T07:31:15.763 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:31:15.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:15.764 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-02T07:31:15.837 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:31:15.837 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:31:15.847 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:31:15.847 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:31:15.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:15.847 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-02T07:31:15.896 INFO:teuthology.orchestra.run.smithi106.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-04-02T07:31:15.896 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:31:15.897 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:31:15.897 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:31:15.906 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:31:15.906 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:31:15.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:15.906 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-02T07:31:15.957 INFO:teuthology.orchestra.run.smithi055.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-04-02T07:31:15.957 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:31:15.958 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:31:15.958 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:31:15.967 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:31:15.967 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:31:15.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:15.967 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-02T07:31:16.016 INFO:teuthology.orchestra.run.smithi106.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-04-02T07:31:16.017 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:31:16.017 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:31:16.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.157+0000 7efd69c00640 1 Processor -- start 2024-04-02T07:31:16.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.157+0000 7efd69c00640 1 -- start start 2024-04-02T07:31:16.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.157+0000 7efd69c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd640c4120 0x7efd640b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.157+0000 7efd69c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efd640b36f0 0x7efd6413d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.157+0000 7efd69c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd6413d0c0 con 0x7efd64153ea0 2024-04-02T07:31:16.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.157+0000 7efd69c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd6415a2f0 con 0x7efd640c4120 2024-04-02T07:31:16.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.157+0000 7efd69c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd640b3b20 con 0x7efd640b36f0 2024-04-02T07:31:16.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.157+0000 7efd62000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd640c4120 0x7efd640b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.157+0000 7efd62000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd640c4120 0x7efd640b31b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52508/0 (socket says 172.21.15.55:52508) 2024-04-02T07:31:16.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.157+0000 7efd62000640 1 -- 172.21.15.55:0/467066448 learned_addr learned my addr 172.21.15.55:0/467066448 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:16.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.157+0000 7efd63400640 1 --2- 172.21.15.55:0/467066448 >> v2:172.21.15.106:3300/0 conn(0x7efd640b36f0 0x7efd6413d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.157+0000 7efd62000640 1 -- 172.21.15.55:0/467066448 >> v2:172.21.15.106:3300/0 conn(0x7efd640b36f0 msgr2=0x7efd6413d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:16.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.157+0000 7efd62000640 1 --2- 172.21.15.55:0/467066448 >> v2:172.21.15.106:3300/0 conn(0x7efd640b36f0 0x7efd6413d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.157+0000 7efd62000640 1 -- 172.21.15.55:0/467066448 >> v1:172.21.15.106:6789/0 conn(0x7efd64153ea0 legacy=0x7efd64159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:16.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.157+0000 7efd62000640 1 -- 172.21.15.55:0/467066448 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd6415a4f0 con 0x7efd640c4120 2024-04-02T07:31:16.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.161+0000 7efd62000640 1 --2- 172.21.15.55:0/467066448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd640c4120 0x7efd640b31b0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7efd64143320 tx=0x7efd5001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a265d71b12433e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:16.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.161+0000 7efd61600640 1 -- 172.21.15.55:0/467066448 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500a7070 con 0x7efd640c4120 2024-04-02T07:31:16.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.161+0000 7efd61600640 1 -- 172.21.15.55:0/467066448 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd500ab430 con 0x7efd640c4120 2024-04-02T07:31:16.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.161+0000 7efd61600640 1 -- 172.21.15.55:0/467066448 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500ab7c0 con 0x7efd640c4120 2024-04-02T07:31:16.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.161+0000 7efd69c00640 1 -- 172.21.15.55:0/467066448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd640c4120 msgr2=0x7efd640b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:16.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.161+0000 7efd69c00640 1 --2- 172.21.15.55:0/467066448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd640c4120 0x7efd640b31b0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7efd64143320 tx=0x7efd5001c520 comp rx=0 tx=0).stop 2024-04-02T07:31:16.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.161+0000 7efd69c00640 1 -- 172.21.15.55:0/467066448 shutdown_connections 2024-04-02T07:31:16.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.161+0000 7efd69c00640 1 --2- 172.21.15.55:0/467066448 >> v2:172.21.15.106:3300/0 conn(0x7efd640b36f0 0x7efd6413d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.161+0000 7efd69c00640 1 --2- 172.21.15.55:0/467066448 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd640c4120 0x7efd640b31b0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.161+0000 7efd69c00640 1 -- 172.21.15.55:0/467066448 >> 172.21.15.55:0/467066448 conn(0x7efd64066080 msgr2=0x7efd64069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:16.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.161+0000 7efd69c00640 1 -- 172.21.15.55:0/467066448 shutdown_connections 2024-04-02T07:31:16.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.161+0000 7efd69c00640 1 -- 172.21.15.55:0/467066448 wait complete. 2024-04-02T07:31:16.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd69c00640 1 Processor -- start 2024-04-02T07:31:16.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd69c00640 1 -- start start 2024-04-02T07:31:16.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd69c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd640b36f0 0x7efd6413a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd69c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd640c4120 0x7efd64070f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd69c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd64153ea0 0x7efd640cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd69c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6413a990 con 0x7efd640c4120 2024-04-02T07:31:16.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd69c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd6413ac70 con 0x7efd640b36f0 2024-04-02T07:31:16.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd69c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd6413af50 con 0x7efd64153ea0 2024-04-02T07:31:16.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd62000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd640c4120 0x7efd64070f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd62000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd640c4120 0x7efd64070f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52522/0 (socket says 172.21.15.55:52522) 2024-04-02T07:31:16.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd62000640 1 -- 172.21.15.55:0/224756812 learned_addr learned my addr 172.21.15.55:0/224756812 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:16.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd62a00640 1 --2- 172.21.15.55:0/224756812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd640b36f0 0x7efd6413a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd63400640 1 --2- 172.21.15.55:0/224756812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd64153ea0 0x7efd640cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd62000640 1 -- 172.21.15.55:0/224756812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd64153ea0 msgr2=0x7efd640cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:16.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd62000640 1 --2- 172.21.15.55:0/224756812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd64153ea0 0x7efd640cb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd62000640 1 -- 172.21.15.55:0/224756812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd640b36f0 msgr2=0x7efd6413a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:16.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd62000640 1 --2- 172.21.15.55:0/224756812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd640b36f0 0x7efd6413a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd62000640 1 -- 172.21.15.55:0/224756812 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd500094d0 con 0x7efd640c4120 2024-04-02T07:31:16.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd62000640 1 --2- 172.21.15.55:0/224756812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd640c4120 0x7efd64070f70 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7efd50019130 tx=0x7efd5001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:16.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd5aa00640 1 -- 172.21.15.55:0/224756812 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500b4800 con 0x7efd640c4120 2024-04-02T07:31:16.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd5aa00640 1 -- 172.21.15.55:0/224756812 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd500b4960 con 0x7efd640c4120 2024-04-02T07:31:16.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd69c00640 1 -- 172.21.15.55:0/224756812 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd640cb0f0 con 0x7efd640c4120 2024-04-02T07:31:16.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd5aa00640 1 -- 172.21.15.55:0/224756812 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd500b4cd0 con 0x7efd640c4120 2024-04-02T07:31:16.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd69c00640 1 -- 172.21.15.55:0/224756812 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6413a560 con 0x7efd640c4120 2024-04-02T07:31:16.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.165+0000 7efd69c00640 1 -- 172.21.15.55:0/224756812 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd64066c90 con 0x7efd640c4120 2024-04-02T07:31:16.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.169+0000 7efd5aa00640 1 -- 172.21.15.55:0/224756812 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7efd500b3380 con 0x7efd640c4120 2024-04-02T07:31:16.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.169+0000 7efd5aa00640 1 --2- 172.21.15.55:0/224756812 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efd44066690 0x7efd44068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.169+0000 7efd5aa00640 1 -- 172.21.15.55:0/224756812 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7efd5011e130 con 0x7efd640c4120 2024-04-02T07:31:16.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.169+0000 7efd62a00640 1 --2- 172.21.15.55:0/224756812 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efd44066690 0x7efd44068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.169+0000 7efd62a00640 1 --2- 172.21.15.55:0/224756812 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efd44066690 0x7efd44068b50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efd54007fd0 tx=0x7efd54009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:16.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.173+0000 7efd5aa00640 1 -- 172.21.15.55:0/224756812 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7efd500eb500 con 0x7efd640c4120 2024-04-02T07:31:16.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.369+0000 7efd69c00640 1 -- 172.21.15.55:0/224756812 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd640cb5a0 con 0x7efd640c4120 2024-04-02T07:31:16.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.369+0000 7efd5aa00640 1 -- 172.21.15.55:0/224756812 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4743 (secure 0 0 0) 0x7efd500f3e60 con 0x7efd640c4120 2024-04-02T07:31:16.373 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:16.373 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2209852195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2209852195},{"type":"v1","addr":"172.21.15.55:6835","nonce":2209852195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1897181831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1897181831},{"type":"v1","addr":"172.21.15.106:6835","nonce":1897181831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1894364429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1894364429},{"type":"v1","addr":"172.21.15.106:6837","nonce":1894364429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:28:53.919977+0000","modified":"2024-04-02T07:30:38.894246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8052":{"gid":8052,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6834/2658455613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2658455613},{"type":"v1","addr":"172.21.15.55:6834","nonce":2658455613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-02T07:31:16.374 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 73 2024-04-02T07:31:16.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.373+0000 7efd69c00640 1 -- 172.21.15.55:0/224756812 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efd44066690 msgr2=0x7efd44068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:16.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.373+0000 7efd69c00640 1 --2- 172.21.15.55:0/224756812 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efd44066690 0x7efd44068b50 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7efd54007fd0 tx=0x7efd54009040 comp rx=0 tx=0).stop 2024-04-02T07:31:16.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.373+0000 7efd69c00640 1 -- 172.21.15.55:0/224756812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd640c4120 msgr2=0x7efd64070f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:16.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.373+0000 7efd69c00640 1 --2- 172.21.15.55:0/224756812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd640c4120 0x7efd64070f70 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7efd50019130 tx=0x7efd5001ad60 comp rx=0 tx=0).stop 2024-04-02T07:31:16.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.373+0000 7efd69c00640 1 -- 172.21.15.55:0/224756812 shutdown_connections 2024-04-02T07:31:16.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.373+0000 7efd69c00640 1 --2- 172.21.15.55:0/224756812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd64153ea0 0x7efd640cb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.373+0000 7efd69c00640 1 --2- 172.21.15.55:0/224756812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd640c4120 0x7efd64070f70 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.373+0000 7efd69c00640 1 --2- 172.21.15.55:0/224756812 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efd44066690 0x7efd44068b50 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.373+0000 7efd69c00640 1 --2- 172.21.15.55:0/224756812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd640b36f0 0x7efd6413a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.373+0000 7efd69c00640 1 -- 172.21.15.55:0/224756812 >> 172.21.15.55:0/224756812 conn(0x7efd64066080 msgr2=0x7efd64138cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:16.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.373+0000 7efd69c00640 1 -- 172.21.15.55:0/224756812 shutdown_connections 2024-04-02T07:31:16.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.373+0000 7efd69c00640 1 -- 172.21.15.55:0/224756812 wait complete. 2024-04-02T07:31:16.394 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:31:16.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.533+0000 7f9605400640 1 Processor -- start 2024-04-02T07:31:16.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.533+0000 7f9605400640 1 -- start start 2024-04-02T07:31:16.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.537+0000 7f9605400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9600147a00 0x7f96000afc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.537+0000 7f9605400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f96000b01c0 0x7f96000b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.537+0000 7f9605400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96000ce340 con 0x7f9600146fa0 2024-04-02T07:31:16.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.537+0000 7f9605400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96000b0630 con 0x7f9600147a00 2024-04-02T07:31:16.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.537+0000 7f9605400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9600164be0 con 0x7f96000b01c0 2024-04-02T07:31:16.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.537+0000 7f95f7e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9600147a00 0x7f96000afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.537+0000 7f95f7e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9600147a00 0x7f96000afc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52532/0 (socket says 172.21.15.55:52532) 2024-04-02T07:31:16.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.537+0000 7f95fe800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9600146fa0 0x7f960014a290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34116/0 (socket says 172.21.15.55:34116) 2024-04-02T07:31:16.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.537+0000 7f95f7e00640 1 -- 172.21.15.55:0/3373007868 learned_addr learned my addr 172.21.15.55:0/3373007868 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:16.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.537+0000 7f95ff200640 1 --2- 172.21.15.55:0/3373007868 >> v2:172.21.15.106:3300/0 conn(0x7f96000b01c0 0x7f96000b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.537+0000 7f95f7e00640 1 -- 172.21.15.55:0/3373007868 >> v2:172.21.15.106:3300/0 conn(0x7f96000b01c0 msgr2=0x7f96000b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:16.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.537+0000 7f95f7e00640 1 --2- 172.21.15.55:0/3373007868 >> v2:172.21.15.106:3300/0 conn(0x7f96000b01c0 0x7f96000b19b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.537+0000 7f95f7e00640 1 -- 172.21.15.55:0/3373007868 >> v1:172.21.15.55:6789/0 conn(0x7f9600146fa0 legacy=0x7f960014a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:16.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.537+0000 7f95fde00640 1 -- 172.21.15.55:0/3373007868 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2473629230 0 0) 0x7f96000ce340 con 0x7f9600146fa0 2024-04-02T07:31:16.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.537+0000 7f95f7e00640 1 -- 172.21.15.55:0/3373007868 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9600164ec0 con 0x7f9600147a00 2024-04-02T07:31:16.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f95f7e00640 1 --2- 172.21.15.55:0/3373007868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9600147a00 0x7f96000afc80 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f960014a9a0 tx=0x7f95e801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2d16ac1fa2d7a67 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:16.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f95fde00640 1 -- 172.21.15.55:0/3373007868 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e80aa650 con 0x7f9600147a00 2024-04-02T07:31:16.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f95fde00640 1 -- 172.21.15.55:0/3373007868 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e80aa7b0 con 0x7f9600147a00 2024-04-02T07:31:16.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f95fde00640 1 -- 172.21.15.55:0/3373007868 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e80aab40 con 0x7f9600147a00 2024-04-02T07:31:16.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f9605400640 1 -- 172.21.15.55:0/3373007868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9600147a00 msgr2=0x7f96000afc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:16.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f9605400640 1 --2- 172.21.15.55:0/3373007868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9600147a00 0x7f96000afc80 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f960014a9a0 tx=0x7f95e801c4f0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f9605400640 1 -- 172.21.15.55:0/3373007868 shutdown_connections 2024-04-02T07:31:16.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f9605400640 1 --2- 172.21.15.55:0/3373007868 >> v2:172.21.15.106:3300/0 conn(0x7f96000b01c0 0x7f96000b19b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f9605400640 1 --2- 172.21.15.55:0/3373007868 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9600147a00 0x7f96000afc80 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f9605400640 1 -- 172.21.15.55:0/3373007868 >> 172.21.15.55:0/3373007868 conn(0x7f9600066080 msgr2=0x7f9600069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:16.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f9605400640 1 -- 172.21.15.55:0/3373007868 shutdown_connections 2024-04-02T07:31:16.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f9605400640 1 -- 172.21.15.55:0/3373007868 wait complete. 2024-04-02T07:31:16.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f9605400640 1 Processor -- start 2024-04-02T07:31:16.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f9605400640 1 -- start start 2024-04-02T07:31:16.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f9605400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96000b01c0 0x7f9600145470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f9605400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9600146fa0 0x7f96001459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f9605400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9600147a00 0x7f9600136f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f9605400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96001f9100 con 0x7f96000b01c0 2024-04-02T07:31:16.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f9605400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9600139f00 con 0x7f9600146fa0 2024-04-02T07:31:16.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f9605400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9600139010 con 0x7f9600147a00 2024-04-02T07:31:16.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f95fe800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96000b01c0 0x7f9600145470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f95fe800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96000b01c0 0x7f9600145470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52544/0 (socket says 172.21.15.55:52544) 2024-04-02T07:31:16.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.541+0000 7f95fe800640 1 -- 172.21.15.55:0/666726865 learned_addr learned my addr 172.21.15.55:0/666726865 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:16.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.545+0000 7f95f7e00640 1 --2- 172.21.15.55:0/666726865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9600146fa0 0x7f96001459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.545+0000 7f95ff200640 1 --2- 172.21.15.55:0/666726865 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9600147a00 0x7f9600136f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.545+0000 7f95fe800640 1 -- 172.21.15.55:0/666726865 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9600147a00 msgr2=0x7f9600136f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:16.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.545+0000 7f95fe800640 1 --2- 172.21.15.55:0/666726865 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9600147a00 0x7f9600136f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.545+0000 7f95fe800640 1 -- 172.21.15.55:0/666726865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9600146fa0 msgr2=0x7f96001459b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:16.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.545+0000 7f95fe800640 1 --2- 172.21.15.55:0/666726865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9600146fa0 0x7f96001459b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.545+0000 7f95fe800640 1 -- 172.21.15.55:0/666726865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e80094d0 con 0x7f96000b01c0 2024-04-02T07:31:16.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.545+0000 7f95f7e00640 1 --2- 172.21.15.55:0/666726865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9600146fa0 0x7f96001459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:16.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.545+0000 7f95fe800640 1 --2- 172.21.15.55:0/666726865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96000b01c0 0x7f9600145470 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f95f00011f0 tx=0x7f95f000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:16.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.545+0000 7f95f6a00640 1 -- 172.21.15.55:0/666726865 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f00074e0 con 0x7f96000b01c0 2024-04-02T07:31:16.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.545+0000 7f95f6a00640 1 -- 172.21.15.55:0/666726865 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95f0007640 con 0x7f96000b01c0 2024-04-02T07:31:16.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.545+0000 7f95f6a00640 1 -- 172.21.15.55:0/666726865 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95f0004a10 con 0x7f96000b01c0 2024-04-02T07:31:16.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.545+0000 7f9605400640 1 -- 172.21.15.55:0/666726865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96001392f0 con 0x7f96000b01c0 2024-04-02T07:31:16.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.545+0000 7f9605400640 1 -- 172.21.15.55:0/666726865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96001398b0 con 0x7f96000b01c0 2024-04-02T07:31:16.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.545+0000 7f9605400640 1 -- 172.21.15.55:0/666726865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960013f160 con 0x7f96000b01c0 2024-04-02T07:31:16.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.545+0000 7f95f6a00640 1 -- 172.21.15.55:0/666726865 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f95f0004b70 con 0x7f96000b01c0 2024-04-02T07:31:16.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.549+0000 7f95f6a00640 1 --2- 172.21.15.55:0/666726865 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f95dc0666c0 0x7f95dc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.549+0000 7f95f6a00640 1 -- 172.21.15.55:0/666726865 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f95f0083510 con 0x7f96000b01c0 2024-04-02T07:31:16.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.549+0000 7f95f7e00640 1 --2- 172.21.15.55:0/666726865 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f95dc0666c0 0x7f95dc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.549+0000 7f95f7e00640 1 --2- 172.21.15.55:0/666726865 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f95dc0666c0 0x7f95dc068b80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f95e80ae000 tx=0x7f95e80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:16.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.553+0000 7f95f6a00640 1 -- 172.21.15.55:0/666726865 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f95f0050680 con 0x7f96000b01c0 2024-04-02T07:31:16.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.729+0000 7f9605400640 1 -- 172.21.15.55:0/666726865 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9600066c90 con 0x7f96000b01c0 2024-04-02T07:31:16.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.729+0000 7f95f6a00640 1 -- 172.21.15.55:0/666726865 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16400 (secure 0 0 0) 0x7f95f0018090 con 0x7f96000b01c0 2024-04-02T07:31:16.731 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:16.731 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:30:34.869319+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:28:52.464907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-02T07:28:52.918058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.c","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6834/821922065":"2024-04-03T07:30:34.869296+0000","172.21.15.55:6832/821922065":"2024-04-03T07:30:34.869296+0000","172.21.15.106:6837/2582023800":"2024-04-03T07:29:14.039921+0000","172.21.15.106:6836/2582023800":"2024-04-03T07:29:14.039921+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:31:16.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.729+0000 7f9605400640 1 -- 172.21.15.55:0/666726865 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f95dc0666c0 msgr2=0x7f95dc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:16.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.729+0000 7f9605400640 1 --2- 172.21.15.55:0/666726865 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f95dc0666c0 0x7f95dc068b80 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f95e80ae000 tx=0x7f95e80a7000 comp rx=0 tx=0).stop 2024-04-02T07:31:16.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.729+0000 7f9605400640 1 -- 172.21.15.55:0/666726865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96000b01c0 msgr2=0x7f9600145470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:16.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.729+0000 7f9605400640 1 --2- 172.21.15.55:0/666726865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96000b01c0 0x7f9600145470 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f95f00011f0 tx=0x7f95f000c9b0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.729+0000 7f9605400640 1 -- 172.21.15.55:0/666726865 shutdown_connections 2024-04-02T07:31:16.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.729+0000 7f9605400640 1 --2- 172.21.15.55:0/666726865 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9600147a00 0x7f9600136f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.729+0000 7f9605400640 1 --2- 172.21.15.55:0/666726865 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f95dc0666c0 0x7f95dc068b80 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.729+0000 7f9605400640 1 --2- 172.21.15.55:0/666726865 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9600146fa0 0x7f96001459b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.729+0000 7f9605400640 1 --2- 172.21.15.55:0/666726865 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f96000b01c0 0x7f9600145470 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.729+0000 7f9605400640 1 -- 172.21.15.55:0/666726865 >> 172.21.15.55:0/666726865 conn(0x7f9600066080 msgr2=0x7f9600069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:16.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.729+0000 7f9605400640 1 -- 172.21.15.55:0/666726865 shutdown_connections 2024-04-02T07:31:16.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.729+0000 7f9605400640 1 -- 172.21.15.55:0/666726865 wait complete. 2024-04-02T07:31:16.753 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:28:52.464907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '86', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:28:52.918058+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:31:16.753 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:31:16.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.893+0000 7fa980000640 1 Processor -- start 2024-04-02T07:31:16.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.893+0000 7fa980000640 1 -- start start 2024-04-02T07:31:16.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.893+0000 7fa980000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa9780b3dc0 0x7fa9780ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.893+0000 7fa980000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9780ade90 0x7fa97806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.893+0000 7fa980000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97806c630 con 0x7fa9780b41a0 2024-04-02T07:31:16.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.893+0000 7fa980000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa97806c8f0 con 0x7fa9780b3dc0 2024-04-02T07:31:16.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.893+0000 7fa980000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa97806cbd0 con 0x7fa9780ade90 2024-04-02T07:31:16.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.893+0000 7fa97e000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa9780b41a0 0x7fa978142ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34120/0 (socket says 172.21.15.55:34120) 2024-04-02T07:31:16.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.893+0000 7fa97e000640 1 -- 172.21.15.55:0/71633841 learned_addr learned my addr 172.21.15.55:0/71633841 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:16.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa97cc00640 1 --2- 172.21.15.55:0/71633841 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9780ade90 0x7fa97806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa97d600640 1 --2- 172.21.15.55:0/71633841 >> v2:172.21.15.106:3300/0 conn(0x7fa9780b3dc0 0x7fa9780ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa977e00640 1 -- 172.21.15.55:0/71633841 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3993456971 0 0) 0x7fa97806c630 con 0x7fa9780b41a0 2024-04-02T07:31:16.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa977e00640 1 -- 172.21.15.55:0/71633841 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa960003530 con 0x7fa9780b41a0 2024-04-02T07:31:16.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa977e00640 1 -- 172.21.15.55:0/71633841 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1816758108 0 0) 0x7fa960003530 con 0x7fa9780b41a0 2024-04-02T07:31:16.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa977e00640 1 -- 172.21.15.55:0/71633841 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9780ade90 msgr2=0x7fa97806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:16.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa977e00640 1 --2- 172.21.15.55:0/71633841 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9780ade90 0x7fa97806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa977e00640 1 -- 172.21.15.55:0/71633841 >> v2:172.21.15.106:3300/0 conn(0x7fa9780b3dc0 msgr2=0x7fa9780ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:16.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa977e00640 1 --2- 172.21.15.55:0/71633841 >> v2:172.21.15.106:3300/0 conn(0x7fa9780b3dc0 0x7fa9780ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa977e00640 1 -- 172.21.15.55:0/71633841 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97806ceb0 con 0x7fa9780b41a0 2024-04-02T07:31:16.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa977e00640 1 -- 172.21.15.55:0/71633841 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fa970001a00 con 0x7fa9780b41a0 2024-04-02T07:31:16.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa977e00640 1 -- 172.21.15.55:0/71633841 >> v1:172.21.15.55:6789/0 conn(0x7fa9780b41a0 legacy=0x7fa978142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:16.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa977e00640 1 --2- 172.21.15.55:0/71633841 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa960003980 0x7fa960003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa977e00640 1 --2- 172.21.15.55:0/71633841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa960004370 0x7fa960004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa977e00640 1 --2- 172.21.15.55:0/71633841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa960004f60 0x7fa96000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa977e00640 1 -- 172.21.15.55:0/71633841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97806c8f0 con 0x7fa960004370 2024-04-02T07:31:16.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa977e00640 1 -- 172.21.15.55:0/71633841 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97806cbd0 con 0x7fa960004f60 2024-04-02T07:31:16.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa977e00640 1 -- 172.21.15.55:0/71633841 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa96000bf00 con 0x7fa960003980 2024-04-02T07:31:16.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa97cc00640 1 --2- 172.21.15.55:0/71633841 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9780ade90 0x7fa97806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:31:16.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa97cc00640 1 --2- 172.21.15.55:0/71633841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa960004370 0x7fa960004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa97e000640 1 --2- 172.21.15.55:0/71633841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa960004f60 0x7fa96000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa97d600640 1 --2- 172.21.15.55:0/71633841 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa960003980 0x7fa960003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa97cc00640 1 -- 172.21.15.55:0/71633841 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa960003980 msgr2=0x7fa960003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:16.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa97cc00640 1 --2- 172.21.15.55:0/71633841 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa960003980 0x7fa960003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa97cc00640 1 -- 172.21.15.55:0/71633841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa960004f60 msgr2=0x7fa96000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:16.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa97cc00640 1 --2- 172.21.15.55:0/71633841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa960004f60 0x7fa96000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.897+0000 7fa97cc00640 1 -- 172.21.15.55:0/71633841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa960003530 con 0x7fa960004370 2024-04-02T07:31:16.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.901+0000 7fa97cc00640 1 --2- 172.21.15.55:0/71633841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa960004370 0x7fa960004850 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fa96400bdc0 tx=0x7fa96401f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6a5d3ff276dcee6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.901+0000 7fa977e00640 1 -- 172.21.15.55:0/71633841 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa964004230 con 0x7fa960004370 2024-04-02T07:31:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.901+0000 7fa977e00640 1 -- 172.21.15.55:0/71633841 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa964004390 con 0x7fa960004370 2024-04-02T07:31:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.901+0000 7fa977e00640 1 -- 172.21.15.55:0/71633841 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa964003840 con 0x7fa960004370 2024-04-02T07:31:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.901+0000 7fa980000640 1 -- 172.21.15.55:0/71633841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa960004370 msgr2=0x7fa960004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.901+0000 7fa980000640 1 --2- 172.21.15.55:0/71633841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa960004370 0x7fa960004850 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fa96400bdc0 tx=0x7fa96401f370 comp rx=0 tx=0).stop 2024-04-02T07:31:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.901+0000 7fa97e000640 1 -- 172.21.15.55:0/71633841 reap_dead start 2024-04-02T07:31:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.901+0000 7fa980000640 1 -- 172.21.15.55:0/71633841 shutdown_connections 2024-04-02T07:31:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.901+0000 7fa980000640 1 -- 172.21.15.55:0/71633841 >> 172.21.15.55:0/71633841 conn(0x7fa97806a390 msgr2=0x7fa9780b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.901+0000 7fa980000640 1 -- 172.21.15.55:0/71633841 shutdown_connections 2024-04-02T07:31:16.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.901+0000 7fa980000640 1 -- 172.21.15.55:0/71633841 wait complete. 2024-04-02T07:31:16.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.901+0000 7fa980000640 1 Processor -- start 2024-04-02T07:31:16.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.901+0000 7fa980000640 1 -- start start 2024-04-02T07:31:16.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa980000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa960004370 0x7fa9780aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa980000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa978131db0 0x7fa97815c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa980000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780b0300 0x7fa97815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa980000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa97815cb80 con 0x7fa9780b0300 2024-04-02T07:31:16.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa980000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9781422d0 con 0x7fa960004370 2024-04-02T07:31:16.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa980000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9780afe70 con 0x7fa978131db0 2024-04-02T07:31:16.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa97e000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780b0300 0x7fa97815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa97e000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780b0300 0x7fa97815a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52556/0 (socket says 172.21.15.55:52556) 2024-04-02T07:31:16.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa97e000640 1 -- 172.21.15.55:0/3765113201 learned_addr learned my addr 172.21.15.55:0/3765113201 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:16.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa97d600640 1 --2- 172.21.15.55:0/3765113201 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa960004370 0x7fa9780aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa97cc00640 1 --2- 172.21.15.55:0/3765113201 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa978131db0 0x7fa97815c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa97e000640 1 -- 172.21.15.55:0/3765113201 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa978131db0 msgr2=0x7fa97815c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:16.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa97e000640 1 --2- 172.21.15.55:0/3765113201 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa978131db0 0x7fa97815c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa97e000640 1 -- 172.21.15.55:0/3765113201 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa960004370 msgr2=0x7fa9780aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:16.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa97e000640 1 --2- 172.21.15.55:0/3765113201 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa960004370 0x7fa9780aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:16.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa97e000640 1 -- 172.21.15.55:0/3765113201 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9780af260 con 0x7fa9780b0300 2024-04-02T07:31:16.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa97e000640 1 --2- 172.21.15.55:0/3765113201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780b0300 0x7fa97815a5e0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fa9780b18d0 tx=0x7fa970007a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:16.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa975600640 1 -- 172.21.15.55:0/3765113201 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97000ac20 con 0x7fa9780b0300 2024-04-02T07:31:16.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa975600640 1 -- 172.21.15.55:0/3765113201 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97000ad80 con 0x7fa9780b0300 2024-04-02T07:31:16.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa980000640 1 -- 172.21.15.55:0/3765113201 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9780af540 con 0x7fa9780b0300 2024-04-02T07:31:16.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa975600640 1 -- 172.21.15.55:0/3765113201 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa970013630 con 0x7fa9780b0300 2024-04-02T07:31:16.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa980000640 1 -- 172.21.15.55:0/3765113201 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9780afb00 con 0x7fa9780b0300 2024-04-02T07:31:16.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa980000640 1 -- 172.21.15.55:0/3765113201 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9780affe0 con 0x7fa9780b0300 2024-04-02T07:31:16.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.905+0000 7fa975600640 1 -- 172.21.15.55:0/3765113201 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa970013790 con 0x7fa9780b0300 2024-04-02T07:31:16.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.909+0000 7fa975600640 1 --2- 172.21.15.55:0/3765113201 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa9580666c0 0x7fa958068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:16.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.909+0000 7fa975600640 1 -- 172.21.15.55:0/3765113201 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fa970084b10 con 0x7fa9780b0300 2024-04-02T07:31:16.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.909+0000 7fa97d600640 1 --2- 172.21.15.55:0/3765113201 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa9580666c0 0x7fa958068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:16.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.909+0000 7fa97d600640 1 --2- 172.21.15.55:0/3765113201 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa9580666c0 0x7fa958068b80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009be0 tx=0x7fa96c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:16.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:16.913+0000 7fa975600640 1 -- 172.21.15.55:0/3765113201 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa970051da0 con 0x7fa9780b0300 2024-04-02T07:31:17.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.069+0000 7fa980000640 1 -- 172.21.15.55:0/3765113201 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa978066c90 con 0x7fa9780b0300 2024-04-02T07:31:17.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.069+0000 7fa975600640 1 -- 172.21.15.55:0/3765113201 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v91) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa970017070 con 0x7fa9780b0300 2024-04-02T07:31:17.073 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:31:17.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.073+0000 7fa980000640 1 -- 172.21.15.55:0/3765113201 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa9580666c0 msgr2=0x7fa958068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:17.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.073+0000 7fa980000640 1 --2- 172.21.15.55:0/3765113201 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa9580666c0 0x7fa958068b80 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009be0 tx=0x7fa96c009190 comp rx=0 tx=0).stop 2024-04-02T07:31:17.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.073+0000 7fa980000640 1 -- 172.21.15.55:0/3765113201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780b0300 msgr2=0x7fa97815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:17.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.073+0000 7fa980000640 1 --2- 172.21.15.55:0/3765113201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780b0300 0x7fa97815a5e0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7fa9780b18d0 tx=0x7fa970007a60 comp rx=0 tx=0).stop 2024-04-02T07:31:17.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.073+0000 7fa980000640 1 -- 172.21.15.55:0/3765113201 shutdown_connections 2024-04-02T07:31:17.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.073+0000 7fa980000640 1 --2- 172.21.15.55:0/3765113201 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9780b0300 0x7fa97815a5e0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.073+0000 7fa980000640 1 --2- 172.21.15.55:0/3765113201 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa978131db0 0x7fa97815c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.073+0000 7fa980000640 1 --2- 172.21.15.55:0/3765113201 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa9580666c0 0x7fa958068b80 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.073+0000 7fa980000640 1 --2- 172.21.15.55:0/3765113201 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa960004370 0x7fa9780aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.073+0000 7fa980000640 1 -- 172.21.15.55:0/3765113201 >> 172.21.15.55:0/3765113201 conn(0x7fa97806a390 msgr2=0x7fa9780cdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:17.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.073+0000 7fa980000640 1 -- 172.21.15.55:0/3765113201 shutdown_connections 2024-04-02T07:31:17.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.073+0000 7fa980000640 1 -- 172.21.15.55:0/3765113201 wait complete. 2024-04-02T07:31:17.093 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:31:17.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.237+0000 7f86d3c00640 1 Processor -- start 2024-04-02T07:31:17.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.237+0000 7f86d3c00640 1 -- start start 2024-04-02T07:31:17.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.237+0000 7f86d3c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86cc15ca60 0x7f86cc0cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:17.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.237+0000 7f86d3c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f86cc06c030 0x7f86cc098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:17.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.237+0000 7f86d3c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86cc0993b0 con 0x7f86cc098a10 2024-04-02T07:31:17.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.237+0000 7f86d3c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86cc06c460 con 0x7f86cc06c030 2024-04-02T07:31:17.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.237+0000 7f86d3c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc15ce40 con 0x7f86cc15ca60 2024-04-02T07:31:17.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.237+0000 7f86d1200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86cc15ca60 0x7f86cc0cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:17.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.237+0000 7f86d1c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f86cc06c030 0x7f86cc098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:17.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.237+0000 7f86d1200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86cc15ca60 0x7f86cc0cfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:42566/0 (socket says 172.21.15.55:42566) 2024-04-02T07:31:17.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.237+0000 7f86d1200640 1 -- 172.21.15.55:0/2864084086 learned_addr learned my addr 172.21.15.55:0/2864084086 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:17.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.237+0000 7f86cbe00640 1 --1- 172.21.15.55:0/2864084086 >> v1:172.21.15.106:6789/0 conn(0x7f86cc098a10 0x7f86cc06b920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:56004/0 (socket says 172.21.15.55:56004) 2024-04-02T07:31:17.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.237+0000 7f86d1200640 1 -- 172.21.15.55:0/2864084086 >> v2:172.21.15.106:3300/0 conn(0x7f86cc06c030 msgr2=0x7f86cc098e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:17.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.237+0000 7f86d1200640 1 --2- 172.21.15.55:0/2864084086 >> v2:172.21.15.106:3300/0 conn(0x7f86cc06c030 0x7f86cc098e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.237+0000 7f86d1200640 1 -- 172.21.15.55:0/2864084086 >> v1:172.21.15.106:6789/0 conn(0x7f86cc098a10 legacy=0x7f86cc06b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:17.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.237+0000 7f86d1200640 1 -- 172.21.15.55:0/2864084086 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86cc0d01b0 con 0x7f86cc15ca60 2024-04-02T07:31:17.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.241+0000 7f86d1200640 1 --2- 172.21.15.55:0/2864084086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86cc15ca60 0x7f86cc0cfc70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009870 tx=0x7f86c001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=784d20a43e0160b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:17.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.241+0000 7f86cb400640 1 -- 172.21.15.55:0/2864084086 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c00a6040 con 0x7f86cc15ca60 2024-04-02T07:31:17.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.241+0000 7f86cb400640 1 -- 172.21.15.55:0/2864084086 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c00aa600 con 0x7f86cc15ca60 2024-04-02T07:31:17.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.241+0000 7f86cb400640 1 -- 172.21.15.55:0/2864084086 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c00aa990 con 0x7f86cc15ca60 2024-04-02T07:31:17.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.241+0000 7f86d3c00640 1 -- 172.21.15.55:0/2864084086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86cc15ca60 msgr2=0x7f86cc0cfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:17.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.241+0000 7f86d3c00640 1 --2- 172.21.15.55:0/2864084086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86cc15ca60 0x7f86cc0cfc70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f86c0009870 tx=0x7f86c001c4a0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.241+0000 7f86d3c00640 1 -- 172.21.15.55:0/2864084086 shutdown_connections 2024-04-02T07:31:17.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.241+0000 7f86d3c00640 1 --2- 172.21.15.55:0/2864084086 >> v2:172.21.15.106:3300/0 conn(0x7f86cc06c030 0x7f86cc098e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.241+0000 7f86d3c00640 1 --2- 172.21.15.55:0/2864084086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86cc15ca60 0x7f86cc0cfc70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.241+0000 7f86d3c00640 1 -- 172.21.15.55:0/2864084086 >> 172.21.15.55:0/2864084086 conn(0x7f86cc0b2150 msgr2=0x7f86cc0b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:17.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.241+0000 7f86d3c00640 1 -- 172.21.15.55:0/2864084086 shutdown_connections 2024-04-02T07:31:17.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.241+0000 7f86d3c00640 1 -- 172.21.15.55:0/2864084086 wait complete. 2024-04-02T07:31:17.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86d3c00640 1 Processor -- start 2024-04-02T07:31:17.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86d3c00640 1 -- start start 2024-04-02T07:31:17.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86d3c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86cc06c030 0x7f86cc0ca120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:17.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86d3c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86cc098a10 0x7f86cc0c7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:17.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86d3c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86cc15ca60 0x7f86cc0c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:17.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86d3c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc0aec50 con 0x7f86cc098a10 2024-04-02T07:31:17.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86d3c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc0ae3b0 con 0x7f86cc15ca60 2024-04-02T07:31:17.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86d3c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86cc0ae690 con 0x7f86cc06c030 2024-04-02T07:31:17.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86cbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86cc098a10 0x7f86cc0c7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:17.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86cbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86cc098a10 0x7f86cc0c7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52568/0 (socket says 172.21.15.55:52568) 2024-04-02T07:31:17.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86cbe00640 1 -- 172.21.15.55:0/1086652714 learned_addr learned my addr 172.21.15.55:0/1086652714 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:17.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86d1200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86cc06c030 0x7f86cc0ca120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:17.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86d1c00640 1 --2- 172.21.15.55:0/1086652714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86cc15ca60 0x7f86cc0c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:17.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86cbe00640 1 -- 172.21.15.55:0/1086652714 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86cc06c030 msgr2=0x7f86cc0ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:17.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86cbe00640 1 --2- 172.21.15.55:0/1086652714 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86cc06c030 0x7f86cc0ca120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86cbe00640 1 -- 172.21.15.55:0/1086652714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86cc15ca60 msgr2=0x7f86cc0c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:17.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86cbe00640 1 --2- 172.21.15.55:0/1086652714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86cc15ca60 0x7f86cc0c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86cbe00640 1 -- 172.21.15.55:0/1086652714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c00094d0 con 0x7f86cc098a10 2024-04-02T07:31:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86d1200640 1 --2- 172.21.15.55:0/1086652714 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86cc06c030 0x7f86cc0ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:31:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86d1c00640 1 --2- 172.21.15.55:0/1086652714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86cc15ca60 0x7f86cc0c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:31:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86cbe00640 1 --2- 172.21.15.55:0/1086652714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86cc098a10 0x7f86cc0c7940 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f86b800c370 tx=0x7f86b800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86c8c00640 1 -- 172.21.15.55:0/1086652714 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b80074e0 con 0x7f86cc098a10 2024-04-02T07:31:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86c8c00640 1 -- 172.21.15.55:0/1086652714 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b8007640 con 0x7f86cc098a10 2024-04-02T07:31:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86d3c00640 1 -- 172.21.15.55:0/1086652714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86cc0ae970 con 0x7f86cc098a10 2024-04-02T07:31:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86c8c00640 1 -- 172.21.15.55:0/1086652714 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8004a30 con 0x7f86cc098a10 2024-04-02T07:31:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.245+0000 7f86d3c00640 1 -- 172.21.15.55:0/1086652714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86cc0ad4d0 con 0x7f86cc098a10 2024-04-02T07:31:17.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.249+0000 7f86d3c00640 1 -- 172.21.15.55:0/1086652714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86cc066c90 con 0x7f86cc098a10 2024-04-02T07:31:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.249+0000 7f86c8c00640 1 -- 172.21.15.55:0/1086652714 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f86b8004b90 con 0x7f86cc098a10 2024-04-02T07:31:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.249+0000 7f86c8c00640 1 --2- 172.21.15.55:0/1086652714 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f86ac066690 0x7f86ac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:17.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.249+0000 7f86c8c00640 1 -- 172.21.15.55:0/1086652714 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f86b8083b30 con 0x7f86cc098a10 2024-04-02T07:31:17.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.249+0000 7f86d1200640 1 --2- 172.21.15.55:0/1086652714 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f86ac066690 0x7f86ac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:17.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.249+0000 7f86d1200640 1 --2- 172.21.15.55:0/1086652714 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f86ac066690 0x7f86ac068b50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f86c00ae000 tx=0x7f86c00b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:17.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.253+0000 7f86c8c00640 1 -- 172.21.15.55:0/1086652714 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f86b8050de0 con 0x7f86cc098a10 2024-04-02T07:31:17.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.417+0000 7f86d3c00640 1 -- 172.21.15.55:0/1086652714 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f86cc15a410 con 0x7f86cc098a10 2024-04-02T07:31:17.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.417+0000 7f86c8c00640 1 -- 172.21.15.55:0/1086652714 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v91) v1 ==== 104+0+11 (secure 0 0 0) 0x7f86b8054400 con 0x7f86cc098a10 2024-04-02T07:31:17.418 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:31:17.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.417+0000 7f86d3c00640 1 -- 172.21.15.55:0/1086652714 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f86ac066690 msgr2=0x7f86ac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:17.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.417+0000 7f86d3c00640 1 --2- 172.21.15.55:0/1086652714 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f86ac066690 0x7f86ac068b50 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f86c00ae000 tx=0x7f86c00b5040 comp rx=0 tx=0).stop 2024-04-02T07:31:17.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.417+0000 7f86d3c00640 1 -- 172.21.15.55:0/1086652714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86cc098a10 msgr2=0x7f86cc0c7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:17.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.417+0000 7f86d3c00640 1 --2- 172.21.15.55:0/1086652714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86cc098a10 0x7f86cc0c7940 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f86b800c370 tx=0x7f86b800c830 comp rx=0 tx=0).stop 2024-04-02T07:31:17.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.417+0000 7f86d3c00640 1 -- 172.21.15.55:0/1086652714 shutdown_connections 2024-04-02T07:31:17.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.417+0000 7f86d3c00640 1 --2- 172.21.15.55:0/1086652714 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f86ac066690 0x7f86ac068b50 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.417+0000 7f86d3c00640 1 --2- 172.21.15.55:0/1086652714 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86cc15ca60 0x7f86cc0c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.417+0000 7f86d3c00640 1 --2- 172.21.15.55:0/1086652714 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86cc098a10 0x7f86cc0c7940 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.417+0000 7f86d3c00640 1 --2- 172.21.15.55:0/1086652714 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86cc06c030 0x7f86cc0ca120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.417+0000 7f86d3c00640 1 -- 172.21.15.55:0/1086652714 >> 172.21.15.55:0/1086652714 conn(0x7f86cc0b2150 msgr2=0x7f86cc0afff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.417+0000 7f86d3c00640 1 -- 172.21.15.55:0/1086652714 shutdown_connections 2024-04-02T07:31:17.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.417+0000 7f86d3c00640 1 -- 172.21.15.55:0/1086652714 wait complete. 2024-04-02T07:31:17.438 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:31:17.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.581+0000 7fe857800640 1 Processor -- start 2024-04-02T07:31:17.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.581+0000 7fe857800640 1 -- start start 2024-04-02T07:31:17.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.581+0000 7fe857800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe8500ceb50 0x7fe8500cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:17.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.581+0000 7fe857800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe8500cc5b0 0x7fe850164390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:17.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.581+0000 7fe857800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8500cb0e0 con 0x7fe8500b0800 2024-04-02T07:31:17.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.581+0000 7fe857800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8500cf470 con 0x7fe8500cc5b0 2024-04-02T07:31:17.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.581+0000 7fe857800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8500b1560 con 0x7fe8500ceb50 2024-04-02T07:31:17.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.581+0000 7fe855800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe8500cc5b0 0x7fe850164390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:17.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.581+0000 7fe855800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe8500cc5b0 0x7fe850164390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52570/0 (socket says 172.21.15.55:52570) 2024-04-02T07:31:17.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.581+0000 7fe855800640 1 -- 172.21.15.55:0/4047890746 learned_addr learned my addr 172.21.15.55:0/4047890746 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:17.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.581+0000 7fe854e00640 1 --2- 172.21.15.55:0/4047890746 >> v2:172.21.15.106:3300/0 conn(0x7fe8500ceb50 0x7fe8500cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:17.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.581+0000 7fe855800640 1 -- 172.21.15.55:0/4047890746 >> v2:172.21.15.106:3300/0 conn(0x7fe8500ceb50 msgr2=0x7fe8500cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:17.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.581+0000 7fe855800640 1 --2- 172.21.15.55:0/4047890746 >> v2:172.21.15.106:3300/0 conn(0x7fe8500ceb50 0x7fe8500cef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.581+0000 7fe855800640 1 -- 172.21.15.55:0/4047890746 >> v1:172.21.15.106:6789/0 conn(0x7fe8500b0800 legacy=0x7fe8500b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:17.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.581+0000 7fe855800640 1 -- 172.21.15.55:0/4047890746 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8500b1840 con 0x7fe8500cc5b0 2024-04-02T07:31:17.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.585+0000 7fe855800640 1 --2- 172.21.15.55:0/4047890746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8500cc5b0 0x7fe850164390 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fe8500cde60 tx=0x7fe84801c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d8b65341f2dba7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:17.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.585+0000 7fe84fe00640 1 -- 172.21.15.55:0/4047890746 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8480a55e0 con 0x7fe8500cc5b0 2024-04-02T07:31:17.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.585+0000 7fe84fe00640 1 -- 172.21.15.55:0/4047890746 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8480a5740 con 0x7fe8500cc5b0 2024-04-02T07:31:17.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.585+0000 7fe84fe00640 1 -- 172.21.15.55:0/4047890746 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8480a5ad0 con 0x7fe8500cc5b0 2024-04-02T07:31:17.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.585+0000 7fe857800640 1 -- 172.21.15.55:0/4047890746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8500cc5b0 msgr2=0x7fe850164390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:17.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.585+0000 7fe857800640 1 --2- 172.21.15.55:0/4047890746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8500cc5b0 0x7fe850164390 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fe8500cde60 tx=0x7fe84801c920 comp rx=0 tx=0).stop 2024-04-02T07:31:17.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.585+0000 7fe857800640 1 -- 172.21.15.55:0/4047890746 shutdown_connections 2024-04-02T07:31:17.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.585+0000 7fe857800640 1 --2- 172.21.15.55:0/4047890746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8500cc5b0 0x7fe850164390 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.585+0000 7fe857800640 1 --2- 172.21.15.55:0/4047890746 >> v2:172.21.15.106:3300/0 conn(0x7fe8500ceb50 0x7fe8500cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.585+0000 7fe857800640 1 -- 172.21.15.55:0/4047890746 >> 172.21.15.55:0/4047890746 conn(0x7fe8500d0700 msgr2=0x7fe8500d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:17.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.585+0000 7fe857800640 1 -- 172.21.15.55:0/4047890746 shutdown_connections 2024-04-02T07:31:17.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.585+0000 7fe857800640 1 -- 172.21.15.55:0/4047890746 wait complete. 2024-04-02T07:31:17.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe857800640 1 Processor -- start 2024-04-02T07:31:17.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe857800640 1 -- start start 2024-04-02T07:31:17.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe857800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8500b0800 0x7fe8500b3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:17.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe857800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8500cc5b0 0x7fe850158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:17.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe857800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8500ceb50 0x7fe850159420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:17.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe857800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8500ad3a0 con 0x7fe8500b0800 2024-04-02T07:31:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe857800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8500b3c40 con 0x7fe8500ceb50 2024-04-02T07:31:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe857800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8500af2a0 con 0x7fe8500cc5b0 2024-04-02T07:31:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe854e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8500b0800 0x7fe8500b3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe854e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8500b0800 0x7fe8500b3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52572/0 (socket says 172.21.15.55:52572) 2024-04-02T07:31:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe854e00640 1 -- 172.21.15.55:0/589182641 learned_addr learned my addr 172.21.15.55:0/589182641 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe847e00640 1 --2- 172.21.15.55:0/589182641 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8500cc5b0 0x7fe850158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe855800640 1 --2- 172.21.15.55:0/589182641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8500ceb50 0x7fe850159420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe854e00640 1 -- 172.21.15.55:0/589182641 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8500cc5b0 msgr2=0x7fe850158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe854e00640 1 --2- 172.21.15.55:0/589182641 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8500cc5b0 0x7fe850158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe854e00640 1 -- 172.21.15.55:0/589182641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8500ceb50 msgr2=0x7fe850159420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe854e00640 1 --2- 172.21.15.55:0/589182641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8500ceb50 0x7fe850159420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe854e00640 1 -- 172.21.15.55:0/589182641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe848009b30 con 0x7fe8500b0800 2024-04-02T07:31:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe854e00640 1 --2- 172.21.15.55:0/589182641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8500b0800 0x7fe8500b3700 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fe84000d5f0 tx=0x7fe84000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:17.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe84d600640 1 -- 172.21.15.55:0/589182641 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8400125f0 con 0x7fe8500b0800 2024-04-02T07:31:17.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe84d600640 1 -- 172.21.15.55:0/589182641 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe840012750 con 0x7fe8500b0800 2024-04-02T07:31:17.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe857800640 1 -- 172.21.15.55:0/589182641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8500ad640 con 0x7fe8500b0800 2024-04-02T07:31:17.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe84d600640 1 -- 172.21.15.55:0/589182641 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe840012ae0 con 0x7fe8500b0800 2024-04-02T07:31:17.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.589+0000 7fe857800640 1 -- 172.21.15.55:0/589182641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8500af580 con 0x7fe8500b0800 2024-04-02T07:31:17.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.593+0000 7fe857800640 1 -- 172.21.15.55:0/589182641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe850066c90 con 0x7fe8500b0800 2024-04-02T07:31:17.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.593+0000 7fe84d600640 1 -- 172.21.15.55:0/589182641 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe840012c40 con 0x7fe8500b0800 2024-04-02T07:31:17.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.593+0000 7fe84d600640 1 --2- 172.21.15.55:0/589182641 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe82c066690 0x7fe82c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:17.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.593+0000 7fe84d600640 1 -- 172.21.15.55:0/589182641 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fe840084800 con 0x7fe8500b0800 2024-04-02T07:31:17.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.593+0000 7fe847e00640 1 --2- 172.21.15.55:0/589182641 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe82c066690 0x7fe82c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:17.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.593+0000 7fe847e00640 1 --2- 172.21.15.55:0/589182641 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe82c066690 0x7fe82c068b50 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe85006c760 tx=0x7fe838008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:17.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.597+0000 7fe84d600640 1 -- 172.21.15.55:0/589182641 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe840051a00 con 0x7fe8500b0800 2024-04-02T07:31:17.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.757+0000 7fe857800640 1 -- 172.21.15.55:0/589182641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe8500d1320 con 0x7fe8500b0800 2024-04-02T07:31:17.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.757+0000 7fe84d600640 1 -- 172.21.15.55:0/589182641 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v91) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe840007380 con 0x7fe8500b0800 2024-04-02T07:31:17.758 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:31:17.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.757+0000 7fe857800640 1 -- 172.21.15.55:0/589182641 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe82c066690 msgr2=0x7fe82c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:17.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.757+0000 7fe857800640 1 --2- 172.21.15.55:0/589182641 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe82c066690 0x7fe82c068b50 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fe85006c760 tx=0x7fe838008040 comp rx=0 tx=0).stop 2024-04-02T07:31:17.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.757+0000 7fe857800640 1 -- 172.21.15.55:0/589182641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8500b0800 msgr2=0x7fe8500b3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:17.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.757+0000 7fe857800640 1 --2- 172.21.15.55:0/589182641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8500b0800 0x7fe8500b3700 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7fe84000d5f0 tx=0x7fe84000dab0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.757+0000 7fe857800640 1 -- 172.21.15.55:0/589182641 shutdown_connections 2024-04-02T07:31:17.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.757+0000 7fe857800640 1 --2- 172.21.15.55:0/589182641 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe82c066690 0x7fe82c068b50 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.757+0000 7fe857800640 1 --2- 172.21.15.55:0/589182641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe8500ceb50 0x7fe850159420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.757+0000 7fe857800640 1 --2- 172.21.15.55:0/589182641 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8500cc5b0 0x7fe850158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.757+0000 7fe857800640 1 --2- 172.21.15.55:0/589182641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe8500b0800 0x7fe8500b3700 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.757+0000 7fe857800640 1 -- 172.21.15.55:0/589182641 >> 172.21.15.55:0/589182641 conn(0x7fe8500d0700 msgr2=0x7fe8500cb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:17.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.757+0000 7fe857800640 1 -- 172.21.15.55:0/589182641 shutdown_connections 2024-04-02T07:31:17.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.757+0000 7fe857800640 1 -- 172.21.15.55:0/589182641 wait complete. 2024-04-02T07:31:17.779 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:31:17.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.917+0000 7f74cb200640 1 Processor -- start 2024-04-02T07:31:17.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.917+0000 7f74cb200640 1 -- start start 2024-04-02T07:31:17.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.917+0000 7f74cb200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f74c40ce630 0x7f74c4065d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:17.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.917+0000 7f74cb200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74c4070a80 0x7f74c4070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:17.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.917+0000 7f74cb200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74c406d5b0 con 0x7f74c415cbe0 2024-04-02T07:31:17.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.917+0000 7f74cb200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74c40cec10 con 0x7f74c40ce630 2024-04-02T07:31:17.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.917+0000 7f74cb200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c4071430 con 0x7f74c4070a80 2024-04-02T07:31:17.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.917+0000 7f74bb400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f74c40ce630 0x7f74c4065d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:17.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.917+0000 7f74c3e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f74c415cbe0 0x7f74c40b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34132/0 (socket says 172.21.15.55:34132) 2024-04-02T07:31:17.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.917+0000 7f74c3e00640 1 -- 172.21.15.55:0/1948786536 learned_addr learned my addr 172.21.15.55:0/1948786536 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:17.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.921+0000 7f74c9200640 1 --2- 172.21.15.55:0/1948786536 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74c4070a80 0x7f74c4070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:17.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.921+0000 7f74bb400640 1 -- 172.21.15.55:0/1948786536 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74c4070a80 msgr2=0x7f74c4070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:17.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.921+0000 7f74bb400640 1 --2- 172.21.15.55:0/1948786536 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74c4070a80 0x7f74c4070ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.921+0000 7f74bb400640 1 -- 172.21.15.55:0/1948786536 >> v1:172.21.15.55:6789/0 conn(0x7f74c415cbe0 legacy=0x7f74c40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:17.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.921+0000 7f74bb400640 1 -- 172.21.15.55:0/1948786536 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74c406cc80 con 0x7f74c40ce630 2024-04-02T07:31:17.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.921+0000 7f74c9200640 1 --2- 172.21.15.55:0/1948786536 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74c4070a80 0x7f74c4070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:17.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.921+0000 7f74c3400640 1 -- 172.21.15.55:0/1948786536 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472486354 0 0) 0x7f74c406d5b0 con 0x7f74c415cbe0 2024-04-02T07:31:17.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.921+0000 7f74bb400640 1 --2- 172.21.15.55:0/1948786536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c40ce630 0x7f74c4065d20 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0097f0 tx=0x7f74ac01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a10a70a364aaaa7e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:17.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.921+0000 7f74c3400640 1 -- 172.21.15.55:0/1948786536 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac0ad640 con 0x7f74c40ce630 2024-04-02T07:31:17.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.921+0000 7f74c3400640 1 -- 172.21.15.55:0/1948786536 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac0ad7a0 con 0x7f74c40ce630 2024-04-02T07:31:17.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.921+0000 7f74c3400640 1 -- 172.21.15.55:0/1948786536 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac0adb30 con 0x7f74c40ce630 2024-04-02T07:31:17.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.921+0000 7f74cb200640 1 -- 172.21.15.55:0/1948786536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c40ce630 msgr2=0x7f74c4065d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:17.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.921+0000 7f74cb200640 1 --2- 172.21.15.55:0/1948786536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c40ce630 0x7f74c4065d20 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0097f0 tx=0x7f74ac01c4a0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74cb200640 1 -- 172.21.15.55:0/1948786536 shutdown_connections 2024-04-02T07:31:17.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74cb200640 1 --2- 172.21.15.55:0/1948786536 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74c4070a80 0x7f74c4070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74cb200640 1 --2- 172.21.15.55:0/1948786536 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c40ce630 0x7f74c4065d20 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74cb200640 1 -- 172.21.15.55:0/1948786536 >> 172.21.15.55:0/1948786536 conn(0x7f74c40ced50 msgr2=0x7f74c40cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:17.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74cb200640 1 -- 172.21.15.55:0/1948786536 shutdown_connections 2024-04-02T07:31:17.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74cb200640 1 -- 172.21.15.55:0/1948786536 wait complete. 2024-04-02T07:31:17.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74cb200640 1 Processor -- start 2024-04-02T07:31:17.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74cb200640 1 -- start start 2024-04-02T07:31:17.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74cb200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c4070a80 0x7f74c4149750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:17.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74cb200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74c40ce630 0x7f74c414e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:17.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74cb200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74c415cbe0 0x7f74c4147a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:17.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74cb200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c4154490 con 0x7f74c4070a80 2024-04-02T07:31:17.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74cb200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c414ebc0 con 0x7f74c40ce630 2024-04-02T07:31:17.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74cb200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74c4152590 con 0x7f74c415cbe0 2024-04-02T07:31:17.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74c3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c4070a80 0x7f74c4149750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:17.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74c3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c4070a80 0x7f74c4149750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52582/0 (socket says 172.21.15.55:52582) 2024-04-02T07:31:17.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74c3e00640 1 -- 172.21.15.55:0/1338257749 learned_addr learned my addr 172.21.15.55:0/1338257749 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:17.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74bb400640 1 --2- 172.21.15.55:0/1338257749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74c40ce630 0x7f74c414e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:17.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74c9200640 1 --2- 172.21.15.55:0/1338257749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74c415cbe0 0x7f74c4147a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:17.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74c3e00640 1 -- 172.21.15.55:0/1338257749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74c415cbe0 msgr2=0x7f74c4147a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:17.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74c3e00640 1 --2- 172.21.15.55:0/1338257749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74c415cbe0 0x7f74c4147a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74c3e00640 1 -- 172.21.15.55:0/1338257749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74c40ce630 msgr2=0x7f74c414e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:17.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74c3e00640 1 --2- 172.21.15.55:0/1338257749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74c40ce630 0x7f74c414e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:17.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74c3e00640 1 -- 172.21.15.55:0/1338257749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ac009420 con 0x7f74c4070a80 2024-04-02T07:31:17.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74bb400640 1 --2- 172.21.15.55:0/1338257749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74c40ce630 0x7f74c414e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:17.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74c3e00640 1 --2- 172.21.15.55:0/1338257749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c4070a80 0x7f74c4149750 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f74b400c480 tx=0x7f74b400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:17.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74c0c00640 1 -- 172.21.15.55:0/1338257749 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b40074e0 con 0x7f74c4070a80 2024-04-02T07:31:17.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74c0c00640 1 -- 172.21.15.55:0/1338257749 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74b4007660 con 0x7f74c4070a80 2024-04-02T07:31:17.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74cb200640 1 -- 172.21.15.55:0/1338257749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c4152870 con 0x7f74c4070a80 2024-04-02T07:31:17.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74c0c00640 1 -- 172.21.15.55:0/1338257749 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74b4004a30 con 0x7f74c4070a80 2024-04-02T07:31:17.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.925+0000 7f74cb200640 1 -- 172.21.15.55:0/1338257749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c4147f40 con 0x7f74c4070a80 2024-04-02T07:31:17.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.929+0000 7f74cb200640 1 -- 172.21.15.55:0/1338257749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c4066c90 con 0x7f74c4070a80 2024-04-02T07:31:17.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.929+0000 7f74c0c00640 1 -- 172.21.15.55:0/1338257749 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f74b4004b90 con 0x7f74c4070a80 2024-04-02T07:31:17.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.929+0000 7f74c0c00640 1 --2- 172.21.15.55:0/1338257749 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f74a0066690 0x7f74a0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:17.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.929+0000 7f74c0c00640 1 -- 172.21.15.55:0/1338257749 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f74b4083790 con 0x7f74c4070a80 2024-04-02T07:31:17.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.929+0000 7f74bb400640 1 --2- 172.21.15.55:0/1338257749 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f74a0066690 0x7f74a0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:17.932 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.929+0000 7f74bb400640 1 --2- 172.21.15.55:0/1338257749 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f74a0066690 0x7f74a0068b50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0af000 tx=0x7f74ac0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:17.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:17.933+0000 7f74c0c00640 1 -- 172.21.15.55:0/1338257749 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f74b40544b0 con 0x7f74c4070a80 2024-04-02T07:31:18.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.133+0000 7f74cb200640 1 -- 172.21.15.55:0/1338257749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f74c406e640 con 0x7f74c4070a80 2024-04-02T07:31:18.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.133+0000 7f74c0c00640 1 -- 172.21.15.55:0/1338257749 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f74b4054040 con 0x7f74c4070a80 2024-04-02T07:31:18.134 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:18.134 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2209852195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2209852195},{"type":"v1","addr":"172.21.15.55:6835","nonce":2209852195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1897181831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1897181831},{"type":"v1","addr":"172.21.15.106:6835","nonce":1897181831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1894364429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1894364429},{"type":"v1","addr":"172.21.15.106:6837","nonce":1894364429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:28:53.919977+0000","modified":"2024-04-02T07:30:38.894246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8052":{"gid":8052,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6834/2658455613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2658455613},{"type":"v1","addr":"172.21.15.55:6834","nonce":2658455613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-02T07:31:18.134 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 73 2024-04-02T07:31:18.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.133+0000 7f74cb200640 1 -- 172.21.15.55:0/1338257749 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f74a0066690 msgr2=0x7f74a0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:18.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.133+0000 7f74cb200640 1 --2- 172.21.15.55:0/1338257749 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f74a0066690 0x7f74a0068b50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f74ac0af000 tx=0x7f74ac0a7070 comp rx=0 tx=0).stop 2024-04-02T07:31:18.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.133+0000 7f74cb200640 1 -- 172.21.15.55:0/1338257749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c4070a80 msgr2=0x7f74c4149750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:18.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.133+0000 7f74cb200640 1 --2- 172.21.15.55:0/1338257749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c4070a80 0x7f74c4149750 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f74b400c480 tx=0x7f74b400c940 comp rx=0 tx=0).stop 2024-04-02T07:31:18.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.133+0000 7f74cb200640 1 -- 172.21.15.55:0/1338257749 shutdown_connections 2024-04-02T07:31:18.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.133+0000 7f74cb200640 1 --2- 172.21.15.55:0/1338257749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74c415cbe0 0x7f74c4147a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.133+0000 7f74cb200640 1 --2- 172.21.15.55:0/1338257749 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f74a0066690 0x7f74a0068b50 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.133+0000 7f74cb200640 1 --2- 172.21.15.55:0/1338257749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74c40ce630 0x7f74c414e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.133+0000 7f74cb200640 1 --2- 172.21.15.55:0/1338257749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74c4070a80 0x7f74c4149750 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.133+0000 7f74cb200640 1 -- 172.21.15.55:0/1338257749 >> 172.21.15.55:0/1338257749 conn(0x7f74c40ced50 msgr2=0x7f74c40b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:18.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.133+0000 7f74cb200640 1 -- 172.21.15.55:0/1338257749 shutdown_connections 2024-04-02T07:31:18.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.133+0000 7f74cb200640 1 -- 172.21.15.55:0/1338257749 wait complete. 2024-04-02T07:31:18.155 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:31:18.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.293+0000 7f3603600640 1 Processor -- start 2024-04-02T07:31:18.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.293+0000 7f3603600640 1 -- start start 2024-04-02T07:31:18.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.297+0000 7f3603600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f35fc0b0cb0 0x7f35fc0b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:18.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.297+0000 7f3603600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35fc0c3680 0x7f35fc15c900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:18.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.297+0000 7f3603600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35fc15d270 con 0x7f35fc15ce40 2024-04-02T07:31:18.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.297+0000 7f3603600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35fc0b1090 con 0x7f35fc0c3680 2024-04-02T07:31:18.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.297+0000 7f3603600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc0cac90 con 0x7f35fc0b0cb0 2024-04-02T07:31:18.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.297+0000 7f35fbe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35fc0c3680 0x7f35fc15c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:18.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.297+0000 7f35fbe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f35fc0c3680 0x7f35fc15c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52594/0 (socket says 172.21.15.55:52594) 2024-04-02T07:31:18.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.297+0000 7f35fbe00640 1 -- 172.21.15.55:0/3885648626 learned_addr learned my addr 172.21.15.55:0/3885648626 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:18.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.297+0000 7f3601600640 1 --1- 172.21.15.55:0/3885648626 >> v1:172.21.15.55:6789/0 conn(0x7f35fc15ce40 0x7f35fc0cbe50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34138/0 (socket says 172.21.15.55:34138) 2024-04-02T07:31:18.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.297+0000 7f3600c00640 1 --2- 172.21.15.55:0/3885648626 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f35fc0b0cb0 0x7f35fc0b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:18.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.297+0000 7f35fbe00640 1 -- 172.21.15.55:0/3885648626 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f35fc0b0cb0 msgr2=0x7f35fc0b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:18.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.297+0000 7f35fbe00640 1 --2- 172.21.15.55:0/3885648626 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f35fc0b0cb0 0x7f35fc0b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.297+0000 7f35fbe00640 1 -- 172.21.15.55:0/3885648626 >> v1:172.21.15.55:6789/0 conn(0x7f35fc15ce40 legacy=0x7f35fc0cbe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:18.299 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.297+0000 7f35fbe00640 1 -- 172.21.15.55:0/3885648626 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35fc0caf70 con 0x7f35fc0c3680 2024-04-02T07:31:18.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.297+0000 7f35fbe00640 1 --2- 172.21.15.55:0/3885648626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc0c3680 0x7f35fc15c900 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f35e800bb10 tx=0x7f35e801ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31cd95b8190b2592 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:18.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.297+0000 7f35fb400640 1 -- 172.21.15.55:0/3885648626 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e80a7cd0 con 0x7f35fc0c3680 2024-04-02T07:31:18.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f35fb400640 1 -- 172.21.15.55:0/3885648626 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e80a7e30 con 0x7f35fc0c3680 2024-04-02T07:31:18.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f35fb400640 1 -- 172.21.15.55:0/3885648626 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e80af660 con 0x7f35fc0c3680 2024-04-02T07:31:18.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f3603600640 1 -- 172.21.15.55:0/3885648626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc0c3680 msgr2=0x7f35fc15c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:18.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f3603600640 1 --2- 172.21.15.55:0/3885648626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc0c3680 0x7f35fc15c900 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f35e800bb10 tx=0x7f35e801ec00 comp rx=0 tx=0).stop 2024-04-02T07:31:18.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f3603600640 1 -- 172.21.15.55:0/3885648626 shutdown_connections 2024-04-02T07:31:18.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f3603600640 1 --2- 172.21.15.55:0/3885648626 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc0c3680 0x7f35fc15c900 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f3603600640 1 --2- 172.21.15.55:0/3885648626 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f35fc0b0cb0 0x7f35fc0b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f3603600640 1 -- 172.21.15.55:0/3885648626 >> 172.21.15.55:0/3885648626 conn(0x7f35fc066080 msgr2=0x7f35fc069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:18.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f3603600640 1 -- 172.21.15.55:0/3885648626 shutdown_connections 2024-04-02T07:31:18.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f3603600640 1 -- 172.21.15.55:0/3885648626 wait complete. 2024-04-02T07:31:18.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f3603600640 1 Processor -- start 2024-04-02T07:31:18.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f3603600640 1 -- start start 2024-04-02T07:31:18.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f3603600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35fc0b0cb0 0x7f35fc14a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:18.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f3603600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc0c3680 0x7f35fc152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:18.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f3603600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f35fc15ce40 0x7f35fc141280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:18.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f3603600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc141d80 con 0x7f35fc0c3680 2024-04-02T07:31:18.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f3603600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc1525c0 con 0x7f35fc0b0cb0 2024-04-02T07:31:18.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f3603600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35fc142020 con 0x7f35fc15ce40 2024-04-02T07:31:18.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f35fbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc0c3680 0x7f35fc152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:18.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f35fbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc0c3680 0x7f35fc152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52606/0 (socket says 172.21.15.55:52606) 2024-04-02T07:31:18.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f35fbe00640 1 -- 172.21.15.55:0/1018352902 learned_addr learned my addr 172.21.15.55:0/1018352902 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:18.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f35fbe00640 1 -- 172.21.15.55:0/1018352902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f35fc15ce40 msgr2=0x7f35fc141280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:18.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f35fbe00640 1 --2- 172.21.15.55:0/1018352902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f35fc15ce40 0x7f35fc141280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f35fbe00640 1 -- 172.21.15.55:0/1018352902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35fc0b0cb0 msgr2=0x7f35fc14a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:18.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f35fbe00640 1 --2- 172.21.15.55:0/1018352902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35fc0b0cb0 0x7f35fc14a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.301+0000 7f35fbe00640 1 -- 172.21.15.55:0/1018352902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e800b770 con 0x7f35fc0c3680 2024-04-02T07:31:18.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.305+0000 7f35fbe00640 1 --2- 172.21.15.55:0/1018352902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc0c3680 0x7f35fc152080 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f35e800b2c0 tx=0x7f35e801d440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:18.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.305+0000 7f35f8c00640 1 -- 172.21.15.55:0/1018352902 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e80afe80 con 0x7f35fc0c3680 2024-04-02T07:31:18.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.305+0000 7f35f8c00640 1 -- 172.21.15.55:0/1018352902 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e80ba440 con 0x7f35fc0c3680 2024-04-02T07:31:18.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.305+0000 7f35f8c00640 1 -- 172.21.15.55:0/1018352902 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e80ba7f0 con 0x7f35fc0c3680 2024-04-02T07:31:18.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.305+0000 7f3603600640 1 -- 172.21.15.55:0/1018352902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35fc142300 con 0x7f35fc0c3680 2024-04-02T07:31:18.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.305+0000 7f3603600640 1 -- 172.21.15.55:0/1018352902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35fc1417c0 con 0x7f35fc0c3680 2024-04-02T07:31:18.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.305+0000 7f3603600640 1 -- 172.21.15.55:0/1018352902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35fc066c90 con 0x7f35fc0c3680 2024-04-02T07:31:18.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.305+0000 7f35f8c00640 1 -- 172.21.15.55:0/1018352902 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f35e80b93e0 con 0x7f35fc0c3680 2024-04-02T07:31:18.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.305+0000 7f35f8c00640 1 --2- 172.21.15.55:0/1018352902 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f35dc0666c0 0x7f35dc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:18.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.305+0000 7f35f8c00640 1 -- 172.21.15.55:0/1018352902 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f35e811ece0 con 0x7f35fc0c3680 2024-04-02T07:31:18.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.305+0000 7f3600c00640 1 --2- 172.21.15.55:0/1018352902 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f35dc0666c0 0x7f35dc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:18.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.309+0000 7f3600c00640 1 --2- 172.21.15.55:0/1018352902 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f35dc0666c0 0x7f35dc068b80 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f35f000b850 tx=0x7f35f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:18.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.309+0000 7f35f8c00640 1 -- 172.21.15.55:0/1018352902 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f35e80ebe50 con 0x7f35fc0c3680 2024-04-02T07:31:18.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.473+0000 7f3603600640 1 -- 172.21.15.55:0/1018352902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35fc1427b0 con 0x7f35fc0c3680 2024-04-02T07:31:18.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.473+0000 7f35f8c00640 1 -- 172.21.15.55:0/1018352902 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16400 (secure 0 0 0) 0x7f35e80b4090 con 0x7f35fc0c3680 2024-04-02T07:31:18.475 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:18.475 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:30:34.869319+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:28:52.464907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-02T07:28:52.918058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.c","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6834/821922065":"2024-04-03T07:30:34.869296+0000","172.21.15.55:6832/821922065":"2024-04-03T07:30:34.869296+0000","172.21.15.106:6837/2582023800":"2024-04-03T07:29:14.039921+0000","172.21.15.106:6836/2582023800":"2024-04-03T07:29:14.039921+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:31:18.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.473+0000 7f3603600640 1 -- 172.21.15.55:0/1018352902 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f35dc0666c0 msgr2=0x7f35dc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:18.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.473+0000 7f3603600640 1 --2- 172.21.15.55:0/1018352902 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f35dc0666c0 0x7f35dc068b80 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f35f000b850 tx=0x7f35f0008040 comp rx=0 tx=0).stop 2024-04-02T07:31:18.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.473+0000 7f3603600640 1 -- 172.21.15.55:0/1018352902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc0c3680 msgr2=0x7f35fc152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:18.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.473+0000 7f3603600640 1 --2- 172.21.15.55:0/1018352902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc0c3680 0x7f35fc152080 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7f35e800b2c0 tx=0x7f35e801d440 comp rx=0 tx=0).stop 2024-04-02T07:31:18.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.473+0000 7f3603600640 1 -- 172.21.15.55:0/1018352902 shutdown_connections 2024-04-02T07:31:18.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.473+0000 7f3603600640 1 --2- 172.21.15.55:0/1018352902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f35fc15ce40 0x7f35fc141280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.473+0000 7f3603600640 1 --2- 172.21.15.55:0/1018352902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35fc0c3680 0x7f35fc152080 unknown :-1 s=CLOSED pgs=1378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.473+0000 7f3603600640 1 --2- 172.21.15.55:0/1018352902 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f35dc0666c0 0x7f35dc068b80 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.473+0000 7f3603600640 1 --2- 172.21.15.55:0/1018352902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f35fc0b0cb0 0x7f35fc14a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.473+0000 7f3603600640 1 -- 172.21.15.55:0/1018352902 >> 172.21.15.55:0/1018352902 conn(0x7f35fc066080 msgr2=0x7f35fc069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:18.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.477+0000 7f3603600640 1 -- 172.21.15.55:0/1018352902 shutdown_connections 2024-04-02T07:31:18.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.477+0000 7f3603600640 1 -- 172.21.15.55:0/1018352902 wait complete. 2024-04-02T07:31:18.496 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-02T07:31:18.496 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:31:18.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.633+0000 7fdf49a00640 1 Processor -- start 2024-04-02T07:31:18.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.633+0000 7fdf49a00640 1 -- start start 2024-04-02T07:31:18.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.633+0000 7fdf49a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdf44153ea0 0x7fdf440c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:18.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.633+0000 7fdf49a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf4413d0c0 con 0x7fdf4415a070 2024-04-02T07:31:18.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.633+0000 7fdf49a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf4415a4f0 con 0x7fdf44159be0 2024-04-02T07:31:18.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.633+0000 7fdf49a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf4415a7d0 con 0x7fdf44153ea0 2024-04-02T07:31:18.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.637+0000 7fdf42a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdf44153ea0 0x7fdf440c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:18.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.637+0000 7fdf43400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdf4415a070 0x7fdf4413d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34142/0 (socket says 172.21.15.55:34142) 2024-04-02T07:31:18.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.637+0000 7fdf43400640 1 -- 172.21.15.55:0/1267657728 learned_addr learned my addr 172.21.15.55:0/1267657728 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:18.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.637+0000 7fdf42a00640 1 -- 172.21.15.55:0/1267657728 >> v1:172.21.15.106:6789/0 conn(0x7fdf44159be0 legacy=0x7fdf440b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:18.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.637+0000 7fdf42a00640 1 -- 172.21.15.55:0/1267657728 >> v1:172.21.15.55:6789/0 conn(0x7fdf4415a070 legacy=0x7fdf4413d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:18.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.637+0000 7fdf42a00640 1 -- 172.21.15.55:0/1267657728 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4415aab0 con 0x7fdf44153ea0 2024-04-02T07:31:18.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.637+0000 7fdf42000640 1 -- 172.21.15.55:0/1267657728 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2948858101 0 0) 0x7fdf4413d0c0 con 0x7fdf4415a070 2024-04-02T07:31:18.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.637+0000 7fdf42a00640 1 --2- 172.21.15.55:0/1267657728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf44153ea0 0x7fdf440c4120 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fdf34009d90 tx=0x7fdf3401c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=824c276aa231357b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:18.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.637+0000 7fdf42000640 1 -- 172.21.15.55:0/1267657728 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf340a5a50 con 0x7fdf44153ea0 2024-04-02T07:31:18.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.637+0000 7fdf42000640 1 -- 172.21.15.55:0/1267657728 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf340a5bb0 con 0x7fdf44153ea0 2024-04-02T07:31:18.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.637+0000 7fdf42000640 1 -- 172.21.15.55:0/1267657728 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf340ad440 con 0x7fdf44153ea0 2024-04-02T07:31:18.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf49a00640 1 -- 172.21.15.55:0/1267657728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf44153ea0 msgr2=0x7fdf440c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:18.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf49a00640 1 --2- 172.21.15.55:0/1267657728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf44153ea0 0x7fdf440c4120 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7fdf34009d90 tx=0x7fdf3401c970 comp rx=0 tx=0).stop 2024-04-02T07:31:18.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf49a00640 1 -- 172.21.15.55:0/1267657728 shutdown_connections 2024-04-02T07:31:18.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf49a00640 1 --2- 172.21.15.55:0/1267657728 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf44153ea0 0x7fdf440c4120 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf49a00640 1 -- 172.21.15.55:0/1267657728 >> 172.21.15.55:0/1267657728 conn(0x7fdf44066080 msgr2=0x7fdf44069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:18.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf49a00640 1 -- 172.21.15.55:0/1267657728 shutdown_connections 2024-04-02T07:31:18.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf49a00640 1 -- 172.21.15.55:0/1267657728 wait complete. 2024-04-02T07:31:18.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf49a00640 1 Processor -- start 2024-04-02T07:31:18.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf49a00640 1 -- start start 2024-04-02T07:31:18.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf49a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf44153ea0 0x7fdf441519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:18.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf49a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf44159be0 0x7fdf4413ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:18.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf49a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf4415a070 0x7fdf4413b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:18.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf49a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf441f3240 con 0x7fdf44159be0 2024-04-02T07:31:18.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf49a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf441f3520 con 0x7fdf4415a070 2024-04-02T07:31:18.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf49a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf441f3800 con 0x7fdf44153ea0 2024-04-02T07:31:18.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf3a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf44159be0 0x7fdf4413ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:18.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf3a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf44159be0 0x7fdf4413ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52630/0 (socket says 172.21.15.55:52630) 2024-04-02T07:31:18.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf3a000640 1 -- 172.21.15.55:0/1426753702 learned_addr learned my addr 172.21.15.55:0/1426753702 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:18.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf43400640 1 --2- 172.21.15.55:0/1426753702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf4415a070 0x7fdf4413b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:18.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf42a00640 1 --2- 172.21.15.55:0/1426753702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf44153ea0 0x7fdf441519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:18.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf3a000640 1 -- 172.21.15.55:0/1426753702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf44153ea0 msgr2=0x7fdf441519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:18.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf3a000640 1 --2- 172.21.15.55:0/1426753702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf44153ea0 0x7fdf441519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf3a000640 1 -- 172.21.15.55:0/1426753702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf4415a070 msgr2=0x7fdf4413b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:18.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf3a000640 1 --2- 172.21.15.55:0/1426753702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf4415a070 0x7fdf4413b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.641+0000 7fdf3a000640 1 -- 172.21.15.55:0/1426753702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf34009a70 con 0x7fdf44159be0 2024-04-02T07:31:18.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.645+0000 7fdf3a000640 1 --2- 172.21.15.55:0/1426753702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf44159be0 0x7fdf4413ac60 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00c500 tx=0x7fdf2c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:18.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.645+0000 7fdf3b400640 1 -- 172.21.15.55:0/1426753702 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c005220 con 0x7fdf44159be0 2024-04-02T07:31:18.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.645+0000 7fdf3b400640 1 -- 172.21.15.55:0/1426753702 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf2c005380 con 0x7fdf44159be0 2024-04-02T07:31:18.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.645+0000 7fdf49a00640 1 -- 172.21.15.55:0/1426753702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf441f3ae0 con 0x7fdf44159be0 2024-04-02T07:31:18.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.645+0000 7fdf3b400640 1 -- 172.21.15.55:0/1426753702 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf2c007270 con 0x7fdf44159be0 2024-04-02T07:31:18.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.645+0000 7fdf49a00640 1 -- 172.21.15.55:0/1426753702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf44151f20 con 0x7fdf44159be0 2024-04-02T07:31:18.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.645+0000 7fdf49a00640 1 -- 172.21.15.55:0/1426753702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf44066c90 con 0x7fdf44159be0 2024-04-02T07:31:18.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.645+0000 7fdf3b400640 1 -- 172.21.15.55:0/1426753702 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fdf2c0073d0 con 0x7fdf44159be0 2024-04-02T07:31:18.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.645+0000 7fdf3b400640 1 --2- 172.21.15.55:0/1426753702 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf200666c0 0x7fdf20068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:18.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.645+0000 7fdf3b400640 1 -- 172.21.15.55:0/1426753702 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7fdf2c083a70 con 0x7fdf44159be0 2024-04-02T07:31:18.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.645+0000 7fdf42a00640 1 --2- 172.21.15.55:0/1426753702 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf200666c0 0x7fdf20068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:18.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.649+0000 7fdf42a00640 1 --2- 172.21.15.55:0/1426753702 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf200666c0 0x7fdf20068b80 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fdf340af000 tx=0x7fdf340a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:18.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.649+0000 7fdf3b400640 1 -- 172.21.15.55:0/1426753702 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fdf2c050d30 con 0x7fdf44159be0 2024-04-02T07:31:18.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.845+0000 7fdf49a00640 1 -- 172.21.15.55:0/1426753702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf44138a40 con 0x7fdf44159be0 2024-04-02T07:31:18.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.845+0000 7fdf3b400640 1 -- 172.21.15.55:0/1426753702 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4743 (secure 0 0 0) 0x7fdf2c054350 con 0x7fdf44159be0 2024-04-02T07:31:18.847 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:18.847 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2209852195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2209852195},{"type":"v1","addr":"172.21.15.55:6835","nonce":2209852195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1897181831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1897181831},{"type":"v1","addr":"172.21.15.106:6835","nonce":1897181831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1894364429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1894364429},{"type":"v1","addr":"172.21.15.106:6837","nonce":1894364429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:28:53.919977+0000","modified":"2024-04-02T07:30:38.894246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8052":{"gid":8052,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6834/2658455613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2658455613},{"type":"v1","addr":"172.21.15.55:6834","nonce":2658455613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-02T07:31:18.848 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 73 2024-04-02T07:31:18.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.845+0000 7fdf49a00640 1 -- 172.21.15.55:0/1426753702 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf200666c0 msgr2=0x7fdf20068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:18.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.845+0000 7fdf49a00640 1 --2- 172.21.15.55:0/1426753702 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf200666c0 0x7fdf20068b80 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fdf340af000 tx=0x7fdf340a7070 comp rx=0 tx=0).stop 2024-04-02T07:31:18.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.845+0000 7fdf49a00640 1 -- 172.21.15.55:0/1426753702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf44159be0 msgr2=0x7fdf4413ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:18.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.845+0000 7fdf49a00640 1 --2- 172.21.15.55:0/1426753702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf44159be0 0x7fdf4413ac60 secure :-1 s=READY pgs=1381 cs=0 l=1 rev1=1 crypto rx=0x7fdf2c00c500 tx=0x7fdf2c00c9c0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.845+0000 7fdf49a00640 1 -- 172.21.15.55:0/1426753702 shutdown_connections 2024-04-02T07:31:18.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.845+0000 7fdf49a00640 1 --2- 172.21.15.55:0/1426753702 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf200666c0 0x7fdf20068b80 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.845+0000 7fdf49a00640 1 --2- 172.21.15.55:0/1426753702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf4415a070 0x7fdf4413b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.845+0000 7fdf49a00640 1 --2- 172.21.15.55:0/1426753702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf44159be0 0x7fdf4413ac60 unknown :-1 s=CLOSED pgs=1381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.845+0000 7fdf49a00640 1 --2- 172.21.15.55:0/1426753702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf44153ea0 0x7fdf441519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:18.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.845+0000 7fdf49a00640 1 -- 172.21.15.55:0/1426753702 >> 172.21.15.55:0/1426753702 conn(0x7fdf44066080 msgr2=0x7fdf44134b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:18.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.849+0000 7fdf49a00640 1 -- 172.21.15.55:0/1426753702 shutdown_connections 2024-04-02T07:31:18.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:18.849+0000 7fdf49a00640 1 -- 172.21.15.55:0/1426753702 wait complete. 2024-04-02T07:31:18.871 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:31:19.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.009+0000 7f839ec00640 1 Processor -- start 2024-04-02T07:31:19.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.009+0000 7f839ec00640 1 -- start start 2024-04-02T07:31:19.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.009+0000 7f839ec00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f83980b2ca0 0x7f83980701f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.009+0000 7f839ec00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8398159d50 0x7f83980cd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.009+0000 7f839ec00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83980b43a0 con 0x7f8398153530 2024-04-02T07:31:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.009+0000 7f839ec00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83980cce40 con 0x7f83980b2ca0 2024-04-02T07:31:19.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.009+0000 7f839ec00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83980cd0e0 con 0x7f8398159d50 2024-04-02T07:31:19.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.009+0000 7f838f400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f83980b2ca0 0x7f83980701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:19.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.009+0000 7f838f400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f83980b2ca0 0x7f83980701f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:36958/0 (socket says 172.21.15.55:36958) 2024-04-02T07:31:19.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.009+0000 7f838f400640 1 -- 172.21.15.55:0/1056336313 learned_addr learned my addr 172.21.15.55:0/1056336313 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:19.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.009+0000 7f839cc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8398159d50 0x7f83980cd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:19.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.009+0000 7f8397e00640 1 --1- 172.21.15.55:0/1056336313 >> v1:172.21.15.106:6789/0 conn(0x7f8398153530 0x7f83980b2590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:56048/0 (socket says 172.21.15.55:56048) 2024-04-02T07:31:19.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.009+0000 7f838f400640 1 -- 172.21.15.55:0/1056336313 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8398159d50 msgr2=0x7f83980cd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:19.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.009+0000 7f838f400640 1 --2- 172.21.15.55:0/1056336313 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8398159d50 0x7f83980cd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.009+0000 7f838f400640 1 -- 172.21.15.55:0/1056336313 >> v1:172.21.15.106:6789/0 conn(0x7f8398153530 legacy=0x7f83980b2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:19.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.009+0000 7f838f400640 1 -- 172.21.15.55:0/1056336313 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839815a270 con 0x7f83980b2ca0 2024-04-02T07:31:19.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.009+0000 7f839cc00640 1 --2- 172.21.15.55:0/1056336313 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8398159d50 0x7f83980cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:31:19.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.009+0000 7f8397400640 1 -- 172.21.15.55:0/1056336313 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3559274345 0 0) 0x7f83980b43a0 con 0x7f8398153530 2024-04-02T07:31:19.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.013+0000 7f838f400640 1 --2- 172.21.15.55:0/1056336313 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83980b2ca0 0x7f83980701f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8380009870 tx=0x7f838001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b8499f5ef1f19a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:19.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.013+0000 7f8397400640 1 -- 172.21.15.55:0/1056336313 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83800ab600 con 0x7f83980b2ca0 2024-04-02T07:31:19.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.013+0000 7f8397400640 1 -- 172.21.15.55:0/1056336313 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83800a7050 con 0x7f83980b2ca0 2024-04-02T07:31:19.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.013+0000 7f8397400640 1 -- 172.21.15.55:0/1056336313 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83800ab980 con 0x7f83980b2ca0 2024-04-02T07:31:19.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.013+0000 7f839ec00640 1 -- 172.21.15.55:0/1056336313 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83980b2ca0 msgr2=0x7f83980701f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:19.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.013+0000 7f839ec00640 1 --2- 172.21.15.55:0/1056336313 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83980b2ca0 0x7f83980701f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8380009870 tx=0x7f838001c4d0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.013+0000 7f839ec00640 1 -- 172.21.15.55:0/1056336313 shutdown_connections 2024-04-02T07:31:19.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.013+0000 7f839ec00640 1 --2- 172.21.15.55:0/1056336313 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8398159d50 0x7f83980cd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.013+0000 7f839ec00640 1 --2- 172.21.15.55:0/1056336313 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f83980b2ca0 0x7f83980701f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.013+0000 7f839ec00640 1 -- 172.21.15.55:0/1056336313 >> 172.21.15.55:0/1056336313 conn(0x7f8398069d90 msgr2=0x7f839806a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:19.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.013+0000 7f839ec00640 1 -- 172.21.15.55:0/1056336313 shutdown_connections 2024-04-02T07:31:19.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.013+0000 7f839ec00640 1 -- 172.21.15.55:0/1056336313 wait complete. 2024-04-02T07:31:19.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f839ec00640 1 Processor -- start 2024-04-02T07:31:19.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f839ec00640 1 -- start start 2024-04-02T07:31:19.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f839ec00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83980b2ca0 0x7f839815d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f839ec00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8398153530 0x7f839814fb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f839ec00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8398159d50 0x7f839813a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f839ec00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8398150060 con 0x7f83980b2ca0 2024-04-02T07:31:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f839ec00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f839813a550 con 0x7f8398159d50 2024-04-02T07:31:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f839ec00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8398150240 con 0x7f8398153530 2024-04-02T07:31:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f8397e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83980b2ca0 0x7f839815d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f8397e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83980b2ca0 0x7f839815d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52644/0 (socket says 172.21.15.55:52644) 2024-04-02T07:31:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f8397e00640 1 -- 172.21.15.55:0/3135887392 learned_addr learned my addr 172.21.15.55:0/3135887392 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f839cc00640 1 --2- 172.21.15.55:0/3135887392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8398159d50 0x7f839813a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f838f400640 1 --2- 172.21.15.55:0/3135887392 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8398153530 0x7f839814fb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f8397e00640 1 -- 172.21.15.55:0/3135887392 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8398153530 msgr2=0x7f839814fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f8397e00640 1 --2- 172.21.15.55:0/3135887392 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8398153530 0x7f839814fb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f8397e00640 1 -- 172.21.15.55:0/3135887392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8398159d50 msgr2=0x7f839813a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:19.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f8397e00640 1 --2- 172.21.15.55:0/3135887392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8398159d50 0x7f839813a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f8397e00640 1 -- 172.21.15.55:0/3135887392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8390009a70 con 0x7f83980b2ca0 2024-04-02T07:31:19.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f8397e00640 1 --2- 172.21.15.55:0/3135887392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83980b2ca0 0x7f839815d330 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f83880011f0 tx=0x7f838800c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:19.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f8394c00640 1 -- 172.21.15.55:0/3135887392 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83880074e0 con 0x7f83980b2ca0 2024-04-02T07:31:19.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f8394c00640 1 -- 172.21.15.55:0/3135887392 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8388007640 con 0x7f83980b2ca0 2024-04-02T07:31:19.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f8394c00640 1 -- 172.21.15.55:0/3135887392 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8388004a10 con 0x7f83980b2ca0 2024-04-02T07:31:19.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f839ec00640 1 -- 172.21.15.55:0/3135887392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83800094d0 con 0x7f83980b2ca0 2024-04-02T07:31:19.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.017+0000 7f839ec00640 1 -- 172.21.15.55:0/3135887392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f839815cb30 con 0x7f83980b2ca0 2024-04-02T07:31:19.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.021+0000 7f839ec00640 1 -- 172.21.15.55:0/3135887392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8398066c90 con 0x7f83980b2ca0 2024-04-02T07:31:19.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.021+0000 7f8394c00640 1 -- 172.21.15.55:0/3135887392 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8388004b70 con 0x7f83980b2ca0 2024-04-02T07:31:19.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.021+0000 7f8394c00640 1 --2- 172.21.15.55:0/3135887392 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8374066690 0x7f8374068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:19.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.021+0000 7f8394c00640 1 -- 172.21.15.55:0/3135887392 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f8388083530 con 0x7f83980b2ca0 2024-04-02T07:31:19.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.021+0000 7f838f400640 1 --2- 172.21.15.55:0/3135887392 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8374066690 0x7f8374068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:19.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.021+0000 7f838f400640 1 --2- 172.21.15.55:0/3135887392 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8374066690 0x7f8374068b50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f83800ad000 tx=0x7f83800a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:19.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.025+0000 7f8394c00640 1 -- 172.21.15.55:0/3135887392 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f83880507e0 con 0x7f83980b2ca0 2024-04-02T07:31:19.222 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.221+0000 7f839ec00640 1 -- 172.21.15.55:0/3135887392 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8398071640 con 0x7f83980b2ca0 2024-04-02T07:31:19.223 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.221+0000 7f8394c00640 1 -- 172.21.15.55:0/3135887392 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 73 v73) v1 ==== 94+0+4743 (secure 0 0 0) 0x7f8388018090 con 0x7f83980b2ca0 2024-04-02T07:31:19.223 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:19.223 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":73,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2209852195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2209852195},{"type":"v1","addr":"172.21.15.55:6835","nonce":2209852195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1897181831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1897181831},{"type":"v1","addr":"172.21.15.106:6835","nonce":1897181831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1894364429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1894364429},{"type":"v1","addr":"172.21.15.106:6837","nonce":1894364429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":73,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:28:53.919977+0000","modified":"2024-04-02T07:30:38.894246+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":91,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8052},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8052":{"gid":8052,"name":"a","rank":0,"incarnation":70,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6834/2658455613","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":2658455613},{"type":"v1","addr":"172.21.15.55:6834","nonce":2658455613}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2024-04-02T07:31:19.224 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 73 2024-04-02T07:31:19.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.225+0000 7f839ec00640 1 -- 172.21.15.55:0/3135887392 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8374066690 msgr2=0x7f8374068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:19.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.225+0000 7f839ec00640 1 --2- 172.21.15.55:0/3135887392 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8374066690 0x7f8374068b50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f83800ad000 tx=0x7f83800a6000 comp rx=0 tx=0).stop 2024-04-02T07:31:19.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.225+0000 7f839ec00640 1 -- 172.21.15.55:0/3135887392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83980b2ca0 msgr2=0x7f839815d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:19.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.225+0000 7f839ec00640 1 --2- 172.21.15.55:0/3135887392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83980b2ca0 0x7f839815d330 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7f83880011f0 tx=0x7f838800c9b0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.225+0000 7f839ec00640 1 -- 172.21.15.55:0/3135887392 shutdown_connections 2024-04-02T07:31:19.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.225+0000 7f839ec00640 1 --2- 172.21.15.55:0/3135887392 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8374066690 0x7f8374068b50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.225+0000 7f839ec00640 1 --2- 172.21.15.55:0/3135887392 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8398159d50 0x7f839813a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.225+0000 7f839ec00640 1 --2- 172.21.15.55:0/3135887392 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8398153530 0x7f839814fb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.225+0000 7f839ec00640 1 --2- 172.21.15.55:0/3135887392 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f83980b2ca0 0x7f839815d330 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.225+0000 7f839ec00640 1 -- 172.21.15.55:0/3135887392 >> 172.21.15.55:0/3135887392 conn(0x7f8398069d90 msgr2=0x7f8398152600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:19.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.225+0000 7f839ec00640 1 -- 172.21.15.55:0/3135887392 shutdown_connections 2024-04-02T07:31:19.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.225+0000 7f839ec00640 1 -- 172.21.15.55:0/3135887392 wait complete. 2024-04-02T07:31:19.244 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:31:19.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.381+0000 7f0a0b400640 1 Processor -- start 2024-04-02T07:31:19.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.381+0000 7f0a0b400640 1 -- start start 2024-04-02T07:31:19.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.385+0000 7f0a0b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f0a040c4120 0x7f0a040b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:19.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.385+0000 7f0a0b400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0a040b36f0 0x7f0a0413d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:19.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.385+0000 7f0a0b400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0413d0c0 con 0x7f0a04153ea0 2024-04-02T07:31:19.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.385+0000 7f0a0b400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0415a2f0 con 0x7f0a040b36f0 2024-04-02T07:31:19.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.385+0000 7f0a0b400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a040b3b20 con 0x7f0a040c4120 2024-04-02T07:31:19.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.385+0000 7f0a09400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0a040b36f0 0x7f0a0413d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:19.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.385+0000 7f0a09400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0a040b36f0 0x7f0a0413d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52652/0 (socket says 172.21.15.55:52652) 2024-04-02T07:31:19.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.385+0000 7f0a09400640 1 -- 172.21.15.55:0/2169281513 learned_addr learned my addr 172.21.15.55:0/2169281513 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:19.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.385+0000 7f0a03e00640 1 --2- 172.21.15.55:0/2169281513 >> v2:172.21.15.106:3300/0 conn(0x7f0a040c4120 0x7f0a040b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:19.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.385+0000 7f0a09400640 1 -- 172.21.15.55:0/2169281513 >> v2:172.21.15.106:3300/0 conn(0x7f0a040c4120 msgr2=0x7f0a040b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:19.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.385+0000 7f0a09400640 1 --2- 172.21.15.55:0/2169281513 >> v2:172.21.15.106:3300/0 conn(0x7f0a040c4120 0x7f0a040b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.385+0000 7f0a09400640 1 -- 172.21.15.55:0/2169281513 >> v1:172.21.15.106:6789/0 conn(0x7f0a04153ea0 legacy=0x7f0a04159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:19.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.385+0000 7f0a09400640 1 -- 172.21.15.55:0/2169281513 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0415a4f0 con 0x7f0a040b36f0 2024-04-02T07:31:19.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.389+0000 7f0a09400640 1 --2- 172.21.15.55:0/2169281513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a040b36f0 0x7f0a0413d550 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f0a0406d470 tx=0x7f09fc01ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27a0e0f2c7a0187 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:19.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.389+0000 7f0a03400640 1 -- 172.21.15.55:0/2169281513 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc00b2d0 con 0x7f0a040b36f0 2024-04-02T07:31:19.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.389+0000 7f0a03400640 1 -- 172.21.15.55:0/2169281513 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc00b430 con 0x7f0a040b36f0 2024-04-02T07:31:19.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.389+0000 7f0a03400640 1 -- 172.21.15.55:0/2169281513 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc0a7bf0 con 0x7f0a040b36f0 2024-04-02T07:31:19.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.389+0000 7f0a0b400640 1 -- 172.21.15.55:0/2169281513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a040b36f0 msgr2=0x7f0a0413d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:19.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.389+0000 7f0a0b400640 1 --2- 172.21.15.55:0/2169281513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a040b36f0 0x7f0a0413d550 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f0a0406d470 tx=0x7f09fc01ebf0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.389+0000 7f0a0b400640 1 -- 172.21.15.55:0/2169281513 shutdown_connections 2024-04-02T07:31:19.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.389+0000 7f0a0b400640 1 --2- 172.21.15.55:0/2169281513 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a040b36f0 0x7f0a0413d550 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.389+0000 7f0a0b400640 1 --2- 172.21.15.55:0/2169281513 >> v2:172.21.15.106:3300/0 conn(0x7f0a040c4120 0x7f0a040b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.389+0000 7f0a0b400640 1 -- 172.21.15.55:0/2169281513 >> 172.21.15.55:0/2169281513 conn(0x7f0a04066080 msgr2=0x7f0a04069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:19.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.389+0000 7f0a0b400640 1 -- 172.21.15.55:0/2169281513 shutdown_connections 2024-04-02T07:31:19.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.389+0000 7f0a0b400640 1 -- 172.21.15.55:0/2169281513 wait complete. 2024-04-02T07:31:19.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.389+0000 7f0a0b400640 1 Processor -- start 2024-04-02T07:31:19.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.389+0000 7f0a0b400640 1 -- start start 2024-04-02T07:31:19.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.389+0000 7f0a0b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a040b36f0 0x7f0a0414f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:19.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.389+0000 7f0a0b400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a040c4120 0x7f0a0414cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:19.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.389+0000 7f0a0b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a04153ea0 0x7f0a04138060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:19.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.389+0000 7f0a0b400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0415b5f0 con 0x7f0a040b36f0 2024-04-02T07:31:19.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.389+0000 7f0a0b400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0415b310 con 0x7f0a04153ea0 2024-04-02T07:31:19.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.389+0000 7f0a0b400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a04138fa0 con 0x7f0a040c4120 2024-04-02T07:31:19.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.393+0000 7f0a08a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a040b36f0 0x7f0a0414f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:19.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.393+0000 7f0a08a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a040b36f0 0x7f0a0414f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52654/0 (socket says 172.21.15.55:52654) 2024-04-02T07:31:19.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.393+0000 7f0a08a00640 1 -- 172.21.15.55:0/489657045 learned_addr learned my addr 172.21.15.55:0/489657045 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:19.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.393+0000 7f0a03e00640 1 --2- 172.21.15.55:0/489657045 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a040c4120 0x7f0a0414cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:19.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.393+0000 7f0a09400640 1 --2- 172.21.15.55:0/489657045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a04153ea0 0x7f0a04138060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:19.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.393+0000 7f0a08a00640 1 -- 172.21.15.55:0/489657045 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a040c4120 msgr2=0x7f0a0414cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:19.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.393+0000 7f0a08a00640 1 --2- 172.21.15.55:0/489657045 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a040c4120 0x7f0a0414cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.393+0000 7f0a08a00640 1 -- 172.21.15.55:0/489657045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a04153ea0 msgr2=0x7f0a04138060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:19.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.393+0000 7f0a08a00640 1 --2- 172.21.15.55:0/489657045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a04153ea0 0x7f0a04138060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.393+0000 7f0a08a00640 1 -- 172.21.15.55:0/489657045 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09fc00bd40 con 0x7f0a040b36f0 2024-04-02T07:31:19.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.393+0000 7f0a08a00640 1 --2- 172.21.15.55:0/489657045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a040b36f0 0x7f0a0414f770 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f09f800c3c0 tx=0x7f09f800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:19.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.393+0000 7f0a00c00640 1 -- 172.21.15.55:0/489657045 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f80052d0 con 0x7f0a040b36f0 2024-04-02T07:31:19.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.393+0000 7f0a00c00640 1 -- 172.21.15.55:0/489657045 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09f8005430 con 0x7f0a040b36f0 2024-04-02T07:31:19.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.393+0000 7f0a00c00640 1 -- 172.21.15.55:0/489657045 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09f8003840 con 0x7f0a040b36f0 2024-04-02T07:31:19.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.393+0000 7f0a0b400640 1 -- 172.21.15.55:0/489657045 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a04139280 con 0x7f0a040b36f0 2024-04-02T07:31:19.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.393+0000 7f0a0b400640 1 -- 172.21.15.55:0/489657045 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0413c420 con 0x7f0a040b36f0 2024-04-02T07:31:19.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.393+0000 7f0a0b400640 1 -- 172.21.15.55:0/489657045 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a040cdea0 con 0x7f0a040b36f0 2024-04-02T07:31:19.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.393+0000 7f0a00c00640 1 -- 172.21.15.55:0/489657045 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f09f80039a0 con 0x7f0a040b36f0 2024-04-02T07:31:19.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.397+0000 7f0a00c00640 1 --2- 172.21.15.55:0/489657045 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f09e4066690 0x7f09e4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:19.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.397+0000 7f0a00c00640 1 -- 172.21.15.55:0/489657045 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f09f80836f0 con 0x7f0a040b36f0 2024-04-02T07:31:19.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.397+0000 7f0a03e00640 1 --2- 172.21.15.55:0/489657045 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f09e4066690 0x7f09e4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:19.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.397+0000 7f0a03e00640 1 --2- 172.21.15.55:0/489657045 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f09e4066690 0x7f09e4068b50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0a04071ba0 tx=0x7f09f0009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:19.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.397+0000 7f0a00c00640 1 -- 172.21.15.55:0/489657045 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0a040cdea0 con 0x7f0a040b36f0 2024-04-02T07:31:19.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.561+0000 7f0a0b400640 1 -- 172.21.15.55:0/489657045 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a040cdea0 con 0x7f0a040b36f0 2024-04-02T07:31:19.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.565+0000 7f0a00c00640 1 -- 172.21.15.55:0/489657045 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) v1 ==== 74+0+16400 (secure 0 0 0) 0x7f0a040cdea0 con 0x7f0a040b36f0 2024-04-02T07:31:19.566 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:19.566 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:30:34.869319+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:28:52.464907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"86","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-04-02T07:28:52.918058+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.c","mappings":[{"from":1,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6834/821922065":"2024-04-03T07:30:34.869296+0000","172.21.15.55:6832/821922065":"2024-04-03T07:30:34.869296+0000","172.21.15.106:6837/2582023800":"2024-04-03T07:29:14.039921+0000","172.21.15.106:6836/2582023800":"2024-04-03T07:29:14.039921+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:31:19.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.565+0000 7f0a0b400640 1 -- 172.21.15.55:0/489657045 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f09e4066690 msgr2=0x7f09e4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:19.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.565+0000 7f0a0b400640 1 --2- 172.21.15.55:0/489657045 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f09e4066690 0x7f09e4068b50 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f0a04071ba0 tx=0x7f09f0009190 comp rx=0 tx=0).stop 2024-04-02T07:31:19.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.565+0000 7f0a0b400640 1 -- 172.21.15.55:0/489657045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a040b36f0 msgr2=0x7f0a0414f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.565+0000 7f0a0b400640 1 --2- 172.21.15.55:0/489657045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a040b36f0 0x7f0a0414f770 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f09f800c3c0 tx=0x7f09f800c880 comp rx=0 tx=0).stop 2024-04-02T07:31:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.565+0000 7f0a0b400640 1 -- 172.21.15.55:0/489657045 shutdown_connections 2024-04-02T07:31:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.565+0000 7f0a0b400640 1 --2- 172.21.15.55:0/489657045 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f09e4066690 0x7f09e4068b50 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.565+0000 7f0a0b400640 1 --2- 172.21.15.55:0/489657045 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a04153ea0 0x7f0a04138060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.565+0000 7f0a0b400640 1 --2- 172.21.15.55:0/489657045 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a040c4120 0x7f0a0414cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.565+0000 7f0a0b400640 1 --2- 172.21.15.55:0/489657045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a040b36f0 0x7f0a0414f770 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.565+0000 7f0a0b400640 1 -- 172.21.15.55:0/489657045 >> 172.21.15.55:0/489657045 conn(0x7f0a04066080 msgr2=0x7f0a04071060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.565+0000 7f0a0b400640 1 -- 172.21.15.55:0/489657045 shutdown_connections 2024-04-02T07:31:19.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.565+0000 7f0a0b400640 1 -- 172.21.15.55:0/489657045 wait complete. 2024-04-02T07:31:19.587 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-02T07:31:19.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.729+0000 7f3749e00640 1 Processor -- start 2024-04-02T07:31:19.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.729+0000 7f3749e00640 1 -- start start 2024-04-02T07:31:19.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.729+0000 7f3749e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f37440b1650 0x7f37440cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:19.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.729+0000 7f3749e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37440cb1f0 0x7f37440cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:19.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.729+0000 7f3749e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37440ce990 con 0x7f3744160230 2024-04-02T07:31:19.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.729+0000 7f3749e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3744160610 con 0x7f37440b1650 2024-04-02T07:31:19.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.729+0000 7f3749e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37440cf4f0 con 0x7f37440cb1f0 2024-04-02T07:31:19.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.729+0000 7f3742000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f37440b1650 0x7f37440cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:19.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.729+0000 7f3743400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37440cb1f0 0x7f37440cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:19.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.729+0000 7f3742000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f37440b1650 0x7f37440cacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:36994/0 (socket says 172.21.15.55:36994) 2024-04-02T07:31:19.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.729+0000 7f3742000640 1 -- 172.21.15.55:0/2348241902 learned_addr learned my addr 172.21.15.55:0/2348241902 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:19.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.729+0000 7f3742a00640 1 --1- 172.21.15.55:0/2348241902 >> v1:172.21.15.106:6789/0 conn(0x7f3744160230 0x7f374406bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:56062/0 (socket says 172.21.15.55:56062) 2024-04-02T07:31:19.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.729+0000 7f3742000640 1 -- 172.21.15.55:0/2348241902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37440cb1f0 msgr2=0x7f37440cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:19.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.729+0000 7f3742000640 1 --2- 172.21.15.55:0/2348241902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37440cb1f0 0x7f37440cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.729+0000 7f3742000640 1 -- 172.21.15.55:0/2348241902 >> v1:172.21.15.106:6789/0 conn(0x7f3744160230 legacy=0x7f374406bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:19.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.729+0000 7f3742000640 1 -- 172.21.15.55:0/2348241902 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37440cebc0 con 0x7f37440b1650 2024-04-02T07:31:19.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.729+0000 7f3741600640 1 -- 172.21.15.55:0/2348241902 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 195873906 0 0) 0x7f37440ce990 con 0x7f3744160230 2024-04-02T07:31:19.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.733+0000 7f3742000640 1 --2- 172.21.15.55:0/2348241902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37440b1650 0x7f37440cacb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3730009870 tx=0x7f373001c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e190f541e16b22f1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:19.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.733+0000 7f3741600640 1 -- 172.21.15.55:0/2348241902 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37300ab600 con 0x7f37440b1650 2024-04-02T07:31:19.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.733+0000 7f3741600640 1 -- 172.21.15.55:0/2348241902 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37300a7050 con 0x7f37440b1650 2024-04-02T07:31:19.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.733+0000 7f3741600640 1 -- 172.21.15.55:0/2348241902 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37300ab980 con 0x7f37440b1650 2024-04-02T07:31:19.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.733+0000 7f3749e00640 1 -- 172.21.15.55:0/2348241902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37440b1650 msgr2=0x7f37440cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:19.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.733+0000 7f3749e00640 1 --2- 172.21.15.55:0/2348241902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37440b1650 0x7f37440cacb0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f3730009870 tx=0x7f373001c4d0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.733+0000 7f3749e00640 1 -- 172.21.15.55:0/2348241902 shutdown_connections 2024-04-02T07:31:19.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.733+0000 7f3749e00640 1 --2- 172.21.15.55:0/2348241902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f37440cb1f0 0x7f37440cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.733+0000 7f3749e00640 1 --2- 172.21.15.55:0/2348241902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37440b1650 0x7f37440cacb0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.733+0000 7f3749e00640 1 -- 172.21.15.55:0/2348241902 >> 172.21.15.55:0/2348241902 conn(0x7f37440b2150 msgr2=0x7f37440b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:19.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.733+0000 7f3749e00640 1 -- 172.21.15.55:0/2348241902 shutdown_connections 2024-04-02T07:31:19.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.733+0000 7f3749e00640 1 -- 172.21.15.55:0/2348241902 wait complete. 2024-04-02T07:31:19.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.733+0000 7f3749e00640 1 Processor -- start 2024-04-02T07:31:19.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3749e00640 1 -- start start 2024-04-02T07:31:19.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3749e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37440b1650 0x7f37440b4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:19.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3749e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37440cb1f0 0x7f374415bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:19.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3749e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3744160230 0x7f374415c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:19.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3749e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37440c7730 con 0x7f37440cb1f0 2024-04-02T07:31:19.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3749e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374415ba50 con 0x7f37440b1650 2024-04-02T07:31:19.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3749e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37440c9f50 con 0x7f3744160230 2024-04-02T07:31:19.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3742000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37440cb1f0 0x7f374415bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:19.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3742000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37440cb1f0 0x7f374415bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52670/0 (socket says 172.21.15.55:52670) 2024-04-02T07:31:19.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3742000640 1 -- 172.21.15.55:0/3572017766 learned_addr learned my addr 172.21.15.55:0/3572017766 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:19.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3743400640 1 --2- 172.21.15.55:0/3572017766 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3744160230 0x7f374415c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:19.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3742a00640 1 --2- 172.21.15.55:0/3572017766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37440b1650 0x7f37440b4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:19.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3742000640 1 -- 172.21.15.55:0/3572017766 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3744160230 msgr2=0x7f374415c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:19.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3742000640 1 --2- 172.21.15.55:0/3572017766 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3744160230 0x7f374415c450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3742000640 1 -- 172.21.15.55:0/3572017766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37440b1650 msgr2=0x7f37440b4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:19.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3742000640 1 --2- 172.21.15.55:0/3572017766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37440b1650 0x7f37440b4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3742000640 1 -- 172.21.15.55:0/3572017766 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37300094d0 con 0x7f37440cb1f0 2024-04-02T07:31:19.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3743400640 1 --2- 172.21.15.55:0/3572017766 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3744160230 0x7f374415c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:19.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3742000640 1 --2- 172.21.15.55:0/3572017766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37440cb1f0 0x7f374415bf10 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f37300ae040 tx=0x7f373001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:19.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f373b400640 1 -- 172.21.15.55:0/3572017766 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37300b6420 con 0x7f37440cb1f0 2024-04-02T07:31:19.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f373b400640 1 -- 172.21.15.55:0/3572017766 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37300b65a0 con 0x7f37440cb1f0 2024-04-02T07:31:19.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f373b400640 1 -- 172.21.15.55:0/3572017766 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37300b6950 con 0x7f37440cb1f0 2024-04-02T07:31:19.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3749e00640 1 -- 172.21.15.55:0/3572017766 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37440ca230 con 0x7f37440cb1f0 2024-04-02T07:31:19.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3749e00640 1 -- 172.21.15.55:0/3572017766 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37441525f0 con 0x7f37440cb1f0 2024-04-02T07:31:19.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.737+0000 7f3749e00640 1 -- 172.21.15.55:0/3572017766 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3744066c90 con 0x7f37440cb1f0 2024-04-02T07:31:19.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.741+0000 7f373b400640 1 -- 172.21.15.55:0/3572017766 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f37300b2040 con 0x7f37440cb1f0 2024-04-02T07:31:19.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.741+0000 7f373b400640 1 --2- 172.21.15.55:0/3572017766 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3724066690 0x7f3724068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:19.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.741+0000 7f373b400640 1 -- 172.21.15.55:0/3572017766 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5910+0+0 (secure 0 0 0) 0x7f373011e610 con 0x7f37440cb1f0 2024-04-02T07:31:19.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.741+0000 7f3742a00640 1 --2- 172.21.15.55:0/3572017766 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3724066690 0x7f3724068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:19.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.741+0000 7f3742a00640 1 --2- 172.21.15.55:0/3572017766 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3724066690 0x7f3724068b50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3734007fd0 tx=0x7f3734007ee0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:19.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.745+0000 7f373b400640 1 -- 172.21.15.55:0/3572017766 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f37300eb8a0 con 0x7f37440cb1f0 2024-04-02T07:31:19.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.937+0000 7f3749e00640 1 -- 172.21.15.55:0/3572017766 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f37440b2f40 con 0x7f37440cb1f0 2024-04-02T07:31:19.939 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-02T07:31:19.937+0000 7f8f18800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-02T07:31:19.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.949+0000 7f373b400640 1 -- 172.21.15.55:0/3572017766 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v74) v1 ==== 161+0+0 (secure 0 0 0) 0x7f37300a4f00 con 0x7f37440cb1f0 2024-04-02T07:31:19.952 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-02T07:31:19.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.953+0000 7f3749e00640 1 -- 172.21.15.55:0/3572017766 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3724066690 msgr2=0x7f3724068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:19.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.953+0000 7f3749e00640 1 --2- 172.21.15.55:0/3572017766 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3724066690 0x7f3724068b50 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f3734007fd0 tx=0x7f3734007ee0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.953+0000 7f3749e00640 1 -- 172.21.15.55:0/3572017766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37440cb1f0 msgr2=0x7f374415bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:19.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.953+0000 7f3749e00640 1 --2- 172.21.15.55:0/3572017766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37440cb1f0 0x7f374415bf10 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f37300ae040 tx=0x7f373001ad10 comp rx=0 tx=0).stop 2024-04-02T07:31:19.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.953+0000 7f3749e00640 1 -- 172.21.15.55:0/3572017766 shutdown_connections 2024-04-02T07:31:19.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.953+0000 7f3749e00640 1 --2- 172.21.15.55:0/3572017766 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3744160230 0x7f374415c450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.953+0000 7f3749e00640 1 --2- 172.21.15.55:0/3572017766 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37440cb1f0 0x7f374415bf10 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.953+0000 7f3749e00640 1 --2- 172.21.15.55:0/3572017766 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3724066690 0x7f3724068b50 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.953+0000 7f3749e00640 1 --2- 172.21.15.55:0/3572017766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f37440b1650 0x7f37440b4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:19.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.953+0000 7f3749e00640 1 -- 172.21.15.55:0/3572017766 >> 172.21.15.55:0/3572017766 conn(0x7f37440b2150 msgr2=0x7f374406f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:19.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.953+0000 7f3749e00640 1 -- 172.21.15.55:0/3572017766 shutdown_connections 2024-04-02T07:31:19.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:19.953+0000 7f3749e00640 1 -- 172.21.15.55:0/3572017766 wait complete. 2024-04-02T07:31:19.962 INFO:tasks.ceph.mds.a.smithi055.stderr: -2157> 2024-04-02T07:30:40.886+0000 7fe9afa00640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:31:19.964 INFO:tasks.ceph.mds.a.smithi055.stderr: -1792> 2024-04-02T07:30:42.366+0000 7fe9ab400640 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000001 [...2,head] /dir/file auth v1 ap=1 DIRTYPARENT s=0 nl=2 n() (iversion lock) | dirtyparent=1 authpin=1 scrubqueue=0 0x55cbe304c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(13)0x10000000001:[<0x10000000000/file v6>,<0x1/dir v13>]//[]","memoryvalue":"(13)0x10000000001:[<0x10000000000/file v1>,<0x1/dir v21>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-04-02T07:31:19.979 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-02T07:31:20.012 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-02T07:31:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.121+0000 7fc845200640 1 Processor -- start 2024-04-02T07:31:20.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.121+0000 7fc845200640 1 -- start start 2024-04-02T07:31:20.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.121+0000 7fc845200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc8400ceb50 0x7fc8400cef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:20.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.121+0000 7fc845200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc8400b0800 0x7fc8400b0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:20.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.121+0000 7fc845200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8400cb0e0 con 0x7fc8400cb5a0 2024-04-02T07:31:20.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.121+0000 7fc845200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8400cf470 con 0x7fc8400ceb50 2024-04-02T07:31:20.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.121+0000 7fc845200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8400b1560 con 0x7fc8400b0800 2024-04-02T07:31:20.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.121+0000 7fc83de00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc8400ceb50 0x7fc8400cef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:20.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.121+0000 7fc83de00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc8400ceb50 0x7fc8400cef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52700/0 (socket says 172.21.15.55:52700) 2024-04-02T07:31:20.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.121+0000 7fc83e800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc8400cb5a0 0x7fc8400cba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34158/0 (socket says 172.21.15.55:34158) 2024-04-02T07:31:20.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.121+0000 7fc83de00640 1 -- 172.21.15.55:0/691811729 learned_addr learned my addr 172.21.15.55:0/691811729 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:20.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.121+0000 7fc835400640 1 --2- 172.21.15.55:0/691811729 >> v2:172.21.15.106:3300/0 conn(0x7fc8400b0800 0x7fc8400b0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:20.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.121+0000 7fc83de00640 1 -- 172.21.15.55:0/691811729 >> v2:172.21.15.106:3300/0 conn(0x7fc8400b0800 msgr2=0x7fc8400b0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:20.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.121+0000 7fc83de00640 1 --2- 172.21.15.55:0/691811729 >> v2:172.21.15.106:3300/0 conn(0x7fc8400b0800 0x7fc8400b0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:20.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.121+0000 7fc83de00640 1 -- 172.21.15.55:0/691811729 >> v1:172.21.15.55:6789/0 conn(0x7fc8400cb5a0 legacy=0x7fc8400cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:20.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.121+0000 7fc83de00640 1 -- 172.21.15.55:0/691811729 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8400b1840 con 0x7fc8400ceb50 2024-04-02T07:31:20.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.121+0000 7fc83d400640 1 -- 172.21.15.55:0/691811729 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2485001330 0 0) 0x7fc8400cb0e0 con 0x7fc8400cb5a0 2024-04-02T07:31:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.125+0000 7fc83de00640 1 --2- 172.21.15.55:0/691811729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400ceb50 0x7fc8400cef30 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fc8400b3280 tx=0x7fc83001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdafddf0d36b4a6d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.125+0000 7fc83d400640 1 -- 172.21.15.55:0/691811729 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8300ad680 con 0x7fc8400ceb50 2024-04-02T07:31:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.125+0000 7fc83d400640 1 -- 172.21.15.55:0/691811729 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8300ad7e0 con 0x7fc8400ceb50 2024-04-02T07:31:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.125+0000 7fc83d400640 1 -- 172.21.15.55:0/691811729 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8300adb70 con 0x7fc8400ceb50 2024-04-02T07:31:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.125+0000 7fc845200640 1 -- 172.21.15.55:0/691811729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400ceb50 msgr2=0x7fc8400cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.125+0000 7fc845200640 1 --2- 172.21.15.55:0/691811729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400ceb50 0x7fc8400cef30 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fc8400b3280 tx=0x7fc83001c490 comp rx=0 tx=0).stop 2024-04-02T07:31:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.125+0000 7fc845200640 1 -- 172.21.15.55:0/691811729 shutdown_connections 2024-04-02T07:31:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.125+0000 7fc845200640 1 --2- 172.21.15.55:0/691811729 >> v2:172.21.15.106:3300/0 conn(0x7fc8400b0800 0x7fc8400b0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.125+0000 7fc845200640 1 --2- 172.21.15.55:0/691811729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400ceb50 0x7fc8400cef30 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:20.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.125+0000 7fc845200640 1 -- 172.21.15.55:0/691811729 >> 172.21.15.55:0/691811729 conn(0x7fc8400d0700 msgr2=0x7fc8400d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:20.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.125+0000 7fc845200640 1 -- 172.21.15.55:0/691811729 shutdown_connections 2024-04-02T07:31:20.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.125+0000 7fc845200640 1 -- 172.21.15.55:0/691811729 wait complete. 2024-04-02T07:31:20.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc845200640 1 Processor -- start 2024-04-02T07:31:20.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc845200640 1 -- start start 2024-04-02T07:31:20.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc845200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc8400b0800 0x7fc8401548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:20.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc845200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400cb5a0 0x7fc8400c4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:20.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc845200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc8400ceb50 0x7fc84006c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:20.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc845200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400add20 con 0x7fc8400cb5a0 2024-04-02T07:31:20.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc845200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400c4cf0 con 0x7fc8400ceb50 2024-04-02T07:31:20.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc845200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8400c4790 con 0x7fc8400b0800 2024-04-02T07:31:20.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc835400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400cb5a0 0x7fc8400c4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:20.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc835400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400cb5a0 0x7fc8400c4250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52714/0 (socket says 172.21.15.55:52714) 2024-04-02T07:31:20.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc835400640 1 -- 172.21.15.55:0/3460286371 learned_addr learned my addr 172.21.15.55:0/3460286371 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:20.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc83de00640 1 --2- 172.21.15.55:0/3460286371 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc8400b0800 0x7fc8401548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:20.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc83e800640 1 --2- 172.21.15.55:0/3460286371 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc8400ceb50 0x7fc84006c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:20.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc835400640 1 -- 172.21.15.55:0/3460286371 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc8400b0800 msgr2=0x7fc8401548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:20.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc835400640 1 --2- 172.21.15.55:0/3460286371 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc8400b0800 0x7fc8401548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:20.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc835400640 1 -- 172.21.15.55:0/3460286371 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc8400ceb50 msgr2=0x7fc84006c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:20.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc835400640 1 --2- 172.21.15.55:0/3460286371 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc8400ceb50 0x7fc84006c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:20.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc835400640 1 -- 172.21.15.55:0/3460286371 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8300094d0 con 0x7fc8400cb5a0 2024-04-02T07:31:20.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc835400640 1 --2- 172.21.15.55:0/3460286371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400cb5a0 0x7fc8400c4250 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fc82800e8a0 tx=0x7fc82800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:20.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc836a00640 1 -- 172.21.15.55:0/3460286371 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc828009510 con 0x7fc8400cb5a0 2024-04-02T07:31:20.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc836a00640 1 -- 172.21.15.55:0/3460286371 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82800c940 con 0x7fc8400cb5a0 2024-04-02T07:31:20.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc836a00640 1 -- 172.21.15.55:0/3460286371 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82800ccb0 con 0x7fc8400cb5a0 2024-04-02T07:31:20.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc845200640 1 -- 172.21.15.55:0/3460286371 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8400c4a10 con 0x7fc8400cb5a0 2024-04-02T07:31:20.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc845200640 1 -- 172.21.15.55:0/3460286371 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8400ad940 con 0x7fc8400cb5a0 2024-04-02T07:31:20.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.129+0000 7fc845200640 1 -- 172.21.15.55:0/3460286371 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc840066c90 con 0x7fc8400cb5a0 2024-04-02T07:31:20.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.133+0000 7fc836a00640 1 -- 172.21.15.55:0/3460286371 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc828013470 con 0x7fc8400cb5a0 2024-04-02T07:31:20.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.133+0000 7fc836a00640 1 --2- 172.21.15.55:0/3460286371 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc81c066690 0x7fc81c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:20.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.133+0000 7fc836a00640 1 -- 172.21.15.55:0/3460286371 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5996+0+0 (secure 0 0 0) 0x7fc828084300 con 0x7fc8400cb5a0 2024-04-02T07:31:20.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.133+0000 7fc83de00640 1 --2- 172.21.15.55:0/3460286371 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc81c066690 0x7fc81c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:20.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.133+0000 7fc83de00640 1 --2- 172.21.15.55:0/3460286371 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc81c066690 0x7fc81c068b50 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc8300af000 tx=0x7fc8300a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:20.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.137+0000 7fc836a00640 1 -- 172.21.15.55:0/3460286371 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc8280515f0 con 0x7fc8400cb5a0 2024-04-02T07:31:20.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.333+0000 7fc845200640 1 -- 172.21.15.55:0/3460286371 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc8400d1320 con 0x7fc8400cb5a0 2024-04-02T07:31:20.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.953+0000 7fc836a00640 1 -- 172.21.15.55:0/3460286371 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v75) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc828054c10 con 0x7fc8400cb5a0 2024-04-02T07:31:20.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.957+0000 7fc845200640 1 -- 172.21.15.55:0/3460286371 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc81c066690 msgr2=0x7fc81c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:20.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.957+0000 7fc845200640 1 --2- 172.21.15.55:0/3460286371 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc81c066690 0x7fc81c068b50 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fc8300af000 tx=0x7fc8300a7000 comp rx=0 tx=0).stop 2024-04-02T07:31:20.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.957+0000 7fc845200640 1 -- 172.21.15.55:0/3460286371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400cb5a0 msgr2=0x7fc8400c4250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:20.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.957+0000 7fc845200640 1 --2- 172.21.15.55:0/3460286371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400cb5a0 0x7fc8400c4250 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fc82800e8a0 tx=0x7fc82800eca0 comp rx=0 tx=0).stop 2024-04-02T07:31:20.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.957+0000 7fc845200640 1 -- 172.21.15.55:0/3460286371 shutdown_connections 2024-04-02T07:31:20.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.957+0000 7fc845200640 1 --2- 172.21.15.55:0/3460286371 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc81c066690 0x7fc81c068b50 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:20.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.957+0000 7fc845200640 1 --2- 172.21.15.55:0/3460286371 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc8400ceb50 0x7fc84006c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:20.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.957+0000 7fc845200640 1 --2- 172.21.15.55:0/3460286371 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc8400cb5a0 0x7fc8400c4250 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:20.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.957+0000 7fc845200640 1 --2- 172.21.15.55:0/3460286371 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc8400b0800 0x7fc8401548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:20.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.957+0000 7fc845200640 1 -- 172.21.15.55:0/3460286371 >> 172.21.15.55:0/3460286371 conn(0x7fc8400d0700 msgr2=0x7fc8400d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:20.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.957+0000 7fc845200640 1 -- 172.21.15.55:0/3460286371 shutdown_connections 2024-04-02T07:31:20.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:20.957+0000 7fc845200640 1 -- 172.21.15.55:0/3460286371 wait complete. 2024-04-02T07:31:20.979 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-02T07:31:21.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.173+0000 7fbb28400640 1 Processor -- start 2024-04-02T07:31:21.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.173+0000 7fbb28400640 1 -- start start 2024-04-02T07:31:21.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb28400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fbb2006d1c0 0x7fbb200b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:21.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb28400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb200b1d60 con 0x7fbb2015ce40 2024-04-02T07:31:21.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb28400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb2006c400 con 0x7fbb200afe70 2024-04-02T07:31:21.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb28400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb2006cda0 con 0x7fbb2006d1c0 2024-04-02T07:31:21.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb25a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbb2015ce40 0x7fbb200b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34166/0 (socket says 172.21.15.55:34166) 2024-04-02T07:31:21.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb25a00640 1 -- 172.21.15.55:0/732465957 learned_addr learned my addr 172.21.15.55:0/732465957 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:21.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb25000640 1 --2- 172.21.15.55:0/732465957 >> v2:172.21.15.106:3300/0 conn(0x7fbb2006d1c0 0x7fbb200b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:21.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb1fe00640 1 -- 172.21.15.55:0/732465957 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1842659007 0 0) 0x7fbb200b1d60 con 0x7fbb2015ce40 2024-04-02T07:31:21.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb1fe00640 1 -- 172.21.15.55:0/732465957 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb08005740 con 0x7fbb2015ce40 2024-04-02T07:31:21.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb1fe00640 1 -- 172.21.15.55:0/732465957 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3983539391 0 0) 0x7fbb08005740 con 0x7fbb2015ce40 2024-04-02T07:31:21.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb1fe00640 1 -- 172.21.15.55:0/732465957 >> v2:172.21.15.106:3300/0 conn(0x7fbb2006d1c0 msgr2=0x7fbb200b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:21.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb1fe00640 1 --2- 172.21.15.55:0/732465957 >> v2:172.21.15.106:3300/0 conn(0x7fbb2006d1c0 0x7fbb200b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:21.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb1fe00640 1 -- 172.21.15.55:0/732465957 >> v1:172.21.15.106:6789/0 conn(0x7fbb200afe70 legacy=0x7fbb200c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:21.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb1fe00640 1 -- 172.21.15.55:0/732465957 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb2006c6e0 con 0x7fbb2015ce40 2024-04-02T07:31:21.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb1fe00640 1 -- 172.21.15.55:0/732465957 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fbb14001680 con 0x7fbb2015ce40 2024-04-02T07:31:21.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb1fe00640 1 -- 172.21.15.55:0/732465957 >> v1:172.21.15.55:6789/0 conn(0x7fbb2015ce40 legacy=0x7fbb200b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:21.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb1fe00640 1 --2- 172.21.15.55:0/732465957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb08005b90 0x7fbb08005f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:21.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb1fe00640 1 --2- 172.21.15.55:0/732465957 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb08006590 0x7fbb08006a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:21.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb1fe00640 1 --2- 172.21.15.55:0/732465957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb08007300 0x7fbb0800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:21.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb1fe00640 1 -- 172.21.15.55:0/732465957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2006cda0 con 0x7fbb08007300 2024-04-02T07:31:21.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb1fe00640 1 -- 172.21.15.55:0/732465957 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0800e240 con 0x7fbb08005b90 2024-04-02T07:31:21.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb1fe00640 1 -- 172.21.15.55:0/732465957 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb0800e400 con 0x7fbb08006590 2024-04-02T07:31:21.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb26400640 1 --2- 172.21.15.55:0/732465957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb08007300 0x7fbb0800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:21.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb25a00640 1 --2- 172.21.15.55:0/732465957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb08005b90 0x7fbb08005f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:21.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb25000640 1 --2- 172.21.15.55:0/732465957 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb08006590 0x7fbb08006a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:21.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb26400640 1 -- 172.21.15.55:0/732465957 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb08006590 msgr2=0x7fbb08006a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:21.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb26400640 1 --2- 172.21.15.55:0/732465957 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb08006590 0x7fbb08006a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:21.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb26400640 1 -- 172.21.15.55:0/732465957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb08005b90 msgr2=0x7fbb08005f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:21.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb26400640 1 --2- 172.21.15.55:0/732465957 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb08005b90 0x7fbb08005f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:21.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.177+0000 7fbb26400640 1 -- 172.21.15.55:0/732465957 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb08005740 con 0x7fbb08007300 2024-04-02T07:31:21.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.181+0000 7fbb26400640 1 -- 172.21.15.55:0/732465957 reap_dead start 2024-04-02T07:31:21.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.181+0000 7fbb26400640 1 --2- 172.21.15.55:0/732465957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb08007300 0x7fbb0800dba0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fbb18002010 tx=0x7fbb1801c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0342905e01553ca server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:21.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.181+0000 7fbb1fe00640 1 -- 172.21.15.55:0/732465957 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb18003b80 con 0x7fbb08007300 2024-04-02T07:31:21.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.181+0000 7fbb1fe00640 1 -- 172.21.15.55:0/732465957 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb18003d00 con 0x7fbb08007300 2024-04-02T07:31:21.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.181+0000 7fbb1fe00640 1 -- 172.21.15.55:0/732465957 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb18005310 con 0x7fbb08007300 2024-04-02T07:31:21.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.181+0000 7fbb28400640 1 -- 172.21.15.55:0/732465957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb08007300 msgr2=0x7fbb0800dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:21.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.181+0000 7fbb28400640 1 --2- 172.21.15.55:0/732465957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb08007300 0x7fbb0800dba0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fbb18002010 tx=0x7fbb1801c8e0 comp rx=0 tx=0).stop 2024-04-02T07:31:21.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.181+0000 7fbb28400640 1 -- 172.21.15.55:0/732465957 shutdown_connections 2024-04-02T07:31:21.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.181+0000 7fbb28400640 1 --2- 172.21.15.55:0/732465957 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb08007300 0x7fbb0800dba0 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:21.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.181+0000 7fbb28400640 1 -- 172.21.15.55:0/732465957 >> 172.21.15.55:0/732465957 conn(0x7fbb20069d90 msgr2=0x7fbb2006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:21.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.181+0000 7fbb28400640 1 -- 172.21.15.55:0/732465957 shutdown_connections 2024-04-02T07:31:21.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.181+0000 7fbb28400640 1 -- 172.21.15.55:0/732465957 wait complete. 2024-04-02T07:31:21.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.181+0000 7fbb28400640 1 Processor -- start 2024-04-02T07:31:21.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.181+0000 7fbb28400640 1 -- start start 2024-04-02T07:31:21.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb28400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb08007300 0x7fbb2015e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:21.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb28400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb2014da90 0x7fbb200b0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:21.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb28400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb201f44e0 0x7fbb201f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:21.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb28400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb200c7330 con 0x7fbb201f44e0 2024-04-02T07:31:21.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb28400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb2015eb60 con 0x7fbb2014da90 2024-04-02T07:31:21.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb28400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb200c7510 con 0x7fbb08007300 2024-04-02T07:31:21.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb26400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb201f44e0 0x7fbb201f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:21.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb26400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb201f44e0 0x7fbb201f4940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52732/0 (socket says 172.21.15.55:52732) 2024-04-02T07:31:21.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb26400640 1 -- 172.21.15.55:0/4036893745 learned_addr learned my addr 172.21.15.55:0/4036893745 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:21.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb25a00640 1 --2- 172.21.15.55:0/4036893745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb08007300 0x7fbb2015e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:21.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb25000640 1 --2- 172.21.15.55:0/4036893745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb2014da90 0x7fbb200b0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:21.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb26400640 1 -- 172.21.15.55:0/4036893745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb08007300 msgr2=0x7fbb2015e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:21.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb26400640 1 --2- 172.21.15.55:0/4036893745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb08007300 0x7fbb2015e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:21.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb26400640 1 -- 172.21.15.55:0/4036893745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb2014da90 msgr2=0x7fbb200b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:21.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb26400640 1 --2- 172.21.15.55:0/4036893745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb2014da90 0x7fbb200b0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:21.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb26400640 1 -- 172.21.15.55:0/4036893745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb200c77f0 con 0x7fbb201f44e0 2024-04-02T07:31:21.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb26400640 1 --2- 172.21.15.55:0/4036893745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb201f44e0 0x7fbb201f4940 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fbb1801d180 tx=0x7fbb08007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:21.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb1d600640 1 -- 172.21.15.55:0/4036893745 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb180ad070 con 0x7fbb201f44e0 2024-04-02T07:31:21.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb1d600640 1 -- 172.21.15.55:0/4036893745 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb18007e00 con 0x7fbb201f44e0 2024-04-02T07:31:21.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb28400640 1 -- 172.21.15.55:0/4036893745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb200c5830 con 0x7fbb201f44e0 2024-04-02T07:31:21.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb1d600640 1 -- 172.21.15.55:0/4036893745 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb18003980 con 0x7fbb201f44e0 2024-04-02T07:31:21.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb28400640 1 -- 172.21.15.55:0/4036893745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb200c5520 con 0x7fbb201f44e0 2024-04-02T07:31:21.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.185+0000 7fbb28400640 1 -- 172.21.15.55:0/4036893745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb2006e270 con 0x7fbb201f44e0 2024-04-02T07:31:21.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.189+0000 7fbb1d600640 1 -- 172.21.15.55:0/4036893745 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fbb180a8420 con 0x7fbb201f44e0 2024-04-02T07:31:21.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.189+0000 7fbb1d600640 1 --2- 172.21.15.55:0/4036893745 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb000666c0 0x7fbb00068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:21.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.189+0000 7fbb1d600640 1 -- 172.21.15.55:0/4036893745 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 5996+0+0 (secure 0 0 0) 0x7fbb1811d2a0 con 0x7fbb201f44e0 2024-04-02T07:31:21.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.189+0000 7fbb25a00640 1 --2- 172.21.15.55:0/4036893745 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb000666c0 0x7fbb00068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:21.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.189+0000 7fbb25a00640 1 --2- 172.21.15.55:0/4036893745 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb000666c0 0x7fbb00068b80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fbb140010f0 tx=0x7fbb14001160 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:21.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.193+0000 7fbb1d600640 1 -- 172.21.15.55:0/4036893745 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fbb180ea5c0 con 0x7fbb201f44e0 2024-04-02T07:31:21.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:21.357+0000 7fbb28400640 1 -- 172.21.15.55:0/4036893745 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbb200c5d50 con 0x7fbb201f44e0 2024-04-02T07:31:22.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.217+0000 7fbb1d600640 1 -- 172.21.15.55:0/4036893745 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v93) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbb200c5d50 con 0x7fbb201f44e0 2024-04-02T07:31:22.221 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2024-04-02T07:31:22.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.221+0000 7fbb28400640 1 -- 172.21.15.55:0/4036893745 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb000666c0 msgr2=0x7fbb00068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:22.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.221+0000 7fbb28400640 1 --2- 172.21.15.55:0/4036893745 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb000666c0 0x7fbb00068b80 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fbb140010f0 tx=0x7fbb14001160 comp rx=0 tx=0).stop 2024-04-02T07:31:22.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.221+0000 7fbb28400640 1 -- 172.21.15.55:0/4036893745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb201f44e0 msgr2=0x7fbb201f4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:22.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.221+0000 7fbb28400640 1 --2- 172.21.15.55:0/4036893745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb201f44e0 0x7fbb201f4940 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fbb1801d180 tx=0x7fbb08007a10 comp rx=0 tx=0).stop 2024-04-02T07:31:22.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.221+0000 7fbb28400640 1 -- 172.21.15.55:0/4036893745 shutdown_connections 2024-04-02T07:31:22.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.221+0000 7fbb28400640 1 --2- 172.21.15.55:0/4036893745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb201f44e0 0x7fbb201f4940 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:22.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.221+0000 7fbb28400640 1 --2- 172.21.15.55:0/4036893745 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fbb000666c0 0x7fbb00068b80 secure :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fbb140010f0 tx=0x7fbb14001160 comp rx=0 tx=0).stop 2024-04-02T07:31:22.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.221+0000 7fbb28400640 1 --2- 172.21.15.55:0/4036893745 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fbb2014da90 0x7fbb200b0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:22.225 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.221+0000 7fbb28400640 1 --2- 172.21.15.55:0/4036893745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fbb08007300 0x7fbb2015e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:22.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.221+0000 7fbb28400640 1 -- 172.21.15.55:0/4036893745 >> 172.21.15.55:0/4036893745 conn(0x7fbb20069d90 msgr2=0x7fbb20070310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:22.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.225+0000 7fbb28400640 1 -- 172.21.15.55:0/4036893745 shutdown_connections 2024-04-02T07:31:22.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.225+0000 7fbb28400640 1 -- 172.21.15.55:0/4036893745 wait complete. 2024-04-02T07:31:22.252 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-02T07:31:22.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.401+0000 7fd329e00640 1 Processor -- start 2024-04-02T07:31:22.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.401+0000 7fd329e00640 1 -- start start 2024-04-02T07:31:22.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd329e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd3240afe70 0x7fd3240b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:22.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd329e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3240b1d60 con 0x7fd32415ce40 2024-04-02T07:31:22.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd329e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32406c400 con 0x7fd32406d1c0 2024-04-02T07:31:22.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd329e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd32406cda0 con 0x7fd3240afe70 2024-04-02T07:31:22.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd322a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd32415ce40 0x7fd3240b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34176/0 (socket says 172.21.15.55:34176) 2024-04-02T07:31:22.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd322a00640 1 -- 172.21.15.55:0/2015490274 learned_addr learned my addr 172.21.15.55:0/2015490274 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:22.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd323400640 1 --2- 172.21.15.55:0/2015490274 >> v2:172.21.15.106:3300/0 conn(0x7fd3240afe70 0x7fd3240b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:22.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd322000640 1 -- 172.21.15.55:0/2015490274 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1075497761 0 0) 0x7fd3240b1d60 con 0x7fd32415ce40 2024-04-02T07:31:22.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd322000640 1 -- 172.21.15.55:0/2015490274 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd308005740 con 0x7fd32415ce40 2024-04-02T07:31:22.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd322000640 1 -- 172.21.15.55:0/2015490274 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2447604032 0 0) 0x7fd308005740 con 0x7fd32415ce40 2024-04-02T07:31:22.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd322000640 1 -- 172.21.15.55:0/2015490274 >> v2:172.21.15.106:3300/0 conn(0x7fd3240afe70 msgr2=0x7fd3240b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:22.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd322000640 1 --2- 172.21.15.55:0/2015490274 >> v2:172.21.15.106:3300/0 conn(0x7fd3240afe70 0x7fd3240b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:22.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd322000640 1 -- 172.21.15.55:0/2015490274 >> v1:172.21.15.106:6789/0 conn(0x7fd32406d1c0 legacy=0x7fd3240c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd322000640 1 -- 172.21.15.55:0/2015490274 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32406c6e0 con 0x7fd32415ce40 2024-04-02T07:31:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd322000640 1 -- 172.21.15.55:0/2015490274 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fd314001680 con 0x7fd32415ce40 2024-04-02T07:31:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd322000640 1 -- 172.21.15.55:0/2015490274 >> v1:172.21.15.55:6789/0 conn(0x7fd32415ce40 legacy=0x7fd3240b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd322000640 1 --2- 172.21.15.55:0/2015490274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd308005b90 0x7fd308005fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd322000640 1 --2- 172.21.15.55:0/2015490274 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3080069e0 0x7fd308006e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd322000640 1 --2- 172.21.15.55:0/2015490274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3080073a0 0x7fd30800dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd322000640 1 -- 172.21.15.55:0/2015490274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd32406cda0 con 0x7fd3080073a0 2024-04-02T07:31:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd322000640 1 -- 172.21.15.55:0/2015490274 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd30800e340 con 0x7fd308005b90 2024-04-02T07:31:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd322000640 1 -- 172.21.15.55:0/2015490274 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd30800e500 con 0x7fd3080069e0 2024-04-02T07:31:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd323400640 1 --2- 172.21.15.55:0/2015490274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3080073a0 0x7fd30800dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd322a00640 1 --2- 172.21.15.55:0/2015490274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd308005b90 0x7fd308005fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd31be00640 1 --2- 172.21.15.55:0/2015490274 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3080069e0 0x7fd308006e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:22.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd323400640 1 -- 172.21.15.55:0/2015490274 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3080069e0 msgr2=0x7fd308006e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:22.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd323400640 1 --2- 172.21.15.55:0/2015490274 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd3080069e0 0x7fd308006e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:22.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd323400640 1 -- 172.21.15.55:0/2015490274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd308005b90 msgr2=0x7fd308005fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:22.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd323400640 1 --2- 172.21.15.55:0/2015490274 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd308005b90 0x7fd308005fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:22.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.405+0000 7fd323400640 1 -- 172.21.15.55:0/2015490274 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd308005740 con 0x7fd3080073a0 2024-04-02T07:31:22.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.409+0000 7fd323400640 1 -- 172.21.15.55:0/2015490274 reap_dead start 2024-04-02T07:31:22.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.409+0000 7fd323400640 1 --2- 172.21.15.55:0/2015490274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3080073a0 0x7fd30800dba0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fd31c009fc0 tx=0x7fd31c01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786c11cf1c5bd69a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:22.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.409+0000 7fd322000640 1 -- 172.21.15.55:0/2015490274 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c0a5bd0 con 0x7fd3080073a0 2024-04-02T07:31:22.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.409+0000 7fd322000640 1 -- 172.21.15.55:0/2015490274 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31c00f040 con 0x7fd3080073a0 2024-04-02T07:31:22.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.409+0000 7fd322000640 1 -- 172.21.15.55:0/2015490274 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31c0039a0 con 0x7fd3080073a0 2024-04-02T07:31:22.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.409+0000 7fd329e00640 1 -- 172.21.15.55:0/2015490274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3080073a0 msgr2=0x7fd30800dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:22.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.409+0000 7fd329e00640 1 --2- 172.21.15.55:0/2015490274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3080073a0 0x7fd30800dba0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7fd31c009fc0 tx=0x7fd31c01ccc0 comp rx=0 tx=0).stop 2024-04-02T07:31:22.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.409+0000 7fd329e00640 1 -- 172.21.15.55:0/2015490274 shutdown_connections 2024-04-02T07:31:22.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.409+0000 7fd329e00640 1 --2- 172.21.15.55:0/2015490274 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3080073a0 0x7fd30800dba0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:22.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.409+0000 7fd329e00640 1 -- 172.21.15.55:0/2015490274 >> 172.21.15.55:0/2015490274 conn(0x7fd324069d90 msgr2=0x7fd32406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:22.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.409+0000 7fd329e00640 1 -- 172.21.15.55:0/2015490274 shutdown_connections 2024-04-02T07:31:22.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.409+0000 7fd329e00640 1 -- 172.21.15.55:0/2015490274 wait complete. 2024-04-02T07:31:22.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd329e00640 1 Processor -- start 2024-04-02T07:31:22.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd329e00640 1 -- start start 2024-04-02T07:31:22.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd329e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3080073a0 0x7fd324152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:22.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd329e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd324153940 0x7fd324159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:22.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd329e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd324156da0 0x7fd324157220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:22.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd329e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd324153dd0 con 0x7fd3080073a0 2024-04-02T07:31:22.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd329e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3241540b0 con 0x7fd324156da0 2024-04-02T07:31:22.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd329e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd324154390 con 0x7fd324153940 2024-04-02T07:31:22.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd322a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3080073a0 0x7fd324152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:22.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd322a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3080073a0 0x7fd324152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52754/0 (socket says 172.21.15.55:52754) 2024-04-02T07:31:22.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd322a00640 1 -- 172.21.15.55:0/3435780221 learned_addr learned my addr 172.21.15.55:0/3435780221 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:22.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd31be00640 1 --2- 172.21.15.55:0/3435780221 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd324153940 0x7fd324159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:22.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd323400640 1 --2- 172.21.15.55:0/3435780221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd324156da0 0x7fd324157220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:22.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd322a00640 1 -- 172.21.15.55:0/3435780221 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd324153940 msgr2=0x7fd324159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:22.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd322a00640 1 --2- 172.21.15.55:0/3435780221 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd324153940 0x7fd324159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:22.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd322a00640 1 -- 172.21.15.55:0/3435780221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd324156da0 msgr2=0x7fd324157220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:22.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd322a00640 1 --2- 172.21.15.55:0/3435780221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd324156da0 0x7fd324157220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:22.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd322a00640 1 -- 172.21.15.55:0/3435780221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd324154670 con 0x7fd3080073a0 2024-04-02T07:31:22.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd322a00640 1 --2- 172.21.15.55:0/3435780221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3080073a0 0x7fd324152370 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fd3140124c0 tx=0x7fd314012980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:22.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd31b400640 1 -- 172.21.15.55:0/3435780221 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314014810 con 0x7fd3080073a0 2024-04-02T07:31:22.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd31b400640 1 -- 172.21.15.55:0/3435780221 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd314014970 con 0x7fd3080073a0 2024-04-02T07:31:22.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd329e00640 1 -- 172.21.15.55:0/3435780221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd324154950 con 0x7fd3080073a0 2024-04-02T07:31:22.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd31b400640 1 -- 172.21.15.55:0/3435780221 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314014d20 con 0x7fd3080073a0 2024-04-02T07:31:22.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd329e00640 1 -- 172.21.15.55:0/3435780221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd324159f90 con 0x7fd3080073a0 2024-04-02T07:31:22.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.413+0000 7fd329e00640 1 -- 172.21.15.55:0/3435780221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd32406e270 con 0x7fd3080073a0 2024-04-02T07:31:22.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.417+0000 7fd31b400640 1 -- 172.21.15.55:0/3435780221 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd3140153e0 con 0x7fd3080073a0 2024-04-02T07:31:22.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.417+0000 7fd31b400640 1 --2- 172.21.15.55:0/3435780221 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd300066690 0x7fd300068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:22.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.417+0000 7fd31b400640 1 -- 172.21.15.55:0/3435780221 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(93..93 src has 1..93) v4 ==== 5558+0+0 (secure 0 0 0) 0x7fd314086c70 con 0x7fd3080073a0 2024-04-02T07:31:22.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.417+0000 7fd31be00640 1 --2- 172.21.15.55:0/3435780221 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd300066690 0x7fd300068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:22.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.417+0000 7fd31be00640 1 --2- 172.21.15.55:0/3435780221 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd300066690 0x7fd300068b50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd32406a4c0 tx=0x7fd30c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:22.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.421+0000 7fd31b400640 1 -- 172.21.15.55:0/3435780221 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd314054080 con 0x7fd3080073a0 2024-04-02T07:31:22.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:22.581+0000 7fd329e00640 1 -- 172.21.15.55:0/3435780221 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd324066c90 con 0x7fd3080073a0 2024-04-02T07:31:23.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.225+0000 7fd31b400640 1 -- 172.21.15.55:0/3435780221 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v94) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd31401c020 con 0x7fd3080073a0 2024-04-02T07:31:23.227 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2024-04-02T07:31:23.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.229+0000 7fd329e00640 1 -- 172.21.15.55:0/3435780221 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd300066690 msgr2=0x7fd300068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:23.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.229+0000 7fd329e00640 1 --2- 172.21.15.55:0/3435780221 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd300066690 0x7fd300068b50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fd32406a4c0 tx=0x7fd30c009040 comp rx=0 tx=0).stop 2024-04-02T07:31:23.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.229+0000 7fd329e00640 1 -- 172.21.15.55:0/3435780221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3080073a0 msgr2=0x7fd324152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:23.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.229+0000 7fd329e00640 1 --2- 172.21.15.55:0/3435780221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3080073a0 0x7fd324152370 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7fd3140124c0 tx=0x7fd314012980 comp rx=0 tx=0).stop 2024-04-02T07:31:23.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.229+0000 7fd329e00640 1 -- 172.21.15.55:0/3435780221 shutdown_connections 2024-04-02T07:31:23.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.229+0000 7fd329e00640 1 --2- 172.21.15.55:0/3435780221 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd300066690 0x7fd300068b50 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:23.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.229+0000 7fd329e00640 1 --2- 172.21.15.55:0/3435780221 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd324156da0 0x7fd324157220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:23.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.229+0000 7fd329e00640 1 --2- 172.21.15.55:0/3435780221 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd324153940 0x7fd324159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:23.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.229+0000 7fd329e00640 1 --2- 172.21.15.55:0/3435780221 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd3080073a0 0x7fd324152370 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:23.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.229+0000 7fd329e00640 1 -- 172.21.15.55:0/3435780221 >> 172.21.15.55:0/3435780221 conn(0x7fd324069d90 msgr2=0x7fd3240ca2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:23.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.229+0000 7fd329e00640 1 -- 172.21.15.55:0/3435780221 shutdown_connections 2024-04-02T07:31:23.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.229+0000 7fd329e00640 1 -- 172.21.15.55:0/3435780221 wait complete. 2024-04-02T07:31:23.256 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-02T07:31:23.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.401+0000 7f382e600640 1 Processor -- start 2024-04-02T07:31:23.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.401+0000 7f382e600640 1 -- start start 2024-04-02T07:31:23.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.401+0000 7f382e600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3828144260 0x7f38280702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:23.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.401+0000 7f382e600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f38280b31a0 0x7f38280b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:23.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.401+0000 7f382e600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3828070c90 con 0x7f38280707e0 2024-04-02T07:31:23.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.401+0000 7f382e600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38280b37c0 con 0x7f3828144260 2024-04-02T07:31:23.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.401+0000 7f382e600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38280b3580 con 0x7f38280b31a0 2024-04-02T07:31:23.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.401+0000 7f3827400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3828144260 0x7f38280702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:23.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.401+0000 7f3827400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3828144260 0x7f38280702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52770/0 (socket says 172.21.15.55:52770) 2024-04-02T07:31:23.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.401+0000 7f3827400640 1 -- 172.21.15.55:0/43203269 learned_addr learned my addr 172.21.15.55:0/43203269 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:23.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.401+0000 7f3827e00640 1 --2- 172.21.15.55:0/43203269 >> v2:172.21.15.106:3300/0 conn(0x7f38280b31a0 0x7f38280b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:23.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.401+0000 7f3827400640 1 -- 172.21.15.55:0/43203269 >> v2:172.21.15.106:3300/0 conn(0x7f38280b31a0 msgr2=0x7f38280b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:23.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.401+0000 7f3827400640 1 --2- 172.21.15.55:0/43203269 >> v2:172.21.15.106:3300/0 conn(0x7f38280b31a0 0x7f38280b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:23.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.401+0000 7f3827400640 1 -- 172.21.15.55:0/43203269 >> v1:172.21.15.55:6789/0 conn(0x7f38280707e0 legacy=0x7f38280b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:23.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.401+0000 7f3827400640 1 -- 172.21.15.55:0/43203269 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f382815e3a0 con 0x7f3828144260 2024-04-02T07:31:23.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.405+0000 7f3827400640 1 --2- 172.21.15.55:0/43203269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3828144260 0x7f38280702a0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f382806ac10 tx=0x7f381801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f7f924462cc2e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:23.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.405+0000 7f3826000640 1 -- 172.21.15.55:0/43203269 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180ab610 con 0x7f3828144260 2024-04-02T07:31:23.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.405+0000 7f3826000640 1 -- 172.21.15.55:0/43203269 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38180ab770 con 0x7f3828144260 2024-04-02T07:31:23.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.405+0000 7f3826000640 1 -- 172.21.15.55:0/43203269 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180abb00 con 0x7f3828144260 2024-04-02T07:31:23.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.405+0000 7f382e600640 1 -- 172.21.15.55:0/43203269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3828144260 msgr2=0x7f38280702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:23.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.405+0000 7f382e600640 1 --2- 172.21.15.55:0/43203269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3828144260 0x7f38280702a0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f382806ac10 tx=0x7f381801c520 comp rx=0 tx=0).stop 2024-04-02T07:31:23.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.405+0000 7f382e600640 1 -- 172.21.15.55:0/43203269 shutdown_connections 2024-04-02T07:31:23.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.405+0000 7f382e600640 1 --2- 172.21.15.55:0/43203269 >> v2:172.21.15.106:3300/0 conn(0x7f38280b31a0 0x7f38280b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:23.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.405+0000 7f382e600640 1 --2- 172.21.15.55:0/43203269 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3828144260 0x7f38280702a0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:23.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.405+0000 7f382e600640 1 -- 172.21.15.55:0/43203269 >> 172.21.15.55:0/43203269 conn(0x7f382806a390 msgr2=0x7f38280b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:23.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.405+0000 7f382e600640 1 -- 172.21.15.55:0/43203269 shutdown_connections 2024-04-02T07:31:23.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.405+0000 7f382e600640 1 -- 172.21.15.55:0/43203269 wait complete. 2024-04-02T07:31:23.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.405+0000 7f382e600640 1 Processor -- start 2024-04-02T07:31:23.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.405+0000 7f382e600640 1 -- start start 2024-04-02T07:31:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f382e600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38280707e0 0x7f3828153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f382e600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f38280b31a0 0x7f382815c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f382e600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3828144260 0x7f382815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f382e600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38281f6040 con 0x7f38280707e0 2024-04-02T07:31:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f382e600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38281f6320 con 0x7f3828144260 2024-04-02T07:31:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f382e600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38281f6600 con 0x7f38280b31a0 2024-04-02T07:31:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f3827400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38280707e0 0x7f3828153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f3827400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38280707e0 0x7f3828153a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52774/0 (socket says 172.21.15.55:52774) 2024-04-02T07:31:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f3827400640 1 -- 172.21.15.55:0/4176066365 learned_addr learned my addr 172.21.15.55:0/4176066365 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f3827400640 1 -- 172.21.15.55:0/4176066365 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f38280b31a0 msgr2=0x7f382815c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:23.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f3827400640 1 --2- 172.21.15.55:0/4176066365 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f38280b31a0 0x7f382815c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:23.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f3827400640 1 -- 172.21.15.55:0/4176066365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3828144260 msgr2=0x7f382815cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:23.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f3827400640 1 --2- 172.21.15.55:0/4176066365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3828144260 0x7f382815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:23.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f3827400640 1 -- 172.21.15.55:0/4176066365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38180094d0 con 0x7f38280707e0 2024-04-02T07:31:23.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f3827400640 1 --2- 172.21.15.55:0/4176066365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38280707e0 0x7f3828153a50 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f3818019130 tx=0x7f381801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:23.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f381f400640 1 -- 172.21.15.55:0/4176066365 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180b4800 con 0x7f38280707e0 2024-04-02T07:31:23.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f381f400640 1 -- 172.21.15.55:0/4176066365 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38180b4980 con 0x7f38280707e0 2024-04-02T07:31:23.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f382e600640 1 -- 172.21.15.55:0/4176066365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38281f68e0 con 0x7f38280707e0 2024-04-02T07:31:23.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f381f400640 1 -- 172.21.15.55:0/4176066365 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38180b4d30 con 0x7f38280707e0 2024-04-02T07:31:23.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f382e600640 1 -- 172.21.15.55:0/4176066365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38281f51a0 con 0x7f38280707e0 2024-04-02T07:31:23.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f382e600640 1 -- 172.21.15.55:0/4176066365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3828066c90 con 0x7f38280707e0 2024-04-02T07:31:23.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.409+0000 7f381f400640 1 -- 172.21.15.55:0/4176066365 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f38180c7390 con 0x7f38280707e0 2024-04-02T07:31:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.413+0000 7f381f400640 1 --2- 172.21.15.55:0/4176066365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3808066690 0x7f3808068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.413+0000 7f381f400640 1 -- 172.21.15.55:0/4176066365 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f381811e930 con 0x7f38280707e0 2024-04-02T07:31:23.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.413+0000 7f3826a00640 1 --2- 172.21.15.55:0/4176066365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3808066690 0x7f3808068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:23.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.413+0000 7f3826a00640 1 --2- 172.21.15.55:0/4176066365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3808066690 0x7f3808068b50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3814000f70 tx=0x7f38140079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:23.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.417+0000 7f381f400640 1 -- 172.21.15.55:0/4176066365 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f38180ebf60 con 0x7f38280707e0 2024-04-02T07:31:23.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.577+0000 7f382e600640 1 -- 172.21.15.55:0/4176066365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f38280b1060 con 0x7f38280707e0 2024-04-02T07:31:23.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.581+0000 7f381f400640 1 -- 172.21.15.55:0/4176066365 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f38180ef580 con 0x7f38280707e0 2024-04-02T07:31:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.585+0000 7f382e600640 1 -- 172.21.15.55:0/4176066365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3808066690 msgr2=0x7f3808068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.585+0000 7f382e600640 1 --2- 172.21.15.55:0/4176066365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3808066690 0x7f3808068b50 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f3814000f70 tx=0x7f38140079c0 comp rx=0 tx=0).stop 2024-04-02T07:31:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.585+0000 7f382e600640 1 -- 172.21.15.55:0/4176066365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38280707e0 msgr2=0x7f3828153a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.585+0000 7f382e600640 1 --2- 172.21.15.55:0/4176066365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38280707e0 0x7f3828153a50 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f3818019130 tx=0x7f381801ad60 comp rx=0 tx=0).stop 2024-04-02T07:31:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.585+0000 7f382e600640 1 -- 172.21.15.55:0/4176066365 shutdown_connections 2024-04-02T07:31:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.585+0000 7f382e600640 1 --2- 172.21.15.55:0/4176066365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3808066690 0x7f3808068b50 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.585+0000 7f382e600640 1 --2- 172.21.15.55:0/4176066365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3828144260 0x7f382815cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.585+0000 7f382e600640 1 --2- 172.21.15.55:0/4176066365 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f38280b31a0 0x7f382815c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:23.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.585+0000 7f382e600640 1 --2- 172.21.15.55:0/4176066365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f38280707e0 0x7f3828153a50 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:23.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.585+0000 7f382e600640 1 -- 172.21.15.55:0/4176066365 >> 172.21.15.55:0/4176066365 conn(0x7f382806a390 msgr2=0x7f382806c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:23.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.585+0000 7f382e600640 1 -- 172.21.15.55:0/4176066365 shutdown_connections 2024-04-02T07:31:23.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.585+0000 7f382e600640 1 -- 172.21.15.55:0/4176066365 wait complete. 2024-04-02T07:31:23.607 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair' 2024-04-02T07:31:23.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.745+0000 7f7256400640 1 Processor -- start 2024-04-02T07:31:23.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.745+0000 7f7256400640 1 -- start start 2024-04-02T07:31:23.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.745+0000 7f7256400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7250099120 0x7f7250099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:23.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.745+0000 7f7256400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f725015f250 0x7f72500b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:23.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.745+0000 7f7256400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72500ad270 con 0x7f725015ee70 2024-04-02T07:31:23.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.745+0000 7f7256400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72500b0840 con 0x7f7250099120 2024-04-02T07:31:23.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.745+0000 7f7256400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72500cf6a0 con 0x7f725015f250 2024-04-02T07:31:23.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.745+0000 7f724f400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f725015ee70 0x7f7250098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34194/0 (socket says 172.21.15.55:34194) 2024-04-02T07:31:23.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.745+0000 7f724f400640 1 -- 172.21.15.55:0/2508414031 learned_addr learned my addr 172.21.15.55:0/2508414031 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:23.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.745+0000 7f724ea00640 1 --2- 172.21.15.55:0/2508414031 >> v2:172.21.15.55:3300/0 conn(0x7f7250099120 0x7f7250099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:23.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.749+0000 7f724fe00640 1 --2- 172.21.15.55:0/2508414031 >> v2:172.21.15.106:3300/0 conn(0x7f725015f250 0x7f72500b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:23.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.749+0000 7f724e000640 1 -- 172.21.15.55:0/2508414031 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 593499398 0 0) 0x7f72500ad270 con 0x7f725015ee70 2024-04-02T07:31:23.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.749+0000 7f724e000640 1 -- 172.21.15.55:0/2508414031 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7234003530 con 0x7f725015ee70 2024-04-02T07:31:23.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.749+0000 7f724ea00640 1 -- 172.21.15.55:0/2508414031 >> v2:172.21.15.106:3300/0 conn(0x7f725015f250 msgr2=0x7f72500b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:23.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.749+0000 7f724ea00640 1 --2- 172.21.15.55:0/2508414031 >> v2:172.21.15.106:3300/0 conn(0x7f725015f250 0x7f72500b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:23.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.749+0000 7f724ea00640 1 -- 172.21.15.55:0/2508414031 >> v1:172.21.15.55:6789/0 conn(0x7f725015ee70 legacy=0x7f7250098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:23.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.749+0000 7f724ea00640 1 -- 172.21.15.55:0/2508414031 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72500b0a50 con 0x7f7250099120 2024-04-02T07:31:23.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.749+0000 7f724ea00640 1 --2- 172.21.15.55:0/2508414031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7250099120 0x7f7250099830 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f72500afdc0 tx=0x7f723c01c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562212085514eee8 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:23.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.749+0000 7f724e000640 1 -- 172.21.15.55:0/2508414031 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c0ab680 con 0x7f7250099120 2024-04-02T07:31:23.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.749+0000 7f724e000640 1 -- 172.21.15.55:0/2508414031 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f723c0ab7e0 con 0x7f7250099120 2024-04-02T07:31:23.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.749+0000 7f724e000640 1 -- 172.21.15.55:0/2508414031 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f723c0abb70 con 0x7f7250099120 2024-04-02T07:31:23.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.749+0000 7f7256400640 1 -- 172.21.15.55:0/2508414031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7250099120 msgr2=0x7f7250099830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:23.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.749+0000 7f7256400640 1 --2- 172.21.15.55:0/2508414031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7250099120 0x7f7250099830 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f72500afdc0 tx=0x7f723c01c480 comp rx=0 tx=0).stop 2024-04-02T07:31:23.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.749+0000 7f7256400640 1 -- 172.21.15.55:0/2508414031 shutdown_connections 2024-04-02T07:31:23.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.749+0000 7f7256400640 1 --2- 172.21.15.55:0/2508414031 >> v2:172.21.15.106:3300/0 conn(0x7f725015f250 0x7f72500b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:23.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.749+0000 7f7256400640 1 --2- 172.21.15.55:0/2508414031 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7250099120 0x7f7250099830 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:23.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.749+0000 7f7256400640 1 -- 172.21.15.55:0/2508414031 >> 172.21.15.55:0/2508414031 conn(0x7f72500b21d0 msgr2=0x7f72500b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:23.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.749+0000 7f7256400640 1 -- 172.21.15.55:0/2508414031 shutdown_connections 2024-04-02T07:31:23.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.749+0000 7f7256400640 1 -- 172.21.15.55:0/2508414031 wait complete. 2024-04-02T07:31:23.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f7256400640 1 Processor -- start 2024-04-02T07:31:23.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f7256400640 1 -- start start 2024-04-02T07:31:23.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f7256400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7250099120 0x7f725006b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:23.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f7256400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f725015ee70 0x7f72500b5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:23.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f7256400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f725015f250 0x7f72501f4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:23.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f7256400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72500b5fa0 con 0x7f7250099120 2024-04-02T07:31:23.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f7256400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725006bf90 con 0x7f725015f250 2024-04-02T07:31:23.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f7256400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725006c270 con 0x7f725015ee70 2024-04-02T07:31:23.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f724f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7250099120 0x7f725006b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:23.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f724f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7250099120 0x7f725006b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52782/0 (socket says 172.21.15.55:52782) 2024-04-02T07:31:23.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f724f400640 1 -- 172.21.15.55:0/1772707168 learned_addr learned my addr 172.21.15.55:0/1772707168 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:23.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f724fe00640 1 --2- 172.21.15.55:0/1772707168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f725015f250 0x7f72501f4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:23.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f724ea00640 1 --2- 172.21.15.55:0/1772707168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f725015ee70 0x7f72500b5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:23.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f724f400640 1 -- 172.21.15.55:0/1772707168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f725015ee70 msgr2=0x7f72500b5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:23.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f724f400640 1 --2- 172.21.15.55:0/1772707168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f725015ee70 0x7f72500b5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:23.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f724f400640 1 -- 172.21.15.55:0/1772707168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f725015f250 msgr2=0x7f72501f4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:23.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f724f400640 1 --2- 172.21.15.55:0/1772707168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f725015f250 0x7f72501f4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:23.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f724f400640 1 -- 172.21.15.55:0/1772707168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723c009420 con 0x7f7250099120 2024-04-02T07:31:23.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f724f400640 1 --2- 172.21.15.55:0/1772707168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7250099120 0x7f725006b880 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f724000c4d0 tx=0x7f724000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:23.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f7247400640 1 -- 172.21.15.55:0/1772707168 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7240005cf0 con 0x7f7250099120 2024-04-02T07:31:23.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f7247400640 1 -- 172.21.15.55:0/1772707168 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7240005e50 con 0x7f7250099120 2024-04-02T07:31:23.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f7247400640 1 -- 172.21.15.55:0/1772707168 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7240007270 con 0x7f7250099120 2024-04-02T07:31:23.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f7256400640 1 -- 172.21.15.55:0/1772707168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f725006c550 con 0x7f7250099120 2024-04-02T07:31:23.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.753+0000 7f7256400640 1 -- 172.21.15.55:0/1772707168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7250159880 con 0x7f7250099120 2024-04-02T07:31:23.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.757+0000 7f7256400640 1 -- 172.21.15.55:0/1772707168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7250066c90 con 0x7f7250099120 2024-04-02T07:31:23.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.757+0000 7f7247400640 1 -- 172.21.15.55:0/1772707168 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f72400073d0 con 0x7f7250099120 2024-04-02T07:31:23.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.757+0000 7f7247400640 1 --2- 172.21.15.55:0/1772707168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7230066690 0x7f7230068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:23.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.757+0000 7f7247400640 1 -- 172.21.15.55:0/1772707168 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f7240083460 con 0x7f7250099120 2024-04-02T07:31:23.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.757+0000 7f724ea00640 1 --2- 172.21.15.55:0/1772707168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7230066690 0x7f7230068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:23.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.757+0000 7f724ea00640 1 --2- 172.21.15.55:0/1772707168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7230066690 0x7f7230068b50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f723c0af000 tx=0x7f723c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:23.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.761+0000 7f7247400640 1 -- 172.21.15.55:0/1772707168 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7240050ab0 con 0x7f7250099120 2024-04-02T07:31:23.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:23.981+0000 7f7256400640 1 -- 172.21.15.55:0/1772707168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]} v 0) v1 -- 0x7f725015c470 con 0x7f7250099120 2024-04-02T07:31:24.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.229+0000 7f7247400640 1 -- 172.21.15.55:0/1772707168 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_health_status_after_dirfrag_repair"]}]=0 v416) v1 ==== 167+0+0 (secure 0 0 0) 0x7f72400540d0 con 0x7f7250099120 2024-04-02T07:31:24.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.229+0000 7f7256400640 1 -- 172.21.15.55:0/1772707168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7230066690 msgr2=0x7f7230068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:24.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.229+0000 7f7256400640 1 --2- 172.21.15.55:0/1772707168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7230066690 0x7f7230068b50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f723c0af000 tx=0x7f723c0a7000 comp rx=0 tx=0).stop 2024-04-02T07:31:24.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.229+0000 7f7256400640 1 -- 172.21.15.55:0/1772707168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7250099120 msgr2=0x7f725006b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:24.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.229+0000 7f7256400640 1 --2- 172.21.15.55:0/1772707168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7250099120 0x7f725006b880 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f724000c4d0 tx=0x7f724000c990 comp rx=0 tx=0).stop 2024-04-02T07:31:24.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.229+0000 7f7256400640 1 -- 172.21.15.55:0/1772707168 shutdown_connections 2024-04-02T07:31:24.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.229+0000 7f7256400640 1 --2- 172.21.15.55:0/1772707168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7230066690 0x7f7230068b50 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:24.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.229+0000 7f7256400640 1 --2- 172.21.15.55:0/1772707168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f725015f250 0x7f72501f4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:24.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.229+0000 7f7256400640 1 --2- 172.21.15.55:0/1772707168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f725015ee70 0x7f72500b5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:24.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.229+0000 7f7256400640 1 --2- 172.21.15.55:0/1772707168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7250099120 0x7f725006b880 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:24.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.229+0000 7f7256400640 1 -- 172.21.15.55:0/1772707168 >> 172.21.15.55:0/1772707168 conn(0x7f72500b21d0 msgr2=0x7f72501650a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:24.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.229+0000 7f7256400640 1 -- 172.21.15.55:0/1772707168 shutdown_connections 2024-04-02T07:31:24.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.229+0000 7f7256400640 1 -- 172.21.15.55:0/1772707168 wait complete. 2024-04-02T07:31:24.252 INFO:tasks.cephfs_test_runner:Test that the damage health status is cleared ... ok 2024-04-02T07:31:24.252 INFO:tasks.cephfs_test_runner:Starting test: test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-02T07:31:24.253 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-04-02T07:31:24.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.393+0000 7f2beae00640 1 Processor -- start 2024-04-02T07:31:24.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.393+0000 7f2beae00640 1 -- start start 2024-04-02T07:31:24.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.393+0000 7f2beae00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2be4098c70 0x7f2be4099750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:24.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.393+0000 7f2beae00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be40ad1b0 0x7f2be415e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:24.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.393+0000 7f2beae00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2be40b0950 con 0x7f2be40b1470 2024-04-02T07:31:24.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.393+0000 7f2beae00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2be40ce240 con 0x7f2be4098c70 2024-04-02T07:31:24.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.393+0000 7f2beae00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be40b0bc0 con 0x7f2be40ad1b0 2024-04-02T07:31:24.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.393+0000 7f2be9a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2be4098c70 0x7f2be4099750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:24.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.393+0000 7f2be9a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2be4098c70 0x7f2be4099750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52794/0 (socket says 172.21.15.55:52794) 2024-04-02T07:31:24.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.393+0000 7f2be9a00640 1 -- 172.21.15.55:0/709840754 learned_addr learned my addr 172.21.15.55:0/709840754 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:24.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.393+0000 7f2be9000640 1 --2- 172.21.15.55:0/709840754 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be40ad1b0 0x7f2be415e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:24.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.393+0000 7f2be9a00640 1 -- 172.21.15.55:0/709840754 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be40ad1b0 msgr2=0x7f2be415e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:24.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.393+0000 7f2be9a00640 1 --2- 172.21.15.55:0/709840754 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be40ad1b0 0x7f2be415e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:24.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.393+0000 7f2be9a00640 1 -- 172.21.15.55:0/709840754 >> v1:172.21.15.106:6789/0 conn(0x7f2be40b1470 legacy=0x7f2be415eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:24.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.393+0000 7f2be9a00640 1 -- 172.21.15.55:0/709840754 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2be40b0ea0 con 0x7f2be4098c70 2024-04-02T07:31:24.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.393+0000 7f2be9000640 1 --2- 172.21.15.55:0/709840754 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be40ad1b0 0x7f2be415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:24.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.397+0000 7f2be9a00640 1 --2- 172.21.15.55:0/709840754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be4098c70 0x7f2be4099750 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8009870 tx=0x7f2bd801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621cf628ae578e17 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:24.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.397+0000 7f2be3e00640 1 -- 172.21.15.55:0/709840754 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd80ab600 con 0x7f2be4098c70 2024-04-02T07:31:24.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.397+0000 7f2be3e00640 1 -- 172.21.15.55:0/709840754 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd80ab760 con 0x7f2be4098c70 2024-04-02T07:31:24.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.397+0000 7f2be3e00640 1 -- 172.21.15.55:0/709840754 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd80abaf0 con 0x7f2be4098c70 2024-04-02T07:31:24.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.397+0000 7f2beae00640 1 -- 172.21.15.55:0/709840754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be4098c70 msgr2=0x7f2be4099750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:24.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.397+0000 7f2beae00640 1 --2- 172.21.15.55:0/709840754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be4098c70 0x7f2be4099750 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f2bd8009870 tx=0x7f2bd801c520 comp rx=0 tx=0).stop 2024-04-02T07:31:24.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.397+0000 7f2beae00640 1 -- 172.21.15.55:0/709840754 shutdown_connections 2024-04-02T07:31:24.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.397+0000 7f2beae00640 1 --2- 172.21.15.55:0/709840754 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be40ad1b0 0x7f2be415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:24.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.397+0000 7f2beae00640 1 --2- 172.21.15.55:0/709840754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be4098c70 0x7f2be4099750 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:24.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.397+0000 7f2beae00640 1 -- 172.21.15.55:0/709840754 >> 172.21.15.55:0/709840754 conn(0x7f2be40b2030 msgr2=0x7f2be40b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:24.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.397+0000 7f2beae00640 1 -- 172.21.15.55:0/709840754 shutdown_connections 2024-04-02T07:31:24.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.397+0000 7f2beae00640 1 -- 172.21.15.55:0/709840754 wait complete. 2024-04-02T07:31:24.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2beae00640 1 Processor -- start 2024-04-02T07:31:24.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2beae00640 1 -- start start 2024-04-02T07:31:24.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2beae00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be4098c70 0x7f2be40c40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:24.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2beae00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be40ad1b0 0x7f2be40c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:24.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2beae00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be40b1470 0x7f2be4157a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:24.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2beae00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be40c9cf0 con 0x7f2be40ad1b0 2024-04-02T07:31:24.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2beae00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2be40c9fd0 con 0x7f2be4098c70 2024-04-02T07:31:24.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2beae00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2be40ca2b0 con 0x7f2be40b1470 2024-04-02T07:31:24.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2be9000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be40ad1b0 0x7f2be40c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:24.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2be9000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be40ad1b0 0x7f2be40c93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52806/0 (socket says 172.21.15.55:52806) 2024-04-02T07:31:24.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2be9000640 1 -- 172.21.15.55:0/1678860954 learned_addr learned my addr 172.21.15.55:0/1678860954 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:24.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2be9a00640 1 --2- 172.21.15.55:0/1678860954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be4098c70 0x7f2be40c40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:24.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2bea400640 1 --2- 172.21.15.55:0/1678860954 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be40b1470 0x7f2be4157a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:24.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2be9000640 1 -- 172.21.15.55:0/1678860954 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be40b1470 msgr2=0x7f2be4157a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:24.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2be9000640 1 --2- 172.21.15.55:0/1678860954 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be40b1470 0x7f2be4157a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:24.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2be9000640 1 -- 172.21.15.55:0/1678860954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be4098c70 msgr2=0x7f2be40c40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:24.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2be9000640 1 --2- 172.21.15.55:0/1678860954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be4098c70 0x7f2be40c40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:24.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2be9000640 1 -- 172.21.15.55:0/1678860954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bd80094d0 con 0x7f2be40ad1b0 2024-04-02T07:31:24.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2bea400640 1 --2- 172.21.15.55:0/1678860954 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be40b1470 0x7f2be4157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:24.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2be9000640 1 --2- 172.21.15.55:0/1678860954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be40ad1b0 0x7f2be40c93a0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f2bd000c7f0 tx=0x7f2bd000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:24.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2be1600640 1 -- 172.21.15.55:0/1678860954 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd000cea0 con 0x7f2be40ad1b0 2024-04-02T07:31:24.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2be1600640 1 -- 172.21.15.55:0/1678860954 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bd0007a30 con 0x7f2be40ad1b0 2024-04-02T07:31:24.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2be1600640 1 -- 172.21.15.55:0/1678860954 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0007dc0 con 0x7f2be40ad1b0 2024-04-02T07:31:24.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2beae00640 1 -- 172.21.15.55:0/1678860954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2be40ca590 con 0x7f2be40ad1b0 2024-04-02T07:31:24.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2beae00640 1 -- 172.21.15.55:0/1678860954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2be40c98e0 con 0x7f2be40ad1b0 2024-04-02T07:31:24.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.401+0000 7f2beae00640 1 -- 172.21.15.55:0/1678860954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2be4073fa0 con 0x7f2be40ad1b0 2024-04-02T07:31:24.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.405+0000 7f2be1600640 1 -- 172.21.15.55:0/1678860954 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2bd00113f0 con 0x7f2be40ad1b0 2024-04-02T07:31:24.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.405+0000 7f2be1600640 1 --2- 172.21.15.55:0/1678860954 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2bc40666c0 0x7f2bc4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:24.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.405+0000 7f2be1600640 1 -- 172.21.15.55:0/1678860954 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f2bd0084090 con 0x7f2be40ad1b0 2024-04-02T07:31:24.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.405+0000 7f2be9a00640 1 --2- 172.21.15.55:0/1678860954 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2bc40666c0 0x7f2bc4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:24.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.405+0000 7f2be9a00640 1 --2- 172.21.15.55:0/1678860954 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2bc40666c0 0x7f2bc4068b80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2bd80af000 tx=0x7f2bd80b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:24.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.409+0000 7f2be1600640 1 -- 172.21.15.55:0/1678860954 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2bd0051660 con 0x7f2be40ad1b0 2024-04-02T07:31:24.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:24.629+0000 7f2beae00640 1 -- 172.21.15.55:0/1678860954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) v1 -- 0x7f2be41492d0 con 0x7f2be40ad1b0 2024-04-02T07:31:25.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.233+0000 7f2be1600640 1 -- 172.21.15.55:0/1678860954 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v417) v1 ==== 149+0+0 (secure 0 0 0) 0x7f2bd0054c80 con 0x7f2be40ad1b0 2024-04-02T07:31:25.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.233+0000 7f2beae00640 1 -- 172.21.15.55:0/1678860954 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2bc40666c0 msgr2=0x7f2bc4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:25.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.233+0000 7f2beae00640 1 --2- 172.21.15.55:0/1678860954 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2bc40666c0 0x7f2bc4068b80 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f2bd80af000 tx=0x7f2bd80b6040 comp rx=0 tx=0).stop 2024-04-02T07:31:25.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.233+0000 7f2beae00640 1 -- 172.21.15.55:0/1678860954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be40ad1b0 msgr2=0x7f2be40c93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:25.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.233+0000 7f2beae00640 1 --2- 172.21.15.55:0/1678860954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be40ad1b0 0x7f2be40c93a0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f2bd000c7f0 tx=0x7f2bd000ccb0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.233+0000 7f2beae00640 1 -- 172.21.15.55:0/1678860954 shutdown_connections 2024-04-02T07:31:25.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.233+0000 7f2beae00640 1 --2- 172.21.15.55:0/1678860954 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2be40b1470 0x7f2be4157a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.233+0000 7f2beae00640 1 --2- 172.21.15.55:0/1678860954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2be40ad1b0 0x7f2be40c93a0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.233+0000 7f2beae00640 1 --2- 172.21.15.55:0/1678860954 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2bc40666c0 0x7f2bc4068b80 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.233+0000 7f2beae00640 1 --2- 172.21.15.55:0/1678860954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2be4098c70 0x7f2be40c40e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.233+0000 7f2beae00640 1 -- 172.21.15.55:0/1678860954 >> 172.21.15.55:0/1678860954 conn(0x7f2be40b2030 msgr2=0x7f2be40ad6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:25.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.233+0000 7f2beae00640 1 -- 172.21.15.55:0/1678860954 shutdown_connections 2024-04-02T07:31:25.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.233+0000 7f2beae00640 1 -- 172.21.15.55:0/1678860954 wait complete. 2024-04-02T07:31:25.259 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-02T07:31:25.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.405+0000 7f6aae600640 1 Processor -- start 2024-04-02T07:31:25.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.405+0000 7f6aae600640 1 -- start start 2024-04-02T07:31:25.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.405+0000 7f6aae600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6aa815ca60 0x7f6aa80cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:25.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.405+0000 7f6aae600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6aa806c030 0x7f6aa8098ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:25.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.405+0000 7f6aae600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6aa815ce40 con 0x7f6aa8098a10 2024-04-02T07:31:25.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.405+0000 7f6aae600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa80993e0 con 0x7f6aa815ca60 2024-04-02T07:31:25.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.405+0000 7f6aae600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6aa806c440 con 0x7f6aa806c030 2024-04-02T07:31:25.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.405+0000 7f6aa7400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6aa815ca60 0x7f6aa80cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:25.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.405+0000 7f6aa7400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6aa815ca60 0x7f6aa80cfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52820/0 (socket says 172.21.15.55:52820) 2024-04-02T07:31:25.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.405+0000 7f6a9fe00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f6aa8098a10 0x7f6aa806b920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34198/0 (socket says 172.21.15.55:34198) 2024-04-02T07:31:25.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.405+0000 7f6aa7400640 1 -- 172.21.15.55:0/3961210363 learned_addr learned my addr 172.21.15.55:0/3961210363 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:25.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.405+0000 7f6aa7e00640 1 --2- 172.21.15.55:0/3961210363 >> v2:172.21.15.106:3300/0 conn(0x7f6aa806c030 0x7f6aa8098ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:25.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.405+0000 7f6aa7400640 1 -- 172.21.15.55:0/3961210363 >> v2:172.21.15.106:3300/0 conn(0x7f6aa806c030 msgr2=0x7f6aa8098ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:25.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.405+0000 7f6aa7400640 1 --2- 172.21.15.55:0/3961210363 >> v2:172.21.15.106:3300/0 conn(0x7f6aa806c030 0x7f6aa8098ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.405+0000 7f6aa7400640 1 -- 172.21.15.55:0/3961210363 >> v1:172.21.15.55:6789/0 conn(0x7f6aa8098a10 legacy=0x7f6aa806b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:25.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.405+0000 7f6aa7400640 1 -- 172.21.15.55:0/3961210363 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aa80d01b0 con 0x7f6aa815ca60 2024-04-02T07:31:25.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.409+0000 7f6aa7400640 1 --2- 172.21.15.55:0/3961210363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aa815ca60 0x7f6aa80cfc70 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f6aa809e5a0 tx=0x7f6a9801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ff9a7eb3f18d17f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:25.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.409+0000 7f6aa6a00640 1 -- 172.21.15.55:0/3961210363 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a980ab660 con 0x7f6aa815ca60 2024-04-02T07:31:25.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.409+0000 7f6aa6a00640 1 -- 172.21.15.55:0/3961210363 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a980ab7c0 con 0x7f6aa815ca60 2024-04-02T07:31:25.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.409+0000 7f6aa6a00640 1 -- 172.21.15.55:0/3961210363 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a980abb50 con 0x7f6aa815ca60 2024-04-02T07:31:25.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.409+0000 7f6aae600640 1 -- 172.21.15.55:0/3961210363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aa815ca60 msgr2=0x7f6aa80cfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:25.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.409+0000 7f6aae600640 1 --2- 172.21.15.55:0/3961210363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aa815ca60 0x7f6aa80cfc70 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f6aa809e5a0 tx=0x7f6a9801c460 comp rx=0 tx=0).stop 2024-04-02T07:31:25.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.409+0000 7f6aae600640 1 -- 172.21.15.55:0/3961210363 shutdown_connections 2024-04-02T07:31:25.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.409+0000 7f6aae600640 1 --2- 172.21.15.55:0/3961210363 >> v2:172.21.15.106:3300/0 conn(0x7f6aa806c030 0x7f6aa8098ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.409+0000 7f6aae600640 1 --2- 172.21.15.55:0/3961210363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aa815ca60 0x7f6aa80cfc70 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.409+0000 7f6aae600640 1 -- 172.21.15.55:0/3961210363 >> 172.21.15.55:0/3961210363 conn(0x7f6aa80b2150 msgr2=0x7f6aa80b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:25.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.409+0000 7f6aae600640 1 -- 172.21.15.55:0/3961210363 shutdown_connections 2024-04-02T07:31:25.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.409+0000 7f6aae600640 1 -- 172.21.15.55:0/3961210363 wait complete. 2024-04-02T07:31:25.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aae600640 1 Processor -- start 2024-04-02T07:31:25.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aae600640 1 -- start start 2024-04-02T07:31:25.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aae600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aa806c030 0x7f6aa815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:25.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aae600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6aa8098a10 0x7f6aa8154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:25.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aae600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6aa815ca60 0x7f6aa80ae2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:25.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aae600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa815aec0 con 0x7f6aa806c030 2024-04-02T07:31:25.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aae600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa815b1a0 con 0x7f6aa815ca60 2024-04-02T07:31:25.421 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aae600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa815b480 con 0x7f6aa8098a10 2024-04-02T07:31:25.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aa7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aa806c030 0x7f6aa815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:25.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aa7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aa806c030 0x7f6aa815a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52828/0 (socket says 172.21.15.55:52828) 2024-04-02T07:31:25.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aa7400640 1 -- 172.21.15.55:0/1180376543 learned_addr learned my addr 172.21.15.55:0/1180376543 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:25.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6a9fe00640 1 --2- 172.21.15.55:0/1180376543 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6aa8098a10 0x7f6aa8154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:25.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aa7e00640 1 --2- 172.21.15.55:0/1180376543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6aa815ca60 0x7f6aa80ae2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:25.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aa7400640 1 -- 172.21.15.55:0/1180376543 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6aa8098a10 msgr2=0x7f6aa8154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:25.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aa7400640 1 --2- 172.21.15.55:0/1180376543 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6aa8098a10 0x7f6aa8154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aa7400640 1 -- 172.21.15.55:0/1180376543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6aa815ca60 msgr2=0x7f6aa80ae2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:25.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aa7400640 1 --2- 172.21.15.55:0/1180376543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6aa815ca60 0x7f6aa80ae2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aa7400640 1 -- 172.21.15.55:0/1180376543 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a980094d0 con 0x7f6aa806c030 2024-04-02T07:31:25.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aa7e00640 1 --2- 172.21.15.55:0/1180376543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6aa815ca60 0x7f6aa80ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:25.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aa7400640 1 --2- 172.21.15.55:0/1180376543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aa806c030 0x7f6aa815a5e0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f6a98019070 tx=0x7f6a9801aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:25.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6a9f400640 1 -- 172.21.15.55:0/1180376543 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a980b4800 con 0x7f6aa806c030 2024-04-02T07:31:25.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6a9f400640 1 -- 172.21.15.55:0/1180376543 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a980b4980 con 0x7f6aa806c030 2024-04-02T07:31:25.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6a9f400640 1 -- 172.21.15.55:0/1180376543 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a980b4d30 con 0x7f6aa806c030 2024-04-02T07:31:25.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aae600640 1 -- 172.21.15.55:0/1180376543 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa815b760 con 0x7f6aa806c030 2024-04-02T07:31:25.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.413+0000 7f6aae600640 1 -- 172.21.15.55:0/1180376543 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa815ab20 con 0x7f6aa806c030 2024-04-02T07:31:25.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.417+0000 7f6aae600640 1 -- 172.21.15.55:0/1180376543 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6aa8066c90 con 0x7f6aa806c030 2024-04-02T07:31:25.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.417+0000 7f6a9f400640 1 -- 172.21.15.55:0/1180376543 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6a980a9070 con 0x7f6aa806c030 2024-04-02T07:31:25.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.417+0000 7f6a9f400640 1 --2- 172.21.15.55:0/1180376543 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a84066690 0x7f6a84068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:25.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.417+0000 7f6a9f400640 1 -- 172.21.15.55:0/1180376543 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f6a9811e550 con 0x7f6aa806c030 2024-04-02T07:31:25.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.417+0000 7f6a9fe00640 1 --2- 172.21.15.55:0/1180376543 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a84066690 0x7f6a84068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:25.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.417+0000 7f6a9fe00640 1 --2- 172.21.15.55:0/1180376543 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a84066690 0x7f6a84068b50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80d0630 tx=0x7f6a90007e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:25.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.421+0000 7f6a9f400640 1 -- 172.21.15.55:0/1180376543 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6a980ebc40 con 0x7f6aa806c030 2024-04-02T07:31:25.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.581+0000 7f6aae600640 1 -- 172.21.15.55:0/1180376543 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6aa815bc10 con 0x7f6aa806c030 2024-04-02T07:31:25.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.585+0000 7f6a9f400640 1 -- 172.21.15.55:0/1180376543 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6a980ef260 con 0x7f6aa806c030 2024-04-02T07:31:25.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.589+0000 7f6aae600640 1 -- 172.21.15.55:0/1180376543 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a84066690 msgr2=0x7f6a84068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:25.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.589+0000 7f6aae600640 1 --2- 172.21.15.55:0/1180376543 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a84066690 0x7f6a84068b50 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f6aa80d0630 tx=0x7f6a90007e50 comp rx=0 tx=0).stop 2024-04-02T07:31:25.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.589+0000 7f6aae600640 1 -- 172.21.15.55:0/1180376543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aa806c030 msgr2=0x7f6aa815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:25.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.589+0000 7f6aae600640 1 --2- 172.21.15.55:0/1180376543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aa806c030 0x7f6aa815a5e0 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7f6a98019070 tx=0x7f6a9801aca0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.589+0000 7f6aae600640 1 -- 172.21.15.55:0/1180376543 shutdown_connections 2024-04-02T07:31:25.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.589+0000 7f6aae600640 1 --2- 172.21.15.55:0/1180376543 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6a84066690 0x7f6a84068b50 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.589+0000 7f6aae600640 1 --2- 172.21.15.55:0/1180376543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6aa815ca60 0x7f6aa80ae2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.589+0000 7f6aae600640 1 --2- 172.21.15.55:0/1180376543 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6aa8098a10 0x7f6aa8154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.589+0000 7f6aae600640 1 --2- 172.21.15.55:0/1180376543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6aa806c030 0x7f6aa815a5e0 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.589+0000 7f6aae600640 1 -- 172.21.15.55:0/1180376543 >> 172.21.15.55:0/1180376543 conn(0x7f6aa80b2150 msgr2=0x7f6aa80afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:25.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.589+0000 7f6aae600640 1 -- 172.21.15.55:0/1180376543 shutdown_connections 2024-04-02T07:31:25.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.589+0000 7f6aae600640 1 -- 172.21.15.55:0/1180376543 wait complete. 2024-04-02T07:31:25.610 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-02T07:31:25.610 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:31:25.703 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:31:25.747 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-02T07:31:25.747 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:31:25.747 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:31:25.759 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:31:25.759 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:31:25.759 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:31:25.796 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:31:25.796 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:31:25.797 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:31:25.812 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:31:25.812 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:31:25.812 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:31:25.848 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:31:25.848 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-02T07:31:25.848 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:31:25.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.989+0000 7fb7e4400640 1 Processor -- start 2024-04-02T07:31:25.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.989+0000 7fb7e4400640 1 -- start start 2024-04-02T07:31:25.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.993+0000 7fb7e4400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb7dc15cbe0 0x7fb7dc0ce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:25.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.993+0000 7fb7e4400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7dc065d20 0x7fb7dc0b1c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:25.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.993+0000 7fb7e4400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb7dc070a80 0x7fb7dc070f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.993+0000 7fb7e4400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7dc0cec10 con 0x7fb7dc070a80 2024-04-02T07:31:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.993+0000 7fb7e4400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7dc071450 con 0x7fb7dc15cbe0 2024-04-02T07:31:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.993+0000 7fb7e4400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc06d5b0 con 0x7fb7dc065d20 2024-04-02T07:31:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.993+0000 7fb7e2400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb7dc070a80 0x7fb7dc070f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.993+0000 7fb7e2400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb7dc070a80 0x7fb7dc070f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43924/0 (socket says 172.21.15.55:43924) 2024-04-02T07:31:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.993+0000 7fb7e2400640 1 -- 172.21.15.55:0/3882853460 learned_addr learned my addr 172.21.15.55:0/3882853460 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.993+0000 7fb7e1000640 1 --2- 172.21.15.55:0/3882853460 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7dc065d20 0x7fb7dc0b1c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.993+0000 7fb7e1a00640 1 --2- 172.21.15.55:0/3882853460 >> v2:172.21.15.106:3300/0 conn(0x7fb7dc15cbe0 0x7fb7dc0ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.993+0000 7fb7e2400640 1 -- 172.21.15.55:0/3882853460 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7dc065d20 msgr2=0x7fb7dc0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.993+0000 7fb7e2400640 1 --2- 172.21.15.55:0/3882853460 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7dc065d20 0x7fb7dc0b1c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.993+0000 7fb7e2400640 1 -- 172.21.15.55:0/3882853460 >> v2:172.21.15.106:3300/0 conn(0x7fb7dc15cbe0 msgr2=0x7fb7dc0ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.993+0000 7fb7e2400640 1 --2- 172.21.15.55:0/3882853460 >> v2:172.21.15.106:3300/0 conn(0x7fb7dc15cbe0 0x7fb7dc0ce630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.993+0000 7fb7e2400640 1 -- 172.21.15.55:0/3882853460 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc06cc80 con 0x7fb7dc070a80 2024-04-02T07:31:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.993+0000 7fb7e1000640 1 --2- 172.21.15.55:0/3882853460 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7dc065d20 0x7fb7dc0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.993+0000 7fb7e1a00640 1 --2- 172.21.15.55:0/3882853460 >> v2:172.21.15.106:3300/0 conn(0x7fb7dc15cbe0 0x7fb7dc0ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:25.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.997+0000 7fb7e2400640 1 --2- 172.21.15.55:0/3882853460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7dc070a80 0x7fb7dc070f10 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0662e0 tx=0x7fb7d401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d9a719736cbf45 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:25.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.997+0000 7fb7dbe00640 1 -- 172.21.15.55:0/3882853460 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d40a5760 con 0x7fb7dc070a80 2024-04-02T07:31:25.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.997+0000 7fb7dbe00640 1 -- 172.21.15.55:0/3882853460 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d40a58c0 con 0x7fb7dc070a80 2024-04-02T07:31:25.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.997+0000 7fb7dbe00640 1 -- 172.21.15.55:0/3882853460 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d40a5c50 con 0x7fb7dc070a80 2024-04-02T07:31:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.997+0000 7fb7e4400640 1 -- 172.21.15.55:0/3882853460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7dc070a80 msgr2=0x7fb7dc070f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.997+0000 7fb7e4400640 1 --2- 172.21.15.55:0/3882853460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7dc070a80 0x7fb7dc070f10 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0662e0 tx=0x7fb7d401c9f0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.997+0000 7fb7e4400640 1 -- 172.21.15.55:0/3882853460 shutdown_connections 2024-04-02T07:31:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.997+0000 7fb7e4400640 1 --2- 172.21.15.55:0/3882853460 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7dc070a80 0x7fb7dc070f10 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.997+0000 7fb7e4400640 1 --2- 172.21.15.55:0/3882853460 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7dc065d20 0x7fb7dc0b1c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.997+0000 7fb7e4400640 1 --2- 172.21.15.55:0/3882853460 >> v2:172.21.15.106:3300/0 conn(0x7fb7dc15cbe0 0x7fb7dc0ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.997+0000 7fb7e4400640 1 -- 172.21.15.55:0/3882853460 >> 172.21.15.55:0/3882853460 conn(0x7fb7dc0ced50 msgr2=0x7fb7dc0cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.997+0000 7fb7e4400640 1 -- 172.21.15.55:0/3882853460 shutdown_connections 2024-04-02T07:31:25.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.997+0000 7fb7e4400640 1 -- 172.21.15.55:0/3882853460 wait complete. 2024-04-02T07:31:26.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.997+0000 7fb7e4400640 1 Processor -- start 2024-04-02T07:31:26.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:25.997+0000 7fb7e4400640 1 -- start start 2024-04-02T07:31:26.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e4400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7dc065d20 0x7fb7dc145cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e4400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7dc070a80 0x7fb7dc15de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e4400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7dc15cbe0 0x7fb7dc14f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e4400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc14e9c0 con 0x7fb7dc070a80 2024-04-02T07:31:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e4400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc14eca0 con 0x7fb7dc15cbe0 2024-04-02T07:31:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e4400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7dc14ef80 con 0x7fb7dc065d20 2024-04-02T07:31:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e1000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7dc070a80 0x7fb7dc15de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e1000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7dc070a80 0x7fb7dc15de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43932/0 (socket says 172.21.15.55:43932) 2024-04-02T07:31:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e1000640 1 -- 172.21.15.55:0/2937201477 learned_addr learned my addr 172.21.15.55:0/2937201477 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e1a00640 1 --2- 172.21.15.55:0/2937201477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7dc065d20 0x7fb7dc145cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e2400640 1 --2- 172.21.15.55:0/2937201477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7dc15cbe0 0x7fb7dc14f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:26.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e1000640 1 -- 172.21.15.55:0/2937201477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7dc065d20 msgr2=0x7fb7dc145cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e1000640 1 --2- 172.21.15.55:0/2937201477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7dc065d20 0x7fb7dc145cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e1000640 1 -- 172.21.15.55:0/2937201477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7dc15cbe0 msgr2=0x7fb7dc14f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e1000640 1 --2- 172.21.15.55:0/2937201477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7dc15cbe0 0x7fb7dc14f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e1000640 1 -- 172.21.15.55:0/2937201477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d4009b30 con 0x7fb7dc070a80 2024-04-02T07:31:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e2400640 1 --2- 172.21.15.55:0/2937201477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7dc15cbe0 0x7fb7dc14f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e1000640 1 --2- 172.21.15.55:0/2937201477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7dc070a80 0x7fb7dc15de40 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fb7c800e810 tx=0x7fb7c800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7d9600640 1 -- 172.21.15.55:0/2937201477 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c800c8d0 con 0x7fb7dc070a80 2024-04-02T07:31:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7d9600640 1 -- 172.21.15.55:0/2937201477 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7c800ca30 con 0x7fb7dc070a80 2024-04-02T07:31:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7d9600640 1 -- 172.21.15.55:0/2937201477 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7c800cdc0 con 0x7fb7dc070a80 2024-04-02T07:31:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e4400640 1 -- 172.21.15.55:0/2937201477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7dc155410 con 0x7fb7dc070a80 2024-04-02T07:31:26.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e4400640 1 -- 172.21.15.55:0/2937201477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7dc15e380 con 0x7fb7dc070a80 2024-04-02T07:31:26.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7e4400640 1 -- 172.21.15.55:0/2937201477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7dc066c90 con 0x7fb7dc070a80 2024-04-02T07:31:26.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.001+0000 7fb7d9600640 1 -- 172.21.15.55:0/2937201477 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb7c8013410 con 0x7fb7dc070a80 2024-04-02T07:31:26.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.005+0000 7fb7d9600640 1 --2- 172.21.15.55:0/2937201477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7bc066690 0x7fb7bc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:26.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.005+0000 7fb7d9600640 1 -- 172.21.15.55:0/2937201477 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fb7c8083cc0 con 0x7fb7dc070a80 2024-04-02T07:31:26.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.005+0000 7fb7e1a00640 1 --2- 172.21.15.55:0/2937201477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7bc066690 0x7fb7bc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:26.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.005+0000 7fb7e1a00640 1 --2- 172.21.15.55:0/2937201477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7bc066690 0x7fb7bc068b50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc14e770 tx=0x7fb7d0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:26.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.005+0000 7fb7d9600640 1 -- 172.21.15.55:0/2937201477 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fb7c808a080 con 0x7fb7dc070a80 2024-04-02T07:31:26.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.205+0000 7fb7e4400640 1 -- 172.21.15.55:0/2937201477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7dc0b3050 con 0x7fb7dc070a80 2024-04-02T07:31:26.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.205+0000 7fb7d9600640 1 -- 172.21.15.55:0/2937201477 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fb7c8021de0 con 0x7fb7dc070a80 2024-04-02T07:31:26.207 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:26.207 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":75,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6446,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/2209852195","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2209852195},{"type":"v1","addr":"172.21.15.55:6835","nonce":2209852195}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6449,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6835/1897181831","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":1897181831},{"type":"v1","addr":"172.21.15.106:6835","nonce":1897181831}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":55},{"gid":6611,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/1894364429","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6836","nonce":1894364429},{"type":"v1","addr":"172.21.15.106:6837","nonce":1894364429}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":8352,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/1951352336","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1951352336},{"type":"v1","addr":"172.21.15.55:6834","nonce":1951352336}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":75}],"filesystems":[]} 2024-04-02T07:31:26.207 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 75 2024-04-02T07:31:26.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.205+0000 7fb7e4400640 1 -- 172.21.15.55:0/2937201477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7bc066690 msgr2=0x7fb7bc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:26.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.205+0000 7fb7e4400640 1 --2- 172.21.15.55:0/2937201477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7bc066690 0x7fb7bc068b50 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc14e770 tx=0x7fb7d0008040 comp rx=0 tx=0).stop 2024-04-02T07:31:26.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.205+0000 7fb7e4400640 1 -- 172.21.15.55:0/2937201477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7dc070a80 msgr2=0x7fb7dc15de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:26.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.205+0000 7fb7e4400640 1 --2- 172.21.15.55:0/2937201477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7dc070a80 0x7fb7dc15de40 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fb7c800e810 tx=0x7fb7c800ecd0 comp rx=0 tx=0).stop 2024-04-02T07:31:26.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.205+0000 7fb7e4400640 1 -- 172.21.15.55:0/2937201477 shutdown_connections 2024-04-02T07:31:26.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.205+0000 7fb7e4400640 1 --2- 172.21.15.55:0/2937201477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7bc066690 0x7fb7bc068b50 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:26.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.205+0000 7fb7e4400640 1 --2- 172.21.15.55:0/2937201477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7dc15cbe0 0x7fb7dc14f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:26.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.205+0000 7fb7e4400640 1 --2- 172.21.15.55:0/2937201477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7dc070a80 0x7fb7dc15de40 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:26.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.205+0000 7fb7e4400640 1 --2- 172.21.15.55:0/2937201477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7dc065d20 0x7fb7dc145cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:26.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.205+0000 7fb7e4400640 1 -- 172.21.15.55:0/2937201477 >> 172.21.15.55:0/2937201477 conn(0x7fb7dc0ced50 msgr2=0x7fb7dc0b3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:26.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.205+0000 7fb7e4400640 1 -- 172.21.15.55:0/2937201477 shutdown_connections 2024-04-02T07:31:26.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.205+0000 7fb7e4400640 1 -- 172.21.15.55:0/2937201477 wait complete. 2024-04-02T07:31:26.228 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-02T07:31:26.229 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-02T07:31:26.229 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-02T07:31:26.229 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:31:26.229 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-02T07:31:26.229 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-02T07:31:26.229 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-02T07:31:26.230 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:31:26.230 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-02T07:31:26.230 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-02T07:31:26.230 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-02T07:31:26.230 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:31:26.230 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-02T07:31:26.230 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-02T07:31:26.231 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-02T07:31:26.231 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:31:26.244 INFO:tasks.ceph.mds.a:Stopped 2024-04-02T07:31:26.244 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-02T07:31:26.245 INFO:tasks.ceph.mds.c:Stopped 2024-04-02T07:31:26.245 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-02T07:31:26.246 INFO:tasks.ceph.mds.d:Stopped 2024-04-02T07:31:26.246 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-02T07:31:26.247 INFO:tasks.ceph.mds.b:Stopped 2024-04-02T07:31:26.247 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-02T07:31:26.287 INFO:tasks.ceph.mds.a:Started 2024-04-02T07:31:26.288 DEBUG:teuthology.parallel:result is None 2024-04-02T07:31:26.289 INFO:tasks.ceph.mds.c:Started 2024-04-02T07:31:26.289 DEBUG:teuthology.parallel:result is None 2024-04-02T07:31:26.294 INFO:tasks.ceph.mds.d:Started 2024-04-02T07:31:26.295 DEBUG:teuthology.parallel:result is None 2024-04-02T07:31:26.296 INFO:tasks.ceph.mds.b:Started 2024-04-02T07:31:26.296 DEBUG:teuthology.parallel:result is None 2024-04-02T07:31:26.296 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-02T07:31:26.375 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-02T07:31:26.376 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-02T07:31:26.384 INFO:tasks.ceph.mds.d.smithi106.stdout:starting mds.d at 2024-04-02T07:31:26.384 INFO:tasks.ceph.mds.b.smithi106.stdout:starting mds.b at 2024-04-02T07:31:26.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.445+0000 7f4d21600640 1 Processor -- start 2024-04-02T07:31:26.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.445+0000 7f4d21600640 1 -- start start 2024-04-02T07:31:26.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.449+0000 7f4d21600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4d1c099120 0x7f4d1c0b1320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:26.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.449+0000 7f4d21600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1c0b1ae0 con 0x7f4d1c099750 2024-04-02T07:31:26.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.449+0000 7f4d21600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d1c0ce240 con 0x7f4d1c15ded0 2024-04-02T07:31:26.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.449+0000 7f4d21600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d1c099b60 con 0x7f4d1c099120 2024-04-02T07:31:26.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.449+0000 7f4d13e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4d1c099120 0x7f4d1c0b1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:26.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.449+0000 7f4d13e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4d1c099120 0x7f4d1c0b1320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43988/0 (socket says 172.21.15.55:43988) 2024-04-02T07:31:26.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.449+0000 7f4d1b400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4d1c099750 0x7f4d1c0ce9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40542/0 (socket says 172.21.15.55:40542) 2024-04-02T07:31:26.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.449+0000 7f4d13e00640 1 -- 172.21.15.55:0/1184923752 learned_addr learned my addr 172.21.15.55:0/1184923752 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:26.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.449+0000 7f4d13e00640 1 -- 172.21.15.55:0/1184923752 >> v1:172.21.15.106:6789/0 conn(0x7f4d1c15ded0 legacy=0x7f4d1c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:26.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.449+0000 7f4d13e00640 1 -- 172.21.15.55:0/1184923752 >> v1:172.21.15.55:6789/0 conn(0x7f4d1c099750 legacy=0x7f4d1c0ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:26.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.449+0000 7f4d13e00640 1 -- 172.21.15.55:0/1184923752 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d1c15e2b0 con 0x7f4d1c099120 2024-04-02T07:31:26.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.449+0000 7f4d1a000640 1 -- 172.21.15.55:0/1184923752 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3855204972 0 0) 0x7f4d1c0b1ae0 con 0x7f4d1c099750 2024-04-02T07:31:26.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.453+0000 7f4d13e00640 1 --2- 172.21.15.55:0/1184923752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d1c099120 0x7f4d1c0b1320 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009870 tx=0x7f4d0401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4cd04b5acb00a34 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:26.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.453+0000 7f4d1a000640 1 -- 172.21.15.55:0/1184923752 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d040ab600 con 0x7f4d1c099120 2024-04-02T07:31:26.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.453+0000 7f4d1a000640 1 -- 172.21.15.55:0/1184923752 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d040a7050 con 0x7f4d1c099120 2024-04-02T07:31:26.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.453+0000 7f4d1a000640 1 -- 172.21.15.55:0/1184923752 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d040ab980 con 0x7f4d1c099120 2024-04-02T07:31:26.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.453+0000 7f4d21600640 1 -- 172.21.15.55:0/1184923752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d1c099120 msgr2=0x7f4d1c0b1320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:26.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.453+0000 7f4d21600640 1 --2- 172.21.15.55:0/1184923752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d1c099120 0x7f4d1c0b1320 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f4d04009870 tx=0x7f4d0401c520 comp rx=0 tx=0).stop 2024-04-02T07:31:26.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.453+0000 7f4d21600640 1 -- 172.21.15.55:0/1184923752 shutdown_connections 2024-04-02T07:31:26.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.453+0000 7f4d21600640 1 --2- 172.21.15.55:0/1184923752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d1c099120 0x7f4d1c0b1320 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:26.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.453+0000 7f4d21600640 1 -- 172.21.15.55:0/1184923752 >> 172.21.15.55:0/1184923752 conn(0x7f4d1c0b2160 msgr2=0x7f4d1c0b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:26.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.453+0000 7f4d21600640 1 -- 172.21.15.55:0/1184923752 shutdown_connections 2024-04-02T07:31:26.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.453+0000 7f4d21600640 1 -- 172.21.15.55:0/1184923752 wait complete. 2024-04-02T07:31:26.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.453+0000 7f4d21600640 1 Processor -- start 2024-04-02T07:31:26.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d21600640 1 -- start start 2024-04-02T07:31:26.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d21600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d1c099120 0x7f4d1c0b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:26.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d21600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d1c099750 0x7f4d1c153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:26.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d21600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d1c15ded0 0x7f4d1c1588b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:26.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d21600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c158420 con 0x7f4d1c15ded0 2024-04-02T07:31:26.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d21600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c0b5a70 con 0x7f4d1c099750 2024-04-02T07:31:26.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d21600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d1c157b30 con 0x7f4d1c099120 2024-04-02T07:31:26.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d1b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d1c15ded0 0x7f4d1c1588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:26.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d1b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d1c15ded0 0x7f4d1c1588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43998/0 (socket says 172.21.15.55:43998) 2024-04-02T07:31:26.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d1b400640 1 -- 172.21.15.55:0/1778187623 learned_addr learned my addr 172.21.15.55:0/1778187623 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:26.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d1aa00640 1 --2- 172.21.15.55:0/1778187623 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d1c099120 0x7f4d1c0b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:26.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d13e00640 1 --2- 172.21.15.55:0/1778187623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d1c099750 0x7f4d1c153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:26.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d1b400640 1 -- 172.21.15.55:0/1778187623 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d1c099120 msgr2=0x7f4d1c0b5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:26.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d1b400640 1 --2- 172.21.15.55:0/1778187623 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d1c099120 0x7f4d1c0b5390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:26.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d1b400640 1 -- 172.21.15.55:0/1778187623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d1c099750 msgr2=0x7f4d1c153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:26.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d1b400640 1 --2- 172.21.15.55:0/1778187623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d1c099750 0x7f4d1c153070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:26.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d1b400640 1 -- 172.21.15.55:0/1778187623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d040094d0 con 0x7f4d1c15ded0 2024-04-02T07:31:26.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d1b400640 1 --2- 172.21.15.55:0/1778187623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d1c15ded0 0x7f4d1c1588b0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400c7a0 tx=0x7f4d1400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:26.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d12a00640 1 -- 172.21.15.55:0/1778187623 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1400a640 con 0x7f4d1c15ded0 2024-04-02T07:31:26.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d12a00640 1 -- 172.21.15.55:0/1778187623 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d1400a7a0 con 0x7f4d1c15ded0 2024-04-02T07:31:26.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d12a00640 1 -- 172.21.15.55:0/1778187623 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d1400abd0 con 0x7f4d1c15ded0 2024-04-02T07:31:26.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d21600640 1 -- 172.21.15.55:0/1778187623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d1c154120 con 0x7f4d1c15ded0 2024-04-02T07:31:26.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.457+0000 7f4d21600640 1 -- 172.21.15.55:0/1778187623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1c1580b0 con 0x7f4d1c15ded0 2024-04-02T07:31:26.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.461+0000 7f4d21600640 1 -- 172.21.15.55:0/1778187623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1c158590 con 0x7f4d1c15ded0 2024-04-02T07:31:26.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.461+0000 7f4d12a00640 1 -- 172.21.15.55:0/1778187623 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f4d1400ad30 con 0x7f4d1c15ded0 2024-04-02T07:31:26.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.461+0000 7f4d12a00640 1 --2- 172.21.15.55:0/1778187623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4cf80666c0 0x7f4cf8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:26.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.461+0000 7f4d12a00640 1 -- 172.21.15.55:0/1778187623 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f4d140832f0 con 0x7f4d1c15ded0 2024-04-02T07:31:26.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.461+0000 7f4d1aa00640 1 --2- 172.21.15.55:0/1778187623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4cf80666c0 0x7f4cf8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:26.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.461+0000 7f4d1aa00640 1 --2- 172.21.15.55:0/1778187623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4cf80666c0 0x7f4cf8068b80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0098e0 tx=0x7f4d0c009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:26.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.465+0000 7f4d12a00640 1 -- 172.21.15.55:0/1778187623 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f4d14050950 con 0x7f4d1c15ded0 2024-04-02T07:31:26.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:26.637+0000 7f4d21600640 1 -- 172.21.15.55:0/1778187623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4d1c066c90 con 0x7f4d1c15ded0 2024-04-02T07:31:27.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.425+0000 7f4d12a00640 1 -- 172.21.15.55:0/1778187623 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v99) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4d14053f70 con 0x7f4d1c15ded0 2024-04-02T07:31:27.426 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2024-04-02T07:31:27.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.425+0000 7f4d21600640 1 -- 172.21.15.55:0/1778187623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4cf80666c0 msgr2=0x7f4cf8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:27.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.425+0000 7f4d21600640 1 --2- 172.21.15.55:0/1778187623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4cf80666c0 0x7f4cf8068b80 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c0098e0 tx=0x7f4d0c009060 comp rx=0 tx=0).stop 2024-04-02T07:31:27.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.425+0000 7f4d21600640 1 -- 172.21.15.55:0/1778187623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d1c15ded0 msgr2=0x7f4d1c1588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:27.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.425+0000 7f4d21600640 1 --2- 172.21.15.55:0/1778187623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d1c15ded0 0x7f4d1c1588b0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7f4d1400c7a0 tx=0x7f4d1400cc60 comp rx=0 tx=0).stop 2024-04-02T07:31:27.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.425+0000 7f4d21600640 1 -- 172.21.15.55:0/1778187623 shutdown_connections 2024-04-02T07:31:27.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.425+0000 7f4d21600640 1 --2- 172.21.15.55:0/1778187623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4d1c15ded0 0x7f4d1c1588b0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:27.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.425+0000 7f4d21600640 1 --2- 172.21.15.55:0/1778187623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4cf80666c0 0x7f4cf8068b80 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:27.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.425+0000 7f4d21600640 1 --2- 172.21.15.55:0/1778187623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4d1c099750 0x7f4d1c153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:27.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.425+0000 7f4d21600640 1 --2- 172.21.15.55:0/1778187623 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4d1c099120 0x7f4d1c0b5390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:27.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.425+0000 7f4d21600640 1 -- 172.21.15.55:0/1778187623 >> 172.21.15.55:0/1778187623 conn(0x7f4d1c0b2160 msgr2=0x7f4d1c06fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:27.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.425+0000 7f4d21600640 1 -- 172.21.15.55:0/1778187623 shutdown_connections 2024-04-02T07:31:27.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.425+0000 7f4d21600640 1 -- 172.21.15.55:0/1778187623 wait complete. 2024-04-02T07:31:27.451 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-02T07:31:27.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.589+0000 7f06ffe00640 1 Processor -- start 2024-04-02T07:31:27.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.593+0000 7f06ffe00640 1 -- start start 2024-04-02T07:31:27.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.593+0000 7f06ffe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f06f815ca70 0x7f06f80b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:27.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.593+0000 7f06ffe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06f806b700 0x7f06f8098ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:27.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.593+0000 7f06ffe00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f815ce50 con 0x7f06f8098a10 2024-04-02T07:31:27.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.593+0000 7f06ffe00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f80993e0 con 0x7f06f806b700 2024-04-02T07:31:27.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.593+0000 7f06ffe00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f80cef60 con 0x7f06f815ca70 2024-04-02T07:31:27.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.593+0000 7f06fde00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06f806b700 0x7f06f8098ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:27.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.593+0000 7f06fca00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f06f8098a10 0x7f06f806aff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40546/0 (socket says 172.21.15.55:40546) 2024-04-02T07:31:27.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.593+0000 7f06fca00640 1 -- 172.21.15.55:0/2179046421 learned_addr learned my addr 172.21.15.55:0/2179046421 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:27.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.593+0000 7f06fd400640 1 --2- 172.21.15.55:0/2179046421 >> v2:172.21.15.106:3300/0 conn(0x7f06f815ca70 0x7f06f80b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:27.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.593+0000 7f06fde00640 1 -- 172.21.15.55:0/2179046421 >> v2:172.21.15.106:3300/0 conn(0x7f06f815ca70 msgr2=0x7f06f80b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:27.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.593+0000 7f06fde00640 1 --2- 172.21.15.55:0/2179046421 >> v2:172.21.15.106:3300/0 conn(0x7f06f815ca70 0x7f06f80b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:27.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.593+0000 7f06fde00640 1 -- 172.21.15.55:0/2179046421 >> v1:172.21.15.55:6789/0 conn(0x7f06f8098a10 legacy=0x7f06f806aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:27.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.593+0000 7f06fde00640 1 -- 172.21.15.55:0/2179046421 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f806bd60 con 0x7f06f806b700 2024-04-02T07:31:27.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.593+0000 7f06f7e00640 1 -- 172.21.15.55:0/2179046421 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1867839596 0 0) 0x7f06f815ce50 con 0x7f06f8098a10 2024-04-02T07:31:27.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.593+0000 7f06fd400640 1 --2- 172.21.15.55:0/2179046421 >> v2:172.21.15.106:3300/0 conn(0x7f06f815ca70 0x7f06f80b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:27.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.597+0000 7f06fde00640 1 --2- 172.21.15.55:0/2179046421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f806b700 0x7f06f8098ea0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f06f8071f60 tx=0x7f06f001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eface6b1c20b8d70 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:27.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.597+0000 7f06f7e00640 1 -- 172.21.15.55:0/2179046421 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f00a58e0 con 0x7f06f806b700 2024-04-02T07:31:27.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.597+0000 7f06f7e00640 1 -- 172.21.15.55:0/2179046421 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f00a5a40 con 0x7f06f806b700 2024-04-02T07:31:27.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.597+0000 7f06f7e00640 1 -- 172.21.15.55:0/2179046421 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f00a5dd0 con 0x7f06f806b700 2024-04-02T07:31:27.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.597+0000 7f06ffe00640 1 -- 172.21.15.55:0/2179046421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f806b700 msgr2=0x7f06f8098ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:27.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.597+0000 7f06ffe00640 1 --2- 172.21.15.55:0/2179046421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f806b700 0x7f06f8098ea0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f06f8071f60 tx=0x7f06f001c930 comp rx=0 tx=0).stop 2024-04-02T07:31:27.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.597+0000 7f06ffe00640 1 -- 172.21.15.55:0/2179046421 shutdown_connections 2024-04-02T07:31:27.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.597+0000 7f06ffe00640 1 --2- 172.21.15.55:0/2179046421 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f806b700 0x7f06f8098ea0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:27.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.597+0000 7f06ffe00640 1 --2- 172.21.15.55:0/2179046421 >> v2:172.21.15.106:3300/0 conn(0x7f06f815ca70 0x7f06f80b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:27.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.597+0000 7f06ffe00640 1 -- 172.21.15.55:0/2179046421 >> 172.21.15.55:0/2179046421 conn(0x7f06f80b21d0 msgr2=0x7f06f80b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:27.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.597+0000 7f06ffe00640 1 -- 172.21.15.55:0/2179046421 shutdown_connections 2024-04-02T07:31:27.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.597+0000 7f06ffe00640 1 -- 172.21.15.55:0/2179046421 wait complete. 2024-04-02T07:31:27.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.597+0000 7f06ffe00640 1 Processor -- start 2024-04-02T07:31:27.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.597+0000 7f06ffe00640 1 -- start start 2024-04-02T07:31:27.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06ffe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06f806b700 0x7f06f8154a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:27.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06ffe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06f8098a10 0x7f06f8153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:27.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06ffe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f815ca70 0x7f06f814ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:27.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06ffe00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f81550c0 con 0x7f06f815ca70 2024-04-02T07:31:27.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06ffe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f8153ec0 con 0x7f06f806b700 2024-04-02T07:31:27.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06ffe00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f815ee90 con 0x7f06f8098a10 2024-04-02T07:31:27.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06fde00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f815ca70 0x7f06f814ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:27.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06fde00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f815ca70 0x7f06f814ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44008/0 (socket says 172.21.15.55:44008) 2024-04-02T07:31:27.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06fde00640 1 -- 172.21.15.55:0/3090582250 learned_addr learned my addr 172.21.15.55:0/3090582250 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:27.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06fca00640 1 --2- 172.21.15.55:0/3090582250 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06f8098a10 0x7f06f8153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:27.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06fd400640 1 --2- 172.21.15.55:0/3090582250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06f806b700 0x7f06f8154a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:27.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06fde00640 1 -- 172.21.15.55:0/3090582250 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06f8098a10 msgr2=0x7f06f8153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:27.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06fde00640 1 --2- 172.21.15.55:0/3090582250 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06f8098a10 0x7f06f8153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:27.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06fde00640 1 -- 172.21.15.55:0/3090582250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06f806b700 msgr2=0x7f06f8154a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:27.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06fde00640 1 --2- 172.21.15.55:0/3090582250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06f806b700 0x7f06f8154a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:27.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06fde00640 1 -- 172.21.15.55:0/3090582250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f0009a70 con 0x7f06f815ca70 2024-04-02T07:31:27.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06fde00640 1 --2- 172.21.15.55:0/3090582250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f815ca70 0x7f06f814ba00 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f06f00b0040 tx=0x7f06f00196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:27.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06f5600640 1 -- 172.21.15.55:0/3090582250 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f00ad950 con 0x7f06f815ca70 2024-04-02T07:31:27.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06f5600640 1 -- 172.21.15.55:0/3090582250 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f00adab0 con 0x7f06f815ca70 2024-04-02T07:31:27.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06f5600640 1 -- 172.21.15.55:0/3090582250 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f00ade60 con 0x7f06f815ca70 2024-04-02T07:31:27.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06ffe00640 1 -- 172.21.15.55:0/3090582250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f815f170 con 0x7f06f815ca70 2024-04-02T07:31:27.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06ffe00640 1 -- 172.21.15.55:0/3090582250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f815f730 con 0x7f06f815ca70 2024-04-02T07:31:27.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06ffe00640 1 -- 172.21.15.55:0/3090582250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f815f920 con 0x7f06f815ca70 2024-04-02T07:31:27.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.601+0000 7f06f5600640 1 -- 172.21.15.55:0/3090582250 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f06f00b4050 con 0x7f06f815ca70 2024-04-02T07:31:27.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.605+0000 7f06f5600640 1 --2- 172.21.15.55:0/3090582250 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f06d8066690 0x7f06d8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:27.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.605+0000 7f06f5600640 1 -- 172.21.15.55:0/3090582250 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f06f011edc0 con 0x7f06f815ca70 2024-04-02T07:31:27.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.605+0000 7f06fd400640 1 --2- 172.21.15.55:0/3090582250 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f06d8066690 0x7f06d8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:27.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.605+0000 7f06fd400640 1 --2- 172.21.15.55:0/3090582250 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f06d8066690 0x7f06d8068b50 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f06ec006fd0 tx=0x7f06ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:27.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.609+0000 7f06f5600640 1 -- 172.21.15.55:0/3090582250 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f06f00ec610 con 0x7f06f815ca70 2024-04-02T07:31:27.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.825+0000 7f06ffe00640 1 -- 172.21.15.55:0/3090582250 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f06f8066c90 con 0x7f06f815ca70 2024-04-02T07:31:27.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.825+0000 7f06f5600640 1 -- 172.21.15.55:0/3090582250 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f06f00b2020 con 0x7f06f815ca70 2024-04-02T07:31:27.826 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:27.826 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:31:27.826 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2024-04-02T07:31:27.826 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:31:27.827 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2024-04-02T07:31:27.827 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFL1DHxAAuUs47l42sADNRgxi4BeNrA==", 2024-04-02T07:31:27.827 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:31:27.827 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:31:27.827 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:31:27.827 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:31:27.827 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:31:27.827 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:27.827 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:27.827 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:31:27.827 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2024-04-02T07:31:27.827 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFZB+KxAAeKnfP4Z1UkLura+bQrG5mA==", 2024-04-02T07:31:27.827 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:31:27.827 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:31:27.828 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:31:27.828 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:31:27.828 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:31:27.828 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:27.828 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:27.828 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:31:27.828 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2024-04-02T07:31:27.828 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmUQR/JhAA9LNK5gHJ1NiiqNrfxL4mIA==", 2024-04-02T07:31:27.828 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:31:27.828 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:31:27.828 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:31:27.828 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:31:27.828 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:31:27.828 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:27.829 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:27.829 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:31:27.829 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2024-04-02T07:31:27.829 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmotumMhAASI1PogpVSHXWIv9xq3qs4Q==", 2024-04-02T07:31:27.829 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:31:27.829 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:31:27.829 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:31:27.829 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:31:27.829 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:31:27.829 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:27.829 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:27.829 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:31:27.829 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2024-04-02T07:31:27.829 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDysQtmsM9JIxAAZNjTGYW74kqz5NM9NyPSWQ==", 2024-04-02T07:31:27.829 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:31:27.830 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:31:27.830 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:31:27.830 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:31:27.830 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:27.830 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:27.830 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:31:27.830 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2024-04-02T07:31:27.830 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD1sQtmJaorKhAAtujPXPmQVX3QUG1ANqEphQ==", 2024-04-02T07:31:27.830 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:31:27.830 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:31:27.830 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:31:27.831 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:31:27.831 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:27.831 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:27.831 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:31:27.831 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2024-04-02T07:31:27.831 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD4sQtm1fdwMhAAOxlYwaBnPKhSQODMLVbaSQ==", 2024-04-02T07:31:27.831 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:31:27.831 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:31:27.831 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:31:27.831 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:31:27.831 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:27.831 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:27.831 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:31:27.831 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2024-04-02T07:31:27.832 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD7sQtmo9OaORAAsjpiVkG9vZV1QxpvgbrFmg==", 2024-04-02T07:31:27.832 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:31:27.832 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:31:27.832 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:31:27.832 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:31:27.832 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:27.832 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:27.832 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:31:27.832 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2024-04-02T07:31:27.832 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQACsgtmTyOkAxAARfxuj/YCM6FWNDhCkLQV3g==", 2024-04-02T07:31:27.832 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:31:27.832 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:31:27.832 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:31:27.832 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:31:27.833 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:27.833 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:27.833 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:31:27.833 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2024-04-02T07:31:27.833 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAFsgtmimDECRAAh/XVN7rICihc8NlxhDJB6Q==", 2024-04-02T07:31:27.833 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:31:27.833 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:31:27.833 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:31:27.833 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:31:27.833 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:27.833 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:27.833 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:31:27.833 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2024-04-02T07:31:27.833 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAIsgtmreHiDhAAISQbxixad17TRrz7MHQTxA==", 2024-04-02T07:31:27.833 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:31:27.834 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:31:27.834 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:31:27.834 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:31:27.834 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:27.834 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:27.834 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:31:27.834 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2024-04-02T07:31:27.834 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQALsgtmHVTlExAAT/6jK+czOZ3+4nwpgZOmow==", 2024-04-02T07:31:27.834 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:31:27.834 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:31:27.834 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:31:27.834 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:31:27.835 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:27.835 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:27.835 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:31:27.835 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2024-04-02T07:31:27.835 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmkS2QNhAAt+q0y1TDn03hqM/Y6uKq6g==", 2024-04-02T07:31:27.835 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:31:27.835 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:31:27.835 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2024-04-02T07:31:27.835 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-02T07:31:27.835 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:27.835 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:27.836 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:31:27.836 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2024-04-02T07:31:27.836 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmjCzTBBAAVYyat2dGZSTquRQoB+7JMg==", 2024-04-02T07:31:27.836 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:31:27.836 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:31:27.836 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:31:27.836 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:31:27.836 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:31:27.836 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:27.836 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:27.836 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:31:27.836 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2024-04-02T07:31:27.836 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmq45FARAAY6/caSeqvTn7/BThOodYIA==", 2024-04-02T07:31:27.836 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:31:27.837 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:31:27.837 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:31:27.837 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:31:27.837 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:31:27.837 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:27.837 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:27.837 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:31:27.837 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2024-04-02T07:31:27.837 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmmjDeChAAL2RsY5VlAy/KZ5go5ZJoBA==", 2024-04-02T07:31:27.837 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:31:27.837 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:31:27.837 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:31:27.837 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:31:27.837 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:31:27.838 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:27.838 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:27.838 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:31:27.838 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2024-04-02T07:31:27.838 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtm1hiMAxAAarlHR9VHGrkPCXhksMM/1w==", 2024-04-02T07:31:27.838 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:31:27.838 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:31:27.838 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:31:27.838 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:31:27.838 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:31:27.838 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:27.838 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:27.838 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:31:27.838 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2024-04-02T07:31:27.838 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFyktGxAAJC7ezewbXwDQue+qjpTfYw==", 2024-04-02T07:31:27.839 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:31:27.839 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:31:27.839 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-02T07:31:27.839 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:31:27.839 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:27.839 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:27.839 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:31:27.839 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2024-04-02T07:31:27.839 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmUcxUFxAA8NUHdxhUfp3/AILMIbS1fw==", 2024-04-02T07:31:27.839 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:31:27.839 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:31:27.839 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-02T07:31:27.839 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:31:27.839 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:27.840 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:27.840 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-04-02T07:31:27.840 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:31:27.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.825+0000 7f06ffe00640 1 -- 172.21.15.55:0/3090582250 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f06d8066690 msgr2=0x7f06d8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:27.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.825+0000 7f06ffe00640 1 --2- 172.21.15.55:0/3090582250 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f06d8066690 0x7f06d8068b50 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f06ec006fd0 tx=0x7f06ec008040 comp rx=0 tx=0).stop 2024-04-02T07:31:27.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.825+0000 7f06ffe00640 1 -- 172.21.15.55:0/3090582250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f815ca70 msgr2=0x7f06f814ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:27.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.825+0000 7f06ffe00640 1 --2- 172.21.15.55:0/3090582250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f815ca70 0x7f06f814ba00 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f06f00b0040 tx=0x7f06f00196d0 comp rx=0 tx=0).stop 2024-04-02T07:31:27.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.825+0000 7f06ffe00640 1 -- 172.21.15.55:0/3090582250 shutdown_connections 2024-04-02T07:31:27.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.825+0000 7f06ffe00640 1 --2- 172.21.15.55:0/3090582250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06f815ca70 0x7f06f814ba00 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:27.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.825+0000 7f06ffe00640 1 --2- 172.21.15.55:0/3090582250 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06f8098a10 0x7f06f8153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:27.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.825+0000 7f06ffe00640 1 --2- 172.21.15.55:0/3090582250 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f06d8066690 0x7f06d8068b50 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:27.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.825+0000 7f06ffe00640 1 --2- 172.21.15.55:0/3090582250 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06f806b700 0x7f06f8154a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:27.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.825+0000 7f06ffe00640 1 -- 172.21.15.55:0/3090582250 >> 172.21.15.55:0/3090582250 conn(0x7f06f80b21d0 msgr2=0x7f06f8155330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:27.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.825+0000 7f06ffe00640 1 -- 172.21.15.55:0/3090582250 shutdown_connections 2024-04-02T07:31:27.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.825+0000 7f06ffe00640 1 -- 172.21.15.55:0/3090582250 wait complete. 2024-04-02T07:31:27.847 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:31:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.985+0000 7f44fa000640 1 Processor -- start 2024-04-02T07:31:27.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.985+0000 7f44fa000640 1 -- start start 2024-04-02T07:31:27.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.985+0000 7f44fa000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44f40b38c0 0x7f44f4164210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.985+0000 7f44fa000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f413d0c0 con 0x7f44f4153ea0 2024-04-02T07:31:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.985+0000 7f44fa000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44f415a4f0 con 0x7f44f40c4120 2024-04-02T07:31:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.985+0000 7f44fa000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f415a2f0 con 0x7f44f40b38c0 2024-04-02T07:31:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.985+0000 7f44f3400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f44f4153ea0 0x7f44f4159be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40550/0 (socket says 172.21.15.55:40550) 2024-04-02T07:31:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.985+0000 7f44f3400640 1 -- 172.21.15.55:0/2982936505 learned_addr learned my addr 172.21.15.55:0/2982936505 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:27.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f3e00640 1 --2- 172.21.15.55:0/2982936505 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44f40b38c0 0x7f44f4164210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f2a00640 1 -- 172.21.15.55:0/2982936505 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1630652012 0 0) 0x7f44f413d0c0 con 0x7f44f4153ea0 2024-04-02T07:31:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f2a00640 1 -- 172.21.15.55:0/2982936505 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44d8005740 con 0x7f44f4153ea0 2024-04-02T07:31:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f2a00640 1 -- 172.21.15.55:0/2982936505 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 230851275 0 0) 0x7f44f415a4f0 con 0x7f44f40c4120 2024-04-02T07:31:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f2a00640 1 -- 172.21.15.55:0/2982936505 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f44f413d0c0 con 0x7f44f40c4120 2024-04-02T07:31:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f2a00640 1 -- 172.21.15.55:0/2982936505 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3995269922 0 0) 0x7f44d8005740 con 0x7f44f4153ea0 2024-04-02T07:31:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f2a00640 1 -- 172.21.15.55:0/2982936505 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44f40b38c0 msgr2=0x7f44f4164210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f2a00640 1 --2- 172.21.15.55:0/2982936505 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44f40b38c0 0x7f44f4164210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f2a00640 1 -- 172.21.15.55:0/2982936505 >> v1:172.21.15.106:6789/0 conn(0x7f44f40c4120 legacy=0x7f44f40b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:27.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f2a00640 1 -- 172.21.15.55:0/2982936505 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f415a7d0 con 0x7f44f4153ea0 2024-04-02T07:31:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f2a00640 1 -- 172.21.15.55:0/2982936505 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f44e4001680 con 0x7f44f4153ea0 2024-04-02T07:31:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f3e00640 1 --2- 172.21.15.55:0/2982936505 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44f40b38c0 0x7f44f4164210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:31:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f2a00640 1 -- 172.21.15.55:0/2982936505 >> v1:172.21.15.55:6789/0 conn(0x7f44f4153ea0 legacy=0x7f44f4159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f2a00640 1 --2- 172.21.15.55:0/2982936505 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44f40b38c0 0x7f44d8005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f2a00640 1 --2- 172.21.15.55:0/2982936505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44d8006290 0x7f44d80069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f2a00640 1 --2- 172.21.15.55:0/2982936505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44d8006f20 0x7f44d80073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f2a00640 1 -- 172.21.15.55:0/2982936505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f415a2f0 con 0x7f44d8006290 2024-04-02T07:31:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f2a00640 1 -- 172.21.15.55:0/2982936505 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d800dc50 con 0x7f44d8006f20 2024-04-02T07:31:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f2a00640 1 -- 172.21.15.55:0/2982936505 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d800de10 con 0x7f44f40b38c0 2024-04-02T07:31:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44ebe00640 1 --2- 172.21.15.55:0/2982936505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44d8006290 0x7f44d80069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f3400640 1 --2- 172.21.15.55:0/2982936505 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44f40b38c0 0x7f44d8005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44f3e00640 1 --2- 172.21.15.55:0/2982936505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44d8006f20 0x7f44d80073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44ebe00640 1 -- 172.21.15.55:0/2982936505 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44f40b38c0 msgr2=0x7f44d8005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44ebe00640 1 --2- 172.21.15.55:0/2982936505 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44f40b38c0 0x7f44d8005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:27.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44ebe00640 1 -- 172.21.15.55:0/2982936505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44d8006f20 msgr2=0x7f44d80073a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44ebe00640 1 --2- 172.21.15.55:0/2982936505 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44d8006f20 0x7f44d80073a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.989+0000 7f44ebe00640 1 -- 172.21.15.55:0/2982936505 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ec009a70 con 0x7f44d8006290 2024-04-02T07:31:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.993+0000 7f44ebe00640 1 --2- 172.21.15.55:0/2982936505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44d8006290 0x7f44d80069e0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0018d0 tx=0x7f44dc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5fff566d69410c6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.993+0000 7f44f2a00640 1 -- 172.21.15.55:0/2982936505 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc0052d0 con 0x7f44d8006290 2024-04-02T07:31:27.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.993+0000 7f44f2a00640 1 -- 172.21.15.55:0/2982936505 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44dc005450 con 0x7f44d8006290 2024-04-02T07:31:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.993+0000 7f44f2a00640 1 -- 172.21.15.55:0/2982936505 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44dc0a8950 con 0x7f44d8006290 2024-04-02T07:31:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.993+0000 7f44fa000640 1 -- 172.21.15.55:0/2982936505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44d8006290 msgr2=0x7f44d80069e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.993+0000 7f44fa000640 1 --2- 172.21.15.55:0/2982936505 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44d8006290 0x7f44d80069e0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f44dc0018d0 tx=0x7f44dc01ecf0 comp rx=0 tx=0).stop 2024-04-02T07:31:27.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.993+0000 7f44f3e00640 1 -- 172.21.15.55:0/2982936505 reap_dead start 2024-04-02T07:31:27.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.993+0000 7f44fa000640 1 -- 172.21.15.55:0/2982936505 shutdown_connections 2024-04-02T07:31:27.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.993+0000 7f44fa000640 1 -- 172.21.15.55:0/2982936505 >> 172.21.15.55:0/2982936505 conn(0x7f44f4066080 msgr2=0x7f44f4069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:27.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.993+0000 7f44fa000640 1 -- 172.21.15.55:0/2982936505 shutdown_connections 2024-04-02T07:31:27.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.993+0000 7f44fa000640 1 -- 172.21.15.55:0/2982936505 wait complete. 2024-04-02T07:31:27.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.993+0000 7f44fa000640 1 Processor -- start 2024-04-02T07:31:27.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.993+0000 7f44fa000640 1 -- start start 2024-04-02T07:31:27.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44fa000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44d8006290 0x7f44f4142250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:27.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44fa000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44f41397a0 0x7f44f4140ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:27.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44fa000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44f413f000 0x7f44f41f12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44fa000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f41411b0 con 0x7f44f413f000 2024-04-02T07:31:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44fa000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f4141490 con 0x7f44d8006290 2024-04-02T07:31:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44fa000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44f4141770 con 0x7f44f41397a0 2024-04-02T07:31:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44f3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44f413f000 0x7f44f41f12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44f3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44f413f000 0x7f44f41f12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44020/0 (socket says 172.21.15.55:44020) 2024-04-02T07:31:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44f3e00640 1 -- 172.21.15.55:0/329107751 learned_addr learned my addr 172.21.15.55:0/329107751 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44f3400640 1 --2- 172.21.15.55:0/329107751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44d8006290 0x7f44f4142250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44ebe00640 1 --2- 172.21.15.55:0/329107751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44f41397a0 0x7f44f4140ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44f3e00640 1 -- 172.21.15.55:0/329107751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44f41397a0 msgr2=0x7f44f4140ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44f3e00640 1 --2- 172.21.15.55:0/329107751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44f41397a0 0x7f44f4140ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44f3e00640 1 -- 172.21.15.55:0/329107751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44d8006290 msgr2=0x7f44f4142250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44f3e00640 1 --2- 172.21.15.55:0/329107751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44d8006290 0x7f44f4142250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:27.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44f3e00640 1 -- 172.21.15.55:0/329107751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f4141a50 con 0x7f44f413f000 2024-04-02T07:31:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44f3e00640 1 --2- 172.21.15.55:0/329107751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44f413f000 0x7f44f41f12e0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f44f406aa70 tx=0x7f44ec00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44eb400640 1 -- 172.21.15.55:0/329107751 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec00e040 con 0x7f44f413f000 2024-04-02T07:31:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44eb400640 1 -- 172.21.15.55:0/329107751 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44ec00f040 con 0x7f44f413f000 2024-04-02T07:31:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44eb400640 1 -- 172.21.15.55:0/329107751 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec015670 con 0x7f44f413f000 2024-04-02T07:31:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44fa000640 1 -- 172.21.15.55:0/329107751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f4141d30 con 0x7f44f413f000 2024-04-02T07:31:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44fa000640 1 -- 172.21.15.55:0/329107751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f413f650 con 0x7f44f413f000 2024-04-02T07:31:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44fa000640 1 -- 172.21.15.55:0/329107751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f4141f20 con 0x7f44f413f000 2024-04-02T07:31:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:27.997+0000 7f44eb400640 1 -- 172.21.15.55:0/329107751 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f44ec0157d0 con 0x7f44f413f000 2024-04-02T07:31:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.001+0000 7f44eb400640 1 --2- 172.21.15.55:0/329107751 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f44d0066690 0x7f44d0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:28.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.001+0000 7f44eb400640 1 -- 172.21.15.55:0/329107751 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f44ec084730 con 0x7f44f413f000 2024-04-02T07:31:28.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.001+0000 7f44f3400640 1 --2- 172.21.15.55:0/329107751 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f44d0066690 0x7f44d0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:28.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.001+0000 7f44f3400640 1 --2- 172.21.15.55:0/329107751 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f44d0066690 0x7f44d0068b50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f44e4001ec0 tx=0x7f44e4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:28.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.005+0000 7f44eb400640 1 -- 172.21.15.55:0/329107751 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f44ec051d50 con 0x7f44f413f000 2024-04-02T07:31:28.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.165+0000 7f44fa000640 1 -- 172.21.15.55:0/329107751 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f44f4066c90 con 0x7f44f413f000 2024-04-02T07:31:28.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.165+0000 7f44eb400640 1 -- 172.21.15.55:0/329107751 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v99) v1 ==== 74+0+12390 (secure 0 0 0) 0x7f44ec055370 con 0x7f44f413f000 2024-04-02T07:31:28.166 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:28.167 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":99,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:31:27.419092+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:31:28.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.169+0000 7f44fa000640 1 -- 172.21.15.55:0/329107751 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f44d0066690 msgr2=0x7f44d0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:28.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.169+0000 7f44fa000640 1 --2- 172.21.15.55:0/329107751 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f44d0066690 0x7f44d0068b50 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f44e4001ec0 tx=0x7f44e4009040 comp rx=0 tx=0).stop 2024-04-02T07:31:28.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.169+0000 7f44fa000640 1 -- 172.21.15.55:0/329107751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44f413f000 msgr2=0x7f44f41f12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:28.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.169+0000 7f44fa000640 1 --2- 172.21.15.55:0/329107751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44f413f000 0x7f44f41f12e0 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f44f406aa70 tx=0x7f44ec00f580 comp rx=0 tx=0).stop 2024-04-02T07:31:28.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.169+0000 7f44fa000640 1 -- 172.21.15.55:0/329107751 shutdown_connections 2024-04-02T07:31:28.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.169+0000 7f44fa000640 1 --2- 172.21.15.55:0/329107751 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44f413f000 0x7f44f41f12e0 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.169+0000 7f44fa000640 1 --2- 172.21.15.55:0/329107751 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44f41397a0 0x7f44f4140ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.169+0000 7f44fa000640 1 --2- 172.21.15.55:0/329107751 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f44d0066690 0x7f44d0068b50 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.169+0000 7f44fa000640 1 --2- 172.21.15.55:0/329107751 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44d8006290 0x7f44f4142250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.169+0000 7f44fa000640 1 -- 172.21.15.55:0/329107751 >> 172.21.15.55:0/329107751 conn(0x7f44f4066080 msgr2=0x7f44f415bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:28.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.169+0000 7f44fa000640 1 -- 172.21.15.55:0/329107751 shutdown_connections 2024-04-02T07:31:28.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.169+0000 7f44fa000640 1 -- 172.21.15.55:0/329107751 wait complete. 2024-04-02T07:31:28.190 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:31:28.190 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:31:28.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.333+0000 7f44e7200640 1 Processor -- start 2024-04-02T07:31:28.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.333+0000 7f44e7200640 1 -- start start 2024-04-02T07:31:28.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.333+0000 7f44e7200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f44e015ca60 0x7f44e00cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:28.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.333+0000 7f44e7200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44e0098a10 0x7f44e0098ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:28.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.333+0000 7f44e7200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e015ce40 con 0x7f44e006b920 2024-04-02T07:31:28.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.333+0000 7f44e7200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e00993e0 con 0x7f44e0098a10 2024-04-02T07:31:28.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.333+0000 7f44e7200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e006c440 con 0x7f44e015ca60 2024-04-02T07:31:28.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.333+0000 7f44d7400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44e0098a10 0x7f44e0098ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:28.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.333+0000 7f44d7400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f44e0098a10 0x7f44e0098ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44028/0 (socket says 172.21.15.55:44028) 2024-04-02T07:31:28.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.333+0000 7f44d7400640 1 -- 172.21.15.55:0/1500295544 learned_addr learned my addr 172.21.15.55:0/1500295544 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:28.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.337+0000 7f44dfe00640 1 --2- 172.21.15.55:0/1500295544 >> v2:172.21.15.106:3300/0 conn(0x7f44e015ca60 0x7f44e00cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:28.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.337+0000 7f44d7400640 1 -- 172.21.15.55:0/1500295544 >> v2:172.21.15.106:3300/0 conn(0x7f44e015ca60 msgr2=0x7f44e00cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:28.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.337+0000 7f44d7400640 1 --2- 172.21.15.55:0/1500295544 >> v2:172.21.15.106:3300/0 conn(0x7f44e015ca60 0x7f44e00cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.337+0000 7f44d7400640 1 -- 172.21.15.55:0/1500295544 >> v1:172.21.15.106:6789/0 conn(0x7f44e006b920 legacy=0x7f44e006bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:28.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.337+0000 7f44d7400640 1 -- 172.21.15.55:0/1500295544 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e00d01b0 con 0x7f44e0098a10 2024-04-02T07:31:28.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.337+0000 7f44d7400640 1 --2- 172.21.15.55:0/1500295544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44e0098a10 0x7f44e0098ea0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f44e00d1760 tx=0x7f44c801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef689ff93e1e70af server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:28.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.337+0000 7f44df400640 1 -- 172.21.15.55:0/1500295544 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c80ab660 con 0x7f44e0098a10 2024-04-02T07:31:28.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.337+0000 7f44df400640 1 -- 172.21.15.55:0/1500295544 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44c80ab7c0 con 0x7f44e0098a10 2024-04-02T07:31:28.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.337+0000 7f44df400640 1 -- 172.21.15.55:0/1500295544 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44c80abb50 con 0x7f44e0098a10 2024-04-02T07:31:28.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.337+0000 7f44e7200640 1 -- 172.21.15.55:0/1500295544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44e0098a10 msgr2=0x7f44e0098ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:28.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.337+0000 7f44e7200640 1 --2- 172.21.15.55:0/1500295544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44e0098a10 0x7f44e0098ea0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f44e00d1760 tx=0x7f44c801c460 comp rx=0 tx=0).stop 2024-04-02T07:31:28.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.337+0000 7f44e7200640 1 -- 172.21.15.55:0/1500295544 shutdown_connections 2024-04-02T07:31:28.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.337+0000 7f44e7200640 1 --2- 172.21.15.55:0/1500295544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44e0098a10 0x7f44e0098ea0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.337+0000 7f44e7200640 1 --2- 172.21.15.55:0/1500295544 >> v2:172.21.15.106:3300/0 conn(0x7f44e015ca60 0x7f44e00cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.337+0000 7f44e7200640 1 -- 172.21.15.55:0/1500295544 >> 172.21.15.55:0/1500295544 conn(0x7f44e00b2150 msgr2=0x7f44e00b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:28.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44e7200640 1 -- 172.21.15.55:0/1500295544 shutdown_connections 2024-04-02T07:31:28.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44e7200640 1 -- 172.21.15.55:0/1500295544 wait complete. 2024-04-02T07:31:28.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44e7200640 1 Processor -- start 2024-04-02T07:31:28.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44e7200640 1 -- start start 2024-04-02T07:31:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44e7200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44e006b920 0x7f44e00b3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44e7200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44e0098a10 0x7f44e00c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44e7200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44e015ca60 0x7f44e0158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44e7200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e00c6520 con 0x7f44e015ca60 2024-04-02T07:31:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44e7200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e00b4350 con 0x7f44e0098a10 2024-04-02T07:31:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44e7200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e00c5910 con 0x7f44e006b920 2024-04-02T07:31:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44e5200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44e015ca60 0x7f44e0158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44e5200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44e015ca60 0x7f44e0158190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44034/0 (socket says 172.21.15.55:44034) 2024-04-02T07:31:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44e5200640 1 -- 172.21.15.55:0/1337142287 learned_addr learned my addr 172.21.15.55:0/1337142287 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:28.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44d7400640 1 --2- 172.21.15.55:0/1337142287 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44e0098a10 0x7f44e00c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44dfe00640 1 --2- 172.21.15.55:0/1337142287 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44e006b920 0x7f44e00b3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44e5200640 1 -- 172.21.15.55:0/1337142287 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44e006b920 msgr2=0x7f44e00b3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44e5200640 1 --2- 172.21.15.55:0/1337142287 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44e006b920 0x7f44e00b3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44e5200640 1 -- 172.21.15.55:0/1337142287 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44e0098a10 msgr2=0x7f44e00c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44e5200640 1 --2- 172.21.15.55:0/1337142287 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44e0098a10 0x7f44e00c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44e5200640 1 -- 172.21.15.55:0/1337142287 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44c80094d0 con 0x7f44e015ca60 2024-04-02T07:31:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44e5200640 1 --2- 172.21.15.55:0/1337142287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44e015ca60 0x7f44e0158190 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f44d800c340 tx=0x7f44d800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.341+0000 7f44dcc00640 1 -- 172.21.15.55:0/1337142287 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d8005220 con 0x7f44e015ca60 2024-04-02T07:31:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.345+0000 7f44dcc00640 1 -- 172.21.15.55:0/1337142287 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d8005380 con 0x7f44e015ca60 2024-04-02T07:31:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.345+0000 7f44e7200640 1 -- 172.21.15.55:0/1337142287 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e00c5bf0 con 0x7f44e015ca60 2024-04-02T07:31:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.345+0000 7f44dcc00640 1 -- 172.21.15.55:0/1337142287 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d8007270 con 0x7f44e015ca60 2024-04-02T07:31:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.345+0000 7f44e7200640 1 -- 172.21.15.55:0/1337142287 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e00c61b0 con 0x7f44e015ca60 2024-04-02T07:31:28.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.345+0000 7f44e7200640 1 -- 172.21.15.55:0/1337142287 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e00c6690 con 0x7f44e015ca60 2024-04-02T07:31:28.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.345+0000 7f44dcc00640 1 -- 172.21.15.55:0/1337142287 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f44d80073d0 con 0x7f44e015ca60 2024-04-02T07:31:28.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.345+0000 7f44dcc00640 1 --2- 172.21.15.55:0/1337142287 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f44bc0666e0 0x7f44bc068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:28.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.345+0000 7f44dcc00640 1 -- 172.21.15.55:0/1337142287 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f44d8083230 con 0x7f44e015ca60 2024-04-02T07:31:28.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.345+0000 7f44dfe00640 1 --2- 172.21.15.55:0/1337142287 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f44bc0666e0 0x7f44bc068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:28.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.345+0000 7f44dfe00640 1 --2- 172.21.15.55:0/1337142287 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f44bc0666e0 0x7f44bc068ba0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f44d0003b90 tx=0x7f44d00098d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:28.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.349+0000 7f44dcc00640 1 -- 172.21.15.55:0/1337142287 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f44d8050990 con 0x7f44e015ca60 2024-04-02T07:31:28.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.513+0000 7f44e7200640 1 -- 172.21.15.55:0/1337142287 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f44e0066c90 con 0x7f44e015ca60 2024-04-02T07:31:28.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.513+0000 7f44dcc00640 1 -- 172.21.15.55:0/1337142287 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v99) v1 ==== 93+0+10 (secure 0 0 0) 0x7f44d8053fb0 con 0x7f44e015ca60 2024-04-02T07:31:28.516 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:31:28.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.517+0000 7f44e7200640 1 -- 172.21.15.55:0/1337142287 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f44bc0666e0 msgr2=0x7f44bc068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:28.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.517+0000 7f44e7200640 1 --2- 172.21.15.55:0/1337142287 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f44bc0666e0 0x7f44bc068ba0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f44d0003b90 tx=0x7f44d00098d0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.517+0000 7f44e7200640 1 -- 172.21.15.55:0/1337142287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44e015ca60 msgr2=0x7f44e0158190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:28.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.517+0000 7f44e7200640 1 --2- 172.21.15.55:0/1337142287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44e015ca60 0x7f44e0158190 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f44d800c340 tx=0x7f44d800c800 comp rx=0 tx=0).stop 2024-04-02T07:31:28.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.517+0000 7f44e7200640 1 -- 172.21.15.55:0/1337142287 shutdown_connections 2024-04-02T07:31:28.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.517+0000 7f44e7200640 1 --2- 172.21.15.55:0/1337142287 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f44e015ca60 0x7f44e0158190 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.517+0000 7f44e7200640 1 --2- 172.21.15.55:0/1337142287 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f44bc0666e0 0x7f44bc068ba0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.517+0000 7f44e7200640 1 --2- 172.21.15.55:0/1337142287 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f44e0098a10 0x7f44e00c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.517+0000 7f44e7200640 1 --2- 172.21.15.55:0/1337142287 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f44e006b920 0x7f44e00b3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.517+0000 7f44e7200640 1 -- 172.21.15.55:0/1337142287 >> 172.21.15.55:0/1337142287 conn(0x7f44e00b2150 msgr2=0x7f44e00afef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:28.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.517+0000 7f44e7200640 1 -- 172.21.15.55:0/1337142287 shutdown_connections 2024-04-02T07:31:28.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.517+0000 7f44e7200640 1 -- 172.21.15.55:0/1337142287 wait complete. 2024-04-02T07:31:28.537 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-02T07:31:28.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.673+0000 7f9189c00640 1 Processor -- start 2024-04-02T07:31:28.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.673+0000 7f9189c00640 1 -- start start 2024-04-02T07:31:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.677+0000 7f9189c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f91840c4120 0x7f91840b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.677+0000 7f9189c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f91840b36f0 0x7f918413d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.677+0000 7f9189c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f918413d0c0 con 0x7f9184153ea0 2024-04-02T07:31:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.677+0000 7f9189c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f918415a2f0 con 0x7f91840b36f0 2024-04-02T07:31:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.677+0000 7f9189c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91840b3b20 con 0x7f91840c4120 2024-04-02T07:31:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.677+0000 7f9183400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f91840b36f0 0x7f918413d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.677+0000 7f9183400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f91840b36f0 0x7f918413d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44046/0 (socket says 172.21.15.55:44046) 2024-04-02T07:31:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.677+0000 7f9183400640 1 -- 172.21.15.55:0/3343274419 learned_addr learned my addr 172.21.15.55:0/3343274419 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.677+0000 7f917a000640 1 --2- 172.21.15.55:0/3343274419 >> v2:172.21.15.106:3300/0 conn(0x7f91840c4120 0x7f91840b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.677+0000 7f9183400640 1 -- 172.21.15.55:0/3343274419 >> v2:172.21.15.106:3300/0 conn(0x7f91840c4120 msgr2=0x7f91840b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.677+0000 7f9183400640 1 --2- 172.21.15.55:0/3343274419 >> v2:172.21.15.106:3300/0 conn(0x7f91840c4120 0x7f91840b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.677+0000 7f9183400640 1 -- 172.21.15.55:0/3343274419 >> v1:172.21.15.106:6789/0 conn(0x7f9184153ea0 legacy=0x7f9184159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:28.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.677+0000 7f9183400640 1 -- 172.21.15.55:0/3343274419 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f918415a4f0 con 0x7f91840b36f0 2024-04-02T07:31:28.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.681+0000 7f9183400640 1 --2- 172.21.15.55:0/3343274419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91840b36f0 0x7f918413d550 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f918406d470 tx=0x7f917c01ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af048003e4e7586 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:28.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.681+0000 7f9182000640 1 -- 172.21.15.55:0/3343274419 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c00b2d0 con 0x7f91840b36f0 2024-04-02T07:31:28.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.681+0000 7f9182000640 1 -- 172.21.15.55:0/3343274419 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f917c00b430 con 0x7f91840b36f0 2024-04-02T07:31:28.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.681+0000 7f9182000640 1 -- 172.21.15.55:0/3343274419 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f917c0a7bf0 con 0x7f91840b36f0 2024-04-02T07:31:28.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.681+0000 7f9189c00640 1 -- 172.21.15.55:0/3343274419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91840b36f0 msgr2=0x7f918413d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:28.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.681+0000 7f9189c00640 1 --2- 172.21.15.55:0/3343274419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91840b36f0 0x7f918413d550 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f918406d470 tx=0x7f917c01ebf0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.681+0000 7f9189c00640 1 -- 172.21.15.55:0/3343274419 shutdown_connections 2024-04-02T07:31:28.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.681+0000 7f9189c00640 1 --2- 172.21.15.55:0/3343274419 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91840b36f0 0x7f918413d550 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.681+0000 7f9189c00640 1 --2- 172.21.15.55:0/3343274419 >> v2:172.21.15.106:3300/0 conn(0x7f91840c4120 0x7f91840b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.681+0000 7f9189c00640 1 -- 172.21.15.55:0/3343274419 >> 172.21.15.55:0/3343274419 conn(0x7f9184066080 msgr2=0x7f9184069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:28.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.681+0000 7f9189c00640 1 -- 172.21.15.55:0/3343274419 shutdown_connections 2024-04-02T07:31:28.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.681+0000 7f9189c00640 1 -- 172.21.15.55:0/3343274419 wait complete. 2024-04-02T07:31:28.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.681+0000 7f9189c00640 1 Processor -- start 2024-04-02T07:31:28.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.681+0000 7f9189c00640 1 -- start start 2024-04-02T07:31:28.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.681+0000 7f9189c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91840b36f0 0x7f91840cc640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:28.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.681+0000 7f9189c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91840c4120 0x7f918413afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:28.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.681+0000 7f9189c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9184153ea0 0x7f918413b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:28.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.681+0000 7f9189c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91840cc220 con 0x7f91840c4120 2024-04-02T07:31:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.681+0000 7f9189c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91840cbba0 con 0x7f91840b36f0 2024-04-02T07:31:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.681+0000 7f9189c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f918413bb90 con 0x7f9184153ea0 2024-04-02T07:31:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.685+0000 7f917a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91840c4120 0x7f918413afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.685+0000 7f9182a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91840b36f0 0x7f91840cc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.685+0000 7f9183400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9184153ea0 0x7f918413b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.685+0000 7f917a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91840c4120 0x7f918413afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44048/0 (socket says 172.21.15.55:44048) 2024-04-02T07:31:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.685+0000 7f917a000640 1 -- 172.21.15.55:0/93838321 learned_addr learned my addr 172.21.15.55:0/93838321 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.685+0000 7f917a000640 1 -- 172.21.15.55:0/93838321 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9184153ea0 msgr2=0x7f918413b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.685+0000 7f917a000640 1 --2- 172.21.15.55:0/93838321 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9184153ea0 0x7f918413b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.685+0000 7f917a000640 1 -- 172.21.15.55:0/93838321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91840b36f0 msgr2=0x7f91840cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.685+0000 7f917a000640 1 --2- 172.21.15.55:0/93838321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91840b36f0 0x7f91840cc640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.685+0000 7f917a000640 1 -- 172.21.15.55:0/93838321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f917c00bd40 con 0x7f91840c4120 2024-04-02T07:31:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.685+0000 7f917a000640 1 --2- 172.21.15.55:0/93838321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91840c4120 0x7f918413afe0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f916c00d800 tx=0x7f916c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.685+0000 7f917b400640 1 -- 172.21.15.55:0/93838321 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c00b6c0 con 0x7f91840c4120 2024-04-02T07:31:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.685+0000 7f917b400640 1 -- 172.21.15.55:0/93838321 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f916c00b860 con 0x7f91840c4120 2024-04-02T07:31:28.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.685+0000 7f9189c00640 1 -- 172.21.15.55:0/93838321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91840cbe40 con 0x7f91840c4120 2024-04-02T07:31:28.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.685+0000 7f917b400640 1 -- 172.21.15.55:0/93838321 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f916c00bc10 con 0x7f91840c4120 2024-04-02T07:31:28.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.685+0000 7f9189c00640 1 -- 172.21.15.55:0/93838321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f918414f630 con 0x7f91840c4120 2024-04-02T07:31:28.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.685+0000 7f9189c00640 1 -- 172.21.15.55:0/93838321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91840cc360 con 0x7f91840c4120 2024-04-02T07:31:28.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.685+0000 7f917b400640 1 -- 172.21.15.55:0/93838321 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f916c01e460 con 0x7f91840c4120 2024-04-02T07:31:28.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.689+0000 7f917b400640 1 --2- 172.21.15.55:0/93838321 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9160066690 0x7f9160068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:28.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.689+0000 7f917b400640 1 -- 172.21.15.55:0/93838321 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f916c0842a0 con 0x7f91840c4120 2024-04-02T07:31:28.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.689+0000 7f9182a00640 1 --2- 172.21.15.55:0/93838321 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9160066690 0x7f9160068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:28.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.689+0000 7f9182a00640 1 --2- 172.21.15.55:0/93838321 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9160066690 0x7f9160068b50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9184138c50 tx=0x7f9174009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:28.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.693+0000 7f917b400640 1 -- 172.21.15.55:0/93838321 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f91840cc360 con 0x7f91840c4120 2024-04-02T07:31:28.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.853+0000 7f9189c00640 1 -- 172.21.15.55:0/93838321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f91840cc360 con 0x7f91840c4120 2024-04-02T07:31:28.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.853+0000 7f917b400640 1 -- 172.21.15.55:0/93838321 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v99) v1 ==== 84+0+65 (secure 0 0 0) 0x7f91840cc360 con 0x7f91840c4120 2024-04-02T07:31:28.854 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:28.854 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-02T07:31:28.854 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:31:28.854 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-04-02T07:31:28.854 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-04-02T07:31:28.854 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:28.855 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-02T07:31:28.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.853+0000 7f9189c00640 1 -- 172.21.15.55:0/93838321 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9160066690 msgr2=0x7f9160068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:28.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.853+0000 7f9189c00640 1 --2- 172.21.15.55:0/93838321 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9160066690 0x7f9160068b50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f9184138c50 tx=0x7f9174009040 comp rx=0 tx=0).stop 2024-04-02T07:31:28.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.853+0000 7f9189c00640 1 -- 172.21.15.55:0/93838321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91840c4120 msgr2=0x7f918413afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:28.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.853+0000 7f9189c00640 1 --2- 172.21.15.55:0/93838321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91840c4120 0x7f918413afe0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7f916c00d800 tx=0x7f916c00dcc0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.853+0000 7f9189c00640 1 -- 172.21.15.55:0/93838321 shutdown_connections 2024-04-02T07:31:28.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.853+0000 7f9189c00640 1 --2- 172.21.15.55:0/93838321 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9184153ea0 0x7f918413b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.853+0000 7f9189c00640 1 --2- 172.21.15.55:0/93838321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91840c4120 0x7f918413afe0 unknown :-1 s=CLOSED pgs=1431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.853+0000 7f9189c00640 1 --2- 172.21.15.55:0/93838321 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9160066690 0x7f9160068b50 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.853+0000 7f9189c00640 1 --2- 172.21.15.55:0/93838321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91840b36f0 0x7f91840cc640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:28.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.853+0000 7f9189c00640 1 -- 172.21.15.55:0/93838321 >> 172.21.15.55:0/93838321 conn(0x7f9184066080 msgr2=0x7f9184071990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:28.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.853+0000 7f9189c00640 1 -- 172.21.15.55:0/93838321 shutdown_connections 2024-04-02T07:31:28.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:28.853+0000 7f9189c00640 1 -- 172.21.15.55:0/93838321 wait complete. 2024-04-02T07:31:28.875 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-02T07:31:28.875 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-02T07:31:29.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.017+0000 7faf9c800640 1 Processor -- start 2024-04-02T07:31:29.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.017+0000 7faf9c800640 1 -- start start 2024-04-02T07:31:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.017+0000 7faf9c800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7faf940cb5b0 0x7faf9406ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.017+0000 7faf9c800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7faf940af920 0x7faf9406cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.017+0000 7faf9c800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf940ca030 con 0x7faf9415aa40 2024-04-02T07:31:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.017+0000 7faf9c800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf940c9420 con 0x7faf940af920 2024-04-02T07:31:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.017+0000 7faf9c800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf940c9700 con 0x7faf940cb5b0 2024-04-02T07:31:29.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.017+0000 7faf99e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7faf9415aa40 0x7faf940caea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40564/0 (socket says 172.21.15.55:40564) 2024-04-02T07:31:29.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.017+0000 7faf99e00640 1 -- 172.21.15.55:0/3285472264 learned_addr learned my addr 172.21.15.55:0/3285472264 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:29.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.017+0000 7faf9a800640 1 --2- 172.21.15.55:0/3285472264 >> v2:172.21.15.55:3300/0 conn(0x7faf940af920 0x7faf9406cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:29.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.021+0000 7faf99400640 1 --2- 172.21.15.55:0/3285472264 >> v2:172.21.15.106:3300/0 conn(0x7faf940cb5b0 0x7faf9406ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:29.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.021+0000 7faf98a00640 1 -- 172.21.15.55:0/3285472264 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2869626881 0 0) 0x7faf940ca030 con 0x7faf9415aa40 2024-04-02T07:31:29.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.021+0000 7faf98a00640 1 -- 172.21.15.55:0/3285472264 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf7c003530 con 0x7faf9415aa40 2024-04-02T07:31:29.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.021+0000 7faf9a800640 1 -- 172.21.15.55:0/3285472264 >> v2:172.21.15.106:3300/0 conn(0x7faf940cb5b0 msgr2=0x7faf9406ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:29.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.021+0000 7faf9a800640 1 --2- 172.21.15.55:0/3285472264 >> v2:172.21.15.106:3300/0 conn(0x7faf940cb5b0 0x7faf9406ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:29.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.021+0000 7faf9a800640 1 -- 172.21.15.55:0/3285472264 >> v1:172.21.15.55:6789/0 conn(0x7faf9415aa40 legacy=0x7faf940caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:29.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.021+0000 7faf9a800640 1 -- 172.21.15.55:0/3285472264 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf940c99e0 con 0x7faf940af920 2024-04-02T07:31:29.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.021+0000 7faf99400640 1 --2- 172.21.15.55:0/3285472264 >> v2:172.21.15.106:3300/0 conn(0x7faf940cb5b0 0x7faf9406ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:29.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.021+0000 7faf9a800640 1 --2- 172.21.15.55:0/3285472264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf940af920 0x7faf9406cf40 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7faf940b0450 tx=0x7faf9001c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e771d8eda8edfcb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:29.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.021+0000 7faf98a00640 1 -- 172.21.15.55:0/3285472264 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf900a59e0 con 0x7faf940af920 2024-04-02T07:31:29.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.021+0000 7faf98a00640 1 -- 172.21.15.55:0/3285472264 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf900a5b40 con 0x7faf940af920 2024-04-02T07:31:29.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.021+0000 7faf98a00640 1 -- 172.21.15.55:0/3285472264 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf900ad440 con 0x7faf940af920 2024-04-02T07:31:29.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.021+0000 7faf9c800640 1 -- 172.21.15.55:0/3285472264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf940af920 msgr2=0x7faf9406cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:29.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.021+0000 7faf9c800640 1 --2- 172.21.15.55:0/3285472264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf940af920 0x7faf9406cf40 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7faf940b0450 tx=0x7faf9001c900 comp rx=0 tx=0).stop 2024-04-02T07:31:29.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf9c800640 1 -- 172.21.15.55:0/3285472264 shutdown_connections 2024-04-02T07:31:29.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf9c800640 1 --2- 172.21.15.55:0/3285472264 >> v2:172.21.15.106:3300/0 conn(0x7faf940cb5b0 0x7faf9406ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:29.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf9c800640 1 --2- 172.21.15.55:0/3285472264 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf940af920 0x7faf9406cf40 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:29.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf9c800640 1 -- 172.21.15.55:0/3285472264 >> 172.21.15.55:0/3285472264 conn(0x7faf94069d90 msgr2=0x7faf9406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:29.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf9c800640 1 -- 172.21.15.55:0/3285472264 shutdown_connections 2024-04-02T07:31:29.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf9c800640 1 -- 172.21.15.55:0/3285472264 wait complete. 2024-04-02T07:31:29.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf9c800640 1 Processor -- start 2024-04-02T07:31:29.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf9c800640 1 -- start start 2024-04-02T07:31:29.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf9c800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf940af920 0x7faf941516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:29.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf9c800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf940cb5b0 0x7faf941f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:29.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf9c800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf9415aa40 0x7faf940c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:29.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf9c800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf94145d80 con 0x7faf940cb5b0 2024-04-02T07:31:29.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf9c800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf941f90e0 con 0x7faf940af920 2024-04-02T07:31:29.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf9c800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf941f93c0 con 0x7faf9415aa40 2024-04-02T07:31:29.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf99400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf940cb5b0 0x7faf941f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:29.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf99400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf940cb5b0 0x7faf941f4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44060/0 (socket says 172.21.15.55:44060) 2024-04-02T07:31:29.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf99400640 1 -- 172.21.15.55:0/2820350438 learned_addr learned my addr 172.21.15.55:0/2820350438 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:29.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf99e00640 1 --2- 172.21.15.55:0/2820350438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf940af920 0x7faf941516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:29.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf9a800640 1 --2- 172.21.15.55:0/2820350438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf9415aa40 0x7faf940c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:29.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf99400640 1 -- 172.21.15.55:0/2820350438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf9415aa40 msgr2=0x7faf940c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:29.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf99400640 1 --2- 172.21.15.55:0/2820350438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf9415aa40 0x7faf940c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:29.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf99400640 1 -- 172.21.15.55:0/2820350438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf940af920 msgr2=0x7faf941516c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:29.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf99400640 1 --2- 172.21.15.55:0/2820350438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf940af920 0x7faf941516c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:29.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf99400640 1 -- 172.21.15.55:0/2820350438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf90009a70 con 0x7faf940cb5b0 2024-04-02T07:31:29.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf9a800640 1 --2- 172.21.15.55:0/2820350438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf9415aa40 0x7faf940c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:29.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf99400640 1 --2- 172.21.15.55:0/2820350438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf940cb5b0 0x7faf941f4e70 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7faf8400e810 tx=0x7faf8400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:29.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf8e000640 1 -- 172.21.15.55:0/2820350438 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8400c8d0 con 0x7faf940cb5b0 2024-04-02T07:31:29.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.025+0000 7faf8e000640 1 -- 172.21.15.55:0/2820350438 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8400ca30 con 0x7faf940cb5b0 2024-04-02T07:31:29.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.029+0000 7faf8e000640 1 -- 172.21.15.55:0/2820350438 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8400cde0 con 0x7faf940cb5b0 2024-04-02T07:31:29.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.029+0000 7faf9c800640 1 -- 172.21.15.55:0/2820350438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf941f96a0 con 0x7faf940cb5b0 2024-04-02T07:31:29.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.029+0000 7faf9c800640 1 -- 172.21.15.55:0/2820350438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf9415c5d0 con 0x7faf940cb5b0 2024-04-02T07:31:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.029+0000 7faf9c800640 1 -- 172.21.15.55:0/2820350438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf9406e240 con 0x7faf940cb5b0 2024-04-02T07:31:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.029+0000 7faf8e000640 1 -- 172.21.15.55:0/2820350438 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7faf84013410 con 0x7faf940cb5b0 2024-04-02T07:31:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.029+0000 7faf8e000640 1 --2- 172.21.15.55:0/2820350438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faf78066690 0x7faf78068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:29.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.029+0000 7faf8e000640 1 -- 172.21.15.55:0/2820350438 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faf84083c10 con 0x7faf940cb5b0 2024-04-02T07:31:29.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.029+0000 7faf99e00640 1 --2- 172.21.15.55:0/2820350438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faf78066690 0x7faf78068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:29.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.029+0000 7faf99e00640 1 --2- 172.21.15.55:0/2820350438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faf78066690 0x7faf78068b50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7faf880011f0 tx=0x7faf88007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:29.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.033+0000 7faf8e000640 1 -- 172.21.15.55:0/2820350438 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7faf840512e0 con 0x7faf940cb5b0 2024-04-02T07:31:29.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.197+0000 7faf9c800640 1 -- 172.21.15.55:0/2820350438 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7faf941f9b50 con 0x7faf940cb5b0 2024-04-02T07:31:29.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.297+0000 7faf8e000640 1 -- 172.21.15.55:0/2820350438 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v100) v1 ==== 138+0+0 (secure 0 0 0) 0x7faf84054900 con 0x7faf940cb5b0 2024-04-02T07:31:29.298 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-04-02T07:31:29.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.301+0000 7faf9c800640 1 -- 172.21.15.55:0/2820350438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faf78066690 msgr2=0x7faf78068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:29.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.301+0000 7faf9c800640 1 --2- 172.21.15.55:0/2820350438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faf78066690 0x7faf78068b50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7faf880011f0 tx=0x7faf88007d40 comp rx=0 tx=0).stop 2024-04-02T07:31:29.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.301+0000 7faf9c800640 1 -- 172.21.15.55:0/2820350438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf940cb5b0 msgr2=0x7faf941f4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:29.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.301+0000 7faf9c800640 1 --2- 172.21.15.55:0/2820350438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf940cb5b0 0x7faf941f4e70 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7faf8400e810 tx=0x7faf8400ecd0 comp rx=0 tx=0).stop 2024-04-02T07:31:29.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.301+0000 7faf9c800640 1 -- 172.21.15.55:0/2820350438 shutdown_connections 2024-04-02T07:31:29.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.301+0000 7faf9c800640 1 --2- 172.21.15.55:0/2820350438 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7faf9415aa40 0x7faf940c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:29.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.301+0000 7faf9c800640 1 --2- 172.21.15.55:0/2820350438 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7faf940cb5b0 0x7faf941f4e70 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:29.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.301+0000 7faf9c800640 1 --2- 172.21.15.55:0/2820350438 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7faf78066690 0x7faf78068b50 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:29.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.301+0000 7faf9c800640 1 --2- 172.21.15.55:0/2820350438 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7faf940af920 0x7faf941516c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:29.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.301+0000 7faf9c800640 1 -- 172.21.15.55:0/2820350438 >> 172.21.15.55:0/2820350438 conn(0x7faf94069d90 msgr2=0x7faf94159d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:29.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.301+0000 7faf9c800640 1 -- 172.21.15.55:0/2820350438 shutdown_connections 2024-04-02T07:31:29.304 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.301+0000 7faf9c800640 1 -- 172.21.15.55:0/2820350438 wait complete. 2024-04-02T07:31:29.325 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-02T07:31:29.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.469+0000 7f5304e00640 1 Processor -- start 2024-04-02T07:31:29.472 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.469+0000 7f5304e00640 1 -- start start 2024-04-02T07:31:29.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.473+0000 7f5304e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5300158e40 0x7f53000b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:29.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.473+0000 7f5304e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f530006de60 0x7f530015cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:29.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.473+0000 7f5304e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f530015d4a0 0x7f53000cba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:29.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.473+0000 7f5304e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5300159220 con 0x7f5300158e40 2024-04-02T07:31:29.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.473+0000 7f5304e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53000b1440 con 0x7f530006de60 2024-04-02T07:31:29.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.473+0000 7f5304e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53000b1c50 con 0x7f530015d4a0 2024-04-02T07:31:29.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.473+0000 7f52fde00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5300158e40 0x7f53000b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:29.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.473+0000 7f52fde00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5300158e40 0x7f53000b2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44074/0 (socket says 172.21.15.55:44074) 2024-04-02T07:31:29.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.473+0000 7f52fde00640 1 -- 172.21.15.55:0/1493140544 learned_addr learned my addr 172.21.15.55:0/1493140544 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:29.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.473+0000 7f52fe800640 1 --2- 172.21.15.55:0/1493140544 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f530015d4a0 0x7f53000cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:29.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.473+0000 7f52f5400640 1 --2- 172.21.15.55:0/1493140544 >> v2:172.21.15.106:3300/0 conn(0x7f530006de60 0x7f530015cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:29.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.473+0000 7f52fde00640 1 -- 172.21.15.55:0/1493140544 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f530015d4a0 msgr2=0x7f53000cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:29.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.473+0000 7f52fde00640 1 --2- 172.21.15.55:0/1493140544 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f530015d4a0 0x7f53000cba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:29.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.473+0000 7f52fde00640 1 -- 172.21.15.55:0/1493140544 >> v2:172.21.15.106:3300/0 conn(0x7f530006de60 msgr2=0x7f530015cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:29.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.473+0000 7f52fde00640 1 --2- 172.21.15.55:0/1493140544 >> v2:172.21.15.106:3300/0 conn(0x7f530006de60 0x7f530015cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:29.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.473+0000 7f52fde00640 1 -- 172.21.15.55:0/1493140544 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f530015cad0 con 0x7f5300158e40 2024-04-02T07:31:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f52fde00640 1 --2- 172.21.15.55:0/1493140544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5300158e40 0x7f53000b2dd0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f530006ac60 tx=0x7f52f001eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c271fb9388b28b14 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f52fd400640 1 -- 172.21.15.55:0/1493140544 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f000b2d0 con 0x7f5300158e40 2024-04-02T07:31:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f52fd400640 1 -- 172.21.15.55:0/1493140544 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f000b430 con 0x7f5300158e40 2024-04-02T07:31:29.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f52fd400640 1 -- 172.21.15.55:0/1493140544 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f00a79f0 con 0x7f5300158e40 2024-04-02T07:31:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f5304e00640 1 -- 172.21.15.55:0/1493140544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5300158e40 msgr2=0x7f53000b2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f5304e00640 1 --2- 172.21.15.55:0/1493140544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5300158e40 0x7f53000b2dd0 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7f530006ac60 tx=0x7f52f001eb30 comp rx=0 tx=0).stop 2024-04-02T07:31:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f5304e00640 1 -- 172.21.15.55:0/1493140544 shutdown_connections 2024-04-02T07:31:29.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f5304e00640 1 --2- 172.21.15.55:0/1493140544 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f530015d4a0 0x7f53000cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f5304e00640 1 --2- 172.21.15.55:0/1493140544 >> v2:172.21.15.106:3300/0 conn(0x7f530006de60 0x7f530015cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f5304e00640 1 --2- 172.21.15.55:0/1493140544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5300158e40 0x7f53000b2dd0 unknown :-1 s=CLOSED pgs=1435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f5304e00640 1 -- 172.21.15.55:0/1493140544 >> 172.21.15.55:0/1493140544 conn(0x7f5300066110 msgr2=0x7f5300069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f5304e00640 1 -- 172.21.15.55:0/1493140544 shutdown_connections 2024-04-02T07:31:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f5304e00640 1 -- 172.21.15.55:0/1493140544 wait complete. 2024-04-02T07:31:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f5304e00640 1 Processor -- start 2024-04-02T07:31:29.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f5304e00640 1 -- start start 2024-04-02T07:31:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f5304e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530006de60 0x7f53000af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f5304e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5300158e40 0x7f53000a7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f5304e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f530015d4a0 0x7f53000b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f5304e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53000a8780 con 0x7f530006de60 2024-04-02T07:31:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f5304e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53000a7b70 con 0x7f5300158e40 2024-04-02T07:31:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.477+0000 7f5304e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53000a7e50 con 0x7f530015d4a0 2024-04-02T07:31:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.481+0000 7f52fde00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530006de60 0x7f53000af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.481+0000 7f52fde00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530006de60 0x7f53000af6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44082/0 (socket says 172.21.15.55:44082) 2024-04-02T07:31:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.481+0000 7f52fde00640 1 -- 172.21.15.55:0/1510700947 learned_addr learned my addr 172.21.15.55:0/1510700947 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.481+0000 7f52f5400640 1 --2- 172.21.15.55:0/1510700947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5300158e40 0x7f53000a7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:29.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.481+0000 7f52fe800640 1 --2- 172.21.15.55:0/1510700947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f530015d4a0 0x7f53000b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.481+0000 7f52fde00640 1 -- 172.21.15.55:0/1510700947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f530015d4a0 msgr2=0x7f53000b0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.481+0000 7f52fde00640 1 --2- 172.21.15.55:0/1510700947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f530015d4a0 0x7f53000b0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.481+0000 7f52fde00640 1 -- 172.21.15.55:0/1510700947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5300158e40 msgr2=0x7f53000a7470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.481+0000 7f52fde00640 1 --2- 172.21.15.55:0/1510700947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5300158e40 0x7f53000a7470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.481+0000 7f52fde00640 1 -- 172.21.15.55:0/1510700947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52f000bd40 con 0x7f530006de60 2024-04-02T07:31:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.481+0000 7f52fde00640 1 --2- 172.21.15.55:0/1510700947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530006de60 0x7f53000af6c0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f52f001d1e0 tx=0x7f52f001b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.481+0000 7f52f6a00640 1 -- 172.21.15.55:0/1510700947 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0009800 con 0x7f530006de60 2024-04-02T07:31:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.481+0000 7f52f6a00640 1 -- 172.21.15.55:0/1510700947 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52f00099a0 con 0x7f530006de60 2024-04-02T07:31:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.481+0000 7f5304e00640 1 -- 172.21.15.55:0/1510700947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53000a8130 con 0x7f530006de60 2024-04-02T07:31:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.481+0000 7f52f6a00640 1 -- 172.21.15.55:0/1510700947 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52f0009d50 con 0x7f530006de60 2024-04-02T07:31:29.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.481+0000 7f5304e00640 1 -- 172.21.15.55:0/1510700947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5300149320 con 0x7f530006de60 2024-04-02T07:31:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.481+0000 7f5304e00640 1 -- 172.21.15.55:0/1510700947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53000a85e0 con 0x7f530006de60 2024-04-02T07:31:29.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.481+0000 7f52f6a00640 1 -- 172.21.15.55:0/1510700947 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f52f00b9430 con 0x7f530006de60 2024-04-02T07:31:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.481+0000 7f52f6a00640 1 --2- 172.21.15.55:0/1510700947 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f52dc066710 0x7f52dc068bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.485+0000 7f52f6a00640 1 -- 172.21.15.55:0/1510700947 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f52f011ef60 con 0x7f530006de60 2024-04-02T07:31:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.485+0000 7f52f5400640 1 --2- 172.21.15.55:0/1510700947 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f52dc066710 0x7f52dc068bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:29.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.485+0000 7f52f5400640 1 --2- 172.21.15.55:0/1510700947 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f52dc066710 0x7f52dc068bd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5300155b40 tx=0x7f52e8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:29.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.489+0000 7f52f6a00640 1 -- 172.21.15.55:0/1510700947 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f53000a85e0 con 0x7f530006de60 2024-04-02T07:31:29.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:29.649+0000 7f5304e00640 1 -- 172.21.15.55:0/1510700947 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f53000a85e0 con 0x7f530006de60 2024-04-02T07:31:30.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.301+0000 7f52f6a00640 1 -- 172.21.15.55:0/1510700947 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v101) v1 ==== 170+0+0 (secure 0 0 0) 0x7f53000a85e0 con 0x7f530006de60 2024-04-02T07:31:30.302 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-04-02T07:31:30.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.309+0000 7f5304e00640 1 -- 172.21.15.55:0/1510700947 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f52dc066710 msgr2=0x7f52dc068bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:30.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.309+0000 7f5304e00640 1 --2- 172.21.15.55:0/1510700947 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f52dc066710 0x7f52dc068bd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f5300155b40 tx=0x7f52e8008040 comp rx=0 tx=0).stop 2024-04-02T07:31:30.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.309+0000 7f5304e00640 1 -- 172.21.15.55:0/1510700947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530006de60 msgr2=0x7f53000af6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:30.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.309+0000 7f5304e00640 1 --2- 172.21.15.55:0/1510700947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530006de60 0x7f53000af6c0 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f52f001d1e0 tx=0x7f52f001b8d0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.309+0000 7f5304e00640 1 -- 172.21.15.55:0/1510700947 shutdown_connections 2024-04-02T07:31:30.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.309+0000 7f5304e00640 1 --2- 172.21.15.55:0/1510700947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f530015d4a0 0x7f53000b0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.309+0000 7f5304e00640 1 --2- 172.21.15.55:0/1510700947 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f52dc066710 0x7f52dc068bd0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.309+0000 7f5304e00640 1 --2- 172.21.15.55:0/1510700947 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5300158e40 0x7f53000a7470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.309+0000 7f5304e00640 1 --2- 172.21.15.55:0/1510700947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f530006de60 0x7f53000af6c0 secure :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f52f001d1e0 tx=0x7f52f001b8d0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.309+0000 7f5304e00640 1 -- 172.21.15.55:0/1510700947 >> 172.21.15.55:0/1510700947 conn(0x7f5300066110 msgr2=0x7f53000cc980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:30.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.309+0000 7f5304e00640 1 -- 172.21.15.55:0/1510700947 shutdown_connections 2024-04-02T07:31:30.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.309+0000 7f5304e00640 1 -- 172.21.15.55:0/1510700947 wait complete. 2024-04-02T07:31:30.343 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-02T07:31:30.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.485+0000 7f16e5800640 1 Processor -- start 2024-04-02T07:31:30.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.485+0000 7f16e5800640 1 -- start start 2024-04-02T07:31:30.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.489+0000 7f16e5800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16e0157000 0x7f16e0071a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:30.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.489+0000 7f16e5800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f16e0071f60 0x7f16e0069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:30.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.489+0000 7f16e5800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f16e006a2d0 0x7f16e00cf5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:30.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.489+0000 7f16e5800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e015d070 con 0x7f16e006a2d0 2024-04-02T07:31:30.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.489+0000 7f16e5800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16e00723e0 con 0x7f16e0071f60 2024-04-02T07:31:30.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.489+0000 7f16e5800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e015de90 con 0x7f16e0157000 2024-04-02T07:31:30.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.489+0000 7f16df400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f16e006a2d0 0x7f16e00cf5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:30.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.489+0000 7f16df400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f16e006a2d0 0x7f16e00cf5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44084/0 (socket says 172.21.15.55:44084) 2024-04-02T07:31:30.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.489+0000 7f16df400640 1 -- 172.21.15.55:0/3565368708 learned_addr learned my addr 172.21.15.55:0/3565368708 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:30.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.489+0000 7f16df400640 1 -- 172.21.15.55:0/3565368708 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16e0157000 msgr2=0x7f16e0071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:30.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.489+0000 7f16df400640 1 --2- 172.21.15.55:0/3565368708 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16e0157000 0x7f16e0071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.489+0000 7f16df400640 1 -- 172.21.15.55:0/3565368708 >> v2:172.21.15.106:3300/0 conn(0x7f16e0071f60 msgr2=0x7f16e0069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:30.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.489+0000 7f16d6000640 1 --2- 172.21.15.55:0/3565368708 >> v2:172.21.15.106:3300/0 conn(0x7f16e0071f60 0x7f16e0069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:30.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.489+0000 7f16df400640 1 --2- 172.21.15.55:0/3565368708 >> v2:172.21.15.106:3300/0 conn(0x7f16e0071f60 0x7f16e0069d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.489+0000 7f16df400640 1 -- 172.21.15.55:0/3565368708 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16e006a760 con 0x7f16e006a2d0 2024-04-02T07:31:30.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.489+0000 7f16d6000640 1 --2- 172.21.15.55:0/3565368708 >> v2:172.21.15.106:3300/0 conn(0x7f16e0071f60 0x7f16e0069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:30.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16df400640 1 --2- 172.21.15.55:0/3565368708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16e006a2d0 0x7f16e00cf5a0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f16e0070f70 tx=0x7f16d801c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8445010b8bba8b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:30.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16de000640 1 -- 172.21.15.55:0/3565368708 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d80ab600 con 0x7f16e006a2d0 2024-04-02T07:31:30.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16de000640 1 -- 172.21.15.55:0/3565368708 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d80a7050 con 0x7f16e006a2d0 2024-04-02T07:31:30.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16de000640 1 -- 172.21.15.55:0/3565368708 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d80ab980 con 0x7f16e006a2d0 2024-04-02T07:31:30.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16e5800640 1 -- 172.21.15.55:0/3565368708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16e006a2d0 msgr2=0x7f16e00cf5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:30.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16e5800640 1 --2- 172.21.15.55:0/3565368708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16e006a2d0 0x7f16e00cf5a0 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f16e0070f70 tx=0x7f16d801c230 comp rx=0 tx=0).stop 2024-04-02T07:31:30.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16e5800640 1 -- 172.21.15.55:0/3565368708 shutdown_connections 2024-04-02T07:31:30.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16e5800640 1 --2- 172.21.15.55:0/3565368708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16e006a2d0 0x7f16e00cf5a0 unknown :-1 s=CLOSED pgs=1437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16e5800640 1 --2- 172.21.15.55:0/3565368708 >> v2:172.21.15.106:3300/0 conn(0x7f16e0071f60 0x7f16e0069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16e5800640 1 --2- 172.21.15.55:0/3565368708 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16e0157000 0x7f16e0071a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16e5800640 1 -- 172.21.15.55:0/3565368708 >> 172.21.15.55:0/3565368708 conn(0x7f16e00b13b0 msgr2=0x7f16e00b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:30.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16e5800640 1 -- 172.21.15.55:0/3565368708 shutdown_connections 2024-04-02T07:31:30.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16e5800640 1 -- 172.21.15.55:0/3565368708 wait complete. 2024-04-02T07:31:30.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16e5800640 1 Processor -- start 2024-04-02T07:31:30.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16e5800640 1 -- start start 2024-04-02T07:31:30.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16e5800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16e006a2d0 0x7f16e013ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:30.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16e5800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16e0071f60 0x7f16e0137760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:30.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16e5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16e0157000 0x7f16e015f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:30.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16e5800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e00cb800 con 0x7f16e0157000 2024-04-02T07:31:30.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16e5800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16e0153440 con 0x7f16e0071f60 2024-04-02T07:31:30.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.493+0000 7f16e5800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16e013b070 con 0x7f16e006a2d0 2024-04-02T07:31:30.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.497+0000 7f16df400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16e0157000 0x7f16e015f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:30.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.497+0000 7f16df400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16e0157000 0x7f16e015f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44100/0 (socket says 172.21.15.55:44100) 2024-04-02T07:31:30.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.497+0000 7f16df400640 1 -- 172.21.15.55:0/2990755901 learned_addr learned my addr 172.21.15.55:0/2990755901 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:30.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.497+0000 7f16dea00640 1 --2- 172.21.15.55:0/2990755901 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16e006a2d0 0x7f16e013ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:30.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.497+0000 7f16d6000640 1 --2- 172.21.15.55:0/2990755901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16e0071f60 0x7f16e0137760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:30.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.497+0000 7f16df400640 1 -- 172.21.15.55:0/2990755901 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16e006a2d0 msgr2=0x7f16e013ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:30.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.497+0000 7f16df400640 1 --2- 172.21.15.55:0/2990755901 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16e006a2d0 0x7f16e013ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.497+0000 7f16df400640 1 -- 172.21.15.55:0/2990755901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16e0071f60 msgr2=0x7f16e0137760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:30.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.497+0000 7f16df400640 1 --2- 172.21.15.55:0/2990755901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16e0071f60 0x7f16e0137760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.497+0000 7f16df400640 1 -- 172.21.15.55:0/2990755901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16d80094d0 con 0x7f16e0157000 2024-04-02T07:31:30.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.497+0000 7f16df400640 1 --2- 172.21.15.55:0/2990755901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16e0157000 0x7f16e015f8b0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f16d801a8e0 tx=0x7f16d8018fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:30.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.497+0000 7f16d7400640 1 -- 172.21.15.55:0/2990755901 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d80b4620 con 0x7f16e0157000 2024-04-02T07:31:30.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.497+0000 7f16d7400640 1 -- 172.21.15.55:0/2990755901 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16d80abe90 con 0x7f16e0157000 2024-04-02T07:31:30.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.497+0000 7f16d7400640 1 -- 172.21.15.55:0/2990755901 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16d80b4980 con 0x7f16e0157000 2024-04-02T07:31:30.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.497+0000 7f16e5800640 1 -- 172.21.15.55:0/2990755901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16e0155340 con 0x7f16e0157000 2024-04-02T07:31:30.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.497+0000 7f16e5800640 1 -- 172.21.15.55:0/2990755901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16e0155900 con 0x7f16e0157000 2024-04-02T07:31:30.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.497+0000 7f16e5800640 1 -- 172.21.15.55:0/2990755901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16e0066c90 con 0x7f16e0157000 2024-04-02T07:31:30.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.497+0000 7f16d7400640 1 -- 172.21.15.55:0/2990755901 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f16d80b2070 con 0x7f16e0157000 2024-04-02T07:31:30.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.501+0000 7f16d7400640 1 --2- 172.21.15.55:0/2990755901 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f16bc066690 0x7f16bc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:30.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.501+0000 7f16d7400640 1 -- 172.21.15.55:0/2990755901 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f16d811d540 con 0x7f16e0157000 2024-04-02T07:31:30.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.501+0000 7f16dea00640 1 --2- 172.21.15.55:0/2990755901 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f16bc066690 0x7f16bc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:30.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.501+0000 7f16dea00640 1 --2- 172.21.15.55:0/2990755901 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f16bc066690 0x7f16bc068b50 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f16d0009990 tx=0x7f16d0009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:30.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.501+0000 7f16d7400640 1 -- 172.21.15.55:0/2990755901 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f16d80ea9a0 con 0x7f16e0157000 2024-04-02T07:31:30.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.697+0000 7f16e5800640 1 -- 172.21.15.55:0/2990755901 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f16e00ae9a0 con 0x7f16e0157000 2024-04-02T07:31:30.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.709+0000 7f16d7400640 1 -- 172.21.15.55:0/2990755901 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v77) v1 ==== 174+0+0 (secure 0 0 0) 0x7f16d80ba0c0 con 0x7f16e0157000 2024-04-02T07:31:30.712 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 14 and data pool 15 2024-04-02T07:31:30.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.713+0000 7f16e5800640 1 -- 172.21.15.55:0/2990755901 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f16bc066690 msgr2=0x7f16bc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:30.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.713+0000 7f16e5800640 1 --2- 172.21.15.55:0/2990755901 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f16bc066690 0x7f16bc068b50 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f16d0009990 tx=0x7f16d0009110 comp rx=0 tx=0).stop 2024-04-02T07:31:30.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.713+0000 7f16e5800640 1 -- 172.21.15.55:0/2990755901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16e0157000 msgr2=0x7f16e015f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:30.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.713+0000 7f16e5800640 1 --2- 172.21.15.55:0/2990755901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16e0157000 0x7f16e015f8b0 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f16d801a8e0 tx=0x7f16d8018fd0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.717+0000 7f16e5800640 1 -- 172.21.15.55:0/2990755901 shutdown_connections 2024-04-02T07:31:30.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.717+0000 7f16e5800640 1 --2- 172.21.15.55:0/2990755901 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16e0157000 0x7f16e015f8b0 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.717+0000 7f16e5800640 1 --2- 172.21.15.55:0/2990755901 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f16bc066690 0x7f16bc068b50 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.717+0000 7f16e5800640 1 --2- 172.21.15.55:0/2990755901 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f16e0071f60 0x7f16e0137760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.717+0000 7f16e5800640 1 --2- 172.21.15.55:0/2990755901 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16e006a2d0 0x7f16e013ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.717+0000 7f16e5800640 1 -- 172.21.15.55:0/2990755901 >> 172.21.15.55:0/2990755901 conn(0x7f16e00b13b0 msgr2=0x7f16e0152870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:30.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.721+0000 7f16e5800640 1 -- 172.21.15.55:0/2990755901 shutdown_connections 2024-04-02T07:31:30.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.721+0000 7f16e5800640 1 -- 172.21.15.55:0/2990755901 wait complete. 2024-04-02T07:31:30.757 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:31:30.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.897+0000 7f9ca1e00640 1 Processor -- start 2024-04-02T07:31:30.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.897+0000 7f9ca1e00640 1 -- start start 2024-04-02T07:31:30.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.897+0000 7f9ca1e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9c9c15ca70 0x7f9c9c0b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:30.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.897+0000 7f9ca1e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9c9c098a10 0x7f9c9c098ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:30.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.897+0000 7f9ca1e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c9c15ce50 con 0x7f9c9c06aff0 2024-04-02T07:31:30.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.897+0000 7f9ca1e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c0993e0 con 0x7f9c9c098a10 2024-04-02T07:31:30.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.897+0000 7f9ca1e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c9c0cef60 con 0x7f9c9c15ca70 2024-04-02T07:31:30.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.897+0000 7f9c92000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9c9c098a10 0x7f9c9c098ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:30.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.897+0000 7f9c9b400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9c9c06aff0 0x7f9c9c06b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40576/0 (socket says 172.21.15.55:40576) 2024-04-02T07:31:30.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.897+0000 7f9c9b400640 1 -- 172.21.15.55:0/175370990 learned_addr learned my addr 172.21.15.55:0/175370990 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:30.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.897+0000 7f9c9aa00640 1 --2- 172.21.15.55:0/175370990 >> v2:172.21.15.106:3300/0 conn(0x7f9c9c15ca70 0x7f9c9c0b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:30.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.897+0000 7f9c92000640 1 -- 172.21.15.55:0/175370990 >> v2:172.21.15.106:3300/0 conn(0x7f9c9c15ca70 msgr2=0x7f9c9c0b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:30.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.897+0000 7f9c92000640 1 --2- 172.21.15.55:0/175370990 >> v2:172.21.15.106:3300/0 conn(0x7f9c9c15ca70 0x7f9c9c0b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.897+0000 7f9c92000640 1 -- 172.21.15.55:0/175370990 >> v1:172.21.15.55:6789/0 conn(0x7f9c9c06aff0 legacy=0x7f9c9c06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:30.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.897+0000 7f9c92000640 1 -- 172.21.15.55:0/175370990 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c9c06bd60 con 0x7f9c9c098a10 2024-04-02T07:31:30.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.897+0000 7f9c9a000640 1 -- 172.21.15.55:0/175370990 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 481920207 0 0) 0x7f9c9c15ce50 con 0x7f9c9c06aff0 2024-04-02T07:31:30.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.901+0000 7f9c92000640 1 --2- 172.21.15.55:0/175370990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c9c098a10 0x7f9c9c098ea0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c071f60 tx=0x7f9c8401c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62ecb0b5b6d9a2ae server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:30.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.901+0000 7f9c9a000640 1 -- 172.21.15.55:0/175370990 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c840ab600 con 0x7f9c9c098a10 2024-04-02T07:31:30.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.901+0000 7f9c9a000640 1 -- 172.21.15.55:0/175370990 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c840a7050 con 0x7f9c9c098a10 2024-04-02T07:31:30.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.901+0000 7f9c9a000640 1 -- 172.21.15.55:0/175370990 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c840ab980 con 0x7f9c9c098a10 2024-04-02T07:31:30.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.901+0000 7f9ca1e00640 1 -- 172.21.15.55:0/175370990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c9c098a10 msgr2=0x7f9c9c098ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:30.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.901+0000 7f9ca1e00640 1 --2- 172.21.15.55:0/175370990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c9c098a10 0x7f9c9c098ea0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c071f60 tx=0x7f9c8401c480 comp rx=0 tx=0).stop 2024-04-02T07:31:30.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.901+0000 7f9ca1e00640 1 -- 172.21.15.55:0/175370990 shutdown_connections 2024-04-02T07:31:30.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.901+0000 7f9ca1e00640 1 --2- 172.21.15.55:0/175370990 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c9c098a10 0x7f9c9c098ea0 unknown :-1 s=CLOSED pgs=1440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.901+0000 7f9ca1e00640 1 --2- 172.21.15.55:0/175370990 >> v2:172.21.15.106:3300/0 conn(0x7f9c9c15ca70 0x7f9c9c0b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.901+0000 7f9ca1e00640 1 -- 172.21.15.55:0/175370990 >> 172.21.15.55:0/175370990 conn(0x7f9c9c0b21d0 msgr2=0x7f9c9c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:30.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.901+0000 7f9ca1e00640 1 -- 172.21.15.55:0/175370990 shutdown_connections 2024-04-02T07:31:30.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.901+0000 7f9ca1e00640 1 -- 172.21.15.55:0/175370990 wait complete. 2024-04-02T07:31:30.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9ca1e00640 1 Processor -- start 2024-04-02T07:31:30.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9ca1e00640 1 -- start start 2024-04-02T07:31:30.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9ca1e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9c9c06aff0 0x7f9c9c14b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:30.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9ca1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c9c098a10 0x7f9c9c15ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:30.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9ca1e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c9c15ca70 0x7f9c9c0ad270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:30.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9ca1e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c152f70 con 0x7f9c9c098a10 2024-04-02T07:31:30.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9ca1e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c153150 con 0x7f9c9c15ca70 2024-04-02T07:31:30.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9ca1e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c9c153430 con 0x7f9c9c06aff0 2024-04-02T07:31:30.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9c92000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c9c098a10 0x7f9c9c15ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:30.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9c92000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c9c098a10 0x7f9c9c15ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44114/0 (socket says 172.21.15.55:44114) 2024-04-02T07:31:30.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9c92000640 1 -- 172.21.15.55:0/4061753386 learned_addr learned my addr 172.21.15.55:0/4061753386 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:30.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9c9aa00640 1 --2- 172.21.15.55:0/4061753386 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9c9c06aff0 0x7f9c9c14b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:30.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9c9b400640 1 --2- 172.21.15.55:0/4061753386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c9c15ca70 0x7f9c9c0ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:30.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9c92000640 1 -- 172.21.15.55:0/4061753386 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9c9c06aff0 msgr2=0x7f9c9c14b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:30.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9c92000640 1 --2- 172.21.15.55:0/4061753386 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9c9c06aff0 0x7f9c9c14b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9c92000640 1 -- 172.21.15.55:0/4061753386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c9c15ca70 msgr2=0x7f9c9c0ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:30.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9c92000640 1 --2- 172.21.15.55:0/4061753386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c9c15ca70 0x7f9c9c0ad270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:30.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9c92000640 1 -- 172.21.15.55:0/4061753386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c84009420 con 0x7f9c9c098a10 2024-04-02T07:31:30.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9c9b400640 1 --2- 172.21.15.55:0/4061753386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c9c15ca70 0x7f9c9c0ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:30.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9c92000640 1 --2- 172.21.15.55:0/4061753386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c9c098a10 0x7f9c9c15ad20 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f9c840ae040 tx=0x7f9c8401acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:30.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9c93e00640 1 -- 172.21.15.55:0/4061753386 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c840b7450 con 0x7f9c9c098a10 2024-04-02T07:31:30.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9c93e00640 1 -- 172.21.15.55:0/4061753386 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c840b75b0 con 0x7f9c9c098a10 2024-04-02T07:31:30.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9ca1e00640 1 -- 172.21.15.55:0/4061753386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c9c153710 con 0x7f9c9c098a10 2024-04-02T07:31:30.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9c93e00640 1 -- 172.21.15.55:0/4061753386 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c840b7960 con 0x7f9c9c098a10 2024-04-02T07:31:30.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9ca1e00640 1 -- 172.21.15.55:0/4061753386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c9c153cd0 con 0x7f9c9c098a10 2024-04-02T07:31:30.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.905+0000 7f9ca1e00640 1 -- 172.21.15.55:0/4061753386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c9c066c90 con 0x7f9c9c098a10 2024-04-02T07:31:30.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.909+0000 7f9c93e00640 1 -- 172.21.15.55:0/4061753386 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f9c840b7ac0 con 0x7f9c9c098a10 2024-04-02T07:31:30.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.909+0000 7f9c93e00640 1 --2- 172.21.15.55:0/4061753386 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9c78066690 0x7f9c78068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:30.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.909+0000 7f9c93e00640 1 -- 172.21.15.55:0/4061753386 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c8411e9e0 con 0x7f9c9c098a10 2024-04-02T07:31:30.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.909+0000 7f9c9aa00640 1 --2- 172.21.15.55:0/4061753386 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9c78066690 0x7f9c78068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:30.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.909+0000 7f9c9aa00640 1 --2- 172.21.15.55:0/4061753386 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9c78066690 0x7f9c78068b50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c155320 tx=0x7f9c8c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:30.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:30.913+0000 7f9c93e00640 1 -- 172.21.15.55:0/4061753386 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f9c840ebcb0 con 0x7f9c9c098a10 2024-04-02T07:31:31.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.077+0000 7f9ca1e00640 1 -- 172.21.15.55:0/4061753386 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c9c153ec0 con 0x7f9c9c098a10 2024-04-02T07:31:31.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.077+0000 7f9c93e00640 1 -- 172.21.15.55:0/4061753386 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16064 (secure 0 0 0) 0x7f9c840ef2d0 con 0x7f9c9c098a10 2024-04-02T07:31:31.079 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:31.079 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":102,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:31:30.703832+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:31:29.246681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-02T07:31:29.698823+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:31:31.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.077+0000 7f9ca1e00640 1 -- 172.21.15.55:0/4061753386 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9c78066690 msgr2=0x7f9c78068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:31.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.077+0000 7f9ca1e00640 1 --2- 172.21.15.55:0/4061753386 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9c78066690 0x7f9c78068b50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c155320 tx=0x7f9c8c009190 comp rx=0 tx=0).stop 2024-04-02T07:31:31.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.077+0000 7f9ca1e00640 1 -- 172.21.15.55:0/4061753386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c9c098a10 msgr2=0x7f9c9c15ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:31.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.077+0000 7f9ca1e00640 1 --2- 172.21.15.55:0/4061753386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c9c098a10 0x7f9c9c15ad20 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f9c840ae040 tx=0x7f9c8401acc0 comp rx=0 tx=0).stop 2024-04-02T07:31:31.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.081+0000 7f9ca1e00640 1 -- 172.21.15.55:0/4061753386 shutdown_connections 2024-04-02T07:31:31.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.081+0000 7f9ca1e00640 1 --2- 172.21.15.55:0/4061753386 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9c78066690 0x7f9c78068b50 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:31.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.081+0000 7f9ca1e00640 1 --2- 172.21.15.55:0/4061753386 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9c9c15ca70 0x7f9c9c0ad270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:31.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.081+0000 7f9ca1e00640 1 --2- 172.21.15.55:0/4061753386 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9c9c098a10 0x7f9c9c15ad20 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:31.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.081+0000 7f9ca1e00640 1 --2- 172.21.15.55:0/4061753386 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9c9c06aff0 0x7f9c9c14b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:31.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.081+0000 7f9ca1e00640 1 -- 172.21.15.55:0/4061753386 >> 172.21.15.55:0/4061753386 conn(0x7f9c9c0b21d0 msgr2=0x7f9c9c15bc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:31.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.081+0000 7f9ca1e00640 1 -- 172.21.15.55:0/4061753386 shutdown_connections 2024-04-02T07:31:31.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.081+0000 7f9ca1e00640 1 -- 172.21.15.55:0/4061753386 wait complete. 2024-04-02T07:31:31.101 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:31:31.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.241+0000 7ff673000640 1 Processor -- start 2024-04-02T07:31:31.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.241+0000 7ff673000640 1 -- start start 2024-04-02T07:31:31.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.241+0000 7ff673000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff66c0b38c0 0x7ff66c164210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:31.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.241+0000 7ff673000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66c13d0c0 con 0x7ff66c0c4120 2024-04-02T07:31:31.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.241+0000 7ff673000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff66c15a4f0 con 0x7ff66c153ea0 2024-04-02T07:31:31.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.241+0000 7ff673000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c15a2f0 con 0x7ff66c0b38c0 2024-04-02T07:31:31.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.241+0000 7ff663e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff66c0c4120 0x7ff66c0b31b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40586/0 (socket says 172.21.15.55:40586) 2024-04-02T07:31:31.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.241+0000 7ff663e00640 1 -- 172.21.15.55:0/2668806895 learned_addr learned my addr 172.21.15.55:0/2668806895 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:31.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.241+0000 7ff671000640 1 --2- 172.21.15.55:0/2668806895 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff66c0b38c0 0x7ff66c164210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:31.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.241+0000 7ff66b400640 1 -- 172.21.15.55:0/2668806895 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60228834 0 0) 0x7ff66c13d0c0 con 0x7ff66c0c4120 2024-04-02T07:31:31.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.241+0000 7ff66b400640 1 -- 172.21.15.55:0/2668806895 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff650003530 con 0x7ff66c0c4120 2024-04-02T07:31:31.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.241+0000 7ff66b400640 1 -- 172.21.15.55:0/2668806895 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989310214 0 0) 0x7ff66c15a4f0 con 0x7ff66c153ea0 2024-04-02T07:31:31.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.241+0000 7ff66b400640 1 -- 172.21.15.55:0/2668806895 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff66c13d0c0 con 0x7ff66c153ea0 2024-04-02T07:31:31.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.241+0000 7ff671000640 1 -- 172.21.15.55:0/2668806895 >> v1:172.21.15.106:6789/0 conn(0x7ff66c153ea0 legacy=0x7ff66c159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:31.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.241+0000 7ff671000640 1 -- 172.21.15.55:0/2668806895 >> v1:172.21.15.55:6789/0 conn(0x7ff66c0c4120 legacy=0x7ff66c0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:31.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.241+0000 7ff671000640 1 -- 172.21.15.55:0/2668806895 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff66c15a7d0 con 0x7ff66c0b38c0 2024-04-02T07:31:31.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.245+0000 7ff671000640 1 --2- 172.21.15.55:0/2668806895 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff66c0b38c0 0x7ff66c164210 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff664009dc0 tx=0x7ff66401c990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=394a57011a03675a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:31.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.245+0000 7ff66b400640 1 -- 172.21.15.55:0/2668806895 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6640a5860 con 0x7ff66c0b38c0 2024-04-02T07:31:31.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.245+0000 7ff66b400640 1 -- 172.21.15.55:0/2668806895 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6640a59c0 con 0x7ff66c0b38c0 2024-04-02T07:31:31.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.245+0000 7ff66b400640 1 -- 172.21.15.55:0/2668806895 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6640a5d30 con 0x7ff66c0b38c0 2024-04-02T07:31:31.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.245+0000 7ff673000640 1 -- 172.21.15.55:0/2668806895 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff66c0b38c0 msgr2=0x7ff66c164210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:31.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.245+0000 7ff673000640 1 --2- 172.21.15.55:0/2668806895 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff66c0b38c0 0x7ff66c164210 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ff664009dc0 tx=0x7ff66401c990 comp rx=0 tx=0).stop 2024-04-02T07:31:31.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.245+0000 7ff673000640 1 -- 172.21.15.55:0/2668806895 shutdown_connections 2024-04-02T07:31:31.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.245+0000 7ff673000640 1 --2- 172.21.15.55:0/2668806895 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff66c0b38c0 0x7ff66c164210 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:31.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.245+0000 7ff673000640 1 -- 172.21.15.55:0/2668806895 >> 172.21.15.55:0/2668806895 conn(0x7ff66c066080 msgr2=0x7ff66c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:31.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.245+0000 7ff673000640 1 -- 172.21.15.55:0/2668806895 shutdown_connections 2024-04-02T07:31:31.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.245+0000 7ff673000640 1 -- 172.21.15.55:0/2668806895 wait complete. 2024-04-02T07:31:31.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.245+0000 7ff673000640 1 Processor -- start 2024-04-02T07:31:31.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff673000640 1 -- start start 2024-04-02T07:31:31.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff673000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff66c0b38c0 0x7ff66c1f6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:31.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff673000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff66c0c4120 0x7ff66c152a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:31.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff673000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff66c153ea0 0x7ff66c13af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:31.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff673000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c0cc170 con 0x7ff66c0b38c0 2024-04-02T07:31:31.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff673000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c1f68d0 con 0x7ff66c153ea0 2024-04-02T07:31:31.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff673000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff66c0ccad0 con 0x7ff66c0c4120 2024-04-02T07:31:31.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff66be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff66c0b38c0 0x7ff66c1f6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:31.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff66be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff66c0b38c0 0x7ff66c1f6390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44120/0 (socket says 172.21.15.55:44120) 2024-04-02T07:31:31.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff66be00640 1 -- 172.21.15.55:0/465462773 learned_addr learned my addr 172.21.15.55:0/465462773 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:31.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff671000640 1 --2- 172.21.15.55:0/465462773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff66c153ea0 0x7ff66c13af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:31.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff663e00640 1 --2- 172.21.15.55:0/465462773 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff66c0c4120 0x7ff66c152a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:31.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff66be00640 1 -- 172.21.15.55:0/465462773 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff66c0c4120 msgr2=0x7ff66c152a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:31.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff66be00640 1 --2- 172.21.15.55:0/465462773 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff66c0c4120 0x7ff66c152a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:31.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff66be00640 1 -- 172.21.15.55:0/465462773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff66c153ea0 msgr2=0x7ff66c13af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:31.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff66be00640 1 --2- 172.21.15.55:0/465462773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff66c153ea0 0x7ff66c13af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:31.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff66be00640 1 -- 172.21.15.55:0/465462773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff664009a70 con 0x7ff66c0b38c0 2024-04-02T07:31:31.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff663e00640 1 --2- 172.21.15.55:0/465462773 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff66c0c4120 0x7ff66c152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:31.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff66be00640 1 --2- 172.21.15.55:0/465462773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff66c0b38c0 0x7ff66c1f6390 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00c490 tx=0x7ff65c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:31.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff668c00640 1 -- 172.21.15.55:0/465462773 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c0052d0 con 0x7ff66c0b38c0 2024-04-02T07:31:31.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff668c00640 1 -- 172.21.15.55:0/465462773 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff65c005430 con 0x7ff66c0b38c0 2024-04-02T07:31:31.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff673000640 1 -- 172.21.15.55:0/465462773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff66c0ccdb0 con 0x7ff66c0b38c0 2024-04-02T07:31:31.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff668c00640 1 -- 172.21.15.55:0/465462773 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff65c012870 con 0x7ff66c0b38c0 2024-04-02T07:31:31.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff673000640 1 -- 172.21.15.55:0/465462773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff66c0cd370 con 0x7ff66c0b38c0 2024-04-02T07:31:31.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.249+0000 7ff673000640 1 -- 172.21.15.55:0/465462773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff66c066c90 con 0x7ff66c0b38c0 2024-04-02T07:31:31.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.253+0000 7ff668c00640 1 -- 172.21.15.55:0/465462773 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff65c0129d0 con 0x7ff66c0b38c0 2024-04-02T07:31:31.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.253+0000 7ff668c00640 1 --2- 172.21.15.55:0/465462773 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff648066690 0x7ff648068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:31.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.253+0000 7ff668c00640 1 -- 172.21.15.55:0/465462773 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff65c083de0 con 0x7ff66c0b38c0 2024-04-02T07:31:31.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.253+0000 7ff663e00640 1 --2- 172.21.15.55:0/465462773 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff648066690 0x7ff648068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:31.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.253+0000 7ff663e00640 1 --2- 172.21.15.55:0/465462773 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff648066690 0x7ff648068b50 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff66c153770 tx=0x7ff654009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:31.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.257+0000 7ff668c00640 1 -- 172.21.15.55:0/465462773 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff65c0510b0 con 0x7ff66c0b38c0 2024-04-02T07:31:31.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.421+0000 7ff673000640 1 -- 172.21.15.55:0/465462773 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff66c1534c0 con 0x7ff66c0b38c0 2024-04-02T07:31:31.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.425+0000 7ff668c00640 1 -- 172.21.15.55:0/465462773 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v102) v1 ==== 74+0+16064 (secure 0 0 0) 0x7ff65c080ed0 con 0x7ff66c0b38c0 2024-04-02T07:31:31.425 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:31.425 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":102,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:31:30.703832+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:31:29.246681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-02T07:31:29.698823+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:31:31.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.425+0000 7ff673000640 1 -- 172.21.15.55:0/465462773 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff648066690 msgr2=0x7ff648068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:31.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.425+0000 7ff673000640 1 --2- 172.21.15.55:0/465462773 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff648066690 0x7ff648068b50 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7ff66c153770 tx=0x7ff654009040 comp rx=0 tx=0).stop 2024-04-02T07:31:31.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.425+0000 7ff673000640 1 -- 172.21.15.55:0/465462773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff66c0b38c0 msgr2=0x7ff66c1f6390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:31.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.425+0000 7ff673000640 1 --2- 172.21.15.55:0/465462773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff66c0b38c0 0x7ff66c1f6390 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7ff65c00c490 tx=0x7ff65c00c950 comp rx=0 tx=0).stop 2024-04-02T07:31:31.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.425+0000 7ff673000640 1 -- 172.21.15.55:0/465462773 shutdown_connections 2024-04-02T07:31:31.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.425+0000 7ff673000640 1 --2- 172.21.15.55:0/465462773 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff648066690 0x7ff648068b50 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:31.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.425+0000 7ff673000640 1 --2- 172.21.15.55:0/465462773 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff66c153ea0 0x7ff66c13af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:31.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.425+0000 7ff673000640 1 --2- 172.21.15.55:0/465462773 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff66c0c4120 0x7ff66c152a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:31.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.425+0000 7ff673000640 1 --2- 172.21.15.55:0/465462773 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff66c0b38c0 0x7ff66c1f6390 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:31.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.425+0000 7ff673000640 1 -- 172.21.15.55:0/465462773 >> 172.21.15.55:0/465462773 conn(0x7ff66c066080 msgr2=0x7ff66c06c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:31.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.425+0000 7ff673000640 1 -- 172.21.15.55:0/465462773 shutdown_connections 2024-04-02T07:31:31.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.425+0000 7ff673000640 1 -- 172.21.15.55:0/465462773 wait complete. 2024-04-02T07:31:31.447 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-02T07:31:31.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.589+0000 7f9338a00640 1 Processor -- start 2024-04-02T07:31:31.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.589+0000 7f9338a00640 1 -- start start 2024-04-02T07:31:31.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.589+0000 7f9338a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93340b3dc0 0x7f93340ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:31.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.589+0000 7f9338a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93340ade90 0x7f933406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:31.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.589+0000 7f9338a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f933406c630 con 0x7f93340b41a0 2024-04-02T07:31:31.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.589+0000 7f9338a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f933406c8f0 con 0x7f93340b3dc0 2024-04-02T07:31:31.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.589+0000 7f9338a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933406cbd0 con 0x7f93340ade90 2024-04-02T07:31:31.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.589+0000 7f9331e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93340b3dc0 0x7f93340ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:31.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.589+0000 7f9332800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f93340b41a0 0x7f9334142ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40594/0 (socket says 172.21.15.55:40594) 2024-04-02T07:31:31.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.589+0000 7f9332800640 1 -- 172.21.15.55:0/1575842535 learned_addr learned my addr 172.21.15.55:0/1575842535 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:31.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.589+0000 7f932be00640 1 --2- 172.21.15.55:0/1575842535 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93340ade90 0x7f933406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:31.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.589+0000 7f9331e00640 1 -- 172.21.15.55:0/1575842535 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93340ade90 msgr2=0x7f933406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:31.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.593+0000 7f9331e00640 1 --2- 172.21.15.55:0/1575842535 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93340ade90 0x7f933406d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:31.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.593+0000 7f9331e00640 1 -- 172.21.15.55:0/1575842535 >> v1:172.21.15.55:6789/0 conn(0x7f93340b41a0 legacy=0x7f9334142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:31.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.593+0000 7f9331e00640 1 -- 172.21.15.55:0/1575842535 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933406ceb0 con 0x7f93340b3dc0 2024-04-02T07:31:31.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.593+0000 7f9331400640 1 -- 172.21.15.55:0/1575842535 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099560749 0 0) 0x7f933406c630 con 0x7f93340b41a0 2024-04-02T07:31:31.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.593+0000 7f9331e00640 1 --2- 172.21.15.55:0/1575842535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93340b3dc0 0x7f93340ca770 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f93240097c0 tx=0x7f932401c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daded8d7cd64a76f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:31.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.593+0000 7f9331400640 1 -- 172.21.15.55:0/1575842535 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93240ab600 con 0x7f93340b3dc0 2024-04-02T07:31:31.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.593+0000 7f9331400640 1 -- 172.21.15.55:0/1575842535 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93240ab760 con 0x7f93340b3dc0 2024-04-02T07:31:31.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.593+0000 7f9331400640 1 -- 172.21.15.55:0/1575842535 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93240abaf0 con 0x7f93340b3dc0 2024-04-02T07:31:31.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.593+0000 7f9338a00640 1 -- 172.21.15.55:0/1575842535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93340b3dc0 msgr2=0x7f93340ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:31.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.593+0000 7f9338a00640 1 --2- 172.21.15.55:0/1575842535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93340b3dc0 0x7f93340ca770 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f93240097c0 tx=0x7f932401c3e0 comp rx=0 tx=0).stop 2024-04-02T07:31:31.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.593+0000 7f9338a00640 1 -- 172.21.15.55:0/1575842535 shutdown_connections 2024-04-02T07:31:31.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.593+0000 7f9338a00640 1 --2- 172.21.15.55:0/1575842535 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93340ade90 0x7f933406d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:31.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.593+0000 7f9338a00640 1 --2- 172.21.15.55:0/1575842535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93340b3dc0 0x7f93340ca770 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:31.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.593+0000 7f9338a00640 1 -- 172.21.15.55:0/1575842535 >> 172.21.15.55:0/1575842535 conn(0x7f933406a390 msgr2=0x7f93340b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:31.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.593+0000 7f9338a00640 1 -- 172.21.15.55:0/1575842535 shutdown_connections 2024-04-02T07:31:31.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.593+0000 7f9338a00640 1 -- 172.21.15.55:0/1575842535 wait complete. 2024-04-02T07:31:31.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f9338a00640 1 Processor -- start 2024-04-02T07:31:31.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f9338a00640 1 -- start start 2024-04-02T07:31:31.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f9338a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93340ade90 0x7f9334138ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:31.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f9338a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93340b3dc0 0x7f9334133b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:31.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f9338a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93340b41a0 0x7f9334135d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:31.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f9338a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9334142160 con 0x7f93340b3dc0 2024-04-02T07:31:31.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f9338a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9334142440 con 0x7f93340ade90 2024-04-02T07:31:31.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f9338a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9334137260 con 0x7f93340b41a0 2024-04-02T07:31:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f932be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93340b3dc0 0x7f9334133b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f932be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93340b3dc0 0x7f9334133b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44140/0 (socket says 172.21.15.55:44140) 2024-04-02T07:31:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f932be00640 1 -- 172.21.15.55:0/3523735516 learned_addr learned my addr 172.21.15.55:0/3523735516 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f9331e00640 1 --2- 172.21.15.55:0/3523735516 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93340ade90 0x7f9334138ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f9332800640 1 --2- 172.21.15.55:0/3523735516 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93340b41a0 0x7f9334135d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f932be00640 1 -- 172.21.15.55:0/3523735516 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93340b41a0 msgr2=0x7f9334135d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f932be00640 1 --2- 172.21.15.55:0/3523735516 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93340b41a0 0x7f9334135d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f932be00640 1 -- 172.21.15.55:0/3523735516 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93340ade90 msgr2=0x7f9334138ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f932be00640 1 --2- 172.21.15.55:0/3523735516 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93340ade90 0x7f9334138ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f932be00640 1 -- 172.21.15.55:0/3523735516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9324009420 con 0x7f93340b3dc0 2024-04-02T07:31:31.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f932be00640 1 --2- 172.21.15.55:0/3523735516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93340b3dc0 0x7f9334133b30 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f931c00d800 tx=0x7f931c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:31.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f932a000640 1 -- 172.21.15.55:0/3523735516 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c00b6c0 con 0x7f93340b3dc0 2024-04-02T07:31:31.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f932a000640 1 -- 172.21.15.55:0/3523735516 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c00b820 con 0x7f93340b3dc0 2024-04-02T07:31:31.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f9338a00640 1 -- 172.21.15.55:0/3523735516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f933406de00 con 0x7f93340b3dc0 2024-04-02T07:31:31.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f932a000640 1 -- 172.21.15.55:0/3523735516 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c00bb90 con 0x7f93340b3dc0 2024-04-02T07:31:31.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.597+0000 7f9338a00640 1 -- 172.21.15.55:0/3523735516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9334137820 con 0x7f93340b3dc0 2024-04-02T07:31:31.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.601+0000 7f9338a00640 1 -- 172.21.15.55:0/3523735516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93341379e0 con 0x7f93340b3dc0 2024-04-02T07:31:31.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.601+0000 7f932a000640 1 -- 172.21.15.55:0/3523735516 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f931c00bcf0 con 0x7f93340b3dc0 2024-04-02T07:31:31.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.601+0000 7f932a000640 1 --2- 172.21.15.55:0/3523735516 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9310066690 0x7f9310068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:31.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.601+0000 7f932a000640 1 -- 172.21.15.55:0/3523735516 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f931c084720 con 0x7f93340b3dc0 2024-04-02T07:31:31.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.601+0000 7f9331e00640 1 --2- 172.21.15.55:0/3523735516 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9310066690 0x7f9310068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:31.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.601+0000 7f9331e00640 1 --2- 172.21.15.55:0/3523735516 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9310066690 0x7f9310068b50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f93240af000 tx=0x7f93240a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:31.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.605+0000 7f932a000640 1 -- 172.21.15.55:0/3523735516 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f931c051a80 con 0x7f93340b3dc0 2024-04-02T07:31:31.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:31.801+0000 7f9338a00640 1 -- 172.21.15.55:0/3523735516 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9334073530 con 0x7f93340b3dc0 2024-04-02T07:31:32.249 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-04-02T07:31:32.245+0000 7fc138800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:31:32.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.713+0000 7f932a000640 1 -- 172.21.15.55:0/3523735516 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v80) v1 ==== 118+0+0 (secure 0 0 0) 0x7f931c0550a0 con 0x7f93340b3dc0 2024-04-02T07:31:32.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.717+0000 7f9338a00640 1 -- 172.21.15.55:0/3523735516 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9310066690 msgr2=0x7f9310068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:32.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.717+0000 7f9338a00640 1 --2- 172.21.15.55:0/3523735516 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9310066690 0x7f9310068b50 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f93240af000 tx=0x7f93240a7000 comp rx=0 tx=0).stop 2024-04-02T07:31:32.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.717+0000 7f9338a00640 1 -- 172.21.15.55:0/3523735516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93340b3dc0 msgr2=0x7f9334133b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:32.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.717+0000 7f9338a00640 1 --2- 172.21.15.55:0/3523735516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93340b3dc0 0x7f9334133b30 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7f931c00d800 tx=0x7f931c00dcc0 comp rx=0 tx=0).stop 2024-04-02T07:31:32.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.717+0000 7f9338a00640 1 -- 172.21.15.55:0/3523735516 shutdown_connections 2024-04-02T07:31:32.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.717+0000 7f9338a00640 1 --2- 172.21.15.55:0/3523735516 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f93340b41a0 0x7f9334135d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:32.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.717+0000 7f9338a00640 1 --2- 172.21.15.55:0/3523735516 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93340b3dc0 0x7f9334133b30 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:32.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.717+0000 7f9338a00640 1 --2- 172.21.15.55:0/3523735516 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9310066690 0x7f9310068b50 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:32.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.717+0000 7f9338a00640 1 --2- 172.21.15.55:0/3523735516 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f93340ade90 0x7f9334138ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:32.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.717+0000 7f9338a00640 1 -- 172.21.15.55:0/3523735516 >> 172.21.15.55:0/3523735516 conn(0x7f933406a390 msgr2=0x7f9334154500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:32.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.717+0000 7f9338a00640 1 -- 172.21.15.55:0/3523735516 shutdown_connections 2024-04-02T07:31:32.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.717+0000 7f9338a00640 1 -- 172.21.15.55:0/3523735516 wait complete. 2024-04-02T07:31:32.740 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-02T07:31:32.740 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-02T07:31:32.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.885+0000 7f1833600640 1 Processor -- start 2024-04-02T07:31:32.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.885+0000 7f1833600640 1 -- start start 2024-04-02T07:31:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.885+0000 7f1833600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f182c15ca60 0x7f182c0cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.885+0000 7f1833600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f182c098a10 0x7f182c098ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.885+0000 7f1833600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f182c15ce40 con 0x7f182c06b920 2024-04-02T07:31:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.885+0000 7f1833600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f182c0993e0 con 0x7f182c098a10 2024-04-02T07:31:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.885+0000 7f1833600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f182c06c440 con 0x7f182c15ca60 2024-04-02T07:31:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.889+0000 7f182be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f182c098a10 0x7f182c098ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.889+0000 7f182be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f182c098a10 0x7f182c098ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44154/0 (socket says 172.21.15.55:44154) 2024-04-02T07:31:32.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.889+0000 7f182be00640 1 -- 172.21.15.55:0/1300928412 learned_addr learned my addr 172.21.15.55:0/1300928412 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:32.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.889+0000 7f1830c00640 1 --2- 172.21.15.55:0/1300928412 >> v2:172.21.15.106:3300/0 conn(0x7f182c15ca60 0x7f182c0cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:32.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.889+0000 7f182be00640 1 -- 172.21.15.55:0/1300928412 >> v2:172.21.15.106:3300/0 conn(0x7f182c15ca60 msgr2=0x7f182c0cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:32.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.889+0000 7f182be00640 1 --2- 172.21.15.55:0/1300928412 >> v2:172.21.15.106:3300/0 conn(0x7f182c15ca60 0x7f182c0cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:32.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.889+0000 7f182be00640 1 -- 172.21.15.55:0/1300928412 >> v1:172.21.15.106:6789/0 conn(0x7f182c06b920 legacy=0x7f182c06bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:32.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.889+0000 7f182be00640 1 -- 172.21.15.55:0/1300928412 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c0d01b0 con 0x7f182c098a10 2024-04-02T07:31:32.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.889+0000 7f182be00640 1 --2- 172.21.15.55:0/1300928412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f182c098a10 0x7f182c098ea0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f182c0d1760 tx=0x7f181801c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e708a86236ae9172 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:32.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.889+0000 7f182b400640 1 -- 172.21.15.55:0/1300928412 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18180ab620 con 0x7f182c098a10 2024-04-02T07:31:32.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.889+0000 7f182b400640 1 -- 172.21.15.55:0/1300928412 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18180ab780 con 0x7f182c098a10 2024-04-02T07:31:32.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.889+0000 7f182b400640 1 -- 172.21.15.55:0/1300928412 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18180abb10 con 0x7f182c098a10 2024-04-02T07:31:32.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1833600640 1 -- 172.21.15.55:0/1300928412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f182c098a10 msgr2=0x7f182c098ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:32.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1833600640 1 --2- 172.21.15.55:0/1300928412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f182c098a10 0x7f182c098ea0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7f182c0d1760 tx=0x7f181801c420 comp rx=0 tx=0).stop 2024-04-02T07:31:32.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1833600640 1 -- 172.21.15.55:0/1300928412 shutdown_connections 2024-04-02T07:31:32.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1833600640 1 --2- 172.21.15.55:0/1300928412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f182c098a10 0x7f182c098ea0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:32.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1833600640 1 --2- 172.21.15.55:0/1300928412 >> v2:172.21.15.106:3300/0 conn(0x7f182c15ca60 0x7f182c0cfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:32.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1833600640 1 -- 172.21.15.55:0/1300928412 >> 172.21.15.55:0/1300928412 conn(0x7f182c0b2150 msgr2=0x7f182c0b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:32.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1833600640 1 -- 172.21.15.55:0/1300928412 shutdown_connections 2024-04-02T07:31:32.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1833600640 1 -- 172.21.15.55:0/1300928412 wait complete. 2024-04-02T07:31:32.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1833600640 1 Processor -- start 2024-04-02T07:31:32.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1833600640 1 -- start start 2024-04-02T07:31:32.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1833600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f182c06b920 0x7f182c154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:32.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1833600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f182c098a10 0x7f182c158750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:32.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1833600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f182c15ca60 0x7f182c158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:32.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1833600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c0c6730 con 0x7f182c15ca60 2024-04-02T07:31:32.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1833600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182c154d90 con 0x7f182c098a10 2024-04-02T07:31:32.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1833600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f182c0c4cb0 con 0x7f182c06b920 2024-04-02T07:31:32.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1831600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f182c15ca60 0x7f182c158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:32.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f182be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f182c098a10 0x7f182c158750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:32.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1830c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f182c06b920 0x7f182c154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:32.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f182be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f182c098a10 0x7f182c158750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:52646/0 (socket says 172.21.15.55:52646) 2024-04-02T07:31:32.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1831600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f182c15ca60 0x7f182c158c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44170/0 (socket says 172.21.15.55:44170) 2024-04-02T07:31:32.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f182be00640 1 -- 172.21.15.55:0/3415088255 learned_addr learned my addr 172.21.15.55:0/3415088255 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:32.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1831600640 1 -- 172.21.15.55:0/3415088255 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f182c06b920 msgr2=0x7f182c154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:32.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1831600640 1 --2- 172.21.15.55:0/3415088255 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f182c06b920 0x7f182c154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:32.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1831600640 1 -- 172.21.15.55:0/3415088255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f182c098a10 msgr2=0x7f182c158750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:32.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1831600640 1 --2- 172.21.15.55:0/3415088255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f182c098a10 0x7f182c158750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:32.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f1831600640 1 -- 172.21.15.55:0/3415088255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18180094d0 con 0x7f182c15ca60 2024-04-02T07:31:32.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.893+0000 7f182be00640 1 --2- 172.21.15.55:0/3415088255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f182c098a10 0x7f182c158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:31:32.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.897+0000 7f1831600640 1 --2- 172.21.15.55:0/3415088255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f182c15ca60 0x7f182c158c90 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f182400be00 tx=0x7f182400bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:32.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.897+0000 7f1828c00640 1 -- 172.21.15.55:0/3415088255 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182400ce70 con 0x7f182c15ca60 2024-04-02T07:31:32.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.897+0000 7f1828c00640 1 -- 172.21.15.55:0/3415088255 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1824003980 con 0x7f182c15ca60 2024-04-02T07:31:32.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.897+0000 7f1833600640 1 -- 172.21.15.55:0/3415088255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182c0c4f90 con 0x7f182c15ca60 2024-04-02T07:31:32.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.897+0000 7f1828c00640 1 -- 172.21.15.55:0/3415088255 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824003d70 con 0x7f182c15ca60 2024-04-02T07:31:32.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.897+0000 7f1833600640 1 -- 172.21.15.55:0/3415088255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182c0c69d0 con 0x7f182c15ca60 2024-04-02T07:31:32.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.897+0000 7f1833600640 1 -- 172.21.15.55:0/3415088255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f182c066c90 con 0x7f182c15ca60 2024-04-02T07:31:32.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.897+0000 7f1828c00640 1 -- 172.21.15.55:0/3415088255 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1824003ed0 con 0x7f182c15ca60 2024-04-02T07:31:32.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.897+0000 7f1828c00640 1 --2- 172.21.15.55:0/3415088255 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f180c066690 0x7f180c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:32.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.897+0000 7f1828c00640 1 -- 172.21.15.55:0/3415088255 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1824084080 con 0x7f182c15ca60 2024-04-02T07:31:32.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.897+0000 7f1830c00640 1 --2- 172.21.15.55:0/3415088255 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f180c066690 0x7f180c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:32.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.901+0000 7f1830c00640 1 --2- 172.21.15.55:0/3415088255 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f180c066690 0x7f180c068b50 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1820007a60 tx=0x7f1820008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:32.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:32.901+0000 7f1828c00640 1 -- 172.21.15.55:0/3415088255 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f18240b5980 con 0x7f182c15ca60 2024-04-02T07:31:33.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.097+0000 7f1833600640 1 -- 172.21.15.55:0/3415088255 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f182c0b2ff0 con 0x7f182c15ca60 2024-04-02T07:31:33.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.717+0000 7f1828c00640 1 -- 172.21.15.55:0/3415088255 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v81) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1824051490 con 0x7f182c15ca60 2024-04-02T07:31:33.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.717+0000 7f1833600640 1 -- 172.21.15.55:0/3415088255 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f180c066690 msgr2=0x7f180c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:33.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.717+0000 7f1833600640 1 --2- 172.21.15.55:0/3415088255 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f180c066690 0x7f180c068b50 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1820007a60 tx=0x7f1820008040 comp rx=0 tx=0).stop 2024-04-02T07:31:33.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.717+0000 7f1833600640 1 -- 172.21.15.55:0/3415088255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f182c15ca60 msgr2=0x7f182c158c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:33.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.717+0000 7f1833600640 1 --2- 172.21.15.55:0/3415088255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f182c15ca60 0x7f182c158c90 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f182400be00 tx=0x7f182400bef0 comp rx=0 tx=0).stop 2024-04-02T07:31:33.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.717+0000 7f1833600640 1 -- 172.21.15.55:0/3415088255 shutdown_connections 2024-04-02T07:31:33.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.717+0000 7f1833600640 1 --2- 172.21.15.55:0/3415088255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f182c15ca60 0x7f182c158c90 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:33.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.717+0000 7f1833600640 1 --2- 172.21.15.55:0/3415088255 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f180c066690 0x7f180c068b50 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:33.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.717+0000 7f1833600640 1 --2- 172.21.15.55:0/3415088255 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f182c098a10 0x7f182c158750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:33.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.717+0000 7f1833600640 1 --2- 172.21.15.55:0/3415088255 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f182c06b920 0x7f182c154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:33.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.717+0000 7f1833600640 1 -- 172.21.15.55:0/3415088255 >> 172.21.15.55:0/3415088255 conn(0x7f182c0b2150 msgr2=0x7f182c0cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:33.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.717+0000 7f1833600640 1 -- 172.21.15.55:0/3415088255 shutdown_connections 2024-04-02T07:31:33.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.717+0000 7f1833600640 1 -- 172.21.15.55:0/3415088255 wait complete. 2024-04-02T07:31:33.744 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-02T07:31:33.745 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:31:33.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.885+0000 7fe67ba00640 1 Processor -- start 2024-04-02T07:31:33.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.885+0000 7fe67ba00640 1 -- start start 2024-04-02T07:31:33.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.889+0000 7fe67ba00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe67415aa60 0x7fe674099750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:33.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.889+0000 7fe67ba00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe674099120 0x7fe6740afa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:33.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.889+0000 7fe67ba00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6740cb250 con 0x7fe6740cc520 2024-04-02T07:31:33.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.889+0000 7fe67ba00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67415ae40 con 0x7fe674099120 2024-04-02T07:31:33.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.889+0000 7fe67ba00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740cb480 con 0x7fe67415aa60 2024-04-02T07:31:33.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.889+0000 7fe679a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe674099120 0x7fe6740afa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:33.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.889+0000 7fe679a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe674099120 0x7fe6740afa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44172/0 (socket says 172.21.15.55:44172) 2024-04-02T07:31:33.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.889+0000 7fe679a00640 1 -- 172.21.15.55:0/2535219178 learned_addr learned my addr 172.21.15.55:0/2535219178 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:33.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.889+0000 7fe679a00640 1 -- 172.21.15.55:0/2535219178 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe67415aa60 msgr2=0x7fe674099750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:33.890 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.889+0000 7fe679000640 1 --2- 172.21.15.55:0/2535219178 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe67415aa60 0x7fe674099750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:33.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.889+0000 7fe679a00640 1 --2- 172.21.15.55:0/2535219178 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe67415aa60 0x7fe674099750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:33.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.889+0000 7fe679a00640 1 -- 172.21.15.55:0/2535219178 >> v1:172.21.15.106:6789/0 conn(0x7fe6740cc520 legacy=0x7fe674098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:33.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.889+0000 7fe679a00640 1 -- 172.21.15.55:0/2535219178 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6740cb760 con 0x7fe674099120 2024-04-02T07:31:33.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.889+0000 7fe679000640 1 --2- 172.21.15.55:0/2535219178 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe67415aa60 0x7fe674099750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:33.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe679a00640 1 --2- 172.21.15.55:0/2535219178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe674099120 0x7fe6740afa90 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009e50 tx=0x7fe66c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ed1bf63fdca6bb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:33.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe673400640 1 -- 172.21.15.55:0/2535219178 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c0a58d0 con 0x7fe674099120 2024-04-02T07:31:33.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe673400640 1 -- 172.21.15.55:0/2535219178 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c0a5a30 con 0x7fe674099120 2024-04-02T07:31:33.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe673400640 1 -- 172.21.15.55:0/2535219178 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c0a5dc0 con 0x7fe674099120 2024-04-02T07:31:33.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe67ba00640 1 -- 172.21.15.55:0/2535219178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe674099120 msgr2=0x7fe6740afa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:33.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe67ba00640 1 --2- 172.21.15.55:0/2535219178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe674099120 0x7fe6740afa90 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7fe66c009e50 tx=0x7fe66c01ca00 comp rx=0 tx=0).stop 2024-04-02T07:31:33.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe67ba00640 1 -- 172.21.15.55:0/2535219178 shutdown_connections 2024-04-02T07:31:33.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe67ba00640 1 --2- 172.21.15.55:0/2535219178 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe674099120 0x7fe6740afa90 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:33.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe67ba00640 1 --2- 172.21.15.55:0/2535219178 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe67415aa60 0x7fe674099750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:33.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe67ba00640 1 -- 172.21.15.55:0/2535219178 >> 172.21.15.55:0/2535219178 conn(0x7fe6740b2150 msgr2=0x7fe6740b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:33.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe67ba00640 1 -- 172.21.15.55:0/2535219178 shutdown_connections 2024-04-02T07:31:33.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe67ba00640 1 -- 172.21.15.55:0/2535219178 wait complete. 2024-04-02T07:31:33.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe67ba00640 1 Processor -- start 2024-04-02T07:31:33.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe67ba00640 1 -- start start 2024-04-02T07:31:33.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe67ba00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe674099120 0x7fe6741590c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:33.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe67ba00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6740cc520 0x7fe6740c67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:33.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe67ba00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe67415aa60 0x7fe6740c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:33.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe67ba00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740b3280 con 0x7fe6740cc520 2024-04-02T07:31:33.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe67ba00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740c5480 con 0x7fe674099120 2024-04-02T07:31:33.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe67ba00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6740c5760 con 0x7fe67415aa60 2024-04-02T07:31:33.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe673e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6740cc520 0x7fe6740c67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:33.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe679000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe674099120 0x7fe6741590c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:33.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe673e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6740cc520 0x7fe6740c67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44176/0 (socket says 172.21.15.55:44176) 2024-04-02T07:31:33.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe679a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe67415aa60 0x7fe6740c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:33.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.893+0000 7fe673e00640 1 -- 172.21.15.55:0/3255711377 learned_addr learned my addr 172.21.15.55:0/3255711377 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:33.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.897+0000 7fe673e00640 1 -- 172.21.15.55:0/3255711377 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe67415aa60 msgr2=0x7fe6740c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:33.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.897+0000 7fe673e00640 1 --2- 172.21.15.55:0/3255711377 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe67415aa60 0x7fe6740c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:33.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.897+0000 7fe673e00640 1 -- 172.21.15.55:0/3255711377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe674099120 msgr2=0x7fe6741590c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:33.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.897+0000 7fe673e00640 1 --2- 172.21.15.55:0/3255711377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe674099120 0x7fe6741590c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:33.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.897+0000 7fe673e00640 1 -- 172.21.15.55:0/3255711377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66c009b30 con 0x7fe6740cc520 2024-04-02T07:31:33.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.897+0000 7fe673e00640 1 --2- 172.21.15.55:0/3255711377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6740cc520 0x7fe6740c67b0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fe66000c500 tx=0x7fe66000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:33.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.897+0000 7fe670c00640 1 -- 172.21.15.55:0/3255711377 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660005220 con 0x7fe6740cc520 2024-04-02T07:31:33.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.897+0000 7fe670c00640 1 -- 172.21.15.55:0/3255711377 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe660005380 con 0x7fe6740cc520 2024-04-02T07:31:33.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.897+0000 7fe670c00640 1 -- 172.21.15.55:0/3255711377 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe660007270 con 0x7fe6740cc520 2024-04-02T07:31:33.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.897+0000 7fe67ba00640 1 -- 172.21.15.55:0/3255711377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6740c5a40 con 0x7fe6740cc520 2024-04-02T07:31:33.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.897+0000 7fe67ba00640 1 -- 172.21.15.55:0/3255711377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe674159600 con 0x7fe6740cc520 2024-04-02T07:31:33.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.897+0000 7fe67ba00640 1 -- 172.21.15.55:0/3255711377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6740b3430 con 0x7fe6740cc520 2024-04-02T07:31:33.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.897+0000 7fe670c00640 1 -- 172.21.15.55:0/3255711377 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe6600073d0 con 0x7fe6740cc520 2024-04-02T07:31:33.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.897+0000 7fe670c00640 1 --2- 172.21.15.55:0/3255711377 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe654066690 0x7fe654068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:33.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.897+0000 7fe670c00640 1 -- 172.21.15.55:0/3255711377 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6600839f0 con 0x7fe6740cc520 2024-04-02T07:31:33.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.897+0000 7fe679000640 1 --2- 172.21.15.55:0/3255711377 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe654066690 0x7fe654068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:33.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.901+0000 7fe679000640 1 --2- 172.21.15.55:0/3255711377 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe654066690 0x7fe654068b50 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe668006fd0 tx=0x7fe668008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:33.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:33.905+0000 7fe670c00640 1 -- 172.21.15.55:0/3255711377 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe6740b3430 con 0x7fe6740cc520 2024-04-02T07:31:34.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.097+0000 7fe67ba00640 1 -- 172.21.15.55:0/3255711377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe674066c90 con 0x7fe6740cc520 2024-04-02T07:31:34.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.097+0000 7fe670c00640 1 -- 172.21.15.55:0/3255711377 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4736 (secure 0 0 0) 0x7fe660050d80 con 0x7fe6740cc520 2024-04-02T07:31:34.099 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:34.099 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":81,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2707651793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2707651793},{"type":"v1","addr":"172.21.15.106:6836","nonce":2707651793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2234384639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2234384639},{"type":"v1","addr":"172.21.15.106:6837","nonce":2234384639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":8433,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53259218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53259218},{"type":"v1","addr":"172.21.15.55:6833","nonce":53259218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:31:30.704183+0000","modified":"2024-04-02T07:31:33.715450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8436":{"gid":8436,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1089546237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1089546237},{"type":"v1","addr":"172.21.15.55:6835","nonce":1089546237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-02T07:31:34.099 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 81 2024-04-02T07:31:34.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.097+0000 7fe67ba00640 1 -- 172.21.15.55:0/3255711377 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe654066690 msgr2=0x7fe654068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:34.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.097+0000 7fe67ba00640 1 --2- 172.21.15.55:0/3255711377 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe654066690 0x7fe654068b50 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fe668006fd0 tx=0x7fe668008040 comp rx=0 tx=0).stop 2024-04-02T07:31:34.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.097+0000 7fe67ba00640 1 -- 172.21.15.55:0/3255711377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6740cc520 msgr2=0x7fe6740c67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:34.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.097+0000 7fe67ba00640 1 --2- 172.21.15.55:0/3255711377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6740cc520 0x7fe6740c67b0 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7fe66000c500 tx=0x7fe66000c9c0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.097+0000 7fe67ba00640 1 -- 172.21.15.55:0/3255711377 shutdown_connections 2024-04-02T07:31:34.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.097+0000 7fe67ba00640 1 --2- 172.21.15.55:0/3255711377 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe67415aa60 0x7fe6740c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.097+0000 7fe67ba00640 1 --2- 172.21.15.55:0/3255711377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6740cc520 0x7fe6740c67b0 unknown :-1 s=CLOSED pgs=1450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.097+0000 7fe67ba00640 1 --2- 172.21.15.55:0/3255711377 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe654066690 0x7fe654068b50 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.097+0000 7fe67ba00640 1 --2- 172.21.15.55:0/3255711377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe674099120 0x7fe6741590c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.097+0000 7fe67ba00640 1 -- 172.21.15.55:0/3255711377 >> 172.21.15.55:0/3255711377 conn(0x7fe6740b2150 msgr2=0x7fe674164dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:34.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.101+0000 7fe67ba00640 1 -- 172.21.15.55:0/3255711377 shutdown_connections 2024-04-02T07:31:34.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.101+0000 7fe67ba00640 1 -- 172.21.15.55:0/3255711377 wait complete. 2024-04-02T07:31:34.120 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:31:34.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.257+0000 7fe244800640 1 Processor -- start 2024-04-02T07:31:34.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.261+0000 7fe244800640 1 -- start start 2024-04-02T07:31:34.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.261+0000 7fe244800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe23c099120 0x7fe23c099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:34.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.261+0000 7fe244800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe23c15f250 0x7fe23c0b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:34.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.261+0000 7fe244800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe23c0ad270 con 0x7fe23c15ee70 2024-04-02T07:31:34.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.261+0000 7fe244800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe23c0b0840 con 0x7fe23c15f250 2024-04-02T07:31:34.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.261+0000 7fe244800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c0cf6a0 con 0x7fe23c099120 2024-04-02T07:31:34.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.261+0000 7fe242800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe23c15f250 0x7fe23c0b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:34.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.261+0000 7fe242800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe23c15f250 0x7fe23c0b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44188/0 (socket says 172.21.15.55:44188) 2024-04-02T07:31:34.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.261+0000 7fe242800640 1 -- 172.21.15.55:0/1248017480 learned_addr learned my addr 172.21.15.55:0/1248017480 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:34.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.261+0000 7fe241400640 1 --2- 172.21.15.55:0/1248017480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe23c099120 0x7fe23c099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:34.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.261+0000 7fe242800640 1 -- 172.21.15.55:0/1248017480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe23c099120 msgr2=0x7fe23c099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:34.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.261+0000 7fe242800640 1 --2- 172.21.15.55:0/1248017480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe23c099120 0x7fe23c099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.261+0000 7fe242800640 1 -- 172.21.15.55:0/1248017480 >> v1:172.21.15.106:6789/0 conn(0x7fe23c15ee70 legacy=0x7fe23c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:34.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.261+0000 7fe242800640 1 -- 172.21.15.55:0/1248017480 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c0b0a50 con 0x7fe23c15f250 2024-04-02T07:31:34.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.261+0000 7fe241400640 1 --2- 172.21.15.55:0/1248017480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe23c099120 0x7fe23c099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:34.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.265+0000 7fe242800640 1 --2- 172.21.15.55:0/1248017480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe23c15f250 0x7fe23c0b12f0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fe238009e50 tx=0x7fe23801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ae04920ea436089 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:34.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.265+0000 7fe240a00640 1 -- 172.21.15.55:0/1248017480 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2380a5870 con 0x7fe23c15f250 2024-04-02T07:31:34.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.265+0000 7fe240a00640 1 -- 172.21.15.55:0/1248017480 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2380a59d0 con 0x7fe23c15f250 2024-04-02T07:31:34.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.265+0000 7fe240a00640 1 -- 172.21.15.55:0/1248017480 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2380a5d60 con 0x7fe23c15f250 2024-04-02T07:31:34.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.265+0000 7fe244800640 1 -- 172.21.15.55:0/1248017480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe23c15f250 msgr2=0x7fe23c0b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:34.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.265+0000 7fe244800640 1 --2- 172.21.15.55:0/1248017480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe23c15f250 0x7fe23c0b12f0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fe238009e50 tx=0x7fe23801c9f0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.265+0000 7fe244800640 1 -- 172.21.15.55:0/1248017480 shutdown_connections 2024-04-02T07:31:34.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.265+0000 7fe244800640 1 --2- 172.21.15.55:0/1248017480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe23c15f250 0x7fe23c0b12f0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.265+0000 7fe244800640 1 --2- 172.21.15.55:0/1248017480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe23c099120 0x7fe23c099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.265+0000 7fe244800640 1 -- 172.21.15.55:0/1248017480 >> 172.21.15.55:0/1248017480 conn(0x7fe23c0b21d0 msgr2=0x7fe23c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:34.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.265+0000 7fe244800640 1 -- 172.21.15.55:0/1248017480 shutdown_connections 2024-04-02T07:31:34.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.265+0000 7fe244800640 1 -- 172.21.15.55:0/1248017480 wait complete. 2024-04-02T07:31:34.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.265+0000 7fe244800640 1 Processor -- start 2024-04-02T07:31:34.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.265+0000 7fe244800640 1 -- start start 2024-04-02T07:31:34.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe244800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe23c099120 0x7fe23c149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:34.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe244800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe23c15ee70 0x7fe23c15da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:34.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe244800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe23c15f250 0x7fe23c146360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:34.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe244800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c15dfb0 con 0x7fe23c099120 2024-04-02T07:31:34.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe244800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c0c7b00 con 0x7fe23c15f250 2024-04-02T07:31:34.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe244800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c15cf90 con 0x7fe23c15ee70 2024-04-02T07:31:34.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe241e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe23c099120 0x7fe23c149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:34.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe241e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe23c099120 0x7fe23c149d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44198/0 (socket says 172.21.15.55:44198) 2024-04-02T07:31:34.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe241e00640 1 -- 172.21.15.55:0/3798415168 learned_addr learned my addr 172.21.15.55:0/3798415168 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:34.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe241400640 1 --2- 172.21.15.55:0/3798415168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe23c15ee70 0x7fe23c15da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:34.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe242800640 1 --2- 172.21.15.55:0/3798415168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe23c15f250 0x7fe23c146360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:34.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe241e00640 1 -- 172.21.15.55:0/3798415168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe23c15ee70 msgr2=0x7fe23c15da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:34.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe241e00640 1 --2- 172.21.15.55:0/3798415168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe23c15ee70 0x7fe23c15da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe241e00640 1 -- 172.21.15.55:0/3798415168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe23c15f250 msgr2=0x7fe23c146360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:34.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe241e00640 1 --2- 172.21.15.55:0/3798415168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe23c15f250 0x7fe23c146360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe241e00640 1 -- 172.21.15.55:0/3798415168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe238009b30 con 0x7fe23c099120 2024-04-02T07:31:34.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe242800640 1 --2- 172.21.15.55:0/3798415168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe23c15f250 0x7fe23c146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:34.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe241400640 1 --2- 172.21.15.55:0/3798415168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe23c15ee70 0x7fe23c15da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:34.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe241e00640 1 --2- 172.21.15.55:0/3798415168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe23c099120 0x7fe23c149d90 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fe23000c450 tx=0x7fe23000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:34.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe236000640 1 -- 172.21.15.55:0/3798415168 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe230012830 con 0x7fe23c099120 2024-04-02T07:31:34.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe236000640 1 -- 172.21.15.55:0/3798415168 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2300129b0 con 0x7fe23c099120 2024-04-02T07:31:34.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe244800640 1 -- 172.21.15.55:0/3798415168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe23c15d270 con 0x7fe23c099120 2024-04-02T07:31:34.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe236000640 1 -- 172.21.15.55:0/3798415168 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe230012d60 con 0x7fe23c099120 2024-04-02T07:31:34.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe244800640 1 -- 172.21.15.55:0/3798415168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe23c0c7de0 con 0x7fe23c099120 2024-04-02T07:31:34.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe244800640 1 -- 172.21.15.55:0/3798415168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe23c066c90 con 0x7fe23c099120 2024-04-02T07:31:34.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.269+0000 7fe236000640 1 -- 172.21.15.55:0/3798415168 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe23001c460 con 0x7fe23c099120 2024-04-02T07:31:34.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.273+0000 7fe236000640 1 --2- 172.21.15.55:0/3798415168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe220066690 0x7fe220068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:34.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.273+0000 7fe236000640 1 -- 172.21.15.55:0/3798415168 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe230084110 con 0x7fe23c099120 2024-04-02T07:31:34.273 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.273+0000 7fe241400640 1 --2- 172.21.15.55:0/3798415168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe220066690 0x7fe220068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:34.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.273+0000 7fe241400640 1 --2- 172.21.15.55:0/3798415168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe220066690 0x7fe220068b50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe23c0b6630 tx=0x7fe22c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:34.276 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.277+0000 7fe236000640 1 -- 172.21.15.55:0/3798415168 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe2300513e0 con 0x7fe23c099120 2024-04-02T07:31:34.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.437+0000 7fe244800640 1 -- 172.21.15.55:0/3798415168 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe23c0cc3e0 con 0x7fe23c099120 2024-04-02T07:31:34.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.441+0000 7fe236000640 1 -- 172.21.15.55:0/3798415168 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+16051 (secure 0 0 0) 0x7fe230054a00 con 0x7fe23c099120 2024-04-02T07:31:34.441 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:34.441 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":103,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:31:31.706822+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:31:29.246681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-02T07:31:29.698823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:31:34.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.441+0000 7fe244800640 1 -- 172.21.15.55:0/3798415168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe220066690 msgr2=0x7fe220068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:34.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.441+0000 7fe244800640 1 --2- 172.21.15.55:0/3798415168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe220066690 0x7fe220068b50 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fe23c0b6630 tx=0x7fe22c008040 comp rx=0 tx=0).stop 2024-04-02T07:31:34.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.441+0000 7fe244800640 1 -- 172.21.15.55:0/3798415168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe23c099120 msgr2=0x7fe23c149d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:34.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.441+0000 7fe244800640 1 --2- 172.21.15.55:0/3798415168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe23c099120 0x7fe23c149d90 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fe23000c450 tx=0x7fe23000c910 comp rx=0 tx=0).stop 2024-04-02T07:31:34.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.441+0000 7fe244800640 1 -- 172.21.15.55:0/3798415168 shutdown_connections 2024-04-02T07:31:34.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.441+0000 7fe244800640 1 --2- 172.21.15.55:0/3798415168 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe220066690 0x7fe220068b50 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.441+0000 7fe244800640 1 --2- 172.21.15.55:0/3798415168 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe23c15f250 0x7fe23c146360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.441+0000 7fe244800640 1 --2- 172.21.15.55:0/3798415168 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe23c15ee70 0x7fe23c15da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.441+0000 7fe244800640 1 --2- 172.21.15.55:0/3798415168 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe23c099120 0x7fe23c149d90 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.441+0000 7fe244800640 1 -- 172.21.15.55:0/3798415168 >> 172.21.15.55:0/3798415168 conn(0x7fe23c0b21d0 msgr2=0x7fe23c06f8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:34.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.441+0000 7fe244800640 1 -- 172.21.15.55:0/3798415168 shutdown_connections 2024-04-02T07:31:34.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.441+0000 7fe244800640 1 -- 172.21.15.55:0/3798415168 wait complete. 2024-04-02T07:31:34.463 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-02T07:31:34.463 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:31:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.601+0000 7fc2f5a00640 1 Processor -- start 2024-04-02T07:31:34.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.601+0000 7fc2f5a00640 1 -- start start 2024-04-02T07:31:34.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.605+0000 7fc2f5a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc2f0153ea0 0x7fc2f00c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:34.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.605+0000 7fc2f5a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc2f0159be0 0x7fc2f00b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:34.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.605+0000 7fc2f5a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2f013d0c0 con 0x7fc2f015a070 2024-04-02T07:31:34.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.605+0000 7fc2f5a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f015a4f0 con 0x7fc2f0153ea0 2024-04-02T07:31:34.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.605+0000 7fc2f5a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2f015a7d0 con 0x7fc2f0159be0 2024-04-02T07:31:34.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.605+0000 7fc2eea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc2f0153ea0 0x7fc2f00c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:34.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.605+0000 7fc2eea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc2f0153ea0 0x7fc2f00c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44200/0 (socket says 172.21.15.55:44200) 2024-04-02T07:31:34.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.605+0000 7fc2eea00640 1 -- 172.21.15.55:0/1916235430 learned_addr learned my addr 172.21.15.55:0/1916235430 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:34.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.605+0000 7fc2eea00640 1 -- 172.21.15.55:0/1916235430 >> v2:172.21.15.106:3300/0 conn(0x7fc2f0159be0 msgr2=0x7fc2f00b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:34.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.605+0000 7fc2eea00640 1 --2- 172.21.15.55:0/1916235430 >> v2:172.21.15.106:3300/0 conn(0x7fc2f0159be0 0x7fc2f00b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.605+0000 7fc2eea00640 1 -- 172.21.15.55:0/1916235430 >> v1:172.21.15.106:6789/0 conn(0x7fc2f015a070 legacy=0x7fc2f013ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:34.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.605+0000 7fc2eea00640 1 -- 172.21.15.55:0/1916235430 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2f015aab0 con 0x7fc2f0153ea0 2024-04-02T07:31:34.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.605+0000 7fc2eea00640 1 --2- 172.21.15.55:0/1916235430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2f0153ea0 0x7fc2f00c4120 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fc2f006d470 tx=0x7fc2e001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374841bb7486aeb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:34.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.605+0000 7fc2ee000640 1 -- 172.21.15.55:0/1916235430 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e00aa660 con 0x7fc2f0153ea0 2024-04-02T07:31:34.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.605+0000 7fc2ee000640 1 -- 172.21.15.55:0/1916235430 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e00aa7c0 con 0x7fc2f0153ea0 2024-04-02T07:31:34.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.605+0000 7fc2ee000640 1 -- 172.21.15.55:0/1916235430 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e00aab50 con 0x7fc2f0153ea0 2024-04-02T07:31:34.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2f5a00640 1 -- 172.21.15.55:0/1916235430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2f0153ea0 msgr2=0x7fc2f00c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:34.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2f5a00640 1 --2- 172.21.15.55:0/1916235430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2f0153ea0 0x7fc2f00c4120 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fc2f006d470 tx=0x7fc2e001c4e0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2f5a00640 1 -- 172.21.15.55:0/1916235430 shutdown_connections 2024-04-02T07:31:34.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2f5a00640 1 --2- 172.21.15.55:0/1916235430 >> v2:172.21.15.106:3300/0 conn(0x7fc2f0159be0 0x7fc2f00b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2f5a00640 1 --2- 172.21.15.55:0/1916235430 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2f0153ea0 0x7fc2f00c4120 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2f5a00640 1 -- 172.21.15.55:0/1916235430 >> 172.21.15.55:0/1916235430 conn(0x7fc2f0066080 msgr2=0x7fc2f0069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:34.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2f5a00640 1 -- 172.21.15.55:0/1916235430 shutdown_connections 2024-04-02T07:31:34.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2f5a00640 1 -- 172.21.15.55:0/1916235430 wait complete. 2024-04-02T07:31:34.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2f5a00640 1 Processor -- start 2024-04-02T07:31:34.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2f5a00640 1 -- start start 2024-04-02T07:31:34.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2f5a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2f0153ea0 0x7fc2f0154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:34.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2f5a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2f0159be0 0x7fc2f012fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:34.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2f5a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2f015a070 0x7fc2f00cd800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:34.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2f5a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f0154ae0 con 0x7fc2f015a070 2024-04-02T07:31:34.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2f5a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f0130290 con 0x7fc2f0159be0 2024-04-02T07:31:34.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2f5a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2f0153690 con 0x7fc2f0153ea0 2024-04-02T07:31:34.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2ef400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2f015a070 0x7fc2f00cd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:34.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2ef400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2f015a070 0x7fc2f00cd800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44216/0 (socket says 172.21.15.55:44216) 2024-04-02T07:31:34.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2ef400640 1 -- 172.21.15.55:0/4194156057 learned_addr learned my addr 172.21.15.55:0/4194156057 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:34.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2eea00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2f0153ea0 0x7fc2f0154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:34.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2e6000640 1 --2- 172.21.15.55:0/4194156057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2f0159be0 0x7fc2f012fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2ef400640 1 -- 172.21.15.55:0/4194156057 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2f0153ea0 msgr2=0x7fc2f0154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2ef400640 1 --2- 172.21.15.55:0/4194156057 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2f0153ea0 0x7fc2f0154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2ef400640 1 -- 172.21.15.55:0/4194156057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2f0159be0 msgr2=0x7fc2f012fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2ef400640 1 --2- 172.21.15.55:0/4194156057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2f0159be0 0x7fc2f012fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.609+0000 7fc2ef400640 1 -- 172.21.15.55:0/4194156057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e00094d0 con 0x7fc2f015a070 2024-04-02T07:31:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.613+0000 7fc2ef400640 1 --2- 172.21.15.55:0/4194156057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2f015a070 0x7fc2f00cd800 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800b9c0 tx=0x7fc2e800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.613+0000 7fc2e7400640 1 -- 172.21.15.55:0/4194156057 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e800cba0 con 0x7fc2f015a070 2024-04-02T07:31:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.613+0000 7fc2e7400640 1 -- 172.21.15.55:0/4194156057 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2e800cd00 con 0x7fc2f015a070 2024-04-02T07:31:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.613+0000 7fc2e7400640 1 -- 172.21.15.55:0/4194156057 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8014680 con 0x7fc2f015a070 2024-04-02T07:31:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.613+0000 7fc2f5a00640 1 -- 172.21.15.55:0/4194156057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2f00ce1e0 con 0x7fc2f015a070 2024-04-02T07:31:34.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.613+0000 7fc2f5a00640 1 -- 172.21.15.55:0/4194156057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2f0154700 con 0x7fc2f015a070 2024-04-02T07:31:34.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.613+0000 7fc2f5a00640 1 -- 172.21.15.55:0/4194156057 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2f0154280 con 0x7fc2f015a070 2024-04-02T07:31:34.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.613+0000 7fc2e7400640 1 -- 172.21.15.55:0/4194156057 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc2e801d3b0 con 0x7fc2f015a070 2024-04-02T07:31:34.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.613+0000 7fc2e7400640 1 --2- 172.21.15.55:0/4194156057 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2cc066690 0x7fc2cc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:34.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.613+0000 7fc2e7400640 1 -- 172.21.15.55:0/4194156057 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2e8084060 con 0x7fc2f015a070 2024-04-02T07:31:34.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.613+0000 7fc2eea00640 1 --2- 172.21.15.55:0/4194156057 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2cc066690 0x7fc2cc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:34.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.617+0000 7fc2eea00640 1 --2- 172.21.15.55:0/4194156057 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2cc066690 0x7fc2cc068b50 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00ae000 tx=0x7fc2e00b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:34.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.617+0000 7fc2e7400640 1 -- 172.21.15.55:0/4194156057 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc2e80b5980 con 0x7fc2f015a070 2024-04-02T07:31:34.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.781+0000 7fc2f5a00640 1 -- 172.21.15.55:0/4194156057 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc2f0066c90 con 0x7fc2cc066690 2024-04-02T07:31:34.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.789+0000 7fc2e7400640 1 -- 172.21.15.55:0/4194156057 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289313 (secure 0 0 0) 0x7fc2f0066c90 con 0x7fc2cc066690 2024-04-02T07:31:34.794 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:34.796 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:31:34.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.793+0000 7fc2f5a00640 1 -- 172.21.15.55:0/4194156057 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2cc066690 msgr2=0x7fc2cc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:34.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.793+0000 7fc2f5a00640 1 --2- 172.21.15.55:0/4194156057 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2cc066690 0x7fc2cc068b50 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00ae000 tx=0x7fc2e00b5040 comp rx=0 tx=0).stop 2024-04-02T07:31:34.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.793+0000 7fc2f5a00640 1 -- 172.21.15.55:0/4194156057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2f015a070 msgr2=0x7fc2f00cd800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:34.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.793+0000 7fc2f5a00640 1 --2- 172.21.15.55:0/4194156057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2f015a070 0x7fc2f00cd800 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800b9c0 tx=0x7fc2e800be80 comp rx=0 tx=0).stop 2024-04-02T07:31:34.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.793+0000 7fc2f5a00640 1 -- 172.21.15.55:0/4194156057 shutdown_connections 2024-04-02T07:31:34.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.793+0000 7fc2f5a00640 1 --2- 172.21.15.55:0/4194156057 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2f015a070 0x7fc2f00cd800 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.793+0000 7fc2f5a00640 1 --2- 172.21.15.55:0/4194156057 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2cc066690 0x7fc2cc068b50 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.793+0000 7fc2f5a00640 1 --2- 172.21.15.55:0/4194156057 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2f0159be0 0x7fc2f012fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.793+0000 7fc2f5a00640 1 --2- 172.21.15.55:0/4194156057 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2f0153ea0 0x7fc2f0154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.793+0000 7fc2f5a00640 1 -- 172.21.15.55:0/4194156057 >> 172.21.15.55:0/4194156057 conn(0x7fc2f0066080 msgr2=0x7fc2f0070840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:34.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.793+0000 7fc2f5a00640 1 -- 172.21.15.55:0/4194156057 shutdown_connections 2024-04-02T07:31:34.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.793+0000 7fc2f5a00640 1 -- 172.21.15.55:0/4194156057 wait complete. 2024-04-02T07:31:34.814 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":380,"stamp":"2024-04-02T07:31:34.473482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259944,"kb_used_data":10980,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754714776,"statfs":{"total":773094113280,"available":772827930624,"internally_reserved":0,"allocated":11243520,"data_stored":5507847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.169252"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.735409+0000","last_change":"2024-04-02T07:31:30.733661+0000","last_active":"2024-04-02T07:31:30.735409+0000","last_peered":"2024-04-02T07:31:30.735409+0000","last_clean":"2024-04-02T07:31:30.735409+0000","last_became_active":"2024-04-02T07:31:30.733391+0000","last_became_peered":"2024-04-02T07:31:30.733391+0000","last_unstale":"2024-04-02T07:31:30.735409+0000","last_undegraded":"2024-04-02T07:31:30.735409+0000","last_fullsized":"2024-04-02T07:31:30.735409+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:03:47.396054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.739049+0000","last_change":"2024-04-02T07:31:30.733011+0000","last_active":"2024-04-02T07:31:30.739049+0000","last_peered":"2024-04-02T07:31:30.739049+0000","last_clean":"2024-04-02T07:31:30.739049+0000","last_became_active":"2024-04-02T07:31:30.732755+0000","last_became_peered":"2024-04-02T07:31:30.732755+0000","last_unstale":"2024-04-02T07:31:30.739049+0000","last_undegraded":"2024-04-02T07:31:30.739049+0000","last_fullsized":"2024-04-02T07:31:30.739049+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:34:38.136232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.733763+0000","last_change":"2024-04-02T07:31:30.728260+0000","last_active":"2024-04-02T07:31:30.733763+0000","last_peered":"2024-04-02T07:31:30.733763+0000","last_clean":"2024-04-02T07:31:30.733763+0000","last_became_active":"2024-04-02T07:31:30.727951+0000","last_became_peered":"2024-04-02T07:31:30.727951+0000","last_unstale":"2024-04-02T07:31:30.733763+0000","last_undegraded":"2024-04-02T07:31:30.733763+0000","last_fullsized":"2024-04-02T07:31:30.733763+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:54:59.313606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.747450+0000","last_change":"2024-04-02T07:31:30.742511+0000","last_active":"2024-04-02T07:31:30.747450+0000","last_peered":"2024-04-02T07:31:30.747450+0000","last_clean":"2024-04-02T07:31:30.747450+0000","last_became_active":"2024-04-02T07:31:30.742215+0000","last_became_peered":"2024-04-02T07:31:30.742215+0000","last_unstale":"2024-04-02T07:31:30.747450+0000","last_undegraded":"2024-04-02T07:31:30.747450+0000","last_fullsized":"2024-04-02T07:31:30.747450+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:48:29.335613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.738085+0000","last_change":"2024-04-02T07:31:30.732084+0000","last_active":"2024-04-02T07:31:30.738085+0000","last_peered":"2024-04-02T07:31:30.738085+0000","last_clean":"2024-04-02T07:31:30.738085+0000","last_became_active":"2024-04-02T07:31:30.728583+0000","last_became_peered":"2024-04-02T07:31:30.728583+0000","last_unstale":"2024-04-02T07:31:30.738085+0000","last_undegraded":"2024-04-02T07:31:30.738085+0000","last_fullsized":"2024-04-02T07:31:30.738085+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:04:08.523568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.739808+0000","last_change":"2024-04-02T07:31:30.735423+0000","last_active":"2024-04-02T07:31:30.739808+0000","last_peered":"2024-04-02T07:31:30.739808+0000","last_clean":"2024-04-02T07:31:30.739808+0000","last_became_active":"2024-04-02T07:31:30.733957+0000","last_became_peered":"2024-04-02T07:31:30.733957+0000","last_unstale":"2024-04-02T07:31:30.739808+0000","last_undegraded":"2024-04-02T07:31:30.739808+0000","last_fullsized":"2024-04-02T07:31:30.739808+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:23:54.392879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.739953+0000","last_change":"2024-04-02T07:31:30.735877+0000","last_active":"2024-04-02T07:31:30.739953+0000","last_peered":"2024-04-02T07:31:30.739953+0000","last_clean":"2024-04-02T07:31:30.739953+0000","last_became_active":"2024-04-02T07:31:30.734293+0000","last_became_peered":"2024-04-02T07:31:30.734293+0000","last_unstale":"2024-04-02T07:31:30.739953+0000","last_undegraded":"2024-04-02T07:31:30.739953+0000","last_fullsized":"2024-04-02T07:31:30.739953+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:51.651877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.737528+0000","last_change":"2024-04-02T07:31:30.730030+0000","last_active":"2024-04-02T07:31:30.737528+0000","last_peered":"2024-04-02T07:31:30.737528+0000","last_clean":"2024-04-02T07:31:30.737528+0000","last_became_active":"2024-04-02T07:31:30.729754+0000","last_became_peered":"2024-04-02T07:31:30.729754+0000","last_unstale":"2024-04-02T07:31:30.737528+0000","last_undegraded":"2024-04-02T07:31:30.737528+0000","last_fullsized":"2024-04-02T07:31:30.737528+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:27:07.246969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.739468+0000","last_change":"2024-04-02T07:31:30.737625+0000","last_active":"2024-04-02T07:31:30.739468+0000","last_peered":"2024-04-02T07:31:30.739468+0000","last_clean":"2024-04-02T07:31:30.739468+0000","last_became_active":"2024-04-02T07:31:30.734332+0000","last_became_peered":"2024-04-02T07:31:30.734332+0000","last_unstale":"2024-04-02T07:31:30.739468+0000","last_undegraded":"2024-04-02T07:31:30.739468+0000","last_fullsized":"2024-04-02T07:31:30.739468+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:04:36.056014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.734841+0000","last_change":"2024-04-02T07:31:30.728434+0000","last_active":"2024-04-02T07:31:30.734841+0000","last_peered":"2024-04-02T07:31:30.734841+0000","last_clean":"2024-04-02T07:31:30.734841+0000","last_became_active":"2024-04-02T07:31:30.727920+0000","last_became_peered":"2024-04-02T07:31:30.727920+0000","last_unstale":"2024-04-02T07:31:30.734841+0000","last_undegraded":"2024-04-02T07:31:30.734841+0000","last_fullsized":"2024-04-02T07:31:30.734841+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:47:43.895734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.735820+0000","last_change":"2024-04-02T07:31:30.729028+0000","last_active":"2024-04-02T07:31:30.735820+0000","last_peered":"2024-04-02T07:31:30.735820+0000","last_clean":"2024-04-02T07:31:30.735820+0000","last_became_active":"2024-04-02T07:31:30.728768+0000","last_became_peered":"2024-04-02T07:31:30.728768+0000","last_unstale":"2024-04-02T07:31:30.735820+0000","last_undegraded":"2024-04-02T07:31:30.735820+0000","last_fullsized":"2024-04-02T07:31:30.735820+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:27:07.246969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.733577+0000","last_change":"2024-04-02T07:31:30.730191+0000","last_active":"2024-04-02T07:31:30.733577+0000","last_peered":"2024-04-02T07:31:30.733577+0000","last_clean":"2024-04-02T07:31:30.733577+0000","last_became_active":"2024-04-02T07:31:30.729850+0000","last_became_peered":"2024-04-02T07:31:30.729850+0000","last_unstale":"2024-04-02T07:31:30.733577+0000","last_undegraded":"2024-04-02T07:31:30.733577+0000","last_fullsized":"2024-04-02T07:31:30.733577+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:26:24.104990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.729238+0000","last_change":"2024-04-02T07:31:30.727091+0000","last_active":"2024-04-02T07:31:30.729238+0000","last_peered":"2024-04-02T07:31:30.729238+0000","last_clean":"2024-04-02T07:31:30.729238+0000","last_became_active":"2024-04-02T07:31:30.726853+0000","last_became_peered":"2024-04-02T07:31:30.726853+0000","last_unstale":"2024-04-02T07:31:30.729238+0000","last_undegraded":"2024-04-02T07:31:30.729238+0000","last_fullsized":"2024-04-02T07:31:30.729238+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:40:40.588598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.742658+0000","last_change":"2024-04-02T07:31:30.735917+0000","last_active":"2024-04-02T07:31:30.742658+0000","last_peered":"2024-04-02T07:31:30.742658+0000","last_clean":"2024-04-02T07:31:30.742658+0000","last_became_active":"2024-04-02T07:31:30.735602+0000","last_became_peered":"2024-04-02T07:31:30.735602+0000","last_unstale":"2024-04-02T07:31:30.742658+0000","last_undegraded":"2024-04-02T07:31:30.742658+0000","last_fullsized":"2024-04-02T07:31:30.742658+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:09:15.325580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.733561+0000","last_change":"2024-04-02T07:31:30.728779+0000","last_active":"2024-04-02T07:31:30.733561+0000","last_peered":"2024-04-02T07:31:30.733561+0000","last_clean":"2024-04-02T07:31:30.733561+0000","last_became_active":"2024-04-02T07:31:30.727383+0000","last_became_peered":"2024-04-02T07:31:30.727383+0000","last_unstale":"2024-04-02T07:31:30.733561+0000","last_undegraded":"2024-04-02T07:31:30.733561+0000","last_fullsized":"2024-04-02T07:31:30.733561+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:23:54.392879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.739864+0000","last_change":"2024-04-02T07:31:30.735669+0000","last_active":"2024-04-02T07:31:30.739864+0000","last_peered":"2024-04-02T07:31:30.739864+0000","last_clean":"2024-04-02T07:31:30.739864+0000","last_became_active":"2024-04-02T07:31:30.735137+0000","last_became_peered":"2024-04-02T07:31:30.735137+0000","last_unstale":"2024-04-02T07:31:30.739864+0000","last_undegraded":"2024-04-02T07:31:30.739864+0000","last_fullsized":"2024-04-02T07:31:30.739864+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:47:43.895734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.741720+0000","last_change":"2024-04-02T07:31:30.736323+0000","last_active":"2024-04-02T07:31:30.741720+0000","last_peered":"2024-04-02T07:31:30.741720+0000","last_clean":"2024-04-02T07:31:30.741720+0000","last_became_active":"2024-04-02T07:31:30.735946+0000","last_became_peered":"2024-04-02T07:31:30.735946+0000","last_unstale":"2024-04-02T07:31:30.741720+0000","last_undegraded":"2024-04-02T07:31:30.741720+0000","last_fullsized":"2024-04-02T07:31:30.741720+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:47:43.895734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.747511+0000","last_change":"2024-04-02T07:31:30.743359+0000","last_active":"2024-04-02T07:31:30.747511+0000","last_peered":"2024-04-02T07:31:30.747511+0000","last_clean":"2024-04-02T07:31:30.747511+0000","last_became_active":"2024-04-02T07:31:30.742259+0000","last_became_peered":"2024-04-02T07:31:30.742259+0000","last_unstale":"2024-04-02T07:31:30.747511+0000","last_undegraded":"2024-04-02T07:31:30.747511+0000","last_fullsized":"2024-04-02T07:31:30.747511+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:51.651877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.742468+0000","last_change":"2024-04-02T07:31:30.731985+0000","last_active":"2024-04-02T07:31:30.742468+0000","last_peered":"2024-04-02T07:31:30.742468+0000","last_clean":"2024-04-02T07:31:30.742468+0000","last_became_active":"2024-04-02T07:31:30.731638+0000","last_became_peered":"2024-04-02T07:31:30.731638+0000","last_unstale":"2024-04-02T07:31:30.742468+0000","last_undegraded":"2024-04-02T07:31:30.742468+0000","last_fullsized":"2024-04-02T07:31:30.742468+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:35:17.457569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.738532+0000","last_change":"2024-04-02T07:31:30.733716+0000","last_active":"2024-04-02T07:31:30.738532+0000","last_peered":"2024-04-02T07:31:30.738532+0000","last_clean":"2024-04-02T07:31:30.738532+0000","last_became_active":"2024-04-02T07:31:30.733116+0000","last_became_peered":"2024-04-02T07:31:30.733116+0000","last_unstale":"2024-04-02T07:31:30.738532+0000","last_undegraded":"2024-04-02T07:31:30.738532+0000","last_fullsized":"2024-04-02T07:31:30.738532+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:04:08.523568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.747127+0000","last_change":"2024-04-02T07:31:30.739988+0000","last_active":"2024-04-02T07:31:30.747127+0000","last_peered":"2024-04-02T07:31:30.747127+0000","last_clean":"2024-04-02T07:31:30.747127+0000","last_became_active":"2024-04-02T07:31:30.738360+0000","last_became_peered":"2024-04-02T07:31:30.738360+0000","last_unstale":"2024-04-02T07:31:30.747127+0000","last_undegraded":"2024-04-02T07:31:30.747127+0000","last_fullsized":"2024-04-02T07:31:30.747127+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:36:55.039904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.728757+0000","last_change":"2024-04-02T07:31:30.723849+0000","last_active":"2024-04-02T07:31:30.728757+0000","last_peered":"2024-04-02T07:31:30.728757+0000","last_clean":"2024-04-02T07:31:30.728757+0000","last_became_active":"2024-04-02T07:31:30.723586+0000","last_became_peered":"2024-04-02T07:31:30.723586+0000","last_unstale":"2024-04-02T07:31:30.728757+0000","last_undegraded":"2024-04-02T07:31:30.728757+0000","last_fullsized":"2024-04-02T07:31:30.728757+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:54:19.952103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.735819+0000","last_change":"2024-04-02T07:31:30.728658+0000","last_active":"2024-04-02T07:31:30.735819+0000","last_peered":"2024-04-02T07:31:30.735819+0000","last_clean":"2024-04-02T07:31:30.735819+0000","last_became_active":"2024-04-02T07:31:30.728421+0000","last_became_peered":"2024-04-02T07:31:30.728421+0000","last_unstale":"2024-04-02T07:31:30.735819+0000","last_undegraded":"2024-04-02T07:31:30.735819+0000","last_fullsized":"2024-04-02T07:31:30.735819+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:40:03.326165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.737786+0000","last_change":"2024-04-02T07:31:30.733556+0000","last_active":"2024-04-02T07:31:30.737786+0000","last_peered":"2024-04-02T07:31:30.737786+0000","last_clean":"2024-04-02T07:31:30.737786+0000","last_became_active":"2024-04-02T07:31:30.733289+0000","last_became_peered":"2024-04-02T07:31:30.733289+0000","last_unstale":"2024-04-02T07:31:30.737786+0000","last_undegraded":"2024-04-02T07:31:30.737786+0000","last_fullsized":"2024-04-02T07:31:30.737786+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:04:09.602900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.735909+0000","last_change":"2024-04-02T07:31:30.731504+0000","last_active":"2024-04-02T07:31:30.735909+0000","last_peered":"2024-04-02T07:31:30.735909+0000","last_clean":"2024-04-02T07:31:30.735909+0000","last_became_active":"2024-04-02T07:31:30.731247+0000","last_became_peered":"2024-04-02T07:31:30.731247+0000","last_unstale":"2024-04-02T07:31:30.735909+0000","last_undegraded":"2024-04-02T07:31:30.735909+0000","last_fullsized":"2024-04-02T07:31:30.735909+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:40:03.326165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.733505+0000","last_change":"2024-04-02T07:31:30.727850+0000","last_active":"2024-04-02T07:31:30.733505+0000","last_peered":"2024-04-02T07:31:30.733505+0000","last_clean":"2024-04-02T07:31:30.733505+0000","last_became_active":"2024-04-02T07:31:30.727563+0000","last_became_peered":"2024-04-02T07:31:30.727563+0000","last_unstale":"2024-04-02T07:31:30.733505+0000","last_undegraded":"2024-04-02T07:31:30.733505+0000","last_fullsized":"2024-04-02T07:31:30.733505+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:04:09.602900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.746081+0000","last_change":"2024-04-02T07:31:30.741319+0000","last_active":"2024-04-02T07:31:30.746081+0000","last_peered":"2024-04-02T07:31:30.746081+0000","last_clean":"2024-04-02T07:31:30.746081+0000","last_became_active":"2024-04-02T07:31:30.740657+0000","last_became_peered":"2024-04-02T07:31:30.740657+0000","last_unstale":"2024-04-02T07:31:30.746081+0000","last_undegraded":"2024-04-02T07:31:30.746081+0000","last_fullsized":"2024-04-02T07:31:30.746081+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:40:40.588598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.731759+0000","last_change":"2024-04-02T07:31:30.726192+0000","last_active":"2024-04-02T07:31:30.731759+0000","last_peered":"2024-04-02T07:31:30.731759+0000","last_clean":"2024-04-02T07:31:30.731759+0000","last_became_active":"2024-04-02T07:31:30.725838+0000","last_became_peered":"2024-04-02T07:31:30.725838+0000","last_unstale":"2024-04-02T07:31:30.731759+0000","last_undegraded":"2024-04-02T07:31:30.731759+0000","last_fullsized":"2024-04-02T07:31:30.731759+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:54:19.952103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.733313+0000","last_change":"2024-04-02T07:31:30.727847+0000","last_active":"2024-04-02T07:31:30.733313+0000","last_peered":"2024-04-02T07:31:30.733313+0000","last_clean":"2024-04-02T07:31:30.733313+0000","last_became_active":"2024-04-02T07:31:30.727440+0000","last_became_peered":"2024-04-02T07:31:30.727440+0000","last_unstale":"2024-04-02T07:31:30.733313+0000","last_undegraded":"2024-04-02T07:31:30.733313+0000","last_fullsized":"2024-04-02T07:31:30.733313+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:02:21.039483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.742640+0000","last_change":"2024-04-02T07:31:30.734103+0000","last_active":"2024-04-02T07:31:30.742640+0000","last_peered":"2024-04-02T07:31:30.742640+0000","last_clean":"2024-04-02T07:31:30.742640+0000","last_became_active":"2024-04-02T07:31:30.732095+0000","last_became_peered":"2024-04-02T07:31:30.732095+0000","last_unstale":"2024-04-02T07:31:30.742640+0000","last_undegraded":"2024-04-02T07:31:30.742640+0000","last_fullsized":"2024-04-02T07:31:30.742640+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:04:25.942969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.739348+0000","last_change":"2024-04-02T07:31:30.733448+0000","last_active":"2024-04-02T07:31:30.739348+0000","last_peered":"2024-04-02T07:31:30.739348+0000","last_clean":"2024-04-02T07:31:30.739348+0000","last_became_active":"2024-04-02T07:31:30.733126+0000","last_became_peered":"2024-04-02T07:31:30.733126+0000","last_unstale":"2024-04-02T07:31:30.739348+0000","last_undegraded":"2024-04-02T07:31:30.739348+0000","last_fullsized":"2024-04-02T07:31:30.739348+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:54:19.952103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.735013+0000","last_change":"2024-04-02T07:31:30.731845+0000","last_active":"2024-04-02T07:31:30.735013+0000","last_peered":"2024-04-02T07:31:30.735013+0000","last_clean":"2024-04-02T07:31:30.735013+0000","last_became_active":"2024-04-02T07:31:30.730851+0000","last_became_peered":"2024-04-02T07:31:30.730851+0000","last_unstale":"2024-04-02T07:31:30.735013+0000","last_undegraded":"2024-04-02T07:31:30.735013+0000","last_fullsized":"2024-04-02T07:31:30.735013+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:17:35.772666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.747011+0000","last_change":"2024-04-02T07:31:30.739114+0000","last_active":"2024-04-02T07:31:30.747011+0000","last_peered":"2024-04-02T07:31:30.747011+0000","last_clean":"2024-04-02T07:31:30.747011+0000","last_became_active":"2024-04-02T07:31:30.736700+0000","last_became_peered":"2024-04-02T07:31:30.736700+0000","last_unstale":"2024-04-02T07:31:30.747011+0000","last_undegraded":"2024-04-02T07:31:30.747011+0000","last_fullsized":"2024-04-02T07:31:30.747011+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:33:33.120731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"102'4","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.735695+0000","last_change":"2024-04-02T07:31:30.324671+0000","last_active":"2024-04-02T07:31:30.735695+0000","last_peered":"2024-04-02T07:31:30.735695+0000","last_clean":"2024-04-02T07:31:30.735695+0000","last_became_active":"2024-04-02T07:31:30.324337+0000","last_became_peered":"2024-04-02T07:31:30.324337+0000","last_unstale":"2024-04-02T07:31:30.735695+0000","last_undegraded":"2024-04-02T07:31:30.735695+0000","last_fullsized":"2024-04-02T07:31:30.735695+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:48:38.076275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.741951+0000","last_change":"2024-04-02T07:31:30.736937+0000","last_active":"2024-04-02T07:31:30.741951+0000","last_peered":"2024-04-02T07:31:30.741951+0000","last_clean":"2024-04-02T07:31:30.741951+0000","last_became_active":"2024-04-02T07:31:30.736604+0000","last_became_peered":"2024-04-02T07:31:30.736604+0000","last_unstale":"2024-04-02T07:31:30.741951+0000","last_undegraded":"2024-04-02T07:31:30.741951+0000","last_fullsized":"2024-04-02T07:31:30.741951+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:02:21.039483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"102'1","reported_seq":11,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.731546+0000","last_change":"2024-04-02T07:31:30.323938+0000","last_active":"2024-04-02T07:31:30.731546+0000","last_peered":"2024-04-02T07:31:30.731546+0000","last_clean":"2024-04-02T07:31:30.731546+0000","last_became_active":"2024-04-02T07:31:30.323619+0000","last_became_peered":"2024-04-02T07:31:30.323619+0000","last_unstale":"2024-04-02T07:31:30.731546+0000","last_undegraded":"2024-04-02T07:31:30.731546+0000","last_fullsized":"2024-04-02T07:31:30.731546+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:11:01.198614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.734997+0000","last_change":"2024-04-02T07:31:30.729354+0000","last_active":"2024-04-02T07:31:30.734997+0000","last_peered":"2024-04-02T07:31:30.734997+0000","last_clean":"2024-04-02T07:31:30.734997+0000","last_became_active":"2024-04-02T07:31:30.728952+0000","last_became_peered":"2024-04-02T07:31:30.728952+0000","last_unstale":"2024-04-02T07:31:30.734997+0000","last_undegraded":"2024-04-02T07:31:30.734997+0000","last_fullsized":"2024-04-02T07:31:30.734997+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:11:49.638302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"102'2","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.737993+0000","last_change":"2024-04-02T07:31:30.323395+0000","last_active":"2024-04-02T07:31:30.737993+0000","last_peered":"2024-04-02T07:31:30.737993+0000","last_clean":"2024-04-02T07:31:30.737993+0000","last_became_active":"2024-04-02T07:31:30.323124+0000","last_became_peered":"2024-04-02T07:31:30.323124+0000","last_unstale":"2024-04-02T07:31:30.737993+0000","last_undegraded":"2024-04-02T07:31:30.737993+0000","last_fullsized":"2024-04-02T07:31:30.737993+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:12:33.521269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.733661+0000","last_change":"2024-04-02T07:31:30.727572+0000","last_active":"2024-04-02T07:31:30.733661+0000","last_peered":"2024-04-02T07:31:30.733661+0000","last_clean":"2024-04-02T07:31:30.733661+0000","last_became_active":"2024-04-02T07:31:30.727310+0000","last_became_peered":"2024-04-02T07:31:30.727310+0000","last_unstale":"2024-04-02T07:31:30.733661+0000","last_undegraded":"2024-04-02T07:31:30.733661+0000","last_fullsized":"2024-04-02T07:31:30.733661+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:48:39.078714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"102'2","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.738969+0000","last_change":"2024-04-02T07:31:30.326158+0000","last_active":"2024-04-02T07:31:30.738969+0000","last_peered":"2024-04-02T07:31:30.738969+0000","last_clean":"2024-04-02T07:31:30.738969+0000","last_became_active":"2024-04-02T07:31:30.325731+0000","last_became_peered":"2024-04-02T07:31:30.325731+0000","last_unstale":"2024-04-02T07:31:30.738969+0000","last_undegraded":"2024-04-02T07:31:30.738969+0000","last_fullsized":"2024-04-02T07:31:30.738969+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:11:48.635862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.736325+0000","last_change":"2024-04-02T07:31:30.734614+0000","last_active":"2024-04-02T07:31:30.736325+0000","last_peered":"2024-04-02T07:31:30.736325+0000","last_clean":"2024-04-02T07:31:30.736325+0000","last_became_active":"2024-04-02T07:31:30.734337+0000","last_became_peered":"2024-04-02T07:31:30.734337+0000","last_unstale":"2024-04-02T07:31:30.736325+0000","last_undegraded":"2024-04-02T07:31:30.736325+0000","last_fullsized":"2024-04-02T07:31:30.736325+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:09:56.945929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"102'1","reported_seq":11,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.736260+0000","last_change":"2024-04-02T07:31:30.320241+0000","last_active":"2024-04-02T07:31:30.736260+0000","last_peered":"2024-04-02T07:31:30.736260+0000","last_clean":"2024-04-02T07:31:30.736260+0000","last_became_active":"2024-04-02T07:31:30.319947+0000","last_became_peered":"2024-04-02T07:31:30.319947+0000","last_unstale":"2024-04-02T07:31:30.736260+0000","last_undegraded":"2024-04-02T07:31:30.736260+0000","last_fullsized":"2024-04-02T07:31:30.736260+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:56:57.221485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.738773+0000","last_change":"2024-04-02T07:31:30.734087+0000","last_active":"2024-04-02T07:31:30.738773+0000","last_peered":"2024-04-02T07:31:30.738773+0000","last_clean":"2024-04-02T07:31:30.738773+0000","last_became_active":"2024-04-02T07:31:30.733796+0000","last_became_peered":"2024-04-02T07:31:30.733796+0000","last_unstale":"2024-04-02T07:31:30.738773+0000","last_undegraded":"2024-04-02T07:31:30.738773+0000","last_fullsized":"2024-04-02T07:31:30.738773+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:48:29.335613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"102'1","reported_seq":11,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.732894+0000","last_change":"2024-04-02T07:31:30.327225+0000","last_active":"2024-04-02T07:31:30.732894+0000","last_peered":"2024-04-02T07:31:30.732894+0000","last_clean":"2024-04-02T07:31:30.732894+0000","last_became_active":"2024-04-02T07:31:30.326956+0000","last_became_peered":"2024-04-02T07:31:30.326956+0000","last_unstale":"2024-04-02T07:31:30.732894+0000","last_undegraded":"2024-04-02T07:31:30.732894+0000","last_fullsized":"2024-04-02T07:31:30.732894+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:14:29.720578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.739398+0000","last_change":"2024-04-02T07:31:30.734696+0000","last_active":"2024-04-02T07:31:30.739398+0000","last_peered":"2024-04-02T07:31:30.739398+0000","last_clean":"2024-04-02T07:31:30.739398+0000","last_became_active":"2024-04-02T07:31:30.734466+0000","last_became_peered":"2024-04-02T07:31:30.734466+0000","last_unstale":"2024-04-02T07:31:30.739398+0000","last_undegraded":"2024-04-02T07:31:30.739398+0000","last_fullsized":"2024-04-02T07:31:30.739398+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:47:43.895734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.715347+0000","last_change":"2024-04-02T07:31:30.321650+0000","last_active":"2024-04-02T07:31:30.715347+0000","last_peered":"2024-04-02T07:31:30.715347+0000","last_clean":"2024-04-02T07:31:30.715347+0000","last_became_active":"2024-04-02T07:31:30.321356+0000","last_became_peered":"2024-04-02T07:31:30.321356+0000","last_unstale":"2024-04-02T07:31:30.715347+0000","last_undegraded":"2024-04-02T07:31:30.715347+0000","last_fullsized":"2024-04-02T07:31:30.715347+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:18:25.113121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.739388+0000","last_change":"2024-04-02T07:31:30.737398+0000","last_active":"2024-04-02T07:31:30.739388+0000","last_peered":"2024-04-02T07:31:30.739388+0000","last_clean":"2024-04-02T07:31:30.739388+0000","last_became_active":"2024-04-02T07:31:30.737111+0000","last_became_peered":"2024-04-02T07:31:30.737111+0000","last_unstale":"2024-04-02T07:31:30.739388+0000","last_undegraded":"2024-04-02T07:31:30.739388+0000","last_fullsized":"2024-04-02T07:31:30.739388+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:14:30.723018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.717741+0000","last_change":"2024-04-02T07:31:30.315692+0000","last_active":"2024-04-02T07:31:30.717741+0000","last_peered":"2024-04-02T07:31:30.717741+0000","last_clean":"2024-04-02T07:31:30.717741+0000","last_became_active":"2024-04-02T07:31:30.315108+0000","last_became_peered":"2024-04-02T07:31:30.315108+0000","last_unstale":"2024-04-02T07:31:30.717741+0000","last_undegraded":"2024-04-02T07:31:30.717741+0000","last_fullsized":"2024-04-02T07:31:30.717741+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:37:01.992504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.728532+0000","last_change":"2024-04-02T07:31:30.721977+0000","last_active":"2024-04-02T07:31:30.728532+0000","last_peered":"2024-04-02T07:31:30.728532+0000","last_clean":"2024-04-02T07:31:30.728532+0000","last_became_active":"2024-04-02T07:31:30.721703+0000","last_became_peered":"2024-04-02T07:31:30.721703+0000","last_unstale":"2024-04-02T07:31:30.728532+0000","last_undegraded":"2024-04-02T07:31:30.728532+0000","last_fullsized":"2024-04-02T07:31:30.728532+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:40:40.588598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.718382+0000","last_change":"2024-04-02T07:31:30.321299+0000","last_active":"2024-04-02T07:31:30.718382+0000","last_peered":"2024-04-02T07:31:30.718382+0000","last_clean":"2024-04-02T07:31:30.718382+0000","last_became_active":"2024-04-02T07:31:30.321048+0000","last_became_peered":"2024-04-02T07:31:30.321048+0000","last_unstale":"2024-04-02T07:31:30.718382+0000","last_undegraded":"2024-04-02T07:31:30.718382+0000","last_fullsized":"2024-04-02T07:31:30.718382+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:45:27.249222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.733556+0000","last_change":"2024-04-02T07:31:30.729062+0000","last_active":"2024-04-02T07:31:30.733556+0000","last_peered":"2024-04-02T07:31:30.733556+0000","last_clean":"2024-04-02T07:31:30.733556+0000","last_became_active":"2024-04-02T07:31:30.728817+0000","last_became_peered":"2024-04-02T07:31:30.728817+0000","last_unstale":"2024-04-02T07:31:30.733556+0000","last_undegraded":"2024-04-02T07:31:30.733556+0000","last_fullsized":"2024-04-02T07:31:30.733556+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:31:40.412369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.724838+0000","last_change":"2024-04-02T07:31:30.323934+0000","last_active":"2024-04-02T07:31:30.724838+0000","last_peered":"2024-04-02T07:31:30.724838+0000","last_clean":"2024-04-02T07:31:30.724838+0000","last_became_active":"2024-04-02T07:31:30.323680+0000","last_became_peered":"2024-04-02T07:31:30.323680+0000","last_unstale":"2024-04-02T07:31:30.724838+0000","last_undegraded":"2024-04-02T07:31:30.724838+0000","last_fullsized":"2024-04-02T07:31:30.724838+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:48:38.076275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.735702+0000","last_change":"2024-04-02T07:31:30.731267+0000","last_active":"2024-04-02T07:31:30.735702+0000","last_peered":"2024-04-02T07:31:30.735702+0000","last_clean":"2024-04-02T07:31:30.735702+0000","last_became_active":"2024-04-02T07:31:30.730466+0000","last_became_peered":"2024-04-02T07:31:30.730466+0000","last_unstale":"2024-04-02T07:31:30.735702+0000","last_undegraded":"2024-04-02T07:31:30.735702+0000","last_fullsized":"2024-04-02T07:31:30.735702+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:29:36.448188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"102'3","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.742233+0000","last_change":"2024-04-02T07:31:30.323250+0000","last_active":"2024-04-02T07:31:30.742233+0000","last_peered":"2024-04-02T07:31:30.742233+0000","last_clean":"2024-04-02T07:31:30.742233+0000","last_became_active":"2024-04-02T07:31:30.322968+0000","last_became_peered":"2024-04-02T07:31:30.322968+0000","last_unstale":"2024-04-02T07:31:30.742233+0000","last_undegraded":"2024-04-02T07:31:30.742233+0000","last_fullsized":"2024-04-02T07:31:30.742233+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:31:39.409929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.740867+0000","last_change":"2024-04-02T07:31:30.737739+0000","last_active":"2024-04-02T07:31:30.740867+0000","last_peered":"2024-04-02T07:31:30.740867+0000","last_clean":"2024-04-02T07:31:30.740867+0000","last_became_active":"2024-04-02T07:31:30.737486+0000","last_became_peered":"2024-04-02T07:31:30.737486+0000","last_unstale":"2024-04-02T07:31:30.740867+0000","last_undegraded":"2024-04-02T07:31:30.740867+0000","last_fullsized":"2024-04-02T07:31:30.740867+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:54:19.952103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"102'6","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.749059+0000","last_change":"2024-04-02T07:31:30.328514+0000","last_active":"2024-04-02T07:31:30.749059+0000","last_peered":"2024-04-02T07:31:30.749059+0000","last_clean":"2024-04-02T07:31:30.749059+0000","last_became_active":"2024-04-02T07:31:30.328011+0000","last_became_peered":"2024-04-02T07:31:30.328011+0000","last_unstale":"2024-04-02T07:31:30.749059+0000","last_undegraded":"2024-04-02T07:31:30.749059+0000","last_fullsized":"2024-04-02T07:31:30.749059+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:25:38.680395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.736838+0000","last_change":"2024-04-02T07:31:30.730585+0000","last_active":"2024-04-02T07:31:30.736838+0000","last_peered":"2024-04-02T07:31:30.736838+0000","last_clean":"2024-04-02T07:31:30.736838+0000","last_became_active":"2024-04-02T07:31:30.730159+0000","last_became_peered":"2024-04-02T07:31:30.730159+0000","last_unstale":"2024-04-02T07:31:30.736838+0000","last_undegraded":"2024-04-02T07:31:30.736838+0000","last_fullsized":"2024-04-02T07:31:30.736838+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:40:03.326165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"102'2","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.740372+0000","last_change":"2024-04-02T07:31:30.328453+0000","last_active":"2024-04-02T07:31:30.740372+0000","last_peered":"2024-04-02T07:31:30.740372+0000","last_clean":"2024-04-02T07:31:30.740372+0000","last_became_active":"2024-04-02T07:31:30.328181+0000","last_became_peered":"2024-04-02T07:31:30.328181+0000","last_unstale":"2024-04-02T07:31:30.740372+0000","last_undegraded":"2024-04-02T07:31:30.740372+0000","last_fullsized":"2024-04-02T07:31:30.740372+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:19:05.961238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.743075+0000","last_change":"2024-04-02T07:31:30.741132+0000","last_active":"2024-04-02T07:31:30.743075+0000","last_peered":"2024-04-02T07:31:30.743075+0000","last_clean":"2024-04-02T07:31:30.743075+0000","last_became_active":"2024-04-02T07:31:30.740876+0000","last_became_peered":"2024-04-02T07:31:30.740876+0000","last_unstale":"2024-04-02T07:31:30.743075+0000","last_undegraded":"2024-04-02T07:31:30.743075+0000","last_fullsized":"2024-04-02T07:31:30.743075+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:32.822529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.714558+0000","last_change":"2024-04-02T07:31:30.323742+0000","last_active":"2024-04-02T07:31:30.714558+0000","last_peered":"2024-04-02T07:31:30.714558+0000","last_clean":"2024-04-02T07:31:30.714558+0000","last_became_active":"2024-04-02T07:31:30.323446+0000","last_became_peered":"2024-04-02T07:31:30.323446+0000","last_unstale":"2024-04-02T07:31:30.714558+0000","last_undegraded":"2024-04-02T07:31:30.714558+0000","last_fullsized":"2024-04-02T07:31:30.714558+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:16:28.250201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.733418+0000","last_change":"2024-04-02T07:31:30.727850+0000","last_active":"2024-04-02T07:31:30.733418+0000","last_peered":"2024-04-02T07:31:30.733418+0000","last_clean":"2024-04-02T07:31:30.733418+0000","last_became_active":"2024-04-02T07:31:30.726944+0000","last_became_peered":"2024-04-02T07:31:30.726944+0000","last_unstale":"2024-04-02T07:31:30.733418+0000","last_undegraded":"2024-04-02T07:31:30.733418+0000","last_fullsized":"2024-04-02T07:31:30.733418+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:11:02.201053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.712919+0000","last_change":"2024-04-02T07:31:30.325935+0000","last_active":"2024-04-02T07:31:30.712919+0000","last_peered":"2024-04-02T07:31:30.712919+0000","last_clean":"2024-04-02T07:31:30.712919+0000","last_became_active":"2024-04-02T07:31:30.325614+0000","last_became_peered":"2024-04-02T07:31:30.325614+0000","last_unstale":"2024-04-02T07:31:30.712919+0000","last_undegraded":"2024-04-02T07:31:30.712919+0000","last_fullsized":"2024-04-02T07:31:30.712919+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:09:55.943489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.742516+0000","last_change":"2024-04-02T07:31:30.731934+0000","last_active":"2024-04-02T07:31:30.742516+0000","last_peered":"2024-04-02T07:31:30.742516+0000","last_clean":"2024-04-02T07:31:30.742516+0000","last_became_active":"2024-04-02T07:31:30.731673+0000","last_became_peered":"2024-04-02T07:31:30.731673+0000","last_unstale":"2024-04-02T07:31:30.742516+0000","last_undegraded":"2024-04-02T07:31:30.742516+0000","last_fullsized":"2024-04-02T07:31:30.742516+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:32:15.184711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"102'8","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.737846+0000","last_change":"2024-04-02T07:31:30.315782+0000","last_active":"2024-04-02T07:31:30.737846+0000","last_peered":"2024-04-02T07:31:30.737846+0000","last_clean":"2024-04-02T07:31:30.737846+0000","last_became_active":"2024-04-02T07:31:30.315441+0000","last_became_peered":"2024-04-02T07:31:30.315441+0000","last_unstale":"2024-04-02T07:31:30.737846+0000","last_undegraded":"2024-04-02T07:31:30.737846+0000","last_fullsized":"2024-04-02T07:31:30.737846+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:41:56.174822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.730801+0000","last_change":"2024-04-02T07:31:30.720679+0000","last_active":"2024-04-02T07:31:30.730801+0000","last_peered":"2024-04-02T07:31:30.730801+0000","last_clean":"2024-04-02T07:31:30.730801+0000","last_became_active":"2024-04-02T07:31:30.720404+0000","last_became_peered":"2024-04-02T07:31:30.720404+0000","last_unstale":"2024-04-02T07:31:30.730801+0000","last_undegraded":"2024-04-02T07:31:30.730801+0000","last_fullsized":"2024-04-02T07:31:30.730801+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:51.651877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"102'2","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.742406+0000","last_change":"2024-04-02T07:31:30.325092+0000","last_active":"2024-04-02T07:31:30.742406+0000","last_peered":"2024-04-02T07:31:30.742406+0000","last_clean":"2024-04-02T07:31:30.742406+0000","last_became_active":"2024-04-02T07:31:30.324528+0000","last_became_peered":"2024-04-02T07:31:30.324528+0000","last_unstale":"2024-04-02T07:31:30.742406+0000","last_undegraded":"2024-04-02T07:31:30.742406+0000","last_fullsized":"2024-04-02T07:31:30.742406+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:24:25.989729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.736296+0000","last_change":"2024-04-02T07:31:30.734371+0000","last_active":"2024-04-02T07:31:30.736296+0000","last_peered":"2024-04-02T07:31:30.736296+0000","last_clean":"2024-04-02T07:31:30.736296+0000","last_became_active":"2024-04-02T07:31:30.734101+0000","last_became_peered":"2024-04-02T07:31:30.734101+0000","last_unstale":"2024-04-02T07:31:30.736296+0000","last_undegraded":"2024-04-02T07:31:30.736296+0000","last_fullsized":"2024-04-02T07:31:30.736296+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:24:26.992169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"102'1","reported_seq":11,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.741788+0000","last_change":"2024-04-02T07:31:30.321802+0000","last_active":"2024-04-02T07:31:30.741788+0000","last_peered":"2024-04-02T07:31:30.741788+0000","last_clean":"2024-04-02T07:31:30.741788+0000","last_became_active":"2024-04-02T07:31:30.321023+0000","last_became_peered":"2024-04-02T07:31:30.321023+0000","last_unstale":"2024-04-02T07:31:30.741788+0000","last_undegraded":"2024-04-02T07:31:30.741788+0000","last_fullsized":"2024-04-02T07:31:30.741788+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:17:34.770227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.743222+0000","last_change":"2024-04-02T07:31:30.740134+0000","last_active":"2024-04-02T07:31:30.743222+0000","last_peered":"2024-04-02T07:31:30.743222+0000","last_clean":"2024-04-02T07:31:30.743222+0000","last_became_active":"2024-04-02T07:31:30.739609+0000","last_became_peered":"2024-04-02T07:31:30.739609+0000","last_unstale":"2024-04-02T07:31:30.743222+0000","last_undegraded":"2024-04-02T07:31:30.743222+0000","last_fullsized":"2024-04-02T07:31:30.743222+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:02:21.039483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.709261+0000","last_change":"2024-04-02T07:31:30.325728+0000","last_active":"2024-04-02T07:31:30.709261+0000","last_peered":"2024-04-02T07:31:30.709261+0000","last_clean":"2024-04-02T07:31:30.709261+0000","last_became_active":"2024-04-02T07:31:30.325442+0000","last_became_peered":"2024-04-02T07:31:30.325442+0000","last_unstale":"2024-04-02T07:31:30.709261+0000","last_undegraded":"2024-04-02T07:31:30.709261+0000","last_fullsized":"2024-04-02T07:31:30.709261+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:17:34.770227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.742621+0000","last_change":"2024-04-02T07:31:30.733925+0000","last_active":"2024-04-02T07:31:30.742621+0000","last_peered":"2024-04-02T07:31:30.742621+0000","last_clean":"2024-04-02T07:31:30.742621+0000","last_became_active":"2024-04-02T07:31:30.731512+0000","last_became_peered":"2024-04-02T07:31:30.731512+0000","last_unstale":"2024-04-02T07:31:30.742621+0000","last_undegraded":"2024-04-02T07:31:30.742621+0000","last_fullsized":"2024-04-02T07:31:30.742621+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:21:08.099874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"102'2","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.741089+0000","last_change":"2024-04-02T07:31:30.328807+0000","last_active":"2024-04-02T07:31:30.741089+0000","last_peered":"2024-04-02T07:31:30.741089+0000","last_clean":"2024-04-02T07:31:30.741089+0000","last_became_active":"2024-04-02T07:31:30.328533+0000","last_became_peered":"2024-04-02T07:31:30.328533+0000","last_unstale":"2024-04-02T07:31:30.741089+0000","last_undegraded":"2024-04-02T07:31:30.741089+0000","last_fullsized":"2024-04-02T07:31:30.741089+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:11:01.198614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.747146+0000","last_change":"2024-04-02T07:31:30.740274+0000","last_active":"2024-04-02T07:31:30.747146+0000","last_peered":"2024-04-02T07:31:30.747146+0000","last_clean":"2024-04-02T07:31:30.747146+0000","last_became_active":"2024-04-02T07:31:30.739247+0000","last_became_peered":"2024-04-02T07:31:30.739247+0000","last_unstale":"2024-04-02T07:31:30.747146+0000","last_undegraded":"2024-04-02T07:31:30.747146+0000","last_fullsized":"2024-04-02T07:31:30.747146+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:50:36.187945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.719205+0000","last_change":"2024-04-02T07:31:30.327079+0000","last_active":"2024-04-02T07:31:30.719205+0000","last_peered":"2024-04-02T07:31:30.719205+0000","last_clean":"2024-04-02T07:31:30.719205+0000","last_became_active":"2024-04-02T07:31:30.326293+0000","last_became_peered":"2024-04-02T07:31:30.326293+0000","last_unstale":"2024-04-02T07:31:30.719205+0000","last_undegraded":"2024-04-02T07:31:30.719205+0000","last_fullsized":"2024-04-02T07:31:30.719205+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:25:42.939510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.747049+0000","last_change":"2024-04-02T07:31:30.739503+0000","last_active":"2024-04-02T07:31:30.747049+0000","last_peered":"2024-04-02T07:31:30.747049+0000","last_clean":"2024-04-02T07:31:30.747049+0000","last_became_active":"2024-04-02T07:31:30.738303+0000","last_became_peered":"2024-04-02T07:31:30.738303+0000","last_unstale":"2024-04-02T07:31:30.747049+0000","last_undegraded":"2024-04-02T07:31:30.747049+0000","last_fullsized":"2024-04-02T07:31:30.747049+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:58:46.447107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.724180+0000","last_change":"2024-04-02T07:31:30.318477+0000","last_active":"2024-04-02T07:31:30.724180+0000","last_peered":"2024-04-02T07:31:30.724180+0000","last_clean":"2024-04-02T07:31:30.724180+0000","last_became_active":"2024-04-02T07:31:30.318192+0000","last_became_peered":"2024-04-02T07:31:30.318192+0000","last_unstale":"2024-04-02T07:31:30.724180+0000","last_undegraded":"2024-04-02T07:31:30.724180+0000","last_fullsized":"2024-04-02T07:31:30.724180+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:41:56.174822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.734865+0000","last_change":"2024-04-02T07:31:30.728067+0000","last_active":"2024-04-02T07:31:30.734865+0000","last_peered":"2024-04-02T07:31:30.734865+0000","last_clean":"2024-04-02T07:31:30.734865+0000","last_became_active":"2024-04-02T07:31:30.727756+0000","last_became_peered":"2024-04-02T07:31:30.727756+0000","last_unstale":"2024-04-02T07:31:30.734865+0000","last_undegraded":"2024-04-02T07:31:30.734865+0000","last_fullsized":"2024-04-02T07:31:30.734865+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:30:57.344018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.708633+0000","last_change":"2024-04-02T07:31:30.323737+0000","last_active":"2024-04-02T07:31:30.708633+0000","last_peered":"2024-04-02T07:31:30.708633+0000","last_clean":"2024-04-02T07:31:30.708633+0000","last_became_active":"2024-04-02T07:31:30.323499+0000","last_became_peered":"2024-04-02T07:31:30.323499+0000","last_unstale":"2024-04-02T07:31:30.708633+0000","last_undegraded":"2024-04-02T07:31:30.708633+0000","last_fullsized":"2024-04-02T07:31:30.708633+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:31:39.409929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.735612+0000","last_change":"2024-04-02T07:31:30.731144+0000","last_active":"2024-04-02T07:31:30.735612+0000","last_peered":"2024-04-02T07:31:30.735612+0000","last_clean":"2024-04-02T07:31:30.735612+0000","last_became_active":"2024-04-02T07:31:30.730911+0000","last_became_peered":"2024-04-02T07:31:30.730911+0000","last_unstale":"2024-04-02T07:31:30.735612+0000","last_undegraded":"2024-04-02T07:31:30.735612+0000","last_fullsized":"2024-04-02T07:31:30.735612+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:48:29.335613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"102'2","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.742260+0000","last_change":"2024-04-02T07:31:30.328116+0000","last_active":"2024-04-02T07:31:30.742260+0000","last_peered":"2024-04-02T07:31:30.742260+0000","last_clean":"2024-04-02T07:31:30.742260+0000","last_became_active":"2024-04-02T07:31:30.327755+0000","last_became_peered":"2024-04-02T07:31:30.327755+0000","last_unstale":"2024-04-02T07:31:30.742260+0000","last_undegraded":"2024-04-02T07:31:30.742260+0000","last_fullsized":"2024-04-02T07:31:30.742260+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:40:53.952593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.743012+0000","last_change":"2024-04-02T07:31:30.738821+0000","last_active":"2024-04-02T07:31:30.743012+0000","last_peered":"2024-04-02T07:31:30.743012+0000","last_clean":"2024-04-02T07:31:30.743012+0000","last_became_active":"2024-04-02T07:31:30.738572+0000","last_became_peered":"2024-04-02T07:31:30.738572+0000","last_unstale":"2024-04-02T07:31:30.743012+0000","last_undegraded":"2024-04-02T07:31:30.743012+0000","last_fullsized":"2024-04-02T07:31:30.743012+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:15:32.951259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.709902+0000","last_change":"2024-04-02T07:31:30.327850+0000","last_active":"2024-04-02T07:31:30.709902+0000","last_peered":"2024-04-02T07:31:30.709902+0000","last_clean":"2024-04-02T07:31:30.709902+0000","last_became_active":"2024-04-02T07:31:30.327597+0000","last_became_peered":"2024-04-02T07:31:30.327597+0000","last_unstale":"2024-04-02T07:31:30.709902+0000","last_undegraded":"2024-04-02T07:31:30.709902+0000","last_fullsized":"2024-04-02T07:31:30.709902+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:21:21.928471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.736610+0000","last_change":"2024-04-02T07:31:30.735390+0000","last_active":"2024-04-02T07:31:30.736610+0000","last_peered":"2024-04-02T07:31:30.736610+0000","last_clean":"2024-04-02T07:31:30.736610+0000","last_became_active":"2024-04-02T07:31:30.735110+0000","last_became_peered":"2024-04-02T07:31:30.735110+0000","last_unstale":"2024-04-02T07:31:30.736610+0000","last_undegraded":"2024-04-02T07:31:30.736610+0000","last_fullsized":"2024-04-02T07:31:30.736610+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:18:26.115560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.709503+0000","last_change":"2024-04-02T07:31:30.324552+0000","last_active":"2024-04-02T07:31:30.709503+0000","last_peered":"2024-04-02T07:31:30.709503+0000","last_clean":"2024-04-02T07:31:30.709503+0000","last_became_active":"2024-04-02T07:31:30.324290+0000","last_became_peered":"2024-04-02T07:31:30.324290+0000","last_unstale":"2024-04-02T07:31:30.709503+0000","last_undegraded":"2024-04-02T07:31:30.709503+0000","last_fullsized":"2024-04-02T07:31:30.709503+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:12:54.553033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.736024+0000","last_change":"2024-04-02T07:31:30.730719+0000","last_active":"2024-04-02T07:31:30.736024+0000","last_peered":"2024-04-02T07:31:30.736024+0000","last_clean":"2024-04-02T07:31:30.736024+0000","last_became_active":"2024-04-02T07:31:30.730417+0000","last_became_peered":"2024-04-02T07:31:30.730417+0000","last_unstale":"2024-04-02T07:31:30.736024+0000","last_undegraded":"2024-04-02T07:31:30.736024+0000","last_fullsized":"2024-04-02T07:31:30.736024+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:15:05.313593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.716436+0000","last_change":"2024-04-02T07:31:30.324996+0000","last_active":"2024-04-02T07:31:30.716436+0000","last_peered":"2024-04-02T07:31:30.716436+0000","last_clean":"2024-04-02T07:31:30.716436+0000","last_became_active":"2024-04-02T07:31:30.324701+0000","last_became_peered":"2024-04-02T07:31:30.324701+0000","last_unstale":"2024-04-02T07:31:30.716436+0000","last_undegraded":"2024-04-02T07:31:30.716436+0000","last_fullsized":"2024-04-02T07:31:30.716436+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:11:48.635862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.742192+0000","last_change":"2024-04-02T07:31:30.730919+0000","last_active":"2024-04-02T07:31:30.742192+0000","last_peered":"2024-04-02T07:31:30.742192+0000","last_clean":"2024-04-02T07:31:30.742192+0000","last_became_active":"2024-04-02T07:31:30.730645+0000","last_became_peered":"2024-04-02T07:31:30.730645+0000","last_unstale":"2024-04-02T07:31:30.742192+0000","last_undegraded":"2024-04-02T07:31:30.742192+0000","last_fullsized":"2024-04-02T07:31:30.742192+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:34:58.821249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.709040+0000","last_change":"2024-04-02T07:31:30.319400+0000","last_active":"2024-04-02T07:31:30.709040+0000","last_peered":"2024-04-02T07:31:30.709040+0000","last_clean":"2024-04-02T07:31:30.709040+0000","last_became_active":"2024-04-02T07:31:30.319013+0000","last_became_peered":"2024-04-02T07:31:30.319013+0000","last_unstale":"2024-04-02T07:31:30.709040+0000","last_undegraded":"2024-04-02T07:31:30.709040+0000","last_fullsized":"2024-04-02T07:31:30.709040+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:18:25.113121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.727300+0000","last_change":"2024-04-02T07:31:30.721774+0000","last_active":"2024-04-02T07:31:30.727300+0000","last_peered":"2024-04-02T07:31:30.727300+0000","last_clean":"2024-04-02T07:31:30.727300+0000","last_became_active":"2024-04-02T07:31:30.720737+0000","last_became_peered":"2024-04-02T07:31:30.720737+0000","last_unstale":"2024-04-02T07:31:30.727300+0000","last_undegraded":"2024-04-02T07:31:30.727300+0000","last_fullsized":"2024-04-02T07:31:30.727300+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:12:34.523708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.715683+0000","last_change":"2024-04-02T07:31:30.323163+0000","last_active":"2024-04-02T07:31:30.715683+0000","last_peered":"2024-04-02T07:31:30.715683+0000","last_clean":"2024-04-02T07:31:30.715683+0000","last_became_active":"2024-04-02T07:31:30.322908+0000","last_became_peered":"2024-04-02T07:31:30.322908+0000","last_unstale":"2024-04-02T07:31:30.715683+0000","last_undegraded":"2024-04-02T07:31:30.715683+0000","last_fullsized":"2024-04-02T07:31:30.715683+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:31.820089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.747027+0000","last_change":"2024-04-02T07:31:30.739332+0000","last_active":"2024-04-02T07:31:30.747027+0000","last_peered":"2024-04-02T07:31:30.747027+0000","last_clean":"2024-04-02T07:31:30.747027+0000","last_became_active":"2024-04-02T07:31:30.739045+0000","last_became_peered":"2024-04-02T07:31:30.739045+0000","last_unstale":"2024-04-02T07:31:30.747027+0000","last_undegraded":"2024-04-02T07:31:30.747027+0000","last_fullsized":"2024-04-02T07:31:30.747027+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:29:36.944905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.722902+0000","last_change":"2024-04-02T07:31:30.320276+0000","last_active":"2024-04-02T07:31:30.722902+0000","last_peered":"2024-04-02T07:31:30.722902+0000","last_clean":"2024-04-02T07:31:30.722902+0000","last_became_active":"2024-04-02T07:31:30.319376+0000","last_became_peered":"2024-04-02T07:31:30.319376+0000","last_unstale":"2024-04-02T07:31:30.722902+0000","last_undegraded":"2024-04-02T07:31:30.722902+0000","last_fullsized":"2024-04-02T07:31:30.722902+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:31:39.409929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.735063+0000","last_change":"2024-04-02T07:31:30.729994+0000","last_active":"2024-04-02T07:31:30.735063+0000","last_peered":"2024-04-02T07:31:30.735063+0000","last_clean":"2024-04-02T07:31:30.735063+0000","last_became_active":"2024-04-02T07:31:30.729617+0000","last_became_peered":"2024-04-02T07:31:30.729617+0000","last_unstale":"2024-04-02T07:31:30.735063+0000","last_undegraded":"2024-04-02T07:31:30.735063+0000","last_fullsized":"2024-04-02T07:31:30.735063+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:04:36.056014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.714341+0000","last_change":"2024-04-02T07:31:30.326021+0000","last_active":"2024-04-02T07:31:30.714341+0000","last_peered":"2024-04-02T07:31:30.714341+0000","last_clean":"2024-04-02T07:31:30.714341+0000","last_became_active":"2024-04-02T07:31:30.325772+0000","last_became_peered":"2024-04-02T07:31:30.325772+0000","last_unstale":"2024-04-02T07:31:30.714341+0000","last_undegraded":"2024-04-02T07:31:30.714341+0000","last_fullsized":"2024-04-02T07:31:30.714341+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:48:20.783900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.742686+0000","last_change":"2024-04-02T07:31:30.733065+0000","last_active":"2024-04-02T07:31:30.742686+0000","last_peered":"2024-04-02T07:31:30.742686+0000","last_clean":"2024-04-02T07:31:30.742686+0000","last_became_active":"2024-04-02T07:31:30.730927+0000","last_became_peered":"2024-04-02T07:31:30.730927+0000","last_unstale":"2024-04-02T07:31:30.742686+0000","last_undegraded":"2024-04-02T07:31:30.742686+0000","last_fullsized":"2024-04-02T07:31:30.742686+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:46:09.018831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"102'1","reported_seq":11,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.732725+0000","last_change":"2024-04-02T07:31:30.322517+0000","last_active":"2024-04-02T07:31:30.732725+0000","last_peered":"2024-04-02T07:31:30.732725+0000","last_clean":"2024-04-02T07:31:30.732725+0000","last_became_active":"2024-04-02T07:31:30.321191+0000","last_became_peered":"2024-04-02T07:31:30.321191+0000","last_unstale":"2024-04-02T07:31:30.732725+0000","last_undegraded":"2024-04-02T07:31:30.732725+0000","last_fullsized":"2024-04-02T07:31:30.732725+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:48:38.076275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":237,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.310766+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:31:30.310766+0000","last_peered":"2024-04-02T07:31:30.310766+0000","last_clean":"2024-04-02T07:31:30.310766+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:31:30.310766+0000","last_undegraded":"2024-04-02T07:31:30.310766+0000","last_fullsized":"2024-04-02T07:31:30.310766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574963,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32944,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1863680,"data_stored":1135391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66700000000000004,"15min":0.65500000000000003},"min":{"1min":0.46200000000000002,"5min":0.376,"15min":0.35299999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":1.0569999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65700000000000003,"15min":0.63200000000000001},"min":{"1min":0.442,"5min":0.40699999999999997,"15min":0.39900000000000002},"max":{"1min":0.94999999999999996,"5min":1.018,"15min":1.018},"last":0.48899999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67700000000000005,"15min":0.64900000000000002},"min":{"1min":0.51900000000000002,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.97399999999999998,"5min":1.004,"15min":1.0289999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.69399999999999995,"15min":0.67300000000000004},"min":{"1min":0.51800000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.113},"last":0.58999999999999997}]},{"osd":2,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.751,"15min":0.752},"min":{"1min":0.501,"5min":0.501,"15min":0.435},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.139},"last":0.747},{"interface":"front","average":{"1min":0.749,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.503,"5min":0.437,"15min":0.437},"max":{"1min":0.995,"5min":1.0549999999999999,"15min":1.522},"last":0.63200000000000001}]},{"osd":3,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69799999999999995,"15min":0.70199999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.97399999999999998,"5min":1.0409999999999999,"15min":1.405},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72999999999999998,"15min":0.72699999999999998},"min":{"1min":0.54200000000000004,"5min":0.48799999999999999,"15min":0.48599999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0580000000000001},"last":0.65100000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57799999999999996,"15min":0.64600000000000002},"min":{"1min":0.37,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86599999999999999,"5min":0.89500000000000002,"15min":1.633},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66100000000000003,"15min":0.70699999999999996},"min":{"1min":0.52800000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88300000000000001,"5min":0.91200000000000003,"15min":1.079},"last":0.70399999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64900000000000002,"15min":0.69099999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86799999999999999,"5min":0.996,"15min":1.2250000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69999999999999996,"15min":0.749},"min":{"1min":0.45600000000000002,"5min":0.441,"15min":0.43099999999999999},"max":{"1min":0.90000000000000002,"5min":1.0049999999999999,"15min":1.5609999999999999},"last":0.72899999999999998}]},{"osd":6,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66600000000000004,"15min":0.70399999999999996},"min":{"1min":0.50700000000000001,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":0.93600000000000005,"5min":0.97199999999999998,"15min":1.5960000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.66200000000000003,"15min":0.68100000000000005},"min":{"1min":0.45700000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91400000000000003,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.53100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574964,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1249280,"data_stored":538136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70899999999999996,"15min":0.67700000000000005},"min":{"1min":0.48199999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97299999999999998,"5min":0.995,"15min":1.399},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71499999999999997,"15min":0.80900000000000005},"min":{"1min":0.59199999999999997,"5min":0.439,"15min":0.39400000000000002},"max":{"1min":0.89200000000000002,"5min":0.98599999999999999,"15min":5.7569999999999997},"last":0.63200000000000001}]},{"osd":1,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.52600000000000002,"5min":0.42299999999999999,"15min":0.38200000000000001},"max":{"1min":0.88900000000000001,"5min":1.0249999999999999,"15min":1.95},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.74099999999999999,"15min":0.73099999999999998},"min":{"1min":0.623,"5min":0.50600000000000001,"15min":0.47599999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.248},"last":0.77000000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72699999999999998,"15min":0.69799999999999995},"min":{"1min":0.56100000000000005,"5min":0.47499999999999998,"15min":0.45000000000000001},"max":{"1min":0.95399999999999996,"5min":1.0249999999999999,"15min":1.226},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.74099999999999999,"15min":0.71899999999999997},"min":{"1min":0.53900000000000003,"5min":0.502,"15min":0.46500000000000002},"max":{"1min":0.98999999999999999,"5min":1,"15min":1},"last":0.751}]},{"osd":3,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.747,"15min":0.77900000000000003},"min":{"1min":0.495,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92500000000000004,"5min":0.99299999999999999,"15min":2.3119999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73099999999999998,"15min":0.76400000000000001},"min":{"1min":0.51400000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97499999999999998,"5min":1.018,"15min":2.6389999999999998},"last":0.65900000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.60699999999999998,"15min":0.64000000000000001},"min":{"1min":0.437,"5min":0.36099999999999999,"15min":0.34999999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.94399999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.621,"15min":0.65000000000000002},"min":{"1min":0.47799999999999998,"5min":0.41399999999999998,"15min":0.38500000000000001},"max":{"1min":0.80500000000000005,"5min":0.95199999999999996,"15min":0.96999999999999997},"last":0.67900000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61199999999999999,"15min":0.64600000000000002},"min":{"1min":0.47499999999999998,"5min":0.41899999999999998,"15min":0.37},"max":{"1min":0.74099999999999999,"5min":0.93000000000000005,"15min":0.95999999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66200000000000003,"15min":0.70499999999999996},"min":{"1min":0.48699999999999999,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":0.78900000000000003,"5min":0.94399999999999995,"15min":1.0529999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66700000000000004,"15min":0.71299999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83499999999999996,"5min":0.95099999999999996,"15min":1.0209999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68400000000000005,"15min":0.71899999999999997},"min":{"1min":0.54700000000000004,"5min":0.503,"15min":0.47799999999999998},"max":{"1min":0.78100000000000003,"5min":0.96299999999999997,"15min":0.999},"last":0.69199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1249280,"data_stored":538136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68999999999999995,"15min":0.66500000000000004},"min":{"1min":0.439,"5min":0.433,"15min":0.33900000000000002},"max":{"1min":0.995,"5min":0.995,"15min":1.25},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":0.70899999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.33000000000000002},"max":{"1min":0.93999999999999995,"5min":1.0029999999999999,"15min":1.5289999999999999},"last":0.86099999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.70899999999999996},"min":{"1min":0.50900000000000001,"5min":0.45900000000000002,"15min":0.371},"max":{"1min":0.93600000000000005,"5min":0.98899999999999999,"15min":1.1830000000000001},"last":0.995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.94699999999999995,"5min":1.0169999999999999,"15min":1.3420000000000001},"last":0.63900000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78900000000000003,"15min":0.80400000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.44900000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.8280000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.48399999999999999,"5min":0.42499999999999999,"15min":0.39700000000000002},"max":{"1min":0.96699999999999997,"5min":1.022,"15min":1.696},"last":0.79100000000000004}]},{"osd":3,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74199999999999999,"15min":0.751},"min":{"1min":0.55400000000000005,"5min":0.497,"15min":0.40899999999999997},"max":{"1min":0.90800000000000003,"5min":0.96199999999999997,"15min":1.6399999999999999},"last":1.034},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.752,"15min":0.78900000000000003},"min":{"1min":0.54300000000000004,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":0.90400000000000003,"5min":0.98799999999999999,"15min":2.0219999999999998},"last":0.92500000000000004}]},{"osd":4,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57999999999999996,"15min":0.65500000000000003},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.911},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.622,"15min":0.71099999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.307},"max":{"1min":0.77300000000000002,"5min":0.94599999999999995,"15min":1.7829999999999999},"last":1.0649999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.65100000000000002,"15min":0.76500000000000001},"min":{"1min":0.439,"5min":0.42999999999999999,"15min":0.39600000000000002},"max":{"1min":0.78200000000000003,"5min":0.92800000000000005,"15min":2.1829999999999998},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.64700000000000002,"15min":0.75600000000000001},"min":{"1min":0.45400000000000001,"5min":0.39400000000000002,"15min":0.36499999999999999},"max":{"1min":0.83299999999999996,"5min":0.91100000000000003,"15min":2.1280000000000001},"last":0.90200000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.68799999999999994,"15min":0.78700000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.38300000000000001},"max":{"1min":0.81599999999999995,"5min":0.98299999999999998,"15min":1.887},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72599999999999998,"15min":0.82799999999999996},"min":{"1min":0.48199999999999998,"5min":0.48099999999999998,"15min":0.439},"max":{"1min":0.87,"5min":1.0109999999999999,"15min":2.2599999999999998},"last":1.056}]}]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1249280,"data_stored":538136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:31:29 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67100000000000004,"15min":0.71699999999999997},"min":{"1min":0.496,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92000000000000004,"5min":1.014,"15min":2.4929999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67000000000000004,"15min":0.76200000000000001},"min":{"1min":0.46100000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.94799999999999995,"5min":0.94899999999999995,"15min":3.2519999999999998},"last":0.44900000000000001}]},{"osd":1,"last update":"Tue Apr 2 07:31:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70199999999999996,"15min":0.73599999999999999},"min":{"1min":0.51900000000000002,"5min":0.45600000000000002,"15min":0.44400000000000001},"max":{"1min":0.94499999999999995,"5min":1.042,"15min":1.4279999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.82499999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94699999999999995,"5min":0.99399999999999999,"15min":4.3810000000000002},"last":0.59899999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:31:29 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72599999999999998,"15min":0.77100000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":2.056},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70899999999999996,"15min":0.81000000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.038,"5min":1.109,"15min":3.3420000000000001},"last":0.69999999999999996}]},{"osd":3,"last update":"Tue Apr 2 07:31:29 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.752,"15min":0.89500000000000002},"min":{"1min":0.59899999999999998,"5min":0.436,"15min":0.436},"max":{"1min":1.091,"5min":1.091,"15min":3.9180000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.748,"15min":0.90500000000000003},"min":{"1min":0.55600000000000005,"5min":0.497,"15min":0.497},"max":{"1min":0.99299999999999999,"5min":1.0920000000000001,"15min":3.9750000000000001},"last":0.64100000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:31:29 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58299999999999996,"15min":0.66300000000000003},"min":{"1min":0.48599999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.2509999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.60999999999999999,"15min":0.69499999999999995},"min":{"1min":0.44500000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98199999999999998,"5min":1.0640000000000001,"15min":1.4419999999999999},"last":0.66400000000000003}]},{"osd":6,"last update":"Tue Apr 2 07:31:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60699999999999998,"15min":0.67500000000000004},"min":{"1min":0.42199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.92700000000000005,"5min":0.94299999999999995,"15min":1.2949999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66500000000000004,"15min":0.73399999999999999},"min":{"1min":0.52400000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.3069999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:31:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68500000000000005,"15min":0.75900000000000001},"min":{"1min":0.51800000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.034,"5min":1.091,"15min":1.2689999999999999},"last":0.627},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76600000000000001,"15min":0.82899999999999996},"min":{"1min":0.622,"5min":0.53100000000000003,"15min":0.52700000000000002},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.353},"last":0.68600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574964,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1277952,"data_stored":546497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.26300000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.48599999999999999,"15min":0.48399999999999999},"min":{"1min":0.31,"5min":0.307,"15min":0.28699999999999998},"max":{"1min":0.65800000000000003,"5min":0.81699999999999995,"15min":1.0109999999999999},"last":0.48399999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45000000000000001,"15min":0.44500000000000001},"min":{"1min":0.32800000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.60399999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.42799999999999999,"5min":0.36499999999999999,"15min":0.309},"max":{"1min":0.60999999999999999,"5min":0.77500000000000002,"15min":0.79700000000000004},"last":0.53700000000000003}]},{"osd":2,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54200000000000004,"15min":0.53700000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.374},"max":{"1min":0.63,"5min":0.754,"15min":0.81599999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.47799999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.751,"5min":0.84399999999999997,"15min":1.306},"last":0.64300000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71899999999999997,"15min":0.74199999999999999},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.40500000000000003},"max":{"1min":0.98799999999999999,"5min":1.0600000000000001,"15min":1.1850000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.74399999999999999,"15min":0.752},"min":{"1min":0.56299999999999994,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.04,"5min":1.091,"15min":1.155},"last":0.61599999999999999}]},{"osd":5,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77300000000000002,"15min":0.77400000000000002},"min":{"1min":0.58499999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.0189999999999999,"5min":1.077,"15min":1.198},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.755,"15min":0.751},"min":{"1min":0.58099999999999996,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":0.95999999999999996,"5min":1.056,"15min":1.135},"last":0.88400000000000001}]},{"osd":6,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.747,"15min":0.76100000000000001},"min":{"1min":0.56999999999999995,"5min":0.48799999999999999,"15min":0.44500000000000001},"max":{"1min":0.94399999999999995,"5min":1.1060000000000001,"15min":1.25},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.78300000000000003},"min":{"1min":0.56200000000000006,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98999999999999999,"5min":1.1379999999999999,"15min":1.2010000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.754,"15min":0.75800000000000001},"min":{"1min":0.61099999999999999,"5min":0.53300000000000003,"15min":0.53200000000000003},"max":{"1min":0.95799999999999996,"5min":1.0209999999999999,"15min":1.216},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77700000000000002,"15min":0.78900000000000003},"min":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.47499999999999998},"max":{"1min":0.97799999999999998,"5min":1.073,"15min":1.2869999999999999},"last":0.75900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1249280,"data_stored":538136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.44700000000000001,"15min":0.44800000000000001},"min":{"1min":0.31,"5min":0.28000000000000003,"15min":0.253},"max":{"1min":0.72499999999999998,"5min":0.73899999999999999,"15min":0.79100000000000004},"last":0.437},{"interface":"front","average":{"1min":0.5,"5min":0.499,"15min":0.48899999999999999},"min":{"1min":0.34100000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65800000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.47999999999999998}]},{"osd":1,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52100000000000002,"15min":0.53400000000000003},"min":{"1min":0.38500000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68799999999999994,"5min":0.76900000000000002,"15min":1.171},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.499,"15min":0.495},"min":{"1min":0.36699999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.333},"last":0.621}]},{"osd":3,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.86299999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57199999999999995,"15min":0.56899999999999995},"min":{"1min":0.443,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.1140000000000001},"last":0.57699999999999996}]},{"osd":4,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.56200000000000006,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92300000000000004,"5min":1.115,"15min":2.254},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.54500000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93999999999999995,"5min":1.1599999999999999,"15min":1.3420000000000001},"last":0.86899999999999999}]},{"osd":5,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.77200000000000002,"15min":0.76300000000000001},"min":{"1min":0.54100000000000004,"5min":0.52600000000000002,"15min":0.46200000000000002},"max":{"1min":1.075,"5min":1.091,"15min":1.3740000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.57399999999999995,"5min":0.498,"15min":0.443},"max":{"1min":1.1000000000000001,"5min":1.135,"15min":2.0840000000000001},"last":0.93600000000000005}]},{"osd":6,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97899999999999998,"5min":1.1990000000000001,"15min":1.5029999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83299999999999996,"15min":0.82899999999999996},"min":{"1min":0.68799999999999994,"5min":0.58399999999999996,"15min":0.52700000000000002},"max":{"1min":1.119,"5min":1.1459999999999999,"15min":1.425},"last":0.91700000000000004}]},{"osd":7,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.80100000000000005,"15min":0.82199999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.52100000000000002},"max":{"1min":1.0569999999999999,"5min":1.1830000000000001,"15min":2.3580000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":0.82099999999999995},"min":{"1min":0.58899999999999997,"5min":0.54400000000000004,"15min":0.54300000000000004},"max":{"1min":1.006,"5min":1.0900000000000001,"15min":1.377},"last":0.95299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1261568,"data_stored":544911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.438,"15min":0.46500000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.71299999999999997,"5min":0.78600000000000003,"15min":1.2150000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.47999999999999998,"15min":0.58199999999999996},"min":{"1min":0.30099999999999999,"5min":0.27500000000000002,"15min":0.26200000000000001},"max":{"1min":0.69699999999999995,"5min":0.73899999999999999,"15min":4.157},"last":0.48599999999999999}]},{"osd":2,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46400000000000002,"15min":0.58299999999999996},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63600000000000001,"5min":0.69799999999999995,"15min":4.282},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52300000000000002,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.33600000000000002},"max":{"1min":0.72799999999999998,"5min":0.81000000000000005,"15min":1.625},"last":0.42699999999999999}]},{"osd":3,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58799999999999997,"15min":0.60399999999999998},"min":{"1min":0.41399999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":0.88800000000000001,"15min":1.1120000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.76100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76600000000000001,"5min":0.80600000000000005,"15min":8.1620000000000008},"last":0.55800000000000005}]},{"osd":4,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71199999999999997,"15min":0.86599999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.081,"5min":1.081,"15min":4.7400000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76900000000000002,"15min":0.80300000000000005},"min":{"1min":0.54000000000000004,"5min":0.53700000000000003,"15min":0.50600000000000001},"max":{"1min":0.95299999999999996,"5min":1.125,"15min":1.7070000000000001},"last":0.67400000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75800000000000001,"15min":0.874},"min":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.113,"5min":1.113,"15min":4.5759999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.751,"15min":0.874},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.103,"5min":1.103,"15min":4.7949999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76600000000000001,"15min":0.90500000000000003},"min":{"1min":0.55400000000000005,"5min":0.52800000000000002,"15min":0.47299999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":4.6890000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76800000000000002,"15min":0.89200000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.05,"5min":1.0589999999999999,"15min":4.6059999999999999},"last":0.77100000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.77800000000000002,"15min":0.81399999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0920000000000001,"5min":1.1200000000000001,"15min":1.8759999999999999},"last":0.75},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78700000000000003,"15min":0.90500000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0629999999999999,"5min":1.157,"15min":4.6420000000000003},"last":0.80000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574964,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1843200,"data_stored":1128504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:31:22 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.41899999999999998,"15min":0.45600000000000002},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54900000000000004,"5min":0.62,"15min":1.48},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48699999999999999,"15min":0.505},"min":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.61199999999999999,"5min":0.72199999999999998,"15min":1.2330000000000001},"last":0.44500000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:31:22 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48099999999999998,"15min":0.51200000000000001},"min":{"1min":0.38400000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.56499999999999995,"5min":0.747,"15min":1.3129999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.41099999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.82599999999999996},"last":0.40500000000000003}]},{"osd":3,"last update":"Tue Apr 2 07:31:22 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45500000000000002,"15min":0.46700000000000003},"min":{"1min":0.33000000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.84799999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.60299999999999998},"min":{"1min":0.441,"5min":0.40799999999999997,"15min":0.40300000000000002},"max":{"1min":0.753,"5min":0.77200000000000002,"15min":1.4430000000000001},"last":0.53100000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:31:22 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89700000000000002,"5min":1.0209999999999999,"15min":1.0569999999999999},"last":0.505},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72699999999999998,"15min":0.74199999999999999},"min":{"1min":0.54200000000000004,"5min":0.51400000000000001,"15min":0.501},"max":{"1min":0.996,"5min":1.0840000000000001,"15min":1.1240000000000001},"last":0.49199999999999999}]},{"osd":5,"last update":"Tue Apr 2 07:31:22 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.73699999999999999,"15min":0.77400000000000002},"min":{"1min":0.57499999999999996,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90800000000000003,"5min":1.042,"15min":1.371},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73899999999999999,"15min":0.75800000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90500000000000003,"5min":1.1000000000000001,"15min":1.143},"last":0.56000000000000005}]},{"osd":6,"last update":"Tue Apr 2 07:31:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76600000000000001,"15min":0.79100000000000004},"min":{"1min":0.58399999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.038,"5min":1.177,"15min":1.177},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79100000000000004,"15min":0.82499999999999996},"min":{"1min":0.66600000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97199999999999998,"5min":1.081,"15min":1.4099999999999999},"last":0.80600000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:31:22 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76300000000000001,"15min":0.78600000000000003},"min":{"1min":0.56100000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.95399999999999996,"5min":1.046,"15min":1.135},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75600000000000001,"15min":0.78100000000000003},"min":{"1min":0.621,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92700000000000005,"5min":1.079,"15min":1.141},"last":0.54500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:31:34.820 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:31:34.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.993+0000 7fce0e800640 1 Processor -- start 2024-04-02T07:31:34.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.993+0000 7fce0e800640 1 -- start start 2024-04-02T07:31:34.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.997+0000 7fce0e800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fce080ce630 0x7fce08065d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:34.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.997+0000 7fce0e800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fce08070a80 0x7fce08070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:34.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.997+0000 7fce0e800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0806d5b0 con 0x7fce0815cbe0 2024-04-02T07:31:34.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.997+0000 7fce0e800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce080cec10 con 0x7fce080ce630 2024-04-02T07:31:34.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.997+0000 7fce0e800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce080713f0 con 0x7fce08070a80 2024-04-02T07:31:34.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.997+0000 7fce07400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fce0815cbe0 0x7fce080b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:40602/0 (socket says 172.21.15.55:40602) 2024-04-02T07:31:34.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.997+0000 7fce07400640 1 -- 172.21.15.55:0/788338113 learned_addr learned my addr 172.21.15.55:0/788338113 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:34.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.997+0000 7fcdfea00640 1 --2- 172.21.15.55:0/788338113 >> v2:172.21.15.55:3300/0 conn(0x7fce080ce630 0x7fce08065d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:34.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.997+0000 7fce07e00640 1 --2- 172.21.15.55:0/788338113 >> v2:172.21.15.106:3300/0 conn(0x7fce08070a80 0x7fce08070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:34.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.997+0000 7fcdfea00640 1 -- 172.21.15.55:0/788338113 >> v2:172.21.15.106:3300/0 conn(0x7fce08070a80 msgr2=0x7fce08070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:34.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.997+0000 7fcdfea00640 1 --2- 172.21.15.55:0/788338113 >> v2:172.21.15.106:3300/0 conn(0x7fce08070a80 0x7fce08070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:34.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.997+0000 7fcdfea00640 1 -- 172.21.15.55:0/788338113 >> v1:172.21.15.55:6789/0 conn(0x7fce0815cbe0 legacy=0x7fce080b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:34.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.997+0000 7fcdfea00640 1 -- 172.21.15.55:0/788338113 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0806cc80 con 0x7fce080ce630 2024-04-02T07:31:34.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.997+0000 7fce06a00640 1 -- 172.21.15.55:0/788338113 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438756776 0 0) 0x7fce0806d5b0 con 0x7fce0815cbe0 2024-04-02T07:31:35.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:34.997+0000 7fcdfea00640 1 --2- 172.21.15.55:0/788338113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce080ce630 0x7fce08065d20 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fce0806b210 tx=0x7fcdf001c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c574d5675cfcbfcd server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce06a00640 1 -- 172.21.15.55:0/788338113 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf00ab600 con 0x7fce080ce630 2024-04-02T07:31:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce06a00640 1 -- 172.21.15.55:0/788338113 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf00a7050 con 0x7fce080ce630 2024-04-02T07:31:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce06a00640 1 -- 172.21.15.55:0/788338113 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf00ab980 con 0x7fce080ce630 2024-04-02T07:31:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce0e800640 1 -- 172.21.15.55:0/788338113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce080ce630 msgr2=0x7fce08065d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce0e800640 1 --2- 172.21.15.55:0/788338113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce080ce630 0x7fce08065d20 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7fce0806b210 tx=0x7fcdf001c480 comp rx=0 tx=0).stop 2024-04-02T07:31:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce0e800640 1 -- 172.21.15.55:0/788338113 shutdown_connections 2024-04-02T07:31:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce0e800640 1 --2- 172.21.15.55:0/788338113 >> v2:172.21.15.106:3300/0 conn(0x7fce08070a80 0x7fce08070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce0e800640 1 --2- 172.21.15.55:0/788338113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce080ce630 0x7fce08065d20 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce0e800640 1 -- 172.21.15.55:0/788338113 >> 172.21.15.55:0/788338113 conn(0x7fce080ced50 msgr2=0x7fce080cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce0e800640 1 -- 172.21.15.55:0/788338113 shutdown_connections 2024-04-02T07:31:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce0e800640 1 -- 172.21.15.55:0/788338113 wait complete. 2024-04-02T07:31:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce0e800640 1 Processor -- start 2024-04-02T07:31:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce0e800640 1 -- start start 2024-04-02T07:31:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce0e800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce08070a80 0x7fce0815f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce0e800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce080ce630 0x7fce08152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce0e800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce0815cbe0 0x7fce08152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce0e800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce08155610 con 0x7fce0815cbe0 2024-04-02T07:31:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce0e800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce081558f0 con 0x7fce080ce630 2024-04-02T07:31:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce0e800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce08155bd0 con 0x7fce08070a80 2024-04-02T07:31:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce07e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce0815cbe0 0x7fce08152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce07e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce0815cbe0 0x7fce08152960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44238/0 (socket says 172.21.15.55:44238) 2024-04-02T07:31:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.001+0000 7fce07e00640 1 -- 172.21.15.55:0/1155152243 learned_addr learned my addr 172.21.15.55:0/1155152243 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.005+0000 7fcdfea00640 1 --2- 172.21.15.55:0/1155152243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce080ce630 0x7fce08152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.005+0000 7fce07400640 1 --2- 172.21.15.55:0/1155152243 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce08070a80 0x7fce0815f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.005+0000 7fce07e00640 1 -- 172.21.15.55:0/1155152243 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce08070a80 msgr2=0x7fce0815f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.005+0000 7fce07e00640 1 --2- 172.21.15.55:0/1155152243 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce08070a80 0x7fce0815f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.005+0000 7fce07e00640 1 -- 172.21.15.55:0/1155152243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce080ce630 msgr2=0x7fce08152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.005+0000 7fce07e00640 1 --2- 172.21.15.55:0/1155152243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce080ce630 0x7fce08152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.005+0000 7fce07e00640 1 -- 172.21.15.55:0/1155152243 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf0009420 con 0x7fce0815cbe0 2024-04-02T07:31:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.005+0000 7fce07e00640 1 --2- 172.21.15.55:0/1155152243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce0815cbe0 0x7fce08152960 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fce00007e40 tx=0x7fce0000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.005+0000 7fcdffe00640 1 -- 172.21.15.55:0/1155152243 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce00014620 con 0x7fce0815cbe0 2024-04-02T07:31:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.005+0000 7fcdffe00640 1 -- 172.21.15.55:0/1155152243 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0000ee90 con 0x7fce0815cbe0 2024-04-02T07:31:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.005+0000 7fcdffe00640 1 -- 172.21.15.55:0/1155152243 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce000149e0 con 0x7fce0815cbe0 2024-04-02T07:31:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.005+0000 7fce0e800640 1 -- 172.21.15.55:0/1155152243 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce08155eb0 con 0x7fce0815cbe0 2024-04-02T07:31:35.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.005+0000 7fce0e800640 1 -- 172.21.15.55:0/1155152243 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce08155230 con 0x7fce0815cbe0 2024-04-02T07:31:35.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.005+0000 7fce0e800640 1 -- 172.21.15.55:0/1155152243 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce08066c90 con 0x7fce0815cbe0 2024-04-02T07:31:35.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.005+0000 7fcdffe00640 1 -- 172.21.15.55:0/1155152243 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fce00014b40 con 0x7fce0815cbe0 2024-04-02T07:31:35.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.009+0000 7fcdffe00640 1 --2- 172.21.15.55:0/1155152243 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcde4066690 0x7fcde4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:35.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.009+0000 7fcdffe00640 1 -- 172.21.15.55:0/1155152243 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fce00085800 con 0x7fce0815cbe0 2024-04-02T07:31:35.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.009+0000 7fce07400640 1 --2- 172.21.15.55:0/1155152243 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcde4066690 0x7fcde4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:35.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.009+0000 7fce07400640 1 --2- 172.21.15.55:0/1155152243 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcde4066690 0x7fcde4068b50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8000f70 tx=0x7fcdf8007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:35.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.009+0000 7fcdffe00640 1 -- 172.21.15.55:0/1155152243 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fce00052d90 con 0x7fce0815cbe0 2024-04-02T07:31:35.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.165+0000 7fce0e800640 1 -- 172.21.15.55:0/1155152243 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fce0806e250 con 0x7fcde4066690 2024-04-02T07:31:35.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.173+0000 7fcdffe00640 1 -- 172.21.15.55:0/1155152243 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289313 (secure 0 0 0) 0x7fcdf80072a0 con 0x7fcde4066690 2024-04-02T07:31:35.179 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:35.180 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:31:35.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.177+0000 7fce0e800640 1 -- 172.21.15.55:0/1155152243 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcde4066690 msgr2=0x7fcde4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:35.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.177+0000 7fce0e800640 1 --2- 172.21.15.55:0/1155152243 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcde4066690 0x7fcde4068b50 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fcdf8000f70 tx=0x7fcdf8007df0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.177+0000 7fce0e800640 1 -- 172.21.15.55:0/1155152243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce0815cbe0 msgr2=0x7fce08152960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:35.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.177+0000 7fce0e800640 1 --2- 172.21.15.55:0/1155152243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce0815cbe0 0x7fce08152960 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fce00007e40 tx=0x7fce0000e4b0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.177+0000 7fce0e800640 1 -- 172.21.15.55:0/1155152243 shutdown_connections 2024-04-02T07:31:35.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.177+0000 7fce0e800640 1 --2- 172.21.15.55:0/1155152243 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fce0815cbe0 0x7fce08152960 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.177+0000 7fce0e800640 1 --2- 172.21.15.55:0/1155152243 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcde4066690 0x7fcde4068b50 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.177+0000 7fce0e800640 1 --2- 172.21.15.55:0/1155152243 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fce080ce630 0x7fce08152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.177+0000 7fce0e800640 1 --2- 172.21.15.55:0/1155152243 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fce08070a80 0x7fce0815f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.177+0000 7fce0e800640 1 -- 172.21.15.55:0/1155152243 >> 172.21.15.55:0/1155152243 conn(0x7fce080ced50 msgr2=0x7fce080cf130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:35.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.177+0000 7fce0e800640 1 -- 172.21.15.55:0/1155152243 shutdown_connections 2024-04-02T07:31:35.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.177+0000 7fce0e800640 1 -- 172.21.15.55:0/1155152243 wait complete. 2024-04-02T07:31:35.199 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":380,"stamp":"2024-04-02T07:31:34.473482+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":259944,"kb_used_data":10980,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754714776,"statfs":{"total":773094113280,"available":772827930624,"internally_reserved":0,"allocated":11243520,"data_stored":5507847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.169252"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.735409+0000","last_change":"2024-04-02T07:31:30.733661+0000","last_active":"2024-04-02T07:31:30.735409+0000","last_peered":"2024-04-02T07:31:30.735409+0000","last_clean":"2024-04-02T07:31:30.735409+0000","last_became_active":"2024-04-02T07:31:30.733391+0000","last_became_peered":"2024-04-02T07:31:30.733391+0000","last_unstale":"2024-04-02T07:31:30.735409+0000","last_undegraded":"2024-04-02T07:31:30.735409+0000","last_fullsized":"2024-04-02T07:31:30.735409+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:03:47.396054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.739049+0000","last_change":"2024-04-02T07:31:30.733011+0000","last_active":"2024-04-02T07:31:30.739049+0000","last_peered":"2024-04-02T07:31:30.739049+0000","last_clean":"2024-04-02T07:31:30.739049+0000","last_became_active":"2024-04-02T07:31:30.732755+0000","last_became_peered":"2024-04-02T07:31:30.732755+0000","last_unstale":"2024-04-02T07:31:30.739049+0000","last_undegraded":"2024-04-02T07:31:30.739049+0000","last_fullsized":"2024-04-02T07:31:30.739049+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:34:38.136232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.733763+0000","last_change":"2024-04-02T07:31:30.728260+0000","last_active":"2024-04-02T07:31:30.733763+0000","last_peered":"2024-04-02T07:31:30.733763+0000","last_clean":"2024-04-02T07:31:30.733763+0000","last_became_active":"2024-04-02T07:31:30.727951+0000","last_became_peered":"2024-04-02T07:31:30.727951+0000","last_unstale":"2024-04-02T07:31:30.733763+0000","last_undegraded":"2024-04-02T07:31:30.733763+0000","last_fullsized":"2024-04-02T07:31:30.733763+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:54:59.313606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.747450+0000","last_change":"2024-04-02T07:31:30.742511+0000","last_active":"2024-04-02T07:31:30.747450+0000","last_peered":"2024-04-02T07:31:30.747450+0000","last_clean":"2024-04-02T07:31:30.747450+0000","last_became_active":"2024-04-02T07:31:30.742215+0000","last_became_peered":"2024-04-02T07:31:30.742215+0000","last_unstale":"2024-04-02T07:31:30.747450+0000","last_undegraded":"2024-04-02T07:31:30.747450+0000","last_fullsized":"2024-04-02T07:31:30.747450+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:48:29.335613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.738085+0000","last_change":"2024-04-02T07:31:30.732084+0000","last_active":"2024-04-02T07:31:30.738085+0000","last_peered":"2024-04-02T07:31:30.738085+0000","last_clean":"2024-04-02T07:31:30.738085+0000","last_became_active":"2024-04-02T07:31:30.728583+0000","last_became_peered":"2024-04-02T07:31:30.728583+0000","last_unstale":"2024-04-02T07:31:30.738085+0000","last_undegraded":"2024-04-02T07:31:30.738085+0000","last_fullsized":"2024-04-02T07:31:30.738085+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:04:08.523568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.739808+0000","last_change":"2024-04-02T07:31:30.735423+0000","last_active":"2024-04-02T07:31:30.739808+0000","last_peered":"2024-04-02T07:31:30.739808+0000","last_clean":"2024-04-02T07:31:30.739808+0000","last_became_active":"2024-04-02T07:31:30.733957+0000","last_became_peered":"2024-04-02T07:31:30.733957+0000","last_unstale":"2024-04-02T07:31:30.739808+0000","last_undegraded":"2024-04-02T07:31:30.739808+0000","last_fullsized":"2024-04-02T07:31:30.739808+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:23:54.392879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.739953+0000","last_change":"2024-04-02T07:31:30.735877+0000","last_active":"2024-04-02T07:31:30.739953+0000","last_peered":"2024-04-02T07:31:30.739953+0000","last_clean":"2024-04-02T07:31:30.739953+0000","last_became_active":"2024-04-02T07:31:30.734293+0000","last_became_peered":"2024-04-02T07:31:30.734293+0000","last_unstale":"2024-04-02T07:31:30.739953+0000","last_undegraded":"2024-04-02T07:31:30.739953+0000","last_fullsized":"2024-04-02T07:31:30.739953+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:51.651877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.737528+0000","last_change":"2024-04-02T07:31:30.730030+0000","last_active":"2024-04-02T07:31:30.737528+0000","last_peered":"2024-04-02T07:31:30.737528+0000","last_clean":"2024-04-02T07:31:30.737528+0000","last_became_active":"2024-04-02T07:31:30.729754+0000","last_became_peered":"2024-04-02T07:31:30.729754+0000","last_unstale":"2024-04-02T07:31:30.737528+0000","last_undegraded":"2024-04-02T07:31:30.737528+0000","last_fullsized":"2024-04-02T07:31:30.737528+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:27:07.246969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.739468+0000","last_change":"2024-04-02T07:31:30.737625+0000","last_active":"2024-04-02T07:31:30.739468+0000","last_peered":"2024-04-02T07:31:30.739468+0000","last_clean":"2024-04-02T07:31:30.739468+0000","last_became_active":"2024-04-02T07:31:30.734332+0000","last_became_peered":"2024-04-02T07:31:30.734332+0000","last_unstale":"2024-04-02T07:31:30.739468+0000","last_undegraded":"2024-04-02T07:31:30.739468+0000","last_fullsized":"2024-04-02T07:31:30.739468+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:04:36.056014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.734841+0000","last_change":"2024-04-02T07:31:30.728434+0000","last_active":"2024-04-02T07:31:30.734841+0000","last_peered":"2024-04-02T07:31:30.734841+0000","last_clean":"2024-04-02T07:31:30.734841+0000","last_became_active":"2024-04-02T07:31:30.727920+0000","last_became_peered":"2024-04-02T07:31:30.727920+0000","last_unstale":"2024-04-02T07:31:30.734841+0000","last_undegraded":"2024-04-02T07:31:30.734841+0000","last_fullsized":"2024-04-02T07:31:30.734841+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:47:43.895734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.735820+0000","last_change":"2024-04-02T07:31:30.729028+0000","last_active":"2024-04-02T07:31:30.735820+0000","last_peered":"2024-04-02T07:31:30.735820+0000","last_clean":"2024-04-02T07:31:30.735820+0000","last_became_active":"2024-04-02T07:31:30.728768+0000","last_became_peered":"2024-04-02T07:31:30.728768+0000","last_unstale":"2024-04-02T07:31:30.735820+0000","last_undegraded":"2024-04-02T07:31:30.735820+0000","last_fullsized":"2024-04-02T07:31:30.735820+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:27:07.246969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.733577+0000","last_change":"2024-04-02T07:31:30.730191+0000","last_active":"2024-04-02T07:31:30.733577+0000","last_peered":"2024-04-02T07:31:30.733577+0000","last_clean":"2024-04-02T07:31:30.733577+0000","last_became_active":"2024-04-02T07:31:30.729850+0000","last_became_peered":"2024-04-02T07:31:30.729850+0000","last_unstale":"2024-04-02T07:31:30.733577+0000","last_undegraded":"2024-04-02T07:31:30.733577+0000","last_fullsized":"2024-04-02T07:31:30.733577+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:26:24.104990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.729238+0000","last_change":"2024-04-02T07:31:30.727091+0000","last_active":"2024-04-02T07:31:30.729238+0000","last_peered":"2024-04-02T07:31:30.729238+0000","last_clean":"2024-04-02T07:31:30.729238+0000","last_became_active":"2024-04-02T07:31:30.726853+0000","last_became_peered":"2024-04-02T07:31:30.726853+0000","last_unstale":"2024-04-02T07:31:30.729238+0000","last_undegraded":"2024-04-02T07:31:30.729238+0000","last_fullsized":"2024-04-02T07:31:30.729238+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:40:40.588598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.742658+0000","last_change":"2024-04-02T07:31:30.735917+0000","last_active":"2024-04-02T07:31:30.742658+0000","last_peered":"2024-04-02T07:31:30.742658+0000","last_clean":"2024-04-02T07:31:30.742658+0000","last_became_active":"2024-04-02T07:31:30.735602+0000","last_became_peered":"2024-04-02T07:31:30.735602+0000","last_unstale":"2024-04-02T07:31:30.742658+0000","last_undegraded":"2024-04-02T07:31:30.742658+0000","last_fullsized":"2024-04-02T07:31:30.742658+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:09:15.325580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.733561+0000","last_change":"2024-04-02T07:31:30.728779+0000","last_active":"2024-04-02T07:31:30.733561+0000","last_peered":"2024-04-02T07:31:30.733561+0000","last_clean":"2024-04-02T07:31:30.733561+0000","last_became_active":"2024-04-02T07:31:30.727383+0000","last_became_peered":"2024-04-02T07:31:30.727383+0000","last_unstale":"2024-04-02T07:31:30.733561+0000","last_undegraded":"2024-04-02T07:31:30.733561+0000","last_fullsized":"2024-04-02T07:31:30.733561+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:23:54.392879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.739864+0000","last_change":"2024-04-02T07:31:30.735669+0000","last_active":"2024-04-02T07:31:30.739864+0000","last_peered":"2024-04-02T07:31:30.739864+0000","last_clean":"2024-04-02T07:31:30.739864+0000","last_became_active":"2024-04-02T07:31:30.735137+0000","last_became_peered":"2024-04-02T07:31:30.735137+0000","last_unstale":"2024-04-02T07:31:30.739864+0000","last_undegraded":"2024-04-02T07:31:30.739864+0000","last_fullsized":"2024-04-02T07:31:30.739864+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:47:43.895734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.741720+0000","last_change":"2024-04-02T07:31:30.736323+0000","last_active":"2024-04-02T07:31:30.741720+0000","last_peered":"2024-04-02T07:31:30.741720+0000","last_clean":"2024-04-02T07:31:30.741720+0000","last_became_active":"2024-04-02T07:31:30.735946+0000","last_became_peered":"2024-04-02T07:31:30.735946+0000","last_unstale":"2024-04-02T07:31:30.741720+0000","last_undegraded":"2024-04-02T07:31:30.741720+0000","last_fullsized":"2024-04-02T07:31:30.741720+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:47:43.895734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.747511+0000","last_change":"2024-04-02T07:31:30.743359+0000","last_active":"2024-04-02T07:31:30.747511+0000","last_peered":"2024-04-02T07:31:30.747511+0000","last_clean":"2024-04-02T07:31:30.747511+0000","last_became_active":"2024-04-02T07:31:30.742259+0000","last_became_peered":"2024-04-02T07:31:30.742259+0000","last_unstale":"2024-04-02T07:31:30.747511+0000","last_undegraded":"2024-04-02T07:31:30.747511+0000","last_fullsized":"2024-04-02T07:31:30.747511+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:51.651877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.742468+0000","last_change":"2024-04-02T07:31:30.731985+0000","last_active":"2024-04-02T07:31:30.742468+0000","last_peered":"2024-04-02T07:31:30.742468+0000","last_clean":"2024-04-02T07:31:30.742468+0000","last_became_active":"2024-04-02T07:31:30.731638+0000","last_became_peered":"2024-04-02T07:31:30.731638+0000","last_unstale":"2024-04-02T07:31:30.742468+0000","last_undegraded":"2024-04-02T07:31:30.742468+0000","last_fullsized":"2024-04-02T07:31:30.742468+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:35:17.457569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.738532+0000","last_change":"2024-04-02T07:31:30.733716+0000","last_active":"2024-04-02T07:31:30.738532+0000","last_peered":"2024-04-02T07:31:30.738532+0000","last_clean":"2024-04-02T07:31:30.738532+0000","last_became_active":"2024-04-02T07:31:30.733116+0000","last_became_peered":"2024-04-02T07:31:30.733116+0000","last_unstale":"2024-04-02T07:31:30.738532+0000","last_undegraded":"2024-04-02T07:31:30.738532+0000","last_fullsized":"2024-04-02T07:31:30.738532+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:04:08.523568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.747127+0000","last_change":"2024-04-02T07:31:30.739988+0000","last_active":"2024-04-02T07:31:30.747127+0000","last_peered":"2024-04-02T07:31:30.747127+0000","last_clean":"2024-04-02T07:31:30.747127+0000","last_became_active":"2024-04-02T07:31:30.738360+0000","last_became_peered":"2024-04-02T07:31:30.738360+0000","last_unstale":"2024-04-02T07:31:30.747127+0000","last_undegraded":"2024-04-02T07:31:30.747127+0000","last_fullsized":"2024-04-02T07:31:30.747127+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:36:55.039904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.728757+0000","last_change":"2024-04-02T07:31:30.723849+0000","last_active":"2024-04-02T07:31:30.728757+0000","last_peered":"2024-04-02T07:31:30.728757+0000","last_clean":"2024-04-02T07:31:30.728757+0000","last_became_active":"2024-04-02T07:31:30.723586+0000","last_became_peered":"2024-04-02T07:31:30.723586+0000","last_unstale":"2024-04-02T07:31:30.728757+0000","last_undegraded":"2024-04-02T07:31:30.728757+0000","last_fullsized":"2024-04-02T07:31:30.728757+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:54:19.952103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.735819+0000","last_change":"2024-04-02T07:31:30.728658+0000","last_active":"2024-04-02T07:31:30.735819+0000","last_peered":"2024-04-02T07:31:30.735819+0000","last_clean":"2024-04-02T07:31:30.735819+0000","last_became_active":"2024-04-02T07:31:30.728421+0000","last_became_peered":"2024-04-02T07:31:30.728421+0000","last_unstale":"2024-04-02T07:31:30.735819+0000","last_undegraded":"2024-04-02T07:31:30.735819+0000","last_fullsized":"2024-04-02T07:31:30.735819+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:40:03.326165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.737786+0000","last_change":"2024-04-02T07:31:30.733556+0000","last_active":"2024-04-02T07:31:30.737786+0000","last_peered":"2024-04-02T07:31:30.737786+0000","last_clean":"2024-04-02T07:31:30.737786+0000","last_became_active":"2024-04-02T07:31:30.733289+0000","last_became_peered":"2024-04-02T07:31:30.733289+0000","last_unstale":"2024-04-02T07:31:30.737786+0000","last_undegraded":"2024-04-02T07:31:30.737786+0000","last_fullsized":"2024-04-02T07:31:30.737786+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:04:09.602900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.735909+0000","last_change":"2024-04-02T07:31:30.731504+0000","last_active":"2024-04-02T07:31:30.735909+0000","last_peered":"2024-04-02T07:31:30.735909+0000","last_clean":"2024-04-02T07:31:30.735909+0000","last_became_active":"2024-04-02T07:31:30.731247+0000","last_became_peered":"2024-04-02T07:31:30.731247+0000","last_unstale":"2024-04-02T07:31:30.735909+0000","last_undegraded":"2024-04-02T07:31:30.735909+0000","last_fullsized":"2024-04-02T07:31:30.735909+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:40:03.326165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.733505+0000","last_change":"2024-04-02T07:31:30.727850+0000","last_active":"2024-04-02T07:31:30.733505+0000","last_peered":"2024-04-02T07:31:30.733505+0000","last_clean":"2024-04-02T07:31:30.733505+0000","last_became_active":"2024-04-02T07:31:30.727563+0000","last_became_peered":"2024-04-02T07:31:30.727563+0000","last_unstale":"2024-04-02T07:31:30.733505+0000","last_undegraded":"2024-04-02T07:31:30.733505+0000","last_fullsized":"2024-04-02T07:31:30.733505+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:04:09.602900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.746081+0000","last_change":"2024-04-02T07:31:30.741319+0000","last_active":"2024-04-02T07:31:30.746081+0000","last_peered":"2024-04-02T07:31:30.746081+0000","last_clean":"2024-04-02T07:31:30.746081+0000","last_became_active":"2024-04-02T07:31:30.740657+0000","last_became_peered":"2024-04-02T07:31:30.740657+0000","last_unstale":"2024-04-02T07:31:30.746081+0000","last_undegraded":"2024-04-02T07:31:30.746081+0000","last_fullsized":"2024-04-02T07:31:30.746081+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:40:40.588598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.731759+0000","last_change":"2024-04-02T07:31:30.726192+0000","last_active":"2024-04-02T07:31:30.731759+0000","last_peered":"2024-04-02T07:31:30.731759+0000","last_clean":"2024-04-02T07:31:30.731759+0000","last_became_active":"2024-04-02T07:31:30.725838+0000","last_became_peered":"2024-04-02T07:31:30.725838+0000","last_unstale":"2024-04-02T07:31:30.731759+0000","last_undegraded":"2024-04-02T07:31:30.731759+0000","last_fullsized":"2024-04-02T07:31:30.731759+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:54:19.952103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.733313+0000","last_change":"2024-04-02T07:31:30.727847+0000","last_active":"2024-04-02T07:31:30.733313+0000","last_peered":"2024-04-02T07:31:30.733313+0000","last_clean":"2024-04-02T07:31:30.733313+0000","last_became_active":"2024-04-02T07:31:30.727440+0000","last_became_peered":"2024-04-02T07:31:30.727440+0000","last_unstale":"2024-04-02T07:31:30.733313+0000","last_undegraded":"2024-04-02T07:31:30.733313+0000","last_fullsized":"2024-04-02T07:31:30.733313+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:02:21.039483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.742640+0000","last_change":"2024-04-02T07:31:30.734103+0000","last_active":"2024-04-02T07:31:30.742640+0000","last_peered":"2024-04-02T07:31:30.742640+0000","last_clean":"2024-04-02T07:31:30.742640+0000","last_became_active":"2024-04-02T07:31:30.732095+0000","last_became_peered":"2024-04-02T07:31:30.732095+0000","last_unstale":"2024-04-02T07:31:30.742640+0000","last_undegraded":"2024-04-02T07:31:30.742640+0000","last_fullsized":"2024-04-02T07:31:30.742640+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:04:25.942969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.739348+0000","last_change":"2024-04-02T07:31:30.733448+0000","last_active":"2024-04-02T07:31:30.739348+0000","last_peered":"2024-04-02T07:31:30.739348+0000","last_clean":"2024-04-02T07:31:30.739348+0000","last_became_active":"2024-04-02T07:31:30.733126+0000","last_became_peered":"2024-04-02T07:31:30.733126+0000","last_unstale":"2024-04-02T07:31:30.739348+0000","last_undegraded":"2024-04-02T07:31:30.739348+0000","last_fullsized":"2024-04-02T07:31:30.739348+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:54:19.952103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.735013+0000","last_change":"2024-04-02T07:31:30.731845+0000","last_active":"2024-04-02T07:31:30.735013+0000","last_peered":"2024-04-02T07:31:30.735013+0000","last_clean":"2024-04-02T07:31:30.735013+0000","last_became_active":"2024-04-02T07:31:30.730851+0000","last_became_peered":"2024-04-02T07:31:30.730851+0000","last_unstale":"2024-04-02T07:31:30.735013+0000","last_undegraded":"2024-04-02T07:31:30.735013+0000","last_fullsized":"2024-04-02T07:31:30.735013+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:17:35.772666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.747011+0000","last_change":"2024-04-02T07:31:30.739114+0000","last_active":"2024-04-02T07:31:30.747011+0000","last_peered":"2024-04-02T07:31:30.747011+0000","last_clean":"2024-04-02T07:31:30.747011+0000","last_became_active":"2024-04-02T07:31:30.736700+0000","last_became_peered":"2024-04-02T07:31:30.736700+0000","last_unstale":"2024-04-02T07:31:30.747011+0000","last_undegraded":"2024-04-02T07:31:30.747011+0000","last_fullsized":"2024-04-02T07:31:30.747011+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:33:33.120731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"102'4","reported_seq":14,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.735695+0000","last_change":"2024-04-02T07:31:30.324671+0000","last_active":"2024-04-02T07:31:30.735695+0000","last_peered":"2024-04-02T07:31:30.735695+0000","last_clean":"2024-04-02T07:31:30.735695+0000","last_became_active":"2024-04-02T07:31:30.324337+0000","last_became_peered":"2024-04-02T07:31:30.324337+0000","last_unstale":"2024-04-02T07:31:30.735695+0000","last_undegraded":"2024-04-02T07:31:30.735695+0000","last_fullsized":"2024-04-02T07:31:30.735695+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:48:38.076275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.741951+0000","last_change":"2024-04-02T07:31:30.736937+0000","last_active":"2024-04-02T07:31:30.741951+0000","last_peered":"2024-04-02T07:31:30.741951+0000","last_clean":"2024-04-02T07:31:30.741951+0000","last_became_active":"2024-04-02T07:31:30.736604+0000","last_became_peered":"2024-04-02T07:31:30.736604+0000","last_unstale":"2024-04-02T07:31:30.741951+0000","last_undegraded":"2024-04-02T07:31:30.741951+0000","last_fullsized":"2024-04-02T07:31:30.741951+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:02:21.039483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"102'1","reported_seq":11,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.731546+0000","last_change":"2024-04-02T07:31:30.323938+0000","last_active":"2024-04-02T07:31:30.731546+0000","last_peered":"2024-04-02T07:31:30.731546+0000","last_clean":"2024-04-02T07:31:30.731546+0000","last_became_active":"2024-04-02T07:31:30.323619+0000","last_became_peered":"2024-04-02T07:31:30.323619+0000","last_unstale":"2024-04-02T07:31:30.731546+0000","last_undegraded":"2024-04-02T07:31:30.731546+0000","last_fullsized":"2024-04-02T07:31:30.731546+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:11:01.198614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.734997+0000","last_change":"2024-04-02T07:31:30.729354+0000","last_active":"2024-04-02T07:31:30.734997+0000","last_peered":"2024-04-02T07:31:30.734997+0000","last_clean":"2024-04-02T07:31:30.734997+0000","last_became_active":"2024-04-02T07:31:30.728952+0000","last_became_peered":"2024-04-02T07:31:30.728952+0000","last_unstale":"2024-04-02T07:31:30.734997+0000","last_undegraded":"2024-04-02T07:31:30.734997+0000","last_fullsized":"2024-04-02T07:31:30.734997+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:11:49.638302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"102'2","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.737993+0000","last_change":"2024-04-02T07:31:30.323395+0000","last_active":"2024-04-02T07:31:30.737993+0000","last_peered":"2024-04-02T07:31:30.737993+0000","last_clean":"2024-04-02T07:31:30.737993+0000","last_became_active":"2024-04-02T07:31:30.323124+0000","last_became_peered":"2024-04-02T07:31:30.323124+0000","last_unstale":"2024-04-02T07:31:30.737993+0000","last_undegraded":"2024-04-02T07:31:30.737993+0000","last_fullsized":"2024-04-02T07:31:30.737993+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:12:33.521269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.733661+0000","last_change":"2024-04-02T07:31:30.727572+0000","last_active":"2024-04-02T07:31:30.733661+0000","last_peered":"2024-04-02T07:31:30.733661+0000","last_clean":"2024-04-02T07:31:30.733661+0000","last_became_active":"2024-04-02T07:31:30.727310+0000","last_became_peered":"2024-04-02T07:31:30.727310+0000","last_unstale":"2024-04-02T07:31:30.733661+0000","last_undegraded":"2024-04-02T07:31:30.733661+0000","last_fullsized":"2024-04-02T07:31:30.733661+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:48:39.078714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"102'2","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.738969+0000","last_change":"2024-04-02T07:31:30.326158+0000","last_active":"2024-04-02T07:31:30.738969+0000","last_peered":"2024-04-02T07:31:30.738969+0000","last_clean":"2024-04-02T07:31:30.738969+0000","last_became_active":"2024-04-02T07:31:30.325731+0000","last_became_peered":"2024-04-02T07:31:30.325731+0000","last_unstale":"2024-04-02T07:31:30.738969+0000","last_undegraded":"2024-04-02T07:31:30.738969+0000","last_fullsized":"2024-04-02T07:31:30.738969+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:11:48.635862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.736325+0000","last_change":"2024-04-02T07:31:30.734614+0000","last_active":"2024-04-02T07:31:30.736325+0000","last_peered":"2024-04-02T07:31:30.736325+0000","last_clean":"2024-04-02T07:31:30.736325+0000","last_became_active":"2024-04-02T07:31:30.734337+0000","last_became_peered":"2024-04-02T07:31:30.734337+0000","last_unstale":"2024-04-02T07:31:30.736325+0000","last_undegraded":"2024-04-02T07:31:30.736325+0000","last_fullsized":"2024-04-02T07:31:30.736325+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:09:56.945929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"102'1","reported_seq":11,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.736260+0000","last_change":"2024-04-02T07:31:30.320241+0000","last_active":"2024-04-02T07:31:30.736260+0000","last_peered":"2024-04-02T07:31:30.736260+0000","last_clean":"2024-04-02T07:31:30.736260+0000","last_became_active":"2024-04-02T07:31:30.319947+0000","last_became_peered":"2024-04-02T07:31:30.319947+0000","last_unstale":"2024-04-02T07:31:30.736260+0000","last_undegraded":"2024-04-02T07:31:30.736260+0000","last_fullsized":"2024-04-02T07:31:30.736260+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:56:57.221485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.738773+0000","last_change":"2024-04-02T07:31:30.734087+0000","last_active":"2024-04-02T07:31:30.738773+0000","last_peered":"2024-04-02T07:31:30.738773+0000","last_clean":"2024-04-02T07:31:30.738773+0000","last_became_active":"2024-04-02T07:31:30.733796+0000","last_became_peered":"2024-04-02T07:31:30.733796+0000","last_unstale":"2024-04-02T07:31:30.738773+0000","last_undegraded":"2024-04-02T07:31:30.738773+0000","last_fullsized":"2024-04-02T07:31:30.738773+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:48:29.335613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"102'1","reported_seq":11,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.732894+0000","last_change":"2024-04-02T07:31:30.327225+0000","last_active":"2024-04-02T07:31:30.732894+0000","last_peered":"2024-04-02T07:31:30.732894+0000","last_clean":"2024-04-02T07:31:30.732894+0000","last_became_active":"2024-04-02T07:31:30.326956+0000","last_became_peered":"2024-04-02T07:31:30.326956+0000","last_unstale":"2024-04-02T07:31:30.732894+0000","last_undegraded":"2024-04-02T07:31:30.732894+0000","last_fullsized":"2024-04-02T07:31:30.732894+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:14:29.720578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.739398+0000","last_change":"2024-04-02T07:31:30.734696+0000","last_active":"2024-04-02T07:31:30.739398+0000","last_peered":"2024-04-02T07:31:30.739398+0000","last_clean":"2024-04-02T07:31:30.739398+0000","last_became_active":"2024-04-02T07:31:30.734466+0000","last_became_peered":"2024-04-02T07:31:30.734466+0000","last_unstale":"2024-04-02T07:31:30.739398+0000","last_undegraded":"2024-04-02T07:31:30.739398+0000","last_fullsized":"2024-04-02T07:31:30.739398+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:47:43.895734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.715347+0000","last_change":"2024-04-02T07:31:30.321650+0000","last_active":"2024-04-02T07:31:30.715347+0000","last_peered":"2024-04-02T07:31:30.715347+0000","last_clean":"2024-04-02T07:31:30.715347+0000","last_became_active":"2024-04-02T07:31:30.321356+0000","last_became_peered":"2024-04-02T07:31:30.321356+0000","last_unstale":"2024-04-02T07:31:30.715347+0000","last_undegraded":"2024-04-02T07:31:30.715347+0000","last_fullsized":"2024-04-02T07:31:30.715347+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:18:25.113121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.739388+0000","last_change":"2024-04-02T07:31:30.737398+0000","last_active":"2024-04-02T07:31:30.739388+0000","last_peered":"2024-04-02T07:31:30.739388+0000","last_clean":"2024-04-02T07:31:30.739388+0000","last_became_active":"2024-04-02T07:31:30.737111+0000","last_became_peered":"2024-04-02T07:31:30.737111+0000","last_unstale":"2024-04-02T07:31:30.739388+0000","last_undegraded":"2024-04-02T07:31:30.739388+0000","last_fullsized":"2024-04-02T07:31:30.739388+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:14:30.723018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.717741+0000","last_change":"2024-04-02T07:31:30.315692+0000","last_active":"2024-04-02T07:31:30.717741+0000","last_peered":"2024-04-02T07:31:30.717741+0000","last_clean":"2024-04-02T07:31:30.717741+0000","last_became_active":"2024-04-02T07:31:30.315108+0000","last_became_peered":"2024-04-02T07:31:30.315108+0000","last_unstale":"2024-04-02T07:31:30.717741+0000","last_undegraded":"2024-04-02T07:31:30.717741+0000","last_fullsized":"2024-04-02T07:31:30.717741+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:37:01.992504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.728532+0000","last_change":"2024-04-02T07:31:30.721977+0000","last_active":"2024-04-02T07:31:30.728532+0000","last_peered":"2024-04-02T07:31:30.728532+0000","last_clean":"2024-04-02T07:31:30.728532+0000","last_became_active":"2024-04-02T07:31:30.721703+0000","last_became_peered":"2024-04-02T07:31:30.721703+0000","last_unstale":"2024-04-02T07:31:30.728532+0000","last_undegraded":"2024-04-02T07:31:30.728532+0000","last_fullsized":"2024-04-02T07:31:30.728532+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:40:40.588598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.718382+0000","last_change":"2024-04-02T07:31:30.321299+0000","last_active":"2024-04-02T07:31:30.718382+0000","last_peered":"2024-04-02T07:31:30.718382+0000","last_clean":"2024-04-02T07:31:30.718382+0000","last_became_active":"2024-04-02T07:31:30.321048+0000","last_became_peered":"2024-04-02T07:31:30.321048+0000","last_unstale":"2024-04-02T07:31:30.718382+0000","last_undegraded":"2024-04-02T07:31:30.718382+0000","last_fullsized":"2024-04-02T07:31:30.718382+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:45:27.249222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.733556+0000","last_change":"2024-04-02T07:31:30.729062+0000","last_active":"2024-04-02T07:31:30.733556+0000","last_peered":"2024-04-02T07:31:30.733556+0000","last_clean":"2024-04-02T07:31:30.733556+0000","last_became_active":"2024-04-02T07:31:30.728817+0000","last_became_peered":"2024-04-02T07:31:30.728817+0000","last_unstale":"2024-04-02T07:31:30.733556+0000","last_undegraded":"2024-04-02T07:31:30.733556+0000","last_fullsized":"2024-04-02T07:31:30.733556+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:31:40.412369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.724838+0000","last_change":"2024-04-02T07:31:30.323934+0000","last_active":"2024-04-02T07:31:30.724838+0000","last_peered":"2024-04-02T07:31:30.724838+0000","last_clean":"2024-04-02T07:31:30.724838+0000","last_became_active":"2024-04-02T07:31:30.323680+0000","last_became_peered":"2024-04-02T07:31:30.323680+0000","last_unstale":"2024-04-02T07:31:30.724838+0000","last_undegraded":"2024-04-02T07:31:30.724838+0000","last_fullsized":"2024-04-02T07:31:30.724838+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:48:38.076275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.735702+0000","last_change":"2024-04-02T07:31:30.731267+0000","last_active":"2024-04-02T07:31:30.735702+0000","last_peered":"2024-04-02T07:31:30.735702+0000","last_clean":"2024-04-02T07:31:30.735702+0000","last_became_active":"2024-04-02T07:31:30.730466+0000","last_became_peered":"2024-04-02T07:31:30.730466+0000","last_unstale":"2024-04-02T07:31:30.735702+0000","last_undegraded":"2024-04-02T07:31:30.735702+0000","last_fullsized":"2024-04-02T07:31:30.735702+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:29:36.448188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"102'3","reported_seq":13,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.742233+0000","last_change":"2024-04-02T07:31:30.323250+0000","last_active":"2024-04-02T07:31:30.742233+0000","last_peered":"2024-04-02T07:31:30.742233+0000","last_clean":"2024-04-02T07:31:30.742233+0000","last_became_active":"2024-04-02T07:31:30.322968+0000","last_became_peered":"2024-04-02T07:31:30.322968+0000","last_unstale":"2024-04-02T07:31:30.742233+0000","last_undegraded":"2024-04-02T07:31:30.742233+0000","last_fullsized":"2024-04-02T07:31:30.742233+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:31:39.409929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.740867+0000","last_change":"2024-04-02T07:31:30.737739+0000","last_active":"2024-04-02T07:31:30.740867+0000","last_peered":"2024-04-02T07:31:30.740867+0000","last_clean":"2024-04-02T07:31:30.740867+0000","last_became_active":"2024-04-02T07:31:30.737486+0000","last_became_peered":"2024-04-02T07:31:30.737486+0000","last_unstale":"2024-04-02T07:31:30.740867+0000","last_undegraded":"2024-04-02T07:31:30.740867+0000","last_fullsized":"2024-04-02T07:31:30.740867+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:54:19.952103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"102'6","reported_seq":16,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.749059+0000","last_change":"2024-04-02T07:31:30.328514+0000","last_active":"2024-04-02T07:31:30.749059+0000","last_peered":"2024-04-02T07:31:30.749059+0000","last_clean":"2024-04-02T07:31:30.749059+0000","last_became_active":"2024-04-02T07:31:30.328011+0000","last_became_peered":"2024-04-02T07:31:30.328011+0000","last_unstale":"2024-04-02T07:31:30.749059+0000","last_undegraded":"2024-04-02T07:31:30.749059+0000","last_fullsized":"2024-04-02T07:31:30.749059+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:25:38.680395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.736838+0000","last_change":"2024-04-02T07:31:30.730585+0000","last_active":"2024-04-02T07:31:30.736838+0000","last_peered":"2024-04-02T07:31:30.736838+0000","last_clean":"2024-04-02T07:31:30.736838+0000","last_became_active":"2024-04-02T07:31:30.730159+0000","last_became_peered":"2024-04-02T07:31:30.730159+0000","last_unstale":"2024-04-02T07:31:30.736838+0000","last_undegraded":"2024-04-02T07:31:30.736838+0000","last_fullsized":"2024-04-02T07:31:30.736838+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:40:03.326165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"102'2","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.740372+0000","last_change":"2024-04-02T07:31:30.328453+0000","last_active":"2024-04-02T07:31:30.740372+0000","last_peered":"2024-04-02T07:31:30.740372+0000","last_clean":"2024-04-02T07:31:30.740372+0000","last_became_active":"2024-04-02T07:31:30.328181+0000","last_became_peered":"2024-04-02T07:31:30.328181+0000","last_unstale":"2024-04-02T07:31:30.740372+0000","last_undegraded":"2024-04-02T07:31:30.740372+0000","last_fullsized":"2024-04-02T07:31:30.740372+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:19:05.961238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.743075+0000","last_change":"2024-04-02T07:31:30.741132+0000","last_active":"2024-04-02T07:31:30.743075+0000","last_peered":"2024-04-02T07:31:30.743075+0000","last_clean":"2024-04-02T07:31:30.743075+0000","last_became_active":"2024-04-02T07:31:30.740876+0000","last_became_peered":"2024-04-02T07:31:30.740876+0000","last_unstale":"2024-04-02T07:31:30.743075+0000","last_undegraded":"2024-04-02T07:31:30.743075+0000","last_fullsized":"2024-04-02T07:31:30.743075+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:32.822529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.714558+0000","last_change":"2024-04-02T07:31:30.323742+0000","last_active":"2024-04-02T07:31:30.714558+0000","last_peered":"2024-04-02T07:31:30.714558+0000","last_clean":"2024-04-02T07:31:30.714558+0000","last_became_active":"2024-04-02T07:31:30.323446+0000","last_became_peered":"2024-04-02T07:31:30.323446+0000","last_unstale":"2024-04-02T07:31:30.714558+0000","last_undegraded":"2024-04-02T07:31:30.714558+0000","last_fullsized":"2024-04-02T07:31:30.714558+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:16:28.250201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.733418+0000","last_change":"2024-04-02T07:31:30.727850+0000","last_active":"2024-04-02T07:31:30.733418+0000","last_peered":"2024-04-02T07:31:30.733418+0000","last_clean":"2024-04-02T07:31:30.733418+0000","last_became_active":"2024-04-02T07:31:30.726944+0000","last_became_peered":"2024-04-02T07:31:30.726944+0000","last_unstale":"2024-04-02T07:31:30.733418+0000","last_undegraded":"2024-04-02T07:31:30.733418+0000","last_fullsized":"2024-04-02T07:31:30.733418+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:11:02.201053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.712919+0000","last_change":"2024-04-02T07:31:30.325935+0000","last_active":"2024-04-02T07:31:30.712919+0000","last_peered":"2024-04-02T07:31:30.712919+0000","last_clean":"2024-04-02T07:31:30.712919+0000","last_became_active":"2024-04-02T07:31:30.325614+0000","last_became_peered":"2024-04-02T07:31:30.325614+0000","last_unstale":"2024-04-02T07:31:30.712919+0000","last_undegraded":"2024-04-02T07:31:30.712919+0000","last_fullsized":"2024-04-02T07:31:30.712919+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:09:55.943489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.742516+0000","last_change":"2024-04-02T07:31:30.731934+0000","last_active":"2024-04-02T07:31:30.742516+0000","last_peered":"2024-04-02T07:31:30.742516+0000","last_clean":"2024-04-02T07:31:30.742516+0000","last_became_active":"2024-04-02T07:31:30.731673+0000","last_became_peered":"2024-04-02T07:31:30.731673+0000","last_unstale":"2024-04-02T07:31:30.742516+0000","last_undegraded":"2024-04-02T07:31:30.742516+0000","last_fullsized":"2024-04-02T07:31:30.742516+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:32:15.184711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"102'8","reported_seq":18,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.737846+0000","last_change":"2024-04-02T07:31:30.315782+0000","last_active":"2024-04-02T07:31:30.737846+0000","last_peered":"2024-04-02T07:31:30.737846+0000","last_clean":"2024-04-02T07:31:30.737846+0000","last_became_active":"2024-04-02T07:31:30.315441+0000","last_became_peered":"2024-04-02T07:31:30.315441+0000","last_unstale":"2024-04-02T07:31:30.737846+0000","last_undegraded":"2024-04-02T07:31:30.737846+0000","last_fullsized":"2024-04-02T07:31:30.737846+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:41:56.174822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.730801+0000","last_change":"2024-04-02T07:31:30.720679+0000","last_active":"2024-04-02T07:31:30.730801+0000","last_peered":"2024-04-02T07:31:30.730801+0000","last_clean":"2024-04-02T07:31:30.730801+0000","last_became_active":"2024-04-02T07:31:30.720404+0000","last_became_peered":"2024-04-02T07:31:30.720404+0000","last_unstale":"2024-04-02T07:31:30.730801+0000","last_undegraded":"2024-04-02T07:31:30.730801+0000","last_fullsized":"2024-04-02T07:31:30.730801+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:51.651877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"102'2","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.742406+0000","last_change":"2024-04-02T07:31:30.325092+0000","last_active":"2024-04-02T07:31:30.742406+0000","last_peered":"2024-04-02T07:31:30.742406+0000","last_clean":"2024-04-02T07:31:30.742406+0000","last_became_active":"2024-04-02T07:31:30.324528+0000","last_became_peered":"2024-04-02T07:31:30.324528+0000","last_unstale":"2024-04-02T07:31:30.742406+0000","last_undegraded":"2024-04-02T07:31:30.742406+0000","last_fullsized":"2024-04-02T07:31:30.742406+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:24:25.989729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.736296+0000","last_change":"2024-04-02T07:31:30.734371+0000","last_active":"2024-04-02T07:31:30.736296+0000","last_peered":"2024-04-02T07:31:30.736296+0000","last_clean":"2024-04-02T07:31:30.736296+0000","last_became_active":"2024-04-02T07:31:30.734101+0000","last_became_peered":"2024-04-02T07:31:30.734101+0000","last_unstale":"2024-04-02T07:31:30.736296+0000","last_undegraded":"2024-04-02T07:31:30.736296+0000","last_fullsized":"2024-04-02T07:31:30.736296+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:24:26.992169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"102'1","reported_seq":11,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.741788+0000","last_change":"2024-04-02T07:31:30.321802+0000","last_active":"2024-04-02T07:31:30.741788+0000","last_peered":"2024-04-02T07:31:30.741788+0000","last_clean":"2024-04-02T07:31:30.741788+0000","last_became_active":"2024-04-02T07:31:30.321023+0000","last_became_peered":"2024-04-02T07:31:30.321023+0000","last_unstale":"2024-04-02T07:31:30.741788+0000","last_undegraded":"2024-04-02T07:31:30.741788+0000","last_fullsized":"2024-04-02T07:31:30.741788+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:17:34.770227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.743222+0000","last_change":"2024-04-02T07:31:30.740134+0000","last_active":"2024-04-02T07:31:30.743222+0000","last_peered":"2024-04-02T07:31:30.743222+0000","last_clean":"2024-04-02T07:31:30.743222+0000","last_became_active":"2024-04-02T07:31:30.739609+0000","last_became_peered":"2024-04-02T07:31:30.739609+0000","last_unstale":"2024-04-02T07:31:30.743222+0000","last_undegraded":"2024-04-02T07:31:30.743222+0000","last_fullsized":"2024-04-02T07:31:30.743222+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:02:21.039483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.709261+0000","last_change":"2024-04-02T07:31:30.325728+0000","last_active":"2024-04-02T07:31:30.709261+0000","last_peered":"2024-04-02T07:31:30.709261+0000","last_clean":"2024-04-02T07:31:30.709261+0000","last_became_active":"2024-04-02T07:31:30.325442+0000","last_became_peered":"2024-04-02T07:31:30.325442+0000","last_unstale":"2024-04-02T07:31:30.709261+0000","last_undegraded":"2024-04-02T07:31:30.709261+0000","last_fullsized":"2024-04-02T07:31:30.709261+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:17:34.770227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.742621+0000","last_change":"2024-04-02T07:31:30.733925+0000","last_active":"2024-04-02T07:31:30.742621+0000","last_peered":"2024-04-02T07:31:30.742621+0000","last_clean":"2024-04-02T07:31:30.742621+0000","last_became_active":"2024-04-02T07:31:30.731512+0000","last_became_peered":"2024-04-02T07:31:30.731512+0000","last_unstale":"2024-04-02T07:31:30.742621+0000","last_undegraded":"2024-04-02T07:31:30.742621+0000","last_fullsized":"2024-04-02T07:31:30.742621+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:21:08.099874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"102'2","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.741089+0000","last_change":"2024-04-02T07:31:30.328807+0000","last_active":"2024-04-02T07:31:30.741089+0000","last_peered":"2024-04-02T07:31:30.741089+0000","last_clean":"2024-04-02T07:31:30.741089+0000","last_became_active":"2024-04-02T07:31:30.328533+0000","last_became_peered":"2024-04-02T07:31:30.328533+0000","last_unstale":"2024-04-02T07:31:30.741089+0000","last_undegraded":"2024-04-02T07:31:30.741089+0000","last_fullsized":"2024-04-02T07:31:30.741089+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:11:01.198614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.747146+0000","last_change":"2024-04-02T07:31:30.740274+0000","last_active":"2024-04-02T07:31:30.747146+0000","last_peered":"2024-04-02T07:31:30.747146+0000","last_clean":"2024-04-02T07:31:30.747146+0000","last_became_active":"2024-04-02T07:31:30.739247+0000","last_became_peered":"2024-04-02T07:31:30.739247+0000","last_unstale":"2024-04-02T07:31:30.747146+0000","last_undegraded":"2024-04-02T07:31:30.747146+0000","last_fullsized":"2024-04-02T07:31:30.747146+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:50:36.187945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.719205+0000","last_change":"2024-04-02T07:31:30.327079+0000","last_active":"2024-04-02T07:31:30.719205+0000","last_peered":"2024-04-02T07:31:30.719205+0000","last_clean":"2024-04-02T07:31:30.719205+0000","last_became_active":"2024-04-02T07:31:30.326293+0000","last_became_peered":"2024-04-02T07:31:30.326293+0000","last_unstale":"2024-04-02T07:31:30.719205+0000","last_undegraded":"2024-04-02T07:31:30.719205+0000","last_fullsized":"2024-04-02T07:31:30.719205+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:25:42.939510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.747049+0000","last_change":"2024-04-02T07:31:30.739503+0000","last_active":"2024-04-02T07:31:30.747049+0000","last_peered":"2024-04-02T07:31:30.747049+0000","last_clean":"2024-04-02T07:31:30.747049+0000","last_became_active":"2024-04-02T07:31:30.738303+0000","last_became_peered":"2024-04-02T07:31:30.738303+0000","last_unstale":"2024-04-02T07:31:30.747049+0000","last_undegraded":"2024-04-02T07:31:30.747049+0000","last_fullsized":"2024-04-02T07:31:30.747049+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:58:46.447107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.724180+0000","last_change":"2024-04-02T07:31:30.318477+0000","last_active":"2024-04-02T07:31:30.724180+0000","last_peered":"2024-04-02T07:31:30.724180+0000","last_clean":"2024-04-02T07:31:30.724180+0000","last_became_active":"2024-04-02T07:31:30.318192+0000","last_became_peered":"2024-04-02T07:31:30.318192+0000","last_unstale":"2024-04-02T07:31:30.724180+0000","last_undegraded":"2024-04-02T07:31:30.724180+0000","last_fullsized":"2024-04-02T07:31:30.724180+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:41:56.174822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.734865+0000","last_change":"2024-04-02T07:31:30.728067+0000","last_active":"2024-04-02T07:31:30.734865+0000","last_peered":"2024-04-02T07:31:30.734865+0000","last_clean":"2024-04-02T07:31:30.734865+0000","last_became_active":"2024-04-02T07:31:30.727756+0000","last_became_peered":"2024-04-02T07:31:30.727756+0000","last_unstale":"2024-04-02T07:31:30.734865+0000","last_undegraded":"2024-04-02T07:31:30.734865+0000","last_fullsized":"2024-04-02T07:31:30.734865+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:30:57.344018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.708633+0000","last_change":"2024-04-02T07:31:30.323737+0000","last_active":"2024-04-02T07:31:30.708633+0000","last_peered":"2024-04-02T07:31:30.708633+0000","last_clean":"2024-04-02T07:31:30.708633+0000","last_became_active":"2024-04-02T07:31:30.323499+0000","last_became_peered":"2024-04-02T07:31:30.323499+0000","last_unstale":"2024-04-02T07:31:30.708633+0000","last_undegraded":"2024-04-02T07:31:30.708633+0000","last_fullsized":"2024-04-02T07:31:30.708633+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:31:39.409929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.735612+0000","last_change":"2024-04-02T07:31:30.731144+0000","last_active":"2024-04-02T07:31:30.735612+0000","last_peered":"2024-04-02T07:31:30.735612+0000","last_clean":"2024-04-02T07:31:30.735612+0000","last_became_active":"2024-04-02T07:31:30.730911+0000","last_became_peered":"2024-04-02T07:31:30.730911+0000","last_unstale":"2024-04-02T07:31:30.735612+0000","last_undegraded":"2024-04-02T07:31:30.735612+0000","last_fullsized":"2024-04-02T07:31:30.735612+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:48:29.335613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"102'2","reported_seq":12,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.742260+0000","last_change":"2024-04-02T07:31:30.328116+0000","last_active":"2024-04-02T07:31:30.742260+0000","last_peered":"2024-04-02T07:31:30.742260+0000","last_clean":"2024-04-02T07:31:30.742260+0000","last_became_active":"2024-04-02T07:31:30.327755+0000","last_became_peered":"2024-04-02T07:31:30.327755+0000","last_unstale":"2024-04-02T07:31:30.742260+0000","last_undegraded":"2024-04-02T07:31:30.742260+0000","last_fullsized":"2024-04-02T07:31:30.742260+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:40:53.952593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.743012+0000","last_change":"2024-04-02T07:31:30.738821+0000","last_active":"2024-04-02T07:31:30.743012+0000","last_peered":"2024-04-02T07:31:30.743012+0000","last_clean":"2024-04-02T07:31:30.743012+0000","last_became_active":"2024-04-02T07:31:30.738572+0000","last_became_peered":"2024-04-02T07:31:30.738572+0000","last_unstale":"2024-04-02T07:31:30.743012+0000","last_undegraded":"2024-04-02T07:31:30.743012+0000","last_fullsized":"2024-04-02T07:31:30.743012+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:15:32.951259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.709902+0000","last_change":"2024-04-02T07:31:30.327850+0000","last_active":"2024-04-02T07:31:30.709902+0000","last_peered":"2024-04-02T07:31:30.709902+0000","last_clean":"2024-04-02T07:31:30.709902+0000","last_became_active":"2024-04-02T07:31:30.327597+0000","last_became_peered":"2024-04-02T07:31:30.327597+0000","last_unstale":"2024-04-02T07:31:30.709902+0000","last_undegraded":"2024-04-02T07:31:30.709902+0000","last_fullsized":"2024-04-02T07:31:30.709902+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:21:21.928471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.736610+0000","last_change":"2024-04-02T07:31:30.735390+0000","last_active":"2024-04-02T07:31:30.736610+0000","last_peered":"2024-04-02T07:31:30.736610+0000","last_clean":"2024-04-02T07:31:30.736610+0000","last_became_active":"2024-04-02T07:31:30.735110+0000","last_became_peered":"2024-04-02T07:31:30.735110+0000","last_unstale":"2024-04-02T07:31:30.736610+0000","last_undegraded":"2024-04-02T07:31:30.736610+0000","last_fullsized":"2024-04-02T07:31:30.736610+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:18:26.115560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.709503+0000","last_change":"2024-04-02T07:31:30.324552+0000","last_active":"2024-04-02T07:31:30.709503+0000","last_peered":"2024-04-02T07:31:30.709503+0000","last_clean":"2024-04-02T07:31:30.709503+0000","last_became_active":"2024-04-02T07:31:30.324290+0000","last_became_peered":"2024-04-02T07:31:30.324290+0000","last_unstale":"2024-04-02T07:31:30.709503+0000","last_undegraded":"2024-04-02T07:31:30.709503+0000","last_fullsized":"2024-04-02T07:31:30.709503+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:12:54.553033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.736024+0000","last_change":"2024-04-02T07:31:30.730719+0000","last_active":"2024-04-02T07:31:30.736024+0000","last_peered":"2024-04-02T07:31:30.736024+0000","last_clean":"2024-04-02T07:31:30.736024+0000","last_became_active":"2024-04-02T07:31:30.730417+0000","last_became_peered":"2024-04-02T07:31:30.730417+0000","last_unstale":"2024-04-02T07:31:30.736024+0000","last_undegraded":"2024-04-02T07:31:30.736024+0000","last_fullsized":"2024-04-02T07:31:30.736024+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:15:05.313593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.716436+0000","last_change":"2024-04-02T07:31:30.324996+0000","last_active":"2024-04-02T07:31:30.716436+0000","last_peered":"2024-04-02T07:31:30.716436+0000","last_clean":"2024-04-02T07:31:30.716436+0000","last_became_active":"2024-04-02T07:31:30.324701+0000","last_became_peered":"2024-04-02T07:31:30.324701+0000","last_unstale":"2024-04-02T07:31:30.716436+0000","last_undegraded":"2024-04-02T07:31:30.716436+0000","last_fullsized":"2024-04-02T07:31:30.716436+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:11:48.635862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.742192+0000","last_change":"2024-04-02T07:31:30.730919+0000","last_active":"2024-04-02T07:31:30.742192+0000","last_peered":"2024-04-02T07:31:30.742192+0000","last_clean":"2024-04-02T07:31:30.742192+0000","last_became_active":"2024-04-02T07:31:30.730645+0000","last_became_peered":"2024-04-02T07:31:30.730645+0000","last_unstale":"2024-04-02T07:31:30.742192+0000","last_undegraded":"2024-04-02T07:31:30.742192+0000","last_fullsized":"2024-04-02T07:31:30.742192+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:34:58.821249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.709040+0000","last_change":"2024-04-02T07:31:30.319400+0000","last_active":"2024-04-02T07:31:30.709040+0000","last_peered":"2024-04-02T07:31:30.709040+0000","last_clean":"2024-04-02T07:31:30.709040+0000","last_became_active":"2024-04-02T07:31:30.319013+0000","last_became_peered":"2024-04-02T07:31:30.319013+0000","last_unstale":"2024-04-02T07:31:30.709040+0000","last_undegraded":"2024-04-02T07:31:30.709040+0000","last_fullsized":"2024-04-02T07:31:30.709040+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:18:25.113121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.727300+0000","last_change":"2024-04-02T07:31:30.721774+0000","last_active":"2024-04-02T07:31:30.727300+0000","last_peered":"2024-04-02T07:31:30.727300+0000","last_clean":"2024-04-02T07:31:30.727300+0000","last_became_active":"2024-04-02T07:31:30.720737+0000","last_became_peered":"2024-04-02T07:31:30.720737+0000","last_unstale":"2024-04-02T07:31:30.727300+0000","last_undegraded":"2024-04-02T07:31:30.727300+0000","last_fullsized":"2024-04-02T07:31:30.727300+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:12:34.523708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.715683+0000","last_change":"2024-04-02T07:31:30.323163+0000","last_active":"2024-04-02T07:31:30.715683+0000","last_peered":"2024-04-02T07:31:30.715683+0000","last_clean":"2024-04-02T07:31:30.715683+0000","last_became_active":"2024-04-02T07:31:30.322908+0000","last_became_peered":"2024-04-02T07:31:30.322908+0000","last_unstale":"2024-04-02T07:31:30.715683+0000","last_undegraded":"2024-04-02T07:31:30.715683+0000","last_fullsized":"2024-04-02T07:31:30.715683+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:31.820089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.747027+0000","last_change":"2024-04-02T07:31:30.739332+0000","last_active":"2024-04-02T07:31:30.747027+0000","last_peered":"2024-04-02T07:31:30.747027+0000","last_clean":"2024-04-02T07:31:30.747027+0000","last_became_active":"2024-04-02T07:31:30.739045+0000","last_became_peered":"2024-04-02T07:31:30.739045+0000","last_unstale":"2024-04-02T07:31:30.747027+0000","last_undegraded":"2024-04-02T07:31:30.747027+0000","last_fullsized":"2024-04-02T07:31:30.747027+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:29:36.944905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.722902+0000","last_change":"2024-04-02T07:31:30.320276+0000","last_active":"2024-04-02T07:31:30.722902+0000","last_peered":"2024-04-02T07:31:30.722902+0000","last_clean":"2024-04-02T07:31:30.722902+0000","last_became_active":"2024-04-02T07:31:30.319376+0000","last_became_peered":"2024-04-02T07:31:30.319376+0000","last_unstale":"2024-04-02T07:31:30.722902+0000","last_undegraded":"2024-04-02T07:31:30.722902+0000","last_fullsized":"2024-04-02T07:31:30.722902+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:31:39.409929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.735063+0000","last_change":"2024-04-02T07:31:30.729994+0000","last_active":"2024-04-02T07:31:30.735063+0000","last_peered":"2024-04-02T07:31:30.735063+0000","last_clean":"2024-04-02T07:31:30.735063+0000","last_became_active":"2024-04-02T07:31:30.729617+0000","last_became_peered":"2024-04-02T07:31:30.729617+0000","last_unstale":"2024-04-02T07:31:30.735063+0000","last_undegraded":"2024-04-02T07:31:30.735063+0000","last_fullsized":"2024-04-02T07:31:30.735063+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:04:36.056014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":10,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.714341+0000","last_change":"2024-04-02T07:31:30.326021+0000","last_active":"2024-04-02T07:31:30.714341+0000","last_peered":"2024-04-02T07:31:30.714341+0000","last_clean":"2024-04-02T07:31:30.714341+0000","last_became_active":"2024-04-02T07:31:30.325772+0000","last_became_peered":"2024-04-02T07:31:30.325772+0000","last_unstale":"2024-04-02T07:31:30.714341+0000","last_undegraded":"2024-04-02T07:31:30.714341+0000","last_fullsized":"2024-04-02T07:31:30.714341+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:48:20.783900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":9,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.742686+0000","last_change":"2024-04-02T07:31:30.733065+0000","last_active":"2024-04-02T07:31:30.742686+0000","last_peered":"2024-04-02T07:31:30.742686+0000","last_clean":"2024-04-02T07:31:30.742686+0000","last_became_active":"2024-04-02T07:31:30.730927+0000","last_became_peered":"2024-04-02T07:31:30.730927+0000","last_unstale":"2024-04-02T07:31:30.742686+0000","last_undegraded":"2024-04-02T07:31:30.742686+0000","last_fullsized":"2024-04-02T07:31:30.742686+0000","mapping_epoch":101,"log_start":"0'0","ondisk_log_start":"0'0","created":101,"last_epoch_clean":102,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:30.299304+0000","last_clean_scrub_stamp":"2024-04-02T07:31:30.299304+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:46:09.018831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"102'1","reported_seq":11,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.732725+0000","last_change":"2024-04-02T07:31:30.322517+0000","last_active":"2024-04-02T07:31:30.732725+0000","last_peered":"2024-04-02T07:31:30.732725+0000","last_clean":"2024-04-02T07:31:30.732725+0000","last_became_active":"2024-04-02T07:31:30.321191+0000","last_became_peered":"2024-04-02T07:31:30.321191+0000","last_unstale":"2024-04-02T07:31:30.732725+0000","last_undegraded":"2024-04-02T07:31:30.732725+0000","last_fullsized":"2024-04-02T07:31:30.732725+0000","mapping_epoch":100,"log_start":"0'0","ondisk_log_start":"0'0","created":100,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:31:29.296865+0000","last_clean_scrub_stamp":"2024-04-02T07:31:29.296865+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:48:38.076275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":237,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-04-02T07:31:30.310766+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:31:30.310766+0000","last_peered":"2024-04-02T07:31:30.310766+0000","last_clean":"2024-04-02T07:31:30.310766+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:31:30.310766+0000","last_undegraded":"2024-04-02T07:31:30.310766+0000","last_fullsized":"2024-04-02T07:31:30.310766+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574963,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32944,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338896,"statfs":{"total":96636764160,"available":96603029504,"internally_reserved":0,"allocated":1863680,"data_stored":1135391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.66700000000000004,"15min":0.65500000000000003},"min":{"1min":0.46200000000000002,"5min":0.376,"15min":0.35299999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":1.0569999999999999},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.65700000000000003,"15min":0.63200000000000001},"min":{"1min":0.442,"5min":0.40699999999999997,"15min":0.39900000000000002},"max":{"1min":0.94999999999999996,"5min":1.018,"15min":1.018},"last":0.48899999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.67700000000000005,"15min":0.64900000000000002},"min":{"1min":0.51900000000000002,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.97399999999999998,"5min":1.004,"15min":1.0289999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.69399999999999995,"15min":0.67300000000000004},"min":{"1min":0.51800000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":1.113},"last":0.58999999999999997}]},{"osd":2,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.751,"15min":0.752},"min":{"1min":0.501,"5min":0.501,"15min":0.435},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.139},"last":0.747},{"interface":"front","average":{"1min":0.749,"5min":0.72599999999999998,"15min":0.72799999999999998},"min":{"1min":0.503,"5min":0.437,"15min":0.437},"max":{"1min":0.995,"5min":1.0549999999999999,"15min":1.522},"last":0.63200000000000001}]},{"osd":3,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.71299999999999997,"5min":0.69799999999999995,"15min":0.70199999999999996},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.97399999999999998,"5min":1.0409999999999999,"15min":1.405},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.72999999999999998,"15min":0.72699999999999998},"min":{"1min":0.54200000000000004,"5min":0.48799999999999999,"15min":0.48599999999999999},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0580000000000001},"last":0.65100000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.57799999999999996,"15min":0.64600000000000002},"min":{"1min":0.37,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.86599999999999999,"5min":0.89500000000000002,"15min":1.633},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66100000000000003,"15min":0.70699999999999996},"min":{"1min":0.52800000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88300000000000001,"5min":0.91200000000000003,"15min":1.079},"last":0.70399999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64900000000000002,"15min":0.69099999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.86799999999999999,"5min":0.996,"15min":1.2250000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.69999999999999996,"15min":0.749},"min":{"1min":0.45600000000000002,"5min":0.441,"15min":0.43099999999999999},"max":{"1min":0.90000000000000002,"5min":1.0049999999999999,"15min":1.5609999999999999},"last":0.72899999999999998}]},{"osd":6,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.68799999999999994,"5min":0.66600000000000004,"15min":0.70399999999999996},"min":{"1min":0.50700000000000001,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":0.93600000000000005,"5min":0.97199999999999998,"15min":1.5960000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.66200000000000003,"15min":0.68100000000000005},"min":{"1min":0.45700000000000002,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.91400000000000003,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.53100000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574964,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32336,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339504,"statfs":{"total":96636764160,"available":96603652096,"internally_reserved":0,"allocated":1249280,"data_stored":538136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.70899999999999996,"15min":0.67700000000000005},"min":{"1min":0.48199999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.97299999999999998,"5min":0.995,"15min":1.399},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.71499999999999997,"15min":0.80900000000000005},"min":{"1min":0.59199999999999997,"5min":0.439,"15min":0.39400000000000002},"max":{"1min":0.89200000000000002,"5min":0.98599999999999999,"15min":5.7569999999999997},"last":0.63200000000000001}]},{"osd":1,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.71599999999999997,"15min":0.72099999999999997},"min":{"1min":0.52600000000000002,"5min":0.42299999999999999,"15min":0.38200000000000001},"max":{"1min":0.88900000000000001,"5min":1.0249999999999999,"15min":1.95},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.74099999999999999,"15min":0.73099999999999998},"min":{"1min":0.623,"5min":0.50600000000000001,"15min":0.47599999999999998},"max":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.248},"last":0.77000000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.72699999999999998,"15min":0.69799999999999995},"min":{"1min":0.56100000000000005,"5min":0.47499999999999998,"15min":0.45000000000000001},"max":{"1min":0.95399999999999996,"5min":1.0249999999999999,"15min":1.226},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.74099999999999999,"15min":0.71899999999999997},"min":{"1min":0.53900000000000003,"5min":0.502,"15min":0.46500000000000002},"max":{"1min":0.98999999999999999,"5min":1,"15min":1},"last":0.751}]},{"osd":3,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.747,"15min":0.77900000000000003},"min":{"1min":0.495,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.92500000000000004,"5min":0.99299999999999999,"15min":2.3119999999999998},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.73099999999999998,"15min":0.76400000000000001},"min":{"1min":0.51400000000000001,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":0.97499999999999998,"5min":1.018,"15min":2.6389999999999998},"last":0.65900000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.60699999999999998,"15min":0.64000000000000001},"min":{"1min":0.437,"5min":0.36099999999999999,"15min":0.34999999999999998},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.94399999999999995},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.621,"15min":0.65000000000000002},"min":{"1min":0.47799999999999998,"5min":0.41399999999999998,"15min":0.38500000000000001},"max":{"1min":0.80500000000000005,"5min":0.95199999999999996,"15min":0.96999999999999997},"last":0.67900000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.61199999999999999,"15min":0.64600000000000002},"min":{"1min":0.47499999999999998,"5min":0.41899999999999998,"15min":0.37},"max":{"1min":0.74099999999999999,"5min":0.93000000000000005,"15min":0.95999999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.66200000000000003,"15min":0.70499999999999996},"min":{"1min":0.48699999999999999,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":0.78900000000000003,"5min":0.94399999999999995,"15min":1.0529999999999999},"last":0.78700000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.66700000000000004,"15min":0.71299999999999997},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.83499999999999996,"5min":0.95099999999999996,"15min":1.0209999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.68400000000000005,"15min":0.71899999999999997},"min":{"1min":0.54700000000000004,"5min":0.503,"15min":0.47799999999999998},"max":{"1min":0.78100000000000003,"5min":0.96299999999999997,"15min":0.999},"last":0.69199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1249280,"data_stored":538136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.68999999999999995,"15min":0.66500000000000004},"min":{"1min":0.439,"5min":0.433,"15min":0.33900000000000002},"max":{"1min":0.995,"5min":0.995,"15min":1.25},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.71799999999999997,"15min":0.70899999999999996},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.33000000000000002},"max":{"1min":0.93999999999999995,"5min":1.0029999999999999,"15min":1.5289999999999999},"last":0.86099999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.73799999999999999,"15min":0.70899999999999996},"min":{"1min":0.50900000000000001,"5min":0.45900000000000002,"15min":0.371},"max":{"1min":0.93600000000000005,"5min":0.98899999999999999,"15min":1.1830000000000001},"last":0.995},{"interface":"front","average":{"1min":0.70199999999999996,"5min":0.71899999999999997,"15min":0.71699999999999997},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.94699999999999995,"5min":1.0169999999999999,"15min":1.3420000000000001},"last":0.63900000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.78900000000000003,"15min":0.80400000000000005},"min":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.44900000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.8280000000000001},"last":0.81599999999999995},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73299999999999998,"15min":0.73699999999999999},"min":{"1min":0.48399999999999999,"5min":0.42499999999999999,"15min":0.39700000000000002},"max":{"1min":0.96699999999999997,"5min":1.022,"15min":1.696},"last":0.79100000000000004}]},{"osd":3,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.74199999999999999,"15min":0.751},"min":{"1min":0.55400000000000005,"5min":0.497,"15min":0.40899999999999997},"max":{"1min":0.90800000000000003,"5min":0.96199999999999997,"15min":1.6399999999999999},"last":1.034},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.752,"15min":0.78900000000000003},"min":{"1min":0.54300000000000004,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":0.90400000000000003,"5min":0.98799999999999999,"15min":2.0219999999999998},"last":0.92500000000000004}]},{"osd":4,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.57999999999999996,"15min":0.65500000000000003},"min":{"1min":0.38300000000000001,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":1.911},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.622,"15min":0.71099999999999997},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.307},"max":{"1min":0.77300000000000002,"5min":0.94599999999999995,"15min":1.7829999999999999},"last":1.0649999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.65100000000000002,"15min":0.76500000000000001},"min":{"1min":0.439,"5min":0.42999999999999999,"15min":0.39600000000000002},"max":{"1min":0.78200000000000003,"5min":0.92800000000000005,"15min":2.1829999999999998},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.64700000000000002,"15min":0.75600000000000001},"min":{"1min":0.45400000000000001,"5min":0.39400000000000002,"15min":0.36499999999999999},"max":{"1min":0.83299999999999996,"5min":0.91100000000000003,"15min":2.1280000000000001},"last":0.90200000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:31:21 2024","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.68799999999999994,"15min":0.78700000000000003},"min":{"1min":0.435,"5min":0.435,"15min":0.38300000000000001},"max":{"1min":0.81599999999999995,"5min":0.98299999999999998,"15min":1.887},"last":1.1319999999999999},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.72599999999999998,"15min":0.82799999999999996},"min":{"1min":0.48199999999999998,"5min":0.48099999999999998,"15min":0.439},"max":{"1min":0.87,"5min":1.0109999999999999,"15min":2.2599999999999998},"last":1.056}]}]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1249280,"data_stored":538136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:31:29 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.67100000000000004,"15min":0.71699999999999997},"min":{"1min":0.496,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.92000000000000004,"5min":1.014,"15min":2.4929999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67000000000000004,"15min":0.76200000000000001},"min":{"1min":0.46100000000000002,"5min":0.435,"15min":0.435},"max":{"1min":0.94799999999999995,"5min":0.94899999999999995,"15min":3.2519999999999998},"last":0.44900000000000001}]},{"osd":1,"last update":"Tue Apr 2 07:31:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.70199999999999996,"15min":0.73599999999999999},"min":{"1min":0.51900000000000002,"5min":0.45600000000000002,"15min":0.44400000000000001},"max":{"1min":0.94499999999999995,"5min":1.042,"15min":1.4279999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.70499999999999996,"15min":0.82499999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94699999999999995,"5min":0.99399999999999999,"15min":4.3810000000000002},"last":0.59899999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:31:29 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.72599999999999998,"15min":0.77100000000000002},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":2.056},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.70899999999999996,"15min":0.81000000000000005},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":1.038,"5min":1.109,"15min":3.3420000000000001},"last":0.69999999999999996}]},{"osd":3,"last update":"Tue Apr 2 07:31:29 2024","interfaces":[{"interface":"back","average":{"1min":0.79800000000000004,"5min":0.752,"15min":0.89500000000000002},"min":{"1min":0.59899999999999998,"5min":0.436,"15min":0.436},"max":{"1min":1.091,"5min":1.091,"15min":3.9180000000000001},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.748,"15min":0.90500000000000003},"min":{"1min":0.55600000000000005,"5min":0.497,"15min":0.497},"max":{"1min":0.99299999999999999,"5min":1.0920000000000001,"15min":3.9750000000000001},"last":0.64100000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:31:29 2024","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.58299999999999996,"15min":0.66300000000000003},"min":{"1min":0.48599999999999999,"5min":0.376,"15min":0.376},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.2509999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.60999999999999999,"15min":0.69499999999999995},"min":{"1min":0.44500000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98199999999999998,"5min":1.0640000000000001,"15min":1.4419999999999999},"last":0.66400000000000003}]},{"osd":6,"last update":"Tue Apr 2 07:31:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.60699999999999998,"15min":0.67500000000000004},"min":{"1min":0.42199999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.92700000000000005,"5min":0.94299999999999995,"15min":1.2949999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69399999999999995,"5min":0.66500000000000004,"15min":0.73399999999999999},"min":{"1min":0.52400000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.3069999999999999},"last":0.64800000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:31:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68899999999999995,"5min":0.68500000000000005,"15min":0.75900000000000001},"min":{"1min":0.51800000000000002,"5min":0.432,"15min":0.432},"max":{"1min":1.034,"5min":1.091,"15min":1.2689999999999999},"last":0.627},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76600000000000001,"15min":0.82899999999999996},"min":{"1min":0.622,"5min":0.53100000000000003,"15min":0.52700000000000002},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.353},"last":0.68600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574964,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32372,"kb_used_data":1248,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339468,"statfs":{"total":96636764160,"available":96603615232,"internally_reserved":0,"allocated":1277952,"data_stored":546497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.32100000000000001,"5min":0.28699999999999998,"15min":0.26300000000000001},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.48599999999999999,"15min":0.48399999999999999},"min":{"1min":0.31,"5min":0.307,"15min":0.28699999999999998},"max":{"1min":0.65800000000000003,"5min":0.81699999999999995,"15min":1.0109999999999999},"last":0.48399999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.42999999999999999,"5min":0.45000000000000001,"15min":0.44500000000000001},"min":{"1min":0.32800000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.60399999999999998,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.497,"5min":0.52000000000000002,"15min":0.51000000000000001},"min":{"1min":0.42799999999999999,"5min":0.36499999999999999,"15min":0.309},"max":{"1min":0.60999999999999999,"5min":0.77500000000000002,"15min":0.79700000000000004},"last":0.53700000000000003}]},{"osd":2,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.54200000000000004,"15min":0.53700000000000003},"min":{"1min":0.378,"5min":0.378,"15min":0.374},"max":{"1min":0.63,"5min":0.754,"15min":0.81599999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57299999999999995,"15min":0.58199999999999996},"min":{"1min":0.47799999999999998,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.751,"5min":0.84399999999999997,"15min":1.306},"last":0.64300000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.71899999999999997,"15min":0.74199999999999999},"min":{"1min":0.52000000000000002,"5min":0.46999999999999997,"15min":0.40500000000000003},"max":{"1min":0.98799999999999999,"5min":1.0600000000000001,"15min":1.1850000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.76100000000000001,"5min":0.74399999999999999,"15min":0.752},"min":{"1min":0.56299999999999994,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":1.04,"5min":1.091,"15min":1.155},"last":0.61599999999999999}]},{"osd":5,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.77300000000000002,"15min":0.77400000000000002},"min":{"1min":0.58499999999999996,"5min":0.501,"15min":0.501},"max":{"1min":1.0189999999999999,"5min":1.077,"15min":1.198},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.755,"15min":0.751},"min":{"1min":0.58099999999999996,"5min":0.49199999999999999,"15min":0.48899999999999999},"max":{"1min":0.95999999999999996,"5min":1.056,"15min":1.135},"last":0.88400000000000001}]},{"osd":6,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.747,"15min":0.76100000000000001},"min":{"1min":0.56999999999999995,"5min":0.48799999999999999,"15min":0.44500000000000001},"max":{"1min":0.94399999999999995,"5min":1.1060000000000001,"15min":1.25},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.752,"5min":0.78000000000000003,"15min":0.78300000000000003},"min":{"1min":0.56200000000000006,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":0.98999999999999999,"5min":1.1379999999999999,"15min":1.2010000000000001},"last":0.65800000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:31:19 2024","interfaces":[{"interface":"back","average":{"1min":0.76500000000000001,"5min":0.754,"15min":0.75800000000000001},"min":{"1min":0.61099999999999999,"5min":0.53300000000000003,"15min":0.53200000000000003},"max":{"1min":0.95799999999999996,"5min":1.0209999999999999,"15min":1.216},"last":0.90900000000000003},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.77700000000000002,"15min":0.78900000000000003},"min":{"1min":0.53500000000000003,"5min":0.53100000000000003,"15min":0.47499999999999998},"max":{"1min":0.97799999999999998,"5min":1.073,"15min":1.2869999999999999},"last":0.75900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574964,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32340,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339500,"statfs":{"total":96636764160,"available":96603648000,"internally_reserved":0,"allocated":1249280,"data_stored":538136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.44700000000000001,"15min":0.44800000000000001},"min":{"1min":0.31,"5min":0.28000000000000003,"15min":0.253},"max":{"1min":0.72499999999999998,"5min":0.73899999999999999,"15min":0.79100000000000004},"last":0.437},{"interface":"front","average":{"1min":0.5,"5min":0.499,"15min":0.48899999999999999},"min":{"1min":0.34100000000000003,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.65800000000000003,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.47999999999999998}]},{"osd":1,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52100000000000002,"15min":0.53400000000000003},"min":{"1min":0.38500000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68799999999999994,"5min":0.76900000000000002,"15min":1.171},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.499,"15min":0.495},"min":{"1min":0.36699999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":1.333},"last":0.621}]},{"osd":3,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.52500000000000002},"min":{"1min":0.36699999999999999,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.82699999999999996,"5min":0.82699999999999996,"15min":0.86299999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57199999999999995,"15min":0.56899999999999995},"min":{"1min":0.443,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.1140000000000001},"last":0.57699999999999996}]},{"osd":4,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.74399999999999999,"5min":0.76000000000000001,"15min":0.76800000000000002},"min":{"1min":0.56200000000000006,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92300000000000004,"5min":1.115,"15min":2.254},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.72099999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"min":{"1min":0.54500000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93999999999999995,"5min":1.1599999999999999,"15min":1.3420000000000001},"last":0.86899999999999999}]},{"osd":5,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.77200000000000002,"15min":0.76300000000000001},"min":{"1min":0.54100000000000004,"5min":0.52600000000000002,"15min":0.46200000000000002},"max":{"1min":1.075,"5min":1.091,"15min":1.3740000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.75700000000000001,"5min":0.78800000000000003,"15min":0.80300000000000005},"min":{"1min":0.57399999999999995,"5min":0.498,"15min":0.443},"max":{"1min":1.1000000000000001,"5min":1.135,"15min":2.0840000000000001},"last":0.93600000000000005}]},{"osd":6,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.81000000000000005,"15min":0.81999999999999995},"min":{"1min":0.56499999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.97899999999999998,"5min":1.1990000000000001,"15min":1.5029999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.83299999999999996,"15min":0.82899999999999996},"min":{"1min":0.68799999999999994,"5min":0.58399999999999996,"15min":0.52700000000000002},"max":{"1min":1.119,"5min":1.1459999999999999,"15min":1.425},"last":0.91700000000000004}]},{"osd":7,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.80100000000000005,"15min":0.82199999999999995},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.52100000000000002},"max":{"1min":1.0569999999999999,"5min":1.1830000000000001,"15min":2.3580000000000001},"last":0.97199999999999998},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.81200000000000006,"15min":0.82099999999999995},"min":{"1min":0.58899999999999997,"5min":0.54400000000000004,"15min":0.54300000000000004},"max":{"1min":1.006,"5min":1.0900000000000001,"15min":1.377},"last":0.95299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32356,"kb_used_data":1232,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339484,"statfs":{"total":96636764160,"available":96603631616,"internally_reserved":0,"allocated":1261568,"data_stored":544911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.438,"15min":0.46500000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.71299999999999997,"5min":0.78600000000000003,"15min":1.2150000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.47999999999999998,"15min":0.58199999999999996},"min":{"1min":0.30099999999999999,"5min":0.27500000000000002,"15min":0.26200000000000001},"max":{"1min":0.69699999999999995,"5min":0.73899999999999999,"15min":4.157},"last":0.48599999999999999}]},{"osd":2,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.46400000000000002,"15min":0.58299999999999996},"min":{"1min":0.32400000000000001,"5min":0.28999999999999998,"15min":0.28999999999999998},"max":{"1min":0.63600000000000001,"5min":0.69799999999999995,"15min":4.282},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.52300000000000002,"15min":0.57299999999999995},"min":{"1min":0.38,"5min":0.34399999999999997,"15min":0.33600000000000002},"max":{"1min":0.72799999999999998,"5min":0.81000000000000005,"15min":1.625},"last":0.42699999999999999}]},{"osd":3,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.58799999999999997,"15min":0.60399999999999998},"min":{"1min":0.41399999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.75900000000000001,"5min":0.88800000000000001,"15min":1.1120000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.76100000000000001},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.76600000000000001,"5min":0.80600000000000005,"15min":8.1620000000000008},"last":0.55800000000000005}]},{"osd":4,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.71199999999999997,"15min":0.86599999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.081,"5min":1.081,"15min":4.7400000000000002},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76900000000000002,"15min":0.80300000000000005},"min":{"1min":0.54000000000000004,"5min":0.53700000000000003,"15min":0.50600000000000001},"max":{"1min":0.95299999999999996,"5min":1.125,"15min":1.7070000000000001},"last":0.67400000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.75800000000000001,"15min":0.874},"min":{"1min":0.45600000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.113,"5min":1.113,"15min":4.5759999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.751,"15min":0.874},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.103,"5min":1.103,"15min":4.7949999999999999},"last":0.63900000000000001}]},{"osd":6,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.76600000000000001,"15min":0.90500000000000003},"min":{"1min":0.55400000000000005,"5min":0.52800000000000002,"15min":0.47299999999999998},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":4.6890000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.77300000000000002,"5min":0.76800000000000002,"15min":0.89200000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.05,"5min":1.0589999999999999,"15min":4.6059999999999999},"last":0.77100000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:31:27 2024","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.77800000000000002,"15min":0.81399999999999995},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0920000000000001,"5min":1.1200000000000001,"15min":1.8759999999999999},"last":0.75},{"interface":"front","average":{"1min":0.76900000000000002,"5min":0.78700000000000003,"15min":0.90500000000000003},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0629999999999999,"5min":1.157,"15min":4.6420000000000003},"last":0.80000000000000004}]}]},{"osd":0,"up_from":13,"seq":55834574964,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1800,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1843200,"data_stored":1128504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:31:22 2024","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.41899999999999998,"15min":0.45600000000000002},"min":{"1min":0.28899999999999998,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.54900000000000004,"5min":0.62,"15min":1.48},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.48699999999999999,"15min":0.505},"min":{"1min":0.39200000000000002,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.61199999999999999,"5min":0.72199999999999998,"15min":1.2330000000000001},"last":0.44500000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:31:22 2024","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.48099999999999998,"15min":0.51200000000000001},"min":{"1min":0.38400000000000001,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.56499999999999995,"5min":0.747,"15min":1.3129999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53400000000000003,"15min":0.53100000000000003},"min":{"1min":0.41099999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.72899999999999998,"5min":0.75600000000000001,"15min":0.82599999999999996},"last":0.40500000000000003}]},{"osd":3,"last update":"Tue Apr 2 07:31:22 2024","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.45500000000000002,"15min":0.46700000000000003},"min":{"1min":0.33000000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.84799999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56499999999999995,"15min":0.60299999999999998},"min":{"1min":0.441,"5min":0.40799999999999997,"15min":0.40300000000000002},"max":{"1min":0.753,"5min":0.77200000000000002,"15min":1.4430000000000001},"last":0.53100000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:31:22 2024","interfaces":[{"interface":"back","average":{"1min":0.69899999999999995,"5min":0.72999999999999998,"15min":0.73599999999999999},"min":{"1min":0.51400000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.89700000000000002,"5min":1.0209999999999999,"15min":1.0569999999999999},"last":0.505},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72699999999999998,"15min":0.74199999999999999},"min":{"1min":0.54200000000000004,"5min":0.51400000000000001,"15min":0.501},"max":{"1min":0.996,"5min":1.0840000000000001,"15min":1.1240000000000001},"last":0.49199999999999999}]},{"osd":5,"last update":"Tue Apr 2 07:31:22 2024","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.73699999999999999,"15min":0.77400000000000002},"min":{"1min":0.57499999999999996,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.90800000000000003,"5min":1.042,"15min":1.371},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.73399999999999999,"5min":0.73899999999999999,"15min":0.75800000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.90500000000000003,"5min":1.1000000000000001,"15min":1.143},"last":0.56000000000000005}]},{"osd":6,"last update":"Tue Apr 2 07:31:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.76600000000000001,"15min":0.79100000000000004},"min":{"1min":0.58399999999999996,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.038,"5min":1.177,"15min":1.177},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.79100000000000004,"15min":0.82499999999999996},"min":{"1min":0.66600000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97199999999999998,"5min":1.081,"15min":1.4099999999999999},"last":0.80600000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:31:22 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.76300000000000001,"15min":0.78600000000000003},"min":{"1min":0.56100000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.95399999999999996,"5min":1.046,"15min":1.135},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.75600000000000001,"15min":0.78100000000000003},"min":{"1min":0.621,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.92700000000000005,"5min":1.079,"15min":1.141},"last":0.54500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:31:35.205 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-02T07:31:35.205 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-02T07:31:35.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.385+0000 7f02eca00640 1 Processor -- start 2024-04-02T07:31:35.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.385+0000 7f02eca00640 1 -- start start 2024-04-02T07:31:35.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.385+0000 7f02eca00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f02e815cae0 0x7f02e80ce930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:35.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.385+0000 7f02eca00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f02e806a4a0 0x7f02e81610a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:35.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.385+0000 7f02eca00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f02e8160650 con 0x7f02e80cd2a0 2024-04-02T07:31:35.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.385+0000 7f02eca00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e8160c80 con 0x7f02e815cae0 2024-04-02T07:31:35.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.385+0000 7f02eca00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f02e80cef10 con 0x7f02e806a4a0 2024-04-02T07:31:35.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.389+0000 7f02e5e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f02e815cae0 0x7f02e80ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:35.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.389+0000 7f02e5e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f02e815cae0 0x7f02e80ce930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44244/0 (socket says 172.21.15.55:44244) 2024-04-02T07:31:35.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.389+0000 7f02e5e00640 1 -- 172.21.15.55:0/2111453039 learned_addr learned my addr 172.21.15.55:0/2111453039 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:35.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.389+0000 7f02e6800640 1 --2- 172.21.15.55:0/2111453039 >> v2:172.21.15.106:3300/0 conn(0x7f02e806a4a0 0x7f02e81610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:35.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.389+0000 7f02e5e00640 1 -- 172.21.15.55:0/2111453039 >> v2:172.21.15.106:3300/0 conn(0x7f02e806a4a0 msgr2=0x7f02e81610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:35.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.389+0000 7f02e5e00640 1 --2- 172.21.15.55:0/2111453039 >> v2:172.21.15.106:3300/0 conn(0x7f02e806a4a0 0x7f02e81610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.389+0000 7f02e5e00640 1 -- 172.21.15.55:0/2111453039 >> v1:172.21.15.106:6789/0 conn(0x7f02e80cd2a0 legacy=0x7f02e8069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:35.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.389+0000 7f02e5e00640 1 -- 172.21.15.55:0/2111453039 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e80cf1f0 con 0x7f02e815cae0 2024-04-02T07:31:35.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.389+0000 7f02e6800640 1 --2- 172.21.15.55:0/2111453039 >> v2:172.21.15.106:3300/0 conn(0x7f02e806a4a0 0x7f02e81610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:35.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.389+0000 7f02e5e00640 1 --2- 172.21.15.55:0/2111453039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02e815cae0 0x7f02e80ce930 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f02e80c6650 tx=0x7f02d801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4e9f80aa5cf33b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:35.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.389+0000 7f02e5400640 1 -- 172.21.15.55:0/2111453039 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d80ab600 con 0x7f02e815cae0 2024-04-02T07:31:35.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.389+0000 7f02e5400640 1 -- 172.21.15.55:0/2111453039 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02d80a7050 con 0x7f02e815cae0 2024-04-02T07:31:35.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.389+0000 7f02e5400640 1 -- 172.21.15.55:0/2111453039 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02d80ab980 con 0x7f02e815cae0 2024-04-02T07:31:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02eca00640 1 -- 172.21.15.55:0/2111453039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02e815cae0 msgr2=0x7f02e80ce930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02eca00640 1 --2- 172.21.15.55:0/2111453039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02e815cae0 0x7f02e80ce930 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7f02e80c6650 tx=0x7f02d801c3d0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02eca00640 1 -- 172.21.15.55:0/2111453039 shutdown_connections 2024-04-02T07:31:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02eca00640 1 --2- 172.21.15.55:0/2111453039 >> v2:172.21.15.106:3300/0 conn(0x7f02e806a4a0 0x7f02e81610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02eca00640 1 --2- 172.21.15.55:0/2111453039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02e815cae0 0x7f02e80ce930 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02eca00640 1 -- 172.21.15.55:0/2111453039 >> 172.21.15.55:0/2111453039 conn(0x7f02e80717c0 msgr2=0x7f02e8098a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:35.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02eca00640 1 -- 172.21.15.55:0/2111453039 shutdown_connections 2024-04-02T07:31:35.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02eca00640 1 -- 172.21.15.55:0/2111453039 wait complete. 2024-04-02T07:31:35.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02eca00640 1 Processor -- start 2024-04-02T07:31:35.395 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02eca00640 1 -- start start 2024-04-02T07:31:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02eca00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02e806a4a0 0x7f02e80b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02eca00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02e80cd2a0 0x7f02e8152490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02eca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02e815cae0 0x7f02e80c3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02eca00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e81529d0 con 0x7f02e815cae0 2024-04-02T07:31:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02eca00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80c5430 con 0x7f02e806a4a0 2024-04-02T07:31:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02eca00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f02e80c5710 con 0x7f02e80cd2a0 2024-04-02T07:31:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02e6800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02e815cae0 0x7f02e80c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02e6800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02e815cae0 0x7f02e80c3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44250/0 (socket says 172.21.15.55:44250) 2024-04-02T07:31:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02e6800640 1 -- 172.21.15.55:0/547184317 learned_addr learned my addr 172.21.15.55:0/547184317 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02e5e00640 1 --2- 172.21.15.55:0/547184317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02e806a4a0 0x7f02e80b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:35.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02dd400640 1 --2- 172.21.15.55:0/547184317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02e80cd2a0 0x7f02e8152490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02e6800640 1 -- 172.21.15.55:0/547184317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02e80cd2a0 msgr2=0x7f02e8152490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02e6800640 1 --2- 172.21.15.55:0/547184317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02e80cd2a0 0x7f02e8152490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02e6800640 1 -- 172.21.15.55:0/547184317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02e806a4a0 msgr2=0x7f02e80b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02e6800640 1 --2- 172.21.15.55:0/547184317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02e806a4a0 0x7f02e80b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02e6800640 1 -- 172.21.15.55:0/547184317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02d80094d0 con 0x7f02e815cae0 2024-04-02T07:31:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02dd400640 1 --2- 172.21.15.55:0/547184317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02e80cd2a0 0x7f02e8152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.393+0000 7f02e6800640 1 --2- 172.21.15.55:0/547184317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02e815cae0 0x7f02e80c3120 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f02e0007ef0 tx=0x7f02e000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.397+0000 7f02dea00640 1 -- 172.21.15.55:0/547184317 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e0003ba0 con 0x7f02e815cae0 2024-04-02T07:31:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.397+0000 7f02dea00640 1 -- 172.21.15.55:0/547184317 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02e000f040 con 0x7f02e815cae0 2024-04-02T07:31:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.397+0000 7f02dea00640 1 -- 172.21.15.55:0/547184317 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02e000de80 con 0x7f02e815cae0 2024-04-02T07:31:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.397+0000 7f02eca00640 1 -- 172.21.15.55:0/547184317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02e80ca960 con 0x7f02e815cae0 2024-04-02T07:31:35.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.397+0000 7f02eca00640 1 -- 172.21.15.55:0/547184317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02e80c5cd0 con 0x7f02e815cae0 2024-04-02T07:31:35.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.397+0000 7f02eca00640 1 -- 172.21.15.55:0/547184317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02e8066c90 con 0x7f02e815cae0 2024-04-02T07:31:35.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.397+0000 7f02dea00640 1 -- 172.21.15.55:0/547184317 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f02e0004030 con 0x7f02e815cae0 2024-04-02T07:31:35.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.397+0000 7f02dea00640 1 --2- 172.21.15.55:0/547184317 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f02c4066690 0x7f02c4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:35.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.397+0000 7f02dea00640 1 -- 172.21.15.55:0/547184317 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f02e0084470 con 0x7f02e815cae0 2024-04-02T07:31:35.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.397+0000 7f02e5e00640 1 --2- 172.21.15.55:0/547184317 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f02c4066690 0x7f02c4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:35.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.397+0000 7f02e5e00640 1 --2- 172.21.15.55:0/547184317 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f02c4066690 0x7f02c4068b50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f02d80ad000 tx=0x7f02d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:35.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.401+0000 7f02dea00640 1 -- 172.21.15.55:0/547184317 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f02e00517f0 con 0x7f02e815cae0 2024-04-02T07:31:35.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.617+0000 7f02eca00640 1 -- 172.21.15.55:0/547184317 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f02e804e560 con 0x7f02e815cae0 2024-04-02T07:31:35.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.625+0000 7f02dea00640 1 -- 172.21.15.55:0/547184317 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f02e0054e10 con 0x7f02e815cae0 2024-04-02T07:31:35.625 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2024-04-02T07:31:35.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.625+0000 7f02eca00640 1 -- 172.21.15.55:0/547184317 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f02c4066690 msgr2=0x7f02c4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:35.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.625+0000 7f02eca00640 1 --2- 172.21.15.55:0/547184317 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f02c4066690 0x7f02c4068b50 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f02d80ad000 tx=0x7f02d8008040 comp rx=0 tx=0).stop 2024-04-02T07:31:35.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.625+0000 7f02eca00640 1 -- 172.21.15.55:0/547184317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02e815cae0 msgr2=0x7f02e80c3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:35.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.625+0000 7f02eca00640 1 --2- 172.21.15.55:0/547184317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02e815cae0 0x7f02e80c3120 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f02e0007ef0 tx=0x7f02e000d4a0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.625+0000 7f02eca00640 1 -- 172.21.15.55:0/547184317 shutdown_connections 2024-04-02T07:31:35.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.625+0000 7f02eca00640 1 --2- 172.21.15.55:0/547184317 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f02e815cae0 0x7f02e80c3120 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.625+0000 7f02eca00640 1 --2- 172.21.15.55:0/547184317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f02e80cd2a0 0x7f02e8152490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.625+0000 7f02eca00640 1 --2- 172.21.15.55:0/547184317 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f02c4066690 0x7f02c4068b50 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.625+0000 7f02eca00640 1 --2- 172.21.15.55:0/547184317 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f02e806a4a0 0x7f02e80b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.625+0000 7f02eca00640 1 -- 172.21.15.55:0/547184317 >> 172.21.15.55:0/547184317 conn(0x7f02e80717c0 msgr2=0x7f02e80b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:35.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.625+0000 7f02eca00640 1 -- 172.21.15.55:0/547184317 shutdown_connections 2024-04-02T07:31:35.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.625+0000 7f02eca00640 1 -- 172.21.15.55:0/547184317 wait complete. 2024-04-02T07:31:35.646 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:31:35.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.785+0000 7f375ba00640 1 Processor -- start 2024-04-02T07:31:35.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.785+0000 7f375ba00640 1 -- start start 2024-04-02T07:31:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.789+0000 7f375ba00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3754153ea0 0x7f37540c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.789+0000 7f375ba00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3754159be0 0x7f37540b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.789+0000 7f375ba00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375413d0c0 con 0x7f375415a040 2024-04-02T07:31:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.789+0000 7f375ba00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375415a4f0 con 0x7f3754153ea0 2024-04-02T07:31:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.789+0000 7f375ba00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375415a7d0 con 0x7f3754159be0 2024-04-02T07:31:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.789+0000 7f3759000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3754153ea0 0x7f37540c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.789+0000 7f3759000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3754153ea0 0x7f37540c4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47546/0 (socket says 172.21.15.55:47546) 2024-04-02T07:31:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.789+0000 7f3759a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f375415a040 0x7f375413ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36090/0 (socket says 172.21.15.55:36090) 2024-04-02T07:31:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.789+0000 7f3759000640 1 -- 172.21.15.55:0/1929425589 learned_addr learned my addr 172.21.15.55:0/1929425589 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.789+0000 7f374be00640 1 --2- 172.21.15.55:0/1929425589 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3754159be0 0x7f37540b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.789+0000 7f3759000640 1 -- 172.21.15.55:0/1929425589 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3754159be0 msgr2=0x7f37540b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.789+0000 7f3759000640 1 --2- 172.21.15.55:0/1929425589 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3754159be0 0x7f37540b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.789+0000 7f3759000640 1 -- 172.21.15.55:0/1929425589 >> v1:172.21.15.55:6789/0 conn(0x7f375415a040 legacy=0x7f375413ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:35.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.789+0000 7f3759000640 1 -- 172.21.15.55:0/1929425589 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375415aab0 con 0x7f3754153ea0 2024-04-02T07:31:35.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.789+0000 7f3753e00640 1 -- 172.21.15.55:0/1929425589 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 242811115 0 0) 0x7f375413d0c0 con 0x7f375415a040 2024-04-02T07:31:35.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.793+0000 7f3759000640 1 --2- 172.21.15.55:0/1929425589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3754153ea0 0x7f37540c4120 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f374400bb10 tx=0x7f374401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403384866bb6292f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:35.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.793+0000 7f3753e00640 1 -- 172.21.15.55:0/1929425589 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37440a7d20 con 0x7f3754153ea0 2024-04-02T07:31:35.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.793+0000 7f3753e00640 1 -- 172.21.15.55:0/1929425589 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37440a7e80 con 0x7f3754153ea0 2024-04-02T07:31:35.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.793+0000 7f3753e00640 1 -- 172.21.15.55:0/1929425589 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37440af660 con 0x7f3754153ea0 2024-04-02T07:31:35.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.793+0000 7f375ba00640 1 -- 172.21.15.55:0/1929425589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3754153ea0 msgr2=0x7f37540c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:35.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.793+0000 7f375ba00640 1 --2- 172.21.15.55:0/1929425589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3754153ea0 0x7f37540c4120 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f374400bb10 tx=0x7f374401ec30 comp rx=0 tx=0).stop 2024-04-02T07:31:35.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.793+0000 7f375ba00640 1 -- 172.21.15.55:0/1929425589 shutdown_connections 2024-04-02T07:31:35.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.793+0000 7f375ba00640 1 --2- 172.21.15.55:0/1929425589 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3754159be0 0x7f37540b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.793+0000 7f375ba00640 1 --2- 172.21.15.55:0/1929425589 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3754153ea0 0x7f37540c4120 unknown :-1 s=CLOSED pgs=1461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.793+0000 7f375ba00640 1 -- 172.21.15.55:0/1929425589 >> 172.21.15.55:0/1929425589 conn(0x7f3754066080 msgr2=0x7f3754069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:35.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.793+0000 7f375ba00640 1 -- 172.21.15.55:0/1929425589 shutdown_connections 2024-04-02T07:31:35.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.793+0000 7f375ba00640 1 -- 172.21.15.55:0/1929425589 wait complete. 2024-04-02T07:31:35.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.793+0000 7f375ba00640 1 Processor -- start 2024-04-02T07:31:35.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.793+0000 7f375ba00640 1 -- start start 2024-04-02T07:31:35.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.793+0000 7f375ba00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3754153ea0 0x7f37541518e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:35.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f375ba00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3754159be0 0x7f375406c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:35.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f375ba00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f375415a040 0x7f375406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:35.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f375ba00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37540cb440 con 0x7f3754159be0 2024-04-02T07:31:35.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f375ba00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37541f5990 con 0x7f375415a040 2024-04-02T07:31:35.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f375ba00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3754152110 con 0x7f3754153ea0 2024-04-02T07:31:35.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f374be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3754159be0 0x7f375406c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:35.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f374be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3754159be0 0x7f375406c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47560/0 (socket says 172.21.15.55:47560) 2024-04-02T07:31:35.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f374be00640 1 -- 172.21.15.55:0/2254128005 learned_addr learned my addr 172.21.15.55:0/2254128005 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:35.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f3759000640 1 --2- 172.21.15.55:0/2254128005 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3754153ea0 0x7f37541518e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:35.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f3759a00640 1 --2- 172.21.15.55:0/2254128005 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f375415a040 0x7f375406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:35.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f374be00640 1 -- 172.21.15.55:0/2254128005 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3754153ea0 msgr2=0x7f37541518e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:35.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f374be00640 1 --2- 172.21.15.55:0/2254128005 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3754153ea0 0x7f37541518e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f374be00640 1 -- 172.21.15.55:0/2254128005 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f375415a040 msgr2=0x7f375406c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f374be00640 1 --2- 172.21.15.55:0/2254128005 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f375415a040 0x7f375406c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f374be00640 1 -- 172.21.15.55:0/2254128005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374400b770 con 0x7f3754159be0 2024-04-02T07:31:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f374be00640 1 --2- 172.21.15.55:0/2254128005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3754159be0 0x7f375406c400 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f373c00d800 tx=0x7f373c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f3751600640 1 -- 172.21.15.55:0/2254128005 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c00b6c0 con 0x7f3754159be0 2024-04-02T07:31:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f3751600640 1 -- 172.21.15.55:0/2254128005 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373c00b820 con 0x7f3754159be0 2024-04-02T07:31:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f3751600640 1 -- 172.21.15.55:0/2254128005 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373c00bb90 con 0x7f3754159be0 2024-04-02T07:31:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f375ba00640 1 -- 172.21.15.55:0/2254128005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37541523f0 con 0x7f3754159be0 2024-04-02T07:31:35.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f375ba00640 1 -- 172.21.15.55:0/2254128005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37541529b0 con 0x7f3754159be0 2024-04-02T07:31:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f375ba00640 1 -- 172.21.15.55:0/2254128005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3754066c90 con 0x7f3754159be0 2024-04-02T07:31:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f3751600640 1 -- 172.21.15.55:0/2254128005 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f373c00bcf0 con 0x7f3754159be0 2024-04-02T07:31:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.797+0000 7f3751600640 1 --2- 172.21.15.55:0/2254128005 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3730066690 0x7f3730068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.801+0000 7f3751600640 1 -- 172.21.15.55:0/2254128005 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f373c084690 con 0x7f3754159be0 2024-04-02T07:31:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.801+0000 7f3759000640 1 --2- 172.21.15.55:0/2254128005 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3730066690 0x7f3730068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:35.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.801+0000 7f3759000640 1 --2- 172.21.15.55:0/2254128005 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3730066690 0x7f3730068b50 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f37440b1000 tx=0x7f37440a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:35.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.805+0000 7f3751600640 1 -- 172.21.15.55:0/2254128005 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f373c051a00 con 0x7f3754159be0 2024-04-02T07:31:36.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:35.997+0000 7f375ba00640 1 -- 172.21.15.55:0/2254128005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3754163ff0 con 0x7f3754159be0 2024-04-02T07:31:36.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.001+0000 7f3751600640 1 -- 172.21.15.55:0/2254128005 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f373c055020 con 0x7f3754159be0 2024-04-02T07:31:36.001 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:36.001 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":81,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2707651793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2707651793},{"type":"v1","addr":"172.21.15.106:6836","nonce":2707651793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2234384639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2234384639},{"type":"v1","addr":"172.21.15.106:6837","nonce":2234384639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":8433,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53259218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53259218},{"type":"v1","addr":"172.21.15.55:6833","nonce":53259218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:31:30.704183+0000","modified":"2024-04-02T07:31:33.715450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8436":{"gid":8436,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1089546237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1089546237},{"type":"v1","addr":"172.21.15.55:6835","nonce":1089546237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-02T07:31:36.002 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 81 2024-04-02T07:31:36.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.001+0000 7f375ba00640 1 -- 172.21.15.55:0/2254128005 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3730066690 msgr2=0x7f3730068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:36.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.001+0000 7f375ba00640 1 --2- 172.21.15.55:0/2254128005 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3730066690 0x7f3730068b50 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f37440b1000 tx=0x7f37440a9070 comp rx=0 tx=0).stop 2024-04-02T07:31:36.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.001+0000 7f375ba00640 1 -- 172.21.15.55:0/2254128005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3754159be0 msgr2=0x7f375406c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:36.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.001+0000 7f375ba00640 1 --2- 172.21.15.55:0/2254128005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3754159be0 0x7f375406c400 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f373c00d800 tx=0x7f373c00dcc0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.001+0000 7f375ba00640 1 -- 172.21.15.55:0/2254128005 shutdown_connections 2024-04-02T07:31:36.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.001+0000 7f375ba00640 1 --2- 172.21.15.55:0/2254128005 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3730066690 0x7f3730068b50 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.001+0000 7f375ba00640 1 --2- 172.21.15.55:0/2254128005 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f375415a040 0x7f375406c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.001+0000 7f375ba00640 1 --2- 172.21.15.55:0/2254128005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3754159be0 0x7f375406c400 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.001+0000 7f375ba00640 1 --2- 172.21.15.55:0/2254128005 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3754153ea0 0x7f37541518e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.001+0000 7f375ba00640 1 -- 172.21.15.55:0/2254128005 >> 172.21.15.55:0/2254128005 conn(0x7f3754066080 msgr2=0x7f375413b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:36.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.001+0000 7f375ba00640 1 -- 172.21.15.55:0/2254128005 shutdown_connections 2024-04-02T07:31:36.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.001+0000 7f375ba00640 1 -- 172.21.15.55:0/2254128005 wait complete. 2024-04-02T07:31:36.425 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 81, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:31:30.704183+0000', 'modified': '2024-04-02T07:31:33.715450+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8436}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8436': {'gid': 8436, 'name': 'a', 'rank': 0, 'incarnation': 77, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.55:6835/1089546237', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6834', 'nonce': 1089546237}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 1089546237}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:31:36.425 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-02T07:31:36.425 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-02T07:31:36.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.569+0000 7fba03600640 1 Processor -- start 2024-04-02T07:31:36.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.569+0000 7fba03600640 1 -- start start 2024-04-02T07:31:36.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.569+0000 7fba03600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb9fc0cad50 0x7fb9fc0b0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.569+0000 7fba03600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb9fc0cd690 0x7fb9fc0b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.569+0000 7fba03600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9fc0cea70 con 0x7fb9fc15cb20 2024-04-02T07:31:36.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.569+0000 7fba03600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9fc0b13a0 con 0x7fb9fc0cd690 2024-04-02T07:31:36.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.569+0000 7fba03600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9fc0b1680 con 0x7fb9fc0cad50 2024-04-02T07:31:36.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.569+0000 7fba01600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb9fc0cd690 0x7fb9fc0b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.569+0000 7fba01600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb9fc0cd690 0x7fb9fc0b0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47566/0 (socket says 172.21.15.55:47566) 2024-04-02T07:31:36.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.569+0000 7fba01600640 1 -- 172.21.15.55:0/1846668532 learned_addr learned my addr 172.21.15.55:0/1846668532 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:36.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.569+0000 7fba00c00640 1 --1- 172.21.15.55:0/1846668532 >> v1:172.21.15.55:6789/0 conn(0x7fb9fc15cb20 0x7fb9fc0ccf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36096/0 (socket says 172.21.15.55:36096) 2024-04-02T07:31:36.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.569+0000 7fb9f3e00640 1 --2- 172.21.15.55:0/1846668532 >> v2:172.21.15.106:3300/0 conn(0x7fb9fc0cad50 0x7fb9fc0b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.569+0000 7fba01600640 1 -- 172.21.15.55:0/1846668532 >> v2:172.21.15.106:3300/0 conn(0x7fb9fc0cad50 msgr2=0x7fb9fc0b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:36.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.569+0000 7fba01600640 1 --2- 172.21.15.55:0/1846668532 >> v2:172.21.15.106:3300/0 conn(0x7fb9fc0cad50 0x7fb9fc0b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.569+0000 7fba01600640 1 -- 172.21.15.55:0/1846668532 >> v1:172.21.15.55:6789/0 conn(0x7fb9fc15cb20 legacy=0x7fb9fc0ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:36.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.569+0000 7fba01600640 1 -- 172.21.15.55:0/1846668532 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc0cecf0 con 0x7fb9fc0cd690 2024-04-02T07:31:36.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.569+0000 7fb9fbe00640 1 -- 172.21.15.55:0/1846668532 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541690954 0 0) 0x7fb9fc0cea70 con 0x7fb9fc15cb20 2024-04-02T07:31:36.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.573+0000 7fba01600640 1 --2- 172.21.15.55:0/1846668532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9fc0cd690 0x7fb9fc0b0b60 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0b3290 tx=0x7fb9f401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2903f75ce2f32ff server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:36.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.573+0000 7fb9fbe00640 1 -- 172.21.15.55:0/1846668532 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f40a58a0 con 0x7fb9fc0cd690 2024-04-02T07:31:36.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.573+0000 7fb9fbe00640 1 -- 172.21.15.55:0/1846668532 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f40a5a00 con 0x7fb9fc0cd690 2024-04-02T07:31:36.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.573+0000 7fb9fbe00640 1 -- 172.21.15.55:0/1846668532 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f40a5d90 con 0x7fb9fc0cd690 2024-04-02T07:31:36.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.573+0000 7fba03600640 1 -- 172.21.15.55:0/1846668532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9fc0cd690 msgr2=0x7fb9fc0b0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:36.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.573+0000 7fba03600640 1 --2- 172.21.15.55:0/1846668532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9fc0cd690 0x7fb9fc0b0b60 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0b3290 tx=0x7fb9f401c9c0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.573+0000 7fba03600640 1 -- 172.21.15.55:0/1846668532 shutdown_connections 2024-04-02T07:31:36.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.573+0000 7fba03600640 1 --2- 172.21.15.55:0/1846668532 >> v2:172.21.15.106:3300/0 conn(0x7fb9fc0cad50 0x7fb9fc0b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.573+0000 7fba03600640 1 --2- 172.21.15.55:0/1846668532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9fc0cd690 0x7fb9fc0b0b60 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.573+0000 7fba03600640 1 -- 172.21.15.55:0/1846668532 >> 172.21.15.55:0/1846668532 conn(0x7fb9fc0d0700 msgr2=0x7fb9fc0d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:36.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.573+0000 7fba03600640 1 -- 172.21.15.55:0/1846668532 shutdown_connections 2024-04-02T07:31:36.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.573+0000 7fba03600640 1 -- 172.21.15.55:0/1846668532 wait complete. 2024-04-02T07:31:36.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fba03600640 1 Processor -- start 2024-04-02T07:31:36.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fba03600640 1 -- start start 2024-04-02T07:31:36.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fba03600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9fc0cad50 0x7fb9fc0c58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fba03600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9fc0cd690 0x7fb9fc15da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fba03600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9fc15cb20 0x7fb9fc156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fba03600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc15d600 con 0x7fb9fc0cd690 2024-04-02T07:31:36.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fba03600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc0c6100 con 0x7fb9fc0cad50 2024-04-02T07:31:36.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fba03600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9fc0c63e0 con 0x7fb9fc15cb20 2024-04-02T07:31:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fb9f3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9fc0cd690 0x7fb9fc15da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fb9f3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9fc0cd690 0x7fb9fc15da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47570/0 (socket says 172.21.15.55:47570) 2024-04-02T07:31:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fb9f3e00640 1 -- 172.21.15.55:0/1664749078 learned_addr learned my addr 172.21.15.55:0/1664749078 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fba00c00640 1 --2- 172.21.15.55:0/1664749078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9fc0cad50 0x7fb9fc0c58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fba01600640 1 --2- 172.21.15.55:0/1664749078 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9fc15cb20 0x7fb9fc156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fb9f3e00640 1 -- 172.21.15.55:0/1664749078 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9fc15cb20 msgr2=0x7fb9fc156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fb9f3e00640 1 --2- 172.21.15.55:0/1664749078 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9fc15cb20 0x7fb9fc156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fb9f3e00640 1 -- 172.21.15.55:0/1664749078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9fc0cad50 msgr2=0x7fb9fc0c58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fb9f3e00640 1 --2- 172.21.15.55:0/1664749078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9fc0cad50 0x7fb9fc0c58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fb9f3e00640 1 -- 172.21.15.55:0/1664749078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9f4009b30 con 0x7fb9fc0cd690 2024-04-02T07:31:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fba01600640 1 --2- 172.21.15.55:0/1664749078 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9fc15cb20 0x7fb9fc156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fb9f3e00640 1 --2- 172.21.15.55:0/1664749078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9fc0cd690 0x7fb9fc15da20 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400d800 tx=0x7fb9e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:36.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fb9f9600640 1 -- 172.21.15.55:0/1664749078 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e400b6c0 con 0x7fb9fc0cd690 2024-04-02T07:31:36.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fb9f9600640 1 -- 172.21.15.55:0/1664749078 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9e400b820 con 0x7fb9fc0cd690 2024-04-02T07:31:36.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fb9f9600640 1 -- 172.21.15.55:0/1664749078 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e400bb90 con 0x7fb9fc0cd690 2024-04-02T07:31:36.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fba03600640 1 -- 172.21.15.55:0/1664749078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9fc15d220 con 0x7fb9fc0cd690 2024-04-02T07:31:36.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.577+0000 7fba03600640 1 -- 172.21.15.55:0/1664749078 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9fc0c66c0 con 0x7fb9fc0cd690 2024-04-02T07:31:36.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.581+0000 7fb9f9600640 1 -- 172.21.15.55:0/1664749078 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb9e400bcf0 con 0x7fb9fc0cd690 2024-04-02T07:31:36.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.581+0000 7fb9f9600640 1 --2- 172.21.15.55:0/1664749078 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb9d80666c0 0x7fb9d8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.581+0000 7fb9f9600640 1 -- 172.21.15.55:0/1664749078 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9e4084670 con 0x7fb9fc0cd690 2024-04-02T07:31:36.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.581+0000 7fba00c00640 1 --2- 172.21.15.55:0/1664749078 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb9d80666c0 0x7fb9d8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.581+0000 7fba069ac000 1 Processor -- start 2024-04-02T07:31:36.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.581+0000 7fba069ac000 1 -- start start 2024-04-02T07:31:36.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.581+0000 7fba00c00640 1 --2- 172.21.15.55:0/1664749078 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb9d80666c0 0x7fb9d8068b80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec000f70 tx=0x7fb9ec007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba069ac000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 0x55d85db73190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba069ac000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d85db736d0 0x55d85db28f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba069ac000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 0x55d85db298a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba069ac000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85d9f15a0 con 0x55d85db294c0 2024-04-02T07:31:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba069ac000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85d97eaf0 con 0x55d85db72db0 2024-04-02T07:31:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba069ac000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d85d97c0c0 con 0x55d85db736d0 2024-04-02T07:31:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba01600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 0x55d85db298a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba01600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 0x55d85db298a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47582/0 (socket says 172.21.15.55:47582) 2024-04-02T07:31:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba01600640 1 -- 172.21.15.55:0/4269883213 learned_addr learned my addr 172.21.15.55:0/4269883213 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba00c00640 1 --2- 172.21.15.55:0/4269883213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 0x55d85db73190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fb9f3e00640 1 --2- 172.21.15.55:0/4269883213 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d85db736d0 0x55d85db28f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba01600640 1 -- 172.21.15.55:0/4269883213 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d85db736d0 msgr2=0x55d85db28f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba01600640 1 --2- 172.21.15.55:0/4269883213 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d85db736d0 0x55d85db28f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba01600640 1 -- 172.21.15.55:0/4269883213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 msgr2=0x55d85db73190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba01600640 1 --2- 172.21.15.55:0/4269883213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 0x55d85db73190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba01600640 1 -- 172.21.15.55:0/4269883213 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d85d673890 con 0x55d85db294c0 2024-04-02T07:31:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba00c00640 1 --2- 172.21.15.55:0/4269883213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 0x55d85db73190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:31:36.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba01600640 1 --2- 172.21.15.55:0/4269883213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 0x55d85db298a0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fb9f401a5f0 tx=0x7fb9f4004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=522fa170a16296eb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fb9f1600640 1 -- 172.21.15.55:0/4269883213 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f40a5b70 con 0x55d85db294c0 2024-04-02T07:31:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fb9f1600640 1 -- 172.21.15.55:0/4269883213 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f40a5cd0 con 0x55d85db294c0 2024-04-02T07:31:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fb9f1600640 1 -- 172.21.15.55:0/4269883213 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f40b6620 con 0x55d85db294c0 2024-04-02T07:31:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba069ac000 1 -- 172.21.15.55:0/4269883213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 msgr2=0x55d85db298a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba069ac000 1 --2- 172.21.15.55:0/4269883213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 0x55d85db298a0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fb9f401a5f0 tx=0x7fb9f4004ac0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba069ac000 1 -- 172.21.15.55:0/4269883213 shutdown_connections 2024-04-02T07:31:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba069ac000 1 --2- 172.21.15.55:0/4269883213 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 0x55d85db298a0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba069ac000 1 --2- 172.21.15.55:0/4269883213 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d85db736d0 0x55d85db28f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba069ac000 1 --2- 172.21.15.55:0/4269883213 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 0x55d85db73190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba069ac000 1 -- 172.21.15.55:0/4269883213 >> 172.21.15.55:0/4269883213 conn(0x55d85db2f830 msgr2=0x55d85db27860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba069ac000 1 -- 172.21.15.55:0/4269883213 shutdown_connections 2024-04-02T07:31:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba069ac000 1 -- 172.21.15.55:0/4269883213 wait complete. 2024-04-02T07:31:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba069ac000 1 -- start start 2024-04-02T07:31:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.585+0000 7fba069ac000 1 Processor -- start 2024-04-02T07:31:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba069ac000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 0x55d85db2d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba069ac000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 0x55d85db2d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba069ac000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d85db736d0 0x55d85db2dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba069ac000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85d9779b0 con 0x55d85db294c0 2024-04-02T07:31:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba069ac000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85d916c00 con 0x55d85db72db0 2024-04-02T07:31:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba069ac000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d85d935070 con 0x55d85db736d0 2024-04-02T07:31:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba069ac000 10 client.0 _ll_register_callbacks cb 0x55d85db150e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:31:36.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba00c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 0x55d85db2d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba00c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 0x55d85db2d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47598/0 (socket says 172.21.15.55:47598) 2024-04-02T07:31:36.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba00c00640 1 -- 172.21.15.55:0/3398114021 learned_addr learned my addr 172.21.15.55:0/3398114021 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:36.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fb9f3e00640 1 --2- 172.21.15.55:0/3398114021 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 0x55d85db2d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba01600640 1 --2- 172.21.15.55:0/3398114021 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d85db736d0 0x55d85db2dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba00c00640 1 -- 172.21.15.55:0/3398114021 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d85db736d0 msgr2=0x55d85db2dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:36.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba00c00640 1 --2- 172.21.15.55:0/3398114021 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d85db736d0 0x55d85db2dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba00c00640 1 -- 172.21.15.55:0/3398114021 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 msgr2=0x55d85db2d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:36.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba00c00640 1 --2- 172.21.15.55:0/3398114021 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 0x55d85db2d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba00c00640 1 -- 172.21.15.55:0/3398114021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9ec004c80 con 0x55d85db294c0 2024-04-02T07:31:36.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba00c00640 1 --2- 172.21.15.55:0/3398114021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 0x55d85db2d230 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0139a0 tx=0x7fb9ec001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea78a09f814695b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:36.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fb9ea000640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:31:36.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fb9ea000640 1 -- 172.21.15.55:0/3398114021 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec012850 con 0x55d85db294c0 2024-04-02T07:31:36.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fb9ea000640 1 -- 172.21.15.55:0/3398114021 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9ec01b070 con 0x55d85db294c0 2024-04-02T07:31:36.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba069ac000 1 -- 172.21.15.55:0/3398114021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d85d9345f0 con 0x55d85db294c0 2024-04-02T07:31:36.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fb9ea000640 1 -- 172.21.15.55:0/3398114021 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9ec0129b0 con 0x55d85db294c0 2024-04-02T07:31:36.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba069ac000 10 client.8586 fetch_fsmap learned FSMap version 81 2024-04-02T07:31:36.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba069ac000 1 -- 172.21.15.55:0/3398114021 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x7fb9fc0cecf0 con 0x55d85db294c0 2024-04-02T07:31:36.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fb9ea000640 1 -- 172.21.15.55:0/3398114021 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d85d9345f0 con 0x55d85db294c0 2024-04-02T07:31:36.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fb9ea000640 1 -- 172.21.15.55:0/3398114021 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 81) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fb9ec012070 con 0x55d85db294c0 2024-04-02T07:31:36.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba069ac000 10 client.8586 fetch_fsmap finished waiting for FSMap version 81 2024-04-02T07:31:36.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba069ac000 10 client.8586 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:31:36.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba069ac000 20 client.8586 populate_metadata read hostname 'smithi055' 2024-04-02T07:31:36.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba069ac000 1 --2- 172.21.15.55:0/3398114021 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x55d85db81e40 0x55d85db84230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba069ac000 4 client.8586 mds_command: new command op to 8436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:31:36.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fba069ac000 1 -- 172.21.15.55:0/3398114021 --> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d85d974790 con 0x55d85db81e40 2024-04-02T07:31:36.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fb9f3e00640 1 --2- 172.21.15.55:0/3398114021 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x55d85db81e40 0x55d85db84230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fb9f3e00640 1 --2- 172.21.15.55:0/3398114021 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x55d85db81e40 0x55d85db84230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ecff9ff050c01242 server_cookie=c2e1699f2e383d59 in_seq=0 out_seq=0 2024-04-02T07:31:36.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.589+0000 7fb9ea000640 10 client.8586 ms_handle_connect on v2:172.21.15.55:6834/1089546237 2024-04-02T07:31:36.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.593+0000 7fb9ea000640 1 -- 172.21.15.55:0/3398114021 <== mds.0 v2:172.21.15.55:6834/1089546237 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55d85d974790 con 0x55d85db81e40 2024-04-02T07:31:36.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.593+0000 7fb9ea000640 10 client.8586 handle_command_reply: tid=0 2024-04-02T07:31:36.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.593+0000 7fba069ac000 1 client.8586 shutdown 2024-04-02T07:31:36.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.593+0000 7fba069ac000 1 -- 172.21.15.55:0/3398114021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 msgr2=0x55d85db2d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:36.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.593+0000 7fba069ac000 1 --2- 172.21.15.55:0/3398114021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 0x55d85db2d230 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec0139a0 tx=0x7fb9ec001090 comp rx=0 tx=0).stop 2024-04-02T07:31:36.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.593+0000 7fba069ac000 1 -- 172.21.15.55:0/3398114021 shutdown_connections 2024-04-02T07:31:36.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.593+0000 7fba069ac000 1 --2- 172.21.15.55:0/3398114021 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x55d85db81e40 0x55d85db84230 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.593+0000 7fba069ac000 1 --2- 172.21.15.55:0/3398114021 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d85db736d0 0x55d85db2dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.593+0000 7fba069ac000 1 --2- 172.21.15.55:0/3398114021 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 0x55d85db2d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.593+0000 7fba069ac000 1 --2- 172.21.15.55:0/3398114021 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 0x55d85db2d230 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.593+0000 7fb9ea000640 0 client.8586 ms_handle_reset on v2:172.21.15.55:6834/1089546237 2024-04-02T07:31:36.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.593+0000 7fba069ac000 1 -- 172.21.15.55:0/3398114021 >> 172.21.15.55:0/3398114021 conn(0x55d85db2f830 msgr2=0x55d85db27f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:36.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.593+0000 7fba069ac000 1 -- 172.21.15.55:0/3398114021 shutdown_connections 2024-04-02T07:31:36.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.593+0000 7fba069ac000 1 -- 172.21.15.55:0/3398114021 wait complete. 2024-04-02T07:31:36.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.593+0000 7fba069ac000 20 client.8586 trim_cache size 0 max 16384 2024-04-02T07:31:36.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba069ac000 1 Processor -- start 2024-04-02T07:31:36.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba069ac000 1 -- start start 2024-04-02T07:31:36.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba069ac000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d85db294c0 0x55d85dbcc840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba069ac000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 0x55d85dbccd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba069ac000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db736d0 0x55d85dbcd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba069ac000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85d634940 con 0x55d85db736d0 2024-04-02T07:31:36.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba069ac000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85d914c10 con 0x55d85db72db0 2024-04-02T07:31:36.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba069ac000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d85d97fd80 con 0x55d85db294c0 2024-04-02T07:31:36.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba01600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db736d0 0x55d85dbcd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba01600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db736d0 0x55d85dbcd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47612/0 (socket says 172.21.15.55:47612) 2024-04-02T07:31:36.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba01600640 1 -- 172.21.15.55:0/3491595910 learned_addr learned my addr 172.21.15.55:0/3491595910 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:36.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba01600640 1 -- 172.21.15.55:0/3491595910 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d85db294c0 msgr2=0x55d85dbcc840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:36.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba01600640 1 --2- 172.21.15.55:0/3491595910 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d85db294c0 0x55d85dbcc840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba01600640 1 -- 172.21.15.55:0/3491595910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 msgr2=0x55d85dbccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:36.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fb9f3e00640 1 --2- 172.21.15.55:0/3491595910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 0x55d85dbccd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba01600640 1 --2- 172.21.15.55:0/3491595910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 0x55d85dbccd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba01600640 1 -- 172.21.15.55:0/3491595910 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d85d93cab0 con 0x55d85db736d0 2024-04-02T07:31:36.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fb9f3e00640 1 --2- 172.21.15.55:0/3491595910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 0x55d85dbccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:36.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba01600640 1 --2- 172.21.15.55:0/3491595910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db736d0 0x55d85dbcd2c0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4004b00 tx=0x7fb9f40a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9eebb2968e33d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:36.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fb9f2000640 1 -- 172.21.15.55:0/3491595910 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f4007160 con 0x55d85db736d0 2024-04-02T07:31:36.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fb9f2000640 1 -- 172.21.15.55:0/3491595910 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9f4009150 con 0x55d85db736d0 2024-04-02T07:31:36.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fb9f2000640 1 -- 172.21.15.55:0/3491595910 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9f40a5d70 con 0x55d85db736d0 2024-04-02T07:31:36.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba069ac000 1 -- 172.21.15.55:0/3491595910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db736d0 msgr2=0x55d85dbcd2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:36.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba069ac000 1 --2- 172.21.15.55:0/3491595910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db736d0 0x55d85dbcd2c0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7fb9f4004b00 tx=0x7fb9f40a7000 comp rx=0 tx=0).stop 2024-04-02T07:31:36.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba069ac000 1 -- 172.21.15.55:0/3491595910 shutdown_connections 2024-04-02T07:31:36.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba069ac000 1 --2- 172.21.15.55:0/3491595910 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db736d0 0x55d85dbcd2c0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba069ac000 1 --2- 172.21.15.55:0/3491595910 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 0x55d85dbccd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba069ac000 1 --2- 172.21.15.55:0/3491595910 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d85db294c0 0x55d85dbcc840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba069ac000 1 -- 172.21.15.55:0/3491595910 >> 172.21.15.55:0/3491595910 conn(0x55d85db2f830 msgr2=0x55d85db2ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:36.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba069ac000 1 -- 172.21.15.55:0/3491595910 shutdown_connections 2024-04-02T07:31:36.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba069ac000 1 -- 172.21.15.55:0/3491595910 wait complete. 2024-04-02T07:31:36.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba069ac000 1 -- start start 2024-04-02T07:31:36.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.609+0000 7fba069ac000 1 Processor -- start 2024-04-02T07:31:36.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 0x55d85dbcd210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 0x55d85db70400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d85db736d0 0x55d85db70940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85d974db0 con 0x55d85db294c0 2024-04-02T07:31:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d85d97a510 con 0x55d85db72db0 2024-04-02T07:31:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d85d9751c0 con 0x55d85db736d0 2024-04-02T07:31:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 10 client.0 _ll_register_callbacks cb 0x55d85d93c590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:31:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba00c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 0x55d85dbcd210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba00c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 0x55d85dbcd210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47622/0 (socket says 172.21.15.55:47622) 2024-04-02T07:31:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba00c00640 1 -- 172.21.15.55:0/989399593 learned_addr learned my addr 172.21.15.55:0/989399593 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fb9f3e00640 1 --2- 172.21.15.55:0/989399593 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 0x55d85db70400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba01600640 1 --2- 172.21.15.55:0/989399593 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d85db736d0 0x55d85db70940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba00c00640 1 -- 172.21.15.55:0/989399593 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d85db736d0 msgr2=0x55d85db70940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba00c00640 1 --2- 172.21.15.55:0/989399593 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d85db736d0 0x55d85db70940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba00c00640 1 -- 172.21.15.55:0/989399593 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 msgr2=0x55d85db70400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba00c00640 1 --2- 172.21.15.55:0/989399593 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 0x55d85db70400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba00c00640 1 -- 172.21.15.55:0/989399593 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d85d673890 con 0x55d85db294c0 2024-04-02T07:31:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba01600640 1 --2- 172.21.15.55:0/989399593 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d85db736d0 0x55d85db70940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba00c00640 1 --2- 172.21.15.55:0/989399593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 0x55d85dbcd210 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec004e90 tx=0x7fb9ec013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83cada7fe674ba15 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fb9ea000640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:31:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fb9ea000640 1 -- 172.21.15.55:0/989399593 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec012b40 con 0x55d85db294c0 2024-04-02T07:31:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fb9ea000640 1 -- 172.21.15.55:0/989399593 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9ec001670 con 0x55d85db294c0 2024-04-02T07:31:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 -- 172.21.15.55:0/989399593 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d85d947460 con 0x55d85db294c0 2024-04-02T07:31:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fb9ea000640 1 -- 172.21.15.55:0/989399593 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb9ec02c460 con 0x55d85db294c0 2024-04-02T07:31:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 10 client.8592 fetch_fsmap learned FSMap version 81 2024-04-02T07:31:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 -- 172.21.15.55:0/989399593 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x55d85d922c00 con 0x55d85db294c0 2024-04-02T07:31:36.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fb9ea000640 1 -- 172.21.15.55:0/989399593 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d85d947460 con 0x55d85db294c0 2024-04-02T07:31:36.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fb9ea000640 1 -- 172.21.15.55:0/989399593 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 81) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fb9ec02c5c0 con 0x55d85db294c0 2024-04-02T07:31:36.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 10 client.8592 fetch_fsmap finished waiting for FSMap version 81 2024-04-02T07:31:36.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 10 client.8592 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:31:36.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 20 client.8592 populate_metadata read hostname 'smithi055' 2024-04-02T07:31:36.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 --2- 172.21.15.55:0/989399593 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x55d85db70e80 0x55d85db71260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 4 client.8592 mds_command: new command op to 8436 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-02T07:31:36.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 -- 172.21.15.55:0/989399593 --> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d85d9409c0 con 0x55d85db70e80 2024-04-02T07:31:36.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fb9f3e00640 1 --2- 172.21.15.55:0/989399593 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x55d85db70e80 0x55d85db71260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fb9f3e00640 1 --2- 172.21.15.55:0/989399593 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x55d85db70e80 0x55d85db71260 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe322f5b28c159d4 server_cookie=fb8970a70a63d96c in_seq=0 out_seq=0 2024-04-02T07:31:36.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fb9ea000640 10 client.8592 ms_handle_connect on v2:172.21.15.55:6834/1089546237 2024-04-02T07:31:36.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fb9ea000640 1 -- 172.21.15.55:0/989399593 <== mds.0 v2:172.21.15.55:6834/1089546237 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55d85d9409c0 con 0x55d85db70e80 2024-04-02T07:31:36.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fb9ea000640 10 client.8592 handle_command_reply: tid=0 2024-04-02T07:31:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 client.8592 shutdown 2024-04-02T07:31:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 -- 172.21.15.55:0/989399593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 msgr2=0x55d85dbcd210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 --2- 172.21.15.55:0/989399593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 0x55d85dbcd210 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec004e90 tx=0x7fb9ec013000 comp rx=0 tx=0).stop 2024-04-02T07:31:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 -- 172.21.15.55:0/989399593 shutdown_connections 2024-04-02T07:31:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 --2- 172.21.15.55:0/989399593 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x55d85db70e80 0x55d85db71260 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 --2- 172.21.15.55:0/989399593 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55d85db736d0 0x55d85db70940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 --2- 172.21.15.55:0/989399593 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55d85db72db0 0x55d85db70400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 --2- 172.21.15.55:0/989399593 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55d85db294c0 0x55d85dbcd210 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 -- 172.21.15.55:0/989399593 >> 172.21.15.55:0/989399593 conn(0x55d85db2f830 msgr2=0x55d85db2d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fb9ea000640 0 client.8592 ms_handle_reset on v2:172.21.15.55:6834/1089546237 2024-04-02T07:31:36.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 -- 172.21.15.55:0/989399593 shutdown_connections 2024-04-02T07:31:36.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 1 -- 172.21.15.55:0/989399593 wait complete. 2024-04-02T07:31:36.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.613+0000 7fba069ac000 20 client.8592 trim_cache size 0 max 16384 2024-04-02T07:31:36.623 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:31:36.623 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "642a0456-a2ac-49a4-91a5-3b3449b512da", 2024-04-02T07:31:36.623 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-02T07:31:36.623 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 8436, 2024-04-02T07:31:36.623 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-02T07:31:36.623 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-02T07:31:36.623 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-02T07:31:36.624 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 5.9121394040000004, 2024-04-02T07:31:36.624 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 81, 2024-04-02T07:31:36.624 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 103, 2024-04-02T07:31:36.624 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 103, 2024-04-02T07:31:36.624 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 10.234683407 2024-04-02T07:31:36.624 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:31:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.617+0000 7fba03600640 1 -- 172.21.15.55:0/1664749078 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb9d80666c0 msgr2=0x7fb9d8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.617+0000 7fba03600640 1 --2- 172.21.15.55:0/1664749078 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb9d80666c0 0x7fb9d8068b80 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec000f70 tx=0x7fb9ec007df0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.617+0000 7fba03600640 1 -- 172.21.15.55:0/1664749078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9fc0cd690 msgr2=0x7fb9fc15da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.617+0000 7fba03600640 1 --2- 172.21.15.55:0/1664749078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9fc0cd690 0x7fb9fc15da20 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7fb9e400d800 tx=0x7fb9e400dcc0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.617+0000 7fba03600640 1 -- 172.21.15.55:0/1664749078 shutdown_connections 2024-04-02T07:31:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.617+0000 7fba03600640 1 --2- 172.21.15.55:0/1664749078 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb9fc15cb20 0x7fb9fc156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.617+0000 7fba03600640 1 --2- 172.21.15.55:0/1664749078 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb9fc0cd690 0x7fb9fc15da20 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.617+0000 7fba03600640 1 --2- 172.21.15.55:0/1664749078 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb9d80666c0 0x7fb9d8068b80 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.617+0000 7fba03600640 1 --2- 172.21.15.55:0/1664749078 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb9fc0cad50 0x7fb9fc0c58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.617+0000 7fba03600640 1 -- 172.21.15.55:0/1664749078 >> 172.21.15.55:0/1664749078 conn(0x7fb9fc0d0700 msgr2=0x7fb9fc099210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:36.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.617+0000 7fba03600640 1 -- 172.21.15.55:0/1664749078 shutdown_connections 2024-04-02T07:31:36.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.617+0000 7fba03600640 1 -- 172.21.15.55:0/1664749078 wait complete. 2024-04-02T07:31:36.636 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-02T07:31:36.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.777+0000 7f2cf3400640 1 Processor -- start 2024-04-02T07:31:36.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.777+0000 7f2cf3400640 1 -- start start 2024-04-02T07:31:36.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.777+0000 7f2cf3400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2cec15aa10 0x7f2cec06d680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.777+0000 7f2cf3400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cec15e5a0 con 0x7f2cec0cdc90 2024-04-02T07:31:36.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.777+0000 7f2cf3400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cec15adf0 con 0x7f2cec06dbc0 2024-04-02T07:31:36.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.777+0000 7f2cf3400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cec0ce170 con 0x7f2cec15aa10 2024-04-02T07:31:36.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.777+0000 7f2cf0a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2cec15aa10 0x7f2cec06d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.777+0000 7f2cf0a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2cec15aa10 0x7f2cec06d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47638/0 (socket says 172.21.15.55:47638) 2024-04-02T07:31:36.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.777+0000 7f2cf0a00640 1 -- 172.21.15.55:0/2321909816 learned_addr learned my addr 172.21.15.55:0/2321909816 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:36.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.777+0000 7f2cf0a00640 1 -- 172.21.15.55:0/2321909816 >> v1:172.21.15.106:6789/0 conn(0x7f2cec06dbc0 legacy=0x7f2cec15ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:36.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.777+0000 7f2cf0a00640 1 -- 172.21.15.55:0/2321909816 >> v1:172.21.15.55:6789/0 conn(0x7f2cec0cdc90 legacy=0x7f2cec070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:36.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.777+0000 7f2cf0a00640 1 -- 172.21.15.55:0/2321909816 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cec0ce450 con 0x7f2cec15aa10 2024-04-02T07:31:36.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.781+0000 7f2cf0a00640 1 --2- 172.21.15.55:0/2321909816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec15aa10 0x7f2cec06d680 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009870 tx=0x7f2cdc01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d6942a05d85c3b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:36.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.781+0000 7f2cebe00640 1 -- 172.21.15.55:0/2321909816 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc0a6040 con 0x7f2cec15aa10 2024-04-02T07:31:36.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.781+0000 7f2cebe00640 1 -- 172.21.15.55:0/2321909816 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc0aa600 con 0x7f2cec15aa10 2024-04-02T07:31:36.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.781+0000 7f2cebe00640 1 -- 172.21.15.55:0/2321909816 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc0aa990 con 0x7f2cec15aa10 2024-04-02T07:31:36.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.781+0000 7f2cf3400640 1 -- 172.21.15.55:0/2321909816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec15aa10 msgr2=0x7f2cec06d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:36.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.781+0000 7f2cf3400640 1 --2- 172.21.15.55:0/2321909816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec15aa10 0x7f2cec06d680 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009870 tx=0x7f2cdc01c4a0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.781+0000 7f2cf3400640 1 -- 172.21.15.55:0/2321909816 shutdown_connections 2024-04-02T07:31:36.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.781+0000 7f2cf3400640 1 --2- 172.21.15.55:0/2321909816 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec15aa10 0x7f2cec06d680 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.781+0000 7f2cf3400640 1 -- 172.21.15.55:0/2321909816 >> 172.21.15.55:0/2321909816 conn(0x7f2cec0ced50 msgr2=0x7f2cec0cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:36.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.781+0000 7f2cf3400640 1 -- 172.21.15.55:0/2321909816 shutdown_connections 2024-04-02T07:31:36.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.781+0000 7f2cf3400640 1 -- 172.21.15.55:0/2321909816 wait complete. 2024-04-02T07:31:36.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf3400640 1 Processor -- start 2024-04-02T07:31:36.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf3400640 1 -- start start 2024-04-02T07:31:36.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf3400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec06dbc0 0x7f2cec147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf3400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cec0cdc90 0x7f2cec15bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf3400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cec15aa10 0x7f2cec0aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf3400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec153570 con 0x7f2cec06dbc0 2024-04-02T07:31:36.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf3400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec1540f0 con 0x7f2cec15aa10 2024-04-02T07:31:36.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf3400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cec1484c0 con 0x7f2cec0cdc90 2024-04-02T07:31:36.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf0a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec06dbc0 0x7f2cec147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf0a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec06dbc0 0x7f2cec147f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47650/0 (socket says 172.21.15.55:47650) 2024-04-02T07:31:36.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf0a00640 1 -- 172.21.15.55:0/180987494 learned_addr learned my addr 172.21.15.55:0/180987494 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:36.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf1400640 1 --2- 172.21.15.55:0/180987494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cec15aa10 0x7f2cec0aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2ce3e00640 1 --2- 172.21.15.55:0/180987494 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cec0cdc90 0x7f2cec15bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf0a00640 1 -- 172.21.15.55:0/180987494 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cec0cdc90 msgr2=0x7f2cec15bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:36.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf0a00640 1 --2- 172.21.15.55:0/180987494 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cec0cdc90 0x7f2cec15bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf0a00640 1 -- 172.21.15.55:0/180987494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cec15aa10 msgr2=0x7f2cec0aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:36.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf0a00640 1 --2- 172.21.15.55:0/180987494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cec15aa10 0x7f2cec0aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf0a00640 1 -- 172.21.15.55:0/180987494 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc0094d0 con 0x7f2cec06dbc0 2024-04-02T07:31:36.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2ce3e00640 1 --2- 172.21.15.55:0/180987494 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cec0cdc90 0x7f2cec15bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:36.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf0a00640 1 --2- 172.21.15.55:0/180987494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec06dbc0 0x7f2cec147f80 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc0190b0 tx=0x7f2cdc01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:36.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2ce9600640 1 -- 172.21.15.55:0/180987494 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc0b3800 con 0x7f2cec06dbc0 2024-04-02T07:31:36.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2ce9600640 1 -- 172.21.15.55:0/180987494 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cdc0b3980 con 0x7f2cec06dbc0 2024-04-02T07:31:36.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf3400640 1 -- 172.21.15.55:0/180987494 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cec1537c0 con 0x7f2cec06dbc0 2024-04-02T07:31:36.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2ce9600640 1 -- 172.21.15.55:0/180987494 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc0b3d30 con 0x7f2cec06dbc0 2024-04-02T07:31:36.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf3400640 1 -- 172.21.15.55:0/180987494 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cec153d80 con 0x7f2cec06dbc0 2024-04-02T07:31:36.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.785+0000 7f2cf3400640 1 -- 172.21.15.55:0/180987494 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cec066c90 con 0x7f2cec06dbc0 2024-04-02T07:31:36.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.789+0000 7f2ce9600640 1 -- 172.21.15.55:0/180987494 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2cdc0bd3f0 con 0x7f2cec06dbc0 2024-04-02T07:31:36.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.789+0000 7f2ce9600640 1 --2- 172.21.15.55:0/180987494 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2cc80666c0 0x7f2cc8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:36.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.789+0000 7f2ce9600640 1 -- 172.21.15.55:0/180987494 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2cdc11e960 con 0x7f2cec06dbc0 2024-04-02T07:31:36.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.789+0000 7f2ce3e00640 1 --2- 172.21.15.55:0/180987494 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2cc80666c0 0x7f2cc8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:36.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.789+0000 7f2ce3e00640 1 --2- 172.21.15.55:0/180987494 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2cc80666c0 0x7f2cc8068b80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2cec15a260 tx=0x7f2cd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:36.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.793+0000 7f2ce9600640 1 -- 172.21.15.55:0/180987494 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2cdc0ebc30 con 0x7f2cec06dbc0 2024-04-02T07:31:36.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.989+0000 7f2cf3400640 1 -- 172.21.15.55:0/180987494 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2cec065ff0 con 0x7f2cec06dbc0 2024-04-02T07:31:36.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.989+0000 7f2ce9600640 1 -- 172.21.15.55:0/180987494 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v81) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2cdc0ef250 con 0x7f2cec06dbc0 2024-04-02T07:31:36.991 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-02T07:31:36.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.989+0000 7f2cf3400640 1 -- 172.21.15.55:0/180987494 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2cc80666c0 msgr2=0x7f2cc8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:36.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.989+0000 7f2cf3400640 1 --2- 172.21.15.55:0/180987494 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2cc80666c0 0x7f2cc8068b80 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f2cec15a260 tx=0x7f2cd4009040 comp rx=0 tx=0).stop 2024-04-02T07:31:36.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.989+0000 7f2cf3400640 1 -- 172.21.15.55:0/180987494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec06dbc0 msgr2=0x7f2cec147f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:36.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.989+0000 7f2cf3400640 1 --2- 172.21.15.55:0/180987494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec06dbc0 0x7f2cec147f80 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc0190b0 tx=0x7f2cdc01ace0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.989+0000 7f2cf3400640 1 -- 172.21.15.55:0/180987494 shutdown_connections 2024-04-02T07:31:36.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.989+0000 7f2cf3400640 1 --2- 172.21.15.55:0/180987494 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2cc80666c0 0x7f2cc8068b80 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.989+0000 7f2cf3400640 1 --2- 172.21.15.55:0/180987494 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2cec15aa10 0x7f2cec0aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.989+0000 7f2cf3400640 1 --2- 172.21.15.55:0/180987494 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2cec0cdc90 0x7f2cec15bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.989+0000 7f2cf3400640 1 --2- 172.21.15.55:0/180987494 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2cec06dbc0 0x7f2cec147f80 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:36.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.989+0000 7f2cf3400640 1 -- 172.21.15.55:0/180987494 >> 172.21.15.55:0/180987494 conn(0x7f2cec0ced50 msgr2=0x7f2cec151a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:36.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.989+0000 7f2cf3400640 1 -- 172.21.15.55:0/180987494 shutdown_connections 2024-04-02T07:31:36.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:36.989+0000 7f2cf3400640 1 -- 172.21.15.55:0/180987494 wait complete. 2024-04-02T07:31:37.011 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-02T07:31:37.011 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-02T07:31:37.011 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-02T07:31:37.011 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-02T07:31:37.011 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-02T07:31:37.011 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-02T07:31:37.011 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-02T07:31:37.011 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-02T07:31:37.011 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:31:37.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:37.012 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-02T07:31:37.021 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:31:37.021 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:31:37.021 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:31:37.021 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:31:37.022 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-02T07:31:37.022 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:31:37.022 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:31:37.022 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:31:37.022 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-02T07:31:37.022 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:31:37.022 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:31:37.022 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-02T07:31:37.022 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-02T07:31:37.022 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:31:37.022 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-02T07:31:37.022 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-02T07:31:37.022 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41897sec preferred_lft 41897sec 2024-04-02T07:31:37.023 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2024-04-02T07:31:37.023 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:31:37.023 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:31:37.023 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:31:37.023 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-02T07:31:37.023 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-02T07:31:37.023 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:81:5a:89:17 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:31:37.023 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-02T07:31:37.023 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:31:37.023 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:31:37.023 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-02T07:31:37.023 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-02T07:31:37.023 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:31:37.023 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-02T07:31:37.023 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:31:37.024 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:31:37.024 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-02T07:31:37.024 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-02T07:31:37.024 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:31:37.024 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:31:37.024 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-02T07:31:37.024 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-02T07:31:37.024 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:31:37.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:37.024 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-02T07:31:37.083 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:31:37.085 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:37.085 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-02T07:31:37.138 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-02T07:31:37.138 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-02T07:31:37.138 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-02T07:31:37.138 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-02T07:31:37.138 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-02T07:31:37.138 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-02T07:31:37.138 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:37.139 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:31:37.139 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:31:37.139 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-02T07:31:37.139 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-02T07:31:37.139 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-02T07:31:37.139 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:31:37.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:37.230 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-02T07:31:37.239 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-02T07:31:37.239 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-02T07:31:37.239 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:31:37.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:37.240 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-02T07:31:37.300 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-02T07:31:37.301 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:31:37.301 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-02T07:31:37.357 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:31:37.357 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:31:37.357 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:31:37.408 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:31:37.473 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:31:37.473 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:31:37.539 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:31:37.540 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:31:37.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:37.541 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:31:37.593 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-02T07:31:37.593 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-02T07:31:37.639 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:31:37.660 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:31:37.660 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:31:37.720 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:31:37.721 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:31:37.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:37.721 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:31:37.735 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:2024-04-02T07:31:37.733+0000 7fc4b5c90580 -1 init, newargv = 0x563551e4b360 newargc=15 2024-04-02T07:31:37.735 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[49409]: starting ceph client 2024-04-02T07:31:37.744 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[49409]: starting fuse 2024-04-02T07:31:38.846 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:31:38.870 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:31:38.870 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:31:38.933 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:31:38.934 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:31:38.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:38.935 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:31:38.985 INFO:teuthology.orchestra.run.smithi055.stdout:43 2024-04-02T07:31:38.985 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-02T07:31:38.986 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:31:38.986 DEBUG:teuthology.orchestra.run.smithi055:> import glob 2024-04-02T07:31:38.986 DEBUG:teuthology.orchestra.run.smithi055:> import re 2024-04-02T07:31:38.986 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:31:38.986 DEBUG:teuthology.orchestra.run.smithi055:> import subprocess 2024-04-02T07:31:38.986 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:31:38.987 DEBUG:teuthology.orchestra.run.smithi055:> def _find_admin_socket(client_name): 2024-04-02T07:31:38.987 DEBUG:teuthology.orchestra.run.smithi055:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-02T07:31:38.987 DEBUG:teuthology.orchestra.run.smithi055:> files = glob.glob(asok_path) 2024-04-02T07:31:38.987 DEBUG:teuthology.orchestra.run.smithi055:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-02T07:31:38.987 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:31:38.987 DEBUG:teuthology.orchestra.run.smithi055:> # Given a non-glob path, it better be there 2024-04-02T07:31:38.987 DEBUG:teuthology.orchestra.run.smithi055:> if "*" not in asok_path: 2024-04-02T07:31:38.987 DEBUG:teuthology.orchestra.run.smithi055:> assert(len(files) == 1) 2024-04-02T07:31:38.987 DEBUG:teuthology.orchestra.run.smithi055:> return files[0] 2024-04-02T07:31:38.987 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:31:38.987 DEBUG:teuthology.orchestra.run.smithi055:> for f in files: 2024-04-02T07:31:38.987 DEBUG:teuthology.orchestra.run.smithi055:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-02T07:31:38.987 DEBUG:teuthology.orchestra.run.smithi055:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-02T07:31:38.988 DEBUG:teuthology.orchestra.run.smithi055:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-02T07:31:38.988 DEBUG:teuthology.orchestra.run.smithi055:> contents = proc_f.read() 2024-04-02T07:31:38.988 DEBUG:teuthology.orchestra.run.smithi055:> if mountpoint in contents: 2024-04-02T07:31:38.988 DEBUG:teuthology.orchestra.run.smithi055:> return f 2024-04-02T07:31:38.988 DEBUG:teuthology.orchestra.run.smithi055:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-02T07:31:38.988 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:31:38.988 DEBUG:teuthology.orchestra.run.smithi055:> print(_find_admin_socket("client.0")) 2024-04-02T07:31:38.988 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:31:39.117 INFO:teuthology.orchestra.run.smithi055.stdout:/var/run/ceph/ceph-client.0.49409.asok 2024-04-02T07:31:39.301 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49409.asok 2024-04-02T07:31:39.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:39.301 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49409.asok status 2024-04-02T07:31:39.488 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:31:39.488 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": { 2024-04-02T07:31:39.488 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_sha1": "d0e392d9aee635f2b65768c460c7a151ead7a5e2", 2024-04-02T07:31:39.488 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)", 2024-04-02T07:31:39.488 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "0", 2024-04-02T07:31:39.488 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2024-04-02T07:31:39.488 INFO:teuthology.orchestra.run.smithi055.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-02T07:31:39.488 INFO:teuthology.orchestra.run.smithi055.stdout: "pid": "49409", 2024-04-02T07:31:39.488 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2024-04-02T07:31:39.489 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:39.489 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_count": 0, 2024-04-02T07:31:39.489 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_pinned_count": 0, 2024-04-02T07:31:39.489 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 8607, 2024-04-02T07:31:39.489 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": { 2024-04-02T07:31:39.489 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2024-04-02T07:31:39.489 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2024-04-02T07:31:39.489 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 8607 2024-04-02T07:31:39.489 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:39.489 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:31:39.489 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:31:39.489 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:31:39.489 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 1872208943 2024-04-02T07:31:39.489 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:39.489 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:39.490 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:31:39.490 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:31:39.490 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:31:39.490 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 1872208943 2024-04-02T07:31:39.490 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:39.490 INFO:teuthology.orchestra.run.smithi055.stdout: "inst_str": "client.8607 192.168.0.1:0/1872208943", 2024-04-02T07:31:39.490 INFO:teuthology.orchestra.run.smithi055.stdout: "addr_str": "192.168.0.1:0/1872208943", 2024-04-02T07:31:39.490 INFO:teuthology.orchestra.run.smithi055.stdout: "inode_count": 1, 2024-04-02T07:31:39.490 INFO:teuthology.orchestra.run.smithi055.stdout: "mds_epoch": 81, 2024-04-02T07:31:39.490 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch": 103, 2024-04-02T07:31:39.490 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch_barrier": 0, 2024-04-02T07:31:39.490 INFO:teuthology.orchestra.run.smithi055.stdout: "blocklisted": false, 2024-04-02T07:31:39.490 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs" 2024-04-02T07:31:39.490 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:31:39.503 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:39.503 DEBUG:teuthology.orchestra.run.smithi055:> stat --file-system '--printf=%T 2024-04-02T07:31:39.503 DEBUG:teuthology.orchestra.run.smithi055:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-02T07:31:39.513 INFO:teuthology.orchestra.run.smithi055.stdout:fuseblk 2024-04-02T07:31:39.513 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-02T07:31:39.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:39.513 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:31:39.581 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:31:39.581 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:31:39.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:39.633 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file1_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-02T07:31:39.765 INFO:teuthology.orchestra.run.smithi055.stderr:6+0 records in 2024-04-02T07:31:39.765 INFO:teuthology.orchestra.run.smithi055.stderr:6+0 records out 2024-04-02T07:31:39.765 INFO:teuthology.orchestra.run.smithi055.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0742524 s, 84.7 MB/s 2024-04-02T07:31:39.766 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:31:39.766 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:31:39.776 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:31:39.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.953+0000 7f3797000640 1 Processor -- start 2024-04-02T07:31:39.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.953+0000 7f3797000640 1 -- start start 2024-04-02T07:31:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.957+0000 7f3797000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3790153ea0 0x7f37900c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.957+0000 7f3797000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3790159be0 0x7f37900b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.957+0000 7f3797000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f379013d0c0 con 0x7f379015a070 2024-04-02T07:31:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.957+0000 7f3797000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379015a4f0 con 0x7f3790159be0 2024-04-02T07:31:39.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.957+0000 7f3797000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f379015a7d0 con 0x7f3790153ea0 2024-04-02T07:31:39.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.957+0000 7f3795000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f379015a070 0x7f379013ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36118/0 (socket says 172.21.15.55:36118) 2024-04-02T07:31:39.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.957+0000 7f3795000640 1 -- 172.21.15.55:0/2072079246 learned_addr learned my addr 172.21.15.55:0/2072079246 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:39.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.957+0000 7f3787400640 1 --2- 172.21.15.55:0/2072079246 >> v2:172.21.15.55:3300/0 conn(0x7f3790159be0 0x7f37900b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:39.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.957+0000 7f378fe00640 1 --2- 172.21.15.55:0/2072079246 >> v2:172.21.15.106:3300/0 conn(0x7f3790153ea0 0x7f37900c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.957+0000 7f3787400640 1 -- 172.21.15.55:0/2072079246 >> v2:172.21.15.106:3300/0 conn(0x7f3790153ea0 msgr2=0x7f37900c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.957+0000 7f3787400640 1 --2- 172.21.15.55:0/2072079246 >> v2:172.21.15.106:3300/0 conn(0x7f3790153ea0 0x7f37900c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.957+0000 7f3787400640 1 -- 172.21.15.55:0/2072079246 >> v1:172.21.15.55:6789/0 conn(0x7f379015a070 legacy=0x7f379013ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.957+0000 7f3787400640 1 -- 172.21.15.55:0/2072079246 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379015aab0 con 0x7f3790159be0 2024-04-02T07:31:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.957+0000 7f378f400640 1 -- 172.21.15.55:0/2072079246 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4076960204 0 0) 0x7f379013d0c0 con 0x7f379015a070 2024-04-02T07:31:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.957+0000 7f378fe00640 1 --2- 172.21.15.55:0/2072079246 >> v2:172.21.15.106:3300/0 conn(0x7f3790153ea0 0x7f37900c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:39.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f3787400640 1 --2- 172.21.15.55:0/2072079246 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3790159be0 0x7f37900b31b0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f379006e720 tx=0x7f377801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cefc3836e5c2407 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:39.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f378f400640 1 -- 172.21.15.55:0/2072079246 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37780a6040 con 0x7f3790159be0 2024-04-02T07:31:39.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f378f400640 1 -- 172.21.15.55:0/2072079246 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37780aa600 con 0x7f3790159be0 2024-04-02T07:31:39.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f378f400640 1 -- 172.21.15.55:0/2072079246 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37780aa990 con 0x7f3790159be0 2024-04-02T07:31:39.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f3797000640 1 -- 172.21.15.55:0/2072079246 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3790159be0 msgr2=0x7f37900b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:39.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f3797000640 1 --2- 172.21.15.55:0/2072079246 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3790159be0 0x7f37900b31b0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f379006e720 tx=0x7f377801c480 comp rx=0 tx=0).stop 2024-04-02T07:31:39.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f3797000640 1 -- 172.21.15.55:0/2072079246 shutdown_connections 2024-04-02T07:31:39.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f3797000640 1 --2- 172.21.15.55:0/2072079246 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3790159be0 0x7f37900b31b0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:39.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f3797000640 1 --2- 172.21.15.55:0/2072079246 >> v2:172.21.15.106:3300/0 conn(0x7f3790153ea0 0x7f37900c4120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:39.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f3797000640 1 -- 172.21.15.55:0/2072079246 >> 172.21.15.55:0/2072079246 conn(0x7f3790066080 msgr2=0x7f3790069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:39.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f3797000640 1 -- 172.21.15.55:0/2072079246 shutdown_connections 2024-04-02T07:31:39.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f3797000640 1 -- 172.21.15.55:0/2072079246 wait complete. 2024-04-02T07:31:39.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f3797000640 1 Processor -- start 2024-04-02T07:31:39.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f3797000640 1 -- start start 2024-04-02T07:31:39.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f3797000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3790153ea0 0x7f3790136140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:39.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f3797000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3790159be0 0x7f379013a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f3797000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f379015a070 0x7f379013a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f3797000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37901410a0 con 0x7f3790153ea0 2024-04-02T07:31:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f3797000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37901f6ad0 con 0x7f3790159be0 2024-04-02T07:31:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f3797000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37901f6db0 con 0x7f379015a070 2024-04-02T07:31:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f378fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3790153ea0 0x7f3790136140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f378fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3790153ea0 0x7f3790136140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47672/0 (socket says 172.21.15.55:47672) 2024-04-02T07:31:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.961+0000 7f378fe00640 1 -- 172.21.15.55:0/1570708825 learned_addr learned my addr 172.21.15.55:0/1570708825 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.965+0000 7f3795000640 1 --2- 172.21.15.55:0/1570708825 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f379015a070 0x7f379013a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.965+0000 7f3787400640 1 --2- 172.21.15.55:0/1570708825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3790159be0 0x7f379013a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.965+0000 7f378fe00640 1 -- 172.21.15.55:0/1570708825 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f379015a070 msgr2=0x7f379013a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.965+0000 7f378fe00640 1 --2- 172.21.15.55:0/1570708825 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f379015a070 0x7f379013a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.965+0000 7f378fe00640 1 -- 172.21.15.55:0/1570708825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3790159be0 msgr2=0x7f379013a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.965+0000 7f378fe00640 1 --2- 172.21.15.55:0/1570708825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3790159be0 0x7f379013a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.965+0000 7f378fe00640 1 -- 172.21.15.55:0/1570708825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3778009420 con 0x7f3790153ea0 2024-04-02T07:31:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.965+0000 7f378fe00640 1 --2- 172.21.15.55:0/1570708825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3790153ea0 0x7f3790136140 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f378000e810 tx=0x7f378000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.965+0000 7f378cc00640 1 -- 172.21.15.55:0/1570708825 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378000c8d0 con 0x7f3790153ea0 2024-04-02T07:31:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.965+0000 7f378cc00640 1 -- 172.21.15.55:0/1570708825 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378000ca30 con 0x7f3790153ea0 2024-04-02T07:31:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.965+0000 7f378cc00640 1 -- 172.21.15.55:0/1570708825 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378000cdc0 con 0x7f3790153ea0 2024-04-02T07:31:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.965+0000 7f3797000640 1 -- 172.21.15.55:0/1570708825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37901f7090 con 0x7f3790153ea0 2024-04-02T07:31:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.965+0000 7f3797000640 1 -- 172.21.15.55:0/1570708825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37901f7890 con 0x7f3790153ea0 2024-04-02T07:31:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.965+0000 7f3797000640 1 -- 172.21.15.55:0/1570708825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3790066c90 con 0x7f3790153ea0 2024-04-02T07:31:39.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.965+0000 7f378cc00640 1 -- 172.21.15.55:0/1570708825 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3780013410 con 0x7f3790153ea0 2024-04-02T07:31:39.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.969+0000 7f378cc00640 1 --2- 172.21.15.55:0/1570708825 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f376c0666c0 0x7f376c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:39.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.969+0000 7f378cc00640 1 -- 172.21.15.55:0/1570708825 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3780083fc0 con 0x7f3790153ea0 2024-04-02T07:31:39.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.969+0000 7f3787400640 1 --2- 172.21.15.55:0/1570708825 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f376c0666c0 0x7f376c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:39.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.969+0000 7f3787400640 1 --2- 172.21.15.55:0/1570708825 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f376c0666c0 0x7f376c068b80 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f37780ae000 tx=0x7f37780a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:39.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:39.973+0000 7f378cc00640 1 -- 172.21.15.55:0/1570708825 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3780051320 con 0x7f3790153ea0 2024-04-02T07:31:40.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.133+0000 7f3797000640 1 -- 172.21.15.55:0/1570708825 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f379013eee0 con 0x7f3790153ea0 2024-04-02T07:31:40.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.133+0000 7f378cc00640 1 -- 172.21.15.55:0/1570708825 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+16051 (secure 0 0 0) 0x7f3780009480 con 0x7f3790153ea0 2024-04-02T07:31:40.137 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:40.137 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":103,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:31:31.706822+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:31:29.246681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-02T07:31:29.698823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:31:40.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.137+0000 7f3797000640 1 -- 172.21.15.55:0/1570708825 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f376c0666c0 msgr2=0x7f376c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:40.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.137+0000 7f3797000640 1 --2- 172.21.15.55:0/1570708825 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f376c0666c0 0x7f376c068b80 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f37780ae000 tx=0x7f37780a7000 comp rx=0 tx=0).stop 2024-04-02T07:31:40.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.137+0000 7f3797000640 1 -- 172.21.15.55:0/1570708825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3790153ea0 msgr2=0x7f3790136140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:40.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.137+0000 7f3797000640 1 --2- 172.21.15.55:0/1570708825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3790153ea0 0x7f3790136140 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f378000e810 tx=0x7f378000ecd0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.137+0000 7f3797000640 1 -- 172.21.15.55:0/1570708825 shutdown_connections 2024-04-02T07:31:40.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.137+0000 7f3797000640 1 --2- 172.21.15.55:0/1570708825 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f379015a070 0x7f379013a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.137+0000 7f3797000640 1 --2- 172.21.15.55:0/1570708825 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f376c0666c0 0x7f376c068b80 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.137+0000 7f3797000640 1 --2- 172.21.15.55:0/1570708825 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3790159be0 0x7f379013a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.137+0000 7f3797000640 1 --2- 172.21.15.55:0/1570708825 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3790153ea0 0x7f3790136140 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.137+0000 7f3797000640 1 -- 172.21.15.55:0/1570708825 >> 172.21.15.55:0/1570708825 conn(0x7f3790066080 msgr2=0x7f37900c3ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:40.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.137+0000 7f3797000640 1 -- 172.21.15.55:0/1570708825 shutdown_connections 2024-04-02T07:31:40.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.137+0000 7f3797000640 1 -- 172.21.15.55:0/1570708825 wait complete. 2024-04-02T07:31:40.159 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:31:29.246681+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:31:29.698823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:31:40.160 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:31:40.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.301+0000 7f140b000640 1 Processor -- start 2024-04-02T07:31:40.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.301+0000 7f140b000640 1 -- start start 2024-04-02T07:31:40.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.301+0000 7f140b000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f140415ca60 0x7f14040cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:40.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.301+0000 7f140b000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1404098a10 0x7f1404098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:40.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.301+0000 7f140b000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14040993b0 con 0x7f140406b920 2024-04-02T07:31:40.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.301+0000 7f140b000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f140406c460 con 0x7f140415ca60 2024-04-02T07:31:40.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.301+0000 7f140b000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140415ce40 con 0x7f1404098a10 2024-04-02T07:31:40.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.301+0000 7f1403e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f140415ca60 0x7f14040cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:40.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.301+0000 7f1403e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f140415ca60 0x7f14040cfc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47684/0 (socket says 172.21.15.55:47684) 2024-04-02T07:31:40.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.301+0000 7f1403e00640 1 -- 172.21.15.55:0/329944928 learned_addr learned my addr 172.21.15.55:0/329944928 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:40.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.305+0000 7f13fb400640 1 --2- 172.21.15.55:0/329944928 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1404098a10 0x7f1404098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:40.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.305+0000 7f1403e00640 1 -- 172.21.15.55:0/329944928 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1404098a10 msgr2=0x7f1404098e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:40.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.305+0000 7f1403e00640 1 --2- 172.21.15.55:0/329944928 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1404098a10 0x7f1404098e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.305+0000 7f1403e00640 1 -- 172.21.15.55:0/329944928 >> v1:172.21.15.106:6789/0 conn(0x7f140406b920 legacy=0x7f140406bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:40.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.305+0000 7f1403e00640 1 -- 172.21.15.55:0/329944928 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14040d01b0 con 0x7f140415ca60 2024-04-02T07:31:40.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.305+0000 7f1403e00640 1 --2- 172.21.15.55:0/329944928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f140415ca60 0x7f14040cfc70 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009870 tx=0x7f13f401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412a882d19fbad73 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:40.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.305+0000 7f1403400640 1 -- 172.21.15.55:0/329944928 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f40a6040 con 0x7f140415ca60 2024-04-02T07:31:40.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.305+0000 7f1403400640 1 -- 172.21.15.55:0/329944928 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13f40aa600 con 0x7f140415ca60 2024-04-02T07:31:40.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.305+0000 7f1403400640 1 -- 172.21.15.55:0/329944928 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13f40aa990 con 0x7f140415ca60 2024-04-02T07:31:40.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.305+0000 7f140b000640 1 -- 172.21.15.55:0/329944928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f140415ca60 msgr2=0x7f14040cfc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:40.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.305+0000 7f140b000640 1 --2- 172.21.15.55:0/329944928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f140415ca60 0x7f14040cfc70 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f13f4009870 tx=0x7f13f401c4a0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f140b000640 1 -- 172.21.15.55:0/329944928 shutdown_connections 2024-04-02T07:31:40.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f140b000640 1 --2- 172.21.15.55:0/329944928 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1404098a10 0x7f1404098e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f140b000640 1 --2- 172.21.15.55:0/329944928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f140415ca60 0x7f14040cfc70 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f140b000640 1 -- 172.21.15.55:0/329944928 >> 172.21.15.55:0/329944928 conn(0x7f14040b2150 msgr2=0x7f14040b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:40.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f140b000640 1 -- 172.21.15.55:0/329944928 shutdown_connections 2024-04-02T07:31:40.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f140b000640 1 -- 172.21.15.55:0/329944928 wait complete. 2024-04-02T07:31:40.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f140b000640 1 Processor -- start 2024-04-02T07:31:40.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f140b000640 1 -- start start 2024-04-02T07:31:40.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f140b000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f140406b920 0x7f140414f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:40.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f140b000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1404098a10 0x7f14040c6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:40.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f140b000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f140415ca60 0x7f14040c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:40.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f140b000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14040ad270 con 0x7f1404098a10 2024-04-02T07:31:40.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f140b000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14040c6ef0 con 0x7f140406b920 2024-04-02T07:31:40.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f140b000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f140415ad90 con 0x7f140415ca60 2024-04-02T07:31:40.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f13fb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1404098a10 0x7f14040c6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:40.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f13fb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1404098a10 0x7f14040c6470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47694/0 (socket says 172.21.15.55:47694) 2024-04-02T07:31:40.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f13fb400640 1 -- 172.21.15.55:0/1777277097 learned_addr learned my addr 172.21.15.55:0/1777277097 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:40.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f1403e00640 1 --2- 172.21.15.55:0/1777277097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f140406b920 0x7f140414f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:40.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f1409000640 1 --2- 172.21.15.55:0/1777277097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f140415ca60 0x7f14040c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:40.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f13fb400640 1 -- 172.21.15.55:0/1777277097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f140415ca60 msgr2=0x7f14040c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:40.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f13fb400640 1 --2- 172.21.15.55:0/1777277097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f140415ca60 0x7f14040c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f13fb400640 1 -- 172.21.15.55:0/1777277097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f140406b920 msgr2=0x7f140414f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:40.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f13fb400640 1 --2- 172.21.15.55:0/1777277097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f140406b920 0x7f140414f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f13fb400640 1 -- 172.21.15.55:0/1777277097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f40094d0 con 0x7f1404098a10 2024-04-02T07:31:40.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.309+0000 7f13fb400640 1 --2- 172.21.15.55:0/1777277097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1404098a10 0x7f14040c6470 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f13ec007e90 tx=0x7f13ec00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:40.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.313+0000 7f1400c00640 1 -- 172.21.15.55:0/1777277097 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ec014620 con 0x7f1404098a10 2024-04-02T07:31:40.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.313+0000 7f1400c00640 1 -- 172.21.15.55:0/1777277097 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13ec0147a0 con 0x7f1404098a10 2024-04-02T07:31:40.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.313+0000 7f1400c00640 1 -- 172.21.15.55:0/1777277097 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13ec014b50 con 0x7f1404098a10 2024-04-02T07:31:40.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.313+0000 7f140b000640 1 -- 172.21.15.55:0/1777277097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f140415b070 con 0x7f1404098a10 2024-04-02T07:31:40.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.313+0000 7f140b000640 1 -- 172.21.15.55:0/1777277097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f140414f740 con 0x7f1404098a10 2024-04-02T07:31:40.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.313+0000 7f140b000640 1 -- 172.21.15.55:0/1777277097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14040ad420 con 0x7f1404098a10 2024-04-02T07:31:40.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.313+0000 7f1400c00640 1 -- 172.21.15.55:0/1777277097 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f13ec014cb0 con 0x7f1404098a10 2024-04-02T07:31:40.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.313+0000 7f1400c00640 1 --2- 172.21.15.55:0/1777277097 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f13e0066690 0x7f13e0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:40.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.313+0000 7f1400c00640 1 -- 172.21.15.55:0/1777277097 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13ec084ab0 con 0x7f1404098a10 2024-04-02T07:31:40.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.313+0000 7f1403e00640 1 --2- 172.21.15.55:0/1777277097 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f13e0066690 0x7f13e0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:40.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.317+0000 7f1403e00640 1 --2- 172.21.15.55:0/1777277097 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f13e0066690 0x7f13e0068b50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f13f40ae000 tx=0x7f13f40b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:40.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.317+0000 7f1400c00640 1 -- 172.21.15.55:0/1777277097 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f14040ad420 con 0x7f1404098a10 2024-04-02T07:31:40.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.481+0000 7f140b000640 1 -- 172.21.15.55:0/1777277097 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f14040ad420 con 0x7f1404098a10 2024-04-02T07:31:40.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.481+0000 7f1400c00640 1 -- 172.21.15.55:0/1777277097 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7f14040ad420 con 0x7f1404098a10 2024-04-02T07:31:40.483 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:31:40.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.481+0000 7f140b000640 1 -- 172.21.15.55:0/1777277097 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f13e0066690 msgr2=0x7f13e0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:40.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.481+0000 7f140b000640 1 --2- 172.21.15.55:0/1777277097 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f13e0066690 0x7f13e0068b50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f13f40ae000 tx=0x7f13f40b5040 comp rx=0 tx=0).stop 2024-04-02T07:31:40.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.481+0000 7f140b000640 1 -- 172.21.15.55:0/1777277097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1404098a10 msgr2=0x7f14040c6470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:40.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.481+0000 7f140b000640 1 --2- 172.21.15.55:0/1777277097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1404098a10 0x7f14040c6470 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f13ec007e90 tx=0x7f13ec00e4b0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.481+0000 7f140b000640 1 -- 172.21.15.55:0/1777277097 shutdown_connections 2024-04-02T07:31:40.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.481+0000 7f140b000640 1 --2- 172.21.15.55:0/1777277097 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f140415ca60 0x7f14040c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.481+0000 7f140b000640 1 --2- 172.21.15.55:0/1777277097 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1404098a10 0x7f14040c6470 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.481+0000 7f140b000640 1 --2- 172.21.15.55:0/1777277097 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f13e0066690 0x7f13e0068b50 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.481+0000 7f140b000640 1 --2- 172.21.15.55:0/1777277097 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f140406b920 0x7f140414f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.481+0000 7f140b000640 1 -- 172.21.15.55:0/1777277097 >> 172.21.15.55:0/1777277097 conn(0x7f14040b2150 msgr2=0x7f14040b0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:40.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.481+0000 7f140b000640 1 -- 172.21.15.55:0/1777277097 shutdown_connections 2024-04-02T07:31:40.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.481+0000 7f140b000640 1 -- 172.21.15.55:0/1777277097 wait complete. 2024-04-02T07:31:40.504 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:31:40.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.645+0000 7f424e600640 1 Processor -- start 2024-04-02T07:31:40.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.645+0000 7f424e600640 1 -- start start 2024-04-02T07:31:40.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.645+0000 7f424e600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f42480709b0 0x7f42480b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:40.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.645+0000 7f424e600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42480b2fd0 0x7f42480b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:40.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.645+0000 7f424e600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f424815e3a0 con 0x7f4248144260 2024-04-02T07:31:40.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.645+0000 7f424e600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42480b37c0 con 0x7f42480709b0 2024-04-02T07:31:40.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.645+0000 7f424e600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424815e5f0 con 0x7f42480b2fd0 2024-04-02T07:31:40.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.645+0000 7f4247400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4248144260 0x7f42480702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36130/0 (socket says 172.21.15.55:36130) 2024-04-02T07:31:40.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.645+0000 7f423fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f42480709b0 0x7f42480b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:40.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.645+0000 7f4247400640 1 -- 172.21.15.55:0/207328550 learned_addr learned my addr 172.21.15.55:0/207328550 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:40.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.645+0000 7f4247e00640 1 --2- 172.21.15.55:0/207328550 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42480b2fd0 0x7f42480b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:40.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.649+0000 7f4246a00640 1 -- 172.21.15.55:0/207328550 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1840683025 0 0) 0x7f424815e3a0 con 0x7f4248144260 2024-04-02T07:31:40.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.649+0000 7f423fe00640 1 -- 172.21.15.55:0/207328550 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42480b2fd0 msgr2=0x7f42480b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:40.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.649+0000 7f423fe00640 1 --2- 172.21.15.55:0/207328550 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42480b2fd0 0x7f42480b1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.649+0000 7f423fe00640 1 -- 172.21.15.55:0/207328550 >> v1:172.21.15.55:6789/0 conn(0x7f4248144260 legacy=0x7f42480702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:40.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.649+0000 7f423fe00640 1 -- 172.21.15.55:0/207328550 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f424815e8d0 con 0x7f42480709b0 2024-04-02T07:31:40.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.649+0000 7f423fe00640 1 --2- 172.21.15.55:0/207328550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42480709b0 0x7f42480b2a90 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f42300097c0 tx=0x7f423001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=754efb5ad375f9e1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:40.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.649+0000 7f4246a00640 1 -- 172.21.15.55:0/207328550 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42300ad640 con 0x7f42480709b0 2024-04-02T07:31:40.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.649+0000 7f4246a00640 1 -- 172.21.15.55:0/207328550 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42300ad7a0 con 0x7f42480709b0 2024-04-02T07:31:40.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.649+0000 7f4246a00640 1 -- 172.21.15.55:0/207328550 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42300adb30 con 0x7f42480709b0 2024-04-02T07:31:40.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.649+0000 7f424e600640 1 -- 172.21.15.55:0/207328550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42480709b0 msgr2=0x7f42480b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:40.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.649+0000 7f424e600640 1 --2- 172.21.15.55:0/207328550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42480709b0 0x7f42480b2a90 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f42300097c0 tx=0x7f423001c4a0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f424e600640 1 -- 172.21.15.55:0/207328550 shutdown_connections 2024-04-02T07:31:40.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f424e600640 1 --2- 172.21.15.55:0/207328550 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f42480b2fd0 0x7f42480b1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f424e600640 1 --2- 172.21.15.55:0/207328550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42480709b0 0x7f42480b2a90 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f424e600640 1 -- 172.21.15.55:0/207328550 >> 172.21.15.55:0/207328550 conn(0x7f424806a390 msgr2=0x7f42480b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:40.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f424e600640 1 -- 172.21.15.55:0/207328550 shutdown_connections 2024-04-02T07:31:40.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f424e600640 1 -- 172.21.15.55:0/207328550 wait complete. 2024-04-02T07:31:40.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f424e600640 1 Processor -- start 2024-04-02T07:31:40.654 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f424e600640 1 -- start start 2024-04-02T07:31:40.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f424e600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42480709b0 0x7f424813ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:40.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f424e600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42480b2fd0 0x7f424813a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f424e600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4248144260 0x7f4248153fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f424e600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4248157850 con 0x7f42480709b0 2024-04-02T07:31:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f424e600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4248157af0 con 0x7f42480b2fd0 2024-04-02T07:31:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f424e600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f424813c9f0 con 0x7f4248144260 2024-04-02T07:31:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f4247400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42480709b0 0x7f424813ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f4247400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42480709b0 0x7f424813ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47722/0 (socket says 172.21.15.55:47722) 2024-04-02T07:31:40.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f4247400640 1 -- 172.21.15.55:0/2672553167 learned_addr learned my addr 172.21.15.55:0/2672553167 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:40.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f4247e00640 1 --2- 172.21.15.55:0/2672553167 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4248144260 0x7f4248153fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:40.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f423fe00640 1 --2- 172.21.15.55:0/2672553167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42480b2fd0 0x7f424813a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:40.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f4247400640 1 -- 172.21.15.55:0/2672553167 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4248144260 msgr2=0x7f4248153fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:40.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f4247400640 1 --2- 172.21.15.55:0/2672553167 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4248144260 0x7f4248153fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f4247400640 1 -- 172.21.15.55:0/2672553167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42480b2fd0 msgr2=0x7f424813a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:40.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f4247400640 1 --2- 172.21.15.55:0/2672553167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42480b2fd0 0x7f424813a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f4247400640 1 -- 172.21.15.55:0/2672553167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4230009420 con 0x7f42480709b0 2024-04-02T07:31:40.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f423fe00640 1 --2- 172.21.15.55:0/2672553167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42480b2fd0 0x7f424813a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:40.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f4247e00640 1 --2- 172.21.15.55:0/2672553167 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4248144260 0x7f4248153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:40.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f4247400640 1 --2- 172.21.15.55:0/2672553167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42480709b0 0x7f424813ad60 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f423800c480 tx=0x7f423800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:40.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f423f400640 1 -- 172.21.15.55:0/2672553167 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42380074e0 con 0x7f42480709b0 2024-04-02T07:31:40.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.653+0000 7f423f400640 1 -- 172.21.15.55:0/2672553167 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4238007660 con 0x7f42480709b0 2024-04-02T07:31:40.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.657+0000 7f423f400640 1 -- 172.21.15.55:0/2672553167 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4238004a30 con 0x7f42480709b0 2024-04-02T07:31:40.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.657+0000 7f424e600640 1 -- 172.21.15.55:0/2672553167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4248157dd0 con 0x7f42480709b0 2024-04-02T07:31:40.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.657+0000 7f424e600640 1 -- 172.21.15.55:0/2672553167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f424813b340 con 0x7f42480709b0 2024-04-02T07:31:40.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.657+0000 7f424e600640 1 -- 172.21.15.55:0/2672553167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4248073530 con 0x7f42480709b0 2024-04-02T07:31:40.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.657+0000 7f423f400640 1 -- 172.21.15.55:0/2672553167 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f4238004b90 con 0x7f42480709b0 2024-04-02T07:31:40.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.657+0000 7f423f400640 1 --2- 172.21.15.55:0/2672553167 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f42240666c0 0x7f4224068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:40.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.657+0000 7f423f400640 1 -- 172.21.15.55:0/2672553167 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4238083320 con 0x7f42480709b0 2024-04-02T07:31:40.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.657+0000 7f423fe00640 1 --2- 172.21.15.55:0/2672553167 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f42240666c0 0x7f4224068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:40.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.657+0000 7f423fe00640 1 --2- 172.21.15.55:0/2672553167 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f42240666c0 0x7f4224068b80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f42300af000 tx=0x7f42300a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:40.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.661+0000 7f423f400640 1 -- 172.21.15.55:0/2672553167 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f4238054110 con 0x7f42480709b0 2024-04-02T07:31:40.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.825+0000 7f424e600640 1 -- 172.21.15.55:0/2672553167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f424813c850 con 0x7f42480709b0 2024-04-02T07:31:40.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.825+0000 7f423f400640 1 -- 172.21.15.55:0/2672553167 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v103) v1 ==== 104+0+11 (secure 0 0 0) 0x7f424813c850 con 0x7f42480709b0 2024-04-02T07:31:40.825 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:31:40.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.825+0000 7f424e600640 1 -- 172.21.15.55:0/2672553167 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f42240666c0 msgr2=0x7f4224068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:40.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.825+0000 7f424e600640 1 --2- 172.21.15.55:0/2672553167 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f42240666c0 0x7f4224068b80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f42300af000 tx=0x7f42300a7070 comp rx=0 tx=0).stop 2024-04-02T07:31:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.825+0000 7f424e600640 1 -- 172.21.15.55:0/2672553167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42480709b0 msgr2=0x7f424813ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.825+0000 7f424e600640 1 --2- 172.21.15.55:0/2672553167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42480709b0 0x7f424813ad60 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f423800c480 tx=0x7f423800c940 comp rx=0 tx=0).stop 2024-04-02T07:31:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.825+0000 7f424e600640 1 -- 172.21.15.55:0/2672553167 shutdown_connections 2024-04-02T07:31:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.825+0000 7f424e600640 1 --2- 172.21.15.55:0/2672553167 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4248144260 0x7f4248153fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.825+0000 7f424e600640 1 --2- 172.21.15.55:0/2672553167 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f42240666c0 0x7f4224068b80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.825+0000 7f424e600640 1 --2- 172.21.15.55:0/2672553167 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f42480b2fd0 0x7f424813a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.825+0000 7f424e600640 1 --2- 172.21.15.55:0/2672553167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f42480709b0 0x7f424813ad60 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.825+0000 7f424e600640 1 -- 172.21.15.55:0/2672553167 >> 172.21.15.55:0/2672553167 conn(0x7f424806a390 msgr2=0x7f4248142750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.825+0000 7f424e600640 1 -- 172.21.15.55:0/2672553167 shutdown_connections 2024-04-02T07:31:40.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.825+0000 7f424e600640 1 -- 172.21.15.55:0/2672553167 wait complete. 2024-04-02T07:31:40.847 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:31:40.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.989+0000 7f3bfde00640 1 Processor -- start 2024-04-02T07:31:40.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.989+0000 7f3bfde00640 1 -- start start 2024-04-02T07:31:40.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.989+0000 7f3bfde00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3bf80cc710 0x7f3bf806bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:40.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.989+0000 7f3bfde00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3bf80cff30 0x7f3bf8098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:40.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.989+0000 7f3bfde00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bf806c300 con 0x7f3bf80ce900 2024-04-02T07:31:40.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.989+0000 7f3bfde00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bf80ccaf0 con 0x7f3bf80cc710 2024-04-02T07:31:40.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.989+0000 7f3bfde00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf80cee90 con 0x7f3bf80cff30 2024-04-02T07:31:40.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.989+0000 7f3bf7400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3bf80ce900 0x7f3bf815c330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36142/0 (socket says 172.21.15.55:36142) 2024-04-02T07:31:40.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.989+0000 7f3bf7400640 1 -- 172.21.15.55:0/1882629769 learned_addr learned my addr 172.21.15.55:0/1882629769 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:40.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.989+0000 7f3bf6a00640 1 --2- 172.21.15.55:0/1882629769 >> v2:172.21.15.106:3300/0 conn(0x7f3bf80cc710 0x7f3bf806bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:40.992 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.989+0000 7f3bee000640 1 --2- 172.21.15.55:0/1882629769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3bf80cff30 0x7f3bf8098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:40.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.989+0000 7f3bf6000640 1 -- 172.21.15.55:0/1882629769 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530300430 0 0) 0x7f3bf00014a0 con 0x7f3bf80ce900 2024-04-02T07:31:40.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.989+0000 7f3bf6000640 1 -- 172.21.15.55:0/1882629769 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3bdc003530 con 0x7f3bf80ce900 2024-04-02T07:31:40.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.989+0000 7f3bf6a00640 1 -- 172.21.15.55:0/1882629769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3bf80cff30 msgr2=0x7f3bf8098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:40.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.989+0000 7f3bf6a00640 1 --2- 172.21.15.55:0/1882629769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3bf80cff30 0x7f3bf8098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.989+0000 7f3bf6a00640 1 -- 172.21.15.55:0/1882629769 >> v1:172.21.15.55:6789/0 conn(0x7f3bf80ce900 legacy=0x7f3bf815c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:40.993 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.989+0000 7f3bf6a00640 1 -- 172.21.15.55:0/1882629769 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bf80cf170 con 0x7f3bf80cc710 2024-04-02T07:31:40.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.993+0000 7f3bf6a00640 1 --2- 172.21.15.55:0/1882629769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3bf80cc710 0x7f3bf806bdc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3be80097c0 tx=0x7f3be801c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ada08b1d57afd3e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.993+0000 7f3bf6000640 1 -- 172.21.15.55:0/1882629769 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be80ad680 con 0x7f3bf80cc710 2024-04-02T07:31:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.993+0000 7f3bf6000640 1 -- 172.21.15.55:0/1882629769 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be80ad7e0 con 0x7f3bf80cc710 2024-04-02T07:31:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.993+0000 7f3bf6000640 1 -- 172.21.15.55:0/1882629769 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be80adb70 con 0x7f3bf80cc710 2024-04-02T07:31:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.993+0000 7f3bfde00640 1 -- 172.21.15.55:0/1882629769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3bf80cc710 msgr2=0x7f3bf806bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.993+0000 7f3bfde00640 1 --2- 172.21.15.55:0/1882629769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3bf80cc710 0x7f3bf806bdc0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3be80097c0 tx=0x7f3be801c470 comp rx=0 tx=0).stop 2024-04-02T07:31:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.993+0000 7f3bfde00640 1 -- 172.21.15.55:0/1882629769 shutdown_connections 2024-04-02T07:31:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.993+0000 7f3bfde00640 1 --2- 172.21.15.55:0/1882629769 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3bf80cff30 0x7f3bf8098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.993+0000 7f3bfde00640 1 --2- 172.21.15.55:0/1882629769 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3bf80cc710 0x7f3bf806bdc0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.993+0000 7f3bfde00640 1 -- 172.21.15.55:0/1882629769 >> 172.21.15.55:0/1882629769 conn(0x7f3bf80b21b0 msgr2=0x7f3bf80b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.993+0000 7f3bfde00640 1 -- 172.21.15.55:0/1882629769 shutdown_connections 2024-04-02T07:31:40.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.993+0000 7f3bfde00640 1 -- 172.21.15.55:0/1882629769 wait complete. 2024-04-02T07:31:40.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bfde00640 1 Processor -- start 2024-04-02T07:31:40.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bfde00640 1 -- start start 2024-04-02T07:31:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bfde00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3bf80cc710 0x7f3bf814c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bfde00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3bf80ce900 0x7f3bf80c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bfde00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bf80cff30 0x7f3bf80cd420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bfde00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf80ad890 con 0x7f3bf80cff30 2024-04-02T07:31:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bfde00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf814ce20 con 0x7f3bf80ce900 2024-04-02T07:31:40.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bfde00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bf81f9be0 con 0x7f3bf80cc710 2024-04-02T07:31:41.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bf7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bf80cff30 0x7f3bf80cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:41.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bf7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bf80cff30 0x7f3bf80cd420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47736/0 (socket says 172.21.15.55:47736) 2024-04-02T07:31:41.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bf7400640 1 -- 172.21.15.55:0/4058676927 learned_addr learned my addr 172.21.15.55:0/4058676927 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:41.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bee000640 1 --2- 172.21.15.55:0/4058676927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3bf80ce900 0x7f3bf80c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:41.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bf6a00640 1 --2- 172.21.15.55:0/4058676927 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3bf80cc710 0x7f3bf814c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:41.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bf7400640 1 -- 172.21.15.55:0/4058676927 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3bf80cc710 msgr2=0x7f3bf814c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:41.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bf7400640 1 --2- 172.21.15.55:0/4058676927 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3bf80cc710 0x7f3bf814c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bf7400640 1 -- 172.21.15.55:0/4058676927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3bf80ce900 msgr2=0x7f3bf80c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:41.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bf7400640 1 --2- 172.21.15.55:0/4058676927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3bf80ce900 0x7f3bf80c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bf7400640 1 -- 172.21.15.55:0/4058676927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be8009420 con 0x7f3bf80cff30 2024-04-02T07:31:41.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bf7400640 1 --2- 172.21.15.55:0/4058676927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bf80cff30 0x7f3bf80cd420 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000cae0 tx=0x7f3bf000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:41.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3befe00640 1 -- 172.21.15.55:0/4058676927 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf000ac40 con 0x7f3bf80cff30 2024-04-02T07:31:41.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3befe00640 1 -- 172.21.15.55:0/4058676927 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bf000ada0 con 0x7f3bf80cff30 2024-04-02T07:31:41.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bfde00640 1 -- 172.21.15.55:0/4058676927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bf81f9ec0 con 0x7f3bf80cff30 2024-04-02T07:31:41.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3befe00640 1 -- 172.21.15.55:0/4058676927 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bf0012620 con 0x7f3bf80cff30 2024-04-02T07:31:41.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:40.997+0000 7f3bfde00640 1 -- 172.21.15.55:0/4058676927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bf81fa480 con 0x7f3bf80cff30 2024-04-02T07:31:41.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.001+0000 7f3bfde00640 1 -- 172.21.15.55:0/4058676927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bf80ada00 con 0x7f3bf80cff30 2024-04-02T07:31:41.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.001+0000 7f3befe00640 1 -- 172.21.15.55:0/4058676927 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3bf0007070 con 0x7f3bf80cff30 2024-04-02T07:31:41.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.001+0000 7f3befe00640 1 --2- 172.21.15.55:0/4058676927 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3bd4066690 0x7f3bd4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:41.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.001+0000 7f3befe00640 1 -- 172.21.15.55:0/4058676927 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bf0083f60 con 0x7f3bf80cff30 2024-04-02T07:31:41.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.001+0000 7f3bf6a00640 1 --2- 172.21.15.55:0/4058676927 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3bd4066690 0x7f3bd4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:41.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.001+0000 7f3bf6a00640 1 --2- 172.21.15.55:0/4058676927 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3bd4066690 0x7f3bd4068b50 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3be80af000 tx=0x7f3be80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:41.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.005+0000 7f3befe00640 1 -- 172.21.15.55:0/4058676927 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3bf00512e0 con 0x7f3bf80cff30 2024-04-02T07:31:41.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.165+0000 7f3bfde00640 1 -- 172.21.15.55:0/4058676927 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3bf806c300 con 0x7f3bf80cff30 2024-04-02T07:31:41.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.165+0000 7f3befe00640 1 -- 172.21.15.55:0/4058676927 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v103) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3bf806c300 con 0x7f3bf80cff30 2024-04-02T07:31:41.167 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:31:41.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.169+0000 7f3bfde00640 1 -- 172.21.15.55:0/4058676927 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3bd4066690 msgr2=0x7f3bd4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:41.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.169+0000 7f3bfde00640 1 --2- 172.21.15.55:0/4058676927 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3bd4066690 0x7f3bd4068b50 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f3be80af000 tx=0x7f3be80a7000 comp rx=0 tx=0).stop 2024-04-02T07:31:41.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.169+0000 7f3bfde00640 1 -- 172.21.15.55:0/4058676927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bf80cff30 msgr2=0x7f3bf80cd420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:41.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.169+0000 7f3bfde00640 1 --2- 172.21.15.55:0/4058676927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bf80cff30 0x7f3bf80cd420 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f3bf000cae0 tx=0x7f3bf000a060 comp rx=0 tx=0).stop 2024-04-02T07:31:41.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.169+0000 7f3bfde00640 1 -- 172.21.15.55:0/4058676927 shutdown_connections 2024-04-02T07:31:41.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.169+0000 7f3bfde00640 1 --2- 172.21.15.55:0/4058676927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bf80cff30 0x7f3bf80cd420 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.169+0000 7f3bfde00640 1 --2- 172.21.15.55:0/4058676927 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3bd4066690 0x7f3bd4068b50 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.169+0000 7f3bfde00640 1 --2- 172.21.15.55:0/4058676927 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3bf80ce900 0x7f3bf80c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.169+0000 7f3bfde00640 1 --2- 172.21.15.55:0/4058676927 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3bf80cc710 0x7f3bf814c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.169+0000 7f3bfde00640 1 -- 172.21.15.55:0/4058676927 >> 172.21.15.55:0/4058676927 conn(0x7f3bf80b21b0 msgr2=0x7f3bf8152a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:41.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.169+0000 7f3bfde00640 1 -- 172.21.15.55:0/4058676927 shutdown_connections 2024-04-02T07:31:41.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.169+0000 7f3bfde00640 1 -- 172.21.15.55:0/4058676927 wait complete. 2024-04-02T07:31:41.189 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:31:41.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.329+0000 7f0f13200640 1 Processor -- start 2024-04-02T07:31:41.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.329+0000 7f0f13200640 1 -- start start 2024-04-02T07:31:41.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.329+0000 7f0f13200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f0c0cf420 0x7f0f0c0b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:41.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.329+0000 7f0f13200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0f0c0b3350 0x7f0f0c0cb720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:41.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.329+0000 7f0f13200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f0c0b1e30 con 0x7f0f0c098a10 2024-04-02T07:31:41.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.329+0000 7f0f13200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f0c099dc0 con 0x7f0f0c0b3350 2024-04-02T07:31:41.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.329+0000 7f0f13200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c0ce170 con 0x7f0f0c0cf420 2024-04-02T07:31:41.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.329+0000 7f0f11e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f0f0c098a10 0x7f0f0c098df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36146/0 (socket says 172.21.15.55:36146) 2024-04-02T07:31:41.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.329+0000 7f0f11e00640 1 -- 172.21.15.55:0/2368633119 learned_addr learned my addr 172.21.15.55:0/2368633119 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:41.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.329+0000 7f0f12800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0f0c0b3350 0x7f0f0c0cb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:41.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.329+0000 7f0f11400640 1 --2- 172.21.15.55:0/2368633119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f0c0cf420 0x7f0f0c0b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:41.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.329+0000 7f0f12800640 1 -- 172.21.15.55:0/2368633119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f0c0cf420 msgr2=0x7f0f0c0b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:41.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.329+0000 7f0f12800640 1 --2- 172.21.15.55:0/2368633119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f0c0cf420 0x7f0f0c0b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.329+0000 7f0f12800640 1 -- 172.21.15.55:0/2368633119 >> v1:172.21.15.55:6789/0 conn(0x7f0f0c098a10 legacy=0x7f0f0c098df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:41.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.329+0000 7f0f12800640 1 -- 172.21.15.55:0/2368633119 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f0c0ce450 con 0x7f0f0c0b3350 2024-04-02T07:31:41.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.329+0000 7f0f10a00640 1 -- 172.21.15.55:0/2368633119 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259853642 0 0) 0x7f0f0c0b1e30 con 0x7f0f0c098a10 2024-04-02T07:31:41.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.333+0000 7f0f12800640 1 --2- 172.21.15.55:0/2368633119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0b3350 0x7f0f0c0cb720 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009d90 tx=0x7f0f0801c6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f051a3e13e8f9a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:41.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.333+0000 7f0f10a00640 1 -- 172.21.15.55:0/2368633119 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f080a5790 con 0x7f0f0c0b3350 2024-04-02T07:31:41.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.333+0000 7f0f10a00640 1 -- 172.21.15.55:0/2368633119 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f080a58f0 con 0x7f0f0c0b3350 2024-04-02T07:31:41.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.333+0000 7f0f10a00640 1 -- 172.21.15.55:0/2368633119 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f080a5c80 con 0x7f0f0c0b3350 2024-04-02T07:31:41.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.333+0000 7f0f13200640 1 -- 172.21.15.55:0/2368633119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0b3350 msgr2=0x7f0f0c0cb720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:41.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.333+0000 7f0f13200640 1 --2- 172.21.15.55:0/2368633119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0b3350 0x7f0f0c0cb720 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009d90 tx=0x7f0f0801c6d0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.333+0000 7f0f13200640 1 -- 172.21.15.55:0/2368633119 shutdown_connections 2024-04-02T07:31:41.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.333+0000 7f0f13200640 1 --2- 172.21.15.55:0/2368633119 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f0c0cf420 0x7f0f0c0b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.333+0000 7f0f13200640 1 --2- 172.21.15.55:0/2368633119 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0b3350 0x7f0f0c0cb720 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.333+0000 7f0f13200640 1 -- 172.21.15.55:0/2368633119 >> 172.21.15.55:0/2368633119 conn(0x7f0f0c0ccf80 msgr2=0x7f0f0c0cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:41.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.333+0000 7f0f13200640 1 -- 172.21.15.55:0/2368633119 shutdown_connections 2024-04-02T07:31:41.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.333+0000 7f0f13200640 1 -- 172.21.15.55:0/2368633119 wait complete. 2024-04-02T07:31:41.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f13200640 1 Processor -- start 2024-04-02T07:31:41.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f13200640 1 -- start start 2024-04-02T07:31:41.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f13200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f0c098a10 0x7f0f0c15b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:41.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f13200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f0c0b3350 0x7f0f0c0c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:41.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f13200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0cf420 0x7f0f0c148480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:41.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f13200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c0c76c0 con 0x7f0f0c0cf420 2024-04-02T07:31:41.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f13200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c0c79a0 con 0x7f0f0c098a10 2024-04-02T07:31:41.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f13200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0c0c7c80 con 0x7f0f0c0b3350 2024-04-02T07:31:41.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f12800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0cf420 0x7f0f0c148480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:41.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f12800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0cf420 0x7f0f0c148480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47750/0 (socket says 172.21.15.55:47750) 2024-04-02T07:31:41.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f12800640 1 -- 172.21.15.55:0/3146808656 learned_addr learned my addr 172.21.15.55:0/3146808656 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:41.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f11400640 1 --2- 172.21.15.55:0/3146808656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f0c0b3350 0x7f0f0c0c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:41.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f11e00640 1 --2- 172.21.15.55:0/3146808656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f0c098a10 0x7f0f0c15b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:41.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f12800640 1 -- 172.21.15.55:0/3146808656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f0c0b3350 msgr2=0x7f0f0c0c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:41.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f12800640 1 --2- 172.21.15.55:0/3146808656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f0c0b3350 0x7f0f0c0c92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f12800640 1 -- 172.21.15.55:0/3146808656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f0c098a10 msgr2=0x7f0f0c15b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:41.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f12800640 1 --2- 172.21.15.55:0/3146808656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f0c098a10 0x7f0f0c15b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f12800640 1 -- 172.21.15.55:0/3146808656 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f08009a70 con 0x7f0f0c0cf420 2024-04-02T07:31:41.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f12800640 1 --2- 172.21.15.55:0/3146808656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0cf420 0x7f0f0c148480 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f0f0801cbb0 tx=0x7f0f08019470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:41.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f06000640 1 -- 172.21.15.55:0/3146808656 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f080ad440 con 0x7f0f0c0cf420 2024-04-02T07:31:41.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f06000640 1 -- 172.21.15.55:0/3146808656 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f080ad5a0 con 0x7f0f0c0cf420 2024-04-02T07:31:41.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f06000640 1 -- 172.21.15.55:0/3146808656 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f080ad910 con 0x7f0f0c0cf420 2024-04-02T07:31:41.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f13200640 1 -- 172.21.15.55:0/3146808656 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f0c0c7f60 con 0x7f0f0c0cf420 2024-04-02T07:31:41.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.337+0000 7f0f13200640 1 -- 172.21.15.55:0/3146808656 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f0c0c8df0 con 0x7f0f0c0cf420 2024-04-02T07:31:41.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.341+0000 7f0f13200640 1 -- 172.21.15.55:0/3146808656 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0c0d01d0 con 0x7f0f0c0cf420 2024-04-02T07:31:41.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.341+0000 7f0f06000640 1 -- 172.21.15.55:0/3146808656 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f0f080ada70 con 0x7f0f0c0cf420 2024-04-02T07:31:41.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.341+0000 7f0f06000640 1 --2- 172.21.15.55:0/3146808656 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ef0066690 0x7f0ef0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:41.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.341+0000 7f0f06000640 1 -- 172.21.15.55:0/3146808656 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f0811f4f0 con 0x7f0f0c0cf420 2024-04-02T07:31:41.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.341+0000 7f0f11e00640 1 --2- 172.21.15.55:0/3146808656 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ef0066690 0x7f0ef0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:41.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.341+0000 7f0f11e00640 1 --2- 172.21.15.55:0/3146808656 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ef0066690 0x7f0ef0068b50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0f00000f70 tx=0x7f0f00007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:41.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.345+0000 7f0f06000640 1 -- 172.21.15.55:0/3146808656 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0f080ec980 con 0x7f0f0c0cf420 2024-04-02T07:31:41.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.517+0000 7f0f13200640 1 -- 172.21.15.55:0/3146808656 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f0f0c073fa0 con 0x7f0f0c0cf420 2024-04-02T07:31:41.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.517+0000 7f0f06000640 1 -- 172.21.15.55:0/3146808656 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v103) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0f080c6080 con 0x7f0f0c0cf420 2024-04-02T07:31:41.520 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:31:41.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.521+0000 7f0f13200640 1 -- 172.21.15.55:0/3146808656 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ef0066690 msgr2=0x7f0ef0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:41.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.521+0000 7f0f13200640 1 --2- 172.21.15.55:0/3146808656 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ef0066690 0x7f0ef0068b50 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0f00000f70 tx=0x7f0f00007df0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.521+0000 7f0f13200640 1 -- 172.21.15.55:0/3146808656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0cf420 msgr2=0x7f0f0c148480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:41.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.521+0000 7f0f13200640 1 --2- 172.21.15.55:0/3146808656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0cf420 0x7f0f0c148480 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f0f0801cbb0 tx=0x7f0f08019470 comp rx=0 tx=0).stop 2024-04-02T07:31:41.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.521+0000 7f0f13200640 1 -- 172.21.15.55:0/3146808656 shutdown_connections 2024-04-02T07:31:41.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.521+0000 7f0f13200640 1 --2- 172.21.15.55:0/3146808656 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0f0c0cf420 0x7f0f0c148480 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.521+0000 7f0f13200640 1 --2- 172.21.15.55:0/3146808656 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0f0c0b3350 0x7f0f0c0c92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.521+0000 7f0f13200640 1 --2- 172.21.15.55:0/3146808656 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0ef0066690 0x7f0ef0068b50 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.521+0000 7f0f13200640 1 --2- 172.21.15.55:0/3146808656 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0f0c098a10 0x7f0f0c15b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.521+0000 7f0f13200640 1 -- 172.21.15.55:0/3146808656 >> 172.21.15.55:0/3146808656 conn(0x7f0f0c0ccf80 msgr2=0x7f0f0c0b3730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:41.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.521+0000 7f0f13200640 1 -- 172.21.15.55:0/3146808656 shutdown_connections 2024-04-02T07:31:41.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.521+0000 7f0f13200640 1 -- 172.21.15.55:0/3146808656 wait complete. 2024-04-02T07:31:41.540 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:31:41.540 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:31:41.549 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:31:41.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.729+0000 7fa3e3800640 1 Processor -- start 2024-04-02T07:31:41.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.729+0000 7fa3e3800640 1 -- start start 2024-04-02T07:31:41.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.729+0000 7fa3e3800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa3dc153ea0 0x7fa3dc0c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:41.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.729+0000 7fa3e3800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3dc13d0c0 con 0x7fa3dc159be0 2024-04-02T07:31:41.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.729+0000 7fa3e3800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3dc15a4f0 con 0x7fa3dc15a070 2024-04-02T07:31:41.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.729+0000 7fa3e3800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3dc15a7d0 con 0x7fa3dc153ea0 2024-04-02T07:31:41.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.733+0000 7fa3dbe00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa3dc159be0 0x7fa3dc0b31b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36162/0 (socket says 172.21.15.55:36162) 2024-04-02T07:31:41.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.733+0000 7fa3dbe00640 1 -- 172.21.15.55:0/3886607027 learned_addr learned my addr 172.21.15.55:0/3886607027 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:41.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.733+0000 7fa3e0e00640 1 --2- 172.21.15.55:0/3886607027 >> v2:172.21.15.106:3300/0 conn(0x7fa3dc153ea0 0x7fa3dc0c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:41.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.733+0000 7fa3db400640 1 -- 172.21.15.55:0/3886607027 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1078695543 0 0) 0x7fa3dc13d0c0 con 0x7fa3dc159be0 2024-04-02T07:31:41.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.733+0000 7fa3db400640 1 -- 172.21.15.55:0/3886607027 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3c4003530 con 0x7fa3dc159be0 2024-04-02T07:31:41.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.733+0000 7fa3db400640 1 -- 172.21.15.55:0/3886607027 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3750382221 0 0) 0x7fa3dc15a4f0 con 0x7fa3dc15a070 2024-04-02T07:31:41.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.733+0000 7fa3db400640 1 -- 172.21.15.55:0/3886607027 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3dc13d0c0 con 0x7fa3dc15a070 2024-04-02T07:31:41.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.733+0000 7fa3db400640 1 -- 172.21.15.55:0/3886607027 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1916645437 0 0) 0x7fa3c4003530 con 0x7fa3dc159be0 2024-04-02T07:31:41.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.733+0000 7fa3e0e00640 1 -- 172.21.15.55:0/3886607027 >> v1:172.21.15.106:6789/0 conn(0x7fa3dc15a070 legacy=0x7fa3dc13d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:41.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.733+0000 7fa3e0e00640 1 -- 172.21.15.55:0/3886607027 >> v1:172.21.15.55:6789/0 conn(0x7fa3dc159be0 legacy=0x7fa3dc0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:41.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.733+0000 7fa3e0e00640 1 -- 172.21.15.55:0/3886607027 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3dc15aab0 con 0x7fa3dc153ea0 2024-04-02T07:31:41.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.733+0000 7fa3e0e00640 1 --2- 172.21.15.55:0/3886607027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3dc153ea0 0x7fa3dc0c4120 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00097c0 tx=0x7fa3d001c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=393cc91ca67cb765 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:41.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3db400640 1 -- 172.21.15.55:0/3886607027 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8001680 con 0x7fa3dc153ea0 2024-04-02T07:31:41.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3db400640 1 -- 172.21.15.55:0/3886607027 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3d00ad460 con 0x7fa3dc153ea0 2024-04-02T07:31:41.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3db400640 1 -- 172.21.15.55:0/3886607027 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d00ad7d0 con 0x7fa3dc153ea0 2024-04-02T07:31:41.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3e3800640 1 -- 172.21.15.55:0/3886607027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3dc153ea0 msgr2=0x7fa3dc0c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:41.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3e3800640 1 --2- 172.21.15.55:0/3886607027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3dc153ea0 0x7fa3dc0c4120 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00097c0 tx=0x7fa3d001c3c0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3e3800640 1 -- 172.21.15.55:0/3886607027 shutdown_connections 2024-04-02T07:31:41.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3e3800640 1 --2- 172.21.15.55:0/3886607027 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3dc153ea0 0x7fa3dc0c4120 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3e3800640 1 -- 172.21.15.55:0/3886607027 >> 172.21.15.55:0/3886607027 conn(0x7fa3dc066080 msgr2=0x7fa3dc069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:41.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3e3800640 1 -- 172.21.15.55:0/3886607027 shutdown_connections 2024-04-02T07:31:41.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3e3800640 1 -- 172.21.15.55:0/3886607027 wait complete. 2024-04-02T07:31:41.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3e3800640 1 Processor -- start 2024-04-02T07:31:41.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3e3800640 1 -- start start 2024-04-02T07:31:41.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3e3800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3dc153ea0 0x7fa3dc0cd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:41.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3e3800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3dc159be0 0x7fa3dc134a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:41.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3e3800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3dc15a070 0x7fa3dc134fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:41.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3e3800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc15b600 con 0x7fa3dc159be0 2024-04-02T07:31:41.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3e3800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc0c39c0 con 0x7fa3dc153ea0 2024-04-02T07:31:41.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3e3800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3dc13c410 con 0x7fa3dc15a070 2024-04-02T07:31:41.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3dbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3dc159be0 0x7fa3dc134a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:41.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3e0e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3dc153ea0 0x7fa3dc0cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:41.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3dbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3dc159be0 0x7fa3dc134a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47764/0 (socket says 172.21.15.55:47764) 2024-04-02T07:31:41.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3dbe00640 1 -- 172.21.15.55:0/1176252768 learned_addr learned my addr 172.21.15.55:0/1176252768 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:41.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.737+0000 7fa3e1800640 1 --2- 172.21.15.55:0/1176252768 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3dc15a070 0x7fa3dc134fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:41.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.741+0000 7fa3dbe00640 1 -- 172.21.15.55:0/1176252768 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3dc15a070 msgr2=0x7fa3dc134fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:41.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.741+0000 7fa3dbe00640 1 --2- 172.21.15.55:0/1176252768 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3dc15a070 0x7fa3dc134fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.741+0000 7fa3dbe00640 1 -- 172.21.15.55:0/1176252768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3dc153ea0 msgr2=0x7fa3dc0cd810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:41.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.741+0000 7fa3dbe00640 1 --2- 172.21.15.55:0/1176252768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3dc153ea0 0x7fa3dc0cd810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.741+0000 7fa3dbe00640 1 -- 172.21.15.55:0/1176252768 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d0009420 con 0x7fa3dc159be0 2024-04-02T07:31:41.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.741+0000 7fa3e1800640 1 --2- 172.21.15.55:0/1176252768 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3dc15a070 0x7fa3dc134fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:41.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.741+0000 7fa3dbe00640 1 --2- 172.21.15.55:0/1176252768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3dc159be0 0x7fa3dc134a60 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c780 tx=0x7fa3c800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:41.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.741+0000 7fa3d8c00640 1 -- 172.21.15.55:0/1176252768 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c8005cf0 con 0x7fa3dc159be0 2024-04-02T07:31:41.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.741+0000 7fa3d8c00640 1 -- 172.21.15.55:0/1176252768 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c8005e50 con 0x7fa3dc159be0 2024-04-02T07:31:41.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.741+0000 7fa3e3800640 1 -- 172.21.15.55:0/1176252768 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3dc15acd0 con 0x7fa3dc159be0 2024-04-02T07:31:41.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.741+0000 7fa3d8c00640 1 -- 172.21.15.55:0/1176252768 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c80072b0 con 0x7fa3dc159be0 2024-04-02T07:31:41.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.741+0000 7fa3e3800640 1 -- 172.21.15.55:0/1176252768 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3dc15b290 con 0x7fa3dc159be0 2024-04-02T07:31:41.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.741+0000 7fa3e3800640 1 -- 172.21.15.55:0/1176252768 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3dc066c90 con 0x7fa3dc159be0 2024-04-02T07:31:41.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.741+0000 7fa3d8c00640 1 -- 172.21.15.55:0/1176252768 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa3c8007410 con 0x7fa3dc159be0 2024-04-02T07:31:41.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.741+0000 7fa3d8c00640 1 --2- 172.21.15.55:0/1176252768 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa3bc066690 0x7fa3bc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:41.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.741+0000 7fa3d8c00640 1 -- 172.21.15.55:0/1176252768 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3c8083920 con 0x7fa3dc159be0 2024-04-02T07:31:41.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.745+0000 7fa3e0e00640 1 --2- 172.21.15.55:0/1176252768 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa3bc066690 0x7fa3bc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:41.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.745+0000 7fa3e0e00640 1 --2- 172.21.15.55:0/1176252768 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa3bc066690 0x7fa3bc068b50 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00af000 tx=0x7fa3d00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:41.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.745+0000 7fa3d8c00640 1 -- 172.21.15.55:0/1176252768 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa3c8054730 con 0x7fa3dc159be0 2024-04-02T07:31:41.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.909+0000 7fa3e3800640 1 -- 172.21.15.55:0/1176252768 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3dc0ce410 con 0x7fa3dc159be0 2024-04-02T07:31:41.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.909+0000 7fa3d8c00640 1 -- 172.21.15.55:0/1176252768 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+16051 (secure 0 0 0) 0x7fa3c8017020 con 0x7fa3dc159be0 2024-04-02T07:31:41.912 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:41.912 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":103,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:31:31.706822+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:31:29.246681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-02T07:31:29.698823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:31:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.913+0000 7fa3e3800640 1 -- 172.21.15.55:0/1176252768 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa3bc066690 msgr2=0x7fa3bc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.913+0000 7fa3e3800640 1 --2- 172.21.15.55:0/1176252768 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa3bc066690 0x7fa3bc068b50 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fa3d00af000 tx=0x7fa3d00a7000 comp rx=0 tx=0).stop 2024-04-02T07:31:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.913+0000 7fa3e3800640 1 -- 172.21.15.55:0/1176252768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3dc159be0 msgr2=0x7fa3dc134a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.913+0000 7fa3e3800640 1 --2- 172.21.15.55:0/1176252768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3dc159be0 0x7fa3dc134a60 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fa3c800c780 tx=0x7fa3c800cc40 comp rx=0 tx=0).stop 2024-04-02T07:31:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.913+0000 7fa3e3800640 1 -- 172.21.15.55:0/1176252768 shutdown_connections 2024-04-02T07:31:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.913+0000 7fa3e3800640 1 --2- 172.21.15.55:0/1176252768 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3dc15a070 0x7fa3dc134fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.913+0000 7fa3e3800640 1 --2- 172.21.15.55:0/1176252768 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3dc159be0 0x7fa3dc134a60 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.913+0000 7fa3e3800640 1 --2- 172.21.15.55:0/1176252768 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa3bc066690 0x7fa3bc068b50 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.913+0000 7fa3e3800640 1 --2- 172.21.15.55:0/1176252768 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3dc153ea0 0x7fa3dc0cd810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.913+0000 7fa3e3800640 1 -- 172.21.15.55:0/1176252768 >> 172.21.15.55:0/1176252768 conn(0x7fa3dc066080 msgr2=0x7fa3dc0b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:41.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.913+0000 7fa3e3800640 1 -- 172.21.15.55:0/1176252768 shutdown_connections 2024-04-02T07:31:41.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:41.913+0000 7fa3e3800640 1 -- 172.21.15.55:0/1176252768 wait complete. 2024-04-02T07:31:41.934 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:31:29.246681+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:31:29.698823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:31:41.934 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:31:42.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.073+0000 7fb7fac00640 1 Processor -- start 2024-04-02T07:31:42.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.073+0000 7fb7fac00640 1 -- start start 2024-04-02T07:31:42.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.077+0000 7fb7fac00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7f40ce710 0x7fb7f4159650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:42.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.077+0000 7fb7fac00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb7f4069d90 0x7fb7f406a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:42.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.077+0000 7fb7fac00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7f4159ce0 con 0x7fb7f41537b0 2024-04-02T07:31:42.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.077+0000 7fb7fac00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7f415a580 con 0x7fb7f4069d90 2024-04-02T07:31:42.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.077+0000 7fb7fac00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f406a740 con 0x7fb7f40ce710 2024-04-02T07:31:42.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.077+0000 7fb7f3e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb7f41537b0 0x7fb7f415d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36176/0 (socket says 172.21.15.55:36176) 2024-04-02T07:31:42.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.077+0000 7fb7f3e00640 1 -- 172.21.15.55:0/1259284089 learned_addr learned my addr 172.21.15.55:0/1259284089 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.077+0000 7fb7f8c00640 1 --2- 172.21.15.55:0/1259284089 >> v2:172.21.15.106:3300/0 conn(0x7fb7f4069d90 0x7fb7f406a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.077+0000 7fb7eb400640 1 --2- 172.21.15.55:0/1259284089 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7f40ce710 0x7fb7f4159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.077+0000 7fb7f3400640 1 -- 172.21.15.55:0/1259284089 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679802499 0 0) 0x7fb7f4159ce0 con 0x7fb7f41537b0 2024-04-02T07:31:42.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.077+0000 7fb7f3400640 1 -- 172.21.15.55:0/1259284089 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb7d8003530 con 0x7fb7f41537b0 2024-04-02T07:31:42.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.077+0000 7fb7f8c00640 1 -- 172.21.15.55:0/1259284089 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7f40ce710 msgr2=0x7fb7f4159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:42.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.077+0000 7fb7f8c00640 1 --2- 172.21.15.55:0/1259284089 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7f40ce710 0x7fb7f4159650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.077+0000 7fb7f8c00640 1 -- 172.21.15.55:0/1259284089 >> v1:172.21.15.55:6789/0 conn(0x7fb7f41537b0 legacy=0x7fb7f415d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:42.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.077+0000 7fb7f3400640 1 -- 172.21.15.55:0/1259284089 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4200999908 0 0) 0x7fb7d8003530 con 0x7fb7f41537b0 2024-04-02T07:31:42.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.077+0000 7fb7f8c00640 1 -- 172.21.15.55:0/1259284089 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7f4159fc0 con 0x7fb7f4069d90 2024-04-02T07:31:42.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.081+0000 7fb7f8c00640 1 --2- 172.21.15.55:0/1259284089 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7f4069d90 0x7fb7f406a200 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009d90 tx=0x7fb7ec01c7d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20544d577bf2849b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:42.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.081+0000 7fb7f3400640 1 -- 172.21.15.55:0/1259284089 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e4001680 con 0x7fb7f4069d90 2024-04-02T07:31:42.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.081+0000 7fb7f3400640 1 -- 172.21.15.55:0/1259284089 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec0a9460 con 0x7fb7f4069d90 2024-04-02T07:31:42.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.081+0000 7fb7f3400640 1 -- 172.21.15.55:0/1259284089 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0a97f0 con 0x7fb7f4069d90 2024-04-02T07:31:42.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.081+0000 7fb7fac00640 1 -- 172.21.15.55:0/1259284089 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7f4069d90 msgr2=0x7fb7f406a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:42.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.081+0000 7fb7fac00640 1 --2- 172.21.15.55:0/1259284089 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7f4069d90 0x7fb7f406a200 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec009d90 tx=0x7fb7ec01c7d0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.081+0000 7fb7fac00640 1 -- 172.21.15.55:0/1259284089 shutdown_connections 2024-04-02T07:31:42.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.081+0000 7fb7fac00640 1 --2- 172.21.15.55:0/1259284089 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7f4069d90 0x7fb7f406a200 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.081+0000 7fb7fac00640 1 --2- 172.21.15.55:0/1259284089 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7f40ce710 0x7fb7f4159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.081+0000 7fb7fac00640 1 -- 172.21.15.55:0/1259284089 >> 172.21.15.55:0/1259284089 conn(0x7fb7f40ced90 msgr2=0x7fb7f40cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:42.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.081+0000 7fb7fac00640 1 -- 172.21.15.55:0/1259284089 shutdown_connections 2024-04-02T07:31:42.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.081+0000 7fb7fac00640 1 -- 172.21.15.55:0/1259284089 wait complete. 2024-04-02T07:31:42.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.081+0000 7fb7fac00640 1 Processor -- start 2024-04-02T07:31:42.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.081+0000 7fb7fac00640 1 -- start start 2024-04-02T07:31:42.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7fac00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7f4069d90 0x7fb7f4152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:42.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7fac00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7f40ce710 0x7fb7f414c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:42.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7fac00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f41537b0 0x7fb7f40b2720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:42.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7fac00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f4152fc0 con 0x7fb7f41537b0 2024-04-02T07:31:42.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7fac00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40b3b20 con 0x7fb7f4069d90 2024-04-02T07:31:42.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7fac00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7f40b3e00 con 0x7fb7f40ce710 2024-04-02T07:31:42.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7f8c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f41537b0 0x7fb7f40b2720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:42.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7f8c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f41537b0 0x7fb7f40b2720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47768/0 (socket says 172.21.15.55:47768) 2024-04-02T07:31:42.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7f8c00640 1 -- 172.21.15.55:0/484148873 learned_addr learned my addr 172.21.15.55:0/484148873 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:42.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7eb400640 1 --2- 172.21.15.55:0/484148873 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7f40ce710 0x7fb7f414c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:42.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7f3e00640 1 --2- 172.21.15.55:0/484148873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7f4069d90 0x7fb7f4152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:42.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7f8c00640 1 -- 172.21.15.55:0/484148873 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7f40ce710 msgr2=0x7fb7f414c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:42.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7f8c00640 1 --2- 172.21.15.55:0/484148873 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7f40ce710 0x7fb7f414c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7f8c00640 1 -- 172.21.15.55:0/484148873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7f4069d90 msgr2=0x7fb7f4152a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:42.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7f8c00640 1 --2- 172.21.15.55:0/484148873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7f4069d90 0x7fb7f4152a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7f8c00640 1 -- 172.21.15.55:0/484148873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec009a70 con 0x7fb7f41537b0 2024-04-02T07:31:42.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7f8c00640 1 --2- 172.21.15.55:0/484148873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f41537b0 0x7fb7f40b2720 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec01ae80 tx=0x7fb7ec019570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:42.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7f0c00640 1 -- 172.21.15.55:0/484148873 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0b7070 con 0x7fb7f41537b0 2024-04-02T07:31:42.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7f0c00640 1 -- 172.21.15.55:0/484148873 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7ec009450 con 0x7fb7f41537b0 2024-04-02T07:31:42.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7fac00640 1 -- 172.21.15.55:0/484148873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7f40b1c40 con 0x7fb7f41537b0 2024-04-02T07:31:42.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7f0c00640 1 -- 172.21.15.55:0/484148873 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7ec0a9ea0 con 0x7fb7f41537b0 2024-04-02T07:31:42.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7fac00640 1 -- 172.21.15.55:0/484148873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7f40b2200 con 0x7fb7f41537b0 2024-04-02T07:31:42.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.085+0000 7fb7fac00640 1 -- 172.21.15.55:0/484148873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7f40cc770 con 0x7fb7f41537b0 2024-04-02T07:31:42.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.089+0000 7fb7f0c00640 1 -- 172.21.15.55:0/484148873 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb7ec0bb070 con 0x7fb7f41537b0 2024-04-02T07:31:42.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.089+0000 7fb7f0c00640 1 --2- 172.21.15.55:0/484148873 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7d0066690 0x7fb7d0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:42.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.089+0000 7fb7f0c00640 1 -- 172.21.15.55:0/484148873 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7ec11eac0 con 0x7fb7f41537b0 2024-04-02T07:31:42.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.089+0000 7fb7f3e00640 1 --2- 172.21.15.55:0/484148873 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7d0066690 0x7fb7d0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:42.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.089+0000 7fb7f3e00640 1 --2- 172.21.15.55:0/484148873 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7d0066690 0x7fb7d0068b50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4000fc0 tx=0x7fb7e40019c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:42.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.093+0000 7fb7f0c00640 1 -- 172.21.15.55:0/484148873 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fb7ec0ebee0 con 0x7fb7f41537b0 2024-04-02T07:31:42.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.253+0000 7fb7fac00640 1 -- 172.21.15.55:0/484148873 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7f40b23f0 con 0x7fb7f41537b0 2024-04-02T07:31:42.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.253+0000 7fb7f0c00640 1 -- 172.21.15.55:0/484148873 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb7ec0c20a0 con 0x7fb7f41537b0 2024-04-02T07:31:42.256 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:31:42.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.257+0000 7fb7fac00640 1 -- 172.21.15.55:0/484148873 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7d0066690 msgr2=0x7fb7d0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:42.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.257+0000 7fb7fac00640 1 --2- 172.21.15.55:0/484148873 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7d0066690 0x7fb7d0068b50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4000fc0 tx=0x7fb7e40019c0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.257+0000 7fb7fac00640 1 -- 172.21.15.55:0/484148873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f41537b0 msgr2=0x7fb7f40b2720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:42.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.257+0000 7fb7fac00640 1 --2- 172.21.15.55:0/484148873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f41537b0 0x7fb7f40b2720 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fb7ec01ae80 tx=0x7fb7ec019570 comp rx=0 tx=0).stop 2024-04-02T07:31:42.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.257+0000 7fb7fac00640 1 -- 172.21.15.55:0/484148873 shutdown_connections 2024-04-02T07:31:42.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.257+0000 7fb7fac00640 1 --2- 172.21.15.55:0/484148873 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb7f41537b0 0x7fb7f40b2720 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.257+0000 7fb7fac00640 1 --2- 172.21.15.55:0/484148873 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb7f40ce710 0x7fb7f414c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.257+0000 7fb7fac00640 1 --2- 172.21.15.55:0/484148873 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb7d0066690 0x7fb7d0068b50 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.257+0000 7fb7fac00640 1 --2- 172.21.15.55:0/484148873 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb7f4069d90 0x7fb7f4152a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.257+0000 7fb7fac00640 1 -- 172.21.15.55:0/484148873 >> 172.21.15.55:0/484148873 conn(0x7fb7f40ced90 msgr2=0x7fb7f415d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:42.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.257+0000 7fb7fac00640 1 -- 172.21.15.55:0/484148873 shutdown_connections 2024-04-02T07:31:42.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.257+0000 7fb7fac00640 1 -- 172.21.15.55:0/484148873 wait complete. 2024-04-02T07:31:42.276 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:31:42.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.417+0000 7f6c37e00640 1 Processor -- start 2024-04-02T07:31:42.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.417+0000 7f6c37e00640 1 -- start start 2024-04-02T07:31:42.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.421+0000 7f6c37e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c38098c70 0x7f6c38099750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:42.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.421+0000 7f6c37e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6c38099050 0x7f6c380b1510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:42.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.421+0000 7f6c37e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6c380ce430 0x7f6c380ce860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:42.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.421+0000 7f6c37e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c380b1200 con 0x7f6c380ce430 2024-04-02T07:31:42.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.421+0000 7f6c37e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c38099d30 con 0x7f6c38099050 2024-04-02T07:31:42.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.421+0000 7f6c37e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c380b08d0 con 0x7f6c38098c70 2024-04-02T07:31:42.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.421+0000 7f6c37400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6c380ce430 0x7f6c380ce860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:42.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.421+0000 7f6c37400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6c380ce430 0x7f6c380ce860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47774/0 (socket says 172.21.15.55:47774) 2024-04-02T07:31:42.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.421+0000 7f6c37400640 1 -- 172.21.15.55:0/1010285283 learned_addr learned my addr 172.21.15.55:0/1010285283 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:42.422 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.421+0000 7f6c36a00640 1 --2- 172.21.15.55:0/1010285283 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c38098c70 0x7f6c38099750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:42.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.421+0000 7f6c36000640 1 --2- 172.21.15.55:0/1010285283 >> v2:172.21.15.106:3300/0 conn(0x7f6c38099050 0x7f6c380b1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:42.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.421+0000 7f6c37400640 1 -- 172.21.15.55:0/1010285283 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c38098c70 msgr2=0x7f6c38099750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:42.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.421+0000 7f6c37400640 1 --2- 172.21.15.55:0/1010285283 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c38098c70 0x7f6c38099750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.421+0000 7f6c37400640 1 -- 172.21.15.55:0/1010285283 >> v2:172.21.15.106:3300/0 conn(0x7f6c38099050 msgr2=0x7f6c380b1510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:42.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.421+0000 7f6c37400640 1 --2- 172.21.15.55:0/1010285283 >> v2:172.21.15.106:3300/0 conn(0x7f6c38099050 0x7f6c380b1510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.423 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.421+0000 7f6c37400640 1 -- 172.21.15.55:0/1010285283 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c380b0bb0 con 0x7f6c380ce430 2024-04-02T07:31:42.424 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.421+0000 7f6c37400640 1 --2- 172.21.15.55:0/1010285283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c380ce430 0x7f6c380ce860 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f6c38071710 tx=0x7f6c3001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129b849875ceb252 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:42.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c35600640 1 -- 172.21.15.55:0/1010285283 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c300a56c0 con 0x7f6c380ce430 2024-04-02T07:31:42.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c35600640 1 -- 172.21.15.55:0/1010285283 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c300a5820 con 0x7f6c380ce430 2024-04-02T07:31:42.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c35600640 1 -- 172.21.15.55:0/1010285283 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c300a5bb0 con 0x7f6c380ce430 2024-04-02T07:31:42.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c37e00640 1 -- 172.21.15.55:0/1010285283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c380ce430 msgr2=0x7f6c380ce860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:42.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c37e00640 1 --2- 172.21.15.55:0/1010285283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c380ce430 0x7f6c380ce860 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7f6c38071710 tx=0x7f6c3001c8a0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c37e00640 1 -- 172.21.15.55:0/1010285283 shutdown_connections 2024-04-02T07:31:42.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c37e00640 1 --2- 172.21.15.55:0/1010285283 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c380ce430 0x7f6c380ce860 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c37e00640 1 --2- 172.21.15.55:0/1010285283 >> v2:172.21.15.106:3300/0 conn(0x7f6c38099050 0x7f6c380b1510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c37e00640 1 --2- 172.21.15.55:0/1010285283 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c38098c70 0x7f6c38099750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c37e00640 1 -- 172.21.15.55:0/1010285283 >> 172.21.15.55:0/1010285283 conn(0x7f6c380b1fb0 msgr2=0x7f6c380b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:42.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c37e00640 1 -- 172.21.15.55:0/1010285283 shutdown_connections 2024-04-02T07:31:42.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c37e00640 1 -- 172.21.15.55:0/1010285283 wait complete. 2024-04-02T07:31:42.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c37e00640 1 Processor -- start 2024-04-02T07:31:42.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c37e00640 1 -- start start 2024-04-02T07:31:42.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c37e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c38098c70 0x7f6c38150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:42.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c37e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c38099050 0x7f6c380c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:42.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c37e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c380ce430 0x7f6c380b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:42.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c37e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c38150ec0 con 0x7f6c38099050 2024-04-02T07:31:42.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c37e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c380b3c70 con 0x7f6c38098c70 2024-04-02T07:31:42.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c37e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c380b4510 con 0x7f6c380ce430 2024-04-02T07:31:42.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.425+0000 7f6c36000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c38099050 0x7f6c380c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:42.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.429+0000 7f6c36000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c38099050 0x7f6c380c85e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47776/0 (socket says 172.21.15.55:47776) 2024-04-02T07:31:42.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.429+0000 7f6c36000640 1 -- 172.21.15.55:0/2559029173 learned_addr learned my addr 172.21.15.55:0/2559029173 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:42.429 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.429+0000 7f6c37400640 1 --2- 172.21.15.55:0/2559029173 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c380ce430 0x7f6c380b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:42.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.429+0000 7f6c36a00640 1 --2- 172.21.15.55:0/2559029173 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c38098c70 0x7f6c38150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:42.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.429+0000 7f6c36000640 1 -- 172.21.15.55:0/2559029173 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c380ce430 msgr2=0x7f6c380b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:42.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.429+0000 7f6c36000640 1 --2- 172.21.15.55:0/2559029173 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c380ce430 0x7f6c380b49a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.429+0000 7f6c36000640 1 -- 172.21.15.55:0/2559029173 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c38098c70 msgr2=0x7f6c38150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:42.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.429+0000 7f6c36000640 1 --2- 172.21.15.55:0/2559029173 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c38098c70 0x7f6c38150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.429+0000 7f6c36000640 1 -- 172.21.15.55:0/2559029173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c30009b30 con 0x7f6c38099050 2024-04-02T07:31:42.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.429+0000 7f6c36000640 1 --2- 172.21.15.55:0/2559029173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c38099050 0x7f6c380c85e0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400d800 tx=0x7f6c2400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:42.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.429+0000 7f6c2f400640 1 -- 172.21.15.55:0/2559029173 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2400b6c0 con 0x7f6c38099050 2024-04-02T07:31:42.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.429+0000 7f6c2f400640 1 -- 172.21.15.55:0/2559029173 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2400b820 con 0x7f6c38099050 2024-04-02T07:31:42.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.429+0000 7f6c2f400640 1 -- 172.21.15.55:0/2559029173 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2400bb90 con 0x7f6c38099050 2024-04-02T07:31:42.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.429+0000 7f6c37e00640 1 -- 172.21.15.55:0/2559029173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c380c7220 con 0x7f6c38099050 2024-04-02T07:31:42.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.429+0000 7f6c37e00640 1 -- 172.21.15.55:0/2559029173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c380b41a0 con 0x7f6c38099050 2024-04-02T07:31:42.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.429+0000 7f6c37e00640 1 -- 172.21.15.55:0/2559029173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c38073fa0 con 0x7f6c38099050 2024-04-02T07:31:42.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.429+0000 7f6c2f400640 1 -- 172.21.15.55:0/2559029173 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6c2400bcf0 con 0x7f6c38099050 2024-04-02T07:31:42.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.433+0000 7f6c2f400640 1 --2- 172.21.15.55:0/2559029173 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6c18066690 0x7f6c18068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:42.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.433+0000 7f6c2f400640 1 -- 172.21.15.55:0/2559029173 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c24084590 con 0x7f6c38099050 2024-04-02T07:31:42.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.433+0000 7f6c36a00640 1 --2- 172.21.15.55:0/2559029173 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6c18066690 0x7f6c18068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:42.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.433+0000 7f6c36a00640 1 --2- 172.21.15.55:0/2559029173 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6c18066690 0x7f6c18068b50 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6c280045f0 tx=0x7f6c28008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:42.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.437+0000 7f6c2f400640 1 -- 172.21.15.55:0/2559029173 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6c240519b0 con 0x7f6c38099050 2024-04-02T07:31:42.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.597+0000 7f6c37e00640 1 -- 172.21.15.55:0/2559029173 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6c380cc550 con 0x7f6c38099050 2024-04-02T07:31:42.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.601+0000 7f6c2f400640 1 -- 172.21.15.55:0/2559029173 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v103) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6c24054fd0 con 0x7f6c38099050 2024-04-02T07:31:42.601 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:31:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.601+0000 7f6c37e00640 1 -- 172.21.15.55:0/2559029173 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6c18066690 msgr2=0x7f6c18068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.601+0000 7f6c37e00640 1 --2- 172.21.15.55:0/2559029173 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6c18066690 0x7f6c18068b50 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6c280045f0 tx=0x7f6c28008040 comp rx=0 tx=0).stop 2024-04-02T07:31:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.601+0000 7f6c37e00640 1 -- 172.21.15.55:0/2559029173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c38099050 msgr2=0x7f6c380c85e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.601+0000 7f6c37e00640 1 --2- 172.21.15.55:0/2559029173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c38099050 0x7f6c380c85e0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400d800 tx=0x7f6c2400dcc0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.601+0000 7f6c37e00640 1 -- 172.21.15.55:0/2559029173 shutdown_connections 2024-04-02T07:31:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.601+0000 7f6c37e00640 1 --2- 172.21.15.55:0/2559029173 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6c380ce430 0x7f6c380b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.601+0000 7f6c37e00640 1 --2- 172.21.15.55:0/2559029173 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6c38099050 0x7f6c380c85e0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.601+0000 7f6c37e00640 1 --2- 172.21.15.55:0/2559029173 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6c18066690 0x7f6c18068b50 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.601+0000 7f6c37e00640 1 --2- 172.21.15.55:0/2559029173 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6c38098c70 0x7f6c38150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.601+0000 7f6c37e00640 1 -- 172.21.15.55:0/2559029173 >> 172.21.15.55:0/2559029173 conn(0x7f6c380b1fb0 msgr2=0x7f6c3806b550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:42.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.601+0000 7f6c37e00640 1 -- 172.21.15.55:0/2559029173 shutdown_connections 2024-04-02T07:31:42.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.601+0000 7f6c37e00640 1 -- 172.21.15.55:0/2559029173 wait complete. 2024-04-02T07:31:42.622 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:31:42.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.765+0000 7fdcd7800640 1 Processor -- start 2024-04-02T07:31:42.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.765+0000 7fdcd7800640 1 -- start start 2024-04-02T07:31:42.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.765+0000 7fdcd7800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdcd00cea00 0x7fdcd00cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:42.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.765+0000 7fdcd7800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcd00c9ba0 0x7fdcd00cc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:42.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.765+0000 7fdcd7800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd006a350 con 0x7fdcd0069d90 2024-04-02T07:31:42.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.765+0000 7fdcd7800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd006a5f0 con 0x7fdcd00cea00 2024-04-02T07:31:42.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.765+0000 7fdcd7800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd00cb7e0 con 0x7fdcd00c9ba0 2024-04-02T07:31:42.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.765+0000 7fdcd4e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdcd00cea00 0x7fdcd00cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:42.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.765+0000 7fdcd4e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdcd00cea00 0x7fdcd00cd120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47780/0 (socket says 172.21.15.55:47780) 2024-04-02T07:31:42.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.765+0000 7fdcd4e00640 1 -- 172.21.15.55:0/1521858918 learned_addr learned my addr 172.21.15.55:0/1521858918 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:42.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.765+0000 7fdcd5800640 1 --2- 172.21.15.55:0/1521858918 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcd00c9ba0 0x7fdcd00cc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:42.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.765+0000 7fdcd4e00640 1 -- 172.21.15.55:0/1521858918 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcd00c9ba0 msgr2=0x7fdcd00cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:42.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.765+0000 7fdcd4e00640 1 --2- 172.21.15.55:0/1521858918 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcd00c9ba0 0x7fdcd00cc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.765+0000 7fdcd4e00640 1 -- 172.21.15.55:0/1521858918 >> v1:172.21.15.106:6789/0 conn(0x7fdcd0069d90 legacy=0x7fdcd00cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:42.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.765+0000 7fdcd4e00640 1 -- 172.21.15.55:0/1521858918 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd00cbac0 con 0x7fdcd00cea00 2024-04-02T07:31:42.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.769+0000 7fdcd4e00640 1 --2- 172.21.15.55:0/1521858918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcd00cea00 0x7fdcd00cd120 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009870 tx=0x7fdcc401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9426b570a245df6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:42.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.769+0000 7fdccf400640 1 -- 172.21.15.55:0/1521858918 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc40ab670 con 0x7fdcd00cea00 2024-04-02T07:31:42.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.769+0000 7fdccf400640 1 -- 172.21.15.55:0/1521858918 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc40ab7d0 con 0x7fdcd00cea00 2024-04-02T07:31:42.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.769+0000 7fdccf400640 1 -- 172.21.15.55:0/1521858918 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc40abb60 con 0x7fdcd00cea00 2024-04-02T07:31:42.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.769+0000 7fdcd7800640 1 -- 172.21.15.55:0/1521858918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcd00cea00 msgr2=0x7fdcd00cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:42.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.769+0000 7fdcd7800640 1 --2- 172.21.15.55:0/1521858918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcd00cea00 0x7fdcd00cd120 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009870 tx=0x7fdcc401c560 comp rx=0 tx=0).stop 2024-04-02T07:31:42.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.769+0000 7fdcd7800640 1 -- 172.21.15.55:0/1521858918 shutdown_connections 2024-04-02T07:31:42.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.769+0000 7fdcd7800640 1 --2- 172.21.15.55:0/1521858918 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcd00c9ba0 0x7fdcd00cc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.769+0000 7fdcd7800640 1 --2- 172.21.15.55:0/1521858918 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcd00cea00 0x7fdcd00cd120 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.769+0000 7fdcd7800640 1 -- 172.21.15.55:0/1521858918 >> 172.21.15.55:0/1521858918 conn(0x7fdcd00cf550 msgr2=0x7fdcd00cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:42.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.769+0000 7fdcd7800640 1 -- 172.21.15.55:0/1521858918 shutdown_connections 2024-04-02T07:31:42.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.769+0000 7fdcd7800640 1 -- 172.21.15.55:0/1521858918 wait complete. 2024-04-02T07:31:42.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.769+0000 7fdcd7800640 1 Processor -- start 2024-04-02T07:31:42.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.769+0000 7fdcd7800640 1 -- start start 2024-04-02T07:31:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcd7800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcd0069d90 0x7fdcd014fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcd7800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcd00c9ba0 0x7fdcd0150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcd7800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcd00cea00 0x7fdcd0150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcd7800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd0151990 con 0x7fdcd0069d90 2024-04-02T07:31:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcd7800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd01503e0 con 0x7fdcd00c9ba0 2024-04-02T07:31:42.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcd7800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd0152a70 con 0x7fdcd00cea00 2024-04-02T07:31:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcd4e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcd0069d90 0x7fdcd014fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcd4e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcd0069d90 0x7fdcd014fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47788/0 (socket says 172.21.15.55:47788) 2024-04-02T07:31:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcd4e00640 1 -- 172.21.15.55:0/3204690165 learned_addr learned my addr 172.21.15.55:0/3204690165 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcd5800640 1 --2- 172.21.15.55:0/3204690165 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcd00cea00 0x7fdcd0150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdccfe00640 1 --2- 172.21.15.55:0/3204690165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcd00c9ba0 0x7fdcd0150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcd4e00640 1 -- 172.21.15.55:0/3204690165 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcd00cea00 msgr2=0x7fdcd0150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcd4e00640 1 --2- 172.21.15.55:0/3204690165 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcd00cea00 0x7fdcd0150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcd4e00640 1 -- 172.21.15.55:0/3204690165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcd00c9ba0 msgr2=0x7fdcd0150580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcd4e00640 1 --2- 172.21.15.55:0/3204690165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcd00c9ba0 0x7fdcd0150580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcd4e00640 1 -- 172.21.15.55:0/3204690165 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc40094d0 con 0x7fdcd0069d90 2024-04-02T07:31:42.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcd4e00640 1 --2- 172.21.15.55:0/3204690165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcd0069d90 0x7fdcd014fea0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fdcc401ac10 tx=0x7fdcc401ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcccc00640 1 -- 172.21.15.55:0/3204690165 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc40b4800 con 0x7fdcd0069d90 2024-04-02T07:31:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcccc00640 1 -- 172.21.15.55:0/3204690165 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc40b4960 con 0x7fdcd0069d90 2024-04-02T07:31:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcccc00640 1 -- 172.21.15.55:0/3204690165 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc40b4d10 con 0x7fdcd0069d90 2024-04-02T07:31:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcd7800640 1 -- 172.21.15.55:0/3204690165 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd0151de0 con 0x7fdcd0069d90 2024-04-02T07:31:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcd7800640 1 -- 172.21.15.55:0/3204690165 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd01513d0 con 0x7fdcd0069d90 2024-04-02T07:31:42.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcd7800640 1 -- 172.21.15.55:0/3204690165 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd0152860 con 0x7fdcd0069d90 2024-04-02T07:31:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.773+0000 7fdcccc00640 1 -- 172.21.15.55:0/3204690165 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fdcc40b3380 con 0x7fdcd0069d90 2024-04-02T07:31:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.777+0000 7fdcccc00640 1 --2- 172.21.15.55:0/3204690165 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdcb0066690 0x7fdcb0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:42.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.777+0000 7fdcccc00640 1 -- 172.21.15.55:0/3204690165 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcc411e910 con 0x7fdcd0069d90 2024-04-02T07:31:42.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.777+0000 7fdccfe00640 1 --2- 172.21.15.55:0/3204690165 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdcb0066690 0x7fdcb0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:42.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.777+0000 7fdccfe00640 1 --2- 172.21.15.55:0/3204690165 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdcb0066690 0x7fdcb0068b50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00b04d0 tx=0x7fdcbc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:42.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.781+0000 7fdcccc00640 1 -- 172.21.15.55:0/3204690165 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fdcc40ebd20 con 0x7fdcd0069d90 2024-04-02T07:31:42.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.945+0000 7fdcd7800640 1 -- 172.21.15.55:0/3204690165 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdcd0066c90 con 0x7fdcd0069d90 2024-04-02T07:31:42.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.945+0000 7fdcccc00640 1 -- 172.21.15.55:0/3204690165 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v103) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdcc40ef340 con 0x7fdcd0069d90 2024-04-02T07:31:42.946 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:31:42.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.945+0000 7fdcd7800640 1 -- 172.21.15.55:0/3204690165 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdcb0066690 msgr2=0x7fdcb0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:42.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.945+0000 7fdcd7800640 1 --2- 172.21.15.55:0/3204690165 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdcb0066690 0x7fdcb0068b50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fdcd00b04d0 tx=0x7fdcbc009040 comp rx=0 tx=0).stop 2024-04-02T07:31:42.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.945+0000 7fdcd7800640 1 -- 172.21.15.55:0/3204690165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcd0069d90 msgr2=0x7fdcd014fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:42.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.945+0000 7fdcd7800640 1 --2- 172.21.15.55:0/3204690165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcd0069d90 0x7fdcd014fea0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7fdcc401ac10 tx=0x7fdcc401ada0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.945+0000 7fdcd7800640 1 -- 172.21.15.55:0/3204690165 shutdown_connections 2024-04-02T07:31:42.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.945+0000 7fdcd7800640 1 --2- 172.21.15.55:0/3204690165 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdcd00cea00 0x7fdcd0150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.945+0000 7fdcd7800640 1 --2- 172.21.15.55:0/3204690165 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdcb0066690 0x7fdcb0068b50 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.945+0000 7fdcd7800640 1 --2- 172.21.15.55:0/3204690165 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdcd00c9ba0 0x7fdcd0150580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.945+0000 7fdcd7800640 1 --2- 172.21.15.55:0/3204690165 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdcd0069d90 0x7fdcd014fea0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:42.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.945+0000 7fdcd7800640 1 -- 172.21.15.55:0/3204690165 >> 172.21.15.55:0/3204690165 conn(0x7fdcd00cf550 msgr2=0x7fdcd0072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:42.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.945+0000 7fdcd7800640 1 -- 172.21.15.55:0/3204690165 shutdown_connections 2024-04-02T07:31:42.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:42.945+0000 7fdcd7800640 1 -- 172.21.15.55:0/3204690165 wait complete. 2024-04-02T07:31:42.968 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:31:43.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.109+0000 7f9ef7000640 1 Processor -- start 2024-04-02T07:31:43.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.109+0000 7f9ef7000640 1 -- start start 2024-04-02T07:31:43.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.109+0000 7f9ef7000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ef01601a0 0x7f9ef00cf5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:43.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.109+0000 7f9ef7000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9ef0160580 0x7f9ef0098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:43.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.109+0000 7f9ef7000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef00cfee0 con 0x7f9ef00b19b0 2024-04-02T07:31:43.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.109+0000 7f9ef7000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef00d04a0 con 0x7f9ef0160580 2024-04-02T07:31:43.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.109+0000 7f9ef7000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00d01c0 con 0x7f9ef01601a0 2024-04-02T07:31:43.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.109+0000 7f9eef400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9ef0160580 0x7f9ef0098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:43.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.109+0000 7f9eefe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ef01601a0 0x7f9ef00cf5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:43.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.109+0000 7f9eef400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9ef0160580 0x7f9ef0098a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:57966/0 (socket says 172.21.15.55:57966) 2024-04-02T07:31:43.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.109+0000 7f9eef400640 1 -- 172.21.15.55:0/2070227688 learned_addr learned my addr 172.21.15.55:0/2070227688 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:43.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.109+0000 7f9eef400640 1 -- 172.21.15.55:0/2070227688 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ef01601a0 msgr2=0x7f9ef00cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:43.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.109+0000 7f9eef400640 1 --2- 172.21.15.55:0/2070227688 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ef01601a0 0x7f9ef00cf5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:43.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.109+0000 7f9eef400640 1 -- 172.21.15.55:0/2070227688 >> v1:172.21.15.106:6789/0 conn(0x7f9ef00b19b0 legacy=0x7f9ef006b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:43.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.109+0000 7f9eef400640 1 -- 172.21.15.55:0/2070227688 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef00cade0 con 0x7f9ef0160580 2024-04-02T07:31:43.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.113+0000 7f9eef400640 1 --2- 172.21.15.55:0/2070227688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ef0160580 0x7f9ef0098a10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009870 tx=0x7f9edc01c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f83eeebbf66469c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:43.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.113+0000 7f9eeea00640 1 -- 172.21.15.55:0/2070227688 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc0ab600 con 0x7f9ef0160580 2024-04-02T07:31:43.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.113+0000 7f9eeea00640 1 -- 172.21.15.55:0/2070227688 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9edc0a7050 con 0x7f9ef0160580 2024-04-02T07:31:43.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.113+0000 7f9eeea00640 1 -- 172.21.15.55:0/2070227688 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc0ab980 con 0x7f9ef0160580 2024-04-02T07:31:43.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.113+0000 7f9ef7000640 1 -- 172.21.15.55:0/2070227688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ef0160580 msgr2=0x7f9ef0098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:43.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.113+0000 7f9ef7000640 1 --2- 172.21.15.55:0/2070227688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ef0160580 0x7f9ef0098a10 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f9edc009870 tx=0x7f9edc01c410 comp rx=0 tx=0).stop 2024-04-02T07:31:43.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.113+0000 7f9ef7000640 1 -- 172.21.15.55:0/2070227688 shutdown_connections 2024-04-02T07:31:43.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.113+0000 7f9ef7000640 1 --2- 172.21.15.55:0/2070227688 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ef0160580 0x7f9ef0098a10 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:43.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.113+0000 7f9ef7000640 1 --2- 172.21.15.55:0/2070227688 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ef01601a0 0x7f9ef00cf5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:43.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.113+0000 7f9ef7000640 1 -- 172.21.15.55:0/2070227688 >> 172.21.15.55:0/2070227688 conn(0x7f9ef00b2150 msgr2=0x7f9ef00b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:43.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.113+0000 7f9ef7000640 1 -- 172.21.15.55:0/2070227688 shutdown_connections 2024-04-02T07:31:43.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.113+0000 7f9ef7000640 1 -- 172.21.15.55:0/2070227688 wait complete. 2024-04-02T07:31:43.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9ef7000640 1 Processor -- start 2024-04-02T07:31:43.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9ef7000640 1 -- start start 2024-04-02T07:31:43.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9ef7000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00b19b0 0x7f9ef015e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:43.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9ef7000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ef01601a0 0x7f9ef006f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:43.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9ef7000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ef0160580 0x7f9ef0154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:43.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9ef7000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00c9a10 con 0x7f9ef00b19b0 2024-04-02T07:31:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9ef7000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00c9ea0 con 0x7f9ef0160580 2024-04-02T07:31:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9ef7000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00c8e00 con 0x7f9ef01601a0 2024-04-02T07:31:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9eefe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00b19b0 0x7f9ef015e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9eefe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00b19b0 0x7f9ef015e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:47794/0 (socket says 172.21.15.55:47794) 2024-04-02T07:31:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9eefe00640 1 -- 172.21.15.55:0/827746577 learned_addr learned my addr 172.21.15.55:0/827746577 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9eef400640 1 --2- 172.21.15.55:0/827746577 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ef01601a0 0x7f9ef006f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9ef5000640 1 --2- 172.21.15.55:0/827746577 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ef0160580 0x7f9ef0154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9eefe00640 1 -- 172.21.15.55:0/827746577 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ef01601a0 msgr2=0x7f9ef006f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9eefe00640 1 --2- 172.21.15.55:0/827746577 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ef01601a0 0x7f9ef006f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9eefe00640 1 -- 172.21.15.55:0/827746577 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ef0160580 msgr2=0x7f9ef0154370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9eefe00640 1 --2- 172.21.15.55:0/827746577 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ef0160580 0x7f9ef0154370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9eefe00640 1 -- 172.21.15.55:0/827746577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9edc0094d0 con 0x7f9ef00b19b0 2024-04-02T07:31:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9ef5000640 1 --2- 172.21.15.55:0/827746577 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ef0160580 0x7f9ef0154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:43.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9eefe00640 1 --2- 172.21.15.55:0/827746577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00b19b0 0x7f9ef015e1d0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000e930 tx=0x7f9ee000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:43.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9ee7e00640 1 -- 172.21.15.55:0/827746577 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee0009690 con 0x7f9ef00b19b0 2024-04-02T07:31:43.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9ee7e00640 1 -- 172.21.15.55:0/827746577 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ee000ca00 con 0x7f9ef00b19b0 2024-04-02T07:31:43.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9ef7000640 1 -- 172.21.15.55:0/827746577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef00c90e0 con 0x7f9ef00b19b0 2024-04-02T07:31:43.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9ee7e00640 1 -- 172.21.15.55:0/827746577 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee000cd70 con 0x7f9ef00b19b0 2024-04-02T07:31:43.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9ef7000640 1 -- 172.21.15.55:0/827746577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef00c96a0 con 0x7f9ef00b19b0 2024-04-02T07:31:43.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.117+0000 7f9ef7000640 1 -- 172.21.15.55:0/827746577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef00723d0 con 0x7f9ef00b19b0 2024-04-02T07:31:43.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.121+0000 7f9ee7e00640 1 -- 172.21.15.55:0/827746577 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f9ee0013470 con 0x7f9ef00b19b0 2024-04-02T07:31:43.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.121+0000 7f9ee7e00640 1 --2- 172.21.15.55:0/827746577 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9ed0066690 0x7f9ed0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:43.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.121+0000 7f9ee7e00640 1 -- 172.21.15.55:0/827746577 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ee0084470 con 0x7f9ef00b19b0 2024-04-02T07:31:43.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.121+0000 7f9eef400640 1 --2- 172.21.15.55:0/827746577 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9ed0066690 0x7f9ed0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:43.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.121+0000 7f9eef400640 1 --2- 172.21.15.55:0/827746577 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9ed0066690 0x7f9ed0068b50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0ad000 tx=0x7f9edc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:43.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.125+0000 7f9ee7e00640 1 -- 172.21.15.55:0/827746577 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f9ee0051890 con 0x7f9ef00b19b0 2024-04-02T07:31:43.301 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.301+0000 7f9ef7000640 1 -- 172.21.15.55:0/827746577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f9ef0066c90 con 0x7f9ef00b19b0 2024-04-02T07:31:43.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.301+0000 7f9ee7e00640 1 -- 172.21.15.55:0/827746577 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v103) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9ee0054eb0 con 0x7f9ef00b19b0 2024-04-02T07:31:43.335 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:31:43.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.301+0000 7f9ef7000640 1 -- 172.21.15.55:0/827746577 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9ed0066690 msgr2=0x7f9ed0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:43.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.301+0000 7f9ef7000640 1 --2- 172.21.15.55:0/827746577 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9ed0066690 0x7f9ed0068b50 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0ad000 tx=0x7f9edc008040 comp rx=0 tx=0).stop 2024-04-02T07:31:43.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.301+0000 7f9ef7000640 1 -- 172.21.15.55:0/827746577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00b19b0 msgr2=0x7f9ef015e1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:43.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.301+0000 7f9ef7000640 1 --2- 172.21.15.55:0/827746577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00b19b0 0x7f9ef015e1d0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f9ee000e930 tx=0x7f9ee000edf0 comp rx=0 tx=0).stop 2024-04-02T07:31:43.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.301+0000 7f9ef7000640 1 -- 172.21.15.55:0/827746577 shutdown_connections 2024-04-02T07:31:43.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.301+0000 7f9ef7000640 1 --2- 172.21.15.55:0/827746577 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9ed0066690 0x7f9ed0068b50 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:43.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.301+0000 7f9ef7000640 1 --2- 172.21.15.55:0/827746577 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9ef0160580 0x7f9ef0154370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:43.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.301+0000 7f9ef7000640 1 --2- 172.21.15.55:0/827746577 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9ef01601a0 0x7f9ef006f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:43.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.301+0000 7f9ef7000640 1 --2- 172.21.15.55:0/827746577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00b19b0 0x7f9ef015e1d0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:43.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.301+0000 7f9ef7000640 1 -- 172.21.15.55:0/827746577 >> 172.21.15.55:0/827746577 conn(0x7f9ef00b2150 msgr2=0x7f9ef00cd560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:43.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.301+0000 7f9ef7000640 1 -- 172.21.15.55:0/827746577 shutdown_connections 2024-04-02T07:31:43.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:43.301+0000 7f9ef7000640 1 -- 172.21.15.55:0/827746577 wait complete. 2024-04-02T07:31:43.338 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi055.front.sepia.ceph.com... 2024-04-02T07:31:43.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:43.338 DEBUG:teuthology.orchestra.run.smithi055:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-02T07:31:43.357 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[49409]: fuse finished with error 0 and tester_r 0 2024-04-02T07:31:43.361 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:31:45.396 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:31:45.400 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:31:49.463 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:31:49.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:49.463 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-02T07:31:49.474 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:31:49.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.665+0000 7f0703000640 1 Processor -- start 2024-04-02T07:31:49.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.665+0000 7f0703000640 1 -- start start 2024-04-02T07:31:49.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.669+0000 7f0703000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f06fc143f90 0x7f06fc15ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:49.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.669+0000 7f0703000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06fc0b34f0 0x7f06fc0cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.669+0000 7f0703000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06fc0b3980 0x7f06fc0cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.669+0000 7f0703000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06fc15b270 con 0x7f06fc0b34f0 2024-04-02T07:31:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.669+0000 7f0703000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06fc144370 con 0x7f06fc143f90 2024-04-02T07:31:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.669+0000 7f0703000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc0c37b0 con 0x7f06fc0b3980 2024-04-02T07:31:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.669+0000 7f06f3e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06fc0b34f0 0x7f06fc0cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.669+0000 7f06f3e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06fc0b34f0 0x7f06fc0cd370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49502/0 (socket says 172.21.15.55:49502) 2024-04-02T07:31:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.669+0000 7f06f3e00640 1 -- 172.21.15.55:0/202665872 learned_addr learned my addr 172.21.15.55:0/202665872 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.669+0000 7f06fbe00640 1 --2- 172.21.15.55:0/202665872 >> v2:172.21.15.106:3300/0 conn(0x7f06fc143f90 0x7f06fc15ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.669+0000 7f0701000640 1 --2- 172.21.15.55:0/202665872 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06fc0b3980 0x7f06fc0cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.669+0000 7f06f3e00640 1 -- 172.21.15.55:0/202665872 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06fc0b3980 msgr2=0x7f06fc0cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.669+0000 7f06f3e00640 1 --2- 172.21.15.55:0/202665872 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06fc0b3980 0x7f06fc0cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.669+0000 7f06f3e00640 1 -- 172.21.15.55:0/202665872 >> v2:172.21.15.106:3300/0 conn(0x7f06fc143f90 msgr2=0x7f06fc15ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.669+0000 7f06f3e00640 1 --2- 172.21.15.55:0/202665872 >> v2:172.21.15.106:3300/0 conn(0x7f06fc143f90 0x7f06fc15ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:49.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.669+0000 7f06f3e00640 1 -- 172.21.15.55:0/202665872 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc0c3a90 con 0x7f06fc0b34f0 2024-04-02T07:31:49.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.669+0000 7f06f3e00640 1 --2- 172.21.15.55:0/202665872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc0b34f0 0x7f06fc0cd370 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f06fc06abc0 tx=0x7f06e401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20591db7f3f82205 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:49.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.669+0000 7f06fb400640 1 -- 172.21.15.55:0/202665872 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e40ab620 con 0x7f06fc0b34f0 2024-04-02T07:31:49.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f06fb400640 1 -- 172.21.15.55:0/202665872 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06e40ab780 con 0x7f06fc0b34f0 2024-04-02T07:31:49.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f06fb400640 1 -- 172.21.15.55:0/202665872 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06e40abb10 con 0x7f06fc0b34f0 2024-04-02T07:31:49.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f0703000640 1 -- 172.21.15.55:0/202665872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc0b34f0 msgr2=0x7f06fc0cd370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:49.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f0703000640 1 --2- 172.21.15.55:0/202665872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc0b34f0 0x7f06fc0cd370 secure :-1 s=READY pgs=1498 cs=0 l=1 rev1=1 crypto rx=0x7f06fc06abc0 tx=0x7f06e401c460 comp rx=0 tx=0).stop 2024-04-02T07:31:49.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f0703000640 1 -- 172.21.15.55:0/202665872 shutdown_connections 2024-04-02T07:31:49.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f0703000640 1 --2- 172.21.15.55:0/202665872 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06fc0b3980 0x7f06fc0cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:49.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f0703000640 1 --2- 172.21.15.55:0/202665872 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc0b34f0 0x7f06fc0cd370 unknown :-1 s=CLOSED pgs=1498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:49.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f0703000640 1 --2- 172.21.15.55:0/202665872 >> v2:172.21.15.106:3300/0 conn(0x7f06fc143f90 0x7f06fc15ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:49.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f0703000640 1 -- 172.21.15.55:0/202665872 >> 172.21.15.55:0/202665872 conn(0x7f06fc066080 msgr2=0x7f06fc069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:49.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f0703000640 1 -- 172.21.15.55:0/202665872 shutdown_connections 2024-04-02T07:31:49.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f0703000640 1 -- 172.21.15.55:0/202665872 wait complete. 2024-04-02T07:31:49.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f0703000640 1 Processor -- start 2024-04-02T07:31:49.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f0703000640 1 -- start start 2024-04-02T07:31:49.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f0703000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06fc0b34f0 0x7f06fc159e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:49.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f0703000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06fc0b3980 0x7f06fc13c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:49.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f0703000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc143f90 0x7f06fc131cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:49.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f0703000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc0cd2c0 con 0x7f06fc143f90 2024-04-02T07:31:49.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f0703000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc15a360 con 0x7f06fc0b34f0 2024-04-02T07:31:49.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f0703000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06fc13d0c0 con 0x7f06fc0b3980 2024-04-02T07:31:49.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f0701000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc143f90 0x7f06fc131cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:49.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f0701000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc143f90 0x7f06fc131cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49504/0 (socket says 172.21.15.55:49504) 2024-04-02T07:31:49.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f0701000640 1 -- 172.21.15.55:0/3768601963 learned_addr learned my addr 172.21.15.55:0/3768601963 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:49.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f06fbe00640 1 --2- 172.21.15.55:0/3768601963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06fc0b34f0 0x7f06fc159e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:49.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.673+0000 7f06f3e00640 1 --2- 172.21.15.55:0/3768601963 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06fc0b3980 0x7f06fc13c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:49.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.677+0000 7f0701000640 1 -- 172.21.15.55:0/3768601963 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06fc0b3980 msgr2=0x7f06fc13c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:49.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.677+0000 7f0701000640 1 --2- 172.21.15.55:0/3768601963 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06fc0b3980 0x7f06fc13c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:49.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.677+0000 7f0701000640 1 -- 172.21.15.55:0/3768601963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06fc0b34f0 msgr2=0x7f06fc159e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:49.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.677+0000 7f0701000640 1 --2- 172.21.15.55:0/3768601963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06fc0b34f0 0x7f06fc159e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:49.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.677+0000 7f0701000640 1 -- 172.21.15.55:0/3768601963 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e40094d0 con 0x7f06fc143f90 2024-04-02T07:31:49.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.677+0000 7f0701000640 1 --2- 172.21.15.55:0/3768601963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc143f90 0x7f06fc131cb0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f06f4007e40 tx=0x7f06f400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:49.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.677+0000 7f06f8c00640 1 -- 172.21.15.55:0/3768601963 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f4014620 con 0x7f06fc143f90 2024-04-02T07:31:49.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.677+0000 7f06f8c00640 1 -- 172.21.15.55:0/3768601963 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f400ee90 con 0x7f06fc143f90 2024-04-02T07:31:49.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.677+0000 7f06f8c00640 1 -- 172.21.15.55:0/3768601963 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f40149e0 con 0x7f06fc143f90 2024-04-02T07:31:49.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.677+0000 7f0703000640 1 -- 172.21.15.55:0/3768601963 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06fc13d3a0 con 0x7f06fc143f90 2024-04-02T07:31:49.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.677+0000 7f0703000640 1 -- 172.21.15.55:0/3768601963 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06fc0ccc00 con 0x7f06fc143f90 2024-04-02T07:31:49.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.677+0000 7f0703000640 1 -- 172.21.15.55:0/3768601963 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06fc0cd430 con 0x7f06fc143f90 2024-04-02T07:31:49.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.677+0000 7f06f8c00640 1 -- 172.21.15.55:0/3768601963 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f06f4014b40 con 0x7f06fc143f90 2024-04-02T07:31:49.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.677+0000 7f06f8c00640 1 --2- 172.21.15.55:0/3768601963 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f06d8066690 0x7f06d8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:49.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.681+0000 7f06f8c00640 1 -- 172.21.15.55:0/3768601963 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06f4084a90 con 0x7f06fc143f90 2024-04-02T07:31:49.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.681+0000 7f06fbe00640 1 --2- 172.21.15.55:0/3768601963 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f06d8066690 0x7f06d8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:49.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.681+0000 7f06fbe00640 1 --2- 172.21.15.55:0/3768601963 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f06d8066690 0x7f06d8068b50 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f06ec007940 tx=0x7f06ec008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:49.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.685+0000 7f06f8c00640 1 -- 172.21.15.55:0/3768601963 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f06f4051e10 con 0x7f06fc143f90 2024-04-02T07:31:49.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.877+0000 7f0703000640 1 -- 172.21.15.55:0/3768601963 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06fc066c90 con 0x7f06fc143f90 2024-04-02T07:31:49.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.877+0000 7f06f8c00640 1 -- 172.21.15.55:0/3768601963 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f06f4055430 con 0x7f06fc143f90 2024-04-02T07:31:49.880 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:49.880 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":81,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2707651793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2707651793},{"type":"v1","addr":"172.21.15.106:6836","nonce":2707651793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2234384639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2234384639},{"type":"v1","addr":"172.21.15.106:6837","nonce":2234384639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":8433,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53259218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53259218},{"type":"v1","addr":"172.21.15.55:6833","nonce":53259218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:31:30.704183+0000","modified":"2024-04-02T07:31:33.715450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8436":{"gid":8436,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1089546237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1089546237},{"type":"v1","addr":"172.21.15.55:6835","nonce":1089546237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-02T07:31:49.881 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 81 2024-04-02T07:31:49.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.881+0000 7f0703000640 1 -- 172.21.15.55:0/3768601963 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f06d8066690 msgr2=0x7f06d8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:49.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.881+0000 7f0703000640 1 --2- 172.21.15.55:0/3768601963 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f06d8066690 0x7f06d8068b50 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f06ec007940 tx=0x7f06ec008040 comp rx=0 tx=0).stop 2024-04-02T07:31:49.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.881+0000 7f0703000640 1 -- 172.21.15.55:0/3768601963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc143f90 msgr2=0x7f06fc131cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:49.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.881+0000 7f0703000640 1 --2- 172.21.15.55:0/3768601963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc143f90 0x7f06fc131cb0 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f06f4007e40 tx=0x7f06f400e4b0 comp rx=0 tx=0).stop 2024-04-02T07:31:49.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.881+0000 7f0703000640 1 -- 172.21.15.55:0/3768601963 shutdown_connections 2024-04-02T07:31:49.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.881+0000 7f0703000640 1 --2- 172.21.15.55:0/3768601963 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06fc143f90 0x7f06fc131cb0 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:49.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.881+0000 7f0703000640 1 --2- 172.21.15.55:0/3768601963 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06fc0b3980 0x7f06fc13c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:49.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.881+0000 7f0703000640 1 --2- 172.21.15.55:0/3768601963 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f06d8066690 0x7f06d8068b50 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:49.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.881+0000 7f0703000640 1 --2- 172.21.15.55:0/3768601963 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06fc0b34f0 0x7f06fc159e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:49.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.881+0000 7f0703000640 1 -- 172.21.15.55:0/3768601963 >> 172.21.15.55:0/3768601963 conn(0x7f06fc066080 msgr2=0x7f06fc15b410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:49.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.881+0000 7f0703000640 1 -- 172.21.15.55:0/3768601963 shutdown_connections 2024-04-02T07:31:49.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:49.881+0000 7f0703000640 1 -- 172.21.15.55:0/3768601963 wait complete. 2024-04-02T07:31:49.902 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-02T07:31:50.118 INFO:teuthology.orchestra.run.smithi055.stdout:{"message":"","return_code":0} 2024-04-02T07:31:50.119 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-02T07:31:50.119 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:31:50.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.257+0000 7f33a9400640 1 Processor -- start 2024-04-02T07:31:50.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.257+0000 7f33a9400640 1 -- start start 2024-04-02T07:31:50.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.257+0000 7f33a9400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f33a4156f70 0x7f33a415d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.257+0000 7f33a9400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f33a4157350 0x7f33a40cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.257+0000 7f33a9400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f33a40d02a0 0x7f33a40b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.257+0000 7f33a9400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a415d950 con 0x7f33a40d02a0 2024-04-02T07:31:50.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.257+0000 7f33a9400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33a415dc30 con 0x7f33a4157350 2024-04-02T07:31:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.257+0000 7f33a9400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a415df10 con 0x7f33a4156f70 2024-04-02T07:31:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.261+0000 7f33a3200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f33a40d02a0 0x7f33a40b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.261+0000 7f33a3200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f33a40d02a0 0x7f33a40b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49518/0 (socket says 172.21.15.55:49518) 2024-04-02T07:31:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.261+0000 7f33a3200640 1 -- 172.21.15.55:0/1645724888 learned_addr learned my addr 172.21.15.55:0/1645724888 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.261+0000 7f33a2800640 1 --2- 172.21.15.55:0/1645724888 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f33a4156f70 0x7f33a415d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.261+0000 7f3399e00640 1 --2- 172.21.15.55:0/1645724888 >> v2:172.21.15.106:3300/0 conn(0x7f33a4157350 0x7f33a40cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.261+0000 7f33a3200640 1 -- 172.21.15.55:0/1645724888 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f33a4156f70 msgr2=0x7f33a415d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.261+0000 7f33a3200640 1 --2- 172.21.15.55:0/1645724888 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f33a4156f70 0x7f33a415d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.261+0000 7f33a3200640 1 -- 172.21.15.55:0/1645724888 >> v2:172.21.15.106:3300/0 conn(0x7f33a4157350 msgr2=0x7f33a40cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.261+0000 7f33a3200640 1 --2- 172.21.15.55:0/1645724888 >> v2:172.21.15.106:3300/0 conn(0x7f33a4157350 0x7f33a40cfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.261+0000 7f33a3200640 1 -- 172.21.15.55:0/1645724888 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a40cf560 con 0x7f33a40d02a0 2024-04-02T07:31:50.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.261+0000 7f33a3200640 1 --2- 172.21.15.55:0/1645724888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a40d02a0 0x7f33a40b31c0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f33a40d0710 tx=0x7f339c01c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d08ded32eb4e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:50.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.261+0000 7f33a1e00640 1 -- 172.21.15.55:0/1645724888 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c0a5860 con 0x7f33a40d02a0 2024-04-02T07:31:50.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.261+0000 7f33a1e00640 1 -- 172.21.15.55:0/1645724888 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339c0a59c0 con 0x7f33a40d02a0 2024-04-02T07:31:50.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.261+0000 7f33a1e00640 1 -- 172.21.15.55:0/1645724888 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339c0a5d50 con 0x7f33a40d02a0 2024-04-02T07:31:50.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a9400640 1 -- 172.21.15.55:0/1645724888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a40d02a0 msgr2=0x7f33a40b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:50.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a9400640 1 --2- 172.21.15.55:0/1645724888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a40d02a0 0x7f33a40b31c0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f33a40d0710 tx=0x7f339c01c9c0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a9400640 1 -- 172.21.15.55:0/1645724888 shutdown_connections 2024-04-02T07:31:50.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a9400640 1 --2- 172.21.15.55:0/1645724888 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a40d02a0 0x7f33a40b31c0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a9400640 1 --2- 172.21.15.55:0/1645724888 >> v2:172.21.15.106:3300/0 conn(0x7f33a4157350 0x7f33a40cfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a9400640 1 --2- 172.21.15.55:0/1645724888 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f33a4156f70 0x7f33a415d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a9400640 1 -- 172.21.15.55:0/1645724888 >> 172.21.15.55:0/1645724888 conn(0x7f33a40b13b0 msgr2=0x7f33a40b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:50.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a9400640 1 -- 172.21.15.55:0/1645724888 shutdown_connections 2024-04-02T07:31:50.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a9400640 1 -- 172.21.15.55:0/1645724888 wait complete. 2024-04-02T07:31:50.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a9400640 1 Processor -- start 2024-04-02T07:31:50.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a9400640 1 -- start start 2024-04-02T07:31:50.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a9400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a40d02a0 0x7f33a414aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a9400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33a4156f70 0x7f33a414e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a9400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f33a4157350 0x7f33a4147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a9400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a414b430 con 0x7f33a40d02a0 2024-04-02T07:31:50.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a9400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a41533e0 con 0x7f33a4156f70 2024-04-02T07:31:50.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a9400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33a41536c0 con 0x7f33a4157350 2024-04-02T07:31:50.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a2800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a40d02a0 0x7f33a414aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a2800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a40d02a0 0x7f33a414aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49524/0 (socket says 172.21.15.55:49524) 2024-04-02T07:31:50.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a2800640 1 -- 172.21.15.55:0/3619737780 learned_addr learned my addr 172.21.15.55:0/3619737780 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:50.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a3200640 1 --2- 172.21.15.55:0/3619737780 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f33a4157350 0x7f33a4147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f3399e00640 1 --2- 172.21.15.55:0/3619737780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33a4156f70 0x7f33a414e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a2800640 1 -- 172.21.15.55:0/3619737780 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f33a4157350 msgr2=0x7f33a4147f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:50.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a2800640 1 --2- 172.21.15.55:0/3619737780 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f33a4157350 0x7f33a4147f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a2800640 1 -- 172.21.15.55:0/3619737780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33a4156f70 msgr2=0x7f33a414e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:50.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a2800640 1 --2- 172.21.15.55:0/3619737780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33a4156f70 0x7f33a414e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a2800640 1 -- 172.21.15.55:0/3619737780 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339c009b30 con 0x7f33a40d02a0 2024-04-02T07:31:50.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f3399e00640 1 --2- 172.21.15.55:0/3619737780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33a4156f70 0x7f33a414e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:50.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.265+0000 7f33a2800640 1 --2- 172.21.15.55:0/3619737780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a40d02a0 0x7f33a414aca0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f339400d800 tx=0x7f339400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:50.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.269+0000 7f339b400640 1 -- 172.21.15.55:0/3619737780 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339400b6c0 con 0x7f33a40d02a0 2024-04-02T07:31:50.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.269+0000 7f339b400640 1 -- 172.21.15.55:0/3619737780 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f339400b820 con 0x7f33a40d02a0 2024-04-02T07:31:50.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.269+0000 7f339b400640 1 -- 172.21.15.55:0/3619737780 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f339400bb90 con 0x7f33a40d02a0 2024-04-02T07:31:50.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.269+0000 7f33a9400640 1 -- 172.21.15.55:0/3619737780 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a41539a0 con 0x7f33a40d02a0 2024-04-02T07:31:50.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.269+0000 7f33a9400640 1 -- 172.21.15.55:0/3619737780 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a40aeee0 con 0x7f33a40d02a0 2024-04-02T07:31:50.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.269+0000 7f33a9400640 1 -- 172.21.15.55:0/3619737780 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a40aea60 con 0x7f33a40d02a0 2024-04-02T07:31:50.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.269+0000 7f339b400640 1 -- 172.21.15.55:0/3619737780 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f339400bcf0 con 0x7f33a40d02a0 2024-04-02T07:31:50.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.269+0000 7f339b400640 1 --2- 172.21.15.55:0/3619737780 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3380066690 0x7f3380068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.269+0000 7f339b400640 1 -- 172.21.15.55:0/3619737780 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3394084670 con 0x7f33a40d02a0 2024-04-02T07:31:50.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.269+0000 7f3399e00640 1 --2- 172.21.15.55:0/3619737780 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3380066690 0x7f3380068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.269+0000 7f3399e00640 1 --2- 172.21.15.55:0/3619737780 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3380066690 0x7f3380068b50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f33a4152eb0 tx=0x7f338c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:50.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.273+0000 7f339b400640 1 -- 172.21.15.55:0/3619737780 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f33a40aea60 con 0x7f33a40d02a0 2024-04-02T07:31:50.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.469+0000 7f33a9400640 1 -- 172.21.15.55:0/3619737780 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33a40aea60 con 0x7f33a40d02a0 2024-04-02T07:31:50.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.469+0000 7f339b400640 1 -- 172.21.15.55:0/3619737780 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f33a40aea60 con 0x7f33a40d02a0 2024-04-02T07:31:50.471 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:50.471 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":81,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2707651793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2707651793},{"type":"v1","addr":"172.21.15.106:6836","nonce":2707651793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2234384639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2234384639},{"type":"v1","addr":"172.21.15.106:6837","nonce":2234384639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":8433,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53259218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53259218},{"type":"v1","addr":"172.21.15.55:6833","nonce":53259218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:31:30.704183+0000","modified":"2024-04-02T07:31:33.715450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8436":{"gid":8436,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1089546237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1089546237},{"type":"v1","addr":"172.21.15.55:6835","nonce":1089546237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-02T07:31:50.472 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 81 2024-04-02T07:31:50.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.473+0000 7f33a9400640 1 -- 172.21.15.55:0/3619737780 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3380066690 msgr2=0x7f3380068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:50.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.473+0000 7f33a9400640 1 --2- 172.21.15.55:0/3619737780 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3380066690 0x7f3380068b50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f33a4152eb0 tx=0x7f338c008040 comp rx=0 tx=0).stop 2024-04-02T07:31:50.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.473+0000 7f33a9400640 1 -- 172.21.15.55:0/3619737780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a40d02a0 msgr2=0x7f33a414aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:50.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.473+0000 7f33a9400640 1 --2- 172.21.15.55:0/3619737780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a40d02a0 0x7f33a414aca0 secure :-1 s=READY pgs=1501 cs=0 l=1 rev1=1 crypto rx=0x7f339400d800 tx=0x7f339400dcc0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.473+0000 7f33a9400640 1 -- 172.21.15.55:0/3619737780 shutdown_connections 2024-04-02T07:31:50.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.473+0000 7f33a9400640 1 --2- 172.21.15.55:0/3619737780 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f33a4157350 0x7f33a4147f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.473+0000 7f33a9400640 1 --2- 172.21.15.55:0/3619737780 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3380066690 0x7f3380068b50 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.473+0000 7f33a9400640 1 --2- 172.21.15.55:0/3619737780 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f33a4156f70 0x7f33a414e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.473+0000 7f33a9400640 1 --2- 172.21.15.55:0/3619737780 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f33a40d02a0 0x7f33a414aca0 unknown :-1 s=CLOSED pgs=1501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.473+0000 7f33a9400640 1 -- 172.21.15.55:0/3619737780 >> 172.21.15.55:0/3619737780 conn(0x7f33a40b13b0 msgr2=0x7f33a40ce530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:50.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.473+0000 7f33a9400640 1 -- 172.21.15.55:0/3619737780 shutdown_connections 2024-04-02T07:31:50.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.473+0000 7f33a9400640 1 -- 172.21.15.55:0/3619737780 wait complete. 2024-04-02T07:31:50.492 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata get mds0_inotable - 2024-04-02T07:31:50.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa88bc53080 1 Processor -- start 2024-04-02T07:31:50.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa88bc53080 1 -- start start 2024-04-02T07:31:50.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa88bc53080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f3227ec1c0 0x55f3227ea310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa88bc53080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f3227ec5a0 0x55f322897470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa88bc53080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f322803850 0x55f3228979b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa88bc53080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f322674960 con 0x55f322803850 2024-04-02T07:31:50.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa88bc53080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f322674600 con 0x55f3227ec5a0 2024-04-02T07:31:50.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa88bc53080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f32266b690 con 0x55f3227ec1c0 2024-04-02T07:31:50.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa889800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f322803850 0x55f3228979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa889800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f322803850 0x55f3228979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49550/0 (socket says 172.21.15.55:49550) 2024-04-02T07:31:50.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa889800640 1 -- 172.21.15.55:0/633717987 learned_addr learned my addr 172.21.15.55:0/633717987 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:50.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa888e00640 1 --2- 172.21.15.55:0/633717987 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f3227ec1c0 0x55f3227ea310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa883e00640 1 --2- 172.21.15.55:0/633717987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f3227ec5a0 0x55f322897470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa889800640 1 -- 172.21.15.55:0/633717987 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f3227ec1c0 msgr2=0x55f3227ea310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:50.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa889800640 1 --2- 172.21.15.55:0/633717987 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f3227ec1c0 0x55f3227ea310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa889800640 1 -- 172.21.15.55:0/633717987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f3227ec5a0 msgr2=0x55f322897470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:50.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa889800640 1 --2- 172.21.15.55:0/633717987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f3227ec5a0 0x55f322897470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa889800640 1 -- 172.21.15.55:0/633717987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa874005d30 con 0x55f322803850 2024-04-02T07:31:50.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa889800640 1 --2- 172.21.15.55:0/633717987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f322803850 0x55f3228979b0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fa884001680 tx=0x7fa884001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f08c553d5a0d4f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:50.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa882a00640 1 -- 172.21.15.55:0/633717987 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884003660 con 0x55f322803850 2024-04-02T07:31:50.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa882a00640 1 -- 172.21.15.55:0/633717987 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8840037c0 con 0x55f322803850 2024-04-02T07:31:50.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.537+0000 7fa882a00640 1 -- 172.21.15.55:0/633717987 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa884003b70 con 0x55f322803850 2024-04-02T07:31:50.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa88bc53080 1 -- 172.21.15.55:0/633717987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f322803850 msgr2=0x55f3228979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa88bc53080 1 --2- 172.21.15.55:0/633717987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f322803850 0x55f3228979b0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fa884001680 tx=0x7fa884001b40 comp rx=0 tx=0).stop 2024-04-02T07:31:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa88bc53080 1 -- 172.21.15.55:0/633717987 shutdown_connections 2024-04-02T07:31:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa88bc53080 1 --2- 172.21.15.55:0/633717987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f322803850 0x55f3228979b0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa88bc53080 1 --2- 172.21.15.55:0/633717987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f3227ec5a0 0x55f322897470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa88bc53080 1 --2- 172.21.15.55:0/633717987 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f3227ec1c0 0x55f3227ea310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa88bc53080 1 -- 172.21.15.55:0/633717987 >> 172.21.15.55:0/633717987 conn(0x55f32275abf0 msgr2=0x55f322775150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa88bc53080 1 -- 172.21.15.55:0/633717987 shutdown_connections 2024-04-02T07:31:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa88bc53080 1 -- 172.21.15.55:0/633717987 wait complete. 2024-04-02T07:31:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa88bc53080 1 Processor -- start 2024-04-02T07:31:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa88bc53080 1 -- start start 2024-04-02T07:31:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa88bc53080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f3227ec1c0 0x55f3228065a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa88bc53080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f3227ec5a0 0x55f3228021d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa88bc53080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f322803850 0x55f322772600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa88bc53080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3227e69e0 con 0x55f3227ec1c0 2024-04-02T07:31:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa88bc53080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f322806c40 con 0x55f3227ec5a0 2024-04-02T07:31:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa88bc53080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55f322806ee0 con 0x55f322803850 2024-04-02T07:31:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa888e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f3227ec1c0 0x55f3228065a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa888e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f3227ec1c0 0x55f3228065a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49560/0 (socket says 172.21.15.55:49560) 2024-04-02T07:31:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa888e00640 1 -- 172.21.15.55:0/460186305 learned_addr learned my addr 172.21.15.55:0/460186305 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa883e00640 1 --2- 172.21.15.55:0/460186305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f3227ec5a0 0x55f3228021d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa889800640 1 --2- 172.21.15.55:0/460186305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f322803850 0x55f322772600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa888e00640 1 -- 172.21.15.55:0/460186305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f322803850 msgr2=0x55f322772600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa888e00640 1 --2- 172.21.15.55:0/460186305 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55f322803850 0x55f322772600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa888e00640 1 -- 172.21.15.55:0/460186305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f3227ec5a0 msgr2=0x55f3228021d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa888e00640 1 --2- 172.21.15.55:0/460186305 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55f3227ec5a0 0x55f3228021d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa888e00640 1 -- 172.21.15.55:0/460186305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa884006da0 con 0x55f3227ec1c0 2024-04-02T07:31:50.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa888e00640 1 --2- 172.21.15.55:0/460186305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f3227ec1c0 0x55f3228065a0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fa87c008740 tx=0x7fa87c008c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:50.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa881600640 1 -- 172.21.15.55:0/460186305 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c00f040 con 0x55f3227ec1c0 2024-04-02T07:31:50.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa881600640 1 -- 172.21.15.55:0/460186305 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c010ba0 con 0x55f3227ec1c0 2024-04-02T07:31:50.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa88bc53080 1 -- 172.21.15.55:0/460186305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55f3226838c0 con 0x55f3227ec1c0 2024-04-02T07:31:50.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa881600640 1 -- 172.21.15.55:0/460186305 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87c015450 con 0x55f3227ec1c0 2024-04-02T07:31:50.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.541+0000 7fa88bc53080 1 -- 172.21.15.55:0/460186305 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f322676d00 con 0x55f3227ec1c0 2024-04-02T07:31:50.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.545+0000 7fa881600640 1 -- 172.21.15.55:0/460186305 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa87c0155b0 con 0x55f3227ec1c0 2024-04-02T07:31:50.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.545+0000 7fa881600640 1 --2- 172.21.15.55:0/460186305 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa868065070 0x7fa868067530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.545+0000 7fa881600640 1 -- 172.21.15.55:0/460186305 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa87c0839f0 con 0x55f3227ec1c0 2024-04-02T07:31:50.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.545+0000 7fa88bc53080 1 --2- 172.21.15.55:0/460186305 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x55f322775660 0x55f322805090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.545+0000 7fa88bc53080 1 -- 172.21.15.55:0/460186305 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [read 0~4194304] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e103) v8 -- 0x55f3228055d0 con 0x55f322775660 2024-04-02T07:31:50.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.545+0000 7fa883e00640 1 --2- 172.21.15.55:0/460186305 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa868065070 0x7fa868067530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.545+0000 7fa889800640 1 --2- 172.21.15.55:0/460186305 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x55f322775660 0x55f322805090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.545+0000 7fa883e00640 1 --2- 172.21.15.55:0/460186305 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa868065070 0x7fa868067530 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa8740ae000 tx=0x7fa8740a6070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:50.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.545+0000 7fa889800640 1 --2- 172.21.15.55:0/460186305 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x55f322775660 0x55f322805090 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:50.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.545+0000 7fa889800640 1 -- 172.21.15.55:0/460186305 <== osd.2 v2:172.21.15.55:6808/27394 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv3 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x7fa8840034e0 con 0x55f322775660 2024-04-02T07:31:50.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.545+0000 7fa88bc53080 1 -- 172.21.15.55:0/460186305 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x55f322775660 msgr2=0x55f322805090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:50.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.545+0000 7fa88bc53080 1 --2- 172.21.15.55:0/460186305 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x55f322775660 0x55f322805090 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.545+0000 7fa88bc53080 1 -- 172.21.15.55:0/460186305 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa868065070 msgr2=0x7fa868067530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:50.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.545+0000 7fa88bc53080 1 --2- 172.21.15.55:0/460186305 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa868065070 0x7fa868067530 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fa8740ae000 tx=0x7fa8740a6070 comp rx=0 tx=0).stop 2024-04-02T07:31:50.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.545+0000 7fa88bc53080 1 -- 172.21.15.55:0/460186305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f3227ec1c0 msgr2=0x55f3228065a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:50.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.545+0000 7fa88bc53080 1 --2- 172.21.15.55:0/460186305 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55f3227ec1c0 0x55f3228065a0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fa87c008740 tx=0x7fa87c008c00 comp rx=0 tx=0).stop 2024-04-02T07:31:50.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.545+0000 7fa889800640 1 -- 172.21.15.55:0/460186305 reap_dead start 2024-04-02T07:31:50.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.545+0000 7fa88bc53080 1 -- 172.21.15.55:0/460186305 shutdown_connections 2024-04-02T07:31:50.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.545+0000 7fa88bc53080 1 -- 172.21.15.55:0/460186305 >> 172.21.15.55:0/460186305 conn(0x55f32275abf0 msgr2=0x55f3227760d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:50.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.549+0000 7fa88bc53080 1 -- 172.21.15.55:0/460186305 shutdown_connections 2024-04-02T07:31:50.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.549+0000 7fa88bc53080 1 -- 172.21.15.55:0/460186305 wait complete. 2024-04-02T07:31:50.553 INFO:teuthology.orchestra.run.smithi055.stdout:����� 2024-04-02T07:31:50.554 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-02T07:31:50.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.737+0000 7fc2dac00640 1 Processor -- start 2024-04-02T07:31:50.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.741+0000 7fc2dac00640 1 -- start start 2024-04-02T07:31:50.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.741+0000 7fc2dac00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2d415ca70 0x7fc2d40b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.741+0000 7fc2dac00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc2d4098a10 0x7fc2d4098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.741+0000 7fc2dac00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2d40993b0 con 0x7fc2d406aff0 2024-04-02T07:31:50.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.741+0000 7fc2dac00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2d415ce50 con 0x7fc2d4098a10 2024-04-02T07:31:50.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.741+0000 7fc2dac00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d40cef60 con 0x7fc2d415ca70 2024-04-02T07:31:50.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.741+0000 7fc2cbe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc2d4098a10 0x7fc2d4098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.741+0000 7fc2d8c00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc2d406aff0 0x7fc2d406b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:57522/0 (socket says 172.21.15.55:57522) 2024-04-02T07:31:50.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.741+0000 7fc2d8c00640 1 -- 172.21.15.55:0/3254709136 learned_addr learned my addr 172.21.15.55:0/3254709136 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:50.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.741+0000 7fc2d3e00640 1 --2- 172.21.15.55:0/3254709136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2d415ca70 0x7fc2d40b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.741+0000 7fc2cbe00640 1 -- 172.21.15.55:0/3254709136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2d415ca70 msgr2=0x7fc2d40b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:50.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.741+0000 7fc2cbe00640 1 --2- 172.21.15.55:0/3254709136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2d415ca70 0x7fc2d40b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.741+0000 7fc2d3400640 1 -- 172.21.15.55:0/3254709136 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2397778309 0 0) 0x7fc2d40993b0 con 0x7fc2d406aff0 2024-04-02T07:31:50.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.741+0000 7fc2cbe00640 1 -- 172.21.15.55:0/3254709136 >> v1:172.21.15.106:6789/0 conn(0x7fc2d406aff0 legacy=0x7fc2d406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:50.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.741+0000 7fc2cbe00640 1 -- 172.21.15.55:0/3254709136 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d406bd60 con 0x7fc2d4098a10 2024-04-02T07:31:50.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.745+0000 7fc2cbe00640 1 --2- 172.21.15.55:0/3254709136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2d4098a10 0x7fc2d4098e70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0097c0 tx=0x7fc2bc01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b13738967bf71bb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:50.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.745+0000 7fc2d3400640 1 -- 172.21.15.55:0/3254709136 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0ad640 con 0x7fc2d4098a10 2024-04-02T07:31:50.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.745+0000 7fc2d3400640 1 -- 172.21.15.55:0/3254709136 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc0ad7a0 con 0x7fc2d4098a10 2024-04-02T07:31:50.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.745+0000 7fc2d3400640 1 -- 172.21.15.55:0/3254709136 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0adb30 con 0x7fc2d4098a10 2024-04-02T07:31:50.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.745+0000 7fc2dac00640 1 -- 172.21.15.55:0/3254709136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2d4098a10 msgr2=0x7fc2d4098e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:50.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.745+0000 7fc2dac00640 1 --2- 172.21.15.55:0/3254709136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2d4098a10 0x7fc2d4098e70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc0097c0 tx=0x7fc2bc01c4a0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.745+0000 7fc2dac00640 1 -- 172.21.15.55:0/3254709136 shutdown_connections 2024-04-02T07:31:50.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.745+0000 7fc2dac00640 1 --2- 172.21.15.55:0/3254709136 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2d4098a10 0x7fc2d4098e70 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.745+0000 7fc2dac00640 1 --2- 172.21.15.55:0/3254709136 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2d415ca70 0x7fc2d40b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.745+0000 7fc2dac00640 1 -- 172.21.15.55:0/3254709136 >> 172.21.15.55:0/3254709136 conn(0x7fc2d40b21d0 msgr2=0x7fc2d40b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:50.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.745+0000 7fc2dac00640 1 -- 172.21.15.55:0/3254709136 shutdown_connections 2024-04-02T07:31:50.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.745+0000 7fc2dac00640 1 -- 172.21.15.55:0/3254709136 wait complete. 2024-04-02T07:31:50.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.745+0000 7fc2dac00640 1 Processor -- start 2024-04-02T07:31:50.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.745+0000 7fc2dac00640 1 -- start start 2024-04-02T07:31:50.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2dac00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2d406aff0 0x7fc2d40b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2dac00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2d4098a10 0x7fc2d41536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2dac00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2d415ca70 0x7fc2d41528a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2dac00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d415cf90 con 0x7fc2d4098a10 2024-04-02T07:31:50.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2dac00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d4155dd0 con 0x7fc2d406aff0 2024-04-02T07:31:50.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2dac00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2d415ae80 con 0x7fc2d415ca70 2024-04-02T07:31:50.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2cbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2d4098a10 0x7fc2d41536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2cbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2d4098a10 0x7fc2d41536b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49572/0 (socket says 172.21.15.55:49572) 2024-04-02T07:31:50.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2cbe00640 1 -- 172.21.15.55:0/1674873422 learned_addr learned my addr 172.21.15.55:0/1674873422 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:50.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2d8c00640 1 --2- 172.21.15.55:0/1674873422 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2d415ca70 0x7fc2d41528a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2d3e00640 1 --2- 172.21.15.55:0/1674873422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2d406aff0 0x7fc2d40b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2cbe00640 1 -- 172.21.15.55:0/1674873422 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2d415ca70 msgr2=0x7fc2d41528a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:50.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2cbe00640 1 --2- 172.21.15.55:0/1674873422 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2d415ca70 0x7fc2d41528a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2cbe00640 1 -- 172.21.15.55:0/1674873422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2d406aff0 msgr2=0x7fc2d40b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:50.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2cbe00640 1 --2- 172.21.15.55:0/1674873422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2d406aff0 0x7fc2d40b08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2cbe00640 1 -- 172.21.15.55:0/1674873422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2bc009420 con 0x7fc2d4098a10 2024-04-02T07:31:50.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2cbe00640 1 --2- 172.21.15.55:0/1674873422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2d4098a10 0x7fc2d41536b0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc01a0d0 tx=0x7fc2bc019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:50.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2d0c00640 1 -- 172.21.15.55:0/1674873422 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc004220 con 0x7fc2d4098a10 2024-04-02T07:31:50.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2d0c00640 1 -- 172.21.15.55:0/1674873422 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2bc0a6040 con 0x7fc2d4098a10 2024-04-02T07:31:50.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2dac00640 1 -- 172.21.15.55:0/1674873422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2d415b160 con 0x7fc2d4098a10 2024-04-02T07:31:50.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2d0c00640 1 -- 172.21.15.55:0/1674873422 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc003620 con 0x7fc2d4098a10 2024-04-02T07:31:50.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2dac00640 1 -- 172.21.15.55:0/1674873422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2d4155a80 con 0x7fc2d4098a10 2024-04-02T07:31:50.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.749+0000 7fc2dac00640 1 -- 172.21.15.55:0/1674873422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2d415b610 con 0x7fc2d4098a10 2024-04-02T07:31:50.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.753+0000 7fc2d0c00640 1 -- 172.21.15.55:0/1674873422 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc2bc0b4040 con 0x7fc2d4098a10 2024-04-02T07:31:50.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.753+0000 7fc2d0c00640 1 --2- 172.21.15.55:0/1674873422 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2b0066690 0x7fc2b0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:50.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.753+0000 7fc2d0c00640 1 -- 172.21.15.55:0/1674873422 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2bc11d7f0 con 0x7fc2d4098a10 2024-04-02T07:31:50.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.753+0000 7fc2d3e00640 1 --2- 172.21.15.55:0/1674873422 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2b0066690 0x7fc2b0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:50.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.753+0000 7fc2d3e00640 1 --2- 172.21.15.55:0/1674873422 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2b0066690 0x7fc2b0068b50 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4009b60 tx=0x7fc2c4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:50.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.757+0000 7fc2d0c00640 1 -- 172.21.15.55:0/1674873422 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc2d415b610 con 0x7fc2d4098a10 2024-04-02T07:31:50.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.953+0000 7fc2dac00640 1 -- 172.21.15.55:0/1674873422 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc2d415b610 con 0x7fc2d4098a10 2024-04-02T07:31:50.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.953+0000 7fc2d0c00640 1 -- 172.21.15.55:0/1674873422 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v81) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc2d415b610 con 0x7fc2d4098a10 2024-04-02T07:31:50.955 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-02T07:31:50.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.957+0000 7fc2dac00640 1 -- 172.21.15.55:0/1674873422 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2b0066690 msgr2=0x7fc2b0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:50.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.957+0000 7fc2dac00640 1 --2- 172.21.15.55:0/1674873422 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2b0066690 0x7fc2b0068b50 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4009b60 tx=0x7fc2c4009190 comp rx=0 tx=0).stop 2024-04-02T07:31:50.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.957+0000 7fc2dac00640 1 -- 172.21.15.55:0/1674873422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2d4098a10 msgr2=0x7fc2d41536b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:50.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.957+0000 7fc2dac00640 1 --2- 172.21.15.55:0/1674873422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2d4098a10 0x7fc2d41536b0 secure :-1 s=READY pgs=1506 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc01a0d0 tx=0x7fc2bc019240 comp rx=0 tx=0).stop 2024-04-02T07:31:50.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.957+0000 7fc2dac00640 1 -- 172.21.15.55:0/1674873422 shutdown_connections 2024-04-02T07:31:50.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.957+0000 7fc2dac00640 1 --2- 172.21.15.55:0/1674873422 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc2d415ca70 0x7fc2d41528a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.957+0000 7fc2dac00640 1 --2- 172.21.15.55:0/1674873422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2d4098a10 0x7fc2d41536b0 unknown :-1 s=CLOSED pgs=1506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.957+0000 7fc2dac00640 1 --2- 172.21.15.55:0/1674873422 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc2b0066690 0x7fc2b0068b50 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.957+0000 7fc2dac00640 1 --2- 172.21.15.55:0/1674873422 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc2d406aff0 0x7fc2d40b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:50.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.957+0000 7fc2dac00640 1 -- 172.21.15.55:0/1674873422 >> 172.21.15.55:0/1674873422 conn(0x7fc2d40b21d0 msgr2=0x7fc2d4098e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:50.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.957+0000 7fc2dac00640 1 -- 172.21.15.55:0/1674873422 shutdown_connections 2024-04-02T07:31:50.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:50.957+0000 7fc2dac00640 1 -- 172.21.15.55:0/1674873422 wait complete. 2024-04-02T07:31:50.975 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-02T07:31:50.976 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-02T07:31:50.976 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-02T07:31:50.976 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-02T07:31:50.976 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-02T07:31:50.976 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-02T07:31:50.976 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-02T07:31:50.976 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-02T07:31:50.976 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:31:50.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:50.976 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-02T07:31:50.986 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:31:50.986 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:31:50.986 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:31:50.986 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:31:50.986 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-02T07:31:50.986 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:31:50.986 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:31:50.986 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:31:50.986 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-02T07:31:50.987 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:31:50.987 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:31:50.987 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-02T07:31:50.987 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-02T07:31:50.987 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:31:50.987 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-02T07:31:50.987 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-02T07:31:50.987 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41883sec preferred_lft 41883sec 2024-04-02T07:31:50.987 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2024-04-02T07:31:50.987 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:31:50.987 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:31:50.987 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:31:50.987 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-02T07:31:50.987 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-02T07:31:50.988 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:81:5a:89:17 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:31:50.988 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-02T07:31:50.988 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:31:50.988 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:31:50.988 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-02T07:31:50.988 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-02T07:31:50.988 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:31:50.988 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-02T07:31:50.988 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:31:50.988 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:31:50.988 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-02T07:31:50.988 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-02T07:31:50.988 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:31:50.988 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:31:50.989 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-02T07:31:50.989 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-02T07:31:50.989 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:31:50.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:50.989 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-02T07:31:51.050 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:31:51.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:51.052 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-02T07:31:51.105 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-02T07:31:51.106 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-02T07:31:51.106 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-02T07:31:51.106 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-02T07:31:51.106 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-02T07:31:51.106 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-02T07:31:51.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:51.106 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:31:51.106 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:31:51.106 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-02T07:31:51.106 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-02T07:31:51.107 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-02T07:31:51.107 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:31:51.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:51.197 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-02T07:31:51.206 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-02T07:31:51.206 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-02T07:31:51.206 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:31:51.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:51.207 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-02T07:31:51.268 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-02T07:31:51.269 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:31:51.269 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-02T07:31:51.320 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:31:51.320 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:31:51.321 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:31:51.372 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:31:51.432 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:31:51.433 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:31:51.494 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:31:51.496 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:31:51.496 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:51.496 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:31:51.552 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-02T07:31:51.552 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-02T07:31:51.599 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:31:51.619 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:31:51.619 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:31:51.682 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:31:51.684 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:31:51.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:51.685 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:31:51.694 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:2024-04-02T07:31:51.693+0000 7f01ed62b580 -1 init, newargv = 0x560c49484f10 newargc=15 2024-04-02T07:31:51.694 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[49866]: starting ceph client 2024-04-02T07:31:51.701 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[49866]: starting fuse 2024-04-02T07:31:51.702 INFO:teuthology.orchestra.run.smithi055.stdout:43 2024-04-02T07:31:51.702 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-02T07:31:51.702 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:31:51.702 DEBUG:teuthology.orchestra.run.smithi055:> import glob 2024-04-02T07:31:51.702 DEBUG:teuthology.orchestra.run.smithi055:> import re 2024-04-02T07:31:51.702 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:31:51.702 DEBUG:teuthology.orchestra.run.smithi055:> import subprocess 2024-04-02T07:31:51.702 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:31:51.702 DEBUG:teuthology.orchestra.run.smithi055:> def _find_admin_socket(client_name): 2024-04-02T07:31:51.702 DEBUG:teuthology.orchestra.run.smithi055:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-02T07:31:51.703 DEBUG:teuthology.orchestra.run.smithi055:> files = glob.glob(asok_path) 2024-04-02T07:31:51.703 DEBUG:teuthology.orchestra.run.smithi055:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-02T07:31:51.703 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:31:51.703 DEBUG:teuthology.orchestra.run.smithi055:> # Given a non-glob path, it better be there 2024-04-02T07:31:51.703 DEBUG:teuthology.orchestra.run.smithi055:> if "*" not in asok_path: 2024-04-02T07:31:51.703 DEBUG:teuthology.orchestra.run.smithi055:> assert(len(files) == 1) 2024-04-02T07:31:51.703 DEBUG:teuthology.orchestra.run.smithi055:> return files[0] 2024-04-02T07:31:51.703 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:31:51.703 DEBUG:teuthology.orchestra.run.smithi055:> for f in files: 2024-04-02T07:31:51.703 DEBUG:teuthology.orchestra.run.smithi055:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-02T07:31:51.703 DEBUG:teuthology.orchestra.run.smithi055:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-02T07:31:51.703 DEBUG:teuthology.orchestra.run.smithi055:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-02T07:31:51.703 DEBUG:teuthology.orchestra.run.smithi055:> contents = proc_f.read() 2024-04-02T07:31:51.703 DEBUG:teuthology.orchestra.run.smithi055:> if mountpoint in contents: 2024-04-02T07:31:51.703 DEBUG:teuthology.orchestra.run.smithi055:> return f 2024-04-02T07:31:51.703 DEBUG:teuthology.orchestra.run.smithi055:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-02T07:31:51.704 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:31:51.704 DEBUG:teuthology.orchestra.run.smithi055:> print(_find_admin_socket("client.0")) 2024-04-02T07:31:51.704 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:31:51.828 INFO:teuthology.orchestra.run.smithi055.stdout:/var/run/ceph/ceph-client.0.49866.asok 2024-04-02T07:31:52.013 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.49866.asok 2024-04-02T07:31:52.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:52.013 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.49866.asok status 2024-04-02T07:31:52.187 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:31:52.188 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": { 2024-04-02T07:31:52.188 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_sha1": "d0e392d9aee635f2b65768c460c7a151ead7a5e2", 2024-04-02T07:31:52.188 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)", 2024-04-02T07:31:52.188 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "0", 2024-04-02T07:31:52.188 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2024-04-02T07:31:52.188 INFO:teuthology.orchestra.run.smithi055.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-02T07:31:52.188 INFO:teuthology.orchestra.run.smithi055.stdout: "pid": "49866", 2024-04-02T07:31:52.188 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2024-04-02T07:31:52.188 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:52.188 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_count": 0, 2024-04-02T07:31:52.188 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_pinned_count": 0, 2024-04-02T07:31:52.188 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 8706, 2024-04-02T07:31:52.189 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": { 2024-04-02T07:31:52.189 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2024-04-02T07:31:52.189 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2024-04-02T07:31:52.189 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 8706 2024-04-02T07:31:52.189 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:52.189 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:31:52.189 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:31:52.189 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:31:52.189 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 1465287950 2024-04-02T07:31:52.189 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:31:52.189 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:52.189 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:31:52.189 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:31:52.189 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:31:52.190 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 1465287950 2024-04-02T07:31:52.190 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:31:52.190 INFO:teuthology.orchestra.run.smithi055.stdout: "inst_str": "client.8706 192.168.0.1:0/1465287950", 2024-04-02T07:31:52.190 INFO:teuthology.orchestra.run.smithi055.stdout: "addr_str": "192.168.0.1:0/1465287950", 2024-04-02T07:31:52.190 INFO:teuthology.orchestra.run.smithi055.stdout: "inode_count": 1, 2024-04-02T07:31:52.190 INFO:teuthology.orchestra.run.smithi055.stdout: "mds_epoch": 81, 2024-04-02T07:31:52.190 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch": 103, 2024-04-02T07:31:52.190 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch_barrier": 0, 2024-04-02T07:31:52.190 INFO:teuthology.orchestra.run.smithi055.stdout: "blocklisted": false, 2024-04-02T07:31:52.190 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs" 2024-04-02T07:31:52.190 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:31:52.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:52.204 DEBUG:teuthology.orchestra.run.smithi055:> stat --file-system '--printf=%T 2024-04-02T07:31:52.204 DEBUG:teuthology.orchestra.run.smithi055:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-02T07:31:52.213 INFO:teuthology.orchestra.run.smithi055.stdout:fuseblk 2024-04-02T07:31:52.213 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-02T07:31:52.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:52.213 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:31:52.280 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:31:52.280 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:31:52.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:52.329 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file2_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-02T07:31:52.464 INFO:teuthology.orchestra.run.smithi055.stderr:6+0 records in 2024-04-02T07:31:52.464 INFO:teuthology.orchestra.run.smithi055.stderr:6+0 records out 2024-04-02T07:31:52.464 INFO:teuthology.orchestra.run.smithi055.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.0745874 s, 84.4 MB/s 2024-04-02T07:31:52.465 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:31:52.465 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:31:52.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:52.474 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=file3_sixmegs bs=1M conv=fdatasync count=6 seek=0) 2024-04-02T07:31:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:6+0 records in 2024-04-02T07:31:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:6+0 records out 2024-04-02T07:31:52.606 INFO:teuthology.orchestra.run.smithi055.stderr:6291456 bytes (6.3 MB, 6.0 MiB) copied, 0.078363 s, 80.3 MB/s 2024-04-02T07:31:52.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:52.607 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-02T07:31:52.620 INFO:teuthology.orchestra.run.smithi055.stdout:./ 2024-04-02T07:31:52.620 INFO:teuthology.orchestra.run.smithi055.stdout:./file2_sixmegs 2024-04-02T07:31:52.620 INFO:teuthology.orchestra.run.smithi055.stdout:./file3_sixmegs 2024-04-02T07:31:52.620 INFO:teuthology.orchestra.run.smithi055.stdout:./file1_sixmegs 2024-04-02T07:31:52.621 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:31:52.621 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:31:52.621 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:31:52.622 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:31:52.622 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-02T07:31:52.622 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:31:52.732 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:31:52.922 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:31:52.922 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:31:52.922 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:31:52.922 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:31:52.922 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file2_sixmegs").st_ino) 2024-04-02T07:31:52.922 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:31:53.029 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627777 2024-04-02T07:31:53.219 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:31:53.219 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:31:53.219 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:31:53.219 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:31:53.219 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file3_sixmegs").st_ino) 2024-04-02T07:31:53.219 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:31:53.326 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627778 2024-04-02T07:31:53.515 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:31:53.515 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:31:53.515 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:31:53.515 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:31:53.515 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./file1_sixmegs").st_ino) 2024-04-02T07:31:53.515 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:31:53.620 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627776 2024-04-02T07:31:53.810 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:31:53.810 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:31:53.865 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:31:54.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.045+0000 7fe14d200640 1 Processor -- start 2024-04-02T07:31:54.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.045+0000 7fe14d200640 1 -- start start 2024-04-02T07:31:54.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.049+0000 7fe14d200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe1480b0cb0 0x7fe1480b3590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:54.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.049+0000 7fe14d200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe14815d010 0x7fe1480cbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:54.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.049+0000 7fe14d200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1480cac90 con 0x7fe1480c3680 2024-04-02T07:31:54.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.049+0000 7fe14d200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1480b1090 con 0x7fe1480b0cb0 2024-04-02T07:31:54.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.049+0000 7fe14d200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1480caf70 con 0x7fe14815d010 2024-04-02T07:31:54.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.049+0000 7fe146800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe14815d010 0x7fe1480cbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:54.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.049+0000 7fe145e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fe1480b0cb0 0x7fe1480b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:54.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.049+0000 7fe146800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe14815d010 0x7fe1480cbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:54082/0 (socket says 172.21.15.55:54082) 2024-04-02T07:31:54.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.049+0000 7fe146800640 1 -- 172.21.15.55:0/1175093581 learned_addr learned my addr 172.21.15.55:0/1175093581 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:54.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.049+0000 7fe145400640 1 -- 172.21.15.55:0/1175093581 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3713686522 0 0) 0x7fe1480cac90 con 0x7fe1480c3680 2024-04-02T07:31:54.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.049+0000 7fe145400640 1 -- 172.21.15.55:0/1175093581 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe12c003530 con 0x7fe1480c3680 2024-04-02T07:31:54.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.049+0000 7fe146800640 1 -- 172.21.15.55:0/1175093581 >> v2:172.21.15.106:3300/0 conn(0x7fe1480b0cb0 msgr2=0x7fe1480b3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:54.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.049+0000 7fe146800640 1 --2- 172.21.15.55:0/1175093581 >> v2:172.21.15.106:3300/0 conn(0x7fe1480b0cb0 0x7fe1480b3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.049+0000 7fe146800640 1 -- 172.21.15.55:0/1175093581 >> v1:172.21.15.106:6789/0 conn(0x7fe1480c3680 legacy=0x7fe14815c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:54.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.049+0000 7fe146800640 1 -- 172.21.15.55:0/1175093581 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1480b2d90 con 0x7fe14815d010 2024-04-02T07:31:54.051 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.049+0000 7fe145e00640 1 --2- 172.21.15.55:0/1175093581 >> v2:172.21.15.106:3300/0 conn(0x7fe1480b0cb0 0x7fe1480b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:31:54.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.053+0000 7fe146800640 1 --2- 172.21.15.55:0/1175093581 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe14815d010 0x7fe1480cbe50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe14000d150 tx=0x7fe14001ec00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=296ebcb5a4941ac3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:54.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.053+0000 7fe145400640 1 -- 172.21.15.55:0/1175093581 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1400a7c10 con 0x7fe14815d010 2024-04-02T07:31:54.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.053+0000 7fe145400640 1 -- 172.21.15.55:0/1175093581 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1400ab070 con 0x7fe14815d010 2024-04-02T07:31:54.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.053+0000 7fe145400640 1 -- 172.21.15.55:0/1175093581 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1400b1400 con 0x7fe14815d010 2024-04-02T07:31:54.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.053+0000 7fe14d200640 1 -- 172.21.15.55:0/1175093581 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe14815d010 msgr2=0x7fe1480cbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:54.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.053+0000 7fe14d200640 1 --2- 172.21.15.55:0/1175093581 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe14815d010 0x7fe1480cbe50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe14000d150 tx=0x7fe14001ec00 comp rx=0 tx=0).stop 2024-04-02T07:31:54.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.053+0000 7fe14d200640 1 -- 172.21.15.55:0/1175093581 shutdown_connections 2024-04-02T07:31:54.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.053+0000 7fe14d200640 1 --2- 172.21.15.55:0/1175093581 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe14815d010 0x7fe1480cbe50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.053+0000 7fe14d200640 1 --2- 172.21.15.55:0/1175093581 >> v2:172.21.15.106:3300/0 conn(0x7fe1480b0cb0 0x7fe1480b3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.053+0000 7fe14d200640 1 -- 172.21.15.55:0/1175093581 >> 172.21.15.55:0/1175093581 conn(0x7fe148066080 msgr2=0x7fe148069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:54.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.053+0000 7fe14d200640 1 -- 172.21.15.55:0/1175093581 shutdown_connections 2024-04-02T07:31:54.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.053+0000 7fe14d200640 1 -- 172.21.15.55:0/1175093581 wait complete. 2024-04-02T07:31:54.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.053+0000 7fe14d200640 1 Processor -- start 2024-04-02T07:31:54.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.053+0000 7fe14d200640 1 -- start start 2024-04-02T07:31:54.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe14d200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1480b0cb0 0x7fe148152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:54.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe14d200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1480c3680 0x7fe1481407a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:54.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe14d200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe14815d010 0x7fe148140ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:54.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe14d200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe148152650 con 0x7fe1480c3680 2024-04-02T07:31:54.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe14d200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe148132580 con 0x7fe1480b0cb0 2024-04-02T07:31:54.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe14d200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe148132860 con 0x7fe14815d010 2024-04-02T07:31:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe13fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1480c3680 0x7fe1481407a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe13fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1480c3680 0x7fe1481407a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49576/0 (socket says 172.21.15.55:49576) 2024-04-02T07:31:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe13fe00640 1 -- 172.21.15.55:0/3991387286 learned_addr learned my addr 172.21.15.55:0/3991387286 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe146800640 1 --2- 172.21.15.55:0/3991387286 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe14815d010 0x7fe148140ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe145e00640 1 --2- 172.21.15.55:0/3991387286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1480b0cb0 0x7fe148152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe13fe00640 1 -- 172.21.15.55:0/3991387286 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe14815d010 msgr2=0x7fe148140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe13fe00640 1 --2- 172.21.15.55:0/3991387286 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe14815d010 0x7fe148140ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe13fe00640 1 -- 172.21.15.55:0/3991387286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1480b0cb0 msgr2=0x7fe148152110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe13fe00640 1 --2- 172.21.15.55:0/3991387286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1480b0cb0 0x7fe148152110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe13fe00640 1 -- 172.21.15.55:0/3991387286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe138009420 con 0x7fe1480c3680 2024-04-02T07:31:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe13fe00640 1 --2- 172.21.15.55:0/3991387286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1480c3680 0x7fe1481407a0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fe13000c490 tx=0x7fe13000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe13e000640 1 -- 172.21.15.55:0/3991387286 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1300052d0 con 0x7fe1480c3680 2024-04-02T07:31:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe13e000640 1 -- 172.21.15.55:0/3991387286 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe130005430 con 0x7fe1480c3680 2024-04-02T07:31:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe13e000640 1 -- 172.21.15.55:0/3991387286 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe130012870 con 0x7fe1480c3680 2024-04-02T07:31:54.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe14d200640 1 -- 172.21.15.55:0/3991387286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe14000bd40 con 0x7fe1480c3680 2024-04-02T07:31:54.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe14d200640 1 -- 172.21.15.55:0/3991387286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe148132e20 con 0x7fe1480c3680 2024-04-02T07:31:54.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe14d200640 1 -- 172.21.15.55:0/3991387286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe148066c90 con 0x7fe1480c3680 2024-04-02T07:31:54.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.057+0000 7fe13e000640 1 -- 172.21.15.55:0/3991387286 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe1300129d0 con 0x7fe1480c3680 2024-04-02T07:31:54.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.061+0000 7fe13e000640 1 --2- 172.21.15.55:0/3991387286 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe124066690 0x7fe124068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:54.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.061+0000 7fe13e000640 1 -- 172.21.15.55:0/3991387286 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe130083be0 con 0x7fe1480c3680 2024-04-02T07:31:54.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.061+0000 7fe145e00640 1 --2- 172.21.15.55:0/3991387286 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe124066690 0x7fe124068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:54.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.061+0000 7fe145e00640 1 --2- 172.21.15.55:0/3991387286 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe124066690 0x7fe124068b50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe1480cd440 tx=0x7fe138009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:54.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.065+0000 7fe13e000640 1 -- 172.21.15.55:0/3991387286 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe130050ff0 con 0x7fe1480c3680 2024-04-02T07:31:54.227 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.225+0000 7fe14d200640 1 -- 172.21.15.55:0/3991387286 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe148152c00 con 0x7fe1480c3680 2024-04-02T07:31:54.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.229+0000 7fe13e000640 1 -- 172.21.15.55:0/3991387286 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+16051 (secure 0 0 0) 0x7fe130054610 con 0x7fe1480c3680 2024-04-02T07:31:54.229 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:54.229 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":103,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:31:31.706822+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:31:29.246681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-02T07:31:29.698823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:31:54.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.229+0000 7fe14d200640 1 -- 172.21.15.55:0/3991387286 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe124066690 msgr2=0x7fe124068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:54.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.229+0000 7fe14d200640 1 --2- 172.21.15.55:0/3991387286 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe124066690 0x7fe124068b50 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fe1480cd440 tx=0x7fe138009190 comp rx=0 tx=0).stop 2024-04-02T07:31:54.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.229+0000 7fe14d200640 1 -- 172.21.15.55:0/3991387286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1480c3680 msgr2=0x7fe1481407a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:54.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.229+0000 7fe14d200640 1 --2- 172.21.15.55:0/3991387286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1480c3680 0x7fe1481407a0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fe13000c490 tx=0x7fe13000c950 comp rx=0 tx=0).stop 2024-04-02T07:31:54.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.229+0000 7fe14d200640 1 -- 172.21.15.55:0/3991387286 shutdown_connections 2024-04-02T07:31:54.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.229+0000 7fe14d200640 1 --2- 172.21.15.55:0/3991387286 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe14815d010 0x7fe148140ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.229+0000 7fe14d200640 1 --2- 172.21.15.55:0/3991387286 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe1480c3680 0x7fe1481407a0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.229+0000 7fe14d200640 1 --2- 172.21.15.55:0/3991387286 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe124066690 0x7fe124068b50 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.229+0000 7fe14d200640 1 --2- 172.21.15.55:0/3991387286 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe1480b0cb0 0x7fe148152110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.229+0000 7fe14d200640 1 -- 172.21.15.55:0/3991387286 >> 172.21.15.55:0/3991387286 conn(0x7fe148066080 msgr2=0x7fe148159b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.229+0000 7fe14d200640 1 -- 172.21.15.55:0/3991387286 shutdown_connections 2024-04-02T07:31:54.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.229+0000 7fe14d200640 1 -- 172.21.15.55:0/3991387286 wait complete. 2024-04-02T07:31:54.251 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:31:29.246681+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:31:29.698823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:31:54.251 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:31:54.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.397+0000 7f3bc5a00640 1 Processor -- start 2024-04-02T07:31:54.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.397+0000 7f3bc5a00640 1 -- start start 2024-04-02T07:31:54.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.397+0000 7f3bc5a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3bc01637f0 0x7f3bc0165be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:54.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.397+0000 7f3bc5a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc015ada0 con 0x7f3bc006e710 2024-04-02T07:31:54.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.397+0000 7f3bc5a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc015f2b0 con 0x7f3bc00adb70 2024-04-02T07:31:54.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.397+0000 7f3bc5a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc006cb00 con 0x7f3bc01637f0 2024-04-02T07:31:54.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.397+0000 7f3bbf400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3bc01637f0 0x7f3bc0165be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:54.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.397+0000 7f3bb6000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3bc006e710 0x7f3bc015eba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49196/0 (socket says 172.21.15.55:49196) 2024-04-02T07:31:54.398 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.397+0000 7f3bb6000640 1 -- 172.21.15.55:0/1190582907 learned_addr learned my addr 172.21.15.55:0/1190582907 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:54.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.397+0000 7f3bbe000640 1 -- 172.21.15.55:0/1190582907 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3157141154 0 0) 0x7f3bc015ada0 con 0x7f3bc006e710 2024-04-02T07:31:54.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.397+0000 7f3bbe000640 1 -- 172.21.15.55:0/1190582907 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ba4003530 con 0x7f3bc006e710 2024-04-02T07:31:54.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.397+0000 7f3bbe000640 1 -- 172.21.15.55:0/1190582907 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 261312793 0 0) 0x7f3bc015f2b0 con 0x7f3bc00adb70 2024-04-02T07:31:54.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.397+0000 7f3bbf400640 1 -- 172.21.15.55:0/1190582907 >> v1:172.21.15.106:6789/0 conn(0x7f3bc00adb70 legacy=0x7f3bc015e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:54.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.397+0000 7f3bbf400640 1 -- 172.21.15.55:0/1190582907 >> v1:172.21.15.55:6789/0 conn(0x7f3bc006e710 legacy=0x7f3bc015eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:54.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.397+0000 7f3bbf400640 1 -- 172.21.15.55:0/1190582907 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc00cd030 con 0x7f3bc01637f0 2024-04-02T07:31:54.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.401+0000 7f3bbf400640 1 --2- 172.21.15.55:0/1190582907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bc01637f0 0x7f3bc0165be0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80097c0 tx=0x7f3bb801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd3f93c73d029d7b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:54.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.401+0000 7f3bbe000640 1 -- 172.21.15.55:0/1190582907 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb80ab670 con 0x7f3bc01637f0 2024-04-02T07:31:54.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.401+0000 7f3bbe000640 1 -- 172.21.15.55:0/1190582907 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb80ab7d0 con 0x7f3bc01637f0 2024-04-02T07:31:54.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.401+0000 7f3bbe000640 1 -- 172.21.15.55:0/1190582907 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb80abb60 con 0x7f3bc01637f0 2024-04-02T07:31:54.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.401+0000 7f3bc5a00640 1 -- 172.21.15.55:0/1190582907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bc01637f0 msgr2=0x7f3bc0165be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:54.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.401+0000 7f3bc5a00640 1 --2- 172.21.15.55:0/1190582907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bc01637f0 0x7f3bc0165be0 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80097c0 tx=0x7f3bb801c470 comp rx=0 tx=0).stop 2024-04-02T07:31:54.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.401+0000 7f3bc5a00640 1 -- 172.21.15.55:0/1190582907 shutdown_connections 2024-04-02T07:31:54.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.401+0000 7f3bc5a00640 1 --2- 172.21.15.55:0/1190582907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bc01637f0 0x7f3bc0165be0 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.401+0000 7f3bc5a00640 1 -- 172.21.15.55:0/1190582907 >> 172.21.15.55:0/1190582907 conn(0x7f3bc00cb7f0 msgr2=0x7f3bc00cbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:54.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.401+0000 7f3bc5a00640 1 -- 172.21.15.55:0/1190582907 shutdown_connections 2024-04-02T07:31:54.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.401+0000 7f3bc5a00640 1 -- 172.21.15.55:0/1190582907 wait complete. 2024-04-02T07:31:54.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.401+0000 7f3bc5a00640 1 Processor -- start 2024-04-02T07:31:54.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.401+0000 7f3bc5a00640 1 -- start start 2024-04-02T07:31:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bc5a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bc006e710 0x7f3bc0165af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:54.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bc5a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3bc00adb70 0x7f3bc015a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bc5a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3bc01637f0 0x7f3bc015e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bc5a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc015bc00 con 0x7f3bc006e710 2024-04-02T07:31:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bc5a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc015aff0 con 0x7f3bc00adb70 2024-04-02T07:31:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bc5a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc015b2d0 con 0x7f3bc01637f0 2024-04-02T07:31:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bbea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bc006e710 0x7f3bc0165af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bbea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bc006e710 0x7f3bc0165af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49590/0 (socket says 172.21.15.55:49590) 2024-04-02T07:31:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bbea00640 1 -- 172.21.15.55:0/2621573083 learned_addr learned my addr 172.21.15.55:0/2621573083 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bb6000640 1 --2- 172.21.15.55:0/2621573083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3bc00adb70 0x7f3bc015a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bbf400640 1 --2- 172.21.15.55:0/2621573083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3bc01637f0 0x7f3bc015e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bbea00640 1 -- 172.21.15.55:0/2621573083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3bc01637f0 msgr2=0x7f3bc015e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bbea00640 1 --2- 172.21.15.55:0/2621573083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3bc01637f0 0x7f3bc015e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bbea00640 1 -- 172.21.15.55:0/2621573083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3bc00adb70 msgr2=0x7f3bc015a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:54.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bbea00640 1 --2- 172.21.15.55:0/2621573083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3bc00adb70 0x7f3bc015a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bbea00640 1 -- 172.21.15.55:0/2621573083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb8009420 con 0x7f3bc006e710 2024-04-02T07:31:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bb6000640 1 --2- 172.21.15.55:0/2621573083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3bc00adb70 0x7f3bc015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bbf400640 1 --2- 172.21.15.55:0/2621573083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3bc01637f0 0x7f3bc015e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bbea00640 1 --2- 172.21.15.55:0/2621573083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bc006e710 0x7f3bc0165af0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0001570 tx=0x7f3bb000cd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bb7400640 1 -- 172.21.15.55:0/2621573083 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0003db0 con 0x7f3bc006e710 2024-04-02T07:31:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bb7400640 1 -- 172.21.15.55:0/2621573083 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb0005070 con 0x7f3bc006e710 2024-04-02T07:31:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bc5a00640 1 -- 172.21.15.55:0/2621573083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc015b5b0 con 0x7f3bc006e710 2024-04-02T07:31:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bb7400640 1 -- 172.21.15.55:0/2621573083 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb0005420 con 0x7f3bc006e710 2024-04-02T07:31:54.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bc5a00640 1 -- 172.21.15.55:0/2621573083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc014c6f0 con 0x7f3bc006e710 2024-04-02T07:31:54.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.405+0000 7f3bc5a00640 1 -- 172.21.15.55:0/2621573083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc0066c90 con 0x7f3bc006e710 2024-04-02T07:31:54.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.409+0000 7f3bb7400640 1 -- 172.21.15.55:0/2621573083 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3bb0005580 con 0x7f3bc006e710 2024-04-02T07:31:54.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.409+0000 7f3bb7400640 1 --2- 172.21.15.55:0/2621573083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3b9c0666c0 0x7f3b9c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:54.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.409+0000 7f3bb7400640 1 -- 172.21.15.55:0/2621573083 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bb0083b70 con 0x7f3bc006e710 2024-04-02T07:31:54.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.409+0000 7f3bb6000640 1 --2- 172.21.15.55:0/2621573083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3b9c0666c0 0x7f3b9c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:54.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.409+0000 7f3bb6000640 1 --2- 172.21.15.55:0/2621573083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3b9c0666c0 0x7f3b9c068b80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3bc01555f0 tx=0x7f3ba8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:54.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.413+0000 7f3bb7400640 1 -- 172.21.15.55:0/2621573083 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3bb0050e40 con 0x7f3bc006e710 2024-04-02T07:31:54.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.573+0000 7f3bc5a00640 1 -- 172.21.15.55:0/2621573083 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3bc0071980 con 0x7f3bc006e710 2024-04-02T07:31:54.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.573+0000 7f3bb7400640 1 -- 172.21.15.55:0/2621573083 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3bb0017070 con 0x7f3bc006e710 2024-04-02T07:31:54.576 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:31:54.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.577+0000 7f3bc5a00640 1 -- 172.21.15.55:0/2621573083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3b9c0666c0 msgr2=0x7f3b9c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:54.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.577+0000 7f3bc5a00640 1 --2- 172.21.15.55:0/2621573083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3b9c0666c0 0x7f3b9c068b80 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f3bc01555f0 tx=0x7f3ba8009040 comp rx=0 tx=0).stop 2024-04-02T07:31:54.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.577+0000 7f3bc5a00640 1 -- 172.21.15.55:0/2621573083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bc006e710 msgr2=0x7f3bc0165af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:54.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.577+0000 7f3bc5a00640 1 --2- 172.21.15.55:0/2621573083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bc006e710 0x7f3bc0165af0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f3bb0001570 tx=0x7f3bb000cd00 comp rx=0 tx=0).stop 2024-04-02T07:31:54.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.577+0000 7f3bc5a00640 1 -- 172.21.15.55:0/2621573083 shutdown_connections 2024-04-02T07:31:54.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.577+0000 7f3bc5a00640 1 --2- 172.21.15.55:0/2621573083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3bc01637f0 0x7f3bc015e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.577+0000 7f3bc5a00640 1 --2- 172.21.15.55:0/2621573083 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3b9c0666c0 0x7f3b9c068b80 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.577+0000 7f3bc5a00640 1 --2- 172.21.15.55:0/2621573083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3bc00adb70 0x7f3bc015a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.577+0000 7f3bc5a00640 1 --2- 172.21.15.55:0/2621573083 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3bc006e710 0x7f3bc0165af0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.577+0000 7f3bc5a00640 1 -- 172.21.15.55:0/2621573083 >> 172.21.15.55:0/2621573083 conn(0x7f3bc00cb7f0 msgr2=0x7f3bc00aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:54.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.577+0000 7f3bc5a00640 1 -- 172.21.15.55:0/2621573083 shutdown_connections 2024-04-02T07:31:54.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.577+0000 7f3bc5a00640 1 -- 172.21.15.55:0/2621573083 wait complete. 2024-04-02T07:31:54.597 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:31:54.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.741+0000 7ff80f000640 1 Processor -- start 2024-04-02T07:31:54.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.741+0000 7ff80f000640 1 -- start start 2024-04-02T07:31:54.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.741+0000 7ff80f000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff808144260 0x7ff8080702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:54.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.741+0000 7ff80f000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff8080b31a0 0x7ff8080b1670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:54.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.741+0000 7ff80f000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff80815e3a0 con 0x7ff8080707e0 2024-04-02T07:31:54.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.741+0000 7ff80f000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8080b35d0 con 0x7ff8080b31a0 2024-04-02T07:31:54.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.741+0000 7ff80f000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8080b37c0 con 0x7ff808144260 2024-04-02T07:31:54.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.741+0000 7ff7ff400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff8080707e0 0x7ff8080b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49208/0 (socket says 172.21.15.55:49208) 2024-04-02T07:31:54.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.741+0000 7ff7ff400640 1 -- 172.21.15.55:0/1378395101 learned_addr learned my addr 172.21.15.55:0/1378395101 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:54.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.741+0000 7ff80d000640 1 --2- 172.21.15.55:0/1378395101 >> v2:172.21.15.55:3300/0 conn(0x7ff8080b31a0 0x7ff8080b1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:54.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.741+0000 7ff807e00640 1 --2- 172.21.15.55:0/1378395101 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff808144260 0x7ff8080702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:54.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.741+0000 7ff807400640 1 -- 172.21.15.55:0/1378395101 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1910913647 0 0) 0x7ff80815e3a0 con 0x7ff8080707e0 2024-04-02T07:31:54.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.741+0000 7ff807400640 1 -- 172.21.15.55:0/1378395101 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7ec003530 con 0x7ff8080707e0 2024-04-02T07:31:54.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.741+0000 7ff80d000640 1 -- 172.21.15.55:0/1378395101 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff808144260 msgr2=0x7ff8080702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:54.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.741+0000 7ff80d000640 1 --2- 172.21.15.55:0/1378395101 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff808144260 0x7ff8080702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.741+0000 7ff80d000640 1 -- 172.21.15.55:0/1378395101 >> v1:172.21.15.55:6789/0 conn(0x7ff8080707e0 legacy=0x7ff8080b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:54.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.741+0000 7ff80d000640 1 -- 172.21.15.55:0/1378395101 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff808070c60 con 0x7ff8080b31a0 2024-04-02T07:31:54.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.745+0000 7ff80d000640 1 --2- 172.21.15.55:0/1378395101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8080b31a0 0x7ff8080b1670 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7ff8000097c0 tx=0x7ff80001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cafcc50b05e8f6e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:54.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.745+0000 7ff807400640 1 -- 172.21.15.55:0/1378395101 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8000ad640 con 0x7ff8080b31a0 2024-04-02T07:31:54.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.745+0000 7ff807400640 1 -- 172.21.15.55:0/1378395101 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8000ad7a0 con 0x7ff8080b31a0 2024-04-02T07:31:54.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.745+0000 7ff807400640 1 -- 172.21.15.55:0/1378395101 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8000adb10 con 0x7ff8080b31a0 2024-04-02T07:31:54.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.745+0000 7ff80f000640 1 -- 172.21.15.55:0/1378395101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8080b31a0 msgr2=0x7ff8080b1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:54.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.745+0000 7ff80f000640 1 --2- 172.21.15.55:0/1378395101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8080b31a0 0x7ff8080b1670 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7ff8000097c0 tx=0x7ff80001c4a0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.745+0000 7ff80f000640 1 -- 172.21.15.55:0/1378395101 shutdown_connections 2024-04-02T07:31:54.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.745+0000 7ff80f000640 1 --2- 172.21.15.55:0/1378395101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8080b31a0 0x7ff8080b1670 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.745+0000 7ff80f000640 1 --2- 172.21.15.55:0/1378395101 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff808144260 0x7ff8080702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.745+0000 7ff80f000640 1 -- 172.21.15.55:0/1378395101 >> 172.21.15.55:0/1378395101 conn(0x7ff80806a390 msgr2=0x7ff8080b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:54.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.745+0000 7ff80f000640 1 -- 172.21.15.55:0/1378395101 shutdown_connections 2024-04-02T07:31:54.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.745+0000 7ff80f000640 1 -- 172.21.15.55:0/1378395101 wait complete. 2024-04-02T07:31:54.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff80f000640 1 Processor -- start 2024-04-02T07:31:54.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff80f000640 1 -- start start 2024-04-02T07:31:54.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff80f000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8080707e0 0x7ff80813d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:54.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff80f000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8080b31a0 0x7ff80813ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:54.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff80f000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff808144260 0x7ff80813bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:54.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff80f000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8081f92c0 con 0x7ff8080707e0 2024-04-02T07:31:54.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff80f000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8081f86d0 con 0x7ff808144260 2024-04-02T07:31:54.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff80f000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff80813b2a0 con 0x7ff8080b31a0 2024-04-02T07:31:54.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff807e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8080707e0 0x7ff80813d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:54.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff807e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8080707e0 0x7ff80813d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49606/0 (socket says 172.21.15.55:49606) 2024-04-02T07:31:54.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff807e00640 1 -- 172.21.15.55:0/3639051917 learned_addr learned my addr 172.21.15.55:0/3639051917 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:54.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff7ff400640 1 --2- 172.21.15.55:0/3639051917 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8080b31a0 0x7ff80813ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:54.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff80d000640 1 --2- 172.21.15.55:0/3639051917 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff808144260 0x7ff80813bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:54.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff807e00640 1 -- 172.21.15.55:0/3639051917 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8080b31a0 msgr2=0x7ff80813ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:54.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff807e00640 1 --2- 172.21.15.55:0/3639051917 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8080b31a0 0x7ff80813ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff807e00640 1 -- 172.21.15.55:0/3639051917 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff808144260 msgr2=0x7ff80813bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:54.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff807e00640 1 --2- 172.21.15.55:0/3639051917 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff808144260 0x7ff80813bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff807e00640 1 -- 172.21.15.55:0/3639051917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff800009420 con 0x7ff8080707e0 2024-04-02T07:31:54.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff80d000640 1 --2- 172.21.15.55:0/3639051917 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff808144260 0x7ff80813bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:54.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff7ff400640 1 --2- 172.21.15.55:0/3639051917 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8080b31a0 0x7ff80813ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:54.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff807e00640 1 --2- 172.21.15.55:0/3639051917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8080707e0 0x7ff80813d760 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800e870 tx=0x7ff7f800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:54.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff804c00640 1 -- 172.21.15.55:0/3639051917 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f8009510 con 0x7ff8080707e0 2024-04-02T07:31:54.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff804c00640 1 -- 172.21.15.55:0/3639051917 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7f800eec0 con 0x7ff8080707e0 2024-04-02T07:31:54.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff804c00640 1 -- 172.21.15.55:0/3639051917 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f800cb40 con 0x7ff8080707e0 2024-04-02T07:31:54.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff80f000640 1 -- 172.21.15.55:0/3639051917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8081f8920 con 0x7ff8080707e0 2024-04-02T07:31:54.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.749+0000 7ff80f000640 1 -- 172.21.15.55:0/3639051917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8081f8ee0 con 0x7ff8080707e0 2024-04-02T07:31:54.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.753+0000 7ff80f000640 1 -- 172.21.15.55:0/3639051917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff808073530 con 0x7ff8080707e0 2024-04-02T07:31:54.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.753+0000 7ff804c00640 1 -- 172.21.15.55:0/3639051917 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff7f800cca0 con 0x7ff8080707e0 2024-04-02T07:31:54.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.753+0000 7ff804c00640 1 --2- 172.21.15.55:0/3639051917 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff7e4066690 0x7ff7e4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:54.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.753+0000 7ff804c00640 1 -- 172.21.15.55:0/3639051917 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7f80842a0 con 0x7ff8080707e0 2024-04-02T07:31:54.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.753+0000 7ff7ff400640 1 --2- 172.21.15.55:0/3639051917 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff7e4066690 0x7ff7e4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:54.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.753+0000 7ff7ff400640 1 --2- 172.21.15.55:0/3639051917 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff7e4066690 0x7ff7e4068b50 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff808071280 tx=0x7ff7f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:54.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.757+0000 7ff804c00640 1 -- 172.21.15.55:0/3639051917 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff7f8051600 con 0x7ff8080707e0 2024-04-02T07:31:54.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.917+0000 7ff80f000640 1 -- 172.21.15.55:0/3639051917 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff808066c90 con 0x7ff8080707e0 2024-04-02T07:31:54.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.917+0000 7ff804c00640 1 -- 172.21.15.55:0/3639051917 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v103) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff7f8054c20 con 0x7ff8080707e0 2024-04-02T07:31:54.918 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:31:54.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.917+0000 7ff80f000640 1 -- 172.21.15.55:0/3639051917 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff7e4066690 msgr2=0x7ff7e4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:54.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.917+0000 7ff80f000640 1 --2- 172.21.15.55:0/3639051917 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff7e4066690 0x7ff7e4068b50 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7ff808071280 tx=0x7ff7f0009040 comp rx=0 tx=0).stop 2024-04-02T07:31:54.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.917+0000 7ff80f000640 1 -- 172.21.15.55:0/3639051917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8080707e0 msgr2=0x7ff80813d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:54.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.917+0000 7ff80f000640 1 --2- 172.21.15.55:0/3639051917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8080707e0 0x7ff80813d760 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7ff7f800e870 tx=0x7ff7f800ec70 comp rx=0 tx=0).stop 2024-04-02T07:31:54.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.917+0000 7ff80f000640 1 -- 172.21.15.55:0/3639051917 shutdown_connections 2024-04-02T07:31:54.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.917+0000 7ff80f000640 1 --2- 172.21.15.55:0/3639051917 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff7e4066690 0x7ff7e4068b50 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.917+0000 7ff80f000640 1 --2- 172.21.15.55:0/3639051917 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff808144260 0x7ff80813bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.917+0000 7ff80f000640 1 --2- 172.21.15.55:0/3639051917 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff8080b31a0 0x7ff80813ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.917+0000 7ff80f000640 1 --2- 172.21.15.55:0/3639051917 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8080707e0 0x7ff80813d760 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:54.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.917+0000 7ff80f000640 1 -- 172.21.15.55:0/3639051917 >> 172.21.15.55:0/3639051917 conn(0x7ff80806a390 msgr2=0x7ff80815a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:54.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.917+0000 7ff80f000640 1 -- 172.21.15.55:0/3639051917 shutdown_connections 2024-04-02T07:31:54.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:54.917+0000 7ff80f000640 1 -- 172.21.15.55:0/3639051917 wait complete. 2024-04-02T07:31:54.939 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:31:55.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.081+0000 7fd51ce00640 1 Processor -- start 2024-04-02T07:31:55.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.081+0000 7fd51ce00640 1 -- start start 2024-04-02T07:31:55.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.081+0000 7fd51ce00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd5181590d0 0x7fd5180ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:55.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.081+0000 7fd51ce00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd51815cb10 0x7fd51815cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:55.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.081+0000 7fd51ce00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd5180702a0 0x7fd518070730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:55.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.081+0000 7fd51ce00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd518070c70 con 0x7fd5180702a0 2024-04-02T07:31:55.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.081+0000 7fd51ce00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5180cd4e0 con 0x7fd5181590d0 2024-04-02T07:31:55.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.081+0000 7fd51ce00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51815d640 con 0x7fd51815cb10 2024-04-02T07:31:55.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.081+0000 7fd516800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd5180702a0 0x7fd518070730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:55.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.081+0000 7fd516800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd5180702a0 0x7fd518070730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49614/0 (socket says 172.21.15.55:49614) 2024-04-02T07:31:55.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.081+0000 7fd516800640 1 -- 172.21.15.55:0/2178334105 learned_addr learned my addr 172.21.15.55:0/2178334105 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:55.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.081+0000 7fd515e00640 1 --2- 172.21.15.55:0/2178334105 >> v2:172.21.15.106:3300/0 conn(0x7fd5181590d0 0x7fd5180ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:55.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.081+0000 7fd50fe00640 1 --2- 172.21.15.55:0/2178334105 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd51815cb10 0x7fd51815cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:55.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.081+0000 7fd516800640 1 -- 172.21.15.55:0/2178334105 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd51815cb10 msgr2=0x7fd51815cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:55.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.081+0000 7fd516800640 1 --2- 172.21.15.55:0/2178334105 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd51815cb10 0x7fd51815cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.081+0000 7fd516800640 1 -- 172.21.15.55:0/2178334105 >> v2:172.21.15.106:3300/0 conn(0x7fd5181590d0 msgr2=0x7fd5180ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:55.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.081+0000 7fd516800640 1 --2- 172.21.15.55:0/2178334105 >> v2:172.21.15.106:3300/0 conn(0x7fd5181590d0 0x7fd5180ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.081+0000 7fd516800640 1 -- 172.21.15.55:0/2178334105 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51815d920 con 0x7fd5180702a0 2024-04-02T07:31:55.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.085+0000 7fd516800640 1 --2- 172.21.15.55:0/2178334105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5180702a0 0x7fd518070730 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fd518070e40 tx=0x7fd51001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9415d509fa889b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:55.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.085+0000 7fd515400640 1 -- 172.21.15.55:0/2178334105 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5100a5730 con 0x7fd5180702a0 2024-04-02T07:31:55.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.085+0000 7fd515400640 1 -- 172.21.15.55:0/2178334105 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5100a5890 con 0x7fd5180702a0 2024-04-02T07:31:55.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.085+0000 7fd515400640 1 -- 172.21.15.55:0/2178334105 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5100a5c20 con 0x7fd5180702a0 2024-04-02T07:31:55.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.085+0000 7fd51ce00640 1 -- 172.21.15.55:0/2178334105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5180702a0 msgr2=0x7fd518070730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:55.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.085+0000 7fd51ce00640 1 --2- 172.21.15.55:0/2178334105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5180702a0 0x7fd518070730 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7fd518070e40 tx=0x7fd51001c930 comp rx=0 tx=0).stop 2024-04-02T07:31:55.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.085+0000 7fd51ce00640 1 -- 172.21.15.55:0/2178334105 shutdown_connections 2024-04-02T07:31:55.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.085+0000 7fd51ce00640 1 --2- 172.21.15.55:0/2178334105 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5180702a0 0x7fd518070730 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.085+0000 7fd51ce00640 1 --2- 172.21.15.55:0/2178334105 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd51815cb10 0x7fd51815cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.085+0000 7fd51ce00640 1 --2- 172.21.15.55:0/2178334105 >> v2:172.21.15.106:3300/0 conn(0x7fd5181590d0 0x7fd5180ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.085+0000 7fd51ce00640 1 -- 172.21.15.55:0/2178334105 >> 172.21.15.55:0/2178334105 conn(0x7fd51806a390 msgr2=0x7fd5180b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:55.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.085+0000 7fd51ce00640 1 -- 172.21.15.55:0/2178334105 shutdown_connections 2024-04-02T07:31:55.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.085+0000 7fd51ce00640 1 -- 172.21.15.55:0/2178334105 wait complete. 2024-04-02T07:31:55.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd51ce00640 1 Processor -- start 2024-04-02T07:31:55.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd51ce00640 1 -- start start 2024-04-02T07:31:55.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd51ce00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5180702a0 0x7fd51814f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:55.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd51ce00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5181590d0 0x7fd5180ac260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:55.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd51ce00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd51815cb10 0x7fd5181463f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:55.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd51ce00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd518149f50 con 0x7fd5180702a0 2024-04-02T07:31:55.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd51ce00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd518149c20 con 0x7fd51815cb10 2024-04-02T07:31:55.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd51ce00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5180ad210 con 0x7fd5181590d0 2024-04-02T07:31:55.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd515e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5180702a0 0x7fd51814f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:55.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd515e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5180702a0 0x7fd51814f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49620/0 (socket says 172.21.15.55:49620) 2024-04-02T07:31:55.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd515e00640 1 -- 172.21.15.55:0/3604507993 learned_addr learned my addr 172.21.15.55:0/3604507993 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:55.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd516800640 1 --2- 172.21.15.55:0/3604507993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd51815cb10 0x7fd5181463f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:55.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd50fe00640 1 --2- 172.21.15.55:0/3604507993 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5181590d0 0x7fd5180ac260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:55.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd515e00640 1 -- 172.21.15.55:0/3604507993 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5181590d0 msgr2=0x7fd5180ac260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:55.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd515e00640 1 --2- 172.21.15.55:0/3604507993 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5181590d0 0x7fd5180ac260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd515e00640 1 -- 172.21.15.55:0/3604507993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd51815cb10 msgr2=0x7fd5181463f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:55.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd515e00640 1 --2- 172.21.15.55:0/3604507993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd51815cb10 0x7fd5181463f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd515e00640 1 -- 172.21.15.55:0/3604507993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd510009b30 con 0x7fd5180702a0 2024-04-02T07:31:55.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd515e00640 1 --2- 172.21.15.55:0/3604507993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5180702a0 0x7fd51814f9b0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fd50800d830 tx=0x7fd50800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:55.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd50e000640 1 -- 172.21.15.55:0/3604507993 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5080096a0 con 0x7fd5180702a0 2024-04-02T07:31:55.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd50e000640 1 -- 172.21.15.55:0/3604507993 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd508009800 con 0x7fd5180702a0 2024-04-02T07:31:55.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd50e000640 1 -- 172.21.15.55:0/3604507993 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd508009b70 con 0x7fd5180702a0 2024-04-02T07:31:55.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd51ce00640 1 -- 172.21.15.55:0/3604507993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5180b1de0 con 0x7fd5180702a0 2024-04-02T07:31:55.093 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.089+0000 7fd51ce00640 1 -- 172.21.15.55:0/3604507993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5180acc50 con 0x7fd5180702a0 2024-04-02T07:31:55.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.093+0000 7fd51ce00640 1 -- 172.21.15.55:0/3604507993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd518073530 con 0x7fd5180702a0 2024-04-02T07:31:55.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.093+0000 7fd50e000640 1 -- 172.21.15.55:0/3604507993 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd508014410 con 0x7fd5180702a0 2024-04-02T07:31:55.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.093+0000 7fd50e000640 1 --2- 172.21.15.55:0/3604507993 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd4f40666c0 0x7fd4f4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:55.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.093+0000 7fd50e000640 1 -- 172.21.15.55:0/3604507993 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd508084930 con 0x7fd5180702a0 2024-04-02T07:31:55.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.093+0000 7fd50fe00640 1 --2- 172.21.15.55:0/3604507993 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd4f40666c0 0x7fd4f4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:55.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.093+0000 7fd50fe00640 1 --2- 172.21.15.55:0/3604507993 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd4f40666c0 0x7fd4f4068b80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd51814bd90 tx=0x7fd500008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:55.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.097+0000 7fd50e000640 1 -- 172.21.15.55:0/3604507993 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd508051d50 con 0x7fd5180702a0 2024-04-02T07:31:55.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.261+0000 7fd51ce00640 1 -- 172.21.15.55:0/3604507993 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd518066c90 con 0x7fd5180702a0 2024-04-02T07:31:55.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.261+0000 7fd50e000640 1 -- 172.21.15.55:0/3604507993 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v103) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd508055370 con 0x7fd5180702a0 2024-04-02T07:31:55.262 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:31:55.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.261+0000 7fd51ce00640 1 -- 172.21.15.55:0/3604507993 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd4f40666c0 msgr2=0x7fd4f4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:55.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.261+0000 7fd51ce00640 1 --2- 172.21.15.55:0/3604507993 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd4f40666c0 0x7fd4f4068b80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fd51814bd90 tx=0x7fd500008040 comp rx=0 tx=0).stop 2024-04-02T07:31:55.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.261+0000 7fd51ce00640 1 -- 172.21.15.55:0/3604507993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5180702a0 msgr2=0x7fd51814f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:55.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.261+0000 7fd51ce00640 1 --2- 172.21.15.55:0/3604507993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5180702a0 0x7fd51814f9b0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7fd50800d830 tx=0x7fd50800dcf0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.261+0000 7fd51ce00640 1 -- 172.21.15.55:0/3604507993 shutdown_connections 2024-04-02T07:31:55.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.261+0000 7fd51ce00640 1 --2- 172.21.15.55:0/3604507993 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd4f40666c0 0x7fd4f4068b80 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.261+0000 7fd51ce00640 1 --2- 172.21.15.55:0/3604507993 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd51815cb10 0x7fd5181463f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.261+0000 7fd51ce00640 1 --2- 172.21.15.55:0/3604507993 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd5181590d0 0x7fd5180ac260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.261+0000 7fd51ce00640 1 --2- 172.21.15.55:0/3604507993 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd5180702a0 0x7fd51814f9b0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.261+0000 7fd51ce00640 1 -- 172.21.15.55:0/3604507993 >> 172.21.15.55:0/3604507993 conn(0x7fd51806a390 msgr2=0x7fd518153e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:55.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.261+0000 7fd51ce00640 1 -- 172.21.15.55:0/3604507993 shutdown_connections 2024-04-02T07:31:55.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.261+0000 7fd51ce00640 1 -- 172.21.15.55:0/3604507993 wait complete. 2024-04-02T07:31:55.284 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:31:55.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.425+0000 7f62e5800640 1 Processor -- start 2024-04-02T07:31:55.426 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.425+0000 7f62e5800640 1 -- start start 2024-04-02T07:31:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.425+0000 7f62e5800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62e0160580 0x7f62e0098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.425+0000 7f62e5800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f62e00b19b0 0x7f62e0098f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.425+0000 7f62e5800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62e00cfee0 con 0x7f62e01601a0 2024-04-02T07:31:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.425+0000 7f62e5800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62e00d04a0 con 0x7f62e00b19b0 2024-04-02T07:31:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.425+0000 7f62e5800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e00cfcf0 con 0x7f62e0160580 2024-04-02T07:31:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.425+0000 7f62dea00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f62e01601a0 0x7f62e00cf5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:49216/0 (socket says 172.21.15.55:49216) 2024-04-02T07:31:55.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.425+0000 7f62dea00640 1 -- 172.21.15.55:0/2461091429 learned_addr learned my addr 172.21.15.55:0/2461091429 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.425+0000 7f62df400640 1 --2- 172.21.15.55:0/2461091429 >> v2:172.21.15.55:3300/0 conn(0x7f62e00b19b0 0x7f62e0098f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.425+0000 7f62d7e00640 1 --2- 172.21.15.55:0/2461091429 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62e0160580 0x7f62e0098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.425+0000 7f62de000640 1 -- 172.21.15.55:0/2461091429 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3365226311 0 0) 0x7f62e00cfee0 con 0x7f62e01601a0 2024-04-02T07:31:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.425+0000 7f62df400640 1 -- 172.21.15.55:0/2461091429 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62e0160580 msgr2=0x7f62e0098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.425+0000 7f62df400640 1 --2- 172.21.15.55:0/2461091429 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62e0160580 0x7f62e0098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.425+0000 7f62df400640 1 -- 172.21.15.55:0/2461091429 >> v1:172.21.15.55:6789/0 conn(0x7f62e01601a0 legacy=0x7f62e00cf5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:55.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.425+0000 7f62df400640 1 -- 172.21.15.55:0/2461091429 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62e00d01c0 con 0x7f62e00b19b0 2024-04-02T07:31:55.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.429+0000 7f62df400640 1 --2- 172.21.15.55:0/2461091429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62e00b19b0 0x7f62e0098f50 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009d90 tx=0x7f62d801c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21127e3505ee3f8b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:55.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.429+0000 7f62de000640 1 -- 172.21.15.55:0/2461091429 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d80a58e0 con 0x7f62e00b19b0 2024-04-02T07:31:55.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.429+0000 7f62de000640 1 -- 172.21.15.55:0/2461091429 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62d80a5a40 con 0x7f62e00b19b0 2024-04-02T07:31:55.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.429+0000 7f62de000640 1 -- 172.21.15.55:0/2461091429 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62d80a5dd0 con 0x7f62e00b19b0 2024-04-02T07:31:55.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.429+0000 7f62e5800640 1 -- 172.21.15.55:0/2461091429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62e00b19b0 msgr2=0x7f62e0098f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:55.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.429+0000 7f62e5800640 1 --2- 172.21.15.55:0/2461091429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62e00b19b0 0x7f62e0098f50 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7f62d8009d90 tx=0x7f62d801c820 comp rx=0 tx=0).stop 2024-04-02T07:31:55.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.429+0000 7f62e5800640 1 -- 172.21.15.55:0/2461091429 shutdown_connections 2024-04-02T07:31:55.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.429+0000 7f62e5800640 1 --2- 172.21.15.55:0/2461091429 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62e0160580 0x7f62e0098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.429+0000 7f62e5800640 1 --2- 172.21.15.55:0/2461091429 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62e00b19b0 0x7f62e0098f50 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.429+0000 7f62e5800640 1 -- 172.21.15.55:0/2461091429 >> 172.21.15.55:0/2461091429 conn(0x7f62e00b2150 msgr2=0x7f62e00b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:55.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.429+0000 7f62e5800640 1 -- 172.21.15.55:0/2461091429 shutdown_connections 2024-04-02T07:31:55.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.429+0000 7f62e5800640 1 -- 172.21.15.55:0/2461091429 wait complete. 2024-04-02T07:31:55.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62e5800640 1 Processor -- start 2024-04-02T07:31:55.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62e5800640 1 -- start start 2024-04-02T07:31:55.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62e5800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62e00b19b0 0x7f62e00cd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:55.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62e5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62e01601a0 0x7f62e00c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:55.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62e5800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62e0160580 0x7f62e015e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:55.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62e5800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e0153a40 con 0x7f62e01601a0 2024-04-02T07:31:55.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62e5800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e00c61d0 con 0x7f62e0160580 2024-04-02T07:31:55.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62e5800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62e00c6470 con 0x7f62e00b19b0 2024-04-02T07:31:55.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62d7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62e01601a0 0x7f62e00c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:55.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62d7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62e01601a0 0x7f62e00c5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49642/0 (socket says 172.21.15.55:49642) 2024-04-02T07:31:55.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62d7e00640 1 -- 172.21.15.55:0/1872052749 learned_addr learned my addr 172.21.15.55:0/1872052749 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:55.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62dea00640 1 --2- 172.21.15.55:0/1872052749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62e00b19b0 0x7f62e00cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:55.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62df400640 1 --2- 172.21.15.55:0/1872052749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62e0160580 0x7f62e015e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:55.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62d7e00640 1 -- 172.21.15.55:0/1872052749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62e00b19b0 msgr2=0x7f62e00cd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:55.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62d7e00640 1 --2- 172.21.15.55:0/1872052749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62e00b19b0 0x7f62e00cd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62d7e00640 1 -- 172.21.15.55:0/1872052749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62e0160580 msgr2=0x7f62e015e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:55.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62d7e00640 1 --2- 172.21.15.55:0/1872052749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62e0160580 0x7f62e015e7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62d7e00640 1 -- 172.21.15.55:0/1872052749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d8009a70 con 0x7f62e01601a0 2024-04-02T07:31:55.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62df400640 1 --2- 172.21.15.55:0/1872052749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62e0160580 0x7f62e015e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:55.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62d7e00640 1 --2- 172.21.15.55:0/1872052749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62e01601a0 0x7f62e00c5c90 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f62c800d5f0 tx=0x7f62c800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:55.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62d6a00640 1 -- 172.21.15.55:0/1872052749 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c80125f0 con 0x7f62e01601a0 2024-04-02T07:31:55.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62d6a00640 1 -- 172.21.15.55:0/1872052749 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c8012750 con 0x7f62e01601a0 2024-04-02T07:31:55.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62d6a00640 1 -- 172.21.15.55:0/1872052749 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c8012ae0 con 0x7f62e01601a0 2024-04-02T07:31:55.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62e5800640 1 -- 172.21.15.55:0/1872052749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e0153c90 con 0x7f62e01601a0 2024-04-02T07:31:55.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62e5800640 1 -- 172.21.15.55:0/1872052749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e0154250 con 0x7f62e01601a0 2024-04-02T07:31:55.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.433+0000 7f62e5800640 1 -- 172.21.15.55:0/1872052749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e00723d0 con 0x7f62e01601a0 2024-04-02T07:31:55.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.437+0000 7f62d6a00640 1 -- 172.21.15.55:0/1872052749 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f62c8012c40 con 0x7f62e01601a0 2024-04-02T07:31:55.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.437+0000 7f62d6a00640 1 --2- 172.21.15.55:0/1872052749 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f62bc0666c0 0x7f62bc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:55.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.437+0000 7f62d6a00640 1 -- 172.21.15.55:0/1872052749 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f62c8084560 con 0x7f62e01601a0 2024-04-02T07:31:55.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.437+0000 7f62dea00640 1 --2- 172.21.15.55:0/1872052749 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f62bc0666c0 0x7f62bc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:55.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.437+0000 7f62dea00640 1 --2- 172.21.15.55:0/1872052749 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f62bc0666c0 0x7f62bc068b80 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f62d0007fd0 tx=0x7f62d0007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:55.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.441+0000 7f62d6a00640 1 -- 172.21.15.55:0/1872052749 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f62c80518c0 con 0x7f62e01601a0 2024-04-02T07:31:55.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.613+0000 7f62e5800640 1 -- 172.21.15.55:0/1872052749 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f62e0066c90 con 0x7f62e01601a0 2024-04-02T07:31:55.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.613+0000 7f62d6a00640 1 -- 172.21.15.55:0/1872052749 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v103) v1 ==== 80+0+0 (secure 0 0 0) 0x7f62c8004650 con 0x7f62e01601a0 2024-04-02T07:31:55.614 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:31:55.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.613+0000 7f62e5800640 1 -- 172.21.15.55:0/1872052749 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f62bc0666c0 msgr2=0x7f62bc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:55.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.613+0000 7f62e5800640 1 --2- 172.21.15.55:0/1872052749 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f62bc0666c0 0x7f62bc068b80 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f62d0007fd0 tx=0x7f62d0007d60 comp rx=0 tx=0).stop 2024-04-02T07:31:55.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.613+0000 7f62e5800640 1 -- 172.21.15.55:0/1872052749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62e01601a0 msgr2=0x7f62e00c5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:55.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.613+0000 7f62e5800640 1 --2- 172.21.15.55:0/1872052749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62e01601a0 0x7f62e00c5c90 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f62c800d5f0 tx=0x7f62c800dab0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.613+0000 7f62e5800640 1 -- 172.21.15.55:0/1872052749 shutdown_connections 2024-04-02T07:31:55.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.613+0000 7f62e5800640 1 --2- 172.21.15.55:0/1872052749 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f62bc0666c0 0x7f62bc068b80 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.613+0000 7f62e5800640 1 --2- 172.21.15.55:0/1872052749 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62e0160580 0x7f62e015e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.613+0000 7f62e5800640 1 --2- 172.21.15.55:0/1872052749 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62e01601a0 0x7f62e00c5c90 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.613+0000 7f62e5800640 1 --2- 172.21.15.55:0/1872052749 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62e00b19b0 0x7f62e00cd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.613+0000 7f62e5800640 1 -- 172.21.15.55:0/1872052749 >> 172.21.15.55:0/1872052749 conn(0x7f62e00b2150 msgr2=0x7f62e006b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:55.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.613+0000 7f62e5800640 1 -- 172.21.15.55:0/1872052749 shutdown_connections 2024-04-02T07:31:55.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.613+0000 7f62e5800640 1 -- 172.21.15.55:0/1872052749 wait complete. 2024-04-02T07:31:55.638 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:31:55.639 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:31:55.647 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:31:55.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.825+0000 7fec4a400640 1 Processor -- start 2024-04-02T07:31:55.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.825+0000 7fec4a400640 1 -- start start 2024-04-02T07:31:55.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.825+0000 7fec4a400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fec440d0050 0x7fec44099120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:55.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.829+0000 7fec4a400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec440af460 con 0x7fec440cadf0 2024-04-02T07:31:55.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.829+0000 7fec4a400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec440cf0f0 con 0x7fec4415ff90 2024-04-02T07:31:55.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.829+0000 7fec4a400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec440af690 con 0x7fec440d0050 2024-04-02T07:31:55.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.829+0000 7fec49a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fec440cadf0 0x7fec440cb260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43300/0 (socket says 172.21.15.55:43300) 2024-04-02T07:31:55.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.829+0000 7fec49a00640 1 -- 172.21.15.55:0/4043057427 learned_addr learned my addr 172.21.15.55:0/4043057427 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:55.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.829+0000 7fec43e00640 1 --2- 172.21.15.55:0/4043057427 >> v2:172.21.15.106:3300/0 conn(0x7fec440d0050 0x7fec44099120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:55.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.829+0000 7fec43400640 1 -- 172.21.15.55:0/4043057427 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109463350 0 0) 0x7fec440af460 con 0x7fec440cadf0 2024-04-02T07:31:55.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.829+0000 7fec43400640 1 -- 172.21.15.55:0/4043057427 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec2c003530 con 0x7fec440cadf0 2024-04-02T07:31:55.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.829+0000 7fec43e00640 1 -- 172.21.15.55:0/4043057427 >> v1:172.21.15.106:6789/0 conn(0x7fec4415ff90 legacy=0x7fec44098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:55.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.829+0000 7fec43400640 1 -- 172.21.15.55:0/4043057427 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3874768559 0 0) 0x7fec440cf0f0 con 0x7fec4415ff90 2024-04-02T07:31:55.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.829+0000 7fec43e00640 1 -- 172.21.15.55:0/4043057427 >> v1:172.21.15.55:6789/0 conn(0x7fec440cadf0 legacy=0x7fec440cb260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:55.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.829+0000 7fec43e00640 1 -- 172.21.15.55:0/4043057427 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec440cf3b0 con 0x7fec440d0050 2024-04-02T07:31:55.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.833+0000 7fec43e00640 1 --2- 172.21.15.55:0/4043057427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec440d0050 0x7fec44099120 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fec300097c0 tx=0x7fec3001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65cf0d9061cc4c4c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:55.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.833+0000 7fec43400640 1 -- 172.21.15.55:0/4043057427 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec300ab670 con 0x7fec440d0050 2024-04-02T07:31:55.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.833+0000 7fec43400640 1 -- 172.21.15.55:0/4043057427 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec300ab7d0 con 0x7fec440d0050 2024-04-02T07:31:55.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.833+0000 7fec43400640 1 -- 172.21.15.55:0/4043057427 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec300abb60 con 0x7fec440d0050 2024-04-02T07:31:55.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.833+0000 7fec4a400640 1 -- 172.21.15.55:0/4043057427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec440d0050 msgr2=0x7fec44099120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:55.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.833+0000 7fec4a400640 1 --2- 172.21.15.55:0/4043057427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec440d0050 0x7fec44099120 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fec300097c0 tx=0x7fec3001c470 comp rx=0 tx=0).stop 2024-04-02T07:31:55.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.833+0000 7fec4a400640 1 -- 172.21.15.55:0/4043057427 shutdown_connections 2024-04-02T07:31:55.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.833+0000 7fec4a400640 1 --2- 172.21.15.55:0/4043057427 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec440d0050 0x7fec44099120 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.833+0000 7fec4a400640 1 -- 172.21.15.55:0/4043057427 >> 172.21.15.55:0/4043057427 conn(0x7fec440b1fb0 msgr2=0x7fec440b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:55.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.833+0000 7fec4a400640 1 -- 172.21.15.55:0/4043057427 shutdown_connections 2024-04-02T07:31:55.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.833+0000 7fec4a400640 1 -- 172.21.15.55:0/4043057427 wait complete. 2024-04-02T07:31:55.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.833+0000 7fec4a400640 1 Processor -- start 2024-04-02T07:31:55.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.833+0000 7fec4a400640 1 -- start start 2024-04-02T07:31:55.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.833+0000 7fec4a400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec440cadf0 0x7fec44154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:55.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.833+0000 7fec4a400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec440d0050 0x7fec441400c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:55.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.833+0000 7fec4a400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec4415ff90 0x7fec441576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:55.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.833+0000 7fec4a400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec441572a0 con 0x7fec4415ff90 2024-04-02T07:31:55.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.833+0000 7fec4a400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec44140600 con 0x7fec440cadf0 2024-04-02T07:31:55.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.833+0000 7fec4a400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec44156620 con 0x7fec440d0050 2024-04-02T07:31:55.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec49a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec4415ff90 0x7fec441576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:55.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec49a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec4415ff90 0x7fec441576c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36894/0 (socket says 172.21.15.55:36894) 2024-04-02T07:31:55.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec49a00640 1 -- 172.21.15.55:0/960520477 learned_addr learned my addr 172.21.15.55:0/960520477 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:55.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec43e00640 1 --2- 172.21.15.55:0/960520477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec440d0050 0x7fec441400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:55.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec49000640 1 --2- 172.21.15.55:0/960520477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec440cadf0 0x7fec44154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:55.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec49a00640 1 -- 172.21.15.55:0/960520477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec440d0050 msgr2=0x7fec441400c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:55.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec49a00640 1 --2- 172.21.15.55:0/960520477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec440d0050 0x7fec441400c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec49a00640 1 -- 172.21.15.55:0/960520477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec440cadf0 msgr2=0x7fec44154690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:55.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec49a00640 1 --2- 172.21.15.55:0/960520477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec440cadf0 0x7fec44154690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:55.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec49a00640 1 -- 172.21.15.55:0/960520477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec30009420 con 0x7fec4415ff90 2024-04-02T07:31:55.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec43e00640 1 --2- 172.21.15.55:0/960520477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec440d0050 0x7fec441400c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:55.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec49a00640 1 --2- 172.21.15.55:0/960520477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec4415ff90 0x7fec441576c0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00caa0 tx=0x7fec3c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:55.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec40c00640 1 -- 172.21.15.55:0/960520477 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c00ac00 con 0x7fec4415ff90 2024-04-02T07:31:55.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec40c00640 1 -- 172.21.15.55:0/960520477 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3c00ad60 con 0x7fec4415ff90 2024-04-02T07:31:55.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec40c00640 1 -- 172.21.15.55:0/960520477 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3c012620 con 0x7fec4415ff90 2024-04-02T07:31:55.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec4a400640 1 -- 172.21.15.55:0/960520477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec44156900 con 0x7fec4415ff90 2024-04-02T07:31:55.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec4a400640 1 -- 172.21.15.55:0/960520477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec44156ec0 con 0x7fec4415ff90 2024-04-02T07:31:55.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec4a400640 1 -- 172.21.15.55:0/960520477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec441573e0 con 0x7fec4415ff90 2024-04-02T07:31:55.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec40c00640 1 -- 172.21.15.55:0/960520477 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fec3c007070 con 0x7fec4415ff90 2024-04-02T07:31:55.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec40c00640 1 --2- 172.21.15.55:0/960520477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec240666c0 0x7fec24068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:55.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.837+0000 7fec40c00640 1 -- 172.21.15.55:0/960520477 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec3c084190 con 0x7fec4415ff90 2024-04-02T07:31:55.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.841+0000 7fec49000640 1 --2- 172.21.15.55:0/960520477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec240666c0 0x7fec24068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:55.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.841+0000 7fec49000640 1 --2- 172.21.15.55:0/960520477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec240666c0 0x7fec24068b80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fec38000f70 tx=0x7fec38009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:55.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:55.841+0000 7fec40c00640 1 -- 172.21.15.55:0/960520477 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fec441573e0 con 0x7fec4415ff90 2024-04-02T07:31:56.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.005+0000 7fec4a400640 1 -- 172.21.15.55:0/960520477 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec441573e0 con 0x7fec4415ff90 2024-04-02T07:31:56.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.005+0000 7fec40c00640 1 -- 172.21.15.55:0/960520477 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v103) v1 ==== 74+0+16051 (secure 0 0 0) 0x7fec441573e0 con 0x7fec4415ff90 2024-04-02T07:31:56.006 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:31:56.006 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":103,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:31:31.706822+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:31:29.246681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-02T07:31:29.698823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:31:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.005+0000 7fec4a400640 1 -- 172.21.15.55:0/960520477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec240666c0 msgr2=0x7fec24068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.005+0000 7fec4a400640 1 --2- 172.21.15.55:0/960520477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec240666c0 0x7fec24068b80 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fec38000f70 tx=0x7fec38009040 comp rx=0 tx=0).stop 2024-04-02T07:31:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.005+0000 7fec4a400640 1 -- 172.21.15.55:0/960520477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec4415ff90 msgr2=0x7fec441576c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.005+0000 7fec4a400640 1 --2- 172.21.15.55:0/960520477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec4415ff90 0x7fec441576c0 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fec3c00caa0 tx=0x7fec3c00cf60 comp rx=0 tx=0).stop 2024-04-02T07:31:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.005+0000 7fec4a400640 1 -- 172.21.15.55:0/960520477 shutdown_connections 2024-04-02T07:31:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.005+0000 7fec4a400640 1 --2- 172.21.15.55:0/960520477 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec4415ff90 0x7fec441576c0 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.005+0000 7fec4a400640 1 --2- 172.21.15.55:0/960520477 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec440d0050 0x7fec441400c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.005+0000 7fec4a400640 1 --2- 172.21.15.55:0/960520477 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec240666c0 0x7fec24068b80 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.005+0000 7fec4a400640 1 --2- 172.21.15.55:0/960520477 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec440cadf0 0x7fec44154690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.005+0000 7fec4a400640 1 -- 172.21.15.55:0/960520477 >> 172.21.15.55:0/960520477 conn(0x7fec440b1fb0 msgr2=0x7fec4406b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:56.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.005+0000 7fec4a400640 1 -- 172.21.15.55:0/960520477 shutdown_connections 2024-04-02T07:31:56.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.005+0000 7fec4a400640 1 -- 172.21.15.55:0/960520477 wait complete. 2024-04-02T07:31:56.028 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:31:29.246681+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:31:29.698823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:31:56.028 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:31:56.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.169+0000 7fd11ce00640 1 Processor -- start 2024-04-02T07:31:56.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.169+0000 7fd11ce00640 1 -- start start 2024-04-02T07:31:56.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.169+0000 7fd11ce00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd1180ccfa0 0x7fd11815cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:56.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.169+0000 7fd11ce00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd11815d050 0x7fd1180702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:56.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.169+0000 7fd11ce00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1180cd430 con 0x7fd1181590d0 2024-04-02T07:31:56.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.169+0000 7fd11ce00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd11815d460 con 0x7fd1180ccfa0 2024-04-02T07:31:56.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.169+0000 7fd11ce00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1180b1190 con 0x7fd11815d050 2024-04-02T07:31:56.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.169+0000 7fd10d400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd1180ccfa0 0x7fd11815cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:56.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.169+0000 7fd10d400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd1180ccfa0 0x7fd11815cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36900/0 (socket says 172.21.15.55:36900) 2024-04-02T07:31:56.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.173+0000 7fd10d400640 1 -- 172.21.15.55:0/3014033744 learned_addr learned my addr 172.21.15.55:0/3014033744 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:56.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.173+0000 7fd116800640 1 --2- 172.21.15.55:0/3014033744 >> v2:172.21.15.106:3300/0 conn(0x7fd11815d050 0x7fd1180702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:56.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.173+0000 7fd10d400640 1 -- 172.21.15.55:0/3014033744 >> v2:172.21.15.106:3300/0 conn(0x7fd11815d050 msgr2=0x7fd1180702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:56.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.173+0000 7fd10d400640 1 --2- 172.21.15.55:0/3014033744 >> v2:172.21.15.106:3300/0 conn(0x7fd11815d050 0x7fd1180702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.173+0000 7fd10d400640 1 -- 172.21.15.55:0/3014033744 >> v1:172.21.15.106:6789/0 conn(0x7fd1181590d0 legacy=0x7fd1180b0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:56.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.173+0000 7fd10d400640 1 -- 172.21.15.55:0/3014033744 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd11815d640 con 0x7fd1180ccfa0 2024-04-02T07:31:56.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.173+0000 7fd10d400640 1 --2- 172.21.15.55:0/3014033744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1180ccfa0 0x7fd11815cb10 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fd1180ce1d0 tx=0x7fd10001eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19bfa092008f7c44 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:56.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.173+0000 7fd115400640 1 -- 172.21.15.55:0/3014033744 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1000a7b10 con 0x7fd1180ccfa0 2024-04-02T07:31:56.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.173+0000 7fd115400640 1 -- 172.21.15.55:0/3014033744 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1000a7c70 con 0x7fd1180ccfa0 2024-04-02T07:31:56.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.173+0000 7fd115400640 1 -- 172.21.15.55:0/3014033744 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1000af440 con 0x7fd1180ccfa0 2024-04-02T07:31:56.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd11ce00640 1 -- 172.21.15.55:0/3014033744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1180ccfa0 msgr2=0x7fd11815cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:56.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd11ce00640 1 --2- 172.21.15.55:0/3014033744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1180ccfa0 0x7fd11815cb10 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fd1180ce1d0 tx=0x7fd10001eb30 comp rx=0 tx=0).stop 2024-04-02T07:31:56.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd11ce00640 1 -- 172.21.15.55:0/3014033744 shutdown_connections 2024-04-02T07:31:56.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd11ce00640 1 --2- 172.21.15.55:0/3014033744 >> v2:172.21.15.106:3300/0 conn(0x7fd11815d050 0x7fd1180702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd11ce00640 1 --2- 172.21.15.55:0/3014033744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1180ccfa0 0x7fd11815cb10 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd11ce00640 1 -- 172.21.15.55:0/3014033744 >> 172.21.15.55:0/3014033744 conn(0x7fd11806a390 msgr2=0x7fd1180b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:56.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd11ce00640 1 -- 172.21.15.55:0/3014033744 shutdown_connections 2024-04-02T07:31:56.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd11ce00640 1 -- 172.21.15.55:0/3014033744 wait complete. 2024-04-02T07:31:56.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd11ce00640 1 Processor -- start 2024-04-02T07:31:56.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd11ce00640 1 -- start start 2024-04-02T07:31:56.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd11ce00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1180ccfa0 0x7fd11814c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:56.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd11ce00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1181590d0 0x7fd118155bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:56.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd11ce00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd11815d050 0x7fd118157330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:56.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd11ce00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11814c590 con 0x7fd11815d050 2024-04-02T07:31:56.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd11ce00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd118154b50 con 0x7fd1181590d0 2024-04-02T07:31:56.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd11ce00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd118154e10 con 0x7fd1180ccfa0 2024-04-02T07:31:56.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd116800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd11815d050 0x7fd118157330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:56.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd116800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd11815d050 0x7fd118157330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36914/0 (socket says 172.21.15.55:36914) 2024-04-02T07:31:56.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd116800640 1 -- 172.21.15.55:0/1520827237 learned_addr learned my addr 172.21.15.55:0/1520827237 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:56.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd115e00640 1 --2- 172.21.15.55:0/1520827237 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1180ccfa0 0x7fd11814c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:56.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd10d400640 1 --2- 172.21.15.55:0/1520827237 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1181590d0 0x7fd118155bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:56.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd116800640 1 -- 172.21.15.55:0/1520827237 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1180ccfa0 msgr2=0x7fd11814c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:56.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd116800640 1 --2- 172.21.15.55:0/1520827237 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1180ccfa0 0x7fd11814c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd116800640 1 -- 172.21.15.55:0/1520827237 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1181590d0 msgr2=0x7fd118155bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:56.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd116800640 1 --2- 172.21.15.55:0/1520827237 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1181590d0 0x7fd118155bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd116800640 1 -- 172.21.15.55:0/1520827237 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10000b770 con 0x7fd11815d050 2024-04-02T07:31:56.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd116800640 1 --2- 172.21.15.55:0/1520827237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd11815d050 0x7fd118157330 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fd11000d560 tx=0x7fd11000da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:56.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.177+0000 7fd10ea00640 1 -- 172.21.15.55:0/1520827237 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1100125f0 con 0x7fd11815d050 2024-04-02T07:31:56.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.181+0000 7fd10ea00640 1 -- 172.21.15.55:0/1520827237 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd110012770 con 0x7fd11815d050 2024-04-02T07:31:56.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.181+0000 7fd10ea00640 1 -- 172.21.15.55:0/1520827237 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd110012b20 con 0x7fd11815d050 2024-04-02T07:31:56.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.181+0000 7fd11ce00640 1 -- 172.21.15.55:0/1520827237 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1180b1de0 con 0x7fd11815d050 2024-04-02T07:31:56.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.181+0000 7fd11ce00640 1 -- 172.21.15.55:0/1520827237 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1181553d0 con 0x7fd11815d050 2024-04-02T07:31:56.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.181+0000 7fd11ce00640 1 -- 172.21.15.55:0/1520827237 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd118073530 con 0x7fd11815d050 2024-04-02T07:31:56.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.181+0000 7fd10ea00640 1 -- 172.21.15.55:0/1520827237 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd110012c80 con 0x7fd11815d050 2024-04-02T07:31:56.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.181+0000 7fd10ea00640 1 --2- 172.21.15.55:0/1520827237 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd0f4066690 0x7fd0f4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:56.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.181+0000 7fd10ea00640 1 -- 172.21.15.55:0/1520827237 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1100845a0 con 0x7fd11815d050 2024-04-02T07:31:56.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.181+0000 7fd115e00640 1 --2- 172.21.15.55:0/1520827237 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd0f4066690 0x7fd0f4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:56.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.181+0000 7fd115e00640 1 --2- 172.21.15.55:0/1520827237 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd0f4066690 0x7fd0f4068b50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd1080012f0 tx=0x7fd108009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:56.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.185+0000 7fd10ea00640 1 -- 172.21.15.55:0/1520827237 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd110051920 con 0x7fd11815d050 2024-04-02T07:31:56.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.345+0000 7fd11ce00640 1 -- 172.21.15.55:0/1520827237 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd118066c90 con 0x7fd11815d050 2024-04-02T07:31:56.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.345+0000 7fd10ea00640 1 -- 172.21.15.55:0/1520827237 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v103) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd110054f40 con 0x7fd11815d050 2024-04-02T07:31:56.348 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:31:56.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.349+0000 7fd11ce00640 1 -- 172.21.15.55:0/1520827237 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd0f4066690 msgr2=0x7fd0f4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:56.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.349+0000 7fd11ce00640 1 --2- 172.21.15.55:0/1520827237 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd0f4066690 0x7fd0f4068b50 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd1080012f0 tx=0x7fd108009040 comp rx=0 tx=0).stop 2024-04-02T07:31:56.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.349+0000 7fd11ce00640 1 -- 172.21.15.55:0/1520827237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd11815d050 msgr2=0x7fd118157330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:56.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.349+0000 7fd11ce00640 1 --2- 172.21.15.55:0/1520827237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd11815d050 0x7fd118157330 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fd11000d560 tx=0x7fd11000da20 comp rx=0 tx=0).stop 2024-04-02T07:31:56.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.349+0000 7fd11ce00640 1 -- 172.21.15.55:0/1520827237 shutdown_connections 2024-04-02T07:31:56.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.349+0000 7fd11ce00640 1 --2- 172.21.15.55:0/1520827237 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd11815d050 0x7fd118157330 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.349+0000 7fd11ce00640 1 --2- 172.21.15.55:0/1520827237 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd0f4066690 0x7fd0f4068b50 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.349+0000 7fd11ce00640 1 --2- 172.21.15.55:0/1520827237 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1181590d0 0x7fd118155bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.349+0000 7fd11ce00640 1 --2- 172.21.15.55:0/1520827237 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1180ccfa0 0x7fd11814c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.349+0000 7fd11ce00640 1 -- 172.21.15.55:0/1520827237 >> 172.21.15.55:0/1520827237 conn(0x7fd11806a390 msgr2=0x7fd11814fe20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:56.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.349+0000 7fd11ce00640 1 -- 172.21.15.55:0/1520827237 shutdown_connections 2024-04-02T07:31:56.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.349+0000 7fd11ce00640 1 -- 172.21.15.55:0/1520827237 wait complete. 2024-04-02T07:31:56.369 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:31:56.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.513+0000 7f85ce400640 1 Processor -- start 2024-04-02T07:31:56.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.513+0000 7f85ce400640 1 -- start start 2024-04-02T07:31:56.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.513+0000 7f85ce400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f85c80cea00 0x7f85c80cd120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:56.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.513+0000 7f85ce400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f85c8069d90 0x7f85c80cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:56.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.513+0000 7f85ce400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c806a350 con 0x7f85c80c9ba0 2024-04-02T07:31:56.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.513+0000 7f85ce400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c80cf320 con 0x7f85c80cea00 2024-04-02T07:31:56.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.513+0000 7f85ce400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c806a5f0 con 0x7f85c8069d90 2024-04-02T07:31:56.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.513+0000 7f85c7400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f85c80cea00 0x7f85c80cd120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:56.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.513+0000 7f85c7e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f85c80c9ba0 0x7f85c80cc2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43310/0 (socket says 172.21.15.55:43310) 2024-04-02T07:31:56.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.513+0000 7f85c7e00640 1 -- 172.21.15.55:0/3177029349 learned_addr learned my addr 172.21.15.55:0/3177029349 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:56.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.513+0000 7f85bea00640 1 --2- 172.21.15.55:0/3177029349 >> v2:172.21.15.106:3300/0 conn(0x7f85c8069d90 0x7f85c80cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:56.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.513+0000 7f85c7400640 1 -- 172.21.15.55:0/3177029349 >> v2:172.21.15.106:3300/0 conn(0x7f85c8069d90 msgr2=0x7f85c80cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:56.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.513+0000 7f85c7400640 1 --2- 172.21.15.55:0/3177029349 >> v2:172.21.15.106:3300/0 conn(0x7f85c8069d90 0x7f85c80cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.513+0000 7f85c7400640 1 -- 172.21.15.55:0/3177029349 >> v1:172.21.15.55:6789/0 conn(0x7f85c80c9ba0 legacy=0x7f85c80cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:56.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.513+0000 7f85c7400640 1 -- 172.21.15.55:0/3177029349 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c80cb7e0 con 0x7f85c80cea00 2024-04-02T07:31:56.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.517+0000 7f85c7400640 1 --2- 172.21.15.55:0/3177029349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85c80cea00 0x7f85c80cd120 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f85c806cbf0 tx=0x7f85b801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3aaa7fda34f0371 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:56.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.517+0000 7f85c6a00640 1 -- 172.21.15.55:0/3177029349 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b80ab600 con 0x7f85c80cea00 2024-04-02T07:31:56.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.517+0000 7f85c6a00640 1 -- 172.21.15.55:0/3177029349 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b80a7050 con 0x7f85c80cea00 2024-04-02T07:31:56.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.517+0000 7f85c6a00640 1 -- 172.21.15.55:0/3177029349 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b80ab980 con 0x7f85c80cea00 2024-04-02T07:31:56.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.517+0000 7f85ce400640 1 -- 172.21.15.55:0/3177029349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85c80cea00 msgr2=0x7f85c80cd120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:56.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.517+0000 7f85ce400640 1 --2- 172.21.15.55:0/3177029349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85c80cea00 0x7f85c80cd120 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f85c806cbf0 tx=0x7f85b801c480 comp rx=0 tx=0).stop 2024-04-02T07:31:56.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.517+0000 7f85ce400640 1 -- 172.21.15.55:0/3177029349 shutdown_connections 2024-04-02T07:31:56.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.517+0000 7f85ce400640 1 --2- 172.21.15.55:0/3177029349 >> v2:172.21.15.106:3300/0 conn(0x7f85c8069d90 0x7f85c80cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.517+0000 7f85ce400640 1 --2- 172.21.15.55:0/3177029349 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85c80cea00 0x7f85c80cd120 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.517+0000 7f85ce400640 1 -- 172.21.15.55:0/3177029349 >> 172.21.15.55:0/3177029349 conn(0x7f85c80cf550 msgr2=0x7f85c80cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:56.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.517+0000 7f85ce400640 1 -- 172.21.15.55:0/3177029349 shutdown_connections 2024-04-02T07:31:56.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.517+0000 7f85ce400640 1 -- 172.21.15.55:0/3177029349 wait complete. 2024-04-02T07:31:56.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85ce400640 1 Processor -- start 2024-04-02T07:31:56.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85ce400640 1 -- start start 2024-04-02T07:31:56.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85ce400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85c8069d90 0x7f85c814f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:56.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85ce400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85c80c9ba0 0x7f85c8152f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:56.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85ce400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85c80cea00 0x7f85c80b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:56.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85ce400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c814fff0 con 0x7f85c8069d90 2024-04-02T07:31:56.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85ce400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c814fdf0 con 0x7f85c80c9ba0 2024-04-02T07:31:56.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85ce400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85c8150240 con 0x7f85c80cea00 2024-04-02T07:31:56.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85c7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85c8069d90 0x7f85c814f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:56.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85c7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85c8069d90 0x7f85c814f8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36932/0 (socket says 172.21.15.55:36932) 2024-04-02T07:31:56.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85c7400640 1 -- 172.21.15.55:0/3832262983 learned_addr learned my addr 172.21.15.55:0/3832262983 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:56.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85bea00640 1 --2- 172.21.15.55:0/3832262983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85c80c9ba0 0x7f85c8152f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:56.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85c7e00640 1 --2- 172.21.15.55:0/3832262983 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85c80cea00 0x7f85c80b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:56.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85c7400640 1 -- 172.21.15.55:0/3832262983 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85c80cea00 msgr2=0x7f85c80b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:56.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85c7400640 1 --2- 172.21.15.55:0/3832262983 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85c80cea00 0x7f85c80b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85c7400640 1 -- 172.21.15.55:0/3832262983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85c80c9ba0 msgr2=0x7f85c8152f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:56.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85c7400640 1 --2- 172.21.15.55:0/3832262983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85c80c9ba0 0x7f85c8152f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85c7400640 1 -- 172.21.15.55:0/3832262983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b8009420 con 0x7f85c8069d90 2024-04-02T07:31:56.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85bea00640 1 --2- 172.21.15.55:0/3832262983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85c80c9ba0 0x7f85c8152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:56.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85c7e00640 1 --2- 172.21.15.55:0/3832262983 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85c80cea00 0x7f85c80b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:31:56.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85c7400640 1 --2- 172.21.15.55:0/3832262983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85c8069d90 0x7f85c814f8b0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f85b801a0b0 tx=0x7f85b8019220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:56.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85bfe00640 1 -- 172.21.15.55:0/3832262983 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b80b4430 con 0x7f85c8069d90 2024-04-02T07:31:56.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85bfe00640 1 -- 172.21.15.55:0/3832262983 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b80b45b0 con 0x7f85c8069d90 2024-04-02T07:31:56.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85bfe00640 1 -- 172.21.15.55:0/3832262983 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b80b4960 con 0x7f85c8069d90 2024-04-02T07:31:56.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85ce400640 1 -- 172.21.15.55:0/3832262983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c8150520 con 0x7f85c8069d90 2024-04-02T07:31:56.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85ce400640 1 -- 172.21.15.55:0/3832262983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c8150ae0 con 0x7f85c8069d90 2024-04-02T07:31:56.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.521+0000 7f85ce400640 1 -- 172.21.15.55:0/3832262983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c8066c90 con 0x7f85c8069d90 2024-04-02T07:31:56.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.525+0000 7f85bfe00640 1 -- 172.21.15.55:0/3832262983 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f85b80b2040 con 0x7f85c8069d90 2024-04-02T07:31:56.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.525+0000 7f85bfe00640 1 --2- 172.21.15.55:0/3832262983 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f85a4066690 0x7f85a4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:56.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.525+0000 7f85bfe00640 1 -- 172.21.15.55:0/3832262983 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f85b811e210 con 0x7f85c8069d90 2024-04-02T07:31:56.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.525+0000 7f85bea00640 1 --2- 172.21.15.55:0/3832262983 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f85a4066690 0x7f85a4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:56.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.525+0000 7f85bea00640 1 --2- 172.21.15.55:0/3832262983 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f85a4066690 0x7f85a4068b50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f85c80aea50 tx=0x7f85b0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:56.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.529+0000 7f85bfe00640 1 -- 172.21.15.55:0/3832262983 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f85b80eb4e0 con 0x7f85c8069d90 2024-04-02T07:31:56.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.693+0000 7f85ce400640 1 -- 172.21.15.55:0/3832262983 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f85c80b07e0 con 0x7f85c8069d90 2024-04-02T07:31:56.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.693+0000 7f85bfe00640 1 -- 172.21.15.55:0/3832262983 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v103) v1 ==== 104+0+11 (secure 0 0 0) 0x7f85b80eeb00 con 0x7f85c8069d90 2024-04-02T07:31:56.694 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:31:56.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.693+0000 7f85ce400640 1 -- 172.21.15.55:0/3832262983 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f85a4066690 msgr2=0x7f85a4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:56.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.693+0000 7f85ce400640 1 --2- 172.21.15.55:0/3832262983 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f85a4066690 0x7f85a4068b50 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f85c80aea50 tx=0x7f85b0008040 comp rx=0 tx=0).stop 2024-04-02T07:31:56.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.693+0000 7f85ce400640 1 -- 172.21.15.55:0/3832262983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85c8069d90 msgr2=0x7f85c814f8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:56.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.693+0000 7f85ce400640 1 --2- 172.21.15.55:0/3832262983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85c8069d90 0x7f85c814f8b0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7f85b801a0b0 tx=0x7f85b8019220 comp rx=0 tx=0).stop 2024-04-02T07:31:56.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.693+0000 7f85ce400640 1 -- 172.21.15.55:0/3832262983 shutdown_connections 2024-04-02T07:31:56.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.693+0000 7f85ce400640 1 --2- 172.21.15.55:0/3832262983 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f85c80cea00 0x7f85c80b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.693+0000 7f85ce400640 1 --2- 172.21.15.55:0/3832262983 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f85a4066690 0x7f85a4068b50 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.693+0000 7f85ce400640 1 --2- 172.21.15.55:0/3832262983 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f85c80c9ba0 0x7f85c8152f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.693+0000 7f85ce400640 1 --2- 172.21.15.55:0/3832262983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85c8069d90 0x7f85c814f8b0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.693+0000 7f85ce400640 1 -- 172.21.15.55:0/3832262983 >> 172.21.15.55:0/3832262983 conn(0x7f85c80cf550 msgr2=0x7f85c806df10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:56.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.693+0000 7f85ce400640 1 -- 172.21.15.55:0/3832262983 shutdown_connections 2024-04-02T07:31:56.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.693+0000 7f85ce400640 1 -- 172.21.15.55:0/3832262983 wait complete. 2024-04-02T07:31:56.714 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:31:56.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.853+0000 7f544fc00640 1 Processor -- start 2024-04-02T07:31:56.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.853+0000 7f544fc00640 1 -- start start 2024-04-02T07:31:56.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.857+0000 7f544fc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f544815cd50 0x7f54480cfef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:56.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.857+0000 7f544fc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f544806bac0 0x7f5448098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:56.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.857+0000 7f544fc00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f544806c2a0 con 0x7f5448098f50 2024-04-02T07:31:56.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.857+0000 7f544fc00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54480993c0 con 0x7f544806bac0 2024-04-02T07:31:56.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.857+0000 7f544fc00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54480ccb30 con 0x7f544815cd50 2024-04-02T07:31:56.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.857+0000 7f5447e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f544806bac0 0x7f5448098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:56.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.857+0000 7f544dc00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5448098f50 0x7f54480b5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43316/0 (socket says 172.21.15.55:43316) 2024-04-02T07:31:56.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.857+0000 7f544dc00640 1 -- 172.21.15.55:0/1430028686 learned_addr learned my addr 172.21.15.55:0/1430028686 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:56.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.857+0000 7f544d200640 1 --2- 172.21.15.55:0/1430028686 >> v2:172.21.15.106:3300/0 conn(0x7f544815cd50 0x7f54480cfef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:56.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.857+0000 7f5447e00640 1 -- 172.21.15.55:0/1430028686 >> v2:172.21.15.106:3300/0 conn(0x7f544815cd50 msgr2=0x7f54480cfef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:31:56.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.857+0000 7f5447e00640 1 --2- 172.21.15.55:0/1430028686 >> v2:172.21.15.106:3300/0 conn(0x7f544815cd50 0x7f54480cfef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.857+0000 7f5447e00640 1 -- 172.21.15.55:0/1430028686 >> v1:172.21.15.55:6789/0 conn(0x7f5448098f50 legacy=0x7f54480b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:56.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.857+0000 7f5447e00640 1 -- 172.21.15.55:0/1430028686 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54480cad60 con 0x7f544806bac0 2024-04-02T07:31:56.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.857+0000 7f5447400640 1 -- 172.21.15.55:0/1430028686 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2873923651 0 0) 0x7f544806c2a0 con 0x7f5448098f50 2024-04-02T07:31:56.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.861+0000 7f5447e00640 1 --2- 172.21.15.55:0/1430028686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f544806bac0 0x7f5448098a10 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f544806e210 tx=0x7f543401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccf612ad2ab6639 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:56.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.861+0000 7f5447400640 1 -- 172.21.15.55:0/1430028686 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54340ac620 con 0x7f544806bac0 2024-04-02T07:31:56.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.861+0000 7f5447400640 1 -- 172.21.15.55:0/1430028686 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54340ac780 con 0x7f544806bac0 2024-04-02T07:31:56.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.861+0000 7f5447400640 1 -- 172.21.15.55:0/1430028686 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f54340acb10 con 0x7f544806bac0 2024-04-02T07:31:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.861+0000 7f544fc00640 1 -- 172.21.15.55:0/1430028686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f544806bac0 msgr2=0x7f5448098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.861+0000 7f544fc00640 1 --2- 172.21.15.55:0/1430028686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f544806bac0 0x7f5448098a10 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f544806e210 tx=0x7f543401c3c0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.861+0000 7f544fc00640 1 -- 172.21.15.55:0/1430028686 shutdown_connections 2024-04-02T07:31:56.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.861+0000 7f544fc00640 1 --2- 172.21.15.55:0/1430028686 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f544806bac0 0x7f5448098a10 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.861+0000 7f544fc00640 1 --2- 172.21.15.55:0/1430028686 >> v2:172.21.15.106:3300/0 conn(0x7f544815cd50 0x7f54480cfef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.861+0000 7f544fc00640 1 -- 172.21.15.55:0/1430028686 >> 172.21.15.55:0/1430028686 conn(0x7f54480b2160 msgr2=0x7f54480b2540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:56.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.861+0000 7f544fc00640 1 -- 172.21.15.55:0/1430028686 shutdown_connections 2024-04-02T07:31:56.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.861+0000 7f544fc00640 1 -- 172.21.15.55:0/1430028686 wait complete. 2024-04-02T07:31:56.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.861+0000 7f544fc00640 1 Processor -- start 2024-04-02T07:31:56.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.861+0000 7f544fc00640 1 -- start start 2024-04-02T07:31:56.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f544fc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f544806bac0 0x7f54481463e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:56.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f544fc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5448098f50 0x7f5448155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:56.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f544fc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f544815cd50 0x7f5448156350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:56.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f544fc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54480c7090 con 0x7f544815cd50 2024-04-02T07:31:56.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f544fc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5448157bc0 con 0x7f5448098f50 2024-04-02T07:31:56.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f544fc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5448146a00 con 0x7f544806bac0 2024-04-02T07:31:56.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f544dc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f544815cd50 0x7f5448156350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:56.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f544dc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f544815cd50 0x7f5448156350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36948/0 (socket says 172.21.15.55:36948) 2024-04-02T07:31:56.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f544dc00640 1 -- 172.21.15.55:0/1549434059 learned_addr learned my addr 172.21.15.55:0/1549434059 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f5447e00640 1 --2- 172.21.15.55:0/1549434059 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5448098f50 0x7f5448155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f544d200640 1 --2- 172.21.15.55:0/1549434059 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f544806bac0 0x7f54481463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f544dc00640 1 -- 172.21.15.55:0/1549434059 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f544806bac0 msgr2=0x7f54481463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f544dc00640 1 --2- 172.21.15.55:0/1549434059 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f544806bac0 0x7f54481463e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f544dc00640 1 -- 172.21.15.55:0/1549434059 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5448098f50 msgr2=0x7f5448155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f544dc00640 1 --2- 172.21.15.55:0/1549434059 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5448098f50 0x7f5448155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f544dc00640 1 -- 172.21.15.55:0/1549434059 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5434009420 con 0x7f544815cd50 2024-04-02T07:31:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f5447e00640 1 --2- 172.21.15.55:0/1549434059 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5448098f50 0x7f5448155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f544dc00640 1 --2- 172.21.15.55:0/1549434059 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f544815cd50 0x7f5448156350 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f544000c780 tx=0x7f544000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f5444c00640 1 -- 172.21.15.55:0/1549434059 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544000ce90 con 0x7f544815cd50 2024-04-02T07:31:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f5444c00640 1 -- 172.21.15.55:0/1549434059 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f544000a640 con 0x7f544815cd50 2024-04-02T07:31:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f544fc00640 1 -- 172.21.15.55:0/1549434059 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5448146ce0 con 0x7f544815cd50 2024-04-02T07:31:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f5444c00640 1 -- 172.21.15.55:0/1549434059 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f544000a9d0 con 0x7f544815cd50 2024-04-02T07:31:56.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f544fc00640 1 -- 172.21.15.55:0/1549434059 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54481472a0 con 0x7f544815cd50 2024-04-02T07:31:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f544fc00640 1 -- 172.21.15.55:0/1549434059 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54480c4090 con 0x7f544815cd50 2024-04-02T07:31:56.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.865+0000 7f5444c00640 1 -- 172.21.15.55:0/1549434059 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f544000ab30 con 0x7f544815cd50 2024-04-02T07:31:56.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.869+0000 7f5444c00640 1 --2- 172.21.15.55:0/1549434059 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5428066690 0x7f5428068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:56.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.869+0000 7f5444c00640 1 -- 172.21.15.55:0/1549434059 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5440083740 con 0x7f544815cd50 2024-04-02T07:31:56.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.869+0000 7f544d200640 1 --2- 172.21.15.55:0/1549434059 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5428066690 0x7f5428068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:56.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.869+0000 7f544d200640 1 --2- 172.21.15.55:0/1549434059 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5428066690 0x7f5428068b50 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f543c00b9d0 tx=0x7f543c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:56.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:56.873+0000 7f5444c00640 1 -- 172.21.15.55:0/1549434059 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5440050a10 con 0x7f544815cd50 2024-04-02T07:31:57.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.029+0000 7f544fc00640 1 -- 172.21.15.55:0/1549434059 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5448066c90 con 0x7f544815cd50 2024-04-02T07:31:57.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.033+0000 7f5444c00640 1 -- 172.21.15.55:0/1549434059 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v103) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5440018020 con 0x7f544815cd50 2024-04-02T07:31:57.033 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:31:57.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.033+0000 7f544fc00640 1 -- 172.21.15.55:0/1549434059 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5428066690 msgr2=0x7f5428068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:57.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.033+0000 7f544fc00640 1 --2- 172.21.15.55:0/1549434059 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5428066690 0x7f5428068b50 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f543c00b9d0 tx=0x7f543c008040 comp rx=0 tx=0).stop 2024-04-02T07:31:57.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.033+0000 7f544fc00640 1 -- 172.21.15.55:0/1549434059 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f544815cd50 msgr2=0x7f5448156350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:57.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.033+0000 7f544fc00640 1 --2- 172.21.15.55:0/1549434059 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f544815cd50 0x7f5448156350 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f544000c780 tx=0x7f544000cc40 comp rx=0 tx=0).stop 2024-04-02T07:31:57.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.033+0000 7f544fc00640 1 -- 172.21.15.55:0/1549434059 shutdown_connections 2024-04-02T07:31:57.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.033+0000 7f544fc00640 1 --2- 172.21.15.55:0/1549434059 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f544815cd50 0x7f5448156350 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:57.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.033+0000 7f544fc00640 1 --2- 172.21.15.55:0/1549434059 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5428066690 0x7f5428068b50 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:57.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.033+0000 7f544fc00640 1 --2- 172.21.15.55:0/1549434059 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5448098f50 0x7f5448155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:57.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.033+0000 7f544fc00640 1 --2- 172.21.15.55:0/1549434059 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f544806bac0 0x7f54481463e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:57.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.033+0000 7f544fc00640 1 -- 172.21.15.55:0/1549434059 >> 172.21.15.55:0/1549434059 conn(0x7f54480b2160 msgr2=0x7f544806f020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:57.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.033+0000 7f544fc00640 1 -- 172.21.15.55:0/1549434059 shutdown_connections 2024-04-02T07:31:57.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.033+0000 7f544fc00640 1 -- 172.21.15.55:0/1549434059 wait complete. 2024-04-02T07:31:57.054 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:31:57.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.193+0000 7fe827600640 1 Processor -- start 2024-04-02T07:31:57.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.193+0000 7fe827600640 1 -- start start 2024-04-02T07:31:57.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.193+0000 7fe827600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe82015fff0 0x7fe8200b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:57.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.193+0000 7fe827600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8200aea20 con 0x7fe8200aebd0 2024-04-02T07:31:57.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.193+0000 7fe827600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8200b3c00 con 0x7fe820069d90 2024-04-02T07:31:57.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.193+0000 7fe827600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8201603d0 con 0x7fe82015fff0 2024-04-02T07:31:57.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.193+0000 7fe81fe00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe8200aebd0 0x7fe82006f430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43326/0 (socket says 172.21.15.55:43326) 2024-04-02T07:31:57.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.193+0000 7fe81fe00640 1 -- 172.21.15.55:0/2399250100 learned_addr learned my addr 172.21.15.55:0/2399250100 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:31:57.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.193+0000 7fe824c00640 1 --2- 172.21.15.55:0/2399250100 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe82015fff0 0x7fe8200b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:57.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.193+0000 7fe81f400640 1 -- 172.21.15.55:0/2399250100 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941108270 0 0) 0x7fe8200aea20 con 0x7fe8200aebd0 2024-04-02T07:31:57.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.193+0000 7fe81f400640 1 -- 172.21.15.55:0/2399250100 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe808003530 con 0x7fe8200aebd0 2024-04-02T07:31:57.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.193+0000 7fe824c00640 1 -- 172.21.15.55:0/2399250100 >> v1:172.21.15.106:6789/0 conn(0x7fe820069d90 legacy=0x7fe820160590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:57.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.193+0000 7fe81f400640 1 -- 172.21.15.55:0/2399250100 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4155032814 0 0) 0x7fe8200b3c00 con 0x7fe820069d90 2024-04-02T07:31:57.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.193+0000 7fe824c00640 1 -- 172.21.15.55:0/2399250100 >> v1:172.21.15.55:6789/0 conn(0x7fe8200aebd0 legacy=0x7fe82006f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:57.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.193+0000 7fe824c00640 1 -- 172.21.15.55:0/2399250100 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe82006ecc0 con 0x7fe82015fff0 2024-04-02T07:31:57.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.197+0000 7fe824c00640 1 --2- 172.21.15.55:0/2399250100 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe82015fff0 0x7fe8200b1f40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe8140097f0 tx=0x7fe81401c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afce00c33bf2c2e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:57.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.197+0000 7fe81f400640 1 -- 172.21.15.55:0/2399250100 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8140ab600 con 0x7fe82015fff0 2024-04-02T07:31:57.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.197+0000 7fe81f400640 1 -- 172.21.15.55:0/2399250100 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8140a7050 con 0x7fe82015fff0 2024-04-02T07:31:57.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.197+0000 7fe81f400640 1 -- 172.21.15.55:0/2399250100 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8140ab980 con 0x7fe82015fff0 2024-04-02T07:31:57.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.197+0000 7fe827600640 1 -- 172.21.15.55:0/2399250100 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe82015fff0 msgr2=0x7fe8200b1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:57.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.197+0000 7fe827600640 1 --2- 172.21.15.55:0/2399250100 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe82015fff0 0x7fe8200b1f40 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe8140097f0 tx=0x7fe81401c3c0 comp rx=0 tx=0).stop 2024-04-02T07:31:57.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.197+0000 7fe827600640 1 -- 172.21.15.55:0/2399250100 shutdown_connections 2024-04-02T07:31:57.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.197+0000 7fe827600640 1 --2- 172.21.15.55:0/2399250100 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe82015fff0 0x7fe8200b1f40 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:57.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.197+0000 7fe827600640 1 -- 172.21.15.55:0/2399250100 >> 172.21.15.55:0/2399250100 conn(0x7fe8200b1420 msgr2=0x7fe8200b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:57.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.197+0000 7fe827600640 1 -- 172.21.15.55:0/2399250100 shutdown_connections 2024-04-02T07:31:57.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.197+0000 7fe827600640 1 -- 172.21.15.55:0/2399250100 wait complete. 2024-04-02T07:31:57.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe827600640 1 Processor -- start 2024-04-02T07:31:57.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe827600640 1 -- start start 2024-04-02T07:31:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe827600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe820069d90 0x7fe8200ca9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe827600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8200aebd0 0x7fe820150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe827600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe82015fff0 0x7fe82014a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe827600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe82014e7c0 con 0x7fe820069d90 2024-04-02T07:31:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe827600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8200cb3b0 con 0x7fe82015fff0 2024-04-02T07:31:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe827600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8200cb0d0 con 0x7fe8200aebd0 2024-04-02T07:31:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe824c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe820069d90 0x7fe8200ca9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:57.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe824c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe820069d90 0x7fe8200ca9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36954/0 (socket says 172.21.15.55:36954) 2024-04-02T07:31:57.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe824c00640 1 -- 172.21.15.55:0/1388052219 learned_addr learned my addr 172.21.15.55:0/1388052219 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:31:57.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe81fe00640 1 --2- 172.21.15.55:0/1388052219 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8200aebd0 0x7fe820150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:57.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe825600640 1 --2- 172.21.15.55:0/1388052219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe82015fff0 0x7fe82014a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:57.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe824c00640 1 -- 172.21.15.55:0/1388052219 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8200aebd0 msgr2=0x7fe820150df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:57.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe824c00640 1 --2- 172.21.15.55:0/1388052219 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8200aebd0 0x7fe820150df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:57.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe824c00640 1 -- 172.21.15.55:0/1388052219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe82015fff0 msgr2=0x7fe82014a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:57.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe824c00640 1 --2- 172.21.15.55:0/1388052219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe82015fff0 0x7fe82014a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:57.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe824c00640 1 -- 172.21.15.55:0/1388052219 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe814009420 con 0x7fe820069d90 2024-04-02T07:31:57.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe81fe00640 1 --2- 172.21.15.55:0/1388052219 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8200aebd0 0x7fe820150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:57.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe825600640 1 --2- 172.21.15.55:0/1388052219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe82015fff0 0x7fe82014a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:31:57.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe824c00640 1 --2- 172.21.15.55:0/1388052219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe820069d90 0x7fe8200ca9d0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fe814009740 tx=0x7fe814019160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:57.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe81cc00640 1 -- 172.21.15.55:0/1388052219 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814004020 con 0x7fe820069d90 2024-04-02T07:31:57.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe81cc00640 1 -- 172.21.15.55:0/1388052219 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe814004180 con 0x7fe820069d90 2024-04-02T07:31:57.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe827600640 1 -- 172.21.15.55:0/1388052219 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe820153110 con 0x7fe820069d90 2024-04-02T07:31:57.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe81cc00640 1 -- 172.21.15.55:0/1388052219 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe814004510 con 0x7fe820069d90 2024-04-02T07:31:57.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.201+0000 7fe827600640 1 -- 172.21.15.55:0/1388052219 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8201536d0 con 0x7fe820069d90 2024-04-02T07:31:57.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.205+0000 7fe827600640 1 -- 172.21.15.55:0/1388052219 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8201538c0 con 0x7fe820069d90 2024-04-02T07:31:57.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.205+0000 7fe81cc00640 1 -- 172.21.15.55:0/1388052219 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe8140b2040 con 0x7fe820069d90 2024-04-02T07:31:57.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.205+0000 7fe81cc00640 1 --2- 172.21.15.55:0/1388052219 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe800066690 0x7fe800068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:31:57.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.205+0000 7fe81cc00640 1 -- 172.21.15.55:0/1388052219 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe81411e7b0 con 0x7fe820069d90 2024-04-02T07:31:57.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.205+0000 7fe81fe00640 1 --2- 172.21.15.55:0/1388052219 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe800066690 0x7fe800068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:31:57.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.205+0000 7fe81fe00640 1 --2- 172.21.15.55:0/1388052219 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe800066690 0x7fe800068b50 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe8200ca290 tx=0x7fe80c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:31:57.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.209+0000 7fe81cc00640 1 -- 172.21.15.55:0/1388052219 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe8140ebba0 con 0x7fe820069d90 2024-04-02T07:31:57.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.381+0000 7fe827600640 1 -- 172.21.15.55:0/1388052219 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe820066c90 con 0x7fe820069d90 2024-04-02T07:31:57.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.381+0000 7fe81cc00640 1 -- 172.21.15.55:0/1388052219 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v103) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe8140b0080 con 0x7fe820069d90 2024-04-02T07:31:57.384 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:31:57.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.385+0000 7fe827600640 1 -- 172.21.15.55:0/1388052219 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe800066690 msgr2=0x7fe800068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:57.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.385+0000 7fe827600640 1 --2- 172.21.15.55:0/1388052219 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe800066690 0x7fe800068b50 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe8200ca290 tx=0x7fe80c009040 comp rx=0 tx=0).stop 2024-04-02T07:31:57.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.385+0000 7fe827600640 1 -- 172.21.15.55:0/1388052219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe820069d90 msgr2=0x7fe8200ca9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:31:57.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.385+0000 7fe827600640 1 --2- 172.21.15.55:0/1388052219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe820069d90 0x7fe8200ca9d0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7fe814009740 tx=0x7fe814019160 comp rx=0 tx=0).stop 2024-04-02T07:31:57.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.385+0000 7fe827600640 1 -- 172.21.15.55:0/1388052219 shutdown_connections 2024-04-02T07:31:57.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.385+0000 7fe827600640 1 --2- 172.21.15.55:0/1388052219 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe800066690 0x7fe800068b50 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:57.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.385+0000 7fe827600640 1 --2- 172.21.15.55:0/1388052219 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe82015fff0 0x7fe82014a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:57.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.385+0000 7fe827600640 1 --2- 172.21.15.55:0/1388052219 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8200aebd0 0x7fe820150df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:57.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.385+0000 7fe827600640 1 --2- 172.21.15.55:0/1388052219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe820069d90 0x7fe8200ca9d0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:31:57.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.385+0000 7fe827600640 1 -- 172.21.15.55:0/1388052219 >> 172.21.15.55:0/1388052219 conn(0x7fe8200b1420 msgr2=0x7fe8200cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:31:57.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.385+0000 7fe827600640 1 -- 172.21.15.55:0/1388052219 shutdown_connections 2024-04-02T07:31:57.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:31:57.385+0000 7fe827600640 1 -- 172.21.15.55:0/1388052219 wait complete. 2024-04-02T07:31:57.405 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi055.front.sepia.ceph.com... 2024-04-02T07:31:57.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:31:57.405 DEBUG:teuthology.orchestra.run.smithi055:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-02T07:31:57.423 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[49866]: fuse finished with error 0 and tester_r 0 2024-04-02T07:31:57.429 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:32:03.530 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:32:03.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:32:03.531 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-02T07:32:03.541 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:32:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.737+0000 7f914be00640 1 Processor -- start 2024-04-02T07:32:03.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.737+0000 7f914be00640 1 -- start start 2024-04-02T07:32:03.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.737+0000 7f914be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f914c15a6a0 0x7f914c0cba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:03.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.737+0000 7f914be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f914c0cbfb0 0x7f914c15e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:03.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.737+0000 7f914be00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f914c0ce090 con 0x7f914c15e7f0 2024-04-02T07:32:03.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.737+0000 7f914be00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914c15ec60 con 0x7f914c0cbfb0 2024-04-02T07:32:03.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.737+0000 7f914be00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f914c0ce2e0 con 0x7f914c15a6a0 2024-04-02T07:32:03.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.741+0000 7f9142000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f914c0cbfb0 0x7f914c15e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:03.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.741+0000 7f9142000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f914c0cbfb0 0x7f914c15e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36956/0 (socket says 172.21.15.55:36956) 2024-04-02T07:32:03.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.741+0000 7f9142000640 1 -- 172.21.15.55:0/903815163 learned_addr learned my addr 172.21.15.55:0/903815163 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:03.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.741+0000 7f914aa00640 1 --2- 172.21.15.55:0/903815163 >> v2:172.21.15.106:3300/0 conn(0x7f914c15a6a0 0x7f914c0cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:03.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.741+0000 7f9142000640 1 -- 172.21.15.55:0/903815163 >> v2:172.21.15.106:3300/0 conn(0x7f914c15a6a0 msgr2=0x7f914c0cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:03.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.741+0000 7f9142000640 1 --2- 172.21.15.55:0/903815163 >> v2:172.21.15.106:3300/0 conn(0x7f914c15a6a0 0x7f914c0cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:03.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.741+0000 7f9142000640 1 -- 172.21.15.55:0/903815163 >> v1:172.21.15.106:6789/0 conn(0x7f914c15e7f0 legacy=0x7f914c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:03.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.741+0000 7f9142000640 1 -- 172.21.15.55:0/903815163 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f914c0ce5c0 con 0x7f914c0cbfb0 2024-04-02T07:32:03.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.741+0000 7f914aa00640 1 --2- 172.21.15.55:0/903815163 >> v2:172.21.15.106:3300/0 conn(0x7f914c15a6a0 0x7f914c0cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:32:03.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.741+0000 7f9142000640 1 --2- 172.21.15.55:0/903815163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f914c0cbfb0 0x7f914c15e2b0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f914c071450 tx=0x7f913401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b2b7c07bb459d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:03.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.741+0000 7f914a000640 1 -- 172.21.15.55:0/903815163 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91340ab610 con 0x7f914c0cbfb0 2024-04-02T07:32:03.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.741+0000 7f914a000640 1 -- 172.21.15.55:0/903815163 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91340ab770 con 0x7f914c0cbfb0 2024-04-02T07:32:03.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.741+0000 7f914a000640 1 -- 172.21.15.55:0/903815163 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91340abb00 con 0x7f914c0cbfb0 2024-04-02T07:32:03.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914be00640 1 -- 172.21.15.55:0/903815163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f914c0cbfb0 msgr2=0x7f914c15e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:03.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914be00640 1 --2- 172.21.15.55:0/903815163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f914c0cbfb0 0x7f914c15e2b0 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f914c071450 tx=0x7f913401c520 comp rx=0 tx=0).stop 2024-04-02T07:32:03.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914be00640 1 -- 172.21.15.55:0/903815163 shutdown_connections 2024-04-02T07:32:03.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914be00640 1 --2- 172.21.15.55:0/903815163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f914c0cbfb0 0x7f914c15e2b0 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:03.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914be00640 1 --2- 172.21.15.55:0/903815163 >> v2:172.21.15.106:3300/0 conn(0x7f914c15a6a0 0x7f914c0cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:03.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914be00640 1 -- 172.21.15.55:0/903815163 >> 172.21.15.55:0/903815163 conn(0x7f914c0b1fb0 msgr2=0x7f914c0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:03.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914be00640 1 -- 172.21.15.55:0/903815163 shutdown_connections 2024-04-02T07:32:03.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914be00640 1 -- 172.21.15.55:0/903815163 wait complete. 2024-04-02T07:32:03.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914be00640 1 Processor -- start 2024-04-02T07:32:03.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914be00640 1 -- start start 2024-04-02T07:32:03.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f914c0cbfb0 0x7f914c151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:03.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914be00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f914c15a6a0 0x7f914c156940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:03.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f914c15e7f0 0x7f914c152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:03.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914be00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c0c8180 con 0x7f914c0cbfb0 2024-04-02T07:32:03.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914be00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f914c0c7590 con 0x7f914c15e7f0 2024-04-02T07:32:03.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914be00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f914c158ef0 con 0x7f914c15a6a0 2024-04-02T07:32:03.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f914c0cbfb0 0x7f914c151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f914c0cbfb0 0x7f914c151510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36966/0 (socket says 172.21.15.55:36966) 2024-04-02T07:32:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914aa00640 1 -- 172.21.15.55:0/4052985086 learned_addr learned my addr 172.21.15.55:0/4052985086 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f9142000640 1 --2- 172.21.15.55:0/4052985086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f914c15a6a0 0x7f914c156940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914b400640 1 --2- 172.21.15.55:0/4052985086 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f914c15e7f0 0x7f914c152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914aa00640 1 -- 172.21.15.55:0/4052985086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f914c15a6a0 msgr2=0x7f914c156940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914aa00640 1 --2- 172.21.15.55:0/4052985086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f914c15a6a0 0x7f914c156940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914aa00640 1 -- 172.21.15.55:0/4052985086 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f914c15e7f0 msgr2=0x7f914c152650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914aa00640 1 --2- 172.21.15.55:0/4052985086 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f914c15e7f0 0x7f914c152650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:03.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.745+0000 7f914aa00640 1 -- 172.21.15.55:0/4052985086 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91340094d0 con 0x7f914c0cbfb0 2024-04-02T07:32:03.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.749+0000 7f914aa00640 1 --2- 172.21.15.55:0/4052985086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f914c0cbfb0 0x7f914c151510 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f913c009fc0 tx=0x7f913c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:03.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.749+0000 7f9143400640 1 -- 172.21.15.55:0/4052985086 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c003ba0 con 0x7f914c0cbfb0 2024-04-02T07:32:03.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.749+0000 7f9143400640 1 -- 172.21.15.55:0/4052985086 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f913c00f040 con 0x7f914c0cbfb0 2024-04-02T07:32:03.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.749+0000 7f9143400640 1 -- 172.21.15.55:0/4052985086 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f913c004030 con 0x7f914c0cbfb0 2024-04-02T07:32:03.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.749+0000 7f914be00640 1 -- 172.21.15.55:0/4052985086 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f914c0c77e0 con 0x7f914c0cbfb0 2024-04-02T07:32:03.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.749+0000 7f914be00640 1 -- 172.21.15.55:0/4052985086 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f914c0c7da0 con 0x7f914c0cbfb0 2024-04-02T07:32:03.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.749+0000 7f914be00640 1 -- 172.21.15.55:0/4052985086 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f914c073fa0 con 0x7f914c0cbfb0 2024-04-02T07:32:03.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.749+0000 7f9143400640 1 -- 172.21.15.55:0/4052985086 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f913c004190 con 0x7f914c0cbfb0 2024-04-02T07:32:03.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.749+0000 7f9143400640 1 --2- 172.21.15.55:0/4052985086 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9128066690 0x7f9128068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:03.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.749+0000 7f9143400640 1 -- 172.21.15.55:0/4052985086 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f913c0844e0 con 0x7f914c0cbfb0 2024-04-02T07:32:03.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.753+0000 7f9142000640 1 --2- 172.21.15.55:0/4052985086 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9128066690 0x7f9128068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:03.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.753+0000 7f9142000640 1 --2- 172.21.15.55:0/4052985086 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9128066690 0x7f9128068b50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f91340af000 tx=0x7f91340b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:03.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.757+0000 7f9143400640 1 -- 172.21.15.55:0/4052985086 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f913c0518f0 con 0x7f914c0cbfb0 2024-04-02T07:32:03.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.953+0000 7f914be00640 1 -- 172.21.15.55:0/4052985086 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f914c0c83f0 con 0x7f914c0cbfb0 2024-04-02T07:32:03.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.953+0000 7f9143400640 1 -- 172.21.15.55:0/4052985086 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 81 v81) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f913c054f10 con 0x7f914c0cbfb0 2024-04-02T07:32:03.955 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:32:03.955 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":81,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2707651793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2707651793},{"type":"v1","addr":"172.21.15.106:6836","nonce":2707651793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2234384639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2234384639},{"type":"v1","addr":"172.21.15.106:6837","nonce":2234384639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":8433,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53259218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53259218},{"type":"v1","addr":"172.21.15.55:6833","nonce":53259218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":81,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:31:30.704183+0000","modified":"2024-04-02T07:31:33.715450+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8436},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8436":{"gid":8436,"name":"a","rank":0,"incarnation":77,"state":"up:active","state_seq":3,"addr":"172.21.15.55:6835/1089546237","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1089546237},{"type":"v1","addr":"172.21.15.55:6835","nonce":1089546237}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-02T07:32:03.956 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 81 2024-04-02T07:32:03.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.957+0000 7f914be00640 1 -- 172.21.15.55:0/4052985086 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9128066690 msgr2=0x7f9128068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:03.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.957+0000 7f914be00640 1 --2- 172.21.15.55:0/4052985086 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9128066690 0x7f9128068b50 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f91340af000 tx=0x7f91340b6040 comp rx=0 tx=0).stop 2024-04-02T07:32:03.957 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.957+0000 7f914be00640 1 -- 172.21.15.55:0/4052985086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f914c0cbfb0 msgr2=0x7f914c151510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:03.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.957+0000 7f914be00640 1 --2- 172.21.15.55:0/4052985086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f914c0cbfb0 0x7f914c151510 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f913c009fc0 tx=0x7f913c00d560 comp rx=0 tx=0).stop 2024-04-02T07:32:03.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.957+0000 7f914be00640 1 -- 172.21.15.55:0/4052985086 shutdown_connections 2024-04-02T07:32:03.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.957+0000 7f914be00640 1 --2- 172.21.15.55:0/4052985086 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9128066690 0x7f9128068b50 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:03.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.957+0000 7f914be00640 1 --2- 172.21.15.55:0/4052985086 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f914c15e7f0 0x7f914c152650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:03.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.957+0000 7f914be00640 1 --2- 172.21.15.55:0/4052985086 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f914c15a6a0 0x7f914c156940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:03.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.957+0000 7f914be00640 1 --2- 172.21.15.55:0/4052985086 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f914c0cbfb0 0x7f914c151510 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:03.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.957+0000 7f914be00640 1 -- 172.21.15.55:0/4052985086 >> 172.21.15.55:0/4052985086 conn(0x7f914c0b1fb0 msgr2=0x7f914c098a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:03.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.957+0000 7f914be00640 1 -- 172.21.15.55:0/4052985086 shutdown_connections 2024-04-02T07:32:03.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:03.957+0000 7f914be00640 1 -- 172.21.15.55:0/4052985086 wait complete. 2024-04-02T07:32:03.976 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json flush journal 2024-04-02T07:32:04.147 INFO:teuthology.orchestra.run.smithi055.stdout:{"message":"","return_code":0} 2024-04-02T07:32:04.147 DEBUG:tasks.cephfs.filesystem:_json_asok output { "message": "", "return_code": 0 } 2024-04-02T07:32:04.147 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:32:04.147 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:32:04.156 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:32:04.156 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi055.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2024-04-02T07:32:04.156 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:32:04.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:32:04.157 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-02T07:32:04.208 INFO:teuthology.orchestra.run.smithi055.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-02T07:32:04.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:32:04.209 DEBUG:teuthology.orchestra.run.smithi055:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-02T07:32:04.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:32:04.255 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-04-02T07:32:04.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.397+0000 7fa4f3e00640 1 Processor -- start 2024-04-02T07:32:04.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.397+0000 7fa4f3e00640 1 -- start start 2024-04-02T07:32:04.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.401+0000 7fa4f3e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa4ec15aa40 0x7fa4ec0caea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.401+0000 7fa4f3e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4ec06da10 0x7fa4ec0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.401+0000 7fa4f3e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4ec0ca030 con 0x7fa4ec0af920 2024-04-02T07:32:04.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.401+0000 7fa4f3e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4ec0cb920 con 0x7fa4ec15aa40 2024-04-02T07:32:04.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.401+0000 7fa4f3e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec0c9420 con 0x7fa4ec06da10 2024-04-02T07:32:04.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.401+0000 7fa4f1400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa4ec15aa40 0x7fa4ec0caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.401+0000 7fa4f1400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa4ec15aa40 0x7fa4ec0caea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36972/0 (socket says 172.21.15.55:36972) 2024-04-02T07:32:04.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.401+0000 7fa4f1400640 1 -- 172.21.15.55:0/462972481 learned_addr learned my addr 172.21.15.55:0/462972481 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:04.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.401+0000 7fa4f0a00640 1 --1- 172.21.15.55:0/462972481 >> v1:172.21.15.55:6789/0 conn(0x7fa4ec0af920 0x7fa4ec15e690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43336/0 (socket says 172.21.15.55:43336) 2024-04-02T07:32:04.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.401+0000 7fa4f1e00640 1 --2- 172.21.15.55:0/462972481 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4ec06da10 0x7fa4ec0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.401+0000 7fa4f1400640 1 -- 172.21.15.55:0/462972481 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4ec06da10 msgr2=0x7fa4ec0cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:04.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.401+0000 7fa4f1400640 1 --2- 172.21.15.55:0/462972481 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4ec06da10 0x7fa4ec0cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.401+0000 7fa4f1400640 1 -- 172.21.15.55:0/462972481 >> v1:172.21.15.55:6789/0 conn(0x7fa4ec0af920 legacy=0x7fa4ec15e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.401+0000 7fa4f1400640 1 -- 172.21.15.55:0/462972481 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec0c9700 con 0x7fa4ec15aa40 2024-04-02T07:32:04.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.401+0000 7fa4ebe00640 1 -- 172.21.15.55:0/462972481 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2207798967 0 0) 0x7fa4ec0ca030 con 0x7fa4ec0af920 2024-04-02T07:32:04.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.405+0000 7fa4f1400640 1 --2- 172.21.15.55:0/462972481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4ec15aa40 0x7fa4ec0caea0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009870 tx=0x7fa4e001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85490c89e88a5081 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:04.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.405+0000 7fa4ebe00640 1 -- 172.21.15.55:0/462972481 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e00a95f0 con 0x7fa4ec15aa40 2024-04-02T07:32:04.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.405+0000 7fa4ebe00640 1 -- 172.21.15.55:0/462972481 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e00a9750 con 0x7fa4ec15aa40 2024-04-02T07:32:04.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.405+0000 7fa4ebe00640 1 -- 172.21.15.55:0/462972481 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e00a9ae0 con 0x7fa4ec15aa40 2024-04-02T07:32:04.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.405+0000 7fa4f3e00640 1 -- 172.21.15.55:0/462972481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4ec15aa40 msgr2=0x7fa4ec0caea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.405+0000 7fa4f3e00640 1 --2- 172.21.15.55:0/462972481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4ec15aa40 0x7fa4ec0caea0 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7fa4e0009870 tx=0x7fa4e001c530 comp rx=0 tx=0).stop 2024-04-02T07:32:04.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.405+0000 7fa4f3e00640 1 -- 172.21.15.55:0/462972481 shutdown_connections 2024-04-02T07:32:04.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.405+0000 7fa4f3e00640 1 --2- 172.21.15.55:0/462972481 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4ec06da10 0x7fa4ec0cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.405+0000 7fa4f3e00640 1 --2- 172.21.15.55:0/462972481 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4ec15aa40 0x7fa4ec0caea0 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.405+0000 7fa4f3e00640 1 -- 172.21.15.55:0/462972481 >> 172.21.15.55:0/462972481 conn(0x7fa4ec069d90 msgr2=0x7fa4ec06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:04.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.405+0000 7fa4f3e00640 1 -- 172.21.15.55:0/462972481 shutdown_connections 2024-04-02T07:32:04.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.405+0000 7fa4f3e00640 1 -- 172.21.15.55:0/462972481 wait complete. 2024-04-02T07:32:04.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.405+0000 7fa4f3e00640 1 Processor -- start 2024-04-02T07:32:04.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.405+0000 7fa4f3e00640 1 -- start start 2024-04-02T07:32:04.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4f3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4ec06da10 0x7fa4ec147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4f3e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4ec0af920 0x7fa4ec147250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4f3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4ec15aa40 0x7fa4ec15afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4f3e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec14b160 con 0x7fa4ec06da10 2024-04-02T07:32:04.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4f3e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec15da40 con 0x7fa4ec15aa40 2024-04-02T07:32:04.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4f3e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4ec15dd20 con 0x7fa4ec0af920 2024-04-02T07:32:04.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4f1400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4ec06da10 0x7fa4ec147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4f1400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4ec06da10 0x7fa4ec147f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36976/0 (socket says 172.21.15.55:36976) 2024-04-02T07:32:04.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4f1400640 1 -- 172.21.15.55:0/2351418128 learned_addr learned my addr 172.21.15.55:0/2351418128 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:04.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4f0a00640 1 --2- 172.21.15.55:0/2351418128 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4ec0af920 0x7fa4ec147250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4f1e00640 1 --2- 172.21.15.55:0/2351418128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4ec15aa40 0x7fa4ec15afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4f1400640 1 -- 172.21.15.55:0/2351418128 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4ec0af920 msgr2=0x7fa4ec147250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4f1400640 1 --2- 172.21.15.55:0/2351418128 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4ec0af920 0x7fa4ec147250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4f1400640 1 -- 172.21.15.55:0/2351418128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4ec15aa40 msgr2=0x7fa4ec15afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4f1400640 1 --2- 172.21.15.55:0/2351418128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4ec15aa40 0x7fa4ec15afa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4f1400640 1 -- 172.21.15.55:0/2351418128 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e00094d0 con 0x7fa4ec06da10 2024-04-02T07:32:04.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4f1400640 1 --2- 172.21.15.55:0/2351418128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4ec06da10 0x7fa4ec147f20 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00ab040 tx=0x7fa4e001ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:04.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4e9600640 1 -- 172.21.15.55:0/2351418128 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e00a95f0 con 0x7fa4ec06da10 2024-04-02T07:32:04.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4e9600640 1 -- 172.21.15.55:0/2351418128 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e00b1820 con 0x7fa4ec06da10 2024-04-02T07:32:04.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4f3e00640 1 -- 172.21.15.55:0/2351418128 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4ec14b400 con 0x7fa4ec06da10 2024-04-02T07:32:04.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4e9600640 1 -- 172.21.15.55:0/2351418128 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e00b1bd0 con 0x7fa4ec06da10 2024-04-02T07:32:04.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4f3e00640 1 -- 172.21.15.55:0/2351418128 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ec15d6f0 con 0x7fa4ec06da10 2024-04-02T07:32:04.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.409+0000 7fa4e9600640 1 -- 172.21.15.55:0/2351418128 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa4e00b1d30 con 0x7fa4ec06da10 2024-04-02T07:32:04.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4e9600640 1 --2- 172.21.15.55:0/2351418128 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4cc066690 0x7fa4cc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4e9600640 1 -- 172.21.15.55:0/2351418128 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4e011ed70 con 0x7fa4ec06da10 2024-04-02T07:32:04.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f0a00640 1 --2- 172.21.15.55:0/2351418128 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4cc066690 0x7fa4cc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f7343000 1 Processor -- start 2024-04-02T07:32:04.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f7343000 1 -- start start 2024-04-02T07:32:04.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f0a00640 1 --2- 172.21.15.55:0/2351418128 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4cc066690 0x7fa4cc068b50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec1659f0 tx=0x7fa4d8007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:04.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f7343000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99f8d30 0x55acd99f9110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f7343000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 0x55acd99afa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f7343000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99aff60 0x55acd99b0340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f7343000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd9877170 con 0x55acd99f9650 2024-04-02T07:32:04.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f7343000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd9804d80 con 0x55acd99aff60 2024-04-02T07:32:04.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f7343000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55acd9802350 con 0x55acd99f8d30 2024-04-02T07:32:04.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f0a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 0x55acd99afa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f1400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99f8d30 0x55acd99f9110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f0a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 0x55acd99afa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36980/0 (socket says 172.21.15.55:36980) 2024-04-02T07:32:04.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f0a00640 1 -- 172.21.15.55:0/3657295709 learned_addr learned my addr 172.21.15.55:0/3657295709 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:04.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f1e00640 1 --2- 172.21.15.55:0/3657295709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99aff60 0x55acd99b0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f0a00640 1 -- 172.21.15.55:0/3657295709 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99f8d30 msgr2=0x55acd99f9110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:04.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f0a00640 1 --2- 172.21.15.55:0/3657295709 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99f8d30 0x55acd99f9110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f0a00640 1 -- 172.21.15.55:0/3657295709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99aff60 msgr2=0x55acd99b0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:04.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f0a00640 1 --2- 172.21.15.55:0/3657295709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99aff60 0x55acd99b0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f0a00640 1 -- 172.21.15.55:0/3657295709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55acd94fa070 con 0x55acd99f9650 2024-04-02T07:32:04.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f1400640 1 --2- 172.21.15.55:0/3657295709 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99f8d30 0x55acd99f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:32:04.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f1e00640 1 --2- 172.21.15.55:0/3657295709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99aff60 0x55acd99b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:32:04.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4f0a00640 1 --2- 172.21.15.55:0/3657295709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 0x55acd99afa20 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8004fa0 tx=0x7fa4d8013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=441ed2e476d53006 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:04.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4de000640 1 -- 172.21.15.55:0/3657295709 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8013ad0 con 0x55acd99f9650 2024-04-02T07:32:04.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4de000640 1 -- 172.21.15.55:0/3657295709 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d8013c30 con 0x55acd99f9650 2024-04-02T07:32:04.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.413+0000 7fa4de000640 1 -- 172.21.15.55:0/3657295709 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8012350 con 0x55acd99f9650 2024-04-02T07:32:04.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f7343000 1 -- 172.21.15.55:0/3657295709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 msgr2=0x55acd99afa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f7343000 1 --2- 172.21.15.55:0/3657295709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 0x55acd99afa20 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8004fa0 tx=0x7fa4d8013000 comp rx=0 tx=0).stop 2024-04-02T07:32:04.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f7343000 1 -- 172.21.15.55:0/3657295709 shutdown_connections 2024-04-02T07:32:04.419 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f7343000 1 --2- 172.21.15.55:0/3657295709 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99aff60 0x55acd99b0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f7343000 1 --2- 172.21.15.55:0/3657295709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 0x55acd99afa20 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f7343000 1 --2- 172.21.15.55:0/3657295709 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99f8d30 0x55acd99f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f7343000 1 -- 172.21.15.55:0/3657295709 >> 172.21.15.55:0/3657295709 conn(0x55acd99abf10 msgr2=0x55acd99ae300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:04.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f7343000 1 -- 172.21.15.55:0/3657295709 shutdown_connections 2024-04-02T07:32:04.420 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f7343000 1 -- 172.21.15.55:0/3657295709 wait complete. 2024-04-02T07:32:04.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f7343000 1 -- start start 2024-04-02T07:32:04.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f7343000 1 Processor -- start 2024-04-02T07:32:04.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f7343000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99aff60 0x55acd99ba530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f7343000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99f8d30 0x55acd99baa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f7343000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 0x55acd99bafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f7343000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd97fdc40 con 0x55acd99f9650 2024-04-02T07:32:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f7343000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd979cfa0 con 0x55acd99aff60 2024-04-02T07:32:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f7343000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55acd97bb1c0 con 0x55acd99f8d30 2024-04-02T07:32:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f7343000 10 client.0 _ll_register_callbacks cb 0x55acd999b060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:32:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 0x55acd99bafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 0x55acd99bafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36984/0 (socket says 172.21.15.55:36984) 2024-04-02T07:32:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f1400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99aff60 0x55acd99ba530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f1e00640 1 -- 172.21.15.55:0/2159089215 learned_addr learned my addr 172.21.15.55:0/2159089215 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f0a00640 1 --2- 172.21.15.55:0/2159089215 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99f8d30 0x55acd99baa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.431 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f1e00640 1 -- 172.21.15.55:0/2159089215 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99f8d30 msgr2=0x55acd99baa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:04.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f1e00640 1 --2- 172.21.15.55:0/2159089215 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99f8d30 0x55acd99baa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f1e00640 1 -- 172.21.15.55:0/2159089215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99aff60 msgr2=0x55acd99ba530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:04.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f1e00640 1 --2- 172.21.15.55:0/2159089215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99aff60 0x55acd99ba530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f1e00640 1 -- 172.21.15.55:0/2159089215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e4011040 con 0x55acd99f9650 2024-04-02T07:32:04.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f1400640 1 --2- 172.21.15.55:0/2159089215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99aff60 0x55acd99ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:32:04.432 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4f1e00640 1 --2- 172.21.15.55:0/2159089215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 0x55acd99bafb0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4004660 tx=0x7fa4e4007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac583b66f823935 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:04.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4d2a00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:32:04.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.417+0000 7fa4d2a00640 1 -- 172.21.15.55:0/2159089215 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4007e50 con 0x55acd99f9650 2024-04-02T07:32:04.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 1 -- 172.21.15.55:0/2159089215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55acd97faa20 con 0x55acd99f9650 2024-04-02T07:32:04.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4d2a00640 1 -- 172.21.15.55:0/2159089215 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4e4004750 con 0x55acd99f9650 2024-04-02T07:32:04.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4d2a00640 1 -- 172.21.15.55:0/2159089215 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4e4017470 con 0x55acd99f9650 2024-04-02T07:32:04.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 10 client.8799 fetch_fsmap learned FSMap version 81 2024-04-02T07:32:04.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 1 -- 172.21.15.55:0/2159089215 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x7fa4ec15d6f0 con 0x55acd99f9650 2024-04-02T07:32:04.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4d2a00640 1 -- 172.21.15.55:0/2159089215 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55acd97faa20 con 0x55acd99f9650 2024-04-02T07:32:04.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4d2a00640 1 -- 172.21.15.55:0/2159089215 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 81) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fa4e40175d0 con 0x55acd99f9650 2024-04-02T07:32:04.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 10 client.8799 fetch_fsmap finished waiting for FSMap version 81 2024-04-02T07:32:04.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 10 client.8799 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-02T07:32:04.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 20 client.8799 populate_metadata read hostname 'smithi055' 2024-04-02T07:32:04.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 1 --2- 172.21.15.55:0/2159089215 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x55acd99bb9c0 0x55acd9a0aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 4 client.8799 mds_command: new command op to 8436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:32:04.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 1 -- 172.21.15.55:0/2159089215 --> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55acd97fc590 con 0x55acd99bb9c0 2024-04-02T07:32:04.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f1400640 1 --2- 172.21.15.55:0/2159089215 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x55acd99bb9c0 0x55acd9a0aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f1400640 1 --2- 172.21.15.55:0/2159089215 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x55acd99bb9c0 0x55acd9a0aff0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13b93ee07eb96447 server_cookie=6243e423a55fc9cd in_seq=0 out_seq=0 2024-04-02T07:32:04.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4d2a00640 10 client.8799 ms_handle_connect on v2:172.21.15.55:6834/1089546237 2024-04-02T07:32:04.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4d2a00640 1 -- 172.21.15.55:0/2159089215 <== mds.0 v2:172.21.15.55:6834/1089546237 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55acd97fc590 con 0x55acd99bb9c0 2024-04-02T07:32:04.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4d2a00640 10 client.8799 handle_command_reply: tid=0 2024-04-02T07:32:04.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 1 client.8799 shutdown 2024-04-02T07:32:04.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 1 -- 172.21.15.55:0/2159089215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 msgr2=0x55acd99bafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 1 --2- 172.21.15.55:0/2159089215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 0x55acd99bafb0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4004660 tx=0x7fa4e4007700 comp rx=0 tx=0).stop 2024-04-02T07:32:04.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 1 -- 172.21.15.55:0/2159089215 shutdown_connections 2024-04-02T07:32:04.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 1 --2- 172.21.15.55:0/2159089215 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x55acd99bb9c0 0x55acd9a0aff0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 1 --2- 172.21.15.55:0/2159089215 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 0x55acd99bafb0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 1 --2- 172.21.15.55:0/2159089215 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99f8d30 0x55acd99baa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 1 --2- 172.21.15.55:0/2159089215 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99aff60 0x55acd99ba530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4d2a00640 0 client.8799 ms_handle_reset on v2:172.21.15.55:6834/1089546237 2024-04-02T07:32:04.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 1 -- 172.21.15.55:0/2159089215 >> 172.21.15.55:0/2159089215 conn(0x55acd99abf10 msgr2=0x55acd99aeb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:04.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 1 -- 172.21.15.55:0/2159089215 shutdown_connections 2024-04-02T07:32:04.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 1 -- 172.21.15.55:0/2159089215 wait complete. 2024-04-02T07:32:04.436 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.421+0000 7fa4f7343000 20 client.8799 trim_cache size 0 max 16384 2024-04-02T07:32:04.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.425+0000 7f3593c00640 1 Processor -- start 2024-04-02T07:32:04.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.425+0000 7f3593c00640 1 -- start start 2024-04-02T07:32:04.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.425+0000 7f3593c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f358c06a4a0 0x7f358c0cb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.425+0000 7f3593c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358c15ef70 con 0x7f358c0ca990 2024-04-02T07:32:04.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.425+0000 7f3593c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f358c15e3a0 con 0x7f358c0cad70 2024-04-02T07:32:04.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.425+0000 7f3593c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f358c15e640 con 0x7f358c06a4a0 2024-04-02T07:32:04.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.425+0000 7f3591200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f358c0ca990 0x7f358c069d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43348/0 (socket says 172.21.15.55:43348) 2024-04-02T07:32:04.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.425+0000 7f3591200640 1 -- 172.21.15.55:0/2370953592 learned_addr learned my addr 172.21.15.55:0/2370953592 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:32:04.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.425+0000 7f358be00640 1 --2- 172.21.15.55:0/2370953592 >> v2:172.21.15.55:3300/0 conn(0x7f358c06a4a0 0x7f358c0cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.425+0000 7f358b400640 1 -- 172.21.15.55:0/2370953592 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2376505045 0 0) 0x7f358c15ef70 con 0x7f358c0ca990 2024-04-02T07:32:04.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.425+0000 7f358b400640 1 -- 172.21.15.55:0/2370953592 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3574003530 con 0x7f358c0ca990 2024-04-02T07:32:04.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.425+0000 7f358be00640 1 -- 172.21.15.55:0/2370953592 >> v1:172.21.15.106:6789/0 conn(0x7f358c0cad70 legacy=0x7f358c15ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.425+0000 7f358be00640 1 -- 172.21.15.55:0/2370953592 >> v1:172.21.15.55:6789/0 conn(0x7f358c0ca990 legacy=0x7f358c069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.425+0000 7f358be00640 1 -- 172.21.15.55:0/2370953592 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f358c15e920 con 0x7f358c06a4a0 2024-04-02T07:32:04.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.429+0000 7f358be00640 1 --2- 172.21.15.55:0/2370953592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f358c06a4a0 0x7f358c0cb660 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f35780097c0 tx=0x7f357801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c885d32071df28f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:04.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.429+0000 7f358b400640 1 -- 172.21.15.55:0/2370953592 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35780ab670 con 0x7f358c06a4a0 2024-04-02T07:32:04.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.429+0000 7f358b400640 1 -- 172.21.15.55:0/2370953592 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35780ab7d0 con 0x7f358c06a4a0 2024-04-02T07:32:04.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.429+0000 7f358b400640 1 -- 172.21.15.55:0/2370953592 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35780abb60 con 0x7f358c06a4a0 2024-04-02T07:32:04.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.429+0000 7f3593c00640 1 -- 172.21.15.55:0/2370953592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f358c06a4a0 msgr2=0x7f358c0cb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.429+0000 7f3593c00640 1 --2- 172.21.15.55:0/2370953592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f358c06a4a0 0x7f358c0cb660 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f35780097c0 tx=0x7f357801c470 comp rx=0 tx=0).stop 2024-04-02T07:32:04.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.429+0000 7f3593c00640 1 -- 172.21.15.55:0/2370953592 shutdown_connections 2024-04-02T07:32:04.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.429+0000 7f3593c00640 1 --2- 172.21.15.55:0/2370953592 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f358c06a4a0 0x7f358c0cb660 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.429+0000 7f3593c00640 1 -- 172.21.15.55:0/2370953592 >> 172.21.15.55:0/2370953592 conn(0x7f358c0b0220 msgr2=0x7f358c0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:04.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.429+0000 7f3593c00640 1 -- 172.21.15.55:0/2370953592 shutdown_connections 2024-04-02T07:32:04.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.429+0000 7f3593c00640 1 -- 172.21.15.55:0/2370953592 wait complete. 2024-04-02T07:32:04.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3593c00640 1 Processor -- start 2024-04-02T07:32:04.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3593c00640 1 -- start start 2024-04-02T07:32:04.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3593c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f358c06a4a0 0x7f358c136d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3593c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f358c0ca990 0x7f358c14b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3593c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f358c0cad70 0x7f358c14b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3593c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c0aff90 con 0x7f358c06a4a0 2024-04-02T07:32:04.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3593c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f358c0af6f0 con 0x7f358c0ca990 2024-04-02T07:32:04.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3593c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f358c0af9d0 con 0x7f358c0cad70 2024-04-02T07:32:04.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3591200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f358c06a4a0 0x7f358c136d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3591200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f358c06a4a0 0x7f358c136d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37000/0 (socket says 172.21.15.55:37000) 2024-04-02T07:32:04.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3591200640 1 -- 172.21.15.55:0/508047680 learned_addr learned my addr 172.21.15.55:0/508047680 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:04.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3591c00640 1 --2- 172.21.15.55:0/508047680 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f358c0cad70 0x7f358c14b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f358be00640 1 --2- 172.21.15.55:0/508047680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f358c0ca990 0x7f358c14b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3591200640 1 -- 172.21.15.55:0/508047680 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f358c0cad70 msgr2=0x7f358c14b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3591200640 1 --2- 172.21.15.55:0/508047680 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f358c0cad70 0x7f358c14b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3591200640 1 -- 172.21.15.55:0/508047680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f358c0ca990 msgr2=0x7f358c14b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3591200640 1 --2- 172.21.15.55:0/508047680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f358c0ca990 0x7f358c14b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3591200640 1 -- 172.21.15.55:0/508047680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3578009420 con 0x7f358c06a4a0 2024-04-02T07:32:04.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3591c00640 1 --2- 172.21.15.55:0/508047680 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f358c0cad70 0x7f358c14b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:32:04.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3591200640 1 --2- 172.21.15.55:0/508047680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f358c06a4a0 0x7f358c136d40 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f358000c4d0 tx=0x7f358000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:04.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3588c00640 1 -- 172.21.15.55:0/508047680 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580005cf0 con 0x7f358c06a4a0 2024-04-02T07:32:04.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3588c00640 1 -- 172.21.15.55:0/508047680 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3580005e50 con 0x7f358c06a4a0 2024-04-02T07:32:04.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3588c00640 1 -- 172.21.15.55:0/508047680 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3580007270 con 0x7f358c06a4a0 2024-04-02T07:32:04.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3593c00640 1 -- 172.21.15.55:0/508047680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f358c0afcb0 con 0x7f358c06a4a0 2024-04-02T07:32:04.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3593c00640 1 -- 172.21.15.55:0/508047680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f358c148ca0 con 0x7f358c06a4a0 2024-04-02T07:32:04.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.433+0000 7f3593c00640 1 -- 172.21.15.55:0/508047680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f358c066c90 con 0x7f358c06a4a0 2024-04-02T07:32:04.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.437+0000 7f3588c00640 1 -- 172.21.15.55:0/508047680 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f35800073d0 con 0x7f358c06a4a0 2024-04-02T07:32:04.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.437+0000 7f3588c00640 1 --2- 172.21.15.55:0/508047680 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f356c0666c0 0x7f356c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.437+0000 7f3588c00640 1 -- 172.21.15.55:0/508047680 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3580083e20 con 0x7f358c06a4a0 2024-04-02T07:32:04.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.437+0000 7f3588c00640 1 -- 172.21.15.55:0/508047680 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+514 (secure 0 0 0) 0x7f35800841b0 con 0x7f358c06a4a0 2024-04-02T07:32:04.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.437+0000 7f358be00640 1 --2- 172.21.15.55:0/508047680 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f356c0666c0 0x7f356c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.437+0000 7f3593c00640 1 -- 172.21.15.55:0/508047680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7f358c0b1840 con 0x7f358c06a4a0 2024-04-02T07:32:04.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.437+0000 7f358be00640 1 --2- 172.21.15.55:0/508047680 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f356c0666c0 0x7f356c068b80 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f35780af000 tx=0x7f35780a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:04.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.437+0000 7fa4f7343000 1 Processor -- start 2024-04-02T07:32:04.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.437+0000 7fa4f7343000 1 -- start start 2024-04-02T07:32:04.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f7343000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99aff60 0x55acd9a061a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f7343000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99f8d30 0x55acd9a066e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f7343000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 0x55acd9a08fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f7343000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd94bacf0 con 0x55acd99f9650 2024-04-02T07:32:04.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f7343000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd99b4860 con 0x55acd99f8d30 2024-04-02T07:32:04.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f7343000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55acd97f9430 con 0x55acd99aff60 2024-04-02T07:32:04.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 0x55acd9a08fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 0x55acd9a08fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37008/0 (socket says 172.21.15.55:37008) 2024-04-02T07:32:04.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f1e00640 1 -- 172.21.15.55:0/3037109760 learned_addr learned my addr 172.21.15.55:0/3037109760 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:04.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f1400640 1 --2- 172.21.15.55:0/3037109760 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99aff60 0x55acd9a061a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f0a00640 1 --2- 172.21.15.55:0/3037109760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99f8d30 0x55acd9a066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f1e00640 1 -- 172.21.15.55:0/3037109760 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99aff60 msgr2=0x55acd9a061a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:04.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f1e00640 1 --2- 172.21.15.55:0/3037109760 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99aff60 0x55acd9a061a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f1e00640 1 -- 172.21.15.55:0/3037109760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99f8d30 msgr2=0x55acd9a066e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:04.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f1e00640 1 --2- 172.21.15.55:0/3037109760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99f8d30 0x55acd9a066e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f1e00640 1 -- 172.21.15.55:0/3037109760 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec154a10 con 0x55acd99f9650 2024-04-02T07:32:04.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f1e00640 1 --2- 172.21.15.55:0/3037109760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 0x55acd9a08fe0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4007cb0 tx=0x7fa4e400e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=764cca377dae9c22 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:04.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4dea00640 1 -- 172.21.15.55:0/3037109760 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4009be0 con 0x55acd99f9650 2024-04-02T07:32:04.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4dea00640 1 -- 172.21.15.55:0/3037109760 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e4007e50 con 0x55acd99f9650 2024-04-02T07:32:04.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4dea00640 1 -- 172.21.15.55:0/3037109760 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e4017b30 con 0x55acd99f9650 2024-04-02T07:32:04.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f7343000 1 -- 172.21.15.55:0/3037109760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 msgr2=0x55acd9a08fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f7343000 1 --2- 172.21.15.55:0/3037109760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 0x55acd9a08fe0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fa4e4007cb0 tx=0x7fa4e400e000 comp rx=0 tx=0).stop 2024-04-02T07:32:04.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f7343000 1 -- 172.21.15.55:0/3037109760 shutdown_connections 2024-04-02T07:32:04.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f7343000 1 --2- 172.21.15.55:0/3037109760 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f9650 0x55acd9a08fe0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f7343000 1 --2- 172.21.15.55:0/3037109760 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99f8d30 0x55acd9a066e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f7343000 1 --2- 172.21.15.55:0/3037109760 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99aff60 0x55acd9a061a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f7343000 1 -- 172.21.15.55:0/3037109760 >> 172.21.15.55:0/3037109760 conn(0x55acd99abf10 msgr2=0x55acd9a05a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:04.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f7343000 1 -- 172.21.15.55:0/3037109760 shutdown_connections 2024-04-02T07:32:04.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f7343000 1 -- 172.21.15.55:0/3037109760 wait complete. 2024-04-02T07:32:04.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f7343000 1 -- start start 2024-04-02T07:32:04.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.441+0000 7fa4f7343000 1 Processor -- start 2024-04-02T07:32:04.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99aff60 0x55acd9a0c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f8d30 0x55acd9a574d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99f9650 0x55acd9a57a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd97fb450 con 0x55acd99f8d30 2024-04-02T07:32:04.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55acd97c4420 con 0x55acd99f9650 2024-04-02T07:32:04.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55acd9806010 con 0x55acd99aff60 2024-04-02T07:32:04.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 10 client.0 _ll_register_callbacks cb 0x55acd98770c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:32:04.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f0a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f8d30 0x55acd9a574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f0a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f8d30 0x55acd9a574d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37022/0 (socket says 172.21.15.55:37022) 2024-04-02T07:32:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f0a00640 1 -- 172.21.15.55:0/1205227361 learned_addr learned my addr 172.21.15.55:0/1205227361 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f1400640 1 --2- 172.21.15.55:0/1205227361 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99aff60 0x55acd9a0c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f1e00640 1 --2- 172.21.15.55:0/1205227361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99f9650 0x55acd9a57a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f0a00640 1 -- 172.21.15.55:0/1205227361 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99aff60 msgr2=0x55acd9a0c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f0a00640 1 --2- 172.21.15.55:0/1205227361 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99aff60 0x55acd9a0c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f0a00640 1 -- 172.21.15.55:0/1205227361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99f9650 msgr2=0x55acd9a57a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f0a00640 1 --2- 172.21.15.55:0/1205227361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99f9650 0x55acd9a57a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f0a00640 1 -- 172.21.15.55:0/1205227361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4ec15d6f0 con 0x55acd99f8d30 2024-04-02T07:32:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f1400640 1 --2- 172.21.15.55:0/1205227361 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99aff60 0x55acd9a0c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:32:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f0a00640 1 --2- 172.21.15.55:0/1205227361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f8d30 0x55acd9a574d0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8001ec0 tx=0x7fa4d8000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cadb252bc76161a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4d2a00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:32:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4d2a00640 1 -- 172.21.15.55:0/1205227361 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d8031030 con 0x55acd99f8d30 2024-04-02T07:32:04.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4d2a00640 1 -- 172.21.15.55:0/1205227361 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4d8032070 con 0x55acd99f8d30 2024-04-02T07:32:04.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 1 -- 172.21.15.55:0/1205227361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55acd97ba5f0 con 0x55acd99f8d30 2024-04-02T07:32:04.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4d2a00640 1 -- 172.21.15.55:0/1205227361 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa4d8013e20 con 0x55acd99f8d30 2024-04-02T07:32:04.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 10 client.8814 fetch_fsmap learned FSMap version 81 2024-04-02T07:32:04.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 1 -- 172.21.15.55:0/1205227361 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x7fa4d8004c80 con 0x55acd99f8d30 2024-04-02T07:32:04.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4d2a00640 1 -- 172.21.15.55:0/1205227361 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55acd97ba5f0 con 0x55acd99f8d30 2024-04-02T07:32:04.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4d2a00640 1 -- 172.21.15.55:0/1205227361 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 81) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fa4d8012070 con 0x55acd99f8d30 2024-04-02T07:32:04.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 10 client.8814 fetch_fsmap finished waiting for FSMap version 81 2024-04-02T07:32:04.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 10 client.8814 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-02T07:32:04.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 20 client.8814 populate_metadata read hostname 'smithi055' 2024-04-02T07:32:04.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 1 --2- 172.21.15.55:0/1205227361 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x55acd9a143b0 0x55acd9a147c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 4 client.8814 mds_command: new command op to 8436 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-02T07:32:04.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 1 -- 172.21.15.55:0/1205227361 --> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x55acd97bc410 con 0x55acd9a143b0 2024-04-02T07:32:04.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f1400640 1 --2- 172.21.15.55:0/1205227361 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x55acd9a143b0 0x55acd9a147c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f1400640 1 --2- 172.21.15.55:0/1205227361 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x55acd9a143b0 0x55acd9a147c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dc4dee458f945b server_cookie=a3fd914a28a8997 in_seq=0 out_seq=0 2024-04-02T07:32:04.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4d2a00640 10 client.8814 ms_handle_connect on v2:172.21.15.55:6834/1089546237 2024-04-02T07:32:04.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4d2a00640 1 -- 172.21.15.55:0/1205227361 <== mds.0 v2:172.21.15.55:6834/1089546237 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55acd97bc410 con 0x55acd9a143b0 2024-04-02T07:32:04.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4d2a00640 10 client.8814 handle_command_reply: tid=0 2024-04-02T07:32:04.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 1 client.8814 shutdown 2024-04-02T07:32:04.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 1 -- 172.21.15.55:0/1205227361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f8d30 msgr2=0x55acd9a574d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 1 --2- 172.21.15.55:0/1205227361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f8d30 0x55acd9a574d0 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fa4d8001ec0 tx=0x7fa4d8000ee0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 1 -- 172.21.15.55:0/1205227361 shutdown_connections 2024-04-02T07:32:04.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 1 --2- 172.21.15.55:0/1205227361 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x55acd9a143b0 0x55acd9a147c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 1 --2- 172.21.15.55:0/1205227361 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55acd99f9650 0x55acd9a57a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 1 --2- 172.21.15.55:0/1205227361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55acd99f8d30 0x55acd9a574d0 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 1 --2- 172.21.15.55:0/1205227361 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55acd99aff60 0x55acd9a0c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4f7343000 1 -- 172.21.15.55:0/1205227361 >> 172.21.15.55:0/1205227361 conn(0x55acd99abf10 msgr2=0x55acd9a06320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:04.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.445+0000 7fa4d2a00640 0 client.8814 ms_handle_reset on v2:172.21.15.55:6834/1089546237 2024-04-02T07:32:04.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.449+0000 7fa4f7343000 1 -- 172.21.15.55:0/1205227361 shutdown_connections 2024-04-02T07:32:04.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.449+0000 7fa4f7343000 1 -- 172.21.15.55:0/1205227361 wait complete. 2024-04-02T07:32:04.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.449+0000 7fa4f7343000 20 client.8814 trim_cache size 0 max 16384 2024-04-02T07:32:04.457 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:32:04.457 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-04-02T07:32:04.457 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "004694d0-eadc-48ca-805e-36aec1352d98", 2024-04-02T07:32:04.457 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-04-02T07:32:04.457 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:32:04.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.449+0000 7fa4f3e00640 1 -- 172.21.15.55:0/2351418128 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4cc066690 msgr2=0x7fa4cc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.449+0000 7fa4f3e00640 1 --2- 172.21.15.55:0/2351418128 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4cc066690 0x7fa4cc068b50 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fa4ec1659f0 tx=0x7fa4d8007d60 comp rx=0 tx=0).stop 2024-04-02T07:32:04.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.449+0000 7fa4f3e00640 1 -- 172.21.15.55:0/2351418128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4ec06da10 msgr2=0x7fa4ec147f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.449+0000 7fa4f3e00640 1 --2- 172.21.15.55:0/2351418128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4ec06da10 0x7fa4ec147f20 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00ab040 tx=0x7fa4e001ad70 comp rx=0 tx=0).stop 2024-04-02T07:32:04.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.449+0000 7fa4f3e00640 1 -- 172.21.15.55:0/2351418128 shutdown_connections 2024-04-02T07:32:04.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.449+0000 7fa4f3e00640 1 --2- 172.21.15.55:0/2351418128 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa4cc066690 0x7fa4cc068b50 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.449+0000 7fa4f3e00640 1 --2- 172.21.15.55:0/2351418128 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa4ec15aa40 0x7fa4ec15afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.449+0000 7fa4f3e00640 1 --2- 172.21.15.55:0/2351418128 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa4ec0af920 0x7fa4ec147250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.449+0000 7fa4f3e00640 1 --2- 172.21.15.55:0/2351418128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa4ec06da10 0x7fa4ec147f20 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.449+0000 7fa4f3e00640 1 -- 172.21.15.55:0/2351418128 >> 172.21.15.55:0/2351418128 conn(0x7fa4ec069d90 msgr2=0x7fa4ec15e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:04.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.449+0000 7fa4f3e00640 1 -- 172.21.15.55:0/2351418128 shutdown_connections 2024-04-02T07:32:04.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.449+0000 7fa4f3e00640 1 -- 172.21.15.55:0/2351418128 wait complete. 2024-04-02T07:32:04.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:32:04.468 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-02T07:32:04.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.609+0000 7f43b0400640 1 Processor -- start 2024-04-02T07:32:04.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.609+0000 7f43b0400640 1 -- start start 2024-04-02T07:32:04.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.609+0000 7f43b0400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f43a80adeb0 0x7f43a806d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.609+0000 7f43b0400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a8161330 con 0x7f43a8162070 2024-04-02T07:32:04.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.609+0000 7f43b0400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43a806e560 con 0x7f43a80709b0 2024-04-02T07:32:04.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.609+0000 7f43b0400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43a80b2960 con 0x7f43a80adeb0 2024-04-02T07:32:04.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.609+0000 7f43ada00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f43a80adeb0 0x7f43a806d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.609+0000 7f43ad000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f43a8162070 0x7f43a80702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43350/0 (socket says 172.21.15.55:43350) 2024-04-02T07:32:04.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.609+0000 7f43ad000640 1 -- 172.21.15.55:0/3456910029 learned_addr learned my addr 172.21.15.55:0/3456910029 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:32:04.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.613+0000 7f43ada00640 1 -- 172.21.15.55:0/3456910029 >> v1:172.21.15.106:6789/0 conn(0x7f43a80709b0 legacy=0x7f43a8164970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.613+0000 7f43ada00640 1 -- 172.21.15.55:0/3456910029 >> v1:172.21.15.55:6789/0 conn(0x7f43a8162070 legacy=0x7f43a80702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.613+0000 7f43ada00640 1 -- 172.21.15.55:0/3456910029 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43a806e280 con 0x7f43a80adeb0 2024-04-02T07:32:04.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.613+0000 7f43a7e00640 1 -- 172.21.15.55:0/3456910029 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44967503 0 0) 0x7f43a8161330 con 0x7f43a8162070 2024-04-02T07:32:04.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.613+0000 7f43ada00640 1 --2- 172.21.15.55:0/3456910029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43a80adeb0 0x7f43a806d830 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f439c0097c0 tx=0x7f439c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde9664a94d366cc server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:04.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.613+0000 7f43a7e00640 1 -- 172.21.15.55:0/3456910029 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0ab670 con 0x7f43a80adeb0 2024-04-02T07:32:04.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.613+0000 7f43a7e00640 1 -- 172.21.15.55:0/3456910029 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c0ab7d0 con 0x7f43a80adeb0 2024-04-02T07:32:04.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.613+0000 7f43a7e00640 1 -- 172.21.15.55:0/3456910029 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0abb60 con 0x7f43a80adeb0 2024-04-02T07:32:04.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.613+0000 7f43b0400640 1 -- 172.21.15.55:0/3456910029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43a80adeb0 msgr2=0x7f43a806d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.613+0000 7f43b0400640 1 --2- 172.21.15.55:0/3456910029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43a80adeb0 0x7f43a806d830 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f439c0097c0 tx=0x7f439c01c470 comp rx=0 tx=0).stop 2024-04-02T07:32:04.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43b0400640 1 -- 172.21.15.55:0/3456910029 shutdown_connections 2024-04-02T07:32:04.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43b0400640 1 --2- 172.21.15.55:0/3456910029 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43a80adeb0 0x7f43a806d830 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43b0400640 1 -- 172.21.15.55:0/3456910029 >> 172.21.15.55:0/3456910029 conn(0x7f43a806a390 msgr2=0x7f43a80b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:04.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43b0400640 1 -- 172.21.15.55:0/3456910029 shutdown_connections 2024-04-02T07:32:04.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43b0400640 1 -- 172.21.15.55:0/3456910029 wait complete. 2024-04-02T07:32:04.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43b0400640 1 Processor -- start 2024-04-02T07:32:04.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43b0400640 1 -- start start 2024-04-02T07:32:04.619 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43b0400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43a80709b0 0x7f43a8151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43b0400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f43a80adeb0 0x7f43a815b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43b0400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43a8162070 0x7f43a81587b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43b0400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a8158cf0 con 0x7f43a80709b0 2024-04-02T07:32:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43b0400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a8158f00 con 0x7f43a8162070 2024-04-02T07:32:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43b0400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43a815cef0 con 0x7f43a80adeb0 2024-04-02T07:32:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43ada00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43a80709b0 0x7f43a8151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43ada00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43a80709b0 0x7f43a8151810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37030/0 (socket says 172.21.15.55:37030) 2024-04-02T07:32:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43ada00640 1 -- 172.21.15.55:0/4017112746 learned_addr learned my addr 172.21.15.55:0/4017112746 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43ada00640 1 -- 172.21.15.55:0/4017112746 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f43a80adeb0 msgr2=0x7f43a815b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43ada00640 1 --2- 172.21.15.55:0/4017112746 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f43a80adeb0 0x7f43a815b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43ada00640 1 -- 172.21.15.55:0/4017112746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43a8162070 msgr2=0x7f43a81587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43ae400640 1 --2- 172.21.15.55:0/4017112746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43a8162070 0x7f43a81587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43ada00640 1 --2- 172.21.15.55:0/4017112746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43a8162070 0x7f43a81587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43ada00640 1 -- 172.21.15.55:0/4017112746 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f439c009420 con 0x7f43a80709b0 2024-04-02T07:32:04.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43ae400640 1 --2- 172.21.15.55:0/4017112746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43a8162070 0x7f43a81587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:32:04.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43ada00640 1 --2- 172.21.15.55:0/4017112746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43a80709b0 0x7f43a8151810 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f439c019080 tx=0x7f439c01acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:04.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43a5600640 1 -- 172.21.15.55:0/4017112746 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0b5810 con 0x7f43a80709b0 2024-04-02T07:32:04.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43a5600640 1 -- 172.21.15.55:0/4017112746 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c0b5970 con 0x7f43a80709b0 2024-04-02T07:32:04.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43a5600640 1 -- 172.21.15.55:0/4017112746 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0b5d20 con 0x7f43a80709b0 2024-04-02T07:32:04.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.617+0000 7f43b0400640 1 -- 172.21.15.55:0/4017112746 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a815a3c0 con 0x7f43a80709b0 2024-04-02T07:32:04.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.621+0000 7f43b0400640 1 -- 172.21.15.55:0/4017112746 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a815a940 con 0x7f43a80709b0 2024-04-02T07:32:04.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.621+0000 7f43a5600640 1 -- 172.21.15.55:0/4017112746 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f439c0bf410 con 0x7f43a80709b0 2024-04-02T07:32:04.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.621+0000 7f43a5600640 1 --2- 172.21.15.55:0/4017112746 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4388066690 0x7f4388068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.621+0000 7f43a5600640 1 -- 172.21.15.55:0/4017112746 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f439c11ed20 con 0x7f43a80709b0 2024-04-02T07:32:04.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.621+0000 7f43b3766000 1 Processor -- start 2024-04-02T07:32:04.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.621+0000 7f43ad000640 1 --2- 172.21.15.55:0/4017112746 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4388066690 0x7f4388068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.621+0000 7f43b3766000 1 -- start start 2024-04-02T07:32:04.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43ad000640 1 --2- 172.21.15.55:0/4017112746 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4388066690 0x7f4388068b50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4394000c10 tx=0x7f4394007a70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:04.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43b3766000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfcf1a70 0x5650dfcf1e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43b3766000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfcf2390 0x5650dfca54f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43b3766000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfca5a30 0x5650dfca5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43b3766000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650dfb70630 con 0x5650dfca5a30 2024-04-02T07:32:04.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43b3766000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650dfafdbd0 con 0x5650dfcf1a70 2024-04-02T07:32:04.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43b3766000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5650dfafb1a0 con 0x5650dfcf2390 2024-04-02T07:32:04.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43ada00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfcf1a70 0x5650dfcf1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43ada00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfcf1a70 0x5650dfcf1e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:54082/0 (socket says 172.21.15.55:54082) 2024-04-02T07:32:04.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43ada00640 1 -- 172.21.15.55:0/742603715 learned_addr learned my addr 172.21.15.55:0/742603715 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:04.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43ad000640 1 --2- 172.21.15.55:0/742603715 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfcf2390 0x5650dfca54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43ada00640 1 -- 172.21.15.55:0/742603715 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfcf2390 msgr2=0x5650dfca54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:04.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43ada00640 1 --2- 172.21.15.55:0/742603715 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfcf2390 0x5650dfca54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43ada00640 1 -- 172.21.15.55:0/742603715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfca5a30 msgr2=0x5650dfca5e10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-02T07:32:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43ada00640 1 --2- 172.21.15.55:0/742603715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfca5a30 0x5650dfca5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43ada00640 1 -- 172.21.15.55:0/742603715 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650df7f2e20 con 0x5650dfcf1a70 2024-04-02T07:32:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43ada00640 1 --2- 172.21.15.55:0/742603715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfcf1a70 0x5650dfcf1e50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f439c0ec240 tx=0x7f439c01c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=828ce2b2d4bd308d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f439a000640 1 -- 172.21.15.55:0/742603715 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0f3b70 con 0x5650dfcf1a70 2024-04-02T07:32:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f439a000640 1 -- 172.21.15.55:0/742603715 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c118070 con 0x5650dfcf1a70 2024-04-02T07:32:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f439a000640 1 -- 172.21.15.55:0/742603715 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0f8130 con 0x5650dfcf1a70 2024-04-02T07:32:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43b3766000 1 -- 172.21.15.55:0/742603715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfcf1a70 msgr2=0x5650dfcf1e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43b3766000 1 --2- 172.21.15.55:0/742603715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfcf1a70 0x5650dfcf1e50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f439c0ec240 tx=0x7f439c01c470 comp rx=0 tx=0).stop 2024-04-02T07:32:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43b3766000 1 -- 172.21.15.55:0/742603715 shutdown_connections 2024-04-02T07:32:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43b3766000 1 --2- 172.21.15.55:0/742603715 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfca5a30 0x5650dfca5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43b3766000 1 --2- 172.21.15.55:0/742603715 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfcf2390 0x5650dfca54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43b3766000 1 --2- 172.21.15.55:0/742603715 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfcf1a70 0x5650dfcf1e50 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43b3766000 1 -- 172.21.15.55:0/742603715 >> 172.21.15.55:0/742603715 conn(0x5650dfaa6160 msgr2=0x5650dfcd4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:04.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43b3766000 1 -- 172.21.15.55:0/742603715 shutdown_connections 2024-04-02T07:32:04.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43b3766000 1 -- 172.21.15.55:0/742603715 wait complete. 2024-04-02T07:32:04.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.625+0000 7f43b3766000 1 -- start start 2024-04-02T07:32:04.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43b3766000 1 Processor -- start 2024-04-02T07:32:04.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43b3766000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfca5a30 0x5650dfcf1200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43b3766000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfcf1a70 0x5650dfcd5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43b3766000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfcf2390 0x5650dfcd5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43b3766000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650dfaf6a90 con 0x5650dfca5a30 2024-04-02T07:32:04.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43b3766000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650dfa95d40 con 0x5650dfcf1a70 2024-04-02T07:32:04.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43b3766000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5650dfab3f30 con 0x5650dfcf2390 2024-04-02T07:32:04.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43b3766000 10 client.0 _ll_register_callbacks cb 0x5650dfb58810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:32:04.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43ada00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfca5a30 0x5650dfcf1200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43ada00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfca5a30 0x5650dfcf1200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37056/0 (socket says 172.21.15.55:37056) 2024-04-02T07:32:04.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43ada00640 1 -- 172.21.15.55:0/1770799951 learned_addr learned my addr 172.21.15.55:0/1770799951 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:04.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43ae400640 1 --2- 172.21.15.55:0/1770799951 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfcf2390 0x5650dfcd5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43ada00640 1 -- 172.21.15.55:0/1770799951 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfcf2390 msgr2=0x5650dfcd5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:04.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43ad000640 1 --2- 172.21.15.55:0/1770799951 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfcf1a70 0x5650dfcd5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43ada00640 1 --2- 172.21.15.55:0/1770799951 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfcf2390 0x5650dfcd5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43ada00640 1 -- 172.21.15.55:0/1770799951 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfcf1a70 msgr2=0x5650dfcd5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43ada00640 1 --2- 172.21.15.55:0/1770799951 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfcf1a70 0x5650dfcd5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43ada00640 1 -- 172.21.15.55:0/1770799951 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a815a940 con 0x5650dfca5a30 2024-04-02T07:32:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43ae400640 1 --2- 172.21.15.55:0/1770799951 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfcf2390 0x5650dfcd5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:32:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43ad000640 1 --2- 172.21.15.55:0/1770799951 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfcf1a70 0x5650dfcd5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:32:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43ada00640 1 --2- 172.21.15.55:0/1770799951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfca5a30 0x5650dfcf1200 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f439c0ec240 tx=0x7f439c000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9e985d8bd60ac server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f438ea00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:32:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f438ea00640 1 -- 172.21.15.55:0/1770799951 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0f7ea0 con 0x5650dfca5a30 2024-04-02T07:32:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f438ea00640 1 -- 172.21.15.55:0/1770799951 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f439c0f3b70 con 0x5650dfca5a30 2024-04-02T07:32:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43b3766000 1 -- 172.21.15.55:0/1770799951 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5650dfaf53e0 con 0x5650dfca5a30 2024-04-02T07:32:04.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f438ea00640 1 -- 172.21.15.55:0/1770799951 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f439c0f8130 con 0x5650dfca5a30 2024-04-02T07:32:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43b3766000 10 client.8826 fetch_fsmap learned FSMap version 81 2024-04-02T07:32:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43b3766000 1 -- 172.21.15.55:0/1770799951 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x5650dfabbaa0 con 0x5650dfca5a30 2024-04-02T07:32:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f438ea00640 1 -- 172.21.15.55:0/1770799951 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5650dfaf53e0 con 0x5650dfca5a30 2024-04-02T07:32:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f438ea00640 1 -- 172.21.15.55:0/1770799951 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 81) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f439c0c8020 con 0x5650dfca5a30 2024-04-02T07:32:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43b3766000 10 client.8826 fetch_fsmap finished waiting for FSMap version 81 2024-04-02T07:32:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43b3766000 10 client.8826 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-02T07:32:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43b3766000 20 client.8826 populate_metadata read hostname 'smithi055' 2024-04-02T07:32:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43b3766000 1 --2- 172.21.15.55:0/1770799951 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x5650dfcf92d0 0x5650dfcf96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43b3766000 4 client.8826 mds_command: new command op to 8436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:32:04.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43b3766000 1 -- 172.21.15.55:0/1770799951 --> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5650dfac6d00 con 0x5650dfcf92d0 2024-04-02T07:32:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43ad000640 1 --2- 172.21.15.55:0/1770799951 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x5650dfcf92d0 0x5650dfcf96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f43ad000640 1 --2- 172.21.15.55:0/1770799951 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x5650dfcf92d0 0x5650dfcf96b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14922fec40c8369e server_cookie=abbab6b72f7b333d in_seq=0 out_seq=0 2024-04-02T07:32:04.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.629+0000 7f438ea00640 10 client.8826 ms_handle_connect on v2:172.21.15.55:6834/1089546237 2024-04-02T07:32:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.633+0000 7f438ea00640 1 -- 172.21.15.55:0/1770799951 <== mds.0 v2:172.21.15.55:6834/1089546237 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5650dfac6d00 con 0x5650dfcf92d0 2024-04-02T07:32:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.633+0000 7f438ea00640 10 client.8826 handle_command_reply: tid=0 2024-04-02T07:32:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.633+0000 7f43b3766000 1 client.8826 shutdown 2024-04-02T07:32:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.633+0000 7f43b3766000 1 -- 172.21.15.55:0/1770799951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfca5a30 msgr2=0x5650dfcf1200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.633+0000 7f43b3766000 1 --2- 172.21.15.55:0/1770799951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfca5a30 0x5650dfcf1200 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f439c0ec240 tx=0x7f439c000bd0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.633+0000 7f43b3766000 1 -- 172.21.15.55:0/1770799951 shutdown_connections 2024-04-02T07:32:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.633+0000 7f43b3766000 1 --2- 172.21.15.55:0/1770799951 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x5650dfcf92d0 0x5650dfcf96b0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.633+0000 7f43b3766000 1 --2- 172.21.15.55:0/1770799951 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfcf2390 0x5650dfcd5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.633+0000 7f43b3766000 1 --2- 172.21.15.55:0/1770799951 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfcf1a70 0x5650dfcd5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.633+0000 7f43b3766000 1 --2- 172.21.15.55:0/1770799951 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfca5a30 0x5650dfcf1200 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.633+0000 7f438ea00640 0 client.8826 ms_handle_reset on v2:172.21.15.55:6834/1089546237 2024-04-02T07:32:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.633+0000 7f43b3766000 1 -- 172.21.15.55:0/1770799951 >> 172.21.15.55:0/1770799951 conn(0x5650dfaa6160 msgr2=0x5650dfca4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.633+0000 7f43b3766000 1 -- 172.21.15.55:0/1770799951 shutdown_connections 2024-04-02T07:32:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.633+0000 7f43b3766000 1 -- 172.21.15.55:0/1770799951 wait complete. 2024-04-02T07:32:04.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.633+0000 7f43b3766000 20 client.8826 trim_cache size 0 max 16384 2024-04-02T07:32:04.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.645+0000 7f43b3766000 1 Processor -- start 2024-04-02T07:32:04.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.645+0000 7f43b3766000 1 -- start start 2024-04-02T07:32:04.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.645+0000 7f43b3766000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfaa6160 0x5650dfcd4520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.645+0000 7f43b3766000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfca5a30 0x5650dfcd4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfcf1a70 0x5650dfca5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650df7b3aa0 con 0x5650dfca5a30 2024-04-02T07:32:04.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650dfaf3e90 con 0x5650dfaa6160 2024-04-02T07:32:04.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5650dfaf95f0 con 0x5650dfcf1a70 2024-04-02T07:32:04.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43ad000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfca5a30 0x5650dfcd4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43ad000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfca5a30 0x5650dfcd4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37066/0 (socket says 172.21.15.55:37066) 2024-04-02T07:32:04.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43ad000640 1 -- 172.21.15.55:0/1637883062 learned_addr learned my addr 172.21.15.55:0/1637883062 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:04.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43ada00640 1 --2- 172.21.15.55:0/1637883062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfaa6160 0x5650dfcd4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43ae400640 1 --2- 172.21.15.55:0/1637883062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfcf1a70 0x5650dfca5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43ad000640 1 -- 172.21.15.55:0/1637883062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfcf1a70 msgr2=0x5650dfca5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:04.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43ad000640 1 --2- 172.21.15.55:0/1637883062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfcf1a70 0x5650dfca5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43ad000640 1 -- 172.21.15.55:0/1637883062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfaa6160 msgr2=0x5650dfcd4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:04.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43ad000640 1 --2- 172.21.15.55:0/1637883062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfaa6160 0x5650dfcd4520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43ad000640 1 -- 172.21.15.55:0/1637883062 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650dfaa1df0 con 0x5650dfca5a30 2024-04-02T07:32:04.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43ad000640 1 --2- 172.21.15.55:0/1637883062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfca5a30 0x5650dfcd4a60 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f43a8151d50 tx=0x7f4394011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1457a264bbeb31 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:04.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f439aa00640 1 -- 172.21.15.55:0/1637883062 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43940075a0 con 0x5650dfca5a30 2024-04-02T07:32:04.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f439aa00640 1 -- 172.21.15.55:0/1637883062 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439401c030 con 0x5650dfca5a30 2024-04-02T07:32:04.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f439aa00640 1 -- 172.21.15.55:0/1637883062 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4394023990 con 0x5650dfca5a30 2024-04-02T07:32:04.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 -- 172.21.15.55:0/1637883062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfca5a30 msgr2=0x5650dfcd4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 --2- 172.21.15.55:0/1637883062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfca5a30 0x5650dfcd4a60 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f43a8151d50 tx=0x7f4394011000 comp rx=0 tx=0).stop 2024-04-02T07:32:04.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 -- 172.21.15.55:0/1637883062 shutdown_connections 2024-04-02T07:32:04.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 --2- 172.21.15.55:0/1637883062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfcf1a70 0x5650dfca5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 --2- 172.21.15.55:0/1637883062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfca5a30 0x5650dfcd4a60 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 --2- 172.21.15.55:0/1637883062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfaa6160 0x5650dfcd4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 -- 172.21.15.55:0/1637883062 >> 172.21.15.55:0/1637883062 conn(0x5650dfcabfc0 msgr2=0x5650dfca4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:04.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 -- 172.21.15.55:0/1637883062 shutdown_connections 2024-04-02T07:32:04.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 -- 172.21.15.55:0/1637883062 wait complete. 2024-04-02T07:32:04.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 -- start start 2024-04-02T07:32:04.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 Processor -- start 2024-04-02T07:32:04.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfaa6160 0x5650dfd51ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfca5a30 0x5650dfd52020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfcf1a70 0x5650dfca8630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650dfcd6220 con 0x5650dfaa6160 2024-04-02T07:32:04.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650dfab7c60 con 0x5650dfcf1a70 2024-04-02T07:32:04.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5650dfac2390 con 0x5650dfca5a30 2024-04-02T07:32:04.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43b3766000 10 client.0 _ll_register_callbacks cb 0x5650dfbab680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:32:04.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43ada00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfaa6160 0x5650dfd51ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43ada00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfaa6160 0x5650dfd51ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37082/0 (socket says 172.21.15.55:37082) 2024-04-02T07:32:04.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43ada00640 1 -- 172.21.15.55:0/3623198680 learned_addr learned my addr 172.21.15.55:0/3623198680 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:04.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43ad000640 1 --2- 172.21.15.55:0/3623198680 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfca5a30 0x5650dfd52020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.649+0000 7f43ae400640 1 --2- 172.21.15.55:0/3623198680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfcf1a70 0x5650dfca8630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43ada00640 1 -- 172.21.15.55:0/3623198680 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfca5a30 msgr2=0x5650dfd52020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43ada00640 1 --2- 172.21.15.55:0/3623198680 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfca5a30 0x5650dfd52020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43ada00640 1 -- 172.21.15.55:0/3623198680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfcf1a70 msgr2=0x5650dfca8630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43ada00640 1 --2- 172.21.15.55:0/3623198680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfcf1a70 0x5650dfca8630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43ada00640 1 -- 172.21.15.55:0/3623198680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4394005e70 con 0x5650dfaa6160 2024-04-02T07:32:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43ada00640 1 --2- 172.21.15.55:0/3623198680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfaa6160 0x5650dfd51ae0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f439c0ee090 tx=0x7f439c019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dde14951eba79bc9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f438ea00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:32:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f438ea00640 1 -- 172.21.15.55:0/3623198680 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439c0f8130 con 0x5650dfaa6160 2024-04-02T07:32:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f438ea00640 1 -- 172.21.15.55:0/3623198680 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f439c0eeca0 con 0x5650dfaa6160 2024-04-02T07:32:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 1 -- 172.21.15.55:0/3623198680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5650dfcd6360 con 0x5650dfaa6160 2024-04-02T07:32:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f438ea00640 1 -- 172.21.15.55:0/3623198680 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f439c0eee60 con 0x5650dfaa6160 2024-04-02T07:32:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 10 client.8832 fetch_fsmap learned FSMap version 81 2024-04-02T07:32:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 1 -- 172.21.15.55:0/3623198680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x5650dfa95960 con 0x5650dfaa6160 2024-04-02T07:32:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f438ea00640 1 -- 172.21.15.55:0/3623198680 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f439c0fd020 con 0x5650dfaa6160 2024-04-02T07:32:04.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f438ea00640 1 -- 172.21.15.55:0/3623198680 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 81) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f439c0c8040 con 0x5650dfaa6160 2024-04-02T07:32:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 10 client.8832 fetch_fsmap finished waiting for FSMap version 81 2024-04-02T07:32:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 10 client.8832 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-02T07:32:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 20 client.8832 populate_metadata read hostname 'smithi055' 2024-04-02T07:32:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 1 --2- 172.21.15.55:0/3623198680 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x5650dfcf2390 0x5650dfca8b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 4 client.8832 mds_command: new command op to 8436 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-02T07:32:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 1 -- 172.21.15.55:0/3623198680 --> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5650dfab3970 con 0x5650dfcf2390 2024-04-02T07:32:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43ad000640 1 --2- 172.21.15.55:0/3623198680 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x5650dfcf2390 0x5650dfca8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43ad000640 1 --2- 172.21.15.55:0/3623198680 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x5650dfcf2390 0x5650dfca8b70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3340cdb67a009220 server_cookie=2eb95cb5dc06a1d6 in_seq=0 out_seq=0 2024-04-02T07:32:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f438ea00640 10 client.8832 ms_handle_connect on v2:172.21.15.55:6834/1089546237 2024-04-02T07:32:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f438ea00640 1 -- 172.21.15.55:0/3623198680 <== mds.0 v2:172.21.15.55:6834/1089546237 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x5650dfab3970 con 0x5650dfcf2390 2024-04-02T07:32:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f438ea00640 10 client.8832 handle_command_reply: tid=0 2024-04-02T07:32:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 1 client.8832 shutdown 2024-04-02T07:32:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 1 -- 172.21.15.55:0/3623198680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfaa6160 msgr2=0x5650dfd51ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 1 --2- 172.21.15.55:0/3623198680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfaa6160 0x5650dfd51ae0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f439c0ee090 tx=0x7f439c019210 comp rx=0 tx=0).stop 2024-04-02T07:32:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 1 -- 172.21.15.55:0/3623198680 shutdown_connections 2024-04-02T07:32:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 1 --2- 172.21.15.55:0/3623198680 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x5650dfcf2390 0x5650dfca8b70 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 1 --2- 172.21.15.55:0/3623198680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5650dfcf1a70 0x5650dfca8630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 1 --2- 172.21.15.55:0/3623198680 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5650dfca5a30 0x5650dfd52020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 1 --2- 172.21.15.55:0/3623198680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5650dfaa6160 0x5650dfd51ae0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f438ea00640 0 client.8832 ms_handle_reset on v2:172.21.15.55:6834/1089546237 2024-04-02T07:32:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 1 -- 172.21.15.55:0/3623198680 >> 172.21.15.55:0/3623198680 conn(0x5650dfcabfc0 msgr2=0x5650dfcd3510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 1 -- 172.21.15.55:0/3623198680 shutdown_connections 2024-04-02T07:32:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 1 -- 172.21.15.55:0/3623198680 wait complete. 2024-04-02T07:32:04.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b3766000 20 client.8832 trim_cache size 0 max 16384 2024-04-02T07:32:04.661 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:32:04.661 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-02T07:32:04.661 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-04-02T07:32:04.661 INFO:teuthology.orchestra.run.smithi055.stdout: "004694d0-eadc-48ca-805e-36aec1352d98": { 2024-04-02T07:32:04.661 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/", 2024-04-02T07:32:04.661 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "004694d0-eadc-48ca-805e-36aec1352d98", 2024-04-02T07:32:04.661 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive,repair" 2024-04-02T07:32:04.661 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:32:04.661 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:32:04.661 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:32:04.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b0400640 1 -- 172.21.15.55:0/4017112746 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4388066690 msgr2=0x7f4388068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b0400640 1 --2- 172.21.15.55:0/4017112746 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4388066690 0x7f4388068b50 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4394000c10 tx=0x7f4394007a70 comp rx=0 tx=0).stop 2024-04-02T07:32:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b0400640 1 -- 172.21.15.55:0/4017112746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43a80709b0 msgr2=0x7f43a8151810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b0400640 1 --2- 172.21.15.55:0/4017112746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43a80709b0 0x7f43a8151810 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f439c019080 tx=0x7f439c01acb0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b0400640 1 -- 172.21.15.55:0/4017112746 shutdown_connections 2024-04-02T07:32:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b0400640 1 --2- 172.21.15.55:0/4017112746 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4388066690 0x7f4388068b50 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b0400640 1 --2- 172.21.15.55:0/4017112746 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43a8162070 0x7f43a81587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b0400640 1 --2- 172.21.15.55:0/4017112746 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f43a80adeb0 0x7f43a815b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b0400640 1 --2- 172.21.15.55:0/4017112746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43a80709b0 0x7f43a8151810 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b0400640 1 -- 172.21.15.55:0/4017112746 >> 172.21.15.55:0/4017112746 conn(0x7f43a806a390 msgr2=0x7f43a80cd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b0400640 1 -- 172.21.15.55:0/4017112746 shutdown_connections 2024-04-02T07:32:04.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:04.653+0000 7f43b0400640 1 -- 172.21.15.55:0/4017112746 wait complete. 2024-04-02T07:32:04.675 INFO:tasks.cephfs.filesystem:scrub status for tag:004694d0-eadc-48ca-805e-36aec1352d98 - {'path': '/', 'tag': '004694d0-eadc-48ca-805e-36aec1352d98', 'options': 'recursive,repair'} 2024-04-02T07:32:06.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:06.281+0000 7f3588c00640 1 -- 172.21.15.55:0/508047680 <== mon.0 v2:172.21.15.55:3300/0 7 ==== log(4 entries from seq 1 at 2024-04-02T07:32:04.451033+0000) v1 ==== 695+0+0 (secure 0 0 0) 0x7f3580054ef0 con 0x7f358c06a4a0 2024-04-02T07:32:06.284 INFO:teuthology.orchestra.run.smithi055.stdout: cluster: 2024-04-02T07:32:06.284 INFO:teuthology.orchestra.run.smithi055.stdout: id: 642a0456-a2ac-49a4-91a5-3b3449b512da 2024-04-02T07:32:06.284 INFO:teuthology.orchestra.run.smithi055.stdout: health: HEALTH_OK 2024-04-02T07:32:06.284 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:32:06.284 INFO:teuthology.orchestra.run.smithi055.stdout: services: 2024-04-02T07:32:06.284 INFO:teuthology.orchestra.run.smithi055.stdout: mon: 3 daemons, quorum a,b,c (age 10m) 2024-04-02T07:32:06.284 INFO:teuthology.orchestra.run.smithi055.stdout: mgr: x(active, since 10m), standbys: y 2024-04-02T07:32:06.284 INFO:teuthology.orchestra.run.smithi055.stdout: mds: 1/1 daemons up, 3 standby 2024-04-02T07:32:06.284 INFO:teuthology.orchestra.run.smithi055.stdout: osd: 8 osds: 8 up (since 9m), 8 in (since 10m) 2024-04-02T07:32:06.284 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:32:06.284 INFO:teuthology.orchestra.run.smithi055.stdout: data: 2024-04-02T07:32:06.284 INFO:teuthology.orchestra.run.smithi055.stdout: volumes: 1/1 healthy 2024-04-02T07:32:06.284 INFO:teuthology.orchestra.run.smithi055.stdout: pools: 3 pools, 97 pgs 2024-04-02T07:32:06.285 INFO:teuthology.orchestra.run.smithi055.stdout: objects: 30 objects, 19 MiB 2024-04-02T07:32:06.285 INFO:teuthology.orchestra.run.smithi055.stdout: usage: 290 MiB used, 720 GiB / 720 GiB avail 2024-04-02T07:32:06.285 INFO:teuthology.orchestra.run.smithi055.stdout: pgs: 97 active+clean 2024-04-02T07:32:06.285 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:32:06.285 INFO:teuthology.orchestra.run.smithi055.stdout: io: 2024-04-02T07:32:06.285 INFO:teuthology.orchestra.run.smithi055.stdout: client: 85 B/s rd, 1.0 MiB/s wr, 0 op/s rd, 2 op/s wr 2024-04-02T07:32:06.285 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:32:06.285 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:32:06.285 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:32:04.451033+0000 mds.a [INF] scrub queued for path: / 2024-04-02T07:32:06.285 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:32:04.451036+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-04-02T07:32:06.285 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:32:04.451043+0000 mds.a [INF] scrub summary: active paths [/] 2024-04-02T07:32:06.285 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:32:04.452557+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-04-02T07:32:07.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:07.289+0000 7f3588c00640 1 -- 172.21.15.55:0/508047680 <== mon.0 v2:172.21.15.55:3300/0 8 ==== log(1 entries from seq 5 at 2024-04-02T07:32:06.387888+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7f358005d230 con 0x7f358c06a4a0 2024-04-02T07:32:07.290 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:32:06.387888+0000 mds.a [INF] scrub summary: idle 2024-04-02T07:32:15.454 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:32:15.458 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:32:34.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:32:34.676 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-02T07:32:34.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.833+0000 7f8ac6c00640 1 Processor -- start 2024-04-02T07:32:34.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.833+0000 7f8ac6c00640 1 -- start start 2024-04-02T07:32:34.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.837+0000 7f8ac6c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ac00cc880 0x7f8ac006b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:34.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.837+0000 7f8ac6c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8ac0098e70 0x7f8ac015c840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:34.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.837+0000 7f8ac6c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ac0099a70 con 0x7f8ac0098a10 2024-04-02T07:32:34.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.837+0000 7f8ac6c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ac006b5f0 con 0x7f8ac0098e70 2024-04-02T07:32:34.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.837+0000 7f8ac6c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac015cd80 con 0x7f8ac00cc880 2024-04-02T07:32:34.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.837+0000 7f8ac6200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8ac0098e70 0x7f8ac015c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:34.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.837+0000 7f8ac6200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8ac0098e70 0x7f8ac015c840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51744/0 (socket says 172.21.15.55:51744) 2024-04-02T07:32:34.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.837+0000 7f8ac6200640 1 -- 172.21.15.55:0/1116158637 learned_addr learned my addr 172.21.15.55:0/1116158637 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:34.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.837+0000 7f8ac5800640 1 --2- 172.21.15.55:0/1116158637 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ac00cc880 0x7f8ac006b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:34.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.837+0000 7f8ac6200640 1 -- 172.21.15.55:0/1116158637 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ac00cc880 msgr2=0x7f8ac006b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:34.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.837+0000 7f8ac6200640 1 --2- 172.21.15.55:0/1116158637 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ac00cc880 0x7f8ac006b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.837+0000 7f8ac6200640 1 -- 172.21.15.55:0/1116158637 >> v1:172.21.15.106:6789/0 conn(0x7f8ac0098a10 legacy=0x7f8ac015c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:34.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.837+0000 7f8ac6200640 1 -- 172.21.15.55:0/1116158637 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ac006bc90 con 0x7f8ac0098e70 2024-04-02T07:32:34.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.841+0000 7f8ac6200640 1 --2- 172.21.15.55:0/1116158637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ac0098e70 0x7f8ac015c840 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009e50 tx=0x7f8ab801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8c180504c9e16e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:34.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.841+0000 7f8abfe00640 1 -- 172.21.15.55:0/1116158637 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80a58d0 con 0x7f8ac0098e70 2024-04-02T07:32:34.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.841+0000 7f8abfe00640 1 -- 172.21.15.55:0/1116158637 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab80a5a30 con 0x7f8ac0098e70 2024-04-02T07:32:34.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.841+0000 7f8abfe00640 1 -- 172.21.15.55:0/1116158637 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80a5dc0 con 0x7f8ac0098e70 2024-04-02T07:32:34.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.841+0000 7f8ac6c00640 1 -- 172.21.15.55:0/1116158637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ac0098e70 msgr2=0x7f8ac015c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:34.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.841+0000 7f8ac6c00640 1 --2- 172.21.15.55:0/1116158637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ac0098e70 0x7f8ac015c840 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f8ab8009e50 tx=0x7f8ab801ca00 comp rx=0 tx=0).stop 2024-04-02T07:32:34.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.841+0000 7f8ac6c00640 1 -- 172.21.15.55:0/1116158637 shutdown_connections 2024-04-02T07:32:34.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.841+0000 7f8ac6c00640 1 --2- 172.21.15.55:0/1116158637 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ac0098e70 0x7f8ac015c840 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.841+0000 7f8ac6c00640 1 --2- 172.21.15.55:0/1116158637 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ac00cc880 0x7f8ac006b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.841+0000 7f8ac6c00640 1 -- 172.21.15.55:0/1116158637 >> 172.21.15.55:0/1116158637 conn(0x7f8ac00b1fb0 msgr2=0x7f8ac00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:34.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.841+0000 7f8ac6c00640 1 -- 172.21.15.55:0/1116158637 shutdown_connections 2024-04-02T07:32:34.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.841+0000 7f8ac6c00640 1 -- 172.21.15.55:0/1116158637 wait complete. 2024-04-02T07:32:34.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.841+0000 7f8ac6c00640 1 Processor -- start 2024-04-02T07:32:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.841+0000 7f8ac6c00640 1 -- start start 2024-04-02T07:32:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8ac6c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ac0098a10 0x7f8ac00c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8ac6c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ac0098e70 0x7f8ac00c52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8ac6c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ac00cc880 0x7f8ac00c9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8ac6c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac014d920 con 0x7f8ac00cc880 2024-04-02T07:32:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8ac6c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac00c3ff0 con 0x7f8ac0098e70 2024-04-02T07:32:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8ac6c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ac00c4240 con 0x7f8ac0098a10 2024-04-02T07:32:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8ac6200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ac00cc880 0x7f8ac00c9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8ac6200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ac00cc880 0x7f8ac00c9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51752/0 (socket says 172.21.15.55:51752) 2024-04-02T07:32:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8ac6200640 1 -- 172.21.15.55:0/2045863920 learned_addr learned my addr 172.21.15.55:0/2045863920 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:34.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8ac5800640 1 --2- 172.21.15.55:0/2045863920 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ac0098a10 0x7f8ac00c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:34.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8ac4e00640 1 --2- 172.21.15.55:0/2045863920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ac0098e70 0x7f8ac00c52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:34.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8ac6200640 1 -- 172.21.15.55:0/2045863920 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ac0098a10 msgr2=0x7f8ac00c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:34.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8ac6200640 1 --2- 172.21.15.55:0/2045863920 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ac0098a10 0x7f8ac00c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8ac6200640 1 -- 172.21.15.55:0/2045863920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ac0098e70 msgr2=0x7f8ac00c52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:34.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8ac6200640 1 --2- 172.21.15.55:0/2045863920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ac0098e70 0x7f8ac00c52e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8ac6200640 1 -- 172.21.15.55:0/2045863920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab8009b30 con 0x7f8ac00cc880 2024-04-02T07:32:34.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8ac6200640 1 --2- 172.21.15.55:0/2045863920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ac00cc880 0x7f8ac00c9590 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f8ab801a630 tx=0x7f8ab80197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:34.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8abd600640 1 -- 172.21.15.55:0/2045863920 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80b8670 con 0x7f8ac00cc880 2024-04-02T07:32:34.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8abd600640 1 -- 172.21.15.55:0/2045863920 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab80b87d0 con 0x7f8ac00cc880 2024-04-02T07:32:34.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8ac6c00640 1 -- 172.21.15.55:0/2045863920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ac00c4520 con 0x7f8ac00cc880 2024-04-02T07:32:34.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8abd600640 1 -- 172.21.15.55:0/2045863920 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80b8b60 con 0x7f8ac00cc880 2024-04-02T07:32:34.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8ac6c00640 1 -- 172.21.15.55:0/2045863920 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac00c4ae0 con 0x7f8ac00cc880 2024-04-02T07:32:34.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.845+0000 7f8abd600640 1 -- 172.21.15.55:0/2045863920 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8ab80b8cc0 con 0x7f8ac00cc880 2024-04-02T07:32:34.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8abd600640 1 --2- 172.21.15.55:0/2045863920 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8aa0066690 0x7f8aa0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:34.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8abd600640 1 -- 172.21.15.55:0/2045863920 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ab811f7f0 con 0x7f8ac00cc880 2024-04-02T07:32:34.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8acb735000 1 Processor -- start 2024-04-02T07:32:34.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8ac5800640 1 --2- 172.21.15.55:0/2045863920 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8aa0066690 0x7f8aa0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:34.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8acb735000 1 -- start start 2024-04-02T07:32:34.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8ac5800640 1 --2- 172.21.15.55:0/2045863920 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8aa0066690 0x7f8aa0068b50 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009b60 tx=0x7f8ab4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:34.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8acb735000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651ea3a70 0x561651ea3e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:34.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8acb735000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651ea4390 0x561651e574c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:34.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8acb735000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561651e57a00 0x561651e57de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:34.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8acb735000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561651d22630 con 0x561651ea3a70 2024-04-02T07:32:34.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8acb735000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561651cafbd0 con 0x561651e57a00 2024-04-02T07:32:34.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8acb735000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x561651cad1a0 con 0x561651ea4390 2024-04-02T07:32:34.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8ac5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651ea3a70 0x561651ea3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:34.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8ac5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651ea3a70 0x561651ea3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51760/0 (socket says 172.21.15.55:51760) 2024-04-02T07:32:34.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8ac5800640 1 -- 172.21.15.55:0/1454558527 learned_addr learned my addr 172.21.15.55:0/1454558527 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:34.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8ac6200640 1 --2- 172.21.15.55:0/1454558527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561651e57a00 0x561651e57de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:34.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8ac4e00640 1 --2- 172.21.15.55:0/1454558527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651ea4390 0x561651e574c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:34.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8ac5800640 1 -- 172.21.15.55:0/1454558527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651ea4390 msgr2=0x561651e574c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:34.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8ac5800640 1 --2- 172.21.15.55:0/1454558527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651ea4390 0x561651e574c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8ac5800640 1 -- 172.21.15.55:0/1454558527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561651e57a00 msgr2=0x561651e57de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:34.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8ac5800640 1 --2- 172.21.15.55:0/1454558527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561651e57a00 0x561651e57de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8ac5800640 1 -- 172.21.15.55:0/1454558527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5616519a4e20 con 0x561651ea3a70 2024-04-02T07:32:34.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8ac5800640 1 --2- 172.21.15.55:0/1454558527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651ea3a70 0x561651ea3e50 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4011ec0 tx=0x7f8ab4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50670c24f901cac4 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:34.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8ab2000640 1 -- 172.21.15.55:0/1454558527 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab401c040 con 0x561651ea3a70 2024-04-02T07:32:34.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8ab2000640 1 -- 172.21.15.55:0/1454558527 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab4003830 con 0x561651ea3a70 2024-04-02T07:32:34.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8ab2000640 1 -- 172.21.15.55:0/1454558527 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4003ba0 con 0x561651ea3a70 2024-04-02T07:32:34.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8acb735000 1 -- 172.21.15.55:0/1454558527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651ea3a70 msgr2=0x561651ea3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:34.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8acb735000 1 --2- 172.21.15.55:0/1454558527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651ea3a70 0x561651ea3e50 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4011ec0 tx=0x7f8ab4014000 comp rx=0 tx=0).stop 2024-04-02T07:32:34.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8acb735000 1 -- 172.21.15.55:0/1454558527 shutdown_connections 2024-04-02T07:32:34.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8acb735000 1 --2- 172.21.15.55:0/1454558527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561651e57a00 0x561651e57de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8acb735000 1 --2- 172.21.15.55:0/1454558527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651ea4390 0x561651e574c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8acb735000 1 --2- 172.21.15.55:0/1454558527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651ea3a70 0x561651ea3e50 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8acb735000 1 -- 172.21.15.55:0/1454558527 >> 172.21.15.55:0/1454558527 conn(0x561651c58160 msgr2=0x561651e86820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:34.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8acb735000 1 -- 172.21.15.55:0/1454558527 shutdown_connections 2024-04-02T07:32:34.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.849+0000 7f8acb735000 1 -- 172.21.15.55:0/1454558527 wait complete. 2024-04-02T07:32:34.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8acb735000 1 -- start start 2024-04-02T07:32:34.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8acb735000 1 Processor -- start 2024-04-02T07:32:34.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8acb735000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651e57a00 0x561651e5fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:34.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8acb735000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651ea3a70 0x561651e87a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:34.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8acb735000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561651ea4390 0x561651e87f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:34.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8acb735000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561651ca8a90 con 0x561651e57a00 2024-04-02T07:32:34.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8acb735000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561651c47d40 con 0x561651ea4390 2024-04-02T07:32:34.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8acb735000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x561651c65f30 con 0x561651ea3a70 2024-04-02T07:32:34.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8acb735000 10 client.0 _ll_register_callbacks cb 0x561651d0a810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:32:34.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8ac5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651e57a00 0x561651e5fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:34.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8ac5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651e57a00 0x561651e5fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51762/0 (socket says 172.21.15.55:51762) 2024-04-02T07:32:34.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8ac5800640 1 -- 172.21.15.55:0/1957938163 learned_addr learned my addr 172.21.15.55:0/1957938163 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:34.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8ac4e00640 1 --2- 172.21.15.55:0/1957938163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651ea3a70 0x561651e87a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:34.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8ac6200640 1 --2- 172.21.15.55:0/1957938163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561651ea4390 0x561651e87f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:34.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8ac5800640 1 -- 172.21.15.55:0/1957938163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651ea3a70 msgr2=0x561651e87a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:34.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8ac5800640 1 --2- 172.21.15.55:0/1957938163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651ea3a70 0x561651e87a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8ac5800640 1 -- 172.21.15.55:0/1957938163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561651ea4390 msgr2=0x561651e87f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:34.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8ac5800640 1 --2- 172.21.15.55:0/1957938163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561651ea4390 0x561651e87f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8ac5800640 1 -- 172.21.15.55:0/1957938163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab4011ba0 con 0x561651e57a00 2024-04-02T07:32:34.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8ac4e00640 1 --2- 172.21.15.55:0/1957938163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651ea3a70 0x561651e87a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:32:34.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8ac5800640 1 --2- 172.21.15.55:0/1957938163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651e57a00 0x561651e5fad0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4011750 tx=0x7f8ab4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f5f8d5f16f834f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:34.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8aa6a00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:32:34.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8aa6a00640 1 -- 172.21.15.55:0/1957938163 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4022880 con 0x561651e57a00 2024-04-02T07:32:34.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8aa6a00640 1 -- 172.21.15.55:0/1957938163 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ab40229e0 con 0x561651e57a00 2024-04-02T07:32:34.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8acb735000 1 -- 172.21.15.55:0/1957938163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561651ca73e0 con 0x561651e57a00 2024-04-02T07:32:34.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8aa6a00640 1 -- 172.21.15.55:0/1957938163 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ab4022ba0 con 0x561651e57a00 2024-04-02T07:32:34.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8acb735000 10 client.8844 fetch_fsmap learned FSMap version 81 2024-04-02T07:32:34.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8acb735000 1 -- 172.21.15.55:0/1957938163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x561651c6daa0 con 0x561651e57a00 2024-04-02T07:32:34.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8aa6a00640 1 -- 172.21.15.55:0/1957938163 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561651ca73e0 con 0x561651e57a00 2024-04-02T07:32:34.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8aa6a00640 1 -- 172.21.15.55:0/1957938163 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 81) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8ab4022d00 con 0x561651e57a00 2024-04-02T07:32:34.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8acb735000 10 client.8844 fetch_fsmap finished waiting for FSMap version 81 2024-04-02T07:32:34.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8acb735000 10 client.8844 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-02T07:32:34.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8acb735000 20 client.8844 populate_metadata read hostname 'smithi055' 2024-04-02T07:32:34.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8acb735000 1 --2- 172.21.15.55:0/1957938163 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x561651eaaeb0 0x561651eab290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:34.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8acb735000 4 client.8844 mds_command: new command op to 8436 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:32:34.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.853+0000 7f8acb735000 1 -- 172.21.15.55:0/1957938163 --> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561651c78d00 con 0x561651eaaeb0 2024-04-02T07:32:34.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.857+0000 7f8ac4e00640 1 --2- 172.21.15.55:0/1957938163 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x561651eaaeb0 0x561651eab290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:34.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.857+0000 7f8ac4e00640 1 --2- 172.21.15.55:0/1957938163 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x561651eaaeb0 0x561651eab290 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9eac016e627663be server_cookie=ef899cbc28ff4a2f in_seq=0 out_seq=0 2024-04-02T07:32:34.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.857+0000 7f8aa6a00640 10 client.8844 ms_handle_connect on v2:172.21.15.55:6834/1089546237 2024-04-02T07:32:34.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.857+0000 7f8aa6a00640 1 -- 172.21.15.55:0/1957938163 <== mds.0 v2:172.21.15.55:6834/1089546237 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x561651c78d00 con 0x561651eaaeb0 2024-04-02T07:32:34.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.857+0000 7f8aa6a00640 10 client.8844 handle_command_reply: tid=0 2024-04-02T07:32:34.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.857+0000 7f8acb735000 1 client.8844 shutdown 2024-04-02T07:32:34.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.857+0000 7f8acb735000 1 -- 172.21.15.55:0/1957938163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651e57a00 msgr2=0x561651e5fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:34.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.857+0000 7f8acb735000 1 --2- 172.21.15.55:0/1957938163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651e57a00 0x561651e5fad0 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4011750 tx=0x7f8ab4004740 comp rx=0 tx=0).stop 2024-04-02T07:32:34.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.857+0000 7f8acb735000 1 -- 172.21.15.55:0/1957938163 shutdown_connections 2024-04-02T07:32:34.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.857+0000 7f8acb735000 1 --2- 172.21.15.55:0/1957938163 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x561651eaaeb0 0x561651eab290 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.857+0000 7f8acb735000 1 --2- 172.21.15.55:0/1957938163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561651ea4390 0x561651e87f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.857+0000 7f8acb735000 1 --2- 172.21.15.55:0/1957938163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651ea3a70 0x561651e87a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.857+0000 7f8acb735000 1 --2- 172.21.15.55:0/1957938163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651e57a00 0x561651e5fad0 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.857+0000 7f8aa6a00640 0 client.8844 ms_handle_reset on v2:172.21.15.55:6834/1089546237 2024-04-02T07:32:34.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.857+0000 7f8acb735000 1 -- 172.21.15.55:0/1957938163 >> 172.21.15.55:0/1957938163 conn(0x561651c58160 msgr2=0x561651e56bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:34.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.857+0000 7f8acb735000 1 -- 172.21.15.55:0/1957938163 shutdown_connections 2024-04-02T07:32:34.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.857+0000 7f8acb735000 1 -- 172.21.15.55:0/1957938163 wait complete. 2024-04-02T07:32:34.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.857+0000 7f8acb735000 20 client.8844 trim_cache size 0 max 16384 2024-04-02T07:32:34.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8acb735000 1 Processor -- start 2024-04-02T07:32:34.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8acb735000 1 -- start start 2024-04-02T07:32:34.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8acb735000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651c58160 0x561651e5e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:34.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8acb735000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561651e57a00 0x561651e5ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:34.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8acb735000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651ea3a70 0x561651e57de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:34.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8acb735000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561651965aa0 con 0x561651ea3a70 2024-04-02T07:32:34.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8acb735000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561651c74390 con 0x561651e57a00 2024-04-02T07:32:34.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8acb735000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x561651e5fb20 con 0x561651c58160 2024-04-02T07:32:34.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8ac6200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651ea3a70 0x561651e57de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:34.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8ac6200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651ea3a70 0x561651e57de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51778/0 (socket says 172.21.15.55:51778) 2024-04-02T07:32:34.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8ac6200640 1 -- 172.21.15.55:0/663351543 learned_addr learned my addr 172.21.15.55:0/663351543 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:34.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8ac4e00640 1 --2- 172.21.15.55:0/663351543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561651e57a00 0x561651e5ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:34.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8ac5800640 1 --2- 172.21.15.55:0/663351543 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651c58160 0x561651e5e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:34.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8ac6200640 1 -- 172.21.15.55:0/663351543 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651c58160 msgr2=0x561651e5e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:34.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8ac6200640 1 --2- 172.21.15.55:0/663351543 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651c58160 0x561651e5e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8ac6200640 1 -- 172.21.15.55:0/663351543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561651e57a00 msgr2=0x561651e5ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:34.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8ac6200640 1 --2- 172.21.15.55:0/663351543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561651e57a00 0x561651e5ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8ac6200640 1 -- 172.21.15.55:0/663351543 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561651c53df0 con 0x561651ea3a70 2024-04-02T07:32:34.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8ac6200640 1 --2- 172.21.15.55:0/663351543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651ea3a70 0x561651e57de0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80ecfa0 tx=0x7f8ab80f0aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c99a44c2b7cac701 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:34.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8ab2a00640 1 -- 172.21.15.55:0/663351543 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80eee40 con 0x561651ea3a70 2024-04-02T07:32:34.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8ab2a00640 1 -- 172.21.15.55:0/663351543 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ab80ed1b0 con 0x561651ea3a70 2024-04-02T07:32:34.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8ab2a00640 1 -- 172.21.15.55:0/663351543 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab80f0f20 con 0x561651ea3a70 2024-04-02T07:32:34.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8acb735000 1 -- 172.21.15.55:0/663351543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651ea3a70 msgr2=0x561651e57de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:34.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8acb735000 1 --2- 172.21.15.55:0/663351543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651ea3a70 0x561651e57de0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f8ab80ecfa0 tx=0x7f8ab80f0aa0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8acb735000 1 -- 172.21.15.55:0/663351543 shutdown_connections 2024-04-02T07:32:34.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8acb735000 1 --2- 172.21.15.55:0/663351543 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651ea3a70 0x561651e57de0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8acb735000 1 --2- 172.21.15.55:0/663351543 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561651e57a00 0x561651e5ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8acb735000 1 --2- 172.21.15.55:0/663351543 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651c58160 0x561651e5e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8acb735000 1 -- 172.21.15.55:0/663351543 >> 172.21.15.55:0/663351543 conn(0x561651ea2ef0 msgr2=0x561651e56b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:34.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8acb735000 1 -- 172.21.15.55:0/663351543 shutdown_connections 2024-04-02T07:32:34.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8acb735000 1 -- 172.21.15.55:0/663351543 wait complete. 2024-04-02T07:32:34.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8acb735000 1 -- start start 2024-04-02T07:32:34.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.873+0000 7f8acb735000 1 Processor -- start 2024-04-02T07:32:34.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651c58160 0x561651e5ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:34.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561651e57a00 0x561651ebedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:34.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651ea3a70 0x561651ebf300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:34.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x561651d61ec0 con 0x561651c58160 2024-04-02T07:32:34.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x561651c780b0 con 0x561651e57a00 2024-04-02T07:32:34.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x561651e60860 con 0x561651ea3a70 2024-04-02T07:32:34.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 10 client.0 _ll_register_callbacks cb 0x7f8ab40095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:32:34.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8ac5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651c58160 0x561651e5ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:34.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8ac5800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651c58160 0x561651e5ae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51784/0 (socket says 172.21.15.55:51784) 2024-04-02T07:32:34.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8ac5800640 1 -- 172.21.15.55:0/1811306915 learned_addr learned my addr 172.21.15.55:0/1811306915 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:34.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8ac6200640 1 --2- 172.21.15.55:0/1811306915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651ea3a70 0x561651ebf300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:34.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8ac4e00640 1 --2- 172.21.15.55:0/1811306915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561651e57a00 0x561651ebedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:34.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8ac5800640 1 -- 172.21.15.55:0/1811306915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651ea3a70 msgr2=0x561651ebf300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:34.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8ac5800640 1 --2- 172.21.15.55:0/1811306915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651ea3a70 0x561651ebf300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8ac5800640 1 -- 172.21.15.55:0/1811306915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561651e57a00 msgr2=0x561651ebedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:34.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8ac5800640 1 --2- 172.21.15.55:0/1811306915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561651e57a00 0x561651ebedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8ac5800640 1 -- 172.21.15.55:0/1811306915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ac00c4ae0 con 0x561651c58160 2024-04-02T07:32:34.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8ac5800640 1 --2- 172.21.15.55:0/1811306915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651c58160 0x561651e5ae50 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4011750 tx=0x7f8ab4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73b758ed4582fc18 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:34.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8aa6a00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:32:34.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8aa6a00640 1 -- 172.21.15.55:0/1811306915 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4022880 con 0x561651c58160 2024-04-02T07:32:34.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8aa6a00640 1 -- 172.21.15.55:0/1811306915 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ab40229e0 con 0x561651c58160 2024-04-02T07:32:34.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 1 -- 172.21.15.55:0/1811306915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561651c65970 con 0x561651c58160 2024-04-02T07:32:34.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8aa6a00640 1 -- 172.21.15.55:0/1811306915 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ab4003e30 con 0x561651c58160 2024-04-02T07:32:34.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 10 client.8850 fetch_fsmap learned FSMap version 81 2024-04-02T07:32:34.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 1 -- 172.21.15.55:0/1811306915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=2+}) v3 -- 0x561651c47960 con 0x561651c58160 2024-04-02T07:32:34.886 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8aa6a00640 1 -- 172.21.15.55:0/1811306915 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x561651c65970 con 0x561651c58160 2024-04-02T07:32:34.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8aa6a00640 1 -- 172.21.15.55:0/1811306915 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 81) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8ab4022ba0 con 0x561651c58160 2024-04-02T07:32:34.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 10 client.8850 fetch_fsmap finished waiting for FSMap version 81 2024-04-02T07:32:34.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 10 client.8850 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-02T07:32:34.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 20 client.8850 populate_metadata read hostname 'smithi055' 2024-04-02T07:32:34.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 1 --2- 172.21.15.55:0/1811306915 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x561651ea4390 0x561651ebf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:34.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 4 client.8850 mds_command: new command op to 8436 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-02T07:32:34.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 1 -- 172.21.15.55:0/1811306915 --> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x561651cd7a20 con 0x561651ea4390 2024-04-02T07:32:34.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8ac4e00640 1 --2- 172.21.15.55:0/1811306915 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x561651ea4390 0x561651ebf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:34.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8aa6a00640 10 client.8850 ms_handle_connect on v2:172.21.15.55:6834/1089546237 2024-04-02T07:32:34.887 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8ac4e00640 1 --2- 172.21.15.55:0/1811306915 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x561651ea4390 0x561651ebf840 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d306549f3d257d8e server_cookie=d44951c6620da11f in_seq=0 out_seq=0 2024-04-02T07:32:34.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8aa6a00640 1 -- 172.21.15.55:0/1811306915 <== mds.0 v2:172.21.15.55:6834/1089546237 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x561651cd7a20 con 0x561651ea4390 2024-04-02T07:32:34.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8aa6a00640 10 client.8850 handle_command_reply: tid=0 2024-04-02T07:32:34.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 1 client.8850 shutdown 2024-04-02T07:32:34.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 1 -- 172.21.15.55:0/1811306915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651c58160 msgr2=0x561651e5ae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:34.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 1 --2- 172.21.15.55:0/1811306915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651c58160 0x561651e5ae50 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4011750 tx=0x7f8ab4018000 comp rx=0 tx=0).stop 2024-04-02T07:32:34.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 1 -- 172.21.15.55:0/1811306915 shutdown_connections 2024-04-02T07:32:34.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.877+0000 7f8acb735000 1 --2- 172.21.15.55:0/1811306915 >> [v2:172.21.15.55:6834/1089546237,v1:172.21.15.55:6835/1089546237] conn(0x561651ea4390 0x561651ebf840 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.881+0000 7f8acb735000 1 --2- 172.21.15.55:0/1811306915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x561651ea3a70 0x561651ebf300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.881+0000 7f8acb735000 1 --2- 172.21.15.55:0/1811306915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x561651e57a00 0x561651ebedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.881+0000 7f8acb735000 1 --2- 172.21.15.55:0/1811306915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x561651c58160 0x561651e5ae50 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.881+0000 7f8acb735000 1 -- 172.21.15.55:0/1811306915 >> 172.21.15.55:0/1811306915 conn(0x561651ea2ef0 msgr2=0x561651e57230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:34.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.881+0000 7f8aa6a00640 0 client.8850 ms_handle_reset on v2:172.21.15.55:6834/1089546237 2024-04-02T07:32:34.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.881+0000 7f8acb735000 1 -- 172.21.15.55:0/1811306915 shutdown_connections 2024-04-02T07:32:34.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.881+0000 7f8acb735000 1 -- 172.21.15.55:0/1811306915 wait complete. 2024-04-02T07:32:34.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.881+0000 7f8acb735000 20 client.8850 trim_cache size 0 max 16384 2024-04-02T07:32:34.889 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:32:34.890 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-04-02T07:32:34.890 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-04-02T07:32:34.890 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:32:34.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.881+0000 7f8ac6c00640 1 -- 172.21.15.55:0/2045863920 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8aa0066690 msgr2=0x7f8aa0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:34.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.881+0000 7f8ac6c00640 1 --2- 172.21.15.55:0/2045863920 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8aa0066690 0x7f8aa0068b50 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f8ab4009b60 tx=0x7f8ab4009190 comp rx=0 tx=0).stop 2024-04-02T07:32:34.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.881+0000 7f8ac6c00640 1 -- 172.21.15.55:0/2045863920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ac00cc880 msgr2=0x7f8ac00c9590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:34.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.881+0000 7f8ac6c00640 1 --2- 172.21.15.55:0/2045863920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ac00cc880 0x7f8ac00c9590 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f8ab801a630 tx=0x7f8ab80197a0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.881+0000 7f8ac6c00640 1 -- 172.21.15.55:0/2045863920 shutdown_connections 2024-04-02T07:32:34.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.881+0000 7f8ac6c00640 1 --2- 172.21.15.55:0/2045863920 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8ac00cc880 0x7f8ac00c9590 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.881+0000 7f8ac6c00640 1 --2- 172.21.15.55:0/2045863920 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8aa0066690 0x7f8aa0068b50 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.881+0000 7f8ac6c00640 1 --2- 172.21.15.55:0/2045863920 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8ac0098e70 0x7f8ac00c52e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.881+0000 7f8ac6c00640 1 --2- 172.21.15.55:0/2045863920 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8ac0098a10 0x7f8ac00c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:34.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.881+0000 7f8ac6c00640 1 -- 172.21.15.55:0/2045863920 >> 172.21.15.55:0/2045863920 conn(0x7f8ac00b1fb0 msgr2=0x7f8ac00b3660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:34.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.881+0000 7f8ac6c00640 1 -- 172.21.15.55:0/2045863920 shutdown_connections 2024-04-02T07:32:34.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:34.881+0000 7f8ac6c00640 1 -- 172.21.15.55:0/2045863920 wait complete. 2024-04-02T07:32:34.900 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-02T07:32:35.001 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-02T07:32:35.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.141+0000 7fc71e200640 1 Processor -- start 2024-04-02T07:32:35.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.141+0000 7fc71e200640 1 -- start start 2024-04-02T07:32:35.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.145+0000 7fc71e200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc7180ce570 0x7fc71806a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.145+0000 7fc71e200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7180b0160 0x7fc7180b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.145+0000 7fc71e200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc71815cd90 con 0x7fc71815c9b0 2024-04-02T07:32:35.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.145+0000 7fc71e200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7180cf280 con 0x7fc7180ce570 2024-04-02T07:32:35.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.145+0000 7fc71e200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7180b0b30 con 0x7fc7180b0160 2024-04-02T07:32:35.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.145+0000 7fc70fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc7180ce570 0x7fc71806a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.145+0000 7fc71ce00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc71815c9b0 0x7fc718160e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43164/0 (socket says 172.21.15.55:43164) 2024-04-02T07:32:35.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.145+0000 7fc71ce00640 1 -- 172.21.15.55:0/3964880645 learned_addr learned my addr 172.21.15.55:0/3964880645 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:32:35.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.145+0000 7fc71d800640 1 --2- 172.21.15.55:0/3964880645 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7180b0160 0x7fc7180b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.145+0000 7fc70fe00640 1 -- 172.21.15.55:0/3964880645 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7180b0160 msgr2=0x7fc7180b05f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:35.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.145+0000 7fc70fe00640 1 --2- 172.21.15.55:0/3964880645 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7180b0160 0x7fc7180b05f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.145+0000 7fc70fe00640 1 -- 172.21.15.55:0/3964880645 >> v1:172.21.15.55:6789/0 conn(0x7fc71815c9b0 legacy=0x7fc718160e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.145+0000 7fc70fe00640 1 -- 172.21.15.55:0/3964880645 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7180cecc0 con 0x7fc7180ce570 2024-04-02T07:32:35.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.145+0000 7fc717e00640 1 -- 172.21.15.55:0/3964880645 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2704544473 0 0) 0x7fc71815cd90 con 0x7fc71815c9b0 2024-04-02T07:32:35.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.145+0000 7fc70fe00640 1 --2- 172.21.15.55:0/3964880645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7180ce570 0x7fc71806a710 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fc7000097c0 tx=0x7fc70001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c720e2d9e39a7dc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc717e00640 1 -- 172.21.15.55:0/3964880645 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7000a8990 con 0x7fc7180ce570 2024-04-02T07:32:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc717e00640 1 -- 172.21.15.55:0/3964880645 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7000a8af0 con 0x7fc7180ce570 2024-04-02T07:32:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc717e00640 1 -- 172.21.15.55:0/3964880645 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7000a8e80 con 0x7fc7180ce570 2024-04-02T07:32:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc71e200640 1 -- 172.21.15.55:0/3964880645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7180ce570 msgr2=0x7fc71806a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc71e200640 1 --2- 172.21.15.55:0/3964880645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7180ce570 0x7fc71806a710 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fc7000097c0 tx=0x7fc70001ec90 comp rx=0 tx=0).stop 2024-04-02T07:32:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc71e200640 1 -- 172.21.15.55:0/3964880645 shutdown_connections 2024-04-02T07:32:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc71e200640 1 --2- 172.21.15.55:0/3964880645 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7180b0160 0x7fc7180b05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc71e200640 1 --2- 172.21.15.55:0/3964880645 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7180ce570 0x7fc71806a710 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc71e200640 1 -- 172.21.15.55:0/3964880645 >> 172.21.15.55:0/3964880645 conn(0x7fc718098a10 msgr2=0x7fc7180cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:35.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc71e200640 1 -- 172.21.15.55:0/3964880645 shutdown_connections 2024-04-02T07:32:35.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc71e200640 1 -- 172.21.15.55:0/3964880645 wait complete. 2024-04-02T07:32:35.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc71e200640 1 Processor -- start 2024-04-02T07:32:35.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc71e200640 1 -- start start 2024-04-02T07:32:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc71e200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7180b0160 0x7fc7180b26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc71e200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7180ce570 0x7fc71814f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc71e200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc71815c9b0 0x7fc71814fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc71e200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc718150290 con 0x7fc7180ce570 2024-04-02T07:32:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc71e200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7181601f0 con 0x7fc71815c9b0 2024-04-02T07:32:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc71e200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc71815d0e0 con 0x7fc7180b0160 2024-04-02T07:32:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc70fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7180ce570 0x7fc71814f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc70fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7180ce570 0x7fc71814f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51804/0 (socket says 172.21.15.55:51804) 2024-04-02T07:32:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc70fe00640 1 -- 172.21.15.55:0/2545269733 learned_addr learned my addr 172.21.15.55:0/2545269733 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:35.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc71ce00640 1 --2- 172.21.15.55:0/2545269733 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7180b0160 0x7fc7180b26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.149+0000 7fc71d800640 1 --2- 172.21.15.55:0/2545269733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc71815c9b0 0x7fc71814fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.153+0000 7fc70fe00640 1 -- 172.21.15.55:0/2545269733 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7180b0160 msgr2=0x7fc7180b26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.153+0000 7fc70fe00640 1 --2- 172.21.15.55:0/2545269733 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7180b0160 0x7fc7180b26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.153+0000 7fc70fe00640 1 -- 172.21.15.55:0/2545269733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc71815c9b0 msgr2=0x7fc71814fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.153+0000 7fc70fe00640 1 --2- 172.21.15.55:0/2545269733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc71815c9b0 0x7fc71814fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.153+0000 7fc70fe00640 1 -- 172.21.15.55:0/2545269733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc700009420 con 0x7fc7180ce570 2024-04-02T07:32:35.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.153+0000 7fc71d800640 1 --2- 172.21.15.55:0/2545269733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc71815c9b0 0x7fc71814fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:32:35.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.153+0000 7fc70fe00640 1 --2- 172.21.15.55:0/2545269733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7180ce570 0x7fc71814f810 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fc70001c8c0 tx=0x7fc70001d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.153+0000 7fc715600640 1 -- 172.21.15.55:0/2545269733 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7000a8990 con 0x7fc7180ce570 2024-04-02T07:32:35.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.153+0000 7fc715600640 1 -- 172.21.15.55:0/2545269733 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc700006e20 con 0x7fc7180ce570 2024-04-02T07:32:35.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.153+0000 7fc715600640 1 -- 172.21.15.55:0/2545269733 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc700004230 con 0x7fc7180ce570 2024-04-02T07:32:35.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.153+0000 7fc71e200640 1 -- 172.21.15.55:0/2545269733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc71815d3c0 con 0x7fc7180ce570 2024-04-02T07:32:35.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.153+0000 7fc71e200640 1 -- 172.21.15.55:0/2545269733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc71815d6a0 con 0x7fc7180ce570 2024-04-02T07:32:35.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.153+0000 7fc71e200640 1 -- 172.21.15.55:0/2545269733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc718073fa0 con 0x7fc7180ce570 2024-04-02T07:32:35.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.153+0000 7fc715600640 1 -- 172.21.15.55:0/2545269733 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc700004390 con 0x7fc7180ce570 2024-04-02T07:32:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.153+0000 7fc715600640 1 --2- 172.21.15.55:0/2545269733 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc6f4066690 0x7fc6f4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.153+0000 7fc715600640 1 -- 172.21.15.55:0/2545269733 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7001219a0 con 0x7fc7180ce570 2024-04-02T07:32:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.157+0000 7fc71ce00640 1 --2- 172.21.15.55:0/2545269733 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc6f4066690 0x7fc6f4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.157+0000 7fc71ce00640 1 --2- 172.21.15.55:0/2545269733 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc6f4066690 0x7fc6f4068b50 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc708007fd0 tx=0x7fc708007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.157+0000 7fc715600640 1 -- 172.21.15.55:0/2545269733 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc7000eedb0 con 0x7fc7180ce570 2024-04-02T07:32:35.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.353+0000 7fc71e200640 1 -- 172.21.15.55:0/2545269733 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fc7180af940 con 0x7fc7180ce570 2024-04-02T07:32:35.355 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-02T07:32:35.353+0000 7f8f18800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-02T07:32:35.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.369+0000 7fc715600640 1 -- 172.21.15.55:0/2545269733 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v82) v1 ==== 161+0+0 (secure 0 0 0) 0x7fc7000b5090 con 0x7fc7180ce570 2024-04-02T07:32:35.371 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-02T07:32:35.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.373+0000 7fc71e200640 1 -- 172.21.15.55:0/2545269733 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc6f4066690 msgr2=0x7fc6f4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.373+0000 7fc71e200640 1 --2- 172.21.15.55:0/2545269733 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc6f4066690 0x7fc6f4068b50 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc708007fd0 tx=0x7fc708007d60 comp rx=0 tx=0).stop 2024-04-02T07:32:35.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.373+0000 7fc71e200640 1 -- 172.21.15.55:0/2545269733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7180ce570 msgr2=0x7fc71814f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.373+0000 7fc71e200640 1 --2- 172.21.15.55:0/2545269733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7180ce570 0x7fc71814f810 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7fc70001c8c0 tx=0x7fc70001d4d0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.373+0000 7fc71e200640 1 -- 172.21.15.55:0/2545269733 shutdown_connections 2024-04-02T07:32:35.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.373+0000 7fc71e200640 1 --2- 172.21.15.55:0/2545269733 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc6f4066690 0x7fc6f4068b50 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.373+0000 7fc71e200640 1 --2- 172.21.15.55:0/2545269733 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc71815c9b0 0x7fc71814fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.373+0000 7fc71e200640 1 --2- 172.21.15.55:0/2545269733 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc7180ce570 0x7fc71814f810 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.373+0000 7fc71e200640 1 --2- 172.21.15.55:0/2545269733 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc7180b0160 0x7fc7180b26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.373+0000 7fc71e200640 1 -- 172.21.15.55:0/2545269733 >> 172.21.15.55:0/2545269733 conn(0x7fc718098a10 msgr2=0x7fc7180b1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:35.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.373+0000 7fc71e200640 1 -- 172.21.15.55:0/2545269733 shutdown_connections 2024-04-02T07:32:35.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.373+0000 7fc71e200640 1 -- 172.21.15.55:0/2545269733 wait complete. 2024-04-02T07:32:35.375 INFO:tasks.ceph.mds.a.smithi055.stderr: -6173> 2024-04-02T07:31:32.245+0000 7fc138800640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:32:35.394 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627777 summary 2024-04-02T07:32:35.426 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-02T07:32:35.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.441+0000 7f7787a47400 1 -- start start 2024-04-02T07:32:35.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.441+0000 7f7787a47400 1 Processor -- start 2024-04-02T07:32:35.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.441+0000 7f7787a47400 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa37caf800 0x55fa37d3a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.441+0000 7f7787a47400 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa37caf400 0x55fa37d3ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.441+0000 7f7787a47400 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa37caf000 0x55fa37d3b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.441+0000 7f7787a47400 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa37d7ca00 con 0x55fa37caf800 2024-04-02T07:32:35.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.441+0000 7f7787a47400 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa37d7c780 con 0x55fa37caf000 2024-04-02T07:32:35.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.441+0000 7f7787a47400 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa37d7c640 con 0x55fa37caf400 2024-04-02T07:32:35.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.441+0000 7f7785c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa37caf800 0x55fa37d3a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.441+0000 7f7785c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa37caf800 0x55fa37d3a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51820/0 (socket says 172.21.15.55:51820) 2024-04-02T07:32:35.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.441+0000 7f7785c00640 1 -- 172.21.15.55:0/3263491568 learned_addr learned my addr 172.21.15.55:0/3263491568 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:35.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.441+0000 7f7786600640 1 --2- 172.21.15.55:0/3263491568 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa37caf000 0x55fa37d3b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.441+0000 7f7785c00640 1 -- 172.21.15.55:0/3263491568 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa37caf400 msgr2=0x55fa37d3ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:35.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.441+0000 7f7785c00640 1 --2- 172.21.15.55:0/3263491568 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa37caf400 0x55fa37d3ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.441+0000 7f7785c00640 1 -- 172.21.15.55:0/3263491568 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa37caf000 msgr2=0x55fa37d3b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:35.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.441+0000 7f7785c00640 1 --2- 172.21.15.55:0/3263491568 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa37caf000 0x55fa37d3b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.441+0000 7f7785c00640 1 -- 172.21.15.55:0/3263491568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa37ce49c0 con 0x55fa37caf800 2024-04-02T07:32:35.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.441+0000 7f7786600640 1 --2- 172.21.15.55:0/3263491568 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa37caf000 0x55fa37d3b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:32:35.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7785c00640 1 --2- 172.21.15.55:0/3263491568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa37caf800 0x55fa37d3a580 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x55fa38b1cc00 tx=0x55fa38a6ca80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98f57b63d51c3f59 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7782a00640 1 -- 172.21.15.55:0/3263491568 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa37d03080 con 0x55fa37caf800 2024-04-02T07:32:35.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7782a00640 1 -- 172.21.15.55:0/3263491568 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa38a6e180 con 0x55fa37caf800 2024-04-02T07:32:35.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7782a00640 1 -- 172.21.15.55:0/3263491568 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa37d03600 con 0x55fa37caf800 2024-04-02T07:32:35.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7787a47400 1 -- 172.21.15.55:0/3263491568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa37ce41a0 con 0x55fa37caf800 2024-04-02T07:32:35.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7787a47400 1 -- 172.21.15.55:0/3263491568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x55fa37ce49c0 con 0x55fa37caf800 2024-04-02T07:32:35.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7787a47400 4 waiting for MDS map... 2024-04-02T07:32:35.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7782a00640 1 -- 172.21.15.55:0/3263491568 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x55fa37ceec40 con 0x55fa37caf800 2024-04-02T07:32:35.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7782a00640 1 -- 172.21.15.55:0/3263491568 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 82) v1 ==== 2573+0+0 (secure 0 0 0) 0x55fa37cfd200 con 0x55fa37caf800 2024-04-02T07:32:35.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7787a47400 4 Got MDS map 82 2024-04-02T07:32:35.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7787a47400 10 main: JournalTool::main 2024-04-02T07:32:35.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7787a47400 4 main: JournalTool: connecting to RADOS... 2024-04-02T07:32:35.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7787a47400 1 Processor -- start 2024-04-02T07:32:35.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7787a47400 1 -- start start 2024-04-02T07:32:35.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7787a47400 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa38a83800 0x55fa37d3b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7787a47400 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa38a83c00 0x55fa37d3bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7787a47400 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa38c2e000 0x55fa37d3c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7787a47400 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa37cf5e00 con 0x55fa38a83800 2024-04-02T07:32:35.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7787a47400 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa37d7c780 con 0x55fa38a83c00 2024-04-02T07:32:35.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7787a47400 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa37d7ca00 con 0x55fa38c2e000 2024-04-02T07:32:35.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7786600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa38a83800 0x55fa37d3b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7786600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa38a83800 0x55fa37d3b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51834/0 (socket says 172.21.15.55:51834) 2024-04-02T07:32:35.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7785200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa38c2e000 0x55fa37d3c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7786600640 1 -- 172.21.15.55:0/302665654 learned_addr learned my addr 172.21.15.55:0/302665654 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:35.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7785c00640 1 --2- 172.21.15.55:0/302665654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa38a83c00 0x55fa37d3bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7786600640 1 -- 172.21.15.55:0/302665654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa38c2e000 msgr2=0x55fa37d3c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:35.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7786600640 1 --2- 172.21.15.55:0/302665654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa38c2e000 0x55fa37d3c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7786600640 1 -- 172.21.15.55:0/302665654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa38a83c00 msgr2=0x55fa37d3bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:35.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7786600640 1 --2- 172.21.15.55:0/302665654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa38a83c00 0x55fa37d3bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7786600640 1 -- 172.21.15.55:0/302665654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa37ce4b60 con 0x55fa38a83800 2024-04-02T07:32:35.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7786600640 1 --2- 172.21.15.55:0/302665654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa38a83800 0x55fa37d3b600 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x55fa38c300c0 tx=0x55fa38bd4d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd547747939b197 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7780200640 1 -- 172.21.15.55:0/302665654 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa37d03080 con 0x55fa38a83800 2024-04-02T07:32:35.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7780200640 1 -- 172.21.15.55:0/302665654 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa38a6e300 con 0x55fa38a83800 2024-04-02T07:32:35.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.445+0000 7f7780200640 1 -- 172.21.15.55:0/302665654 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa37d03600 con 0x55fa38a83800 2024-04-02T07:32:35.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7787a47400 1 -- 172.21.15.55:0/302665654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa38a83800 msgr2=0x55fa37d3b600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7787a47400 1 --2- 172.21.15.55:0/302665654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa38a83800 0x55fa37d3b600 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x55fa38c300c0 tx=0x55fa38bd4d20 comp rx=0 tx=0).stop 2024-04-02T07:32:35.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7787a47400 1 -- 172.21.15.55:0/302665654 shutdown_connections 2024-04-02T07:32:35.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7787a47400 1 --2- 172.21.15.55:0/302665654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa38c2e000 0x55fa37d3c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7787a47400 1 --2- 172.21.15.55:0/302665654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa38a83c00 0x55fa37d3bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7787a47400 1 --2- 172.21.15.55:0/302665654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa38a83800 0x55fa37d3b600 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7787a47400 1 -- 172.21.15.55:0/302665654 >> 172.21.15.55:0/302665654 conn(0x55fa37caec00 msgr2=0x55fa37cdd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:35.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7787a47400 1 -- 172.21.15.55:0/302665654 shutdown_connections 2024-04-02T07:32:35.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7787a47400 1 -- 172.21.15.55:0/302665654 wait complete. 2024-04-02T07:32:35.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7787a47400 1 Processor -- start 2024-04-02T07:32:35.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7787a47400 1 -- start start 2024-04-02T07:32:35.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7787a47400 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa38a83c00 0x55fa37d3d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7787a47400 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa38a83800 0x55fa37d3cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7787a47400 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa38c2f800 0x55fa37d3c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7787a47400 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa37d7c500 con 0x55fa38c2f800 2024-04-02T07:32:35.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7787a47400 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa37d7c3c0 con 0x55fa38a83800 2024-04-02T07:32:35.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7787a47400 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa37d7c280 con 0x55fa38a83c00 2024-04-02T07:32:35.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7785200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa38c2f800 0x55fa37d3c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7785200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa38c2f800 0x55fa37d3c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:51838/0 (socket says 172.21.15.55:51838) 2024-04-02T07:32:35.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7785200640 1 -- 172.21.15.55:0/2689583953 learned_addr learned my addr 172.21.15.55:0/2689583953 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:35.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7786600640 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa38a83c00 0x55fa37d3d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7785c00640 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa38a83800 0x55fa37d3cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7785200640 1 -- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa38a83c00 msgr2=0x55fa37d3d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7785200640 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa38a83c00 0x55fa37d3d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7785200640 1 -- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa38a83800 msgr2=0x55fa37d3cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7785200640 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa38a83800 0x55fa37d3cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7785200640 1 -- 172.21.15.55:0/2689583953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa37ce4340 con 0x55fa38c2f800 2024-04-02T07:32:35.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7785200640 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa38c2f800 0x55fa37d3c680 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x55fa38c30de0 tx=0x55fa38bd4e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f777e400640 1 -- 172.21.15.55:0/2689583953 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa37d03080 con 0x55fa38c2f800 2024-04-02T07:32:35.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f777e400640 1 -- 172.21.15.55:0/2689583953 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa38a6f500 con 0x55fa38c2f800 2024-04-02T07:32:35.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f777e400640 1 -- 172.21.15.55:0/2689583953 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x55fa37d03600 con 0x55fa38c2f800 2024-04-02T07:32:35.457 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7787a47400 1 -- 172.21.15.55:0/2689583953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55fa37ce4000 con 0x55fa38c2f800 2024-04-02T07:32:35.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7787a47400 1 -- 172.21.15.55:0/2689583953 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa37ce4ea0 con 0x55fa38c2f800 2024-04-02T07:32:35.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.449+0000 7f7787a47400 4 main: JournalTool: resolving pool 14 2024-04-02T07:32:35.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.453+0000 7f777e400640 1 -- 172.21.15.55:0/2689583953 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x55fa37d7a840 con 0x55fa38c2f800 2024-04-02T07:32:35.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.453+0000 7f777e400640 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x55fa38bb1400 0x55fa37d3d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.453+0000 7f777e400640 1 -- 172.21.15.55:0/2689583953 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x55fa37ceea80 con 0x55fa38c2f800 2024-04-02T07:32:35.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.453+0000 7f7787a47400 4 main: JournalTool: creating IoCtx.. 2024-04-02T07:32:35.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.453+0000 7f7787a47400 4 main: Executing for rank 0 2024-04-02T07:32:35.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.453+0000 7f7787a47400 4 Filtering by inode '1099511627777' 2024-04-02T07:32:35.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.453+0000 7f7787a47400 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x55fa38c2f400 0x55fa37d3c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.453+0000 7f7787a47400 1 -- 172.21.15.55:0/2689583953 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104) v8 -- 0x55fa38c2f000 con 0x55fa38c2f400 2024-04-02T07:32:35.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.453+0000 7f7786600640 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x55fa38bb1400 0x55fa37d3d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.453+0000 7f7785c00640 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x55fa38c2f400 0x55fa37d3c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.453+0000 7f7786600640 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x55fa38bb1400 0x55fa37d3d700 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x55fa38c300c0 tx=0x55fa37d89020 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.453+0000 7f7785c00640 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x55fa38c2f400 0x55fa37d3c100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.457+0000 7f7785c00640 1 -- 172.21.15.55:0/2689583953 <== osd.7 v2:172.21.15.106:6824/27679 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x55fa38a80b40 con 0x55fa38c2f400 2024-04-02T07:32:35.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.457+0000 7f7787a47400 4 Pointer 400.00000000 is readable 2024-04-02T07:32:35.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.457+0000 7f7787a47400 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-02T07:32:35.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.457+0000 7f7787a47400 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x55fa38c2ec00 0x55fa37d3bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.457+0000 7f7787a47400 1 -- 172.21.15.55:0/2689583953 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:2 14.14 14:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104) v8 -- 0x55fa38c2e800 con 0x55fa38c2ec00 2024-04-02T07:32:35.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.457+0000 7f7786600640 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x55fa38c2ec00 0x55fa37d3bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.457+0000 7f7786600640 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x55fa38c2ec00 0x55fa37d3bb80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.457+0000 7f7786600640 1 -- 172.21.15.55:0/2689583953 <== osd.4 v2:172.21.15.106:6801/27677 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x55fa38a80d80 con 0x55fa38c2ec00 2024-04-02T07:32:35.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.457+0000 7f7787a47400 10 Header 0x400000 0x405ee2 0x40625e 2024-04-02T07:32:35.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.457+0000 7f7787a47400 10 Starting journal scan from offset 0x405ee2 2024-04-02T07:32:35.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.457+0000 7f7787a47400 1 -- 172.21.15.55:0/2689583953 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:3 14.14 14:2e2fa760:::200.00000001:head [read 24290~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104) v8 -- 0x55fa38c2e400 con 0x55fa38c2ec00 2024-04-02T07:32:35.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.457+0000 7f7786600640 1 -- 172.21.15.55:0/2689583953 <== osd.4 v2:172.21.15.106:6801/27677 2 ==== osd_op_reply(3 200.00000001 [read 24290~892 out=892b] v0'0 uv27 ondisk = 0) v8 ==== 156+0+892 (crc 0 0 0) 0x55fa38a80d80 con 0x55fa38c2ec00 2024-04-02T07:32:35.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.457+0000 7f7787a47400 4 Read 0x37c bytes from 200.00000001 gap=0 2024-04-02T07:32:35.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.457+0000 7f7787a47400 10 Parsing data, 0x37c bytes available 2024-04-02T07:32:35.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.457+0000 7f7787a47400 10 Attempting decode at 0x405ee2 2024-04-02T07:32:35.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.457+0000 7f7787a47400 10 Consumed 0x37c bytes 2024-04-02T07:32:35.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.457+0000 7f7787a47400 10 Valid entry at 0x405ee2 2024-04-02T07:32:35.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.457+0000 7f7787a47400 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55fa38c2e000 0x55fa37d3b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.457+0000 7f7787a47400 1 -- 172.21.15.55:0/2689583953 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:4 14.1b 14:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104) v8 -- 0x55fa38bb1800 con 0x55fa38c2e000 2024-04-02T07:32:35.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.457+0000 7f7785c00640 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55fa38c2e000 0x55fa37d3b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7785c00640 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55fa38c2e000 0x55fa37d3b600 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7785c00640 1 -- 172.21.15.55:0/2689583953 <== osd.1 v2:172.21.15.55:6809/27391 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x55fa38a80b40 con 0x55fa38c2e000 2024-04-02T07:32:35.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 4 Reached end of journal objects 2024-04-02T07:32:35.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 4 Scanned objects, 0 missing, 1 valid 2024-04-02T07:32:35.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 4 Events scanned, 0 gaps 2024-04-02T07:32:35.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 4 Found 1 valid events 2024-04-02T07:32:35.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 4 Selected 0 events events for processing 2024-04-02T07:32:35.466 INFO:teuthology.orchestra.run.smithi055.stdout:Events by type: 2024-04-02T07:32:35.466 INFO:teuthology.orchestra.run.smithi055.stdout:Errors: 0 2024-04-02T07:32:35.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 4 0 events 2024-04-02T07:32:35.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 -- 172.21.15.55:0/2689583953 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55fa38c2e000 msgr2=0x55fa37d3b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x55fa38c2e000 0x55fa37d3b600 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 -- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x55fa38c2ec00 msgr2=0x55fa37d3bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x55fa38c2ec00 0x55fa37d3bb80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 -- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x55fa38c2f400 msgr2=0x55fa37d3c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x55fa38c2f400 0x55fa37d3c100 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7785200640 1 -- 172.21.15.55:0/2689583953 reap_dead start 2024-04-02T07:32:35.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 -- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x55fa38bb1400 msgr2=0x55fa37d3d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x55fa38bb1400 0x55fa37d3d700 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x55fa38c300c0 tx=0x55fa37d89020 comp rx=0 tx=0).stop 2024-04-02T07:32:35.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 -- 172.21.15.55:0/2689583953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa38c2f800 msgr2=0x55fa37d3c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa38c2f800 0x55fa37d3c680 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x55fa38c30de0 tx=0x55fa38bd4e40 comp rx=0 tx=0).stop 2024-04-02T07:32:35.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 -- 172.21.15.55:0/2689583953 shutdown_connections 2024-04-02T07:32:35.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa38c2f800 0x55fa37d3c680 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 --2- 172.21.15.55:0/2689583953 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x55fa38bb1400 0x55fa37d3d700 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 -- 172.21.15.55:0/2689583953 >> 172.21.15.55:0/2689583953 conn(0x55fa37caec00 msgr2=0x55fa37cdd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:35.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 -- 172.21.15.55:0/2689583953 shutdown_connections 2024-04-02T07:32:35.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 -- 172.21.15.55:0/2689583953 wait complete. 2024-04-02T07:32:35.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 -- 172.21.15.55:0/3263491568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa37caf800 msgr2=0x55fa37d3a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 --2- 172.21.15.55:0/3263491568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa37caf800 0x55fa37d3a580 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x55fa38b1cc00 tx=0x55fa38a6ca80 comp rx=0 tx=0).stop 2024-04-02T07:32:35.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 -- 172.21.15.55:0/3263491568 shutdown_connections 2024-04-02T07:32:35.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 --2- 172.21.15.55:0/3263491568 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55fa37caf000 0x55fa37d3b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 --2- 172.21.15.55:0/3263491568 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55fa37caf400 0x55fa37d3ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 --2- 172.21.15.55:0/3263491568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55fa37caf800 0x55fa37d3a580 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.461+0000 7f7787a47400 1 -- 172.21.15.55:0/3263491568 >> 172.21.15.55:0/3263491568 conn(0x55fa37cafc00 msgr2=0x55fa37cdd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:35.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.465+0000 7f7787a47400 1 -- 172.21.15.55:0/3263491568 shutdown_connections 2024-04-02T07:32:35.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.465+0000 7f7787a47400 1 -- 172.21.15.55:0/3263491568 wait complete. 2024-04-02T07:32:35.471 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627777', 'summary'] in time 0:00:00.077097, result: Events by type: Errors: 0 2024-04-02T07:32:35.471 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 event splice --inode=1099511627778 summary 2024-04-02T07:32:35.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.561+0000 7f44fc2c1400 1 -- start start 2024-04-02T07:32:35.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.561+0000 7f44fc2c1400 1 Processor -- start 2024-04-02T07:32:35.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.561+0000 7f44fc2c1400 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5556e5ed3800 0x5556e5f5e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.561+0000 7f44fc2c1400 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5556e5ed3400 0x5556e5f5eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.561+0000 7f44fc2c1400 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556e5ed3000 0x5556e5f5f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.561+0000 7f44fc2c1400 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556e5fa0780 con 0x5556e5ed3000 2024-04-02T07:32:35.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.561+0000 7f44fc2c1400 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556e5fa0a00 con 0x5556e5ed3400 2024-04-02T07:32:35.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.561+0000 7f44fc2c1400 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556e5fa0640 con 0x5556e5ed3800 2024-04-02T07:32:35.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.561+0000 7f44fae00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556e5ed3000 0x5556e5f5f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.561+0000 7f44fae00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556e5ed3000 0x5556e5f5f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48414/0 (socket says 172.21.15.55:48414) 2024-04-02T07:32:35.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.561+0000 7f44fae00640 1 -- 172.21.15.55:0/484301853 learned_addr learned my addr 172.21.15.55:0/484301853 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:35.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.561+0000 7f44f9a00640 1 --2- 172.21.15.55:0/484301853 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5556e5ed3400 0x5556e5f5eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.561+0000 7f44fa400640 1 --2- 172.21.15.55:0/484301853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5556e5ed3800 0x5556e5f5e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.561+0000 7f44fa400640 1 -- 172.21.15.55:0/484301853 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5556e5ed3400 msgr2=0x5556e5f5eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:35.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.561+0000 7f44fa400640 1 --2- 172.21.15.55:0/484301853 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5556e5ed3400 0x5556e5f5eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.561+0000 7f44fa400640 1 -- 172.21.15.55:0/484301853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556e5ed3000 msgr2=0x5556e5f5f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:35.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.561+0000 7f44fa400640 1 --2- 172.21.15.55:0/484301853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556e5ed3000 0x5556e5f5f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.561+0000 7f44fa400640 1 -- 172.21.15.55:0/484301853 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556e5f089c0 con 0x5556e5ed3800 2024-04-02T07:32:35.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.565+0000 7f44fa400640 1 --2- 172.21.15.55:0/484301853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5556e5ed3800 0x5556e5f5e580 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x5556e6d46330 tx=0x5556e6c90ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc7a8895ef53b001 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.565+0000 7f44f7200640 1 -- 172.21.15.55:0/484301853 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5556e5f27080 con 0x5556e5ed3800 2024-04-02T07:32:35.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.565+0000 7f44f7200640 1 -- 172.21.15.55:0/484301853 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5556e6cac300 con 0x5556e5ed3800 2024-04-02T07:32:35.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.565+0000 7f44f7200640 1 -- 172.21.15.55:0/484301853 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5556e5f27600 con 0x5556e5ed3800 2024-04-02T07:32:35.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.565+0000 7f44fc2c1400 1 -- 172.21.15.55:0/484301853 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5556e5f081a0 con 0x5556e5ed3800 2024-04-02T07:32:35.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.565+0000 7f44fc2c1400 1 -- 172.21.15.55:0/484301853 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5556e5f089c0 con 0x5556e5ed3800 2024-04-02T07:32:35.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.565+0000 7f44fc2c1400 4 waiting for MDS map... 2024-04-02T07:32:35.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.565+0000 7f44f7200640 1 -- 172.21.15.55:0/484301853 <== mon.2 v2:172.21.15.106:3301/0 4 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x5556e5f12c40 con 0x5556e5ed3800 2024-04-02T07:32:35.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.565+0000 7f44f7200640 1 -- 172.21.15.55:0/484301853 <== mon.2 v2:172.21.15.106:3301/0 5 ==== fsmap(e 82) v1 ==== 2573+0+0 (secure 0 0 0) 0x5556e5f20f00 con 0x5556e5ed3800 2024-04-02T07:32:35.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.565+0000 7f44fc2c1400 4 Got MDS map 82 2024-04-02T07:32:35.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.565+0000 7f44fc2c1400 10 main: JournalTool::main 2024-04-02T07:32:35.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.565+0000 7f44fc2c1400 4 main: JournalTool: connecting to RADOS... 2024-04-02T07:32:35.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.565+0000 7f44fc2c1400 1 Processor -- start 2024-04-02T07:32:35.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.565+0000 7f44fc2c1400 1 -- start start 2024-04-02T07:32:35.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.565+0000 7f44fc2c1400 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5556e6c95800 0x5556e5f5f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.565+0000 7f44fc2c1400 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5556e6c95c00 0x5556e5f5fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556e6e46000 0x5556e5f60100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556e5f19e00 con 0x5556e6e46000 2024-04-02T07:32:35.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556e5fa0780 con 0x5556e6c95800 2024-04-02T07:32:35.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556e5fa0640 con 0x5556e6c95c00 2024-04-02T07:32:35.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44f9a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556e6e46000 0x5556e5f60100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fae00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5556e6c95800 0x5556e5f5f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44f9a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556e6e46000 0x5556e5f60100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48418/0 (socket says 172.21.15.55:48418) 2024-04-02T07:32:35.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44f9a00640 1 -- 172.21.15.55:0/1358430066 learned_addr learned my addr 172.21.15.55:0/1358430066 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fae00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5556e6c95800 0x5556e5f5f600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:39638/0 (socket says 172.21.15.55:39638) 2024-04-02T07:32:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fa400640 1 --2- 172.21.15.55:0/1358430066 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5556e6c95c00 0x5556e5f5fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44f9a00640 1 -- 172.21.15.55:0/1358430066 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5556e6c95c00 msgr2=0x5556e5f5fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44f9a00640 1 --2- 172.21.15.55:0/1358430066 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5556e6c95c00 0x5556e5f5fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44f9a00640 1 -- 172.21.15.55:0/1358430066 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5556e6c95800 msgr2=0x5556e5f5f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44f9a00640 1 --2- 172.21.15.55:0/1358430066 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5556e6c95800 0x5556e5f5f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44f9a00640 1 -- 172.21.15.55:0/1358430066 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556e5f08b60 con 0x5556e6e46000 2024-04-02T07:32:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44f9a00640 1 --2- 172.21.15.55:0/1358430066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556e6e46000 0x5556e5f60100 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x5556e6e500c0 tx=0x5556e6dd8c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abab39693de210a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44f4a00640 1 -- 172.21.15.55:0/1358430066 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5556e5f27080 con 0x5556e6e46000 2024-04-02T07:32:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44f4a00640 1 -- 172.21.15.55:0/1358430066 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5556e5f30480 con 0x5556e6e46000 2024-04-02T07:32:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44f4a00640 1 -- 172.21.15.55:0/1358430066 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5556e5f27600 con 0x5556e6e46000 2024-04-02T07:32:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 -- 172.21.15.55:0/1358430066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556e6e46000 msgr2=0x5556e5f60100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 --2- 172.21.15.55:0/1358430066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556e6e46000 0x5556e5f60100 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x5556e6e500c0 tx=0x5556e6dd8c00 comp rx=0 tx=0).stop 2024-04-02T07:32:35.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 -- 172.21.15.55:0/1358430066 shutdown_connections 2024-04-02T07:32:35.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 --2- 172.21.15.55:0/1358430066 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556e6e46000 0x5556e5f60100 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 --2- 172.21.15.55:0/1358430066 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5556e6c95c00 0x5556e5f5fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 --2- 172.21.15.55:0/1358430066 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5556e6c95800 0x5556e5f5f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 -- 172.21.15.55:0/1358430066 >> 172.21.15.55:0/1358430066 conn(0x5556e5ed2c00 msgr2=0x5556e5f01800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:35.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 -- 172.21.15.55:0/1358430066 shutdown_connections 2024-04-02T07:32:35.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 -- 172.21.15.55:0/1358430066 wait complete. 2024-04-02T07:32:35.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 Processor -- start 2024-04-02T07:32:35.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 -- start start 2024-04-02T07:32:35.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5556e6c95c00 0x5556e5f61180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5556e6c95800 0x5556e5f60c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556e6e47800 0x5556e5f60680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556e5fa0500 con 0x5556e6e47800 2024-04-02T07:32:35.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556e5fa03c0 con 0x5556e6c95800 2024-04-02T07:32:35.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fc2c1400 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5556e5fa0280 con 0x5556e6c95c00 2024-04-02T07:32:35.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44f9a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556e6e47800 0x5556e5f60680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44f9a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556e6e47800 0x5556e5f60680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48420/0 (socket says 172.21.15.55:48420) 2024-04-02T07:32:35.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44f9a00640 1 -- 172.21.15.55:0/4126011106 learned_addr learned my addr 172.21.15.55:0/4126011106 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:35.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fa400640 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5556e6c95800 0x5556e5f60c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44f9a00640 1 -- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5556e6c95c00 msgr2=0x5556e5f61180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.569+0000 7f44fae00640 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5556e6c95c00 0x5556e5f61180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44f9a00640 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5556e6c95c00 0x5556e5f61180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44f9a00640 1 -- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5556e6c95800 msgr2=0x5556e5f60c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44f9a00640 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5556e6c95800 0x5556e5f60c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44f9a00640 1 -- 172.21.15.55:0/4126011106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556e5f08340 con 0x5556e6e47800 2024-04-02T07:32:35.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44fa400640 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5556e6c95800 0x5556e5f60c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:32:35.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44fae00640 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5556e6c95c00 0x5556e5f61180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:32:35.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44f9a00640 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556e6e47800 0x5556e5f60680 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x5556e6e51380 tx=0x5556e5fad200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44f2c00640 1 -- 172.21.15.55:0/4126011106 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5556e5f26dc0 con 0x5556e6e47800 2024-04-02T07:32:35.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44f2c00640 1 -- 172.21.15.55:0/4126011106 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5556e6cad500 con 0x5556e6e47800 2024-04-02T07:32:35.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44fc2c1400 1 -- 172.21.15.55:0/4126011106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5556e5f08000 con 0x5556e6e47800 2024-04-02T07:32:35.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44f2c00640 1 -- 172.21.15.55:0/4126011106 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5556e5f27080 con 0x5556e6e47800 2024-04-02T07:32:35.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44fc2c1400 1 -- 172.21.15.55:0/4126011106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5556e5f08ea0 con 0x5556e6e47800 2024-04-02T07:32:35.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44fc2c1400 4 main: JournalTool: resolving pool 14 2024-04-02T07:32:35.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44f2c00640 1 -- 172.21.15.55:0/4126011106 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x5556e5f9e840 con 0x5556e6e47800 2024-04-02T07:32:35.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44f2c00640 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5556e6e5c800 0x5556e5f61700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44f2c00640 1 -- 172.21.15.55:0/4126011106 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x5556e5f12a80 con 0x5556e6e47800 2024-04-02T07:32:35.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44fc2c1400 4 main: JournalTool: creating IoCtx.. 2024-04-02T07:32:35.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44fc2c1400 4 main: Executing for rank 0 2024-04-02T07:32:35.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44fc2c1400 4 Filtering by inode '1099511627778' 2024-04-02T07:32:35.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44fc2c1400 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x5556e6e47400 0x5556e5f60100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44fc2c1400 1 -- 172.21.15.55:0/4126011106 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:1 14.f 14:f1f69726:::400.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104) v8 -- 0x5556e6e47000 con 0x5556e6e47400 2024-04-02T07:32:35.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44fae00640 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5556e6e5c800 0x5556e5f61700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44fa400640 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x5556e6e47400 0x5556e5f60100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44fae00640 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5556e6e5c800 0x5556e5f61700 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x5556e6d46c60 tx=0x5556e6dd9da0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.573+0000 7f44fa400640 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x5556e6e47400 0x5556e5f60100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fa400640 1 -- 172.21.15.55:0/4126011106 <== osd.7 v2:172.21.15.106:6824/27679 1 ==== osd_op_reply(1 400.00000000 [read 0~22 out=22b] v0'0 uv1 ondisk = 0) v8 ==== 156+0+22 (crc 0 0 0) 0x5556e6ca4b40 con 0x5556e6e47400 2024-04-02T07:32:35.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 4 Pointer 400.00000000 is readable 2024-04-02T07:32:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 4 JournalScanner::scan: reading header object '200.00000000' 2024-04-02T07:32:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x5556e6e46c00 0x5556e5f5fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 -- 172.21.15.55:0/4126011106 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:2 14.14 14:292cf221:::200.00000000:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104) v8 -- 0x5556e6e46800 con 0x5556e6e46c00 2024-04-02T07:32:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fae00640 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x5556e6e46c00 0x5556e5f5fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fae00640 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x5556e6e46c00 0x5556e5f5fb80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fae00640 1 -- 172.21.15.55:0/4126011106 <== osd.4 v2:172.21.15.106:6801/27677 1 ==== osd_op_reply(2 200.00000000 [read 0~90 out=90b] v0'0 uv30 ondisk = 0) v8 ==== 156+0+90 (crc 0 0 0) 0x5556e6ca4d80 con 0x5556e6e46c00 2024-04-02T07:32:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 10 Header 0x400000 0x405ee2 0x40625e 2024-04-02T07:32:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 10 Starting journal scan from offset 0x405ee2 2024-04-02T07:32:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 -- 172.21.15.55:0/4126011106 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:3 14.14 14:2e2fa760:::200.00000001:head [read 24290~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104) v8 -- 0x5556e6e46400 con 0x5556e6e46c00 2024-04-02T07:32:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fae00640 1 -- 172.21.15.55:0/4126011106 <== osd.4 v2:172.21.15.106:6801/27677 2 ==== osd_op_reply(3 200.00000001 [read 24290~892 out=892b] v0'0 uv27 ondisk = 0) v8 ==== 156+0+892 (crc 0 0 0) 0x5556e6ca4d80 con 0x5556e6e46c00 2024-04-02T07:32:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 4 Read 0x37c bytes from 200.00000001 gap=0 2024-04-02T07:32:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 10 Parsing data, 0x37c bytes available 2024-04-02T07:32:35.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 10 Attempting decode at 0x405ee2 2024-04-02T07:32:35.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 10 Consumed 0x37c bytes 2024-04-02T07:32:35.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 10 Valid entry at 0x405ee2 2024-04-02T07:32:35.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x5556e6e46000 0x5556e5f5f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 -- 172.21.15.55:0/4126011106 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:4 14.1b 14:ddb4e4d7:::200.00000002:head [read 0~2147483647] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e104) v8 -- 0x5556e6e5d800 con 0x5556e6e46000 2024-04-02T07:32:35.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fa400640 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x5556e6e46000 0x5556e5f5f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fa400640 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x5556e6e46000 0x5556e5f5f600 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fa400640 1 -- 172.21.15.55:0/4126011106 <== osd.1 v2:172.21.15.55:6809/27391 1 ==== osd_op_reply(4 200.00000002 [read 0~2147483647] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x5556e6ca4b40 con 0x5556e6e46000 2024-04-02T07:32:35.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 4 Reached end of journal objects 2024-04-02T07:32:35.583 INFO:teuthology.orchestra.run.smithi055.stdout:Events by type: 2024-04-02T07:32:35.583 INFO:teuthology.orchestra.run.smithi055.stdout:Errors: 0 2024-04-02T07:32:35.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 4 Scanned objects, 0 missing, 1 valid 2024-04-02T07:32:35.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 4 Events scanned, 0 gaps 2024-04-02T07:32:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 4 Found 1 valid events 2024-04-02T07:32:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 4 Selected 0 events events for processing 2024-04-02T07:32:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 4 0 events 2024-04-02T07:32:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 -- 172.21.15.55:0/4126011106 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x5556e6e46000 msgr2=0x5556e5f5f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x5556e6e46000 0x5556e5f5f600 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 -- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x5556e6e46c00 msgr2=0x5556e5f5fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x5556e6e46c00 0x5556e5f5fb80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 -- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x5556e6e47400 msgr2=0x5556e5f60100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x5556e6e47400 0x5556e5f60100 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44f9a00640 1 -- 172.21.15.55:0/4126011106 reap_dead start 2024-04-02T07:32:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 -- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5556e6e5c800 msgr2=0x5556e5f61700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5556e6e5c800 0x5556e5f61700 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x5556e6d46c60 tx=0x5556e6dd9da0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 -- 172.21.15.55:0/4126011106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556e6e47800 msgr2=0x5556e5f60680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556e6e47800 0x5556e5f60680 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x5556e6e51380 tx=0x5556e5fad200 comp rx=0 tx=0).stop 2024-04-02T07:32:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 -- 172.21.15.55:0/4126011106 shutdown_connections 2024-04-02T07:32:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556e6e47800 0x5556e5f60680 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 --2- 172.21.15.55:0/4126011106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5556e6e5c800 0x5556e5f61700 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 -- 172.21.15.55:0/4126011106 >> 172.21.15.55:0/4126011106 conn(0x5556e5ed2c00 msgr2=0x5556e5f01800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 -- 172.21.15.55:0/4126011106 shutdown_connections 2024-04-02T07:32:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 -- 172.21.15.55:0/4126011106 wait complete. 2024-04-02T07:32:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 -- 172.21.15.55:0/484301853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5556e5ed3800 msgr2=0x5556e5f5e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 --2- 172.21.15.55:0/484301853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5556e5ed3800 0x5556e5f5e580 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x5556e6d46330 tx=0x5556e6c90ba0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 -- 172.21.15.55:0/484301853 shutdown_connections 2024-04-02T07:32:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 --2- 172.21.15.55:0/484301853 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5556e5ed3000 0x5556e5f5f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 --2- 172.21.15.55:0/484301853 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5556e5ed3400 0x5556e5f5eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 --2- 172.21.15.55:0/484301853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5556e5ed3800 0x5556e5f5e580 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 -- 172.21.15.55:0/484301853 >> 172.21.15.55:0/484301853 conn(0x5556e5ed3c00 msgr2=0x5556e5f01000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 -- 172.21.15.55:0/484301853 shutdown_connections 2024-04-02T07:32:35.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.577+0000 7f44fc2c1400 1 -- 172.21.15.55:0/484301853 wait complete. 2024-04-02T07:32:35.588 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'event', 'splice', '--inode=1099511627778', 'summary'] in time 0:00:00.116803, result: Events by type: Errors: 0 2024-04-02T07:32:35.588 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata put mds0_inotable - 2024-04-02T07:32:35.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4f3833080 1 Processor -- start 2024-04-02T07:32:35.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4f3833080 1 -- start start 2024-04-02T07:32:35.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4f3833080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55da8a675ce0 0x55da8a7039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4f3833080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da8a701a20 0x55da8a705bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4f3833080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55da8a702340 0x55da8a706100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4f3833080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da8a571960 con 0x55da8a701a20 2024-04-02T07:32:35.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4f3833080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da8a571600 con 0x55da8a675ce0 2024-04-02T07:32:35.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4f3833080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da8a568690 con 0x55da8a702340 2024-04-02T07:32:35.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4ebe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da8a701a20 0x55da8a705bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4ebe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da8a701a20 0x55da8a705bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48444/0 (socket says 172.21.15.55:48444) 2024-04-02T07:32:35.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4ebe00640 1 -- 172.21.15.55:0/144709833 learned_addr learned my addr 172.21.15.55:0/144709833 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:35.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4f1400640 1 --2- 172.21.15.55:0/144709833 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55da8a702340 0x55da8a706100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4f0a00640 1 --2- 172.21.15.55:0/144709833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55da8a675ce0 0x55da8a7039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4ebe00640 1 -- 172.21.15.55:0/144709833 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55da8a702340 msgr2=0x55da8a706100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:35.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4ebe00640 1 --2- 172.21.15.55:0/144709833 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55da8a702340 0x55da8a706100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4ebe00640 1 -- 172.21.15.55:0/144709833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55da8a675ce0 msgr2=0x55da8a7039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:35.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4ebe00640 1 --2- 172.21.15.55:0/144709833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55da8a675ce0 0x55da8a7039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4ebe00640 1 -- 172.21.15.55:0/144709833 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e4005df0 con 0x55da8a701a20 2024-04-02T07:32:35.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4ebe00640 1 --2- 172.21.15.55:0/144709833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da8a701a20 0x55da8a705bc0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009850 tx=0x7fb4dc005a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecb75f1642c03bb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4eaa00640 1 -- 172.21.15.55:0/144709833 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00f040 con 0x55da8a701a20 2024-04-02T07:32:35.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4eaa00640 1 -- 172.21.15.55:0/144709833 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc008d40 con 0x55da8a701a20 2024-04-02T07:32:35.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4eaa00640 1 -- 172.21.15.55:0/144709833 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc005e40 con 0x55da8a701a20 2024-04-02T07:32:35.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4f3833080 1 -- 172.21.15.55:0/144709833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da8a701a20 msgr2=0x55da8a705bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4f3833080 1 --2- 172.21.15.55:0/144709833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da8a701a20 0x55da8a705bc0 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009850 tx=0x7fb4dc005a10 comp rx=0 tx=0).stop 2024-04-02T07:32:35.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4f3833080 1 -- 172.21.15.55:0/144709833 shutdown_connections 2024-04-02T07:32:35.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4f3833080 1 --2- 172.21.15.55:0/144709833 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55da8a702340 0x55da8a706100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4f3833080 1 --2- 172.21.15.55:0/144709833 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da8a701a20 0x55da8a705bc0 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4f3833080 1 --2- 172.21.15.55:0/144709833 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55da8a675ce0 0x55da8a7039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.633+0000 7fb4f3833080 1 -- 172.21.15.55:0/144709833 >> 172.21.15.55:0/144709833 conn(0x55da8a6585a0 msgr2=0x55da8a65d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:35.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4f3833080 1 -- 172.21.15.55:0/144709833 shutdown_connections 2024-04-02T07:32:35.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4f3833080 1 -- 172.21.15.55:0/144709833 wait complete. 2024-04-02T07:32:35.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4f3833080 1 Processor -- start 2024-04-02T07:32:35.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4f3833080 1 -- start start 2024-04-02T07:32:35.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4f3833080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55da8a675ce0 0x55da8a6fb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4f3833080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da8a701a20 0x55da8a62b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4f3833080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55da8a702340 0x55da8a62b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4f3833080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da8a6fbb40 con 0x55da8a701a20 2024-04-02T07:32:35.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4f3833080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da8a707f30 con 0x55da8a702340 2024-04-02T07:32:35.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4f3833080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da8a7081d0 con 0x55da8a675ce0 2024-04-02T07:32:35.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4ebe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da8a701a20 0x55da8a62b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4ebe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da8a701a20 0x55da8a62b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48446/0 (socket says 172.21.15.55:48446) 2024-04-02T07:32:35.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4ebe00640 1 -- 172.21.15.55:0/2028013496 learned_addr learned my addr 172.21.15.55:0/2028013496 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:35.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4f0a00640 1 --2- 172.21.15.55:0/2028013496 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55da8a675ce0 0x55da8a6fb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4f1400640 1 --2- 172.21.15.55:0/2028013496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55da8a702340 0x55da8a62b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4ebe00640 1 -- 172.21.15.55:0/2028013496 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55da8a675ce0 msgr2=0x55da8a6fb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4ebe00640 1 --2- 172.21.15.55:0/2028013496 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55da8a675ce0 0x55da8a6fb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4ebe00640 1 -- 172.21.15.55:0/2028013496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55da8a702340 msgr2=0x55da8a62b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4ebe00640 1 --2- 172.21.15.55:0/2028013496 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55da8a702340 0x55da8a62b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4ebe00640 1 -- 172.21.15.55:0/2028013496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4dc009420 con 0x55da8a701a20 2024-04-02T07:32:35.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4ebe00640 1 --2- 172.21.15.55:0/2028013496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da8a701a20 0x55da8a62b110 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc008780 tx=0x7fb4dc003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4e9600640 1 -- 172.21.15.55:0/2028013496 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc00f070 con 0x55da8a701a20 2024-04-02T07:32:35.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4e9600640 1 -- 172.21.15.55:0/2028013496 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4dc008eb0 con 0x55da8a701a20 2024-04-02T07:32:35.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4e9600640 1 -- 172.21.15.55:0/2028013496 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4dc0056d0 con 0x55da8a701a20 2024-04-02T07:32:35.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4f3833080 1 -- 172.21.15.55:0/2028013496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55da8a5808c0 con 0x55da8a701a20 2024-04-02T07:32:35.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.637+0000 7fb4f3833080 1 -- 172.21.15.55:0/2028013496 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da8a573d00 con 0x55da8a701a20 2024-04-02T07:32:35.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.641+0000 7fb4e9600640 1 -- 172.21.15.55:0/2028013496 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb4dc01b050 con 0x55da8a701a20 2024-04-02T07:32:35.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.641+0000 7fb4e9600640 1 --2- 172.21.15.55:0/2028013496 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb4d00650a0 0x7fb4d0067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.641+0000 7fb4e9600640 1 -- 172.21.15.55:0/2028013496 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb4dc0847f0 con 0x55da8a701a20 2024-04-02T07:32:35.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.641+0000 7fb4f3833080 1 --2- 172.21.15.55:0/2028013496 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x55da8a79ab00 0x55da8a79af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.641+0000 7fb4f0a00640 1 --2- 172.21.15.55:0/2028013496 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb4d00650a0 0x7fb4d0067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.641+0000 7fb4f3833080 1 -- 172.21.15.55:0/2028013496 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e104) v8 -- 0x55da8a706410 con 0x55da8a79ab00 2024-04-02T07:32:35.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.641+0000 7fb4f1400640 1 --2- 172.21.15.55:0/2028013496 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x55da8a79ab00 0x55da8a79af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.641+0000 7fb4f0a00640 1 --2- 172.21.15.55:0/2028013496 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb4d00650a0 0x7fb4d0067560 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40ae000 tx=0x7fb4e40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.641+0000 7fb4f1400640 1 --2- 172.21.15.55:0/2028013496 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x55da8a79ab00 0x55da8a79af10 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.645+0000 7fb4f1400640 1 -- 172.21.15.55:0/2028013496 <== osd.2 v2:172.21.15.55:6808/27394 1 ==== osd_op_reply(1 mds0_inotable [writefull 0~34] v104'5 uv5 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x7fb4ec0027d0 con 0x55da8a79ab00 2024-04-02T07:32:35.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.645+0000 7fb4f3833080 1 -- 172.21.15.55:0/2028013496 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x55da8a79ab00 msgr2=0x55da8a79af10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.645+0000 7fb4f3833080 1 --2- 172.21.15.55:0/2028013496 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x55da8a79ab00 0x55da8a79af10 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.645+0000 7fb4f3833080 1 -- 172.21.15.55:0/2028013496 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb4d00650a0 msgr2=0x7fb4d0067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.645+0000 7fb4f3833080 1 --2- 172.21.15.55:0/2028013496 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb4d00650a0 0x7fb4d0067560 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fb4e40ae000 tx=0x7fb4e40a6000 comp rx=0 tx=0).stop 2024-04-02T07:32:35.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.645+0000 7fb4f3833080 1 -- 172.21.15.55:0/2028013496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da8a701a20 msgr2=0x55da8a62b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.645+0000 7fb4f3833080 1 --2- 172.21.15.55:0/2028013496 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55da8a701a20 0x55da8a62b110 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc008780 tx=0x7fb4dc003030 comp rx=0 tx=0).stop 2024-04-02T07:32:35.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.645+0000 7fb4f1400640 1 -- 172.21.15.55:0/2028013496 reap_dead start 2024-04-02T07:32:35.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.645+0000 7fb4f3833080 1 -- 172.21.15.55:0/2028013496 shutdown_connections 2024-04-02T07:32:35.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.645+0000 7fb4f3833080 1 -- 172.21.15.55:0/2028013496 >> 172.21.15.55:0/2028013496 conn(0x55da8a6585a0 msgr2=0x55da8a65d280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:35.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.645+0000 7fb4f3833080 1 -- 172.21.15.55:0/2028013496 shutdown_connections 2024-04-02T07:32:35.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.645+0000 7fb4f3833080 1 -- 172.21.15.55:0/2028013496 wait complete. 2024-04-02T07:32:35.649 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-02T07:32:35.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.837+0000 7fa1bca00640 1 Processor -- start 2024-04-02T07:32:35.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.837+0000 7fa1bca00640 1 -- start start 2024-04-02T07:32:35.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.837+0000 7fa1bca00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa1b80ccfa0 0x7fa1b80702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.837+0000 7fa1bca00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1b80707e0 0x7fa1b80b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.837+0000 7fa1bca00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1b8070bf0 con 0x7fa1b81590d0 2024-04-02T07:32:35.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.837+0000 7fa1bca00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b80cd430 con 0x7fa1b80707e0 2024-04-02T07:32:35.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.837+0000 7fa1bca00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1b815d640 con 0x7fa1b80ccfa0 2024-04-02T07:32:35.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.837+0000 7fa1b6800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1b80707e0 0x7fa1b80b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.837+0000 7fa1b5e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa1b81590d0 0x7fa1b815cb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35816/0 (socket says 172.21.15.55:35816) 2024-04-02T07:32:35.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.837+0000 7fa1b5e00640 1 -- 172.21.15.55:0/4172644370 learned_addr learned my addr 172.21.15.55:0/4172644370 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:32:35.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.837+0000 7fa1afe00640 1 --2- 172.21.15.55:0/4172644370 >> v2:172.21.15.106:3300/0 conn(0x7fa1b80ccfa0 0x7fa1b80702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.841+0000 7fa1b6800640 1 -- 172.21.15.55:0/4172644370 >> v2:172.21.15.106:3300/0 conn(0x7fa1b80ccfa0 msgr2=0x7fa1b80702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:35.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.841+0000 7fa1b6800640 1 --2- 172.21.15.55:0/4172644370 >> v2:172.21.15.106:3300/0 conn(0x7fa1b80ccfa0 0x7fa1b80702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.841+0000 7fa1b6800640 1 -- 172.21.15.55:0/4172644370 >> v1:172.21.15.55:6789/0 conn(0x7fa1b81590d0 legacy=0x7fa1b815cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.841+0000 7fa1b6800640 1 -- 172.21.15.55:0/4172644370 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b815d920 con 0x7fa1b80707e0 2024-04-02T07:32:35.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.841+0000 7fa1b6800640 1 --2- 172.21.15.55:0/4172644370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b80707e0 0x7fa1b80b31f0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fa1b806abb0 tx=0x7fa1b001c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f65334a3c83585 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.841+0000 7fa1b5400640 1 -- 172.21.15.55:0/4172644370 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b00a58b0 con 0x7fa1b80707e0 2024-04-02T07:32:35.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.841+0000 7fa1b5400640 1 -- 172.21.15.55:0/4172644370 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1b00a5a10 con 0x7fa1b80707e0 2024-04-02T07:32:35.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.841+0000 7fa1b5400640 1 -- 172.21.15.55:0/4172644370 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1b00a5da0 con 0x7fa1b80707e0 2024-04-02T07:32:35.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.841+0000 7fa1bca00640 1 -- 172.21.15.55:0/4172644370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b80707e0 msgr2=0x7fa1b80b31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.841+0000 7fa1bca00640 1 --2- 172.21.15.55:0/4172644370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b80707e0 0x7fa1b80b31f0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7fa1b806abb0 tx=0x7fa1b001c870 comp rx=0 tx=0).stop 2024-04-02T07:32:35.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.841+0000 7fa1bca00640 1 -- 172.21.15.55:0/4172644370 shutdown_connections 2024-04-02T07:32:35.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.841+0000 7fa1bca00640 1 --2- 172.21.15.55:0/4172644370 >> v2:172.21.15.106:3300/0 conn(0x7fa1b80ccfa0 0x7fa1b80702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.841+0000 7fa1bca00640 1 --2- 172.21.15.55:0/4172644370 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b80707e0 0x7fa1b80b31f0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.841+0000 7fa1bca00640 1 -- 172.21.15.55:0/4172644370 >> 172.21.15.55:0/4172644370 conn(0x7fa1b806a390 msgr2=0x7fa1b80b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:35.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.841+0000 7fa1bca00640 1 -- 172.21.15.55:0/4172644370 shutdown_connections 2024-04-02T07:32:35.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.841+0000 7fa1bca00640 1 -- 172.21.15.55:0/4172644370 wait complete. 2024-04-02T07:32:35.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1bca00640 1 Processor -- start 2024-04-02T07:32:35.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1bca00640 1 -- start start 2024-04-02T07:32:35.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1bca00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b80707e0 0x7fa1b8155200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1bca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b80ccfa0 0x7fa1b80af2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1bca00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa1b81590d0 0x7fa1b80af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1bca00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b81616b0 con 0x7fa1b80ccfa0 2024-04-02T07:32:35.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1bca00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b8161990 con 0x7fa1b80707e0 2024-04-02T07:32:35.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1bca00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1b8161c70 con 0x7fa1b81590d0 2024-04-02T07:32:35.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1afe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b80ccfa0 0x7fa1b80af2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1afe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b80ccfa0 0x7fa1b80af2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48452/0 (socket says 172.21.15.55:48452) 2024-04-02T07:32:35.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1afe00640 1 -- 172.21.15.55:0/3289682039 learned_addr learned my addr 172.21.15.55:0/3289682039 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:35.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1b5e00640 1 --2- 172.21.15.55:0/3289682039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b80707e0 0x7fa1b8155200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1b6800640 1 --2- 172.21.15.55:0/3289682039 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa1b81590d0 0x7fa1b80af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1afe00640 1 -- 172.21.15.55:0/3289682039 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa1b81590d0 msgr2=0x7fa1b80af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1afe00640 1 --2- 172.21.15.55:0/3289682039 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa1b81590d0 0x7fa1b80af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1afe00640 1 -- 172.21.15.55:0/3289682039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b80707e0 msgr2=0x7fa1b8155200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:35.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1afe00640 1 --2- 172.21.15.55:0/3289682039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b80707e0 0x7fa1b8155200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:35.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1afe00640 1 -- 172.21.15.55:0/3289682039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1b0009a70 con 0x7fa1b80ccfa0 2024-04-02T07:32:35.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1afe00640 1 --2- 172.21.15.55:0/3289682039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b80ccfa0 0x7fa1b80af2f0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000d800 tx=0x7fa1a000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1ae000640 1 -- 172.21.15.55:0/3289682039 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a000b6c0 con 0x7fa1b80ccfa0 2024-04-02T07:32:35.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1ae000640 1 -- 172.21.15.55:0/3289682039 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1a000b820 con 0x7fa1b80ccfa0 2024-04-02T07:32:35.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1ae000640 1 -- 172.21.15.55:0/3289682039 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1a000bb90 con 0x7fa1b80ccfa0 2024-04-02T07:32:35.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1bca00640 1 -- 172.21.15.55:0/3289682039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1b80b1de0 con 0x7fa1b80ccfa0 2024-04-02T07:32:35.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.845+0000 7fa1bca00640 1 -- 172.21.15.55:0/3289682039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1b8162230 con 0x7fa1b80ccfa0 2024-04-02T07:32:35.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.849+0000 7fa1bca00640 1 -- 172.21.15.55:0/3289682039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1b8073530 con 0x7fa1b80ccfa0 2024-04-02T07:32:35.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.849+0000 7fa1ae000640 1 -- 172.21.15.55:0/3289682039 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa1a000bcf0 con 0x7fa1b80ccfa0 2024-04-02T07:32:35.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.849+0000 7fa1ae000640 1 --2- 172.21.15.55:0/3289682039 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa1940666c0 0x7fa194068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:35.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.849+0000 7fa1ae000640 1 -- 172.21.15.55:0/3289682039 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa1a0084680 con 0x7fa1b80ccfa0 2024-04-02T07:32:35.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.849+0000 7fa1b5e00640 1 --2- 172.21.15.55:0/3289682039 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa1940666c0 0x7fa194068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:35.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.849+0000 7fa1b5e00640 1 --2- 172.21.15.55:0/3289682039 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa1940666c0 0x7fa194068b80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8000f70 tx=0x7fa1a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:35.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:35.853+0000 7fa1ae000640 1 -- 172.21.15.55:0/3289682039 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa1a00519a0 con 0x7fa1b80ccfa0 2024-04-02T07:32:36.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.045+0000 7fa1bca00640 1 -- 172.21.15.55:0/3289682039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fa1b81623c0 con 0x7fa1b80ccfa0 2024-04-02T07:32:36.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.409+0000 7fa1ae000640 1 -- 172.21.15.55:0/3289682039 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v83) v1 ==== 162+0+0 (secure 0 0 0) 0x7fa1a0054fc0 con 0x7fa1b80ccfa0 2024-04-02T07:32:36.411 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-02T07:32:36.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.413+0000 7fa1bca00640 1 -- 172.21.15.55:0/3289682039 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa1940666c0 msgr2=0x7fa194068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:36.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.413+0000 7fa1bca00640 1 --2- 172.21.15.55:0/3289682039 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa1940666c0 0x7fa194068b80 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fa1a8000f70 tx=0x7fa1a8009040 comp rx=0 tx=0).stop 2024-04-02T07:32:36.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.413+0000 7fa1bca00640 1 -- 172.21.15.55:0/3289682039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b80ccfa0 msgr2=0x7fa1b80af2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:36.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.413+0000 7fa1bca00640 1 --2- 172.21.15.55:0/3289682039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b80ccfa0 0x7fa1b80af2f0 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fa1a000d800 tx=0x7fa1a000dcc0 comp rx=0 tx=0).stop 2024-04-02T07:32:36.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.413+0000 7fa1bca00640 1 -- 172.21.15.55:0/3289682039 shutdown_connections 2024-04-02T07:32:36.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.413+0000 7fa1bca00640 1 --2- 172.21.15.55:0/3289682039 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa1b81590d0 0x7fa1b80af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:36.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.413+0000 7fa1bca00640 1 --2- 172.21.15.55:0/3289682039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1b80ccfa0 0x7fa1b80af2f0 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:36.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.413+0000 7fa1bca00640 1 --2- 172.21.15.55:0/3289682039 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa1940666c0 0x7fa194068b80 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:36.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.413+0000 7fa1bca00640 1 --2- 172.21.15.55:0/3289682039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa1b80707e0 0x7fa1b8155200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:36.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.413+0000 7fa1bca00640 1 -- 172.21.15.55:0/3289682039 >> 172.21.15.55:0/3289682039 conn(0x7fa1b806a390 msgr2=0x7fa1b80ca860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:36.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.413+0000 7fa1bca00640 1 -- 172.21.15.55:0/3289682039 shutdown_connections 2024-04-02T07:32:36.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.413+0000 7fa1bca00640 1 -- 172.21.15.55:0/3289682039 wait complete. 2024-04-02T07:32:36.438 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:32:36.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.581+0000 7f99a7400640 1 Processor -- start 2024-04-02T07:32:36.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.581+0000 7f99a7400640 1 -- start start 2024-04-02T07:32:36.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.581+0000 7f99a7400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99a015ee70 0x7f99a0099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:36.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.581+0000 7f99a7400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f99a015f250 0x7f99a00b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.581+0000 7f99a7400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a00cf6a0 con 0x7f99a0098a10 2024-04-02T07:32:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.581+0000 7f99a7400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a00b0840 con 0x7f99a015f250 2024-04-02T07:32:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.581+0000 7f99a7400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a00ad270 con 0x7f99a015ee70 2024-04-02T07:32:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.581+0000 7f999fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f99a015f250 0x7f99a00b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.581+0000 7f999fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f99a015f250 0x7f99a00b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48468/0 (socket says 172.21.15.55:48468) 2024-04-02T07:32:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.581+0000 7f999fe00640 1 -- 172.21.15.55:0/3845106124 learned_addr learned my addr 172.21.15.55:0/3845106124 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.581+0000 7f99a4a00640 1 --2- 172.21.15.55:0/3845106124 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99a015ee70 0x7f99a0099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.581+0000 7f999fe00640 1 -- 172.21.15.55:0/3845106124 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99a015ee70 msgr2=0x7f99a0099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.581+0000 7f999fe00640 1 --2- 172.21.15.55:0/3845106124 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99a015ee70 0x7f99a0099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.581+0000 7f999fe00640 1 -- 172.21.15.55:0/3845106124 >> v1:172.21.15.106:6789/0 conn(0x7f99a0098a10 legacy=0x7f99a00cb2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:36.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.581+0000 7f999fe00640 1 -- 172.21.15.55:0/3845106124 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a00b0a50 con 0x7f99a015f250 2024-04-02T07:32:36.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.585+0000 7f999fe00640 1 --2- 172.21.15.55:0/3845106124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99a015f250 0x7f99a00b12f0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f998c009870 tx=0x7f998c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac7a07d74d4c0741 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.585+0000 7f999f400640 1 -- 172.21.15.55:0/3845106124 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c0a9620 con 0x7f99a015f250 2024-04-02T07:32:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.585+0000 7f999f400640 1 -- 172.21.15.55:0/3845106124 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998c0a9780 con 0x7f99a015f250 2024-04-02T07:32:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.585+0000 7f999f400640 1 -- 172.21.15.55:0/3845106124 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c0a9b10 con 0x7f99a015f250 2024-04-02T07:32:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.585+0000 7f99a7400640 1 -- 172.21.15.55:0/3845106124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99a015f250 msgr2=0x7f99a00b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.585+0000 7f99a7400640 1 --2- 172.21.15.55:0/3845106124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99a015f250 0x7f99a00b12f0 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f998c009870 tx=0x7f998c01c560 comp rx=0 tx=0).stop 2024-04-02T07:32:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.585+0000 7f99a7400640 1 -- 172.21.15.55:0/3845106124 shutdown_connections 2024-04-02T07:32:36.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.585+0000 7f99a7400640 1 --2- 172.21.15.55:0/3845106124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99a015f250 0x7f99a00b12f0 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.585+0000 7f99a7400640 1 --2- 172.21.15.55:0/3845106124 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99a015ee70 0x7f99a0099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.585+0000 7f99a7400640 1 -- 172.21.15.55:0/3845106124 >> 172.21.15.55:0/3845106124 conn(0x7f99a00b21d0 msgr2=0x7f99a00b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.585+0000 7f99a7400640 1 -- 172.21.15.55:0/3845106124 shutdown_connections 2024-04-02T07:32:36.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.585+0000 7f99a7400640 1 -- 172.21.15.55:0/3845106124 wait complete. 2024-04-02T07:32:36.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.585+0000 7f99a7400640 1 Processor -- start 2024-04-02T07:32:36.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.585+0000 7f99a7400640 1 -- start start 2024-04-02T07:32:36.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f99a7400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99a0098a10 0x7f99a0152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:36.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f99a7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99a015ee70 0x7f99a0156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:36.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f99a7400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99a015f250 0x7f99a015b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f99a7400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a0153480 con 0x7f99a015ee70 2024-04-02T07:32:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f99a7400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a0157800 con 0x7f99a0098a10 2024-04-02T07:32:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f99a7400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a0157ae0 con 0x7f99a015f250 2024-04-02T07:32:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f999fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99a015ee70 0x7f99a0156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f999fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99a015ee70 0x7f99a0156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48482/0 (socket says 172.21.15.55:48482) 2024-04-02T07:32:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f999fe00640 1 -- 172.21.15.55:0/3600673162 learned_addr learned my addr 172.21.15.55:0/3600673162 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f99a4a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99a0098a10 0x7f99a0152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f99a5400640 1 --2- 172.21.15.55:0/3600673162 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99a015f250 0x7f99a015b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f999fe00640 1 -- 172.21.15.55:0/3600673162 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99a015f250 msgr2=0x7f99a015b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f999fe00640 1 --2- 172.21.15.55:0/3600673162 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99a015f250 0x7f99a015b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f999fe00640 1 -- 172.21.15.55:0/3600673162 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99a0098a10 msgr2=0x7f99a0152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f999fe00640 1 --2- 172.21.15.55:0/3600673162 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99a0098a10 0x7f99a0152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:36.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f999fe00640 1 -- 172.21.15.55:0/3600673162 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f998c0094d0 con 0x7f99a015ee70 2024-04-02T07:32:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f999fe00640 1 --2- 172.21.15.55:0/3600673162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99a015ee70 0x7f99a0156d40 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f998c0ab040 tx=0x7f998c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f999cc00640 1 -- 172.21.15.55:0/3600673162 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c0bc450 con 0x7f99a015ee70 2024-04-02T07:32:36.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f999cc00640 1 -- 172.21.15.55:0/3600673162 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998c0bc5b0 con 0x7f99a015ee70 2024-04-02T07:32:36.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f999cc00640 1 -- 172.21.15.55:0/3600673162 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998c0bc960 con 0x7f99a015ee70 2024-04-02T07:32:36.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f99a7400640 1 -- 172.21.15.55:0/3600673162 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a00993b0 con 0x7f99a015ee70 2024-04-02T07:32:36.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f99a7400640 1 -- 172.21.15.55:0/3600673162 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a01580a0 con 0x7f99a015ee70 2024-04-02T07:32:36.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.589+0000 7f99a7400640 1 -- 172.21.15.55:0/3600673162 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a0066c90 con 0x7f99a015ee70 2024-04-02T07:32:36.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.593+0000 7f999cc00640 1 -- 172.21.15.55:0/3600673162 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f998c0bcac0 con 0x7f99a015ee70 2024-04-02T07:32:36.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.593+0000 7f999cc00640 1 --2- 172.21.15.55:0/3600673162 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9980066690 0x7f9980068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:36.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.593+0000 7f999cc00640 1 -- 172.21.15.55:0/3600673162 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f998c11e6f0 con 0x7f99a015ee70 2024-04-02T07:32:36.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.593+0000 7f99a4a00640 1 --2- 172.21.15.55:0/3600673162 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9980066690 0x7f9980068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:36.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.593+0000 7f99a4a00640 1 --2- 172.21.15.55:0/3600673162 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9980066690 0x7f9980068b50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9994007a60 tx=0x7f9994008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:36.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.597+0000 7f999cc00640 1 -- 172.21.15.55:0/3600673162 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f998c0ebb10 con 0x7f99a015ee70 2024-04-02T07:32:36.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.793+0000 7f99a7400640 1 -- 172.21.15.55:0/3600673162 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99a006ce90 con 0x7f99a015ee70 2024-04-02T07:32:36.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.793+0000 7f999cc00640 1 -- 172.21.15.55:0/3600673162 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) v1 ==== 94+0+4738 (secure 0 0 0) 0x7f998c0ef130 con 0x7f99a015ee70 2024-04-02T07:32:36.794 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:32:36.794 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":84,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2707651793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2707651793},{"type":"v1","addr":"172.21.15.106:6836","nonce":2707651793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2234384639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2234384639},{"type":"v1","addr":"172.21.15.106:6837","nonce":2234384639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":8433,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53259218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53259218},{"type":"v1","addr":"172.21.15.55:6833","nonce":53259218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:31:30.704183+0000","modified":"2024-04-02T07:32:36.414770+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8868":{"gid":8868,"name":"a","rank":0,"incarnation":84,"state":"up:replay","state_seq":1,"addr":"172.21.15.55:6835/1137835746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1137835746},{"type":"v1","addr":"172.21.15.55:6835","nonce":1137835746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-02T07:32:36.794 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 84 2024-04-02T07:32:36.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.793+0000 7f99a7400640 1 -- 172.21.15.55:0/3600673162 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9980066690 msgr2=0x7f9980068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:36.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.793+0000 7f99a7400640 1 --2- 172.21.15.55:0/3600673162 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9980066690 0x7f9980068b50 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f9994007a60 tx=0x7f9994008040 comp rx=0 tx=0).stop 2024-04-02T07:32:36.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.793+0000 7f99a7400640 1 -- 172.21.15.55:0/3600673162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99a015ee70 msgr2=0x7f99a0156d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:36.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.793+0000 7f99a7400640 1 --2- 172.21.15.55:0/3600673162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99a015ee70 0x7f99a0156d40 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f998c0ab040 tx=0x7f998c01ada0 comp rx=0 tx=0).stop 2024-04-02T07:32:36.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.793+0000 7f99a7400640 1 -- 172.21.15.55:0/3600673162 shutdown_connections 2024-04-02T07:32:36.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.793+0000 7f99a7400640 1 --2- 172.21.15.55:0/3600673162 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f99a015f250 0x7f99a015b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:36.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.793+0000 7f99a7400640 1 --2- 172.21.15.55:0/3600673162 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f99a015ee70 0x7f99a0156d40 unknown :-1 s=CLOSED pgs=1577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:36.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.793+0000 7f99a7400640 1 --2- 172.21.15.55:0/3600673162 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9980066690 0x7f9980068b50 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:36.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.793+0000 7f99a7400640 1 --2- 172.21.15.55:0/3600673162 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f99a0098a10 0x7f99a0152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:36.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.793+0000 7f99a7400640 1 -- 172.21.15.55:0/3600673162 >> 172.21.15.55:0/3600673162 conn(0x7f99a00b21d0 msgr2=0x7f99a006ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:36.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.793+0000 7f99a7400640 1 -- 172.21.15.55:0/3600673162 shutdown_connections 2024-04-02T07:32:36.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:36.793+0000 7f99a7400640 1 -- 172.21.15.55:0/3600673162 wait complete. 2024-04-02T07:32:37.217 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:31:30.704183+0000', 'modified': '2024-04-02T07:32:36.414770+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 104, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8868}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8868': {'gid': 8868, 'name': 'a', 'rank': 0, 'incarnation': 84, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.55:6835/1137835746', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6834', 'nonce': 1137835746}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 1137835746}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:32:37.217 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8868:up:replay 2024-04-02T07:32:38.218 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:32:38.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.369+0000 7f708f200640 1 Processor -- start 2024-04-02T07:32:38.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.369+0000 7f708f200640 1 -- start start 2024-04-02T07:32:38.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.369+0000 7f708f200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f709015cb60 0x7f70900ae630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:38.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.369+0000 7f708f200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f70900aef60 0x7f70900b02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:38.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.369+0000 7f708f200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70900b07e0 0x7f7090069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:38.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.369+0000 7f708f200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70900ac2e0 con 0x7f70900aef60 2024-04-02T07:32:38.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.369+0000 7f708f200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70900b0c30 con 0x7f709015cb60 2024-04-02T07:32:38.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.369+0000 7f708f200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70900af460 con 0x7f70900b07e0 2024-04-02T07:32:38.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.369+0000 7f7085400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f70900aef60 0x7f70900b02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:38.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.369+0000 7f7085400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f70900aef60 0x7f70900b02a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48494/0 (socket says 172.21.15.55:48494) 2024-04-02T07:32:38.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.369+0000 7f7085400640 1 -- 172.21.15.55:0/1101157813 learned_addr learned my addr 172.21.15.55:0/1101157813 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:38.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.369+0000 7f708de00640 1 --2- 172.21.15.55:0/1101157813 >> v2:172.21.15.106:3300/0 conn(0x7f709015cb60 0x7f70900ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:38.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.369+0000 7f708e800640 1 --2- 172.21.15.55:0/1101157813 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70900b07e0 0x7f7090069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:38.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.373+0000 7f7085400640 1 -- 172.21.15.55:0/1101157813 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70900b07e0 msgr2=0x7f7090069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:38.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.373+0000 7f7085400640 1 --2- 172.21.15.55:0/1101157813 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70900b07e0 0x7f7090069d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:38.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.373+0000 7f7085400640 1 -- 172.21.15.55:0/1101157813 >> v2:172.21.15.106:3300/0 conn(0x7f709015cb60 msgr2=0x7f70900ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:38.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.373+0000 7f7085400640 1 --2- 172.21.15.55:0/1101157813 >> v2:172.21.15.106:3300/0 conn(0x7f709015cb60 0x7f70900ae630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:38.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.373+0000 7f7085400640 1 -- 172.21.15.55:0/1101157813 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70900af740 con 0x7f70900aef60 2024-04-02T07:32:38.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.373+0000 7f7085400640 1 --2- 172.21.15.55:0/1101157813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70900aef60 0x7f70900b02a0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f70900cf580 tx=0x7f707801c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd344150eea7a14 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:38.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.373+0000 7f708d400640 1 -- 172.21.15.55:0/1101157813 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70780ab600 con 0x7f70900aef60 2024-04-02T07:32:38.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.373+0000 7f708d400640 1 -- 172.21.15.55:0/1101157813 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70780a7050 con 0x7f70900aef60 2024-04-02T07:32:38.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.373+0000 7f708d400640 1 -- 172.21.15.55:0/1101157813 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70780ab980 con 0x7f70900aef60 2024-04-02T07:32:38.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708f200640 1 -- 172.21.15.55:0/1101157813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70900aef60 msgr2=0x7f70900b02a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:38.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708f200640 1 --2- 172.21.15.55:0/1101157813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70900aef60 0x7f70900b02a0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f70900cf580 tx=0x7f707801c230 comp rx=0 tx=0).stop 2024-04-02T07:32:38.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708f200640 1 -- 172.21.15.55:0/1101157813 shutdown_connections 2024-04-02T07:32:38.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708f200640 1 --2- 172.21.15.55:0/1101157813 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f70900b07e0 0x7f7090069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:38.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708f200640 1 --2- 172.21.15.55:0/1101157813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70900aef60 0x7f70900b02a0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:38.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708f200640 1 --2- 172.21.15.55:0/1101157813 >> v2:172.21.15.106:3300/0 conn(0x7f709015cb60 0x7f70900ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:38.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708f200640 1 -- 172.21.15.55:0/1101157813 >> 172.21.15.55:0/1101157813 conn(0x7f7090098a10 msgr2=0x7f70900cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:38.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708f200640 1 -- 172.21.15.55:0/1101157813 shutdown_connections 2024-04-02T07:32:38.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708f200640 1 -- 172.21.15.55:0/1101157813 wait complete. 2024-04-02T07:32:38.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708f200640 1 Processor -- start 2024-04-02T07:32:38.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708f200640 1 -- start start 2024-04-02T07:32:38.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708f200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70900aef60 0x7f7090155830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:38.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708f200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70900b07e0 0x7f709015f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:38.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708f200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f709015cb60 0x7f709015f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:38.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708f200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709015b5a0 con 0x7f70900aef60 2024-04-02T07:32:38.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708f200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709015a990 con 0x7f70900b07e0 2024-04-02T07:32:38.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708f200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709015ac70 con 0x7f709015cb60 2024-04-02T07:32:38.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70900aef60 0x7f7090155830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:38.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70900aef60 0x7f7090155830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48508/0 (socket says 172.21.15.55:48508) 2024-04-02T07:32:38.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708de00640 1 -- 172.21.15.55:0/3271454958 learned_addr learned my addr 172.21.15.55:0/3271454958 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:38.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708e800640 1 --2- 172.21.15.55:0/3271454958 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f709015cb60 0x7f709015f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:38.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f7085400640 1 --2- 172.21.15.55:0/3271454958 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70900b07e0 0x7f709015f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:38.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708de00640 1 -- 172.21.15.55:0/3271454958 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f709015cb60 msgr2=0x7f709015f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:38.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708de00640 1 --2- 172.21.15.55:0/3271454958 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f709015cb60 0x7f709015f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:38.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708de00640 1 -- 172.21.15.55:0/3271454958 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70900b07e0 msgr2=0x7f709015f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:38.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708de00640 1 --2- 172.21.15.55:0/3271454958 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70900b07e0 0x7f709015f110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:38.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708de00640 1 -- 172.21.15.55:0/3271454958 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70780094d0 con 0x7f70900aef60 2024-04-02T07:32:38.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.377+0000 7f708e800640 1 --2- 172.21.15.55:0/3271454958 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f709015cb60 0x7f709015f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:32:38.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.381+0000 7f708de00640 1 --2- 172.21.15.55:0/3271454958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70900aef60 0x7f7090155830 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f708000e870 tx=0x7f708000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:38.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.381+0000 7f7086a00640 1 -- 172.21.15.55:0/3271454958 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7080009510 con 0x7f70900aef60 2024-04-02T07:32:38.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.381+0000 7f7086a00640 1 -- 172.21.15.55:0/3271454958 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708000eec0 con 0x7f70900aef60 2024-04-02T07:32:38.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.381+0000 7f7086a00640 1 -- 172.21.15.55:0/3271454958 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708000cb40 con 0x7f70900aef60 2024-04-02T07:32:38.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.381+0000 7f708f200640 1 -- 172.21.15.55:0/3271454958 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709015af50 con 0x7f70900aef60 2024-04-02T07:32:38.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.381+0000 7f708f200640 1 -- 172.21.15.55:0/3271454958 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709015a620 con 0x7f70900aef60 2024-04-02T07:32:38.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.381+0000 7f708f200640 1 -- 172.21.15.55:0/3271454958 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7090073fa0 con 0x7f70900aef60 2024-04-02T07:32:38.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.381+0000 7f7086a00640 1 -- 172.21.15.55:0/3271454958 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f708000cca0 con 0x7f70900aef60 2024-04-02T07:32:38.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.381+0000 7f7086a00640 1 --2- 172.21.15.55:0/3271454958 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f706c066690 0x7f706c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:38.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.381+0000 7f7086a00640 1 -- 172.21.15.55:0/3271454958 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f70800842e0 con 0x7f70900aef60 2024-04-02T07:32:38.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.381+0000 7f7085400640 1 --2- 172.21.15.55:0/3271454958 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f706c066690 0x7f706c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:38.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.385+0000 7f7085400640 1 --2- 172.21.15.55:0/3271454958 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f706c066690 0x7f706c068b50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f70780ad000 tx=0x7f70780a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:38.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.385+0000 7f7086a00640 1 -- 172.21.15.55:0/3271454958 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7080051600 con 0x7f70900aef60 2024-04-02T07:32:38.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.585+0000 7f708f200640 1 -- 172.21.15.55:0/3271454958 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70900ce760 con 0x7f70900aef60 2024-04-02T07:32:38.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.585+0000 7f7086a00640 1 -- 172.21.15.55:0/3271454958 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 86 v86) v1 ==== 94+0+4738 (secure 0 0 0) 0x7f7080054c20 con 0x7f70900aef60 2024-04-02T07:32:38.586 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:32:38.586 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":86,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2707651793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2707651793},{"type":"v1","addr":"172.21.15.106:6836","nonce":2707651793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2234384639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2234384639},{"type":"v1","addr":"172.21.15.106:6837","nonce":2234384639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":8433,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53259218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53259218},{"type":"v1","addr":"172.21.15.55:6833","nonce":53259218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":86,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:31:30.704183+0000","modified":"2024-04-02T07:32:38.423003+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8868":{"gid":8868,"name":"a","rank":0,"incarnation":84,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.55:6835/1137835746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1137835746},{"type":"v1","addr":"172.21.15.55:6835","nonce":1137835746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-02T07:32:38.587 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 86 2024-04-02T07:32:38.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.585+0000 7f708f200640 1 -- 172.21.15.55:0/3271454958 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f706c066690 msgr2=0x7f706c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:38.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.585+0000 7f708f200640 1 --2- 172.21.15.55:0/3271454958 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f706c066690 0x7f706c068b50 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f70780ad000 tx=0x7f70780a6000 comp rx=0 tx=0).stop 2024-04-02T07:32:38.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.585+0000 7f708f200640 1 -- 172.21.15.55:0/3271454958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70900aef60 msgr2=0x7f7090155830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:38.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.585+0000 7f708f200640 1 --2- 172.21.15.55:0/3271454958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70900aef60 0x7f7090155830 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f708000e870 tx=0x7f708000ec70 comp rx=0 tx=0).stop 2024-04-02T07:32:38.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.585+0000 7f708f200640 1 -- 172.21.15.55:0/3271454958 shutdown_connections 2024-04-02T07:32:38.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.585+0000 7f708f200640 1 --2- 172.21.15.55:0/3271454958 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f709015cb60 0x7f709015f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:38.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.585+0000 7f708f200640 1 --2- 172.21.15.55:0/3271454958 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f706c066690 0x7f706c068b50 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:38.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.585+0000 7f708f200640 1 --2- 172.21.15.55:0/3271454958 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f70900b07e0 0x7f709015f110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:38.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.585+0000 7f708f200640 1 --2- 172.21.15.55:0/3271454958 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f70900aef60 0x7f7090155830 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:38.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.585+0000 7f708f200640 1 -- 172.21.15.55:0/3271454958 >> 172.21.15.55:0/3271454958 conn(0x7f7090098a10 msgr2=0x7f70900acca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:38.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.589+0000 7f708f200640 1 -- 172.21.15.55:0/3271454958 shutdown_connections 2024-04-02T07:32:38.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:38.589+0000 7f708f200640 1 -- 172.21.15.55:0/3271454958 wait complete. 2024-04-02T07:32:39.010 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 86, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:31:30.704183+0000', 'modified': '2024-04-02T07:32:38.423003+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 104, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8868}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8868': {'gid': 8868, 'name': 'a', 'rank': 0, 'incarnation': 84, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.55:6835/1137835746', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6834', 'nonce': 1137835746}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 1137835746}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:32:39.010 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_8868:up:rejoin 2024-04-02T07:32:40.011 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:32:40.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.161+0000 7fec06800640 1 Processor -- start 2024-04-02T07:32:40.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.161+0000 7fec06800640 1 -- start start 2024-04-02T07:32:40.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.165+0000 7fec06800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec00143f90 0x7fec0015ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.165+0000 7fec06800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fec000cda80 0x7fec000c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.165+0000 7fec06800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec0015b270 con 0x7fec000b34f0 2024-04-02T07:32:40.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.165+0000 7fec06800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec00144370 con 0x7fec000cda80 2024-04-02T07:32:40.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.165+0000 7fec06800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec000c37b0 con 0x7fec00143f90 2024-04-02T07:32:40.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.165+0000 7febffe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fec000cda80 0x7fec000c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.165+0000 7febff400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec00143f90 0x7fec0015ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.165+0000 7febffe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fec000cda80 0x7fec000c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:39730/0 (socket says 172.21.15.55:39730) 2024-04-02T07:32:40.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.165+0000 7febffe00640 1 -- 172.21.15.55:0/3780703357 learned_addr learned my addr 172.21.15.55:0/3780703357 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:40.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.165+0000 7febf6a00640 1 --1- 172.21.15.55:0/3780703357 >> v1:172.21.15.106:6789/0 conn(0x7fec000b34f0 0x7fec000cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:42626/0 (socket says 172.21.15.55:42626) 2024-04-02T07:32:40.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.165+0000 7febffe00640 1 -- 172.21.15.55:0/3780703357 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec00143f90 msgr2=0x7fec0015ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:40.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.165+0000 7febffe00640 1 --2- 172.21.15.55:0/3780703357 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec00143f90 0x7fec0015ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.165+0000 7febffe00640 1 -- 172.21.15.55:0/3780703357 >> v1:172.21.15.106:6789/0 conn(0x7fec000b34f0 legacy=0x7fec000cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:40.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.165+0000 7febffe00640 1 -- 172.21.15.55:0/3780703357 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec000c3a90 con 0x7fec000cda80 2024-04-02T07:32:40.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.165+0000 7febff400640 1 --2- 172.21.15.55:0/3780703357 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec00143f90 0x7fec0015ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:32:40.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.165+0000 7febfea00640 1 -- 172.21.15.55:0/3780703357 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1480698746 0 0) 0x7fec0015b270 con 0x7fec000b34f0 2024-04-02T07:32:40.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.169+0000 7febffe00640 1 --2- 172.21.15.55:0/3780703357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec000cda80 0x7fec000c4850 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7febf8009870 tx=0x7febf801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e4ae54af4fe062e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:40.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.169+0000 7febfea00640 1 -- 172.21.15.55:0/3780703357 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf80a6040 con 0x7fec000cda80 2024-04-02T07:32:40.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.169+0000 7febfea00640 1 -- 172.21.15.55:0/3780703357 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf80aa600 con 0x7fec000cda80 2024-04-02T07:32:40.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.169+0000 7febfea00640 1 -- 172.21.15.55:0/3780703357 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf80aa990 con 0x7fec000cda80 2024-04-02T07:32:40.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.169+0000 7fec06800640 1 -- 172.21.15.55:0/3780703357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec000cda80 msgr2=0x7fec000c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:40.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.169+0000 7fec06800640 1 --2- 172.21.15.55:0/3780703357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec000cda80 0x7fec000c4850 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7febf8009870 tx=0x7febf801c4a0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.169+0000 7fec06800640 1 -- 172.21.15.55:0/3780703357 shutdown_connections 2024-04-02T07:32:40.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.169+0000 7fec06800640 1 --2- 172.21.15.55:0/3780703357 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec000cda80 0x7fec000c4850 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.169+0000 7fec06800640 1 --2- 172.21.15.55:0/3780703357 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec00143f90 0x7fec0015ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.169+0000 7fec06800640 1 -- 172.21.15.55:0/3780703357 >> 172.21.15.55:0/3780703357 conn(0x7fec00066080 msgr2=0x7fec00069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:40.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.169+0000 7fec06800640 1 -- 172.21.15.55:0/3780703357 shutdown_connections 2024-04-02T07:32:40.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.169+0000 7fec06800640 1 -- 172.21.15.55:0/3780703357 wait complete. 2024-04-02T07:32:40.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.169+0000 7fec06800640 1 Processor -- start 2024-04-02T07:32:40.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.169+0000 7fec06800640 1 -- start start 2024-04-02T07:32:40.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7fec06800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec000b34f0 0x7fec000ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7fec06800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec000cda80 0x7fec000cd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7fec06800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec00143f90 0x7fec000c8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7fec06800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec000cd760 con 0x7fec000b34f0 2024-04-02T07:32:40.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7fec06800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec000ca130 con 0x7fec000cda80 2024-04-02T07:32:40.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7fec06800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec000c9520 con 0x7fec00143f90 2024-04-02T07:32:40.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7febff400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec000b34f0 0x7fec000ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7febff400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec000b34f0 0x7fec000ca5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48512/0 (socket says 172.21.15.55:48512) 2024-04-02T07:32:40.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7febff400640 1 -- 172.21.15.55:0/2410689704 learned_addr learned my addr 172.21.15.55:0/2410689704 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:40.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7febf6a00640 1 --2- 172.21.15.55:0/2410689704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec000cda80 0x7fec000cd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7febffe00640 1 --2- 172.21.15.55:0/2410689704 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec00143f90 0x7fec000c8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7febff400640 1 -- 172.21.15.55:0/2410689704 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec00143f90 msgr2=0x7fec000c8b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:40.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7febff400640 1 --2- 172.21.15.55:0/2410689704 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec00143f90 0x7fec000c8b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7febff400640 1 -- 172.21.15.55:0/2410689704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec000cda80 msgr2=0x7fec000cd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:40.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7febff400640 1 --2- 172.21.15.55:0/2410689704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec000cda80 0x7fec000cd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7febff400640 1 -- 172.21.15.55:0/2410689704 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febf0009a70 con 0x7fec000b34f0 2024-04-02T07:32:40.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7febff400640 1 --2- 172.21.15.55:0/2410689704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec000b34f0 0x7fec000ca5c0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7febf000efc0 tx=0x7febf000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:40.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7febf7e00640 1 -- 172.21.15.55:0/2410689704 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf0014680 con 0x7fec000b34f0 2024-04-02T07:32:40.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7febf7e00640 1 -- 172.21.15.55:0/2410689704 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febf000f040 con 0x7fec000b34f0 2024-04-02T07:32:40.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7febf7e00640 1 -- 172.21.15.55:0/2410689704 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febf0014a00 con 0x7fec000b34f0 2024-04-02T07:32:40.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7fec06800640 1 -- 172.21.15.55:0/2410689704 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febf80094d0 con 0x7fec000b34f0 2024-04-02T07:32:40.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7fec06800640 1 -- 172.21.15.55:0/2410689704 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec000c9ae0 con 0x7fec000b34f0 2024-04-02T07:32:40.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7fec06800640 1 -- 172.21.15.55:0/2410689704 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec00066c90 con 0x7fec000b34f0 2024-04-02T07:32:40.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.173+0000 7febf7e00640 1 -- 172.21.15.55:0/2410689704 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7febf0014b60 con 0x7fec000b34f0 2024-04-02T07:32:40.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.177+0000 7febf7e00640 1 --2- 172.21.15.55:0/2410689704 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7febdc0666c0 0x7febdc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.177+0000 7febf7e00640 1 -- 172.21.15.55:0/2410689704 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x7febf00850e0 con 0x7fec000b34f0 2024-04-02T07:32:40.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.177+0000 7febf6a00640 1 --2- 172.21.15.55:0/2410689704 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7febdc0666c0 0x7febdc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.177+0000 7febf6a00640 1 --2- 172.21.15.55:0/2410689704 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7febdc0666c0 0x7febdc068b80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fec001308a0 tx=0x7febe8007d60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:40.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.181+0000 7febf7e00640 1 -- 172.21.15.55:0/2410689704 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7febf0052370 con 0x7fec000b34f0 2024-04-02T07:32:40.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.373+0000 7fec06800640 1 -- 172.21.15.55:0/2410689704 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec000b2880 con 0x7fec000b34f0 2024-04-02T07:32:40.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.373+0000 7febf7e00640 1 -- 172.21.15.55:0/2410689704 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+4738 (secure 0 0 0) 0x7febf0055990 con 0x7fec000b34f0 2024-04-02T07:32:40.378 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:32:40.378 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":87,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2707651793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2707651793},{"type":"v1","addr":"172.21.15.106:6836","nonce":2707651793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2234384639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2234384639},{"type":"v1","addr":"172.21.15.106:6837","nonce":2234384639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":8433,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53259218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53259218},{"type":"v1","addr":"172.21.15.55:6833","nonce":53259218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":87,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:31:30.704183+0000","modified":"2024-04-02T07:32:39.433060+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":104,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8868},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8868":{"gid":8868,"name":"a","rank":0,"incarnation":84,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6835/1137835746","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":1137835746},{"type":"v1","addr":"172.21.15.55:6835","nonce":1137835746}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-02T07:32:40.379 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 87 2024-04-02T07:32:40.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.377+0000 7fec06800640 1 -- 172.21.15.55:0/2410689704 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7febdc0666c0 msgr2=0x7febdc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:40.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.377+0000 7fec06800640 1 --2- 172.21.15.55:0/2410689704 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7febdc0666c0 0x7febdc068b80 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7fec001308a0 tx=0x7febe8007d60 comp rx=0 tx=0).stop 2024-04-02T07:32:40.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.377+0000 7fec06800640 1 -- 172.21.15.55:0/2410689704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec000b34f0 msgr2=0x7fec000ca5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:40.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.377+0000 7fec06800640 1 --2- 172.21.15.55:0/2410689704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec000b34f0 0x7fec000ca5c0 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7febf000efc0 tx=0x7febf000c490 comp rx=0 tx=0).stop 2024-04-02T07:32:40.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.377+0000 7fec06800640 1 -- 172.21.15.55:0/2410689704 shutdown_connections 2024-04-02T07:32:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.377+0000 7fec06800640 1 --2- 172.21.15.55:0/2410689704 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec00143f90 0x7fec000c8b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.377+0000 7fec06800640 1 --2- 172.21.15.55:0/2410689704 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7febdc0666c0 0x7febdc068b80 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.377+0000 7fec06800640 1 --2- 172.21.15.55:0/2410689704 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec000cda80 0x7fec000cd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.377+0000 7fec06800640 1 --2- 172.21.15.55:0/2410689704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec000b34f0 0x7fec000ca5c0 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.377+0000 7fec06800640 1 -- 172.21.15.55:0/2410689704 >> 172.21.15.55:0/2410689704 conn(0x7fec00066080 msgr2=0x7fec00163890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.377+0000 7fec06800640 1 -- 172.21.15.55:0/2410689704 shutdown_connections 2024-04-02T07:32:40.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.377+0000 7fec06800640 1 -- 172.21.15.55:0/2410689704 wait complete. 2024-04-02T07:32:40.799 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 87, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:31:30.704183+0000', 'modified': '2024-04-02T07:32:39.433060+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 104, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8868}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8868': {'gid': 8868, 'name': 'a', 'rank': 0, 'incarnation': 84, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.55:6835/1137835746', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6834', 'nonce': 1137835746}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 1137835746}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:32:40.799 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-02T07:32:40.800 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-02T07:32:40.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.941+0000 7f5e23200640 1 Processor -- start 2024-04-02T07:32:40.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.941+0000 7f5e23200640 1 -- start start 2024-04-02T07:32:40.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.945+0000 7f5e23200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e241580a0 0x7f5e240cdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.945+0000 7f5e23200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e2415bb20 con 0x7f5e2415b700 2024-04-02T07:32:40.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.945+0000 7f5e23200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e240cb940 con 0x7f5e240afff0 2024-04-02T07:32:40.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.945+0000 7f5e23200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e240cbc20 con 0x7f5e241580a0 2024-04-02T07:32:40.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.945+0000 7f5e19400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5e2415b700 0x7f5e240cb130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35820/0 (socket says 172.21.15.55:35820) 2024-04-02T07:32:40.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.945+0000 7f5e19400640 1 -- 172.21.15.55:0/1010092048 learned_addr learned my addr 172.21.15.55:0/1010092048 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:32:40.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.945+0000 7f5e21e00640 1 --2- 172.21.15.55:0/1010092048 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e241580a0 0x7f5e240cdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.945+0000 7f5e21400640 1 -- 172.21.15.55:0/1010092048 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3137389857 0 0) 0x7f5e2415bb20 con 0x7f5e2415b700 2024-04-02T07:32:40.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.945+0000 7f5e21400640 1 -- 172.21.15.55:0/1010092048 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e08003530 con 0x7f5e2415b700 2024-04-02T07:32:40.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.945+0000 7f5e21400640 1 -- 172.21.15.55:0/1010092048 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1827934604 0 0) 0x7f5e240cb940 con 0x7f5e240afff0 2024-04-02T07:32:40.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.945+0000 7f5e21400640 1 -- 172.21.15.55:0/1010092048 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e2415bb20 con 0x7f5e240afff0 2024-04-02T07:32:40.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.945+0000 7f5e21e00640 1 -- 172.21.15.55:0/1010092048 >> v1:172.21.15.106:6789/0 conn(0x7f5e240afff0 legacy=0x7f5e240700e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:40.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.945+0000 7f5e21400640 1 -- 172.21.15.55:0/1010092048 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1671942869 0 0) 0x7f5e08003530 con 0x7f5e2415b700 2024-04-02T07:32:40.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.945+0000 7f5e21e00640 1 -- 172.21.15.55:0/1010092048 >> v1:172.21.15.55:6789/0 conn(0x7f5e2415b700 legacy=0x7f5e240cb130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:40.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.945+0000 7f5e21e00640 1 -- 172.21.15.55:0/1010092048 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e2415af00 con 0x7f5e241580a0 2024-04-02T07:32:40.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.949+0000 7f5e21e00640 1 --2- 172.21.15.55:0/1010092048 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e241580a0 0x7f5e240cdd70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009dc0 tx=0x7f5e1401c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc26d3b781938bda server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:40.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.949+0000 7f5e21400640 1 -- 172.21.15.55:0/1010092048 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e0c001680 con 0x7f5e241580a0 2024-04-02T07:32:40.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.949+0000 7f5e21400640 1 -- 172.21.15.55:0/1010092048 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e140a5680 con 0x7f5e241580a0 2024-04-02T07:32:40.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.949+0000 7f5e21400640 1 -- 172.21.15.55:0/1010092048 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e140a5a10 con 0x7f5e241580a0 2024-04-02T07:32:40.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.949+0000 7f5e23200640 1 -- 172.21.15.55:0/1010092048 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e241580a0 msgr2=0x7f5e240cdd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:40.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.949+0000 7f5e23200640 1 --2- 172.21.15.55:0/1010092048 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e241580a0 0x7f5e240cdd70 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f5e14009dc0 tx=0x7f5e1401c880 comp rx=0 tx=0).stop 2024-04-02T07:32:40.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.949+0000 7f5e23200640 1 -- 172.21.15.55:0/1010092048 shutdown_connections 2024-04-02T07:32:40.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.949+0000 7f5e23200640 1 --2- 172.21.15.55:0/1010092048 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e241580a0 0x7f5e240cdd70 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.949+0000 7f5e23200640 1 -- 172.21.15.55:0/1010092048 >> 172.21.15.55:0/1010092048 conn(0x7f5e24069d90 msgr2=0x7f5e2406a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:40.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.949+0000 7f5e23200640 1 -- 172.21.15.55:0/1010092048 shutdown_connections 2024-04-02T07:32:40.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.949+0000 7f5e23200640 1 -- 172.21.15.55:0/1010092048 wait complete. 2024-04-02T07:32:40.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.949+0000 7f5e23200640 1 Processor -- start 2024-04-02T07:32:40.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.949+0000 7f5e23200640 1 -- start start 2024-04-02T07:32:40.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e23200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e240afff0 0x7f5e24158be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e23200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e241580a0 0x7f5e24159120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e23200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e2415b700 0x7f5e24153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e23200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2413e1a0 con 0x7f5e240afff0 2024-04-02T07:32:40.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e23200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e241532c0 con 0x7f5e2415b700 2024-04-02T07:32:40.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e23200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e2413d870 con 0x7f5e241580a0 2024-04-02T07:32:40.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e21e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e240afff0 0x7f5e24158be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e21e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e240afff0 0x7f5e24158be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48518/0 (socket says 172.21.15.55:48518) 2024-04-02T07:32:40.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e21e00640 1 -- 172.21.15.55:0/89337762 learned_addr learned my addr 172.21.15.55:0/89337762 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:40.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e19400640 1 --2- 172.21.15.55:0/89337762 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e241580a0 0x7f5e24159120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e22800640 1 --2- 172.21.15.55:0/89337762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e2415b700 0x7f5e24153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e21e00640 1 -- 172.21.15.55:0/89337762 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e241580a0 msgr2=0x7f5e24159120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:40.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e21e00640 1 --2- 172.21.15.55:0/89337762 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e241580a0 0x7f5e24159120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e21e00640 1 -- 172.21.15.55:0/89337762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e2415b700 msgr2=0x7f5e24153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:40.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e21e00640 1 --2- 172.21.15.55:0/89337762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e2415b700 0x7f5e24153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e21e00640 1 -- 172.21.15.55:0/89337762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e14009a70 con 0x7f5e240afff0 2024-04-02T07:32:40.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e21e00640 1 --2- 172.21.15.55:0/89337762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e240afff0 0x7f5e24158be0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f5e1401af30 tx=0x7f5e14019620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:40.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e1aa00640 1 -- 172.21.15.55:0/89337762 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e140bf070 con 0x7f5e240afff0 2024-04-02T07:32:40.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e1aa00640 1 -- 172.21.15.55:0/89337762 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e14009450 con 0x7f5e240afff0 2024-04-02T07:32:40.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e1aa00640 1 -- 172.21.15.55:0/89337762 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e140ad890 con 0x7f5e240afff0 2024-04-02T07:32:40.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e23200640 1 -- 172.21.15.55:0/89337762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e240b0990 con 0x7f5e240afff0 2024-04-02T07:32:40.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.953+0000 7f5e23200640 1 -- 172.21.15.55:0/89337762 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e2413de30 con 0x7f5e240afff0 2024-04-02T07:32:40.956 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e1aa00640 1 -- 172.21.15.55:0/89337762 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5e140b4050 con 0x7f5e240afff0 2024-04-02T07:32:40.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e1aa00640 1 --2- 172.21.15.55:0/89337762 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e00066690 0x7f5e00068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e1aa00640 1 -- 172.21.15.55:0/89337762 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5e1411e630 con 0x7f5e240afff0 2024-04-02T07:32:40.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e2bfc2000 1 Processor -- start 2024-04-02T07:32:40.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e19400640 1 --2- 172.21.15.55:0/89337762 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e00066690 0x7f5e00068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e2bfc2000 1 -- start start 2024-04-02T07:32:40.959 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e19400640 1 --2- 172.21.15.55:0/89337762 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e00066690 0x7f5e00068b50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5e241f8890 tx=0x7f5e0c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:40.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e2bfc2000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b11028db0 0x556b11029190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e2bfc2000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b110296d0 0x556b10fdef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e2bfc2000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b10fdf4c0 0x556b10fdf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e2bfc2000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b10ea75a0 con 0x556b10fdf4c0 2024-04-02T07:32:40.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e2bfc2000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b10e34af0 con 0x556b11028db0 2024-04-02T07:32:40.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e2bfc2000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x556b10e320c0 con 0x556b110296d0 2024-04-02T07:32:40.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e22800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b10fdf4c0 0x556b10fdf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e22800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b10fdf4c0 0x556b10fdf8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48528/0 (socket says 172.21.15.55:48528) 2024-04-02T07:32:40.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e22800640 1 -- 172.21.15.55:0/2085706676 learned_addr learned my addr 172.21.15.55:0/2085706676 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:40.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e21e00640 1 --2- 172.21.15.55:0/2085706676 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b11028db0 0x556b11029190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e22800640 1 -- 172.21.15.55:0/2085706676 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b110296d0 msgr2=0x556b10fdef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:40.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e19400640 1 --2- 172.21.15.55:0/2085706676 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b110296d0 0x556b10fdef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e22800640 1 --2- 172.21.15.55:0/2085706676 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b110296d0 0x556b10fdef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e22800640 1 -- 172.21.15.55:0/2085706676 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b11028db0 msgr2=0x556b11029190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:40.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e22800640 1 --2- 172.21.15.55:0/2085706676 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b11028db0 0x556b11029190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e22800640 1 -- 172.21.15.55:0/2085706676 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b10b29890 con 0x556b10fdf4c0 2024-04-02T07:32:40.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e21e00640 1 --2- 172.21.15.55:0/2085706676 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b11028db0 0x556b11029190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:32:40.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.957+0000 7f5e19400640 1 --2- 172.21.15.55:0/2085706676 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b110296d0 0x556b10fdef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:32:40.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e22800640 1 --2- 172.21.15.55:0/2085706676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b10fdf4c0 0x556b10fdf8a0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0015a0 tx=0x7f5e1c001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c3a8d907f6038a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:40.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e12a00640 1 -- 172.21.15.55:0/2085706676 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c0050d0 con 0x556b10fdf4c0 2024-04-02T07:32:40.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e12a00640 1 -- 172.21.15.55:0/2085706676 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1c005230 con 0x556b10fdf4c0 2024-04-02T07:32:40.962 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e12a00640 1 -- 172.21.15.55:0/2085706676 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c00e6e0 con 0x556b10fdf4c0 2024-04-02T07:32:40.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/2085706676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b10fdf4c0 msgr2=0x556b10fdf8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:40.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e2bfc2000 1 --2- 172.21.15.55:0/2085706676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b10fdf4c0 0x556b10fdf8a0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c0015a0 tx=0x7f5e1c001a60 comp rx=0 tx=0).stop 2024-04-02T07:32:40.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/2085706676 shutdown_connections 2024-04-02T07:32:40.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e2bfc2000 1 --2- 172.21.15.55:0/2085706676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b10fdf4c0 0x556b10fdf8a0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e2bfc2000 1 --2- 172.21.15.55:0/2085706676 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b110296d0 0x556b10fdef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e2bfc2000 1 --2- 172.21.15.55:0/2085706676 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b11028db0 0x556b11029190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/2085706676 >> 172.21.15.55:0/2085706676 conn(0x556b10fe5830 msgr2=0x556b10fdd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:40.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/2085706676 shutdown_connections 2024-04-02T07:32:40.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/2085706676 wait complete. 2024-04-02T07:32:40.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e2bfc2000 1 -- start start 2024-04-02T07:32:40.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e2bfc2000 1 Processor -- start 2024-04-02T07:32:40.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e2bfc2000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b10fdf4c0 0x556b10fe40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e2bfc2000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b11028db0 0x556b11028220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e2bfc2000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b110296d0 0x556b11028760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e2bfc2000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b10e2d9b0 con 0x556b110296d0 2024-04-02T07:32:40.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e2bfc2000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b10dccc00 con 0x556b10fdf4c0 2024-04-02T07:32:40.965 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e2bfc2000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x556b10deb070 con 0x556b11028db0 2024-04-02T07:32:40.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e2bfc2000 10 client.0 _ll_register_callbacks cb 0x556b10fcb0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:32:40.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e22800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b110296d0 0x556b11028760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e22800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b110296d0 0x556b11028760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48538/0 (socket says 172.21.15.55:48538) 2024-04-02T07:32:40.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e22800640 1 -- 172.21.15.55:0/884980446 learned_addr learned my addr 172.21.15.55:0/884980446 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:40.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e19400640 1 --2- 172.21.15.55:0/884980446 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b11028db0 0x556b11028220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e21e00640 1 --2- 172.21.15.55:0/884980446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b10fdf4c0 0x556b10fe40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e22800640 1 -- 172.21.15.55:0/884980446 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b11028db0 msgr2=0x556b11028220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:40.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e22800640 1 --2- 172.21.15.55:0/884980446 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b11028db0 0x556b11028220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e22800640 1 -- 172.21.15.55:0/884980446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b10fdf4c0 msgr2=0x556b10fe40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:40.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e22800640 1 --2- 172.21.15.55:0/884980446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b10fdf4c0 0x556b10fe40f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e22800640 1 -- 172.21.15.55:0/884980446 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e1c00f040 con 0x556b110296d0 2024-04-02T07:32:40.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e22800640 1 --2- 172.21.15.55:0/884980446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b110296d0 0x556b11028760 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c013000 tx=0x7f5e1c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da8efa8a57a38ef server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:40.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.961+0000 7f5e07400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:32:40.966 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e07400640 1 -- 172.21.15.55:0/884980446 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c0079f0 con 0x556b110296d0 2024-04-02T07:32:40.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/884980446 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556b10dea5f0 con 0x556b110296d0 2024-04-02T07:32:40.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e07400640 1 -- 172.21.15.55:0/884980446 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5e1c005480 con 0x556b110296d0 2024-04-02T07:32:40.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e07400640 1 -- 172.21.15.55:0/884980446 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e1c00e8f0 con 0x556b110296d0 2024-04-02T07:32:40.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 10 client.8937 fetch_fsmap learned FSMap version 87 2024-04-02T07:32:40.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/884980446 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) v3 -- 0x556b10df2ab0 con 0x556b110296d0 2024-04-02T07:32:40.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e07400640 1 -- 172.21.15.55:0/884980446 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556b10dea5f0 con 0x556b110296d0 2024-04-02T07:32:40.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e07400640 1 -- 172.21.15.55:0/884980446 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 87) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f5e1c00ea50 con 0x556b110296d0 2024-04-02T07:32:40.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 10 client.8937 fetch_fsmap finished waiting for FSMap version 87 2024-04-02T07:32:40.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 10 client.8937 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:32:40.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 20 client.8937 populate_metadata read hostname 'smithi055' 2024-04-02T07:32:40.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 1 --2- 172.21.15.55:0/884980446 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x556b1102a310 0x556b1103a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 4 client.8937 mds_command: new command op to 8868 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:32:40.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/884980446 --> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556b10e2a790 con 0x556b1102a310 2024-04-02T07:32:40.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e21e00640 1 --2- 172.21.15.55:0/884980446 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x556b1102a310 0x556b1103a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e21e00640 1 --2- 172.21.15.55:0/884980446 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x556b1102a310 0x556b1103a530 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a382df13bbfe2b0c server_cookie=fda91b115bbf9de3 in_seq=0 out_seq=0 2024-04-02T07:32:40.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e07400640 10 client.8937 ms_handle_connect on v2:172.21.15.55:6834/1137835746 2024-04-02T07:32:40.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e07400640 1 -- 172.21.15.55:0/884980446 <== mds.0 v2:172.21.15.55:6834/1137835746 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x556b10e2a790 con 0x556b1102a310 2024-04-02T07:32:40.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e07400640 10 client.8937 handle_command_reply: tid=0 2024-04-02T07:32:40.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 1 client.8937 shutdown 2024-04-02T07:32:40.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/884980446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b110296d0 msgr2=0x556b11028760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:40.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 1 --2- 172.21.15.55:0/884980446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b110296d0 0x556b11028760 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c013000 tx=0x7f5e1c000ee0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/884980446 shutdown_connections 2024-04-02T07:32:40.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 1 --2- 172.21.15.55:0/884980446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b110296d0 0x556b11028760 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 1 --2- 172.21.15.55:0/884980446 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b11028db0 0x556b11028220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 1 --2- 172.21.15.55:0/884980446 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x556b1102a310 0x556b1103a530 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 1 --2- 172.21.15.55:0/884980446 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b10fdf4c0 0x556b10fe40f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/884980446 >> 172.21.15.55:0/884980446 conn(0x556b10fe5830 msgr2=0x556b10fddf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:40.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e07400640 0 client.8937 ms_handle_reset on v2:172.21.15.55:6834/1137835746 2024-04-02T07:32:40.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/884980446 shutdown_connections 2024-04-02T07:32:40.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/884980446 wait complete. 2024-04-02T07:32:40.970 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.965+0000 7f5e2bfc2000 20 client.8937 trim_cache size 0 max 16384 2024-04-02T07:32:40.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.981+0000 7f5e2bfc2000 1 Processor -- start 2024-04-02T07:32:40.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.981+0000 7f5e2bfc2000 1 -- start start 2024-04-02T07:32:40.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.981+0000 7f5e2bfc2000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b10fdf4c0 0x556b11027eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.981+0000 7f5e2bfc2000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b11028db0 0x556b110283f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.981+0000 7f5e2bfc2000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b110296d0 0x556b1102a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.981+0000 7f5e2bfc2000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b10aea940 con 0x556b110296d0 2024-04-02T07:32:40.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.981+0000 7f5e2bfc2000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b110353d0 con 0x556b11028db0 2024-04-02T07:32:40.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.981+0000 7f5e2bfc2000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x556b10e2adb0 con 0x556b10fdf4c0 2024-04-02T07:32:40.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.981+0000 7f5e22800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b110296d0 0x556b1102a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.981+0000 7f5e22800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b110296d0 0x556b1102a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48550/0 (socket says 172.21.15.55:48550) 2024-04-02T07:32:40.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.981+0000 7f5e22800640 1 -- 172.21.15.55:0/554281841 learned_addr learned my addr 172.21.15.55:0/554281841 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:40.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.981+0000 7f5e19400640 1 --2- 172.21.15.55:0/554281841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b11028db0 0x556b110283f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.981+0000 7f5e21e00640 1 --2- 172.21.15.55:0/554281841 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b10fdf4c0 0x556b11027eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.981+0000 7f5e22800640 1 -- 172.21.15.55:0/554281841 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b10fdf4c0 msgr2=0x556b11027eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:40.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.981+0000 7f5e22800640 1 --2- 172.21.15.55:0/554281841 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b10fdf4c0 0x556b11027eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.981+0000 7f5e22800640 1 -- 172.21.15.55:0/554281841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b11028db0 msgr2=0x556b110283f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:40.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.981+0000 7f5e22800640 1 --2- 172.21.15.55:0/554281841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b11028db0 0x556b110283f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.981+0000 7f5e22800640 1 -- 172.21.15.55:0/554281841 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b10dd8c00 con 0x556b110296d0 2024-04-02T07:32:40.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.981+0000 7f5e19400640 1 --2- 172.21.15.55:0/554281841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b11028db0 0x556b110283f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:32:40.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e22800640 1 --2- 172.21.15.55:0/554281841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b110296d0 0x556b1102a6f0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c003c90 tx=0x7f5e1c01d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de738876ec3dcc11 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:40.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e13400640 1 -- 172.21.15.55:0/554281841 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c0052e0 con 0x556b110296d0 2024-04-02T07:32:40.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e13400640 1 -- 172.21.15.55:0/554281841 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e1c005440 con 0x556b110296d0 2024-04-02T07:32:40.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e13400640 1 -- 172.21.15.55:0/554281841 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e1c007bf0 con 0x556b110296d0 2024-04-02T07:32:40.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/554281841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b110296d0 msgr2=0x556b1102a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:40.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e2bfc2000 1 --2- 172.21.15.55:0/554281841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b110296d0 0x556b1102a6f0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f5e1c003c90 tx=0x7f5e1c01d000 comp rx=0 tx=0).stop 2024-04-02T07:32:40.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/554281841 shutdown_connections 2024-04-02T07:32:40.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e2bfc2000 1 --2- 172.21.15.55:0/554281841 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b110296d0 0x556b1102a6f0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e2bfc2000 1 --2- 172.21.15.55:0/554281841 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b11028db0 0x556b110283f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e2bfc2000 1 --2- 172.21.15.55:0/554281841 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b10fdf4c0 0x556b11027eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/554281841 >> 172.21.15.55:0/554281841 conn(0x556b10fe5830 msgr2=0x556b11026790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:40.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/554281841 shutdown_connections 2024-04-02T07:32:40.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/554281841 wait complete. 2024-04-02T07:32:40.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e2bfc2000 1 -- start start 2024-04-02T07:32:40.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e2bfc2000 1 Processor -- start 2024-04-02T07:32:40.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e2bfc2000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b10fdf4c0 0x556b1102dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e2bfc2000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b11028db0 0x556b110438f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e2bfc2000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b110296d0 0x556b11043e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e2bfc2000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b10e70ac0 con 0x556b10fdf4c0 2024-04-02T07:32:40.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e2bfc2000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b10e2b1c0 con 0x556b110296d0 2024-04-02T07:32:40.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e2bfc2000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x556b1103e780 con 0x556b11028db0 2024-04-02T07:32:40.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e2bfc2000 10 client.0 _ll_register_callbacks cb 0x556b10df2590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:32:40.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e21e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b10fdf4c0 0x556b1102dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e21e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b10fdf4c0 0x556b1102dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48552/0 (socket says 172.21.15.55:48552) 2024-04-02T07:32:40.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e21e00640 1 -- 172.21.15.55:0/596215698 learned_addr learned my addr 172.21.15.55:0/596215698 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:40.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e22800640 1 --2- 172.21.15.55:0/596215698 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b110296d0 0x556b11043e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e19400640 1 --2- 172.21.15.55:0/596215698 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b11028db0 0x556b110438f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.989 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e21e00640 1 -- 172.21.15.55:0/596215698 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b11028db0 msgr2=0x556b110438f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:40.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e21e00640 1 --2- 172.21.15.55:0/596215698 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b11028db0 0x556b110438f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e21e00640 1 -- 172.21.15.55:0/596215698 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b110296d0 msgr2=0x556b11043e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:40.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e21e00640 1 --2- 172.21.15.55:0/596215698 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b110296d0 0x556b11043e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e21e00640 1 -- 172.21.15.55:0/596215698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556b10df2ab0 con 0x556b10fdf4c0 2024-04-02T07:32:40.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e21e00640 1 --2- 172.21.15.55:0/596215698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b10fdf4c0 0x556b1102dd00 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f5e140ef500 tx=0x7f5e14000f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a092afc17a5942af server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:40.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e07400640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:32:40.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e07400640 1 -- 172.21.15.55:0/596215698 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e140f79f0 con 0x556b10fdf4c0 2024-04-02T07:32:40.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e07400640 1 -- 172.21.15.55:0/596215698 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f5e1411cb80 con 0x556b10fdf4c0 2024-04-02T07:32:40.990 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.985+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/596215698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556b10dfd460 con 0x556b10fdf4c0 2024-04-02T07:32:40.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e07400640 1 -- 172.21.15.55:0/596215698 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e140ebc80 con 0x556b10fdf4c0 2024-04-02T07:32:40.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e2bfc2000 10 client.8943 fetch_fsmap learned FSMap version 87 2024-04-02T07:32:40.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/596215698 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) v3 -- 0x556b10b29cc0 con 0x556b10fdf4c0 2024-04-02T07:32:40.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e07400640 1 -- 172.21.15.55:0/596215698 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x556b10dfd460 con 0x556b10fdf4c0 2024-04-02T07:32:40.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e07400640 1 -- 172.21.15.55:0/596215698 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 87) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f5e14005d20 con 0x556b10fdf4c0 2024-04-02T07:32:40.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e2bfc2000 10 client.8943 fetch_fsmap finished waiting for FSMap version 87 2024-04-02T07:32:40.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e2bfc2000 10 client.8943 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:32:40.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e2bfc2000 20 client.8943 populate_metadata read hostname 'smithi055' 2024-04-02T07:32:40.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e2bfc2000 1 --2- 172.21.15.55:0/596215698 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x556b11087180 0x556b11087560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:40.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e2bfc2000 4 client.8943 mds_command: new command op to 8868 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-02T07:32:40.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/596215698 --> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556b10df69c0 con 0x556b11087180 2024-04-02T07:32:40.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e19400640 1 --2- 172.21.15.55:0/596215698 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x556b11087180 0x556b11087560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:40.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e19400640 1 --2- 172.21.15.55:0/596215698 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x556b11087180 0x556b11087560 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16666617dfd82391 server_cookie=5fa73d1cba9eea19 in_seq=0 out_seq=0 2024-04-02T07:32:40.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e07400640 10 client.8943 ms_handle_connect on v2:172.21.15.55:6834/1137835746 2024-04-02T07:32:40.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e07400640 1 -- 172.21.15.55:0/596215698 <== mds.0 v2:172.21.15.55:6834/1137835746 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x556b10df69c0 con 0x556b11087180 2024-04-02T07:32:40.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e07400640 10 client.8943 handle_command_reply: tid=0 2024-04-02T07:32:40.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e2bfc2000 1 client.8943 shutdown 2024-04-02T07:32:40.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/596215698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b10fdf4c0 msgr2=0x556b1102dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:40.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e2bfc2000 1 --2- 172.21.15.55:0/596215698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b10fdf4c0 0x556b1102dd00 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f5e140ef500 tx=0x7f5e14000f50 comp rx=0 tx=0).stop 2024-04-02T07:32:40.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/596215698 shutdown_connections 2024-04-02T07:32:40.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e2bfc2000 1 --2- 172.21.15.55:0/596215698 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x556b11087180 0x556b11087560 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e2bfc2000 1 --2- 172.21.15.55:0/596215698 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x556b110296d0 0x556b11043e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e2bfc2000 1 --2- 172.21.15.55:0/596215698 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x556b11028db0 0x556b110438f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e07400640 0 client.8943 ms_handle_reset on v2:172.21.15.55:6834/1137835746 2024-04-02T07:32:40.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e2bfc2000 1 --2- 172.21.15.55:0/596215698 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x556b10fdf4c0 0x556b1102dd00 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/596215698 >> 172.21.15.55:0/596215698 conn(0x556b10fe5830 msgr2=0x556b11027020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/596215698 shutdown_connections 2024-04-02T07:32:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e2bfc2000 1 -- 172.21.15.55:0/596215698 wait complete. 2024-04-02T07:32:40.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e2bfc2000 20 client.8943 trim_cache size 0 max 16384 2024-04-02T07:32:40.996 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:32:40.996 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "642a0456-a2ac-49a4-91a5-3b3449b512da", 2024-04-02T07:32:40.996 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-02T07:32:40.996 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 8868, 2024-04-02T07:32:40.996 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-02T07:32:40.996 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-02T07:32:40.996 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-02T07:32:40.997 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 4.5732706710000004, 2024-04-02T07:32:40.997 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 87, 2024-04-02T07:32:40.997 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 104, 2024-04-02T07:32:40.997 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 104, 2024-04-02T07:32:40.997 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 5.5602265639999997 2024-04-02T07:32:40.997 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:32:40.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e23200640 1 -- 172.21.15.55:0/89337762 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e00066690 msgr2=0x7f5e00068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e23200640 1 --2- 172.21.15.55:0/89337762 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e00066690 0x7f5e00068b50 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f5e241f8890 tx=0x7f5e0c009040 comp rx=0 tx=0).stop 2024-04-02T07:32:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e23200640 1 -- 172.21.15.55:0/89337762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e240afff0 msgr2=0x7f5e24158be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e23200640 1 --2- 172.21.15.55:0/89337762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e240afff0 0x7f5e24158be0 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f5e1401af30 tx=0x7f5e14019620 comp rx=0 tx=0).stop 2024-04-02T07:32:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e23200640 1 -- 172.21.15.55:0/89337762 shutdown_connections 2024-04-02T07:32:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e23200640 1 --2- 172.21.15.55:0/89337762 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e00066690 0x7f5e00068b50 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e23200640 1 --2- 172.21.15.55:0/89337762 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5e2415b700 0x7f5e24153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e23200640 1 --2- 172.21.15.55:0/89337762 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5e241580a0 0x7f5e24159120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e23200640 1 --2- 172.21.15.55:0/89337762 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5e240afff0 0x7f5e24158be0 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e23200640 1 -- 172.21.15.55:0/89337762 >> 172.21.15.55:0/89337762 conn(0x7f5e24069d90 msgr2=0x7f5e2415a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e23200640 1 -- 172.21.15.55:0/89337762 shutdown_connections 2024-04-02T07:32:40.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:40.989+0000 7f5e23200640 1 -- 172.21.15.55:0/89337762 wait complete. 2024-04-02T07:32:41.010 DEBUG:teuthology.orchestra.run.smithi055:> sudo daemon-helper kill ceph --cluster ceph -w 2024-04-02T07:32:41.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:32:41.013 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub start / repair,recursive 2024-04-02T07:32:41.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.157+0000 7f3f8f400640 1 Processor -- start 2024-04-02T07:32:41.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.157+0000 7f3f8f400640 1 -- start start 2024-04-02T07:32:41.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.157+0000 7f3f8f400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3f8815d450 0x7f3f8815d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.157+0000 7f3f8f400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3f880ccf80 0x7f3f880cd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.157+0000 7f3f8f400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f88160550 0x7f3f881609e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.157+0000 7f3f8f400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f880cd970 con 0x7f3f880ccf80 2024-04-02T07:32:41.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.157+0000 7f3f8f400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f88098d40 con 0x7f3f8815d450 2024-04-02T07:32:41.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.157+0000 7f3f8f400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f88099020 con 0x7f3f88160550 2024-04-02T07:32:41.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.157+0000 7f3f7fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3f880ccf80 0x7f3f880cd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.157+0000 7f3f7fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3f880ccf80 0x7f3f880cd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48566/0 (socket says 172.21.15.55:48566) 2024-04-02T07:32:41.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.157+0000 7f3f7fe00640 1 -- 172.21.15.55:0/1348488340 learned_addr learned my addr 172.21.15.55:0/1348488340 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:41.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.157+0000 7f3f8ca00640 1 --2- 172.21.15.55:0/1348488340 >> v2:172.21.15.106:3300/0 conn(0x7f3f8815d450 0x7f3f8815d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.157+0000 7f3f8d400640 1 --2- 172.21.15.55:0/1348488340 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f88160550 0x7f3f881609e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.157+0000 7f3f7fe00640 1 -- 172.21.15.55:0/1348488340 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f88160550 msgr2=0x7f3f881609e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:41.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.157+0000 7f3f7fe00640 1 --2- 172.21.15.55:0/1348488340 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f88160550 0x7f3f881609e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.157+0000 7f3f7fe00640 1 -- 172.21.15.55:0/1348488340 >> v2:172.21.15.106:3300/0 conn(0x7f3f8815d450 msgr2=0x7f3f8815d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:41.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.157+0000 7f3f7fe00640 1 --2- 172.21.15.55:0/1348488340 >> v2:172.21.15.106:3300/0 conn(0x7f3f8815d450 0x7f3f8815d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.157+0000 7f3f7fe00640 1 -- 172.21.15.55:0/1348488340 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f88099300 con 0x7f3f880ccf80 2024-04-02T07:32:41.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.157+0000 7f3f8d400640 1 --2- 172.21.15.55:0/1348488340 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f88160550 0x7f3f881609e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:32:41.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.157+0000 7f3f8ca00640 1 --2- 172.21.15.55:0/1348488340 >> v2:172.21.15.106:3300/0 conn(0x7f3f8815d450 0x7f3f8815d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:32:41.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.161+0000 7f3f7fe00640 1 --2- 172.21.15.55:0/1348488340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f880ccf80 0x7f3f880cd430 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f3f88070a70 tx=0x7f3f7001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9f5b422fc36c70e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:41.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.161+0000 7f3f87e00640 1 -- 172.21.15.55:0/1348488340 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f700aa410 con 0x7f3f880ccf80 2024-04-02T07:32:41.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.161+0000 7f3f87e00640 1 -- 172.21.15.55:0/1348488340 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f700a6040 con 0x7f3f880ccf80 2024-04-02T07:32:41.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.161+0000 7f3f87e00640 1 -- 172.21.15.55:0/1348488340 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f700aa790 con 0x7f3f880ccf80 2024-04-02T07:32:41.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.161+0000 7f3f8f400640 1 -- 172.21.15.55:0/1348488340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f880ccf80 msgr2=0x7f3f880cd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.161+0000 7f3f8f400640 1 --2- 172.21.15.55:0/1348488340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f880ccf80 0x7f3f880cd430 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f3f88070a70 tx=0x7f3f7001c4f0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.161+0000 7f3f8f400640 1 -- 172.21.15.55:0/1348488340 shutdown_connections 2024-04-02T07:32:41.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.161+0000 7f3f8f400640 1 --2- 172.21.15.55:0/1348488340 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f88160550 0x7f3f881609e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.161+0000 7f3f8f400640 1 --2- 172.21.15.55:0/1348488340 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f880ccf80 0x7f3f880cd430 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.161+0000 7f3f8f400640 1 --2- 172.21.15.55:0/1348488340 >> v2:172.21.15.106:3300/0 conn(0x7f3f8815d450 0x7f3f8815d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.161+0000 7f3f8f400640 1 -- 172.21.15.55:0/1348488340 >> 172.21.15.55:0/1348488340 conn(0x7f3f880d0700 msgr2=0x7f3f880d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:41.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.161+0000 7f3f8f400640 1 -- 172.21.15.55:0/1348488340 shutdown_connections 2024-04-02T07:32:41.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.161+0000 7f3f8f400640 1 -- 172.21.15.55:0/1348488340 wait complete. 2024-04-02T07:32:41.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f8f400640 1 Processor -- start 2024-04-02T07:32:41.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f8f400640 1 -- start start 2024-04-02T07:32:41.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f8f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f880ccf80 0x7f3f88158780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f8f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f8815d450 0x7f3f88154a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f8f400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f88160550 0x7f3f88154fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f8f400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f880c4c00 con 0x7f3f8815d450 2024-04-02T07:32:41.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f8f400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8815c2e0 con 0x7f3f880ccf80 2024-04-02T07:32:41.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f8f400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f880c42d0 con 0x7f3f88160550 2024-04-02T07:32:41.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f7fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f8815d450 0x7f3f88154a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f7fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f8815d450 0x7f3f88154a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48576/0 (socket says 172.21.15.55:48576) 2024-04-02T07:32:41.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f7fe00640 1 -- 172.21.15.55:0/762634902 learned_addr learned my addr 172.21.15.55:0/762634902 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:41.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f8ca00640 1 --2- 172.21.15.55:0/762634902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f880ccf80 0x7f3f88158780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f8d400640 1 --2- 172.21.15.55:0/762634902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f88160550 0x7f3f88154fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f7fe00640 1 -- 172.21.15.55:0/762634902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f88160550 msgr2=0x7f3f88154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f7fe00640 1 --2- 172.21.15.55:0/762634902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f88160550 0x7f3f88154fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f7fe00640 1 -- 172.21.15.55:0/762634902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f880ccf80 msgr2=0x7f3f88158780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f7fe00640 1 --2- 172.21.15.55:0/762634902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f880ccf80 0x7f3f88158780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f7fe00640 1 -- 172.21.15.55:0/762634902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f700094d0 con 0x7f3f8815d450 2024-04-02T07:32:41.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f7fe00640 1 --2- 172.21.15.55:0/762634902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f8815d450 0x7f3f88154a90 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f3f700ac040 tx=0x7f3f7001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:41.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f85600640 1 -- 172.21.15.55:0/762634902 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f700bd5f0 con 0x7f3f8815d450 2024-04-02T07:32:41.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f85600640 1 -- 172.21.15.55:0/762634902 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f700bd750 con 0x7f3f8815d450 2024-04-02T07:32:41.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f85600640 1 -- 172.21.15.55:0/762634902 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f700bdb00 con 0x7f3f8815d450 2024-04-02T07:32:41.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f8f400640 1 -- 172.21.15.55:0/762634902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f880c45b0 con 0x7f3f8815d450 2024-04-02T07:32:41.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.165+0000 7f3f8f400640 1 -- 172.21.15.55:0/762634902 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8815cb10 con 0x7f3f8815d450 2024-04-02T07:32:41.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.169+0000 7f3f85600640 1 -- 172.21.15.55:0/762634902 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3f700b33f0 con 0x7f3f8815d450 2024-04-02T07:32:41.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.169+0000 7f3f92868000 1 Processor -- start 2024-04-02T07:32:41.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.169+0000 7f3f92868000 1 -- start start 2024-04-02T07:32:41.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.169+0000 7f3f85600640 1 --2- 172.21.15.55:0/762634902 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f64066690 0x7f3f64068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.169+0000 7f3f85600640 1 -- 172.21.15.55:0/762634902 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3f7011eda0 con 0x7f3f8815d450 2024-04-02T07:32:41.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.169+0000 7f3f8d400640 1 --2- 172.21.15.55:0/762634902 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f64066690 0x7f3f64068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.169+0000 7f3f92868000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e341d30 0x56476e342110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f92868000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e342650 0x56476e2f8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f92868000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e2f8f60 0x56476e2f9340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f92868000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56476e1c0170 con 0x56476e341d30 2024-04-02T07:32:41.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f92868000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56476e14dd80 con 0x56476e342650 2024-04-02T07:32:41.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f92868000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x56476e14b350 con 0x56476e2f8f60 2024-04-02T07:32:41.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f8ca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e341d30 0x56476e342110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f8ca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e341d30 0x56476e342110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48584/0 (socket says 172.21.15.55:48584) 2024-04-02T07:32:41.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f8ca00640 1 -- 172.21.15.55:0/3507626681 learned_addr learned my addr 172.21.15.55:0/3507626681 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:41.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f7fe00640 1 --2- 172.21.15.55:0/3507626681 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e342650 0x56476e2f8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f8d400640 1 --2- 172.21.15.55:0/3507626681 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e2f8f60 0x56476e2f9340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f8ca00640 1 -- 172.21.15.55:0/3507626681 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e2f8f60 msgr2=0x56476e2f9340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:41.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f8ca00640 1 --2- 172.21.15.55:0/3507626681 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e2f8f60 0x56476e2f9340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f8ca00640 1 -- 172.21.15.55:0/3507626681 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e342650 msgr2=0x56476e2f8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:41.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f8ca00640 1 --2- 172.21.15.55:0/3507626681 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e342650 0x56476e2f8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f8ca00640 1 -- 172.21.15.55:0/3507626681 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56476de43070 con 0x56476e341d30 2024-04-02T07:32:41.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f8d400640 1 --2- 172.21.15.55:0/3507626681 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e2f8f60 0x56476e2f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:32:41.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f8d400640 1 --2- 172.21.15.55:0/762634902 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f64066690 0x7f3f64068b50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3f880d10a0 tx=0x7f3f800097d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:41.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f8ca00640 1 --2- 172.21.15.55:0/3507626681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e341d30 0x56476e342110 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f3f78004500 tx=0x7f3f780039f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c95fca643a4fd13 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:41.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f7d600640 1 -- 172.21.15.55:0/3507626681 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7800b7d0 con 0x56476e341d30 2024-04-02T07:32:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f7d600640 1 -- 172.21.15.55:0/3507626681 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f7800b930 con 0x56476e341d30 2024-04-02T07:32:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f7d600640 1 -- 172.21.15.55:0/3507626681 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7800bca0 con 0x56476e341d30 2024-04-02T07:32:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f92868000 1 -- 172.21.15.55:0/3507626681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e341d30 msgr2=0x56476e342110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f92868000 1 --2- 172.21.15.55:0/3507626681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e341d30 0x56476e342110 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f3f78004500 tx=0x7f3f780039f0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f92868000 1 -- 172.21.15.55:0/3507626681 shutdown_connections 2024-04-02T07:32:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f92868000 1 --2- 172.21.15.55:0/3507626681 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e2f8f60 0x56476e2f9340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f92868000 1 --2- 172.21.15.55:0/3507626681 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e342650 0x56476e2f8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f92868000 1 --2- 172.21.15.55:0/3507626681 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e341d30 0x56476e342110 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f92868000 1 -- 172.21.15.55:0/3507626681 >> 172.21.15.55:0/3507626681 conn(0x56476e2f4f10 msgr2=0x56476e2f7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f92868000 1 -- 172.21.15.55:0/3507626681 shutdown_connections 2024-04-02T07:32:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f92868000 1 -- 172.21.15.55:0/3507626681 wait complete. 2024-04-02T07:32:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f92868000 1 -- start start 2024-04-02T07:32:41.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f92868000 1 Processor -- start 2024-04-02T07:32:41.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f92868000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e2f8f60 0x56476e32f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.173+0000 7f3f92868000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e341d30 0x56476e2fe5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e342650 0x56476e2feb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56476e146c40 con 0x56476e341d30 2024-04-02T07:32:41.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56476e0e5fa0 con 0x56476e2f8f60 2024-04-02T07:32:41.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x56476e1041c0 con 0x56476e342650 2024-04-02T07:32:41.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 10 client.0 _ll_register_callbacks cb 0x56476e2e4060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:32:41.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f7fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e341d30 0x56476e2fe5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f7fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e341d30 0x56476e2fe5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48590/0 (socket says 172.21.15.55:48590) 2024-04-02T07:32:41.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f7fe00640 1 -- 172.21.15.55:0/2464587063 learned_addr learned my addr 172.21.15.55:0/2464587063 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:41.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f8d400640 1 --2- 172.21.15.55:0/2464587063 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e342650 0x56476e2feb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f8ca00640 1 --2- 172.21.15.55:0/2464587063 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e2f8f60 0x56476e32f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f7fe00640 1 -- 172.21.15.55:0/2464587063 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e342650 msgr2=0x56476e2feb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:41.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f7fe00640 1 --2- 172.21.15.55:0/2464587063 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e342650 0x56476e2feb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f7fe00640 1 -- 172.21.15.55:0/2464587063 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e2f8f60 msgr2=0x56476e32f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:41.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f7fe00640 1 --2- 172.21.15.55:0/2464587063 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e2f8f60 0x56476e32f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f7fe00640 1 -- 172.21.15.55:0/2464587063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f7800e040 con 0x56476e341d30 2024-04-02T07:32:41.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f7fe00640 1 --2- 172.21.15.55:0/2464587063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e341d30 0x56476e2fe5e0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f3f7011d1d0 tx=0x7f3f700f3b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6492384be5159e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:41.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f76000640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:32:41.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f76000640 1 -- 172.21.15.55:0/2464587063 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f70119070 con 0x56476e341d30 2024-04-02T07:32:41.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 1 -- 172.21.15.55:0/2464587063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56476e143a20 con 0x56476e341d30 2024-04-02T07:32:41.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f76000640 1 -- 172.21.15.55:0/2464587063 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3f700ef270 con 0x56476e341d30 2024-04-02T07:32:41.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f76000640 1 -- 172.21.15.55:0/2464587063 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f700ef430 con 0x56476e341d30 2024-04-02T07:32:41.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 10 client.8955 fetch_fsmap learned FSMap version 87 2024-04-02T07:32:41.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 1 -- 172.21.15.55:0/2464587063 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) v3 -- 0x56476e10bba0 con 0x56476e341d30 2024-04-02T07:32:41.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f76000640 1 -- 172.21.15.55:0/2464587063 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f70111020 con 0x56476e341d30 2024-04-02T07:32:41.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f76000640 1 -- 172.21.15.55:0/2464587063 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 87) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3f700c6070 con 0x56476e341d30 2024-04-02T07:32:41.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 10 client.8955 fetch_fsmap finished waiting for FSMap version 87 2024-04-02T07:32:41.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 10 client.8955 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-02T07:32:41.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 20 client.8955 populate_metadata read hostname 'smithi055' 2024-04-02T07:32:41.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 1 --2- 172.21.15.55:0/2464587063 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x56476e343470 0x56476e353ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 4 client.8955 mds_command: new command op to 8868 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:32:41.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 1 -- 172.21.15.55:0/2464587063 --> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56476e145590 con 0x56476e343470 2024-04-02T07:32:41.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f8ca00640 1 --2- 172.21.15.55:0/2464587063 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x56476e343470 0x56476e353ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f8ca00640 1 --2- 172.21.15.55:0/2464587063 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x56476e343470 0x56476e353ff0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f61cc0075a972741 server_cookie=b435362b521cf2d in_seq=0 out_seq=0 2024-04-02T07:32:41.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f76000640 10 client.8955 ms_handle_connect on v2:172.21.15.55:6834/1137835746 2024-04-02T07:32:41.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f76000640 1 -- 172.21.15.55:0/2464587063 <== mds.0 v2:172.21.15.55:6834/1137835746 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x56476e145590 con 0x56476e343470 2024-04-02T07:32:41.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f76000640 10 client.8955 handle_command_reply: tid=0 2024-04-02T07:32:41.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 1 client.8955 shutdown 2024-04-02T07:32:41.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 1 -- 172.21.15.55:0/2464587063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e341d30 msgr2=0x56476e2fe5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 1 --2- 172.21.15.55:0/2464587063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e341d30 0x56476e2fe5e0 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f3f7011d1d0 tx=0x7f3f700f3b00 comp rx=0 tx=0).stop 2024-04-02T07:32:41.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 1 -- 172.21.15.55:0/2464587063 shutdown_connections 2024-04-02T07:32:41.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 1 --2- 172.21.15.55:0/2464587063 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e342650 0x56476e2feb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 1 --2- 172.21.15.55:0/2464587063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e341d30 0x56476e2fe5e0 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 1 --2- 172.21.15.55:0/2464587063 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x56476e343470 0x56476e353ff0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 1 --2- 172.21.15.55:0/2464587063 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e2f8f60 0x56476e32f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f76000640 0 client.8955 ms_handle_reset on v2:172.21.15.55:6834/1137835746 2024-04-02T07:32:41.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 1 -- 172.21.15.55:0/2464587063 >> 172.21.15.55:0/2464587063 conn(0x56476e2f4f10 msgr2=0x56476e2f7b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:41.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 1 -- 172.21.15.55:0/2464587063 shutdown_connections 2024-04-02T07:32:41.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.177+0000 7f3f92868000 1 -- 172.21.15.55:0/2464587063 wait complete. 2024-04-02T07:32:41.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.181+0000 7f3f92868000 20 client.8955 trim_cache size 0 max 16384 2024-04-02T07:32:41.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.181+0000 7fb89ae00640 1 Processor -- start 2024-04-02T07:32:41.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.181+0000 7fb89ae00640 1 -- start start 2024-04-02T07:32:41.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.185+0000 7fb89ae00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb89415df00 0x7fb89415cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.185+0000 7fb89ae00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8940b05d0 con 0x7fb8940cea50 2024-04-02T07:32:41.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.185+0000 7fb89ae00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb89415d660 con 0x7fb89415c9a0 2024-04-02T07:32:41.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.185+0000 7fb89ae00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8940af170 con 0x7fb89415df00 2024-04-02T07:32:41.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.185+0000 7fb898e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb8940cea50 0x7fb8940ceee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35828/0 (socket says 172.21.15.55:35828) 2024-04-02T07:32:41.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.185+0000 7fb898e00640 1 -- 172.21.15.55:0/4274003223 learned_addr learned my addr 172.21.15.55:0/4274003223 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:32:41.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.185+0000 7fb893e00640 1 --1- 172.21.15.55:0/4274003223 >> v1:172.21.15.106:6789/0 conn(0x7fb89415c9a0 0x7fb8940b0a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:42646/0 (socket says 172.21.15.55:42646) 2024-04-02T07:32:41.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.185+0000 7fb893400640 1 --2- 172.21.15.55:0/4274003223 >> v2:172.21.15.106:3300/0 conn(0x7fb89415df00 0x7fb89415cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.185+0000 7fb892a00640 1 -- 172.21.15.55:0/4274003223 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820678839 0 0) 0x7fb8940b05d0 con 0x7fb8940cea50 2024-04-02T07:32:41.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.185+0000 7fb892a00640 1 -- 172.21.15.55:0/4274003223 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb878003530 con 0x7fb8940cea50 2024-04-02T07:32:41.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.185+0000 7fb892a00640 1 -- 172.21.15.55:0/4274003223 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4066774466 0 0) 0x7fb89415d660 con 0x7fb89415c9a0 2024-04-02T07:32:41.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.185+0000 7fb892a00640 1 -- 172.21.15.55:0/4274003223 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8940b05d0 con 0x7fb89415c9a0 2024-04-02T07:32:41.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.185+0000 7fb893400640 1 -- 172.21.15.55:0/4274003223 >> v1:172.21.15.106:6789/0 conn(0x7fb89415c9a0 legacy=0x7fb8940b0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.185+0000 7fb893400640 1 -- 172.21.15.55:0/4274003223 >> v1:172.21.15.55:6789/0 conn(0x7fb8940cea50 legacy=0x7fb8940ceee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.185+0000 7fb893400640 1 -- 172.21.15.55:0/4274003223 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89415d940 con 0x7fb89415df00 2024-04-02T07:32:41.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.189+0000 7fb893400640 1 --2- 172.21.15.55:0/4274003223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb89415df00 0x7fb89415cd80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb8800097c0 tx=0x7fb88001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aca4ed264d23622 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:41.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.189+0000 7fb892a00640 1 -- 172.21.15.55:0/4274003223 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8800ab600 con 0x7fb89415df00 2024-04-02T07:32:41.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.189+0000 7fb892a00640 1 -- 172.21.15.55:0/4274003223 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8800a7050 con 0x7fb89415df00 2024-04-02T07:32:41.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.189+0000 7fb892a00640 1 -- 172.21.15.55:0/4274003223 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8800ab960 con 0x7fb89415df00 2024-04-02T07:32:41.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.189+0000 7fb89ae00640 1 -- 172.21.15.55:0/4274003223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb89415df00 msgr2=0x7fb89415cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.189+0000 7fb89ae00640 1 --2- 172.21.15.55:0/4274003223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb89415df00 0x7fb89415cd80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fb8800097c0 tx=0x7fb88001c4a0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.189+0000 7fb89ae00640 1 -- 172.21.15.55:0/4274003223 shutdown_connections 2024-04-02T07:32:41.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.189+0000 7fb89ae00640 1 --2- 172.21.15.55:0/4274003223 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb89415df00 0x7fb89415cd80 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.189+0000 7fb89ae00640 1 -- 172.21.15.55:0/4274003223 >> 172.21.15.55:0/4274003223 conn(0x7fb894098a10 msgr2=0x7fb8940cf6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:41.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.189+0000 7fb89ae00640 1 -- 172.21.15.55:0/4274003223 shutdown_connections 2024-04-02T07:32:41.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.189+0000 7fb89ae00640 1 -- 172.21.15.55:0/4274003223 wait complete. 2024-04-02T07:32:41.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.189+0000 7fb89ae00640 1 Processor -- start 2024-04-02T07:32:41.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.189+0000 7fb89ae00640 1 -- start start 2024-04-02T07:32:41.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.189+0000 7fb89ae00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8940cea50 0x7fb8940c5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.189+0000 7fb89ae00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb89415c9a0 0x7fb894153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.189+0000 7fb89ae00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb89415df00 0x7fb894154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.189+0000 7fb89ae00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8940c57d0 con 0x7fb89415df00 2024-04-02T07:32:41.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.189+0000 7fb89ae00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8941547d0 con 0x7fb89415c9a0 2024-04-02T07:32:41.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.189+0000 7fb89ae00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8940c3d90 con 0x7fb8940cea50 2024-04-02T07:32:41.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.193+0000 7fb898e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb89415df00 0x7fb894154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.193+0000 7fb893400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb89415c9a0 0x7fb894153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.193+0000 7fb898e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb89415df00 0x7fb894154290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48596/0 (socket says 172.21.15.55:48596) 2024-04-02T07:32:41.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.193+0000 7fb893e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8940cea50 0x7fb8940c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.193+0000 7fb898e00640 1 -- 172.21.15.55:0/2385230462 learned_addr learned my addr 172.21.15.55:0/2385230462 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:41.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.193+0000 7fb898e00640 1 -- 172.21.15.55:0/2385230462 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8940cea50 msgr2=0x7fb8940c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.193+0000 7fb898e00640 1 --2- 172.21.15.55:0/2385230462 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb8940cea50 0x7fb8940c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.193+0000 7fb898e00640 1 -- 172.21.15.55:0/2385230462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb89415c9a0 msgr2=0x7fb894153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.193+0000 7fb898e00640 1 --2- 172.21.15.55:0/2385230462 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb89415c9a0 0x7fb894153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.193+0000 7fb898e00640 1 -- 172.21.15.55:0/2385230462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb880009420 con 0x7fb89415df00 2024-04-02T07:32:41.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.193+0000 7fb898e00640 1 --2- 172.21.15.55:0/2385230462 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb89415df00 0x7fb894154290 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7fb88c00cad0 tx=0x7fb88c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:41.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.193+0000 7fb88be00640 1 -- 172.21.15.55:0/2385230462 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c00ac30 con 0x7fb89415df00 2024-04-02T07:32:41.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.193+0000 7fb88be00640 1 -- 172.21.15.55:0/2385230462 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb88c00adb0 con 0x7fb89415df00 2024-04-02T07:32:41.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.193+0000 7fb88be00640 1 -- 172.21.15.55:0/2385230462 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88c012640 con 0x7fb89415df00 2024-04-02T07:32:41.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.193+0000 7fb89ae00640 1 -- 172.21.15.55:0/2385230462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8940c4070 con 0x7fb89415df00 2024-04-02T07:32:41.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.193+0000 7fb89ae00640 1 -- 172.21.15.55:0/2385230462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8940c4630 con 0x7fb89415df00 2024-04-02T07:32:41.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.193+0000 7fb89ae00640 1 -- 172.21.15.55:0/2385230462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7fb894066c90 con 0x7fb89415df00 2024-04-02T07:32:41.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.193+0000 7fb88be00640 1 -- 172.21.15.55:0/2385230462 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb88c007070 con 0x7fb89415df00 2024-04-02T07:32:41.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7fb88be00640 1 --2- 172.21.15.55:0/2385230462 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb874066690 0x7fb874068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7fb88be00640 1 -- 172.21.15.55:0/2385230462 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fb88c0847d0 con 0x7fb89415df00 2024-04-02T07:32:41.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7fb88be00640 1 -- 172.21.15.55:0/2385230462 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+516 (secure 0 0 0) 0x7fb88c084c40 con 0x7fb89415df00 2024-04-02T07:32:41.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7fb893e00640 1 --2- 172.21.15.55:0/2385230462 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb874066690 0x7fb874068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f92868000 1 Processor -- start 2024-04-02T07:32:41.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7fb89ae00640 1 -- 172.21.15.55:0/2385230462 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({log-info=0+}) v3 -- 0x7fb89406a5b0 con 0x7fb89415df00 2024-04-02T07:32:41.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f92868000 1 -- start start 2024-04-02T07:32:41.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7fb88be00640 1 -- 172.21.15.55:0/2385230462 <== mon.0 v2:172.21.15.55:3300/0 7 ==== log(2 entries from seq 1031 at 2024-04-02T07:32:39.433122+0000) v1 ==== 389+0+0 (secure 0 0 0) 0x7fb88c055850 con 0x7fb89415df00 2024-04-02T07:32:41.199 INFO:teuthology.orchestra.run.smithi055.stdout: cluster: 2024-04-02T07:32:41.200 INFO:teuthology.orchestra.run.smithi055.stdout: id: 642a0456-a2ac-49a4-91a5-3b3449b512da 2024-04-02T07:32:41.200 INFO:teuthology.orchestra.run.smithi055.stdout: health: HEALTH_OK 2024-04-02T07:32:41.200 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:32:41.200 INFO:teuthology.orchestra.run.smithi055.stdout: services: 2024-04-02T07:32:41.200 INFO:teuthology.orchestra.run.smithi055.stdout: mon: 3 daemons, quorum a,b,c (age 10m) 2024-04-02T07:32:41.200 INFO:teuthology.orchestra.run.smithi055.stdout: mgr: x(active, since 10m), standbys: y 2024-04-02T07:32:41.200 INFO:teuthology.orchestra.run.smithi055.stdout: mds: 1/1 daemons up, 3 standby 2024-04-02T07:32:41.200 INFO:teuthology.orchestra.run.smithi055.stdout: osd: 8 osds: 8 up (since 10m), 8 in (since 10m) 2024-04-02T07:32:41.200 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:32:41.200 INFO:teuthology.orchestra.run.smithi055.stdout: data: 2024-04-02T07:32:41.200 INFO:teuthology.orchestra.run.smithi055.stdout: volumes: 1/1 healthy 2024-04-02T07:32:41.200 INFO:teuthology.orchestra.run.smithi055.stdout: pools: 3 pools, 97 pgs 2024-04-02T07:32:41.200 INFO:teuthology.orchestra.run.smithi055.stdout: objects: 30 objects, 19 MiB 2024-04-02T07:32:41.201 INFO:teuthology.orchestra.run.smithi055.stdout: usage: 290 MiB used, 720 GiB / 720 GiB avail 2024-04-02T07:32:41.201 INFO:teuthology.orchestra.run.smithi055.stdout: pgs: 97 active+clean 2024-04-02T07:32:41.201 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:32:41.201 INFO:teuthology.orchestra.run.smithi055.stdout: io: 2024-04-02T07:32:41.201 INFO:teuthology.orchestra.run.smithi055.stdout: client: 1.8 KiB/s rd, 102 B/s wr, 1 op/s rd, 0 op/s wr 2024-04-02T07:32:41.201 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:32:41.201 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:32:41.201 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:32:39.433122+0000 mon.a [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-04-02T07:32:41.201 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:32:39.433151+0000 mon.a [INF] Cluster is now healthy 2024-04-02T07:32:41.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7fb893e00640 1 --2- 172.21.15.55:0/2385230462 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb874066690 0x7fb874068b50 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7fb8840011f0 tx=0x7fb884007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:41.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f92868000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e2f8f60 0x56476e2f8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f92868000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e341d30 0x56476e2f8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f92868000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e342650 0x56476e32dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f92868000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56476de03cf0 con 0x56476e342650 2024-04-02T07:32:41.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f92868000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56476e107090 con 0x56476e341d30 2024-04-02T07:32:41.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f92868000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x56476e14f010 con 0x56476e2f8f60 2024-04-02T07:32:41.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f8d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e342650 0x56476e32dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f8d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e342650 0x56476e32dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48608/0 (socket says 172.21.15.55:48608) 2024-04-02T07:32:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f8d400640 1 -- 172.21.15.55:0/1034541285 learned_addr learned my addr 172.21.15.55:0/1034541285 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f8ca00640 1 --2- 172.21.15.55:0/1034541285 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e2f8f60 0x56476e2f8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f7fe00640 1 --2- 172.21.15.55:0/1034541285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e341d30 0x56476e2f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f8d400640 1 -- 172.21.15.55:0/1034541285 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e2f8f60 msgr2=0x56476e2f8310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f8d400640 1 --2- 172.21.15.55:0/1034541285 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e2f8f60 0x56476e2f8310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f8d400640 1 -- 172.21.15.55:0/1034541285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e341d30 msgr2=0x56476e2f8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f8d400640 1 --2- 172.21.15.55:0/1034541285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e341d30 0x56476e2f8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f8d400640 1 -- 172.21.15.55:0/1034541285 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56476e0f1ef0 con 0x56476e342650 2024-04-02T07:32:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f8d400640 1 --2- 172.21.15.55:0/1034541285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e342650 0x56476e32dfa0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f3f80015720 tx=0x7f3f8001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5e2cb3a21903486 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f7e000640 1 -- 172.21.15.55:0/1034541285 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f800169c0 con 0x56476e342650 2024-04-02T07:32:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f7e000640 1 -- 172.21.15.55:0/1034541285 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8000f040 con 0x56476e342650 2024-04-02T07:32:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f7e000640 1 -- 172.21.15.55:0/1034541285 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f80016d20 con 0x56476e342650 2024-04-02T07:32:41.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f92868000 1 -- 172.21.15.55:0/1034541285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e342650 msgr2=0x56476e32dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.197+0000 7f3f92868000 1 --2- 172.21.15.55:0/1034541285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e342650 0x56476e32dfa0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f3f80015720 tx=0x7f3f8001b000 comp rx=0 tx=0).stop 2024-04-02T07:32:41.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 1 -- 172.21.15.55:0/1034541285 shutdown_connections 2024-04-02T07:32:41.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 1 --2- 172.21.15.55:0/1034541285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e342650 0x56476e32dfa0 unknown :-1 s=CLOSED pgs=1593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 1 --2- 172.21.15.55:0/1034541285 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e341d30 0x56476e2f8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 1 --2- 172.21.15.55:0/1034541285 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e2f8f60 0x56476e2f8310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 1 -- 172.21.15.55:0/1034541285 >> 172.21.15.55:0/1034541285 conn(0x56476e2f4f10 msgr2=0x56476e32d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:41.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 1 -- 172.21.15.55:0/1034541285 shutdown_connections 2024-04-02T07:32:41.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 1 -- 172.21.15.55:0/1034541285 wait complete. 2024-04-02T07:32:41.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 1 -- start start 2024-04-02T07:32:41.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 1 Processor -- start 2024-04-02T07:32:41.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e2f8f60 0x56476e3a0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e341d30 0x56476e3544e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e342650 0x56476e354a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56476e0ce150 con 0x56476e2f8f60 2024-04-02T07:32:41.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56476e1497a0 con 0x56476e342650 2024-04-02T07:32:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x56476e10d420 con 0x56476e341d30 2024-04-02T07:32:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 10 client.0 _ll_register_callbacks cb 0x56476e1c00c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:32:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f8ca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e2f8f60 0x56476e3a0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f8ca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e2f8f60 0x56476e3a0470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48624/0 (socket says 172.21.15.55:48624) 2024-04-02T07:32:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f8ca00640 1 -- 172.21.15.55:0/1427711892 learned_addr learned my addr 172.21.15.55:0/1427711892 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f7fe00640 1 --2- 172.21.15.55:0/1427711892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e341d30 0x56476e3544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f8d400640 1 --2- 172.21.15.55:0/1427711892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e342650 0x56476e354a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f8ca00640 1 -- 172.21.15.55:0/1427711892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e341d30 msgr2=0x56476e3544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f8ca00640 1 --2- 172.21.15.55:0/1427711892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e341d30 0x56476e3544e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f8ca00640 1 -- 172.21.15.55:0/1427711892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e342650 msgr2=0x56476e354a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f8ca00640 1 --2- 172.21.15.55:0/1427711892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e342650 0x56476e354a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f8ca00640 1 -- 172.21.15.55:0/1427711892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f80015420 con 0x56476e2f8f60 2024-04-02T07:32:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f8d400640 1 --2- 172.21.15.55:0/1427711892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e342650 0x56476e354a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:32:41.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f7fe00640 1 --2- 172.21.15.55:0/1427711892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e341d30 0x56476e3544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:32:41.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f8ca00640 1 --2- 172.21.15.55:0/1427711892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e2f8f60 0x56476e3a0470 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f3f78006d20 tx=0x7f3f78004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2432942cd87242ca server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:41.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f76000640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:32:41.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f76000640 1 -- 172.21.15.55:0/1427711892 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f78023040 con 0x56476e2f8f60 2024-04-02T07:32:41.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f76000640 1 -- 172.21.15.55:0/1427711892 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3f7800b960 con 0x56476e2f8f60 2024-04-02T07:32:41.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 1 -- 172.21.15.55:0/1427711892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56476e1035f0 con 0x56476e2f8f60 2024-04-02T07:32:41.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f76000640 1 -- 172.21.15.55:0/1427711892 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f780285b0 con 0x56476e2f8f60 2024-04-02T07:32:41.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 10 client.8967 fetch_fsmap learned FSMap version 87 2024-04-02T07:32:41.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 1 -- 172.21.15.55:0/1427711892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) v3 -- 0x56476e0e5a60 con 0x56476e2f8f60 2024-04-02T07:32:41.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f76000640 1 -- 172.21.15.55:0/1427711892 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56476e1035f0 con 0x56476e2f8f60 2024-04-02T07:32:41.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f76000640 1 -- 172.21.15.55:0/1427711892 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 87) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3f7800bb20 con 0x56476e2f8f60 2024-04-02T07:32:41.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 10 client.8967 fetch_fsmap finished waiting for FSMap version 87 2024-04-02T07:32:41.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 10 client.8967 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-02T07:32:41.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 20 client.8967 populate_metadata read hostname 'smithi055' 2024-04-02T07:32:41.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 1 --2- 172.21.15.55:0/1427711892 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x56476e354f60 0x56476e355370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 4 client.8967 mds_command: new command op to 8868 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}] 2024-04-02T07:32:41.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f92868000 1 -- 172.21.15.55:0/1427711892 --> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["repair", "recursive"]}) v1 -- 0x56476e105410 con 0x56476e354f60 2024-04-02T07:32:41.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.201+0000 7f3f7fe00640 1 --2- 172.21.15.55:0/1427711892 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x56476e354f60 0x56476e355370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f7fe00640 1 --2- 172.21.15.55:0/1427711892 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x56476e354f60 0x56476e355370 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f4e71bdd0e2d557 server_cookie=c5fdaeba0bc18eb in_seq=0 out_seq=0 2024-04-02T07:32:41.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f76000640 10 client.8967 ms_handle_connect on v2:172.21.15.55:6834/1137835746 2024-04-02T07:32:41.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f76000640 1 -- 172.21.15.55:0/1427711892 <== mds.0 v2:172.21.15.55:6834/1137835746 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x56476e105410 con 0x56476e354f60 2024-04-02T07:32:41.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f76000640 10 client.8967 handle_command_reply: tid=0 2024-04-02T07:32:41.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f92868000 1 client.8967 shutdown 2024-04-02T07:32:41.211 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f0cd5000640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-04-02T07:32:41.212 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f0cd5000640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-04-02T07:32:41.212 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f0cd5000640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-04-02T07:32:41.212 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f0cd5000640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-04-02T07:32:41.212 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f92868000 1 -- 172.21.15.55:0/1427711892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e2f8f60 msgr2=0x56476e3a0470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f92868000 1 --2- 172.21.15.55:0/1427711892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e2f8f60 0x56476e3a0470 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f3f78006d20 tx=0x7f3f78004740 comp rx=0 tx=0).stop 2024-04-02T07:32:41.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f92868000 1 -- 172.21.15.55:0/1427711892 shutdown_connections 2024-04-02T07:32:41.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f92868000 1 --2- 172.21.15.55:0/1427711892 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x56476e354f60 0x56476e355370 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f92868000 1 --2- 172.21.15.55:0/1427711892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56476e342650 0x56476e354a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f92868000 1 --2- 172.21.15.55:0/1427711892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56476e341d30 0x56476e3544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f92868000 1 --2- 172.21.15.55:0/1427711892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56476e2f8f60 0x56476e3a0470 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f92868000 1 -- 172.21.15.55:0/1427711892 >> 172.21.15.55:0/1427711892 conn(0x56476e2f4f10 msgr2=0x56476e2fea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:41.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f76000640 0 client.8967 ms_handle_reset on v2:172.21.15.55:6834/1137835746 2024-04-02T07:32:41.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f92868000 1 -- 172.21.15.55:0/1427711892 shutdown_connections 2024-04-02T07:32:41.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f92868000 1 -- 172.21.15.55:0/1427711892 wait complete. 2024-04-02T07:32:41.213 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f92868000 20 client.8967 trim_cache size 0 max 16384 2024-04-02T07:32:41.214 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:32:41.214 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0, 2024-04-02T07:32:41.214 INFO:teuthology.orchestra.run.smithi055.stdout: "scrub_tag": "1fd12daa-4703-45e6-8f6a-b47699c13ee2", 2024-04-02T07:32:41.214 INFO:teuthology.orchestra.run.smithi055.stdout: "mode": "asynchronous" 2024-04-02T07:32:41.214 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:32:41.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f8f400640 1 -- 172.21.15.55:0/762634902 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f64066690 msgr2=0x7f3f64068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f8f400640 1 --2- 172.21.15.55:0/762634902 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f64066690 0x7f3f64068b50 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f3f880d10a0 tx=0x7f3f800097d0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f8f400640 1 -- 172.21.15.55:0/762634902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f8815d450 msgr2=0x7f3f88154a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f8f400640 1 --2- 172.21.15.55:0/762634902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f8815d450 0x7f3f88154a90 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f3f700ac040 tx=0x7f3f7001ad30 comp rx=0 tx=0).stop 2024-04-02T07:32:41.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f8f400640 1 -- 172.21.15.55:0/762634902 shutdown_connections 2024-04-02T07:32:41.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f8f400640 1 --2- 172.21.15.55:0/762634902 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3f88160550 0x7f3f88154fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f8f400640 1 --2- 172.21.15.55:0/762634902 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3f8815d450 0x7f3f88154a90 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f8f400640 1 --2- 172.21.15.55:0/762634902 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f64066690 0x7f3f64068b50 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f8f400640 1 --2- 172.21.15.55:0/762634902 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3f880ccf80 0x7f3f88158780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f8f400640 1 -- 172.21.15.55:0/762634902 >> 172.21.15.55:0/762634902 conn(0x7f3f880d0700 msgr2=0x7f3f8806f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:41.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f8f400640 1 -- 172.21.15.55:0/762634902 shutdown_connections 2024-04-02T07:32:41.215 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.205+0000 7f3f8f400640 1 -- 172.21.15.55:0/762634902 wait complete. 2024-04-02T07:32:41.226 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:32:41.226 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-02T07:32:41.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.365+0000 7f3221e00640 1 Processor -- start 2024-04-02T07:32:41.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.365+0000 7f3221e00640 1 -- start start 2024-04-02T07:32:41.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.369+0000 7f3221e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f321c06a4a0 0x7f321c0cb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.369+0000 7f3221e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321c15bbc0 con 0x7f321c15eca0 2024-04-02T07:32:41.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.369+0000 7f3221e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f321c15b040 con 0x7f321c158400 2024-04-02T07:32:41.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.369+0000 7f3221e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f321c15b320 con 0x7f321c06a4a0 2024-04-02T07:32:41.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.369+0000 7f3213e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f321c06a4a0 0x7f321c0cb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.369+0000 7f321b400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f321c15eca0 0x7f321c0ce680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35840/0 (socket says 172.21.15.55:35840) 2024-04-02T07:32:41.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.369+0000 7f321b400640 1 -- 172.21.15.55:0/3590637396 learned_addr learned my addr 172.21.15.55:0/3590637396 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:32:41.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.369+0000 7f3213e00640 1 -- 172.21.15.55:0/3590637396 >> v1:172.21.15.106:6789/0 conn(0x7f321c158400 legacy=0x7f321c069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.369+0000 7f3213e00640 1 -- 172.21.15.55:0/3590637396 >> v1:172.21.15.55:6789/0 conn(0x7f321c15eca0 legacy=0x7f321c0ce680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.369+0000 7f3213e00640 1 -- 172.21.15.55:0/3590637396 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f321c15b600 con 0x7f321c06a4a0 2024-04-02T07:32:41.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.369+0000 7f3213e00640 1 --2- 172.21.15.55:0/3590637396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f321c06a4a0 0x7f321c0cb270 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f32040097c0 tx=0x7f320401ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d924b6868e07059a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:41.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f321a000640 1 -- 172.21.15.55:0/3590637396 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32040aa5f0 con 0x7f321c06a4a0 2024-04-02T07:32:41.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f321a000640 1 -- 172.21.15.55:0/3590637396 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32040aa750 con 0x7f321c06a4a0 2024-04-02T07:32:41.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f321a000640 1 -- 172.21.15.55:0/3590637396 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32040aaae0 con 0x7f321c06a4a0 2024-04-02T07:32:41.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3221e00640 1 -- 172.21.15.55:0/3590637396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f321c06a4a0 msgr2=0x7f321c0cb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3221e00640 1 --2- 172.21.15.55:0/3590637396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f321c06a4a0 0x7f321c0cb270 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f32040097c0 tx=0x7f320401ced0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3221e00640 1 -- 172.21.15.55:0/3590637396 shutdown_connections 2024-04-02T07:32:41.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3221e00640 1 --2- 172.21.15.55:0/3590637396 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f321c06a4a0 0x7f321c0cb270 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3221e00640 1 -- 172.21.15.55:0/3590637396 >> 172.21.15.55:0/3590637396 conn(0x7f321c098a10 msgr2=0x7f321c0b1070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:41.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3221e00640 1 -- 172.21.15.55:0/3590637396 shutdown_connections 2024-04-02T07:32:41.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3221e00640 1 -- 172.21.15.55:0/3590637396 wait complete. 2024-04-02T07:32:41.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3221e00640 1 Processor -- start 2024-04-02T07:32:41.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3221e00640 1 -- start start 2024-04-02T07:32:41.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3221e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f321c06a4a0 0x7f321c13d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3221e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f321c158400 0x7f321c0c4660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3221e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f321c15eca0 0x7f321c15bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3221e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c0c2900 con 0x7f321c158400 2024-04-02T07:32:41.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3221e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f321c15d4a0 con 0x7f321c15eca0 2024-04-02T07:32:41.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3221e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f321c15c890 con 0x7f321c06a4a0 2024-04-02T07:32:41.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3213e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f321c158400 0x7f321c0c4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3213e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f321c158400 0x7f321c0c4660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48646/0 (socket says 172.21.15.55:48646) 2024-04-02T07:32:41.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3213e00640 1 -- 172.21.15.55:0/3202905883 learned_addr learned my addr 172.21.15.55:0/3202905883 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:41.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f321b400640 1 --2- 172.21.15.55:0/3202905883 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f321c15eca0 0x7f321c15bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f321aa00640 1 --2- 172.21.15.55:0/3202905883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f321c06a4a0 0x7f321c13d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3213e00640 1 -- 172.21.15.55:0/3202905883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f321c06a4a0 msgr2=0x7f321c13d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3213e00640 1 --2- 172.21.15.55:0/3202905883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f321c06a4a0 0x7f321c13d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3213e00640 1 -- 172.21.15.55:0/3202905883 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f321c15eca0 msgr2=0x7f321c15bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.373+0000 7f3213e00640 1 --2- 172.21.15.55:0/3202905883 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f321c15eca0 0x7f321c15bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.377+0000 7f3213e00640 1 -- 172.21.15.55:0/3202905883 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3204009420 con 0x7f321c158400 2024-04-02T07:32:41.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.377+0000 7f321aa00640 1 --2- 172.21.15.55:0/3202905883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f321c06a4a0 0x7f321c13d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:32:41.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.377+0000 7f3213e00640 1 --2- 172.21.15.55:0/3202905883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f321c158400 0x7f321c0c4660 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f320401a0a0 tx=0x7f320401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:41.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.377+0000 7f3213400640 1 -- 172.21.15.55:0/3202905883 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32040b4810 con 0x7f321c158400 2024-04-02T07:32:41.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.377+0000 7f3213400640 1 -- 172.21.15.55:0/3202905883 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32040b4970 con 0x7f321c158400 2024-04-02T07:32:41.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.377+0000 7f3213400640 1 -- 172.21.15.55:0/3202905883 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32040b4d20 con 0x7f321c158400 2024-04-02T07:32:41.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.377+0000 7f3221e00640 1 -- 172.21.15.55:0/3202905883 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321c15cb70 con 0x7f321c158400 2024-04-02T07:32:41.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.377+0000 7f3221e00640 1 -- 172.21.15.55:0/3202905883 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321c15d130 con 0x7f321c158400 2024-04-02T07:32:41.379 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.377+0000 7f3213400640 1 -- 172.21.15.55:0/3202905883 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f32040b3390 con 0x7f321c158400 2024-04-02T07:32:41.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.377+0000 7f3213400640 1 --2- 172.21.15.55:0/3202905883 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f31f8066690 0x7f31f8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.377+0000 7f3213400640 1 -- 172.21.15.55:0/3202905883 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f32040a7070 con 0x7f321c158400 2024-04-02T07:32:41.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.377+0000 7f3225232000 1 Processor -- start 2024-04-02T07:32:41.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f3225232000 1 -- start start 2024-04-02T07:32:41.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f321aa00640 1 --2- 172.21.15.55:0/3202905883 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f31f8066690 0x7f31f8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f3225232000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dba70 0x55e97c1dbe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f3225232000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c1dc390 0x55e97c18f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f3225232000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e97c18fa00 0x55e97c18fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f3225232000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97c05a630 con 0x55e97c1dba70 2024-04-02T07:32:41.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f3225232000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97bfe7bd0 con 0x55e97c1dc390 2024-04-02T07:32:41.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f3225232000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e97bfe51a0 con 0x55e97c18fa00 2024-04-02T07:32:41.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f321aa00640 1 --2- 172.21.15.55:0/3202905883 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f31f8066690 0x7f31f8068b50 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f320c000f70 tx=0x7f320c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:41.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f321aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dba70 0x55e97c1dbe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f321aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dba70 0x55e97c1dbe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48650/0 (socket says 172.21.15.55:48650) 2024-04-02T07:32:41.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f321aa00640 1 -- 172.21.15.55:0/1374536198 learned_addr learned my addr 172.21.15.55:0/1374536198 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:41.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f3213e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c1dc390 0x55e97c18f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f321b400640 1 --2- 172.21.15.55:0/1374536198 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e97c18fa00 0x55e97c18fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f321aa00640 1 -- 172.21.15.55:0/1374536198 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e97c18fa00 msgr2=0x55e97c18fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:41.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f321aa00640 1 --2- 172.21.15.55:0/1374536198 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e97c18fa00 0x55e97c18fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f321aa00640 1 -- 172.21.15.55:0/1374536198 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c1dc390 msgr2=0x55e97c18f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:41.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f321aa00640 1 --2- 172.21.15.55:0/1374536198 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c1dc390 0x55e97c18f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f321aa00640 1 -- 172.21.15.55:0/1374536198 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e97bcdce20 con 0x55e97c1dba70 2024-04-02T07:32:41.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f321aa00640 1 --2- 172.21.15.55:0/1374536198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dba70 0x55e97c1dbe50 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f320c0050d0 tx=0x7f320c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabaec92611acab3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:41.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f320be00640 1 -- 172.21.15.55:0/1374536198 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c003600 con 0x55e97c1dba70 2024-04-02T07:32:41.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f320be00640 1 -- 172.21.15.55:0/1374536198 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320c003760 con 0x55e97c1dba70 2024-04-02T07:32:41.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f320be00640 1 -- 172.21.15.55:0/1374536198 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c003af0 con 0x55e97c1dba70 2024-04-02T07:32:41.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f3225232000 1 -- 172.21.15.55:0/1374536198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dba70 msgr2=0x55e97c1dbe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f3225232000 1 --2- 172.21.15.55:0/1374536198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dba70 0x55e97c1dbe50 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f320c0050d0 tx=0x7f320c011000 comp rx=0 tx=0).stop 2024-04-02T07:32:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f3225232000 1 -- 172.21.15.55:0/1374536198 shutdown_connections 2024-04-02T07:32:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f3225232000 1 --2- 172.21.15.55:0/1374536198 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e97c18fa00 0x55e97c18fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f3225232000 1 --2- 172.21.15.55:0/1374536198 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c1dc390 0x55e97c18f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f3225232000 1 --2- 172.21.15.55:0/1374536198 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dba70 0x55e97c1dbe50 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f3225232000 1 -- 172.21.15.55:0/1374536198 >> 172.21.15.55:0/1374536198 conn(0x55e97bf90160 msgr2=0x55e97c1be820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f3225232000 1 -- 172.21.15.55:0/1374536198 shutdown_connections 2024-04-02T07:32:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f3225232000 1 -- 172.21.15.55:0/1374536198 wait complete. 2024-04-02T07:32:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.381+0000 7f3225232000 1 -- start start 2024-04-02T07:32:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3225232000 1 Processor -- start 2024-04-02T07:32:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3225232000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e97c18fa00 0x55e97c1987b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3225232000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c1dba70 0x55e97c1bfa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3225232000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dc390 0x55e97c1bff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3225232000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97bfe0a90 con 0x55e97c1dc390 2024-04-02T07:32:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3225232000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97bf7fd40 con 0x55e97c1dba70 2024-04-02T07:32:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3225232000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e97bf9df30 con 0x55e97c18fa00 2024-04-02T07:32:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3225232000 10 client.0 _ll_register_callbacks cb 0x55e97c042810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:32:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f321b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dc390 0x55e97c1bff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f321b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dc390 0x55e97c1bff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48664/0 (socket says 172.21.15.55:48664) 2024-04-02T07:32:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f321b400640 1 -- 172.21.15.55:0/2018587125 learned_addr learned my addr 172.21.15.55:0/2018587125 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f321aa00640 1 --2- 172.21.15.55:0/2018587125 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e97c18fa00 0x55e97c1987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3213e00640 1 --2- 172.21.15.55:0/2018587125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c1dba70 0x55e97c1bfa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f321b400640 1 -- 172.21.15.55:0/2018587125 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e97c18fa00 msgr2=0x55e97c1987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f321b400640 1 --2- 172.21.15.55:0/2018587125 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e97c18fa00 0x55e97c1987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f321b400640 1 -- 172.21.15.55:0/2018587125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c1dba70 msgr2=0x55e97c1bfa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f321b400640 1 --2- 172.21.15.55:0/2018587125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c1dba70 0x55e97c1bfa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f321b400640 1 -- 172.21.15.55:0/2018587125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f320c00f040 con 0x55e97c1dc390 2024-04-02T07:32:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3213e00640 1 --2- 172.21.15.55:0/2018587125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c1dba70 0x55e97c1bfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:32:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f321b400640 1 --2- 172.21.15.55:0/2018587125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dc390 0x55e97c1bff90 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f3214012980 tx=0x7f3214012e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c08116d834047863 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3208c00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:32:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3208c00640 1 -- 172.21.15.55:0/2018587125 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3214001dc0 con 0x55e97c1dc390 2024-04-02T07:32:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3208c00640 1 -- 172.21.15.55:0/2018587125 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f3214010a90 con 0x55e97c1dc390 2024-04-02T07:32:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3225232000 1 -- 172.21.15.55:0/2018587125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e97bfdf3e0 con 0x55e97c1dc390 2024-04-02T07:32:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3208c00640 1 -- 172.21.15.55:0/2018587125 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3214010c90 con 0x55e97c1dc390 2024-04-02T07:32:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3225232000 10 client.8982 fetch_fsmap learned FSMap version 87 2024-04-02T07:32:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3225232000 1 -- 172.21.15.55:0/2018587125 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) v3 -- 0x55e97bfa5aa0 con 0x55e97c1dc390 2024-04-02T07:32:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3208c00640 1 -- 172.21.15.55:0/2018587125 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e97bfdf3e0 con 0x55e97c1dc390 2024-04-02T07:32:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3208c00640 1 -- 172.21.15.55:0/2018587125 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 87) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f32140070d0 con 0x55e97c1dc390 2024-04-02T07:32:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3225232000 10 client.8982 fetch_fsmap finished waiting for FSMap version 87 2024-04-02T07:32:41.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3225232000 10 client.8982 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-02T07:32:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3225232000 20 client.8982 populate_metadata read hostname 'smithi055' 2024-04-02T07:32:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3225232000 1 --2- 172.21.15.55:0/2018587125 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x55e97c1e32d0 0x55e97c1e36e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3225232000 4 client.8982 mds_command: new command op to 8868 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:32:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3225232000 1 -- 172.21.15.55:0/2018587125 --> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e97bfb0d00 con 0x55e97c1e32d0 2024-04-02T07:32:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f321aa00640 1 --2- 172.21.15.55:0/2018587125 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x55e97c1e32d0 0x55e97c1e36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f321aa00640 1 --2- 172.21.15.55:0/2018587125 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x55e97c1e32d0 0x55e97c1e36e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dcf373b5f29907bd server_cookie=ac64c7f86778b55b in_seq=0 out_seq=0 2024-04-02T07:32:41.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.385+0000 7f3208c00640 10 client.8982 ms_handle_connect on v2:172.21.15.55:6834/1137835746 2024-04-02T07:32:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.389+0000 7f3208c00640 1 -- 172.21.15.55:0/2018587125 <== mds.0 v2:172.21.15.55:6834/1137835746 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55e97bfb0d00 con 0x55e97c1e32d0 2024-04-02T07:32:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.389+0000 7f3208c00640 10 client.8982 handle_command_reply: tid=0 2024-04-02T07:32:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.389+0000 7f3225232000 1 client.8982 shutdown 2024-04-02T07:32:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.389+0000 7f3225232000 1 -- 172.21.15.55:0/2018587125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dc390 msgr2=0x55e97c1bff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.389+0000 7f3225232000 1 --2- 172.21.15.55:0/2018587125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dc390 0x55e97c1bff90 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f3214012980 tx=0x7f3214012e40 comp rx=0 tx=0).stop 2024-04-02T07:32:41.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.389+0000 7f3225232000 1 -- 172.21.15.55:0/2018587125 shutdown_connections 2024-04-02T07:32:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.389+0000 7f3225232000 1 --2- 172.21.15.55:0/2018587125 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dc390 0x55e97c1bff90 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.389+0000 7f3225232000 1 --2- 172.21.15.55:0/2018587125 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x55e97c1e32d0 0x55e97c1e36e0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.389+0000 7f3225232000 1 --2- 172.21.15.55:0/2018587125 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c1dba70 0x55e97c1bfa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.389+0000 7f3225232000 1 --2- 172.21.15.55:0/2018587125 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e97c18fa00 0x55e97c1987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.389+0000 7f3225232000 1 -- 172.21.15.55:0/2018587125 >> 172.21.15.55:0/2018587125 conn(0x55e97bf90160 msgr2=0x55e97c18ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.389+0000 7f3208c00640 0 client.8982 ms_handle_reset on v2:172.21.15.55:6834/1137835746 2024-04-02T07:32:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.389+0000 7f3225232000 1 -- 172.21.15.55:0/2018587125 shutdown_connections 2024-04-02T07:32:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.389+0000 7f3225232000 1 -- 172.21.15.55:0/2018587125 wait complete. 2024-04-02T07:32:41.393 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.389+0000 7f3225232000 20 client.8982 trim_cache size 0 max 16384 2024-04-02T07:32:41.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.401+0000 7f3225232000 1 Processor -- start 2024-04-02T07:32:41.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.401+0000 7f3225232000 1 -- start start 2024-04-02T07:32:41.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c18fa00 0x55e97c18ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e97c1dba70 0x55e97c18f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dc390 0x55e97c18fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97bc9daa0 con 0x55e97c1dc390 2024-04-02T07:32:41.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97bfdc280 con 0x55e97c18fa00 2024-04-02T07:32:41.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e97bfb00b0 con 0x55e97c1dba70 2024-04-02T07:32:41.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f321b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dc390 0x55e97c18fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f321b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dc390 0x55e97c18fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48670/0 (socket says 172.21.15.55:48670) 2024-04-02T07:32:41.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f321b400640 1 -- 172.21.15.55:0/1497987636 learned_addr learned my addr 172.21.15.55:0/1497987636 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:41.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3213e00640 1 --2- 172.21.15.55:0/1497987636 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e97c1dba70 0x55e97c18f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f321aa00640 1 --2- 172.21.15.55:0/1497987636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c18fa00 0x55e97c18ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f321b400640 1 -- 172.21.15.55:0/1497987636 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e97c1dba70 msgr2=0x55e97c18f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:41.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f321b400640 1 --2- 172.21.15.55:0/1497987636 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e97c1dba70 0x55e97c18f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f321b400640 1 -- 172.21.15.55:0/1497987636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c18fa00 msgr2=0x55e97c18ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:41.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f321b400640 1 --2- 172.21.15.55:0/1497987636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c18fa00 0x55e97c18ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f321b400640 1 -- 172.21.15.55:0/1497987636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e97bf8bdf0 con 0x55e97c1dc390 2024-04-02T07:32:41.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f321b400640 1 --2- 172.21.15.55:0/1497987636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dc390 0x55e97c18fde0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f3214001230 tx=0x7f321400c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb20397014c54ee server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:41.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3210c00640 1 -- 172.21.15.55:0/1497987636 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3214010610 con 0x55e97c1dc390 2024-04-02T07:32:41.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3210c00640 1 -- 172.21.15.55:0/1497987636 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3214007680 con 0x55e97c1dc390 2024-04-02T07:32:41.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3210c00640 1 -- 172.21.15.55:0/1497987636 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3214007890 con 0x55e97c1dc390 2024-04-02T07:32:41.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 -- 172.21.15.55:0/1497987636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dc390 msgr2=0x55e97c18fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 --2- 172.21.15.55:0/1497987636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dc390 0x55e97c18fde0 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f3214001230 tx=0x7f321400c000 comp rx=0 tx=0).stop 2024-04-02T07:32:41.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 -- 172.21.15.55:0/1497987636 shutdown_connections 2024-04-02T07:32:41.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 --2- 172.21.15.55:0/1497987636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dc390 0x55e97c18fde0 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 --2- 172.21.15.55:0/1497987636 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e97c1dba70 0x55e97c18f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 --2- 172.21.15.55:0/1497987636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c18fa00 0x55e97c18ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 -- 172.21.15.55:0/1497987636 >> 172.21.15.55:0/1497987636 conn(0x55e97bf90160 msgr2=0x55e97c196f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:41.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 -- 172.21.15.55:0/1497987636 shutdown_connections 2024-04-02T07:32:41.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 -- 172.21.15.55:0/1497987636 wait complete. 2024-04-02T07:32:41.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 -- start start 2024-04-02T07:32:41.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 Processor -- start 2024-04-02T07:32:41.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c18fa00 0x55e97c23ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dba70 0x55e97c23bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e97c1dc390 0x55e97c192600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97c038920 con 0x55e97c1dba70 2024-04-02T07:32:41.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97c1e9910 con 0x55e97c18fa00 2024-04-02T07:32:41.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e97bfe2020 con 0x55e97c1dc390 2024-04-02T07:32:41.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3225232000 10 client.0 _ll_register_callbacks cb 0x7f320c001450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:32:41.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.405+0000 7f3213e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dba70 0x55e97c23bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3213e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dba70 0x55e97c23bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:48684/0 (socket says 172.21.15.55:48684) 2024-04-02T07:32:41.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3213e00640 1 -- 172.21.15.55:0/1643859328 learned_addr learned my addr 172.21.15.55:0/1643859328 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:32:41.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f321aa00640 1 --2- 172.21.15.55:0/1643859328 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c18fa00 0x55e97c23ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f321b400640 1 --2- 172.21.15.55:0/1643859328 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e97c1dc390 0x55e97c192600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3213e00640 1 -- 172.21.15.55:0/1643859328 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e97c1dc390 msgr2=0x55e97c192600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:41.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3213e00640 1 --2- 172.21.15.55:0/1643859328 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e97c1dc390 0x55e97c192600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3213e00640 1 -- 172.21.15.55:0/1643859328 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c18fa00 msgr2=0x55e97c23ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:32:41.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3213e00640 1 --2- 172.21.15.55:0/1643859328 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c18fa00 0x55e97c23ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3213e00640 1 -- 172.21.15.55:0/1643859328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e97bfa5aa0 con 0x55e97c1dba70 2024-04-02T07:32:41.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3213e00640 1 --2- 172.21.15.55:0/1643859328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dba70 0x55e97c23bf40 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f32040ba000 tx=0x7f32040f3510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f4ba716829c9c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:32:41.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3208c00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:32:41.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3208c00640 1 -- 172.21.15.55:0/1643859328 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32040eec80 con 0x55e97c1dba70 2024-04-02T07:32:41.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3208c00640 1 -- 172.21.15.55:0/1643859328 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f32040eede0 con 0x55e97c1dba70 2024-04-02T07:32:41.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 1 -- 172.21.15.55:0/1643859328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e97bf9d970 con 0x55e97c1dba70 2024-04-02T07:32:41.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3208c00640 1 -- 172.21.15.55:0/1643859328 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f32040f7640 con 0x55e97c1dba70 2024-04-02T07:32:41.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 10 client.8988 fetch_fsmap learned FSMap version 87 2024-04-02T07:32:41.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 1 -- 172.21.15.55:0/1643859328 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) v3 -- 0x55e97bf7f960 con 0x55e97c1dba70 2024-04-02T07:32:41.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3208c00640 1 -- 172.21.15.55:0/1643859328 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e97bf9d970 con 0x55e97c1dba70 2024-04-02T07:32:41.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3208c00640 1 -- 172.21.15.55:0/1643859328 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 87) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f32040a9070 con 0x55e97c1dba70 2024-04-02T07:32:41.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 10 client.8988 fetch_fsmap finished waiting for FSMap version 87 2024-04-02T07:32:41.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 10 client.8988 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-02T07:32:41.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 20 client.8988 populate_metadata read hostname 'smithi055' 2024-04-02T07:32:41.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 1 --2- 172.21.15.55:0/1643859328 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x55e97c192b40 0x55e97c192f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:32:41.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 4 client.8988 mds_command: new command op to 8868 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-02T07:32:41.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 1 -- 172.21.15.55:0/1643859328 --> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55e97c00fa20 con 0x55e97c192b40 2024-04-02T07:32:41.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f321aa00640 1 --2- 172.21.15.55:0/1643859328 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x55e97c192b40 0x55e97c192f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:32:41.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f321aa00640 1 --2- 172.21.15.55:0/1643859328 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x55e97c192b40 0x55e97c192f50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3cfb4fd23aa7d5a server_cookie=ff8da1e0d8cac64f in_seq=0 out_seq=0 2024-04-02T07:32:41.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3208c00640 10 client.8988 ms_handle_connect on v2:172.21.15.55:6834/1137835746 2024-04-02T07:32:41.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3208c00640 1 -- 172.21.15.55:0/1643859328 <== mds.0 v2:172.21.15.55:6834/1137835746 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+260 (crc 0 0 0) 0x55e97c00fa20 con 0x55e97c192b40 2024-04-02T07:32:41.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3208c00640 10 client.8988 handle_command_reply: tid=0 2024-04-02T07:32:41.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 1 client.8988 shutdown 2024-04-02T07:32:41.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 1 -- 172.21.15.55:0/1643859328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dba70 msgr2=0x55e97c23bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 1 --2- 172.21.15.55:0/1643859328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dba70 0x55e97c23bf40 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f32040ba000 tx=0x7f32040f3510 comp rx=0 tx=0).stop 2024-04-02T07:32:41.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 1 -- 172.21.15.55:0/1643859328 shutdown_connections 2024-04-02T07:32:41.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 1 --2- 172.21.15.55:0/1643859328 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55e97c1dc390 0x55e97c192600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 1 --2- 172.21.15.55:0/1643859328 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55e97c1dba70 0x55e97c23bf40 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 1 --2- 172.21.15.55:0/1643859328 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x55e97c192b40 0x55e97c192f50 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 1 --2- 172.21.15.55:0/1643859328 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55e97c18fa00 0x55e97c23ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 1 -- 172.21.15.55:0/1643859328 >> 172.21.15.55:0/1643859328 conn(0x55e97bf90160 msgr2=0x55e97c197810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:41.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3208c00640 0 client.8988 ms_handle_reset on v2:172.21.15.55:6834/1137835746 2024-04-02T07:32:41.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 1 -- 172.21.15.55:0/1643859328 shutdown_connections 2024-04-02T07:32:41.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 1 -- 172.21.15.55:0/1643859328 wait complete. 2024-04-02T07:32:41.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3225232000 20 client.8988 trim_cache size 0 max 16384 2024-04-02T07:32:41.416 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:32:41.416 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "IDLE (waiting for more scrubs)", 2024-04-02T07:32:41.416 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": { 2024-04-02T07:32:41.416 INFO:teuthology.orchestra.run.smithi055.stdout: "1fd12daa-4703-45e6-8f6a-b47699c13ee2": { 2024-04-02T07:32:41.416 INFO:teuthology.orchestra.run.smithi055.stdout: "path": "/", 2024-04-02T07:32:41.416 INFO:teuthology.orchestra.run.smithi055.stdout: "tag": "1fd12daa-4703-45e6-8f6a-b47699c13ee2", 2024-04-02T07:32:41.416 INFO:teuthology.orchestra.run.smithi055.stdout: "options": "recursive,repair" 2024-04-02T07:32:41.416 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:32:41.416 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:32:41.416 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:32:41.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3221e00640 1 -- 172.21.15.55:0/3202905883 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f31f8066690 msgr2=0x7f31f8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3221e00640 1 --2- 172.21.15.55:0/3202905883 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f31f8066690 0x7f31f8068b50 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f320c000f70 tx=0x7f320c009040 comp rx=0 tx=0).stop 2024-04-02T07:32:41.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3221e00640 1 -- 172.21.15.55:0/3202905883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f321c158400 msgr2=0x7f321c0c4660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:32:41.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3221e00640 1 --2- 172.21.15.55:0/3202905883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f321c158400 0x7f321c0c4660 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f320401a0a0 tx=0x7f320401acb0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3221e00640 1 -- 172.21.15.55:0/3202905883 shutdown_connections 2024-04-02T07:32:41.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3221e00640 1 --2- 172.21.15.55:0/3202905883 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f31f8066690 0x7f31f8068b50 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3221e00640 1 --2- 172.21.15.55:0/3202905883 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f321c15eca0 0x7f321c15bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3221e00640 1 --2- 172.21.15.55:0/3202905883 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f321c158400 0x7f321c0c4660 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3221e00640 1 --2- 172.21.15.55:0/3202905883 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f321c06a4a0 0x7f321c13d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:32:41.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3221e00640 1 -- 172.21.15.55:0/3202905883 >> 172.21.15.55:0/3202905883 conn(0x7f321c098a10 msgr2=0x7f321c0ac650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:32:41.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3221e00640 1 -- 172.21.15.55:0/3202905883 shutdown_connections 2024-04-02T07:32:41.418 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.409+0000 7f3221e00640 1 -- 172.21.15.55:0/3202905883 wait complete. 2024-04-02T07:32:41.430 INFO:tasks.cephfs.filesystem:scrub status for tag:1fd12daa-4703-45e6-8f6a-b47699c13ee2 - {'path': '/', 'tag': '1fd12daa-4703-45e6-8f6a-b47699c13ee2', 'options': 'recursive,repair'} 2024-04-02T07:32:41.445 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:32:41.208637+0000 mds.a [INF] scrub queued for path: / 2024-04-02T07:32:41.445 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:32:41.208640+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-04-02T07:32:41.445 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:32:41.208644+0000 mds.a [INF] scrub summary: active paths [/] 2024-04-02T07:32:41.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:41.445+0000 7fb88be00640 1 -- 172.21.15.55:0/2385230462 <== mon.0 v2:172.21.15.55:3300/0 8 ==== log(8 entries from seq 1 at 2024-04-02T07:32:41.208637+0000) v1 ==== 1407+0+0 (secure 0 0 0) 0x7fb88c0595d0 con 0x7fb89415df00 2024-04-02T07:32:41.446 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:32:41.209380+0000 mds.a [ERR] scrub: inode wrongly marked free: 0x10000000001 2024-04-02T07:32:41.446 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:32:41.209388+0000 mds.a [ERR] inode table repaired for inode: 0x10000000001 2024-04-02T07:32:41.446 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:32:41.209464+0000 mds.a [ERR] scrub: inode wrongly marked free: 0x10000000002 2024-04-02T07:32:41.446 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:32:41.209469+0000 mds.a [ERR] inode table repaired for inode: 0x10000000002 2024-04-02T07:32:41.446 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:32:41.210087+0000 mds.a [INF] scrub summary: idle+waiting paths [/] 2024-04-02T07:32:42.417 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-04-02T07:32:42.417+0000 7f0cd9600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:32:45.848 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:32:45.851 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:32:47.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:32:47.200+0000 7fb88be00640 1 -- 172.21.15.55:0/2385230462 <== mon.0 v2:172.21.15.55:3300/0 9 ==== log(1 entries from seq 9 at 2024-04-02T07:32:45.435548+0000) v1 ==== 189+0+0 (secure 0 0 0) 0x7fb88c053990 con 0x7fb89415df00 2024-04-02T07:32:47.203 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:32:45.435548+0000 mds.a [INF] scrub summary: idle 2024-04-02T07:33:11.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:11.431 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.7:0 scrub status 2024-04-02T07:33:11.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.584+0000 7fca6da00640 1 Processor -- start 2024-04-02T07:33:11.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.584+0000 7fca6da00640 1 -- start start 2024-04-02T07:33:11.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.584+0000 7fca6da00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca680b3dc0 0x7fca680ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.584+0000 7fca6da00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fca680ade90 0x7fca6806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.584+0000 7fca6da00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca680b41a0 0x7fca68142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.584+0000 7fca6da00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca6806c630 con 0x7fca680b3dc0 2024-04-02T07:33:11.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.584+0000 7fca6da00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca6806c8f0 con 0x7fca680ade90 2024-04-02T07:33:11.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.584+0000 7fca6da00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca6806cbd0 con 0x7fca680b41a0 2024-04-02T07:33:11.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.588+0000 7fca66a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca680b3dc0 0x7fca680ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.588+0000 7fca66a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fca680b3dc0 0x7fca680ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58430/0 (socket says 172.21.15.55:58430) 2024-04-02T07:33:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.588+0000 7fca66a00640 1 -- 172.21.15.55:0/3119231660 learned_addr learned my addr 172.21.15.55:0/3119231660 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.588+0000 7fca67400640 1 --2- 172.21.15.55:0/3119231660 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca680b41a0 0x7fca68142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.588+0000 7fca5fe00640 1 --2- 172.21.15.55:0/3119231660 >> v2:172.21.15.106:3300/0 conn(0x7fca680ade90 0x7fca6806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.588+0000 7fca66a00640 1 -- 172.21.15.55:0/3119231660 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca680b41a0 msgr2=0x7fca68142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.588+0000 7fca66a00640 1 --2- 172.21.15.55:0/3119231660 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca680b41a0 0x7fca68142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.588+0000 7fca66a00640 1 -- 172.21.15.55:0/3119231660 >> v2:172.21.15.106:3300/0 conn(0x7fca680ade90 msgr2=0x7fca6806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.588+0000 7fca66a00640 1 --2- 172.21.15.55:0/3119231660 >> v2:172.21.15.106:3300/0 conn(0x7fca680ade90 0x7fca6806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.588+0000 7fca66a00640 1 -- 172.21.15.55:0/3119231660 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca6806ceb0 con 0x7fca680b3dc0 2024-04-02T07:33:11.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.588+0000 7fca5fe00640 1 --2- 172.21.15.55:0/3119231660 >> v2:172.21.15.106:3300/0 conn(0x7fca680ade90 0x7fca6806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.588+0000 7fca66a00640 1 --2- 172.21.15.55:0/3119231660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca680b3dc0 0x7fca680ca770 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fca680adb40 tx=0x7fca5801eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95d4129ed4d9f66 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:11.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.588+0000 7fca66000640 1 -- 172.21.15.55:0/3119231660 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca580a7ad0 con 0x7fca680b3dc0 2024-04-02T07:33:11.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.588+0000 7fca66000640 1 -- 172.21.15.55:0/3119231660 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca580a7c30 con 0x7fca680b3dc0 2024-04-02T07:33:11.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.588+0000 7fca66000640 1 -- 172.21.15.55:0/3119231660 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca580af440 con 0x7fca680b3dc0 2024-04-02T07:33:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca6da00640 1 -- 172.21.15.55:0/3119231660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca680b3dc0 msgr2=0x7fca680ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca6da00640 1 --2- 172.21.15.55:0/3119231660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca680b3dc0 0x7fca680ca770 secure :-1 s=READY pgs=1602 cs=0 l=1 rev1=1 crypto rx=0x7fca680adb40 tx=0x7fca5801eb30 comp rx=0 tx=0).stop 2024-04-02T07:33:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca6da00640 1 -- 172.21.15.55:0/3119231660 shutdown_connections 2024-04-02T07:33:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca6da00640 1 --2- 172.21.15.55:0/3119231660 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca680b41a0 0x7fca68142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca6da00640 1 --2- 172.21.15.55:0/3119231660 >> v2:172.21.15.106:3300/0 conn(0x7fca680ade90 0x7fca6806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca6da00640 1 --2- 172.21.15.55:0/3119231660 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca680b3dc0 0x7fca680ca770 unknown :-1 s=CLOSED pgs=1602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca6da00640 1 -- 172.21.15.55:0/3119231660 >> 172.21.15.55:0/3119231660 conn(0x7fca6806a390 msgr2=0x7fca680b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca6da00640 1 -- 172.21.15.55:0/3119231660 shutdown_connections 2024-04-02T07:33:11.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca6da00640 1 -- 172.21.15.55:0/3119231660 wait complete. 2024-04-02T07:33:11.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca6da00640 1 Processor -- start 2024-04-02T07:33:11.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca6da00640 1 -- start start 2024-04-02T07:33:11.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca6da00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca680ade90 0x7fca68141fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca6da00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca680b3dc0 0x7fca68157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca6da00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca680b41a0 0x7fca68157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca6da00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca68158af0 con 0x7fca680b41a0 2024-04-02T07:33:11.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca6da00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca681514d0 con 0x7fca680ade90 2024-04-02T07:33:11.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca6da00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca681584a0 con 0x7fca680b3dc0 2024-04-02T07:33:11.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca67400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca680b41a0 0x7fca68157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca67400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca680b41a0 0x7fca68157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58442/0 (socket says 172.21.15.55:58442) 2024-04-02T07:33:11.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca67400640 1 -- 172.21.15.55:0/2552139087 learned_addr learned my addr 172.21.15.55:0/2552139087 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:11.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca66a00640 1 --2- 172.21.15.55:0/2552139087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca680ade90 0x7fca68141fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca5fe00640 1 --2- 172.21.15.55:0/2552139087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca680b3dc0 0x7fca68157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca67400640 1 -- 172.21.15.55:0/2552139087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca680b3dc0 msgr2=0x7fca68157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:11.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca67400640 1 --2- 172.21.15.55:0/2552139087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca680b3dc0 0x7fca68157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca67400640 1 -- 172.21.15.55:0/2552139087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca680ade90 msgr2=0x7fca68141fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:11.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca67400640 1 --2- 172.21.15.55:0/2552139087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca680ade90 0x7fca68141fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca67400640 1 -- 172.21.15.55:0/2552139087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca5800b770 con 0x7fca680b41a0 2024-04-02T07:33:11.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.592+0000 7fca5fe00640 1 --2- 172.21.15.55:0/2552139087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca680b3dc0 0x7fca68157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:11.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.596+0000 7fca67400640 1 --2- 172.21.15.55:0/2552139087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca680b41a0 0x7fca68157b60 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fca6000efc0 tx=0x7fca6000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:11.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.596+0000 7fca5ea00640 1 -- 172.21.15.55:0/2552139087 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca60009ba0 con 0x7fca680b41a0 2024-04-02T07:33:11.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.596+0000 7fca5ea00640 1 -- 172.21.15.55:0/2552139087 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6000f040 con 0x7fca680b41a0 2024-04-02T07:33:11.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.596+0000 7fca5ea00640 1 -- 172.21.15.55:0/2552139087 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca600146c0 con 0x7fca680b41a0 2024-04-02T07:33:11.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.596+0000 7fca6da00640 1 -- 172.21.15.55:0/2552139087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca6806de00 con 0x7fca680b41a0 2024-04-02T07:33:11.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.596+0000 7fca6da00640 1 -- 172.21.15.55:0/2552139087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca68142520 con 0x7fca680b41a0 2024-04-02T07:33:11.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.596+0000 7fca5ea00640 1 -- 172.21.15.55:0/2552139087 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fca60014820 con 0x7fca680b41a0 2024-04-02T07:33:11.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.596+0000 7fca5ea00640 1 --2- 172.21.15.55:0/2552139087 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fca440666c0 0x7fca44068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.596+0000 7fca5ea00640 1 -- 172.21.15.55:0/2552139087 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fca60084f70 con 0x7fca680b41a0 2024-04-02T07:33:11.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.596+0000 7fca66a00640 1 --2- 172.21.15.55:0/2552139087 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fca440666c0 0x7fca44068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.596+0000 7fca70ed4000 1 Processor -- start 2024-04-02T07:33:11.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.596+0000 7fca70ed4000 1 -- start start 2024-04-02T07:33:11.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca66a00640 1 --2- 172.21.15.55:0/2552139087 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fca440666c0 0x7fca44068b80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fca580b1000 tx=0x7fca580a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:11.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca70ed4000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5594e6e70e60 0x5594e6e71240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca70ed4000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e71780 0x5594e6e248d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca70ed4000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e24e10 0x5594e6e251f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca70ed4000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e6ceb630 con 0x5594e6e71780 2024-04-02T07:33:11.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca70ed4000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e6c78bd0 con 0x5594e6e70e60 2024-04-02T07:33:11.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca70ed4000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594e6c761a0 con 0x5594e6e24e10 2024-04-02T07:33:11.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca5fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e71780 0x5594e6e248d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca5fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e71780 0x5594e6e248d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58444/0 (socket says 172.21.15.55:58444) 2024-04-02T07:33:11.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca5fe00640 1 -- 172.21.15.55:0/1435990965 learned_addr learned my addr 172.21.15.55:0/1435990965 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:11.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca66a00640 1 --2- 172.21.15.55:0/1435990965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5594e6e70e60 0x5594e6e71240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca67400640 1 --2- 172.21.15.55:0/1435990965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e24e10 0x5594e6e251f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca5fe00640 1 -- 172.21.15.55:0/1435990965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e24e10 msgr2=0x5594e6e251f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:11.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca5fe00640 1 --2- 172.21.15.55:0/1435990965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e24e10 0x5594e6e251f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca5fe00640 1 -- 172.21.15.55:0/1435990965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5594e6e70e60 msgr2=0x5594e6e71240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:11.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca5fe00640 1 --2- 172.21.15.55:0/1435990965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5594e6e70e60 0x5594e6e71240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca5fe00640 1 -- 172.21.15.55:0/1435990965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594e696de20 con 0x5594e6e71780 2024-04-02T07:33:11.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca67400640 1 --2- 172.21.15.55:0/1435990965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e24e10 0x5594e6e251f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:11.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca5fe00640 1 --2- 172.21.15.55:0/1435990965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e71780 0x5594e6e248d0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fca50009800 tx=0x7fca50009cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ad674e8ffd370b8 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:11.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca57400640 1 -- 172.21.15.55:0/1435990965 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5000f960 con 0x5594e6e71780 2024-04-02T07:33:11.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca57400640 1 -- 172.21.15.55:0/1435990965 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca5000c030 con 0x5594e6e71780 2024-04-02T07:33:11.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca57400640 1 -- 172.21.15.55:0/1435990965 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca5000fd20 con 0x5594e6e71780 2024-04-02T07:33:11.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca70ed4000 1 -- 172.21.15.55:0/1435990965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e71780 msgr2=0x5594e6e248d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:11.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca70ed4000 1 --2- 172.21.15.55:0/1435990965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e71780 0x5594e6e248d0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fca50009800 tx=0x7fca50009cc0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca70ed4000 1 -- 172.21.15.55:0/1435990965 shutdown_connections 2024-04-02T07:33:11.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca70ed4000 1 --2- 172.21.15.55:0/1435990965 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e24e10 0x5594e6e251f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca70ed4000 1 --2- 172.21.15.55:0/1435990965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e71780 0x5594e6e248d0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca70ed4000 1 --2- 172.21.15.55:0/1435990965 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5594e6e70e60 0x5594e6e71240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca70ed4000 1 -- 172.21.15.55:0/1435990965 >> 172.21.15.55:0/1435990965 conn(0x5594e6c21160 msgr2=0x5594e6e4f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:11.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca70ed4000 1 -- 172.21.15.55:0/1435990965 shutdown_connections 2024-04-02T07:33:11.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca70ed4000 1 -- 172.21.15.55:0/1435990965 wait complete. 2024-04-02T07:33:11.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca70ed4000 1 -- start start 2024-04-02T07:33:11.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.600+0000 7fca70ed4000 1 Processor -- start 2024-04-02T07:33:11.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca70ed4000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5594e6e24e10 0x5594e6e77fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca70ed4000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e70e60 0x5594e6e784f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca70ed4000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e71780 0x5594e6e53c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca70ed4000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e6c71a90 con 0x5594e6e70e60 2024-04-02T07:33:11.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca70ed4000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e6c10d40 con 0x5594e6e24e10 2024-04-02T07:33:11.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca70ed4000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594e6c2ef30 con 0x5594e6e71780 2024-04-02T07:33:11.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca70ed4000 10 client.0 _ll_register_callbacks cb 0x5594e6cd3810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:33:11.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca5fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e70e60 0x5594e6e784f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca5fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e70e60 0x5594e6e784f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58458/0 (socket says 172.21.15.55:58458) 2024-04-02T07:33:11.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca5fe00640 1 -- 172.21.15.55:0/2624071397 learned_addr learned my addr 172.21.15.55:0/2624071397 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:11.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca66a00640 1 --2- 172.21.15.55:0/2624071397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5594e6e24e10 0x5594e6e77fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca67400640 1 --2- 172.21.15.55:0/2624071397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e71780 0x5594e6e53c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca5fe00640 1 -- 172.21.15.55:0/2624071397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e71780 msgr2=0x5594e6e53c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:11.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca5fe00640 1 --2- 172.21.15.55:0/2624071397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e71780 0x5594e6e53c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca5fe00640 1 -- 172.21.15.55:0/2624071397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5594e6e24e10 msgr2=0x5594e6e77fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:11.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca5fe00640 1 --2- 172.21.15.55:0/2624071397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5594e6e24e10 0x5594e6e77fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca5fe00640 1 -- 172.21.15.55:0/2624071397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca5000e040 con 0x5594e6e70e60 2024-04-02T07:33:11.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca5fe00640 1 --2- 172.21.15.55:0/2624071397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e70e60 0x5594e6e784f0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fca50016000 tx=0x7fca50004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58971d8aefce0ca6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:11.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca4be00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:33:11.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca4be00640 1 -- 172.21.15.55:0/2624071397 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca50014890 con 0x5594e6e70e60 2024-04-02T07:33:11.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca4be00640 1 -- 172.21.15.55:0/2624071397 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fca50029b50 con 0x5594e6e70e60 2024-04-02T07:33:11.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca70ed4000 1 -- 172.21.15.55:0/2624071397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594e6c703e0 con 0x5594e6e70e60 2024-04-02T07:33:11.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca4be00640 1 -- 172.21.15.55:0/2624071397 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca50029d50 con 0x5594e6e70e60 2024-04-02T07:33:11.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca70ed4000 10 client.9000 fetch_fsmap learned FSMap version 87 2024-04-02T07:33:11.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca70ed4000 1 -- 172.21.15.55:0/2624071397 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) v3 -- 0x5594e6c36aa0 con 0x5594e6e70e60 2024-04-02T07:33:11.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca4be00640 1 -- 172.21.15.55:0/2624071397 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5594e6c703e0 con 0x5594e6e70e60 2024-04-02T07:33:11.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca4be00640 1 -- 172.21.15.55:0/2624071397 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 87) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fca500149f0 con 0x5594e6e70e60 2024-04-02T07:33:11.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca70ed4000 10 client.9000 fetch_fsmap finished waiting for FSMap version 87 2024-04-02T07:33:11.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca70ed4000 10 client.9000 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-02T07:33:11.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca70ed4000 20 client.9000 populate_metadata read hostname 'smithi055' 2024-04-02T07:33:11.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca70ed4000 1 --2- 172.21.15.55:0/2624071397 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x5594e6e54a30 0x5594e6e54e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca70ed4000 4 client.9000 mds_command: new command op to 8868 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:33:11.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca70ed4000 1 -- 172.21.15.55:0/2624071397 --> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594e6c41d00 con 0x5594e6e54a30 2024-04-02T07:33:11.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca66a00640 1 --2- 172.21.15.55:0/2624071397 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x5594e6e54a30 0x5594e6e54e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca4be00640 10 client.9000 ms_handle_connect on v2:172.21.15.55:6834/1137835746 2024-04-02T07:33:11.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca66a00640 1 --2- 172.21.15.55:0/2624071397 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x5594e6e54a30 0x5594e6e54e40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e96500cea69fa8bb server_cookie=34b389649b34dde8 in_seq=0 out_seq=0 2024-04-02T07:33:11.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca4be00640 1 -- 172.21.15.55:0/2624071397 <== mds.0 v2:172.21.15.55:6834/1137835746 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5594e6c41d00 con 0x5594e6e54a30 2024-04-02T07:33:11.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca4be00640 10 client.9000 handle_command_reply: tid=0 2024-04-02T07:33:11.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.604+0000 7fca70ed4000 1 client.9000 shutdown 2024-04-02T07:33:11.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.608+0000 7fca70ed4000 1 -- 172.21.15.55:0/2624071397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e70e60 msgr2=0x5594e6e784f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:11.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.608+0000 7fca70ed4000 1 --2- 172.21.15.55:0/2624071397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e70e60 0x5594e6e784f0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7fca50016000 tx=0x7fca50004740 comp rx=0 tx=0).stop 2024-04-02T07:33:11.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.608+0000 7fca70ed4000 1 -- 172.21.15.55:0/2624071397 shutdown_connections 2024-04-02T07:33:11.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.608+0000 7fca70ed4000 1 --2- 172.21.15.55:0/2624071397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e71780 0x5594e6e53c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.608+0000 7fca70ed4000 1 --2- 172.21.15.55:0/2624071397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e70e60 0x5594e6e784f0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.608+0000 7fca70ed4000 1 --2- 172.21.15.55:0/2624071397 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x5594e6e54a30 0x5594e6e54e40 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.608+0000 7fca70ed4000 1 --2- 172.21.15.55:0/2624071397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5594e6e24e10 0x5594e6e77fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.608+0000 7fca4be00640 0 client.9000 ms_handle_reset on v2:172.21.15.55:6834/1137835746 2024-04-02T07:33:11.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.608+0000 7fca70ed4000 1 -- 172.21.15.55:0/2624071397 >> 172.21.15.55:0/2624071397 conn(0x5594e6c21160 msgr2=0x5594e6e1fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:11.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.608+0000 7fca70ed4000 1 -- 172.21.15.55:0/2624071397 shutdown_connections 2024-04-02T07:33:11.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.608+0000 7fca70ed4000 1 -- 172.21.15.55:0/2624071397 wait complete. 2024-04-02T07:33:11.612 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.608+0000 7fca70ed4000 20 client.9000 trim_cache size 0 max 16384 2024-04-02T07:33:11.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.620+0000 7fca70ed4000 1 Processor -- start 2024-04-02T07:33:11.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.620+0000 7fca70ed4000 1 -- start start 2024-04-02T07:33:11.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.620+0000 7fca70ed4000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e24e10 0x5594e6e70070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.620+0000 7fca70ed4000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e70e60 0x5594e6e6ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.620+0000 7fca70ed4000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5594e6e71780 0x5594e6e6f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.620+0000 7fca70ed4000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e692eaa0 con 0x5594e6e24e10 2024-04-02T07:33:11.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.620+0000 7fca70ed4000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e6cb5170 con 0x5594e6e71780 2024-04-02T07:33:11.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.620+0000 7fca70ed4000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594e6c75a90 con 0x5594e6e70e60 2024-04-02T07:33:11.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca66a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e24e10 0x5594e6e70070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca66a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e24e10 0x5594e6e70070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58466/0 (socket says 172.21.15.55:58466) 2024-04-02T07:33:11.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca66a00640 1 -- 172.21.15.55:0/2344068476 learned_addr learned my addr 172.21.15.55:0/2344068476 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:11.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca5fe00640 1 --2- 172.21.15.55:0/2344068476 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e70e60 0x5594e6e6ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca67400640 1 --2- 172.21.15.55:0/2344068476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5594e6e71780 0x5594e6e6f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca66a00640 1 -- 172.21.15.55:0/2344068476 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e70e60 msgr2=0x5594e6e6ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:11.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca66a00640 1 --2- 172.21.15.55:0/2344068476 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e70e60 0x5594e6e6ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.625 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca66a00640 1 -- 172.21.15.55:0/2344068476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5594e6e71780 msgr2=0x5594e6e6f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:11.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca66a00640 1 --2- 172.21.15.55:0/2344068476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5594e6e71780 0x5594e6e6f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca66a00640 1 -- 172.21.15.55:0/2344068476 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594e6c1cdf0 con 0x5594e6e24e10 2024-04-02T07:33:11.626 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca66a00640 1 --2- 172.21.15.55:0/2344068476 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e24e10 0x5594e6e70070 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fca5800b2c0 tx=0x7fca58004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1afc5716edb3cd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:11.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca57e00640 1 -- 172.21.15.55:0/2344068476 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca580cc260 con 0x5594e6e24e10 2024-04-02T07:33:11.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca57e00640 1 -- 172.21.15.55:0/2344068476 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca580c0040 con 0x5594e6e24e10 2024-04-02T07:33:11.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca57e00640 1 -- 172.21.15.55:0/2344068476 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca580cc400 con 0x5594e6e24e10 2024-04-02T07:33:11.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca70ed4000 1 -- 172.21.15.55:0/2344068476 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e24e10 msgr2=0x5594e6e70070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:11.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca70ed4000 1 --2- 172.21.15.55:0/2344068476 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e24e10 0x5594e6e70070 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7fca5800b2c0 tx=0x7fca58004740 comp rx=0 tx=0).stop 2024-04-02T07:33:11.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca70ed4000 1 -- 172.21.15.55:0/2344068476 shutdown_connections 2024-04-02T07:33:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca70ed4000 1 --2- 172.21.15.55:0/2344068476 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5594e6e71780 0x5594e6e6f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca70ed4000 1 --2- 172.21.15.55:0/2344068476 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e70e60 0x5594e6e6ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca70ed4000 1 --2- 172.21.15.55:0/2344068476 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e24e10 0x5594e6e70070 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca70ed4000 1 -- 172.21.15.55:0/2344068476 >> 172.21.15.55:0/2344068476 conn(0x5594e6c21160 msgr2=0x5594e6e1fd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca70ed4000 1 -- 172.21.15.55:0/2344068476 shutdown_connections 2024-04-02T07:33:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca70ed4000 1 -- 172.21.15.55:0/2344068476 wait complete. 2024-04-02T07:33:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca70ed4000 1 -- start start 2024-04-02T07:33:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca70ed4000 1 Processor -- start 2024-04-02T07:33:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca70ed4000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5594e6e24e10 0x5594e6ecd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca70ed4000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e70e60 0x5594e6ecdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca70ed4000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e71780 0x5594e6ece000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca70ed4000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e6c70920 con 0x5594e6e71780 2024-04-02T07:33:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca70ed4000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594e6e7ec20 con 0x5594e6e24e10 2024-04-02T07:33:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca70ed4000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5594e6e50c80 con 0x5594e6e70e60 2024-04-02T07:33:11.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca70ed4000 10 client.0 _ll_register_callbacks cb 0x7fca500091e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:33:11.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca67400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e71780 0x5594e6ece000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca67400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e71780 0x5594e6ece000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58478/0 (socket says 172.21.15.55:58478) 2024-04-02T07:33:11.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca67400640 1 -- 172.21.15.55:0/3219394299 learned_addr learned my addr 172.21.15.55:0/3219394299 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:11.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca66a00640 1 --2- 172.21.15.55:0/3219394299 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5594e6e24e10 0x5594e6ecd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.624+0000 7fca5fe00640 1 --2- 172.21.15.55:0/3219394299 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e70e60 0x5594e6ecdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca67400640 1 -- 172.21.15.55:0/3219394299 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e70e60 msgr2=0x5594e6ecdac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:11.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca67400640 1 --2- 172.21.15.55:0/3219394299 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e70e60 0x5594e6ecdac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca67400640 1 -- 172.21.15.55:0/3219394299 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5594e6e24e10 msgr2=0x5594e6ecd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:11.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca67400640 1 --2- 172.21.15.55:0/3219394299 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5594e6e24e10 0x5594e6ecd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca67400640 1 -- 172.21.15.55:0/3219394299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6806ceb0 con 0x5594e6e71780 2024-04-02T07:33:11.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca67400640 1 --2- 172.21.15.55:0/3219394299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e71780 0x5594e6ece000 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fca60009ac0 tx=0x7fca60055fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5905ea9ec2c690e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:11.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca4be00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:33:11.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca4be00640 1 -- 172.21.15.55:0/3219394299 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca60056300 con 0x5594e6e71780 2024-04-02T07:33:11.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca4be00640 1 -- 172.21.15.55:0/3219394299 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fca6006d030 con 0x5594e6e71780 2024-04-02T07:33:11.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 1 -- 172.21.15.55:0/3219394299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594e6e87750 con 0x5594e6e71780 2024-04-02T07:33:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca4be00640 1 -- 172.21.15.55:0/3219394299 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7fca60055390 con 0x5594e6e71780 2024-04-02T07:33:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 10 client.9006 fetch_fsmap learned FSMap version 87 2024-04-02T07:33:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 1 -- 172.21.15.55:0/3219394299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=2+}) v3 -- 0x5594e6c10960 con 0x5594e6e71780 2024-04-02T07:33:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca4be00640 1 -- 172.21.15.55:0/3219394299 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5594e6e87750 con 0x5594e6e71780 2024-04-02T07:33:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca4be00640 1 -- 172.21.15.55:0/3219394299 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 87) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fca60024020 con 0x5594e6e71780 2024-04-02T07:33:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 10 client.9006 fetch_fsmap finished waiting for FSMap version 87 2024-04-02T07:33:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 10 client.9006 resolve_mds: resolved 7:0 to role '7:0' aka daemon mds.a 2024-04-02T07:33:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 20 client.9006 populate_metadata read hostname 'smithi055' 2024-04-02T07:33:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 1 --2- 172.21.15.55:0/3219394299 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x5594e6ece540 0x5594e6ece920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 4 client.9006 mds_command: new command op to 8868 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-04-02T07:33:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 1 -- 172.21.15.55:0/3219394299 --> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5594e6c2e970 con 0x5594e6ece540 2024-04-02T07:33:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca66a00640 1 --2- 172.21.15.55:0/3219394299 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x5594e6ece540 0x5594e6ece920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca66a00640 1 --2- 172.21.15.55:0/3219394299 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x5594e6ece540 0x5594e6ece920 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f95d5c7adb63a66 server_cookie=3be06fed2827a3df in_seq=0 out_seq=0 2024-04-02T07:33:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca4be00640 10 client.9006 ms_handle_connect on v2:172.21.15.55:6834/1137835746 2024-04-02T07:33:11.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca4be00640 1 -- 172.21.15.55:0/3219394299 <== mds.0 v2:172.21.15.55:6834/1137835746 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5594e6c2e970 con 0x5594e6ece540 2024-04-02T07:33:11.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca4be00640 10 client.9006 handle_command_reply: tid=0 2024-04-02T07:33:11.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 1 client.9006 shutdown 2024-04-02T07:33:11.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 1 -- 172.21.15.55:0/3219394299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e71780 msgr2=0x5594e6ece000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:11.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 1 --2- 172.21.15.55:0/3219394299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e71780 0x5594e6ece000 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7fca60009ac0 tx=0x7fca60055fd0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 1 -- 172.21.15.55:0/3219394299 shutdown_connections 2024-04-02T07:33:11.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 1 --2- 172.21.15.55:0/3219394299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5594e6e71780 0x5594e6ece000 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 1 --2- 172.21.15.55:0/3219394299 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5594e6e70e60 0x5594e6ecdac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 1 --2- 172.21.15.55:0/3219394299 >> [v2:172.21.15.55:6834/1137835746,v1:172.21.15.55:6835/1137835746] conn(0x5594e6ece540 0x5594e6ece920 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 1 --2- 172.21.15.55:0/3219394299 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5594e6e24e10 0x5594e6ecd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 1 -- 172.21.15.55:0/3219394299 >> 172.21.15.55:0/3219394299 conn(0x5594e6c21160 msgr2=0x5594e6e6ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:11.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca4be00640 0 client.9006 ms_handle_reset on v2:172.21.15.55:6834/1137835746 2024-04-02T07:33:11.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 1 -- 172.21.15.55:0/3219394299 shutdown_connections 2024-04-02T07:33:11.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 1 -- 172.21.15.55:0/3219394299 wait complete. 2024-04-02T07:33:11.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca70ed4000 20 client.9006 trim_cache size 0 max 16384 2024-04-02T07:33:11.635 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:33:11.635 INFO:teuthology.orchestra.run.smithi055.stdout: "status": "no active scrubs running", 2024-04-02T07:33:11.635 INFO:teuthology.orchestra.run.smithi055.stdout: "scrubs": {} 2024-04-02T07:33:11.635 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:33:11.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca6da00640 1 -- 172.21.15.55:0/2552139087 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fca440666c0 msgr2=0x7fca44068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:11.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca6da00640 1 --2- 172.21.15.55:0/2552139087 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fca440666c0 0x7fca44068b80 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fca580b1000 tx=0x7fca580a9070 comp rx=0 tx=0).stop 2024-04-02T07:33:11.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca6da00640 1 -- 172.21.15.55:0/2552139087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca680b41a0 msgr2=0x7fca68157b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:11.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca6da00640 1 --2- 172.21.15.55:0/2552139087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca680b41a0 0x7fca68157b60 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fca6000efc0 tx=0x7fca6000c490 comp rx=0 tx=0).stop 2024-04-02T07:33:11.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca6da00640 1 -- 172.21.15.55:0/2552139087 shutdown_connections 2024-04-02T07:33:11.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca6da00640 1 --2- 172.21.15.55:0/2552139087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca680b41a0 0x7fca68157b60 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca6da00640 1 --2- 172.21.15.55:0/2552139087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca680b3dc0 0x7fca68157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca6da00640 1 --2- 172.21.15.55:0/2552139087 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fca440666c0 0x7fca44068b80 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca6da00640 1 --2- 172.21.15.55:0/2552139087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca680ade90 0x7fca68141fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca6da00640 1 -- 172.21.15.55:0/2552139087 >> 172.21.15.55:0/2552139087 conn(0x7fca6806a390 msgr2=0x7fca680b0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:11.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca6da00640 1 -- 172.21.15.55:0/2552139087 shutdown_connections 2024-04-02T07:33:11.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.628+0000 7fca6da00640 1 -- 172.21.15.55:0/2552139087 wait complete. 2024-04-02T07:33:11.651 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-04-02T07:33:11.753 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-02T07:33:11.893 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.892+0000 7f17bd000640 1 Processor -- start 2024-04-02T07:33:11.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.892+0000 7f17bd000640 1 -- start start 2024-04-02T07:33:11.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.892+0000 7f17bd000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f17b815dc80 0x7f17b806aea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.892+0000 7f17bd000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f17b806b3e0 0x7f17b815f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.892+0000 7f17bd000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b80cec60 con 0x7f17b8098a10 2024-04-02T07:33:11.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.892+0000 7f17bd000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b80d0100 con 0x7f17b806b3e0 2024-04-02T07:33:11.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.892+0000 7f17bd000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17b815d2c0 con 0x7f17b815dc80 2024-04-02T07:33:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.892+0000 7f17b6800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f17b806b3e0 0x7f17b815f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.892+0000 7f17b6800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f17b806b3e0 0x7f17b815f650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58488/0 (socket says 172.21.15.55:58488) 2024-04-02T07:33:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.892+0000 7f17b6800640 1 -- 172.21.15.55:0/2528839285 learned_addr learned my addr 172.21.15.55:0/2528839285 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.892+0000 7f17ad400640 1 --2- 172.21.15.55:0/2528839285 >> v2:172.21.15.106:3300/0 conn(0x7f17b815dc80 0x7f17b806aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.892+0000 7f17b6800640 1 -- 172.21.15.55:0/2528839285 >> v2:172.21.15.106:3300/0 conn(0x7f17b815dc80 msgr2=0x7f17b806aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.892+0000 7f17b6800640 1 --2- 172.21.15.55:0/2528839285 >> v2:172.21.15.106:3300/0 conn(0x7f17b815dc80 0x7f17b806aea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.892+0000 7f17b6800640 1 -- 172.21.15.55:0/2528839285 >> v1:172.21.15.106:6789/0 conn(0x7f17b8098a10 legacy=0x7f17b8098df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:11.896 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.892+0000 7f17b6800640 1 -- 172.21.15.55:0/2528839285 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b806ba10 con 0x7f17b806b3e0 2024-04-02T07:33:11.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.896+0000 7f17b6800640 1 --2- 172.21.15.55:0/2528839285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17b806b3e0 0x7f17b815f650 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f17b8071720 tx=0x7f17b001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61fab0f29b04ea58 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:11.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.896+0000 7f17b5400640 1 -- 172.21.15.55:0/2528839285 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b00a58b0 con 0x7f17b806b3e0 2024-04-02T07:33:11.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.896+0000 7f17b5400640 1 -- 172.21.15.55:0/2528839285 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b00a5a10 con 0x7f17b806b3e0 2024-04-02T07:33:11.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.896+0000 7f17b5400640 1 -- 172.21.15.55:0/2528839285 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b00a5da0 con 0x7f17b806b3e0 2024-04-02T07:33:11.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.896+0000 7f17bd000640 1 -- 172.21.15.55:0/2528839285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17b806b3e0 msgr2=0x7f17b815f650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:11.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.896+0000 7f17bd000640 1 --2- 172.21.15.55:0/2528839285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17b806b3e0 0x7f17b815f650 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f17b8071720 tx=0x7f17b001c9f0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.896+0000 7f17bd000640 1 -- 172.21.15.55:0/2528839285 shutdown_connections 2024-04-02T07:33:11.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.896+0000 7f17bd000640 1 --2- 172.21.15.55:0/2528839285 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17b806b3e0 0x7f17b815f650 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.896+0000 7f17bd000640 1 --2- 172.21.15.55:0/2528839285 >> v2:172.21.15.106:3300/0 conn(0x7f17b815dc80 0x7f17b806aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.896+0000 7f17bd000640 1 -- 172.21.15.55:0/2528839285 >> 172.21.15.55:0/2528839285 conn(0x7f17b80b21d0 msgr2=0x7f17b80b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:11.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.896+0000 7f17bd000640 1 -- 172.21.15.55:0/2528839285 shutdown_connections 2024-04-02T07:33:11.900 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.896+0000 7f17bd000640 1 -- 172.21.15.55:0/2528839285 wait complete. 2024-04-02T07:33:11.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17bd000640 1 Processor -- start 2024-04-02T07:33:11.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17bd000640 1 -- start start 2024-04-02T07:33:11.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17bd000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17b806b3e0 0x7f17b80afe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17bd000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17b8098a10 0x7f17b80b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17bd000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17b814f710 0x7f17b814fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17bd000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b8150100 con 0x7f17b8098a10 2024-04-02T07:33:11.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17bd000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80c6cf0 con 0x7f17b806b3e0 2024-04-02T07:33:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17bd000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b80c6fd0 con 0x7f17b814f710 2024-04-02T07:33:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17ad400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17b8098a10 0x7f17b80b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17ad400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17b8098a10 0x7f17b80b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58492/0 (socket says 172.21.15.55:58492) 2024-04-02T07:33:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17ad400640 1 -- 172.21.15.55:0/404264923 learned_addr learned my addr 172.21.15.55:0/404264923 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17b5e00640 1 --2- 172.21.15.55:0/404264923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17b806b3e0 0x7f17b80afe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17b6800640 1 --2- 172.21.15.55:0/404264923 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17b814f710 0x7f17b814fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17ad400640 1 -- 172.21.15.55:0/404264923 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17b814f710 msgr2=0x7f17b814fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17ad400640 1 --2- 172.21.15.55:0/404264923 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17b814f710 0x7f17b814fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17ad400640 1 -- 172.21.15.55:0/404264923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17b806b3e0 msgr2=0x7f17b80afe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17ad400640 1 --2- 172.21.15.55:0/404264923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17b806b3e0 0x7f17b80afe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17ad400640 1 -- 172.21.15.55:0/404264923 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b0009b30 con 0x7f17b8098a10 2024-04-02T07:33:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17b6800640 1 --2- 172.21.15.55:0/404264923 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17b814f710 0x7f17b814fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:11.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17b5e00640 1 --2- 172.21.15.55:0/404264923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17b806b3e0 0x7f17b80afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:11.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17ad400640 1 --2- 172.21.15.55:0/404264923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17b8098a10 0x7f17b80b0350 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f17a000e870 tx=0x7f17a000ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:11.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17aea00640 1 -- 172.21.15.55:0/404264923 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a0009510 con 0x7f17b8098a10 2024-04-02T07:33:11.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17aea00640 1 -- 172.21.15.55:0/404264923 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17a000eec0 con 0x7f17b8098a10 2024-04-02T07:33:11.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17bd000640 1 -- 172.21.15.55:0/404264923 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b80ae8a0 con 0x7f17b8098a10 2024-04-02T07:33:11.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17aea00640 1 -- 172.21.15.55:0/404264923 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17a000cb40 con 0x7f17b8098a10 2024-04-02T07:33:11.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.900+0000 7f17bd000640 1 -- 172.21.15.55:0/404264923 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b80aee60 con 0x7f17b8098a10 2024-04-02T07:33:11.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.904+0000 7f17bd000640 1 -- 172.21.15.55:0/404264923 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b80ae700 con 0x7f17b8098a10 2024-04-02T07:33:11.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.904+0000 7f17aea00640 1 -- 172.21.15.55:0/404264923 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f17a000cca0 con 0x7f17b8098a10 2024-04-02T07:33:11.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.904+0000 7f17aea00640 1 --2- 172.21.15.55:0/404264923 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f17940666c0 0x7f1794068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:11.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.904+0000 7f17aea00640 1 -- 172.21.15.55:0/404264923 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f17a00842e0 con 0x7f17b8098a10 2024-04-02T07:33:11.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.904+0000 7f17b5e00640 1 --2- 172.21.15.55:0/404264923 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f17940666c0 0x7f1794068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:11.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.904+0000 7f17b5e00640 1 --2- 172.21.15.55:0/404264923 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f17940666c0 0x7f1794068b80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f17b80ae4f0 tx=0x7f17a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:11.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:11.908+0000 7f17aea00640 1 -- 172.21.15.55:0/404264923 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f17b80ae700 con 0x7f17b8098a10 2024-04-02T07:33:12.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.104+0000 7f17bd000640 1 -- 172.21.15.55:0/404264923 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f17b80ae700 con 0x7f17b8098a10 2024-04-02T07:33:12.105 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-02T07:33:12.104+0000 7f8f18800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-02T07:33:12.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.112+0000 7f17aea00640 1 -- 172.21.15.55:0/404264923 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v88) v1 ==== 161+0+0 (secure 0 0 0) 0x7f17b80ae700 con 0x7f17b8098a10 2024-04-02T07:33:12.114 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-02T07:33:12.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.116+0000 7f17bd000640 1 -- 172.21.15.55:0/404264923 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f17940666c0 msgr2=0x7f1794068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:12.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.116+0000 7f17bd000640 1 --2- 172.21.15.55:0/404264923 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f17940666c0 0x7f1794068b80 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f17b80ae4f0 tx=0x7f17a8009040 comp rx=0 tx=0).stop 2024-04-02T07:33:12.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.116+0000 7f17bd000640 1 -- 172.21.15.55:0/404264923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17b8098a10 msgr2=0x7f17b80b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:12.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.116+0000 7f17bd000640 1 --2- 172.21.15.55:0/404264923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17b8098a10 0x7f17b80b0350 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f17a000e870 tx=0x7f17a000ec70 comp rx=0 tx=0).stop 2024-04-02T07:33:12.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.116+0000 7f17bd000640 1 -- 172.21.15.55:0/404264923 shutdown_connections 2024-04-02T07:33:12.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.116+0000 7f17bd000640 1 --2- 172.21.15.55:0/404264923 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f17b814f710 0x7f17b814fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.116+0000 7f17bd000640 1 --2- 172.21.15.55:0/404264923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f17b8098a10 0x7f17b80b0350 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.116+0000 7f17bd000640 1 --2- 172.21.15.55:0/404264923 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f17940666c0 0x7f1794068b80 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.116+0000 7f17bd000640 1 --2- 172.21.15.55:0/404264923 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f17b806b3e0 0x7f17b80afe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.116+0000 7f17bd000640 1 -- 172.21.15.55:0/404264923 >> 172.21.15.55:0/404264923 conn(0x7f17b80b21d0 msgr2=0x7f17b806e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:12.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.116+0000 7f17bd000640 1 -- 172.21.15.55:0/404264923 shutdown_connections 2024-04-02T07:33:12.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.116+0000 7f17bd000640 1 -- 172.21.15.55:0/404264923 wait complete. 2024-04-02T07:33:12.120 INFO:tasks.ceph.mds.a.smithi055.stderr: -1011> 2024-04-02T07:32:41.205+0000 7f0cd5000640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000001 2024-04-02T07:33:12.120 INFO:tasks.ceph.mds.a.smithi055.stderr: -1008> 2024-04-02T07:32:41.205+0000 7f0cd5000640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000001 2024-04-02T07:33:12.121 INFO:tasks.ceph.mds.a.smithi055.stderr: -992> 2024-04-02T07:32:41.205+0000 7f0cd5000640 -1 log_channel(cluster) log [ERR] : scrub: inode wrongly marked free: 0x10000000002 2024-04-02T07:33:12.121 INFO:tasks.ceph.mds.a.smithi055.stderr: -989> 2024-04-02T07:32:41.205+0000 7f0cd5000640 -1 log_channel(cluster) log [ERR] : inode table repaired for inode: 0x10000000002 2024-04-02T07:33:12.121 INFO:tasks.ceph.mds.a.smithi055.stderr: -817> 2024-04-02T07:32:42.417+0000 7f0cd9600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:33:12.136 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-table-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 0 show inode 2024-04-02T07:33:12.163 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-02T07:33:12.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c47cd400 1 -- start start 2024-04-02T07:33:12.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c47cd400 1 Processor -- start 2024-04-02T07:33:12.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c47cd400 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5590e6a45800 0x5590e6ad1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:12.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c47cd400 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590e6a45400 0x5590e6ad1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:12.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c47cd400 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5590e6a45000 0x5590e6ad1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:12.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c47cd400 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590e6b12a00 con 0x5590e6a45000 2024-04-02T07:33:12.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c47cd400 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590e6b12640 con 0x5590e6a45400 2024-04-02T07:33:12.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c47cd400 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590e6b12500 con 0x5590e6a45800 2024-04-02T07:33:12.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c3200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5590e6a45000 0x5590e6ad1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:12.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c3200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5590e6a45000 0x5590e6ad1080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58528/0 (socket says 172.21.15.55:58528) 2024-04-02T07:33:12.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c3200640 1 -- 172.21.15.55:0/979596414 learned_addr learned my addr 172.21.15.55:0/979596414 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:12.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c1e00640 1 --2- 172.21.15.55:0/979596414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590e6a45400 0x5590e6ad1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:12.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c2800640 1 --2- 172.21.15.55:0/979596414 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5590e6a45800 0x5590e6ad1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:12.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c3200640 1 -- 172.21.15.55:0/979596414 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5590e6a45800 msgr2=0x5590e6ad1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:12.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c3200640 1 --2- 172.21.15.55:0/979596414 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5590e6a45800 0x5590e6ad1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c3200640 1 -- 172.21.15.55:0/979596414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590e6a45400 msgr2=0x5590e6ad1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:12.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c3200640 1 --2- 172.21.15.55:0/979596414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590e6a45400 0x5590e6ad1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c3200640 1 -- 172.21.15.55:0/979596414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590e6a7a9c0 con 0x5590e6a45000 2024-04-02T07:33:12.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c3200640 1 --2- 172.21.15.55:0/979596414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5590e6a45000 0x5590e6ad1080 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x5590e781ccf0 tx=0x5590e78b4d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9484ae1fd3771923 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:12.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9bf600640 1 -- 172.21.15.55:0/979596414 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5590e6a99600 con 0x5590e6a45000 2024-04-02T07:33:12.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9bf600640 1 -- 172.21.15.55:0/979596414 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5590e6aa2180 con 0x5590e6a45000 2024-04-02T07:33:12.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9bf600640 1 -- 172.21.15.55:0/979596414 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5590e6a991e0 con 0x5590e6a45000 2024-04-02T07:33:12.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c47cd400 1 -- 172.21.15.55:0/979596414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590e6a7ab60 con 0x5590e6a45000 2024-04-02T07:33:12.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c47cd400 1 -- 172.21.15.55:0/979596414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5590e6a7a340 con 0x5590e6a45000 2024-04-02T07:33:12.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.180+0000 7fb9c47cd400 4 waiting for MDS map... 2024-04-02T07:33:12.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9bf600640 1 -- 172.21.15.55:0/979596414 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(105..105 src has 1..105) v4 ==== 5881+0+0 (secure 0 0 0) 0x5590e6a84c40 con 0x5590e6a45000 2024-04-02T07:33:12.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9bf600640 1 -- 172.21.15.55:0/979596414 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 88) v1 ==== 2573+0+0 (secure 0 0 0) 0x5590e6a92f00 con 0x5590e6a45000 2024-04-02T07:33:12.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c47cd400 4 Got MDS map 88 2024-04-02T07:33:12.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c47cd400 10 main: main 2024-04-02T07:33:12.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c47cd400 4 main: connecting to RADOS... 2024-04-02T07:33:12.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c47cd400 1 Processor -- start 2024-04-02T07:33:12.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c47cd400 1 -- start start 2024-04-02T07:33:12.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c47cd400 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5590e796ac00 0x5590e6ad0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:12.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c47cd400 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5590e796b000 0x5590e6ad0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:12.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c47cd400 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590e796b400 0x5590e6ad2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:12.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c47cd400 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590e6a8be00 con 0x5590e796ac00 2024-04-02T07:33:12.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c47cd400 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590e6b12640 con 0x5590e796b400 2024-04-02T07:33:12.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c47cd400 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590e6b123c0 con 0x5590e796b000 2024-04-02T07:33:12.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5590e796ac00 0x5590e6ad0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:12.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5590e796ac00 0x5590e6ad0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58544/0 (socket says 172.21.15.55:58544) 2024-04-02T07:33:12.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c1e00640 1 -- 172.21.15.55:0/3721332271 learned_addr learned my addr 172.21.15.55:0/3721332271 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:12.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c2800640 1 --2- 172.21.15.55:0/3721332271 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5590e796b000 0x5590e6ad0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:12.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c1e00640 1 --2- 172.21.15.55:0/3721332271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590e796b400 0x5590e6ad2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:12.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c1e00640 1 -- 172.21.15.55:0/3721332271 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5590e796b000 msgr2=0x5590e6ad0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:12.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c1e00640 1 --2- 172.21.15.55:0/3721332271 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5590e796b000 0x5590e6ad0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c1e00640 1 -- 172.21.15.55:0/3721332271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590e796b400 msgr2=0x5590e6ad2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:12.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c1e00640 1 --2- 172.21.15.55:0/3721332271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590e796b400 0x5590e6ad2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c1e00640 1 -- 172.21.15.55:0/3721332271 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590e6a7a000 con 0x5590e796ac00 2024-04-02T07:33:12.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c1e00640 1 --2- 172.21.15.55:0/3721332271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5590e796ac00 0x5590e6ad0b00 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x5590e781c180 tx=0x5590e78b40c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4b07a3bc992f0c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:12.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9bce00640 1 -- 172.21.15.55:0/3721332271 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5590e6a99080 con 0x5590e796ac00 2024-04-02T07:33:12.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9bce00640 1 -- 172.21.15.55:0/3721332271 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5590e7820a80 con 0x5590e796ac00 2024-04-02T07:33:12.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9bce00640 1 -- 172.21.15.55:0/3721332271 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5590e6a99600 con 0x5590e796ac00 2024-04-02T07:33:12.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c47cd400 1 -- 172.21.15.55:0/3721332271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5590e796ac00 msgr2=0x5590e6ad0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:12.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c47cd400 1 --2- 172.21.15.55:0/3721332271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5590e796ac00 0x5590e6ad0b00 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x5590e781c180 tx=0x5590e78b40c0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c47cd400 1 -- 172.21.15.55:0/3721332271 shutdown_connections 2024-04-02T07:33:12.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c47cd400 1 --2- 172.21.15.55:0/3721332271 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590e796b400 0x5590e6ad2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c47cd400 1 --2- 172.21.15.55:0/3721332271 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5590e796b000 0x5590e6ad0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c47cd400 1 --2- 172.21.15.55:0/3721332271 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5590e796ac00 0x5590e6ad0b00 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c47cd400 1 -- 172.21.15.55:0/3721332271 >> 172.21.15.55:0/3721332271 conn(0x5590e6a44c00 msgr2=0x5590e6a73800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:12.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c47cd400 1 -- 172.21.15.55:0/3721332271 shutdown_connections 2024-04-02T07:33:12.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.184+0000 7fb9c47cd400 1 -- 172.21.15.55:0/3721332271 wait complete. 2024-04-02T07:33:12.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c47cd400 1 Processor -- start 2024-04-02T07:33:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c47cd400 1 -- start start 2024-04-02T07:33:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c47cd400 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5590e796ac00 0x5590e6ad0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c47cd400 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590e796b000 0x5590e6ad0580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c47cd400 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5590e796b400 0x5590e6ad2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c47cd400 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590e6b12280 con 0x5590e796b400 2024-04-02T07:33:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c47cd400 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5590e6b12140 con 0x5590e796b000 2024-04-02T07:33:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c47cd400 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5590e6b12000 con 0x5590e796ac00 2024-04-02T07:33:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5590e796b400 0x5590e6ad2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c2800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590e796b000 0x5590e6ad0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5590e796b400 0x5590e6ad2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58554/0 (socket says 172.21.15.55:58554) 2024-04-02T07:33:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c1e00640 1 -- 172.21.15.55:0/1195001301 learned_addr learned my addr 172.21.15.55:0/1195001301 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c1e00640 1 --2- 172.21.15.55:0/1195001301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5590e796ac00 0x5590e6ad0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c1e00640 1 -- 172.21.15.55:0/1195001301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5590e796ac00 msgr2=0x5590e6ad0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:12.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c1e00640 1 --2- 172.21.15.55:0/1195001301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5590e796ac00 0x5590e6ad0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c1e00640 1 -- 172.21.15.55:0/1195001301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590e796b000 msgr2=0x5590e6ad0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c1e00640 1 --2- 172.21.15.55:0/1195001301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590e796b000 0x5590e6ad0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c1e00640 1 -- 172.21.15.55:0/1195001301 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5590e6a7a1a0 con 0x5590e796b400 2024-04-02T07:33:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c1e00640 1 --2- 172.21.15.55:0/1195001301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5590e796b400 0x5590e6ad2100 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x5590e6d2cc90 tx=0x5590e6b1f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9bb000640 1 -- 172.21.15.55:0/1195001301 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5590e6a991e0 con 0x5590e796b400 2024-04-02T07:33:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9bb000640 1 -- 172.21.15.55:0/1195001301 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5590e7820c00 con 0x5590e796b400 2024-04-02T07:33:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c47cd400 1 -- 172.21.15.55:0/1195001301 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5590e6a7a000 con 0x5590e796b400 2024-04-02T07:33:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9bb000640 1 -- 172.21.15.55:0/1195001301 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5590e6a98dc0 con 0x5590e796b400 2024-04-02T07:33:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c47cd400 1 -- 172.21.15.55:0/1195001301 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5590e6a7a9c0 con 0x5590e796b400 2024-04-02T07:33:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9c47cd400 4 main: resolving pool 14 2024-04-02T07:33:12.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.188+0000 7fb9bb000640 1 -- 172.21.15.55:0/1195001301 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x5590e6b11080 con 0x5590e796b400 2024-04-02T07:33:12.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.192+0000 7fb9bb000640 1 --2- 172.21.15.55:0/1195001301 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5590e6e16000 0x5590e6e1c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:12.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.192+0000 7fb9bb000640 1 -- 172.21.15.55:0/1195001301 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5881+0+0 (secure 0 0 0) 0x5590e6a84a80 con 0x5590e796b400 2024-04-02T07:33:12.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.192+0000 7fb9c47cd400 4 main: creating IoCtx.. 2024-04-02T07:33:12.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.192+0000 7fb9c47cd400 1 --2- 172.21.15.55:0/1195001301 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x5590e796b800 0x5590e6ad2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:12.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.192+0000 7fb9c47cd400 1 -- 172.21.15.55:0/1195001301 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:1 14.13 14:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e105) v8 -- 0x5590e796bc00 con 0x5590e796b800 2024-04-02T07:33:12.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.192+0000 7fb9c1e00640 1 --2- 172.21.15.55:0/1195001301 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x5590e796b800 0x5590e6ad2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:12.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.192+0000 7fb9c2800640 1 --2- 172.21.15.55:0/1195001301 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5590e6e16000 0x5590e6e1c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:12.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.192+0000 7fb9c1e00640 1 --2- 172.21.15.55:0/1195001301 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x5590e796b800 0x5590e6ad2680 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:12.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.192+0000 7fb9c2800640 1 --2- 172.21.15.55:0/1195001301 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5590e6e16000 0x5590e6e1c000 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x5590e6a7de60 tx=0x5590e797fb00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:12.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c1e00640 1 -- 172.21.15.55:0/1195001301 <== osd.2 v2:172.21.15.55:6808/27394 1 ==== osd_op_reply(1 mds0_inotable [read 0~34 out=34b] v0'0 uv7 ondisk = 0) v8 ==== 157+0+34 (crc 0 0 0) 0x5590e7806b40 con 0x5590e796b800 2024-04-02T07:33:12.197 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:33:12.198 INFO:teuthology.orchestra.run.smithi055.stdout: "0": { 2024-04-02T07:33:12.198 INFO:teuthology.orchestra.run.smithi055.stdout: "data": { 2024-04-02T07:33:12.198 INFO:teuthology.orchestra.run.smithi055.stdout: "version": 5, 2024-04-02T07:33:12.198 INFO:teuthology.orchestra.run.smithi055.stdout: "inotable": { 2024-04-02T07:33:12.198 INFO:teuthology.orchestra.run.smithi055.stdout: "projected_free": [ 2024-04-02T07:33:12.198 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:12.198 INFO:teuthology.orchestra.run.smithi055.stdout: "start": 1099511627779, 2024-04-02T07:33:12.198 INFO:teuthology.orchestra.run.smithi055.stdout: "len": 1099511627773 2024-04-02T07:33:12.198 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:12.198 INFO:teuthology.orchestra.run.smithi055.stdout: ], 2024-04-02T07:33:12.198 INFO:teuthology.orchestra.run.smithi055.stdout: "free": [ 2024-04-02T07:33:12.198 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:12.198 INFO:teuthology.orchestra.run.smithi055.stdout: "start": 1099511627779, 2024-04-02T07:33:12.199 INFO:teuthology.orchestra.run.smithi055.stdout: "len": 1099511627773 2024-04-02T07:33:12.199 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:12.199 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-04-02T07:33:12.199 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:12.199 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:12.199 INFO:teuthology.orchestra.run.smithi055.stdout: "result": 0 2024-04-02T07:33:12.199 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:12.199 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:33:12.199 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:12.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c47cd400 1 -- 172.21.15.55:0/1195001301 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x5590e796b800 msgr2=0x5590e6ad2680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:12.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c47cd400 1 --2- 172.21.15.55:0/1195001301 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x5590e796b800 0x5590e6ad2680 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c47cd400 1 -- 172.21.15.55:0/1195001301 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5590e6e16000 msgr2=0x5590e6e1c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:12.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c47cd400 1 --2- 172.21.15.55:0/1195001301 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5590e6e16000 0x5590e6e1c000 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x5590e6a7de60 tx=0x5590e797fb00 comp rx=0 tx=0).stop 2024-04-02T07:33:12.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c47cd400 1 -- 172.21.15.55:0/1195001301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5590e796b400 msgr2=0x5590e6ad2100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:12.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c47cd400 1 --2- 172.21.15.55:0/1195001301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5590e796b400 0x5590e6ad2100 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x5590e6d2cc90 tx=0x5590e6b1f200 comp rx=0 tx=0).stop 2024-04-02T07:33:12.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c2800640 1 -- 172.21.15.55:0/1195001301 reap_dead start 2024-04-02T07:33:12.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c47cd400 1 -- 172.21.15.55:0/1195001301 shutdown_connections 2024-04-02T07:33:12.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c47cd400 1 -- 172.21.15.55:0/1195001301 >> 172.21.15.55:0/1195001301 conn(0x5590e6a44c00 msgr2=0x5590e6a73800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:12.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c47cd400 1 -- 172.21.15.55:0/1195001301 shutdown_connections 2024-04-02T07:33:12.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c47cd400 1 -- 172.21.15.55:0/1195001301 wait complete. 2024-04-02T07:33:12.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c47cd400 1 -- 172.21.15.55:0/979596414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5590e6a45000 msgr2=0x5590e6ad1080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:12.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c47cd400 1 --2- 172.21.15.55:0/979596414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5590e6a45000 0x5590e6ad1080 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x5590e781ccf0 tx=0x5590e78b4d20 comp rx=0 tx=0).stop 2024-04-02T07:33:12.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c47cd400 1 -- 172.21.15.55:0/979596414 shutdown_connections 2024-04-02T07:33:12.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c47cd400 1 --2- 172.21.15.55:0/979596414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5590e6a45000 0x5590e6ad1080 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c47cd400 1 --2- 172.21.15.55:0/979596414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5590e6a45400 0x5590e6ad1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c47cd400 1 --2- 172.21.15.55:0/979596414 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5590e6a45800 0x5590e6ad1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c47cd400 1 -- 172.21.15.55:0/979596414 >> 172.21.15.55:0/979596414 conn(0x5590e6a45c00 msgr2=0x5590e6a73000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:12.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c47cd400 1 -- 172.21.15.55:0/979596414 shutdown_connections 2024-04-02T07:33:12.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.196+0000 7fb9c47cd400 1 -- 172.21.15.55:0/979596414 wait complete. 2024-04-02T07:33:12.202 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-table-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '0', 'show', 'inode'] in time 0:00:00.066055, result: { "0": { "data": { "version": 5, "inotable": { "projected_free": [ { "start": 1099511627779, "len": 1099511627773 } ], "free": [ { "start": 1099511627779, "len": 1099511627773 } ] } }, "result": 0 } } 2024-04-02T07:33:12.203 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-02T07:33:12.203 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:33:12.326 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:33:12.398 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-02T07:33:12.399 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:33:12.399 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:33:12.407 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:33:12.408 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:33:12.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:12.408 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-02T07:33:12.455 INFO:teuthology.orchestra.run.smithi055.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-02T07:33:12.456 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:33:12.457 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:33:12.457 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:33:12.466 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:33:12.466 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:33:12.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:12.466 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-02T07:33:12.518 INFO:teuthology.orchestra.run.smithi106.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-04-02T07:33:12.519 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:33:12.519 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:33:12.519 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:33:12.527 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:33:12.527 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:33:12.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:12.528 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-02T07:33:12.575 INFO:teuthology.orchestra.run.smithi055.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-04-02T07:33:12.576 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:33:12.577 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:33:12.577 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:33:12.586 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:33:12.586 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:33:12.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:12.586 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-02T07:33:12.634 INFO:teuthology.orchestra.run.smithi106.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-04-02T07:33:12.635 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:33:12.636 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:33:12.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe72a000640 1 Processor -- start 2024-04-02T07:33:12.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe72a000640 1 -- start start 2024-04-02T07:33:12.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe72a000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe72415ad30 0x7fe7240cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:12.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe72a000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7240b3c00 con 0x7fe7240cd8b0 2024-04-02T07:33:12.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe72a000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe724144370 con 0x7fe724143f90 2024-04-02T07:33:12.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe72a000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7240cdd20 con 0x7fe72415ad30 2024-04-02T07:33:12.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe723e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe7240cd8b0 0x7fe7240c4850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47408/0 (socket says 172.21.15.55:47408) 2024-04-02T07:33:12.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe723e00640 1 -- 172.21.15.55:0/112661301 learned_addr learned my addr 172.21.15.55:0/112661301 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:12.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe722a00640 1 --2- 172.21.15.55:0/112661301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe72415ad30 0x7fe7240cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:12.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe722000640 1 -- 172.21.15.55:0/112661301 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3415660520 0 0) 0x7fe7240b3c00 con 0x7fe7240cd8b0 2024-04-02T07:33:12.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe722000640 1 -- 172.21.15.55:0/112661301 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe708003530 con 0x7fe7240cd8b0 2024-04-02T07:33:12.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe722000640 1 -- 172.21.15.55:0/112661301 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 219687715 0 0) 0x7fe708003530 con 0x7fe7240cd8b0 2024-04-02T07:33:12.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe722000640 1 -- 172.21.15.55:0/112661301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe72415ad30 msgr2=0x7fe7240cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:12.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe722000640 1 --2- 172.21.15.55:0/112661301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe72415ad30 0x7fe7240cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe722000640 1 -- 172.21.15.55:0/112661301 >> v1:172.21.15.106:6789/0 conn(0x7fe724143f90 legacy=0x7fe7240b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:12.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe722000640 1 -- 172.21.15.55:0/112661301 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7240c37b0 con 0x7fe7240cd8b0 2024-04-02T07:33:12.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe722000640 1 -- 172.21.15.55:0/112661301 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fe71c001a00 con 0x7fe7240cd8b0 2024-04-02T07:33:12.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe722000640 1 -- 172.21.15.55:0/112661301 >> v1:172.21.15.55:6789/0 conn(0x7fe7240cd8b0 legacy=0x7fe7240c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:12.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe722000640 1 --2- 172.21.15.55:0/112661301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7080039b0 0x7fe708003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:12.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe722000640 1 --2- 172.21.15.55:0/112661301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7080047d0 0x7fe708004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:12.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe722000640 1 --2- 172.21.15.55:0/112661301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe72415ad30 0x7fe7080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:12.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe722000640 1 -- 172.21.15.55:0/112661301 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7240cdd20 con 0x7fe7080039b0 2024-04-02T07:33:12.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe722000640 1 -- 172.21.15.55:0/112661301 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe70800bac0 con 0x7fe7080047d0 2024-04-02T07:33:12.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe722000640 1 -- 172.21.15.55:0/112661301 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe70800bc80 con 0x7fe72415ad30 2024-04-02T07:33:12.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe723400640 1 --2- 172.21.15.55:0/112661301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7080039b0 0x7fe708003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:12.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe722a00640 1 --2- 172.21.15.55:0/112661301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7080047d0 0x7fe708004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:12.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe723e00640 1 --2- 172.21.15.55:0/112661301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe72415ad30 0x7fe7080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:12.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe723400640 1 -- 172.21.15.55:0/112661301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe72415ad30 msgr2=0x7fe7080051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:12.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe723400640 1 --2- 172.21.15.55:0/112661301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe72415ad30 0x7fe7080051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe723400640 1 -- 172.21.15.55:0/112661301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7080047d0 msgr2=0x7fe708004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:12.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe723400640 1 --2- 172.21.15.55:0/112661301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7080047d0 0x7fe708004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.776+0000 7fe723400640 1 -- 172.21.15.55:0/112661301 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe708003530 con 0x7fe7080039b0 2024-04-02T07:33:12.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.780+0000 7fe723400640 1 --2- 172.21.15.55:0/112661301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7080039b0 0x7fe708003dd0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fe714001780 tx=0x7fe71401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef1787ce2782fe5 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:12.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.780+0000 7fe722000640 1 -- 172.21.15.55:0/112661301 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7140052d0 con 0x7fe7080039b0 2024-04-02T07:33:12.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.780+0000 7fe722000640 1 -- 172.21.15.55:0/112661301 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe714005450 con 0x7fe7080039b0 2024-04-02T07:33:12.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.780+0000 7fe722000640 1 -- 172.21.15.55:0/112661301 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe714003840 con 0x7fe7080039b0 2024-04-02T07:33:12.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.780+0000 7fe72a000640 1 -- 172.21.15.55:0/112661301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7080039b0 msgr2=0x7fe708003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:12.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.780+0000 7fe72a000640 1 --2- 172.21.15.55:0/112661301 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7080039b0 0x7fe708003dd0 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fe714001780 tx=0x7fe71401c3f0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.780+0000 7fe723e00640 1 -- 172.21.15.55:0/112661301 reap_dead start 2024-04-02T07:33:12.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.780+0000 7fe72a000640 1 -- 172.21.15.55:0/112661301 shutdown_connections 2024-04-02T07:33:12.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.780+0000 7fe72a000640 1 -- 172.21.15.55:0/112661301 >> 172.21.15.55:0/112661301 conn(0x7fe724066080 msgr2=0x7fe724069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:12.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.780+0000 7fe72a000640 1 -- 172.21.15.55:0/112661301 shutdown_connections 2024-04-02T07:33:12.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.780+0000 7fe72a000640 1 -- 172.21.15.55:0/112661301 wait complete. 2024-04-02T07:33:12.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe72a000640 1 Processor -- start 2024-04-02T07:33:12.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe72a000640 1 -- start start 2024-04-02T07:33:12.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe72a000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7080039b0 0x7fe724159910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:12.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe72a000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe72415f440 0x7fe7240cbb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:12.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe72a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7240cc0d0 0x7fe72415ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:12.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe72a000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe724161570 con 0x7fe7240cc0d0 2024-04-02T07:33:12.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe72a000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7241f1d50 con 0x7fe7080039b0 2024-04-02T07:33:12.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe72a000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7241f11d0 con 0x7fe72415f440 2024-04-02T07:33:12.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe723e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7240cc0d0 0x7fe72415ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:12.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe723400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7080039b0 0x7fe724159910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:12.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe723e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7240cc0d0 0x7fe72415ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58570/0 (socket says 172.21.15.55:58570) 2024-04-02T07:33:12.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe723e00640 1 -- 172.21.15.55:0/2937027915 learned_addr learned my addr 172.21.15.55:0/2937027915 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:12.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe722a00640 1 --2- 172.21.15.55:0/2937027915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe72415f440 0x7fe7240cbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:12.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe723e00640 1 -- 172.21.15.55:0/2937027915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe72415f440 msgr2=0x7fe7240cbb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:12.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe723e00640 1 --2- 172.21.15.55:0/2937027915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe72415f440 0x7fe7240cbb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe723e00640 1 -- 172.21.15.55:0/2937027915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7080039b0 msgr2=0x7fe724159910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:12.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe723e00640 1 --2- 172.21.15.55:0/2937027915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7080039b0 0x7fe724159910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe723e00640 1 -- 172.21.15.55:0/2937027915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7241f14b0 con 0x7fe7240cc0d0 2024-04-02T07:33:12.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe723e00640 1 --2- 172.21.15.55:0/2937027915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7240cc0d0 0x7fe72415ca80 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fe72415f3f0 tx=0x7fe71c00a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:12.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe71b400640 1 -- 172.21.15.55:0/2937027915 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c00acc0 con 0x7fe7240cc0d0 2024-04-02T07:33:12.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe71b400640 1 -- 172.21.15.55:0/2937027915 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe71c00ae20 con 0x7fe7240cc0d0 2024-04-02T07:33:12.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe71b400640 1 -- 172.21.15.55:0/2937027915 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe71c013630 con 0x7fe7240cc0d0 2024-04-02T07:33:12.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe72a000640 1 -- 172.21.15.55:0/2937027915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7241f1790 con 0x7fe7240cc0d0 2024-04-02T07:33:12.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.784+0000 7fe72a000640 1 -- 172.21.15.55:0/2937027915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe724159e50 con 0x7fe7240cc0d0 2024-04-02T07:33:12.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.788+0000 7fe72a000640 1 -- 172.21.15.55:0/2937027915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe724066c90 con 0x7fe7240cc0d0 2024-04-02T07:33:12.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.788+0000 7fe71b400640 1 -- 172.21.15.55:0/2937027915 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe71c013790 con 0x7fe7240cc0d0 2024-04-02T07:33:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.788+0000 7fe71b400640 1 --2- 172.21.15.55:0/2937027915 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe704066690 0x7fe704068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.788+0000 7fe71b400640 1 -- 172.21.15.55:0/2937027915 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fe71c084910 con 0x7fe7240cc0d0 2024-04-02T07:33:12.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.788+0000 7fe723400640 1 --2- 172.21.15.55:0/2937027915 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe704066690 0x7fe704068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:12.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.788+0000 7fe723400640 1 --2- 172.21.15.55:0/2937027915 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe704066690 0x7fe704068b50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe714001750 tx=0x7fe7140011a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:12.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.792+0000 7fe71b400640 1 -- 172.21.15.55:0/2937027915 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe71c051b30 con 0x7fe7240cc0d0 2024-04-02T07:33:12.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.992+0000 7fe72a000640 1 -- 172.21.15.55:0/2937027915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7240b2880 con 0x7fe7240cc0d0 2024-04-02T07:33:12.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.992+0000 7fe71b400640 1 -- 172.21.15.55:0/2937027915 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 88 v88) v1 ==== 94+0+3973 (secure 0 0 0) 0x7fe71c055150 con 0x7fe7240cc0d0 2024-04-02T07:33:12.995 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:12.995 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":88,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2707651793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2707651793},{"type":"v1","addr":"172.21.15.106:6836","nonce":2707651793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2234384639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2234384639},{"type":"v1","addr":"172.21.15.106:6837","nonce":2234384639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":8433,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53259218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53259218},{"type":"v1","addr":"172.21.15.55:6833","nonce":53259218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76}],"filesystems":[{"mdsmap":{"epoch":88,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:31:30.704183+0000","modified":"2024-04-02T07:33:12.109414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-02T07:33:12.996 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 88 2024-04-02T07:33:12.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.996+0000 7fe72a000640 1 -- 172.21.15.55:0/2937027915 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe704066690 msgr2=0x7fe704068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:12.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.996+0000 7fe72a000640 1 --2- 172.21.15.55:0/2937027915 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe704066690 0x7fe704068b50 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe714001750 tx=0x7fe7140011a0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.996+0000 7fe72a000640 1 -- 172.21.15.55:0/2937027915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7240cc0d0 msgr2=0x7fe72415ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:12.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.996+0000 7fe72a000640 1 --2- 172.21.15.55:0/2937027915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7240cc0d0 0x7fe72415ca80 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7fe72415f3f0 tx=0x7fe71c00a6e0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.996+0000 7fe72a000640 1 -- 172.21.15.55:0/2937027915 shutdown_connections 2024-04-02T07:33:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.996+0000 7fe72a000640 1 --2- 172.21.15.55:0/2937027915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7240cc0d0 0x7fe72415ca80 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.996+0000 7fe72a000640 1 --2- 172.21.15.55:0/2937027915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe72415f440 0x7fe7240cbb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.996+0000 7fe72a000640 1 --2- 172.21.15.55:0/2937027915 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe704066690 0x7fe704068b50 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.996+0000 7fe72a000640 1 --2- 172.21.15.55:0/2937027915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7080039b0 0x7fe724159910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.996+0000 7fe72a000640 1 -- 172.21.15.55:0/2937027915 >> 172.21.15.55:0/2937027915 conn(0x7fe724066080 msgr2=0x7fe7240b1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.996+0000 7fe72a000640 1 -- 172.21.15.55:0/2937027915 shutdown_connections 2024-04-02T07:33:12.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:12.996+0000 7fe72a000640 1 -- 172.21.15.55:0/2937027915 wait complete. 2024-04-02T07:33:13.018 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:33:13.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.156+0000 7fd938800640 1 Processor -- start 2024-04-02T07:33:13.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.156+0000 7fd938800640 1 -- start start 2024-04-02T07:33:13.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.156+0000 7fd938800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd93015cc90 0x7fd93006f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:13.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.156+0000 7fd938800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd9300aecb0 0x7fd9300b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:13.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.156+0000 7fd938800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd93006f420 con 0x7fd93015c8b0 2024-04-02T07:33:13.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.156+0000 7fd938800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd93006fdf0 con 0x7fd9300aecb0 2024-04-02T07:33:13.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.156+0000 7fd938800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd93006a5e0 con 0x7fd93015cc90 2024-04-02T07:33:13.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.156+0000 7fd935e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd93015c8b0 0x7fd930069d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47424/0 (socket says 172.21.15.55:47424) 2024-04-02T07:33:13.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.156+0000 7fd935e00640 1 -- 172.21.15.55:0/101965071 learned_addr learned my addr 172.21.15.55:0/101965071 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:13.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.156+0000 7fd936800640 1 --2- 172.21.15.55:0/101965071 >> v2:172.21.15.55:3300/0 conn(0x7fd9300aecb0 0x7fd9300b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:13.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.156+0000 7fd934a00640 1 -- 172.21.15.55:0/101965071 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2983551930 0 0) 0x7fd93006f420 con 0x7fd93015c8b0 2024-04-02T07:33:13.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.156+0000 7fd934a00640 1 -- 172.21.15.55:0/101965071 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd918003530 con 0x7fd93015c8b0 2024-04-02T07:33:13.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.156+0000 7fd936800640 1 -- 172.21.15.55:0/101965071 >> v2:172.21.15.106:3300/0 conn(0x7fd93015cc90 msgr2=0x7fd93006f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:13.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.156+0000 7fd935400640 1 --2- 172.21.15.55:0/101965071 >> v2:172.21.15.106:3300/0 conn(0x7fd93015cc90 0x7fd93006f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:13.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.160+0000 7fd936800640 1 --2- 172.21.15.55:0/101965071 >> v2:172.21.15.106:3300/0 conn(0x7fd93015cc90 0x7fd93006f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.160+0000 7fd936800640 1 -- 172.21.15.55:0/101965071 >> v1:172.21.15.55:6789/0 conn(0x7fd93015c8b0 legacy=0x7fd930069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:13.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.160+0000 7fd936800640 1 -- 172.21.15.55:0/101965071 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd93006edd0 con 0x7fd9300aecb0 2024-04-02T07:33:13.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.160+0000 7fd935400640 1 --2- 172.21.15.55:0/101965071 >> v2:172.21.15.106:3300/0 conn(0x7fd93015cc90 0x7fd93006f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:13.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.160+0000 7fd936800640 1 --2- 172.21.15.55:0/101965071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9300aecb0 0x7fd9300b31c0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fd930071800 tx=0x7fd92c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94293593ea569c4d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:13.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.160+0000 7fd934a00640 1 -- 172.21.15.55:0/101965071 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0a58d0 con 0x7fd9300aecb0 2024-04-02T07:33:13.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.160+0000 7fd934a00640 1 -- 172.21.15.55:0/101965071 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92c0a5a30 con 0x7fd9300aecb0 2024-04-02T07:33:13.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.160+0000 7fd934a00640 1 -- 172.21.15.55:0/101965071 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0a5da0 con 0x7fd9300aecb0 2024-04-02T07:33:13.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.160+0000 7fd938800640 1 -- 172.21.15.55:0/101965071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9300aecb0 msgr2=0x7fd9300b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:13.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.160+0000 7fd938800640 1 --2- 172.21.15.55:0/101965071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9300aecb0 0x7fd9300b31c0 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7fd930071800 tx=0x7fd92c01c900 comp rx=0 tx=0).stop 2024-04-02T07:33:13.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.160+0000 7fd938800640 1 -- 172.21.15.55:0/101965071 shutdown_connections 2024-04-02T07:33:13.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.160+0000 7fd938800640 1 --2- 172.21.15.55:0/101965071 >> v2:172.21.15.106:3300/0 conn(0x7fd93015cc90 0x7fd93006f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.160+0000 7fd938800640 1 --2- 172.21.15.55:0/101965071 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9300aecb0 0x7fd9300b31c0 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.160+0000 7fd938800640 1 -- 172.21.15.55:0/101965071 >> 172.21.15.55:0/101965071 conn(0x7fd9300b13b0 msgr2=0x7fd9300b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:13.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.160+0000 7fd938800640 1 -- 172.21.15.55:0/101965071 shutdown_connections 2024-04-02T07:33:13.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.160+0000 7fd938800640 1 -- 172.21.15.55:0/101965071 wait complete. 2024-04-02T07:33:13.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd938800640 1 Processor -- start 2024-04-02T07:33:13.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd938800640 1 -- start start 2024-04-02T07:33:13.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd938800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9300aecb0 0x7fd930157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:13.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd938800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd93015c8b0 0x7fd9301579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:13.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd938800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9300adfd0 0x7fd930159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:13.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd938800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd930156e40 con 0x7fd9300adfd0 2024-04-02T07:33:13.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd938800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd930158cf0 con 0x7fd9300aecb0 2024-04-02T07:33:13.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd938800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9301580e0 con 0x7fd93015c8b0 2024-04-02T07:33:13.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd936800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9300adfd0 0x7fd930159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:13.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd936800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9300adfd0 0x7fd930159180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58584/0 (socket says 172.21.15.55:58584) 2024-04-02T07:33:13.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd936800640 1 -- 172.21.15.55:0/3371525969 learned_addr learned my addr 172.21.15.55:0/3371525969 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:13.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd935400640 1 --2- 172.21.15.55:0/3371525969 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd93015c8b0 0x7fd9301579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:13.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd935e00640 1 --2- 172.21.15.55:0/3371525969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9300aecb0 0x7fd930157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:13.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd936800640 1 -- 172.21.15.55:0/3371525969 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd93015c8b0 msgr2=0x7fd9301579d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:13.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd936800640 1 --2- 172.21.15.55:0/3371525969 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd93015c8b0 0x7fd9301579d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd936800640 1 -- 172.21.15.55:0/3371525969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9300aecb0 msgr2=0x7fd930157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:13.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd936800640 1 --2- 172.21.15.55:0/3371525969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9300aecb0 0x7fd930157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd936800640 1 -- 172.21.15.55:0/3371525969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd92c009a70 con 0x7fd9300adfd0 2024-04-02T07:33:13.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd936800640 1 --2- 172.21.15.55:0/3371525969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9300adfd0 0x7fd930159180 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fd92c01cde0 tx=0x7fd92c0196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:13.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd92a000640 1 -- 172.21.15.55:0/3371525969 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0ae8e0 con 0x7fd9300adfd0 2024-04-02T07:33:13.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd92a000640 1 -- 172.21.15.55:0/3371525969 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd92c0aea40 con 0x7fd9300adfd0 2024-04-02T07:33:13.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd92a000640 1 -- 172.21.15.55:0/3371525969 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0aedb0 con 0x7fd9300adfd0 2024-04-02T07:33:13.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd938800640 1 -- 172.21.15.55:0/3371525969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9301583c0 con 0x7fd9300adfd0 2024-04-02T07:33:13.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.164+0000 7fd938800640 1 -- 172.21.15.55:0/3371525969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd930158980 con 0x7fd9300adfd0 2024-04-02T07:33:13.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.168+0000 7fd938800640 1 -- 172.21.15.55:0/3371525969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd930159e80 con 0x7fd9300adfd0 2024-04-02T07:33:13.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.168+0000 7fd92a000640 1 -- 172.21.15.55:0/3371525969 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd92c0b4050 con 0x7fd9300adfd0 2024-04-02T07:33:13.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.168+0000 7fd92a000640 1 --2- 172.21.15.55:0/3371525969 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd914066690 0x7fd914068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:13.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.168+0000 7fd92a000640 1 -- 172.21.15.55:0/3371525969 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fd92c11f2a0 con 0x7fd9300adfd0 2024-04-02T07:33:13.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.168+0000 7fd935e00640 1 --2- 172.21.15.55:0/3371525969 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd914066690 0x7fd914068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:13.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.168+0000 7fd935e00640 1 --2- 172.21.15.55:0/3371525969 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd914066690 0x7fd914068b50 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd924005890 tx=0x7fd924009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:13.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.172+0000 7fd92a000640 1 -- 172.21.15.55:0/3371525969 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd92c0ec4d0 con 0x7fd9300adfd0 2024-04-02T07:33:13.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.340+0000 7fd938800640 1 -- 172.21.15.55:0/3371525969 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd930066c90 con 0x7fd9300adfd0 2024-04-02T07:33:13.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.340+0000 7fd92a000640 1 -- 172.21.15.55:0/3371525969 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+16310 (secure 0 0 0) 0x7fd92c0efaf0 con 0x7fd9300adfd0 2024-04-02T07:33:13.341 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:13.342 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":105,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:33:12.108824+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:31:29.246681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-02T07:31:29.698823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6835/1137835746":"2024-04-03T07:33:12.108798+0000","172.21.15.55:6834/1137835746":"2024-04-03T07:33:12.108798+0000","172.21.15.55:6835/1089546237":"2024-04-03T07:32:35.358480+0000","172.21.15.55:6834/1089546237":"2024-04-03T07:32:35.358480+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:33:13.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.340+0000 7fd938800640 1 -- 172.21.15.55:0/3371525969 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd914066690 msgr2=0x7fd914068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:13.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.340+0000 7fd938800640 1 --2- 172.21.15.55:0/3371525969 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd914066690 0x7fd914068b50 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fd924005890 tx=0x7fd924009040 comp rx=0 tx=0).stop 2024-04-02T07:33:13.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.340+0000 7fd938800640 1 -- 172.21.15.55:0/3371525969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9300adfd0 msgr2=0x7fd930159180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:13.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.340+0000 7fd938800640 1 --2- 172.21.15.55:0/3371525969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9300adfd0 0x7fd930159180 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fd92c01cde0 tx=0x7fd92c0196a0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.340+0000 7fd938800640 1 -- 172.21.15.55:0/3371525969 shutdown_connections 2024-04-02T07:33:13.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.340+0000 7fd938800640 1 --2- 172.21.15.55:0/3371525969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd9300adfd0 0x7fd930159180 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.340+0000 7fd938800640 1 --2- 172.21.15.55:0/3371525969 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd93015c8b0 0x7fd9301579d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.340+0000 7fd938800640 1 --2- 172.21.15.55:0/3371525969 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd914066690 0x7fd914068b50 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.340+0000 7fd938800640 1 --2- 172.21.15.55:0/3371525969 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd9300aecb0 0x7fd930157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.340+0000 7fd938800640 1 -- 172.21.15.55:0/3371525969 >> 172.21.15.55:0/3371525969 conn(0x7fd9300b13b0 msgr2=0x7fd9300b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:13.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.340+0000 7fd938800640 1 -- 172.21.15.55:0/3371525969 shutdown_connections 2024-04-02T07:33:13.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.340+0000 7fd938800640 1 -- 172.21.15.55:0/3371525969 wait complete. 2024-04-02T07:33:13.362 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:31:29.246681+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '102', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:31:29.698823+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '103', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:33:13.363 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:33:13.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.504+0000 7f4f23e00640 1 Processor -- start 2024-04-02T07:33:13.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.504+0000 7f4f23e00640 1 -- start start 2024-04-02T07:33:13.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.508+0000 7f4f23e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4f1c0ade90 0x7f4f1c06d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:13.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.508+0000 7f4f23e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4f1c0b41a0 0x7f4f1c142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:13.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.508+0000 7f4f23e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f1c06c630 con 0x7f4f1c0b3dc0 2024-04-02T07:33:13.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.508+0000 7f4f23e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f1c0cae80 con 0x7f4f1c0ade90 2024-04-02T07:33:13.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.508+0000 7f4f23e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c06c8f0 con 0x7f4f1c0b41a0 2024-04-02T07:33:13.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.508+0000 7f4f20a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4f1c0ade90 0x7f4f1c06d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:13.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.508+0000 7f4f20a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4f1c0ade90 0x7f4f1c06d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58588/0 (socket says 172.21.15.55:58588) 2024-04-02T07:33:13.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.508+0000 7f4f20a00640 1 -- 172.21.15.55:0/3378627255 learned_addr learned my addr 172.21.15.55:0/3378627255 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:13.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.508+0000 7f4f21e00640 1 --2- 172.21.15.55:0/3378627255 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4f1c0b41a0 0x7f4f1c142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:13.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.508+0000 7f4f20a00640 1 -- 172.21.15.55:0/3378627255 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4f1c0b41a0 msgr2=0x7f4f1c142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:13.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.508+0000 7f4f20a00640 1 --2- 172.21.15.55:0/3378627255 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4f1c0b41a0 0x7f4f1c142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.508+0000 7f4f20a00640 1 -- 172.21.15.55:0/3378627255 >> v1:172.21.15.106:6789/0 conn(0x7f4f1c0b3dc0 legacy=0x7f4f1c0ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:13.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.508+0000 7f4f20a00640 1 -- 172.21.15.55:0/3378627255 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1c06cbd0 con 0x7f4f1c0ade90 2024-04-02T07:33:13.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.508+0000 7f4f21e00640 1 --2- 172.21.15.55:0/3378627255 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4f1c0b41a0 0x7f4f1c142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:13.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.508+0000 7f4f20a00640 1 --2- 172.21.15.55:0/3378627255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f1c0ade90 0x7f4f1c06d6b0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009870 tx=0x7f4f0801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bf8fc561f19a343 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:13.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.508+0000 7f4f1be00640 1 -- 172.21.15.55:0/3378627255 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f080ac410 con 0x7f4f1c0ade90 2024-04-02T07:33:13.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.508+0000 7f4f1be00640 1 -- 172.21.15.55:0/3378627255 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f080ac570 con 0x7f4f1c0ade90 2024-04-02T07:33:13.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.508+0000 7f4f1be00640 1 -- 172.21.15.55:0/3378627255 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f080ac900 con 0x7f4f1c0ade90 2024-04-02T07:33:13.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f23e00640 1 -- 172.21.15.55:0/3378627255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f1c0ade90 msgr2=0x7f4f1c06d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:13.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f23e00640 1 --2- 172.21.15.55:0/3378627255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f1c0ade90 0x7f4f1c06d6b0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f4f08009870 tx=0x7f4f0801c4a0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f23e00640 1 -- 172.21.15.55:0/3378627255 shutdown_connections 2024-04-02T07:33:13.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f23e00640 1 --2- 172.21.15.55:0/3378627255 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4f1c0b41a0 0x7f4f1c142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f23e00640 1 --2- 172.21.15.55:0/3378627255 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f1c0ade90 0x7f4f1c06d6b0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f23e00640 1 -- 172.21.15.55:0/3378627255 >> 172.21.15.55:0/3378627255 conn(0x7f4f1c06a390 msgr2=0x7f4f1c0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:13.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f23e00640 1 -- 172.21.15.55:0/3378627255 shutdown_connections 2024-04-02T07:33:13.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f23e00640 1 -- 172.21.15.55:0/3378627255 wait complete. 2024-04-02T07:33:13.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f23e00640 1 Processor -- start 2024-04-02T07:33:13.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f23e00640 1 -- start start 2024-04-02T07:33:13.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f23e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f1c0ade90 0x7f4f1c0acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:13.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f23e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f1c0b3dc0 0x7f4f1c133960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f23e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4f1c0b41a0 0x7f4f1c134340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f23e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c1336c0 con 0x7f4f1c0b3dc0 2024-04-02T07:33:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f23e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c0aeff0 con 0x7f4f1c0ade90 2024-04-02T07:33:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f23e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1c0af2d0 con 0x7f4f1c0b41a0 2024-04-02T07:33:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f20a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f1c0b3dc0 0x7f4f1c133960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f20a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f1c0b3dc0 0x7f4f1c133960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58598/0 (socket says 172.21.15.55:58598) 2024-04-02T07:33:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f20a00640 1 -- 172.21.15.55:0/600301458 learned_addr learned my addr 172.21.15.55:0/600301458 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f21400640 1 --2- 172.21.15.55:0/600301458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f1c0ade90 0x7f4f1c0acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f21e00640 1 --2- 172.21.15.55:0/600301458 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4f1c0b41a0 0x7f4f1c134340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f20a00640 1 -- 172.21.15.55:0/600301458 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4f1c0b41a0 msgr2=0x7f4f1c134340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f20a00640 1 --2- 172.21.15.55:0/600301458 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4f1c0b41a0 0x7f4f1c134340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f20a00640 1 -- 172.21.15.55:0/600301458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f1c0ade90 msgr2=0x7f4f1c0acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:13.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f20a00640 1 --2- 172.21.15.55:0/600301458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f1c0ade90 0x7f4f1c0acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f20a00640 1 -- 172.21.15.55:0/600301458 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f080094d0 con 0x7f4f1c0b3dc0 2024-04-02T07:33:13.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f21e00640 1 --2- 172.21.15.55:0/600301458 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4f1c0b41a0 0x7f4f1c134340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:13.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.512+0000 7f4f21400640 1 --2- 172.21.15.55:0/600301458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f1c0ade90 0x7f4f1c0acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:13.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.516+0000 7f4f20a00640 1 --2- 172.21.15.55:0/600301458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f1c0b3dc0 0x7f4f1c133960 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f4f080af040 tx=0x7f4f08019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:13.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.516+0000 7f4f19600640 1 -- 172.21.15.55:0/600301458 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f080ac410 con 0x7f4f1c0b3dc0 2024-04-02T07:33:13.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.516+0000 7f4f19600640 1 -- 172.21.15.55:0/600301458 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f080b65f0 con 0x7f4f1c0b3dc0 2024-04-02T07:33:13.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.516+0000 7f4f19600640 1 -- 172.21.15.55:0/600301458 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f080b69a0 con 0x7f4f1c0b3dc0 2024-04-02T07:33:13.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.516+0000 7f4f23e00640 1 -- 172.21.15.55:0/600301458 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f1c06de00 con 0x7f4f1c0b3dc0 2024-04-02T07:33:13.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.516+0000 7f4f23e00640 1 -- 172.21.15.55:0/600301458 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f1c0af890 con 0x7f4f1c0b3dc0 2024-04-02T07:33:13.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.516+0000 7f4f23e00640 1 -- 172.21.15.55:0/600301458 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1c073530 con 0x7f4f1c0b3dc0 2024-04-02T07:33:13.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.516+0000 7f4f19600640 1 -- 172.21.15.55:0/600301458 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f4f080b6b00 con 0x7f4f1c0b3dc0 2024-04-02T07:33:13.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.516+0000 7f4f19600640 1 --2- 172.21.15.55:0/600301458 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4efc066690 0x7f4efc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:13.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.516+0000 7f4f19600640 1 -- 172.21.15.55:0/600301458 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f4f0811ec60 con 0x7f4f1c0b3dc0 2024-04-02T07:33:13.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.516+0000 7f4f21400640 1 --2- 172.21.15.55:0/600301458 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4efc066690 0x7f4efc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:13.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.520+0000 7f4f21400640 1 --2- 172.21.15.55:0/600301458 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4efc066690 0x7f4efc068b50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c1510f0 tx=0x7f4f10009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:13.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.520+0000 7f4f19600640 1 -- 172.21.15.55:0/600301458 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f4f080ebfa0 con 0x7f4f1c0b3dc0 2024-04-02T07:33:13.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.684+0000 7f4f23e00640 1 -- 172.21.15.55:0/600301458 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f1c142550 con 0x7f4f1c0b3dc0 2024-04-02T07:33:13.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.684+0000 7f4f19600640 1 -- 172.21.15.55:0/600301458 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v105) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f080b1020 con 0x7f4f1c0b3dc0 2024-04-02T07:33:13.685 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:33:13.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.684+0000 7f4f23e00640 1 -- 172.21.15.55:0/600301458 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4efc066690 msgr2=0x7f4efc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:13.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.684+0000 7f4f23e00640 1 --2- 172.21.15.55:0/600301458 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4efc066690 0x7f4efc068b50 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c1510f0 tx=0x7f4f10009040 comp rx=0 tx=0).stop 2024-04-02T07:33:13.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.684+0000 7f4f23e00640 1 -- 172.21.15.55:0/600301458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f1c0b3dc0 msgr2=0x7f4f1c133960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:13.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.684+0000 7f4f23e00640 1 --2- 172.21.15.55:0/600301458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f1c0b3dc0 0x7f4f1c133960 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f4f080af040 tx=0x7f4f08019240 comp rx=0 tx=0).stop 2024-04-02T07:33:13.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.684+0000 7f4f23e00640 1 -- 172.21.15.55:0/600301458 shutdown_connections 2024-04-02T07:33:13.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.684+0000 7f4f23e00640 1 --2- 172.21.15.55:0/600301458 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4f1c0b41a0 0x7f4f1c134340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.684+0000 7f4f23e00640 1 --2- 172.21.15.55:0/600301458 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f1c0b3dc0 0x7f4f1c133960 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.684+0000 7f4f23e00640 1 --2- 172.21.15.55:0/600301458 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4efc066690 0x7f4efc068b50 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.684+0000 7f4f23e00640 1 --2- 172.21.15.55:0/600301458 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4f1c0ade90 0x7f4f1c0acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.684+0000 7f4f23e00640 1 -- 172.21.15.55:0/600301458 >> 172.21.15.55:0/600301458 conn(0x7f4f1c06a390 msgr2=0x7f4f1c0b04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:13.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.684+0000 7f4f23e00640 1 -- 172.21.15.55:0/600301458 shutdown_connections 2024-04-02T07:33:13.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.684+0000 7f4f23e00640 1 -- 172.21.15.55:0/600301458 wait complete. 2024-04-02T07:33:13.708 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:33:13.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.848+0000 7feecde00640 1 Processor -- start 2024-04-02T07:33:13.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.848+0000 7feecde00640 1 -- start start 2024-04-02T07:33:13.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.848+0000 7feecde00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7feec80b3dc0 0x7feec80ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:13.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.848+0000 7feecde00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feec80ade90 0x7feec806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:13.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.848+0000 7feecde00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feec806c630 con 0x7feec80b41a0 2024-04-02T07:33:13.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.848+0000 7feecde00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec806c8f0 con 0x7feec80ade90 2024-04-02T07:33:13.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.848+0000 7feecde00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feec806cbd0 con 0x7feec80b3dc0 2024-04-02T07:33:13.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.852+0000 7feebfe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feec80ade90 0x7feec806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:13.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.852+0000 7feebfe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feec80ade90 0x7feec806d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58612/0 (socket says 172.21.15.55:58612) 2024-04-02T07:33:13.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.852+0000 7feebfe00640 1 -- 172.21.15.55:0/3683063716 learned_addr learned my addr 172.21.15.55:0/3683063716 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:13.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.852+0000 7feec6a00640 1 --2- 172.21.15.55:0/3683063716 >> v2:172.21.15.106:3300/0 conn(0x7feec80b3dc0 0x7feec80ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:13.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.852+0000 7feebfe00640 1 -- 172.21.15.55:0/3683063716 >> v2:172.21.15.106:3300/0 conn(0x7feec80b3dc0 msgr2=0x7feec80ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:13.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.852+0000 7feebfe00640 1 --2- 172.21.15.55:0/3683063716 >> v2:172.21.15.106:3300/0 conn(0x7feec80b3dc0 0x7feec80ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.852+0000 7feebfe00640 1 -- 172.21.15.55:0/3683063716 >> v1:172.21.15.106:6789/0 conn(0x7feec80b41a0 legacy=0x7feec8142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:13.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.852+0000 7feebfe00640 1 -- 172.21.15.55:0/3683063716 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec806ceb0 con 0x7feec80ade90 2024-04-02T07:33:13.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.852+0000 7feebfe00640 1 --2- 172.21.15.55:0/3683063716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80ade90 0x7feec806d6b0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7feec806c820 tx=0x7feeb001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d8d34964cd1ed0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:13.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.852+0000 7feec6000640 1 -- 172.21.15.55:0/3683063716 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00aa670 con 0x7feec80ade90 2024-04-02T07:33:13.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.852+0000 7feec6000640 1 -- 172.21.15.55:0/3683063716 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb00aa7d0 con 0x7feec80ade90 2024-04-02T07:33:13.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.852+0000 7feec6000640 1 -- 172.21.15.55:0/3683063716 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00aab60 con 0x7feec80ade90 2024-04-02T07:33:13.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feecde00640 1 -- 172.21.15.55:0/3683063716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80ade90 msgr2=0x7feec806d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:13.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feecde00640 1 --2- 172.21.15.55:0/3683063716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80ade90 0x7feec806d6b0 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7feec806c820 tx=0x7feeb001c4f0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feecde00640 1 -- 172.21.15.55:0/3683063716 shutdown_connections 2024-04-02T07:33:13.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feecde00640 1 --2- 172.21.15.55:0/3683063716 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80ade90 0x7feec806d6b0 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feecde00640 1 --2- 172.21.15.55:0/3683063716 >> v2:172.21.15.106:3300/0 conn(0x7feec80b3dc0 0x7feec80ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feecde00640 1 -- 172.21.15.55:0/3683063716 >> 172.21.15.55:0/3683063716 conn(0x7feec806a390 msgr2=0x7feec80b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:13.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feecde00640 1 -- 172.21.15.55:0/3683063716 shutdown_connections 2024-04-02T07:33:13.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feecde00640 1 -- 172.21.15.55:0/3683063716 wait complete. 2024-04-02T07:33:13.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feecde00640 1 Processor -- start 2024-04-02T07:33:13.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feecde00640 1 -- start start 2024-04-02T07:33:13.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feecde00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feec80ade90 0x7feec8159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:13.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feecde00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80b3dc0 0x7feec80accc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:13.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feecde00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feec80b41a0 0x7feec813e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:13.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feecde00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec80ac830 con 0x7feec80b3dc0 2024-04-02T07:33:13.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feecde00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec80abc20 con 0x7feec80ade90 2024-04-02T07:33:13.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feecde00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feec80abf00 con 0x7feec80b41a0 2024-04-02T07:33:13.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feebfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80b3dc0 0x7feec80accc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:13.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feebfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80b3dc0 0x7feec80accc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58626/0 (socket says 172.21.15.55:58626) 2024-04-02T07:33:13.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feebfe00640 1 -- 172.21.15.55:0/3133042337 learned_addr learned my addr 172.21.15.55:0/3133042337 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:13.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feec6a00640 1 --2- 172.21.15.55:0/3133042337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feec80ade90 0x7feec8159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:13.860 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feec7400640 1 --2- 172.21.15.55:0/3133042337 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feec80b41a0 0x7feec813e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:13.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feebfe00640 1 -- 172.21.15.55:0/3133042337 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feec80b41a0 msgr2=0x7feec813e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:13.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feebfe00640 1 --2- 172.21.15.55:0/3133042337 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feec80b41a0 0x7feec813e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feebfe00640 1 -- 172.21.15.55:0/3133042337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feec80ade90 msgr2=0x7feec8159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:13.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feebfe00640 1 --2- 172.21.15.55:0/3133042337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feec80ade90 0x7feec8159220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:13.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.856+0000 7feebfe00640 1 -- 172.21.15.55:0/3133042337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb00094d0 con 0x7feec80b3dc0 2024-04-02T07:33:13.861 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.860+0000 7feebfe00640 1 --2- 172.21.15.55:0/3133042337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80b3dc0 0x7feec80accc0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7feeb0019100 tx=0x7feeb001ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:13.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.860+0000 7feebf400640 1 -- 172.21.15.55:0/3133042337 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00b3800 con 0x7feec80b3dc0 2024-04-02T07:33:13.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.860+0000 7feebf400640 1 -- 172.21.15.55:0/3133042337 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feeb00b3960 con 0x7feec80b3dc0 2024-04-02T07:33:13.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.860+0000 7feecde00640 1 -- 172.21.15.55:0/3133042337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec806de00 con 0x7feec80b3dc0 2024-04-02T07:33:13.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.860+0000 7feebf400640 1 -- 172.21.15.55:0/3133042337 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb00b3d10 con 0x7feec80b3dc0 2024-04-02T07:33:13.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.860+0000 7feecde00640 1 -- 172.21.15.55:0/3133042337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec80ac4c0 con 0x7feec80b3dc0 2024-04-02T07:33:13.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.860+0000 7feecde00640 1 -- 172.21.15.55:0/3133042337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feec8073530 con 0x7feec80b3dc0 2024-04-02T07:33:13.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.860+0000 7feebf400640 1 -- 172.21.15.55:0/3133042337 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7feeb00c6440 con 0x7feec80b3dc0 2024-04-02T07:33:13.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.860+0000 7feebf400640 1 --2- 172.21.15.55:0/3133042337 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feea40666c0 0x7feea4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:13.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.860+0000 7feebf400640 1 -- 172.21.15.55:0/3133042337 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5881+0+0 (secure 0 0 0) 0x7feeb011ef60 con 0x7feec80b3dc0 2024-04-02T07:33:13.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.860+0000 7feec6a00640 1 --2- 172.21.15.55:0/3133042337 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feea40666c0 0x7feea4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:13.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.864+0000 7feec6a00640 1 --2- 172.21.15.55:0/3133042337 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feea40666c0 0x7feea4068b80 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7feeb8009af0 tx=0x7feeb8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:13.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:13.864+0000 7feebf400640 1 -- 172.21.15.55:0/3133042337 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7feeb00ec210 con 0x7feec80b3dc0 2024-04-02T07:33:14.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.028+0000 7feecde00640 1 -- 172.21.15.55:0/3133042337 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feec8066c90 con 0x7feec80b3dc0 2024-04-02T07:33:14.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.028+0000 7feebf400640 1 -- 172.21.15.55:0/3133042337 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v105) v1 ==== 104+0+11 (secure 0 0 0) 0x7feeb00ef830 con 0x7feec80b3dc0 2024-04-02T07:33:14.029 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:33:14.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.028+0000 7feecde00640 1 -- 172.21.15.55:0/3133042337 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feea40666c0 msgr2=0x7feea4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:14.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.028+0000 7feecde00640 1 --2- 172.21.15.55:0/3133042337 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feea40666c0 0x7feea4068b80 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7feeb8009af0 tx=0x7feeb8008040 comp rx=0 tx=0).stop 2024-04-02T07:33:14.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.028+0000 7feecde00640 1 -- 172.21.15.55:0/3133042337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80b3dc0 msgr2=0x7feec80accc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:14.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.028+0000 7feecde00640 1 --2- 172.21.15.55:0/3133042337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80b3dc0 0x7feec80accc0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7feeb0019100 tx=0x7feeb001ad30 comp rx=0 tx=0).stop 2024-04-02T07:33:14.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.028+0000 7feecde00640 1 -- 172.21.15.55:0/3133042337 shutdown_connections 2024-04-02T07:33:14.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.028+0000 7feecde00640 1 --2- 172.21.15.55:0/3133042337 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7feec80b41a0 0x7feec813e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.028+0000 7feecde00640 1 --2- 172.21.15.55:0/3133042337 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feec80b3dc0 0x7feec80accc0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.028+0000 7feecde00640 1 --2- 172.21.15.55:0/3133042337 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feea40666c0 0x7feea4068b80 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.028+0000 7feecde00640 1 --2- 172.21.15.55:0/3133042337 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7feec80ade90 0x7feec8159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.028+0000 7feecde00640 1 -- 172.21.15.55:0/3133042337 >> 172.21.15.55:0/3133042337 conn(0x7feec806a390 msgr2=0x7feec815d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:14.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.028+0000 7feecde00640 1 -- 172.21.15.55:0/3133042337 shutdown_connections 2024-04-02T07:33:14.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.028+0000 7feecde00640 1 -- 172.21.15.55:0/3133042337 wait complete. 2024-04-02T07:33:14.050 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:33:14.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe817e00640 1 Processor -- start 2024-04-02T07:33:14.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe817e00640 1 -- start start 2024-04-02T07:33:14.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe817e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8100b41a0 0x7fe810142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe817e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81006ddc0 con 0x7fe8100ade90 2024-04-02T07:33:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe817e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81006c630 con 0x7fe8100b3dc0 2024-04-02T07:33:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe817e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8100cae80 con 0x7fe8100b41a0 2024-04-02T07:33:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe814a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe8100ade90 0x7fe81006d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47434/0 (socket says 172.21.15.55:47434) 2024-04-02T07:33:14.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe814a00640 1 -- 172.21.15.55:0/1648014875 learned_addr learned my addr 172.21.15.55:0/1648014875 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:14.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe815e00640 1 --2- 172.21.15.55:0/1648014875 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8100b41a0 0x7fe810142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:14.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe80fe00640 1 -- 172.21.15.55:0/1648014875 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1539849524 0 0) 0x7fe81006ddc0 con 0x7fe8100ade90 2024-04-02T07:33:14.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe80fe00640 1 -- 172.21.15.55:0/1648014875 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7f8005740 con 0x7fe8100ade90 2024-04-02T07:33:14.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe80fe00640 1 -- 172.21.15.55:0/1648014875 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 512564547 0 0) 0x7fe81006c630 con 0x7fe8100b3dc0 2024-04-02T07:33:14.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe80fe00640 1 -- 172.21.15.55:0/1648014875 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe81006ddc0 con 0x7fe8100b3dc0 2024-04-02T07:33:14.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe80fe00640 1 -- 172.21.15.55:0/1648014875 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 273081021 0 0) 0x7fe7f8005740 con 0x7fe8100ade90 2024-04-02T07:33:14.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe80fe00640 1 -- 172.21.15.55:0/1648014875 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8100b41a0 msgr2=0x7fe810142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:14.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe80fe00640 1 --2- 172.21.15.55:0/1648014875 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8100b41a0 0x7fe810142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe80fe00640 1 -- 172.21.15.55:0/1648014875 >> v1:172.21.15.106:6789/0 conn(0x7fe8100b3dc0 legacy=0x7fe8100ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:14.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe80fe00640 1 -- 172.21.15.55:0/1648014875 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81006c8f0 con 0x7fe8100ade90 2024-04-02T07:33:14.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe80fe00640 1 -- 172.21.15.55:0/1648014875 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fe7fc001600 con 0x7fe8100ade90 2024-04-02T07:33:14.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe80fe00640 1 -- 172.21.15.55:0/1648014875 >> v1:172.21.15.55:6789/0 conn(0x7fe8100ade90 legacy=0x7fe81006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe80fe00640 1 --2- 172.21.15.55:0/1648014875 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8100b41a0 0x7fe7f8005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe80fe00640 1 --2- 172.21.15.55:0/1648014875 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7f8006300 0x7fe7f80069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe80fe00640 1 --2- 172.21.15.55:0/1648014875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f8006f20 0x7fe7f80073a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe80fe00640 1 -- 172.21.15.55:0/1648014875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8100cae80 con 0x7fe7f8006f20 2024-04-02T07:33:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe80fe00640 1 -- 172.21.15.55:0/1648014875 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f800dd60 con 0x7fe7f8006300 2024-04-02T07:33:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.192+0000 7fe80fe00640 1 -- 172.21.15.55:0/1648014875 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7f800df20 con 0x7fe8100b41a0 2024-04-02T07:33:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.196+0000 7fe815400640 1 --2- 172.21.15.55:0/1648014875 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8100b41a0 0x7fe7f8005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.196+0000 7fe815e00640 1 --2- 172.21.15.55:0/1648014875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f8006f20 0x7fe7f80073a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.196+0000 7fe814a00640 1 --2- 172.21.15.55:0/1648014875 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7f8006300 0x7fe7f80069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.196+0000 7fe815e00640 1 -- 172.21.15.55:0/1648014875 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8100b41a0 msgr2=0x7fe7f8005d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.196+0000 7fe815e00640 1 --2- 172.21.15.55:0/1648014875 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8100b41a0 0x7fe7f8005d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.196+0000 7fe815e00640 1 -- 172.21.15.55:0/1648014875 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7f8006300 msgr2=0x7fe7f80069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.196+0000 7fe815e00640 1 --2- 172.21.15.55:0/1648014875 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe7f8006300 0x7fe7f80069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.196+0000 7fe815e00640 1 -- 172.21.15.55:0/1648014875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7f8005740 con 0x7fe7f8006f20 2024-04-02T07:33:14.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.196+0000 7fe815400640 1 --2- 172.21.15.55:0/1648014875 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe8100b41a0 0x7fe7f8005d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:33:14.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.196+0000 7fe815e00640 1 --2- 172.21.15.55:0/1648014875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f8006f20 0x7fe7f80073a0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fe808009fc0 tx=0x7fe80801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db69d24a13365a97 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:14.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.196+0000 7fe80fe00640 1 -- 172.21.15.55:0/1648014875 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8080a5c70 con 0x7fe7f8006f20 2024-04-02T07:33:14.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.196+0000 7fe80fe00640 1 -- 172.21.15.55:0/1648014875 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80800f040 con 0x7fe7f8006f20 2024-04-02T07:33:14.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.196+0000 7fe80fe00640 1 -- 172.21.15.55:0/1648014875 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8080ad440 con 0x7fe7f8006f20 2024-04-02T07:33:14.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe817e00640 1 -- 172.21.15.55:0/1648014875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f8006f20 msgr2=0x7fe7f80073a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:14.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe817e00640 1 --2- 172.21.15.55:0/1648014875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe7f8006f20 0x7fe7f80073a0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7fe808009fc0 tx=0x7fe80801cc60 comp rx=0 tx=0).stop 2024-04-02T07:33:14.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe815e00640 1 -- 172.21.15.55:0/1648014875 reap_dead start 2024-04-02T07:33:14.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe817e00640 1 -- 172.21.15.55:0/1648014875 shutdown_connections 2024-04-02T07:33:14.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe817e00640 1 -- 172.21.15.55:0/1648014875 >> 172.21.15.55:0/1648014875 conn(0x7fe81006a390 msgr2=0x7fe8100b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:14.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe817e00640 1 -- 172.21.15.55:0/1648014875 shutdown_connections 2024-04-02T07:33:14.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe817e00640 1 -- 172.21.15.55:0/1648014875 wait complete. 2024-04-02T07:33:14.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe817e00640 1 Processor -- start 2024-04-02T07:33:14.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe817e00640 1 -- start start 2024-04-02T07:33:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe817e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe7f8006f20 0x7fe810153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe817e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe810131510 0x7fe81013dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe817e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe810131990 0x7fe81013e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe817e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8101414c0 con 0x7fe810131990 2024-04-02T07:33:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe817e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8101422c0 con 0x7fe810131510 2024-04-02T07:33:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe817e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8101416f0 con 0x7fe7f8006f20 2024-04-02T07:33:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe815e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe810131990 0x7fe81013e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe815e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe810131990 0x7fe81013e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58650/0 (socket says 172.21.15.55:58650) 2024-04-02T07:33:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe815e00640 1 -- 172.21.15.55:0/2207844915 learned_addr learned my addr 172.21.15.55:0/2207844915 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe815400640 1 --2- 172.21.15.55:0/2207844915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe7f8006f20 0x7fe810153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe814a00640 1 --2- 172.21.15.55:0/2207844915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe810131510 0x7fe81013dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe815e00640 1 -- 172.21.15.55:0/2207844915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe7f8006f20 msgr2=0x7fe810153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe815e00640 1 --2- 172.21.15.55:0/2207844915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe7f8006f20 0x7fe810153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe815e00640 1 -- 172.21.15.55:0/2207844915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe810131510 msgr2=0x7fe81013dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:14.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe815e00640 1 --2- 172.21.15.55:0/2207844915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe810131510 0x7fe81013dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.200+0000 7fe815e00640 1 -- 172.21.15.55:0/2207844915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe810141990 con 0x7fe810131990 2024-04-02T07:33:14.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.204+0000 7fe815e00640 1 --2- 172.21.15.55:0/2207844915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe810131990 0x7fe81013e170 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fe8080b0040 tx=0x7fe808009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:14.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.204+0000 7fe80d600640 1 -- 172.21.15.55:0/2207844915 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8080bc070 con 0x7fe810131990 2024-04-02T07:33:14.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.204+0000 7fe80d600640 1 -- 172.21.15.55:0/2207844915 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8080039a0 con 0x7fe810131990 2024-04-02T07:33:14.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.204+0000 7fe817e00640 1 -- 172.21.15.55:0/2207844915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe810141c70 con 0x7fe810131990 2024-04-02T07:33:14.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.204+0000 7fe80d600640 1 -- 172.21.15.55:0/2207844915 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe808003b30 con 0x7fe810131990 2024-04-02T07:33:14.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.204+0000 7fe817e00640 1 -- 172.21.15.55:0/2207844915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8100b0910 con 0x7fe810131990 2024-04-02T07:33:14.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.204+0000 7fe817e00640 1 -- 172.21.15.55:0/2207844915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8100b0b00 con 0x7fe810131990 2024-04-02T07:33:14.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.204+0000 7fe80d600640 1 -- 172.21.15.55:0/2207844915 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe8080b4040 con 0x7fe810131990 2024-04-02T07:33:14.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.204+0000 7fe80d600640 1 --2- 172.21.15.55:0/2207844915 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe7f0066690 0x7fe7f0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:14.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.204+0000 7fe80d600640 1 -- 172.21.15.55:0/2207844915 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fe80811e220 con 0x7fe810131990 2024-04-02T07:33:14.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.204+0000 7fe815400640 1 --2- 172.21.15.55:0/2207844915 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe7f0066690 0x7fe7f0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:14.209 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.208+0000 7fe815400640 1 --2- 172.21.15.55:0/2207844915 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe7f0066690 0x7fe7f0068b50 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe804000c10 tx=0x7fe804006ff0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:14.211 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.208+0000 7fe80d600640 1 -- 172.21.15.55:0/2207844915 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe8100b0b00 con 0x7fe810131990 2024-04-02T07:33:14.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.372+0000 7fe817e00640 1 -- 172.21.15.55:0/2207844915 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fe810142470 con 0x7fe810131990 2024-04-02T07:33:14.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.372+0000 7fe80d600640 1 -- 172.21.15.55:0/2207844915 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v105) v1 ==== 100+0+11 (secure 0 0 0) 0x7fe810142470 con 0x7fe810131990 2024-04-02T07:33:14.375 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:33:14.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.376+0000 7fe817e00640 1 -- 172.21.15.55:0/2207844915 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe7f0066690 msgr2=0x7fe7f0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:14.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.376+0000 7fe817e00640 1 --2- 172.21.15.55:0/2207844915 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe7f0066690 0x7fe7f0068b50 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7fe804000c10 tx=0x7fe804006ff0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.376+0000 7fe817e00640 1 -- 172.21.15.55:0/2207844915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe810131990 msgr2=0x7fe81013e170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:14.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.376+0000 7fe817e00640 1 --2- 172.21.15.55:0/2207844915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe810131990 0x7fe81013e170 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7fe8080b0040 tx=0x7fe808009750 comp rx=0 tx=0).stop 2024-04-02T07:33:14.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.376+0000 7fe817e00640 1 -- 172.21.15.55:0/2207844915 shutdown_connections 2024-04-02T07:33:14.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.376+0000 7fe817e00640 1 --2- 172.21.15.55:0/2207844915 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe810131990 0x7fe81013e170 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.376+0000 7fe817e00640 1 --2- 172.21.15.55:0/2207844915 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe7f0066690 0x7fe7f0068b50 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.376+0000 7fe817e00640 1 --2- 172.21.15.55:0/2207844915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe810131510 0x7fe81013dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.376+0000 7fe817e00640 1 --2- 172.21.15.55:0/2207844915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe7f8006f20 0x7fe810153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.376+0000 7fe817e00640 1 -- 172.21.15.55:0/2207844915 >> 172.21.15.55:0/2207844915 conn(0x7fe81006a390 msgr2=0x7fe810156900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:14.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.376+0000 7fe817e00640 1 -- 172.21.15.55:0/2207844915 shutdown_connections 2024-04-02T07:33:14.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.376+0000 7fe817e00640 1 -- 172.21.15.55:0/2207844915 wait complete. 2024-04-02T07:33:14.397 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:33:14.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.536+0000 7f62abe00640 1 Processor -- start 2024-04-02T07:33:14.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.536+0000 7f62abe00640 1 -- start start 2024-04-02T07:33:14.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.536+0000 7f62abe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62ac15ff90 0x7f62ac098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:14.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.536+0000 7f62abe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f62ac0cadf0 0x7f62ac0cb280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:14.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.536+0000 7f62abe00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62ac0af460 con 0x7f62ac0d0050 2024-04-02T07:33:14.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.536+0000 7f62abe00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62ac0cf0f0 con 0x7f62ac0cadf0 2024-04-02T07:33:14.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.536+0000 7f62abe00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac0af690 con 0x7f62ac15ff90 2024-04-02T07:33:14.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.540+0000 7f62a2000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f62ac0d0050 0x7f62ac098f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47442/0 (socket says 172.21.15.55:47442) 2024-04-02T07:33:14.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.540+0000 7f62a2000640 1 -- 172.21.15.55:0/2205895915 learned_addr learned my addr 172.21.15.55:0/2205895915 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:14.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.540+0000 7f62ab400640 1 --2- 172.21.15.55:0/2205895915 >> v2:172.21.15.106:3300/0 conn(0x7f62ac0cadf0 0x7f62ac0cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:14.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.540+0000 7f62aaa00640 1 --2- 172.21.15.55:0/2205895915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62ac15ff90 0x7f62ac098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:14.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.540+0000 7f62aa000640 1 -- 172.21.15.55:0/2205895915 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2113487744 0 0) 0x7f62ac0af460 con 0x7f62ac0d0050 2024-04-02T07:33:14.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.540+0000 7f62aa000640 1 -- 172.21.15.55:0/2205895915 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6290003530 con 0x7f62ac0d0050 2024-04-02T07:33:14.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.540+0000 7f62ab400640 1 -- 172.21.15.55:0/2205895915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62ac15ff90 msgr2=0x7f62ac098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:14.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.540+0000 7f62aa000640 1 -- 172.21.15.55:0/2205895915 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1856594107 0 0) 0x7f6290003530 con 0x7f62ac0d0050 2024-04-02T07:33:14.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.540+0000 7f62ab400640 1 --2- 172.21.15.55:0/2205895915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62ac15ff90 0x7f62ac098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.540+0000 7f62ab400640 1 -- 172.21.15.55:0/2205895915 >> v1:172.21.15.55:6789/0 conn(0x7f62ac0d0050 legacy=0x7f62ac098f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:14.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.540+0000 7f62ab400640 1 -- 172.21.15.55:0/2205895915 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62ac0cf3b0 con 0x7f62ac0cadf0 2024-04-02T07:33:14.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.540+0000 7f62aaa00640 1 --2- 172.21.15.55:0/2205895915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62ac15ff90 0x7f62ac098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:33:14.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.540+0000 7f62ab400640 1 --2- 172.21.15.55:0/2205895915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ac0cadf0 0x7f62ac0cb280 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f62a40097c0 tx=0x7f62a401c390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d8f593c5619e36a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:14.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62aa000640 1 -- 172.21.15.55:0/2205895915 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6294001a00 con 0x7f62ac0cadf0 2024-04-02T07:33:14.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62aa000640 1 -- 172.21.15.55:0/2205895915 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a40a7050 con 0x7f62ac0cadf0 2024-04-02T07:33:14.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62aa000640 1 -- 172.21.15.55:0/2205895915 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40ab600 con 0x7f62ac0cadf0 2024-04-02T07:33:14.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62abe00640 1 -- 172.21.15.55:0/2205895915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ac0cadf0 msgr2=0x7f62ac0cb280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:14.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62abe00640 1 --2- 172.21.15.55:0/2205895915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ac0cadf0 0x7f62ac0cb280 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f62a40097c0 tx=0x7f62a401c390 comp rx=0 tx=0).stop 2024-04-02T07:33:14.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62abe00640 1 -- 172.21.15.55:0/2205895915 shutdown_connections 2024-04-02T07:33:14.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62abe00640 1 --2- 172.21.15.55:0/2205895915 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ac0cadf0 0x7f62ac0cb280 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62abe00640 1 --2- 172.21.15.55:0/2205895915 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62ac15ff90 0x7f62ac098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62abe00640 1 -- 172.21.15.55:0/2205895915 >> 172.21.15.55:0/2205895915 conn(0x7f62ac0b1fb0 msgr2=0x7f62ac0b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:14.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62abe00640 1 -- 172.21.15.55:0/2205895915 shutdown_connections 2024-04-02T07:33:14.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62abe00640 1 -- 172.21.15.55:0/2205895915 wait complete. 2024-04-02T07:33:14.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62abe00640 1 Processor -- start 2024-04-02T07:33:14.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62abe00640 1 -- start start 2024-04-02T07:33:14.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62abe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62ac0cadf0 0x7f62ac0c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:14.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62abe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ac0d0050 0x7f62ac1f7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:14.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62abe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ac15ff90 0x7f62ac0c4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:14.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62abe00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac15a4c0 con 0x7f62ac15ff90 2024-04-02T07:33:14.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62abe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac159f00 con 0x7f62ac0d0050 2024-04-02T07:33:14.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62abe00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62ac15a1e0 con 0x7f62ac0cadf0 2024-04-02T07:33:14.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62ab400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ac15ff90 0x7f62ac0c4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:14.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62ab400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ac15ff90 0x7f62ac0c4f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58666/0 (socket says 172.21.15.55:58666) 2024-04-02T07:33:14.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62ab400640 1 -- 172.21.15.55:0/2824943153 learned_addr learned my addr 172.21.15.55:0/2824943153 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:14.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.548+0000 7f62aaa00640 1 --2- 172.21.15.55:0/2824943153 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62ac0cadf0 0x7f62ac0c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:14.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.544+0000 7f62a2000640 1 --2- 172.21.15.55:0/2824943153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ac0d0050 0x7f62ac1f7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:14.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.548+0000 7f62ab400640 1 -- 172.21.15.55:0/2824943153 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62ac0cadf0 msgr2=0x7f62ac0c9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:14.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.548+0000 7f62ab400640 1 --2- 172.21.15.55:0/2824943153 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62ac0cadf0 0x7f62ac0c9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.548+0000 7f62ab400640 1 -- 172.21.15.55:0/2824943153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ac0d0050 msgr2=0x7f62ac1f7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:14.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.548+0000 7f62ab400640 1 --2- 172.21.15.55:0/2824943153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ac0d0050 0x7f62ac1f7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.548+0000 7f62ab400640 1 -- 172.21.15.55:0/2824943153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f629c009420 con 0x7f62ac15ff90 2024-04-02T07:33:14.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.548+0000 7f62a2000640 1 --2- 172.21.15.55:0/2824943153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ac0d0050 0x7f62ac1f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:14.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.548+0000 7f62ab400640 1 --2- 172.21.15.55:0/2824943153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ac15ff90 0x7f62ac0c4f70 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009710 tx=0x7f62a4019130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:14.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.548+0000 7f62a3400640 1 -- 172.21.15.55:0/2824943153 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a40bb070 con 0x7f62ac15ff90 2024-04-02T07:33:14.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.548+0000 7f62a3400640 1 -- 172.21.15.55:0/2824943153 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a4003830 con 0x7f62ac15ff90 2024-04-02T07:33:14.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.548+0000 7f62a3400640 1 -- 172.21.15.55:0/2824943153 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a4003ba0 con 0x7f62ac15ff90 2024-04-02T07:33:14.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.548+0000 7f62abe00640 1 -- 172.21.15.55:0/2824943153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a4009420 con 0x7f62ac15ff90 2024-04-02T07:33:14.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.548+0000 7f62abe00640 1 -- 172.21.15.55:0/2824943153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62ac154300 con 0x7f62ac15ff90 2024-04-02T07:33:14.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.548+0000 7f62abe00640 1 -- 172.21.15.55:0/2824943153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62ac1544f0 con 0x7f62ac15ff90 2024-04-02T07:33:14.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.548+0000 7f62a3400640 1 -- 172.21.15.55:0/2824943153 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f62a40b2050 con 0x7f62ac15ff90 2024-04-02T07:33:14.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.548+0000 7f62a3400640 1 --2- 172.21.15.55:0/2824943153 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6288066690 0x7f6288068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:14.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.548+0000 7f62a3400640 1 -- 172.21.15.55:0/2824943153 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f62a411ddc0 con 0x7f62ac15ff90 2024-04-02T07:33:14.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.552+0000 7f62aaa00640 1 --2- 172.21.15.55:0/2824943153 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6288066690 0x7f6288068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:14.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.552+0000 7f62aaa00640 1 --2- 172.21.15.55:0/2824943153 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6288066690 0x7f6288068b50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f629c009c50 tx=0x7f629c009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:14.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.552+0000 7f62a3400640 1 -- 172.21.15.55:0/2824943153 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f62a40eb070 con 0x7f62ac15ff90 2024-04-02T07:33:14.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.752+0000 7f62abe00640 1 -- 172.21.15.55:0/2824943153 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62ac073fa0 con 0x7f62ac15ff90 2024-04-02T07:33:14.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.752+0000 7f62a3400640 1 -- 172.21.15.55:0/2824943153 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4730 (secure 0 0 0) 0x7f62a40b0070 con 0x7f62ac15ff90 2024-04-02T07:33:14.755 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:14.755 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":89,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2707651793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2707651793},{"type":"v1","addr":"172.21.15.106:6836","nonce":2707651793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2234384639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2234384639},{"type":"v1","addr":"172.21.15.106:6837","nonce":2234384639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":8433,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53259218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53259218},{"type":"v1","addr":"172.21.15.55:6833","nonce":53259218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":9018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/4241257205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4241257205},{"type":"v1","addr":"172.21.15.55:6835","nonce":4241257205}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":88,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:31:30.704183+0000","modified":"2024-04-02T07:33:12.109414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-02T07:33:14.755 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 89 2024-04-02T07:33:14.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.756+0000 7f62abe00640 1 -- 172.21.15.55:0/2824943153 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6288066690 msgr2=0x7f6288068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.756+0000 7f62abe00640 1 --2- 172.21.15.55:0/2824943153 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6288066690 0x7f6288068b50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f629c009c50 tx=0x7f629c009190 comp rx=0 tx=0).stop 2024-04-02T07:33:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.756+0000 7f62abe00640 1 -- 172.21.15.55:0/2824943153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ac15ff90 msgr2=0x7f62ac0c4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.756+0000 7f62abe00640 1 --2- 172.21.15.55:0/2824943153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ac15ff90 0x7f62ac0c4f70 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f62a4009710 tx=0x7f62a4019130 comp rx=0 tx=0).stop 2024-04-02T07:33:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.756+0000 7f62abe00640 1 -- 172.21.15.55:0/2824943153 shutdown_connections 2024-04-02T07:33:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.756+0000 7f62abe00640 1 --2- 172.21.15.55:0/2824943153 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f62ac15ff90 0x7f62ac0c4f70 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.756+0000 7f62abe00640 1 --2- 172.21.15.55:0/2824943153 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6288066690 0x7f6288068b50 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.756+0000 7f62abe00640 1 --2- 172.21.15.55:0/2824943153 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f62ac0d0050 0x7f62ac1f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.756+0000 7f62abe00640 1 --2- 172.21.15.55:0/2824943153 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f62ac0cadf0 0x7f62ac0c9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.756+0000 7f62abe00640 1 -- 172.21.15.55:0/2824943153 >> 172.21.15.55:0/2824943153 conn(0x7f62ac0b1fb0 msgr2=0x7f62ac0b2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.756+0000 7f62abe00640 1 -- 172.21.15.55:0/2824943153 shutdown_connections 2024-04-02T07:33:14.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.756+0000 7f62abe00640 1 -- 172.21.15.55:0/2824943153 wait complete. 2024-04-02T07:33:14.777 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:33:14.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.916+0000 7f937ae00640 1 Processor -- start 2024-04-02T07:33:14.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.916+0000 7f937ae00640 1 -- start start 2024-04-02T07:33:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.916+0000 7f937ae00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f937415ca70 0x7f93740b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.916+0000 7f937ae00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9374098a10 0x7f9374098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.916+0000 7f937ae00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93740993b0 con 0x7f937406aff0 2024-04-02T07:33:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.916+0000 7f937ae00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f937415ce50 con 0x7f9374098a10 2024-04-02T07:33:14.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.916+0000 7f937ae00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93740cef60 con 0x7f937415ca70 2024-04-02T07:33:14.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.916+0000 7f9373e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f937415ca70 0x7f93740b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:14.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.916+0000 7f936b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9374098a10 0x7f9374098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:14.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.916+0000 7f9373e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f937415ca70 0x7f93740b0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:40542/0 (socket says 172.21.15.55:40542) 2024-04-02T07:33:14.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.916+0000 7f9373e00640 1 -- 172.21.15.55:0/390676504 learned_addr learned my addr 172.21.15.55:0/390676504 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:14.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.916+0000 7f936b400640 1 -- 172.21.15.55:0/390676504 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f937415ca70 msgr2=0x7f93740b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:14.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.916+0000 7f936b400640 1 --2- 172.21.15.55:0/390676504 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f937415ca70 0x7f93740b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.916+0000 7f936b400640 1 -- 172.21.15.55:0/390676504 >> v1:172.21.15.106:6789/0 conn(0x7f937406aff0 legacy=0x7f937406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:14.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.916+0000 7f936b400640 1 -- 172.21.15.55:0/390676504 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f937406bd60 con 0x7f9374098a10 2024-04-02T07:33:14.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.916+0000 7f9373e00640 1 --2- 172.21.15.55:0/390676504 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f937415ca70 0x7f93740b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:33:14.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.920+0000 7f936b400640 1 --2- 172.21.15.55:0/390676504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9374098a10 0x7f9374098e70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f935c0097c0 tx=0x7f935c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5578cde9064b1e9f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:14.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.920+0000 7f9373400640 1 -- 172.21.15.55:0/390676504 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c0ad640 con 0x7f9374098a10 2024-04-02T07:33:14.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.920+0000 7f9373400640 1 -- 172.21.15.55:0/390676504 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f935c0ad7a0 con 0x7f9374098a10 2024-04-02T07:33:14.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.920+0000 7f9373400640 1 -- 172.21.15.55:0/390676504 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f935c0adb30 con 0x7f9374098a10 2024-04-02T07:33:14.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.920+0000 7f937ae00640 1 -- 172.21.15.55:0/390676504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9374098a10 msgr2=0x7f9374098e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:14.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.920+0000 7f937ae00640 1 --2- 172.21.15.55:0/390676504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9374098a10 0x7f9374098e70 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f935c0097c0 tx=0x7f935c01c4a0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.920+0000 7f937ae00640 1 -- 172.21.15.55:0/390676504 shutdown_connections 2024-04-02T07:33:14.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.920+0000 7f937ae00640 1 --2- 172.21.15.55:0/390676504 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9374098a10 0x7f9374098e70 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.920+0000 7f937ae00640 1 --2- 172.21.15.55:0/390676504 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f937415ca70 0x7f93740b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.920+0000 7f937ae00640 1 -- 172.21.15.55:0/390676504 >> 172.21.15.55:0/390676504 conn(0x7f93740b21d0 msgr2=0x7f93740b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:14.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.920+0000 7f937ae00640 1 -- 172.21.15.55:0/390676504 shutdown_connections 2024-04-02T07:33:14.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.920+0000 7f937ae00640 1 -- 172.21.15.55:0/390676504 wait complete. 2024-04-02T07:33:14.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f937ae00640 1 Processor -- start 2024-04-02T07:33:14.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f937ae00640 1 -- start start 2024-04-02T07:33:14.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f937ae00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f937406aff0 0x7f9374153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:14.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f937ae00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9374098a10 0x7f937415a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:14.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f937ae00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f937415ca70 0x7f9374152040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:14.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f937ae00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f937415ada0 con 0x7f937406aff0 2024-04-02T07:33:14.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f937ae00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93741542f0 con 0x7f937415ca70 2024-04-02T07:33:14.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f937ae00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9374153a50 con 0x7f9374098a10 2024-04-02T07:33:14.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f9373e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f937406aff0 0x7f9374153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:14.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f9373e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f937406aff0 0x7f9374153350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58670/0 (socket says 172.21.15.55:58670) 2024-04-02T07:33:14.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f9373e00640 1 -- 172.21.15.55:0/1934716510 learned_addr learned my addr 172.21.15.55:0/1934716510 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:14.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f936b400640 1 --2- 172.21.15.55:0/1934716510 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9374098a10 0x7f937415a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:14.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f9378e00640 1 --2- 172.21.15.55:0/1934716510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f937415ca70 0x7f9374152040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:14.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f9373e00640 1 -- 172.21.15.55:0/1934716510 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9374098a10 msgr2=0x7f937415a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:14.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f9373e00640 1 --2- 172.21.15.55:0/1934716510 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9374098a10 0x7f937415a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f9373e00640 1 -- 172.21.15.55:0/1934716510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f937415ca70 msgr2=0x7f9374152040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:14.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f9373e00640 1 --2- 172.21.15.55:0/1934716510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f937415ca70 0x7f9374152040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:14.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f9373e00640 1 -- 172.21.15.55:0/1934716510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93640094d0 con 0x7f937406aff0 2024-04-02T07:33:14.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f936b400640 1 --2- 172.21.15.55:0/1934716510 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9374098a10 0x7f937415a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:14.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f9378e00640 1 --2- 172.21.15.55:0/1934716510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f937415ca70 0x7f9374152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:14.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f9373e00640 1 --2- 172.21.15.55:0/1934716510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f937406aff0 0x7f9374153350 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f936400e9d0 tx=0x7f936400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:14.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f9370c00640 1 -- 172.21.15.55:0/1934716510 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f936400ca60 con 0x7f937406aff0 2024-04-02T07:33:14.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f9370c00640 1 -- 172.21.15.55:0/1934716510 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f936400cbc0 con 0x7f937406aff0 2024-04-02T07:33:14.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f937ae00640 1 -- 172.21.15.55:0/1934716510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935c009420 con 0x7f937406aff0 2024-04-02T07:33:14.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f9370c00640 1 -- 172.21.15.55:0/1934716510 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9364013470 con 0x7f937406aff0 2024-04-02T07:33:14.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f937ae00640 1 -- 172.21.15.55:0/1934716510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9374154010 con 0x7f937406aff0 2024-04-02T07:33:14.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.924+0000 7f937ae00640 1 -- 172.21.15.55:0/1934716510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9374066c90 con 0x7f937406aff0 2024-04-02T07:33:14.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.928+0000 7f9370c00640 1 -- 172.21.15.55:0/1934716510 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f93640135d0 con 0x7f937406aff0 2024-04-02T07:33:14.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.928+0000 7f9370c00640 1 --2- 172.21.15.55:0/1934716510 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f93500666c0 0x7f9350068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:14.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.928+0000 7f9370c00640 1 -- 172.21.15.55:0/1934716510 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f93640845c0 con 0x7f937406aff0 2024-04-02T07:33:14.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.928+0000 7f936b400640 1 --2- 172.21.15.55:0/1934716510 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f93500666c0 0x7f9350068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:14.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.928+0000 7f936b400640 1 --2- 172.21.15.55:0/1934716510 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f93500666c0 0x7f9350068b80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f935c0af000 tx=0x7f935c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:14.933 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:14.932+0000 7f9370c00640 1 -- 172.21.15.55:0/1934716510 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f93640517e0 con 0x7f937406aff0 2024-04-02T07:33:15.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.092+0000 7f937ae00640 1 -- 172.21.15.55:0/1934716510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93740b6660 con 0x7f937406aff0 2024-04-02T07:33:15.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.096+0000 7f9370c00640 1 -- 172.21.15.55:0/1934716510 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+16310 (secure 0 0 0) 0x7f9364054e00 con 0x7f937406aff0 2024-04-02T07:33:15.096 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:15.096 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":105,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:33:12.108824+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:31:29.246681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-02T07:31:29.698823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6835/1137835746":"2024-04-03T07:33:12.108798+0000","172.21.15.55:6834/1137835746":"2024-04-03T07:33:12.108798+0000","172.21.15.55:6835/1089546237":"2024-04-03T07:32:35.358480+0000","172.21.15.55:6834/1089546237":"2024-04-03T07:32:35.358480+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:33:15.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.096+0000 7f937ae00640 1 -- 172.21.15.55:0/1934716510 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f93500666c0 msgr2=0x7f9350068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:15.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.096+0000 7f937ae00640 1 --2- 172.21.15.55:0/1934716510 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f93500666c0 0x7f9350068b80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f935c0af000 tx=0x7f935c008040 comp rx=0 tx=0).stop 2024-04-02T07:33:15.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.096+0000 7f937ae00640 1 -- 172.21.15.55:0/1934716510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f937406aff0 msgr2=0x7f9374153350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:15.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.096+0000 7f937ae00640 1 --2- 172.21.15.55:0/1934716510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f937406aff0 0x7f9374153350 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f936400e9d0 tx=0x7f936400ee90 comp rx=0 tx=0).stop 2024-04-02T07:33:15.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.096+0000 7f937ae00640 1 -- 172.21.15.55:0/1934716510 shutdown_connections 2024-04-02T07:33:15.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.096+0000 7f937ae00640 1 --2- 172.21.15.55:0/1934716510 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f93500666c0 0x7f9350068b80 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.096+0000 7f937ae00640 1 --2- 172.21.15.55:0/1934716510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f937415ca70 0x7f9374152040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.096+0000 7f937ae00640 1 --2- 172.21.15.55:0/1934716510 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9374098a10 0x7f937415a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.096+0000 7f937ae00640 1 --2- 172.21.15.55:0/1934716510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f937406aff0 0x7f9374153350 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.096+0000 7f937ae00640 1 -- 172.21.15.55:0/1934716510 >> 172.21.15.55:0/1934716510 conn(0x7f93740b21d0 msgr2=0x7f93740b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:15.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.096+0000 7f937ae00640 1 -- 172.21.15.55:0/1934716510 shutdown_connections 2024-04-02T07:33:15.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.096+0000 7f937ae00640 1 -- 172.21.15.55:0/1934716510 wait complete. 2024-04-02T07:33:15.117 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-02T07:33:15.118 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:33:15.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.256+0000 7f1cd9800640 1 Processor -- start 2024-04-02T07:33:15.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.256+0000 7f1cd9800640 1 -- start start 2024-04-02T07:33:15.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.256+0000 7f1cd9800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1cd4144240 0x7f1cd415e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:15.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.256+0000 7f1cd9800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cd4069d90 0x7f1cd406ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:15.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.256+0000 7f1cd9800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1cd406f150 0x7f1cd415adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:15.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.256+0000 7f1cd9800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd406f5e0 con 0x7f1cd4144240 2024-04-02T07:33:15.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.256+0000 7f1cd9800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd415f370 con 0x7f1cd406f150 2024-04-02T07:33:15.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.256+0000 7f1cd9800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd406fa70 con 0x7f1cd4069d90 2024-04-02T07:33:15.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.256+0000 7f1cd2a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1cd4144240 0x7f1cd415e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:15.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.256+0000 7f1cd2a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1cd4144240 0x7f1cd415e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58678/0 (socket says 172.21.15.55:58678) 2024-04-02T07:33:15.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.256+0000 7f1cd2a00640 1 -- 172.21.15.55:0/4128583143 learned_addr learned my addr 172.21.15.55:0/4128583143 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:15.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.256+0000 7f1cd2a00640 1 -- 172.21.15.55:0/4128583143 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cd4069d90 msgr2=0x7f1cd406ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:15.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.256+0000 7f1cd2a00640 1 --2- 172.21.15.55:0/4128583143 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cd4069d90 0x7f1cd406ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.256+0000 7f1cd2a00640 1 -- 172.21.15.55:0/4128583143 >> v2:172.21.15.106:3300/0 conn(0x7f1cd406f150 msgr2=0x7f1cd415adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:15.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.256+0000 7f1cd2a00640 1 --2- 172.21.15.55:0/4128583143 >> v2:172.21.15.106:3300/0 conn(0x7f1cd406f150 0x7f1cd415adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.256+0000 7f1cd2a00640 1 -- 172.21.15.55:0/4128583143 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd415ead0 con 0x7f1cd4144240 2024-04-02T07:33:15.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.260+0000 7f1cd2a00640 1 --2- 172.21.15.55:0/4128583143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd4144240 0x7f1cd415e3f0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4070a60 tx=0x7f1cc401c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=217e4d04cfec3674 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:15.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.260+0000 7f1cd2000640 1 -- 172.21.15.55:0/4128583143 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc40ad660 con 0x7f1cd4144240 2024-04-02T07:33:15.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.260+0000 7f1cd2000640 1 -- 172.21.15.55:0/4128583143 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc40ad7c0 con 0x7f1cd4144240 2024-04-02T07:33:15.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.260+0000 7f1cd2000640 1 -- 172.21.15.55:0/4128583143 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc40adb50 con 0x7f1cd4144240 2024-04-02T07:33:15.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.260+0000 7f1cd9800640 1 -- 172.21.15.55:0/4128583143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd4144240 msgr2=0x7f1cd415e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:15.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.260+0000 7f1cd9800640 1 --2- 172.21.15.55:0/4128583143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd4144240 0x7f1cd415e3f0 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f1cd4070a60 tx=0x7f1cc401c490 comp rx=0 tx=0).stop 2024-04-02T07:33:15.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.260+0000 7f1cd9800640 1 -- 172.21.15.55:0/4128583143 shutdown_connections 2024-04-02T07:33:15.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.260+0000 7f1cd9800640 1 --2- 172.21.15.55:0/4128583143 >> v2:172.21.15.106:3300/0 conn(0x7f1cd406f150 0x7f1cd415adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.260+0000 7f1cd9800640 1 --2- 172.21.15.55:0/4128583143 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cd4069d90 0x7f1cd406ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.260+0000 7f1cd9800640 1 --2- 172.21.15.55:0/4128583143 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd4144240 0x7f1cd415e3f0 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.260+0000 7f1cd9800640 1 -- 172.21.15.55:0/4128583143 >> 172.21.15.55:0/4128583143 conn(0x7f1cd40b13b0 msgr2=0x7f1cd40b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:15.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.260+0000 7f1cd9800640 1 -- 172.21.15.55:0/4128583143 shutdown_connections 2024-04-02T07:33:15.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.260+0000 7f1cd9800640 1 -- 172.21.15.55:0/4128583143 wait complete. 2024-04-02T07:33:15.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd9800640 1 Processor -- start 2024-04-02T07:33:15.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd9800640 1 -- start start 2024-04-02T07:33:15.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd9800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd4069d90 0x7f1cd415adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:15.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd9800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cd406f150 0x7f1cd415a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:15.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd9800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cd4144240 0x7f1cd40af300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:15.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd9800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd40ae330 con 0x7f1cd4069d90 2024-04-02T07:33:15.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd9800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd4138350 con 0x7f1cd406f150 2024-04-02T07:33:15.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd9800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd4138630 con 0x7f1cd4144240 2024-04-02T07:33:15.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd4069d90 0x7f1cd415adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:15.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd4069d90 0x7f1cd415adc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58680/0 (socket says 172.21.15.55:58680) 2024-04-02T07:33:15.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd2a00640 1 -- 172.21.15.55:0/1425584254 learned_addr learned my addr 172.21.15.55:0/1425584254 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:15.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd3400640 1 --2- 172.21.15.55:0/1425584254 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cd4144240 0x7f1cd40af300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:15.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cca000640 1 --2- 172.21.15.55:0/1425584254 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cd406f150 0x7f1cd415a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:15.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd2a00640 1 -- 172.21.15.55:0/1425584254 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cd4144240 msgr2=0x7f1cd40af300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:15.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd2a00640 1 --2- 172.21.15.55:0/1425584254 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cd4144240 0x7f1cd40af300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd2a00640 1 -- 172.21.15.55:0/1425584254 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cd406f150 msgr2=0x7f1cd415a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:15.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd2a00640 1 --2- 172.21.15.55:0/1425584254 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cd406f150 0x7f1cd415a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd2a00640 1 -- 172.21.15.55:0/1425584254 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc40094d0 con 0x7f1cd4069d90 2024-04-02T07:33:15.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd2a00640 1 --2- 172.21.15.55:0/1425584254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd4069d90 0x7f1cd415adc0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f1cc401ab40 tx=0x7f1cc401acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:15.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1ccb400640 1 -- 172.21.15.55:0/1425584254 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc40b8830 con 0x7f1cd4069d90 2024-04-02T07:33:15.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1ccb400640 1 -- 172.21.15.55:0/1425584254 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc40b8990 con 0x7f1cd4069d90 2024-04-02T07:33:15.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1ccb400640 1 -- 172.21.15.55:0/1425584254 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc40b8d40 con 0x7f1cd4069d90 2024-04-02T07:33:15.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd9800640 1 -- 172.21.15.55:0/1425584254 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd4138910 con 0x7f1cd4069d90 2024-04-02T07:33:15.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd9800640 1 -- 172.21.15.55:0/1425584254 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd415a610 con 0x7f1cd4069d90 2024-04-02T07:33:15.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.264+0000 7f1cd9800640 1 -- 172.21.15.55:0/1425584254 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd40703c0 con 0x7f1cd4069d90 2024-04-02T07:33:15.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.268+0000 7f1ccb400640 1 -- 172.21.15.55:0/1425584254 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1cc40b4040 con 0x7f1cd4069d90 2024-04-02T07:33:15.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.268+0000 7f1ccb400640 1 --2- 172.21.15.55:0/1425584254 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1cb0066690 0x7f1cb0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:15.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.268+0000 7f1ccb400640 1 -- 172.21.15.55:0/1425584254 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f1cc411edc0 con 0x7f1cd4069d90 2024-04-02T07:33:15.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.268+0000 7f1cca000640 1 --2- 172.21.15.55:0/1425584254 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1cb0066690 0x7f1cb0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:15.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.268+0000 7f1cca000640 1 --2- 172.21.15.55:0/1425584254 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1cb0066690 0x7f1cb0068b50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc006fd0 tx=0x7f1cbc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:15.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.272+0000 7f1ccb400640 1 -- 172.21.15.55:0/1425584254 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f1cc40ec180 con 0x7f1cd4069d90 2024-04-02T07:33:15.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.468+0000 7f1cd9800640 1 -- 172.21.15.55:0/1425584254 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1cd4066c90 con 0x7f1cd4069d90 2024-04-02T07:33:15.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.468+0000 7f1ccb400640 1 -- 172.21.15.55:0/1425584254 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4730 (secure 0 0 0) 0x7f1cc40ef7a0 con 0x7f1cd4069d90 2024-04-02T07:33:15.472 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:15.472 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":89,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2707651793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2707651793},{"type":"v1","addr":"172.21.15.106:6836","nonce":2707651793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2234384639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2234384639},{"type":"v1","addr":"172.21.15.106:6837","nonce":2234384639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":8433,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53259218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53259218},{"type":"v1","addr":"172.21.15.55:6833","nonce":53259218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":9018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/4241257205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4241257205},{"type":"v1","addr":"172.21.15.55:6835","nonce":4241257205}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":88,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:31:30.704183+0000","modified":"2024-04-02T07:33:12.109414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-02T07:33:15.472 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 89 2024-04-02T07:33:15.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.472+0000 7f1cd9800640 1 -- 172.21.15.55:0/1425584254 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1cb0066690 msgr2=0x7f1cb0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:15.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.472+0000 7f1cd9800640 1 --2- 172.21.15.55:0/1425584254 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1cb0066690 0x7f1cb0068b50 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc006fd0 tx=0x7f1cbc008040 comp rx=0 tx=0).stop 2024-04-02T07:33:15.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.472+0000 7f1cd9800640 1 -- 172.21.15.55:0/1425584254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd4069d90 msgr2=0x7f1cd415adc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:15.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.472+0000 7f1cd9800640 1 --2- 172.21.15.55:0/1425584254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd4069d90 0x7f1cd415adc0 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f1cc401ab40 tx=0x7f1cc401acd0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.472+0000 7f1cd9800640 1 -- 172.21.15.55:0/1425584254 shutdown_connections 2024-04-02T07:33:15.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.472+0000 7f1cd9800640 1 --2- 172.21.15.55:0/1425584254 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1cd4144240 0x7f1cd40af300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.472+0000 7f1cd9800640 1 --2- 172.21.15.55:0/1425584254 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1cb0066690 0x7f1cb0068b50 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.472+0000 7f1cd9800640 1 --2- 172.21.15.55:0/1425584254 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1cd406f150 0x7f1cd415a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.472+0000 7f1cd9800640 1 --2- 172.21.15.55:0/1425584254 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1cd4069d90 0x7f1cd415adc0 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.472+0000 7f1cd9800640 1 -- 172.21.15.55:0/1425584254 >> 172.21.15.55:0/1425584254 conn(0x7f1cd40b13b0 msgr2=0x7f1cd4140ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:15.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.472+0000 7f1cd9800640 1 -- 172.21.15.55:0/1425584254 shutdown_connections 2024-04-02T07:33:15.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.472+0000 7f1cd9800640 1 -- 172.21.15.55:0/1425584254 wait complete. 2024-04-02T07:33:15.492 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:33:15.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.632+0000 7fdf9da00640 1 Processor -- start 2024-04-02T07:33:15.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.632+0000 7fdf9da00640 1 -- start start 2024-04-02T07:33:15.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.632+0000 7fdf9da00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf9815dbe0 0x7fdf98069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:15.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.632+0000 7fdf9da00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdf980ca9c0 0x7fdf9806e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:15.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.632+0000 7fdf9da00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf9806cba0 con 0x7fdf9809faa0 2024-04-02T07:33:15.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.632+0000 7fdf9da00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf980ca570 con 0x7fdf980ca9c0 2024-04-02T07:33:15.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.632+0000 7fdf9da00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf980cb610 con 0x7fdf9815dbe0 2024-04-02T07:33:15.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.632+0000 7fdf97e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf9815dbe0 0x7fdf98069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:15.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.632+0000 7fdf9d000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdf980ca9c0 0x7fdf9806e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:15.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.632+0000 7fdf8f400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fdf9809faa0 0x7fdf980caf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:37122/0 (socket says 172.21.15.55:37122) 2024-04-02T07:33:15.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.632+0000 7fdf8f400640 1 -- 172.21.15.55:0/2139479262 learned_addr learned my addr 172.21.15.55:0/2139479262 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:15.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.632+0000 7fdf97400640 1 -- 172.21.15.55:0/2139479262 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335426890 0 0) 0x7fdf9806cba0 con 0x7fdf9809faa0 2024-04-02T07:33:15.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.632+0000 7fdf97400640 1 -- 172.21.15.55:0/2139479262 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf7c003530 con 0x7fdf9809faa0 2024-04-02T07:33:15.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.632+0000 7fdf97e00640 1 -- 172.21.15.55:0/2139479262 >> v2:172.21.15.106:3300/0 conn(0x7fdf980ca9c0 msgr2=0x7fdf9806e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:15.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.632+0000 7fdf97e00640 1 --2- 172.21.15.55:0/2139479262 >> v2:172.21.15.106:3300/0 conn(0x7fdf980ca9c0 0x7fdf9806e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.632+0000 7fdf97e00640 1 -- 172.21.15.55:0/2139479262 >> v1:172.21.15.106:6789/0 conn(0x7fdf9809faa0 legacy=0x7fdf980caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:15.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.632+0000 7fdf97e00640 1 -- 172.21.15.55:0/2139479262 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf9815ee50 con 0x7fdf9815dbe0 2024-04-02T07:33:15.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.632+0000 7fdf9d000640 1 --2- 172.21.15.55:0/2139479262 >> v2:172.21.15.106:3300/0 conn(0x7fdf980ca9c0 0x7fdf9806e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:33:15.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.636+0000 7fdf97e00640 1 --2- 172.21.15.55:0/2139479262 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf9815dbe0 0x7fdf98069d90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdf880097c0 tx=0x7fdf8801c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48ba9c6903fc428d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:15.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.636+0000 7fdf97400640 1 -- 172.21.15.55:0/2139479262 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf880ad680 con 0x7fdf9815dbe0 2024-04-02T07:33:15.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.636+0000 7fdf97400640 1 -- 172.21.15.55:0/2139479262 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf880ad7e0 con 0x7fdf9815dbe0 2024-04-02T07:33:15.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.636+0000 7fdf97400640 1 -- 172.21.15.55:0/2139479262 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf880adb70 con 0x7fdf9815dbe0 2024-04-02T07:33:15.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.636+0000 7fdf9da00640 1 -- 172.21.15.55:0/2139479262 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf9815dbe0 msgr2=0x7fdf98069d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:15.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.636+0000 7fdf9da00640 1 --2- 172.21.15.55:0/2139479262 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf9815dbe0 0x7fdf98069d90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fdf880097c0 tx=0x7fdf8801c470 comp rx=0 tx=0).stop 2024-04-02T07:33:15.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.636+0000 7fdf9da00640 1 -- 172.21.15.55:0/2139479262 shutdown_connections 2024-04-02T07:33:15.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.636+0000 7fdf9da00640 1 --2- 172.21.15.55:0/2139479262 >> v2:172.21.15.106:3300/0 conn(0x7fdf980ca9c0 0x7fdf9806e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.636+0000 7fdf9da00640 1 --2- 172.21.15.55:0/2139479262 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf9815dbe0 0x7fdf98069d90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.636+0000 7fdf9da00640 1 -- 172.21.15.55:0/2139479262 >> 172.21.15.55:0/2139479262 conn(0x7fdf980b0900 msgr2=0x7fdf980b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:15.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.636+0000 7fdf9da00640 1 -- 172.21.15.55:0/2139479262 shutdown_connections 2024-04-02T07:33:15.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.636+0000 7fdf9da00640 1 -- 172.21.15.55:0/2139479262 wait complete. 2024-04-02T07:33:15.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf9da00640 1 Processor -- start 2024-04-02T07:33:15.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf9da00640 1 -- start start 2024-04-02T07:33:15.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf9da00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf9809faa0 0x7fdf980b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:15.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf9da00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf980ca9c0 0x7fdf9809af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:15.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf9da00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf9815dbe0 0x7fdf98157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:15.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf9da00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9809b7b0 con 0x7fdf980ca9c0 2024-04-02T07:33:15.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf9da00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9809ba90 con 0x7fdf9809faa0 2024-04-02T07:33:15.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf9da00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf9809bd70 con 0x7fdf9815dbe0 2024-04-02T07:33:15.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf8f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf980ca9c0 0x7fdf9809af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:15.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf97e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf9809faa0 0x7fdf980b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:15.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf97e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf9809faa0 0x7fdf980b2bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:46060/0 (socket says 172.21.15.55:46060) 2024-04-02T07:33:15.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf97e00640 1 -- 172.21.15.55:0/3252637584 learned_addr learned my addr 172.21.15.55:0/3252637584 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:15.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf9d000640 1 --2- 172.21.15.55:0/3252637584 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf9815dbe0 0x7fdf98157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:15.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf97e00640 1 -- 172.21.15.55:0/3252637584 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf9815dbe0 msgr2=0x7fdf98157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:15.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf97e00640 1 --2- 172.21.15.55:0/3252637584 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf9815dbe0 0x7fdf98157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf97e00640 1 -- 172.21.15.55:0/3252637584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf980ca9c0 msgr2=0x7fdf9809af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:15.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf97e00640 1 --2- 172.21.15.55:0/3252637584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf980ca9c0 0x7fdf9809af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf97e00640 1 -- 172.21.15.55:0/3252637584 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf90009a70 con 0x7fdf9809faa0 2024-04-02T07:33:15.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf8f400640 1 --2- 172.21.15.55:0/3252637584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf980ca9c0 0x7fdf9809af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:33:15.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf97e00640 1 --2- 172.21.15.55:0/3252637584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf9809faa0 0x7fdf980b2bc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdf8801a0a0 tx=0x7fdf8801acb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:15.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf94c00640 1 -- 172.21.15.55:0/3252637584 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf880add60 con 0x7fdf9809faa0 2024-04-02T07:33:15.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf94c00640 1 -- 172.21.15.55:0/3252637584 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf880b9450 con 0x7fdf9809faa0 2024-04-02T07:33:15.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf9da00640 1 -- 172.21.15.55:0/3252637584 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf88009420 con 0x7fdf9809faa0 2024-04-02T07:33:15.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf94c00640 1 -- 172.21.15.55:0/3252637584 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf880b97c0 con 0x7fdf9809faa0 2024-04-02T07:33:15.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.640+0000 7fdf9da00640 1 -- 172.21.15.55:0/3252637584 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf9809c330 con 0x7fdf9809faa0 2024-04-02T07:33:15.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.644+0000 7fdf9da00640 1 -- 172.21.15.55:0/3252637584 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf9809c520 con 0x7fdf9809faa0 2024-04-02T07:33:15.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.644+0000 7fdf94c00640 1 -- 172.21.15.55:0/3252637584 <== mon.1 v2:172.21.15.106:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fdf880b9920 con 0x7fdf9809faa0 2024-04-02T07:33:15.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.644+0000 7fdf94c00640 1 --2- 172.21.15.55:0/3252637584 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf74066690 0x7fdf74068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:15.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.644+0000 7fdf94c00640 1 -- 172.21.15.55:0/3252637584 <== mon.1 v2:172.21.15.106:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5881+0+0 (secure 0 0 0) 0x7fdf8811ee30 con 0x7fdf9809faa0 2024-04-02T07:33:15.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.644+0000 7fdf8f400640 1 --2- 172.21.15.55:0/3252637584 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf74066690 0x7fdf74068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:15.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.644+0000 7fdf8f400640 1 --2- 172.21.15.55:0/3252637584 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf74066690 0x7fdf74068b50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fdf980c5610 tx=0x7fdf80009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:15.650 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.648+0000 7fdf94c00640 1 -- 172.21.15.55:0/3252637584 <== mon.1 v2:172.21.15.106:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fdf880ec320 con 0x7fdf9809faa0 2024-04-02T07:33:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.844+0000 7fdf9da00640 1 -- 172.21.15.55:0/3252637584 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf98073fa0 con 0x7fdf9809faa0 2024-04-02T07:33:15.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.844+0000 7fdf94c00640 1 -- 172.21.15.55:0/3252637584 <== mon.1 v2:172.21.15.106:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 89 v89) v1 ==== 94+0+4730 (secure 0 0 0) 0x7fdf880ef8c0 con 0x7fdf9809faa0 2024-04-02T07:33:15.846 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:15.846 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":89,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2707651793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2707651793},{"type":"v1","addr":"172.21.15.106:6836","nonce":2707651793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2234384639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2234384639},{"type":"v1","addr":"172.21.15.106:6837","nonce":2234384639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":8433,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53259218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53259218},{"type":"v1","addr":"172.21.15.55:6833","nonce":53259218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":9018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/4241257205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4241257205},{"type":"v1","addr":"172.21.15.55:6835","nonce":4241257205}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":88,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:31:30.704183+0000","modified":"2024-04-02T07:33:12.109414+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":105,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2024-04-02T07:33:15.846 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 89 2024-04-02T07:33:15.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.844+0000 7fdf9da00640 1 -- 172.21.15.55:0/3252637584 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf74066690 msgr2=0x7fdf74068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:15.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.844+0000 7fdf9da00640 1 --2- 172.21.15.55:0/3252637584 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf74066690 0x7fdf74068b50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fdf980c5610 tx=0x7fdf80009040 comp rx=0 tx=0).stop 2024-04-02T07:33:15.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.844+0000 7fdf9da00640 1 -- 172.21.15.55:0/3252637584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf9809faa0 msgr2=0x7fdf980b2bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:15.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.844+0000 7fdf9da00640 1 --2- 172.21.15.55:0/3252637584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf9809faa0 0x7fdf980b2bc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fdf8801a0a0 tx=0x7fdf8801acb0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.844+0000 7fdf9da00640 1 -- 172.21.15.55:0/3252637584 shutdown_connections 2024-04-02T07:33:15.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.844+0000 7fdf9da00640 1 --2- 172.21.15.55:0/3252637584 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf9815dbe0 0x7fdf98157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.844+0000 7fdf9da00640 1 --2- 172.21.15.55:0/3252637584 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf980ca9c0 0x7fdf9809af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.844+0000 7fdf9da00640 1 --2- 172.21.15.55:0/3252637584 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf74066690 0x7fdf74068b50 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.844+0000 7fdf9da00640 1 --2- 172.21.15.55:0/3252637584 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf9809faa0 0x7fdf980b2bc0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:15.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.844+0000 7fdf9da00640 1 -- 172.21.15.55:0/3252637584 >> 172.21.15.55:0/3252637584 conn(0x7fdf980b0900 msgr2=0x7fdf9815cca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:15.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.844+0000 7fdf9da00640 1 -- 172.21.15.55:0/3252637584 shutdown_connections 2024-04-02T07:33:15.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:15.844+0000 7fdf9da00640 1 -- 172.21.15.55:0/3252637584 wait complete. 2024-04-02T07:33:15.867 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:33:16.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.004+0000 7f063d400640 1 Processor -- start 2024-04-02T07:33:16.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.004+0000 7f063d400640 1 -- start start 2024-04-02T07:33:16.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.004+0000 7f063d400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06380cab70 0x7f06380b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:16.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.004+0000 7f063d400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f06380b0ea0 0x7f06380c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:16.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.004+0000 7f063d400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f063815a860 con 0x7f063815a480 2024-04-02T07:33:16.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.004+0000 7f063d400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f063815ce20 con 0x7f06380cab70 2024-04-02T07:33:16.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.004+0000 7f063d400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06380b1300 con 0x7f06380b0ea0 2024-04-02T07:33:16.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.004+0000 7f062fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06380cab70 0x7f06380b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:16.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.004+0000 7f062fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06380cab70 0x7f06380b0960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52730/0 (socket says 172.21.15.55:52730) 2024-04-02T07:33:16.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.004+0000 7f062fe00640 1 -- 172.21.15.55:0/3382655510 learned_addr learned my addr 172.21.15.55:0/3382655510 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:16.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.004+0000 7f0637200640 1 --2- 172.21.15.55:0/3382655510 >> v2:172.21.15.106:3300/0 conn(0x7f06380b0ea0 0x7f06380c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:16.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.004+0000 7f062fe00640 1 -- 172.21.15.55:0/3382655510 >> v2:172.21.15.106:3300/0 conn(0x7f06380b0ea0 msgr2=0x7f06380c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:16.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.004+0000 7f062fe00640 1 --2- 172.21.15.55:0/3382655510 >> v2:172.21.15.106:3300/0 conn(0x7f06380b0ea0 0x7f06380c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:16.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.004+0000 7f062fe00640 1 -- 172.21.15.55:0/3382655510 >> v1:172.21.15.106:6789/0 conn(0x7f063815a480 legacy=0x7f06380ca460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:16.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.004+0000 7f062fe00640 1 -- 172.21.15.55:0/3382655510 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06380cb570 con 0x7f06380cab70 2024-04-02T07:33:16.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.008+0000 7f062fe00640 1 --2- 172.21.15.55:0/3382655510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06380cab70 0x7f06380b0960 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f063806acb0 tx=0x7f062001c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775b955a5de83e56 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:16.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.008+0000 7f0635e00640 1 -- 172.21.15.55:0/3382655510 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06200ad680 con 0x7f06380cab70 2024-04-02T07:33:16.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.008+0000 7f0635e00640 1 -- 172.21.15.55:0/3382655510 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06200ad7e0 con 0x7f06380cab70 2024-04-02T07:33:16.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.008+0000 7f0635e00640 1 -- 172.21.15.55:0/3382655510 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06200adb70 con 0x7f06380cab70 2024-04-02T07:33:16.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.008+0000 7f063d400640 1 -- 172.21.15.55:0/3382655510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06380cab70 msgr2=0x7f06380b0960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:16.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.008+0000 7f063d400640 1 --2- 172.21.15.55:0/3382655510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06380cab70 0x7f06380b0960 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f063806acb0 tx=0x7f062001c490 comp rx=0 tx=0).stop 2024-04-02T07:33:16.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.008+0000 7f063d400640 1 -- 172.21.15.55:0/3382655510 shutdown_connections 2024-04-02T07:33:16.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.008+0000 7f063d400640 1 --2- 172.21.15.55:0/3382655510 >> v2:172.21.15.106:3300/0 conn(0x7f06380b0ea0 0x7f06380c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:16.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.008+0000 7f063d400640 1 --2- 172.21.15.55:0/3382655510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06380cab70 0x7f06380b0960 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:16.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.008+0000 7f063d400640 1 -- 172.21.15.55:0/3382655510 >> 172.21.15.55:0/3382655510 conn(0x7f0638066080 msgr2=0x7f0638069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:16.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.008+0000 7f063d400640 1 -- 172.21.15.55:0/3382655510 shutdown_connections 2024-04-02T07:33:16.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.008+0000 7f063d400640 1 -- 172.21.15.55:0/3382655510 wait complete. 2024-04-02T07:33:16.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f063d400640 1 Processor -- start 2024-04-02T07:33:16.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f063d400640 1 -- start start 2024-04-02T07:33:16.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f063d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06380b0ea0 0x7f063814f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:16.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f063d400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06380cab70 0x7f063814fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:16.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f063d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f063815a480 0x7f0638150050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:16.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f063d400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0638152cf0 con 0x7f06380b0ea0 2024-04-02T07:33:16.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f063d400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f063814f6f0 con 0x7f063815a480 2024-04-02T07:33:16.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f063d400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0638152070 con 0x7f06380cab70 2024-04-02T07:33:16.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f0636800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06380b0ea0 0x7f063814f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:16.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f0636800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06380b0ea0 0x7f063814f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52732/0 (socket says 172.21.15.55:52732) 2024-04-02T07:33:16.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f0636800640 1 -- 172.21.15.55:0/2093200655 learned_addr learned my addr 172.21.15.55:0/2093200655 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:16.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f062fe00640 1 --2- 172.21.15.55:0/2093200655 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06380cab70 0x7f063814fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:16.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f0637200640 1 --2- 172.21.15.55:0/2093200655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f063815a480 0x7f0638150050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:16.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f0636800640 1 -- 172.21.15.55:0/2093200655 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06380cab70 msgr2=0x7f063814fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:16.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f0636800640 1 --2- 172.21.15.55:0/2093200655 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06380cab70 0x7f063814fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:16.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f0636800640 1 -- 172.21.15.55:0/2093200655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f063815a480 msgr2=0x7f0638150050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:16.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f0636800640 1 --2- 172.21.15.55:0/2093200655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f063815a480 0x7f0638150050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:16.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f0636800640 1 -- 172.21.15.55:0/2093200655 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06200094d0 con 0x7f06380b0ea0 2024-04-02T07:33:16.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f062fe00640 1 --2- 172.21.15.55:0/2093200655 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06380cab70 0x7f063814fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:16.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f0637200640 1 --2- 172.21.15.55:0/2093200655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f063815a480 0x7f0638150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:16.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f0636800640 1 --2- 172.21.15.55:0/2093200655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06380b0ea0 0x7f063814f1b0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f062800c3c0 tx=0x7f062800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:16.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f062ea00640 1 -- 172.21.15.55:0/2093200655 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06280052d0 con 0x7f06380b0ea0 2024-04-02T07:33:16.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f062ea00640 1 -- 172.21.15.55:0/2093200655 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0628005430 con 0x7f06380b0ea0 2024-04-02T07:33:16.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f062ea00640 1 -- 172.21.15.55:0/2093200655 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0628003840 con 0x7f06380b0ea0 2024-04-02T07:33:16.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f063d400640 1 -- 172.21.15.55:0/2093200655 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0638152350 con 0x7f06380b0ea0 2024-04-02T07:33:16.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.012+0000 7f063d400640 1 -- 172.21.15.55:0/2093200655 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0638152910 con 0x7f06380b0ea0 2024-04-02T07:33:16.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.016+0000 7f063d400640 1 -- 172.21.15.55:0/2093200655 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0638066c90 con 0x7f06380b0ea0 2024-04-02T07:33:16.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.016+0000 7f062ea00640 1 -- 172.21.15.55:0/2093200655 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f06280039a0 con 0x7f06380b0ea0 2024-04-02T07:33:16.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.016+0000 7f062ea00640 1 --2- 172.21.15.55:0/2093200655 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0614066690 0x7f0614068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:16.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.016+0000 7f062ea00640 1 -- 172.21.15.55:0/2093200655 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f0628083600 con 0x7f06380b0ea0 2024-04-02T07:33:16.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.016+0000 7f062fe00640 1 --2- 172.21.15.55:0/2093200655 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0614066690 0x7f0614068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:16.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.016+0000 7f062fe00640 1 --2- 172.21.15.55:0/2093200655 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0614066690 0x7f0614068b50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f06200af000 tx=0x7f0620008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:16.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.020+0000 7f062ea00640 1 -- 172.21.15.55:0/2093200655 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f06280508b0 con 0x7f06380b0ea0 2024-04-02T07:33:16.035 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:33:16.039 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:33:16.187 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.184+0000 7f063d400640 1 -- 172.21.15.55:0/2093200655 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f063815a860 con 0x7f06380b0ea0 2024-04-02T07:33:16.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.188+0000 7f062ea00640 1 -- 172.21.15.55:0/2093200655 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) v1 ==== 74+0+16310 (secure 0 0 0) 0x7f063815a860 con 0x7f06380b0ea0 2024-04-02T07:33:16.188 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:16.188 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":105,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:33:12.108824+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:31:29.246681+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"102","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2024-04-02T07:31:29.698823+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"103","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6835/1137835746":"2024-04-03T07:33:12.108798+0000","172.21.15.55:6834/1137835746":"2024-04-03T07:33:12.108798+0000","172.21.15.55:6835/1089546237":"2024-04-03T07:32:35.358480+0000","172.21.15.55:6834/1089546237":"2024-04-03T07:32:35.358480+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:33:16.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.188+0000 7f063d400640 1 -- 172.21.15.55:0/2093200655 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0614066690 msgr2=0x7f0614068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:16.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.188+0000 7f063d400640 1 --2- 172.21.15.55:0/2093200655 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0614066690 0x7f0614068b50 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f06200af000 tx=0x7f0620008040 comp rx=0 tx=0).stop 2024-04-02T07:33:16.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.188+0000 7f063d400640 1 -- 172.21.15.55:0/2093200655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06380b0ea0 msgr2=0x7f063814f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:16.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.188+0000 7f063d400640 1 --2- 172.21.15.55:0/2093200655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06380b0ea0 0x7f063814f1b0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f062800c3c0 tx=0x7f062800c880 comp rx=0 tx=0).stop 2024-04-02T07:33:16.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.188+0000 7f063d400640 1 -- 172.21.15.55:0/2093200655 shutdown_connections 2024-04-02T07:33:16.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.188+0000 7f063d400640 1 --2- 172.21.15.55:0/2093200655 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0614066690 0x7f0614068b50 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:16.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.188+0000 7f063d400640 1 --2- 172.21.15.55:0/2093200655 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f063815a480 0x7f0638150050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:16.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.188+0000 7f063d400640 1 --2- 172.21.15.55:0/2093200655 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f06380cab70 0x7f063814fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:16.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.188+0000 7f063d400640 1 --2- 172.21.15.55:0/2093200655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06380b0ea0 0x7f063814f1b0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:16.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.188+0000 7f063d400640 1 -- 172.21.15.55:0/2093200655 >> 172.21.15.55:0/2093200655 conn(0x7f0638066080 msgr2=0x7f06380702a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:16.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.188+0000 7f063d400640 1 -- 172.21.15.55:0/2093200655 shutdown_connections 2024-04-02T07:33:16.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.188+0000 7f063d400640 1 -- 172.21.15.55:0/2093200655 wait complete. 2024-04-02T07:33:16.209 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-02T07:33:16.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.348+0000 7f89ef000640 1 Processor -- start 2024-04-02T07:33:16.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.348+0000 7f89ef000640 1 -- start start 2024-04-02T07:33:16.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.348+0000 7f89ef000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89e815cb20 0x7f89e80ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:16.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.348+0000 7f89ef000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f89e80cad50 0x7f89e80cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:16.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.348+0000 7f89ef000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89e80cea70 con 0x7f89e80b0620 2024-04-02T07:33:16.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.348+0000 7f89ef000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89e80b13a0 con 0x7f89e80cad50 2024-04-02T07:33:16.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.348+0000 7f89ef000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e80b1680 con 0x7f89e815cb20 2024-04-02T07:33:16.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.348+0000 7f89e7e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89e815cb20 0x7f89e80ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:16.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.348+0000 7f89df400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f89e80cad50 0x7f89e80cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:16.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.348+0000 7f89e7e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89e815cb20 0x7f89e80ccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:59748/0 (socket says 172.21.15.55:59748) 2024-04-02T07:33:16.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.348+0000 7f89e7e00640 1 -- 172.21.15.55:0/4081388050 learned_addr learned my addr 172.21.15.55:0/4081388050 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:16.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.348+0000 7f89df400640 1 -- 172.21.15.55:0/4081388050 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89e815cb20 msgr2=0x7f89e80ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:16.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.348+0000 7f89df400640 1 --2- 172.21.15.55:0/4081388050 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89e815cb20 0x7f89e80ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:16.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.348+0000 7f89df400640 1 -- 172.21.15.55:0/4081388050 >> v1:172.21.15.106:6789/0 conn(0x7f89e80b0620 legacy=0x7f89e80b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:16.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.348+0000 7f89df400640 1 -- 172.21.15.55:0/4081388050 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e80cecf0 con 0x7f89e80cad50 2024-04-02T07:33:16.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.348+0000 7f89e7e00640 1 --2- 172.21.15.55:0/4081388050 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89e815cb20 0x7f89e80ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:33:16.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.352+0000 7f89df400640 1 --2- 172.21.15.55:0/4081388050 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89e80cad50 0x7f89e80cd4c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f89d00097c0 tx=0x7f89d001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd5eed9611082491 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:16.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.352+0000 7f89e7400640 1 -- 172.21.15.55:0/4081388050 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d00aa620 con 0x7f89e80cad50 2024-04-02T07:33:16.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.352+0000 7f89e7400640 1 -- 172.21.15.55:0/4081388050 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d00aa780 con 0x7f89e80cad50 2024-04-02T07:33:16.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.352+0000 7f89e7400640 1 -- 172.21.15.55:0/4081388050 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d00aab10 con 0x7f89e80cad50 2024-04-02T07:33:16.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.352+0000 7f89ef000640 1 -- 172.21.15.55:0/4081388050 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89e80cad50 msgr2=0x7f89e80cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:16.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.352+0000 7f89ef000640 1 --2- 172.21.15.55:0/4081388050 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89e80cad50 0x7f89e80cd4c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f89d00097c0 tx=0x7f89d001c4a0 comp rx=0 tx=0).stop 2024-04-02T07:33:16.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.352+0000 7f89ef000640 1 -- 172.21.15.55:0/4081388050 shutdown_connections 2024-04-02T07:33:16.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.352+0000 7f89ef000640 1 --2- 172.21.15.55:0/4081388050 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89e80cad50 0x7f89e80cd4c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.352+0000 7f89ef000640 1 --2- 172.21.15.55:0/4081388050 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89e815cb20 0x7f89e80ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.352+0000 7f89ef000640 1 -- 172.21.15.55:0/4081388050 >> 172.21.15.55:0/4081388050 conn(0x7f89e80d0700 msgr2=0x7f89e80d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.352+0000 7f89ef000640 1 -- 172.21.15.55:0/4081388050 shutdown_connections 2024-04-02T07:33:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.352+0000 7f89ef000640 1 -- 172.21.15.55:0/4081388050 wait complete. 2024-04-02T07:33:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89ef000640 1 Processor -- start 2024-04-02T07:33:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89ef000640 1 -- start start 2024-04-02T07:33:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89ef000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89e80b0620 0x7f89e815b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89ef000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89e80cad50 0x7f89e80b3260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89ef000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89e815cb20 0x7f89e80b37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89ef000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e8154a40 con 0x7f89e80cad50 2024-04-02T07:33:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89ef000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89e8153e50 con 0x7f89e815cb20 2024-04-02T07:33:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89ef000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89e8154110 con 0x7f89e80b0620 2024-04-02T07:33:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89df400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89e80cad50 0x7f89e80b3260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89e7e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89e80b0620 0x7f89e815b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89df400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89e80cad50 0x7f89e80b3260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52744/0 (socket says 172.21.15.55:52744) 2024-04-02T07:33:16.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89e7e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89e80b0620 0x7f89e815b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:59762/0 (socket says 172.21.15.55:59762) 2024-04-02T07:33:16.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89df400640 1 -- 172.21.15.55:0/1027282747 learned_addr learned my addr 172.21.15.55:0/1027282747 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:16.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89ed000640 1 --2- 172.21.15.55:0/1027282747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89e815cb20 0x7f89e80b37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:16.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89e7e00640 1 -- 172.21.15.55:0/1027282747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89e815cb20 msgr2=0x7f89e80b37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:16.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89e7e00640 1 --2- 172.21.15.55:0/1027282747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89e815cb20 0x7f89e80b37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:16.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89e7e00640 1 -- 172.21.15.55:0/1027282747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89e80cad50 msgr2=0x7f89e80b3260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:16.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89e7e00640 1 --2- 172.21.15.55:0/1027282747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89e80cad50 0x7f89e80b3260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:16.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89e7e00640 1 -- 172.21.15.55:0/1027282747 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d80094d0 con 0x7f89e80b0620 2024-04-02T07:33:16.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89e7e00640 1 --2- 172.21.15.55:0/1027282747 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89e80b0620 0x7f89e815b000 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f89d800e910 tx=0x7f89d800edd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:16.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89e4c00640 1 -- 172.21.15.55:0/1027282747 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d800ca00 con 0x7f89e80b0620 2024-04-02T07:33:16.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89e4c00640 1 -- 172.21.15.55:0/1027282747 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89d800cb60 con 0x7f89e80b0620 2024-04-02T07:33:16.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89ef000640 1 -- 172.21.15.55:0/1027282747 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d0009420 con 0x7f89e80b0620 2024-04-02T07:33:16.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89e4c00640 1 -- 172.21.15.55:0/1027282747 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89d8004030 con 0x7f89e80b0620 2024-04-02T07:33:16.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.356+0000 7f89ef000640 1 -- 172.21.15.55:0/1027282747 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89e81546d0 con 0x7f89e80b0620 2024-04-02T07:33:16.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.360+0000 7f89ef000640 1 -- 172.21.15.55:0/1027282747 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89e806ce80 con 0x7f89e80b0620 2024-04-02T07:33:16.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.360+0000 7f89e4c00640 1 -- 172.21.15.55:0/1027282747 <== mon.2 v2:172.21.15.106:3301/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f89d8004190 con 0x7f89e80b0620 2024-04-02T07:33:16.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.360+0000 7f89e4c00640 1 --2- 172.21.15.55:0/1027282747 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f89c4066690 0x7f89c4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:16.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.360+0000 7f89e4c00640 1 -- 172.21.15.55:0/1027282747 <== mon.2 v2:172.21.15.106:3301/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f89d8084360 con 0x7f89e80b0620 2024-04-02T07:33:16.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.360+0000 7f89df400640 1 --2- 172.21.15.55:0/1027282747 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f89c4066690 0x7f89c4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:16.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.360+0000 7f89df400640 1 --2- 172.21.15.55:0/1027282747 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f89c4066690 0x7f89c4068b50 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f89d001a0d0 tx=0x7f89d00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:16.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.364+0000 7f89e4c00640 1 -- 172.21.15.55:0/1027282747 <== mon.2 v2:172.21.15.106:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f89d80515a0 con 0x7f89e80b0620 2024-04-02T07:33:16.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:16.560+0000 7f89ef000640 1 -- 172.21.15.55:0/1027282747 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f89e8066c90 con 0x7f89e80b0620 2024-04-02T07:33:17.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.292+0000 7f89e4c00640 1 -- 172.21.15.55:0/1027282747 <== mon.2 v2:172.21.15.106:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v90) v1 ==== 161+0+0 (secure 0 0 0) 0x7f89d8054bc0 con 0x7f89e80b0620 2024-04-02T07:33:17.293 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-02T07:33:17.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.292+0000 7f89ef000640 1 -- 172.21.15.55:0/1027282747 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f89c4066690 msgr2=0x7f89c4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:17.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.292+0000 7f89ef000640 1 --2- 172.21.15.55:0/1027282747 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f89c4066690 0x7f89c4068b50 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f89d001a0d0 tx=0x7f89d00a7000 comp rx=0 tx=0).stop 2024-04-02T07:33:17.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.292+0000 7f89ef000640 1 -- 172.21.15.55:0/1027282747 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89e80b0620 msgr2=0x7f89e815b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:17.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.292+0000 7f89ef000640 1 --2- 172.21.15.55:0/1027282747 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89e80b0620 0x7f89e815b000 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f89d800e910 tx=0x7f89d800edd0 comp rx=0 tx=0).stop 2024-04-02T07:33:17.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.292+0000 7f89ef000640 1 -- 172.21.15.55:0/1027282747 shutdown_connections 2024-04-02T07:33:17.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.292+0000 7f89ef000640 1 --2- 172.21.15.55:0/1027282747 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f89c4066690 0x7f89c4068b50 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:17.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.292+0000 7f89ef000640 1 --2- 172.21.15.55:0/1027282747 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f89e815cb20 0x7f89e80b37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:17.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.292+0000 7f89ef000640 1 --2- 172.21.15.55:0/1027282747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89e80cad50 0x7f89e80b3260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:17.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.292+0000 7f89ef000640 1 --2- 172.21.15.55:0/1027282747 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f89e80b0620 0x7f89e815b000 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:17.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.292+0000 7f89ef000640 1 -- 172.21.15.55:0/1027282747 >> 172.21.15.55:0/1027282747 conn(0x7f89e80d0700 msgr2=0x7f89e806e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:17.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.292+0000 7f89ef000640 1 -- 172.21.15.55:0/1027282747 shutdown_connections 2024-04-02T07:33:17.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.292+0000 7f89ef000640 1 -- 172.21.15.55:0/1027282747 wait complete. 2024-04-02T07:33:17.317 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-02T07:33:17.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.460+0000 7f7894e00640 1 Processor -- start 2024-04-02T07:33:17.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.460+0000 7f7894e00640 1 -- start start 2024-04-02T07:33:17.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.464+0000 7f7894e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f789015b180 0x7f789015b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:17.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.464+0000 7f7894e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f78900c2a80 0x7f78900b0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:17.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.464+0000 7f7894e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f78900b07d0 0x7f789015e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:17.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.464+0000 7f7894e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78900b0c80 con 0x7f78900c2a80 2024-04-02T07:33:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.464+0000 7f7894e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78900ca7a0 con 0x7f78900b07d0 2024-04-02T07:33:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.464+0000 7f7894e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7890069d90 con 0x7f789015b180 2024-04-02T07:33:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.464+0000 7f788ea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f78900c2a80 0x7f78900b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.464+0000 7f788ea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f78900c2a80 0x7f78900b0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52750/0 (socket says 172.21.15.55:52750) 2024-04-02T07:33:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.464+0000 7f788ea00640 1 -- 172.21.15.55:0/1664891943 learned_addr learned my addr 172.21.15.55:0/1664891943 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.464+0000 7f788f400640 1 --2- 172.21.15.55:0/1664891943 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f789015b180 0x7f789015b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.464+0000 7f788fe00640 1 --2- 172.21.15.55:0/1664891943 >> v2:172.21.15.106:3300/0 conn(0x7f78900b07d0 0x7f789015e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:17.466 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.464+0000 7f788ea00640 1 -- 172.21.15.55:0/1664891943 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f789015b180 msgr2=0x7f789015b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:17.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.464+0000 7f788ea00640 1 --2- 172.21.15.55:0/1664891943 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f789015b180 0x7f789015b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:17.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.464+0000 7f788ea00640 1 -- 172.21.15.55:0/1664891943 >> v2:172.21.15.106:3300/0 conn(0x7f78900b07d0 msgr2=0x7f789015e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:17.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.464+0000 7f788ea00640 1 --2- 172.21.15.55:0/1664891943 >> v2:172.21.15.106:3300/0 conn(0x7f78900b07d0 0x7f789015e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:17.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.464+0000 7f788ea00640 1 -- 172.21.15.55:0/1664891943 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78900cb1a0 con 0x7f78900c2a80 2024-04-02T07:33:17.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.464+0000 7f788ea00640 1 --2- 172.21.15.55:0/1664891943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78900c2a80 0x7f78900b0290 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f7890070ad0 tx=0x7f787c01c230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8481371c6c8f958d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:17.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.464+0000 7f788e000640 1 -- 172.21.15.55:0/1664891943 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c0ab600 con 0x7f78900c2a80 2024-04-02T07:33:17.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.464+0000 7f788e000640 1 -- 172.21.15.55:0/1664891943 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c0a7050 con 0x7f78900c2a80 2024-04-02T07:33:17.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.464+0000 7f788e000640 1 -- 172.21.15.55:0/1664891943 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c0ab980 con 0x7f78900c2a80 2024-04-02T07:33:17.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f7894e00640 1 -- 172.21.15.55:0/1664891943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78900c2a80 msgr2=0x7f78900b0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:17.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f7894e00640 1 --2- 172.21.15.55:0/1664891943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78900c2a80 0x7f78900b0290 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f7890070ad0 tx=0x7f787c01c230 comp rx=0 tx=0).stop 2024-04-02T07:33:17.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f7894e00640 1 -- 172.21.15.55:0/1664891943 shutdown_connections 2024-04-02T07:33:17.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f7894e00640 1 --2- 172.21.15.55:0/1664891943 >> v2:172.21.15.106:3300/0 conn(0x7f78900b07d0 0x7f789015e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:17.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f7894e00640 1 --2- 172.21.15.55:0/1664891943 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78900c2a80 0x7f78900b0290 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:17.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f7894e00640 1 --2- 172.21.15.55:0/1664891943 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f789015b180 0x7f789015b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:17.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f7894e00640 1 -- 172.21.15.55:0/1664891943 >> 172.21.15.55:0/1664891943 conn(0x7f78900b0eb0 msgr2=0x7f78900b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:17.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f7894e00640 1 -- 172.21.15.55:0/1664891943 shutdown_connections 2024-04-02T07:33:17.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f7894e00640 1 -- 172.21.15.55:0/1664891943 wait complete. 2024-04-02T07:33:17.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f7894e00640 1 Processor -- start 2024-04-02T07:33:17.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f7894e00640 1 -- start start 2024-04-02T07:33:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f7894e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78900b07d0 0x7f789014f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f7894e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78900c2a80 0x7f78900c4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f7894e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f789015b180 0x7f78900c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f7894e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78900b3380 con 0x7f78900c2a80 2024-04-02T07:33:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f7894e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78900c95e0 con 0x7f789015b180 2024-04-02T07:33:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f7894e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78900b2a50 con 0x7f78900b07d0 2024-04-02T07:33:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f788ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78900c2a80 0x7f78900c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f788ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78900c2a80 0x7f78900c4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52762/0 (socket says 172.21.15.55:52762) 2024-04-02T07:33:17.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f788ea00640 1 -- 172.21.15.55:0/3648083710 learned_addr learned my addr 172.21.15.55:0/3648083710 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:17.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f788f400640 1 --2- 172.21.15.55:0/3648083710 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78900b07d0 0x7f789014f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:17.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f788ea00640 1 -- 172.21.15.55:0/3648083710 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78900b07d0 msgr2=0x7f789014f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:17.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f788ea00640 1 --2- 172.21.15.55:0/3648083710 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78900b07d0 0x7f789014f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:17.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f788fe00640 1 --2- 172.21.15.55:0/3648083710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f789015b180 0x7f78900c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:17.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f788ea00640 1 -- 172.21.15.55:0/3648083710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f789015b180 msgr2=0x7f78900c4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:17.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f788ea00640 1 --2- 172.21.15.55:0/3648083710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f789015b180 0x7f78900c4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:17.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f788ea00640 1 -- 172.21.15.55:0/3648083710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c0094d0 con 0x7f78900c2a80 2024-04-02T07:33:17.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.468+0000 7f788fe00640 1 --2- 172.21.15.55:0/3648083710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f789015b180 0x7f78900c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:17.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.472+0000 7f788ea00640 1 --2- 172.21.15.55:0/3648083710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78900c2a80 0x7f78900c4450 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f787c0ae040 tx=0x7f787c01aa70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:17.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.472+0000 7f7887400640 1 -- 172.21.15.55:0/3648083710 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c0b6620 con 0x7f78900c2a80 2024-04-02T07:33:17.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.472+0000 7f7887400640 1 -- 172.21.15.55:0/3648083710 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c0b67a0 con 0x7f78900c2a80 2024-04-02T07:33:17.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.472+0000 7f7887400640 1 -- 172.21.15.55:0/3648083710 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c0b6b50 con 0x7f78900c2a80 2024-04-02T07:33:17.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.472+0000 7f7894e00640 1 -- 172.21.15.55:0/3648083710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78900b2d30 con 0x7f78900c2a80 2024-04-02T07:33:17.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.472+0000 7f7894e00640 1 -- 172.21.15.55:0/3648083710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f789014d1d0 con 0x7f78900c2a80 2024-04-02T07:33:17.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.472+0000 7f7894e00640 1 -- 172.21.15.55:0/3648083710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78900b34f0 con 0x7f78900c2a80 2024-04-02T07:33:17.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.472+0000 7f7887400640 1 -- 172.21.15.55:0/3648083710 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f787c0b2040 con 0x7f78900c2a80 2024-04-02T07:33:17.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.472+0000 7f7887400640 1 --2- 172.21.15.55:0/3648083710 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7870066690 0x7f7870068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:17.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.472+0000 7f7887400640 1 -- 172.21.15.55:0/3648083710 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f787c11e6a0 con 0x7f78900c2a80 2024-04-02T07:33:17.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.472+0000 7f788f400640 1 --2- 172.21.15.55:0/3648083710 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7870066690 0x7f7870068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:17.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.476+0000 7f788f400640 1 --2- 172.21.15.55:0/3648083710 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7870066690 0x7f7870068b50 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f788000b930 tx=0x7f7880008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:17.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.476+0000 7f7887400640 1 -- 172.21.15.55:0/3648083710 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f787c0eb8c0 con 0x7f78900c2a80 2024-04-02T07:33:17.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:17.672+0000 7f7894e00640 1 -- 172.21.15.55:0/3648083710 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7890073fa0 con 0x7f78900c2a80 2024-04-02T07:33:18.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.300+0000 7f7887400640 1 -- 172.21.15.55:0/3648083710 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v91) v1 ==== 104+0+0 (secure 0 0 0) 0x7f787c0eeee0 con 0x7f78900c2a80 2024-04-02T07:33:18.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.304+0000 7f7894e00640 1 -- 172.21.15.55:0/3648083710 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7870066690 msgr2=0x7f7870068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:18.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.304+0000 7f7894e00640 1 --2- 172.21.15.55:0/3648083710 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7870066690 0x7f7870068b50 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f788000b930 tx=0x7f7880008040 comp rx=0 tx=0).stop 2024-04-02T07:33:18.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.304+0000 7f7894e00640 1 -- 172.21.15.55:0/3648083710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78900c2a80 msgr2=0x7f78900c4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:18.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.304+0000 7f7894e00640 1 --2- 172.21.15.55:0/3648083710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78900c2a80 0x7f78900c4450 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f787c0ae040 tx=0x7f787c01aa70 comp rx=0 tx=0).stop 2024-04-02T07:33:18.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.304+0000 7f7894e00640 1 -- 172.21.15.55:0/3648083710 shutdown_connections 2024-04-02T07:33:18.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.304+0000 7f7894e00640 1 --2- 172.21.15.55:0/3648083710 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7870066690 0x7f7870068b50 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:18.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.304+0000 7f7894e00640 1 --2- 172.21.15.55:0/3648083710 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f789015b180 0x7f78900c4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:18.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.304+0000 7f7894e00640 1 --2- 172.21.15.55:0/3648083710 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f78900c2a80 0x7f78900c4450 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:18.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.304+0000 7f7894e00640 1 --2- 172.21.15.55:0/3648083710 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f78900b07d0 0x7f789014f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:18.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.304+0000 7f7894e00640 1 -- 172.21.15.55:0/3648083710 >> 172.21.15.55:0/3648083710 conn(0x7f78900b0eb0 msgr2=0x7f789015c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:18.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.304+0000 7f7894e00640 1 -- 172.21.15.55:0/3648083710 shutdown_connections 2024-04-02T07:33:18.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.304+0000 7f7894e00640 1 -- 172.21.15.55:0/3648083710 wait complete. 2024-04-02T07:33:18.328 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-02T07:33:18.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57e5e00640 1 Processor -- start 2024-04-02T07:33:18.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57e5e00640 1 -- start start 2024-04-02T07:33:18.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57e5e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f57e006eb70 0x7f57e0161140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:18.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57e5e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e0161680 con 0x7f57e006a4a0 2024-04-02T07:33:18.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57e5e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57e006fcf0 con 0x7f57e0160070 2024-04-02T07:33:18.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57e5e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57e00cf390 con 0x7f57e006eb70 2024-04-02T07:33:18.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57de000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f57e006a4a0 0x7f57e0160a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37636/0 (socket says 172.21.15.55:37636) 2024-04-02T07:33:18.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57de000640 1 -- 172.21.15.55:0/1874175905 learned_addr learned my addr 172.21.15.55:0/1874175905 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:18.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57df400640 1 --2- 172.21.15.55:0/1874175905 >> v2:172.21.15.106:3300/0 conn(0x7f57e006eb70 0x7f57e0161140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:18.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57dd600640 1 -- 172.21.15.55:0/1874175905 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971383672 0 0) 0x7f57e0161680 con 0x7f57e006a4a0 2024-04-02T07:33:18.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57dd600640 1 -- 172.21.15.55:0/1874175905 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57c4003530 con 0x7f57e006a4a0 2024-04-02T07:33:18.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57dd600640 1 -- 172.21.15.55:0/1874175905 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4075785462 0 0) 0x7f57c4003530 con 0x7f57e006a4a0 2024-04-02T07:33:18.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57dd600640 1 -- 172.21.15.55:0/1874175905 >> v2:172.21.15.106:3300/0 conn(0x7f57e006eb70 msgr2=0x7f57e0161140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:18.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57dd600640 1 --2- 172.21.15.55:0/1874175905 >> v2:172.21.15.106:3300/0 conn(0x7f57e006eb70 0x7f57e0161140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:18.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57dd600640 1 -- 172.21.15.55:0/1874175905 >> v1:172.21.15.106:6789/0 conn(0x7f57e0160070 legacy=0x7f57e0069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:18.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57dd600640 1 -- 172.21.15.55:0/1874175905 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e00ceaf0 con 0x7f57e006a4a0 2024-04-02T07:33:18.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57dd600640 1 -- 172.21.15.55:0/1874175905 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f57cc0016a0 con 0x7f57e006a4a0 2024-04-02T07:33:18.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57dd600640 1 -- 172.21.15.55:0/1874175905 >> v1:172.21.15.55:6789/0 conn(0x7f57e006a4a0 legacy=0x7f57e0160a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:18.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57dd600640 1 --2- 172.21.15.55:0/1874175905 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57c4003980 0x7f57c4003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57dd600640 1 --2- 172.21.15.55:0/1874175905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57c4004380 0x7f57c4004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57dd600640 1 --2- 172.21.15.55:0/1874175905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57c4005050 0x7f57c400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57dd600640 1 -- 172.21.15.55:0/1874175905 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e00cf390 con 0x7f57c4004380 2024-04-02T07:33:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57dd600640 1 -- 172.21.15.55:0/1874175905 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c400bfb0 con 0x7f57c4005050 2024-04-02T07:33:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57dd600640 1 -- 172.21.15.55:0/1874175905 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c400c170 con 0x7f57c4003980 2024-04-02T07:33:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57de000640 1 --2- 172.21.15.55:0/1874175905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57c4004380 0x7f57c4004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57dea00640 1 --2- 172.21.15.55:0/1874175905 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57c4003980 0x7f57c4003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57df400640 1 --2- 172.21.15.55:0/1874175905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57c4005050 0x7f57c400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57de000640 1 -- 172.21.15.55:0/1874175905 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57c4003980 msgr2=0x7f57c4003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:18.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57de000640 1 --2- 172.21.15.55:0/1874175905 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57c4003980 0x7f57c4003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:18.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57de000640 1 -- 172.21.15.55:0/1874175905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57c4005050 msgr2=0x7f57c400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:18.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57de000640 1 --2- 172.21.15.55:0/1874175905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57c4005050 0x7f57c400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:18.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57de000640 1 -- 172.21.15.55:0/1874175905 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c4003530 con 0x7f57c4004380 2024-04-02T07:33:18.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.476+0000 7f57df400640 1 -- 172.21.15.55:0/1874175905 reap_dead start 2024-04-02T07:33:18.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.480+0000 7f57de000640 1 --2- 172.21.15.55:0/1874175905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57c4004380 0x7f57c4004850 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00c210 tx=0x7f57cc01cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843d0f71788fde7f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:18.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.480+0000 7f57dd600640 1 -- 172.21.15.55:0/1874175905 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc005ae0 con 0x7f57c4004380 2024-04-02T07:33:18.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.480+0000 7f57dd600640 1 -- 172.21.15.55:0/1874175905 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57cc005c40 con 0x7f57c4004380 2024-04-02T07:33:18.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.480+0000 7f57dd600640 1 -- 172.21.15.55:0/1874175905 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57cc0a58a0 con 0x7f57c4004380 2024-04-02T07:33:18.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.480+0000 7f57e5e00640 1 -- 172.21.15.55:0/1874175905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57c4004380 msgr2=0x7f57c4004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:18.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.480+0000 7f57e5e00640 1 --2- 172.21.15.55:0/1874175905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57c4004380 0x7f57c4004850 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f57cc00c210 tx=0x7f57cc01cba0 comp rx=0 tx=0).stop 2024-04-02T07:33:18.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.480+0000 7f57e5e00640 1 -- 172.21.15.55:0/1874175905 shutdown_connections 2024-04-02T07:33:18.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.480+0000 7f57e5e00640 1 --2- 172.21.15.55:0/1874175905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57c4004380 0x7f57c4004850 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:18.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.480+0000 7f57e5e00640 1 -- 172.21.15.55:0/1874175905 >> 172.21.15.55:0/1874175905 conn(0x7f57e00b12d0 msgr2=0x7f57e00b16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:18.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.480+0000 7f57e5e00640 1 -- 172.21.15.55:0/1874175905 shutdown_connections 2024-04-02T07:33:18.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.480+0000 7f57e5e00640 1 -- 172.21.15.55:0/1874175905 wait complete. 2024-04-02T07:33:18.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57e5e00640 1 Processor -- start 2024-04-02T07:33:18.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57e5e00640 1 -- start start 2024-04-02T07:33:18.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57e5e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57c4004380 0x7f57e01471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:18.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57e5e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57e015c4b0 0x7f57e015c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:18.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57e5e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57e00b3af0 0x7f57e00b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:18.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57e5e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e00b44b0 con 0x7f57e00b3af0 2024-04-02T07:33:18.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57e5e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57e00ca960 con 0x7f57c4004380 2024-04-02T07:33:18.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57e5e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57e0156e20 con 0x7f57e015c4b0 2024-04-02T07:33:18.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57df400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57e00b3af0 0x7f57e00b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:18.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57df400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57e00b3af0 0x7f57e00b3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52790/0 (socket says 172.21.15.55:52790) 2024-04-02T07:33:18.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57df400640 1 -- 172.21.15.55:0/2654363765 learned_addr learned my addr 172.21.15.55:0/2654363765 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:18.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57dea00640 1 --2- 172.21.15.55:0/2654363765 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57c4004380 0x7f57e01471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:18.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57de000640 1 --2- 172.21.15.55:0/2654363765 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57e015c4b0 0x7f57e015c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:18.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57df400640 1 -- 172.21.15.55:0/2654363765 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57e015c4b0 msgr2=0x7f57e015c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:18.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57df400640 1 --2- 172.21.15.55:0/2654363765 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57e015c4b0 0x7f57e015c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:18.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57df400640 1 -- 172.21.15.55:0/2654363765 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57c4004380 msgr2=0x7f57e01471c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:18.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57df400640 1 --2- 172.21.15.55:0/2654363765 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57c4004380 0x7f57e01471c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:18.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57df400640 1 -- 172.21.15.55:0/2654363765 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57e015d020 con 0x7f57e00b3af0 2024-04-02T07:33:18.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57dea00640 1 --2- 172.21.15.55:0/2654363765 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57c4004380 0x7f57e01471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:33:18.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57df400640 1 --2- 172.21.15.55:0/2654363765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57e00b3af0 0x7f57e00b3f70 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f57e0072500 tx=0x7f57d800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:18.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57d7400640 1 -- 172.21.15.55:0/2654363765 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d800e040 con 0x7f57e00b3af0 2024-04-02T07:33:18.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57d7400640 1 -- 172.21.15.55:0/2654363765 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57d800f040 con 0x7f57e00b3af0 2024-04-02T07:33:18.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57d7400640 1 -- 172.21.15.55:0/2654363765 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57d8015430 con 0x7f57e00b3af0 2024-04-02T07:33:18.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57e5e00640 1 -- 172.21.15.55:0/2654363765 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57e00cabb0 con 0x7f57e00b3af0 2024-04-02T07:33:18.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.484+0000 7f57e5e00640 1 -- 172.21.15.55:0/2654363765 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57e00cb170 con 0x7f57e00b3af0 2024-04-02T07:33:18.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.488+0000 7f57e5e00640 1 -- 172.21.15.55:0/2654363765 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57e0066c90 con 0x7f57e00b3af0 2024-04-02T07:33:18.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.488+0000 7f57d7400640 1 -- 172.21.15.55:0/2654363765 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f57d8015590 con 0x7f57e00b3af0 2024-04-02T07:33:18.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.488+0000 7f57d7400640 1 --2- 172.21.15.55:0/2654363765 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f57c00666c0 0x7f57c0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:18.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.488+0000 7f57d7400640 1 -- 172.21.15.55:0/2654363765 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5881+0+0 (secure 0 0 0) 0x7f57d8084900 con 0x7f57e00b3af0 2024-04-02T07:33:18.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.488+0000 7f57dea00640 1 --2- 172.21.15.55:0/2654363765 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f57c00666c0 0x7f57c0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:18.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.488+0000 7f57dea00640 1 --2- 172.21.15.55:0/2654363765 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f57c00666c0 0x7f57c0068b80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f57e00aea90 tx=0x7f57d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:18.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.492+0000 7f57d7400640 1 -- 172.21.15.55:0/2654363765 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f57d8051c60 con 0x7f57e00b3af0 2024-04-02T07:33:18.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:18.656+0000 7f57e5e00640 1 -- 172.21.15.55:0/2654363765 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f57e015c080 con 0x7f57e00b3af0 2024-04-02T07:33:19.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.312+0000 7f57d7400640 1 -- 172.21.15.55:0/2654363765 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v106) v1 ==== 181+0+0 (secure 0 0 0) 0x7f57d8055280 con 0x7f57e00b3af0 2024-04-02T07:33:19.314 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2024-04-02T07:33:19.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.316+0000 7f57e5e00640 1 -- 172.21.15.55:0/2654363765 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f57c00666c0 msgr2=0x7f57c0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:19.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.316+0000 7f57e5e00640 1 --2- 172.21.15.55:0/2654363765 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f57c00666c0 0x7f57c0068b80 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f57e00aea90 tx=0x7f57d0009040 comp rx=0 tx=0).stop 2024-04-02T07:33:19.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.316+0000 7f57e5e00640 1 -- 172.21.15.55:0/2654363765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57e00b3af0 msgr2=0x7f57e00b3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:19.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.316+0000 7f57e5e00640 1 --2- 172.21.15.55:0/2654363765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57e00b3af0 0x7f57e00b3f70 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7f57e0072500 tx=0x7f57d800f580 comp rx=0 tx=0).stop 2024-04-02T07:33:19.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.316+0000 7f57e5e00640 1 -- 172.21.15.55:0/2654363765 shutdown_connections 2024-04-02T07:33:19.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.316+0000 7f57e5e00640 1 --2- 172.21.15.55:0/2654363765 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f57e00b3af0 0x7f57e00b3f70 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:19.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.316+0000 7f57e5e00640 1 --2- 172.21.15.55:0/2654363765 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f57e015c4b0 0x7f57e015c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:19.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.316+0000 7f57e5e00640 1 --2- 172.21.15.55:0/2654363765 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f57c00666c0 0x7f57c0068b80 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:19.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.316+0000 7f57e5e00640 1 --2- 172.21.15.55:0/2654363765 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f57c4004380 0x7f57e01471c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:19.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.316+0000 7f57e5e00640 1 -- 172.21.15.55:0/2654363765 >> 172.21.15.55:0/2654363765 conn(0x7f57e00b12d0 msgr2=0x7f57e0156370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:19.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.316+0000 7f57e5e00640 1 -- 172.21.15.55:0/2654363765 shutdown_connections 2024-04-02T07:33:19.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.316+0000 7f57e5e00640 1 -- 172.21.15.55:0/2654363765 wait complete. 2024-04-02T07:33:19.343 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-02T07:33:19.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca2c200640 1 Processor -- start 2024-04-02T07:33:19.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca2c200640 1 -- start start 2024-04-02T07:33:19.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca2c200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fca2415d450 0x7fca2415d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:19.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca2c200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca24161370 con 0x7fca240cd430 2024-04-02T07:33:19.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca2c200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca2406c0b0 con 0x7fca240ccf80 2024-04-02T07:33:19.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca2c200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca240cd880 con 0x7fca2415d450 2024-04-02T07:33:19.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca2a200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fca240cd430 0x7fca24160c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37642/0 (socket says 172.21.15.55:37642) 2024-04-02T07:33:19.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca2a200640 1 -- 172.21.15.55:0/1945219393 learned_addr learned my addr 172.21.15.55:0/1945219393 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:19.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca29800640 1 --2- 172.21.15.55:0/1945219393 >> v2:172.21.15.106:3300/0 conn(0x7fca2415d450 0x7fca2415d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:19.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca23e00640 1 -- 172.21.15.55:0/1945219393 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269422021 0 0) 0x7fca24161370 con 0x7fca240cd430 2024-04-02T07:33:19.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca23e00640 1 -- 172.21.15.55:0/1945219393 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca0c003530 con 0x7fca240cd430 2024-04-02T07:33:19.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca23e00640 1 -- 172.21.15.55:0/1945219393 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917215815 0 0) 0x7fca2406c0b0 con 0x7fca240ccf80 2024-04-02T07:33:19.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca23e00640 1 -- 172.21.15.55:0/1945219393 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca24161370 con 0x7fca240ccf80 2024-04-02T07:33:19.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca23e00640 1 -- 172.21.15.55:0/1945219393 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2223067267 0 0) 0x7fca0c003530 con 0x7fca240cd430 2024-04-02T07:33:19.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca23e00640 1 -- 172.21.15.55:0/1945219393 >> v2:172.21.15.106:3300/0 conn(0x7fca2415d450 msgr2=0x7fca2415d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca23e00640 1 --2- 172.21.15.55:0/1945219393 >> v2:172.21.15.106:3300/0 conn(0x7fca2415d450 0x7fca2415d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca23e00640 1 -- 172.21.15.55:0/1945219393 >> v1:172.21.15.106:6789/0 conn(0x7fca240ccf80 legacy=0x7fca24160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca23e00640 1 -- 172.21.15.55:0/1945219393 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca24098d40 con 0x7fca240cd430 2024-04-02T07:33:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca23e00640 1 -- 172.21.15.55:0/1945219393 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fca1c001a00 con 0x7fca240cd430 2024-04-02T07:33:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca23e00640 1 -- 172.21.15.55:0/1945219393 >> v1:172.21.15.55:6789/0 conn(0x7fca240cd430 legacy=0x7fca24160c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca23e00640 1 --2- 172.21.15.55:0/1945219393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca0c003b10 0x7fca0c003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca23e00640 1 --2- 172.21.15.55:0/1945219393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca0c0047d0 0x7fca0c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca23e00640 1 --2- 172.21.15.55:0/1945219393 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca0c005190 0x7fca0c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca23e00640 1 -- 172.21.15.55:0/1945219393 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca240cd880 con 0x7fca0c0047d0 2024-04-02T07:33:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca23e00640 1 -- 172.21.15.55:0/1945219393 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c00c010 con 0x7fca0c003b10 2024-04-02T07:33:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca23e00640 1 -- 172.21.15.55:0/1945219393 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c00c1d0 con 0x7fca0c005190 2024-04-02T07:33:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.488+0000 7fca28e00640 1 --2- 172.21.15.55:0/1945219393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca0c0047d0 0x7fca0c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.492+0000 7fca29800640 1 --2- 172.21.15.55:0/1945219393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca0c003b10 0x7fca0c003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:19.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.492+0000 7fca2a200640 1 --2- 172.21.15.55:0/1945219393 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca0c005190 0x7fca0c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.492+0000 7fca29800640 1 -- 172.21.15.55:0/1945219393 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca0c005190 msgr2=0x7fca0c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.492+0000 7fca29800640 1 --2- 172.21.15.55:0/1945219393 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca0c005190 0x7fca0c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.492+0000 7fca29800640 1 -- 172.21.15.55:0/1945219393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca0c0047d0 msgr2=0x7fca0c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.492+0000 7fca29800640 1 --2- 172.21.15.55:0/1945219393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca0c0047d0 0x7fca0c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.492+0000 7fca29800640 1 -- 172.21.15.55:0/1945219393 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c003530 con 0x7fca0c003b10 2024-04-02T07:33:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.492+0000 7fca28e00640 1 --2- 172.21.15.55:0/1945219393 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca0c0047d0 0x7fca0c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:33:19.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.492+0000 7fca2a200640 1 -- 172.21.15.55:0/1945219393 reap_dead start 2024-04-02T07:33:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.492+0000 7fca29800640 1 --2- 172.21.15.55:0/1945219393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca0c003b10 0x7fca0c003f10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fca18009ae0 tx=0x7fca1801ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=686b725aaa951103 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.492+0000 7fca23e00640 1 -- 172.21.15.55:0/1945219393 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca180a5550 con 0x7fca0c003b10 2024-04-02T07:33:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.492+0000 7fca23e00640 1 -- 172.21.15.55:0/1945219393 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca180a56b0 con 0x7fca0c003b10 2024-04-02T07:33:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.492+0000 7fca23e00640 1 -- 172.21.15.55:0/1945219393 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca180a5a60 con 0x7fca0c003b10 2024-04-02T07:33:19.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca2c200640 1 -- 172.21.15.55:0/1945219393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca0c003b10 msgr2=0x7fca0c003f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:19.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca2c200640 1 --2- 172.21.15.55:0/1945219393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca0c003b10 0x7fca0c003f10 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fca18009ae0 tx=0x7fca1801ca70 comp rx=0 tx=0).stop 2024-04-02T07:33:19.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca2c200640 1 -- 172.21.15.55:0/1945219393 shutdown_connections 2024-04-02T07:33:19.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca2c200640 1 --2- 172.21.15.55:0/1945219393 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca0c003b10 0x7fca0c003f10 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:19.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca2c200640 1 -- 172.21.15.55:0/1945219393 >> 172.21.15.55:0/1945219393 conn(0x7fca240d0700 msgr2=0x7fca240d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:19.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca2c200640 1 -- 172.21.15.55:0/1945219393 shutdown_connections 2024-04-02T07:33:19.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca2c200640 1 -- 172.21.15.55:0/1945219393 wait complete. 2024-04-02T07:33:19.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca2c200640 1 Processor -- start 2024-04-02T07:33:19.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca2c200640 1 -- start start 2024-04-02T07:33:19.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca2c200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca0c003b10 0x7fca24158f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:19.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca2c200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca240ae350 0x7fca240ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:19.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca2c200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca241f1e70 0x7fca241f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:19.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca2c200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca241f2f10 con 0x7fca240ae350 2024-04-02T07:33:19.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca2c200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca240aed10 con 0x7fca0c003b10 2024-04-02T07:33:19.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca2c200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca24159470 con 0x7fca241f1e70 2024-04-02T07:33:19.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca28e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca240ae350 0x7fca240ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:19.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca28e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca240ae350 0x7fca240ae7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52814/0 (socket says 172.21.15.55:52814) 2024-04-02T07:33:19.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca28e00640 1 -- 172.21.15.55:0/1452947322 learned_addr learned my addr 172.21.15.55:0/1452947322 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:19.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca29800640 1 --2- 172.21.15.55:0/1452947322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca0c003b10 0x7fca24158f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:19.500 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca2a200640 1 --2- 172.21.15.55:0/1452947322 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca241f1e70 0x7fca241f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:19.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca28e00640 1 -- 172.21.15.55:0/1452947322 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca241f1e70 msgr2=0x7fca241f22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:19.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca28e00640 1 --2- 172.21.15.55:0/1452947322 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca241f1e70 0x7fca241f22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:19.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca28e00640 1 -- 172.21.15.55:0/1452947322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca0c003b10 msgr2=0x7fca24158f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:19.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca28e00640 1 --2- 172.21.15.55:0/1452947322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca0c003b10 0x7fca24158f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:19.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.496+0000 7fca28e00640 1 -- 172.21.15.55:0/1452947322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca241f2c30 con 0x7fca240ae350 2024-04-02T07:33:19.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.500+0000 7fca28e00640 1 --2- 172.21.15.55:0/1452947322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca240ae350 0x7fca240ae7d0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fca100128d0 tx=0x7fca10012d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:19.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.500+0000 7fca21600640 1 -- 172.21.15.55:0/1452947322 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10010b50 con 0x7fca240ae350 2024-04-02T07:33:19.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.500+0000 7fca21600640 1 -- 172.21.15.55:0/1452947322 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca10010cb0 con 0x7fca240ae350 2024-04-02T07:33:19.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.500+0000 7fca2c200640 1 -- 172.21.15.55:0/1452947322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca241f3210 con 0x7fca240ae350 2024-04-02T07:33:19.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.500+0000 7fca21600640 1 -- 172.21.15.55:0/1452947322 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca10016480 con 0x7fca240ae350 2024-04-02T07:33:19.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.500+0000 7fca2c200640 1 -- 172.21.15.55:0/1452947322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca241f37d0 con 0x7fca240ae350 2024-04-02T07:33:19.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.500+0000 7fca2c200640 1 -- 172.21.15.55:0/1452947322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca241f39f0 con 0x7fca240ae350 2024-04-02T07:33:19.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.500+0000 7fca21600640 1 -- 172.21.15.55:0/1452947322 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fca100165e0 con 0x7fca240ae350 2024-04-02T07:33:19.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.500+0000 7fca21600640 1 --2- 172.21.15.55:0/1452947322 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fca04066690 0x7fca04068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:19.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.500+0000 7fca21600640 1 -- 172.21.15.55:0/1452947322 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 5443+0+0 (secure 0 0 0) 0x7fca10087670 con 0x7fca240ae350 2024-04-02T07:33:19.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.500+0000 7fca29800640 1 --2- 172.21.15.55:0/1452947322 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fca04066690 0x7fca04068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:19.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.504+0000 7fca29800640 1 --2- 172.21.15.55:0/1452947322 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fca04066690 0x7fca04068b50 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fca180af000 tx=0x7fca180046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:19.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.504+0000 7fca21600640 1 -- 172.21.15.55:0/1452947322 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fca10054af0 con 0x7fca240ae350 2024-04-02T07:33:19.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:19.668+0000 7fca2c200640 1 -- 172.21.15.55:0/1452947322 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fca24066c90 con 0x7fca240ae350 2024-04-02T07:33:20.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.316+0000 7fca21600640 1 -- 172.21.15.55:0/1452947322 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v107) v1 ==== 169+0+0 (secure 0 0 0) 0x7fca10058110 con 0x7fca240ae350 2024-04-02T07:33:20.317 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2024-04-02T07:33:20.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.320+0000 7fca2c200640 1 -- 172.21.15.55:0/1452947322 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fca04066690 msgr2=0x7fca04068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:20.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.320+0000 7fca2c200640 1 --2- 172.21.15.55:0/1452947322 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fca04066690 0x7fca04068b50 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fca180af000 tx=0x7fca180046d0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.320+0000 7fca2c200640 1 -- 172.21.15.55:0/1452947322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca240ae350 msgr2=0x7fca240ae7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:20.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.320+0000 7fca2c200640 1 --2- 172.21.15.55:0/1452947322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca240ae350 0x7fca240ae7d0 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7fca100128d0 tx=0x7fca10012d90 comp rx=0 tx=0).stop 2024-04-02T07:33:20.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.320+0000 7fca2c200640 1 -- 172.21.15.55:0/1452947322 shutdown_connections 2024-04-02T07:33:20.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.320+0000 7fca2c200640 1 --2- 172.21.15.55:0/1452947322 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fca241f1e70 0x7fca241f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.320+0000 7fca2c200640 1 --2- 172.21.15.55:0/1452947322 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca240ae350 0x7fca240ae7d0 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.320+0000 7fca2c200640 1 --2- 172.21.15.55:0/1452947322 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fca04066690 0x7fca04068b50 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.320+0000 7fca2c200640 1 --2- 172.21.15.55:0/1452947322 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fca0c003b10 0x7fca24158f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.320+0000 7fca2c200640 1 -- 172.21.15.55:0/1452947322 >> 172.21.15.55:0/1452947322 conn(0x7fca240d0700 msgr2=0x7fca2415f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:20.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.320+0000 7fca2c200640 1 -- 172.21.15.55:0/1452947322 shutdown_connections 2024-04-02T07:33:20.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.320+0000 7fca2c200640 1 -- 172.21.15.55:0/1452947322 wait complete. 2024-04-02T07:33:20.348 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-02T07:33:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.488+0000 7ff043e00640 1 Processor -- start 2024-04-02T07:33:20.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.492+0000 7ff043e00640 1 -- start start 2024-04-02T07:33:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.492+0000 7ff043e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff03c144260 0x7ff03c0702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.492+0000 7ff043e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff03c0707e0 0x7ff03c0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.492+0000 7ff043e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff03c070c90 con 0x7ff03c0b2fd0 2024-04-02T07:33:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.492+0000 7ff043e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff03c0b37c0 con 0x7ff03c144260 2024-04-02T07:33:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.492+0000 7ff043e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff03c15e3a0 con 0x7ff03c0707e0 2024-04-02T07:33:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.492+0000 7ff041400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff03c144260 0x7ff03c0702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.492+0000 7ff041400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff03c144260 0x7ff03c0702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52818/0 (socket says 172.21.15.55:52818) 2024-04-02T07:33:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.492+0000 7ff041400640 1 -- 172.21.15.55:0/1536311659 learned_addr learned my addr 172.21.15.55:0/1536311659 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:20.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.492+0000 7ff040a00640 1 --2- 172.21.15.55:0/1536311659 >> v2:172.21.15.106:3300/0 conn(0x7ff03c0707e0 0x7ff03c0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.492+0000 7ff041400640 1 -- 172.21.15.55:0/1536311659 >> v2:172.21.15.106:3300/0 conn(0x7ff03c0707e0 msgr2=0x7ff03c0b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.492+0000 7ff041400640 1 --2- 172.21.15.55:0/1536311659 >> v2:172.21.15.106:3300/0 conn(0x7ff03c0707e0 0x7ff03c0b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.492+0000 7ff041400640 1 -- 172.21.15.55:0/1536311659 >> v1:172.21.15.106:6789/0 conn(0x7ff03c0b2fd0 legacy=0x7ff03c0cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:20.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.492+0000 7ff041400640 1 -- 172.21.15.55:0/1536311659 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03c15e5f0 con 0x7ff03c144260 2024-04-02T07:33:20.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.496+0000 7ff041400640 1 --2- 172.21.15.55:0/1536311659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c144260 0x7ff03c0702a0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0b1410 tx=0x7ff03001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce65c1b8bb8ecd08 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.496+0000 7ff03be00640 1 -- 172.21.15.55:0/1536311659 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0300ab600 con 0x7ff03c144260 2024-04-02T07:33:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.496+0000 7ff03be00640 1 -- 172.21.15.55:0/1536311659 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0300a7050 con 0x7ff03c144260 2024-04-02T07:33:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.496+0000 7ff03be00640 1 -- 172.21.15.55:0/1536311659 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0300ab980 con 0x7ff03c144260 2024-04-02T07:33:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.496+0000 7ff043e00640 1 -- 172.21.15.55:0/1536311659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c144260 msgr2=0x7ff03c0702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.496+0000 7ff043e00640 1 --2- 172.21.15.55:0/1536311659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c144260 0x7ff03c0702a0 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7ff03c0b1410 tx=0x7ff03001c520 comp rx=0 tx=0).stop 2024-04-02T07:33:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.496+0000 7ff043e00640 1 -- 172.21.15.55:0/1536311659 shutdown_connections 2024-04-02T07:33:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.496+0000 7ff043e00640 1 --2- 172.21.15.55:0/1536311659 >> v2:172.21.15.106:3300/0 conn(0x7ff03c0707e0 0x7ff03c0b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.496+0000 7ff043e00640 1 --2- 172.21.15.55:0/1536311659 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c144260 0x7ff03c0702a0 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.496+0000 7ff043e00640 1 -- 172.21.15.55:0/1536311659 >> 172.21.15.55:0/1536311659 conn(0x7ff03c06a390 msgr2=0x7ff03c0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.496+0000 7ff043e00640 1 -- 172.21.15.55:0/1536311659 shutdown_connections 2024-04-02T07:33:20.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.496+0000 7ff043e00640 1 -- 172.21.15.55:0/1536311659 wait complete. 2024-04-02T07:33:20.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.496+0000 7ff043e00640 1 Processor -- start 2024-04-02T07:33:20.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.496+0000 7ff043e00640 1 -- start start 2024-04-02T07:33:20.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff043e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff03c0707e0 0x7ff03c06da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:20.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff043e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c0b2fd0 0x7ff03c141e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:20.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff043e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff03c144260 0x7ff03c140ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:20.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff043e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c142950 con 0x7ff03c0b2fd0 2024-04-02T07:33:20.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff043e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c1403f0 con 0x7ff03c144260 2024-04-02T07:33:20.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff043e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03c1406d0 con 0x7ff03c0707e0 2024-04-02T07:33:20.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff040a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c0b2fd0 0x7ff03c141e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:20.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff040a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c0b2fd0 0x7ff03c141e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52826/0 (socket says 172.21.15.55:52826) 2024-04-02T07:33:20.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff040a00640 1 -- 172.21.15.55:0/3916720377 learned_addr learned my addr 172.21.15.55:0/3916720377 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:20.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff041400640 1 --2- 172.21.15.55:0/3916720377 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff03c0707e0 0x7ff03c06da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff041e00640 1 --2- 172.21.15.55:0/3916720377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff03c144260 0x7ff03c140ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff040a00640 1 -- 172.21.15.55:0/3916720377 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff03c0707e0 msgr2=0x7ff03c06da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff040a00640 1 --2- 172.21.15.55:0/3916720377 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff03c0707e0 0x7ff03c06da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff040a00640 1 -- 172.21.15.55:0/3916720377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff03c144260 msgr2=0x7ff03c140ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff040a00640 1 --2- 172.21.15.55:0/3916720377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff03c144260 0x7ff03c140ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff040a00640 1 -- 172.21.15.55:0/3916720377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0300094d0 con 0x7ff03c0b2fd0 2024-04-02T07:33:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff041e00640 1 --2- 172.21.15.55:0/3916720377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff03c144260 0x7ff03c140ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff040a00640 1 --2- 172.21.15.55:0/3916720377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c0b2fd0 0x7ff03c141e90 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7ff02800d800 tx=0x7ff02800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff039600640 1 -- 172.21.15.55:0/3916720377 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02800b6c0 con 0x7ff03c0b2fd0 2024-04-02T07:33:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff039600640 1 -- 172.21.15.55:0/3916720377 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff02800b820 con 0x7ff03c0b2fd0 2024-04-02T07:33:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff039600640 1 -- 172.21.15.55:0/3916720377 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02800bb90 con 0x7ff03c0b2fd0 2024-04-02T07:33:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff043e00640 1 -- 172.21.15.55:0/3916720377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff03c1409b0 con 0x7ff03c0b2fd0 2024-04-02T07:33:20.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff043e00640 1 -- 172.21.15.55:0/3916720377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff03c142c30 con 0x7ff03c0b2fd0 2024-04-02T07:33:20.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff043e00640 1 -- 172.21.15.55:0/3916720377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff03c073530 con 0x7ff03c0b2fd0 2024-04-02T07:33:20.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.500+0000 7ff039600640 1 -- 172.21.15.55:0/3916720377 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff02800bcf0 con 0x7ff03c0b2fd0 2024-04-02T07:33:20.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.504+0000 7ff039600640 1 --2- 172.21.15.55:0/3916720377 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff01c066690 0x7ff01c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:20.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.504+0000 7ff039600640 1 -- 172.21.15.55:0/3916720377 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5029+0+0 (secure 0 0 0) 0x7ff028084490 con 0x7ff03c0b2fd0 2024-04-02T07:33:20.505 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.504+0000 7ff041400640 1 --2- 172.21.15.55:0/3916720377 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff01c066690 0x7ff01c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:20.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.504+0000 7ff041400640 1 --2- 172.21.15.55:0/3916720377 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff01c066690 0x7ff01c068b50 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff0300ad000 tx=0x7ff0300a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:20.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.508+0000 7ff039600640 1 -- 172.21.15.55:0/3916720377 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff028051a00 con 0x7ff03c0b2fd0 2024-04-02T07:33:20.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.668+0000 7ff043e00640 1 -- 172.21.15.55:0/3916720377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff03c066c90 con 0x7ff03c0b2fd0 2024-04-02T07:33:20.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.672+0000 7ff039600640 1 -- 172.21.15.55:0/3916720377 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff028055020 con 0x7ff03c0b2fd0 2024-04-02T07:33:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.676+0000 7ff043e00640 1 -- 172.21.15.55:0/3916720377 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff01c066690 msgr2=0x7ff01c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.676+0000 7ff043e00640 1 --2- 172.21.15.55:0/3916720377 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff01c066690 0x7ff01c068b50 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7ff0300ad000 tx=0x7ff0300a6000 comp rx=0 tx=0).stop 2024-04-02T07:33:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.676+0000 7ff043e00640 1 -- 172.21.15.55:0/3916720377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c0b2fd0 msgr2=0x7ff03c141e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.676+0000 7ff043e00640 1 --2- 172.21.15.55:0/3916720377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c0b2fd0 0x7ff03c141e90 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7ff02800d800 tx=0x7ff02800dcc0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.676+0000 7ff043e00640 1 -- 172.21.15.55:0/3916720377 shutdown_connections 2024-04-02T07:33:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.676+0000 7ff043e00640 1 --2- 172.21.15.55:0/3916720377 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff01c066690 0x7ff01c068b50 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.676+0000 7ff043e00640 1 --2- 172.21.15.55:0/3916720377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff03c144260 0x7ff03c140ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.676+0000 7ff043e00640 1 --2- 172.21.15.55:0/3916720377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff03c0b2fd0 0x7ff03c141e90 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.676+0000 7ff043e00640 1 --2- 172.21.15.55:0/3916720377 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff03c0707e0 0x7ff03c06da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.676+0000 7ff043e00640 1 -- 172.21.15.55:0/3916720377 >> 172.21.15.55:0/3916720377 conn(0x7ff03c06a390 msgr2=0x7ff03c072dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:20.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.676+0000 7ff043e00640 1 -- 172.21.15.55:0/3916720377 shutdown_connections 2024-04-02T07:33:20.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.676+0000 7ff043e00640 1 -- 172.21.15.55:0/3916720377 wait complete. 2024-04-02T07:33:20.696 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync' 2024-04-02T07:33:20.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.832+0000 7f9663400640 1 Processor -- start 2024-04-02T07:33:20.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.832+0000 7f9663400640 1 -- start start 2024-04-02T07:33:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f9663400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f965c0cfdf0 0x7f965c06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f9663400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f965c0d01d0 con 0x7f965c0b16e0 2024-04-02T07:33:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f9663400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f965c06c0e0 con 0x7f965c098a10 2024-04-02T07:33:20.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f9663400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965c0b01d0 con 0x7f965c0cfdf0 2024-04-02T07:33:20.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f9653e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f965c0b16e0 0x7f965c0b0cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37644/0 (socket says 172.21.15.55:37644) 2024-04-02T07:33:20.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f9653e00640 1 -- 172.21.15.55:0/3381982376 learned_addr learned my addr 172.21.15.55:0/3381982376 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:20.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f9660a00640 1 --2- 172.21.15.55:0/3381982376 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f965c0cfdf0 0x7f965c06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f965be00640 1 -- 172.21.15.55:0/3381982376 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2539804976 0 0) 0x7f9644001120 con 0x7f965c0b16e0 2024-04-02T07:33:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f965be00640 1 -- 172.21.15.55:0/3381982376 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9640003530 con 0x7f965c0b16e0 2024-04-02T07:33:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f965be00640 1 -- 172.21.15.55:0/3381982376 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1664844791 0 0) 0x7f9640003530 con 0x7f965c0b16e0 2024-04-02T07:33:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f965be00640 1 -- 172.21.15.55:0/3381982376 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f965c0cfdf0 msgr2=0x7f965c06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f965be00640 1 --2- 172.21.15.55:0/3381982376 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f965c0cfdf0 0x7f965c06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f965be00640 1 -- 172.21.15.55:0/3381982376 >> v1:172.21.15.106:6789/0 conn(0x7f965c098a10 legacy=0x7f965c0cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f965be00640 1 -- 172.21.15.55:0/3381982376 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965c0b04b0 con 0x7f965c0b16e0 2024-04-02T07:33:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f965be00640 1 -- 172.21.15.55:0/3381982376 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f9644001810 con 0x7f965c0b16e0 2024-04-02T07:33:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f965be00640 1 -- 172.21.15.55:0/3381982376 >> v1:172.21.15.55:6789/0 conn(0x7f965c0b16e0 legacy=0x7f965c0b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f965be00640 1 --2- 172.21.15.55:0/3381982376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f96400039b0 0x7f9640003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f965be00640 1 --2- 172.21.15.55:0/3381982376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9640004360 0x7f9640004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f965be00640 1 --2- 172.21.15.55:0/3381982376 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9640005030 0x7f964000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:20.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f965be00640 1 -- 172.21.15.55:0/3381982376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c0b01d0 con 0x7f9640004360 2024-04-02T07:33:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f965be00640 1 -- 172.21.15.55:0/3381982376 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f964000bf00 con 0x7f96400039b0 2024-04-02T07:33:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f965be00640 1 -- 172.21.15.55:0/3381982376 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f964000c0c0 con 0x7f9640005030 2024-04-02T07:33:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f9660a00640 1 --2- 172.21.15.55:0/3381982376 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f965c0cfdf0 0x7f965c06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:33:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f9653e00640 1 --2- 172.21.15.55:0/3381982376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9640004360 0x7f9640004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f9661400640 1 --2- 172.21.15.55:0/3381982376 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9640005030 0x7f964000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f9660a00640 1 --2- 172.21.15.55:0/3381982376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f96400039b0 0x7f9640003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f9653e00640 1 -- 172.21.15.55:0/3381982376 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9640005030 msgr2=0x7f964000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f9653e00640 1 --2- 172.21.15.55:0/3381982376 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9640005030 0x7f964000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f9653e00640 1 -- 172.21.15.55:0/3381982376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f96400039b0 msgr2=0x7f9640003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f9653e00640 1 --2- 172.21.15.55:0/3381982376 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f96400039b0 0x7f9640003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.836+0000 7f9653e00640 1 -- 172.21.15.55:0/3381982376 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9640003530 con 0x7f9640004360 2024-04-02T07:33:20.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.840+0000 7f9653e00640 1 --2- 172.21.15.55:0/3381982376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9640004360 0x7f9640004830 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f964400c190 tx=0x7f964401cbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c7ff965999e5ce8 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:20.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.840+0000 7f965be00640 1 -- 172.21.15.55:0/3381982376 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9644005ae0 con 0x7f9640004360 2024-04-02T07:33:20.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.840+0000 7f965be00640 1 -- 172.21.15.55:0/3381982376 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9644005c60 con 0x7f9640004360 2024-04-02T07:33:20.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.840+0000 7f965be00640 1 -- 172.21.15.55:0/3381982376 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96440a57c0 con 0x7f9640004360 2024-04-02T07:33:20.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.840+0000 7f9663400640 1 -- 172.21.15.55:0/3381982376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9640004360 msgr2=0x7f9640004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:20.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.840+0000 7f9663400640 1 --2- 172.21.15.55:0/3381982376 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9640004360 0x7f9640004830 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7f964400c190 tx=0x7f964401cbb0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.840+0000 7f9661400640 1 -- 172.21.15.55:0/3381982376 reap_dead start 2024-04-02T07:33:20.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.840+0000 7f9663400640 1 -- 172.21.15.55:0/3381982376 shutdown_connections 2024-04-02T07:33:20.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.840+0000 7f9663400640 1 -- 172.21.15.55:0/3381982376 >> 172.21.15.55:0/3381982376 conn(0x7f965c0b2210 msgr2=0x7f965c0b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:20.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.840+0000 7f9663400640 1 -- 172.21.15.55:0/3381982376 shutdown_connections 2024-04-02T07:33:20.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.840+0000 7f9663400640 1 -- 172.21.15.55:0/3381982376 wait complete. 2024-04-02T07:33:20.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.840+0000 7f9663400640 1 Processor -- start 2024-04-02T07:33:20.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.840+0000 7f9663400640 1 -- start start 2024-04-02T07:33:20.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9663400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9640004360 0x7f965c1f92e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:20.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9663400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f965c0c67f0 0x7f965c1f83f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:20.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9663400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f965c0c6c50 0x7f965c1f8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:20.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9663400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c1f8e70 con 0x7f965c0c67f0 2024-04-02T07:33:20.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9663400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f965c0b53f0 con 0x7f965c0c6c50 2024-04-02T07:33:20.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9663400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f965c0b5640 con 0x7f9640004360 2024-04-02T07:33:20.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9653e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f965c0c67f0 0x7f965c1f83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:20.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9653e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f965c0c67f0 0x7f965c1f83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52840/0 (socket says 172.21.15.55:52840) 2024-04-02T07:33:20.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9653e00640 1 -- 172.21.15.55:0/1735467744 learned_addr learned my addr 172.21.15.55:0/1735467744 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:20.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9661400640 1 --2- 172.21.15.55:0/1735467744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f965c0c6c50 0x7f965c1f8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:20.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9660a00640 1 --2- 172.21.15.55:0/1735467744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9640004360 0x7f965c1f92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:20.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9653e00640 1 -- 172.21.15.55:0/1735467744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9640004360 msgr2=0x7f965c1f92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:20.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9653e00640 1 --2- 172.21.15.55:0/1735467744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9640004360 0x7f965c1f92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9653e00640 1 -- 172.21.15.55:0/1735467744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f965c0c6c50 msgr2=0x7f965c1f8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:20.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9653e00640 1 --2- 172.21.15.55:0/1735467744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f965c0c6c50 0x7f965c1f8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:20.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9653e00640 1 -- 172.21.15.55:0/1735467744 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f965c0b5920 con 0x7f965c0c67f0 2024-04-02T07:33:20.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9660a00640 1 --2- 172.21.15.55:0/1735467744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9640004360 0x7f965c1f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:20.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9653e00640 1 --2- 172.21.15.55:0/1735467744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f965c0c67f0 0x7f965c1f83f0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f964401c9e0 tx=0x7f9640005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:20.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9659600640 1 -- 172.21.15.55:0/1735467744 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96440b4070 con 0x7f965c0c67f0 2024-04-02T07:33:20.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9659600640 1 -- 172.21.15.55:0/1735467744 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96440047f0 con 0x7f965c0c67f0 2024-04-02T07:33:20.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9659600640 1 -- 172.21.15.55:0/1735467744 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9644004b60 con 0x7f965c0c67f0 2024-04-02T07:33:20.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9663400640 1 -- 172.21.15.55:0/1735467744 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f965c0b5c00 con 0x7f965c0c67f0 2024-04-02T07:33:20.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9663400640 1 -- 172.21.15.55:0/1735467744 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f965c1f9e40 con 0x7f965c0c67f0 2024-04-02T07:33:20.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9663400640 1 -- 172.21.15.55:0/1735467744 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f965c0b60b0 con 0x7f965c0c67f0 2024-04-02T07:33:20.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.844+0000 7f9659600640 1 -- 172.21.15.55:0/1735467744 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f9644004cc0 con 0x7f965c0c67f0 2024-04-02T07:33:20.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.848+0000 7f9659600640 1 --2- 172.21.15.55:0/1735467744 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9638066690 0x7f9638068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:20.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.848+0000 7f9659600640 1 -- 172.21.15.55:0/1735467744 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f964411ce60 con 0x7f965c0c67f0 2024-04-02T07:33:20.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.848+0000 7f9660a00640 1 --2- 172.21.15.55:0/1735467744 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9638066690 0x7f9638068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:20.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.848+0000 7f9660a00640 1 --2- 172.21.15.55:0/1735467744 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9638066690 0x7f9638068b50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f965c073b60 tx=0x7f964c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:20.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:20.852+0000 7f9659600640 1 -- 172.21.15.55:0/1735467744 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f96440ea500 con 0x7f965c0c67f0 2024-04-02T07:33:21.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.068+0000 7f9663400640 1 -- 172.21.15.55:0/1735467744 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]} v 0) v1 -- 0x7f965c0d01d0 con 0x7f965c0c67f0 2024-04-02T07:33:21.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.332+0000 7f9659600640 1 -- 172.21.15.55:0/1735467744 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_inotable_sync"]}]=0 v496) v1 ==== 146+0+0 (secure 0 0 0) 0x7f965c0d01d0 con 0x7f965c0c67f0 2024-04-02T07:33:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.332+0000 7f9663400640 1 -- 172.21.15.55:0/1735467744 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9638066690 msgr2=0x7f9638068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.332+0000 7f9663400640 1 --2- 172.21.15.55:0/1735467744 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9638066690 0x7f9638068b50 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f965c073b60 tx=0x7f964c008040 comp rx=0 tx=0).stop 2024-04-02T07:33:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.332+0000 7f9663400640 1 -- 172.21.15.55:0/1735467744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f965c0c67f0 msgr2=0x7f965c1f83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.332+0000 7f9663400640 1 --2- 172.21.15.55:0/1735467744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f965c0c67f0 0x7f965c1f83f0 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f964401c9e0 tx=0x7f9640005800 comp rx=0 tx=0).stop 2024-04-02T07:33:21.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.336+0000 7f9663400640 1 -- 172.21.15.55:0/1735467744 shutdown_connections 2024-04-02T07:33:21.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.336+0000 7f9663400640 1 --2- 172.21.15.55:0/1735467744 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9638066690 0x7f9638068b50 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:21.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.336+0000 7f9663400640 1 --2- 172.21.15.55:0/1735467744 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f965c0c6c50 0x7f965c1f8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:21.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.336+0000 7f9663400640 1 --2- 172.21.15.55:0/1735467744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f965c0c67f0 0x7f965c1f83f0 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:21.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.336+0000 7f9663400640 1 --2- 172.21.15.55:0/1735467744 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9640004360 0x7f965c1f92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:21.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.336+0000 7f9663400640 1 -- 172.21.15.55:0/1735467744 >> 172.21.15.55:0/1735467744 conn(0x7f965c0b2210 msgr2=0x7f965c15dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:21.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.336+0000 7f9663400640 1 -- 172.21.15.55:0/1735467744 shutdown_connections 2024-04-02T07:33:21.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.336+0000 7f9663400640 1 -- 172.21.15.55:0/1735467744 wait complete. 2024-04-02T07:33:21.356 INFO:tasks.cephfs_test_runner:test_inotable_sync (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-02T07:33:21.357 INFO:tasks.cephfs_test_runner:Starting test: test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) 2024-04-02T07:33:21.357 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-04-02T07:33:21.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.500+0000 7f8a39a00640 1 Processor -- start 2024-04-02T07:33:21.504 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.500+0000 7f8a39a00640 1 -- start start 2024-04-02T07:33:21.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.504+0000 7f8a39a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8a340c4120 0x7f8a340b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:21.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.504+0000 7f8a39a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8a340b36f0 0x7f8a3413d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:21.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.504+0000 7f8a39a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a3413d0c0 con 0x7f8a34153ea0 2024-04-02T07:33:21.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.504+0000 7f8a39a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a3415a2f0 con 0x7f8a340c4120 2024-04-02T07:33:21.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.504+0000 7f8a39a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a340b3b60 con 0x7f8a340b36f0 2024-04-02T07:33:21.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.504+0000 7f8a32a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8a34153ea0 0x7f8a34159be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37660/0 (socket says 172.21.15.55:37660) 2024-04-02T07:33:21.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.504+0000 7f8a32a00640 1 -- 172.21.15.55:0/1689368853 learned_addr learned my addr 172.21.15.55:0/1689368853 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:21.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.504+0000 7f8a2be00640 1 --2- 172.21.15.55:0/1689368853 >> v2:172.21.15.106:3300/0 conn(0x7f8a340c4120 0x7f8a340b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:21.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.504+0000 7f8a33400640 1 --2- 172.21.15.55:0/1689368853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8a340b36f0 0x7f8a3413d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:21.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.504+0000 7f8a32000640 1 -- 172.21.15.55:0/1689368853 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889812441 0 0) 0x7f8a3413d0c0 con 0x7f8a34153ea0 2024-04-02T07:33:21.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.504+0000 7f8a32000640 1 -- 172.21.15.55:0/1689368853 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a18003530 con 0x7f8a34153ea0 2024-04-02T07:33:21.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.504+0000 7f8a2be00640 1 -- 172.21.15.55:0/1689368853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8a340b36f0 msgr2=0x7f8a3413d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:21.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.504+0000 7f8a2be00640 1 --2- 172.21.15.55:0/1689368853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8a340b36f0 0x7f8a3413d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:21.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.504+0000 7f8a2be00640 1 -- 172.21.15.55:0/1689368853 >> v1:172.21.15.55:6789/0 conn(0x7f8a34153ea0 legacy=0x7f8a34159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:21.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.504+0000 7f8a2be00640 1 -- 172.21.15.55:0/1689368853 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a3415a4f0 con 0x7f8a340c4120 2024-04-02T07:33:21.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.508+0000 7f8a2be00640 1 --2- 172.21.15.55:0/1689368853 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a340c4120 0x7f8a340b31b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0097f0 tx=0x7f8a1c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8fc2de84c634c074 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:21.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.508+0000 7f8a32000640 1 -- 172.21.15.55:0/1689368853 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0ac410 con 0x7f8a340c4120 2024-04-02T07:33:21.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.508+0000 7f8a32000640 1 -- 172.21.15.55:0/1689368853 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1c0ac570 con 0x7f8a340c4120 2024-04-02T07:33:21.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.508+0000 7f8a32000640 1 -- 172.21.15.55:0/1689368853 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0ac900 con 0x7f8a340c4120 2024-04-02T07:33:21.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.508+0000 7f8a39a00640 1 -- 172.21.15.55:0/1689368853 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a340c4120 msgr2=0x7f8a340b31b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:21.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.508+0000 7f8a39a00640 1 --2- 172.21.15.55:0/1689368853 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a340c4120 0x7f8a340b31b0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c0097f0 tx=0x7f8a1c01c4a0 comp rx=0 tx=0).stop 2024-04-02T07:33:21.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.508+0000 7f8a39a00640 1 -- 172.21.15.55:0/1689368853 shutdown_connections 2024-04-02T07:33:21.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.508+0000 7f8a39a00640 1 --2- 172.21.15.55:0/1689368853 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8a340b36f0 0x7f8a3413d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:21.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.508+0000 7f8a39a00640 1 --2- 172.21.15.55:0/1689368853 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a340c4120 0x7f8a340b31b0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:21.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.508+0000 7f8a39a00640 1 -- 172.21.15.55:0/1689368853 >> 172.21.15.55:0/1689368853 conn(0x7f8a34066080 msgr2=0x7f8a34069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:21.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.508+0000 7f8a39a00640 1 -- 172.21.15.55:0/1689368853 shutdown_connections 2024-04-02T07:33:21.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.508+0000 7f8a39a00640 1 -- 172.21.15.55:0/1689368853 wait complete. 2024-04-02T07:33:21.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.508+0000 7f8a39a00640 1 Processor -- start 2024-04-02T07:33:21.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.508+0000 7f8a39a00640 1 -- start start 2024-04-02T07:33:21.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a39a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8a340b36f0 0x7f8a34134d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:21.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a39a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a340c4120 0x7f8a3413f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:21.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a39a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a34153ea0 0x7f8a3413a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:21.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a39a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a34143710 con 0x7f8a34153ea0 2024-04-02T07:33:21.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a39a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a341439f0 con 0x7f8a340c4120 2024-04-02T07:33:21.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a39a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a34143cd0 con 0x7f8a340b36f0 2024-04-02T07:33:21.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a33400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a34153ea0 0x7f8a3413a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:21.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a33400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a34153ea0 0x7f8a3413a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52844/0 (socket says 172.21.15.55:52844) 2024-04-02T07:33:21.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a33400640 1 -- 172.21.15.55:0/2074701319 learned_addr learned my addr 172.21.15.55:0/2074701319 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:21.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a32a00640 1 --2- 172.21.15.55:0/2074701319 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8a340b36f0 0x7f8a34134d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:21.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a2be00640 1 --2- 172.21.15.55:0/2074701319 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a340c4120 0x7f8a3413f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:21.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a33400640 1 -- 172.21.15.55:0/2074701319 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8a340b36f0 msgr2=0x7f8a34134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:21.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a33400640 1 --2- 172.21.15.55:0/2074701319 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8a340b36f0 0x7f8a34134d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:21.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a33400640 1 -- 172.21.15.55:0/2074701319 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a340c4120 msgr2=0x7f8a3413f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:21.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a33400640 1 --2- 172.21.15.55:0/2074701319 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a340c4120 0x7f8a3413f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:21.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a33400640 1 -- 172.21.15.55:0/2074701319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c009420 con 0x7f8a34153ea0 2024-04-02T07:33:21.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a32a00640 1 --2- 172.21.15.55:0/2074701319 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8a340b36f0 0x7f8a34134d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:21.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a33400640 1 --2- 172.21.15.55:0/2074701319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a34153ea0 0x7f8a3413a280 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00efc0 tx=0x7f8a2c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:21.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a2aa00640 1 -- 172.21.15.55:0/2074701319 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c014480 con 0x7f8a34153ea0 2024-04-02T07:33:21.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a2aa00640 1 -- 172.21.15.55:0/2074701319 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c00f040 con 0x7f8a34153ea0 2024-04-02T07:33:21.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a39a00640 1 -- 172.21.15.55:0/2074701319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a34143fb0 con 0x7f8a34153ea0 2024-04-02T07:33:21.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a2aa00640 1 -- 172.21.15.55:0/2074701319 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c014820 con 0x7f8a34153ea0 2024-04-02T07:33:21.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a39a00640 1 -- 172.21.15.55:0/2074701319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a34143370 con 0x7f8a34153ea0 2024-04-02T07:33:21.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a39a00640 1 -- 172.21.15.55:0/2074701319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a341444d0 con 0x7f8a34153ea0 2024-04-02T07:33:21.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.512+0000 7f8a2aa00640 1 -- 172.21.15.55:0/2074701319 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8a2c014980 con 0x7f8a34153ea0 2024-04-02T07:33:21.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.516+0000 7f8a2aa00640 1 --2- 172.21.15.55:0/2074701319 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8a100666c0 0x7f8a10068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:21.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.516+0000 7f8a2aa00640 1 -- 172.21.15.55:0/2074701319 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f8a2c084990 con 0x7f8a34153ea0 2024-04-02T07:33:21.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.516+0000 7f8a32a00640 1 --2- 172.21.15.55:0/2074701319 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8a100666c0 0x7f8a10068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:21.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.516+0000 7f8a32a00640 1 --2- 172.21.15.55:0/2074701319 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8a100666c0 0x7f8a10068b80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f8a240011f0 tx=0x7f8a24009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:21.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.520+0000 7f8a2aa00640 1 -- 172.21.15.55:0/2074701319 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f8a341444d0 con 0x7f8a34153ea0 2024-04-02T07:33:21.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:21.736+0000 7f8a39a00640 1 -- 172.21.15.55:0/2074701319 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) v1 -- 0x7f8a341444d0 con 0x7f8a34153ea0 2024-04-02T07:33:22.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.336+0000 7f8a2aa00640 1 -- 172.21.15.55:0/2074701319 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v497) v1 ==== 147+0+0 (secure 0 0 0) 0x7f8a341444d0 con 0x7f8a34153ea0 2024-04-02T07:33:22.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.340+0000 7f8a39a00640 1 -- 172.21.15.55:0/2074701319 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8a100666c0 msgr2=0x7f8a10068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:22.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.340+0000 7f8a39a00640 1 --2- 172.21.15.55:0/2074701319 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8a100666c0 0x7f8a10068b80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f8a240011f0 tx=0x7f8a24009040 comp rx=0 tx=0).stop 2024-04-02T07:33:22.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.340+0000 7f8a39a00640 1 -- 172.21.15.55:0/2074701319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a34153ea0 msgr2=0x7f8a3413a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:22.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.340+0000 7f8a39a00640 1 --2- 172.21.15.55:0/2074701319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a34153ea0 0x7f8a3413a280 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00efc0 tx=0x7f8a2c00c490 comp rx=0 tx=0).stop 2024-04-02T07:33:22.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.340+0000 7f8a39a00640 1 -- 172.21.15.55:0/2074701319 shutdown_connections 2024-04-02T07:33:22.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.340+0000 7f8a39a00640 1 --2- 172.21.15.55:0/2074701319 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8a34153ea0 0x7f8a3413a280 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:22.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.340+0000 7f8a39a00640 1 --2- 172.21.15.55:0/2074701319 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8a100666c0 0x7f8a10068b80 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:22.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.340+0000 7f8a39a00640 1 --2- 172.21.15.55:0/2074701319 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8a340c4120 0x7f8a3413f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:22.342 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.340+0000 7f8a39a00640 1 --2- 172.21.15.55:0/2074701319 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8a340b36f0 0x7f8a34134d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:22.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.340+0000 7f8a39a00640 1 -- 172.21.15.55:0/2074701319 >> 172.21.15.55:0/2074701319 conn(0x7f8a34066080 msgr2=0x7f8a340b20a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:22.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.340+0000 7f8a39a00640 1 -- 172.21.15.55:0/2074701319 shutdown_connections 2024-04-02T07:33:22.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.340+0000 7f8a39a00640 1 -- 172.21.15.55:0/2074701319 wait complete. 2024-04-02T07:33:22.363 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-04-02T07:33:22.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.508+0000 7f7deb400640 1 Processor -- start 2024-04-02T07:33:22.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.508+0000 7f7deb400640 1 -- start start 2024-04-02T07:33:22.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.508+0000 7f7deb400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7de4072130 0x7f7de4069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:22.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.508+0000 7f7deb400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7de406a2d0 0x7f7de4160760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:22.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.508+0000 7f7deb400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de415de90 con 0x7f7de4157000 2024-04-02T07:33:22.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.508+0000 7f7deb400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7de415d070 con 0x7f7de406a2d0 2024-04-02T07:33:22.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.508+0000 7f7deb400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de406a760 con 0x7f7de4072130 2024-04-02T07:33:22.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.508+0000 7f7de9400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7de406a2d0 0x7f7de4160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:22.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.508+0000 7f7de3e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7de4072130 0x7f7de4069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:22.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.508+0000 7f7de9400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7de406a2d0 0x7f7de4160760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:46260/0 (socket says 172.21.15.55:46260) 2024-04-02T07:33:22.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.508+0000 7f7de9400640 1 -- 172.21.15.55:0/2111553679 learned_addr learned my addr 172.21.15.55:0/2111553679 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:22.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.508+0000 7f7de9400640 1 -- 172.21.15.55:0/2111553679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7de4072130 msgr2=0x7f7de4069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:22.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.508+0000 7f7de9400640 1 --2- 172.21.15.55:0/2111553679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7de4072130 0x7f7de4069d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:22.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.508+0000 7f7de9400640 1 -- 172.21.15.55:0/2111553679 >> v1:172.21.15.106:6789/0 conn(0x7f7de4157000 legacy=0x7f7de4071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:22.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.508+0000 7f7de9400640 1 -- 172.21.15.55:0/2111553679 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de415d280 con 0x7f7de406a2d0 2024-04-02T07:33:22.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.508+0000 7f7de3400640 1 -- 172.21.15.55:0/2111553679 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3294566284 0 0) 0x7f7de415de90 con 0x7f7de4157000 2024-04-02T07:33:22.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.508+0000 7f7de3e00640 1 --2- 172.21.15.55:0/2111553679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7de4072130 0x7f7de4069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:33:22.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.512+0000 7f7de9400640 1 --2- 172.21.15.55:0/2111553679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7de406a2d0 0x7f7de4160760 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc009e50 tx=0x7f7ddc01ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77de943f8c351c0e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.512+0000 7f7de3400640 1 -- 172.21.15.55:0/2111553679 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc0a58d0 con 0x7f7de406a2d0 2024-04-02T07:33:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.512+0000 7f7de3400640 1 -- 172.21.15.55:0/2111553679 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ddc0a5a30 con 0x7f7de406a2d0 2024-04-02T07:33:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.512+0000 7f7de3400640 1 -- 172.21.15.55:0/2111553679 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc0a5dc0 con 0x7f7de406a2d0 2024-04-02T07:33:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.512+0000 7f7deb400640 1 -- 172.21.15.55:0/2111553679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7de406a2d0 msgr2=0x7f7de4160760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.512+0000 7f7deb400640 1 --2- 172.21.15.55:0/2111553679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7de406a2d0 0x7f7de4160760 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc009e50 tx=0x7f7ddc01ca00 comp rx=0 tx=0).stop 2024-04-02T07:33:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.512+0000 7f7deb400640 1 -- 172.21.15.55:0/2111553679 shutdown_connections 2024-04-02T07:33:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.512+0000 7f7deb400640 1 --2- 172.21.15.55:0/2111553679 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7de406a2d0 0x7f7de4160760 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.512+0000 7f7deb400640 1 --2- 172.21.15.55:0/2111553679 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7de4072130 0x7f7de4069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.512+0000 7f7deb400640 1 -- 172.21.15.55:0/2111553679 >> 172.21.15.55:0/2111553679 conn(0x7f7de40b13b0 msgr2=0x7f7de40b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.512+0000 7f7deb400640 1 -- 172.21.15.55:0/2111553679 shutdown_connections 2024-04-02T07:33:22.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.512+0000 7f7deb400640 1 -- 172.21.15.55:0/2111553679 wait complete. 2024-04-02T07:33:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7deb400640 1 Processor -- start 2024-04-02T07:33:22.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7deb400640 1 -- start start 2024-04-02T07:33:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7deb400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7de406a2d0 0x7f7de4156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7deb400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7de4072130 0x7f7de41502b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7deb400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7de4157000 0x7f7de414d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7deb400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de414e3f0 con 0x7f7de4072130 2024-04-02T07:33:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7deb400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de4154990 con 0x7f7de406a2d0 2024-04-02T07:33:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7deb400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de414dae0 con 0x7f7de4157000 2024-04-02T07:33:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7de3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7de4072130 0x7f7de41502b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7de3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7de4072130 0x7f7de41502b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52858/0 (socket says 172.21.15.55:52858) 2024-04-02T07:33:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7de3e00640 1 -- 172.21.15.55:0/3096010259 learned_addr learned my addr 172.21.15.55:0/3096010259 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7de8a00640 1 --2- 172.21.15.55:0/3096010259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7de406a2d0 0x7f7de4156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7de9400640 1 --2- 172.21.15.55:0/3096010259 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7de4157000 0x7f7de414d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7de3e00640 1 -- 172.21.15.55:0/3096010259 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7de4157000 msgr2=0x7f7de414d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7de3e00640 1 --2- 172.21.15.55:0/3096010259 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7de4157000 0x7f7de414d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7de3e00640 1 -- 172.21.15.55:0/3096010259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7de406a2d0 msgr2=0x7f7de4156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7de3e00640 1 --2- 172.21.15.55:0/3096010259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7de406a2d0 0x7f7de4156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7de3e00640 1 -- 172.21.15.55:0/3096010259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd0009420 con 0x7f7de4072130 2024-04-02T07:33:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7de9400640 1 --2- 172.21.15.55:0/3096010259 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7de4157000 0x7f7de414d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7de3e00640 1 --2- 172.21.15.55:0/3096010259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7de4072130 0x7f7de41502b0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000ebe0 tx=0x7f7dd000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7de0c00640 1 -- 172.21.15.55:0/3096010259 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd000eee0 con 0x7f7de4072130 2024-04-02T07:33:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7de0c00640 1 -- 172.21.15.55:0/3096010259 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd000cc30 con 0x7f7de4072130 2024-04-02T07:33:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7deb400640 1 -- 172.21.15.55:0/3096010259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ddc009b30 con 0x7f7de4072130 2024-04-02T07:33:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7de0c00640 1 -- 172.21.15.55:0/3096010259 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0013470 con 0x7f7de4072130 2024-04-02T07:33:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.516+0000 7f7deb400640 1 -- 172.21.15.55:0/3096010259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de4156660 con 0x7f7de4072130 2024-04-02T07:33:22.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.520+0000 7f7deb400640 1 -- 172.21.15.55:0/3096010259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de4067430 con 0x7f7de4072130 2024-04-02T07:33:22.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.520+0000 7f7de0c00640 1 -- 172.21.15.55:0/3096010259 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7dd00135d0 con 0x7f7de4072130 2024-04-02T07:33:22.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.520+0000 7f7de0c00640 1 --2- 172.21.15.55:0/3096010259 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7dc4066690 0x7f7dc4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:22.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.520+0000 7f7de0c00640 1 -- 172.21.15.55:0/3096010259 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f7dd0084130 con 0x7f7de4072130 2024-04-02T07:33:22.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.520+0000 7f7de8a00640 1 --2- 172.21.15.55:0/3096010259 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7dc4066690 0x7f7dc4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:22.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.520+0000 7f7de8a00640 1 --2- 172.21.15.55:0/3096010259 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7dc4066690 0x7f7dc4068b50 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8007fd0 tx=0x7f7dd8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:22.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.524+0000 7f7de0c00640 1 -- 172.21.15.55:0/3096010259 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7dd00517f0 con 0x7f7de4072130 2024-04-02T07:33:22.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.684+0000 7f7deb400640 1 -- 172.21.15.55:0/3096010259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7de4066c90 con 0x7f7de4072130 2024-04-02T07:33:22.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.692+0000 7f7de0c00640 1 -- 172.21.15.55:0/3096010259 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7dd0054e10 con 0x7f7de4072130 2024-04-02T07:33:22.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.692+0000 7f7deb400640 1 -- 172.21.15.55:0/3096010259 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7dc4066690 msgr2=0x7f7dc4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:22.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.692+0000 7f7deb400640 1 --2- 172.21.15.55:0/3096010259 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7dc4066690 0x7f7dc4068b50 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8007fd0 tx=0x7f7dd8009040 comp rx=0 tx=0).stop 2024-04-02T07:33:22.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.692+0000 7f7deb400640 1 -- 172.21.15.55:0/3096010259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7de4072130 msgr2=0x7f7de41502b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:22.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.692+0000 7f7deb400640 1 --2- 172.21.15.55:0/3096010259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7de4072130 0x7f7de41502b0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000ebe0 tx=0x7f7dd000c520 comp rx=0 tx=0).stop 2024-04-02T07:33:22.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.692+0000 7f7deb400640 1 -- 172.21.15.55:0/3096010259 shutdown_connections 2024-04-02T07:33:22.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.692+0000 7f7deb400640 1 --2- 172.21.15.55:0/3096010259 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7de4157000 0x7f7de414d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:22.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.692+0000 7f7deb400640 1 --2- 172.21.15.55:0/3096010259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7de4072130 0x7f7de41502b0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:22.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.692+0000 7f7deb400640 1 --2- 172.21.15.55:0/3096010259 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7dc4066690 0x7f7dc4068b50 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:22.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.692+0000 7f7deb400640 1 --2- 172.21.15.55:0/3096010259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7de406a2d0 0x7f7de4156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:22.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.692+0000 7f7deb400640 1 -- 172.21.15.55:0/3096010259 >> 172.21.15.55:0/3096010259 conn(0x7f7de40b13b0 msgr2=0x7f7de40b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:22.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.692+0000 7f7deb400640 1 -- 172.21.15.55:0/3096010259 shutdown_connections 2024-04-02T07:33:22.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:22.692+0000 7f7deb400640 1 -- 172.21.15.55:0/3096010259 wait complete. 2024-04-02T07:33:22.715 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-02T07:33:22.715 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:33:22.798 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:33:22.897 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-02T07:33:22.897 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:33:22.897 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:33:22.906 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:33:22.907 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:33:22.907 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:33:22.915 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:33:22.916 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:33:22.916 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:33:22.956 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:33:22.956 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:33:22.956 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:33:22.966 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:33:22.966 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-04-02T07:33:22.966 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:33:23.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.136+0000 7f3b66e00640 1 Processor -- start 2024-04-02T07:33:23.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.136+0000 7f3b66e00640 1 -- start start 2024-04-02T07:33:23.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.140+0000 7f3b66e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b600cfdf0 0x7f3b6006b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:23.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.140+0000 7f3b66e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3b600b16e0 0x7f3b600b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:23.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.140+0000 7f3b66e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b600d01d0 con 0x7f3b600b11f0 2024-04-02T07:33:23.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.140+0000 7f3b66e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b6006c0e0 con 0x7f3b600b16e0 2024-04-02T07:33:23.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.140+0000 7f3b66e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b600b01d0 con 0x7f3b600cfdf0 2024-04-02T07:33:23.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.140+0000 7f3b57400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3b600b16e0 0x7f3b600b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:23.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.140+0000 7f3b5fe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b600cfdf0 0x7f3b6006b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:23.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.140+0000 7f3b57400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3b600b16e0 0x7f3b600b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:46276/0 (socket says 172.21.15.55:46276) 2024-04-02T07:33:23.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.140+0000 7f3b57400640 1 -- 172.21.15.55:0/310661812 learned_addr learned my addr 172.21.15.55:0/310661812 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:23.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.140+0000 7f3b5fe00640 1 --2- 172.21.15.55:0/310661812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b600cfdf0 0x7f3b6006b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:59880/0 (socket says 172.21.15.55:59880) 2024-04-02T07:33:23.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.140+0000 7f3b57400640 1 -- 172.21.15.55:0/310661812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b600cfdf0 msgr2=0x7f3b6006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:23.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.140+0000 7f3b57400640 1 --2- 172.21.15.55:0/310661812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b600cfdf0 0x7f3b6006b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:23.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.140+0000 7f3b57400640 1 -- 172.21.15.55:0/310661812 >> v1:172.21.15.106:6789/0 conn(0x7f3b600b11f0 legacy=0x7f3b60098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:23.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.140+0000 7f3b57400640 1 -- 172.21.15.55:0/310661812 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b600b04b0 con 0x7f3b600b16e0 2024-04-02T07:33:23.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.140+0000 7f3b5fe00640 1 --2- 172.21.15.55:0/310661812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b600cfdf0 0x7f3b6006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:33:23.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b57400640 1 --2- 172.21.15.55:0/310661812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b600b16e0 0x7f3b600b0cb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009870 tx=0x7f3b4801c530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e5d20c09eae456c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:23.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b5f400640 1 -- 172.21.15.55:0/310661812 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b480aa670 con 0x7f3b600b16e0 2024-04-02T07:33:23.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b5f400640 1 -- 172.21.15.55:0/310661812 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b480aa7d0 con 0x7f3b600b16e0 2024-04-02T07:33:23.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b5f400640 1 -- 172.21.15.55:0/310661812 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b480aab60 con 0x7f3b600b16e0 2024-04-02T07:33:23.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b66e00640 1 -- 172.21.15.55:0/310661812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b600b16e0 msgr2=0x7f3b600b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:23.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b66e00640 1 --2- 172.21.15.55:0/310661812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b600b16e0 0x7f3b600b0cb0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3b48009870 tx=0x7f3b4801c530 comp rx=0 tx=0).stop 2024-04-02T07:33:23.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b66e00640 1 -- 172.21.15.55:0/310661812 shutdown_connections 2024-04-02T07:33:23.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b66e00640 1 --2- 172.21.15.55:0/310661812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b600b16e0 0x7f3b600b0cb0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:23.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b66e00640 1 --2- 172.21.15.55:0/310661812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b600cfdf0 0x7f3b6006b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:23.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b66e00640 1 -- 172.21.15.55:0/310661812 >> 172.21.15.55:0/310661812 conn(0x7f3b600b2210 msgr2=0x7f3b600b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:23.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b66e00640 1 -- 172.21.15.55:0/310661812 shutdown_connections 2024-04-02T07:33:23.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b66e00640 1 -- 172.21.15.55:0/310661812 wait complete. 2024-04-02T07:33:23.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b66e00640 1 Processor -- start 2024-04-02T07:33:23.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b66e00640 1 -- start start 2024-04-02T07:33:23.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b66e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b600b11f0 0x7f3b601517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:23.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b66e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b600b16e0 0x7f3b600b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:23.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b66e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b600cfdf0 0x7f3b6015a850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:23.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b66e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b60151d20 con 0x7f3b600cfdf0 2024-04-02T07:33:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b66e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b600c42d0 con 0x7f3b600b16e0 2024-04-02T07:33:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b66e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b600b3c20 con 0x7f3b600b11f0 2024-04-02T07:33:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.144+0000 7f3b64e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b600cfdf0 0x7f3b6015a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.148+0000 7f3b64e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b600cfdf0 0x7f3b6015a850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52862/0 (socket says 172.21.15.55:52862) 2024-04-02T07:33:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.148+0000 7f3b64e00640 1 -- 172.21.15.55:0/4281866834 learned_addr learned my addr 172.21.15.55:0/4281866834 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.148+0000 7f3b57400640 1 --2- 172.21.15.55:0/4281866834 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b600b16e0 0x7f3b600b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.148+0000 7f3b5fe00640 1 --2- 172.21.15.55:0/4281866834 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b600b11f0 0x7f3b601517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.148+0000 7f3b64e00640 1 -- 172.21.15.55:0/4281866834 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b600b11f0 msgr2=0x7f3b601517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.148+0000 7f3b64e00640 1 --2- 172.21.15.55:0/4281866834 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b600b11f0 0x7f3b601517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.148+0000 7f3b64e00640 1 -- 172.21.15.55:0/4281866834 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b600b16e0 msgr2=0x7f3b600b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.148+0000 7f3b64e00640 1 --2- 172.21.15.55:0/4281866834 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b600b16e0 0x7f3b600b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:23.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.148+0000 7f3b64e00640 1 -- 172.21.15.55:0/4281866834 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b50009420 con 0x7f3b600cfdf0 2024-04-02T07:33:23.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.148+0000 7f3b64e00640 1 --2- 172.21.15.55:0/4281866834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b600cfdf0 0x7f3b6015a850 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f3b5800c760 tx=0x7f3b5800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:23.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.148+0000 7f3b5cc00640 1 -- 172.21.15.55:0/4281866834 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b58003b80 con 0x7f3b600cfdf0 2024-04-02T07:33:23.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.148+0000 7f3b5cc00640 1 -- 172.21.15.55:0/4281866834 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b58003ce0 con 0x7f3b600cfdf0 2024-04-02T07:33:23.150 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.148+0000 7f3b5cc00640 1 -- 172.21.15.55:0/4281866834 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5800aa30 con 0x7f3b600cfdf0 2024-04-02T07:33:23.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.148+0000 7f3b66e00640 1 -- 172.21.15.55:0/4281866834 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b480094d0 con 0x7f3b600cfdf0 2024-04-02T07:33:23.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.148+0000 7f3b66e00640 1 -- 172.21.15.55:0/4281866834 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b600c4820 con 0x7f3b600cfdf0 2024-04-02T07:33:23.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.148+0000 7f3b66e00640 1 -- 172.21.15.55:0/4281866834 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b600c4a40 con 0x7f3b600cfdf0 2024-04-02T07:33:23.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.148+0000 7f3b5cc00640 1 -- 172.21.15.55:0/4281866834 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3b5800ab90 con 0x7f3b600cfdf0 2024-04-02T07:33:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.148+0000 7f3b5cc00640 1 --2- 172.21.15.55:0/4281866834 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3b3c066690 0x7f3b3c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.148+0000 7f3b5cc00640 1 -- 172.21.15.55:0/4281866834 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(107..107 src has 1..107) v4 ==== 5029+0+0 (secure 0 0 0) 0x7f3b580839e0 con 0x7f3b600cfdf0 2024-04-02T07:33:23.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.152+0000 7f3b5fe00640 1 --2- 172.21.15.55:0/4281866834 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3b3c066690 0x7f3b3c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:23.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.152+0000 7f3b5fe00640 1 --2- 172.21.15.55:0/4281866834 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3b3c066690 0x7f3b3c068b50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3b50009c50 tx=0x7f3b50009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:23.156 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.152+0000 7f3b5cc00640 1 -- 172.21.15.55:0/4281866834 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3b580510a0 con 0x7f3b600cfdf0 2024-04-02T07:33:23.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.352+0000 7f3b66e00640 1 -- 172.21.15.55:0/4281866834 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3b600d01d0 con 0x7f3b600cfdf0 2024-04-02T07:33:23.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.352+0000 7f3b5cc00640 1 -- 172.21.15.55:0/4281866834 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 91 v91) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f3b600d01d0 con 0x7f3b600cfdf0 2024-04-02T07:33:23.354 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:23.354 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":91,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7097,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2707651793","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":2707651793},{"type":"v1","addr":"172.21.15.106:6836","nonce":2707651793}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":7912,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/2234384639","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2234384639},{"type":"v1","addr":"172.21.15.106:6837","nonce":2234384639}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":8433,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6833/53259218","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":53259218},{"type":"v1","addr":"172.21.15.55:6833","nonce":53259218}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":76},{"gid":9018,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/4241257205","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6834","nonce":4241257205},{"type":"v1","addr":"172.21.15.55:6835","nonce":4241257205}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":89}],"filesystems":[]} 2024-04-02T07:33:23.354 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 91 2024-04-02T07:33:23.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.352+0000 7f3b66e00640 1 -- 172.21.15.55:0/4281866834 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3b3c066690 msgr2=0x7f3b3c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:23.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.352+0000 7f3b66e00640 1 --2- 172.21.15.55:0/4281866834 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3b3c066690 0x7f3b3c068b50 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f3b50009c50 tx=0x7f3b50009190 comp rx=0 tx=0).stop 2024-04-02T07:33:23.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.352+0000 7f3b66e00640 1 -- 172.21.15.55:0/4281866834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b600cfdf0 msgr2=0x7f3b6015a850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:23.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.352+0000 7f3b66e00640 1 --2- 172.21.15.55:0/4281866834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b600cfdf0 0x7f3b6015a850 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f3b5800c760 tx=0x7f3b5800cc20 comp rx=0 tx=0).stop 2024-04-02T07:33:23.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.352+0000 7f3b66e00640 1 -- 172.21.15.55:0/4281866834 shutdown_connections 2024-04-02T07:33:23.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.352+0000 7f3b66e00640 1 --2- 172.21.15.55:0/4281866834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3b600cfdf0 0x7f3b6015a850 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:23.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.352+0000 7f3b66e00640 1 --2- 172.21.15.55:0/4281866834 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3b3c066690 0x7f3b3c068b50 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:23.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.352+0000 7f3b66e00640 1 --2- 172.21.15.55:0/4281866834 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3b600b16e0 0x7f3b600b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:23.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.352+0000 7f3b66e00640 1 --2- 172.21.15.55:0/4281866834 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3b600b11f0 0x7f3b601517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:23.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.352+0000 7f3b66e00640 1 -- 172.21.15.55:0/4281866834 >> 172.21.15.55:0/4281866834 conn(0x7f3b600b2210 msgr2=0x7f3b600ad4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:23.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.352+0000 7f3b66e00640 1 -- 172.21.15.55:0/4281866834 shutdown_connections 2024-04-02T07:33:23.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.352+0000 7f3b66e00640 1 -- 172.21.15.55:0/4281866834 wait complete. 2024-04-02T07:33:23.375 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-02T07:33:23.375 INFO:tasks.ceph.mds.a:Stopping old one... 2024-04-02T07:33:23.375 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-02T07:33:23.375 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:33:23.376 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-02T07:33:23.376 INFO:tasks.ceph.mds.c:Stopping old one... 2024-04-02T07:33:23.376 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-02T07:33:23.376 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:33:23.376 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-02T07:33:23.376 INFO:tasks.ceph.mds.b:Stopping old one... 2024-04-02T07:33:23.376 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-02T07:33:23.376 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:33:23.377 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-02T07:33:23.377 INFO:tasks.ceph.mds.d:Stopping old one... 2024-04-02T07:33:23.377 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-02T07:33:23.377 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:33:23.390 INFO:tasks.ceph.mds.c:Stopped 2024-04-02T07:33:23.390 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-02T07:33:23.391 INFO:tasks.ceph.mds.a:Stopped 2024-04-02T07:33:23.391 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-02T07:33:23.393 INFO:tasks.ceph.mds.b:Stopped 2024-04-02T07:33:23.393 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-02T07:33:23.394 INFO:tasks.ceph.mds.d:Stopped 2024-04-02T07:33:23.394 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-02T07:33:23.435 INFO:tasks.ceph.mds.c:Started 2024-04-02T07:33:23.435 DEBUG:teuthology.parallel:result is None 2024-04-02T07:33:23.436 INFO:tasks.ceph.mds.a:Started 2024-04-02T07:33:23.437 DEBUG:teuthology.parallel:result is None 2024-04-02T07:33:23.440 INFO:tasks.ceph.mds.b:Started 2024-04-02T07:33:23.441 DEBUG:teuthology.parallel:result is None 2024-04-02T07:33:23.443 INFO:tasks.ceph.mds.d:Started 2024-04-02T07:33:23.443 DEBUG:teuthology.parallel:result is None 2024-04-02T07:33:23.443 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-04-02T07:33:23.522 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2024-04-02T07:33:23.523 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-02T07:33:23.530 INFO:tasks.ceph.mds.d.smithi106.stdout:starting mds.d at 2024-04-02T07:33:23.530 INFO:tasks.ceph.mds.b.smithi106.stdout:starting mds.b at 2024-04-02T07:33:23.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.596+0000 7fdf45000640 1 Processor -- start 2024-04-02T07:33:23.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.596+0000 7fdf45000640 1 -- start start 2024-04-02T07:33:23.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.596+0000 7fdf45000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdf40157110 0x7fdf4015cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:23.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.596+0000 7fdf45000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf40160570 0x7fdf400b1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:23.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.596+0000 7fdf45000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf400b1ec0 con 0x7fdf400b39d0 2024-04-02T07:33:23.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.596+0000 7fdf45000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf40160a00 con 0x7fdf40157110 2024-04-02T07:33:23.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.596+0000 7fdf45000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf40160ce0 con 0x7fdf40160570 2024-04-02T07:33:23.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.596+0000 7fdf37e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf40160570 0x7fdf400b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:23.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.596+0000 7fdf3de00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdf40157110 0x7fdf4015cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:23.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.596+0000 7fdf37e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf40160570 0x7fdf400b1980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:59912/0 (socket says 172.21.15.55:59912) 2024-04-02T07:33:23.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.596+0000 7fdf37e00640 1 -- 172.21.15.55:0/1128302325 learned_addr learned my addr 172.21.15.55:0/1128302325 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:23.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.596+0000 7fdf37e00640 1 -- 172.21.15.55:0/1128302325 >> v2:172.21.15.106:3300/0 conn(0x7fdf40157110 msgr2=0x7fdf4015cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:23.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.596+0000 7fdf37e00640 1 --2- 172.21.15.55:0/1128302325 >> v2:172.21.15.106:3300/0 conn(0x7fdf40157110 0x7fdf4015cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:23.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.596+0000 7fdf37e00640 1 -- 172.21.15.55:0/1128302325 >> v1:172.21.15.106:6789/0 conn(0x7fdf400b39d0 legacy=0x7fdf400cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:23.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.596+0000 7fdf37e00640 1 -- 172.21.15.55:0/1128302325 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf40160fc0 con 0x7fdf40160570 2024-04-02T07:33:23.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.600+0000 7fdf37e00640 1 --2- 172.21.15.55:0/1128302325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf40160570 0x7fdf400b1980 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009870 tx=0x7fdf2801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89a01c16b6a9fab7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:23.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.600+0000 7fdf3d400640 1 -- 172.21.15.55:0/1128302325 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf280a9640 con 0x7fdf40160570 2024-04-02T07:33:23.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.600+0000 7fdf3d400640 1 -- 172.21.15.55:0/1128302325 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf280a97a0 con 0x7fdf40160570 2024-04-02T07:33:23.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.600+0000 7fdf3d400640 1 -- 172.21.15.55:0/1128302325 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf280a9b30 con 0x7fdf40160570 2024-04-02T07:33:23.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.600+0000 7fdf45000640 1 -- 172.21.15.55:0/1128302325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf40160570 msgr2=0x7fdf400b1980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.600+0000 7fdf45000640 1 --2- 172.21.15.55:0/1128302325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf40160570 0x7fdf400b1980 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fdf28009870 tx=0x7fdf2801c560 comp rx=0 tx=0).stop 2024-04-02T07:33:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.600+0000 7fdf45000640 1 -- 172.21.15.55:0/1128302325 shutdown_connections 2024-04-02T07:33:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.600+0000 7fdf45000640 1 --2- 172.21.15.55:0/1128302325 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf40160570 0x7fdf400b1980 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.600+0000 7fdf45000640 1 --2- 172.21.15.55:0/1128302325 >> v2:172.21.15.106:3300/0 conn(0x7fdf40157110 0x7fdf4015cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.600+0000 7fdf45000640 1 -- 172.21.15.55:0/1128302325 >> 172.21.15.55:0/1128302325 conn(0x7fdf400cb3d0 msgr2=0x7fdf400cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.600+0000 7fdf45000640 1 -- 172.21.15.55:0/1128302325 shutdown_connections 2024-04-02T07:33:23.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.600+0000 7fdf45000640 1 -- 172.21.15.55:0/1128302325 wait complete. 2024-04-02T07:33:23.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf45000640 1 Processor -- start 2024-04-02T07:33:23.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf45000640 1 -- start start 2024-04-02T07:33:23.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf45000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf400b39d0 0x7fdf4006ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:23.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf45000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf40157110 0x7fdf4014e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:23.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf45000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf4014e9f0 0x7fdf4015b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:23.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf45000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4015b090 con 0x7fdf4014e9f0 2024-04-02T07:33:23.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf45000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf4014e2b0 con 0x7fdf400b39d0 2024-04-02T07:33:23.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf45000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf400af260 con 0x7fdf40157110 2024-04-02T07:33:23.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf3e800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf4014e9f0 0x7fdf4015b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:23.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf3e800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf4014e9f0 0x7fdf4015b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52912/0 (socket says 172.21.15.55:52912) 2024-04-02T07:33:23.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf3e800640 1 -- 172.21.15.55:0/31315037 learned_addr learned my addr 172.21.15.55:0/31315037 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:23.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf37e00640 1 --2- 172.21.15.55:0/31315037 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf40157110 0x7fdf4014e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:23.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf3de00640 1 --2- 172.21.15.55:0/31315037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf400b39d0 0x7fdf4006ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:23.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf3e800640 1 -- 172.21.15.55:0/31315037 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf40157110 msgr2=0x7fdf4014e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:23.607 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf3e800640 1 --2- 172.21.15.55:0/31315037 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf40157110 0x7fdf4014e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:23.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf3e800640 1 -- 172.21.15.55:0/31315037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf400b39d0 msgr2=0x7fdf4006ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:23.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf3e800640 1 --2- 172.21.15.55:0/31315037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf400b39d0 0x7fdf4006ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:23.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf3e800640 1 -- 172.21.15.55:0/31315037 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf280094d0 con 0x7fdf4014e9f0 2024-04-02T07:33:23.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf37e00640 1 --2- 172.21.15.55:0/31315037 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf40157110 0x7fdf4014e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:33:23.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf3e800640 1 --2- 172.21.15.55:0/31315037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf4014e9f0 0x7fdf4015b4b0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800c7a0 tx=0x7fdf3800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:23.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf36000640 1 -- 172.21.15.55:0/31315037 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf38003b80 con 0x7fdf4014e9f0 2024-04-02T07:33:23.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf36000640 1 -- 172.21.15.55:0/31315037 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf38003ce0 con 0x7fdf4014e9f0 2024-04-02T07:33:23.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf45000640 1 -- 172.21.15.55:0/31315037 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf400af540 con 0x7fdf4014e9f0 2024-04-02T07:33:23.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf36000640 1 -- 172.21.15.55:0/31315037 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3800aa30 con 0x7fdf4014e9f0 2024-04-02T07:33:23.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.604+0000 7fdf45000640 1 -- 172.21.15.55:0/31315037 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf4015acb0 con 0x7fdf4014e9f0 2024-04-02T07:33:23.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.608+0000 7fdf45000640 1 -- 172.21.15.55:0/31315037 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf400afa60 con 0x7fdf4014e9f0 2024-04-02T07:33:23.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.608+0000 7fdf36000640 1 -- 172.21.15.55:0/31315037 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fdf3800ab90 con 0x7fdf4014e9f0 2024-04-02T07:33:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.608+0000 7fdf36000640 1 --2- 172.21.15.55:0/31315037 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf1c066690 0x7fdf1c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.608+0000 7fdf36000640 1 -- 172.21.15.55:0/31315037 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5029+0+0 (secure 0 0 0) 0x7fdf38083c90 con 0x7fdf4014e9f0 2024-04-02T07:33:23.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.608+0000 7fdf3de00640 1 --2- 172.21.15.55:0/31315037 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf1c066690 0x7fdf1c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:23.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.608+0000 7fdf3de00640 1 --2- 172.21.15.55:0/31315037 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf1c066690 0x7fdf1c068b50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fdf30009b60 tx=0x7fdf30009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:23.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.612+0000 7fdf36000640 1 -- 172.21.15.55:0/31315037 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fdf400afa60 con 0x7fdf4014e9f0 2024-04-02T07:33:23.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:23.788+0000 7fdf45000640 1 -- 172.21.15.55:0/31315037 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fdf4015ab10 con 0x7fdf4014e9f0 2024-04-02T07:33:24.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.560+0000 7fdf36000640 1 -- 172.21.15.55:0/31315037 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v112) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdf4015ab10 con 0x7fdf4014e9f0 2024-04-02T07:33:24.564 INFO:teuthology.orchestra.run.smithi055.stderr: removed all blocklist entries 2024-04-02T07:33:24.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.564+0000 7fdf45000640 1 -- 172.21.15.55:0/31315037 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf1c066690 msgr2=0x7fdf1c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:24.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.564+0000 7fdf45000640 1 --2- 172.21.15.55:0/31315037 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf1c066690 0x7fdf1c068b50 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fdf30009b60 tx=0x7fdf30009190 comp rx=0 tx=0).stop 2024-04-02T07:33:24.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.564+0000 7fdf45000640 1 -- 172.21.15.55:0/31315037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf4014e9f0 msgr2=0x7fdf4015b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:24.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.564+0000 7fdf45000640 1 --2- 172.21.15.55:0/31315037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf4014e9f0 0x7fdf4015b4b0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800c7a0 tx=0x7fdf3800cc60 comp rx=0 tx=0).stop 2024-04-02T07:33:24.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.564+0000 7fdf45000640 1 -- 172.21.15.55:0/31315037 shutdown_connections 2024-04-02T07:33:24.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.564+0000 7fdf45000640 1 --2- 172.21.15.55:0/31315037 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf4014e9f0 0x7fdf4015b4b0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:24.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.564+0000 7fdf45000640 1 --2- 172.21.15.55:0/31315037 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdf40157110 0x7fdf4014e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:24.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.564+0000 7fdf45000640 1 --2- 172.21.15.55:0/31315037 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdf1c066690 0x7fdf1c068b50 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:24.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.564+0000 7fdf45000640 1 --2- 172.21.15.55:0/31315037 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdf400b39d0 0x7fdf4006ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:24.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.564+0000 7fdf45000640 1 -- 172.21.15.55:0/31315037 >> 172.21.15.55:0/31315037 conn(0x7fdf400cb3d0 msgr2=0x7fdf4006dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:24.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.564+0000 7fdf45000640 1 -- 172.21.15.55:0/31315037 shutdown_connections 2024-04-02T07:33:24.567 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.564+0000 7fdf45000640 1 -- 172.21.15.55:0/31315037 wait complete. 2024-04-02T07:33:24.590 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-04-02T07:33:24.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.732+0000 7f5fac200640 1 Processor -- start 2024-04-02T07:33:24.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.732+0000 7f5fac200640 1 -- start start 2024-04-02T07:33:24.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.732+0000 7f5fac200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5fa415cbe0 0x7f5fa40ce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:24.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.732+0000 7f5fac200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa406d5b0 con 0x7f5fa4070a80 2024-04-02T07:33:24.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.732+0000 7f5fac200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fa406cc80 con 0x7f5fa4065d20 2024-04-02T07:33:24.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.732+0000 7f5fac200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fa40cec10 con 0x7f5fa415cbe0 2024-04-02T07:33:24.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.732+0000 7f5faa200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5fa4070a80 0x7f5fa406da40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37674/0 (socket says 172.21.15.55:37674) 2024-04-02T07:33:24.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.732+0000 7f5faa200640 1 -- 172.21.15.55:0/1029168787 learned_addr learned my addr 172.21.15.55:0/1029168787 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:24.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.732+0000 7f5fa9800640 1 --2- 172.21.15.55:0/1029168787 >> v2:172.21.15.106:3300/0 conn(0x7f5fa415cbe0 0x7f5fa40ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:24.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.736+0000 7f5fa3e00640 1 -- 172.21.15.55:0/1029168787 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2655216487 0 0) 0x7f5fa406d5b0 con 0x7f5fa4070a80 2024-04-02T07:33:24.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.736+0000 7f5fa3e00640 1 -- 172.21.15.55:0/1029168787 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f8c003530 con 0x7f5fa4070a80 2024-04-02T07:33:24.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.736+0000 7f5fa3e00640 1 -- 172.21.15.55:0/1029168787 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611383899 0 0) 0x7f5fa406cc80 con 0x7f5fa4065d20 2024-04-02T07:33:24.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.736+0000 7f5fa3e00640 1 -- 172.21.15.55:0/1029168787 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fa406d5b0 con 0x7f5fa4065d20 2024-04-02T07:33:24.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.736+0000 7f5fa9800640 1 -- 172.21.15.55:0/1029168787 >> v1:172.21.15.106:6789/0 conn(0x7f5fa4065d20 legacy=0x7f5fa40b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:24.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.736+0000 7f5fa9800640 1 -- 172.21.15.55:0/1029168787 >> v1:172.21.15.55:6789/0 conn(0x7f5fa4070a80 legacy=0x7f5fa406da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:24.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.736+0000 7f5fa9800640 1 -- 172.21.15.55:0/1029168787 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fa406cf60 con 0x7f5fa415cbe0 2024-04-02T07:33:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.736+0000 7f5fa9800640 1 --2- 172.21.15.55:0/1029168787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fa415cbe0 0x7f5fa40ce630 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f5f980097c0 tx=0x7f5f9801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae032445687acc46 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.736+0000 7f5fa3e00640 1 -- 172.21.15.55:0/1029168787 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f980ab600 con 0x7f5fa415cbe0 2024-04-02T07:33:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.736+0000 7f5fa3e00640 1 -- 172.21.15.55:0/1029168787 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f980a7050 con 0x7f5fa415cbe0 2024-04-02T07:33:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.736+0000 7f5fa3e00640 1 -- 172.21.15.55:0/1029168787 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f980ab960 con 0x7f5fa415cbe0 2024-04-02T07:33:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5fac200640 1 -- 172.21.15.55:0/1029168787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fa415cbe0 msgr2=0x7f5fa40ce630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5fac200640 1 --2- 172.21.15.55:0/1029168787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fa415cbe0 0x7f5fa40ce630 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f5f980097c0 tx=0x7f5f9801c4a0 comp rx=0 tx=0).stop 2024-04-02T07:33:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5fac200640 1 -- 172.21.15.55:0/1029168787 shutdown_connections 2024-04-02T07:33:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5fac200640 1 --2- 172.21.15.55:0/1029168787 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fa415cbe0 0x7f5fa40ce630 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5fac200640 1 -- 172.21.15.55:0/1029168787 >> 172.21.15.55:0/1029168787 conn(0x7f5fa40ced50 msgr2=0x7f5fa40cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5fac200640 1 -- 172.21.15.55:0/1029168787 shutdown_connections 2024-04-02T07:33:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5fac200640 1 -- 172.21.15.55:0/1029168787 wait complete. 2024-04-02T07:33:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5fac200640 1 Processor -- start 2024-04-02T07:33:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5fac200640 1 -- start start 2024-04-02T07:33:24.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5fac200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fa4065d20 0x7f5fa413a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:24.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5fac200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fa4070a80 0x7f5fa40cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:24.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5fac200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa415cbe0 0x7f5fa40ce020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:24.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5fac200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa414c080 con 0x7f5fa415cbe0 2024-04-02T07:33:24.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5fac200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa414ef00 con 0x7f5fa4070a80 2024-04-02T07:33:24.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5fac200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fa414c320 con 0x7f5fa4065d20 2024-04-02T07:33:24.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5faa200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa415cbe0 0x7f5fa40ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:24.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5faa200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa415cbe0 0x7f5fa40ce020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52922/0 (socket says 172.21.15.55:52922) 2024-04-02T07:33:24.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5faa200640 1 -- 172.21.15.55:0/678029336 learned_addr learned my addr 172.21.15.55:0/678029336 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5faa200640 1 -- 172.21.15.55:0/678029336 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fa4065d20 msgr2=0x7f5fa413a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5fa9800640 1 --2- 172.21.15.55:0/678029336 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fa4065d20 0x7f5fa413a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5faa200640 1 --2- 172.21.15.55:0/678029336 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fa4065d20 0x7f5fa413a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5fa8e00640 1 --2- 172.21.15.55:0/678029336 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fa4070a80 0x7f5fa40cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5faa200640 1 -- 172.21.15.55:0/678029336 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fa4070a80 msgr2=0x7f5fa40cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.740+0000 7f5faa200640 1 --2- 172.21.15.55:0/678029336 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fa4070a80 0x7f5fa40cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.744+0000 7f5faa200640 1 -- 172.21.15.55:0/678029336 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f98009420 con 0x7f5fa415cbe0 2024-04-02T07:33:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.744+0000 7f5fa9800640 1 --2- 172.21.15.55:0/678029336 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fa4065d20 0x7f5fa413a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.744+0000 7f5fa8e00640 1 --2- 172.21.15.55:0/678029336 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fa4070a80 0x7f5fa40cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.744+0000 7f5faa200640 1 --2- 172.21.15.55:0/678029336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa415cbe0 0x7f5fa40ce020 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c00cbc0 tx=0x7f5f9c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.744+0000 7f5fa1600640 1 -- 172.21.15.55:0/678029336 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c00ace0 con 0x7f5fa415cbe0 2024-04-02T07:33:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.744+0000 7f5fa1600640 1 -- 172.21.15.55:0/678029336 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f9c00ae40 con 0x7f5fa415cbe0 2024-04-02T07:33:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.744+0000 7f5fa1600640 1 -- 172.21.15.55:0/678029336 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f9c012600 con 0x7f5fa415cbe0 2024-04-02T07:33:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.744+0000 7f5fac200640 1 -- 172.21.15.55:0/678029336 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fa4071420 con 0x7f5fa415cbe0 2024-04-02T07:33:24.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.744+0000 7f5fac200640 1 -- 172.21.15.55:0/678029336 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fa414f1e0 con 0x7f5fa415cbe0 2024-04-02T07:33:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.744+0000 7f5fac200640 1 -- 172.21.15.55:0/678029336 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fa4066c90 con 0x7f5fa415cbe0 2024-04-02T07:33:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.744+0000 7f5fa1600640 1 -- 172.21.15.55:0/678029336 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5f9c012820 con 0x7f5fa415cbe0 2024-04-02T07:33:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.744+0000 7f5fa1600640 1 --2- 172.21.15.55:0/678029336 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5f84066690 0x7f5f84068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.744+0000 7f5fa1600640 1 -- 172.21.15.55:0/678029336 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5f9c083da0 con 0x7f5fa415cbe0 2024-04-02T07:33:24.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.744+0000 7f5fa9800640 1 --2- 172.21.15.55:0/678029336 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5f84066690 0x7f5f84068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:24.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.748+0000 7f5fa9800640 1 --2- 172.21.15.55:0/678029336 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5f84066690 0x7f5f84068b50 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5f980ad000 tx=0x7f5f98008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:24.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.748+0000 7f5fa1600640 1 -- 172.21.15.55:0/678029336 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5f9c051470 con 0x7f5fa415cbe0 2024-04-02T07:33:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.968+0000 7f5fac200640 1 -- 172.21.15.55:0/678029336 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f5fa414c7d0 con 0x7f5fa415cbe0 2024-04-02T07:33:24.969 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.968+0000 7f5fa1600640 1 -- 172.21.15.55:0/678029336 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f5f9c054a90 con 0x7f5fa415cbe0 2024-04-02T07:33:24.969 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:24.969 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:33:24.969 INFO:teuthology.orchestra.run.smithi055.stdout: "auth_dump": [ 2024-04-02T07:33:24.970 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:24.970 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.a", 2024-04-02T07:33:24.970 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFL1DHxAAuUs47l42sADNRgxi4BeNrA==", 2024-04-02T07:33:24.970 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:33:24.970 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:33:24.970 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:33:24.970 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:33:24.970 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:33:24.970 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:24.970 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:24.970 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:24.970 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.b", 2024-04-02T07:33:24.970 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFZB+KxAAeKnfP4Z1UkLura+bQrG5mA==", 2024-04-02T07:33:24.970 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:33:24.971 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:33:24.971 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:33:24.971 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:33:24.971 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:33:24.971 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:24.971 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:24.971 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:24.971 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.c", 2024-04-02T07:33:24.971 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmUQR/JhAA9LNK5gHJ1NiiqNrfxL4mIA==", 2024-04-02T07:33:24.971 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:33:24.971 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:33:24.971 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:33:24.971 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:33:24.971 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:33:24.971 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:24.972 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:24.972 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:24.972 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mds.d", 2024-04-02T07:33:24.972 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmotumMhAASI1PogpVSHXWIv9xq3qs4Q==", 2024-04-02T07:33:24.972 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:33:24.972 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:33:24.972 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:33:24.972 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:33:24.972 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:33:24.972 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:24.972 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:24.972 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:24.972 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.0", 2024-04-02T07:33:24.972 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDysQtmsM9JIxAAZNjTGYW74kqz5NM9NyPSWQ==", 2024-04-02T07:33:24.972 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:33:24.973 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:33:24.973 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:33:24.973 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:33:24.973 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:24.973 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:24.973 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:24.973 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.1", 2024-04-02T07:33:24.973 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD1sQtmJaorKhAAtujPXPmQVX3QUG1ANqEphQ==", 2024-04-02T07:33:24.973 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:33:24.973 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:33:24.973 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:33:24.973 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:33:24.973 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:24.973 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:24.973 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:24.974 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.2", 2024-04-02T07:33:24.974 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD4sQtm1fdwMhAAOxlYwaBnPKhSQODMLVbaSQ==", 2024-04-02T07:33:24.974 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:33:24.974 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:33:24.974 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:33:24.974 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:33:24.974 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:24.974 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:24.974 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:24.974 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.3", 2024-04-02T07:33:24.974 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQD7sQtmo9OaORAAsjpiVkG9vZV1QxpvgbrFmg==", 2024-04-02T07:33:24.974 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:33:24.974 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:33:24.974 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:33:24.974 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:33:24.975 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:24.975 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:24.975 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:24.975 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.4", 2024-04-02T07:33:24.975 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQACsgtmTyOkAxAARfxuj/YCM6FWNDhCkLQV3g==", 2024-04-02T07:33:24.975 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:33:24.975 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:33:24.975 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:33:24.975 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:33:24.975 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:24.975 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:24.975 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:24.975 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.5", 2024-04-02T07:33:24.975 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAFsgtmimDECRAAh/XVN7rICihc8NlxhDJB6Q==", 2024-04-02T07:33:24.976 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:33:24.976 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:33:24.976 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:33:24.976 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:33:24.976 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:24.976 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:24.976 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:24.976 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.6", 2024-04-02T07:33:24.976 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQAIsgtmreHiDhAAISQbxixad17TRrz7MHQTxA==", 2024-04-02T07:33:24.976 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:33:24.976 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:33:24.976 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:33:24.977 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:33:24.977 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:24.977 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:24.977 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:24.977 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "osd.7", 2024-04-02T07:33:24.977 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQALsgtmHVTlExAAT/6jK+czOZ3+4nwpgZOmow==", 2024-04-02T07:33:24.977 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:33:24.977 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow profile osd", 2024-04-02T07:33:24.977 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile osd", 2024-04-02T07:33:24.977 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:33:24.977 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:24.977 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:24.977 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:24.977 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.0", 2024-04-02T07:33:24.978 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmkS2QNhAAt+q0y1TDn03hqM/Y6uKq6g==", 2024-04-02T07:33:24.978 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:33:24.978 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:33:24.978 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow r", 2024-04-02T07:33:24.978 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-04-02T07:33:24.978 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:24.978 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:24.978 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:24.978 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.1", 2024-04-02T07:33:24.978 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmjCzTBBAAVYyat2dGZSTquRQoB+7JMg==", 2024-04-02T07:33:24.978 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:33:24.978 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:33:24.978 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:33:24.978 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:33:24.978 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:33:24.979 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:24.979 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:24.979 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:24.979 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.2", 2024-04-02T07:33:24.979 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmq45FARAAY6/caSeqvTn7/BThOodYIA==", 2024-04-02T07:33:24.979 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:33:24.979 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:33:24.979 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:33:24.979 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:33:24.979 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:33:24.979 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:24.979 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:24.979 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:24.979 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.3", 2024-04-02T07:33:24.979 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDssQtmmjDeChAAL2RsY5VlAy/KZ5go5ZJoBA==", 2024-04-02T07:33:24.980 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:33:24.980 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow", 2024-04-02T07:33:24.980 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow r", 2024-04-02T07:33:24.980 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow rw", 2024-04-02T07:33:24.980 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow rwx" 2024-04-02T07:33:24.980 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:24.980 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:24.980 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:24.980 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "client.admin", 2024-04-02T07:33:24.980 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtm1hiMAxAAarlHR9VHGrkPCXhksMM/1w==", 2024-04-02T07:33:24.980 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:33:24.980 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:33:24.980 INFO:teuthology.orchestra.run.smithi055.stdout: "mgr": "allow *", 2024-04-02T07:33:24.980 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow *", 2024-04-02T07:33:24.980 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:33:24.980 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:24.981 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:24.981 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:24.981 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.x", 2024-04-02T07:33:24.981 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmFyktGxAAJC7ezewbXwDQue+qjpTfYw==", 2024-04-02T07:33:24.981 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:33:24.981 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:33:24.981 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-02T07:33:24.981 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:33:24.981 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:24.981 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:24.981 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:24.981 INFO:teuthology.orchestra.run.smithi055.stdout: "entity": "mgr.y", 2024-04-02T07:33:24.981 INFO:teuthology.orchestra.run.smithi055.stdout: "key": "AQDrsQtmUcxUFxAA8NUHdxhUfp3/AILMIbS1fw==", 2024-04-02T07:33:24.981 INFO:teuthology.orchestra.run.smithi055.stdout: "caps": { 2024-04-02T07:33:24.981 INFO:teuthology.orchestra.run.smithi055.stdout: "mds": "allow *", 2024-04-02T07:33:24.982 INFO:teuthology.orchestra.run.smithi055.stdout: "mon": "allow profile mgr", 2024-04-02T07:33:24.982 INFO:teuthology.orchestra.run.smithi055.stdout: "osd": "allow *" 2024-04-02T07:33:24.982 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:24.982 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:24.982 INFO:teuthology.orchestra.run.smithi055.stdout: ] 2024-04-02T07:33:24.982 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:33:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.968+0000 7f5fac200640 1 -- 172.21.15.55:0/678029336 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5f84066690 msgr2=0x7f5f84068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.968+0000 7f5fac200640 1 --2- 172.21.15.55:0/678029336 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5f84066690 0x7f5f84068b50 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f5f980ad000 tx=0x7f5f98008040 comp rx=0 tx=0).stop 2024-04-02T07:33:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.968+0000 7f5fac200640 1 -- 172.21.15.55:0/678029336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa415cbe0 msgr2=0x7f5fa40ce020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.968+0000 7f5fac200640 1 --2- 172.21.15.55:0/678029336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa415cbe0 0x7f5fa40ce020 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c00cbc0 tx=0x7f5f9c00a430 comp rx=0 tx=0).stop 2024-04-02T07:33:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.968+0000 7f5fac200640 1 -- 172.21.15.55:0/678029336 shutdown_connections 2024-04-02T07:33:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.968+0000 7f5fac200640 1 --2- 172.21.15.55:0/678029336 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fa415cbe0 0x7f5fa40ce020 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.968+0000 7f5fac200640 1 --2- 172.21.15.55:0/678029336 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5f84066690 0x7f5f84068b50 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.968+0000 7f5fac200640 1 --2- 172.21.15.55:0/678029336 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fa4070a80 0x7f5fa40cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.968+0000 7f5fac200640 1 --2- 172.21.15.55:0/678029336 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fa4065d20 0x7f5fa413a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:24.983 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.968+0000 7f5fac200640 1 -- 172.21.15.55:0/678029336 >> 172.21.15.55:0/678029336 conn(0x7f5fa40ced50 msgr2=0x7f5fa40b3240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:24.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.968+0000 7f5fac200640 1 -- 172.21.15.55:0/678029336 shutdown_connections 2024-04-02T07:33:24.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:24.968+0000 7f5fac200640 1 -- 172.21.15.55:0/678029336 wait complete. 2024-04-02T07:33:24.991 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:33:25.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.132+0000 7f1074c00640 1 Processor -- start 2024-04-02T07:33:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.132+0000 7f1074c00640 1 -- start start 2024-04-02T07:33:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.132+0000 7f1074c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10700b6120 0x7f10700b3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.132+0000 7f1074c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f107006aea0 0x7f1070098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.132+0000 7f1074c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10700cbb60 con 0x7f1070098f50 2024-04-02T07:33:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.132+0000 7f1074c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10700993e0 con 0x7f107006aea0 2024-04-02T07:33:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.132+0000 7f1074c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10700caf50 con 0x7f10700b6120 2024-04-02T07:33:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.132+0000 7f1067e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f107006aea0 0x7f1070098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.132+0000 7f106fe00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1070098f50 0x7f10700cbff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37686/0 (socket says 172.21.15.55:37686) 2024-04-02T07:33:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.132+0000 7f1067e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f107006aea0 0x7f1070098a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52932/0 (socket says 172.21.15.55:52932) 2024-04-02T07:33:25.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.132+0000 7f106fe00640 1 -- 172.21.15.55:0/4155179826 learned_addr learned my addr 172.21.15.55:0/4155179826 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:25.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.132+0000 7f106f400640 1 --2- 172.21.15.55:0/4155179826 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10700b6120 0x7f10700b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:25.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.132+0000 7f1067e00640 1 -- 172.21.15.55:0/4155179826 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10700b6120 msgr2=0x7f10700b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:25.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.132+0000 7f1067e00640 1 --2- 172.21.15.55:0/4155179826 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10700b6120 0x7f10700b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.132+0000 7f1067e00640 1 -- 172.21.15.55:0/4155179826 >> v1:172.21.15.55:6789/0 conn(0x7f1070098f50 legacy=0x7f10700cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:25.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.132+0000 7f1067e00640 1 -- 172.21.15.55:0/4155179826 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10700cb230 con 0x7f107006aea0 2024-04-02T07:33:25.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.132+0000 7f106f400640 1 --2- 172.21.15.55:0/4155179826 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10700b6120 0x7f10700b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:25.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.136+0000 7f1067e00640 1 --2- 172.21.15.55:0/4155179826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f107006aea0 0x7f1070098a10 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f10580097c0 tx=0x7f105801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d137ff2521c316ca server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:25.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.136+0000 7f106ea00640 1 -- 172.21.15.55:0/4155179826 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10580ab670 con 0x7f107006aea0 2024-04-02T07:33:25.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.136+0000 7f106ea00640 1 -- 172.21.15.55:0/4155179826 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10580ab7d0 con 0x7f107006aea0 2024-04-02T07:33:25.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.136+0000 7f106ea00640 1 -- 172.21.15.55:0/4155179826 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10580abb60 con 0x7f107006aea0 2024-04-02T07:33:25.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.136+0000 7f1074c00640 1 -- 172.21.15.55:0/4155179826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f107006aea0 msgr2=0x7f1070098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:25.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.136+0000 7f1074c00640 1 --2- 172.21.15.55:0/4155179826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f107006aea0 0x7f1070098a10 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f10580097c0 tx=0x7f105801c470 comp rx=0 tx=0).stop 2024-04-02T07:33:25.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.136+0000 7f1074c00640 1 -- 172.21.15.55:0/4155179826 shutdown_connections 2024-04-02T07:33:25.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.136+0000 7f1074c00640 1 --2- 172.21.15.55:0/4155179826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f107006aea0 0x7f1070098a10 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.136+0000 7f1074c00640 1 --2- 172.21.15.55:0/4155179826 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10700b6120 0x7f10700b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.136+0000 7f1074c00640 1 -- 172.21.15.55:0/4155179826 >> 172.21.15.55:0/4155179826 conn(0x7f10700b2030 msgr2=0x7f10700b2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:25.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.136+0000 7f1074c00640 1 -- 172.21.15.55:0/4155179826 shutdown_connections 2024-04-02T07:33:25.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.136+0000 7f1074c00640 1 -- 172.21.15.55:0/4155179826 wait complete. 2024-04-02T07:33:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.136+0000 7f1074c00640 1 Processor -- start 2024-04-02T07:33:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.136+0000 7f1074c00640 1 -- start start 2024-04-02T07:33:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f1074c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f107006aea0 0x7f10700c69a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f1074c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1070098f50 0x7f10700c42d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f1074c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10700b6120 0x7f107015a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f1074c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10700b1580 con 0x7f107006aea0 2024-04-02T07:33:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f1074c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10700b1860 con 0x7f1070098f50 2024-04-02T07:33:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f1074c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10700b1b40 con 0x7f10700b6120 2024-04-02T07:33:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f106f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f107006aea0 0x7f10700c69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f106f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f107006aea0 0x7f10700c69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52948/0 (socket says 172.21.15.55:52948) 2024-04-02T07:33:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f106f400640 1 -- 172.21.15.55:0/537936671 learned_addr learned my addr 172.21.15.55:0/537936671 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f1067e00640 1 --2- 172.21.15.55:0/537936671 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1070098f50 0x7f10700c42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f106fe00640 1 --2- 172.21.15.55:0/537936671 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10700b6120 0x7f107015a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f106f400640 1 -- 172.21.15.55:0/537936671 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10700b6120 msgr2=0x7f107015a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f106f400640 1 --2- 172.21.15.55:0/537936671 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10700b6120 0x7f107015a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f106f400640 1 -- 172.21.15.55:0/537936671 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1070098f50 msgr2=0x7f10700c42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f106f400640 1 --2- 172.21.15.55:0/537936671 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1070098f50 0x7f10700c42d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f106f400640 1 -- 172.21.15.55:0/537936671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1058009420 con 0x7f107006aea0 2024-04-02T07:33:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f1067e00640 1 --2- 172.21.15.55:0/537936671 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1070098f50 0x7f10700c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f106fe00640 1 --2- 172.21.15.55:0/537936671 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10700b6120 0x7f107015a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:25.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f106f400640 1 --2- 172.21.15.55:0/537936671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f107006aea0 0x7f10700c69a0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f106000e810 tx=0x7f106000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:25.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f1067400640 1 -- 172.21.15.55:0/537936671 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106000c8d0 con 0x7f107006aea0 2024-04-02T07:33:25.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f1067400640 1 -- 172.21.15.55:0/537936671 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f106000ca30 con 0x7f107006aea0 2024-04-02T07:33:25.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f1067400640 1 -- 172.21.15.55:0/537936671 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f106000cdc0 con 0x7f107006aea0 2024-04-02T07:33:25.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f1074c00640 1 -- 172.21.15.55:0/537936671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10700c61a0 con 0x7f107006aea0 2024-04-02T07:33:25.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f1074c00640 1 -- 172.21.15.55:0/537936671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f107014fb30 con 0x7f107006aea0 2024-04-02T07:33:25.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.140+0000 7f1074c00640 1 -- 172.21.15.55:0/537936671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10700c6ee0 con 0x7f107006aea0 2024-04-02T07:33:25.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.144+0000 7f1067400640 1 -- 172.21.15.55:0/537936671 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1060026430 con 0x7f107006aea0 2024-04-02T07:33:25.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.144+0000 7f1067400640 1 --2- 172.21.15.55:0/537936671 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f104c066690 0x7f104c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:25.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.144+0000 7f1067400640 1 -- 172.21.15.55:0/537936671 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1060084110 con 0x7f107006aea0 2024-04-02T07:33:25.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.144+0000 7f1067e00640 1 --2- 172.21.15.55:0/537936671 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f104c066690 0x7f104c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:25.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.144+0000 7f1067e00640 1 --2- 172.21.15.55:0/537936671 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f104c066690 0x7f104c068b50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f10580af000 tx=0x7f1058008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:25.147 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.144+0000 7f1067400640 1 -- 172.21.15.55:0/537936671 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f10600517b0 con 0x7f107006aea0 2024-04-02T07:33:25.309 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.308+0000 7f1074c00640 1 -- 172.21.15.55:0/537936671 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1070073fa0 con 0x7f107006aea0 2024-04-02T07:33:25.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.308+0000 7f1067400640 1 -- 172.21.15.55:0/537936671 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+12399 (secure 0 0 0) 0x7f1060009480 con 0x7f107006aea0 2024-04-02T07:33:25.310 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:25.311 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":112,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:33:24.561228+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":101,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:33:25.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.312+0000 7f1074c00640 1 -- 172.21.15.55:0/537936671 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f104c066690 msgr2=0x7f104c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:25.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.312+0000 7f1074c00640 1 --2- 172.21.15.55:0/537936671 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f104c066690 0x7f104c068b50 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f10580af000 tx=0x7f1058008040 comp rx=0 tx=0).stop 2024-04-02T07:33:25.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.312+0000 7f1074c00640 1 -- 172.21.15.55:0/537936671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f107006aea0 msgr2=0x7f10700c69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:25.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.312+0000 7f1074c00640 1 --2- 172.21.15.55:0/537936671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f107006aea0 0x7f10700c69a0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f106000e810 tx=0x7f106000ecd0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.312+0000 7f1074c00640 1 -- 172.21.15.55:0/537936671 shutdown_connections 2024-04-02T07:33:25.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.312+0000 7f1074c00640 1 --2- 172.21.15.55:0/537936671 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10700b6120 0x7f107015a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.312+0000 7f1074c00640 1 --2- 172.21.15.55:0/537936671 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f104c066690 0x7f104c068b50 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.312+0000 7f1074c00640 1 --2- 172.21.15.55:0/537936671 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1070098f50 0x7f10700c42d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.312+0000 7f1074c00640 1 --2- 172.21.15.55:0/537936671 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f107006aea0 0x7f10700c69a0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.312+0000 7f1074c00640 1 -- 172.21.15.55:0/537936671 >> 172.21.15.55:0/537936671 conn(0x7f10700b2030 msgr2=0x7f10700b4de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:25.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.312+0000 7f1074c00640 1 -- 172.21.15.55:0/537936671 shutdown_connections 2024-04-02T07:33:25.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.312+0000 7f1074c00640 1 -- 172.21.15.55:0/537936671 wait complete. 2024-04-02T07:33:25.332 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:33:25.332 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:33:25.476 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.476+0000 7f593bc00640 1 Processor -- start 2024-04-02T07:33:25.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.476+0000 7f593bc00640 1 -- start start 2024-04-02T07:33:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.476+0000 7f593bc00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f59340709b0 0x7f59340b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.476+0000 7f593bc00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59340cd430 con 0x7f59340ccfa0 2024-04-02T07:33:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.476+0000 7f593bc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593415d640 con 0x7f59341590d0 2024-04-02T07:33:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.476+0000 7f593bc00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593415d920 con 0x7f59340709b0 2024-04-02T07:33:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.476+0000 7f5933e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f59340ccfa0 0x7f59340702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:37696/0 (socket says 172.21.15.55:37696) 2024-04-02T07:33:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.476+0000 7f5933e00640 1 -- 172.21.15.55:0/3497436117 learned_addr learned my addr 172.21.15.55:0/3497436117 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:25.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.476+0000 7f5939c00640 1 --2- 172.21.15.55:0/3497436117 >> v2:172.21.15.106:3300/0 conn(0x7f59340709b0 0x7f59340b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:25.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.476+0000 7f5933400640 1 -- 172.21.15.55:0/3497436117 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1899256067 0 0) 0x7f59340cd430 con 0x7f59340ccfa0 2024-04-02T07:33:25.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.476+0000 7f5933400640 1 -- 172.21.15.55:0/3497436117 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f591c003530 con 0x7f59340ccfa0 2024-04-02T07:33:25.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.476+0000 7f5939c00640 1 -- 172.21.15.55:0/3497436117 >> v1:172.21.15.106:6789/0 conn(0x7f59341590d0 legacy=0x7f593415cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:25.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.476+0000 7f5939c00640 1 -- 172.21.15.55:0/3497436117 >> v1:172.21.15.55:6789/0 conn(0x7f59340ccfa0 legacy=0x7f59340702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:25.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.476+0000 7f5939c00640 1 -- 172.21.15.55:0/3497436117 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59340cc4c0 con 0x7f59340709b0 2024-04-02T07:33:25.481 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.480+0000 7f5939c00640 1 --2- 172.21.15.55:0/3497436117 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59340709b0 0x7f59340b31f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f592c009d90 tx=0x7f592c01c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=daa848e051f3632c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.480+0000 7f5933400640 1 -- 172.21.15.55:0/3497436117 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c0a58f0 con 0x7f59340709b0 2024-04-02T07:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.480+0000 7f5933400640 1 -- 172.21.15.55:0/3497436117 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592c0a5a50 con 0x7f59340709b0 2024-04-02T07:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.480+0000 7f5933400640 1 -- 172.21.15.55:0/3497436117 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c0a5de0 con 0x7f59340709b0 2024-04-02T07:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.480+0000 7f593bc00640 1 -- 172.21.15.55:0/3497436117 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59340709b0 msgr2=0x7f59340b31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.480+0000 7f593bc00640 1 --2- 172.21.15.55:0/3497436117 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59340709b0 0x7f59340b31f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f592c009d90 tx=0x7f592c01c8b0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.480+0000 7f593bc00640 1 -- 172.21.15.55:0/3497436117 shutdown_connections 2024-04-02T07:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.480+0000 7f593bc00640 1 --2- 172.21.15.55:0/3497436117 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59340709b0 0x7f59340b31f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.480+0000 7f593bc00640 1 -- 172.21.15.55:0/3497436117 >> 172.21.15.55:0/3497436117 conn(0x7f593406a390 msgr2=0x7f59340b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.480+0000 7f593bc00640 1 -- 172.21.15.55:0/3497436117 shutdown_connections 2024-04-02T07:33:25.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.480+0000 7f593bc00640 1 -- 172.21.15.55:0/3497436117 wait complete. 2024-04-02T07:33:25.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f593bc00640 1 Processor -- start 2024-04-02T07:33:25.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f593bc00640 1 -- start start 2024-04-02T07:33:25.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f593bc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59340709b0 0x7f5934152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:25.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f593bc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59340ccfa0 0x7f59341544d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:25.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f593bc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59341590d0 0x7f5934154a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:25.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f593bc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59341569a0 con 0x7f59341590d0 2024-04-02T07:33:25.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f593bc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5934156c80 con 0x7f59340ccfa0 2024-04-02T07:33:25.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f593bc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5934156f60 con 0x7f59340709b0 2024-04-02T07:33:25.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f5939c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59341590d0 0x7f5934154a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:25.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f5939c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59341590d0 0x7f5934154a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52954/0 (socket says 172.21.15.55:52954) 2024-04-02T07:33:25.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f5939c00640 1 -- 172.21.15.55:0/189248480 learned_addr learned my addr 172.21.15.55:0/189248480 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:25.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f5933e00640 1 --2- 172.21.15.55:0/189248480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59340ccfa0 0x7f59341544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:25.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f5939200640 1 --2- 172.21.15.55:0/189248480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59340709b0 0x7f5934152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:25.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f5939c00640 1 -- 172.21.15.55:0/189248480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59340709b0 msgr2=0x7f5934152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:25.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f5939c00640 1 --2- 172.21.15.55:0/189248480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59340709b0 0x7f5934152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f5939c00640 1 -- 172.21.15.55:0/189248480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59340ccfa0 msgr2=0x7f59341544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:25.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f5939c00640 1 --2- 172.21.15.55:0/189248480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59340ccfa0 0x7f59341544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f5939c00640 1 -- 172.21.15.55:0/189248480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f592c009a70 con 0x7f59341590d0 2024-04-02T07:33:25.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f5939c00640 1 --2- 172.21.15.55:0/189248480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59341590d0 0x7f5934154a10 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f592c0b0040 tx=0x7f592c019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:25.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f5930c00640 1 -- 172.21.15.55:0/189248480 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c0b9860 con 0x7f59341590d0 2024-04-02T07:33:25.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f5930c00640 1 -- 172.21.15.55:0/189248480 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f592c0b99c0 con 0x7f59341590d0 2024-04-02T07:33:25.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f5930c00640 1 -- 172.21.15.55:0/189248480 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f592c0b9d70 con 0x7f59341590d0 2024-04-02T07:33:25.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f593bc00640 1 -- 172.21.15.55:0/189248480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5934157240 con 0x7f59341590d0 2024-04-02T07:33:25.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f593bc00640 1 -- 172.21.15.55:0/189248480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5934156700 con 0x7f59341590d0 2024-04-02T07:33:25.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.484+0000 7f593bc00640 1 -- 172.21.15.55:0/189248480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5934073530 con 0x7f59341590d0 2024-04-02T07:33:25.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.488+0000 7f5930c00640 1 -- 172.21.15.55:0/189248480 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f592c0ad440 con 0x7f59341590d0 2024-04-02T07:33:25.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.488+0000 7f5930c00640 1 --2- 172.21.15.55:0/189248480 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5914066690 0x7f5914068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:25.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.488+0000 7f5930c00640 1 -- 172.21.15.55:0/189248480 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f592c11f0e0 con 0x7f59341590d0 2024-04-02T07:33:25.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.488+0000 7f5939200640 1 --2- 172.21.15.55:0/189248480 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5914066690 0x7f5914068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:25.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.488+0000 7f5939200640 1 --2- 172.21.15.55:0/189248480 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5914066690 0x7f5914068b50 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5928007fd0 tx=0x7f5928009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:25.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.492+0000 7f5930c00640 1 -- 172.21.15.55:0/189248480 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f592c0ec7b0 con 0x7f59341590d0 2024-04-02T07:33:25.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.652+0000 7f593bc00640 1 -- 172.21.15.55:0/189248480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5934157760 con 0x7f59341590d0 2024-04-02T07:33:25.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.652+0000 7f5930c00640 1 -- 172.21.15.55:0/189248480 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v112) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5934157760 con 0x7f59341590d0 2024-04-02T07:33:25.656 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:33:25.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.656+0000 7f593bc00640 1 -- 172.21.15.55:0/189248480 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5914066690 msgr2=0x7f5914068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.656+0000 7f593bc00640 1 --2- 172.21.15.55:0/189248480 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5914066690 0x7f5914068b50 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f5928007fd0 tx=0x7f5928009040 comp rx=0 tx=0).stop 2024-04-02T07:33:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.656+0000 7f593bc00640 1 -- 172.21.15.55:0/189248480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59341590d0 msgr2=0x7f5934154a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.656+0000 7f593bc00640 1 --2- 172.21.15.55:0/189248480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59341590d0 0x7f5934154a10 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f592c0b0040 tx=0x7f592c019650 comp rx=0 tx=0).stop 2024-04-02T07:33:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.656+0000 7f593bc00640 1 -- 172.21.15.55:0/189248480 shutdown_connections 2024-04-02T07:33:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.656+0000 7f593bc00640 1 --2- 172.21.15.55:0/189248480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59341590d0 0x7f5934154a10 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.656+0000 7f593bc00640 1 --2- 172.21.15.55:0/189248480 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5914066690 0x7f5914068b50 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.656+0000 7f593bc00640 1 --2- 172.21.15.55:0/189248480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59340ccfa0 0x7f59341544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.656+0000 7f593bc00640 1 --2- 172.21.15.55:0/189248480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59340709b0 0x7f5934152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.656+0000 7f593bc00640 1 -- 172.21.15.55:0/189248480 >> 172.21.15.55:0/189248480 conn(0x7f593406a390 msgr2=0x7f5934072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.656+0000 7f593bc00640 1 -- 172.21.15.55:0/189248480 shutdown_connections 2024-04-02T07:33:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.656+0000 7f593bc00640 1 -- 172.21.15.55:0/189248480 wait complete. 2024-04-02T07:33:25.676 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-02T07:33:25.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.812+0000 7f5141200640 1 Processor -- start 2024-04-02T07:33:25.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.812+0000 7f5141200640 1 -- start start 2024-04-02T07:33:25.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.816+0000 7f5141200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f513c0b38c0 0x7f513c164210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:25.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.816+0000 7f5141200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f513c13d0c0 con 0x7f513c0c4120 2024-04-02T07:33:25.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.816+0000 7f5141200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f513c15a4f0 con 0x7f513c153ea0 2024-04-02T07:33:25.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.816+0000 7f5141200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f513c15a2f0 con 0x7f513c0b38c0 2024-04-02T07:33:25.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.816+0000 7f5131400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f513c0c4120 0x7f513c0b31b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54478/0 (socket says 172.21.15.55:54478) 2024-04-02T07:33:25.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.816+0000 7f5131400640 1 -- 172.21.15.55:0/40119766 learned_addr learned my addr 172.21.15.55:0/40119766 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:25.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.816+0000 7f513a800640 1 --2- 172.21.15.55:0/40119766 >> v2:172.21.15.106:3300/0 conn(0x7f513c0b38c0 0x7f513c164210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:25.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.816+0000 7f5139400640 1 -- 172.21.15.55:0/40119766 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3204170236 0 0) 0x7f513c13d0c0 con 0x7f513c0c4120 2024-04-02T07:33:25.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.816+0000 7f5139400640 1 -- 172.21.15.55:0/40119766 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5120005740 con 0x7f513c0c4120 2024-04-02T07:33:25.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.816+0000 7f513a800640 1 -- 172.21.15.55:0/40119766 >> v1:172.21.15.106:6789/0 conn(0x7f513c153ea0 legacy=0x7f513c159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:25.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.816+0000 7f513a800640 1 -- 172.21.15.55:0/40119766 >> v1:172.21.15.55:6789/0 conn(0x7f513c0c4120 legacy=0x7f513c0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:25.819 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.816+0000 7f513a800640 1 -- 172.21.15.55:0/40119766 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c15a7d0 con 0x7f513c0b38c0 2024-04-02T07:33:25.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.820+0000 7f513a800640 1 --2- 172.21.15.55:0/40119766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f513c0b38c0 0x7f513c164210 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5134009d90 tx=0x7f513401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d913e95df02ffe54 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:25.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.820+0000 7f5139400640 1 -- 172.21.15.55:0/40119766 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51340a5840 con 0x7f513c0b38c0 2024-04-02T07:33:25.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.820+0000 7f5139400640 1 -- 172.21.15.55:0/40119766 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51340a59a0 con 0x7f513c0b38c0 2024-04-02T07:33:25.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.820+0000 7f5139400640 1 -- 172.21.15.55:0/40119766 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51340a5d30 con 0x7f513c0b38c0 2024-04-02T07:33:25.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.820+0000 7f5141200640 1 -- 172.21.15.55:0/40119766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f513c0b38c0 msgr2=0x7f513c164210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:25.822 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.820+0000 7f5141200640 1 --2- 172.21.15.55:0/40119766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f513c0b38c0 0x7f513c164210 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5134009d90 tx=0x7f513401c970 comp rx=0 tx=0).stop 2024-04-02T07:33:25.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.820+0000 7f5141200640 1 -- 172.21.15.55:0/40119766 shutdown_connections 2024-04-02T07:33:25.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.820+0000 7f5141200640 1 --2- 172.21.15.55:0/40119766 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f513c0b38c0 0x7f513c164210 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.820+0000 7f5141200640 1 -- 172.21.15.55:0/40119766 >> 172.21.15.55:0/40119766 conn(0x7f513c066080 msgr2=0x7f513c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:25.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.820+0000 7f5141200640 1 -- 172.21.15.55:0/40119766 shutdown_connections 2024-04-02T07:33:25.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.820+0000 7f5141200640 1 -- 172.21.15.55:0/40119766 wait complete. 2024-04-02T07:33:25.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.820+0000 7f5141200640 1 Processor -- start 2024-04-02T07:33:25.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.820+0000 7f5141200640 1 -- start start 2024-04-02T07:33:25.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f5141200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f513c0b38c0 0x7f513c0c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:25.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f5141200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f513c0c4120 0x7f513c0c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:25.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f5141200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f513c153ea0 0x7f513c0c9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:25.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f5141200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c0c7fd0 con 0x7f513c153ea0 2024-04-02T07:33:25.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f5141200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513c0c8df0 con 0x7f513c0b38c0 2024-04-02T07:33:25.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f5141200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f513c0c81e0 con 0x7f513c0c4120 2024-04-02T07:33:25.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f513a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f513c153ea0 0x7f513c0c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:25.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f513a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f513c153ea0 0x7f513c0c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:32992/0 (socket says 172.21.15.55:32992) 2024-04-02T07:33:25.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f513a800640 1 -- 172.21.15.55:0/4062932017 learned_addr learned my addr 172.21.15.55:0/4062932017 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:25.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f5139e00640 1 --2- 172.21.15.55:0/4062932017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f513c0b38c0 0x7f513c0c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:25.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f5131400640 1 --2- 172.21.15.55:0/4062932017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f513c0c4120 0x7f513c0c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:25.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f513a800640 1 -- 172.21.15.55:0/4062932017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f513c0c4120 msgr2=0x7f513c0c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:25.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f513a800640 1 --2- 172.21.15.55:0/4062932017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f513c0c4120 0x7f513c0c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f513a800640 1 -- 172.21.15.55:0/4062932017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f513c0b38c0 msgr2=0x7f513c0c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:25.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f513a800640 1 --2- 172.21.15.55:0/4062932017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f513c0b38c0 0x7f513c0c7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f513a800640 1 -- 172.21.15.55:0/4062932017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5134009a70 con 0x7f513c153ea0 2024-04-02T07:33:25.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f5131400640 1 --2- 172.21.15.55:0/4062932017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f513c0c4120 0x7f513c0c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:25.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f513a800640 1 --2- 172.21.15.55:0/4062932017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f513c153ea0 0x7f513c0c9280 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f513401a5a0 tx=0x7f5134019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:25.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f5132a00640 1 -- 172.21.15.55:0/4062932017 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51340b9650 con 0x7f513c153ea0 2024-04-02T07:33:25.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f5132a00640 1 -- 172.21.15.55:0/4062932017 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51340b97b0 con 0x7f513c153ea0 2024-04-02T07:33:25.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f5132a00640 1 -- 172.21.15.55:0/4062932017 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51340b9b20 con 0x7f513c153ea0 2024-04-02T07:33:25.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f5141200640 1 -- 172.21.15.55:0/4062932017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f513c0c84c0 con 0x7f513c153ea0 2024-04-02T07:33:25.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f5141200640 1 -- 172.21.15.55:0/4062932017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f513c0c8a80 con 0x7f513c153ea0 2024-04-02T07:33:25.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.824+0000 7f5141200640 1 -- 172.21.15.55:0/4062932017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f513c0c8f80 con 0x7f513c153ea0 2024-04-02T07:33:25.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.828+0000 7f5132a00640 1 -- 172.21.15.55:0/4062932017 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f51340b9c80 con 0x7f513c153ea0 2024-04-02T07:33:25.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.828+0000 7f5132a00640 1 --2- 172.21.15.55:0/4062932017 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51180666c0 0x7f5118068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:25.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.828+0000 7f5132a00640 1 -- 172.21.15.55:0/4062932017 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f513411f6b0 con 0x7f513c153ea0 2024-04-02T07:33:25.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.828+0000 7f5139e00640 1 --2- 172.21.15.55:0/4062932017 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51180666c0 0x7f5118068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:25.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.828+0000 7f5139e00640 1 --2- 172.21.15.55:0/4062932017 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51180666c0 0x7f5118068b80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f512c007fd0 tx=0x7f512c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:25.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.832+0000 7f5132a00640 1 -- 172.21.15.55:0/4062932017 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f51340eccd0 con 0x7f513c153ea0 2024-04-02T07:33:25.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.992+0000 7f5141200640 1 -- 172.21.15.55:0/4062932017 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f513c066c90 con 0x7f513c153ea0 2024-04-02T07:33:25.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.992+0000 7f5132a00640 1 -- 172.21.15.55:0/4062932017 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v112) v1 ==== 84+0+65 (secure 0 0 0) 0x7f51340b2060 con 0x7f513c153ea0 2024-04-02T07:33:25.995 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:25.995 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2024-04-02T07:33:25.995 INFO:teuthology.orchestra.run.smithi055.stdout: { 2024-04-02T07:33:25.995 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2024-04-02T07:33:25.995 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2024-04-02T07:33:25.995 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:25.996 INFO:teuthology.orchestra.run.smithi055.stdout:] 2024-04-02T07:33:25.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.996+0000 7f5141200640 1 -- 172.21.15.55:0/4062932017 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51180666c0 msgr2=0x7f5118068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:25.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.996+0000 7f5141200640 1 --2- 172.21.15.55:0/4062932017 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51180666c0 0x7f5118068b80 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f512c007fd0 tx=0x7f512c009040 comp rx=0 tx=0).stop 2024-04-02T07:33:25.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.996+0000 7f5141200640 1 -- 172.21.15.55:0/4062932017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f513c153ea0 msgr2=0x7f513c0c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:25.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.996+0000 7f5141200640 1 --2- 172.21.15.55:0/4062932017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f513c153ea0 0x7f513c0c9280 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f513401a5a0 tx=0x7f5134019710 comp rx=0 tx=0).stop 2024-04-02T07:33:25.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.996+0000 7f5141200640 1 -- 172.21.15.55:0/4062932017 shutdown_connections 2024-04-02T07:33:25.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.996+0000 7f5141200640 1 --2- 172.21.15.55:0/4062932017 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f513c153ea0 0x7f513c0c9280 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.996+0000 7f5141200640 1 --2- 172.21.15.55:0/4062932017 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f513c0c4120 0x7f513c0c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.996+0000 7f5141200640 1 --2- 172.21.15.55:0/4062932017 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51180666c0 0x7f5118068b80 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.996+0000 7f5141200640 1 --2- 172.21.15.55:0/4062932017 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f513c0b38c0 0x7f513c0c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:25.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.996+0000 7f5141200640 1 -- 172.21.15.55:0/4062932017 >> 172.21.15.55:0/4062932017 conn(0x7f513c066080 msgr2=0x7f513c15b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:25.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.996+0000 7f5141200640 1 -- 172.21.15.55:0/4062932017 shutdown_connections 2024-04-02T07:33:25.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:25.996+0000 7f5141200640 1 -- 172.21.15.55:0/4062932017 wait complete. 2024-04-02T07:33:26.015 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-02T07:33:26.015 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-02T07:33:26.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.156+0000 7f5adfc00640 1 Processor -- start 2024-04-02T07:33:26.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.156+0000 7f5adfc00640 1 -- start start 2024-04-02T07:33:26.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.160+0000 7f5adfc00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5ad8099120 0x7f5ad806bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:26.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.160+0000 7f5adfc00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad80ccae0 con 0x7f5ad80cead0 2024-04-02T07:33:26.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.160+0000 7f5adfc00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ad80d0300 con 0x7f5ad80cc700 2024-04-02T07:33:26.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.160+0000 7f5adfc00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ad80cf260 con 0x7f5ad8099120 2024-04-02T07:33:26.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.160+0000 7f5acfe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5ad8099120 0x7f5ad806bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:26.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.160+0000 7f5addc00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5ad80cead0 0x7f5ad815c2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54486/0 (socket says 172.21.15.55:54486) 2024-04-02T07:33:26.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.160+0000 7f5addc00640 1 -- 172.21.15.55:0/3733986002 learned_addr learned my addr 172.21.15.55:0/3733986002 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:26.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.160+0000 7f5acfe00640 1 -- 172.21.15.55:0/3733986002 >> v1:172.21.15.106:6789/0 conn(0x7f5ad80cc700 legacy=0x7f5ad8098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:26.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.160+0000 7f5ad7e00640 1 -- 172.21.15.55:0/3733986002 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313190670 0 0) 0x7f5ad80ccae0 con 0x7f5ad80cead0 2024-04-02T07:33:26.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.160+0000 7f5acfe00640 1 -- 172.21.15.55:0/3733986002 >> v1:172.21.15.55:6789/0 conn(0x7f5ad80cead0 legacy=0x7f5ad815c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:26.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.160+0000 7f5acfe00640 1 -- 172.21.15.55:0/3733986002 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad80cf540 con 0x7f5ad8099120 2024-04-02T07:33:26.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.160+0000 7f5acfe00640 1 --2- 172.21.15.55:0/3733986002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ad8099120 0x7f5ad806bfd0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00097c0 tx=0x7f5ac001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f61783d32dcbf server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:26.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5ad7e00640 1 -- 172.21.15.55:0/3733986002 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00a6040 con 0x7f5ad8099120 2024-04-02T07:33:26.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5ad7e00640 1 -- 172.21.15.55:0/3733986002 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac00aa600 con 0x7f5ad8099120 2024-04-02T07:33:26.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5ad7e00640 1 -- 172.21.15.55:0/3733986002 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac00aa990 con 0x7f5ad8099120 2024-04-02T07:33:26.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5adfc00640 1 -- 172.21.15.55:0/3733986002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ad8099120 msgr2=0x7f5ad806bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:26.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5adfc00640 1 --2- 172.21.15.55:0/3733986002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ad8099120 0x7f5ad806bfd0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00097c0 tx=0x7f5ac001c4a0 comp rx=0 tx=0).stop 2024-04-02T07:33:26.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5adfc00640 1 -- 172.21.15.55:0/3733986002 shutdown_connections 2024-04-02T07:33:26.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5adfc00640 1 --2- 172.21.15.55:0/3733986002 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ad8099120 0x7f5ad806bfd0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:26.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5adfc00640 1 -- 172.21.15.55:0/3733986002 >> 172.21.15.55:0/3733986002 conn(0x7f5ad80b2150 msgr2=0x7f5ad80b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:26.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5adfc00640 1 -- 172.21.15.55:0/3733986002 shutdown_connections 2024-04-02T07:33:26.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5adfc00640 1 -- 172.21.15.55:0/3733986002 wait complete. 2024-04-02T07:33:26.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5adfc00640 1 Processor -- start 2024-04-02T07:33:26.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5adfc00640 1 -- start start 2024-04-02T07:33:26.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5adfc00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ad8099120 0x7f5ad815e950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:26.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5adfc00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ad80cc700 0x7f5ad815ee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:26.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5adfc00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ad80cead0 0x7f5ad80c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:26.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5adfc00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad8160100 con 0x7f5ad8099120 2024-04-02T07:33:26.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5adfc00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad80c7960 con 0x7f5ad80cc700 2024-04-02T07:33:26.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5adfc00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ad815f860 con 0x7f5ad80cead0 2024-04-02T07:33:26.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5add200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ad8099120 0x7f5ad815e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:26.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5add200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ad8099120 0x7f5ad815e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33022/0 (socket says 172.21.15.55:33022) 2024-04-02T07:33:26.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5add200640 1 -- 172.21.15.55:0/1817067558 learned_addr learned my addr 172.21.15.55:0/1817067558 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:26.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5addc00640 1 --2- 172.21.15.55:0/1817067558 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ad80cead0 0x7f5ad80c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:26.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.164+0000 7f5acfe00640 1 --2- 172.21.15.55:0/1817067558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ad80cc700 0x7f5ad815ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:26.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.168+0000 7f5add200640 1 -- 172.21.15.55:0/1817067558 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ad80cead0 msgr2=0x7f5ad80c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:26.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.168+0000 7f5add200640 1 --2- 172.21.15.55:0/1817067558 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ad80cead0 0x7f5ad80c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:26.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.168+0000 7f5add200640 1 -- 172.21.15.55:0/1817067558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ad80cc700 msgr2=0x7f5ad815ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:26.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.168+0000 7f5add200640 1 --2- 172.21.15.55:0/1817067558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ad80cc700 0x7f5ad815ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:26.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.168+0000 7f5add200640 1 -- 172.21.15.55:0/1817067558 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac0009420 con 0x7f5ad8099120 2024-04-02T07:33:26.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.168+0000 7f5addc00640 1 --2- 172.21.15.55:0/1817067558 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ad80cead0 0x7f5ad80c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:26.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.168+0000 7f5add200640 1 --2- 172.21.15.55:0/1817067558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ad8099120 0x7f5ad815e950 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800c500 tx=0x7f5ac800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:26.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.168+0000 7f5ad5600640 1 -- 172.21.15.55:0/1817067558 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8005220 con 0x7f5ad8099120 2024-04-02T07:33:26.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.168+0000 7f5ad5600640 1 -- 172.21.15.55:0/1817067558 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ac8005380 con 0x7f5ad8099120 2024-04-02T07:33:26.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.168+0000 7f5ad5600640 1 -- 172.21.15.55:0/1817067558 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ac8007270 con 0x7f5ad8099120 2024-04-02T07:33:26.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.168+0000 7f5adfc00640 1 -- 172.21.15.55:0/1817067558 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ad815fb40 con 0x7f5ad8099120 2024-04-02T07:33:26.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.168+0000 7f5adfc00640 1 -- 172.21.15.55:0/1817067558 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ad815d340 con 0x7f5ad8099120 2024-04-02T07:33:26.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.168+0000 7f5adfc00640 1 -- 172.21.15.55:0/1817067558 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ad8066c90 con 0x7f5ad8099120 2024-04-02T07:33:26.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.168+0000 7f5ad5600640 1 -- 172.21.15.55:0/1817067558 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5ac80073d0 con 0x7f5ad8099120 2024-04-02T07:33:26.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.168+0000 7f5ad5600640 1 --2- 172.21.15.55:0/1817067558 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ab40666e0 0x7f5ab4068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:26.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.168+0000 7f5ad5600640 1 -- 172.21.15.55:0/1817067558 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5ac8083430 con 0x7f5ad8099120 2024-04-02T07:33:26.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.168+0000 7f5acfe00640 1 --2- 172.21.15.55:0/1817067558 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ab40666e0 0x7f5ab4068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:26.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.172+0000 7f5acfe00640 1 --2- 172.21.15.55:0/1817067558 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ab40666e0 0x7f5ab4068ba0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00ae000 tx=0x7f5ac00b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:26.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.172+0000 7f5ad5600640 1 -- 172.21.15.55:0/1817067558 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5ac8050a50 con 0x7f5ad8099120 2024-04-02T07:33:26.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.332+0000 7f5adfc00640 1 -- 172.21.15.55:0/1817067558 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5ad80b2fd0 con 0x7f5ad8099120 2024-04-02T07:33:26.435 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.432+0000 7f5ad5600640 1 -- 172.21.15.55:0/1817067558 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v113) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5ac8054070 con 0x7f5ad8099120 2024-04-02T07:33:26.436 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2024-04-02T07:33:26.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.436+0000 7f5adfc00640 1 -- 172.21.15.55:0/1817067558 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ab40666e0 msgr2=0x7f5ab4068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:26.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.436+0000 7f5adfc00640 1 --2- 172.21.15.55:0/1817067558 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ab40666e0 0x7f5ab4068ba0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f5ac00ae000 tx=0x7f5ac00b5040 comp rx=0 tx=0).stop 2024-04-02T07:33:26.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.436+0000 7f5adfc00640 1 -- 172.21.15.55:0/1817067558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ad8099120 msgr2=0x7f5ad815e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:26.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.436+0000 7f5adfc00640 1 --2- 172.21.15.55:0/1817067558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ad8099120 0x7f5ad815e950 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f5ac800c500 tx=0x7f5ac800c9c0 comp rx=0 tx=0).stop 2024-04-02T07:33:26.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.436+0000 7f5adfc00640 1 -- 172.21.15.55:0/1817067558 shutdown_connections 2024-04-02T07:33:26.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.436+0000 7f5adfc00640 1 --2- 172.21.15.55:0/1817067558 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ad80cead0 0x7f5ad80c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:26.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.436+0000 7f5adfc00640 1 --2- 172.21.15.55:0/1817067558 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ab40666e0 0x7f5ab4068ba0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:26.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.436+0000 7f5adfc00640 1 --2- 172.21.15.55:0/1817067558 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ad80cc700 0x7f5ad815ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:26.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.436+0000 7f5adfc00640 1 --2- 172.21.15.55:0/1817067558 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ad8099120 0x7f5ad815e950 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:26.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.436+0000 7f5adfc00640 1 -- 172.21.15.55:0/1817067558 >> 172.21.15.55:0/1817067558 conn(0x7f5ad80b2150 msgr2=0x7f5ad8098a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:26.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.436+0000 7f5adfc00640 1 -- 172.21.15.55:0/1817067558 shutdown_connections 2024-04-02T07:33:26.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.436+0000 7f5adfc00640 1 -- 172.21.15.55:0/1817067558 wait complete. 2024-04-02T07:33:26.463 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-02T07:33:26.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd1a1c00640 1 Processor -- start 2024-04-02T07:33:26.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd1a1c00640 1 -- start start 2024-04-02T07:33:26.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd1a1c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd19c15c990 0x7fd19c0cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:26.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd1a1c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19c0d0160 con 0x7fd19c06c220 2024-04-02T07:33:26.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd1a1c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd19c0cf0c0 con 0x7fd19c06bdc0 2024-04-02T07:33:26.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd1a1c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c0cf3a0 con 0x7fd19c15c990 2024-04-02T07:33:26.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19b400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd19c06c220 0x7fd19c0b1440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54494/0 (socket says 172.21.15.55:54494) 2024-04-02T07:33:26.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19b400640 1 -- 172.21.15.55:0/2342024103 learned_addr learned my addr 172.21.15.55:0/2342024103 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:26.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19aa00640 1 --2- 172.21.15.55:0/2342024103 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd19c15c990 0x7fd19c0cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:26.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19a000640 1 -- 172.21.15.55:0/2342024103 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747109074 0 0) 0x7fd19c0d0160 con 0x7fd19c06c220 2024-04-02T07:33:26.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19a000640 1 -- 172.21.15.55:0/2342024103 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd180003530 con 0x7fd19c06c220 2024-04-02T07:33:26.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19a000640 1 -- 172.21.15.55:0/2342024103 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769965781 0 0) 0x7fd19c0cf0c0 con 0x7fd19c06bdc0 2024-04-02T07:33:26.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19a000640 1 -- 172.21.15.55:0/2342024103 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd19c0d0160 con 0x7fd19c06bdc0 2024-04-02T07:33:26.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19a000640 1 -- 172.21.15.55:0/2342024103 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3323905662 0 0) 0x7fd180003530 con 0x7fd19c06c220 2024-04-02T07:33:26.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19a000640 1 -- 172.21.15.55:0/2342024103 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd19c15c990 msgr2=0x7fd19c0cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19a000640 1 --2- 172.21.15.55:0/2342024103 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd19c15c990 0x7fd19c0cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19a000640 1 -- 172.21.15.55:0/2342024103 >> v1:172.21.15.106:6789/0 conn(0x7fd19c06bdc0 legacy=0x7fd19c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19a000640 1 -- 172.21.15.55:0/2342024103 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c0cf680 con 0x7fd19c06c220 2024-04-02T07:33:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19a000640 1 -- 172.21.15.55:0/2342024103 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fd194001a00 con 0x7fd19c06c220 2024-04-02T07:33:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19aa00640 1 --2- 172.21.15.55:0/2342024103 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd19c15c990 0x7fd19c0cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:33:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19a000640 1 -- 172.21.15.55:0/2342024103 >> v1:172.21.15.55:6789/0 conn(0x7fd19c06c220 legacy=0x7fd19c0b1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19a000640 1 --2- 172.21.15.55:0/2342024103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd180003b40 0x7fd180003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19a000640 1 --2- 172.21.15.55:0/2342024103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1800047d0 0x7fd180004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19a000640 1 --2- 172.21.15.55:0/2342024103 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd19c15c990 0x7fd180005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19a000640 1 -- 172.21.15.55:0/2342024103 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c0cf3a0 con 0x7fd1800047d0 2024-04-02T07:33:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19a000640 1 -- 172.21.15.55:0/2342024103 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd18000ba40 con 0x7fd180003b40 2024-04-02T07:33:26.614 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd19a000640 1 -- 172.21.15.55:0/2342024103 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18000bbd0 con 0x7fd19c15c990 2024-04-02T07:33:26.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.608+0000 7fd193e00640 1 --2- 172.21.15.55:0/2342024103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1800047d0 0x7fd180004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:26.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.612+0000 7fd19b400640 1 --2- 172.21.15.55:0/2342024103 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd19c15c990 0x7fd180005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:26.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.612+0000 7fd19aa00640 1 --2- 172.21.15.55:0/2342024103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd180003b40 0x7fd180003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:26.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.612+0000 7fd193e00640 1 -- 172.21.15.55:0/2342024103 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd19c15c990 msgr2=0x7fd180005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:26.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.612+0000 7fd193e00640 1 --2- 172.21.15.55:0/2342024103 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd19c15c990 0x7fd180005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:26.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.612+0000 7fd193e00640 1 -- 172.21.15.55:0/2342024103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd180003b40 msgr2=0x7fd180003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:26.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.612+0000 7fd193e00640 1 --2- 172.21.15.55:0/2342024103 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd180003b40 0x7fd180003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:26.615 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.612+0000 7fd193e00640 1 -- 172.21.15.55:0/2342024103 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c009420 con 0x7fd1800047d0 2024-04-02T07:33:26.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.612+0000 7fd193e00640 1 --2- 172.21.15.55:0/2342024103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1800047d0 0x7fd180004c50 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fd184007fd0 tx=0x7fd18401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e41236bb3f4f251 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:26.616 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.612+0000 7fd19a000640 1 -- 172.21.15.55:0/2342024103 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1840052d0 con 0x7fd1800047d0 2024-04-02T07:33:26.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.612+0000 7fd19a000640 1 -- 172.21.15.55:0/2342024103 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd184005450 con 0x7fd1800047d0 2024-04-02T07:33:26.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.612+0000 7fd19a000640 1 -- 172.21.15.55:0/2342024103 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1840a8910 con 0x7fd1800047d0 2024-04-02T07:33:26.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd1a1c00640 1 -- 172.21.15.55:0/2342024103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1800047d0 msgr2=0x7fd180004c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:26.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd1a1c00640 1 --2- 172.21.15.55:0/2342024103 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1800047d0 0x7fd180004c50 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fd184007fd0 tx=0x7fd18401ecb0 comp rx=0 tx=0).stop 2024-04-02T07:33:26.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd19b400640 1 -- 172.21.15.55:0/2342024103 reap_dead start 2024-04-02T07:33:26.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd1a1c00640 1 -- 172.21.15.55:0/2342024103 shutdown_connections 2024-04-02T07:33:26.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd1a1c00640 1 -- 172.21.15.55:0/2342024103 >> 172.21.15.55:0/2342024103 conn(0x7fd19c0b21f0 msgr2=0x7fd19c0b25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:26.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd1a1c00640 1 -- 172.21.15.55:0/2342024103 shutdown_connections 2024-04-02T07:33:26.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd1a1c00640 1 -- 172.21.15.55:0/2342024103 wait complete. 2024-04-02T07:33:26.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd1a1c00640 1 Processor -- start 2024-04-02T07:33:26.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd1a1c00640 1 -- start start 2024-04-02T07:33:26.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd1a1c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1800047d0 0x7fd19c1f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:26.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd1a1c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd19c1f6590 0x7fd19c1f2390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:26.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd1a1c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd19c09a480 0x7fd19c09a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:26.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd1a1c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c1f3880 con 0x7fd19c1f6590 2024-04-02T07:33:26.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd1a1c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c09ae50 con 0x7fd1800047d0 2024-04-02T07:33:26.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd1a1c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd19c15e360 con 0x7fd19c09a480 2024-04-02T07:33:26.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd193e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd19c1f6590 0x7fd19c1f2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:26.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd193e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd19c1f6590 0x7fd19c1f2390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33044/0 (socket says 172.21.15.55:33044) 2024-04-02T07:33:26.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd193e00640 1 -- 172.21.15.55:0/1823819939 learned_addr learned my addr 172.21.15.55:0/1823819939 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:26.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd19aa00640 1 --2- 172.21.15.55:0/1823819939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1800047d0 0x7fd19c1f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:26.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd19b400640 1 --2- 172.21.15.55:0/1823819939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd19c09a480 0x7fd19c09a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:26.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd193e00640 1 -- 172.21.15.55:0/1823819939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd19c09a480 msgr2=0x7fd19c09a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:26.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd193e00640 1 --2- 172.21.15.55:0/1823819939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd19c09a480 0x7fd19c09a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:26.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd193e00640 1 -- 172.21.15.55:0/1823819939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1800047d0 msgr2=0x7fd19c1f51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:26.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd193e00640 1 --2- 172.21.15.55:0/1823819939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1800047d0 0x7fd19c1f51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:26.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd193e00640 1 -- 172.21.15.55:0/1823819939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd19c15e030 con 0x7fd19c1f6590 2024-04-02T07:33:26.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd19aa00640 1 --2- 172.21.15.55:0/1823819939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1800047d0 0x7fd19c1f51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:26.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd193e00640 1 --2- 172.21.15.55:0/1823819939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd19c1f6590 0x7fd19c1f2390 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fd184005040 tx=0x7fd180005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:26.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.616+0000 7fd192a00640 1 -- 172.21.15.55:0/1823819939 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1840a8d30 con 0x7fd19c1f6590 2024-04-02T07:33:26.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.620+0000 7fd192a00640 1 -- 172.21.15.55:0/1823819939 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1840a8e90 con 0x7fd19c1f6590 2024-04-02T07:33:26.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.620+0000 7fd1a1c00640 1 -- 172.21.15.55:0/1823819939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd19c1f5700 con 0x7fd19c1f6590 2024-04-02T07:33:26.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.620+0000 7fd192a00640 1 -- 172.21.15.55:0/1823819939 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1840052d0 con 0x7fd19c1f6590 2024-04-02T07:33:26.622 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.620+0000 7fd1a1c00640 1 -- 172.21.15.55:0/1823819939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd19c1f2f30 con 0x7fd19c1f6590 2024-04-02T07:33:26.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.620+0000 7fd1a1c00640 1 -- 172.21.15.55:0/1823819939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd19c15e4d0 con 0x7fd19c1f6590 2024-04-02T07:33:26.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.620+0000 7fd192a00640 1 -- 172.21.15.55:0/1823819939 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd1840067e0 con 0x7fd19c1f6590 2024-04-02T07:33:26.623 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.620+0000 7fd192a00640 1 --2- 172.21.15.55:0/1823819939 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd178066690 0x7fd178068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:26.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.620+0000 7fd192a00640 1 -- 172.21.15.55:0/1823819939 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fd184121790 con 0x7fd19c1f6590 2024-04-02T07:33:26.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.620+0000 7fd19aa00640 1 --2- 172.21.15.55:0/1823819939 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd178066690 0x7fd178068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:26.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.624+0000 7fd19aa00640 1 --2- 172.21.15.55:0/1823819939 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd178066690 0x7fd178068b50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009c10 tx=0x7fd18c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:26.627 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.624+0000 7fd192a00640 1 -- 172.21.15.55:0/1823819939 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd1840eede0 con 0x7fd19c1f6590 2024-04-02T07:33:26.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:26.784+0000 7fd1a1c00640 1 -- 172.21.15.55:0/1823819939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fd19c15e4d0 con 0x7fd19c1f6590 2024-04-02T07:33:27.443 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.440+0000 7fd192a00640 1 -- 172.21.15.55:0/1823819939 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v114) v1 ==== 170+0+0 (secure 0 0 0) 0x7fd1840f2400 con 0x7fd19c1f6590 2024-04-02T07:33:27.443 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2024-04-02T07:33:27.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.444+0000 7fd1a1c00640 1 -- 172.21.15.55:0/1823819939 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd178066690 msgr2=0x7fd178068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:27.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.444+0000 7fd1a1c00640 1 --2- 172.21.15.55:0/1823819939 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd178066690 0x7fd178068b50 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fd18c009c10 tx=0x7fd18c008040 comp rx=0 tx=0).stop 2024-04-02T07:33:27.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.444+0000 7fd1a1c00640 1 -- 172.21.15.55:0/1823819939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd19c1f6590 msgr2=0x7fd19c1f2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:27.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.444+0000 7fd1a1c00640 1 --2- 172.21.15.55:0/1823819939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd19c1f6590 0x7fd19c1f2390 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7fd184005040 tx=0x7fd180005800 comp rx=0 tx=0).stop 2024-04-02T07:33:27.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.448+0000 7fd1a1c00640 1 -- 172.21.15.55:0/1823819939 shutdown_connections 2024-04-02T07:33:27.448 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.448+0000 7fd1a1c00640 1 --2- 172.21.15.55:0/1823819939 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd19c09a480 0x7fd19c09a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:27.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.448+0000 7fd1a1c00640 1 --2- 172.21.15.55:0/1823819939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd19c1f6590 0x7fd19c1f2390 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:27.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.448+0000 7fd1a1c00640 1 --2- 172.21.15.55:0/1823819939 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd178066690 0x7fd178068b50 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:27.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.448+0000 7fd1a1c00640 1 --2- 172.21.15.55:0/1823819939 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1800047d0 0x7fd19c1f51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:27.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.448+0000 7fd1a1c00640 1 -- 172.21.15.55:0/1823819939 >> 172.21.15.55:0/1823819939 conn(0x7fd19c0b21f0 msgr2=0x7fd19c06ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:27.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.448+0000 7fd1a1c00640 1 -- 172.21.15.55:0/1823819939 shutdown_connections 2024-04-02T07:33:27.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.448+0000 7fd1a1c00640 1 -- 172.21.15.55:0/1823819939 wait complete. 2024-04-02T07:33:27.482 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-02T07:33:27.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.624+0000 7fec93000640 1 Processor -- start 2024-04-02T07:33:27.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.624+0000 7fec93000640 1 -- start start 2024-04-02T07:33:27.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.628+0000 7fec93000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fec8c0b3dc0 0x7fec8c0ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:27.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.628+0000 7fec93000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec8c0b41a0 0x7fec8c142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:27.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.628+0000 7fec93000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8c06ddc0 con 0x7fec8c0ade90 2024-04-02T07:33:27.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.628+0000 7fec93000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8c06c630 con 0x7fec8c0b3dc0 2024-04-02T07:33:27.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.628+0000 7fec93000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c06c8f0 con 0x7fec8c0b41a0 2024-04-02T07:33:27.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.628+0000 7fec8be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fec8c0b3dc0 0x7fec8c0ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:27.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.628+0000 7fec91000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec8c0b41a0 0x7fec8c142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:27.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.628+0000 7fec8be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fec8c0b3dc0 0x7fec8c0ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:34540/0 (socket says 172.21.15.55:34540) 2024-04-02T07:33:27.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.628+0000 7fec8be00640 1 -- 172.21.15.55:0/3601071401 learned_addr learned my addr 172.21.15.55:0/3601071401 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:27.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.628+0000 7fec83400640 1 --1- 172.21.15.55:0/3601071401 >> v1:172.21.15.106:6789/0 conn(0x7fec8c0ade90 0x7fec8c06d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:45662/0 (socket says 172.21.15.55:45662) 2024-04-02T07:33:27.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.628+0000 7fec8be00640 1 -- 172.21.15.55:0/3601071401 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec8c0b41a0 msgr2=0x7fec8c142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:27.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.628+0000 7fec8be00640 1 --2- 172.21.15.55:0/3601071401 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec8c0b41a0 0x7fec8c142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:27.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.628+0000 7fec8be00640 1 -- 172.21.15.55:0/3601071401 >> v1:172.21.15.106:6789/0 conn(0x7fec8c0ade90 legacy=0x7fec8c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:27.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.628+0000 7fec8be00640 1 -- 172.21.15.55:0/3601071401 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8c06cbd0 con 0x7fec8c0b3dc0 2024-04-02T07:33:27.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.632+0000 7fec8be00640 1 --2- 172.21.15.55:0/3601071401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec8c0b3dc0 0x7fec8c0ca770 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009870 tx=0x7fec7c01c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=116ae135ba23cd7b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:27.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.632+0000 7fec8b400640 1 -- 172.21.15.55:0/3601071401 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c0ac410 con 0x7fec8c0b3dc0 2024-04-02T07:33:27.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.632+0000 7fec8b400640 1 -- 172.21.15.55:0/3601071401 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c0ac570 con 0x7fec8c0b3dc0 2024-04-02T07:33:27.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.632+0000 7fec8b400640 1 -- 172.21.15.55:0/3601071401 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c0ac900 con 0x7fec8c0b3dc0 2024-04-02T07:33:27.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.632+0000 7fec93000640 1 -- 172.21.15.55:0/3601071401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec8c0b3dc0 msgr2=0x7fec8c0ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:27.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.632+0000 7fec93000640 1 --2- 172.21.15.55:0/3601071401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec8c0b3dc0 0x7fec8c0ca770 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fec7c009870 tx=0x7fec7c01c4a0 comp rx=0 tx=0).stop 2024-04-02T07:33:27.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.632+0000 7fec93000640 1 -- 172.21.15.55:0/3601071401 shutdown_connections 2024-04-02T07:33:27.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.632+0000 7fec93000640 1 --2- 172.21.15.55:0/3601071401 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec8c0b41a0 0x7fec8c142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:27.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.632+0000 7fec93000640 1 --2- 172.21.15.55:0/3601071401 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec8c0b3dc0 0x7fec8c0ca770 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:27.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.632+0000 7fec93000640 1 -- 172.21.15.55:0/3601071401 >> 172.21.15.55:0/3601071401 conn(0x7fec8c06a390 msgr2=0x7fec8c0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:27.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.632+0000 7fec93000640 1 -- 172.21.15.55:0/3601071401 shutdown_connections 2024-04-02T07:33:27.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.632+0000 7fec93000640 1 -- 172.21.15.55:0/3601071401 wait complete. 2024-04-02T07:33:27.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.632+0000 7fec93000640 1 Processor -- start 2024-04-02T07:33:27.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.632+0000 7fec93000640 1 -- start start 2024-04-02T07:33:27.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec93000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec8c0ade90 0x7fec8c1370b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:27.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec93000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec8c0b3dc0 0x7fec8c156500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:27.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec93000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec8c0b41a0 0x7fec8c156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:27.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec93000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c156f80 con 0x7fec8c0ade90 2024-04-02T07:33:27.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec93000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c150e00 con 0x7fec8c0b41a0 2024-04-02T07:33:27.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec93000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c151050 con 0x7fec8c0b3dc0 2024-04-02T07:33:27.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec8be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec8c0ade90 0x7fec8c1370b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:27.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec8be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec8c0ade90 0x7fec8c1370b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33058/0 (socket says 172.21.15.55:33058) 2024-04-02T07:33:27.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec8be00640 1 -- 172.21.15.55:0/4103170047 learned_addr learned my addr 172.21.15.55:0/4103170047 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:27.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec83400640 1 --2- 172.21.15.55:0/4103170047 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec8c0b3dc0 0x7fec8c156500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:27.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec91000640 1 --2- 172.21.15.55:0/4103170047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec8c0b41a0 0x7fec8c156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:27.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec8be00640 1 -- 172.21.15.55:0/4103170047 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec8c0b3dc0 msgr2=0x7fec8c156500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:27.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec8be00640 1 --2- 172.21.15.55:0/4103170047 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec8c0b3dc0 0x7fec8c156500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:27.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec8be00640 1 -- 172.21.15.55:0/4103170047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec8c0b41a0 msgr2=0x7fec8c156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:27.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec8be00640 1 --2- 172.21.15.55:0/4103170047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec8c0b41a0 0x7fec8c156a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:27.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec8be00640 1 -- 172.21.15.55:0/4103170047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c0094d0 con 0x7fec8c0ade90 2024-04-02T07:33:27.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec8be00640 1 --2- 172.21.15.55:0/4103170047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec8c0ade90 0x7fec8c1370b0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0af040 tx=0x7fec7c019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:27.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec88c00640 1 -- 172.21.15.55:0/4103170047 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c0ac410 con 0x7fec8c0ade90 2024-04-02T07:33:27.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec88c00640 1 -- 172.21.15.55:0/4103170047 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c0b65f0 con 0x7fec8c0ade90 2024-04-02T07:33:27.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec88c00640 1 -- 172.21.15.55:0/4103170047 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c0b69a0 con 0x7fec8c0ade90 2024-04-02T07:33:27.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec93000640 1 -- 172.21.15.55:0/4103170047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8c151330 con 0x7fec8c0ade90 2024-04-02T07:33:27.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec93000640 1 -- 172.21.15.55:0/4103170047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec8c1518f0 con 0x7fec8c0ade90 2024-04-02T07:33:27.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec93000640 1 -- 172.21.15.55:0/4103170047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec8c073530 con 0x7fec8c0ade90 2024-04-02T07:33:27.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.636+0000 7fec88c00640 1 -- 172.21.15.55:0/4103170047 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fec7c0b6b00 con 0x7fec8c0ade90 2024-04-02T07:33:27.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.640+0000 7fec88c00640 1 --2- 172.21.15.55:0/4103170047 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec68066690 0x7fec68068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:27.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.640+0000 7fec88c00640 1 -- 172.21.15.55:0/4103170047 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fec7c11e9b0 con 0x7fec8c0ade90 2024-04-02T07:33:27.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.640+0000 7fec83400640 1 --2- 172.21.15.55:0/4103170047 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec68066690 0x7fec68068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:27.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.640+0000 7fec83400640 1 --2- 172.21.15.55:0/4103170047 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec68066690 0x7fec68068b50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fec8c138110 tx=0x7fec74007e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:27.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.644+0000 7fec88c00640 1 -- 172.21.15.55:0/4103170047 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fec7c0ebd90 con 0x7fec8c0ade90 2024-04-02T07:33:27.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.840+0000 7fec93000640 1 -- 172.21.15.55:0/4103170047 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fec8c151ae0 con 0x7fec8c0ade90 2024-04-02T07:33:27.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.844+0000 7fec88c00640 1 -- 172.21.15.55:0/4103170047 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v93) v1 ==== 174+0+0 (secure 0 0 0) 0x7fec7c0b1020 con 0x7fec8c0ade90 2024-04-02T07:33:27.848 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 16 and data pool 17 2024-04-02T07:33:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.852+0000 7fec93000640 1 -- 172.21.15.55:0/4103170047 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec68066690 msgr2=0x7fec68068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.852+0000 7fec93000640 1 --2- 172.21.15.55:0/4103170047 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec68066690 0x7fec68068b50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fec8c138110 tx=0x7fec74007e50 comp rx=0 tx=0).stop 2024-04-02T07:33:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.852+0000 7fec93000640 1 -- 172.21.15.55:0/4103170047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec8c0ade90 msgr2=0x7fec8c1370b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:27.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.852+0000 7fec93000640 1 --2- 172.21.15.55:0/4103170047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec8c0ade90 0x7fec8c1370b0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0af040 tx=0x7fec7c019240 comp rx=0 tx=0).stop 2024-04-02T07:33:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.852+0000 7fec93000640 1 -- 172.21.15.55:0/4103170047 shutdown_connections 2024-04-02T07:33:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.852+0000 7fec93000640 1 --2- 172.21.15.55:0/4103170047 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fec68066690 0x7fec68068b50 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.852+0000 7fec93000640 1 --2- 172.21.15.55:0/4103170047 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fec8c0b41a0 0x7fec8c156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.852+0000 7fec93000640 1 --2- 172.21.15.55:0/4103170047 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fec8c0b3dc0 0x7fec8c156500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.852+0000 7fec93000640 1 --2- 172.21.15.55:0/4103170047 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fec8c0ade90 0x7fec8c1370b0 secure :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fec7c0af040 tx=0x7fec7c019240 comp rx=0 tx=0).stop 2024-04-02T07:33:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.852+0000 7fec93000640 1 -- 172.21.15.55:0/4103170047 >> 172.21.15.55:0/4103170047 conn(0x7fec8c06a390 msgr2=0x7fec8c0b1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:27.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.852+0000 7fec93000640 1 -- 172.21.15.55:0/4103170047 shutdown_connections 2024-04-02T07:33:27.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:27.852+0000 7fec93000640 1 -- 172.21.15.55:0/4103170047 wait complete. 2024-04-02T07:33:27.894 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:33:28.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.032+0000 7f887ae00640 1 Processor -- start 2024-04-02T07:33:28.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.032+0000 7f887ae00640 1 -- start start 2024-04-02T07:33:28.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.032+0000 7f887ae00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f887415ca70 0x7f88740b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:28.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.032+0000 7f887ae00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8874098a10 0x7f8874098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:28.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.032+0000 7f887ae00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88740993b0 con 0x7f887406aff0 2024-04-02T07:33:28.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.032+0000 7f887ae00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f887415ce50 con 0x7f887415ca70 2024-04-02T07:33:28.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.032+0000 7f887ae00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88740cef60 con 0x7f8874098a10 2024-04-02T07:33:28.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.032+0000 7f8873e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f887415ca70 0x7f88740b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:28.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.032+0000 7f8873e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f887415ca70 0x7f88740b0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33074/0 (socket says 172.21.15.55:33074) 2024-04-02T07:33:28.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.032+0000 7f8873e00640 1 -- 172.21.15.55:0/3990099572 learned_addr learned my addr 172.21.15.55:0/3990099572 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:28.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.032+0000 7f886b400640 1 --2- 172.21.15.55:0/3990099572 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8874098a10 0x7f8874098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:28.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.032+0000 7f8873e00640 1 -- 172.21.15.55:0/3990099572 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8874098a10 msgr2=0x7f8874098e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:28.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.032+0000 7f8873e00640 1 --2- 172.21.15.55:0/3990099572 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8874098a10 0x7f8874098e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.032+0000 7f8873e00640 1 -- 172.21.15.55:0/3990099572 >> v1:172.21.15.106:6789/0 conn(0x7f887406aff0 legacy=0x7f887406b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:28.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.032+0000 7f8873e00640 1 -- 172.21.15.55:0/3990099572 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f887406bd60 con 0x7f887415ca70 2024-04-02T07:33:28.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.036+0000 7f8873e00640 1 --2- 172.21.15.55:0/3990099572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f887415ca70 0x7f88740b0040 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f8864009870 tx=0x7f886401c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdcc74437c9bfc7b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:28.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.036+0000 7f8873400640 1 -- 172.21.15.55:0/3990099572 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88640ab650 con 0x7f887415ca70 2024-04-02T07:33:28.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.036+0000 7f8873400640 1 -- 172.21.15.55:0/3990099572 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88640ab7b0 con 0x7f887415ca70 2024-04-02T07:33:28.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.036+0000 7f8873400640 1 -- 172.21.15.55:0/3990099572 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88640abb40 con 0x7f887415ca70 2024-04-02T07:33:28.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.036+0000 7f887ae00640 1 -- 172.21.15.55:0/3990099572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f887415ca70 msgr2=0x7f88740b0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:28.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.036+0000 7f887ae00640 1 --2- 172.21.15.55:0/3990099572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f887415ca70 0x7f88740b0040 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7f8864009870 tx=0x7f886401c560 comp rx=0 tx=0).stop 2024-04-02T07:33:28.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.036+0000 7f887ae00640 1 -- 172.21.15.55:0/3990099572 shutdown_connections 2024-04-02T07:33:28.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.036+0000 7f887ae00640 1 --2- 172.21.15.55:0/3990099572 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8874098a10 0x7f8874098e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.036+0000 7f887ae00640 1 --2- 172.21.15.55:0/3990099572 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f887415ca70 0x7f88740b0040 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.036+0000 7f887ae00640 1 -- 172.21.15.55:0/3990099572 >> 172.21.15.55:0/3990099572 conn(0x7f88740b21d0 msgr2=0x7f88740b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:28.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.036+0000 7f887ae00640 1 -- 172.21.15.55:0/3990099572 shutdown_connections 2024-04-02T07:33:28.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.036+0000 7f887ae00640 1 -- 172.21.15.55:0/3990099572 wait complete. 2024-04-02T07:33:28.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f887ae00640 1 Processor -- start 2024-04-02T07:33:28.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f887ae00640 1 -- start start 2024-04-02T07:33:28.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f887ae00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f887406aff0 0x7f8874152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:28.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f887ae00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8874098a10 0x7f887415ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:28.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f887ae00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f887415ca70 0x7f887415f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:28.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f887ae00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8874153ee0 con 0x7f8874098a10 2024-04-02T07:33:28.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f887ae00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8874153340 con 0x7f887406aff0 2024-04-02T07:33:28.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f887ae00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88741535b0 con 0x7f887415ca70 2024-04-02T07:33:28.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f886b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8874098a10 0x7f887415ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:28.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f886b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8874098a10 0x7f887415ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33078/0 (socket says 172.21.15.55:33078) 2024-04-02T07:33:28.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f886b400640 1 -- 172.21.15.55:0/1340159321 learned_addr learned my addr 172.21.15.55:0/1340159321 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:28.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f8878e00640 1 --2- 172.21.15.55:0/1340159321 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f887415ca70 0x7f887415f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:28.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f8873e00640 1 --2- 172.21.15.55:0/1340159321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f887406aff0 0x7f8874152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:28.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f886b400640 1 -- 172.21.15.55:0/1340159321 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f887415ca70 msgr2=0x7f887415f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:28.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f886b400640 1 --2- 172.21.15.55:0/1340159321 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f887415ca70 0x7f887415f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f886b400640 1 -- 172.21.15.55:0/1340159321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f887406aff0 msgr2=0x7f8874152a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:28.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f886b400640 1 --2- 172.21.15.55:0/1340159321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f887406aff0 0x7f8874152a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.043 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f886b400640 1 -- 172.21.15.55:0/1340159321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88640094d0 con 0x7f8874098a10 2024-04-02T07:33:28.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f886b400640 1 --2- 172.21.15.55:0/1340159321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8874098a10 0x7f887415ed50 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f885c00d800 tx=0x7f885c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:28.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f8870c00640 1 -- 172.21.15.55:0/1340159321 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c00b6c0 con 0x7f8874098a10 2024-04-02T07:33:28.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f8870c00640 1 -- 172.21.15.55:0/1340159321 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885c00b820 con 0x7f8874098a10 2024-04-02T07:33:28.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f8870c00640 1 -- 172.21.15.55:0/1340159321 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885c00bb90 con 0x7f8874098a10 2024-04-02T07:33:28.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f887ae00640 1 -- 172.21.15.55:0/1340159321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8874153890 con 0x7f8874098a10 2024-04-02T07:33:28.044 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.040+0000 7f887ae00640 1 -- 172.21.15.55:0/1340159321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8874152fa0 con 0x7f8874098a10 2024-04-02T07:33:28.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.044+0000 7f887ae00640 1 -- 172.21.15.55:0/1340159321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88740afe90 con 0x7f8874098a10 2024-04-02T07:33:28.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.044+0000 7f8870c00640 1 -- 172.21.15.55:0/1340159321 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f885c00bcf0 con 0x7f8874098a10 2024-04-02T07:33:28.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.044+0000 7f8870c00640 1 --2- 172.21.15.55:0/1340159321 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8850066690 0x7f8850068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:28.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.044+0000 7f8870c00640 1 -- 172.21.15.55:0/1340159321 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f885c084650 con 0x7f8874098a10 2024-04-02T07:33:28.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.044+0000 7f8873e00640 1 --2- 172.21.15.55:0/1340159321 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8850066690 0x7f8850068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:28.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.044+0000 7f8873e00640 1 --2- 172.21.15.55:0/1340159321 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8850066690 0x7f8850068b50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f88640af000 tx=0x7f88640b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:28.050 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.048+0000 7f8870c00640 1 -- 172.21.15.55:0/1340159321 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f885c0519d0 con 0x7f8874098a10 2024-04-02T07:33:28.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.216+0000 7f887ae00640 1 -- 172.21.15.55:0/1340159321 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8874066c90 con 0x7f8874098a10 2024-04-02T07:33:28.218 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.216+0000 7f8870c00640 1 -- 172.21.15.55:0/1340159321 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+16072 (secure 0 0 0) 0x7f885c054ff0 con 0x7f8874098a10 2024-04-02T07:33:28.218 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:28.218 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":115,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:33:27.846111+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:33:26.384276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-02T07:33:26.835969+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:33:28.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.216+0000 7f887ae00640 1 -- 172.21.15.55:0/1340159321 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8850066690 msgr2=0x7f8850068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:28.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.216+0000 7f887ae00640 1 --2- 172.21.15.55:0/1340159321 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8850066690 0x7f8850068b50 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f88640af000 tx=0x7f88640b6040 comp rx=0 tx=0).stop 2024-04-02T07:33:28.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.216+0000 7f887ae00640 1 -- 172.21.15.55:0/1340159321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8874098a10 msgr2=0x7f887415ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:28.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.216+0000 7f887ae00640 1 --2- 172.21.15.55:0/1340159321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8874098a10 0x7f887415ed50 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f885c00d800 tx=0x7f885c00dcc0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.216+0000 7f887ae00640 1 -- 172.21.15.55:0/1340159321 shutdown_connections 2024-04-02T07:33:28.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.216+0000 7f887ae00640 1 --2- 172.21.15.55:0/1340159321 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f887415ca70 0x7f887415f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.216+0000 7f887ae00640 1 --2- 172.21.15.55:0/1340159321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8874098a10 0x7f887415ed50 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.216+0000 7f887ae00640 1 --2- 172.21.15.55:0/1340159321 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8850066690 0x7f8850068b50 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.220 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.216+0000 7f887ae00640 1 --2- 172.21.15.55:0/1340159321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f887406aff0 0x7f8874152a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.216+0000 7f887ae00640 1 -- 172.21.15.55:0/1340159321 >> 172.21.15.55:0/1340159321 conn(0x7f88740b21d0 msgr2=0x7f887415bcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:28.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.216+0000 7f887ae00640 1 -- 172.21.15.55:0/1340159321 shutdown_connections 2024-04-02T07:33:28.221 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.216+0000 7f887ae00640 1 -- 172.21.15.55:0/1340159321 wait complete. 2024-04-02T07:33:28.240 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:33:28.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.376+0000 7f3763000640 1 Processor -- start 2024-04-02T07:33:28.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.376+0000 7f3763000640 1 -- start start 2024-04-02T07:33:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.380+0000 7f3763000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f375c143f90 0x7f375c15ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.380+0000 7f3763000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375c15b270 con 0x7f375c0b34f0 2024-04-02T07:33:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.380+0000 7f3763000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375c144370 con 0x7f375c0cda80 2024-04-02T07:33:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.380+0000 7f3763000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375c0c37b0 con 0x7f375c143f90 2024-04-02T07:33:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.380+0000 7f375be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f375c143f90 0x7f375c15ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.380+0000 7f375be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f375c143f90 0x7f375c15ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33092/0 (socket says 172.21.15.55:33092) 2024-04-02T07:33:28.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.380+0000 7f375be00640 1 -- 172.21.15.55:0/3574185690 learned_addr learned my addr 172.21.15.55:0/3574185690 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:28.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.380+0000 7f375be00640 1 -- 172.21.15.55:0/3574185690 >> v1:172.21.15.106:6789/0 conn(0x7f375c0cda80 legacy=0x7f375c0c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:28.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.380+0000 7f375be00640 1 -- 172.21.15.55:0/3574185690 >> v1:172.21.15.55:6789/0 conn(0x7f375c0b34f0 legacy=0x7f375c0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:28.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.380+0000 7f375b400640 1 -- 172.21.15.55:0/3574185690 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4045060730 0 0) 0x7f375c15b270 con 0x7f375c0b34f0 2024-04-02T07:33:28.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.380+0000 7f375be00640 1 -- 172.21.15.55:0/3574185690 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375c0c3a90 con 0x7f375c143f90 2024-04-02T07:33:28.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.384+0000 7f375be00640 1 --2- 172.21.15.55:0/3574185690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375c143f90 0x7f375c15ad30 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f374c009870 tx=0x7f374c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6834b32d17252ae server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:28.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.384+0000 7f375b400640 1 -- 172.21.15.55:0/3574185690 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c0ab660 con 0x7f375c143f90 2024-04-02T07:33:28.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.384+0000 7f375b400640 1 -- 172.21.15.55:0/3574185690 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c0ab7c0 con 0x7f375c143f90 2024-04-02T07:33:28.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.384+0000 7f375b400640 1 -- 172.21.15.55:0/3574185690 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c0abb50 con 0x7f375c143f90 2024-04-02T07:33:28.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.384+0000 7f3763000640 1 -- 172.21.15.55:0/3574185690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375c143f90 msgr2=0x7f375c15ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:28.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.384+0000 7f3763000640 1 --2- 172.21.15.55:0/3574185690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375c143f90 0x7f375c15ad30 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f374c009870 tx=0x7f374c01c460 comp rx=0 tx=0).stop 2024-04-02T07:33:28.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.384+0000 7f3763000640 1 -- 172.21.15.55:0/3574185690 shutdown_connections 2024-04-02T07:33:28.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.384+0000 7f3763000640 1 --2- 172.21.15.55:0/3574185690 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375c143f90 0x7f375c15ad30 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.384+0000 7f3763000640 1 -- 172.21.15.55:0/3574185690 >> 172.21.15.55:0/3574185690 conn(0x7f375c066080 msgr2=0x7f375c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:28.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.384+0000 7f3763000640 1 -- 172.21.15.55:0/3574185690 shutdown_connections 2024-04-02T07:33:28.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.384+0000 7f3763000640 1 -- 172.21.15.55:0/3574185690 wait complete. 2024-04-02T07:33:28.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.384+0000 7f3763000640 1 Processor -- start 2024-04-02T07:33:28.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.384+0000 7f3763000640 1 -- start start 2024-04-02T07:33:28.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3763000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f375c0b34f0 0x7f375c0c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:28.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3763000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f375c0cda80 0x7f375c159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:28.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3763000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375c143f90 0x7f375c0c6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:28.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3763000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c1437c0 con 0x7f375c143f90 2024-04-02T07:33:28.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3763000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f375c1560e0 con 0x7f375c0b34f0 2024-04-02T07:33:28.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3763000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f375c143200 con 0x7f375c0cda80 2024-04-02T07:33:28.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3761000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375c143f90 0x7f375c0c6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:28.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3761000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375c143f90 0x7f375c0c6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33104/0 (socket says 172.21.15.55:33104) 2024-04-02T07:33:28.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3761000640 1 -- 172.21.15.55:0/3458546433 learned_addr learned my addr 172.21.15.55:0/3458546433 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:28.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f375be00640 1 --2- 172.21.15.55:0/3458546433 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f375c0b34f0 0x7f375c0c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:28.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3753e00640 1 --2- 172.21.15.55:0/3458546433 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f375c0cda80 0x7f375c159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:28.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3761000640 1 -- 172.21.15.55:0/3458546433 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f375c0cda80 msgr2=0x7f375c159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:28.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3761000640 1 --2- 172.21.15.55:0/3458546433 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f375c0cda80 0x7f375c159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3761000640 1 -- 172.21.15.55:0/3458546433 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f375c0b34f0 msgr2=0x7f375c0c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:28.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3761000640 1 --2- 172.21.15.55:0/3458546433 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f375c0b34f0 0x7f375c0c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3761000640 1 -- 172.21.15.55:0/3458546433 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f374c0094d0 con 0x7f375c143f90 2024-04-02T07:33:28.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3761000640 1 --2- 172.21.15.55:0/3458546433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375c143f90 0x7f375c0c6c30 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f375400c780 tx=0x7f375400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:28.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3758c00640 1 -- 172.21.15.55:0/3458546433 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375400a9f0 con 0x7f375c143f90 2024-04-02T07:33:28.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3758c00640 1 -- 172.21.15.55:0/3458546433 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f375400ce90 con 0x7f375c143f90 2024-04-02T07:33:28.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3758c00640 1 -- 172.21.15.55:0/3458546433 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f375400add0 con 0x7f375c143f90 2024-04-02T07:33:28.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3763000640 1 -- 172.21.15.55:0/3458546433 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f375c1434e0 con 0x7f375c143f90 2024-04-02T07:33:28.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3763000640 1 -- 172.21.15.55:0/3458546433 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f375c142ef0 con 0x7f375c143f90 2024-04-02T07:33:28.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.388+0000 7f3763000640 1 -- 172.21.15.55:0/3458546433 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375c066c90 con 0x7f375c143f90 2024-04-02T07:33:28.394 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.392+0000 7f3758c00640 1 -- 172.21.15.55:0/3458546433 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3754024430 con 0x7f375c143f90 2024-04-02T07:33:28.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.392+0000 7f3758c00640 1 --2- 172.21.15.55:0/3458546433 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3738066690 0x7f3738068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:28.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.392+0000 7f3758c00640 1 -- 172.21.15.55:0/3458546433 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f37540845d0 con 0x7f375c143f90 2024-04-02T07:33:28.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.392+0000 7f375be00640 1 --2- 172.21.15.55:0/3458546433 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3738066690 0x7f3738068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:28.396 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.396+0000 7f375be00640 1 --2- 172.21.15.55:0/3458546433 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3738066690 0x7f3738068b50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f374c0af000 tx=0x7f374c0b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:28.397 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.396+0000 7f3758c00640 1 -- 172.21.15.55:0/3458546433 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3754051a60 con 0x7f375c143f90 2024-04-02T07:33:28.560 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.556+0000 7f3763000640 1 -- 172.21.15.55:0/3458546433 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f375c071700 con 0x7f375c143f90 2024-04-02T07:33:28.561 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.560+0000 7f3758c00640 1 -- 172.21.15.55:0/3458546433 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v115) v1 ==== 74+0+16072 (secure 0 0 0) 0x7f3754016090 con 0x7f375c143f90 2024-04-02T07:33:28.561 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:28.561 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":115,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:33:27.846111+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:33:26.384276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-02T07:33:26.835969+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:33:28.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.560+0000 7f3763000640 1 -- 172.21.15.55:0/3458546433 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3738066690 msgr2=0x7f3738068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:28.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.560+0000 7f3763000640 1 --2- 172.21.15.55:0/3458546433 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3738066690 0x7f3738068b50 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f374c0af000 tx=0x7f374c0b6040 comp rx=0 tx=0).stop 2024-04-02T07:33:28.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.560+0000 7f3763000640 1 -- 172.21.15.55:0/3458546433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375c143f90 msgr2=0x7f375c0c6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:28.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.560+0000 7f3763000640 1 --2- 172.21.15.55:0/3458546433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375c143f90 0x7f375c0c6c30 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f375400c780 tx=0x7f375400cc40 comp rx=0 tx=0).stop 2024-04-02T07:33:28.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.560+0000 7f3763000640 1 -- 172.21.15.55:0/3458546433 shutdown_connections 2024-04-02T07:33:28.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.560+0000 7f3763000640 1 --2- 172.21.15.55:0/3458546433 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f375c143f90 0x7f375c0c6c30 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.560+0000 7f3763000640 1 --2- 172.21.15.55:0/3458546433 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f375c0cda80 0x7f375c159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.560+0000 7f3763000640 1 --2- 172.21.15.55:0/3458546433 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3738066690 0x7f3738068b50 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.560+0000 7f3763000640 1 --2- 172.21.15.55:0/3458546433 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f375c0b34f0 0x7f375c0c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.560+0000 7f3763000640 1 -- 172.21.15.55:0/3458546433 >> 172.21.15.55:0/3458546433 conn(0x7f375c066080 msgr2=0x7f375c15d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:28.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.560+0000 7f3763000640 1 -- 172.21.15.55:0/3458546433 shutdown_connections 2024-04-02T07:33:28.564 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.560+0000 7f3763000640 1 -- 172.21.15.55:0/3458546433 wait complete. 2024-04-02T07:33:28.583 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-02T07:33:28.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.724+0000 7f7d33c00640 1 Processor -- start 2024-04-02T07:33:28.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.724+0000 7f7d33c00640 1 -- start start 2024-04-02T07:33:28.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.724+0000 7f7d33c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7d2c0cc5b0 0x7f7d2c0b0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:28.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.724+0000 7f7d33c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7d2c0b0d40 0x7f7d2c164390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:28.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.724+0000 7f7d33c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d2c0cb0e0 con 0x7f7d2c0ceb50 2024-04-02T07:33:28.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.724+0000 7f7d33c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d2c0b1560 con 0x7f7d2c0b0d40 2024-04-02T07:33:28.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.724+0000 7f7d33c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d2c0b1840 con 0x7f7d2c0cc5b0 2024-04-02T07:33:28.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.724+0000 7f7d31c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7d2c0b0d40 0x7f7d2c164390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:28.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.724+0000 7f7d31c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7d2c0b0d40 0x7f7d2c164390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33112/0 (socket says 172.21.15.55:33112) 2024-04-02T07:33:28.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.724+0000 7f7d31c00640 1 -- 172.21.15.55:0/866846428 learned_addr learned my addr 172.21.15.55:0/866846428 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:28.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.724+0000 7f7d2be00640 1 --2- 172.21.15.55:0/866846428 >> v2:172.21.15.106:3300/0 conn(0x7f7d2c0cc5b0 0x7f7d2c0b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:28.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.724+0000 7f7d31c00640 1 -- 172.21.15.55:0/866846428 >> v2:172.21.15.106:3300/0 conn(0x7f7d2c0cc5b0 msgr2=0x7f7d2c0b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:28.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.724+0000 7f7d31c00640 1 --2- 172.21.15.55:0/866846428 >> v2:172.21.15.106:3300/0 conn(0x7f7d2c0cc5b0 0x7f7d2c0b0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.724+0000 7f7d31c00640 1 -- 172.21.15.55:0/866846428 >> v1:172.21.15.106:6789/0 conn(0x7f7d2c0ceb50 legacy=0x7f7d2c0cef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:28.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.724+0000 7f7d31c00640 1 -- 172.21.15.55:0/866846428 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d2c0b1b20 con 0x7f7d2c0b0d40 2024-04-02T07:33:28.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.728+0000 7f7d31c00640 1 --2- 172.21.15.55:0/866846428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d2c0b0d40 0x7f7d2c164390 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c0b3280 tx=0x7f7d2401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c579ea8c78470d2a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:28.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.728+0000 7f7d2b400640 1 -- 172.21.15.55:0/866846428 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d240a5730 con 0x7f7d2c0b0d40 2024-04-02T07:33:28.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.728+0000 7f7d2b400640 1 -- 172.21.15.55:0/866846428 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d240a5890 con 0x7f7d2c0b0d40 2024-04-02T07:33:28.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.728+0000 7f7d2b400640 1 -- 172.21.15.55:0/866846428 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d240a5c20 con 0x7f7d2c0b0d40 2024-04-02T07:33:28.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.728+0000 7f7d33c00640 1 -- 172.21.15.55:0/866846428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d2c0b0d40 msgr2=0x7f7d2c164390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:28.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.728+0000 7f7d33c00640 1 --2- 172.21.15.55:0/866846428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d2c0b0d40 0x7f7d2c164390 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c0b3280 tx=0x7f7d2401c960 comp rx=0 tx=0).stop 2024-04-02T07:33:28.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.728+0000 7f7d33c00640 1 -- 172.21.15.55:0/866846428 shutdown_connections 2024-04-02T07:33:28.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.728+0000 7f7d33c00640 1 --2- 172.21.15.55:0/866846428 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d2c0b0d40 0x7f7d2c164390 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.728+0000 7f7d33c00640 1 --2- 172.21.15.55:0/866846428 >> v2:172.21.15.106:3300/0 conn(0x7f7d2c0cc5b0 0x7f7d2c0b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.728+0000 7f7d33c00640 1 -- 172.21.15.55:0/866846428 >> 172.21.15.55:0/866846428 conn(0x7f7d2c0d0700 msgr2=0x7f7d2c0d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:28.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.728+0000 7f7d33c00640 1 -- 172.21.15.55:0/866846428 shutdown_connections 2024-04-02T07:33:28.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.728+0000 7f7d33c00640 1 -- 172.21.15.55:0/866846428 wait complete. 2024-04-02T07:33:28.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d33c00640 1 Processor -- start 2024-04-02T07:33:28.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d33c00640 1 -- start start 2024-04-02T07:33:28.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d33c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d2c0b0d40 0x7f7d2c155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:28.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d33c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d2c0cc5b0 0x7f7d2c1556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:28.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d33c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d2c0ceb50 0x7f7d2c06f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:28.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d33c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2c155c20 con 0x7f7d2c0b0d40 2024-04-02T07:33:28.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d33c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2c0c3e30 con 0x7f7d2c0ceb50 2024-04-02T07:33:28.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d33c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d2c0c4110 con 0x7f7d2c0cc5b0 2024-04-02T07:33:28.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d31200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d2c0b0d40 0x7f7d2c155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:28.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d31200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d2c0b0d40 0x7f7d2c155da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33126/0 (socket says 172.21.15.55:33126) 2024-04-02T07:33:28.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d31200640 1 -- 172.21.15.55:0/2027394563 learned_addr learned my addr 172.21.15.55:0/2027394563 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:28.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d2be00640 1 --2- 172.21.15.55:0/2027394563 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d2c0cc5b0 0x7f7d2c1556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:28.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d31c00640 1 --2- 172.21.15.55:0/2027394563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d2c0ceb50 0x7f7d2c06f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:28.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d31200640 1 -- 172.21.15.55:0/2027394563 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d2c0cc5b0 msgr2=0x7f7d2c1556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:28.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d31200640 1 --2- 172.21.15.55:0/2027394563 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d2c0cc5b0 0x7f7d2c1556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d31200640 1 -- 172.21.15.55:0/2027394563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d2c0ceb50 msgr2=0x7f7d2c06f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:28.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d31200640 1 --2- 172.21.15.55:0/2027394563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d2c0ceb50 0x7f7d2c06f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:28.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d31200640 1 -- 172.21.15.55:0/2027394563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d24009b30 con 0x7f7d2c0b0d40 2024-04-02T07:33:28.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d31c00640 1 --2- 172.21.15.55:0/2027394563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d2c0ceb50 0x7f7d2c06f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:28.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d31200640 1 --2- 172.21.15.55:0/2027394563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d2c0b0d40 0x7f7d2c155da0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000c3c0 tx=0x7f7d2000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:28.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d28c00640 1 -- 172.21.15.55:0/2027394563 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d200052d0 con 0x7f7d2c0b0d40 2024-04-02T07:33:28.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d28c00640 1 -- 172.21.15.55:0/2027394563 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d20005430 con 0x7f7d2c0b0d40 2024-04-02T07:33:28.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d28c00640 1 -- 172.21.15.55:0/2027394563 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d20003840 con 0x7f7d2c0b0d40 2024-04-02T07:33:28.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d33c00640 1 -- 172.21.15.55:0/2027394563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d2c0c43f0 con 0x7f7d2c0b0d40 2024-04-02T07:33:28.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d33c00640 1 -- 172.21.15.55:0/2027394563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d2c159a30 con 0x7f7d2c0b0d40 2024-04-02T07:33:28.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.732+0000 7f7d33c00640 1 -- 172.21.15.55:0/2027394563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d2c066c90 con 0x7f7d2c0b0d40 2024-04-02T07:33:28.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.736+0000 7f7d28c00640 1 -- 172.21.15.55:0/2027394563 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7d200039a0 con 0x7f7d2c0b0d40 2024-04-02T07:33:28.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.736+0000 7f7d28c00640 1 --2- 172.21.15.55:0/2027394563 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7d0c0666c0 0x7f7d0c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:28.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.736+0000 7f7d28c00640 1 -- 172.21.15.55:0/2027394563 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d200835f0 con 0x7f7d2c0b0d40 2024-04-02T07:33:28.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.736+0000 7f7d2be00640 1 --2- 172.21.15.55:0/2027394563 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7d0c0666c0 0x7f7d0c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:28.738 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.736+0000 7f7d2be00640 1 --2- 172.21.15.55:0/2027394563 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7d0c0666c0 0x7f7d0c068b80 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c06a2a0 tx=0x7f7d18009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:28.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.740+0000 7f7d28c00640 1 -- 172.21.15.55:0/2027394563 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7d20050a00 con 0x7f7d2c0b0d40 2024-04-02T07:33:28.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:28.936+0000 7f7d33c00640 1 -- 172.21.15.55:0/2027394563 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f7d2c0c48a0 con 0x7f7d2c0b0d40 2024-04-02T07:33:29.357 INFO:tasks.ceph.mds.d.smithi106.stderr:2024-04-02T07:33:29.358+0000 7fc8b4600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:33:29.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:29.852+0000 7f7d28c00640 1 -- 172.21.15.55:0/2027394563 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v95) v1 ==== 118+0+0 (secure 0 0 0) 0x7f7d20054020 con 0x7f7d2c0b0d40 2024-04-02T07:33:29.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:29.856+0000 7f7d33c00640 1 -- 172.21.15.55:0/2027394563 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7d0c0666c0 msgr2=0x7f7d0c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:29.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:29.856+0000 7f7d33c00640 1 --2- 172.21.15.55:0/2027394563 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7d0c0666c0 0x7f7d0c068b80 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7d2c06a2a0 tx=0x7f7d18009190 comp rx=0 tx=0).stop 2024-04-02T07:33:29.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:29.856+0000 7f7d33c00640 1 -- 172.21.15.55:0/2027394563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d2c0b0d40 msgr2=0x7f7d2c155da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:29.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:29.856+0000 7f7d33c00640 1 --2- 172.21.15.55:0/2027394563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d2c0b0d40 0x7f7d2c155da0 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f7d2000c3c0 tx=0x7f7d2000c880 comp rx=0 tx=0).stop 2024-04-02T07:33:29.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:29.856+0000 7f7d33c00640 1 -- 172.21.15.55:0/2027394563 shutdown_connections 2024-04-02T07:33:29.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:29.856+0000 7f7d33c00640 1 --2- 172.21.15.55:0/2027394563 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7d0c0666c0 0x7f7d0c068b80 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:29.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:29.856+0000 7f7d33c00640 1 --2- 172.21.15.55:0/2027394563 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7d2c0ceb50 0x7f7d2c06f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:29.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:29.856+0000 7f7d33c00640 1 --2- 172.21.15.55:0/2027394563 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7d2c0cc5b0 0x7f7d2c1556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:29.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:29.856+0000 7f7d33c00640 1 --2- 172.21.15.55:0/2027394563 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7d2c0b0d40 0x7f7d2c155da0 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:29.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:29.856+0000 7f7d33c00640 1 -- 172.21.15.55:0/2027394563 >> 172.21.15.55:0/2027394563 conn(0x7f7d2c0d0700 msgr2=0x7f7d2c0cc990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:29.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:29.856+0000 7f7d33c00640 1 -- 172.21.15.55:0/2027394563 shutdown_connections 2024-04-02T07:33:29.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:29.856+0000 7f7d33c00640 1 -- 172.21.15.55:0/2027394563 wait complete. 2024-04-02T07:33:29.878 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-04-02T07:33:29.879 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-02T07:33:30.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe616200640 1 Processor -- start 2024-04-02T07:33:30.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe616200640 1 -- start start 2024-04-02T07:33:30.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe616200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe61006c030 0x7fe610098e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:30.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe616200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61015ce40 con 0x7fe61015ca60 2024-04-02T07:33:30.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe616200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6100ceeb0 con 0x7fe610098a10 2024-04-02T07:33:30.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe616200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe61006c440 con 0x7fe61006c030 2024-04-02T07:33:30.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60f400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe61015ca60 0x7fe6100cfc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54508/0 (socket says 172.21.15.55:54508) 2024-04-02T07:33:30.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60f400640 1 -- 172.21.15.55:0/1115836413 learned_addr learned my addr 172.21.15.55:0/1115836413 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:30.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60fe00640 1 --2- 172.21.15.55:0/1115836413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe61006c030 0x7fe610098e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:30.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60ea00640 1 -- 172.21.15.55:0/1115836413 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 360746575 0 0) 0x7fe61015ce40 con 0x7fe61015ca60 2024-04-02T07:33:30.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60ea00640 1 -- 172.21.15.55:0/1115836413 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5f4003530 con 0x7fe61015ca60 2024-04-02T07:33:30.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60ea00640 1 -- 172.21.15.55:0/1115836413 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2647619545 0 0) 0x7fe5f4003530 con 0x7fe61015ca60 2024-04-02T07:33:30.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60ea00640 1 -- 172.21.15.55:0/1115836413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe61006c030 msgr2=0x7fe610098e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:30.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60ea00640 1 --2- 172.21.15.55:0/1115836413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe61006c030 0x7fe610098e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:30.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60ea00640 1 -- 172.21.15.55:0/1115836413 >> v1:172.21.15.106:6789/0 conn(0x7fe610098a10 legacy=0x7fe61006b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:30.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60ea00640 1 -- 172.21.15.55:0/1115836413 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6100cf190 con 0x7fe61015ca60 2024-04-02T07:33:30.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60ea00640 1 -- 172.21.15.55:0/1115836413 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fe600001680 con 0x7fe61015ca60 2024-04-02T07:33:30.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60ea00640 1 -- 172.21.15.55:0/1115836413 >> v1:172.21.15.55:6789/0 conn(0x7fe61015ca60 legacy=0x7fe6100cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:30.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60ea00640 1 --2- 172.21.15.55:0/1115836413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5f40039b0 0x7fe5f4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:30.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60ea00640 1 --2- 172.21.15.55:0/1115836413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe61006c030 0x7fe5f40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:30.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60ea00640 1 --2- 172.21.15.55:0/1115836413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5f4004d10 0x7fe5f4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:30.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60ea00640 1 -- 172.21.15.55:0/1115836413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61006c440 con 0x7fe5f4004d10 2024-04-02T07:33:30.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60ea00640 1 -- 172.21.15.55:0/1115836413 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f400ba40 con 0x7fe5f40039b0 2024-04-02T07:33:30.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60ea00640 1 -- 172.21.15.55:0/1115836413 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f400bc00 con 0x7fe61006c030 2024-04-02T07:33:30.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60fe00640 1 --2- 172.21.15.55:0/1115836413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5f4004d10 0x7fe5f4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:30.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60f400640 1 --2- 172.21.15.55:0/1115836413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5f40039b0 0x7fe5f4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:30.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe606a00640 1 --2- 172.21.15.55:0/1115836413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe61006c030 0x7fe5f40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:30.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60fe00640 1 -- 172.21.15.55:0/1115836413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe61006c030 msgr2=0x7fe5f40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:30.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60fe00640 1 --2- 172.21.15.55:0/1115836413 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe61006c030 0x7fe5f40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:30.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60fe00640 1 -- 172.21.15.55:0/1115836413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5f40039b0 msgr2=0x7fe5f4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:30.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60fe00640 1 --2- 172.21.15.55:0/1115836413 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5f40039b0 0x7fe5f4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:30.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.024+0000 7fe60fe00640 1 -- 172.21.15.55:0/1115836413 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f4003530 con 0x7fe5f4004d10 2024-04-02T07:33:30.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.028+0000 7fe60fe00640 1 --2- 172.21.15.55:0/1115836413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5f4004d10 0x7fe5f4005190 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fe608009fc0 tx=0x7fe60801cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acde59664007c7fe server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:30.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.028+0000 7fe60ea00640 1 -- 172.21.15.55:0/1115836413 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6080a5c90 con 0x7fe5f4004d10 2024-04-02T07:33:30.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.028+0000 7fe60ea00640 1 -- 172.21.15.55:0/1115836413 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60800f040 con 0x7fe5f4004d10 2024-04-02T07:33:30.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.028+0000 7fe60ea00640 1 -- 172.21.15.55:0/1115836413 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6080ad440 con 0x7fe5f4004d10 2024-04-02T07:33:30.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.028+0000 7fe616200640 1 -- 172.21.15.55:0/1115836413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5f4004d10 msgr2=0x7fe5f4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:30.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.028+0000 7fe616200640 1 --2- 172.21.15.55:0/1115836413 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5f4004d10 0x7fe5f4005190 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fe608009fc0 tx=0x7fe60801cc80 comp rx=0 tx=0).stop 2024-04-02T07:33:30.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.028+0000 7fe60fe00640 1 -- 172.21.15.55:0/1115836413 reap_dead start 2024-04-02T07:33:30.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.028+0000 7fe616200640 1 -- 172.21.15.55:0/1115836413 shutdown_connections 2024-04-02T07:33:30.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.028+0000 7fe616200640 1 -- 172.21.15.55:0/1115836413 >> 172.21.15.55:0/1115836413 conn(0x7fe6100b2150 msgr2=0x7fe6100b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:30.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.028+0000 7fe616200640 1 -- 172.21.15.55:0/1115836413 shutdown_connections 2024-04-02T07:33:30.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.028+0000 7fe616200640 1 -- 172.21.15.55:0/1115836413 wait complete. 2024-04-02T07:33:30.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe616200640 1 Processor -- start 2024-04-02T07:33:30.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe616200640 1 -- start start 2024-04-02T07:33:30.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe616200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5f4004d10 0x7fe6101490f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:30.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe616200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6100c7730 0x7fe6100b4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:30.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe616200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6100b4970 0x7fe6100cd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe616200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61015c0e0 con 0x7fe6100c7730 2024-04-02T07:33:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe616200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6100c7bb0 con 0x7fe5f4004d10 2024-04-02T07:33:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe616200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe610149780 con 0x7fe6100b4970 2024-04-02T07:33:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe606a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6100c7730 0x7fe6100b4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe606a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6100c7730 0x7fe6100b4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33134/0 (socket says 172.21.15.55:33134) 2024-04-02T07:33:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe606a00640 1 -- 172.21.15.55:0/2207044820 learned_addr learned my addr 172.21.15.55:0/2207044820 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe60fe00640 1 --2- 172.21.15.55:0/2207044820 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6100b4970 0x7fe6100cd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe606a00640 1 -- 172.21.15.55:0/2207044820 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6100b4970 msgr2=0x7fe6100cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe60f400640 1 --2- 172.21.15.55:0/2207044820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5f4004d10 0x7fe6101490f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe606a00640 1 --2- 172.21.15.55:0/2207044820 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6100b4970 0x7fe6100cd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe606a00640 1 -- 172.21.15.55:0/2207044820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5f4004d10 msgr2=0x7fe6101490f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe606a00640 1 --2- 172.21.15.55:0/2207044820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5f4004d10 0x7fe6101490f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe606a00640 1 -- 172.21.15.55:0/2207044820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe610149a60 con 0x7fe6100c7730 2024-04-02T07:33:30.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe60fe00640 1 --2- 172.21.15.55:0/2207044820 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6100b4970 0x7fe6100cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:30.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe60f400640 1 --2- 172.21.15.55:0/2207044820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5f4004d10 0x7fe6101490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:30.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe606a00640 1 --2- 172.21.15.55:0/2207044820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6100c7730 0x7fe6100b4430 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8011b70 tx=0x7fe5f800f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:30.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe607e00640 1 -- 172.21.15.55:0/2207044820 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8011c60 con 0x7fe6100c7730 2024-04-02T07:33:30.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe607e00640 1 -- 172.21.15.55:0/2207044820 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f8011de0 con 0x7fe6100c7730 2024-04-02T07:33:30.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe616200640 1 -- 172.21.15.55:0/2207044820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe610149d40 con 0x7fe6100c7730 2024-04-02T07:33:30.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe607e00640 1 -- 172.21.15.55:0/2207044820 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8005310 con 0x7fe6100c7730 2024-04-02T07:33:30.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.032+0000 7fe616200640 1 -- 172.21.15.55:0/2207044820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe61014a300 con 0x7fe6100c7730 2024-04-02T07:33:30.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.036+0000 7fe616200640 1 -- 172.21.15.55:0/2207044820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61014a520 con 0x7fe6100c7730 2024-04-02T07:33:30.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.036+0000 7fe607e00640 1 -- 172.21.15.55:0/2207044820 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe5f8003600 con 0x7fe6100c7730 2024-04-02T07:33:30.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.036+0000 7fe607e00640 1 --2- 172.21.15.55:0/2207044820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe5ec066690 0x7fe5ec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:30.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.036+0000 7fe607e00640 1 -- 172.21.15.55:0/2207044820 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe5f8087c20 con 0x7fe6100c7730 2024-04-02T07:33:30.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.036+0000 7fe60f400640 1 --2- 172.21.15.55:0/2207044820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe5ec066690 0x7fe5ec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:30.039 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.036+0000 7fe60f400640 1 --2- 172.21.15.55:0/2207044820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe5ec066690 0x7fe5ec068b50 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe6000010f0 tx=0x7fe600009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:30.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.040+0000 7fe607e00640 1 -- 172.21.15.55:0/2207044820 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fe5f8054ef0 con 0x7fe6100c7730 2024-04-02T07:33:30.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.236+0000 7fe616200640 1 -- 172.21.15.55:0/2207044820 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe610066c90 con 0x7fe6100c7730 2024-04-02T07:33:30.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.856+0000 7fe607e00640 1 -- 172.21.15.55:0/2207044820 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v96) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe5f80190c0 con 0x7fe6100c7730 2024-04-02T07:33:30.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.856+0000 7fe616200640 1 -- 172.21.15.55:0/2207044820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe5ec066690 msgr2=0x7fe5ec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:30.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.856+0000 7fe616200640 1 --2- 172.21.15.55:0/2207044820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe5ec066690 0x7fe5ec068b50 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fe6000010f0 tx=0x7fe600009040 comp rx=0 tx=0).stop 2024-04-02T07:33:30.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.856+0000 7fe616200640 1 -- 172.21.15.55:0/2207044820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6100c7730 msgr2=0x7fe6100b4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:30.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.856+0000 7fe616200640 1 --2- 172.21.15.55:0/2207044820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6100c7730 0x7fe6100b4430 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fe5f8011b70 tx=0x7fe5f800f5a0 comp rx=0 tx=0).stop 2024-04-02T07:33:30.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.856+0000 7fe616200640 1 -- 172.21.15.55:0/2207044820 shutdown_connections 2024-04-02T07:33:30.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.856+0000 7fe616200640 1 --2- 172.21.15.55:0/2207044820 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fe6100b4970 0x7fe6100cd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:30.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.856+0000 7fe616200640 1 --2- 172.21.15.55:0/2207044820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe6100c7730 0x7fe6100b4430 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:30.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.856+0000 7fe616200640 1 --2- 172.21.15.55:0/2207044820 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe5ec066690 0x7fe5ec068b50 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:30.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.856+0000 7fe616200640 1 --2- 172.21.15.55:0/2207044820 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fe5f4004d10 0x7fe6101490f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:30.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.856+0000 7fe616200640 1 -- 172.21.15.55:0/2207044820 >> 172.21.15.55:0/2207044820 conn(0x7fe6100b2150 msgr2=0x7fe61006fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:30.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.856+0000 7fe616200640 1 -- 172.21.15.55:0/2207044820 shutdown_connections 2024-04-02T07:33:30.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:30.856+0000 7fe616200640 1 -- 172.21.15.55:0/2207044820 wait complete. 2024-04-02T07:33:30.882 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-02T07:33:30.882 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:33:31.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.024+0000 7f1048000640 1 Processor -- start 2024-04-02T07:33:31.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.024+0000 7f1048000640 1 -- start start 2024-04-02T07:33:31.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.024+0000 7f1048000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f104015ee70 0x7f1040099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:31.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.024+0000 7f1048000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f104015f250 0x7f10400b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:31.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.024+0000 7f1048000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10400ad270 con 0x7f1040098a10 2024-04-02T07:33:31.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.024+0000 7f1048000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10400b0840 con 0x7f104015f250 2024-04-02T07:33:31.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.024+0000 7f1048000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10400cf6a0 con 0x7f104015ee70 2024-04-02T07:33:31.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.024+0000 7f1044c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f104015f250 0x7f10400b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:31.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.024+0000 7f1044c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f104015f250 0x7f10400b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33136/0 (socket says 172.21.15.55:33136) 2024-04-02T07:33:31.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.024+0000 7f1044c00640 1 -- 172.21.15.55:0/3866929991 learned_addr learned my addr 172.21.15.55:0/3866929991 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:31.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.024+0000 7f1045600640 1 --2- 172.21.15.55:0/3866929991 >> v2:172.21.15.106:3300/0 conn(0x7f104015ee70 0x7f1040099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:31.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.024+0000 7f1044c00640 1 -- 172.21.15.55:0/3866929991 >> v2:172.21.15.106:3300/0 conn(0x7f104015ee70 msgr2=0x7f1040099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:31.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.024+0000 7f1044c00640 1 --2- 172.21.15.55:0/3866929991 >> v2:172.21.15.106:3300/0 conn(0x7f104015ee70 0x7f1040099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.024+0000 7f1044c00640 1 -- 172.21.15.55:0/3866929991 >> v1:172.21.15.55:6789/0 conn(0x7f1040098a10 legacy=0x7f1040098e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:31.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.024+0000 7f1044c00640 1 -- 172.21.15.55:0/3866929991 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10400b0a50 con 0x7f104015f250 2024-04-02T07:33:31.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.024+0000 7f1045600640 1 --2- 172.21.15.55:0/3866929991 >> v2:172.21.15.106:3300/0 conn(0x7f104015ee70 0x7f1040099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:31.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.028+0000 7f1044c00640 1 --2- 172.21.15.55:0/3866929991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f104015f250 0x7f10400b12f0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f10400719c0 tx=0x7f102c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a50b9c3ca67166e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:31.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.028+0000 7f103fe00640 1 -- 172.21.15.55:0/3866929991 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c0aa680 con 0x7f104015f250 2024-04-02T07:33:31.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.028+0000 7f103fe00640 1 -- 172.21.15.55:0/3866929991 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102c0aa7e0 con 0x7f104015f250 2024-04-02T07:33:31.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.028+0000 7f103fe00640 1 -- 172.21.15.55:0/3866929991 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c0aab70 con 0x7f104015f250 2024-04-02T07:33:31.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.028+0000 7f1048000640 1 -- 172.21.15.55:0/3866929991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f104015f250 msgr2=0x7f10400b12f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:31.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.028+0000 7f1048000640 1 --2- 172.21.15.55:0/3866929991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f104015f250 0x7f10400b12f0 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7f10400719c0 tx=0x7f102c01c520 comp rx=0 tx=0).stop 2024-04-02T07:33:31.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.028+0000 7f1048000640 1 -- 172.21.15.55:0/3866929991 shutdown_connections 2024-04-02T07:33:31.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.028+0000 7f1048000640 1 --2- 172.21.15.55:0/3866929991 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f104015f250 0x7f10400b12f0 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.028+0000 7f1048000640 1 --2- 172.21.15.55:0/3866929991 >> v2:172.21.15.106:3300/0 conn(0x7f104015ee70 0x7f1040099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.028+0000 7f1048000640 1 -- 172.21.15.55:0/3866929991 >> 172.21.15.55:0/3866929991 conn(0x7f10400b21d0 msgr2=0x7f10400b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:31.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.028+0000 7f1048000640 1 -- 172.21.15.55:0/3866929991 shutdown_connections 2024-04-02T07:33:31.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.028+0000 7f1048000640 1 -- 172.21.15.55:0/3866929991 wait complete. 2024-04-02T07:33:31.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1048000640 1 Processor -- start 2024-04-02T07:33:31.032 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1048000640 1 -- start start 2024-04-02T07:33:31.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1048000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1040098a10 0x7f10400c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:31.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1048000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f104015ee70 0x7f104014f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:31.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1048000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f104015f250 0x7f10400c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:31.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1048000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10400b5af0 con 0x7f104015f250 2024-04-02T07:33:31.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1048000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f104014fff0 con 0x7f1040098a10 2024-04-02T07:33:31.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1048000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10400c4710 con 0x7f104015ee70 2024-04-02T07:33:31.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1046000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f104015f250 0x7f10400c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:31.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1046000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f104015f250 0x7f10400c66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33138/0 (socket says 172.21.15.55:33138) 2024-04-02T07:33:31.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1046000640 1 -- 172.21.15.55:0/3721096636 learned_addr learned my addr 172.21.15.55:0/3721096636 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:31.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1045600640 1 --2- 172.21.15.55:0/3721096636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1040098a10 0x7f10400c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:31.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1044c00640 1 --2- 172.21.15.55:0/3721096636 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f104015ee70 0x7f104014f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:31.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1046000640 1 -- 172.21.15.55:0/3721096636 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f104015ee70 msgr2=0x7f104014f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:31.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1046000640 1 --2- 172.21.15.55:0/3721096636 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f104015ee70 0x7f104014f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.035 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1046000640 1 -- 172.21.15.55:0/3721096636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1040098a10 msgr2=0x7f10400c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:31.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1046000640 1 --2- 172.21.15.55:0/3721096636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1040098a10 0x7f10400c57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1046000640 1 -- 172.21.15.55:0/3721096636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c0094d0 con 0x7f104015f250 2024-04-02T07:33:31.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1046000640 1 --2- 172.21.15.55:0/3721096636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f104015f250 0x7f10400c66b0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f103800c770 tx=0x7f103800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:31.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f103d600640 1 -- 172.21.15.55:0/3721096636 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1038003b80 con 0x7f104015f250 2024-04-02T07:33:31.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f103d600640 1 -- 172.21.15.55:0/3721096636 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1038003ce0 con 0x7f104015f250 2024-04-02T07:33:31.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f103d600640 1 -- 172.21.15.55:0/3721096636 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f103800aa30 con 0x7f104015f250 2024-04-02T07:33:31.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1048000640 1 -- 172.21.15.55:0/3721096636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10400c49f0 con 0x7f104015f250 2024-04-02T07:33:31.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1048000640 1 -- 172.21.15.55:0/3721096636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10400c5290 con 0x7f104015f250 2024-04-02T07:33:31.036 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.032+0000 7f1048000640 1 -- 172.21.15.55:0/3721096636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1040066c90 con 0x7f104015f250 2024-04-02T07:33:31.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.036+0000 7f103d600640 1 -- 172.21.15.55:0/3721096636 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f103800ab90 con 0x7f104015f250 2024-04-02T07:33:31.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.036+0000 7f103d600640 1 --2- 172.21.15.55:0/3721096636 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1020066690 0x7f1020068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:31.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.036+0000 7f103d600640 1 -- 172.21.15.55:0/3721096636 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1038083f70 con 0x7f104015f250 2024-04-02T07:33:31.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.036+0000 7f1045600640 1 --2- 172.21.15.55:0/3721096636 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1020066690 0x7f1020068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:31.038 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.036+0000 7f1045600640 1 --2- 172.21.15.55:0/3721096636 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1020066690 0x7f1020068b50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1034006e90 tx=0x7f1034008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:31.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.040+0000 7f103d600640 1 -- 172.21.15.55:0/3721096636 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f1038051260 con 0x7f104015f250 2024-04-02T07:33:31.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.236+0000 7f1048000640 1 -- 172.21.15.55:0/3721096636 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10400cc3e0 con 0x7f104015f250 2024-04-02T07:33:31.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.236+0000 7f103d600640 1 -- 172.21.15.55:0/3721096636 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f1038054880 con 0x7f104015f250 2024-04-02T07:33:31.238 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:31.238 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":96,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7592,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2292883244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2292883244},{"type":"v1","addr":"172.21.15.106:6836","nonce":2292883244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":9147,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2700619140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2700619140},{"type":"v1","addr":"172.21.15.55:6834","nonce":2700619140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":9150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/154663344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":154663344},{"type":"v1","addr":"172.21.15.55:6835","nonce":154663344}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:33:27.846433+0000","modified":"2024-04-02T07:33:30.856803+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9156":{"gid":9156,"name":"d","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6837/775582321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":775582321},{"type":"v1","addr":"172.21.15.106:6837","nonce":775582321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-02T07:33:31.240 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 96 2024-04-02T07:33:31.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.236+0000 7f1048000640 1 -- 172.21.15.55:0/3721096636 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1020066690 msgr2=0x7f1020068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:31.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.236+0000 7f1048000640 1 --2- 172.21.15.55:0/3721096636 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1020066690 0x7f1020068b50 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f1034006e90 tx=0x7f1034008040 comp rx=0 tx=0).stop 2024-04-02T07:33:31.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.236+0000 7f1048000640 1 -- 172.21.15.55:0/3721096636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f104015f250 msgr2=0x7f10400c66b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:31.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.236+0000 7f1048000640 1 --2- 172.21.15.55:0/3721096636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f104015f250 0x7f10400c66b0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f103800c770 tx=0x7f103800cc30 comp rx=0 tx=0).stop 2024-04-02T07:33:31.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.236+0000 7f1048000640 1 -- 172.21.15.55:0/3721096636 shutdown_connections 2024-04-02T07:33:31.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.236+0000 7f1048000640 1 --2- 172.21.15.55:0/3721096636 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f104015f250 0x7f10400c66b0 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.236+0000 7f1048000640 1 --2- 172.21.15.55:0/3721096636 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f104015ee70 0x7f104014f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.236+0000 7f1048000640 1 --2- 172.21.15.55:0/3721096636 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1020066690 0x7f1020068b50 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.241 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.236+0000 7f1048000640 1 --2- 172.21.15.55:0/3721096636 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1040098a10 0x7f10400c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.236+0000 7f1048000640 1 -- 172.21.15.55:0/3721096636 >> 172.21.15.55:0/3721096636 conn(0x7f10400b21d0 msgr2=0x7f104006e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:31.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.236+0000 7f1048000640 1 -- 172.21.15.55:0/3721096636 shutdown_connections 2024-04-02T07:33:31.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.236+0000 7f1048000640 1 -- 172.21.15.55:0/3721096636 wait complete. 2024-04-02T07:33:31.259 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:33:31.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.396+0000 7f40e3e00640 1 Processor -- start 2024-04-02T07:33:31.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.396+0000 7f40e3e00640 1 -- start start 2024-04-02T07:33:31.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.400+0000 7f40e3e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40e406f6f0 0x7f40e4098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:31.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.400+0000 7f40e3e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f40e40ceff0 0x7f40e40cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:31.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.400+0000 7f40e3e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e40ce660 con 0x7f40e40cec10 2024-04-02T07:33:31.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.400+0000 7f40e3e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e40cb0a0 con 0x7f40e40ceff0 2024-04-02T07:33:31.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.400+0000 7f40e3e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e406ee60 con 0x7f40e406f6f0 2024-04-02T07:33:31.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.400+0000 7f40e2a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f40e40cec10 0x7f40e40cb550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54530/0 (socket says 172.21.15.55:54530) 2024-04-02T07:33:31.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.400+0000 7f40e2a00640 1 -- 172.21.15.55:0/1976345513 learned_addr learned my addr 172.21.15.55:0/1976345513 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:31.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.400+0000 7f40e2000640 1 --2- 172.21.15.55:0/1976345513 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40e406f6f0 0x7f40e4098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:31.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.400+0000 7f40e3400640 1 --2- 172.21.15.55:0/1976345513 >> v2:172.21.15.106:3300/0 conn(0x7f40e40ceff0 0x7f40e40cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:31.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.400+0000 7f40e1600640 1 -- 172.21.15.55:0/1976345513 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1592574993 0 0) 0x7f40e40ce660 con 0x7f40e40cec10 2024-04-02T07:33:31.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.400+0000 7f40e1600640 1 -- 172.21.15.55:0/1976345513 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40c8003530 con 0x7f40e40cec10 2024-04-02T07:33:31.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.400+0000 7f40e2000640 1 -- 172.21.15.55:0/1976345513 >> v2:172.21.15.106:3300/0 conn(0x7f40e40ceff0 msgr2=0x7f40e40cbc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:31.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.400+0000 7f40e2000640 1 --2- 172.21.15.55:0/1976345513 >> v2:172.21.15.106:3300/0 conn(0x7f40e40ceff0 0x7f40e40cbc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.400+0000 7f40e2000640 1 -- 172.21.15.55:0/1976345513 >> v1:172.21.15.55:6789/0 conn(0x7f40e40cec10 legacy=0x7f40e40cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:31.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.400+0000 7f40e2000640 1 -- 172.21.15.55:0/1976345513 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e406f140 con 0x7f40e406f6f0 2024-04-02T07:33:31.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.404+0000 7f40e2000640 1 --2- 172.21.15.55:0/1976345513 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40e406f6f0 0x7f40e4098a10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f40d00097c0 tx=0x7f40d001c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2aab30556f386848 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:31.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.404+0000 7f40e1600640 1 -- 172.21.15.55:0/1976345513 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d00ab600 con 0x7f40e406f6f0 2024-04-02T07:33:31.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.404+0000 7f40e1600640 1 -- 172.21.15.55:0/1976345513 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d00a7050 con 0x7f40e406f6f0 2024-04-02T07:33:31.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.404+0000 7f40e1600640 1 -- 172.21.15.55:0/1976345513 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d00ab980 con 0x7f40e406f6f0 2024-04-02T07:33:31.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.404+0000 7f40e3e00640 1 -- 172.21.15.55:0/1976345513 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40e406f6f0 msgr2=0x7f40e4098a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:31.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.404+0000 7f40e3e00640 1 --2- 172.21.15.55:0/1976345513 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40e406f6f0 0x7f40e4098a10 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f40d00097c0 tx=0x7f40d001c380 comp rx=0 tx=0).stop 2024-04-02T07:33:31.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.404+0000 7f40e3e00640 1 -- 172.21.15.55:0/1976345513 shutdown_connections 2024-04-02T07:33:31.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.404+0000 7f40e3e00640 1 --2- 172.21.15.55:0/1976345513 >> v2:172.21.15.106:3300/0 conn(0x7f40e40ceff0 0x7f40e40cbc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.404+0000 7f40e3e00640 1 --2- 172.21.15.55:0/1976345513 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40e406f6f0 0x7f40e4098a10 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.404+0000 7f40e3e00640 1 -- 172.21.15.55:0/1976345513 >> 172.21.15.55:0/1976345513 conn(0x7f40e40b1fc0 msgr2=0x7f40e40b23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:31.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.404+0000 7f40e3e00640 1 -- 172.21.15.55:0/1976345513 shutdown_connections 2024-04-02T07:33:31.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.404+0000 7f40e3e00640 1 -- 172.21.15.55:0/1976345513 wait complete. 2024-04-02T07:33:31.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e3e00640 1 Processor -- start 2024-04-02T07:33:31.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e3e00640 1 -- start start 2024-04-02T07:33:31.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e3e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40e406f6f0 0x7f40e4157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:31.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e3e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40e40cec10 0x7f40e40b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:31.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e3e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40e40ceff0 0x7f40e4155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:31.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e3e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e4158e30 con 0x7f40e40cec10 2024-04-02T07:33:31.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e3e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e4159950 con 0x7f40e406f6f0 2024-04-02T07:33:31.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e3e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40b5790 con 0x7f40e40ceff0 2024-04-02T07:33:31.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e2000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40e40cec10 0x7f40e40b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:31.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e2000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40e40cec10 0x7f40e40b4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33140/0 (socket says 172.21.15.55:33140) 2024-04-02T07:33:31.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e2000640 1 -- 172.21.15.55:0/1209076260 learned_addr learned my addr 172.21.15.55:0/1209076260 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:31.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e2a00640 1 --2- 172.21.15.55:0/1209076260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40e406f6f0 0x7f40e4157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:31.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e3400640 1 --2- 172.21.15.55:0/1209076260 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40e40ceff0 0x7f40e4155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:31.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e2000640 1 -- 172.21.15.55:0/1209076260 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40e40ceff0 msgr2=0x7f40e4155f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:31.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e2000640 1 --2- 172.21.15.55:0/1209076260 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40e40ceff0 0x7f40e4155f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e2000640 1 -- 172.21.15.55:0/1209076260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40e406f6f0 msgr2=0x7f40e4157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:31.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e2000640 1 --2- 172.21.15.55:0/1209076260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40e406f6f0 0x7f40e4157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e2000640 1 -- 172.21.15.55:0/1209076260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40d0009420 con 0x7f40e40cec10 2024-04-02T07:33:31.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e2000640 1 --2- 172.21.15.55:0/1209076260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40e40cec10 0x7f40e40b4f40 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f40d0019fb0 tx=0x7f40e4070510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:31.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40daa00640 1 -- 172.21.15.55:0/1209076260 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d00b4400 con 0x7f40e40cec10 2024-04-02T07:33:31.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40daa00640 1 -- 172.21.15.55:0/1209076260 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d00b4560 con 0x7f40e40cec10 2024-04-02T07:33:31.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40daa00640 1 -- 172.21.15.55:0/1209076260 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d00b4910 con 0x7f40e40cec10 2024-04-02T07:33:31.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e3e00640 1 -- 172.21.15.55:0/1209076260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e4159060 con 0x7f40e40cec10 2024-04-02T07:33:31.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e3e00640 1 -- 172.21.15.55:0/1209076260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e41595e0 con 0x7f40e40cec10 2024-04-02T07:33:31.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.408+0000 7f40e3e00640 1 -- 172.21.15.55:0/1209076260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e40cf900 con 0x7f40e40cec10 2024-04-02T07:33:31.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.412+0000 7f40daa00640 1 -- 172.21.15.55:0/1209076260 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f40d00b2040 con 0x7f40e40cec10 2024-04-02T07:33:31.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.412+0000 7f40daa00640 1 --2- 172.21.15.55:0/1209076260 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f40c4066690 0x7f40c4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:31.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.412+0000 7f40daa00640 1 -- 172.21.15.55:0/1209076260 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40d011dc80 con 0x7f40e40cec10 2024-04-02T07:33:31.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.412+0000 7f40e2a00640 1 --2- 172.21.15.55:0/1209076260 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f40c4066690 0x7f40c4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:31.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.412+0000 7f40e2a00640 1 --2- 172.21.15.55:0/1209076260 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f40c4066690 0x7f40c4068b50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f40d4007fd0 tx=0x7f40d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:31.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.416+0000 7f40daa00640 1 -- 172.21.15.55:0/1209076260 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f40d00eb000 con 0x7f40e40cec10 2024-04-02T07:33:31.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.576+0000 7f40e3e00640 1 -- 172.21.15.55:0/1209076260 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f40e415a580 con 0x7f40e40cec10 2024-04-02T07:33:31.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.580+0000 7f40daa00640 1 -- 172.21.15.55:0/1209076260 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+16059 (secure 0 0 0) 0x7f40d00ee620 con 0x7f40e40cec10 2024-04-02T07:33:31.580 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:31.581 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":116,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:33:28.848519+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:33:26.384276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-02T07:33:26.835969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:33:31.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.580+0000 7f40e3e00640 1 -- 172.21.15.55:0/1209076260 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f40c4066690 msgr2=0x7f40c4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:31.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.580+0000 7f40e3e00640 1 --2- 172.21.15.55:0/1209076260 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f40c4066690 0x7f40c4068b50 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f40d4007fd0 tx=0x7f40d4009040 comp rx=0 tx=0).stop 2024-04-02T07:33:31.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.580+0000 7f40e3e00640 1 -- 172.21.15.55:0/1209076260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40e40cec10 msgr2=0x7f40e40b4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:31.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.580+0000 7f40e3e00640 1 --2- 172.21.15.55:0/1209076260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40e40cec10 0x7f40e40b4f40 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7f40d0019fb0 tx=0x7f40e4070510 comp rx=0 tx=0).stop 2024-04-02T07:33:31.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.580+0000 7f40e3e00640 1 -- 172.21.15.55:0/1209076260 shutdown_connections 2024-04-02T07:33:31.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.580+0000 7f40e3e00640 1 --2- 172.21.15.55:0/1209076260 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40e40ceff0 0x7f40e4155f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.580+0000 7f40e3e00640 1 --2- 172.21.15.55:0/1209076260 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40e40cec10 0x7f40e40b4f40 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.580+0000 7f40e3e00640 1 --2- 172.21.15.55:0/1209076260 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f40c4066690 0x7f40c4068b50 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.580+0000 7f40e3e00640 1 --2- 172.21.15.55:0/1209076260 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40e406f6f0 0x7f40e4157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.580+0000 7f40e3e00640 1 -- 172.21.15.55:0/1209076260 >> 172.21.15.55:0/1209076260 conn(0x7f40e40b1fc0 msgr2=0x7f40e40cd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:31.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.580+0000 7f40e3e00640 1 -- 172.21.15.55:0/1209076260 shutdown_connections 2024-04-02T07:33:31.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.580+0000 7f40e3e00640 1 -- 172.21.15.55:0/1209076260 wait complete. 2024-04-02T07:33:31.602 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-02T07:33:31.602 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:33:31.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.740+0000 7f8652e00640 1 Processor -- start 2024-04-02T07:33:31.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.740+0000 7f8652e00640 1 -- start start 2024-04-02T07:33:31.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.740+0000 7f8652e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f864c143f90 0x7f864c15ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:31.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.740+0000 7f8652e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864c15b270 con 0x7f864c0b34f0 2024-04-02T07:33:31.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.740+0000 7f8652e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f864c144370 con 0x7f864c0cda80 2024-04-02T07:33:31.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.740+0000 7f8652e00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f864c0c37b0 con 0x7f864c143f90 2024-04-02T07:33:31.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.740+0000 7f864be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f864c143f90 0x7f864c15ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:31.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.740+0000 7f8643400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f864c0b34f0 0x7f864c0cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54544/0 (socket says 172.21.15.55:54544) 2024-04-02T07:33:31.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.740+0000 7f8643400640 1 -- 172.21.15.55:0/3361677030 learned_addr learned my addr 172.21.15.55:0/3361677030 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:31.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.740+0000 7f864be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f864c143f90 0x7f864c15ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33154/0 (socket says 172.21.15.55:33154) 2024-04-02T07:33:31.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.740+0000 7f864be00640 1 -- 172.21.15.55:0/3361677030 >> v1:172.21.15.106:6789/0 conn(0x7f864c0cda80 legacy=0x7f864c0c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:31.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.740+0000 7f864be00640 1 -- 172.21.15.55:0/3361677030 >> v1:172.21.15.55:6789/0 conn(0x7f864c0b34f0 legacy=0x7f864c0cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:31.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.744+0000 7f864be00640 1 -- 172.21.15.55:0/3361677030 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c0c3a90 con 0x7f864c143f90 2024-04-02T07:33:31.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.744+0000 7f864b400640 1 -- 172.21.15.55:0/3361677030 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166153656 0 0) 0x7f864c15b270 con 0x7f864c0b34f0 2024-04-02T07:33:31.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.744+0000 7f864be00640 1 --2- 172.21.15.55:0/3361677030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f864c143f90 0x7f864c15ad30 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f863c0097c0 tx=0x7f863c01c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ac409376d77e7c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:31.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.744+0000 7f864b400640 1 -- 172.21.15.55:0/3361677030 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c0ac600 con 0x7f864c143f90 2024-04-02T07:33:31.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.744+0000 7f864b400640 1 -- 172.21.15.55:0/3361677030 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f863c0a8050 con 0x7f864c143f90 2024-04-02T07:33:31.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.744+0000 7f864b400640 1 -- 172.21.15.55:0/3361677030 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f863c0ac980 con 0x7f864c143f90 2024-04-02T07:33:31.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.744+0000 7f8652e00640 1 -- 172.21.15.55:0/3361677030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f864c143f90 msgr2=0x7f864c15ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:31.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.744+0000 7f8652e00640 1 --2- 172.21.15.55:0/3361677030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f864c143f90 0x7f864c15ad30 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f863c0097c0 tx=0x7f863c01c3a0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.744+0000 7f8652e00640 1 -- 172.21.15.55:0/3361677030 shutdown_connections 2024-04-02T07:33:31.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.744+0000 7f8652e00640 1 --2- 172.21.15.55:0/3361677030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f864c143f90 0x7f864c15ad30 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.744+0000 7f8652e00640 1 -- 172.21.15.55:0/3361677030 >> 172.21.15.55:0/3361677030 conn(0x7f864c066080 msgr2=0x7f864c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:31.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.744+0000 7f8652e00640 1 -- 172.21.15.55:0/3361677030 shutdown_connections 2024-04-02T07:33:31.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.744+0000 7f8652e00640 1 -- 172.21.15.55:0/3361677030 wait complete. 2024-04-02T07:33:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8652e00640 1 Processor -- start 2024-04-02T07:33:31.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8652e00640 1 -- start start 2024-04-02T07:33:31.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8652e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f864c0b34f0 0x7f864c0c9600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:31.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8652e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f864c0cda80 0x7f864c0c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:31.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8652e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f864c143f90 0x7f864c15a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8652e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c0c8450 con 0x7f864c0cda80 2024-04-02T07:33:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8652e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f864c0c6e70 con 0x7f864c0b34f0 2024-04-02T07:33:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8652e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f864c0c7150 con 0x7f864c143f90 2024-04-02T07:33:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8643400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f864c0cda80 0x7f864c0c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8643400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f864c0cda80 0x7f864c0c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33162/0 (socket says 172.21.15.55:33162) 2024-04-02T07:33:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8643400640 1 -- 172.21.15.55:0/1040684106 learned_addr learned my addr 172.21.15.55:0/1040684106 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f864be00640 1 --2- 172.21.15.55:0/1040684106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f864c0b34f0 0x7f864c0c9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8650e00640 1 --2- 172.21.15.55:0/1040684106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f864c143f90 0x7f864c15a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8643400640 1 -- 172.21.15.55:0/1040684106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f864c143f90 msgr2=0x7f864c15a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8643400640 1 --2- 172.21.15.55:0/1040684106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f864c143f90 0x7f864c15a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8643400640 1 -- 172.21.15.55:0/1040684106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f864c0b34f0 msgr2=0x7f864c0c9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8643400640 1 --2- 172.21.15.55:0/1040684106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f864c0b34f0 0x7f864c0c9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8643400640 1 -- 172.21.15.55:0/1040684106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f863c009420 con 0x7f864c0cda80 2024-04-02T07:33:31.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8643400640 1 --2- 172.21.15.55:0/1040684106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f864c0cda80 0x7f864c0c7f10 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f86340011f0 tx=0x7f863400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:31.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8648c00640 1 -- 172.21.15.55:0/1040684106 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86340074e0 con 0x7f864c0cda80 2024-04-02T07:33:31.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8648c00640 1 -- 172.21.15.55:0/1040684106 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8634007640 con 0x7f864c0cda80 2024-04-02T07:33:31.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8648c00640 1 -- 172.21.15.55:0/1040684106 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8634004a10 con 0x7f864c0cda80 2024-04-02T07:33:31.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8652e00640 1 -- 172.21.15.55:0/1040684106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f864c0c7430 con 0x7f864c0cda80 2024-04-02T07:33:31.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.748+0000 7f8652e00640 1 -- 172.21.15.55:0/1040684106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f864c0c79f0 con 0x7f864c0cda80 2024-04-02T07:33:31.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.752+0000 7f8652e00640 1 -- 172.21.15.55:0/1040684106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f864c0c7c10 con 0x7f864c0cda80 2024-04-02T07:33:31.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.752+0000 7f8648c00640 1 -- 172.21.15.55:0/1040684106 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8634004b70 con 0x7f864c0cda80 2024-04-02T07:33:31.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.752+0000 7f8648c00640 1 --2- 172.21.15.55:0/1040684106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8628066690 0x7f8628068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:31.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.752+0000 7f8648c00640 1 -- 172.21.15.55:0/1040684106 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8634083460 con 0x7f864c0cda80 2024-04-02T07:33:31.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.752+0000 7f864be00640 1 --2- 172.21.15.55:0/1040684106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8628066690 0x7f8628068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:31.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.752+0000 7f864be00640 1 --2- 172.21.15.55:0/1040684106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8628066690 0x7f8628068b50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f863c0ae000 tx=0x7f863c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:31.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.756+0000 7f8648c00640 1 -- 172.21.15.55:0/1040684106 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f86340507e0 con 0x7f864c0cda80 2024-04-02T07:33:31.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.912+0000 7f8652e00640 1 -- 172.21.15.55:0/1040684106 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f864c0c5370 con 0x7f8628066690 2024-04-02T07:33:31.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.920+0000 7f8648c00640 1 -- 172.21.15.55:0/1040684106 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276249 (secure 0 0 0) 0x7f863c0bb070 con 0x7f8628066690 2024-04-02T07:33:31.927 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:31.929 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:33:31.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.924+0000 7f8652e00640 1 -- 172.21.15.55:0/1040684106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8628066690 msgr2=0x7f8628068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:31.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.924+0000 7f8652e00640 1 --2- 172.21.15.55:0/1040684106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8628066690 0x7f8628068b50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f863c0ae000 tx=0x7f863c0a7000 comp rx=0 tx=0).stop 2024-04-02T07:33:31.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.924+0000 7f8652e00640 1 -- 172.21.15.55:0/1040684106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f864c0cda80 msgr2=0x7f864c0c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:31.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.924+0000 7f8652e00640 1 --2- 172.21.15.55:0/1040684106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f864c0cda80 0x7f864c0c7f10 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f86340011f0 tx=0x7f863400c9b0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.924+0000 7f8652e00640 1 -- 172.21.15.55:0/1040684106 shutdown_connections 2024-04-02T07:33:31.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.924+0000 7f8652e00640 1 --2- 172.21.15.55:0/1040684106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f864c143f90 0x7f864c15a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.924+0000 7f8652e00640 1 --2- 172.21.15.55:0/1040684106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f864c0cda80 0x7f864c0c7f10 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.924+0000 7f8652e00640 1 --2- 172.21.15.55:0/1040684106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8628066690 0x7f8628068b50 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.924+0000 7f8652e00640 1 --2- 172.21.15.55:0/1040684106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f864c0b34f0 0x7f864c0c9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:31.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.924+0000 7f8652e00640 1 -- 172.21.15.55:0/1040684106 >> 172.21.15.55:0/1040684106 conn(0x7f864c066080 msgr2=0x7f864c071860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:31.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.924+0000 7f8652e00640 1 -- 172.21.15.55:0/1040684106 shutdown_connections 2024-04-02T07:33:31.931 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:31.924+0000 7f8652e00640 1 -- 172.21.15.55:0/1040684106 wait complete. 2024-04-02T07:33:31.947 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":451,"stamp":"2024-04-02T07:33:30.505025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":260968,"kb_used_data":12028,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754713752,"statfs":{"total":773094113280,"available":772826882048,"internally_reserved":0,"allocated":12316672,"data_stored":5986035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.063548"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.441200+0000","last_change":"2024-04-02T07:33:26.441200+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.441200+0000","last_undegraded":"2024-04-02T07:33:26.441200+0000","last_fullsized":"2024-04-02T07:33:26.441200+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:35:51.795729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.443404+0000","last_change":"2024-04-02T07:33:26.443404+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.443404+0000","last_undegraded":"2024-04-02T07:33:26.443404+0000","last_fullsized":"2024-04-02T07:33:26.443404+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:21.236879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.440432+0000","last_change":"2024-04-02T07:33:26.440432+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.440432+0000","last_undegraded":"2024-04-02T07:33:26.440432+0000","last_fullsized":"2024-04-02T07:33:26.440432+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:30:53.259024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.442080+0000","last_change":"2024-04-02T07:33:26.442080+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.442080+0000","last_undegraded":"2024-04-02T07:33:26.442080+0000","last_fullsized":"2024-04-02T07:33:26.442080+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:58:03.695984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.446688+0000","last_change":"2024-04-02T07:33:26.446688+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.446688+0000","last_undegraded":"2024-04-02T07:33:26.446688+0000","last_fullsized":"2024-04-02T07:33:26.446688+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:52:12.071857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.446768+0000","last_change":"2024-04-02T07:33:26.446768+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.446768+0000","last_undegraded":"2024-04-02T07:33:26.446768+0000","last_fullsized":"2024-04-02T07:33:26.446768+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:37:50.004156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.440262+0000","last_change":"2024-04-02T07:33:26.440262+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.440262+0000","last_undegraded":"2024-04-02T07:33:26.440262+0000","last_fullsized":"2024-04-02T07:33:26.440262+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:51:50.224528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.440249+0000","last_change":"2024-04-02T07:33:26.440249+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.440249+0000","last_undegraded":"2024-04-02T07:33:26.440249+0000","last_fullsized":"2024-04-02T07:33:26.440249+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:22:53.910523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.440409+0000","last_change":"2024-04-02T07:33:26.440409+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.440409+0000","last_undegraded":"2024-04-02T07:33:26.440409+0000","last_fullsized":"2024-04-02T07:33:26.440409+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:21:06.948320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.446709+0000","last_change":"2024-04-02T07:33:26.446709+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.446709+0000","last_undegraded":"2024-04-02T07:33:26.446709+0000","last_fullsized":"2024-04-02T07:33:26.446709+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:49:54.401940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.440402+0000","last_change":"2024-04-02T07:33:26.440402+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.440402+0000","last_undegraded":"2024-04-02T07:33:26.440402+0000","last_fullsized":"2024-04-02T07:33:26.440402+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:44:29.549736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.443396+0000","last_change":"2024-04-02T07:33:26.443396+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.443396+0000","last_undegraded":"2024-04-02T07:33:26.443396+0000","last_fullsized":"2024-04-02T07:33:26.443396+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:42:29.107894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":245,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-02T07:33:23.558232+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:33:23.558232+0000","last_peered":"2024-04-02T07:33:23.558232+0000","last_clean":"2024-04-02T07:33:23.558232+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:33:23.558232+0000","last_undegraded":"2024-04-02T07:33:23.558232+0000","last_fullsized":"2024-04-02T07:33:23.558232+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574986,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33060,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":1986560,"data_stored":1191680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68400000000000005,"15min":0.66300000000000003},"min":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.35299999999999998},"max":{"1min":0.90600000000000003,"5min":0.92400000000000004,"15min":1.0569999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.66800000000000004,"15min":0.64300000000000002},"min":{"1min":0.60099999999999998,"5min":0.442,"15min":0.39900000000000002},"max":{"1min":0.88700000000000001,"5min":1.018,"15min":1.018},"last":0.61199999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.67400000000000004,"15min":0.65500000000000003},"min":{"1min":0.52600000000000002,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.98099999999999998,"5min":1.004,"15min":1.0289999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69499999999999995,"15min":0.67800000000000005},"min":{"1min":0.503,"5min":0.42599999999999999,"15min":0.39500000000000002},"max":{"1min":0.96699999999999997,"5min":0.99299999999999999,"15min":1.113},"last":0.72199999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.46300000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95099999999999996,"5min":1.0309999999999999,"15min":1.139},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.73999999999999999,"15min":0.72999999999999998},"min":{"1min":0.63900000000000001,"5min":0.503,"15min":0.437},"max":{"1min":0.93600000000000005,"5min":1.0549999999999999,"15min":1.522},"last":0.68600000000000005}]},{"osd":3,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.70999999999999996,"15min":0.70499999999999996},"min":{"1min":0.52100000000000002,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.94499999999999995,"5min":1.0409999999999999,"15min":1.405},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.623,"5min":0.48799999999999999,"15min":0.48599999999999999},"max":{"1min":0.96199999999999997,"5min":1.0329999999999999,"15min":1.0580000000000001},"last":0.754}]},{"osd":4,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.63},"min":{"1min":0.40699999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":0.86599999999999999,"15min":1.633},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66400000000000003,"15min":0.69699999999999995},"min":{"1min":0.54700000000000004,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88200000000000001,"5min":0.94299999999999995,"15min":1.079},"last":0.628}]},{"osd":5,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.67700000000000005},"min":{"1min":0.39900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.99399999999999999,"5min":0.995,"15min":1.2250000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.70399999999999996,"15min":0.73799999999999999},"min":{"1min":0.60399999999999998,"5min":0.441,"15min":0.43099999999999999},"max":{"1min":0.93600000000000005,"5min":0.98799999999999999,"15min":1.5609999999999999},"last":0.64800000000000002}]},{"osd":6,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67000000000000004,"15min":0.69399999999999995},"min":{"1min":0.51300000000000001,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":0.93899999999999995,"5min":0.97599999999999998,"15min":1.5960000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66200000000000003,"15min":0.67500000000000004},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.40699999999999997},"max":{"1min":0.89800000000000002,"5min":0.96499999999999997,"15min":1.0840000000000001},"last":0.76600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574987,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1392640,"data_stored":601312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.71499999999999997,"15min":0.68600000000000005},"min":{"1min":0.56699999999999995,"5min":0.45500000000000002,"15min":0.41399999999999998},"max":{"1min":1.0820000000000001,"5min":1.147,"15min":1.399},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.70999999999999996,"15min":0.78000000000000003},"min":{"1min":0.60299999999999998,"5min":0.439,"15min":0.39400000000000002},"max":{"1min":0.91500000000000004,"5min":0.95799999999999996,"15min":5.7569999999999997},"last":0.77300000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.59499999999999997,"5min":0.42299999999999999,"15min":0.38200000000000001},"max":{"1min":0.93000000000000005,"5min":1.097,"15min":1.95},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73799999999999999,"15min":0.73099999999999998},"min":{"1min":0.59799999999999998,"5min":0.51400000000000001,"15min":0.47599999999999998},"max":{"1min":0.95899999999999996,"5min":1.0449999999999999,"15min":1.248},"last":0.95899999999999996}]},{"osd":2,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72299999999999998,"15min":0.70099999999999996},"min":{"1min":0.54400000000000004,"5min":0.47499999999999998,"15min":0.45000000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.226},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.745,"15min":0.72799999999999998},"min":{"1min":0.53100000000000003,"5min":0.51200000000000001,"15min":0.46500000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.3320000000000001}]},{"osd":3,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.74199999999999999,"15min":0.76700000000000002},"min":{"1min":0.65900000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.006,"5min":1.006,"15min":2.3119999999999998},"last":1.006},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.72299999999999998,"15min":0.754},"min":{"1min":0.61699999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":2.6389999999999998},"last":1.0660000000000001}]},{"osd":4,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.62,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.34999999999999998},"max":{"1min":1.0469999999999999,"5min":1.236,"15min":1.236},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.625,"15min":0.64300000000000002},"min":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.38500000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":1.0980000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60399999999999998,"15min":0.63500000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.37},"max":{"1min":0.80000000000000004,"5min":0.86399999999999999,"15min":0.95999999999999996},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67800000000000005,"15min":0.69899999999999995},"min":{"1min":0.505,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":1.0109999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.876}]},{"osd":7,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69099999999999995,"15min":0.70999999999999996},"min":{"1min":0.52500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.96999999999999997,"5min":3.3290000000000002,"15min":3.3290000000000002},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.67900000000000005,"15min":0.70899999999999996},"min":{"1min":0.52300000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":1.1799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574987,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32480,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1392640,"data_stored":601312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67300000000000004,"15min":0.66600000000000004},"min":{"1min":0.41899999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.86399999999999999,"5min":0.995,"15min":1.25},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70399999999999996,"15min":0.70299999999999996},"min":{"1min":0.438,"5min":0.42399999999999999,"15min":0.33000000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.5289999999999999},"last":0.74199999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72899999999999998,"15min":0.71199999999999997},"min":{"1min":0.56200000000000006,"5min":0.45900000000000002,"15min":0.371},"max":{"1min":0.995,"5min":0.995,"15min":1.1830000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.438,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96599999999999997,"5min":1.0069999999999999,"15min":1.3420000000000001},"last":0.94899999999999995}]},{"osd":2,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.77000000000000002,"15min":0.79300000000000004},"min":{"1min":0.57799999999999996,"5min":0.53400000000000003,"15min":0.44900000000000001},"max":{"1min":0.92800000000000005,"5min":1.0129999999999999,"15min":1.8280000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72399999999999998,"15min":0.72699999999999998},"min":{"1min":0.45700000000000002,"5min":0.40999999999999998,"15min":0.39700000000000002},"max":{"1min":0.91200000000000003,"5min":1.0109999999999999,"15min":1.696},"last":0.71499999999999997}]},{"osd":3,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.52800000000000002,"5min":0.498,"15min":0.40899999999999997},"max":{"1min":0.97399999999999998,"5min":1.034,"15min":1.6399999999999999},"last":0.88},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.745,"15min":0.77500000000000002},"min":{"1min":0.52900000000000003,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":1.01,"5min":1.01,"15min":2.0219999999999998},"last":0.68500000000000005}]},{"osd":4,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57899999999999996,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.911},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61899999999999999,"15min":0.68700000000000006},"min":{"1min":0.42799999999999999,"5min":0.38500000000000001,"15min":0.307},"max":{"1min":0.93100000000000005,"5min":1.0649999999999999,"15min":1.7829999999999999},"last":0.93100000000000005}]},{"osd":6,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64000000000000001,"15min":0.72799999999999998},"min":{"1min":0.48099999999999998,"5min":0.439,"15min":0.39600000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":2.1829999999999998},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65700000000000003,"15min":0.72699999999999998},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.36499999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":2.1280000000000001},"last":1.1359999999999999}]},{"osd":7,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68899999999999995,"15min":0.76100000000000001},"min":{"1min":0.54700000000000004,"5min":0.435,"15min":0.38300000000000001},"max":{"1min":0.90800000000000003,"5min":1.1319999999999999,"15min":1.887},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71399999999999997,"15min":0.79500000000000004},"min":{"1min":0.56599999999999995,"5min":0.47799999999999998,"15min":0.439},"max":{"1min":0.996,"5min":1.056,"15min":2.2599999999999998},"last":0.85899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1392640,"data_stored":601312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67000000000000004,"15min":0.70999999999999996},"min":{"1min":0.41099999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.875,"5min":0.92000000000000004,"15min":2.4929999999999999},"last":0.62},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68899999999999995,"15min":0.751},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.94499999999999995,"5min":0.94799999999999995,"15min":3.2519999999999998},"last":0.65200000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69799999999999995,"15min":0.72899999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.89600000000000002,"5min":0.94499999999999995,"15min":1.4279999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70899999999999996,"15min":0.80900000000000005},"min":{"1min":0.47199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":4.3810000000000002},"last":0.73599999999999999}]},{"osd":2,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71999999999999997,"15min":0.76400000000000001},"min":{"1min":0.47399999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1899999999999999,"5min":1.1990000000000001,"15min":2.056},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.79500000000000004},"min":{"1min":0.46899999999999997,"5min":0.436,"15min":0.436},"max":{"1min":0.877,"5min":1.038,"15min":3.3420000000000001},"last":0.66700000000000004}]},{"osd":3,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.752,"15min":0.875},"min":{"1min":0.61499999999999999,"5min":0.48199999999999998,"15min":0.436},"max":{"1min":0.90700000000000003,"5min":1.091,"15min":3.9180000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75900000000000001,"15min":0.88500000000000001},"min":{"1min":0.56100000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":3.9750000000000001},"last":0.69699999999999995}]},{"osd":5,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57799999999999996,"15min":0.65400000000000003},"min":{"1min":0.45200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.1060000000000001,"5min":1.1120000000000001,"15min":1.2509999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.68400000000000005},"min":{"1min":0.38100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93000000000000005,"5min":0.98199999999999998,"15min":1.4419999999999999},"last":0.83299999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61399999999999999,"15min":0.66900000000000004},"min":{"1min":0.42299999999999999,"5min":0.40999999999999998,"15min":0.33400000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.2949999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.66800000000000004,"15min":0.72899999999999998},"min":{"1min":0.53300000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.159,"5min":1.2529999999999999,"15min":1.3069999999999999},"last":0.98199999999999998}]},{"osd":7,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68000000000000005,"15min":0.75},"min":{"1min":0.443,"5min":0.432,"15min":0.432},"max":{"1min":0.97399999999999998,"5min":1.034,"15min":1.2689999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.76400000000000001,"15min":0.82299999999999995},"min":{"1min":0.60699999999999998,"5min":0.53100000000000003,"15min":0.52700000000000002},"max":{"1min":1.214,"5min":1.2949999999999999,"15min":1.353},"last":1.0249999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574987,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1380352,"data_stored":596115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45400000000000001,"15min":0.44700000000000001},"min":{"1min":0.33000000000000002,"5min":0.30199999999999999,"15min":0.26300000000000001},"max":{"1min":0.71199999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48799999999999999,"15min":0.48599999999999999},"min":{"1min":0.34799999999999998,"5min":0.30399999999999999,"15min":0.28699999999999998},"max":{"1min":0.65500000000000003,"5min":0.78400000000000003,"15min":1.0109999999999999},"last":0.435}]},{"osd":1,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.46400000000000002,"15min":0.45000000000000001},"min":{"1min":0.34899999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.748,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.40600000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.80500000000000005}]},{"osd":2,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.45200000000000001,"5min":0.378,"15min":0.374},"max":{"1min":0.80400000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.437,"5min":0.35399999999999998,"15min":0.33400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":1.306},"last":0.59799999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.76000000000000001,"15min":0.747},"min":{"1min":0.55000000000000004,"5min":0.45800000000000002,"15min":0.40500000000000003},"max":{"1min":1.1539999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.78200000000000003,"15min":0.76100000000000001},"min":{"1min":0.64100000000000001,"5min":0.47299999999999998,"15min":0.46500000000000002},"max":{"1min":1.0620000000000001,"5min":1.306,"15min":1.306},"last":0.81799999999999995}]},{"osd":5,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78400000000000003,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.502,"15min":0.501},"max":{"1min":1.129,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.78400000000000003,"15min":0.76100000000000001},"min":{"1min":0.59399999999999997,"5min":0.48999999999999999,"15min":0.48899999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.91100000000000003}]},{"osd":6,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.77400000000000002,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.48799999999999999,"15min":0.44500000000000001},"max":{"1min":1.2130000000000001,"5min":1.258,"15min":1.258},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.80700000000000005,"15min":0.79300000000000004},"min":{"1min":0.627,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2529999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.76300000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.79100000000000004,"15min":0.76800000000000002},"min":{"1min":0.60199999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.103,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.879,"5min":0.80300000000000005,"15min":0.79400000000000004},"min":{"1min":0.60899999999999999,"5min":0.53100000000000003,"15min":0.47499999999999998},"max":{"1min":1.0860000000000001,"5min":1.1120000000000001,"15min":1.2869999999999999},"last":0.83499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574987,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32480,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1392640,"data_stored":601312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.44800000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.253},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.79100000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.499,"15min":0.49299999999999999},"min":{"1min":0.28299999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.55700000000000005}]},{"osd":1,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.53400000000000003},"min":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.876,"5min":0.876,"15min":1.171},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.50700000000000001,"15min":0.498},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78500000000000003,"5min":0.83199999999999996,"15min":1.333},"last":0.58399999999999996}]},{"osd":3,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55300000000000005,"15min":0.52900000000000003},"min":{"1min":0.38100000000000001,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.44900000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.89800000000000002,"5min":0.90000000000000002,"15min":1.1140000000000001},"last":0.64600000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.751,"15min":0.76500000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":2.254},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76500000000000001,"15min":0.76800000000000002},"min":{"1min":0.498,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0740000000000001,"5min":1.1599999999999999,"15min":1.3420000000000001},"last":0.73599999999999999}]},{"osd":5,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76900000000000002,"15min":0.76300000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.46200000000000002},"max":{"1min":0.996,"5min":1.091,"15min":1.3740000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78600000000000003,"15min":0.80000000000000004},"min":{"1min":0.60499999999999998,"5min":0.498,"15min":0.443},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":2.0840000000000001},"last":0.82599999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80800000000000005,"15min":0.81999999999999995},"min":{"1min":0.57199999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.153,"5min":1.1990000000000001,"15min":1.5029999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.61099999999999999,"5min":0.58399999999999996,"15min":0.52700000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.425},"last":0.92100000000000004}]},{"osd":7,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79900000000000004,"15min":0.81699999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1779999999999999,"5min":1.1799999999999999,"15min":2.3580000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81100000000000005,"15min":0.81899999999999995},"min":{"1min":0.60299999999999998,"5min":0.54400000000000004,"15min":0.54300000000000004},"max":{"1min":1.127,"5min":1.127,"15min":1.377},"last":0.75900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1392640,"data_stored":601312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45200000000000001,"15min":0.46300000000000002},"min":{"1min":0.317,"5min":0.251,"15min":0.251},"max":{"1min":0.77200000000000002,"5min":0.78600000000000003,"15min":1.2150000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47399999999999998,"15min":0.56699999999999995},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.26200000000000001},"max":{"1min":0.68100000000000005,"5min":0.72299999999999998,"15min":4.157},"last":0.28799999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48099999999999998,"15min":0.56799999999999995},"min":{"1min":0.36599999999999999,"5min":0.32400000000000001,"15min":0.28999999999999998},"max":{"1min":0.63100000000000001,"5min":0.69799999999999995,"15min":4.282},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52600000000000002,"15min":0.56399999999999995},"min":{"1min":0.38900000000000001,"5min":0.35499999999999998,"15min":0.33600000000000002},"max":{"1min":0.65200000000000002,"5min":0.81000000000000005,"15min":1.625},"last":0.42999999999999999}]},{"osd":3,"last update":"Tue Apr 2 07:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.438,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81699999999999995,"5min":0.88800000000000001,"15min":1.1120000000000001},"last":0.376},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.72899999999999998},"min":{"1min":0.36699999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74199999999999999,"5min":0.80600000000000005,"15min":8.1620000000000008},"last":0.41399999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71399999999999997,"15min":0.84599999999999997},"min":{"1min":0.46000000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97399999999999998,"5min":1.081,"15min":4.7400000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.79500000000000004},"min":{"1min":0.58599999999999997,"5min":0.53700000000000003,"15min":0.50600000000000001},"max":{"1min":0.93600000000000005,"5min":1.125,"15min":1.7070000000000001},"last":0.53000000000000003}]},{"osd":5,"last update":"Tue Apr 2 07:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.751,"15min":0.85499999999999998},"min":{"1min":0.48799999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.004,"5min":1.113,"15min":4.5759999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.752,"15min":0.85599999999999998},"min":{"1min":0.52700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.081,"5min":1.103,"15min":4.7949999999999999},"last":0.61099999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76200000000000001,"15min":0.88300000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94099999999999995,"5min":1.0329999999999999,"15min":4.6890000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.76700000000000002,"15min":0.873},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.89000000000000001,"5min":1.0589999999999999,"15min":4.6059999999999999},"last":0.51100000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77800000000000002,"15min":0.80600000000000005},"min":{"1min":0.51300000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.877,"5min":1.1200000000000001,"15min":1.8759999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.78500000000000003,"15min":0.88700000000000001},"min":{"1min":0.52100000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.90000000000000002,"5min":1.157,"15min":4.6420000000000003},"last":0.56499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574987,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33056,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338784,"statfs":{"total":96636764160,"available":96602914816,"internally_reserved":0,"allocated":1986560,"data_stored":1191680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42799999999999999,"15min":0.44600000000000001},"min":{"1min":0.28299999999999997,"5min":0.27800000000000002,"15min":0.26300000000000001},"max":{"1min":0.54800000000000004,"5min":0.62,"15min":1.48},"last":0.375},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.496,"15min":0.503},"min":{"1min":0.41199999999999998,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":1.2330000000000001},"last":0.48099999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.497,"15min":0.50800000000000001},"min":{"1min":0.40000000000000002,"5min":0.34699999999999998,"15min":0.29099999999999998},"max":{"1min":0.65000000000000002,"5min":0.77800000000000002,"15min":1.3129999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.32400000000000001},"max":{"1min":0.69699999999999995,"5min":0.76700000000000002,"15min":0.82599999999999996},"last":0.438}]},{"osd":3,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.46999999999999997,"15min":0.46899999999999997},"min":{"1min":0.33100000000000002,"5min":0.29999999999999999,"15min":0.28199999999999997},"max":{"1min":0.749,"5min":0.82799999999999996,"15min":0.84799999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57799999999999996,"15min":0.59699999999999998},"min":{"1min":0.435,"5min":0.42499999999999999,"15min":0.40300000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":1.4430000000000001},"last":0.55300000000000005}]},{"osd":4,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.745,"15min":0.73999999999999999},"min":{"1min":0.65300000000000002,"5min":0.505,"15min":0.46200000000000002},"max":{"1min":1.0149999999999999,"5min":1.0209999999999999,"15min":1.0569999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.623,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.93999999999999995,"5min":1.034,"15min":1.1240000000000001},"last":0.69699999999999995}]},{"osd":5,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.59299999999999997,"5min":0.53700000000000003,"15min":0.47599999999999998},"max":{"1min":0.95599999999999996,"5min":1.042,"15min":1.371},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.56899999999999995,"5min":0.498,"15min":0.498},"max":{"1min":0.89500000000000002,"5min":1.0009999999999999,"15min":1.143},"last":0.61599999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.77500000000000002,"15min":0.78900000000000003},"min":{"1min":0.65100000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.97999999999999998,"5min":1.0409999999999999,"15min":1.177},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.79800000000000004,"15min":0.81899999999999995},"min":{"1min":0.63900000000000001,"5min":0.57099999999999995,"15min":0.52700000000000002},"max":{"1min":0.96099999999999997,"5min":1.081,"15min":1.4099999999999999},"last":0.70899999999999996}]},{"osd":7,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.76000000000000001,"15min":0.78000000000000003},"min":{"1min":0.61199999999999999,"5min":0.56100000000000005,"15min":0.54800000000000004},"max":{"1min":0.93400000000000005,"5min":1.028,"15min":1.135},"last":0.752},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.76500000000000001,"15min":0.77800000000000002},"min":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.48399999999999999},"max":{"1min":0.92800000000000005,"5min":1.075,"15min":1.141},"last":0.65400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:33:31.987 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:33:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.124+0000 7f75e6400640 1 Processor -- start 2024-04-02T07:33:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.124+0000 7f75e6400640 1 -- start start 2024-04-02T07:33:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.128+0000 7f75e6400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f75e0153ea0 0x7f75e00c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.128+0000 7f75e6400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75e0159be0 0x7f75e00b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.128+0000 7f75e6400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75e013d0c0 con 0x7f75e015a040 2024-04-02T07:33:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.128+0000 7f75e6400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75e015a4f0 con 0x7f75e0153ea0 2024-04-02T07:33:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.128+0000 7f75e6400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e015a7d0 con 0x7f75e0159be0 2024-04-02T07:33:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.128+0000 7f75df400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f75e0153ea0 0x7f75e00c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.128+0000 7f75d6a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75e0159be0 0x7f75e00b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.128+0000 7f75dfe00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f75e015a040 0x7f75e013ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:45722/0 (socket says 172.21.15.55:45722) 2024-04-02T07:33:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.128+0000 7f75dfe00640 1 -- 172.21.15.55:0/2450634344 learned_addr learned my addr 172.21.15.55:0/2450634344 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:32.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.128+0000 7f75df400640 1 -- 172.21.15.55:0/2450634344 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75e0159be0 msgr2=0x7f75e00b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:32.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.128+0000 7f75df400640 1 --2- 172.21.15.55:0/2450634344 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75e0159be0 0x7f75e00b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.128+0000 7f75df400640 1 -- 172.21.15.55:0/2450634344 >> v1:172.21.15.106:6789/0 conn(0x7f75e015a040 legacy=0x7f75e013ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:32.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.128+0000 7f75df400640 1 -- 172.21.15.55:0/2450634344 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e015aab0 con 0x7f75e0153ea0 2024-04-02T07:33:32.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.128+0000 7f75dea00640 1 -- 172.21.15.55:0/2450634344 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1308889411 0 0) 0x7f75e013d0c0 con 0x7f75e015a040 2024-04-02T07:33:32.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.128+0000 7f75d6a00640 1 --2- 172.21.15.55:0/2450634344 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75e0159be0 0x7f75e00b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:33:32.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.132+0000 7f75df400640 1 --2- 172.21.15.55:0/2450634344 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75e0153ea0 0x7f75e00c4120 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f75d00097c0 tx=0x7f75d001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2dad7744f82d7b19 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:32.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.132+0000 7f75dea00640 1 -- 172.21.15.55:0/2450634344 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d00aa620 con 0x7f75e0153ea0 2024-04-02T07:33:32.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.132+0000 7f75dea00640 1 -- 172.21.15.55:0/2450634344 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d00aa780 con 0x7f75e0153ea0 2024-04-02T07:33:32.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.132+0000 7f75dea00640 1 -- 172.21.15.55:0/2450634344 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d00aab10 con 0x7f75e0153ea0 2024-04-02T07:33:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.132+0000 7f75e6400640 1 -- 172.21.15.55:0/2450634344 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75e0153ea0 msgr2=0x7f75e00c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.132+0000 7f75e6400640 1 --2- 172.21.15.55:0/2450634344 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75e0153ea0 0x7f75e00c4120 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f75d00097c0 tx=0x7f75d001c4a0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.132+0000 7f75e6400640 1 -- 172.21.15.55:0/2450634344 shutdown_connections 2024-04-02T07:33:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.132+0000 7f75e6400640 1 --2- 172.21.15.55:0/2450634344 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75e0159be0 0x7f75e00b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.132+0000 7f75e6400640 1 --2- 172.21.15.55:0/2450634344 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75e0153ea0 0x7f75e00c4120 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.132+0000 7f75e6400640 1 -- 172.21.15.55:0/2450634344 >> 172.21.15.55:0/2450634344 conn(0x7f75e0066080 msgr2=0x7f75e0069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.132+0000 7f75e6400640 1 -- 172.21.15.55:0/2450634344 shutdown_connections 2024-04-02T07:33:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.132+0000 7f75e6400640 1 -- 172.21.15.55:0/2450634344 wait complete. 2024-04-02T07:33:32.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.132+0000 7f75e6400640 1 Processor -- start 2024-04-02T07:33:32.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.132+0000 7f75e6400640 1 -- start start 2024-04-02T07:33:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75e6400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75e0153ea0 0x7f75e00c5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75e6400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75e0159be0 0x7f75e0158ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75e6400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75e015a040 0x7f75e00709f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75e6400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00c9c40 con 0x7f75e015a040 2024-04-02T07:33:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75e6400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00c6460 con 0x7f75e0159be0 2024-04-02T07:33:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75e6400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75e00c8fc0 con 0x7f75e0153ea0 2024-04-02T07:33:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75dfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75e015a040 0x7f75e00709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75dfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75e015a040 0x7f75e00709f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33164/0 (socket says 172.21.15.55:33164) 2024-04-02T07:33:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75df400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75e0153ea0 0x7f75e00c5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75dfe00640 1 -- 172.21.15.55:0/2639675368 learned_addr learned my addr 172.21.15.55:0/2639675368 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75d6a00640 1 --2- 172.21.15.55:0/2639675368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75e0159be0 0x7f75e0158ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:32.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75dfe00640 1 -- 172.21.15.55:0/2639675368 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75e0153ea0 msgr2=0x7f75e00c5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:32.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75dfe00640 1 --2- 172.21.15.55:0/2639675368 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75e0153ea0 0x7f75e00c5f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75dfe00640 1 -- 172.21.15.55:0/2639675368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75e0159be0 msgr2=0x7f75e0158ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:32.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75dfe00640 1 --2- 172.21.15.55:0/2639675368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75e0159be0 0x7f75e0158ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75dfe00640 1 -- 172.21.15.55:0/2639675368 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c8009a70 con 0x7f75e015a040 2024-04-02T07:33:32.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75dfe00640 1 --2- 172.21.15.55:0/2639675368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75e015a040 0x7f75e00709f0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f75d800c410 tx=0x7f75d800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:32.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75d7e00640 1 -- 172.21.15.55:0/2639675368 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d80074e0 con 0x7f75e015a040 2024-04-02T07:33:32.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75d7e00640 1 -- 172.21.15.55:0/2639675368 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75d8007640 con 0x7f75e015a040 2024-04-02T07:33:32.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75e6400640 1 -- 172.21.15.55:0/2639675368 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75d0009420 con 0x7f75e015a040 2024-04-02T07:33:32.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75d7e00640 1 -- 172.21.15.55:0/2639675368 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75d8004a30 con 0x7f75e015a040 2024-04-02T07:33:32.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75e6400640 1 -- 172.21.15.55:0/2639675368 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75e00c9580 con 0x7f75e015a040 2024-04-02T07:33:32.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75e6400640 1 -- 172.21.15.55:0/2639675368 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75e00c9d80 con 0x7f75e015a040 2024-04-02T07:33:32.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.136+0000 7f75d7e00640 1 -- 172.21.15.55:0/2639675368 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f75d8004b90 con 0x7f75e015a040 2024-04-02T07:33:32.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.140+0000 7f75d7e00640 1 --2- 172.21.15.55:0/2639675368 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f75bc0666c0 0x7f75bc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:32.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.140+0000 7f75d7e00640 1 -- 172.21.15.55:0/2639675368 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75d8083e50 con 0x7f75e015a040 2024-04-02T07:33:32.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.140+0000 7f75df400640 1 --2- 172.21.15.55:0/2639675368 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f75bc0666c0 0x7f75bc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:32.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.140+0000 7f75df400640 1 --2- 172.21.15.55:0/2639675368 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f75bc0666c0 0x7f75bc068b80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f75d00ae000 tx=0x7f75d00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:32.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.144+0000 7f75d7e00640 1 -- 172.21.15.55:0/2639675368 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f75e00c9d80 con 0x7f75e015a040 2024-04-02T07:33:32.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.300+0000 7f75e6400640 1 -- 172.21.15.55:0/2639675368 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75e00c9d80 con 0x7f75bc0666c0 2024-04-02T07:33:32.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.312+0000 7f75d7e00640 1 -- 172.21.15.55:0/2639675368 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276249 (secure 0 0 0) 0x7f75e00c9d80 con 0x7f75bc0666c0 2024-04-02T07:33:32.312 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:32.316 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:33:32.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.312+0000 7f75e6400640 1 -- 172.21.15.55:0/2639675368 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f75bc0666c0 msgr2=0x7f75bc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:32.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.312+0000 7f75e6400640 1 --2- 172.21.15.55:0/2639675368 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f75bc0666c0 0x7f75bc068b80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f75d00ae000 tx=0x7f75d00a7000 comp rx=0 tx=0).stop 2024-04-02T07:33:32.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.312+0000 7f75e6400640 1 -- 172.21.15.55:0/2639675368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75e015a040 msgr2=0x7f75e00709f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:32.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.312+0000 7f75e6400640 1 --2- 172.21.15.55:0/2639675368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75e015a040 0x7f75e00709f0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f75d800c410 tx=0x7f75d800c8d0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.312+0000 7f75e6400640 1 -- 172.21.15.55:0/2639675368 shutdown_connections 2024-04-02T07:33:32.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.312+0000 7f75e6400640 1 --2- 172.21.15.55:0/2639675368 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f75e015a040 0x7f75e00709f0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.312+0000 7f75e6400640 1 --2- 172.21.15.55:0/2639675368 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f75bc0666c0 0x7f75bc068b80 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.312+0000 7f75e6400640 1 --2- 172.21.15.55:0/2639675368 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f75e0159be0 0x7f75e0158ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.312+0000 7f75e6400640 1 --2- 172.21.15.55:0/2639675368 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f75e0153ea0 0x7f75e00c5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.312+0000 7f75e6400640 1 -- 172.21.15.55:0/2639675368 >> 172.21.15.55:0/2639675368 conn(0x7f75e0066080 msgr2=0x7f75e0071bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:32.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.312+0000 7f75e6400640 1 -- 172.21.15.55:0/2639675368 shutdown_connections 2024-04-02T07:33:32.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.312+0000 7f75e6400640 1 -- 172.21.15.55:0/2639675368 wait complete. 2024-04-02T07:33:32.332 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":451,"stamp":"2024-04-02T07:33:30.505025+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":26,"acting":26,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":6,"kb":754974720,"kb_used":260968,"kb_used_data":12028,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754713752,"statfs":{"total":773094113280,"available":772826882048,"internally_reserved":0,"allocated":12316672,"data_stored":5986035,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.063548"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.441200+0000","last_change":"2024-04-02T07:33:26.441200+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.441200+0000","last_undegraded":"2024-04-02T07:33:26.441200+0000","last_fullsized":"2024-04-02T07:33:26.441200+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:35:51.795729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.443404+0000","last_change":"2024-04-02T07:33:26.443404+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.443404+0000","last_undegraded":"2024-04-02T07:33:26.443404+0000","last_fullsized":"2024-04-02T07:33:26.443404+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:21.236879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.440432+0000","last_change":"2024-04-02T07:33:26.440432+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.440432+0000","last_undegraded":"2024-04-02T07:33:26.440432+0000","last_fullsized":"2024-04-02T07:33:26.440432+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:30:53.259024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.442080+0000","last_change":"2024-04-02T07:33:26.442080+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.442080+0000","last_undegraded":"2024-04-02T07:33:26.442080+0000","last_fullsized":"2024-04-02T07:33:26.442080+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:58:03.695984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.446688+0000","last_change":"2024-04-02T07:33:26.446688+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.446688+0000","last_undegraded":"2024-04-02T07:33:26.446688+0000","last_fullsized":"2024-04-02T07:33:26.446688+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:52:12.071857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.446768+0000","last_change":"2024-04-02T07:33:26.446768+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.446768+0000","last_undegraded":"2024-04-02T07:33:26.446768+0000","last_fullsized":"2024-04-02T07:33:26.446768+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:37:50.004156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.440262+0000","last_change":"2024-04-02T07:33:26.440262+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.440262+0000","last_undegraded":"2024-04-02T07:33:26.440262+0000","last_fullsized":"2024-04-02T07:33:26.440262+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:51:50.224528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.440249+0000","last_change":"2024-04-02T07:33:26.440249+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.440249+0000","last_undegraded":"2024-04-02T07:33:26.440249+0000","last_fullsized":"2024-04-02T07:33:26.440249+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:22:53.910523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.440409+0000","last_change":"2024-04-02T07:33:26.440409+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.440409+0000","last_undegraded":"2024-04-02T07:33:26.440409+0000","last_fullsized":"2024-04-02T07:33:26.440409+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:21:06.948320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.446709+0000","last_change":"2024-04-02T07:33:26.446709+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.446709+0000","last_undegraded":"2024-04-02T07:33:26.446709+0000","last_fullsized":"2024-04-02T07:33:26.446709+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:49:54.401940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.440402+0000","last_change":"2024-04-02T07:33:26.440402+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.440402+0000","last_undegraded":"2024-04-02T07:33:26.440402+0000","last_fullsized":"2024-04-02T07:33:26.440402+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:44:29.549736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":113,"state":"creating+peering","last_fresh":"2024-04-02T07:33:26.443396+0000","last_change":"2024-04-02T07:33:26.443396+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.443396+0000","last_undegraded":"2024-04-02T07:33:26.443396+0000","last_fullsized":"2024-04-02T07:33:26.443396+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:42:29.107894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:27.438148+0000","last_change":"2024-04-02T07:33:27.438148+0000","last_active":"2024-04-02T07:33:27.438148+0000","last_peered":"2024-04-02T07:33:27.438148+0000","last_clean":"2024-04-02T07:33:27.438148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:27.438148+0000","last_undegraded":"2024-04-02T07:33:27.438148+0000","last_fullsized":"2024-04-02T07:33:27.438148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-04-02T07:33:26.434513+0000","last_change":"2024-04-02T07:33:26.434513+0000","last_active":"2024-04-02T07:33:26.434513+0000","last_peered":"2024-04-02T07:33:26.434513+0000","last_clean":"2024-04-02T07:33:26.434513+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-04-02T07:33:26.434513+0000","last_undegraded":"2024-04-02T07:33:26.434513+0000","last_fullsized":"2024-04-02T07:33:26.434513+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":245,"reported_epoch":110,"state":"active+clean","last_fresh":"2024-04-02T07:33:23.558232+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:33:23.558232+0000","last_peered":"2024-04-02T07:33:23.558232+0000","last_clean":"2024-04-02T07:33:23.558232+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:33:23.558232+0000","last_undegraded":"2024-04-02T07:33:23.558232+0000","last_fullsized":"2024-04-02T07:33:23.558232+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574986,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33060,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338780,"statfs":{"total":96636764160,"available":96602910720,"internally_reserved":0,"allocated":1986560,"data_stored":1191680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68400000000000005,"15min":0.66300000000000003},"min":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.35299999999999998},"max":{"1min":0.90600000000000003,"5min":0.92400000000000004,"15min":1.0569999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.66800000000000004,"15min":0.64300000000000002},"min":{"1min":0.60099999999999998,"5min":0.442,"15min":0.39900000000000002},"max":{"1min":0.88700000000000001,"5min":1.018,"15min":1.018},"last":0.61199999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.67400000000000004,"15min":0.65500000000000003},"min":{"1min":0.52600000000000002,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.98099999999999998,"5min":1.004,"15min":1.0289999999999999},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69499999999999995,"15min":0.67800000000000005},"min":{"1min":0.503,"5min":0.42599999999999999,"15min":0.39500000000000002},"max":{"1min":0.96699999999999997,"5min":0.99299999999999999,"15min":1.113},"last":0.72199999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.46300000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95099999999999996,"5min":1.0309999999999999,"15min":1.139},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.73999999999999999,"15min":0.72999999999999998},"min":{"1min":0.63900000000000001,"5min":0.503,"15min":0.437},"max":{"1min":0.93600000000000005,"5min":1.0549999999999999,"15min":1.522},"last":0.68600000000000005}]},{"osd":3,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.70999999999999996,"15min":0.70499999999999996},"min":{"1min":0.52100000000000002,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.94499999999999995,"5min":1.0409999999999999,"15min":1.405},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.755,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.623,"5min":0.48799999999999999,"15min":0.48599999999999999},"max":{"1min":0.96199999999999997,"5min":1.0329999999999999,"15min":1.0580000000000001},"last":0.754}]},{"osd":4,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.63},"min":{"1min":0.40699999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":0.86599999999999999,"15min":1.633},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66400000000000003,"15min":0.69699999999999995},"min":{"1min":0.54700000000000004,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88200000000000001,"5min":0.94299999999999995,"15min":1.079},"last":0.628}]},{"osd":5,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.67700000000000005},"min":{"1min":0.39900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.99399999999999999,"5min":0.995,"15min":1.2250000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.748,"5min":0.70399999999999996,"15min":0.73799999999999999},"min":{"1min":0.60399999999999998,"5min":0.441,"15min":0.43099999999999999},"max":{"1min":0.93600000000000005,"5min":0.98799999999999999,"15min":1.5609999999999999},"last":0.64800000000000002}]},{"osd":6,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67000000000000004,"15min":0.69399999999999995},"min":{"1min":0.51300000000000001,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":0.93899999999999995,"5min":0.97599999999999998,"15min":1.5960000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66200000000000003,"15min":0.67500000000000004},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.40699999999999997},"max":{"1min":0.89800000000000002,"5min":0.96499999999999997,"15min":1.0840000000000001},"last":0.76600000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574987,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1392640,"data_stored":601312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.71499999999999997,"15min":0.68600000000000005},"min":{"1min":0.56699999999999995,"5min":0.45500000000000002,"15min":0.41399999999999998},"max":{"1min":1.0820000000000001,"5min":1.147,"15min":1.399},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.70999999999999996,"15min":0.78000000000000003},"min":{"1min":0.60299999999999998,"5min":0.439,"15min":0.39400000000000002},"max":{"1min":0.91500000000000004,"5min":0.95799999999999996,"15min":5.7569999999999997},"last":0.77300000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.59499999999999997,"5min":0.42299999999999999,"15min":0.38200000000000001},"max":{"1min":0.93000000000000005,"5min":1.097,"15min":1.95},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73799999999999999,"15min":0.73099999999999998},"min":{"1min":0.59799999999999998,"5min":0.51400000000000001,"15min":0.47599999999999998},"max":{"1min":0.95899999999999996,"5min":1.0449999999999999,"15min":1.248},"last":0.95899999999999996}]},{"osd":2,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72299999999999998,"15min":0.70099999999999996},"min":{"1min":0.54400000000000004,"5min":0.47499999999999998,"15min":0.45000000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.226},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.745,"15min":0.72799999999999998},"min":{"1min":0.53100000000000003,"5min":0.51200000000000001,"15min":0.46500000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":1.3320000000000001}]},{"osd":3,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.74199999999999999,"15min":0.76700000000000002},"min":{"1min":0.65900000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.006,"5min":1.006,"15min":2.3119999999999998},"last":1.006},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.72299999999999998,"15min":0.754},"min":{"1min":0.61699999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":2.6389999999999998},"last":1.0660000000000001}]},{"osd":4,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.62,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.34999999999999998},"max":{"1min":1.0469999999999999,"5min":1.236,"15min":1.236},"last":1.0469999999999999},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.625,"15min":0.64300000000000002},"min":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.38500000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":1.0980000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60399999999999998,"15min":0.63500000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.37},"max":{"1min":0.80000000000000004,"5min":0.86399999999999999,"15min":0.95999999999999996},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67800000000000005,"15min":0.69899999999999995},"min":{"1min":0.505,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":1.0109999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.876}]},{"osd":7,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69099999999999995,"15min":0.70999999999999996},"min":{"1min":0.52500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.96999999999999997,"5min":3.3290000000000002,"15min":3.3290000000000002},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.67900000000000005,"15min":0.70899999999999996},"min":{"1min":0.52300000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":1.1799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574987,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32480,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1392640,"data_stored":601312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67300000000000004,"15min":0.66600000000000004},"min":{"1min":0.41899999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.86399999999999999,"5min":0.995,"15min":1.25},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70399999999999996,"15min":0.70299999999999996},"min":{"1min":0.438,"5min":0.42399999999999999,"15min":0.33000000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.5289999999999999},"last":0.74199999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72899999999999998,"15min":0.71199999999999997},"min":{"1min":0.56200000000000006,"5min":0.45900000000000002,"15min":0.371},"max":{"1min":0.995,"5min":0.995,"15min":1.1830000000000001},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.438,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96599999999999997,"5min":1.0069999999999999,"15min":1.3420000000000001},"last":0.94899999999999995}]},{"osd":2,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.77000000000000002,"15min":0.79300000000000004},"min":{"1min":0.57799999999999996,"5min":0.53400000000000003,"15min":0.44900000000000001},"max":{"1min":0.92800000000000005,"5min":1.0129999999999999,"15min":1.8280000000000001},"last":0.91900000000000004},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72399999999999998,"15min":0.72699999999999998},"min":{"1min":0.45700000000000002,"5min":0.40999999999999998,"15min":0.39700000000000002},"max":{"1min":0.91200000000000003,"5min":1.0109999999999999,"15min":1.696},"last":0.71499999999999997}]},{"osd":3,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.52800000000000002,"5min":0.498,"15min":0.40899999999999997},"max":{"1min":0.97399999999999998,"5min":1.034,"15min":1.6399999999999999},"last":0.88},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.745,"15min":0.77500000000000002},"min":{"1min":0.52900000000000003,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":1.01,"5min":1.01,"15min":2.0219999999999998},"last":0.68500000000000005}]},{"osd":4,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57899999999999996,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.911},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61899999999999999,"15min":0.68700000000000006},"min":{"1min":0.42799999999999999,"5min":0.38500000000000001,"15min":0.307},"max":{"1min":0.93100000000000005,"5min":1.0649999999999999,"15min":1.7829999999999999},"last":0.93100000000000005}]},{"osd":6,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64000000000000001,"15min":0.72799999999999998},"min":{"1min":0.48099999999999998,"5min":0.439,"15min":0.39600000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":2.1829999999999998},"last":1.1020000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65700000000000003,"15min":0.72699999999999998},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.36499999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":2.1280000000000001},"last":1.1359999999999999}]},{"osd":7,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68899999999999995,"15min":0.76100000000000001},"min":{"1min":0.54700000000000004,"5min":0.435,"15min":0.38300000000000001},"max":{"1min":0.90800000000000003,"5min":1.1319999999999999,"15min":1.887},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71399999999999997,"15min":0.79500000000000004},"min":{"1min":0.56599999999999995,"5min":0.47799999999999998,"15min":0.439},"max":{"1min":0.996,"5min":1.056,"15min":2.2599999999999998},"last":0.85899999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1392640,"data_stored":601312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67000000000000004,"15min":0.70999999999999996},"min":{"1min":0.41099999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.875,"5min":0.92000000000000004,"15min":2.4929999999999999},"last":0.62},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68899999999999995,"15min":0.751},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.94499999999999995,"5min":0.94799999999999995,"15min":3.2519999999999998},"last":0.65200000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69799999999999995,"15min":0.72899999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.89600000000000002,"5min":0.94499999999999995,"15min":1.4279999999999999},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70899999999999996,"15min":0.80900000000000005},"min":{"1min":0.47199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":4.3810000000000002},"last":0.73599999999999999}]},{"osd":2,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71999999999999997,"15min":0.76400000000000001},"min":{"1min":0.47399999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1899999999999999,"5min":1.1990000000000001,"15min":2.056},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.79500000000000004},"min":{"1min":0.46899999999999997,"5min":0.436,"15min":0.436},"max":{"1min":0.877,"5min":1.038,"15min":3.3420000000000001},"last":0.66700000000000004}]},{"osd":3,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.752,"15min":0.875},"min":{"1min":0.61499999999999999,"5min":0.48199999999999998,"15min":0.436},"max":{"1min":0.90700000000000003,"5min":1.091,"15min":3.9180000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75900000000000001,"15min":0.88500000000000001},"min":{"1min":0.56100000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":3.9750000000000001},"last":0.69699999999999995}]},{"osd":5,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57799999999999996,"15min":0.65400000000000003},"min":{"1min":0.45200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.1060000000000001,"5min":1.1120000000000001,"15min":1.2509999999999999},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.68400000000000005},"min":{"1min":0.38100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93000000000000005,"5min":0.98199999999999998,"15min":1.4419999999999999},"last":0.83299999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61399999999999999,"15min":0.66900000000000004},"min":{"1min":0.42299999999999999,"5min":0.40999999999999998,"15min":0.33400000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.2949999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.66800000000000004,"15min":0.72899999999999998},"min":{"1min":0.53300000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.159,"5min":1.2529999999999999,"15min":1.3069999999999999},"last":0.98199999999999998}]},{"osd":7,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68000000000000005,"15min":0.75},"min":{"1min":0.443,"5min":0.432,"15min":0.432},"max":{"1min":0.97399999999999998,"5min":1.034,"15min":1.2689999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.76400000000000001,"15min":0.82299999999999995},"min":{"1min":0.60699999999999998,"5min":0.53100000000000003,"15min":0.52700000000000002},"max":{"1min":1.214,"5min":1.2949999999999999,"15min":1.353},"last":1.0249999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574987,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32464,"kb_used_data":1348,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339376,"statfs":{"total":96636764160,"available":96603521024,"internally_reserved":0,"allocated":1380352,"data_stored":596115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45400000000000001,"15min":0.44700000000000001},"min":{"1min":0.33000000000000002,"5min":0.30199999999999999,"15min":0.26300000000000001},"max":{"1min":0.71199999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48799999999999999,"15min":0.48599999999999999},"min":{"1min":0.34799999999999998,"5min":0.30399999999999999,"15min":0.28699999999999998},"max":{"1min":0.65500000000000003,"5min":0.78400000000000003,"15min":1.0109999999999999},"last":0.435}]},{"osd":1,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.46400000000000002,"15min":0.45000000000000001},"min":{"1min":0.34899999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.748,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.40600000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.80500000000000005}]},{"osd":2,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.45200000000000001,"5min":0.378,"15min":0.374},"max":{"1min":0.80400000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.437,"5min":0.35399999999999998,"15min":0.33400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":1.306},"last":0.59799999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.76000000000000001,"15min":0.747},"min":{"1min":0.55000000000000004,"5min":0.45800000000000002,"15min":0.40500000000000003},"max":{"1min":1.1539999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.78200000000000003,"15min":0.76100000000000001},"min":{"1min":0.64100000000000001,"5min":0.47299999999999998,"15min":0.46500000000000002},"max":{"1min":1.0620000000000001,"5min":1.306,"15min":1.306},"last":0.81799999999999995}]},{"osd":5,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78400000000000003,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.502,"15min":0.501},"max":{"1min":1.129,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.78400000000000003,"15min":0.76100000000000001},"min":{"1min":0.59399999999999997,"5min":0.48999999999999999,"15min":0.48899999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.91100000000000003}]},{"osd":6,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.77400000000000002,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.48799999999999999,"15min":0.44500000000000001},"max":{"1min":1.2130000000000001,"5min":1.258,"15min":1.258},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.80700000000000005,"15min":0.79300000000000004},"min":{"1min":0.627,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2529999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.76300000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.79100000000000004,"15min":0.76800000000000002},"min":{"1min":0.60199999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.103,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.879,"5min":0.80300000000000005,"15min":0.79400000000000004},"min":{"1min":0.60899999999999999,"5min":0.53100000000000003,"15min":0.47499999999999998},"max":{"1min":1.0860000000000001,"5min":1.1120000000000001,"15min":1.2869999999999999},"last":0.83499999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574987,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32480,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339360,"statfs":{"total":96636764160,"available":96603504640,"internally_reserved":0,"allocated":1392640,"data_stored":601312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.44800000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.253},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.79100000000000004},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.499,"15min":0.49299999999999999},"min":{"1min":0.28299999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.55700000000000005}]},{"osd":1,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.53400000000000003},"min":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.876,"5min":0.876,"15min":1.171},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.50700000000000001,"15min":0.498},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78500000000000003,"5min":0.83199999999999996,"15min":1.333},"last":0.58399999999999996}]},{"osd":3,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55300000000000005,"15min":0.52900000000000003},"min":{"1min":0.38100000000000001,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.63,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.44900000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.89800000000000002,"5min":0.90000000000000002,"15min":1.1140000000000001},"last":0.64600000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.751,"15min":0.76500000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":2.254},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76500000000000001,"15min":0.76800000000000002},"min":{"1min":0.498,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0740000000000001,"5min":1.1599999999999999,"15min":1.3420000000000001},"last":0.73599999999999999}]},{"osd":5,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76900000000000002,"15min":0.76300000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.46200000000000002},"max":{"1min":0.996,"5min":1.091,"15min":1.3740000000000001},"last":0.86699999999999999},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78600000000000003,"15min":0.80000000000000004},"min":{"1min":0.60499999999999998,"5min":0.498,"15min":0.443},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":2.0840000000000001},"last":0.82599999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80800000000000005,"15min":0.81999999999999995},"min":{"1min":0.57199999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.153,"5min":1.1990000000000001,"15min":1.5029999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.61099999999999999,"5min":0.58399999999999996,"15min":0.52700000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.425},"last":0.92100000000000004}]},{"osd":7,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79900000000000004,"15min":0.81699999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1779999999999999,"5min":1.1799999999999999,"15min":2.3580000000000001},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81100000000000005,"15min":0.81899999999999995},"min":{"1min":0.60299999999999998,"5min":0.54400000000000004,"15min":0.54300000000000004},"max":{"1min":1.127,"5min":1.127,"15min":1.377},"last":0.75900000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574986,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32476,"kb_used_data":1360,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339364,"statfs":{"total":96636764160,"available":96603508736,"internally_reserved":0,"allocated":1392640,"data_stored":601312,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45200000000000001,"15min":0.46300000000000002},"min":{"1min":0.317,"5min":0.251,"15min":0.251},"max":{"1min":0.77200000000000002,"5min":0.78600000000000003,"15min":1.2150000000000001},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.47399999999999998,"15min":0.56699999999999995},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.26200000000000001},"max":{"1min":0.68100000000000005,"5min":0.72299999999999998,"15min":4.157},"last":0.28799999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.48099999999999998,"15min":0.56799999999999995},"min":{"1min":0.36599999999999999,"5min":0.32400000000000001,"15min":0.28999999999999998},"max":{"1min":0.63100000000000001,"5min":0.69799999999999995,"15min":4.282},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.52600000000000002,"15min":0.56399999999999995},"min":{"1min":0.38900000000000001,"5min":0.35499999999999998,"15min":0.33600000000000002},"max":{"1min":0.65200000000000002,"5min":0.81000000000000005,"15min":1.625},"last":0.42999999999999999}]},{"osd":3,"last update":"Tue Apr 2 07:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.60099999999999998},"min":{"1min":0.438,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.81699999999999995,"5min":0.88800000000000001,"15min":1.1120000000000001},"last":0.376},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.55400000000000005,"15min":0.72899999999999998},"min":{"1min":0.36699999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74199999999999999,"5min":0.80600000000000005,"15min":8.1620000000000008},"last":0.41399999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.71399999999999997,"15min":0.84599999999999997},"min":{"1min":0.46000000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.97399999999999998,"5min":1.081,"15min":4.7400000000000002},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.76600000000000001,"15min":0.79500000000000004},"min":{"1min":0.58599999999999997,"5min":0.53700000000000003,"15min":0.50600000000000001},"max":{"1min":0.93600000000000005,"5min":1.125,"15min":1.7070000000000001},"last":0.53000000000000003}]},{"osd":5,"last update":"Tue Apr 2 07:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.751,"15min":0.85499999999999998},"min":{"1min":0.48799999999999999,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.004,"5min":1.113,"15min":4.5759999999999996},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.74399999999999999,"5min":0.752,"15min":0.85599999999999998},"min":{"1min":0.52700000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.081,"5min":1.103,"15min":4.7949999999999999},"last":0.61099999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.76200000000000001,"15min":0.88300000000000001},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.94099999999999995,"5min":1.0329999999999999,"15min":4.6890000000000001},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.76700000000000002,"15min":0.873},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":0.89000000000000001,"5min":1.0589999999999999,"15min":4.6059999999999999},"last":0.51100000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:32:27 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.77800000000000002,"15min":0.80600000000000005},"min":{"1min":0.51300000000000001,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.877,"5min":1.1200000000000001,"15min":1.8759999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.78500000000000003,"15min":0.88700000000000001},"min":{"1min":0.52100000000000002,"5min":0.495,"15min":0.495},"max":{"1min":0.90000000000000002,"5min":1.157,"15min":4.6420000000000003},"last":0.56499999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574987,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33056,"kb_used_data":1940,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338784,"statfs":{"total":96636764160,"available":96602914816,"internally_reserved":0,"allocated":1986560,"data_stored":1191680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42799999999999999,"15min":0.44600000000000001},"min":{"1min":0.28299999999999997,"5min":0.27800000000000002,"15min":0.26300000000000001},"max":{"1min":0.54800000000000004,"5min":0.62,"15min":1.48},"last":0.375},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.496,"15min":0.503},"min":{"1min":0.41199999999999998,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":1.2330000000000001},"last":0.48099999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.497,"15min":0.50800000000000001},"min":{"1min":0.40000000000000002,"5min":0.34699999999999998,"15min":0.29099999999999998},"max":{"1min":0.65000000000000002,"5min":0.77800000000000002,"15min":1.3129999999999999},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.32400000000000001},"max":{"1min":0.69699999999999995,"5min":0.76700000000000002,"15min":0.82599999999999996},"last":0.438}]},{"osd":3,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.46999999999999997,"15min":0.46899999999999997},"min":{"1min":0.33100000000000002,"5min":0.29999999999999999,"15min":0.28199999999999997},"max":{"1min":0.749,"5min":0.82799999999999996,"15min":0.84799999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57799999999999996,"15min":0.59699999999999998},"min":{"1min":0.435,"5min":0.42499999999999999,"15min":0.40300000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":1.4430000000000001},"last":0.55300000000000005}]},{"osd":4,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.745,"15min":0.73999999999999999},"min":{"1min":0.65300000000000002,"5min":0.505,"15min":0.46200000000000002},"max":{"1min":1.0149999999999999,"5min":1.0209999999999999,"15min":1.0569999999999999},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.623,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.93999999999999995,"5min":1.034,"15min":1.1240000000000001},"last":0.69699999999999995}]},{"osd":5,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.59299999999999997,"5min":0.53700000000000003,"15min":0.47599999999999998},"max":{"1min":0.95599999999999996,"5min":1.042,"15min":1.371},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.755,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.56899999999999995,"5min":0.498,"15min":0.498},"max":{"1min":0.89500000000000002,"5min":1.0009999999999999,"15min":1.143},"last":0.61599999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.77500000000000002,"15min":0.78900000000000003},"min":{"1min":0.65100000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.97999999999999998,"5min":1.0409999999999999,"15min":1.177},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.79800000000000004,"15min":0.81899999999999995},"min":{"1min":0.63900000000000001,"5min":0.57099999999999995,"15min":0.52700000000000002},"max":{"1min":0.96099999999999997,"5min":1.081,"15min":1.4099999999999999},"last":0.70899999999999996}]},{"osd":7,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.76000000000000001,"15min":0.78000000000000003},"min":{"1min":0.61199999999999999,"5min":0.56100000000000005,"15min":0.54800000000000004},"max":{"1min":0.93400000000000005,"5min":1.028,"15min":1.135},"last":0.752},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.76500000000000001,"15min":0.77800000000000002},"min":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.48399999999999999},"max":{"1min":0.92800000000000005,"5min":1.075,"15min":1.141},"last":0.65400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:33:32.337 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:33:32.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.512+0000 7fc6a8400640 1 Processor -- start 2024-04-02T07:33:32.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.512+0000 7fc6a8400640 1 -- start start 2024-04-02T07:33:32.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.516+0000 7fc6a8400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc6a0153ea0 0x7fc6a00c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:32.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.516+0000 7fc6a8400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6a015a070 0x7fc6a013d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:32.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.516+0000 7fc6a8400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6a013d0c0 con 0x7fc6a0159be0 2024-04-02T07:33:32.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.516+0000 7fc6a8400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6a015a4f0 con 0x7fc6a0153ea0 2024-04-02T07:33:32.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.516+0000 7fc6a8400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a015a7d0 con 0x7fc6a015a070 2024-04-02T07:33:32.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.516+0000 7fc6a5a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc6a0153ea0 0x7fc6a00c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:32.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.516+0000 7fc6a5000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc6a0159be0 0x7fc6a00b31b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54548/0 (socket says 172.21.15.55:54548) 2024-04-02T07:33:32.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.516+0000 7fc6a5000640 1 -- 172.21.15.55:0/3121266846 learned_addr learned my addr 172.21.15.55:0/3121266846 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:32.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.516+0000 7fc6a6400640 1 --2- 172.21.15.55:0/3121266846 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6a015a070 0x7fc6a013d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:32.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.516+0000 7fc6a5a00640 1 -- 172.21.15.55:0/3121266846 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6a015a070 msgr2=0x7fc6a013d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:32.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.516+0000 7fc6a5a00640 1 --2- 172.21.15.55:0/3121266846 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6a015a070 0x7fc6a013d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.516+0000 7fc6a5a00640 1 -- 172.21.15.55:0/3121266846 >> v1:172.21.15.55:6789/0 conn(0x7fc6a0159be0 legacy=0x7fc6a00b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:32.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.516+0000 7fc69fe00640 1 -- 172.21.15.55:0/3121266846 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916517639 0 0) 0x7fc6a013d0c0 con 0x7fc6a0159be0 2024-04-02T07:33:32.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.516+0000 7fc6a5a00640 1 -- 172.21.15.55:0/3121266846 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a015aab0 con 0x7fc6a0153ea0 2024-04-02T07:33:32.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.520+0000 7fc6a5a00640 1 --2- 172.21.15.55:0/3121266846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6a0153ea0 0x7fc6a00c4120 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fc6940097c0 tx=0x7fc69401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303a1f052ead3b36 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:32.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.520+0000 7fc69fe00640 1 -- 172.21.15.55:0/3121266846 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6940aa620 con 0x7fc6a0153ea0 2024-04-02T07:33:32.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.520+0000 7fc69fe00640 1 -- 172.21.15.55:0/3121266846 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6940aa780 con 0x7fc6a0153ea0 2024-04-02T07:33:32.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.520+0000 7fc69fe00640 1 -- 172.21.15.55:0/3121266846 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6940aab10 con 0x7fc6a0153ea0 2024-04-02T07:33:32.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.520+0000 7fc6a8400640 1 -- 172.21.15.55:0/3121266846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6a0153ea0 msgr2=0x7fc6a00c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:32.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.520+0000 7fc6a8400640 1 --2- 172.21.15.55:0/3121266846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6a0153ea0 0x7fc6a00c4120 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fc6940097c0 tx=0x7fc69401c4a0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.520+0000 7fc6a8400640 1 -- 172.21.15.55:0/3121266846 shutdown_connections 2024-04-02T07:33:32.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.520+0000 7fc6a8400640 1 --2- 172.21.15.55:0/3121266846 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6a015a070 0x7fc6a013d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.520+0000 7fc6a8400640 1 --2- 172.21.15.55:0/3121266846 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6a0153ea0 0x7fc6a00c4120 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.520+0000 7fc6a8400640 1 -- 172.21.15.55:0/3121266846 >> 172.21.15.55:0/3121266846 conn(0x7fc6a0066080 msgr2=0x7fc6a0069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:32.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.520+0000 7fc6a8400640 1 -- 172.21.15.55:0/3121266846 shutdown_connections 2024-04-02T07:33:32.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.520+0000 7fc6a8400640 1 -- 172.21.15.55:0/3121266846 wait complete. 2024-04-02T07:33:32.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.520+0000 7fc6a8400640 1 Processor -- start 2024-04-02T07:33:32.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.520+0000 7fc6a8400640 1 -- start start 2024-04-02T07:33:32.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.520+0000 7fc6a8400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6a0153ea0 0x7fc6a01f8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:32.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.520+0000 7fc6a8400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6a0159be0 0x7fc6a015c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:32.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.520+0000 7fc6a8400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6a015a070 0x7fc6a00c3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:32.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.520+0000 7fc6a8400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a00c61e0 con 0x7fc6a0153ea0 2024-04-02T07:33:32.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.520+0000 7fc6a8400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a0138b00 con 0x7fc6a015a070 2024-04-02T07:33:32.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.520+0000 7fc6a8400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6a015cc40 con 0x7fc6a0159be0 2024-04-02T07:33:32.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.524+0000 7fc6a5a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6a0153ea0 0x7fc6a01f8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:32.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.524+0000 7fc6a5a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6a0153ea0 0x7fc6a01f8e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33188/0 (socket says 172.21.15.55:33188) 2024-04-02T07:33:32.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.524+0000 7fc6a5a00640 1 -- 172.21.15.55:0/3353702012 learned_addr learned my addr 172.21.15.55:0/3353702012 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:32.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.524+0000 7fc6a5000640 1 --2- 172.21.15.55:0/3353702012 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6a0159be0 0x7fc6a015c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:32.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.524+0000 7fc6a6400640 1 --2- 172.21.15.55:0/3353702012 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6a015a070 0x7fc6a00c3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:32.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.524+0000 7fc6a5a00640 1 -- 172.21.15.55:0/3353702012 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6a0159be0 msgr2=0x7fc6a015c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:32.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.524+0000 7fc6a5a00640 1 --2- 172.21.15.55:0/3353702012 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6a0159be0 0x7fc6a015c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.524+0000 7fc6a5a00640 1 -- 172.21.15.55:0/3353702012 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6a015a070 msgr2=0x7fc6a00c3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:32.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.524+0000 7fc6a5a00640 1 --2- 172.21.15.55:0/3353702012 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6a015a070 0x7fc6a00c3680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.524+0000 7fc6a5a00640 1 -- 172.21.15.55:0/3353702012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc694009420 con 0x7fc6a0153ea0 2024-04-02T07:33:32.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.524+0000 7fc6a5a00640 1 --2- 172.21.15.55:0/3353702012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6a0153ea0 0x7fc6a01f8e50 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fc69401a0d0 tx=0x7fc69401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:32.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.524+0000 7fc69d600640 1 -- 172.21.15.55:0/3353702012 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6940aabb0 con 0x7fc6a0153ea0 2024-04-02T07:33:32.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.524+0000 7fc69d600640 1 -- 172.21.15.55:0/3353702012 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6940b8070 con 0x7fc6a0153ea0 2024-04-02T07:33:32.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.524+0000 7fc6a8400640 1 -- 172.21.15.55:0/3353702012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6a0136770 con 0x7fc6a0153ea0 2024-04-02T07:33:32.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.524+0000 7fc69d600640 1 -- 172.21.15.55:0/3353702012 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc694004020 con 0x7fc6a0153ea0 2024-04-02T07:33:32.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.524+0000 7fc6a8400640 1 -- 172.21.15.55:0/3353702012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6a00c59d0 con 0x7fc6a0153ea0 2024-04-02T07:33:32.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.524+0000 7fc6a8400640 1 -- 172.21.15.55:0/3353702012 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6a0066c90 con 0x7fc6a0153ea0 2024-04-02T07:33:32.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.524+0000 7fc69d600640 1 -- 172.21.15.55:0/3353702012 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc694004180 con 0x7fc6a0153ea0 2024-04-02T07:33:32.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.524+0000 7fc69d600640 1 --2- 172.21.15.55:0/3353702012 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc680066690 0x7fc680068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:32.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.528+0000 7fc69d600640 1 -- 172.21.15.55:0/3353702012 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc6940ba070 con 0x7fc6a0153ea0 2024-04-02T07:33:32.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.528+0000 7fc6a5000640 1 --2- 172.21.15.55:0/3353702012 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc680066690 0x7fc680068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:32.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.528+0000 7fc6a5000640 1 --2- 172.21.15.55:0/3353702012 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc680066690 0x7fc680068b50 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc6a015c420 tx=0x7fc68c007b60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:32.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.528+0000 7fc69d600640 1 -- 172.21.15.55:0/3353702012 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc6940eb8b0 con 0x7fc6a0153ea0 2024-04-02T07:33:32.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.688+0000 7fc6a8400640 1 -- 172.21.15.55:0/3353702012 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc6a0136770 con 0x7fc680066690 2024-04-02T07:33:32.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.696+0000 7fc69d600640 1 -- 172.21.15.55:0/3353702012 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289605 (secure 0 0 0) 0x7fc6a0136770 con 0x7fc680066690 2024-04-02T07:33:32.701 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:32.703 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:33:32.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.700+0000 7fc6a8400640 1 -- 172.21.15.55:0/3353702012 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc680066690 msgr2=0x7fc680068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:32.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.700+0000 7fc6a8400640 1 --2- 172.21.15.55:0/3353702012 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc680066690 0x7fc680068b50 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fc6a015c420 tx=0x7fc68c007b60 comp rx=0 tx=0).stop 2024-04-02T07:33:32.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.700+0000 7fc6a8400640 1 -- 172.21.15.55:0/3353702012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6a0153ea0 msgr2=0x7fc6a01f8e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:32.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.700+0000 7fc6a8400640 1 --2- 172.21.15.55:0/3353702012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6a0153ea0 0x7fc6a01f8e50 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7fc69401a0d0 tx=0x7fc69401ace0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.700+0000 7fc6a8400640 1 -- 172.21.15.55:0/3353702012 shutdown_connections 2024-04-02T07:33:32.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.700+0000 7fc6a8400640 1 --2- 172.21.15.55:0/3353702012 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc680066690 0x7fc680068b50 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.700+0000 7fc6a8400640 1 --2- 172.21.15.55:0/3353702012 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc6a015a070 0x7fc6a00c3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.700+0000 7fc6a8400640 1 --2- 172.21.15.55:0/3353702012 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc6a0159be0 0x7fc6a015c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.700+0000 7fc6a8400640 1 --2- 172.21.15.55:0/3353702012 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc6a0153ea0 0x7fc6a01f8e50 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.700+0000 7fc6a8400640 1 -- 172.21.15.55:0/3353702012 >> 172.21.15.55:0/3353702012 conn(0x7fc6a0066080 msgr2=0x7fc6a00cb180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:32.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.700+0000 7fc6a8400640 1 -- 172.21.15.55:0/3353702012 shutdown_connections 2024-04-02T07:33:32.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.700+0000 7fc6a8400640 1 -- 172.21.15.55:0/3353702012 wait complete. 2024-04-02T07:33:32.722 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":452,"stamp":"2024-04-02T07:33:32.505566+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261464,"kb_used_data":12488,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754713256,"statfs":{"total":773094113280,"available":772826374144,"internally_reserved":0,"allocated":12787712,"data_stored":6197292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001592"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711677+0000","last_change":"2024-04-02T07:33:27.882595+0000","last_active":"2024-04-02T07:33:29.711677+0000","last_peered":"2024-04-02T07:33:29.711677+0000","last_clean":"2024-04-02T07:33:29.711677+0000","last_became_active":"2024-04-02T07:33:27.882331+0000","last_became_peered":"2024-04-02T07:33:27.882331+0000","last_unstale":"2024-04-02T07:33:29.711677+0000","last_undegraded":"2024-04-02T07:33:29.711677+0000","last_fullsized":"2024-04-02T07:33:29.711677+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:44:26.449539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.861038+0000","last_change":"2024-04-02T07:33:27.869951+0000","last_active":"2024-04-02T07:33:28.861038+0000","last_peered":"2024-04-02T07:33:28.861038+0000","last_clean":"2024-04-02T07:33:28.861038+0000","last_became_active":"2024-04-02T07:33:27.869579+0000","last_became_peered":"2024-04-02T07:33:27.869579+0000","last_unstale":"2024-04-02T07:33:28.861038+0000","last_undegraded":"2024-04-02T07:33:28.861038+0000","last_fullsized":"2024-04-02T07:33:28.861038+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:08:48.680568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714760+0000","last_change":"2024-04-02T07:33:27.877522+0000","last_active":"2024-04-02T07:33:29.714760+0000","last_peered":"2024-04-02T07:33:29.714760+0000","last_clean":"2024-04-02T07:33:29.714760+0000","last_became_active":"2024-04-02T07:33:27.876088+0000","last_became_peered":"2024-04-02T07:33:27.876088+0000","last_unstale":"2024-04-02T07:33:29.714760+0000","last_undegraded":"2024-04-02T07:33:29.714760+0000","last_fullsized":"2024-04-02T07:33:29.714760+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:08:39.323055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711842+0000","last_change":"2024-04-02T07:33:27.875231+0000","last_active":"2024-04-02T07:33:29.711842+0000","last_peered":"2024-04-02T07:33:29.711842+0000","last_clean":"2024-04-02T07:33:29.711842+0000","last_became_active":"2024-04-02T07:33:27.874506+0000","last_became_peered":"2024-04-02T07:33:27.874506+0000","last_unstale":"2024-04-02T07:33:29.711842+0000","last_undegraded":"2024-04-02T07:33:29.711842+0000","last_fullsized":"2024-04-02T07:33:29.711842+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:15:11.171684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857023+0000","last_change":"2024-04-02T07:33:27.871285+0000","last_active":"2024-04-02T07:33:28.857023+0000","last_peered":"2024-04-02T07:33:28.857023+0000","last_clean":"2024-04-02T07:33:28.857023+0000","last_became_active":"2024-04-02T07:33:27.871038+0000","last_became_peered":"2024-04-02T07:33:27.871038+0000","last_unstale":"2024-04-02T07:33:28.857023+0000","last_undegraded":"2024-04-02T07:33:28.857023+0000","last_fullsized":"2024-04-02T07:33:28.857023+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:49:08.367496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.210936+0000","last_change":"2024-04-02T07:33:27.876121+0000","last_active":"2024-04-02T07:33:29.210936+0000","last_peered":"2024-04-02T07:33:29.210936+0000","last_clean":"2024-04-02T07:33:29.210936+0000","last_became_active":"2024-04-02T07:33:27.875832+0000","last_became_peered":"2024-04-02T07:33:27.875832+0000","last_unstale":"2024-04-02T07:33:29.210936+0000","last_undegraded":"2024-04-02T07:33:29.210936+0000","last_fullsized":"2024-04-02T07:33:29.210936+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:12:14.480598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413346+0000","last_change":"2024-04-02T07:33:27.879609+0000","last_active":"2024-04-02T07:33:29.413346+0000","last_peered":"2024-04-02T07:33:29.413346+0000","last_clean":"2024-04-02T07:33:29.413346+0000","last_became_active":"2024-04-02T07:33:27.878988+0000","last_became_peered":"2024-04-02T07:33:27.878988+0000","last_unstale":"2024-04-02T07:33:29.413346+0000","last_undegraded":"2024-04-02T07:33:29.413346+0000","last_fullsized":"2024-04-02T07:33:29.413346+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:46:59.020865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714533+0000","last_change":"2024-04-02T07:33:27.876286+0000","last_active":"2024-04-02T07:33:29.714533+0000","last_peered":"2024-04-02T07:33:29.714533+0000","last_clean":"2024-04-02T07:33:29.714533+0000","last_became_active":"2024-04-02T07:33:27.875717+0000","last_became_peered":"2024-04-02T07:33:27.875717+0000","last_unstale":"2024-04-02T07:33:29.714533+0000","last_undegraded":"2024-04-02T07:33:29.714533+0000","last_fullsized":"2024-04-02T07:33:29.714533+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:05.978066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711733+0000","last_change":"2024-04-02T07:33:27.880196+0000","last_active":"2024-04-02T07:33:29.711733+0000","last_peered":"2024-04-02T07:33:29.711733+0000","last_clean":"2024-04-02T07:33:29.711733+0000","last_became_active":"2024-04-02T07:33:27.877656+0000","last_became_peered":"2024-04-02T07:33:27.877656+0000","last_unstale":"2024-04-02T07:33:29.711733+0000","last_undegraded":"2024-04-02T07:33:29.711733+0000","last_fullsized":"2024-04-02T07:33:29.711733+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:08.049991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711715+0000","last_change":"2024-04-02T07:33:27.869017+0000","last_active":"2024-04-02T07:33:29.711715+0000","last_peered":"2024-04-02T07:33:29.711715+0000","last_clean":"2024-04-02T07:33:29.711715+0000","last_became_active":"2024-04-02T07:33:27.868286+0000","last_became_peered":"2024-04-02T07:33:27.868286+0000","last_unstale":"2024-04-02T07:33:29.711715+0000","last_undegraded":"2024-04-02T07:33:29.711715+0000","last_fullsized":"2024-04-02T07:33:29.711715+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:45:02.593548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860916+0000","last_change":"2024-04-02T07:33:27.882601+0000","last_active":"2024-04-02T07:33:28.860916+0000","last_peered":"2024-04-02T07:33:28.860916+0000","last_clean":"2024-04-02T07:33:28.860916+0000","last_became_active":"2024-04-02T07:33:27.882352+0000","last_became_peered":"2024-04-02T07:33:27.882352+0000","last_unstale":"2024-04-02T07:33:28.860916+0000","last_undegraded":"2024-04-02T07:33:28.860916+0000","last_fullsized":"2024-04-02T07:33:28.860916+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:42:59.489339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711840+0000","last_change":"2024-04-02T07:33:27.874378+0000","last_active":"2024-04-02T07:33:29.711840+0000","last_peered":"2024-04-02T07:33:29.711840+0000","last_clean":"2024-04-02T07:33:29.711840+0000","last_became_active":"2024-04-02T07:33:27.873619+0000","last_became_peered":"2024-04-02T07:33:27.873619+0000","last_unstale":"2024-04-02T07:33:29.711840+0000","last_undegraded":"2024-04-02T07:33:29.711840+0000","last_fullsized":"2024-04-02T07:33:29.711840+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:09:32.458968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714766+0000","last_change":"2024-04-02T07:33:27.875814+0000","last_active":"2024-04-02T07:33:29.714766+0000","last_peered":"2024-04-02T07:33:29.714766+0000","last_clean":"2024-04-02T07:33:29.714766+0000","last_became_active":"2024-04-02T07:33:27.874810+0000","last_became_peered":"2024-04-02T07:33:27.874810+0000","last_unstale":"2024-04-02T07:33:29.714766+0000","last_undegraded":"2024-04-02T07:33:29.714766+0000","last_fullsized":"2024-04-02T07:33:29.714766+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:47:01.625875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714540+0000","last_change":"2024-04-02T07:33:27.884371+0000","last_active":"2024-04-02T07:33:29.714540+0000","last_peered":"2024-04-02T07:33:29.714540+0000","last_clean":"2024-04-02T07:33:29.714540+0000","last_became_active":"2024-04-02T07:33:27.884131+0000","last_became_peered":"2024-04-02T07:33:27.884131+0000","last_unstale":"2024-04-02T07:33:29.714540+0000","last_undegraded":"2024-04-02T07:33:29.714540+0000","last_fullsized":"2024-04-02T07:33:29.714540+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:45:56.636391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.210851+0000","last_change":"2024-04-02T07:33:27.877545+0000","last_active":"2024-04-02T07:33:29.210851+0000","last_peered":"2024-04-02T07:33:29.210851+0000","last_clean":"2024-04-02T07:33:29.210851+0000","last_became_active":"2024-04-02T07:33:27.877273+0000","last_became_peered":"2024-04-02T07:33:27.877273+0000","last_unstale":"2024-04-02T07:33:29.210851+0000","last_undegraded":"2024-04-02T07:33:29.210851+0000","last_fullsized":"2024-04-02T07:33:29.210851+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:52:13.075492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711236+0000","last_change":"2024-04-02T07:33:27.876720+0000","last_active":"2024-04-02T07:33:29.711236+0000","last_peered":"2024-04-02T07:33:29.711236+0000","last_clean":"2024-04-02T07:33:29.711236+0000","last_became_active":"2024-04-02T07:33:27.876330+0000","last_became_peered":"2024-04-02T07:33:27.876330+0000","last_unstale":"2024-04-02T07:33:29.711236+0000","last_undegraded":"2024-04-02T07:33:29.711236+0000","last_fullsized":"2024-04-02T07:33:29.711236+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:15:51.484030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860989+0000","last_change":"2024-04-02T07:33:27.884195+0000","last_active":"2024-04-02T07:33:28.860989+0000","last_peered":"2024-04-02T07:33:28.860989+0000","last_clean":"2024-04-02T07:33:28.860989+0000","last_became_active":"2024-04-02T07:33:27.883925+0000","last_became_peered":"2024-04-02T07:33:27.883925+0000","last_unstale":"2024-04-02T07:33:28.860989+0000","last_undegraded":"2024-04-02T07:33:28.860989+0000","last_fullsized":"2024-04-02T07:33:28.860989+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:24:38.502056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.507576+0000","last_change":"2024-04-02T07:33:27.880520+0000","last_active":"2024-04-02T07:33:29.507576+0000","last_peered":"2024-04-02T07:33:29.507576+0000","last_clean":"2024-04-02T07:33:29.507576+0000","last_became_active":"2024-04-02T07:33:27.879592+0000","last_became_peered":"2024-04-02T07:33:27.879592+0000","last_unstale":"2024-04-02T07:33:29.507576+0000","last_undegraded":"2024-04-02T07:33:29.507576+0000","last_fullsized":"2024-04-02T07:33:29.507576+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:42:59.489339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714842+0000","last_change":"2024-04-02T07:33:27.877703+0000","last_active":"2024-04-02T07:33:29.714842+0000","last_peered":"2024-04-02T07:33:29.714842+0000","last_clean":"2024-04-02T07:33:29.714842+0000","last_became_active":"2024-04-02T07:33:27.876491+0000","last_became_peered":"2024-04-02T07:33:27.876491+0000","last_unstale":"2024-04-02T07:33:29.714842+0000","last_undegraded":"2024-04-02T07:33:29.714842+0000","last_fullsized":"2024-04-02T07:33:29.714842+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:22:10.905772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.861137+0000","last_change":"2024-04-02T07:33:27.875061+0000","last_active":"2024-04-02T07:33:28.861137+0000","last_peered":"2024-04-02T07:33:28.861137+0000","last_clean":"2024-04-02T07:33:28.861137+0000","last_became_active":"2024-04-02T07:33:27.873808+0000","last_became_peered":"2024-04-02T07:33:27.873808+0000","last_unstale":"2024-04-02T07:33:28.861137+0000","last_undegraded":"2024-04-02T07:33:28.861137+0000","last_fullsized":"2024-04-02T07:33:28.861137+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:07:35.756044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860959+0000","last_change":"2024-04-02T07:33:27.874169+0000","last_active":"2024-04-02T07:33:28.860959+0000","last_peered":"2024-04-02T07:33:28.860959+0000","last_clean":"2024-04-02T07:33:28.860959+0000","last_became_active":"2024-04-02T07:33:27.873870+0000","last_became_peered":"2024-04-02T07:33:27.873870+0000","last_unstale":"2024-04-02T07:33:28.860959+0000","last_undegraded":"2024-04-02T07:33:28.860959+0000","last_fullsized":"2024-04-02T07:33:28.860959+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:04:12.160313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857812+0000","last_change":"2024-04-02T07:33:27.877812+0000","last_active":"2024-04-02T07:33:28.857812+0000","last_peered":"2024-04-02T07:33:28.857812+0000","last_clean":"2024-04-02T07:33:28.857812+0000","last_became_active":"2024-04-02T07:33:27.877587+0000","last_became_peered":"2024-04-02T07:33:27.877587+0000","last_unstale":"2024-04-02T07:33:28.857812+0000","last_undegraded":"2024-04-02T07:33:28.857812+0000","last_fullsized":"2024-04-02T07:33:28.857812+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:56:03.473104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860474+0000","last_change":"2024-04-02T07:33:27.873484+0000","last_active":"2024-04-02T07:33:28.860474+0000","last_peered":"2024-04-02T07:33:28.860474+0000","last_clean":"2024-04-02T07:33:28.860474+0000","last_became_active":"2024-04-02T07:33:27.873191+0000","last_became_peered":"2024-04-02T07:33:27.873191+0000","last_unstale":"2024-04-02T07:33:28.860474+0000","last_undegraded":"2024-04-02T07:33:28.860474+0000","last_fullsized":"2024-04-02T07:33:28.860474+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:42:58.494573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857717+0000","last_change":"2024-04-02T07:33:27.876890+0000","last_active":"2024-04-02T07:33:28.857717+0000","last_peered":"2024-04-02T07:33:28.857717+0000","last_clean":"2024-04-02T07:33:28.857717+0000","last_became_active":"2024-04-02T07:33:27.876595+0000","last_became_peered":"2024-04-02T07:33:27.876595+0000","last_unstale":"2024-04-02T07:33:28.857717+0000","last_undegraded":"2024-04-02T07:33:28.857717+0000","last_fullsized":"2024-04-02T07:33:28.857717+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:44:30.290566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.861036+0000","last_change":"2024-04-02T07:33:27.883804+0000","last_active":"2024-04-02T07:33:28.861036+0000","last_peered":"2024-04-02T07:33:28.861036+0000","last_clean":"2024-04-02T07:33:28.861036+0000","last_became_active":"2024-04-02T07:33:27.883536+0000","last_became_peered":"2024-04-02T07:33:27.883536+0000","last_unstale":"2024-04-02T07:33:28.861036+0000","last_undegraded":"2024-04-02T07:33:28.861036+0000","last_fullsized":"2024-04-02T07:33:28.861036+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:24:35.699323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711791+0000","last_change":"2024-04-02T07:33:27.873296+0000","last_active":"2024-04-02T07:33:29.711791+0000","last_peered":"2024-04-02T07:33:29.711791+0000","last_clean":"2024-04-02T07:33:29.711791+0000","last_became_active":"2024-04-02T07:33:27.872968+0000","last_became_peered":"2024-04-02T07:33:27.872968+0000","last_unstale":"2024-04-02T07:33:29.711791+0000","last_undegraded":"2024-04-02T07:33:29.711791+0000","last_fullsized":"2024-04-02T07:33:29.711791+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:54:29.292390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.211116+0000","last_change":"2024-04-02T07:33:27.868594+0000","last_active":"2024-04-02T07:33:29.211116+0000","last_peered":"2024-04-02T07:33:29.211116+0000","last_clean":"2024-04-02T07:33:29.211116+0000","last_became_active":"2024-04-02T07:33:27.867037+0000","last_became_peered":"2024-04-02T07:33:27.867037+0000","last_unstale":"2024-04-02T07:33:29.211116+0000","last_undegraded":"2024-04-02T07:33:29.211116+0000","last_fullsized":"2024-04-02T07:33:29.211116+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:37:18.608010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857926+0000","last_change":"2024-04-02T07:33:27.877779+0000","last_active":"2024-04-02T07:33:28.857926+0000","last_peered":"2024-04-02T07:33:28.857926+0000","last_clean":"2024-04-02T07:33:28.857926+0000","last_became_active":"2024-04-02T07:33:27.877522+0000","last_became_peered":"2024-04-02T07:33:27.877522+0000","last_unstale":"2024-04-02T07:33:28.857926+0000","last_undegraded":"2024-04-02T07:33:28.857926+0000","last_fullsized":"2024-04-02T07:33:28.857926+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:42:36.055385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860478+0000","last_change":"2024-04-02T07:33:27.872398+0000","last_active":"2024-04-02T07:33:28.860478+0000","last_peered":"2024-04-02T07:33:28.860478+0000","last_clean":"2024-04-02T07:33:28.860478+0000","last_became_active":"2024-04-02T07:33:27.872153+0000","last_became_peered":"2024-04-02T07:33:27.872153+0000","last_unstale":"2024-04-02T07:33:28.860478+0000","last_undegraded":"2024-04-02T07:33:28.860478+0000","last_fullsized":"2024-04-02T07:33:28.860478+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:05.978066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413563+0000","last_change":"2024-04-02T07:33:27.877534+0000","last_active":"2024-04-02T07:33:29.413563+0000","last_peered":"2024-04-02T07:33:29.413563+0000","last_clean":"2024-04-02T07:33:29.413563+0000","last_became_active":"2024-04-02T07:33:27.874093+0000","last_became_peered":"2024-04-02T07:33:27.874093+0000","last_unstale":"2024-04-02T07:33:29.413563+0000","last_undegraded":"2024-04-02T07:33:29.413563+0000","last_fullsized":"2024-04-02T07:33:29.413563+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:07.305572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711292+0000","last_change":"2024-04-02T07:33:27.872336+0000","last_active":"2024-04-02T07:33:29.711292+0000","last_peered":"2024-04-02T07:33:29.711292+0000","last_clean":"2024-04-02T07:33:29.711292+0000","last_became_active":"2024-04-02T07:33:27.872061+0000","last_became_peered":"2024-04-02T07:33:27.872061+0000","last_unstale":"2024-04-02T07:33:29.711292+0000","last_undegraded":"2024-04-02T07:33:29.711292+0000","last_fullsized":"2024-04-02T07:33:29.711292+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:16:52.197373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.210854+0000","last_change":"2024-04-02T07:33:27.875893+0000","last_active":"2024-04-02T07:33:29.210854+0000","last_peered":"2024-04-02T07:33:29.210854+0000","last_clean":"2024-04-02T07:33:29.210854+0000","last_became_active":"2024-04-02T07:33:27.875615+0000","last_became_peered":"2024-04-02T07:33:27.875615+0000","last_unstale":"2024-04-02T07:33:29.210854+0000","last_undegraded":"2024-04-02T07:33:29.210854+0000","last_fullsized":"2024-04-02T07:33:29.210854+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:56:29.935329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.211275+0000","last_change":"2024-04-02T07:33:27.866086+0000","last_active":"2024-04-02T07:33:29.211275+0000","last_peered":"2024-04-02T07:33:29.211275+0000","last_clean":"2024-04-02T07:33:29.211275+0000","last_became_active":"2024-04-02T07:33:27.865799+0000","last_became_peered":"2024-04-02T07:33:27.865799+0000","last_unstale":"2024-04-02T07:33:29.211275+0000","last_undegraded":"2024-04-02T07:33:29.211275+0000","last_fullsized":"2024-04-02T07:33:29.211275+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:49:55.405575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"115'4","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413536+0000","last_change":"2024-04-02T07:33:27.465580+0000","last_active":"2024-04-02T07:33:29.413536+0000","last_peered":"2024-04-02T07:33:29.413536+0000","last_clean":"2024-04-02T07:33:29.413536+0000","last_became_active":"2024-04-02T07:33:27.465317+0000","last_became_peered":"2024-04-02T07:33:27.465317+0000","last_unstale":"2024-04-02T07:33:29.413536+0000","last_undegraded":"2024-04-02T07:33:29.413536+0000","last_fullsized":"2024-04-02T07:33:29.413536+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:53:49.973543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.507596+0000","last_change":"2024-04-02T07:33:27.882689+0000","last_active":"2024-04-02T07:33:29.507596+0000","last_peered":"2024-04-02T07:33:29.507596+0000","last_clean":"2024-04-02T07:33:29.507596+0000","last_became_active":"2024-04-02T07:33:27.882354+0000","last_became_peered":"2024-04-02T07:33:27.882354+0000","last_unstale":"2024-04-02T07:33:29.507596+0000","last_undegraded":"2024-04-02T07:33:29.507596+0000","last_fullsized":"2024-04-02T07:33:29.507596+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:24:38.502056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"115'1","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714897+0000","last_change":"2024-04-02T07:33:27.466340+0000","last_active":"2024-04-02T07:33:29.714897+0000","last_peered":"2024-04-02T07:33:29.714897+0000","last_clean":"2024-04-02T07:33:29.714897+0000","last_became_active":"2024-04-02T07:33:27.466039+0000","last_became_peered":"2024-04-02T07:33:27.466039+0000","last_unstale":"2024-04-02T07:33:29.714897+0000","last_undegraded":"2024-04-02T07:33:29.714897+0000","last_fullsized":"2024-04-02T07:33:29.714897+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:37:17.604375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.211070+0000","last_change":"2024-04-02T07:33:27.876858+0000","last_active":"2024-04-02T07:33:29.211070+0000","last_peered":"2024-04-02T07:33:29.211070+0000","last_clean":"2024-04-02T07:33:29.211070+0000","last_became_active":"2024-04-02T07:33:27.876598+0000","last_became_peered":"2024-04-02T07:33:27.876598+0000","last_unstale":"2024-04-02T07:33:29.211070+0000","last_undegraded":"2024-04-02T07:33:29.211070+0000","last_fullsized":"2024-04-02T07:33:29.211070+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:30:56.102859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"115'2","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.856911+0000","last_change":"2024-04-02T07:33:27.456721+0000","last_active":"2024-04-02T07:33:28.856911+0000","last_peered":"2024-04-02T07:33:28.856911+0000","last_clean":"2024-04-02T07:33:28.856911+0000","last_became_active":"2024-04-02T07:33:27.456469+0000","last_became_peered":"2024-04-02T07:33:27.456469+0000","last_unstale":"2024-04-02T07:33:28.856911+0000","last_undegraded":"2024-04-02T07:33:28.856911+0000","last_fullsized":"2024-04-02T07:33:28.856911+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:04:38.980893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714885+0000","last_change":"2024-04-02T07:33:27.880030+0000","last_active":"2024-04-02T07:33:29.714885+0000","last_peered":"2024-04-02T07:33:29.714885+0000","last_clean":"2024-04-02T07:33:29.714885+0000","last_became_active":"2024-04-02T07:33:27.876829+0000","last_became_peered":"2024-04-02T07:33:27.876829+0000","last_unstale":"2024-04-02T07:33:29.714885+0000","last_undegraded":"2024-04-02T07:33:29.714885+0000","last_fullsized":"2024-04-02T07:33:29.714885+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:37:58.952494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"115'2","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.856780+0000","last_change":"2024-04-02T07:33:27.459863+0000","last_active":"2024-04-02T07:33:28.856780+0000","last_peered":"2024-04-02T07:33:28.856780+0000","last_clean":"2024-04-02T07:33:28.856780+0000","last_became_active":"2024-04-02T07:33:27.458908+0000","last_became_peered":"2024-04-02T07:33:27.458908+0000","last_unstale":"2024-04-02T07:33:28.856780+0000","last_undegraded":"2024-04-02T07:33:28.856780+0000","last_fullsized":"2024-04-02T07:33:28.856780+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:54:43.407165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711388+0000","last_change":"2024-04-02T07:33:27.881505+0000","last_active":"2024-04-02T07:33:29.711388+0000","last_peered":"2024-04-02T07:33:29.711388+0000","last_clean":"2024-04-02T07:33:29.711388+0000","last_became_active":"2024-04-02T07:33:27.881255+0000","last_became_peered":"2024-04-02T07:33:27.881255+0000","last_unstale":"2024-04-02T07:33:29.711388+0000","last_undegraded":"2024-04-02T07:33:29.711388+0000","last_fullsized":"2024-04-02T07:33:29.711388+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:12:23.501513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"115'1","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413467+0000","last_change":"2024-04-02T07:33:27.464628+0000","last_active":"2024-04-02T07:33:29.413467+0000","last_peered":"2024-04-02T07:33:29.413467+0000","last_clean":"2024-04-02T07:33:29.413467+0000","last_became_active":"2024-04-02T07:33:27.464228+0000","last_became_peered":"2024-04-02T07:33:27.464228+0000","last_unstale":"2024-04-02T07:33:29.413467+0000","last_undegraded":"2024-04-02T07:33:29.413467+0000","last_fullsized":"2024-04-02T07:33:29.413467+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:07:36.248518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860597+0000","last_change":"2024-04-02T07:33:27.875788+0000","last_active":"2024-04-02T07:33:28.860597+0000","last_peered":"2024-04-02T07:33:28.860597+0000","last_clean":"2024-04-02T07:33:28.860597+0000","last_became_active":"2024-04-02T07:33:27.875532+0000","last_became_peered":"2024-04-02T07:33:27.875532+0000","last_unstale":"2024-04-02T07:33:28.860597+0000","last_undegraded":"2024-04-02T07:33:28.860597+0000","last_fullsized":"2024-04-02T07:33:28.860597+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:44:30.553371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"115'1","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.880920+0000","last_change":"2024-04-02T07:33:27.464579+0000","last_active":"2024-04-02T07:33:27.880920+0000","last_peered":"2024-04-02T07:33:27.880920+0000","last_clean":"2024-04-02T07:33:27.880920+0000","last_became_active":"2024-04-02T07:33:27.464321+0000","last_became_peered":"2024-04-02T07:33:27.464321+0000","last_unstale":"2024-04-02T07:33:27.880920+0000","last_undegraded":"2024-04-02T07:33:27.880920+0000","last_fullsized":"2024-04-02T07:33:27.880920+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:08:56.569092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711234+0000","last_change":"2024-04-02T07:33:27.876563+0000","last_active":"2024-04-02T07:33:29.711234+0000","last_peered":"2024-04-02T07:33:29.711234+0000","last_clean":"2024-04-02T07:33:29.711234+0000","last_became_active":"2024-04-02T07:33:27.875714+0000","last_became_peered":"2024-04-02T07:33:27.875714+0000","last_unstale":"2024-04-02T07:33:29.711234+0000","last_undegraded":"2024-04-02T07:33:29.711234+0000","last_fullsized":"2024-04-02T07:33:29.711234+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:04:00.348795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.859908+0000","last_change":"2024-04-02T07:33:27.462628+0000","last_active":"2024-04-02T07:33:27.859908+0000","last_peered":"2024-04-02T07:33:27.859908+0000","last_clean":"2024-04-02T07:33:27.859908+0000","last_became_active":"2024-04-02T07:33:27.462346+0000","last_became_peered":"2024-04-02T07:33:27.462346+0000","last_unstale":"2024-04-02T07:33:27.859908+0000","last_undegraded":"2024-04-02T07:33:27.859908+0000","last_fullsized":"2024-04-02T07:33:27.859908+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:21.236879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413277+0000","last_change":"2024-04-02T07:33:27.879776+0000","last_active":"2024-04-02T07:33:29.413277+0000","last_peered":"2024-04-02T07:33:29.413277+0000","last_clean":"2024-04-02T07:33:29.413277+0000","last_became_active":"2024-04-02T07:33:27.879358+0000","last_became_peered":"2024-04-02T07:33:27.879358+0000","last_unstale":"2024-04-02T07:33:29.413277+0000","last_undegraded":"2024-04-02T07:33:29.413277+0000","last_fullsized":"2024-04-02T07:33:29.413277+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:22.240514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711359+0000","last_change":"2024-04-02T07:33:27.470673+0000","last_active":"2024-04-02T07:33:29.711359+0000","last_peered":"2024-04-02T07:33:29.711359+0000","last_clean":"2024-04-02T07:33:29.711359+0000","last_became_active":"2024-04-02T07:33:27.470329+0000","last_became_peered":"2024-04-02T07:33:27.470329+0000","last_unstale":"2024-04-02T07:33:29.711359+0000","last_undegraded":"2024-04-02T07:33:29.711359+0000","last_fullsized":"2024-04-02T07:33:29.711359+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:45:55.632756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413598+0000","last_change":"2024-04-02T07:33:27.877334+0000","last_active":"2024-04-02T07:33:29.413598+0000","last_peered":"2024-04-02T07:33:29.413598+0000","last_clean":"2024-04-02T07:33:29.413598+0000","last_became_active":"2024-04-02T07:33:27.877064+0000","last_became_peered":"2024-04-02T07:33:27.877064+0000","last_unstale":"2024-04-02T07:33:29.413598+0000","last_undegraded":"2024-04-02T07:33:29.413598+0000","last_fullsized":"2024-04-02T07:33:29.413598+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:25:29.754251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.856687+0000","last_change":"2024-04-02T07:33:27.461888+0000","last_active":"2024-04-02T07:33:28.856687+0000","last_peered":"2024-04-02T07:33:28.856687+0000","last_clean":"2024-04-02T07:33:28.856687+0000","last_became_active":"2024-04-02T07:33:27.461640+0000","last_became_peered":"2024-04-02T07:33:27.461640+0000","last_unstale":"2024-04-02T07:33:28.856687+0000","last_undegraded":"2024-04-02T07:33:28.856687+0000","last_fullsized":"2024-04-02T07:33:28.856687+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:26:29.689361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.507698+0000","last_change":"2024-04-02T07:33:27.882054+0000","last_active":"2024-04-02T07:33:29.507698+0000","last_peered":"2024-04-02T07:33:29.507698+0000","last_clean":"2024-04-02T07:33:29.507698+0000","last_became_active":"2024-04-02T07:33:27.881385+0000","last_became_peered":"2024-04-02T07:33:27.881385+0000","last_unstale":"2024-04-02T07:33:29.507698+0000","last_undegraded":"2024-04-02T07:33:29.507698+0000","last_fullsized":"2024-04-02T07:33:29.507698+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:07:35.756044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.866811+0000","last_change":"2024-04-02T07:33:27.464819+0000","last_active":"2024-04-02T07:33:27.866811+0000","last_peered":"2024-04-02T07:33:27.866811+0000","last_clean":"2024-04-02T07:33:27.866811+0000","last_became_active":"2024-04-02T07:33:27.464336+0000","last_became_peered":"2024-04-02T07:33:27.464336+0000","last_unstale":"2024-04-02T07:33:27.866811+0000","last_undegraded":"2024-04-02T07:33:27.866811+0000","last_fullsized":"2024-04-02T07:33:27.866811+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:04:11.156678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857980+0000","last_change":"2024-04-02T07:33:27.873267+0000","last_active":"2024-04-02T07:33:28.857980+0000","last_peered":"2024-04-02T07:33:28.857980+0000","last_clean":"2024-04-02T07:33:28.857980+0000","last_became_active":"2024-04-02T07:33:27.872846+0000","last_became_peered":"2024-04-02T07:33:27.872846+0000","last_unstale":"2024-04-02T07:33:28.857980+0000","last_undegraded":"2024-04-02T07:33:28.857980+0000","last_fullsized":"2024-04-02T07:33:28.857980+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:19:33.558224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"115'3","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711681+0000","last_change":"2024-04-02T07:33:27.468371+0000","last_active":"2024-04-02T07:33:29.711681+0000","last_peered":"2024-04-02T07:33:29.711681+0000","last_clean":"2024-04-02T07:33:29.711681+0000","last_became_active":"2024-04-02T07:33:27.468137+0000","last_became_peered":"2024-04-02T07:33:27.468137+0000","last_unstale":"2024-04-02T07:33:29.711681+0000","last_undegraded":"2024-04-02T07:33:29.711681+0000","last_fullsized":"2024-04-02T07:33:29.711681+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:07:34.752409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413480+0000","last_change":"2024-04-02T07:33:27.874173+0000","last_active":"2024-04-02T07:33:29.413480+0000","last_peered":"2024-04-02T07:33:29.413480+0000","last_clean":"2024-04-02T07:33:29.413480+0000","last_became_active":"2024-04-02T07:33:27.873885+0000","last_became_peered":"2024-04-02T07:33:27.873885+0000","last_unstale":"2024-04-02T07:33:29.413480+0000","last_undegraded":"2024-04-02T07:33:29.413480+0000","last_fullsized":"2024-04-02T07:33:29.413480+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:01:55.510529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"115'6","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711951+0000","last_change":"2024-04-02T07:33:27.470069+0000","last_active":"2024-04-02T07:33:29.711951+0000","last_peered":"2024-04-02T07:33:29.711951+0000","last_clean":"2024-04-02T07:33:29.711951+0000","last_became_active":"2024-04-02T07:33:27.469725+0000","last_became_peered":"2024-04-02T07:33:27.469725+0000","last_unstale":"2024-04-02T07:33:29.711951+0000","last_undegraded":"2024-04-02T07:33:29.711951+0000","last_fullsized":"2024-04-02T07:33:29.711951+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:48:39.594742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857894+0000","last_change":"2024-04-02T07:33:27.869118+0000","last_active":"2024-04-02T07:33:28.857894+0000","last_peered":"2024-04-02T07:33:28.857894+0000","last_clean":"2024-04-02T07:33:28.857894+0000","last_became_active":"2024-04-02T07:33:27.868872+0000","last_became_peered":"2024-04-02T07:33:27.868872+0000","last_unstale":"2024-04-02T07:33:28.857894+0000","last_undegraded":"2024-04-02T07:33:28.857894+0000","last_fullsized":"2024-04-02T07:33:28.857894+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:25:09.411123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"115'2","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.871157+0000","last_change":"2024-04-02T07:33:27.462734+0000","last_active":"2024-04-02T07:33:27.871157+0000","last_peered":"2024-04-02T07:33:27.871157+0000","last_clean":"2024-04-02T07:33:27.871157+0000","last_became_active":"2024-04-02T07:33:27.462486+0000","last_became_peered":"2024-04-02T07:33:27.462486+0000","last_unstale":"2024-04-02T07:33:27.871157+0000","last_undegraded":"2024-04-02T07:33:27.871157+0000","last_fullsized":"2024-04-02T07:33:27.871157+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:11:47.314840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857892+0000","last_change":"2024-04-02T07:33:27.876507+0000","last_active":"2024-04-02T07:33:28.857892+0000","last_peered":"2024-04-02T07:33:28.857892+0000","last_clean":"2024-04-02T07:33:28.857892+0000","last_became_active":"2024-04-02T07:33:27.876221+0000","last_became_peered":"2024-04-02T07:33:27.876221+0000","last_unstale":"2024-04-02T07:33:28.857892+0000","last_undegraded":"2024-04-02T07:33:28.857892+0000","last_fullsized":"2024-04-02T07:33:28.857892+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:37:58.952494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.872828+0000","last_change":"2024-04-02T07:33:27.469634+0000","last_active":"2024-04-02T07:33:27.872828+0000","last_peered":"2024-04-02T07:33:27.872828+0000","last_clean":"2024-04-02T07:33:27.872828+0000","last_became_active":"2024-04-02T07:33:27.469328+0000","last_became_peered":"2024-04-02T07:33:27.469328+0000","last_unstale":"2024-04-02T07:33:27.872828+0000","last_undegraded":"2024-04-02T07:33:27.872828+0000","last_fullsized":"2024-04-02T07:33:27.872828+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:21:06.948320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857866+0000","last_change":"2024-04-02T07:33:27.872927+0000","last_active":"2024-04-02T07:33:28.857866+0000","last_peered":"2024-04-02T07:33:28.857866+0000","last_clean":"2024-04-02T07:33:28.857866+0000","last_became_active":"2024-04-02T07:33:27.872635+0000","last_became_peered":"2024-04-02T07:33:27.872635+0000","last_unstale":"2024-04-02T07:33:28.857866+0000","last_undegraded":"2024-04-02T07:33:28.857866+0000","last_fullsized":"2024-04-02T07:33:28.857866+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:47:01.625875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"115'8","reported_seq":19,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.856539+0000","last_change":"2024-04-02T07:33:27.459692+0000","last_active":"2024-04-02T07:33:28.856539+0000","last_peered":"2024-04-02T07:33:28.856539+0000","last_clean":"2024-04-02T07:33:28.856539+0000","last_became_active":"2024-04-02T07:33:27.459414+0000","last_became_peered":"2024-04-02T07:33:27.459414+0000","last_unstale":"2024-04-02T07:33:28.856539+0000","last_undegraded":"2024-04-02T07:33:28.856539+0000","last_fullsized":"2024-04-02T07:33:28.856539+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:32:00.625887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857324+0000","last_change":"2024-04-02T07:33:27.881452+0000","last_active":"2024-04-02T07:33:28.857324+0000","last_peered":"2024-04-02T07:33:28.857324+0000","last_clean":"2024-04-02T07:33:28.857324+0000","last_became_active":"2024-04-02T07:33:27.879513+0000","last_became_peered":"2024-04-02T07:33:27.879513+0000","last_unstale":"2024-04-02T07:33:28.857324+0000","last_undegraded":"2024-04-02T07:33:28.857324+0000","last_fullsized":"2024-04-02T07:33:28.857324+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:53:50.977179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"115'1","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711883+0000","last_change":"2024-04-02T07:33:27.471006+0000","last_active":"2024-04-02T07:33:29.711883+0000","last_peered":"2024-04-02T07:33:29.711883+0000","last_clean":"2024-04-02T07:33:29.711883+0000","last_became_active":"2024-04-02T07:33:27.470297+0000","last_became_peered":"2024-04-02T07:33:27.470297+0000","last_unstale":"2024-04-02T07:33:29.711883+0000","last_undegraded":"2024-04-02T07:33:29.711883+0000","last_fullsized":"2024-04-02T07:33:29.711883+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:04.974430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.211281+0000","last_change":"2024-04-02T07:33:27.872104+0000","last_active":"2024-04-02T07:33:29.211281+0000","last_peered":"2024-04-02T07:33:29.211281+0000","last_clean":"2024-04-02T07:33:29.211281+0000","last_became_active":"2024-04-02T07:33:27.871812+0000","last_became_peered":"2024-04-02T07:33:27.871812+0000","last_unstale":"2024-04-02T07:33:29.211281+0000","last_undegraded":"2024-04-02T07:33:29.211281+0000","last_fullsized":"2024-04-02T07:33:29.211281+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:37:51.007791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"115'2","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857348+0000","last_change":"2024-04-02T07:33:27.460964+0000","last_active":"2024-04-02T07:33:28.857348+0000","last_peered":"2024-04-02T07:33:28.857348+0000","last_clean":"2024-04-02T07:33:28.857348+0000","last_became_active":"2024-04-02T07:33:27.460660+0000","last_became_peered":"2024-04-02T07:33:27.460660+0000","last_unstale":"2024-04-02T07:33:28.857348+0000","last_undegraded":"2024-04-02T07:33:28.857348+0000","last_fullsized":"2024-04-02T07:33:28.857348+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:18:31.967031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714810+0000","last_change":"2024-04-02T07:33:27.878749+0000","last_active":"2024-04-02T07:33:29.714810+0000","last_peered":"2024-04-02T07:33:29.714810+0000","last_clean":"2024-04-02T07:33:29.714810+0000","last_became_active":"2024-04-02T07:33:27.878487+0000","last_became_peered":"2024-04-02T07:33:27.878487+0000","last_unstale":"2024-04-02T07:33:29.714810+0000","last_undegraded":"2024-04-02T07:33:29.714810+0000","last_fullsized":"2024-04-02T07:33:29.714810+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:25:09.411123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"115'1","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.882562+0000","last_change":"2024-04-02T07:33:27.467380+0000","last_active":"2024-04-02T07:33:27.882562+0000","last_peered":"2024-04-02T07:33:27.882562+0000","last_clean":"2024-04-02T07:33:27.882562+0000","last_became_active":"2024-04-02T07:33:27.467110+0000","last_became_peered":"2024-04-02T07:33:27.467110+0000","last_unstale":"2024-04-02T07:33:27.882562+0000","last_undegraded":"2024-04-02T07:33:27.882562+0000","last_fullsized":"2024-04-02T07:33:27.882562+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:37:17.604375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714951+0000","last_change":"2024-04-02T07:33:27.880948+0000","last_active":"2024-04-02T07:33:29.714951+0000","last_peered":"2024-04-02T07:33:29.714951+0000","last_clean":"2024-04-02T07:33:29.714951+0000","last_became_active":"2024-04-02T07:33:27.880667+0000","last_became_peered":"2024-04-02T07:33:27.880667+0000","last_unstale":"2024-04-02T07:33:29.714951+0000","last_undegraded":"2024-04-02T07:33:29.714951+0000","last_fullsized":"2024-04-02T07:33:29.714951+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:17:08.670738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413362+0000","last_change":"2024-04-02T07:33:27.475514+0000","last_active":"2024-04-02T07:33:29.413362+0000","last_peered":"2024-04-02T07:33:29.413362+0000","last_clean":"2024-04-02T07:33:29.413362+0000","last_became_active":"2024-04-02T07:33:27.475204+0000","last_became_peered":"2024-04-02T07:33:27.475204+0000","last_unstale":"2024-04-02T07:33:29.413362+0000","last_undegraded":"2024-04-02T07:33:29.413362+0000","last_fullsized":"2024-04-02T07:33:29.413362+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:06:44.332166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714557+0000","last_change":"2024-04-02T07:33:27.877020+0000","last_active":"2024-04-02T07:33:29.714557+0000","last_peered":"2024-04-02T07:33:29.714557+0000","last_clean":"2024-04-02T07:33:29.714557+0000","last_became_active":"2024-04-02T07:33:27.876734+0000","last_became_peered":"2024-04-02T07:33:27.876734+0000","last_unstale":"2024-04-02T07:33:29.714557+0000","last_undegraded":"2024-04-02T07:33:29.714557+0000","last_fullsized":"2024-04-02T07:33:29.714557+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:07:35.756044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"115'2","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.869706+0000","last_change":"2024-04-02T07:33:27.468546+0000","last_active":"2024-04-02T07:33:27.869706+0000","last_peered":"2024-04-02T07:33:27.869706+0000","last_clean":"2024-04-02T07:33:27.869706+0000","last_became_active":"2024-04-02T07:33:27.468265+0000","last_became_peered":"2024-04-02T07:33:27.468265+0000","last_unstale":"2024-04-02T07:33:27.869706+0000","last_undegraded":"2024-04-02T07:33:27.869706+0000","last_fullsized":"2024-04-02T07:33:27.869706+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:20:26.400805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711361+0000","last_change":"2024-04-02T07:33:27.873609+0000","last_active":"2024-04-02T07:33:29.711361+0000","last_peered":"2024-04-02T07:33:29.711361+0000","last_clean":"2024-04-02T07:33:29.711361+0000","last_became_active":"2024-04-02T07:33:27.873311+0000","last_became_peered":"2024-04-02T07:33:27.873311+0000","last_unstale":"2024-04-02T07:33:29.711361+0000","last_undegraded":"2024-04-02T07:33:29.711361+0000","last_fullsized":"2024-04-02T07:33:29.711361+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:36:13.657455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.856665+0000","last_change":"2024-04-02T07:33:27.459252+0000","last_active":"2024-04-02T07:33:28.856665+0000","last_peered":"2024-04-02T07:33:28.856665+0000","last_clean":"2024-04-02T07:33:28.856665+0000","last_became_active":"2024-04-02T07:33:27.457131+0000","last_became_peered":"2024-04-02T07:33:27.457131+0000","last_unstale":"2024-04-02T07:33:28.856665+0000","last_undegraded":"2024-04-02T07:33:28.856665+0000","last_fullsized":"2024-04-02T07:33:28.856665+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:11:07.359510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714678+0000","last_change":"2024-04-02T07:33:27.876431+0000","last_active":"2024-04-02T07:33:29.714678+0000","last_peered":"2024-04-02T07:33:29.714678+0000","last_clean":"2024-04-02T07:33:29.714678+0000","last_became_active":"2024-04-02T07:33:27.876162+0000","last_became_peered":"2024-04-02T07:33:27.876162+0000","last_unstale":"2024-04-02T07:33:29.714678+0000","last_undegraded":"2024-04-02T07:33:29.714678+0000","last_fullsized":"2024-04-02T07:33:29.714678+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:56:03.473104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.851031+0000","last_change":"2024-04-02T07:33:27.464627+0000","last_active":"2024-04-02T07:33:27.851031+0000","last_peered":"2024-04-02T07:33:27.851031+0000","last_clean":"2024-04-02T07:33:27.851031+0000","last_became_active":"2024-04-02T07:33:27.464384+0000","last_became_peered":"2024-04-02T07:33:27.464384+0000","last_unstale":"2024-04-02T07:33:27.851031+0000","last_undegraded":"2024-04-02T07:33:27.851031+0000","last_fullsized":"2024-04-02T07:33:27.851031+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:08:01.054804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857770+0000","last_change":"2024-04-02T07:33:27.883782+0000","last_active":"2024-04-02T07:33:28.857770+0000","last_peered":"2024-04-02T07:33:28.857770+0000","last_clean":"2024-04-02T07:33:28.857770+0000","last_became_active":"2024-04-02T07:33:27.883530+0000","last_became_peered":"2024-04-02T07:33:27.883530+0000","last_unstale":"2024-04-02T07:33:28.857770+0000","last_undegraded":"2024-04-02T07:33:28.857770+0000","last_fullsized":"2024-04-02T07:33:28.857770+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:03:56.453553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711419+0000","last_change":"2024-04-02T07:33:27.466749+0000","last_active":"2024-04-02T07:33:29.711419+0000","last_peered":"2024-04-02T07:33:29.711419+0000","last_clean":"2024-04-02T07:33:29.711419+0000","last_became_active":"2024-04-02T07:33:27.466501+0000","last_became_peered":"2024-04-02T07:33:27.466501+0000","last_unstale":"2024-04-02T07:33:29.711419+0000","last_undegraded":"2024-04-02T07:33:29.711419+0000","last_fullsized":"2024-04-02T07:33:29.711419+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:29:58.451996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.507632+0000","last_change":"2024-04-02T07:33:27.880592+0000","last_active":"2024-04-02T07:33:29.507632+0000","last_peered":"2024-04-02T07:33:29.507632+0000","last_clean":"2024-04-02T07:33:29.507632+0000","last_became_active":"2024-04-02T07:33:27.880268+0000","last_became_peered":"2024-04-02T07:33:27.880268+0000","last_unstale":"2024-04-02T07:33:29.507632+0000","last_undegraded":"2024-04-02T07:33:29.507632+0000","last_fullsized":"2024-04-02T07:33:29.507632+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:42:58.494573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"115'2","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.877258+0000","last_change":"2024-04-02T07:33:27.460369+0000","last_active":"2024-04-02T07:33:27.877258+0000","last_peered":"2024-04-02T07:33:27.877258+0000","last_clean":"2024-04-02T07:33:27.877258+0000","last_became_active":"2024-04-02T07:33:27.460059+0000","last_became_peered":"2024-04-02T07:33:27.460059+0000","last_unstale":"2024-04-02T07:33:27.877258+0000","last_undegraded":"2024-04-02T07:33:27.877258+0000","last_fullsized":"2024-04-02T07:33:27.877258+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:08:47.676933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711799+0000","last_change":"2024-04-02T07:33:27.868116+0000","last_active":"2024-04-02T07:33:29.711799+0000","last_peered":"2024-04-02T07:33:29.711799+0000","last_clean":"2024-04-02T07:33:29.711799+0000","last_became_active":"2024-04-02T07:33:27.867771+0000","last_became_peered":"2024-04-02T07:33:27.867771+0000","last_unstale":"2024-04-02T07:33:29.711799+0000","last_undegraded":"2024-04-02T07:33:29.711799+0000","last_fullsized":"2024-04-02T07:33:29.711799+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:07:07.097752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"115'1","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.550059+0000","last_change":"2024-04-02T07:33:27.463956+0000","last_active":"2024-04-02T07:33:28.550059+0000","last_peered":"2024-04-02T07:33:28.550059+0000","last_clean":"2024-04-02T07:33:28.550059+0000","last_became_active":"2024-04-02T07:33:27.463426+0000","last_became_peered":"2024-04-02T07:33:27.463426+0000","last_unstale":"2024-04-02T07:33:28.550059+0000","last_undegraded":"2024-04-02T07:33:28.550059+0000","last_fullsized":"2024-04-02T07:33:28.550059+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:30:53.259024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711923+0000","last_change":"2024-04-02T07:33:27.873388+0000","last_active":"2024-04-02T07:33:29.711923+0000","last_peered":"2024-04-02T07:33:29.711923+0000","last_clean":"2024-04-02T07:33:29.711923+0000","last_became_active":"2024-04-02T07:33:27.873046+0000","last_became_peered":"2024-04-02T07:33:27.873046+0000","last_unstale":"2024-04-02T07:33:29.711923+0000","last_undegraded":"2024-04-02T07:33:29.711923+0000","last_fullsized":"2024-04-02T07:33:29.711923+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:38:08.666711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711698+0000","last_change":"2024-04-02T07:33:27.462653+0000","last_active":"2024-04-02T07:33:29.711698+0000","last_peered":"2024-04-02T07:33:29.711698+0000","last_clean":"2024-04-02T07:33:29.711698+0000","last_became_active":"2024-04-02T07:33:27.462356+0000","last_became_peered":"2024-04-02T07:33:27.462356+0000","last_unstale":"2024-04-02T07:33:29.711698+0000","last_undegraded":"2024-04-02T07:33:29.711698+0000","last_fullsized":"2024-04-02T07:33:29.711698+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:42:57.490938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.507503+0000","last_change":"2024-04-02T07:33:27.886387+0000","last_active":"2024-04-02T07:33:29.507503+0000","last_peered":"2024-04-02T07:33:29.507503+0000","last_clean":"2024-04-02T07:33:29.507503+0000","last_became_active":"2024-04-02T07:33:27.886120+0000","last_became_peered":"2024-04-02T07:33:27.886120+0000","last_unstale":"2024-04-02T07:33:29.507503+0000","last_undegraded":"2024-04-02T07:33:29.507503+0000","last_fullsized":"2024-04-02T07:33:29.507503+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:05.978066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.866477+0000","last_change":"2024-04-02T07:33:27.463765+0000","last_active":"2024-04-02T07:33:27.866477+0000","last_peered":"2024-04-02T07:33:27.866477+0000","last_clean":"2024-04-02T07:33:27.866477+0000","last_became_active":"2024-04-02T07:33:27.463560+0000","last_became_peered":"2024-04-02T07:33:27.463560+0000","last_unstale":"2024-04-02T07:33:27.866477+0000","last_undegraded":"2024-04-02T07:33:27.866477+0000","last_fullsized":"2024-04-02T07:33:27.866477+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:44:29.549736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860456+0000","last_change":"2024-04-02T07:33:27.871562+0000","last_active":"2024-04-02T07:33:28.860456+0000","last_peered":"2024-04-02T07:33:28.860456+0000","last_clean":"2024-04-02T07:33:28.860456+0000","last_became_active":"2024-04-02T07:33:27.871249+0000","last_became_peered":"2024-04-02T07:33:27.871249+0000","last_unstale":"2024-04-02T07:33:28.860456+0000","last_undegraded":"2024-04-02T07:33:28.860456+0000","last_fullsized":"2024-04-02T07:33:28.860456+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:29:59.455631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413588+0000","last_change":"2024-04-02T07:33:27.465947+0000","last_active":"2024-04-02T07:33:29.413588+0000","last_peered":"2024-04-02T07:33:29.413588+0000","last_clean":"2024-04-02T07:33:29.413588+0000","last_became_active":"2024-04-02T07:33:27.465653+0000","last_became_peered":"2024-04-02T07:33:27.465653+0000","last_unstale":"2024-04-02T07:33:29.413588+0000","last_undegraded":"2024-04-02T07:33:29.413588+0000","last_fullsized":"2024-04-02T07:33:29.413588+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:49:07.363861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860729+0000","last_change":"2024-04-02T07:33:27.868107+0000","last_active":"2024-04-02T07:33:28.860729+0000","last_peered":"2024-04-02T07:33:28.860729+0000","last_clean":"2024-04-02T07:33:28.860729+0000","last_became_active":"2024-04-02T07:33:27.867794+0000","last_became_peered":"2024-04-02T07:33:27.867794+0000","last_unstale":"2024-04-02T07:33:28.860729+0000","last_undegraded":"2024-04-02T07:33:28.860729+0000","last_fullsized":"2024-04-02T07:33:28.860729+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:08:57.572728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.861074+0000","last_change":"2024-04-02T07:33:27.463549+0000","last_active":"2024-04-02T07:33:27.861074+0000","last_peered":"2024-04-02T07:33:27.861074+0000","last_clean":"2024-04-02T07:33:27.861074+0000","last_became_active":"2024-04-02T07:33:27.463001+0000","last_became_peered":"2024-04-02T07:33:27.463001+0000","last_unstale":"2024-04-02T07:33:27.861074+0000","last_undegraded":"2024-04-02T07:33:27.861074+0000","last_fullsized":"2024-04-02T07:33:27.861074+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:42:29.107894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714800+0000","last_change":"2024-04-02T07:33:27.883667+0000","last_active":"2024-04-02T07:33:29.714800+0000","last_peered":"2024-04-02T07:33:29.714800+0000","last_clean":"2024-04-02T07:33:29.714800+0000","last_became_active":"2024-04-02T07:33:27.883417+0000","last_became_peered":"2024-04-02T07:33:27.883417+0000","last_unstale":"2024-04-02T07:33:29.714800+0000","last_undegraded":"2024-04-02T07:33:29.714800+0000","last_fullsized":"2024-04-02T07:33:29.714800+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:48:40.598377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.856798+0000","last_change":"2024-04-02T07:33:27.460731+0000","last_active":"2024-04-02T07:33:28.856798+0000","last_peered":"2024-04-02T07:33:28.856798+0000","last_clean":"2024-04-02T07:33:28.856798+0000","last_became_active":"2024-04-02T07:33:27.460259+0000","last_became_peered":"2024-04-02T07:33:27.460259+0000","last_unstale":"2024-04-02T07:33:28.856798+0000","last_undegraded":"2024-04-02T07:33:28.856798+0000","last_fullsized":"2024-04-02T07:33:28.856798+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:14:47.506995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711426+0000","last_change":"2024-04-02T07:33:27.865732+0000","last_active":"2024-04-02T07:33:29.711426+0000","last_peered":"2024-04-02T07:33:29.711426+0000","last_clean":"2024-04-02T07:33:29.711426+0000","last_became_active":"2024-04-02T07:33:27.865437+0000","last_became_peered":"2024-04-02T07:33:27.865437+0000","last_unstale":"2024-04-02T07:33:29.711426+0000","last_undegraded":"2024-04-02T07:33:29.711426+0000","last_fullsized":"2024-04-02T07:33:29.711426+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:06:19.432859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711498+0000","last_change":"2024-04-02T07:33:27.466750+0000","last_active":"2024-04-02T07:33:29.711498+0000","last_peered":"2024-04-02T07:33:29.711498+0000","last_clean":"2024-04-02T07:33:29.711498+0000","last_became_active":"2024-04-02T07:33:27.466479+0000","last_became_peered":"2024-04-02T07:33:27.466479+0000","last_unstale":"2024-04-02T07:33:29.711498+0000","last_undegraded":"2024-04-02T07:33:29.711498+0000","last_fullsized":"2024-04-02T07:33:29.711498+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:42:58.485704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857703+0000","last_change":"2024-04-02T07:33:27.876686+0000","last_active":"2024-04-02T07:33:28.857703+0000","last_peered":"2024-04-02T07:33:28.857703+0000","last_clean":"2024-04-02T07:33:28.857703+0000","last_became_active":"2024-04-02T07:33:27.876182+0000","last_became_peered":"2024-04-02T07:33:27.876182+0000","last_unstale":"2024-04-02T07:33:28.857703+0000","last_undegraded":"2024-04-02T07:33:28.857703+0000","last_fullsized":"2024-04-02T07:33:28.857703+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:22:10.905772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413403+0000","last_change":"2024-04-02T07:33:27.476242+0000","last_active":"2024-04-02T07:33:29.413403+0000","last_peered":"2024-04-02T07:33:29.413403+0000","last_clean":"2024-04-02T07:33:29.413403+0000","last_became_active":"2024-04-02T07:33:27.476017+0000","last_became_peered":"2024-04-02T07:33:27.476017+0000","last_unstale":"2024-04-02T07:33:29.413403+0000","last_undegraded":"2024-04-02T07:33:29.413403+0000","last_fullsized":"2024-04-02T07:33:29.413403+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:06:31.207856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":249,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.866769+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:33:27.866769+0000","last_peered":"2024-04-02T07:33:27.866769+0000","last_clean":"2024-04-02T07:33:27.866769+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:33:27.866769+0000","last_undegraded":"2024-04-02T07:33:27.866769+0000","last_fullsized":"2024-04-02T07:33:27.866769+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574987,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33112,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":2043904,"data_stored":1217463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68400000000000005,"15min":0.66300000000000003},"min":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.35299999999999998},"max":{"1min":0.90600000000000003,"5min":0.92400000000000004,"15min":1.0569999999999999},"last":0.63},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.66800000000000004,"15min":0.64300000000000002},"min":{"1min":0.60099999999999998,"5min":0.442,"15min":0.39900000000000002},"max":{"1min":0.88700000000000001,"5min":1.018,"15min":1.018},"last":0.58699999999999997}]},{"osd":1,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.67400000000000004,"15min":0.65500000000000003},"min":{"1min":0.52600000000000002,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.98099999999999998,"5min":1.004,"15min":1.0289999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69499999999999995,"15min":0.67800000000000005},"min":{"1min":0.503,"5min":0.42599999999999999,"15min":0.39500000000000002},"max":{"1min":0.96699999999999997,"5min":0.99299999999999999,"15min":1.113},"last":0.74399999999999999}]},{"osd":2,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.46300000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95099999999999996,"5min":1.0309999999999999,"15min":1.139},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.73999999999999999,"15min":0.72999999999999998},"min":{"1min":0.63900000000000001,"5min":0.503,"15min":0.437},"max":{"1min":0.93600000000000005,"5min":1.0549999999999999,"15min":1.522},"last":0.69799999999999995}]},{"osd":3,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.70999999999999996,"15min":0.70499999999999996},"min":{"1min":0.52100000000000002,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.94499999999999995,"5min":1.0409999999999999,"15min":1.405},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.623,"5min":0.48799999999999999,"15min":0.48599999999999999},"max":{"1min":0.96199999999999997,"5min":1.0329999999999999,"15min":1.0580000000000001},"last":0.55500000000000005}]},{"osd":4,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.63},"min":{"1min":0.40699999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":0.86599999999999999,"15min":1.633},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66400000000000003,"15min":0.69699999999999995},"min":{"1min":0.54700000000000004,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88200000000000001,"5min":0.94299999999999995,"15min":1.079},"last":0.79500000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.67700000000000005},"min":{"1min":0.39900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.99399999999999999,"5min":0.995,"15min":1.2250000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.70399999999999996,"15min":0.73799999999999999},"min":{"1min":0.60399999999999998,"5min":0.441,"15min":0.43099999999999999},"max":{"1min":0.93600000000000005,"5min":0.98799999999999999,"15min":1.5609999999999999},"last":0.81200000000000006}]},{"osd":6,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67000000000000004,"15min":0.69399999999999995},"min":{"1min":0.51300000000000001,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":0.93899999999999995,"5min":0.97599999999999998,"15min":1.5960000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66200000000000003,"15min":0.67500000000000004},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.40699999999999997},"max":{"1min":0.89800000000000002,"5min":0.96499999999999997,"15min":1.0840000000000001},"last":0.82999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574988,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1445888,"data_stored":626549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.71499999999999997,"15min":0.68600000000000005},"min":{"1min":0.56699999999999995,"5min":0.45500000000000002,"15min":0.41399999999999998},"max":{"1min":1.0820000000000001,"5min":1.147,"15min":1.399},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.70999999999999996,"15min":0.78000000000000003},"min":{"1min":0.60299999999999998,"5min":0.439,"15min":0.39400000000000002},"max":{"1min":0.91500000000000004,"5min":0.95799999999999996,"15min":5.7569999999999997},"last":0.80800000000000005}]},{"osd":1,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.59499999999999997,"5min":0.42299999999999999,"15min":0.38200000000000001},"max":{"1min":0.93000000000000005,"5min":1.097,"15min":1.95},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73799999999999999,"15min":0.73099999999999998},"min":{"1min":0.59799999999999998,"5min":0.51400000000000001,"15min":0.47599999999999998},"max":{"1min":0.95899999999999996,"5min":1.0449999999999999,"15min":1.248},"last":0.84899999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72299999999999998,"15min":0.70099999999999996},"min":{"1min":0.54400000000000004,"5min":0.47499999999999998,"15min":0.45000000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.226},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.745,"15min":0.72799999999999998},"min":{"1min":0.53100000000000003,"5min":0.51200000000000001,"15min":0.46500000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.78900000000000003}]},{"osd":3,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.74199999999999999,"15min":0.76700000000000002},"min":{"1min":0.65900000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.006,"5min":1.006,"15min":2.3119999999999998},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.72299999999999998,"15min":0.754},"min":{"1min":0.61699999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":2.6389999999999998},"last":0.996}]},{"osd":4,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.62,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.34999999999999998},"max":{"1min":1.0469999999999999,"5min":1.236,"15min":1.236},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.625,"15min":0.64300000000000002},"min":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.38500000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.53100000000000003}]},{"osd":5,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60399999999999998,"15min":0.63500000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.37},"max":{"1min":0.80000000000000004,"5min":0.86399999999999999,"15min":0.95999999999999996},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67800000000000005,"15min":0.69899999999999995},"min":{"1min":0.505,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":1.0109999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.64700000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69099999999999995,"15min":0.70999999999999996},"min":{"1min":0.52500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.96999999999999997,"5min":3.3290000000000002,"15min":3.3290000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.67900000000000005,"15min":0.70899999999999996},"min":{"1min":0.52300000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.67700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574988,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32540,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1449984,"data_stored":627083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67300000000000004,"15min":0.66600000000000004},"min":{"1min":0.41899999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.86399999999999999,"5min":0.995,"15min":1.25},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70399999999999996,"15min":0.70299999999999996},"min":{"1min":0.438,"5min":0.42399999999999999,"15min":0.33000000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.5289999999999999},"last":0.61699999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72899999999999998,"15min":0.71199999999999997},"min":{"1min":0.56200000000000006,"5min":0.45900000000000002,"15min":0.371},"max":{"1min":0.995,"5min":0.995,"15min":1.1830000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.438,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96599999999999997,"5min":1.0069999999999999,"15min":1.3420000000000001},"last":0.81299999999999994}]},{"osd":2,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.77000000000000002,"15min":0.79300000000000004},"min":{"1min":0.57799999999999996,"5min":0.53400000000000003,"15min":0.44900000000000001},"max":{"1min":0.92800000000000005,"5min":1.0129999999999999,"15min":1.8280000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72399999999999998,"15min":0.72699999999999998},"min":{"1min":0.45700000000000002,"5min":0.40999999999999998,"15min":0.39700000000000002},"max":{"1min":0.91200000000000003,"5min":1.0109999999999999,"15min":1.696},"last":1.03}]},{"osd":3,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.52800000000000002,"5min":0.498,"15min":0.40899999999999997},"max":{"1min":0.97399999999999998,"5min":1.034,"15min":1.6399999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.745,"15min":0.77500000000000002},"min":{"1min":0.52900000000000003,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":1.01,"5min":1.01,"15min":2.0219999999999998},"last":0.65800000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57899999999999996,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.911},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61899999999999999,"15min":0.68700000000000006},"min":{"1min":0.42799999999999999,"5min":0.38500000000000001,"15min":0.307},"max":{"1min":0.93100000000000005,"5min":1.0649999999999999,"15min":1.7829999999999999},"last":0.79100000000000004}]},{"osd":6,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64000000000000001,"15min":0.72799999999999998},"min":{"1min":0.48099999999999998,"5min":0.439,"15min":0.39600000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":2.1829999999999998},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65700000000000003,"15min":0.72699999999999998},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.36499999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":2.1280000000000001},"last":0.996}]},{"osd":7,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68899999999999995,"15min":0.76100000000000001},"min":{"1min":0.54700000000000004,"5min":0.435,"15min":0.38300000000000001},"max":{"1min":0.90800000000000003,"5min":1.1319999999999999,"15min":1.887},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71399999999999997,"15min":0.79500000000000004},"min":{"1min":0.56599999999999995,"5min":0.47799999999999998,"15min":0.439},"max":{"1min":0.996,"5min":1.056,"15min":2.2599999999999998},"last":0.77500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574990,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1441792,"data_stored":626479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67000000000000004,"15min":0.70999999999999996},"min":{"1min":0.41099999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.875,"5min":0.92000000000000004,"15min":2.4929999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68899999999999995,"15min":0.751},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.94499999999999995,"5min":0.94799999999999995,"15min":3.2519999999999998},"last":0.68600000000000005}]},{"osd":1,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69799999999999995,"15min":0.72899999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.89600000000000002,"5min":0.94499999999999995,"15min":1.4279999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70899999999999996,"15min":0.80900000000000005},"min":{"1min":0.47199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":4.3810000000000002},"last":0.57599999999999996}]},{"osd":2,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71999999999999997,"15min":0.76400000000000001},"min":{"1min":0.47399999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1899999999999999,"5min":1.1990000000000001,"15min":2.056},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.79500000000000004},"min":{"1min":0.46899999999999997,"5min":0.436,"15min":0.436},"max":{"1min":0.877,"5min":1.038,"15min":3.3420000000000001},"last":0.71699999999999997}]},{"osd":3,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.752,"15min":0.875},"min":{"1min":0.61499999999999999,"5min":0.48199999999999998,"15min":0.436},"max":{"1min":0.90700000000000003,"5min":1.091,"15min":3.9180000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75900000000000001,"15min":0.88500000000000001},"min":{"1min":0.56100000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":3.9750000000000001},"last":0.78100000000000003}]},{"osd":5,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57799999999999996,"15min":0.65400000000000003},"min":{"1min":0.45200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.1060000000000001,"5min":1.1120000000000001,"15min":1.2509999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.68400000000000005},"min":{"1min":0.38100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93000000000000005,"5min":0.98199999999999998,"15min":1.4419999999999999},"last":0.59499999999999997}]},{"osd":6,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61399999999999999,"15min":0.66900000000000004},"min":{"1min":0.42299999999999999,"5min":0.40999999999999998,"15min":0.33400000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.2949999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.66800000000000004,"15min":0.72899999999999998},"min":{"1min":0.53300000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.159,"5min":1.2529999999999999,"15min":1.3069999999999999},"last":0.70499999999999996}]},{"osd":7,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68000000000000005,"15min":0.75},"min":{"1min":0.443,"5min":0.432,"15min":0.432},"max":{"1min":0.97399999999999998,"5min":1.034,"15min":1.2689999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.76400000000000001,"15min":0.82299999999999995},"min":{"1min":0.60699999999999998,"5min":0.53100000000000003,"15min":0.52700000000000002},"max":{"1min":1.214,"5min":1.2949999999999999,"15min":1.353},"last":0.753}]}]},{"osd":3,"up_from":13,"seq":55834574988,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1458176,"data_stored":628113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45400000000000001,"15min":0.44700000000000001},"min":{"1min":0.33000000000000002,"5min":0.30199999999999999,"15min":0.26300000000000001},"max":{"1min":0.71199999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48799999999999999,"15min":0.48599999999999999},"min":{"1min":0.34799999999999998,"5min":0.30399999999999999,"15min":0.28699999999999998},"max":{"1min":0.65500000000000003,"5min":0.78400000000000003,"15min":1.0109999999999999},"last":0.36099999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.46400000000000002,"15min":0.45000000000000001},"min":{"1min":0.34899999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.748,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.40600000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52300000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.45200000000000001,"5min":0.378,"15min":0.374},"max":{"1min":0.80400000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.437,"5min":0.35399999999999998,"15min":0.33400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":1.306},"last":0.48499999999999999}]},{"osd":4,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.76000000000000001,"15min":0.747},"min":{"1min":0.55000000000000004,"5min":0.45800000000000002,"15min":0.40500000000000003},"max":{"1min":1.1539999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.78200000000000003,"15min":0.76100000000000001},"min":{"1min":0.64100000000000001,"5min":0.47299999999999998,"15min":0.46500000000000002},"max":{"1min":1.0620000000000001,"5min":1.306,"15min":1.306},"last":0.67500000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78400000000000003,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.502,"15min":0.501},"max":{"1min":1.129,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.78400000000000003,"15min":0.76100000000000001},"min":{"1min":0.59399999999999997,"5min":0.48999999999999999,"15min":0.48899999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.71199999999999997}]},{"osd":6,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.77400000000000002,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.48799999999999999,"15min":0.44500000000000001},"max":{"1min":1.2130000000000001,"5min":1.258,"15min":1.258},"last":0.755},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.80700000000000005,"15min":0.79300000000000004},"min":{"1min":0.627,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2529999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.79100000000000004,"15min":0.76800000000000002},"min":{"1min":0.60199999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.103,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.879,"5min":0.80300000000000005,"15min":0.79400000000000004},"min":{"1min":0.60899999999999999,"5min":0.53100000000000003,"15min":0.47499999999999998},"max":{"1min":1.0860000000000001,"5min":1.1120000000000001,"15min":1.2869999999999999},"last":0.78500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574988,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1441792,"data_stored":626479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.44800000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.253},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.79100000000000004},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.499,"15min":0.49299999999999999},"min":{"1min":0.28299999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.38800000000000001}]},{"osd":1,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.53400000000000003},"min":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.876,"5min":0.876,"15min":1.171},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.50700000000000001,"15min":0.498},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78500000000000003,"5min":0.83199999999999996,"15min":1.333},"last":0.34499999999999997}]},{"osd":3,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55300000000000005,"15min":0.52900000000000003},"min":{"1min":0.38100000000000001,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.44900000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.89800000000000002,"5min":0.90000000000000002,"15min":1.1140000000000001},"last":0.41299999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.751,"15min":0.76500000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":2.254},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76500000000000001,"15min":0.76800000000000002},"min":{"1min":0.498,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0740000000000001,"5min":1.1599999999999999,"15min":1.3420000000000001},"last":1.0580000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76900000000000002,"15min":0.76300000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.46200000000000002},"max":{"1min":0.996,"5min":1.091,"15min":1.3740000000000001},"last":0.752},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78600000000000003,"15min":0.80000000000000004},"min":{"1min":0.60499999999999998,"5min":0.498,"15min":0.443},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":2.0840000000000001},"last":1.042}]},{"osd":6,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80800000000000005,"15min":0.81999999999999995},"min":{"1min":0.57199999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.153,"5min":1.1990000000000001,"15min":1.5029999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.61099999999999999,"5min":0.58399999999999996,"15min":0.52700000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.425},"last":0.88200000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79900000000000004,"15min":0.81699999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1779999999999999,"5min":1.1799999999999999,"15min":2.3580000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81100000000000005,"15min":0.81899999999999995},"min":{"1min":0.60299999999999998,"5min":0.54400000000000004,"15min":0.54300000000000004},"max":{"1min":1.127,"5min":1.127,"15min":1.377},"last":0.84399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574987,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32540,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1449984,"data_stored":626603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44900000000000001,"15min":0.45800000000000002},"min":{"1min":0.26500000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.60399999999999998,"5min":0.78600000000000003,"15min":1.2150000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47499999999999998,"15min":0.55300000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.26200000000000001},"max":{"1min":0.64000000000000001,"5min":0.72299999999999998,"15min":4.157},"last":0.317}]},{"osd":2,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48399999999999999,"15min":0.55200000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28999999999999998},"max":{"1min":0.621,"5min":0.67700000000000005,"15min":4.282},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52900000000000003,"15min":0.55900000000000005},"min":{"1min":0.37,"5min":0.35499999999999998,"15min":0.33600000000000002},"max":{"1min":0.78200000000000003,"5min":0.81000000000000005,"15min":1.625},"last":0.55300000000000005}]},{"osd":3,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83799999999999997,"5min":0.88800000000000001,"15min":1.1120000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54800000000000004,"15min":0.69699999999999995},"min":{"1min":0.35599999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72799999999999998,"5min":0.80600000000000005,"15min":8.1620000000000008},"last":0.67800000000000005}]},{"osd":4,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72199999999999998,"15min":0.82799999999999996},"min":{"1min":0.55100000000000005,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":4.7400000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.77400000000000002,"15min":0.79200000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.50600000000000001},"max":{"1min":1.123,"5min":1.125,"15min":1.7070000000000001},"last":0.66000000000000003}]},{"osd":5,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76600000000000001,"15min":0.84299999999999997},"min":{"1min":0.52200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.321,"5min":1.321,"15min":4.5759999999999996},"last":0.625},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75800000000000001,"15min":0.84099999999999997},"min":{"1min":0.49099999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":4.7949999999999999},"last":0.52800000000000002}]},{"osd":6,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.77900000000000003,"15min":0.86899999999999999},"min":{"1min":0.59899999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":4.6890000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77500000000000002,"15min":0.85699999999999998},"min":{"1min":0.51100000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":4.6059999999999999},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78100000000000003,"15min":0.80300000000000005},"min":{"1min":0.58399999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.8759999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79500000000000004,"15min":0.873},"min":{"1min":0.56499999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.081,"5min":1.157,"15min":4.6420000000000003},"last":0.71799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574988,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33124,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338716,"statfs":{"total":96636764160,"available":96602845184,"internally_reserved":0,"allocated":2056192,"data_stored":1218523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42799999999999999,"15min":0.44600000000000001},"min":{"1min":0.28299999999999997,"5min":0.27800000000000002,"15min":0.26300000000000001},"max":{"1min":0.54800000000000004,"5min":0.62,"15min":1.48},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.496,"15min":0.503},"min":{"1min":0.41199999999999998,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":1.2330000000000001},"last":0.42299999999999999}]},{"osd":2,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.497,"15min":0.50800000000000001},"min":{"1min":0.40000000000000002,"5min":0.34699999999999998,"15min":0.29099999999999998},"max":{"1min":0.65000000000000002,"5min":0.77800000000000002,"15min":1.3129999999999999},"last":0.437},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.32400000000000001},"max":{"1min":0.69699999999999995,"5min":0.76700000000000002,"15min":0.82599999999999996},"last":0.623}]},{"osd":3,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.46999999999999997,"15min":0.46899999999999997},"min":{"1min":0.33100000000000002,"5min":0.29999999999999999,"15min":0.28199999999999997},"max":{"1min":0.749,"5min":0.82799999999999996,"15min":0.84799999999999998},"last":0.312},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57799999999999996,"15min":0.59699999999999998},"min":{"1min":0.435,"5min":0.42499999999999999,"15min":0.40300000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":1.4430000000000001},"last":0.496}]},{"osd":4,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.745,"15min":0.73999999999999999},"min":{"1min":0.65300000000000002,"5min":0.505,"15min":0.46200000000000002},"max":{"1min":1.0149999999999999,"5min":1.0209999999999999,"15min":1.0569999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.623,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.93999999999999995,"5min":1.034,"15min":1.1240000000000001},"last":0.46999999999999997}]},{"osd":5,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.59299999999999997,"5min":0.53700000000000003,"15min":0.47599999999999998},"max":{"1min":0.95599999999999996,"5min":1.042,"15min":1.371},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.56899999999999995,"5min":0.498,"15min":0.498},"max":{"1min":0.89500000000000002,"5min":1.0009999999999999,"15min":1.143},"last":0.48699999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.77500000000000002,"15min":0.78900000000000003},"min":{"1min":0.65100000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.97999999999999998,"5min":1.0409999999999999,"15min":1.177},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.79800000000000004,"15min":0.81899999999999995},"min":{"1min":0.63900000000000001,"5min":0.57099999999999995,"15min":0.52700000000000002},"max":{"1min":0.96099999999999997,"5min":1.081,"15min":1.4099999999999999},"last":0.52700000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.76000000000000001,"15min":0.78000000000000003},"min":{"1min":0.61199999999999999,"5min":0.56100000000000005,"15min":0.54800000000000004},"max":{"1min":0.93400000000000005,"5min":1.028,"15min":1.135},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.76500000000000001,"15min":0.77800000000000002},"min":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.48399999999999999},"max":{"1min":0.92800000000000005,"5min":1.075,"15min":1.141},"last":0.51600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:33:32.727 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-04-02T07:33:32.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.900+0000 7f9691c00640 1 Processor -- start 2024-04-02T07:33:32.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.900+0000 7f9691c00640 1 -- start start 2024-04-02T07:33:32.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.904+0000 7f9691c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f968c156f70 0x7f968c15d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:32.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.904+0000 7f9691c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f968c0b26b0 0x7f968c0b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:32.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.904+0000 7f9691c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968c15d950 con 0x7f968c157350 2024-04-02T07:33:32.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.904+0000 7f9691c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968c15dc30 con 0x7f968c0b26b0 2024-04-02T07:33:32.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.904+0000 7f9691c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968c15df10 con 0x7f968c156f70 2024-04-02T07:33:32.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.904+0000 7f968b400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f968c0b26b0 0x7f968c0b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:32.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.904+0000 7f9682000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f968c157350 0x7f968c0cfd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54560/0 (socket says 172.21.15.55:54560) 2024-04-02T07:33:32.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.904+0000 7f9682000640 1 -- 172.21.15.55:0/614591084 learned_addr learned my addr 172.21.15.55:0/614591084 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:32.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.904+0000 7f968b400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f968c0b26b0 0x7f968c0b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33194/0 (socket says 172.21.15.55:33194) 2024-04-02T07:33:32.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.904+0000 7f968aa00640 1 --2- 172.21.15.55:0/614591084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f968c156f70 0x7f968c15d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:32.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.904+0000 7f968b400640 1 -- 172.21.15.55:0/614591084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f968c156f70 msgr2=0x7f968c15d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:32.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.904+0000 7f968b400640 1 --2- 172.21.15.55:0/614591084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f968c156f70 0x7f968c15d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.904+0000 7f968b400640 1 -- 172.21.15.55:0/614591084 >> v1:172.21.15.55:6789/0 conn(0x7f968c157350 legacy=0x7f968c0cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:32.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.904+0000 7f968b400640 1 -- 172.21.15.55:0/614591084 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f968c0cf560 con 0x7f968c0b26b0 2024-04-02T07:33:32.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.904+0000 7f968a000640 1 -- 172.21.15.55:0/614591084 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 923238077 0 0) 0x7f968c15d950 con 0x7f968c157350 2024-04-02T07:33:32.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.908+0000 7f968b400640 1 --2- 172.21.15.55:0/614591084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f968c0b26b0 0x7f968c0b31c0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f9684009d90 tx=0x7f968401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67479996fe4c5cd5 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:32.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.908+0000 7f968a000640 1 -- 172.21.15.55:0/614591084 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840a5910 con 0x7f968c0b26b0 2024-04-02T07:33:32.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.908+0000 7f968a000640 1 -- 172.21.15.55:0/614591084 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96840a5a70 con 0x7f968c0b26b0 2024-04-02T07:33:32.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.908+0000 7f968a000640 1 -- 172.21.15.55:0/614591084 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96840a5e00 con 0x7f968c0b26b0 2024-04-02T07:33:32.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.908+0000 7f9691c00640 1 -- 172.21.15.55:0/614591084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f968c0b26b0 msgr2=0x7f968c0b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:32.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.908+0000 7f9691c00640 1 --2- 172.21.15.55:0/614591084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f968c0b26b0 0x7f968c0b31c0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f9684009d90 tx=0x7f968401c940 comp rx=0 tx=0).stop 2024-04-02T07:33:32.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.908+0000 7f9691c00640 1 -- 172.21.15.55:0/614591084 shutdown_connections 2024-04-02T07:33:32.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.908+0000 7f9691c00640 1 --2- 172.21.15.55:0/614591084 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f968c0b26b0 0x7f968c0b31c0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.908+0000 7f9691c00640 1 --2- 172.21.15.55:0/614591084 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f968c156f70 0x7f968c15d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.908+0000 7f9691c00640 1 -- 172.21.15.55:0/614591084 >> 172.21.15.55:0/614591084 conn(0x7f968c0b13b0 msgr2=0x7f968c0b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:32.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.908+0000 7f9691c00640 1 -- 172.21.15.55:0/614591084 shutdown_connections 2024-04-02T07:33:32.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.908+0000 7f9691c00640 1 -- 172.21.15.55:0/614591084 wait complete. 2024-04-02T07:33:32.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.908+0000 7f9691c00640 1 Processor -- start 2024-04-02T07:33:32.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.908+0000 7f9691c00640 1 -- start start 2024-04-02T07:33:32.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f9691c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f968c0b26b0 0x7f968c15a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:32.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f9691c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f968c156f70 0x7f968c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:32.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f9691c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f968c157350 0x7f968c13d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:32.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f9691c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c13d5d0 con 0x7f968c0b26b0 2024-04-02T07:33:32.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f9691c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0cd2a0 con 0x7f968c156f70 2024-04-02T07:33:32.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f9691c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f968c0cd580 con 0x7f968c157350 2024-04-02T07:33:32.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f968aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f968c0b26b0 0x7f968c15a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:32.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f968aa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f968c0b26b0 0x7f968c15a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33210/0 (socket says 172.21.15.55:33210) 2024-04-02T07:33:32.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f968aa00640 1 -- 172.21.15.55:0/3195373022 learned_addr learned my addr 172.21.15.55:0/3195373022 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:32.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f968b400640 1 --2- 172.21.15.55:0/3195373022 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f968c157350 0x7f968c13d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:32.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f968aa00640 1 -- 172.21.15.55:0/3195373022 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f968c157350 msgr2=0x7f968c13d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:32.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f9682000640 1 --2- 172.21.15.55:0/3195373022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f968c156f70 0x7f968c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:32.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f968aa00640 1 --2- 172.21.15.55:0/3195373022 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f968c157350 0x7f968c13d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f968aa00640 1 -- 172.21.15.55:0/3195373022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f968c156f70 msgr2=0x7f968c0ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:32.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f968aa00640 1 --2- 172.21.15.55:0/3195373022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f968c156f70 0x7f968c0ccb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:32.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f968aa00640 1 -- 172.21.15.55:0/3195373022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9684009a70 con 0x7f968c0b26b0 2024-04-02T07:33:32.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f968b400640 1 --2- 172.21.15.55:0/3195373022 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f968c157350 0x7f968c13d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:32.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f9682000640 1 --2- 172.21.15.55:0/3195373022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f968c156f70 0x7f968c0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:32.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f968aa00640 1 --2- 172.21.15.55:0/3195373022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f968c0b26b0 0x7f968c15a100 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f967c00e930 tx=0x7f967c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:32.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f9683400640 1 -- 172.21.15.55:0/3195373022 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c009690 con 0x7f968c0b26b0 2024-04-02T07:33:32.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f9683400640 1 -- 172.21.15.55:0/3195373022 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967c00ca00 con 0x7f968c0b26b0 2024-04-02T07:33:32.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f9683400640 1 -- 172.21.15.55:0/3195373022 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c00cd70 con 0x7f968c0b26b0 2024-04-02T07:33:32.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f9691c00640 1 -- 172.21.15.55:0/3195373022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f968c0cd860 con 0x7f968c0b26b0 2024-04-02T07:33:32.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f9691c00640 1 -- 172.21.15.55:0/3195373022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f968c0cde20 con 0x7f968c0b26b0 2024-04-02T07:33:32.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f9691c00640 1 -- 172.21.15.55:0/3195373022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f968c066c90 con 0x7f968c0b26b0 2024-04-02T07:33:32.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.912+0000 7f9683400640 1 -- 172.21.15.55:0/3195373022 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f967c013470 con 0x7f968c0b26b0 2024-04-02T07:33:32.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.916+0000 7f9683400640 1 --2- 172.21.15.55:0/3195373022 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9668066690 0x7f9668068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:32.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.916+0000 7f9683400640 1 -- 172.21.15.55:0/3195373022 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f967c084470 con 0x7f968c0b26b0 2024-04-02T07:33:32.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.916+0000 7f9682000640 1 --2- 172.21.15.55:0/3195373022 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9668066690 0x7f9668068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:32.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.916+0000 7f9682000640 1 --2- 172.21.15.55:0/3195373022 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9668066690 0x7f9668068b50 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9674007fd0 tx=0x7f9674009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:32.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:32.920+0000 7f9683400640 1 -- 172.21.15.55:0/3195373022 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f967c051890 con 0x7f968c0b26b0 2024-04-02T07:33:33.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.140+0000 7f9691c00640 1 -- 172.21.15.55:0/3195373022 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f968c0ceb80 con 0x7f968c0b26b0 2024-04-02T07:33:33.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.140+0000 7f9683400640 1 -- 172.21.15.55:0/3195373022 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1014 (secure 0 0 0) 0x7f967c054eb0 con 0x7f968c0b26b0 2024-04-02T07:33:33.143 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:33.144 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":699,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":116,"num_osds":8,"num_up_osds":8,"osd_up_since":1712042525,"num_in_osds":8,"osd_in_since":1712042515,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592730,"bytes_used":267739136,"bytes_avail":772826374144,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":96,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":9156}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":27,"modified":"2024-04-02T07:33:12.500841+0000","services":{}},"progress_events":{}} 2024-04-02T07:33:33.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.144+0000 7f9691c00640 1 -- 172.21.15.55:0/3195373022 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9668066690 msgr2=0x7f9668068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:33.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.144+0000 7f9691c00640 1 --2- 172.21.15.55:0/3195373022 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9668066690 0x7f9668068b50 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f9674007fd0 tx=0x7f9674009040 comp rx=0 tx=0).stop 2024-04-02T07:33:33.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.144+0000 7f9691c00640 1 -- 172.21.15.55:0/3195373022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f968c0b26b0 msgr2=0x7f968c15a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:33.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.144+0000 7f9691c00640 1 --2- 172.21.15.55:0/3195373022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f968c0b26b0 0x7f968c15a100 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7f967c00e930 tx=0x7f967c00edf0 comp rx=0 tx=0).stop 2024-04-02T07:33:33.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.144+0000 7f9691c00640 1 -- 172.21.15.55:0/3195373022 shutdown_connections 2024-04-02T07:33:33.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.144+0000 7f9691c00640 1 --2- 172.21.15.55:0/3195373022 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f968c157350 0x7f968c13d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:33.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.144+0000 7f9691c00640 1 --2- 172.21.15.55:0/3195373022 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9668066690 0x7f9668068b50 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:33.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.144+0000 7f9691c00640 1 --2- 172.21.15.55:0/3195373022 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f968c156f70 0x7f968c0ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:33.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.144+0000 7f9691c00640 1 --2- 172.21.15.55:0/3195373022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f968c0b26b0 0x7f968c15a100 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:33.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.144+0000 7f9691c00640 1 -- 172.21.15.55:0/3195373022 >> 172.21.15.55:0/3195373022 conn(0x7f968c0b13b0 msgr2=0x7f968c0b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:33.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.144+0000 7f9691c00640 1 -- 172.21.15.55:0/3195373022 shutdown_connections 2024-04-02T07:33:33.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.144+0000 7f9691c00640 1 -- 172.21.15.55:0/3195373022 wait complete. 2024-04-02T07:33:33.165 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-04-02T07:33:33.165 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:33:33.305 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.304+0000 7f8fa5200640 1 Processor -- start 2024-04-02T07:33:33.306 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.304+0000 7f8fa5200640 1 -- start start 2024-04-02T07:33:33.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.304+0000 7f8fa5200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8fa015ee70 0x7f8fa0099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:33.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.304+0000 7f8fa5200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa00ad270 con 0x7f8fa0099120 2024-04-02T07:33:33.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.304+0000 7f8fa5200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fa00b0a50 con 0x7f8fa015f250 2024-04-02T07:33:33.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.304+0000 7f8fa5200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fa00b0840 con 0x7f8fa015ee70 2024-04-02T07:33:33.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.304+0000 7f8f9de00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8fa015ee70 0x7f8fa0099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:33.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.304+0000 7f8f9e800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8fa0099120 0x7f8fa00ce690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54568/0 (socket says 172.21.15.55:54568) 2024-04-02T07:33:33.307 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.304+0000 7f8f9e800640 1 -- 172.21.15.55:0/2419861465 learned_addr learned my addr 172.21.15.55:0/2419861465 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:33.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.304+0000 7f8f9de00640 1 -- 172.21.15.55:0/2419861465 >> v1:172.21.15.106:6789/0 conn(0x7f8fa015f250 legacy=0x7f8fa0098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:33.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.304+0000 7f8f9de00640 1 -- 172.21.15.55:0/2419861465 >> v1:172.21.15.55:6789/0 conn(0x7f8fa0099120 legacy=0x7f8fa00ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:33.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.304+0000 7f8f9d400640 1 -- 172.21.15.55:0/2419861465 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3974678643 0 0) 0x7f8fa00ad270 con 0x7f8fa0099120 2024-04-02T07:33:33.308 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.304+0000 7f8f9de00640 1 -- 172.21.15.55:0/2419861465 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa00b0d30 con 0x7f8fa015ee70 2024-04-02T07:33:33.310 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.308+0000 7f8f9de00640 1 --2- 172.21.15.55:0/2419861465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa015ee70 0x7f8fa0099830 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f8f900097c0 tx=0x7f8f9001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66836abfe19e8b40 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:33.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.308+0000 7f8f9d400640 1 -- 172.21.15.55:0/2419861465 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f900ab650 con 0x7f8fa015ee70 2024-04-02T07:33:33.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.308+0000 7f8f9d400640 1 -- 172.21.15.55:0/2419861465 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f900ab7b0 con 0x7f8fa015ee70 2024-04-02T07:33:33.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.308+0000 7f8f9d400640 1 -- 172.21.15.55:0/2419861465 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f900abb40 con 0x7f8fa015ee70 2024-04-02T07:33:33.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.308+0000 7f8fa5200640 1 -- 172.21.15.55:0/2419861465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa015ee70 msgr2=0x7f8fa0099830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:33.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.308+0000 7f8fa5200640 1 --2- 172.21.15.55:0/2419861465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa015ee70 0x7f8fa0099830 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f8f900097c0 tx=0x7f8f9001c470 comp rx=0 tx=0).stop 2024-04-02T07:33:33.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.308+0000 7f8fa5200640 1 -- 172.21.15.55:0/2419861465 shutdown_connections 2024-04-02T07:33:33.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.308+0000 7f8fa5200640 1 --2- 172.21.15.55:0/2419861465 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa015ee70 0x7f8fa0099830 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:33.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.308+0000 7f8fa5200640 1 -- 172.21.15.55:0/2419861465 >> 172.21.15.55:0/2419861465 conn(0x7f8fa00b21d0 msgr2=0x7f8fa00b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:33.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.308+0000 7f8fa5200640 1 -- 172.21.15.55:0/2419861465 shutdown_connections 2024-04-02T07:33:33.311 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.308+0000 7f8fa5200640 1 -- 172.21.15.55:0/2419861465 wait complete. 2024-04-02T07:33:33.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8fa5200640 1 Processor -- start 2024-04-02T07:33:33.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8fa5200640 1 -- start start 2024-04-02T07:33:33.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8fa5200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa0099120 0x7f8fa014e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:33.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8fa5200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fa015ee70 0x7f8fa0165050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:33.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8fa5200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fa015f250 0x7f8fa01f8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:33.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8fa5200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa014e6f0 con 0x7f8fa0099120 2024-04-02T07:33:33.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8fa5200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa00c4210 con 0x7f8fa015ee70 2024-04-02T07:33:33.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8fa5200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fa015d2e0 con 0x7f8fa015f250 2024-04-02T07:33:33.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8f9de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa0099120 0x7f8fa014e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:33.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8f9de00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa0099120 0x7f8fa014e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33224/0 (socket says 172.21.15.55:33224) 2024-04-02T07:33:33.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8f9de00640 1 -- 172.21.15.55:0/3472505921 learned_addr learned my addr 172.21.15.55:0/3472505921 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:33.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8f9e800640 1 --2- 172.21.15.55:0/3472505921 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fa015f250 0x7f8fa01f8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:33.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8f95400640 1 --2- 172.21.15.55:0/3472505921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fa015ee70 0x7f8fa0165050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:33.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8f9de00640 1 -- 172.21.15.55:0/3472505921 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fa015f250 msgr2=0x7f8fa01f8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:33.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8f9de00640 1 --2- 172.21.15.55:0/3472505921 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fa015f250 0x7f8fa01f8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:33.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8f9de00640 1 -- 172.21.15.55:0/3472505921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fa015ee70 msgr2=0x7f8fa0165050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:33.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8f9de00640 1 --2- 172.21.15.55:0/3472505921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fa015ee70 0x7f8fa0165050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:33.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8f9de00640 1 -- 172.21.15.55:0/3472505921 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f90009420 con 0x7f8fa0099120 2024-04-02T07:33:33.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8f95400640 1 --2- 172.21.15.55:0/3472505921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fa015ee70 0x7f8fa0165050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:33.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8f9e800640 1 --2- 172.21.15.55:0/3472505921 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fa015f250 0x7f8fa01f8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:33.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8f9de00640 1 --2- 172.21.15.55:0/3472505921 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa0099120 0x7f8fa014e1b0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f8f900ad040 tx=0x7f8f9001acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:33.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8f96a00640 1 -- 172.21.15.55:0/3472505921 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f900b5810 con 0x7f8fa0099120 2024-04-02T07:33:33.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8f96a00640 1 -- 172.21.15.55:0/3472505921 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f900b5970 con 0x7f8fa0099120 2024-04-02T07:33:33.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8fa5200640 1 -- 172.21.15.55:0/3472505921 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fa015ccd0 con 0x7f8fa0099120 2024-04-02T07:33:33.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8f96a00640 1 -- 172.21.15.55:0/3472505921 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f900b5d20 con 0x7f8fa0099120 2024-04-02T07:33:33.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.312+0000 7f8fa5200640 1 -- 172.21.15.55:0/3472505921 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fa015cf70 con 0x7f8fa0099120 2024-04-02T07:33:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.316+0000 7f8fa5200640 1 -- 172.21.15.55:0/3472505921 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fa0066c90 con 0x7f8fa0099120 2024-04-02T07:33:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.316+0000 7f8f96a00640 1 -- 172.21.15.55:0/3472505921 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8f900bf410 con 0x7f8fa0099120 2024-04-02T07:33:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.316+0000 7f8f96a00640 1 --2- 172.21.15.55:0/3472505921 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8f7c0666c0 0x7f8f7c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.316+0000 7f8f96a00640 1 -- 172.21.15.55:0/3472505921 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f9011ed50 con 0x7f8fa0099120 2024-04-02T07:33:33.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.316+0000 7f8f95400640 1 --2- 172.21.15.55:0/3472505921 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8f7c0666c0 0x7f8f7c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:33.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.316+0000 7f8f95400640 1 --2- 172.21.15.55:0/3472505921 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8f7c0666c0 0x7f8f7c068b80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00990b0 tx=0x7f8f88009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:33.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.320+0000 7f8f96a00640 1 -- 172.21.15.55:0/3472505921 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f8f900ec020 con 0x7f8fa0099120 2024-04-02T07:33:33.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.476+0000 7f8fa5200640 1 -- 172.21.15.55:0/3472505921 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8fa00c5ce0 con 0x7f8f7c0666c0 2024-04-02T07:33:33.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.488+0000 7f8f96a00640 1 -- 172.21.15.55:0/3472505921 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289605 (secure 0 0 0) 0x7f8fa00c5ce0 con 0x7f8f7c0666c0 2024-04-02T07:33:33.491 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:33.493 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:33:33.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.488+0000 7f8fa5200640 1 -- 172.21.15.55:0/3472505921 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8f7c0666c0 msgr2=0x7f8f7c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:33.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.488+0000 7f8fa5200640 1 --2- 172.21.15.55:0/3472505921 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8f7c0666c0 0x7f8f7c068b80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8fa00990b0 tx=0x7f8f88009040 comp rx=0 tx=0).stop 2024-04-02T07:33:33.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.488+0000 7f8fa5200640 1 -- 172.21.15.55:0/3472505921 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa0099120 msgr2=0x7f8fa014e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:33.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.488+0000 7f8fa5200640 1 --2- 172.21.15.55:0/3472505921 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa0099120 0x7f8fa014e1b0 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f8f900ad040 tx=0x7f8f9001acb0 comp rx=0 tx=0).stop 2024-04-02T07:33:33.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.488+0000 7f8fa5200640 1 -- 172.21.15.55:0/3472505921 shutdown_connections 2024-04-02T07:33:33.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.488+0000 7f8fa5200640 1 --2- 172.21.15.55:0/3472505921 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8fa015f250 0x7f8fa01f8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:33.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.488+0000 7f8fa5200640 1 --2- 172.21.15.55:0/3472505921 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8f7c0666c0 0x7f8f7c068b80 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:33.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.488+0000 7f8fa5200640 1 --2- 172.21.15.55:0/3472505921 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8fa015ee70 0x7f8fa0165050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:33.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.488+0000 7f8fa5200640 1 --2- 172.21.15.55:0/3472505921 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8fa0099120 0x7f8fa014e1b0 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:33.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.488+0000 7f8fa5200640 1 -- 172.21.15.55:0/3472505921 >> 172.21.15.55:0/3472505921 conn(0x7f8fa00b21d0 msgr2=0x7f8fa006f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:33.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.488+0000 7f8fa5200640 1 -- 172.21.15.55:0/3472505921 shutdown_connections 2024-04-02T07:33:33.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:33.488+0000 7f8fa5200640 1 -- 172.21.15.55:0/3472505921 wait complete. 2024-04-02T07:33:33.511 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":452,"stamp":"2024-04-02T07:33:32.505566+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":181,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261464,"kb_used_data":12488,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754713256,"statfs":{"total":773094113280,"available":772826374144,"internally_reserved":0,"allocated":12787712,"data_stored":6197292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001592"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711677+0000","last_change":"2024-04-02T07:33:27.882595+0000","last_active":"2024-04-02T07:33:29.711677+0000","last_peered":"2024-04-02T07:33:29.711677+0000","last_clean":"2024-04-02T07:33:29.711677+0000","last_became_active":"2024-04-02T07:33:27.882331+0000","last_became_peered":"2024-04-02T07:33:27.882331+0000","last_unstale":"2024-04-02T07:33:29.711677+0000","last_undegraded":"2024-04-02T07:33:29.711677+0000","last_fullsized":"2024-04-02T07:33:29.711677+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:44:26.449539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.861038+0000","last_change":"2024-04-02T07:33:27.869951+0000","last_active":"2024-04-02T07:33:28.861038+0000","last_peered":"2024-04-02T07:33:28.861038+0000","last_clean":"2024-04-02T07:33:28.861038+0000","last_became_active":"2024-04-02T07:33:27.869579+0000","last_became_peered":"2024-04-02T07:33:27.869579+0000","last_unstale":"2024-04-02T07:33:28.861038+0000","last_undegraded":"2024-04-02T07:33:28.861038+0000","last_fullsized":"2024-04-02T07:33:28.861038+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:08:48.680568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714760+0000","last_change":"2024-04-02T07:33:27.877522+0000","last_active":"2024-04-02T07:33:29.714760+0000","last_peered":"2024-04-02T07:33:29.714760+0000","last_clean":"2024-04-02T07:33:29.714760+0000","last_became_active":"2024-04-02T07:33:27.876088+0000","last_became_peered":"2024-04-02T07:33:27.876088+0000","last_unstale":"2024-04-02T07:33:29.714760+0000","last_undegraded":"2024-04-02T07:33:29.714760+0000","last_fullsized":"2024-04-02T07:33:29.714760+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:08:39.323055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711842+0000","last_change":"2024-04-02T07:33:27.875231+0000","last_active":"2024-04-02T07:33:29.711842+0000","last_peered":"2024-04-02T07:33:29.711842+0000","last_clean":"2024-04-02T07:33:29.711842+0000","last_became_active":"2024-04-02T07:33:27.874506+0000","last_became_peered":"2024-04-02T07:33:27.874506+0000","last_unstale":"2024-04-02T07:33:29.711842+0000","last_undegraded":"2024-04-02T07:33:29.711842+0000","last_fullsized":"2024-04-02T07:33:29.711842+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:15:11.171684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857023+0000","last_change":"2024-04-02T07:33:27.871285+0000","last_active":"2024-04-02T07:33:28.857023+0000","last_peered":"2024-04-02T07:33:28.857023+0000","last_clean":"2024-04-02T07:33:28.857023+0000","last_became_active":"2024-04-02T07:33:27.871038+0000","last_became_peered":"2024-04-02T07:33:27.871038+0000","last_unstale":"2024-04-02T07:33:28.857023+0000","last_undegraded":"2024-04-02T07:33:28.857023+0000","last_fullsized":"2024-04-02T07:33:28.857023+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:49:08.367496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.210936+0000","last_change":"2024-04-02T07:33:27.876121+0000","last_active":"2024-04-02T07:33:29.210936+0000","last_peered":"2024-04-02T07:33:29.210936+0000","last_clean":"2024-04-02T07:33:29.210936+0000","last_became_active":"2024-04-02T07:33:27.875832+0000","last_became_peered":"2024-04-02T07:33:27.875832+0000","last_unstale":"2024-04-02T07:33:29.210936+0000","last_undegraded":"2024-04-02T07:33:29.210936+0000","last_fullsized":"2024-04-02T07:33:29.210936+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:12:14.480598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413346+0000","last_change":"2024-04-02T07:33:27.879609+0000","last_active":"2024-04-02T07:33:29.413346+0000","last_peered":"2024-04-02T07:33:29.413346+0000","last_clean":"2024-04-02T07:33:29.413346+0000","last_became_active":"2024-04-02T07:33:27.878988+0000","last_became_peered":"2024-04-02T07:33:27.878988+0000","last_unstale":"2024-04-02T07:33:29.413346+0000","last_undegraded":"2024-04-02T07:33:29.413346+0000","last_fullsized":"2024-04-02T07:33:29.413346+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:46:59.020865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714533+0000","last_change":"2024-04-02T07:33:27.876286+0000","last_active":"2024-04-02T07:33:29.714533+0000","last_peered":"2024-04-02T07:33:29.714533+0000","last_clean":"2024-04-02T07:33:29.714533+0000","last_became_active":"2024-04-02T07:33:27.875717+0000","last_became_peered":"2024-04-02T07:33:27.875717+0000","last_unstale":"2024-04-02T07:33:29.714533+0000","last_undegraded":"2024-04-02T07:33:29.714533+0000","last_fullsized":"2024-04-02T07:33:29.714533+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:05.978066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711733+0000","last_change":"2024-04-02T07:33:27.880196+0000","last_active":"2024-04-02T07:33:29.711733+0000","last_peered":"2024-04-02T07:33:29.711733+0000","last_clean":"2024-04-02T07:33:29.711733+0000","last_became_active":"2024-04-02T07:33:27.877656+0000","last_became_peered":"2024-04-02T07:33:27.877656+0000","last_unstale":"2024-04-02T07:33:29.711733+0000","last_undegraded":"2024-04-02T07:33:29.711733+0000","last_fullsized":"2024-04-02T07:33:29.711733+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:08.049991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711715+0000","last_change":"2024-04-02T07:33:27.869017+0000","last_active":"2024-04-02T07:33:29.711715+0000","last_peered":"2024-04-02T07:33:29.711715+0000","last_clean":"2024-04-02T07:33:29.711715+0000","last_became_active":"2024-04-02T07:33:27.868286+0000","last_became_peered":"2024-04-02T07:33:27.868286+0000","last_unstale":"2024-04-02T07:33:29.711715+0000","last_undegraded":"2024-04-02T07:33:29.711715+0000","last_fullsized":"2024-04-02T07:33:29.711715+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:45:02.593548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860916+0000","last_change":"2024-04-02T07:33:27.882601+0000","last_active":"2024-04-02T07:33:28.860916+0000","last_peered":"2024-04-02T07:33:28.860916+0000","last_clean":"2024-04-02T07:33:28.860916+0000","last_became_active":"2024-04-02T07:33:27.882352+0000","last_became_peered":"2024-04-02T07:33:27.882352+0000","last_unstale":"2024-04-02T07:33:28.860916+0000","last_undegraded":"2024-04-02T07:33:28.860916+0000","last_fullsized":"2024-04-02T07:33:28.860916+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:42:59.489339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711840+0000","last_change":"2024-04-02T07:33:27.874378+0000","last_active":"2024-04-02T07:33:29.711840+0000","last_peered":"2024-04-02T07:33:29.711840+0000","last_clean":"2024-04-02T07:33:29.711840+0000","last_became_active":"2024-04-02T07:33:27.873619+0000","last_became_peered":"2024-04-02T07:33:27.873619+0000","last_unstale":"2024-04-02T07:33:29.711840+0000","last_undegraded":"2024-04-02T07:33:29.711840+0000","last_fullsized":"2024-04-02T07:33:29.711840+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:09:32.458968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714766+0000","last_change":"2024-04-02T07:33:27.875814+0000","last_active":"2024-04-02T07:33:29.714766+0000","last_peered":"2024-04-02T07:33:29.714766+0000","last_clean":"2024-04-02T07:33:29.714766+0000","last_became_active":"2024-04-02T07:33:27.874810+0000","last_became_peered":"2024-04-02T07:33:27.874810+0000","last_unstale":"2024-04-02T07:33:29.714766+0000","last_undegraded":"2024-04-02T07:33:29.714766+0000","last_fullsized":"2024-04-02T07:33:29.714766+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:47:01.625875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714540+0000","last_change":"2024-04-02T07:33:27.884371+0000","last_active":"2024-04-02T07:33:29.714540+0000","last_peered":"2024-04-02T07:33:29.714540+0000","last_clean":"2024-04-02T07:33:29.714540+0000","last_became_active":"2024-04-02T07:33:27.884131+0000","last_became_peered":"2024-04-02T07:33:27.884131+0000","last_unstale":"2024-04-02T07:33:29.714540+0000","last_undegraded":"2024-04-02T07:33:29.714540+0000","last_fullsized":"2024-04-02T07:33:29.714540+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:45:56.636391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.210851+0000","last_change":"2024-04-02T07:33:27.877545+0000","last_active":"2024-04-02T07:33:29.210851+0000","last_peered":"2024-04-02T07:33:29.210851+0000","last_clean":"2024-04-02T07:33:29.210851+0000","last_became_active":"2024-04-02T07:33:27.877273+0000","last_became_peered":"2024-04-02T07:33:27.877273+0000","last_unstale":"2024-04-02T07:33:29.210851+0000","last_undegraded":"2024-04-02T07:33:29.210851+0000","last_fullsized":"2024-04-02T07:33:29.210851+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:52:13.075492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711236+0000","last_change":"2024-04-02T07:33:27.876720+0000","last_active":"2024-04-02T07:33:29.711236+0000","last_peered":"2024-04-02T07:33:29.711236+0000","last_clean":"2024-04-02T07:33:29.711236+0000","last_became_active":"2024-04-02T07:33:27.876330+0000","last_became_peered":"2024-04-02T07:33:27.876330+0000","last_unstale":"2024-04-02T07:33:29.711236+0000","last_undegraded":"2024-04-02T07:33:29.711236+0000","last_fullsized":"2024-04-02T07:33:29.711236+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:15:51.484030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860989+0000","last_change":"2024-04-02T07:33:27.884195+0000","last_active":"2024-04-02T07:33:28.860989+0000","last_peered":"2024-04-02T07:33:28.860989+0000","last_clean":"2024-04-02T07:33:28.860989+0000","last_became_active":"2024-04-02T07:33:27.883925+0000","last_became_peered":"2024-04-02T07:33:27.883925+0000","last_unstale":"2024-04-02T07:33:28.860989+0000","last_undegraded":"2024-04-02T07:33:28.860989+0000","last_fullsized":"2024-04-02T07:33:28.860989+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:24:38.502056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.507576+0000","last_change":"2024-04-02T07:33:27.880520+0000","last_active":"2024-04-02T07:33:29.507576+0000","last_peered":"2024-04-02T07:33:29.507576+0000","last_clean":"2024-04-02T07:33:29.507576+0000","last_became_active":"2024-04-02T07:33:27.879592+0000","last_became_peered":"2024-04-02T07:33:27.879592+0000","last_unstale":"2024-04-02T07:33:29.507576+0000","last_undegraded":"2024-04-02T07:33:29.507576+0000","last_fullsized":"2024-04-02T07:33:29.507576+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:42:59.489339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714842+0000","last_change":"2024-04-02T07:33:27.877703+0000","last_active":"2024-04-02T07:33:29.714842+0000","last_peered":"2024-04-02T07:33:29.714842+0000","last_clean":"2024-04-02T07:33:29.714842+0000","last_became_active":"2024-04-02T07:33:27.876491+0000","last_became_peered":"2024-04-02T07:33:27.876491+0000","last_unstale":"2024-04-02T07:33:29.714842+0000","last_undegraded":"2024-04-02T07:33:29.714842+0000","last_fullsized":"2024-04-02T07:33:29.714842+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:22:10.905772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.861137+0000","last_change":"2024-04-02T07:33:27.875061+0000","last_active":"2024-04-02T07:33:28.861137+0000","last_peered":"2024-04-02T07:33:28.861137+0000","last_clean":"2024-04-02T07:33:28.861137+0000","last_became_active":"2024-04-02T07:33:27.873808+0000","last_became_peered":"2024-04-02T07:33:27.873808+0000","last_unstale":"2024-04-02T07:33:28.861137+0000","last_undegraded":"2024-04-02T07:33:28.861137+0000","last_fullsized":"2024-04-02T07:33:28.861137+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:07:35.756044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860959+0000","last_change":"2024-04-02T07:33:27.874169+0000","last_active":"2024-04-02T07:33:28.860959+0000","last_peered":"2024-04-02T07:33:28.860959+0000","last_clean":"2024-04-02T07:33:28.860959+0000","last_became_active":"2024-04-02T07:33:27.873870+0000","last_became_peered":"2024-04-02T07:33:27.873870+0000","last_unstale":"2024-04-02T07:33:28.860959+0000","last_undegraded":"2024-04-02T07:33:28.860959+0000","last_fullsized":"2024-04-02T07:33:28.860959+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:04:12.160313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857812+0000","last_change":"2024-04-02T07:33:27.877812+0000","last_active":"2024-04-02T07:33:28.857812+0000","last_peered":"2024-04-02T07:33:28.857812+0000","last_clean":"2024-04-02T07:33:28.857812+0000","last_became_active":"2024-04-02T07:33:27.877587+0000","last_became_peered":"2024-04-02T07:33:27.877587+0000","last_unstale":"2024-04-02T07:33:28.857812+0000","last_undegraded":"2024-04-02T07:33:28.857812+0000","last_fullsized":"2024-04-02T07:33:28.857812+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:56:03.473104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860474+0000","last_change":"2024-04-02T07:33:27.873484+0000","last_active":"2024-04-02T07:33:28.860474+0000","last_peered":"2024-04-02T07:33:28.860474+0000","last_clean":"2024-04-02T07:33:28.860474+0000","last_became_active":"2024-04-02T07:33:27.873191+0000","last_became_peered":"2024-04-02T07:33:27.873191+0000","last_unstale":"2024-04-02T07:33:28.860474+0000","last_undegraded":"2024-04-02T07:33:28.860474+0000","last_fullsized":"2024-04-02T07:33:28.860474+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:42:58.494573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857717+0000","last_change":"2024-04-02T07:33:27.876890+0000","last_active":"2024-04-02T07:33:28.857717+0000","last_peered":"2024-04-02T07:33:28.857717+0000","last_clean":"2024-04-02T07:33:28.857717+0000","last_became_active":"2024-04-02T07:33:27.876595+0000","last_became_peered":"2024-04-02T07:33:27.876595+0000","last_unstale":"2024-04-02T07:33:28.857717+0000","last_undegraded":"2024-04-02T07:33:28.857717+0000","last_fullsized":"2024-04-02T07:33:28.857717+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:44:30.290566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.861036+0000","last_change":"2024-04-02T07:33:27.883804+0000","last_active":"2024-04-02T07:33:28.861036+0000","last_peered":"2024-04-02T07:33:28.861036+0000","last_clean":"2024-04-02T07:33:28.861036+0000","last_became_active":"2024-04-02T07:33:27.883536+0000","last_became_peered":"2024-04-02T07:33:27.883536+0000","last_unstale":"2024-04-02T07:33:28.861036+0000","last_undegraded":"2024-04-02T07:33:28.861036+0000","last_fullsized":"2024-04-02T07:33:28.861036+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:24:35.699323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711791+0000","last_change":"2024-04-02T07:33:27.873296+0000","last_active":"2024-04-02T07:33:29.711791+0000","last_peered":"2024-04-02T07:33:29.711791+0000","last_clean":"2024-04-02T07:33:29.711791+0000","last_became_active":"2024-04-02T07:33:27.872968+0000","last_became_peered":"2024-04-02T07:33:27.872968+0000","last_unstale":"2024-04-02T07:33:29.711791+0000","last_undegraded":"2024-04-02T07:33:29.711791+0000","last_fullsized":"2024-04-02T07:33:29.711791+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:54:29.292390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.211116+0000","last_change":"2024-04-02T07:33:27.868594+0000","last_active":"2024-04-02T07:33:29.211116+0000","last_peered":"2024-04-02T07:33:29.211116+0000","last_clean":"2024-04-02T07:33:29.211116+0000","last_became_active":"2024-04-02T07:33:27.867037+0000","last_became_peered":"2024-04-02T07:33:27.867037+0000","last_unstale":"2024-04-02T07:33:29.211116+0000","last_undegraded":"2024-04-02T07:33:29.211116+0000","last_fullsized":"2024-04-02T07:33:29.211116+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:37:18.608010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857926+0000","last_change":"2024-04-02T07:33:27.877779+0000","last_active":"2024-04-02T07:33:28.857926+0000","last_peered":"2024-04-02T07:33:28.857926+0000","last_clean":"2024-04-02T07:33:28.857926+0000","last_became_active":"2024-04-02T07:33:27.877522+0000","last_became_peered":"2024-04-02T07:33:27.877522+0000","last_unstale":"2024-04-02T07:33:28.857926+0000","last_undegraded":"2024-04-02T07:33:28.857926+0000","last_fullsized":"2024-04-02T07:33:28.857926+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:42:36.055385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860478+0000","last_change":"2024-04-02T07:33:27.872398+0000","last_active":"2024-04-02T07:33:28.860478+0000","last_peered":"2024-04-02T07:33:28.860478+0000","last_clean":"2024-04-02T07:33:28.860478+0000","last_became_active":"2024-04-02T07:33:27.872153+0000","last_became_peered":"2024-04-02T07:33:27.872153+0000","last_unstale":"2024-04-02T07:33:28.860478+0000","last_undegraded":"2024-04-02T07:33:28.860478+0000","last_fullsized":"2024-04-02T07:33:28.860478+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:05.978066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413563+0000","last_change":"2024-04-02T07:33:27.877534+0000","last_active":"2024-04-02T07:33:29.413563+0000","last_peered":"2024-04-02T07:33:29.413563+0000","last_clean":"2024-04-02T07:33:29.413563+0000","last_became_active":"2024-04-02T07:33:27.874093+0000","last_became_peered":"2024-04-02T07:33:27.874093+0000","last_unstale":"2024-04-02T07:33:29.413563+0000","last_undegraded":"2024-04-02T07:33:29.413563+0000","last_fullsized":"2024-04-02T07:33:29.413563+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:07.305572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711292+0000","last_change":"2024-04-02T07:33:27.872336+0000","last_active":"2024-04-02T07:33:29.711292+0000","last_peered":"2024-04-02T07:33:29.711292+0000","last_clean":"2024-04-02T07:33:29.711292+0000","last_became_active":"2024-04-02T07:33:27.872061+0000","last_became_peered":"2024-04-02T07:33:27.872061+0000","last_unstale":"2024-04-02T07:33:29.711292+0000","last_undegraded":"2024-04-02T07:33:29.711292+0000","last_fullsized":"2024-04-02T07:33:29.711292+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:16:52.197373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.210854+0000","last_change":"2024-04-02T07:33:27.875893+0000","last_active":"2024-04-02T07:33:29.210854+0000","last_peered":"2024-04-02T07:33:29.210854+0000","last_clean":"2024-04-02T07:33:29.210854+0000","last_became_active":"2024-04-02T07:33:27.875615+0000","last_became_peered":"2024-04-02T07:33:27.875615+0000","last_unstale":"2024-04-02T07:33:29.210854+0000","last_undegraded":"2024-04-02T07:33:29.210854+0000","last_fullsized":"2024-04-02T07:33:29.210854+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:56:29.935329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.211275+0000","last_change":"2024-04-02T07:33:27.866086+0000","last_active":"2024-04-02T07:33:29.211275+0000","last_peered":"2024-04-02T07:33:29.211275+0000","last_clean":"2024-04-02T07:33:29.211275+0000","last_became_active":"2024-04-02T07:33:27.865799+0000","last_became_peered":"2024-04-02T07:33:27.865799+0000","last_unstale":"2024-04-02T07:33:29.211275+0000","last_undegraded":"2024-04-02T07:33:29.211275+0000","last_fullsized":"2024-04-02T07:33:29.211275+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:49:55.405575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"115'4","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413536+0000","last_change":"2024-04-02T07:33:27.465580+0000","last_active":"2024-04-02T07:33:29.413536+0000","last_peered":"2024-04-02T07:33:29.413536+0000","last_clean":"2024-04-02T07:33:29.413536+0000","last_became_active":"2024-04-02T07:33:27.465317+0000","last_became_peered":"2024-04-02T07:33:27.465317+0000","last_unstale":"2024-04-02T07:33:29.413536+0000","last_undegraded":"2024-04-02T07:33:29.413536+0000","last_fullsized":"2024-04-02T07:33:29.413536+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:53:49.973543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.507596+0000","last_change":"2024-04-02T07:33:27.882689+0000","last_active":"2024-04-02T07:33:29.507596+0000","last_peered":"2024-04-02T07:33:29.507596+0000","last_clean":"2024-04-02T07:33:29.507596+0000","last_became_active":"2024-04-02T07:33:27.882354+0000","last_became_peered":"2024-04-02T07:33:27.882354+0000","last_unstale":"2024-04-02T07:33:29.507596+0000","last_undegraded":"2024-04-02T07:33:29.507596+0000","last_fullsized":"2024-04-02T07:33:29.507596+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:24:38.502056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"115'1","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714897+0000","last_change":"2024-04-02T07:33:27.466340+0000","last_active":"2024-04-02T07:33:29.714897+0000","last_peered":"2024-04-02T07:33:29.714897+0000","last_clean":"2024-04-02T07:33:29.714897+0000","last_became_active":"2024-04-02T07:33:27.466039+0000","last_became_peered":"2024-04-02T07:33:27.466039+0000","last_unstale":"2024-04-02T07:33:29.714897+0000","last_undegraded":"2024-04-02T07:33:29.714897+0000","last_fullsized":"2024-04-02T07:33:29.714897+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:37:17.604375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.211070+0000","last_change":"2024-04-02T07:33:27.876858+0000","last_active":"2024-04-02T07:33:29.211070+0000","last_peered":"2024-04-02T07:33:29.211070+0000","last_clean":"2024-04-02T07:33:29.211070+0000","last_became_active":"2024-04-02T07:33:27.876598+0000","last_became_peered":"2024-04-02T07:33:27.876598+0000","last_unstale":"2024-04-02T07:33:29.211070+0000","last_undegraded":"2024-04-02T07:33:29.211070+0000","last_fullsized":"2024-04-02T07:33:29.211070+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:30:56.102859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"115'2","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.856911+0000","last_change":"2024-04-02T07:33:27.456721+0000","last_active":"2024-04-02T07:33:28.856911+0000","last_peered":"2024-04-02T07:33:28.856911+0000","last_clean":"2024-04-02T07:33:28.856911+0000","last_became_active":"2024-04-02T07:33:27.456469+0000","last_became_peered":"2024-04-02T07:33:27.456469+0000","last_unstale":"2024-04-02T07:33:28.856911+0000","last_undegraded":"2024-04-02T07:33:28.856911+0000","last_fullsized":"2024-04-02T07:33:28.856911+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:04:38.980893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714885+0000","last_change":"2024-04-02T07:33:27.880030+0000","last_active":"2024-04-02T07:33:29.714885+0000","last_peered":"2024-04-02T07:33:29.714885+0000","last_clean":"2024-04-02T07:33:29.714885+0000","last_became_active":"2024-04-02T07:33:27.876829+0000","last_became_peered":"2024-04-02T07:33:27.876829+0000","last_unstale":"2024-04-02T07:33:29.714885+0000","last_undegraded":"2024-04-02T07:33:29.714885+0000","last_fullsized":"2024-04-02T07:33:29.714885+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:37:58.952494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"115'2","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.856780+0000","last_change":"2024-04-02T07:33:27.459863+0000","last_active":"2024-04-02T07:33:28.856780+0000","last_peered":"2024-04-02T07:33:28.856780+0000","last_clean":"2024-04-02T07:33:28.856780+0000","last_became_active":"2024-04-02T07:33:27.458908+0000","last_became_peered":"2024-04-02T07:33:27.458908+0000","last_unstale":"2024-04-02T07:33:28.856780+0000","last_undegraded":"2024-04-02T07:33:28.856780+0000","last_fullsized":"2024-04-02T07:33:28.856780+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:54:43.407165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711388+0000","last_change":"2024-04-02T07:33:27.881505+0000","last_active":"2024-04-02T07:33:29.711388+0000","last_peered":"2024-04-02T07:33:29.711388+0000","last_clean":"2024-04-02T07:33:29.711388+0000","last_became_active":"2024-04-02T07:33:27.881255+0000","last_became_peered":"2024-04-02T07:33:27.881255+0000","last_unstale":"2024-04-02T07:33:29.711388+0000","last_undegraded":"2024-04-02T07:33:29.711388+0000","last_fullsized":"2024-04-02T07:33:29.711388+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:12:23.501513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"115'1","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413467+0000","last_change":"2024-04-02T07:33:27.464628+0000","last_active":"2024-04-02T07:33:29.413467+0000","last_peered":"2024-04-02T07:33:29.413467+0000","last_clean":"2024-04-02T07:33:29.413467+0000","last_became_active":"2024-04-02T07:33:27.464228+0000","last_became_peered":"2024-04-02T07:33:27.464228+0000","last_unstale":"2024-04-02T07:33:29.413467+0000","last_undegraded":"2024-04-02T07:33:29.413467+0000","last_fullsized":"2024-04-02T07:33:29.413467+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:07:36.248518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860597+0000","last_change":"2024-04-02T07:33:27.875788+0000","last_active":"2024-04-02T07:33:28.860597+0000","last_peered":"2024-04-02T07:33:28.860597+0000","last_clean":"2024-04-02T07:33:28.860597+0000","last_became_active":"2024-04-02T07:33:27.875532+0000","last_became_peered":"2024-04-02T07:33:27.875532+0000","last_unstale":"2024-04-02T07:33:28.860597+0000","last_undegraded":"2024-04-02T07:33:28.860597+0000","last_fullsized":"2024-04-02T07:33:28.860597+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:44:30.553371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"115'1","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.880920+0000","last_change":"2024-04-02T07:33:27.464579+0000","last_active":"2024-04-02T07:33:27.880920+0000","last_peered":"2024-04-02T07:33:27.880920+0000","last_clean":"2024-04-02T07:33:27.880920+0000","last_became_active":"2024-04-02T07:33:27.464321+0000","last_became_peered":"2024-04-02T07:33:27.464321+0000","last_unstale":"2024-04-02T07:33:27.880920+0000","last_undegraded":"2024-04-02T07:33:27.880920+0000","last_fullsized":"2024-04-02T07:33:27.880920+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:08:56.569092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711234+0000","last_change":"2024-04-02T07:33:27.876563+0000","last_active":"2024-04-02T07:33:29.711234+0000","last_peered":"2024-04-02T07:33:29.711234+0000","last_clean":"2024-04-02T07:33:29.711234+0000","last_became_active":"2024-04-02T07:33:27.875714+0000","last_became_peered":"2024-04-02T07:33:27.875714+0000","last_unstale":"2024-04-02T07:33:29.711234+0000","last_undegraded":"2024-04-02T07:33:29.711234+0000","last_fullsized":"2024-04-02T07:33:29.711234+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:04:00.348795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.859908+0000","last_change":"2024-04-02T07:33:27.462628+0000","last_active":"2024-04-02T07:33:27.859908+0000","last_peered":"2024-04-02T07:33:27.859908+0000","last_clean":"2024-04-02T07:33:27.859908+0000","last_became_active":"2024-04-02T07:33:27.462346+0000","last_became_peered":"2024-04-02T07:33:27.462346+0000","last_unstale":"2024-04-02T07:33:27.859908+0000","last_undegraded":"2024-04-02T07:33:27.859908+0000","last_fullsized":"2024-04-02T07:33:27.859908+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:21.236879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413277+0000","last_change":"2024-04-02T07:33:27.879776+0000","last_active":"2024-04-02T07:33:29.413277+0000","last_peered":"2024-04-02T07:33:29.413277+0000","last_clean":"2024-04-02T07:33:29.413277+0000","last_became_active":"2024-04-02T07:33:27.879358+0000","last_became_peered":"2024-04-02T07:33:27.879358+0000","last_unstale":"2024-04-02T07:33:29.413277+0000","last_undegraded":"2024-04-02T07:33:29.413277+0000","last_fullsized":"2024-04-02T07:33:29.413277+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:22.240514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711359+0000","last_change":"2024-04-02T07:33:27.470673+0000","last_active":"2024-04-02T07:33:29.711359+0000","last_peered":"2024-04-02T07:33:29.711359+0000","last_clean":"2024-04-02T07:33:29.711359+0000","last_became_active":"2024-04-02T07:33:27.470329+0000","last_became_peered":"2024-04-02T07:33:27.470329+0000","last_unstale":"2024-04-02T07:33:29.711359+0000","last_undegraded":"2024-04-02T07:33:29.711359+0000","last_fullsized":"2024-04-02T07:33:29.711359+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:45:55.632756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413598+0000","last_change":"2024-04-02T07:33:27.877334+0000","last_active":"2024-04-02T07:33:29.413598+0000","last_peered":"2024-04-02T07:33:29.413598+0000","last_clean":"2024-04-02T07:33:29.413598+0000","last_became_active":"2024-04-02T07:33:27.877064+0000","last_became_peered":"2024-04-02T07:33:27.877064+0000","last_unstale":"2024-04-02T07:33:29.413598+0000","last_undegraded":"2024-04-02T07:33:29.413598+0000","last_fullsized":"2024-04-02T07:33:29.413598+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:25:29.754251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.856687+0000","last_change":"2024-04-02T07:33:27.461888+0000","last_active":"2024-04-02T07:33:28.856687+0000","last_peered":"2024-04-02T07:33:28.856687+0000","last_clean":"2024-04-02T07:33:28.856687+0000","last_became_active":"2024-04-02T07:33:27.461640+0000","last_became_peered":"2024-04-02T07:33:27.461640+0000","last_unstale":"2024-04-02T07:33:28.856687+0000","last_undegraded":"2024-04-02T07:33:28.856687+0000","last_fullsized":"2024-04-02T07:33:28.856687+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:26:29.689361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.507698+0000","last_change":"2024-04-02T07:33:27.882054+0000","last_active":"2024-04-02T07:33:29.507698+0000","last_peered":"2024-04-02T07:33:29.507698+0000","last_clean":"2024-04-02T07:33:29.507698+0000","last_became_active":"2024-04-02T07:33:27.881385+0000","last_became_peered":"2024-04-02T07:33:27.881385+0000","last_unstale":"2024-04-02T07:33:29.507698+0000","last_undegraded":"2024-04-02T07:33:29.507698+0000","last_fullsized":"2024-04-02T07:33:29.507698+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:07:35.756044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.866811+0000","last_change":"2024-04-02T07:33:27.464819+0000","last_active":"2024-04-02T07:33:27.866811+0000","last_peered":"2024-04-02T07:33:27.866811+0000","last_clean":"2024-04-02T07:33:27.866811+0000","last_became_active":"2024-04-02T07:33:27.464336+0000","last_became_peered":"2024-04-02T07:33:27.464336+0000","last_unstale":"2024-04-02T07:33:27.866811+0000","last_undegraded":"2024-04-02T07:33:27.866811+0000","last_fullsized":"2024-04-02T07:33:27.866811+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:04:11.156678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857980+0000","last_change":"2024-04-02T07:33:27.873267+0000","last_active":"2024-04-02T07:33:28.857980+0000","last_peered":"2024-04-02T07:33:28.857980+0000","last_clean":"2024-04-02T07:33:28.857980+0000","last_became_active":"2024-04-02T07:33:27.872846+0000","last_became_peered":"2024-04-02T07:33:27.872846+0000","last_unstale":"2024-04-02T07:33:28.857980+0000","last_undegraded":"2024-04-02T07:33:28.857980+0000","last_fullsized":"2024-04-02T07:33:28.857980+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:19:33.558224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"115'3","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711681+0000","last_change":"2024-04-02T07:33:27.468371+0000","last_active":"2024-04-02T07:33:29.711681+0000","last_peered":"2024-04-02T07:33:29.711681+0000","last_clean":"2024-04-02T07:33:29.711681+0000","last_became_active":"2024-04-02T07:33:27.468137+0000","last_became_peered":"2024-04-02T07:33:27.468137+0000","last_unstale":"2024-04-02T07:33:29.711681+0000","last_undegraded":"2024-04-02T07:33:29.711681+0000","last_fullsized":"2024-04-02T07:33:29.711681+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:07:34.752409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413480+0000","last_change":"2024-04-02T07:33:27.874173+0000","last_active":"2024-04-02T07:33:29.413480+0000","last_peered":"2024-04-02T07:33:29.413480+0000","last_clean":"2024-04-02T07:33:29.413480+0000","last_became_active":"2024-04-02T07:33:27.873885+0000","last_became_peered":"2024-04-02T07:33:27.873885+0000","last_unstale":"2024-04-02T07:33:29.413480+0000","last_undegraded":"2024-04-02T07:33:29.413480+0000","last_fullsized":"2024-04-02T07:33:29.413480+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:01:55.510529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"115'6","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711951+0000","last_change":"2024-04-02T07:33:27.470069+0000","last_active":"2024-04-02T07:33:29.711951+0000","last_peered":"2024-04-02T07:33:29.711951+0000","last_clean":"2024-04-02T07:33:29.711951+0000","last_became_active":"2024-04-02T07:33:27.469725+0000","last_became_peered":"2024-04-02T07:33:27.469725+0000","last_unstale":"2024-04-02T07:33:29.711951+0000","last_undegraded":"2024-04-02T07:33:29.711951+0000","last_fullsized":"2024-04-02T07:33:29.711951+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:48:39.594742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857894+0000","last_change":"2024-04-02T07:33:27.869118+0000","last_active":"2024-04-02T07:33:28.857894+0000","last_peered":"2024-04-02T07:33:28.857894+0000","last_clean":"2024-04-02T07:33:28.857894+0000","last_became_active":"2024-04-02T07:33:27.868872+0000","last_became_peered":"2024-04-02T07:33:27.868872+0000","last_unstale":"2024-04-02T07:33:28.857894+0000","last_undegraded":"2024-04-02T07:33:28.857894+0000","last_fullsized":"2024-04-02T07:33:28.857894+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:25:09.411123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"115'2","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.871157+0000","last_change":"2024-04-02T07:33:27.462734+0000","last_active":"2024-04-02T07:33:27.871157+0000","last_peered":"2024-04-02T07:33:27.871157+0000","last_clean":"2024-04-02T07:33:27.871157+0000","last_became_active":"2024-04-02T07:33:27.462486+0000","last_became_peered":"2024-04-02T07:33:27.462486+0000","last_unstale":"2024-04-02T07:33:27.871157+0000","last_undegraded":"2024-04-02T07:33:27.871157+0000","last_fullsized":"2024-04-02T07:33:27.871157+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:11:47.314840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857892+0000","last_change":"2024-04-02T07:33:27.876507+0000","last_active":"2024-04-02T07:33:28.857892+0000","last_peered":"2024-04-02T07:33:28.857892+0000","last_clean":"2024-04-02T07:33:28.857892+0000","last_became_active":"2024-04-02T07:33:27.876221+0000","last_became_peered":"2024-04-02T07:33:27.876221+0000","last_unstale":"2024-04-02T07:33:28.857892+0000","last_undegraded":"2024-04-02T07:33:28.857892+0000","last_fullsized":"2024-04-02T07:33:28.857892+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:37:58.952494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.872828+0000","last_change":"2024-04-02T07:33:27.469634+0000","last_active":"2024-04-02T07:33:27.872828+0000","last_peered":"2024-04-02T07:33:27.872828+0000","last_clean":"2024-04-02T07:33:27.872828+0000","last_became_active":"2024-04-02T07:33:27.469328+0000","last_became_peered":"2024-04-02T07:33:27.469328+0000","last_unstale":"2024-04-02T07:33:27.872828+0000","last_undegraded":"2024-04-02T07:33:27.872828+0000","last_fullsized":"2024-04-02T07:33:27.872828+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:21:06.948320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857866+0000","last_change":"2024-04-02T07:33:27.872927+0000","last_active":"2024-04-02T07:33:28.857866+0000","last_peered":"2024-04-02T07:33:28.857866+0000","last_clean":"2024-04-02T07:33:28.857866+0000","last_became_active":"2024-04-02T07:33:27.872635+0000","last_became_peered":"2024-04-02T07:33:27.872635+0000","last_unstale":"2024-04-02T07:33:28.857866+0000","last_undegraded":"2024-04-02T07:33:28.857866+0000","last_fullsized":"2024-04-02T07:33:28.857866+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:47:01.625875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"115'8","reported_seq":19,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.856539+0000","last_change":"2024-04-02T07:33:27.459692+0000","last_active":"2024-04-02T07:33:28.856539+0000","last_peered":"2024-04-02T07:33:28.856539+0000","last_clean":"2024-04-02T07:33:28.856539+0000","last_became_active":"2024-04-02T07:33:27.459414+0000","last_became_peered":"2024-04-02T07:33:27.459414+0000","last_unstale":"2024-04-02T07:33:28.856539+0000","last_undegraded":"2024-04-02T07:33:28.856539+0000","last_fullsized":"2024-04-02T07:33:28.856539+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:32:00.625887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857324+0000","last_change":"2024-04-02T07:33:27.881452+0000","last_active":"2024-04-02T07:33:28.857324+0000","last_peered":"2024-04-02T07:33:28.857324+0000","last_clean":"2024-04-02T07:33:28.857324+0000","last_became_active":"2024-04-02T07:33:27.879513+0000","last_became_peered":"2024-04-02T07:33:27.879513+0000","last_unstale":"2024-04-02T07:33:28.857324+0000","last_undegraded":"2024-04-02T07:33:28.857324+0000","last_fullsized":"2024-04-02T07:33:28.857324+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:53:50.977179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"115'1","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711883+0000","last_change":"2024-04-02T07:33:27.471006+0000","last_active":"2024-04-02T07:33:29.711883+0000","last_peered":"2024-04-02T07:33:29.711883+0000","last_clean":"2024-04-02T07:33:29.711883+0000","last_became_active":"2024-04-02T07:33:27.470297+0000","last_became_peered":"2024-04-02T07:33:27.470297+0000","last_unstale":"2024-04-02T07:33:29.711883+0000","last_undegraded":"2024-04-02T07:33:29.711883+0000","last_fullsized":"2024-04-02T07:33:29.711883+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:04.974430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.211281+0000","last_change":"2024-04-02T07:33:27.872104+0000","last_active":"2024-04-02T07:33:29.211281+0000","last_peered":"2024-04-02T07:33:29.211281+0000","last_clean":"2024-04-02T07:33:29.211281+0000","last_became_active":"2024-04-02T07:33:27.871812+0000","last_became_peered":"2024-04-02T07:33:27.871812+0000","last_unstale":"2024-04-02T07:33:29.211281+0000","last_undegraded":"2024-04-02T07:33:29.211281+0000","last_fullsized":"2024-04-02T07:33:29.211281+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:37:51.007791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"115'2","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857348+0000","last_change":"2024-04-02T07:33:27.460964+0000","last_active":"2024-04-02T07:33:28.857348+0000","last_peered":"2024-04-02T07:33:28.857348+0000","last_clean":"2024-04-02T07:33:28.857348+0000","last_became_active":"2024-04-02T07:33:27.460660+0000","last_became_peered":"2024-04-02T07:33:27.460660+0000","last_unstale":"2024-04-02T07:33:28.857348+0000","last_undegraded":"2024-04-02T07:33:28.857348+0000","last_fullsized":"2024-04-02T07:33:28.857348+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:18:31.967031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714810+0000","last_change":"2024-04-02T07:33:27.878749+0000","last_active":"2024-04-02T07:33:29.714810+0000","last_peered":"2024-04-02T07:33:29.714810+0000","last_clean":"2024-04-02T07:33:29.714810+0000","last_became_active":"2024-04-02T07:33:27.878487+0000","last_became_peered":"2024-04-02T07:33:27.878487+0000","last_unstale":"2024-04-02T07:33:29.714810+0000","last_undegraded":"2024-04-02T07:33:29.714810+0000","last_fullsized":"2024-04-02T07:33:29.714810+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:25:09.411123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"115'1","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.882562+0000","last_change":"2024-04-02T07:33:27.467380+0000","last_active":"2024-04-02T07:33:27.882562+0000","last_peered":"2024-04-02T07:33:27.882562+0000","last_clean":"2024-04-02T07:33:27.882562+0000","last_became_active":"2024-04-02T07:33:27.467110+0000","last_became_peered":"2024-04-02T07:33:27.467110+0000","last_unstale":"2024-04-02T07:33:27.882562+0000","last_undegraded":"2024-04-02T07:33:27.882562+0000","last_fullsized":"2024-04-02T07:33:27.882562+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:37:17.604375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714951+0000","last_change":"2024-04-02T07:33:27.880948+0000","last_active":"2024-04-02T07:33:29.714951+0000","last_peered":"2024-04-02T07:33:29.714951+0000","last_clean":"2024-04-02T07:33:29.714951+0000","last_became_active":"2024-04-02T07:33:27.880667+0000","last_became_peered":"2024-04-02T07:33:27.880667+0000","last_unstale":"2024-04-02T07:33:29.714951+0000","last_undegraded":"2024-04-02T07:33:29.714951+0000","last_fullsized":"2024-04-02T07:33:29.714951+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:17:08.670738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413362+0000","last_change":"2024-04-02T07:33:27.475514+0000","last_active":"2024-04-02T07:33:29.413362+0000","last_peered":"2024-04-02T07:33:29.413362+0000","last_clean":"2024-04-02T07:33:29.413362+0000","last_became_active":"2024-04-02T07:33:27.475204+0000","last_became_peered":"2024-04-02T07:33:27.475204+0000","last_unstale":"2024-04-02T07:33:29.413362+0000","last_undegraded":"2024-04-02T07:33:29.413362+0000","last_fullsized":"2024-04-02T07:33:29.413362+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:06:44.332166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714557+0000","last_change":"2024-04-02T07:33:27.877020+0000","last_active":"2024-04-02T07:33:29.714557+0000","last_peered":"2024-04-02T07:33:29.714557+0000","last_clean":"2024-04-02T07:33:29.714557+0000","last_became_active":"2024-04-02T07:33:27.876734+0000","last_became_peered":"2024-04-02T07:33:27.876734+0000","last_unstale":"2024-04-02T07:33:29.714557+0000","last_undegraded":"2024-04-02T07:33:29.714557+0000","last_fullsized":"2024-04-02T07:33:29.714557+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:07:35.756044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"115'2","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.869706+0000","last_change":"2024-04-02T07:33:27.468546+0000","last_active":"2024-04-02T07:33:27.869706+0000","last_peered":"2024-04-02T07:33:27.869706+0000","last_clean":"2024-04-02T07:33:27.869706+0000","last_became_active":"2024-04-02T07:33:27.468265+0000","last_became_peered":"2024-04-02T07:33:27.468265+0000","last_unstale":"2024-04-02T07:33:27.869706+0000","last_undegraded":"2024-04-02T07:33:27.869706+0000","last_fullsized":"2024-04-02T07:33:27.869706+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:20:26.400805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711361+0000","last_change":"2024-04-02T07:33:27.873609+0000","last_active":"2024-04-02T07:33:29.711361+0000","last_peered":"2024-04-02T07:33:29.711361+0000","last_clean":"2024-04-02T07:33:29.711361+0000","last_became_active":"2024-04-02T07:33:27.873311+0000","last_became_peered":"2024-04-02T07:33:27.873311+0000","last_unstale":"2024-04-02T07:33:29.711361+0000","last_undegraded":"2024-04-02T07:33:29.711361+0000","last_fullsized":"2024-04-02T07:33:29.711361+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:36:13.657455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.856665+0000","last_change":"2024-04-02T07:33:27.459252+0000","last_active":"2024-04-02T07:33:28.856665+0000","last_peered":"2024-04-02T07:33:28.856665+0000","last_clean":"2024-04-02T07:33:28.856665+0000","last_became_active":"2024-04-02T07:33:27.457131+0000","last_became_peered":"2024-04-02T07:33:27.457131+0000","last_unstale":"2024-04-02T07:33:28.856665+0000","last_undegraded":"2024-04-02T07:33:28.856665+0000","last_fullsized":"2024-04-02T07:33:28.856665+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:11:07.359510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714678+0000","last_change":"2024-04-02T07:33:27.876431+0000","last_active":"2024-04-02T07:33:29.714678+0000","last_peered":"2024-04-02T07:33:29.714678+0000","last_clean":"2024-04-02T07:33:29.714678+0000","last_became_active":"2024-04-02T07:33:27.876162+0000","last_became_peered":"2024-04-02T07:33:27.876162+0000","last_unstale":"2024-04-02T07:33:29.714678+0000","last_undegraded":"2024-04-02T07:33:29.714678+0000","last_fullsized":"2024-04-02T07:33:29.714678+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:56:03.473104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.851031+0000","last_change":"2024-04-02T07:33:27.464627+0000","last_active":"2024-04-02T07:33:27.851031+0000","last_peered":"2024-04-02T07:33:27.851031+0000","last_clean":"2024-04-02T07:33:27.851031+0000","last_became_active":"2024-04-02T07:33:27.464384+0000","last_became_peered":"2024-04-02T07:33:27.464384+0000","last_unstale":"2024-04-02T07:33:27.851031+0000","last_undegraded":"2024-04-02T07:33:27.851031+0000","last_fullsized":"2024-04-02T07:33:27.851031+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:08:01.054804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857770+0000","last_change":"2024-04-02T07:33:27.883782+0000","last_active":"2024-04-02T07:33:28.857770+0000","last_peered":"2024-04-02T07:33:28.857770+0000","last_clean":"2024-04-02T07:33:28.857770+0000","last_became_active":"2024-04-02T07:33:27.883530+0000","last_became_peered":"2024-04-02T07:33:27.883530+0000","last_unstale":"2024-04-02T07:33:28.857770+0000","last_undegraded":"2024-04-02T07:33:28.857770+0000","last_fullsized":"2024-04-02T07:33:28.857770+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:03:56.453553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711419+0000","last_change":"2024-04-02T07:33:27.466749+0000","last_active":"2024-04-02T07:33:29.711419+0000","last_peered":"2024-04-02T07:33:29.711419+0000","last_clean":"2024-04-02T07:33:29.711419+0000","last_became_active":"2024-04-02T07:33:27.466501+0000","last_became_peered":"2024-04-02T07:33:27.466501+0000","last_unstale":"2024-04-02T07:33:29.711419+0000","last_undegraded":"2024-04-02T07:33:29.711419+0000","last_fullsized":"2024-04-02T07:33:29.711419+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:29:58.451996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.507632+0000","last_change":"2024-04-02T07:33:27.880592+0000","last_active":"2024-04-02T07:33:29.507632+0000","last_peered":"2024-04-02T07:33:29.507632+0000","last_clean":"2024-04-02T07:33:29.507632+0000","last_became_active":"2024-04-02T07:33:27.880268+0000","last_became_peered":"2024-04-02T07:33:27.880268+0000","last_unstale":"2024-04-02T07:33:29.507632+0000","last_undegraded":"2024-04-02T07:33:29.507632+0000","last_fullsized":"2024-04-02T07:33:29.507632+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:42:58.494573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"115'2","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.877258+0000","last_change":"2024-04-02T07:33:27.460369+0000","last_active":"2024-04-02T07:33:27.877258+0000","last_peered":"2024-04-02T07:33:27.877258+0000","last_clean":"2024-04-02T07:33:27.877258+0000","last_became_active":"2024-04-02T07:33:27.460059+0000","last_became_peered":"2024-04-02T07:33:27.460059+0000","last_unstale":"2024-04-02T07:33:27.877258+0000","last_undegraded":"2024-04-02T07:33:27.877258+0000","last_fullsized":"2024-04-02T07:33:27.877258+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:08:47.676933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711799+0000","last_change":"2024-04-02T07:33:27.868116+0000","last_active":"2024-04-02T07:33:29.711799+0000","last_peered":"2024-04-02T07:33:29.711799+0000","last_clean":"2024-04-02T07:33:29.711799+0000","last_became_active":"2024-04-02T07:33:27.867771+0000","last_became_peered":"2024-04-02T07:33:27.867771+0000","last_unstale":"2024-04-02T07:33:29.711799+0000","last_undegraded":"2024-04-02T07:33:29.711799+0000","last_fullsized":"2024-04-02T07:33:29.711799+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:07:07.097752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"115'1","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.550059+0000","last_change":"2024-04-02T07:33:27.463956+0000","last_active":"2024-04-02T07:33:28.550059+0000","last_peered":"2024-04-02T07:33:28.550059+0000","last_clean":"2024-04-02T07:33:28.550059+0000","last_became_active":"2024-04-02T07:33:27.463426+0000","last_became_peered":"2024-04-02T07:33:27.463426+0000","last_unstale":"2024-04-02T07:33:28.550059+0000","last_undegraded":"2024-04-02T07:33:28.550059+0000","last_fullsized":"2024-04-02T07:33:28.550059+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:30:53.259024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711923+0000","last_change":"2024-04-02T07:33:27.873388+0000","last_active":"2024-04-02T07:33:29.711923+0000","last_peered":"2024-04-02T07:33:29.711923+0000","last_clean":"2024-04-02T07:33:29.711923+0000","last_became_active":"2024-04-02T07:33:27.873046+0000","last_became_peered":"2024-04-02T07:33:27.873046+0000","last_unstale":"2024-04-02T07:33:29.711923+0000","last_undegraded":"2024-04-02T07:33:29.711923+0000","last_fullsized":"2024-04-02T07:33:29.711923+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:38:08.666711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711698+0000","last_change":"2024-04-02T07:33:27.462653+0000","last_active":"2024-04-02T07:33:29.711698+0000","last_peered":"2024-04-02T07:33:29.711698+0000","last_clean":"2024-04-02T07:33:29.711698+0000","last_became_active":"2024-04-02T07:33:27.462356+0000","last_became_peered":"2024-04-02T07:33:27.462356+0000","last_unstale":"2024-04-02T07:33:29.711698+0000","last_undegraded":"2024-04-02T07:33:29.711698+0000","last_fullsized":"2024-04-02T07:33:29.711698+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:42:57.490938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.507503+0000","last_change":"2024-04-02T07:33:27.886387+0000","last_active":"2024-04-02T07:33:29.507503+0000","last_peered":"2024-04-02T07:33:29.507503+0000","last_clean":"2024-04-02T07:33:29.507503+0000","last_became_active":"2024-04-02T07:33:27.886120+0000","last_became_peered":"2024-04-02T07:33:27.886120+0000","last_unstale":"2024-04-02T07:33:29.507503+0000","last_undegraded":"2024-04-02T07:33:29.507503+0000","last_fullsized":"2024-04-02T07:33:29.507503+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:05.978066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.866477+0000","last_change":"2024-04-02T07:33:27.463765+0000","last_active":"2024-04-02T07:33:27.866477+0000","last_peered":"2024-04-02T07:33:27.866477+0000","last_clean":"2024-04-02T07:33:27.866477+0000","last_became_active":"2024-04-02T07:33:27.463560+0000","last_became_peered":"2024-04-02T07:33:27.463560+0000","last_unstale":"2024-04-02T07:33:27.866477+0000","last_undegraded":"2024-04-02T07:33:27.866477+0000","last_fullsized":"2024-04-02T07:33:27.866477+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:44:29.549736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860456+0000","last_change":"2024-04-02T07:33:27.871562+0000","last_active":"2024-04-02T07:33:28.860456+0000","last_peered":"2024-04-02T07:33:28.860456+0000","last_clean":"2024-04-02T07:33:28.860456+0000","last_became_active":"2024-04-02T07:33:27.871249+0000","last_became_peered":"2024-04-02T07:33:27.871249+0000","last_unstale":"2024-04-02T07:33:28.860456+0000","last_undegraded":"2024-04-02T07:33:28.860456+0000","last_fullsized":"2024-04-02T07:33:28.860456+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:29:59.455631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413588+0000","last_change":"2024-04-02T07:33:27.465947+0000","last_active":"2024-04-02T07:33:29.413588+0000","last_peered":"2024-04-02T07:33:29.413588+0000","last_clean":"2024-04-02T07:33:29.413588+0000","last_became_active":"2024-04-02T07:33:27.465653+0000","last_became_peered":"2024-04-02T07:33:27.465653+0000","last_unstale":"2024-04-02T07:33:29.413588+0000","last_undegraded":"2024-04-02T07:33:29.413588+0000","last_fullsized":"2024-04-02T07:33:29.413588+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:49:07.363861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860729+0000","last_change":"2024-04-02T07:33:27.868107+0000","last_active":"2024-04-02T07:33:28.860729+0000","last_peered":"2024-04-02T07:33:28.860729+0000","last_clean":"2024-04-02T07:33:28.860729+0000","last_became_active":"2024-04-02T07:33:27.867794+0000","last_became_peered":"2024-04-02T07:33:27.867794+0000","last_unstale":"2024-04-02T07:33:28.860729+0000","last_undegraded":"2024-04-02T07:33:28.860729+0000","last_fullsized":"2024-04-02T07:33:28.860729+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:08:57.572728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.861074+0000","last_change":"2024-04-02T07:33:27.463549+0000","last_active":"2024-04-02T07:33:27.861074+0000","last_peered":"2024-04-02T07:33:27.861074+0000","last_clean":"2024-04-02T07:33:27.861074+0000","last_became_active":"2024-04-02T07:33:27.463001+0000","last_became_peered":"2024-04-02T07:33:27.463001+0000","last_unstale":"2024-04-02T07:33:27.861074+0000","last_undegraded":"2024-04-02T07:33:27.861074+0000","last_fullsized":"2024-04-02T07:33:27.861074+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:42:29.107894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714800+0000","last_change":"2024-04-02T07:33:27.883667+0000","last_active":"2024-04-02T07:33:29.714800+0000","last_peered":"2024-04-02T07:33:29.714800+0000","last_clean":"2024-04-02T07:33:29.714800+0000","last_became_active":"2024-04-02T07:33:27.883417+0000","last_became_peered":"2024-04-02T07:33:27.883417+0000","last_unstale":"2024-04-02T07:33:29.714800+0000","last_undegraded":"2024-04-02T07:33:29.714800+0000","last_fullsized":"2024-04-02T07:33:29.714800+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:48:40.598377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.856798+0000","last_change":"2024-04-02T07:33:27.460731+0000","last_active":"2024-04-02T07:33:28.856798+0000","last_peered":"2024-04-02T07:33:28.856798+0000","last_clean":"2024-04-02T07:33:28.856798+0000","last_became_active":"2024-04-02T07:33:27.460259+0000","last_became_peered":"2024-04-02T07:33:27.460259+0000","last_unstale":"2024-04-02T07:33:28.856798+0000","last_undegraded":"2024-04-02T07:33:28.856798+0000","last_fullsized":"2024-04-02T07:33:28.856798+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:14:47.506995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711426+0000","last_change":"2024-04-02T07:33:27.865732+0000","last_active":"2024-04-02T07:33:29.711426+0000","last_peered":"2024-04-02T07:33:29.711426+0000","last_clean":"2024-04-02T07:33:29.711426+0000","last_became_active":"2024-04-02T07:33:27.865437+0000","last_became_peered":"2024-04-02T07:33:27.865437+0000","last_unstale":"2024-04-02T07:33:29.711426+0000","last_undegraded":"2024-04-02T07:33:29.711426+0000","last_fullsized":"2024-04-02T07:33:29.711426+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:06:19.432859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711498+0000","last_change":"2024-04-02T07:33:27.466750+0000","last_active":"2024-04-02T07:33:29.711498+0000","last_peered":"2024-04-02T07:33:29.711498+0000","last_clean":"2024-04-02T07:33:29.711498+0000","last_became_active":"2024-04-02T07:33:27.466479+0000","last_became_peered":"2024-04-02T07:33:27.466479+0000","last_unstale":"2024-04-02T07:33:29.711498+0000","last_undegraded":"2024-04-02T07:33:29.711498+0000","last_fullsized":"2024-04-02T07:33:29.711498+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:42:58.485704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857703+0000","last_change":"2024-04-02T07:33:27.876686+0000","last_active":"2024-04-02T07:33:28.857703+0000","last_peered":"2024-04-02T07:33:28.857703+0000","last_clean":"2024-04-02T07:33:28.857703+0000","last_became_active":"2024-04-02T07:33:27.876182+0000","last_became_peered":"2024-04-02T07:33:27.876182+0000","last_unstale":"2024-04-02T07:33:28.857703+0000","last_undegraded":"2024-04-02T07:33:28.857703+0000","last_fullsized":"2024-04-02T07:33:28.857703+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:22:10.905772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413403+0000","last_change":"2024-04-02T07:33:27.476242+0000","last_active":"2024-04-02T07:33:29.413403+0000","last_peered":"2024-04-02T07:33:29.413403+0000","last_clean":"2024-04-02T07:33:29.413403+0000","last_became_active":"2024-04-02T07:33:27.476017+0000","last_became_peered":"2024-04-02T07:33:27.476017+0000","last_unstale":"2024-04-02T07:33:29.413403+0000","last_undegraded":"2024-04-02T07:33:29.413403+0000","last_fullsized":"2024-04-02T07:33:29.413403+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:06:31.207856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":249,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.866769+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:33:27.866769+0000","last_peered":"2024-04-02T07:33:27.866769+0000","last_clean":"2024-04-02T07:33:27.866769+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:33:27.866769+0000","last_undegraded":"2024-04-02T07:33:27.866769+0000","last_fullsized":"2024-04-02T07:33:27.866769+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574987,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33112,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":2043904,"data_stored":1217463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68400000000000005,"15min":0.66300000000000003},"min":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.35299999999999998},"max":{"1min":0.90600000000000003,"5min":0.92400000000000004,"15min":1.0569999999999999},"last":0.63},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.66800000000000004,"15min":0.64300000000000002},"min":{"1min":0.60099999999999998,"5min":0.442,"15min":0.39900000000000002},"max":{"1min":0.88700000000000001,"5min":1.018,"15min":1.018},"last":0.58699999999999997}]},{"osd":1,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.67400000000000004,"15min":0.65500000000000003},"min":{"1min":0.52600000000000002,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.98099999999999998,"5min":1.004,"15min":1.0289999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69499999999999995,"15min":0.67800000000000005},"min":{"1min":0.503,"5min":0.42599999999999999,"15min":0.39500000000000002},"max":{"1min":0.96699999999999997,"5min":0.99299999999999999,"15min":1.113},"last":0.74399999999999999}]},{"osd":2,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.46300000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95099999999999996,"5min":1.0309999999999999,"15min":1.139},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.73999999999999999,"15min":0.72999999999999998},"min":{"1min":0.63900000000000001,"5min":0.503,"15min":0.437},"max":{"1min":0.93600000000000005,"5min":1.0549999999999999,"15min":1.522},"last":0.69799999999999995}]},{"osd":3,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.70999999999999996,"15min":0.70499999999999996},"min":{"1min":0.52100000000000002,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.94499999999999995,"5min":1.0409999999999999,"15min":1.405},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.623,"5min":0.48799999999999999,"15min":0.48599999999999999},"max":{"1min":0.96199999999999997,"5min":1.0329999999999999,"15min":1.0580000000000001},"last":0.55500000000000005}]},{"osd":4,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.63},"min":{"1min":0.40699999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":0.86599999999999999,"15min":1.633},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66400000000000003,"15min":0.69699999999999995},"min":{"1min":0.54700000000000004,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88200000000000001,"5min":0.94299999999999995,"15min":1.079},"last":0.79500000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.67700000000000005},"min":{"1min":0.39900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.99399999999999999,"5min":0.995,"15min":1.2250000000000001},"last":0.77900000000000003},{"interface":"front","average":{"1min":0.748,"5min":0.70399999999999996,"15min":0.73799999999999999},"min":{"1min":0.60399999999999998,"5min":0.441,"15min":0.43099999999999999},"max":{"1min":0.93600000000000005,"5min":0.98799999999999999,"15min":1.5609999999999999},"last":0.81200000000000006}]},{"osd":6,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67000000000000004,"15min":0.69399999999999995},"min":{"1min":0.51300000000000001,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":0.93899999999999995,"5min":0.97599999999999998,"15min":1.5960000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66200000000000003,"15min":0.67500000000000004},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.40699999999999997},"max":{"1min":0.89800000000000002,"5min":0.96499999999999997,"15min":1.0840000000000001},"last":0.82999999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574988,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1445888,"data_stored":626549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.71499999999999997,"15min":0.68600000000000005},"min":{"1min":0.56699999999999995,"5min":0.45500000000000002,"15min":0.41399999999999998},"max":{"1min":1.0820000000000001,"5min":1.147,"15min":1.399},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.755,"5min":0.70999999999999996,"15min":0.78000000000000003},"min":{"1min":0.60299999999999998,"5min":0.439,"15min":0.39400000000000002},"max":{"1min":0.91500000000000004,"5min":0.95799999999999996,"15min":5.7569999999999997},"last":0.80800000000000005}]},{"osd":1,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.59499999999999997,"5min":0.42299999999999999,"15min":0.38200000000000001},"max":{"1min":0.93000000000000005,"5min":1.097,"15min":1.95},"last":0.86399999999999999},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73799999999999999,"15min":0.73099999999999998},"min":{"1min":0.59799999999999998,"5min":0.51400000000000001,"15min":0.47599999999999998},"max":{"1min":0.95899999999999996,"5min":1.0449999999999999,"15min":1.248},"last":0.84899999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72299999999999998,"15min":0.70099999999999996},"min":{"1min":0.54400000000000004,"5min":0.47499999999999998,"15min":0.45000000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.226},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.745,"15min":0.72799999999999998},"min":{"1min":0.53100000000000003,"5min":0.51200000000000001,"15min":0.46500000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.78900000000000003}]},{"osd":3,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.74199999999999999,"15min":0.76700000000000002},"min":{"1min":0.65900000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.006,"5min":1.006,"15min":2.3119999999999998},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.72299999999999998,"15min":0.754},"min":{"1min":0.61699999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":2.6389999999999998},"last":0.996}]},{"osd":4,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.62,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.34999999999999998},"max":{"1min":1.0469999999999999,"5min":1.236,"15min":1.236},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.625,"15min":0.64300000000000002},"min":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.38500000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.53100000000000003}]},{"osd":5,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60399999999999998,"15min":0.63500000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.37},"max":{"1min":0.80000000000000004,"5min":0.86399999999999999,"15min":0.95999999999999996},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67800000000000005,"15min":0.69899999999999995},"min":{"1min":0.505,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":1.0109999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.64700000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69099999999999995,"15min":0.70999999999999996},"min":{"1min":0.52500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.96999999999999997,"5min":3.3290000000000002,"15min":3.3290000000000002},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.67900000000000005,"15min":0.70899999999999996},"min":{"1min":0.52300000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.67700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574988,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32540,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1449984,"data_stored":627083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67300000000000004,"15min":0.66600000000000004},"min":{"1min":0.41899999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.86399999999999999,"5min":0.995,"15min":1.25},"last":0.94899999999999995},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70399999999999996,"15min":0.70299999999999996},"min":{"1min":0.438,"5min":0.42399999999999999,"15min":0.33000000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.5289999999999999},"last":0.61699999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72899999999999998,"15min":0.71199999999999997},"min":{"1min":0.56200000000000006,"5min":0.45900000000000002,"15min":0.371},"max":{"1min":0.995,"5min":0.995,"15min":1.1830000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.438,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96599999999999997,"5min":1.0069999999999999,"15min":1.3420000000000001},"last":0.81299999999999994}]},{"osd":2,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.77000000000000002,"15min":0.79300000000000004},"min":{"1min":0.57799999999999996,"5min":0.53400000000000003,"15min":0.44900000000000001},"max":{"1min":0.92800000000000005,"5min":1.0129999999999999,"15min":1.8280000000000001},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72399999999999998,"15min":0.72699999999999998},"min":{"1min":0.45700000000000002,"5min":0.40999999999999998,"15min":0.39700000000000002},"max":{"1min":0.91200000000000003,"5min":1.0109999999999999,"15min":1.696},"last":1.03}]},{"osd":3,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.52800000000000002,"5min":0.498,"15min":0.40899999999999997},"max":{"1min":0.97399999999999998,"5min":1.034,"15min":1.6399999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.745,"15min":0.77500000000000002},"min":{"1min":0.52900000000000003,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":1.01,"5min":1.01,"15min":2.0219999999999998},"last":0.65800000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57899999999999996,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.911},"last":1.0840000000000001},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61899999999999999,"15min":0.68700000000000006},"min":{"1min":0.42799999999999999,"5min":0.38500000000000001,"15min":0.307},"max":{"1min":0.93100000000000005,"5min":1.0649999999999999,"15min":1.7829999999999999},"last":0.79100000000000004}]},{"osd":6,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64000000000000001,"15min":0.72799999999999998},"min":{"1min":0.48099999999999998,"5min":0.439,"15min":0.39600000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":2.1829999999999998},"last":1.2350000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65700000000000003,"15min":0.72699999999999998},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.36499999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":2.1280000000000001},"last":0.996}]},{"osd":7,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68899999999999995,"15min":0.76100000000000001},"min":{"1min":0.54700000000000004,"5min":0.435,"15min":0.38300000000000001},"max":{"1min":0.90800000000000003,"5min":1.1319999999999999,"15min":1.887},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71399999999999997,"15min":0.79500000000000004},"min":{"1min":0.56599999999999995,"5min":0.47799999999999998,"15min":0.439},"max":{"1min":0.996,"5min":1.056,"15min":2.2599999999999998},"last":0.77500000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574990,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1441792,"data_stored":626479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.67000000000000004,"15min":0.70999999999999996},"min":{"1min":0.41099999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.875,"5min":0.92000000000000004,"15min":2.4929999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.68899999999999995,"15min":0.751},"min":{"1min":0.44900000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.94499999999999995,"5min":0.94799999999999995,"15min":3.2519999999999998},"last":0.68600000000000005}]},{"osd":1,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.69799999999999995,"15min":0.72899999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.89600000000000002,"5min":0.94499999999999995,"15min":1.4279999999999999},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.70899999999999996,"15min":0.80900000000000005},"min":{"1min":0.47199999999999998,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":4.3810000000000002},"last":0.57599999999999996}]},{"osd":2,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.71999999999999997,"15min":0.76400000000000001},"min":{"1min":0.47399999999999998,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1899999999999999,"5min":1.1990000000000001,"15min":2.056},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.70099999999999996,"15min":0.79500000000000004},"min":{"1min":0.46899999999999997,"5min":0.436,"15min":0.436},"max":{"1min":0.877,"5min":1.038,"15min":3.3420000000000001},"last":0.71699999999999997}]},{"osd":3,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.752,"15min":0.875},"min":{"1min":0.61499999999999999,"5min":0.48199999999999998,"15min":0.436},"max":{"1min":0.90700000000000003,"5min":1.091,"15min":3.9180000000000001},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75900000000000001,"15min":0.88500000000000001},"min":{"1min":0.56100000000000005,"5min":0.497,"15min":0.497},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":3.9750000000000001},"last":0.78100000000000003}]},{"osd":5,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57799999999999996,"15min":0.65400000000000003},"min":{"1min":0.45200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.1060000000000001,"5min":1.1120000000000001,"15min":1.2509999999999999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59699999999999998,"15min":0.68400000000000005},"min":{"1min":0.38100000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.93000000000000005,"5min":0.98199999999999998,"15min":1.4419999999999999},"last":0.59499999999999997}]},{"osd":6,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61399999999999999,"15min":0.66900000000000004},"min":{"1min":0.42299999999999999,"5min":0.40999999999999998,"15min":0.33400000000000002},"max":{"1min":1.0760000000000001,"5min":1.0760000000000001,"15min":1.2949999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.66800000000000004,"15min":0.72899999999999998},"min":{"1min":0.53300000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.159,"5min":1.2529999999999999,"15min":1.3069999999999999},"last":0.70499999999999996}]},{"osd":7,"last update":"Tue Apr 2 07:32:32 2024","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.68000000000000005,"15min":0.75},"min":{"1min":0.443,"5min":0.432,"15min":0.432},"max":{"1min":0.97399999999999998,"5min":1.034,"15min":1.2689999999999999},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.76400000000000001,"15min":0.82299999999999995},"min":{"1min":0.60699999999999998,"5min":0.53100000000000003,"15min":0.52700000000000002},"max":{"1min":1.214,"5min":1.2949999999999999,"15min":1.353},"last":0.753}]}]},{"osd":3,"up_from":13,"seq":55834574988,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1458176,"data_stored":628113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45400000000000001,"15min":0.44700000000000001},"min":{"1min":0.33000000000000002,"5min":0.30199999999999999,"15min":0.26300000000000001},"max":{"1min":0.71199999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48799999999999999,"15min":0.48599999999999999},"min":{"1min":0.34799999999999998,"5min":0.30399999999999999,"15min":0.28699999999999998},"max":{"1min":0.65500000000000003,"5min":0.78400000000000003,"15min":1.0109999999999999},"last":0.36099999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.46400000000000002,"15min":0.45000000000000001},"min":{"1min":0.34899999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.748,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.40600000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52300000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.45200000000000001,"5min":0.378,"15min":0.374},"max":{"1min":0.80400000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.437,"5min":0.35399999999999998,"15min":0.33400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":1.306},"last":0.48499999999999999}]},{"osd":4,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.76000000000000001,"15min":0.747},"min":{"1min":0.55000000000000004,"5min":0.45800000000000002,"15min":0.40500000000000003},"max":{"1min":1.1539999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.78200000000000003,"15min":0.76100000000000001},"min":{"1min":0.64100000000000001,"5min":0.47299999999999998,"15min":0.46500000000000002},"max":{"1min":1.0620000000000001,"5min":1.306,"15min":1.306},"last":0.67500000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78400000000000003,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.502,"15min":0.501},"max":{"1min":1.129,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.78400000000000003,"15min":0.76100000000000001},"min":{"1min":0.59399999999999997,"5min":0.48999999999999999,"15min":0.48899999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.71199999999999997}]},{"osd":6,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.77400000000000002,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.48799999999999999,"15min":0.44500000000000001},"max":{"1min":1.2130000000000001,"5min":1.258,"15min":1.258},"last":0.755},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.80700000000000005,"15min":0.79300000000000004},"min":{"1min":0.627,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2529999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.72499999999999998}]},{"osd":7,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.79100000000000004,"15min":0.76800000000000002},"min":{"1min":0.60199999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.103,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.879,"5min":0.80300000000000005,"15min":0.79400000000000004},"min":{"1min":0.60899999999999999,"5min":0.53100000000000003,"15min":0.47499999999999998},"max":{"1min":1.0860000000000001,"5min":1.1120000000000001,"15min":1.2869999999999999},"last":0.78500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574988,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1441792,"data_stored":626479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46400000000000002,"5min":0.44900000000000001,"15min":0.44800000000000001},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.253},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.79100000000000004},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.499,"15min":0.49299999999999999},"min":{"1min":0.28299999999999997,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.38800000000000001}]},{"osd":1,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52000000000000002,"15min":0.53400000000000003},"min":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.876,"5min":0.876,"15min":1.171},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.50700000000000001,"15min":0.498},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.78500000000000003,"5min":0.83199999999999996,"15min":1.333},"last":0.34499999999999997}]},{"osd":3,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.55300000000000005,"15min":0.52900000000000003},"min":{"1min":0.38100000000000001,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.63,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.44900000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.89800000000000002,"5min":0.90000000000000002,"15min":1.1140000000000001},"last":0.41299999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.751,"15min":0.76500000000000001},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":2.254},"last":0.80600000000000005},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.76500000000000001,"15min":0.76800000000000002},"min":{"1min":0.498,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0740000000000001,"5min":1.1599999999999999,"15min":1.3420000000000001},"last":1.0580000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.76900000000000002,"15min":0.76300000000000001},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.46200000000000002},"max":{"1min":0.996,"5min":1.091,"15min":1.3740000000000001},"last":0.752},{"interface":"front","average":{"1min":0.79200000000000004,"5min":0.78600000000000003,"15min":0.80000000000000004},"min":{"1min":0.60499999999999998,"5min":0.498,"15min":0.443},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":2.0840000000000001},"last":1.042}]},{"osd":6,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.80800000000000005,"15min":0.81999999999999995},"min":{"1min":0.57199999999999995,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.153,"5min":1.1990000000000001,"15min":1.5029999999999999},"last":0.95899999999999996},{"interface":"front","average":{"1min":0.83599999999999997,"5min":0.83499999999999996,"15min":0.82899999999999996},"min":{"1min":0.61099999999999999,"5min":0.58399999999999996,"15min":0.52700000000000002},"max":{"1min":1.159,"5min":1.159,"15min":1.425},"last":0.88200000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:32:28 2024","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.79900000000000004,"15min":0.81699999999999995},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.1779999999999999,"5min":1.1799999999999999,"15min":2.3580000000000001},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.81100000000000005,"15min":0.81899999999999995},"min":{"1min":0.60299999999999998,"5min":0.54400000000000004,"15min":0.54300000000000004},"max":{"1min":1.127,"5min":1.127,"15min":1.377},"last":0.84399999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574987,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32540,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1449984,"data_stored":626603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44900000000000001,"15min":0.45800000000000002},"min":{"1min":0.26500000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.60399999999999998,"5min":0.78600000000000003,"15min":1.2150000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47499999999999998,"15min":0.55300000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.26200000000000001},"max":{"1min":0.64000000000000001,"5min":0.72299999999999998,"15min":4.157},"last":0.317}]},{"osd":2,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48399999999999999,"15min":0.55200000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28999999999999998},"max":{"1min":0.621,"5min":0.67700000000000005,"15min":4.282},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52900000000000003,"15min":0.55900000000000005},"min":{"1min":0.37,"5min":0.35499999999999998,"15min":0.33600000000000002},"max":{"1min":0.78200000000000003,"5min":0.81000000000000005,"15min":1.625},"last":0.55300000000000005}]},{"osd":3,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83799999999999997,"5min":0.88800000000000001,"15min":1.1120000000000001},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54800000000000004,"15min":0.69699999999999995},"min":{"1min":0.35599999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72799999999999998,"5min":0.80600000000000005,"15min":8.1620000000000008},"last":0.67800000000000005}]},{"osd":4,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72199999999999998,"15min":0.82799999999999996},"min":{"1min":0.55100000000000005,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":4.7400000000000002},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.77400000000000002,"15min":0.79200000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.50600000000000001},"max":{"1min":1.123,"5min":1.125,"15min":1.7070000000000001},"last":0.66000000000000003}]},{"osd":5,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76600000000000001,"15min":0.84299999999999997},"min":{"1min":0.52200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.321,"5min":1.321,"15min":4.5759999999999996},"last":0.625},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75800000000000001,"15min":0.84099999999999997},"min":{"1min":0.49099999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":4.7949999999999999},"last":0.52800000000000002}]},{"osd":6,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.77900000000000003,"15min":0.86899999999999999},"min":{"1min":0.59899999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":4.6890000000000001},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77500000000000002,"15min":0.85699999999999998},"min":{"1min":0.51100000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":4.6059999999999999},"last":0.56399999999999995}]},{"osd":7,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78100000000000003,"15min":0.80300000000000005},"min":{"1min":0.58399999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.8759999999999999},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79500000000000004,"15min":0.873},"min":{"1min":0.56499999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.081,"5min":1.157,"15min":4.6420000000000003},"last":0.71799999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574988,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33124,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338716,"statfs":{"total":96636764160,"available":96602845184,"internally_reserved":0,"allocated":2056192,"data_stored":1218523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42799999999999999,"15min":0.44600000000000001},"min":{"1min":0.28299999999999997,"5min":0.27800000000000002,"15min":0.26300000000000001},"max":{"1min":0.54800000000000004,"5min":0.62,"15min":1.48},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.496,"15min":0.503},"min":{"1min":0.41199999999999998,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":1.2330000000000001},"last":0.42299999999999999}]},{"osd":2,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.497,"15min":0.50800000000000001},"min":{"1min":0.40000000000000002,"5min":0.34699999999999998,"15min":0.29099999999999998},"max":{"1min":0.65000000000000002,"5min":0.77800000000000002,"15min":1.3129999999999999},"last":0.437},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.32400000000000001},"max":{"1min":0.69699999999999995,"5min":0.76700000000000002,"15min":0.82599999999999996},"last":0.623}]},{"osd":3,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.46999999999999997,"15min":0.46899999999999997},"min":{"1min":0.33100000000000002,"5min":0.29999999999999999,"15min":0.28199999999999997},"max":{"1min":0.749,"5min":0.82799999999999996,"15min":0.84799999999999998},"last":0.312},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57799999999999996,"15min":0.59699999999999998},"min":{"1min":0.435,"5min":0.42499999999999999,"15min":0.40300000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":1.4430000000000001},"last":0.496}]},{"osd":4,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.745,"15min":0.73999999999999999},"min":{"1min":0.65300000000000002,"5min":0.505,"15min":0.46200000000000002},"max":{"1min":1.0149999999999999,"5min":1.0209999999999999,"15min":1.0569999999999999},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.623,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.93999999999999995,"5min":1.034,"15min":1.1240000000000001},"last":0.46999999999999997}]},{"osd":5,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.59299999999999997,"5min":0.53700000000000003,"15min":0.47599999999999998},"max":{"1min":0.95599999999999996,"5min":1.042,"15min":1.371},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.755,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.56899999999999995,"5min":0.498,"15min":0.498},"max":{"1min":0.89500000000000002,"5min":1.0009999999999999,"15min":1.143},"last":0.48699999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.77500000000000002,"15min":0.78900000000000003},"min":{"1min":0.65100000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.97999999999999998,"5min":1.0409999999999999,"15min":1.177},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.79800000000000004,"15min":0.81899999999999995},"min":{"1min":0.63900000000000001,"5min":0.57099999999999995,"15min":0.52700000000000002},"max":{"1min":0.96099999999999997,"5min":1.081,"15min":1.4099999999999999},"last":0.52700000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.76000000000000001,"15min":0.78000000000000003},"min":{"1min":0.61199999999999999,"5min":0.56100000000000005,"15min":0.54800000000000004},"max":{"1min":0.93400000000000005,"5min":1.028,"15min":1.135},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.76500000000000001,"15min":0.77800000000000002},"min":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.48399999999999999},"max":{"1min":0.92800000000000005,"5min":1.075,"15min":1.141},"last":0.51600000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:33:36.517 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:33:36.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.668+0000 7f169c200640 1 Processor -- start 2024-04-02T07:33:36.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.668+0000 7f169c200640 1 -- start start 2024-04-02T07:33:36.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.668+0000 7f169c200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f169415a480 0x7f16940ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:36.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.668+0000 7f169c200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f16940ca9a0 0x7f16940b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:36.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.668+0000 7f169c200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169415a860 con 0x7f16940b0ea0 2024-04-02T07:33:36.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.668+0000 7f169c200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f169415ce20 con 0x7f169415a480 2024-04-02T07:33:36.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.668+0000 7f169c200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16940cade0 con 0x7f16940ca9a0 2024-04-02T07:33:36.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.668+0000 7f1699800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f169415a480 0x7f16940ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:36.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.668+0000 7f1699800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f169415a480 0x7f16940ca460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60550/0 (socket says 172.21.15.55:60550) 2024-04-02T07:33:36.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.668+0000 7f1699800640 1 -- 172.21.15.55:0/32039307 learned_addr learned my addr 172.21.15.55:0/32039307 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:36.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.668+0000 7f1699800640 1 -- 172.21.15.55:0/32039307 >> v2:172.21.15.106:3300/0 conn(0x7f16940ca9a0 msgr2=0x7f16940b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:36.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.668+0000 7f1698e00640 1 --2- 172.21.15.55:0/32039307 >> v2:172.21.15.106:3300/0 conn(0x7f16940ca9a0 0x7f16940b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:36.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.668+0000 7f1699800640 1 --2- 172.21.15.55:0/32039307 >> v2:172.21.15.106:3300/0 conn(0x7f16940ca9a0 0x7f16940b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:36.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.668+0000 7f1699800640 1 -- 172.21.15.55:0/32039307 >> v1:172.21.15.106:6789/0 conn(0x7f16940b0ea0 legacy=0x7f1694160460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:36.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.668+0000 7f1699800640 1 -- 172.21.15.55:0/32039307 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16940cb570 con 0x7f169415a480 2024-04-02T07:33:36.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.668+0000 7f1698e00640 1 --2- 172.21.15.55:0/32039307 >> v2:172.21.15.106:3300/0 conn(0x7f16940ca9a0 0x7f16940b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:36.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.672+0000 7f1699800640 1 --2- 172.21.15.55:0/32039307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169415a480 0x7f16940ca460 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f169406d470 tx=0x7f168801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c13bcda87589c142 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:36.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.672+0000 7f1693e00640 1 -- 172.21.15.55:0/32039307 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16880ab600 con 0x7f169415a480 2024-04-02T07:33:36.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.672+0000 7f1693e00640 1 -- 172.21.15.55:0/32039307 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16880a7050 con 0x7f169415a480 2024-04-02T07:33:36.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.672+0000 7f1693e00640 1 -- 172.21.15.55:0/32039307 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16880ab980 con 0x7f169415a480 2024-04-02T07:33:36.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.672+0000 7f169c200640 1 -- 172.21.15.55:0/32039307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169415a480 msgr2=0x7f16940ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:36.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.672+0000 7f169c200640 1 --2- 172.21.15.55:0/32039307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169415a480 0x7f16940ca460 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f169406d470 tx=0x7f168801c450 comp rx=0 tx=0).stop 2024-04-02T07:33:36.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.672+0000 7f169c200640 1 -- 172.21.15.55:0/32039307 shutdown_connections 2024-04-02T07:33:36.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.672+0000 7f169c200640 1 --2- 172.21.15.55:0/32039307 >> v2:172.21.15.106:3300/0 conn(0x7f16940ca9a0 0x7f16940b0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:36.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.672+0000 7f169c200640 1 --2- 172.21.15.55:0/32039307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f169415a480 0x7f16940ca460 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:36.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.672+0000 7f169c200640 1 -- 172.21.15.55:0/32039307 >> 172.21.15.55:0/32039307 conn(0x7f1694066080 msgr2=0x7f1694069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:36.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.672+0000 7f169c200640 1 -- 172.21.15.55:0/32039307 shutdown_connections 2024-04-02T07:33:36.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.672+0000 7f169c200640 1 -- 172.21.15.55:0/32039307 wait complete. 2024-04-02T07:33:36.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f169c200640 1 Processor -- start 2024-04-02T07:33:36.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f169c200640 1 -- start start 2024-04-02T07:33:36.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f169c200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16940b0ea0 0x7f16940b1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:36.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f169c200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16940ca9a0 0x7f169415f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:36.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f169c200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f169415a480 0x7f1694145fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f169c200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1694147120 con 0x7f16940b0ea0 2024-04-02T07:33:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f169c200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169415b8f0 con 0x7f169415a480 2024-04-02T07:33:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f169c200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f169415bbd0 con 0x7f16940ca9a0 2024-04-02T07:33:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f1699800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16940b0ea0 0x7f16940b1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f1699800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16940b0ea0 0x7f16940b1ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60556/0 (socket says 172.21.15.55:60556) 2024-04-02T07:33:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f1699800640 1 -- 172.21.15.55:0/285691062 learned_addr learned my addr 172.21.15.55:0/285691062 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f1698e00640 1 --2- 172.21.15.55:0/285691062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16940ca9a0 0x7f169415f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f169a200640 1 --2- 172.21.15.55:0/285691062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f169415a480 0x7f1694145fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f1699800640 1 -- 172.21.15.55:0/285691062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16940ca9a0 msgr2=0x7f169415f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f1699800640 1 --2- 172.21.15.55:0/285691062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16940ca9a0 0x7f169415f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f1699800640 1 -- 172.21.15.55:0/285691062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f169415a480 msgr2=0x7f1694145fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f1699800640 1 --2- 172.21.15.55:0/285691062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f169415a480 0x7f1694145fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f1699800640 1 -- 172.21.15.55:0/285691062 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16880094d0 con 0x7f16940b0ea0 2024-04-02T07:33:36.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f1699800640 1 --2- 172.21.15.55:0/285691062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16940b0ea0 0x7f16940b1ea0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f16880ae040 tx=0x7f16880191f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f1691600640 1 -- 172.21.15.55:0/285691062 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16880b4850 con 0x7f16940b0ea0 2024-04-02T07:33:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f1691600640 1 -- 172.21.15.55:0/285691062 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16880b49d0 con 0x7f16940b0ea0 2024-04-02T07:33:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f169c200640 1 -- 172.21.15.55:0/285691062 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f169415beb0 con 0x7f16940b0ea0 2024-04-02T07:33:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f1691600640 1 -- 172.21.15.55:0/285691062 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16880b4d80 con 0x7f16940b0ea0 2024-04-02T07:33:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.676+0000 7f169c200640 1 -- 172.21.15.55:0/285691062 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16940b23e0 con 0x7f16940b0ea0 2024-04-02T07:33:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.680+0000 7f169c200640 1 -- 172.21.15.55:0/285691062 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1694146f80 con 0x7f16940b0ea0 2024-04-02T07:33:36.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.680+0000 7f1691600640 1 -- 172.21.15.55:0/285691062 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f16880b2070 con 0x7f16940b0ea0 2024-04-02T07:33:36.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.680+0000 7f1691600640 1 --2- 172.21.15.55:0/285691062 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1674066690 0x7f1674068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:36.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.680+0000 7f1691600640 1 -- 172.21.15.55:0/285691062 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f168811e1f0 con 0x7f16940b0ea0 2024-04-02T07:33:36.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.680+0000 7f1698e00640 1 --2- 172.21.15.55:0/285691062 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1674066690 0x7f1674068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:36.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.680+0000 7f1698e00640 1 --2- 172.21.15.55:0/285691062 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1674066690 0x7f1674068b50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f168000a9a0 tx=0x7f1680008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:36.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.684+0000 7f1691600640 1 -- 172.21.15.55:0/285691062 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f1694146f80 con 0x7f16940b0ea0 2024-04-02T07:33:36.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.840+0000 7f169c200640 1 -- 172.21.15.55:0/285691062 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f169415d900 con 0x7f1674066690 2024-04-02T07:33:36.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.848+0000 7f1691600640 1 -- 172.21.15.55:0/285691062 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289636 (secure 0 0 0) 0x7f168000a720 con 0x7f1674066690 2024-04-02T07:33:36.854 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:36.856 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:33:36.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.852+0000 7f169c200640 1 -- 172.21.15.55:0/285691062 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1674066690 msgr2=0x7f1674068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:36.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.852+0000 7f169c200640 1 --2- 172.21.15.55:0/285691062 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1674066690 0x7f1674068b50 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f168000a9a0 tx=0x7f1680008040 comp rx=0 tx=0).stop 2024-04-02T07:33:36.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.852+0000 7f169c200640 1 -- 172.21.15.55:0/285691062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16940b0ea0 msgr2=0x7f16940b1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:36.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.852+0000 7f169c200640 1 --2- 172.21.15.55:0/285691062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16940b0ea0 0x7f16940b1ea0 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f16880ae040 tx=0x7f16880191f0 comp rx=0 tx=0).stop 2024-04-02T07:33:36.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.852+0000 7f169c200640 1 -- 172.21.15.55:0/285691062 shutdown_connections 2024-04-02T07:33:36.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.852+0000 7f169c200640 1 --2- 172.21.15.55:0/285691062 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1674066690 0x7f1674068b50 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:36.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.852+0000 7f169c200640 1 --2- 172.21.15.55:0/285691062 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f169415a480 0x7f1694145fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:36.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.852+0000 7f169c200640 1 --2- 172.21.15.55:0/285691062 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f16940ca9a0 0x7f169415f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:36.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.852+0000 7f169c200640 1 --2- 172.21.15.55:0/285691062 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f16940b0ea0 0x7f16940b1ea0 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:36.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.852+0000 7f169c200640 1 -- 172.21.15.55:0/285691062 >> 172.21.15.55:0/285691062 conn(0x7f1694066080 msgr2=0x7f1694153770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:36.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.852+0000 7f169c200640 1 -- 172.21.15.55:0/285691062 shutdown_connections 2024-04-02T07:33:36.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:36.852+0000 7f169c200640 1 -- 172.21.15.55:0/285691062 wait complete. 2024-04-02T07:33:36.874 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":454,"stamp":"2024-04-02T07:33:36.506914+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":261464,"kb_used_data":12488,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754713256,"statfs":{"total":773094113280,"available":772826374144,"internally_reserved":0,"allocated":12787712,"data_stored":6197292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.648839"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711677+0000","last_change":"2024-04-02T07:33:27.882595+0000","last_active":"2024-04-02T07:33:29.711677+0000","last_peered":"2024-04-02T07:33:29.711677+0000","last_clean":"2024-04-02T07:33:29.711677+0000","last_became_active":"2024-04-02T07:33:27.882331+0000","last_became_peered":"2024-04-02T07:33:27.882331+0000","last_unstale":"2024-04-02T07:33:29.711677+0000","last_undegraded":"2024-04-02T07:33:29.711677+0000","last_fullsized":"2024-04-02T07:33:29.711677+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:44:26.449539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.861038+0000","last_change":"2024-04-02T07:33:27.869951+0000","last_active":"2024-04-02T07:33:28.861038+0000","last_peered":"2024-04-02T07:33:28.861038+0000","last_clean":"2024-04-02T07:33:28.861038+0000","last_became_active":"2024-04-02T07:33:27.869579+0000","last_became_peered":"2024-04-02T07:33:27.869579+0000","last_unstale":"2024-04-02T07:33:28.861038+0000","last_undegraded":"2024-04-02T07:33:28.861038+0000","last_fullsized":"2024-04-02T07:33:28.861038+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:08:48.680568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714760+0000","last_change":"2024-04-02T07:33:27.877522+0000","last_active":"2024-04-02T07:33:29.714760+0000","last_peered":"2024-04-02T07:33:29.714760+0000","last_clean":"2024-04-02T07:33:29.714760+0000","last_became_active":"2024-04-02T07:33:27.876088+0000","last_became_peered":"2024-04-02T07:33:27.876088+0000","last_unstale":"2024-04-02T07:33:29.714760+0000","last_undegraded":"2024-04-02T07:33:29.714760+0000","last_fullsized":"2024-04-02T07:33:29.714760+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:08:39.323055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711842+0000","last_change":"2024-04-02T07:33:27.875231+0000","last_active":"2024-04-02T07:33:29.711842+0000","last_peered":"2024-04-02T07:33:29.711842+0000","last_clean":"2024-04-02T07:33:29.711842+0000","last_became_active":"2024-04-02T07:33:27.874506+0000","last_became_peered":"2024-04-02T07:33:27.874506+0000","last_unstale":"2024-04-02T07:33:29.711842+0000","last_undegraded":"2024-04-02T07:33:29.711842+0000","last_fullsized":"2024-04-02T07:33:29.711842+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:15:11.171684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857023+0000","last_change":"2024-04-02T07:33:27.871285+0000","last_active":"2024-04-02T07:33:28.857023+0000","last_peered":"2024-04-02T07:33:28.857023+0000","last_clean":"2024-04-02T07:33:28.857023+0000","last_became_active":"2024-04-02T07:33:27.871038+0000","last_became_peered":"2024-04-02T07:33:27.871038+0000","last_unstale":"2024-04-02T07:33:28.857023+0000","last_undegraded":"2024-04-02T07:33:28.857023+0000","last_fullsized":"2024-04-02T07:33:28.857023+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:49:08.367496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.210936+0000","last_change":"2024-04-02T07:33:27.876121+0000","last_active":"2024-04-02T07:33:29.210936+0000","last_peered":"2024-04-02T07:33:29.210936+0000","last_clean":"2024-04-02T07:33:29.210936+0000","last_became_active":"2024-04-02T07:33:27.875832+0000","last_became_peered":"2024-04-02T07:33:27.875832+0000","last_unstale":"2024-04-02T07:33:29.210936+0000","last_undegraded":"2024-04-02T07:33:29.210936+0000","last_fullsized":"2024-04-02T07:33:29.210936+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:12:14.480598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413346+0000","last_change":"2024-04-02T07:33:27.879609+0000","last_active":"2024-04-02T07:33:29.413346+0000","last_peered":"2024-04-02T07:33:29.413346+0000","last_clean":"2024-04-02T07:33:29.413346+0000","last_became_active":"2024-04-02T07:33:27.878988+0000","last_became_peered":"2024-04-02T07:33:27.878988+0000","last_unstale":"2024-04-02T07:33:29.413346+0000","last_undegraded":"2024-04-02T07:33:29.413346+0000","last_fullsized":"2024-04-02T07:33:29.413346+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:46:59.020865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714533+0000","last_change":"2024-04-02T07:33:27.876286+0000","last_active":"2024-04-02T07:33:29.714533+0000","last_peered":"2024-04-02T07:33:29.714533+0000","last_clean":"2024-04-02T07:33:29.714533+0000","last_became_active":"2024-04-02T07:33:27.875717+0000","last_became_peered":"2024-04-02T07:33:27.875717+0000","last_unstale":"2024-04-02T07:33:29.714533+0000","last_undegraded":"2024-04-02T07:33:29.714533+0000","last_fullsized":"2024-04-02T07:33:29.714533+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:05.978066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711733+0000","last_change":"2024-04-02T07:33:27.880196+0000","last_active":"2024-04-02T07:33:29.711733+0000","last_peered":"2024-04-02T07:33:29.711733+0000","last_clean":"2024-04-02T07:33:29.711733+0000","last_became_active":"2024-04-02T07:33:27.877656+0000","last_became_peered":"2024-04-02T07:33:27.877656+0000","last_unstale":"2024-04-02T07:33:29.711733+0000","last_undegraded":"2024-04-02T07:33:29.711733+0000","last_fullsized":"2024-04-02T07:33:29.711733+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:19:08.049991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711715+0000","last_change":"2024-04-02T07:33:27.869017+0000","last_active":"2024-04-02T07:33:29.711715+0000","last_peered":"2024-04-02T07:33:29.711715+0000","last_clean":"2024-04-02T07:33:29.711715+0000","last_became_active":"2024-04-02T07:33:27.868286+0000","last_became_peered":"2024-04-02T07:33:27.868286+0000","last_unstale":"2024-04-02T07:33:29.711715+0000","last_undegraded":"2024-04-02T07:33:29.711715+0000","last_fullsized":"2024-04-02T07:33:29.711715+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:45:02.593548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860916+0000","last_change":"2024-04-02T07:33:27.882601+0000","last_active":"2024-04-02T07:33:28.860916+0000","last_peered":"2024-04-02T07:33:28.860916+0000","last_clean":"2024-04-02T07:33:28.860916+0000","last_became_active":"2024-04-02T07:33:27.882352+0000","last_became_peered":"2024-04-02T07:33:27.882352+0000","last_unstale":"2024-04-02T07:33:28.860916+0000","last_undegraded":"2024-04-02T07:33:28.860916+0000","last_fullsized":"2024-04-02T07:33:28.860916+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:42:59.489339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711840+0000","last_change":"2024-04-02T07:33:27.874378+0000","last_active":"2024-04-02T07:33:29.711840+0000","last_peered":"2024-04-02T07:33:29.711840+0000","last_clean":"2024-04-02T07:33:29.711840+0000","last_became_active":"2024-04-02T07:33:27.873619+0000","last_became_peered":"2024-04-02T07:33:27.873619+0000","last_unstale":"2024-04-02T07:33:29.711840+0000","last_undegraded":"2024-04-02T07:33:29.711840+0000","last_fullsized":"2024-04-02T07:33:29.711840+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:09:32.458968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714766+0000","last_change":"2024-04-02T07:33:27.875814+0000","last_active":"2024-04-02T07:33:29.714766+0000","last_peered":"2024-04-02T07:33:29.714766+0000","last_clean":"2024-04-02T07:33:29.714766+0000","last_became_active":"2024-04-02T07:33:27.874810+0000","last_became_peered":"2024-04-02T07:33:27.874810+0000","last_unstale":"2024-04-02T07:33:29.714766+0000","last_undegraded":"2024-04-02T07:33:29.714766+0000","last_fullsized":"2024-04-02T07:33:29.714766+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:47:01.625875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714540+0000","last_change":"2024-04-02T07:33:27.884371+0000","last_active":"2024-04-02T07:33:29.714540+0000","last_peered":"2024-04-02T07:33:29.714540+0000","last_clean":"2024-04-02T07:33:29.714540+0000","last_became_active":"2024-04-02T07:33:27.884131+0000","last_became_peered":"2024-04-02T07:33:27.884131+0000","last_unstale":"2024-04-02T07:33:29.714540+0000","last_undegraded":"2024-04-02T07:33:29.714540+0000","last_fullsized":"2024-04-02T07:33:29.714540+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:45:56.636391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.210851+0000","last_change":"2024-04-02T07:33:27.877545+0000","last_active":"2024-04-02T07:33:29.210851+0000","last_peered":"2024-04-02T07:33:29.210851+0000","last_clean":"2024-04-02T07:33:29.210851+0000","last_became_active":"2024-04-02T07:33:27.877273+0000","last_became_peered":"2024-04-02T07:33:27.877273+0000","last_unstale":"2024-04-02T07:33:29.210851+0000","last_undegraded":"2024-04-02T07:33:29.210851+0000","last_fullsized":"2024-04-02T07:33:29.210851+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:52:13.075492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711236+0000","last_change":"2024-04-02T07:33:27.876720+0000","last_active":"2024-04-02T07:33:29.711236+0000","last_peered":"2024-04-02T07:33:29.711236+0000","last_clean":"2024-04-02T07:33:29.711236+0000","last_became_active":"2024-04-02T07:33:27.876330+0000","last_became_peered":"2024-04-02T07:33:27.876330+0000","last_unstale":"2024-04-02T07:33:29.711236+0000","last_undegraded":"2024-04-02T07:33:29.711236+0000","last_fullsized":"2024-04-02T07:33:29.711236+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:15:51.484030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860989+0000","last_change":"2024-04-02T07:33:27.884195+0000","last_active":"2024-04-02T07:33:28.860989+0000","last_peered":"2024-04-02T07:33:28.860989+0000","last_clean":"2024-04-02T07:33:28.860989+0000","last_became_active":"2024-04-02T07:33:27.883925+0000","last_became_peered":"2024-04-02T07:33:27.883925+0000","last_unstale":"2024-04-02T07:33:28.860989+0000","last_undegraded":"2024-04-02T07:33:28.860989+0000","last_fullsized":"2024-04-02T07:33:28.860989+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:24:38.502056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.507576+0000","last_change":"2024-04-02T07:33:27.880520+0000","last_active":"2024-04-02T07:33:29.507576+0000","last_peered":"2024-04-02T07:33:29.507576+0000","last_clean":"2024-04-02T07:33:29.507576+0000","last_became_active":"2024-04-02T07:33:27.879592+0000","last_became_peered":"2024-04-02T07:33:27.879592+0000","last_unstale":"2024-04-02T07:33:29.507576+0000","last_undegraded":"2024-04-02T07:33:29.507576+0000","last_fullsized":"2024-04-02T07:33:29.507576+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:42:59.489339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714842+0000","last_change":"2024-04-02T07:33:27.877703+0000","last_active":"2024-04-02T07:33:29.714842+0000","last_peered":"2024-04-02T07:33:29.714842+0000","last_clean":"2024-04-02T07:33:29.714842+0000","last_became_active":"2024-04-02T07:33:27.876491+0000","last_became_peered":"2024-04-02T07:33:27.876491+0000","last_unstale":"2024-04-02T07:33:29.714842+0000","last_undegraded":"2024-04-02T07:33:29.714842+0000","last_fullsized":"2024-04-02T07:33:29.714842+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:22:10.905772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.861137+0000","last_change":"2024-04-02T07:33:27.875061+0000","last_active":"2024-04-02T07:33:28.861137+0000","last_peered":"2024-04-02T07:33:28.861137+0000","last_clean":"2024-04-02T07:33:28.861137+0000","last_became_active":"2024-04-02T07:33:27.873808+0000","last_became_peered":"2024-04-02T07:33:27.873808+0000","last_unstale":"2024-04-02T07:33:28.861137+0000","last_undegraded":"2024-04-02T07:33:28.861137+0000","last_fullsized":"2024-04-02T07:33:28.861137+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:07:35.756044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860959+0000","last_change":"2024-04-02T07:33:27.874169+0000","last_active":"2024-04-02T07:33:28.860959+0000","last_peered":"2024-04-02T07:33:28.860959+0000","last_clean":"2024-04-02T07:33:28.860959+0000","last_became_active":"2024-04-02T07:33:27.873870+0000","last_became_peered":"2024-04-02T07:33:27.873870+0000","last_unstale":"2024-04-02T07:33:28.860959+0000","last_undegraded":"2024-04-02T07:33:28.860959+0000","last_fullsized":"2024-04-02T07:33:28.860959+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:04:12.160313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857812+0000","last_change":"2024-04-02T07:33:27.877812+0000","last_active":"2024-04-02T07:33:28.857812+0000","last_peered":"2024-04-02T07:33:28.857812+0000","last_clean":"2024-04-02T07:33:28.857812+0000","last_became_active":"2024-04-02T07:33:27.877587+0000","last_became_peered":"2024-04-02T07:33:27.877587+0000","last_unstale":"2024-04-02T07:33:28.857812+0000","last_undegraded":"2024-04-02T07:33:28.857812+0000","last_fullsized":"2024-04-02T07:33:28.857812+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:56:03.473104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860474+0000","last_change":"2024-04-02T07:33:27.873484+0000","last_active":"2024-04-02T07:33:28.860474+0000","last_peered":"2024-04-02T07:33:28.860474+0000","last_clean":"2024-04-02T07:33:28.860474+0000","last_became_active":"2024-04-02T07:33:27.873191+0000","last_became_peered":"2024-04-02T07:33:27.873191+0000","last_unstale":"2024-04-02T07:33:28.860474+0000","last_undegraded":"2024-04-02T07:33:28.860474+0000","last_fullsized":"2024-04-02T07:33:28.860474+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:42:58.494573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857717+0000","last_change":"2024-04-02T07:33:27.876890+0000","last_active":"2024-04-02T07:33:28.857717+0000","last_peered":"2024-04-02T07:33:28.857717+0000","last_clean":"2024-04-02T07:33:28.857717+0000","last_became_active":"2024-04-02T07:33:27.876595+0000","last_became_peered":"2024-04-02T07:33:27.876595+0000","last_unstale":"2024-04-02T07:33:28.857717+0000","last_undegraded":"2024-04-02T07:33:28.857717+0000","last_fullsized":"2024-04-02T07:33:28.857717+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:44:30.290566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.861036+0000","last_change":"2024-04-02T07:33:27.883804+0000","last_active":"2024-04-02T07:33:28.861036+0000","last_peered":"2024-04-02T07:33:28.861036+0000","last_clean":"2024-04-02T07:33:28.861036+0000","last_became_active":"2024-04-02T07:33:27.883536+0000","last_became_peered":"2024-04-02T07:33:27.883536+0000","last_unstale":"2024-04-02T07:33:28.861036+0000","last_undegraded":"2024-04-02T07:33:28.861036+0000","last_fullsized":"2024-04-02T07:33:28.861036+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:24:35.699323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711791+0000","last_change":"2024-04-02T07:33:27.873296+0000","last_active":"2024-04-02T07:33:29.711791+0000","last_peered":"2024-04-02T07:33:29.711791+0000","last_clean":"2024-04-02T07:33:29.711791+0000","last_became_active":"2024-04-02T07:33:27.872968+0000","last_became_peered":"2024-04-02T07:33:27.872968+0000","last_unstale":"2024-04-02T07:33:29.711791+0000","last_undegraded":"2024-04-02T07:33:29.711791+0000","last_fullsized":"2024-04-02T07:33:29.711791+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:54:29.292390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.211116+0000","last_change":"2024-04-02T07:33:27.868594+0000","last_active":"2024-04-02T07:33:29.211116+0000","last_peered":"2024-04-02T07:33:29.211116+0000","last_clean":"2024-04-02T07:33:29.211116+0000","last_became_active":"2024-04-02T07:33:27.867037+0000","last_became_peered":"2024-04-02T07:33:27.867037+0000","last_unstale":"2024-04-02T07:33:29.211116+0000","last_undegraded":"2024-04-02T07:33:29.211116+0000","last_fullsized":"2024-04-02T07:33:29.211116+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:37:18.608010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857926+0000","last_change":"2024-04-02T07:33:27.877779+0000","last_active":"2024-04-02T07:33:28.857926+0000","last_peered":"2024-04-02T07:33:28.857926+0000","last_clean":"2024-04-02T07:33:28.857926+0000","last_became_active":"2024-04-02T07:33:27.877522+0000","last_became_peered":"2024-04-02T07:33:27.877522+0000","last_unstale":"2024-04-02T07:33:28.857926+0000","last_undegraded":"2024-04-02T07:33:28.857926+0000","last_fullsized":"2024-04-02T07:33:28.857926+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:42:36.055385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860478+0000","last_change":"2024-04-02T07:33:27.872398+0000","last_active":"2024-04-02T07:33:28.860478+0000","last_peered":"2024-04-02T07:33:28.860478+0000","last_clean":"2024-04-02T07:33:28.860478+0000","last_became_active":"2024-04-02T07:33:27.872153+0000","last_became_peered":"2024-04-02T07:33:27.872153+0000","last_unstale":"2024-04-02T07:33:28.860478+0000","last_undegraded":"2024-04-02T07:33:28.860478+0000","last_fullsized":"2024-04-02T07:33:28.860478+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:05.978066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413563+0000","last_change":"2024-04-02T07:33:27.877534+0000","last_active":"2024-04-02T07:33:29.413563+0000","last_peered":"2024-04-02T07:33:29.413563+0000","last_clean":"2024-04-02T07:33:29.413563+0000","last_became_active":"2024-04-02T07:33:27.874093+0000","last_became_peered":"2024-04-02T07:33:27.874093+0000","last_unstale":"2024-04-02T07:33:29.413563+0000","last_undegraded":"2024-04-02T07:33:29.413563+0000","last_fullsized":"2024-04-02T07:33:29.413563+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:07.305572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711292+0000","last_change":"2024-04-02T07:33:27.872336+0000","last_active":"2024-04-02T07:33:29.711292+0000","last_peered":"2024-04-02T07:33:29.711292+0000","last_clean":"2024-04-02T07:33:29.711292+0000","last_became_active":"2024-04-02T07:33:27.872061+0000","last_became_peered":"2024-04-02T07:33:27.872061+0000","last_unstale":"2024-04-02T07:33:29.711292+0000","last_undegraded":"2024-04-02T07:33:29.711292+0000","last_fullsized":"2024-04-02T07:33:29.711292+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T16:16:52.197373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.210854+0000","last_change":"2024-04-02T07:33:27.875893+0000","last_active":"2024-04-02T07:33:29.210854+0000","last_peered":"2024-04-02T07:33:29.210854+0000","last_clean":"2024-04-02T07:33:29.210854+0000","last_became_active":"2024-04-02T07:33:27.875615+0000","last_became_peered":"2024-04-02T07:33:27.875615+0000","last_unstale":"2024-04-02T07:33:29.210854+0000","last_undegraded":"2024-04-02T07:33:29.210854+0000","last_fullsized":"2024-04-02T07:33:29.210854+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:56:29.935329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.211275+0000","last_change":"2024-04-02T07:33:27.866086+0000","last_active":"2024-04-02T07:33:29.211275+0000","last_peered":"2024-04-02T07:33:29.211275+0000","last_clean":"2024-04-02T07:33:29.211275+0000","last_became_active":"2024-04-02T07:33:27.865799+0000","last_became_peered":"2024-04-02T07:33:27.865799+0000","last_unstale":"2024-04-02T07:33:29.211275+0000","last_undegraded":"2024-04-02T07:33:29.211275+0000","last_fullsized":"2024-04-02T07:33:29.211275+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:49:55.405575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"115'4","reported_seq":15,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413536+0000","last_change":"2024-04-02T07:33:27.465580+0000","last_active":"2024-04-02T07:33:29.413536+0000","last_peered":"2024-04-02T07:33:29.413536+0000","last_clean":"2024-04-02T07:33:29.413536+0000","last_became_active":"2024-04-02T07:33:27.465317+0000","last_became_peered":"2024-04-02T07:33:27.465317+0000","last_unstale":"2024-04-02T07:33:29.413536+0000","last_undegraded":"2024-04-02T07:33:29.413536+0000","last_fullsized":"2024-04-02T07:33:29.413536+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:53:49.973543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.507596+0000","last_change":"2024-04-02T07:33:27.882689+0000","last_active":"2024-04-02T07:33:29.507596+0000","last_peered":"2024-04-02T07:33:29.507596+0000","last_clean":"2024-04-02T07:33:29.507596+0000","last_became_active":"2024-04-02T07:33:27.882354+0000","last_became_peered":"2024-04-02T07:33:27.882354+0000","last_unstale":"2024-04-02T07:33:29.507596+0000","last_undegraded":"2024-04-02T07:33:29.507596+0000","last_fullsized":"2024-04-02T07:33:29.507596+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:24:38.502056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"115'1","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714897+0000","last_change":"2024-04-02T07:33:27.466340+0000","last_active":"2024-04-02T07:33:29.714897+0000","last_peered":"2024-04-02T07:33:29.714897+0000","last_clean":"2024-04-02T07:33:29.714897+0000","last_became_active":"2024-04-02T07:33:27.466039+0000","last_became_peered":"2024-04-02T07:33:27.466039+0000","last_unstale":"2024-04-02T07:33:29.714897+0000","last_undegraded":"2024-04-02T07:33:29.714897+0000","last_fullsized":"2024-04-02T07:33:29.714897+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:37:17.604375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.211070+0000","last_change":"2024-04-02T07:33:27.876858+0000","last_active":"2024-04-02T07:33:29.211070+0000","last_peered":"2024-04-02T07:33:29.211070+0000","last_clean":"2024-04-02T07:33:29.211070+0000","last_became_active":"2024-04-02T07:33:27.876598+0000","last_became_peered":"2024-04-02T07:33:27.876598+0000","last_unstale":"2024-04-02T07:33:29.211070+0000","last_undegraded":"2024-04-02T07:33:29.211070+0000","last_fullsized":"2024-04-02T07:33:29.211070+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:30:56.102859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"115'2","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.856911+0000","last_change":"2024-04-02T07:33:27.456721+0000","last_active":"2024-04-02T07:33:28.856911+0000","last_peered":"2024-04-02T07:33:28.856911+0000","last_clean":"2024-04-02T07:33:28.856911+0000","last_became_active":"2024-04-02T07:33:27.456469+0000","last_became_peered":"2024-04-02T07:33:27.456469+0000","last_unstale":"2024-04-02T07:33:28.856911+0000","last_undegraded":"2024-04-02T07:33:28.856911+0000","last_fullsized":"2024-04-02T07:33:28.856911+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:04:38.980893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714885+0000","last_change":"2024-04-02T07:33:27.880030+0000","last_active":"2024-04-02T07:33:29.714885+0000","last_peered":"2024-04-02T07:33:29.714885+0000","last_clean":"2024-04-02T07:33:29.714885+0000","last_became_active":"2024-04-02T07:33:27.876829+0000","last_became_peered":"2024-04-02T07:33:27.876829+0000","last_unstale":"2024-04-02T07:33:29.714885+0000","last_undegraded":"2024-04-02T07:33:29.714885+0000","last_fullsized":"2024-04-02T07:33:29.714885+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:37:58.952494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"115'2","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.856780+0000","last_change":"2024-04-02T07:33:27.459863+0000","last_active":"2024-04-02T07:33:28.856780+0000","last_peered":"2024-04-02T07:33:28.856780+0000","last_clean":"2024-04-02T07:33:28.856780+0000","last_became_active":"2024-04-02T07:33:27.458908+0000","last_became_peered":"2024-04-02T07:33:27.458908+0000","last_unstale":"2024-04-02T07:33:28.856780+0000","last_undegraded":"2024-04-02T07:33:28.856780+0000","last_fullsized":"2024-04-02T07:33:28.856780+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:54:43.407165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711388+0000","last_change":"2024-04-02T07:33:27.881505+0000","last_active":"2024-04-02T07:33:29.711388+0000","last_peered":"2024-04-02T07:33:29.711388+0000","last_clean":"2024-04-02T07:33:29.711388+0000","last_became_active":"2024-04-02T07:33:27.881255+0000","last_became_peered":"2024-04-02T07:33:27.881255+0000","last_unstale":"2024-04-02T07:33:29.711388+0000","last_undegraded":"2024-04-02T07:33:29.711388+0000","last_fullsized":"2024-04-02T07:33:29.711388+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:12:23.501513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"115'1","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413467+0000","last_change":"2024-04-02T07:33:27.464628+0000","last_active":"2024-04-02T07:33:29.413467+0000","last_peered":"2024-04-02T07:33:29.413467+0000","last_clean":"2024-04-02T07:33:29.413467+0000","last_became_active":"2024-04-02T07:33:27.464228+0000","last_became_peered":"2024-04-02T07:33:27.464228+0000","last_unstale":"2024-04-02T07:33:29.413467+0000","last_undegraded":"2024-04-02T07:33:29.413467+0000","last_fullsized":"2024-04-02T07:33:29.413467+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:07:36.248518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860597+0000","last_change":"2024-04-02T07:33:27.875788+0000","last_active":"2024-04-02T07:33:28.860597+0000","last_peered":"2024-04-02T07:33:28.860597+0000","last_clean":"2024-04-02T07:33:28.860597+0000","last_became_active":"2024-04-02T07:33:27.875532+0000","last_became_peered":"2024-04-02T07:33:27.875532+0000","last_unstale":"2024-04-02T07:33:28.860597+0000","last_undegraded":"2024-04-02T07:33:28.860597+0000","last_fullsized":"2024-04-02T07:33:28.860597+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:44:30.553371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"115'1","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.880920+0000","last_change":"2024-04-02T07:33:27.464579+0000","last_active":"2024-04-02T07:33:27.880920+0000","last_peered":"2024-04-02T07:33:27.880920+0000","last_clean":"2024-04-02T07:33:27.880920+0000","last_became_active":"2024-04-02T07:33:27.464321+0000","last_became_peered":"2024-04-02T07:33:27.464321+0000","last_unstale":"2024-04-02T07:33:27.880920+0000","last_undegraded":"2024-04-02T07:33:27.880920+0000","last_fullsized":"2024-04-02T07:33:27.880920+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:08:56.569092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711234+0000","last_change":"2024-04-02T07:33:27.876563+0000","last_active":"2024-04-02T07:33:29.711234+0000","last_peered":"2024-04-02T07:33:29.711234+0000","last_clean":"2024-04-02T07:33:29.711234+0000","last_became_active":"2024-04-02T07:33:27.875714+0000","last_became_peered":"2024-04-02T07:33:27.875714+0000","last_unstale":"2024-04-02T07:33:29.711234+0000","last_undegraded":"2024-04-02T07:33:29.711234+0000","last_fullsized":"2024-04-02T07:33:29.711234+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:04:00.348795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.859908+0000","last_change":"2024-04-02T07:33:27.462628+0000","last_active":"2024-04-02T07:33:27.859908+0000","last_peered":"2024-04-02T07:33:27.859908+0000","last_clean":"2024-04-02T07:33:27.859908+0000","last_became_active":"2024-04-02T07:33:27.462346+0000","last_became_peered":"2024-04-02T07:33:27.462346+0000","last_unstale":"2024-04-02T07:33:27.859908+0000","last_undegraded":"2024-04-02T07:33:27.859908+0000","last_fullsized":"2024-04-02T07:33:27.859908+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:21.236879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413277+0000","last_change":"2024-04-02T07:33:27.879776+0000","last_active":"2024-04-02T07:33:29.413277+0000","last_peered":"2024-04-02T07:33:29.413277+0000","last_clean":"2024-04-02T07:33:29.413277+0000","last_became_active":"2024-04-02T07:33:27.879358+0000","last_became_peered":"2024-04-02T07:33:27.879358+0000","last_unstale":"2024-04-02T07:33:29.413277+0000","last_undegraded":"2024-04-02T07:33:29.413277+0000","last_fullsized":"2024-04-02T07:33:29.413277+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:12:22.240514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711359+0000","last_change":"2024-04-02T07:33:27.470673+0000","last_active":"2024-04-02T07:33:29.711359+0000","last_peered":"2024-04-02T07:33:29.711359+0000","last_clean":"2024-04-02T07:33:29.711359+0000","last_became_active":"2024-04-02T07:33:27.470329+0000","last_became_peered":"2024-04-02T07:33:27.470329+0000","last_unstale":"2024-04-02T07:33:29.711359+0000","last_undegraded":"2024-04-02T07:33:29.711359+0000","last_fullsized":"2024-04-02T07:33:29.711359+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:45:55.632756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413598+0000","last_change":"2024-04-02T07:33:27.877334+0000","last_active":"2024-04-02T07:33:29.413598+0000","last_peered":"2024-04-02T07:33:29.413598+0000","last_clean":"2024-04-02T07:33:29.413598+0000","last_became_active":"2024-04-02T07:33:27.877064+0000","last_became_peered":"2024-04-02T07:33:27.877064+0000","last_unstale":"2024-04-02T07:33:29.413598+0000","last_undegraded":"2024-04-02T07:33:29.413598+0000","last_fullsized":"2024-04-02T07:33:29.413598+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:25:29.754251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.856687+0000","last_change":"2024-04-02T07:33:27.461888+0000","last_active":"2024-04-02T07:33:28.856687+0000","last_peered":"2024-04-02T07:33:28.856687+0000","last_clean":"2024-04-02T07:33:28.856687+0000","last_became_active":"2024-04-02T07:33:27.461640+0000","last_became_peered":"2024-04-02T07:33:27.461640+0000","last_unstale":"2024-04-02T07:33:28.856687+0000","last_undegraded":"2024-04-02T07:33:28.856687+0000","last_fullsized":"2024-04-02T07:33:28.856687+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:26:29.689361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.507698+0000","last_change":"2024-04-02T07:33:27.882054+0000","last_active":"2024-04-02T07:33:29.507698+0000","last_peered":"2024-04-02T07:33:29.507698+0000","last_clean":"2024-04-02T07:33:29.507698+0000","last_became_active":"2024-04-02T07:33:27.881385+0000","last_became_peered":"2024-04-02T07:33:27.881385+0000","last_unstale":"2024-04-02T07:33:29.507698+0000","last_undegraded":"2024-04-02T07:33:29.507698+0000","last_fullsized":"2024-04-02T07:33:29.507698+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:07:35.756044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.866811+0000","last_change":"2024-04-02T07:33:27.464819+0000","last_active":"2024-04-02T07:33:27.866811+0000","last_peered":"2024-04-02T07:33:27.866811+0000","last_clean":"2024-04-02T07:33:27.866811+0000","last_became_active":"2024-04-02T07:33:27.464336+0000","last_became_peered":"2024-04-02T07:33:27.464336+0000","last_unstale":"2024-04-02T07:33:27.866811+0000","last_undegraded":"2024-04-02T07:33:27.866811+0000","last_fullsized":"2024-04-02T07:33:27.866811+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:04:11.156678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857980+0000","last_change":"2024-04-02T07:33:27.873267+0000","last_active":"2024-04-02T07:33:28.857980+0000","last_peered":"2024-04-02T07:33:28.857980+0000","last_clean":"2024-04-02T07:33:28.857980+0000","last_became_active":"2024-04-02T07:33:27.872846+0000","last_became_peered":"2024-04-02T07:33:27.872846+0000","last_unstale":"2024-04-02T07:33:28.857980+0000","last_undegraded":"2024-04-02T07:33:28.857980+0000","last_fullsized":"2024-04-02T07:33:28.857980+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:19:33.558224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"115'3","reported_seq":14,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711681+0000","last_change":"2024-04-02T07:33:27.468371+0000","last_active":"2024-04-02T07:33:29.711681+0000","last_peered":"2024-04-02T07:33:29.711681+0000","last_clean":"2024-04-02T07:33:29.711681+0000","last_became_active":"2024-04-02T07:33:27.468137+0000","last_became_peered":"2024-04-02T07:33:27.468137+0000","last_unstale":"2024-04-02T07:33:29.711681+0000","last_undegraded":"2024-04-02T07:33:29.711681+0000","last_fullsized":"2024-04-02T07:33:29.711681+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:07:34.752409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413480+0000","last_change":"2024-04-02T07:33:27.874173+0000","last_active":"2024-04-02T07:33:29.413480+0000","last_peered":"2024-04-02T07:33:29.413480+0000","last_clean":"2024-04-02T07:33:29.413480+0000","last_became_active":"2024-04-02T07:33:27.873885+0000","last_became_peered":"2024-04-02T07:33:27.873885+0000","last_unstale":"2024-04-02T07:33:29.413480+0000","last_undegraded":"2024-04-02T07:33:29.413480+0000","last_fullsized":"2024-04-02T07:33:29.413480+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:01:55.510529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"115'6","reported_seq":17,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711951+0000","last_change":"2024-04-02T07:33:27.470069+0000","last_active":"2024-04-02T07:33:29.711951+0000","last_peered":"2024-04-02T07:33:29.711951+0000","last_clean":"2024-04-02T07:33:29.711951+0000","last_became_active":"2024-04-02T07:33:27.469725+0000","last_became_peered":"2024-04-02T07:33:27.469725+0000","last_unstale":"2024-04-02T07:33:29.711951+0000","last_undegraded":"2024-04-02T07:33:29.711951+0000","last_fullsized":"2024-04-02T07:33:29.711951+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:48:39.594742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857894+0000","last_change":"2024-04-02T07:33:27.869118+0000","last_active":"2024-04-02T07:33:28.857894+0000","last_peered":"2024-04-02T07:33:28.857894+0000","last_clean":"2024-04-02T07:33:28.857894+0000","last_became_active":"2024-04-02T07:33:27.868872+0000","last_became_peered":"2024-04-02T07:33:27.868872+0000","last_unstale":"2024-04-02T07:33:28.857894+0000","last_undegraded":"2024-04-02T07:33:28.857894+0000","last_fullsized":"2024-04-02T07:33:28.857894+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:25:09.411123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"115'2","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.871157+0000","last_change":"2024-04-02T07:33:27.462734+0000","last_active":"2024-04-02T07:33:27.871157+0000","last_peered":"2024-04-02T07:33:27.871157+0000","last_clean":"2024-04-02T07:33:27.871157+0000","last_became_active":"2024-04-02T07:33:27.462486+0000","last_became_peered":"2024-04-02T07:33:27.462486+0000","last_unstale":"2024-04-02T07:33:27.871157+0000","last_undegraded":"2024-04-02T07:33:27.871157+0000","last_fullsized":"2024-04-02T07:33:27.871157+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:11:47.314840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857892+0000","last_change":"2024-04-02T07:33:27.876507+0000","last_active":"2024-04-02T07:33:28.857892+0000","last_peered":"2024-04-02T07:33:28.857892+0000","last_clean":"2024-04-02T07:33:28.857892+0000","last_became_active":"2024-04-02T07:33:27.876221+0000","last_became_peered":"2024-04-02T07:33:27.876221+0000","last_unstale":"2024-04-02T07:33:28.857892+0000","last_undegraded":"2024-04-02T07:33:28.857892+0000","last_fullsized":"2024-04-02T07:33:28.857892+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:37:58.952494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.872828+0000","last_change":"2024-04-02T07:33:27.469634+0000","last_active":"2024-04-02T07:33:27.872828+0000","last_peered":"2024-04-02T07:33:27.872828+0000","last_clean":"2024-04-02T07:33:27.872828+0000","last_became_active":"2024-04-02T07:33:27.469328+0000","last_became_peered":"2024-04-02T07:33:27.469328+0000","last_unstale":"2024-04-02T07:33:27.872828+0000","last_undegraded":"2024-04-02T07:33:27.872828+0000","last_fullsized":"2024-04-02T07:33:27.872828+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:21:06.948320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857866+0000","last_change":"2024-04-02T07:33:27.872927+0000","last_active":"2024-04-02T07:33:28.857866+0000","last_peered":"2024-04-02T07:33:28.857866+0000","last_clean":"2024-04-02T07:33:28.857866+0000","last_became_active":"2024-04-02T07:33:27.872635+0000","last_became_peered":"2024-04-02T07:33:27.872635+0000","last_unstale":"2024-04-02T07:33:28.857866+0000","last_undegraded":"2024-04-02T07:33:28.857866+0000","last_fullsized":"2024-04-02T07:33:28.857866+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:47:01.625875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"115'8","reported_seq":19,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.856539+0000","last_change":"2024-04-02T07:33:27.459692+0000","last_active":"2024-04-02T07:33:28.856539+0000","last_peered":"2024-04-02T07:33:28.856539+0000","last_clean":"2024-04-02T07:33:28.856539+0000","last_became_active":"2024-04-02T07:33:27.459414+0000","last_became_peered":"2024-04-02T07:33:27.459414+0000","last_unstale":"2024-04-02T07:33:28.856539+0000","last_undegraded":"2024-04-02T07:33:28.856539+0000","last_fullsized":"2024-04-02T07:33:28.856539+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:32:00.625887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857324+0000","last_change":"2024-04-02T07:33:27.881452+0000","last_active":"2024-04-02T07:33:28.857324+0000","last_peered":"2024-04-02T07:33:28.857324+0000","last_clean":"2024-04-02T07:33:28.857324+0000","last_became_active":"2024-04-02T07:33:27.879513+0000","last_became_peered":"2024-04-02T07:33:27.879513+0000","last_unstale":"2024-04-02T07:33:28.857324+0000","last_undegraded":"2024-04-02T07:33:28.857324+0000","last_fullsized":"2024-04-02T07:33:28.857324+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:53:50.977179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"115'1","reported_seq":12,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711883+0000","last_change":"2024-04-02T07:33:27.471006+0000","last_active":"2024-04-02T07:33:29.711883+0000","last_peered":"2024-04-02T07:33:29.711883+0000","last_clean":"2024-04-02T07:33:29.711883+0000","last_became_active":"2024-04-02T07:33:27.470297+0000","last_became_peered":"2024-04-02T07:33:27.470297+0000","last_unstale":"2024-04-02T07:33:29.711883+0000","last_undegraded":"2024-04-02T07:33:29.711883+0000","last_fullsized":"2024-04-02T07:33:29.711883+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:04.974430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.211281+0000","last_change":"2024-04-02T07:33:27.872104+0000","last_active":"2024-04-02T07:33:29.211281+0000","last_peered":"2024-04-02T07:33:29.211281+0000","last_clean":"2024-04-02T07:33:29.211281+0000","last_became_active":"2024-04-02T07:33:27.871812+0000","last_became_peered":"2024-04-02T07:33:27.871812+0000","last_unstale":"2024-04-02T07:33:29.211281+0000","last_undegraded":"2024-04-02T07:33:29.211281+0000","last_fullsized":"2024-04-02T07:33:29.211281+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T07:37:51.007791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"115'2","reported_seq":13,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857348+0000","last_change":"2024-04-02T07:33:27.460964+0000","last_active":"2024-04-02T07:33:28.857348+0000","last_peered":"2024-04-02T07:33:28.857348+0000","last_clean":"2024-04-02T07:33:28.857348+0000","last_became_active":"2024-04-02T07:33:27.460660+0000","last_became_peered":"2024-04-02T07:33:27.460660+0000","last_unstale":"2024-04-02T07:33:28.857348+0000","last_undegraded":"2024-04-02T07:33:28.857348+0000","last_fullsized":"2024-04-02T07:33:28.857348+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:18:31.967031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714810+0000","last_change":"2024-04-02T07:33:27.878749+0000","last_active":"2024-04-02T07:33:29.714810+0000","last_peered":"2024-04-02T07:33:29.714810+0000","last_clean":"2024-04-02T07:33:29.714810+0000","last_became_active":"2024-04-02T07:33:27.878487+0000","last_became_peered":"2024-04-02T07:33:27.878487+0000","last_unstale":"2024-04-02T07:33:29.714810+0000","last_undegraded":"2024-04-02T07:33:29.714810+0000","last_fullsized":"2024-04-02T07:33:29.714810+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:25:09.411123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"115'1","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.882562+0000","last_change":"2024-04-02T07:33:27.467380+0000","last_active":"2024-04-02T07:33:27.882562+0000","last_peered":"2024-04-02T07:33:27.882562+0000","last_clean":"2024-04-02T07:33:27.882562+0000","last_became_active":"2024-04-02T07:33:27.467110+0000","last_became_peered":"2024-04-02T07:33:27.467110+0000","last_unstale":"2024-04-02T07:33:27.882562+0000","last_undegraded":"2024-04-02T07:33:27.882562+0000","last_fullsized":"2024-04-02T07:33:27.882562+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:37:17.604375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714951+0000","last_change":"2024-04-02T07:33:27.880948+0000","last_active":"2024-04-02T07:33:29.714951+0000","last_peered":"2024-04-02T07:33:29.714951+0000","last_clean":"2024-04-02T07:33:29.714951+0000","last_became_active":"2024-04-02T07:33:27.880667+0000","last_became_peered":"2024-04-02T07:33:27.880667+0000","last_unstale":"2024-04-02T07:33:29.714951+0000","last_undegraded":"2024-04-02T07:33:29.714951+0000","last_fullsized":"2024-04-02T07:33:29.714951+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:17:08.670738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413362+0000","last_change":"2024-04-02T07:33:27.475514+0000","last_active":"2024-04-02T07:33:29.413362+0000","last_peered":"2024-04-02T07:33:29.413362+0000","last_clean":"2024-04-02T07:33:29.413362+0000","last_became_active":"2024-04-02T07:33:27.475204+0000","last_became_peered":"2024-04-02T07:33:27.475204+0000","last_unstale":"2024-04-02T07:33:29.413362+0000","last_undegraded":"2024-04-02T07:33:29.413362+0000","last_fullsized":"2024-04-02T07:33:29.413362+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:06:44.332166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714557+0000","last_change":"2024-04-02T07:33:27.877020+0000","last_active":"2024-04-02T07:33:29.714557+0000","last_peered":"2024-04-02T07:33:29.714557+0000","last_clean":"2024-04-02T07:33:29.714557+0000","last_became_active":"2024-04-02T07:33:27.876734+0000","last_became_peered":"2024-04-02T07:33:27.876734+0000","last_unstale":"2024-04-02T07:33:29.714557+0000","last_undegraded":"2024-04-02T07:33:29.714557+0000","last_fullsized":"2024-04-02T07:33:29.714557+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:07:35.756044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"115'2","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.869706+0000","last_change":"2024-04-02T07:33:27.468546+0000","last_active":"2024-04-02T07:33:27.869706+0000","last_peered":"2024-04-02T07:33:27.869706+0000","last_clean":"2024-04-02T07:33:27.869706+0000","last_became_active":"2024-04-02T07:33:27.468265+0000","last_became_peered":"2024-04-02T07:33:27.468265+0000","last_unstale":"2024-04-02T07:33:27.869706+0000","last_undegraded":"2024-04-02T07:33:27.869706+0000","last_fullsized":"2024-04-02T07:33:27.869706+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:20:26.400805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711361+0000","last_change":"2024-04-02T07:33:27.873609+0000","last_active":"2024-04-02T07:33:29.711361+0000","last_peered":"2024-04-02T07:33:29.711361+0000","last_clean":"2024-04-02T07:33:29.711361+0000","last_became_active":"2024-04-02T07:33:27.873311+0000","last_became_peered":"2024-04-02T07:33:27.873311+0000","last_unstale":"2024-04-02T07:33:29.711361+0000","last_undegraded":"2024-04-02T07:33:29.711361+0000","last_fullsized":"2024-04-02T07:33:29.711361+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:36:13.657455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.856665+0000","last_change":"2024-04-02T07:33:27.459252+0000","last_active":"2024-04-02T07:33:28.856665+0000","last_peered":"2024-04-02T07:33:28.856665+0000","last_clean":"2024-04-02T07:33:28.856665+0000","last_became_active":"2024-04-02T07:33:27.457131+0000","last_became_peered":"2024-04-02T07:33:27.457131+0000","last_unstale":"2024-04-02T07:33:28.856665+0000","last_undegraded":"2024-04-02T07:33:28.856665+0000","last_fullsized":"2024-04-02T07:33:28.856665+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:11:07.359510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714678+0000","last_change":"2024-04-02T07:33:27.876431+0000","last_active":"2024-04-02T07:33:29.714678+0000","last_peered":"2024-04-02T07:33:29.714678+0000","last_clean":"2024-04-02T07:33:29.714678+0000","last_became_active":"2024-04-02T07:33:27.876162+0000","last_became_peered":"2024-04-02T07:33:27.876162+0000","last_unstale":"2024-04-02T07:33:29.714678+0000","last_undegraded":"2024-04-02T07:33:29.714678+0000","last_fullsized":"2024-04-02T07:33:29.714678+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:56:03.473104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.851031+0000","last_change":"2024-04-02T07:33:27.464627+0000","last_active":"2024-04-02T07:33:27.851031+0000","last_peered":"2024-04-02T07:33:27.851031+0000","last_clean":"2024-04-02T07:33:27.851031+0000","last_became_active":"2024-04-02T07:33:27.464384+0000","last_became_peered":"2024-04-02T07:33:27.464384+0000","last_unstale":"2024-04-02T07:33:27.851031+0000","last_undegraded":"2024-04-02T07:33:27.851031+0000","last_fullsized":"2024-04-02T07:33:27.851031+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:08:01.054804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857770+0000","last_change":"2024-04-02T07:33:27.883782+0000","last_active":"2024-04-02T07:33:28.857770+0000","last_peered":"2024-04-02T07:33:28.857770+0000","last_clean":"2024-04-02T07:33:28.857770+0000","last_became_active":"2024-04-02T07:33:27.883530+0000","last_became_peered":"2024-04-02T07:33:27.883530+0000","last_unstale":"2024-04-02T07:33:28.857770+0000","last_undegraded":"2024-04-02T07:33:28.857770+0000","last_fullsized":"2024-04-02T07:33:28.857770+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T15:03:56.453553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711419+0000","last_change":"2024-04-02T07:33:27.466749+0000","last_active":"2024-04-02T07:33:29.711419+0000","last_peered":"2024-04-02T07:33:29.711419+0000","last_clean":"2024-04-02T07:33:29.711419+0000","last_became_active":"2024-04-02T07:33:27.466501+0000","last_became_peered":"2024-04-02T07:33:27.466501+0000","last_unstale":"2024-04-02T07:33:29.711419+0000","last_undegraded":"2024-04-02T07:33:29.711419+0000","last_fullsized":"2024-04-02T07:33:29.711419+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:29:58.451996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.507632+0000","last_change":"2024-04-02T07:33:27.880592+0000","last_active":"2024-04-02T07:33:29.507632+0000","last_peered":"2024-04-02T07:33:29.507632+0000","last_clean":"2024-04-02T07:33:29.507632+0000","last_became_active":"2024-04-02T07:33:27.880268+0000","last_became_peered":"2024-04-02T07:33:27.880268+0000","last_unstale":"2024-04-02T07:33:29.507632+0000","last_undegraded":"2024-04-02T07:33:29.507632+0000","last_fullsized":"2024-04-02T07:33:29.507632+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:42:58.494573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"115'2","reported_seq":13,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.877258+0000","last_change":"2024-04-02T07:33:27.460369+0000","last_active":"2024-04-02T07:33:27.877258+0000","last_peered":"2024-04-02T07:33:27.877258+0000","last_clean":"2024-04-02T07:33:27.877258+0000","last_became_active":"2024-04-02T07:33:27.460059+0000","last_became_peered":"2024-04-02T07:33:27.460059+0000","last_unstale":"2024-04-02T07:33:27.877258+0000","last_undegraded":"2024-04-02T07:33:27.877258+0000","last_fullsized":"2024-04-02T07:33:27.877258+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:08:47.676933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711799+0000","last_change":"2024-04-02T07:33:27.868116+0000","last_active":"2024-04-02T07:33:29.711799+0000","last_peered":"2024-04-02T07:33:29.711799+0000","last_clean":"2024-04-02T07:33:29.711799+0000","last_became_active":"2024-04-02T07:33:27.867771+0000","last_became_peered":"2024-04-02T07:33:27.867771+0000","last_unstale":"2024-04-02T07:33:29.711799+0000","last_undegraded":"2024-04-02T07:33:29.711799+0000","last_fullsized":"2024-04-02T07:33:29.711799+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:07:07.097752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"115'1","reported_seq":12,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.550059+0000","last_change":"2024-04-02T07:33:27.463956+0000","last_active":"2024-04-02T07:33:28.550059+0000","last_peered":"2024-04-02T07:33:28.550059+0000","last_clean":"2024-04-02T07:33:28.550059+0000","last_became_active":"2024-04-02T07:33:27.463426+0000","last_became_peered":"2024-04-02T07:33:27.463426+0000","last_unstale":"2024-04-02T07:33:28.550059+0000","last_undegraded":"2024-04-02T07:33:28.550059+0000","last_fullsized":"2024-04-02T07:33:28.550059+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:30:53.259024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711923+0000","last_change":"2024-04-02T07:33:27.873388+0000","last_active":"2024-04-02T07:33:29.711923+0000","last_peered":"2024-04-02T07:33:29.711923+0000","last_clean":"2024-04-02T07:33:29.711923+0000","last_became_active":"2024-04-02T07:33:27.873046+0000","last_became_peered":"2024-04-02T07:33:27.873046+0000","last_unstale":"2024-04-02T07:33:29.711923+0000","last_undegraded":"2024-04-02T07:33:29.711923+0000","last_fullsized":"2024-04-02T07:33:29.711923+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:38:08.666711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711698+0000","last_change":"2024-04-02T07:33:27.462653+0000","last_active":"2024-04-02T07:33:29.711698+0000","last_peered":"2024-04-02T07:33:29.711698+0000","last_clean":"2024-04-02T07:33:29.711698+0000","last_became_active":"2024-04-02T07:33:27.462356+0000","last_became_peered":"2024-04-02T07:33:27.462356+0000","last_unstale":"2024-04-02T07:33:29.711698+0000","last_undegraded":"2024-04-02T07:33:29.711698+0000","last_fullsized":"2024-04-02T07:33:29.711698+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T09:42:57.490938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.507503+0000","last_change":"2024-04-02T07:33:27.886387+0000","last_active":"2024-04-02T07:33:29.507503+0000","last_peered":"2024-04-02T07:33:29.507503+0000","last_clean":"2024-04-02T07:33:29.507503+0000","last_became_active":"2024-04-02T07:33:27.886120+0000","last_became_peered":"2024-04-02T07:33:27.886120+0000","last_unstale":"2024-04-02T07:33:29.507503+0000","last_undegraded":"2024-04-02T07:33:29.507503+0000","last_fullsized":"2024-04-02T07:33:29.507503+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:14:05.978066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.866477+0000","last_change":"2024-04-02T07:33:27.463765+0000","last_active":"2024-04-02T07:33:27.866477+0000","last_peered":"2024-04-02T07:33:27.866477+0000","last_clean":"2024-04-02T07:33:27.866477+0000","last_became_active":"2024-04-02T07:33:27.463560+0000","last_became_peered":"2024-04-02T07:33:27.463560+0000","last_unstale":"2024-04-02T07:33:27.866477+0000","last_undegraded":"2024-04-02T07:33:27.866477+0000","last_fullsized":"2024-04-02T07:33:27.866477+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:44:29.549736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860456+0000","last_change":"2024-04-02T07:33:27.871562+0000","last_active":"2024-04-02T07:33:28.860456+0000","last_peered":"2024-04-02T07:33:28.860456+0000","last_clean":"2024-04-02T07:33:28.860456+0000","last_became_active":"2024-04-02T07:33:27.871249+0000","last_became_peered":"2024-04-02T07:33:27.871249+0000","last_unstale":"2024-04-02T07:33:28.860456+0000","last_undegraded":"2024-04-02T07:33:28.860456+0000","last_fullsized":"2024-04-02T07:33:28.860456+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T19:29:59.455631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413588+0000","last_change":"2024-04-02T07:33:27.465947+0000","last_active":"2024-04-02T07:33:29.413588+0000","last_peered":"2024-04-02T07:33:29.413588+0000","last_clean":"2024-04-02T07:33:29.413588+0000","last_became_active":"2024-04-02T07:33:27.465653+0000","last_became_peered":"2024-04-02T07:33:27.465653+0000","last_unstale":"2024-04-02T07:33:29.413588+0000","last_undegraded":"2024-04-02T07:33:29.413588+0000","last_fullsized":"2024-04-02T07:33:29.413588+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T18:49:07.363861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.860729+0000","last_change":"2024-04-02T07:33:27.868107+0000","last_active":"2024-04-02T07:33:28.860729+0000","last_peered":"2024-04-02T07:33:28.860729+0000","last_clean":"2024-04-02T07:33:28.860729+0000","last_became_active":"2024-04-02T07:33:27.867794+0000","last_became_peered":"2024-04-02T07:33:27.867794+0000","last_unstale":"2024-04-02T07:33:28.860729+0000","last_undegraded":"2024-04-02T07:33:28.860729+0000","last_fullsized":"2024-04-02T07:33:28.860729+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T11:08:57.572728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.861074+0000","last_change":"2024-04-02T07:33:27.463549+0000","last_active":"2024-04-02T07:33:27.861074+0000","last_peered":"2024-04-02T07:33:27.861074+0000","last_clean":"2024-04-02T07:33:27.861074+0000","last_became_active":"2024-04-02T07:33:27.463001+0000","last_became_peered":"2024-04-02T07:33:27.463001+0000","last_unstale":"2024-04-02T07:33:27.861074+0000","last_undegraded":"2024-04-02T07:33:27.861074+0000","last_fullsized":"2024-04-02T07:33:27.861074+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T12:42:29.107894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.714800+0000","last_change":"2024-04-02T07:33:27.883667+0000","last_active":"2024-04-02T07:33:29.714800+0000","last_peered":"2024-04-02T07:33:29.714800+0000","last_clean":"2024-04-02T07:33:29.714800+0000","last_became_active":"2024-04-02T07:33:27.883417+0000","last_became_peered":"2024-04-02T07:33:27.883417+0000","last_unstale":"2024-04-02T07:33:29.714800+0000","last_undegraded":"2024-04-02T07:33:29.714800+0000","last_fullsized":"2024-04-02T07:33:29.714800+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:48:40.598377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.856798+0000","last_change":"2024-04-02T07:33:27.460731+0000","last_active":"2024-04-02T07:33:28.856798+0000","last_peered":"2024-04-02T07:33:28.856798+0000","last_clean":"2024-04-02T07:33:28.856798+0000","last_became_active":"2024-04-02T07:33:27.460259+0000","last_became_peered":"2024-04-02T07:33:27.460259+0000","last_unstale":"2024-04-02T07:33:28.856798+0000","last_undegraded":"2024-04-02T07:33:28.856798+0000","last_fullsized":"2024-04-02T07:33:28.856798+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:14:47.506995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711426+0000","last_change":"2024-04-02T07:33:27.865732+0000","last_active":"2024-04-02T07:33:29.711426+0000","last_peered":"2024-04-02T07:33:29.711426+0000","last_clean":"2024-04-02T07:33:29.711426+0000","last_became_active":"2024-04-02T07:33:27.865437+0000","last_became_peered":"2024-04-02T07:33:27.865437+0000","last_unstale":"2024-04-02T07:33:29.711426+0000","last_undegraded":"2024-04-02T07:33:29.711426+0000","last_fullsized":"2024-04-02T07:33:29.711426+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:06:19.432859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.711498+0000","last_change":"2024-04-02T07:33:27.466750+0000","last_active":"2024-04-02T07:33:29.711498+0000","last_peered":"2024-04-02T07:33:29.711498+0000","last_clean":"2024-04-02T07:33:29.711498+0000","last_became_active":"2024-04-02T07:33:27.466479+0000","last_became_peered":"2024-04-02T07:33:27.466479+0000","last_unstale":"2024-04-02T07:33:29.711498+0000","last_undegraded":"2024-04-02T07:33:29.711498+0000","last_fullsized":"2024-04-02T07:33:29.711498+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T14:42:58.485704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:28.857703+0000","last_change":"2024-04-02T07:33:27.876686+0000","last_active":"2024-04-02T07:33:28.857703+0000","last_peered":"2024-04-02T07:33:28.857703+0000","last_clean":"2024-04-02T07:33:28.857703+0000","last_became_active":"2024-04-02T07:33:27.876182+0000","last_became_peered":"2024-04-02T07:33:27.876182+0000","last_unstale":"2024-04-02T07:33:28.857703+0000","last_undegraded":"2024-04-02T07:33:28.857703+0000","last_fullsized":"2024-04-02T07:33:28.857703+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:27.438148+0000","last_clean_scrub_stamp":"2024-04-02T07:33:27.438148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T17:22:10.905772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":116,"state":"active+clean","last_fresh":"2024-04-02T07:33:29.413403+0000","last_change":"2024-04-02T07:33:27.476242+0000","last_active":"2024-04-02T07:33:29.413403+0000","last_peered":"2024-04-02T07:33:29.413403+0000","last_clean":"2024-04-02T07:33:29.413403+0000","last_became_active":"2024-04-02T07:33:27.476017+0000","last_became_peered":"2024-04-02T07:33:27.476017+0000","last_unstale":"2024-04-02T07:33:29.413403+0000","last_undegraded":"2024-04-02T07:33:29.413403+0000","last_fullsized":"2024-04-02T07:33:29.413403+0000","mapping_epoch":113,"log_start":"0'0","ondisk_log_start":"0'0","created":113,"last_epoch_clean":114,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:33:26.434513+0000","last_clean_scrub_stamp":"2024-04-02T07:33:26.434513+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T08:06:31.207856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":249,"reported_epoch":115,"state":"active+clean","last_fresh":"2024-04-02T07:33:27.866769+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:33:27.866769+0000","last_peered":"2024-04-02T07:33:27.866769+0000","last_clean":"2024-04-02T07:33:27.866769+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:33:27.866769+0000","last_undegraded":"2024-04-02T07:33:27.866769+0000","last_fullsized":"2024-04-02T07:33:27.866769+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574988,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33112,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338728,"statfs":{"total":96636764160,"available":96602857472,"internally_reserved":0,"allocated":2043904,"data_stored":1217463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.73199999999999998,"5min":0.68400000000000005,"15min":0.66300000000000003},"min":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.35299999999999998},"max":{"1min":0.90600000000000003,"5min":0.92400000000000004,"15min":1.0569999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.66800000000000004,"15min":0.64300000000000002},"min":{"1min":0.60099999999999998,"5min":0.442,"15min":0.39900000000000002},"max":{"1min":0.88700000000000001,"5min":1.018,"15min":1.018},"last":0.83299999999999996}]},{"osd":1,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.67400000000000004,"15min":0.65500000000000003},"min":{"1min":0.52600000000000002,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.98099999999999998,"5min":1.004,"15min":1.0289999999999999},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.69499999999999995,"15min":0.67800000000000005},"min":{"1min":0.503,"5min":0.42599999999999999,"15min":0.39500000000000002},"max":{"1min":0.96699999999999997,"5min":0.99299999999999999,"15min":1.113},"last":0.66700000000000004}]},{"osd":2,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.74399999999999999,"15min":0.75},"min":{"1min":0.46300000000000002,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.95099999999999996,"5min":1.0309999999999999,"15min":1.139},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.73999999999999999,"15min":0.72999999999999998},"min":{"1min":0.63900000000000001,"5min":0.503,"15min":0.437},"max":{"1min":0.93600000000000005,"5min":1.0549999999999999,"15min":1.522},"last":0.68500000000000005}]},{"osd":3,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.70999999999999996,"15min":0.70499999999999996},"min":{"1min":0.52100000000000002,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.94499999999999995,"5min":1.0409999999999999,"15min":1.405},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.755,"5min":0.72899999999999998,"15min":0.72899999999999998},"min":{"1min":0.623,"5min":0.48799999999999999,"15min":0.48599999999999999},"max":{"1min":0.96199999999999997,"5min":1.0329999999999999,"15min":1.0580000000000001},"last":0.77400000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57399999999999995,"15min":0.63},"min":{"1min":0.40699999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.76500000000000001,"5min":0.86599999999999999,"15min":1.633},"last":0.63},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.66400000000000003,"15min":0.69699999999999995},"min":{"1min":0.54700000000000004,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.88200000000000001,"5min":0.94299999999999995,"15min":1.079},"last":0.79200000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.63900000000000001,"15min":0.67700000000000005},"min":{"1min":0.39900000000000002,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.99399999999999999,"5min":0.995,"15min":1.2250000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.748,"5min":0.70399999999999996,"15min":0.73799999999999999},"min":{"1min":0.60399999999999998,"5min":0.441,"15min":0.43099999999999999},"max":{"1min":0.93600000000000005,"5min":0.98799999999999999,"15min":1.5609999999999999},"last":0.873}]},{"osd":6,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.67000000000000004,"15min":0.69399999999999995},"min":{"1min":0.51300000000000001,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":0.93899999999999995,"5min":0.97599999999999998,"15min":1.5960000000000001},"last":0.90200000000000002},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66200000000000003,"15min":0.67500000000000004},"min":{"1min":0.496,"5min":0.41399999999999998,"15min":0.40699999999999997},"max":{"1min":0.89800000000000002,"5min":0.96499999999999997,"15min":1.0840000000000001},"last":0.85099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574989,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32536,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339304,"statfs":{"total":96636764160,"available":96603447296,"internally_reserved":0,"allocated":1445888,"data_stored":626549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.71499999999999997,"15min":0.68600000000000005},"min":{"1min":0.56699999999999995,"5min":0.45500000000000002,"15min":0.41399999999999998},"max":{"1min":1.0820000000000001,"5min":1.147,"15min":1.399},"last":0.754},{"interface":"front","average":{"1min":0.755,"5min":0.70999999999999996,"15min":0.78000000000000003},"min":{"1min":0.60299999999999998,"5min":0.439,"15min":0.39400000000000002},"max":{"1min":0.91500000000000004,"5min":0.95799999999999996,"15min":5.7569999999999997},"last":0.74099999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.73399999999999999,"15min":0.72399999999999998},"min":{"1min":0.59499999999999997,"5min":0.42299999999999999,"15min":0.38200000000000001},"max":{"1min":0.93000000000000005,"5min":1.097,"15min":1.95},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.73799999999999999,"15min":0.73099999999999998},"min":{"1min":0.59799999999999998,"5min":0.51400000000000001,"15min":0.47599999999999998},"max":{"1min":0.95899999999999996,"5min":1.0449999999999999,"15min":1.248},"last":0.79100000000000004}]},{"osd":2,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.72299999999999998,"15min":0.70099999999999996},"min":{"1min":0.54400000000000004,"5min":0.47499999999999998,"15min":0.45000000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":1.226},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.745,"15min":0.72799999999999998},"min":{"1min":0.53100000000000003,"5min":0.51200000000000001,"15min":0.46500000000000002},"max":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.70299999999999996}]},{"osd":3,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.74199999999999999,"15min":0.76700000000000002},"min":{"1min":0.65900000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.006,"5min":1.006,"15min":2.3119999999999998},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.72299999999999998,"15min":0.754},"min":{"1min":0.61699999999999999,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":2.6389999999999998},"last":0.72399999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.66200000000000003,"5min":0.62,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.39600000000000002,"15min":0.34999999999999998},"max":{"1min":1.0469999999999999,"5min":1.236,"15min":1.236},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.625,"15min":0.64300000000000002},"min":{"1min":0.44800000000000001,"5min":0.42199999999999999,"15min":0.38500000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.58199999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.60399999999999998,"15min":0.63500000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.37},"max":{"1min":0.80000000000000004,"5min":0.86399999999999999,"15min":0.95999999999999996},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.69299999999999995,"5min":0.67800000000000005,"15min":0.69899999999999995},"min":{"1min":0.505,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":1.0109999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.55100000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:33:23 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.69099999999999995,"15min":0.70999999999999996},"min":{"1min":0.52500000000000002,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.96999999999999997,"5min":3.3290000000000002,"15min":3.3290000000000002},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.67900000000000005,"15min":0.70899999999999996},"min":{"1min":0.52300000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.52000000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574989,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32540,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1449984,"data_stored":627083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.67300000000000004,"15min":0.66600000000000004},"min":{"1min":0.41899999999999998,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.86399999999999999,"5min":0.995,"15min":1.25},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.70399999999999996,"15min":0.70299999999999996},"min":{"1min":0.438,"5min":0.42399999999999999,"15min":0.33000000000000002},"max":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":1.5289999999999999},"last":0.64500000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.72899999999999998,"15min":0.71199999999999997},"min":{"1min":0.56200000000000006,"5min":0.45900000000000002,"15min":0.371},"max":{"1min":0.995,"5min":0.995,"15min":1.1830000000000001},"last":0.752},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.71399999999999997,"15min":0.71099999999999997},"min":{"1min":0.438,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96599999999999997,"5min":1.0069999999999999,"15min":1.3420000000000001},"last":0.56399999999999995}]},{"osd":2,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.77000000000000002,"15min":0.79300000000000004},"min":{"1min":0.57799999999999996,"5min":0.53400000000000003,"15min":0.44900000000000001},"max":{"1min":0.92800000000000005,"5min":1.0129999999999999,"15min":1.8280000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.73699999999999999,"5min":0.72399999999999998,"15min":0.72699999999999998},"min":{"1min":0.45700000000000002,"5min":0.40999999999999998,"15min":0.39700000000000002},"max":{"1min":0.91200000000000003,"5min":1.0109999999999999,"15min":1.696},"last":0.79000000000000004}]},{"osd":3,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.74099999999999999,"15min":0.745},"min":{"1min":0.52800000000000002,"5min":0.498,"15min":0.40899999999999997},"max":{"1min":0.97399999999999998,"5min":1.034,"15min":1.6399999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.745,"15min":0.77500000000000002},"min":{"1min":0.52900000000000003,"5min":0.496,"15min":0.46800000000000003},"max":{"1min":1.01,"5min":1.01,"15min":2.0219999999999998},"last":0.66300000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.57899999999999996,"15min":0.63300000000000001},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.32500000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":1.911},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61899999999999999,"15min":0.68700000000000006},"min":{"1min":0.42799999999999999,"5min":0.38500000000000001,"15min":0.307},"max":{"1min":0.93100000000000005,"5min":1.0649999999999999,"15min":1.7829999999999999},"last":0.72399999999999998}]},{"osd":6,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.64000000000000001,"15min":0.72799999999999998},"min":{"1min":0.48099999999999998,"5min":0.439,"15min":0.39600000000000002},"max":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":2.1829999999999998},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.65700000000000003,"15min":0.72699999999999998},"min":{"1min":0.46200000000000002,"5min":0.39400000000000002,"15min":0.36499999999999999},"max":{"1min":1.1359999999999999,"5min":1.1359999999999999,"15min":2.1280000000000001},"last":0.73799999999999999}]},{"osd":7,"last update":"Tue Apr 2 07:33:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71699999999999997,"5min":0.68899999999999995,"15min":0.76100000000000001},"min":{"1min":0.54700000000000004,"5min":0.435,"15min":0.38300000000000001},"max":{"1min":0.90800000000000003,"5min":1.1319999999999999,"15min":1.887},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.71399999999999997,"15min":0.79500000000000004},"min":{"1min":0.56599999999999995,"5min":0.47799999999999998,"15min":0.439},"max":{"1min":0.996,"5min":1.056,"15min":2.2599999999999998},"last":0.76500000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574991,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1441792,"data_stored":626479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:33 2024","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68400000000000005,"15min":0.70799999999999996},"min":{"1min":0.53800000000000003,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":2.4929999999999999},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.73899999999999999},"min":{"1min":0.50600000000000001,"5min":0.435,"15min":0.435},"max":{"1min":0.93200000000000005,"5min":0.94799999999999995,"15min":3.2519999999999998},"last":0.505}]},{"osd":1,"last update":"Tue Apr 2 07:33:33 2024","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.70199999999999996,"15min":0.72699999999999998},"min":{"1min":0.55300000000000005,"5min":0.441,"15min":0.441},"max":{"1min":0.96999999999999997,"5min":0.96999999999999997,"15min":1.4279999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70299999999999996,"15min":0.79200000000000004},"min":{"1min":0.56899999999999995,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.88600000000000001,"5min":1.0069999999999999,"15min":4.3810000000000002},"last":0.51600000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:33:33 2024","interfaces":[{"interface":"back","average":{"1min":0.78800000000000003,"5min":0.72599999999999998,"15min":0.76200000000000001},"min":{"1min":0.61799999999999999,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.94399999999999995,"5min":1.1990000000000001,"15min":2.056},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.71599999999999997,"15min":0.78600000000000003},"min":{"1min":0.64500000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.95799999999999996,"5min":1.038,"15min":3.3420000000000001},"last":0.54900000000000004}]},{"osd":3,"last update":"Tue Apr 2 07:33:33 2024","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.75900000000000001,"15min":0.85599999999999998},"min":{"1min":0.58499999999999996,"5min":0.53500000000000003,"15min":0.436},"max":{"1min":0.92700000000000005,"5min":1.091,"15min":3.9180000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.81100000000000005,"5min":0.77000000000000002,"15min":0.86799999999999999},"min":{"1min":0.66000000000000003,"5min":0.497,"15min":0.497},"max":{"1min":0.996,"5min":1.1279999999999999,"15min":3.9750000000000001},"last":0.66100000000000003}]},{"osd":5,"last update":"Tue Apr 2 07:33:33 2024","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.59199999999999997,"15min":0.64600000000000002},"min":{"1min":0.47699999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.94299999999999995,"5min":1.1120000000000001,"15min":1.2509999999999999},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.59999999999999998,"15min":0.67100000000000004},"min":{"1min":0.378,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.83299999999999996,"5min":0.98199999999999998,"15min":1.4419999999999999},"last":0.433}]},{"osd":6,"last update":"Tue Apr 2 07:33:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.62,"15min":0.66000000000000003},"min":{"1min":0.45500000000000002,"5min":0.40999999999999998,"15min":0.33400000000000002},"max":{"1min":0.76300000000000001,"5min":1.0760000000000001,"15min":1.2949999999999999},"last":0.627},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.67900000000000005,"15min":0.71999999999999997},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.98199999999999998,"5min":1.2529999999999999,"15min":1.3069999999999999},"last":0.61699999999999999}]},{"osd":7,"last update":"Tue Apr 2 07:33:33 2024","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.68899999999999995,"15min":0.73999999999999999},"min":{"1min":0.434,"5min":0.432,"15min":0.432},"max":{"1min":0.85499999999999998,"5min":1.034,"15min":1.2689999999999999},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.77500000000000002,"15min":0.81599999999999995},"min":{"1min":0.60499999999999998,"5min":0.56899999999999995,"15min":0.52700000000000002},"max":{"1min":1.0249999999999999,"5min":1.2949999999999999,"15min":1.353},"last":0.70299999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574989,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32548,"kb_used_data":1424,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339292,"statfs":{"total":96636764160,"available":96603435008,"internally_reserved":0,"allocated":1458176,"data_stored":628113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45400000000000001,"15min":0.44700000000000001},"min":{"1min":0.33000000000000002,"5min":0.30199999999999999,"15min":0.26300000000000001},"max":{"1min":0.71199999999999997,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.48799999999999999,"15min":0.48599999999999999},"min":{"1min":0.34799999999999998,"5min":0.30399999999999999,"15min":0.28699999999999998},"max":{"1min":0.65500000000000003,"5min":0.78400000000000003,"15min":1.0109999999999999},"last":0.48499999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.46400000000000002,"15min":0.45000000000000001},"min":{"1min":0.34899999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.748,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.52700000000000002,"15min":0.51500000000000001},"min":{"1min":0.40600000000000003,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51000000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.54500000000000004,"15min":0.54200000000000004},"min":{"1min":0.45200000000000001,"5min":0.378,"15min":0.374},"max":{"1min":0.80400000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.58199999999999996,"15min":0.58099999999999996},"min":{"1min":0.437,"5min":0.35399999999999998,"15min":0.33400000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":1.306},"last":0.58099999999999996}]},{"osd":4,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.76000000000000001,"15min":0.747},"min":{"1min":0.55000000000000004,"5min":0.45800000000000002,"15min":0.40500000000000003},"max":{"1min":1.1539999999999999,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.78200000000000003,"15min":0.76100000000000001},"min":{"1min":0.64100000000000001,"5min":0.47299999999999998,"15min":0.46500000000000002},"max":{"1min":1.0620000000000001,"5min":1.306,"15min":1.306},"last":0.84099999999999997}]},{"osd":5,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.84599999999999997,"5min":0.78400000000000003,"15min":0.77800000000000002},"min":{"1min":0.57399999999999995,"5min":0.502,"15min":0.501},"max":{"1min":1.129,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.92500000000000004},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.78400000000000003,"15min":0.76100000000000001},"min":{"1min":0.59399999999999997,"5min":0.48999999999999999,"15min":0.48899999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.76800000000000002}]},{"osd":6,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":0.77400000000000002,"15min":0.76700000000000002},"min":{"1min":0.57899999999999996,"5min":0.48799999999999999,"15min":0.44500000000000001},"max":{"1min":1.2130000000000001,"5min":1.258,"15min":1.258},"last":0.86199999999999999},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.80700000000000005,"15min":0.79300000000000004},"min":{"1min":0.627,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.2529999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.96299999999999997}]},{"osd":7,"last update":"Tue Apr 2 07:33:21 2024","interfaces":[{"interface":"back","average":{"1min":0.86399999999999999,"5min":0.79100000000000004,"15min":0.76800000000000002},"min":{"1min":0.60199999999999998,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.103,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.879,"5min":0.80300000000000005,"15min":0.79400000000000004},"min":{"1min":0.60899999999999999,"5min":0.53100000000000003,"15min":0.47499999999999998},"max":{"1min":1.0860000000000001,"5min":1.1120000000000001,"15min":1.2869999999999999},"last":0.93700000000000006}]}]},{"osd":2,"up_from":13,"seq":55834574989,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32532,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339308,"statfs":{"total":96636764160,"available":96603451392,"internally_reserved":0,"allocated":1441792,"data_stored":626479,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:32 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.46400000000000002,"15min":0.45100000000000001},"min":{"1min":0.30099999999999999,"5min":0.25800000000000001,"15min":0.253},"max":{"1min":0.75600000000000001,"5min":0.78800000000000003,"15min":0.79100000000000004},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.31,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.71499999999999997,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.54600000000000004}]},{"osd":1,"last update":"Tue Apr 2 07:33:32 2024","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.52300000000000002,"15min":0.53300000000000003},"min":{"1min":0.36399999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72499999999999998,"5min":0.876,"15min":1.171},"last":0.375},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51300000000000001,"15min":0.501},"min":{"1min":0.33900000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.878,"5min":0.878,"15min":1.333},"last":0.51700000000000002}]},{"osd":3,"last update":"Tue Apr 2 07:33:32 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55100000000000005,"15min":0.53200000000000003},"min":{"1min":0.374,"5min":0.33400000000000002,"15min":0.32700000000000001},"max":{"1min":0.83899999999999997,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.57499999999999996},"min":{"1min":0.41299999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.73999999999999999,"5min":0.90000000000000002,"15min":1.1140000000000001},"last":0.434}]},{"osd":4,"last update":"Tue Apr 2 07:33:32 2024","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.755,"15min":0.76600000000000001},"min":{"1min":0.63700000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.94799999999999995,"5min":1.1379999999999999,"15min":2.254},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.82999999999999996,"5min":0.76500000000000001,"15min":0.77200000000000002},"min":{"1min":0.53400000000000003,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.0780000000000001,"5min":1.1599999999999999,"15min":1.3420000000000001},"last":0.95199999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:33:32 2024","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.77100000000000002,"15min":0.76700000000000002},"min":{"1min":0.66300000000000003,"5min":0.54000000000000004,"15min":0.46200000000000002},"max":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.3740000000000001},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.79400000000000004,"15min":0.80300000000000005},"min":{"1min":0.63800000000000001,"5min":0.498,"15min":0.443},"max":{"1min":1.1020000000000001,"5min":1.2070000000000001,"15min":2.0840000000000001},"last":0.92800000000000005}]},{"osd":6,"last update":"Tue Apr 2 07:33:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85299999999999998,"5min":0.80900000000000005,"15min":0.82099999999999995},"min":{"1min":0.623,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":0.98599999999999999,"5min":1.1990000000000001,"15min":1.5029999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.91200000000000003,"5min":0.84699999999999998,"15min":0.83499999999999996},"min":{"1min":0.73799999999999999,"5min":0.58399999999999996,"15min":0.52700000000000002},"max":{"1min":1.1200000000000001,"5min":1.159,"15min":1.425},"last":0.88900000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:33:32 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.79500000000000004,"15min":0.81499999999999995},"min":{"1min":0.61599999999999999,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0489999999999999,"5min":1.1799999999999999,"15min":2.3580000000000001},"last":0.84399999999999997},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.81200000000000006,"15min":0.82099999999999995},"min":{"1min":0.68300000000000005,"5min":0.54400000000000004,"15min":0.54300000000000004},"max":{"1min":1.0369999999999999,"5min":1.127,"15min":1.377},"last":0.82199999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574988,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32540,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339300,"statfs":{"total":96636764160,"available":96603443200,"internally_reserved":0,"allocated":1449984,"data_stored":626603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.44900000000000001,"15min":0.45800000000000002},"min":{"1min":0.26500000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.60399999999999998,"5min":0.78600000000000003,"15min":1.2150000000000001},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.47499999999999998,"15min":0.55300000000000005},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.26200000000000001},"max":{"1min":0.64000000000000001,"5min":0.72299999999999998,"15min":4.157},"last":0.5}]},{"osd":2,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.48399999999999999,"15min":0.55200000000000005},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.28999999999999998},"max":{"1min":0.621,"5min":0.67700000000000005,"15min":4.282},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52900000000000003,"15min":0.55900000000000005},"min":{"1min":0.37,"5min":0.35499999999999998,"15min":0.33600000000000002},"max":{"1min":0.78200000000000003,"5min":0.81000000000000005,"15min":1.625},"last":0.47899999999999998}]},{"osd":3,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59799999999999998,"15min":0.59999999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83799999999999997,"5min":0.88800000000000001,"15min":1.1120000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.54800000000000004,"15min":0.69699999999999995},"min":{"1min":0.35599999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.72799999999999998,"5min":0.80600000000000005,"15min":8.1620000000000008},"last":0.57399999999999995}]},{"osd":4,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.72199999999999998,"15min":0.82799999999999996},"min":{"1min":0.55100000000000005,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":4.7400000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.77400000000000002,"15min":0.79200000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.50600000000000001},"max":{"1min":1.123,"5min":1.125,"15min":1.7070000000000001},"last":0.70799999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.76600000000000001,"15min":0.84299999999999997},"min":{"1min":0.52200000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.321,"5min":1.321,"15min":4.5759999999999996},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.75800000000000001,"15min":0.84099999999999997},"min":{"1min":0.49099999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":4.7949999999999999},"last":0.73199999999999998}]},{"osd":6,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.77900000000000003,"15min":0.86899999999999999},"min":{"1min":0.59899999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":4.6890000000000001},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.77500000000000002,"15min":0.85699999999999998},"min":{"1min":0.51100000000000001,"5min":0.501,"15min":0.501},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":4.6059999999999999},"last":0.69999999999999996}]},{"osd":7,"last update":"Tue Apr 2 07:33:28 2024","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.78100000000000003,"15min":0.80300000000000005},"min":{"1min":0.58399999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.206,"5min":1.206,"15min":1.8759999999999999},"last":0.755},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.79500000000000004,"15min":0.873},"min":{"1min":0.56499999999999995,"5min":0.495,"15min":0.495},"max":{"1min":1.081,"5min":1.157,"15min":4.6420000000000003},"last":0.74299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574989,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33124,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338716,"statfs":{"total":96636764160,"available":96602845184,"internally_reserved":0,"allocated":2056192,"data_stored":1218523,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.42799999999999999,"15min":0.44600000000000001},"min":{"1min":0.28299999999999997,"5min":0.27800000000000002,"15min":0.26300000000000001},"max":{"1min":0.54800000000000004,"5min":0.62,"15min":1.48},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.496,"15min":0.503},"min":{"1min":0.41199999999999998,"5min":0.377,"15min":0.35799999999999998},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":1.2330000000000001},"last":0.55700000000000005}]},{"osd":2,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.497,"15min":0.50800000000000001},"min":{"1min":0.40000000000000002,"5min":0.34699999999999998,"15min":0.29099999999999998},"max":{"1min":0.65000000000000002,"5min":0.77800000000000002,"15min":1.3129999999999999},"last":0.504},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54500000000000004,"15min":0.53500000000000003},"min":{"1min":0.41799999999999998,"5min":0.38,"15min":0.32400000000000001},"max":{"1min":0.69699999999999995,"5min":0.76700000000000002,"15min":0.82599999999999996},"last":0.61199999999999999}]},{"osd":3,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.46999999999999997,"15min":0.46899999999999997},"min":{"1min":0.33100000000000002,"5min":0.29999999999999999,"15min":0.28199999999999997},"max":{"1min":0.749,"5min":0.82799999999999996,"15min":0.84799999999999998},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.57799999999999996,"15min":0.59699999999999998},"min":{"1min":0.435,"5min":0.42499999999999999,"15min":0.40300000000000002},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":1.4430000000000001},"last":0.52700000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.745,"15min":0.73999999999999999},"min":{"1min":0.65300000000000002,"5min":0.505,"15min":0.46200000000000002},"max":{"1min":1.0149999999999999,"5min":1.0209999999999999,"15min":1.0569999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.73199999999999998,"15min":0.73999999999999999},"min":{"1min":0.623,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.93999999999999995,"5min":1.034,"15min":1.1240000000000001},"last":0.84299999999999997}]},{"osd":5,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.76600000000000001},"min":{"1min":0.59299999999999997,"5min":0.53700000000000003,"15min":0.47599999999999998},"max":{"1min":0.95599999999999996,"5min":1.042,"15min":1.371},"last":0.878},{"interface":"front","average":{"1min":0.755,"5min":0.74099999999999999,"15min":0.75600000000000001},"min":{"1min":0.56899999999999995,"5min":0.498,"15min":0.498},"max":{"1min":0.89500000000000002,"5min":1.0009999999999999,"15min":1.143},"last":0.997}]},{"osd":6,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.77500000000000002,"15min":0.78900000000000003},"min":{"1min":0.65100000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.97999999999999998,"5min":1.0409999999999999,"15min":1.177},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.79800000000000004,"15min":0.81899999999999995},"min":{"1min":0.63900000000000001,"5min":0.57099999999999995,"15min":0.52700000000000002},"max":{"1min":0.96099999999999997,"5min":1.081,"15min":1.4099999999999999},"last":0.94099999999999995}]},{"osd":7,"last update":"Tue Apr 2 07:33:22 2024","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.76000000000000001,"15min":0.78000000000000003},"min":{"1min":0.61199999999999999,"5min":0.56100000000000005,"15min":0.54800000000000004},"max":{"1min":0.93400000000000005,"5min":1.028,"15min":1.135},"last":0.92400000000000004},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.76500000000000001,"15min":0.77800000000000002},"min":{"1min":0.55200000000000005,"5min":0.54500000000000004,"15min":0.48399999999999999},"max":{"1min":0.92800000000000005,"5min":1.075,"15min":1.141},"last":0.90100000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:33:36.879 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-02T07:33:36.879 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-04-02T07:33:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.060+0000 7fcde7200640 1 Processor -- start 2024-04-02T07:33:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.060+0000 7fcde7200640 1 -- start start 2024-04-02T07:33:37.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.060+0000 7fcde7200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcde00cdbb0 0x7fcde00cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:37.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.060+0000 7fcde7200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcde00ce1d0 0x7fcde00ce660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:37.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.060+0000 7fcde7200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcde00cad40 con 0x7fcde0143f00 2024-04-02T07:33:37.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.060+0000 7fcde7200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde00cdff0 con 0x7fcde00ce1d0 2024-04-02T07:33:37.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.060+0000 7fcde7200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde00cb020 con 0x7fcde00cdbb0 2024-04-02T07:33:37.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.060+0000 7fcde5200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcde00ce1d0 0x7fcde00ce660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:37.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.060+0000 7fcde5200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcde00ce1d0 0x7fcde00ce660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60570/0 (socket says 172.21.15.55:60570) 2024-04-02T07:33:37.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.060+0000 7fcde5200640 1 -- 172.21.15.55:0/3436897904 learned_addr learned my addr 172.21.15.55:0/3436897904 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:37.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.060+0000 7fcdd7e00640 1 --2- 172.21.15.55:0/3436897904 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcde00cdbb0 0x7fcde00cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:37.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.060+0000 7fcde5200640 1 -- 172.21.15.55:0/3436897904 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcde00cdbb0 msgr2=0x7fcde00cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:37.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.060+0000 7fcde5200640 1 --2- 172.21.15.55:0/3436897904 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcde00cdbb0 0x7fcde00cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:37.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.060+0000 7fcde5200640 1 -- 172.21.15.55:0/3436897904 >> v1:172.21.15.106:6789/0 conn(0x7fcde0143f00 legacy=0x7fcde00cd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:37.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.060+0000 7fcde5200640 1 -- 172.21.15.55:0/3436897904 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde00cb300 con 0x7fcde00ce1d0 2024-04-02T07:33:37.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.064+0000 7fcde5200640 1 --2- 172.21.15.55:0/3436897904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde00ce1d0 0x7fcde00ce660 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009e80 tx=0x7fcdd801ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbe48dad84b7d3e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:37.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.064+0000 7fcddf400640 1 -- 172.21.15.55:0/3436897904 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd80a5880 con 0x7fcde00ce1d0 2024-04-02T07:33:37.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.064+0000 7fcddf400640 1 -- 172.21.15.55:0/3436897904 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd80a59e0 con 0x7fcde00ce1d0 2024-04-02T07:33:37.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.064+0000 7fcddf400640 1 -- 172.21.15.55:0/3436897904 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd80a5d70 con 0x7fcde00ce1d0 2024-04-02T07:33:37.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.064+0000 7fcde7200640 1 -- 172.21.15.55:0/3436897904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde00ce1d0 msgr2=0x7fcde00ce660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:37.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.064+0000 7fcde7200640 1 --2- 172.21.15.55:0/3436897904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde00ce1d0 0x7fcde00ce660 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fcdd8009e80 tx=0x7fcdd801ca10 comp rx=0 tx=0).stop 2024-04-02T07:33:37.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.064+0000 7fcde7200640 1 -- 172.21.15.55:0/3436897904 shutdown_connections 2024-04-02T07:33:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.064+0000 7fcde7200640 1 --2- 172.21.15.55:0/3436897904 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde00ce1d0 0x7fcde00ce660 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.064+0000 7fcde7200640 1 --2- 172.21.15.55:0/3436897904 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcde00cdbb0 0x7fcde00cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.064+0000 7fcde7200640 1 -- 172.21.15.55:0/3436897904 >> 172.21.15.55:0/3436897904 conn(0x7fcde0066110 msgr2=0x7fcde0069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.064+0000 7fcde7200640 1 -- 172.21.15.55:0/3436897904 shutdown_connections 2024-04-02T07:33:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.064+0000 7fcde7200640 1 -- 172.21.15.55:0/3436897904 wait complete. 2024-04-02T07:33:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcde7200640 1 Processor -- start 2024-04-02T07:33:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcde7200640 1 -- start start 2024-04-02T07:33:37.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcde7200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde00cdbb0 0x7fcde006d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:37.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcde7200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcde00ce1d0 0x7fcde0139e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:37.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcde7200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcde0143f00 0x7fcde01637f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcde7200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde0155330 con 0x7fcde00cdbb0 2024-04-02T07:33:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcde7200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde0157e80 con 0x7fcde00ce1d0 2024-04-02T07:33:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcde7200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde0158a00 con 0x7fcde0143f00 2024-04-02T07:33:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcddfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde00cdbb0 0x7fcde006d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcddfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde00cdbb0 0x7fcde006d9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60586/0 (socket says 172.21.15.55:60586) 2024-04-02T07:33:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcddfe00640 1 -- 172.21.15.55:0/1549012527 learned_addr learned my addr 172.21.15.55:0/1549012527 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcdd7e00640 1 --2- 172.21.15.55:0/1549012527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcde00ce1d0 0x7fcde0139e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:37.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcde5200640 1 --2- 172.21.15.55:0/1549012527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcde0143f00 0x7fcde01637f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:37.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcddfe00640 1 -- 172.21.15.55:0/1549012527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcde0143f00 msgr2=0x7fcde01637f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:37.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcddfe00640 1 --2- 172.21.15.55:0/1549012527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcde0143f00 0x7fcde01637f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:37.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcddfe00640 1 -- 172.21.15.55:0/1549012527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcde00ce1d0 msgr2=0x7fcde0139e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:37.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcddfe00640 1 --2- 172.21.15.55:0/1549012527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcde00ce1d0 0x7fcde0139e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:37.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcddfe00640 1 -- 172.21.15.55:0/1549012527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd8009b30 con 0x7fcde00cdbb0 2024-04-02T07:33:37.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcddfe00640 1 --2- 172.21.15.55:0/1549012527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde00cdbb0 0x7fcde006d9a0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fcdd000c3c0 tx=0x7fcdd000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:37.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcddcc00640 1 -- 172.21.15.55:0/1549012527 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd00052d0 con 0x7fcde00cdbb0 2024-04-02T07:33:37.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcddcc00640 1 -- 172.21.15.55:0/1549012527 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd0005430 con 0x7fcde00cdbb0 2024-04-02T07:33:37.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcddcc00640 1 -- 172.21.15.55:0/1549012527 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd0003840 con 0x7fcde00cdbb0 2024-04-02T07:33:37.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcde7200640 1 -- 172.21.15.55:0/1549012527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde006dee0 con 0x7fcde00cdbb0 2024-04-02T07:33:37.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcde7200640 1 -- 172.21.15.55:0/1549012527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde01583b0 con 0x7fcde00cdbb0 2024-04-02T07:33:37.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.068+0000 7fcde7200640 1 -- 172.21.15.55:0/1549012527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde0066c90 con 0x7fcde00cdbb0 2024-04-02T07:33:37.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.072+0000 7fcddcc00640 1 -- 172.21.15.55:0/1549012527 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fcdd00039a0 con 0x7fcde00cdbb0 2024-04-02T07:33:37.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.072+0000 7fcddcc00640 1 --2- 172.21.15.55:0/1549012527 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcdbc066690 0x7fcdbc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:37.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.072+0000 7fcddcc00640 1 -- 172.21.15.55:0/1549012527 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcdd0083690 con 0x7fcde00cdbb0 2024-04-02T07:33:37.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.072+0000 7fcdd7e00640 1 --2- 172.21.15.55:0/1549012527 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcdbc066690 0x7fcdbc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:37.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.072+0000 7fcdd7e00640 1 --2- 172.21.15.55:0/1549012527 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcdbc066690 0x7fcdbc068b50 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fcde00ce840 tx=0x7fcdc8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:37.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.076+0000 7fcddcc00640 1 -- 172.21.15.55:0/1549012527 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fcdd0050a10 con 0x7fcde00cdbb0 2024-04-02T07:33:37.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.292+0000 7fcde7200640 1 -- 172.21.15.55:0/1549012527 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fcde006b1a0 con 0x7fcde00cdbb0 2024-04-02T07:33:37.300 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.296+0000 7fcddcc00640 1 -- 172.21.15.55:0/1549012527 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7fcdd0054030 con 0x7fcde00cdbb0 2024-04-02T07:33:37.300 INFO:teuthology.orchestra.run.smithi055.stderr:updated caps for client.0 2024-04-02T07:33:37.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.300+0000 7fcde7200640 1 -- 172.21.15.55:0/1549012527 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcdbc066690 msgr2=0x7fcdbc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:37.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.300+0000 7fcde7200640 1 --2- 172.21.15.55:0/1549012527 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcdbc066690 0x7fcdbc068b50 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fcde00ce840 tx=0x7fcdc8008040 comp rx=0 tx=0).stop 2024-04-02T07:33:37.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.300+0000 7fcde7200640 1 -- 172.21.15.55:0/1549012527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde00cdbb0 msgr2=0x7fcde006d9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:37.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.300+0000 7fcde7200640 1 --2- 172.21.15.55:0/1549012527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde00cdbb0 0x7fcde006d9a0 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fcdd000c3c0 tx=0x7fcdd000c880 comp rx=0 tx=0).stop 2024-04-02T07:33:37.302 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.300+0000 7fcde7200640 1 -- 172.21.15.55:0/1549012527 shutdown_connections 2024-04-02T07:33:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.300+0000 7fcde7200640 1 --2- 172.21.15.55:0/1549012527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcde0143f00 0x7fcde01637f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.300+0000 7fcde7200640 1 --2- 172.21.15.55:0/1549012527 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcdbc066690 0x7fcdbc068b50 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.300+0000 7fcde7200640 1 --2- 172.21.15.55:0/1549012527 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcde00ce1d0 0x7fcde0139e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.300+0000 7fcde7200640 1 --2- 172.21.15.55:0/1549012527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcde00cdbb0 0x7fcde006d9a0 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.300+0000 7fcde7200640 1 -- 172.21.15.55:0/1549012527 >> 172.21.15.55:0/1549012527 conn(0x7fcde0066110 msgr2=0x7fcde00cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.300+0000 7fcde7200640 1 -- 172.21.15.55:0/1549012527 shutdown_connections 2024-04-02T07:33:37.303 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.300+0000 7fcde7200640 1 -- 172.21.15.55:0/1549012527 wait complete. 2024-04-02T07:33:37.322 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:33:37.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.460+0000 7f4ebd400640 1 Processor -- start 2024-04-02T07:33:37.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.460+0000 7f4ebd400640 1 -- start start 2024-04-02T07:33:37.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.460+0000 7f4ebd400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4eb8158360 0x7f4eb80ccdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:37.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.460+0000 7f4ebd400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb815b6c0 con 0x7f4eb80b41c0 2024-04-02T07:33:37.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.460+0000 7f4ebd400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4eb815b9a0 con 0x7f4eb815abb0 2024-04-02T07:33:37.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.460+0000 7f4ebd400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb80cc5d0 con 0x7f4eb8158360 2024-04-02T07:33:37.463 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.460+0000 7f4eb7200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4eb80b41c0 0x7f4eb815bdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33984/0 (socket says 172.21.15.55:33984) 2024-04-02T07:33:37.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.460+0000 7f4eb7200640 1 -- 172.21.15.55:0/81736925 learned_addr learned my addr 172.21.15.55:0/81736925 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:37.464 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.460+0000 7f4eb6800640 1 --2- 172.21.15.55:0/81736925 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4eb8158360 0x7f4eb80ccdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:37.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.460+0000 7f4eb5e00640 1 -- 172.21.15.55:0/81736925 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 347217438 0 0) 0x7f4eb815b6c0 con 0x7f4eb80b41c0 2024-04-02T07:33:37.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.460+0000 7f4eb5e00640 1 -- 172.21.15.55:0/81736925 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e9c003530 con 0x7f4eb80b41c0 2024-04-02T07:33:37.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.464+0000 7f4eb5e00640 1 -- 172.21.15.55:0/81736925 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491924081 0 0) 0x7f4eb815b9a0 con 0x7f4eb815abb0 2024-04-02T07:33:37.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.464+0000 7f4eb5e00640 1 -- 172.21.15.55:0/81736925 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4eb815b6c0 con 0x7f4eb815abb0 2024-04-02T07:33:37.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.464+0000 7f4eb6800640 1 -- 172.21.15.55:0/81736925 >> v1:172.21.15.106:6789/0 conn(0x7f4eb815abb0 legacy=0x7f4eb80b3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:37.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.464+0000 7f4eb5e00640 1 -- 172.21.15.55:0/81736925 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1416479550 0 0) 0x7f4e9c003530 con 0x7f4eb80b41c0 2024-04-02T07:33:37.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.464+0000 7f4eb6800640 1 -- 172.21.15.55:0/81736925 >> v1:172.21.15.55:6789/0 conn(0x7f4eb80b41c0 legacy=0x7f4eb815bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:37.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.464+0000 7f4eb6800640 1 -- 172.21.15.55:0/81736925 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eb80cc8b0 con 0x7f4eb8158360 2024-04-02T07:33:37.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.464+0000 7f4eb6800640 1 --2- 172.21.15.55:0/81736925 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4eb8158360 0x7f4eb80ccdd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80097f0 tx=0x7f4ea801c400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9dc01eb1e94062cf server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:37.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.464+0000 7f4eb5e00640 1 -- 172.21.15.55:0/81736925 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0001a00 con 0x7f4eb8158360 2024-04-02T07:33:37.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.464+0000 7f4eb5e00640 1 -- 172.21.15.55:0/81736925 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea80a8050 con 0x7f4eb8158360 2024-04-02T07:33:37.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.464+0000 7f4eb5e00640 1 -- 172.21.15.55:0/81736925 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea80ac620 con 0x7f4eb8158360 2024-04-02T07:33:37.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.464+0000 7f4ebd400640 1 -- 172.21.15.55:0/81736925 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4eb8158360 msgr2=0x7f4eb80ccdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:37.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.464+0000 7f4ebd400640 1 --2- 172.21.15.55:0/81736925 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4eb8158360 0x7f4eb80ccdd0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80097f0 tx=0x7f4ea801c400 comp rx=0 tx=0).stop 2024-04-02T07:33:37.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4ebd400640 1 -- 172.21.15.55:0/81736925 shutdown_connections 2024-04-02T07:33:37.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4ebd400640 1 --2- 172.21.15.55:0/81736925 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4eb8158360 0x7f4eb80ccdd0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:37.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4ebd400640 1 -- 172.21.15.55:0/81736925 >> 172.21.15.55:0/81736925 conn(0x7f4eb8069d90 msgr2=0x7f4eb806a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:37.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4ebd400640 1 -- 172.21.15.55:0/81736925 shutdown_connections 2024-04-02T07:33:37.469 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4ebd400640 1 -- 172.21.15.55:0/81736925 wait complete. 2024-04-02T07:33:37.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4ebd400640 1 Processor -- start 2024-04-02T07:33:37.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4ebd400640 1 -- start start 2024-04-02T07:33:37.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4ebd400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4eb80b41c0 0x7f4eb80b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:37.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4ebd400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8158360 0x7f4eb80b2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:37.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4ebd400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4eb815abb0 0x7f4eb80b3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:37.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4ebd400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb80ca670 con 0x7f4eb8158360 2024-04-02T07:33:37.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4ebd400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb80b3bb0 con 0x7f4eb80b41c0 2024-04-02T07:33:37.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4ebd400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4eb80b3e90 con 0x7f4eb815abb0 2024-04-02T07:33:37.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4eade00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8158360 0x7f4eb80b2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:37.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4eade00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8158360 0x7f4eb80b2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60588/0 (socket says 172.21.15.55:60588) 2024-04-02T07:33:37.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4eade00640 1 -- 172.21.15.55:0/2182325148 learned_addr learned my addr 172.21.15.55:0/2182325148 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:37.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4eb6800640 1 --2- 172.21.15.55:0/2182325148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4eb80b41c0 0x7f4eb80b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:37.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4eb7200640 1 --2- 172.21.15.55:0/2182325148 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4eb815abb0 0x7f4eb80b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4eade00640 1 -- 172.21.15.55:0/2182325148 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4eb815abb0 msgr2=0x7f4eb80b3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4eade00640 1 --2- 172.21.15.55:0/2182325148 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4eb815abb0 0x7f4eb80b3320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4eade00640 1 -- 172.21.15.55:0/2182325148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4eb80b41c0 msgr2=0x7f4eb80b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4eade00640 1 --2- 172.21.15.55:0/2182325148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4eb80b41c0 0x7f4eb80b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4eade00640 1 -- 172.21.15.55:0/2182325148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea8009420 con 0x7f4eb8158360 2024-04-02T07:33:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4eade00640 1 --2- 172.21.15.55:0/2182325148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8158360 0x7f4eb80b2de0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000c430 tx=0x7f4ea000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4eaf400640 1 -- 172.21.15.55:0/2182325148 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea00052d0 con 0x7f4eb8158360 2024-04-02T07:33:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4eaf400640 1 -- 172.21.15.55:0/2182325148 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ea0005450 con 0x7f4eb8158360 2024-04-02T07:33:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4ebd400640 1 -- 172.21.15.55:0/2182325148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eb814f5a0 con 0x7f4eb8158360 2024-04-02T07:33:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.468+0000 7f4eaf400640 1 -- 172.21.15.55:0/2182325148 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ea0003840 con 0x7f4eb8158360 2024-04-02T07:33:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.472+0000 7f4ebd400640 1 -- 172.21.15.55:0/2182325148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eb814fb60 con 0x7f4eb8158360 2024-04-02T07:33:37.473 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.472+0000 7f4ebd400640 1 -- 172.21.15.55:0/2182325148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eb8066c90 con 0x7f4eb8158360 2024-04-02T07:33:37.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.472+0000 7f4eaf400640 1 -- 172.21.15.55:0/2182325148 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f4ea00039a0 con 0x7f4eb8158360 2024-04-02T07:33:37.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.472+0000 7f4eaf400640 1 --2- 172.21.15.55:0/2182325148 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4e94066690 0x7f4e94068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:37.474 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.472+0000 7f4eaf400640 1 -- 172.21.15.55:0/2182325148 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ea0083710 con 0x7f4eb8158360 2024-04-02T07:33:37.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.472+0000 7f4eb6800640 1 --2- 172.21.15.55:0/2182325148 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4e94066690 0x7f4e94068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:37.475 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.472+0000 7f4eb6800640 1 --2- 172.21.15.55:0/2182325148 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4e94066690 0x7f4e94068b50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80ae000 tx=0x7f4ea80a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:37.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.476+0000 7f4eaf400640 1 -- 172.21.15.55:0/2182325148 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f4ea0050b20 con 0x7f4eb8158360 2024-04-02T07:33:37.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.672+0000 7f4ebd400640 1 -- 172.21.15.55:0/2182325148 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4eb80cb140 con 0x7f4eb8158360 2024-04-02T07:33:37.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.672+0000 7f4eaf400640 1 -- 172.21.15.55:0/2182325148 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 96 v96) v1 ==== 94+0+4736 (secure 0 0 0) 0x7f4ea0054140 con 0x7f4eb8158360 2024-04-02T07:33:37.674 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:37.675 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":96,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7592,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2292883244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2292883244},{"type":"v1","addr":"172.21.15.106:6836","nonce":2292883244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":9147,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2700619140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2700619140},{"type":"v1","addr":"172.21.15.55:6834","nonce":2700619140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":9150,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/154663344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":154663344},{"type":"v1","addr":"172.21.15.55:6835","nonce":154663344}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":96,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:33:27.846433+0000","modified":"2024-04-02T07:33:30.856803+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9156},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9156":{"gid":9156,"name":"d","rank":0,"incarnation":93,"state":"up:active","state_seq":3,"addr":"172.21.15.106:6837/775582321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":775582321},{"type":"v1","addr":"172.21.15.106:6837","nonce":775582321}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-02T07:33:37.675 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 96 2024-04-02T07:33:37.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.676+0000 7f4ebd400640 1 -- 172.21.15.55:0/2182325148 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4e94066690 msgr2=0x7f4e94068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:37.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.676+0000 7f4ebd400640 1 --2- 172.21.15.55:0/2182325148 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4e94066690 0x7f4e94068b50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80ae000 tx=0x7f4ea80a7000 comp rx=0 tx=0).stop 2024-04-02T07:33:37.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.676+0000 7f4ebd400640 1 -- 172.21.15.55:0/2182325148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8158360 msgr2=0x7f4eb80b2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:37.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.676+0000 7f4ebd400640 1 --2- 172.21.15.55:0/2182325148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8158360 0x7f4eb80b2de0 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f4ea000c430 tx=0x7f4ea000c8f0 comp rx=0 tx=0).stop 2024-04-02T07:33:37.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.676+0000 7f4ebd400640 1 -- 172.21.15.55:0/2182325148 shutdown_connections 2024-04-02T07:33:37.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.676+0000 7f4ebd400640 1 --2- 172.21.15.55:0/2182325148 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f4eb815abb0 0x7f4eb80b3320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:37.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.676+0000 7f4ebd400640 1 --2- 172.21.15.55:0/2182325148 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4eb8158360 0x7f4eb80b2de0 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:37.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.676+0000 7f4ebd400640 1 --2- 172.21.15.55:0/2182325148 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f4e94066690 0x7f4e94068b50 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:37.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.676+0000 7f4ebd400640 1 --2- 172.21.15.55:0/2182325148 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f4eb80b41c0 0x7f4eb80b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:37.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.676+0000 7f4ebd400640 1 -- 172.21.15.55:0/2182325148 >> 172.21.15.55:0/2182325148 conn(0x7f4eb8069d90 msgr2=0x7f4eb8149e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:37.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.676+0000 7f4ebd400640 1 -- 172.21.15.55:0/2182325148 shutdown_connections 2024-04-02T07:33:37.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:37.676+0000 7f4ebd400640 1 -- 172.21.15.55:0/2182325148 wait complete. 2024-04-02T07:33:38.099 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 96, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:33:27.846433+0000', 'modified': '2024-04-02T07:33:30.856803+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9156}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9156': {'gid': 9156, 'name': 'd', 'rank': 0, 'incarnation': 93, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.106:6837/775582321', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.106:6834', 'nonce': 775582321}, {'type': 'v1', 'addr': '172.21.15.106:6837', 'nonce': 775582321}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:33:38.099 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-02T07:33:38.099 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-02T07:33:38.242 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.240+0000 7f869b400640 1 Processor -- start 2024-04-02T07:33:38.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.240+0000 7f869b400640 1 -- start start 2024-04-02T07:33:38.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.240+0000 7f869b400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f86941599c0 0x7f86940b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.240+0000 7f869b400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86940b38f0 0x7f86940c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.240+0000 7f869b400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86940b1d60 con 0x7f869406d1c0 2024-04-02T07:33:38.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.240+0000 7f869b400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f869406cda0 con 0x7f86940b38f0 2024-04-02T07:33:38.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.240+0000 7f869b400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f869406c400 con 0x7f86941599c0 2024-04-02T07:33:38.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.244+0000 7f8699400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86940b38f0 0x7f86940c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.244+0000 7f8699400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86940b38f0 0x7f86940c90d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60604/0 (socket says 172.21.15.55:60604) 2024-04-02T07:33:38.244 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.244+0000 7f8699400640 1 -- 172.21.15.55:0/2357843403 learned_addr learned my addr 172.21.15.55:0/2357843403 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:38.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.244+0000 7f8698a00640 1 --2- 172.21.15.55:0/2357843403 >> v2:172.21.15.106:3300/0 conn(0x7f86941599c0 0x7f86940b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.244+0000 7f8699400640 1 -- 172.21.15.55:0/2357843403 >> v2:172.21.15.106:3300/0 conn(0x7f86941599c0 msgr2=0x7f86940b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:38.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.244+0000 7f8699400640 1 --2- 172.21.15.55:0/2357843403 >> v2:172.21.15.106:3300/0 conn(0x7f86941599c0 0x7f86940b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.244+0000 7f8699400640 1 -- 172.21.15.55:0/2357843403 >> v1:172.21.15.106:6789/0 conn(0x7f869406d1c0 legacy=0x7f86940b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:38.245 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.244+0000 7f8699400640 1 -- 172.21.15.55:0/2357843403 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f869406c6e0 con 0x7f86940b38f0 2024-04-02T07:33:38.246 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.244+0000 7f8698a00640 1 --2- 172.21.15.55:0/2357843403 >> v2:172.21.15.106:3300/0 conn(0x7f86941599c0 0x7f86940b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:38.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.244+0000 7f8699400640 1 --2- 172.21.15.55:0/2357843403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86940b38f0 0x7f86940c90d0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f86940b1520 tx=0x7f868c01c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7406d14607110f7e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:38.247 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.244+0000 7f8693400640 1 -- 172.21.15.55:0/2357843403 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c0a5780 con 0x7f86940b38f0 2024-04-02T07:33:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.244+0000 7f8693400640 1 -- 172.21.15.55:0/2357843403 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868c0a58e0 con 0x7f86940b38f0 2024-04-02T07:33:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.244+0000 7f8693400640 1 -- 172.21.15.55:0/2357843403 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c0a5c70 con 0x7f86940b38f0 2024-04-02T07:33:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f869b400640 1 -- 172.21.15.55:0/2357843403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86940b38f0 msgr2=0x7f86940c90d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:38.248 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f869b400640 1 --2- 172.21.15.55:0/2357843403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86940b38f0 0x7f86940c90d0 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f86940b1520 tx=0x7f868c01c9b0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f869b400640 1 -- 172.21.15.55:0/2357843403 shutdown_connections 2024-04-02T07:33:38.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f869b400640 1 --2- 172.21.15.55:0/2357843403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86940b38f0 0x7f86940c90d0 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f869b400640 1 --2- 172.21.15.55:0/2357843403 >> v2:172.21.15.106:3300/0 conn(0x7f86941599c0 0x7f86940b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f869b400640 1 -- 172.21.15.55:0/2357843403 >> 172.21.15.55:0/2357843403 conn(0x7f8694069d90 msgr2=0x7f869406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:38.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f869b400640 1 -- 172.21.15.55:0/2357843403 shutdown_connections 2024-04-02T07:33:38.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f869b400640 1 -- 172.21.15.55:0/2357843403 wait complete. 2024-04-02T07:33:38.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f869b400640 1 Processor -- start 2024-04-02T07:33:38.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f869b400640 1 -- start start 2024-04-02T07:33:38.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f869b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f869406d1c0 0x7f8694153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f869b400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86940b38f0 0x7f8694151640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f869b400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86941599c0 0x7f8694149b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f869b400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86941520c0 con 0x7f869406d1c0 2024-04-02T07:33:38.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f869b400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86941523a0 con 0x7f86941599c0 2024-04-02T07:33:38.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f869b400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8694152680 con 0x7f86940b38f0 2024-04-02T07:33:38.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f8698a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f869406d1c0 0x7f8694153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f8698a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f869406d1c0 0x7f8694153820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60612/0 (socket says 172.21.15.55:60612) 2024-04-02T07:33:38.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f8698a00640 1 -- 172.21.15.55:0/3550209999 learned_addr learned my addr 172.21.15.55:0/3550209999 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:38.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f8693e00640 1 --2- 172.21.15.55:0/3550209999 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86940b38f0 0x7f8694151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f8699400640 1 --2- 172.21.15.55:0/3550209999 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86941599c0 0x7f8694149b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f8698a00640 1 -- 172.21.15.55:0/3550209999 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86940b38f0 msgr2=0x7f8694151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:38.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f8698a00640 1 --2- 172.21.15.55:0/3550209999 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86940b38f0 0x7f8694151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f8698a00640 1 -- 172.21.15.55:0/3550209999 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86941599c0 msgr2=0x7f8694149b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:38.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f8698a00640 1 --2- 172.21.15.55:0/3550209999 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86941599c0 0x7f8694149b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f8698a00640 1 -- 172.21.15.55:0/3550209999 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c009b30 con 0x7f869406d1c0 2024-04-02T07:33:38.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f8693e00640 1 --2- 172.21.15.55:0/3550209999 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86940b38f0 0x7f8694151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:38.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.248+0000 7f8698a00640 1 --2- 172.21.15.55:0/3550209999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f869406d1c0 0x7f8694153820 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f868800c7f0 tx=0x7f868800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:38.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.252+0000 7f8690c00640 1 -- 172.21.15.55:0/3550209999 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8688007820 con 0x7f869406d1c0 2024-04-02T07:33:38.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.252+0000 7f8690c00640 1 -- 172.21.15.55:0/3550209999 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8688007980 con 0x7f869406d1c0 2024-04-02T07:33:38.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.252+0000 7f8690c00640 1 -- 172.21.15.55:0/3550209999 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8688007d30 con 0x7f869406d1c0 2024-04-02T07:33:38.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.252+0000 7f869b400640 1 -- 172.21.15.55:0/3550209999 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8694152960 con 0x7f869406d1c0 2024-04-02T07:33:38.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.252+0000 7f869b400640 1 -- 172.21.15.55:0/3550209999 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f869414d7c0 con 0x7f869406d1c0 2024-04-02T07:33:38.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.252+0000 7f8690c00640 1 -- 172.21.15.55:0/3550209999 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f86880113f0 con 0x7f869406d1c0 2024-04-02T07:33:38.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.252+0000 7f8690c00640 1 --2- 172.21.15.55:0/3550209999 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8674066690 0x7f8674068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.252+0000 7f8690c00640 1 -- 172.21.15.55:0/3550209999 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8688084600 con 0x7f869406d1c0 2024-04-02T07:33:38.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f8693e00640 1 --2- 172.21.15.55:0/3550209999 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8674066690 0x7f8674068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f869e8ca000 1 Processor -- start 2024-04-02T07:33:38.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f869e8ca000 1 -- start start 2024-04-02T07:33:38.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f8693e00640 1 --2- 172.21.15.55:0/3550209999 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8674066690 0x7f8674068b50 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f86940cbb50 tx=0x7f8680009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:38.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f869e8ca000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7ddb0 0x5580b6c7e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f869e8ca000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5580b6c7e6d0 0x5580b6c33f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f869e8ca000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c344c0 0x5580b6c348a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f869e8ca000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580b6afc5a0 con 0x5580b6c7ddb0 2024-04-02T07:33:38.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f869e8ca000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580b6a89af0 con 0x5580b6c344c0 2024-04-02T07:33:38.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f869e8ca000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5580b6a870c0 con 0x5580b6c7e6d0 2024-04-02T07:33:38.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f8698a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7ddb0 0x5580b6c7e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f8698a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7ddb0 0x5580b6c7e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60618/0 (socket says 172.21.15.55:60618) 2024-04-02T07:33:38.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f8698a00640 1 -- 172.21.15.55:0/862140720 learned_addr learned my addr 172.21.15.55:0/862140720 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:38.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f8693e00640 1 --2- 172.21.15.55:0/862140720 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5580b6c7e6d0 0x5580b6c33f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f8699400640 1 --2- 172.21.15.55:0/862140720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c344c0 0x5580b6c348a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f8698a00640 1 -- 172.21.15.55:0/862140720 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5580b6c7e6d0 msgr2=0x5580b6c33f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:38.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f8698a00640 1 --2- 172.21.15.55:0/862140720 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5580b6c7e6d0 0x5580b6c33f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f8698a00640 1 -- 172.21.15.55:0/862140720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c344c0 msgr2=0x5580b6c348a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:38.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f8698a00640 1 --2- 172.21.15.55:0/862140720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c344c0 0x5580b6c348a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f8698a00640 1 -- 172.21.15.55:0/862140720 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580b677e890 con 0x5580b6c7ddb0 2024-04-02T07:33:38.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f8699400640 1 --2- 172.21.15.55:0/862140720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c344c0 0x5580b6c348a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:38.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f8698a00640 1 --2- 172.21.15.55:0/862140720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7ddb0 0x5580b6c7e190 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f8688006fd0 tx=0x7f8688054fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f1ef2e3b53df804 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:38.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f8685600640 1 -- 172.21.15.55:0/862140720 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86880593c0 con 0x5580b6c7ddb0 2024-04-02T07:33:38.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f8685600640 1 -- 172.21.15.55:0/862140720 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868805d980 con 0x5580b6c7ddb0 2024-04-02T07:33:38.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f8685600640 1 -- 172.21.15.55:0/862140720 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8688059170 con 0x5580b6c7ddb0 2024-04-02T07:33:38.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f869e8ca000 1 -- 172.21.15.55:0/862140720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7ddb0 msgr2=0x5580b6c7e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:38.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f869e8ca000 1 --2- 172.21.15.55:0/862140720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7ddb0 0x5580b6c7e190 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f8688006fd0 tx=0x7f8688054fb0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f869e8ca000 1 -- 172.21.15.55:0/862140720 shutdown_connections 2024-04-02T07:33:38.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f869e8ca000 1 --2- 172.21.15.55:0/862140720 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c344c0 0x5580b6c348a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f869e8ca000 1 --2- 172.21.15.55:0/862140720 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5580b6c7e6d0 0x5580b6c33f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f869e8ca000 1 --2- 172.21.15.55:0/862140720 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7ddb0 0x5580b6c7e190 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f869e8ca000 1 -- 172.21.15.55:0/862140720 >> 172.21.15.55:0/862140720 conn(0x5580b6c3a830 msgr2=0x5580b6c32860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:38.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f869e8ca000 1 -- 172.21.15.55:0/862140720 shutdown_connections 2024-04-02T07:33:38.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f869e8ca000 1 -- 172.21.15.55:0/862140720 wait complete. 2024-04-02T07:33:38.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.256+0000 7f869e8ca000 1 -- start start 2024-04-02T07:33:38.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f869e8ca000 1 Processor -- start 2024-04-02T07:33:38.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f869e8ca000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c344c0 0x5580b6c38410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f869e8ca000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5580b6c7ddb0 0x5580b6c38950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f869e8ca000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 0x5580b6c38e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f869e8ca000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580b6a829b0 con 0x5580b6c7e6d0 2024-04-02T07:33:38.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f869e8ca000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580b6a21c00 con 0x5580b6c344c0 2024-04-02T07:33:38.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f869e8ca000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5580b6a40070 con 0x5580b6c7ddb0 2024-04-02T07:33:38.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f869e8ca000 10 client.0 _ll_register_callbacks cb 0x5580b6c200e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:33:38.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f8699400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 0x5580b6c38e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f8699400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 0x5580b6c38e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60634/0 (socket says 172.21.15.55:60634) 2024-04-02T07:33:38.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f8699400640 1 -- 172.21.15.55:0/4250784956 learned_addr learned my addr 172.21.15.55:0/4250784956 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:38.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f8698a00640 1 --2- 172.21.15.55:0/4250784956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c344c0 0x5580b6c38410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f8693e00640 1 --2- 172.21.15.55:0/4250784956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5580b6c7ddb0 0x5580b6c38950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f8699400640 1 -- 172.21.15.55:0/4250784956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5580b6c7ddb0 msgr2=0x5580b6c38950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:38.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f8699400640 1 --2- 172.21.15.55:0/4250784956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5580b6c7ddb0 0x5580b6c38950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f8699400640 1 -- 172.21.15.55:0/4250784956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c344c0 msgr2=0x5580b6c38410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:38.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f8699400640 1 --2- 172.21.15.55:0/4250784956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c344c0 0x5580b6c38410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f8699400640 1 -- 172.21.15.55:0/4250784956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f869414d7c0 con 0x5580b6c7e6d0 2024-04-02T07:33:38.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f8699400640 1 --2- 172.21.15.55:0/4250784956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 0x5580b6c38e90 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f868c01b060 tx=0x7f868c01b1f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2a5f209eed58745 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:38.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f867a000640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:33:38.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f867a000640 1 -- 172.21.15.55:0/4250784956 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c0c0440 con 0x5580b6c7e6d0 2024-04-02T07:33:38.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f867a000640 1 -- 172.21.15.55:0/4250784956 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f868c0c05a0 con 0x5580b6c7e6d0 2024-04-02T07:33:38.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f869e8ca000 1 -- 172.21.15.55:0/4250784956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5580b6a3f5f0 con 0x5580b6c7e6d0 2024-04-02T07:33:38.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f867a000640 1 -- 172.21.15.55:0/4250784956 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) v2 ==== 24+0+0 (secure 0 0 0) 0x7f868c0c0760 con 0x5580b6c7e6d0 2024-04-02T07:33:38.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f869e8ca000 10 client.9315 fetch_fsmap learned FSMap version 96 2024-04-02T07:33:38.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f869e8ca000 1 -- 172.21.15.55:0/4250784956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) v3 -- 0x5580b6a47ab0 con 0x5580b6c7e6d0 2024-04-02T07:33:38.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f867a000640 1 -- 172.21.15.55:0/4250784956 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5580b6a3f5f0 con 0x5580b6c7e6d0 2024-04-02T07:33:38.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f867a000640 1 -- 172.21.15.55:0/4250784956 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 96) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f868c0c08c0 con 0x5580b6c7e6d0 2024-04-02T07:33:38.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f869e8ca000 10 client.9315 fetch_fsmap finished waiting for FSMap version 96 2024-04-02T07:33:38.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f869e8ca000 10 client.9315 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-02T07:33:38.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f869e8ca000 20 client.9315 populate_metadata read hostname 'smithi055' 2024-04-02T07:33:38.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f869e8ca000 1 --2- 172.21.15.55:0/4250784956 >> [v2:172.21.15.106:6834/775582321,v1:172.21.15.106:6837/775582321] conn(0x5580b6c90e80 0x5580b6c93270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f869e8ca000 4 client.9315 mds_command: new command op to 9156 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:33:38.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f869e8ca000 1 -- 172.21.15.55:0/4250784956 --> [v2:172.21.15.106:6834/775582321,v1:172.21.15.106:6837/775582321] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5580b6a7f790 con 0x5580b6c90e80 2024-04-02T07:33:38.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f8698a00640 1 --2- 172.21.15.55:0/4250784956 >> [v2:172.21.15.106:6834/775582321,v1:172.21.15.106:6837/775582321] conn(0x5580b6c90e80 0x5580b6c93270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f8698a00640 1 --2- 172.21.15.55:0/4250784956 >> [v2:172.21.15.106:6834/775582321,v1:172.21.15.106:6837/775582321] conn(0x5580b6c90e80 0x5580b6c93270 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7b93417813472a6 server_cookie=bf2fe5194617172c in_seq=0 out_seq=0 2024-04-02T07:33:38.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.260+0000 7f867a000640 10 client.9315 ms_handle_connect on v2:172.21.15.106:6834/775582321 2024-04-02T07:33:38.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.264+0000 7f867a000640 1 -- 172.21.15.55:0/4250784956 <== mds.0 v2:172.21.15.106:6834/775582321 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5580b6a7f790 con 0x5580b6c90e80 2024-04-02T07:33:38.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.264+0000 7f867a000640 10 client.9315 handle_command_reply: tid=0 2024-04-02T07:33:38.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.264+0000 7f869e8ca000 1 client.9315 shutdown 2024-04-02T07:33:38.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.264+0000 7f869e8ca000 1 -- 172.21.15.55:0/4250784956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 msgr2=0x5580b6c38e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:38.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.264+0000 7f869e8ca000 1 --2- 172.21.15.55:0/4250784956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 0x5580b6c38e90 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f868c01b060 tx=0x7f868c01b1f0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.264+0000 7f869e8ca000 1 -- 172.21.15.55:0/4250784956 shutdown_connections 2024-04-02T07:33:38.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.264+0000 7f869e8ca000 1 --2- 172.21.15.55:0/4250784956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 0x5580b6c38e90 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.268 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.264+0000 7f869e8ca000 1 --2- 172.21.15.55:0/4250784956 >> [v2:172.21.15.106:6834/775582321,v1:172.21.15.106:6837/775582321] conn(0x5580b6c90e80 0x5580b6c93270 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.264+0000 7f869e8ca000 1 --2- 172.21.15.55:0/4250784956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5580b6c7ddb0 0x5580b6c38950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.264+0000 7f869e8ca000 1 --2- 172.21.15.55:0/4250784956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c344c0 0x5580b6c38410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.264+0000 7f867a000640 0 client.9315 ms_handle_reset on v2:172.21.15.106:6834/775582321 2024-04-02T07:33:38.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.264+0000 7f869e8ca000 1 -- 172.21.15.55:0/4250784956 >> 172.21.15.55:0/4250784956 conn(0x5580b6c3a830 msgr2=0x5580b6c32f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:38.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.264+0000 7f869e8ca000 1 -- 172.21.15.55:0/4250784956 shutdown_connections 2024-04-02T07:33:38.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.264+0000 7f869e8ca000 1 -- 172.21.15.55:0/4250784956 wait complete. 2024-04-02T07:33:38.269 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.264+0000 7f869e8ca000 20 client.9315 trim_cache size 0 max 16384 2024-04-02T07:33:38.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f869e8ca000 1 Processor -- start 2024-04-02T07:33:38.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f869e8ca000 1 -- start start 2024-04-02T07:33:38.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f869e8ca000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5580b6c344c0 0x5580b6cdba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f869e8ca000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c7ddb0 0x5580b6cdbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f869e8ca000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 0x5580b6cdc510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f869e8ca000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580b673f940 con 0x5580b6c7e6d0 2024-04-02T07:33:38.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f869e8ca000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580b6c974c0 con 0x5580b6c7ddb0 2024-04-02T07:33:38.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f869e8ca000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5580b6a7fdb0 con 0x5580b6c344c0 2024-04-02T07:33:38.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f8699400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 0x5580b6cdc510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f8699400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 0x5580b6cdc510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60650/0 (socket says 172.21.15.55:60650) 2024-04-02T07:33:38.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f8699400640 1 -- 172.21.15.55:0/510583247 learned_addr learned my addr 172.21.15.55:0/510583247 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:38.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f8693e00640 1 --2- 172.21.15.55:0/510583247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c7ddb0 0x5580b6cdbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f8698a00640 1 --2- 172.21.15.55:0/510583247 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5580b6c344c0 0x5580b6cdba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f8699400640 1 -- 172.21.15.55:0/510583247 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5580b6c344c0 msgr2=0x5580b6cdba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:38.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f8699400640 1 --2- 172.21.15.55:0/510583247 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5580b6c344c0 0x5580b6cdba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f8699400640 1 -- 172.21.15.55:0/510583247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c7ddb0 msgr2=0x5580b6cdbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:38.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f8699400640 1 --2- 172.21.15.55:0/510583247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c7ddb0 0x5580b6cdbfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f8699400640 1 -- 172.21.15.55:0/510583247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5580b6a2dc00 con 0x5580b6c7e6d0 2024-04-02T07:33:38.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f8699400640 1 --2- 172.21.15.55:0/510583247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 0x5580b6cdc510 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f868c00c090 tx=0x7f868c0b7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32deb52d2b171d7c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:38.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f8686000640 1 -- 172.21.15.55:0/510583247 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c0b6c80 con 0x5580b6c7e6d0 2024-04-02T07:33:38.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f8686000640 1 -- 172.21.15.55:0/510583247 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868c0b6de0 con 0x5580b6c7e6d0 2024-04-02T07:33:38.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f8686000640 1 -- 172.21.15.55:0/510583247 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c0b65f0 con 0x5580b6c7e6d0 2024-04-02T07:33:38.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f869e8ca000 1 -- 172.21.15.55:0/510583247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 msgr2=0x5580b6cdc510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:38.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f869e8ca000 1 --2- 172.21.15.55:0/510583247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 0x5580b6cdc510 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f868c00c090 tx=0x7f868c0b7000 comp rx=0 tx=0).stop 2024-04-02T07:33:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f869e8ca000 1 -- 172.21.15.55:0/510583247 shutdown_connections 2024-04-02T07:33:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f869e8ca000 1 --2- 172.21.15.55:0/510583247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 0x5580b6cdc510 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f869e8ca000 1 --2- 172.21.15.55:0/510583247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c7ddb0 0x5580b6cdbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f869e8ca000 1 --2- 172.21.15.55:0/510583247 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5580b6c344c0 0x5580b6cdba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f869e8ca000 1 -- 172.21.15.55:0/510583247 >> 172.21.15.55:0/510583247 conn(0x5580b6c3a830 msgr2=0x5580b6c377c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f869e8ca000 1 -- 172.21.15.55:0/510583247 shutdown_connections 2024-04-02T07:33:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.280+0000 7f869e8ca000 1 -- 172.21.15.55:0/510583247 wait complete. 2024-04-02T07:33:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f869e8ca000 1 -- start start 2024-04-02T07:33:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f869e8ca000 1 Processor -- start 2024-04-02T07:33:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f869e8ca000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c344c0 0x5580b6cc71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f869e8ca000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5580b6c7ddb0 0x5580b6c7b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f869e8ca000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 0x5580b6c7be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f869e8ca000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580b6a8ad80 con 0x5580b6c7e6d0 2024-04-02T07:33:38.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f869e8ca000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5580b6a81840 con 0x5580b6c344c0 2024-04-02T07:33:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f869e8ca000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5580b6a49c60 con 0x5580b6c7ddb0 2024-04-02T07:33:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f869e8ca000 10 client.0 _ll_register_callbacks cb 0x5580b6a47590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:33:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f8699400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 0x5580b6c7be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f8699400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 0x5580b6c7be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60662/0 (socket says 172.21.15.55:60662) 2024-04-02T07:33:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f8699400640 1 -- 172.21.15.55:0/1949036323 learned_addr learned my addr 172.21.15.55:0/1949036323 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f8698a00640 1 --2- 172.21.15.55:0/1949036323 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c344c0 0x5580b6cc71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f8693e00640 1 --2- 172.21.15.55:0/1949036323 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5580b6c7ddb0 0x5580b6c7b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f8699400640 1 -- 172.21.15.55:0/1949036323 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5580b6c7ddb0 msgr2=0x5580b6c7b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f8699400640 1 --2- 172.21.15.55:0/1949036323 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5580b6c7ddb0 0x5580b6c7b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f8699400640 1 -- 172.21.15.55:0/1949036323 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c344c0 msgr2=0x5580b6cc71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f8699400640 1 --2- 172.21.15.55:0/1949036323 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c344c0 0x5580b6cc71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f8699400640 1 -- 172.21.15.55:0/1949036323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5580b6a47ab0 con 0x5580b6c7e6d0 2024-04-02T07:33:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f8699400640 1 --2- 172.21.15.55:0/1949036323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 0x5580b6c7be70 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f868c0093e0 tx=0x7f868c009810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760509c43176219b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f867a000640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:33:38.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f867a000640 1 -- 172.21.15.55:0/1949036323 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868c0c0850 con 0x5580b6c7e6d0 2024-04-02T07:33:38.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f867a000640 1 -- 172.21.15.55:0/1949036323 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f868c0c0d80 con 0x5580b6c7e6d0 2024-04-02T07:33:38.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f869e8ca000 1 -- 172.21.15.55:0/1949036323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5580b6a52460 con 0x5580b6c7e6d0 2024-04-02T07:33:38.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f867a000640 1 -- 172.21.15.55:0/1949036323 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) v2 ==== 24+0+0 (secure 0 0 0) 0x7f868c0a5a50 con 0x5580b6c7e6d0 2024-04-02T07:33:38.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f869e8ca000 10 client.9321 fetch_fsmap learned FSMap version 96 2024-04-02T07:33:38.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f869e8ca000 1 -- 172.21.15.55:0/1949036323 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) v3 -- 0x5580b677ecc0 con 0x5580b6c7e6d0 2024-04-02T07:33:38.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f867a000640 1 -- 172.21.15.55:0/1949036323 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5580b6a52460 con 0x5580b6c7e6d0 2024-04-02T07:33:38.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f867a000640 1 -- 172.21.15.55:0/1949036323 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 96) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f868c004040 con 0x5580b6c7e6d0 2024-04-02T07:33:38.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f869e8ca000 10 client.9321 fetch_fsmap finished waiting for FSMap version 96 2024-04-02T07:33:38.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f869e8ca000 10 client.9321 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-02T07:33:38.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f869e8ca000 20 client.9321 populate_metadata read hostname 'smithi055' 2024-04-02T07:33:38.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f869e8ca000 1 --2- 172.21.15.55:0/1949036323 >> [v2:172.21.15.106:6834/775582321,v1:172.21.15.106:6837/775582321] conn(0x5580b6c7c3b0 0x5580b6c7c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f869e8ca000 4 client.9321 mds_command: new command op to 9156 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-02T07:33:38.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f869e8ca000 1 -- 172.21.15.55:0/1949036323 --> [v2:172.21.15.106:6834/775582321,v1:172.21.15.106:6837/775582321] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5580b6a4b9c0 con 0x5580b6c7c3b0 2024-04-02T07:33:38.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.284+0000 7f8698a00640 1 --2- 172.21.15.55:0/1949036323 >> [v2:172.21.15.106:6834/775582321,v1:172.21.15.106:6837/775582321] conn(0x5580b6c7c3b0 0x5580b6c7c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f8698a00640 1 --2- 172.21.15.55:0/1949036323 >> [v2:172.21.15.106:6834/775582321,v1:172.21.15.106:6837/775582321] conn(0x5580b6c7c3b0 0x5580b6c7c790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17730b86a628057 server_cookie=6615cc7ba9f1ff28 in_seq=0 out_seq=0 2024-04-02T07:33:38.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f867a000640 10 client.9321 ms_handle_connect on v2:172.21.15.106:6834/775582321 2024-04-02T07:33:38.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f867a000640 1 -- 172.21.15.55:0/1949036323 <== mds.0 v2:172.21.15.106:6834/775582321 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x5580b6a4b9c0 con 0x5580b6c7c3b0 2024-04-02T07:33:38.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f867a000640 10 client.9321 handle_command_reply: tid=0 2024-04-02T07:33:38.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869e8ca000 1 client.9321 shutdown 2024-04-02T07:33:38.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869e8ca000 1 -- 172.21.15.55:0/1949036323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 msgr2=0x5580b6c7be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:38.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869e8ca000 1 --2- 172.21.15.55:0/1949036323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 0x5580b6c7be70 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f868c0093e0 tx=0x7f868c009810 comp rx=0 tx=0).stop 2024-04-02T07:33:38.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869e8ca000 1 -- 172.21.15.55:0/1949036323 shutdown_connections 2024-04-02T07:33:38.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869e8ca000 1 --2- 172.21.15.55:0/1949036323 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5580b6c7e6d0 0x5580b6c7be70 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869e8ca000 1 --2- 172.21.15.55:0/1949036323 >> [v2:172.21.15.106:6834/775582321,v1:172.21.15.106:6837/775582321] conn(0x5580b6c7c3b0 0x5580b6c7c790 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869e8ca000 1 --2- 172.21.15.55:0/1949036323 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5580b6c7ddb0 0x5580b6c7b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869e8ca000 1 --2- 172.21.15.55:0/1949036323 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5580b6c344c0 0x5580b6cc71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f867a000640 0 client.9321 ms_handle_reset on v2:172.21.15.106:6834/775582321 2024-04-02T07:33:38.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869e8ca000 1 -- 172.21.15.55:0/1949036323 >> 172.21.15.55:0/1949036323 conn(0x5580b6c3a830 msgr2=0x5580b6c37ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:38.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869e8ca000 1 -- 172.21.15.55:0/1949036323 shutdown_connections 2024-04-02T07:33:38.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869e8ca000 1 -- 172.21.15.55:0/1949036323 wait complete. 2024-04-02T07:33:38.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869e8ca000 20 client.9321 trim_cache size 0 max 16384 2024-04-02T07:33:38.293 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:33:38.293 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "642a0456-a2ac-49a4-91a5-3b3449b512da", 2024-04-02T07:33:38.293 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-02T07:33:38.294 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 9156, 2024-04-02T07:33:38.294 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-02T07:33:38.294 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-02T07:33:38.294 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-02T07:33:38.294 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 10.443114205000001, 2024-04-02T07:33:38.294 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 96, 2024-04-02T07:33:38.294 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 116, 2024-04-02T07:33:38.294 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 116, 2024-04-02T07:33:38.294 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 14.75375318 2024-04-02T07:33:38.294 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:33:38.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869b400640 1 -- 172.21.15.55:0/3550209999 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8674066690 msgr2=0x7f8674068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:38.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869b400640 1 --2- 172.21.15.55:0/3550209999 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8674066690 0x7f8674068b50 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f86940cbb50 tx=0x7f8680009040 comp rx=0 tx=0).stop 2024-04-02T07:33:38.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869b400640 1 -- 172.21.15.55:0/3550209999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f869406d1c0 msgr2=0x7f8694153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:38.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869b400640 1 --2- 172.21.15.55:0/3550209999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f869406d1c0 0x7f8694153820 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7f868800c7f0 tx=0x7f868800ccb0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869b400640 1 -- 172.21.15.55:0/3550209999 shutdown_connections 2024-04-02T07:33:38.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869b400640 1 --2- 172.21.15.55:0/3550209999 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8674066690 0x7f8674068b50 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869b400640 1 --2- 172.21.15.55:0/3550209999 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f86941599c0 0x7f8694149b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869b400640 1 --2- 172.21.15.55:0/3550209999 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f86940b38f0 0x7f8694151640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869b400640 1 --2- 172.21.15.55:0/3550209999 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f869406d1c0 0x7f8694153820 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869b400640 1 -- 172.21.15.55:0/3550209999 >> 172.21.15.55:0/3550209999 conn(0x7f8694069d90 msgr2=0x7f86940cc5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:38.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869b400640 1 -- 172.21.15.55:0/3550209999 shutdown_connections 2024-04-02T07:33:38.296 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.288+0000 7f869b400640 1 -- 172.21.15.55:0/3550209999 wait complete. 2024-04-02T07:33:38.308 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-02T07:33:38.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.448+0000 7ff7dc600640 1 Processor -- start 2024-04-02T07:33:38.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.448+0000 7ff7dc600640 1 -- start start 2024-04-02T07:33:38.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.448+0000 7ff7dc600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7d4099120 0x7ff7d40b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.448+0000 7ff7dc600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff7d406aff0 0x7ff7d406b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.448+0000 7ff7dc600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7d415ce50 con 0x7ff7d415ca70 2024-04-02T07:33:38.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.448+0000 7ff7dc600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7d40cef60 con 0x7ff7d406aff0 2024-04-02T07:33:38.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.448+0000 7ff7dc600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d406bd60 con 0x7ff7d4099120 2024-04-02T07:33:38.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.448+0000 7ff7da600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff7d406aff0 0x7ff7d406b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.448+0000 7ff7d9200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7d4099120 0x7ff7d40b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.448+0000 7ff7da600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff7d406aff0 0x7ff7d406b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:60726/0 (socket says 172.21.15.55:60726) 2024-04-02T07:33:38.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.448+0000 7ff7da600640 1 -- 172.21.15.55:0/2174395801 learned_addr learned my addr 172.21.15.55:0/2174395801 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:38.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.448+0000 7ff7da600640 1 -- 172.21.15.55:0/2174395801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7d4099120 msgr2=0x7ff7d40b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:38.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.448+0000 7ff7da600640 1 --2- 172.21.15.55:0/2174395801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7d4099120 0x7ff7d40b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.448+0000 7ff7da600640 1 -- 172.21.15.55:0/2174395801 >> v1:172.21.15.106:6789/0 conn(0x7ff7d415ca70 legacy=0x7ff7d4098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:38.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.448+0000 7ff7da600640 1 -- 172.21.15.55:0/2174395801 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d406c040 con 0x7ff7d406aff0 2024-04-02T07:33:38.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.452+0000 7ff7da600640 1 --2- 172.21.15.55:0/2174395801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7d406aff0 0x7ff7d406b480 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009e50 tx=0x7ff7cc01ca00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f82b9eda0ee949b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:38.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.452+0000 7ff7d3e00640 1 -- 172.21.15.55:0/2174395801 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc0a58f0 con 0x7ff7d406aff0 2024-04-02T07:33:38.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.452+0000 7ff7d3e00640 1 -- 172.21.15.55:0/2174395801 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7cc0a5a50 con 0x7ff7d406aff0 2024-04-02T07:33:38.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.452+0000 7ff7d3e00640 1 -- 172.21.15.55:0/2174395801 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7cc0a5de0 con 0x7ff7d406aff0 2024-04-02T07:33:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.452+0000 7ff7dc600640 1 -- 172.21.15.55:0/2174395801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7d406aff0 msgr2=0x7ff7d406b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.452+0000 7ff7dc600640 1 --2- 172.21.15.55:0/2174395801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7d406aff0 0x7ff7d406b480 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc009e50 tx=0x7ff7cc01ca00 comp rx=0 tx=0).stop 2024-04-02T07:33:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.452+0000 7ff7dc600640 1 -- 172.21.15.55:0/2174395801 shutdown_connections 2024-04-02T07:33:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.452+0000 7ff7dc600640 1 --2- 172.21.15.55:0/2174395801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7d406aff0 0x7ff7d406b480 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.452+0000 7ff7dc600640 1 --2- 172.21.15.55:0/2174395801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7d4099120 0x7ff7d40b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.452+0000 7ff7dc600640 1 -- 172.21.15.55:0/2174395801 >> 172.21.15.55:0/2174395801 conn(0x7ff7d40b21d0 msgr2=0x7ff7d40b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.452+0000 7ff7dc600640 1 -- 172.21.15.55:0/2174395801 shutdown_connections 2024-04-02T07:33:38.455 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.452+0000 7ff7dc600640 1 -- 172.21.15.55:0/2174395801 wait complete. 2024-04-02T07:33:38.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7dc600640 1 Processor -- start 2024-04-02T07:33:38.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7dc600640 1 -- start start 2024-04-02T07:33:38.458 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7dc600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7d406aff0 0x7ff7d415b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7dc600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7d4099120 0x7ff7d414b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7dc600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7d415ca70 0x7ff7d4153f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7dc600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d415ab80 con 0x7ff7d4099120 2024-04-02T07:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7dc600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d4159f00 con 0x7ff7d415ca70 2024-04-02T07:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7dc600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7d415a1e0 con 0x7ff7d406aff0 2024-04-02T07:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7d9200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7d4099120 0x7ff7d414b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7d9200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7d4099120 0x7ff7d414b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60668/0 (socket says 172.21.15.55:60668) 2024-04-02T07:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7d9200640 1 -- 172.21.15.55:0/2755053395 learned_addr learned my addr 172.21.15.55:0/2755053395 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7da600640 1 --2- 172.21.15.55:0/2755053395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7d415ca70 0x7ff7d4153f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7d9c00640 1 --2- 172.21.15.55:0/2755053395 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7d406aff0 0x7ff7d415b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7d9200640 1 -- 172.21.15.55:0/2755053395 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7d406aff0 msgr2=0x7ff7d415b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7d9200640 1 --2- 172.21.15.55:0/2755053395 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7d406aff0 0x7ff7d415b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7d9200640 1 -- 172.21.15.55:0/2755053395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7d415ca70 msgr2=0x7ff7d4153f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:38.459 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7d9200640 1 --2- 172.21.15.55:0/2755053395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7d415ca70 0x7ff7d4153f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7d9200640 1 -- 172.21.15.55:0/2755053395 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7cc009b30 con 0x7ff7d4099120 2024-04-02T07:33:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7da600640 1 --2- 172.21.15.55:0/2755053395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7d415ca70 0x7ff7d4153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7d9200640 1 --2- 172.21.15.55:0/2755053395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7d4099120 0x7ff7d414b830 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000e930 tx=0x7ff7c000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7d1600640 1 -- 172.21.15.55:0/2755053395 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c0009690 con 0x7ff7d4099120 2024-04-02T07:33:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7d1600640 1 -- 172.21.15.55:0/2755053395 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7c000ca00 con 0x7ff7d4099120 2024-04-02T07:33:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7d1600640 1 -- 172.21.15.55:0/2755053395 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7c000cd70 con 0x7ff7d4099120 2024-04-02T07:33:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7dc600640 1 -- 172.21.15.55:0/2755053395 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7d415a4c0 con 0x7ff7d4099120 2024-04-02T07:33:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7dc600640 1 -- 172.21.15.55:0/2755053395 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7d40ad950 con 0x7ff7d4099120 2024-04-02T07:33:38.460 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.456+0000 7ff7dc600640 1 -- 172.21.15.55:0/2755053395 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7d4066c90 con 0x7ff7d4099120 2024-04-02T07:33:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.460+0000 7ff7d1600640 1 -- 172.21.15.55:0/2755053395 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff7c0013470 con 0x7ff7d4099120 2024-04-02T07:33:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.460+0000 7ff7d1600640 1 --2- 172.21.15.55:0/2755053395 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff7b4066690 0x7ff7b4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.460+0000 7ff7d1600640 1 -- 172.21.15.55:0/2755053395 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff7c00843a0 con 0x7ff7d4099120 2024-04-02T07:33:38.461 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.460+0000 7ff7d9c00640 1 --2- 172.21.15.55:0/2755053395 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff7b4066690 0x7ff7b4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:38.462 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.460+0000 7ff7d9c00640 1 --2- 172.21.15.55:0/2755053395 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff7b4066690 0x7ff7b4068b50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff7d40afd80 tx=0x7ff7c8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:38.465 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.464+0000 7ff7d1600640 1 -- 172.21.15.55:0/2755053395 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff7c0051870 con 0x7ff7d4099120 2024-04-02T07:33:38.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.660+0000 7ff7dc600640 1 -- 172.21.15.55:0/2755053395 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff7d40b6660 con 0x7ff7d4099120 2024-04-02T07:33:38.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.660+0000 7ff7d1600640 1 -- 172.21.15.55:0/2755053395 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v96) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff7c0054e90 con 0x7ff7d4099120 2024-04-02T07:33:38.662 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-02T07:33:38.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.664+0000 7ff7dc600640 1 -- 172.21.15.55:0/2755053395 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff7b4066690 msgr2=0x7ff7b4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:38.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.664+0000 7ff7dc600640 1 --2- 172.21.15.55:0/2755053395 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff7b4066690 0x7ff7b4068b50 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff7d40afd80 tx=0x7ff7c8009040 comp rx=0 tx=0).stop 2024-04-02T07:33:38.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.664+0000 7ff7dc600640 1 -- 172.21.15.55:0/2755053395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7d4099120 msgr2=0x7ff7d414b830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:38.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.664+0000 7ff7dc600640 1 --2- 172.21.15.55:0/2755053395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7d4099120 0x7ff7d414b830 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7ff7c000e930 tx=0x7ff7c000edf0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.664+0000 7ff7dc600640 1 -- 172.21.15.55:0/2755053395 shutdown_connections 2024-04-02T07:33:38.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.664+0000 7ff7dc600640 1 --2- 172.21.15.55:0/2755053395 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff7b4066690 0x7ff7b4068b50 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.664+0000 7ff7dc600640 1 --2- 172.21.15.55:0/2755053395 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff7d415ca70 0x7ff7d4153f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.664+0000 7ff7dc600640 1 --2- 172.21.15.55:0/2755053395 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff7d4099120 0x7ff7d414b830 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.664+0000 7ff7dc600640 1 --2- 172.21.15.55:0/2755053395 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff7d406aff0 0x7ff7d415b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:38.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.664+0000 7ff7dc600640 1 -- 172.21.15.55:0/2755053395 >> 172.21.15.55:0/2755053395 conn(0x7ff7d40b21d0 msgr2=0x7ff7d415bcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:38.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.664+0000 7ff7dc600640 1 -- 172.21.15.55:0/2755053395 shutdown_connections 2024-04-02T07:33:38.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:38.664+0000 7ff7dc600640 1 -- 172.21.15.55:0/2755053395 wait complete. 2024-04-02T07:33:38.684 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-02T07:33:38.684 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-02T07:33:38.684 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-02T07:33:38.684 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-02T07:33:38.684 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-02T07:33:38.684 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-02T07:33:38.684 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-02T07:33:38.684 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-02T07:33:38.684 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:33:38.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:38.685 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-02T07:33:38.694 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:33:38.695 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:33:38.695 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:33:38.695 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:33:38.695 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-02T07:33:38.695 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:33:38.696 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:33:38.696 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:33:38.696 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-02T07:33:38.696 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:33:38.696 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:33:38.696 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-02T07:33:38.696 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-02T07:33:38.696 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:33:38.696 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-02T07:33:38.696 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-02T07:33:38.696 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41776sec preferred_lft 41776sec 2024-04-02T07:33:38.696 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2024-04-02T07:33:38.696 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:33:38.697 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:33:38.697 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:33:38.697 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-02T07:33:38.697 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-02T07:33:38.697 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:81:5a:89:17 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:33:38.697 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-02T07:33:38.697 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:33:38.697 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:33:38.697 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-02T07:33:38.697 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-02T07:33:38.697 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:33:38.697 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-02T07:33:38.697 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:33:38.697 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:33:38.698 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-02T07:33:38.698 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-02T07:33:38.698 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:33:38.698 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:33:38.698 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-02T07:33:38.698 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-02T07:33:38.698 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:33:38.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:38.698 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-02T07:33:38.753 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:33:38.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:38.756 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-02T07:33:38.809 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-02T07:33:38.809 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-02T07:33:38.809 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-02T07:33:38.809 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-02T07:33:38.809 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-02T07:33:38.810 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-02T07:33:38.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:38.810 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:33:38.810 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:33:38.810 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-02T07:33:38.810 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-02T07:33:38.810 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-02T07:33:38.810 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:33:38.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:38.901 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-02T07:33:38.911 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-02T07:33:38.911 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-02T07:33:38.911 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:33:38.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:38.911 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-02T07:33:38.971 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-02T07:33:38.971 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:33:38.971 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-02T07:33:39.020 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:33:39.020 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:33:39.020 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:33:39.071 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:33:39.132 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:33:39.132 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:33:39.193 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:33:39.195 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:33:39.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:39.196 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:33:39.248 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-02T07:33:39.248 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-02T07:33:39.298 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:33:39.319 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:33:39.319 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:33:39.378 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:33:39.380 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:33:39.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:39.380 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:33:39.393 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:2024-04-02T07:33:39.392+0000 7f3ccba80580 -1 init, newargv = 0x5561a3238dd0 newargc=15 2024-04-02T07:33:39.394 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[52189]: starting ceph client 2024-04-02T07:33:39.402 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[52189]: starting fuse 2024-04-02T07:33:39.402 INFO:teuthology.orchestra.run.smithi055.stdout:43 2024-04-02T07:33:39.403 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-02T07:33:39.403 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:33:39.403 DEBUG:teuthology.orchestra.run.smithi055:> import glob 2024-04-02T07:33:39.403 DEBUG:teuthology.orchestra.run.smithi055:> import re 2024-04-02T07:33:39.403 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:33:39.403 DEBUG:teuthology.orchestra.run.smithi055:> import subprocess 2024-04-02T07:33:39.403 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:33:39.403 DEBUG:teuthology.orchestra.run.smithi055:> def _find_admin_socket(client_name): 2024-04-02T07:33:39.403 DEBUG:teuthology.orchestra.run.smithi055:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-02T07:33:39.403 DEBUG:teuthology.orchestra.run.smithi055:> files = glob.glob(asok_path) 2024-04-02T07:33:39.403 DEBUG:teuthology.orchestra.run.smithi055:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-02T07:33:39.404 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:33:39.404 DEBUG:teuthology.orchestra.run.smithi055:> # Given a non-glob path, it better be there 2024-04-02T07:33:39.404 DEBUG:teuthology.orchestra.run.smithi055:> if "*" not in asok_path: 2024-04-02T07:33:39.404 DEBUG:teuthology.orchestra.run.smithi055:> assert(len(files) == 1) 2024-04-02T07:33:39.404 DEBUG:teuthology.orchestra.run.smithi055:> return files[0] 2024-04-02T07:33:39.404 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:33:39.404 DEBUG:teuthology.orchestra.run.smithi055:> for f in files: 2024-04-02T07:33:39.404 DEBUG:teuthology.orchestra.run.smithi055:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-02T07:33:39.404 DEBUG:teuthology.orchestra.run.smithi055:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-02T07:33:39.404 DEBUG:teuthology.orchestra.run.smithi055:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-02T07:33:39.404 DEBUG:teuthology.orchestra.run.smithi055:> contents = proc_f.read() 2024-04-02T07:33:39.404 DEBUG:teuthology.orchestra.run.smithi055:> if mountpoint in contents: 2024-04-02T07:33:39.404 DEBUG:teuthology.orchestra.run.smithi055:> return f 2024-04-02T07:33:39.405 DEBUG:teuthology.orchestra.run.smithi055:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-02T07:33:39.405 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:33:39.405 DEBUG:teuthology.orchestra.run.smithi055:> print(_find_admin_socket("client.0")) 2024-04-02T07:33:39.405 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:33:39.528 INFO:teuthology.orchestra.run.smithi055.stdout:/var/run/ceph/ceph-client.0.52189.asok 2024-04-02T07:33:39.713 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.52189.asok 2024-04-02T07:33:39.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:39.714 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.52189.asok status 2024-04-02T07:33:39.887 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:33:39.887 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": { 2024-04-02T07:33:39.887 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_sha1": "d0e392d9aee635f2b65768c460c7a151ead7a5e2", 2024-04-02T07:33:39.887 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)", 2024-04-02T07:33:39.887 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "0", 2024-04-02T07:33:39.887 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2024-04-02T07:33:39.887 INFO:teuthology.orchestra.run.smithi055.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-02T07:33:39.887 INFO:teuthology.orchestra.run.smithi055.stdout: "pid": "52189", 2024-04-02T07:33:39.887 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2024-04-02T07:33:39.888 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:39.888 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_count": 0, 2024-04-02T07:33:39.888 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_pinned_count": 0, 2024-04-02T07:33:39.888 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 9333, 2024-04-02T07:33:39.888 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": { 2024-04-02T07:33:39.888 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2024-04-02T07:33:39.888 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2024-04-02T07:33:39.888 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 9333 2024-04-02T07:33:39.888 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:39.888 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:33:39.888 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:33:39.888 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:33:39.888 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 4150756950 2024-04-02T07:33:39.888 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:39.889 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:39.889 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:33:39.889 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:33:39.889 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:33:39.889 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 4150756950 2024-04-02T07:33:39.889 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:39.889 INFO:teuthology.orchestra.run.smithi055.stdout: "inst_str": "client.9333 192.168.0.1:0/4150756950", 2024-04-02T07:33:39.889 INFO:teuthology.orchestra.run.smithi055.stdout: "addr_str": "192.168.0.1:0/4150756950", 2024-04-02T07:33:39.889 INFO:teuthology.orchestra.run.smithi055.stdout: "inode_count": 1, 2024-04-02T07:33:39.889 INFO:teuthology.orchestra.run.smithi055.stdout: "mds_epoch": 96, 2024-04-02T07:33:39.890 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch": 116, 2024-04-02T07:33:39.890 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch_barrier": 0, 2024-04-02T07:33:39.890 INFO:teuthology.orchestra.run.smithi055.stdout: "blocklisted": false, 2024-04-02T07:33:39.890 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs" 2024-04-02T07:33:39.890 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:33:39.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:39.902 DEBUG:teuthology.orchestra.run.smithi055:> stat --file-system '--printf=%T 2024-04-02T07:33:39.903 DEBUG:teuthology.orchestra.run.smithi055:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-02T07:33:39.912 INFO:teuthology.orchestra.run.smithi055.stdout:fuseblk 2024-04-02T07:33:39.912 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-02T07:33:39.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:39.912 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:33:39.980 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:33:39.980 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:33:39.980 DEBUG:teuthology.orchestra.run.smithi055:> mount_point = "/home/ubuntu/cephtest/mnt.0" 2024-04-02T07:33:39.980 DEBUG:teuthology.orchestra.run.smithi055:> parent = os.path.join(mount_point, "parent") 2024-04-02T07:33:39.980 DEBUG:teuthology.orchestra.run.smithi055:> os.mkdir(parent) 2024-04-02T07:33:39.980 DEBUG:teuthology.orchestra.run.smithi055:> flushed = os.path.join(parent, "flushed") 2024-04-02T07:33:39.981 DEBUG:teuthology.orchestra.run.smithi055:> os.mkdir(flushed) 2024-04-02T07:33:39.981 DEBUG:teuthology.orchestra.run.smithi055:> for f in ["alpha", "bravo", "charlie"]: 2024-04-02T07:33:39.981 DEBUG:teuthology.orchestra.run.smithi055:> open(os.path.join(flushed, f), '"'"'w'"'"').write(f) 2024-04-02T07:33:39.981 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:33:40.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:40.277 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-02T07:33:40.346 INFO:teuthology.orchestra.run.smithi055.stdout:./ 2024-04-02T07:33:40.346 INFO:teuthology.orchestra.run.smithi055.stdout:./parent 2024-04-02T07:33:40.346 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed 2024-04-02T07:33:40.346 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed/charlie 2024-04-02T07:33:40.346 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed/alpha 2024-04-02T07:33:40.346 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed/bravo 2024-04-02T07:33:40.347 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:33:40.347 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:33:40.348 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:33:40.348 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:33:40.348 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-02T07:33:40.348 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:33:40.459 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:33:40.649 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:33:40.649 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:33:40.649 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:33:40.649 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:33:40.649 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-02T07:33:40.649 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:33:40.756 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627776 2024-04-02T07:33:40.945 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:33:40.945 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:33:40.945 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:33:40.946 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:33:40.946 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-02T07:33:40.946 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:33:41.056 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627777 2024-04-02T07:33:41.246 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:33:41.246 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:33:41.246 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:33:41.246 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:33:41.246 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-02T07:33:41.247 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:33:41.352 INFO:teuthology.orchestra.run.smithi055.stdout:1099511628280 2024-04-02T07:33:41.543 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:33:41.543 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:33:41.543 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:33:41.543 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:33:41.543 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-02T07:33:41.543 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:33:41.652 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627778 2024-04-02T07:33:41.842 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:33:41.842 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:33:41.842 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:33:41.842 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:33:41.842 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-04-02T07:33:41.842 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:33:41.948 INFO:teuthology.orchestra.run.smithi055.stdout:1099511628279 2024-04-02T07:33:42.138 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:33:42.138 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:33:42.189 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:33:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.368+0000 7f2284800640 1 Processor -- start 2024-04-02T07:33:42.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.368+0000 7f2284800640 1 -- start start 2024-04-02T07:33:42.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.372+0000 7f2284800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f227c156f70 0x7f227c15d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:42.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.372+0000 7f2284800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f227c0b26b0 0x7f227c0b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:42.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.372+0000 7f2284800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f227c15d950 con 0x7f227c157350 2024-04-02T07:33:42.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.372+0000 7f2284800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f227c15dc30 con 0x7f227c0b26b0 2024-04-02T07:33:42.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.372+0000 7f2284800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c15df10 con 0x7f227c156f70 2024-04-02T07:33:42.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.372+0000 7f2281400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f227c157350 0x7f227c0cfd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:33998/0 (socket says 172.21.15.55:33998) 2024-04-02T07:33:42.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.372+0000 7f2281400640 1 -- 172.21.15.55:0/3142908032 learned_addr learned my addr 172.21.15.55:0/3142908032 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:42.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.372+0000 7f2282800640 1 --2- 172.21.15.55:0/3142908032 >> v2:172.21.15.55:3300/0 conn(0x7f227c0b26b0 0x7f227c0b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:42.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.372+0000 7f2281e00640 1 --2- 172.21.15.55:0/3142908032 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f227c156f70 0x7f227c15d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:42.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.372+0000 7f2280a00640 1 -- 172.21.15.55:0/3142908032 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 872378903 0 0) 0x7f227c15d950 con 0x7f227c157350 2024-04-02T07:33:42.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.372+0000 7f2282800640 1 -- 172.21.15.55:0/3142908032 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f227c156f70 msgr2=0x7f227c15d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:42.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.372+0000 7f2282800640 1 --2- 172.21.15.55:0/3142908032 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f227c156f70 0x7f227c15d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:42.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.372+0000 7f2282800640 1 -- 172.21.15.55:0/3142908032 >> v1:172.21.15.55:6789/0 conn(0x7f227c157350 legacy=0x7f227c0cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:42.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.372+0000 7f2282800640 1 -- 172.21.15.55:0/3142908032 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f227c0cf560 con 0x7f227c0b26b0 2024-04-02T07:33:42.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.372+0000 7f2281e00640 1 --2- 172.21.15.55:0/3142908032 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f227c156f70 0x7f227c15d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:42.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2282800640 1 --2- 172.21.15.55:0/3142908032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f227c0b26b0 0x7f227c0b31c0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f2278009d90 tx=0x7f227801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f020a3d61d4bf53 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:42.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2280a00640 1 -- 172.21.15.55:0/3142908032 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22780a5910 con 0x7f227c0b26b0 2024-04-02T07:33:42.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2280a00640 1 -- 172.21.15.55:0/3142908032 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22780a5a70 con 0x7f227c0b26b0 2024-04-02T07:33:42.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2280a00640 1 -- 172.21.15.55:0/3142908032 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22780a5e00 con 0x7f227c0b26b0 2024-04-02T07:33:42.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2284800640 1 -- 172.21.15.55:0/3142908032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f227c0b26b0 msgr2=0x7f227c0b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:42.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2284800640 1 --2- 172.21.15.55:0/3142908032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f227c0b26b0 0x7f227c0b31c0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f2278009d90 tx=0x7f227801c940 comp rx=0 tx=0).stop 2024-04-02T07:33:42.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2284800640 1 -- 172.21.15.55:0/3142908032 shutdown_connections 2024-04-02T07:33:42.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2284800640 1 --2- 172.21.15.55:0/3142908032 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f227c0b26b0 0x7f227c0b31c0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:42.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2284800640 1 --2- 172.21.15.55:0/3142908032 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f227c156f70 0x7f227c15d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:42.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2284800640 1 -- 172.21.15.55:0/3142908032 >> 172.21.15.55:0/3142908032 conn(0x7f227c0b13b0 msgr2=0x7f227c0b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:42.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2284800640 1 -- 172.21.15.55:0/3142908032 shutdown_connections 2024-04-02T07:33:42.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2284800640 1 -- 172.21.15.55:0/3142908032 wait complete. 2024-04-02T07:33:42.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2284800640 1 Processor -- start 2024-04-02T07:33:42.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2284800640 1 -- start start 2024-04-02T07:33:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2284800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f227c0b26b0 0x7f227c0cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2284800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f227c156f70 0x7f227c155d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2284800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f227c157350 0x7f227c1562a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2284800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c15b0c0 con 0x7f227c0b26b0 2024-04-02T07:33:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2284800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f227c158300 con 0x7f227c157350 2024-04-02T07:33:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2284800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f227c15a860 con 0x7f227c156f70 2024-04-02T07:33:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2281e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f227c0b26b0 0x7f227c0cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2281e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f227c0b26b0 0x7f227c0cd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60674/0 (socket says 172.21.15.55:60674) 2024-04-02T07:33:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.376+0000 7f2281e00640 1 -- 172.21.15.55:0/174921005 learned_addr learned my addr 172.21.15.55:0/174921005 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.380+0000 7f2281400640 1 --2- 172.21.15.55:0/174921005 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f227c156f70 0x7f227c155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.380+0000 7f2282800640 1 --2- 172.21.15.55:0/174921005 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f227c157350 0x7f227c1562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.380+0000 7f2281e00640 1 -- 172.21.15.55:0/174921005 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f227c156f70 msgr2=0x7f227c155d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.380+0000 7f2281e00640 1 --2- 172.21.15.55:0/174921005 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f227c156f70 0x7f227c155d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.380+0000 7f2281e00640 1 -- 172.21.15.55:0/174921005 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f227c157350 msgr2=0x7f227c1562a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.380+0000 7f2281e00640 1 --2- 172.21.15.55:0/174921005 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f227c157350 0x7f227c1562a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.380+0000 7f2281e00640 1 -- 172.21.15.55:0/174921005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2278009a70 con 0x7f227c0b26b0 2024-04-02T07:33:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.380+0000 7f2282800640 1 --2- 172.21.15.55:0/174921005 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f227c157350 0x7f227c1562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.380+0000 7f2281e00640 1 --2- 172.21.15.55:0/174921005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f227c0b26b0 0x7f227c0cd7e0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f227000c7c0 tx=0x7f227000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.380+0000 7f2276000640 1 -- 172.21.15.55:0/174921005 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2270007a30 con 0x7f227c0b26b0 2024-04-02T07:33:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.380+0000 7f2276000640 1 -- 172.21.15.55:0/174921005 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2270007b90 con 0x7f227c0b26b0 2024-04-02T07:33:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.380+0000 7f2284800640 1 -- 172.21.15.55:0/174921005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f227c15b380 con 0x7f227c0b26b0 2024-04-02T07:33:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.380+0000 7f2276000640 1 -- 172.21.15.55:0/174921005 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f227000ce70 con 0x7f227c0b26b0 2024-04-02T07:33:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.380+0000 7f2284800640 1 -- 172.21.15.55:0/174921005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f227c15b940 con 0x7f227c0b26b0 2024-04-02T07:33:42.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.380+0000 7f2284800640 1 -- 172.21.15.55:0/174921005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f227c15bb30 con 0x7f227c0b26b0 2024-04-02T07:33:42.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.380+0000 7f2276000640 1 -- 172.21.15.55:0/174921005 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f22700113f0 con 0x7f227c0b26b0 2024-04-02T07:33:42.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.380+0000 7f2276000640 1 --2- 172.21.15.55:0/174921005 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2260066690 0x7f2260068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:42.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.380+0000 7f2276000640 1 -- 172.21.15.55:0/174921005 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f22700846b0 con 0x7f227c0b26b0 2024-04-02T07:33:42.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.384+0000 7f2281400640 1 --2- 172.21.15.55:0/174921005 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2260066690 0x7f2260068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:42.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.384+0000 7f2281400640 1 --2- 172.21.15.55:0/174921005 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2260066690 0x7f2260068b50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f227c1f94e0 tx=0x7f226c007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:42.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.384+0000 7f2276000640 1 -- 172.21.15.55:0/174921005 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f22700519a0 con 0x7f227c0b26b0 2024-04-02T07:33:42.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.548+0000 7f2284800640 1 -- 172.21.15.55:0/174921005 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f227c066c90 con 0x7f227c0b26b0 2024-04-02T07:33:42.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.548+0000 7f2276000640 1 -- 172.21.15.55:0/174921005 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+16059 (secure 0 0 0) 0x7f2270054fc0 con 0x7f227c0b26b0 2024-04-02T07:33:42.551 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:42.551 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":116,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:33:28.848519+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:33:26.384276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-02T07:33:26.835969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:33:42.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.552+0000 7f2284800640 1 -- 172.21.15.55:0/174921005 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2260066690 msgr2=0x7f2260068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:42.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.552+0000 7f2284800640 1 --2- 172.21.15.55:0/174921005 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2260066690 0x7f2260068b50 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f227c1f94e0 tx=0x7f226c007df0 comp rx=0 tx=0).stop 2024-04-02T07:33:42.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.552+0000 7f2284800640 1 -- 172.21.15.55:0/174921005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f227c0b26b0 msgr2=0x7f227c0cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:42.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.552+0000 7f2284800640 1 --2- 172.21.15.55:0/174921005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f227c0b26b0 0x7f227c0cd7e0 secure :-1 s=READY pgs=1721 cs=0 l=1 rev1=1 crypto rx=0x7f227000c7c0 tx=0x7f227000cc80 comp rx=0 tx=0).stop 2024-04-02T07:33:42.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.552+0000 7f2284800640 1 -- 172.21.15.55:0/174921005 shutdown_connections 2024-04-02T07:33:42.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.552+0000 7f2284800640 1 --2- 172.21.15.55:0/174921005 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2260066690 0x7f2260068b50 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:42.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.552+0000 7f2284800640 1 --2- 172.21.15.55:0/174921005 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f227c157350 0x7f227c1562a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:42.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.552+0000 7f2284800640 1 --2- 172.21.15.55:0/174921005 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f227c156f70 0x7f227c155d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:42.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.552+0000 7f2284800640 1 --2- 172.21.15.55:0/174921005 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f227c0b26b0 0x7f227c0cd7e0 unknown :-1 s=CLOSED pgs=1721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:42.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.552+0000 7f2284800640 1 -- 172.21.15.55:0/174921005 >> 172.21.15.55:0/174921005 conn(0x7f227c0b13b0 msgr2=0x7f227c072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:42.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.552+0000 7f2284800640 1 -- 172.21.15.55:0/174921005 shutdown_connections 2024-04-02T07:33:42.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.552+0000 7f2284800640 1 -- 172.21.15.55:0/174921005 wait complete. 2024-04-02T07:33:42.572 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:33:26.384276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:33:26.835969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:33:42.572 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:33:42.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.712+0000 7f2513400640 1 Processor -- start 2024-04-02T07:33:42.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.712+0000 7f2513400640 1 -- start start 2024-04-02T07:33:42.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f2513400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f250c0b41a0 0x7f250c142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:42.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f2513400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250c06ddc0 con 0x7f250c0ade90 2024-04-02T07:33:42.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f2513400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250c06c630 con 0x7f250c0b3dc0 2024-04-02T07:33:42.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f2513400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250c0cae80 con 0x7f250c0b41a0 2024-04-02T07:33:42.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f250be00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f250c0ade90 0x7f250c06d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34010/0 (socket says 172.21.15.55:34010) 2024-04-02T07:33:42.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f250be00640 1 -- 172.21.15.55:0/460398964 learned_addr learned my addr 172.21.15.55:0/460398964 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:42.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f2511400640 1 --2- 172.21.15.55:0/460398964 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f250c0b41a0 0x7f250c142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:42.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f250b400640 1 -- 172.21.15.55:0/460398964 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062224239 0 0) 0x7f250c06ddc0 con 0x7f250c0ade90 2024-04-02T07:33:42.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f250b400640 1 -- 172.21.15.55:0/460398964 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24f4003530 con 0x7f250c0ade90 2024-04-02T07:33:42.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f250b400640 1 -- 172.21.15.55:0/460398964 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3086587508 0 0) 0x7f24f4003530 con 0x7f250c0ade90 2024-04-02T07:33:42.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f250b400640 1 -- 172.21.15.55:0/460398964 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f250c0b41a0 msgr2=0x7f250c142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:42.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f250b400640 1 --2- 172.21.15.55:0/460398964 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f250c0b41a0 0x7f250c142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:42.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f250b400640 1 -- 172.21.15.55:0/460398964 >> v1:172.21.15.106:6789/0 conn(0x7f250c0b3dc0 legacy=0x7f250c0ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:42.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f250b400640 1 -- 172.21.15.55:0/460398964 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c06c8f0 con 0x7f250c0ade90 2024-04-02T07:33:42.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f250b400640 1 -- 172.21.15.55:0/460398964 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f24f8001680 con 0x7f250c0ade90 2024-04-02T07:33:42.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f250b400640 1 -- 172.21.15.55:0/460398964 >> v1:172.21.15.55:6789/0 conn(0x7f250c0ade90 legacy=0x7f250c06d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:42.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f250b400640 1 --2- 172.21.15.55:0/460398964 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f250c0b41a0 0x7f24f40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:42.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f250b400640 1 --2- 172.21.15.55:0/460398964 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24f4003f80 0x7f24f40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:42.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f250b400640 1 --2- 172.21.15.55:0/460398964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24f4004d10 0x7f24f4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:42.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f250b400640 1 -- 172.21.15.55:0/460398964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c0cae80 con 0x7f24f4004d10 2024-04-02T07:33:42.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f250b400640 1 -- 172.21.15.55:0/460398964 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f400bb80 con 0x7f24f4003f80 2024-04-02T07:33:42.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f250b400640 1 -- 172.21.15.55:0/460398964 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24f400bd40 con 0x7f250c0b41a0 2024-04-02T07:33:42.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f2511400640 1 --2- 172.21.15.55:0/460398964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24f4004d10 0x7f24f4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:42.720 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f250be00640 1 --2- 172.21.15.55:0/460398964 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24f4003f80 0x7f24f40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:42.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f2510a00640 1 --2- 172.21.15.55:0/460398964 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f250c0b41a0 0x7f24f40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:42.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f2511400640 1 -- 172.21.15.55:0/460398964 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f250c0b41a0 msgr2=0x7f24f40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:42.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f2511400640 1 --2- 172.21.15.55:0/460398964 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f250c0b41a0 0x7f24f40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:42.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f2511400640 1 -- 172.21.15.55:0/460398964 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24f4003f80 msgr2=0x7f24f40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:42.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f2511400640 1 --2- 172.21.15.55:0/460398964 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f24f4003f80 0x7f24f40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:42.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.716+0000 7f2511400640 1 -- 172.21.15.55:0/460398964 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f4003530 con 0x7f24f4004d10 2024-04-02T07:33:42.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.720+0000 7f2511400640 1 --2- 172.21.15.55:0/460398964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24f4004d10 0x7f24f4005190 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f2504009fc0 tx=0x7f250401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac64cb636970127 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:42.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.720+0000 7f250b400640 1 -- 172.21.15.55:0/460398964 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25040a5c90 con 0x7f24f4004d10 2024-04-02T07:33:42.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.720+0000 7f250b400640 1 -- 172.21.15.55:0/460398964 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f250400f040 con 0x7f24f4004d10 2024-04-02T07:33:42.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.720+0000 7f250b400640 1 -- 172.21.15.55:0/460398964 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25040ad440 con 0x7f24f4004d10 2024-04-02T07:33:42.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.720+0000 7f2513400640 1 -- 172.21.15.55:0/460398964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24f4004d10 msgr2=0x7f24f4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:42.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.720+0000 7f2513400640 1 --2- 172.21.15.55:0/460398964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24f4004d10 0x7f24f4005190 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f2504009fc0 tx=0x7f250401cc80 comp rx=0 tx=0).stop 2024-04-02T07:33:42.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.720+0000 7f2511400640 1 -- 172.21.15.55:0/460398964 reap_dead start 2024-04-02T07:33:42.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.720+0000 7f2513400640 1 -- 172.21.15.55:0/460398964 shutdown_connections 2024-04-02T07:33:42.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.720+0000 7f2513400640 1 -- 172.21.15.55:0/460398964 >> 172.21.15.55:0/460398964 conn(0x7f250c06a390 msgr2=0x7f250c0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:42.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.720+0000 7f2513400640 1 -- 172.21.15.55:0/460398964 shutdown_connections 2024-04-02T07:33:42.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.720+0000 7f2513400640 1 -- 172.21.15.55:0/460398964 wait complete. 2024-04-02T07:33:42.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.720+0000 7f2513400640 1 Processor -- start 2024-04-02T07:33:42.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.720+0000 7f2513400640 1 -- start start 2024-04-02T07:33:42.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2513400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24f4004d10 0x7f250c1f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:42.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2513400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f250c13ffd0 0x7f250c13dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:42.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2513400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f250c140450 0x7f250c13e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:42.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2513400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c141530 con 0x7f24f4004d10 2024-04-02T07:33:42.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2513400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f250c140920 con 0x7f250c140450 2024-04-02T07:33:42.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2513400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f250c140c00 con 0x7f250c13ffd0 2024-04-02T07:33:42.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2510a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24f4004d10 0x7f250c1f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:42.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2510a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24f4004d10 0x7f250c1f23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60686/0 (socket says 172.21.15.55:60686) 2024-04-02T07:33:42.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2510a00640 1 -- 172.21.15.55:0/43527058 learned_addr learned my addr 172.21.15.55:0/43527058 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:42.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2511400640 1 --2- 172.21.15.55:0/43527058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f250c140450 0x7f250c13e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:42.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f250be00640 1 --2- 172.21.15.55:0/43527058 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f250c13ffd0 0x7f250c13dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:42.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2510a00640 1 -- 172.21.15.55:0/43527058 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f250c13ffd0 msgr2=0x7f250c13dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:42.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2510a00640 1 --2- 172.21.15.55:0/43527058 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f250c13ffd0 0x7f250c13dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:42.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2510a00640 1 -- 172.21.15.55:0/43527058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f250c140450 msgr2=0x7f250c13e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:42.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2510a00640 1 --2- 172.21.15.55:0/43527058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f250c140450 0x7f250c13e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:42.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2510a00640 1 -- 172.21.15.55:0/43527058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f250c140ee0 con 0x7f24f4004d10 2024-04-02T07:33:42.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2511400640 1 --2- 172.21.15.55:0/43527058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f250c140450 0x7f250c13e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:42.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2510a00640 1 --2- 172.21.15.55:0/43527058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24f4004d10 0x7f250c1f23f0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f250000f7f0 tx=0x7f250000fcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:42.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2508c00640 1 -- 172.21.15.55:0/43527058 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25000050d0 con 0x7f24f4004d10 2024-04-02T07:33:42.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2508c00640 1 -- 172.21.15.55:0/43527058 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2500005230 con 0x7f24f4004d10 2024-04-02T07:33:42.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2513400640 1 -- 172.21.15.55:0/43527058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f250c1411c0 con 0x7f24f4004d10 2024-04-02T07:33:42.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2508c00640 1 -- 172.21.15.55:0/43527058 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f250000d730 con 0x7f24f4004d10 2024-04-02T07:33:42.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2513400640 1 -- 172.21.15.55:0/43527058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f250c1f5800 con 0x7f24f4004d10 2024-04-02T07:33:42.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2513400640 1 -- 172.21.15.55:0/43527058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f250c066c90 con 0x7f24f4004d10 2024-04-02T07:33:42.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.724+0000 7f2508c00640 1 -- 172.21.15.55:0/43527058 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f250000d890 con 0x7f24f4004d10 2024-04-02T07:33:42.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.728+0000 7f2508c00640 1 --2- 172.21.15.55:0/43527058 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f24ec066690 0x7f24ec068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:42.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.728+0000 7f2508c00640 1 -- 172.21.15.55:0/43527058 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f25000840f0 con 0x7f24f4004d10 2024-04-02T07:33:42.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.728+0000 7f250be00640 1 --2- 172.21.15.55:0/43527058 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f24ec066690 0x7f24ec068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:42.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.728+0000 7f250be00640 1 --2- 172.21.15.55:0/43527058 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f24ec066690 0x7f24ec068b50 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f24f8001060 tx=0x7f24f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:42.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.732+0000 7f2508c00640 1 -- 172.21.15.55:0/43527058 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f25000514f0 con 0x7f24f4004d10 2024-04-02T07:33:42.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.888+0000 7f2513400640 1 -- 172.21.15.55:0/43527058 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f250c06e5a0 con 0x7f24f4004d10 2024-04-02T07:33:42.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.892+0000 7f2508c00640 1 -- 172.21.15.55:0/43527058 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2500054b10 con 0x7f24f4004d10 2024-04-02T07:33:42.892 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:33:42.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.892+0000 7f2513400640 1 -- 172.21.15.55:0/43527058 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f24ec066690 msgr2=0x7f24ec068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:42.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.892+0000 7f2513400640 1 --2- 172.21.15.55:0/43527058 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f24ec066690 0x7f24ec068b50 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f24f8001060 tx=0x7f24f8009040 comp rx=0 tx=0).stop 2024-04-02T07:33:42.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.892+0000 7f2513400640 1 -- 172.21.15.55:0/43527058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24f4004d10 msgr2=0x7f250c1f23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:42.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.892+0000 7f2513400640 1 --2- 172.21.15.55:0/43527058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24f4004d10 0x7f250c1f23f0 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f250000f7f0 tx=0x7f250000fcb0 comp rx=0 tx=0).stop 2024-04-02T07:33:42.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.892+0000 7f2513400640 1 -- 172.21.15.55:0/43527058 shutdown_connections 2024-04-02T07:33:42.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.892+0000 7f2513400640 1 --2- 172.21.15.55:0/43527058 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f24ec066690 0x7f24ec068b50 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:42.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.892+0000 7f2513400640 1 --2- 172.21.15.55:0/43527058 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f250c140450 0x7f250c13e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:42.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.892+0000 7f2513400640 1 --2- 172.21.15.55:0/43527058 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f250c13ffd0 0x7f250c13dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:42.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.892+0000 7f2513400640 1 --2- 172.21.15.55:0/43527058 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f24f4004d10 0x7f250c1f23f0 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:42.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.892+0000 7f2513400640 1 -- 172.21.15.55:0/43527058 >> 172.21.15.55:0/43527058 conn(0x7f250c06a390 msgr2=0x7f250c1592b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:42.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.892+0000 7f2513400640 1 -- 172.21.15.55:0/43527058 shutdown_connections 2024-04-02T07:33:42.895 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:42.892+0000 7f2513400640 1 -- 172.21.15.55:0/43527058 wait complete. 2024-04-02T07:33:42.913 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:33:43.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.056+0000 7fa346400640 1 Processor -- start 2024-04-02T07:33:43.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.056+0000 7fa346400640 1 -- start start 2024-04-02T07:33:43.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.056+0000 7fa346400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa340098a10 0x7fa340098e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:43.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.056+0000 7fa346400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa34006b920 0x7fa34006bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:43.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.056+0000 7fa346400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa34015ce40 con 0x7fa34015ca60 2024-04-02T07:33:43.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.056+0000 7fa346400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa340099390 con 0x7fa34006b920 2024-04-02T07:33:43.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.056+0000 7fa346400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3400ceeb0 con 0x7fa340098a10 2024-04-02T07:33:43.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.056+0000 7fa337e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa340098a10 0x7fa340098e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:43.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.056+0000 7fa33fe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa34006b920 0x7fa34006bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:43.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.056+0000 7fa337e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa340098a10 0x7fa340098e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:41214/0 (socket says 172.21.15.55:41214) 2024-04-02T07:33:43.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.056+0000 7fa337e00640 1 -- 172.21.15.55:0/1572928872 learned_addr learned my addr 172.21.15.55:0/1572928872 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:43.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.056+0000 7fa33fe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa34006b920 0x7fa34006bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:60772/0 (socket says 172.21.15.55:60772) 2024-04-02T07:33:43.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.056+0000 7fa337e00640 1 -- 172.21.15.55:0/1572928872 >> v2:172.21.15.106:3300/0 conn(0x7fa34006b920 msgr2=0x7fa34006bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:43.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.056+0000 7fa337e00640 1 --2- 172.21.15.55:0/1572928872 >> v2:172.21.15.106:3300/0 conn(0x7fa34006b920 0x7fa34006bd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.056+0000 7fa337e00640 1 -- 172.21.15.55:0/1572928872 >> v1:172.21.15.106:6789/0 conn(0x7fa34015ca60 legacy=0x7fa3400cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:43.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.056+0000 7fa337e00640 1 -- 172.21.15.55:0/1572928872 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3400cf190 con 0x7fa340098a10 2024-04-02T07:33:43.059 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.056+0000 7fa33fe00640 1 --2- 172.21.15.55:0/1572928872 >> v2:172.21.15.106:3300/0 conn(0x7fa34006b920 0x7fa34006bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:33:43.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.060+0000 7fa337e00640 1 --2- 172.21.15.55:0/1572928872 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa340098a10 0x7fa340098e50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa328009870 tx=0x7fa32801c330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec77d8ffaeb33d0c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:43.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.060+0000 7fa33ea00640 1 -- 172.21.15.55:0/1572928872 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3280ab600 con 0x7fa340098a10 2024-04-02T07:33:43.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.060+0000 7fa33ea00640 1 -- 172.21.15.55:0/1572928872 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3280a7050 con 0x7fa340098a10 2024-04-02T07:33:43.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.060+0000 7fa33ea00640 1 -- 172.21.15.55:0/1572928872 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3280ab980 con 0x7fa340098a10 2024-04-02T07:33:43.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.060+0000 7fa346400640 1 -- 172.21.15.55:0/1572928872 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa340098a10 msgr2=0x7fa340098e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:43.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.060+0000 7fa346400640 1 --2- 172.21.15.55:0/1572928872 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa340098a10 0x7fa340098e50 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa328009870 tx=0x7fa32801c330 comp rx=0 tx=0).stop 2024-04-02T07:33:43.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.060+0000 7fa346400640 1 -- 172.21.15.55:0/1572928872 shutdown_connections 2024-04-02T07:33:43.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.060+0000 7fa346400640 1 --2- 172.21.15.55:0/1572928872 >> v2:172.21.15.106:3300/0 conn(0x7fa34006b920 0x7fa34006bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.060+0000 7fa346400640 1 --2- 172.21.15.55:0/1572928872 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa340098a10 0x7fa340098e50 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.060+0000 7fa346400640 1 -- 172.21.15.55:0/1572928872 >> 172.21.15.55:0/1572928872 conn(0x7fa3400b2150 msgr2=0x7fa3400b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:43.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.060+0000 7fa346400640 1 -- 172.21.15.55:0/1572928872 shutdown_connections 2024-04-02T07:33:43.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.060+0000 7fa346400640 1 -- 172.21.15.55:0/1572928872 wait complete. 2024-04-02T07:33:43.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa346400640 1 Processor -- start 2024-04-02T07:33:43.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa346400640 1 -- start start 2024-04-02T07:33:43.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa346400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa34006b920 0x7fa3400b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:43.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa346400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa340098a10 0x7fa34015adc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:43.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa346400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa34015ca60 0x7fa340157d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:43.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa346400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3400c8b50 con 0x7fa34015ca60 2024-04-02T07:33:43.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa346400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3400ca470 con 0x7fa340098a10 2024-04-02T07:33:43.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa346400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa340156fa0 con 0x7fa34006b920 2024-04-02T07:33:43.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa33fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa34015ca60 0x7fa340157d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:43.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa33fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa34015ca60 0x7fa340157d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60694/0 (socket says 172.21.15.55:60694) 2024-04-02T07:33:43.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa33fe00640 1 -- 172.21.15.55:0/728863611 learned_addr learned my addr 172.21.15.55:0/728863611 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:43.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa337e00640 1 --2- 172.21.15.55:0/728863611 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa340098a10 0x7fa34015adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:43.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa33f400640 1 --2- 172.21.15.55:0/728863611 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa34006b920 0x7fa3400b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:43.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa33fe00640 1 -- 172.21.15.55:0/728863611 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa34006b920 msgr2=0x7fa3400b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:43.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa33fe00640 1 --2- 172.21.15.55:0/728863611 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa34006b920 0x7fa3400b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa33fe00640 1 -- 172.21.15.55:0/728863611 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa340098a10 msgr2=0x7fa34015adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:43.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa33fe00640 1 --2- 172.21.15.55:0/728863611 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa340098a10 0x7fa34015adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa33fe00640 1 -- 172.21.15.55:0/728863611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa338009a70 con 0x7fa34015ca60 2024-04-02T07:33:43.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa33fe00640 1 --2- 172.21.15.55:0/728863611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa34015ca60 0x7fa340157d60 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fa33800efc0 tx=0x7fa338009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:43.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa337400640 1 -- 172.21.15.55:0/728863611 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa338009d70 con 0x7fa34015ca60 2024-04-02T07:33:43.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa337400640 1 -- 172.21.15.55:0/728863611 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa33800f040 con 0x7fa34015ca60 2024-04-02T07:33:43.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa337400640 1 -- 172.21.15.55:0/728863611 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3380039a0 con 0x7fa34015ca60 2024-04-02T07:33:43.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa346400640 1 -- 172.21.15.55:0/728863611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3280094d0 con 0x7fa34015ca60 2024-04-02T07:33:43.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa346400640 1 -- 172.21.15.55:0/728863611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa340157840 con 0x7fa34015ca60 2024-04-02T07:33:43.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.064+0000 7fa346400640 1 -- 172.21.15.55:0/728863611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3401573a0 con 0x7fa34015ca60 2024-04-02T07:33:43.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.068+0000 7fa337400640 1 -- 172.21.15.55:0/728863611 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa3380144a0 con 0x7fa34015ca60 2024-04-02T07:33:43.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.068+0000 7fa337400640 1 --2- 172.21.15.55:0/728863611 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa31c066690 0x7fa31c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:43.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.068+0000 7fa337400640 1 -- 172.21.15.55:0/728863611 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa338084d30 con 0x7fa34015ca60 2024-04-02T07:33:43.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.068+0000 7fa33f400640 1 --2- 172.21.15.55:0/728863611 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa31c066690 0x7fa31c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:43.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.068+0000 7fa33f400640 1 --2- 172.21.15.55:0/728863611 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa31c066690 0x7fa31c068b50 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa330007fd0 tx=0x7fa330009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:43.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.072+0000 7fa337400640 1 -- 172.21.15.55:0/728863611 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa338052140 con 0x7fa34015ca60 2024-04-02T07:33:43.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.232+0000 7fa346400640 1 -- 172.21.15.55:0/728863611 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa340157160 con 0x7fa34015ca60 2024-04-02T07:33:43.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.232+0000 7fa337400640 1 -- 172.21.15.55:0/728863611 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa338018020 con 0x7fa34015ca60 2024-04-02T07:33:43.235 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:33:43.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.236+0000 7fa346400640 1 -- 172.21.15.55:0/728863611 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa31c066690 msgr2=0x7fa31c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:43.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.236+0000 7fa346400640 1 --2- 172.21.15.55:0/728863611 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa31c066690 0x7fa31c068b50 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fa330007fd0 tx=0x7fa330009040 comp rx=0 tx=0).stop 2024-04-02T07:33:43.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.236+0000 7fa346400640 1 -- 172.21.15.55:0/728863611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa34015ca60 msgr2=0x7fa340157d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:43.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.236+0000 7fa346400640 1 --2- 172.21.15.55:0/728863611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa34015ca60 0x7fa340157d60 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fa33800efc0 tx=0x7fa338009f90 comp rx=0 tx=0).stop 2024-04-02T07:33:43.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.236+0000 7fa346400640 1 -- 172.21.15.55:0/728863611 shutdown_connections 2024-04-02T07:33:43.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.236+0000 7fa346400640 1 --2- 172.21.15.55:0/728863611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa34015ca60 0x7fa340157d60 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.236+0000 7fa346400640 1 --2- 172.21.15.55:0/728863611 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa31c066690 0x7fa31c068b50 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.236+0000 7fa346400640 1 --2- 172.21.15.55:0/728863611 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa340098a10 0x7fa34015adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.236+0000 7fa346400640 1 --2- 172.21.15.55:0/728863611 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa34006b920 0x7fa3400b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.236+0000 7fa346400640 1 -- 172.21.15.55:0/728863611 >> 172.21.15.55:0/728863611 conn(0x7fa3400b2150 msgr2=0x7fa3400b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:43.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.236+0000 7fa346400640 1 -- 172.21.15.55:0/728863611 shutdown_connections 2024-04-02T07:33:43.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.236+0000 7fa346400640 1 -- 172.21.15.55:0/728863611 wait complete. 2024-04-02T07:33:43.256 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:33:43.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.396+0000 7f91d2e00640 1 Processor -- start 2024-04-02T07:33:43.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.396+0000 7f91d2e00640 1 -- start start 2024-04-02T07:33:43.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.400+0000 7f91d2e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91cc15c920 0x7f91cc0b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:43.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.400+0000 7f91d2e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f91cc0afa70 0x7f91cc0ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:43.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.400+0000 7f91d2e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91cc0cd910 con 0x7f91cc0cd4c0 2024-04-02T07:33:43.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.400+0000 7f91d2e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91cc06beb0 con 0x7f91cc0afa70 2024-04-02T07:33:43.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.400+0000 7f91d2e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc15de30 con 0x7f91cc15c920 2024-04-02T07:33:43.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.400+0000 7f91d0e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f91cc0cd4c0 0x7f91cc160550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34018/0 (socket says 172.21.15.55:34018) 2024-04-02T07:33:43.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.400+0000 7f91d0e00640 1 -- 172.21.15.55:0/868211694 learned_addr learned my addr 172.21.15.55:0/868211694 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:43.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.400+0000 7f91cbe00640 1 --2- 172.21.15.55:0/868211694 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91cc15c920 0x7f91cc0b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:43.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.400+0000 7f91c3e00640 1 --2- 172.21.15.55:0/868211694 >> v2:172.21.15.106:3300/0 conn(0x7f91cc0afa70 0x7f91cc0ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:43.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.400+0000 7f91cb400640 1 -- 172.21.15.55:0/868211694 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3528222488 0 0) 0x7f91c40014a0 con 0x7f91cc0cd4c0 2024-04-02T07:33:43.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.400+0000 7f91cb400640 1 -- 172.21.15.55:0/868211694 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91b0003530 con 0x7f91cc0cd4c0 2024-04-02T07:33:43.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.400+0000 7f91cbe00640 1 -- 172.21.15.55:0/868211694 >> v2:172.21.15.106:3300/0 conn(0x7f91cc0afa70 msgr2=0x7f91cc0ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:43.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.400+0000 7f91cbe00640 1 --2- 172.21.15.55:0/868211694 >> v2:172.21.15.106:3300/0 conn(0x7f91cc0afa70 0x7f91cc0ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.400+0000 7f91cbe00640 1 -- 172.21.15.55:0/868211694 >> v1:172.21.15.55:6789/0 conn(0x7f91cc0cd4c0 legacy=0x7f91cc160550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:43.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.400+0000 7f91cbe00640 1 -- 172.21.15.55:0/868211694 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc098ab0 con 0x7f91cc15c920 2024-04-02T07:33:43.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.404+0000 7f91cbe00640 1 --2- 172.21.15.55:0/868211694 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91cc15c920 0x7f91cc0b1ca0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0097c0 tx=0x7f91bc01c470 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdcd2608d7c77013 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:43.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.404+0000 7f91cb400640 1 -- 172.21.15.55:0/868211694 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc0ad640 con 0x7f91cc15c920 2024-04-02T07:33:43.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.404+0000 7f91cb400640 1 -- 172.21.15.55:0/868211694 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91bc0ad7a0 con 0x7f91cc15c920 2024-04-02T07:33:43.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.404+0000 7f91cb400640 1 -- 172.21.15.55:0/868211694 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc0adb30 con 0x7f91cc15c920 2024-04-02T07:33:43.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.404+0000 7f91d2e00640 1 -- 172.21.15.55:0/868211694 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91cc15c920 msgr2=0x7f91cc0b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:43.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.404+0000 7f91d2e00640 1 --2- 172.21.15.55:0/868211694 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91cc15c920 0x7f91cc0b1ca0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0097c0 tx=0x7f91bc01c470 comp rx=0 tx=0).stop 2024-04-02T07:33:43.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.404+0000 7f91d2e00640 1 -- 172.21.15.55:0/868211694 shutdown_connections 2024-04-02T07:33:43.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.404+0000 7f91d2e00640 1 --2- 172.21.15.55:0/868211694 >> v2:172.21.15.106:3300/0 conn(0x7f91cc0afa70 0x7f91cc0ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.404+0000 7f91d2e00640 1 --2- 172.21.15.55:0/868211694 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91cc15c920 0x7f91cc0b1ca0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.404+0000 7f91d2e00640 1 -- 172.21.15.55:0/868211694 >> 172.21.15.55:0/868211694 conn(0x7f91cc0d0700 msgr2=0x7f91cc0d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:43.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.404+0000 7f91d2e00640 1 -- 172.21.15.55:0/868211694 shutdown_connections 2024-04-02T07:33:43.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.404+0000 7f91d2e00640 1 -- 172.21.15.55:0/868211694 wait complete. 2024-04-02T07:33:43.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.404+0000 7f91d2e00640 1 Processor -- start 2024-04-02T07:33:43.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.404+0000 7f91d2e00640 1 -- start start 2024-04-02T07:33:43.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91d2e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91cc0afa70 0x7f91cc15b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:43.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91d2e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91cc0cd4c0 0x7f91cc155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:43.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91d2e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91cc15c920 0x7f91cc0d0d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:43.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91d2e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0ccd10 con 0x7f91cc0afa70 2024-04-02T07:33:43.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91d2e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc1560d0 con 0x7f91cc0cd4c0 2024-04-02T07:33:43.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91d2e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc15b7b0 con 0x7f91cc15c920 2024-04-02T07:33:43.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91cbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91cc0afa70 0x7f91cc15b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:43.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91cbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91cc0afa70 0x7f91cc15b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60702/0 (socket says 172.21.15.55:60702) 2024-04-02T07:33:43.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91cbe00640 1 -- 172.21.15.55:0/525561541 learned_addr learned my addr 172.21.15.55:0/525561541 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:43.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91c3e00640 1 --2- 172.21.15.55:0/525561541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91cc0cd4c0 0x7f91cc155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:43.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91d0e00640 1 --2- 172.21.15.55:0/525561541 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91cc15c920 0x7f91cc0d0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:43.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91cbe00640 1 -- 172.21.15.55:0/525561541 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91cc15c920 msgr2=0x7f91cc0d0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:43.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91cbe00640 1 --2- 172.21.15.55:0/525561541 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91cc15c920 0x7f91cc0d0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91cbe00640 1 -- 172.21.15.55:0/525561541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91cc0cd4c0 msgr2=0x7f91cc155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:43.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91cbe00640 1 --2- 172.21.15.55:0/525561541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91cc0cd4c0 0x7f91cc155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91cbe00640 1 -- 172.21.15.55:0/525561541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91bc009420 con 0x7f91cc0afa70 2024-04-02T07:33:43.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91c3e00640 1 --2- 172.21.15.55:0/525561541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91cc0cd4c0 0x7f91cc155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:43.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91cbe00640 1 --2- 172.21.15.55:0/525561541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91cc0afa70 0x7f91cc15b120 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f91bc019080 tx=0x7f91bc019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:43.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91c8c00640 1 -- 172.21.15.55:0/525561541 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc0b6600 con 0x7f91cc0afa70 2024-04-02T07:33:43.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91c8c00640 1 -- 172.21.15.55:0/525561541 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91bc0a6040 con 0x7f91cc0afa70 2024-04-02T07:33:43.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91c8c00640 1 -- 172.21.15.55:0/525561541 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc0b69a0 con 0x7f91cc0afa70 2024-04-02T07:33:43.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91d2e00640 1 -- 172.21.15.55:0/525561541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91cc15ba90 con 0x7f91cc0afa70 2024-04-02T07:33:43.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91d2e00640 1 -- 172.21.15.55:0/525561541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91cc0cc5e0 con 0x7f91cc0afa70 2024-04-02T07:33:43.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91d2e00640 1 -- 172.21.15.55:0/525561541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91cc0cce50 con 0x7f91cc0afa70 2024-04-02T07:33:43.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.408+0000 7f91c8c00640 1 -- 172.21.15.55:0/525561541 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f91bc0b4040 con 0x7f91cc0afa70 2024-04-02T07:33:43.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.412+0000 7f91c8c00640 1 --2- 172.21.15.55:0/525561541 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f91a8066690 0x7f91a8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:43.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.412+0000 7f91c8c00640 1 -- 172.21.15.55:0/525561541 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f91bc11e0b0 con 0x7f91cc0afa70 2024-04-02T07:33:43.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.412+0000 7f91c3e00640 1 --2- 172.21.15.55:0/525561541 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f91a8066690 0x7f91a8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:43.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.412+0000 7f91c3e00640 1 --2- 172.21.15.55:0/525561541 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f91a8066690 0x7f91a8068b50 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f91cc0c73d0 tx=0x7f91b4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:43.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.416+0000 7f91c8c00640 1 -- 172.21.15.55:0/525561541 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f91bc0eb390 con 0x7f91cc0afa70 2024-04-02T07:33:43.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.580+0000 7f91d2e00640 1 -- 172.21.15.55:0/525561541 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f91cc066c90 con 0x7f91cc0afa70 2024-04-02T07:33:43.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.580+0000 7f91c8c00640 1 -- 172.21.15.55:0/525561541 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7f91bc0ee9b0 con 0x7f91cc0afa70 2024-04-02T07:33:43.582 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:33:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.584+0000 7f91d2e00640 1 -- 172.21.15.55:0/525561541 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f91a8066690 msgr2=0x7f91a8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.584+0000 7f91d2e00640 1 --2- 172.21.15.55:0/525561541 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f91a8066690 0x7f91a8068b50 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f91cc0c73d0 tx=0x7f91b4008040 comp rx=0 tx=0).stop 2024-04-02T07:33:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.584+0000 7f91d2e00640 1 -- 172.21.15.55:0/525561541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91cc0afa70 msgr2=0x7f91cc15b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.584+0000 7f91d2e00640 1 --2- 172.21.15.55:0/525561541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91cc0afa70 0x7f91cc15b120 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7f91bc019080 tx=0x7f91bc019210 comp rx=0 tx=0).stop 2024-04-02T07:33:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.584+0000 7f91d2e00640 1 -- 172.21.15.55:0/525561541 shutdown_connections 2024-04-02T07:33:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.584+0000 7f91d2e00640 1 --2- 172.21.15.55:0/525561541 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91cc15c920 0x7f91cc0d0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.584+0000 7f91d2e00640 1 --2- 172.21.15.55:0/525561541 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f91a8066690 0x7f91a8068b50 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.584+0000 7f91d2e00640 1 --2- 172.21.15.55:0/525561541 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91cc0cd4c0 0x7f91cc155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.584+0000 7f91d2e00640 1 --2- 172.21.15.55:0/525561541 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91cc0afa70 0x7f91cc15b120 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.584+0000 7f91d2e00640 1 -- 172.21.15.55:0/525561541 >> 172.21.15.55:0/525561541 conn(0x7f91cc0d0700 msgr2=0x7f91cc0b04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.584+0000 7f91d2e00640 1 -- 172.21.15.55:0/525561541 shutdown_connections 2024-04-02T07:33:43.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.584+0000 7f91d2e00640 1 -- 172.21.15.55:0/525561541 wait complete. 2024-04-02T07:33:43.604 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:33:43.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.744+0000 7f6e39a00640 1 Processor -- start 2024-04-02T07:33:43.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.744+0000 7f6e39a00640 1 -- start start 2024-04-02T07:33:43.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.744+0000 7f6e39a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e34098a10 0x7f6e340b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:43.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.744+0000 7f6e39a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6e340cf420 0x7f6e340b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:43.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.744+0000 7f6e39a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e340b1e30 con 0x7f6e34098df0 2024-04-02T07:33:43.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.744+0000 7f6e39a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e34099dc0 con 0x7f6e340cf420 2024-04-02T07:33:43.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.744+0000 7f6e39a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e340ce170 con 0x7f6e34098a10 2024-04-02T07:33:43.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.744+0000 7f6e2be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6e340cf420 0x7f6e340b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:43.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.744+0000 7f6e2be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f6e340cf420 0x7f6e340b3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:60816/0 (socket says 172.21.15.55:60816) 2024-04-02T07:33:43.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.744+0000 7f6e2be00640 1 -- 172.21.15.55:0/1931720634 learned_addr learned my addr 172.21.15.55:0/1931720634 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.744+0000 7f6e33e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e34098a10 0x7f6e340b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.744+0000 7f6e33e00640 1 -- 172.21.15.55:0/1931720634 >> v2:172.21.15.106:3300/0 conn(0x7f6e340cf420 msgr2=0x7f6e340b3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.744+0000 7f6e33e00640 1 --2- 172.21.15.55:0/1931720634 >> v2:172.21.15.106:3300/0 conn(0x7f6e340cf420 0x7f6e340b3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.744+0000 7f6e33e00640 1 -- 172.21.15.55:0/1931720634 >> v1:172.21.15.106:6789/0 conn(0x7f6e34098df0 legacy=0x7f6e340cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.744+0000 7f6e33e00640 1 -- 172.21.15.55:0/1931720634 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e340ce450 con 0x7f6e34098a10 2024-04-02T07:33:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.744+0000 7f6e2be00640 1 --2- 172.21.15.55:0/1931720634 >> v2:172.21.15.106:3300/0 conn(0x7f6e340cf420 0x7f6e340b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:33:43.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.744+0000 7f6e33400640 1 -- 172.21.15.55:0/1931720634 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1476129585 0 0) 0x7f6e340b1e30 con 0x7f6e34098df0 2024-04-02T07:33:43.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.748+0000 7f6e33e00640 1 --2- 172.21.15.55:0/1931720634 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e34098a10 0x7f6e340b1150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6e240097c0 tx=0x7f6e2401c3e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bc205200eb6a270 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:43.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.748+0000 7f6e33400640 1 -- 172.21.15.55:0/1931720634 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e240ac640 con 0x7f6e34098a10 2024-04-02T07:33:43.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.748+0000 7f6e33400640 1 -- 172.21.15.55:0/1931720634 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e240ac7a0 con 0x7f6e34098a10 2024-04-02T07:33:43.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.748+0000 7f6e33400640 1 -- 172.21.15.55:0/1931720634 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e240acb30 con 0x7f6e34098a10 2024-04-02T07:33:43.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.748+0000 7f6e39a00640 1 -- 172.21.15.55:0/1931720634 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e34098a10 msgr2=0x7f6e340b1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:43.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.748+0000 7f6e39a00640 1 --2- 172.21.15.55:0/1931720634 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e34098a10 0x7f6e340b1150 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f6e240097c0 tx=0x7f6e2401c3e0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.748+0000 7f6e39a00640 1 -- 172.21.15.55:0/1931720634 shutdown_connections 2024-04-02T07:33:43.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.748+0000 7f6e39a00640 1 --2- 172.21.15.55:0/1931720634 >> v2:172.21.15.106:3300/0 conn(0x7f6e340cf420 0x7f6e340b3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.748+0000 7f6e39a00640 1 --2- 172.21.15.55:0/1931720634 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e34098a10 0x7f6e340b1150 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.748+0000 7f6e39a00640 1 -- 172.21.15.55:0/1931720634 >> 172.21.15.55:0/1931720634 conn(0x7f6e340ccf80 msgr2=0x7f6e340cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:43.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.748+0000 7f6e39a00640 1 -- 172.21.15.55:0/1931720634 shutdown_connections 2024-04-02T07:33:43.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.748+0000 7f6e39a00640 1 -- 172.21.15.55:0/1931720634 wait complete. 2024-04-02T07:33:43.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e39a00640 1 Processor -- start 2024-04-02T07:33:43.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e39a00640 1 -- start start 2024-04-02T07:33:43.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e39a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e34098a10 0x7f6e34163900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:43.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e39a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e34098df0 0x7f6e34153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:43.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e39a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e340cf420 0x7f6e34154360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:43.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e39a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3415a980 con 0x7f6e34098a10 2024-04-02T07:33:43.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e39a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e34163e40 con 0x7f6e34098df0 2024-04-02T07:33:43.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e39a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e3415a630 con 0x7f6e340cf420 2024-04-02T07:33:43.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e33e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e34098a10 0x7f6e34163900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:43.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e33e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e34098a10 0x7f6e34163900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60712/0 (socket says 172.21.15.55:60712) 2024-04-02T07:33:43.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e33e00640 1 -- 172.21.15.55:0/3292421459 learned_addr learned my addr 172.21.15.55:0/3292421459 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:43.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e2be00640 1 --2- 172.21.15.55:0/3292421459 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e34098df0 0x7f6e34153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:43.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e39000640 1 --2- 172.21.15.55:0/3292421459 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e340cf420 0x7f6e34154360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:43.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e33e00640 1 -- 172.21.15.55:0/3292421459 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e340cf420 msgr2=0x7f6e34154360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:43.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e33e00640 1 --2- 172.21.15.55:0/3292421459 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e340cf420 0x7f6e34154360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e33e00640 1 -- 172.21.15.55:0/3292421459 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e34098df0 msgr2=0x7f6e34153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:43.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e33e00640 1 --2- 172.21.15.55:0/3292421459 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e34098df0 0x7f6e34153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e33e00640 1 -- 172.21.15.55:0/3292421459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e1c0094d0 con 0x7f6e34098a10 2024-04-02T07:33:43.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e2be00640 1 --2- 172.21.15.55:0/3292421459 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e34098df0 0x7f6e34153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:43.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e39000640 1 --2- 172.21.15.55:0/3292421459 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e340cf420 0x7f6e34154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:43.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e33e00640 1 --2- 172.21.15.55:0/3292421459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e34098a10 0x7f6e34163900 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f6e24009710 tx=0x7f6e2401ac20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:43.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e30c00640 1 -- 172.21.15.55:0/3292421459 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e240b7620 con 0x7f6e34098a10 2024-04-02T07:33:43.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e30c00640 1 -- 172.21.15.55:0/3292421459 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e240b7780 con 0x7f6e34098a10 2024-04-02T07:33:43.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e30c00640 1 -- 172.21.15.55:0/3292421459 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e240b7b10 con 0x7f6e34098a10 2024-04-02T07:33:43.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e39a00640 1 -- 172.21.15.55:0/3292421459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e24009420 con 0x7f6e34098a10 2024-04-02T07:33:43.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.752+0000 7f6e39a00640 1 -- 172.21.15.55:0/3292421459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e34154190 con 0x7f6e34098a10 2024-04-02T07:33:43.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.756+0000 7f6e39a00640 1 -- 172.21.15.55:0/3292421459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e340d01f0 con 0x7f6e34098a10 2024-04-02T07:33:43.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.756+0000 7f6e30c00640 1 -- 172.21.15.55:0/3292421459 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f6e240b3040 con 0x7f6e34098a10 2024-04-02T07:33:43.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.756+0000 7f6e30c00640 1 --2- 172.21.15.55:0/3292421459 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6e10066690 0x7f6e10068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:43.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.756+0000 7f6e30c00640 1 -- 172.21.15.55:0/3292421459 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e2411e850 con 0x7f6e34098a10 2024-04-02T07:33:43.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.756+0000 7f6e2be00640 1 --2- 172.21.15.55:0/3292421459 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6e10066690 0x7f6e10068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:43.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.756+0000 7f6e2be00640 1 --2- 172.21.15.55:0/3292421459 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6e10066690 0x7f6e10068b50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6e3406bcf0 tx=0x7f6e1c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:43.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.760+0000 7f6e30c00640 1 -- 172.21.15.55:0/3292421459 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f6e240ebc40 con 0x7f6e34098a10 2024-04-02T07:33:43.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.932+0000 7f6e39a00640 1 -- 172.21.15.55:0/3292421459 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6e34073fa0 con 0x7f6e34098a10 2024-04-02T07:33:43.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.936+0000 7f6e30c00640 1 -- 172.21.15.55:0/3292421459 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v116) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6e240ef260 con 0x7f6e34098a10 2024-04-02T07:33:43.936 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:33:43.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.936+0000 7f6e39a00640 1 -- 172.21.15.55:0/3292421459 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6e10066690 msgr2=0x7f6e10068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:43.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.936+0000 7f6e39a00640 1 --2- 172.21.15.55:0/3292421459 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6e10066690 0x7f6e10068b50 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6e3406bcf0 tx=0x7f6e1c008040 comp rx=0 tx=0).stop 2024-04-02T07:33:43.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.936+0000 7f6e39a00640 1 -- 172.21.15.55:0/3292421459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e34098a10 msgr2=0x7f6e34163900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:43.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.936+0000 7f6e39a00640 1 --2- 172.21.15.55:0/3292421459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e34098a10 0x7f6e34163900 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f6e24009710 tx=0x7f6e2401ac20 comp rx=0 tx=0).stop 2024-04-02T07:33:43.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.936+0000 7f6e39a00640 1 -- 172.21.15.55:0/3292421459 shutdown_connections 2024-04-02T07:33:43.938 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.936+0000 7f6e39a00640 1 --2- 172.21.15.55:0/3292421459 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f6e340cf420 0x7f6e34154360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.936+0000 7f6e39a00640 1 --2- 172.21.15.55:0/3292421459 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f6e10066690 0x7f6e10068b50 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.936+0000 7f6e39a00640 1 --2- 172.21.15.55:0/3292421459 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f6e34098df0 0x7f6e34153c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.936+0000 7f6e39a00640 1 --2- 172.21.15.55:0/3292421459 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6e34098a10 0x7f6e34163900 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.936+0000 7f6e39a00640 1 -- 172.21.15.55:0/3292421459 >> 172.21.15.55:0/3292421459 conn(0x7f6e340ccf80 msgr2=0x7f6e340cb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.936+0000 7f6e39a00640 1 -- 172.21.15.55:0/3292421459 shutdown_connections 2024-04-02T07:33:43.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:43.936+0000 7f6e39a00640 1 -- 172.21.15.55:0/3292421459 wait complete. 2024-04-02T07:33:43.957 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:33:43.957 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:33:43.966 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:33:44.148 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.144+0000 7f13e1800640 1 Processor -- start 2024-04-02T07:33:44.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.148+0000 7f13e1800640 1 -- start start 2024-04-02T07:33:44.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.148+0000 7f13e1800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13dc0cfdf0 0x7f13dc06b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:44.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.148+0000 7f13e1800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13dc098a10 0x7f13dc098e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:44.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.148+0000 7f13e1800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13dc0d01d0 con 0x7f13dc0b16e0 2024-04-02T07:33:44.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.148+0000 7f13e1800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13dc099380 con 0x7f13dc098a10 2024-04-02T07:33:44.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.148+0000 7f13e1800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc06c0e0 con 0x7f13dc0cfdf0 2024-04-02T07:33:44.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.148+0000 7f13db400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13dc098a10 0x7f13dc098e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:44.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.148+0000 7f13db400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f13dc098a10 0x7f13dc098e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60718/0 (socket says 172.21.15.55:60718) 2024-04-02T07:33:44.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.148+0000 7f13db400640 1 -- 172.21.15.55:0/3676973976 learned_addr learned my addr 172.21.15.55:0/3676973976 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:44.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.148+0000 7f13daa00640 1 --2- 172.21.15.55:0/3676973976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13dc0cfdf0 0x7f13dc06b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:44.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.148+0000 7f13db400640 1 -- 172.21.15.55:0/3676973976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13dc0cfdf0 msgr2=0x7f13dc06b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:44.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.148+0000 7f13db400640 1 --2- 172.21.15.55:0/3676973976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13dc0cfdf0 0x7f13dc06b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.148+0000 7f13db400640 1 -- 172.21.15.55:0/3676973976 >> v1:172.21.15.106:6789/0 conn(0x7f13dc0b16e0 legacy=0x7f13dc0b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:44.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.148+0000 7f13db400640 1 -- 172.21.15.55:0/3676973976 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13dc0b01d0 con 0x7f13dc098a10 2024-04-02T07:33:44.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.152+0000 7f13db400640 1 --2- 172.21.15.55:0/3676973976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc098a10 0x7f13dc098e40 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009e50 tx=0x7f13d401ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54181b5ea4faa1ac server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:44.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.152+0000 7f13da000640 1 -- 172.21.15.55:0/3676973976 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d40a58d0 con 0x7f13dc098a10 2024-04-02T07:33:44.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.152+0000 7f13da000640 1 -- 172.21.15.55:0/3676973976 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d40a5a30 con 0x7f13dc098a10 2024-04-02T07:33:44.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.152+0000 7f13da000640 1 -- 172.21.15.55:0/3676973976 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d40a5dc0 con 0x7f13dc098a10 2024-04-02T07:33:44.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.152+0000 7f13e1800640 1 -- 172.21.15.55:0/3676973976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc098a10 msgr2=0x7f13dc098e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:44.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.152+0000 7f13e1800640 1 --2- 172.21.15.55:0/3676973976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc098a10 0x7f13dc098e40 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f13d4009e50 tx=0x7f13d401ca00 comp rx=0 tx=0).stop 2024-04-02T07:33:44.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.152+0000 7f13e1800640 1 -- 172.21.15.55:0/3676973976 shutdown_connections 2024-04-02T07:33:44.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.152+0000 7f13e1800640 1 --2- 172.21.15.55:0/3676973976 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc098a10 0x7f13dc098e40 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.152+0000 7f13e1800640 1 --2- 172.21.15.55:0/3676973976 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13dc0cfdf0 0x7f13dc06b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.152+0000 7f13e1800640 1 -- 172.21.15.55:0/3676973976 >> 172.21.15.55:0/3676973976 conn(0x7f13dc0b2210 msgr2=0x7f13dc0b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:44.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.152+0000 7f13e1800640 1 -- 172.21.15.55:0/3676973976 shutdown_connections 2024-04-02T07:33:44.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.152+0000 7f13e1800640 1 -- 172.21.15.55:0/3676973976 wait complete. 2024-04-02T07:33:44.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.152+0000 7f13e1800640 1 Processor -- start 2024-04-02T07:33:44.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.152+0000 7f13e1800640 1 -- start start 2024-04-02T07:33:44.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13e1800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13dc098a10 0x7f13dc0ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:44.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13e1800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13dc0b16e0 0x7f13dc159260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:44.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13e1800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc0cfdf0 0x7f13dc0ccd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:44.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13e1800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc0cb720 con 0x7f13dc0cfdf0 2024-04-02T07:33:44.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13e1800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc0caaa0 con 0x7f13dc098a10 2024-04-02T07:33:44.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13e1800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13dc1597a0 con 0x7f13dc0b16e0 2024-04-02T07:33:44.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13db400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc0cfdf0 0x7f13dc0ccd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:44.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13db400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc0cfdf0 0x7f13dc0ccd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60722/0 (socket says 172.21.15.55:60722) 2024-04-02T07:33:44.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13db400640 1 -- 172.21.15.55:0/3326441696 learned_addr learned my addr 172.21.15.55:0/3326441696 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:44.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13daa00640 1 --2- 172.21.15.55:0/3326441696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13dc098a10 0x7f13dc0ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:44.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13d3e00640 1 --2- 172.21.15.55:0/3326441696 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13dc0b16e0 0x7f13dc159260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:44.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13db400640 1 -- 172.21.15.55:0/3326441696 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13dc0b16e0 msgr2=0x7f13dc159260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:44.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13db400640 1 --2- 172.21.15.55:0/3326441696 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13dc0b16e0 0x7f13dc159260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13db400640 1 -- 172.21.15.55:0/3326441696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13dc098a10 msgr2=0x7f13dc0ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:44.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13db400640 1 --2- 172.21.15.55:0/3326441696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13dc098a10 0x7f13dc0ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13db400640 1 -- 172.21.15.55:0/3326441696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d4009b30 con 0x7f13dc0cfdf0 2024-04-02T07:33:44.158 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13db400640 1 --2- 172.21.15.55:0/3326441696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc0cfdf0 0x7f13dc0ccd90 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f13d40af040 tx=0x7f13d40197a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:44.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13d2a00640 1 -- 172.21.15.55:0/3326441696 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d40a5ba0 con 0x7f13dc0cfdf0 2024-04-02T07:33:44.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13d2a00640 1 -- 172.21.15.55:0/3326441696 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d40a5d00 con 0x7f13dc0cfdf0 2024-04-02T07:33:44.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13d2a00640 1 -- 172.21.15.55:0/3326441696 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d40b86b0 con 0x7f13dc0cfdf0 2024-04-02T07:33:44.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13e1800640 1 -- 172.21.15.55:0/3326441696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13dc0cb900 con 0x7f13dc0cfdf0 2024-04-02T07:33:44.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13e1800640 1 -- 172.21.15.55:0/3326441696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13dc0cbec0 con 0x7f13dc0cfdf0 2024-04-02T07:33:44.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13e1800640 1 -- 172.21.15.55:0/3326441696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13dc0c77f0 con 0x7f13dc0cfdf0 2024-04-02T07:33:44.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.156+0000 7f13d2a00640 1 -- 172.21.15.55:0/3326441696 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f13d40b8810 con 0x7f13dc0cfdf0 2024-04-02T07:33:44.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.160+0000 7f13d2a00640 1 --2- 172.21.15.55:0/3326441696 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f13b8066690 0x7f13b8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:44.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.160+0000 7f13d2a00640 1 -- 172.21.15.55:0/3326441696 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13d411ed00 con 0x7f13dc0cfdf0 2024-04-02T07:33:44.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.160+0000 7f13daa00640 1 --2- 172.21.15.55:0/3326441696 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f13b8066690 0x7f13b8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:44.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.160+0000 7f13daa00640 1 --2- 172.21.15.55:0/3326441696 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f13b8066690 0x7f13b8068b50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009ac0 tx=0x7f13cc009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:44.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.164+0000 7f13d2a00640 1 -- 172.21.15.55:0/3326441696 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f13d40ec230 con 0x7f13dc0cfdf0 2024-04-02T07:33:44.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.324+0000 7f13e1800640 1 -- 172.21.15.55:0/3326441696 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13dc0c77f0 con 0x7f13dc0cfdf0 2024-04-02T07:33:44.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.328+0000 7f13d2a00640 1 -- 172.21.15.55:0/3326441696 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+16059 (secure 0 0 0) 0x7f13d40ef850 con 0x7f13dc0cfdf0 2024-04-02T07:33:44.328 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:44.329 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":116,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:33:28.848519+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:33:26.384276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-02T07:33:26.835969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:33:44.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.328+0000 7f13e1800640 1 -- 172.21.15.55:0/3326441696 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f13b8066690 msgr2=0x7f13b8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:44.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.328+0000 7f13e1800640 1 --2- 172.21.15.55:0/3326441696 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f13b8066690 0x7f13b8068b50 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f13cc009ac0 tx=0x7f13cc009190 comp rx=0 tx=0).stop 2024-04-02T07:33:44.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.328+0000 7f13e1800640 1 -- 172.21.15.55:0/3326441696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc0cfdf0 msgr2=0x7f13dc0ccd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:44.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.328+0000 7f13e1800640 1 --2- 172.21.15.55:0/3326441696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc0cfdf0 0x7f13dc0ccd90 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f13d40af040 tx=0x7f13d40197a0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.328+0000 7f13e1800640 1 -- 172.21.15.55:0/3326441696 shutdown_connections 2024-04-02T07:33:44.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.328+0000 7f13e1800640 1 --2- 172.21.15.55:0/3326441696 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f13dc0cfdf0 0x7f13dc0ccd90 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.328+0000 7f13e1800640 1 --2- 172.21.15.55:0/3326441696 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13dc0b16e0 0x7f13dc159260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.328+0000 7f13e1800640 1 --2- 172.21.15.55:0/3326441696 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f13b8066690 0x7f13b8068b50 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.328+0000 7f13e1800640 1 --2- 172.21.15.55:0/3326441696 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13dc098a10 0x7f13dc0ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.328+0000 7f13e1800640 1 -- 172.21.15.55:0/3326441696 >> 172.21.15.55:0/3326441696 conn(0x7f13dc0b2210 msgr2=0x7f13dc0ad680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:44.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.328+0000 7f13e1800640 1 -- 172.21.15.55:0/3326441696 shutdown_connections 2024-04-02T07:33:44.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.328+0000 7f13e1800640 1 -- 172.21.15.55:0/3326441696 wait complete. 2024-04-02T07:33:44.350 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:33:26.384276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:33:26.835969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:33:44.350 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:33:44.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.496+0000 7f5fea000640 1 Processor -- start 2024-04-02T07:33:44.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.496+0000 7f5fea000640 1 -- start start 2024-04-02T07:33:44.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.496+0000 7f5fea000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fe40ade90 0x7f5fe406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:44.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.496+0000 7f5fea000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5fe40b41a0 0x7f5fe4142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:44.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.496+0000 7f5fea000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fe406c630 con 0x7f5fe40b3dc0 2024-04-02T07:33:44.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.496+0000 7f5fea000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fe40cae80 con 0x7f5fe40b41a0 2024-04-02T07:33:44.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.496+0000 7f5fea000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe406c8f0 con 0x7f5fe40ade90 2024-04-02T07:33:44.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.496+0000 7f5fe3e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5fe40b41a0 0x7f5fe4142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:44.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.496+0000 7f5fe3400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5fe40b3dc0 0x7f5fe40ca770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34026/0 (socket says 172.21.15.55:34026) 2024-04-02T07:33:44.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.496+0000 7f5fe3400640 1 -- 172.21.15.55:0/4277773527 learned_addr learned my addr 172.21.15.55:0/4277773527 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:44.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.496+0000 7f5fdaa00640 1 --2- 172.21.15.55:0/4277773527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fe40ade90 0x7f5fe406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:44.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.496+0000 7f5fe3e00640 1 -- 172.21.15.55:0/4277773527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fe40ade90 msgr2=0x7f5fe406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:44.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.496+0000 7f5fe3e00640 1 --2- 172.21.15.55:0/4277773527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fe40ade90 0x7f5fe406d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.496+0000 7f5fe3e00640 1 -- 172.21.15.55:0/4277773527 >> v1:172.21.15.55:6789/0 conn(0x7f5fe40b3dc0 legacy=0x7f5fe40ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:44.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.496+0000 7f5fe3e00640 1 -- 172.21.15.55:0/4277773527 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fe406cbd0 con 0x7f5fe40b41a0 2024-04-02T07:33:44.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.500+0000 7f5fe3e00640 1 --2- 172.21.15.55:0/4277773527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fe40b41a0 0x7f5fe4142ac0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0097c0 tx=0x7f5fdc01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e16e0d577aa75b2a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:44.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.500+0000 7f5fe2a00640 1 -- 172.21.15.55:0/4277773527 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc0ab600 con 0x7f5fe40b41a0 2024-04-02T07:33:44.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.500+0000 7f5fe2a00640 1 -- 172.21.15.55:0/4277773527 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fdc0a7050 con 0x7f5fe40b41a0 2024-04-02T07:33:44.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.500+0000 7f5fe2a00640 1 -- 172.21.15.55:0/4277773527 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fdc0ab980 con 0x7f5fe40b41a0 2024-04-02T07:33:44.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.500+0000 7f5fea000640 1 -- 172.21.15.55:0/4277773527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fe40b41a0 msgr2=0x7f5fe4142ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:44.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.500+0000 7f5fea000640 1 --2- 172.21.15.55:0/4277773527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fe40b41a0 0x7f5fe4142ac0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc0097c0 tx=0x7f5fdc01c3e0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.500+0000 7f5fea000640 1 -- 172.21.15.55:0/4277773527 shutdown_connections 2024-04-02T07:33:44.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.500+0000 7f5fea000640 1 --2- 172.21.15.55:0/4277773527 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fe40ade90 0x7f5fe406d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.500+0000 7f5fea000640 1 --2- 172.21.15.55:0/4277773527 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fe40b41a0 0x7f5fe4142ac0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.500+0000 7f5fea000640 1 -- 172.21.15.55:0/4277773527 >> 172.21.15.55:0/4277773527 conn(0x7f5fe406a390 msgr2=0x7f5fe40b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:44.502 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.500+0000 7f5fea000640 1 -- 172.21.15.55:0/4277773527 shutdown_connections 2024-04-02T07:33:44.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.500+0000 7f5fea000640 1 -- 172.21.15.55:0/4277773527 wait complete. 2024-04-02T07:33:44.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.500+0000 7f5fea000640 1 Processor -- start 2024-04-02T07:33:44.503 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.500+0000 7f5fea000640 1 -- start start 2024-04-02T07:33:44.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fea000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fe40ade90 0x7f5fe41371d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:44.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fea000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fe40b3dc0 0x7f5fe4153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:44.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fea000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fe40b41a0 0x7f5fe4137a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:44.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fea000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe40af970 con 0x7f5fe40b3dc0 2024-04-02T07:33:44.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fea000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe4139620 con 0x7f5fe40b41a0 2024-04-02T07:33:44.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fea000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fe4159820 con 0x7f5fe40ade90 2024-04-02T07:33:44.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fdaa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fe40b3dc0 0x7f5fe4153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:44.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fdaa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fe40b3dc0 0x7f5fe4153170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60740/0 (socket says 172.21.15.55:60740) 2024-04-02T07:33:44.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fdaa00640 1 -- 172.21.15.55:0/169554157 learned_addr learned my addr 172.21.15.55:0/169554157 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:44.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fe3400640 1 --2- 172.21.15.55:0/169554157 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fe40ade90 0x7f5fe41371d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:44.506 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fe3e00640 1 --2- 172.21.15.55:0/169554157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fe40b41a0 0x7f5fe4137a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:44.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fdaa00640 1 -- 172.21.15.55:0/169554157 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fe40ade90 msgr2=0x7f5fe41371d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:44.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fdaa00640 1 --2- 172.21.15.55:0/169554157 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fe40ade90 0x7f5fe41371d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fdaa00640 1 -- 172.21.15.55:0/169554157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fe40b41a0 msgr2=0x7f5fe4137a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:44.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fdaa00640 1 --2- 172.21.15.55:0/169554157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fe40b41a0 0x7f5fe4137a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fdaa00640 1 -- 172.21.15.55:0/169554157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fdc009420 con 0x7f5fe40b3dc0 2024-04-02T07:33:44.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fdaa00640 1 --2- 172.21.15.55:0/169554157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fe40b3dc0 0x7f5fe4153170 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00d5f0 tx=0x7f5fcc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:44.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fdbe00640 1 -- 172.21.15.55:0/169554157 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc0125f0 con 0x7f5fe40b3dc0 2024-04-02T07:33:44.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fdbe00640 1 -- 172.21.15.55:0/169554157 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc012750 con 0x7f5fe40b3dc0 2024-04-02T07:33:44.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fdbe00640 1 -- 172.21.15.55:0/169554157 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc012ae0 con 0x7f5fe40b3dc0 2024-04-02T07:33:44.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fea000640 1 -- 172.21.15.55:0/169554157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fe406de00 con 0x7f5fe40b3dc0 2024-04-02T07:33:44.507 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fea000640 1 -- 172.21.15.55:0/169554157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fe4152690 con 0x7f5fe40b3dc0 2024-04-02T07:33:44.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fea000640 1 -- 172.21.15.55:0/169554157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fe41524c0 con 0x7f5fe40b3dc0 2024-04-02T07:33:44.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.504+0000 7f5fdbe00640 1 -- 172.21.15.55:0/169554157 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5fcc012c40 con 0x7f5fe40b3dc0 2024-04-02T07:33:44.508 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.508+0000 7f5fdbe00640 1 --2- 172.21.15.55:0/169554157 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5fc0066690 0x7f5fc0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:44.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.508+0000 7f5fdbe00640 1 -- 172.21.15.55:0/169554157 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5fcc084470 con 0x7f5fe40b3dc0 2024-04-02T07:33:44.509 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.508+0000 7f5fe3400640 1 --2- 172.21.15.55:0/169554157 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5fc0066690 0x7f5fc0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:44.510 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.508+0000 7f5fe3400640 1 --2- 172.21.15.55:0/169554157 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5fc0066690 0x7f5fc0068b50 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4005c10 tx=0x7f5fd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:44.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.512+0000 7f5fdbe00640 1 -- 172.21.15.55:0/169554157 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5fcc051900 con 0x7f5fe40b3dc0 2024-04-02T07:33:44.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.672+0000 7f5fea000640 1 -- 172.21.15.55:0/169554157 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5fe40734b0 con 0x7f5fe40b3dc0 2024-04-02T07:33:44.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.672+0000 7f5fdbe00640 1 -- 172.21.15.55:0/169554157 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5fcc054f20 con 0x7f5fe40b3dc0 2024-04-02T07:33:44.675 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:33:44.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.676+0000 7f5fea000640 1 -- 172.21.15.55:0/169554157 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5fc0066690 msgr2=0x7f5fc0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:44.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.676+0000 7f5fea000640 1 --2- 172.21.15.55:0/169554157 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5fc0066690 0x7f5fc0068b50 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4005c10 tx=0x7f5fd4009040 comp rx=0 tx=0).stop 2024-04-02T07:33:44.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.676+0000 7f5fea000640 1 -- 172.21.15.55:0/169554157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fe40b3dc0 msgr2=0x7f5fe4153170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:44.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.676+0000 7f5fea000640 1 --2- 172.21.15.55:0/169554157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fe40b3dc0 0x7f5fe4153170 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00d5f0 tx=0x7f5fcc00dab0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.676+0000 7f5fea000640 1 -- 172.21.15.55:0/169554157 shutdown_connections 2024-04-02T07:33:44.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.676+0000 7f5fea000640 1 --2- 172.21.15.55:0/169554157 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5fc0066690 0x7f5fc0068b50 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.676+0000 7f5fea000640 1 --2- 172.21.15.55:0/169554157 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5fe40b41a0 0x7f5fe4137a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.676+0000 7f5fea000640 1 --2- 172.21.15.55:0/169554157 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5fe40b3dc0 0x7f5fe4153170 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.676+0000 7f5fea000640 1 --2- 172.21.15.55:0/169554157 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5fe40ade90 0x7f5fe41371d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.676+0000 7f5fea000640 1 -- 172.21.15.55:0/169554157 >> 172.21.15.55:0/169554157 conn(0x7f5fe406a390 msgr2=0x7f5fe40cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:44.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.676+0000 7f5fea000640 1 -- 172.21.15.55:0/169554157 shutdown_connections 2024-04-02T07:33:44.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.676+0000 7f5fea000640 1 -- 172.21.15.55:0/169554157 wait complete. 2024-04-02T07:33:44.695 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:33:44.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.836+0000 7fa9bba00640 1 Processor -- start 2024-04-02T07:33:44.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.836+0000 7fa9bba00640 1 -- start start 2024-04-02T07:33:44.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.840+0000 7fa9bba00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9b4144260 0x7fa9b40702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:44.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.840+0000 7fa9bba00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b4070c90 con 0x7fa9b40707e0 2024-04-02T07:33:44.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.840+0000 7fa9bba00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9b40b3580 con 0x7fa9b40b31a0 2024-04-02T07:33:44.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.840+0000 7fa9bba00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9b40b37c0 con 0x7fa9b4144260 2024-04-02T07:33:44.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.840+0000 7fa9b9000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9b4144260 0x7fa9b40702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:44.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.840+0000 7fa9abe00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa9b40707e0 0x7fa9b40b2a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34042/0 (socket says 172.21.15.55:34042) 2024-04-02T07:33:44.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.840+0000 7fa9b9000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa9b4144260 0x7fa9b40702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60746/0 (socket says 172.21.15.55:60746) 2024-04-02T07:33:44.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.840+0000 7fa9abe00640 1 -- 172.21.15.55:0/2331831745 learned_addr learned my addr 172.21.15.55:0/2331831745 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:44.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.840+0000 7fa9b9000640 1 -- 172.21.15.55:0/2331831745 >> v1:172.21.15.106:6789/0 conn(0x7fa9b40b31a0 legacy=0x7fa9b40b1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:44.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.840+0000 7fa9b9000640 1 -- 172.21.15.55:0/2331831745 >> v1:172.21.15.55:6789/0 conn(0x7fa9b40707e0 legacy=0x7fa9b40b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:44.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.840+0000 7fa9b9000640 1 -- 172.21.15.55:0/2331831745 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9b415e3a0 con 0x7fa9b4144260 2024-04-02T07:33:44.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.840+0000 7fa9b3e00640 1 -- 172.21.15.55:0/2331831745 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391830088 0 0) 0x7fa9b4070c90 con 0x7fa9b40707e0 2024-04-02T07:33:44.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.840+0000 7fa9b9000640 1 --2- 172.21.15.55:0/2331831745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b4144260 0x7fa9b40702a0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fa9a40097c0 tx=0x7fa9a401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135c96f97a05a622 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:44.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9b3e00640 1 -- 172.21.15.55:0/2331831745 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a40a8050 con 0x7fa9b4144260 2024-04-02T07:33:44.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9b3e00640 1 -- 172.21.15.55:0/2331831745 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9a40ac5f0 con 0x7fa9b4144260 2024-04-02T07:33:44.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9b3e00640 1 -- 172.21.15.55:0/2331831745 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9a40ac980 con 0x7fa9b4144260 2024-04-02T07:33:44.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9bba00640 1 -- 172.21.15.55:0/2331831745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b4144260 msgr2=0x7fa9b40702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:44.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9bba00640 1 --2- 172.21.15.55:0/2331831745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b4144260 0x7fa9b40702a0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fa9a40097c0 tx=0x7fa9a401c4a0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9bba00640 1 -- 172.21.15.55:0/2331831745 shutdown_connections 2024-04-02T07:33:44.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9bba00640 1 --2- 172.21.15.55:0/2331831745 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b4144260 0x7fa9b40702a0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9bba00640 1 -- 172.21.15.55:0/2331831745 >> 172.21.15.55:0/2331831745 conn(0x7fa9b406a390 msgr2=0x7fa9b40b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:44.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9bba00640 1 -- 172.21.15.55:0/2331831745 shutdown_connections 2024-04-02T07:33:44.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9bba00640 1 -- 172.21.15.55:0/2331831745 wait complete. 2024-04-02T07:33:44.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9bba00640 1 Processor -- start 2024-04-02T07:33:44.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9bba00640 1 -- start start 2024-04-02T07:33:44.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9bba00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9b40707e0 0x7fa9b4137710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:44.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9bba00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9b40b31a0 0x7fa9b41536e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:44.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9bba00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b4144260 0x7fa9b41596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9bba00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b41532c0 con 0x7fa9b4144260 2024-04-02T07:33:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9bba00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b41523f0 con 0x7fa9b40b31a0 2024-04-02T07:33:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9bba00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9b4152640 con 0x7fa9b40707e0 2024-04-02T07:33:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9b9a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b4144260 0x7fa9b41596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9b9a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b4144260 0x7fa9b41596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60760/0 (socket says 172.21.15.55:60760) 2024-04-02T07:33:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9b9a00640 1 -- 172.21.15.55:0/1398552437 learned_addr learned my addr 172.21.15.55:0/1398552437 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9b9000640 1 --2- 172.21.15.55:0/1398552437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9b40707e0 0x7fa9b4137710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:44.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.844+0000 7fa9abe00640 1 --2- 172.21.15.55:0/1398552437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9b40b31a0 0x7fa9b41536e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:44.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.848+0000 7fa9b9a00640 1 -- 172.21.15.55:0/1398552437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9b40707e0 msgr2=0x7fa9b4137710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:44.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.848+0000 7fa9b9a00640 1 --2- 172.21.15.55:0/1398552437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9b40707e0 0x7fa9b4137710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.848+0000 7fa9b9a00640 1 -- 172.21.15.55:0/1398552437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9b40b31a0 msgr2=0x7fa9b41536e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:44.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.848+0000 7fa9b9a00640 1 --2- 172.21.15.55:0/1398552437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9b40b31a0 0x7fa9b41536e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:44.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.848+0000 7fa9b9a00640 1 -- 172.21.15.55:0/1398552437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9a4009420 con 0x7fa9b4144260 2024-04-02T07:33:44.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.848+0000 7fa9b9a00640 1 --2- 172.21.15.55:0/1398552437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b4144260 0x7fa9b41596b0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac00c770 tx=0x7fa9ac00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.848+0000 7fa9b1600640 1 -- 172.21.15.55:0/1398552437 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac003b80 con 0x7fa9b4144260 2024-04-02T07:33:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.848+0000 7fa9b1600640 1 -- 172.21.15.55:0/1398552437 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9ac003ce0 con 0x7fa9b4144260 2024-04-02T07:33:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.848+0000 7fa9b1600640 1 -- 172.21.15.55:0/1398552437 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac00aa90 con 0x7fa9b4144260 2024-04-02T07:33:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.848+0000 7fa9bba00640 1 -- 172.21.15.55:0/1398552437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9b4152920 con 0x7fa9b4144260 2024-04-02T07:33:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.848+0000 7fa9bba00640 1 -- 172.21.15.55:0/1398552437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9b4152ee0 con 0x7fa9b4144260 2024-04-02T07:33:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.848+0000 7fa9bba00640 1 -- 172.21.15.55:0/1398552437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9b4073530 con 0x7fa9b4144260 2024-04-02T07:33:44.850 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.848+0000 7fa9b1600640 1 -- 172.21.15.55:0/1398552437 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa9ac00abf0 con 0x7fa9b4144260 2024-04-02T07:33:44.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.848+0000 7fa9b1600640 1 --2- 172.21.15.55:0/1398552437 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa9900666c0 0x7fa990068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:44.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.848+0000 7fa9b1600640 1 -- 172.21.15.55:0/1398552437 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9ac083ca0 con 0x7fa9b4144260 2024-04-02T07:33:44.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.848+0000 7fa9b9000640 1 --2- 172.21.15.55:0/1398552437 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa9900666c0 0x7fa990068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:44.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.852+0000 7fa9b9000640 1 --2- 172.21.15.55:0/1398552437 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa9900666c0 0x7fa990068b80 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fa9a40ae000 tx=0x7fa9a40a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:44.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:44.852+0000 7fa9b1600640 1 -- 172.21.15.55:0/1398552437 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa9ac0510b0 con 0x7fa9b4144260 2024-04-02T07:33:45.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.016+0000 7fa9bba00640 1 -- 172.21.15.55:0/1398552437 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa9b40b3580 con 0x7fa9b4144260 2024-04-02T07:33:45.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.016+0000 7fa9b1600640 1 -- 172.21.15.55:0/1398552437 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa9b40b3580 con 0x7fa9b4144260 2024-04-02T07:33:45.020 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:33:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.020+0000 7fa9bba00640 1 -- 172.21.15.55:0/1398552437 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa9900666c0 msgr2=0x7fa990068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.020+0000 7fa9bba00640 1 --2- 172.21.15.55:0/1398552437 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa9900666c0 0x7fa990068b80 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fa9a40ae000 tx=0x7fa9a40a7000 comp rx=0 tx=0).stop 2024-04-02T07:33:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.020+0000 7fa9bba00640 1 -- 172.21.15.55:0/1398552437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b4144260 msgr2=0x7fa9b41596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.020+0000 7fa9bba00640 1 --2- 172.21.15.55:0/1398552437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b4144260 0x7fa9b41596b0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac00c770 tx=0x7fa9ac00cc30 comp rx=0 tx=0).stop 2024-04-02T07:33:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.020+0000 7fa9bba00640 1 -- 172.21.15.55:0/1398552437 shutdown_connections 2024-04-02T07:33:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.020+0000 7fa9bba00640 1 --2- 172.21.15.55:0/1398552437 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa9b4144260 0x7fa9b41596b0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.020+0000 7fa9bba00640 1 --2- 172.21.15.55:0/1398552437 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa9900666c0 0x7fa990068b80 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.020+0000 7fa9bba00640 1 --2- 172.21.15.55:0/1398552437 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa9b40b31a0 0x7fa9b41536e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.020+0000 7fa9bba00640 1 --2- 172.21.15.55:0/1398552437 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa9b40707e0 0x7fa9b4137710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.020+0000 7fa9bba00640 1 -- 172.21.15.55:0/1398552437 >> 172.21.15.55:0/1398552437 conn(0x7fa9b406a390 msgr2=0x7fa9b4072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.020+0000 7fa9bba00640 1 -- 172.21.15.55:0/1398552437 shutdown_connections 2024-04-02T07:33:45.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.020+0000 7fa9bba00640 1 -- 172.21.15.55:0/1398552437 wait complete. 2024-04-02T07:33:45.040 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:33:45.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.180+0000 7f5d30200640 1 Processor -- start 2024-04-02T07:33:45.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.180+0000 7f5d30200640 1 -- start start 2024-04-02T07:33:45.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.180+0000 7f5d30200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d28072130 0x7f5d28069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:45.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.180+0000 7f5d30200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d2806a2d0 0x7f5d28160760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:45.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.180+0000 7f5d30200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d2815de90 con 0x7f5d28157000 2024-04-02T07:33:45.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.180+0000 7f5d30200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d2815d070 con 0x7f5d2806a2d0 2024-04-02T07:33:45.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.180+0000 7f5d30200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2806a760 con 0x7f5d28072130 2024-04-02T07:33:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.180+0000 7f5d2e200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d2806a2d0 0x7f5d28160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.180+0000 7f5d2e200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5d2806a2d0 0x7f5d28160760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60762/0 (socket says 172.21.15.55:60762) 2024-04-02T07:33:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.184+0000 7f5d2e200640 1 -- 172.21.15.55:0/3962905492 learned_addr learned my addr 172.21.15.55:0/3962905492 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.184+0000 7f5d2ce00640 1 --2- 172.21.15.55:0/3962905492 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d28072130 0x7f5d28069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.184+0000 7f5d2e200640 1 -- 172.21.15.55:0/3962905492 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d28072130 msgr2=0x7f5d28069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.184+0000 7f5d2e200640 1 --2- 172.21.15.55:0/3962905492 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d28072130 0x7f5d28069d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.184+0000 7f5d2e200640 1 -- 172.21.15.55:0/3962905492 >> v1:172.21.15.106:6789/0 conn(0x7f5d28157000 legacy=0x7f5d28071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.184+0000 7f5d2e200640 1 -- 172.21.15.55:0/3962905492 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d2815d280 con 0x7f5d2806a2d0 2024-04-02T07:33:45.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.184+0000 7f5d2ce00640 1 --2- 172.21.15.55:0/3962905492 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d28072130 0x7f5d28069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:45.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.184+0000 7f5d2e200640 1 --2- 172.21.15.55:0/3962905492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d2806a2d0 0x7f5d28160760 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009e50 tx=0x7f5d2001c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9254153dd32f3f90 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:45.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.184+0000 7f5d27e00640 1 -- 172.21.15.55:0/3962905492 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d200a5840 con 0x7f5d2806a2d0 2024-04-02T07:33:45.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.184+0000 7f5d27e00640 1 -- 172.21.15.55:0/3962905492 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d200a59a0 con 0x7f5d2806a2d0 2024-04-02T07:33:45.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.184+0000 7f5d27e00640 1 -- 172.21.15.55:0/3962905492 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d200a5d30 con 0x7f5d2806a2d0 2024-04-02T07:33:45.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d30200640 1 -- 172.21.15.55:0/3962905492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d2806a2d0 msgr2=0x7f5d28160760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:45.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d30200640 1 --2- 172.21.15.55:0/3962905492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d2806a2d0 0x7f5d28160760 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009e50 tx=0x7f5d2001c9c0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d30200640 1 -- 172.21.15.55:0/3962905492 shutdown_connections 2024-04-02T07:33:45.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d30200640 1 --2- 172.21.15.55:0/3962905492 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d2806a2d0 0x7f5d28160760 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d30200640 1 --2- 172.21.15.55:0/3962905492 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d28072130 0x7f5d28069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d30200640 1 -- 172.21.15.55:0/3962905492 >> 172.21.15.55:0/3962905492 conn(0x7f5d280b13b0 msgr2=0x7f5d280b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:45.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d30200640 1 -- 172.21.15.55:0/3962905492 shutdown_connections 2024-04-02T07:33:45.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d30200640 1 -- 172.21.15.55:0/3962905492 wait complete. 2024-04-02T07:33:45.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d30200640 1 Processor -- start 2024-04-02T07:33:45.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d30200640 1 -- start start 2024-04-02T07:33:45.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d30200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d2806a2d0 0x7f5d28149f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:45.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d30200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d28072130 0x7f5d28154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:45.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d30200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d28157000 0x7f5d28150340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:45.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d30200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2814cfa0 con 0x7f5d28072130 2024-04-02T07:33:45.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d30200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2814ef30 con 0x7f5d2806a2d0 2024-04-02T07:33:45.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d30200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d2814a4c0 con 0x7f5d28157000 2024-04-02T07:33:45.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d2ce00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d28072130 0x7f5d28154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:45.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d2ce00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d28072130 0x7f5d28154450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60764/0 (socket says 172.21.15.55:60764) 2024-04-02T07:33:45.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d2ce00640 1 -- 172.21.15.55:0/557809040 learned_addr learned my addr 172.21.15.55:0/557809040 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:45.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d2e200640 1 --2- 172.21.15.55:0/557809040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d28157000 0x7f5d28150340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:45.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d2d800640 1 --2- 172.21.15.55:0/557809040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d2806a2d0 0x7f5d28149f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:45.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d2ce00640 1 -- 172.21.15.55:0/557809040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d28157000 msgr2=0x7f5d28150340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:45.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d2ce00640 1 --2- 172.21.15.55:0/557809040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d28157000 0x7f5d28150340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d2ce00640 1 -- 172.21.15.55:0/557809040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d2806a2d0 msgr2=0x7f5d28149f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:45.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d2ce00640 1 --2- 172.21.15.55:0/557809040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d2806a2d0 0x7f5d28149f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d2ce00640 1 -- 172.21.15.55:0/557809040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d20009b30 con 0x7f5d28072130 2024-04-02T07:33:45.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.188+0000 7f5d2ce00640 1 --2- 172.21.15.55:0/557809040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d28072130 0x7f5d28154450 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400c7c0 tx=0x7f5d1400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:45.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.192+0000 7f5d25600640 1 -- 172.21.15.55:0/557809040 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d14007a30 con 0x7f5d28072130 2024-04-02T07:33:45.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.192+0000 7f5d25600640 1 -- 172.21.15.55:0/557809040 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d14007b90 con 0x7f5d28072130 2024-04-02T07:33:45.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.192+0000 7f5d25600640 1 -- 172.21.15.55:0/557809040 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1400ce70 con 0x7f5d28072130 2024-04-02T07:33:45.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.192+0000 7f5d30200640 1 -- 172.21.15.55:0/557809040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d28152c20 con 0x7f5d28072130 2024-04-02T07:33:45.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.192+0000 7f5d30200640 1 -- 172.21.15.55:0/557809040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d2814f180 con 0x7f5d28072130 2024-04-02T07:33:45.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.192+0000 7f5d30200640 1 -- 172.21.15.55:0/557809040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d28066c90 con 0x7f5d28072130 2024-04-02T07:33:45.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.192+0000 7f5d25600640 1 -- 172.21.15.55:0/557809040 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5d140113f0 con 0x7f5d28072130 2024-04-02T07:33:45.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.192+0000 7f5d25600640 1 --2- 172.21.15.55:0/557809040 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d08066690 0x7f5d08068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:45.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.192+0000 7f5d25600640 1 -- 172.21.15.55:0/557809040 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d14084680 con 0x7f5d28072130 2024-04-02T07:33:45.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.192+0000 7f5d2d800640 1 --2- 172.21.15.55:0/557809040 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d08066690 0x7f5d08068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:45.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.192+0000 7f5d2d800640 1 --2- 172.21.15.55:0/557809040 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d08066690 0x7f5d08068b50 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0098e0 tx=0x7f5d1c009060 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:45.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.196+0000 7f5d25600640 1 -- 172.21.15.55:0/557809040 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5d14051a00 con 0x7f5d28072130 2024-04-02T07:33:45.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.356+0000 7f5d30200640 1 -- 172.21.15.55:0/557809040 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5d28071800 con 0x7f5d28072130 2024-04-02T07:33:45.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.356+0000 7f5d25600640 1 -- 172.21.15.55:0/557809040 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5d14055020 con 0x7f5d28072130 2024-04-02T07:33:45.359 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:33:45.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.360+0000 7f5d30200640 1 -- 172.21.15.55:0/557809040 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d08066690 msgr2=0x7f5d08068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:45.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.360+0000 7f5d30200640 1 --2- 172.21.15.55:0/557809040 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d08066690 0x7f5d08068b50 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f5d1c0098e0 tx=0x7f5d1c009060 comp rx=0 tx=0).stop 2024-04-02T07:33:45.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.360+0000 7f5d30200640 1 -- 172.21.15.55:0/557809040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d28072130 msgr2=0x7f5d28154450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:45.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.360+0000 7f5d30200640 1 --2- 172.21.15.55:0/557809040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d28072130 0x7f5d28154450 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f5d1400c7c0 tx=0x7f5d1400cc80 comp rx=0 tx=0).stop 2024-04-02T07:33:45.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.360+0000 7f5d30200640 1 -- 172.21.15.55:0/557809040 shutdown_connections 2024-04-02T07:33:45.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.360+0000 7f5d30200640 1 --2- 172.21.15.55:0/557809040 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d28157000 0x7f5d28150340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.360+0000 7f5d30200640 1 --2- 172.21.15.55:0/557809040 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d28072130 0x7f5d28154450 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.360+0000 7f5d30200640 1 --2- 172.21.15.55:0/557809040 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d08066690 0x7f5d08068b50 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.360+0000 7f5d30200640 1 --2- 172.21.15.55:0/557809040 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d2806a2d0 0x7f5d28149f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.360+0000 7f5d30200640 1 -- 172.21.15.55:0/557809040 >> 172.21.15.55:0/557809040 conn(0x7f5d280b13b0 msgr2=0x7f5d280ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:45.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.360+0000 7f5d30200640 1 -- 172.21.15.55:0/557809040 shutdown_connections 2024-04-02T07:33:45.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.360+0000 7f5d30200640 1 -- 172.21.15.55:0/557809040 wait complete. 2024-04-02T07:33:45.382 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:33:45.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.520+0000 7f55a4200640 1 Processor -- start 2024-04-02T07:33:45.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.520+0000 7f55a4200640 1 -- start start 2024-04-02T07:33:45.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.520+0000 7f55a4200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f559c160a50 0x7f559c160ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.520+0000 7f55a4200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f559c0abd50 0x7f559c0ac1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.520+0000 7f55a4200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f559c15df80 con 0x7f559c160670 2024-04-02T07:33:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.520+0000 7f55a4200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f559c0cd410 con 0x7f559c160a50 2024-04-02T07:33:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.520+0000 7f55a4200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c06a8d0 con 0x7f559c0abd50 2024-04-02T07:33:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.520+0000 7f55a1800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f559c160670 0x7f559c0ccc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34052/0 (socket says 172.21.15.55:34052) 2024-04-02T07:33:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.524+0000 7f55a1800640 1 -- 172.21.15.55:0/1402581815 learned_addr learned my addr 172.21.15.55:0/1402581815 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.524+0000 7f55a0e00640 1 --2- 172.21.15.55:0/1402581815 >> v2:172.21.15.55:3300/0 conn(0x7f559c160a50 0x7f559c160ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.524+0000 7f55a2200640 1 --2- 172.21.15.55:0/1402581815 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f559c0abd50 0x7f559c0ac1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.524+0000 7f559be00640 1 -- 172.21.15.55:0/1402581815 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 203426343 0 0) 0x7f559c15df80 con 0x7f559c160670 2024-04-02T07:33:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.524+0000 7f559be00640 1 -- 172.21.15.55:0/1402581815 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5584003530 con 0x7f559c160670 2024-04-02T07:33:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.524+0000 7f55a0e00640 1 -- 172.21.15.55:0/1402581815 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f559c0abd50 msgr2=0x7f559c0ac1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.524+0000 7f55a0e00640 1 --2- 172.21.15.55:0/1402581815 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f559c0abd50 0x7f559c0ac1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.524+0000 7f55a0e00640 1 -- 172.21.15.55:0/1402581815 >> v1:172.21.15.55:6789/0 conn(0x7f559c160670 legacy=0x7f559c0ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:45.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.524+0000 7f55a0e00640 1 -- 172.21.15.55:0/1402581815 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f559c06abb0 con 0x7f559c160a50 2024-04-02T07:33:45.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.524+0000 7f55a0e00640 1 --2- 172.21.15.55:0/1402581815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c160a50 0x7f559c160ee0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f55880097c0 tx=0x7f558801c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=756a680463fe1f7c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:45.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.524+0000 7f559be00640 1 -- 172.21.15.55:0/1402581815 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55880ab600 con 0x7f559c160a50 2024-04-02T07:33:45.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.524+0000 7f559be00640 1 -- 172.21.15.55:0/1402581815 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55880a7050 con 0x7f559c160a50 2024-04-02T07:33:45.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.524+0000 7f559be00640 1 -- 172.21.15.55:0/1402581815 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55880ab960 con 0x7f559c160a50 2024-04-02T07:33:45.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a4200640 1 -- 172.21.15.55:0/1402581815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c160a50 msgr2=0x7f559c160ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:45.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a4200640 1 --2- 172.21.15.55:0/1402581815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c160a50 0x7f559c160ee0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f55880097c0 tx=0x7f558801c320 comp rx=0 tx=0).stop 2024-04-02T07:33:45.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a4200640 1 -- 172.21.15.55:0/1402581815 shutdown_connections 2024-04-02T07:33:45.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a4200640 1 --2- 172.21.15.55:0/1402581815 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f559c0abd50 0x7f559c0ac1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a4200640 1 --2- 172.21.15.55:0/1402581815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c160a50 0x7f559c160ee0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a4200640 1 -- 172.21.15.55:0/1402581815 >> 172.21.15.55:0/1402581815 conn(0x7f559c0cb7d0 msgr2=0x7f559c0cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:45.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a4200640 1 -- 172.21.15.55:0/1402581815 shutdown_connections 2024-04-02T07:33:45.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a4200640 1 -- 172.21.15.55:0/1402581815 wait complete. 2024-04-02T07:33:45.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a4200640 1 Processor -- start 2024-04-02T07:33:45.530 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a4200640 1 -- start start 2024-04-02T07:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a4200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f559c0abd50 0x7f559c0c35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a4200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f559c160670 0x7f559c0af6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a4200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c160a50 0x7f559c0afc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a4200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c1f5d10 con 0x7f559c160a50 2024-04-02T07:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a4200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f559c1f53e0 con 0x7f559c160670 2024-04-02T07:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a4200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f559c1f56c0 con 0x7f559c0abd50 2024-04-02T07:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a2200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c160a50 0x7f559c0afc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a2200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c160a50 0x7f559c0afc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60782/0 (socket says 172.21.15.55:60782) 2024-04-02T07:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a2200640 1 -- 172.21.15.55:0/1014394331 learned_addr learned my addr 172.21.15.55:0/1014394331 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a0e00640 1 --2- 172.21.15.55:0/1014394331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f559c160670 0x7f559c0af6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a1800640 1 --2- 172.21.15.55:0/1014394331 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f559c0abd50 0x7f559c0c35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a2200640 1 -- 172.21.15.55:0/1014394331 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f559c0abd50 msgr2=0x7f559c0c35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a2200640 1 --2- 172.21.15.55:0/1014394331 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f559c0abd50 0x7f559c0c35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a2200640 1 -- 172.21.15.55:0/1014394331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f559c160670 msgr2=0x7f559c0af6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a2200640 1 --2- 172.21.15.55:0/1014394331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f559c160670 0x7f559c0af6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a2200640 1 -- 172.21.15.55:0/1014394331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5588009420 con 0x7f559c160a50 2024-04-02T07:33:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.528+0000 7f55a1800640 1 --2- 172.21.15.55:0/1014394331 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f559c0abd50 0x7f559c0c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.532+0000 7f55a2200640 1 --2- 172.21.15.55:0/1014394331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c160a50 0x7f559c0afc20 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f559400efc0 tx=0x7f559400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.532+0000 7f5599600640 1 -- 172.21.15.55:0/1014394331 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594014480 con 0x7f559c160a50 2024-04-02T07:33:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.532+0000 7f5599600640 1 -- 172.21.15.55:0/1014394331 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f559400f040 con 0x7f559c160a50 2024-04-02T07:33:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.532+0000 7f5599600640 1 -- 172.21.15.55:0/1014394331 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5594014820 con 0x7f559c160a50 2024-04-02T07:33:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.532+0000 7f55a4200640 1 -- 172.21.15.55:0/1014394331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f559c1f59a0 con 0x7f559c160a50 2024-04-02T07:33:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.532+0000 7f55a4200640 1 -- 172.21.15.55:0/1014394331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f559c1f5040 con 0x7f559c160a50 2024-04-02T07:33:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.532+0000 7f55a4200640 1 -- 172.21.15.55:0/1014394331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f559c1f5ec0 con 0x7f559c160a50 2024-04-02T07:33:45.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.532+0000 7f5599600640 1 -- 172.21.15.55:0/1014394331 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5594014980 con 0x7f559c160a50 2024-04-02T07:33:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.532+0000 7f5599600640 1 --2- 172.21.15.55:0/1014394331 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f557c066690 0x7f557c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.532+0000 7f5599600640 1 -- 172.21.15.55:0/1014394331 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5594084cc0 con 0x7f559c160a50 2024-04-02T07:33:45.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.532+0000 7f55a1800640 1 --2- 172.21.15.55:0/1014394331 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f557c066690 0x7f557c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:45.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.536+0000 7f55a1800640 1 --2- 172.21.15.55:0/1014394331 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f557c066690 0x7f557c068b50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f5590005890 tx=0x7f5590009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:45.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.536+0000 7f5599600640 1 -- 172.21.15.55:0/1014394331 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f559c1f5ec0 con 0x7f559c160a50 2024-04-02T07:33:45.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.712+0000 7f55a4200640 1 -- 172.21.15.55:0/1014394331 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f559c1f5ec0 con 0x7f559c160a50 2024-04-02T07:33:45.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.712+0000 7f5599600640 1 -- 172.21.15.55:0/1014394331 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v116) v1 ==== 80+0+0 (secure 0 0 0) 0x7f559c1f5ec0 con 0x7f559c160a50 2024-04-02T07:33:45.712 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:33:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.712+0000 7f55a4200640 1 -- 172.21.15.55:0/1014394331 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f557c066690 msgr2=0x7f557c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.712+0000 7f55a4200640 1 --2- 172.21.15.55:0/1014394331 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f557c066690 0x7f557c068b50 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f5590005890 tx=0x7f5590009040 comp rx=0 tx=0).stop 2024-04-02T07:33:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.712+0000 7f55a4200640 1 -- 172.21.15.55:0/1014394331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c160a50 msgr2=0x7f559c0afc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.712+0000 7f55a4200640 1 --2- 172.21.15.55:0/1014394331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c160a50 0x7f559c0afc20 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f559400efc0 tx=0x7f559400c490 comp rx=0 tx=0).stop 2024-04-02T07:33:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.712+0000 7f55a4200640 1 -- 172.21.15.55:0/1014394331 shutdown_connections 2024-04-02T07:33:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.712+0000 7f55a4200640 1 --2- 172.21.15.55:0/1014394331 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f559c160a50 0x7f559c0afc20 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.712+0000 7f55a4200640 1 --2- 172.21.15.55:0/1014394331 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f557c066690 0x7f557c068b50 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.712+0000 7f55a4200640 1 --2- 172.21.15.55:0/1014394331 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f559c160670 0x7f559c0af6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.712+0000 7f55a4200640 1 --2- 172.21.15.55:0/1014394331 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f559c0abd50 0x7f559c0c35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.712+0000 7f55a4200640 1 -- 172.21.15.55:0/1014394331 >> 172.21.15.55:0/1014394331 conn(0x7f559c0cb7d0 msgr2=0x7f559c0cbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:45.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.712+0000 7f55a4200640 1 -- 172.21.15.55:0/1014394331 shutdown_connections 2024-04-02T07:33:45.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:45.712+0000 7f55a4200640 1 -- 172.21.15.55:0/1014394331 wait complete. 2024-04-02T07:33:45.734 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi055.front.sepia.ceph.com... 2024-04-02T07:33:45.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:45.734 DEBUG:teuthology.orchestra.run.smithi055:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-02T07:33:45.752 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[52189]: fuse finished with error 0 and tester_r 0 2024-04-02T07:33:45.755 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:33:46.096 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:33:46.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:33:51.857 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:33:51.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:51.858 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-02T07:33:51.869 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-02T07:33:51.869 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-04-02T07:33:52.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.063+0000 7f26afe00640 1 Processor -- start 2024-04-02T07:33:52.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.063+0000 7f26afe00640 1 -- start start 2024-04-02T07:33:52.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.067+0000 7f26afe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f26a80b41a0 0x7f26a8142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.067+0000 7f26afe00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a806ddc0 con 0x7f26a80ade90 2024-04-02T07:33:52.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.067+0000 7f26afe00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a806c630 con 0x7f26a80b3dc0 2024-04-02T07:33:52.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.067+0000 7f26afe00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a80cae80 con 0x7f26a80b41a0 2024-04-02T07:33:52.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.067+0000 7f26aca00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f26a80ade90 0x7f26a806d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41150/0 (socket says 172.21.15.55:41150) 2024-04-02T07:33:52.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.067+0000 7f26aca00640 1 -- 172.21.15.55:0/2125695321 learned_addr learned my addr 172.21.15.55:0/2125695321 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:52.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.067+0000 7f26ade00640 1 --2- 172.21.15.55:0/2125695321 >> v2:172.21.15.106:3300/0 conn(0x7f26a80b41a0 0x7f26a8142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.067+0000 7f26a7e00640 1 -- 172.21.15.55:0/2125695321 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4028406545 0 0) 0x7f26a806ddc0 con 0x7f26a80ade90 2024-04-02T07:33:52.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.067+0000 7f26a7e00640 1 -- 172.21.15.55:0/2125695321 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2690005740 con 0x7f26a80ade90 2024-04-02T07:33:52.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.067+0000 7f26a7e00640 1 -- 172.21.15.55:0/2125695321 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1302455221 0 0) 0x7f2690005740 con 0x7f26a80ade90 2024-04-02T07:33:52.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.067+0000 7f26ade00640 1 -- 172.21.15.55:0/2125695321 >> v1:172.21.15.106:6789/0 conn(0x7f26a80b3dc0 legacy=0x7f26a80ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:52.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.067+0000 7f26ade00640 1 -- 172.21.15.55:0/2125695321 >> v1:172.21.15.55:6789/0 conn(0x7f26a80ade90 legacy=0x7f26a806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:52.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.067+0000 7f26ade00640 1 -- 172.21.15.55:0/2125695321 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a806c8f0 con 0x7f26a80b41a0 2024-04-02T07:33:52.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.071+0000 7f26ade00640 1 --2- 172.21.15.55:0/2125695321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26a80b41a0 0x7f26a8142ac0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009d90 tx=0x7f26a001c860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7693b2f25b459379 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:52.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.071+0000 7f26a7e00640 1 -- 172.21.15.55:0/2125695321 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694001680 con 0x7f26a80b41a0 2024-04-02T07:33:52.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.071+0000 7f26a7e00640 1 -- 172.21.15.55:0/2125695321 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26a00a55b0 con 0x7f26a80b41a0 2024-04-02T07:33:52.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.071+0000 7f26a7e00640 1 -- 172.21.15.55:0/2125695321 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a00a5940 con 0x7f26a80b41a0 2024-04-02T07:33:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.071+0000 7f26afe00640 1 -- 172.21.15.55:0/2125695321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26a80b41a0 msgr2=0x7f26a8142ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.071+0000 7f26afe00640 1 --2- 172.21.15.55:0/2125695321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26a80b41a0 0x7f26a8142ac0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f26a0009d90 tx=0x7f26a001c860 comp rx=0 tx=0).stop 2024-04-02T07:33:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.071+0000 7f26afe00640 1 -- 172.21.15.55:0/2125695321 shutdown_connections 2024-04-02T07:33:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.071+0000 7f26afe00640 1 --2- 172.21.15.55:0/2125695321 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26a80b41a0 0x7f26a8142ac0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.071+0000 7f26afe00640 1 -- 172.21.15.55:0/2125695321 >> 172.21.15.55:0/2125695321 conn(0x7f26a806a390 msgr2=0x7f26a80b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:52.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.071+0000 7f26afe00640 1 -- 172.21.15.55:0/2125695321 shutdown_connections 2024-04-02T07:33:52.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.071+0000 7f26afe00640 1 -- 172.21.15.55:0/2125695321 wait complete. 2024-04-02T07:33:52.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.071+0000 7f26afe00640 1 Processor -- start 2024-04-02T07:33:52.070 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.071+0000 7f26afe00640 1 -- start start 2024-04-02T07:33:52.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.071+0000 7f26afe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26a80ade90 0x7f26a81389f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.071+0000 7f26afe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26a80b3dc0 0x7f26a814c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.071+0000 7f26afe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26a80b41a0 0x7f26a81521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.071+0000 7f26afe00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a814b8d0 con 0x7f26a80b3dc0 2024-04-02T07:33:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.071+0000 7f26afe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a814bbb0 con 0x7f26a80ade90 2024-04-02T07:33:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.071+0000 7f26afe00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a814be90 con 0x7f26a80b41a0 2024-04-02T07:33:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.075+0000 7f26aca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26a80b3dc0 0x7f26a814c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.075+0000 7f26aca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26a80b3dc0 0x7f26a814c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44444/0 (socket says 172.21.15.55:44444) 2024-04-02T07:33:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.075+0000 7f26aca00640 1 -- 172.21.15.55:0/3009631625 learned_addr learned my addr 172.21.15.55:0/3009631625 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.075+0000 7f26ade00640 1 --2- 172.21.15.55:0/3009631625 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26a80b41a0 0x7f26a81521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.075+0000 7f26ad400640 1 --2- 172.21.15.55:0/3009631625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26a80ade90 0x7f26a81389f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.075+0000 7f26aca00640 1 -- 172.21.15.55:0/3009631625 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26a80b41a0 msgr2=0x7f26a81521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.075+0000 7f26aca00640 1 --2- 172.21.15.55:0/3009631625 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26a80b41a0 0x7f26a81521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.075+0000 7f26aca00640 1 -- 172.21.15.55:0/3009631625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26a80ade90 msgr2=0x7f26a81389f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.075+0000 7f26aca00640 1 --2- 172.21.15.55:0/3009631625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26a80ade90 0x7f26a81389f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.075+0000 7f26aca00640 1 -- 172.21.15.55:0/3009631625 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a0009a70 con 0x7f26a80b3dc0 2024-04-02T07:33:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.075+0000 7f26aca00640 1 --2- 172.21.15.55:0/3009631625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26a80b3dc0 0x7f26a814c970 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f269400c730 tx=0x7f269400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.075+0000 7f26a5600640 1 -- 172.21.15.55:0/3009631625 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694005ae0 con 0x7f26a80b3dc0 2024-04-02T07:33:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.075+0000 7f26a5600640 1 -- 172.21.15.55:0/3009631625 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2694005c40 con 0x7f26a80b3dc0 2024-04-02T07:33:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.075+0000 7f26a5600640 1 -- 172.21.15.55:0/3009631625 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26940072b0 con 0x7f26a80b3dc0 2024-04-02T07:33:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.075+0000 7f26afe00640 1 -- 172.21.15.55:0/3009631625 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a814c170 con 0x7f26a80b3dc0 2024-04-02T07:33:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.075+0000 7f26afe00640 1 -- 172.21.15.55:0/3009631625 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a8138f30 con 0x7f26a80b3dc0 2024-04-02T07:33:52.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.075+0000 7f26a5600640 1 -- 172.21.15.55:0/3009631625 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2694007410 con 0x7f26a80b3dc0 2024-04-02T07:33:52.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26a5600640 1 --2- 172.21.15.55:0/3009631625 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f26880666c0 0x7f2688068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26a5600640 1 -- 172.21.15.55:0/3009631625 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26940839b0 con 0x7f26a80b3dc0 2024-04-02T07:33:52.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26ad400640 1 --2- 172.21.15.55:0/3009631625 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f26880666c0 0x7f2688068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26b32f6000 1 Processor -- start 2024-04-02T07:33:52.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26b32f6000 1 -- start start 2024-04-02T07:33:52.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26ad400640 1 --2- 172.21.15.55:0/3009631625 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f26880666c0 0x7f2688068b80 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f269c007fd0 tx=0x7f269c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:52.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26b32f6000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c5da70 0x55faa1c5de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26b32f6000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5e390 0x55faa1c114c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26b32f6000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c11a00 0x55faa1c11de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26b32f6000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faa1adc630 con 0x55faa1c5e390 2024-04-02T07:33:52.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26b32f6000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faa1a69bd0 con 0x55faa1c5da70 2024-04-02T07:33:52.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26b32f6000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55faa1a671a0 con 0x55faa1c11a00 2024-04-02T07:33:52.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26aca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5e390 0x55faa1c114c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26aca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5e390 0x55faa1c114c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44446/0 (socket says 172.21.15.55:44446) 2024-04-02T07:33:52.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26aca00640 1 -- 172.21.15.55:0/1185486412 learned_addr learned my addr 172.21.15.55:0/1185486412 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:52.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26ad400640 1 --2- 172.21.15.55:0/1185486412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c5da70 0x55faa1c5de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26ade00640 1 --2- 172.21.15.55:0/1185486412 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c11a00 0x55faa1c11de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26aca00640 1 -- 172.21.15.55:0/1185486412 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c11a00 msgr2=0x55faa1c11de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:52.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26aca00640 1 --2- 172.21.15.55:0/1185486412 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c11a00 0x55faa1c11de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26aca00640 1 -- 172.21.15.55:0/1185486412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c5da70 msgr2=0x55faa1c5de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:52.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26aca00640 1 --2- 172.21.15.55:0/1185486412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c5da70 0x55faa1c5de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26aca00640 1 -- 172.21.15.55:0/1185486412 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55faa175ee20 con 0x55faa1c5e390 2024-04-02T07:33:52.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26ad400640 1 --2- 172.21.15.55:0/1185486412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c5da70 0x55faa1c5de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:52.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26ade00640 1 --2- 172.21.15.55:0/1185486412 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c11a00 0x55faa1c11de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:52.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f26aca00640 1 --2- 172.21.15.55:0/1185486412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5e390 0x55faa1c114c0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f269405c800 tx=0x7f26940549f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=216200a3cca87f4d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:52.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f269a000640 1 -- 172.21.15.55:0/1185486412 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269405cd30 con 0x55faa1c5e390 2024-04-02T07:33:52.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f269a000640 1 -- 172.21.15.55:0/1185486412 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26940076c0 con 0x55faa1c5e390 2024-04-02T07:33:52.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.079+0000 7f269a000640 1 -- 172.21.15.55:0/1185486412 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694051100 con 0x55faa1c5e390 2024-04-02T07:33:52.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26b32f6000 1 -- 172.21.15.55:0/1185486412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5e390 msgr2=0x55faa1c114c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:52.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26b32f6000 1 --2- 172.21.15.55:0/1185486412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5e390 0x55faa1c114c0 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f269405c800 tx=0x7f26940549f0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26b32f6000 1 -- 172.21.15.55:0/1185486412 shutdown_connections 2024-04-02T07:33:52.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26b32f6000 1 --2- 172.21.15.55:0/1185486412 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c11a00 0x55faa1c11de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26b32f6000 1 --2- 172.21.15.55:0/1185486412 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5e390 0x55faa1c114c0 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26b32f6000 1 --2- 172.21.15.55:0/1185486412 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c5da70 0x55faa1c5de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26b32f6000 1 -- 172.21.15.55:0/1185486412 >> 172.21.15.55:0/1185486412 conn(0x55faa1a12160 msgr2=0x55faa1c40820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:52.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26b32f6000 1 -- 172.21.15.55:0/1185486412 shutdown_connections 2024-04-02T07:33:52.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26b32f6000 1 -- 172.21.15.55:0/1185486412 wait complete. 2024-04-02T07:33:52.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26b32f6000 1 -- start start 2024-04-02T07:33:52.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26b32f6000 1 Processor -- start 2024-04-02T07:33:52.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26b32f6000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c11a00 0x55faa1c1a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26b32f6000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c5da70 0x55faa1c1a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26b32f6000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c5e390 0x55faa1c45e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26b32f6000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faa1a62a90 con 0x55faa1c11a00 2024-04-02T07:33:52.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26b32f6000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faa1a01d40 con 0x55faa1c5da70 2024-04-02T07:33:52.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26b32f6000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55faa1a1ff30 con 0x55faa1c5e390 2024-04-02T07:33:52.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26b32f6000 10 client.0 _ll_register_callbacks cb 0x55faa1ac4810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:33:52.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26ad400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c11a00 0x55faa1c1a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26ad400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c11a00 0x55faa1c1a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44448/0 (socket says 172.21.15.55:44448) 2024-04-02T07:33:52.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26ad400640 1 -- 172.21.15.55:0/2068056977 learned_addr learned my addr 172.21.15.55:0/2068056977 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:52.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26aca00640 1 --2- 172.21.15.55:0/2068056977 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c5da70 0x55faa1c1a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26ade00640 1 --2- 172.21.15.55:0/2068056977 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c5e390 0x55faa1c45e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26ad400640 1 -- 172.21.15.55:0/2068056977 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c5e390 msgr2=0x55faa1c45e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:52.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26ad400640 1 --2- 172.21.15.55:0/2068056977 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c5e390 0x55faa1c45e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26ad400640 1 -- 172.21.15.55:0/2068056977 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c5da70 msgr2=0x55faa1c1a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:52.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26ad400640 1 --2- 172.21.15.55:0/2068056977 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c5da70 0x55faa1c1a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26ad400640 1 -- 172.21.15.55:0/2068056977 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a8138f30 con 0x55faa1c11a00 2024-04-02T07:33:52.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26ad400640 1 --2- 172.21.15.55:0/2068056977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c11a00 0x55faa1c1a3f0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f269c0146d0 tx=0x7f269c001130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bff50d33e2c0332 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:52.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f268ea00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:33:52.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f268ea00640 1 -- 172.21.15.55:0/2068056977 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269c013680 con 0x55faa1c11a00 2024-04-02T07:33:52.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f268ea00640 1 -- 172.21.15.55:0/2068056977 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f269c0137e0 con 0x55faa1c11a00 2024-04-02T07:33:52.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.083+0000 7f26b32f6000 1 -- 172.21.15.55:0/2068056977 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55faa1a613e0 con 0x55faa1c11a00 2024-04-02T07:33:52.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f268ea00640 1 -- 172.21.15.55:0/2068056977 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) v2 ==== 24+0+0 (secure 0 0 0) 0x7f269c0139a0 con 0x55faa1c11a00 2024-04-02T07:33:52.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26b32f6000 10 client.9411 fetch_fsmap learned FSMap version 96 2024-04-02T07:33:52.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26b32f6000 1 -- 172.21.15.55:0/2068056977 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) v3 -- 0x55faa1a27aa0 con 0x55faa1c11a00 2024-04-02T07:33:52.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f268ea00640 1 -- 172.21.15.55:0/2068056977 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55faa1a613e0 con 0x55faa1c11a00 2024-04-02T07:33:52.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f268ea00640 1 -- 172.21.15.55:0/2068056977 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 96) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f269c012070 con 0x55faa1c11a00 2024-04-02T07:33:52.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26b32f6000 10 client.9411 fetch_fsmap finished waiting for FSMap version 96 2024-04-02T07:33:52.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26b32f6000 10 client.9411 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-04-02T07:33:52.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26b32f6000 20 client.9411 populate_metadata read hostname 'smithi055' 2024-04-02T07:33:52.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26b32f6000 1 --2- 172.21.15.55:0/2068056977 >> [v2:172.21.15.106:6834/775582321,v1:172.21.15.106:6837/775582321] conn(0x55faa1c46870 0x55faa1c73d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26b32f6000 4 client.9411 mds_command: new command op to 9156 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:33:52.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26b32f6000 1 -- 172.21.15.55:0/2068056977 --> [v2:172.21.15.106:6834/775582321,v1:172.21.15.106:6837/775582321] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55faa1a32d00 con 0x55faa1c46870 2024-04-02T07:33:52.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26aca00640 1 --2- 172.21.15.55:0/2068056977 >> [v2:172.21.15.106:6834/775582321,v1:172.21.15.106:6837/775582321] conn(0x55faa1c46870 0x55faa1c73d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26aca00640 1 --2- 172.21.15.55:0/2068056977 >> [v2:172.21.15.106:6834/775582321,v1:172.21.15.106:6837/775582321] conn(0x55faa1c46870 0x55faa1c73d70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe12800e68e44671 server_cookie=d3d4a35a8b11f16f in_seq=0 out_seq=0 2024-04-02T07:33:52.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f268ea00640 10 client.9411 ms_handle_connect on v2:172.21.15.106:6834/775582321 2024-04-02T07:33:52.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f268ea00640 1 -- 172.21.15.55:0/2068056977 <== mds.0 v2:172.21.15.106:6834/775582321 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x55faa1a32d00 con 0x55faa1c46870 2024-04-02T07:33:52.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f268ea00640 10 client.9411 handle_command_reply: tid=0 2024-04-02T07:33:52.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26b32f6000 1 client.9411 shutdown 2024-04-02T07:33:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26b32f6000 1 -- 172.21.15.55:0/2068056977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c11a00 msgr2=0x55faa1c1a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26b32f6000 1 --2- 172.21.15.55:0/2068056977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c11a00 0x55faa1c1a3f0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f269c0146d0 tx=0x7f269c001130 comp rx=0 tx=0).stop 2024-04-02T07:33:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26b32f6000 1 -- 172.21.15.55:0/2068056977 shutdown_connections 2024-04-02T07:33:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26b32f6000 1 --2- 172.21.15.55:0/2068056977 >> [v2:172.21.15.106:6834/775582321,v1:172.21.15.106:6837/775582321] conn(0x55faa1c46870 0x55faa1c73d70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26b32f6000 1 --2- 172.21.15.55:0/2068056977 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c5e390 0x55faa1c45e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26b32f6000 1 --2- 172.21.15.55:0/2068056977 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c5da70 0x55faa1c1a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f268ea00640 0 client.9411 ms_handle_reset on v2:172.21.15.106:6834/775582321 2024-04-02T07:33:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26b32f6000 1 --2- 172.21.15.55:0/2068056977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c11a00 0x55faa1c1a3f0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26b32f6000 1 -- 172.21.15.55:0/2068056977 >> 172.21.15.55:0/2068056977 conn(0x55faa1a12160 msgr2=0x55faa1c10bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26b32f6000 1 -- 172.21.15.55:0/2068056977 shutdown_connections 2024-04-02T07:33:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26b32f6000 1 -- 172.21.15.55:0/2068056977 wait complete. 2024-04-02T07:33:52.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.087+0000 7f26b32f6000 20 client.9411 trim_cache size 0 max 16384 2024-04-02T07:33:52.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.099+0000 7f26b32f6000 1 Processor -- start 2024-04-02T07:33:52.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26b32f6000 1 -- start start 2024-04-02T07:33:52.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26b32f6000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c11a00 0x55faa1c0fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26b32f6000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5da70 0x55faa1c10160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26b32f6000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c5e390 0x55faa1c106a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26b32f6000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faa171faa0 con 0x55faa1c5da70 2024-04-02T07:33:52.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26b32f6000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faa1a602a0 con 0x55faa1c5e390 2024-04-02T07:33:52.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26b32f6000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55faa1aa6170 con 0x55faa1c11a00 2024-04-02T07:33:52.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26aca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5da70 0x55faa1c10160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26aca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5da70 0x55faa1c10160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44462/0 (socket says 172.21.15.55:44462) 2024-04-02T07:33:52.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26aca00640 1 -- 172.21.15.55:0/4059043642 learned_addr learned my addr 172.21.15.55:0/4059043642 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:52.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26ade00640 1 --2- 172.21.15.55:0/4059043642 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c5e390 0x55faa1c106a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26ad400640 1 --2- 172.21.15.55:0/4059043642 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c11a00 0x55faa1c0fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26aca00640 1 -- 172.21.15.55:0/4059043642 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c11a00 msgr2=0x55faa1c0fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:52.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26aca00640 1 --2- 172.21.15.55:0/4059043642 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c11a00 0x55faa1c0fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26aca00640 1 -- 172.21.15.55:0/4059043642 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c5e390 msgr2=0x55faa1c106a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:52.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26aca00640 1 --2- 172.21.15.55:0/4059043642 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c5e390 0x55faa1c106a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26aca00640 1 -- 172.21.15.55:0/4059043642 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55faa1a0ddf0 con 0x55faa1c5da70 2024-04-02T07:33:52.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26aca00640 1 --2- 172.21.15.55:0/4059043642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5da70 0x55faa1c10160 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f269400a430 tx=0x7f2694013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a79ebec22f832334 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:52.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f269aa00640 1 -- 172.21.15.55:0/4059043642 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2694050d30 con 0x55faa1c5da70 2024-04-02T07:33:52.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f269aa00640 1 -- 172.21.15.55:0/4059043642 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2694052d90 con 0x55faa1c5da70 2024-04-02T07:33:52.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f269aa00640 1 -- 172.21.15.55:0/4059043642 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269406c170 con 0x55faa1c5da70 2024-04-02T07:33:52.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26b32f6000 1 -- 172.21.15.55:0/4059043642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5da70 msgr2=0x55faa1c10160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:52.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26b32f6000 1 --2- 172.21.15.55:0/4059043642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5da70 0x55faa1c10160 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f269400a430 tx=0x7f2694013000 comp rx=0 tx=0).stop 2024-04-02T07:33:52.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26b32f6000 1 -- 172.21.15.55:0/4059043642 shutdown_connections 2024-04-02T07:33:52.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26b32f6000 1 --2- 172.21.15.55:0/4059043642 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c5e390 0x55faa1c106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26b32f6000 1 --2- 172.21.15.55:0/4059043642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5da70 0x55faa1c10160 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26b32f6000 1 --2- 172.21.15.55:0/4059043642 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c11a00 0x55faa1c0fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26b32f6000 1 -- 172.21.15.55:0/4059043642 >> 172.21.15.55:0/4059043642 conn(0x55faa1a12160 msgr2=0x55faa1c3f510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:52.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26b32f6000 1 -- 172.21.15.55:0/4059043642 shutdown_connections 2024-04-02T07:33:52.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26b32f6000 1 -- 172.21.15.55:0/4059043642 wait complete. 2024-04-02T07:33:52.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26b32f6000 1 -- start start 2024-04-02T07:33:52.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.103+0000 7f26b32f6000 1 Processor -- start 2024-04-02T07:33:52.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26b32f6000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c11a00 0x55faa1ca4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26b32f6000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c5da70 0x55faa1c140f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26b32f6000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5e390 0x55faa1c14630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26b32f6000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faa1c18170 con 0x55faa1c5e390 2024-04-02T07:33:52.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26b32f6000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55faa1c0b930 con 0x55faa1c11a00 2024-04-02T07:33:52.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26b32f6000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55faa1a5fe90 con 0x55faa1c5da70 2024-04-02T07:33:52.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26b32f6000 10 client.0 _ll_register_callbacks cb 0x7f26a00b0070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:33:52.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26ade00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5e390 0x55faa1c14630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26ade00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5e390 0x55faa1c14630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44472/0 (socket says 172.21.15.55:44472) 2024-04-02T07:33:52.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26ade00640 1 -- 172.21.15.55:0/1396498189 learned_addr learned my addr 172.21.15.55:0/1396498189 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:52.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26aca00640 1 --2- 172.21.15.55:0/1396498189 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c5da70 0x55faa1c140f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26ad400640 1 --2- 172.21.15.55:0/1396498189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c11a00 0x55faa1ca4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26ade00640 1 -- 172.21.15.55:0/1396498189 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c5da70 msgr2=0x55faa1c140f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:52.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26ade00640 1 --2- 172.21.15.55:0/1396498189 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c5da70 0x55faa1c140f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26ade00640 1 -- 172.21.15.55:0/1396498189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c11a00 msgr2=0x55faa1ca4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:52.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26ade00640 1 --2- 172.21.15.55:0/1396498189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c11a00 0x55faa1ca4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26ade00640 1 -- 172.21.15.55:0/1396498189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55faa175ee20 con 0x55faa1c5e390 2024-04-02T07:33:52.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26aca00640 1 --2- 172.21.15.55:0/1396498189 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c5da70 0x55faa1c140f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:52.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26ad400640 1 --2- 172.21.15.55:0/1396498189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c11a00 0x55faa1ca4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:52.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26ade00640 1 --2- 172.21.15.55:0/1396498189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5e390 0x55faa1c14630 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f26a000c090 tx=0x7f26a001b0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533f169658cce6fe server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:52.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f268ea00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:33:52.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f268ea00640 1 -- 172.21.15.55:0/1396498189 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26a00c7070 con 0x55faa1c5e390 2024-04-02T07:33:52.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f268ea00640 1 -- 172.21.15.55:0/1396498189 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26a00a5860 con 0x55faa1c5e390 2024-04-02T07:33:52.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26b32f6000 1 -- 172.21.15.55:0/1396498189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55faa1a1f970 con 0x55faa1c5e390 2024-04-02T07:33:52.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f268ea00640 1 -- 172.21.15.55:0/1396498189 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26a00a5a20 con 0x55faa1c5e390 2024-04-02T07:33:52.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26b32f6000 10 client.9417 fetch_fsmap learned FSMap version 96 2024-04-02T07:33:52.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26b32f6000 1 -- 172.21.15.55:0/1396498189 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=2+}) v3 -- 0x55faa1a01960 con 0x55faa1c5e390 2024-04-02T07:33:52.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f268ea00640 1 -- 172.21.15.55:0/1396498189 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55faa1a1f970 con 0x55faa1c5e390 2024-04-02T07:33:52.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f268ea00640 1 -- 172.21.15.55:0/1396498189 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 96) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f26a00c2070 con 0x55faa1c5e390 2024-04-02T07:33:52.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26b32f6000 10 client.9417 fetch_fsmap finished waiting for FSMap version 96 2024-04-02T07:33:52.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26b32f6000 10 client.9417 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.d 2024-04-02T07:33:52.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26b32f6000 20 client.9417 populate_metadata read hostname 'smithi055' 2024-04-02T07:33:52.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26b32f6000 1 --2- 172.21.15.55:0/1396498189 >> [v2:172.21.15.106:6834/775582321,v1:172.21.15.106:6837/775582321] conn(0x55faa1c14b70 0x55faa1c14f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26b32f6000 4 client.9417 mds_command: new command op to 9156 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-02T07:33:52.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26b32f6000 1 -- 172.21.15.55:0/1396498189 --> [v2:172.21.15.106:6834/775582321,v1:172.21.15.106:6837/775582321] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55faa1a91a20 con 0x55faa1c14b70 2024-04-02T07:33:52.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26ad400640 1 --2- 172.21.15.55:0/1396498189 >> [v2:172.21.15.106:6834/775582321,v1:172.21.15.106:6837/775582321] conn(0x55faa1c14b70 0x55faa1c14f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f268ea00640 10 client.9417 ms_handle_connect on v2:172.21.15.106:6834/775582321 2024-04-02T07:33:52.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.107+0000 7f26ad400640 1 --2- 172.21.15.55:0/1396498189 >> [v2:172.21.15.106:6834/775582321,v1:172.21.15.106:6837/775582321] conn(0x55faa1c14b70 0x55faa1c14f50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=254c508d55481950 server_cookie=25dd7bef4871ca39 in_seq=0 out_seq=0 2024-04-02T07:33:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f268ea00640 1 -- 172.21.15.55:0/1396498189 <== mds.0 v2:172.21.15.106:6834/775582321 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55faa1a91a20 con 0x55faa1c14b70 2024-04-02T07:33:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f268ea00640 10 client.9417 handle_command_reply: tid=0 2024-04-02T07:33:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26b32f6000 1 client.9417 shutdown 2024-04-02T07:33:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26b32f6000 1 -- 172.21.15.55:0/1396498189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5e390 msgr2=0x55faa1c14630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26b32f6000 1 --2- 172.21.15.55:0/1396498189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5e390 0x55faa1c14630 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f26a000c090 tx=0x7f26a001b0a0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26b32f6000 1 -- 172.21.15.55:0/1396498189 shutdown_connections 2024-04-02T07:33:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26b32f6000 1 --2- 172.21.15.55:0/1396498189 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55faa1c5e390 0x55faa1c14630 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26b32f6000 1 --2- 172.21.15.55:0/1396498189 >> [v2:172.21.15.106:6834/775582321,v1:172.21.15.106:6837/775582321] conn(0x55faa1c14b70 0x55faa1c14f50 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26b32f6000 1 --2- 172.21.15.55:0/1396498189 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55faa1c5da70 0x55faa1c140f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26b32f6000 1 --2- 172.21.15.55:0/1396498189 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55faa1c11a00 0x55faa1ca4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f268ea00640 0 client.9417 ms_handle_reset on v2:172.21.15.106:6834/775582321 2024-04-02T07:33:52.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26b32f6000 1 -- 172.21.15.55:0/1396498189 >> 172.21.15.55:0/1396498189 conn(0x55faa1a12160 msgr2=0x55faa1c3fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:52.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26b32f6000 1 -- 172.21.15.55:0/1396498189 shutdown_connections 2024-04-02T07:33:52.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26b32f6000 1 -- 172.21.15.55:0/1396498189 wait complete. 2024-04-02T07:33:52.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26b32f6000 20 client.9417 trim_cache size 0 max 16384 2024-04-02T07:33:52.123 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:33:52.123 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "", 2024-04-02T07:33:52.124 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0 2024-04-02T07:33:52.124 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:33:52.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26afe00640 1 -- 172.21.15.55:0/3009631625 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f26880666c0 msgr2=0x7f2688068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:52.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26afe00640 1 --2- 172.21.15.55:0/3009631625 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f26880666c0 0x7f2688068b80 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f269c007fd0 tx=0x7f269c009040 comp rx=0 tx=0).stop 2024-04-02T07:33:52.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26afe00640 1 -- 172.21.15.55:0/3009631625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26a80b3dc0 msgr2=0x7f26a814c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:52.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26afe00640 1 --2- 172.21.15.55:0/3009631625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26a80b3dc0 0x7f26a814c970 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f269400c730 tx=0x7f269400cbf0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26afe00640 1 -- 172.21.15.55:0/3009631625 shutdown_connections 2024-04-02T07:33:52.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26afe00640 1 --2- 172.21.15.55:0/3009631625 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f26a80b41a0 0x7f26a81521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26afe00640 1 --2- 172.21.15.55:0/3009631625 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26a80b3dc0 0x7f26a814c970 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26afe00640 1 --2- 172.21.15.55:0/3009631625 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f26880666c0 0x7f2688068b80 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26afe00640 1 --2- 172.21.15.55:0/3009631625 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f26a80ade90 0x7f26a81389f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26afe00640 1 -- 172.21.15.55:0/3009631625 >> 172.21.15.55:0/3009631625 conn(0x7f26a806a390 msgr2=0x7f26a8151090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:52.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26afe00640 1 -- 172.21.15.55:0/3009631625 shutdown_connections 2024-04-02T07:33:52.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.119+0000 7f26afe00640 1 -- 172.21.15.55:0/3009631625 wait complete. 2024-04-02T07:33:52.139 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-02T07:33:52.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.283+0000 7f14c2c00640 1 Processor -- start 2024-04-02T07:33:52.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.283+0000 7f14c2c00640 1 -- start start 2024-04-02T07:33:52.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.283+0000 7f14c2c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc15ca70 0x7f14bc0b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.283+0000 7f14c2c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f14bc06b700 0x7f14bc098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.283+0000 7f14c2c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14bc0993b0 con 0x7f14bc098a10 2024-04-02T07:33:52.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.283+0000 7f14c2c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14bc15ce50 con 0x7f14bc06b700 2024-04-02T07:33:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.283+0000 7f14c2c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0cef60 con 0x7f14bc15ca70 2024-04-02T07:33:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.283+0000 7f14c0c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f14bc06b700 0x7f14bc098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.283+0000 7f14bbe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc15ca70 0x7f14bc0b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.283+0000 7f14c0c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f14bc06b700 0x7f14bc098e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:38236/0 (socket says 172.21.15.55:38236) 2024-04-02T07:33:52.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.283+0000 7f14c0c00640 1 -- 172.21.15.55:0/2204476991 learned_addr learned my addr 172.21.15.55:0/2204476991 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:52.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.283+0000 7f14bbe00640 1 -- 172.21.15.55:0/2204476991 >> v2:172.21.15.106:3300/0 conn(0x7f14bc06b700 msgr2=0x7f14bc098e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:52.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.283+0000 7f14bbe00640 1 --2- 172.21.15.55:0/2204476991 >> v2:172.21.15.106:3300/0 conn(0x7f14bc06b700 0x7f14bc098e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.283+0000 7f14bbe00640 1 -- 172.21.15.55:0/2204476991 >> v1:172.21.15.106:6789/0 conn(0x7f14bc098a10 legacy=0x7f14bc06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:52.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.283+0000 7f14bbe00640 1 -- 172.21.15.55:0/2204476991 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc06bd60 con 0x7f14bc15ca70 2024-04-02T07:33:52.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.283+0000 7f14c0c00640 1 --2- 172.21.15.55:0/2204476991 >> v2:172.21.15.106:3300/0 conn(0x7f14bc06b700 0x7f14bc098e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:33:52.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.287+0000 7f14bbe00640 1 --2- 172.21.15.55:0/2204476991 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc15ca70 0x7f14bc0b0040 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0097c0 tx=0x7f14ac01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf17eff59cb96261 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:52.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.287+0000 7f14bb400640 1 -- 172.21.15.55:0/2204476991 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0ad640 con 0x7f14bc15ca70 2024-04-02T07:33:52.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.287+0000 7f14bb400640 1 -- 172.21.15.55:0/2204476991 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14ac0ad7a0 con 0x7f14bc15ca70 2024-04-02T07:33:52.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.287+0000 7f14bb400640 1 -- 172.21.15.55:0/2204476991 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14ac0adb30 con 0x7f14bc15ca70 2024-04-02T07:33:52.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.287+0000 7f14c2c00640 1 -- 172.21.15.55:0/2204476991 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc15ca70 msgr2=0x7f14bc0b0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:52.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.287+0000 7f14c2c00640 1 --2- 172.21.15.55:0/2204476991 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc15ca70 0x7f14bc0b0040 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0097c0 tx=0x7f14ac01c4a0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.287 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.287+0000 7f14c2c00640 1 -- 172.21.15.55:0/2204476991 shutdown_connections 2024-04-02T07:33:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.287+0000 7f14c2c00640 1 --2- 172.21.15.55:0/2204476991 >> v2:172.21.15.106:3300/0 conn(0x7f14bc06b700 0x7f14bc098e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.287+0000 7f14c2c00640 1 --2- 172.21.15.55:0/2204476991 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc15ca70 0x7f14bc0b0040 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.287+0000 7f14c2c00640 1 -- 172.21.15.55:0/2204476991 >> 172.21.15.55:0/2204476991 conn(0x7f14bc0b21d0 msgr2=0x7f14bc0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.287+0000 7f14c2c00640 1 -- 172.21.15.55:0/2204476991 shutdown_connections 2024-04-02T07:33:52.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.287+0000 7f14c2c00640 1 -- 172.21.15.55:0/2204476991 wait complete. 2024-04-02T07:33:52.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14c2c00640 1 Processor -- start 2024-04-02T07:33:52.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14c2c00640 1 -- start start 2024-04-02T07:33:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14c2c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14bc06b700 0x7f14bc15f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14c2c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14bc098a10 0x7f14bc153c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14c2c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc15ca70 0x7f14bc0b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14c2c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0c4210 con 0x7f14bc098a10 2024-04-02T07:33:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14c2c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc0b55b0 con 0x7f14bc06b700 2024-04-02T07:33:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14c2c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14bc15f9f0 con 0x7f14bc15ca70 2024-04-02T07:33:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14b3400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14bc098a10 0x7f14bc153c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14b3400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14bc098a10 0x7f14bc153c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44486/0 (socket says 172.21.15.55:44486) 2024-04-02T07:33:52.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14b3400640 1 -- 172.21.15.55:0/1025676534 learned_addr learned my addr 172.21.15.55:0/1025676534 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14bbe00640 1 --2- 172.21.15.55:0/1025676534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14bc06b700 0x7f14bc15f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14c0c00640 1 --2- 172.21.15.55:0/1025676534 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc15ca70 0x7f14bc0b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14b3400640 1 -- 172.21.15.55:0/1025676534 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc15ca70 msgr2=0x7f14bc0b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14b3400640 1 --2- 172.21.15.55:0/1025676534 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc15ca70 0x7f14bc0b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14b3400640 1 -- 172.21.15.55:0/1025676534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14bc06b700 msgr2=0x7f14bc15f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14b3400640 1 --2- 172.21.15.55:0/1025676534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14bc06b700 0x7f14bc15f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14b3400640 1 -- 172.21.15.55:0/1025676534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b40094d0 con 0x7f14bc098a10 2024-04-02T07:33:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14b3400640 1 --2- 172.21.15.55:0/1025676534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14bc098a10 0x7f14bc153c10 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f14a400c7f0 tx=0x7f14a400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14b8c00640 1 -- 172.21.15.55:0/1025676534 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4003b80 con 0x7f14bc098a10 2024-04-02T07:33:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14b8c00640 1 -- 172.21.15.55:0/1025676534 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a4003ce0 con 0x7f14bc098a10 2024-04-02T07:33:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14c2c00640 1 -- 172.21.15.55:0/1025676534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ac009420 con 0x7f14bc098a10 2024-04-02T07:33:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14b8c00640 1 -- 172.21.15.55:0/1025676534 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a400aa90 con 0x7f14bc098a10 2024-04-02T07:33:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.291+0000 7f14c2c00640 1 -- 172.21.15.55:0/1025676534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14bc0c4460 con 0x7f14bc098a10 2024-04-02T07:33:52.293 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.295+0000 7f14c2c00640 1 -- 172.21.15.55:0/1025676534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14bc066c90 con 0x7f14bc098a10 2024-04-02T07:33:52.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.295+0000 7f14b8c00640 1 -- 172.21.15.55:0/1025676534 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f14a400abf0 con 0x7f14bc098a10 2024-04-02T07:33:52.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.295+0000 7f14b8c00640 1 --2- 172.21.15.55:0/1025676534 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1498066690 0x7f1498068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:52.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.295+0000 7f14b8c00640 1 -- 172.21.15.55:0/1025676534 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14a4083f40 con 0x7f14bc098a10 2024-04-02T07:33:52.294 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.295+0000 7f14bbe00640 1 --2- 172.21.15.55:0/1025676534 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1498066690 0x7f1498068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:52.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.295+0000 7f14bbe00640 1 --2- 172.21.15.55:0/1025676534 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1498066690 0x7f1498068b50 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0af000 tx=0x7f14ac0a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:52.298 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.299+0000 7f14b8c00640 1 -- 172.21.15.55:0/1025676534 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f14a4051350 con 0x7f14bc098a10 2024-04-02T07:33:52.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.495+0000 7f14c2c00640 1 -- 172.21.15.55:0/1025676534 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f14bc160050 con 0x7f14bc098a10 2024-04-02T07:33:52.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.495+0000 7f14b8c00640 1 -- 172.21.15.55:0/1025676534 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v96) v1 ==== 53+0+73 (secure 0 0 0) 0x7f14a4054970 con 0x7f14bc098a10 2024-04-02T07:33:52.494 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-02T07:33:52.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.495+0000 7f14c2c00640 1 -- 172.21.15.55:0/1025676534 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1498066690 msgr2=0x7f1498068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:52.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.495+0000 7f14c2c00640 1 --2- 172.21.15.55:0/1025676534 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1498066690 0x7f1498068b50 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f14ac0af000 tx=0x7f14ac0a7070 comp rx=0 tx=0).stop 2024-04-02T07:33:52.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.495+0000 7f14c2c00640 1 -- 172.21.15.55:0/1025676534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14bc098a10 msgr2=0x7f14bc153c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:52.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.495+0000 7f14c2c00640 1 --2- 172.21.15.55:0/1025676534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14bc098a10 0x7f14bc153c10 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f14a400c7f0 tx=0x7f14a400ccb0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.495+0000 7f14c2c00640 1 -- 172.21.15.55:0/1025676534 shutdown_connections 2024-04-02T07:33:52.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.495+0000 7f14c2c00640 1 --2- 172.21.15.55:0/1025676534 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f14bc15ca70 0x7f14bc0b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.495+0000 7f14c2c00640 1 --2- 172.21.15.55:0/1025676534 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f14bc098a10 0x7f14bc153c10 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.495+0000 7f14c2c00640 1 --2- 172.21.15.55:0/1025676534 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1498066690 0x7f1498068b50 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.495+0000 7f14c2c00640 1 --2- 172.21.15.55:0/1025676534 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f14bc06b700 0x7f14bc15f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:52.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.495+0000 7f14c2c00640 1 -- 172.21.15.55:0/1025676534 >> 172.21.15.55:0/1025676534 conn(0x7f14bc0b21d0 msgr2=0x7f14bc0af280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:52.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.495+0000 7f14c2c00640 1 -- 172.21.15.55:0/1025676534 shutdown_connections 2024-04-02T07:33:52.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:52.495+0000 7f14c2c00640 1 -- 172.21.15.55:0/1025676534 wait complete. 2024-04-02T07:33:52.515 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-02T07:33:52.515 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-02T07:33:52.515 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-02T07:33:52.515 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-02T07:33:52.515 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-02T07:33:52.515 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-02T07:33:52.515 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-02T07:33:52.515 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-02T07:33:52.515 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:33:52.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:52.516 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-02T07:33:52.525 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:33:52.525 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:33:52.525 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:33:52.526 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:33:52.526 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-02T07:33:52.526 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:33:52.526 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:33:52.526 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:33:52.526 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-02T07:33:52.526 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:33:52.526 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:33:52.526 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-02T07:33:52.526 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-02T07:33:52.526 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:33:52.526 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-02T07:33:52.526 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-02T07:33:52.530 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41762sec preferred_lft 41762sec 2024-04-02T07:33:52.530 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2024-04-02T07:33:52.530 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:33:52.530 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:33:52.530 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:33:52.531 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-02T07:33:52.531 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-02T07:33:52.531 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:81:5a:89:17 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:33:52.531 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-02T07:33:52.531 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:33:52.531 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:33:52.531 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-02T07:33:52.531 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-02T07:33:52.531 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:33:52.531 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-02T07:33:52.531 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:33:52.531 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:33:52.532 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-02T07:33:52.532 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-02T07:33:52.532 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:33:52.532 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:33:52.532 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-02T07:33:52.532 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-02T07:33:52.532 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:33:52.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:52.532 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-02T07:33:52.586 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:33:52.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:52.588 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-02T07:33:52.642 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-02T07:33:52.642 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-02T07:33:52.642 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-02T07:33:52.642 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-02T07:33:52.642 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-02T07:33:52.642 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-02T07:33:52.643 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:52.643 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:33:52.643 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:33:52.643 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-02T07:33:52.643 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-02T07:33:52.643 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-02T07:33:52.643 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:33:52.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:52.733 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-02T07:33:52.742 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-02T07:33:52.743 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-02T07:33:52.743 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:33:52.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:52.743 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-02T07:33:52.807 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-02T07:33:52.807 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:33:52.807 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-02T07:33:52.856 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:33:52.856 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:33:52.856 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:33:52.907 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:33:52.972 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:33:52.972 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:33:53.037 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:33:53.039 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:33:53.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:53.039 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:33:53.091 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-02T07:33:53.092 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-02T07:33:53.142 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:33:53.163 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:33:53.163 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:33:53.226 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:33:53.228 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:33:53.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:53.229 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:33:53.233 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:2024-04-02T07:33:53.235+0000 7f0155f13580 -1 init, newargv = 0x55c8df1d1da0 newargc=15 2024-04-02T07:33:53.233 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[52634]: starting ceph client 2024-04-02T07:33:53.240 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[52634]: starting fuse 2024-04-02T07:33:53.242 INFO:teuthology.orchestra.run.smithi055.stdout:43 2024-04-02T07:33:53.242 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-02T07:33:53.242 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:33:53.243 DEBUG:teuthology.orchestra.run.smithi055:> import glob 2024-04-02T07:33:53.243 DEBUG:teuthology.orchestra.run.smithi055:> import re 2024-04-02T07:33:53.243 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:33:53.243 DEBUG:teuthology.orchestra.run.smithi055:> import subprocess 2024-04-02T07:33:53.243 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:33:53.243 DEBUG:teuthology.orchestra.run.smithi055:> def _find_admin_socket(client_name): 2024-04-02T07:33:53.243 DEBUG:teuthology.orchestra.run.smithi055:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-02T07:33:53.243 DEBUG:teuthology.orchestra.run.smithi055:> files = glob.glob(asok_path) 2024-04-02T07:33:53.243 DEBUG:teuthology.orchestra.run.smithi055:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-02T07:33:53.243 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:33:53.243 DEBUG:teuthology.orchestra.run.smithi055:> # Given a non-glob path, it better be there 2024-04-02T07:33:53.243 DEBUG:teuthology.orchestra.run.smithi055:> if "*" not in asok_path: 2024-04-02T07:33:53.243 DEBUG:teuthology.orchestra.run.smithi055:> assert(len(files) == 1) 2024-04-02T07:33:53.243 DEBUG:teuthology.orchestra.run.smithi055:> return files[0] 2024-04-02T07:33:53.243 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:33:53.244 DEBUG:teuthology.orchestra.run.smithi055:> for f in files: 2024-04-02T07:33:53.244 DEBUG:teuthology.orchestra.run.smithi055:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-02T07:33:53.244 DEBUG:teuthology.orchestra.run.smithi055:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-02T07:33:53.244 DEBUG:teuthology.orchestra.run.smithi055:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-02T07:33:53.244 DEBUG:teuthology.orchestra.run.smithi055:> contents = proc_f.read() 2024-04-02T07:33:53.244 DEBUG:teuthology.orchestra.run.smithi055:> if mountpoint in contents: 2024-04-02T07:33:53.244 DEBUG:teuthology.orchestra.run.smithi055:> return f 2024-04-02T07:33:53.244 DEBUG:teuthology.orchestra.run.smithi055:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-02T07:33:53.244 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:33:53.244 DEBUG:teuthology.orchestra.run.smithi055:> print(_find_admin_socket("client.0")) 2024-04-02T07:33:53.244 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:33:53.368 INFO:teuthology.orchestra.run.smithi055.stdout:/var/run/ceph/ceph-client.0.52634.asok 2024-04-02T07:33:53.553 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.52634.asok 2024-04-02T07:33:53.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:53.553 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.52634.asok status 2024-04-02T07:33:53.732 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:33:53.732 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": { 2024-04-02T07:33:53.732 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_sha1": "d0e392d9aee635f2b65768c460c7a151ead7a5e2", 2024-04-02T07:33:53.732 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)", 2024-04-02T07:33:53.732 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "0", 2024-04-02T07:33:53.732 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2024-04-02T07:33:53.732 INFO:teuthology.orchestra.run.smithi055.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-02T07:33:53.732 INFO:teuthology.orchestra.run.smithi055.stdout: "pid": "52634", 2024-04-02T07:33:53.732 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2024-04-02T07:33:53.732 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:53.732 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_count": 0, 2024-04-02T07:33:53.732 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_pinned_count": 0, 2024-04-02T07:33:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 9429, 2024-04-02T07:33:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": { 2024-04-02T07:33:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2024-04-02T07:33:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2024-04-02T07:33:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 9429 2024-04-02T07:33:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:33:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:33:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:33:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 976928832 2024-04-02T07:33:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:33:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:33:53.733 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:33:53.734 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:33:53.734 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 976928832 2024-04-02T07:33:53.734 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:33:53.734 INFO:teuthology.orchestra.run.smithi055.stdout: "inst_str": "client.9429 192.168.0.1:0/976928832", 2024-04-02T07:33:53.734 INFO:teuthology.orchestra.run.smithi055.stdout: "addr_str": "192.168.0.1:0/976928832", 2024-04-02T07:33:53.734 INFO:teuthology.orchestra.run.smithi055.stdout: "inode_count": 1, 2024-04-02T07:33:53.734 INFO:teuthology.orchestra.run.smithi055.stdout: "mds_epoch": 96, 2024-04-02T07:33:53.734 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch": 116, 2024-04-02T07:33:53.734 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch_barrier": 0, 2024-04-02T07:33:53.734 INFO:teuthology.orchestra.run.smithi055.stdout: "blocklisted": false, 2024-04-02T07:33:53.734 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs" 2024-04-02T07:33:53.734 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:33:53.747 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:53.747 DEBUG:teuthology.orchestra.run.smithi055:> stat --file-system '--printf=%T 2024-04-02T07:33:53.747 DEBUG:teuthology.orchestra.run.smithi055:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-02T07:33:53.757 INFO:teuthology.orchestra.run.smithi055.stdout:fuseblk 2024-04-02T07:33:53.757 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-02T07:33:53.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:53.757 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:33:53.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:53.819 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir parent/unflushed) 2024-04-02T07:33:53.875 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:53.875 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=./parent/unflushed/jfile bs=1M count=8) 2024-04-02T07:33:53.992 INFO:teuthology.orchestra.run.smithi055.stderr:8+0 records in 2024-04-02T07:33:53.992 INFO:teuthology.orchestra.run.smithi055.stderr:8+0 records out 2024-04-02T07:33:53.992 INFO:teuthology.orchestra.run.smithi055.stderr:8388608 bytes (8.4 MB, 8.0 MiB) copied, 0.0658128 s, 127 MB/s 2024-04-02T07:33:53.993 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:33:53.993 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:33:53.993 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:33:53.993 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:33:53.993 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-02T07:33:53.994 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:33:54.064 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627779 2024-04-02T07:33:54.253 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:33:54.253 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:33:54.253 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:33:54.253 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:33:54.253 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-02T07:33:54.253 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:33:54.360 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627780 2024-04-02T07:33:54.549 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:33:54.549 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:33:54.605 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:33:54.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.791+0000 7f9334800640 1 Processor -- start 2024-04-02T07:33:54.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.791+0000 7f9334800640 1 -- start start 2024-04-02T07:33:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.791+0000 7f9334800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f932c099120 0x7f932c0b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.791+0000 7f9334800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f932c06aff0 0x7f932c06b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.791+0000 7f9334800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f932c15ce50 con 0x7f932c15ca70 2024-04-02T07:33:54.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.791+0000 7f9334800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f932c0cef60 con 0x7f932c099120 2024-04-02T07:33:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.791+0000 7f9334800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932c06bd60 con 0x7f932c06aff0 2024-04-02T07:33:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.791+0000 7f9331400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f932c099120 0x7f932c0b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.791+0000 7f9331400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f932c099120 0x7f932c0b0040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44490/0 (socket says 172.21.15.55:44490) 2024-04-02T07:33:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.791+0000 7f9331400640 1 -- 172.21.15.55:0/563122302 learned_addr learned my addr 172.21.15.55:0/563122302 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.791+0000 7f9332800640 1 --2- 172.21.15.55:0/563122302 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f932c06aff0 0x7f932c06b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.791+0000 7f9331400640 1 -- 172.21.15.55:0/563122302 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f932c06aff0 msgr2=0x7f932c06b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.791+0000 7f9331400640 1 --2- 172.21.15.55:0/563122302 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f932c06aff0 0x7f932c06b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.791+0000 7f9331400640 1 -- 172.21.15.55:0/563122302 >> v1:172.21.15.106:6789/0 conn(0x7f932c15ca70 legacy=0x7f932c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:54.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.791+0000 7f9331400640 1 -- 172.21.15.55:0/563122302 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f932c06c040 con 0x7f932c099120 2024-04-02T07:33:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.795+0000 7f9331400640 1 --2- 172.21.15.55:0/563122302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f932c099120 0x7f932c0b0040 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f931c009870 tx=0x7f931c01c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5655c507589f29d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.795+0000 7f9330a00640 1 -- 172.21.15.55:0/563122302 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c0a9610 con 0x7f932c099120 2024-04-02T07:33:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.795+0000 7f9330a00640 1 -- 172.21.15.55:0/563122302 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f931c0a9770 con 0x7f932c099120 2024-04-02T07:33:54.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.795+0000 7f9330a00640 1 -- 172.21.15.55:0/563122302 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f931c0a9b00 con 0x7f932c099120 2024-04-02T07:33:54.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.795+0000 7f9334800640 1 -- 172.21.15.55:0/563122302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f932c099120 msgr2=0x7f932c0b0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:54.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.795+0000 7f9334800640 1 --2- 172.21.15.55:0/563122302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f932c099120 0x7f932c0b0040 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f931c009870 tx=0x7f931c01c530 comp rx=0 tx=0).stop 2024-04-02T07:33:54.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.795+0000 7f9334800640 1 -- 172.21.15.55:0/563122302 shutdown_connections 2024-04-02T07:33:54.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.795+0000 7f9334800640 1 --2- 172.21.15.55:0/563122302 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f932c06aff0 0x7f932c06b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:54.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.795+0000 7f9334800640 1 --2- 172.21.15.55:0/563122302 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f932c099120 0x7f932c0b0040 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:54.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.795+0000 7f9334800640 1 -- 172.21.15.55:0/563122302 >> 172.21.15.55:0/563122302 conn(0x7f932c0b21d0 msgr2=0x7f932c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:54.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.795+0000 7f9334800640 1 -- 172.21.15.55:0/563122302 shutdown_connections 2024-04-02T07:33:54.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.795+0000 7f9334800640 1 -- 172.21.15.55:0/563122302 wait complete. 2024-04-02T07:33:54.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9334800640 1 Processor -- start 2024-04-02T07:33:54.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9334800640 1 -- start start 2024-04-02T07:33:54.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9334800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f932c06aff0 0x7f932c0cd720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:54.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9334800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f932c099120 0x7f932c153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:54.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9334800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f932c15ca70 0x7f932c0ae990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:54.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9334800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c159890 con 0x7f932c06aff0 2024-04-02T07:33:54.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9334800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932c159310 con 0x7f932c099120 2024-04-02T07:33:54.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9334800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f932c1595b0 con 0x7f932c15ca70 2024-04-02T07:33:54.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9331e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f932c06aff0 0x7f932c0cd720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:54.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9331e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f932c06aff0 0x7f932c0cd720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44496/0 (socket says 172.21.15.55:44496) 2024-04-02T07:33:54.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9331e00640 1 -- 172.21.15.55:0/2935215263 learned_addr learned my addr 172.21.15.55:0/2935215263 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:54.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9332800640 1 --2- 172.21.15.55:0/2935215263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f932c15ca70 0x7f932c0ae990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:54.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9331400640 1 --2- 172.21.15.55:0/2935215263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f932c099120 0x7f932c153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:54.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9331e00640 1 -- 172.21.15.55:0/2935215263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f932c15ca70 msgr2=0x7f932c0ae990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:54.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9331e00640 1 --2- 172.21.15.55:0/2935215263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f932c15ca70 0x7f932c0ae990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:54.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9331e00640 1 -- 172.21.15.55:0/2935215263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f932c099120 msgr2=0x7f932c153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:54.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9331e00640 1 --2- 172.21.15.55:0/2935215263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f932c099120 0x7f932c153ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:54.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9331e00640 1 -- 172.21.15.55:0/2935215263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f931c0094d0 con 0x7f932c06aff0 2024-04-02T07:33:54.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9331e00640 1 --2- 172.21.15.55:0/2935215263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f932c06aff0 0x7f932c0cd720 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f932000c3c0 tx=0x7f932000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:54.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9326000640 1 -- 172.21.15.55:0/2935215263 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93200052d0 con 0x7f932c06aff0 2024-04-02T07:33:54.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9326000640 1 -- 172.21.15.55:0/2935215263 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9320005430 con 0x7f932c06aff0 2024-04-02T07:33:54.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9334800640 1 -- 172.21.15.55:0/2935215263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f932c0b4450 con 0x7f932c06aff0 2024-04-02T07:33:54.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9326000640 1 -- 172.21.15.55:0/2935215263 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9320003840 con 0x7f932c06aff0 2024-04-02T07:33:54.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9334800640 1 -- 172.21.15.55:0/2935215263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f932c154920 con 0x7f932c06aff0 2024-04-02T07:33:54.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.799+0000 7f9334800640 1 -- 172.21.15.55:0/2935215263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932c0b4690 con 0x7f932c06aff0 2024-04-02T07:33:54.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.803+0000 7f9326000640 1 -- 172.21.15.55:0/2935215263 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f93200039a0 con 0x7f932c06aff0 2024-04-02T07:33:54.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.803+0000 7f9326000640 1 --2- 172.21.15.55:0/2935215263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9310066690 0x7f9310068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:54.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.803+0000 7f9326000640 1 -- 172.21.15.55:0/2935215263 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9320083630 con 0x7f932c06aff0 2024-04-02T07:33:54.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.803+0000 7f9331400640 1 --2- 172.21.15.55:0/2935215263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9310066690 0x7f9310068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:54.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.803+0000 7f9331400640 1 --2- 172.21.15.55:0/2935215263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9310066690 0x7f9310068b50 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f931c0ae000 tx=0x7f931c0b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:54.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.807+0000 7f9326000640 1 -- 172.21.15.55:0/2935215263 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f932c0b4690 con 0x7f932c06aff0 2024-04-02T07:33:54.967 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.967+0000 7f9334800640 1 -- 172.21.15.55:0/2935215263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f932c066c90 con 0x7f932c06aff0 2024-04-02T07:33:54.968 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.967+0000 7f9326000640 1 -- 172.21.15.55:0/2935215263 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+16059 (secure 0 0 0) 0x7f9320050a40 con 0x7f932c06aff0 2024-04-02T07:33:54.968 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:54.968 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":116,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:33:28.848519+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:33:26.384276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-02T07:33:26.835969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:33:54.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.971+0000 7f9334800640 1 -- 172.21.15.55:0/2935215263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9310066690 msgr2=0x7f9310068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:54.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.971+0000 7f9334800640 1 --2- 172.21.15.55:0/2935215263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9310066690 0x7f9310068b50 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f931c0ae000 tx=0x7f931c0b3040 comp rx=0 tx=0).stop 2024-04-02T07:33:54.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.971+0000 7f9334800640 1 -- 172.21.15.55:0/2935215263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f932c06aff0 msgr2=0x7f932c0cd720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:54.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.971+0000 7f9334800640 1 --2- 172.21.15.55:0/2935215263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f932c06aff0 0x7f932c0cd720 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f932000c3c0 tx=0x7f932000c880 comp rx=0 tx=0).stop 2024-04-02T07:33:54.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.971+0000 7f9334800640 1 -- 172.21.15.55:0/2935215263 shutdown_connections 2024-04-02T07:33:54.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.971+0000 7f9334800640 1 --2- 172.21.15.55:0/2935215263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f932c15ca70 0x7f932c0ae990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:54.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.971+0000 7f9334800640 1 --2- 172.21.15.55:0/2935215263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9310066690 0x7f9310068b50 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:54.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.971+0000 7f9334800640 1 --2- 172.21.15.55:0/2935215263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f932c099120 0x7f932c153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:54.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.971+0000 7f9334800640 1 --2- 172.21.15.55:0/2935215263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f932c06aff0 0x7f932c0cd720 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:54.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.971+0000 7f9334800640 1 -- 172.21.15.55:0/2935215263 >> 172.21.15.55:0/2935215263 conn(0x7f932c0b21d0 msgr2=0x7f932c0b0040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:54.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.971+0000 7f9334800640 1 -- 172.21.15.55:0/2935215263 shutdown_connections 2024-04-02T07:33:54.971 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:54.971+0000 7f9334800640 1 -- 172.21.15.55:0/2935215263 wait complete. 2024-04-02T07:33:54.989 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:33:26.384276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:33:26.835969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:33:54.990 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:33:55.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5033e00640 1 Processor -- start 2024-04-02T07:33:55.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5033e00640 1 -- start start 2024-04-02T07:33:55.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5033e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f50340c2a80 0x7f50340b0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:55.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5033e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5034069d90 con 0x7f50340b07d0 2024-04-02T07:33:55.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5033e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50340cb1a0 con 0x7f503415b180 2024-04-02T07:33:55.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5033e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50340b0c80 con 0x7f50340c2a80 2024-04-02T07:33:55.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5033400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f50340b07d0 0x7f50340cb630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41158/0 (socket says 172.21.15.55:41158) 2024-04-02T07:33:55.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5033400640 1 -- 172.21.15.55:0/3548149702 learned_addr learned my addr 172.21.15.55:0/3548149702 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:55.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f502be00640 1 --2- 172.21.15.55:0/3548149702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f50340c2a80 0x7f50340b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:55.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032000640 1 -- 172.21.15.55:0/3548149702 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067596441 0 0) 0x7f5034069d90 con 0x7f50340b07d0 2024-04-02T07:33:55.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032000640 1 -- 172.21.15.55:0/3548149702 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5018003530 con 0x7f50340b07d0 2024-04-02T07:33:55.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032000640 1 -- 172.21.15.55:0/3548149702 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1901478258 0 0) 0x7f5018003530 con 0x7f50340b07d0 2024-04-02T07:33:55.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032000640 1 -- 172.21.15.55:0/3548149702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f50340c2a80 msgr2=0x7f50340b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:55.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032000640 1 --2- 172.21.15.55:0/3548149702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f50340c2a80 0x7f50340b0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032000640 1 -- 172.21.15.55:0/3548149702 >> v1:172.21.15.106:6789/0 conn(0x7f503415b180 legacy=0x7f503415b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:55.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032000640 1 -- 172.21.15.55:0/3548149702 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5034069fe0 con 0x7f50340b07d0 2024-04-02T07:33:55.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032000640 1 -- 172.21.15.55:0/3548149702 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f502c001a00 con 0x7f50340b07d0 2024-04-02T07:33:55.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032000640 1 -- 172.21.15.55:0/3548149702 >> v1:172.21.15.55:6789/0 conn(0x7f50340b07d0 legacy=0x7f50340cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:55.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032000640 1 --2- 172.21.15.55:0/3548149702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50180039b0 0x7f5018003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:55.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032000640 1 --2- 172.21.15.55:0/3548149702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50180047d0 0x7f5018004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:55.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032000640 1 --2- 172.21.15.55:0/3548149702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f50340c2a80 0x7f5018005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:55.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032000640 1 -- 172.21.15.55:0/3548149702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340b0c80 con 0x7f50180039b0 2024-04-02T07:33:55.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032000640 1 -- 172.21.15.55:0/3548149702 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f501800baa0 con 0x7f50180047d0 2024-04-02T07:33:55.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032000640 1 -- 172.21.15.55:0/3548149702 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f501800bc60 con 0x7f50340c2a80 2024-04-02T07:33:55.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032a00640 1 --2- 172.21.15.55:0/3548149702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50180039b0 0x7f5018003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:55.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f502be00640 1 --2- 172.21.15.55:0/3548149702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50180047d0 0x7f5018004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:55.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5033400640 1 --2- 172.21.15.55:0/3548149702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f50340c2a80 0x7f5018005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:55.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032a00640 1 -- 172.21.15.55:0/3548149702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f50340c2a80 msgr2=0x7f5018005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:55.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032a00640 1 --2- 172.21.15.55:0/3548149702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f50340c2a80 0x7f5018005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032a00640 1 -- 172.21.15.55:0/3548149702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50180047d0 msgr2=0x7f5018004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:55.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032a00640 1 --2- 172.21.15.55:0/3548149702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50180047d0 0x7f5018004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f5032a00640 1 -- 172.21.15.55:0/3548149702 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5018003530 con 0x7f50180039b0 2024-04-02T07:33:55.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.135+0000 7f502be00640 1 --2- 172.21.15.55:0/3548149702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50180047d0 0x7f5018004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.139+0000 7f5032a00640 1 --2- 172.21.15.55:0/3548149702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50180039b0 0x7f5018003dd0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f5024001750 tx=0x7f502401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d808e1df004770 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.139+0000 7f5032000640 1 -- 172.21.15.55:0/3548149702 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50240052d0 con 0x7f50180039b0 2024-04-02T07:33:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.139+0000 7f5032000640 1 -- 172.21.15.55:0/3548149702 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50240a7050 con 0x7f50180039b0 2024-04-02T07:33:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.139+0000 7f5032000640 1 -- 172.21.15.55:0/3548149702 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5024003600 con 0x7f50180039b0 2024-04-02T07:33:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.139+0000 7f5033e00640 1 -- 172.21.15.55:0/3548149702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50180039b0 msgr2=0x7f5018003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.139+0000 7f5033e00640 1 --2- 172.21.15.55:0/3548149702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50180039b0 0x7f5018003dd0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7f5024001750 tx=0x7f502401c3c0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.139+0000 7f5033400640 1 -- 172.21.15.55:0/3548149702 reap_dead start 2024-04-02T07:33:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.139+0000 7f5033e00640 1 -- 172.21.15.55:0/3548149702 shutdown_connections 2024-04-02T07:33:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.139+0000 7f5033e00640 1 -- 172.21.15.55:0/3548149702 >> 172.21.15.55:0/3548149702 conn(0x7f50340b0eb0 msgr2=0x7f50340b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.139+0000 7f5033e00640 1 -- 172.21.15.55:0/3548149702 shutdown_connections 2024-04-02T07:33:55.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.139+0000 7f5033e00640 1 -- 172.21.15.55:0/3548149702 wait complete. 2024-04-02T07:33:55.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5033e00640 1 Processor -- start 2024-04-02T07:33:55.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5033e00640 1 -- start start 2024-04-02T07:33:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5033e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50180039b0 0x7f5034150750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5033e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50340c39d0 0x7f50340c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5033e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f50340c3e50 0x7f50340c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5033e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50340c89a0 con 0x7f50180039b0 2024-04-02T07:33:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5033e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f503415bbc0 con 0x7f50340c39d0 2024-04-02T07:33:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5033e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50340c8c40 con 0x7f50340c3e50 2024-04-02T07:33:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5032a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50180039b0 0x7f5034150750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:55.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5032a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50180039b0 0x7f5034150750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44514/0 (socket says 172.21.15.55:44514) 2024-04-02T07:33:55.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5032a00640 1 -- 172.21.15.55:0/3717462892 learned_addr learned my addr 172.21.15.55:0/3717462892 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:55.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f502be00640 1 --2- 172.21.15.55:0/3717462892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50340c39d0 0x7f50340c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:55.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5033400640 1 --2- 172.21.15.55:0/3717462892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f50340c3e50 0x7f50340c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5032a00640 1 -- 172.21.15.55:0/3717462892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f50340c3e50 msgr2=0x7f50340c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5032a00640 1 --2- 172.21.15.55:0/3717462892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f50340c3e50 0x7f50340c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5032a00640 1 -- 172.21.15.55:0/3717462892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50340c39d0 msgr2=0x7f50340c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5032a00640 1 --2- 172.21.15.55:0/3717462892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50340c39d0 0x7f50340c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5032a00640 1 -- 172.21.15.55:0/3717462892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50340c8f20 con 0x7f50180039b0 2024-04-02T07:33:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5033400640 1 --2- 172.21.15.55:0/3717462892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f50340c3e50 0x7f50340c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:55.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5032a00640 1 --2- 172.21.15.55:0/3717462892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50180039b0 0x7f5034150750 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f5024005040 tx=0x7f5018005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:55.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f502b400640 1 -- 172.21.15.55:0/3717462892 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50240038c0 con 0x7f50180039b0 2024-04-02T07:33:55.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f502b400640 1 -- 172.21.15.55:0/3717462892 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5024003a20 con 0x7f50180039b0 2024-04-02T07:33:55.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f502b400640 1 -- 172.21.15.55:0/3717462892 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5024003d90 con 0x7f50180039b0 2024-04-02T07:33:55.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5033e00640 1 -- 172.21.15.55:0/3717462892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f503415be60 con 0x7f50180039b0 2024-04-02T07:33:55.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.143+0000 7f5033e00640 1 -- 172.21.15.55:0/3717462892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5034150c90 con 0x7f50180039b0 2024-04-02T07:33:55.145 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.147+0000 7f5033e00640 1 -- 172.21.15.55:0/3717462892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5034073fa0 con 0x7f50180039b0 2024-04-02T07:33:55.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.147+0000 7f502b400640 1 -- 172.21.15.55:0/3717462892 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f50240b7470 con 0x7f50180039b0 2024-04-02T07:33:55.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.147+0000 7f502b400640 1 --2- 172.21.15.55:0/3717462892 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5010066690 0x7f5010068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:55.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.147+0000 7f502b400640 1 -- 172.21.15.55:0/3717462892 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f502411e850 con 0x7f50180039b0 2024-04-02T07:33:55.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.147+0000 7f502be00640 1 --2- 172.21.15.55:0/3717462892 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5010066690 0x7f5010068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:55.146 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.147+0000 7f502be00640 1 --2- 172.21.15.55:0/3717462892 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5010066690 0x7f5010068b50 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f50340c3960 tx=0x7f501c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:55.149 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.151+0000 7f502b400640 1 -- 172.21.15.55:0/3717462892 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f50240ebba0 con 0x7f50180039b0 2024-04-02T07:33:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.315+0000 7f5033e00640 1 -- 172.21.15.55:0/3717462892 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f50340b52e0 con 0x7f50180039b0 2024-04-02T07:33:55.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.315+0000 7f502b400640 1 -- 172.21.15.55:0/3717462892 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7f50240bb0a0 con 0x7f50180039b0 2024-04-02T07:33:55.314 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:33:55.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.315+0000 7f5033e00640 1 -- 172.21.15.55:0/3717462892 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5010066690 msgr2=0x7f5010068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:55.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.315+0000 7f5033e00640 1 --2- 172.21.15.55:0/3717462892 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5010066690 0x7f5010068b50 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f50340c3960 tx=0x7f501c008040 comp rx=0 tx=0).stop 2024-04-02T07:33:55.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.315+0000 7f5033e00640 1 -- 172.21.15.55:0/3717462892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50180039b0 msgr2=0x7f5034150750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:55.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.315+0000 7f5033e00640 1 --2- 172.21.15.55:0/3717462892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50180039b0 0x7f5034150750 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7f5024005040 tx=0x7f5018005800 comp rx=0 tx=0).stop 2024-04-02T07:33:55.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.315+0000 7f5033e00640 1 -- 172.21.15.55:0/3717462892 shutdown_connections 2024-04-02T07:33:55.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.315+0000 7f5033e00640 1 --2- 172.21.15.55:0/3717462892 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f50340c3e50 0x7f50340c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.315+0000 7f5033e00640 1 --2- 172.21.15.55:0/3717462892 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5010066690 0x7f5010068b50 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.315+0000 7f5033e00640 1 --2- 172.21.15.55:0/3717462892 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f50340c39d0 0x7f50340c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.315+0000 7f5033e00640 1 --2- 172.21.15.55:0/3717462892 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f50180039b0 0x7f5034150750 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.315+0000 7f5033e00640 1 -- 172.21.15.55:0/3717462892 >> 172.21.15.55:0/3717462892 conn(0x7f50340b0eb0 msgr2=0x7f50340ce690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:55.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.315+0000 7f5033e00640 1 -- 172.21.15.55:0/3717462892 shutdown_connections 2024-04-02T07:33:55.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.315+0000 7f5033e00640 1 -- 172.21.15.55:0/3717462892 wait complete. 2024-04-02T07:33:55.334 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:33:55.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.479+0000 7ff38e000640 1 Processor -- start 2024-04-02T07:33:55.477 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.479+0000 7ff38e000640 1 -- start start 2024-04-02T07:33:55.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.479+0000 7ff38e000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff388098a10 0x7ff388098e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:55.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.479+0000 7ff38e000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff38806b920 0x7ff38806bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:55.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.479+0000 7ff38e000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff38815ce40 con 0x7ff38815ca60 2024-04-02T07:33:55.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.479+0000 7ff38e000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff388099390 con 0x7ff38806b920 2024-04-02T07:33:55.478 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.479+0000 7ff38e000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3880ceeb0 con 0x7ff388098a10 2024-04-02T07:33:55.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.479+0000 7ff37ea00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff388098a10 0x7ff388098e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:55.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.479+0000 7ff387e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff38806b920 0x7ff38806bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:55.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.479+0000 7ff387e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff38806b920 0x7ff38806bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:38282/0 (socket says 172.21.15.55:38282) 2024-04-02T07:33:55.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.479+0000 7ff387e00640 1 -- 172.21.15.55:0/1047266864 learned_addr learned my addr 172.21.15.55:0/1047266864 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:55.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.479+0000 7ff387400640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff38815ca60 0x7ff3880cfc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:54184/0 (socket says 172.21.15.55:54184) 2024-04-02T07:33:55.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.479+0000 7ff386a00640 1 -- 172.21.15.55:0/1047266864 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 715980891 0 0) 0x7ff38815ce40 con 0x7ff38815ca60 2024-04-02T07:33:55.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.479+0000 7ff386a00640 1 -- 172.21.15.55:0/1047266864 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff36c003530 con 0x7ff38815ca60 2024-04-02T07:33:55.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.479+0000 7ff387e00640 1 -- 172.21.15.55:0/1047266864 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff388098a10 msgr2=0x7ff388098e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:55.479 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.479+0000 7ff387e00640 1 --2- 172.21.15.55:0/1047266864 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff388098a10 0x7ff388098e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.479+0000 7ff387e00640 1 -- 172.21.15.55:0/1047266864 >> v1:172.21.15.106:6789/0 conn(0x7ff38815ca60 legacy=0x7ff3880cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:55.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.479+0000 7ff387e00640 1 -- 172.21.15.55:0/1047266864 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3880cf190 con 0x7ff38806b920 2024-04-02T07:33:55.480 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.479+0000 7ff37ea00640 1 --2- 172.21.15.55:0/1047266864 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff388098a10 0x7ff388098e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:33:55.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.483+0000 7ff387e00640 1 --2- 172.21.15.55:0/1047266864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff38806b920 0x7ff38806bd50 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff380009e50 tx=0x7ff38001c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=10df82f0c09d7fa0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:55.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.483+0000 7ff386a00640 1 -- 172.21.15.55:0/1047266864 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3800a5830 con 0x7ff38806b920 2024-04-02T07:33:55.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.483+0000 7ff386a00640 1 -- 172.21.15.55:0/1047266864 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3800a5990 con 0x7ff38806b920 2024-04-02T07:33:55.482 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.483+0000 7ff386a00640 1 -- 172.21.15.55:0/1047266864 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3800a5d20 con 0x7ff38806b920 2024-04-02T07:33:55.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.483+0000 7ff38e000640 1 -- 172.21.15.55:0/1047266864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff38806b920 msgr2=0x7ff38806bd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:55.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.483+0000 7ff38e000640 1 --2- 172.21.15.55:0/1047266864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff38806b920 0x7ff38806bd50 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7ff380009e50 tx=0x7ff38001c970 comp rx=0 tx=0).stop 2024-04-02T07:33:55.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.483+0000 7ff38e000640 1 -- 172.21.15.55:0/1047266864 shutdown_connections 2024-04-02T07:33:55.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.483+0000 7ff38e000640 1 --2- 172.21.15.55:0/1047266864 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff38806b920 0x7ff38806bd50 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.483+0000 7ff38e000640 1 --2- 172.21.15.55:0/1047266864 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff388098a10 0x7ff388098e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.483+0000 7ff38e000640 1 -- 172.21.15.55:0/1047266864 >> 172.21.15.55:0/1047266864 conn(0x7ff3880b2150 msgr2=0x7ff3880b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:55.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.483+0000 7ff38e000640 1 -- 172.21.15.55:0/1047266864 shutdown_connections 2024-04-02T07:33:55.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.483+0000 7ff38e000640 1 -- 172.21.15.55:0/1047266864 wait complete. 2024-04-02T07:33:55.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff38e000640 1 Processor -- start 2024-04-02T07:33:55.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff38e000640 1 -- start start 2024-04-02T07:33:55.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff38e000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff38806b920 0x7ff3881f8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:55.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff38e000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff388098a10 0x7ff3880b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:55.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff38e000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff38815ca60 0x7ff3880b3280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:55.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff38e000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3880b4910 con 0x7ff38806b920 2024-04-02T07:33:55.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff38e000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3880b3d00 con 0x7ff388098a10 2024-04-02T07:33:55.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff38e000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3880b3fe0 con 0x7ff38815ca60 2024-04-02T07:33:55.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff387400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff38806b920 0x7ff3881f8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:55.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff387400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff38806b920 0x7ff3881f8ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44526/0 (socket says 172.21.15.55:44526) 2024-04-02T07:33:55.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff387400640 1 -- 172.21.15.55:0/3619994719 learned_addr learned my addr 172.21.15.55:0/3619994719 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:55.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff37ea00640 1 --2- 172.21.15.55:0/3619994719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff388098a10 0x7ff3880b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:55.486 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff387e00640 1 --2- 172.21.15.55:0/3619994719 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff38815ca60 0x7ff3880b3280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:55.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff387400640 1 -- 172.21.15.55:0/3619994719 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff38815ca60 msgr2=0x7ff3880b3280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:55.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff387400640 1 --2- 172.21.15.55:0/3619994719 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff38815ca60 0x7ff3880b3280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff387400640 1 -- 172.21.15.55:0/3619994719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff388098a10 msgr2=0x7ff3880b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:55.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff387400640 1 --2- 172.21.15.55:0/3619994719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff388098a10 0x7ff3880b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff387400640 1 -- 172.21.15.55:0/3619994719 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff370009420 con 0x7ff38806b920 2024-04-02T07:33:55.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff387400640 1 --2- 172.21.15.55:0/3619994719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff38806b920 0x7ff3881f8ed0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7ff37800c420 tx=0x7ff37800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:55.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff37fe00640 1 -- 172.21.15.55:0/3619994719 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3780074e0 con 0x7ff38806b920 2024-04-02T07:33:55.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff37fe00640 1 -- 172.21.15.55:0/3619994719 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff378007660 con 0x7ff38806b920 2024-04-02T07:33:55.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff37fe00640 1 -- 172.21.15.55:0/3619994719 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378004a30 con 0x7ff38806b920 2024-04-02T07:33:55.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff38e000640 1 -- 172.21.15.55:0/3619994719 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff380009b30 con 0x7ff38806b920 2024-04-02T07:33:55.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.487+0000 7ff38e000640 1 -- 172.21.15.55:0/3619994719 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3880b45a0 con 0x7ff38806b920 2024-04-02T07:33:55.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.491+0000 7ff38e000640 1 -- 172.21.15.55:0/3619994719 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff388066c90 con 0x7ff38806b920 2024-04-02T07:33:55.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.491+0000 7ff37fe00640 1 -- 172.21.15.55:0/3619994719 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff378004b90 con 0x7ff38806b920 2024-04-02T07:33:55.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.491+0000 7ff37fe00640 1 --2- 172.21.15.55:0/3619994719 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff3640666c0 0x7ff364068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:55.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.491+0000 7ff37fe00640 1 -- 172.21.15.55:0/3619994719 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff378083b20 con 0x7ff38806b920 2024-04-02T07:33:55.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.491+0000 7ff37ea00640 1 --2- 172.21.15.55:0/3619994719 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff3640666c0 0x7ff364068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:55.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.491+0000 7ff37ea00640 1 --2- 172.21.15.55:0/3619994719 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff3640666c0 0x7ff364068b80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff38806a380 tx=0x7ff370009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:55.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.495+0000 7ff37fe00640 1 -- 172.21.15.55:0/3619994719 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff378050ea0 con 0x7ff38806b920 2024-04-02T07:33:55.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.655+0000 7ff38e000640 1 -- 172.21.15.55:0/3619994719 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff3880b2ff0 con 0x7ff38806b920 2024-04-02T07:33:55.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.655+0000 7ff37fe00640 1 -- 172.21.15.55:0/3619994719 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff3780544c0 con 0x7ff38806b920 2024-04-02T07:33:55.655 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:33:55.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.659+0000 7ff38e000640 1 -- 172.21.15.55:0/3619994719 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff3640666c0 msgr2=0x7ff364068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:55.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.659+0000 7ff38e000640 1 --2- 172.21.15.55:0/3619994719 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff3640666c0 0x7ff364068b80 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff38806a380 tx=0x7ff370009190 comp rx=0 tx=0).stop 2024-04-02T07:33:55.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.659+0000 7ff38e000640 1 -- 172.21.15.55:0/3619994719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff38806b920 msgr2=0x7ff3881f8ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:55.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.659+0000 7ff38e000640 1 --2- 172.21.15.55:0/3619994719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff38806b920 0x7ff3881f8ed0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7ff37800c420 tx=0x7ff37800c8e0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.659+0000 7ff38e000640 1 -- 172.21.15.55:0/3619994719 shutdown_connections 2024-04-02T07:33:55.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.659+0000 7ff38e000640 1 --2- 172.21.15.55:0/3619994719 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff38815ca60 0x7ff3880b3280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.659+0000 7ff38e000640 1 --2- 172.21.15.55:0/3619994719 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff3640666c0 0x7ff364068b80 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.659+0000 7ff38e000640 1 --2- 172.21.15.55:0/3619994719 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff388098a10 0x7ff3880b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.659+0000 7ff38e000640 1 --2- 172.21.15.55:0/3619994719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff38806b920 0x7ff3881f8ed0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.659+0000 7ff38e000640 1 -- 172.21.15.55:0/3619994719 >> 172.21.15.55:0/3619994719 conn(0x7ff3880b2150 msgr2=0x7ff3880ad300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:55.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.659+0000 7ff38e000640 1 -- 172.21.15.55:0/3619994719 shutdown_connections 2024-04-02T07:33:55.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.659+0000 7ff38e000640 1 -- 172.21.15.55:0/3619994719 wait complete. 2024-04-02T07:33:55.676 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:33:55.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.819+0000 7f419ca00640 1 Processor -- start 2024-04-02T07:33:55.818 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.819+0000 7f419ca00640 1 -- start start 2024-04-02T07:33:55.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.819+0000 7f419ca00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f419813c800 0x7f41980b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:55.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.819+0000 7f419ca00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41980b2040 0x7f4198159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:55.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.819+0000 7f419ca00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419813fcf0 con 0x7f41980b3fe0 2024-04-02T07:33:55.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.819+0000 7f419ca00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41980b25f0 con 0x7f419813c800 2024-04-02T07:33:55.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.819+0000 7f419ca00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419813ef30 con 0x7f41980b2040 2024-04-02T07:33:55.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.823+0000 7f4195e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f419813c800 0x7f41980b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:55.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.823+0000 7f4195e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f419813c800 0x7f41980b3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44164/0 (socket says 172.21.15.55:44164) 2024-04-02T07:33:55.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.823+0000 7f4195e00640 1 -- 172.21.15.55:0/4129534013 learned_addr learned my addr 172.21.15.55:0/4129534013 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:55.820 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.823+0000 7f4196800640 1 --2- 172.21.15.55:0/4129534013 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41980b2040 0x7f4198159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:55.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.823+0000 7f4195e00640 1 -- 172.21.15.55:0/4129534013 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41980b2040 msgr2=0x7f4198159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:55.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.823+0000 7f4195e00640 1 --2- 172.21.15.55:0/4129534013 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41980b2040 0x7f4198159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.823+0000 7f4195e00640 1 -- 172.21.15.55:0/4129534013 >> v1:172.21.15.106:6789/0 conn(0x7f41980b3fe0 legacy=0x7f41980b1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:55.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.823+0000 7f4195e00640 1 -- 172.21.15.55:0/4129534013 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419813f210 con 0x7f419813c800 2024-04-02T07:33:55.821 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.823+0000 7f4195400640 1 -- 172.21.15.55:0/4129534013 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3347380996 0 0) 0x7f419813fcf0 con 0x7f41980b3fe0 2024-04-02T07:33:55.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.823+0000 7f4195e00640 1 --2- 172.21.15.55:0/4129534013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f419813c800 0x7f41980b3aa0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f418800d150 tx=0x7f418801ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dcd4424e7356463 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:55.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.823+0000 7f4195400640 1 -- 172.21.15.55:0/4129534013 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41880a7cd0 con 0x7f419813c800 2024-04-02T07:33:55.823 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.823+0000 7f4195400640 1 -- 172.21.15.55:0/4129534013 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41880a7e30 con 0x7f419813c800 2024-04-02T07:33:55.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.823+0000 7f4195400640 1 -- 172.21.15.55:0/4129534013 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418800b2f0 con 0x7f419813c800 2024-04-02T07:33:55.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f419ca00640 1 -- 172.21.15.55:0/4129534013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f419813c800 msgr2=0x7f41980b3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:55.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f419ca00640 1 --2- 172.21.15.55:0/4129534013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f419813c800 0x7f41980b3aa0 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f418800d150 tx=0x7f418801ec00 comp rx=0 tx=0).stop 2024-04-02T07:33:55.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f419ca00640 1 -- 172.21.15.55:0/4129534013 shutdown_connections 2024-04-02T07:33:55.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f419ca00640 1 --2- 172.21.15.55:0/4129534013 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41980b2040 0x7f4198159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f419ca00640 1 --2- 172.21.15.55:0/4129534013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f419813c800 0x7f41980b3aa0 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f419ca00640 1 -- 172.21.15.55:0/4129534013 >> 172.21.15.55:0/4129534013 conn(0x7f419806a390 msgr2=0x7f41980b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:55.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f419ca00640 1 -- 172.21.15.55:0/4129534013 shutdown_connections 2024-04-02T07:33:55.825 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f419ca00640 1 -- 172.21.15.55:0/4129534013 wait complete. 2024-04-02T07:33:55.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f419ca00640 1 Processor -- start 2024-04-02T07:33:55.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f419ca00640 1 -- start start 2024-04-02T07:33:55.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f419ca00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41980b2040 0x7f419806e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:55.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f419ca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41980b3fe0 0x7f41980abfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:55.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f419ca00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f419813c800 0x7f419815afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:55.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f419ca00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419813e850 con 0x7f41980b3fe0 2024-04-02T07:33:55.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f419ca00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4198154150 con 0x7f41980b2040 2024-04-02T07:33:55.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f419ca00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419813dbd0 con 0x7f419813c800 2024-04-02T07:33:55.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f418d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41980b3fe0 0x7f41980abfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:55.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f418d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41980b3fe0 0x7f41980abfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44174/0 (socket says 172.21.15.55:44174) 2024-04-02T07:33:55.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f418d400640 1 -- 172.21.15.55:0/4073782685 learned_addr learned my addr 172.21.15.55:0/4073782685 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:55.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f4195e00640 1 --2- 172.21.15.55:0/4073782685 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41980b2040 0x7f419806e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:55.828 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f4196800640 1 --2- 172.21.15.55:0/4073782685 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f419813c800 0x7f419815afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:55.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f418d400640 1 -- 172.21.15.55:0/4073782685 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f419813c800 msgr2=0x7f419815afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:55.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f418d400640 1 --2- 172.21.15.55:0/4073782685 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f419813c800 0x7f419815afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f418d400640 1 -- 172.21.15.55:0/4073782685 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41980b2040 msgr2=0x7f419806e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:55.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f418d400640 1 --2- 172.21.15.55:0/4073782685 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41980b2040 0x7f419806e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:55.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.827+0000 7f418d400640 1 -- 172.21.15.55:0/4073782685 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418800bd40 con 0x7f41980b3fe0 2024-04-02T07:33:55.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.831+0000 7f418d400640 1 --2- 172.21.15.55:0/4073782685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41980b3fe0 0x7f41980abfd0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f418000c4d0 tx=0x7f418000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:55.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.831+0000 7f418ea00640 1 -- 172.21.15.55:0/4073782685 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4180005480 con 0x7f41980b3fe0 2024-04-02T07:33:55.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.831+0000 7f418ea00640 1 -- 172.21.15.55:0/4073782685 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4180003600 con 0x7f41980b3fe0 2024-04-02T07:33:55.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.831+0000 7f418ea00640 1 -- 172.21.15.55:0/4073782685 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41800039b0 con 0x7f41980b3fe0 2024-04-02T07:33:55.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.831+0000 7f419ca00640 1 -- 172.21.15.55:0/4073782685 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419813deb0 con 0x7f41980b3fe0 2024-04-02T07:33:55.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.831+0000 7f419ca00640 1 -- 172.21.15.55:0/4073782685 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419813e470 con 0x7f41980b3fe0 2024-04-02T07:33:55.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.831+0000 7f419ca00640 1 -- 172.21.15.55:0/4073782685 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4198073530 con 0x7f41980b3fe0 2024-04-02T07:33:55.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.831+0000 7f418ea00640 1 -- 172.21.15.55:0/4073782685 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f4180003b10 con 0x7f41980b3fe0 2024-04-02T07:33:55.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.831+0000 7f418ea00640 1 --2- 172.21.15.55:0/4073782685 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41740666c0 0x7f4174068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:55.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.831+0000 7f418ea00640 1 -- 172.21.15.55:0/4073782685 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4180083620 con 0x7f41980b3fe0 2024-04-02T07:33:55.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.835+0000 7f4195e00640 1 --2- 172.21.15.55:0/4073782685 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41740666c0 0x7f4174068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:55.832 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.835+0000 7f4195e00640 1 --2- 172.21.15.55:0/4073782685 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41740666c0 0x7f4174068b80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f41880b0000 tx=0x7f41880a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:55.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.835+0000 7f418ea00640 1 -- 172.21.15.55:0/4073782685 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f4180050b70 con 0x7f41980b3fe0 2024-04-02T07:33:55.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.995+0000 7f419ca00640 1 -- 172.21.15.55:0/4073782685 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4198066c90 con 0x7f41980b3fe0 2024-04-02T07:33:55.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.995+0000 7f418ea00640 1 -- 172.21.15.55:0/4073782685 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7f41800170a0 con 0x7f41980b3fe0 2024-04-02T07:33:55.995 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:33:56.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.999+0000 7f419ca00640 1 -- 172.21.15.55:0/4073782685 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41740666c0 msgr2=0x7f4174068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:56.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.999+0000 7f419ca00640 1 --2- 172.21.15.55:0/4073782685 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41740666c0 0x7f4174068b80 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f41880b0000 tx=0x7f41880a9070 comp rx=0 tx=0).stop 2024-04-02T07:33:56.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.999+0000 7f419ca00640 1 -- 172.21.15.55:0/4073782685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41980b3fe0 msgr2=0x7f41980abfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:56.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.999+0000 7f419ca00640 1 --2- 172.21.15.55:0/4073782685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41980b3fe0 0x7f41980abfd0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7f418000c4d0 tx=0x7f418000c990 comp rx=0 tx=0).stop 2024-04-02T07:33:56.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.999+0000 7f419ca00640 1 -- 172.21.15.55:0/4073782685 shutdown_connections 2024-04-02T07:33:56.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.999+0000 7f419ca00640 1 --2- 172.21.15.55:0/4073782685 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f419813c800 0x7f419815afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.999+0000 7f419ca00640 1 --2- 172.21.15.55:0/4073782685 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41980b3fe0 0x7f41980abfd0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.999+0000 7f419ca00640 1 --2- 172.21.15.55:0/4073782685 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f41740666c0 0x7f4174068b80 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.999+0000 7f419ca00640 1 --2- 172.21.15.55:0/4073782685 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41980b2040 0x7f419806e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.999+0000 7f419ca00640 1 -- 172.21.15.55:0/4073782685 >> 172.21.15.55:0/4073782685 conn(0x7f419806a390 msgr2=0x7f4198164c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:56.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.999+0000 7f419ca00640 1 -- 172.21.15.55:0/4073782685 shutdown_connections 2024-04-02T07:33:56.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:55.999+0000 7f419ca00640 1 -- 172.21.15.55:0/4073782685 wait complete. 2024-04-02T07:33:56.016 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:33:56.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.159+0000 7f47e4000640 1 Processor -- start 2024-04-02T07:33:56.157 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.159+0000 7f47e4000640 1 -- start start 2024-04-02T07:33:56.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.159+0000 7f47e4000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f47dc06d1c0 0x7f47dc0b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:56.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.159+0000 7f47e4000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f47dc0b38f0 0x7f47dc0c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:56.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.159+0000 7f47e4000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47dc0b1d60 con 0x7f47dc1599c0 2024-04-02T07:33:56.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.159+0000 7f47e4000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47dc06cda0 con 0x7f47dc06d1c0 2024-04-02T07:33:56.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.159+0000 7f47e4000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47dc06c400 con 0x7f47dc0b38f0 2024-04-02T07:33:56.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.159+0000 7f47e1600640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f47dc1599c0 0x7f47dc0b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54166/0 (socket says 172.21.15.55:54166) 2024-04-02T07:33:56.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.159+0000 7f47e1600640 1 -- 172.21.15.55:0/3462901420 learned_addr learned my addr 172.21.15.55:0/3462901420 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:56.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.159+0000 7f47e0c00640 1 --2- 172.21.15.55:0/3462901420 >> v2:172.21.15.55:3300/0 conn(0x7f47dc06d1c0 0x7f47dc0b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:56.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.159+0000 7f47e2000640 1 --2- 172.21.15.55:0/3462901420 >> v2:172.21.15.106:3300/0 conn(0x7f47dc0b38f0 0x7f47dc0c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:56.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.159+0000 7f47dbe00640 1 -- 172.21.15.55:0/3462901420 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3923463673 0 0) 0x7f47dc0b1d60 con 0x7f47dc1599c0 2024-04-02T07:33:56.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.159+0000 7f47dbe00640 1 -- 172.21.15.55:0/3462901420 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47c4003530 con 0x7f47dc1599c0 2024-04-02T07:33:56.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.159+0000 7f47e0c00640 1 -- 172.21.15.55:0/3462901420 >> v2:172.21.15.106:3300/0 conn(0x7f47dc0b38f0 msgr2=0x7f47dc0c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:56.159 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.159+0000 7f47e0c00640 1 --2- 172.21.15.55:0/3462901420 >> v2:172.21.15.106:3300/0 conn(0x7f47dc0b38f0 0x7f47dc0c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.159+0000 7f47e0c00640 1 -- 172.21.15.55:0/3462901420 >> v1:172.21.15.55:6789/0 conn(0x7f47dc1599c0 legacy=0x7f47dc0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:56.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.159+0000 7f47e0c00640 1 -- 172.21.15.55:0/3462901420 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc06c6e0 con 0x7f47dc06d1c0 2024-04-02T07:33:56.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.163+0000 7f47e0c00640 1 --2- 172.21.15.55:0/3462901420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47dc06d1c0 0x7f47dc0b1780 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0c8840 tx=0x7f47c801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=699f9aa8b448a2cb server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:56.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.163+0000 7f47dbe00640 1 -- 172.21.15.55:0/3462901420 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c80ab600 con 0x7f47dc06d1c0 2024-04-02T07:33:56.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.163+0000 7f47dbe00640 1 -- 172.21.15.55:0/3462901420 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c80a7050 con 0x7f47dc06d1c0 2024-04-02T07:33:56.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.163+0000 7f47dbe00640 1 -- 172.21.15.55:0/3462901420 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c80ab980 con 0x7f47dc06d1c0 2024-04-02T07:33:56.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.163+0000 7f47e4000640 1 -- 172.21.15.55:0/3462901420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47dc06d1c0 msgr2=0x7f47dc0b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:56.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.163+0000 7f47e4000640 1 --2- 172.21.15.55:0/3462901420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47dc06d1c0 0x7f47dc0b1780 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0c8840 tx=0x7f47c801c480 comp rx=0 tx=0).stop 2024-04-02T07:33:56.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.163+0000 7f47e4000640 1 -- 172.21.15.55:0/3462901420 shutdown_connections 2024-04-02T07:33:56.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.163+0000 7f47e4000640 1 --2- 172.21.15.55:0/3462901420 >> v2:172.21.15.106:3300/0 conn(0x7f47dc0b38f0 0x7f47dc0c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.163+0000 7f47e4000640 1 --2- 172.21.15.55:0/3462901420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47dc06d1c0 0x7f47dc0b1780 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.163+0000 7f47e4000640 1 -- 172.21.15.55:0/3462901420 >> 172.21.15.55:0/3462901420 conn(0x7f47dc069d90 msgr2=0x7f47dc06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:56.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.163+0000 7f47e4000640 1 -- 172.21.15.55:0/3462901420 shutdown_connections 2024-04-02T07:33:56.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.163+0000 7f47e4000640 1 -- 172.21.15.55:0/3462901420 wait complete. 2024-04-02T07:33:56.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e4000640 1 Processor -- start 2024-04-02T07:33:56.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e4000640 1 -- start start 2024-04-02T07:33:56.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e4000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47dc06d1c0 0x7f47dc14f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:56.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e4000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47dc0b38f0 0x7f47dc13fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:56.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e4000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47dc1599c0 0x7f47dc14cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:56.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e4000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc15a0f0 con 0x7f47dc06d1c0 2024-04-02T07:33:56.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e4000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc15a3d0 con 0x7f47dc0b38f0 2024-04-02T07:33:56.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e4000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc15a6b0 con 0x7f47dc1599c0 2024-04-02T07:33:56.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e1600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47dc06d1c0 0x7f47dc14f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:56.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e1600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47dc06d1c0 0x7f47dc14f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44204/0 (socket says 172.21.15.55:44204) 2024-04-02T07:33:56.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e1600640 1 -- 172.21.15.55:0/1835364623 learned_addr learned my addr 172.21.15.55:0/1835364623 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:56.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e0c00640 1 --2- 172.21.15.55:0/1835364623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47dc0b38f0 0x7f47dc13fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:56.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e2000640 1 --2- 172.21.15.55:0/1835364623 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47dc1599c0 0x7f47dc14cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:56.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e1600640 1 -- 172.21.15.55:0/1835364623 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47dc1599c0 msgr2=0x7f47dc14cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:56.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e1600640 1 --2- 172.21.15.55:0/1835364623 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47dc1599c0 0x7f47dc14cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e1600640 1 -- 172.21.15.55:0/1835364623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47dc0b38f0 msgr2=0x7f47dc13fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:56.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e1600640 1 --2- 172.21.15.55:0/1835364623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47dc0b38f0 0x7f47dc13fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e1600640 1 -- 172.21.15.55:0/1835364623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c8009420 con 0x7f47dc06d1c0 2024-04-02T07:33:56.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e1600640 1 --2- 172.21.15.55:0/1835364623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47dc06d1c0 0x7f47dc14f6e0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f47d000c420 tx=0x7f47d000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:56.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47d9600640 1 -- 172.21.15.55:0/1835364623 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d0005cf0 con 0x7f47dc06d1c0 2024-04-02T07:33:56.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47d9600640 1 -- 172.21.15.55:0/1835364623 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d0005e50 con 0x7f47dc06d1c0 2024-04-02T07:33:56.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47d9600640 1 -- 172.21.15.55:0/1835364623 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d00072d0 con 0x7f47dc06d1c0 2024-04-02T07:33:56.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e4000640 1 -- 172.21.15.55:0/1835364623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47dc15a990 con 0x7f47dc06d1c0 2024-04-02T07:33:56.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e4000640 1 -- 172.21.15.55:0/1835364623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47dc14ff30 con 0x7f47dc06d1c0 2024-04-02T07:33:56.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.167+0000 7f47e4000640 1 -- 172.21.15.55:0/1835364623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47dc06e270 con 0x7f47dc06d1c0 2024-04-02T07:33:56.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.171+0000 7f47d9600640 1 -- 172.21.15.55:0/1835364623 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f47d0007430 con 0x7f47dc06d1c0 2024-04-02T07:33:56.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.171+0000 7f47d9600640 1 --2- 172.21.15.55:0/1835364623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f47bc066690 0x7f47bc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:56.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.171+0000 7f47d9600640 1 -- 172.21.15.55:0/1835364623 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f47d0083740 con 0x7f47dc06d1c0 2024-04-02T07:33:56.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.171+0000 7f47e0c00640 1 --2- 172.21.15.55:0/1835364623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f47bc066690 0x7f47bc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:56.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.171+0000 7f47e0c00640 1 --2- 172.21.15.55:0/1835364623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f47bc066690 0x7f47bc068b50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f47c80ad000 tx=0x7f47c8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:56.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.175+0000 7f47d9600640 1 -- 172.21.15.55:0/1835364623 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f47d0050ac0 con 0x7f47dc06d1c0 2024-04-02T07:33:56.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.347+0000 7f47e4000640 1 -- 172.21.15.55:0/1835364623 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f47dc15abd0 con 0x7f47dc06d1c0 2024-04-02T07:33:56.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.347+0000 7f47d9600640 1 -- 172.21.15.55:0/1835364623 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v116) v1 ==== 80+0+0 (secure 0 0 0) 0x7f47dc15abd0 con 0x7f47dc06d1c0 2024-04-02T07:33:56.346 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:33:56.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.347+0000 7f47e4000640 1 -- 172.21.15.55:0/1835364623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f47bc066690 msgr2=0x7f47bc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:56.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.347+0000 7f47e4000640 1 --2- 172.21.15.55:0/1835364623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f47bc066690 0x7f47bc068b50 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f47c80ad000 tx=0x7f47c8008040 comp rx=0 tx=0).stop 2024-04-02T07:33:56.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.351+0000 7f47e4000640 1 -- 172.21.15.55:0/1835364623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47dc06d1c0 msgr2=0x7f47dc14f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:56.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.351+0000 7f47e4000640 1 --2- 172.21.15.55:0/1835364623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47dc06d1c0 0x7f47dc14f6e0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f47d000c420 tx=0x7f47d000c8e0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.351+0000 7f47e4000640 1 -- 172.21.15.55:0/1835364623 shutdown_connections 2024-04-02T07:33:56.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.351+0000 7f47e4000640 1 --2- 172.21.15.55:0/1835364623 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47dc1599c0 0x7f47dc14cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.351+0000 7f47e4000640 1 --2- 172.21.15.55:0/1835364623 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f47bc066690 0x7f47bc068b50 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.351+0000 7f47e4000640 1 --2- 172.21.15.55:0/1835364623 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47dc0b38f0 0x7f47dc13fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.351+0000 7f47e4000640 1 --2- 172.21.15.55:0/1835364623 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47dc06d1c0 0x7f47dc14f6e0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.351+0000 7f47e4000640 1 -- 172.21.15.55:0/1835364623 >> 172.21.15.55:0/1835364623 conn(0x7f47dc069d90 msgr2=0x7f47dc155bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:56.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.351+0000 7f47e4000640 1 -- 172.21.15.55:0/1835364623 shutdown_connections 2024-04-02T07:33:56.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.351+0000 7f47e4000640 1 -- 172.21.15.55:0/1835364623 wait complete. 2024-04-02T07:33:56.367 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:33:56.367 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:33:56.377 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:33:56.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.563+0000 7f956d000640 1 Processor -- start 2024-04-02T07:33:56.563 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.563+0000 7f956d000640 1 -- start start 2024-04-02T07:33:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.567+0000 7f956d000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f95680ce630 0x7f9568065d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.567+0000 7f956d000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9568070a80 0x7f9568070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.567+0000 7f956d000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f956806d5b0 con 0x7f956815cbe0 2024-04-02T07:33:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.567+0000 7f956d000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95680cec10 con 0x7f95680ce630 2024-04-02T07:33:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.567+0000 7f956d000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9568071430 con 0x7f9568070a80 2024-04-02T07:33:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.567+0000 7f955d400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f95680ce630 0x7f9568065d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.567+0000 7f955d400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f95680ce630 0x7f9568065d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44218/0 (socket says 172.21.15.55:44218) 2024-04-02T07:33:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.567+0000 7f955d400640 1 -- 172.21.15.55:0/403015228 learned_addr learned my addr 172.21.15.55:0/403015228 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.567+0000 7f9565e00640 1 --1- 172.21.15.55:0/403015228 >> v1:172.21.15.55:6789/0 conn(0x7f956815cbe0 0x7f95680b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54168/0 (socket says 172.21.15.55:54168) 2024-04-02T07:33:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.567+0000 7f9566800640 1 --2- 172.21.15.55:0/403015228 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9568070a80 0x7f9568070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:56.565 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.567+0000 7f955d400640 1 -- 172.21.15.55:0/403015228 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9568070a80 msgr2=0x7f9568070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:56.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.567+0000 7f955d400640 1 --2- 172.21.15.55:0/403015228 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9568070a80 0x7f9568070ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.567+0000 7f955d400640 1 -- 172.21.15.55:0/403015228 >> v1:172.21.15.55:6789/0 conn(0x7f956815cbe0 legacy=0x7f95680b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:56.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.567+0000 7f955d400640 1 -- 172.21.15.55:0/403015228 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f956806cc80 con 0x7f95680ce630 2024-04-02T07:33:56.566 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.567+0000 7f9565400640 1 -- 172.21.15.55:0/403015228 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372693530 0 0) 0x7f956806d5b0 con 0x7f956815cbe0 2024-04-02T07:33:56.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.567+0000 7f955d400640 1 --2- 172.21.15.55:0/403015228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95680ce630 0x7f9568065d20 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f95500098a0 tx=0x7f955001c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e640f9e7ced0d54 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:56.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f9565400640 1 -- 172.21.15.55:0/403015228 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95500a7070 con 0x7f95680ce630 2024-04-02T07:33:56.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f9565400640 1 -- 172.21.15.55:0/403015228 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95500ab430 con 0x7f95680ce630 2024-04-02T07:33:56.568 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f9565400640 1 -- 172.21.15.55:0/403015228 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95500ab7c0 con 0x7f95680ce630 2024-04-02T07:33:56.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f956d000640 1 -- 172.21.15.55:0/403015228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95680ce630 msgr2=0x7f9568065d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:56.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f956d000640 1 --2- 172.21.15.55:0/403015228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95680ce630 0x7f9568065d20 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f95500098a0 tx=0x7f955001c540 comp rx=0 tx=0).stop 2024-04-02T07:33:56.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f956d000640 1 -- 172.21.15.55:0/403015228 shutdown_connections 2024-04-02T07:33:56.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f956d000640 1 --2- 172.21.15.55:0/403015228 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9568070a80 0x7f9568070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f956d000640 1 --2- 172.21.15.55:0/403015228 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95680ce630 0x7f9568065d20 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f956d000640 1 -- 172.21.15.55:0/403015228 >> 172.21.15.55:0/403015228 conn(0x7f95680ced50 msgr2=0x7f95680cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:56.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f956d000640 1 -- 172.21.15.55:0/403015228 shutdown_connections 2024-04-02T07:33:56.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f956d000640 1 -- 172.21.15.55:0/403015228 wait complete. 2024-04-02T07:33:56.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f956d000640 1 Processor -- start 2024-04-02T07:33:56.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f956d000640 1 -- start start 2024-04-02T07:33:56.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f956d000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9568070a80 0x7f9568156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:56.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f956d000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95680ce630 0x7f95681407e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:56.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f956d000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f956815cbe0 0x7f95681550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:56.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f956d000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95681568e0 con 0x7f95680ce630 2024-04-02T07:33:56.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f956d000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9568157240 con 0x7f956815cbe0 2024-04-02T07:33:56.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f956d000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9568140d20 con 0x7f9568070a80 2024-04-02T07:33:56.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f955d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95680ce630 0x7f95681407e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:56.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f955d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95680ce630 0x7f95681407e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44226/0 (socket says 172.21.15.55:44226) 2024-04-02T07:33:56.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f955d400640 1 -- 172.21.15.55:0/3107064082 learned_addr learned my addr 172.21.15.55:0/3107064082 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:56.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f9565e00640 1 --2- 172.21.15.55:0/3107064082 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9568070a80 0x7f9568156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:56.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.571+0000 7f9566800640 1 --2- 172.21.15.55:0/3107064082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f956815cbe0 0x7f95681550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:56.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.575+0000 7f955d400640 1 -- 172.21.15.55:0/3107064082 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9568070a80 msgr2=0x7f9568156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:56.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.575+0000 7f955d400640 1 --2- 172.21.15.55:0/3107064082 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9568070a80 0x7f9568156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.575+0000 7f955d400640 1 -- 172.21.15.55:0/3107064082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f956815cbe0 msgr2=0x7f95681550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:56.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.575+0000 7f955d400640 1 --2- 172.21.15.55:0/3107064082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f956815cbe0 0x7f95681550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.575+0000 7f955d400640 1 -- 172.21.15.55:0/3107064082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95500094d0 con 0x7f95680ce630 2024-04-02T07:33:56.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.575+0000 7f9566800640 1 --2- 172.21.15.55:0/3107064082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f956815cbe0 0x7f95681550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:56.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.575+0000 7f955d400640 1 --2- 172.21.15.55:0/3107064082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95680ce630 0x7f95681407e0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f955001a170 tx=0x7f95500192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:56.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.575+0000 7f955ea00640 1 -- 172.21.15.55:0/3107064082 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95500b4830 con 0x7f95680ce630 2024-04-02T07:33:56.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.575+0000 7f955ea00640 1 -- 172.21.15.55:0/3107064082 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95500b4990 con 0x7f95680ce630 2024-04-02T07:33:56.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.575+0000 7f955ea00640 1 -- 172.21.15.55:0/3107064082 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95500b4d40 con 0x7f95680ce630 2024-04-02T07:33:56.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.575+0000 7f956d000640 1 -- 172.21.15.55:0/3107064082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956815fe80 con 0x7f95680ce630 2024-04-02T07:33:56.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.575+0000 7f956d000640 1 -- 172.21.15.55:0/3107064082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9568155f40 con 0x7f95680ce630 2024-04-02T07:33:56.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.575+0000 7f956d000640 1 -- 172.21.15.55:0/3107064082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9568156a20 con 0x7f95680ce630 2024-04-02T07:33:56.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.575+0000 7f955ea00640 1 -- 172.21.15.55:0/3107064082 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f95500c0460 con 0x7f95680ce630 2024-04-02T07:33:56.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.575+0000 7f955ea00640 1 --2- 172.21.15.55:0/3107064082 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9544066690 0x7f9544068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:56.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.575+0000 7f955ea00640 1 -- 172.21.15.55:0/3107064082 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f955011e420 con 0x7f95680ce630 2024-04-02T07:33:56.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.579+0000 7f9565e00640 1 --2- 172.21.15.55:0/3107064082 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9544066690 0x7f9544068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:56.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.579+0000 7f9565e00640 1 --2- 172.21.15.55:0/3107064082 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9544066690 0x7f9544068b50 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f9558000f70 tx=0x7f9558007df0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:56.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.579+0000 7f955ea00640 1 -- 172.21.15.55:0/3107064082 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f9568156a20 con 0x7f95680ce630 2024-04-02T07:33:56.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.743+0000 7f956d000640 1 -- 172.21.15.55:0/3107064082 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9568156a20 con 0x7f95680ce630 2024-04-02T07:33:56.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.743+0000 7f955ea00640 1 -- 172.21.15.55:0/3107064082 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) v1 ==== 74+0+16059 (secure 0 0 0) 0x7f9568156a20 con 0x7f95680ce630 2024-04-02T07:33:56.743 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:33:56.743 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":116,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:33:28.848519+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:33:26.384276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-02T07:33:26.835969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:33:56.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.747+0000 7f956d000640 1 -- 172.21.15.55:0/3107064082 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9544066690 msgr2=0x7f9544068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:56.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.747+0000 7f956d000640 1 --2- 172.21.15.55:0/3107064082 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9544066690 0x7f9544068b50 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f9558000f70 tx=0x7f9558007df0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.747+0000 7f956d000640 1 -- 172.21.15.55:0/3107064082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95680ce630 msgr2=0x7f95681407e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:56.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.747+0000 7f956d000640 1 --2- 172.21.15.55:0/3107064082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95680ce630 0x7f95681407e0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f955001a170 tx=0x7f95500192e0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.747+0000 7f956d000640 1 -- 172.21.15.55:0/3107064082 shutdown_connections 2024-04-02T07:33:56.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.747+0000 7f956d000640 1 --2- 172.21.15.55:0/3107064082 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9544066690 0x7f9544068b50 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.747+0000 7f956d000640 1 --2- 172.21.15.55:0/3107064082 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f956815cbe0 0x7f95681550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.747+0000 7f956d000640 1 --2- 172.21.15.55:0/3107064082 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95680ce630 0x7f95681407e0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.747+0000 7f956d000640 1 --2- 172.21.15.55:0/3107064082 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9568070a80 0x7f9568156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.747+0000 7f956d000640 1 -- 172.21.15.55:0/3107064082 >> 172.21.15.55:0/3107064082 conn(0x7f95680ced50 msgr2=0x7f95680afc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:56.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.747+0000 7f956d000640 1 -- 172.21.15.55:0/3107064082 shutdown_connections 2024-04-02T07:33:56.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.747+0000 7f956d000640 1 -- 172.21.15.55:0/3107064082 wait complete. 2024-04-02T07:33:56.764 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:33:26.384276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:33:26.835969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:33:56.764 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:33:56.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.907+0000 7f5d57000640 1 Processor -- start 2024-04-02T07:33:56.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.907+0000 7f5d57000640 1 -- start start 2024-04-02T07:33:56.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d57000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5d5015ca60 0x7f5d500cfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:56.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d57000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d5015ce40 con 0x7f5d50098a10 2024-04-02T07:33:56.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d57000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d500d01b0 con 0x7f5d5006c030 2024-04-02T07:33:56.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d57000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d5006c440 con 0x7f5d5015ca60 2024-04-02T07:33:56.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d47400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5d50098a10 0x7f5d5006b920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54182/0 (socket says 172.21.15.55:54182) 2024-04-02T07:33:56.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d47400640 1 -- 172.21.15.55:0/2777766967 learned_addr learned my addr 172.21.15.55:0/2777766967 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:56.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d4fe00640 1 --2- 172.21.15.55:0/2777766967 >> v2:172.21.15.106:3300/0 conn(0x7f5d5015ca60 0x7f5d500cfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:56.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d4f400640 1 -- 172.21.15.55:0/2777766967 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2051350140 0 0) 0x7f5d5015ce40 con 0x7f5d50098a10 2024-04-02T07:33:56.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d4f400640 1 -- 172.21.15.55:0/2777766967 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d34003530 con 0x7f5d50098a10 2024-04-02T07:33:56.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d4f400640 1 -- 172.21.15.55:0/2777766967 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3931951889 0 0) 0x7f5d34003530 con 0x7f5d50098a10 2024-04-02T07:33:56.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d4f400640 1 -- 172.21.15.55:0/2777766967 >> v2:172.21.15.106:3300/0 conn(0x7f5d5015ca60 msgr2=0x7f5d500cfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:56.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d4f400640 1 --2- 172.21.15.55:0/2777766967 >> v2:172.21.15.106:3300/0 conn(0x7f5d5015ca60 0x7f5d500cfc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d4f400640 1 -- 172.21.15.55:0/2777766967 >> v1:172.21.15.106:6789/0 conn(0x7f5d5006c030 legacy=0x7f5d500cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:56.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d4f400640 1 -- 172.21.15.55:0/2777766967 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d500ceeb0 con 0x7f5d50098a10 2024-04-02T07:33:56.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d4f400640 1 -- 172.21.15.55:0/2777766967 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f5d38001680 con 0x7f5d50098a10 2024-04-02T07:33:56.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d4f400640 1 -- 172.21.15.55:0/2777766967 >> v1:172.21.15.55:6789/0 conn(0x7f5d50098a10 legacy=0x7f5d5006b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:56.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d4f400640 1 --2- 172.21.15.55:0/2777766967 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d34003980 0x7f5d34003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:56.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d4f400640 1 --2- 172.21.15.55:0/2777766967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d34004380 0x7f5d34004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:56.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d4f400640 1 --2- 172.21.15.55:0/2777766967 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d340050f0 0x7f5d3400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:56.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d4f400640 1 -- 172.21.15.55:0/2777766967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5006c440 con 0x7f5d34004380 2024-04-02T07:33:56.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d4f400640 1 -- 172.21.15.55:0/2777766967 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3400c030 con 0x7f5d340050f0 2024-04-02T07:33:56.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d4f400640 1 -- 172.21.15.55:0/2777766967 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3400c1f0 con 0x7f5d34003980 2024-04-02T07:33:56.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d47400640 1 --2- 172.21.15.55:0/2777766967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d34004380 0x7f5d34004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:56.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d4fe00640 1 --2- 172.21.15.55:0/2777766967 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d34003980 0x7f5d34003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:56.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d55000640 1 --2- 172.21.15.55:0/2777766967 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d340050f0 0x7f5d3400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:56.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d47400640 1 -- 172.21.15.55:0/2777766967 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d34003980 msgr2=0x7f5d34003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:56.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d47400640 1 --2- 172.21.15.55:0/2777766967 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d34003980 0x7f5d34003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d47400640 1 -- 172.21.15.55:0/2777766967 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d340050f0 msgr2=0x7f5d3400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:56.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d47400640 1 --2- 172.21.15.55:0/2777766967 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d340050f0 0x7f5d3400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d47400640 1 -- 172.21.15.55:0/2777766967 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d34003530 con 0x7f5d34004380 2024-04-02T07:33:56.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.911+0000 7f5d55000640 1 -- 172.21.15.55:0/2777766967 reap_dead start 2024-04-02T07:33:56.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.915+0000 7f5d47400640 1 --2- 172.21.15.55:0/2777766967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d34004380 0x7f5d34004850 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800c190 tx=0x7f5d3801cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5fef22771d173 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:56.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.915+0000 7f5d4f400640 1 -- 172.21.15.55:0/2777766967 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d38005ae0 con 0x7f5d34004380 2024-04-02T07:33:56.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.915+0000 7f5d4f400640 1 -- 172.21.15.55:0/2777766967 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d38005c60 con 0x7f5d34004380 2024-04-02T07:33:56.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.915+0000 7f5d4f400640 1 -- 172.21.15.55:0/2777766967 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d380a5b20 con 0x7f5d34004380 2024-04-02T07:33:56.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.915+0000 7f5d57000640 1 -- 172.21.15.55:0/2777766967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d34004380 msgr2=0x7f5d34004850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:56.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.915+0000 7f5d57000640 1 --2- 172.21.15.55:0/2777766967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d34004380 0x7f5d34004850 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800c190 tx=0x7f5d3801cbe0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.915+0000 7f5d57000640 1 -- 172.21.15.55:0/2777766967 shutdown_connections 2024-04-02T07:33:56.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.915+0000 7f5d57000640 1 --2- 172.21.15.55:0/2777766967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d34004380 0x7f5d34004850 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.915+0000 7f5d57000640 1 -- 172.21.15.55:0/2777766967 >> 172.21.15.55:0/2777766967 conn(0x7f5d500b2150 msgr2=0x7f5d500b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:56.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.915+0000 7f5d57000640 1 -- 172.21.15.55:0/2777766967 shutdown_connections 2024-04-02T07:33:56.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.915+0000 7f5d57000640 1 -- 172.21.15.55:0/2777766967 wait complete. 2024-04-02T07:33:56.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.915+0000 7f5d57000640 1 Processor -- start 2024-04-02T07:33:56.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.915+0000 7f5d57000640 1 -- start start 2024-04-02T07:33:56.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d57000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d34004380 0x7f5d501455d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:56.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d57000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d5009bf50 0x7f5d5009a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:56.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d57000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d501f5000 0x7f5d501449f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:56.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d57000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d5009c3b0 con 0x7f5d501f5000 2024-04-02T07:33:56.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d57000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d50142960 con 0x7f5d5009bf50 2024-04-02T07:33:56.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d57000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d501434e0 con 0x7f5d34004380 2024-04-02T07:33:56.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d55000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d501f5000 0x7f5d501449f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:56.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d55000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d501f5000 0x7f5d501449f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44230/0 (socket says 172.21.15.55:44230) 2024-04-02T07:33:56.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d55000640 1 -- 172.21.15.55:0/3326716954 learned_addr learned my addr 172.21.15.55:0/3326716954 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:56.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d4fe00640 1 --2- 172.21.15.55:0/3326716954 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d34004380 0x7f5d501455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:56.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d55000640 1 -- 172.21.15.55:0/3326716954 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d34004380 msgr2=0x7f5d501455d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:56.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d47400640 1 --2- 172.21.15.55:0/3326716954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d5009bf50 0x7f5d5009a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:56.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d55000640 1 --2- 172.21.15.55:0/3326716954 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d34004380 0x7f5d501455d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d55000640 1 -- 172.21.15.55:0/3326716954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d5009bf50 msgr2=0x7f5d5009a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:56.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d55000640 1 --2- 172.21.15.55:0/3326716954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d5009bf50 0x7f5d5009a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:56.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d55000640 1 -- 172.21.15.55:0/3326716954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d5009a930 con 0x7f5d501f5000 2024-04-02T07:33:56.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d4fe00640 1 --2- 172.21.15.55:0/3326716954 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d34004380 0x7f5d501455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:56.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d47400640 1 --2- 172.21.15.55:0/3326716954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d5009bf50 0x7f5d5009a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:33:56.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d55000640 1 --2- 172.21.15.55:0/3326716954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d501f5000 0x7f5d501449f0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f5d48007fd0 tx=0x7f5d480118b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:56.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d4cc00640 1 -- 172.21.15.55:0/3326716954 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48006bf0 con 0x7f5d501f5000 2024-04-02T07:33:56.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d4cc00640 1 -- 172.21.15.55:0/3326716954 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d48006d70 con 0x7f5d501f5000 2024-04-02T07:33:56.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d4cc00640 1 -- 172.21.15.55:0/3326716954 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d48007270 con 0x7f5d501f5000 2024-04-02T07:33:56.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d57000640 1 -- 172.21.15.55:0/3326716954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d50142bb0 con 0x7f5d501f5000 2024-04-02T07:33:56.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d57000640 1 -- 172.21.15.55:0/3326716954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d50143170 con 0x7f5d501f5000 2024-04-02T07:33:56.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d57000640 1 -- 172.21.15.55:0/3326716954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d50066c90 con 0x7f5d501f5000 2024-04-02T07:33:56.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.919+0000 7f5d4cc00640 1 -- 172.21.15.55:0/3326716954 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5d480073d0 con 0x7f5d501f5000 2024-04-02T07:33:56.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.923+0000 7f5d4cc00640 1 --2- 172.21.15.55:0/3326716954 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d2c066690 0x7f5d2c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:56.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.923+0000 7f5d4cc00640 1 -- 172.21.15.55:0/3326716954 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5d48085dd0 con 0x7f5d501f5000 2024-04-02T07:33:56.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.923+0000 7f5d4fe00640 1 --2- 172.21.15.55:0/3326716954 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d2c066690 0x7f5d2c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:56.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.923+0000 7f5d4fe00640 1 --2- 172.21.15.55:0/3326716954 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d2c066690 0x7f5d2c068b50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5d5004f980 tx=0x7f5d4000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:56.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:56.927+0000 7f5d4cc00640 1 -- 172.21.15.55:0/3326716954 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5d480530a0 con 0x7f5d501f5000 2024-04-02T07:33:57.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.087+0000 7f5d57000640 1 -- 172.21.15.55:0/3326716954 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5d50143620 con 0x7f5d501f5000 2024-04-02T07:33:57.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.087+0000 7f5d4cc00640 1 -- 172.21.15.55:0/3326716954 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v116) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5d4801b020 con 0x7f5d501f5000 2024-04-02T07:33:57.087 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:33:57.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.091+0000 7f5d57000640 1 -- 172.21.15.55:0/3326716954 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d2c066690 msgr2=0x7f5d2c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:57.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.091+0000 7f5d57000640 1 --2- 172.21.15.55:0/3326716954 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d2c066690 0x7f5d2c068b50 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f5d5004f980 tx=0x7f5d4000b040 comp rx=0 tx=0).stop 2024-04-02T07:33:57.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.091+0000 7f5d57000640 1 -- 172.21.15.55:0/3326716954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d501f5000 msgr2=0x7f5d501449f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:57.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.091+0000 7f5d57000640 1 --2- 172.21.15.55:0/3326716954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d501f5000 0x7f5d501449f0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f5d48007fd0 tx=0x7f5d480118b0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.091+0000 7f5d57000640 1 -- 172.21.15.55:0/3326716954 shutdown_connections 2024-04-02T07:33:57.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.091+0000 7f5d57000640 1 --2- 172.21.15.55:0/3326716954 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d501f5000 0x7f5d501449f0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.091+0000 7f5d57000640 1 --2- 172.21.15.55:0/3326716954 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5d2c066690 0x7f5d2c068b50 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.091+0000 7f5d57000640 1 --2- 172.21.15.55:0/3326716954 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5d5009bf50 0x7f5d5009a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.091+0000 7f5d57000640 1 --2- 172.21.15.55:0/3326716954 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5d34004380 0x7f5d501455d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.091+0000 7f5d57000640 1 -- 172.21.15.55:0/3326716954 >> 172.21.15.55:0/3326716954 conn(0x7f5d500b2150 msgr2=0x7f5d5006c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:57.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.091+0000 7f5d57000640 1 -- 172.21.15.55:0/3326716954 shutdown_connections 2024-04-02T07:33:57.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.091+0000 7f5d57000640 1 -- 172.21.15.55:0/3326716954 wait complete. 2024-04-02T07:33:57.108 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:33:57.250 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.251+0000 7fef3c600640 1 Processor -- start 2024-04-02T07:33:57.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.251+0000 7fef3c600640 1 -- start start 2024-04-02T07:33:57.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.251+0000 7fef3c600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fef34099120 0x7fef341656d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:57.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.251+0000 7fef3c600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef340afbc0 con 0x7fef3415e230 2024-04-02T07:33:57.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.251+0000 7fef3c600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef34099be0 con 0x7fef3415de50 2024-04-02T07:33:57.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.251+0000 7fef3c600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef340cf740 con 0x7fef34099120 2024-04-02T07:33:57.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.251+0000 7fef3a600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fef34099120 0x7fef341656d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:57.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.255+0000 7fef3a600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fef34099120 0x7fef341656d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44232/0 (socket says 172.21.15.55:44232) 2024-04-02T07:33:57.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.255+0000 7fef3a600640 1 -- 172.21.15.55:0/3132707442 learned_addr learned my addr 172.21.15.55:0/3132707442 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:57.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.255+0000 7fef39200640 1 --1- 172.21.15.55:0/3132707442 >> v1:172.21.15.55:6789/0 conn(0x7fef3415e230 0x7fef34098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54190/0 (socket says 172.21.15.55:54190) 2024-04-02T07:33:57.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.255+0000 7fef3a600640 1 -- 172.21.15.55:0/3132707442 >> v1:172.21.15.106:6789/0 conn(0x7fef3415de50 legacy=0x7fef340cebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:57.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.255+0000 7fef3a600640 1 -- 172.21.15.55:0/3132707442 >> v1:172.21.15.55:6789/0 conn(0x7fef3415e230 legacy=0x7fef34098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:57.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.255+0000 7fef3a600640 1 -- 172.21.15.55:0/3132707442 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef340afe10 con 0x7fef34099120 2024-04-02T07:33:57.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.255+0000 7fef33e00640 1 -- 172.21.15.55:0/3132707442 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560353211 0 0) 0x7fef340afbc0 con 0x7fef3415e230 2024-04-02T07:33:57.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.255+0000 7fef3a600640 1 --2- 172.21.15.55:0/3132707442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef34099120 0x7fef341656d0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fef2c009e50 tx=0x7fef2c01c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1f27564022adea0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:57.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.255+0000 7fef33e00640 1 -- 172.21.15.55:0/3132707442 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c0a5640 con 0x7fef34099120 2024-04-02T07:33:57.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.255+0000 7fef33e00640 1 -- 172.21.15.55:0/3132707442 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef2c0a57a0 con 0x7fef34099120 2024-04-02T07:33:57.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.255+0000 7fef33e00640 1 -- 172.21.15.55:0/3132707442 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef2c0a5b30 con 0x7fef34099120 2024-04-02T07:33:57.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef3c600640 1 -- 172.21.15.55:0/3132707442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef34099120 msgr2=0x7fef341656d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:57.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef3c600640 1 --2- 172.21.15.55:0/3132707442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef34099120 0x7fef341656d0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7fef2c009e50 tx=0x7fef2c01c9a0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef3c600640 1 -- 172.21.15.55:0/3132707442 shutdown_connections 2024-04-02T07:33:57.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef3c600640 1 --2- 172.21.15.55:0/3132707442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef34099120 0x7fef341656d0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef3c600640 1 -- 172.21.15.55:0/3132707442 >> 172.21.15.55:0/3132707442 conn(0x7fef340b2150 msgr2=0x7fef340b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:57.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef3c600640 1 -- 172.21.15.55:0/3132707442 shutdown_connections 2024-04-02T07:33:57.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef3c600640 1 -- 172.21.15.55:0/3132707442 wait complete. 2024-04-02T07:33:57.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef3c600640 1 Processor -- start 2024-04-02T07:33:57.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef3c600640 1 -- start start 2024-04-02T07:33:57.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef3c600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef34099120 0x7fef340b4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:57.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef3c600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef3415de50 0x7fef340c4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:57.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef3c600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fef34151c10 0x7fef34150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:57.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef3c600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef341519a0 con 0x7fef3415de50 2024-04-02T07:33:57.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef3c600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef341516c0 con 0x7fef34099120 2024-04-02T07:33:57.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef3c600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef340c8a80 con 0x7fef34151c10 2024-04-02T07:33:57.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef39200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef3415de50 0x7fef340c4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:57.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef39200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef3415de50 0x7fef340c4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44238/0 (socket says 172.21.15.55:44238) 2024-04-02T07:33:57.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef39200640 1 -- 172.21.15.55:0/4231847482 learned_addr learned my addr 172.21.15.55:0/4231847482 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:57.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef39c00640 1 --2- 172.21.15.55:0/4231847482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef34099120 0x7fef340b4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:57.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef3a600640 1 --2- 172.21.15.55:0/4231847482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fef34151c10 0x7fef34150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:57.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef39200640 1 -- 172.21.15.55:0/4231847482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fef34151c10 msgr2=0x7fef34150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:57.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef39200640 1 --2- 172.21.15.55:0/4231847482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fef34151c10 0x7fef34150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef39200640 1 -- 172.21.15.55:0/4231847482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef34099120 msgr2=0x7fef340b4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:57.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef39200640 1 --2- 172.21.15.55:0/4231847482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef34099120 0x7fef340b4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef39200640 1 -- 172.21.15.55:0/4231847482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef2c009b30 con 0x7fef3415de50 2024-04-02T07:33:57.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef3a600640 1 --2- 172.21.15.55:0/4231847482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fef34151c10 0x7fef34150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:33:57.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.259+0000 7fef39200640 1 --2- 172.21.15.55:0/4231847482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef3415de50 0x7fef340c4190 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fef2000c410 tx=0x7fef2000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:57.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.263+0000 7fef31600640 1 -- 172.21.15.55:0/4231847482 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef200074e0 con 0x7fef3415de50 2024-04-02T07:33:57.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.263+0000 7fef31600640 1 -- 172.21.15.55:0/4231847482 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef20007640 con 0x7fef3415de50 2024-04-02T07:33:57.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.263+0000 7fef31600640 1 -- 172.21.15.55:0/4231847482 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef20004a30 con 0x7fef3415de50 2024-04-02T07:33:57.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.263+0000 7fef3c600640 1 -- 172.21.15.55:0/4231847482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef340c8d60 con 0x7fef3415de50 2024-04-02T07:33:57.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.263+0000 7fef3c600640 1 -- 172.21.15.55:0/4231847482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef340c9320 con 0x7fef3415de50 2024-04-02T07:33:57.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.263+0000 7fef3c600640 1 -- 172.21.15.55:0/4231847482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef340c9540 con 0x7fef3415de50 2024-04-02T07:33:57.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.263+0000 7fef31600640 1 -- 172.21.15.55:0/4231847482 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fef20004b90 con 0x7fef3415de50 2024-04-02T07:33:57.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.263+0000 7fef31600640 1 --2- 172.21.15.55:0/4231847482 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fef14066690 0x7fef14068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:57.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.263+0000 7fef31600640 1 -- 172.21.15.55:0/4231847482 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fef20083fc0 con 0x7fef3415de50 2024-04-02T07:33:57.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.263+0000 7fef39c00640 1 --2- 172.21.15.55:0/4231847482 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fef14066690 0x7fef14068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:57.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.263+0000 7fef39c00640 1 --2- 172.21.15.55:0/4231847482 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fef14066690 0x7fef14068b50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fef28007fd0 tx=0x7fef28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:57.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.267+0000 7fef31600640 1 -- 172.21.15.55:0/4231847482 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fef20051290 con 0x7fef3415de50 2024-04-02T07:33:57.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.431+0000 7fef3c600640 1 -- 172.21.15.55:0/4231847482 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fef340723d0 con 0x7fef3415de50 2024-04-02T07:33:57.430 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.431+0000 7fef31600640 1 -- 172.21.15.55:0/4231847482 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v116) v1 ==== 104+0+11 (secure 0 0 0) 0x7fef200548b0 con 0x7fef3415de50 2024-04-02T07:33:57.431 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:33:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.435+0000 7fef3c600640 1 -- 172.21.15.55:0/4231847482 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fef14066690 msgr2=0x7fef14068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.435+0000 7fef3c600640 1 --2- 172.21.15.55:0/4231847482 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fef14066690 0x7fef14068b50 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fef28007fd0 tx=0x7fef28009040 comp rx=0 tx=0).stop 2024-04-02T07:33:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.435+0000 7fef3c600640 1 -- 172.21.15.55:0/4231847482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef3415de50 msgr2=0x7fef340c4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.435+0000 7fef3c600640 1 --2- 172.21.15.55:0/4231847482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef3415de50 0x7fef340c4190 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7fef2000c410 tx=0x7fef2000c8d0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.435+0000 7fef3c600640 1 -- 172.21.15.55:0/4231847482 shutdown_connections 2024-04-02T07:33:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.435+0000 7fef3c600640 1 --2- 172.21.15.55:0/4231847482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fef34151c10 0x7fef34150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.435+0000 7fef3c600640 1 --2- 172.21.15.55:0/4231847482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fef3415de50 0x7fef340c4190 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.435+0000 7fef3c600640 1 --2- 172.21.15.55:0/4231847482 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fef14066690 0x7fef14068b50 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.433 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.435+0000 7fef3c600640 1 --2- 172.21.15.55:0/4231847482 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fef34099120 0x7fef340b4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.435+0000 7fef3c600640 1 -- 172.21.15.55:0/4231847482 >> 172.21.15.55:0/4231847482 conn(0x7fef340b2150 msgr2=0x7fef340cd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.435+0000 7fef3c600640 1 -- 172.21.15.55:0/4231847482 shutdown_connections 2024-04-02T07:33:57.434 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.435+0000 7fef3c600640 1 -- 172.21.15.55:0/4231847482 wait complete. 2024-04-02T07:33:57.451 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:33:57.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.595+0000 7fa3b5000640 1 Processor -- start 2024-04-02T07:33:57.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.599+0000 7fa3b5000640 1 -- start start 2024-04-02T07:33:57.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.599+0000 7fa3b5000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa3b0144260 0x7fa3b00702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:57.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.599+0000 7fa3b5000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b00707e0 0x7fa3b00b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:57.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.599+0000 7fa3b5000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b015e3a0 con 0x7fa3b00b2fd0 2024-04-02T07:33:57.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.599+0000 7fa3b5000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b00b37c0 con 0x7fa3b0144260 2024-04-02T07:33:57.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.599+0000 7fa3b5000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b0070c60 con 0x7fa3b00707e0 2024-04-02T07:33:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.599+0000 7fa3a7e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b00707e0 0x7fa3b00b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.599+0000 7fa3ade00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa3b0144260 0x7fa3b00702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.599+0000 7fa3a7e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b00707e0 0x7fa3b00b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:48762/0 (socket says 172.21.15.55:48762) 2024-04-02T07:33:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.599+0000 7fa3a7e00640 1 -- 172.21.15.55:0/329903973 learned_addr learned my addr 172.21.15.55:0/329903973 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.599+0000 7fa3a7e00640 1 -- 172.21.15.55:0/329903973 >> v2:172.21.15.106:3300/0 conn(0x7fa3b0144260 msgr2=0x7fa3b00702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.599+0000 7fa3a7e00640 1 --2- 172.21.15.55:0/329903973 >> v2:172.21.15.106:3300/0 conn(0x7fa3b0144260 0x7fa3b00702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.599+0000 7fa3a7e00640 1 -- 172.21.15.55:0/329903973 >> v1:172.21.15.106:6789/0 conn(0x7fa3b00b2fd0 legacy=0x7fa3b00cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:57.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.599+0000 7fa3a7e00640 1 -- 172.21.15.55:0/329903973 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b015e5f0 con 0x7fa3b00707e0 2024-04-02T07:33:57.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.599+0000 7fa3ade00640 1 --2- 172.21.15.55:0/329903973 >> v2:172.21.15.106:3300/0 conn(0x7fa3b0144260 0x7fa3b00702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:33:57.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.603+0000 7fa3a7e00640 1 --2- 172.21.15.55:0/329903973 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b00707e0 0x7fa3b00b2a90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa398009870 tx=0x7fa39801c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be6a5e57f9091df2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:57.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.603+0000 7fa3ad400640 1 -- 172.21.15.55:0/329903973 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3980ab600 con 0x7fa3b00707e0 2024-04-02T07:33:57.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.603+0000 7fa3ad400640 1 -- 172.21.15.55:0/329903973 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3980a7050 con 0x7fa3b00707e0 2024-04-02T07:33:57.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.603+0000 7fa3ad400640 1 -- 172.21.15.55:0/329903973 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3980ab980 con 0x7fa3b00707e0 2024-04-02T07:33:57.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.603+0000 7fa3b5000640 1 -- 172.21.15.55:0/329903973 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b00707e0 msgr2=0x7fa3b00b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:57.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.603+0000 7fa3b5000640 1 --2- 172.21.15.55:0/329903973 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b00707e0 0x7fa3b00b2a90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa398009870 tx=0x7fa39801c560 comp rx=0 tx=0).stop 2024-04-02T07:33:57.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.603+0000 7fa3b5000640 1 -- 172.21.15.55:0/329903973 shutdown_connections 2024-04-02T07:33:57.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.603+0000 7fa3b5000640 1 --2- 172.21.15.55:0/329903973 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b00707e0 0x7fa3b00b2a90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.603+0000 7fa3b5000640 1 --2- 172.21.15.55:0/329903973 >> v2:172.21.15.106:3300/0 conn(0x7fa3b0144260 0x7fa3b00702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.603+0000 7fa3b5000640 1 -- 172.21.15.55:0/329903973 >> 172.21.15.55:0/329903973 conn(0x7fa3b006a390 msgr2=0x7fa3b00b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:57.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.603+0000 7fa3b5000640 1 -- 172.21.15.55:0/329903973 shutdown_connections 2024-04-02T07:33:57.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.603+0000 7fa3b5000640 1 -- 172.21.15.55:0/329903973 wait complete. 2024-04-02T07:33:57.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3b5000640 1 Processor -- start 2024-04-02T07:33:57.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3b5000640 1 -- start start 2024-04-02T07:33:57.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3b5000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b00707e0 0x7fa3b013e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:57.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3b5000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3b00b2fd0 0x7fa3b013ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:57.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3b5000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3b0144260 0x7fa3b01369b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:57.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3b5000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b0154e50 con 0x7fa3b00b2fd0 2024-04-02T07:33:57.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3b5000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b0164d40 con 0x7fa3b0144260 2024-04-02T07:33:57.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3b5000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b0164410 con 0x7fa3b00707e0 2024-04-02T07:33:57.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3a7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3b00b2fd0 0x7fa3b013ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:57.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3a7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3b00b2fd0 0x7fa3b013ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44254/0 (socket says 172.21.15.55:44254) 2024-04-02T07:33:57.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3a7e00640 1 -- 172.21.15.55:0/2745460377 learned_addr learned my addr 172.21.15.55:0/2745460377 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:57.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3ae800640 1 --2- 172.21.15.55:0/2745460377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3b0144260 0x7fa3b01369b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:57.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3ade00640 1 --2- 172.21.15.55:0/2745460377 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b00707e0 0x7fa3b013e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:57.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3a7e00640 1 -- 172.21.15.55:0/2745460377 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b00707e0 msgr2=0x7fa3b013e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:57.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3a7e00640 1 --2- 172.21.15.55:0/2745460377 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b00707e0 0x7fa3b013e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3a7e00640 1 -- 172.21.15.55:0/2745460377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3b0144260 msgr2=0x7fa3b01369b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:57.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3a7e00640 1 --2- 172.21.15.55:0/2745460377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3b0144260 0x7fa3b01369b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3a7e00640 1 -- 172.21.15.55:0/2745460377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a0009420 con 0x7fa3b00b2fd0 2024-04-02T07:33:57.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3a7e00640 1 --2- 172.21.15.55:0/2745460377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3b00b2fd0 0x7fa3b013ede0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fa39801ac10 tx=0x7fa398019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:57.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3a6000640 1 -- 172.21.15.55:0/2745460377 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3980b4420 con 0x7fa3b00b2fd0 2024-04-02T07:33:57.609 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3a6000640 1 -- 172.21.15.55:0/2745460377 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3980b4580 con 0x7fa3b00b2fd0 2024-04-02T07:33:57.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3a6000640 1 -- 172.21.15.55:0/2745460377 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3980b4930 con 0x7fa3b00b2fd0 2024-04-02T07:33:57.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3b5000640 1 -- 172.21.15.55:0/2745460377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3980094d0 con 0x7fa3b00b2fd0 2024-04-02T07:33:57.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3b5000640 1 -- 172.21.15.55:0/2745460377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b01649d0 con 0x7fa3b00b2fd0 2024-04-02T07:33:57.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.607+0000 7fa3b5000640 1 -- 172.21.15.55:0/2745460377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b0073530 con 0x7fa3b00b2fd0 2024-04-02T07:33:57.610 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.611+0000 7fa3a6000640 1 -- 172.21.15.55:0/2745460377 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa3980b2070 con 0x7fa3b00b2fd0 2024-04-02T07:33:57.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.611+0000 7fa3a6000640 1 --2- 172.21.15.55:0/2745460377 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa38c066690 0x7fa38c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:57.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.611+0000 7fa3a6000640 1 -- 172.21.15.55:0/2745460377 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa39811d340 con 0x7fa3b00b2fd0 2024-04-02T07:33:57.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.611+0000 7fa3ade00640 1 --2- 172.21.15.55:0/2745460377 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa38c066690 0x7fa38c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:57.611 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.611+0000 7fa3ade00640 1 --2- 172.21.15.55:0/2745460377 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa38c066690 0x7fa38c068b50 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa3b015e2e0 tx=0x7fa3a0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:57.613 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.615+0000 7fa3a6000640 1 -- 172.21.15.55:0/2745460377 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa3980ea740 con 0x7fa3b00b2fd0 2024-04-02T07:33:57.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.775+0000 7fa3b5000640 1 -- 172.21.15.55:0/2745460377 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa3b00666c0 con 0x7fa3b00b2fd0 2024-04-02T07:33:57.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.775+0000 7fa3a6000640 1 -- 172.21.15.55:0/2745460377 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v116) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa3980edd60 con 0x7fa3b00b2fd0 2024-04-02T07:33:57.775 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:33:57.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.779+0000 7fa3b5000640 1 -- 172.21.15.55:0/2745460377 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa38c066690 msgr2=0x7fa38c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:57.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.779+0000 7fa3b5000640 1 --2- 172.21.15.55:0/2745460377 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa38c066690 0x7fa38c068b50 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fa3b015e2e0 tx=0x7fa3a0008040 comp rx=0 tx=0).stop 2024-04-02T07:33:57.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.779+0000 7fa3b5000640 1 -- 172.21.15.55:0/2745460377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3b00b2fd0 msgr2=0x7fa3b013ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:57.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.779+0000 7fa3b5000640 1 --2- 172.21.15.55:0/2745460377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3b00b2fd0 0x7fa3b013ede0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7fa39801ac10 tx=0x7fa398019300 comp rx=0 tx=0).stop 2024-04-02T07:33:57.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.779+0000 7fa3b5000640 1 -- 172.21.15.55:0/2745460377 shutdown_connections 2024-04-02T07:33:57.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.779+0000 7fa3b5000640 1 --2- 172.21.15.55:0/2745460377 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa38c066690 0x7fa38c068b50 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.779+0000 7fa3b5000640 1 --2- 172.21.15.55:0/2745460377 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3b0144260 0x7fa3b01369b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.779+0000 7fa3b5000640 1 --2- 172.21.15.55:0/2745460377 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3b00b2fd0 0x7fa3b013ede0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.779+0000 7fa3b5000640 1 --2- 172.21.15.55:0/2745460377 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3b00707e0 0x7fa3b013e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.779+0000 7fa3b5000640 1 -- 172.21.15.55:0/2745460377 >> 172.21.15.55:0/2745460377 conn(0x7fa3b006a390 msgr2=0x7fa3b0140250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:57.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.779+0000 7fa3b5000640 1 -- 172.21.15.55:0/2745460377 shutdown_connections 2024-04-02T07:33:57.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.779+0000 7fa3b5000640 1 -- 172.21.15.55:0/2745460377 wait complete. 2024-04-02T07:33:57.796 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:33:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76d1400640 1 Processor -- start 2024-04-02T07:33:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76d1400640 1 -- start start 2024-04-02T07:33:57.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76d1400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f76cc1599c0 0x7f76cc0b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:57.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76d1400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f76cc0b38f0 0x7f76cc0c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:57.939 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76d1400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76cc0b1d60 con 0x7f76cc06d1c0 2024-04-02T07:33:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76d1400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76cc06cda0 con 0x7f76cc1599c0 2024-04-02T07:33:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76d1400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc06c400 con 0x7f76cc0b38f0 2024-04-02T07:33:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76c3e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f76cc06d1c0 0x7f76cc0b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54192/0 (socket says 172.21.15.55:54192) 2024-04-02T07:33:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76c3e00640 1 -- 172.21.15.55:0/539678812 learned_addr learned my addr 172.21.15.55:0/539678812 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:33:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76cb200640 1 --2- 172.21.15.55:0/539678812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f76cc0b38f0 0x7f76cc0c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76ca800640 1 --2- 172.21.15.55:0/539678812 >> v2:172.21.15.106:3300/0 conn(0x7f76cc1599c0 0x7f76cc0b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76c9e00640 1 -- 172.21.15.55:0/539678812 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2850025358 0 0) 0x7f76cc0b1d60 con 0x7f76cc06d1c0 2024-04-02T07:33:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76c9e00640 1 -- 172.21.15.55:0/539678812 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76b0003530 con 0x7f76cc06d1c0 2024-04-02T07:33:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76c9e00640 1 -- 172.21.15.55:0/539678812 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 943938761 0 0) 0x7f76b0003530 con 0x7f76cc06d1c0 2024-04-02T07:33:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76c9e00640 1 -- 172.21.15.55:0/539678812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f76cc0b38f0 msgr2=0x7f76cc0c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76c9e00640 1 --2- 172.21.15.55:0/539678812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f76cc0b38f0 0x7f76cc0c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76c9e00640 1 -- 172.21.15.55:0/539678812 >> v2:172.21.15.106:3300/0 conn(0x7f76cc1599c0 msgr2=0x7f76cc0b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76c9e00640 1 --2- 172.21.15.55:0/539678812 >> v2:172.21.15.106:3300/0 conn(0x7f76cc1599c0 0x7f76cc0b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76c9e00640 1 -- 172.21.15.55:0/539678812 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc06c6e0 con 0x7f76cc06d1c0 2024-04-02T07:33:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76c9e00640 1 -- 172.21.15.55:0/539678812 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f76b4001680 con 0x7f76cc06d1c0 2024-04-02T07:33:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76c9e00640 1 -- 172.21.15.55:0/539678812 >> v1:172.21.15.55:6789/0 conn(0x7f76cc06d1c0 legacy=0x7f76cc0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76c9e00640 1 --2- 172.21.15.55:0/539678812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f76cc0b38f0 0x7f76b0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76c9e00640 1 --2- 172.21.15.55:0/539678812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76b0003f50 0x7f76b00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76c9e00640 1 --2- 172.21.15.55:0/539678812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b0004d10 0x7f76b0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76c9e00640 1 -- 172.21.15.55:0/539678812 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc06cda0 con 0x7f76b0004d10 2024-04-02T07:33:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76c9e00640 1 -- 172.21.15.55:0/539678812 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc06c400 con 0x7f76b0003f50 2024-04-02T07:33:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76c9e00640 1 -- 172.21.15.55:0/539678812 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76b000b990 con 0x7f76cc0b38f0 2024-04-02T07:33:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76cb200640 1 --2- 172.21.15.55:0/539678812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b0004d10 0x7f76b0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76ca800640 1 --2- 172.21.15.55:0/539678812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f76cc0b38f0 0x7f76b0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.939+0000 7f76c3e00640 1 --2- 172.21.15.55:0/539678812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76b0003f50 0x7f76b00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:57.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.943+0000 7f76cb200640 1 -- 172.21.15.55:0/539678812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f76cc0b38f0 msgr2=0x7f76b0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:57.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.943+0000 7f76cb200640 1 --2- 172.21.15.55:0/539678812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f76cc0b38f0 0x7f76b0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.943+0000 7f76cb200640 1 -- 172.21.15.55:0/539678812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76b0003f50 msgr2=0x7f76b00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:33:57.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.943+0000 7f76cb200640 1 --2- 172.21.15.55:0/539678812 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76b0003f50 0x7f76b00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.943+0000 7f76cb200640 1 -- 172.21.15.55:0/539678812 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76b0003530 con 0x7f76b0004d10 2024-04-02T07:33:57.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.943+0000 7f76ca800640 1 --2- 172.21.15.55:0/539678812 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f76cc0b38f0 0x7f76b0003980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:33:57.943 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.943+0000 7f76cb200640 1 --2- 172.21.15.55:0/539678812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b0004d10 0x7f76b0005190 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009bd0 tx=0x7f76c401ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a395bf4eedaf62 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:57.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.943+0000 7f76c9e00640 1 -- 172.21.15.55:0/539678812 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c40a7e80 con 0x7f76b0004d10 2024-04-02T07:33:57.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.943+0000 7f76c9e00640 1 -- 172.21.15.55:0/539678812 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c400f040 con 0x7f76b0004d10 2024-04-02T07:33:57.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.943+0000 7f76c9e00640 1 -- 172.21.15.55:0/539678812 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c40af660 con 0x7f76b0004d10 2024-04-02T07:33:57.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.943+0000 7f76d1400640 1 -- 172.21.15.55:0/539678812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b0004d10 msgr2=0x7f76b0005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:57.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.943+0000 7f76d1400640 1 --2- 172.21.15.55:0/539678812 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b0004d10 0x7f76b0005190 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f76c4009bd0 tx=0x7f76c401ee70 comp rx=0 tx=0).stop 2024-04-02T07:33:57.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.943+0000 7f76cb200640 1 -- 172.21.15.55:0/539678812 reap_dead start 2024-04-02T07:33:57.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.943+0000 7f76d1400640 1 -- 172.21.15.55:0/539678812 shutdown_connections 2024-04-02T07:33:57.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.943+0000 7f76d1400640 1 -- 172.21.15.55:0/539678812 >> 172.21.15.55:0/539678812 conn(0x7f76cc069d90 msgr2=0x7f76cc06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:57.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.943+0000 7f76d1400640 1 -- 172.21.15.55:0/539678812 shutdown_connections 2024-04-02T07:33:57.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.943+0000 7f76d1400640 1 -- 172.21.15.55:0/539678812 wait complete. 2024-04-02T07:33:57.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76d1400640 1 Processor -- start 2024-04-02T07:33:57.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76d1400640 1 -- start start 2024-04-02T07:33:57.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76d1400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b0004d10 0x7f76cc153090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:57.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76d1400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76cc0cb210 0x7f76cc14c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:57.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76d1400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f76cc0cd750 0x7f76cc0cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:57.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76d1400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc0ce140 con 0x7f76b0004d10 2024-04-02T07:33:57.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76d1400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc152030 con 0x7f76cc0cb210 2024-04-02T07:33:57.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76d1400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc1522d0 con 0x7f76cc0cd750 2024-04-02T07:33:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76ca800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b0004d10 0x7f76cc153090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76ca800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b0004d10 0x7f76cc153090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44266/0 (socket says 172.21.15.55:44266) 2024-04-02T07:33:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76ca800640 1 -- 172.21.15.55:0/143966330 learned_addr learned my addr 172.21.15.55:0/143966330 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:33:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76c3e00640 1 --2- 172.21.15.55:0/143966330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76cc0cb210 0x7f76cc14c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76cb200640 1 --2- 172.21.15.55:0/143966330 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f76cc0cd750 0x7f76cc0cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76ca800640 1 -- 172.21.15.55:0/143966330 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f76cc0cd750 msgr2=0x7f76cc0cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76ca800640 1 --2- 172.21.15.55:0/143966330 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f76cc0cd750 0x7f76cc0cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76ca800640 1 -- 172.21.15.55:0/143966330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76cc0cb210 msgr2=0x7f76cc14c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76ca800640 1 --2- 172.21.15.55:0/143966330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76cc0cb210 0x7f76cc14c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76ca800640 1 -- 172.21.15.55:0/143966330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc1525b0 con 0x7f76b0004d10 2024-04-02T07:33:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76ca800640 1 --2- 172.21.15.55:0/143966330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b0004d10 0x7f76cc153090 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f76bc011ca0 tx=0x7f76bc00f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:57.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76c2a00640 1 -- 172.21.15.55:0/143966330 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc011e50 con 0x7f76b0004d10 2024-04-02T07:33:57.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76c2a00640 1 -- 172.21.15.55:0/143966330 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76bc004020 con 0x7f76b0004d10 2024-04-02T07:33:57.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76c2a00640 1 -- 172.21.15.55:0/143966330 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76bc0043d0 con 0x7f76b0004d10 2024-04-02T07:33:57.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.947+0000 7f76d1400640 1 -- 172.21.15.55:0/143966330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76cc152890 con 0x7f76b0004d10 2024-04-02T07:33:57.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.951+0000 7f76d1400640 1 -- 172.21.15.55:0/143966330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76cc1535d0 con 0x7f76b0004d10 2024-04-02T07:33:57.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.951+0000 7f76d1400640 1 -- 172.21.15.55:0/143966330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76cc06e270 con 0x7f76b0004d10 2024-04-02T07:33:57.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.951+0000 7f76c2a00640 1 -- 172.21.15.55:0/143966330 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f76bc003620 con 0x7f76b0004d10 2024-04-02T07:33:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.951+0000 7f76c2a00640 1 --2- 172.21.15.55:0/143966330 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f76a80666c0 0x7f76a8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:33:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.951+0000 7f76c2a00640 1 -- 172.21.15.55:0/143966330 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76bc0848f0 con 0x7f76b0004d10 2024-04-02T07:33:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.951+0000 7f76c3e00640 1 --2- 172.21.15.55:0/143966330 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f76a80666c0 0x7f76a8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:33:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.951+0000 7f76c3e00640 1 --2- 172.21.15.55:0/143966330 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f76a80666c0 0x7f76a8068b80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0c8a90 tx=0x7f76b4001dd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:33:57.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:57.955+0000 7f76c2a00640 1 -- 172.21.15.55:0/143966330 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f76bc051c70 con 0x7f76b0004d10 2024-04-02T07:33:58.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:58.131+0000 7f76d1400640 1 -- 172.21.15.55:0/143966330 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f76cc066c90 con 0x7f76b0004d10 2024-04-02T07:33:58.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:58.131+0000 7f76c2a00640 1 -- 172.21.15.55:0/143966330 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v116) v1 ==== 80+0+0 (secure 0 0 0) 0x7f76bc022020 con 0x7f76b0004d10 2024-04-02T07:33:58.129 INFO:teuthology.orchestra.run.smithi055.stderr:listed 0 entries 2024-04-02T07:33:58.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:58.131+0000 7f76d1400640 1 -- 172.21.15.55:0/143966330 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f76a80666c0 msgr2=0x7f76a8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:58.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:58.131+0000 7f76d1400640 1 --2- 172.21.15.55:0/143966330 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f76a80666c0 0x7f76a8068b80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f76cc0c8a90 tx=0x7f76b4001dd0 comp rx=0 tx=0).stop 2024-04-02T07:33:58.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:58.131+0000 7f76d1400640 1 -- 172.21.15.55:0/143966330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b0004d10 msgr2=0x7f76cc153090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:33:58.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:58.131+0000 7f76d1400640 1 --2- 172.21.15.55:0/143966330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b0004d10 0x7f76cc153090 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f76bc011ca0 tx=0x7f76bc00f610 comp rx=0 tx=0).stop 2024-04-02T07:33:58.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:58.131+0000 7f76d1400640 1 -- 172.21.15.55:0/143966330 shutdown_connections 2024-04-02T07:33:58.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:58.131+0000 7f76d1400640 1 --2- 172.21.15.55:0/143966330 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f76cc0cd750 0x7f76cc0cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:58.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:58.131+0000 7f76d1400640 1 --2- 172.21.15.55:0/143966330 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f76a80666c0 0x7f76a8068b80 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:58.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:58.131+0000 7f76d1400640 1 --2- 172.21.15.55:0/143966330 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f76cc0cb210 0x7f76cc14c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:58.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:58.131+0000 7f76d1400640 1 --2- 172.21.15.55:0/143966330 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f76b0004d10 0x7f76cc153090 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:33:58.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:58.131+0000 7f76d1400640 1 -- 172.21.15.55:0/143966330 >> 172.21.15.55:0/143966330 conn(0x7f76cc069d90 msgr2=0x7f76cc156720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:33:58.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:58.131+0000 7f76d1400640 1 -- 172.21.15.55:0/143966330 shutdown_connections 2024-04-02T07:33:58.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:33:58.131+0000 7f76d1400640 1 -- 172.21.15.55:0/143966330 wait complete. 2024-04-02T07:33:58.149 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi055.front.sepia.ceph.com... 2024-04-02T07:33:58.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:33:58.149 DEBUG:teuthology.orchestra.run.smithi055:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-02T07:33:58.167 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[52634]: fuse finished with error 0 and tester_r 0 2024-04-02T07:33:58.171 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:34:04.273 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:34:04.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:04.273 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-02T07:34:04.284 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:34:04.284 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:34:04.340 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:34:04.341 DEBUG:tasks.cephfs.fuse_mount:ceph-fuse client.0 is not mounted at ubuntu@smithi055.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0 2024-04-02T07:34:04.341 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:34:04.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:04.341 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-02T07:34:04.392 INFO:teuthology.orchestra.run.smithi055.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-02T07:34:04.393 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:34:04.393 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-02T07:34:04.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.591+0000 7f09c2800640 1 Processor -- start 2024-04-02T07:34:04.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.591+0000 7f09c2800640 1 -- start start 2024-04-02T07:34:04.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.591+0000 7f09c2800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09bc15aad0 0x7f09bc0caea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:04.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09c2800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f09bc06da10 0x7f09bc0cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:04.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09c2800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09bc0c9ff0 con 0x7f09bc0af920 2024-04-02T07:34:04.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09c2800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09bc0cb920 con 0x7f09bc06da10 2024-04-02T07:34:04.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09c2800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc0c93e0 con 0x7f09bc15aad0 2024-04-02T07:34:04.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09b3e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f09bc0af920 0x7f09bc15e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54206/0 (socket says 172.21.15.55:54206) 2024-04-02T07:34:04.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09b3e00640 1 -- 172.21.15.55:0/1844086023 learned_addr learned my addr 172.21.15.55:0/1844086023 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:04.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09bbe00640 1 --2- 172.21.15.55:0/1844086023 >> v2:172.21.15.106:3300/0 conn(0x7f09bc06da10 0x7f09bc0cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:04.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09bb400640 1 --2- 172.21.15.55:0/1844086023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09bc15aad0 0x7f09bc0caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09baa00640 1 -- 172.21.15.55:0/1844086023 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1488586744 0 0) 0x7f09bc0c9ff0 con 0x7f09bc0af920 2024-04-02T07:34:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09baa00640 1 -- 172.21.15.55:0/1844086023 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f09a0003530 con 0x7f09bc0af920 2024-04-02T07:34:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09baa00640 1 -- 172.21.15.55:0/1844086023 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 499006497 0 0) 0x7f09a0003530 con 0x7f09bc0af920 2024-04-02T07:34:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09baa00640 1 -- 172.21.15.55:0/1844086023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09bc15aad0 msgr2=0x7f09bc0caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09baa00640 1 --2- 172.21.15.55:0/1844086023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09bc15aad0 0x7f09bc0caea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09baa00640 1 -- 172.21.15.55:0/1844086023 >> v2:172.21.15.106:3300/0 conn(0x7f09bc06da10 msgr2=0x7f09bc0cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09baa00640 1 --2- 172.21.15.55:0/1844086023 >> v2:172.21.15.106:3300/0 conn(0x7f09bc06da10 0x7f09bc0cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09baa00640 1 -- 172.21.15.55:0/1844086023 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc0c96c0 con 0x7f09bc0af920 2024-04-02T07:34:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09baa00640 1 -- 172.21.15.55:0/1844086023 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f09a4001680 con 0x7f09bc0af920 2024-04-02T07:34:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09baa00640 1 -- 172.21.15.55:0/1844086023 >> v1:172.21.15.55:6789/0 conn(0x7f09bc0af920 legacy=0x7f09bc15e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09baa00640 1 --2- 172.21.15.55:0/1844086023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09a0003980 0x7f09a0003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09baa00640 1 --2- 172.21.15.55:0/1844086023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09a0004370 0x7f09a0004850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09baa00640 1 --2- 172.21.15.55:0/1844086023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09a0004f60 0x7f09a000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:04.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09baa00640 1 -- 172.21.15.55:0/1844086023 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc0c93e0 con 0x7f09a0004f60 2024-04-02T07:34:04.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09baa00640 1 -- 172.21.15.55:0/1844086023 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09a000bed0 con 0x7f09a0004370 2024-04-02T07:34:04.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09baa00640 1 -- 172.21.15.55:0/1844086023 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09a000c040 con 0x7f09a0003980 2024-04-02T07:34:04.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09bbe00640 1 --2- 172.21.15.55:0/1844086023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09a0004f60 0x7f09a000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:04.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09b3e00640 1 --2- 172.21.15.55:0/1844086023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09a0004370 0x7f09a0004850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:04.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09bb400640 1 --2- 172.21.15.55:0/1844086023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09a0003980 0x7f09a0003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:04.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09bbe00640 1 -- 172.21.15.55:0/1844086023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09a0003980 msgr2=0x7f09a0003da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:04.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09bbe00640 1 --2- 172.21.15.55:0/1844086023 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09a0003980 0x7f09a0003da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:04.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09bbe00640 1 -- 172.21.15.55:0/1844086023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09a0004370 msgr2=0x7f09a0004850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:04.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09bbe00640 1 --2- 172.21.15.55:0/1844086023 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09a0004370 0x7f09a0004850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:04.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.595+0000 7f09bbe00640 1 -- 172.21.15.55:0/1844086023 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09a0003530 con 0x7f09a0004f60 2024-04-02T07:34:04.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.599+0000 7f09bbe00640 1 --2- 172.21.15.55:0/1844086023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09a0004f60 0x7f09a000b990 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f09b4009f90 tx=0x7f09b401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15538e15ec19f5e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:04.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.599+0000 7f09baa00640 1 -- 172.21.15.55:0/1844086023 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40a5c90 con 0x7f09a0004f60 2024-04-02T07:34:04.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.599+0000 7f09baa00640 1 -- 172.21.15.55:0/1844086023 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b400f040 con 0x7f09a0004f60 2024-04-02T07:34:04.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.599+0000 7f09baa00640 1 -- 172.21.15.55:0/1844086023 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40ad640 con 0x7f09a0004f60 2024-04-02T07:34:04.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.599+0000 7f09c2800640 1 -- 172.21.15.55:0/1844086023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09a0004f60 msgr2=0x7f09a000b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:04.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.599+0000 7f09c2800640 1 --2- 172.21.15.55:0/1844086023 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09a0004f60 0x7f09a000b990 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f09b4009f90 tx=0x7f09b401cc20 comp rx=0 tx=0).stop 2024-04-02T07:34:04.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.599+0000 7f09bbe00640 1 -- 172.21.15.55:0/1844086023 reap_dead start 2024-04-02T07:34:04.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.599+0000 7f09c2800640 1 -- 172.21.15.55:0/1844086023 shutdown_connections 2024-04-02T07:34:04.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.599+0000 7f09c2800640 1 -- 172.21.15.55:0/1844086023 >> 172.21.15.55:0/1844086023 conn(0x7f09bc069d90 msgr2=0x7f09bc06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:04.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.599+0000 7f09c2800640 1 -- 172.21.15.55:0/1844086023 shutdown_connections 2024-04-02T07:34:04.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.599+0000 7f09c2800640 1 -- 172.21.15.55:0/1844086023 wait complete. 2024-04-02T07:34:04.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.599+0000 7f09c2800640 1 Processor -- start 2024-04-02T07:34:04.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.599+0000 7f09c2800640 1 -- start start 2024-04-02T07:34:04.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09c2800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09a0004f60 0x7f09bc13fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:04.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09c2800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09bc0c6ad0 0x7f09bc0c3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:04.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09c2800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09bc0c6f50 0x7f09bc1e60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:04.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09c2800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc0c8860 con 0x7f09bc0c6f50 2024-04-02T07:34:04.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09c2800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc0c48d0 con 0x7f09a0004f60 2024-04-02T07:34:04.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09c2800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09bc0c4bb0 con 0x7f09bc0c6ad0 2024-04-02T07:34:04.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09bbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09bc0c6f50 0x7f09bc1e60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:04.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09bbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09bc0c6f50 0x7f09bc1e60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44290/0 (socket says 172.21.15.55:44290) 2024-04-02T07:34:04.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09bbe00640 1 -- 172.21.15.55:0/914403351 learned_addr learned my addr 172.21.15.55:0/914403351 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:04.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09bbe00640 1 -- 172.21.15.55:0/914403351 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09bc0c6ad0 msgr2=0x7f09bc0c3e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:04.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09bbe00640 1 --2- 172.21.15.55:0/914403351 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09bc0c6ad0 0x7f09bc0c3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:04.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09bb400640 1 --2- 172.21.15.55:0/914403351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09a0004f60 0x7f09bc13fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:04.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09bbe00640 1 -- 172.21.15.55:0/914403351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09a0004f60 msgr2=0x7f09bc13fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:04.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09bbe00640 1 --2- 172.21.15.55:0/914403351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09a0004f60 0x7f09bc13fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:04.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09bbe00640 1 -- 172.21.15.55:0/914403351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09bc0c4e90 con 0x7f09bc0c6f50 2024-04-02T07:34:04.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09bb400640 1 --2- 172.21.15.55:0/914403351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09a0004f60 0x7f09bc13fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:04.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09bbe00640 1 --2- 172.21.15.55:0/914403351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09bc0c6f50 0x7f09bc1e60d0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f09b4002240 tx=0x7f09b4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:04.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09b3400640 1 -- 172.21.15.55:0/914403351 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40ad710 con 0x7f09bc0c6f50 2024-04-02T07:34:04.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09b3400640 1 -- 172.21.15.55:0/914403351 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09b40ad870 con 0x7f09bc0c6f50 2024-04-02T07:34:04.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09b3400640 1 -- 172.21.15.55:0/914403351 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09b40adc20 con 0x7f09bc0c6f50 2024-04-02T07:34:04.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09c2800640 1 -- 172.21.15.55:0/914403351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09bc0c5170 con 0x7f09bc0c6f50 2024-04-02T07:34:04.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09c2800640 1 -- 172.21.15.55:0/914403351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09bc1500e0 con 0x7f09bc0c6f50 2024-04-02T07:34:04.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09c2800640 1 -- 172.21.15.55:0/914403351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09bc06e240 con 0x7f09bc0c6f50 2024-04-02T07:34:04.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.603+0000 7f09b3400640 1 -- 172.21.15.55:0/914403351 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f09b40b4040 con 0x7f09bc0c6f50 2024-04-02T07:34:04.604 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.607+0000 7f09b3400640 1 --2- 172.21.15.55:0/914403351 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0998066690 0x7f0998068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:04.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.607+0000 7f09b3400640 1 -- 172.21.15.55:0/914403351 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f09b411e980 con 0x7f09bc0c6f50 2024-04-02T07:34:04.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.607+0000 7f09bb400640 1 --2- 172.21.15.55:0/914403351 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0998066690 0x7f0998068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:04.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.607+0000 7f09bb400640 1 --2- 172.21.15.55:0/914403351 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0998066690 0x7f0998068b50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0b1520 tx=0x7f09ac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:04.608 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.611+0000 7f09b3400640 1 -- 172.21.15.55:0/914403351 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f09b40ebc10 con 0x7f09bc0c6f50 2024-04-02T07:34:04.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.803+0000 7f09c2800640 1 -- 172.21.15.55:0/914403351 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f09bc066c90 con 0x7f09bc0c6f50 2024-04-02T07:34:04.804 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-02T07:34:04.807+0000 7f8f18800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-02T07:34:04.824 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.827+0000 7f09b3400640 1 -- 172.21.15.55:0/914403351 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v97) v1 ==== 161+0+0 (secure 0 0 0) 0x7f09b40b2020 con 0x7f09bc0c6f50 2024-04-02T07:34:04.824 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-02T07:34:04.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.827+0000 7f09c2800640 1 -- 172.21.15.55:0/914403351 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0998066690 msgr2=0x7f0998068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:04.826 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.827+0000 7f09c2800640 1 --2- 172.21.15.55:0/914403351 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0998066690 0x7f0998068b50 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f09bc0b1520 tx=0x7f09ac008040 comp rx=0 tx=0).stop 2024-04-02T07:34:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.827+0000 7f09c2800640 1 -- 172.21.15.55:0/914403351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09bc0c6f50 msgr2=0x7f09bc1e60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.827+0000 7f09c2800640 1 --2- 172.21.15.55:0/914403351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09bc0c6f50 0x7f09bc1e60d0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f09b4002240 tx=0x7f09b4009750 comp rx=0 tx=0).stop 2024-04-02T07:34:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.827+0000 7f09c2800640 1 -- 172.21.15.55:0/914403351 shutdown_connections 2024-04-02T07:34:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.827+0000 7f09c2800640 1 --2- 172.21.15.55:0/914403351 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f09bc0c6f50 0x7f09bc1e60d0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.827+0000 7f09c2800640 1 --2- 172.21.15.55:0/914403351 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f09bc0c6ad0 0x7f09bc0c3e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.827+0000 7f09c2800640 1 --2- 172.21.15.55:0/914403351 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0998066690 0x7f0998068b50 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.827+0000 7f09c2800640 1 --2- 172.21.15.55:0/914403351 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f09a0004f60 0x7f09bc13fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.827+0000 7f09c2800640 1 -- 172.21.15.55:0/914403351 >> 172.21.15.55:0/914403351 conn(0x7f09bc069d90 msgr2=0x7f09bc157440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.827+0000 7f09c2800640 1 -- 172.21.15.55:0/914403351 shutdown_connections 2024-04-02T07:34:04.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:04.827+0000 7f09c2800640 1 -- 172.21.15.55:0/914403351 wait complete. 2024-04-02T07:34:04.838 INFO:tasks.ceph.mds.d.smithi106.stderr: -8056> 2024-04-02T07:33:29.358+0000 7fc8b4600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:34:04.847 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-02T07:34:04.849 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-02T07:34:04.890 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2024-04-02T07:34:04.890 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2024-04-02T07:34:04.890 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-02T07:34:04.890 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2024-04-02T07:34:04.890 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.890 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2024-04-02T07:34:04.891 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.891 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2024-04-02T07:34:04.891 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.891 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2024-04-02T07:34:04.891 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2024-04-02T07:34:04.891 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.891 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2024-04-02T07:34:04.891 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2024-04-02T07:34:04.891 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.891 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-02T07:34:04.891 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2024-04-02T07:34:04.891 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.891 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2024-04-02T07:34:04.891 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-02T07:34:04.892 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.892 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2024-04-02T07:34:04.892 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.892 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2024-04-02T07:34:04.892 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2024-04-02T07:34:04.892 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2024-04-02T07:34:04.892 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2024-04-02T07:34:04.892 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2024-04-02T07:34:04.892 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2024-04-02T07:34:04.892 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2024-04-02T07:34:04.892 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-02T07:34:04.892 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-02T07:34:04.892 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2024-04-02T07:34:04.892 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.893 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-02T07:34:04.893 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.893 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2024-04-02T07:34:04.893 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.893 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2024-04-02T07:34:04.893 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.893 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2024-04-02T07:34:04.893 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2024-04-02T07:34:04.893 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2024-04-02T07:34:04.893 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.55,172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790]" 2024-04-02T07:34:04.893 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = 642a0456-a2ac-49a4-91a5-3b3449b512da 2024-04-02T07:34:04.893 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.893 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2024-04-02T07:34:04.894 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2024-04-02T07:34:04.894 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.894 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2024-04-02T07:34:04.894 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2024-04-02T07:34:04.894 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2024-04-02T07:34:04.894 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.894 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2024-04-02T07:34:04.894 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2024-04-02T07:34:04.894 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.894 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2024-04-02T07:34:04.894 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2024-04-02T07:34:04.894 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2024-04-02T07:34:04.894 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.895 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2024-04-02T07:34:04.895 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2024-04-02T07:34:04.895 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.895 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2024-04-02T07:34:04.895 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.895 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2024-04-02T07:34:04.895 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.895 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2024-04-02T07:34:04.895 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.895 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2024-04-02T07:34:04.895 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2024-04-02T07:34:04.895 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.895 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2024-04-02T07:34:04.895 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2024-04-02T07:34:04.895 INFO:teuthology.orchestra.run.smithi055.stdout: bdev async discard = True 2024-04-02T07:34:04.896 INFO:teuthology.orchestra.run.smithi055.stdout: bdev enable discard = True 2024-04-02T07:34:04.896 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore allocator = bitmap 2024-04-02T07:34:04.896 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2024-04-02T07:34:04.896 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2024-04-02T07:34:04.896 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 1/20 2024-04-02T07:34:04.896 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 1/20 2024-04-02T07:34:04.896 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:34:04.896 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2024-04-02T07:34:04.896 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 4/10 2024-04-02T07:34:04.896 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2024-04-02T07:34:04.896 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2024-04-02T07:34:04.896 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2024-04-02T07:34:04.896 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2024-04-02T07:34:04.896 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2024-04-02T07:34:04.896 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-02T07:34:04.897 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.897 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2024-04-02T07:34:04.897 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:34:04.897 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2024-04-02T07:34:04.897 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-02T07:34:04.897 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-02T07:34:04.897 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-02T07:34:04.897 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-02T07:34:04.897 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2024-04-02T07:34:04.897 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.897 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2024-04-02T07:34:04.897 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:34:04.897 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-02T07:34:04.898 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2024-04-02T07:34:04.898 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-02T07:34:04.898 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2024-04-02T07:34:04.898 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2024-04-02T07:34:04.898 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-02T07:34:04.898 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2024-04-02T07:34:04.898 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2024-04-02T07:34:04.898 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-02T07:34:04.898 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.898 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-02T07:34:04.898 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2024-04-02T07:34:04.898 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2024-04-02T07:34:04.898 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.899 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2024-04-02T07:34:04.899 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-02T07:34:04.899 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-02T07:34:04.899 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.899 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2024-04-02T07:34:04.899 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2024-04-02T07:34:04.899 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.899 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2024-04-02T07:34:04.899 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2024-04-02T07:34:04.899 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:04.899 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2024-04-02T07:34:04.899 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2024-04-02T07:34:04.899 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2024-04-02T07:34:04.899 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2024-04-02T07:34:04.899 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-02T07:34:04.899 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-02T07:34:04.900 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2024-04-02T07:34:04.900 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2024-04-02T07:34:04.900 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:34:04.900 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2024-04-02T07:34:04.900 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-02T07:34:04.900 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-02T07:34:04.900 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2024-04-02T07:34:04.900 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2024-04-02T07:34:04.900 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2024-04-02T07:34:04.900 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-04-02T07:34:04.900 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-04-02T07:34:04.900 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-04-02T07:34:04.900 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-04-02T07:34:04.900 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2024-04-02T07:34:04.901 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2024-04-02T07:34:04.901 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2024-04-02T07:34:04.901 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:34:04.901 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2024-04-02T07:34:04.901 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = True 2024-04-02T07:34:04.901 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2024-04-02T07:34:04.901 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = False 2024-04-02T07:34:04.901 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-02T07:34:04.901 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-02T07:34:04.901 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-02T07:34:04.902 INFO:tasks.ceph.mds.d.smithi106.stdout:starting mds.d at 2024-04-02T07:34:04.902 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2024-04-02T07:34:04.902 INFO:teuthology.orchestra.run.smithi106.stdout: chdir = "" 2024-04-02T07:34:04.902 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-02T07:34:04.902 INFO:teuthology.orchestra.run.smithi106.stdout: auth supported = cephx 2024-04-02T07:34:04.902 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.902 INFO:teuthology.orchestra.run.smithi106.stdout: filestore xattr use omap = true 2024-04-02T07:34:04.902 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.903 INFO:teuthology.orchestra.run.smithi106.stdout: mon clock drift allowed = 1.000 2024-04-02T07:34:04.903 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.903 INFO:teuthology.orchestra.run.smithi106.stdout: osd crush chooseleaf type = 0 2024-04-02T07:34:04.903 INFO:teuthology.orchestra.run.smithi106.stdout: auth debug = true 2024-04-02T07:34:04.903 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.903 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on old message = true 2024-04-02T07:34:04.903 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on bug = true 2024-04-02T07:34:04.903 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.903 INFO:teuthology.orchestra.run.smithi106.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-02T07:34:04.903 INFO:teuthology.orchestra.run.smithi106.stdout: mon pg warn max object skew = 0 2024-04-02T07:34:04.903 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.903 INFO:teuthology.orchestra.run.smithi106.stdout: # disable pg_autoscaler by default for new pools 2024-04-02T07:34:04.903 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-02T07:34:04.904 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.904 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default size = 2 2024-04-02T07:34:04.904 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.904 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow primary affinity = true 2024-04-02T07:34:04.904 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow pg remap = true 2024-04-02T07:34:04.904 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on legacy crush tunables = false 2024-04-02T07:34:04.904 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on crush straw calc version zero = false 2024-04-02T07:34:04.904 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on no sortbitwise = false 2024-04-02T07:34:04.904 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on osd down out interval zero = false 2024-04-02T07:34:04.904 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on too few osds = false 2024-04-02T07:34:04.904 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-02T07:34:04.904 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-02T07:34:04.904 INFO:teuthology.orchestra.run.smithi106.stdout: mon_allow_pool_size_one = true 2024-04-02T07:34:04.905 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.905 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-02T07:34:04.905 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.905 INFO:teuthology.orchestra.run.smithi106.stdout: osd default data pool replay window = 5 2024-04-02T07:34:04.905 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.905 INFO:teuthology.orchestra.run.smithi106.stdout: mon allow pool delete = true 2024-04-02T07:34:04.905 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.905 INFO:teuthology.orchestra.run.smithi106.stdout: mon cluster log file level = debug 2024-04-02T07:34:04.905 INFO:teuthology.orchestra.run.smithi106.stdout: debug asserts on shutdown = true 2024-04-02T07:34:04.905 INFO:teuthology.orchestra.run.smithi106.stdout: mon health detail to clog = false 2024-04-02T07:34:04.905 INFO:teuthology.orchestra.run.smithi106.stdout: mon host = "172.21.15.55,172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790]" 2024-04-02T07:34:04.905 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = 642a0456-a2ac-49a4-91a5-3b3449b512da 2024-04-02T07:34:04.905 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.905 INFO:teuthology.orchestra.run.smithi106.stdout:[osd] 2024-04-02T07:34:04.906 INFO:teuthology.orchestra.run.smithi106.stdout: osd journal size = 100 2024-04-02T07:34:04.906 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.906 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub load threshold = 5.0 2024-04-02T07:34:04.906 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub max interval = 600 2024-04-02T07:34:04.906 INFO:teuthology.orchestra.run.smithi106.stdout: osd mclock profile = high_recovery_ops 2024-04-02T07:34:04.906 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.906 INFO:teuthology.orchestra.run.smithi106.stdout: osd recover clone overlap = true 2024-04-02T07:34:04.906 INFO:teuthology.orchestra.run.smithi106.stdout: osd recovery max chunk = 1048576 2024-04-02T07:34:04.906 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.906 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug shutdown = true 2024-04-02T07:34:04.906 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug op order = true 2024-04-02T07:34:04.906 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify stray on activate = true 2024-04-02T07:34:04.906 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.906 INFO:teuthology.orchestra.run.smithi106.stdout: osd open classes on start = true 2024-04-02T07:34:04.907 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug pg log writeout = true 2024-04-02T07:34:04.907 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.907 INFO:teuthology.orchestra.run.smithi106.stdout: osd deep scrub update digest min age = 30 2024-04-02T07:34:04.907 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.907 INFO:teuthology.orchestra.run.smithi106.stdout: osd map max advance = 10 2024-04-02T07:34:04.907 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.907 INFO:teuthology.orchestra.run.smithi106.stdout: journal zero on create = true 2024-04-02T07:34:04.907 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.907 INFO:teuthology.orchestra.run.smithi106.stdout: filestore ondisk finisher threads = 3 2024-04-02T07:34:04.907 INFO:teuthology.orchestra.run.smithi106.stdout: filestore apply finisher threads = 3 2024-04-02T07:34:04.907 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.907 INFO:teuthology.orchestra.run.smithi106.stdout: bdev debug aio = true 2024-04-02T07:34:04.907 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug misdirected ops = true 2024-04-02T07:34:04.907 INFO:teuthology.orchestra.run.smithi106.stdout: bdev async discard = True 2024-04-02T07:34:04.907 INFO:teuthology.orchestra.run.smithi106.stdout: bdev enable discard = True 2024-04-02T07:34:04.908 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore allocator = bitmap 2024-04-02T07:34:04.908 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore block size = 96636764160 2024-04-02T07:34:04.908 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore fsck on mount = True 2024-04-02T07:34:04.908 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluefs = 1/20 2024-04-02T07:34:04.908 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluestore = 1/20 2024-04-02T07:34:04.908 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:34:04.908 INFO:teuthology.orchestra.run.smithi106.stdout: debug osd = 20 2024-04-02T07:34:04.908 INFO:teuthology.orchestra.run.smithi106.stdout: debug rocksdb = 4/10 2024-04-02T07:34:04.908 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd backfillfull_ratio = 0.85 2024-04-02T07:34:04.908 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd full ratio = 0.9 2024-04-02T07:34:04.908 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd nearfull ratio = 0.8 2024-04-02T07:34:04.908 INFO:teuthology.orchestra.run.smithi106.stdout: osd failsafe full ratio = 0.95 2024-04-02T07:34:04.908 INFO:teuthology.orchestra.run.smithi106.stdout: osd objectstore = bluestore 2024-04-02T07:34:04.908 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2024-04-02T07:34:04.909 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.909 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr] 2024-04-02T07:34:04.909 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:34:04.909 INFO:teuthology.orchestra.run.smithi106.stdout: debug mgr = 20 2024-04-02T07:34:04.909 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-04-02T07:34:04.909 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-04-02T07:34:04.909 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-04-02T07:34:04.909 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-04-02T07:34:04.909 INFO:teuthology.orchestra.run.smithi106.stdout: mgr/telemetry/nag = false 2024-04-02T07:34:04.909 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.909 INFO:teuthology.orchestra.run.smithi106.stdout:[mon] 2024-04-02T07:34:04.910 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:34:04.910 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-04-02T07:34:04.910 INFO:teuthology.orchestra.run.smithi106.stdout: debug paxos = 20 2024-04-02T07:34:04.910 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-04-02T07:34:04.910 INFO:teuthology.orchestra.run.smithi106.stdout: mon data avail warn = 5 2024-04-02T07:34:04.910 INFO:teuthology.orchestra.run.smithi106.stdout: mon mgr mkfs grace = 240 2024-04-02T07:34:04.910 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-04-02T07:34:04.910 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd reporter subtree level = osd 2024-04-02T07:34:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd prime pg temp = true 2024-04-02T07:34:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-04-02T07:34:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-02T07:34:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: auth mon ticket ttl = 660 # 11m 2024-04-02T07:34:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: auth service ticket ttl = 240 # 4m 2024-04-02T07:34:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: # don't complain about insecure global_id in the test suite 2024-04-02T07:34:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-02T07:34:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-02T07:34:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: # 1m isn't quite enough 2024-04-02T07:34:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: mon_down_mkfs_grace = 2m 2024-04-02T07:34:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_filestore_osds = false 2024-04-02T07:34:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: mon op complaint time = 120 2024-04-02T07:34:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:04.912 INFO:teuthology.orchestra.run.smithi106.stdout:[client] 2024-04-02T07:34:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: rgw cache enabled = true 2024-04-02T07:34:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable ops log = true 2024-04-02T07:34:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable usage log = true 2024-04-02T07:34:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-02T07:34:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-02T07:34:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: client mount timeout = 600 2024-04-02T07:34:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: debug client = 20 2024-04-02T07:34:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:34:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = "" 2024-04-02T07:34:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2024-04-02T07:34:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2024-04-02T07:34:04.913 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.a] 2024-04-02T07:34:04.913 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.b] 2024-04-02T07:34:04.913 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.c] 2024-04-02T07:34:04.913 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2024-04-02T07:34:04.913 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.c] 2024-04-02T07:34:04.913 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2024-04-02T07:34:04.913 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.d] 2024-04-02T07:34:04.913 INFO:teuthology.orchestra.run.smithi106.stdout:[mds] 2024-04-02T07:34:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds = 20 2024-04-02T07:34:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds balancer = 20 2024-04-02T07:34:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:34:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug frag = True 2024-04-02T07:34:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug scatterstat = True 2024-04-02T07:34:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: mds op complaint time = 180 2024-04-02T07:34:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: mds verify scatter = False 2024-04-02T07:34:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2024-04-02T07:34:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2024-04-02T07:34:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2024-04-02T07:34:04.919 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-02T07:34:04.967 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-02T07:34:05.006 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2024-04-02T07:34:05.006 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2024-04-02T07:34:05.006 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-02T07:34:05.006 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2024-04-02T07:34:05.006 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.007 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2024-04-02T07:34:05.007 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.007 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2024-04-02T07:34:05.007 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.007 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2024-04-02T07:34:05.007 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2024-04-02T07:34:05.007 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.007 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2024-04-02T07:34:05.007 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2024-04-02T07:34:05.007 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.007 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-02T07:34:05.007 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2024-04-02T07:34:05.007 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.007 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2024-04-02T07:34:05.007 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-02T07:34:05.008 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.008 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2024-04-02T07:34:05.008 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.008 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2024-04-02T07:34:05.008 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2024-04-02T07:34:05.008 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2024-04-02T07:34:05.008 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2024-04-02T07:34:05.008 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2024-04-02T07:34:05.008 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2024-04-02T07:34:05.008 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2024-04-02T07:34:05.008 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-02T07:34:05.008 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-02T07:34:05.008 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2024-04-02T07:34:05.008 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.008 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-02T07:34:05.009 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.009 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2024-04-02T07:34:05.009 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.009 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2024-04-02T07:34:05.009 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.009 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2024-04-02T07:34:05.009 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2024-04-02T07:34:05.009 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2024-04-02T07:34:05.009 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.55,172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790]" 2024-04-02T07:34:05.009 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = 642a0456-a2ac-49a4-91a5-3b3449b512da 2024-04-02T07:34:05.009 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.009 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2024-04-02T07:34:05.009 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2024-04-02T07:34:05.009 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.009 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2024-04-02T07:34:05.010 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2024-04-02T07:34:05.010 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2024-04-02T07:34:05.010 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.010 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2024-04-02T07:34:05.010 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2024-04-02T07:34:05.010 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.010 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2024-04-02T07:34:05.010 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2024-04-02T07:34:05.010 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2024-04-02T07:34:05.010 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.010 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2024-04-02T07:34:05.010 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2024-04-02T07:34:05.010 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.010 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2024-04-02T07:34:05.011 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.011 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2024-04-02T07:34:05.011 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.011 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2024-04-02T07:34:05.011 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.011 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2024-04-02T07:34:05.011 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2024-04-02T07:34:05.011 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.011 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2024-04-02T07:34:05.011 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2024-04-02T07:34:05.011 INFO:teuthology.orchestra.run.smithi055.stdout: bdev async discard = True 2024-04-02T07:34:05.011 INFO:teuthology.orchestra.run.smithi055.stdout: bdev enable discard = True 2024-04-02T07:34:05.011 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore allocator = bitmap 2024-04-02T07:34:05.011 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2024-04-02T07:34:05.011 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2024-04-02T07:34:05.012 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 1/20 2024-04-02T07:34:05.012 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 1/20 2024-04-02T07:34:05.012 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:34:05.012 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2024-04-02T07:34:05.012 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 4/10 2024-04-02T07:34:05.012 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2024-04-02T07:34:05.012 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2024-04-02T07:34:05.012 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2024-04-02T07:34:05.012 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2024-04-02T07:34:05.012 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2024-04-02T07:34:05.012 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-02T07:34:05.012 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.012 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2024-04-02T07:34:05.012 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:34:05.012 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2024-04-02T07:34:05.013 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-02T07:34:05.013 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-02T07:34:05.013 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-02T07:34:05.013 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-02T07:34:05.013 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2024-04-02T07:34:05.013 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.013 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2024-04-02T07:34:05.013 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:34:05.013 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-02T07:34:05.013 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2024-04-02T07:34:05.013 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-02T07:34:05.013 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2024-04-02T07:34:05.013 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2024-04-02T07:34:05.013 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-02T07:34:05.013 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2024-04-02T07:34:05.014 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2024-04-02T07:34:05.014 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-02T07:34:05.014 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.014 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-02T07:34:05.014 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2024-04-02T07:34:05.014 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2024-04-02T07:34:05.014 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.014 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2024-04-02T07:34:05.014 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-02T07:34:05.014 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-02T07:34:05.014 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.014 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2024-04-02T07:34:05.014 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2024-04-02T07:34:05.014 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.014 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2024-04-02T07:34:05.015 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2024-04-02T07:34:05.015 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:05.015 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2024-04-02T07:34:05.015 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2024-04-02T07:34:05.015 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2024-04-02T07:34:05.015 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2024-04-02T07:34:05.015 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-02T07:34:05.015 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-02T07:34:05.015 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2024-04-02T07:34:05.015 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2024-04-02T07:34:05.015 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:34:05.015 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2024-04-02T07:34:05.015 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-02T07:34:05.015 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-02T07:34:05.016 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2024-04-02T07:34:05.016 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2024-04-02T07:34:05.016 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2024-04-02T07:34:05.016 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-04-02T07:34:05.016 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-04-02T07:34:05.016 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-04-02T07:34:05.016 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-04-02T07:34:05.016 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2024-04-02T07:34:05.016 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2024-04-02T07:34:05.016 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2024-04-02T07:34:05.016 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:34:05.016 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2024-04-02T07:34:05.016 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = False 2024-04-02T07:34:05.016 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2024-04-02T07:34:05.017 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = False 2024-04-02T07:34:05.017 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-02T07:34:05.017 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-02T07:34:05.017 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-02T07:34:05.017 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2024-04-02T07:34:05.017 INFO:teuthology.orchestra.run.smithi106.stdout: chdir = "" 2024-04-02T07:34:05.017 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-02T07:34:05.017 INFO:teuthology.orchestra.run.smithi106.stdout: auth supported = cephx 2024-04-02T07:34:05.018 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.018 INFO:teuthology.orchestra.run.smithi106.stdout: filestore xattr use omap = true 2024-04-02T07:34:05.018 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.018 INFO:teuthology.orchestra.run.smithi106.stdout: mon clock drift allowed = 1.000 2024-04-02T07:34:05.018 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.018 INFO:teuthology.orchestra.run.smithi106.stdout: osd crush chooseleaf type = 0 2024-04-02T07:34:05.018 INFO:teuthology.orchestra.run.smithi106.stdout: auth debug = true 2024-04-02T07:34:05.018 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.018 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on old message = true 2024-04-02T07:34:05.018 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on bug = true 2024-04-02T07:34:05.018 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.018 INFO:teuthology.orchestra.run.smithi106.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-02T07:34:05.018 INFO:teuthology.orchestra.run.smithi106.stdout: mon pg warn max object skew = 0 2024-04-02T07:34:05.018 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.019 INFO:teuthology.orchestra.run.smithi106.stdout: # disable pg_autoscaler by default for new pools 2024-04-02T07:34:05.019 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-02T07:34:05.019 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.019 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default size = 2 2024-04-02T07:34:05.019 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.019 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow primary affinity = true 2024-04-02T07:34:05.019 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow pg remap = true 2024-04-02T07:34:05.019 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on legacy crush tunables = false 2024-04-02T07:34:05.019 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on crush straw calc version zero = false 2024-04-02T07:34:05.019 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on no sortbitwise = false 2024-04-02T07:34:05.019 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on osd down out interval zero = false 2024-04-02T07:34:05.019 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on too few osds = false 2024-04-02T07:34:05.019 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-02T07:34:05.020 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-02T07:34:05.020 INFO:teuthology.orchestra.run.smithi106.stdout: mon_allow_pool_size_one = true 2024-04-02T07:34:05.020 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.020 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-02T07:34:05.020 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.020 INFO:teuthology.orchestra.run.smithi106.stdout: osd default data pool replay window = 5 2024-04-02T07:34:05.020 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.020 INFO:teuthology.orchestra.run.smithi106.stdout: mon allow pool delete = true 2024-04-02T07:34:05.020 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.020 INFO:teuthology.orchestra.run.smithi106.stdout: mon cluster log file level = debug 2024-04-02T07:34:05.020 INFO:teuthology.orchestra.run.smithi106.stdout: debug asserts on shutdown = true 2024-04-02T07:34:05.020 INFO:teuthology.orchestra.run.smithi106.stdout: mon health detail to clog = false 2024-04-02T07:34:05.020 INFO:teuthology.orchestra.run.smithi106.stdout: mon host = "172.21.15.55,172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790]" 2024-04-02T07:34:05.020 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = 642a0456-a2ac-49a4-91a5-3b3449b512da 2024-04-02T07:34:05.021 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.021 INFO:teuthology.orchestra.run.smithi106.stdout:[osd] 2024-04-02T07:34:05.021 INFO:teuthology.orchestra.run.smithi106.stdout: osd journal size = 100 2024-04-02T07:34:05.021 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.021 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub load threshold = 5.0 2024-04-02T07:34:05.021 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub max interval = 600 2024-04-02T07:34:05.021 INFO:teuthology.orchestra.run.smithi106.stdout: osd mclock profile = high_recovery_ops 2024-04-02T07:34:05.021 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.021 INFO:teuthology.orchestra.run.smithi106.stdout: osd recover clone overlap = true 2024-04-02T07:34:05.021 INFO:teuthology.orchestra.run.smithi106.stdout: osd recovery max chunk = 1048576 2024-04-02T07:34:05.021 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.022 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug shutdown = true 2024-04-02T07:34:05.022 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug op order = true 2024-04-02T07:34:05.022 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify stray on activate = true 2024-04-02T07:34:05.022 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.022 INFO:teuthology.orchestra.run.smithi106.stdout: osd open classes on start = true 2024-04-02T07:34:05.022 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug pg log writeout = true 2024-04-02T07:34:05.022 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.022 INFO:teuthology.orchestra.run.smithi106.stdout: osd deep scrub update digest min age = 30 2024-04-02T07:34:05.022 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.022 INFO:teuthology.orchestra.run.smithi106.stdout: osd map max advance = 10 2024-04-02T07:34:05.022 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.022 INFO:teuthology.orchestra.run.smithi106.stdout: journal zero on create = true 2024-04-02T07:34:05.022 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.023 INFO:teuthology.orchestra.run.smithi106.stdout: filestore ondisk finisher threads = 3 2024-04-02T07:34:05.023 INFO:teuthology.orchestra.run.smithi106.stdout: filestore apply finisher threads = 3 2024-04-02T07:34:05.023 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.023 INFO:teuthology.orchestra.run.smithi106.stdout: bdev debug aio = true 2024-04-02T07:34:05.023 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug misdirected ops = true 2024-04-02T07:34:05.023 INFO:teuthology.orchestra.run.smithi106.stdout: bdev async discard = True 2024-04-02T07:34:05.023 INFO:teuthology.orchestra.run.smithi106.stdout: bdev enable discard = True 2024-04-02T07:34:05.023 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore allocator = bitmap 2024-04-02T07:34:05.023 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore block size = 96636764160 2024-04-02T07:34:05.023 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore fsck on mount = True 2024-04-02T07:34:05.023 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluefs = 1/20 2024-04-02T07:34:05.023 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluestore = 1/20 2024-04-02T07:34:05.023 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:34:05.023 INFO:teuthology.orchestra.run.smithi106.stdout: debug osd = 20 2024-04-02T07:34:05.024 INFO:teuthology.orchestra.run.smithi106.stdout: debug rocksdb = 4/10 2024-04-02T07:34:05.024 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd backfillfull_ratio = 0.85 2024-04-02T07:34:05.024 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd full ratio = 0.9 2024-04-02T07:34:05.024 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd nearfull ratio = 0.8 2024-04-02T07:34:05.024 INFO:teuthology.orchestra.run.smithi106.stdout: osd failsafe full ratio = 0.95 2024-04-02T07:34:05.024 INFO:teuthology.orchestra.run.smithi106.stdout: osd objectstore = bluestore 2024-04-02T07:34:05.024 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2024-04-02T07:34:05.024 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.024 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr] 2024-04-02T07:34:05.024 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:34:05.024 INFO:teuthology.orchestra.run.smithi106.stdout: debug mgr = 20 2024-04-02T07:34:05.024 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-04-02T07:34:05.024 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-04-02T07:34:05.024 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-04-02T07:34:05.024 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-04-02T07:34:05.025 INFO:teuthology.orchestra.run.smithi106.stdout: mgr/telemetry/nag = false 2024-04-02T07:34:05.025 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.025 INFO:teuthology.orchestra.run.smithi106.stdout:[mon] 2024-04-02T07:34:05.025 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:34:05.025 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-04-02T07:34:05.025 INFO:teuthology.orchestra.run.smithi106.stdout: debug paxos = 20 2024-04-02T07:34:05.025 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-04-02T07:34:05.025 INFO:teuthology.orchestra.run.smithi106.stdout: mon data avail warn = 5 2024-04-02T07:34:05.025 INFO:teuthology.orchestra.run.smithi106.stdout: mon mgr mkfs grace = 240 2024-04-02T07:34:05.025 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-04-02T07:34:05.025 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd reporter subtree level = osd 2024-04-02T07:34:05.025 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd prime pg temp = true 2024-04-02T07:34:05.025 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-04-02T07:34:05.025 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.025 INFO:teuthology.orchestra.run.smithi106.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-02T07:34:05.026 INFO:teuthology.orchestra.run.smithi106.stdout: auth mon ticket ttl = 660 # 11m 2024-04-02T07:34:05.026 INFO:teuthology.orchestra.run.smithi106.stdout: auth service ticket ttl = 240 # 4m 2024-04-02T07:34:05.026 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.026 INFO:teuthology.orchestra.run.smithi106.stdout: # don't complain about insecure global_id in the test suite 2024-04-02T07:34:05.026 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-02T07:34:05.026 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-02T07:34:05.026 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.026 INFO:teuthology.orchestra.run.smithi106.stdout: # 1m isn't quite enough 2024-04-02T07:34:05.026 INFO:teuthology.orchestra.run.smithi106.stdout: mon_down_mkfs_grace = 2m 2024-04-02T07:34:05.026 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.026 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_filestore_osds = false 2024-04-02T07:34:05.026 INFO:teuthology.orchestra.run.smithi106.stdout: mon op complaint time = 120 2024-04-02T07:34:05.026 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:05.026 INFO:teuthology.orchestra.run.smithi106.stdout:[client] 2024-04-02T07:34:05.027 INFO:teuthology.orchestra.run.smithi106.stdout: rgw cache enabled = true 2024-04-02T07:34:05.027 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable ops log = true 2024-04-02T07:34:05.027 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable usage log = true 2024-04-02T07:34:05.027 INFO:teuthology.orchestra.run.smithi106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-02T07:34:05.027 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-02T07:34:05.027 INFO:teuthology.orchestra.run.smithi106.stdout: client mount timeout = 600 2024-04-02T07:34:05.027 INFO:teuthology.orchestra.run.smithi106.stdout: debug client = 20 2024-04-02T07:34:05.027 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:34:05.027 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = "" 2024-04-02T07:34:05.027 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2024-04-02T07:34:05.027 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2024-04-02T07:34:05.027 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.a] 2024-04-02T07:34:05.027 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.b] 2024-04-02T07:34:05.028 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.c] 2024-04-02T07:34:05.028 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2024-04-02T07:34:05.028 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.c] 2024-04-02T07:34:05.028 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2024-04-02T07:34:05.028 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.d] 2024-04-02T07:34:05.028 INFO:teuthology.orchestra.run.smithi106.stdout:[mds] 2024-04-02T07:34:05.028 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds = 20 2024-04-02T07:34:05.028 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds balancer = 20 2024-04-02T07:34:05.028 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:34:05.028 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug frag = True 2024-04-02T07:34:05.028 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug scatterstat = False 2024-04-02T07:34:05.028 INFO:teuthology.orchestra.run.smithi106.stdout: mds op complaint time = 180 2024-04-02T07:34:05.028 INFO:teuthology.orchestra.run.smithi106.stdout: mds verify scatter = False 2024-04-02T07:34:05.028 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2024-04-02T07:34:05.028 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2024-04-02T07:34:05.029 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2024-04-02T07:34:05.030 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_metadata rmomapkey 10000000001.00000000 bravo_head 2024-04-02T07:34:05.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.119+0000 7f12eb447080 1 Processor -- start 2024-04-02T07:34:05.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.119+0000 7f12eb447080 1 -- start start 2024-04-02T07:34:05.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.119+0000 7f12eb447080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55642085c300 0x556420832b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:05.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.119+0000 7f12eb447080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55642085c6e0 0x556420877160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:05.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.119+0000 7f12eb447080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55642085f280 0x5564208fe730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:05.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.119+0000 7f12eb447080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x556420776960 con 0x55642085c6e0 2024-04-02T07:34:05.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.119+0000 7f12eb447080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x556420776600 con 0x55642085c300 2024-04-02T07:34:05.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.119+0000 7f12eb447080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55642076d690 con 0x55642085f280 2024-04-02T07:34:05.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.119+0000 7f12e7000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55642085c6e0 0x556420877160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:05.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.119+0000 7f12e7000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55642085c6e0 0x556420877160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44314/0 (socket says 172.21.15.55:44314) 2024-04-02T07:34:05.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.119+0000 7f12e7000640 1 -- 172.21.15.55:0/3254913801 learned_addr learned my addr 172.21.15.55:0/3254913801 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:05.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.119+0000 7f12e8400640 1 --2- 172.21.15.55:0/3254913801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55642085f280 0x5564208fe730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:05.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.119+0000 7f12e7a00640 1 --2- 172.21.15.55:0/3254913801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55642085c300 0x556420832b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:05.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.119+0000 7f12e7000640 1 -- 172.21.15.55:0/3254913801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55642085f280 msgr2=0x5564208fe730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:05.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.119+0000 7f12e7000640 1 --2- 172.21.15.55:0/3254913801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55642085f280 0x5564208fe730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:05.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.119+0000 7f12e7000640 1 -- 172.21.15.55:0/3254913801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55642085c300 msgr2=0x556420832b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:05.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.119+0000 7f12e7000640 1 --2- 172.21.15.55:0/3254913801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55642085c300 0x556420832b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:05.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.119+0000 7f12e7000640 1 -- 172.21.15.55:0/3254913801 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d4005df0 con 0x55642085c6e0 2024-04-02T07:34:05.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.119+0000 7f12e8400640 1 --2- 172.21.15.55:0/3254913801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55642085f280 0x5564208fe730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:05.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.119+0000 7f12e7a00640 1 --2- 172.21.15.55:0/3254913801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55642085c300 0x556420832b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:05.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12e7000640 1 --2- 172.21.15.55:0/3254913801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55642085c6e0 0x556420877160 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f12d40af040 tx=0x7f12d4003030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8527611da44d5ff server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:05.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12e5c00640 1 -- 172.21.15.55:0/3254913801 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d40a5b80 con 0x55642085c6e0 2024-04-02T07:34:05.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12e5c00640 1 -- 172.21.15.55:0/3254913801 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d40a5ce0 con 0x55642085c6e0 2024-04-02T07:34:05.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12e5c00640 1 -- 172.21.15.55:0/3254913801 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d40b7670 con 0x55642085c6e0 2024-04-02T07:34:05.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12eb447080 1 -- 172.21.15.55:0/3254913801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55642085c6e0 msgr2=0x556420877160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:05.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12eb447080 1 --2- 172.21.15.55:0/3254913801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55642085c6e0 0x556420877160 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f12d40af040 tx=0x7f12d4003030 comp rx=0 tx=0).stop 2024-04-02T07:34:05.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12eb447080 1 -- 172.21.15.55:0/3254913801 shutdown_connections 2024-04-02T07:34:05.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12eb447080 1 --2- 172.21.15.55:0/3254913801 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55642085f280 0x5564208fe730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:05.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12eb447080 1 --2- 172.21.15.55:0/3254913801 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55642085c6e0 0x556420877160 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:05.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12eb447080 1 --2- 172.21.15.55:0/3254913801 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55642085c300 0x556420832b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:05.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12eb447080 1 -- 172.21.15.55:0/3254913801 >> 172.21.15.55:0/3254913801 conn(0x55642085d2f0 msgr2=0x55642082f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:05.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12eb447080 1 -- 172.21.15.55:0/3254913801 shutdown_connections 2024-04-02T07:34:05.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12eb447080 1 -- 172.21.15.55:0/3254913801 wait complete. 2024-04-02T07:34:05.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12eb447080 1 Processor -- start 2024-04-02T07:34:05.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12eb447080 1 -- start start 2024-04-02T07:34:05.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12eb447080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55642085c300 0x556420907200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:05.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12eb447080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55642085c6e0 0x5564208fdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:05.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12eb447080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55642085f280 0x55642082f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:05.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12eb447080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564208fe4d0 con 0x55642085f280 2024-04-02T07:34:05.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12eb447080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564209078a0 con 0x55642085c300 2024-04-02T07:34:05.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12eb447080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x556420907b40 con 0x55642085c6e0 2024-04-02T07:34:05.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12e8400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55642085f280 0x55642082f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:05.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12e7a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55642085c300 0x556420907200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:05.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12e8400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55642085f280 0x55642082f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44326/0 (socket says 172.21.15.55:44326) 2024-04-02T07:34:05.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12e7000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55642085c6e0 0x5564208fdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:05.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12e8400640 1 -- 172.21.15.55:0/1960810441 learned_addr learned my addr 172.21.15.55:0/1960810441 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:05.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12e8400640 1 -- 172.21.15.55:0/1960810441 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55642085c6e0 msgr2=0x5564208fdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:05.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12e8400640 1 --2- 172.21.15.55:0/1960810441 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55642085c6e0 0x5564208fdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:05.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12e8400640 1 -- 172.21.15.55:0/1960810441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55642085c300 msgr2=0x556420907200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:05.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12e8400640 1 --2- 172.21.15.55:0/1960810441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55642085c300 0x556420907200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:05.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.123+0000 7f12e8400640 1 -- 172.21.15.55:0/1960810441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55642079fa60 con 0x55642085f280 2024-04-02T07:34:05.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.127+0000 7f12e8400640 1 --2- 172.21.15.55:0/1960810441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55642085f280 0x55642082f850 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f12e000e1e0 tx=0x7f12e000e6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:05.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.127+0000 7f12dfe00640 1 -- 172.21.15.55:0/1960810441 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0013870 con 0x55642085f280 2024-04-02T07:34:05.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.127+0000 7f12dfe00640 1 -- 172.21.15.55:0/1960810441 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12e00139f0 con 0x55642085f280 2024-04-02T07:34:05.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.127+0000 7f12dfe00640 1 -- 172.21.15.55:0/1960810441 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12e0013da0 con 0x55642085f280 2024-04-02T07:34:05.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.127+0000 7f12eb447080 1 -- 172.21.15.55:0/1960810441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5564207858c0 con 0x55642085f280 2024-04-02T07:34:05.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.127+0000 7f12eb447080 1 -- 172.21.15.55:0/1960810441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556420778d00 con 0x55642085f280 2024-04-02T07:34:05.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.127+0000 7f12dfe00640 1 -- 172.21.15.55:0/1960810441 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f12e0014410 con 0x55642085f280 2024-04-02T07:34:05.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.127+0000 7f12dfe00640 1 --2- 172.21.15.55:0/1960810441 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f12c80650a0 0x7f12c8067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:05.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.127+0000 7f12dfe00640 1 -- 172.21.15.55:0/1960810441 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f12e0083360 con 0x55642085f280 2024-04-02T07:34:05.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.127+0000 7f12eb447080 1 --2- 172.21.15.55:0/1960810441 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55642082fd90 0x5564209083a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:05.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.127+0000 7f12eb447080 1 -- 172.21.15.55:0/1960810441 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:1 16.7 16:e2e07930:::10000000001.00000000:head [omap-rm-keys in=18b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e119) v8 -- 0x5564209088e0 con 0x55642082fd90 2024-04-02T07:34:05.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.127+0000 7f12e7a00640 1 --2- 172.21.15.55:0/1960810441 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f12c80650a0 0x7f12c8067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:05.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.131+0000 7f12e7000640 1 --2- 172.21.15.55:0/1960810441 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55642082fd90 0x5564209083a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:05.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.131+0000 7f12e7a00640 1 --2- 172.21.15.55:0/1960810441 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f12c80650a0 0x7f12c8067560 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f12d800f530 tx=0x7f12d8001850 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.131+0000 7f12e7000640 1 --2- 172.21.15.55:0/1960810441 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55642082fd90 0x5564209083a0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.131+0000 7f12e7000640 1 -- 172.21.15.55:0/1960810441 <== osd.3 v2:172.21.15.55:6824/27393 1 ==== osd_op_reply(1 10000000001.00000000 [omap-rm-keys] v119'5 uv5 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x7f12d40a5980 con 0x55642082fd90 2024-04-02T07:34:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.131+0000 7f12eb447080 1 -- 172.21.15.55:0/1960810441 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55642082fd90 msgr2=0x5564209083a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.131+0000 7f12eb447080 1 --2- 172.21.15.55:0/1960810441 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55642082fd90 0x5564209083a0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.131+0000 7f12eb447080 1 -- 172.21.15.55:0/1960810441 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f12c80650a0 msgr2=0x7f12c8067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.131+0000 7f12eb447080 1 --2- 172.21.15.55:0/1960810441 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f12c80650a0 0x7f12c8067560 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f12d800f530 tx=0x7f12d8001850 comp rx=0 tx=0).stop 2024-04-02T07:34:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.131+0000 7f12eb447080 1 -- 172.21.15.55:0/1960810441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55642085f280 msgr2=0x55642082f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.131+0000 7f12eb447080 1 --2- 172.21.15.55:0/1960810441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55642085f280 0x55642082f850 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f12e000e1e0 tx=0x7f12e000e6a0 comp rx=0 tx=0).stop 2024-04-02T07:34:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.131+0000 7f12e8400640 1 -- 172.21.15.55:0/1960810441 reap_dead start 2024-04-02T07:34:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.131+0000 7f12eb447080 1 -- 172.21.15.55:0/1960810441 shutdown_connections 2024-04-02T07:34:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.131+0000 7f12eb447080 1 -- 172.21.15.55:0/1960810441 >> 172.21.15.55:0/1960810441 conn(0x55642085d2f0 msgr2=0x556420903100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.131+0000 7f12eb447080 1 -- 172.21.15.55:0/1960810441 shutdown_connections 2024-04-02T07:34:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.131+0000 7f12eb447080 1 -- 172.21.15.55:0/1960810441 wait complete. 2024-04-02T07:34:05.136 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-02T07:34:05.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.279+0000 7f9b3f200640 1 Processor -- start 2024-04-02T07:34:05.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.279+0000 7f9b3f200640 1 -- start start 2024-04-02T07:34:05.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.279+0000 7f9b3f200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f9b380ade90 0x7f9b3806d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:05.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.279+0000 7f9b3f200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9b380b41a0 0x7f9b38142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:05.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.279+0000 7f9b3f200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b3806c630 con 0x7f9b380b3dc0 2024-04-02T07:34:05.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.279+0000 7f9b3f200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b380cae80 con 0x7f9b380b41a0 2024-04-02T07:34:05.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.279+0000 7f9b3f200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b3806c8f0 con 0x7f9b380ade90 2024-04-02T07:34:05.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.283+0000 7f9b3d200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9b380b41a0 0x7f9b38142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:05.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.283+0000 7f9b3d200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9b380b41a0 0x7f9b38142ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44338/0 (socket says 172.21.15.55:44338) 2024-04-02T07:34:05.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.283+0000 7f9b37e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9b380b3dc0 0x7f9b380ca770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54216/0 (socket says 172.21.15.55:54216) 2024-04-02T07:34:05.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.283+0000 7f9b3d200640 1 -- 172.21.15.55:0/2379384692 learned_addr learned my addr 172.21.15.55:0/2379384692 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:05.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.283+0000 7f9b2f400640 1 --2- 172.21.15.55:0/2379384692 >> v2:172.21.15.106:3300/0 conn(0x7f9b380ade90 0x7f9b3806d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:05.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.283+0000 7f9b3d200640 1 -- 172.21.15.55:0/2379384692 >> v2:172.21.15.106:3300/0 conn(0x7f9b380ade90 msgr2=0x7f9b3806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:05.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.283+0000 7f9b3d200640 1 --2- 172.21.15.55:0/2379384692 >> v2:172.21.15.106:3300/0 conn(0x7f9b380ade90 0x7f9b3806d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:05.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.283+0000 7f9b3d200640 1 -- 172.21.15.55:0/2379384692 >> v1:172.21.15.55:6789/0 conn(0x7f9b380b3dc0 legacy=0x7f9b380ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:05.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.283+0000 7f9b3d200640 1 -- 172.21.15.55:0/2379384692 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3806cbd0 con 0x7f9b380b41a0 2024-04-02T07:34:05.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.283+0000 7f9b37400640 1 -- 172.21.15.55:0/2379384692 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1531001905 0 0) 0x7f9b3806c630 con 0x7f9b380b3dc0 2024-04-02T07:34:05.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.283+0000 7f9b3d200640 1 --2- 172.21.15.55:0/2379384692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b380b41a0 0x7f9b38142ac0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f9b3806c820 tx=0x7f9b3001eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52270149b4f0569c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:05.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.283+0000 7f9b37400640 1 -- 172.21.15.55:0/2379384692 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b300a7b80 con 0x7f9b380b41a0 2024-04-02T07:34:05.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.283+0000 7f9b37400640 1 -- 172.21.15.55:0/2379384692 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b300a7ce0 con 0x7f9b380b41a0 2024-04-02T07:34:05.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.283+0000 7f9b37400640 1 -- 172.21.15.55:0/2379384692 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b300af660 con 0x7f9b380b41a0 2024-04-02T07:34:05.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b3f200640 1 -- 172.21.15.55:0/2379384692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b380b41a0 msgr2=0x7f9b38142ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:05.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b3f200640 1 --2- 172.21.15.55:0/2379384692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b380b41a0 0x7f9b38142ac0 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f9b3806c820 tx=0x7f9b3001eba0 comp rx=0 tx=0).stop 2024-04-02T07:34:05.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b3f200640 1 -- 172.21.15.55:0/2379384692 shutdown_connections 2024-04-02T07:34:05.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b3f200640 1 --2- 172.21.15.55:0/2379384692 >> v2:172.21.15.106:3300/0 conn(0x7f9b380ade90 0x7f9b3806d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:05.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b3f200640 1 --2- 172.21.15.55:0/2379384692 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b380b41a0 0x7f9b38142ac0 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:05.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b3f200640 1 -- 172.21.15.55:0/2379384692 >> 172.21.15.55:0/2379384692 conn(0x7f9b3806a390 msgr2=0x7f9b380b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:05.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b3f200640 1 -- 172.21.15.55:0/2379384692 shutdown_connections 2024-04-02T07:34:05.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b3f200640 1 -- 172.21.15.55:0/2379384692 wait complete. 2024-04-02T07:34:05.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b3f200640 1 Processor -- start 2024-04-02T07:34:05.286 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b3f200640 1 -- start start 2024-04-02T07:34:05.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b3f200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b380ade90 0x7f9b38135e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:05.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b3f200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b380b3dc0 0x7f9b3814fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:05.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b3f200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9b380b41a0 0x7f9b3814ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:05.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b3f200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b380af540 con 0x7f9b380ade90 2024-04-02T07:34:05.288 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b3f200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b38151860 con 0x7f9b380b3dc0 2024-04-02T07:34:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b3f200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b38138f90 con 0x7f9b380b41a0 2024-04-02T07:34:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b37e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b380ade90 0x7f9b38135e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b37e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b380ade90 0x7f9b38135e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44342/0 (socket says 172.21.15.55:44342) 2024-04-02T07:34:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b37e00640 1 -- 172.21.15.55:0/1934972347 learned_addr learned my addr 172.21.15.55:0/1934972347 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b2f400640 1 --2- 172.21.15.55:0/1934972347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b380b3dc0 0x7f9b3814fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b3d200640 1 --2- 172.21.15.55:0/1934972347 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9b380b41a0 0x7f9b3814ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b37e00640 1 -- 172.21.15.55:0/1934972347 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9b380b41a0 msgr2=0x7f9b3814ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b37e00640 1 --2- 172.21.15.55:0/1934972347 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9b380b41a0 0x7f9b3814ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b37e00640 1 -- 172.21.15.55:0/1934972347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b380b3dc0 msgr2=0x7f9b3814fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b37e00640 1 --2- 172.21.15.55:0/1934972347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b380b3dc0 0x7f9b3814fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.287+0000 7f9b37e00640 1 -- 172.21.15.55:0/1934972347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b3000b770 con 0x7f9b380ade90 2024-04-02T07:34:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.291+0000 7f9b37e00640 1 --2- 172.21.15.55:0/1934972347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b380ade90 0x7f9b38135e10 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f9b28001570 tx=0x7f9b2800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:05.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.291+0000 7f9b34c00640 1 -- 172.21.15.55:0/1934972347 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2800a640 con 0x7f9b380ade90 2024-04-02T07:34:05.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.291+0000 7f9b34c00640 1 -- 172.21.15.55:0/1934972347 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2800a7c0 con 0x7f9b380ade90 2024-04-02T07:34:05.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.291+0000 7f9b34c00640 1 -- 172.21.15.55:0/1934972347 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2800ab70 con 0x7f9b380ade90 2024-04-02T07:34:05.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.291+0000 7f9b3f200640 1 -- 172.21.15.55:0/1934972347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b3806de00 con 0x7f9b380ade90 2024-04-02T07:34:05.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.291+0000 7f9b3f200640 1 -- 172.21.15.55:0/1934972347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b38139230 con 0x7f9b380ade90 2024-04-02T07:34:05.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.291+0000 7f9b3f200640 1 -- 172.21.15.55:0/1934972347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b38073530 con 0x7f9b380ade90 2024-04-02T07:34:05.290 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.291+0000 7f9b34c00640 1 -- 172.21.15.55:0/1934972347 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f9b2800acd0 con 0x7f9b380ade90 2024-04-02T07:34:05.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.291+0000 7f9b34c00640 1 --2- 172.21.15.55:0/1934972347 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9b140666e0 0x7f9b14068ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:05.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.291+0000 7f9b34c00640 1 -- 172.21.15.55:0/1934972347 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f9b28083c00 con 0x7f9b380ade90 2024-04-02T07:34:05.291 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.291+0000 7f9b2f400640 1 --2- 172.21.15.55:0/1934972347 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9b140666e0 0x7f9b14068ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:05.292 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.295+0000 7f9b2f400640 1 --2- 172.21.15.55:0/1934972347 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9b140666e0 0x7f9b14068ba0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f9b380b0580 tx=0x7f9b20008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:05.295 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.295+0000 7f9b34c00640 1 -- 172.21.15.55:0/1934972347 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f9b28050f50 con 0x7f9b380ade90 2024-04-02T07:34:05.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.495+0000 7f9b3f200640 1 -- 172.21.15.55:0/1934972347 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7f9b38139450 con 0x7f9b380ade90 2024-04-02T07:34:05.827 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.827+0000 7f9b34c00640 1 -- 172.21.15.55:0/1934972347 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v98) v1 ==== 162+0+0 (secure 0 0 0) 0x7f9b28018070 con 0x7f9b380ade90 2024-04-02T07:34:05.827 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-02T07:34:05.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.831+0000 7f9b3f200640 1 -- 172.21.15.55:0/1934972347 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9b140666e0 msgr2=0x7f9b14068ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:05.829 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.831+0000 7f9b3f200640 1 --2- 172.21.15.55:0/1934972347 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9b140666e0 0x7f9b14068ba0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f9b380b0580 tx=0x7f9b20008040 comp rx=0 tx=0).stop 2024-04-02T07:34:05.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.831+0000 7f9b3f200640 1 -- 172.21.15.55:0/1934972347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b380ade90 msgr2=0x7f9b38135e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:05.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.831+0000 7f9b3f200640 1 --2- 172.21.15.55:0/1934972347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b380ade90 0x7f9b38135e10 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f9b28001570 tx=0x7f9b2800cd20 comp rx=0 tx=0).stop 2024-04-02T07:34:05.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.831+0000 7f9b3f200640 1 -- 172.21.15.55:0/1934972347 shutdown_connections 2024-04-02T07:34:05.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.831+0000 7f9b3f200640 1 --2- 172.21.15.55:0/1934972347 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9b380b41a0 0x7f9b3814ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:05.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.831+0000 7f9b3f200640 1 --2- 172.21.15.55:0/1934972347 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9b140666e0 0x7f9b14068ba0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:05.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.831+0000 7f9b3f200640 1 --2- 172.21.15.55:0/1934972347 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9b380b3dc0 0x7f9b3814fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:05.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.831+0000 7f9b3f200640 1 --2- 172.21.15.55:0/1934972347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9b380ade90 0x7f9b38135e10 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:05.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.831+0000 7f9b3f200640 1 -- 172.21.15.55:0/1934972347 >> 172.21.15.55:0/1934972347 conn(0x7f9b3806a390 msgr2=0x7f9b38155390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:05.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.831+0000 7f9b3f200640 1 -- 172.21.15.55:0/1934972347 shutdown_connections 2024-04-02T07:34:05.830 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.831+0000 7f9b3f200640 1 -- 172.21.15.55:0/1934972347 wait complete. 2024-04-02T07:34:05.853 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:34:05.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.995+0000 7f561c200640 1 Processor -- start 2024-04-02T07:34:05.994 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.995+0000 7f561c200640 1 -- start start 2024-04-02T07:34:05.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.995+0000 7f561c200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56140cbef0 0x7f56140ae020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:05.995 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.995+0000 7f561c200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5614069e20 0x7f561406a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:05.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.995+0000 7f561c200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56140b3c50 con 0x7f561406db10 2024-04-02T07:34:05.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.995+0000 7f561c200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5614071410 con 0x7f56140cbef0 2024-04-02T07:34:05.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.995+0000 7f561c200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5614070790 con 0x7f5614069e20 2024-04-02T07:34:05.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.995+0000 7f5618e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56140cbef0 0x7f56140ae020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:05.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.995+0000 7f5618e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f56140cbef0 0x7f56140ae020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57440/0 (socket says 172.21.15.55:57440) 2024-04-02T07:34:05.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.995+0000 7f5618e00640 1 -- 172.21.15.55:0/2240027403 learned_addr learned my addr 172.21.15.55:0/2240027403 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:05.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.995+0000 7f561a200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5614069e20 0x7f561406a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:05.996 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.995+0000 7f5618e00640 1 -- 172.21.15.55:0/2240027403 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5614069e20 msgr2=0x7f561406a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:05.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.999+0000 7f5618e00640 1 --2- 172.21.15.55:0/2240027403 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5614069e20 0x7f561406a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:05.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.999+0000 7f5618e00640 1 -- 172.21.15.55:0/2240027403 >> v1:172.21.15.106:6789/0 conn(0x7f561406db10 legacy=0x7f561406def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:05.997 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.999+0000 7f5618e00640 1 -- 172.21.15.55:0/2240027403 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5614070a70 con 0x7f56140cbef0 2024-04-02T07:34:05.998 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.999+0000 7f5618e00640 1 --2- 172.21.15.55:0/2240027403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56140cbef0 0x7f56140ae020 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f5600009870 tx=0x7f560001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b00b92facfb826a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:05.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.999+0000 7f5613e00640 1 -- 172.21.15.55:0/2240027403 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56000ab610 con 0x7f56140cbef0 2024-04-02T07:34:05.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.999+0000 7f5613e00640 1 -- 172.21.15.55:0/2240027403 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56000ab770 con 0x7f56140cbef0 2024-04-02T07:34:05.999 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.999+0000 7f5613e00640 1 -- 172.21.15.55:0/2240027403 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56000abb00 con 0x7f56140cbef0 2024-04-02T07:34:06.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.999+0000 7f561c200640 1 -- 172.21.15.55:0/2240027403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56140cbef0 msgr2=0x7f56140ae020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:06.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.999+0000 7f561c200640 1 --2- 172.21.15.55:0/2240027403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56140cbef0 0x7f56140ae020 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7f5600009870 tx=0x7f560001c410 comp rx=0 tx=0).stop 2024-04-02T07:34:06.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.999+0000 7f561c200640 1 -- 172.21.15.55:0/2240027403 shutdown_connections 2024-04-02T07:34:06.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.999+0000 7f561c200640 1 --2- 172.21.15.55:0/2240027403 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5614069e20 0x7f561406a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:06.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.999+0000 7f561c200640 1 --2- 172.21.15.55:0/2240027403 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f56140cbef0 0x7f56140ae020 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:06.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.999+0000 7f561c200640 1 -- 172.21.15.55:0/2240027403 >> 172.21.15.55:0/2240027403 conn(0x7f56140cb3d0 msgr2=0x7f56140cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:06.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.999+0000 7f561c200640 1 -- 172.21.15.55:0/2240027403 shutdown_connections 2024-04-02T07:34:06.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:05.999+0000 7f561c200640 1 -- 172.21.15.55:0/2240027403 wait complete. 2024-04-02T07:34:06.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f561c200640 1 Processor -- start 2024-04-02T07:34:06.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f561c200640 1 -- start start 2024-04-02T07:34:06.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f561c200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5614069e20 0x7f5614153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:06.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f561c200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f561406db10 0x7f56140ad560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:06.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f561c200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56140cbef0 0x7f561415f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:06.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f561c200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56141541d0 con 0x7f5614069e20 2024-04-02T07:34:06.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f561c200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56140ac4c0 con 0x7f561406db10 2024-04-02T07:34:06.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f561c200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56140ac7a0 con 0x7f56140cbef0 2024-04-02T07:34:06.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f5619800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5614069e20 0x7f5614153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:06.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f5619800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5614069e20 0x7f5614153c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57442/0 (socket says 172.21.15.55:57442) 2024-04-02T07:34:06.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f5619800640 1 -- 172.21.15.55:0/77065913 learned_addr learned my addr 172.21.15.55:0/77065913 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:06.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f561a200640 1 --2- 172.21.15.55:0/77065913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56140cbef0 0x7f561415f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:06.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f5618e00640 1 --2- 172.21.15.55:0/77065913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f561406db10 0x7f56140ad560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:06.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f5619800640 1 -- 172.21.15.55:0/77065913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56140cbef0 msgr2=0x7f561415f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:06.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f5619800640 1 --2- 172.21.15.55:0/77065913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56140cbef0 0x7f561415f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:06.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f5619800640 1 -- 172.21.15.55:0/77065913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f561406db10 msgr2=0x7f56140ad560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:06.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f5619800640 1 --2- 172.21.15.55:0/77065913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f561406db10 0x7f56140ad560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:06.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f5619800640 1 -- 172.21.15.55:0/77065913 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56000094d0 con 0x7f5614069e20 2024-04-02T07:34:06.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f561a200640 1 --2- 172.21.15.55:0/77065913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56140cbef0 0x7f561415f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:06.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f5618e00640 1 --2- 172.21.15.55:0/77065913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f561406db10 0x7f56140ad560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:06.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f5619800640 1 --2- 172.21.15.55:0/77065913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5614069e20 0x7f5614153c90 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f560800c370 tx=0x7f560800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:06.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f5611600640 1 -- 172.21.15.55:0/77065913 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56080052d0 con 0x7f5614069e20 2024-04-02T07:34:06.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f5611600640 1 -- 172.21.15.55:0/77065913 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5608005430 con 0x7f5614069e20 2024-04-02T07:34:06.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f5611600640 1 -- 172.21.15.55:0/77065913 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5608007260 con 0x7f5614069e20 2024-04-02T07:34:06.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f561c200640 1 -- 172.21.15.55:0/77065913 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56140aca80 con 0x7f5614069e20 2024-04-02T07:34:06.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.003+0000 7f561c200640 1 -- 172.21.15.55:0/77065913 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56140ad040 con 0x7f5614069e20 2024-04-02T07:34:06.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.007+0000 7f561c200640 1 -- 172.21.15.55:0/77065913 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5614066c90 con 0x7f5614069e20 2024-04-02T07:34:06.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.007+0000 7f5611600640 1 -- 172.21.15.55:0/77065913 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f56080073c0 con 0x7f5614069e20 2024-04-02T07:34:06.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.007+0000 7f5611600640 1 --2- 172.21.15.55:0/77065913 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f55f4066690 0x7f55f4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:06.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.007+0000 7f5611600640 1 -- 172.21.15.55:0/77065913 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f5608083510 con 0x7f5614069e20 2024-04-02T07:34:06.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.007+0000 7f5618e00640 1 --2- 172.21.15.55:0/77065913 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f55f4066690 0x7f55f4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:06.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.007+0000 7f5618e00640 1 --2- 172.21.15.55:0/77065913 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f55f4066690 0x7f55f4068b50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f56000af000 tx=0x7f56000a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:06.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.011+0000 7f5611600640 1 -- 172.21.15.55:0/77065913 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5608050880 con 0x7f5614069e20 2024-04-02T07:34:06.203 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.203+0000 7f561c200640 1 -- 172.21.15.55:0/77065913 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5614159e20 con 0x7f5614069e20 2024-04-02T07:34:06.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.207+0000 7f5611600640 1 -- 172.21.15.55:0/77065913 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 99 v99) v1 ==== 94+0+4741 (secure 0 0 0) 0x7f5608053ea0 con 0x7f5614069e20 2024-04-02T07:34:06.204 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:06.204 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":99,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7592,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2292883244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2292883244},{"type":"v1","addr":"172.21.15.106:6836","nonce":2292883244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":7835,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3165795379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3165795379},{"type":"v1","addr":"172.21.15.106:6837","nonce":3165795379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":9147,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2700619140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2700619140},{"type":"v1","addr":"172.21.15.55:6834","nonce":2700619140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":99,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:33:27.846433+0000","modified":"2024-04-02T07:34:05.830911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9150":{"gid":9150,"name":"a","rank":0,"incarnation":99,"state":"up:replay","state_seq":1,"addr":"172.21.15.55:6835/154663344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":154663344},{"type":"v1","addr":"172.21.15.55:6835","nonce":154663344}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-02T07:34:06.205 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 99 2024-04-02T07:34:06.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.207+0000 7f561c200640 1 -- 172.21.15.55:0/77065913 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f55f4066690 msgr2=0x7f55f4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:06.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.207+0000 7f561c200640 1 --2- 172.21.15.55:0/77065913 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f55f4066690 0x7f55f4068b50 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f56000af000 tx=0x7f56000a7000 comp rx=0 tx=0).stop 2024-04-02T07:34:06.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.207+0000 7f561c200640 1 -- 172.21.15.55:0/77065913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5614069e20 msgr2=0x7f5614153c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:06.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.207+0000 7f561c200640 1 --2- 172.21.15.55:0/77065913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5614069e20 0x7f5614153c90 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f560800c370 tx=0x7f560800c830 comp rx=0 tx=0).stop 2024-04-02T07:34:06.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.207+0000 7f561c200640 1 -- 172.21.15.55:0/77065913 shutdown_connections 2024-04-02T07:34:06.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.207+0000 7f561c200640 1 --2- 172.21.15.55:0/77065913 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f56140cbef0 0x7f561415f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:06.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.207+0000 7f561c200640 1 --2- 172.21.15.55:0/77065913 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f55f4066690 0x7f55f4068b50 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:06.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.207+0000 7f561c200640 1 --2- 172.21.15.55:0/77065913 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f561406db10 0x7f56140ad560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:06.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.207+0000 7f561c200640 1 --2- 172.21.15.55:0/77065913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5614069e20 0x7f5614153c90 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:06.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.207+0000 7f561c200640 1 -- 172.21.15.55:0/77065913 >> 172.21.15.55:0/77065913 conn(0x7f56140cb3d0 msgr2=0x7f56140cb7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:06.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.207+0000 7f561c200640 1 -- 172.21.15.55:0/77065913 shutdown_connections 2024-04-02T07:34:06.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:06.207+0000 7f561c200640 1 -- 172.21.15.55:0/77065913 wait complete. 2024-04-02T07:34:06.630 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 99, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:33:27.846433+0000', 'modified': '2024-04-02T07:34:05.830911+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 119, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9150}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9150': {'gid': 9150, 'name': 'a', 'rank': 0, 'incarnation': 99, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.55:6835/154663344', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 154663344}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 154663344}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:34:06.630 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9150:up:replay 2024-04-02T07:34:07.631 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:34:07.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.783+0000 7f80f4e00640 1 Processor -- start 2024-04-02T07:34:07.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.783+0000 7f80f4e00640 1 -- start start 2024-04-02T07:34:07.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.787+0000 7f80f4e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80f006a4a0 0x7f80f015b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:07.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.787+0000 7f80f4e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f006f910 con 0x7f80f01585d0 2024-04-02T07:34:07.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.787+0000 7f80f4e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80f006edd0 con 0x7f80f0071c30 2024-04-02T07:34:07.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.787+0000 7f80f4e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f015ae40 con 0x7f80f006a4a0 2024-04-02T07:34:07.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.787+0000 7f80ede00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f80f01585d0 0x7f80f00cc020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46132/0 (socket says 172.21.15.55:46132) 2024-04-02T07:34:07.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.787+0000 7f80ede00640 1 -- 172.21.15.55:0/4148363001 learned_addr learned my addr 172.21.15.55:0/4148363001 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:07.786 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.787+0000 7f80ee800640 1 --2- 172.21.15.55:0/4148363001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80f006a4a0 0x7f80f015b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:07.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.787+0000 7f80eca00640 1 -- 172.21.15.55:0/4148363001 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1459413100 0 0) 0x7f80e0001120 con 0x7f80f01585d0 2024-04-02T07:34:07.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.787+0000 7f80eca00640 1 -- 172.21.15.55:0/4148363001 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80d4003530 con 0x7f80f01585d0 2024-04-02T07:34:07.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.787+0000 7f80eca00640 1 -- 172.21.15.55:0/4148363001 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820648530 0 0) 0x7f80f006edd0 con 0x7f80f0071c30 2024-04-02T07:34:07.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.787+0000 7f80eca00640 1 -- 172.21.15.55:0/4148363001 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f80e0001120 con 0x7f80f0071c30 2024-04-02T07:34:07.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.787+0000 7f80eca00640 1 -- 172.21.15.55:0/4148363001 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1275195939 0 0) 0x7f80d4003530 con 0x7f80f01585d0 2024-04-02T07:34:07.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.787+0000 7f80ee800640 1 -- 172.21.15.55:0/4148363001 >> v1:172.21.15.106:6789/0 conn(0x7f80f0071c30 legacy=0x7f80f0069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:07.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.787+0000 7f80ee800640 1 -- 172.21.15.55:0/4148363001 >> v1:172.21.15.55:6789/0 conn(0x7f80f01585d0 legacy=0x7f80f00cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:07.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.787+0000 7f80ee800640 1 -- 172.21.15.55:0/4148363001 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80f006f070 con 0x7f80f006a4a0 2024-04-02T07:34:07.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.791+0000 7f80ee800640 1 --2- 172.21.15.55:0/4148363001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80f006a4a0 0x7f80f015b250 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009dc0 tx=0x7f80e801c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cefb7df8062bb67d server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:07.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.791+0000 7f80eca00640 1 -- 172.21.15.55:0/4148363001 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e0001810 con 0x7f80f006a4a0 2024-04-02T07:34:07.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.791+0000 7f80eca00640 1 -- 172.21.15.55:0/4148363001 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80e80a5590 con 0x7f80f006a4a0 2024-04-02T07:34:07.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.791+0000 7f80eca00640 1 -- 172.21.15.55:0/4148363001 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80e80a5920 con 0x7f80f006a4a0 2024-04-02T07:34:07.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.791+0000 7f80f4e00640 1 -- 172.21.15.55:0/4148363001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80f006a4a0 msgr2=0x7f80f015b250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:07.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.791+0000 7f80f4e00640 1 --2- 172.21.15.55:0/4148363001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80f006a4a0 0x7f80f015b250 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f80e8009dc0 tx=0x7f80e801c880 comp rx=0 tx=0).stop 2024-04-02T07:34:07.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.791+0000 7f80f4e00640 1 -- 172.21.15.55:0/4148363001 shutdown_connections 2024-04-02T07:34:07.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.791+0000 7f80f4e00640 1 --2- 172.21.15.55:0/4148363001 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80f006a4a0 0x7f80f015b250 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:07.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.791+0000 7f80f4e00640 1 -- 172.21.15.55:0/4148363001 >> 172.21.15.55:0/4148363001 conn(0x7f80f00b13b0 msgr2=0x7f80f00b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:07.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.791+0000 7f80f4e00640 1 -- 172.21.15.55:0/4148363001 shutdown_connections 2024-04-02T07:34:07.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.791+0000 7f80f4e00640 1 -- 172.21.15.55:0/4148363001 wait complete. 2024-04-02T07:34:07.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.791+0000 7f80f4e00640 1 Processor -- start 2024-04-02T07:34:07.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80f4e00640 1 -- start start 2024-04-02T07:34:07.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80f4e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80f006a4a0 0x7f80f00afc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:07.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80f4e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80f0071c30 0x7f80f014fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:07.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80f4e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80f01585d0 0x7f80f01502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:07.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80f4e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f01507e0 con 0x7f80f0071c30 2024-04-02T07:34:07.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80f4e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80f014eab0 con 0x7f80f006a4a0 2024-04-02T07:34:07.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80f4e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80f014ed90 con 0x7f80f01585d0 2024-04-02T07:34:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80ed400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80f0071c30 0x7f80f014fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80ed400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80f0071c30 0x7f80f014fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57444/0 (socket says 172.21.15.55:57444) 2024-04-02T07:34:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80ed400640 1 -- 172.21.15.55:0/1901158867 learned_addr learned my addr 172.21.15.55:0/1901158867 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80ede00640 1 --2- 172.21.15.55:0/1901158867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80f006a4a0 0x7f80f00afc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80ed400640 1 -- 172.21.15.55:0/1901158867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80f01585d0 msgr2=0x7f80f01502a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80ed400640 1 --2- 172.21.15.55:0/1901158867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80f01585d0 0x7f80f01502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80ed400640 1 -- 172.21.15.55:0/1901158867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80f006a4a0 msgr2=0x7f80f00afc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80ed400640 1 --2- 172.21.15.55:0/1901158867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80f006a4a0 0x7f80f00afc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80ed400640 1 -- 172.21.15.55:0/1901158867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80e8009a70 con 0x7f80f0071c30 2024-04-02T07:34:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80ede00640 1 --2- 172.21.15.55:0/1901158867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80f006a4a0 0x7f80f00afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80ed400640 1 --2- 172.21.15.55:0/1901158867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80f0071c30 0x7f80f014fd60 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00c490 tx=0x7f80dc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80e6000640 1 -- 172.21.15.55:0/1901158867 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc0052d0 con 0x7f80f0071c30 2024-04-02T07:34:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80e6000640 1 -- 172.21.15.55:0/1901158867 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80dc005430 con 0x7f80f0071c30 2024-04-02T07:34:07.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80e6000640 1 -- 172.21.15.55:0/1901158867 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80dc012870 con 0x7f80f0071c30 2024-04-02T07:34:07.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80f4e00640 1 -- 172.21.15.55:0/1901158867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80f014f070 con 0x7f80f0071c30 2024-04-02T07:34:07.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80f4e00640 1 -- 172.21.15.55:0/1901158867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80f014f630 con 0x7f80f0071c30 2024-04-02T07:34:07.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.795+0000 7f80f4e00640 1 -- 172.21.15.55:0/1901158867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80f014f850 con 0x7f80f0071c30 2024-04-02T07:34:07.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.799+0000 7f80e6000640 1 -- 172.21.15.55:0/1901158867 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f80dc0129d0 con 0x7f80f0071c30 2024-04-02T07:34:07.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.799+0000 7f80e6000640 1 --2- 172.21.15.55:0/1901158867 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f80d0066690 0x7f80d0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:07.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.799+0000 7f80e6000640 1 -- 172.21.15.55:0/1901158867 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f80dc083d50 con 0x7f80f0071c30 2024-04-02T07:34:07.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.799+0000 7f80ede00640 1 --2- 172.21.15.55:0/1901158867 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f80d0066690 0x7f80d0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:07.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.799+0000 7f80ede00640 1 --2- 172.21.15.55:0/1901158867 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f80d0066690 0x7f80d0068b50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f80e0001520 tx=0x7f80e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:07.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:07.803+0000 7f80e6000640 1 -- 172.21.15.55:0/1901158867 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f80dc087030 con 0x7f80f0071c30 2024-04-02T07:34:08.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:08.003+0000 7f80f4e00640 1 -- 172.21.15.55:0/1901158867 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f80f0066c90 con 0x7f80f0071c30 2024-04-02T07:34:08.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:08.003+0000 7f80e6000640 1 -- 172.21.15.55:0/1901158867 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) v1 ==== 95+0+4744 (secure 0 0 0) 0x7f80dc054b50 con 0x7f80f0071c30 2024-04-02T07:34:08.001 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:08.001 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":101,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7592,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2292883244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2292883244},{"type":"v1","addr":"172.21.15.106:6836","nonce":2292883244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":7835,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3165795379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3165795379},{"type":"v1","addr":"172.21.15.106:6837","nonce":3165795379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":9147,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2700619140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2700619140},{"type":"v1","addr":"172.21.15.55:6834","nonce":2700619140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:33:27.846433+0000","modified":"2024-04-02T07:34:07.844769+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9150":{"gid":9150,"name":"a","rank":0,"incarnation":99,"state":"up:rejoin","state_seq":13,"addr":"172.21.15.55:6835/154663344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":154663344},{"type":"v1","addr":"172.21.15.55:6835","nonce":154663344}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-02T07:34:08.001 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 101 2024-04-02T07:34:08.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:08.003+0000 7f80f4e00640 1 -- 172.21.15.55:0/1901158867 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f80d0066690 msgr2=0x7f80d0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:08.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:08.003+0000 7f80f4e00640 1 --2- 172.21.15.55:0/1901158867 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f80d0066690 0x7f80d0068b50 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f80e0001520 tx=0x7f80e0009040 comp rx=0 tx=0).stop 2024-04-02T07:34:08.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:08.003+0000 7f80f4e00640 1 -- 172.21.15.55:0/1901158867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80f0071c30 msgr2=0x7f80f014fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:08.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:08.003+0000 7f80f4e00640 1 --2- 172.21.15.55:0/1901158867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80f0071c30 0x7f80f014fd60 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f80dc00c490 tx=0x7f80dc00c950 comp rx=0 tx=0).stop 2024-04-02T07:34:08.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:08.003+0000 7f80f4e00640 1 -- 172.21.15.55:0/1901158867 shutdown_connections 2024-04-02T07:34:08.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:08.003+0000 7f80f4e00640 1 --2- 172.21.15.55:0/1901158867 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f80f01585d0 0x7f80f01502a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:08.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:08.003+0000 7f80f4e00640 1 --2- 172.21.15.55:0/1901158867 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80f0071c30 0x7f80f014fd60 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:08.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:08.003+0000 7f80f4e00640 1 --2- 172.21.15.55:0/1901158867 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f80d0066690 0x7f80d0068b50 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:08.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:08.003+0000 7f80f4e00640 1 --2- 172.21.15.55:0/1901158867 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f80f006a4a0 0x7f80f00afc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:08.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:08.003+0000 7f80f4e00640 1 -- 172.21.15.55:0/1901158867 >> 172.21.15.55:0/1901158867 conn(0x7f80f00b13b0 msgr2=0x7f80f0150b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:08.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:08.003+0000 7f80f4e00640 1 -- 172.21.15.55:0/1901158867 shutdown_connections 2024-04-02T07:34:08.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:08.003+0000 7f80f4e00640 1 -- 172.21.15.55:0/1901158867 wait complete. 2024-04-02T07:34:08.425 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 101, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:33:27.846433+0000', 'modified': '2024-04-02T07:34:07.844769+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 119, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9150}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9150': {'gid': 9150, 'name': 'a', 'rank': 0, 'incarnation': 99, 'state': 'up:rejoin', 'state_seq': 13, 'addr': '172.21.15.55:6835/154663344', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 154663344}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 154663344}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:34:08.425 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9150:up:rejoin 2024-04-02T07:34:09.356 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-04-02T07:34:09.359+0000 7fd8ce600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:34:09.426 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:34:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5cefe00640 1 Processor -- start 2024-04-02T07:34:09.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5cefe00640 1 -- start start 2024-04-02T07:34:09.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5cefe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ce815ee70 0x7f5ce8099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:09.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5cefe00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce80ad270 con 0x7f5ce8099120 2024-04-02T07:34:09.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5cefe00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ce80b0a50 con 0x7f5ce815f250 2024-04-02T07:34:09.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5cefe00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce80b0840 con 0x7f5ce815ee70 2024-04-02T07:34:09.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5cede00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5ce8099120 0x7f5ce80ce690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46140/0 (socket says 172.21.15.55:46140) 2024-04-02T07:34:09.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5cede00640 1 -- 172.21.15.55:0/150070480 learned_addr learned my addr 172.21.15.55:0/150070480 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:09.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ced400640 1 --2- 172.21.15.55:0/150070480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ce815ee70 0x7f5ce8099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:09.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ce7e00640 1 -- 172.21.15.55:0/150070480 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2227331444 0 0) 0x7f5ce80ad270 con 0x7f5ce8099120 2024-04-02T07:34:09.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ce7e00640 1 -- 172.21.15.55:0/150070480 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cd0003530 con 0x7f5ce8099120 2024-04-02T07:34:09.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ce7e00640 1 -- 172.21.15.55:0/150070480 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1862674028 0 0) 0x7f5cd0003530 con 0x7f5ce8099120 2024-04-02T07:34:09.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ce7e00640 1 -- 172.21.15.55:0/150070480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ce815ee70 msgr2=0x7f5ce8099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:09.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ce7e00640 1 --2- 172.21.15.55:0/150070480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ce815ee70 0x7f5ce8099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:09.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ce7e00640 1 -- 172.21.15.55:0/150070480 >> v1:172.21.15.106:6789/0 conn(0x7f5ce815f250 legacy=0x7f5ce8098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:09.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ce7e00640 1 -- 172.21.15.55:0/150070480 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce80b0d30 con 0x7f5ce8099120 2024-04-02T07:34:09.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ce7e00640 1 -- 172.21.15.55:0/150070480 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f5ce0001a00 con 0x7f5ce8099120 2024-04-02T07:34:09.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ce7e00640 1 -- 172.21.15.55:0/150070480 >> v1:172.21.15.55:6789/0 conn(0x7f5ce8099120 legacy=0x7f5ce80ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:09.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ce7e00640 1 --2- 172.21.15.55:0/150070480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cd00039b0 0x7f5cd0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:09.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ce7e00640 1 --2- 172.21.15.55:0/150070480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ce815ee70 0x7f5cd00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:09.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ce7e00640 1 --2- 172.21.15.55:0/150070480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cd0004d10 0x7f5cd0005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:09.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ce7e00640 1 -- 172.21.15.55:0/150070480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce80b0840 con 0x7f5cd00039b0 2024-04-02T07:34:09.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ce7e00640 1 -- 172.21.15.55:0/150070480 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd000ba40 con 0x7f5cd0004d10 2024-04-02T07:34:09.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ce7e00640 1 -- 172.21.15.55:0/150070480 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd000bc00 con 0x7f5ce815ee70 2024-04-02T07:34:09.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ced400640 1 --2- 172.21.15.55:0/150070480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cd00039b0 0x7f5cd0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:09.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ceca00640 1 --2- 172.21.15.55:0/150070480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ce815ee70 0x7f5cd00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:09.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5cede00640 1 --2- 172.21.15.55:0/150070480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cd0004d10 0x7f5cd0005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:09.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ced400640 1 -- 172.21.15.55:0/150070480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ce815ee70 msgr2=0x7f5cd00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:09.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ced400640 1 --2- 172.21.15.55:0/150070480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ce815ee70 0x7f5cd00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:09.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ced400640 1 -- 172.21.15.55:0/150070480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cd0004d10 msgr2=0x7f5cd0005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:09.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ced400640 1 --2- 172.21.15.55:0/150070480 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5cd0004d10 0x7f5cd0005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:09.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ced400640 1 -- 172.21.15.55:0/150070480 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd0003530 con 0x7f5cd00039b0 2024-04-02T07:34:09.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.583+0000 7f5ceca00640 1 --2- 172.21.15.55:0/150070480 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ce815ee70 0x7f5cd00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:09.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.587+0000 7f5ced400640 1 --2- 172.21.15.55:0/150070480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cd00039b0 0x7f5cd0003dd0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009ab0 tx=0x7f5cdc01ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f486ef4fbb7aea16 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:09.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.587+0000 7f5ce7e00640 1 -- 172.21.15.55:0/150070480 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc0a6510 con 0x7f5cd00039b0 2024-04-02T07:34:09.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.587+0000 7f5ce7e00640 1 -- 172.21.15.55:0/150070480 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc0a6670 con 0x7f5cd00039b0 2024-04-02T07:34:09.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.587+0000 7f5ce7e00640 1 -- 172.21.15.55:0/150070480 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc0a6a20 con 0x7f5cd00039b0 2024-04-02T07:34:09.587 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.587+0000 7f5cefe00640 1 -- 172.21.15.55:0/150070480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cd00039b0 msgr2=0x7f5cd0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:09.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.587+0000 7f5cefe00640 1 --2- 172.21.15.55:0/150070480 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cd00039b0 0x7f5cd0003dd0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc009ab0 tx=0x7f5cdc01ca20 comp rx=0 tx=0).stop 2024-04-02T07:34:09.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.587+0000 7f5cede00640 1 -- 172.21.15.55:0/150070480 reap_dead start 2024-04-02T07:34:09.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.587+0000 7f5cefe00640 1 -- 172.21.15.55:0/150070480 shutdown_connections 2024-04-02T07:34:09.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.587+0000 7f5cefe00640 1 -- 172.21.15.55:0/150070480 >> 172.21.15.55:0/150070480 conn(0x7f5ce80b21d0 msgr2=0x7f5ce80b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:09.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.587+0000 7f5cefe00640 1 -- 172.21.15.55:0/150070480 shutdown_connections 2024-04-02T07:34:09.588 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.587+0000 7f5cefe00640 1 -- 172.21.15.55:0/150070480 wait complete. 2024-04-02T07:34:09.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5cefe00640 1 Processor -- start 2024-04-02T07:34:09.589 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5cefe00640 1 -- start start 2024-04-02T07:34:09.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5cefe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cd00039b0 0x7f5ce80b4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:09.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5cefe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ce80c5a90 0x7f5ce80c4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:09.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5cefe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ce80c6610 0x7f5ce815cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:09.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5cefe00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce80c5600 con 0x7f5cd00039b0 2024-04-02T07:34:09.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5cefe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce80c4750 con 0x7f5ce80c6610 2024-04-02T07:34:09.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5cefe00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ce80c49f0 con 0x7f5ce80c5a90 2024-04-02T07:34:09.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5ced400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cd00039b0 0x7f5ce80b4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:09.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5ced400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cd00039b0 0x7f5ce80b4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57460/0 (socket says 172.21.15.55:57460) 2024-04-02T07:34:09.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5ced400640 1 -- 172.21.15.55:0/1747812854 learned_addr learned my addr 172.21.15.55:0/1747812854 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:09.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5ceca00640 1 --2- 172.21.15.55:0/1747812854 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ce80c5a90 0x7f5ce80c4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:09.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5cede00640 1 --2- 172.21.15.55:0/1747812854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ce80c6610 0x7f5ce815cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:09.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5ced400640 1 -- 172.21.15.55:0/1747812854 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ce80c5a90 msgr2=0x7f5ce80c4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:09.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5ced400640 1 --2- 172.21.15.55:0/1747812854 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ce80c5a90 0x7f5ce80c4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:09.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5ced400640 1 -- 172.21.15.55:0/1747812854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ce80c6610 msgr2=0x7f5ce815cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:09.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5ced400640 1 --2- 172.21.15.55:0/1747812854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ce80c6610 0x7f5ce815cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:09.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5ced400640 1 -- 172.21.15.55:0/1747812854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce80c4cd0 con 0x7f5cd00039b0 2024-04-02T07:34:09.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5ceca00640 1 --2- 172.21.15.55:0/1747812854 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ce80c5a90 0x7f5ce80c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:09.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5ced400640 1 --2- 172.21.15.55:0/1747812854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cd00039b0 0x7f5ce80b4550 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc0b0040 tx=0x7f5cd0005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:09.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5ce5600640 1 -- 172.21.15.55:0/1747812854 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc004020 con 0x7f5cd00039b0 2024-04-02T07:34:09.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5ce5600640 1 -- 172.21.15.55:0/1747812854 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cdc004180 con 0x7f5cd00039b0 2024-04-02T07:34:09.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5ce5600640 1 -- 172.21.15.55:0/1747812854 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cdc004510 con 0x7f5cd00039b0 2024-04-02T07:34:09.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5cefe00640 1 -- 172.21.15.55:0/1747812854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ce80c4fb0 con 0x7f5cd00039b0 2024-04-02T07:34:09.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.591+0000 7f5cefe00640 1 -- 172.21.15.55:0/1747812854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ce80c6ac0 con 0x7f5cd00039b0 2024-04-02T07:34:09.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.595+0000 7f5cefe00640 1 -- 172.21.15.55:0/1747812854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ce80c6ce0 con 0x7f5cd00039b0 2024-04-02T07:34:09.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.595+0000 7f5ce5600640 1 -- 172.21.15.55:0/1747812854 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5cdc0a67e0 con 0x7f5cd00039b0 2024-04-02T07:34:09.594 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.595+0000 7f5ce5600640 1 --2- 172.21.15.55:0/1747812854 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5cc80666c0 0x7f5cc8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:09.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.595+0000 7f5ce5600640 1 -- 172.21.15.55:0/1747812854 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f5cdc0aa070 con 0x7f5cd00039b0 2024-04-02T07:34:09.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.595+0000 7f5ceca00640 1 --2- 172.21.15.55:0/1747812854 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5cc80666c0 0x7f5cc8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:09.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.595+0000 7f5ceca00640 1 --2- 172.21.15.55:0/1747812854 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5cc80666c0 0x7f5cc8068b80 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f5ce809e470 tx=0x7f5cd4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:09.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.599+0000 7f5ce5600640 1 -- 172.21.15.55:0/1747812854 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5cdc0eb8c0 con 0x7f5cd00039b0 2024-04-02T07:34:09.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.795+0000 7f5cefe00640 1 -- 172.21.15.55:0/1747812854 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ce8066c90 con 0x7f5cd00039b0 2024-04-02T07:34:09.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.795+0000 7f5ce5600640 1 -- 172.21.15.55:0/1747812854 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4744 (secure 0 0 0) 0x7f5cdc0eeee0 con 0x7f5cd00039b0 2024-04-02T07:34:09.793 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:09.794 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":102,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7592,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2292883244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2292883244},{"type":"v1","addr":"172.21.15.106:6836","nonce":2292883244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":7835,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3165795379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3165795379},{"type":"v1","addr":"172.21.15.106:6837","nonce":3165795379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":9147,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2700619140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2700619140},{"type":"v1","addr":"172.21.15.55:6834","nonce":2700619140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:33:27.846433+0000","modified":"2024-04-02T07:34:08.859806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9150":{"gid":9150,"name":"a","rank":0,"incarnation":99,"state":"up:active","state_seq":14,"addr":"172.21.15.55:6835/154663344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":154663344},{"type":"v1","addr":"172.21.15.55:6835","nonce":154663344}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-02T07:34:09.794 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 102 2024-04-02T07:34:09.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.795+0000 7f5cefe00640 1 -- 172.21.15.55:0/1747812854 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5cc80666c0 msgr2=0x7f5cc8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:09.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.795+0000 7f5cefe00640 1 --2- 172.21.15.55:0/1747812854 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5cc80666c0 0x7f5cc8068b80 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f5ce809e470 tx=0x7f5cd4009040 comp rx=0 tx=0).stop 2024-04-02T07:34:09.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.795+0000 7f5cefe00640 1 -- 172.21.15.55:0/1747812854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cd00039b0 msgr2=0x7f5ce80b4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:09.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.795+0000 7f5cefe00640 1 --2- 172.21.15.55:0/1747812854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cd00039b0 0x7f5ce80b4550 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc0b0040 tx=0x7f5cd0005800 comp rx=0 tx=0).stop 2024-04-02T07:34:09.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.795+0000 7f5cefe00640 1 -- 172.21.15.55:0/1747812854 shutdown_connections 2024-04-02T07:34:09.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.795+0000 7f5cefe00640 1 --2- 172.21.15.55:0/1747812854 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5cc80666c0 0x7f5cc8068b80 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:09.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.795+0000 7f5cefe00640 1 --2- 172.21.15.55:0/1747812854 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ce80c6610 0x7f5ce815cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:09.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.795+0000 7f5cefe00640 1 --2- 172.21.15.55:0/1747812854 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ce80c5a90 0x7f5ce80c4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:09.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.795+0000 7f5cefe00640 1 --2- 172.21.15.55:0/1747812854 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5cd00039b0 0x7f5ce80b4550 unknown :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:09.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.795+0000 7f5cefe00640 1 -- 172.21.15.55:0/1747812854 >> 172.21.15.55:0/1747812854 conn(0x7f5ce80b21d0 msgr2=0x7f5ce80c97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:09.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.795+0000 7f5cefe00640 1 -- 172.21.15.55:0/1747812854 shutdown_connections 2024-04-02T07:34:09.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:09.795+0000 7f5cefe00640 1 -- 172.21.15.55:0/1747812854 wait complete. 2024-04-02T07:34:10.218 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 102, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:33:27.846433+0000', 'modified': '2024-04-02T07:34:08.859806+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 119, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9150}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9150': {'gid': 9150, 'name': 'a', 'rank': 0, 'incarnation': 99, 'state': 'up:active', 'state_seq': 14, 'addr': '172.21.15.55:6835/154663344', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 154663344}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 154663344}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:34:10.218 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-02T07:34:10.218 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-02T07:34:10.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.367+0000 7f47d3600640 1 Processor -- start 2024-04-02T07:34:10.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.367+0000 7f47d3600640 1 -- start start 2024-04-02T07:34:10.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.367+0000 7f47d3600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f47cc0b1650 0x7f47cc0cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.367+0000 7f47d3600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47cc0cb1f0 0x7f47cc0cf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.367+0000 7f47d3600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc0ce990 con 0x7f47cc160230 2024-04-02T07:34:10.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.367+0000 7f47d3600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47cc160610 con 0x7f47cc0b1650 2024-04-02T07:34:10.366 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.367+0000 7f47d3600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0cf4f0 con 0x7f47cc0cb1f0 2024-04-02T07:34:10.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.367+0000 7f47cbe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f47cc0b1650 0x7f47cc0cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.367+0000 7f47cbe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f47cc0b1650 0x7f47cc0cacb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:50764/0 (socket says 172.21.15.55:50764) 2024-04-02T07:34:10.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.367+0000 7f47d0c00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f47cc160230 0x7f47cc06bac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:59502/0 (socket says 172.21.15.55:59502) 2024-04-02T07:34:10.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.367+0000 7f47cbe00640 1 -- 172.21.15.55:0/1312982083 learned_addr learned my addr 172.21.15.55:0/1312982083 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:10.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.367+0000 7f47d1600640 1 --2- 172.21.15.55:0/1312982083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47cc0cb1f0 0x7f47cc0cf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.367+0000 7f47cbe00640 1 -- 172.21.15.55:0/1312982083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47cc0cb1f0 msgr2=0x7f47cc0cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:10.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.367+0000 7f47cbe00640 1 --2- 172.21.15.55:0/1312982083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47cc0cb1f0 0x7f47cc0cf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.367+0000 7f47cbe00640 1 -- 172.21.15.55:0/1312982083 >> v1:172.21.15.106:6789/0 conn(0x7f47cc160230 legacy=0x7f47cc06bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:10.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.367+0000 7f47cbe00640 1 -- 172.21.15.55:0/1312982083 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc0cebc0 con 0x7f47cc0b1650 2024-04-02T07:34:10.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.367+0000 7f47d1600640 1 --2- 172.21.15.55:0/1312982083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47cc0cb1f0 0x7f47cc0cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:34:10.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.371+0000 7f47cbe00640 1 --2- 172.21.15.55:0/1312982083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47cc0b1650 0x7f47cc0cacb0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f47b8009870 tx=0x7f47b801c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=579ab6c9fe4394d9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:10.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.371+0000 7f47cb400640 1 -- 172.21.15.55:0/1312982083 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b80ab600 con 0x7f47cc0b1650 2024-04-02T07:34:10.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.371+0000 7f47cb400640 1 -- 172.21.15.55:0/1312982083 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b80a7050 con 0x7f47cc0b1650 2024-04-02T07:34:10.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.371+0000 7f47cb400640 1 -- 172.21.15.55:0/1312982083 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b80ab980 con 0x7f47cc0b1650 2024-04-02T07:34:10.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.371+0000 7f47d3600640 1 -- 172.21.15.55:0/1312982083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47cc0b1650 msgr2=0x7f47cc0cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:10.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.371+0000 7f47d3600640 1 --2- 172.21.15.55:0/1312982083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47cc0b1650 0x7f47cc0cacb0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f47b8009870 tx=0x7f47b801c4d0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.371+0000 7f47d3600640 1 -- 172.21.15.55:0/1312982083 shutdown_connections 2024-04-02T07:34:10.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.371+0000 7f47d3600640 1 --2- 172.21.15.55:0/1312982083 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47cc0cb1f0 0x7f47cc0cf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.371+0000 7f47d3600640 1 --2- 172.21.15.55:0/1312982083 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47cc0b1650 0x7f47cc0cacb0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.371+0000 7f47d3600640 1 -- 172.21.15.55:0/1312982083 >> 172.21.15.55:0/1312982083 conn(0x7f47cc0b2150 msgr2=0x7f47cc0b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:10.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.371+0000 7f47d3600640 1 -- 172.21.15.55:0/1312982083 shutdown_connections 2024-04-02T07:34:10.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.371+0000 7f47d3600640 1 -- 172.21.15.55:0/1312982083 wait complete. 2024-04-02T07:34:10.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47d3600640 1 Processor -- start 2024-04-02T07:34:10.372 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47d3600640 1 -- start start 2024-04-02T07:34:10.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47d3600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47cc0b1650 0x7f47cc0b3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47d3600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47cc0cb1f0 0x7f47cc0c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47d3600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47cc160230 0x7f47cc15e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47d3600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0c7730 con 0x7f47cc0cb1f0 2024-04-02T07:34:10.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47d3600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0b4350 con 0x7f47cc160230 2024-04-02T07:34:10.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47d3600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc0b4630 con 0x7f47cc0b1650 2024-04-02T07:34:10.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47cbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47cc0cb1f0 0x7f47cc0c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47cbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47cc0cb1f0 0x7f47cc0c6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57466/0 (socket says 172.21.15.55:57466) 2024-04-02T07:34:10.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47cbe00640 1 -- 172.21.15.55:0/2899769106 learned_addr learned my addr 172.21.15.55:0/2899769106 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:10.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47d0c00640 1 --2- 172.21.15.55:0/2899769106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47cc0b1650 0x7f47cc0b3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47d1600640 1 --2- 172.21.15.55:0/2899769106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47cc160230 0x7f47cc15e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47cbe00640 1 -- 172.21.15.55:0/2899769106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47cc0b1650 msgr2=0x7f47cc0b3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:10.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47cbe00640 1 --2- 172.21.15.55:0/2899769106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47cc0b1650 0x7f47cc0b3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47cbe00640 1 -- 172.21.15.55:0/2899769106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47cc160230 msgr2=0x7f47cc15e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:10.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47cbe00640 1 --2- 172.21.15.55:0/2899769106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47cc160230 0x7f47cc15e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47cbe00640 1 -- 172.21.15.55:0/2899769106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c4009a70 con 0x7f47cc0cb1f0 2024-04-02T07:34:10.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47cbe00640 1 --2- 172.21.15.55:0/2899769106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47cc0cb1f0 0x7f47cc0c6d50 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f47b80ae040 tx=0x7f47b8019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:10.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47c8c00640 1 -- 172.21.15.55:0/2899769106 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b80b6470 con 0x7f47cc0cb1f0 2024-04-02T07:34:10.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47c8c00640 1 -- 172.21.15.55:0/2899769106 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b80b65f0 con 0x7f47cc0cb1f0 2024-04-02T07:34:10.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47c8c00640 1 -- 172.21.15.55:0/2899769106 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b80b69a0 con 0x7f47cc0cb1f0 2024-04-02T07:34:10.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47d3600640 1 -- 172.21.15.55:0/2899769106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47b80094d0 con 0x7f47cc0cb1f0 2024-04-02T07:34:10.376 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.375+0000 7f47d3600640 1 -- 172.21.15.55:0/2899769106 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47cc0b4bf0 con 0x7f47cc0cb1f0 2024-04-02T07:34:10.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47c8c00640 1 -- 172.21.15.55:0/2899769106 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f47b80b2070 con 0x7f47cc0cb1f0 2024-04-02T07:34:10.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47c8c00640 1 --2- 172.21.15.55:0/2899769106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f47ac0666c0 0x7f47ac068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47c8c00640 1 -- 172.21.15.55:0/2899769106 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f47b811e5a0 con 0x7f47cc0cb1f0 2024-04-02T07:34:10.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47d6a9f000 1 Processor -- start 2024-04-02T07:34:10.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47d6a9f000 1 -- start start 2024-04-02T07:34:10.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47d0c00640 1 --2- 172.21.15.55:0/2899769106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f47ac0666c0 0x7f47ac068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47d6a9f000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5637807d9fc0 0x5637807da3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47d6a9f000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807da8e0 0x56378078ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47d6a9f000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5637807904f0 0x5637807908d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47d6a9f000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637806585a0 con 0x5637807da8e0 2024-04-02T07:34:10.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47d6a9f000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637805e5af0 con 0x5637807d9fc0 2024-04-02T07:34:10.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47d6a9f000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5637805e30c0 con 0x5637807904f0 2024-04-02T07:34:10.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47d0c00640 1 --2- 172.21.15.55:0/2899769106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f47ac0666c0 0x7f47ac068b80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f47c0000f70 tx=0x7f47c0007e50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:10.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47cbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807da8e0 0x56378078ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47cbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807da8e0 0x56378078ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57476/0 (socket says 172.21.15.55:57476) 2024-04-02T07:34:10.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47cbe00640 1 -- 172.21.15.55:0/1361810956 learned_addr learned my addr 172.21.15.55:0/1361810956 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:10.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47d0c00640 1 --2- 172.21.15.55:0/1361810956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5637807d9fc0 0x5637807da3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47cbe00640 1 -- 172.21.15.55:0/1361810956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5637807904f0 msgr2=0x5637807908d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:10.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47cbe00640 1 --2- 172.21.15.55:0/1361810956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5637807904f0 0x5637807908d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47cbe00640 1 -- 172.21.15.55:0/1361810956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5637807d9fc0 msgr2=0x5637807da3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:10.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47cbe00640 1 --2- 172.21.15.55:0/1361810956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5637807d9fc0 0x5637807da3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47cbe00640 1 -- 172.21.15.55:0/1361810956 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637802da890 con 0x5637807da8e0 2024-04-02T07:34:10.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.379+0000 7f47cbe00640 1 --2- 172.21.15.55:0/1361810956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807da8e0 0x56378078ffb0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f47b80f73f0 tx=0x7f47b80ef1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c33ae40191dcbea server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:10.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47bd600640 1 -- 172.21.15.55:0/1361810956 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b80ef530 con 0x5637807da8e0 2024-04-02T07:34:10.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47bd600640 1 -- 172.21.15.55:0/1361810956 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47b80f3360 con 0x5637807da8e0 2024-04-02T07:34:10.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47bd600640 1 -- 172.21.15.55:0/1361810956 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b80f7920 con 0x5637807da8e0 2024-04-02T07:34:10.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d6a9f000 1 -- 172.21.15.55:0/1361810956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807da8e0 msgr2=0x56378078ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:10.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d6a9f000 1 --2- 172.21.15.55:0/1361810956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807da8e0 0x56378078ffb0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f47b80f73f0 tx=0x7f47b80ef1a0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d6a9f000 1 -- 172.21.15.55:0/1361810956 shutdown_connections 2024-04-02T07:34:10.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d6a9f000 1 --2- 172.21.15.55:0/1361810956 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5637807904f0 0x5637807908d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d6a9f000 1 --2- 172.21.15.55:0/1361810956 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807da8e0 0x56378078ffb0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d6a9f000 1 --2- 172.21.15.55:0/1361810956 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5637807d9fc0 0x5637807da3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d6a9f000 1 -- 172.21.15.55:0/1361810956 >> 172.21.15.55:0/1361810956 conn(0x563780796860 msgr2=0x56378078e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:10.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d6a9f000 1 -- 172.21.15.55:0/1361810956 shutdown_connections 2024-04-02T07:34:10.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d6a9f000 1 -- 172.21.15.55:0/1361810956 wait complete. 2024-04-02T07:34:10.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d6a9f000 1 -- start start 2024-04-02T07:34:10.384 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d6a9f000 1 Processor -- start 2024-04-02T07:34:10.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d6a9f000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807904f0 0x563780795060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d6a9f000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5637807d9fc0 0x5637807955a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d6a9f000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5637807da8e0 0x5637807dacc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d6a9f000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637805de9b0 con 0x5637807904f0 2024-04-02T07:34:10.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d6a9f000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56378057dc00 con 0x5637807d9fc0 2024-04-02T07:34:10.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d6a9f000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x56378059c070 con 0x5637807da8e0 2024-04-02T07:34:10.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d6a9f000 10 client.0 _ll_register_callbacks cb 0x56378077c0e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:34:10.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d0c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807904f0 0x563780795060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d0c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807904f0 0x563780795060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57486/0 (socket says 172.21.15.55:57486) 2024-04-02T07:34:10.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d0c00640 1 -- 172.21.15.55:0/4102317087 learned_addr learned my addr 172.21.15.55:0/4102317087 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:10.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d1600640 1 --2- 172.21.15.55:0/4102317087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5637807da8e0 0x5637807dacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47cbe00640 1 --2- 172.21.15.55:0/4102317087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5637807d9fc0 0x5637807955a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d0c00640 1 -- 172.21.15.55:0/4102317087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5637807da8e0 msgr2=0x5637807dacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:10.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d0c00640 1 --2- 172.21.15.55:0/4102317087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5637807da8e0 0x5637807dacc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d0c00640 1 -- 172.21.15.55:0/4102317087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5637807d9fc0 msgr2=0x5637807955a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:10.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d0c00640 1 --2- 172.21.15.55:0/4102317087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5637807d9fc0 0x5637807955a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d0c00640 1 -- 172.21.15.55:0/4102317087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47cc0b4bf0 con 0x5637807904f0 2024-04-02T07:34:10.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d1600640 1 --2- 172.21.15.55:0/4102317087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5637807da8e0 0x5637807dacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:10.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d0c00640 1 --2- 172.21.15.55:0/4102317087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807904f0 0x563780795060 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f47c0007800 tx=0x7f47c0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab313891ac4c85a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:10.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47b2000640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:34:10.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47b2000640 1 -- 172.21.15.55:0/4102317087 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c0013e00 con 0x5637807904f0 2024-04-02T07:34:10.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47b2000640 1 -- 172.21.15.55:0/4102317087 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f47c001b040 con 0x5637807904f0 2024-04-02T07:34:10.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.383+0000 7f47d6a9f000 1 -- 172.21.15.55:0/4102317087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56378059b5f0 con 0x5637807904f0 2024-04-02T07:34:10.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47b2000640 1 -- 172.21.15.55:0/4102317087 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47c0012560 con 0x5637807904f0 2024-04-02T07:34:10.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47d6a9f000 10 client.9549 fetch_fsmap learned FSMap version 102 2024-04-02T07:34:10.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47d6a9f000 1 -- 172.21.15.55:0/4102317087 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) v3 -- 0x5637805a3ab0 con 0x5637807904f0 2024-04-02T07:34:10.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47b2000640 1 -- 172.21.15.55:0/4102317087 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56378059b5f0 con 0x5637807904f0 2024-04-02T07:34:10.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47b2000640 1 -- 172.21.15.55:0/4102317087 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 102) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f47c0012070 con 0x5637807904f0 2024-04-02T07:34:10.390 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47d6a9f000 10 client.9549 fetch_fsmap finished waiting for FSMap version 102 2024-04-02T07:34:10.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47d6a9f000 10 client.9549 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:34:10.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47d6a9f000 20 client.9549 populate_metadata read hostname 'smithi055' 2024-04-02T07:34:10.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47d6a9f000 1 --2- 172.21.15.55:0/4102317087 >> [v2:172.21.15.55:6832/154663344,v1:172.21.15.55:6835/154663344] conn(0x5637807db6d0 0x5637807eb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47d6a9f000 4 client.9549 mds_command: new command op to 9150 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:34:10.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47d6a9f000 1 -- 172.21.15.55:0/4102317087 --> [v2:172.21.15.55:6832/154663344,v1:172.21.15.55:6835/154663344] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5637805db790 con 0x5637807db6d0 2024-04-02T07:34:10.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47cbe00640 1 --2- 172.21.15.55:0/4102317087 >> [v2:172.21.15.55:6832/154663344,v1:172.21.15.55:6835/154663344] conn(0x5637807db6d0 0x5637807eb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47cbe00640 1 --2- 172.21.15.55:0/4102317087 >> [v2:172.21.15.55:6832/154663344,v1:172.21.15.55:6835/154663344] conn(0x5637807db6d0 0x5637807eb060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29874f283e9f0775 server_cookie=b081e6defeb39bb4 in_seq=0 out_seq=0 2024-04-02T07:34:10.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47b2000640 10 client.9549 ms_handle_connect on v2:172.21.15.55:6832/154663344 2024-04-02T07:34:10.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47b2000640 1 -- 172.21.15.55:0/4102317087 <== mds.0 v2:172.21.15.55:6832/154663344 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5637805db790 con 0x5637807db6d0 2024-04-02T07:34:10.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47b2000640 10 client.9549 handle_command_reply: tid=0 2024-04-02T07:34:10.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47d6a9f000 1 client.9549 shutdown 2024-04-02T07:34:10.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47d6a9f000 1 -- 172.21.15.55:0/4102317087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807904f0 msgr2=0x563780795060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:10.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47d6a9f000 1 --2- 172.21.15.55:0/4102317087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807904f0 0x563780795060 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f47c0007800 tx=0x7f47c0000ee0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.391 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47d6a9f000 1 -- 172.21.15.55:0/4102317087 shutdown_connections 2024-04-02T07:34:10.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47d6a9f000 1 --2- 172.21.15.55:0/4102317087 >> [v2:172.21.15.55:6832/154663344,v1:172.21.15.55:6835/154663344] conn(0x5637807db6d0 0x5637807eb060 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47d6a9f000 1 --2- 172.21.15.55:0/4102317087 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5637807da8e0 0x5637807dacc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47d6a9f000 1 --2- 172.21.15.55:0/4102317087 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5637807d9fc0 0x5637807955a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47b2000640 0 client.9549 ms_handle_reset on v2:172.21.15.55:6832/154663344 2024-04-02T07:34:10.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47d6a9f000 1 --2- 172.21.15.55:0/4102317087 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807904f0 0x563780795060 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47d6a9f000 1 -- 172.21.15.55:0/4102317087 >> 172.21.15.55:0/4102317087 conn(0x563780796860 msgr2=0x56378078ef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:10.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47d6a9f000 1 -- 172.21.15.55:0/4102317087 shutdown_connections 2024-04-02T07:34:10.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47d6a9f000 1 -- 172.21.15.55:0/4102317087 wait complete. 2024-04-02T07:34:10.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.387+0000 7f47d6a9f000 20 client.9549 trim_cache size 0 max 16384 2024-04-02T07:34:10.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.403+0000 7f47d6a9f000 1 Processor -- start 2024-04-02T07:34:10.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.403+0000 7f47d6a9f000 1 -- start start 2024-04-02T07:34:10.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.403+0000 7f47d6a9f000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5637807904f0 0x5637807d87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.403 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.403+0000 7f47d6a9f000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5637807d9fc0 0x5637807d8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.403+0000 7f47d6a9f000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807da8e0 0x5637807e9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.403+0000 7f47d6a9f000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56378029b940 con 0x5637807da8e0 2024-04-02T07:34:10.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.403+0000 7f47d6a9f000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637805dd840 con 0x5637807904f0 2024-04-02T07:34:10.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.403+0000 7f47d6a9f000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x56378059a470 con 0x5637807d9fc0 2024-04-02T07:34:10.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.403+0000 7f47d1600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807da8e0 0x5637807e9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.403+0000 7f47d1600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807da8e0 0x5637807e9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57498/0 (socket says 172.21.15.55:57498) 2024-04-02T07:34:10.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.403+0000 7f47d1600640 1 -- 172.21.15.55:0/2580333220 learned_addr learned my addr 172.21.15.55:0/2580333220 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:10.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.403+0000 7f47cbe00640 1 --2- 172.21.15.55:0/2580333220 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5637807d9fc0 0x5637807d8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.403+0000 7f47d0c00640 1 --2- 172.21.15.55:0/2580333220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5637807904f0 0x5637807d87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.403+0000 7f47d1600640 1 -- 172.21.15.55:0/2580333220 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5637807d9fc0 msgr2=0x5637807d8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:10.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.403+0000 7f47d1600640 1 --2- 172.21.15.55:0/2580333220 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5637807d9fc0 0x5637807d8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.403+0000 7f47d1600640 1 -- 172.21.15.55:0/2580333220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5637807904f0 msgr2=0x5637807d87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:10.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.403+0000 7f47d1600640 1 --2- 172.21.15.55:0/2580333220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5637807904f0 0x5637807d87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.403+0000 7f47d1600640 1 -- 172.21.15.55:0/2580333220 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563780589c00 con 0x5637807da8e0 2024-04-02T07:34:10.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.403+0000 7f47d1600640 1 --2- 172.21.15.55:0/2580333220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807da8e0 0x5637807e9050 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f47c4007730 tx=0x7f47c4007bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2958bcc45c41145 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47be000640 1 -- 172.21.15.55:0/2580333220 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c400e040 con 0x5637807da8e0 2024-04-02T07:34:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47be000640 1 -- 172.21.15.55:0/2580333220 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c400f040 con 0x5637807da8e0 2024-04-02T07:34:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47be000640 1 -- 172.21.15.55:0/2580333220 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c4013c60 con 0x5637807da8e0 2024-04-02T07:34:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 1 -- 172.21.15.55:0/2580333220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807da8e0 msgr2=0x5637807e9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 1 --2- 172.21.15.55:0/2580333220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807da8e0 0x5637807e9050 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7f47c4007730 tx=0x7f47c4007bf0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 1 -- 172.21.15.55:0/2580333220 shutdown_connections 2024-04-02T07:34:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 1 --2- 172.21.15.55:0/2580333220 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807da8e0 0x5637807e9050 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 1 --2- 172.21.15.55:0/2580333220 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5637807d9fc0 0x5637807d8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 1 --2- 172.21.15.55:0/2580333220 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5637807904f0 0x5637807d87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 1 -- 172.21.15.55:0/2580333220 >> 172.21.15.55:0/2580333220 conn(0x563780796860 msgr2=0x5637807953e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 1 -- 172.21.15.55:0/2580333220 shutdown_connections 2024-04-02T07:34:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 1 -- 172.21.15.55:0/2580333220 wait complete. 2024-04-02T07:34:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 1 -- start start 2024-04-02T07:34:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 1 Processor -- start 2024-04-02T07:34:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5637807904f0 0x5637807ec660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807d9fc0 0x563780837210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5637807da8e0 0x563780837750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637805a7ef0 con 0x5637807d9fc0 2024-04-02T07:34:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56378059c250 con 0x5637807da8e0 2024-04-02T07:34:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x56378075f530 con 0x5637807904f0 2024-04-02T07:34:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 10 client.0 _ll_register_callbacks cb 0x563780693850 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:34:10.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47cbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807d9fc0 0x563780837210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47cbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807d9fc0 0x563780837210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57512/0 (socket says 172.21.15.55:57512) 2024-04-02T07:34:10.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47cbe00640 1 -- 172.21.15.55:0/1721920238 learned_addr learned my addr 172.21.15.55:0/1721920238 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:10.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d0c00640 1 --2- 172.21.15.55:0/1721920238 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5637807904f0 0x5637807ec660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d1600640 1 --2- 172.21.15.55:0/1721920238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5637807da8e0 0x563780837750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47cbe00640 1 -- 172.21.15.55:0/1721920238 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5637807904f0 msgr2=0x5637807ec660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:10.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47cbe00640 1 --2- 172.21.15.55:0/1721920238 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5637807904f0 0x5637807ec660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47cbe00640 1 -- 172.21.15.55:0/1721920238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5637807da8e0 msgr2=0x563780837750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:10.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47cbe00640 1 --2- 172.21.15.55:0/1721920238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5637807da8e0 0x563780837750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47cbe00640 1 -- 172.21.15.55:0/1721920238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c4007410 con 0x5637807d9fc0 2024-04-02T07:34:10.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47cbe00640 1 --2- 172.21.15.55:0/1721920238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807d9fc0 0x563780837210 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f47b801ca40 tx=0x7f47b811e050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2c94a58af7093c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:10.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47b2000640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:34:10.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47b2000640 1 -- 172.21.15.55:0/1721920238 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b80f3120 con 0x5637807d9fc0 2024-04-02T07:34:10.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47b2000640 1 -- 172.21.15.55:0/1721920238 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f47b80f3360 con 0x5637807d9fc0 2024-04-02T07:34:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 1 -- 172.21.15.55:0/1721920238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5637805ae460 con 0x5637807d9fc0 2024-04-02T07:34:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47b2000640 1 -- 172.21.15.55:0/1721920238 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47b80f7920 con 0x5637807d9fc0 2024-04-02T07:34:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 10 client.9555 fetch_fsmap learned FSMap version 102 2024-04-02T07:34:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.407+0000 7f47d6a9f000 1 -- 172.21.15.55:0/1721920238 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) v3 -- 0x5637802dacc0 con 0x5637807d9fc0 2024-04-02T07:34:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47b2000640 1 -- 172.21.15.55:0/1721920238 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5637805ae460 con 0x5637807d9fc0 2024-04-02T07:34:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47b2000640 1 -- 172.21.15.55:0/1721920238 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 102) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f47b80ebc40 con 0x5637807d9fc0 2024-04-02T07:34:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d6a9f000 10 client.9555 fetch_fsmap finished waiting for FSMap version 102 2024-04-02T07:34:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d6a9f000 10 client.9555 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:34:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d6a9f000 20 client.9555 populate_metadata read hostname 'smithi055' 2024-04-02T07:34:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d6a9f000 1 --2- 172.21.15.55:0/1721920238 >> [v2:172.21.15.55:6832/154663344,v1:172.21.15.55:6835/154663344] conn(0x5637807f4840 0x5637807f4c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d6a9f000 4 client.9555 mds_command: new command op to 9150 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-02T07:34:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d6a9f000 1 -- 172.21.15.55:0/1721920238 --> [v2:172.21.15.55:6832/154663344,v1:172.21.15.55:6835/154663344] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5637805a79c0 con 0x5637807f4840 2024-04-02T07:34:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d0c00640 1 --2- 172.21.15.55:0/1721920238 >> [v2:172.21.15.55:6832/154663344,v1:172.21.15.55:6835/154663344] conn(0x5637807f4840 0x5637807f4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d0c00640 1 --2- 172.21.15.55:0/1721920238 >> [v2:172.21.15.55:6832/154663344,v1:172.21.15.55:6835/154663344] conn(0x5637807f4840 0x5637807f4c20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20e52ffec9cfc01b server_cookie=96e0efa337a85612 in_seq=0 out_seq=0 2024-04-02T07:34:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47b2000640 10 client.9555 ms_handle_connect on v2:172.21.15.55:6832/154663344 2024-04-02T07:34:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47b2000640 1 -- 172.21.15.55:0/1721920238 <== mds.0 v2:172.21.15.55:6832/154663344 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x5637805a79c0 con 0x5637807f4840 2024-04-02T07:34:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47b2000640 10 client.9555 handle_command_reply: tid=0 2024-04-02T07:34:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d6a9f000 1 client.9555 shutdown 2024-04-02T07:34:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d6a9f000 1 -- 172.21.15.55:0/1721920238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807d9fc0 msgr2=0x563780837210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d6a9f000 1 --2- 172.21.15.55:0/1721920238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807d9fc0 0x563780837210 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f47b801ca40 tx=0x7f47b811e050 comp rx=0 tx=0).stop 2024-04-02T07:34:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d6a9f000 1 -- 172.21.15.55:0/1721920238 shutdown_connections 2024-04-02T07:34:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d6a9f000 1 --2- 172.21.15.55:0/1721920238 >> [v2:172.21.15.55:6832/154663344,v1:172.21.15.55:6835/154663344] conn(0x5637807f4840 0x5637807f4c20 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d6a9f000 1 --2- 172.21.15.55:0/1721920238 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5637807da8e0 0x563780837750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d6a9f000 1 --2- 172.21.15.55:0/1721920238 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5637807d9fc0 0x563780837210 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d6a9f000 1 --2- 172.21.15.55:0/1721920238 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5637807904f0 0x5637807ec660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47b2000640 0 client.9555 ms_handle_reset on v2:172.21.15.55:6832/154663344 2024-04-02T07:34:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d6a9f000 1 -- 172.21.15.55:0/1721920238 >> 172.21.15.55:0/1721920238 conn(0x563780796860 msgr2=0x5637807d7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:10.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d6a9f000 1 -- 172.21.15.55:0/1721920238 shutdown_connections 2024-04-02T07:34:10.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d6a9f000 1 -- 172.21.15.55:0/1721920238 wait complete. 2024-04-02T07:34:10.415 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d6a9f000 20 client.9555 trim_cache size 0 max 16384 2024-04-02T07:34:10.415 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:34:10.415 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "642a0456-a2ac-49a4-91a5-3b3449b512da", 2024-04-02T07:34:10.415 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-02T07:34:10.415 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 9150, 2024-04-02T07:34:10.415 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-02T07:34:10.415 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-02T07:34:10.415 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-02T07:34:10.415 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 4.5738768219999999, 2024-04-02T07:34:10.416 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 102, 2024-04-02T07:34:10.416 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 119, 2024-04-02T07:34:10.416 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 119, 2024-04-02T07:34:10.416 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 46.883385977000003 2024-04-02T07:34:10.416 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:34:10.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d3600640 1 -- 172.21.15.55:0/2899769106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f47ac0666c0 msgr2=0x7f47ac068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:10.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d3600640 1 --2- 172.21.15.55:0/2899769106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f47ac0666c0 0x7f47ac068b80 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f47c0000f70 tx=0x7f47c0007e50 comp rx=0 tx=0).stop 2024-04-02T07:34:10.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d3600640 1 -- 172.21.15.55:0/2899769106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47cc0cb1f0 msgr2=0x7f47cc0c6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:10.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d3600640 1 --2- 172.21.15.55:0/2899769106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47cc0cb1f0 0x7f47cc0c6d50 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f47b80ae040 tx=0x7f47b8019270 comp rx=0 tx=0).stop 2024-04-02T07:34:10.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d3600640 1 -- 172.21.15.55:0/2899769106 shutdown_connections 2024-04-02T07:34:10.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d3600640 1 --2- 172.21.15.55:0/2899769106 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f47ac0666c0 0x7f47ac068b80 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d3600640 1 --2- 172.21.15.55:0/2899769106 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f47cc160230 0x7f47cc15e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d3600640 1 --2- 172.21.15.55:0/2899769106 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47cc0cb1f0 0x7f47cc0c6d50 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d3600640 1 --2- 172.21.15.55:0/2899769106 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f47cc0b1650 0x7f47cc0b3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d3600640 1 -- 172.21.15.55:0/2899769106 >> 172.21.15.55:0/2899769106 conn(0x7f47cc0b2150 msgr2=0x7f47cc06f5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:10.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d3600640 1 -- 172.21.15.55:0/2899769106 shutdown_connections 2024-04-02T07:34:10.417 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.411+0000 7f47d3600640 1 -- 172.21.15.55:0/2899769106 wait complete. 2024-04-02T07:34:10.429 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-02T07:34:10.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.571+0000 7f91df400640 1 Processor -- start 2024-04-02T07:34:10.570 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.571+0000 7f91df400640 1 -- start start 2024-04-02T07:34:10.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.571+0000 7f91df400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f91d80b16e0 0x7f91d80b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.571+0000 7f91df400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91d80b11f0 0x7f91d8098a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.571+0000 7f91df400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91d80d01d0 con 0x7f91d80cfdf0 2024-04-02T07:34:10.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.571+0000 7f91df400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91d806c0e0 con 0x7f91d80b16e0 2024-04-02T07:34:10.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.571+0000 7f91df400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d80b01d0 con 0x7f91d80b11f0 2024-04-02T07:34:10.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.571+0000 7f91dca00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f91d80cfdf0 0x7f91d806b8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46154/0 (socket says 172.21.15.55:46154) 2024-04-02T07:34:10.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.571+0000 7f91dca00640 1 -- 172.21.15.55:0/746114969 learned_addr learned my addr 172.21.15.55:0/746114969 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:10.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.571+0000 7f91cfe00640 1 --2- 172.21.15.55:0/746114969 >> v2:172.21.15.55:3300/0 conn(0x7f91d80b16e0 0x7f91d80b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.571+0000 7f91dd400640 1 --2- 172.21.15.55:0/746114969 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91d80b11f0 0x7f91d8098a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.571+0000 7f91cfe00640 1 -- 172.21.15.55:0/746114969 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91d80b11f0 msgr2=0x7f91d8098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:10.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.571+0000 7f91cfe00640 1 --2- 172.21.15.55:0/746114969 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91d80b11f0 0x7f91d8098a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.571+0000 7f91cfe00640 1 -- 172.21.15.55:0/746114969 >> v1:172.21.15.55:6789/0 conn(0x7f91d80cfdf0 legacy=0x7f91d806b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:10.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.571+0000 7f91cfe00640 1 -- 172.21.15.55:0/746114969 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d80b04b0 con 0x7f91d80b16e0 2024-04-02T07:34:10.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.571+0000 7f91d7e00640 1 -- 172.21.15.55:0/746114969 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 936158038 0 0) 0x7f91c8001120 con 0x7f91d80cfdf0 2024-04-02T07:34:10.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.571+0000 7f91dd400640 1 --2- 172.21.15.55:0/746114969 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91d80b11f0 0x7f91d8098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:10.574 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.575+0000 7f91cfe00640 1 --2- 172.21.15.55:0/746114969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d80b16e0 0x7f91d80b0cb0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f91c00097c0 tx=0x7f91c001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=feec0a51f986c953 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:10.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.575+0000 7f91d7e00640 1 -- 172.21.15.55:0/746114969 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c00ad680 con 0x7f91d80b16e0 2024-04-02T07:34:10.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.575+0000 7f91d7e00640 1 -- 172.21.15.55:0/746114969 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91c00ad7e0 con 0x7f91d80b16e0 2024-04-02T07:34:10.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.575+0000 7f91d7e00640 1 -- 172.21.15.55:0/746114969 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c00adb70 con 0x7f91d80b16e0 2024-04-02T07:34:10.575 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.575+0000 7f91df400640 1 -- 172.21.15.55:0/746114969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d80b16e0 msgr2=0x7f91d80b0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:10.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.575+0000 7f91df400640 1 --2- 172.21.15.55:0/746114969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d80b16e0 0x7f91d80b0cb0 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7f91c00097c0 tx=0x7f91c001c470 comp rx=0 tx=0).stop 2024-04-02T07:34:10.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.575+0000 7f91df400640 1 -- 172.21.15.55:0/746114969 shutdown_connections 2024-04-02T07:34:10.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.575+0000 7f91df400640 1 --2- 172.21.15.55:0/746114969 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91d80b11f0 0x7f91d8098a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.575+0000 7f91df400640 1 --2- 172.21.15.55:0/746114969 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d80b16e0 0x7f91d80b0cb0 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.575+0000 7f91df400640 1 -- 172.21.15.55:0/746114969 >> 172.21.15.55:0/746114969 conn(0x7f91d80b2210 msgr2=0x7f91d80b2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:10.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.575+0000 7f91df400640 1 -- 172.21.15.55:0/746114969 shutdown_connections 2024-04-02T07:34:10.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.575+0000 7f91df400640 1 -- 172.21.15.55:0/746114969 wait complete. 2024-04-02T07:34:10.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91df400640 1 Processor -- start 2024-04-02T07:34:10.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91df400640 1 -- start start 2024-04-02T07:34:10.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91df400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91d80b11f0 0x7f91d80ca480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91df400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91d80b16e0 0x7f91d80cd060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91df400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d80cfdf0 0x7f91d80cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91df400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d80b6510 con 0x7f91d80cfdf0 2024-04-02T07:34:10.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91df400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d80b5d40 con 0x7f91d80b11f0 2024-04-02T07:34:10.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91df400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d80c9ff0 con 0x7f91d80b16e0 2024-04-02T07:34:10.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91dd400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d80cfdf0 0x7f91d80cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91dd400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d80cfdf0 0x7f91d80cbda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57520/0 (socket says 172.21.15.55:57520) 2024-04-02T07:34:10.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91dd400640 1 -- 172.21.15.55:0/788674024 learned_addr learned my addr 172.21.15.55:0/788674024 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:10.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91cfe00640 1 --2- 172.21.15.55:0/788674024 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91d80b16e0 0x7f91d80cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91dca00640 1 --2- 172.21.15.55:0/788674024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91d80b11f0 0x7f91d80ca480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91dd400640 1 -- 172.21.15.55:0/788674024 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91d80b16e0 msgr2=0x7f91d80cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:10.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91dd400640 1 --2- 172.21.15.55:0/788674024 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91d80b16e0 0x7f91d80cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91dd400640 1 -- 172.21.15.55:0/788674024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91d80b11f0 msgr2=0x7f91d80ca480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:10.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91dd400640 1 --2- 172.21.15.55:0/788674024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91d80b11f0 0x7f91d80ca480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91dd400640 1 -- 172.21.15.55:0/788674024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c0009420 con 0x7f91d80cfdf0 2024-04-02T07:34:10.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91dca00640 1 --2- 172.21.15.55:0/788674024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91d80b11f0 0x7f91d80ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:10.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91dd400640 1 --2- 172.21.15.55:0/788674024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d80cfdf0 0x7f91d80cbda0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f91d000cd50 tx=0x7f91d000a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:10.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91d5600640 1 -- 172.21.15.55:0/788674024 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d000f680 con 0x7f91d80cfdf0 2024-04-02T07:34:10.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91d5600640 1 -- 172.21.15.55:0/788674024 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d000f800 con 0x7f91d80cfdf0 2024-04-02T07:34:10.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91d5600640 1 -- 172.21.15.55:0/788674024 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d000fbb0 con 0x7f91d80cfdf0 2024-04-02T07:34:10.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91df400640 1 -- 172.21.15.55:0/788674024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d80b5f50 con 0x7f91d80cfdf0 2024-04-02T07:34:10.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.579+0000 7f91df400640 1 -- 172.21.15.55:0/788674024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91d80c9c80 con 0x7f91d80cfdf0 2024-04-02T07:34:10.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.583+0000 7f91df400640 1 -- 172.21.15.55:0/788674024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91d80c9ae0 con 0x7f91d80cfdf0 2024-04-02T07:34:10.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.583+0000 7f91d5600640 1 -- 172.21.15.55:0/788674024 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f91d000b040 con 0x7f91d80cfdf0 2024-04-02T07:34:10.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.583+0000 7f91d5600640 1 --2- 172.21.15.55:0/788674024 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f91b4066690 0x7f91b4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:10.582 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.583+0000 7f91d5600640 1 -- 172.21.15.55:0/788674024 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f91d0084b10 con 0x7f91d80cfdf0 2024-04-02T07:34:10.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.583+0000 7f91dca00640 1 --2- 172.21.15.55:0/788674024 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f91b4066690 0x7f91b4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:10.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.587+0000 7f91dca00640 1 --2- 172.21.15.55:0/788674024 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f91b4066690 0x7f91b4068b50 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f91c8000f70 tx=0x7f91c8007cb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:10.586 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.587+0000 7f91d5600640 1 -- 172.21.15.55:0/788674024 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f91d80c9ae0 con 0x7f91d80cfdf0 2024-04-02T07:34:10.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.787+0000 7f91df400640 1 -- 172.21.15.55:0/788674024 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f91d80c9ae0 con 0x7f91d80cfdf0 2024-04-02T07:34:10.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.787+0000 7f91d5600640 1 -- 172.21.15.55:0/788674024 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v102) v1 ==== 53+0+73 (secure 0 0 0) 0x7f91d80c9ae0 con 0x7f91d80cfdf0 2024-04-02T07:34:10.786 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-02T07:34:10.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.787+0000 7f91df400640 1 -- 172.21.15.55:0/788674024 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f91b4066690 msgr2=0x7f91b4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:10.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.787+0000 7f91df400640 1 --2- 172.21.15.55:0/788674024 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f91b4066690 0x7f91b4068b50 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f91c8000f70 tx=0x7f91c8007cb0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.787+0000 7f91df400640 1 -- 172.21.15.55:0/788674024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d80cfdf0 msgr2=0x7f91d80cbda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:10.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.787+0000 7f91df400640 1 --2- 172.21.15.55:0/788674024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d80cfdf0 0x7f91d80cbda0 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f91d000cd50 tx=0x7f91d000a650 comp rx=0 tx=0).stop 2024-04-02T07:34:10.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.787+0000 7f91df400640 1 -- 172.21.15.55:0/788674024 shutdown_connections 2024-04-02T07:34:10.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.787+0000 7f91df400640 1 --2- 172.21.15.55:0/788674024 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f91d80cfdf0 0x7f91d80cbda0 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.787+0000 7f91df400640 1 --2- 172.21.15.55:0/788674024 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f91d80b16e0 0x7f91d80cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.787+0000 7f91df400640 1 --2- 172.21.15.55:0/788674024 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f91b4066690 0x7f91b4068b50 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.787+0000 7f91df400640 1 --2- 172.21.15.55:0/788674024 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f91d80b11f0 0x7f91d80ca480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:10.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.787+0000 7f91df400640 1 -- 172.21.15.55:0/788674024 >> 172.21.15.55:0/788674024 conn(0x7f91d80b2210 msgr2=0x7f91d815a810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:10.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.787+0000 7f91df400640 1 -- 172.21.15.55:0/788674024 shutdown_connections 2024-04-02T07:34:10.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:10.787+0000 7f91df400640 1 -- 172.21.15.55:0/788674024 wait complete. 2024-04-02T07:34:10.807 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-02T07:34:10.807 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-02T07:34:10.807 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-02T07:34:10.807 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-02T07:34:10.807 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-02T07:34:10.807 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-02T07:34:10.807 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-02T07:34:10.807 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-02T07:34:10.807 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:34:10.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:10.808 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-02T07:34:10.817 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:34:10.817 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:34:10.817 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:34:10.817 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:34:10.817 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-02T07:34:10.817 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:34:10.817 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:34:10.818 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:34:10.818 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-02T07:34:10.818 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:34:10.818 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:34:10.818 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-02T07:34:10.818 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-02T07:34:10.818 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:34:10.818 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-02T07:34:10.818 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-02T07:34:10.818 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41744sec preferred_lft 41744sec 2024-04-02T07:34:10.818 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2024-04-02T07:34:10.818 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:34:10.818 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:34:10.818 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:34:10.819 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-02T07:34:10.819 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-02T07:34:10.819 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:81:5a:89:17 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:34:10.819 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-02T07:34:10.819 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:34:10.819 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:34:10.819 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-02T07:34:10.819 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-02T07:34:10.819 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:34:10.819 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-02T07:34:10.819 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:34:10.819 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:34:10.820 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-02T07:34:10.820 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-02T07:34:10.820 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:34:10.820 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:34:10.820 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-02T07:34:10.820 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-02T07:34:10.820 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:34:10.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:10.820 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-02T07:34:10.878 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:34:10.880 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:10.880 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-02T07:34:10.933 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-02T07:34:10.933 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-02T07:34:10.934 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-02T07:34:10.934 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-02T07:34:10.934 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-02T07:34:10.934 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-02T07:34:10.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:10.934 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:34:10.934 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:34:10.934 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-02T07:34:10.934 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-02T07:34:10.935 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-02T07:34:10.935 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:34:11.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:11.026 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-02T07:34:11.035 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-02T07:34:11.035 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-02T07:34:11.035 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:34:11.035 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:11.035 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-02T07:34:11.095 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-02T07:34:11.095 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:34:11.095 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-02T07:34:11.144 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:34:11.144 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:34:11.144 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:34:11.196 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:34:11.260 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:34:11.260 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:34:11.321 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:34:11.323 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:34:11.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:11.324 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:34:11.376 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-02T07:34:11.376 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-02T07:34:11.423 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:34:11.443 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:34:11.443 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:34:11.502 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:34:11.504 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:34:11.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:11.505 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:34:11.517 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:2024-04-02T07:34:11.519+0000 7fa4da42b580 -1 init, newargv = 0x55a0e5ca9820 newargc=15 2024-04-02T07:34:11.517 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[53249]: starting ceph client 2024-04-02T07:34:11.525 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[53249]: starting fuse 2024-04-02T07:34:11.527 INFO:teuthology.orchestra.run.smithi055.stdout:43 2024-04-02T07:34:11.527 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-02T07:34:11.528 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:34:11.528 DEBUG:teuthology.orchestra.run.smithi055:> import glob 2024-04-02T07:34:11.528 DEBUG:teuthology.orchestra.run.smithi055:> import re 2024-04-02T07:34:11.528 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:34:11.528 DEBUG:teuthology.orchestra.run.smithi055:> import subprocess 2024-04-02T07:34:11.528 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:11.528 DEBUG:teuthology.orchestra.run.smithi055:> def _find_admin_socket(client_name): 2024-04-02T07:34:11.528 DEBUG:teuthology.orchestra.run.smithi055:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-02T07:34:11.528 DEBUG:teuthology.orchestra.run.smithi055:> files = glob.glob(asok_path) 2024-04-02T07:34:11.528 DEBUG:teuthology.orchestra.run.smithi055:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-02T07:34:11.528 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:11.528 DEBUG:teuthology.orchestra.run.smithi055:> # Given a non-glob path, it better be there 2024-04-02T07:34:11.528 DEBUG:teuthology.orchestra.run.smithi055:> if "*" not in asok_path: 2024-04-02T07:34:11.528 DEBUG:teuthology.orchestra.run.smithi055:> assert(len(files) == 1) 2024-04-02T07:34:11.529 DEBUG:teuthology.orchestra.run.smithi055:> return files[0] 2024-04-02T07:34:11.529 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:11.529 DEBUG:teuthology.orchestra.run.smithi055:> for f in files: 2024-04-02T07:34:11.529 DEBUG:teuthology.orchestra.run.smithi055:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-02T07:34:11.529 DEBUG:teuthology.orchestra.run.smithi055:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-02T07:34:11.529 DEBUG:teuthology.orchestra.run.smithi055:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-02T07:34:11.529 DEBUG:teuthology.orchestra.run.smithi055:> contents = proc_f.read() 2024-04-02T07:34:11.529 DEBUG:teuthology.orchestra.run.smithi055:> if mountpoint in contents: 2024-04-02T07:34:11.529 DEBUG:teuthology.orchestra.run.smithi055:> return f 2024-04-02T07:34:11.529 DEBUG:teuthology.orchestra.run.smithi055:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-02T07:34:11.529 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:11.529 DEBUG:teuthology.orchestra.run.smithi055:> print(_find_admin_socket("client.0")) 2024-04-02T07:34:11.529 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:34:11.652 INFO:teuthology.orchestra.run.smithi055.stdout:/var/run/ceph/ceph-client.0.53249.asok 2024-04-02T07:34:11.835 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.53249.asok 2024-04-02T07:34:11.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:11.836 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.53249.asok status 2024-04-02T07:34:12.015 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:34:12.015 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": { 2024-04-02T07:34:12.016 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_sha1": "d0e392d9aee635f2b65768c460c7a151ead7a5e2", 2024-04-02T07:34:12.016 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)", 2024-04-02T07:34:12.016 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "0", 2024-04-02T07:34:12.016 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2024-04-02T07:34:12.016 INFO:teuthology.orchestra.run.smithi055.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-02T07:34:12.016 INFO:teuthology.orchestra.run.smithi055.stdout: "pid": "53249", 2024-04-02T07:34:12.016 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2024-04-02T07:34:12.016 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:34:12.016 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_count": 0, 2024-04-02T07:34:12.016 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_pinned_count": 0, 2024-04-02T07:34:12.016 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 9570, 2024-04-02T07:34:12.016 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": { 2024-04-02T07:34:12.016 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2024-04-02T07:34:12.017 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2024-04-02T07:34:12.017 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 9570 2024-04-02T07:34:12.017 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:34:12.017 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:34:12.017 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:34:12.017 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:34:12.017 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 2442618130 2024-04-02T07:34:12.017 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:34:12.017 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:34:12.017 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:34:12.017 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:34:12.017 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:34:12.017 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 2442618130 2024-04-02T07:34:12.017 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:34:12.017 INFO:teuthology.orchestra.run.smithi055.stdout: "inst_str": "client.9570 192.168.0.1:0/2442618130", 2024-04-02T07:34:12.018 INFO:teuthology.orchestra.run.smithi055.stdout: "addr_str": "192.168.0.1:0/2442618130", 2024-04-02T07:34:12.018 INFO:teuthology.orchestra.run.smithi055.stdout: "inode_count": 1, 2024-04-02T07:34:12.018 INFO:teuthology.orchestra.run.smithi055.stdout: "mds_epoch": 102, 2024-04-02T07:34:12.018 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch": 119, 2024-04-02T07:34:12.018 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch_barrier": 0, 2024-04-02T07:34:12.018 INFO:teuthology.orchestra.run.smithi055.stdout: "blocklisted": false, 2024-04-02T07:34:12.018 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs" 2024-04-02T07:34:12.018 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:34:12.031 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:12.031 DEBUG:teuthology.orchestra.run.smithi055:> stat --file-system '--printf=%T 2024-04-02T07:34:12.032 DEBUG:teuthology.orchestra.run.smithi055:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-02T07:34:12.040 INFO:teuthology.orchestra.run.smithi055.stdout:fuseblk 2024-04-02T07:34:12.041 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-02T07:34:12.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:12.041 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:34:12.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:12.103 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-02T07:34:12.167 INFO:teuthology.orchestra.run.smithi055.stdout:./ 2024-04-02T07:34:12.167 INFO:teuthology.orchestra.run.smithi055.stdout:./parent 2024-04-02T07:34:12.167 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed 2024-04-02T07:34:12.167 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed/charlie 2024-04-02T07:34:12.167 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed/alpha 2024-04-02T07:34:12.167 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/unflushed 2024-04-02T07:34:12.168 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/unflushed/jfile 2024-04-02T07:34:12.169 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:34:12.169 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:34:12.169 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:34:12.169 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:12.169 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-02T07:34:12.169 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:34:12.276 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:34:12.466 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:34:12.466 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:34:12.466 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:34:12.466 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:12.466 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-02T07:34:12.466 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:34:12.573 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627776 2024-04-02T07:34:12.763 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:34:12.763 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:34:12.763 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:34:12.763 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:12.763 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-02T07:34:12.763 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:34:12.873 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627777 2024-04-02T07:34:13.063 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:34:13.063 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:34:13.063 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:34:13.063 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:13.063 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-02T07:34:13.063 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:34:13.169 INFO:teuthology.orchestra.run.smithi055.stdout:1099511628280 2024-04-02T07:34:13.358 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:34:13.359 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:34:13.359 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:34:13.359 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:13.359 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-02T07:34:13.359 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:34:13.468 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627778 2024-04-02T07:34:13.658 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:34:13.658 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:34:13.658 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:34:13.658 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:13.658 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-02T07:34:13.658 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:34:13.764 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627779 2024-04-02T07:34:13.953 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:34:13.954 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:34:13.954 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:34:13.954 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:13.954 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-02T07:34:13.954 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:34:14.060 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627780 2024-04-02T07:34:14.250 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:34:14.250 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:34:14.301 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:34:14.483 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.483+0000 7f5ee4000640 1 Processor -- start 2024-04-02T07:34:14.484 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.483+0000 7f5ee4000640 1 -- start start 2024-04-02T07:34:14.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5ee4000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5edc071190 0x7f5edc065d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:14.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5ee4000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5edc06d5b0 con 0x7f5edc15cbe0 2024-04-02T07:34:14.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5ee4000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5edc06cc80 con 0x7f5edc0ce630 2024-04-02T07:34:14.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5ee4000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc0cec10 con 0x7f5edc071190 2024-04-02T07:34:14.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5ee1600640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5edc15cbe0 0x7f5edc0b1c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46166/0 (socket says 172.21.15.55:46166) 2024-04-02T07:34:14.485 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5ee1600640 1 -- 172.21.15.55:0/2364667291 learned_addr learned my addr 172.21.15.55:0/2364667291 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:14.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5edbe00640 1 -- 172.21.15.55:0/2364667291 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310213844 0 0) 0x7f5edc06d5b0 con 0x7f5edc15cbe0 2024-04-02T07:34:14.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5ee2000640 1 --2- 172.21.15.55:0/2364667291 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5edc071190 0x7f5edc065d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:14.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5edbe00640 1 -- 172.21.15.55:0/2364667291 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ec4003530 con 0x7f5edc15cbe0 2024-04-02T07:34:14.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5edbe00640 1 -- 172.21.15.55:0/2364667291 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 17191375 0 0) 0x7f5ec4003530 con 0x7f5edc15cbe0 2024-04-02T07:34:14.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5edbe00640 1 -- 172.21.15.55:0/2364667291 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5edc071190 msgr2=0x7f5edc065d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:14.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5edbe00640 1 --2- 172.21.15.55:0/2364667291 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5edc071190 0x7f5edc065d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:14.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5edbe00640 1 -- 172.21.15.55:0/2364667291 >> v1:172.21.15.106:6789/0 conn(0x7f5edc0ce630 legacy=0x7f5edc070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:14.487 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5edbe00640 1 -- 172.21.15.55:0/2364667291 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc06cf60 con 0x7f5edc15cbe0 2024-04-02T07:34:14.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5edbe00640 1 -- 172.21.15.55:0/2364667291 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f5ed0001680 con 0x7f5edc15cbe0 2024-04-02T07:34:14.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5edbe00640 1 -- 172.21.15.55:0/2364667291 >> v1:172.21.15.55:6789/0 conn(0x7f5edc15cbe0 legacy=0x7f5edc0b1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:14.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5edbe00640 1 --2- 172.21.15.55:0/2364667291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ec40039b0 0x7f5ec4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:14.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5edbe00640 1 --2- 172.21.15.55:0/2364667291 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5edc071190 0x7f5ec40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:14.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5edbe00640 1 --2- 172.21.15.55:0/2364667291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ec4004d10 0x7f5ec4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:14.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5edbe00640 1 -- 172.21.15.55:0/2364667291 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc0cec10 con 0x7f5ec4004d10 2024-04-02T07:34:14.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5edbe00640 1 -- 172.21.15.55:0/2364667291 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec400b9c0 con 0x7f5ec40039b0 2024-04-02T07:34:14.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5edbe00640 1 -- 172.21.15.55:0/2364667291 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec400bb80 con 0x7f5edc071190 2024-04-02T07:34:14.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5ee2000640 1 --2- 172.21.15.55:0/2364667291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ec4004d10 0x7f5ec4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:14.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5ee0c00640 1 --2- 172.21.15.55:0/2364667291 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5edc071190 0x7f5ec40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:14.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5ee1600640 1 --2- 172.21.15.55:0/2364667291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ec40039b0 0x7f5ec4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:14.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5ee2000640 1 -- 172.21.15.55:0/2364667291 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5edc071190 msgr2=0x7f5ec40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:14.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5ee2000640 1 --2- 172.21.15.55:0/2364667291 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5edc071190 0x7f5ec40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:14.488 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5ee2000640 1 -- 172.21.15.55:0/2364667291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ec40039b0 msgr2=0x7f5ec4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:14.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5ee2000640 1 --2- 172.21.15.55:0/2364667291 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ec40039b0 0x7f5ec4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:14.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.487+0000 7f5ee2000640 1 -- 172.21.15.55:0/2364667291 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec4003530 con 0x7f5ec4004d10 2024-04-02T07:34:14.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.491+0000 7f5ee2000640 1 --2- 172.21.15.55:0/2364667291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ec4004d10 0x7f5ec4005190 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f5edc06b230 tx=0x7f5ed401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e4028a3d3597527 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:14.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.491+0000 7f5edbe00640 1 -- 172.21.15.55:0/2364667291 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed0007ea0 con 0x7f5ec4004d10 2024-04-02T07:34:14.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.491+0000 7f5edbe00640 1 -- 172.21.15.55:0/2364667291 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed400f040 con 0x7f5ec4004d10 2024-04-02T07:34:14.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.491+0000 7f5edbe00640 1 -- 172.21.15.55:0/2364667291 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed40a5e30 con 0x7f5ec4004d10 2024-04-02T07:34:14.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.491+0000 7f5ee4000640 1 -- 172.21.15.55:0/2364667291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ec4004d10 msgr2=0x7f5ec4005190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:14.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.491+0000 7f5ee4000640 1 --2- 172.21.15.55:0/2364667291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ec4004d10 0x7f5ec4005190 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7f5edc06b230 tx=0x7f5ed401cc20 comp rx=0 tx=0).stop 2024-04-02T07:34:14.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.491+0000 7f5ee2000640 1 -- 172.21.15.55:0/2364667291 reap_dead start 2024-04-02T07:34:14.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.491+0000 7f5ee4000640 1 -- 172.21.15.55:0/2364667291 shutdown_connections 2024-04-02T07:34:14.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.491+0000 7f5ee4000640 1 -- 172.21.15.55:0/2364667291 >> 172.21.15.55:0/2364667291 conn(0x7f5edc0ced50 msgr2=0x7f5edc0cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:14.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.491+0000 7f5ee4000640 1 -- 172.21.15.55:0/2364667291 shutdown_connections 2024-04-02T07:34:14.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.491+0000 7f5ee4000640 1 -- 172.21.15.55:0/2364667291 wait complete. 2024-04-02T07:34:14.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee4000640 1 Processor -- start 2024-04-02T07:34:14.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee4000640 1 -- start start 2024-04-02T07:34:14.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee4000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec4004d10 0x7f5edc15bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:14.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee4000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5edc15a030 0x7f5edc14f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:14.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee4000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5edc15d470 0x7f5edc15d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:14.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee4000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc14fae0 con 0x7f5edc15d470 2024-04-02T07:34:14.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee4000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc14fe20 con 0x7f5edc15a030 2024-04-02T07:34:14.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee4000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5edc15de30 con 0x7f5ec4004d10 2024-04-02T07:34:14.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee2000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5edc15d470 0x7f5edc15d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:14.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee2000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5edc15d470 0x7f5edc15d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57532/0 (socket says 172.21.15.55:57532) 2024-04-02T07:34:14.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee2000640 1 -- 172.21.15.55:0/1646002113 learned_addr learned my addr 172.21.15.55:0/1646002113 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:14.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee1600640 1 --2- 172.21.15.55:0/1646002113 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec4004d10 0x7f5edc15bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:14.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee0c00640 1 --2- 172.21.15.55:0/1646002113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5edc15a030 0x7f5edc14f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:14.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee2000640 1 -- 172.21.15.55:0/1646002113 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec4004d10 msgr2=0x7f5edc15bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:14.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee2000640 1 --2- 172.21.15.55:0/1646002113 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec4004d10 0x7f5edc15bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:14.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee2000640 1 -- 172.21.15.55:0/1646002113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5edc15a030 msgr2=0x7f5edc14f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:14.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee2000640 1 --2- 172.21.15.55:0/1646002113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5edc15a030 0x7f5edc14f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:14.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee2000640 1 -- 172.21.15.55:0/1646002113 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5edc1f5520 con 0x7f5edc15d470 2024-04-02T07:34:14.496 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee0c00640 1 --2- 172.21.15.55:0/1646002113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5edc15a030 0x7f5edc14f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:14.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee2000640 1 --2- 172.21.15.55:0/1646002113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5edc15d470 0x7f5edc15d8f0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f5ed40b0040 tx=0x7f5ed4009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:14.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ed9600640 1 -- 172.21.15.55:0/1646002113 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed40ad650 con 0x7f5edc15d470 2024-04-02T07:34:14.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ed9600640 1 -- 172.21.15.55:0/1646002113 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed40ad7d0 con 0x7f5edc15d470 2024-04-02T07:34:14.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee4000640 1 -- 172.21.15.55:0/1646002113 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5edc1f5800 con 0x7f5edc15d470 2024-04-02T07:34:14.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ed9600640 1 -- 172.21.15.55:0/1646002113 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed40adb80 con 0x7f5edc15d470 2024-04-02T07:34:14.497 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee4000640 1 -- 172.21.15.55:0/1646002113 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5edc1f5dc0 con 0x7f5edc15d470 2024-04-02T07:34:14.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.495+0000 7f5ee4000640 1 -- 172.21.15.55:0/1646002113 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5edc066c90 con 0x7f5edc15d470 2024-04-02T07:34:14.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.499+0000 7f5ed9600640 1 -- 172.21.15.55:0/1646002113 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5ed40b4040 con 0x7f5edc15d470 2024-04-02T07:34:14.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.499+0000 7f5ed9600640 1 --2- 172.21.15.55:0/1646002113 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ebc0666c0 0x7f5ebc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:14.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.499+0000 7f5ed9600640 1 -- 172.21.15.55:0/1646002113 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f5ed411e710 con 0x7f5edc15d470 2024-04-02T07:34:14.498 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.499+0000 7f5ee1600640 1 --2- 172.21.15.55:0/1646002113 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ebc0666c0 0x7f5ebc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:14.499 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.499+0000 7f5ee1600640 1 --2- 172.21.15.55:0/1646002113 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ebc0666c0 0x7f5ebc068b80 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00016c0 tx=0x7f5ed0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:14.501 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.503+0000 7f5ed9600640 1 -- 172.21.15.55:0/1646002113 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5ed40eb970 con 0x7f5edc15d470 2024-04-02T07:34:14.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.663+0000 7f5ee4000640 1 -- 172.21.15.55:0/1646002113 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5edc0b0240 con 0x7f5edc15d470 2024-04-02T07:34:14.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.667+0000 7f5ed9600640 1 -- 172.21.15.55:0/1646002113 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+16281 (secure 0 0 0) 0x7f5ed40b2090 con 0x7f5edc15d470 2024-04-02T07:34:14.665 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:14.665 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":119,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:34:04.808004+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:33:26.384276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-02T07:33:26.835969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.7","mappings":[{"from":0,"to":5}]},{"pgid":"17.21","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.106:6837/775582321":"2024-04-03T07:34:04.807966+0000","172.21.15.106:6834/775582321":"2024-04-03T07:34:04.807966+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:34:14.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.667+0000 7f5ee4000640 1 -- 172.21.15.55:0/1646002113 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ebc0666c0 msgr2=0x7f5ebc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:14.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.667+0000 7f5ee4000640 1 --2- 172.21.15.55:0/1646002113 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ebc0666c0 0x7f5ebc068b80 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f5ed00016c0 tx=0x7f5ed0009040 comp rx=0 tx=0).stop 2024-04-02T07:34:14.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.667+0000 7f5ee4000640 1 -- 172.21.15.55:0/1646002113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5edc15d470 msgr2=0x7f5edc15d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:14.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.667+0000 7f5ee4000640 1 --2- 172.21.15.55:0/1646002113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5edc15d470 0x7f5edc15d8f0 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f5ed40b0040 tx=0x7f5ed4009750 comp rx=0 tx=0).stop 2024-04-02T07:34:14.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.667+0000 7f5ee4000640 1 -- 172.21.15.55:0/1646002113 shutdown_connections 2024-04-02T07:34:14.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.667+0000 7f5ee4000640 1 --2- 172.21.15.55:0/1646002113 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5edc15d470 0x7f5edc15d8f0 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:14.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.667+0000 7f5ee4000640 1 --2- 172.21.15.55:0/1646002113 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5ebc0666c0 0x7f5ebc068b80 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:14.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.667+0000 7f5ee4000640 1 --2- 172.21.15.55:0/1646002113 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5edc15a030 0x7f5edc14f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:14.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.667+0000 7f5ee4000640 1 --2- 172.21.15.55:0/1646002113 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec4004d10 0x7f5edc15bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:14.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.667+0000 7f5ee4000640 1 -- 172.21.15.55:0/1646002113 >> 172.21.15.55:0/1646002113 conn(0x7f5edc0ced50 msgr2=0x7f5edc0ad490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:14.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.667+0000 7f5ee4000640 1 -- 172.21.15.55:0/1646002113 shutdown_connections 2024-04-02T07:34:14.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.667+0000 7f5ee4000640 1 -- 172.21.15.55:0/1646002113 wait complete. 2024-04-02T07:34:14.686 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:33:26.384276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:33:26.835969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:34:14.687 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:34:14.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.831+0000 7fa8d5400640 1 Processor -- start 2024-04-02T07:34:14.831 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.831+0000 7fa8d5400640 1 -- start start 2024-04-02T07:34:14.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.835+0000 7fa8d5400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8d0098a10 0x7fa8d0098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:14.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.835+0000 7fa8d5400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8d015c130 0x7fa8d015c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:14.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.835+0000 7fa8d5400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d0099a70 con 0x7fa8d00cc880 2024-04-02T07:34:14.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.835+0000 7fa8d5400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d006bc90 con 0x7fa8d015c130 2024-04-02T07:34:14.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.835+0000 7fa8d5400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d006bf70 con 0x7fa8d0098a10 2024-04-02T07:34:14.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.835+0000 7fa8d4a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8d015c130 0x7fa8d015c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:14.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.835+0000 7fa8d4a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa8d015c130 0x7fa8d015c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57548/0 (socket says 172.21.15.55:57548) 2024-04-02T07:34:14.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.835+0000 7fa8d4a00640 1 -- 172.21.15.55:0/4142556959 learned_addr learned my addr 172.21.15.55:0/4142556959 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:14.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.835+0000 7fa8c7400640 1 --2- 172.21.15.55:0/4142556959 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8d0098a10 0x7fa8d0098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:14.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.835+0000 7fa8d4a00640 1 -- 172.21.15.55:0/4142556959 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8d0098a10 msgr2=0x7fa8d0098e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:14.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.835+0000 7fa8d4a00640 1 --2- 172.21.15.55:0/4142556959 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8d0098a10 0x7fa8d0098e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:14.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.835+0000 7fa8d4a00640 1 -- 172.21.15.55:0/4142556959 >> v1:172.21.15.106:6789/0 conn(0x7fa8d00cc880 legacy=0x7fa8d006b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:14.833 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.835+0000 7fa8d4a00640 1 -- 172.21.15.55:0/4142556959 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d00993b0 con 0x7fa8d015c130 2024-04-02T07:34:14.834 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.835+0000 7fa8c7400640 1 --2- 172.21.15.55:0/4142556959 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8d0098a10 0x7fa8d0098e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:14.835 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.835+0000 7fa8d4a00640 1 --2- 172.21.15.55:0/4142556959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d015c130 0x7fa8d015c5c0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009e50 tx=0x7fa8c801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38ecdb7fa8f648f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:14.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.835+0000 7fa8cf400640 1 -- 172.21.15.55:0/4142556959 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80a58d0 con 0x7fa8d015c130 2024-04-02T07:34:14.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8cf400640 1 -- 172.21.15.55:0/4142556959 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c80a5a30 con 0x7fa8d015c130 2024-04-02T07:34:14.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8cf400640 1 -- 172.21.15.55:0/4142556959 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c80a5dc0 con 0x7fa8d015c130 2024-04-02T07:34:14.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8d5400640 1 -- 172.21.15.55:0/4142556959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d015c130 msgr2=0x7fa8d015c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:14.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8d5400640 1 --2- 172.21.15.55:0/4142556959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d015c130 0x7fa8d015c5c0 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8009e50 tx=0x7fa8c801ca00 comp rx=0 tx=0).stop 2024-04-02T07:34:14.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8d5400640 1 -- 172.21.15.55:0/4142556959 shutdown_connections 2024-04-02T07:34:14.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8d5400640 1 --2- 172.21.15.55:0/4142556959 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d015c130 0x7fa8d015c5c0 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:14.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8d5400640 1 --2- 172.21.15.55:0/4142556959 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8d0098a10 0x7fa8d0098e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:14.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8d5400640 1 -- 172.21.15.55:0/4142556959 >> 172.21.15.55:0/4142556959 conn(0x7fa8d00b1fb0 msgr2=0x7fa8d00b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:14.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8d5400640 1 -- 172.21.15.55:0/4142556959 shutdown_connections 2024-04-02T07:34:14.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8d5400640 1 -- 172.21.15.55:0/4142556959 wait complete. 2024-04-02T07:34:14.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8d5400640 1 Processor -- start 2024-04-02T07:34:14.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8d5400640 1 -- start start 2024-04-02T07:34:14.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8d5400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8d0098a10 0x7fa8d014de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:14.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8d5400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d00cc880 0x7fa8d015a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:14.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8d5400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d015c130 0x7fa8d00b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:14.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8d5400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d014e3b0 con 0x7fa8d00cc880 2024-04-02T07:34:14.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8d5400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d015ae20 con 0x7fa8d015c130 2024-04-02T07:34:14.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8d5400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d015b100 con 0x7fa8d0098a10 2024-04-02T07:34:14.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8c7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d00cc880 0x7fa8d015a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:14.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8c7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d00cc880 0x7fa8d015a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57562/0 (socket says 172.21.15.55:57562) 2024-04-02T07:34:14.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8c7400640 1 -- 172.21.15.55:0/3064963394 learned_addr learned my addr 172.21.15.55:0/3064963394 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:14.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8cfe00640 1 --2- 172.21.15.55:0/3064963394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8d0098a10 0x7fa8d014de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:14.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.839+0000 7fa8d4a00640 1 --2- 172.21.15.55:0/3064963394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d015c130 0x7fa8d00b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:14.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.843+0000 7fa8c7400640 1 -- 172.21.15.55:0/3064963394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8d0098a10 msgr2=0x7fa8d014de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:14.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.843+0000 7fa8c7400640 1 --2- 172.21.15.55:0/3064963394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8d0098a10 0x7fa8d014de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:14.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.843+0000 7fa8c7400640 1 -- 172.21.15.55:0/3064963394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d015c130 msgr2=0x7fa8d00b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:14.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.843+0000 7fa8c7400640 1 --2- 172.21.15.55:0/3064963394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d015c130 0x7fa8d00b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:14.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.843+0000 7fa8c7400640 1 -- 172.21.15.55:0/3064963394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c8009b30 con 0x7fa8d00cc880 2024-04-02T07:34:14.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.843+0000 7fa8c7400640 1 --2- 172.21.15.55:0/3064963394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d00cc880 0x7fa8d015a4b0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800d800 tx=0x7fa8b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:14.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.843+0000 7fa8ccc00640 1 -- 172.21.15.55:0/3064963394 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b800b6c0 con 0x7fa8d00cc880 2024-04-02T07:34:14.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.843+0000 7fa8ccc00640 1 -- 172.21.15.55:0/3064963394 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b800b820 con 0x7fa8d00cc880 2024-04-02T07:34:14.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.843+0000 7fa8ccc00640 1 -- 172.21.15.55:0/3064963394 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b800bbd0 con 0x7fa8d00cc880 2024-04-02T07:34:14.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.843+0000 7fa8d5400640 1 -- 172.21.15.55:0/3064963394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d015b3e0 con 0x7fa8d00cc880 2024-04-02T07:34:14.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.843+0000 7fa8d5400640 1 -- 172.21.15.55:0/3064963394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d015b9a0 con 0x7fa8d00cc880 2024-04-02T07:34:14.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.843+0000 7fa8d5400640 1 -- 172.21.15.55:0/3064963394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d006cf00 con 0x7fa8d00cc880 2024-04-02T07:34:14.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.843+0000 7fa8ccc00640 1 -- 172.21.15.55:0/3064963394 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa8b800bd30 con 0x7fa8d00cc880 2024-04-02T07:34:14.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.843+0000 7fa8ccc00640 1 --2- 172.21.15.55:0/3064963394 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8ac066690 0x7fa8ac068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:14.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.843+0000 7fa8ccc00640 1 -- 172.21.15.55:0/3064963394 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fa8b8084670 con 0x7fa8d00cc880 2024-04-02T07:34:14.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.847+0000 7fa8cfe00640 1 --2- 172.21.15.55:0/3064963394 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8ac066690 0x7fa8ac068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:14.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.847+0000 7fa8cfe00640 1 --2- 172.21.15.55:0/3064963394 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8ac066690 0x7fa8ac068b50 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0007fd0 tx=0x7fa8c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:14.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:14.847+0000 7fa8ccc00640 1 -- 172.21.15.55:0/3064963394 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa8b8051960 con 0x7fa8d00cc880 2024-04-02T07:34:15.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.011+0000 7fa8d5400640 1 -- 172.21.15.55:0/3064963394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8d015bb30 con 0x7fa8d00cc880 2024-04-02T07:34:15.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.011+0000 7fa8ccc00640 1 -- 172.21.15.55:0/3064963394 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa8b8054f80 con 0x7fa8d00cc880 2024-04-02T07:34:15.012 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:34:15.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.015+0000 7fa8d5400640 1 -- 172.21.15.55:0/3064963394 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8ac066690 msgr2=0x7fa8ac068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:15.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.015+0000 7fa8d5400640 1 --2- 172.21.15.55:0/3064963394 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8ac066690 0x7fa8ac068b50 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0007fd0 tx=0x7fa8c0009040 comp rx=0 tx=0).stop 2024-04-02T07:34:15.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.015+0000 7fa8d5400640 1 -- 172.21.15.55:0/3064963394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d00cc880 msgr2=0x7fa8d015a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:15.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.015+0000 7fa8d5400640 1 --2- 172.21.15.55:0/3064963394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d00cc880 0x7fa8d015a4b0 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fa8b800d800 tx=0x7fa8b800dcc0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.015+0000 7fa8d5400640 1 -- 172.21.15.55:0/3064963394 shutdown_connections 2024-04-02T07:34:15.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.015+0000 7fa8d5400640 1 --2- 172.21.15.55:0/3064963394 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8ac066690 0x7fa8ac068b50 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.015+0000 7fa8d5400640 1 --2- 172.21.15.55:0/3064963394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8d015c130 0x7fa8d00b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.015+0000 7fa8d5400640 1 --2- 172.21.15.55:0/3064963394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d00cc880 0x7fa8d015a4b0 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.015+0000 7fa8d5400640 1 --2- 172.21.15.55:0/3064963394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8d0098a10 0x7fa8d014de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.015+0000 7fa8d5400640 1 -- 172.21.15.55:0/3064963394 >> 172.21.15.55:0/3064963394 conn(0x7fa8d00b1fb0 msgr2=0x7fa8d0072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:15.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.015+0000 7fa8d5400640 1 -- 172.21.15.55:0/3064963394 shutdown_connections 2024-04-02T07:34:15.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.015+0000 7fa8d5400640 1 -- 172.21.15.55:0/3064963394 wait complete. 2024-04-02T07:34:15.032 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:34:15.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.175+0000 7f7e9ca00640 1 Processor -- start 2024-04-02T07:34:15.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.175+0000 7f7e9ca00640 1 -- start start 2024-04-02T07:34:15.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.179+0000 7f7e9ca00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e9806e4f0 0x7f7e98065a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:15.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.179+0000 7f7e9ca00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7e98161490 0x7f7e9806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:15.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.179+0000 7f7e9ca00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e980660d0 con 0x7f7e9815cd20 2024-04-02T07:34:15.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.179+0000 7f7e9ca00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e981607a0 con 0x7f7e9806e4f0 2024-04-02T07:34:15.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.179+0000 7f7e9ca00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e980ae8d0 con 0x7f7e98161490 2024-04-02T07:34:15.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.179+0000 7f7e8fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e9806e4f0 0x7f7e98065a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:15.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.179+0000 7f7e8fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7e9806e4f0 0x7f7e98065a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57574/0 (socket says 172.21.15.55:57574) 2024-04-02T07:34:15.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.179+0000 7f7e8fe00640 1 -- 172.21.15.55:0/2536422121 learned_addr learned my addr 172.21.15.55:0/2536422121 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:15.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.179+0000 7f7e96800640 1 --2- 172.21.15.55:0/2536422121 >> v2:172.21.15.106:3300/0 conn(0x7f7e98161490 0x7f7e9806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:15.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.179+0000 7f7e8fe00640 1 -- 172.21.15.55:0/2536422121 >> v2:172.21.15.106:3300/0 conn(0x7f7e98161490 msgr2=0x7f7e9806d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:15.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.179+0000 7f7e8fe00640 1 --2- 172.21.15.55:0/2536422121 >> v2:172.21.15.106:3300/0 conn(0x7f7e98161490 0x7f7e9806d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.179+0000 7f7e8fe00640 1 -- 172.21.15.55:0/2536422121 >> v1:172.21.15.106:6789/0 conn(0x7f7e9815cd20 legacy=0x7f7e9806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:15.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.179+0000 7f7e8fe00640 1 -- 172.21.15.55:0/2536422121 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e981609b0 con 0x7f7e9806e4f0 2024-04-02T07:34:15.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.179+0000 7f7e96800640 1 --2- 172.21.15.55:0/2536422121 >> v2:172.21.15.106:3300/0 conn(0x7f7e98161490 0x7f7e9806d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:15.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e8fe00640 1 --2- 172.21.15.55:0/2536422121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9806e4f0 0x7f7e98065a80 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f7e980b41c0 tx=0x7f7e8001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=564ee1a25044bf9a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:15.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e95400640 1 -- 172.21.15.55:0/2536422121 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e800ac640 con 0x7f7e9806e4f0 2024-04-02T07:34:15.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e95400640 1 -- 172.21.15.55:0/2536422121 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e800ac7a0 con 0x7f7e9806e4f0 2024-04-02T07:34:15.182 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e95400640 1 -- 172.21.15.55:0/2536422121 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e800acb30 con 0x7f7e9806e4f0 2024-04-02T07:34:15.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e9ca00640 1 -- 172.21.15.55:0/2536422121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9806e4f0 msgr2=0x7f7e98065a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:15.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e9ca00640 1 --2- 172.21.15.55:0/2536422121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9806e4f0 0x7f7e98065a80 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f7e980b41c0 tx=0x7f7e8001c520 comp rx=0 tx=0).stop 2024-04-02T07:34:15.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e9ca00640 1 -- 172.21.15.55:0/2536422121 shutdown_connections 2024-04-02T07:34:15.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e9ca00640 1 --2- 172.21.15.55:0/2536422121 >> v2:172.21.15.106:3300/0 conn(0x7f7e98161490 0x7f7e9806d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e9ca00640 1 --2- 172.21.15.55:0/2536422121 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9806e4f0 0x7f7e98065a80 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e9ca00640 1 -- 172.21.15.55:0/2536422121 >> 172.21.15.55:0/2536422121 conn(0x7f7e980ced90 msgr2=0x7f7e980cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:15.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e9ca00640 1 -- 172.21.15.55:0/2536422121 shutdown_connections 2024-04-02T07:34:15.184 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e9ca00640 1 -- 172.21.15.55:0/2536422121 wait complete. 2024-04-02T07:34:15.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e9ca00640 1 Processor -- start 2024-04-02T07:34:15.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e9ca00640 1 -- start start 2024-04-02T07:34:15.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e9ca00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e9806e4f0 0x7f7e9814c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:15.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e9ca00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9815cd20 0x7f7e98147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:15.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e9ca00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e98161490 0x7f7e980b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:15.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e9ca00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9814c6a0 con 0x7f7e9815cd20 2024-04-02T07:34:15.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e9ca00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e98148b10 con 0x7f7e98161490 2024-04-02T07:34:15.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e9ca00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e980abdf0 con 0x7f7e9806e4f0 2024-04-02T07:34:15.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e8fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9815cd20 0x7f7e98147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:15.190 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.183+0000 7f7e8fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9815cd20 0x7f7e98147f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57590/0 (socket says 172.21.15.55:57590) 2024-04-02T07:34:15.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.187+0000 7f7e8fe00640 1 -- 172.21.15.55:0/4066369139 learned_addr learned my addr 172.21.15.55:0/4066369139 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:15.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.187+0000 7f7e96800640 1 --2- 172.21.15.55:0/4066369139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e98161490 0x7f7e980b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:15.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.187+0000 7f7e95e00640 1 --2- 172.21.15.55:0/4066369139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e9806e4f0 0x7f7e9814c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:15.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.187+0000 7f7e8fe00640 1 -- 172.21.15.55:0/4066369139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e9806e4f0 msgr2=0x7f7e9814c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:15.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.187+0000 7f7e8fe00640 1 --2- 172.21.15.55:0/4066369139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e9806e4f0 0x7f7e9814c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.187+0000 7f7e8fe00640 1 -- 172.21.15.55:0/4066369139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e98161490 msgr2=0x7f7e980b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:15.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.187+0000 7f7e8fe00640 1 --2- 172.21.15.55:0/4066369139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e98161490 0x7f7e980b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.187+0000 7f7e8fe00640 1 -- 172.21.15.55:0/4066369139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e800094d0 con 0x7f7e9815cd20 2024-04-02T07:34:15.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.187+0000 7f7e96800640 1 --2- 172.21.15.55:0/4066369139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e98161490 0x7f7e980b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:15.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.187+0000 7f7e8fe00640 1 --2- 172.21.15.55:0/4066369139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9815cd20 0x7f7e98147f50 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f7e80019130 tx=0x7f7e800192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:15.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.187+0000 7f7e8e000640 1 -- 172.21.15.55:0/4066369139 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e800b5640 con 0x7f7e9815cd20 2024-04-02T07:34:15.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.187+0000 7f7e8e000640 1 -- 172.21.15.55:0/4066369139 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e800b57a0 con 0x7f7e9815cd20 2024-04-02T07:34:15.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.187+0000 7f7e8e000640 1 -- 172.21.15.55:0/4066369139 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e800b5b50 con 0x7f7e9815cd20 2024-04-02T07:34:15.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.187+0000 7f7e9ca00640 1 -- 172.21.15.55:0/4066369139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e980ac0d0 con 0x7f7e9815cd20 2024-04-02T07:34:15.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.187+0000 7f7e9ca00640 1 -- 172.21.15.55:0/4066369139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e980ac690 con 0x7f7e9815cd20 2024-04-02T07:34:15.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.187+0000 7f7e9ca00640 1 -- 172.21.15.55:0/4066369139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e980cc770 con 0x7f7e9815cd20 2024-04-02T07:34:15.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.187+0000 7f7e8e000640 1 -- 172.21.15.55:0/4066369139 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f7e800b3070 con 0x7f7e9815cd20 2024-04-02T07:34:15.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.191+0000 7f7e8e000640 1 --2- 172.21.15.55:0/4066369139 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e74066690 0x7f7e74068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:15.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.191+0000 7f7e8e000640 1 -- 172.21.15.55:0/4066369139 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f7e8011e3d0 con 0x7f7e9815cd20 2024-04-02T07:34:15.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.191+0000 7f7e95e00640 1 --2- 172.21.15.55:0/4066369139 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e74066690 0x7f7e74068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:15.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.191+0000 7f7e95e00640 1 --2- 172.21.15.55:0/4066369139 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e74066690 0x7f7e74068b50 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f7e88000f70 tx=0x7f7e88009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:15.195 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.195+0000 7f7e8e000640 1 -- 172.21.15.55:0/4066369139 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7e800eb620 con 0x7f7e9815cd20 2024-04-02T07:34:15.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.355+0000 7f7e9ca00640 1 -- 172.21.15.55:0/4066369139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7e980ac880 con 0x7f7e9815cd20 2024-04-02T07:34:15.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.355+0000 7f7e8e000640 1 -- 172.21.15.55:0/4066369139 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v119) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7e800b5cb0 con 0x7f7e9815cd20 2024-04-02T07:34:15.354 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:34:15.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.355+0000 7f7e9ca00640 1 -- 172.21.15.55:0/4066369139 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e74066690 msgr2=0x7f7e74068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:15.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.355+0000 7f7e9ca00640 1 --2- 172.21.15.55:0/4066369139 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e74066690 0x7f7e74068b50 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f7e88000f70 tx=0x7f7e88009040 comp rx=0 tx=0).stop 2024-04-02T07:34:15.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.355+0000 7f7e9ca00640 1 -- 172.21.15.55:0/4066369139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9815cd20 msgr2=0x7f7e98147f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:15.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.355+0000 7f7e9ca00640 1 --2- 172.21.15.55:0/4066369139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9815cd20 0x7f7e98147f50 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7f7e80019130 tx=0x7f7e800192c0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.359+0000 7f7e9ca00640 1 -- 172.21.15.55:0/4066369139 shutdown_connections 2024-04-02T07:34:15.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.359+0000 7f7e9ca00640 1 --2- 172.21.15.55:0/4066369139 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7e74066690 0x7f7e74068b50 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.359+0000 7f7e9ca00640 1 --2- 172.21.15.55:0/4066369139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7e98161490 0x7f7e980b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.359+0000 7f7e9ca00640 1 --2- 172.21.15.55:0/4066369139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7e9815cd20 0x7f7e98147f50 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.359+0000 7f7e9ca00640 1 --2- 172.21.15.55:0/4066369139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7e9806e4f0 0x7f7e9814c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.359+0000 7f7e9ca00640 1 -- 172.21.15.55:0/4066369139 >> 172.21.15.55:0/4066369139 conn(0x7f7e980ced90 msgr2=0x7f7e98155d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:15.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.359+0000 7f7e9ca00640 1 -- 172.21.15.55:0/4066369139 shutdown_connections 2024-04-02T07:34:15.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.359+0000 7f7e9ca00640 1 -- 172.21.15.55:0/4066369139 wait complete. 2024-04-02T07:34:15.374 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:34:15.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8809800640 1 Processor -- start 2024-04-02T07:34:15.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8809800640 1 -- start start 2024-04-02T07:34:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8809800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f88040b31a0 0x7f8804165730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8809800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880415e3a0 con 0x7f8804144260 2024-04-02T07:34:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8809800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f880415e5f0 con 0x7f88040709b0 2024-04-02T07:34:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8809800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88040b37c0 con 0x7f88040b31a0 2024-04-02T07:34:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802a00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8804144260 0x7f88040702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46168/0 (socket says 172.21.15.55:46168) 2024-04-02T07:34:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802a00640 1 -- 172.21.15.55:0/4095020197 learned_addr learned my addr 172.21.15.55:0/4095020197 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8803400640 1 --2- 172.21.15.55:0/4095020197 >> v2:172.21.15.106:3300/0 conn(0x7f88040b31a0 0x7f8804165730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802000640 1 -- 172.21.15.55:0/4095020197 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078785286 0 0) 0x7f880415e3a0 con 0x7f8804144260 2024-04-02T07:34:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802000640 1 -- 172.21.15.55:0/4095020197 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87e8003530 con 0x7f8804144260 2024-04-02T07:34:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802000640 1 -- 172.21.15.55:0/4095020197 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1254186201 0 0) 0x7f87e8003530 con 0x7f8804144260 2024-04-02T07:34:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802000640 1 -- 172.21.15.55:0/4095020197 >> v2:172.21.15.106:3300/0 conn(0x7f88040b31a0 msgr2=0x7f8804165730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:15.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802000640 1 --2- 172.21.15.55:0/4095020197 >> v2:172.21.15.106:3300/0 conn(0x7f88040b31a0 0x7f8804165730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802000640 1 -- 172.21.15.55:0/4095020197 >> v1:172.21.15.106:6789/0 conn(0x7f88040709b0 legacy=0x7f88040b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:15.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802000640 1 -- 172.21.15.55:0/4095020197 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f880415e8d0 con 0x7f8804144260 2024-04-02T07:34:15.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802000640 1 -- 172.21.15.55:0/4095020197 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f87f4001680 con 0x7f8804144260 2024-04-02T07:34:15.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802000640 1 -- 172.21.15.55:0/4095020197 >> v1:172.21.15.55:6789/0 conn(0x7f8804144260 legacy=0x7f88040702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:15.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802000640 1 --2- 172.21.15.55:0/4095020197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e8003980 0x7f87e8003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:15.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802000640 1 --2- 172.21.15.55:0/4095020197 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87e80047d0 0x7f87e8004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:15.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802000640 1 --2- 172.21.15.55:0/4095020197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87e8005190 0x7f87e800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:15.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802000640 1 -- 172.21.15.55:0/4095020197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88040b37c0 con 0x7f87e8003980 2024-04-02T07:34:15.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802000640 1 -- 172.21.15.55:0/4095020197 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e800c030 con 0x7f87e8005190 2024-04-02T07:34:15.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802000640 1 -- 172.21.15.55:0/4095020197 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87e800c1f0 con 0x7f87e80047d0 2024-04-02T07:34:15.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802a00640 1 --2- 172.21.15.55:0/4095020197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e8003980 0x7f87e8003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:15.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f87fa000640 1 --2- 172.21.15.55:0/4095020197 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87e80047d0 0x7f87e8004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:15.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8803400640 1 --2- 172.21.15.55:0/4095020197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87e8005190 0x7f87e800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:15.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802a00640 1 -- 172.21.15.55:0/4095020197 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87e80047d0 msgr2=0x7f87e8004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:15.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802a00640 1 --2- 172.21.15.55:0/4095020197 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87e80047d0 0x7f87e8004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802a00640 1 -- 172.21.15.55:0/4095020197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87e8005190 msgr2=0x7f87e800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:15.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802a00640 1 --2- 172.21.15.55:0/4095020197 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f87e8005190 0x7f87e800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8802a00640 1 -- 172.21.15.55:0/4095020197 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e8003530 con 0x7f87e8003980 2024-04-02T07:34:15.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f8803400640 1 -- 172.21.15.55:0/4095020197 reap_dead start 2024-04-02T07:34:15.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.523+0000 7f87fa000640 1 --2- 172.21.15.55:0/4095020197 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f87e80047d0 0x7f87e8004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:15.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.527+0000 7f8802a00640 1 --2- 172.21.15.55:0/4095020197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e8003980 0x7f87e8003da0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f87f400c240 tx=0x7f87f401cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f65ea92ba7f695a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:15.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.527+0000 7f8802000640 1 -- 172.21.15.55:0/4095020197 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f4005ae0 con 0x7f87e8003980 2024-04-02T07:34:15.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.527+0000 7f8802000640 1 -- 172.21.15.55:0/4095020197 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f4005c40 con 0x7f87e8003980 2024-04-02T07:34:15.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.527+0000 7f8802000640 1 -- 172.21.15.55:0/4095020197 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f40072b0 con 0x7f87e8003980 2024-04-02T07:34:15.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.527+0000 7f8809800640 1 -- 172.21.15.55:0/4095020197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e8003980 msgr2=0x7f87e8003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:15.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.527+0000 7f8809800640 1 --2- 172.21.15.55:0/4095020197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e8003980 0x7f87e8003da0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f87f400c240 tx=0x7f87f401cbe0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.527+0000 7f8809800640 1 -- 172.21.15.55:0/4095020197 shutdown_connections 2024-04-02T07:34:15.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.527+0000 7f8809800640 1 --2- 172.21.15.55:0/4095020197 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e8003980 0x7f87e8003da0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.527+0000 7f8809800640 1 -- 172.21.15.55:0/4095020197 >> 172.21.15.55:0/4095020197 conn(0x7f880406a390 msgr2=0x7f88040b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:15.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.527+0000 7f8809800640 1 -- 172.21.15.55:0/4095020197 shutdown_connections 2024-04-02T07:34:15.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.527+0000 7f8809800640 1 -- 172.21.15.55:0/4095020197 wait complete. 2024-04-02T07:34:15.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f8809800640 1 Processor -- start 2024-04-02T07:34:15.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f8809800640 1 -- start start 2024-04-02T07:34:15.531 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f8809800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e8003980 0x7f8804139a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:15.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f8809800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88041579f0 0x7f88041e6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:15.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f8809800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f880406e0a0 0x7f880413f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:15.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f8809800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8804157560 con 0x7f87e8003980 2024-04-02T07:34:15.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f8809800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8804156c30 con 0x7f880406e0a0 2024-04-02T07:34:15.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f8809800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8804156f10 con 0x7f88041579f0 2024-04-02T07:34:15.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f8802a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e8003980 0x7f8804139a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:15.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f8802a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e8003980 0x7f8804139a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57608/0 (socket says 172.21.15.55:57608) 2024-04-02T07:34:15.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f8802a00640 1 -- 172.21.15.55:0/1942238457 learned_addr learned my addr 172.21.15.55:0/1942238457 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:15.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f8803400640 1 --2- 172.21.15.55:0/1942238457 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f880406e0a0 0x7f880413f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:15.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f87fa000640 1 --2- 172.21.15.55:0/1942238457 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88041579f0 0x7f88041e6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:15.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f8802a00640 1 -- 172.21.15.55:0/1942238457 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88041579f0 msgr2=0x7f88041e6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:15.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f8802a00640 1 --2- 172.21.15.55:0/1942238457 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88041579f0 0x7f88041e6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f8802a00640 1 -- 172.21.15.55:0/1942238457 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f880406e0a0 msgr2=0x7f880413f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:15.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f8802a00640 1 --2- 172.21.15.55:0/1942238457 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f880406e0a0 0x7f880413f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f8802a00640 1 -- 172.21.15.55:0/1942238457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88041571f0 con 0x7f87e8003980 2024-04-02T07:34:15.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f8802a00640 1 --2- 172.21.15.55:0/1942238457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e8003980 0x7f8804139a00 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f87f400c240 tx=0x7f87e8005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:15.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f87fb400640 1 -- 172.21.15.55:0/1942238457 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f40b4070 con 0x7f87e8003980 2024-04-02T07:34:15.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f87fb400640 1 -- 172.21.15.55:0/1942238457 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87f4001480 con 0x7f87e8003980 2024-04-02T07:34:15.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f87fb400640 1 -- 172.21.15.55:0/1942238457 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87f40072d0 con 0x7f87e8003980 2024-04-02T07:34:15.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f8809800640 1 -- 172.21.15.55:0/1942238457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88041e6c70 con 0x7f87e8003980 2024-04-02T07:34:15.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.531+0000 7f8809800640 1 -- 172.21.15.55:0/1942238457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88041e6960 con 0x7f87e8003980 2024-04-02T07:34:15.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.535+0000 7f8809800640 1 -- 172.21.15.55:0/1942238457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8804073530 con 0x7f87e8003980 2024-04-02T07:34:15.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.535+0000 7f87fb400640 1 -- 172.21.15.55:0/1942238457 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f87f4007430 con 0x7f87e8003980 2024-04-02T07:34:15.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.535+0000 7f87fb400640 1 --2- 172.21.15.55:0/1942238457 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f87e00666c0 0x7f87e0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:15.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.535+0000 7f87fb400640 1 -- 172.21.15.55:0/1942238457 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f87f411dc00 con 0x7f87e8003980 2024-04-02T07:34:15.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.535+0000 7f87fa000640 1 --2- 172.21.15.55:0/1942238457 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f87e00666c0 0x7f87e0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:15.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.535+0000 7f87fa000640 1 --2- 172.21.15.55:0/1942238457 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f87e00666c0 0x7f87e0068b80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f88041f9230 tx=0x7f87ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:15.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.539+0000 7f87fb400640 1 -- 172.21.15.55:0/1942238457 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f87f40eaf50 con 0x7f87e8003980 2024-04-02T07:34:15.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.699+0000 7f8809800640 1 -- 172.21.15.55:0/1942238457 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8804066c90 con 0x7f87e8003980 2024-04-02T07:34:15.700 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.699+0000 7f87fb400640 1 -- 172.21.15.55:0/1942238457 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v119) v1 ==== 100+0+11 (secure 0 0 0) 0x7f87f40ee570 con 0x7f87e8003980 2024-04-02T07:34:15.700 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:34:15.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.703+0000 7f8809800640 1 -- 172.21.15.55:0/1942238457 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f87e00666c0 msgr2=0x7f87e0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:15.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.703+0000 7f8809800640 1 --2- 172.21.15.55:0/1942238457 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f87e00666c0 0x7f87e0068b80 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f88041f9230 tx=0x7f87ec009040 comp rx=0 tx=0).stop 2024-04-02T07:34:15.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.703+0000 7f8809800640 1 -- 172.21.15.55:0/1942238457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e8003980 msgr2=0x7f8804139a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:15.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.703+0000 7f8809800640 1 --2- 172.21.15.55:0/1942238457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e8003980 0x7f8804139a00 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f87f400c240 tx=0x7f87e8005800 comp rx=0 tx=0).stop 2024-04-02T07:34:15.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.703+0000 7f8809800640 1 -- 172.21.15.55:0/1942238457 shutdown_connections 2024-04-02T07:34:15.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.703+0000 7f8809800640 1 --2- 172.21.15.55:0/1942238457 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f87e00666c0 0x7f87e0068b80 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.703+0000 7f8809800640 1 --2- 172.21.15.55:0/1942238457 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f880406e0a0 0x7f880413f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.703+0000 7f8809800640 1 --2- 172.21.15.55:0/1942238457 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f88041579f0 0x7f88041e6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.703+0000 7f8809800640 1 --2- 172.21.15.55:0/1942238457 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f87e8003980 0x7f8804139a00 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.703+0000 7f8809800640 1 -- 172.21.15.55:0/1942238457 >> 172.21.15.55:0/1942238457 conn(0x7f880406a390 msgr2=0x7f8804143220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:15.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.703+0000 7f8809800640 1 -- 172.21.15.55:0/1942238457 shutdown_connections 2024-04-02T07:34:15.703 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.703+0000 7f8809800640 1 -- 172.21.15.55:0/1942238457 wait complete. 2024-04-02T07:34:15.723 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:34:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.867+0000 7f2620c00640 1 Processor -- start 2024-04-02T07:34:15.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.867+0000 7f2620c00640 1 -- start start 2024-04-02T07:34:15.867 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.867+0000 7f2620c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f261c15cb20 0x7f261c0ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:15.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.867+0000 7f2620c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f261c0cad50 0x7f261c0cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:15.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.867+0000 7f2620c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f261c0cea70 con 0x7f261c0b0620 2024-04-02T07:34:15.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.867+0000 7f2620c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f261c0b13a0 con 0x7f261c0cad50 2024-04-02T07:34:15.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.867+0000 7f2620c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c0b1680 con 0x7f261c15cb20 2024-04-02T07:34:15.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.867+0000 7f261a800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f261c0b0620 0x7f261c0b0ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48016/0 (socket says 172.21.15.55:48016) 2024-04-02T07:34:15.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.867+0000 7f261a800640 1 -- 172.21.15.55:0/3817772184 learned_addr learned my addr 172.21.15.55:0/3817772184 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:15.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.867+0000 7f2619400640 1 --2- 172.21.15.55:0/3817772184 >> v2:172.21.15.106:3300/0 conn(0x7f261c0cad50 0x7f261c0cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:15.868 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.867+0000 7f2619e00640 1 --2- 172.21.15.55:0/3817772184 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f261c15cb20 0x7f261c0ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:15.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.867+0000 7f2618a00640 1 -- 172.21.15.55:0/3817772184 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 97522820 0 0) 0x7f261c0cea70 con 0x7f261c0b0620 2024-04-02T07:34:15.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.867+0000 7f2618a00640 1 -- 172.21.15.55:0/3817772184 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2600003530 con 0x7f261c0b0620 2024-04-02T07:34:15.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.867+0000 7f2619400640 1 -- 172.21.15.55:0/3817772184 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f261c15cb20 msgr2=0x7f261c0ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:15.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.867+0000 7f2619400640 1 --2- 172.21.15.55:0/3817772184 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f261c15cb20 0x7f261c0ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.867+0000 7f2619400640 1 -- 172.21.15.55:0/3817772184 >> v1:172.21.15.55:6789/0 conn(0x7f261c0b0620 legacy=0x7f261c0b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:15.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.867+0000 7f2619400640 1 -- 172.21.15.55:0/3817772184 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f261c0cecf0 con 0x7f261c0cad50 2024-04-02T07:34:15.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.867+0000 7f2619e00640 1 --2- 172.21.15.55:0/3817772184 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f261c15cb20 0x7f261c0ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:34:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.871+0000 7f2619400640 1 --2- 172.21.15.55:0/3817772184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f261c0cad50 0x7f261c0cd4c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f26080097c0 tx=0x7f260801c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3e5e06a4249624a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.871+0000 7f2618a00640 1 -- 172.21.15.55:0/3817772184 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26080aa620 con 0x7f261c0cad50 2024-04-02T07:34:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.871+0000 7f2618a00640 1 -- 172.21.15.55:0/3817772184 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26080aa780 con 0x7f261c0cad50 2024-04-02T07:34:15.871 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.871+0000 7f2618a00640 1 -- 172.21.15.55:0/3817772184 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26080aab10 con 0x7f261c0cad50 2024-04-02T07:34:15.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.871+0000 7f2620c00640 1 -- 172.21.15.55:0/3817772184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f261c0cad50 msgr2=0x7f261c0cd4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:15.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.871+0000 7f2620c00640 1 --2- 172.21.15.55:0/3817772184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f261c0cad50 0x7f261c0cd4c0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f26080097c0 tx=0x7f260801c4a0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.871+0000 7f2620c00640 1 -- 172.21.15.55:0/3817772184 shutdown_connections 2024-04-02T07:34:15.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.871+0000 7f2620c00640 1 --2- 172.21.15.55:0/3817772184 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f261c0cad50 0x7f261c0cd4c0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.871+0000 7f2620c00640 1 --2- 172.21.15.55:0/3817772184 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f261c15cb20 0x7f261c0ccf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.872 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.871+0000 7f2620c00640 1 -- 172.21.15.55:0/3817772184 >> 172.21.15.55:0/3817772184 conn(0x7f261c0d0700 msgr2=0x7f261c0d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:15.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.871+0000 7f2620c00640 1 -- 172.21.15.55:0/3817772184 shutdown_connections 2024-04-02T07:34:15.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.871+0000 7f2620c00640 1 -- 172.21.15.55:0/3817772184 wait complete. 2024-04-02T07:34:15.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2620c00640 1 Processor -- start 2024-04-02T07:34:15.873 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2620c00640 1 -- start start 2024-04-02T07:34:15.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2620c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f261c0b0620 0x7f261c154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:15.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2620c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f261c0cad50 0x7f261c06ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:15.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2620c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f261c15cb20 0x7f261c15dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:15.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2620c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c154aa0 con 0x7f261c0b0620 2024-04-02T07:34:15.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2620c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f261c06f160 con 0x7f261c0cad50 2024-04-02T07:34:15.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2620c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f261c15f920 con 0x7f261c15cb20 2024-04-02T07:34:15.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2619e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f261c0b0620 0x7f261c154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:15.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2619e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f261c0b0620 0x7f261c154c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49572/0 (socket says 172.21.15.55:49572) 2024-04-02T07:34:15.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2619e00640 1 -- 172.21.15.55:0/2439830033 learned_addr learned my addr 172.21.15.55:0/2439830033 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:15.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2619400640 1 --2- 172.21.15.55:0/2439830033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f261c0cad50 0x7f261c06ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:15.876 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f261a800640 1 --2- 172.21.15.55:0/2439830033 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f261c15cb20 0x7f261c15dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:15.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2619e00640 1 -- 172.21.15.55:0/2439830033 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f261c15cb20 msgr2=0x7f261c15dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:15.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2619e00640 1 --2- 172.21.15.55:0/2439830033 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f261c15cb20 0x7f261c15dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2619e00640 1 -- 172.21.15.55:0/2439830033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f261c0cad50 msgr2=0x7f261c06ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:15.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2619e00640 1 --2- 172.21.15.55:0/2439830033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f261c0cad50 0x7f261c06ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:15.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2619e00640 1 -- 172.21.15.55:0/2439830033 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f260c009420 con 0x7f261c0b0620 2024-04-02T07:34:15.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2619e00640 1 --2- 172.21.15.55:0/2439830033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f261c0b0620 0x7f261c154c20 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f260c00ebe0 tx=0x7f260c00c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:15.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2612000640 1 -- 172.21.15.55:0/2439830033 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c00eee0 con 0x7f261c0b0620 2024-04-02T07:34:15.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2612000640 1 -- 172.21.15.55:0/2439830033 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f260c00cbd0 con 0x7f261c0b0620 2024-04-02T07:34:15.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2620c00640 1 -- 172.21.15.55:0/2439830033 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2608009420 con 0x7f261c0b0620 2024-04-02T07:34:15.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.875+0000 7f2612000640 1 -- 172.21.15.55:0/2439830033 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f260c013470 con 0x7f261c0b0620 2024-04-02T07:34:15.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.879+0000 7f2620c00640 1 -- 172.21.15.55:0/2439830033 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f261c15fbc0 con 0x7f261c0b0620 2024-04-02T07:34:15.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.879+0000 7f2620c00640 1 -- 172.21.15.55:0/2439830033 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f261c160510 con 0x7f261c0b0620 2024-04-02T07:34:15.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.879+0000 7f2612000640 1 -- 172.21.15.55:0/2439830033 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f260c0135d0 con 0x7f261c0b0620 2024-04-02T07:34:15.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.879+0000 7f2612000640 1 --2- 172.21.15.55:0/2439830033 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25fc066690 0x7f25fc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:15.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.879+0000 7f2612000640 1 -- 172.21.15.55:0/2439830033 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f260c084440 con 0x7f261c0b0620 2024-04-02T07:34:15.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.879+0000 7f2619400640 1 --2- 172.21.15.55:0/2439830033 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25fc066690 0x7f25fc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:15.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.883+0000 7f2619400640 1 --2- 172.21.15.55:0/2439830033 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25fc066690 0x7f25fc068b50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f26080ae000 tx=0x7f26080a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:15.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:15.883+0000 7f2612000640 1 -- 172.21.15.55:0/2439830033 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f260c0517c0 con 0x7f261c0b0620 2024-04-02T07:34:16.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.055+0000 7f2620c00640 1 -- 172.21.15.55:0/2439830033 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f261c066c90 con 0x7f261c0b0620 2024-04-02T07:34:16.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.055+0000 7f2612000640 1 -- 172.21.15.55:0/2439830033 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v119) v1 ==== 80+0+122 (secure 0 0 0) 0x7f260c054de0 con 0x7f261c0b0620 2024-04-02T07:34:16.055 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.106:6837/775582321 2024-04-03T07:34:04.807966+0000 2024-04-02T07:34:16.055 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.106:6834/775582321 2024-04-03T07:34:04.807966+0000 2024-04-02T07:34:16.056 INFO:teuthology.orchestra.run.smithi055.stderr:listed 2 entries 2024-04-02T07:34:16.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.059+0000 7f2620c00640 1 -- 172.21.15.55:0/2439830033 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25fc066690 msgr2=0x7f25fc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:16.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.059+0000 7f2620c00640 1 --2- 172.21.15.55:0/2439830033 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25fc066690 0x7f25fc068b50 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f26080ae000 tx=0x7f26080a7000 comp rx=0 tx=0).stop 2024-04-02T07:34:16.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.059+0000 7f2620c00640 1 -- 172.21.15.55:0/2439830033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f261c0b0620 msgr2=0x7f261c154c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:16.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.059+0000 7f2620c00640 1 --2- 172.21.15.55:0/2439830033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f261c0b0620 0x7f261c154c20 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f260c00ebe0 tx=0x7f260c00c520 comp rx=0 tx=0).stop 2024-04-02T07:34:16.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.059+0000 7f2620c00640 1 -- 172.21.15.55:0/2439830033 shutdown_connections 2024-04-02T07:34:16.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.059+0000 7f2620c00640 1 --2- 172.21.15.55:0/2439830033 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f261c15cb20 0x7f261c15dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.059+0000 7f2620c00640 1 --2- 172.21.15.55:0/2439830033 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25fc066690 0x7f25fc068b50 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.059+0000 7f2620c00640 1 --2- 172.21.15.55:0/2439830033 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f261c0cad50 0x7f261c06ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.059+0000 7f2620c00640 1 --2- 172.21.15.55:0/2439830033 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f261c0b0620 0x7f261c154c20 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.059+0000 7f2620c00640 1 -- 172.21.15.55:0/2439830033 >> 172.21.15.55:0/2439830033 conn(0x7f261c0d0700 msgr2=0x7f261c0d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:16.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.059+0000 7f2620c00640 1 -- 172.21.15.55:0/2439830033 shutdown_connections 2024-04-02T07:34:16.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.059+0000 7f2620c00640 1 -- 172.21.15.55:0/2439830033 wait complete. 2024-04-02T07:34:16.076 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:34:16.076 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:34:16.085 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:34:16.161 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:34:16.178 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:34:16.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.271+0000 7f9096200640 1 Processor -- start 2024-04-02T07:34:16.272 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.271+0000 7f9096200640 1 -- start start 2024-04-02T07:34:16.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.275+0000 7f9096200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f909015eaf0 0x7f909015b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:16.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.275+0000 7f9096200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f909015b910 0x7f90900afff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:16.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.275+0000 7f9096200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f909006c5f0 con 0x7f909015eed0 2024-04-02T07:34:16.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.275+0000 7f9096200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f909006d270 con 0x7f909015eaf0 2024-04-02T07:34:16.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.275+0000 7f9096200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90900710f0 con 0x7f909015b910 2024-04-02T07:34:16.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.275+0000 7f9094e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f909015eaf0 0x7f909015b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:16.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.275+0000 7f9095800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f909015eed0 0x7f9090143400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48026/0 (socket says 172.21.15.55:48026) 2024-04-02T07:34:16.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.275+0000 7f9095800640 1 -- 172.21.15.55:0/1528235747 learned_addr learned my addr 172.21.15.55:0/1528235747 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:16.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.275+0000 7f9087e00640 1 --2- 172.21.15.55:0/1528235747 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f909015b910 0x7f90900afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:16.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.275+0000 7f9094e00640 1 -- 172.21.15.55:0/1528235747 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f909015b910 msgr2=0x7f90900afff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:16.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.275+0000 7f9094e00640 1 --2- 172.21.15.55:0/1528235747 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f909015b910 0x7f90900afff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.275+0000 7f9094e00640 1 -- 172.21.15.55:0/1528235747 >> v1:172.21.15.55:6789/0 conn(0x7f909015eed0 legacy=0x7f9090143400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:16.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.275+0000 7f9094e00640 1 -- 172.21.15.55:0/1528235747 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f909006c8d0 con 0x7f909015eaf0 2024-04-02T07:34:16.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.275+0000 7f908fe00640 1 -- 172.21.15.55:0/1528235747 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549912517 0 0) 0x7f909006c5f0 con 0x7f909015eed0 2024-04-02T07:34:16.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.279+0000 7f9094e00640 1 --2- 172.21.15.55:0/1528235747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f909015eaf0 0x7f909015b3d0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f90800097c0 tx=0x7f908001c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed96306a0834027b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:16.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.279+0000 7f908fe00640 1 -- 172.21.15.55:0/1528235747 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800ad680 con 0x7f909015eaf0 2024-04-02T07:34:16.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.279+0000 7f908fe00640 1 -- 172.21.15.55:0/1528235747 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90800ad7e0 con 0x7f909015eaf0 2024-04-02T07:34:16.277 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.279+0000 7f908fe00640 1 -- 172.21.15.55:0/1528235747 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800adb70 con 0x7f909015eaf0 2024-04-02T07:34:16.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.279+0000 7f9096200640 1 -- 172.21.15.55:0/1528235747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f909015eaf0 msgr2=0x7f909015b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:16.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.279+0000 7f9096200640 1 --2- 172.21.15.55:0/1528235747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f909015eaf0 0x7f909015b3d0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f90800097c0 tx=0x7f908001c470 comp rx=0 tx=0).stop 2024-04-02T07:34:16.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.279+0000 7f9096200640 1 -- 172.21.15.55:0/1528235747 shutdown_connections 2024-04-02T07:34:16.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.279+0000 7f9096200640 1 --2- 172.21.15.55:0/1528235747 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f909015b910 0x7f90900afff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.279+0000 7f9096200640 1 --2- 172.21.15.55:0/1528235747 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f909015eaf0 0x7f909015b3d0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.278 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.279+0000 7f9096200640 1 -- 172.21.15.55:0/1528235747 >> 172.21.15.55:0/1528235747 conn(0x7f9090066080 msgr2=0x7f9090069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:16.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.279+0000 7f9096200640 1 -- 172.21.15.55:0/1528235747 shutdown_connections 2024-04-02T07:34:16.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.279+0000 7f9096200640 1 -- 172.21.15.55:0/1528235747 wait complete. 2024-04-02T07:34:16.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.279+0000 7f9096200640 1 Processor -- start 2024-04-02T07:34:16.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.279+0000 7f9096200640 1 -- start start 2024-04-02T07:34:16.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9096200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f909015b910 0x7f9090143590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:16.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9096200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f909015eaf0 0x7f909013bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:16.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9096200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f909015eed0 0x7f90901574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:16.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9096200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90901425a0 con 0x7f909015b910 2024-04-02T07:34:16.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9096200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909013fe30 con 0x7f909015eaf0 2024-04-02T07:34:16.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9096200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90901427d0 con 0x7f909015eed0 2024-04-02T07:34:16.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9094e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f909015b910 0x7f9090143590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:16.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9094e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f909015b910 0x7f9090143590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49598/0 (socket says 172.21.15.55:49598) 2024-04-02T07:34:16.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9094e00640 1 -- 172.21.15.55:0/957453579 learned_addr learned my addr 172.21.15.55:0/957453579 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:16.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9095800640 1 --2- 172.21.15.55:0/957453579 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f909015eed0 0x7f90901574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:16.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9087e00640 1 --2- 172.21.15.55:0/957453579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f909015eaf0 0x7f909013bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:16.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9094e00640 1 -- 172.21.15.55:0/957453579 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f909015eed0 msgr2=0x7f90901574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:16.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9094e00640 1 --2- 172.21.15.55:0/957453579 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f909015eed0 0x7f90901574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9094e00640 1 -- 172.21.15.55:0/957453579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f909015eaf0 msgr2=0x7f909013bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:16.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9094e00640 1 --2- 172.21.15.55:0/957453579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f909015eaf0 0x7f909013bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9094e00640 1 -- 172.21.15.55:0/957453579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9080009420 con 0x7f909015b910 2024-04-02T07:34:16.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9087e00640 1 --2- 172.21.15.55:0/957453579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f909015eaf0 0x7f909013bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:16.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9095800640 1 --2- 172.21.15.55:0/957453579 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f909015eed0 0x7f90901574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:16.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9094e00640 1 --2- 172.21.15.55:0/957453579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f909015b910 0x7f9090143590 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f908001ab20 tx=0x7f9080019210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:16.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f908d600640 1 -- 172.21.15.55:0/957453579 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800ade20 con 0x7f909015b910 2024-04-02T07:34:16.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f908d600640 1 -- 172.21.15.55:0/957453579 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9080004030 con 0x7f909015b910 2024-04-02T07:34:16.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9096200640 1 -- 172.21.15.55:0/957453579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9090142ab0 con 0x7f909015b910 2024-04-02T07:34:16.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f908d600640 1 -- 172.21.15.55:0/957453579 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90800043a0 con 0x7f909015b910 2024-04-02T07:34:16.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9096200640 1 -- 172.21.15.55:0/957453579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9090143070 con 0x7f909015b910 2024-04-02T07:34:16.283 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f9096200640 1 -- 172.21.15.55:0/957453579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90900738f0 con 0x7f909015b910 2024-04-02T07:34:16.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.283+0000 7f908d600640 1 -- 172.21.15.55:0/957453579 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f90800b4040 con 0x7f909015b910 2024-04-02T07:34:16.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.287+0000 7f908d600640 1 --2- 172.21.15.55:0/957453579 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f906c066690 0x7f906c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:16.284 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.287+0000 7f908d600640 1 -- 172.21.15.55:0/957453579 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f908011da20 con 0x7f909015b910 2024-04-02T07:34:16.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.287+0000 7f9087e00640 1 --2- 172.21.15.55:0/957453579 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f906c066690 0x7f906c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:16.285 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.287+0000 7f9087e00640 1 --2- 172.21.15.55:0/957453579 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f906c066690 0x7f906c068b50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f909013fab0 tx=0x7f9078008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:16.289 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.291+0000 7f908d600640 1 -- 172.21.15.55:0/957453579 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f90800eac60 con 0x7f909015b910 2024-04-02T07:34:16.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.451+0000 7f9096200640 1 -- 172.21.15.55:0/957453579 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90900b0c60 con 0x7f909015b910 2024-04-02T07:34:16.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.451+0000 7f908d600640 1 -- 172.21.15.55:0/957453579 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v119) v1 ==== 74+0+16281 (secure 0 0 0) 0x7f90800be090 con 0x7f909015b910 2024-04-02T07:34:16.451 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:16.452 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":119,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:34:04.808004+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:33:26.384276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-02T07:33:26.835969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.7","mappings":[{"from":0,"to":5}]},{"pgid":"17.21","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.106:6837/775582321":"2024-04-03T07:34:04.807966+0000","172.21.15.106:6834/775582321":"2024-04-03T07:34:04.807966+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:34:16.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.455+0000 7f9096200640 1 -- 172.21.15.55:0/957453579 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f906c066690 msgr2=0x7f906c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.455+0000 7f9096200640 1 --2- 172.21.15.55:0/957453579 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f906c066690 0x7f906c068b50 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f909013fab0 tx=0x7f9078008040 comp rx=0 tx=0).stop 2024-04-02T07:34:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.455+0000 7f9096200640 1 -- 172.21.15.55:0/957453579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f909015b910 msgr2=0x7f9090143590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.455+0000 7f9096200640 1 --2- 172.21.15.55:0/957453579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f909015b910 0x7f9090143590 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f908001ab20 tx=0x7f9080019210 comp rx=0 tx=0).stop 2024-04-02T07:34:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.455+0000 7f9096200640 1 -- 172.21.15.55:0/957453579 shutdown_connections 2024-04-02T07:34:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.455+0000 7f9096200640 1 --2- 172.21.15.55:0/957453579 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f909015eed0 0x7f90901574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.455+0000 7f9096200640 1 --2- 172.21.15.55:0/957453579 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f906c066690 0x7f906c068b50 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.455+0000 7f9096200640 1 --2- 172.21.15.55:0/957453579 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f909015eaf0 0x7f909013bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.455+0000 7f9096200640 1 --2- 172.21.15.55:0/957453579 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f909015b910 0x7f9090143590 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.455+0000 7f9096200640 1 -- 172.21.15.55:0/957453579 >> 172.21.15.55:0/957453579 conn(0x7f9090066080 msgr2=0x7f90900ce490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.455+0000 7f9096200640 1 -- 172.21.15.55:0/957453579 shutdown_connections 2024-04-02T07:34:16.454 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.455+0000 7f9096200640 1 -- 172.21.15.55:0/957453579 wait complete. 2024-04-02T07:34:16.473 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:33:26.384276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:33:26.835969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:34:16.473 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:34:16.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.663+0000 7f1e21200640 1 Processor -- start 2024-04-02T07:34:16.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.663+0000 7f1e21200640 1 -- start start 2024-04-02T07:34:16.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.663+0000 7f1e21200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1e1c15d1f0 0x7f1e1c0b3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:16.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.663+0000 7f1e21200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1c13c9b0 con 0x7f1e1c153c30 2024-04-02T07:34:16.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.663+0000 7f1e21200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e1c0c3b70 con 0x7f1e1c0b3680 2024-04-02T07:34:16.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.663+0000 7f1e21200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e1c0b3b30 con 0x7f1e1c15d1f0 2024-04-02T07:34:16.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.663+0000 7f1e19e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1e1c153c30 0x7f1e1c15a680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48036/0 (socket says 172.21.15.55:48036) 2024-04-02T07:34:16.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.663+0000 7f1e19e00640 1 -- 172.21.15.55:0/509651397 learned_addr learned my addr 172.21.15.55:0/509651397 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:16.663 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.663+0000 7f1e11400640 1 --2- 172.21.15.55:0/509651397 >> v2:172.21.15.106:3300/0 conn(0x7f1e1c15d1f0 0x7f1e1c0b3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:16.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.663+0000 7f1e19400640 1 -- 172.21.15.55:0/509651397 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1238971624 0 0) 0x7f1e0c001120 con 0x7f1e1c153c30 2024-04-02T07:34:16.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.663+0000 7f1e19400640 1 -- 172.21.15.55:0/509651397 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e00005740 con 0x7f1e1c153c30 2024-04-02T07:34:16.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.663+0000 7f1e19400640 1 -- 172.21.15.55:0/509651397 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4244410135 0 0) 0x7f1e1c0c3b70 con 0x7f1e1c0b3680 2024-04-02T07:34:16.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.663+0000 7f1e19400640 1 -- 172.21.15.55:0/509651397 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e0c001120 con 0x7f1e1c0b3680 2024-04-02T07:34:16.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.663+0000 7f1e11400640 1 -- 172.21.15.55:0/509651397 >> v1:172.21.15.106:6789/0 conn(0x7f1e1c0b3680 legacy=0x7f1e1c0b0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:16.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.663+0000 7f1e19400640 1 -- 172.21.15.55:0/509651397 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2662970257 0 0) 0x7f1e00005740 con 0x7f1e1c153c30 2024-04-02T07:34:16.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.663+0000 7f1e11400640 1 -- 172.21.15.55:0/509651397 >> v1:172.21.15.55:6789/0 conn(0x7f1e1c153c30 legacy=0x7f1e1c15a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:16.664 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.663+0000 7f1e11400640 1 -- 172.21.15.55:0/509651397 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e1c15d6f0 con 0x7f1e1c15d1f0 2024-04-02T07:34:16.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.667+0000 7f1e11400640 1 --2- 172.21.15.55:0/509651397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c15d1f0 0x7f1e1c0b3140 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1e040097c0 tx=0x7f1e0401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85793c279ed5ee5f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:16.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.667+0000 7f1e19400640 1 -- 172.21.15.55:0/509651397 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e0c001810 con 0x7f1e1c15d1f0 2024-04-02T07:34:16.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.667+0000 7f1e19400640 1 -- 172.21.15.55:0/509651397 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e040a7050 con 0x7f1e1c15d1f0 2024-04-02T07:34:16.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.667+0000 7f1e19400640 1 -- 172.21.15.55:0/509651397 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e040ab620 con 0x7f1e1c15d1f0 2024-04-02T07:34:16.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.667+0000 7f1e21200640 1 -- 172.21.15.55:0/509651397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c15d1f0 msgr2=0x7f1e1c0b3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:16.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.667+0000 7f1e21200640 1 --2- 172.21.15.55:0/509651397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c15d1f0 0x7f1e1c0b3140 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f1e040097c0 tx=0x7f1e0401c3c0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.667+0000 7f1e21200640 1 -- 172.21.15.55:0/509651397 shutdown_connections 2024-04-02T07:34:16.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.667+0000 7f1e21200640 1 --2- 172.21.15.55:0/509651397 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c15d1f0 0x7f1e1c0b3140 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.667+0000 7f1e21200640 1 -- 172.21.15.55:0/509651397 >> 172.21.15.55:0/509651397 conn(0x7f1e1c066080 msgr2=0x7f1e1c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:16.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.667+0000 7f1e21200640 1 -- 172.21.15.55:0/509651397 shutdown_connections 2024-04-02T07:34:16.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.667+0000 7f1e21200640 1 -- 172.21.15.55:0/509651397 wait complete. 2024-04-02T07:34:16.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e21200640 1 Processor -- start 2024-04-02T07:34:16.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e21200640 1 -- start start 2024-04-02T07:34:16.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e21200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e1c0b3680 0x7f1e1c155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:16.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e21200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e1c153c30 0x7f1e1c151da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:16.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e21200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c15d1f0 0x7f1e1c0c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:16.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e21200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c1522e0 con 0x7f1e1c153c30 2024-04-02T07:34:16.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e21200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c0c6580 con 0x7f1e1c15d1f0 2024-04-02T07:34:16.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e21200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e1c155a00 con 0x7f1e1c0b3680 2024-04-02T07:34:16.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e11400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e1c153c30 0x7f1e1c151da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:16.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e11400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e1c153c30 0x7f1e1c151da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49604/0 (socket says 172.21.15.55:49604) 2024-04-02T07:34:16.670 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e11400640 1 -- 172.21.15.55:0/3277324508 learned_addr learned my addr 172.21.15.55:0/3277324508 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:16.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e1a800640 1 --2- 172.21.15.55:0/3277324508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c15d1f0 0x7f1e1c0c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:16.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e19e00640 1 --2- 172.21.15.55:0/3277324508 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e1c0b3680 0x7f1e1c155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:16.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e11400640 1 -- 172.21.15.55:0/3277324508 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e1c0b3680 msgr2=0x7f1e1c155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:16.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e11400640 1 --2- 172.21.15.55:0/3277324508 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e1c0b3680 0x7f1e1c155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e11400640 1 -- 172.21.15.55:0/3277324508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c15d1f0 msgr2=0x7f1e1c0c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:16.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e11400640 1 --2- 172.21.15.55:0/3277324508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c15d1f0 0x7f1e1c0c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e11400640 1 -- 172.21.15.55:0/3277324508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e04009420 con 0x7f1e1c153c30 2024-04-02T07:34:16.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e1a800640 1 --2- 172.21.15.55:0/3277324508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c15d1f0 0x7f1e1c0c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:16.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e11400640 1 --2- 172.21.15.55:0/3277324508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e1c153c30 0x7f1e1c151da0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f1e040ae040 tx=0x7f1e0401ac00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:16.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e12a00640 1 -- 172.21.15.55:0/3277324508 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04004020 con 0x7f1e1c153c30 2024-04-02T07:34:16.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e12a00640 1 -- 172.21.15.55:0/3277324508 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e040041a0 con 0x7f1e1c153c30 2024-04-02T07:34:16.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e12a00640 1 -- 172.21.15.55:0/3277324508 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e04003620 con 0x7f1e1c153c30 2024-04-02T07:34:16.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e21200640 1 -- 172.21.15.55:0/3277324508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e1c155ce0 con 0x7f1e1c153c30 2024-04-02T07:34:16.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.671+0000 7f1e21200640 1 -- 172.21.15.55:0/3277324508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e1c1562a0 con 0x7f1e1c153c30 2024-04-02T07:34:16.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.675+0000 7f1e21200640 1 -- 172.21.15.55:0/3277324508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e1c066c90 con 0x7f1e1c153c30 2024-04-02T07:34:16.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.675+0000 7f1e12a00640 1 -- 172.21.15.55:0/3277324508 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1e04003780 con 0x7f1e1c153c30 2024-04-02T07:34:16.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.675+0000 7f1e12a00640 1 --2- 172.21.15.55:0/3277324508 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1df80666c0 0x7f1df8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:16.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.675+0000 7f1e12a00640 1 -- 172.21.15.55:0/3277324508 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f1e0411db80 con 0x7f1e1c153c30 2024-04-02T07:34:16.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.675+0000 7f1e19e00640 1 --2- 172.21.15.55:0/3277324508 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1df80666c0 0x7f1df8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:16.675 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.675+0000 7f1e19e00640 1 --2- 172.21.15.55:0/3277324508 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1df80666c0 0x7f1df8068b80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c005890 tx=0x7f1e0c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:16.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.679+0000 7f1e12a00640 1 -- 172.21.15.55:0/3277324508 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f1e040eadc0 con 0x7f1e1c153c30 2024-04-02T07:34:16.836 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.839+0000 7f1e21200640 1 -- 172.21.15.55:0/3277324508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1e1c0b1270 con 0x7f1e1c153c30 2024-04-02T07:34:16.837 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.839+0000 7f1e12a00640 1 -- 172.21.15.55:0/3277324508 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v119) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1e040ee3e0 con 0x7f1e1c153c30 2024-04-02T07:34:16.837 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:34:16.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.839+0000 7f1e21200640 1 -- 172.21.15.55:0/3277324508 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1df80666c0 msgr2=0x7f1df8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:16.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.839+0000 7f1e21200640 1 --2- 172.21.15.55:0/3277324508 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1df80666c0 0x7f1df8068b80 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f1e0c005890 tx=0x7f1e0c009040 comp rx=0 tx=0).stop 2024-04-02T07:34:16.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.839+0000 7f1e21200640 1 -- 172.21.15.55:0/3277324508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e1c153c30 msgr2=0x7f1e1c151da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:16.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.839+0000 7f1e21200640 1 --2- 172.21.15.55:0/3277324508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e1c153c30 0x7f1e1c151da0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f1e040ae040 tx=0x7f1e0401ac00 comp rx=0 tx=0).stop 2024-04-02T07:34:16.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.839+0000 7f1e21200640 1 -- 172.21.15.55:0/3277324508 shutdown_connections 2024-04-02T07:34:16.839 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.839+0000 7f1e21200640 1 --2- 172.21.15.55:0/3277324508 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1df80666c0 0x7f1df8068b80 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.839+0000 7f1e21200640 1 --2- 172.21.15.55:0/3277324508 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1e1c15d1f0 0x7f1e1c0c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.839+0000 7f1e21200640 1 --2- 172.21.15.55:0/3277324508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1e1c153c30 0x7f1e1c151da0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.839+0000 7f1e21200640 1 --2- 172.21.15.55:0/3277324508 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1e1c0b3680 0x7f1e1c155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:16.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.839+0000 7f1e21200640 1 -- 172.21.15.55:0/3277324508 >> 172.21.15.55:0/3277324508 conn(0x7f1e1c066080 msgr2=0x7f1e1c1524b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:16.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.839+0000 7f1e21200640 1 -- 172.21.15.55:0/3277324508 shutdown_connections 2024-04-02T07:34:16.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:16.839+0000 7f1e21200640 1 -- 172.21.15.55:0/3277324508 wait complete. 2024-04-02T07:34:16.858 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:34:17.000 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.003+0000 7f6683a00640 1 Processor -- start 2024-04-02T07:34:17.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.003+0000 7f6683a00640 1 -- start start 2024-04-02T07:34:17.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.003+0000 7f6683a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f667c144260 0x7f667c0702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:17.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.003+0000 7f6683a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f667c0707e0 0x7f667c0b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:17.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.003+0000 7f6683a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f667c15e3a0 con 0x7f667c0b2fd0 2024-04-02T07:34:17.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.003+0000 7f6683a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f667c0b37c0 con 0x7f667c0707e0 2024-04-02T07:34:17.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.003+0000 7f6683a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c070c60 con 0x7f667c144260 2024-04-02T07:34:17.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.003+0000 7f667be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f667c0707e0 0x7f667c0b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:17.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.003+0000 7f667be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f667c0707e0 0x7f667c0b2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49616/0 (socket says 172.21.15.55:49616) 2024-04-02T07:34:17.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.003+0000 7f667be00640 1 -- 172.21.15.55:0/274146676 learned_addr learned my addr 172.21.15.55:0/274146676 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:17.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.003+0000 7f6681000640 1 --2- 172.21.15.55:0/274146676 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f667c144260 0x7f667c0702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:17.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.003+0000 7f667be00640 1 -- 172.21.15.55:0/274146676 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f667c144260 msgr2=0x7f667c0702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:17.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.003+0000 7f667be00640 1 --2- 172.21.15.55:0/274146676 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f667c144260 0x7f667c0702a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.003+0000 7f667be00640 1 -- 172.21.15.55:0/274146676 >> v1:172.21.15.106:6789/0 conn(0x7f667c0b2fd0 legacy=0x7f667c0cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:17.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.003+0000 7f667be00640 1 -- 172.21.15.55:0/274146676 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f667c15e5f0 con 0x7f667c0707e0 2024-04-02T07:34:17.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.007+0000 7f667be00640 1 --2- 172.21.15.55:0/274146676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f667c0707e0 0x7f667c0b2a90 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f6668009870 tx=0x7f666801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781a9139d0006c35 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:17.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.007+0000 7f667b400640 1 -- 172.21.15.55:0/274146676 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66680ab600 con 0x7f667c0707e0 2024-04-02T07:34:17.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.007+0000 7f667b400640 1 -- 172.21.15.55:0/274146676 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66680a7050 con 0x7f667c0707e0 2024-04-02T07:34:17.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.007+0000 7f667b400640 1 -- 172.21.15.55:0/274146676 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66680ab980 con 0x7f667c0707e0 2024-04-02T07:34:17.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.007+0000 7f6683a00640 1 -- 172.21.15.55:0/274146676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f667c0707e0 msgr2=0x7f667c0b2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:17.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.007+0000 7f6683a00640 1 --2- 172.21.15.55:0/274146676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f667c0707e0 0x7f667c0b2a90 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f6668009870 tx=0x7f666801c560 comp rx=0 tx=0).stop 2024-04-02T07:34:17.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.007+0000 7f6683a00640 1 -- 172.21.15.55:0/274146676 shutdown_connections 2024-04-02T07:34:17.006 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.007+0000 7f6683a00640 1 --2- 172.21.15.55:0/274146676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f667c0707e0 0x7f667c0b2a90 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.007+0000 7f6683a00640 1 --2- 172.21.15.55:0/274146676 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f667c144260 0x7f667c0702a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.007+0000 7f6683a00640 1 -- 172.21.15.55:0/274146676 >> 172.21.15.55:0/274146676 conn(0x7f667c06a390 msgr2=0x7f667c0b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:17.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.007+0000 7f6683a00640 1 -- 172.21.15.55:0/274146676 shutdown_connections 2024-04-02T07:34:17.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.007+0000 7f6683a00640 1 -- 172.21.15.55:0/274146676 wait complete. 2024-04-02T07:34:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.007+0000 7f6683a00640 1 Processor -- start 2024-04-02T07:34:17.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6683a00640 1 -- start start 2024-04-02T07:34:17.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6683a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f667c0707e0 0x7f667c15c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:17.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6683a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f667c0b2fd0 0x7f667c15a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:17.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6683a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f667c144260 0x7f667c15f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:17.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6683a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c1f9720 con 0x7f667c144260 2024-04-02T07:34:17.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6683a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f667c1f8ba0 con 0x7f667c0707e0 2024-04-02T07:34:17.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6683a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f667c1f8e80 con 0x7f667c0b2fd0 2024-04-02T07:34:17.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6681a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f667c144260 0x7f667c15f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:17.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6681a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f667c144260 0x7f667c15f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49618/0 (socket says 172.21.15.55:49618) 2024-04-02T07:34:17.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6681a00640 1 -- 172.21.15.55:0/2475435680 learned_addr learned my addr 172.21.15.55:0/2475435680 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:17.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f667be00640 1 --2- 172.21.15.55:0/2475435680 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f667c0b2fd0 0x7f667c15a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:17.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6681000640 1 --2- 172.21.15.55:0/2475435680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f667c0707e0 0x7f667c15c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:17.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6681a00640 1 -- 172.21.15.55:0/2475435680 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f667c0b2fd0 msgr2=0x7f667c15a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:17.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6681a00640 1 --2- 172.21.15.55:0/2475435680 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f667c0b2fd0 0x7f667c15a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6681a00640 1 -- 172.21.15.55:0/2475435680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f667c0707e0 msgr2=0x7f667c15c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:17.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6681a00640 1 --2- 172.21.15.55:0/2475435680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f667c0707e0 0x7f667c15c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6681a00640 1 -- 172.21.15.55:0/2475435680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66680094d0 con 0x7f667c144260 2024-04-02T07:34:17.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6681a00640 1 --2- 172.21.15.55:0/2475435680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f667c144260 0x7f667c15f670 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f667400c770 tx=0x7f667400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:17.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6678c00640 1 -- 172.21.15.55:0/2475435680 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674003b80 con 0x7f667c144260 2024-04-02T07:34:17.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6678c00640 1 -- 172.21.15.55:0/2475435680 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6674003ce0 con 0x7f667c144260 2024-04-02T07:34:17.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6678c00640 1 -- 172.21.15.55:0/2475435680 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f667400aa90 con 0x7f667c144260 2024-04-02T07:34:17.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6683a00640 1 -- 172.21.15.55:0/2475435680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f667c1f9160 con 0x7f667c144260 2024-04-02T07:34:17.013 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6683a00640 1 -- 172.21.15.55:0/2475435680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f667c15a5b0 con 0x7f667c144260 2024-04-02T07:34:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.011+0000 7f6683a00640 1 -- 172.21.15.55:0/2475435680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f667c073530 con 0x7f667c144260 2024-04-02T07:34:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.015+0000 7f6678c00640 1 -- 172.21.15.55:0/2475435680 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f667400abf0 con 0x7f667c144260 2024-04-02T07:34:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.015+0000 7f6678c00640 1 --2- 172.21.15.55:0/2475435680 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f665c066690 0x7f665c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.015+0000 7f6678c00640 1 -- 172.21.15.55:0/2475435680 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f6674083e90 con 0x7f667c144260 2024-04-02T07:34:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.015+0000 7f6681000640 1 --2- 172.21.15.55:0/2475435680 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f665c066690 0x7f665c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:17.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.015+0000 7f6681000640 1 --2- 172.21.15.55:0/2475435680 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f665c066690 0x7f665c068b50 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6670009ac0 tx=0x7f6670009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:17.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.019+0000 7f6678c00640 1 -- 172.21.15.55:0/2475435680 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f66740512b0 con 0x7f667c144260 2024-04-02T07:34:17.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.175+0000 7f6683a00640 1 -- 172.21.15.55:0/2475435680 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f667c15ae10 con 0x7f667c144260 2024-04-02T07:34:17.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.175+0000 7f6678c00640 1 -- 172.21.15.55:0/2475435680 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v119) v1 ==== 104+0+11 (secure 0 0 0) 0x7f667c15ae10 con 0x7f667c144260 2024-04-02T07:34:17.176 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:34:17.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.179+0000 7f6683a00640 1 -- 172.21.15.55:0/2475435680 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f665c066690 msgr2=0x7f665c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:17.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.179+0000 7f6683a00640 1 --2- 172.21.15.55:0/2475435680 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f665c066690 0x7f665c068b50 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f6670009ac0 tx=0x7f6670009190 comp rx=0 tx=0).stop 2024-04-02T07:34:17.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.179+0000 7f6683a00640 1 -- 172.21.15.55:0/2475435680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f667c144260 msgr2=0x7f667c15f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:17.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.179+0000 7f6683a00640 1 --2- 172.21.15.55:0/2475435680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f667c144260 0x7f667c15f670 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f667400c770 tx=0x7f667400cc30 comp rx=0 tx=0).stop 2024-04-02T07:34:17.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.179+0000 7f6683a00640 1 -- 172.21.15.55:0/2475435680 shutdown_connections 2024-04-02T07:34:17.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.179+0000 7f6683a00640 1 --2- 172.21.15.55:0/2475435680 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f667c144260 0x7f667c15f670 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.179+0000 7f6683a00640 1 --2- 172.21.15.55:0/2475435680 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f667c0b2fd0 0x7f667c15a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.179+0000 7f6683a00640 1 --2- 172.21.15.55:0/2475435680 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f665c066690 0x7f665c068b50 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.179+0000 7f6683a00640 1 --2- 172.21.15.55:0/2475435680 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f667c0707e0 0x7f667c15c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.179+0000 7f6683a00640 1 -- 172.21.15.55:0/2475435680 >> 172.21.15.55:0/2475435680 conn(0x7f667c06a390 msgr2=0x7f667c1410c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:17.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.179+0000 7f6683a00640 1 -- 172.21.15.55:0/2475435680 shutdown_connections 2024-04-02T07:34:17.179 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.179+0000 7f6683a00640 1 -- 172.21.15.55:0/2475435680 wait complete. 2024-04-02T07:34:17.197 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:34:17.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.343+0000 7f715ae00640 1 Processor -- start 2024-04-02T07:34:17.341 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.343+0000 7f715ae00640 1 -- start start 2024-04-02T07:34:17.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.343+0000 7f715ae00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7154072130 0x7f7154069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:17.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.343+0000 7f715ae00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f715406a2d0 0x7f7154160760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:17.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.343+0000 7f715ae00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f715415de90 con 0x7f7154157000 2024-04-02T07:34:17.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.343+0000 7f715ae00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f715415d070 con 0x7f715406a2d0 2024-04-02T07:34:17.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.343+0000 7f715ae00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f715406a760 con 0x7f7154072130 2024-04-02T07:34:17.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.343+0000 7f7153e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7154157000 0x7f7154071a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48052/0 (socket says 172.21.15.55:48052) 2024-04-02T07:34:17.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.343+0000 7f7153e00640 1 -- 172.21.15.55:0/74815611 learned_addr learned my addr 172.21.15.55:0/74815611 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:17.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.343+0000 7f7158e00640 1 --2- 172.21.15.55:0/74815611 >> v2:172.21.15.55:3300/0 conn(0x7f715406a2d0 0x7f7154160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:17.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.343+0000 7f714b400640 1 --2- 172.21.15.55:0/74815611 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7154072130 0x7f7154069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:17.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.343+0000 7f7153400640 1 -- 172.21.15.55:0/74815611 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2205277570 0 0) 0x7f715415de90 con 0x7f7154157000 2024-04-02T07:34:17.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.343+0000 7f7153400640 1 -- 172.21.15.55:0/74815611 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7138003530 con 0x7f7154157000 2024-04-02T07:34:17.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.343+0000 7f7158e00640 1 -- 172.21.15.55:0/74815611 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7154072130 msgr2=0x7f7154069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:17.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.343+0000 7f7158e00640 1 --2- 172.21.15.55:0/74815611 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7154072130 0x7f7154069d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.343+0000 7f7158e00640 1 -- 172.21.15.55:0/74815611 >> v1:172.21.15.55:6789/0 conn(0x7f7154157000 legacy=0x7f7154071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:17.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.343+0000 7f7158e00640 1 -- 172.21.15.55:0/74815611 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f715415d280 con 0x7f715406a2d0 2024-04-02T07:34:17.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.347+0000 7f7158e00640 1 --2- 172.21.15.55:0/74815611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f715406a2d0 0x7f7154160760 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f714c0097c0 tx=0x7f714c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83101fe4a2fd7788 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:17.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.347+0000 7f7153400640 1 -- 172.21.15.55:0/74815611 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c0ab670 con 0x7f715406a2d0 2024-04-02T07:34:17.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.347+0000 7f7153400640 1 -- 172.21.15.55:0/74815611 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714c0ab7d0 con 0x7f715406a2d0 2024-04-02T07:34:17.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.347+0000 7f7153400640 1 -- 172.21.15.55:0/74815611 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714c0abb60 con 0x7f715406a2d0 2024-04-02T07:34:17.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.347+0000 7f715ae00640 1 -- 172.21.15.55:0/74815611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f715406a2d0 msgr2=0x7f7154160760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:17.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.347+0000 7f715ae00640 1 --2- 172.21.15.55:0/74815611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f715406a2d0 0x7f7154160760 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7f714c0097c0 tx=0x7f714c01c470 comp rx=0 tx=0).stop 2024-04-02T07:34:17.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.347+0000 7f715ae00640 1 -- 172.21.15.55:0/74815611 shutdown_connections 2024-04-02T07:34:17.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.347+0000 7f715ae00640 1 --2- 172.21.15.55:0/74815611 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7154072130 0x7f7154069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.347+0000 7f715ae00640 1 --2- 172.21.15.55:0/74815611 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f715406a2d0 0x7f7154160760 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.347+0000 7f715ae00640 1 -- 172.21.15.55:0/74815611 >> 172.21.15.55:0/74815611 conn(0x7f71540b13b0 msgr2=0x7f71540b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:17.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.347+0000 7f715ae00640 1 -- 172.21.15.55:0/74815611 shutdown_connections 2024-04-02T07:34:17.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.347+0000 7f715ae00640 1 -- 172.21.15.55:0/74815611 wait complete. 2024-04-02T07:34:17.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f715ae00640 1 Processor -- start 2024-04-02T07:34:17.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f715ae00640 1 -- start start 2024-04-02T07:34:17.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f715ae00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f715406a2d0 0x7f71540cf2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f715ae00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7154072130 0x7f71540cf800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f715ae00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7154157000 0x7f7154152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f715ae00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71540aece0 con 0x7f7154072130 2024-04-02T07:34:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f715ae00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7154150240 con 0x7f715406a2d0 2024-04-02T07:34:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f715ae00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71540c9170 con 0x7f7154157000 2024-04-02T07:34:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f714b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7154072130 0x7f71540cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f714b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7154072130 0x7f71540cf800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49634/0 (socket says 172.21.15.55:49634) 2024-04-02T07:34:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f714b400640 1 -- 172.21.15.55:0/689860531 learned_addr learned my addr 172.21.15.55:0/689860531 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f7158e00640 1 --2- 172.21.15.55:0/689860531 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7154157000 0x7f7154152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f7153e00640 1 --2- 172.21.15.55:0/689860531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f715406a2d0 0x7f71540cf2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f714b400640 1 -- 172.21.15.55:0/689860531 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7154157000 msgr2=0x7f7154152520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f714b400640 1 --2- 172.21.15.55:0/689860531 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7154157000 0x7f7154152520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f714b400640 1 -- 172.21.15.55:0/689860531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f715406a2d0 msgr2=0x7f71540cf2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:17.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f714b400640 1 --2- 172.21.15.55:0/689860531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f715406a2d0 0x7f71540cf2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f714b400640 1 -- 172.21.15.55:0/689860531 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c009420 con 0x7f7154072130 2024-04-02T07:34:17.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f7153e00640 1 --2- 172.21.15.55:0/689860531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f715406a2d0 0x7f71540cf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:17.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f714b400640 1 --2- 172.21.15.55:0/689860531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7154072130 0x7f71540cf800 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f713c00d800 tx=0x7f713c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:17.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f7150c00640 1 -- 172.21.15.55:0/689860531 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c00b6c0 con 0x7f7154072130 2024-04-02T07:34:17.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f7150c00640 1 -- 172.21.15.55:0/689860531 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713c00b820 con 0x7f7154072130 2024-04-02T07:34:17.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f7150c00640 1 -- 172.21.15.55:0/689860531 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c00bb90 con 0x7f7154072130 2024-04-02T07:34:17.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f715ae00640 1 -- 172.21.15.55:0/689860531 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71540c9450 con 0x7f7154072130 2024-04-02T07:34:17.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f715ae00640 1 -- 172.21.15.55:0/689860531 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71540c9a10 con 0x7f7154072130 2024-04-02T07:34:17.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.351+0000 7f715ae00640 1 -- 172.21.15.55:0/689860531 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7154066c90 con 0x7f7154072130 2024-04-02T07:34:17.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.355+0000 7f7150c00640 1 -- 172.21.15.55:0/689860531 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f713c00bcf0 con 0x7f7154072130 2024-04-02T07:34:17.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.355+0000 7f7150c00640 1 --2- 172.21.15.55:0/689860531 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7130066690 0x7f7130068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:17.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.355+0000 7f7150c00640 1 -- 172.21.15.55:0/689860531 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f713c084730 con 0x7f7154072130 2024-04-02T07:34:17.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.355+0000 7f7153e00640 1 --2- 172.21.15.55:0/689860531 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7130066690 0x7f7130068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:17.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.355+0000 7f7153e00640 1 --2- 172.21.15.55:0/689860531 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7130066690 0x7f7130068b50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7144001570 tx=0x7f7144009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:17.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.359+0000 7f7150c00640 1 -- 172.21.15.55:0/689860531 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f713c051a00 con 0x7f7154072130 2024-04-02T07:34:17.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.523+0000 7f715ae00640 1 -- 172.21.15.55:0/689860531 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7154071800 con 0x7f7154072130 2024-04-02T07:34:17.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.523+0000 7f7150c00640 1 -- 172.21.15.55:0/689860531 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v119) v1 ==== 100+0+11 (secure 0 0 0) 0x7f713c055020 con 0x7f7154072130 2024-04-02T07:34:17.521 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:34:17.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.523+0000 7f715ae00640 1 -- 172.21.15.55:0/689860531 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7130066690 msgr2=0x7f7130068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:17.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.523+0000 7f715ae00640 1 --2- 172.21.15.55:0/689860531 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7130066690 0x7f7130068b50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7144001570 tx=0x7f7144009040 comp rx=0 tx=0).stop 2024-04-02T07:34:17.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.523+0000 7f715ae00640 1 -- 172.21.15.55:0/689860531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7154072130 msgr2=0x7f71540cf800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:17.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.523+0000 7f715ae00640 1 --2- 172.21.15.55:0/689860531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7154072130 0x7f71540cf800 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7f713c00d800 tx=0x7f713c00dcc0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.523+0000 7f715ae00640 1 -- 172.21.15.55:0/689860531 shutdown_connections 2024-04-02T07:34:17.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.523+0000 7f715ae00640 1 --2- 172.21.15.55:0/689860531 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7154157000 0x7f7154152520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.523+0000 7f715ae00640 1 --2- 172.21.15.55:0/689860531 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7154072130 0x7f71540cf800 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.523+0000 7f715ae00640 1 --2- 172.21.15.55:0/689860531 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7130066690 0x7f7130068b50 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.523+0000 7f715ae00640 1 --2- 172.21.15.55:0/689860531 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f715406a2d0 0x7f71540cf2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.523+0000 7f715ae00640 1 -- 172.21.15.55:0/689860531 >> 172.21.15.55:0/689860531 conn(0x7f71540b13b0 msgr2=0x7f71540b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:17.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.523+0000 7f715ae00640 1 -- 172.21.15.55:0/689860531 shutdown_connections 2024-04-02T07:34:17.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.523+0000 7f715ae00640 1 -- 172.21.15.55:0/689860531 wait complete. 2024-04-02T07:34:17.543 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:34:17.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.687+0000 7ffb7f000640 1 Processor -- start 2024-04-02T07:34:17.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.687+0000 7ffb7f000640 1 -- start start 2024-04-02T07:34:17.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.687+0000 7ffb7f000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ffb780b1650 0x7ffb780cacb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:17.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.687+0000 7ffb7f000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb780ce990 con 0x7ffb780cb1f0 2024-04-02T07:34:17.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.687+0000 7ffb7f000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb780cf4f0 con 0x7ffb78160230 2024-04-02T07:34:17.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.687+0000 7ffb7f000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb78160610 con 0x7ffb780b1650 2024-04-02T07:34:17.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.687+0000 7ffb7d000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ffb780cb1f0 0x7ffb780cf980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48068/0 (socket says 172.21.15.55:48068) 2024-04-02T07:34:17.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.687+0000 7ffb7d000640 1 -- 172.21.15.55:0/2054157126 learned_addr learned my addr 172.21.15.55:0/2054157126 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:17.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.687+0000 7ffb6fe00640 1 --2- 172.21.15.55:0/2054157126 >> v2:172.21.15.106:3300/0 conn(0x7ffb780b1650 0x7ffb780cacb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:17.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.687+0000 7ffb77400640 1 -- 172.21.15.55:0/2054157126 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186548647 0 0) 0x7ffb780ce990 con 0x7ffb780cb1f0 2024-04-02T07:34:17.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.687+0000 7ffb77400640 1 -- 172.21.15.55:0/2054157126 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb5c003530 con 0x7ffb780cb1f0 2024-04-02T07:34:17.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.687+0000 7ffb6fe00640 1 -- 172.21.15.55:0/2054157126 >> v1:172.21.15.106:6789/0 conn(0x7ffb78160230 legacy=0x7ffb7806bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:17.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.687+0000 7ffb6fe00640 1 -- 172.21.15.55:0/2054157126 >> v1:172.21.15.55:6789/0 conn(0x7ffb780cb1f0 legacy=0x7ffb780cf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:17.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.687+0000 7ffb6fe00640 1 -- 172.21.15.55:0/2054157126 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb780cebc0 con 0x7ffb780b1650 2024-04-02T07:34:17.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.691+0000 7ffb6fe00640 1 --2- 172.21.15.55:0/2054157126 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb780b1650 0x7ffb780cacb0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ffb600097c0 tx=0x7ffb6001c410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94d5952ed11690cc server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:17.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.691+0000 7ffb77400640 1 -- 172.21.15.55:0/2054157126 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb600ab600 con 0x7ffb780b1650 2024-04-02T07:34:17.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.691+0000 7ffb77400640 1 -- 172.21.15.55:0/2054157126 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb600a7050 con 0x7ffb780b1650 2024-04-02T07:34:17.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.691+0000 7ffb77400640 1 -- 172.21.15.55:0/2054157126 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb600ab980 con 0x7ffb780b1650 2024-04-02T07:34:17.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.691+0000 7ffb7f000640 1 -- 172.21.15.55:0/2054157126 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb780b1650 msgr2=0x7ffb780cacb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:17.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.691+0000 7ffb7f000640 1 --2- 172.21.15.55:0/2054157126 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb780b1650 0x7ffb780cacb0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7ffb600097c0 tx=0x7ffb6001c410 comp rx=0 tx=0).stop 2024-04-02T07:34:17.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.691+0000 7ffb7f000640 1 -- 172.21.15.55:0/2054157126 shutdown_connections 2024-04-02T07:34:17.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.691+0000 7ffb7f000640 1 --2- 172.21.15.55:0/2054157126 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb780b1650 0x7ffb780cacb0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.691+0000 7ffb7f000640 1 -- 172.21.15.55:0/2054157126 >> 172.21.15.55:0/2054157126 conn(0x7ffb780b2150 msgr2=0x7ffb780b2560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:17.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.691+0000 7ffb7f000640 1 -- 172.21.15.55:0/2054157126 shutdown_connections 2024-04-02T07:34:17.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.691+0000 7ffb7f000640 1 -- 172.21.15.55:0/2054157126 wait complete. 2024-04-02T07:34:17.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb7f000640 1 Processor -- start 2024-04-02T07:34:17.692 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb7f000640 1 -- start start 2024-04-02T07:34:17.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb7f000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb780b1650 0x7ffb780c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:17.694 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb7f000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb780cb1f0 0x7ffb7814b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:17.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb7f000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffb78160230 0x7ffb7814a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:17.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb7f000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb780b3f10 con 0x7ffb780b1650 2024-04-02T07:34:17.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb7f000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb780c99a0 con 0x7ffb780cb1f0 2024-04-02T07:34:17.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb7f000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb780c9c80 con 0x7ffb78160230 2024-04-02T07:34:17.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb77e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb780b1650 0x7ffb780c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:17.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb77e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb780b1650 0x7ffb780c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49644/0 (socket says 172.21.15.55:49644) 2024-04-02T07:34:17.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb77e00640 1 -- 172.21.15.55:0/3214399771 learned_addr learned my addr 172.21.15.55:0/3214399771 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:17.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb6fe00640 1 --2- 172.21.15.55:0/3214399771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb780cb1f0 0x7ffb7814b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:17.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb7d000640 1 --2- 172.21.15.55:0/3214399771 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffb78160230 0x7ffb7814a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:17.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb77e00640 1 -- 172.21.15.55:0/3214399771 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffb78160230 msgr2=0x7ffb7814a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:17.695 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb77e00640 1 --2- 172.21.15.55:0/3214399771 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffb78160230 0x7ffb7814a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb77e00640 1 -- 172.21.15.55:0/3214399771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb780cb1f0 msgr2=0x7ffb7814b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:17.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb77e00640 1 --2- 172.21.15.55:0/3214399771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb780cb1f0 0x7ffb7814b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb77e00640 1 -- 172.21.15.55:0/3214399771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb60009420 con 0x7ffb780b1650 2024-04-02T07:34:17.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb77e00640 1 --2- 172.21.15.55:0/3214399771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb780b1650 0x7ffb780c9160 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800c3c0 tx=0x7ffb6800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:17.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb74c00640 1 -- 172.21.15.55:0/3214399771 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb680052d0 con 0x7ffb780b1650 2024-04-02T07:34:17.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb74c00640 1 -- 172.21.15.55:0/3214399771 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb68005430 con 0x7ffb780b1650 2024-04-02T07:34:17.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb74c00640 1 -- 172.21.15.55:0/3214399771 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb68003840 con 0x7ffb780b1650 2024-04-02T07:34:17.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb7f000640 1 -- 172.21.15.55:0/3214399771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb780c9f60 con 0x7ffb780b1650 2024-04-02T07:34:17.696 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb7f000640 1 -- 172.21.15.55:0/3214399771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb7814bdb0 con 0x7ffb780b1650 2024-04-02T07:34:17.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.695+0000 7ffb7f000640 1 -- 172.21.15.55:0/3214399771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb78066c90 con 0x7ffb780b1650 2024-04-02T07:34:17.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.699+0000 7ffb74c00640 1 -- 172.21.15.55:0/3214399771 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ffb680039a0 con 0x7ffb780b1650 2024-04-02T07:34:17.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.699+0000 7ffb74c00640 1 --2- 172.21.15.55:0/3214399771 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffb54066690 0x7ffb54068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:17.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.699+0000 7ffb74c00640 1 -- 172.21.15.55:0/3214399771 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7ffb680836b0 con 0x7ffb780b1650 2024-04-02T07:34:17.697 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.699+0000 7ffb6fe00640 1 --2- 172.21.15.55:0/3214399771 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffb54066690 0x7ffb54068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:17.698 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.699+0000 7ffb6fe00640 1 --2- 172.21.15.55:0/3214399771 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffb54066690 0x7ffb54068b50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ffb600ad000 tx=0x7ffb60008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:17.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.703+0000 7ffb74c00640 1 -- 172.21.15.55:0/3214399771 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ffb68050a30 con 0x7ffb780b1650 2024-04-02T07:34:17.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.875+0000 7ffb7f000640 1 -- 172.21.15.55:0/3214399771 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffb780b2f40 con 0x7ffb780b1650 2024-04-02T07:34:17.875 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.875+0000 7ffb74c00640 1 -- 172.21.15.55:0/3214399771 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v119) v1 ==== 80+0+122 (secure 0 0 0) 0x7ffb68054050 con 0x7ffb780b1650 2024-04-02T07:34:17.875 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.106:6837/775582321 2024-04-03T07:34:04.807966+0000 2024-04-02T07:34:17.875 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.106:6834/775582321 2024-04-03T07:34:04.807966+0000 2024-04-02T07:34:17.876 INFO:teuthology.orchestra.run.smithi055.stderr:listed 2 entries 2024-04-02T07:34:17.877 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.879+0000 7ffb7f000640 1 -- 172.21.15.55:0/3214399771 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffb54066690 msgr2=0x7ffb54068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:17.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.879+0000 7ffb7f000640 1 --2- 172.21.15.55:0/3214399771 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffb54066690 0x7ffb54068b50 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7ffb600ad000 tx=0x7ffb60008040 comp rx=0 tx=0).stop 2024-04-02T07:34:17.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.879+0000 7ffb7f000640 1 -- 172.21.15.55:0/3214399771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb780b1650 msgr2=0x7ffb780c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:17.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.879+0000 7ffb7f000640 1 --2- 172.21.15.55:0/3214399771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb780b1650 0x7ffb780c9160 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800c3c0 tx=0x7ffb6800c880 comp rx=0 tx=0).stop 2024-04-02T07:34:17.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.879+0000 7ffb7f000640 1 -- 172.21.15.55:0/3214399771 shutdown_connections 2024-04-02T07:34:17.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.879+0000 7ffb7f000640 1 --2- 172.21.15.55:0/3214399771 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffb78160230 0x7ffb7814a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.879+0000 7ffb7f000640 1 --2- 172.21.15.55:0/3214399771 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffb54066690 0x7ffb54068b50 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.879+0000 7ffb7f000640 1 --2- 172.21.15.55:0/3214399771 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffb780cb1f0 0x7ffb7814b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.879+0000 7ffb7f000640 1 --2- 172.21.15.55:0/3214399771 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffb780b1650 0x7ffb780c9160 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:17.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.879+0000 7ffb7f000640 1 -- 172.21.15.55:0/3214399771 >> 172.21.15.55:0/3214399771 conn(0x7ffb780b2150 msgr2=0x7ffb780cbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:17.878 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.879+0000 7ffb7f000640 1 -- 172.21.15.55:0/3214399771 shutdown_connections 2024-04-02T07:34:17.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:17.879+0000 7ffb7f000640 1 -- 172.21.15.55:0/3214399771 wait complete. 2024-04-02T07:34:17.897 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi055.front.sepia.ceph.com... 2024-04-02T07:34:17.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:17.898 DEBUG:teuthology.orchestra.run.smithi055:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-02T07:34:17.916 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[53249]: fuse finished with error 0 and tester_r 0 2024-04-02T07:34:17.919 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:34:24.020 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:34:24.021 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:24.021 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-02T07:34:24.032 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:34:24.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.227+0000 7f9beb200640 1 Processor -- start 2024-04-02T07:34:24.226 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.227+0000 7f9beb200640 1 -- start start 2024-04-02T07:34:24.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.227+0000 7f9beb200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9be4070ce0 0x7f9be406e420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.227+0000 7f9beb200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9be4158fc0 0x7f9be406cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.227+0000 7f9beb200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9be406e960 con 0x7f9be40710c0 2024-04-02T07:34:24.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.227+0000 7f9beb200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9be406b4b0 con 0x7f9be4158fc0 2024-04-02T07:34:24.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.227+0000 7f9beb200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be40cea90 con 0x7f9be4070ce0 2024-04-02T07:34:24.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.227+0000 7f9be9200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9be4158fc0 0x7f9be406cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.227+0000 7f9bdbe00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9be40710c0 0x7f9be41588b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48074/0 (socket says 172.21.15.55:48074) 2024-04-02T07:34:24.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.227+0000 7f9bdbe00640 1 -- 172.21.15.55:0/1274051881 learned_addr learned my addr 172.21.15.55:0/1274051881 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:24.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.227+0000 7f9be3e00640 1 --2- 172.21.15.55:0/1274051881 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9be4070ce0 0x7f9be406e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.231+0000 7f9be9200640 1 -- 172.21.15.55:0/1274051881 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9be4070ce0 msgr2=0x7f9be406e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:24.228 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.231+0000 7f9be9200640 1 --2- 172.21.15.55:0/1274051881 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9be4070ce0 0x7f9be406e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.231+0000 7f9be9200640 1 -- 172.21.15.55:0/1274051881 >> v1:172.21.15.55:6789/0 conn(0x7f9be40710c0 legacy=0x7f9be41588b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.231+0000 7f9be9200640 1 -- 172.21.15.55:0/1274051881 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be40cd210 con 0x7f9be4158fc0 2024-04-02T07:34:24.229 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.231+0000 7f9be3400640 1 -- 172.21.15.55:0/1274051881 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942604275 0 0) 0x7f9be406e960 con 0x7f9be40710c0 2024-04-02T07:34:24.231 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.231+0000 7f9be9200640 1 --2- 172.21.15.55:0/1274051881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9be4158fc0 0x7f9be406cae0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc009d90 tx=0x7f9bdc01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28c8f740209de5a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:24.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.231+0000 7f9be3400640 1 -- 172.21.15.55:0/1274051881 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0a5970 con 0x7f9be4158fc0 2024-04-02T07:34:24.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.231+0000 7f9be3400640 1 -- 172.21.15.55:0/1274051881 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc0a5ad0 con 0x7f9be4158fc0 2024-04-02T07:34:24.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.231+0000 7f9be3400640 1 -- 172.21.15.55:0/1274051881 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0a5e60 con 0x7f9be4158fc0 2024-04-02T07:34:24.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.231+0000 7f9beb200640 1 -- 172.21.15.55:0/1274051881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9be4158fc0 msgr2=0x7f9be406cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.231+0000 7f9beb200640 1 --2- 172.21.15.55:0/1274051881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9be4158fc0 0x7f9be406cae0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc009d90 tx=0x7f9bdc01c8b0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.231+0000 7f9beb200640 1 -- 172.21.15.55:0/1274051881 shutdown_connections 2024-04-02T07:34:24.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.231+0000 7f9beb200640 1 --2- 172.21.15.55:0/1274051881 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9be4158fc0 0x7f9be406cae0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.231+0000 7f9beb200640 1 --2- 172.21.15.55:0/1274051881 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9be4070ce0 0x7f9be406e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.231+0000 7f9beb200640 1 -- 172.21.15.55:0/1274051881 >> 172.21.15.55:0/1274051881 conn(0x7f9be40ced50 msgr2=0x7f9be40cf160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:24.232 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9beb200640 1 -- 172.21.15.55:0/1274051881 shutdown_connections 2024-04-02T07:34:24.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9beb200640 1 -- 172.21.15.55:0/1274051881 wait complete. 2024-04-02T07:34:24.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9beb200640 1 Processor -- start 2024-04-02T07:34:24.233 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9beb200640 1 -- start start 2024-04-02T07:34:24.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9beb200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9be4070ce0 0x7f9be415dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9beb200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9be40710c0 0x7f9be4146990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9beb200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9be4158fc0 0x7f9be41570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.235 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9beb200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be41475f0 con 0x7f9be4158fc0 2024-04-02T07:34:24.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9beb200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be415e120 con 0x7f9be40710c0 2024-04-02T07:34:24.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9beb200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be4144420 con 0x7f9be4070ce0 2024-04-02T07:34:24.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9be9200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9be4158fc0 0x7f9be41570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9be9200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9be4158fc0 0x7f9be41570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49660/0 (socket says 172.21.15.55:49660) 2024-04-02T07:34:24.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9be9200640 1 -- 172.21.15.55:0/2701892041 learned_addr learned my addr 172.21.15.55:0/2701892041 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:24.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9bdbe00640 1 --2- 172.21.15.55:0/2701892041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9be40710c0 0x7f9be4146990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9be3e00640 1 --2- 172.21.15.55:0/2701892041 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9be4070ce0 0x7f9be415dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9be9200640 1 -- 172.21.15.55:0/2701892041 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9be4070ce0 msgr2=0x7f9be415dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9be9200640 1 --2- 172.21.15.55:0/2701892041 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9be4070ce0 0x7f9be415dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9be9200640 1 -- 172.21.15.55:0/2701892041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9be40710c0 msgr2=0x7f9be4146990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9be9200640 1 --2- 172.21.15.55:0/2701892041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9be40710c0 0x7f9be4146990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9be9200640 1 -- 172.21.15.55:0/2701892041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bdc009a70 con 0x7f9be4158fc0 2024-04-02T07:34:24.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.235+0000 7f9bdbe00640 1 --2- 172.21.15.55:0/2701892041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9be40710c0 0x7f9be4146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:24.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.239+0000 7f9be9200640 1 --2- 172.21.15.55:0/2701892041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9be4158fc0 0x7f9be41570f0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc01a4e0 tx=0x7f9bdc019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:24.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.239+0000 7f9be0c00640 1 -- 172.21.15.55:0/2701892041 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc009450 con 0x7f9be4158fc0 2024-04-02T07:34:24.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.239+0000 7f9be0c00640 1 -- 172.21.15.55:0/2701892041 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bdc0adbf0 con 0x7f9be4158fc0 2024-04-02T07:34:24.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.239+0000 7f9be0c00640 1 -- 172.21.15.55:0/2701892041 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0b8420 con 0x7f9be4158fc0 2024-04-02T07:34:24.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.239+0000 7f9beb200640 1 -- 172.21.15.55:0/2701892041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9be415a510 con 0x7f9be4158fc0 2024-04-02T07:34:24.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.239+0000 7f9beb200640 1 -- 172.21.15.55:0/2701892041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9be415aad0 con 0x7f9be4158fc0 2024-04-02T07:34:24.238 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.239+0000 7f9beb200640 1 -- 172.21.15.55:0/2701892041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9be4144770 con 0x7f9be4158fc0 2024-04-02T07:34:24.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.239+0000 7f9be0c00640 1 -- 172.21.15.55:0/2701892041 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f9bdc0b8580 con 0x7f9be4158fc0 2024-04-02T07:34:24.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.239+0000 7f9be0c00640 1 --2- 172.21.15.55:0/2701892041 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9bc0066690 0x7f9bc0068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.239+0000 7f9be0c00640 1 -- 172.21.15.55:0/2701892041 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f9bdc11f820 con 0x7f9be4158fc0 2024-04-02T07:34:24.239 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.239+0000 7f9be3e00640 1 --2- 172.21.15.55:0/2701892041 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9bc0066690 0x7f9bc0068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.240 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.243+0000 7f9be3e00640 1 --2- 172.21.15.55:0/2701892041 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9bc0066690 0x7f9bc0068b50 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9be4158050 tx=0x7f9bd4009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:24.243 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.243+0000 7f9be0c00640 1 -- 172.21.15.55:0/2701892041 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f9bdc0eccc0 con 0x7f9be4158fc0 2024-04-02T07:34:24.437 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.439+0000 7f9beb200640 1 -- 172.21.15.55:0/2701892041 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9be4066c90 con 0x7f9be4158fc0 2024-04-02T07:34:24.438 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.439+0000 7f9be0c00640 1 -- 172.21.15.55:0/2701892041 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) v1 ==== 95+0+4744 (secure 0 0 0) 0x7f9bdc0bc090 con 0x7f9be4158fc0 2024-04-02T07:34:24.438 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:24.439 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":102,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7592,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2292883244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2292883244},{"type":"v1","addr":"172.21.15.106:6836","nonce":2292883244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":7835,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3165795379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3165795379},{"type":"v1","addr":"172.21.15.106:6837","nonce":3165795379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":9147,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2700619140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2700619140},{"type":"v1","addr":"172.21.15.55:6834","nonce":2700619140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":102,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:33:27.846433+0000","modified":"2024-04-02T07:34:08.859806+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":119,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9150},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9150":{"gid":9150,"name":"a","rank":0,"incarnation":99,"state":"up:active","state_seq":14,"addr":"172.21.15.55:6835/154663344","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":154663344},{"type":"v1","addr":"172.21.15.55:6835","nonce":154663344}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-02T07:34:24.439 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 102 2024-04-02T07:34:24.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.443+0000 7f9beb200640 1 -- 172.21.15.55:0/2701892041 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9bc0066690 msgr2=0x7f9bc0068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.440 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.443+0000 7f9beb200640 1 --2- 172.21.15.55:0/2701892041 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9bc0066690 0x7f9bc0068b50 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9be4158050 tx=0x7f9bd4009190 comp rx=0 tx=0).stop 2024-04-02T07:34:24.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.443+0000 7f9beb200640 1 -- 172.21.15.55:0/2701892041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9be4158fc0 msgr2=0x7f9be41570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.443+0000 7f9beb200640 1 --2- 172.21.15.55:0/2701892041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9be4158fc0 0x7f9be41570f0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc01a4e0 tx=0x7f9bdc019650 comp rx=0 tx=0).stop 2024-04-02T07:34:24.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.443+0000 7f9beb200640 1 -- 172.21.15.55:0/2701892041 shutdown_connections 2024-04-02T07:34:24.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.443+0000 7f9beb200640 1 --2- 172.21.15.55:0/2701892041 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9be4158fc0 0x7f9be41570f0 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.443+0000 7f9beb200640 1 --2- 172.21.15.55:0/2701892041 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f9bc0066690 0x7f9bc0068b50 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.443+0000 7f9beb200640 1 --2- 172.21.15.55:0/2701892041 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f9be40710c0 0x7f9be4146990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.443+0000 7f9beb200640 1 --2- 172.21.15.55:0/2701892041 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f9be4070ce0 0x7f9be415dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.443+0000 7f9beb200640 1 -- 172.21.15.55:0/2701892041 >> 172.21.15.55:0/2701892041 conn(0x7f9be40ced50 msgr2=0x7f9be415d3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:24.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.443+0000 7f9beb200640 1 -- 172.21.15.55:0/2701892041 shutdown_connections 2024-04-02T07:34:24.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.443+0000 7f9beb200640 1 -- 172.21.15.55:0/2701892041 wait complete. 2024-04-02T07:34:24.460 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json tag path /parent mytag123 2024-04-02T07:34:24.626 INFO:teuthology.orchestra.run.smithi055.stdout:{"return_code":0,"scrub_tag":"mytag123","mode":"asynchronous"} 2024-04-02T07:34:24.627 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mode": "asynchronous", "return_code": 0, "scrub_tag": "mytag123" } 2024-04-02T07:34:24.627 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f7.00000000 scrub_tag 2024-04-02T07:34:24.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.675+0000 7f12a7313080 1 Processor -- start 2024-04-02T07:34:24.674 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.675+0000 7f12a7313080 1 -- start start 2024-04-02T07:34:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.675+0000 7f12a7313080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1288002820 0x55b274a57e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.675+0000 7f12a7313080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55b274b29b20 0x55b274b29f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.675+0000 7f12a7313080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b274b28cc0 0x55b274b290a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.675+0000 7f12a7313080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b274a021e0 con 0x55b274b28cc0 2024-04-02T07:34:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.675+0000 7f12a7313080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b27499d960 con 0x7f1288002820 2024-04-02T07:34:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.675+0000 7f12a7313080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b27499d600 con 0x55b274b29b20 2024-04-02T07:34:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.675+0000 7f12a5000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b274b28cc0 0x55b274b290a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.675+0000 7f12a5000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b274b28cc0 0x55b274b290a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49678/0 (socket says 172.21.15.55:49678) 2024-04-02T07:34:24.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.675+0000 7f12a5000640 1 -- 172.21.15.55:0/3042484540 learned_addr learned my addr 172.21.15.55:0/3042484540 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:24.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.675+0000 7f12a5000640 1 -- 172.21.15.55:0/3042484540 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55b274b29b20 msgr2=0x55b274b29f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:24.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.675+0000 7f12a5000640 1 --2- 172.21.15.55:0/3042484540 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55b274b29b20 0x55b274b29f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.675+0000 7f12a5000640 1 -- 172.21.15.55:0/3042484540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1288002820 msgr2=0x55b274a57e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:24.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.675+0000 7f12a5000640 1 --2- 172.21.15.55:0/3042484540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1288002820 0x55b274a57e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.675+0000 7f12a5000640 1 -- 172.21.15.55:0/3042484540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b27499fd00 con 0x55b274b28cc0 2024-04-02T07:34:24.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a5000640 1 --2- 172.21.15.55:0/3042484540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b274b28cc0 0x55b274b290a0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x55b274a85e30 tx=0x7f129c005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c419b3afd7f6f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:24.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a2800640 1 -- 172.21.15.55:0/3042484540 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c015750 con 0x55b274b28cc0 2024-04-02T07:34:24.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a2800640 1 -- 172.21.15.55:0/3042484540 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129c0158d0 con 0x55b274b28cc0 2024-04-02T07:34:24.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a2800640 1 -- 172.21.15.55:0/3042484540 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c015c80 con 0x55b274b28cc0 2024-04-02T07:34:24.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a7313080 1 -- 172.21.15.55:0/3042484540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b274b28cc0 msgr2=0x55b274b290a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a7313080 1 --2- 172.21.15.55:0/3042484540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b274b28cc0 0x55b274b290a0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x55b274a85e30 tx=0x7f129c005d90 comp rx=0 tx=0).stop 2024-04-02T07:34:24.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a7313080 1 -- 172.21.15.55:0/3042484540 shutdown_connections 2024-04-02T07:34:24.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a7313080 1 --2- 172.21.15.55:0/3042484540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b274b28cc0 0x55b274b290a0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a7313080 1 --2- 172.21.15.55:0/3042484540 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55b274b29b20 0x55b274b29f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a7313080 1 --2- 172.21.15.55:0/3042484540 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1288002820 0x55b274a57e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a7313080 1 -- 172.21.15.55:0/3042484540 >> 172.21.15.55:0/3042484540 conn(0x55b274a845a0 msgr2=0x55b274b36a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:24.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a7313080 1 -- 172.21.15.55:0/3042484540 shutdown_connections 2024-04-02T07:34:24.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a7313080 1 -- 172.21.15.55:0/3042484540 wait complete. 2024-04-02T07:34:24.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a7313080 1 Processor -- start 2024-04-02T07:34:24.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a7313080 1 -- start start 2024-04-02T07:34:24.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a7313080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b274b28cc0 0x55b274b32710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a7313080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b274b29b20 0x55b274bbf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a7313080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1288002820 0x55b274b28360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a7313080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b274994690 con 0x55b274b29b20 2024-04-02T07:34:24.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a7313080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b274bbf9f0 con 0x55b274b28cc0 2024-04-02T07:34:24.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a7313080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b274bbfc80 con 0x7f1288002820 2024-04-02T07:34:24.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a3c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b274b29b20 0x55b274bbf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a3c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b274b29b20 0x55b274bbf4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49688/0 (socket says 172.21.15.55:49688) 2024-04-02T07:34:24.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a3c00640 1 -- 172.21.15.55:0/1211297259 learned_addr learned my addr 172.21.15.55:0/1211297259 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:24.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a4600640 1 --2- 172.21.15.55:0/1211297259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b274b28cc0 0x55b274b32710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a5000640 1 --2- 172.21.15.55:0/1211297259 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1288002820 0x55b274b28360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a3c00640 1 -- 172.21.15.55:0/1211297259 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1288002820 msgr2=0x55b274b28360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a3c00640 1 --2- 172.21.15.55:0/1211297259 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1288002820 0x55b274b28360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a3c00640 1 -- 172.21.15.55:0/1211297259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b274b28cc0 msgr2=0x55b274b32710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a3c00640 1 --2- 172.21.15.55:0/1211297259 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55b274b28cc0 0x55b274b32710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a3c00640 1 -- 172.21.15.55:0/1211297259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f129c00f250 con 0x55b274b29b20 2024-04-02T07:34:24.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a3c00640 1 --2- 172.21.15.55:0/1211297259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b274b29b20 0x55b274bbf4b0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f12900ae040 tx=0x7f12900ac910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:24.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a1400640 1 -- 172.21.15.55:0/1211297259 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12900a4cb0 con 0x55b274b29b20 2024-04-02T07:34:24.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a1400640 1 -- 172.21.15.55:0/1211297259 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1290001440 con 0x55b274b29b20 2024-04-02T07:34:24.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.679+0000 7f12a1400640 1 -- 172.21.15.55:0/1211297259 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12900015f0 con 0x55b274b29b20 2024-04-02T07:34:24.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.683+0000 7f12a7313080 1 -- 172.21.15.55:0/1211297259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55b27499f760 con 0x55b274b29b20 2024-04-02T07:34:24.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.683+0000 7f12a7313080 1 -- 172.21.15.55:0/1211297259 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b274bc01c0 con 0x55b274b29b20 2024-04-02T07:34:24.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.683+0000 7f12a1400640 1 -- 172.21.15.55:0/1211297259 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f129000a040 con 0x55b274b29b20 2024-04-02T07:34:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.683+0000 7f12a1400640 1 --2- 172.21.15.55:0/1211297259 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1284065070 0x7f1284067530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.683+0000 7f12a1400640 1 -- 172.21.15.55:0/1211297259 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f129011d870 con 0x55b274b29b20 2024-04-02T07:34:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.683+0000 7f12a4600640 1 --2- 172.21.15.55:0/1211297259 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1284065070 0x7f1284067530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.683+0000 7f12a7313080 1 --2- 172.21.15.55:0/1211297259 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x55b274b35210 0x55b274b35620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.683+0000 7f12a7313080 1 -- 172.21.15.55:0/1211297259 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:1 17.36 17:6fe38dc2:::100000001f7.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v8 -- 0x55b274b35b60 con 0x55b274b35210 2024-04-02T07:34:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.683+0000 7f12a5000640 1 --2- 172.21.15.55:0/1211297259 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x55b274b35210 0x55b274b35620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.683+0000 7f12a4600640 1 --2- 172.21.15.55:0/1211297259 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1284065070 0x7f1284067530 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f1294001060 tx=0x7f1294000ff0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.683+0000 7f12a5000640 1 --2- 172.21.15.55:0/1211297259 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x55b274b35210 0x55b274b35620 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.687+0000 7f12a5000640 1 -- 172.21.15.55:0/1211297259 <== osd.0 v2:172.21.15.55:6800/27392 1 ==== osd_op_reply(1 100000001f7.00000000 [getxattr] v0'0 uv0 ondisk = -61 ((61) No data available)) v8 ==== 164+0+0 (crc 0 0 0) 0x7f129c01c020 con 0x55b274b35210 2024-04-02T07:34:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:error getting xattr cephfs_data/100000001f7.00000000/scrub_tag: (61) No data available 2024-04-02T07:34:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.687+0000 7f12a7313080 1 -- 172.21.15.55:0/1211297259 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x55b274b35210 msgr2=0x55b274b35620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.687+0000 7f12a7313080 1 --2- 172.21.15.55:0/1211297259 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x55b274b35210 0x55b274b35620 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.685 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.687+0000 7f12a7313080 1 -- 172.21.15.55:0/1211297259 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1284065070 msgr2=0x7f1284067530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.687+0000 7f12a7313080 1 --2- 172.21.15.55:0/1211297259 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1284065070 0x7f1284067530 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f1294001060 tx=0x7f1294000ff0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.687+0000 7f12a7313080 1 -- 172.21.15.55:0/1211297259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b274b29b20 msgr2=0x55b274bbf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.687+0000 7f12a7313080 1 --2- 172.21.15.55:0/1211297259 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55b274b29b20 0x55b274bbf4b0 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f12900ae040 tx=0x7f12900ac910 comp rx=0 tx=0).stop 2024-04-02T07:34:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.687+0000 7f12a5000640 1 -- 172.21.15.55:0/1211297259 reap_dead start 2024-04-02T07:34:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.687+0000 7f12a7313080 1 -- 172.21.15.55:0/1211297259 shutdown_connections 2024-04-02T07:34:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.687+0000 7f12a7313080 1 -- 172.21.15.55:0/1211297259 >> 172.21.15.55:0/1211297259 conn(0x55b274a845a0 msgr2=0x55b274b290a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.687+0000 7f12a7313080 1 -- 172.21.15.55:0/1211297259 shutdown_connections 2024-04-02T07:34:24.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.687+0000 7f12a7313080 1 -- 172.21.15.55:0/1211297259 wait complete. 2024-04-02T07:34:24.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:34:24.689 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000002.00000000 scrub_tag 2024-04-02T07:34:24.734 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.735+0000 7fe67ebad080 1 Processor -- start 2024-04-02T07:34:24.735 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.735+0000 7fe67ebad080 1 -- start start 2024-04-02T07:34:24.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.735+0000 7fe67ebad080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55990e87f7e0 0x55990e908bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.735+0000 7fe67ebad080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55990e8807a0 0x55990e906270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.735+0000 7fe67ebad080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55990e90ca20 0x55990e8675b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.735+0000 7fe67ebad080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990e7e11e0 con 0x55990e87f7e0 2024-04-02T07:34:24.736 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.735+0000 7fe67ebad080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990e77c960 con 0x55990e8807a0 2024-04-02T07:34:24.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.735+0000 7fe67ebad080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55990e77c600 con 0x55990e90ca20 2024-04-02T07:34:24.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.735+0000 7fe67be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55990e87f7e0 0x55990e908bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.735+0000 7fe67be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55990e87f7e0 0x55990e908bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49706/0 (socket says 172.21.15.55:49706) 2024-04-02T07:34:24.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.735+0000 7fe67be00640 1 -- 172.21.15.55:0/3132923466 learned_addr learned my addr 172.21.15.55:0/3132923466 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:24.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.735+0000 7fe67be00640 1 -- 172.21.15.55:0/3132923466 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55990e90ca20 msgr2=0x55990e8675b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:24.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.735+0000 7fe67be00640 1 --2- 172.21.15.55:0/3132923466 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55990e90ca20 0x55990e8675b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.735+0000 7fe67be00640 1 -- 172.21.15.55:0/3132923466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55990e8807a0 msgr2=0x55990e906270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:24.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.735+0000 7fe67be00640 1 --2- 172.21.15.55:0/3132923466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55990e8807a0 0x55990e906270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67be00640 1 -- 172.21.15.55:0/3132923466 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67400a100 con 0x55990e87f7e0 2024-04-02T07:34:24.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67be00640 1 --2- 172.21.15.55:0/3132923466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55990e87f7e0 0x55990e908bc0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00b250 tx=0x7fe66c00b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d98a7c50c1276e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:24.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67a000640 1 -- 172.21.15.55:0/3132923466 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c014070 con 0x55990e87f7e0 2024-04-02T07:34:24.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67a000640 1 -- 172.21.15.55:0/3132923466 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66c00d510 con 0x55990e87f7e0 2024-04-02T07:34:24.737 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67a000640 1 -- 172.21.15.55:0/3132923466 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66c00d8e0 con 0x55990e87f7e0 2024-04-02T07:34:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67ebad080 1 -- 172.21.15.55:0/3132923466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55990e87f7e0 msgr2=0x55990e908bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67ebad080 1 --2- 172.21.15.55:0/3132923466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55990e87f7e0 0x55990e908bc0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00b250 tx=0x7fe66c00b710 comp rx=0 tx=0).stop 2024-04-02T07:34:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67ebad080 1 -- 172.21.15.55:0/3132923466 shutdown_connections 2024-04-02T07:34:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67ebad080 1 --2- 172.21.15.55:0/3132923466 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55990e90ca20 0x55990e8675b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67ebad080 1 --2- 172.21.15.55:0/3132923466 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55990e8807a0 0x55990e906270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67ebad080 1 --2- 172.21.15.55:0/3132923466 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55990e87f7e0 0x55990e908bc0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67ebad080 1 -- 172.21.15.55:0/3132923466 >> 172.21.15.55:0/3132923466 conn(0x55990e8635a0 msgr2=0x55990e90b810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67ebad080 1 -- 172.21.15.55:0/3132923466 shutdown_connections 2024-04-02T07:34:24.740 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67ebad080 1 -- 172.21.15.55:0/3132923466 wait complete. 2024-04-02T07:34:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67ebad080 1 Processor -- start 2024-04-02T07:34:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67ebad080 1 -- start start 2024-04-02T07:34:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67ebad080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55990e87f7e0 0x55990e8687d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67ebad080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55990e8807a0 0x55990e8f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67ebad080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55990e90ca20 0x55990e8f10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67ebad080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990e773690 con 0x55990e8807a0 2024-04-02T07:34:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67ebad080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55990e8f15f0 con 0x55990e90ca20 2024-04-02T07:34:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67ebad080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55990e8ee700 con 0x55990e87f7e0 2024-04-02T07:34:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55990e8807a0 0x55990e8f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67b400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55990e8807a0 0x55990e8f0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49718/0 (socket says 172.21.15.55:49718) 2024-04-02T07:34:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67b400640 1 -- 172.21.15.55:0/1920854650 learned_addr learned my addr 172.21.15.55:0/1920854650 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67be00640 1 --2- 172.21.15.55:0/1920854650 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55990e87f7e0 0x55990e8687d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67c800640 1 --2- 172.21.15.55:0/1920854650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55990e90ca20 0x55990e8f10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67b400640 1 -- 172.21.15.55:0/1920854650 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55990e87f7e0 msgr2=0x55990e8687d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67b400640 1 --2- 172.21.15.55:0/1920854650 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55990e87f7e0 0x55990e8687d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67b400640 1 -- 172.21.15.55:0/1920854650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55990e90ca20 msgr2=0x55990e8f10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67b400640 1 --2- 172.21.15.55:0/1920854650 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55990e90ca20 0x55990e8f10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67b400640 1 -- 172.21.15.55:0/1920854650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66c001b10 con 0x55990e8807a0 2024-04-02T07:34:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.739+0000 7fe67b400640 1 --2- 172.21.15.55:0/1920854650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55990e8807a0 0x55990e8f0b70 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fe668001e60 tx=0x7fe668009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.743+0000 7fe678c00640 1 -- 172.21.15.55:0/1920854650 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66800f410 con 0x55990e8807a0 2024-04-02T07:34:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.743+0000 7fe678c00640 1 -- 172.21.15.55:0/1920854650 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe66800f590 con 0x55990e8807a0 2024-04-02T07:34:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.743+0000 7fe678c00640 1 -- 172.21.15.55:0/1920854650 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe66800f940 con 0x55990e8807a0 2024-04-02T07:34:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.743+0000 7fe67ebad080 1 -- 172.21.15.55:0/1920854650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55990e77ed00 con 0x55990e8807a0 2024-04-02T07:34:24.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.743+0000 7fe67ebad080 1 -- 172.21.15.55:0/1920854650 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55990e77e760 con 0x55990e8807a0 2024-04-02T07:34:24.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.743+0000 7fe678c00640 1 -- 172.21.15.55:0/1920854650 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fe66800faa0 con 0x55990e8807a0 2024-04-02T07:34:24.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.743+0000 7fe678c00640 1 --2- 172.21.15.55:0/1920854650 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe65c0650a0 0x7fe65c067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.743+0000 7fe678c00640 1 -- 172.21.15.55:0/1920854650 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fe668082930 con 0x55990e8807a0 2024-04-02T07:34:24.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.743+0000 7fe67ebad080 1 --2- 172.21.15.55:0/1920854650 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55990e868d10 0x55990e8ef380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.743+0000 7fe67be00640 1 --2- 172.21.15.55:0/1920854650 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe65c0650a0 0x7fe65c067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.743+0000 7fe67ebad080 1 -- 172.21.15.55:0/1920854650 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:1 17.12 17:4bec3886:::10000000002.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v8 -- 0x55990e8ef8c0 con 0x55990e868d10 2024-04-02T07:34:24.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.743+0000 7fe67c800640 1 --2- 172.21.15.55:0/1920854650 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55990e868d10 0x55990e8ef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.743+0000 7fe67be00640 1 --2- 172.21.15.55:0/1920854650 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe65c0650a0 0x7fe65c067560 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00b250 tx=0x7fe66c009000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:24.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.743+0000 7fe67c800640 1 --2- 172.21.15.55:0/1920854650 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55990e868d10 0x55990e8ef380 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.747+0000 7fe67c800640 1 -- 172.21.15.55:0/1920854650 <== osd.3 v2:172.21.15.55:6824/27393 1 ==== osd_op_reply(1 10000000002.00000000 [getxattr (12) out=12b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7fe6740aa680 con 0x55990e868d10 2024-04-02T07:34:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.747+0000 7fe67ebad080 1 -- 172.21.15.55:0/1920854650 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55990e868d10 msgr2=0x55990e8ef380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.747+0000 7fe67ebad080 1 --2- 172.21.15.55:0/1920854650 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x55990e868d10 0x55990e8ef380 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.747+0000 7fe67ebad080 1 -- 172.21.15.55:0/1920854650 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe65c0650a0 msgr2=0x7fe65c067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.747+0000 7fe67ebad080 1 --2- 172.21.15.55:0/1920854650 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fe65c0650a0 0x7fe65c067560 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fe66c00b250 tx=0x7fe66c009000 comp rx=0 tx=0).stop 2024-04-02T07:34:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.747+0000 7fe67ebad080 1 -- 172.21.15.55:0/1920854650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55990e8807a0 msgr2=0x55990e8f0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.747+0000 7fe67ebad080 1 --2- 172.21.15.55:0/1920854650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55990e8807a0 0x55990e8f0b70 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fe668001e60 tx=0x7fe668009540 comp rx=0 tx=0).stop 2024-04-02T07:34:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.747+0000 7fe67c800640 1 -- 172.21.15.55:0/1920854650 reap_dead start 2024-04-02T07:34:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.747+0000 7fe67ebad080 1 -- 172.21.15.55:0/1920854650 shutdown_connections 2024-04-02T07:34:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.747+0000 7fe67ebad080 1 -- 172.21.15.55:0/1920854650 >> 172.21.15.55:0/1920854650 conn(0x55990e8635a0 msgr2=0x55990e90eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.747+0000 7fe67ebad080 1 -- 172.21.15.55:0/1920854650 shutdown_connections 2024-04-02T07:34:24.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.747+0000 7fe67ebad080 1 -- 172.21.15.55:0/1920854650 wait complete. 2024-04-02T07:34:24.749 INFO:teuthology.orchestra.run.smithi055.stdout:mytag123 2024-04-02T07:34:24.749 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 100000001f8.00000000 scrub_tag 2024-04-02T07:34:24.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f98f46080 1 Processor -- start 2024-04-02T07:34:24.838 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f98f46080 1 -- start start 2024-04-02T07:34:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f98f46080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cdc1465540 0x55cdc13d3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f98f46080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cdc147c710 0x55cdc13a3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f98f46080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cdc147cda0 0x55cdc13a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f98f46080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdc12eb960 con 0x55cdc147c710 2024-04-02T07:34:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f98f46080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdc12eb600 con 0x55cdc147cda0 2024-04-02T07:34:24.840 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f98f46080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cdc12e2690 con 0x55cdc1465540 2024-04-02T07:34:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f95800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cdc147c710 0x55cdc13a3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f95800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cdc147c710 0x55cdc13a3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49730/0 (socket says 172.21.15.55:49730) 2024-04-02T07:34:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f95800640 1 -- 172.21.15.55:0/2764698411 learned_addr learned my addr 172.21.15.55:0/2764698411 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f96200640 1 --2- 172.21.15.55:0/2764698411 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cdc1465540 0x55cdc13d3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f96c00640 1 --2- 172.21.15.55:0/2764698411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cdc147cda0 0x55cdc13a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f95800640 1 -- 172.21.15.55:0/2764698411 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cdc1465540 msgr2=0x55cdc13d3880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f95800640 1 --2- 172.21.15.55:0/2764698411 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cdc1465540 0x55cdc13d3880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f95800640 1 -- 172.21.15.55:0/2764698411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cdc147cda0 msgr2=0x55cdc13a44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f95800640 1 --2- 172.21.15.55:0/2764698411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cdc147cda0 0x55cdc13a44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f95800640 1 -- 172.21.15.55:0/2764698411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f88005d30 con 0x55cdc147c710 2024-04-02T07:34:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f96c00640 1 --2- 172.21.15.55:0/2764698411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cdc147cda0 0x55cdc13a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f95800640 1 --2- 172.21.15.55:0/2764698411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cdc147c710 0x55cdc13a3f80 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400b350 tx=0x7f3f8400b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b823f739a52198 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f8fe00640 1 -- 172.21.15.55:0/2764698411 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f84014070 con 0x55cdc147c710 2024-04-02T07:34:24.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f8fe00640 1 -- 172.21.15.55:0/2764698411 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8400d510 con 0x55cdc147c710 2024-04-02T07:34:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.839+0000 7f3f8fe00640 1 -- 172.21.15.55:0/2764698411 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8400d8a0 con 0x55cdc147c710 2024-04-02T07:34:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f98f46080 1 -- 172.21.15.55:0/2764698411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cdc147c710 msgr2=0x55cdc13a3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f98f46080 1 --2- 172.21.15.55:0/2764698411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cdc147c710 0x55cdc13a3f80 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7f3f8400b350 tx=0x7f3f8400b810 comp rx=0 tx=0).stop 2024-04-02T07:34:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f98f46080 1 -- 172.21.15.55:0/2764698411 shutdown_connections 2024-04-02T07:34:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f98f46080 1 --2- 172.21.15.55:0/2764698411 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cdc147cda0 0x55cdc13a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f98f46080 1 --2- 172.21.15.55:0/2764698411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cdc147c710 0x55cdc13a3f80 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f98f46080 1 --2- 172.21.15.55:0/2764698411 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cdc1465540 0x55cdc13d3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f98f46080 1 -- 172.21.15.55:0/2764698411 >> 172.21.15.55:0/2764698411 conn(0x55cdc13d1bf0 msgr2=0x55cdc13a2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f98f46080 1 -- 172.21.15.55:0/2764698411 shutdown_connections 2024-04-02T07:34:24.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f98f46080 1 -- 172.21.15.55:0/2764698411 wait complete. 2024-04-02T07:34:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f98f46080 1 Processor -- start 2024-04-02T07:34:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f98f46080 1 -- start start 2024-04-02T07:34:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f98f46080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cdc1465540 0x55cdc1485e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f98f46080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cdc147c710 0x55cdc13ed8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f98f46080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cdc147cda0 0x55cdc147f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f98f46080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdc14607d0 con 0x55cdc1465540 2024-04-02T07:34:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f98f46080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdc1460530 con 0x55cdc147c710 2024-04-02T07:34:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f98f46080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x55cdc13eced0 con 0x55cdc147cda0 2024-04-02T07:34:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f96200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cdc1465540 0x55cdc1485e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f96200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cdc1465540 0x55cdc1485e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49742/0 (socket says 172.21.15.55:49742) 2024-04-02T07:34:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f96200640 1 -- 172.21.15.55:0/2227535154 learned_addr learned my addr 172.21.15.55:0/2227535154 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f95800640 1 --2- 172.21.15.55:0/2227535154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cdc147c710 0x55cdc13ed8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f96c00640 1 --2- 172.21.15.55:0/2227535154 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cdc147cda0 0x55cdc147f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f96200640 1 -- 172.21.15.55:0/2227535154 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cdc147cda0 msgr2=0x55cdc147f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f96200640 1 --2- 172.21.15.55:0/2227535154 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x55cdc147cda0 0x55cdc147f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f96200640 1 -- 172.21.15.55:0/2227535154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cdc147c710 msgr2=0x55cdc13ed8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f96200640 1 --2- 172.21.15.55:0/2227535154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cdc147c710 0x55cdc13ed8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f96200640 1 -- 172.21.15.55:0/2227535154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f84001c20 con 0x55cdc1465540 2024-04-02T07:34:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f95800640 1 --2- 172.21.15.55:0/2227535154 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x55cdc147c710 0x55cdc13ed8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:24.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f96200640 1 --2- 172.21.15.55:0/2227535154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cdc1465540 0x55cdc1485e50 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f3f88000c10 tx=0x7f3f88018570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f8ea00640 1 -- 172.21.15.55:0/2227535154 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f880c0660 con 0x55cdc1465540 2024-04-02T07:34:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f8ea00640 1 -- 172.21.15.55:0/2227535154 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f880c07c0 con 0x55cdc1465540 2024-04-02T07:34:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f98f46080 1 -- 172.21.15.55:0/2227535154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x55cdc12fa8c0 con 0x55cdc1465540 2024-04-02T07:34:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f8ea00640 1 -- 172.21.15.55:0/2227535154 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f880c0b30 con 0x55cdc1465540 2024-04-02T07:34:24.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.843+0000 7f3f98f46080 1 -- 172.21.15.55:0/2227535154 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cdc12edd00 con 0x55cdc1465540 2024-04-02T07:34:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.847+0000 7f3f8ea00640 1 -- 172.21.15.55:0/2227535154 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3f880ac440 con 0x55cdc1465540 2024-04-02T07:34:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.847+0000 7f3f8ea00640 1 --2- 172.21.15.55:0/2227535154 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f780650a0 0x7f3f78067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.847+0000 7f3f8ea00640 1 -- 172.21.15.55:0/2227535154 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f3f8811ea70 con 0x55cdc1465540 2024-04-02T07:34:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.847+0000 7f3f98f46080 1 --2- 172.21.15.55:0/2227535154 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x55cdc13eddf0 0x55cdc15171f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.847+0000 7f3f95800640 1 --2- 172.21.15.55:0/2227535154 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f780650a0 0x7f3f78067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.847+0000 7f3f98f46080 1 -- 172.21.15.55:0/2227535154 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:1 17.19 17:997b7129:::100000001f8.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v8 -- 0x55cdc147fc40 con 0x55cdc13eddf0 2024-04-02T07:34:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.847+0000 7f3f96c00640 1 --2- 172.21.15.55:0/2227535154 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x55cdc13eddf0 0x55cdc15171f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.847+0000 7f3f95800640 1 --2- 172.21.15.55:0/2227535154 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f780650a0 0x7f3f78067560 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3f84000c10 tx=0x7f3f84008000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:24.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.847+0000 7f3f96c00640 1 --2- 172.21.15.55:0/2227535154 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x55cdc13eddf0 0x55cdc15171f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.847+0000 7f3f96c00640 1 -- 172.21.15.55:0/2227535154 <== osd.5 v2:172.21.15.106:6800/27676 1 ==== osd_op_reply(1 100000001f8.00000000 [getxattr (12) out=12b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7f3f90002aa0 con 0x55cdc13eddf0 2024-04-02T07:34:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.847+0000 7f3f98f46080 1 -- 172.21.15.55:0/2227535154 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x55cdc13eddf0 msgr2=0x55cdc15171f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.847+0000 7f3f98f46080 1 --2- 172.21.15.55:0/2227535154 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x55cdc13eddf0 0x55cdc15171f0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.847+0000 7f3f98f46080 1 -- 172.21.15.55:0/2227535154 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f780650a0 msgr2=0x7f3f78067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.847+0000 7f3f98f46080 1 --2- 172.21.15.55:0/2227535154 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3f780650a0 0x7f3f78067560 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f3f84000c10 tx=0x7f3f84008000 comp rx=0 tx=0).stop 2024-04-02T07:34:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.847+0000 7f3f98f46080 1 -- 172.21.15.55:0/2227535154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cdc1465540 msgr2=0x55cdc1485e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.847+0000 7f3f98f46080 1 --2- 172.21.15.55:0/2227535154 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x55cdc1465540 0x55cdc1485e50 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f3f88000c10 tx=0x7f3f88018570 comp rx=0 tx=0).stop 2024-04-02T07:34:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.847+0000 7f3f96c00640 1 -- 172.21.15.55:0/2227535154 reap_dead start 2024-04-02T07:34:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.847+0000 7f3f98f46080 1 -- 172.21.15.55:0/2227535154 shutdown_connections 2024-04-02T07:34:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.847+0000 7f3f98f46080 1 -- 172.21.15.55:0/2227535154 >> 172.21.15.55:0/2227535154 conn(0x55cdc13d1bf0 msgr2=0x55cdc13a2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.851+0000 7f3f98f46080 1 -- 172.21.15.55:0/2227535154 shutdown_connections 2024-04-02T07:34:24.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.851+0000 7f3f98f46080 1 -- 172.21.15.55:0/2227535154 wait complete. 2024-04-02T07:34:24.852 INFO:teuthology.orchestra.run.smithi055.stdout:mytag123 2024-04-02T07:34:24.853 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage rados --cluster ceph --pool cephfs_data getxattr 10000000004.00000000 scrub_tag 2024-04-02T07:34:24.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.899+0000 7fada2238080 1 Processor -- start 2024-04-02T07:34:24.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.899+0000 7fada2238080 1 -- start start 2024-04-02T07:34:24.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.899+0000 7fada2238080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560db1fed5d0 0x560db20cac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.899+0000 7fada2238080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560db20aa0b0 0x560db2019fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.899+0000 7fada2238080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560db20aa490 0x560db201b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.899+0000 7fada2238080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db1f33960 con 0x560db1fed5d0 2024-04-02T07:34:24.901 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.899+0000 7fada2238080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db1f33600 con 0x560db20aa0b0 2024-04-02T07:34:24.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.899+0000 7fada2238080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x560db1f2a690 con 0x560db20aa490 2024-04-02T07:34:24.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.899+0000 7fad9f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560db1fed5d0 0x560db20cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.899+0000 7fad9f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560db1fed5d0 0x560db20cac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49768/0 (socket says 172.21.15.55:49768) 2024-04-02T07:34:24.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.899+0000 7fad9f400640 1 -- 172.21.15.55:0/2110668414 learned_addr learned my addr 172.21.15.55:0/2110668414 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:24.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9fe00640 1 --2- 172.21.15.55:0/2110668414 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560db20aa490 0x560db201b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9ea00640 1 --2- 172.21.15.55:0/2110668414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560db20aa0b0 0x560db2019fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9f400640 1 -- 172.21.15.55:0/2110668414 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560db20aa490 msgr2=0x560db201b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:24.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9f400640 1 --2- 172.21.15.55:0/2110668414 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560db20aa490 0x560db201b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9f400640 1 -- 172.21.15.55:0/2110668414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560db20aa0b0 msgr2=0x560db2019fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:24.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9f400640 1 --2- 172.21.15.55:0/2110668414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560db20aa0b0 0x560db2019fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9f400640 1 -- 172.21.15.55:0/2110668414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad8c005df0 con 0x560db1fed5d0 2024-04-02T07:34:24.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9f400640 1 --2- 172.21.15.55:0/2110668414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560db1fed5d0 0x560db20cac40 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fad9000a750 tx=0x7fad9000ac10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b533c54ddef0b99b server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:24.902 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9d600640 1 -- 172.21.15.55:0/2110668414 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad9000f070 con 0x560db1fed5d0 2024-04-02T07:34:24.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9d600640 1 -- 172.21.15.55:0/2110668414 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad90008c00 con 0x560db1fed5d0 2024-04-02T07:34:24.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9d600640 1 -- 172.21.15.55:0/2110668414 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad900133f0 con 0x560db1fed5d0 2024-04-02T07:34:24.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fada2238080 1 -- 172.21.15.55:0/2110668414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560db1fed5d0 msgr2=0x560db20cac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fada2238080 1 --2- 172.21.15.55:0/2110668414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560db1fed5d0 0x560db20cac40 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7fad9000a750 tx=0x7fad9000ac10 comp rx=0 tx=0).stop 2024-04-02T07:34:24.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fada2238080 1 -- 172.21.15.55:0/2110668414 shutdown_connections 2024-04-02T07:34:24.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fada2238080 1 --2- 172.21.15.55:0/2110668414 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560db20aa490 0x560db201b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fada2238080 1 --2- 172.21.15.55:0/2110668414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560db20aa0b0 0x560db2019fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fada2238080 1 --2- 172.21.15.55:0/2110668414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560db1fed5d0 0x560db20cac40 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fada2238080 1 -- 172.21.15.55:0/2110668414 >> 172.21.15.55:0/2110668414 conn(0x560db2019bf0 msgr2=0x560db20a93d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:24.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fada2238080 1 -- 172.21.15.55:0/2110668414 shutdown_connections 2024-04-02T07:34:24.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fada2238080 1 -- 172.21.15.55:0/2110668414 wait complete. 2024-04-02T07:34:24.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fada2238080 1 Processor -- start 2024-04-02T07:34:24.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fada2238080 1 -- start start 2024-04-02T07:34:24.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fada2238080 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560db1fed5d0 0x560db20c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fada2238080 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560db20aa0b0 0x560db2015610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fada2238080 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560db20aa490 0x560db2015b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fada2238080 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db2016090 con 0x560db20aa0b0 2024-04-02T07:34:24.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fada2238080 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x560db20a9170 con 0x560db20aa490 2024-04-02T07:34:24.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fada2238080 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x560db20a9410 con 0x560db1fed5d0 2024-04-02T07:34:24.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560db20aa0b0 0x560db2015610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560db20aa0b0 0x560db2015610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49784/0 (socket says 172.21.15.55:49784) 2024-04-02T07:34:24.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9ea00640 1 -- 172.21.15.55:0/905385474 learned_addr learned my addr 172.21.15.55:0/905385474 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:24.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9f400640 1 --2- 172.21.15.55:0/905385474 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560db1fed5d0 0x560db20c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9fe00640 1 --2- 172.21.15.55:0/905385474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560db20aa490 0x560db2015b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9ea00640 1 -- 172.21.15.55:0/905385474 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560db1fed5d0 msgr2=0x560db20c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9ea00640 1 --2- 172.21.15.55:0/905385474 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560db1fed5d0 0x560db20c28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9ea00640 1 -- 172.21.15.55:0/905385474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560db20aa490 msgr2=0x560db2015b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9ea00640 1 --2- 172.21.15.55:0/905385474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560db20aa490 0x560db2015b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9ea00640 1 -- 172.21.15.55:0/905385474 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad9000a430 con 0x560db20aa0b0 2024-04-02T07:34:24.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.903+0000 7fad9fe00640 1 --2- 172.21.15.55:0/905385474 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560db20aa490 0x560db2015b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:24.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.907+0000 7fad9ea00640 1 --2- 172.21.15.55:0/905385474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560db20aa0b0 0x560db2015610 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fad8c019eb0 tx=0x7fad8c0185a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:24.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.907+0000 7fad97e00640 1 -- 172.21.15.55:0/905385474 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c0ac710 con 0x560db20aa0b0 2024-04-02T07:34:24.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.907+0000 7fad97e00640 1 -- 172.21.15.55:0/905385474 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c0ac870 con 0x560db20aa0b0 2024-04-02T07:34:24.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.907+0000 7fad97e00640 1 -- 172.21.15.55:0/905385474 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c0acc00 con 0x560db20aa0b0 2024-04-02T07:34:24.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.907+0000 7fada2238080 1 -- 172.21.15.55:0/905385474 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560db1f428c0 con 0x560db20aa0b0 2024-04-02T07:34:24.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.907+0000 7fada2238080 1 -- 172.21.15.55:0/905385474 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560db1f35d00 con 0x560db20aa0b0 2024-04-02T07:34:24.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.907+0000 7fad97e00640 1 -- 172.21.15.55:0/905385474 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fad8c0b7420 con 0x560db20aa0b0 2024-04-02T07:34:24.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.907+0000 7fad97e00640 1 --2- 172.21.15.55:0/905385474 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fad800650a0 0x7fad80067560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.907+0000 7fad97e00640 1 -- 172.21.15.55:0/905385474 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fad8c11e7f0 con 0x560db20aa0b0 2024-04-02T07:34:24.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.907+0000 7fad9f400640 1 --2- 172.21.15.55:0/905385474 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fad800650a0 0x7fad80067560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.909 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.907+0000 7fada2238080 1 --2- 172.21.15.55:0/905385474 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x560db215d680 0x560db202e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.907+0000 7fada2238080 1 -- 172.21.15.55:0/905385474 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:1 17.5 17:a367a3e8:::10000000004.00000000:head [getxattr scrub_tag in=9b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e119) v8 -- 0x560db20c2e00 con 0x560db215d680 2024-04-02T07:34:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.911+0000 7fad9fe00640 1 --2- 172.21.15.55:0/905385474 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x560db215d680 0x560db202e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.911+0000 7fad9f400640 1 --2- 172.21.15.55:0/905385474 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fad800650a0 0x7fad80067560 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fad90000c10 tx=0x7fad9000c000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.911+0000 7fad9fe00640 1 --2- 172.21.15.55:0/905385474 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x560db215d680 0x560db202e360 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.911+0000 7fad9fe00640 1 -- 172.21.15.55:0/905385474 <== osd.6 v2:172.21.15.106:6816/27678 1 ==== osd_op_reply(1 10000000004.00000000 [getxattr (12) out=12b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+12 (crc 0 0 0) 0x7fad98006c90 con 0x560db215d680 2024-04-02T07:34:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.911+0000 7fada2238080 1 -- 172.21.15.55:0/905385474 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x560db215d680 msgr2=0x560db202e360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.911+0000 7fada2238080 1 --2- 172.21.15.55:0/905385474 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x560db215d680 0x560db202e360 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.911+0000 7fada2238080 1 -- 172.21.15.55:0/905385474 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fad800650a0 msgr2=0x7fad80067560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.911+0000 7fada2238080 1 --2- 172.21.15.55:0/905385474 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fad800650a0 0x7fad80067560 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fad90000c10 tx=0x7fad9000c000 comp rx=0 tx=0).stop 2024-04-02T07:34:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.911+0000 7fada2238080 1 -- 172.21.15.55:0/905385474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560db20aa0b0 msgr2=0x560db2015610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.911+0000 7fada2238080 1 --2- 172.21.15.55:0/905385474 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560db20aa0b0 0x560db2015610 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7fad8c019eb0 tx=0x7fad8c0185a0 comp rx=0 tx=0).stop 2024-04-02T07:34:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.911+0000 7fad9fe00640 1 -- 172.21.15.55:0/905385474 reap_dead start 2024-04-02T07:34:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.911+0000 7fada2238080 1 -- 172.21.15.55:0/905385474 shutdown_connections 2024-04-02T07:34:24.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.911+0000 7fada2238080 1 -- 172.21.15.55:0/905385474 >> 172.21.15.55:0/905385474 conn(0x560db2019bf0 msgr2=0x560db20cac40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:24.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.911+0000 7fada2238080 1 -- 172.21.15.55:0/905385474 shutdown_connections 2024-04-02T07:34:24.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:24.911+0000 7fada2238080 1 -- 172.21.15.55:0/905385474 wait complete. 2024-04-02T07:34:24.913 INFO:teuthology.orchestra.run.smithi055.stdout:mytag123 2024-04-02T07:34:24.914 INFO:teuthology.orchestra.run:Running command with timeout 120 2024-04-02T07:34:24.914 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.8:0 flush journal 2024-04-02T07:34:25.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.099+0000 7f81ae400640 1 Processor -- start 2024-04-02T07:34:25.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.099+0000 7f81ae400640 1 -- start start 2024-04-02T07:34:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.099+0000 7f81ae400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81a80b3dc0 0x7f81a80ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.099+0000 7f81ae400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f81a80b41a0 0x7f81a8142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.099+0000 7f81ae400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a806ddc0 con 0x7f81a80ade90 2024-04-02T07:34:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.099+0000 7f81ae400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a806c630 con 0x7f81a80b41a0 2024-04-02T07:34:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.099+0000 7f81ae400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a806c8f0 con 0x7f81a80b3dc0 2024-04-02T07:34:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.103+0000 7f81a7e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f81a80b41a0 0x7f81a8142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.103+0000 7f81a7400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81a80b3dc0 0x7f81a80ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.103+0000 7f81a7400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81a80b3dc0 0x7f81a80ca770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:41598/0 (socket says 172.21.15.55:41598) 2024-04-02T07:34:25.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.103+0000 7f81a7e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f81a80b41a0 0x7f81a8142ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:40722/0 (socket says 172.21.15.55:40722) 2024-04-02T07:34:25.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.103+0000 7f81a7400640 1 -- 172.21.15.55:0/2623297050 learned_addr learned my addr 172.21.15.55:0/2623297050 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:25.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.103+0000 7f81a7400640 1 -- 172.21.15.55:0/2623297050 >> v2:172.21.15.106:3300/0 conn(0x7f81a80b41a0 msgr2=0x7f81a8142ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.103+0000 7f81a7400640 1 --2- 172.21.15.55:0/2623297050 >> v2:172.21.15.106:3300/0 conn(0x7f81a80b41a0 0x7f81a8142ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.103+0000 7f81a7400640 1 -- 172.21.15.55:0/2623297050 >> v1:172.21.15.106:6789/0 conn(0x7f81a80ade90 legacy=0x7f81a806d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.103+0000 7f81a6a00640 1 -- 172.21.15.55:0/2623297050 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1267368792 0 0) 0x7f81a806ddc0 con 0x7f81a80ade90 2024-04-02T07:34:25.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.103+0000 7f81a7400640 1 -- 172.21.15.55:0/2623297050 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a806cbd0 con 0x7f81a80b3dc0 2024-04-02T07:34:25.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.103+0000 7f81a7400640 1 --2- 172.21.15.55:0/2623297050 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81a80b3dc0 0x7f81a80ca770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8198009870 tx=0x7f819801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=95db829da54cbf49 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.103+0000 7f81a6a00640 1 -- 172.21.15.55:0/2623297050 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81980ac410 con 0x7f81a80b3dc0 2024-04-02T07:34:25.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f81a6a00640 1 -- 172.21.15.55:0/2623297050 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81980ac570 con 0x7f81a80b3dc0 2024-04-02T07:34:25.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f81a6a00640 1 -- 172.21.15.55:0/2623297050 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81980ac900 con 0x7f81a80b3dc0 2024-04-02T07:34:25.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f81ae400640 1 -- 172.21.15.55:0/2623297050 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81a80b3dc0 msgr2=0x7f81a80ca770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f81ae400640 1 --2- 172.21.15.55:0/2623297050 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81a80b3dc0 0x7f81a80ca770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8198009870 tx=0x7f819801c4a0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f81ae400640 1 -- 172.21.15.55:0/2623297050 shutdown_connections 2024-04-02T07:34:25.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f81ae400640 1 --2- 172.21.15.55:0/2623297050 >> v2:172.21.15.106:3300/0 conn(0x7f81a80b41a0 0x7f81a8142ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f81ae400640 1 --2- 172.21.15.55:0/2623297050 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81a80b3dc0 0x7f81a80ca770 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f81ae400640 1 -- 172.21.15.55:0/2623297050 >> 172.21.15.55:0/2623297050 conn(0x7f81a806a390 msgr2=0x7f81a80b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:25.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f81ae400640 1 -- 172.21.15.55:0/2623297050 shutdown_connections 2024-04-02T07:34:25.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f81ae400640 1 -- 172.21.15.55:0/2623297050 wait complete. 2024-04-02T07:34:25.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f81ae400640 1 Processor -- start 2024-04-02T07:34:25.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f81ae400640 1 -- start start 2024-04-02T07:34:25.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f81ae400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81a80ade90 0x7f81a8159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f81ae400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a80b3dc0 0x7f81a8138ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f81ae400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81a80b41a0 0x7f81a813dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f81ae400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a8157500 con 0x7f81a80b3dc0 2024-04-02T07:34:25.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f81ae400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a815af60 con 0x7f81a80b41a0 2024-04-02T07:34:25.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f81ae400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a815a160 con 0x7f81a80ade90 2024-04-02T07:34:25.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f819fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a80b3dc0 0x7f81a8138ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f819fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a80b3dc0 0x7f81a8138ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49798/0 (socket says 172.21.15.55:49798) 2024-04-02T07:34:25.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f819fe00640 1 -- 172.21.15.55:0/884149570 learned_addr learned my addr 172.21.15.55:0/884149570 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:25.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f81a7400640 1 --2- 172.21.15.55:0/884149570 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81a80ade90 0x7f81a8159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f81a7e00640 1 --2- 172.21.15.55:0/884149570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81a80b41a0 0x7f81a813dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f819fe00640 1 -- 172.21.15.55:0/884149570 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81a80ade90 msgr2=0x7f81a8159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f819fe00640 1 --2- 172.21.15.55:0/884149570 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81a80ade90 0x7f81a8159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f819fe00640 1 -- 172.21.15.55:0/884149570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81a80b41a0 msgr2=0x7f81a813dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.107+0000 7f819fe00640 1 --2- 172.21.15.55:0/884149570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81a80b41a0 0x7f81a813dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.111+0000 7f819fe00640 1 -- 172.21.15.55:0/884149570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81980094d0 con 0x7f81a80b3dc0 2024-04-02T07:34:25.109 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.111+0000 7f819fe00640 1 --2- 172.21.15.55:0/884149570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a80b3dc0 0x7f81a8138ed0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f819000c500 tx=0x7f819000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.111+0000 7f819f400640 1 -- 172.21.15.55:0/884149570 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8190003600 con 0x7f81a80b3dc0 2024-04-02T07:34:25.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.111+0000 7f819f400640 1 -- 172.21.15.55:0/884149570 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8190003760 con 0x7f81a80b3dc0 2024-04-02T07:34:25.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.111+0000 7f81ae400640 1 -- 172.21.15.55:0/884149570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a815a3e0 con 0x7f81a80b3dc0 2024-04-02T07:34:25.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.111+0000 7f819f400640 1 -- 172.21.15.55:0/884149570 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8190003b10 con 0x7f81a80b3dc0 2024-04-02T07:34:25.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.111+0000 7f81ae400640 1 -- 172.21.15.55:0/884149570 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a815a9a0 con 0x7f81a80b3dc0 2024-04-02T07:34:25.110 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.111+0000 7f819f400640 1 -- 172.21.15.55:0/884149570 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8190003c70 con 0x7f81a80b3dc0 2024-04-02T07:34:25.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.111+0000 7f819f400640 1 --2- 172.21.15.55:0/884149570 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8184066690 0x7f8184068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.111 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.111+0000 7f819f400640 1 -- 172.21.15.55:0/884149570 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8190083890 con 0x7f81a80b3dc0 2024-04-02T07:34:25.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81a7400640 1 --2- 172.21.15.55:0/884149570 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8184066690 0x7f8184068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81b177a000 1 Processor -- start 2024-04-02T07:34:25.112 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81b177a000 1 -- start start 2024-04-02T07:34:25.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81a7400640 1 --2- 172.21.15.55:0/884149570 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8184066690 0x7f8184068b50 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f81980ae000 tx=0x7f81980a6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81b177a000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560c31a70 0x555560c31e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81b177a000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555560c32390 0x555560be54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81b177a000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560be5a00 0x555560be5de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81b177a000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555560ab0630 con 0x555560be5a00 2024-04-02T07:34:25.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81b177a000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555560a3dbd0 con 0x555560c31a70 2024-04-02T07:34:25.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81b177a000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x555560a3b1a0 con 0x555560c32390 2024-04-02T07:34:25.113 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81a7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560be5a00 0x555560be5de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81a7e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560be5a00 0x555560be5de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49814/0 (socket says 172.21.15.55:49814) 2024-04-02T07:34:25.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81a7e00640 1 -- 172.21.15.55:0/2246375373 learned_addr learned my addr 172.21.15.55:0/2246375373 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:25.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81a7400640 1 --2- 172.21.15.55:0/2246375373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560c31a70 0x555560c31e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f819fe00640 1 --2- 172.21.15.55:0/2246375373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555560c32390 0x555560be54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81a7e00640 1 -- 172.21.15.55:0/2246375373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555560c32390 msgr2=0x555560be54c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81a7e00640 1 --2- 172.21.15.55:0/2246375373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555560c32390 0x555560be54c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81a7e00640 1 -- 172.21.15.55:0/2246375373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560c31a70 msgr2=0x555560c31e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81a7e00640 1 --2- 172.21.15.55:0/2246375373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560c31a70 0x555560c31e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81a7e00640 1 -- 172.21.15.55:0/2246375373 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555560732e20 con 0x555560be5a00 2024-04-02T07:34:25.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81a7e00640 1 --2- 172.21.15.55:0/2246375373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560be5a00 0x555560be5de0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f81a00074f0 tx=0x7f81a0009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9c8a4c1605276c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f8197e00640 1 -- 172.21.15.55:0/2246375373 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a000e030 con 0x555560be5a00 2024-04-02T07:34:25.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f8197e00640 1 -- 172.21.15.55:0/2246375373 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a0015600 con 0x555560be5a00 2024-04-02T07:34:25.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f8197e00640 1 -- 172.21.15.55:0/2246375373 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a0009ca0 con 0x555560be5a00 2024-04-02T07:34:25.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81b177a000 1 -- 172.21.15.55:0/2246375373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560be5a00 msgr2=0x555560be5de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81b177a000 1 --2- 172.21.15.55:0/2246375373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560be5a00 0x555560be5de0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f81a00074f0 tx=0x7f81a0009750 comp rx=0 tx=0).stop 2024-04-02T07:34:25.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81b177a000 1 -- 172.21.15.55:0/2246375373 shutdown_connections 2024-04-02T07:34:25.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81b177a000 1 --2- 172.21.15.55:0/2246375373 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560be5a00 0x555560be5de0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81b177a000 1 --2- 172.21.15.55:0/2246375373 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555560c32390 0x555560be54c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81b177a000 1 --2- 172.21.15.55:0/2246375373 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560c31a70 0x555560c31e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81b177a000 1 -- 172.21.15.55:0/2246375373 >> 172.21.15.55:0/2246375373 conn(0x5555609e6160 msgr2=0x555560c14820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:25.116 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81b177a000 1 -- 172.21.15.55:0/2246375373 shutdown_connections 2024-04-02T07:34:25.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81b177a000 1 -- 172.21.15.55:0/2246375373 wait complete. 2024-04-02T07:34:25.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81b177a000 1 -- start start 2024-04-02T07:34:25.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.115+0000 7f81b177a000 1 Processor -- start 2024-04-02T07:34:25.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81b177a000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555560be5a00 0x555560bedad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81b177a000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 0x555560c15a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81b177a000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560c32390 0x555560c15f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81b177a000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555560a36a90 con 0x555560c31a70 2024-04-02T07:34:25.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81b177a000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555609d5d40 con 0x555560c32390 2024-04-02T07:34:25.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81b177a000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5555609f3f30 con 0x555560be5a00 2024-04-02T07:34:25.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81b177a000 10 client.0 _ll_register_callbacks cb 0x555560a98810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:34:25.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f819fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 0x555560c15a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f819fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 0x555560c15a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49826/0 (socket says 172.21.15.55:49826) 2024-04-02T07:34:25.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f819fe00640 1 -- 172.21.15.55:0/327648275 learned_addr learned my addr 172.21.15.55:0/327648275 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:25.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81a7400640 1 --2- 172.21.15.55:0/327648275 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555560be5a00 0x555560bedad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81a7e00640 1 --2- 172.21.15.55:0/327648275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560c32390 0x555560c15f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f819fe00640 1 -- 172.21.15.55:0/327648275 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555560be5a00 msgr2=0x555560bedad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f819fe00640 1 --2- 172.21.15.55:0/327648275 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555560be5a00 0x555560bedad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f819fe00640 1 -- 172.21.15.55:0/327648275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560c32390 msgr2=0x555560c15f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f819fe00640 1 --2- 172.21.15.55:0/327648275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560c32390 0x555560c15f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f819fe00640 1 -- 172.21.15.55:0/327648275 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a0009e00 con 0x555560c31a70 2024-04-02T07:34:25.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f819fe00640 1 --2- 172.21.15.55:0/327648275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 0x555560c15a50 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f8190054870 tx=0x7f81900548e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=facf1bca7b1a7b70 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f8194c00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:34:25.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f8194c00640 1 -- 172.21.15.55:0/327648275 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8190053fd0 con 0x555560c31a70 2024-04-02T07:34:25.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f8194c00640 1 -- 172.21.15.55:0/327648275 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f819005c840 con 0x555560c31a70 2024-04-02T07:34:25.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81b177a000 1 -- 172.21.15.55:0/327648275 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555560a353e0 con 0x555560c31a70 2024-04-02T07:34:25.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f8194c00640 1 -- 172.21.15.55:0/327648275 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f819005ca00 con 0x555560c31a70 2024-04-02T07:34:25.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81b177a000 10 client.9696 fetch_fsmap learned FSMap version 102 2024-04-02T07:34:25.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81b177a000 1 -- 172.21.15.55:0/327648275 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) v3 -- 0x5555609fbaa0 con 0x555560c31a70 2024-04-02T07:34:25.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f8194c00640 1 -- 172.21.15.55:0/327648275 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8190076020 con 0x555560c31a70 2024-04-02T07:34:25.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f8194c00640 1 -- 172.21.15.55:0/327648275 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 102) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f8190072ae0 con 0x555560c31a70 2024-04-02T07:34:25.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81b177a000 10 client.9696 fetch_fsmap finished waiting for FSMap version 102 2024-04-02T07:34:25.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81b177a000 10 client.9696 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-02T07:34:25.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81b177a000 20 client.9696 populate_metadata read hostname 'smithi055' 2024-04-02T07:34:25.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81b177a000 1 --2- 172.21.15.55:0/327648275 >> [v2:172.21.15.55:6832/154663344,v1:172.21.15.55:6835/154663344] conn(0x555560c38eb0 0x555560c39290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81b177a000 4 client.9696 mds_command: new command op to 9150 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:34:25.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81b177a000 1 -- 172.21.15.55:0/327648275 --> [v2:172.21.15.55:6832/154663344,v1:172.21.15.55:6835/154663344] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555560a06d00 con 0x555560c38eb0 2024-04-02T07:34:25.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81a7400640 1 --2- 172.21.15.55:0/327648275 >> [v2:172.21.15.55:6832/154663344,v1:172.21.15.55:6835/154663344] conn(0x555560c38eb0 0x555560c39290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81a7400640 1 --2- 172.21.15.55:0/327648275 >> [v2:172.21.15.55:6832/154663344,v1:172.21.15.55:6835/154663344] conn(0x555560c38eb0 0x555560c39290 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5433a3f843d6ec4d server_cookie=fc6ac1e318174b51 in_seq=0 out_seq=0 2024-04-02T07:34:25.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f8194c00640 10 client.9696 ms_handle_connect on v2:172.21.15.55:6832/154663344 2024-04-02T07:34:25.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f8194c00640 1 -- 172.21.15.55:0/327648275 <== mds.0 v2:172.21.15.55:6832/154663344 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x555560a06d00 con 0x555560c38eb0 2024-04-02T07:34:25.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f8194c00640 10 client.9696 handle_command_reply: tid=0 2024-04-02T07:34:25.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.119+0000 7f81b177a000 1 client.9696 shutdown 2024-04-02T07:34:25.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.123+0000 7f81b177a000 1 -- 172.21.15.55:0/327648275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 msgr2=0x555560c15a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.123+0000 7f81b177a000 1 --2- 172.21.15.55:0/327648275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 0x555560c15a50 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f8190054870 tx=0x7f81900548e0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.123+0000 7f81b177a000 1 -- 172.21.15.55:0/327648275 shutdown_connections 2024-04-02T07:34:25.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.123+0000 7f81b177a000 1 --2- 172.21.15.55:0/327648275 >> [v2:172.21.15.55:6832/154663344,v1:172.21.15.55:6835/154663344] conn(0x555560c38eb0 0x555560c39290 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.123+0000 7f81b177a000 1 --2- 172.21.15.55:0/327648275 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560c32390 0x555560c15f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.123+0000 7f81b177a000 1 --2- 172.21.15.55:0/327648275 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 0x555560c15a50 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.123+0000 7f81b177a000 1 --2- 172.21.15.55:0/327648275 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555560be5a00 0x555560bedad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.123+0000 7f8194c00640 0 client.9696 ms_handle_reset on v2:172.21.15.55:6832/154663344 2024-04-02T07:34:25.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.123+0000 7f81b177a000 1 -- 172.21.15.55:0/327648275 >> 172.21.15.55:0/327648275 conn(0x5555609e6160 msgr2=0x555560be4bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:25.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.123+0000 7f81b177a000 1 -- 172.21.15.55:0/327648275 shutdown_connections 2024-04-02T07:34:25.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.123+0000 7f81b177a000 1 -- 172.21.15.55:0/327648275 wait complete. 2024-04-02T07:34:25.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.123+0000 7f81b177a000 20 client.9696 trim_cache size 0 max 16384 2024-04-02T07:34:25.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f81b177a000 1 Processor -- start 2024-04-02T07:34:25.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f81b177a000 1 -- start start 2024-04-02T07:34:25.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f81b177a000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560be5a00 0x555560becfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f81b177a000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 0x555560be4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f81b177a000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555560c32390 0x555560be5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f81b177a000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555606f3aa0 con 0x555560c31a70 2024-04-02T07:34:25.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f81b177a000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555560a33e90 con 0x555560be5a00 2024-04-02T07:34:25.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f81b177a000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x555560bedb20 con 0x555560c32390 2024-04-02T07:34:25.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f819fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 0x555560be4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f819fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 0x555560be4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49834/0 (socket says 172.21.15.55:49834) 2024-04-02T07:34:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f819fe00640 1 -- 172.21.15.55:0/3382614599 learned_addr learned my addr 172.21.15.55:0/3382614599 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f81a7e00640 1 --2- 172.21.15.55:0/3382614599 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555560c32390 0x555560be5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f81a7400640 1 --2- 172.21.15.55:0/3382614599 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560be5a00 0x555560becfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f819fe00640 1 -- 172.21.15.55:0/3382614599 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555560c32390 msgr2=0x555560be5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f819fe00640 1 --2- 172.21.15.55:0/3382614599 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555560c32390 0x555560be5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f819fe00640 1 -- 172.21.15.55:0/3382614599 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560be5a00 msgr2=0x555560becfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f819fe00640 1 --2- 172.21.15.55:0/3382614599 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560be5a00 0x555560becfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f819fe00640 1 -- 172.21.15.55:0/3382614599 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555609e1df0 con 0x555560c31a70 2024-04-02T07:34:25.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f819fe00640 1 --2- 172.21.15.55:0/3382614599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 0x555560be4c30 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f8190050ce0 tx=0x7f8190057000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4796fab8f485a7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f819cc00640 1 -- 172.21.15.55:0/3382614599 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819000e040 con 0x555560c31a70 2024-04-02T07:34:25.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f819cc00640 1 -- 172.21.15.55:0/3382614599 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8190076070 con 0x555560c31a70 2024-04-02T07:34:25.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.135+0000 7f819cc00640 1 -- 172.21.15.55:0/3382614599 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819005ca40 con 0x555560c31a70 2024-04-02T07:34:25.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 1 -- 172.21.15.55:0/3382614599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 msgr2=0x555560be4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 1 --2- 172.21.15.55:0/3382614599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 0x555560be4c30 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f8190050ce0 tx=0x7f8190057000 comp rx=0 tx=0).stop 2024-04-02T07:34:25.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 1 -- 172.21.15.55:0/3382614599 shutdown_connections 2024-04-02T07:34:25.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 1 --2- 172.21.15.55:0/3382614599 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555560c32390 0x555560be5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 1 --2- 172.21.15.55:0/3382614599 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 0x555560be4c30 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 1 --2- 172.21.15.55:0/3382614599 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560be5a00 0x555560becfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 1 -- 172.21.15.55:0/3382614599 >> 172.21.15.55:0/3382614599 conn(0x5555609e6160 msgr2=0x555560bec260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:25.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 1 -- 172.21.15.55:0/3382614599 shutdown_connections 2024-04-02T07:34:25.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 1 -- 172.21.15.55:0/3382614599 wait complete. 2024-04-02T07:34:25.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 1 -- start start 2024-04-02T07:34:25.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 1 Processor -- start 2024-04-02T07:34:25.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560be5a00 0x555560c77aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 0x555560be8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555560c32390 0x555560be8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x555560a8e920 con 0x555560c31a70 2024-04-02T07:34:25.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x555560a395f0 con 0x555560be5a00 2024-04-02T07:34:25.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x555560a32280 con 0x555560c32390 2024-04-02T07:34:25.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 10 client.0 _ll_register_callbacks cb 0x7f81a0009bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:34:25.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f819fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 0x555560be8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81a7400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560be5a00 0x555560c77aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f819fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 0x555560be8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49846/0 (socket says 172.21.15.55:49846) 2024-04-02T07:34:25.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f819fe00640 1 -- 172.21.15.55:0/1823928658 learned_addr learned my addr 172.21.15.55:0/1823928658 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:25.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81a7e00640 1 --2- 172.21.15.55:0/1823928658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555560c32390 0x555560be8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f819fe00640 1 -- 172.21.15.55:0/1823928658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555560c32390 msgr2=0x555560be8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f819fe00640 1 --2- 172.21.15.55:0/1823928658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555560c32390 0x555560be8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f819fe00640 1 -- 172.21.15.55:0/1823928658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560be5a00 msgr2=0x555560c77aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f819fe00640 1 --2- 172.21.15.55:0/1823928658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560be5a00 0x555560c77aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f819fe00640 1 -- 172.21.15.55:0/1823928658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5555609fbaa0 con 0x555560c31a70 2024-04-02T07:34:25.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81a7400640 1 --2- 172.21.15.55:0/1823928658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560be5a00 0x555560c77aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:34:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f819fe00640 1 --2- 172.21.15.55:0/1823928658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 0x555560be8550 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f8190007fd0 tx=0x7f8190081bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c0d441665ad906e server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f8194c00640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:34:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f8194c00640 1 -- 172.21.15.55:0/1823928658 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819000e040 con 0x555560c31a70 2024-04-02T07:34:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f8194c00640 1 -- 172.21.15.55:0/1823928658 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f8190077080 con 0x555560c31a70 2024-04-02T07:34:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 1 -- 172.21.15.55:0/1823928658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5555609f3970 con 0x555560c31a70 2024-04-02T07:34:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f8194c00640 1 -- 172.21.15.55:0/1823928658 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8190054240 con 0x555560c31a70 2024-04-02T07:34:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 10 client.9702 fetch_fsmap learned FSMap version 102 2024-04-02T07:34:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.139+0000 7f81b177a000 1 -- 172.21.15.55:0/1823928658 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=2+}) v3 -- 0x5555609d5960 con 0x555560c31a70 2024-04-02T07:34:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.143+0000 7f8194c00640 1 -- 172.21.15.55:0/1823928658 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5555609f3970 con 0x555560c31a70 2024-04-02T07:34:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.143+0000 7f8194c00640 1 -- 172.21.15.55:0/1823928658 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 102) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f81900502f0 con 0x555560c31a70 2024-04-02T07:34:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.143+0000 7f81b177a000 10 client.9702 fetch_fsmap finished waiting for FSMap version 102 2024-04-02T07:34:25.143 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.143+0000 7f81b177a000 10 client.9702 resolve_mds: resolved 8:0 to role '8:0' aka daemon mds.a 2024-04-02T07:34:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.143+0000 7f81b177a000 20 client.9702 populate_metadata read hostname 'smithi055' 2024-04-02T07:34:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.143+0000 7f81b177a000 1 --2- 172.21.15.55:0/1823928658 >> [v2:172.21.15.55:6832/154663344,v1:172.21.15.55:6835/154663344] conn(0x555560be8fd0 0x555560be93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.143+0000 7f81b177a000 4 client.9702 mds_command: new command op to 9150 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-04-02T07:34:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.143+0000 7f81b177a000 1 -- 172.21.15.55:0/1823928658 --> [v2:172.21.15.55:6832/154663344,v1:172.21.15.55:6835/154663344] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555560a65a20 con 0x555560be8fd0 2024-04-02T07:34:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.143+0000 7f81a7400640 1 --2- 172.21.15.55:0/1823928658 >> [v2:172.21.15.55:6832/154663344,v1:172.21.15.55:6835/154663344] conn(0x555560be8fd0 0x555560be93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.143+0000 7f81a7400640 1 --2- 172.21.15.55:0/1823928658 >> [v2:172.21.15.55:6832/154663344,v1:172.21.15.55:6835/154663344] conn(0x555560be8fd0 0x555560be93e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d257babd31ee19e1 server_cookie=ad1031684ff9806b in_seq=0 out_seq=0 2024-04-02T07:34:25.144 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.143+0000 7f8194c00640 10 client.9702 ms_handle_connect on v2:172.21.15.55:6832/154663344 2024-04-02T07:34:25.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.159+0000 7f8194c00640 1 -- 172.21.15.55:0/1823928658 <== mds.0 v2:172.21.15.55:6832/154663344 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555560a65a20 con 0x555560be8fd0 2024-04-02T07:34:25.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.159+0000 7f8194c00640 10 client.9702 handle_command_reply: tid=0 2024-04-02T07:34:25.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.159+0000 7f81b177a000 1 client.9702 shutdown 2024-04-02T07:34:25.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.159+0000 7f81b177a000 1 -- 172.21.15.55:0/1823928658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 msgr2=0x555560be8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.159+0000 7f81b177a000 1 --2- 172.21.15.55:0/1823928658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 0x555560be8550 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f8190007fd0 tx=0x7f8190081bf0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.160 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.159+0000 7f81b177a000 1 -- 172.21.15.55:0/1823928658 shutdown_connections 2024-04-02T07:34:25.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.159+0000 7f81b177a000 1 --2- 172.21.15.55:0/1823928658 >> [v2:172.21.15.55:6832/154663344,v1:172.21.15.55:6835/154663344] conn(0x555560be8fd0 0x555560be93e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.159+0000 7f81b177a000 1 --2- 172.21.15.55:0/1823928658 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x555560c32390 0x555560be8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.159+0000 7f81b177a000 1 --2- 172.21.15.55:0/1823928658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x555560c31a70 0x555560be8550 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.159+0000 7f8194c00640 0 client.9702 ms_handle_reset on v2:172.21.15.55:6832/154663344 2024-04-02T07:34:25.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.159+0000 7f81b177a000 1 --2- 172.21.15.55:0/1823928658 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x555560be5a00 0x555560c77aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.159+0000 7f81b177a000 1 -- 172.21.15.55:0/1823928658 >> 172.21.15.55:0/1823928658 conn(0x5555609e6160 msgr2=0x555560bec960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:25.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.163+0000 7f81b177a000 1 -- 172.21.15.55:0/1823928658 shutdown_connections 2024-04-02T07:34:25.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.163+0000 7f81b177a000 1 -- 172.21.15.55:0/1823928658 wait complete. 2024-04-02T07:34:25.161 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.163+0000 7f81b177a000 20 client.9702 trim_cache size 0 max 16384 2024-04-02T07:34:25.161 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:34:25.162 INFO:teuthology.orchestra.run.smithi055.stdout: "message": "", 2024-04-02T07:34:25.162 INFO:teuthology.orchestra.run.smithi055.stdout: "return_code": 0 2024-04-02T07:34:25.162 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:34:25.162 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.163+0000 7f81ae400640 1 -- 172.21.15.55:0/884149570 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8184066690 msgr2=0x7f8184068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.163+0000 7f81ae400640 1 --2- 172.21.15.55:0/884149570 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8184066690 0x7f8184068b50 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f81980ae000 tx=0x7f81980a6040 comp rx=0 tx=0).stop 2024-04-02T07:34:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.163+0000 7f81ae400640 1 -- 172.21.15.55:0/884149570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a80b3dc0 msgr2=0x7f81a8138ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.163+0000 7f81ae400640 1 --2- 172.21.15.55:0/884149570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a80b3dc0 0x7f81a8138ed0 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f819000c500 tx=0x7f819000c9c0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.163+0000 7f81ae400640 1 -- 172.21.15.55:0/884149570 shutdown_connections 2024-04-02T07:34:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.163+0000 7f81ae400640 1 --2- 172.21.15.55:0/884149570 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8184066690 0x7f8184068b50 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.163+0000 7f81ae400640 1 --2- 172.21.15.55:0/884149570 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f81a80b41a0 0x7f81a813dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.163+0000 7f81ae400640 1 --2- 172.21.15.55:0/884149570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81a80b3dc0 0x7f81a8138ed0 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.163+0000 7f81ae400640 1 --2- 172.21.15.55:0/884149570 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f81a80ade90 0x7f81a8159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.163+0000 7f81ae400640 1 -- 172.21.15.55:0/884149570 >> 172.21.15.55:0/884149570 conn(0x7f81a806a390 msgr2=0x7f81a81556b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.163+0000 7f81ae400640 1 -- 172.21.15.55:0/884149570 shutdown_connections 2024-04-02T07:34:25.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.163+0000 7f81ae400640 1 -- 172.21.15.55:0/884149570 wait complete. 2024-04-02T07:34:25.180 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-02T07:34:25.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.323+0000 7f59f4000640 1 Processor -- start 2024-04-02T07:34:25.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.323+0000 7f59f4000640 1 -- start start 2024-04-02T07:34:25.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.323+0000 7f59f4000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f59ec15fff0 0x7f59ec0b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.323+0000 7f59f4000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59ec0aebd0 0x7f59ec06f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.323+0000 7f59f4000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59ec0aea20 con 0x7f59ec06f970 2024-04-02T07:34:25.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.323+0000 7f59f4000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59ec1603d0 con 0x7f59ec15fff0 2024-04-02T07:34:25.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.323+0000 7f59f4000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec06ecc0 con 0x7f59ec0aebd0 2024-04-02T07:34:25.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.323+0000 7f59f2000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f59ec06f970 0x7f59ec069d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:48126/0 (socket says 172.21.15.55:48126) 2024-04-02T07:34:25.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.327+0000 7f59f2000640 1 -- 172.21.15.55:0/994943745 learned_addr learned my addr 172.21.15.55:0/994943745 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:25.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.327+0000 7f59f0c00640 1 --2- 172.21.15.55:0/994943745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59ec0aebd0 0x7f59ec06f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.327+0000 7f59f1600640 1 --2- 172.21.15.55:0/994943745 >> v2:172.21.15.106:3300/0 conn(0x7f59ec15fff0 0x7f59ec0b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.327+0000 7f59ebe00640 1 -- 172.21.15.55:0/994943745 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220328631 0 0) 0x7f59ec0aea20 con 0x7f59ec06f970 2024-04-02T07:34:25.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.327+0000 7f59ebe00640 1 -- 172.21.15.55:0/994943745 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f59d4003530 con 0x7f59ec06f970 2024-04-02T07:34:25.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.327+0000 7f59f0c00640 1 -- 172.21.15.55:0/994943745 >> v2:172.21.15.106:3300/0 conn(0x7f59ec15fff0 msgr2=0x7f59ec0b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.327+0000 7f59f0c00640 1 --2- 172.21.15.55:0/994943745 >> v2:172.21.15.106:3300/0 conn(0x7f59ec15fff0 0x7f59ec0b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.327+0000 7f59f0c00640 1 -- 172.21.15.55:0/994943745 >> v1:172.21.15.55:6789/0 conn(0x7f59ec06f970 legacy=0x7f59ec069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.327+0000 7f59f0c00640 1 -- 172.21.15.55:0/994943745 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59ec0b3c00 con 0x7f59ec0aebd0 2024-04-02T07:34:25.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.327+0000 7f59f1600640 1 --2- 172.21.15.55:0/994943745 >> v2:172.21.15.106:3300/0 conn(0x7f59ec15fff0 0x7f59ec0b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:34:25.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.327+0000 7f59f0c00640 1 --2- 172.21.15.55:0/994943745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59ec0aebd0 0x7f59ec06f430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f59d80097c0 tx=0x7f59d801c380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee31e2736150565a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59ebe00640 1 -- 172.21.15.55:0/994943745 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d80ab600 con 0x7f59ec0aebd0 2024-04-02T07:34:25.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59ebe00640 1 -- 172.21.15.55:0/994943745 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59d80a7050 con 0x7f59ec0aebd0 2024-04-02T07:34:25.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59ebe00640 1 -- 172.21.15.55:0/994943745 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59d80ab980 con 0x7f59ec0aebd0 2024-04-02T07:34:25.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f4000640 1 -- 172.21.15.55:0/994943745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59ec0aebd0 msgr2=0x7f59ec06f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f4000640 1 --2- 172.21.15.55:0/994943745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59ec0aebd0 0x7f59ec06f430 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f59d80097c0 tx=0x7f59d801c380 comp rx=0 tx=0).stop 2024-04-02T07:34:25.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f4000640 1 -- 172.21.15.55:0/994943745 shutdown_connections 2024-04-02T07:34:25.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f4000640 1 --2- 172.21.15.55:0/994943745 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59ec0aebd0 0x7f59ec06f430 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f4000640 1 --2- 172.21.15.55:0/994943745 >> v2:172.21.15.106:3300/0 conn(0x7f59ec15fff0 0x7f59ec0b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f4000640 1 -- 172.21.15.55:0/994943745 >> 172.21.15.55:0/994943745 conn(0x7f59ec0b1420 msgr2=0x7f59ec0b1830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:25.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f4000640 1 -- 172.21.15.55:0/994943745 shutdown_connections 2024-04-02T07:34:25.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f4000640 1 -- 172.21.15.55:0/994943745 wait complete. 2024-04-02T07:34:25.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f4000640 1 Processor -- start 2024-04-02T07:34:25.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f4000640 1 -- start start 2024-04-02T07:34:25.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f4000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59ec0aebd0 0x7f59ec0c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f4000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59ec15fff0 0x7f59ec0cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f4000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59ec156af0 0x7f59ec14e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f4000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0ca0a0 con 0x7f59ec0aebd0 2024-04-02T07:34:25.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f4000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0cb8c0 con 0x7f59ec156af0 2024-04-02T07:34:25.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f4000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59ec0c9dc0 con 0x7f59ec15fff0 2024-04-02T07:34:25.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f1600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59ec0aebd0 0x7f59ec0c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f1600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59ec0aebd0 0x7f59ec0c9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49858/0 (socket says 172.21.15.55:49858) 2024-04-02T07:34:25.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f1600640 1 -- 172.21.15.55:0/539131490 learned_addr learned my addr 172.21.15.55:0/539131490 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:25.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f0c00640 1 --2- 172.21.15.55:0/539131490 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59ec15fff0 0x7f59ec0cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f2000640 1 --2- 172.21.15.55:0/539131490 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59ec156af0 0x7f59ec14e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f1600640 1 -- 172.21.15.55:0/539131490 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59ec15fff0 msgr2=0x7f59ec0cfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f1600640 1 --2- 172.21.15.55:0/539131490 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59ec15fff0 0x7f59ec0cfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f1600640 1 -- 172.21.15.55:0/539131490 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59ec156af0 msgr2=0x7f59ec14e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f1600640 1 --2- 172.21.15.55:0/539131490 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59ec156af0 0x7f59ec14e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.331+0000 7f59f1600640 1 -- 172.21.15.55:0/539131490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e0009420 con 0x7f59ec0aebd0 2024-04-02T07:34:25.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.335+0000 7f59f0c00640 1 --2- 172.21.15.55:0/539131490 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59ec15fff0 0x7f59ec0cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:25.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.335+0000 7f59f1600640 1 --2- 172.21.15.55:0/539131490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59ec0aebd0 0x7f59ec0c9750 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f59e000e980 tx=0x7f59e000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.335+0000 7f59e9600640 1 -- 172.21.15.55:0/539131490 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e000ca00 con 0x7f59ec0aebd0 2024-04-02T07:34:25.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.335+0000 7f59e9600640 1 -- 172.21.15.55:0/539131490 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e000cb60 con 0x7f59ec0aebd0 2024-04-02T07:34:25.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.335+0000 7f59f4000640 1 -- 172.21.15.55:0/539131490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59d8009420 con 0x7f59ec0aebd0 2024-04-02T07:34:25.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.335+0000 7f59e9600640 1 -- 172.21.15.55:0/539131490 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0013470 con 0x7f59ec0aebd0 2024-04-02T07:34:25.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.335+0000 7f59f4000640 1 -- 172.21.15.55:0/539131490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59ec14de60 con 0x7f59ec0aebd0 2024-04-02T07:34:25.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.335+0000 7f59f4000640 1 -- 172.21.15.55:0/539131490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59ec14d9e0 con 0x7f59ec0aebd0 2024-04-02T07:34:25.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.335+0000 7f59e9600640 1 -- 172.21.15.55:0/539131490 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f59e00135d0 con 0x7f59ec0aebd0 2024-04-02T07:34:25.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.335+0000 7f59e9600640 1 --2- 172.21.15.55:0/539131490 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f59cc066690 0x7f59cc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.335+0000 7f59e9600640 1 -- 172.21.15.55:0/539131490 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f59e0084500 con 0x7f59ec0aebd0 2024-04-02T07:34:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.339+0000 7f59f0c00640 1 --2- 172.21.15.55:0/539131490 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f59cc066690 0x7f59cc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.339+0000 7f59f0c00640 1 --2- 172.21.15.55:0/539131490 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f59cc066690 0x7f59cc068b50 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f59d80ad000 tx=0x7f59d8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.339+0000 7f59e9600640 1 -- 172.21.15.55:0/539131490 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f59ec14d9e0 con 0x7f59ec0aebd0 2024-04-02T07:34:25.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.535+0000 7f59f4000640 1 -- 172.21.15.55:0/539131490 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f59ec14d9e0 con 0x7f59ec0aebd0 2024-04-02T07:34:25.535 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-02T07:34:25.535+0000 7f8f18800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-02T07:34:25.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.555+0000 7f59e9600640 1 -- 172.21.15.55:0/539131490 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v103) v1 ==== 161+0+0 (secure 0 0 0) 0x7f59ec14d9e0 con 0x7f59ec0aebd0 2024-04-02T07:34:25.553 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-02T07:34:25.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.555+0000 7f59f4000640 1 -- 172.21.15.55:0/539131490 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f59cc066690 msgr2=0x7f59cc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.555+0000 7f59f4000640 1 --2- 172.21.15.55:0/539131490 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f59cc066690 0x7f59cc068b50 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f59d80ad000 tx=0x7f59d8008040 comp rx=0 tx=0).stop 2024-04-02T07:34:25.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.555+0000 7f59f4000640 1 -- 172.21.15.55:0/539131490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59ec0aebd0 msgr2=0x7f59ec0c9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.555+0000 7f59f4000640 1 --2- 172.21.15.55:0/539131490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59ec0aebd0 0x7f59ec0c9750 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f59e000e980 tx=0x7f59e000ee40 comp rx=0 tx=0).stop 2024-04-02T07:34:25.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.555+0000 7f59f4000640 1 -- 172.21.15.55:0/539131490 shutdown_connections 2024-04-02T07:34:25.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.555+0000 7f59f4000640 1 --2- 172.21.15.55:0/539131490 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f59cc066690 0x7f59cc068b50 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.555+0000 7f59f4000640 1 --2- 172.21.15.55:0/539131490 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f59ec156af0 0x7f59ec14e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.555+0000 7f59f4000640 1 --2- 172.21.15.55:0/539131490 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f59ec15fff0 0x7f59ec0cfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.555+0000 7f59f4000640 1 --2- 172.21.15.55:0/539131490 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f59ec0aebd0 0x7f59ec0c9750 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.555+0000 7f59f4000640 1 -- 172.21.15.55:0/539131490 >> 172.21.15.55:0/539131490 conn(0x7f59ec0b1420 msgr2=0x7f59ec156110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:25.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.555+0000 7f59f4000640 1 -- 172.21.15.55:0/539131490 shutdown_connections 2024-04-02T07:34:25.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.555+0000 7f59f4000640 1 -- 172.21.15.55:0/539131490 wait complete. 2024-04-02T07:34:25.566 INFO:tasks.ceph.mds.a.smithi055.stderr: -2347> 2024-04-02T07:34:09.359+0000 7fd8ce600640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:34:25.581 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-journal-tool --debug-mds=20 --debug-ms=1 --debug-objecter=1 --rank cephfs:0 journal reset --force 2024-04-02T07:34:25.616 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-02T07:34:25.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cce18400 1 -- start start 2024-04-02T07:34:25.628 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cce18400 1 Processor -- start 2024-04-02T07:34:25.630 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cce18400 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071c8a5800 0x56071c930580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cce18400 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071c8a5400 0x56071c930b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cce18400 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071c8a5000 0x56071c931080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cce18400 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56071c972a00 con 0x56071c8a5800 2024-04-02T07:34:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cce18400 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56071c972780 con 0x56071c8a5000 2024-04-02T07:34:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cce18400 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x56071c972640 con 0x56071c8a5400 2024-04-02T07:34:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cae00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071c8a5800 0x56071c930580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cae00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071c8a5800 0x56071c930580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33784/0 (socket says 172.21.15.55:33784) 2024-04-02T07:34:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cae00640 1 -- 172.21.15.55:0/3226048394 learned_addr learned my addr 172.21.15.55:0/3226048394 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cb800640 1 --2- 172.21.15.55:0/3226048394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071c8a5000 0x56071c931080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1ca400640 1 --2- 172.21.15.55:0/3226048394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071c8a5400 0x56071c930b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cae00640 1 -- 172.21.15.55:0/3226048394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071c8a5400 msgr2=0x56071c930b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cae00640 1 --2- 172.21.15.55:0/3226048394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071c8a5400 0x56071c930b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cae00640 1 -- 172.21.15.55:0/3226048394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071c8a5000 msgr2=0x56071c931080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cae00640 1 --2- 172.21.15.55:0/3226048394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071c8a5000 0x56071c931080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cae00640 1 -- 172.21.15.55:0/3226048394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56071c8da9c0 con 0x56071c8a5800 2024-04-02T07:34:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1ca400640 1 --2- 172.21.15.55:0/3226048394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071c8a5400 0x56071c930b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cae00640 1 --2- 172.21.15.55:0/3226048394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071c8a5800 0x56071c930580 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x56071d70acc0 tx=0x56071d672d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b57cf67d699d2a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1c7c00640 1 -- 172.21.15.55:0/3226048394 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56071c8f9600 con 0x56071c8a5800 2024-04-02T07:34:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1c7c00640 1 -- 172.21.15.55:0/3226048394 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56071c902180 con 0x56071c8a5800 2024-04-02T07:34:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1c7c00640 1 -- 172.21.15.55:0/3226048394 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56071c8f91e0 con 0x56071c8a5800 2024-04-02T07:34:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cce18400 1 -- 172.21.15.55:0/3226048394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56071c8dab60 con 0x56071c8a5800 2024-04-02T07:34:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cce18400 1 -- 172.21.15.55:0/3226048394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x56071c8da340 con 0x56071c8a5800 2024-04-02T07:34:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cce18400 4 waiting for MDS map... 2024-04-02T07:34:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1c7c00640 1 -- 172.21.15.55:0/3226048394 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x56071c8e4c40 con 0x56071c8a5800 2024-04-02T07:34:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1c7c00640 1 -- 172.21.15.55:0/3226048394 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 103) v1 ==== 2573+0+0 (secure 0 0 0) 0x56071c8f2f00 con 0x56071c8a5800 2024-04-02T07:34:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cce18400 4 Got MDS map 103 2024-04-02T07:34:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cce18400 10 main: JournalTool::main 2024-04-02T07:34:25.632 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cce18400 4 main: JournalTool: connecting to RADOS... 2024-04-02T07:34:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cce18400 1 Processor -- start 2024-04-02T07:34:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.631+0000 7ff1cce18400 1 -- start start 2024-04-02T07:34:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071d7cac00 0x56071c931600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071d7cb000 0x56071c931b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071d7cb400 0x56071c932100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56071c8ebe00 con 0x56071d7cac00 2024-04-02T07:34:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56071c972780 con 0x56071d7cb400 2024-04-02T07:34:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x56071c972500 con 0x56071d7cb000 2024-04-02T07:34:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cb800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071d7cac00 0x56071c931600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cb800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071d7cac00 0x56071c931600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33790/0 (socket says 172.21.15.55:33790) 2024-04-02T07:34:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cb800640 1 -- 172.21.15.55:0/258335669 learned_addr learned my addr 172.21.15.55:0/258335669 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cae00640 1 --2- 172.21.15.55:0/258335669 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071d7cb000 0x56071c931b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1ca400640 1 --2- 172.21.15.55:0/258335669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071d7cb400 0x56071c932100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cb800640 1 -- 172.21.15.55:0/258335669 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071d7cb000 msgr2=0x56071c931b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cb800640 1 --2- 172.21.15.55:0/258335669 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071d7cb000 0x56071c931b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cb800640 1 -- 172.21.15.55:0/258335669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071d7cb400 msgr2=0x56071c932100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cb800640 1 --2- 172.21.15.55:0/258335669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071d7cb400 0x56071c932100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cb800640 1 -- 172.21.15.55:0/258335669 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56071c8da000 con 0x56071d7cac00 2024-04-02T07:34:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1ca400640 1 --2- 172.21.15.55:0/258335669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071d7cb400 0x56071c932100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cb800640 1 --2- 172.21.15.55:0/258335669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071d7cac00 0x56071c931600 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x56071d82e030 tx=0x56071c97f2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40cf87faeecdfd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1c5400640 1 -- 172.21.15.55:0/258335669 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56071c8f9080 con 0x56071d7cac00 2024-04-02T07:34:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1c5400640 1 -- 172.21.15.55:0/258335669 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56071c902900 con 0x56071d7cac00 2024-04-02T07:34:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1c5400640 1 -- 172.21.15.55:0/258335669 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56071c8f9600 con 0x56071d7cac00 2024-04-02T07:34:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 -- 172.21.15.55:0/258335669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071d7cac00 msgr2=0x56071c931600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 --2- 172.21.15.55:0/258335669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071d7cac00 0x56071c931600 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x56071d82e030 tx=0x56071c97f2c0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 -- 172.21.15.55:0/258335669 shutdown_connections 2024-04-02T07:34:25.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 --2- 172.21.15.55:0/258335669 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071d7cb400 0x56071c932100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 --2- 172.21.15.55:0/258335669 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071d7cb000 0x56071c931b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 --2- 172.21.15.55:0/258335669 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071d7cac00 0x56071c931600 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 -- 172.21.15.55:0/258335669 >> 172.21.15.55:0/258335669 conn(0x56071c8a4c00 msgr2=0x56071c8d3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:25.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 -- 172.21.15.55:0/258335669 shutdown_connections 2024-04-02T07:34:25.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 -- 172.21.15.55:0/258335669 wait complete. 2024-04-02T07:34:25.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 Processor -- start 2024-04-02T07:34:25.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 -- start start 2024-04-02T07:34:25.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071d7cac00 0x56071c933180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071d7cb000 0x56071c932c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071d7cb400 0x56071c932680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56071c9723c0 con 0x56071d7cb400 2024-04-02T07:34:25.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56071c972280 con 0x56071d7cb000 2024-04-02T07:34:25.639 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cce18400 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x56071c972140 con 0x56071d7cac00 2024-04-02T07:34:25.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1ca400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071d7cb400 0x56071c932680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1ca400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071d7cb400 0x56071c932680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33796/0 (socket says 172.21.15.55:33796) 2024-04-02T07:34:25.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1ca400640 1 -- 172.21.15.55:0/3551098587 learned_addr learned my addr 172.21.15.55:0/3551098587 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:25.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cb800640 1 --2- 172.21.15.55:0/3551098587 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071d7cac00 0x56071c933180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cae00640 1 --2- 172.21.15.55:0/3551098587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071d7cb000 0x56071c932c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1ca400640 1 -- 172.21.15.55:0/3551098587 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071d7cac00 msgr2=0x56071c933180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1ca400640 1 --2- 172.21.15.55:0/3551098587 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071d7cac00 0x56071c933180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1ca400640 1 -- 172.21.15.55:0/3551098587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071d7cb000 msgr2=0x56071c932c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1ca400640 1 --2- 172.21.15.55:0/3551098587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071d7cb000 0x56071c932c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1ca400640 1 -- 172.21.15.55:0/3551098587 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56071c8da1a0 con 0x56071d7cb400 2024-04-02T07:34:25.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.635+0000 7ff1cae00640 1 --2- 172.21.15.55:0/3551098587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071d7cb000 0x56071c932c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:25.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.639+0000 7ff1ca400640 1 --2- 172.21.15.55:0/3551098587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071d7cb400 0x56071c932680 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x56071d82ee40 tx=0x56071d7d4c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.640 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.639+0000 7ff1c3600640 1 -- 172.21.15.55:0/3551098587 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56071c8f9080 con 0x56071d7cb400 2024-04-02T07:34:25.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.639+0000 7ff1c3600640 1 -- 172.21.15.55:0/3551098587 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56071d675680 con 0x56071d7cb400 2024-04-02T07:34:25.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.639+0000 7ff1cce18400 1 -- 172.21.15.55:0/3551098587 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x56071c8da000 con 0x56071d7cb400 2024-04-02T07:34:25.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.639+0000 7ff1c3600640 1 -- 172.21.15.55:0/3551098587 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56071c8f9600 con 0x56071d7cb400 2024-04-02T07:34:25.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.639+0000 7ff1cce18400 1 -- 172.21.15.55:0/3551098587 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56071c8da9c0 con 0x56071d7cb400 2024-04-02T07:34:25.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.639+0000 7ff1cce18400 4 main: JournalTool: resolving pool 16 2024-04-02T07:34:25.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.639+0000 7ff1c3600640 1 -- 172.21.15.55:0/3551098587 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x56071c970840 con 0x56071d7cb400 2024-04-02T07:34:25.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.639+0000 7ff1c3600640 1 --2- 172.21.15.55:0/3551098587 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x56071cb94c00 0x56071c933700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.639+0000 7ff1c3600640 1 -- 172.21.15.55:0/3551098587 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x56071c8e4a80 con 0x56071d7cb400 2024-04-02T07:34:25.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.639+0000 7ff1cce18400 4 main: JournalTool: creating IoCtx.. 2024-04-02T07:34:25.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.639+0000 7ff1cce18400 4 main: Executing for rank 0 2024-04-02T07:34:25.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.639+0000 7ff1cb800640 1 --2- 172.21.15.55:0/3551098587 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x56071cb94c00 0x56071c933700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.639+0000 7ff1cb800640 1 --2- 172.21.15.55:0/3551098587 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x56071cb94c00 0x56071c933700 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x56071d82e030 tx=0x56071d624fc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.639+0000 7ff1cce18400 1 -- start start 2024-04-02T07:34:25.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cce18400 1 Processor -- start 2024-04-02T07:34:25.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cce18400 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071d7cbc00 0x56071c932100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cce18400 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071cb95000 0x56071c931b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cce18400 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071cb95400 0x56071c931600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cce18400 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56071c972140 con 0x56071cb95000 2024-04-02T07:34:25.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cce18400 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56071c972280 con 0x56071cb95400 2024-04-02T07:34:25.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cce18400 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x56071c972500 con 0x56071d7cbc00 2024-04-02T07:34:25.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cae00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071cb95000 0x56071c931b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cb800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071d7cbc00 0x56071c932100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cae00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071cb95000 0x56071c931b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33804/0 (socket says 172.21.15.55:33804) 2024-04-02T07:34:25.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cae00640 1 -- 172.21.15.55:0/1390985702 learned_addr learned my addr 172.21.15.55:0/1390985702 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:25.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1ca400640 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071cb95400 0x56071c931600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cb800640 1 -- 172.21.15.55:0/1390985702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071cb95400 msgr2=0x56071c931600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cb800640 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071cb95400 0x56071c931600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cb800640 1 -- 172.21.15.55:0/1390985702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071cb95000 msgr2=0x56071c931b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cb800640 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071cb95000 0x56071c931b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cb800640 1 -- 172.21.15.55:0/1390985702 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56071cbc96c0 con 0x56071d7cbc00 2024-04-02T07:34:25.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cae00640 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071cb95000 0x56071c931b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:34:25.647 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cb800640 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071d7cbc00 0x56071c932100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x56071d82e360 tx=0x56071c97f020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9489347525832b2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1bfa00640 1 -- 172.21.15.55:0/1390985702 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56071c8f91e0 con 0x56071d7cbc00 2024-04-02T07:34:25.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1bfa00640 1 -- 172.21.15.55:0/1390985702 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56071c902480 con 0x56071d7cbc00 2024-04-02T07:34:25.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1bfa00640 1 -- 172.21.15.55:0/1390985702 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x56071c8f8dc0 con 0x56071d7cbc00 2024-04-02T07:34:25.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cce18400 1 -- 172.21.15.55:0/1390985702 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56071cbc9520 con 0x56071d7cbc00 2024-04-02T07:34:25.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cce18400 1 -- 172.21.15.55:0/1390985702 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({fsmap=0}) v3 -- 0x56071cbc9380 con 0x56071d7cbc00 2024-04-02T07:34:25.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cce18400 4 waiting for MDS map... 2024-04-02T07:34:25.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1bfa00640 1 -- 172.21.15.55:0/1390985702 <== mon.2 v2:172.21.15.106:3301/0 4 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x56071c8e48c0 con 0x56071d7cbc00 2024-04-02T07:34:25.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1bfa00640 1 -- 172.21.15.55:0/1390985702 <== mon.2 v2:172.21.15.106:3301/0 5 ==== fsmap(e 103) v1 ==== 2573+0+0 (secure 0 0 0) 0x56071cce0900 con 0x56071d7cbc00 2024-04-02T07:34:25.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cce18400 4 Got MDS map 103 2024-04-02T07:34:25.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cce18400 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x56071cb95800 0x56071cce8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cce18400 1 -- 172.21.15.55:0/1390985702 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:1 16.f 16:f1f69726:::400.00000000:head [writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56071cb95c00 con 0x56071cb95800 2024-04-02T07:34:25.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cae00640 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x56071cb95800 0x56071cce8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.648 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.643+0000 7ff1cae00640 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x56071cb95800 0x56071cce8000 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=c6d40130f5e7c79a server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.647+0000 7ff1cae00640 1 -- 172.21.15.55:0/1390985702 <== osd.0 v2:172.21.15.55:6800/27392 1 ==== osd_op_reply(1 400.00000000 [writefull 0~22] v120'2 uv2 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x56071d65ab40 con 0x56071cb95800 2024-04-02T07:34:25.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.647+0000 7ff1cce18400 1 -- 172.21.15.55:0/1390985702 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:2 16.14 16:292cf221:::200.00000000:head [writefull 0~90 in=90b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56071ccdd400 con 0x56071cb95800 2024-04-02T07:34:25.649 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.647+0000 7ff1cae00640 1 -- 172.21.15.55:0/1390985702 <== osd.0 v2:172.21.15.55:6800/27392 2 ==== osd_op_reply(2 200.00000000 [writefull 0~90] v120'41 uv41 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x56071d65ab40 con 0x56071cb95800 2024-04-02T07:34:25.649 INFO:teuthology.orchestra.run.smithi055.stdout:writing EResetJournal entry 2024-04-02T07:34:25.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.647+0000 7ff1cce18400 1 -- 172.21.15.55:0/1390985702 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:3 16.14 16:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56071ccdd800 con 0x56071cb95800 2024-04-02T07:34:25.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.647+0000 7ff1cce18400 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x56071ccddc00 0x56071cce8580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.651 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.647+0000 7ff1cce18400 1 -- 172.21.15.55:0/1390985702 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:4 16.1b 16:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56071ccf4000 con 0x56071ccddc00 2024-04-02T07:34:25.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.647+0000 7ff1cce18400 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x56071ccf4400 0x56071cce8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.647+0000 7ff1cce18400 1 -- 172.21.15.55:0/1390985702 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:5 16.b 16:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56071ccf4800 con 0x56071ccf4400 2024-04-02T07:34:25.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.647+0000 7ff1cce18400 1 -- 172.21.15.55:0/1390985702 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:6 16.1f 16:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56071ccf4c00 con 0x56071ccddc00 2024-04-02T07:34:25.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.647+0000 7ff1cce18400 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x56071ccf5000 0x56071cce9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.647+0000 7ff1cce18400 1 -- 172.21.15.55:0/1390985702 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:7 16.1a 16:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56071ccf5400 con 0x56071ccf5000 2024-04-02T07:34:25.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.647+0000 7ff1cce18400 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x56071ccf5800 0x56071cce9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.647+0000 7ff1cce18400 1 -- 172.21.15.55:0/1390985702 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:8 16.1e 16:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56071ccf5c00 con 0x56071ccf5800 2024-04-02T07:34:25.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.647+0000 7ff1cb800640 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x56071ccf4400 0x56071cce8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.647+0000 7ff1cae00640 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x56071ccf5000 0x56071cce9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.647+0000 7ff1ca400640 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x56071ccddc00 0x56071cce8580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.647+0000 7ff1ca400640 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x56071ccf5800 0x56071cce9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.651+0000 7ff1cb800640 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x56071ccf4400 0x56071cce8b00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=99225c88d98681 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.651+0000 7ff1cae00640 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x56071ccf5000 0x56071cce9080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=ee5b9f3fc8fd8f22 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.652 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.651+0000 7ff1ca400640 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x56071ccddc00 0x56071cce8580 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=482951020068ce7 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.651+0000 7ff1ca400640 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x56071ccf5800 0x56071cce9600 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=f6e1d854ef02a92 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.651+0000 7ff1cae00640 1 -- 172.21.15.55:0/1390985702 <== osd.0 v2:172.21.15.55:6800/27392 3 ==== osd_op_reply(3 200.00000001 [delete] v120'42 uv42 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x56071d65ab40 con 0x56071cb95800 2024-04-02T07:34:25.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.651+0000 7ff1cae00640 1 -- 172.21.15.55:0/1390985702 <== osd.3 v2:172.21.15.55:6824/27393 1 ==== osd_op_reply(7 200.00000005 [delete] v120'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56071d65ab40 con 0x56071ccf5000 2024-04-02T07:34:25.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.651+0000 7ff1ca400640 1 -- 172.21.15.55:0/1390985702 <== osd.5 v2:172.21.15.106:6800/27676 1 ==== osd_op_reply(6 200.00000004 [delete] v120'9 uv8 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56071d65b200 con 0x56071ccddc00 2024-04-02T07:34:25.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.651+0000 7ff1ca400640 1 -- 172.21.15.55:0/1390985702 <== osd.5 v2:172.21.15.106:6800/27676 2 ==== osd_op_reply(4 200.00000002 [delete] v120'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56071d65b200 con 0x56071ccddc00 2024-04-02T07:34:25.653 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.651+0000 7ff1bdc00640 1 -- 172.21.15.55:0/1390985702 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:9 16.14 16:2e2fa760:::200.00000001:head [write 0~48 in=48b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x56071d7ca800 con 0x56071cb95800 2024-04-02T07:34:25.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cae00640 1 -- 172.21.15.55:0/1390985702 <== osd.0 v2:172.21.15.55:6800/27392 4 ==== osd_op_reply(9 200.00000001 [write 0~48] v120'43 uv43 ondisk = 0) v8 ==== 156+0+0 (crc 0 0 0) 0x56071d65ab40 con 0x56071cb95800 2024-04-02T07:34:25.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cb800640 1 -- 172.21.15.55:0/1390985702 <== osd.1 v2:172.21.15.55:6809/27391 1 ==== osd_op_reply(5 200.00000003 [delete] v120'6 uv5 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56071d65b8c0 con 0x56071ccf4400 2024-04-02T07:34:25.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1ca400640 1 -- 172.21.15.55:0/1390985702 <== osd.7 v2:172.21.15.106:6824/27679 1 ==== osd_op_reply(8 200.00000006 [delete] v120'3 uv0 ondisk = -2 ((2) No such file or directory)) v8 ==== 156+0+0 (crc 0 0 0) 0x56071d65b200 con 0x56071ccf5800 2024-04-02T07:34:25.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 4 Successfully wrote new journal pointer and header for rank 8:0 2024-04-02T07:34:25.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/1390985702 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x56071cb95800 msgr2=0x56071cce8000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x56071cb95800 0x56071cce8000 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/1390985702 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x56071ccf4400 msgr2=0x56071cce8b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x56071ccf4400 0x56071cce8b00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/1390985702 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x56071ccf5000 msgr2=0x56071cce9080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x56071ccf5000 0x56071cce9080 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/1390985702 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x56071ccddc00 msgr2=0x56071cce8580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x56071ccddc00 0x56071cce8580 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/1390985702 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x56071ccf5800 msgr2=0x56071cce9600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x56071ccf5800 0x56071cce9600 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.656 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cae00640 1 -- 172.21.15.55:0/1390985702 reap_dead start 2024-04-02T07:34:25.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/1390985702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071d7cbc00 msgr2=0x56071c932100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 --2- 172.21.15.55:0/1390985702 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071d7cbc00 0x56071c932100 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x56071d82e360 tx=0x56071c97f020 comp rx=0 tx=0).stop 2024-04-02T07:34:25.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cae00640 1 -- 172.21.15.55:0/1390985702 reap_dead start 2024-04-02T07:34:25.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/1390985702 shutdown_connections 2024-04-02T07:34:25.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/1390985702 >> 172.21.15.55:0/1390985702 conn(0x56071d7cb800 msgr2=0x56071ccca000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:25.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/1390985702 shutdown_connections 2024-04-02T07:34:25.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/1390985702 wait complete. 2024-04-02T07:34:25.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/3551098587 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x56071cb94c00 msgr2=0x56071c933700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 --2- 172.21.15.55:0/3551098587 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x56071cb94c00 0x56071c933700 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x56071d82e030 tx=0x56071d624fc0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/3551098587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071d7cb400 msgr2=0x56071c932680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 --2- 172.21.15.55:0/3551098587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071d7cb400 0x56071c932680 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x56071d82ee40 tx=0x56071d7d4c00 comp rx=0 tx=0).stop 2024-04-02T07:34:25.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/3551098587 shutdown_connections 2024-04-02T07:34:25.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 --2- 172.21.15.55:0/3551098587 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071d7cb400 0x56071c932680 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 --2- 172.21.15.55:0/3551098587 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x56071cb94c00 0x56071c933700 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 --2- 172.21.15.55:0/3551098587 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071d7cb000 0x56071c932c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 --2- 172.21.15.55:0/3551098587 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071d7cac00 0x56071c933180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/3551098587 >> 172.21.15.55:0/3551098587 conn(0x56071c8a4c00 msgr2=0x56071c8d3800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/3551098587 shutdown_connections 2024-04-02T07:34:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/3551098587 wait complete. 2024-04-02T07:34:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/3226048394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071c8a5800 msgr2=0x56071c930580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 --2- 172.21.15.55:0/3226048394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071c8a5800 0x56071c930580 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x56071d70acc0 tx=0x56071d672d20 comp rx=0 tx=0).stop 2024-04-02T07:34:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/3226048394 shutdown_connections 2024-04-02T07:34:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 --2- 172.21.15.55:0/3226048394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x56071c8a5000 0x56071c931080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 --2- 172.21.15.55:0/3226048394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x56071c8a5400 0x56071c930b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 --2- 172.21.15.55:0/3226048394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x56071c8a5800 0x56071c930580 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/3226048394 >> 172.21.15.55:0/3226048394 conn(0x56071c8a5c00 msgr2=0x56071c8d3000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/3226048394 shutdown_connections 2024-04-02T07:34:25.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.655+0000 7ff1cce18400 1 -- 172.21.15.55:0/3226048394 wait complete. 2024-04-02T07:34:25.660 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-journal-tool', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', '--rank', 'cephfs:0', 'journal', 'reset', '--force'] in time 0:00:00.079251, result: writing EResetJournal entry 2024-04-02T07:34:25.661 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_extents cephfs_data 2024-04-02T07:34:25.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f040a8498c0 1 -- start start 2024-04-02T07:34:25.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f040a8498c0 1 Processor -- start 2024-04-02T07:34:25.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f040a8498c0 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560f5c345800 0x560f5c3d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f040a8498c0 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5c345400 0x560f5c3d0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f040a8498c0 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560f5c345000 0x560f5c3d1080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f040a8498c0 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f5c412a00 con 0x560f5c345400 2024-04-02T07:34:25.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f040a8498c0 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f5c412780 con 0x560f5c345800 2024-04-02T07:34:25.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f040a8498c0 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f5c412640 con 0x560f5c345000 2024-04-02T07:34:25.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f0407200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5c345400 0x560f5c3d0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f0407200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5c345400 0x560f5c3d0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33830/0 (socket says 172.21.15.55:33830) 2024-04-02T07:34:25.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f0407200640 1 -- 172.21.15.55:0/3954884441 learned_addr learned my addr 172.21.15.55:0/3954884441 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:25.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f0408600640 1 --2- 172.21.15.55:0/3954884441 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560f5c345000 0x560f5c3d1080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f0407c00640 1 --2- 172.21.15.55:0/3954884441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560f5c345800 0x560f5c3d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f0407200640 1 -- 172.21.15.55:0/3954884441 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560f5c345000 msgr2=0x560f5c3d1080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f0407200640 1 --2- 172.21.15.55:0/3954884441 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560f5c345000 0x560f5c3d1080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f0407200640 1 -- 172.21.15.55:0/3954884441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560f5c345800 msgr2=0x560f5c3d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f0407200640 1 --2- 172.21.15.55:0/3954884441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560f5c345800 0x560f5c3d0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f0407200640 1 -- 172.21.15.55:0/3954884441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f5c3789c0 con 0x560f5c345400 2024-04-02T07:34:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f0407c00640 1 --2- 172.21.15.55:0/3954884441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560f5c345800 0x560f5c3d0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f0407200640 1 --2- 172.21.15.55:0/3954884441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5c345400 0x560f5c3d0b00 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x560f5d1b9380 tx=0x560f5d11ed20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a572e577a2627c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f0404a00640 1 -- 172.21.15.55:0/3954884441 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560f5c399600 con 0x560f5c345400 2024-04-02T07:34:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f0404a00640 1 -- 172.21.15.55:0/3954884441 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560f5c3a2180 con 0x560f5c345400 2024-04-02T07:34:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f0404a00640 1 -- 172.21.15.55:0/3954884441 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560f5c3991e0 con 0x560f5c345400 2024-04-02T07:34:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f040a8498c0 1 -- 172.21.15.55:0/3954884441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560f5c378b60 con 0x560f5c345400 2024-04-02T07:34:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f040a8498c0 1 -- 172.21.15.55:0/3954884441 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x560f5c378340 con 0x560f5c345400 2024-04-02T07:34:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f040a8498c0 4 waiting for MDS map... 2024-04-02T07:34:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f0404a00640 1 -- 172.21.15.55:0/3954884441 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x560f5c384c40 con 0x560f5c345400 2024-04-02T07:34:25.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.747+0000 7f0404a00640 1 -- 172.21.15.55:0/3954884441 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 103) v1 ==== 2573+0+0 (secure 0 0 0) 0x560f5c392f00 con 0x560f5c345400 2024-04-02T07:34:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f040a8498c0 4 Got MDS map 103 2024-04-02T07:34:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f040a8498c0 4 datascan.main: Using metadata pool output 2024-04-02T07:34:25.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f040a8498c0 4 datascan.main: connecting to RADOS... 2024-04-02T07:34:25.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f040a8498c0 1 Processor -- start 2024-04-02T07:34:25.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f040a8498c0 1 -- start start 2024-04-02T07:34:25.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f040a8498c0 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560f5d124c00 0x560f5c3d1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f040a8498c0 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5d125000 0x560f5c3d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f040a8498c0 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560f5d125400 0x560f5c3d2100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f040a8498c0 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f5c38be00 con 0x560f5d125000 2024-04-02T07:34:25.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f040a8498c0 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f5c412780 con 0x560f5d125400 2024-04-02T07:34:25.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f040a8498c0 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f5c412500 con 0x560f5d124c00 2024-04-02T07:34:25.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f0407c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5d125000 0x560f5c3d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f0407200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560f5d125400 0x560f5c3d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f0408600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560f5d124c00 0x560f5c3d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f0407c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5d125000 0x560f5c3d1b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33846/0 (socket says 172.21.15.55:33846) 2024-04-02T07:34:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f0407200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560f5d125400 0x560f5c3d2100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:45862/0 (socket says 172.21.15.55:45862) 2024-04-02T07:34:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f0407c00640 1 -- 172.21.15.55:0/565878247 learned_addr learned my addr 172.21.15.55:0/565878247 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f0407c00640 1 -- 172.21.15.55:0/565878247 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560f5d124c00 msgr2=0x560f5c3d1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f0407c00640 1 --2- 172.21.15.55:0/565878247 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560f5d124c00 0x560f5c3d1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f0407c00640 1 -- 172.21.15.55:0/565878247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560f5d125400 msgr2=0x560f5c3d2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f0407c00640 1 --2- 172.21.15.55:0/565878247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560f5d125400 0x560f5c3d2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f0407c00640 1 -- 172.21.15.55:0/565878247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f5c378000 con 0x560f5d125000 2024-04-02T07:34:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f0407c00640 1 --2- 172.21.15.55:0/565878247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5d125000 0x560f5c3d1b80 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x560f5d1b89f0 tx=0x560f5d0ce1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fc6a8ac37cfcff server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f0402200640 1 -- 172.21.15.55:0/565878247 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560f5c399080 con 0x560f5d125000 2024-04-02T07:34:25.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f0402200640 1 -- 172.21.15.55:0/565878247 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560f5c3a2900 con 0x560f5d125000 2024-04-02T07:34:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f0402200640 1 -- 172.21.15.55:0/565878247 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560f5c399600 con 0x560f5d125000 2024-04-02T07:34:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f040a8498c0 1 -- 172.21.15.55:0/565878247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5d125000 msgr2=0x560f5c3d1b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f040a8498c0 1 --2- 172.21.15.55:0/565878247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5d125000 0x560f5c3d1b80 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x560f5d1b89f0 tx=0x560f5d0ce1e0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f040a8498c0 1 -- 172.21.15.55:0/565878247 shutdown_connections 2024-04-02T07:34:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f040a8498c0 1 --2- 172.21.15.55:0/565878247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560f5d125400 0x560f5c3d2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f040a8498c0 1 --2- 172.21.15.55:0/565878247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5d125000 0x560f5c3d1b80 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f040a8498c0 1 --2- 172.21.15.55:0/565878247 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560f5d124c00 0x560f5c3d1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f040a8498c0 1 -- 172.21.15.55:0/565878247 >> 172.21.15.55:0/565878247 conn(0x560f5c344c00 msgr2=0x560f5c371800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f040a8498c0 1 -- 172.21.15.55:0/565878247 shutdown_connections 2024-04-02T07:34:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.751+0000 7f040a8498c0 1 -- 172.21.15.55:0/565878247 wait complete. 2024-04-02T07:34:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f040a8498c0 1 Processor -- start 2024-04-02T07:34:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f040a8498c0 1 -- start start 2024-04-02T07:34:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f040a8498c0 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5d124c00 0x560f5c3d3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f040a8498c0 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560f5d125000 0x560f5c3d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f040a8498c0 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560f5d125400 0x560f5c3d2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f040a8498c0 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f5c4123c0 con 0x560f5d124c00 2024-04-02T07:34:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f040a8498c0 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x560f5c412280 con 0x560f5d125400 2024-04-02T07:34:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f040a8498c0 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x560f5c412140 con 0x560f5d125000 2024-04-02T07:34:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f0408600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5d124c00 0x560f5c3d3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f0408600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5d124c00 0x560f5c3d3180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33854/0 (socket says 172.21.15.55:33854) 2024-04-02T07:34:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 learned_addr learned my addr 172.21.15.55:0/2892977651 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f0407c00640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560f5d125000 0x560f5c3d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f0407200640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560f5d125400 0x560f5c3d2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560f5d125000 msgr2=0x560f5c3d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f0408600640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560f5d125000 0x560f5c3d2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560f5d125400 msgr2=0x560f5c3d2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f0408600640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560f5d125400 0x560f5c3d2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560f5c3781a0 con 0x560f5d124c00 2024-04-02T07:34:25.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f0408600640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5d124c00 0x560f5c3d3180 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x560f5d2693e0 tx=0x560f5d26cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f0400400640 1 -- 172.21.15.55:0/2892977651 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560f5c399080 con 0x560f5d124c00 2024-04-02T07:34:25.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f0400400640 1 -- 172.21.15.55:0/2892977651 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560f5d129680 con 0x560f5d124c00 2024-04-02T07:34:25.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f0400400640 1 -- 172.21.15.55:0/2892977651 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x560f5c399600 con 0x560f5d124c00 2024-04-02T07:34:25.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x560f5c378000 con 0x560f5d124c00 2024-04-02T07:34:25.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560f5c3789c0 con 0x560f5d124c00 2024-04-02T07:34:25.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f040a8498c0 4 datascan.init: resolving metadata pool 16 2024-04-02T07:34:25.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.755+0000 7f0400400640 1 -- 172.21.15.55:0/2892977651 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x560f5c37c840 con 0x560f5d124c00 2024-04-02T07:34:25.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f0400400640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x560f5c62ac00 0x560f5c3d3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f0400400640 1 -- 172.21.15.55:0/2892977651 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x560f5c384a80 con 0x560f5d124c00 2024-04-02T07:34:25.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f040a8498c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-02T07:34:25.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f040a8498c0 4 datascan.main: data pool 'cephfs_data' has ID 17 2024-04-02T07:34:25.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f040a8498c0 4 datascan.main: opening data pool 'cephfs_data' 2024-04-02T07:34:25.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f040a8498c0 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x560f5d125800 0x560f5c3d2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:1 17.0 17:00000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5d125c00 con 0x560f5d125800 2024-04-02T07:34:25.761 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f0407c00640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x560f5c62ac00 0x560f5c3d3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f0407200640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x560f5d125800 0x560f5c3d2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f0407200640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x560f5d125800 0x560f5c3d2100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f0407c00640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x560f5c62ac00 0x560f5c3d3700 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x560f5d1b89f0 tx=0x560f5d0ce240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.7 v2:172.21.15.106:6824/27679 1 ==== osd_op_reply(1 [pgnls start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5d125800 2024-04-02T07:34:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f0401800640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x560f5c62b000 0x560f5c71a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:2 17.20 17:04000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c62b400 con 0x560f5c62b000 2024-04-02T07:34:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f0408600640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x560f5c62b000 0x560f5c71a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f0408600640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x560f5c62b000 0x560f5c71a000 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.1 v2:172.21.15.55:6809/27391 1 ==== osd_op_reply(2 [pgnls start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c62b000 2024-04-02T07:34:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f0402200640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x560f5c62bc00 0x560f5c71a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:3 17.10 17:08000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c726000 con 0x560f5c62bc00 2024-04-02T07:34:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f0407c00640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x560f5c62bc00 0x560f5c71a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.759+0000 7f0407c00640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x560f5c62bc00 0x560f5c71a580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 <== osd.3 v2:172.21.15.55:6824/27393 1 ==== osd_op_reply(3 [pgnls start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112fc0 con 0x560f5c62bc00 2024-04-02T07:34:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0401800640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x560f5c62b800 0x560f5c71ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:4 17.30 17:0c000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c726800 con 0x560f5c62b800 2024-04-02T07:34:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0407200640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x560f5c62b800 0x560f5c71ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0407200640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x560f5c62b800 0x560f5c71ab00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.0 v2:172.21.15.55:6800/27392 1 ==== osd_op_reply(4 [pgnls start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c62b800 2024-04-02T07:34:25.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:5 17.8 17:10000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c726400 con 0x560f5d125800 2024-04-02T07:34:25.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.7 v2:172.21.15.106:6824/27679 2 ==== osd_op_reply(5 [pgnls start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5d125800 2024-04-02T07:34:25.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:6 17.28 17:14000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c726c00 con 0x560f5c62bc00 2024-04-02T07:34:25.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 <== osd.3 v2:172.21.15.55:6824/27393 2 ==== osd_op_reply(6 [pgnls start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112fc0 con 0x560f5c62bc00 2024-04-02T07:34:25.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:7 17.18 17:18000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5d124800 con 0x560f5c62b800 2024-04-02T07:34:25.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.0 v2:172.21.15.55:6800/27392 2 ==== osd_op_reply(7 [pgnls start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c62b800 2024-04-02T07:34:25.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:8 17.38 17:1c000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c727000 con 0x560f5d125800 2024-04-02T07:34:25.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.7 v2:172.21.15.106:6824/27679 3 ==== osd_op_reply(8 [pgnls start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5d125800 2024-04-02T07:34:25.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:9 17.4 17:20000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5d124400 con 0x560f5c62b800 2024-04-02T07:34:25.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.0 v2:172.21.15.55:6800/27392 3 ==== osd_op_reply(9 [pgnls start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c62b800 2024-04-02T07:34:25.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:10 17.24 17:24000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c726800 con 0x560f5c62bc00 2024-04-02T07:34:25.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 <== osd.3 v2:172.21.15.55:6824/27393 3 ==== osd_op_reply(10 [pgnls start_epoch 120 out=49b] v116'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112fc0 con 0x560f5c62bc00 2024-04-02T07:34:25.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:11 17.14 17:28000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5d125c00 con 0x560f5c62bc00 2024-04-02T07:34:25.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 <== osd.3 v2:172.21.15.55:6824/27393 4 ==== osd_op_reply(11 [pgnls start_epoch 120 out=49b] v116'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112fc0 con 0x560f5c62bc00 2024-04-02T07:34:25.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:12 17.34 17:2c000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c726400 con 0x560f5c62b800 2024-04-02T07:34:25.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.0 v2:172.21.15.55:6800/27392 4 ==== osd_op_reply(12 [pgnls start_epoch 120 out=49b] v116'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c62b800 2024-04-02T07:34:25.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.763+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:13 17.c 17:30000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c726000 con 0x560f5d125800 2024-04-02T07:34:25.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.767+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.7 v2:172.21.15.106:6824/27679 4 ==== osd_op_reply(13 [pgnls start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5d125800 2024-04-02T07:34:25.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.767+0000 7f0401800640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x560f5c727400 0x560f5c71b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.767+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:14 17.2c 17:34000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c727800 con 0x560f5c727400 2024-04-02T07:34:25.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.767+0000 7f0408600640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x560f5c727400 0x560f5c71b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.767 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.767+0000 7f0408600640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x560f5c727400 0x560f5c71b080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.767+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.4 v2:172.21.15.106:6801/27677 1 ==== osd_op_reply(14 [pgnls start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c727400 2024-04-02T07:34:25.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.767+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:15 17.1c 17:38000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c726c00 con 0x560f5c62b000 2024-04-02T07:34:25.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.767+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.1 v2:172.21.15.55:6809/27391 2 ==== osd_op_reply(15 [pgnls start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c62b000 2024-04-02T07:34:25.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.767+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:16 17.3c 17:3c000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c726800 con 0x560f5c62b800 2024-04-02T07:34:25.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.771+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.0 v2:172.21.15.55:6800/27392 5 ==== osd_op_reply(16 [pgnls start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c62b800 2024-04-02T07:34:25.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.771+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:17 17.2 17:40000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5d12b400 con 0x560f5c727400 2024-04-02T07:34:25.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.771+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.4 v2:172.21.15.106:6801/27677 2 ==== osd_op_reply(17 [pgnls start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c727400 2024-04-02T07:34:25.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.771+0000 7f0401800640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x560f5c727c00 0x560f5c71b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.771+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:18 17.22 17:44000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c727800 con 0x560f5c727c00 2024-04-02T07:34:25.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.771+0000 7f0407c00640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x560f5c727c00 0x560f5c71b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.771+0000 7f0407c00640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x560f5c727c00 0x560f5c71b600 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.771+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 <== osd.5 v2:172.21.15.106:6800/27676 1 ==== osd_op_reply(18 [pgnls start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112fc0 con 0x560f5c727c00 2024-04-02T07:34:25.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.771+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:19 17.12 17:48000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5d12b000 con 0x560f5c62bc00 2024-04-02T07:34:25.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.771+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 <== osd.3 v2:172.21.15.55:6824/27393 5 ==== osd_op_reply(19 [pgnls start_epoch 120 out=81b] v119'22 uv22 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x560f5d112fc0 con 0x560f5c62bc00 2024-04-02T07:34:25.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.771+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:20 17.12 17:4bec3886:::10000000002.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c727000 con 0x560f5c62bc00 2024-04-02T07:34:25.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.771+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 <== osd.3 v2:172.21.15.55:6824/27393 6 ==== osd_op_reply(20 10000000002.00000000 [stat out=16b] v0'0 uv22 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x560f5d112fc0 con 0x560f5c62bc00 2024-04-02T07:34:25.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.771+0000 7f040a8498c0 10 datascan.operator(): handling object 1099511627778.0 2024-04-02T07:34:25.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.771+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:21 17.12 17:4bec3886:::10000000002.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c726400 con 0x560f5c62bc00 2024-04-02T07:34:25.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.771+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 <== osd.3 v2:172.21.15.55:6824/27393 7 ==== osd_op_reply(21 10000000002.00000000 [call] v120'23 uv23 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x560f5d112fc0 con 0x560f5c62bc00 2024-04-02T07:34:25.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.771+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:22 17.32 17:4c000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c726000 con 0x560f5d125800 2024-04-02T07:34:25.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.775+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.7 v2:172.21.15.106:6824/27679 5 ==== osd_op_reply(22 [pgnls start_epoch 120 out=49b] v116'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5d125800 2024-04-02T07:34:25.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.775+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:23 17.a 17:50000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c738000 con 0x560f5d125800 2024-04-02T07:34:25.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.775+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.7 v2:172.21.15.106:6824/27679 6 ==== osd_op_reply(23 [pgnls start_epoch 120 out=49b] v116'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5d125800 2024-04-02T07:34:25.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.775+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:24 17.2a 17:54000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c726c00 con 0x560f5c62bc00 2024-04-02T07:34:25.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.775+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 <== osd.3 v2:172.21.15.55:6824/27393 8 ==== osd_op_reply(24 [pgnls start_epoch 120 out=49b] v116'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112fc0 con 0x560f5c62bc00 2024-04-02T07:34:25.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.775+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:25 17.1a 17:58000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c738400 con 0x560f5c62b800 2024-04-02T07:34:25.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.775+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.0 v2:172.21.15.55:6800/27392 6 ==== osd_op_reply(25 [pgnls start_epoch 120 out=49b] v116'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c62b800 2024-04-02T07:34:25.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.775+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:26 17.3a 17:5c000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5d124800 con 0x560f5c62b000 2024-04-02T07:34:25.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.775+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.1 v2:172.21.15.55:6809/27391 3 ==== osd_op_reply(26 [pgnls start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c62b000 2024-04-02T07:34:25.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.775+0000 7f0402200640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x560f5c738800 0x560f5c71c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.775+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:27 17.6 17:60000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c738c00 con 0x560f5c738800 2024-04-02T07:34:25.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.775+0000 7f0407200640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x560f5c738800 0x560f5c71c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.775+0000 7f0407200640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x560f5c738800 0x560f5c71c680 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.775+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.6 v2:172.21.15.106:6816/27678 1 ==== osd_op_reply(27 [pgnls start_epoch 120 out=49b] v116'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c738800 2024-04-02T07:34:25.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.775+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:28 17.26 17:64000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5d124400 con 0x560f5c62b800 2024-04-02T07:34:25.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.775+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.0 v2:172.21.15.55:6800/27392 7 ==== osd_op_reply(28 [pgnls start_epoch 120 out=49b] v116'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c62b800 2024-04-02T07:34:25.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.775+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:29 17.16 17:68000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c739000 con 0x560f5c727c00 2024-04-02T07:34:25.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.775+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 <== osd.5 v2:172.21.15.106:6800/27676 2 ==== osd_op_reply(29 [pgnls start_epoch 120 out=49b] v116'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112fc0 con 0x560f5c727c00 2024-04-02T07:34:25.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.775+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:30 17.36 17:6c000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5d12b400 con 0x560f5c62b800 2024-04-02T07:34:25.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.779+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.0 v2:172.21.15.55:6800/27392 8 ==== osd_op_reply(30 [pgnls start_epoch 120 out=81b] v116'33 uv17 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c62b800 2024-04-02T07:34:25.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.779+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:31 17.36 17:6fe38dc2:::100000001f7.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c726800 con 0x560f5c62b800 2024-04-02T07:34:25.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.779+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.0 v2:172.21.15.55:6800/27392 9 ==== osd_op_reply(31 100000001f7.00000000 [stat out=16b] v0'0 uv17 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c62b800 2024-04-02T07:34:25.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.779+0000 7f040a8498c0 10 datascan.operator(): handling object 1099511628279.0 2024-04-02T07:34:25.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.779+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:32 17.36 17:6fe38dc2:::100000001f7.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c726000 con 0x560f5c62b800 2024-04-02T07:34:25.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.779+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.0 v2:172.21.15.55:6800/27392 10 ==== osd_op_reply(32 100000001f7.00000000 [call] v120'34 uv34 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c62b800 2024-04-02T07:34:25.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.779+0000 7f040a8498c0 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x560f5c726800 0x560f5c3d1b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.779+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:33 17.e 17:70000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c727800 con 0x560f5c726800 2024-04-02T07:34:25.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.779+0000 7f0408600640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x560f5c726800 0x560f5c3d1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.779+0000 7f0408600640 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x560f5c726800 0x560f5c3d1b80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.779+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.2 v2:172.21.15.55:6808/27394 1 ==== osd_op_reply(33 [pgnls start_epoch 120 out=49b] v116'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c726800 2024-04-02T07:34:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.779+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:34 17.2e 17:74000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c62b400 con 0x560f5c738800 2024-04-02T07:34:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.779+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.6 v2:172.21.15.106:6816/27678 2 ==== osd_op_reply(34 [pgnls start_epoch 120 out=49b] v116'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c738800 2024-04-02T07:34:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.779+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:35 17.1e 17:78000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c738000 con 0x560f5c62b000 2024-04-02T07:34:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.779+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.1 v2:172.21.15.55:6809/27391 4 ==== osd_op_reply(35 [pgnls start_epoch 120 out=49b] v116'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c62b000 2024-04-02T07:34:25.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.779+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:36 17.3e 17:7c000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c739800 con 0x560f5c727400 2024-04-02T07:34:25.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.783+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.4 v2:172.21.15.106:6801/27677 3 ==== osd_op_reply(36 [pgnls start_epoch 120 out=49b] v116'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c727400 2024-04-02T07:34:25.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.783+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:37 17.1 17:80000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c738400 con 0x560f5c62b800 2024-04-02T07:34:25.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.783+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.0 v2:172.21.15.55:6800/27392 11 ==== osd_op_reply(37 [pgnls start_epoch 120 out=49b] v116'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c62b800 2024-04-02T07:34:25.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.783+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:38 17.21 17:84000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c739c00 con 0x560f5c726800 2024-04-02T07:34:25.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.783+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.2 v2:172.21.15.55:6808/27394 2 ==== osd_op_reply(38 [pgnls start_epoch 120 out=49b] v116'24 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c726800 2024-04-02T07:34:25.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.783+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:39 17.11 17:88000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c738c00 con 0x560f5c62bc00 2024-04-02T07:34:25.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.783+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 <== osd.3 v2:172.21.15.55:6824/27393 9 ==== osd_op_reply(39 [pgnls start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112fc0 con 0x560f5c62bc00 2024-04-02T07:34:25.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.783+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:40 17.31 17:8c000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c738000 con 0x560f5c62b000 2024-04-02T07:34:25.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.783+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.1 v2:172.21.15.55:6809/27391 5 ==== osd_op_reply(40 [pgnls start_epoch 120 out=81b] v116'15 uv8 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c62b000 2024-04-02T07:34:25.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.783+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:41 17.31 17:8de29a03:::10000000004.00000001:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c727000 con 0x560f5c62b000 2024-04-02T07:34:25.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.783+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.1 v2:172.21.15.55:6809/27391 6 ==== osd_op_reply(41 10000000004.00000001 [stat out=16b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c62b000 2024-04-02T07:34:25.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.783+0000 7f040a8498c0 10 datascan.operator(): handling object 1099511627780.1 2024-04-02T07:34:25.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.783+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:42 17.5 17:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5d12b400 con 0x560f5c738800 2024-04-02T07:34:25.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.783+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.6 v2:172.21.15.106:6816/27678 3 ==== osd_op_reply(42 10000000004.00000000 [call] v120'14 uv14 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c738800 2024-04-02T07:34:25.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.783+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:43 17.9 17:90000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5d12b000 con 0x560f5c62bc00 2024-04-02T07:34:25.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.783+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 <== osd.3 v2:172.21.15.55:6824/27393 10 ==== osd_op_reply(43 [pgnls start_epoch 120 out=49b] v116'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112fc0 con 0x560f5c62bc00 2024-04-02T07:34:25.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.783+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:44 17.29 17:94000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c739800 con 0x560f5c727400 2024-04-02T07:34:25.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.787+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.4 v2:172.21.15.106:6801/27677 4 ==== osd_op_reply(44 [pgnls start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c727400 2024-04-02T07:34:25.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.787+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:45 17.19 17:98000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c739400 con 0x560f5c727c00 2024-04-02T07:34:25.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.787+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 <== osd.5 v2:172.21.15.106:6800/27676 3 ==== osd_op_reply(45 [pgnls start_epoch 120 out=81b] v119'23 uv23 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x560f5d112fc0 con 0x560f5c727c00 2024-04-02T07:34:25.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.787+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:46 17.19 17:997b7129:::100000001f8.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5d124400 con 0x560f5c727c00 2024-04-02T07:34:25.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.787+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 <== osd.5 v2:172.21.15.106:6800/27676 4 ==== osd_op_reply(46 100000001f8.00000000 [stat out=16b] v0'0 uv23 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x560f5d112fc0 con 0x560f5c727c00 2024-04-02T07:34:25.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.787+0000 7f040a8498c0 10 datascan.operator(): handling object 1099511628280.0 2024-04-02T07:34:25.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.787+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:47 17.19 17:997b7129:::100000001f8.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5d125c00 con 0x560f5c727c00 2024-04-02T07:34:25.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.787+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 <== osd.5 v2:172.21.15.106:6800/27676 5 ==== osd_op_reply(47 100000001f8.00000000 [call] v120'24 uv24 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x560f5d112fc0 con 0x560f5c727c00 2024-04-02T07:34:25.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.787+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:48 17.39 17:9c000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c754000 con 0x560f5c727c00 2024-04-02T07:34:25.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.787+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 <== osd.5 v2:172.21.15.106:6800/27676 6 ==== osd_op_reply(48 [pgnls start_epoch 120 out=49b] v116'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112fc0 con 0x560f5c727c00 2024-04-02T07:34:25.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.787+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:49 17.5 17:a0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c726400 con 0x560f5c738800 2024-04-02T07:34:25.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.787+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.6 v2:172.21.15.106:6816/27678 4 ==== osd_op_reply(49 [pgnls start_epoch 120 out=81b] v120'14 uv14 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c738800 2024-04-02T07:34:25.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.787+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:50 17.5 17:a367a3e8:::10000000004.00000000:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c754400 con 0x560f5c738800 2024-04-02T07:34:25.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.787+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.6 v2:172.21.15.106:6816/27678 5 ==== osd_op_reply(50 10000000004.00000000 [stat out=16b] v0'0 uv14 ondisk = 0) v8 ==== 164+0+16 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c738800 2024-04-02T07:34:25.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.787+0000 7f040a8498c0 10 datascan.operator(): handling object 1099511627780.0 2024-04-02T07:34:25.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.787+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:51 17.5 17:a367a3e8:::10000000004.00000000:head [call cephfs.accumulate_inode_metadata in=112b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c754800 con 0x560f5c738800 2024-04-02T07:34:25.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.791+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.6 v2:172.21.15.106:6816/27678 6 ==== osd_op_reply(51 10000000004.00000000 [call] v120'15 uv15 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c738800 2024-04-02T07:34:25.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.791+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:52 17.25 17:a4000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c754c00 con 0x560f5c62b000 2024-04-02T07:34:25.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.791+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.1 v2:172.21.15.55:6809/27391 7 ==== osd_op_reply(52 [pgnls start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c62b000 2024-04-02T07:34:25.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.791+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:53 17.15 17:a8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c726c00 con 0x560f5c727c00 2024-04-02T07:34:25.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.791+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 <== osd.5 v2:172.21.15.106:6800/27676 7 ==== osd_op_reply(53 [pgnls start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112fc0 con 0x560f5c727c00 2024-04-02T07:34:25.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.791+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:54 17.35 17:ac000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c739c00 con 0x560f5c727400 2024-04-02T07:34:25.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.791+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.4 v2:172.21.15.106:6801/27677 5 ==== osd_op_reply(54 [pgnls start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c727400 2024-04-02T07:34:25.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.791+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:55 17.d 17:b0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c754000 con 0x560f5d125800 2024-04-02T07:34:25.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.791+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.7 v2:172.21.15.106:6824/27679 7 ==== osd_op_reply(55 [pgnls start_epoch 120 out=49b] v116'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5d125800 2024-04-02T07:34:25.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.791+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:56 17.2d 17:b4000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c727800 con 0x560f5d125800 2024-04-02T07:34:25.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.791+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.7 v2:172.21.15.106:6824/27679 8 ==== osd_op_reply(56 [pgnls start_epoch 120 out=49b] v116'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5d125800 2024-04-02T07:34:25.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.791+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:57 17.1d 17:b8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5d124400 con 0x560f5d125800 2024-04-02T07:34:25.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.791+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.7 v2:172.21.15.106:6824/27679 9 ==== osd_op_reply(57 [pgnls start_epoch 120 out=49b] v116'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5d125800 2024-04-02T07:34:25.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.791+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:58 17.3d 17:bc000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5d124800 con 0x560f5d125800 2024-04-02T07:34:25.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.791+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.7 v2:172.21.15.106:6824/27679 10 ==== osd_op_reply(58 [pgnls start_epoch 120 out=49b] v116'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5d125800 2024-04-02T07:34:25.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.791+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:59 17.3 17:c0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5d125c00 con 0x560f5c727400 2024-04-02T07:34:25.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.4 v2:172.21.15.106:6801/27677 6 ==== osd_op_reply(59 [pgnls start_epoch 120 out=49b] v116'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c727400 2024-04-02T07:34:25.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:60 17.23 17:c4000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c727000 con 0x560f5c727400 2024-04-02T07:34:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.4 v2:172.21.15.106:6801/27677 7 ==== osd_op_reply(60 [pgnls start_epoch 120 out=49b] v116'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c727400 2024-04-02T07:34:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:61 17.13 17:c8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c739000 con 0x560f5c62bc00 2024-04-02T07:34:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 <== osd.3 v2:172.21.15.55:6824/27393 11 ==== osd_op_reply(61 [pgnls start_epoch 120 out=49b] v116'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112fc0 con 0x560f5c62bc00 2024-04-02T07:34:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:62 17.33 17:cc000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c726000 con 0x560f5d125800 2024-04-02T07:34:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.7 v2:172.21.15.106:6824/27679 11 ==== osd_op_reply(62 [pgnls start_epoch 120 out=49b] v116'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5d125800 2024-04-02T07:34:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:63 17.b 17:d0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c738c00 con 0x560f5c62b800 2024-04-02T07:34:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.0 v2:172.21.15.55:6800/27392 12 ==== osd_op_reply(63 [pgnls start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c62b800 2024-04-02T07:34:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:64 17.2b 17:d4000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5d12b400 con 0x560f5c727400 2024-04-02T07:34:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.4 v2:172.21.15.106:6801/27677 8 ==== osd_op_reply(64 [pgnls start_epoch 120 out=49b] v116'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c727400 2024-04-02T07:34:25.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:65 17.1b 17:d8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c739400 con 0x560f5c727400 2024-04-02T07:34:25.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.4 v2:172.21.15.106:6801/27677 9 ==== osd_op_reply(65 [pgnls start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c727400 2024-04-02T07:34:25.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:66 17.3b 17:dc000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c738000 con 0x560f5c726800 2024-04-02T07:34:25.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.2 v2:172.21.15.55:6808/27394 3 ==== osd_op_reply(66 [pgnls start_epoch 120 out=49b] v116'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c726800 2024-04-02T07:34:25.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:67 17.7 17:e0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5d12b000 con 0x560f5c727c00 2024-04-02T07:34:25.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 <== osd.5 v2:172.21.15.106:6800/27676 8 ==== osd_op_reply(67 [pgnls start_epoch 120 out=49b] v116'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112fc0 con 0x560f5c727c00 2024-04-02T07:34:25.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:68 17.27 17:e4000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c739800 con 0x560f5c727400 2024-04-02T07:34:25.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.4 v2:172.21.15.106:6801/27677 10 ==== osd_op_reply(68 [pgnls start_epoch 120 out=49b] v116'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c727400 2024-04-02T07:34:25.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:69 17.17 17:e8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c754c00 con 0x560f5c738800 2024-04-02T07:34:25.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.6 v2:172.21.15.106:6816/27678 7 ==== osd_op_reply(69 [pgnls start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c738800 2024-04-02T07:34:25.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.795+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:70 17.37 17:ec000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c739c00 con 0x560f5c62b800 2024-04-02T07:34:25.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.0 v2:172.21.15.55:6800/27392 13 ==== osd_op_reply(70 [pgnls start_epoch 120 out=49b] v116'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c62b800 2024-04-02T07:34:25.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:71 17.f 17:f0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c754400 con 0x560f5c62b000 2024-04-02T07:34:25.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.1 v2:172.21.15.55:6809/27391 8 ==== osd_op_reply(71 [pgnls start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c62b000 2024-04-02T07:34:25.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:72 17.2f 17:f4000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c738400 con 0x560f5c727400 2024-04-02T07:34:25.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f0408600640 1 -- 172.21.15.55:0/2892977651 <== osd.4 v2:172.21.15.106:6801/27677 11 ==== osd_op_reply(72 [pgnls start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112d80 con 0x560f5c727400 2024-04-02T07:34:25.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f0402200640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:73 17.1f 17:f8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c754800 con 0x560f5c738800 2024-04-02T07:34:25.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.6 v2:172.21.15.106:6816/27678 8 ==== osd_op_reply(73 [pgnls start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c738800 2024-04-02T07:34:25.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f0401800640 1 -- 172.21.15.55:0/2892977651 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:74 17.3f 17:fc000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x560f5c62b400 con 0x560f5c62b800 2024-04-02T07:34:25.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f0407200640 1 -- 172.21.15.55:0/2892977651 <== osd.0 v2:172.21.15.55:6800/27392 14 ==== osd_op_reply(74 [pgnls start_epoch 120 out=49b] v116'17 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x560f5d112b40 con 0x560f5c62b800 2024-04-02T07:34:25.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x560f5c62b800 msgr2=0x560f5c71ab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x560f5c62b800 0x560f5c71ab00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x560f5c62b000 msgr2=0x560f5c71a000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x560f5c62b000 0x560f5c71a000 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x560f5c726800 msgr2=0x560f5c3d1b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x560f5c726800 0x560f5c3d1b80 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x560f5c62bc00 msgr2=0x560f5c71a580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x560f5c62bc00 0x560f5c71a580 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x560f5c727400 msgr2=0x560f5c71b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x560f5c727400 0x560f5c71b080 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x560f5c727c00 msgr2=0x560f5c71b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x560f5c727c00 0x560f5c71b600 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 reap_dead start 2024-04-02T07:34:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 reap_dead start 2024-04-02T07:34:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x560f5c738800 msgr2=0x560f5c71c680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x560f5c738800 0x560f5c71c680 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x560f5d125800 msgr2=0x560f5c3d2100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x560f5d125800 0x560f5c3d2100 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f0407c00640 1 -- 172.21.15.55:0/2892977651 reap_dead start 2024-04-02T07:34:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x560f5c62ac00 msgr2=0x560f5c3d3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x560f5c62ac00 0x560f5c3d3700 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x560f5d1b89f0 tx=0x560f5d0ce240 comp rx=0 tx=0).stop 2024-04-02T07:34:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5d124c00 msgr2=0x560f5c3d3180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5d124c00 0x560f5c3d3180 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x560f5d2693e0 tx=0x560f5d26cc00 comp rx=0 tx=0).stop 2024-04-02T07:34:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 shutdown_connections 2024-04-02T07:34:25.801 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x560f5c62ac00 0x560f5c3d3700 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 --2- 172.21.15.55:0/2892977651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5d124c00 0x560f5c3d3180 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 >> 172.21.15.55:0/2892977651 conn(0x560f5c344c00 msgr2=0x560f5c371800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 shutdown_connections 2024-04-02T07:34:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 -- 172.21.15.55:0/2892977651 wait complete. 2024-04-02T07:34:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 -- 172.21.15.55:0/3954884441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5c345400 msgr2=0x560f5c3d0b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 --2- 172.21.15.55:0/3954884441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5c345400 0x560f5c3d0b00 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x560f5d1b9380 tx=0x560f5d11ed20 comp rx=0 tx=0).stop 2024-04-02T07:34:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 -- 172.21.15.55:0/3954884441 shutdown_connections 2024-04-02T07:34:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 --2- 172.21.15.55:0/3954884441 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x560f5c345000 0x560f5c3d1080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 --2- 172.21.15.55:0/3954884441 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x560f5c345400 0x560f5c3d0b00 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 --2- 172.21.15.55:0/3954884441 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x560f5c345800 0x560f5c3d0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 -- 172.21.15.55:0/3954884441 >> 172.21.15.55:0/3954884441 conn(0x560f5c345c00 msgr2=0x560f5c371000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 -- 172.21.15.55:0/3954884441 shutdown_connections 2024-04-02T07:34:25.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.799+0000 7f040a8498c0 1 -- 172.21.15.55:0/3954884441 wait complete. 2024-04-02T07:34:25.804 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_extents', 'cephfs_data'] in time 0:00:00.143569, result: 2024-04-02T07:34:25.804 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_inodes --filter-tag mytag123 cephfs_data 2024-04-02T07:34:25.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b936a78c0 1 -- start start 2024-04-02T07:34:25.894 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b936a78c0 1 Processor -- start 2024-04-02T07:34:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b936a78c0 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5653402e3800 0x56534036e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b936a78c0 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5653402e3400 0x56534036eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b936a78c0 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5653402e3000 0x56534036f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b936a78c0 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653403b0a00 con 0x5653402e3400 2024-04-02T07:34:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b936a78c0 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653403b0780 con 0x5653402e3800 2024-04-02T07:34:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b936a78c0 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653403b0640 con 0x5653402e3000 2024-04-02T07:34:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b90e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5653402e3400 0x56534036eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b90e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5653402e3400 0x56534036eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33876/0 (socket says 172.21.15.55:33876) 2024-04-02T07:34:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b91800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5653402e3800 0x56534036e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b90e00640 1 -- 172.21.15.55:0/1465059404 learned_addr learned my addr 172.21.15.55:0/1465059404 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b92200640 1 --2- 172.21.15.55:0/1465059404 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5653402e3000 0x56534036f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b91800640 1 -- 172.21.15.55:0/1465059404 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5653402e3000 msgr2=0x56534036f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b91800640 1 --2- 172.21.15.55:0/1465059404 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5653402e3000 0x56534036f080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b91800640 1 -- 172.21.15.55:0/1465059404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5653402e3400 msgr2=0x56534036eb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b91800640 1 --2- 172.21.15.55:0/1465059404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5653402e3400 0x56534036eb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b91800640 1 -- 172.21.15.55:0/1465059404 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653403169c0 con 0x5653402e3800 2024-04-02T07:34:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b92200640 1 --2- 172.21.15.55:0/1465059404 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5653402e3000 0x56534036f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b90e00640 1 --2- 172.21.15.55:0/1465059404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5653402e3400 0x56534036eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:34:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.895+0000 7f2b91800640 1 --2- 172.21.15.55:0/1465059404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5653402e3800 0x56534036e580 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x56534114d2c0 tx=0x5653411f8360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea757c71e4a81196 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b8e600640 1 -- 172.21.15.55:0/1465059404 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x565340337600 con 0x5653402e3800 2024-04-02T07:34:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b8e600640 1 -- 172.21.15.55:0/1465059404 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x565340340480 con 0x5653402e3800 2024-04-02T07:34:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b8e600640 1 -- 172.21.15.55:0/1465059404 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5653403371e0 con 0x5653402e3800 2024-04-02T07:34:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 1 -- 172.21.15.55:0/1465059404 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565340316b60 con 0x5653402e3800 2024-04-02T07:34:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 1 -- 172.21.15.55:0/1465059404 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x565340316340 con 0x5653402e3800 2024-04-02T07:34:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 4 waiting for MDS map... 2024-04-02T07:34:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b8e600640 1 -- 172.21.15.55:0/1465059404 <== mon.1 v2:172.21.15.106:3300/0 4 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x565340322c40 con 0x5653402e3800 2024-04-02T07:34:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b8e600640 1 -- 172.21.15.55:0/1465059404 <== mon.1 v2:172.21.15.106:3300/0 5 ==== fsmap(e 103) v1 ==== 2573+0+0 (secure 0 0 0) 0x565340330f00 con 0x5653402e3800 2024-04-02T07:34:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 4 Got MDS map 103 2024-04-02T07:34:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 10 datascan.parse_kwarg: Applying tag filter: 'mytag123' 2024-04-02T07:34:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 4 datascan.main: Using metadata pool output 2024-04-02T07:34:25.899 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 4 datascan.main: connecting to RADOS... 2024-04-02T07:34:25.903 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 1 Processor -- start 2024-04-02T07:34:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 1 -- start start 2024-04-02T07:34:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565341206c00 0x56534036f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565341207000 0x56534036fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565341207400 0x565340370100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x565340329e00 con 0x565341207000 2024-04-02T07:34:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653403b0a00 con 0x565341206c00 2024-04-02T07:34:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653403b0500 con 0x565341207400 2024-04-02T07:34:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b91800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565341207000 0x56534036fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b91800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565341207000 0x56534036fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33878/0 (socket says 172.21.15.55:33878) 2024-04-02T07:34:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b91800640 1 -- 172.21.15.55:0/3136725039 learned_addr learned my addr 172.21.15.55:0/3136725039 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b92200640 1 --2- 172.21.15.55:0/3136725039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565341206c00 0x56534036f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b90e00640 1 --2- 172.21.15.55:0/3136725039 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565341207400 0x565340370100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b91800640 1 -- 172.21.15.55:0/3136725039 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565341207400 msgr2=0x565340370100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b91800640 1 --2- 172.21.15.55:0/3136725039 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565341207400 0x565340370100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b91800640 1 -- 172.21.15.55:0/3136725039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565341206c00 msgr2=0x56534036f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b91800640 1 --2- 172.21.15.55:0/3136725039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565341206c00 0x56534036f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b91800640 1 -- 172.21.15.55:0/3136725039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565340316000 con 0x565341207000 2024-04-02T07:34:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b90e00640 1 --2- 172.21.15.55:0/3136725039 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565341207400 0x565340370100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b91800640 1 --2- 172.21.15.55:0/3136725039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565341207000 0x56534036fb80 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x5653412185a0 tx=0x56534106d140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f7bf60ec8c09859 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b8be00640 1 -- 172.21.15.55:0/3136725039 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x565340336f20 con 0x565341207000 2024-04-02T07:34:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b8be00640 1 -- 172.21.15.55:0/3136725039 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5653410bca80 con 0x565341207000 2024-04-02T07:34:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b8be00640 1 -- 172.21.15.55:0/3136725039 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x565340337600 con 0x565341207000 2024-04-02T07:34:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3136725039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565341207000 msgr2=0x56534036fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/3136725039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565341207000 0x56534036fb80 secure :-1 s=READY pgs=1864 cs=0 l=1 rev1=1 crypto rx=0x5653412185a0 tx=0x56534106d140 comp rx=0 tx=0).stop 2024-04-02T07:34:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3136725039 shutdown_connections 2024-04-02T07:34:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/3136725039 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565341207400 0x565340370100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/3136725039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565341207000 0x56534036fb80 unknown :-1 s=CLOSED pgs=1864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/3136725039 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565341206c00 0x56534036f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3136725039 >> 172.21.15.55:0/3136725039 conn(0x5653402e2c00 msgr2=0x56534030f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:25.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3136725039 shutdown_connections 2024-04-02T07:34:25.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.899+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3136725039 wait complete. 2024-04-02T07:34:25.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b936a78c0 1 Processor -- start 2024-04-02T07:34:25.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b936a78c0 1 -- start start 2024-04-02T07:34:25.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b936a78c0 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565341206c00 0x565340371180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b936a78c0 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565341207000 0x565340370c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b936a78c0 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565341207400 0x565340370680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b936a78c0 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653403b03c0 con 0x565341207000 2024-04-02T07:34:25.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b936a78c0 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5653403b0280 con 0x565341207400 2024-04-02T07:34:25.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b936a78c0 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5653403b0140 con 0x565341206c00 2024-04-02T07:34:25.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b91800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565341207000 0x565340370c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b91800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565341207000 0x565340370c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33892/0 (socket says 172.21.15.55:33892) 2024-04-02T07:34:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b92200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565341206c00 0x565340371180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 learned_addr learned my addr 172.21.15.55:0/3668765100 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b90e00640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565341207400 0x565340370680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565341206c00 msgr2=0x565340371180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b91800640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x565341206c00 0x565340371180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565341207400 msgr2=0x565340370680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b91800640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x565341207400 0x565340370680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5653403169c0 con 0x565341207000 2024-04-02T07:34:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b91800640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565341207000 0x565340370c00 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x565341218810 tx=0x56534121cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b8a000640 1 -- 172.21.15.55:0/3668765100 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5653403371e0 con 0x565341207000 2024-04-02T07:34:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b8a000640 1 -- 172.21.15.55:0/3668765100 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5653410bd380 con 0x565341207000 2024-04-02T07:34:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b8a000640 1 -- 172.21.15.55:0/3668765100 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x565340336dc0 con 0x565341207000 2024-04-02T07:34:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x565340316b60 con 0x565341207000 2024-04-02T07:34:25.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565340316ea0 con 0x565341207000 2024-04-02T07:34:25.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.903+0000 7f2b936a78c0 4 datascan.init: resolving metadata pool 16 2024-04-02T07:34:25.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b8a000640 1 -- 172.21.15.55:0/3668765100 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x56534031a840 con 0x565341207000 2024-04-02T07:34:25.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b8a000640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5653405d3000 0x565340371700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b8a000640 1 -- 172.21.15.55:0/3668765100 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x565340322a80 con 0x565341207000 2024-04-02T07:34:25.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b936a78c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-02T07:34:25.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b936a78c0 4 datascan.main: data pool 'cephfs_data' has ID 17 2024-04-02T07:34:25.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b936a78c0 4 datascan.main: opening data pool 'cephfs_data' 2024-04-02T07:34:25.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x565341207800 0x565340370100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:1 16.14 16:287034c4:::1.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x565341207c00 con 0x565341207800 2024-04-02T07:34:25.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b92200640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5653405d3000 0x565340371700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b90e00640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x565341207800 0x565340370100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b90e00640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x565341207800 0x565340370100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b92200640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5653405d3000 0x565340371700 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x56534114d260 tx=0x56534121ccc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.0 v2:172.21.15.55:6800/27392 1 ==== osd_op_reply(1 1.00000000.inode [stat out=16b] v0'0 uv37 ondisk = 0) v8 ==== 160+0+16 (crc 0 0 0) 0x5653411f2b40 con 0x565341207800 2024-04-02T07:34:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x5653406c0000 0x56534036fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:2 16.1f 16:fe07bba1:::100.00000000.inode:head [stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406c0400 con 0x5653406c0000 2024-04-02T07:34:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b92200640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x5653406c0000 0x56534036fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b92200640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x5653406c0000 0x56534036fb80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.5 v2:172.21.15.106:6800/27676 1 ==== osd_op_reply(2 100.00000000.inode [stat out=16b] v0'0 uv3 ondisk = 0) v8 ==== 162+0+16 (crc 0 0 0) 0x5653411f2d80 con 0x5653406c0000 2024-04-02T07:34:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x5653406c0800 0x56534036f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:3 17.0 17:00000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406c0c00 con 0x5653406c0800 2024-04-02T07:34:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.907+0000 7f2b91800640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x5653406c0800 0x56534036f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.911+0000 7f2b91800640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x5653406c0800 0x56534036f600 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.911+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.7 v2:172.21.15.106:6824/27679 1 ==== osd_op_reply(3 [pgnls-filter start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653406c0800 2024-04-02T07:34:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.911+0000 7f2b8b400640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x5653406c1c00 0x5653406d6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.911+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:4 17.20 17:04000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406da000 con 0x5653406c1c00 2024-04-02T07:34:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.911+0000 7f2b90e00640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x5653406c1c00 0x5653406d6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.911+0000 7f2b90e00640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x5653406c1c00 0x5653406d6000 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.911+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.1 v2:172.21.15.55:6809/27391 1 ==== osd_op_reply(4 [pgnls-filter start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x5653406c1c00 2024-04-02T07:34:25.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.911+0000 7f2b8be00640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x5653410bf400 0x5653406d6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.911+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:5 17.10 17:08000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653410bf000 con 0x5653410bf400 2024-04-02T07:34:25.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.911+0000 7f2b92200640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x5653410bf400 0x5653406d6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.911+0000 7f2b92200640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x5653410bf400 0x5653406d6580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.911+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.3 v2:172.21.15.55:6824/27393 1 ==== osd_op_reply(5 [pgnls-filter start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653410bf400 2024-04-02T07:34:25.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.911+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:6 17.30 17:0c000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406da400 con 0x565341207800 2024-04-02T07:34:25.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.911+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.0 v2:172.21.15.55:6800/27392 2 ==== osd_op_reply(6 [pgnls-filter start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x565341207800 2024-04-02T07:34:25.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.911+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:7 17.8 17:10000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653410be800 con 0x5653406c0800 2024-04-02T07:34:25.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.911+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.7 v2:172.21.15.106:6824/27679 2 ==== osd_op_reply(7 [pgnls-filter start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653406c0800 2024-04-02T07:34:25.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.911+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:8 17.28 17:14000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406da000 con 0x5653410bf400 2024-04-02T07:34:25.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.911+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.3 v2:172.21.15.55:6824/27393 2 ==== osd_op_reply(8 [pgnls-filter start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653410bf400 2024-04-02T07:34:25.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.911+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:9 17.18 17:18000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653410bf000 con 0x565341207800 2024-04-02T07:34:25.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.0 v2:172.21.15.55:6800/27392 3 ==== osd_op_reply(9 [pgnls-filter start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x565341207800 2024-04-02T07:34:25.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:10 17.38 17:1c000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406da800 con 0x5653406c0800 2024-04-02T07:34:25.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.7 v2:172.21.15.106:6824/27679 3 ==== osd_op_reply(10 [pgnls-filter start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653406c0800 2024-04-02T07:34:25.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:11 17.4 17:20000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406c0400 con 0x565341207800 2024-04-02T07:34:25.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.0 v2:172.21.15.55:6800/27392 4 ==== osd_op_reply(11 [pgnls-filter start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x565341207800 2024-04-02T07:34:25.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:12 17.24 17:24000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x565341207c00 con 0x5653410bf400 2024-04-02T07:34:25.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.3 v2:172.21.15.55:6824/27393 3 ==== osd_op_reply(12 [pgnls-filter start_epoch 120 out=49b] v116'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653410bf400 2024-04-02T07:34:25.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:13 17.14 17:28000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653405d3c00 con 0x5653410bf400 2024-04-02T07:34:25.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.3 v2:172.21.15.55:6824/27393 4 ==== osd_op_reply(13 [pgnls-filter start_epoch 120 out=49b] v116'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653410bf400 2024-04-02T07:34:25.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:14 17.34 17:2c000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406c0c00 con 0x565341207800 2024-04-02T07:34:25.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.0 v2:172.21.15.55:6800/27392 5 ==== osd_op_reply(14 [pgnls-filter start_epoch 120 out=49b] v116'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x565341207800 2024-04-02T07:34:25.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:15 17.c 17:30000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406da800 con 0x5653406c0800 2024-04-02T07:34:25.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.7 v2:172.21.15.106:6824/27679 4 ==== osd_op_reply(15 [pgnls-filter start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653406c0800 2024-04-02T07:34:25.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b8b400640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x5653405d2c00 0x5653406d6b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:16 17.2c 17:34000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653405d2800 con 0x5653405d2c00 2024-04-02T07:34:25.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b91800640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x5653405d2c00 0x5653406d6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b91800640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x5653405d2c00 0x5653406d6b00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.4 v2:172.21.15.106:6801/27677 1 ==== osd_op_reply(16 [pgnls-filter start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653405d2c00 2024-04-02T07:34:25.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:17 17.1c 17:38000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406da000 con 0x5653406c1c00 2024-04-02T07:34:25.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.1 v2:172.21.15.55:6809/27391 2 ==== osd_op_reply(17 [pgnls-filter start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x5653406c1c00 2024-04-02T07:34:25.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.915+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:18 17.3c 17:3c000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653405d2400 con 0x565341207800 2024-04-02T07:34:25.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.0 v2:172.21.15.55:6800/27392 6 ==== osd_op_reply(18 [pgnls-filter start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x565341207800 2024-04-02T07:34:25.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:19 17.2 17:40000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406dac00 con 0x5653405d2c00 2024-04-02T07:34:25.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.4 v2:172.21.15.106:6801/27677 2 ==== osd_op_reply(19 [pgnls-filter start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653405d2c00 2024-04-02T07:34:25.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:20 17.22 17:44000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406da400 con 0x5653406c0000 2024-04-02T07:34:25.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.5 v2:172.21.15.106:6800/27676 2 ==== osd_op_reply(20 [pgnls-filter start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653406c0000 2024-04-02T07:34:25.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:21 17.12 17:48000000::::head [pgnls-filter start_epoch 120 in=89b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653410be800 con 0x5653410bf400 2024-04-02T07:34:25.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.3 v2:172.21.15.55:6824/27393 5 ==== osd_op_reply(21 [pgnls-filter start_epoch 120 out=81b] v120'23 uv23 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5653411f2d80 con 0x5653410bf400 2024-04-02T07:34:25.921 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:22 17.0 17:00000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406c1000 con 0x5653406c0800 2024-04-02T07:34:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.7 v2:172.21.15.106:6824/27679 5 ==== osd_op_reply(22 [pgnls-filter start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653406c0800 2024-04-02T07:34:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:23 17.20 17:04000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406da000 con 0x5653406c1c00 2024-04-02T07:34:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.1 v2:172.21.15.55:6809/27391 3 ==== osd_op_reply(23 [pgnls-filter start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x5653406c1c00 2024-04-02T07:34:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:24 17.10 17:08000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653405d2400 con 0x5653410bf400 2024-04-02T07:34:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.3 v2:172.21.15.55:6824/27393 6 ==== osd_op_reply(24 [pgnls-filter start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653410bf400 2024-04-02T07:34:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:25 17.30 17:0c000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406db000 con 0x565341207800 2024-04-02T07:34:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.0 v2:172.21.15.55:6800/27392 7 ==== osd_op_reply(25 [pgnls-filter start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x565341207800 2024-04-02T07:34:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:26 17.8 17:10000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406c0400 con 0x5653406c0800 2024-04-02T07:34:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.7 v2:172.21.15.106:6824/27679 6 ==== osd_op_reply(26 [pgnls-filter start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653406c0800 2024-04-02T07:34:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:27 17.28 17:14000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406db400 con 0x5653410bf400 2024-04-02T07:34:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.3 v2:172.21.15.55:6824/27393 7 ==== osd_op_reply(27 [pgnls-filter start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653410bf400 2024-04-02T07:34:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:28 17.18 17:18000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406c0c00 con 0x565341207800 2024-04-02T07:34:25.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.0 v2:172.21.15.55:6800/27392 8 ==== osd_op_reply(28 [pgnls-filter start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x565341207800 2024-04-02T07:34:25.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:29 17.38 17:1c000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406db800 con 0x5653406c0800 2024-04-02T07:34:25.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.7 v2:172.21.15.106:6824/27679 7 ==== osd_op_reply(29 [pgnls-filter start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653406c0800 2024-04-02T07:34:25.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.919+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:30 17.4 17:20000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653410bf000 con 0x565341207800 2024-04-02T07:34:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.0 v2:172.21.15.55:6800/27392 9 ==== osd_op_reply(30 [pgnls-filter start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x565341207800 2024-04-02T07:34:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:31 17.24 17:24000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406dbc00 con 0x5653410bf400 2024-04-02T07:34:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.3 v2:172.21.15.55:6824/27393 8 ==== osd_op_reply(31 [pgnls-filter start_epoch 120 out=49b] v116'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653410bf400 2024-04-02T07:34:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:32 17.14 17:28000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653405d3c00 con 0x5653410bf400 2024-04-02T07:34:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.3 v2:172.21.15.55:6824/27393 9 ==== osd_op_reply(32 [pgnls-filter start_epoch 120 out=49b] v116'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653410bf400 2024-04-02T07:34:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:33 17.34 17:2c000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406f2000 con 0x565341207800 2024-04-02T07:34:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.0 v2:172.21.15.55:6800/27392 10 ==== osd_op_reply(33 [pgnls-filter start_epoch 120 out=49b] v116'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x565341207800 2024-04-02T07:34:25.927 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:34 17.c 17:30000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653405d2400 con 0x5653406c0800 2024-04-02T07:34:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.7 v2:172.21.15.106:6824/27679 8 ==== osd_op_reply(34 [pgnls-filter start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653406c0800 2024-04-02T07:34:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:35 17.2c 17:34000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406f2400 con 0x5653405d2c00 2024-04-02T07:34:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.4 v2:172.21.15.106:6801/27677 3 ==== osd_op_reply(35 [pgnls-filter start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653405d2c00 2024-04-02T07:34:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:36 17.1c 17:38000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653410be800 con 0x5653406c1c00 2024-04-02T07:34:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.1 v2:172.21.15.55:6809/27391 4 ==== osd_op_reply(36 [pgnls-filter start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x5653406c1c00 2024-04-02T07:34:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:37 17.3c 17:3c000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406f2800 con 0x565341207800 2024-04-02T07:34:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.0 v2:172.21.15.55:6800/27392 11 ==== osd_op_reply(37 [pgnls-filter start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x565341207800 2024-04-02T07:34:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:38 17.2 17:40000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406da400 con 0x5653405d2c00 2024-04-02T07:34:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.4 v2:172.21.15.106:6801/27677 4 ==== osd_op_reply(38 [pgnls-filter start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653405d2c00 2024-04-02T07:34:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:39 17.22 17:44000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406f2c00 con 0x5653406c0000 2024-04-02T07:34:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.5 v2:172.21.15.106:6800/27676 3 ==== osd_op_reply(39 [pgnls-filter start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653406c0000 2024-04-02T07:34:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:40 17.12 17:48000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x565341207c00 con 0x5653410bf400 2024-04-02T07:34:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.3 v2:172.21.15.55:6824/27393 10 ==== osd_op_reply(40 [pgnls-filter start_epoch 120 out=49b] v120'23 uv23 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653410bf400 2024-04-02T07:34:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:41 17.32 17:4c000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406f3000 con 0x5653406c0800 2024-04-02T07:34:25.928 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.7 v2:172.21.15.106:6824/27679 9 ==== osd_op_reply(41 [pgnls-filter start_epoch 120 out=49b] v116'15 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653406c0800 2024-04-02T07:34:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.923+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:42 17.a 17:50000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406da000 con 0x5653406c0800 2024-04-02T07:34:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.7 v2:172.21.15.106:6824/27679 10 ==== osd_op_reply(42 [pgnls-filter start_epoch 120 out=49b] v116'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653406c0800 2024-04-02T07:34:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:43 17.2a 17:54000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406f3400 con 0x5653410bf400 2024-04-02T07:34:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.3 v2:172.21.15.55:6824/27393 11 ==== osd_op_reply(43 [pgnls-filter start_epoch 120 out=49b] v116'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653410bf400 2024-04-02T07:34:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:44 17.1a 17:58000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406db000 con 0x565341207800 2024-04-02T07:34:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.0 v2:172.21.15.55:6800/27392 12 ==== osd_op_reply(44 [pgnls-filter start_epoch 120 out=49b] v116'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x565341207800 2024-04-02T07:34:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:45 17.3a 17:5c000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653405d3c00 con 0x5653406c1c00 2024-04-02T07:34:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.1 v2:172.21.15.55:6809/27391 5 ==== osd_op_reply(45 [pgnls-filter start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x5653406c1c00 2024-04-02T07:34:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b8b400640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x5653406c0c00 0x5653406d7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:46 17.6 17:60000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406c1000 con 0x5653406c0c00 2024-04-02T07:34:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b90e00640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x5653406c0c00 0x5653406d7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b90e00640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x5653406c0c00 0x5653406d7080 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.6 v2:172.21.15.106:6816/27678 1 ==== osd_op_reply(46 [pgnls-filter start_epoch 120 out=49b] v116'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x5653406c0c00 2024-04-02T07:34:25.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:47 17.26 17:64000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406db400 con 0x565341207800 2024-04-02T07:34:25.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.0 v2:172.21.15.55:6800/27392 13 ==== osd_op_reply(47 [pgnls-filter start_epoch 120 out=49b] v116'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x565341207800 2024-04-02T07:34:25.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:48 17.16 17:68000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406c0400 con 0x5653406c0000 2024-04-02T07:34:25.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.5 v2:172.21.15.106:6800/27676 4 ==== osd_op_reply(48 [pgnls-filter start_epoch 120 out=49b] v116'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653406c0000 2024-04-02T07:34:25.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:49 17.36 17:6c000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406dbc00 con 0x565341207800 2024-04-02T07:34:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.0 v2:172.21.15.55:6800/27392 14 ==== osd_op_reply(49 [pgnls-filter start_epoch 120 out=81b] v120'34 uv34 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5653411f2b40 con 0x565341207800 2024-04-02T07:34:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b936a78c0 20 datascan.forall_objects: OSD matched oid 100000001f7.00000000 2024-04-02T07:34:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b936a78c0 10 datascan.operator(): handling object 100000001f7.0 2024-04-02T07:34:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.927+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:50 17.36 17:6fe38dc2:::100000001f7.00000000:head [getxattr scan_ceiling in=12b,getxattr scan_max_size in=13b,getxattr scan_max_mtime in=14b,getxattr scan_pool_id in=12b,getxattr parent in=6b,getxattr layout in=6b,getxattr symlink in=7b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406c1400 con 0x565341207800 2024-04-02T07:34:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.0 v2:172.21.15.55:6800/27392 15 ==== osd_op_reply(50 100000001f7.00000000 [getxattr (22) out=22b,getxattr (8) out=8b,getxattr (8) out=8b,getxattr,getxattr (126) out=126b,getxattr (30) out=30b,getxattr] v0'0 uv34 ondisk = 0) v8 ==== 416+0+194 (crc 0 0 0) 0x5653411f2b40 con 0x565341207800 2024-04-02T07:34:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b936a78c0 10 datascan.inject_with_backtrace: inode: 0x0x100000001f7 2024-04-02T07:34:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b936a78c0 10 datascan.inject_with_backtrace: backptr: 0x0x10000000001/bravo 2024-04-02T07:34:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b936a78c0 20 datascan.get_frag_of: dirino=0x10000000001 target_dname=bravo 2024-04-02T07:34:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:51 16.7 16:e2e07930:::10000000001.00000000:head [getxattr parent in=6b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406c1800 con 0x5653410bf400 2024-04-02T07:34:25.934 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.3 v2:172.21.15.55:6824/27393 12 ==== osd_op_reply(51 10000000001.00000000 [getxattr (95) out=95b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+95 (crc 0 0 0) 0x5653411f2d80 con 0x5653410bf400 2024-04-02T07:34:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b936a78c0 20 datascan.get_frag_of: got backtrace parent 0x10000000000/flushed 2024-04-02T07:34:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x5653406f2c00 0x5653406d7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:52 16.10 16:0cf6ad0f:::10000000000.00000000:head [omap-get-vals-by-keys in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406f3400 con 0x5653406f2c00 2024-04-02T07:34:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b92200640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x5653406f2c00 0x5653406d7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b92200640 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x5653406f2c00 0x5653406d7b80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.2 v2:172.21.15.55:6808/27394 1 ==== osd_op_reply(52 10000000000.00000000 [omap-get-vals-by-keys out=524b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+524 (crc 0 0 0) 0x5653411f2d80 con 0x5653406f2c00 2024-04-02T07:34:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b936a78c0 20 datascan.read_dentry: oid=10000000000.00000000 dname=flushed frag=*, r=0 2024-04-02T07:34:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b936a78c0 20 datascan.get_frag_of: fast path, fragtree is fragtree_t() 2024-04-02T07:34:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b936a78c0 20 datascan.get_frag_of: frag is * 2024-04-02T07:34:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:53 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-header] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406f2000 con 0x5653410bf400 2024-04-02T07:34:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.3 v2:172.21.15.55:6824/27393 13 ==== osd_op_reply(53 10000000001.00000000 [omap-get-header out=274b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+274 (crc 0 0 0) 0x5653411f2d80 con 0x5653410bf400 2024-04-02T07:34:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b936a78c0 10 datascan.find_or_create_dirfrag: read_version = 8 2024-04-02T07:34:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b936a78c0 20 datascan.find_or_create_dirfrag: Dirfrag already exists: 0x0x10000000001 * 2024-04-02T07:34:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:54 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406f2800 con 0x5653410bf400 2024-04-02T07:34:25.935 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.3 v2:172.21.15.55:6824/27393 14 ==== osd_op_reply(54 10000000001.00000000 [omap-get-vals-by-keys out=4b] v0'0 uv8 ondisk = 0) v8 ==== 164+0+4 (crc 0 0 0) 0x5653411f2d80 con 0x5653410bf400 2024-04-02T07:34:25.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b936a78c0 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-04-02T07:34:25.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b936a78c0 20 datascan.read_dentry: bravo_head not found in result 2024-04-02T07:34:25.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b936a78c0 10 datascan.inject_with_backtrace: Linking inode 0x0x100000001f7 at 0x0x10000000001/bravo with size=5 bytes 2024-04-02T07:34:25.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:55 16.7 16:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406f3800 con 0x5653410bf400 2024-04-02T07:34:25.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.3 v2:172.21.15.55:6824/27393 15 ==== osd_op_reply(55 10000000001.00000000 [omap-set-vals] v120'9 uv9 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5653411f2d80 con 0x5653410bf400 2024-04-02T07:34:25.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b936a78c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x100000001f7 2024-04-02T07:34:25.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.931+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:56 17.e 17:70000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406f3c00 con 0x5653406f2c00 2024-04-02T07:34:25.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.2 v2:172.21.15.55:6808/27394 2 ==== osd_op_reply(56 [pgnls-filter start_epoch 120 out=49b] v116'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653406f2c00 2024-04-02T07:34:25.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:57 17.2e 17:74000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406da800 con 0x5653406c0c00 2024-04-02T07:34:25.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.6 v2:172.21.15.106:6816/27678 2 ==== osd_op_reply(57 [pgnls-filter start_epoch 120 out=49b] v116'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x5653406c0c00 2024-04-02T07:34:25.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:58 17.1e 17:78000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653410bf000 con 0x5653406c1c00 2024-04-02T07:34:25.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.1 v2:172.21.15.55:6809/27391 6 ==== osd_op_reply(58 [pgnls-filter start_epoch 120 out=49b] v116'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x5653406c1c00 2024-04-02T07:34:25.936 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:59 17.3e 17:7c000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406dac00 con 0x5653405d2c00 2024-04-02T07:34:25.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.4 v2:172.21.15.106:6801/27677 5 ==== osd_op_reply(59 [pgnls-filter start_epoch 120 out=49b] v116'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653405d2c00 2024-04-02T07:34:25.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:60 17.1 17:80000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653410be800 con 0x565341207800 2024-04-02T07:34:25.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.0 v2:172.21.15.55:6800/27392 16 ==== osd_op_reply(60 [pgnls-filter start_epoch 120 out=49b] v116'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x565341207800 2024-04-02T07:34:25.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:61 17.21 17:84000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406db800 con 0x5653406f2c00 2024-04-02T07:34:25.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.2 v2:172.21.15.55:6808/27394 3 ==== osd_op_reply(61 [pgnls-filter start_epoch 120 out=49b] v116'24 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653406f2c00 2024-04-02T07:34:25.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:62 17.11 17:88000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406c1000 con 0x5653410bf400 2024-04-02T07:34:25.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.3 v2:172.21.15.55:6824/27393 16 ==== osd_op_reply(62 [pgnls-filter start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653410bf400 2024-04-02T07:34:25.937 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:63 17.31 17:8c000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x565341207c00 con 0x5653406c1c00 2024-04-02T07:34:25.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.1 v2:172.21.15.55:6809/27391 7 ==== osd_op_reply(63 [pgnls-filter start_epoch 120 out=49b] v116'15 uv8 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x5653406c1c00 2024-04-02T07:34:25.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:64 17.9 17:90000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406c1400 con 0x5653410bf400 2024-04-02T07:34:25.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.3 v2:172.21.15.55:6824/27393 17 ==== osd_op_reply(64 [pgnls-filter start_epoch 120 out=49b] v116'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653410bf400 2024-04-02T07:34:25.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:65 17.29 17:94000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406f3400 con 0x5653405d2c00 2024-04-02T07:34:25.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.4 v2:172.21.15.106:6801/27677 6 ==== osd_op_reply(65 [pgnls-filter start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653405d2c00 2024-04-02T07:34:25.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:66 17.19 17:98000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653410bf000 con 0x5653406c0000 2024-04-02T07:34:25.940 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.5 v2:172.21.15.106:6800/27676 5 ==== osd_op_reply(66 [pgnls-filter start_epoch 120 out=49b] v120'24 uv24 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653406c0000 2024-04-02T07:34:25.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.935+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:67 17.39 17:9c000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406f2000 con 0x5653406c0000 2024-04-02T07:34:25.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.939+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.5 v2:172.21.15.106:6800/27676 6 ==== osd_op_reply(67 [pgnls-filter start_epoch 120 out=49b] v116'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653406c0000 2024-04-02T07:34:25.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.939+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:68 17.5 17:a0000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406db000 con 0x5653406c0c00 2024-04-02T07:34:25.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.939+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.6 v2:172.21.15.106:6816/27678 3 ==== osd_op_reply(68 [pgnls-filter start_epoch 120 out=49b] v120'15 uv15 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x5653406c0c00 2024-04-02T07:34:25.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.939+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:69 17.25 17:a4000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406f2800 con 0x5653406c1c00 2024-04-02T07:34:25.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.939+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.1 v2:172.21.15.55:6809/27391 8 ==== osd_op_reply(69 [pgnls-filter start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x5653406c1c00 2024-04-02T07:34:25.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.939+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:70 17.15 17:a8000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406db400 con 0x5653406c0000 2024-04-02T07:34:25.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.939+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.5 v2:172.21.15.106:6800/27676 7 ==== osd_op_reply(70 [pgnls-filter start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653406c0000 2024-04-02T07:34:25.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.939+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:71 17.35 17:ac000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406f3800 con 0x5653405d2c00 2024-04-02T07:34:25.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.939+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.4 v2:172.21.15.106:6801/27677 7 ==== osd_op_reply(71 [pgnls-filter start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653405d2c00 2024-04-02T07:34:25.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.939+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:72 17.d 17:b0000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406dbc00 con 0x5653406c0800 2024-04-02T07:34:25.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.939+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.7 v2:172.21.15.106:6824/27679 11 ==== osd_op_reply(72 [pgnls-filter start_epoch 120 out=49b] v116'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653406c0800 2024-04-02T07:34:25.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.939+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:73 17.2d 17:b4000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406f3c00 con 0x5653406c0800 2024-04-02T07:34:25.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.939+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.7 v2:172.21.15.106:6824/27679 12 ==== osd_op_reply(73 [pgnls-filter start_epoch 120 out=49b] v116'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653406c0800 2024-04-02T07:34:25.941 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.939+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:74 17.1d 17:b8000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406da800 con 0x5653406c0800 2024-04-02T07:34:25.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.939+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.7 v2:172.21.15.106:6824/27679 13 ==== osd_op_reply(74 [pgnls-filter start_epoch 120 out=49b] v116'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653406c0800 2024-04-02T07:34:25.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.939+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:75 17.3d 17:bc000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406c0400 con 0x5653406c0800 2024-04-02T07:34:25.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.939+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.7 v2:172.21.15.106:6824/27679 14 ==== osd_op_reply(75 [pgnls-filter start_epoch 120 out=49b] v116'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653406c0800 2024-04-02T07:34:25.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.939+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:76 17.3 17:c0000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653405d3c00 con 0x5653405d2c00 2024-04-02T07:34:25.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.939+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.4 v2:172.21.15.106:6801/27677 8 ==== osd_op_reply(76 [pgnls-filter start_epoch 120 out=49b] v116'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653405d2c00 2024-04-02T07:34:25.942 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.939+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:77 17.23 17:c4000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406c1800 con 0x5653405d2c00 2024-04-02T07:34:25.944 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.943+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.4 v2:172.21.15.106:6801/27677 9 ==== osd_op_reply(77 [pgnls-filter start_epoch 120 out=49b] v116'14 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653405d2c00 2024-04-02T07:34:25.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.943+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:78 17.13 17:c8000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406da400 con 0x5653410bf400 2024-04-02T07:34:25.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.943+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.3 v2:172.21.15.55:6824/27393 18 ==== osd_op_reply(78 [pgnls-filter start_epoch 120 out=49b] v116'30 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653410bf400 2024-04-02T07:34:25.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.943+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:79 17.33 17:cc000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x56534070c000 con 0x5653406c0800 2024-04-02T07:34:25.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.943+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.7 v2:172.21.15.106:6824/27679 15 ==== osd_op_reply(79 [pgnls-filter start_epoch 120 out=49b] v116'20 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653406c0800 2024-04-02T07:34:25.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.943+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:80 17.b 17:d0000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406da000 con 0x565341207800 2024-04-02T07:34:25.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.943+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.0 v2:172.21.15.55:6800/27392 17 ==== osd_op_reply(80 [pgnls-filter start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x565341207800 2024-04-02T07:34:25.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.943+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:81 17.2b 17:d4000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x56534070c400 con 0x5653405d2c00 2024-04-02T07:34:25.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.943+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.4 v2:172.21.15.106:6801/27677 10 ==== osd_op_reply(81 [pgnls-filter start_epoch 120 out=49b] v116'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653405d2c00 2024-04-02T07:34:25.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.943+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:82 17.1b 17:d8000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406dac00 con 0x5653405d2c00 2024-04-02T07:34:25.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.943+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.4 v2:172.21.15.106:6801/27677 11 ==== osd_op_reply(82 [pgnls-filter start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653405d2c00 2024-04-02T07:34:25.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.943+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:83 17.3b 17:dc000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x56534070c800 con 0x5653406f2c00 2024-04-02T07:34:25.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.943+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.2 v2:172.21.15.55:6808/27394 4 ==== osd_op_reply(83 [pgnls-filter start_epoch 120 out=49b] v116'8 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653406f2c00 2024-04-02T07:34:25.945 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.943+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:84 17.7 17:e0000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406dbc00 con 0x5653406c0000 2024-04-02T07:34:25.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.943+0000 7f2b92200640 1 -- 172.21.15.55:0/3668765100 <== osd.5 v2:172.21.15.106:6800/27676 8 ==== osd_op_reply(84 [pgnls-filter start_epoch 120 out=49b] v116'10 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2d80 con 0x5653406c0000 2024-04-02T07:34:25.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.943+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:85 17.27 17:e4000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x56534070cc00 con 0x5653405d2c00 2024-04-02T07:34:25.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.943+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.4 v2:172.21.15.106:6801/27677 12 ==== osd_op_reply(85 [pgnls-filter start_epoch 120 out=49b] v116'4 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653405d2c00 2024-04-02T07:34:25.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.943+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:86 17.17 17:e8000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406f2400 con 0x5653406c0c00 2024-04-02T07:34:25.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.6 v2:172.21.15.106:6816/27678 4 ==== osd_op_reply(86 [pgnls-filter start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x5653406c0c00 2024-04-02T07:34:25.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:87 17.37 17:ec000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x56534070d000 con 0x565341207800 2024-04-02T07:34:25.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.0 v2:172.21.15.55:6800/27392 18 ==== osd_op_reply(87 [pgnls-filter start_epoch 120 out=49b] v116'22 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x565341207800 2024-04-02T07:34:25.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:88 17.f 17:f0000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406f3000 con 0x5653406c1c00 2024-04-02T07:34:25.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.1 v2:172.21.15.55:6809/27391 9 ==== osd_op_reply(88 [pgnls-filter start_epoch 120 out=49b] v116'18 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x5653406c1c00 2024-04-02T07:34:25.946 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:89 17.2f 17:f4000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x56534070d400 con 0x5653405d2c00 2024-04-02T07:34:25.948 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b91800640 1 -- 172.21.15.55:0/3668765100 <== osd.4 v2:172.21.15.106:6801/27677 13 ==== osd_op_reply(89 [pgnls-filter start_epoch 120 out=49b] v116'16 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2fc0 con 0x5653405d2c00 2024-04-02T07:34:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b8b400640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:90 17.1f 17:f8000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5653406f3400 con 0x5653406c0c00 2024-04-02T07:34:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.6 v2:172.21.15.106:6816/27678 5 ==== osd_op_reply(90 [pgnls-filter start_epoch 120 out=49b] v116'12 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x5653406c0c00 2024-04-02T07:34:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b8be00640 1 -- 172.21.15.55:0/3668765100 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:91 17.3f 17:fc000000::::head [pgnls-filter start_epoch 120 in=93b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x56534070d800 con 0x565341207800 2024-04-02T07:34:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 <== osd.0 v2:172.21.15.55:6800/27392 19 ==== osd_op_reply(91 [pgnls-filter start_epoch 120 out=49b] v116'17 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5653411f2b40 con 0x565341207800 2024-04-02T07:34:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x565341207800 msgr2=0x565340370100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x565341207800 0x565340370100 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x5653406c1c00 msgr2=0x5653406d6000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x5653406c1c00 0x5653406d6000 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x5653406f2c00 msgr2=0x5653406d7b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x5653406f2c00 0x5653406d7b80 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x5653410bf400 msgr2=0x5653406d6580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x5653410bf400 0x5653406d6580 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x5653405d2c00 msgr2=0x5653406d6b00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x5653405d2c00 0x5653406d6b00 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x5653406c0000 msgr2=0x56534036fb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x5653406c0000 0x56534036fb80 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x5653406c0c00 msgr2=0x5653406d7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x5653406c0c00 0x5653406d7080 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x5653406c0800 msgr2=0x56534036f600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x5653406c0800 0x56534036f600 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 reap_dead start 2024-04-02T07:34:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 reap_dead start 2024-04-02T07:34:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b90e00640 1 -- 172.21.15.55:0/3668765100 reap_dead start 2024-04-02T07:34:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5653405d3000 msgr2=0x565340371700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5653405d3000 0x565340371700 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x56534114d260 tx=0x56534121ccc0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565341207000 msgr2=0x565340370c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.950 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565341207000 0x565340370c00 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x565341218810 tx=0x56534121cc00 comp rx=0 tx=0).stop 2024-04-02T07:34:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 shutdown_connections 2024-04-02T07:34:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5653405d3000 0x565340371700 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/3668765100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x565341207000 0x565340370c00 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 >> 172.21.15.55:0/3668765100 conn(0x5653402e2c00 msgr2=0x56534030f800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 shutdown_connections 2024-04-02T07:34:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 -- 172.21.15.55:0/3668765100 wait complete. 2024-04-02T07:34:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 -- 172.21.15.55:0/1465059404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5653402e3800 msgr2=0x56534036e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/1465059404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5653402e3800 0x56534036e580 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x56534114d2c0 tx=0x5653411f8360 comp rx=0 tx=0).stop 2024-04-02T07:34:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 -- 172.21.15.55:0/1465059404 shutdown_connections 2024-04-02T07:34:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/1465059404 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5653402e3000 0x56534036f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/1465059404 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5653402e3400 0x56534036eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 --2- 172.21.15.55:0/1465059404 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5653402e3800 0x56534036e580 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 -- 172.21.15.55:0/1465059404 >> 172.21.15.55:0/1465059404 conn(0x5653402e3c00 msgr2=0x56534030f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:25.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 -- 172.21.15.55:0/1465059404 shutdown_connections 2024-04-02T07:34:25.952 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:25.947+0000 7f2b936a78c0 1 -- 172.21.15.55:0/1465059404 wait complete. 2024-04-02T07:34:25.952 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_inodes', '--filter-tag', 'mytag123', 'cephfs_data'] in time 0:00:00.148155, result: 2024-04-02T07:34:25.953 DEBUG:teuthology.orchestra.run.smithi055:> cephfs-data-scan --debug-mds=20 --debug-ms=1 --debug-objecter=1 scan_links 2024-04-02T07:34:26.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb4d3e8c0 1 -- start start 2024-04-02T07:34:26.037 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb4d3e8c0 1 Processor -- start 2024-04-02T07:34:26.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb4d3e8c0 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5613d53db800 0x5613d5466580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb4d3e8c0 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5613d53db400 0x5613d5466b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb4d3e8c0 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5613d53db000 0x5613d5467080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb4d3e8c0 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613d54a8a00 con 0x5613d53db000 2024-04-02T07:34:26.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb4d3e8c0 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613d54a8780 con 0x5613d53db800 2024-04-02T07:34:26.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb4d3e8c0 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5613d54a8640 con 0x5613d53db400 2024-04-02T07:34:26.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb3800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5613d53db000 0x5613d5467080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb3800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5613d53db000 0x5613d5467080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33906/0 (socket says 172.21.15.55:33906) 2024-04-02T07:34:26.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb3800640 1 -- 172.21.15.55:0/3456910557 learned_addr learned my addr 172.21.15.55:0/3456910557 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:26.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb2e00640 1 --2- 172.21.15.55:0/3456910557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5613d53db800 0x5613d5466580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb2400640 1 --2- 172.21.15.55:0/3456910557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5613d53db400 0x5613d5466b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb3800640 1 -- 172.21.15.55:0/3456910557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5613d53db400 msgr2=0x5613d5466b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:26.040 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb3800640 1 --2- 172.21.15.55:0/3456910557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5613d53db400 0x5613d5466b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb3800640 1 -- 172.21.15.55:0/3456910557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5613d53db800 msgr2=0x5613d5466580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:26.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb3800640 1 --2- 172.21.15.55:0/3456910557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5613d53db800 0x5613d5466580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb3800640 1 -- 172.21.15.55:0/3456910557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613d540e9c0 con 0x5613d53db000 2024-04-02T07:34:26.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb3800640 1 --2- 172.21.15.55:0/3456910557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5613d53db000 0x5613d5467080 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x5613d6241380 tx=0x5613d619cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c3ac62b7c664c27 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:26.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bafc00640 1 -- 172.21.15.55:0/3456910557 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5613d542f600 con 0x5613d53db000 2024-04-02T07:34:26.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bafc00640 1 -- 172.21.15.55:0/3456910557 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5613d5438480 con 0x5613d53db000 2024-04-02T07:34:26.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bafc00640 1 -- 172.21.15.55:0/3456910557 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5613d542f1e0 con 0x5613d53db000 2024-04-02T07:34:26.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/3456910557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613d540eb60 con 0x5613d53db000 2024-04-02T07:34:26.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/3456910557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({fsmap=0}) v3 -- 0x5613d540e340 con 0x5613d53db000 2024-04-02T07:34:26.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb4d3e8c0 4 waiting for MDS map... 2024-04-02T07:34:26.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bafc00640 1 -- 172.21.15.55:0/3456910557 <== mon.0 v2:172.21.15.55:3300/0 4 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x5613d541ac40 con 0x5613d53db000 2024-04-02T07:34:26.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bafc00640 1 -- 172.21.15.55:0/3456910557 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 103) v1 ==== 2573+0+0 (secure 0 0 0) 0x5613d5428f00 con 0x5613d53db000 2024-04-02T07:34:26.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb4d3e8c0 4 Got MDS map 103 2024-04-02T07:34:26.041 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb4d3e8c0 4 datascan.main: Using metadata pool output 2024-04-02T07:34:26.042 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.039+0000 7f6bb4d3e8c0 4 datascan.main: connecting to RADOS... 2024-04-02T07:34:26.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb4d3e8c0 1 Processor -- start 2024-04-02T07:34:26.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb4d3e8c0 1 -- start start 2024-04-02T07:34:26.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb4d3e8c0 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5613d62e8c00 0x5613d5467600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb4d3e8c0 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5613d62e9000 0x5613d5467b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb4d3e8c0 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5613d62e9400 0x5613d5468100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb4d3e8c0 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613d5421e00 con 0x5613d62e9400 2024-04-02T07:34:26.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb4d3e8c0 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613d54a8780 con 0x5613d62e8c00 2024-04-02T07:34:26.045 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb4d3e8c0 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5613d54a8500 con 0x5613d62e9000 2024-04-02T07:34:26.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb2400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5613d62e9400 0x5613d5468100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb2400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5613d62e8c00 0x5613d5467600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb2e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5613d62e9000 0x5613d5467b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb2400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5613d62e8c00 0x5613d5467600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:45954/0 (socket says 172.21.15.55:45954) 2024-04-02T07:34:26.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb2400640 1 -- 172.21.15.55:0/3378879835 learned_addr learned my addr 172.21.15.55:0/3378879835 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:26.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb2400640 1 -- 172.21.15.55:0/3378879835 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5613d62e9000 msgr2=0x5613d5467b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:26.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb2400640 1 --2- 172.21.15.55:0/3378879835 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5613d62e9000 0x5613d5467b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb2400640 1 -- 172.21.15.55:0/3378879835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5613d62e9400 msgr2=0x5613d5468100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:26.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb2400640 1 --2- 172.21.15.55:0/3378879835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5613d62e9400 0x5613d5468100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb2400640 1 -- 172.21.15.55:0/3378879835 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613d540e000 con 0x5613d62e8c00 2024-04-02T07:34:26.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb2e00640 1 --2- 172.21.15.55:0/3378879835 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5613d62e9000 0x5613d5467b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:34:26.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb2400640 1 --2- 172.21.15.55:0/3378879835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5613d62e8c00 0x5613d5467600 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x5613d62fa690 tx=0x5613d62fecc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f731fc9c88baea6f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:26.046 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bad400640 1 -- 172.21.15.55:0/3378879835 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5613d542f600 con 0x5613d62e8c00 2024-04-02T07:34:26.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bad400640 1 -- 172.21.15.55:0/3378879835 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5613d61b4f00 con 0x5613d62e8c00 2024-04-02T07:34:26.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bad400640 1 -- 172.21.15.55:0/3378879835 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5613d542f1e0 con 0x5613d62e8c00 2024-04-02T07:34:26.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/3378879835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5613d62e8c00 msgr2=0x5613d5467600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:26.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/3378879835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5613d62e8c00 0x5613d5467600 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x5613d62fa690 tx=0x5613d62fecc0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/3378879835 shutdown_connections 2024-04-02T07:34:26.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/3378879835 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5613d62e9400 0x5613d5468100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/3378879835 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5613d62e9000 0x5613d5467b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/3378879835 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5613d62e8c00 0x5613d5467600 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/3378879835 >> 172.21.15.55:0/3378879835 conn(0x5613d53dac00 msgr2=0x5613d5407800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:26.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/3378879835 shutdown_connections 2024-04-02T07:34:26.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/3378879835 wait complete. 2024-04-02T07:34:26.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb4d3e8c0 1 Processor -- start 2024-04-02T07:34:26.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.043+0000 7f6bb4d3e8c0 1 -- start start 2024-04-02T07:34:26.047 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bb4d3e8c0 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5613d62e8c00 0x5613d5469180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bb4d3e8c0 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5613d62e9000 0x5613d5468c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bb4d3e8c0 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5613d62e9400 0x5613d5468680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bb4d3e8c0 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613d54a83c0 con 0x5613d62e8c00 2024-04-02T07:34:26.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bb4d3e8c0 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5613d54a8280 con 0x5613d62e9000 2024-04-02T07:34:26.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bb4d3e8c0 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5613d54a8140 con 0x5613d62e9400 2024-04-02T07:34:26.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bb2400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5613d62e8c00 0x5613d5469180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bb2400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5613d62e8c00 0x5613d5469180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33920/0 (socket says 172.21.15.55:33920) 2024-04-02T07:34:26.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 learned_addr learned my addr 172.21.15.55:0/2682481101 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:26.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bb2e00640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5613d62e9000 0x5613d5468c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bb2400640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5613d62e9400 0x5613d5468680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5613d62e9400 msgr2=0x5613d5468680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:26.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bb2400640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5613d62e9400 0x5613d5468680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.048 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5613d62e9000 msgr2=0x5613d5468c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:26.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bb2400640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5613d62e9000 0x5613d5468c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5613d540e9c0 con 0x5613d62e8c00 2024-04-02T07:34:26.049 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bb2400640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5613d62e8c00 0x5613d5469180 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x5613d62fb350 tx=0x5613d62fec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:26.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bab600640 1 -- 172.21.15.55:0/2682481101 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5613d542edc0 con 0x5613d62e8c00 2024-04-02T07:34:26.053 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x5613d540eb60 con 0x5613d62e8c00 2024-04-02T07:34:26.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bab600640 1 -- 172.21.15.55:0/2682481101 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5613d61b5080 con 0x5613d62e8c00 2024-04-02T07:34:26.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bab600640 1 -- 172.21.15.55:0/2682481101 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x5613d542f600 con 0x5613d62e8c00 2024-04-02T07:34:26.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5613d540eea0 con 0x5613d62e8c00 2024-04-02T07:34:26.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bb4d3e8c0 4 datascan.init: resolving metadata pool 16 2024-04-02T07:34:26.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bab600640 1 -- 172.21.15.55:0/2682481101 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x5613d5412840 con 0x5613d62e8c00 2024-04-02T07:34:26.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bab600640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5613d6364c00 0x5613d5469700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.047+0000 7f6bab600640 1 -- 172.21.15.55:0/2682481101 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x5613d541aa80 con 0x5613d62e8c00 2024-04-02T07:34:26.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb4d3e8c0 4 datascan.init: found metadata pool 'cephfs_metadata' 2024-04-02T07:34:26.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb4d3e8c0 4 datascan.main: resolving metadata pool 16 2024-04-02T07:34:26.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x5613d62e9800 0x5613d5468100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.054 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:1 16.0 16:00000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d62e9c00 con 0x5613d62e9800 2024-04-02T07:34:26.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb2e00640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5613d6364c00 0x5613d5469700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb2400640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x5613d62e9800 0x5613d5468100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb2400640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x5613d62e9800 0x5613d5468100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:26.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb2e00640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5613d6364c00 0x5613d5469700 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x5613d54a7e00 tx=0x5613d62ffda0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:26.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.0 v2:172.21.15.55:6800/27392 1 ==== osd_op_reply(1 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d62e9800 2024-04-02T07:34:26.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb2400640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x5613d62e9c00 0x5613d57be000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:2 16.10 16:08000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d6365000 con 0x5613d62e9c00 2024-04-02T07:34:26.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb3800640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x5613d62e9c00 0x5613d57be000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb3800640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x5613d62e9c00 0x5613d57be000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:26.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 1 ==== osd_op_reply(2 [pgnls start_epoch 120 out=177b] v119'16 uv16 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.055 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:3 16.8 16:10000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d6365000 con 0x5613d62e9800 2024-04-02T07:34:26.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.0 v2:172.21.15.55:6800/27392 2 ==== osd_op_reply(3 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d62e9800 2024-04-02T07:34:26.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:4 16.18 16:18000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d6365000 con 0x5613d62e9800 2024-04-02T07:34:26.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.0 v2:172.21.15.55:6800/27392 3 ==== osd_op_reply(4 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d62e9800 2024-04-02T07:34:26.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb2400640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x5613d6365000 0x5613d57be580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:5 16.4 16:20000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d6365400 con 0x5613d6365000 2024-04-02T07:34:26.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb2e00640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x5613d6365000 0x5613d57be580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb2e00640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x5613d6365000 0x5613d57be580 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:26.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.3 v2:172.21.15.55:6824/27393 1 ==== osd_op_reply(5 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d6365000 2024-04-02T07:34:26.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.051+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:6 16.14 16:28000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d6365400 con 0x5613d62e9800 2024-04-02T07:34:26.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.055+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.0 v2:172.21.15.55:6800/27392 4 ==== osd_op_reply(6 [pgnls start_epoch 120 out=149b] v120'43 uv43 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d62e9800 2024-04-02T07:34:26.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.055+0000 7f6bb2400640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x5613d6365400 0x5613d57beb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.055+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:7 16.c 16:30000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d6365800 con 0x5613d6365400 2024-04-02T07:34:26.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.055+0000 7f6bb2400640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x5613d6365400 0x5613d57beb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.055+0000 7f6bb2400640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x5613d6365400 0x5613d57beb00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:26.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.055+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.5 v2:172.21.15.106:6800/27676 1 ==== osd_op_reply(7 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d6365400 2024-04-02T07:34:26.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.055+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:8 16.1c 16:38000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d6365800 con 0x5613d62e9c00 2024-04-02T07:34:26.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.055+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 2 ==== osd_op_reply(8 [pgnls start_epoch 120 out=73b] v119'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.055+0000 7f6bb3800640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x5613d6365800 0x5613d57bf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.055+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:9 16.2 16:40000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d62e8400 con 0x5613d6365800 2024-04-02T07:34:26.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.055+0000 7f6bb3800640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x5613d6365800 0x5613d57bf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.055+0000 7f6bb3800640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x5613d6365800 0x5613d57bf080 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:26.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.055+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.4 v2:172.21.15.106:6801/27677 1 ==== osd_op_reply(9 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aed80 con 0x5613d6365800 2024-04-02T07:34:26.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.055+0000 7f6bb3800640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x5613d62e8400 0x5613d57bf600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.055+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:10 16.12 16:48000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d62e8800 con 0x5613d62e8400 2024-04-02T07:34:26.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.055+0000 7f6bb2e00640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x5613d62e8400 0x5613d57bf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.055+0000 7f6bb2e00640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x5613d62e8400 0x5613d57bf600 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:26.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.6 v2:172.21.15.106:6816/27678 1 ==== osd_op_reply(10 [pgnls start_epoch 120 out=81b] v119'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d62e8400 2024-04-02T07:34:26.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:11 16.a 16:50000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d62e8800 con 0x5613d62e9c00 2024-04-02T07:34:26.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 3 ==== osd_op_reply(11 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:12 16.1a 16:58000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d62e8800 con 0x5613d6365000 2024-04-02T07:34:26.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.3 v2:172.21.15.55:6824/27393 2 ==== osd_op_reply(12 [pgnls start_epoch 120 out=49b] v120'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d6365000 2024-04-02T07:34:26.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:13 16.6 16:60000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d62e8800 con 0x5613d62e8400 2024-04-02T07:34:26.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.6 v2:172.21.15.106:6816/27678 2 ==== osd_op_reply(13 [pgnls start_epoch 120 out=77b] v119'7 uv7 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d62e8400 2024-04-02T07:34:26.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:14 16.16 16:68000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d62e8800 con 0x5613d6365000 2024-04-02T07:34:26.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.3 v2:172.21.15.55:6824/27393 3 ==== osd_op_reply(14 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d6365000 2024-04-02T07:34:26.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:15 16.e 16:70000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d62e8800 con 0x5613d62e9c00 2024-04-02T07:34:26.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 4 ==== osd_op_reply(15 [pgnls start_epoch 120 out=73b] v119'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb3800640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x5613d62e8800 0x5613d57bfb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:16 16.1e 16:78000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d6365c00 con 0x5613d62e8800 2024-04-02T07:34:26.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb2400640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x5613d62e8800 0x5613d57bfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb2400640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x5613d62e8800 0x5613d57bfb80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:26.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.7 v2:172.21.15.106:6824/27679 1 ==== osd_op_reply(16 [pgnls start_epoch 120 out=49b] v120'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d62e8800 2024-04-02T07:34:26.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:17 16.1 16:80000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d6365c00 con 0x5613d62e9c00 2024-04-02T07:34:26.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 5 ==== osd_op_reply(17 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:18 16.11 16:88000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d6365c00 con 0x5613d6365400 2024-04-02T07:34:26.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.5 v2:172.21.15.106:6800/27676 2 ==== osd_op_reply(18 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d6365400 2024-04-02T07:34:26.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb2400640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x5613d6365c00 0x5613d57c0100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.059+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:19 16.9 16:90000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e0000 con 0x5613d6365c00 2024-04-02T07:34:26.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb3800640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x5613d6365c00 0x5613d57c0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb3800640 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x5613d6365c00 0x5613d57c0100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:26.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.1 v2:172.21.15.55:6809/27391 1 ==== osd_op_reply(19 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aed80 con 0x5613d6365c00 2024-04-02T07:34:26.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:20 16.19 16:98000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e0000 con 0x5613d6365800 2024-04-02T07:34:26.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.4 v2:172.21.15.106:6801/27677 2 ==== osd_op_reply(20 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aed80 con 0x5613d6365800 2024-04-02T07:34:26.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:21 16.5 16:a0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e0000 con 0x5613d62e9800 2024-04-02T07:34:26.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.0 v2:172.21.15.55:6800/27392 5 ==== osd_op_reply(21 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d62e9800 2024-04-02T07:34:26.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:22 16.15 16:a8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e0000 con 0x5613d62e9800 2024-04-02T07:34:26.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.0 v2:172.21.15.55:6800/27392 6 ==== osd_op_reply(22 [pgnls start_epoch 120 out=97b] v119'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d62e9800 2024-04-02T07:34:26.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:23 16.d 16:b0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e0000 con 0x5613d62e8400 2024-04-02T07:34:26.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.6 v2:172.21.15.106:6816/27678 3 ==== osd_op_reply(23 [pgnls start_epoch 120 out=74b] v115'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d62e8400 2024-04-02T07:34:26.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:24 16.1d 16:b8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e0000 con 0x5613d62e9c00 2024-04-02T07:34:26.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 6 ==== osd_op_reply(24 [pgnls start_epoch 120 out=73b] v119'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:25 16.3 16:c0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e0000 con 0x5613d6365400 2024-04-02T07:34:26.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.5 v2:172.21.15.106:6800/27676 3 ==== osd_op_reply(25 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d6365400 2024-04-02T07:34:26.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:26 16.13 16:c8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e0000 con 0x5613d6365c00 2024-04-02T07:34:26.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.1 v2:172.21.15.55:6809/27391 2 ==== osd_op_reply(26 [pgnls start_epoch 120 out=98b] v119'5 uv5 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x5613d61aed80 con 0x5613d6365c00 2024-04-02T07:34:26.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:27 16.b 16:d0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e0000 con 0x5613d6365c00 2024-04-02T07:34:26.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.1 v2:172.21.15.55:6809/27391 3 ==== osd_op_reply(27 [pgnls start_epoch 120 out=76b] v120'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x5613d61aed80 con 0x5613d6365c00 2024-04-02T07:34:26.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:28 16.1b 16:d8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e0000 con 0x5613d6365400 2024-04-02T07:34:26.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.5 v2:172.21.15.106:6800/27676 4 ==== osd_op_reply(28 [pgnls start_epoch 120 out=49b] v120'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d6365400 2024-04-02T07:34:26.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.063+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:29 16.7 16:e0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e0000 con 0x5613d6365000 2024-04-02T07:34:26.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.3 v2:172.21.15.55:6824/27393 4 ==== osd_op_reply(29 [pgnls start_epoch 120 out=105b] v120'9 uv9 ondisk = 1) v8 ==== 144+0+105 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d6365000 2024-04-02T07:34:26.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:30 16.17 16:e8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e0000 con 0x5613d62e9c00 2024-04-02T07:34:26.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 7 ==== osd_op_reply(30 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:31 16.f 16:f0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e0000 con 0x5613d62e9800 2024-04-02T07:34:26.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.0 v2:172.21.15.55:6800/27392 7 ==== osd_op_reply(31 [pgnls start_epoch 120 out=73b] v120'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d62e9800 2024-04-02T07:34:26.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:32 16.1f 16:f8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e0000 con 0x5613d6365400 2024-04-02T07:34:26.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.5 v2:172.21.15.106:6800/27676 5 ==== osd_op_reply(32 [pgnls start_epoch 120 out=101b] v120'9 uv8 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d6365400 2024-04-02T07:34:26.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 601.00000000 2024-04-02T07:34:26.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:33 16.10 16:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e1000 con 0x5613d62e9c00 2024-04-02T07:34:26.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 8 ==== osd_op_reply(33 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 602.00000000 2024-04-02T07:34:26.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:34 16.10 16:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e1400 con 0x5613d62e9c00 2024-04-02T07:34:26.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 9 ==== osd_op_reply(34 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 10000000000.00000000 2024-04-02T07:34:26.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:35 16.10 16:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e1800 con 0x5613d62e9c00 2024-04-02T07:34:26.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 10 ==== osd_op_reply(35 10000000000.00000000 [omap-get-vals out=1047b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+1047 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 600.00000000 2024-04-02T07:34:26.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:36 16.10 16:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e1c00 con 0x5613d62e9c00 2024-04-02T07:34:26.077 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 11 ==== osd_op_reply(36 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 603.00000000 2024-04-02T07:34:26.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:37 16.10 16:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8000 con 0x5613d62e9c00 2024-04-02T07:34:26.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 12 ==== osd_op_reply(37 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 1.00000000.inode 2024-04-02T07:34:26.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-02T07:34:26.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 200.00000000 2024-04-02T07:34:26.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-02T07:34:26.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 200.00000001 2024-04-02T07:34:26.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-02T07:34:26.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 606.00000000 2024-04-02T07:34:26.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:38 16.14 16:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8400 con 0x5613d62e9800 2024-04-02T07:34:26.078 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.0 v2:172.21.15.55:6800/27392 8 ==== osd_op_reply(38 606.00000000 [omap-get-vals out=5b] v0'0 uv38 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d62e9800 2024-04-02T07:34:26.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 607.00000000 2024-04-02T07:34:26.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:39 16.1c 16:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d62e9c00 2024-04-02T07:34:26.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 13 ==== osd_op_reply(39 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 10000000003.00000000 2024-04-02T07:34:26.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.067+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:40 16.12 16:4def72d4:::10000000003.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8c00 con 0x5613d62e8400 2024-04-02T07:34:26.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.6 v2:172.21.15.106:6816/27678 4 ==== osd_op_reply(40 10000000003.00000000 [omap-get-vals out=523b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+523 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d62e8400 2024-04-02T07:34:26.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object mds0_openfiles.0 2024-04-02T07:34:26.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-02T07:34:26.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 608.00000000 2024-04-02T07:34:26.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:41 16.e 16:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e9000 con 0x5613d62e9c00 2024-04-02T07:34:26.079 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 14 ==== osd_op_reply(41 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 604.00000000 2024-04-02T07:34:26.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:42 16.15 16:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e9400 con 0x5613d62e9800 2024-04-02T07:34:26.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.0 v2:172.21.15.55:6800/27392 9 ==== osd_op_reply(42 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d62e9800 2024-04-02T07:34:26.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 500.00000000 2024-04-02T07:34:26.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-02T07:34:26.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object mds_snaptable 2024-04-02T07:34:26.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-02T07:34:26.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 605.00000000 2024-04-02T07:34:26.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:43 16.1d 16:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e9800 con 0x5613d62e9c00 2024-04-02T07:34:26.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 15 ==== osd_op_reply(43 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.080 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object mds0_inotable 2024-04-02T07:34:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-02T07:34:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 100.00000000 2024-04-02T07:34:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:44 16.13 16:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e9c00 con 0x5613d6365c00 2024-04-02T07:34:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.1 v2:172.21.15.55:6809/27391 4 ==== osd_op_reply(44 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x5613d61aed80 con 0x5613d6365c00 2024-04-02T07:34:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object mds0_sessionmap 2024-04-02T07:34:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-02T07:34:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 609.00000000 2024-04-02T07:34:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:45 16.7 16:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8400 con 0x5613d6365000 2024-04-02T07:34:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.3 v2:172.21.15.55:6824/27393 5 ==== osd_op_reply(45 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d6365000 2024-04-02T07:34:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 10000000001.00000000 2024-04-02T07:34:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:46 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e9400 con 0x5613d6365000 2024-04-02T07:34:26.081 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.3 v2:172.21.15.55:6824/27393 6 ==== osd_op_reply(46 10000000001.00000000 [omap-get-vals out=1545b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+1545 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d6365000 2024-04-02T07:34:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 20 datascan.scan_links: injected ino detected 2024-04-02T07:34:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 400.00000000 2024-04-02T07:34:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-02T07:34:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 100.00000000.inode 2024-04-02T07:34:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-02T07:34:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 1: handling object 1.00000000 2024-04-02T07:34:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:47 16.1f 16:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8000 con 0x5613d6365400 2024-04-02T07:34:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.5 v2:172.21.15.106:6800/27676 6 ==== osd_op_reply(47 1.00000000 [omap-get-vals out=524b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+524 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d6365400 2024-04-02T07:34:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:48 16.0 16:00000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d62e9800 2024-04-02T07:34:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.0 v2:172.21.15.55:6800/27392 10 ==== osd_op_reply(48 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d62e9800 2024-04-02T07:34:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:49 16.10 16:08000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d62e9c00 2024-04-02T07:34:26.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 16 ==== osd_op_reply(49 [pgnls start_epoch 120 out=177b] v119'16 uv16 ondisk = 1) v8 ==== 144+0+177 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:50 16.8 16:10000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d62e9800 2024-04-02T07:34:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.0 v2:172.21.15.55:6800/27392 11 ==== osd_op_reply(50 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d62e9800 2024-04-02T07:34:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:51 16.18 16:18000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d62e9800 2024-04-02T07:34:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.0 v2:172.21.15.55:6800/27392 12 ==== osd_op_reply(51 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d62e9800 2024-04-02T07:34:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:52 16.4 16:20000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d6365000 2024-04-02T07:34:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.3 v2:172.21.15.55:6824/27393 7 ==== osd_op_reply(52 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d6365000 2024-04-02T07:34:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.071+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:53 16.14 16:28000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d62e9800 2024-04-02T07:34:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.0 v2:172.21.15.55:6800/27392 13 ==== osd_op_reply(53 [pgnls start_epoch 120 out=149b] v120'43 uv43 ondisk = 1) v8 ==== 144+0+149 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d62e9800 2024-04-02T07:34:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:54 16.c 16:30000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d6365400 2024-04-02T07:34:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.5 v2:172.21.15.106:6800/27676 7 ==== osd_op_reply(54 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d6365400 2024-04-02T07:34:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:55 16.1c 16:38000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d62e9c00 2024-04-02T07:34:26.083 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 17 ==== osd_op_reply(55 [pgnls start_epoch 120 out=73b] v119'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:56 16.2 16:40000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d6365800 2024-04-02T07:34:26.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.4 v2:172.21.15.106:6801/27677 3 ==== osd_op_reply(56 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aed80 con 0x5613d6365800 2024-04-02T07:34:26.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:57 16.12 16:48000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d62e8400 2024-04-02T07:34:26.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.6 v2:172.21.15.106:6816/27678 5 ==== osd_op_reply(57 [pgnls start_epoch 120 out=81b] v119'3 uv3 ondisk = 1) v8 ==== 144+0+81 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d62e8400 2024-04-02T07:34:26.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:58 16.a 16:50000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d62e9c00 2024-04-02T07:34:26.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 18 ==== osd_op_reply(58 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:59 16.1a 16:58000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d6365000 2024-04-02T07:34:26.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.3 v2:172.21.15.55:6824/27393 8 ==== osd_op_reply(59 [pgnls start_epoch 120 out=49b] v120'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d6365000 2024-04-02T07:34:26.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:60 16.6 16:60000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d62e8400 2024-04-02T07:34:26.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.6 v2:172.21.15.106:6816/27678 6 ==== osd_op_reply(60 [pgnls start_epoch 120 out=77b] v119'7 uv7 ondisk = 1) v8 ==== 144+0+77 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d62e8400 2024-04-02T07:34:26.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:61 16.16 16:68000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d6365000 2024-04-02T07:34:26.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.3 v2:172.21.15.55:6824/27393 9 ==== osd_op_reply(61 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d6365000 2024-04-02T07:34:26.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:62 16.e 16:70000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d62e9c00 2024-04-02T07:34:26.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 19 ==== osd_op_reply(62 [pgnls start_epoch 120 out=73b] v119'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- osd_op(unknown.0.0:63 16.1e 16:78000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d62e8800 2024-04-02T07:34:26.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.7 v2:172.21.15.106:6824/27679 2 ==== osd_op_reply(63 [pgnls start_epoch 120 out=49b] v120'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d62e8800 2024-04-02T07:34:26.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.075+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:64 16.1 16:80000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d62e9c00 2024-04-02T07:34:26.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 20 ==== osd_op_reply(64 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:65 16.11 16:88000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d6365400 2024-04-02T07:34:26.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.5 v2:172.21.15.106:6800/27676 8 ==== osd_op_reply(65 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d6365400 2024-04-02T07:34:26.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:66 16.9 16:90000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d6365c00 2024-04-02T07:34:26.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.1 v2:172.21.15.55:6809/27391 5 ==== osd_op_reply(66 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aed80 con 0x5613d6365c00 2024-04-02T07:34:26.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- osd_op(unknown.0.0:67 16.19 16:98000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d6365800 2024-04-02T07:34:26.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.4 v2:172.21.15.106:6801/27677 4 ==== osd_op_reply(67 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aed80 con 0x5613d6365800 2024-04-02T07:34:26.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:68 16.5 16:a0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d62e9800 2024-04-02T07:34:26.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.0 v2:172.21.15.55:6800/27392 14 ==== osd_op_reply(68 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d62e9800 2024-04-02T07:34:26.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:69 16.15 16:a8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d62e9800 2024-04-02T07:34:26.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.0 v2:172.21.15.55:6800/27392 15 ==== osd_op_reply(69 [pgnls start_epoch 120 out=97b] v119'4 uv4 ondisk = 1) v8 ==== 144+0+97 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d62e9800 2024-04-02T07:34:26.095 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:70 16.d 16:b0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d62e8400 2024-04-02T07:34:26.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.6 v2:172.21.15.106:6816/27678 7 ==== osd_op_reply(70 [pgnls start_epoch 120 out=74b] v115'1 uv1 ondisk = 1) v8 ==== 144+0+74 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d62e8400 2024-04-02T07:34:26.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:71 16.1d 16:b8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d62e9c00 2024-04-02T07:34:26.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 21 ==== osd_op_reply(71 [pgnls start_epoch 120 out=73b] v119'3 uv3 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:72 16.3 16:c0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d6365400 2024-04-02T07:34:26.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.5 v2:172.21.15.106:6800/27676 9 ==== osd_op_reply(72 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d6365400 2024-04-02T07:34:26.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:73 16.13 16:c8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d6365c00 2024-04-02T07:34:26.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.1 v2:172.21.15.55:6809/27391 6 ==== osd_op_reply(73 [pgnls start_epoch 120 out=98b] v119'5 uv5 ondisk = 1) v8 ==== 144+0+98 (crc 0 0 0) 0x5613d61aed80 con 0x5613d6365c00 2024-04-02T07:34:26.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:74 16.b 16:d0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d6365c00 2024-04-02T07:34:26.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.1 v2:172.21.15.55:6809/27391 7 ==== osd_op_reply(74 [pgnls start_epoch 120 out=76b] v120'6 uv5 ondisk = 1) v8 ==== 144+0+76 (crc 0 0 0) 0x5613d61aed80 con 0x5613d6365c00 2024-04-02T07:34:26.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:75 16.1b 16:d8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d6365400 2024-04-02T07:34:26.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.5 v2:172.21.15.106:6800/27676 10 ==== osd_op_reply(75 [pgnls start_epoch 120 out=49b] v120'3 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d6365400 2024-04-02T07:34:26.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.079+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:76 16.7 16:e0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d6365000 2024-04-02T07:34:26.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.3 v2:172.21.15.55:6824/27393 10 ==== osd_op_reply(76 [pgnls start_epoch 120 out=105b] v120'9 uv9 ondisk = 1) v8 ==== 144+0+105 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d6365000 2024-04-02T07:34:26.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:77 16.17 16:e8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d62e9c00 2024-04-02T07:34:26.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 22 ==== osd_op_reply(77 [pgnls start_epoch 120 out=49b] v0'0 uv0 ondisk = 1) v8 ==== 144+0+49 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:78 16.f 16:f0000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d62e9800 2024-04-02T07:34:26.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.0 v2:172.21.15.55:6800/27392 16 ==== osd_op_reply(78 [pgnls start_epoch 120 out=73b] v120'2 uv2 ondisk = 1) v8 ==== 144+0+73 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d62e9800 2024-04-02T07:34:26.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:79 16.1f 16:f8000000::::head [pgnls start_epoch 120 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8800 con 0x5613d6365400 2024-04-02T07:34:26.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.5 v2:172.21.15.106:6800/27676 11 ==== osd_op_reply(79 [pgnls start_epoch 120 out=101b] v120'9 uv8 ondisk = 1) v8 ==== 144+0+101 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d6365400 2024-04-02T07:34:26.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 601.00000000 2024-04-02T07:34:26.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:80 16.10 16:09401a81:::601.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8c00 con 0x5613d62e9c00 2024-04-02T07:34:26.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 23 ==== osd_op_reply(80 601.00000000 [omap-get-vals out=5b] v0'0 uv13 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 602.00000000 2024-04-02T07:34:26.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:81 16.10 16:0bd6d154:::602.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8400 con 0x5613d62e9c00 2024-04-02T07:34:26.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 24 ==== osd_op_reply(81 602.00000000 [omap-get-vals out=5b] v0'0 uv15 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 10000000000.00000000 2024-04-02T07:34:26.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:82 16.10 16:0cf6ad0f:::10000000000.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e9400 con 0x5613d62e9c00 2024-04-02T07:34:26.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 25 ==== osd_op_reply(82 10000000000.00000000 [omap-get-vals out=1047b] v0'0 uv12 ondisk = 0) v8 ==== 164+0+1047 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 600.00000000 2024-04-02T07:34:26.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:83 16.10 16:0d82a743:::600.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d61a9400 con 0x5613d62e9c00 2024-04-02T07:34:26.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 26 ==== osd_op_reply(83 600.00000000 [omap-get-vals out=5b] v0'0 uv14 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 603.00000000 2024-04-02T07:34:26.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:84 16.10 16:0d89b25e:::603.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d61a9000 con 0x5613d62e9c00 2024-04-02T07:34:26.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 27 ==== osd_op_reply(84 603.00000000 [omap-get-vals out=5b] v0'0 uv16 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 1.00000000.inode 2024-04-02T07:34:26.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 10 datascan.scan_links: Not a dirfrag: '1.00000000.inode' 2024-04-02T07:34:26.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 200.00000000 2024-04-02T07:34:26.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000000' 2024-04-02T07:34:26.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 200.00000001 2024-04-02T07:34:26.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '200.00000001' 2024-04-02T07:34:26.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 606.00000000 2024-04-02T07:34:26.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:85 16.14 16:2f55791f:::606.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d61a9400 con 0x5613d62e9800 2024-04-02T07:34:26.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.0 v2:172.21.15.55:6800/27392 17 ==== osd_op_reply(85 606.00000000 [omap-get-vals out=5b] v0'0 uv38 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d62e9800 2024-04-02T07:34:26.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 607.00000000 2024-04-02T07:34:26.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:86 16.1c 16:3ed09add:::607.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e9000 con 0x5613d62e9c00 2024-04-02T07:34:26.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 28 ==== osd_op_reply(86 607.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 10000000003.00000000 2024-04-02T07:34:26.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:87 16.12 16:4def72d4:::10000000003.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e9800 con 0x5613d62e8400 2024-04-02T07:34:26.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.083+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.6 v2:172.21.15.106:6816/27678 8 ==== osd_op_reply(87 10000000003.00000000 [omap-get-vals out=523b] v0'0 uv3 ondisk = 0) v8 ==== 164+0+523 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d62e8400 2024-04-02T07:34:26.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object mds0_openfiles.0 2024-04-02T07:34:26.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_openfiles.0' 2024-04-02T07:34:26.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 608.00000000 2024-04-02T07:34:26.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:88 16.e 16:717a0223:::608.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e9c00 con 0x5613d62e9c00 2024-04-02T07:34:26.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 29 ==== osd_op_reply(88 608.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 604.00000000 2024-04-02T07:34:26.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- osd_op(unknown.0.0:89 16.15 16:a93a17c2:::604.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8c00 con 0x5613d62e9800 2024-04-02T07:34:26.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.0 v2:172.21.15.55:6800/27392 18 ==== osd_op_reply(89 604.00000000 [omap-get-vals out=5b] v0'0 uv4 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d62e9800 2024-04-02T07:34:26.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 500.00000000 2024-04-02T07:34:26.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '500.00000000' 2024-04-02T07:34:26.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object mds_snaptable 2024-04-02T07:34:26.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: Not a dirfrag: 'mds_snaptable' 2024-04-02T07:34:26.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 605.00000000 2024-04-02T07:34:26.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- osd_op(unknown.0.0:90 16.1d 16:b871830b:::605.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e8400 con 0x5613d62e9c00 2024-04-02T07:34:26.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.2 v2:172.21.15.55:6808/27394 30 ==== osd_op_reply(90 605.00000000 [omap-get-vals out=5b] v0'0 uv3 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5613d61aed80 con 0x5613d62e9c00 2024-04-02T07:34:26.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object mds0_inotable 2024-04-02T07:34:26.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_inotable' 2024-04-02T07:34:26.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 100.00000000 2024-04-02T07:34:26.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:91 16.13 16:cd5a64a3:::100.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57e9400 con 0x5613d6365c00 2024-04-02T07:34:26.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.1 v2:172.21.15.55:6809/27391 8 ==== osd_op_reply(91 100.00000000 [omap-get-vals out=5195b] v0'0 uv5 ondisk = 0) v8 ==== 156+0+5195 (crc 0 0 0) 0x5613d61aed80 con 0x5613d6365c00 2024-04-02T07:34:26.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object mds0_sessionmap 2024-04-02T07:34:26.101 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: Not a dirfrag: 'mds0_sessionmap' 2024-04-02T07:34:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 609.00000000 2024-04-02T07:34:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:92 16.7 16:e0b41d06:::609.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57f2000 con 0x5613d6365000 2024-04-02T07:34:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.3 v2:172.21.15.55:6824/27393 11 ==== osd_op_reply(92 609.00000000 [omap-get-vals out=5b] v0'0 uv7 ondisk = 0) v8 ==== 156+0+5 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d6365000 2024-04-02T07:34:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 10000000001.00000000 2024-04-02T07:34:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:93 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57f2400 con 0x5613d6365000 2024-04-02T07:34:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.3 v2:172.21.15.55:6824/27393 12 ==== osd_op_reply(93 10000000001.00000000 [omap-get-vals out=1545b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+1545 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d6365000 2024-04-02T07:34:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 20 datascan.scan_links: injected ino detected 2024-04-02T07:34:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 20 datascan.scan_links: adding 0x100000001f7 for future processing to fix dnfirst 2024-04-02T07:34:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 400.00000000 2024-04-02T07:34:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: Not a dirfrag (invalid ino): '400.00000000' 2024-04-02T07:34:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 100.00000000.inode 2024-04-02T07:34:26.102 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: Not a dirfrag: '100.00000000.inode' 2024-04-02T07:34:26.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: step 2: handling object 1.00000000 2024-04-02T07:34:26.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- osd_op(unknown.0.0:94 16.1f 16:ff5b34d6:::1.00000000:head [omap-get-vals in=16b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57f2800 con 0x5613d6365400 2024-04-02T07:34:26.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb2400640 1 -- 172.21.15.55:0/2682481101 <== osd.5 v2:172.21.15.106:6800/27676 12 ==== osd_op_reply(94 1.00000000 [omap-get-vals out=524b] v0'0 uv8 ondisk = 0) v8 ==== 154+0+524 (crc 0 0 0) 0x5613d61aeb40 con 0x5613d6365400 2024-04-02T07:34:26.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: processing 0 dup_primaries, 0 remote_links 2024-04-02T07:34:26.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: removing dup dentries from 0 objects 2024-04-02T07:34:26.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: processing 0 bad_nlink_inos 2024-04-02T07:34:26.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: processing 1 injected_inos 2024-04-02T07:34:26.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 10 datascan.scan_links: handling injected_ino 0x100000001f7 2024-04-02T07:34:26.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 20 datascan.scan_links: fixing linkage (dnfirst) of 0x10000000001:bravo 2024-04-02T07:34:26.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:95 16.7 16:e2e07930:::10000000001.00000000:head [omap-get-vals-by-keys in=18b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57f2c00 con 0x5613d6365000 2024-04-02T07:34:26.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.3 v2:172.21.15.55:6824/27393 13 ==== osd_op_reply(95 10000000001.00000000 [omap-get-vals-by-keys out=506b] v0'0 uv9 ondisk = 0) v8 ==== 164+0+506 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d6365000 2024-04-02T07:34:26.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 20 datascan.read_dentry: oid=10000000001.00000000 dname=bravo frag=*, r=0 2024-04-02T07:34:26.103 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 20 datascan.scan_links: first is now 2 2024-04-02T07:34:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.087+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- osd_op(unknown.0.0:96 16.7 16:e2e07930:::10000000001.00000000:head [omap-set-vals in=506b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57f3000 con 0x5613d6365000 2024-04-02T07:34:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.3 v2:172.21.15.55:6824/27393 14 ==== osd_op_reply(96 10000000001.00000000 [omap-set-vals] v120'10 uv10 ondisk = 0) v8 ==== 164+0+0 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d6365000 2024-04-02T07:34:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 20 datascan.inject_linkage: Injected dentry 0x0x10000000001/bravo pointing to 0x0x100000001f7 2024-04-02T07:34:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 10 datascan.scan_links: updating inotable 2024-04-02T07:34:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:97 16.13 16:c91d4a1d:::mds0_inotable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57f3400 con 0x5613d6365c00 2024-04-02T07:34:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.1 v2:172.21.15.55:6809/27391 9 ==== osd_op_reply(97 mds0_inotable [read 0~50 out=50b] v0'0 uv4 ondisk = 0) v8 ==== 157+0+50 (crc 0 0 0) 0x5613d61aed80 con 0x5613d6365c00 2024-04-02T07:34:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 10 mds.0.inotable: skip_inos was [0x10000000005~0x1f2,0x100000001f9~0xfffffffe07] 2024-04-02T07:34:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 10 mds.0.inotable: skip_inos now [0x100000001f9~0xfffffffe07] 2024-04-02T07:34:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- osd_op(unknown.0.0:98 16.13 16:c91d4a1d:::mds0_inotable:head [writefull 0~34 in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57f3800 con 0x5613d6365c00 2024-04-02T07:34:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb3800640 1 -- 172.21.15.55:0/2682481101 <== osd.1 v2:172.21.15.55:6809/27391 10 ==== osd_op_reply(98 mds0_inotable [writefull 0~34] v120'6 uv6 ondisk = 0) v8 ==== 157+0+0 (crc 0 0 0) 0x5613d61aed80 con 0x5613d6365c00 2024-04-02T07:34:26.104 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 10 datascan.scan_links: updating snaptable 2024-04-02T07:34:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- osd_op(unknown.0.0:99 16.d 16:b50e409b:::mds_snaptable:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e120) v8 -- 0x5613d57f3c00 con 0x5613d62e8400 2024-04-02T07:34:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 <== osd.6 v2:172.21.15.106:6816/27678 9 ==== osd_op_reply(99 mds_snaptable [read 0~70 out=70b] v0'0 uv1 ondisk = 0) v8 ==== 157+0+70 (crc 0 0 0) 0x5613d61aefc0 con 0x5613d62e8400 2024-04-02T07:34:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x5613d62e9800 msgr2=0x5613d5468100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x5613d62e9800 0x5613d5468100 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x5613d6365c00 msgr2=0x5613d57c0100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x5613d6365c00 0x5613d57c0100 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x5613d62e9c00 msgr2=0x5613d57be000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x5613d62e9c00 0x5613d57be000 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x5613d6365000 msgr2=0x5613d57be580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 reap_dead start 2024-04-02T07:34:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x5613d6365000 0x5613d57be580 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x5613d6365800 msgr2=0x5613d57bf080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:26.105 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x5613d6365800 0x5613d57bf080 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x5613d6365400 msgr2=0x5613d57beb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x5613d6365400 0x5613d57beb00 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x5613d62e8400 msgr2=0x5613d57bf600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x5613d62e8400 0x5613d57bf600 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x5613d62e8800 msgr2=0x5613d57bfb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x5613d62e8800 0x5613d57bfb80 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb2e00640 1 -- 172.21.15.55:0/2682481101 reap_dead start 2024-04-02T07:34:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5613d6364c00 msgr2=0x5613d5469700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5613d6364c00 0x5613d5469700 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x5613d54a7e00 tx=0x5613d62ffda0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5613d62e8c00 msgr2=0x5613d5469180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5613d62e8c00 0x5613d5469180 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x5613d62fb350 tx=0x5613d62fec00 comp rx=0 tx=0).stop 2024-04-02T07:34:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 shutdown_connections 2024-04-02T07:34:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x5613d6364c00 0x5613d5469700 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/2682481101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5613d62e8c00 0x5613d5469180 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 >> 172.21.15.55:0/2682481101 conn(0x5613d53dac00 msgr2=0x5613d5407800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 shutdown_connections 2024-04-02T07:34:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/2682481101 wait complete. 2024-04-02T07:34:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/3456910557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5613d53db000 msgr2=0x5613d5467080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/3456910557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5613d53db000 0x5613d5467080 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x5613d6241380 tx=0x5613d619cc00 comp rx=0 tx=0).stop 2024-04-02T07:34:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/3456910557 shutdown_connections 2024-04-02T07:34:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/3456910557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5613d53db000 0x5613d5467080 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/3456910557 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5613d53db400 0x5613d5466b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 --2- 172.21.15.55:0/3456910557 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5613d53db800 0x5613d5466580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/3456910557 >> 172.21.15.55:0/3456910557 conn(0x5613d53dbc00 msgr2=0x5613d5407000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.091+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/3456910557 shutdown_connections 2024-04-02T07:34:26.108 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.095+0000 7f6bb4d3e8c0 1 -- 172.21.15.55:0/3456910557 wait complete. 2024-04-02T07:34:26.108 DEBUG:tasks.cephfs.filesystem:Ran ['cephfs-data-scan', '--debug-mds=20', '--debug-ms=1', '--debug-objecter=1', 'scan_links'] in time 0:00:00.155874, result: 2024-04-02T07:34:26.109 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-02T07:34:26.154 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-02T07:34:26.194 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2024-04-02T07:34:26.194 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2024-04-02T07:34:26.195 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-02T07:34:26.195 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2024-04-02T07:34:26.195 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.195 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2024-04-02T07:34:26.195 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.195 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2024-04-02T07:34:26.195 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.195 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2024-04-02T07:34:26.195 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2024-04-02T07:34:26.195 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.195 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2024-04-02T07:34:26.195 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2024-04-02T07:34:26.195 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.195 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-02T07:34:26.196 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2024-04-02T07:34:26.196 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.196 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2024-04-02T07:34:26.196 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-02T07:34:26.196 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.196 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2024-04-02T07:34:26.196 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.196 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2024-04-02T07:34:26.196 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2024-04-02T07:34:26.196 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2024-04-02T07:34:26.196 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2024-04-02T07:34:26.196 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2024-04-02T07:34:26.196 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2024-04-02T07:34:26.196 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2024-04-02T07:34:26.196 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-02T07:34:26.197 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-02T07:34:26.197 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2024-04-02T07:34:26.197 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.197 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-02T07:34:26.197 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.197 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2024-04-02T07:34:26.197 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.197 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2024-04-02T07:34:26.197 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.197 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2024-04-02T07:34:26.197 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2024-04-02T07:34:26.197 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2024-04-02T07:34:26.197 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.55,172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790]" 2024-04-02T07:34:26.197 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = 642a0456-a2ac-49a4-91a5-3b3449b512da 2024-04-02T07:34:26.198 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.198 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2024-04-02T07:34:26.198 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2024-04-02T07:34:26.198 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.198 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2024-04-02T07:34:26.198 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2024-04-02T07:34:26.198 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2024-04-02T07:34:26.198 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.198 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2024-04-02T07:34:26.198 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2024-04-02T07:34:26.198 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.198 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2024-04-02T07:34:26.198 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2024-04-02T07:34:26.198 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2024-04-02T07:34:26.199 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.199 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2024-04-02T07:34:26.199 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2024-04-02T07:34:26.199 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.199 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2024-04-02T07:34:26.199 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.199 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2024-04-02T07:34:26.199 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.199 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2024-04-02T07:34:26.199 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.199 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2024-04-02T07:34:26.199 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2024-04-02T07:34:26.199 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.199 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2024-04-02T07:34:26.199 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2024-04-02T07:34:26.200 INFO:teuthology.orchestra.run.smithi055.stdout: bdev async discard = True 2024-04-02T07:34:26.200 INFO:teuthology.orchestra.run.smithi055.stdout: bdev enable discard = True 2024-04-02T07:34:26.200 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore allocator = bitmap 2024-04-02T07:34:26.200 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2024-04-02T07:34:26.200 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2024-04-02T07:34:26.200 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 1/20 2024-04-02T07:34:26.200 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 1/20 2024-04-02T07:34:26.200 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:34:26.200 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2024-04-02T07:34:26.200 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 4/10 2024-04-02T07:34:26.200 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2024-04-02T07:34:26.200 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2024-04-02T07:34:26.200 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2024-04-02T07:34:26.200 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2024-04-02T07:34:26.200 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2024-04-02T07:34:26.200 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-02T07:34:26.201 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.201 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2024-04-02T07:34:26.201 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:34:26.201 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2024-04-02T07:34:26.201 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-02T07:34:26.201 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-02T07:34:26.201 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-02T07:34:26.201 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-02T07:34:26.201 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2024-04-02T07:34:26.201 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.201 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2024-04-02T07:34:26.201 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:34:26.201 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-02T07:34:26.201 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2024-04-02T07:34:26.201 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-02T07:34:26.202 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2024-04-02T07:34:26.202 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2024-04-02T07:34:26.202 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-02T07:34:26.202 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2024-04-02T07:34:26.202 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2024-04-02T07:34:26.202 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-02T07:34:26.202 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.202 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-02T07:34:26.202 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2024-04-02T07:34:26.202 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2024-04-02T07:34:26.202 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.202 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2024-04-02T07:34:26.202 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-02T07:34:26.202 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-02T07:34:26.203 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.203 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2024-04-02T07:34:26.203 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2024-04-02T07:34:26.203 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.203 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2024-04-02T07:34:26.203 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2024-04-02T07:34:26.203 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.203 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2024-04-02T07:34:26.203 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2024-04-02T07:34:26.203 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2024-04-02T07:34:26.203 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2024-04-02T07:34:26.203 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-02T07:34:26.203 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-02T07:34:26.203 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2024-04-02T07:34:26.204 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2024-04-02T07:34:26.204 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:34:26.204 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2024-04-02T07:34:26.204 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-02T07:34:26.204 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-02T07:34:26.204 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2024-04-02T07:34:26.204 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2024-04-02T07:34:26.204 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2024-04-02T07:34:26.204 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-04-02T07:34:26.204 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-04-02T07:34:26.204 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-04-02T07:34:26.204 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-04-02T07:34:26.204 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2024-04-02T07:34:26.205 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2024-04-02T07:34:26.205 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2024-04-02T07:34:26.205 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:34:26.205 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2024-04-02T07:34:26.205 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = False 2024-04-02T07:34:26.205 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2024-04-02T07:34:26.205 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = True 2024-04-02T07:34:26.205 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-02T07:34:26.205 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-02T07:34:26.205 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-02T07:34:26.206 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2024-04-02T07:34:26.206 INFO:teuthology.orchestra.run.smithi106.stdout: chdir = "" 2024-04-02T07:34:26.206 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-02T07:34:26.206 INFO:teuthology.orchestra.run.smithi106.stdout: auth supported = cephx 2024-04-02T07:34:26.206 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.206 INFO:teuthology.orchestra.run.smithi106.stdout: filestore xattr use omap = true 2024-04-02T07:34:26.206 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.206 INFO:teuthology.orchestra.run.smithi106.stdout: mon clock drift allowed = 1.000 2024-04-02T07:34:26.206 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.206 INFO:teuthology.orchestra.run.smithi106.stdout: osd crush chooseleaf type = 0 2024-04-02T07:34:26.206 INFO:teuthology.orchestra.run.smithi106.stdout: auth debug = true 2024-04-02T07:34:26.206 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.207 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on old message = true 2024-04-02T07:34:26.207 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on bug = true 2024-04-02T07:34:26.207 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.207 INFO:teuthology.orchestra.run.smithi106.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-02T07:34:26.207 INFO:teuthology.orchestra.run.smithi106.stdout: mon pg warn max object skew = 0 2024-04-02T07:34:26.207 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.207 INFO:teuthology.orchestra.run.smithi106.stdout: # disable pg_autoscaler by default for new pools 2024-04-02T07:34:26.207 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-02T07:34:26.207 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.207 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default size = 2 2024-04-02T07:34:26.207 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.207 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow primary affinity = true 2024-04-02T07:34:26.207 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow pg remap = true 2024-04-02T07:34:26.207 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on legacy crush tunables = false 2024-04-02T07:34:26.207 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on crush straw calc version zero = false 2024-04-02T07:34:26.208 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on no sortbitwise = false 2024-04-02T07:34:26.208 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on osd down out interval zero = false 2024-04-02T07:34:26.208 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on too few osds = false 2024-04-02T07:34:26.208 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-02T07:34:26.208 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-02T07:34:26.208 INFO:teuthology.orchestra.run.smithi106.stdout: mon_allow_pool_size_one = true 2024-04-02T07:34:26.208 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.208 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-02T07:34:26.208 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.208 INFO:teuthology.orchestra.run.smithi106.stdout: osd default data pool replay window = 5 2024-04-02T07:34:26.208 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.208 INFO:teuthology.orchestra.run.smithi106.stdout: mon allow pool delete = true 2024-04-02T07:34:26.208 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.208 INFO:teuthology.orchestra.run.smithi106.stdout: mon cluster log file level = debug 2024-04-02T07:34:26.209 INFO:teuthology.orchestra.run.smithi106.stdout: debug asserts on shutdown = true 2024-04-02T07:34:26.209 INFO:teuthology.orchestra.run.smithi106.stdout: mon health detail to clog = false 2024-04-02T07:34:26.209 INFO:teuthology.orchestra.run.smithi106.stdout: mon host = "172.21.15.55,172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790]" 2024-04-02T07:34:26.209 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = 642a0456-a2ac-49a4-91a5-3b3449b512da 2024-04-02T07:34:26.209 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.209 INFO:teuthology.orchestra.run.smithi106.stdout:[osd] 2024-04-02T07:34:26.209 INFO:teuthology.orchestra.run.smithi106.stdout: osd journal size = 100 2024-04-02T07:34:26.209 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.209 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub load threshold = 5.0 2024-04-02T07:34:26.209 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub max interval = 600 2024-04-02T07:34:26.209 INFO:teuthology.orchestra.run.smithi106.stdout: osd mclock profile = high_recovery_ops 2024-04-02T07:34:26.209 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.209 INFO:teuthology.orchestra.run.smithi106.stdout: osd recover clone overlap = true 2024-04-02T07:34:26.209 INFO:teuthology.orchestra.run.smithi106.stdout: osd recovery max chunk = 1048576 2024-04-02T07:34:26.209 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.210 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug shutdown = true 2024-04-02T07:34:26.210 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug op order = true 2024-04-02T07:34:26.210 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify stray on activate = true 2024-04-02T07:34:26.210 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.210 INFO:teuthology.orchestra.run.smithi106.stdout: osd open classes on start = true 2024-04-02T07:34:26.210 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug pg log writeout = true 2024-04-02T07:34:26.210 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.210 INFO:teuthology.orchestra.run.smithi106.stdout: osd deep scrub update digest min age = 30 2024-04-02T07:34:26.210 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.210 INFO:teuthology.orchestra.run.smithi106.stdout: osd map max advance = 10 2024-04-02T07:34:26.210 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.210 INFO:teuthology.orchestra.run.smithi106.stdout: journal zero on create = true 2024-04-02T07:34:26.210 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.210 INFO:teuthology.orchestra.run.smithi106.stdout: filestore ondisk finisher threads = 3 2024-04-02T07:34:26.211 INFO:teuthology.orchestra.run.smithi106.stdout: filestore apply finisher threads = 3 2024-04-02T07:34:26.211 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.211 INFO:teuthology.orchestra.run.smithi106.stdout: bdev debug aio = true 2024-04-02T07:34:26.211 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug misdirected ops = true 2024-04-02T07:34:26.211 INFO:teuthology.orchestra.run.smithi106.stdout: bdev async discard = True 2024-04-02T07:34:26.211 INFO:teuthology.orchestra.run.smithi106.stdout: bdev enable discard = True 2024-04-02T07:34:26.211 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore allocator = bitmap 2024-04-02T07:34:26.211 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore block size = 96636764160 2024-04-02T07:34:26.211 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore fsck on mount = True 2024-04-02T07:34:26.211 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluefs = 1/20 2024-04-02T07:34:26.211 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluestore = 1/20 2024-04-02T07:34:26.211 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:34:26.211 INFO:teuthology.orchestra.run.smithi106.stdout: debug osd = 20 2024-04-02T07:34:26.211 INFO:teuthology.orchestra.run.smithi106.stdout: debug rocksdb = 4/10 2024-04-02T07:34:26.211 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd backfillfull_ratio = 0.85 2024-04-02T07:34:26.212 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd full ratio = 0.9 2024-04-02T07:34:26.212 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd nearfull ratio = 0.8 2024-04-02T07:34:26.212 INFO:teuthology.orchestra.run.smithi106.stdout: osd failsafe full ratio = 0.95 2024-04-02T07:34:26.212 INFO:teuthology.orchestra.run.smithi106.stdout: osd objectstore = bluestore 2024-04-02T07:34:26.212 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2024-04-02T07:34:26.212 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.212 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr] 2024-04-02T07:34:26.212 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:34:26.212 INFO:teuthology.orchestra.run.smithi106.stdout: debug mgr = 20 2024-04-02T07:34:26.212 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-04-02T07:34:26.212 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-04-02T07:34:26.212 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-04-02T07:34:26.212 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-04-02T07:34:26.212 INFO:teuthology.orchestra.run.smithi106.stdout: mgr/telemetry/nag = false 2024-04-02T07:34:26.212 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.213 INFO:teuthology.orchestra.run.smithi106.stdout:[mon] 2024-04-02T07:34:26.213 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:34:26.213 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-04-02T07:34:26.213 INFO:teuthology.orchestra.run.smithi106.stdout: debug paxos = 20 2024-04-02T07:34:26.213 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-04-02T07:34:26.213 INFO:teuthology.orchestra.run.smithi106.stdout: mon data avail warn = 5 2024-04-02T07:34:26.213 INFO:teuthology.orchestra.run.smithi106.stdout: mon mgr mkfs grace = 240 2024-04-02T07:34:26.213 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-04-02T07:34:26.213 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd reporter subtree level = osd 2024-04-02T07:34:26.213 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd prime pg temp = true 2024-04-02T07:34:26.213 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-04-02T07:34:26.213 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.213 INFO:teuthology.orchestra.run.smithi106.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-02T07:34:26.213 INFO:teuthology.orchestra.run.smithi106.stdout: auth mon ticket ttl = 660 # 11m 2024-04-02T07:34:26.213 INFO:teuthology.orchestra.run.smithi106.stdout: auth service ticket ttl = 240 # 4m 2024-04-02T07:34:26.214 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.214 INFO:teuthology.orchestra.run.smithi106.stdout: # don't complain about insecure global_id in the test suite 2024-04-02T07:34:26.214 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-02T07:34:26.214 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-02T07:34:26.214 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.214 INFO:teuthology.orchestra.run.smithi106.stdout: # 1m isn't quite enough 2024-04-02T07:34:26.214 INFO:teuthology.orchestra.run.smithi106.stdout: mon_down_mkfs_grace = 2m 2024-04-02T07:34:26.214 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.214 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_filestore_osds = false 2024-04-02T07:34:26.214 INFO:teuthology.orchestra.run.smithi106.stdout: mon op complaint time = 120 2024-04-02T07:34:26.214 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.214 INFO:teuthology.orchestra.run.smithi106.stdout:[client] 2024-04-02T07:34:26.214 INFO:teuthology.orchestra.run.smithi106.stdout: rgw cache enabled = true 2024-04-02T07:34:26.214 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable ops log = true 2024-04-02T07:34:26.215 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable usage log = true 2024-04-02T07:34:26.215 INFO:teuthology.orchestra.run.smithi106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-02T07:34:26.215 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-02T07:34:26.215 INFO:teuthology.orchestra.run.smithi106.stdout: client mount timeout = 600 2024-04-02T07:34:26.215 INFO:teuthology.orchestra.run.smithi106.stdout: debug client = 20 2024-04-02T07:34:26.215 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:34:26.215 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = "" 2024-04-02T07:34:26.215 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2024-04-02T07:34:26.215 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2024-04-02T07:34:26.215 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.a] 2024-04-02T07:34:26.215 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.b] 2024-04-02T07:34:26.215 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.c] 2024-04-02T07:34:26.215 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2024-04-02T07:34:26.215 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.c] 2024-04-02T07:34:26.215 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2024-04-02T07:34:26.216 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.d] 2024-04-02T07:34:26.216 INFO:teuthology.orchestra.run.smithi106.stdout:[mds] 2024-04-02T07:34:26.216 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds = 20 2024-04-02T07:34:26.216 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds balancer = 20 2024-04-02T07:34:26.216 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:34:26.216 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug frag = True 2024-04-02T07:34:26.216 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug scatterstat = False 2024-04-02T07:34:26.216 INFO:teuthology.orchestra.run.smithi106.stdout: mds op complaint time = 180 2024-04-02T07:34:26.216 INFO:teuthology.orchestra.run.smithi106.stdout: mds verify scatter = True 2024-04-02T07:34:26.216 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2024-04-02T07:34:26.216 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2024-04-02T07:34:26.216 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2024-04-02T07:34:26.218 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-02T07:34:26.262 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-02T07:34:26.302 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2024-04-02T07:34:26.302 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2024-04-02T07:34:26.302 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-02T07:34:26.303 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2024-04-02T07:34:26.303 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.303 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2024-04-02T07:34:26.303 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.303 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2024-04-02T07:34:26.303 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.303 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2024-04-02T07:34:26.303 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2024-04-02T07:34:26.303 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.303 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2024-04-02T07:34:26.303 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2024-04-02T07:34:26.303 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.303 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-02T07:34:26.304 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2024-04-02T07:34:26.304 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.304 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2024-04-02T07:34:26.304 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-02T07:34:26.304 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.304 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2024-04-02T07:34:26.304 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.304 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2024-04-02T07:34:26.304 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2024-04-02T07:34:26.304 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2024-04-02T07:34:26.304 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2024-04-02T07:34:26.304 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2024-04-02T07:34:26.304 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2024-04-02T07:34:26.304 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2024-04-02T07:34:26.304 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-02T07:34:26.305 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-02T07:34:26.305 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2024-04-02T07:34:26.305 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.305 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-02T07:34:26.305 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.305 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2024-04-02T07:34:26.305 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.305 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2024-04-02T07:34:26.305 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.305 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2024-04-02T07:34:26.305 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2024-04-02T07:34:26.305 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2024-04-02T07:34:26.305 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.55,172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790]" 2024-04-02T07:34:26.305 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = 642a0456-a2ac-49a4-91a5-3b3449b512da 2024-04-02T07:34:26.306 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.306 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2024-04-02T07:34:26.306 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2024-04-02T07:34:26.306 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.306 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2024-04-02T07:34:26.306 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2024-04-02T07:34:26.306 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2024-04-02T07:34:26.306 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.306 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2024-04-02T07:34:26.306 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2024-04-02T07:34:26.306 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.306 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2024-04-02T07:34:26.306 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2024-04-02T07:34:26.306 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2024-04-02T07:34:26.307 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.307 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2024-04-02T07:34:26.307 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2024-04-02T07:34:26.307 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.307 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2024-04-02T07:34:26.307 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.307 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2024-04-02T07:34:26.307 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.307 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2024-04-02T07:34:26.307 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.307 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2024-04-02T07:34:26.307 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2024-04-02T07:34:26.307 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.307 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2024-04-02T07:34:26.307 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2024-04-02T07:34:26.308 INFO:teuthology.orchestra.run.smithi055.stdout: bdev async discard = True 2024-04-02T07:34:26.308 INFO:teuthology.orchestra.run.smithi055.stdout: bdev enable discard = True 2024-04-02T07:34:26.308 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore allocator = bitmap 2024-04-02T07:34:26.308 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2024-04-02T07:34:26.308 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2024-04-02T07:34:26.308 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 1/20 2024-04-02T07:34:26.308 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 1/20 2024-04-02T07:34:26.308 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:34:26.308 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2024-04-02T07:34:26.308 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 4/10 2024-04-02T07:34:26.308 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2024-04-02T07:34:26.308 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2024-04-02T07:34:26.308 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2024-04-02T07:34:26.308 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2024-04-02T07:34:26.308 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2024-04-02T07:34:26.309 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-02T07:34:26.309 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.309 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2024-04-02T07:34:26.309 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:34:26.309 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2024-04-02T07:34:26.309 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-02T07:34:26.309 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-02T07:34:26.309 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-02T07:34:26.309 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-02T07:34:26.309 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2024-04-02T07:34:26.309 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.309 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2024-04-02T07:34:26.309 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:34:26.309 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2024-04-02T07:34:26.310 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2024-04-02T07:34:26.310 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2024-04-02T07:34:26.310 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2024-04-02T07:34:26.310 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2024-04-02T07:34:26.310 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2024-04-02T07:34:26.310 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2024-04-02T07:34:26.310 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2024-04-02T07:34:26.310 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2024-04-02T07:34:26.310 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.310 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-02T07:34:26.310 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2024-04-02T07:34:26.310 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2024-04-02T07:34:26.310 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.310 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2024-04-02T07:34:26.311 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-02T07:34:26.311 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-02T07:34:26.311 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.311 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2024-04-02T07:34:26.311 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2024-04-02T07:34:26.311 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.311 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2024-04-02T07:34:26.311 INFO:teuthology.orchestra.run.smithi055.stdout: mon op complaint time = 120 2024-04-02T07:34:26.311 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:26.311 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2024-04-02T07:34:26.311 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2024-04-02T07:34:26.311 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2024-04-02T07:34:26.311 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2024-04-02T07:34:26.312 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-02T07:34:26.312 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-02T07:34:26.312 INFO:teuthology.orchestra.run.smithi055.stdout: client mount timeout = 600 2024-04-02T07:34:26.312 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2024-04-02T07:34:26.312 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:34:26.312 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = "" 2024-04-02T07:34:26.312 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-02T07:34:26.312 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-02T07:34:26.312 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2024-04-02T07:34:26.312 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2024-04-02T07:34:26.312 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2024-04-02T07:34:26.312 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2024-04-02T07:34:26.312 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2024-04-02T07:34:26.312 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2024-04-02T07:34:26.313 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.d] 2024-04-02T07:34:26.313 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2024-04-02T07:34:26.313 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds = 20 2024-04-02T07:34:26.313 INFO:teuthology.orchestra.run.smithi055.stdout: debug mds balancer = 20 2024-04-02T07:34:26.313 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2024-04-02T07:34:26.313 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug frag = True 2024-04-02T07:34:26.313 INFO:teuthology.orchestra.run.smithi055.stdout: mds debug scatterstat = True 2024-04-02T07:34:26.313 INFO:teuthology.orchestra.run.smithi055.stdout: mds op complaint time = 180 2024-04-02T07:34:26.313 INFO:teuthology.orchestra.run.smithi055.stdout: mds verify scatter = True 2024-04-02T07:34:26.313 INFO:teuthology.orchestra.run.smithi055.stdout: osd op complaint time = 180 2024-04-02T07:34:26.313 INFO:teuthology.orchestra.run.smithi055.stdout: rados mon op timeout = 900 2024-04-02T07:34:26.313 INFO:teuthology.orchestra.run.smithi055.stdout: rados osd op timeout = 900 2024-04-02T07:34:26.314 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2024-04-02T07:34:26.314 INFO:teuthology.orchestra.run.smithi106.stdout: chdir = "" 2024-04-02T07:34:26.314 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-02T07:34:26.314 INFO:teuthology.orchestra.run.smithi106.stdout: auth supported = cephx 2024-04-02T07:34:26.314 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.314 INFO:teuthology.orchestra.run.smithi106.stdout: filestore xattr use omap = true 2024-04-02T07:34:26.314 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.314 INFO:teuthology.orchestra.run.smithi106.stdout: mon clock drift allowed = 1.000 2024-04-02T07:34:26.314 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.314 INFO:teuthology.orchestra.run.smithi106.stdout: osd crush chooseleaf type = 0 2024-04-02T07:34:26.315 INFO:teuthology.orchestra.run.smithi106.stdout: auth debug = true 2024-04-02T07:34:26.315 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.315 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on old message = true 2024-04-02T07:34:26.315 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on bug = true 2024-04-02T07:34:26.315 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.315 INFO:teuthology.orchestra.run.smithi106.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-02T07:34:26.315 INFO:teuthology.orchestra.run.smithi106.stdout: mon pg warn max object skew = 0 2024-04-02T07:34:26.315 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.315 INFO:teuthology.orchestra.run.smithi106.stdout: # disable pg_autoscaler by default for new pools 2024-04-02T07:34:26.315 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-02T07:34:26.315 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.315 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default size = 2 2024-04-02T07:34:26.315 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.316 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow primary affinity = true 2024-04-02T07:34:26.316 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow pg remap = true 2024-04-02T07:34:26.316 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on legacy crush tunables = false 2024-04-02T07:34:26.316 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on crush straw calc version zero = false 2024-04-02T07:34:26.316 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on no sortbitwise = false 2024-04-02T07:34:26.316 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on osd down out interval zero = false 2024-04-02T07:34:26.316 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on too few osds = false 2024-04-02T07:34:26.316 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-02T07:34:26.316 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-02T07:34:26.316 INFO:teuthology.orchestra.run.smithi106.stdout: mon_allow_pool_size_one = true 2024-04-02T07:34:26.316 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.316 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-02T07:34:26.316 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.317 INFO:teuthology.orchestra.run.smithi106.stdout: osd default data pool replay window = 5 2024-04-02T07:34:26.317 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.317 INFO:teuthology.orchestra.run.smithi106.stdout: mon allow pool delete = true 2024-04-02T07:34:26.317 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.317 INFO:teuthology.orchestra.run.smithi106.stdout: mon cluster log file level = debug 2024-04-02T07:34:26.317 INFO:teuthology.orchestra.run.smithi106.stdout: debug asserts on shutdown = true 2024-04-02T07:34:26.317 INFO:teuthology.orchestra.run.smithi106.stdout: mon health detail to clog = false 2024-04-02T07:34:26.317 INFO:teuthology.orchestra.run.smithi106.stdout: mon host = "172.21.15.55,172.21.15.106,[v2:172.21.15.106:3301,v1:172.21.15.106:6790]" 2024-04-02T07:34:26.317 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = 642a0456-a2ac-49a4-91a5-3b3449b512da 2024-04-02T07:34:26.317 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.317 INFO:teuthology.orchestra.run.smithi106.stdout:[osd] 2024-04-02T07:34:26.317 INFO:teuthology.orchestra.run.smithi106.stdout: osd journal size = 100 2024-04-02T07:34:26.317 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.318 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub load threshold = 5.0 2024-04-02T07:34:26.318 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub max interval = 600 2024-04-02T07:34:26.318 INFO:teuthology.orchestra.run.smithi106.stdout: osd mclock profile = high_recovery_ops 2024-04-02T07:34:26.318 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.318 INFO:teuthology.orchestra.run.smithi106.stdout: osd recover clone overlap = true 2024-04-02T07:34:26.318 INFO:teuthology.orchestra.run.smithi106.stdout: osd recovery max chunk = 1048576 2024-04-02T07:34:26.318 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.318 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug shutdown = true 2024-04-02T07:34:26.318 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug op order = true 2024-04-02T07:34:26.318 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify stray on activate = true 2024-04-02T07:34:26.318 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.318 INFO:teuthology.orchestra.run.smithi106.stdout: osd open classes on start = true 2024-04-02T07:34:26.318 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug pg log writeout = true 2024-04-02T07:34:26.319 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.319 INFO:teuthology.orchestra.run.smithi106.stdout: osd deep scrub update digest min age = 30 2024-04-02T07:34:26.319 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.319 INFO:teuthology.orchestra.run.smithi106.stdout: osd map max advance = 10 2024-04-02T07:34:26.319 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.319 INFO:teuthology.orchestra.run.smithi106.stdout: journal zero on create = true 2024-04-02T07:34:26.319 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.319 INFO:teuthology.orchestra.run.smithi106.stdout: filestore ondisk finisher threads = 3 2024-04-02T07:34:26.319 INFO:teuthology.orchestra.run.smithi106.stdout: filestore apply finisher threads = 3 2024-04-02T07:34:26.319 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.319 INFO:teuthology.orchestra.run.smithi106.stdout: bdev debug aio = true 2024-04-02T07:34:26.319 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug misdirected ops = true 2024-04-02T07:34:26.319 INFO:teuthology.orchestra.run.smithi106.stdout: bdev async discard = True 2024-04-02T07:34:26.320 INFO:teuthology.orchestra.run.smithi106.stdout: bdev enable discard = True 2024-04-02T07:34:26.320 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore allocator = bitmap 2024-04-02T07:34:26.320 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore block size = 96636764160 2024-04-02T07:34:26.320 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore fsck on mount = True 2024-04-02T07:34:26.320 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluefs = 1/20 2024-04-02T07:34:26.320 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluestore = 1/20 2024-04-02T07:34:26.320 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:34:26.320 INFO:teuthology.orchestra.run.smithi106.stdout: debug osd = 20 2024-04-02T07:34:26.320 INFO:teuthology.orchestra.run.smithi106.stdout: debug rocksdb = 4/10 2024-04-02T07:34:26.320 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd backfillfull_ratio = 0.85 2024-04-02T07:34:26.320 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd full ratio = 0.9 2024-04-02T07:34:26.320 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd nearfull ratio = 0.8 2024-04-02T07:34:26.320 INFO:teuthology.orchestra.run.smithi106.stdout: osd failsafe full ratio = 0.95 2024-04-02T07:34:26.321 INFO:teuthology.orchestra.run.smithi106.stdout: osd objectstore = bluestore 2024-04-02T07:34:26.321 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2024-04-02T07:34:26.321 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.321 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr] 2024-04-02T07:34:26.321 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:34:26.321 INFO:teuthology.orchestra.run.smithi106.stdout: debug mgr = 20 2024-04-02T07:34:26.321 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-04-02T07:34:26.321 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-04-02T07:34:26.321 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-04-02T07:34:26.321 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-04-02T07:34:26.321 INFO:teuthology.orchestra.run.smithi106.stdout: mgr/telemetry/nag = false 2024-04-02T07:34:26.321 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.321 INFO:teuthology.orchestra.run.smithi106.stdout:[mon] 2024-04-02T07:34:26.321 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:34:26.322 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-04-02T07:34:26.322 INFO:teuthology.orchestra.run.smithi106.stdout: debug paxos = 20 2024-04-02T07:34:26.322 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-04-02T07:34:26.322 INFO:teuthology.orchestra.run.smithi106.stdout: mon data avail warn = 5 2024-04-02T07:34:26.322 INFO:teuthology.orchestra.run.smithi106.stdout: mon mgr mkfs grace = 240 2024-04-02T07:34:26.322 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-04-02T07:34:26.322 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd reporter subtree level = osd 2024-04-02T07:34:26.322 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd prime pg temp = true 2024-04-02T07:34:26.322 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-04-02T07:34:26.322 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.322 INFO:teuthology.orchestra.run.smithi106.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-02T07:34:26.322 INFO:teuthology.orchestra.run.smithi106.stdout: auth mon ticket ttl = 660 # 11m 2024-04-02T07:34:26.322 INFO:teuthology.orchestra.run.smithi106.stdout: auth service ticket ttl = 240 # 4m 2024-04-02T07:34:26.322 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.323 INFO:teuthology.orchestra.run.smithi106.stdout: # don't complain about insecure global_id in the test suite 2024-04-02T07:34:26.323 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-02T07:34:26.323 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-02T07:34:26.323 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.323 INFO:teuthology.orchestra.run.smithi106.stdout: # 1m isn't quite enough 2024-04-02T07:34:26.323 INFO:teuthology.orchestra.run.smithi106.stdout: mon_down_mkfs_grace = 2m 2024-04-02T07:34:26.323 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.323 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_filestore_osds = false 2024-04-02T07:34:26.323 INFO:teuthology.orchestra.run.smithi106.stdout: mon op complaint time = 120 2024-04-02T07:34:26.323 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-02T07:34:26.323 INFO:teuthology.orchestra.run.smithi106.stdout:[client] 2024-04-02T07:34:26.323 INFO:teuthology.orchestra.run.smithi106.stdout: rgw cache enabled = true 2024-04-02T07:34:26.323 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable ops log = true 2024-04-02T07:34:26.323 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable usage log = true 2024-04-02T07:34:26.324 INFO:teuthology.orchestra.run.smithi106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-02T07:34:26.324 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-02T07:34:26.324 INFO:teuthology.orchestra.run.smithi106.stdout: client mount timeout = 600 2024-04-02T07:34:26.324 INFO:teuthology.orchestra.run.smithi106.stdout: debug client = 20 2024-04-02T07:34:26.324 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:34:26.324 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = "" 2024-04-02T07:34:26.324 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2024-04-02T07:34:26.324 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2024-04-02T07:34:26.324 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.a] 2024-04-02T07:34:26.324 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.b] 2024-04-02T07:34:26.324 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.c] 2024-04-02T07:34:26.324 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.a] 2024-04-02T07:34:26.324 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.c] 2024-04-02T07:34:26.324 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.b] 2024-04-02T07:34:26.324 INFO:teuthology.orchestra.run.smithi106.stdout:[mds.d] 2024-04-02T07:34:26.325 INFO:teuthology.orchestra.run.smithi106.stdout:[mds] 2024-04-02T07:34:26.325 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds = 20 2024-04-02T07:34:26.325 INFO:teuthology.orchestra.run.smithi106.stdout: debug mds balancer = 20 2024-04-02T07:34:26.325 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-02T07:34:26.325 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug frag = True 2024-04-02T07:34:26.325 INFO:teuthology.orchestra.run.smithi106.stdout: mds debug scatterstat = True 2024-04-02T07:34:26.325 INFO:teuthology.orchestra.run.smithi106.stdout: mds op complaint time = 180 2024-04-02T07:34:26.325 INFO:teuthology.orchestra.run.smithi106.stdout: mds verify scatter = True 2024-04-02T07:34:26.325 INFO:teuthology.orchestra.run.smithi106.stdout: osd op complaint time = 180 2024-04-02T07:34:26.325 INFO:teuthology.orchestra.run.smithi106.stdout: rados mon op timeout = 900 2024-04-02T07:34:26.325 INFO:teuthology.orchestra.run.smithi106.stdout: rados osd op timeout = 900 2024-04-02T07:34:26.327 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs joinable true 2024-04-02T07:34:26.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.515+0000 7fa67b000640 1 Processor -- start 2024-04-02T07:34:26.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.515+0000 7fa67b000640 1 -- start start 2024-04-02T07:34:26.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.515+0000 7fa67b000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa67415c920 0x7fa6740b1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.515+0000 7fa67b000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa67415de30 con 0x7fa6740afa70 2024-04-02T07:34:26.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.515+0000 7fa67b000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa674098ab0 con 0x7fa6740cd690 2024-04-02T07:34:26.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.515+0000 7fa67b000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa674098d90 con 0x7fa67415c920 2024-04-02T07:34:26.515 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.515+0000 7fa66b400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa6740afa70 0x7fa6740ccf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57554/0 (socket says 172.21.15.55:57554) 2024-04-02T07:34:26.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.515+0000 7fa66b400640 1 -- 172.21.15.55:0/2648145309 learned_addr learned my addr 172.21.15.55:0/2648145309 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:26.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.515+0000 7fa673e00640 1 --2- 172.21.15.55:0/2648145309 >> v2:172.21.15.106:3300/0 conn(0x7fa67415c920 0x7fa6740b1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.515+0000 7fa673400640 1 -- 172.21.15.55:0/2648145309 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084911615 0 0) 0x7fa67415de30 con 0x7fa6740afa70 2024-04-02T07:34:26.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.515+0000 7fa673e00640 1 -- 172.21.15.55:0/2648145309 >> v1:172.21.15.106:6789/0 conn(0x7fa6740cd690 legacy=0x7fa67406aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:26.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.515+0000 7fa673e00640 1 -- 172.21.15.55:0/2648145309 >> v1:172.21.15.55:6789/0 conn(0x7fa6740afa70 legacy=0x7fa6740ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:26.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.515+0000 7fa673e00640 1 -- 172.21.15.55:0/2648145309 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa674099070 con 0x7fa67415c920 2024-04-02T07:34:26.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.519+0000 7fa673e00640 1 --2- 172.21.15.55:0/2648145309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa67415c920 0x7fa6740b1ca0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa664009d90 tx=0x7fa66401c940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=276ba140f8a18b86 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:26.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.519+0000 7fa673400640 1 -- 172.21.15.55:0/2648145309 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6640a5960 con 0x7fa67415c920 2024-04-02T07:34:26.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.519+0000 7fa673400640 1 -- 172.21.15.55:0/2648145309 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6640a5ac0 con 0x7fa67415c920 2024-04-02T07:34:26.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.519+0000 7fa673400640 1 -- 172.21.15.55:0/2648145309 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6640a5e50 con 0x7fa67415c920 2024-04-02T07:34:26.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.519+0000 7fa67b000640 1 -- 172.21.15.55:0/2648145309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa67415c920 msgr2=0x7fa6740b1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:26.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.519+0000 7fa67b000640 1 --2- 172.21.15.55:0/2648145309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa67415c920 0x7fa6740b1ca0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa664009d90 tx=0x7fa66401c940 comp rx=0 tx=0).stop 2024-04-02T07:34:26.520 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.519+0000 7fa67b000640 1 -- 172.21.15.55:0/2648145309 shutdown_connections 2024-04-02T07:34:26.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.519+0000 7fa67b000640 1 --2- 172.21.15.55:0/2648145309 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa67415c920 0x7fa6740b1ca0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.519+0000 7fa67b000640 1 -- 172.21.15.55:0/2648145309 >> 172.21.15.55:0/2648145309 conn(0x7fa6740d0700 msgr2=0x7fa6740d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:26.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.519+0000 7fa67b000640 1 -- 172.21.15.55:0/2648145309 shutdown_connections 2024-04-02T07:34:26.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.519+0000 7fa67b000640 1 -- 172.21.15.55:0/2648145309 wait complete. 2024-04-02T07:34:26.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa67b000640 1 Processor -- start 2024-04-02T07:34:26.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa67b000640 1 -- start start 2024-04-02T07:34:26.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa67b000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6740afa70 0x7fa67414cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa67b000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa6740cd690 0x7fa67414d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa67b000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa67415c920 0x7fa6740cbab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa67b000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67415eb40 con 0x7fa6740afa70 2024-04-02T07:34:26.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa67b000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa67414d020 con 0x7fa67415c920 2024-04-02T07:34:26.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa67b000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6740cb850 con 0x7fa6740cd690 2024-04-02T07:34:26.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa673e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6740afa70 0x7fa67414cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa673e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6740afa70 0x7fa67414cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33932/0 (socket says 172.21.15.55:33932) 2024-04-02T07:34:26.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa673e00640 1 -- 172.21.15.55:0/1820499875 learned_addr learned my addr 172.21.15.55:0/1820499875 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:26.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa679000640 1 --2- 172.21.15.55:0/1820499875 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa67415c920 0x7fa6740cbab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa66b400640 1 --2- 172.21.15.55:0/1820499875 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa6740cd690 0x7fa67414d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa673e00640 1 -- 172.21.15.55:0/1820499875 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa6740cd690 msgr2=0x7fa67414d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:26.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa673e00640 1 --2- 172.21.15.55:0/1820499875 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa6740cd690 0x7fa67414d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa673e00640 1 -- 172.21.15.55:0/1820499875 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa67415c920 msgr2=0x7fa6740cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:26.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa673e00640 1 --2- 172.21.15.55:0/1820499875 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa67415c920 0x7fa6740cbab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:26.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa673e00640 1 -- 172.21.15.55:0/1820499875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa664009a70 con 0x7fa6740afa70 2024-04-02T07:34:26.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa673e00640 1 --2- 172.21.15.55:0/1820499875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6740afa70 0x7fa67414cae0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fa664000f90 tx=0x7fa6640196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:26.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa670c00640 1 -- 172.21.15.55:0/1820499875 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6640adc20 con 0x7fa6740afa70 2024-04-02T07:34:26.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa670c00640 1 -- 172.21.15.55:0/1820499875 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6640add80 con 0x7fa6740afa70 2024-04-02T07:34:26.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa67b000640 1 -- 172.21.15.55:0/1820499875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa674151fa0 con 0x7fa6740afa70 2024-04-02T07:34:26.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa670c00640 1 -- 172.21.15.55:0/1820499875 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6640b8620 con 0x7fa6740afa70 2024-04-02T07:34:26.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.523+0000 7fa67b000640 1 -- 172.21.15.55:0/1820499875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa674152560 con 0x7fa6740afa70 2024-04-02T07:34:26.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.527+0000 7fa67b000640 1 -- 172.21.15.55:0/1820499875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa674066c90 con 0x7fa6740afa70 2024-04-02T07:34:26.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.527+0000 7fa670c00640 1 -- 172.21.15.55:0/1820499875 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa6640b8780 con 0x7fa6740afa70 2024-04-02T07:34:26.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.527+0000 7fa670c00640 1 --2- 172.21.15.55:0/1820499875 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa6500666c0 0x7fa650068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:26.526 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.527+0000 7fa670c00640 1 -- 172.21.15.55:0/1820499875 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7fa66411fc60 con 0x7fa6740afa70 2024-04-02T07:34:26.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.527+0000 7fa66b400640 1 --2- 172.21.15.55:0/1820499875 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa6500666c0 0x7fa650068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:26.527 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.527+0000 7fa66b400640 1 --2- 172.21.15.55:0/1820499875 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa6500666c0 0x7fa650068b80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa65c000f70 tx=0x7fa65c007240 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:26.529 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.531+0000 7fa670c00640 1 -- 172.21.15.55:0/1820499875 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa6640ed120 con 0x7fa6740afa70 2024-04-02T07:34:26.727 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:26.727+0000 7fa67b000640 1 -- 172.21.15.55:0/1820499875 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} v 0) v1 -- 0x7fa67406ff70 con 0x7fa6740afa70 2024-04-02T07:34:27.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.575+0000 7fa670c00640 1 -- 172.21.15.55:0/1820499875 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]=0 cephfs marked joinable; MDS may join as newly active. v105) v1 ==== 162+0+0 (secure 0 0 0) 0x7fa6640c60b0 con 0x7fa6740afa70 2024-04-02T07:34:27.573 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked joinable; MDS may join as newly active. 2024-04-02T07:34:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.575+0000 7fa67b000640 1 -- 172.21.15.55:0/1820499875 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa6500666c0 msgr2=0x7fa650068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.575+0000 7fa67b000640 1 --2- 172.21.15.55:0/1820499875 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa6500666c0 0x7fa650068b80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fa65c000f70 tx=0x7fa65c007240 comp rx=0 tx=0).stop 2024-04-02T07:34:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.575+0000 7fa67b000640 1 -- 172.21.15.55:0/1820499875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6740afa70 msgr2=0x7fa67414cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.575+0000 7fa67b000640 1 --2- 172.21.15.55:0/1820499875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6740afa70 0x7fa67414cae0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7fa664000f90 tx=0x7fa6640196e0 comp rx=0 tx=0).stop 2024-04-02T07:34:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.575+0000 7fa67b000640 1 -- 172.21.15.55:0/1820499875 shutdown_connections 2024-04-02T07:34:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.575+0000 7fa67b000640 1 --2- 172.21.15.55:0/1820499875 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa6500666c0 0x7fa650068b80 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.575+0000 7fa67b000640 1 --2- 172.21.15.55:0/1820499875 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa67415c920 0x7fa6740cbab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.575+0000 7fa67b000640 1 --2- 172.21.15.55:0/1820499875 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa6740cd690 0x7fa67414d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.575+0000 7fa67b000640 1 --2- 172.21.15.55:0/1820499875 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa6740afa70 0x7fa67414cae0 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.575+0000 7fa67b000640 1 -- 172.21.15.55:0/1820499875 >> 172.21.15.55:0/1820499875 conn(0x7fa6740d0700 msgr2=0x7fa67415d060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.575+0000 7fa67b000640 1 -- 172.21.15.55:0/1820499875 shutdown_connections 2024-04-02T07:34:27.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.575+0000 7fa67b000640 1 -- 172.21.15.55:0/1820499875 wait complete. 2024-04-02T07:34:27.602 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:34:27.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.747+0000 7f5f44000640 1 Processor -- start 2024-04-02T07:34:27.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.747+0000 7f5f44000640 1 -- start start 2024-04-02T07:34:27.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.747+0000 7f5f44000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5f3c15a480 0x7f5f3c0ca460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:27.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.747+0000 7f5f44000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5f3c0b1070 0x7f5f3c0c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:27.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.747+0000 7f5f44000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f3c15a860 con 0x7f5f3c0ca9a0 2024-04-02T07:34:27.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.747+0000 7f5f44000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f3c15ce20 con 0x7f5f3c15a480 2024-04-02T07:34:27.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.747+0000 7f5f44000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0cade0 con 0x7f5f3c0b1070 2024-04-02T07:34:27.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.747+0000 7f5f40c00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5f3c0ca9a0 0x7f5f3c0b0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57560/0 (socket says 172.21.15.55:57560) 2024-04-02T07:34:27.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.747+0000 7f5f40c00640 1 -- 172.21.15.55:0/907749301 learned_addr learned my addr 172.21.15.55:0/907749301 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:27.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.751+0000 7f5f41600640 1 --2- 172.21.15.55:0/907749301 >> v2:172.21.15.106:3300/0 conn(0x7f5f3c15a480 0x7f5f3c0ca460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:27.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.751+0000 7f5f42000640 1 --2- 172.21.15.55:0/907749301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5f3c0b1070 0x7f5f3c0c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:27.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.751+0000 7f5f3be00640 1 -- 172.21.15.55:0/907749301 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1738781874 0 0) 0x7f5f28001120 con 0x7f5f3c0ca9a0 2024-04-02T07:34:27.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.751+0000 7f5f3be00640 1 -- 172.21.15.55:0/907749301 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f24003530 con 0x7f5f3c0ca9a0 2024-04-02T07:34:27.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.751+0000 7f5f41600640 1 -- 172.21.15.55:0/907749301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5f3c0b1070 msgr2=0x7f5f3c0c8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:27.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.751+0000 7f5f41600640 1 --2- 172.21.15.55:0/907749301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5f3c0b1070 0x7f5f3c0c8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:27.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.751+0000 7f5f41600640 1 -- 172.21.15.55:0/907749301 >> v1:172.21.15.55:6789/0 conn(0x7f5f3c0ca9a0 legacy=0x7f5f3c0b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:27.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.751+0000 7f5f41600640 1 -- 172.21.15.55:0/907749301 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f3c0cb570 con 0x7f5f3c15a480 2024-04-02T07:34:27.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.751+0000 7f5f41600640 1 --2- 172.21.15.55:0/907749301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f3c15a480 0x7f5f3c0ca460 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5f300097c0 tx=0x7f5f3001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=363626f161959137 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:27.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.751+0000 7f5f3be00640 1 -- 172.21.15.55:0/907749301 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f300ad640 con 0x7f5f3c15a480 2024-04-02T07:34:27.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.751+0000 7f5f3be00640 1 -- 172.21.15.55:0/907749301 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f300ad7a0 con 0x7f5f3c15a480 2024-04-02T07:34:27.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.751+0000 7f5f3be00640 1 -- 172.21.15.55:0/907749301 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f300adb30 con 0x7f5f3c15a480 2024-04-02T07:34:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f44000640 1 -- 172.21.15.55:0/907749301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f3c15a480 msgr2=0x7f5f3c0ca460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f44000640 1 --2- 172.21.15.55:0/907749301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f3c15a480 0x7f5f3c0ca460 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5f300097c0 tx=0x7f5f3001c4a0 comp rx=0 tx=0).stop 2024-04-02T07:34:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f44000640 1 -- 172.21.15.55:0/907749301 shutdown_connections 2024-04-02T07:34:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f44000640 1 --2- 172.21.15.55:0/907749301 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5f3c0b1070 0x7f5f3c0c8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f44000640 1 --2- 172.21.15.55:0/907749301 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f3c15a480 0x7f5f3c0ca460 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f44000640 1 -- 172.21.15.55:0/907749301 >> 172.21.15.55:0/907749301 conn(0x7f5f3c066080 msgr2=0x7f5f3c069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f44000640 1 -- 172.21.15.55:0/907749301 shutdown_connections 2024-04-02T07:34:27.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f44000640 1 -- 172.21.15.55:0/907749301 wait complete. 2024-04-02T07:34:27.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f44000640 1 Processor -- start 2024-04-02T07:34:27.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f44000640 1 -- start start 2024-04-02T07:34:27.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f44000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f3c0b1070 0x7f5f3c14cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:27.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f44000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5f3c0ca9a0 0x7f5f3c15b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:27.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f44000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f3c15a480 0x7f5f3c154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:27.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f44000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c15c400 con 0x7f5f3c0b1070 2024-04-02T07:34:27.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f44000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c0b1a10 con 0x7f5f3c15a480 2024-04-02T07:34:27.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f44000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f3c15be40 con 0x7f5f3c0ca9a0 2024-04-02T07:34:27.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f41600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f3c0b1070 0x7f5f3c14cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:27.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f41600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f3c0b1070 0x7f5f3c14cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33944/0 (socket says 172.21.15.55:33944) 2024-04-02T07:34:27.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f41600640 1 -- 172.21.15.55:0/625053434 learned_addr learned my addr 172.21.15.55:0/625053434 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:27.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f42000640 1 --2- 172.21.15.55:0/625053434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f3c15a480 0x7f5f3c154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:27.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f40c00640 1 --2- 172.21.15.55:0/625053434 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5f3c0ca9a0 0x7f5f3c15b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:27.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f41600640 1 -- 172.21.15.55:0/625053434 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5f3c0ca9a0 msgr2=0x7f5f3c15b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:27.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f41600640 1 --2- 172.21.15.55:0/625053434 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5f3c0ca9a0 0x7f5f3c15b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:27.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f41600640 1 -- 172.21.15.55:0/625053434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f3c15a480 msgr2=0x7f5f3c154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:27.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f41600640 1 --2- 172.21.15.55:0/625053434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f3c15a480 0x7f5f3c154960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:27.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.755+0000 7f5f41600640 1 -- 172.21.15.55:0/625053434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f30009420 con 0x7f5f3c0b1070 2024-04-02T07:34:27.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.759+0000 7f5f41600640 1 --2- 172.21.15.55:0/625053434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f3c0b1070 0x7f5f3c14cd80 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f5f300097c0 tx=0x7f5f30019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:27.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.759+0000 7f5f39600640 1 -- 172.21.15.55:0/625053434 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f300b6610 con 0x7f5f3c0b1070 2024-04-02T07:34:27.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.759+0000 7f5f39600640 1 -- 172.21.15.55:0/625053434 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f300a6040 con 0x7f5f3c0b1070 2024-04-02T07:34:27.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.759+0000 7f5f39600640 1 -- 172.21.15.55:0/625053434 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f300b69b0 con 0x7f5f3c0b1070 2024-04-02T07:34:27.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.759+0000 7f5f44000640 1 -- 172.21.15.55:0/625053434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f3c15c120 con 0x7f5f3c0b1070 2024-04-02T07:34:27.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.759+0000 7f5f44000640 1 -- 172.21.15.55:0/625053434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f3c14d2c0 con 0x7f5f3c0b1070 2024-04-02T07:34:27.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.759+0000 7f5f44000640 1 -- 172.21.15.55:0/625053434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f3c0b1500 con 0x7f5f3c0b1070 2024-04-02T07:34:27.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.759+0000 7f5f39600640 1 -- 172.21.15.55:0/625053434 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5f300b4040 con 0x7f5f3c0b1070 2024-04-02T07:34:27.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.759+0000 7f5f39600640 1 --2- 172.21.15.55:0/625053434 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5f1c066690 0x7f5f1c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:27.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.759+0000 7f5f39600640 1 -- 172.21.15.55:0/625053434 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f5f3011e3f0 con 0x7f5f3c0b1070 2024-04-02T07:34:27.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.759+0000 7f5f40c00640 1 --2- 172.21.15.55:0/625053434 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5f1c066690 0x7f5f1c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:27.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.763+0000 7f5f40c00640 1 --2- 172.21.15.55:0/625053434 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5f1c066690 0x7f5f1c068b50 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c1596c0 tx=0x7f5f28009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:27.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.763+0000 7f5f39600640 1 -- 172.21.15.55:0/625053434 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5f3c0b1500 con 0x7f5f3c0b1070 2024-04-02T07:34:27.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.963+0000 7f5f44000640 1 -- 172.21.15.55:0/625053434 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f3c0b1500 con 0x7f5f3c0b1070 2024-04-02T07:34:27.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.963+0000 7f5f39600640 1 -- 172.21.15.55:0/625053434 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+4747 (secure 0 0 0) 0x7f5f3c0b1500 con 0x7f5f3c0b1070 2024-04-02T07:34:27.961 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:27.961 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":106,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7592,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2292883244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2292883244},{"type":"v1","addr":"172.21.15.106:6836","nonce":2292883244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":7835,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3165795379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3165795379},{"type":"v1","addr":"172.21.15.106:6837","nonce":3165795379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":9147,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2700619140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2700619140},{"type":"v1","addr":"172.21.15.55:6834","nonce":2700619140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":106,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:33:27.846433+0000","modified":"2024-04-02T07:34:27.576733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9717":{"gid":9717,"name":"a","rank":0,"incarnation":106,"state":"up:replay","state_seq":1,"addr":"172.21.15.55:6835/1279080129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1279080129},{"type":"v1","addr":"172.21.15.55:6835","nonce":1279080129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-02T07:34:27.962 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 106 2024-04-02T07:34:27.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.963+0000 7f5f44000640 1 -- 172.21.15.55:0/625053434 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5f1c066690 msgr2=0x7f5f1c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:27.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.963+0000 7f5f44000640 1 --2- 172.21.15.55:0/625053434 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5f1c066690 0x7f5f1c068b50 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c1596c0 tx=0x7f5f28009040 comp rx=0 tx=0).stop 2024-04-02T07:34:27.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.963+0000 7f5f44000640 1 -- 172.21.15.55:0/625053434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f3c0b1070 msgr2=0x7f5f3c14cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:27.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.963+0000 7f5f44000640 1 --2- 172.21.15.55:0/625053434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f3c0b1070 0x7f5f3c14cd80 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f5f300097c0 tx=0x7f5f30019240 comp rx=0 tx=0).stop 2024-04-02T07:34:27.963 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.963+0000 7f5f44000640 1 -- 172.21.15.55:0/625053434 shutdown_connections 2024-04-02T07:34:27.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.963+0000 7f5f44000640 1 --2- 172.21.15.55:0/625053434 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5f1c066690 0x7f5f1c068b50 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:27.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.963+0000 7f5f44000640 1 --2- 172.21.15.55:0/625053434 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5f3c15a480 0x7f5f3c154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:27.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.963+0000 7f5f44000640 1 --2- 172.21.15.55:0/625053434 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5f3c0ca9a0 0x7f5f3c15b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:27.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.963+0000 7f5f44000640 1 --2- 172.21.15.55:0/625053434 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5f3c0b1070 0x7f5f3c14cd80 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:27.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.963+0000 7f5f44000640 1 -- 172.21.15.55:0/625053434 >> 172.21.15.55:0/625053434 conn(0x7f5f3c066080 msgr2=0x7f5f3c070420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:27.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.963+0000 7f5f44000640 1 -- 172.21.15.55:0/625053434 shutdown_connections 2024-04-02T07:34:27.964 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:27.963+0000 7f5f44000640 1 -- 172.21.15.55:0/625053434 wait complete. 2024-04-02T07:34:28.386 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 106, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:33:27.846433+0000', 'modified': '2024-04-02T07:34:27.576733+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 120, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9717}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9717': {'gid': 9717, 'name': 'a', 'rank': 0, 'incarnation': 106, 'state': 'up:replay', 'state_seq': 1, 'addr': '172.21.15.55:6835/1279080129', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 1279080129}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 1279080129}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:34:28.386 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9717:up:replay 2024-04-02T07:34:29.387 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:34:29.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1e6c00640 1 Processor -- start 2024-04-02T07:34:29.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1e6c00640 1 -- start start 2024-04-02T07:34:29.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1e6c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1e015ca70 0x7fd1e00b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:29.542 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1e6c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd1e0098a10 0x7fd1e0098e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:29.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1e6c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1e00993b0 con 0x7fd1e006aff0 2024-04-02T07:34:29.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1e6c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1e015ce50 con 0x7fd1e0098a10 2024-04-02T07:34:29.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1e6c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00cef60 con 0x7fd1e015ca70 2024-04-02T07:34:29.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1e4c00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd1e006aff0 0x7fd1e006b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57564/0 (socket says 172.21.15.55:57564) 2024-04-02T07:34:29.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1e4c00640 1 -- 172.21.15.55:0/3871517163 learned_addr learned my addr 172.21.15.55:0/3871517163 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:29.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1dfe00640 1 --2- 172.21.15.55:0/3871517163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1e015ca70 0x7fd1e00b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:29.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1d7400640 1 --2- 172.21.15.55:0/3871517163 >> v2:172.21.15.106:3300/0 conn(0x7fd1e0098a10 0x7fd1e0098e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:29.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1df400640 1 -- 172.21.15.55:0/3871517163 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 184674828 0 0) 0x7fd1e00993b0 con 0x7fd1e006aff0 2024-04-02T07:34:29.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1df400640 1 -- 172.21.15.55:0/3871517163 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c4003530 con 0x7fd1e006aff0 2024-04-02T07:34:29.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1df400640 1 -- 172.21.15.55:0/3871517163 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1131453650 0 0) 0x7fd1c4003530 con 0x7fd1e006aff0 2024-04-02T07:34:29.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1df400640 1 -- 172.21.15.55:0/3871517163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1e015ca70 msgr2=0x7fd1e00b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:29.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1df400640 1 --2- 172.21.15.55:0/3871517163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1e015ca70 0x7fd1e00b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:29.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1df400640 1 -- 172.21.15.55:0/3871517163 >> v2:172.21.15.106:3300/0 conn(0x7fd1e0098a10 msgr2=0x7fd1e0098e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:29.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1df400640 1 --2- 172.21.15.55:0/3871517163 >> v2:172.21.15.106:3300/0 conn(0x7fd1e0098a10 0x7fd1e0098e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:29.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1df400640 1 -- 172.21.15.55:0/3871517163 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e006bd60 con 0x7fd1e006aff0 2024-04-02T07:34:29.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1df400640 1 -- 172.21.15.55:0/3871517163 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fd1d8001a00 con 0x7fd1e006aff0 2024-04-02T07:34:29.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1dfe00640 1 --2- 172.21.15.55:0/3871517163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1e015ca70 0x7fd1e00b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:34:29.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1df400640 1 -- 172.21.15.55:0/3871517163 >> v1:172.21.15.55:6789/0 conn(0x7fd1e006aff0 legacy=0x7fd1e006b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:29.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1df400640 1 --2- 172.21.15.55:0/3871517163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1c4003980 0x7fd1c4003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1df400640 1 --2- 172.21.15.55:0/3871517163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1e015ca70 0x7fd1c40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1df400640 1 --2- 172.21.15.55:0/3871517163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1c4004d10 0x7fd1c4005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1df400640 1 -- 172.21.15.55:0/3871517163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e015ce50 con 0x7fd1c4003980 2024-04-02T07:34:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1df400640 1 -- 172.21.15.55:0/3871517163 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00cef60 con 0x7fd1c4004d10 2024-04-02T07:34:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1df400640 1 -- 172.21.15.55:0/3871517163 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c400b990 con 0x7fd1e015ca70 2024-04-02T07:34:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1d7400640 1 --2- 172.21.15.55:0/3871517163 >> v2:172.21.15.106:3300/0 conn(0x7fd1e0098a10 0x7fd1e0098e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:34:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1dfe00640 1 --2- 172.21.15.55:0/3871517163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1c4003980 0x7fd1c4003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1e4c00640 1 --2- 172.21.15.55:0/3871517163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1c4004d10 0x7fd1c4005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1d7400640 1 --2- 172.21.15.55:0/3871517163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1e015ca70 0x7fd1c40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1dfe00640 1 -- 172.21.15.55:0/3871517163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1e015ca70 msgr2=0x7fd1c40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1dfe00640 1 --2- 172.21.15.55:0/3871517163 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1e015ca70 0x7fd1c40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1dfe00640 1 -- 172.21.15.55:0/3871517163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1c4004d10 msgr2=0x7fd1c4005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1dfe00640 1 --2- 172.21.15.55:0/3871517163 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1c4004d10 0x7fd1c4005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:29.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.543+0000 7fd1dfe00640 1 -- 172.21.15.55:0/3871517163 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d0009420 con 0x7fd1c4003980 2024-04-02T07:34:29.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.547+0000 7fd1dfe00640 1 --2- 172.21.15.55:0/3871517163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1c4003980 0x7fd1c4003da0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009cb0 tx=0x7fd1d001cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35ad914c5586dff9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.547+0000 7fd1df400640 1 -- 172.21.15.55:0/3871517163 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00a56b0 con 0x7fd1c4003980 2024-04-02T07:34:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.547+0000 7fd1df400640 1 -- 172.21.15.55:0/3871517163 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d00a5810 con 0x7fd1c4003980 2024-04-02T07:34:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.547+0000 7fd1df400640 1 -- 172.21.15.55:0/3871517163 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d00a5bc0 con 0x7fd1c4003980 2024-04-02T07:34:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.547+0000 7fd1e6c00640 1 -- 172.21.15.55:0/3871517163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1c4003980 msgr2=0x7fd1c4003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.547+0000 7fd1e6c00640 1 --2- 172.21.15.55:0/3871517163 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1c4003980 0x7fd1c4003da0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7fd1d0009cb0 tx=0x7fd1d001cc10 comp rx=0 tx=0).stop 2024-04-02T07:34:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.547+0000 7fd1e4c00640 1 -- 172.21.15.55:0/3871517163 reap_dead start 2024-04-02T07:34:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.547+0000 7fd1e6c00640 1 -- 172.21.15.55:0/3871517163 shutdown_connections 2024-04-02T07:34:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.547+0000 7fd1e6c00640 1 -- 172.21.15.55:0/3871517163 >> 172.21.15.55:0/3871517163 conn(0x7fd1e00b21d0 msgr2=0x7fd1e00b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.547+0000 7fd1e6c00640 1 -- 172.21.15.55:0/3871517163 shutdown_connections 2024-04-02T07:34:29.548 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.547+0000 7fd1e6c00640 1 -- 172.21.15.55:0/3871517163 wait complete. 2024-04-02T07:34:29.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1e6c00640 1 Processor -- start 2024-04-02T07:34:29.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1e6c00640 1 -- start start 2024-04-02T07:34:29.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1e6c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1c4003980 0x7fd1e01461f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:29.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1e6c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1e01f9990 0x7fd1e015f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:29.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1e6c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e01f8df0 0x7fd1e01f9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:29.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1e6c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e01f97b0 con 0x7fd1e01f8df0 2024-04-02T07:34:29.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1e6c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00ae480 con 0x7fd1c4003980 2024-04-02T07:34:29.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1e6c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1e00af000 con 0x7fd1e01f9990 2024-04-02T07:34:29.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1e4c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e01f8df0 0x7fd1e01f9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:29.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1e4c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e01f8df0 0x7fd1e01f9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33966/0 (socket says 172.21.15.55:33966) 2024-04-02T07:34:29.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1e4c00640 1 -- 172.21.15.55:0/2812762675 learned_addr learned my addr 172.21.15.55:0/2812762675 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:29.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1d7400640 1 --2- 172.21.15.55:0/2812762675 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1e01f9990 0x7fd1e015f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:29.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1dfe00640 1 --2- 172.21.15.55:0/2812762675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1c4003980 0x7fd1e01461f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:29.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1e4c00640 1 -- 172.21.15.55:0/2812762675 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1e01f9990 msgr2=0x7fd1e015f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:29.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1e4c00640 1 --2- 172.21.15.55:0/2812762675 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1e01f9990 0x7fd1e015f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:29.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1e4c00640 1 -- 172.21.15.55:0/2812762675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1c4003980 msgr2=0x7fd1e01461f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:29.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1e4c00640 1 --2- 172.21.15.55:0/2812762675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1c4003980 0x7fd1e01461f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:29.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1e4c00640 1 -- 172.21.15.55:0/2812762675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e0146730 con 0x7fd1e01f8df0 2024-04-02T07:34:29.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1e4c00640 1 --2- 172.21.15.55:0/2812762675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e01f8df0 0x7fd1e01f9270 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40046d0 tx=0x7fd1d800e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:29.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1dcc00640 1 -- 172.21.15.55:0/2812762675 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8007a80 con 0x7fd1e01f8df0 2024-04-02T07:34:29.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1dcc00640 1 -- 172.21.15.55:0/2812762675 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d800ed00 con 0x7fd1e01f8df0 2024-04-02T07:34:29.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1dcc00640 1 -- 172.21.15.55:0/2812762675 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d8014670 con 0x7fd1e01f8df0 2024-04-02T07:34:29.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1e6c00640 1 -- 172.21.15.55:0/2812762675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1e00ae6d0 con 0x7fd1e01f8df0 2024-04-02T07:34:29.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.551+0000 7fd1e6c00640 1 -- 172.21.15.55:0/2812762675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1e00aec90 con 0x7fd1e01f8df0 2024-04-02T07:34:29.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.555+0000 7fd1e6c00640 1 -- 172.21.15.55:0/2812762675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1e0066c90 con 0x7fd1e01f8df0 2024-04-02T07:34:29.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.555+0000 7fd1dcc00640 1 -- 172.21.15.55:0/2812762675 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd1d80147d0 con 0x7fd1e01f8df0 2024-04-02T07:34:29.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.555+0000 7fd1dcc00640 1 --2- 172.21.15.55:0/2812762675 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd1bc0666c0 0x7fd1bc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:29.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.555+0000 7fd1dcc00640 1 -- 172.21.15.55:0/2812762675 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7fd1d8083f50 con 0x7fd1e01f8df0 2024-04-02T07:34:29.554 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.555+0000 7fd1dfe00640 1 --2- 172.21.15.55:0/2812762675 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd1bc0666c0 0x7fd1bc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:29.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.555+0000 7fd1dfe00640 1 --2- 172.21.15.55:0/2812762675 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd1bc0666c0 0x7fd1bc068b80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00af000 tx=0x7fd1d00046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:29.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.559+0000 7fd1dcc00640 1 -- 172.21.15.55:0/2812762675 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd1d80511e0 con 0x7fd1e01f8df0 2024-04-02T07:34:29.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.755+0000 7fd1e6c00640 1 -- 172.21.15.55:0/2812762675 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd1e00af140 con 0x7fd1e01f8df0 2024-04-02T07:34:29.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.755+0000 7fd1dcc00640 1 -- 172.21.15.55:0/2812762675 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 108 v108) v1 ==== 95+0+4747 (secure 0 0 0) 0x7fd1d8054800 con 0x7fd1e01f8df0 2024-04-02T07:34:29.754 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:29.754 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":108,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7592,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2292883244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2292883244},{"type":"v1","addr":"172.21.15.106:6836","nonce":2292883244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":7835,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3165795379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3165795379},{"type":"v1","addr":"172.21.15.106:6837","nonce":3165795379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":9147,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2700619140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2700619140},{"type":"v1","addr":"172.21.15.55:6834","nonce":2700619140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":108,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:33:27.846433+0000","modified":"2024-04-02T07:34:29.592351+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9717":{"gid":9717,"name":"a","rank":0,"incarnation":106,"state":"up:rejoin","state_seq":3,"addr":"172.21.15.55:6835/1279080129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1279080129},{"type":"v1","addr":"172.21.15.55:6835","nonce":1279080129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-02T07:34:29.755 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 108 2024-04-02T07:34:29.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.759+0000 7fd1e6c00640 1 -- 172.21.15.55:0/2812762675 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd1bc0666c0 msgr2=0x7fd1bc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:29.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.759+0000 7fd1e6c00640 1 --2- 172.21.15.55:0/2812762675 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd1bc0666c0 0x7fd1bc068b80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd1d00af000 tx=0x7fd1d00046d0 comp rx=0 tx=0).stop 2024-04-02T07:34:29.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.759+0000 7fd1e6c00640 1 -- 172.21.15.55:0/2812762675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e01f8df0 msgr2=0x7fd1e01f9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:29.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.759+0000 7fd1e6c00640 1 --2- 172.21.15.55:0/2812762675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e01f8df0 0x7fd1e01f9270 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40046d0 tx=0x7fd1d800e530 comp rx=0 tx=0).stop 2024-04-02T07:34:29.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.759+0000 7fd1e6c00640 1 -- 172.21.15.55:0/2812762675 shutdown_connections 2024-04-02T07:34:29.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.759+0000 7fd1e6c00640 1 --2- 172.21.15.55:0/2812762675 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd1e01f8df0 0x7fd1e01f9270 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:29.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.759+0000 7fd1e6c00640 1 --2- 172.21.15.55:0/2812762675 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd1e01f9990 0x7fd1e015f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:29.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.759+0000 7fd1e6c00640 1 --2- 172.21.15.55:0/2812762675 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd1bc0666c0 0x7fd1bc068b80 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:29.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.759+0000 7fd1e6c00640 1 --2- 172.21.15.55:0/2812762675 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd1c4003980 0x7fd1e01461f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:29.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.759+0000 7fd1e6c00640 1 -- 172.21.15.55:0/2812762675 >> 172.21.15.55:0/2812762675 conn(0x7fd1e00b21d0 msgr2=0x7fd1e00ad270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:29.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.759+0000 7fd1e6c00640 1 -- 172.21.15.55:0/2812762675 shutdown_connections 2024-04-02T07:34:29.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:29.759+0000 7fd1e6c00640 1 -- 172.21.15.55:0/2812762675 wait complete. 2024-04-02T07:34:30.178 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 108, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:33:27.846433+0000', 'modified': '2024-04-02T07:34:29.592351+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 120, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9717}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9717': {'gid': 9717, 'name': 'a', 'rank': 0, 'incarnation': 106, 'state': 'up:rejoin', 'state_seq': 3, 'addr': '172.21.15.55:6835/1279080129', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 1279080129}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 1279080129}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:34:30.178 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_9717:up:rejoin 2024-04-02T07:34:31.179 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:34:31.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.335+0000 7ff14c200640 1 Processor -- start 2024-04-02T07:34:31.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.335+0000 7ff14c200640 1 -- start start 2024-04-02T07:34:31.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.335+0000 7ff14c200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff144156f70 0x7ff14415d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:31.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.335+0000 7ff14c200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff144157350 0x7ff1440cfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:31.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.335+0000 7ff14c200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff1440d02a0 0x7ff1440b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:31.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.335+0000 7ff14c200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14415d950 con 0x7ff144156f70 2024-04-02T07:34:31.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.335+0000 7ff14c200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14415dc30 con 0x7ff144157350 2024-04-02T07:34:31.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.335+0000 7ff14c200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14415df10 con 0x7ff1440d02a0 2024-04-02T07:34:31.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.335+0000 7ff149800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff144156f70 0x7ff14415d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:31.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.335+0000 7ff149800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff144156f70 0x7ff14415d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33980/0 (socket says 172.21.15.55:33980) 2024-04-02T07:34:31.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.335+0000 7ff149800640 1 -- 172.21.15.55:0/77114022 learned_addr learned my addr 172.21.15.55:0/77114022 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:31.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.335+0000 7ff148e00640 1 --2- 172.21.15.55:0/77114022 >> v2:172.21.15.106:3300/0 conn(0x7ff144157350 0x7ff1440cfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:31.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.335+0000 7ff14a200640 1 --2- 172.21.15.55:0/77114022 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff1440d02a0 0x7ff1440b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:31.335 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.335+0000 7ff149800640 1 -- 172.21.15.55:0/77114022 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff1440d02a0 msgr2=0x7ff1440b31c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:31.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.335+0000 7ff149800640 1 --2- 172.21.15.55:0/77114022 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff1440d02a0 0x7ff1440b31c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:31.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.335+0000 7ff149800640 1 -- 172.21.15.55:0/77114022 >> v2:172.21.15.106:3300/0 conn(0x7ff144157350 msgr2=0x7ff1440cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:31.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.335+0000 7ff149800640 1 --2- 172.21.15.55:0/77114022 >> v2:172.21.15.106:3300/0 conn(0x7ff144157350 0x7ff1440cfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:31.336 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.335+0000 7ff149800640 1 -- 172.21.15.55:0/77114022 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1440cf560 con 0x7ff144156f70 2024-04-02T07:34:31.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.339+0000 7ff149800640 1 --2- 172.21.15.55:0/77114022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff144156f70 0x7ff14415d0b0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7ff1440715a0 tx=0x7ff13801c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bb184c138407707 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:31.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.339+0000 7ff143e00640 1 -- 172.21.15.55:0/77114022 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1380aa430 con 0x7ff144156f70 2024-04-02T07:34:31.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.339+0000 7ff143e00640 1 -- 172.21.15.55:0/77114022 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1380aa590 con 0x7ff144156f70 2024-04-02T07:34:31.338 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.339+0000 7ff143e00640 1 -- 172.21.15.55:0/77114022 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1380aa920 con 0x7ff144156f70 2024-04-02T07:34:31.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.339+0000 7ff14c200640 1 -- 172.21.15.55:0/77114022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff144156f70 msgr2=0x7ff14415d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:31.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.339+0000 7ff14c200640 1 --2- 172.21.15.55:0/77114022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff144156f70 0x7ff14415d0b0 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7ff1440715a0 tx=0x7ff13801c4f0 comp rx=0 tx=0).stop 2024-04-02T07:34:31.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.339+0000 7ff14c200640 1 -- 172.21.15.55:0/77114022 shutdown_connections 2024-04-02T07:34:31.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.339+0000 7ff14c200640 1 --2- 172.21.15.55:0/77114022 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff1440d02a0 0x7ff1440b31c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:31.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.339+0000 7ff14c200640 1 --2- 172.21.15.55:0/77114022 >> v2:172.21.15.106:3300/0 conn(0x7ff144157350 0x7ff1440cfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:31.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.339+0000 7ff14c200640 1 --2- 172.21.15.55:0/77114022 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff144156f70 0x7ff14415d0b0 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:31.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.339+0000 7ff14c200640 1 -- 172.21.15.55:0/77114022 >> 172.21.15.55:0/77114022 conn(0x7ff1440b13b0 msgr2=0x7ff1440b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:31.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.339+0000 7ff14c200640 1 -- 172.21.15.55:0/77114022 shutdown_connections 2024-04-02T07:34:31.339 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.339+0000 7ff14c200640 1 -- 172.21.15.55:0/77114022 wait complete. 2024-04-02T07:34:31.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.339+0000 7ff14c200640 1 Processor -- start 2024-04-02T07:34:31.340 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff14c200640 1 -- start start 2024-04-02T07:34:31.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff14c200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1440d02a0 0x7ff144153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:31.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff14c200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff144156f70 0x7ff144153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:31.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff14c200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff144157350 0x7ff1441541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:31.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff14c200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14415ef30 con 0x7ff1440d02a0 2024-04-02T07:34:31.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff14c200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14415f1d0 con 0x7ff144156f70 2024-04-02T07:34:31.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff14c200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff144155990 con 0x7ff144157350 2024-04-02T07:34:31.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff149800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1440d02a0 0x7ff144153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:31.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff149800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1440d02a0 0x7ff144153480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33982/0 (socket says 172.21.15.55:33982) 2024-04-02T07:34:31.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff149800640 1 -- 172.21.15.55:0/4043736758 learned_addr learned my addr 172.21.15.55:0/4043736758 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:31.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff14a200640 1 --2- 172.21.15.55:0/4043736758 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff144157350 0x7ff1441541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:31.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff148e00640 1 --2- 172.21.15.55:0/4043736758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff144156f70 0x7ff144153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:31.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff149800640 1 -- 172.21.15.55:0/4043736758 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff144157350 msgr2=0x7ff1441541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:31.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff149800640 1 --2- 172.21.15.55:0/4043736758 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff144157350 0x7ff1441541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:31.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff149800640 1 -- 172.21.15.55:0/4043736758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff144156f70 msgr2=0x7ff144153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:31.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff149800640 1 --2- 172.21.15.55:0/4043736758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff144156f70 0x7ff144153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:31.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff149800640 1 -- 172.21.15.55:0/4043736758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1380094d0 con 0x7ff1440d02a0 2024-04-02T07:34:31.345 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff148e00640 1 --2- 172.21.15.55:0/4043736758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff144156f70 0x7ff144153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:31.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff149800640 1 --2- 172.21.15.55:0/4043736758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1440d02a0 0x7ff144153480 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7ff13801aba0 tx=0x7ff13801ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:31.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff141600640 1 -- 172.21.15.55:0/4043736758 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1380aa430 con 0x7ff1440d02a0 2024-04-02T07:34:31.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff141600640 1 -- 172.21.15.55:0/4043736758 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1380b3800 con 0x7ff1440d02a0 2024-04-02T07:34:31.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff141600640 1 -- 172.21.15.55:0/4043736758 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1380b3b90 con 0x7ff1440d02a0 2024-04-02T07:34:31.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff14c200640 1 -- 172.21.15.55:0/4043736758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff144155c70 con 0x7ff1440d02a0 2024-04-02T07:34:31.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff14c200640 1 -- 172.21.15.55:0/4043736758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1441539c0 con 0x7ff1440d02a0 2024-04-02T07:34:31.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.343+0000 7ff14c200640 1 -- 172.21.15.55:0/4043736758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14415d3c0 con 0x7ff1440d02a0 2024-04-02T07:34:31.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.347+0000 7ff141600640 1 -- 172.21.15.55:0/4043736758 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff1380b3cf0 con 0x7ff1440d02a0 2024-04-02T07:34:31.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.347+0000 7ff141600640 1 --2- 172.21.15.55:0/4043736758 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff124066690 0x7ff124068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:31.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.347+0000 7ff141600640 1 -- 172.21.15.55:0/4043736758 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7ff13811e870 con 0x7ff1440d02a0 2024-04-02T07:34:31.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.347+0000 7ff148e00640 1 --2- 172.21.15.55:0/4043736758 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff124066690 0x7ff124068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:31.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.347+0000 7ff148e00640 1 --2- 172.21.15.55:0/4043736758 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff124066690 0x7ff124068b50 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff1440cc0f0 tx=0x7ff130008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:31.350 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.351+0000 7ff141600640 1 -- 172.21.15.55:0/4043736758 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff1380ebb90 con 0x7ff1440d02a0 2024-04-02T07:34:31.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.547+0000 7ff14c200640 1 -- 172.21.15.55:0/4043736758 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff14415f340 con 0x7ff1440d02a0 2024-04-02T07:34:31.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.547+0000 7ff141600640 1 -- 172.21.15.55:0/4043736758 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4747 (secure 0 0 0) 0x7ff1380ef1b0 con 0x7ff1440d02a0 2024-04-02T07:34:31.548 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:31.548 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":109,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7592,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2292883244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2292883244},{"type":"v1","addr":"172.21.15.106:6836","nonce":2292883244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":7835,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3165795379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3165795379},{"type":"v1","addr":"172.21.15.106:6837","nonce":3165795379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":9147,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2700619140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2700619140},{"type":"v1","addr":"172.21.15.55:6834","nonce":2700619140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:33:27.846433+0000","modified":"2024-04-02T07:34:30.606280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9717":{"gid":9717,"name":"a","rank":0,"incarnation":106,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6835/1279080129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1279080129},{"type":"v1","addr":"172.21.15.55:6835","nonce":1279080129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-02T07:34:31.549 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 109 2024-04-02T07:34:31.549 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.551+0000 7ff14c200640 1 -- 172.21.15.55:0/4043736758 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff124066690 msgr2=0x7ff124068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:31.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.551+0000 7ff14c200640 1 --2- 172.21.15.55:0/4043736758 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff124066690 0x7ff124068b50 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7ff1440cc0f0 tx=0x7ff130008040 comp rx=0 tx=0).stop 2024-04-02T07:34:31.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.551+0000 7ff14c200640 1 -- 172.21.15.55:0/4043736758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1440d02a0 msgr2=0x7ff144153480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:31.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.551+0000 7ff14c200640 1 --2- 172.21.15.55:0/4043736758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1440d02a0 0x7ff144153480 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7ff13801aba0 tx=0x7ff13801ad30 comp rx=0 tx=0).stop 2024-04-02T07:34:31.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.551+0000 7ff14c200640 1 -- 172.21.15.55:0/4043736758 shutdown_connections 2024-04-02T07:34:31.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.551+0000 7ff14c200640 1 --2- 172.21.15.55:0/4043736758 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff144157350 0x7ff1441541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:31.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.551+0000 7ff14c200640 1 --2- 172.21.15.55:0/4043736758 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff124066690 0x7ff124068b50 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:31.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.551+0000 7ff14c200640 1 --2- 172.21.15.55:0/4043736758 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff144156f70 0x7ff144153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:31.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.551+0000 7ff14c200640 1 --2- 172.21.15.55:0/4043736758 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1440d02a0 0x7ff144153480 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:31.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.551+0000 7ff14c200640 1 -- 172.21.15.55:0/4043736758 >> 172.21.15.55:0/4043736758 conn(0x7ff1440b13b0 msgr2=0x7ff1440b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:31.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.551+0000 7ff14c200640 1 -- 172.21.15.55:0/4043736758 shutdown_connections 2024-04-02T07:34:31.551 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:31.551+0000 7ff14c200640 1 -- 172.21.15.55:0/4043736758 wait complete. 2024-04-02T07:34:31.564 INFO:tasks.ceph.mds.a.smithi055.stderr:2024-04-02T07:34:31.567+0000 7fa686000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:34:31.971 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 109, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-02T07:33:27.846433+0000', 'modified': '2024-04-02T07:34:30.606280+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 120, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9717}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9717': {'gid': 9717, 'name': 'a', 'rank': 0, 'incarnation': 106, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.55:6835/1279080129', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.55:6832', 'nonce': 1279080129}, {'type': 'v1', 'addr': '172.21.15.55:6835', 'nonce': 1279080129}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2024-04-02T07:34:31.971 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-02T07:34:31.971 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-02T07:34:32.114 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.115+0000 7f7347200640 1 Processor -- start 2024-04-02T07:34:32.115 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.115+0000 7f7347200640 1 -- start start 2024-04-02T07:34:32.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.115+0000 7f7347200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f7340157110 0x7f734015cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.115+0000 7f7347200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7340160570 0x7f73400b1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.115+0000 7f7347200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73400b1ec0 con 0x7f73400b39d0 2024-04-02T07:34:32.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.115+0000 7f7347200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7340160a00 con 0x7f7340157110 2024-04-02T07:34:32.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.115+0000 7f7347200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7340160ce0 con 0x7f7340160570 2024-04-02T07:34:32.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f7345200640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f73400b39d0 0x7f73400cdbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57574/0 (socket says 172.21.15.55:57574) 2024-04-02T07:34:32.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f7345200640 1 -- 172.21.15.55:0/2537886988 learned_addr learned my addr 172.21.15.55:0/2537886988 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:32.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f7337400640 1 --2- 172.21.15.55:0/2537886988 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7340160570 0x7f73400b1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f733fe00640 1 --2- 172.21.15.55:0/2537886988 >> v2:172.21.15.106:3300/0 conn(0x7f7340157110 0x7f734015cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f733f400640 1 -- 172.21.15.55:0/2537886988 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2631843901 0 0) 0x7f73400b1ec0 con 0x7f73400b39d0 2024-04-02T07:34:32.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f733f400640 1 -- 172.21.15.55:0/2537886988 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7324003530 con 0x7f73400b39d0 2024-04-02T07:34:32.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f733f400640 1 -- 172.21.15.55:0/2537886988 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3560127050 0 0) 0x7f7324003530 con 0x7f73400b39d0 2024-04-02T07:34:32.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f733f400640 1 -- 172.21.15.55:0/2537886988 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7340160570 msgr2=0x7f73400b1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:32.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f733f400640 1 --2- 172.21.15.55:0/2537886988 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7340160570 0x7f73400b1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f733f400640 1 -- 172.21.15.55:0/2537886988 >> v2:172.21.15.106:3300/0 conn(0x7f7340157110 msgr2=0x7f734015cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:32.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f733f400640 1 --2- 172.21.15.55:0/2537886988 >> v2:172.21.15.106:3300/0 conn(0x7f7340157110 0x7f734015cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f733f400640 1 -- 172.21.15.55:0/2537886988 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7340160fc0 con 0x7f73400b39d0 2024-04-02T07:34:32.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f733f400640 1 -- 172.21.15.55:0/2537886988 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f7338001a00 con 0x7f73400b39d0 2024-04-02T07:34:32.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f733fe00640 1 --2- 172.21.15.55:0/2537886988 >> v2:172.21.15.106:3300/0 conn(0x7f7340157110 0x7f734015cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:34:32.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f733f400640 1 -- 172.21.15.55:0/2537886988 >> v1:172.21.15.55:6789/0 conn(0x7f73400b39d0 legacy=0x7f73400cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:32.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f733f400640 1 --2- 172.21.15.55:0/2537886988 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7324003980 0x7f7324003d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f733f400640 1 --2- 172.21.15.55:0/2537886988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7324004330 0x7f7324004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f733f400640 1 --2- 172.21.15.55:0/2537886988 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7324004e80 0x7f732400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f733f400640 1 -- 172.21.15.55:0/2537886988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7340160a00 con 0x7f7324004330 2024-04-02T07:34:32.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f733f400640 1 -- 172.21.15.55:0/2537886988 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7340160ce0 con 0x7f7324004e80 2024-04-02T07:34:32.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f733f400640 1 -- 172.21.15.55:0/2537886988 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7324005680 con 0x7f7324003980 2024-04-02T07:34:32.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f7337400640 1 --2- 172.21.15.55:0/2537886988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7324004330 0x7f7324004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f733fe00640 1 --2- 172.21.15.55:0/2537886988 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7324003980 0x7f7324003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f7345200640 1 --2- 172.21.15.55:0/2537886988 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7324004e80 0x7f732400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f7337400640 1 -- 172.21.15.55:0/2537886988 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7324003980 msgr2=0x7f7324003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:32.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f7337400640 1 --2- 172.21.15.55:0/2537886988 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7324003980 0x7f7324003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f7337400640 1 -- 172.21.15.55:0/2537886988 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7324004e80 msgr2=0x7f732400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:32.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f7337400640 1 --2- 172.21.15.55:0/2537886988 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f7324004e80 0x7f732400b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.119+0000 7f7337400640 1 -- 172.21.15.55:0/2537886988 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7324003530 con 0x7f7324004330 2024-04-02T07:34:32.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.123+0000 7f7337400640 1 --2- 172.21.15.55:0/2537886988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7324004330 0x7f7324004810 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f7328009ac0 tx=0x7f732801ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c3a190a83d6002 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:32.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.123+0000 7f733f400640 1 -- 172.21.15.55:0/2537886988 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73280a5640 con 0x7f7324004330 2024-04-02T07:34:32.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.123+0000 7f733f400640 1 -- 172.21.15.55:0/2537886988 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73280a57a0 con 0x7f7324004330 2024-04-02T07:34:32.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.123+0000 7f733f400640 1 -- 172.21.15.55:0/2537886988 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73280a5b30 con 0x7f7324004330 2024-04-02T07:34:32.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.123+0000 7f7347200640 1 -- 172.21.15.55:0/2537886988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7324004330 msgr2=0x7f7324004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:32.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.123+0000 7f7347200640 1 --2- 172.21.15.55:0/2537886988 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7324004330 0x7f7324004810 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f7328009ac0 tx=0x7f732801ca50 comp rx=0 tx=0).stop 2024-04-02T07:34:32.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.123+0000 7f7345200640 1 -- 172.21.15.55:0/2537886988 reap_dead start 2024-04-02T07:34:32.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.123+0000 7f7347200640 1 -- 172.21.15.55:0/2537886988 shutdown_connections 2024-04-02T07:34:32.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.123+0000 7f7347200640 1 -- 172.21.15.55:0/2537886988 >> 172.21.15.55:0/2537886988 conn(0x7f73400cb3d0 msgr2=0x7f73400cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:32.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.123+0000 7f7347200640 1 -- 172.21.15.55:0/2537886988 shutdown_connections 2024-04-02T07:34:32.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.123+0000 7f7347200640 1 -- 172.21.15.55:0/2537886988 wait complete. 2024-04-02T07:34:32.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.123+0000 7f7347200640 1 Processor -- start 2024-04-02T07:34:32.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.123+0000 7f7347200640 1 -- start start 2024-04-02T07:34:32.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.123+0000 7f7347200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7324004330 0x7f7340146430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f7347200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73401582e0 0x7f73400ac290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f7347200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73400ad840 0x7f734015cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f7347200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f734015ab10 con 0x7f73400ad840 2024-04-02T07:34:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f7347200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73400acc00 con 0x7f73401582e0 2024-04-02T07:34:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f7347200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f734015ad20 con 0x7f7324004330 2024-04-02T07:34:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f7345200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73400ad840 0x7f734015cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f7345200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73400ad840 0x7f734015cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34006/0 (socket says 172.21.15.55:34006) 2024-04-02T07:34:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f7345200640 1 -- 172.21.15.55:0/1613000278 learned_addr learned my addr 172.21.15.55:0/1613000278 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f733fe00640 1 --2- 172.21.15.55:0/1613000278 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7324004330 0x7f7340146430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f7337400640 1 --2- 172.21.15.55:0/1613000278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73401582e0 0x7f73400ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f7345200640 1 -- 172.21.15.55:0/1613000278 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7324004330 msgr2=0x7f7340146430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f7345200640 1 --2- 172.21.15.55:0/1613000278 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7324004330 0x7f7340146430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f7345200640 1 -- 172.21.15.55:0/1613000278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73401582e0 msgr2=0x7f73400ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f7345200640 1 --2- 172.21.15.55:0/1613000278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73401582e0 0x7f73400ac290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f7345200640 1 -- 172.21.15.55:0/1613000278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734015b000 con 0x7f73400ad840 2024-04-02T07:34:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f7345200640 1 --2- 172.21.15.55:0/1613000278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73400ad840 0x7f734015cfd0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f734015aac0 tx=0x7f7338011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f733cc00640 1 -- 172.21.15.55:0/1613000278 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733800f920 con 0x7f73400ad840 2024-04-02T07:34:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f733cc00640 1 -- 172.21.15.55:0/1613000278 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f733800fa80 con 0x7f73400ad840 2024-04-02T07:34:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f733cc00640 1 -- 172.21.15.55:0/1613000278 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f733800fe10 con 0x7f73400ad840 2024-04-02T07:34:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f7347200640 1 -- 172.21.15.55:0/1613000278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f734015b2e0 con 0x7f73400ad840 2024-04-02T07:34:32.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f7347200640 1 -- 172.21.15.55:0/1613000278 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73400ac7d0 con 0x7f73400ad840 2024-04-02T07:34:32.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.127+0000 7f733cc00640 1 -- 172.21.15.55:0/1613000278 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f733801f460 con 0x7f73400ad840 2024-04-02T07:34:32.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f733cc00640 1 --2- 172.21.15.55:0/1613000278 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f731c0666c0 0x7f731c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f733cc00640 1 -- 172.21.15.55:0/1613000278 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f73380872c0 con 0x7f73400ad840 2024-04-02T07:34:32.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f733fe00640 1 --2- 172.21.15.55:0/1613000278 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f731c0666c0 0x7f731c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f734a719000 1 Processor -- start 2024-04-02T07:34:32.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f734a719000 1 -- start start 2024-04-02T07:34:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f733fe00640 1 --2- 172.21.15.55:0/1613000278 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f731c0666c0 0x7f731c068b80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7330009de0 tx=0x7f7330009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f734a719000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5643446aedb0 0x5643446af190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f734a719000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446af6d0 0x564344664f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f734a719000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446654c0 0x5643446658a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f734a719000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x56434452d5a0 con 0x5643446654c0 2024-04-02T07:34:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f734a719000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643444baaf0 con 0x5643446af6d0 2024-04-02T07:34:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f734a719000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643444b80c0 con 0x5643446aedb0 2024-04-02T07:34:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f7345200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446654c0 0x5643446658a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f7345200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446654c0 0x5643446658a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34012/0 (socket says 172.21.15.55:34012) 2024-04-02T07:34:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f7345200640 1 -- 172.21.15.55:0/1921451352 learned_addr learned my addr 172.21.15.55:0/1921451352 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f733fe00640 1 --2- 172.21.15.55:0/1921451352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5643446aedb0 0x5643446af190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f7337400640 1 --2- 172.21.15.55:0/1921451352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446af6d0 0x564344664f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f7345200640 1 -- 172.21.15.55:0/1921451352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5643446aedb0 msgr2=0x5643446af190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f7345200640 1 --2- 172.21.15.55:0/1921451352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5643446aedb0 0x5643446af190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f7345200640 1 -- 172.21.15.55:0/1921451352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446af6d0 msgr2=0x564344664f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:32.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f7345200640 1 --2- 172.21.15.55:0/1921451352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446af6d0 0x564344664f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f7345200640 1 -- 172.21.15.55:0/1921451352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5643441af890 con 0x5643446654c0 2024-04-02T07:34:32.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f7337400640 1 --2- 172.21.15.55:0/1921451352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446af6d0 0x564344664f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:32.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f7345200640 1 --2- 172.21.15.55:0/1921451352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446654c0 0x5643446658a0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f73380013e0 tx=0x7f7338058350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8c0588b15121c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:32.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f7334c00640 1 -- 172.21.15.55:0/1921451352 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73380870c0 con 0x5643446654c0 2024-04-02T07:34:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f7334c00640 1 -- 172.21.15.55:0/1921451352 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7338011030 con 0x5643446654c0 2024-04-02T07:34:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f7334c00640 1 -- 172.21.15.55:0/1921451352 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7338054920 con 0x5643446654c0 2024-04-02T07:34:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f734a719000 1 -- 172.21.15.55:0/1921451352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446654c0 msgr2=0x5643446658a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f734a719000 1 --2- 172.21.15.55:0/1921451352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446654c0 0x5643446658a0 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7f73380013e0 tx=0x7f7338058350 comp rx=0 tx=0).stop 2024-04-02T07:34:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f734a719000 1 -- 172.21.15.55:0/1921451352 shutdown_connections 2024-04-02T07:34:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f734a719000 1 --2- 172.21.15.55:0/1921451352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446654c0 0x5643446658a0 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f734a719000 1 --2- 172.21.15.55:0/1921451352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446af6d0 0x564344664f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f734a719000 1 --2- 172.21.15.55:0/1921451352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5643446aedb0 0x5643446af190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f734a719000 1 -- 172.21.15.55:0/1921451352 >> 172.21.15.55:0/1921451352 conn(0x56434466b830 msgr2=0x564344663860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f734a719000 1 -- 172.21.15.55:0/1921451352 shutdown_connections 2024-04-02T07:34:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.131+0000 7f734a719000 1 -- 172.21.15.55:0/1921451352 wait complete. 2024-04-02T07:34:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f734a719000 1 -- start start 2024-04-02T07:34:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f734a719000 1 Processor -- start 2024-04-02T07:34:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f734a719000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446654c0 0x564344669230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f734a719000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446aedb0 0x564344669770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f734a719000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5643446af6d0 0x564344669cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f734a719000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643444b39b0 con 0x5643446aedb0 2024-04-02T07:34:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f734a719000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x564344452c00 con 0x5643446654c0 2024-04-02T07:34:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f734a719000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x564344471070 con 0x5643446af6d0 2024-04-02T07:34:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f734a719000 10 client.0 _ll_register_callbacks cb 0x5643446510e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:34:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f7337400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446aedb0 0x564344669770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f7337400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446aedb0 0x564344669770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34018/0 (socket says 172.21.15.55:34018) 2024-04-02T07:34:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f7337400640 1 -- 172.21.15.55:0/2907669196 learned_addr learned my addr 172.21.15.55:0/2907669196 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f7345200640 1 --2- 172.21.15.55:0/2907669196 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5643446af6d0 0x564344669cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f733fe00640 1 --2- 172.21.15.55:0/2907669196 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446654c0 0x564344669230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f7337400640 1 -- 172.21.15.55:0/2907669196 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5643446af6d0 msgr2=0x564344669cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f7337400640 1 --2- 172.21.15.55:0/2907669196 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5643446af6d0 0x564344669cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f7337400640 1 -- 172.21.15.55:0/2907669196 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446654c0 msgr2=0x564344669230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:32.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f7337400640 1 --2- 172.21.15.55:0/2907669196 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446654c0 0x564344669230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f7337400640 1 -- 172.21.15.55:0/2907669196 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73400ac7d0 con 0x5643446aedb0 2024-04-02T07:34:32.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f7337400640 1 --2- 172.21.15.55:0/2907669196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446aedb0 0x564344669770 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f7328009ac0 tx=0x7f73280197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bf3ecdda6b9d990 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:32.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f732d600640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:34:32.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f732d600640 1 -- 172.21.15.55:0/2907669196 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73280a5640 con 0x5643446aedb0 2024-04-02T07:34:32.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f734a719000 1 -- 172.21.15.55:0/2907669196 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5643444705f0 con 0x5643446aedb0 2024-04-02T07:34:32.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f732d600640 1 -- 172.21.15.55:0/2907669196 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f73280c2450 con 0x5643446aedb0 2024-04-02T07:34:32.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f732d600640 1 -- 172.21.15.55:0/2907669196 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73280059a0 con 0x5643446aedb0 2024-04-02T07:34:32.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f734a719000 10 client.9804 fetch_fsmap learned FSMap version 109 2024-04-02T07:34:32.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f734a719000 1 -- 172.21.15.55:0/2907669196 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) v3 -- 0x564344478ab0 con 0x5643446aedb0 2024-04-02T07:34:32.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f732d600640 1 -- 172.21.15.55:0/2907669196 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5643444705f0 con 0x5643446aedb0 2024-04-02T07:34:32.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f732d600640 1 -- 172.21.15.55:0/2907669196 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 109) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f7328005b00 con 0x5643446aedb0 2024-04-02T07:34:32.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f734a719000 10 client.9804 fetch_fsmap finished waiting for FSMap version 109 2024-04-02T07:34:32.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f734a719000 10 client.9804 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:34:32.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f734a719000 20 client.9804 populate_metadata read hostname 'smithi055' 2024-04-02T07:34:32.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f734a719000 1 --2- 172.21.15.55:0/2907669196 >> [v2:172.21.15.55:6832/1279080129,v1:172.21.15.55:6835/1279080129] conn(0x56434466a6c0 0x5643446bfe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f734a719000 4 client.9804 mds_command: new command op to 9717 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-02T07:34:32.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f734a719000 1 -- 172.21.15.55:0/2907669196 --> [v2:172.21.15.55:6832/1279080129,v1:172.21.15.55:6835/1279080129] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5643444b0790 con 0x56434466a6c0 2024-04-02T07:34:32.139 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.135+0000 7f733fe00640 1 --2- 172.21.15.55:0/2907669196 >> [v2:172.21.15.55:6832/1279080129,v1:172.21.15.55:6835/1279080129] conn(0x56434466a6c0 0x5643446bfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.139+0000 7f733fe00640 1 --2- 172.21.15.55:0/2907669196 >> [v2:172.21.15.55:6832/1279080129,v1:172.21.15.55:6835/1279080129] conn(0x56434466a6c0 0x5643446bfe50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca7448c386dc732b server_cookie=9d48d1023a031f1a in_seq=0 out_seq=0 2024-04-02T07:34:32.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.139+0000 7f732d600640 10 client.9804 ms_handle_connect on v2:172.21.15.55:6832/1279080129 2024-04-02T07:34:32.140 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.139+0000 7f732d600640 1 -- 172.21.15.55:0/2907669196 <== mds.0 v2:172.21.15.55:6832/1279080129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18209 (crc 0 0 0) 0x5643444b0790 con 0x56434466a6c0 2024-04-02T07:34:32.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.139+0000 7f732d600640 10 client.9804 handle_command_reply: tid=0 2024-04-02T07:34:32.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.139+0000 7f734a719000 1 client.9804 shutdown 2024-04-02T07:34:32.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.139+0000 7f734a719000 1 -- 172.21.15.55:0/2907669196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446aedb0 msgr2=0x564344669770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:32.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.139+0000 7f734a719000 1 --2- 172.21.15.55:0/2907669196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446aedb0 0x564344669770 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f7328009ac0 tx=0x7f73280197f0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.139+0000 7f734a719000 1 -- 172.21.15.55:0/2907669196 shutdown_connections 2024-04-02T07:34:32.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.139+0000 7f734a719000 1 --2- 172.21.15.55:0/2907669196 >> [v2:172.21.15.55:6832/1279080129,v1:172.21.15.55:6835/1279080129] conn(0x56434466a6c0 0x5643446bfe50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.139+0000 7f734a719000 1 --2- 172.21.15.55:0/2907669196 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5643446af6d0 0x564344669cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.139+0000 7f734a719000 1 --2- 172.21.15.55:0/2907669196 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446aedb0 0x564344669770 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.139+0000 7f734a719000 1 --2- 172.21.15.55:0/2907669196 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446654c0 0x564344669230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.139+0000 7f732d600640 0 client.9804 ms_handle_reset on v2:172.21.15.55:6832/1279080129 2024-04-02T07:34:32.141 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.139+0000 7f734a719000 1 -- 172.21.15.55:0/2907669196 >> 172.21.15.55:0/2907669196 conn(0x56434466b830 msgr2=0x564344663f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:32.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.139+0000 7f734a719000 1 -- 172.21.15.55:0/2907669196 shutdown_connections 2024-04-02T07:34:32.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.139+0000 7f734a719000 1 -- 172.21.15.55:0/2907669196 wait complete. 2024-04-02T07:34:32.142 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.139+0000 7f734a719000 20 client.9804 trim_cache size 0 max 16384 2024-04-02T07:34:32.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f734a719000 1 Processor -- start 2024-04-02T07:34:32.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f734a719000 1 -- start start 2024-04-02T07:34:32.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f734a719000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5643446654c0 0x564344708670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f734a719000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446aedb0 0x564344708bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f734a719000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446af6d0 0x5643447090f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f734a719000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564344170940 con 0x5643446aedb0 2024-04-02T07:34:32.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f734a719000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x5643444b79b0 con 0x5643446af6d0 2024-04-02T07:34:32.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f734a719000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x5643446c4500 con 0x5643446654c0 2024-04-02T07:34:32.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f7337400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446aedb0 0x564344708bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f7337400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446aedb0 0x564344708bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34032/0 (socket says 172.21.15.55:34032) 2024-04-02T07:34:32.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f7337400640 1 -- 172.21.15.55:0/3035118640 learned_addr learned my addr 172.21.15.55:0/3035118640 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:32.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f733fe00640 1 --2- 172.21.15.55:0/3035118640 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5643446654c0 0x564344708670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f7345200640 1 --2- 172.21.15.55:0/3035118640 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446af6d0 0x5643447090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f7337400640 1 -- 172.21.15.55:0/3035118640 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5643446654c0 msgr2=0x564344708670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:32.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f7337400640 1 --2- 172.21.15.55:0/3035118640 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5643446654c0 0x564344708670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f7337400640 1 -- 172.21.15.55:0/3035118640 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446af6d0 msgr2=0x5643447090f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:32.167 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f7337400640 1 --2- 172.21.15.55:0/3035118640 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446af6d0 0x5643447090f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f7337400640 1 -- 172.21.15.55:0/3035118640 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56434445ec00 con 0x5643446aedb0 2024-04-02T07:34:32.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f7337400640 1 --2- 172.21.15.55:0/3035118640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446aedb0 0x564344708bb0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f732801d2f0 tx=0x7f73280ba000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af3b81061a7cbf server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:32.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f7335600640 1 -- 172.21.15.55:0/3035118640 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73280059a0 con 0x5643446aedb0 2024-04-02T07:34:32.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f7335600640 1 -- 172.21.15.55:0/3035118640 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7328005b00 con 0x5643446aedb0 2024-04-02T07:34:32.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f7335600640 1 -- 172.21.15.55:0/3035118640 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73280c2650 con 0x5643446aedb0 2024-04-02T07:34:32.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f734a719000 1 -- 172.21.15.55:0/3035118640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446aedb0 msgr2=0x564344708bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:32.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f734a719000 1 --2- 172.21.15.55:0/3035118640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446aedb0 0x564344708bb0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f732801d2f0 tx=0x7f73280ba000 comp rx=0 tx=0).stop 2024-04-02T07:34:32.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f734a719000 1 -- 172.21.15.55:0/3035118640 shutdown_connections 2024-04-02T07:34:32.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f734a719000 1 --2- 172.21.15.55:0/3035118640 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446af6d0 0x5643447090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f734a719000 1 --2- 172.21.15.55:0/3035118640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446aedb0 0x564344708bb0 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f734a719000 1 --2- 172.21.15.55:0/3035118640 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5643446654c0 0x564344708670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f734a719000 1 -- 172.21.15.55:0/3035118640 >> 172.21.15.55:0/3035118640 conn(0x56434466b830 msgr2=0x564344668a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:32.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f734a719000 1 -- 172.21.15.55:0/3035118640 shutdown_connections 2024-04-02T07:34:32.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.155+0000 7f734a719000 1 -- 172.21.15.55:0/3035118640 wait complete. 2024-04-02T07:34:32.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f734a719000 1 -- start start 2024-04-02T07:34:32.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f734a719000 1 Processor -- start 2024-04-02T07:34:32.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f734a719000 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446654c0 0x56434470d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f734a719000 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446aedb0 0x56434470d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f734a719000 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5643446af6d0 0x5643446ac9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f734a719000 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x564344664690 con 0x5643446654c0 2024-04-02T07:34:32.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f734a719000 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x56434446cf80 con 0x5643446aedb0 2024-04-02T07:34:32.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f734a719000 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x564344634530 con 0x5643446af6d0 2024-04-02T07:34:32.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f734a719000 10 client.0 _ll_register_callbacks cb 0x564344478590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-02T07:34:32.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f733fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446654c0 0x56434470d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f733fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446654c0 0x56434470d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34048/0 (socket says 172.21.15.55:34048) 2024-04-02T07:34:32.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f733fe00640 1 -- 172.21.15.55:0/1311114150 learned_addr learned my addr 172.21.15.55:0/1311114150 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:32.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f7345200640 1 --2- 172.21.15.55:0/1311114150 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5643446af6d0 0x5643446ac9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f7337400640 1 --2- 172.21.15.55:0/1311114150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446aedb0 0x56434470d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f733fe00640 1 -- 172.21.15.55:0/1311114150 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5643446af6d0 msgr2=0x5643446ac9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:32.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f733fe00640 1 --2- 172.21.15.55:0/1311114150 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5643446af6d0 0x5643446ac9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f733fe00640 1 -- 172.21.15.55:0/1311114150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446aedb0 msgr2=0x56434470d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:32.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f733fe00640 1 --2- 172.21.15.55:0/1311114150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446aedb0 0x56434470d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f733fe00640 1 -- 172.21.15.55:0/1311114150 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564344478ab0 con 0x5643446654c0 2024-04-02T07:34:32.172 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f7337400640 1 --2- 172.21.15.55:0/1311114150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446aedb0 0x56434470d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f733fe00640 1 --2- 172.21.15.55:0/1311114150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446654c0 0x56434470d030 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x564344483880 tx=0x7f73300046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdae10c766f37e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f732d600640 10 client.0 ms_handle_connect on v2:172.21.15.55:3300/0 2024-04-02T07:34:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f732d600640 1 -- 172.21.15.55:0/1311114150 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7330028040 con 0x5643446654c0 2024-04-02T07:34:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f732d600640 1 -- 172.21.15.55:0/1311114150 <== mon.0 v2:172.21.15.55:3300/0 2 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f7330037c10 con 0x5643446654c0 2024-04-02T07:34:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f734a719000 1 -- 172.21.15.55:0/1311114150 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56434466ae10 con 0x5643446654c0 2024-04-02T07:34:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f732d600640 1 -- 172.21.15.55:0/1311114150 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7330037dd0 con 0x5643446654c0 2024-04-02T07:34:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f734a719000 10 client.9810 fetch_fsmap learned FSMap version 109 2024-04-02T07:34:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f734a719000 1 -- 172.21.15.55:0/1311114150 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=2+}) v3 -- 0x5643441afcc0 con 0x5643446654c0 2024-04-02T07:34:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f732d600640 1 -- 172.21.15.55:0/1311114150 <== mon.0 v2:172.21.15.55:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56434466ae10 con 0x5643446654c0 2024-04-02T07:34:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f732d600640 1 -- 172.21.15.55:0/1311114150 <== mon.0 v2:172.21.15.55:3300/0 5 ==== fsmap(e 109) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f733001d040 con 0x5643446654c0 2024-04-02T07:34:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f734a719000 10 client.9810 fetch_fsmap finished waiting for FSMap version 109 2024-04-02T07:34:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f734a719000 10 client.9810 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-02T07:34:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f734a719000 20 client.9810 populate_metadata read hostname 'smithi055' 2024-04-02T07:34:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f734a719000 1 --2- 172.21.15.55:0/1311114150 >> [v2:172.21.15.55:6832/1279080129,v1:172.21.15.55:6835/1279080129] conn(0x5643446acee0 0x5643446ad2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f734a719000 4 client.9810 mds_command: new command op to 9717 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-02T07:34:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f734a719000 1 -- 172.21.15.55:0/1311114150 --> [v2:172.21.15.55:6832/1279080129,v1:172.21.15.55:6835/1279080129] -- command(tid 0: {"prefix": "status"}) v1 -- 0x564344483460 con 0x5643446acee0 2024-04-02T07:34:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f7337400640 1 --2- 172.21.15.55:0/1311114150 >> [v2:172.21.15.55:6832/1279080129,v1:172.21.15.55:6835/1279080129] conn(0x5643446acee0 0x5643446ad2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f7337400640 1 --2- 172.21.15.55:0/1311114150 >> [v2:172.21.15.55:6832/1279080129,v1:172.21.15.55:6835/1279080129] conn(0x5643446acee0 0x5643446ad2c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0ce33a4a00be431 server_cookie=214b8559c511fdd2 in_seq=0 out_seq=0 2024-04-02T07:34:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.159+0000 7f732d600640 10 client.9810 ms_handle_connect on v2:172.21.15.55:6832/1279080129 2024-04-02T07:34:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f732d600640 1 -- 172.21.15.55:0/1311114150 <== mds.0 v2:172.21.15.55:6832/1279080129 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x564344483460 con 0x5643446acee0 2024-04-02T07:34:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f732d600640 10 client.9810 handle_command_reply: tid=0 2024-04-02T07:34:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f734a719000 1 client.9810 shutdown 2024-04-02T07:34:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f734a719000 1 -- 172.21.15.55:0/1311114150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446654c0 msgr2=0x56434470d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f734a719000 1 --2- 172.21.15.55:0/1311114150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446654c0 0x56434470d030 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x564344483880 tx=0x7f73300046d0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f734a719000 1 -- 172.21.15.55:0/1311114150 shutdown_connections 2024-04-02T07:34:32.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f734a719000 1 --2- 172.21.15.55:0/1311114150 >> [v2:172.21.15.55:6832/1279080129,v1:172.21.15.55:6835/1279080129] conn(0x5643446acee0 0x5643446ad2c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f734a719000 1 --2- 172.21.15.55:0/1311114150 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x5643446af6d0 0x5643446ac9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f734a719000 1 --2- 172.21.15.55:0/1311114150 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x5643446aedb0 0x56434470d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f734a719000 1 --2- 172.21.15.55:0/1311114150 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x5643446654c0 0x56434470d030 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f732d600640 0 client.9810 ms_handle_reset on v2:172.21.15.55:6832/1279080129 2024-04-02T07:34:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f734a719000 1 -- 172.21.15.55:0/1311114150 >> 172.21.15.55:0/1311114150 conn(0x56434466b830 msgr2=0x564344669110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f734a719000 1 -- 172.21.15.55:0/1311114150 shutdown_connections 2024-04-02T07:34:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f734a719000 1 -- 172.21.15.55:0/1311114150 wait complete. 2024-04-02T07:34:32.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f734a719000 20 client.9810 trim_cache size 0 max 16384 2024-04-02T07:34:32.176 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:34:32.176 INFO:teuthology.orchestra.run.smithi055.stdout: "cluster_fsid": "642a0456-a2ac-49a4-91a5-3b3449b512da", 2024-04-02T07:34:32.176 INFO:teuthology.orchestra.run.smithi055.stdout: "whoami": 0, 2024-04-02T07:34:32.176 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 9717, 2024-04-02T07:34:32.176 INFO:teuthology.orchestra.run.smithi055.stdout: "want_state": "up:active", 2024-04-02T07:34:32.176 INFO:teuthology.orchestra.run.smithi055.stdout: "state": "up:active", 2024-04-02T07:34:32.176 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs", 2024-04-02T07:34:32.176 INFO:teuthology.orchestra.run.smithi055.stdout: "rank_uptime": 4.5839268649999996, 2024-04-02T07:34:32.176 INFO:teuthology.orchestra.run.smithi055.stdout: "mdsmap_epoch": 109, 2024-04-02T07:34:32.176 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch": 120, 2024-04-02T07:34:32.176 INFO:teuthology.orchestra.run.smithi055.stdout: "osdmap_epoch_barrier": 120, 2024-04-02T07:34:32.176 INFO:teuthology.orchestra.run.smithi055.stdout: "uptime": 6.54106875 2024-04-02T07:34:32.176 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:34:32.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f7347200640 1 -- 172.21.15.55:0/1613000278 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f731c0666c0 msgr2=0x7f731c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:32.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f7347200640 1 --2- 172.21.15.55:0/1613000278 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f731c0666c0 0x7f731c068b80 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7330009de0 tx=0x7f7330009190 comp rx=0 tx=0).stop 2024-04-02T07:34:32.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f7347200640 1 -- 172.21.15.55:0/1613000278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73400ad840 msgr2=0x7f734015cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:32.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f7347200640 1 --2- 172.21.15.55:0/1613000278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73400ad840 0x7f734015cfd0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f734015aac0 tx=0x7f7338011c20 comp rx=0 tx=0).stop 2024-04-02T07:34:32.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f7347200640 1 -- 172.21.15.55:0/1613000278 shutdown_connections 2024-04-02T07:34:32.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f7347200640 1 --2- 172.21.15.55:0/1613000278 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73400ad840 0x7f734015cfd0 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f7347200640 1 --2- 172.21.15.55:0/1613000278 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f731c0666c0 0x7f731c068b80 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f7347200640 1 --2- 172.21.15.55:0/1613000278 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f73401582e0 0x7f73400ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f7347200640 1 --2- 172.21.15.55:0/1613000278 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f7324004330 0x7f7340146430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f7347200640 1 -- 172.21.15.55:0/1613000278 >> 172.21.15.55:0/1613000278 conn(0x7f73400cb3d0 msgr2=0x7f7340155c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:32.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f7347200640 1 -- 172.21.15.55:0/1613000278 shutdown_connections 2024-04-02T07:34:32.178 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.163+0000 7f7347200640 1 -- 172.21.15.55:0/1613000278 wait complete. 2024-04-02T07:34:32.180 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-02T07:34:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.323+0000 7f403a000640 1 Processor -- start 2024-04-02T07:34:32.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.323+0000 7f403a000640 1 -- start start 2024-04-02T07:34:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.323+0000 7f403a000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f40340ae410 0x7f403415dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.323+0000 7f403a000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f40340cc9e0 0x7f403406e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.323+0000 7f403a000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f403415e170 con 0x7f403406aea0 2024-04-02T07:34:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.323+0000 7f403a000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f403406d550 con 0x7f40340ae410 2024-04-02T07:34:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.323+0000 7f403a000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f403406d830 con 0x7f40340cc9e0 2024-04-02T07:34:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.323+0000 7f4033e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f40340ae410 0x7f403415dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.323+0000 7f4033e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f40340ae410 0x7f403415dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34064/0 (socket says 172.21.15.55:34064) 2024-04-02T07:34:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.323+0000 7f4033e00640 1 -- 172.21.15.55:0/3252762658 learned_addr learned my addr 172.21.15.55:0/3252762658 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.323+0000 7f4039600640 1 --2- 172.21.15.55:0/3252762658 >> v2:172.21.15.106:3300/0 conn(0x7f40340cc9e0 0x7f403406e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.323+0000 7f4033e00640 1 -- 172.21.15.55:0/3252762658 >> v2:172.21.15.106:3300/0 conn(0x7f40340cc9e0 msgr2=0x7f403406e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:32.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.323+0000 7f4033e00640 1 --2- 172.21.15.55:0/3252762658 >> v2:172.21.15.106:3300/0 conn(0x7f40340cc9e0 0x7f403406e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.323+0000 7f4033e00640 1 -- 172.21.15.55:0/3252762658 >> v1:172.21.15.106:6789/0 conn(0x7f403406aea0 legacy=0x7f403406b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:32.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.323+0000 7f4033e00640 1 -- 172.21.15.55:0/3252762658 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f403406db10 con 0x7f40340ae410 2024-04-02T07:34:32.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.327+0000 7f4033e00640 1 --2- 172.21.15.55:0/3252762658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40340ae410 0x7f403415dc30 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f40340c9610 tx=0x7f402001c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28eedf0e1163113 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:32.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.327+0000 7f4033400640 1 -- 172.21.15.55:0/3252762658 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40200aa610 con 0x7f40340ae410 2024-04-02T07:34:32.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.327+0000 7f4033400640 1 -- 172.21.15.55:0/3252762658 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40200a6040 con 0x7f40340ae410 2024-04-02T07:34:32.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.327+0000 7f4033400640 1 -- 172.21.15.55:0/3252762658 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40200aa990 con 0x7f40340ae410 2024-04-02T07:34:32.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.327+0000 7f403a000640 1 -- 172.21.15.55:0/3252762658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40340ae410 msgr2=0x7f403415dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:32.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.327+0000 7f403a000640 1 --2- 172.21.15.55:0/3252762658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40340ae410 0x7f403415dc30 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f40340c9610 tx=0x7f402001c4b0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.327+0000 7f403a000640 1 -- 172.21.15.55:0/3252762658 shutdown_connections 2024-04-02T07:34:32.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.327+0000 7f403a000640 1 --2- 172.21.15.55:0/3252762658 >> v2:172.21.15.106:3300/0 conn(0x7f40340cc9e0 0x7f403406e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.327+0000 7f403a000640 1 --2- 172.21.15.55:0/3252762658 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f40340ae410 0x7f403415dc30 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.327+0000 7f403a000640 1 -- 172.21.15.55:0/3252762658 >> 172.21.15.55:0/3252762658 conn(0x7f40340b0900 msgr2=0x7f40340b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:32.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.327+0000 7f403a000640 1 -- 172.21.15.55:0/3252762658 shutdown_connections 2024-04-02T07:34:32.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.327+0000 7f403a000640 1 -- 172.21.15.55:0/3252762658 wait complete. 2024-04-02T07:34:32.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.327+0000 7f403a000640 1 Processor -- start 2024-04-02T07:34:32.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.327+0000 7f403a000640 1 -- start start 2024-04-02T07:34:32.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f403a000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f403406aea0 0x7f40340c4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f403a000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40340ae410 0x7f40340b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f403a000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40340cc9e0 0x7f403409f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f403a000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40340c4ad0 con 0x7f403406aea0 2024-04-02T07:34:32.329 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f403a000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40340c4100 con 0x7f40340cc9e0 2024-04-02T07:34:32.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f403a000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40340c34f0 con 0x7f40340ae410 2024-04-02T07:34:32.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f4038c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f403406aea0 0x7f40340c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f4038c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f403406aea0 0x7f40340c4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:34076/0 (socket says 172.21.15.55:34076) 2024-04-02T07:34:32.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f4038c00640 1 -- 172.21.15.55:0/3005800624 learned_addr learned my addr 172.21.15.55:0/3005800624 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:32.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f4033e00640 1 --2- 172.21.15.55:0/3005800624 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40340ae410 0x7f40340b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f4039600640 1 --2- 172.21.15.55:0/3005800624 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40340cc9e0 0x7f403409f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f4038c00640 1 -- 172.21.15.55:0/3005800624 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40340ae410 msgr2=0x7f40340b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:32.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f4038c00640 1 --2- 172.21.15.55:0/3005800624 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40340ae410 0x7f40340b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f4038c00640 1 -- 172.21.15.55:0/3005800624 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40340cc9e0 msgr2=0x7f403409f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:32.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f4038c00640 1 --2- 172.21.15.55:0/3005800624 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40340cc9e0 0x7f403409f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f4038c00640 1 -- 172.21.15.55:0/3005800624 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40200094d0 con 0x7f403406aea0 2024-04-02T07:34:32.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f4038c00640 1 --2- 172.21.15.55:0/3005800624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f403406aea0 0x7f40340c4590 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f402800c450 tx=0x7f402800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:32.331 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f4030c00640 1 -- 172.21.15.55:0/3005800624 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4028012830 con 0x7f403406aea0 2024-04-02T07:34:32.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f4030c00640 1 -- 172.21.15.55:0/3005800624 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40280129b0 con 0x7f403406aea0 2024-04-02T07:34:32.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f4030c00640 1 -- 172.21.15.55:0/3005800624 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4028012d60 con 0x7f403406aea0 2024-04-02T07:34:32.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f403a000640 1 -- 172.21.15.55:0/3005800624 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40340c37d0 con 0x7f403406aea0 2024-04-02T07:34:32.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f403a000640 1 -- 172.21.15.55:0/3005800624 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40340c3d90 con 0x7f403406aea0 2024-04-02T07:34:32.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f403a000640 1 -- 172.21.15.55:0/3005800624 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4034073fa0 con 0x7f403406aea0 2024-04-02T07:34:32.332 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.331+0000 7f4030c00640 1 -- 172.21.15.55:0/3005800624 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f402801c460 con 0x7f403406aea0 2024-04-02T07:34:32.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.335+0000 7f4030c00640 1 --2- 172.21.15.55:0/3005800624 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f40140666c0 0x7f4014068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:32.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.335+0000 7f4030c00640 1 -- 172.21.15.55:0/3005800624 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f4028083f20 con 0x7f403406aea0 2024-04-02T07:34:32.333 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.335+0000 7f4033e00640 1 --2- 172.21.15.55:0/3005800624 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f40140666c0 0x7f4014068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:32.334 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.335+0000 7f4033e00640 1 --2- 172.21.15.55:0/3005800624 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f40140666c0 0x7f4014068b80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f40200ae000 tx=0x7f40200b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:32.337 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.339+0000 7f4030c00640 1 -- 172.21.15.55:0/3005800624 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f4028051250 con 0x7f403406aea0 2024-04-02T07:34:32.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.535+0000 7f403a000640 1 -- 172.21.15.55:0/3005800624 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f40340660d0 con 0x7f403406aea0 2024-04-02T07:34:32.533 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.535+0000 7f4030c00640 1 -- 172.21.15.55:0/3005800624 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v109) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4028054870 con 0x7f403406aea0 2024-04-02T07:34:32.533 INFO:teuthology.orchestra.run.smithi055.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-02T07:34:32.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.535+0000 7f403a000640 1 -- 172.21.15.55:0/3005800624 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f40140666c0 msgr2=0x7f4014068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:32.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.535+0000 7f403a000640 1 --2- 172.21.15.55:0/3005800624 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f40140666c0 0x7f4014068b80 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f40200ae000 tx=0x7f40200b5040 comp rx=0 tx=0).stop 2024-04-02T07:34:32.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.535+0000 7f403a000640 1 -- 172.21.15.55:0/3005800624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f403406aea0 msgr2=0x7f40340c4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:32.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.535+0000 7f403a000640 1 --2- 172.21.15.55:0/3005800624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f403406aea0 0x7f40340c4590 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f402800c450 tx=0x7f402800c910 comp rx=0 tx=0).stop 2024-04-02T07:34:32.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.535+0000 7f403a000640 1 -- 172.21.15.55:0/3005800624 shutdown_connections 2024-04-02T07:34:32.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.535+0000 7f403a000640 1 --2- 172.21.15.55:0/3005800624 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f40140666c0 0x7f4014068b80 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.535+0000 7f403a000640 1 --2- 172.21.15.55:0/3005800624 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f40340cc9e0 0x7f403409f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.535+0000 7f403a000640 1 --2- 172.21.15.55:0/3005800624 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f40340ae410 0x7f40340b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.535+0000 7f403a000640 1 --2- 172.21.15.55:0/3005800624 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f403406aea0 0x7f40340c4590 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:32.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.535+0000 7f403a000640 1 -- 172.21.15.55:0/3005800624 >> 172.21.15.55:0/3005800624 conn(0x7f40340b0900 msgr2=0x7f40340cdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:32.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.535+0000 7f403a000640 1 -- 172.21.15.55:0/3005800624 shutdown_connections 2024-04-02T07:34:32.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:32.535+0000 7f403a000640 1 -- 172.21.15.55:0/3005800624 wait complete. 2024-04-02T07:34:32.554 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-02T07:34:32.555 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-02T07:34:32.555 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi055.front.sepia.ceph.com 2024-04-02T07:34:32.555 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-02T07:34:32.555 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-02T07:34:32.555 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-02T07:34:32.555 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-02T07:34:32.555 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-02T07:34:32.555 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:34:32.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:32.556 DEBUG:teuthology.orchestra.run.smithi055:> ip addr 2024-04-02T07:34:32.567 INFO:teuthology.orchestra.run.smithi055.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-02T07:34:32.567 INFO:teuthology.orchestra.run.smithi055.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-02T07:34:32.567 INFO:teuthology.orchestra.run.smithi055.stdout: inet 127.0.0.1/8 scope host lo 2024-04-02T07:34:32.567 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:34:32.567 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 ::1/128 scope host 2024-04-02T07:34:32.567 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:34:32.567 INFO:teuthology.orchestra.run.smithi055.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:34:32.567 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d6 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:34:32.568 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f0 2024-04-02T07:34:32.568 INFO:teuthology.orchestra.run.smithi055.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:34:32.568 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0c:c4:7a:6b:fd:d7 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:34:32.568 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp7s0f1 2024-04-02T07:34:32.568 INFO:teuthology.orchestra.run.smithi055.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-02T07:34:32.568 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:06 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:34:32.568 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f0 2024-04-02T07:34:32.568 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.21.15.55/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-02T07:34:32.568 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft 41722sec preferred_lft 41722sec 2024-04-02T07:34:32.568 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::ae1f:6bff:fef8:2606/64 scope link 2024-04-02T07:34:32.568 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:34:32.569 INFO:teuthology.orchestra.run.smithi055.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-02T07:34:32.569 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether ac:1f:6b:f8:26:07 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:34:32.569 INFO:teuthology.orchestra.run.smithi055.stdout: altname enp1s0f1 2024-04-02T07:34:32.569 INFO:teuthology.orchestra.run.smithi055.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-02T07:34:32.569 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 02:42:81:5a:89:17 brd ff:ff:ff:ff:ff:ff 2024-04-02T07:34:32.569 INFO:teuthology.orchestra.run.smithi055.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-02T07:34:32.569 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:34:32.569 INFO:teuthology.orchestra.run.smithi055.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-04-02T07:34:32.569 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2024-04-02T07:34:32.569 INFO:teuthology.orchestra.run.smithi055.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-04-02T07:34:32.569 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:34:32.570 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2024-04-02T07:34:32.570 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:34:32.570 INFO:teuthology.orchestra.run.smithi055.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:34:32.570 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-02T07:34:32.570 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2024-04-02T07:34:32.570 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:34:32.570 INFO:teuthology.orchestra.run.smithi055.stdout:9: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-04-02T07:34:32.570 INFO:teuthology.orchestra.run.smithi055.stdout: link/ether c6:a6:3d:69:d0:db brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-02T07:34:32.570 INFO:teuthology.orchestra.run.smithi055.stdout: inet6 fe80::c4a6:3dff:fe69:d0db/64 scope link 2024-04-02T07:34:32.570 INFO:teuthology.orchestra.run.smithi055.stdout: valid_lft forever preferred_lft forever 2024-04-02T07:34:32.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:32.571 DEBUG:teuthology.orchestra.run.smithi055:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-02T07:34:32.630 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:34:32.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:32.632 DEBUG:teuthology.orchestra.run.smithi055:> route 2024-04-02T07:34:32.689 INFO:teuthology.orchestra.run.smithi055.stdout:Kernel IP routing table 2024-04-02T07:34:32.689 INFO:teuthology.orchestra.run.smithi055.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-02T07:34:32.689 INFO:teuthology.orchestra.run.smithi055.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-02T07:34:32.689 INFO:teuthology.orchestra.run.smithi055.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-02T07:34:32.689 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-02T07:34:32.689 INFO:teuthology.orchestra.run.smithi055.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-02T07:34:32.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:32.689 DEBUG:teuthology.orchestra.run.smithi055:> (cd / && exec bash -c ' 2024-04-02T07:34:32.689 DEBUG:teuthology.orchestra.run.smithi055:> set -e 2024-04-02T07:34:32.690 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-02T07:34:32.690 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-02T07:34:32.690 DEBUG:teuthology.orchestra.run.smithi055:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-02T07:34:32.690 DEBUG:teuthology.orchestra.run.smithi055:> ') 2024-04-02T07:34:32.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:32.783 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-02T07:34:32.792 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-02T07:34:32.792 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-02T07:34:32.793 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:34:32.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:32.793 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link set brx.0 up 2024-04-02T07:34:32.856 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-02T07:34:32.856 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:34:32.856 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-02T07:34:32.908 INFO:teuthology.orchestra.run.smithi055.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-02T07:34:32.908 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-02T07:34:32.908 DEBUG:teuthology.orchestra.run.smithi055:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:34:32.959 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:34:33.020 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:34:33.020 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:34:33.081 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:34:33.083 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:34:33.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:33.084 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:34:33.136 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-02T07:34:33.136 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-02T07:34:33.183 DEBUG:teuthology.orchestra.run.smithi055:> sudo modprobe fuse 2024-04-02T07:34:33.203 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-04-02T07:34:33.203 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-04-02T07:34:33.266 INFO:teuthology.orchestra.run.smithi055.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-04-02T07:34:33.268 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-04-02T07:34:33.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:33.269 DEBUG:teuthology.orchestra.run.smithi055:> ls /sys/fs/fuse/connections 2024-04-02T07:34:33.278 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:2024-04-02T07:34:33.279+0000 7f90f18bf580 -1 init, newargv = 0x55e36d7b4020 newargc=15 2024-04-02T07:34:33.279 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[54156]: starting ceph client 2024-04-02T07:34:33.285 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[54156]: starting fuse 2024-04-02T07:34:33.288 INFO:teuthology.orchestra.run.smithi055.stdout:43 2024-04-02T07:34:33.288 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-02T07:34:33.288 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:34:33.289 DEBUG:teuthology.orchestra.run.smithi055:> import glob 2024-04-02T07:34:33.289 DEBUG:teuthology.orchestra.run.smithi055:> import re 2024-04-02T07:34:33.289 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:34:33.289 DEBUG:teuthology.orchestra.run.smithi055:> import subprocess 2024-04-02T07:34:33.289 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:33.289 DEBUG:teuthology.orchestra.run.smithi055:> def _find_admin_socket(client_name): 2024-04-02T07:34:33.289 DEBUG:teuthology.orchestra.run.smithi055:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-02T07:34:33.289 DEBUG:teuthology.orchestra.run.smithi055:> files = glob.glob(asok_path) 2024-04-02T07:34:33.289 DEBUG:teuthology.orchestra.run.smithi055:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-02T07:34:33.289 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:33.289 DEBUG:teuthology.orchestra.run.smithi055:> # Given a non-glob path, it better be there 2024-04-02T07:34:33.289 DEBUG:teuthology.orchestra.run.smithi055:> if "*" not in asok_path: 2024-04-02T07:34:33.289 DEBUG:teuthology.orchestra.run.smithi055:> assert(len(files) == 1) 2024-04-02T07:34:33.289 DEBUG:teuthology.orchestra.run.smithi055:> return files[0] 2024-04-02T07:34:33.289 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:33.289 DEBUG:teuthology.orchestra.run.smithi055:> for f in files: 2024-04-02T07:34:33.290 DEBUG:teuthology.orchestra.run.smithi055:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-02T07:34:33.290 DEBUG:teuthology.orchestra.run.smithi055:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-02T07:34:33.290 DEBUG:teuthology.orchestra.run.smithi055:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-02T07:34:33.290 DEBUG:teuthology.orchestra.run.smithi055:> contents = proc_f.read() 2024-04-02T07:34:33.290 DEBUG:teuthology.orchestra.run.smithi055:> if mountpoint in contents: 2024-04-02T07:34:33.290 DEBUG:teuthology.orchestra.run.smithi055:> return f 2024-04-02T07:34:33.290 DEBUG:teuthology.orchestra.run.smithi055:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-02T07:34:33.290 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:33.290 DEBUG:teuthology.orchestra.run.smithi055:> print(_find_admin_socket("client.0")) 2024-04-02T07:34:33.290 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:34:33.416 INFO:teuthology.orchestra.run.smithi055.stdout:/var/run/ceph/ceph-client.0.54156.asok 2024-04-02T07:34:33.600 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.54156.asok 2024-04-02T07:34:33.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:33.600 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.54156.asok status 2024-04-02T07:34:33.774 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:34:33.774 INFO:teuthology.orchestra.run.smithi055.stdout: "metadata": { 2024-04-02T07:34:33.774 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_sha1": "d0e392d9aee635f2b65768c460c7a151ead7a5e2", 2024-04-02T07:34:33.774 INFO:teuthology.orchestra.run.smithi055.stdout: "ceph_version": "ceph version 18.2.2-1015-gd0e392d9 (d0e392d9aee635f2b65768c460c7a151ead7a5e2) reef (stable)", 2024-04-02T07:34:33.774 INFO:teuthology.orchestra.run.smithi055.stdout: "entity_id": "0", 2024-04-02T07:34:33.774 INFO:teuthology.orchestra.run.smithi055.stdout: "hostname": "smithi055", 2024-04-02T07:34:33.775 INFO:teuthology.orchestra.run.smithi055.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-02T07:34:33.775 INFO:teuthology.orchestra.run.smithi055.stdout: "pid": "54156", 2024-04-02T07:34:33.775 INFO:teuthology.orchestra.run.smithi055.stdout: "root": "/" 2024-04-02T07:34:33.775 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:34:33.775 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_count": 0, 2024-04-02T07:34:33.775 INFO:teuthology.orchestra.run.smithi055.stdout: "dentry_pinned_count": 0, 2024-04-02T07:34:33.775 INFO:teuthology.orchestra.run.smithi055.stdout: "id": 9822, 2024-04-02T07:34:33.775 INFO:teuthology.orchestra.run.smithi055.stdout: "inst": { 2024-04-02T07:34:33.775 INFO:teuthology.orchestra.run.smithi055.stdout: "name": { 2024-04-02T07:34:33.775 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "client", 2024-04-02T07:34:33.775 INFO:teuthology.orchestra.run.smithi055.stdout: "num": 9822 2024-04-02T07:34:33.775 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:34:33.775 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:34:33.775 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:34:33.775 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:34:33.776 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 1395781027 2024-04-02T07:34:33.776 INFO:teuthology.orchestra.run.smithi055.stdout: } 2024-04-02T07:34:33.776 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:34:33.776 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": { 2024-04-02T07:34:33.776 INFO:teuthology.orchestra.run.smithi055.stdout: "type": "v1", 2024-04-02T07:34:33.776 INFO:teuthology.orchestra.run.smithi055.stdout: "addr": "192.168.0.1:0", 2024-04-02T07:34:33.776 INFO:teuthology.orchestra.run.smithi055.stdout: "nonce": 1395781027 2024-04-02T07:34:33.776 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2024-04-02T07:34:33.776 INFO:teuthology.orchestra.run.smithi055.stdout: "inst_str": "client.9822 192.168.0.1:0/1395781027", 2024-04-02T07:34:33.776 INFO:teuthology.orchestra.run.smithi055.stdout: "addr_str": "192.168.0.1:0/1395781027", 2024-04-02T07:34:33.776 INFO:teuthology.orchestra.run.smithi055.stdout: "inode_count": 1, 2024-04-02T07:34:33.776 INFO:teuthology.orchestra.run.smithi055.stdout: "mds_epoch": 109, 2024-04-02T07:34:33.776 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch": 120, 2024-04-02T07:34:33.776 INFO:teuthology.orchestra.run.smithi055.stdout: "osd_epoch_barrier": 0, 2024-04-02T07:34:33.777 INFO:teuthology.orchestra.run.smithi055.stdout: "blocklisted": false, 2024-04-02T07:34:33.777 INFO:teuthology.orchestra.run.smithi055.stdout: "fs_name": "cephfs" 2024-04-02T07:34:33.777 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:34:33.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:33.789 DEBUG:teuthology.orchestra.run.smithi055:> stat --file-system '--printf=%T 2024-04-02T07:34:33.789 DEBUG:teuthology.orchestra.run.smithi055:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-02T07:34:33.799 INFO:teuthology.orchestra.run.smithi055.stdout:fuseblk 2024-04-02T07:34:33.799 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-02T07:34:33.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:33.799 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-02T07:34:33.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:33.859 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest/mnt.0 && exec find ./) 2024-04-02T07:34:33.921 INFO:teuthology.orchestra.run.smithi055.stdout:./ 2024-04-02T07:34:33.921 INFO:teuthology.orchestra.run.smithi055.stdout:./parent 2024-04-02T07:34:33.921 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed 2024-04-02T07:34:33.921 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed/charlie 2024-04-02T07:34:33.921 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed/alpha 2024-04-02T07:34:33.921 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/flushed/bravo 2024-04-02T07:34:33.921 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/unflushed 2024-04-02T07:34:33.921 INFO:teuthology.orchestra.run.smithi055.stdout:./parent/unflushed/jfile 2024-04-02T07:34:33.923 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:34:33.923 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:34:33.923 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:34:33.923 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:33.923 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./").st_ino) 2024-04-02T07:34:33.923 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:34:34.031 INFO:teuthology.orchestra.run.smithi055.stdout:1 2024-04-02T07:34:34.220 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:34:34.221 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:34:34.221 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:34:34.221 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:34.221 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent").st_ino) 2024-04-02T07:34:34.221 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:34:34.332 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627776 2024-04-02T07:34:34.522 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:34:34.522 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:34:34.522 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:34:34.522 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:34.523 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed").st_ino) 2024-04-02T07:34:34.523 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:34:34.633 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627777 2024-04-02T07:34:34.822 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:34:34.822 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:34:34.822 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:34:34.822 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:34.822 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/charlie").st_ino) 2024-04-02T07:34:34.822 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:34:34.932 INFO:teuthology.orchestra.run.smithi055.stdout:1099511628280 2024-04-02T07:34:35.121 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:34:35.121 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:34:35.121 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:34:35.121 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:35.121 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/alpha").st_ino) 2024-04-02T07:34:35.121 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:34:35.233 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627778 2024-04-02T07:34:35.421 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:34:35.421 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:34:35.421 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:34:35.422 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:35.422 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/flushed/bravo").st_ino) 2024-04-02T07:34:35.422 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:34:35.533 INFO:teuthology.orchestra.run.smithi055.stdout:1099511628279 2024-04-02T07:34:35.722 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:34:35.722 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:34:35.722 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:34:35.722 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:35.722 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed").st_ino) 2024-04-02T07:34:35.722 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:34:35.828 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627779 2024-04-02T07:34:36.018 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits daemon-helper kill python3 -c ' 2024-04-02T07:34:36.018 DEBUG:teuthology.orchestra.run.smithi055:> import os 2024-04-02T07:34:36.018 DEBUG:teuthology.orchestra.run.smithi055:> import stat 2024-04-02T07:34:36.018 DEBUG:teuthology.orchestra.run.smithi055:> 2024-04-02T07:34:36.018 DEBUG:teuthology.orchestra.run.smithi055:> print(os.stat("/home/ubuntu/cephtest/mnt.0/./parent/unflushed/jfile").st_ino) 2024-04-02T07:34:36.018 DEBUG:teuthology.orchestra.run.smithi055:> ' 2024-04-02T07:34:36.124 INFO:teuthology.orchestra.run.smithi055.stdout:1099511627780 2024-04-02T07:34:36.314 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-04-02T07:34:36.314 DEBUG:teuthology.orchestra.run.smithi055:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:34:36.459 DEBUG:teuthology.orchestra.run.smithi106:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-04-02T07:34:36.518 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-04-02T07:34:36.518 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:34:36.518 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:34:36.527 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:34:36.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.711+0000 7f25b8c00640 1 Processor -- start 2024-04-02T07:34:36.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.711+0000 7f25b8c00640 1 -- start start 2024-04-02T07:34:36.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.715+0000 7f25b8c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25b4143f90 0x7f25b415ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:36.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.715+0000 7f25b8c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25b40cda80 0x7f25b40c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:36.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.715+0000 7f25b8c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25b415b270 con 0x7f25b40b34f0 2024-04-02T07:34:36.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.715+0000 7f25b8c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25b4144370 con 0x7f25b40cda80 2024-04-02T07:34:36.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.715+0000 7f25b8c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b40c37b0 con 0x7f25b4143f90 2024-04-02T07:34:36.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.715+0000 7f25b2800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25b40cda80 0x7f25b40c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:36.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.715+0000 7f25b1400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f25b40b34f0 0x7f25b40cd370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45530/0 (socket says 172.21.15.55:45530) 2024-04-02T07:34:36.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.715+0000 7f25b1400640 1 -- 172.21.15.55:0/1254642928 learned_addr learned my addr 172.21.15.55:0/1254642928 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:36.714 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.715+0000 7f25b1e00640 1 --2- 172.21.15.55:0/1254642928 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25b4143f90 0x7f25b415ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:36.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.715+0000 7f25b2800640 1 -- 172.21.15.55:0/1254642928 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25b4143f90 msgr2=0x7f25b415ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:36.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.715+0000 7f25b2800640 1 --2- 172.21.15.55:0/1254642928 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25b4143f90 0x7f25b415ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:36.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.715+0000 7f25b2800640 1 -- 172.21.15.55:0/1254642928 >> v1:172.21.15.55:6789/0 conn(0x7f25b40b34f0 legacy=0x7f25b40cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:36.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.715+0000 7f25b0a00640 1 -- 172.21.15.55:0/1254642928 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205113737 0 0) 0x7f25b415b270 con 0x7f25b40b34f0 2024-04-02T07:34:36.715 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.715+0000 7f25b2800640 1 -- 172.21.15.55:0/1254642928 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25b40c3a90 con 0x7f25b40cda80 2024-04-02T07:34:36.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.719+0000 7f25b2800640 1 --2- 172.21.15.55:0/1254642928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25b40cda80 0x7f25b40c4850 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009d90 tx=0x7f25ac01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b054c387d891df60 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:36.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.719+0000 7f25b0a00640 1 -- 172.21.15.55:0/1254642928 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0a5970 con 0x7f25b40cda80 2024-04-02T07:34:36.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.719+0000 7f25b0a00640 1 -- 172.21.15.55:0/1254642928 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25ac0a5ad0 con 0x7f25b40cda80 2024-04-02T07:34:36.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.719+0000 7f25b0a00640 1 -- 172.21.15.55:0/1254642928 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25ac0a5e60 con 0x7f25b40cda80 2024-04-02T07:34:36.717 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.719+0000 7f25b8c00640 1 -- 172.21.15.55:0/1254642928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25b40cda80 msgr2=0x7f25b40c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:36.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.719+0000 7f25b8c00640 1 --2- 172.21.15.55:0/1254642928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25b40cda80 0x7f25b40c4850 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f25ac009d90 tx=0x7f25ac01c8b0 comp rx=0 tx=0).stop 2024-04-02T07:34:36.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.719+0000 7f25b8c00640 1 -- 172.21.15.55:0/1254642928 shutdown_connections 2024-04-02T07:34:36.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.719+0000 7f25b8c00640 1 --2- 172.21.15.55:0/1254642928 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25b40cda80 0x7f25b40c4850 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:36.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.719+0000 7f25b8c00640 1 --2- 172.21.15.55:0/1254642928 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25b4143f90 0x7f25b415ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:36.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.719+0000 7f25b8c00640 1 -- 172.21.15.55:0/1254642928 >> 172.21.15.55:0/1254642928 conn(0x7f25b4066080 msgr2=0x7f25b4069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:36.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.719+0000 7f25b8c00640 1 -- 172.21.15.55:0/1254642928 shutdown_connections 2024-04-02T07:34:36.718 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.719+0000 7f25b8c00640 1 -- 172.21.15.55:0/1254642928 wait complete. 2024-04-02T07:34:36.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.719+0000 7f25b8c00640 1 Processor -- start 2024-04-02T07:34:36.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.719+0000 7f25b8c00640 1 -- start start 2024-04-02T07:34:36.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b8c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25b40b34f0 0x7f25b413e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:36.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b8c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25b40cda80 0x7f25b40c6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:36.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b8c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25b4143f90 0x7f25b40c8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:36.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b8c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b40c74b0 con 0x7f25b40cda80 2024-04-02T07:34:36.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b8c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25b41407a0 con 0x7f25b4143f90 2024-04-02T07:34:36.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b8c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25b4140a80 con 0x7f25b40b34f0 2024-04-02T07:34:36.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b1400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25b40cda80 0x7f25b40c6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:36.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b1400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25b40cda80 0x7f25b40c6af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33590/0 (socket says 172.21.15.55:33590) 2024-04-02T07:34:36.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b1400640 1 -- 172.21.15.55:0/2304536138 learned_addr learned my addr 172.21.15.55:0/2304536138 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:36.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b1e00640 1 --2- 172.21.15.55:0/2304536138 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25b40b34f0 0x7f25b413e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:36.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b2800640 1 --2- 172.21.15.55:0/2304536138 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25b4143f90 0x7f25b40c8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:36.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b1400640 1 -- 172.21.15.55:0/2304536138 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25b40b34f0 msgr2=0x7f25b413e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:36.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b1400640 1 --2- 172.21.15.55:0/2304536138 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25b40b34f0 0x7f25b413e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:36.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b1400640 1 -- 172.21.15.55:0/2304536138 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25b4143f90 msgr2=0x7f25b40c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:36.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b1400640 1 --2- 172.21.15.55:0/2304536138 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25b4143f90 0x7f25b40c8ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:36.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b1400640 1 -- 172.21.15.55:0/2304536138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25ac009a70 con 0x7f25b40cda80 2024-04-02T07:34:36.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b2800640 1 --2- 172.21.15.55:0/2304536138 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25b4143f90 0x7f25b40c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:36.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b1400640 1 --2- 172.21.15.55:0/2304536138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25b40cda80 0x7f25b40c6af0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f25a00011f0 tx=0x7f25a000c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:36.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25aa000640 1 -- 172.21.15.55:0/2304536138 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a00074e0 con 0x7f25b40cda80 2024-04-02T07:34:36.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25aa000640 1 -- 172.21.15.55:0/2304536138 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f25a0007640 con 0x7f25b40cda80 2024-04-02T07:34:36.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25aa000640 1 -- 172.21.15.55:0/2304536138 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25a0004a10 con 0x7f25b40cda80 2024-04-02T07:34:36.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b8c00640 1 -- 172.21.15.55:0/2304536138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25b4140d60 con 0x7f25b40cda80 2024-04-02T07:34:36.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b8c00640 1 -- 172.21.15.55:0/2304536138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25b413e670 con 0x7f25b40cda80 2024-04-02T07:34:36.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25b8c00640 1 -- 172.21.15.55:0/2304536138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25b4140fa0 con 0x7f25b40cda80 2024-04-02T07:34:36.723 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.723+0000 7f25aa000640 1 -- 172.21.15.55:0/2304536138 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f25a0004b70 con 0x7f25b40cda80 2024-04-02T07:34:36.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.727+0000 7f25aa000640 1 --2- 172.21.15.55:0/2304536138 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2594066690 0x7f2594068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:36.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.727+0000 7f25aa000640 1 -- 172.21.15.55:0/2304536138 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f25a0083600 con 0x7f25b40cda80 2024-04-02T07:34:36.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.727+0000 7f25b1e00640 1 --2- 172.21.15.55:0/2304536138 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2594066690 0x7f2594068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:36.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.727+0000 7f25b1e00640 1 --2- 172.21.15.55:0/2304536138 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2594066690 0x7f2594068b50 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f25b415c6a0 tx=0x7f25a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:36.728 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.731+0000 7f25aa000640 1 -- 172.21.15.55:0/2304536138 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f25b4140fa0 con 0x7f25b40cda80 2024-04-02T07:34:36.888 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.887+0000 7f25b8c00640 1 -- 172.21.15.55:0/2304536138 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f25b4066c90 con 0x7f25b40cda80 2024-04-02T07:34:36.889 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.891+0000 7f25aa000640 1 -- 172.21.15.55:0/2304536138 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+16409 (secure 0 0 0) 0x7f25a0018090 con 0x7f25b40cda80 2024-04-02T07:34:36.889 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:36.889 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":120,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:34:25.539106+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:33:26.384276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-02T07:33:26.835969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.7","mappings":[{"from":0,"to":5}]},{"pgid":"17.21","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6835/154663344":"2024-04-03T07:34:25.539082+0000","172.21.15.55:6832/154663344":"2024-04-03T07:34:25.539082+0000","172.21.15.106:6837/775582321":"2024-04-03T07:34:04.807966+0000","172.21.15.106:6834/775582321":"2024-04-03T07:34:04.807966+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:34:36.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.891+0000 7f25b8c00640 1 -- 172.21.15.55:0/2304536138 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2594066690 msgr2=0x7f2594068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:36.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.891+0000 7f25b8c00640 1 --2- 172.21.15.55:0/2304536138 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2594066690 0x7f2594068b50 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f25b415c6a0 tx=0x7f25a4008040 comp rx=0 tx=0).stop 2024-04-02T07:34:36.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.891+0000 7f25b8c00640 1 -- 172.21.15.55:0/2304536138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25b40cda80 msgr2=0x7f25b40c6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:36.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.891+0000 7f25b8c00640 1 --2- 172.21.15.55:0/2304536138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25b40cda80 0x7f25b40c6af0 secure :-1 s=READY pgs=1891 cs=0 l=1 rev1=1 crypto rx=0x7f25a00011f0 tx=0x7f25a000c9b0 comp rx=0 tx=0).stop 2024-04-02T07:34:36.891 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.891+0000 7f25b8c00640 1 -- 172.21.15.55:0/2304536138 shutdown_connections 2024-04-02T07:34:36.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.891+0000 7f25b8c00640 1 --2- 172.21.15.55:0/2304536138 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2594066690 0x7f2594068b50 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:36.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.891+0000 7f25b8c00640 1 --2- 172.21.15.55:0/2304536138 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25b4143f90 0x7f25b40c8ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:36.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.891+0000 7f25b8c00640 1 --2- 172.21.15.55:0/2304536138 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25b40cda80 0x7f25b40c6af0 unknown :-1 s=CLOSED pgs=1891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:36.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.891+0000 7f25b8c00640 1 --2- 172.21.15.55:0/2304536138 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25b40b34f0 0x7f25b413e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:36.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.891+0000 7f25b8c00640 1 -- 172.21.15.55:0/2304536138 >> 172.21.15.55:0/2304536138 conn(0x7f25b4066080 msgr2=0x7f25b41431d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:36.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.891+0000 7f25b8c00640 1 -- 172.21.15.55:0/2304536138 shutdown_connections 2024-04-02T07:34:36.892 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:36.891+0000 7f25b8c00640 1 -- 172.21.15.55:0/2304536138 wait complete. 2024-04-02T07:34:36.912 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:33:26.384276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:33:26.835969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:34:36.912 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:34:37.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.055+0000 7fa921400640 1 Processor -- start 2024-04-02T07:34:37.056 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.055+0000 7fa921400640 1 -- start start 2024-04-02T07:34:37.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.059+0000 7fa921400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa91c157000 0x7fa91c071a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:37.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.059+0000 7fa921400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa91c071f60 0x7fa91c069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:37.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.059+0000 7fa921400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa91c15de90 con 0x7fa91c06a2d0 2024-04-02T07:34:37.057 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.059+0000 7fa921400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa91c15d070 con 0x7fa91c071f60 2024-04-02T07:34:37.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.059+0000 7fa921400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c0723e0 con 0x7fa91c157000 2024-04-02T07:34:37.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.059+0000 7fa911e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa91c071f60 0x7fa91c069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:37.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.059+0000 7fa911e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa91c071f60 0x7fa91c069d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33594/0 (socket says 172.21.15.55:33594) 2024-04-02T07:34:37.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.059+0000 7fa911e00640 1 -- 172.21.15.55:0/447365947 learned_addr learned my addr 172.21.15.55:0/447365947 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:37.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.059+0000 7fa91a800640 1 --2- 172.21.15.55:0/447365947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa91c157000 0x7fa91c071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:37.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.059+0000 7fa911e00640 1 -- 172.21.15.55:0/447365947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa91c157000 msgr2=0x7fa91c071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:37.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.059+0000 7fa911e00640 1 --2- 172.21.15.55:0/447365947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa91c157000 0x7fa91c071a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.059+0000 7fa911e00640 1 -- 172.21.15.55:0/447365947 >> v1:172.21.15.106:6789/0 conn(0x7fa91c06a2d0 legacy=0x7fa91c0cf5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:37.058 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.059+0000 7fa911e00640 1 -- 172.21.15.55:0/447365947 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa91c06a760 con 0x7fa91c071f60 2024-04-02T07:34:37.060 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.063+0000 7fa911e00640 1 --2- 172.21.15.55:0/447365947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c071f60 0x7fa91c069d90 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fa904009870 tx=0x7fa90401c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18c2686a23a10956 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.063+0000 7fa919e00640 1 -- 172.21.15.55:0/447365947 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9040ab650 con 0x7fa91c071f60 2024-04-02T07:34:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.063+0000 7fa919e00640 1 -- 172.21.15.55:0/447365947 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9040ab7b0 con 0x7fa91c071f60 2024-04-02T07:34:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.063+0000 7fa919e00640 1 -- 172.21.15.55:0/447365947 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9040abb40 con 0x7fa91c071f60 2024-04-02T07:34:37.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.063+0000 7fa921400640 1 -- 172.21.15.55:0/447365947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c071f60 msgr2=0x7fa91c069d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:37.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.063+0000 7fa921400640 1 --2- 172.21.15.55:0/447365947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c071f60 0x7fa91c069d90 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7fa904009870 tx=0x7fa90401c530 comp rx=0 tx=0).stop 2024-04-02T07:34:37.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.063+0000 7fa921400640 1 -- 172.21.15.55:0/447365947 shutdown_connections 2024-04-02T07:34:37.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.063+0000 7fa921400640 1 --2- 172.21.15.55:0/447365947 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c071f60 0x7fa91c069d90 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.063+0000 7fa921400640 1 --2- 172.21.15.55:0/447365947 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa91c157000 0x7fa91c071a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.063+0000 7fa921400640 1 -- 172.21.15.55:0/447365947 >> 172.21.15.55:0/447365947 conn(0x7fa91c0b13b0 msgr2=0x7fa91c0b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:37.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.063+0000 7fa921400640 1 -- 172.21.15.55:0/447365947 shutdown_connections 2024-04-02T07:34:37.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.063+0000 7fa921400640 1 -- 172.21.15.55:0/447365947 wait complete. 2024-04-02T07:34:37.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.063+0000 7fa921400640 1 Processor -- start 2024-04-02T07:34:37.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.063+0000 7fa921400640 1 -- start start 2024-04-02T07:34:37.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa921400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c06a2d0 0x7fa91c142a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:37.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa921400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa91c071f60 0x7fa91c0cca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:37.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa921400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa91c157000 0x7fa91c150e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:37.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa921400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c0ce7d0 con 0x7fa91c06a2d0 2024-04-02T07:34:37.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa921400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c0ca0f0 con 0x7fa91c071f60 2024-04-02T07:34:37.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa921400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91c0ce340 con 0x7fa91c157000 2024-04-02T07:34:37.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa91a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c06a2d0 0x7fa91c142a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:37.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa91a800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c06a2d0 0x7fa91c142a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33598/0 (socket says 172.21.15.55:33598) 2024-04-02T07:34:37.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa91a800640 1 -- 172.21.15.55:0/4173734654 learned_addr learned my addr 172.21.15.55:0/4173734654 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:37.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa91b200640 1 --2- 172.21.15.55:0/4173734654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa91c157000 0x7fa91c150e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:37.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa911e00640 1 --2- 172.21.15.55:0/4173734654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa91c071f60 0x7fa91c0cca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:37.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa91a800640 1 -- 172.21.15.55:0/4173734654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa91c157000 msgr2=0x7fa91c150e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:37.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa91a800640 1 --2- 172.21.15.55:0/4173734654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa91c157000 0x7fa91c150e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa91a800640 1 -- 172.21.15.55:0/4173734654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa91c071f60 msgr2=0x7fa91c0cca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:37.066 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa91a800640 1 --2- 172.21.15.55:0/4173734654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa91c071f60 0x7fa91c0cca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa91a800640 1 -- 172.21.15.55:0/4173734654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9040094d0 con 0x7fa91c06a2d0 2024-04-02T07:34:37.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa911e00640 1 --2- 172.21.15.55:0/4173734654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa91c071f60 0x7fa91c0cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:37.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa91a800640 1 --2- 172.21.15.55:0/4173734654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c06a2d0 0x7fa91c142a70 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fa90c007e90 tx=0x7fa90c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:37.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa913400640 1 -- 172.21.15.55:0/4173734654 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c014420 con 0x7fa91c06a2d0 2024-04-02T07:34:37.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa913400640 1 -- 172.21.15.55:0/4173734654 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa90c0145a0 con 0x7fa91c06a2d0 2024-04-02T07:34:37.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa913400640 1 -- 172.21.15.55:0/4173734654 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa90c014950 con 0x7fa91c06a2d0 2024-04-02T07:34:37.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa921400640 1 -- 172.21.15.55:0/4173734654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa91c0ccf40 con 0x7fa91c06a2d0 2024-04-02T07:34:37.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa921400640 1 -- 172.21.15.55:0/4173734654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa91c0cd730 con 0x7fa91c06a2d0 2024-04-02T07:34:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa921400640 1 -- 172.21.15.55:0/4173734654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa91c15f0b0 con 0x7fa91c06a2d0 2024-04-02T07:34:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.067+0000 7fa913400640 1 -- 172.21.15.55:0/4173734654 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa90c014ab0 con 0x7fa91c06a2d0 2024-04-02T07:34:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.071+0000 7fa913400640 1 --2- 172.21.15.55:0/4173734654 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8f8066690 0x7fa8f8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.071+0000 7fa913400640 1 -- 172.21.15.55:0/4173734654 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7fa90c084b10 con 0x7fa91c06a2d0 2024-04-02T07:34:37.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.071+0000 7fa911e00640 1 --2- 172.21.15.55:0/4173734654 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8f8066690 0x7fa8f8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:37.069 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.071+0000 7fa911e00640 1 --2- 172.21.15.55:0/4173734654 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8f8066690 0x7fa8f8068b50 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa9040af000 tx=0x7fa9040a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:37.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.071+0000 7fa913400640 1 -- 172.21.15.55:0/4173734654 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa90c051d80 con 0x7fa91c06a2d0 2024-04-02T07:34:37.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.235+0000 7fa921400640 1 -- 172.21.15.55:0/4173734654 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa91c066c90 con 0x7fa91c06a2d0 2024-04-02T07:34:37.234 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.235+0000 7fa913400640 1 -- 172.21.15.55:0/4173734654 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v120) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa90c0553a0 con 0x7fa91c06a2d0 2024-04-02T07:34:37.234 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:34:37.236 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.239+0000 7fa921400640 1 -- 172.21.15.55:0/4173734654 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8f8066690 msgr2=0x7fa8f8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:37.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.239+0000 7fa921400640 1 --2- 172.21.15.55:0/4173734654 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8f8066690 0x7fa8f8068b50 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7fa9040af000 tx=0x7fa9040a7000 comp rx=0 tx=0).stop 2024-04-02T07:34:37.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.239+0000 7fa921400640 1 -- 172.21.15.55:0/4173734654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c06a2d0 msgr2=0x7fa91c142a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:37.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.239+0000 7fa921400640 1 --2- 172.21.15.55:0/4173734654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c06a2d0 0x7fa91c142a70 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7fa90c007e90 tx=0x7fa90c00e4b0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.239+0000 7fa921400640 1 -- 172.21.15.55:0/4173734654 shutdown_connections 2024-04-02T07:34:37.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.239+0000 7fa921400640 1 --2- 172.21.15.55:0/4173734654 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa91c157000 0x7fa91c150e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.239+0000 7fa921400640 1 --2- 172.21.15.55:0/4173734654 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8f8066690 0x7fa8f8068b50 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.239+0000 7fa921400640 1 --2- 172.21.15.55:0/4173734654 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa91c071f60 0x7fa91c0cca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.239+0000 7fa921400640 1 --2- 172.21.15.55:0/4173734654 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa91c06a2d0 0x7fa91c142a70 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.239+0000 7fa921400640 1 -- 172.21.15.55:0/4173734654 >> 172.21.15.55:0/4173734654 conn(0x7fa91c0b13b0 msgr2=0x7fa91c06f430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:37.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.239+0000 7fa921400640 1 -- 172.21.15.55:0/4173734654 shutdown_connections 2024-04-02T07:34:37.237 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.239+0000 7fa921400640 1 -- 172.21.15.55:0/4173734654 wait complete. 2024-04-02T07:34:37.257 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:34:37.399 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.399+0000 7f66db200640 1 Processor -- start 2024-04-02T07:34:37.400 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.399+0000 7f66db200640 1 -- start start 2024-04-02T07:34:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.403+0000 7f66db200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66dc15b180 0x7f66dc15b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.403+0000 7f66db200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f66dc0b09a0 0x7f66dc0cb630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.403+0000 7f66db200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66dc069d90 con 0x7f66dc0c2a80 2024-04-02T07:34:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.403+0000 7f66db200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66dc0ca7a0 con 0x7f66dc15b180 2024-04-02T07:34:37.401 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.403+0000 7f66db200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66dc0cb1a0 con 0x7f66dc0b09a0 2024-04-02T07:34:37.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.403+0000 7f66d9e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66dc15b180 0x7f66dc15b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:37.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.403+0000 7f66d9e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f66dc15b180 0x7f66dc15b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33612/0 (socket says 172.21.15.55:33612) 2024-04-02T07:34:37.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.403+0000 7f66d9e00640 1 -- 172.21.15.55:0/3131617535 learned_addr learned my addr 172.21.15.55:0/3131617535 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:37.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.403+0000 7f66da800640 1 --2- 172.21.15.55:0/3131617535 >> v2:172.21.15.106:3300/0 conn(0x7f66dc0b09a0 0x7f66dc0cb630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:37.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.403+0000 7f66d9e00640 1 -- 172.21.15.55:0/3131617535 >> v2:172.21.15.106:3300/0 conn(0x7f66dc0b09a0 msgr2=0x7f66dc0cb630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:37.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.403+0000 7f66d9e00640 1 --2- 172.21.15.55:0/3131617535 >> v2:172.21.15.106:3300/0 conn(0x7f66dc0b09a0 0x7f66dc0cb630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.403+0000 7f66d9e00640 1 -- 172.21.15.55:0/3131617535 >> v1:172.21.15.106:6789/0 conn(0x7f66dc0c2a80 legacy=0x7f66dc0b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:37.402 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.403+0000 7f66d9e00640 1 -- 172.21.15.55:0/3131617535 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66dc069fe0 con 0x7f66dc15b180 2024-04-02T07:34:37.404 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.407+0000 7f66d9e00640 1 --2- 172.21.15.55:0/3131617535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66dc15b180 0x7f66dc15b560 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f66dc072110 tx=0x7f66cc01c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ba235429e59aec server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.407+0000 7f66d9400640 1 -- 172.21.15.55:0/3131617535 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc0aa610 con 0x7f66dc15b180 2024-04-02T07:34:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.407+0000 7f66d9400640 1 -- 172.21.15.55:0/3131617535 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66cc0a6040 con 0x7f66dc15b180 2024-04-02T07:34:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.407+0000 7f66d9400640 1 -- 172.21.15.55:0/3131617535 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc0aa990 con 0x7f66dc15b180 2024-04-02T07:34:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.407+0000 7f66db200640 1 -- 172.21.15.55:0/3131617535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66dc15b180 msgr2=0x7f66dc15b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.407+0000 7f66db200640 1 --2- 172.21.15.55:0/3131617535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66dc15b180 0x7f66dc15b560 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f66dc072110 tx=0x7f66cc01c4b0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.407+0000 7f66db200640 1 -- 172.21.15.55:0/3131617535 shutdown_connections 2024-04-02T07:34:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.407+0000 7f66db200640 1 --2- 172.21.15.55:0/3131617535 >> v2:172.21.15.106:3300/0 conn(0x7f66dc0b09a0 0x7f66dc0cb630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.405 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.407+0000 7f66db200640 1 --2- 172.21.15.55:0/3131617535 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66dc15b180 0x7f66dc15b560 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.407+0000 7f66db200640 1 -- 172.21.15.55:0/3131617535 >> 172.21.15.55:0/3131617535 conn(0x7f66dc0b0eb0 msgr2=0x7f66dc0b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.407+0000 7f66db200640 1 -- 172.21.15.55:0/3131617535 shutdown_connections 2024-04-02T07:34:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.407+0000 7f66db200640 1 -- 172.21.15.55:0/3131617535 wait complete. 2024-04-02T07:34:37.406 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.407+0000 7f66db200640 1 Processor -- start 2024-04-02T07:34:37.407 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.407+0000 7f66db200640 1 -- start start 2024-04-02T07:34:37.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66db200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66dc0b09a0 0x7f66dc14dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:37.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66db200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66dc0c2a80 0x7f66dc0c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:37.408 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66db200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66dc15b180 0x7f66dc14f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:37.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66db200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc0b2160 con 0x7f66dc0b09a0 2024-04-02T07:34:37.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66db200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc0c8ff0 con 0x7f66dc15b180 2024-04-02T07:34:37.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66db200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66dc0b1290 con 0x7f66dc0c2a80 2024-04-02T07:34:37.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66d9e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66dc0b09a0 0x7f66dc14dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:37.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66d9e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66dc0b09a0 0x7f66dc14dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33614/0 (socket says 172.21.15.55:33614) 2024-04-02T07:34:37.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66d9e00640 1 -- 172.21.15.55:0/30236789 learned_addr learned my addr 172.21.15.55:0/30236789 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:37.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66d3e00640 1 --2- 172.21.15.55:0/30236789 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66dc0c2a80 0x7f66dc0c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:37.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66da800640 1 --2- 172.21.15.55:0/30236789 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66dc15b180 0x7f66dc14f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:37.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66d9e00640 1 -- 172.21.15.55:0/30236789 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66dc0c2a80 msgr2=0x7f66dc0c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:37.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66d9e00640 1 --2- 172.21.15.55:0/30236789 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66dc0c2a80 0x7f66dc0c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66d9e00640 1 -- 172.21.15.55:0/30236789 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66dc15b180 msgr2=0x7f66dc14f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:37.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66d9e00640 1 --2- 172.21.15.55:0/30236789 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66dc15b180 0x7f66dc14f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.409 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66d9e00640 1 -- 172.21.15.55:0/30236789 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc0094d0 con 0x7f66dc0b09a0 2024-04-02T07:34:37.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66d9e00640 1 --2- 172.21.15.55:0/30236789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66dc0b09a0 0x7f66dc14dd70 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f66cc01a0e0 tx=0x7f66cc01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:37.410 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66d2000640 1 -- 172.21.15.55:0/30236789 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc0bd5f0 con 0x7f66dc0b09a0 2024-04-02T07:34:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66d2000640 1 -- 172.21.15.55:0/30236789 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66cc0bd750 con 0x7f66dc0b09a0 2024-04-02T07:34:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66d2000640 1 -- 172.21.15.55:0/30236789 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66cc0bdb00 con 0x7f66dc0b09a0 2024-04-02T07:34:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66db200640 1 -- 172.21.15.55:0/30236789 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66dc0b14e0 con 0x7f66dc0b09a0 2024-04-02T07:34:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66db200640 1 -- 172.21.15.55:0/30236789 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66dc0b1aa0 con 0x7f66dc0b09a0 2024-04-02T07:34:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66db200640 1 -- 172.21.15.55:0/30236789 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66dc073fa0 con 0x7f66dc0b09a0 2024-04-02T07:34:37.411 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.411+0000 7f66d2000640 1 -- 172.21.15.55:0/30236789 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f66cc0b33f0 con 0x7f66dc0b09a0 2024-04-02T07:34:37.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.415+0000 7f66d2000640 1 --2- 172.21.15.55:0/30236789 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f66b8066690 0x7f66b8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:37.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.415+0000 7f66d2000640 1 -- 172.21.15.55:0/30236789 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f66cc11eda0 con 0x7f66dc0b09a0 2024-04-02T07:34:37.412 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.415+0000 7f66d3e00640 1 --2- 172.21.15.55:0/30236789 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f66b8066690 0x7f66b8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:37.413 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.415+0000 7f66d3e00640 1 --2- 172.21.15.55:0/30236789 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f66b8066690 0x7f66b8068b50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0c8a60 tx=0x7f66c4007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:37.416 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.419+0000 7f66d2000640 1 -- 172.21.15.55:0/30236789 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f66cc0ec160 con 0x7f66dc0b09a0 2024-04-02T07:34:37.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.579+0000 7f66db200640 1 -- 172.21.15.55:0/30236789 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f66dc0c5210 con 0x7f66dc0b09a0 2024-04-02T07:34:37.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.579+0000 7f66d2000640 1 -- 172.21.15.55:0/30236789 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v120) v1 ==== 104+0+11 (secure 0 0 0) 0x7f66cc0c30a0 con 0x7f66dc0b09a0 2024-04-02T07:34:37.577 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:34:37.578 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.579+0000 7f66db200640 1 -- 172.21.15.55:0/30236789 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f66b8066690 msgr2=0x7f66b8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.579+0000 7f66db200640 1 --2- 172.21.15.55:0/30236789 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f66b8066690 0x7f66b8068b50 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f66dc0c8a60 tx=0x7f66c4007e40 comp rx=0 tx=0).stop 2024-04-02T07:34:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.579+0000 7f66db200640 1 -- 172.21.15.55:0/30236789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66dc0b09a0 msgr2=0x7f66dc14dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.579+0000 7f66db200640 1 --2- 172.21.15.55:0/30236789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66dc0b09a0 0x7f66dc14dd70 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f66cc01a0e0 tx=0x7f66cc01acf0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.579+0000 7f66db200640 1 -- 172.21.15.55:0/30236789 shutdown_connections 2024-04-02T07:34:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.579+0000 7f66db200640 1 --2- 172.21.15.55:0/30236789 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f66b8066690 0x7f66b8068b50 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.579+0000 7f66db200640 1 --2- 172.21.15.55:0/30236789 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f66dc15b180 0x7f66dc14f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.579+0000 7f66db200640 1 --2- 172.21.15.55:0/30236789 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f66dc0c2a80 0x7f66dc0c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.579+0000 7f66db200640 1 --2- 172.21.15.55:0/30236789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f66dc0b09a0 0x7f66dc14dd70 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.579+0000 7f66db200640 1 -- 172.21.15.55:0/30236789 >> 172.21.15.55:0/30236789 conn(0x7f66dc0b0eb0 msgr2=0x7f66dc0c40a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.579+0000 7f66db200640 1 -- 172.21.15.55:0/30236789 shutdown_connections 2024-04-02T07:34:37.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.579+0000 7f66db200640 1 -- 172.21.15.55:0/30236789 wait complete. 2024-04-02T07:34:37.599 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:34:37.743 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.743+0000 7fc11be00640 1 Processor -- start 2024-04-02T07:34:37.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.743+0000 7fc11be00640 1 -- start start 2024-04-02T07:34:37.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.747+0000 7fc11be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc11c0b07a0 0x7fc11c0afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:37.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.747+0000 7fc11be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc11c0cedb0 0x7fc11c06a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:37.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.747+0000 7fc11be00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc11c0cd130 con 0x7fc11c069d90 2024-04-02T07:34:37.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.747+0000 7fc11be00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc11c06a760 con 0x7fc11c0cedb0 2024-04-02T07:34:37.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.747+0000 7fc11be00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc11c0aebf0 con 0x7fc11c0b07a0 2024-04-02T07:34:37.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.747+0000 7fc11b400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc11c0cedb0 0x7fc11c06a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:37.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.747+0000 7fc11b400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc11c0cedb0 0x7fc11c06a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33628/0 (socket says 172.21.15.55:33628) 2024-04-02T07:34:37.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.747+0000 7fc11b400640 1 -- 172.21.15.55:0/2200266374 learned_addr learned my addr 172.21.15.55:0/2200266374 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:37.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.747+0000 7fc11aa00640 1 --2- 172.21.15.55:0/2200266374 >> v2:172.21.15.106:3300/0 conn(0x7fc11c0b07a0 0x7fc11c0afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:37.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.747+0000 7fc11b400640 1 -- 172.21.15.55:0/2200266374 >> v2:172.21.15.106:3300/0 conn(0x7fc11c0b07a0 msgr2=0x7fc11c0afc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:37.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.747+0000 7fc11b400640 1 --2- 172.21.15.55:0/2200266374 >> v2:172.21.15.106:3300/0 conn(0x7fc11c0b07a0 0x7fc11c0afc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.747+0000 7fc11b400640 1 -- 172.21.15.55:0/2200266374 >> v1:172.21.15.106:6789/0 conn(0x7fc11c069d90 legacy=0x7fc11c0ce6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:37.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.747+0000 7fc11b400640 1 -- 172.21.15.55:0/2200266374 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc11c0aeed0 con 0x7fc11c0cedb0 2024-04-02T07:34:37.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.751+0000 7fc11b400640 1 --2- 172.21.15.55:0/2200266374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0cedb0 0x7fc11c06a220 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7fc114009e50 tx=0x7fc11401c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=debc4147b7d62bc6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:37.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.751+0000 7fc11a000640 1 -- 172.21.15.55:0/2200266374 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1140a5880 con 0x7fc11c0cedb0 2024-04-02T07:34:37.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.751+0000 7fc11a000640 1 -- 172.21.15.55:0/2200266374 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1140a59e0 con 0x7fc11c0cedb0 2024-04-02T07:34:37.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.751+0000 7fc11a000640 1 -- 172.21.15.55:0/2200266374 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1140a5d70 con 0x7fc11c0cedb0 2024-04-02T07:34:37.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.751+0000 7fc11be00640 1 -- 172.21.15.55:0/2200266374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0cedb0 msgr2=0x7fc11c06a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:37.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.751+0000 7fc11be00640 1 --2- 172.21.15.55:0/2200266374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0cedb0 0x7fc11c06a220 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7fc114009e50 tx=0x7fc11401c9c0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.751+0000 7fc11be00640 1 -- 172.21.15.55:0/2200266374 shutdown_connections 2024-04-02T07:34:37.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.751+0000 7fc11be00640 1 --2- 172.21.15.55:0/2200266374 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0cedb0 0x7fc11c06a220 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.751+0000 7fc11be00640 1 --2- 172.21.15.55:0/2200266374 >> v2:172.21.15.106:3300/0 conn(0x7fc11c0b07a0 0x7fc11c0afc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.751+0000 7fc11be00640 1 -- 172.21.15.55:0/2200266374 >> 172.21.15.55:0/2200266374 conn(0x7fc11c0b0eb0 msgr2=0x7fc11c0b1290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:37.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.751+0000 7fc11be00640 1 -- 172.21.15.55:0/2200266374 shutdown_connections 2024-04-02T07:34:37.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.751+0000 7fc11be00640 1 -- 172.21.15.55:0/2200266374 wait complete. 2024-04-02T07:34:37.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.751+0000 7fc11be00640 1 Processor -- start 2024-04-02T07:34:37.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.751+0000 7fc11be00640 1 -- start start 2024-04-02T07:34:37.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.751+0000 7fc11be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc11c069d90 0x7fc11c1589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:37.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.751+0000 7fc11be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0b07a0 0x7fc11c150540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:37.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.751+0000 7fc11be00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc11c0cedb0 0x7fc11c1f8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:37.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.751+0000 7fc11be00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c158ef0 con 0x7fc11c0b07a0 2024-04-02T07:34:37.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.751+0000 7fc11be00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c15a1c0 con 0x7fc11c069d90 2024-04-02T07:34:37.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.751+0000 7fc11be00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11c159120 con 0x7fc11c0cedb0 2024-04-02T07:34:37.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.755+0000 7fc113e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0b07a0 0x7fc11c150540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:37.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.755+0000 7fc113e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0b07a0 0x7fc11c150540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33644/0 (socket says 172.21.15.55:33644) 2024-04-02T07:34:37.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.755+0000 7fc113e00640 1 -- 172.21.15.55:0/104301139 learned_addr learned my addr 172.21.15.55:0/104301139 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:37.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.755+0000 7fc11aa00640 1 --2- 172.21.15.55:0/104301139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc11c069d90 0x7fc11c1589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:37.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.755+0000 7fc11b400640 1 --2- 172.21.15.55:0/104301139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc11c0cedb0 0x7fc11c1f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:37.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.755+0000 7fc113e00640 1 -- 172.21.15.55:0/104301139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc11c0cedb0 msgr2=0x7fc11c1f8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:37.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.755+0000 7fc113e00640 1 --2- 172.21.15.55:0/104301139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc11c0cedb0 0x7fc11c1f8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.755+0000 7fc113e00640 1 -- 172.21.15.55:0/104301139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc11c069d90 msgr2=0x7fc11c1589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:37.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.755+0000 7fc113e00640 1 --2- 172.21.15.55:0/104301139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc11c069d90 0x7fc11c1589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.755+0000 7fc113e00640 1 -- 172.21.15.55:0/104301139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc114009b30 con 0x7fc11c0b07a0 2024-04-02T07:34:37.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.755+0000 7fc113e00640 1 --2- 172.21.15.55:0/104301139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0b07a0 0x7fc11c150540 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7fc10400c500 tx=0x7fc10400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:37.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.755+0000 7fc112a00640 1 -- 172.21.15.55:0/104301139 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104005220 con 0x7fc11c0b07a0 2024-04-02T07:34:37.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.755+0000 7fc112a00640 1 -- 172.21.15.55:0/104301139 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc104005380 con 0x7fc11c0b07a0 2024-04-02T07:34:37.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.755+0000 7fc112a00640 1 -- 172.21.15.55:0/104301139 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104007270 con 0x7fc11c0b07a0 2024-04-02T07:34:37.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.755+0000 7fc11be00640 1 -- 172.21.15.55:0/104301139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc11c159400 con 0x7fc11c0b07a0 2024-04-02T07:34:37.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.755+0000 7fc11be00640 1 -- 172.21.15.55:0/104301139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc11c1599c0 con 0x7fc11c0b07a0 2024-04-02T07:34:37.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.755+0000 7fc11be00640 1 -- 172.21.15.55:0/104301139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc11c073fa0 con 0x7fc11c0b07a0 2024-04-02T07:34:37.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.755+0000 7fc112a00640 1 -- 172.21.15.55:0/104301139 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc1040073d0 con 0x7fc11c0b07a0 2024-04-02T07:34:37.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.755+0000 7fc112a00640 1 --2- 172.21.15.55:0/104301139 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc0f80666c0 0x7fc0f8068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:37.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.755+0000 7fc112a00640 1 -- 172.21.15.55:0/104301139 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7fc104083ab0 con 0x7fc11c0b07a0 2024-04-02T07:34:37.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.759+0000 7fc11aa00640 1 --2- 172.21.15.55:0/104301139 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc0f80666c0 0x7fc0f8068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:37.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.759+0000 7fc11aa00640 1 --2- 172.21.15.55:0/104301139 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc0f80666c0 0x7fc0f8068b80 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc10c006aa0 tx=0x7fc10c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:37.760 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.759+0000 7fc112a00640 1 -- 172.21.15.55:0/104301139 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc104050d50 con 0x7fc11c0b07a0 2024-04-02T07:34:37.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.919+0000 7fc11be00640 1 -- 172.21.15.55:0/104301139 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc11c0b52e0 con 0x7fc11c0b07a0 2024-04-02T07:34:37.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.919+0000 7fc112a00640 1 -- 172.21.15.55:0/104301139 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v120) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc104054370 con 0x7fc11c0b07a0 2024-04-02T07:34:37.920 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:34:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.923+0000 7fc11be00640 1 -- 172.21.15.55:0/104301139 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc0f80666c0 msgr2=0x7fc0f8068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.923+0000 7fc11be00640 1 --2- 172.21.15.55:0/104301139 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc0f80666c0 0x7fc0f8068b80 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fc10c006aa0 tx=0x7fc10c008040 comp rx=0 tx=0).stop 2024-04-02T07:34:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.923+0000 7fc11be00640 1 -- 172.21.15.55:0/104301139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0b07a0 msgr2=0x7fc11c150540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.923+0000 7fc11be00640 1 --2- 172.21.15.55:0/104301139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0b07a0 0x7fc11c150540 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7fc10400c500 tx=0x7fc10400c9c0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.923+0000 7fc11be00640 1 -- 172.21.15.55:0/104301139 shutdown_connections 2024-04-02T07:34:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.923+0000 7fc11be00640 1 --2- 172.21.15.55:0/104301139 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc11c0cedb0 0x7fc11c1f8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.923+0000 7fc11be00640 1 --2- 172.21.15.55:0/104301139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc11c0b07a0 0x7fc11c150540 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.923+0000 7fc11be00640 1 --2- 172.21.15.55:0/104301139 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc0f80666c0 0x7fc0f8068b80 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.923+0000 7fc11be00640 1 --2- 172.21.15.55:0/104301139 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc11c069d90 0x7fc11c1589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.923+0000 7fc11be00640 1 -- 172.21.15.55:0/104301139 >> 172.21.15.55:0/104301139 conn(0x7fc11c0b0eb0 msgr2=0x7fc11c156890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:37.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.923+0000 7fc11be00640 1 -- 172.21.15.55:0/104301139 shutdown_connections 2024-04-02T07:34:37.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:37.923+0000 7fc11be00640 1 -- 172.21.15.55:0/104301139 wait complete. 2024-04-02T07:34:37.941 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-02T07:34:38.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.083+0000 7f1373e00640 1 Processor -- start 2024-04-02T07:34:38.082 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.083+0000 7f1373e00640 1 -- start start 2024-04-02T07:34:38.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.083+0000 7f1373e00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f136c06ccc0 0x7f136c06c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:38.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.083+0000 7f1373e00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136c15d5d0 con 0x7f136c0cb160 2024-04-02T07:34:38.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.083+0000 7f1373e00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136c15d8b0 con 0x7f136c06d0a0 2024-04-02T07:34:38.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.083+0000 7f1373e00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136c15db90 con 0x7f136c06ccc0 2024-04-02T07:34:38.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.083+0000 7f1371e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f136c0cb160 0x7f136c0705b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45540/0 (socket says 172.21.15.55:45540) 2024-04-02T07:34:38.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.083+0000 7f1371e00640 1 -- 172.21.15.55:0/350962081 learned_addr learned my addr 172.21.15.55:0/350962081 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:38.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.083+0000 7f1371400640 1 --2- 172.21.15.55:0/350962081 >> v2:172.21.15.106:3300/0 conn(0x7f136c06ccc0 0x7f136c06c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:38.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.083+0000 7f136be00640 1 -- 172.21.15.55:0/350962081 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1127733631 0 0) 0x7f136c15d5d0 con 0x7f136c0cb160 2024-04-02T07:34:38.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.083+0000 7f136be00640 1 -- 172.21.15.55:0/350962081 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1354003530 con 0x7f136c0cb160 2024-04-02T07:34:38.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f136be00640 1 -- 172.21.15.55:0/350962081 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1048853129 0 0) 0x7f1354003530 con 0x7f136c0cb160 2024-04-02T07:34:38.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f136be00640 1 -- 172.21.15.55:0/350962081 >> v2:172.21.15.106:3300/0 conn(0x7f136c06ccc0 msgr2=0x7f136c06c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:38.086 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f136be00640 1 --2- 172.21.15.55:0/350962081 >> v2:172.21.15.106:3300/0 conn(0x7f136c06ccc0 0x7f136c06c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:38.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f136be00640 1 -- 172.21.15.55:0/350962081 >> v1:172.21.15.106:6789/0 conn(0x7f136c06d0a0 legacy=0x7f136c06d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:38.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f136be00640 1 -- 172.21.15.55:0/350962081 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c15de70 con 0x7f136c0cb160 2024-04-02T07:34:38.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f136be00640 1 -- 172.21.15.55:0/350962081 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f1364001a00 con 0x7f136c0cb160 2024-04-02T07:34:38.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f136be00640 1 -- 172.21.15.55:0/350962081 >> v1:172.21.15.55:6789/0 conn(0x7f136c0cb160 legacy=0x7f136c0705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:38.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f136be00640 1 --2- 172.21.15.55:0/350962081 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13540039d0 0x7f1354003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:38.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f136be00640 1 --2- 172.21.15.55:0/350962081 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13540047d0 0x7f1354004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:38.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f136be00640 1 --2- 172.21.15.55:0/350962081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1354005190 0x7f135400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:38.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f136be00640 1 -- 172.21.15.55:0/350962081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c15db90 con 0x7f1354005190 2024-04-02T07:34:38.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f136be00640 1 -- 172.21.15.55:0/350962081 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f135400c090 con 0x7f13540039d0 2024-04-02T07:34:38.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f136be00640 1 -- 172.21.15.55:0/350962081 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f135400c250 con 0x7f13540047d0 2024-04-02T07:34:38.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f1371e00640 1 --2- 172.21.15.55:0/350962081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1354005190 0x7f135400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:38.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f1371400640 1 --2- 172.21.15.55:0/350962081 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13540039d0 0x7f1354003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:38.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f1370a00640 1 --2- 172.21.15.55:0/350962081 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13540047d0 0x7f1354004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:38.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f1371e00640 1 -- 172.21.15.55:0/350962081 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13540047d0 msgr2=0x7f1354004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:38.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f1371e00640 1 --2- 172.21.15.55:0/350962081 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f13540047d0 0x7f1354004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:38.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f1371e00640 1 -- 172.21.15.55:0/350962081 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13540039d0 msgr2=0x7f1354003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:38.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f1371e00640 1 --2- 172.21.15.55:0/350962081 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f13540039d0 0x7f1354003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:38.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f1371e00640 1 -- 172.21.15.55:0/350962081 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1354003530 con 0x7f1354005190 2024-04-02T07:34:38.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f1371e00640 1 -- 172.21.15.55:0/350962081 reap_dead start 2024-04-02T07:34:38.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.087+0000 7f1371e00640 1 --2- 172.21.15.55:0/350962081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1354005190 0x7f135400b990 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f136400a760 tx=0x7f136401d280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd421490c5a3985c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:38.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f136be00640 1 -- 172.21.15.55:0/350962081 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13640ad630 con 0x7f1354005190 2024-04-02T07:34:38.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f136be00640 1 -- 172.21.15.55:0/350962081 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13640a8070 con 0x7f1354005190 2024-04-02T07:34:38.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f136be00640 1 -- 172.21.15.55:0/350962081 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13640ada10 con 0x7f1354005190 2024-04-02T07:34:38.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f1373e00640 1 -- 172.21.15.55:0/350962081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1354005190 msgr2=0x7f135400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:38.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f1373e00640 1 --2- 172.21.15.55:0/350962081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1354005190 0x7f135400b990 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f136400a760 tx=0x7f136401d280 comp rx=0 tx=0).stop 2024-04-02T07:34:38.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f1373e00640 1 -- 172.21.15.55:0/350962081 shutdown_connections 2024-04-02T07:34:38.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f1373e00640 1 --2- 172.21.15.55:0/350962081 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1354005190 0x7f135400b990 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:38.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f1373e00640 1 -- 172.21.15.55:0/350962081 >> 172.21.15.55:0/350962081 conn(0x7f136c069d90 msgr2=0x7f136c06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:38.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f1373e00640 1 -- 172.21.15.55:0/350962081 shutdown_connections 2024-04-02T07:34:38.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f1373e00640 1 -- 172.21.15.55:0/350962081 wait complete. 2024-04-02T07:34:38.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f1373e00640 1 Processor -- start 2024-04-02T07:34:38.092 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f1373e00640 1 -- start start 2024-04-02T07:34:38.096 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f1373e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1354005190 0x7f136c157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:38.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f1373e00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f136c1f2730 0x7f136c1f2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:38.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f1373e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f136c1f30d0 0x7f136c159010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:38.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f1373e00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c1559b0 con 0x7f136c1f30d0 2024-04-02T07:34:38.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f1373e00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136c156cb0 con 0x7f136c1f2730 2024-04-02T07:34:38.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f1373e00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f136c1f3580 con 0x7f1354005190 2024-04-02T07:34:38.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f1371e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f136c1f30d0 0x7f136c159010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:38.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f1371e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f136c1f30d0 0x7f136c159010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33674/0 (socket says 172.21.15.55:33674) 2024-04-02T07:34:38.097 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f1371e00640 1 -- 172.21.15.55:0/1580958414 learned_addr learned my addr 172.21.15.55:0/1580958414 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:38.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f1371400640 1 --2- 172.21.15.55:0/1580958414 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1354005190 0x7f136c157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:38.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.091+0000 7f1370a00640 1 --2- 172.21.15.55:0/1580958414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f136c1f2730 0x7f136c1f2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:38.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.095+0000 7f1371e00640 1 -- 172.21.15.55:0/1580958414 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1354005190 msgr2=0x7f136c157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:38.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.095+0000 7f1371e00640 1 --2- 172.21.15.55:0/1580958414 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1354005190 0x7f136c157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:38.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.095+0000 7f1371e00640 1 -- 172.21.15.55:0/1580958414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f136c1f2730 msgr2=0x7f136c1f2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:38.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.095+0000 7f1371e00640 1 --2- 172.21.15.55:0/1580958414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f136c1f2730 0x7f136c1f2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:38.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.095+0000 7f1371e00640 1 -- 172.21.15.55:0/1580958414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c15d440 con 0x7f136c1f30d0 2024-04-02T07:34:38.098 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.095+0000 7f1371e00640 1 --2- 172.21.15.55:0/1580958414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f136c1f30d0 0x7f136c159010 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f136401db20 tx=0x7f1354005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:38.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.095+0000 7f1369600640 1 -- 172.21.15.55:0/1580958414 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1364001940 con 0x7f136c1f30d0 2024-04-02T07:34:38.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.095+0000 7f1369600640 1 -- 172.21.15.55:0/1580958414 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13640ad6c0 con 0x7f136c1f30d0 2024-04-02T07:34:38.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.095+0000 7f1369600640 1 -- 172.21.15.55:0/1580958414 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13640ada50 con 0x7f136c1f30d0 2024-04-02T07:34:38.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.095+0000 7f1373e00640 1 -- 172.21.15.55:0/1580958414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136c15efe0 con 0x7f136c1f30d0 2024-04-02T07:34:38.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.095+0000 7f1373e00640 1 -- 172.21.15.55:0/1580958414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f136c1569d0 con 0x7f136c1f30d0 2024-04-02T07:34:38.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.095+0000 7f1373e00640 1 -- 172.21.15.55:0/1580958414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f136c066c90 con 0x7f136c1f30d0 2024-04-02T07:34:38.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.095+0000 7f1369600640 1 -- 172.21.15.55:0/1580958414 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f13640aa030 con 0x7f136c1f30d0 2024-04-02T07:34:38.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.095+0000 7f1369600640 1 --2- 172.21.15.55:0/1580958414 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f134c066690 0x7f134c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:38.099 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.095+0000 7f1369600640 1 -- 172.21.15.55:0/1580958414 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f136411e0a0 con 0x7f136c1f30d0 2024-04-02T07:34:38.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.095+0000 7f1371400640 1 --2- 172.21.15.55:0/1580958414 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f134c066690 0x7f134c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:38.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.099+0000 7f1371400640 1 --2- 172.21.15.55:0/1580958414 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f134c066690 0x7f134c068b50 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f1360009ac0 tx=0x7f1360009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:38.100 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.099+0000 7f1369600640 1 -- 172.21.15.55:0/1580958414 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f13640eb480 con 0x7f136c1f30d0 2024-04-02T07:34:38.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.271+0000 7f1373e00640 1 -- 172.21.15.55:0/1580958414 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f136c1559b0 con 0x7f136c1f30d0 2024-04-02T07:34:38.271 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.271+0000 7f1369600640 1 -- 172.21.15.55:0/1580958414 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 4 entries v120) v1 ==== 80+0+242 (secure 0 0 0) 0x7f13640eeaa0 con 0x7f136c1f30d0 2024-04-02T07:34:38.272 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6835/154663344 2024-04-03T07:34:25.539082+0000 2024-04-02T07:34:38.272 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.55:6832/154663344 2024-04-03T07:34:25.539082+0000 2024-04-02T07:34:38.272 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.106:6837/775582321 2024-04-03T07:34:04.807966+0000 2024-04-02T07:34:38.272 INFO:teuthology.orchestra.run.smithi055.stdout:172.21.15.106:6834/775582321 2024-04-03T07:34:04.807966+0000 2024-04-02T07:34:38.272 INFO:teuthology.orchestra.run.smithi055.stderr:listed 4 entries 2024-04-02T07:34:38.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.275+0000 7f1373e00640 1 -- 172.21.15.55:0/1580958414 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f134c066690 msgr2=0x7f134c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:38.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.275+0000 7f1373e00640 1 --2- 172.21.15.55:0/1580958414 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f134c066690 0x7f134c068b50 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f1360009ac0 tx=0x7f1360009190 comp rx=0 tx=0).stop 2024-04-02T07:34:38.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.275+0000 7f1373e00640 1 -- 172.21.15.55:0/1580958414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f136c1f30d0 msgr2=0x7f136c159010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:38.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.275+0000 7f1373e00640 1 --2- 172.21.15.55:0/1580958414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f136c1f30d0 0x7f136c159010 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f136401db20 tx=0x7f1354005800 comp rx=0 tx=0).stop 2024-04-02T07:34:38.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.275+0000 7f1373e00640 1 -- 172.21.15.55:0/1580958414 shutdown_connections 2024-04-02T07:34:38.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.275+0000 7f1373e00640 1 --2- 172.21.15.55:0/1580958414 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f136c1f30d0 0x7f136c159010 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:38.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.275+0000 7f1373e00640 1 --2- 172.21.15.55:0/1580958414 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f134c066690 0x7f134c068b50 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:38.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.275+0000 7f1373e00640 1 --2- 172.21.15.55:0/1580958414 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f136c1f2730 0x7f136c1f2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:38.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.275+0000 7f1373e00640 1 --2- 172.21.15.55:0/1580958414 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1354005190 0x7f136c157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:38.274 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.275+0000 7f1373e00640 1 -- 172.21.15.55:0/1580958414 >> 172.21.15.55:0/1580958414 conn(0x7f136c069d90 msgr2=0x7f136c0ca420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:38.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.275+0000 7f1373e00640 1 -- 172.21.15.55:0/1580958414 shutdown_connections 2024-04-02T07:34:38.275 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.275+0000 7f1373e00640 1 -- 172.21.15.55:0/1580958414 wait complete. 2024-04-02T07:34:38.293 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi055.front.sepia.ceph.com... 2024-04-02T07:34:38.293 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:38.294 DEBUG:teuthology.orchestra.run.smithi055:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-02T07:34:38.311 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi055.stderr:ceph-fuse[54156]: fuse finished with error 0 and tester_r 0 2024-04-02T07:34:38.315 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:34:38.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:38.315 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-02T07:34:38.467 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:34:38.468 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:34:38.479 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:34:38.479 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:34:38.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:38.479 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-02T07:34:38.530 INFO:teuthology.orchestra.run.smithi106.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2024-04-02T07:34:38.531 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:34:38.531 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:34:38.531 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:34:38.543 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:34:38.543 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:34:38.543 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:38.543 DEBUG:teuthology.orchestra.run.smithi055:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-04-02T07:34:38.591 INFO:teuthology.orchestra.run.smithi055.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2024-04-02T07:34:38.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:34:38.592 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:34:38.592 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:34:38.601 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:34:38.601 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:34:38.601 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:38.602 DEBUG:teuthology.orchestra.run.smithi106:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-04-02T07:34:38.650 INFO:teuthology.orchestra.run.smithi106.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2024-04-02T07:34:38.651 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:34:38.651 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:34:38.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.795+0000 7f5214200640 1 Processor -- start 2024-04-02T07:34:38.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.795+0000 7f5214200640 1 -- start start 2024-04-02T07:34:38.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.795+0000 7f5214200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f520c099120 0x7f520c099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:38.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.795+0000 7f5214200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f520c15f250 0x7f520c0b12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:38.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.795+0000 7f5214200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520c0ad270 con 0x7f520c15ee70 2024-04-02T07:34:38.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.795+0000 7f5214200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c0b0840 con 0x7f520c15f250 2024-04-02T07:34:38.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.795+0000 7f5214200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0cf6a0 con 0x7f520c099120 2024-04-02T07:34:38.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.795+0000 7f5212200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f520c15f250 0x7f520c0b12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:38.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.795+0000 7f5210e00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f520c099120 0x7f520c099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:38.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.795+0000 7f5212200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f520c15f250 0x7f520c0b12f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:33330/0 (socket says 172.21.15.55:33330) 2024-04-02T07:34:38.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.795+0000 7f5212200640 1 -- 172.21.15.55:0/2312884579 learned_addr learned my addr 172.21.15.55:0/2312884579 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:38.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.795+0000 7f5210e00640 1 -- 172.21.15.55:0/2312884579 >> v2:172.21.15.106:3300/0 conn(0x7f520c15f250 msgr2=0x7f520c0b12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:38.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.795+0000 7f5210e00640 1 --2- 172.21.15.55:0/2312884579 >> v2:172.21.15.106:3300/0 conn(0x7f520c15f250 0x7f520c0b12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:38.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.795+0000 7f5210e00640 1 -- 172.21.15.55:0/2312884579 >> v1:172.21.15.106:6789/0 conn(0x7f520c15ee70 legacy=0x7f520c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:38.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.795+0000 7f5210e00640 1 -- 172.21.15.55:0/2312884579 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c0b0a50 con 0x7f520c099120 2024-04-02T07:34:38.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.799+0000 7f5210e00640 1 --2- 172.21.15.55:0/2312884579 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f520c099120 0x7f520c099830 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f51f80097c0 tx=0x7f51f801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3041abd88dec2ae1 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:38.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.799+0000 7f520be00640 1 -- 172.21.15.55:0/2312884579 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f80a6040 con 0x7f520c099120 2024-04-02T07:34:38.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.799+0000 7f520be00640 1 -- 172.21.15.55:0/2312884579 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f80aa600 con 0x7f520c099120 2024-04-02T07:34:38.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.799+0000 7f520be00640 1 -- 172.21.15.55:0/2312884579 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f80aa990 con 0x7f520c099120 2024-04-02T07:34:38.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.799+0000 7f5214200640 1 -- 172.21.15.55:0/2312884579 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f520c099120 msgr2=0x7f520c099830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:38.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.799+0000 7f5214200640 1 --2- 172.21.15.55:0/2312884579 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f520c099120 0x7f520c099830 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f51f80097c0 tx=0x7f51f801c4a0 comp rx=0 tx=0).stop 2024-04-02T07:34:38.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.799+0000 7f5214200640 1 -- 172.21.15.55:0/2312884579 shutdown_connections 2024-04-02T07:34:38.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.799+0000 7f5214200640 1 --2- 172.21.15.55:0/2312884579 >> v2:172.21.15.106:3300/0 conn(0x7f520c15f250 0x7f520c0b12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:38.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.799+0000 7f5214200640 1 --2- 172.21.15.55:0/2312884579 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f520c099120 0x7f520c099830 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:38.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.799+0000 7f5214200640 1 -- 172.21.15.55:0/2312884579 >> 172.21.15.55:0/2312884579 conn(0x7f520c0b21d0 msgr2=0x7f520c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:38.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.799+0000 7f5214200640 1 -- 172.21.15.55:0/2312884579 shutdown_connections 2024-04-02T07:34:38.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.799+0000 7f5214200640 1 -- 172.21.15.55:0/2312884579 wait complete. 2024-04-02T07:34:38.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5214200640 1 Processor -- start 2024-04-02T07:34:38.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5214200640 1 -- start start 2024-04-02T07:34:38.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5214200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f520c099120 0x7f520c154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:38.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5214200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f520c15ee70 0x7f520c0c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:38.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5214200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f520c15f250 0x7f520c159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:38.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5214200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c06cf50 con 0x7f520c15ee70 2024-04-02T07:34:38.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5214200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0c46d0 con 0x7f520c099120 2024-04-02T07:34:38.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5214200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c06c9b0 con 0x7f520c15f250 2024-04-02T07:34:38.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5210e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f520c15ee70 0x7f520c0c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:38.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5210e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f520c15ee70 0x7f520c0c69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33682/0 (socket says 172.21.15.55:33682) 2024-04-02T07:34:38.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5210e00640 1 -- 172.21.15.55:0/3469323182 learned_addr learned my addr 172.21.15.55:0/3469323182 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:38.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5211800640 1 --2- 172.21.15.55:0/3469323182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f520c099120 0x7f520c154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:38.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5212200640 1 --2- 172.21.15.55:0/3469323182 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f520c15f250 0x7f520c159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:38.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5210e00640 1 -- 172.21.15.55:0/3469323182 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f520c15f250 msgr2=0x7f520c159f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:38.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5210e00640 1 --2- 172.21.15.55:0/3469323182 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f520c15f250 0x7f520c159f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:38.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5210e00640 1 -- 172.21.15.55:0/3469323182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f520c099120 msgr2=0x7f520c154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:38.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5210e00640 1 --2- 172.21.15.55:0/3469323182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f520c099120 0x7f520c154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:38.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5210e00640 1 -- 172.21.15.55:0/3469323182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f8009420 con 0x7f520c15ee70 2024-04-02T07:34:38.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5210e00640 1 --2- 172.21.15.55:0/3469323182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f520c15ee70 0x7f520c0c69f0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f51f801a0d0 tx=0x7f51f801ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:38.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5209600640 1 -- 172.21.15.55:0/3469323182 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f80b3600 con 0x7f520c15ee70 2024-04-02T07:34:38.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5209600640 1 -- 172.21.15.55:0/3469323182 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f80b3760 con 0x7f520c15ee70 2024-04-02T07:34:38.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5214200640 1 -- 172.21.15.55:0/3469323182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c06cc70 con 0x7f520c15ee70 2024-04-02T07:34:38.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5209600640 1 -- 172.21.15.55:0/3469323182 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f80b3af0 con 0x7f520c15ee70 2024-04-02T07:34:38.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5214200640 1 -- 172.21.15.55:0/3469323182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c0c6f30 con 0x7f520c15ee70 2024-04-02T07:34:38.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.803+0000 7f5214200640 1 -- 172.21.15.55:0/3469323182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520c0c4880 con 0x7f520c15ee70 2024-04-02T07:34:38.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.807+0000 7f5209600640 1 -- 172.21.15.55:0/3469323182 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f51f80b3c50 con 0x7f520c15ee70 2024-04-02T07:34:38.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.807+0000 7f5209600640 1 --2- 172.21.15.55:0/3469323182 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51ec0666c0 0x7f51ec068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:38.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.807+0000 7f5209600640 1 -- 172.21.15.55:0/3469323182 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f51f811e0a0 con 0x7f520c15ee70 2024-04-02T07:34:38.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.807+0000 7f5211800640 1 --2- 172.21.15.55:0/3469323182 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51ec0666c0 0x7f51ec068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:38.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.807+0000 7f5211800640 1 --2- 172.21.15.55:0/3469323182 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51ec0666c0 0x7f51ec068b80 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5200007fd0 tx=0x7f5200009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:38.809 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:38.811+0000 7f5209600640 1 -- 172.21.15.55:0/3469323182 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f520c0c4880 con 0x7f520c15ee70 2024-04-02T07:34:39.001 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.003+0000 7f5214200640 1 -- 172.21.15.55:0/3469323182 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f520c0c4840 con 0x7f520c15ee70 2024-04-02T07:34:39.002 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.003+0000 7f5209600640 1 -- 172.21.15.55:0/3469323182 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4747 (secure 0 0 0) 0x7f51f80eb3c0 con 0x7f520c15ee70 2024-04-02T07:34:39.002 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:39.002 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":109,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7592,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2292883244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2292883244},{"type":"v1","addr":"172.21.15.106:6836","nonce":2292883244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":7835,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3165795379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3165795379},{"type":"v1","addr":"172.21.15.106:6837","nonce":3165795379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":9147,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2700619140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2700619140},{"type":"v1","addr":"172.21.15.55:6834","nonce":2700619140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:33:27.846433+0000","modified":"2024-04-02T07:34:30.606280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9717":{"gid":9717,"name":"a","rank":0,"incarnation":106,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6835/1279080129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1279080129},{"type":"v1","addr":"172.21.15.55:6835","nonce":1279080129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-02T07:34:39.002 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 109 2024-04-02T07:34:39.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.003+0000 7f5214200640 1 -- 172.21.15.55:0/3469323182 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51ec0666c0 msgr2=0x7f51ec068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:39.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.003+0000 7f5214200640 1 --2- 172.21.15.55:0/3469323182 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51ec0666c0 0x7f51ec068b80 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f5200007fd0 tx=0x7f5200009040 comp rx=0 tx=0).stop 2024-04-02T07:34:39.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.003+0000 7f5214200640 1 -- 172.21.15.55:0/3469323182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f520c15ee70 msgr2=0x7f520c0c69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:39.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.003+0000 7f5214200640 1 --2- 172.21.15.55:0/3469323182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f520c15ee70 0x7f520c0c69f0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f51f801a0d0 tx=0x7f51f801ace0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.003+0000 7f5214200640 1 -- 172.21.15.55:0/3469323182 shutdown_connections 2024-04-02T07:34:39.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.003+0000 7f5214200640 1 --2- 172.21.15.55:0/3469323182 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f520c15f250 0x7f520c159f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.003+0000 7f5214200640 1 --2- 172.21.15.55:0/3469323182 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f520c15ee70 0x7f520c0c69f0 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.003+0000 7f5214200640 1 --2- 172.21.15.55:0/3469323182 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f51ec0666c0 0x7f51ec068b80 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.003+0000 7f5214200640 1 --2- 172.21.15.55:0/3469323182 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f520c099120 0x7f520c154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.004 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.003+0000 7f5214200640 1 -- 172.21.15.55:0/3469323182 >> 172.21.15.55:0/3469323182 conn(0x7f520c0b21d0 msgr2=0x7f520c06e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:39.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.003+0000 7f5214200640 1 -- 172.21.15.55:0/3469323182 shutdown_connections 2024-04-02T07:34:39.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.007+0000 7f5214200640 1 -- 172.21.15.55:0/3469323182 wait complete. 2024-04-02T07:34:39.023 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:34:39.163 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.163+0000 7f0a3fe00640 1 Processor -- start 2024-04-02T07:34:39.164 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.163+0000 7f0a3fe00640 1 -- start start 2024-04-02T07:34:39.165 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.167+0000 7f0a3fe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a380c4120 0x7f0a380b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:39.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.167+0000 7f0a3fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0a380b36f0 0x7f0a3813d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:39.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.167+0000 7f0a3fe00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a3813d0c0 con 0x7f0a38153ea0 2024-04-02T07:34:39.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.167+0000 7f0a3fe00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a380c4580 con 0x7f0a380b36f0 2024-04-02T07:34:39.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.167+0000 7f0a3fe00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a3815a2f0 con 0x7f0a380c4120 2024-04-02T07:34:39.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.167+0000 7f0a3de00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0a380b36f0 0x7f0a3813d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:39.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.167+0000 7f0a3de00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f0a380b36f0 0x7f0a3813d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33692/0 (socket says 172.21.15.55:33692) 2024-04-02T07:34:39.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.167+0000 7f0a3de00640 1 -- 172.21.15.55:0/3200057550 learned_addr learned my addr 172.21.15.55:0/3200057550 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:39.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.167+0000 7f0a3ca00640 1 --2- 172.21.15.55:0/3200057550 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a380c4120 0x7f0a380b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:39.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.167+0000 7f0a3de00640 1 -- 172.21.15.55:0/3200057550 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a380c4120 msgr2=0x7f0a380b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:39.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.167+0000 7f0a3de00640 1 --2- 172.21.15.55:0/3200057550 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a380c4120 0x7f0a380b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.167+0000 7f0a3de00640 1 -- 172.21.15.55:0/3200057550 >> v1:172.21.15.106:6789/0 conn(0x7f0a38153ea0 legacy=0x7f0a38159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:39.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.167+0000 7f0a3de00640 1 -- 172.21.15.55:0/3200057550 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3815a4f0 con 0x7f0a380b36f0 2024-04-02T07:34:39.166 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.167+0000 7f0a3ca00640 1 --2- 172.21.15.55:0/3200057550 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a380c4120 0x7f0a380b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:39.168 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.171+0000 7f0a3de00640 1 --2- 172.21.15.55:0/3200057550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a380b36f0 0x7f0a3813d550 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009e50 tx=0x7f0a3001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdec614b5c2198ec server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:39.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.171+0000 7f0a37e00640 1 -- 172.21.15.55:0/3200057550 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a300a5780 con 0x7f0a380b36f0 2024-04-02T07:34:39.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.171+0000 7f0a37e00640 1 -- 172.21.15.55:0/3200057550 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a300a58e0 con 0x7f0a380b36f0 2024-04-02T07:34:39.169 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.171+0000 7f0a37e00640 1 -- 172.21.15.55:0/3200057550 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a300a5c70 con 0x7f0a380b36f0 2024-04-02T07:34:39.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.171+0000 7f0a3fe00640 1 -- 172.21.15.55:0/3200057550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a380b36f0 msgr2=0x7f0a3813d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:39.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.171+0000 7f0a3fe00640 1 --2- 172.21.15.55:0/3200057550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a380b36f0 0x7f0a3813d550 secure :-1 s=READY pgs=1902 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009e50 tx=0x7f0a3001c9f0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.171+0000 7f0a3fe00640 1 -- 172.21.15.55:0/3200057550 shutdown_connections 2024-04-02T07:34:39.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.171+0000 7f0a3fe00640 1 --2- 172.21.15.55:0/3200057550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a380b36f0 0x7f0a3813d550 unknown :-1 s=CLOSED pgs=1902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.171+0000 7f0a3fe00640 1 --2- 172.21.15.55:0/3200057550 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a380c4120 0x7f0a380b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.171+0000 7f0a3fe00640 1 -- 172.21.15.55:0/3200057550 >> 172.21.15.55:0/3200057550 conn(0x7f0a38066080 msgr2=0x7f0a38069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:39.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.171+0000 7f0a3fe00640 1 -- 172.21.15.55:0/3200057550 shutdown_connections 2024-04-02T07:34:39.170 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.171+0000 7f0a3fe00640 1 -- 172.21.15.55:0/3200057550 wait complete. 2024-04-02T07:34:39.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.171+0000 7f0a3fe00640 1 Processor -- start 2024-04-02T07:34:39.171 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.171+0000 7f0a3fe00640 1 -- start start 2024-04-02T07:34:39.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a380b36f0 0x7f0a381386d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:39.173 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3fe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a380c4120 0x7f0a380ccc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:39.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a38153ea0 0x7f0a380cd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:39.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3fe00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a381566b0 con 0x7f0a380b36f0 2024-04-02T07:34:39.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3fe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a38156990 con 0x7f0a38153ea0 2024-04-02T07:34:39.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3fe00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a38156c70 con 0x7f0a380c4120 2024-04-02T07:34:39.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a380b36f0 0x7f0a381386d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:39.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a380b36f0 0x7f0a381386d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33702/0 (socket says 172.21.15.55:33702) 2024-04-02T07:34:39.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3d400640 1 -- 172.21.15.55:0/1034971191 learned_addr learned my addr 172.21.15.55:0/1034971191 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:39.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3ca00640 1 --2- 172.21.15.55:0/1034971191 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a380c4120 0x7f0a380ccc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:39.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3de00640 1 --2- 172.21.15.55:0/1034971191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a38153ea0 0x7f0a380cd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:39.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3d400640 1 -- 172.21.15.55:0/1034971191 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a380c4120 msgr2=0x7f0a380ccc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:39.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3d400640 1 --2- 172.21.15.55:0/1034971191 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a380c4120 0x7f0a380ccc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.174 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3d400640 1 -- 172.21.15.55:0/1034971191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a38153ea0 msgr2=0x7f0a380cd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:39.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3d400640 1 --2- 172.21.15.55:0/1034971191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a38153ea0 0x7f0a380cd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3d400640 1 -- 172.21.15.55:0/1034971191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a30009b30 con 0x7f0a380b36f0 2024-04-02T07:34:39.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3de00640 1 --2- 172.21.15.55:0/1034971191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a38153ea0 0x7f0a380cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:39.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3ca00640 1 --2- 172.21.15.55:0/1034971191 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a380c4120 0x7f0a380ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:39.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3d400640 1 --2- 172.21.15.55:0/1034971191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a380b36f0 0x7f0a381386d0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00b410 tx=0x7f0a2c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:39.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a35600640 1 -- 172.21.15.55:0/1034971191 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c004020 con 0x7f0a380b36f0 2024-04-02T07:34:39.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a35600640 1 -- 172.21.15.55:0/1034971191 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a2c004180 con 0x7f0a380b36f0 2024-04-02T07:34:39.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a35600640 1 -- 172.21.15.55:0/1034971191 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a2c011630 con 0x7f0a380b36f0 2024-04-02T07:34:39.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3fe00640 1 -- 172.21.15.55:0/1034971191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a38156f50 con 0x7f0a380b36f0 2024-04-02T07:34:39.175 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3fe00640 1 -- 172.21.15.55:0/1034971191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a381f5040 con 0x7f0a380b36f0 2024-04-02T07:34:39.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a3fe00640 1 -- 172.21.15.55:0/1034971191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a38066c90 con 0x7f0a380b36f0 2024-04-02T07:34:39.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.175+0000 7f0a35600640 1 -- 172.21.15.55:0/1034971191 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f0a2c011790 con 0x7f0a380b36f0 2024-04-02T07:34:39.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.179+0000 7f0a35600640 1 --2- 172.21.15.55:0/1034971191 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0a18066690 0x7f0a18068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:39.176 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.179+0000 7f0a35600640 1 -- 172.21.15.55:0/1034971191 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f0a2c084130 con 0x7f0a380b36f0 2024-04-02T07:34:39.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.179+0000 7f0a3ca00640 1 --2- 172.21.15.55:0/1034971191 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0a18066690 0x7f0a18068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:39.177 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.179+0000 7f0a3ca00640 1 --2- 172.21.15.55:0/1034971191 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0a18066690 0x7f0a18068b50 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f0a3813c6b0 tx=0x7f0a24008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:39.180 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.183+0000 7f0a35600640 1 -- 172.21.15.55:0/1034971191 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f0a2c051280 con 0x7f0a380b36f0 2024-04-02T07:34:39.343 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.343+0000 7f0a3fe00640 1 -- 172.21.15.55:0/1034971191 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0a380b2f50 con 0x7f0a380b36f0 2024-04-02T07:34:39.344 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.347+0000 7f0a35600640 1 -- 172.21.15.55:0/1034971191 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+16409 (secure 0 0 0) 0x7f0a2c0548a0 con 0x7f0a380b36f0 2024-04-02T07:34:39.345 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:39.345 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":120,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:34:25.539106+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:33:26.384276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-02T07:33:26.835969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.7","mappings":[{"from":0,"to":5}]},{"pgid":"17.21","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6835/154663344":"2024-04-03T07:34:25.539082+0000","172.21.15.55:6832/154663344":"2024-04-03T07:34:25.539082+0000","172.21.15.106:6837/775582321":"2024-04-03T07:34:04.807966+0000","172.21.15.106:6834/775582321":"2024-04-03T07:34:04.807966+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:34:39.346 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.347+0000 7f0a3fe00640 1 -- 172.21.15.55:0/1034971191 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0a18066690 msgr2=0x7f0a18068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.347+0000 7f0a3fe00640 1 --2- 172.21.15.55:0/1034971191 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0a18066690 0x7f0a18068b50 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f0a3813c6b0 tx=0x7f0a24008040 comp rx=0 tx=0).stop 2024-04-02T07:34:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.347+0000 7f0a3fe00640 1 -- 172.21.15.55:0/1034971191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a380b36f0 msgr2=0x7f0a381386d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.347+0000 7f0a3fe00640 1 --2- 172.21.15.55:0/1034971191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a380b36f0 0x7f0a381386d0 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f0a2c00b410 tx=0x7f0a2c00b8d0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.347+0000 7f0a3fe00640 1 -- 172.21.15.55:0/1034971191 shutdown_connections 2024-04-02T07:34:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.347+0000 7f0a3fe00640 1 --2- 172.21.15.55:0/1034971191 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0a18066690 0x7f0a18068b50 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.347+0000 7f0a3fe00640 1 --2- 172.21.15.55:0/1034971191 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f0a38153ea0 0x7f0a380cd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.347+0000 7f0a3fe00640 1 --2- 172.21.15.55:0/1034971191 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f0a380c4120 0x7f0a380ccc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.347+0000 7f0a3fe00640 1 --2- 172.21.15.55:0/1034971191 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0a380b36f0 0x7f0a381386d0 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.347+0000 7f0a3fe00640 1 -- 172.21.15.55:0/1034971191 >> 172.21.15.55:0/1034971191 conn(0x7f0a38066080 msgr2=0x7f0a3815bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.347+0000 7f0a3fe00640 1 -- 172.21.15.55:0/1034971191 shutdown_connections 2024-04-02T07:34:39.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.347+0000 7f0a3fe00640 1 -- 172.21.15.55:0/1034971191 wait complete. 2024-04-02T07:34:39.366 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-02T07:22:06.397650+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-02T07:33:26.384276+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '115', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2024-04-02T07:33:26.835969+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '116', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-02T07:34:39.367 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-02T07:34:39.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.511+0000 7fee05600640 1 Processor -- start 2024-04-02T07:34:39.511 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.511+0000 7fee05600640 1 -- start start 2024-04-02T07:34:39.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.515+0000 7fee05600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee00144260 0x7fee000702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:39.512 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.515+0000 7fee05600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fee000707e0 0x7fee000b2a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:39.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.515+0000 7fee05600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee0015e3a0 con 0x7fee000b2fd0 2024-04-02T07:34:39.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.515+0000 7fee05600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee000b37c0 con 0x7fee000707e0 2024-04-02T07:34:39.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.515+0000 7fee05600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee00070c60 con 0x7fee00144260 2024-04-02T07:34:39.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.515+0000 7fedfea00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee00144260 0x7fee000702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:39.513 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.515+0000 7fedf6000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fee000707e0 0x7fee000b2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:39.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.515+0000 7fedfea00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee00144260 0x7fee000702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:47866/0 (socket says 172.21.15.55:47866) 2024-04-02T07:34:39.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.515+0000 7fedfea00640 1 -- 172.21.15.55:0/720404779 learned_addr learned my addr 172.21.15.55:0/720404779 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:39.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.515+0000 7fedfea00640 1 -- 172.21.15.55:0/720404779 >> v2:172.21.15.106:3300/0 conn(0x7fee000707e0 msgr2=0x7fee000b2a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:39.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.515+0000 7fedfea00640 1 --2- 172.21.15.55:0/720404779 >> v2:172.21.15.106:3300/0 conn(0x7fee000707e0 0x7fee000b2a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.515+0000 7fedfea00640 1 -- 172.21.15.55:0/720404779 >> v1:172.21.15.106:6789/0 conn(0x7fee000b2fd0 legacy=0x7fee000cc4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:39.514 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.515+0000 7fedfea00640 1 -- 172.21.15.55:0/720404779 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee0015e5f0 con 0x7fee00144260 2024-04-02T07:34:39.516 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.519+0000 7fedfea00640 1 --2- 172.21.15.55:0/720404779 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee00144260 0x7fee000702a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fedf0009870 tx=0x7fedf001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1adf329cfb6b5599 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:39.517 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.519+0000 7fedfe000640 1 -- 172.21.15.55:0/720404779 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00ab600 con 0x7fee00144260 2024-04-02T07:34:39.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.519+0000 7fedfe000640 1 -- 172.21.15.55:0/720404779 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf00a7050 con 0x7fee00144260 2024-04-02T07:34:39.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.519+0000 7fedfe000640 1 -- 172.21.15.55:0/720404779 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00ab980 con 0x7fee00144260 2024-04-02T07:34:39.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.519+0000 7fee05600640 1 -- 172.21.15.55:0/720404779 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee00144260 msgr2=0x7fee000702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:39.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.519+0000 7fee05600640 1 --2- 172.21.15.55:0/720404779 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee00144260 0x7fee000702a0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fedf0009870 tx=0x7fedf001c560 comp rx=0 tx=0).stop 2024-04-02T07:34:39.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.519+0000 7fee05600640 1 -- 172.21.15.55:0/720404779 shutdown_connections 2024-04-02T07:34:39.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.519+0000 7fee05600640 1 --2- 172.21.15.55:0/720404779 >> v2:172.21.15.106:3300/0 conn(0x7fee000707e0 0x7fee000b2a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.519+0000 7fee05600640 1 --2- 172.21.15.55:0/720404779 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee00144260 0x7fee000702a0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.519+0000 7fee05600640 1 -- 172.21.15.55:0/720404779 >> 172.21.15.55:0/720404779 conn(0x7fee0006a390 msgr2=0x7fee000b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:39.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.519+0000 7fee05600640 1 -- 172.21.15.55:0/720404779 shutdown_connections 2024-04-02T07:34:39.518 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.519+0000 7fee05600640 1 -- 172.21.15.55:0/720404779 wait complete. 2024-04-02T07:34:39.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.519+0000 7fee05600640 1 Processor -- start 2024-04-02T07:34:39.519 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.519+0000 7fee05600640 1 -- start start 2024-04-02T07:34:39.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fee05600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee000707e0 0x7fee00156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:39.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fee05600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee000b2fd0 0x7fee0013a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:39.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fee05600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee00144260 0x7fee001518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:39.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fee05600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee0013aab0 con 0x7fee000707e0 2024-04-02T07:34:39.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fee05600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee00152be0 con 0x7fee00144260 2024-04-02T07:34:39.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fee05600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee00151e00 con 0x7fee000b2fd0 2024-04-02T07:34:39.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fedfea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee000707e0 0x7fee00156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:39.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fedfea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee000707e0 0x7fee00156c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33718/0 (socket says 172.21.15.55:33718) 2024-04-02T07:34:39.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fedfea00640 1 -- 172.21.15.55:0/1890474405 learned_addr learned my addr 172.21.15.55:0/1890474405 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:39.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fedf6000640 1 --2- 172.21.15.55:0/1890474405 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee000b2fd0 0x7fee0013a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:39.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fedff400640 1 --2- 172.21.15.55:0/1890474405 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee00144260 0x7fee001518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:39.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fedfea00640 1 -- 172.21.15.55:0/1890474405 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee000b2fd0 msgr2=0x7fee0013a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:39.521 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fedfea00640 1 --2- 172.21.15.55:0/1890474405 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee000b2fd0 0x7fee0013a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fedfea00640 1 -- 172.21.15.55:0/1890474405 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee00144260 msgr2=0x7fee001518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:39.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fedfea00640 1 --2- 172.21.15.55:0/1890474405 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee00144260 0x7fee001518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.522 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fedfea00640 1 -- 172.21.15.55:0/1890474405 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf00094d0 con 0x7fee000707e0 2024-04-02T07:34:39.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fedfea00640 1 --2- 172.21.15.55:0/1890474405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee000707e0 0x7fee00156c80 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fedf00ae040 tx=0x7fedf001ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:39.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fedf7400640 1 -- 172.21.15.55:0/1890474405 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00b6420 con 0x7fee000707e0 2024-04-02T07:34:39.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fedf7400640 1 -- 172.21.15.55:0/1890474405 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf00b65a0 con 0x7fee000707e0 2024-04-02T07:34:39.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fee05600640 1 -- 172.21.15.55:0/1890474405 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee00152060 con 0x7fee000707e0 2024-04-02T07:34:39.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fedf7400640 1 -- 172.21.15.55:0/1890474405 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00b6950 con 0x7fee000707e0 2024-04-02T07:34:39.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fee05600640 1 -- 172.21.15.55:0/1890474405 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee00152620 con 0x7fee000707e0 2024-04-02T07:34:39.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fee05600640 1 -- 172.21.15.55:0/1890474405 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee00073530 con 0x7fee000707e0 2024-04-02T07:34:39.523 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.523+0000 7fedf7400640 1 -- 172.21.15.55:0/1890474405 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fedf00b2040 con 0x7fee000707e0 2024-04-02T07:34:39.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.527+0000 7fedf7400640 1 --2- 172.21.15.55:0/1890474405 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feddc066690 0x7feddc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:39.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.527+0000 7fedf7400640 1 -- 172.21.15.55:0/1890474405 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7fedf011e5c0 con 0x7fee000707e0 2024-04-02T07:34:39.524 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.527+0000 7fedf6000640 1 --2- 172.21.15.55:0/1890474405 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feddc066690 0x7feddc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:39.525 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.527+0000 7fedf6000640 1 --2- 172.21.15.55:0/1890474405 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feddc066690 0x7feddc068b50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fee0015d0c0 tx=0x7fede8009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:39.528 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.531+0000 7fedf7400640 1 -- 172.21.15.55:0/1890474405 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fedf00eb8e0 con 0x7fee000707e0 2024-04-02T07:34:39.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.691+0000 7fee05600640 1 -- 172.21.15.55:0/1890474405 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fee00066c90 con 0x7fee000707e0 2024-04-02T07:34:39.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.691+0000 7fedf7400640 1 -- 172.21.15.55:0/1890474405 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v120) v1 ==== 93+0+10 (secure 0 0 0) 0x7fedf00eef00 con 0x7fee000707e0 2024-04-02T07:34:39.689 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2024-04-02T07:34:39.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.691+0000 7fee05600640 1 -- 172.21.15.55:0/1890474405 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feddc066690 msgr2=0x7feddc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:39.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.691+0000 7fee05600640 1 --2- 172.21.15.55:0/1890474405 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feddc066690 0x7feddc068b50 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fee0015d0c0 tx=0x7fede8009190 comp rx=0 tx=0).stop 2024-04-02T07:34:39.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.691+0000 7fee05600640 1 -- 172.21.15.55:0/1890474405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee000707e0 msgr2=0x7fee00156c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:39.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.691+0000 7fee05600640 1 --2- 172.21.15.55:0/1890474405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee000707e0 0x7fee00156c80 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7fedf00ae040 tx=0x7fedf001ada0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.691+0000 7fee05600640 1 -- 172.21.15.55:0/1890474405 shutdown_connections 2024-04-02T07:34:39.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.691+0000 7fee05600640 1 --2- 172.21.15.55:0/1890474405 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feddc066690 0x7feddc068b50 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.691+0000 7fee05600640 1 --2- 172.21.15.55:0/1890474405 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fee00144260 0x7fee001518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.691+0000 7fee05600640 1 --2- 172.21.15.55:0/1890474405 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fee000b2fd0 0x7fee0013a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.691+0000 7fee05600640 1 --2- 172.21.15.55:0/1890474405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fee000707e0 0x7fee00156c80 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.691+0000 7fee05600640 1 -- 172.21.15.55:0/1890474405 >> 172.21.15.55:0/1890474405 conn(0x7fee0006a390 msgr2=0x7fee0006d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:39.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.691+0000 7fee05600640 1 -- 172.21.15.55:0/1890474405 shutdown_connections 2024-04-02T07:34:39.691 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.691+0000 7fee05600640 1 -- 172.21.15.55:0/1890474405 wait complete. 2024-04-02T07:34:39.709 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-02T07:34:39.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.855+0000 7f258a600640 1 Processor -- start 2024-04-02T07:34:39.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.855+0000 7f258a600640 1 -- start start 2024-04-02T07:34:39.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.855+0000 7f258a600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25840ade90 0x7f258406d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:39.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.855+0000 7f258a600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25840b41a0 0x7f2584142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:39.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.855+0000 7f258a600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f258406c630 con 0x7f25840b3dc0 2024-04-02T07:34:39.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.855+0000 7f258a600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25840cae80 con 0x7f25840b41a0 2024-04-02T07:34:39.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.855+0000 7f258a600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258406c8f0 con 0x7f25840ade90 2024-04-02T07:34:39.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.855+0000 7f2583400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f25840b3dc0 0x7f25840ca770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45550/0 (socket says 172.21.15.55:45550) 2024-04-02T07:34:39.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.855+0000 7f2583400640 1 -- 172.21.15.55:0/2558400212 learned_addr learned my addr 172.21.15.55:0/2558400212 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:39.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.855+0000 7f2583e00640 1 --2- 172.21.15.55:0/2558400212 >> v2:172.21.15.55:3300/0 conn(0x7f25840b41a0 0x7f2584142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:39.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.855+0000 7f2582a00640 1 --2- 172.21.15.55:0/2558400212 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25840ade90 0x7f258406d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:39.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.855+0000 7f2583e00640 1 -- 172.21.15.55:0/2558400212 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25840ade90 msgr2=0x7f258406d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:39.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.855+0000 7f2583e00640 1 --2- 172.21.15.55:0/2558400212 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25840ade90 0x7f258406d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.855+0000 7f2582000640 1 -- 172.21.15.55:0/2558400212 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 672984026 0 0) 0x7f258406c630 con 0x7f25840b3dc0 2024-04-02T07:34:39.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.855+0000 7f2583e00640 1 -- 172.21.15.55:0/2558400212 >> v1:172.21.15.55:6789/0 conn(0x7f25840b3dc0 legacy=0x7f25840ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:39.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.855+0000 7f2583e00640 1 -- 172.21.15.55:0/2558400212 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f258406cbd0 con 0x7f25840b41a0 2024-04-02T07:34:39.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.859+0000 7f2583e00640 1 --2- 172.21.15.55:0/2558400212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840b41a0 0x7f2584142ac0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f257c009d90 tx=0x7f257c01c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50234b28b9aacc01 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:39.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.859+0000 7f2582000640 1 -- 172.21.15.55:0/2558400212 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c0a5880 con 0x7f25840b41a0 2024-04-02T07:34:39.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.859+0000 7f2582000640 1 -- 172.21.15.55:0/2558400212 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f257c0a59e0 con 0x7f25840b41a0 2024-04-02T07:34:39.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.859+0000 7f2582000640 1 -- 172.21.15.55:0/2558400212 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257c0a5d70 con 0x7f25840b41a0 2024-04-02T07:34:39.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.859+0000 7f258a600640 1 -- 172.21.15.55:0/2558400212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840b41a0 msgr2=0x7f2584142ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:39.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.859+0000 7f258a600640 1 --2- 172.21.15.55:0/2558400212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840b41a0 0x7f2584142ac0 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f257c009d90 tx=0x7f257c01c8b0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.859+0000 7f258a600640 1 -- 172.21.15.55:0/2558400212 shutdown_connections 2024-04-02T07:34:39.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.859+0000 7f258a600640 1 --2- 172.21.15.55:0/2558400212 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25840ade90 0x7f258406d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.859+0000 7f258a600640 1 --2- 172.21.15.55:0/2558400212 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840b41a0 0x7f2584142ac0 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.859+0000 7f258a600640 1 -- 172.21.15.55:0/2558400212 >> 172.21.15.55:0/2558400212 conn(0x7f258406a390 msgr2=0x7f25840b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:39.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.859+0000 7f258a600640 1 -- 172.21.15.55:0/2558400212 shutdown_connections 2024-04-02T07:34:39.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.859+0000 7f258a600640 1 -- 172.21.15.55:0/2558400212 wait complete. 2024-04-02T07:34:39.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.859+0000 7f258a600640 1 Processor -- start 2024-04-02T07:34:39.859 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.859+0000 7f258a600640 1 -- start start 2024-04-02T07:34:39.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f258a600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840ade90 0x7f258413e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:39.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f258a600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25840b3dc0 0x7f25840ae290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:39.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f258a600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25840b41a0 0x7f2584153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:39.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f258a600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25841627e0 con 0x7f25840ade90 2024-04-02T07:34:39.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f258a600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f258413d820 con 0x7f25840b3dc0 2024-04-02T07:34:39.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f258a600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f258413db00 con 0x7f25840b41a0 2024-04-02T07:34:39.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f2583400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840ade90 0x7f258413e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:39.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f2583400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840ade90 0x7f258413e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33736/0 (socket says 172.21.15.55:33736) 2024-04-02T07:34:39.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f2583400640 1 -- 172.21.15.55:0/2583130905 learned_addr learned my addr 172.21.15.55:0/2583130905 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:39.862 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f2583e00640 1 --2- 172.21.15.55:0/2583130905 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25840b41a0 0x7f2584153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:39.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f2582a00640 1 --2- 172.21.15.55:0/2583130905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25840b3dc0 0x7f25840ae290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:39.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f2583400640 1 -- 172.21.15.55:0/2583130905 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25840b41a0 msgr2=0x7f2584153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:39.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f2583400640 1 --2- 172.21.15.55:0/2583130905 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25840b41a0 0x7f2584153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f2583400640 1 -- 172.21.15.55:0/2583130905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25840b3dc0 msgr2=0x7f25840ae290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:39.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f2583400640 1 --2- 172.21.15.55:0/2583130905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25840b3dc0 0x7f25840ae290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:39.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f2583400640 1 -- 172.21.15.55:0/2583130905 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f257c009a70 con 0x7f25840ade90 2024-04-02T07:34:39.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f2582a00640 1 --2- 172.21.15.55:0/2583130905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25840b3dc0 0x7f25840ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:39.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f2583400640 1 --2- 172.21.15.55:0/2583130905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840ade90 0x7f258413e5f0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f25740011f0 tx=0x7f257400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:39.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f257b400640 1 -- 172.21.15.55:0/2583130905 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25740074e0 con 0x7f25840ade90 2024-04-02T07:34:39.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f257b400640 1 -- 172.21.15.55:0/2583130905 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2574007640 con 0x7f25840ade90 2024-04-02T07:34:39.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f257b400640 1 -- 172.21.15.55:0/2583130905 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2574004a10 con 0x7f25840ade90 2024-04-02T07:34:39.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f258a600640 1 -- 172.21.15.55:0/2583130905 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f258406de00 con 0x7f25840ade90 2024-04-02T07:34:39.863 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f258a600640 1 -- 172.21.15.55:0/2583130905 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2584162a30 con 0x7f25840ade90 2024-04-02T07:34:39.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.863+0000 7f258a600640 1 -- 172.21.15.55:0/2583130905 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2584073530 con 0x7f25840ade90 2024-04-02T07:34:39.864 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.867+0000 7f257b400640 1 -- 172.21.15.55:0/2583130905 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f2574004b70 con 0x7f25840ade90 2024-04-02T07:34:39.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.867+0000 7f257b400640 1 --2- 172.21.15.55:0/2583130905 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25640666c0 0x7f2564068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:39.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.867+0000 7f257b400640 1 -- 172.21.15.55:0/2583130905 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f25740832c0 con 0x7f25840ade90 2024-04-02T07:34:39.865 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.867+0000 7f2582a00640 1 --2- 172.21.15.55:0/2583130905 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25640666c0 0x7f2564068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:39.866 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.867+0000 7f2582a00640 1 --2- 172.21.15.55:0/2583130905 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25640666c0 0x7f2564068b80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f2584154390 tx=0x7f2570008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:39.869 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:39.871+0000 7f257b400640 1 -- 172.21.15.55:0/2583130905 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f2574050680 con 0x7f25840ade90 2024-04-02T07:34:40.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.031+0000 7f258a600640 1 -- 172.21.15.55:0/2583130905 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2584162c40 con 0x7f25840ade90 2024-04-02T07:34:40.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.031+0000 7f257b400640 1 -- 172.21.15.55:0/2583130905 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v120) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2574053ca0 con 0x7f25840ade90 2024-04-02T07:34:40.031 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 32 2024-04-02T07:34:40.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.035+0000 7f258a600640 1 -- 172.21.15.55:0/2583130905 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25640666c0 msgr2=0x7f2564068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:40.033 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.035+0000 7f258a600640 1 --2- 172.21.15.55:0/2583130905 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25640666c0 0x7f2564068b80 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f2584154390 tx=0x7f2570008040 comp rx=0 tx=0).stop 2024-04-02T07:34:40.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.035+0000 7f258a600640 1 -- 172.21.15.55:0/2583130905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840ade90 msgr2=0x7f258413e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:40.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.035+0000 7f258a600640 1 --2- 172.21.15.55:0/2583130905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840ade90 0x7f258413e5f0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f25740011f0 tx=0x7f257400c9b0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.035+0000 7f258a600640 1 -- 172.21.15.55:0/2583130905 shutdown_connections 2024-04-02T07:34:40.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.035+0000 7f258a600640 1 --2- 172.21.15.55:0/2583130905 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f25840b41a0 0x7f2584153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.035+0000 7f258a600640 1 --2- 172.21.15.55:0/2583130905 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f25640666c0 0x7f2564068b80 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.035+0000 7f258a600640 1 --2- 172.21.15.55:0/2583130905 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f25840b3dc0 0x7f25840ae290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.035+0000 7f258a600640 1 --2- 172.21.15.55:0/2583130905 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25840ade90 0x7f258413e5f0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.035+0000 7f258a600640 1 -- 172.21.15.55:0/2583130905 >> 172.21.15.55:0/2583130905 conn(0x7f258406a390 msgr2=0x7f2584158630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:40.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.035+0000 7f258a600640 1 -- 172.21.15.55:0/2583130905 shutdown_connections 2024-04-02T07:34:40.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.035+0000 7f258a600640 1 -- 172.21.15.55:0/2583130905 wait complete. 2024-04-02T07:34:40.052 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-02T07:34:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.195+0000 7f4165800640 1 Processor -- start 2024-04-02T07:34:40.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.195+0000 7f4165800640 1 -- start start 2024-04-02T07:34:40.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.195+0000 7f4165800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41600b3dc0 0x7f41600ca770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:40.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.195+0000 7f4165800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f41600b41a0 0x7f4160142ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:40.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.195+0000 7f4165800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f416006ddc0 con 0x7f41600ade90 2024-04-02T07:34:40.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.195+0000 7f4165800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f416006c630 con 0x7f41600b41a0 2024-04-02T07:34:40.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.195+0000 7f4165800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f416006c8f0 con 0x7f41600b3dc0 2024-04-02T07:34:40.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.195+0000 7f415f400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f41600b41a0 0x7f4160142ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:40.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.199+0000 7f4156000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f41600ade90 0x7f416006d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45556/0 (socket says 172.21.15.55:45556) 2024-04-02T07:34:40.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.199+0000 7f4156000640 1 -- 172.21.15.55:0/1420153977 learned_addr learned my addr 172.21.15.55:0/1420153977 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:40.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.199+0000 7f415ea00640 1 --2- 172.21.15.55:0/1420153977 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41600b3dc0 0x7f41600ca770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:40.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.199+0000 7f415e000640 1 -- 172.21.15.55:0/1420153977 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 734449737 0 0) 0x7f416006ddc0 con 0x7f41600ade90 2024-04-02T07:34:40.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.199+0000 7f415e000640 1 -- 172.21.15.55:0/1420153977 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4144003530 con 0x7f41600ade90 2024-04-02T07:34:40.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.199+0000 7f415f400640 1 -- 172.21.15.55:0/1420153977 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41600b3dc0 msgr2=0x7f41600ca770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:40.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.199+0000 7f415f400640 1 --2- 172.21.15.55:0/1420153977 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41600b3dc0 0x7f41600ca770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.199+0000 7f415f400640 1 -- 172.21.15.55:0/1420153977 >> v1:172.21.15.55:6789/0 conn(0x7f41600ade90 legacy=0x7f416006d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:40.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.199+0000 7f415f400640 1 -- 172.21.15.55:0/1420153977 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f416006cbd0 con 0x7f41600b41a0 2024-04-02T07:34:40.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.199+0000 7f415ea00640 1 --2- 172.21.15.55:0/1420153977 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41600b3dc0 0x7f41600ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:34:40.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.199+0000 7f415f400640 1 --2- 172.21.15.55:0/1420153977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41600b41a0 0x7f4160142ac0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f41580097c0 tx=0x7f415801c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185c6e5f573320bf server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:40.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.199+0000 7f415e000640 1 -- 172.21.15.55:0/1420153977 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41580ab600 con 0x7f41600b41a0 2024-04-02T07:34:40.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.199+0000 7f415e000640 1 -- 172.21.15.55:0/1420153977 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41580a7050 con 0x7f41600b41a0 2024-04-02T07:34:40.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.199+0000 7f415e000640 1 -- 172.21.15.55:0/1420153977 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41580ab960 con 0x7f41600b41a0 2024-04-02T07:34:40.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f4165800640 1 -- 172.21.15.55:0/1420153977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41600b41a0 msgr2=0x7f4160142ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:40.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f4165800640 1 --2- 172.21.15.55:0/1420153977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41600b41a0 0x7f4160142ac0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f41580097c0 tx=0x7f415801c3e0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f4165800640 1 -- 172.21.15.55:0/1420153977 shutdown_connections 2024-04-02T07:34:40.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f4165800640 1 --2- 172.21.15.55:0/1420153977 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41600b41a0 0x7f4160142ac0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f4165800640 1 --2- 172.21.15.55:0/1420153977 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41600b3dc0 0x7f41600ca770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f4165800640 1 -- 172.21.15.55:0/1420153977 >> 172.21.15.55:0/1420153977 conn(0x7f416006a390 msgr2=0x7f41600b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:40.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f4165800640 1 -- 172.21.15.55:0/1420153977 shutdown_connections 2024-04-02T07:34:40.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f4165800640 1 -- 172.21.15.55:0/1420153977 wait complete. 2024-04-02T07:34:40.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f4165800640 1 Processor -- start 2024-04-02T07:34:40.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f4165800640 1 -- start start 2024-04-02T07:34:40.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f4165800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41600ade90 0x7f4160138de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:40.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f4165800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41600b3dc0 0x7f4160137c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:40.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f4165800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41600b41a0 0x7f4160156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:40.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f4165800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41601381d0 con 0x7f41600ade90 2024-04-02T07:34:40.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f4165800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41601393c0 con 0x7f41600b3dc0 2024-04-02T07:34:40.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f4165800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4160156260 con 0x7f41600b41a0 2024-04-02T07:34:40.204 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f415ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41600ade90 0x7f4160138de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:40.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f415ea00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41600ade90 0x7f4160138de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33746/0 (socket says 172.21.15.55:33746) 2024-04-02T07:34:40.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f415ea00640 1 -- 172.21.15.55:0/1781535003 learned_addr learned my addr 172.21.15.55:0/1781535003 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:40.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f415ea00640 1 -- 172.21.15.55:0/1781535003 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41600b41a0 msgr2=0x7f4160156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:40.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f415ea00640 1 --2- 172.21.15.55:0/1781535003 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41600b41a0 0x7f4160156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f415ea00640 1 -- 172.21.15.55:0/1781535003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41600b3dc0 msgr2=0x7f4160137c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:40.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f415ea00640 1 --2- 172.21.15.55:0/1781535003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41600b3dc0 0x7f4160137c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f415ea00640 1 -- 172.21.15.55:0/1781535003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4150009a70 con 0x7f41600ade90 2024-04-02T07:34:40.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.203+0000 7f415ea00640 1 --2- 172.21.15.55:0/1781535003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41600ade90 0x7f4160138de0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f415000efc0 tx=0x7f415000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:40.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.207+0000 7f4157400640 1 -- 172.21.15.55:0/1781535003 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4150014680 con 0x7f41600ade90 2024-04-02T07:34:40.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.207+0000 7f4157400640 1 -- 172.21.15.55:0/1781535003 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f415000f040 con 0x7f41600ade90 2024-04-02T07:34:40.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.207+0000 7f4157400640 1 -- 172.21.15.55:0/1781535003 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4150014a00 con 0x7f41600ade90 2024-04-02T07:34:40.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.207+0000 7f4165800640 1 -- 172.21.15.55:0/1781535003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4158009420 con 0x7f41600ade90 2024-04-02T07:34:40.205 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.207+0000 7f4165800640 1 -- 172.21.15.55:0/1781535003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4160156820 con 0x7f41600ade90 2024-04-02T07:34:40.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.207+0000 7f4165800640 1 -- 172.21.15.55:0/1781535003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41601569e0 con 0x7f41600ade90 2024-04-02T07:34:40.206 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.207+0000 7f4157400640 1 -- 172.21.15.55:0/1781535003 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f4150014b60 con 0x7f41600ade90 2024-04-02T07:34:40.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.207+0000 7f4157400640 1 --2- 172.21.15.55:0/1781535003 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f413c066690 0x7f413c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:40.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.207+0000 7f4157400640 1 -- 172.21.15.55:0/1781535003 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f4150085290 con 0x7f41600ade90 2024-04-02T07:34:40.207 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.207+0000 7f4156000640 1 --2- 172.21.15.55:0/1781535003 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f413c066690 0x7f413c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:40.208 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.211+0000 7f4156000640 1 --2- 172.21.15.55:0/1781535003 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f413c066690 0x7f413c068b50 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f4148007fd0 tx=0x7f4148007900 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:40.210 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.211+0000 7f4157400640 1 -- 172.21.15.55:0/1781535003 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f41500525a0 con 0x7f41600ade90 2024-04-02T07:34:40.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.371+0000 7f4165800640 1 -- 172.21.15.55:0/1781535003 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4160073530 con 0x7f41600ade90 2024-04-02T07:34:40.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.371+0000 7f4157400640 1 -- 172.21.15.55:0/1781535003 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v120) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4150055bc0 con 0x7f41600ade90 2024-04-02T07:34:40.371 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 64 2024-04-02T07:34:40.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.375+0000 7f4165800640 1 -- 172.21.15.55:0/1781535003 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f413c066690 msgr2=0x7f413c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:40.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.375+0000 7f4165800640 1 --2- 172.21.15.55:0/1781535003 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f413c066690 0x7f413c068b50 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f4148007fd0 tx=0x7f4148007900 comp rx=0 tx=0).stop 2024-04-02T07:34:40.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.375+0000 7f4165800640 1 -- 172.21.15.55:0/1781535003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41600ade90 msgr2=0x7f4160138de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:40.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.375+0000 7f4165800640 1 --2- 172.21.15.55:0/1781535003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41600ade90 0x7f4160138de0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f415000efc0 tx=0x7f415000c490 comp rx=0 tx=0).stop 2024-04-02T07:34:40.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.375+0000 7f4165800640 1 -- 172.21.15.55:0/1781535003 shutdown_connections 2024-04-02T07:34:40.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.375+0000 7f4165800640 1 --2- 172.21.15.55:0/1781535003 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f41600b41a0 0x7f4160156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.375+0000 7f4165800640 1 --2- 172.21.15.55:0/1781535003 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f413c066690 0x7f413c068b50 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.375+0000 7f4165800640 1 --2- 172.21.15.55:0/1781535003 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f41600b3dc0 0x7f4160137c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.375+0000 7f4165800640 1 --2- 172.21.15.55:0/1781535003 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f41600ade90 0x7f4160138de0 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.375+0000 7f4165800640 1 -- 172.21.15.55:0/1781535003 >> 172.21.15.55:0/1781535003 conn(0x7f416006a390 msgr2=0x7f4160153a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:40.373 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.375+0000 7f4165800640 1 -- 172.21.15.55:0/1781535003 shutdown_connections 2024-04-02T07:34:40.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.375+0000 7f4165800640 1 -- 172.21.15.55:0/1781535003 wait complete. 2024-04-02T07:34:40.392 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:34:40.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.535+0000 7f714b800640 1 Processor -- start 2024-04-02T07:34:40.534 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.535+0000 7f714b800640 1 -- start start 2024-04-02T07:34:40.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.535+0000 7f714b800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f71440cda80 0x7f71440c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:40.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.535+0000 7f714b800640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71440b3c00 con 0x7f7144143f90 2024-04-02T07:34:40.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.535+0000 7f714b800640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7144144370 con 0x7f714415ad30 2024-04-02T07:34:40.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.535+0000 7f714b800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71440c37b0 con 0x7f71440cda80 2024-04-02T07:34:40.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.535+0000 7f7148e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7144143f90 0x7f71440b34f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45572/0 (socket says 172.21.15.55:45572) 2024-04-02T07:34:40.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.535+0000 7f7148e00640 1 -- 172.21.15.55:0/2532743019 learned_addr learned my addr 172.21.15.55:0/2532743019 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:40.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.535+0000 7f7149800640 1 --2- 172.21.15.55:0/2532743019 >> v2:172.21.15.106:3300/0 conn(0x7f71440cda80 0x7f71440c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:40.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.535+0000 7f7143400640 1 -- 172.21.15.55:0/2532743019 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 893203539 0 0) 0x7f71440b3c00 con 0x7f7144143f90 2024-04-02T07:34:40.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.535+0000 7f7143400640 1 -- 172.21.15.55:0/2532743019 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f712c003530 con 0x7f7144143f90 2024-04-02T07:34:40.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.535+0000 7f7149800640 1 -- 172.21.15.55:0/2532743019 >> v1:172.21.15.106:6789/0 conn(0x7f714415ad30 legacy=0x7f71440cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:40.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.535+0000 7f7149800640 1 -- 172.21.15.55:0/2532743019 >> v1:172.21.15.55:6789/0 conn(0x7f7144143f90 legacy=0x7f71440b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:40.536 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.535+0000 7f7149800640 1 -- 172.21.15.55:0/2532743019 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71440c3a90 con 0x7f71440cda80 2024-04-02T07:34:40.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.539+0000 7f7149800640 1 --2- 172.21.15.55:0/2532743019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71440cda80 0x7f71440c4850 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f713c009d90 tx=0x7f713c01c8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6adb8d3dbcbf0221 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:40.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.539+0000 7f7143400640 1 -- 172.21.15.55:0/2532743019 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c0a5970 con 0x7f71440cda80 2024-04-02T07:34:40.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.539+0000 7f7143400640 1 -- 172.21.15.55:0/2532743019 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f713c0a5ad0 con 0x7f71440cda80 2024-04-02T07:34:40.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.539+0000 7f7143400640 1 -- 172.21.15.55:0/2532743019 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f713c0a5e60 con 0x7f71440cda80 2024-04-02T07:34:40.539 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.539+0000 7f714b800640 1 -- 172.21.15.55:0/2532743019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71440cda80 msgr2=0x7f71440c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:40.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.539+0000 7f714b800640 1 --2- 172.21.15.55:0/2532743019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71440cda80 0x7f71440c4850 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f713c009d90 tx=0x7f713c01c8b0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.539+0000 7f714b800640 1 -- 172.21.15.55:0/2532743019 shutdown_connections 2024-04-02T07:34:40.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.539+0000 7f714b800640 1 --2- 172.21.15.55:0/2532743019 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f71440cda80 0x7f71440c4850 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.539+0000 7f714b800640 1 -- 172.21.15.55:0/2532743019 >> 172.21.15.55:0/2532743019 conn(0x7f7144066080 msgr2=0x7f7144069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:40.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.539+0000 7f714b800640 1 -- 172.21.15.55:0/2532743019 shutdown_connections 2024-04-02T07:34:40.540 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.539+0000 7f714b800640 1 -- 172.21.15.55:0/2532743019 wait complete. 2024-04-02T07:34:40.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f714b800640 1 Processor -- start 2024-04-02T07:34:40.541 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f714b800640 1 -- start start 2024-04-02T07:34:40.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f714b800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71440cda80 0x7f7144159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:40.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f714b800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7144143f90 0x7f714413e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:40.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f714b800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f714415ad30 0x7f71440c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:40.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f714b800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714413ff30 con 0x7f7144143f90 2024-04-02T07:34:40.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f714b800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714413f2b0 con 0x7f714415ad30 2024-04-02T07:34:40.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f714b800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714413f590 con 0x7f71440cda80 2024-04-02T07:34:40.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f7143e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7144143f90 0x7f714413e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:40.543 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f7143e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7144143f90 0x7f714413e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33762/0 (socket says 172.21.15.55:33762) 2024-04-02T07:34:40.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f7143e00640 1 -- 172.21.15.55:0/709188560 learned_addr learned my addr 172.21.15.55:0/709188560 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:40.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f7149800640 1 --2- 172.21.15.55:0/709188560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f714415ad30 0x7f71440c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:40.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f7148e00640 1 --2- 172.21.15.55:0/709188560 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71440cda80 0x7f7144159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:40.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f7143e00640 1 -- 172.21.15.55:0/709188560 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71440cda80 msgr2=0x7f7144159f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:40.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f7143e00640 1 --2- 172.21.15.55:0/709188560 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71440cda80 0x7f7144159f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f7143e00640 1 -- 172.21.15.55:0/709188560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f714415ad30 msgr2=0x7f71440c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:40.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f7143e00640 1 --2- 172.21.15.55:0/709188560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f714415ad30 0x7f71440c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.544 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f7143e00640 1 -- 172.21.15.55:0/709188560 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c009a70 con 0x7f7144143f90 2024-04-02T07:34:40.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f7143e00640 1 --2- 172.21.15.55:0/709188560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7144143f90 0x7f714413e9d0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f713000c3c0 tx=0x7f713000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:40.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f7140c00640 1 -- 172.21.15.55:0/709188560 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71300052d0 con 0x7f7144143f90 2024-04-02T07:34:40.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f7140c00640 1 -- 172.21.15.55:0/709188560 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7130005430 con 0x7f7144143f90 2024-04-02T07:34:40.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f7140c00640 1 -- 172.21.15.55:0/709188560 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130003840 con 0x7f7144143f90 2024-04-02T07:34:40.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.543+0000 7f714b800640 1 -- 172.21.15.55:0/709188560 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714413f870 con 0x7f7144143f90 2024-04-02T07:34:40.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.547+0000 7f714b800640 1 -- 172.21.15.55:0/709188560 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714415a480 con 0x7f7144143f90 2024-04-02T07:34:40.545 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.547+0000 7f714b800640 1 -- 172.21.15.55:0/709188560 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7144066c90 con 0x7f7144143f90 2024-04-02T07:34:40.546 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.547+0000 7f7140c00640 1 -- 172.21.15.55:0/709188560 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f71300039a0 con 0x7f7144143f90 2024-04-02T07:34:40.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.547+0000 7f7140c00640 1 --2- 172.21.15.55:0/709188560 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7124066690 0x7f7124068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:40.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.547+0000 7f7140c00640 1 -- 172.21.15.55:0/709188560 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f71300837a0 con 0x7f7144143f90 2024-04-02T07:34:40.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.547+0000 7f7148e00640 1 --2- 172.21.15.55:0/709188560 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7124066690 0x7f7124068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:40.547 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.547+0000 7f7148e00640 1 --2- 172.21.15.55:0/709188560 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7124066690 0x7f7124068b50 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f71380011f0 tx=0x7f7138007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:40.550 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.551+0000 7f7140c00640 1 -- 172.21.15.55:0/709188560 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f7130050a30 con 0x7f7144143f90 2024-04-02T07:34:40.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.751+0000 7f714b800640 1 -- 172.21.15.55:0/709188560 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71440b2880 con 0x7f7144143f90 2024-04-02T07:34:40.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.751+0000 7f7140c00640 1 -- 172.21.15.55:0/709188560 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4747 (secure 0 0 0) 0x7f7130054050 con 0x7f7144143f90 2024-04-02T07:34:40.752 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:40.752 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":109,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7592,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2292883244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2292883244},{"type":"v1","addr":"172.21.15.106:6836","nonce":2292883244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":7835,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3165795379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3165795379},{"type":"v1","addr":"172.21.15.106:6837","nonce":3165795379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":9147,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2700619140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2700619140},{"type":"v1","addr":"172.21.15.55:6834","nonce":2700619140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:33:27.846433+0000","modified":"2024-04-02T07:34:30.606280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9717":{"gid":9717,"name":"a","rank":0,"incarnation":106,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6835/1279080129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1279080129},{"type":"v1","addr":"172.21.15.55:6835","nonce":1279080129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-02T07:34:40.752 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 109 2024-04-02T07:34:40.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.755+0000 7f714b800640 1 -- 172.21.15.55:0/709188560 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7124066690 msgr2=0x7f7124068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:40.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.755+0000 7f714b800640 1 --2- 172.21.15.55:0/709188560 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7124066690 0x7f7124068b50 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f71380011f0 tx=0x7f7138007d40 comp rx=0 tx=0).stop 2024-04-02T07:34:40.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.755+0000 7f714b800640 1 -- 172.21.15.55:0/709188560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7144143f90 msgr2=0x7f714413e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:40.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.755+0000 7f714b800640 1 --2- 172.21.15.55:0/709188560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7144143f90 0x7f714413e9d0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f713000c3c0 tx=0x7f713000c880 comp rx=0 tx=0).stop 2024-04-02T07:34:40.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.755+0000 7f714b800640 1 -- 172.21.15.55:0/709188560 shutdown_connections 2024-04-02T07:34:40.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.755+0000 7f714b800640 1 --2- 172.21.15.55:0/709188560 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7124066690 0x7f7124068b50 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.755+0000 7f714b800640 1 --2- 172.21.15.55:0/709188560 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f714415ad30 0x7f71440c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.755+0000 7f714b800640 1 --2- 172.21.15.55:0/709188560 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7144143f90 0x7f714413e9d0 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.755+0000 7f714b800640 1 --2- 172.21.15.55:0/709188560 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f71440cda80 0x7f7144159f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.755+0000 7f714b800640 1 -- 172.21.15.55:0/709188560 >> 172.21.15.55:0/709188560 conn(0x7f7144066080 msgr2=0x7f71440b1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:40.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.755+0000 7f714b800640 1 -- 172.21.15.55:0/709188560 shutdown_connections 2024-04-02T07:34:40.755 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.755+0000 7f714b800640 1 -- 172.21.15.55:0/709188560 wait complete. 2024-04-02T07:34:40.773 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:34:40.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.915+0000 7fb2c6a00640 1 Processor -- start 2024-04-02T07:34:40.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.915+0000 7fb2c6a00640 1 -- start start 2024-04-02T07:34:40.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.915+0000 7fb2c6a00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fb2c0143f90 0x7fb2c015ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.915+0000 7fb2c6a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb2c00cda80 0x7fb2c00c4850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.915+0000 7fb2c6a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2c015b270 con 0x7fb2c00b34f0 2024-04-02T07:34:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.915+0000 7fb2c6a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c0144370 con 0x7fb2c00cda80 2024-04-02T07:34:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.915+0000 7fb2c6a00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2c00c37b0 con 0x7fb2c0143f90 2024-04-02T07:34:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.915+0000 7fb2c4a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb2c00cda80 0x7fb2c00c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.915+0000 7fb2c4a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb2c00cda80 0x7fb2c00c4850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33768/0 (socket says 172.21.15.55:33768) 2024-04-02T07:34:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.915+0000 7fb2c4a00640 1 -- 172.21.15.55:0/2535128422 learned_addr learned my addr 172.21.15.55:0/2535128422 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.915+0000 7fb2c4a00640 1 -- 172.21.15.55:0/2535128422 >> v2:172.21.15.106:3300/0 conn(0x7fb2c0143f90 msgr2=0x7fb2c015ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.915+0000 7fb2bfe00640 1 --2- 172.21.15.55:0/2535128422 >> v2:172.21.15.106:3300/0 conn(0x7fb2c0143f90 0x7fb2c015ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.915+0000 7fb2c4a00640 1 --2- 172.21.15.55:0/2535128422 >> v2:172.21.15.106:3300/0 conn(0x7fb2c0143f90 0x7fb2c015ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.915+0000 7fb2c4a00640 1 -- 172.21.15.55:0/2535128422 >> v1:172.21.15.106:6789/0 conn(0x7fb2c00b34f0 legacy=0x7fb2c00cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.915+0000 7fb2c4a00640 1 -- 172.21.15.55:0/2535128422 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2c00c3a90 con 0x7fb2c00cda80 2024-04-02T07:34:40.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.915+0000 7fb2bfe00640 1 --2- 172.21.15.55:0/2535128422 >> v2:172.21.15.106:3300/0 conn(0x7fb2c0143f90 0x7fb2c015ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:40.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.919+0000 7fb2c4a00640 1 --2- 172.21.15.55:0/2535128422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c00cda80 0x7fb2c00c4850 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fb2c006abc0 tx=0x7fb2b801c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242c0eb300428125 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:40.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.919+0000 7fb2bf400640 1 -- 172.21.15.55:0/2535128422 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b80a57b0 con 0x7fb2c00cda80 2024-04-02T07:34:40.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.919+0000 7fb2bf400640 1 -- 172.21.15.55:0/2535128422 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b80a5910 con 0x7fb2c00cda80 2024-04-02T07:34:40.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.919+0000 7fb2bf400640 1 -- 172.21.15.55:0/2535128422 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b80a5ca0 con 0x7fb2c00cda80 2024-04-02T07:34:40.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.919+0000 7fb2c6a00640 1 -- 172.21.15.55:0/2535128422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c00cda80 msgr2=0x7fb2c00c4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:40.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.919+0000 7fb2c6a00640 1 --2- 172.21.15.55:0/2535128422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c00cda80 0x7fb2c00c4850 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7fb2c006abc0 tx=0x7fb2b801c8f0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.919+0000 7fb2c6a00640 1 -- 172.21.15.55:0/2535128422 shutdown_connections 2024-04-02T07:34:40.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.919+0000 7fb2c6a00640 1 --2- 172.21.15.55:0/2535128422 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c00cda80 0x7fb2c00c4850 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.919+0000 7fb2c6a00640 1 --2- 172.21.15.55:0/2535128422 >> v2:172.21.15.106:3300/0 conn(0x7fb2c0143f90 0x7fb2c015ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.919+0000 7fb2c6a00640 1 -- 172.21.15.55:0/2535128422 >> 172.21.15.55:0/2535128422 conn(0x7fb2c0066080 msgr2=0x7fb2c0069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:40.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.919+0000 7fb2c6a00640 1 -- 172.21.15.55:0/2535128422 shutdown_connections 2024-04-02T07:34:40.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.919+0000 7fb2c6a00640 1 -- 172.21.15.55:0/2535128422 wait complete. 2024-04-02T07:34:40.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2c6a00640 1 Processor -- start 2024-04-02T07:34:40.920 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2c6a00640 1 -- start start 2024-04-02T07:34:40.922 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2c6a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c00b34f0 0x7fb2c015cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:40.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2c6a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2c00cda80 0x7fb2c013b770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:40.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2c6a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2c0143f90 0x7fb2c0156b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:40.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2c6a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c0163890 con 0x7fb2c00b34f0 2024-04-02T07:34:40.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2c6a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c0164690 con 0x7fb2c0143f90 2024-04-02T07:34:40.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2c6a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2c015d480 con 0x7fb2c00cda80 2024-04-02T07:34:40.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2bfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c00b34f0 0x7fb2c015cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:40.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2bfe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c00b34f0 0x7fb2c015cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33774/0 (socket says 172.21.15.55:33774) 2024-04-02T07:34:40.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2bfe00640 1 -- 172.21.15.55:0/2739566811 learned_addr learned my addr 172.21.15.55:0/2739566811 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:40.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2b7e00640 1 --2- 172.21.15.55:0/2739566811 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2c00cda80 0x7fb2c013b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:40.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2c4a00640 1 --2- 172.21.15.55:0/2739566811 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2c0143f90 0x7fb2c0156b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:40.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2bfe00640 1 -- 172.21.15.55:0/2739566811 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2c00cda80 msgr2=0x7fb2c013b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:40.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2bfe00640 1 --2- 172.21.15.55:0/2739566811 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2c00cda80 0x7fb2c013b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2bfe00640 1 -- 172.21.15.55:0/2739566811 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2c0143f90 msgr2=0x7fb2c0156b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:40.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2bfe00640 1 --2- 172.21.15.55:0/2739566811 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2c0143f90 0x7fb2c0156b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:40.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2bfe00640 1 -- 172.21.15.55:0/2739566811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b8009b30 con 0x7fb2c00b34f0 2024-04-02T07:34:40.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2b7e00640 1 --2- 172.21.15.55:0/2739566811 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2c00cda80 0x7fb2c013b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:40.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2bfe00640 1 --2- 172.21.15.55:0/2739566811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c00b34f0 0x7fb2c015cf40 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000c820 tx=0x7fb2b000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:40.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2bcc00640 1 -- 172.21.15.55:0/2739566811 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b0007a30 con 0x7fb2c00b34f0 2024-04-02T07:34:40.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2bcc00640 1 -- 172.21.15.55:0/2739566811 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2b0007b90 con 0x7fb2c00b34f0 2024-04-02T07:34:40.924 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2bcc00640 1 -- 172.21.15.55:0/2739566811 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2b000ce10 con 0x7fb2c00b34f0 2024-04-02T07:34:40.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2c6a00640 1 -- 172.21.15.55:0/2739566811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2c0163a80 con 0x7fb2c00b34f0 2024-04-02T07:34:40.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2c6a00640 1 -- 172.21.15.55:0/2739566811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2c0164040 con 0x7fb2c00b34f0 2024-04-02T07:34:40.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.923+0000 7fb2c6a00640 1 -- 172.21.15.55:0/2739566811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2c015b4d0 con 0x7fb2c00b34f0 2024-04-02T07:34:40.925 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.927+0000 7fb2bcc00640 1 -- 172.21.15.55:0/2739566811 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb2b00113f0 con 0x7fb2c00b34f0 2024-04-02T07:34:40.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.927+0000 7fb2bcc00640 1 --2- 172.21.15.55:0/2739566811 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb29c0666c0 0x7fb29c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:40.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.927+0000 7fb2bcc00640 1 -- 172.21.15.55:0/2739566811 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7fb2b0084340 con 0x7fb2c00b34f0 2024-04-02T07:34:40.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.927+0000 7fb2b7e00640 1 --2- 172.21.15.55:0/2739566811 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb29c0666c0 0x7fb29c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:40.926 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.927+0000 7fb2b7e00640 1 --2- 172.21.15.55:0/2739566811 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb29c0666c0 0x7fb29c068b80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00cd340 tx=0x7fb2a8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:40.929 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:40.931+0000 7fb2bcc00640 1 -- 172.21.15.55:0/2739566811 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fb2b00515c0 con 0x7fb2c00b34f0 2024-04-02T07:34:41.090 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.091+0000 7fb2c6a00640 1 -- 172.21.15.55:0/2739566811 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2c0066c90 con 0x7fb2c00b34f0 2024-04-02T07:34:41.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.091+0000 7fb2bcc00640 1 -- 172.21.15.55:0/2739566811 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+16409 (secure 0 0 0) 0x7fb2b0054be0 con 0x7fb2c00b34f0 2024-04-02T07:34:41.092 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:41.092 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":120,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:34:25.539106+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:33:26.384276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-02T07:33:26.835969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.7","mappings":[{"from":0,"to":5}]},{"pgid":"17.21","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6835/154663344":"2024-04-03T07:34:25.539082+0000","172.21.15.55:6832/154663344":"2024-04-03T07:34:25.539082+0000","172.21.15.106:6837/775582321":"2024-04-03T07:34:04.807966+0000","172.21.15.106:6834/775582321":"2024-04-03T07:34:04.807966+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:34:41.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.095+0000 7fb2c6a00640 1 -- 172.21.15.55:0/2739566811 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb29c0666c0 msgr2=0x7fb29c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:41.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.095+0000 7fb2c6a00640 1 --2- 172.21.15.55:0/2739566811 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb29c0666c0 0x7fb29c068b80 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fb2c00cd340 tx=0x7fb2a8009040 comp rx=0 tx=0).stop 2024-04-02T07:34:41.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.095+0000 7fb2c6a00640 1 -- 172.21.15.55:0/2739566811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c00b34f0 msgr2=0x7fb2c015cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:41.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.095+0000 7fb2c6a00640 1 --2- 172.21.15.55:0/2739566811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c00b34f0 0x7fb2c015cf40 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000c820 tx=0x7fb2b000cce0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.095+0000 7fb2c6a00640 1 -- 172.21.15.55:0/2739566811 shutdown_connections 2024-04-02T07:34:41.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.095+0000 7fb2c6a00640 1 --2- 172.21.15.55:0/2739566811 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb29c0666c0 0x7fb29c068b80 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.095+0000 7fb2c6a00640 1 --2- 172.21.15.55:0/2739566811 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb2c0143f90 0x7fb2c0156b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.095+0000 7fb2c6a00640 1 --2- 172.21.15.55:0/2739566811 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb2c00cda80 0x7fb2c013b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.095+0000 7fb2c6a00640 1 --2- 172.21.15.55:0/2739566811 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb2c00b34f0 0x7fb2c015cf40 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.095+0000 7fb2c6a00640 1 -- 172.21.15.55:0/2739566811 >> 172.21.15.55:0/2739566811 conn(0x7fb2c0066080 msgr2=0x7fb2c00b1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:41.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.095+0000 7fb2c6a00640 1 -- 172.21.15.55:0/2739566811 shutdown_connections 2024-04-02T07:34:41.094 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.095+0000 7fb2c6a00640 1 -- 172.21.15.55:0/2739566811 wait complete. 2024-04-02T07:34:41.113 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-02T07:34:41.113 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:34:41.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.255+0000 7f6174000640 1 Processor -- start 2024-04-02T07:34:41.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.255+0000 7f6174000640 1 -- start start 2024-04-02T07:34:41.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.255+0000 7f6174000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f616c0b0040 0x7f616c06b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:41.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.255+0000 7f6174000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c15ce50 con 0x7f616c15ca70 2024-04-02T07:34:41.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.255+0000 7f6174000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c0cef60 con 0x7f616c099120 2024-04-02T07:34:41.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.255+0000 7f6174000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616c06bd60 con 0x7f616c0b0040 2024-04-02T07:34:41.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.255+0000 7f6171600640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f616c15ca70 0x7f616c098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45588/0 (socket says 172.21.15.55:45588) 2024-04-02T07:34:41.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.255+0000 7f6171600640 1 -- 172.21.15.55:0/66505145 learned_addr learned my addr 172.21.15.55:0/66505145 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:41.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.255+0000 7f6172000640 1 --2- 172.21.15.55:0/66505145 >> v2:172.21.15.106:3300/0 conn(0x7f616c0b0040 0x7f616c06b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:41.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.255+0000 7f616be00640 1 -- 172.21.15.55:0/66505145 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3028030718 0 0) 0x7f616c15ce50 con 0x7f616c15ca70 2024-04-02T07:34:41.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.255+0000 7f616be00640 1 -- 172.21.15.55:0/66505145 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6154003530 con 0x7f616c15ca70 2024-04-02T07:34:41.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.255+0000 7f6172000640 1 -- 172.21.15.55:0/66505145 >> v1:172.21.15.106:6789/0 conn(0x7f616c099120 legacy=0x7f616c06aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:41.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.255+0000 7f6172000640 1 -- 172.21.15.55:0/66505145 >> v1:172.21.15.55:6789/0 conn(0x7f616c15ca70 legacy=0x7f616c098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:41.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.255+0000 7f6172000640 1 -- 172.21.15.55:0/66505145 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c06c040 con 0x7f616c0b0040 2024-04-02T07:34:41.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.259+0000 7f6172000640 1 --2- 172.21.15.55:0/66505145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f616c0b0040 0x7f616c06b700 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6164009d90 tx=0x7f616401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85caba8bea11e540 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:41.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.259+0000 7f616be00640 1 -- 172.21.15.55:0/66505145 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61640a5940 con 0x7f616c0b0040 2024-04-02T07:34:41.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.259+0000 7f616be00640 1 -- 172.21.15.55:0/66505145 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61640a5aa0 con 0x7f616c0b0040 2024-04-02T07:34:41.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.259+0000 7f616be00640 1 -- 172.21.15.55:0/66505145 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61640a5e30 con 0x7f616c0b0040 2024-04-02T07:34:41.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.259+0000 7f6174000640 1 -- 172.21.15.55:0/66505145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f616c0b0040 msgr2=0x7f616c06b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:41.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.259+0000 7f6174000640 1 --2- 172.21.15.55:0/66505145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f616c0b0040 0x7f616c06b700 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6164009d90 tx=0x7f616401c970 comp rx=0 tx=0).stop 2024-04-02T07:34:41.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.259+0000 7f6174000640 1 -- 172.21.15.55:0/66505145 shutdown_connections 2024-04-02T07:34:41.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.259+0000 7f6174000640 1 --2- 172.21.15.55:0/66505145 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f616c0b0040 0x7f616c06b700 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.259+0000 7f6174000640 1 -- 172.21.15.55:0/66505145 >> 172.21.15.55:0/66505145 conn(0x7f616c0b21d0 msgr2=0x7f616c0b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:41.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.259+0000 7f6174000640 1 -- 172.21.15.55:0/66505145 shutdown_connections 2024-04-02T07:34:41.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.259+0000 7f6174000640 1 -- 172.21.15.55:0/66505145 wait complete. 2024-04-02T07:34:41.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6174000640 1 Processor -- start 2024-04-02T07:34:41.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6174000640 1 -- start start 2024-04-02T07:34:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6174000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f616c099120 0x7f616c148da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6174000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f616c0b0040 0x7f616c0aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:41.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6174000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f616c15ca70 0x7f616c0c4800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:41.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6174000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c14a070 con 0x7f616c0b0040 2024-04-02T07:34:41.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6174000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c0af930 con 0x7f616c15ca70 2024-04-02T07:34:41.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6174000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616c149460 con 0x7f616c099120 2024-04-02T07:34:41.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6170c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f616c0b0040 0x7f616c0aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:41.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6171600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f616c099120 0x7f616c148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:41.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6170c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f616c0b0040 0x7f616c0aeac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33792/0 (socket says 172.21.15.55:33792) 2024-04-02T07:34:41.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6170c00640 1 -- 172.21.15.55:0/1583395095 learned_addr learned my addr 172.21.15.55:0/1583395095 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:41.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6172000640 1 --2- 172.21.15.55:0/1583395095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f616c15ca70 0x7f616c0c4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:41.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6170c00640 1 -- 172.21.15.55:0/1583395095 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f616c099120 msgr2=0x7f616c148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:41.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6170c00640 1 --2- 172.21.15.55:0/1583395095 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f616c099120 0x7f616c148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6170c00640 1 -- 172.21.15.55:0/1583395095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f616c15ca70 msgr2=0x7f616c0c4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:41.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6170c00640 1 --2- 172.21.15.55:0/1583395095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f616c15ca70 0x7f616c0c4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6170c00640 1 -- 172.21.15.55:0/1583395095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6164009a70 con 0x7f616c0b0040 2024-04-02T07:34:41.264 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6170c00640 1 --2- 172.21.15.55:0/1583395095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f616c0b0040 0x7f616c0aeac0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f615800c420 tx=0x7f615800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:41.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6169600640 1 -- 172.21.15.55:0/1583395095 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61580052d0 con 0x7f616c0b0040 2024-04-02T07:34:41.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6169600640 1 -- 172.21.15.55:0/1583395095 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6158005430 con 0x7f616c0b0040 2024-04-02T07:34:41.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6169600640 1 -- 172.21.15.55:0/1583395095 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6158007260 con 0x7f616c0b0040 2024-04-02T07:34:41.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6174000640 1 -- 172.21.15.55:0/1583395095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616c149740 con 0x7f616c0b0040 2024-04-02T07:34:41.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.263+0000 7f6174000640 1 -- 172.21.15.55:0/1583395095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616c149d00 con 0x7f616c0b0040 2024-04-02T07:34:41.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.267+0000 7f6174000640 1 -- 172.21.15.55:0/1583395095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616c14a1e0 con 0x7f616c0b0040 2024-04-02T07:34:41.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.267+0000 7f6169600640 1 -- 172.21.15.55:0/1583395095 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f61580073c0 con 0x7f616c0b0040 2024-04-02T07:34:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.267+0000 7f6169600640 1 --2- 172.21.15.55:0/1583395095 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f614c066690 0x7f614c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.267+0000 7f6169600640 1 -- 172.21.15.55:0/1583395095 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f6158083640 con 0x7f616c0b0040 2024-04-02T07:34:41.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.267+0000 7f6171600640 1 --2- 172.21.15.55:0/1583395095 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f614c066690 0x7f614c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:41.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.267+0000 7f6171600640 1 --2- 172.21.15.55:0/1583395095 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f614c066690 0x7f614c068b50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f61600011f0 tx=0x7f6160007d40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:41.270 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.271+0000 7f6169600640 1 -- 172.21.15.55:0/1583395095 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f61580508d0 con 0x7f616c0b0040 2024-04-02T07:34:41.467 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.467+0000 7f6174000640 1 -- 172.21.15.55:0/1583395095 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f616c066c90 con 0x7f616c0b0040 2024-04-02T07:34:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.467+0000 7f6169600640 1 -- 172.21.15.55:0/1583395095 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4747 (secure 0 0 0) 0x7f6158053ef0 con 0x7f616c0b0040 2024-04-02T07:34:41.468 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:41.468 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":109,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7592,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2292883244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2292883244},{"type":"v1","addr":"172.21.15.106:6836","nonce":2292883244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":7835,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3165795379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3165795379},{"type":"v1","addr":"172.21.15.106:6837","nonce":3165795379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":9147,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2700619140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2700619140},{"type":"v1","addr":"172.21.15.55:6834","nonce":2700619140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:33:27.846433+0000","modified":"2024-04-02T07:34:30.606280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9717":{"gid":9717,"name":"a","rank":0,"incarnation":106,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6835/1279080129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1279080129},{"type":"v1","addr":"172.21.15.55:6835","nonce":1279080129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-02T07:34:41.468 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 109 2024-04-02T07:34:41.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.471+0000 7f6174000640 1 -- 172.21.15.55:0/1583395095 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f614c066690 msgr2=0x7f614c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:41.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.471+0000 7f6174000640 1 --2- 172.21.15.55:0/1583395095 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f614c066690 0x7f614c068b50 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f61600011f0 tx=0x7f6160007d40 comp rx=0 tx=0).stop 2024-04-02T07:34:41.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.471+0000 7f6174000640 1 -- 172.21.15.55:0/1583395095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f616c0b0040 msgr2=0x7f616c0aeac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:41.470 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.471+0000 7f6174000640 1 --2- 172.21.15.55:0/1583395095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f616c0b0040 0x7f616c0aeac0 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f615800c420 tx=0x7f615800c8e0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.471+0000 7f6174000640 1 -- 172.21.15.55:0/1583395095 shutdown_connections 2024-04-02T07:34:41.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.471+0000 7f6174000640 1 --2- 172.21.15.55:0/1583395095 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f614c066690 0x7f614c068b50 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.471+0000 7f6174000640 1 --2- 172.21.15.55:0/1583395095 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f616c15ca70 0x7f616c0c4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.471+0000 7f6174000640 1 --2- 172.21.15.55:0/1583395095 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f616c0b0040 0x7f616c0aeac0 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.471+0000 7f6174000640 1 --2- 172.21.15.55:0/1583395095 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f616c099120 0x7f616c148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.471+0000 7f6174000640 1 -- 172.21.15.55:0/1583395095 >> 172.21.15.55:0/1583395095 conn(0x7f616c0b21d0 msgr2=0x7f616c0cd6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:41.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.471+0000 7f6174000640 1 -- 172.21.15.55:0/1583395095 shutdown_connections 2024-04-02T07:34:41.471 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.471+0000 7f6174000640 1 -- 172.21.15.55:0/1583395095 wait complete. 2024-04-02T07:34:41.490 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:34:41.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff024c00640 1 Processor -- start 2024-04-02T07:34:41.629 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff024c00640 1 -- start start 2024-04-02T07:34:41.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff024c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff020153ea0 0x7ff0200c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:41.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff024c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7ff02015a040 0x7ff02013d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:41.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff024c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff02013d0c0 con 0x7ff020159be0 2024-04-02T07:34:41.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff024c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff02015a4f0 con 0x7ff02015a040 2024-04-02T07:34:41.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff024c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff02015a7d0 con 0x7ff020153ea0 2024-04-02T07:34:41.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff017e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff020159be0 0x7ff0200b31b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45600/0 (socket says 172.21.15.55:45600) 2024-04-02T07:34:41.631 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff017e00640 1 -- 172.21.15.55:0/2031741510 learned_addr learned my addr 172.21.15.55:0/2031741510 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:41.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff01e800640 1 --2- 172.21.15.55:0/2031741510 >> v2:172.21.15.106:3300/0 conn(0x7ff02015a040 0x7ff02013d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:41.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff01de00640 1 --2- 172.21.15.55:0/2031741510 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff020153ea0 0x7ff0200c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:41.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff01d400640 1 -- 172.21.15.55:0/2031741510 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1897353445 0 0) 0x7ff02013d0c0 con 0x7ff020159be0 2024-04-02T07:34:41.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff01d400640 1 -- 172.21.15.55:0/2031741510 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff004003510 con 0x7ff020159be0 2024-04-02T07:34:41.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff01d400640 1 -- 172.21.15.55:0/2031741510 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1710860988 0 0) 0x7ff004003510 con 0x7ff020159be0 2024-04-02T07:34:41.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff01d400640 1 -- 172.21.15.55:0/2031741510 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff020153ea0 msgr2=0x7ff0200c4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:41.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff01d400640 1 --2- 172.21.15.55:0/2031741510 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff020153ea0 0x7ff0200c4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff01d400640 1 -- 172.21.15.55:0/2031741510 >> v2:172.21.15.106:3300/0 conn(0x7ff02015a040 msgr2=0x7ff02013d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:41.633 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff01d400640 1 --2- 172.21.15.55:0/2031741510 >> v2:172.21.15.106:3300/0 conn(0x7ff02015a040 0x7ff02013d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff01d400640 1 -- 172.21.15.55:0/2031741510 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff02015aab0 con 0x7ff020159be0 2024-04-02T07:34:41.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff01d400640 1 -- 172.21.15.55:0/2031741510 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7ff008001680 con 0x7ff020159be0 2024-04-02T07:34:41.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff01d400640 1 -- 172.21.15.55:0/2031741510 >> v1:172.21.15.55:6789/0 conn(0x7ff020159be0 legacy=0x7ff0200b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:41.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff01d400640 1 --2- 172.21.15.55:0/2031741510 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff004004b40 0x7ff004004f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:41.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff01d400640 1 --2- 172.21.15.55:0/2031741510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff004003750 0x7ff004003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:41.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff01d400640 1 --2- 172.21.15.55:0/2031741510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff004004180 0x7ff00400b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:41.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff01d400640 1 -- 172.21.15.55:0/2031741510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02015a4f0 con 0x7ff004004180 2024-04-02T07:34:41.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff01d400640 1 -- 172.21.15.55:0/2031741510 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff02015a7d0 con 0x7ff004003750 2024-04-02T07:34:41.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.631+0000 7ff01d400640 1 -- 172.21.15.55:0/2031741510 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00400be90 con 0x7ff004004b40 2024-04-02T07:34:41.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.635+0000 7ff01e800640 1 --2- 172.21.15.55:0/2031741510 >> v2:172.21.15.106:3300/0 conn(0x7ff02015a040 0x7ff02013d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:34:41.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.635+0000 7ff01de00640 1 --2- 172.21.15.55:0/2031741510 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff004004b40 0x7ff004004f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:41.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.635+0000 7ff01e800640 1 --2- 172.21.15.55:0/2031741510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff004004180 0x7ff00400b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:41.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.635+0000 7ff017e00640 1 --2- 172.21.15.55:0/2031741510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff004003750 0x7ff004003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:41.634 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.635+0000 7ff01e800640 1 -- 172.21.15.55:0/2031741510 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff004004b40 msgr2=0x7ff004004f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:41.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.635+0000 7ff01e800640 1 --2- 172.21.15.55:0/2031741510 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff004004b40 0x7ff004004f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.635+0000 7ff01e800640 1 -- 172.21.15.55:0/2031741510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff004003750 msgr2=0x7ff004003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:41.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.635+0000 7ff01e800640 1 --2- 172.21.15.55:0/2031741510 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff004003750 0x7ff004003bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.635+0000 7ff01e800640 1 -- 172.21.15.55:0/2031741510 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff004003510 con 0x7ff004004180 2024-04-02T07:34:41.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.635+0000 7ff01de00640 1 --2- 172.21.15.55:0/2031741510 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff004004b40 0x7ff004004f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:34:41.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.635+0000 7ff01e800640 1 --2- 172.21.15.55:0/2031741510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff004004180 0x7ff00400b690 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7ff020143340 tx=0x7ff01801ce20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0320cac6af765d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:41.635 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.635+0000 7ff01d400640 1 -- 172.21.15.55:0/2031741510 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0180a5e30 con 0x7ff004004180 2024-04-02T07:34:41.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.635+0000 7ff01d400640 1 -- 172.21.15.55:0/2031741510 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01800f040 con 0x7ff004004180 2024-04-02T07:34:41.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.635+0000 7ff01d400640 1 -- 172.21.15.55:0/2031741510 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0180ad680 con 0x7ff004004180 2024-04-02T07:34:41.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff024c00640 1 -- 172.21.15.55:0/2031741510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff004004180 msgr2=0x7ff00400b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:41.636 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff024c00640 1 --2- 172.21.15.55:0/2031741510 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff004004180 0x7ff00400b690 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7ff020143340 tx=0x7ff01801ce20 comp rx=0 tx=0).stop 2024-04-02T07:34:41.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff01e800640 1 -- 172.21.15.55:0/2031741510 reap_dead start 2024-04-02T07:34:41.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff024c00640 1 -- 172.21.15.55:0/2031741510 shutdown_connections 2024-04-02T07:34:41.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff024c00640 1 -- 172.21.15.55:0/2031741510 >> 172.21.15.55:0/2031741510 conn(0x7ff020066080 msgr2=0x7ff020069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:41.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff024c00640 1 -- 172.21.15.55:0/2031741510 shutdown_connections 2024-04-02T07:34:41.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff024c00640 1 -- 172.21.15.55:0/2031741510 wait complete. 2024-04-02T07:34:41.637 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff024c00640 1 Processor -- start 2024-04-02T07:34:41.638 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff024c00640 1 -- start start 2024-04-02T07:34:41.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff024c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff004004180 0x7ff0201528c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:41.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff024c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0200cd3b0 0x7ff0200cd810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:41.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff024c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0200cb210 0x7ff0200cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:41.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff024c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0200cdd50 con 0x7ff0200cd3b0 2024-04-02T07:34:41.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff024c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0200ccaf0 con 0x7ff0200cb210 2024-04-02T07:34:41.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff024c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0200cbf70 con 0x7ff004004180 2024-04-02T07:34:41.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff017e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0200cd3b0 0x7ff0200cd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:41.641 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff017e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0200cd3b0 0x7ff0200cd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33806/0 (socket says 172.21.15.55:33806) 2024-04-02T07:34:41.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff017e00640 1 -- 172.21.15.55:0/2032579299 learned_addr learned my addr 172.21.15.55:0/2032579299 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:41.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff01e800640 1 --2- 172.21.15.55:0/2032579299 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0200cb210 0x7ff0200cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:41.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff01de00640 1 --2- 172.21.15.55:0/2032579299 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff004004180 0x7ff0201528c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:41.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff017e00640 1 -- 172.21.15.55:0/2032579299 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff004004180 msgr2=0x7ff0201528c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:41.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff017e00640 1 --2- 172.21.15.55:0/2032579299 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff004004180 0x7ff0201528c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff017e00640 1 -- 172.21.15.55:0/2032579299 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0200cb210 msgr2=0x7ff0200cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:41.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff017e00640 1 --2- 172.21.15.55:0/2032579299 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0200cb210 0x7ff0200cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff017e00640 1 -- 172.21.15.55:0/2032579299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0200cc250 con 0x7ff0200cd3b0 2024-04-02T07:34:41.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff01e800640 1 --2- 172.21.15.55:0/2032579299 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0200cb210 0x7ff0200cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:41.642 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.639+0000 7ff017e00640 1 --2- 172.21.15.55:0/2032579299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0200cd3b0 0x7ff0200cd810 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7ff008007310 tx=0x7ff0080077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:41.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.643+0000 7ff016000640 1 -- 172.21.15.55:0/2032579299 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff008001660 con 0x7ff0200cd3b0 2024-04-02T07:34:41.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.643+0000 7ff016000640 1 -- 172.21.15.55:0/2032579299 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff00800f960 con 0x7ff0200cd3b0 2024-04-02T07:34:41.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.643+0000 7ff024c00640 1 -- 172.21.15.55:0/2032579299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0200cc530 con 0x7ff0200cd3b0 2024-04-02T07:34:41.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.643+0000 7ff016000640 1 -- 172.21.15.55:0/2032579299 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff00800fcd0 con 0x7ff0200cd3b0 2024-04-02T07:34:41.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.643+0000 7ff024c00640 1 -- 172.21.15.55:0/2032579299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff020152e00 con 0x7ff0200cd3b0 2024-04-02T07:34:41.643 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.643+0000 7ff024c00640 1 -- 172.21.15.55:0/2032579299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02006ad60 con 0x7ff0200cd3b0 2024-04-02T07:34:41.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.643+0000 7ff016000640 1 -- 172.21.15.55:0/2032579299 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff00801d460 con 0x7ff0200cd3b0 2024-04-02T07:34:41.644 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.643+0000 7ff016000640 1 --2- 172.21.15.55:0/2032579299 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feffc0666c0 0x7feffc068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:41.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.643+0000 7ff016000640 1 -- 172.21.15.55:0/2032579299 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7ff0080844a0 con 0x7ff0200cd3b0 2024-04-02T07:34:41.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.643+0000 7ff01de00640 1 --2- 172.21.15.55:0/2032579299 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feffc0666c0 0x7feffc068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:41.645 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.643+0000 7ff01de00640 1 --2- 172.21.15.55:0/2032579299 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feffc0666c0 0x7feffc068b80 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff02006e720 tx=0x7ff01000f040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:41.646 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.647+0000 7ff016000640 1 -- 172.21.15.55:0/2032579299 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff008051710 con 0x7ff0200cd3b0 2024-04-02T07:34:41.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.843+0000 7ff024c00640 1 -- 172.21.15.55:0/2032579299 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff020066c90 con 0x7ff0200cd3b0 2024-04-02T07:34:41.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.843+0000 7ff016000640 1 -- 172.21.15.55:0/2032579299 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 109 v109) v1 ==== 95+0+4747 (secure 0 0 0) 0x7ff008054d30 con 0x7ff0200cd3b0 2024-04-02T07:34:41.843 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:41.843 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":109,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7592,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2292883244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2292883244},{"type":"v1","addr":"172.21.15.106:6836","nonce":2292883244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":7835,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3165795379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3165795379},{"type":"v1","addr":"172.21.15.106:6837","nonce":3165795379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":9147,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2700619140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2700619140},{"type":"v1","addr":"172.21.15.55:6834","nonce":2700619140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92}],"filesystems":[{"mdsmap":{"epoch":109,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-02T07:33:27.846433+0000","modified":"2024-04-02T07:34:30.606280+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":120,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9717},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9717":{"gid":9717,"name":"a","rank":0,"incarnation":106,"state":"up:active","state_seq":4,"addr":"172.21.15.55:6835/1279080129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":1279080129},{"type":"v1","addr":"172.21.15.55:6835","nonce":1279080129}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2024-04-02T07:34:41.843 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 109 2024-04-02T07:34:41.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.847+0000 7ff024c00640 1 -- 172.21.15.55:0/2032579299 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feffc0666c0 msgr2=0x7feffc068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:41.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.847+0000 7ff024c00640 1 --2- 172.21.15.55:0/2032579299 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feffc0666c0 0x7feffc068b80 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7ff02006e720 tx=0x7ff01000f040 comp rx=0 tx=0).stop 2024-04-02T07:34:41.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.847+0000 7ff024c00640 1 -- 172.21.15.55:0/2032579299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0200cd3b0 msgr2=0x7ff0200cd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:41.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.847+0000 7ff024c00640 1 --2- 172.21.15.55:0/2032579299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0200cd3b0 0x7ff0200cd810 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7ff008007310 tx=0x7ff0080077d0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.847+0000 7ff024c00640 1 -- 172.21.15.55:0/2032579299 shutdown_connections 2024-04-02T07:34:41.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.847+0000 7ff024c00640 1 --2- 172.21.15.55:0/2032579299 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7feffc0666c0 0x7feffc068b80 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.847+0000 7ff024c00640 1 --2- 172.21.15.55:0/2032579299 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff0200cb210 0x7ff0200cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.847+0000 7ff024c00640 1 --2- 172.21.15.55:0/2032579299 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff0200cd3b0 0x7ff0200cd810 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.845 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.847+0000 7ff024c00640 1 --2- 172.21.15.55:0/2032579299 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff004004180 0x7ff0201528c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:41.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.847+0000 7ff024c00640 1 -- 172.21.15.55:0/2032579299 >> 172.21.15.55:0/2032579299 conn(0x7ff020066080 msgr2=0x7ff020071d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:41.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.847+0000 7ff024c00640 1 -- 172.21.15.55:0/2032579299 shutdown_connections 2024-04-02T07:34:41.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:41.847+0000 7ff024c00640 1 -- 172.21.15.55:0/2032579299 wait complete. 2024-04-02T07:34:41.863 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:34:42.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.003+0000 7fa8a7200640 1 Processor -- start 2024-04-02T07:34:42.003 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.003+0000 7fa8a7200640 1 -- start start 2024-04-02T07:34:42.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a7200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8a8160430 0x7fa8a8160810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:42.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a7200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a806e390 con 0x7fa8a8099420 2024-04-02T07:34:42.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a7200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a8161270 con 0x7fa8a8099840 2024-04-02T07:34:42.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a7200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a8160d50 con 0x7fa8a8160430 2024-04-02T07:34:42.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa89d400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa8a8099420 0x7fa8a815cda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45602/0 (socket says 172.21.15.55:45602) 2024-04-02T07:34:42.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa89d400640 1 -- 172.21.15.55:0/1078704307 learned_addr learned my addr 172.21.15.55:0/1078704307 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:42.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5e00640 1 --2- 172.21.15.55:0/1078704307 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8a8160430 0x7fa8a8160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:42.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5400640 1 -- 172.21.15.55:0/1078704307 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2002850539 0 0) 0x7fa8a806e390 con 0x7fa8a8099420 2024-04-02T07:34:42.005 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5400640 1 -- 172.21.15.55:0/1078704307 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa88c003530 con 0x7fa8a8099420 2024-04-02T07:34:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5400640 1 -- 172.21.15.55:0/1078704307 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 454197313 0 0) 0x7fa88c003530 con 0x7fa8a8099420 2024-04-02T07:34:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5400640 1 -- 172.21.15.55:0/1078704307 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8a8160430 msgr2=0x7fa8a8160810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5400640 1 --2- 172.21.15.55:0/1078704307 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8a8160430 0x7fa8a8160810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5400640 1 -- 172.21.15.55:0/1078704307 >> v1:172.21.15.106:6789/0 conn(0x7fa8a8099840 legacy=0x7fa8a815d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5400640 1 -- 172.21.15.55:0/1078704307 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a806e5c0 con 0x7fa8a8099420 2024-04-02T07:34:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5400640 1 -- 172.21.15.55:0/1078704307 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7fa890001680 con 0x7fa8a8099420 2024-04-02T07:34:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5400640 1 -- 172.21.15.55:0/1078704307 >> v1:172.21.15.55:6789/0 conn(0x7fa8a8099420 legacy=0x7fa8a815cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5400640 1 --2- 172.21.15.55:0/1078704307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa88c0039b0 0x7fa88c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:42.007 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5400640 1 --2- 172.21.15.55:0/1078704307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa88c0047d0 0x7fa88c004c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5400640 1 --2- 172.21.15.55:0/1078704307 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8a8160430 0x7fa88c005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5400640 1 -- 172.21.15.55:0/1078704307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a8160d50 con 0x7fa88c0039b0 2024-04-02T07:34:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5400640 1 -- 172.21.15.55:0/1078704307 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c00ba40 con 0x7fa88c0047d0 2024-04-02T07:34:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5400640 1 -- 172.21.15.55:0/1078704307 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa88c00bc00 con 0x7fa8a8160430 2024-04-02T07:34:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5e00640 1 --2- 172.21.15.55:0/1078704307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa88c0039b0 0x7fa88c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa89d400640 1 --2- 172.21.15.55:0/1078704307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa88c0047d0 0x7fa88c004c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a6800640 1 --2- 172.21.15.55:0/1078704307 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8a8160430 0x7fa88c005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5e00640 1 -- 172.21.15.55:0/1078704307 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8a8160430 msgr2=0x7fa88c005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5e00640 1 --2- 172.21.15.55:0/1078704307 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa8a8160430 0x7fa88c005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5e00640 1 -- 172.21.15.55:0/1078704307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa88c0047d0 msgr2=0x7fa88c004c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5e00640 1 --2- 172.21.15.55:0/1078704307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa88c0047d0 0x7fa88c004c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa8a5e00640 1 -- 172.21.15.55:0/1078704307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa88c003530 con 0x7fa88c0039b0 2024-04-02T07:34:42.008 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.007+0000 7fa89d400640 1 --2- 172.21.15.55:0/1078704307 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa88c0047d0 0x7fa88c004c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:42.009 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.011+0000 7fa8a5e00640 1 --2- 172.21.15.55:0/1078704307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa88c0039b0 0x7fa88c003dd0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7fa898009ab0 tx=0x7fa89801ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4224692c40593529 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:42.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.011+0000 7fa8a5400640 1 -- 172.21.15.55:0/1078704307 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8980a55f0 con 0x7fa88c0039b0 2024-04-02T07:34:42.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.011+0000 7fa8a5400640 1 -- 172.21.15.55:0/1078704307 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8980a5750 con 0x7fa88c0039b0 2024-04-02T07:34:42.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.011+0000 7fa8a5400640 1 -- 172.21.15.55:0/1078704307 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8980a5b00 con 0x7fa88c0039b0 2024-04-02T07:34:42.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.011+0000 7fa8a7200640 1 -- 172.21.15.55:0/1078704307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa88c0039b0 msgr2=0x7fa88c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:42.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.011+0000 7fa8a7200640 1 --2- 172.21.15.55:0/1078704307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa88c0039b0 0x7fa88c003dd0 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7fa898009ab0 tx=0x7fa89801ca00 comp rx=0 tx=0).stop 2024-04-02T07:34:42.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.011+0000 7fa8a6800640 1 -- 172.21.15.55:0/1078704307 reap_dead start 2024-04-02T07:34:42.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.011+0000 7fa8a7200640 1 -- 172.21.15.55:0/1078704307 shutdown_connections 2024-04-02T07:34:42.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.011+0000 7fa8a7200640 1 -- 172.21.15.55:0/1078704307 >> 172.21.15.55:0/1078704307 conn(0x7fa8a80b1fb0 msgr2=0x7fa8a80b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:42.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.011+0000 7fa8a7200640 1 -- 172.21.15.55:0/1078704307 shutdown_connections 2024-04-02T07:34:42.010 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.011+0000 7fa8a7200640 1 -- 172.21.15.55:0/1078704307 wait complete. 2024-04-02T07:34:42.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.011+0000 7fa8a7200640 1 Processor -- start 2024-04-02T07:34:42.011 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.011+0000 7fa8a7200640 1 -- start start 2024-04-02T07:34:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa8a7200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa88c0039b0 0x7fa8a8157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa8a7200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8a815a4e0 0x7fa8a81549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa8a7200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8a806aea0 0x7fa8a806b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa8a7200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a815fb10 con 0x7fa8a815a4e0 2024-04-02T07:34:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa8a7200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a806b890 con 0x7fa8a806aea0 2024-04-02T07:34:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa8a7200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a8159b80 con 0x7fa88c0039b0 2024-04-02T07:34:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa89d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8a815a4e0 0x7fa8a81549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa89d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8a815a4e0 0x7fa8a81549e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33816/0 (socket says 172.21.15.55:33816) 2024-04-02T07:34:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa89d400640 1 -- 172.21.15.55:0/3625596038 learned_addr learned my addr 172.21.15.55:0/3625596038 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa8a5e00640 1 --2- 172.21.15.55:0/3625596038 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa88c0039b0 0x7fa8a8157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa8a6800640 1 --2- 172.21.15.55:0/3625596038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8a806aea0 0x7fa8a806b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:42.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa89d400640 1 -- 172.21.15.55:0/3625596038 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa88c0039b0 msgr2=0x7fa8a8157120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa89d400640 1 --2- 172.21.15.55:0/3625596038 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa88c0039b0 0x7fa8a8157120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa89d400640 1 -- 172.21.15.55:0/3625596038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8a806aea0 msgr2=0x7fa8a806b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa89d400640 1 --2- 172.21.15.55:0/3625596038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8a806aea0 0x7fa8a806b350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa89d400640 1 -- 172.21.15.55:0/3625596038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a81595c0 con 0x7fa8a815a4e0 2024-04-02T07:34:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa89d400640 1 --2- 172.21.15.55:0/3625596038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8a815a4e0 0x7fa8a81549e0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fa890001bc0 tx=0x7fa89000ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa89ea00640 1 -- 172.21.15.55:0/3625596038 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89000c8a0 con 0x7fa8a815a4e0 2024-04-02T07:34:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa89ea00640 1 -- 172.21.15.55:0/3625596038 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89000ca00 con 0x7fa8a815a4e0 2024-04-02T07:34:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa89ea00640 1 -- 172.21.15.55:0/3625596038 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89000cd70 con 0x7fa8a815a4e0 2024-04-02T07:34:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa8a7200640 1 -- 172.21.15.55:0/3625596038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a81598a0 con 0x7fa8a815a4e0 2024-04-02T07:34:42.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa8a7200640 1 -- 172.21.15.55:0/3625596038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a8155660 con 0x7fa8a815a4e0 2024-04-02T07:34:42.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa8a7200640 1 -- 172.21.15.55:0/3625596038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a8155880 con 0x7fa8a815a4e0 2024-04-02T07:34:42.016 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.015+0000 7fa89ea00640 1 -- 172.21.15.55:0/3625596038 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa890013420 con 0x7fa8a815a4e0 2024-04-02T07:34:42.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.019+0000 7fa89ea00640 1 --2- 172.21.15.55:0/3625596038 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8840666c0 0x7fa884068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:42.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.019+0000 7fa89ea00640 1 -- 172.21.15.55:0/3625596038 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7fa890083d90 con 0x7fa8a815a4e0 2024-04-02T07:34:42.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.019+0000 7fa8a5e00640 1 --2- 172.21.15.55:0/3625596038 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8840666c0 0x7fa884068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:42.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.019+0000 7fa8a5e00640 1 --2- 172.21.15.55:0/3625596038 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8840666c0 0x7fa884068b80 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa8980af000 tx=0x7fa8980046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:42.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.023+0000 7fa89ea00640 1 -- 172.21.15.55:0/3625596038 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa890051150 con 0x7fa8a815a4e0 2024-04-02T07:34:42.181 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.183+0000 7fa8a7200640 1 -- 172.21.15.55:0/3625596038 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa8a8073fa0 con 0x7fa8a815a4e0 2024-04-02T07:34:42.183 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.183+0000 7fa89ea00640 1 -- 172.21.15.55:0/3625596038 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v120) v1 ==== 74+0+16409 (secure 0 0 0) 0x7fa890054770 con 0x7fa8a815a4e0 2024-04-02T07:34:42.183 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:42.183 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":120,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:34:25.539106+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-04-02T07:33:26.384276+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"115","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-04-02T07:33:26.835969+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.7","mappings":[{"from":0,"to":5}]},{"pgid":"17.21","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6835/154663344":"2024-04-03T07:34:25.539082+0000","172.21.15.55:6832/154663344":"2024-04-03T07:34:25.539082+0000","172.21.15.106:6837/775582321":"2024-04-03T07:34:04.807966+0000","172.21.15.106:6834/775582321":"2024-04-03T07:34:04.807966+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:34:42.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.187+0000 7fa8a7200640 1 -- 172.21.15.55:0/3625596038 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8840666c0 msgr2=0x7fa884068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:42.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.187+0000 7fa8a7200640 1 --2- 172.21.15.55:0/3625596038 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8840666c0 0x7fa884068b80 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa8980af000 tx=0x7fa8980046d0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.187+0000 7fa8a7200640 1 -- 172.21.15.55:0/3625596038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8a815a4e0 msgr2=0x7fa8a81549e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:42.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.187+0000 7fa8a7200640 1 --2- 172.21.15.55:0/3625596038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8a815a4e0 0x7fa8a81549e0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7fa890001bc0 tx=0x7fa89000ed50 comp rx=0 tx=0).stop 2024-04-02T07:34:42.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.187+0000 7fa8a7200640 1 -- 172.21.15.55:0/3625596038 shutdown_connections 2024-04-02T07:34:42.185 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.187+0000 7fa8a7200640 1 --2- 172.21.15.55:0/3625596038 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa8840666c0 0x7fa884068b80 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.187+0000 7fa8a7200640 1 --2- 172.21.15.55:0/3625596038 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa8a806aea0 0x7fa8a806b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.187+0000 7fa8a7200640 1 --2- 172.21.15.55:0/3625596038 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8a815a4e0 0x7fa8a81549e0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.187+0000 7fa8a7200640 1 --2- 172.21.15.55:0/3625596038 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa88c0039b0 0x7fa8a8157120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.187+0000 7fa8a7200640 1 -- 172.21.15.55:0/3625596038 >> 172.21.15.55:0/3625596038 conn(0x7fa8a80b1fb0 msgr2=0x7fa8a806c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:42.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.187+0000 7fa8a7200640 1 -- 172.21.15.55:0/3625596038 shutdown_connections 2024-04-02T07:34:42.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.187+0000 7fa8a7200640 1 -- 172.21.15.55:0/3625596038 wait complete. 2024-04-02T07:34:42.205 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-02T07:34:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.347+0000 7f1c69000640 1 Processor -- start 2024-04-02T07:34:42.347 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.347+0000 7f1c69000640 1 -- start start 2024-04-02T07:34:42.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.351+0000 7f1c69000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c64098a10 0x7f1c640b1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:42.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.351+0000 7f1c69000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1c640cf420 0x7f1c640b3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:42.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.351+0000 7f1c69000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c640b1e30 con 0x7f1c64098df0 2024-04-02T07:34:42.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.351+0000 7f1c69000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c64099dc0 con 0x7f1c640cf420 2024-04-02T07:34:42.348 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.351+0000 7f1c69000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c640ce170 con 0x7f1c64098a10 2024-04-02T07:34:42.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.351+0000 7f1c5aa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1c640cf420 0x7f1c640b3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:42.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.351+0000 7f1c5aa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1c640cf420 0x7f1c640b3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33822/0 (socket says 172.21.15.55:33822) 2024-04-02T07:34:42.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.351+0000 7f1c5aa00640 1 -- 172.21.15.55:0/603527397 learned_addr learned my addr 172.21.15.55:0/603527397 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:42.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.351+0000 7f1c63400640 1 --2- 172.21.15.55:0/603527397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c64098a10 0x7f1c640b1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:42.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.351+0000 7f1c5aa00640 1 -- 172.21.15.55:0/603527397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c64098a10 msgr2=0x7f1c640b1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:42.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.351+0000 7f1c5aa00640 1 --2- 172.21.15.55:0/603527397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c64098a10 0x7f1c640b1150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.351+0000 7f1c5aa00640 1 -- 172.21.15.55:0/603527397 >> v1:172.21.15.106:6789/0 conn(0x7f1c64098df0 legacy=0x7f1c640cb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:42.349 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.351+0000 7f1c5aa00640 1 -- 172.21.15.55:0/603527397 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c640ce450 con 0x7f1c640cf420 2024-04-02T07:34:42.351 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.351+0000 7f1c5aa00640 1 --2- 172.21.15.55:0/603527397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c640cf420 0x7f1c640b3350 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c009870 tx=0x7f1c4c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37e2869c925dbb5c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:42.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c62a00640 1 -- 172.21.15.55:0/603527397 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c0a6040 con 0x7f1c640cf420 2024-04-02T07:34:42.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c62a00640 1 -- 172.21.15.55:0/603527397 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c4c0aa600 con 0x7f1c640cf420 2024-04-02T07:34:42.352 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c62a00640 1 -- 172.21.15.55:0/603527397 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c4c0aa990 con 0x7f1c640cf420 2024-04-02T07:34:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c69000640 1 -- 172.21.15.55:0/603527397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c640cf420 msgr2=0x7f1c640b3350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c69000640 1 --2- 172.21.15.55:0/603527397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c640cf420 0x7f1c640b3350 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c009870 tx=0x7f1c4c01c4a0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c69000640 1 -- 172.21.15.55:0/603527397 shutdown_connections 2024-04-02T07:34:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c69000640 1 --2- 172.21.15.55:0/603527397 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c640cf420 0x7f1c640b3350 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c69000640 1 --2- 172.21.15.55:0/603527397 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c64098a10 0x7f1c640b1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c69000640 1 -- 172.21.15.55:0/603527397 >> 172.21.15.55:0/603527397 conn(0x7f1c640ccf80 msgr2=0x7f1c640cd390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c69000640 1 -- 172.21.15.55:0/603527397 shutdown_connections 2024-04-02T07:34:42.353 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c69000640 1 -- 172.21.15.55:0/603527397 wait complete. 2024-04-02T07:34:42.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c69000640 1 Processor -- start 2024-04-02T07:34:42.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c69000640 1 -- start start 2024-04-02T07:34:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c69000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c64098a10 0x7f1c641630b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c69000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c64098df0 0x7f1c6414f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:42.355 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c69000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c640cf420 0x7f1c64158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:42.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c69000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64164a80 con 0x7f1c640cf420 2024-04-02T07:34:42.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c69000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6414fa70 con 0x7f1c64098a10 2024-04-02T07:34:42.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c69000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c64163770 con 0x7f1c64098df0 2024-04-02T07:34:42.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c63e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c640cf420 0x7f1c64158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:42.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c63e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c640cf420 0x7f1c64158970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33832/0 (socket says 172.21.15.55:33832) 2024-04-02T07:34:42.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c63e00640 1 -- 172.21.15.55:0/726732779 learned_addr learned my addr 172.21.15.55:0/726732779 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:42.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c63400640 1 --2- 172.21.15.55:0/726732779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c64098a10 0x7f1c641630b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:42.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.355+0000 7f1c5aa00640 1 --2- 172.21.15.55:0/726732779 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c64098df0 0x7f1c6414f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:42.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.359+0000 7f1c63e00640 1 -- 172.21.15.55:0/726732779 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c64098df0 msgr2=0x7f1c6414f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:42.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.359+0000 7f1c63e00640 1 --2- 172.21.15.55:0/726732779 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c64098df0 0x7f1c6414f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.359+0000 7f1c63e00640 1 -- 172.21.15.55:0/726732779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c64098a10 msgr2=0x7f1c641630b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.359+0000 7f1c63e00640 1 --2- 172.21.15.55:0/726732779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c64098a10 0x7f1c641630b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.359+0000 7f1c63e00640 1 -- 172.21.15.55:0/726732779 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c0094d0 con 0x7f1c640cf420 2024-04-02T07:34:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.359+0000 7f1c63e00640 1 --2- 172.21.15.55:0/726732779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c640cf420 0x7f1c64158970 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00c730 tx=0x7f1c5c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.359+0000 7f1c5be00640 1 -- 172.21.15.55:0/726732779 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c003b80 con 0x7f1c640cf420 2024-04-02T07:34:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.359+0000 7f1c5be00640 1 -- 172.21.15.55:0/726732779 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c5c003ce0 con 0x7f1c640cf420 2024-04-02T07:34:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.359+0000 7f1c69000640 1 -- 172.21.15.55:0/726732779 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c64163a50 con 0x7f1c640cf420 2024-04-02T07:34:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.359+0000 7f1c5be00640 1 -- 172.21.15.55:0/726732779 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5c00aa30 con 0x7f1c640cf420 2024-04-02T07:34:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.359+0000 7f1c69000640 1 -- 172.21.15.55:0/726732779 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c64164010 con 0x7f1c640cf420 2024-04-02T07:34:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.359+0000 7f1c69000640 1 -- 172.21.15.55:0/726732779 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c640d01f0 con 0x7f1c640cf420 2024-04-02T07:34:42.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.359+0000 7f1c5be00640 1 -- 172.21.15.55:0/726732779 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1c5c00ab90 con 0x7f1c640cf420 2024-04-02T07:34:42.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.359+0000 7f1c5be00640 1 --2- 172.21.15.55:0/726732779 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1c40066690 0x7f1c40068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:42.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.363+0000 7f1c5be00640 1 -- 172.21.15.55:0/726732779 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5939+0+0 (secure 0 0 0) 0x7f1c5c083fe0 con 0x7f1c640cf420 2024-04-02T07:34:42.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.363+0000 7f1c63400640 1 --2- 172.21.15.55:0/726732779 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1c40066690 0x7f1c40068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:42.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.363+0000 7f1c63400640 1 --2- 172.21.15.55:0/726732779 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1c40066690 0x7f1c40068b50 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f1c540079c0 tx=0x7f1c54008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.363+0000 7f1c5be00640 1 -- 172.21.15.55:0/726732779 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f1c5c051240 con 0x7f1c640cf420 2024-04-02T07:34:42.559 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.559+0000 7f1c69000640 1 -- 172.21.15.55:0/726732779 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f1c64073fa0 con 0x7f1c640cf420 2024-04-02T07:34:42.560 INFO:tasks.ceph.mon.a.smithi055.stderr:2024-04-02T07:34:42.563+0000 7f8f18800640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-02T07:34:42.573 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.575+0000 7f1c5be00640 1 -- 172.21.15.55:0/726732779 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v110) v1 ==== 161+0+0 (secure 0 0 0) 0x7f1c5c054860 con 0x7f1c640cf420 2024-04-02T07:34:42.573 INFO:teuthology.orchestra.run.smithi055.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-02T07:34:42.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.575+0000 7f1c69000640 1 -- 172.21.15.55:0/726732779 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1c40066690 msgr2=0x7f1c40068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:42.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.575+0000 7f1c69000640 1 --2- 172.21.15.55:0/726732779 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1c40066690 0x7f1c40068b50 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f1c540079c0 tx=0x7f1c54008040 comp rx=0 tx=0).stop 2024-04-02T07:34:42.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.575+0000 7f1c69000640 1 -- 172.21.15.55:0/726732779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c640cf420 msgr2=0x7f1c64158970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:42.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.575+0000 7f1c69000640 1 --2- 172.21.15.55:0/726732779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c640cf420 0x7f1c64158970 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f1c5c00c730 tx=0x7f1c5c00cbf0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.575+0000 7f1c69000640 1 -- 172.21.15.55:0/726732779 shutdown_connections 2024-04-02T07:34:42.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.575+0000 7f1c69000640 1 --2- 172.21.15.55:0/726732779 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c640cf420 0x7f1c64158970 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.575+0000 7f1c69000640 1 --2- 172.21.15.55:0/726732779 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c64098df0 0x7f1c6414f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.575+0000 7f1c69000640 1 --2- 172.21.15.55:0/726732779 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1c40066690 0x7f1c40068b50 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.575+0000 7f1c69000640 1 --2- 172.21.15.55:0/726732779 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c64098a10 0x7f1c641630b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.575+0000 7f1c69000640 1 -- 172.21.15.55:0/726732779 >> 172.21.15.55:0/726732779 conn(0x7f1c640ccf80 msgr2=0x7f1c6415b8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:42.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.575+0000 7f1c69000640 1 -- 172.21.15.55:0/726732779 shutdown_connections 2024-04-02T07:34:42.577 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.575+0000 7f1c69000640 1 -- 172.21.15.55:0/726732779 wait complete. 2024-04-02T07:34:42.580 INFO:tasks.ceph.mds.a.smithi055.stderr: -1377> 2024-04-02T07:34:31.567+0000 7fa686000640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-02T07:34:42.596 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-02T07:34:42.622 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2024-04-02T07:34:42.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.739+0000 7fdc7f400640 1 Processor -- start 2024-04-02T07:34:42.739 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.739+0000 7fdc7f400640 1 -- start start 2024-04-02T07:34:42.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.743+0000 7fdc7f400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdc781590d0 0x7fdc780ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:42.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.743+0000 7fdc7f400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7815d640 con 0x7fdc7815cb10 2024-04-02T07:34:42.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.743+0000 7fdc7f400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc7815d920 con 0x7fdc780709b0 2024-04-02T07:34:42.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.743+0000 7fdc7f400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc780cd4e0 con 0x7fdc781590d0 2024-04-02T07:34:42.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.743+0000 7fdc77e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdc7815cb10 0x7fdc780702a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45604/0 (socket says 172.21.15.55:45604) 2024-04-02T07:34:42.741 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.743+0000 7fdc77e00640 1 -- 172.21.15.55:0/1155383538 learned_addr learned my addr 172.21.15.55:0/1155383538 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:42.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.743+0000 7fdc7ca00640 1 --2- 172.21.15.55:0/1155383538 >> v2:172.21.15.106:3300/0 conn(0x7fdc781590d0 0x7fdc780ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:42.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.743+0000 7fdc77400640 1 -- 172.21.15.55:0/1155383538 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2941891745 0 0) 0x7fdc7815d640 con 0x7fdc7815cb10 2024-04-02T07:34:42.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.743+0000 7fdc77400640 1 -- 172.21.15.55:0/1155383538 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc60003530 con 0x7fdc7815cb10 2024-04-02T07:34:42.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.743+0000 7fdc7ca00640 1 -- 172.21.15.55:0/1155383538 >> v1:172.21.15.106:6789/0 conn(0x7fdc780709b0 legacy=0x7fdc780b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:42.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.743+0000 7fdc77400640 1 -- 172.21.15.55:0/1155383538 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1334984374 0 0) 0x7fdc7815d920 con 0x7fdc780709b0 2024-04-02T07:34:42.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.743+0000 7fdc7ca00640 1 -- 172.21.15.55:0/1155383538 >> v1:172.21.15.55:6789/0 conn(0x7fdc7815cb10 legacy=0x7fdc780702a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:42.742 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.743+0000 7fdc7ca00640 1 -- 172.21.15.55:0/1155383538 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc780cc4c0 con 0x7fdc781590d0 2024-04-02T07:34:42.744 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.747+0000 7fdc7ca00640 1 --2- 172.21.15.55:0/1155383538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc781590d0 0x7fdc780ccfa0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0097c0 tx=0x7fdc6c01c3e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e10abf458d084ba server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:42.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.747+0000 7fdc77400640 1 -- 172.21.15.55:0/1155383538 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c0ad660 con 0x7fdc781590d0 2024-04-02T07:34:42.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.747+0000 7fdc77400640 1 -- 172.21.15.55:0/1155383538 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc6c0ad7c0 con 0x7fdc781590d0 2024-04-02T07:34:42.745 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.747+0000 7fdc77400640 1 -- 172.21.15.55:0/1155383538 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c0adb30 con 0x7fdc781590d0 2024-04-02T07:34:42.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.747+0000 7fdc7f400640 1 -- 172.21.15.55:0/1155383538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc781590d0 msgr2=0x7fdc780ccfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:42.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.747+0000 7fdc7f400640 1 --2- 172.21.15.55:0/1155383538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc781590d0 0x7fdc780ccfa0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0097c0 tx=0x7fdc6c01c3e0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.747+0000 7fdc7f400640 1 -- 172.21.15.55:0/1155383538 shutdown_connections 2024-04-02T07:34:42.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.747+0000 7fdc7f400640 1 --2- 172.21.15.55:0/1155383538 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc781590d0 0x7fdc780ccfa0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.747+0000 7fdc7f400640 1 -- 172.21.15.55:0/1155383538 >> 172.21.15.55:0/1155383538 conn(0x7fdc7806a390 msgr2=0x7fdc780b0370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:42.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.747+0000 7fdc7f400640 1 -- 172.21.15.55:0/1155383538 shutdown_connections 2024-04-02T07:34:42.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.747+0000 7fdc7f400640 1 -- 172.21.15.55:0/1155383538 wait complete. 2024-04-02T07:34:42.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.747+0000 7fdc7f400640 1 Processor -- start 2024-04-02T07:34:42.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.747+0000 7fdc7f400640 1 -- start start 2024-04-02T07:34:42.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc7f400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdc780709b0 0x7fdc781487a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:42.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc7f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc781590d0 0x7fdc78156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:42.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc7f400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc7815cb10 0x7fdc780af420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:42.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc7f400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc78148ce0 con 0x7fdc781590d0 2024-04-02T07:34:42.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc7f400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc78157660 con 0x7fdc7815cb10 2024-04-02T07:34:42.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc7f400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc78157940 con 0x7fdc780709b0 2024-04-02T07:34:42.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc77e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc781590d0 0x7fdc78156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:42.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc77e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc781590d0 0x7fdc78156c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33860/0 (socket says 172.21.15.55:33860) 2024-04-02T07:34:42.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc77e00640 1 -- 172.21.15.55:0/2625323352 learned_addr learned my addr 172.21.15.55:0/2625323352 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:42.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc7d400640 1 --2- 172.21.15.55:0/2625323352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc7815cb10 0x7fdc780af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:42.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc7ca00640 1 --2- 172.21.15.55:0/2625323352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdc780709b0 0x7fdc781487a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:42.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc77e00640 1 -- 172.21.15.55:0/2625323352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdc780709b0 msgr2=0x7fdc781487a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:42.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc77e00640 1 --2- 172.21.15.55:0/2625323352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdc780709b0 0x7fdc781487a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc77e00640 1 -- 172.21.15.55:0/2625323352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc7815cb10 msgr2=0x7fdc780af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:42.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc77e00640 1 --2- 172.21.15.55:0/2625323352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc7815cb10 0x7fdc780af420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:42.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc77e00640 1 -- 172.21.15.55:0/2625323352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc6c009420 con 0x7fdc781590d0 2024-04-02T07:34:42.750 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc77e00640 1 --2- 172.21.15.55:0/2625323352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc781590d0 0x7fdc78156c10 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400c3c0 tx=0x7fdc6400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:42.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc74c00640 1 -- 172.21.15.55:0/2625323352 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc64005cf0 con 0x7fdc781590d0 2024-04-02T07:34:42.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc74c00640 1 -- 172.21.15.55:0/2625323352 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc64005e50 con 0x7fdc781590d0 2024-04-02T07:34:42.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc74c00640 1 -- 172.21.15.55:0/2625323352 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc640072f0 con 0x7fdc781590d0 2024-04-02T07:34:42.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc7f400640 1 -- 172.21.15.55:0/2625323352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc780b1de0 con 0x7fdc781590d0 2024-04-02T07:34:42.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc7f400640 1 -- 172.21.15.55:0/2625323352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc78157f00 con 0x7fdc781590d0 2024-04-02T07:34:42.751 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc7f400640 1 -- 172.21.15.55:0/2625323352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc78073530 con 0x7fdc781590d0 2024-04-02T07:34:42.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.751+0000 7fdc74c00640 1 -- 172.21.15.55:0/2625323352 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fdc64007450 con 0x7fdc781590d0 2024-04-02T07:34:42.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.755+0000 7fdc74c00640 1 --2- 172.21.15.55:0/2625323352 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdc58066690 0x7fdc58068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:42.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.755+0000 7fdc74c00640 1 -- 172.21.15.55:0/2625323352 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6025+0+0 (secure 0 0 0) 0x7fdc640837f0 con 0x7fdc781590d0 2024-04-02T07:34:42.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.755+0000 7fdc7ca00640 1 --2- 172.21.15.55:0/2625323352 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdc58066690 0x7fdc58068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:42.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.755+0000 7fdc7ca00640 1 --2- 172.21.15.55:0/2625323352 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdc58066690 0x7fdc58068b50 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0af000 tx=0x7fdc6c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:42.756 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.759+0000 7fdc74c00640 1 -- 172.21.15.55:0/2625323352 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fdc64050ad0 con 0x7fdc781590d0 2024-04-02T07:34:42.949 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:42.951+0000 7fdc7f400640 1 -- 172.21.15.55:0/2625323352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fdc78066c90 con 0x7fdc781590d0 2024-04-02T07:34:43.576 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.575+0000 7fdc74c00640 1 -- 172.21.15.55:0/2625323352 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v111) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdc640170a0 con 0x7fdc781590d0 2024-04-02T07:34:43.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.579+0000 7fdc7f400640 1 -- 172.21.15.55:0/2625323352 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdc58066690 msgr2=0x7fdc58068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:43.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.579+0000 7fdc7f400640 1 --2- 172.21.15.55:0/2625323352 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdc58066690 0x7fdc58068b50 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c0af000 tx=0x7fdc6c0a7000 comp rx=0 tx=0).stop 2024-04-02T07:34:43.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.579+0000 7fdc7f400640 1 -- 172.21.15.55:0/2625323352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc781590d0 msgr2=0x7fdc78156c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:43.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.579+0000 7fdc7f400640 1 --2- 172.21.15.55:0/2625323352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc781590d0 0x7fdc78156c10 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7fdc6400c3c0 tx=0x7fdc6400c880 comp rx=0 tx=0).stop 2024-04-02T07:34:43.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.579+0000 7fdc7f400640 1 -- 172.21.15.55:0/2625323352 shutdown_connections 2024-04-02T07:34:43.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.579+0000 7fdc7f400640 1 --2- 172.21.15.55:0/2625323352 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdc58066690 0x7fdc58068b50 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:43.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.579+0000 7fdc7f400640 1 --2- 172.21.15.55:0/2625323352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdc7815cb10 0x7fdc780af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:43.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.579+0000 7fdc7f400640 1 --2- 172.21.15.55:0/2625323352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc781590d0 0x7fdc78156c10 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:43.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.579+0000 7fdc7f400640 1 --2- 172.21.15.55:0/2625323352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdc780709b0 0x7fdc781487a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:43.579 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.579+0000 7fdc7f400640 1 -- 172.21.15.55:0/2625323352 >> 172.21.15.55:0/2625323352 conn(0x7fdc7806a390 msgr2=0x7fdc7815b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:43.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.579+0000 7fdc7f400640 1 -- 172.21.15.55:0/2625323352 shutdown_connections 2024-04-02T07:34:43.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.579+0000 7fdc7f400640 1 -- 172.21.15.55:0/2625323352 wait complete. 2024-04-02T07:34:43.602 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-02T07:34:43.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.795+0000 7efde6c00640 1 Processor -- start 2024-04-02T07:34:43.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.795+0000 7efde6c00640 1 -- start start 2024-04-02T07:34:43.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.795+0000 7efde6c00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efde00afe70 0x7efde00b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:43.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.795+0000 7efde6c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde00b1d60 con 0x7efde006d1c0 2024-04-02T07:34:43.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.795+0000 7efde6c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde006c400 con 0x7efde015ce40 2024-04-02T07:34:43.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.795+0000 7efde6c00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde006cda0 con 0x7efde00afe70 2024-04-02T07:34:43.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.795+0000 7efdd7400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efde006d1c0 0x7efde00c90d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45606/0 (socket says 172.21.15.55:45606) 2024-04-02T07:34:43.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.795+0000 7efdd7400640 1 -- 172.21.15.55:0/943177893 learned_addr learned my addr 172.21.15.55:0/943177893 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:43.795 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.795+0000 7efde4c00640 1 --2- 172.21.15.55:0/943177893 >> v2:172.21.15.106:3300/0 conn(0x7efde00afe70 0x7efde00b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:43.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.795+0000 7efddf400640 1 -- 172.21.15.55:0/943177893 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1635684626 0 0) 0x7efde00b1d60 con 0x7efde006d1c0 2024-04-02T07:34:43.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.795+0000 7efddf400640 1 -- 172.21.15.55:0/943177893 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efdc4005740 con 0x7efde006d1c0 2024-04-02T07:34:43.796 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.795+0000 7efde4c00640 1 -- 172.21.15.55:0/943177893 >> v1:172.21.15.106:6789/0 conn(0x7efde015ce40 legacy=0x7efde00b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:43.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.795+0000 7efddf400640 1 -- 172.21.15.55:0/943177893 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3956702980 0 0) 0x7efde006c400 con 0x7efde015ce40 2024-04-02T07:34:43.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.795+0000 7efde4c00640 1 -- 172.21.15.55:0/943177893 >> v1:172.21.15.55:6789/0 conn(0x7efde006d1c0 legacy=0x7efde00c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:43.797 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.795+0000 7efde4c00640 1 -- 172.21.15.55:0/943177893 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde006c6e0 con 0x7efde00afe70 2024-04-02T07:34:43.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.799+0000 7efde4c00640 1 --2- 172.21.15.55:0/943177893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efde00afe70 0x7efde00b1780 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7efdd8009d90 tx=0x7efdd801c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22ef2af8fc207e1c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:43.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.799+0000 7efddf400640 1 -- 172.21.15.55:0/943177893 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd80a57a0 con 0x7efde00afe70 2024-04-02T07:34:43.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.799+0000 7efddf400640 1 -- 172.21.15.55:0/943177893 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd80a5900 con 0x7efde00afe70 2024-04-02T07:34:43.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.799+0000 7efddf400640 1 -- 172.21.15.55:0/943177893 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd80a5c90 con 0x7efde00afe70 2024-04-02T07:34:43.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.799+0000 7efde6c00640 1 -- 172.21.15.55:0/943177893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efde00afe70 msgr2=0x7efde00b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:43.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.799+0000 7efde6c00640 1 --2- 172.21.15.55:0/943177893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efde00afe70 0x7efde00b1780 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7efdd8009d90 tx=0x7efdd801c8e0 comp rx=0 tx=0).stop 2024-04-02T07:34:43.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.799+0000 7efde6c00640 1 -- 172.21.15.55:0/943177893 shutdown_connections 2024-04-02T07:34:43.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.799+0000 7efde6c00640 1 --2- 172.21.15.55:0/943177893 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efde00afe70 0x7efde00b1780 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:43.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.799+0000 7efde6c00640 1 -- 172.21.15.55:0/943177893 >> 172.21.15.55:0/943177893 conn(0x7efde0069d90 msgr2=0x7efde006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:43.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.799+0000 7efde6c00640 1 -- 172.21.15.55:0/943177893 shutdown_connections 2024-04-02T07:34:43.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.799+0000 7efde6c00640 1 -- 172.21.15.55:0/943177893 wait complete. 2024-04-02T07:34:43.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efde6c00640 1 Processor -- start 2024-04-02T07:34:43.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efde6c00640 1 -- start start 2024-04-02T07:34:43.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efde6c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efde006d1c0 0x7efde0146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:43.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efde6c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efde00afe70 0x7efde014c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:43.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efde6c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde015ce40 0x7efde014c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:43.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efde6c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde0153940 con 0x7efde015ce40 2024-04-02T07:34:43.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efde6c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde014ebc0 con 0x7efde006d1c0 2024-04-02T07:34:43.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efde6c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde014eea0 con 0x7efde00afe70 2024-04-02T07:34:43.804 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efde4c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde015ce40 0x7efde014c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:43.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efde4c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde015ce40 0x7efde014c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33874/0 (socket says 172.21.15.55:33874) 2024-04-02T07:34:43.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efde4c00640 1 -- 172.21.15.55:0/1942674667 learned_addr learned my addr 172.21.15.55:0/1942674667 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:43.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efdd7400640 1 --2- 172.21.15.55:0/1942674667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efde00afe70 0x7efde014c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:43.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efddfe00640 1 --2- 172.21.15.55:0/1942674667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efde006d1c0 0x7efde0146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:43.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efde4c00640 1 -- 172.21.15.55:0/1942674667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efde00afe70 msgr2=0x7efde014c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:43.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efde4c00640 1 --2- 172.21.15.55:0/1942674667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efde00afe70 0x7efde014c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:43.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efde4c00640 1 -- 172.21.15.55:0/1942674667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efde006d1c0 msgr2=0x7efde0146190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:43.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efde4c00640 1 --2- 172.21.15.55:0/1942674667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efde006d1c0 0x7efde0146190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:43.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efde4c00640 1 -- 172.21.15.55:0/1942674667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdd8009a70 con 0x7efde015ce40 2024-04-02T07:34:43.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efddfe00640 1 --2- 172.21.15.55:0/1942674667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efde006d1c0 0x7efde0146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:43.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efde4c00640 1 --2- 172.21.15.55:0/1942674667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde015ce40 0x7efde014c900 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7efdd80b0040 tx=0x7efdd8019680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:43.805 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efddcc00640 1 -- 172.21.15.55:0/1942674667 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd8003ba0 con 0x7efde015ce40 2024-04-02T07:34:43.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efddcc00640 1 -- 172.21.15.55:0/1942674667 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdd8003d00 con 0x7efde015ce40 2024-04-02T07:34:43.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efde6c00640 1 -- 172.21.15.55:0/1942674667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde0153b50 con 0x7efde015ce40 2024-04-02T07:34:43.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efddcc00640 1 -- 172.21.15.55:0/1942674667 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdd8004270 con 0x7efde015ce40 2024-04-02T07:34:43.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.803+0000 7efde6c00640 1 -- 172.21.15.55:0/1942674667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde01466d0 con 0x7efde015ce40 2024-04-02T07:34:43.806 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.807+0000 7efde6c00640 1 -- 172.21.15.55:0/1942674667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde006e270 con 0x7efde015ce40 2024-04-02T07:34:43.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.807+0000 7efddcc00640 1 -- 172.21.15.55:0/1942674667 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7efdd80b4050 con 0x7efde015ce40 2024-04-02T07:34:43.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.807+0000 7efddcc00640 1 --2- 172.21.15.55:0/1942674667 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdbc066690 0x7efdbc068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:43.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.807+0000 7efddcc00640 1 -- 172.21.15.55:0/1942674667 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 6025+0+0 (secure 0 0 0) 0x7efdd811eef0 con 0x7efde015ce40 2024-04-02T07:34:43.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.807+0000 7efddfe00640 1 --2- 172.21.15.55:0/1942674667 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdbc066690 0x7efdbc068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:43.807 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.807+0000 7efddfe00640 1 --2- 172.21.15.55:0/1942674667 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdbc066690 0x7efdbc068b50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7efdd0000f70 tx=0x7efdd0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:43.810 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.811+0000 7efddcc00640 1 -- 172.21.15.55:0/1942674667 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7efdd80ec1a0 con 0x7efde015ce40 2024-04-02T07:34:43.973 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:43.975+0000 7efde6c00640 1 -- 172.21.15.55:0/1942674667 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7efde014f060 con 0x7efde015ce40 2024-04-02T07:34:44.580 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.583+0000 7efddcc00640 1 -- 172.21.15.55:0/1942674667 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v122) v1 ==== 181+0+0 (secure 0 0 0) 0x7efdd80b20d0 con 0x7efde015ce40 2024-04-02T07:34:44.580 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' removed 2024-04-02T07:34:44.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.583+0000 7efde6c00640 1 -- 172.21.15.55:0/1942674667 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdbc066690 msgr2=0x7efdbc068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:44.583 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.583+0000 7efde6c00640 1 --2- 172.21.15.55:0/1942674667 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdbc066690 0x7efdbc068b50 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7efdd0000f70 tx=0x7efdd0009040 comp rx=0 tx=0).stop 2024-04-02T07:34:44.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.583+0000 7efde6c00640 1 -- 172.21.15.55:0/1942674667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde015ce40 msgr2=0x7efde014c900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:44.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.583+0000 7efde6c00640 1 --2- 172.21.15.55:0/1942674667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde015ce40 0x7efde014c900 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7efdd80b0040 tx=0x7efdd8019680 comp rx=0 tx=0).stop 2024-04-02T07:34:44.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.583+0000 7efde6c00640 1 -- 172.21.15.55:0/1942674667 shutdown_connections 2024-04-02T07:34:44.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.583+0000 7efde6c00640 1 --2- 172.21.15.55:0/1942674667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efde015ce40 0x7efde014c900 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:44.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.583+0000 7efde6c00640 1 --2- 172.21.15.55:0/1942674667 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efde00afe70 0x7efde014c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:44.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.583+0000 7efde6c00640 1 --2- 172.21.15.55:0/1942674667 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efdbc066690 0x7efdbc068b50 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:44.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.583+0000 7efde6c00640 1 --2- 172.21.15.55:0/1942674667 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efde006d1c0 0x7efde0146190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:44.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.583+0000 7efde6c00640 1 -- 172.21.15.55:0/1942674667 >> 172.21.15.55:0/1942674667 conn(0x7efde0069d90 msgr2=0x7efde015d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:44.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.583+0000 7efde6c00640 1 -- 172.21.15.55:0/1942674667 shutdown_connections 2024-04-02T07:34:44.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.583+0000 7efde6c00640 1 -- 172.21.15.55:0/1942674667 wait complete. 2024-04-02T07:34:44.606 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-02T07:34:44.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.751+0000 7ff5b2200640 1 Processor -- start 2024-04-02T07:34:44.752 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.755+0000 7ff5b2200640 1 -- start start 2024-04-02T07:34:44.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.755+0000 7ff5b2200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5ac15cc90 0x7ff5ac065a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:44.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.755+0000 7ff5b2200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ac1607f0 con 0x7ff5ac0ce7e0 2024-04-02T07:34:44.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.755+0000 7ff5b2200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5ac066110 con 0x7ff5ac06e4f0 2024-04-02T07:34:44.753 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.755+0000 7ff5b2200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5ac160a40 con 0x7ff5ac15cc90 2024-04-02T07:34:44.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.755+0000 7ff5ab400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5ac15cc90 0x7ff5ac065a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:44.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.755+0000 7ff5ab400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5ac15cc90 0x7ff5ac065a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33882/0 (socket says 172.21.15.55:33882) 2024-04-02T07:34:44.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.755+0000 7ff5ab400640 1 -- 172.21.15.55:0/315966526 learned_addr learned my addr 172.21.15.55:0/315966526 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:44.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.755+0000 7ff5ab400640 1 -- 172.21.15.55:0/315966526 >> v1:172.21.15.106:6789/0 conn(0x7ff5ac06e4f0 legacy=0x7ff5ac069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:44.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.755+0000 7ff5ab400640 1 -- 172.21.15.55:0/315966526 >> v1:172.21.15.55:6789/0 conn(0x7ff5ac0ce7e0 legacy=0x7ff5ac06dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:44.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.755+0000 7ff5aaa00640 1 -- 172.21.15.55:0/315966526 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167391875 0 0) 0x7ff5ac1607f0 con 0x7ff5ac0ce7e0 2024-04-02T07:34:44.754 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.755+0000 7ff5ab400640 1 -- 172.21.15.55:0/315966526 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5ac160d20 con 0x7ff5ac15cc90 2024-04-02T07:34:44.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.759+0000 7ff5ab400640 1 --2- 172.21.15.55:0/315966526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5ac15cc90 0x7ff5ac065a80 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7ff59c009870 tx=0x7ff59c01c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c3366a7949a711 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:44.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.759+0000 7ff5aaa00640 1 -- 172.21.15.55:0/315966526 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c0aa470 con 0x7ff5ac15cc90 2024-04-02T07:34:44.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.759+0000 7ff5aaa00640 1 -- 172.21.15.55:0/315966526 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff59c0aa5d0 con 0x7ff5ac15cc90 2024-04-02T07:34:44.757 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.759+0000 7ff5aaa00640 1 -- 172.21.15.55:0/315966526 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59c0aa960 con 0x7ff5ac15cc90 2024-04-02T07:34:44.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.759+0000 7ff5b2200640 1 -- 172.21.15.55:0/315966526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5ac15cc90 msgr2=0x7ff5ac065a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:44.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.759+0000 7ff5b2200640 1 --2- 172.21.15.55:0/315966526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5ac15cc90 0x7ff5ac065a80 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7ff59c009870 tx=0x7ff59c01c4f0 comp rx=0 tx=0).stop 2024-04-02T07:34:44.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.759+0000 7ff5b2200640 1 -- 172.21.15.55:0/315966526 shutdown_connections 2024-04-02T07:34:44.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.759+0000 7ff5b2200640 1 --2- 172.21.15.55:0/315966526 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5ac15cc90 0x7ff5ac065a80 unknown :-1 s=CLOSED pgs=1931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:44.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.759+0000 7ff5b2200640 1 -- 172.21.15.55:0/315966526 >> 172.21.15.55:0/315966526 conn(0x7ff5ac0ced90 msgr2=0x7ff5ac0cf1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:44.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.759+0000 7ff5b2200640 1 -- 172.21.15.55:0/315966526 shutdown_connections 2024-04-02T07:34:44.758 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.759+0000 7ff5b2200640 1 -- 172.21.15.55:0/315966526 wait complete. 2024-04-02T07:34:44.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.759+0000 7ff5b2200640 1 Processor -- start 2024-04-02T07:34:44.759 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.759+0000 7ff5b2200640 1 -- start start 2024-04-02T07:34:44.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5b2200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff5ac06e4f0 0x7ff5ac1589c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:44.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5b2200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5ac0ce7e0 0x7ff5ac15b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:44.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5b2200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5ac15cc90 0x7ff5ac15ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:44.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5b2200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac15e970 con 0x7ff5ac0ce7e0 2024-04-02T07:34:44.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5b2200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac15e340 con 0x7ff5ac15cc90 2024-04-02T07:34:44.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5b2200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5ac15bcb0 con 0x7ff5ac06e4f0 2024-04-02T07:34:44.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5a2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5ac0ce7e0 0x7ff5ac15b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:44.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5a2a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5ac0ce7e0 0x7ff5ac15b260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33898/0 (socket says 172.21.15.55:33898) 2024-04-02T07:34:44.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5a2a00640 1 -- 172.21.15.55:0/2464115966 learned_addr learned my addr 172.21.15.55:0/2464115966 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:44.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5ab400640 1 --2- 172.21.15.55:0/2464115966 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff5ac06e4f0 0x7ff5ac1589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:44.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5abe00640 1 --2- 172.21.15.55:0/2464115966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5ac15cc90 0x7ff5ac15ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:44.762 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5a2a00640 1 -- 172.21.15.55:0/2464115966 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff5ac06e4f0 msgr2=0x7ff5ac1589c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:44.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5a2a00640 1 --2- 172.21.15.55:0/2464115966 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff5ac06e4f0 0x7ff5ac1589c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:44.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5a2a00640 1 -- 172.21.15.55:0/2464115966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5ac15cc90 msgr2=0x7ff5ac15ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:44.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5a2a00640 1 --2- 172.21.15.55:0/2464115966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5ac15cc90 0x7ff5ac15ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:44.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5a2a00640 1 -- 172.21.15.55:0/2464115966 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff59c0094d0 con 0x7ff5ac0ce7e0 2024-04-02T07:34:44.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5a2a00640 1 --2- 172.21.15.55:0/2464115966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5ac0ce7e0 0x7ff5ac15b260 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7ff59400c520 tx=0x7ff59400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:44.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5a3e00640 1 -- 172.21.15.55:0/2464115966 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594003600 con 0x7ff5ac0ce7e0 2024-04-02T07:34:44.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5a3e00640 1 -- 172.21.15.55:0/2464115966 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff594003780 con 0x7ff5ac0ce7e0 2024-04-02T07:34:44.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5b2200640 1 -- 172.21.15.55:0/2464115966 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5ac1616a0 con 0x7ff5ac0ce7e0 2024-04-02T07:34:44.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5a3e00640 1 -- 172.21.15.55:0/2464115966 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff594003b30 con 0x7ff5ac0ce7e0 2024-04-02T07:34:44.763 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5b2200640 1 -- 172.21.15.55:0/2464115966 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5ac15e600 con 0x7ff5ac0ce7e0 2024-04-02T07:34:44.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5b2200640 1 -- 172.21.15.55:0/2464115966 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5ac0cc770 con 0x7ff5ac0ce7e0 2024-04-02T07:34:44.764 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.763+0000 7ff5a3e00640 1 -- 172.21.15.55:0/2464115966 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ff594003c90 con 0x7ff5ac0ce7e0 2024-04-02T07:34:44.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.767+0000 7ff5a3e00640 1 --2- 172.21.15.55:0/2464115966 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff5880666c0 0x7ff588068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:44.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.767+0000 7ff5a3e00640 1 -- 172.21.15.55:0/2464115966 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5587+0+0 (secure 0 0 0) 0x7ff594083750 con 0x7ff5ac0ce7e0 2024-04-02T07:34:44.765 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.767+0000 7ff5ab400640 1 --2- 172.21.15.55:0/2464115966 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff5880666c0 0x7ff588068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:44.766 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.767+0000 7ff5ab400640 1 --2- 172.21.15.55:0/2464115966 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff5880666c0 0x7ff588068b80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0ae000 tx=0x7ff59c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:44.769 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.771+0000 7ff5a3e00640 1 -- 172.21.15.55:0/2464115966 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7ff594050b20 con 0x7ff5ac0ce7e0 2024-04-02T07:34:44.930 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:44.931+0000 7ff5b2200640 1 -- 172.21.15.55:0/2464115966 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7ff5ac066c90 con 0x7ff5ac0ce7e0 2024-04-02T07:34:45.581 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.583+0000 7ff5a3e00640 1 -- 172.21.15.55:0/2464115966 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v123) v1 ==== 169+0+0 (secure 0 0 0) 0x7ff594054140 con 0x7ff5ac0ce7e0 2024-04-02T07:34:45.582 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' removed 2024-04-02T07:34:45.584 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.587+0000 7ff5b2200640 1 -- 172.21.15.55:0/2464115966 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff5880666c0 msgr2=0x7ff588068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:45.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.587+0000 7ff5b2200640 1 --2- 172.21.15.55:0/2464115966 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff5880666c0 0x7ff588068b80 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ff59c0ae000 tx=0x7ff59c0a7000 comp rx=0 tx=0).stop 2024-04-02T07:34:45.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.587+0000 7ff5b2200640 1 -- 172.21.15.55:0/2464115966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5ac0ce7e0 msgr2=0x7ff5ac15b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:45.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.587+0000 7ff5b2200640 1 --2- 172.21.15.55:0/2464115966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5ac0ce7e0 0x7ff5ac15b260 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7ff59400c520 tx=0x7ff59400c9e0 comp rx=0 tx=0).stop 2024-04-02T07:34:45.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.587+0000 7ff5b2200640 1 -- 172.21.15.55:0/2464115966 shutdown_connections 2024-04-02T07:34:45.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.587+0000 7ff5b2200640 1 --2- 172.21.15.55:0/2464115966 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ff5880666c0 0x7ff588068b80 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:45.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.587+0000 7ff5b2200640 1 --2- 172.21.15.55:0/2464115966 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ff5ac15cc90 0x7ff5ac15ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:45.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.587+0000 7ff5b2200640 1 --2- 172.21.15.55:0/2464115966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5ac0ce7e0 0x7ff5ac15b260 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:45.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.587+0000 7ff5b2200640 1 --2- 172.21.15.55:0/2464115966 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ff5ac06e4f0 0x7ff5ac1589c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:45.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.587+0000 7ff5b2200640 1 -- 172.21.15.55:0/2464115966 >> 172.21.15.55:0/2464115966 conn(0x7ff5ac0ced90 msgr2=0x7ff5ac0abd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:45.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.587+0000 7ff5b2200640 1 -- 172.21.15.55:0/2464115966 shutdown_connections 2024-04-02T07:34:45.585 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.587+0000 7ff5b2200640 1 -- 172.21.15.55:0/2464115966 wait complete. 2024-04-02T07:34:45.623 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-04-02T07:34:45.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.771+0000 7fc26da00640 1 Processor -- start 2024-04-02T07:34:45.768 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.771+0000 7fc26da00640 1 -- start start 2024-04-02T07:34:45.770 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.771+0000 7fc26da00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fc268157000 0x7fc268071a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:45.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.771+0000 7fc26da00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc26806a4a0 0x7fc268160760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:45.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.771+0000 7fc26da00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc26815de90 con 0x7fc268071f60 2024-04-02T07:34:45.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.771+0000 7fc26da00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc26815d070 con 0x7fc268157000 2024-04-02T07:34:45.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.771+0000 7fc26da00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2680723e0 con 0x7fc26806a4a0 2024-04-02T07:34:45.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.771+0000 7fc266000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc268071f60 0x7fc268069d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41180/0 (socket says 172.21.15.55:41180) 2024-04-02T07:34:45.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.771+0000 7fc266000640 1 -- 172.21.15.55:0/751098578 learned_addr learned my addr 172.21.15.55:0/751098578 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:45.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.771+0000 7fc266a00640 1 --2- 172.21.15.55:0/751098578 >> v2:172.21.15.106:3300/0 conn(0x7fc268157000 0x7fc268071a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:45.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.771+0000 7fc267400640 1 --2- 172.21.15.55:0/751098578 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc26806a4a0 0x7fc268160760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:45.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.771+0000 7fc265600640 1 -- 172.21.15.55:0/751098578 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 727451844 0 0) 0x7fc26815de90 con 0x7fc268071f60 2024-04-02T07:34:45.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.771+0000 7fc265600640 1 -- 172.21.15.55:0/751098578 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc24c003530 con 0x7fc268071f60 2024-04-02T07:34:45.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.771+0000 7fc267400640 1 -- 172.21.15.55:0/751098578 >> v2:172.21.15.106:3300/0 conn(0x7fc268157000 msgr2=0x7fc268071a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:45.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.771+0000 7fc267400640 1 --2- 172.21.15.55:0/751098578 >> v2:172.21.15.106:3300/0 conn(0x7fc268157000 0x7fc268071a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:45.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.771+0000 7fc267400640 1 -- 172.21.15.55:0/751098578 >> v1:172.21.15.55:6789/0 conn(0x7fc268071f60 legacy=0x7fc268069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:45.771 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.771+0000 7fc267400640 1 -- 172.21.15.55:0/751098578 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26815d280 con 0x7fc26806a4a0 2024-04-02T07:34:45.772 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.771+0000 7fc266a00640 1 --2- 172.21.15.55:0/751098578 >> v2:172.21.15.106:3300/0 conn(0x7fc268157000 0x7fc268071a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:34:45.773 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.775+0000 7fc267400640 1 --2- 172.21.15.55:0/751098578 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc26806a4a0 0x7fc268160760 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc260009d90 tx=0x7fc26001c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abb5f8bcc0e5194f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:45.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.775+0000 7fc265600640 1 -- 172.21.15.55:0/751098578 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2600a5a00 con 0x7fc26806a4a0 2024-04-02T07:34:45.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.775+0000 7fc265600640 1 -- 172.21.15.55:0/751098578 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2600a5b60 con 0x7fc26806a4a0 2024-04-02T07:34:45.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.775+0000 7fc265600640 1 -- 172.21.15.55:0/751098578 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2600ad440 con 0x7fc26806a4a0 2024-04-02T07:34:45.774 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.775+0000 7fc26da00640 1 -- 172.21.15.55:0/751098578 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc26806a4a0 msgr2=0x7fc268160760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:45.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.775+0000 7fc26da00640 1 --2- 172.21.15.55:0/751098578 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc26806a4a0 0x7fc268160760 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc260009d90 tx=0x7fc26001c940 comp rx=0 tx=0).stop 2024-04-02T07:34:45.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.775+0000 7fc26da00640 1 -- 172.21.15.55:0/751098578 shutdown_connections 2024-04-02T07:34:45.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.775+0000 7fc26da00640 1 --2- 172.21.15.55:0/751098578 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc26806a4a0 0x7fc268160760 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:45.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.775+0000 7fc26da00640 1 --2- 172.21.15.55:0/751098578 >> v2:172.21.15.106:3300/0 conn(0x7fc268157000 0x7fc268071a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:45.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.775+0000 7fc26da00640 1 -- 172.21.15.55:0/751098578 >> 172.21.15.55:0/751098578 conn(0x7fc2680b13b0 msgr2=0x7fc2680b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:45.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.775+0000 7fc26da00640 1 -- 172.21.15.55:0/751098578 shutdown_connections 2024-04-02T07:34:45.775 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.775+0000 7fc26da00640 1 -- 172.21.15.55:0/751098578 wait complete. 2024-04-02T07:34:45.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc26da00640 1 Processor -- start 2024-04-02T07:34:45.776 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc26da00640 1 -- start start 2024-04-02T07:34:45.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc26da00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc26806a4a0 0x7fc26814fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:45.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc26da00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc268071f60 0x7fc268150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:45.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc26da00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc268157000 0x7fc268151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:45.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc26da00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2680c8e70 con 0x7fc268157000 2024-04-02T07:34:45.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc26da00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2680c9150 con 0x7fc268071f60 2024-04-02T07:34:45.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc26da00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2680c9430 con 0x7fc26806a4a0 2024-04-02T07:34:45.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc267400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc268157000 0x7fc268151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:45.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc267400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc268157000 0x7fc268151a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46396/0 (socket says 172.21.15.55:46396) 2024-04-02T07:34:45.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc267400640 1 -- 172.21.15.55:0/2688423365 learned_addr learned my addr 172.21.15.55:0/2688423365 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:45.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc266a00640 1 --2- 172.21.15.55:0/2688423365 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc26806a4a0 0x7fc26814fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:45.778 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc266000640 1 --2- 172.21.15.55:0/2688423365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc268071f60 0x7fc268150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:45.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc267400640 1 -- 172.21.15.55:0/2688423365 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc26806a4a0 msgr2=0x7fc26814fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:45.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc267400640 1 --2- 172.21.15.55:0/2688423365 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc26806a4a0 0x7fc26814fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:45.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc267400640 1 -- 172.21.15.55:0/2688423365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc268071f60 msgr2=0x7fc268150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:45.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc267400640 1 --2- 172.21.15.55:0/2688423365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc268071f60 0x7fc268150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:45.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc267400640 1 -- 172.21.15.55:0/2688423365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc258009420 con 0x7fc268157000 2024-04-02T07:34:45.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc267400640 1 --2- 172.21.15.55:0/2688423365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc268157000 0x7fc268151a80 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fc26001aff0 tx=0x7fc2600196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:45.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc25ea00640 1 -- 172.21.15.55:0/2688423365 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2600adce0 con 0x7fc268157000 2024-04-02T07:34:45.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc25ea00640 1 -- 172.21.15.55:0/2688423365 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2600ade40 con 0x7fc268157000 2024-04-02T07:34:45.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc25ea00640 1 -- 172.21.15.55:0/2688423365 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2600b9670 con 0x7fc268157000 2024-04-02T07:34:45.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc26da00640 1 -- 172.21.15.55:0/2688423365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc260009a70 con 0x7fc268157000 2024-04-02T07:34:45.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc26da00640 1 -- 172.21.15.55:0/2688423365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2680c99f0 con 0x7fc268157000 2024-04-02T07:34:45.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.779+0000 7fc26da00640 1 -- 172.21.15.55:0/2688423365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2680c9be0 con 0x7fc268157000 2024-04-02T07:34:45.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.783+0000 7fc25ea00640 1 -- 172.21.15.55:0/2688423365 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc2600b97d0 con 0x7fc268157000 2024-04-02T07:34:45.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.783+0000 7fc25ea00640 1 --2- 172.21.15.55:0/2688423365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc248066690 0x7fc248068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:45.781 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.783+0000 7fc25ea00640 1 -- 172.21.15.55:0/2688423365 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fc26011f600 con 0x7fc268157000 2024-04-02T07:34:45.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.783+0000 7fc266a00640 1 --2- 172.21.15.55:0/2688423365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc248066690 0x7fc248068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:45.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.783+0000 7fc266a00640 1 --2- 172.21.15.55:0/2688423365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc248066690 0x7fc248068b50 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc2681569b0 tx=0x7fc258009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:45.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.787+0000 7fc25ea00640 1 -- 172.21.15.55:0/2688423365 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc2600eccf0 con 0x7fc268157000 2024-04-02T07:34:45.947 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.947+0000 7fc26da00640 1 -- 172.21.15.55:0/2688423365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc268066c90 con 0x7fc268157000 2024-04-02T07:34:45.951 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.951+0000 7fc25ea00640 1 -- 172.21.15.55:0/2688423365 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc260009450 con 0x7fc268157000 2024-04-02T07:34:45.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.955+0000 7fc26da00640 1 -- 172.21.15.55:0/2688423365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc248066690 msgr2=0x7fc248068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:45.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.955+0000 7fc26da00640 1 --2- 172.21.15.55:0/2688423365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc248066690 0x7fc248068b50 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7fc2681569b0 tx=0x7fc258009190 comp rx=0 tx=0).stop 2024-04-02T07:34:45.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.955+0000 7fc26da00640 1 -- 172.21.15.55:0/2688423365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc268157000 msgr2=0x7fc268151a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:45.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.955+0000 7fc26da00640 1 --2- 172.21.15.55:0/2688423365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc268157000 0x7fc268151a80 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fc26001aff0 tx=0x7fc2600196e0 comp rx=0 tx=0).stop 2024-04-02T07:34:45.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.955+0000 7fc26da00640 1 -- 172.21.15.55:0/2688423365 shutdown_connections 2024-04-02T07:34:45.954 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.955+0000 7fc26da00640 1 --2- 172.21.15.55:0/2688423365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc268157000 0x7fc268151a80 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:45.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.955+0000 7fc26da00640 1 --2- 172.21.15.55:0/2688423365 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc248066690 0x7fc248068b50 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:45.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.955+0000 7fc26da00640 1 --2- 172.21.15.55:0/2688423365 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc268071f60 0x7fc268150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:45.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.955+0000 7fc26da00640 1 --2- 172.21.15.55:0/2688423365 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc26806a4a0 0x7fc26814fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:45.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.955+0000 7fc26da00640 1 -- 172.21.15.55:0/2688423365 >> 172.21.15.55:0/2688423365 conn(0x7fc2680b13b0 msgr2=0x7fc26806d440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:45.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.955+0000 7fc26da00640 1 -- 172.21.15.55:0/2688423365 shutdown_connections 2024-04-02T07:34:45.955 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:45.955+0000 7fc26da00640 1 -- 172.21.15.55:0/2688423365 wait complete. 2024-04-02T07:34:45.978 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan' 2024-04-02T07:34:46.117 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.119+0000 7f74b8a00640 1 Processor -- start 2024-04-02T07:34:46.118 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.119+0000 7f74b8a00640 1 -- start start 2024-04-02T07:34:46.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.119+0000 7f74b8a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74b415ca70 0x7f74b40b0040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:46.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.119+0000 7f74b8a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b415ce50 con 0x7f74b406b700 2024-04-02T07:34:46.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.119+0000 7f74b8a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b40cef60 con 0x7f74b4098a10 2024-04-02T07:34:46.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.119+0000 7f74b8a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b406bd60 con 0x7f74b415ca70 2024-04-02T07:34:46.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.119+0000 7f74b2800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f74b406b700 0x7f74b40cf3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41186/0 (socket says 172.21.15.55:41186) 2024-04-02T07:34:46.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.119+0000 7f74b2800640 1 -- 172.21.15.55:0/605729317 learned_addr learned my addr 172.21.15.55:0/605729317 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:46.119 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.119+0000 7f74b1e00640 1 --2- 172.21.15.55:0/605729317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74b415ca70 0x7f74b40b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:46.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.119+0000 7f74b1400640 1 -- 172.21.15.55:0/605729317 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 59019641 0 0) 0x7f74b415ce50 con 0x7f74b406b700 2024-04-02T07:34:46.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.119+0000 7f74b1400640 1 -- 172.21.15.55:0/605729317 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7498003530 con 0x7f74b406b700 2024-04-02T07:34:46.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.119+0000 7f74b1400640 1 -- 172.21.15.55:0/605729317 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3835698054 0 0) 0x7f74b40cef60 con 0x7f74b4098a10 2024-04-02T07:34:46.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.119+0000 7f74b1400640 1 -- 172.21.15.55:0/605729317 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74b415ce50 con 0x7f74b4098a10 2024-04-02T07:34:46.120 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.119+0000 7f74b1400640 1 -- 172.21.15.55:0/605729317 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2519802327 0 0) 0x7f7498003530 con 0x7f74b406b700 2024-04-02T07:34:46.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.119+0000 7f74b1e00640 1 -- 172.21.15.55:0/605729317 >> v1:172.21.15.106:6789/0 conn(0x7f74b4098a10 legacy=0x7f74b406aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:46.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.119+0000 7f74b1e00640 1 -- 172.21.15.55:0/605729317 >> v1:172.21.15.55:6789/0 conn(0x7f74b406b700 legacy=0x7f74b40cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:46.121 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.119+0000 7f74b1e00640 1 -- 172.21.15.55:0/605729317 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b406c040 con 0x7f74b415ca70 2024-04-02T07:34:46.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.123+0000 7f74b1e00640 1 --2- 172.21.15.55:0/605729317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74b415ca70 0x7f74b40b0040 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009dc0 tx=0x7f74a401c8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9bfa93204feee4c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:46.122 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.123+0000 7f74b1400640 1 -- 172.21.15.55:0/605729317 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac001680 con 0x7f74b415ca70 2024-04-02T07:34:46.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.123+0000 7f74b1400640 1 -- 172.21.15.55:0/605729317 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a40a55d0 con 0x7f74b415ca70 2024-04-02T07:34:46.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.123+0000 7f74b1400640 1 -- 172.21.15.55:0/605729317 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a40a5960 con 0x7f74b415ca70 2024-04-02T07:34:46.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.123+0000 7f74b8a00640 1 -- 172.21.15.55:0/605729317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74b415ca70 msgr2=0x7f74b40b0040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:46.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.123+0000 7f74b8a00640 1 --2- 172.21.15.55:0/605729317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74b415ca70 0x7f74b40b0040 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009dc0 tx=0x7f74a401c8b0 comp rx=0 tx=0).stop 2024-04-02T07:34:46.123 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.123+0000 7f74b8a00640 1 -- 172.21.15.55:0/605729317 shutdown_connections 2024-04-02T07:34:46.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.123+0000 7f74b8a00640 1 --2- 172.21.15.55:0/605729317 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74b415ca70 0x7f74b40b0040 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:46.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.123+0000 7f74b8a00640 1 -- 172.21.15.55:0/605729317 >> 172.21.15.55:0/605729317 conn(0x7f74b40b21d0 msgr2=0x7f74b40b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:46.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.123+0000 7f74b8a00640 1 -- 172.21.15.55:0/605729317 shutdown_connections 2024-04-02T07:34:46.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.123+0000 7f74b8a00640 1 -- 172.21.15.55:0/605729317 wait complete. 2024-04-02T07:34:46.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74b8a00640 1 Processor -- start 2024-04-02T07:34:46.125 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74b8a00640 1 -- start start 2024-04-02T07:34:46.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74b8a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74b406b700 0x7f74b41535a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:46.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74b8a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b4098a10 0x7f74b40c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:46.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74b8a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74b415ca70 0x7f74b40c68e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:46.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74b8a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b4153ae0 con 0x7f74b406b700 2024-04-02T07:34:46.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74b8a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b40b3eb0 con 0x7f74b4098a10 2024-04-02T07:34:46.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74b8a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b406fd30 con 0x7f74b415ca70 2024-04-02T07:34:46.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74b1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74b406b700 0x7f74b41535a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:46.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74b1e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74b406b700 0x7f74b41535a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46404/0 (socket says 172.21.15.55:46404) 2024-04-02T07:34:46.128 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74b1e00640 1 -- 172.21.15.55:0/232528352 learned_addr learned my addr 172.21.15.55:0/232528352 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:46.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74a9400640 1 --2- 172.21.15.55:0/232528352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b4098a10 0x7f74b40c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:46.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74b2800640 1 --2- 172.21.15.55:0/232528352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74b415ca70 0x7f74b40c68e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:46.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74b1e00640 1 -- 172.21.15.55:0/232528352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74b415ca70 msgr2=0x7f74b40c68e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:46.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74b1e00640 1 --2- 172.21.15.55:0/232528352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74b415ca70 0x7f74b40c68e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:46.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74b1e00640 1 -- 172.21.15.55:0/232528352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b4098a10 msgr2=0x7f74b40c63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:46.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74b1e00640 1 --2- 172.21.15.55:0/232528352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b4098a10 0x7f74b40c63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:46.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74b1e00640 1 -- 172.21.15.55:0/232528352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74a4009a70 con 0x7f74b406b700 2024-04-02T07:34:46.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74b1e00640 1 --2- 172.21.15.55:0/232528352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74b406b700 0x7f74b41535a0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f74a401af60 tx=0x7f74a4019650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:46.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74aaa00640 1 -- 172.21.15.55:0/232528352 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4003ba0 con 0x7f74b406b700 2024-04-02T07:34:46.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74aaa00640 1 -- 172.21.15.55:0/232528352 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a4003d00 con 0x7f74b406b700 2024-04-02T07:34:46.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74b8a00640 1 -- 172.21.15.55:0/232528352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74b40b4170 con 0x7f74b406b700 2024-04-02T07:34:46.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74aaa00640 1 -- 172.21.15.55:0/232528352 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a4004260 con 0x7f74b406b700 2024-04-02T07:34:46.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.127+0000 7f74b8a00640 1 -- 172.21.15.55:0/232528352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b40b4730 con 0x7f74b406b700 2024-04-02T07:34:46.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.131+0000 7f74b8a00640 1 -- 172.21.15.55:0/232528352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b4066c90 con 0x7f74b406b700 2024-04-02T07:34:46.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.131+0000 7f74aaa00640 1 -- 172.21.15.55:0/232528352 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f74a40b4050 con 0x7f74b406b700 2024-04-02T07:34:46.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.131+0000 7f74aaa00640 1 --2- 172.21.15.55:0/232528352 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7490066690 0x7f7490068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:46.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.131+0000 7f74aaa00640 1 -- 172.21.15.55:0/232528352 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f74a411dee0 con 0x7f74b406b700 2024-04-02T07:34:46.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.131+0000 7f74a9400640 1 --2- 172.21.15.55:0/232528352 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7490066690 0x7f7490068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:46.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.131+0000 7f74a9400640 1 --2- 172.21.15.55:0/232528352 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7490066690 0x7f7490068b50 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f74b40cf130 tx=0x7f749c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:46.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.135+0000 7f74aaa00640 1 -- 172.21.15.55:0/232528352 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f74a40eb410 con 0x7f74b406b700 2024-04-02T07:34:46.242 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:34:46.247 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:34:46.354 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.355+0000 7f74b8a00640 1 -- 172.21.15.55:0/232528352 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]} v 0) v1 -- 0x7f74b41541b0 con 0x7f74b406b700 2024-04-02T07:34:46.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.599+0000 7f74aaa00640 1 -- 172.21.15.55:0/232528352 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_forward_scrub.TestForwardScrub.test_orphan_scan"]}]=0 v566) v1 ==== 144+0+0 (secure 0 0 0) 0x7f74a40b2070 con 0x7f74b406b700 2024-04-02T07:34:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.599+0000 7f74b8a00640 1 -- 172.21.15.55:0/232528352 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7490066690 msgr2=0x7f7490068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:46.599 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.599+0000 7f74b8a00640 1 --2- 172.21.15.55:0/232528352 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7490066690 0x7f7490068b50 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f74b40cf130 tx=0x7f749c009040 comp rx=0 tx=0).stop 2024-04-02T07:34:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.599+0000 7f74b8a00640 1 -- 172.21.15.55:0/232528352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74b406b700 msgr2=0x7f74b41535a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.599+0000 7f74b8a00640 1 --2- 172.21.15.55:0/232528352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74b406b700 0x7f74b41535a0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7f74a401af60 tx=0x7f74a4019650 comp rx=0 tx=0).stop 2024-04-02T07:34:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.599+0000 7f74b8a00640 1 -- 172.21.15.55:0/232528352 shutdown_connections 2024-04-02T07:34:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.599+0000 7f74b8a00640 1 --2- 172.21.15.55:0/232528352 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f74b415ca70 0x7f74b40c68e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.599+0000 7f74b8a00640 1 --2- 172.21.15.55:0/232528352 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f7490066690 0x7f7490068b50 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.599+0000 7f74b8a00640 1 --2- 172.21.15.55:0/232528352 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f74b4098a10 0x7f74b40c63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.599+0000 7f74b8a00640 1 --2- 172.21.15.55:0/232528352 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74b406b700 0x7f74b41535a0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.599+0000 7f74b8a00640 1 -- 172.21.15.55:0/232528352 >> 172.21.15.55:0/232528352 conn(0x7f74b40b21d0 msgr2=0x7f74b40b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.599+0000 7f74b8a00640 1 -- 172.21.15.55:0/232528352 shutdown_connections 2024-04-02T07:34:46.600 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:46.599+0000 7f74b8a00640 1 -- 172.21.15.55:0/232528352 wait complete. 2024-04-02T07:34:46.618 INFO:tasks.cephfs_test_runner:test_orphan_scan (tasks.cephfs.test_forward_scrub.TestForwardScrub) ... ok 2024-04-02T07:34:46.619 INFO:tasks.cephfs_test_runner: 2024-04-02T07:34:46.619 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-04-02T07:34:46.619 INFO:tasks.cephfs_test_runner:Ran 7 tests in 717.417s 2024-04-02T07:34:46.619 INFO:tasks.cephfs_test_runner: 2024-04-02T07:34:46.619 INFO:tasks.cephfs_test_runner:OK 2024-04-02T07:34:46.619 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-04-02T07:34:46.629 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-02T07:34:46.721 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-02T07:34:46.721 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:34:46.721 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:34:46.731 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:34:46.731 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2024-04-02T07:34:46.731 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:34:46.780 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16357712k,nr_inodes=4089428,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9467 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275992k,nr_inodes=818998,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275996k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-04-02T07:34:46.780 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:34:46.780 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:34:46.789 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:34:46.789 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-02T07:34:46.790 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-02T07:34:46.839 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 udev /dev devtmpfs rw,nosuid,relatime,size=16354616k,nr_inodes=4088654,mode=755 0 0 devpts /dev/pts devpts rw,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 /dev/sda1 / ext4 rw,relatime,errors=remount-ro 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,nosuid,nodev 0 0 tmpfs /run/lock tmpfs rw,nosuid,nodev,noexec,relatime,size=5120k 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=30,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=9548 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,nosuid,nodev,noexec,relatime 0 0 nfsd /proc/fs/nfsd nfsd rw,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysusers.service ramfs ro,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /run/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,nosuid,nodev,relatime,size=3275372k,nr_inodes=818843,mode=700,uid=1000,gid=1271 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,nosuid,nodev,noexec,relatime,size=3275376k,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-04-02T07:34:46.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:46.839 DEBUG:teuthology.orchestra.run.smithi055:> ip netns list 2024-04-02T07:34:46.848 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-02T07:34:46.848 INFO:teuthology.orchestra.run.smithi055.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-04-02T07:34:46.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:46.848 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-02T07:34:46.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:46.915 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-04-02T07:34:46.995 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:46.995 DEBUG:teuthology.orchestra.run.smithi055:> sudo ip link delete ceph-brx 2024-04-02T07:34:47.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:47.178 DEBUG:teuthology.orchestra.run.smithi106:> ip netns list 2024-04-02T07:34:47.188 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-02T07:34:47.188 INFO:teuthology.orchestra.run.smithi106.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-04-02T07:34:47.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:47.189 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-02T07:34:47.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:47.253 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-04-02T07:34:47.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-02T07:34:47.323 DEBUG:teuthology.orchestra.run.smithi106:> sudo ip link delete ceph-brx 2024-04-02T07:34:47.525 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-02T07:34:47.535 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-02T07:34:47.535 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:34:47.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.679+0000 7f03a5a00640 1 Processor -- start 2024-04-02T07:34:47.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.679+0000 7f03a5a00640 1 -- start start 2024-04-02T07:34:47.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.679+0000 7f03a5a00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f03a0153ea0 0x7f03a00c4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:47.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.679+0000 7f03a5a00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a013d0c0 con 0x7f03a015a070 2024-04-02T07:34:47.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.679+0000 7f03a5a00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03a015a4f0 con 0x7f03a0159be0 2024-04-02T07:34:47.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.679+0000 7f03a5a00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a015a7d0 con 0x7f03a0153ea0 2024-04-02T07:34:47.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.679+0000 7f039f400640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f03a015a070 0x7f03a013d550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41192/0 (socket says 172.21.15.55:41192) 2024-04-02T07:34:47.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.679+0000 7f039ea00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f03a0153ea0 0x7f03a00c4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:47.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.679+0000 7f039f400640 1 -- 172.21.15.55:0/417423815 learned_addr learned my addr 172.21.15.55:0/417423815 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:47.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.679+0000 7f039ea00640 1 -- 172.21.15.55:0/417423815 >> v1:172.21.15.106:6789/0 conn(0x7f03a0159be0 legacy=0x7f03a00b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:47.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.679+0000 7f039ea00640 1 -- 172.21.15.55:0/417423815 >> v1:172.21.15.55:6789/0 conn(0x7f03a015a070 legacy=0x7f03a013d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:47.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.679+0000 7f039ea00640 1 -- 172.21.15.55:0/417423815 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a015aab0 con 0x7f03a0153ea0 2024-04-02T07:34:47.679 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.679+0000 7f039e000640 1 -- 172.21.15.55:0/417423815 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 435097204 0 0) 0x7f03a013d0c0 con 0x7f03a015a070 2024-04-02T07:34:47.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.683+0000 7f039ea00640 1 --2- 172.21.15.55:0/417423815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a0153ea0 0x7f03a00c4120 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f0390009d90 tx=0x7f039001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48813bf217097aec server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:47.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.683+0000 7f039e000640 1 -- 172.21.15.55:0/417423815 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03900a5a10 con 0x7f03a0153ea0 2024-04-02T07:34:47.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.683+0000 7f039e000640 1 -- 172.21.15.55:0/417423815 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03900a5b70 con 0x7f03a0153ea0 2024-04-02T07:34:47.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.683+0000 7f039e000640 1 -- 172.21.15.55:0/417423815 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03900ad440 con 0x7f03a0153ea0 2024-04-02T07:34:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.683+0000 7f03a5a00640 1 -- 172.21.15.55:0/417423815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a0153ea0 msgr2=0x7f03a00c4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.683+0000 7f03a5a00640 1 --2- 172.21.15.55:0/417423815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a0153ea0 0x7f03a00c4120 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f0390009d90 tx=0x7f039001c930 comp rx=0 tx=0).stop 2024-04-02T07:34:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.683+0000 7f03a5a00640 1 -- 172.21.15.55:0/417423815 shutdown_connections 2024-04-02T07:34:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.683+0000 7f03a5a00640 1 --2- 172.21.15.55:0/417423815 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a0153ea0 0x7f03a00c4120 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.683+0000 7f03a5a00640 1 -- 172.21.15.55:0/417423815 >> 172.21.15.55:0/417423815 conn(0x7f03a0066080 msgr2=0x7f03a0069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.683+0000 7f03a5a00640 1 -- 172.21.15.55:0/417423815 shutdown_connections 2024-04-02T07:34:47.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.683+0000 7f03a5a00640 1 -- 172.21.15.55:0/417423815 wait complete. 2024-04-02T07:34:47.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f03a5a00640 1 Processor -- start 2024-04-02T07:34:47.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f03a5a00640 1 -- start start 2024-04-02T07:34:47.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f03a5a00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03a0153ea0 0x7f03a00c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:47.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f03a5a00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a0159be0 0x7f03a0131ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:47.686 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f03a5a00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f03a015a070 0x7f03a013b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:47.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f03a5a00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a00c4160 con 0x7f03a0159be0 2024-04-02T07:34:47.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f03a5a00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a00cdf90 con 0x7f03a0153ea0 2024-04-02T07:34:47.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f03a5a00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a00ce420 con 0x7f03a015a070 2024-04-02T07:34:47.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f0396000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a0159be0 0x7f03a0131ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:47.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f0396000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a0159be0 0x7f03a0131ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46426/0 (socket says 172.21.15.55:46426) 2024-04-02T07:34:47.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f0396000640 1 -- 172.21.15.55:0/3911908444 learned_addr learned my addr 172.21.15.55:0/3911908444 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:47.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f039ea00640 1 --2- 172.21.15.55:0/3911908444 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03a0153ea0 0x7f03a00c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:47.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f039f400640 1 --2- 172.21.15.55:0/3911908444 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f03a015a070 0x7f03a013b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:47.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f0396000640 1 -- 172.21.15.55:0/3911908444 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f03a015a070 msgr2=0x7f03a013b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:47.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f0396000640 1 --2- 172.21.15.55:0/3911908444 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f03a015a070 0x7f03a013b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:47.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f0396000640 1 -- 172.21.15.55:0/3911908444 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03a0153ea0 msgr2=0x7f03a00c3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:47.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f0396000640 1 --2- 172.21.15.55:0/3911908444 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03a0153ea0 0x7f03a00c3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:47.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f0396000640 1 -- 172.21.15.55:0/3911908444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0390009a70 con 0x7f03a0159be0 2024-04-02T07:34:47.687 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f039ea00640 1 --2- 172.21.15.55:0/3911908444 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03a0153ea0 0x7f03a00c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:47.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f0396000640 1 --2- 172.21.15.55:0/3911908444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a0159be0 0x7f03a0131ed0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f038800c450 tx=0x7f038800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:47.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f0397400640 1 -- 172.21.15.55:0/3911908444 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388012830 con 0x7f03a0159be0 2024-04-02T07:34:47.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f0397400640 1 -- 172.21.15.55:0/3911908444 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03880129b0 con 0x7f03a0159be0 2024-04-02T07:34:47.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f0397400640 1 -- 172.21.15.55:0/3911908444 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0388012d60 con 0x7f03a0159be0 2024-04-02T07:34:47.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f03a5a00640 1 -- 172.21.15.55:0/3911908444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a00cd380 con 0x7f03a0159be0 2024-04-02T07:34:47.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f03a5a00640 1 -- 172.21.15.55:0/3911908444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a00cd940 con 0x7f03a0159be0 2024-04-02T07:34:47.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.687+0000 7f03a5a00640 1 -- 172.21.15.55:0/3911908444 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a01599a0 con 0x7f03a0159be0 2024-04-02T07:34:47.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.691+0000 7f0397400640 1 -- 172.21.15.55:0/3911908444 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f038801c460 con 0x7f03a0159be0 2024-04-02T07:34:47.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.691+0000 7f0397400640 1 --2- 172.21.15.55:0/3911908444 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f037c066690 0x7f037c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:47.689 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.691+0000 7f0397400640 1 -- 172.21.15.55:0/3911908444 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f0388083e20 con 0x7f03a0159be0 2024-04-02T07:34:47.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.691+0000 7f039ea00640 1 --2- 172.21.15.55:0/3911908444 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f037c066690 0x7f037c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:47.690 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.691+0000 7f039ea00640 1 --2- 172.21.15.55:0/3911908444 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f037c066690 0x7f037c068b50 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f03900af000 tx=0x7f03900a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:47.693 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.695+0000 7f0397400640 1 -- 172.21.15.55:0/3911908444 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f03880513d0 con 0x7f03a0159be0 2024-04-02T07:34:47.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.851+0000 7f03a5a00640 1 -- 172.21.15.55:0/3911908444 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f03a0167230 con 0x7f037c066690 2024-04-02T07:34:47.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.855+0000 7f0397400640 1 -- 172.21.15.55:0/3911908444 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50475 (secure 0 0 0) 0x7f03900a5890 con 0x7f037c066690 2024-04-02T07:34:47.854 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:47.855 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:34:47.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.859+0000 7f03a5a00640 1 -- 172.21.15.55:0/3911908444 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f037c066690 msgr2=0x7f037c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:47.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.859+0000 7f03a5a00640 1 --2- 172.21.15.55:0/3911908444 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f037c066690 0x7f037c068b50 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f03900af000 tx=0x7f03900a7070 comp rx=0 tx=0).stop 2024-04-02T07:34:47.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.859+0000 7f03a5a00640 1 -- 172.21.15.55:0/3911908444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a0159be0 msgr2=0x7f03a0131ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:47.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.859+0000 7f03a5a00640 1 --2- 172.21.15.55:0/3911908444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a0159be0 0x7f03a0131ed0 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f038800c450 tx=0x7f038800c910 comp rx=0 tx=0).stop 2024-04-02T07:34:47.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.859+0000 7f03a5a00640 1 -- 172.21.15.55:0/3911908444 shutdown_connections 2024-04-02T07:34:47.856 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.859+0000 7f03a5a00640 1 --2- 172.21.15.55:0/3911908444 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f03a015a070 0x7f03a013b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:47.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.859+0000 7f03a5a00640 1 --2- 172.21.15.55:0/3911908444 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f03a0159be0 0x7f03a0131ed0 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:47.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.859+0000 7f03a5a00640 1 --2- 172.21.15.55:0/3911908444 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f037c066690 0x7f037c068b50 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:47.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.859+0000 7f03a5a00640 1 --2- 172.21.15.55:0/3911908444 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f03a0153ea0 0x7f03a00c3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:47.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.859+0000 7f03a5a00640 1 -- 172.21.15.55:0/3911908444 >> 172.21.15.55:0/3911908444 conn(0x7f03a0066080 msgr2=0x7f03a015acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:47.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.859+0000 7f03a5a00640 1 -- 172.21.15.55:0/3911908444 shutdown_connections 2024-04-02T07:34:47.857 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:47.859+0000 7f03a5a00640 1 -- 172.21.15.55:0/3911908444 wait complete. 2024-04-02T07:34:47.875 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":496,"stamp":"2024-04-02T07:34:46.525634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":278424,"kb_used_data":29480,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754696296,"statfs":{"total":773094113280,"available":772809007104,"internally_reserved":0,"allocated":30187520,"data_stored":23272766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390586,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-264,"num_write":-172,"num_write_kb":-8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001705"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":256,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-02T07:34:44.583568+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:34:44.583568+0000","last_peered":"2024-04-02T07:34:44.583568+0000","last_clean":"2024-04-02T07:34:44.583568+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:34:44.583568+0000","last_undegraded":"2024-04-02T07:34:44.583568+0000","last_fullsized":"2024-04-02T07:34:44.583568+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575002,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33184,"kb_used_data":2064,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338656,"statfs":{"total":96636764160,"available":96602783744,"internally_reserved":0,"allocated":2113536,"data_stored":1253763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68799999999999994,"15min":0.66600000000000004},"min":{"1min":0.51900000000000002,"5min":0.39400000000000002,"15min":0.35299999999999998},"max":{"1min":0.86899999999999999,"5min":0.92400000000000004,"15min":1.0569999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67800000000000005,"15min":0.65000000000000002},"min":{"1min":0.52000000000000002,"5min":0.442,"15min":0.39900000000000002},"max":{"1min":0.93100000000000005,"5min":1.018,"15min":1.018},"last":0.64000000000000001}]},{"osd":1,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.88200000000000001,"5min":1.004,"15min":1.0289999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69899999999999995,"15min":0.68100000000000005},"min":{"1min":0.54500000000000004,"5min":0.46899999999999997,"15min":0.39500000000000002},"max":{"1min":0.85599999999999998,"5min":0.99299999999999999,"15min":1.113},"last":0.752}]},{"osd":2,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.749,"15min":0.752},"min":{"1min":0.61199999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98999999999999999,"5min":1.0309999999999999,"15min":1.139},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.752,"15min":0.73299999999999998},"min":{"1min":0.56699999999999995,"5min":0.503,"15min":0.437},"max":{"1min":0.97399999999999998,"5min":1.0549999999999999,"15min":1.522},"last":0.70199999999999996}]},{"osd":3,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71299999999999997,"15min":0.70599999999999996},"min":{"1min":0.53400000000000003,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.87,"5min":1.0409999999999999,"15min":1.405},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.72899999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.48599999999999999},"max":{"1min":0.95399999999999996,"5min":1.0329999999999999,"15min":1.0580000000000001},"last":1.026}]},{"osd":4,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.58499999999999996,"15min":0.625},"min":{"1min":0.39400000000000002,"5min":0.37,"15min":0.34399999999999997},"max":{"1min":0.998,"5min":0.998,"15min":1.633},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.66900000000000004,"15min":0.69399999999999995},"min":{"1min":0.46000000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92900000000000005,"5min":0.94299999999999995,"15min":1.079},"last":0.90200000000000002}]},{"osd":5,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.67200000000000004},"min":{"1min":0.441,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88800000000000001,"5min":0.995,"15min":1.2250000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.71699999999999997,"15min":0.73599999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.43099999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.5609999999999999},"last":0.86399999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.49299999999999999,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.5960000000000001},"last":1.002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.66900000000000004,"15min":0.67600000000000005},"min":{"1min":0.41499999999999998,"5min":0.41399999999999998,"15min":0.40699999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0840000000000001},"last":1.056}]}]},{"osd":6,"up_from":13,"seq":55834575003,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36704,"kb_used_data":5584,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":5718016,"data_stored":4857706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72199999999999998,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.45600000000000002,"15min":0.41399999999999998},"max":{"1min":1.002,"5min":1.147,"15min":1.399},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72699999999999998,"15min":0.76700000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":5.7569999999999997},"last":0.81999999999999995}]},{"osd":1,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.74199999999999999,"15min":0.72299999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.38200000000000001},"max":{"1min":0.96499999999999997,"5min":1.097,"15min":1.95},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.74199999999999999,"15min":0.73099999999999998},"min":{"1min":0.58899999999999997,"5min":0.51400000000000001,"15min":0.47599999999999998},"max":{"1min":0.93600000000000005,"5min":1.0449999999999999,"15min":1.248},"last":0.89300000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72799999999999998,"15min":0.70199999999999996},"min":{"1min":0.53000000000000003,"5min":0.51700000000000002,"15min":0.45000000000000001},"max":{"1min":0.95499999999999996,"5min":0.97699999999999998,"15min":1.226},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.755,"15min":0.73099999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92200000000000004,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.79500000000000004}]},{"osd":3,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.63600000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91600000000000004,"5min":1.006,"15min":2.3119999999999998},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.51900000000000002,"5min":0.49299999999999999,"15min":0.47699999999999998},"max":{"1min":0.996,"5min":1.0660000000000001,"15min":2.6389999999999998},"last":0.83999999999999997}]},{"osd":4,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.40100000000000002,"5min":0.39600000000000002,"15min":0.34999999999999998},"max":{"1min":0.89500000000000002,"5min":1.236,"15min":1.236},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63500000000000001,"15min":0.64300000000000002},"min":{"1min":0.49199999999999999,"5min":0.437,"15min":0.38500000000000001},"max":{"1min":0.93799999999999994,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.70699999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.61599999999999999,"15min":0.63300000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.37},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.95999999999999996},"last":0.871},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.52600000000000002,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":0.90100000000000002,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.90800000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.57699999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.86699999999999999,"5min":3.3290000000000002,"15min":3.3290000000000002},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68000000000000005,"15min":0.70599999999999996},"min":{"1min":0.52000000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98299999999999998,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.68899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67800000000000005,"15min":0.66800000000000004},"min":{"1min":0.55100000000000005,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.94899999999999995,"5min":0.995,"15min":1.25},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.52600000000000002,"5min":0.42399999999999999,"15min":0.33000000000000002},"max":{"1min":0.91800000000000004,"5min":0.96599999999999997,"15min":1.5289999999999999},"last":0.48599999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72599999999999998,"15min":0.71399999999999997},"min":{"1min":0.51800000000000002,"5min":0.45900000000000002,"15min":0.371},"max":{"1min":0.91500000000000004,"5min":0.995,"15min":1.1830000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.56399999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85599999999999998,"5min":1.0069999999999999,"15min":1.3420000000000001},"last":0.625}]},{"osd":2,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76300000000000001,"15min":0.78500000000000003},"min":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.44900000000000001},"max":{"1min":0.878,"5min":1.0129999999999999,"15min":1.8280000000000001},"last":0.748},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.40999999999999998,"15min":0.39700000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.696},"last":0.76700000000000002}]},{"osd":3,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.74099999999999999},"min":{"1min":0.57199999999999995,"5min":0.498,"15min":0.40899999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.6399999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.74399999999999999,"15min":0.76600000000000001},"min":{"1min":0.56799999999999995,"5min":0.51800000000000002,"15min":0.46800000000000003},"max":{"1min":0.84399999999999997,"5min":1.01,"15min":2.0219999999999998},"last":0.83699999999999997}]},{"osd":4,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.58899999999999997,"15min":0.625},"min":{"1min":0.44900000000000001,"5min":0.36899999999999999,"15min":0.32500000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.911},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61399999999999999,"15min":0.67300000000000004},"min":{"1min":0.42999999999999999,"5min":0.38500000000000001,"15min":0.307},"max":{"1min":0.99199999999999999,"5min":1.0649999999999999,"15min":1.7829999999999999},"last":0.89400000000000002}]},{"osd":6,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63800000000000001,"15min":0.71199999999999997},"min":{"1min":0.44700000000000001,"5min":0.439,"15min":0.39600000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":2.1829999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65500000000000003,"15min":0.70999999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.36499999999999999},"max":{"1min":0.996,"5min":1.1359999999999999,"15min":2.1280000000000001},"last":0.53000000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68400000000000005,"15min":0.745},"min":{"1min":0.47799999999999998,"5min":0.435,"15min":0.38300000000000001},"max":{"1min":1.107,"5min":1.1319999999999999,"15min":1.887},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70699999999999996,"15min":0.77600000000000002},"min":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.439},"max":{"1min":0.89400000000000002,"5min":1.056,"15min":2.2599999999999998},"last":0.79200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575005,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.67500000000000004,"15min":0.69599999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77000000000000002,"5min":0.93400000000000005,"15min":2.4929999999999999},"last":0.433},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.67100000000000004,"15min":0.72199999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83699999999999997,"5min":0.94799999999999995,"15min":3.2519999999999998},"last":0.77100000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.94099999999999995,"5min":0.96999999999999997,"15min":1.4279999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69899999999999995,"15min":0.77100000000000002},"min":{"1min":0.46899999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79100000000000004,"5min":1.0069999999999999,"15min":4.3810000000000002},"last":1.0349999999999999}]},{"osd":2,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.72699999999999998,"15min":0.75},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82499999999999996,"5min":1.1990000000000001,"15min":2.056},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.70899999999999996,"15min":0.76900000000000002},"min":{"1min":0.496,"5min":0.436,"15min":0.436},"max":{"1min":0.88500000000000001,"5min":1.038,"15min":3.3420000000000001},"last":0.878}]},{"osd":3,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.75,"15min":0.83099999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.436},"max":{"1min":0.92300000000000004,"5min":1.091,"15min":3.9180000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.76200000000000001,"15min":0.84199999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93200000000000005,"5min":1.1279999999999999,"15min":3.9750000000000001},"last":0.92700000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59199999999999997,"15min":0.63700000000000001},"min":{"1min":0.39300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.91100000000000003,"5min":1.1120000000000001,"15min":1.2509999999999999},"last":0.629},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59699999999999998,"15min":0.65800000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.36699999999999999},"max":{"1min":0.92300000000000004,"5min":0.98199999999999998,"15min":1.4419999999999999},"last":0.68700000000000006}]},{"osd":6,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.65300000000000002},"min":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.33400000000000002},"max":{"1min":0.82799999999999996,"5min":1.0760000000000001,"15min":1.2949999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67700000000000005,"15min":0.71299999999999997},"min":{"1min":0.503,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86299999999999999,"5min":1.2529999999999999,"15min":1.3069999999999999},"last":0.85499999999999998}]},{"osd":7,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68100000000000005,"15min":0.73099999999999998},"min":{"1min":0.46100000000000002,"5min":0.434,"15min":0.432},"max":{"1min":1.0129999999999999,"5min":1.034,"15min":1.2689999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77200000000000002,"15min":0.80700000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.2949999999999999,"15min":1.353},"last":1.081}]}]},{"osd":3,"up_from":13,"seq":55834575003,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36700,"kb_used_data":5584,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94335140,"statfs":{"total":96636764160,"available":96599183360,"internally_reserved":0,"allocated":5718016,"data_stored":4852845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45300000000000001,"15min":0.44600000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26300000000000001},"max":{"1min":0.54900000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.48099999999999998,"15min":0.48199999999999998},"min":{"1min":0.308,"5min":0.30399999999999999,"15min":0.28699999999999998},"max":{"1min":0.56799999999999995,"5min":0.68000000000000005,"15min":1.0109999999999999},"last":0.42299999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46500000000000002,"15min":0.45100000000000001},"min":{"1min":0.29499999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71099999999999997,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69899999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.496}]},{"osd":2,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80900000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.41699999999999998,"5min":0.35399999999999998,"15min":0.33400000000000002},"max":{"1min":0.77900000000000003,"5min":0.82099999999999995,"15min":1.306},"last":0.53900000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75600000000000001,"15min":0.74299999999999999},"min":{"1min":0.50600000000000001,"5min":0.45800000000000002,"15min":0.40500000000000003},"max":{"1min":1.099,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.78600000000000003,"15min":0.76100000000000001},"min":{"1min":0.57899999999999996,"5min":0.52700000000000002,"15min":0.46500000000000002},"max":{"1min":1.0169999999999999,"5min":1.306,"15min":1.306},"last":0.67500000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78600000000000003,"15min":0.77800000000000002},"min":{"1min":0.56000000000000005,"5min":0.502,"15min":0.501},"max":{"1min":1.123,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78300000000000003,"15min":0.76100000000000001},"min":{"1min":0.51500000000000001,"5min":0.48999999999999999,"15min":0.48899999999999999},"max":{"1min":1.0820000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.69099999999999995}]},{"osd":6,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77900000000000003,"15min":0.76500000000000001},"min":{"1min":0.498,"5min":0.49399999999999999,"15min":0.44500000000000001},"max":{"1min":1.1950000000000001,"5min":1.258,"15min":1.258},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.79300000000000004},"min":{"1min":0.58999999999999997,"5min":0.55800000000000005,"15min":0.52000000000000002},"max":{"1min":1.0669999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.80000000000000004,"15min":0.76900000000000002},"min":{"1min":0.54900000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0529999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.745},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79700000000000004,"15min":0.79200000000000004},"min":{"1min":0.59199999999999997,"5min":0.53500000000000003,"15min":0.47499999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.2869999999999999},"last":0.80700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575003,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47099999999999997,"15min":0.45200000000000001},"min":{"1min":0.308,"5min":0.25800000000000001,"15min":0.253},"max":{"1min":0.68799999999999994,"5min":0.78800000000000003,"15min":0.79100000000000004},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51200000000000001,"15min":0.495},"min":{"1min":0.32100000000000001,"5min":0.28299999999999997,"15min":0.27300000000000002},"max":{"1min":0.85899999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.36299999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35099999999999998},"max":{"1min":0.77800000000000002,"5min":0.876,"15min":1.171},"last":0.438},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53100000000000003,"15min":0.504},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.752,"5min":0.878,"15min":1.333},"last":0.40300000000000002}]},{"osd":3,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56899999999999995,"15min":0.53500000000000003},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.32700000000000001},"max":{"1min":0.69999999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.60399999999999998,"15min":0.57899999999999996},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.35799999999999998},"max":{"1min":0.83799999999999997,"5min":0.90000000000000002,"15min":1.1140000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.58399999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98499999999999999,"5min":1.1379999999999999,"15min":2.254},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79000000000000004,"15min":0.77600000000000002},"min":{"1min":0.53100000000000003,"5min":0.498,"15min":0.42799999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.3420000000000001},"last":0.75600000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79200000000000004,"15min":0.77300000000000002},"min":{"1min":0.60599999999999998,"5min":0.54000000000000004,"15min":0.46200000000000002},"max":{"1min":1.0620000000000001,"5min":1.1439999999999999,"15min":1.3740000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81799999999999995,"15min":0.80400000000000005},"min":{"1min":0.60599999999999998,"5min":0.57399999999999995,"15min":0.443},"max":{"1min":1.133,"5min":1.2070000000000001,"15min":2.0840000000000001},"last":0.74099999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83199999999999996,"15min":0.82299999999999995},"min":{"1min":0.63900000000000001,"5min":0.56499999999999995,"15min":0.54600000000000004},"max":{"1min":1.1830000000000001,"5min":1.1990000000000001,"15min":1.5029999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.87,"15min":0.83999999999999997},"min":{"1min":0.71099999999999997,"5min":0.61099999999999999,"15min":0.52700000000000002},"max":{"1min":1.155,"5min":1.159,"15min":1.425},"last":0.71399999999999997}]},{"osd":7,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81100000000000005,"15min":0.81399999999999995},"min":{"1min":0.66200000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0840000000000001,"5min":1.1799999999999999,"15min":2.3580000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.82899999999999996,"15min":0.82099999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.54300000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.377},"last":0.70599999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575002,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36696,"kb_used_data":5580,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94335144,"statfs":{"total":96636764160,"available":96599187456,"internally_reserved":0,"allocated":5713920,"data_stored":4857699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.439,"15min":0.45400000000000001},"min":{"1min":0.27800000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.69999999999999996,"5min":0.77200000000000002,"15min":1.2150000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.47499999999999998,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.28799999999999998,"15min":0.26200000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":4.157},"last":0.46100000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.53700000000000003},"min":{"1min":0.312,"5min":0.30599999999999999,"15min":0.28999999999999998},"max":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":4.282},"last":0.443},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53000000000000003,"15min":0.55200000000000005},"min":{"1min":0.376,"5min":0.37,"15min":0.33600000000000002},"max":{"1min":0.70699999999999996,"5min":0.81000000000000005,"15min":1.625},"last":0.38900000000000001}]},{"osd":3,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.38200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.76400000000000001,"5min":0.88800000000000001,"15min":1.1120000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54800000000000004,"15min":0.66600000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":8.1620000000000008},"last":0.499}]},{"osd":4,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71899999999999997,"15min":0.80700000000000005},"min":{"1min":0.436,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":4.7400000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76300000000000001,"15min":0.78500000000000003},"min":{"1min":0.55900000000000005,"5min":0.53000000000000003,"15min":0.50600000000000001},"max":{"1min":1.071,"5min":1.125,"15min":1.7070000000000001},"last":0.68899999999999995}]},{"osd":5,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.75700000000000001,"15min":0.82599999999999996},"min":{"1min":0.52000000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.302,"5min":1.321,"15min":4.5759999999999996},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.751,"15min":0.82199999999999995},"min":{"1min":0.52800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.018,"5min":1.3680000000000001,"15min":4.7949999999999999},"last":0.625}]},{"osd":6,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77700000000000002,"15min":0.84799999999999998},"min":{"1min":0.56699999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0640000000000001,"5min":1.0820000000000001,"15min":4.6890000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76500000000000001,"15min":0.83699999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.141,"5min":1.141,"15min":4.6059999999999999},"last":0.66200000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77600000000000002,"15min":0.79600000000000004},"min":{"1min":0.54400000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1539999999999999,"5min":1.206,"15min":1.8759999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.78500000000000003,"15min":0.85399999999999998},"min":{"1min":0.53200000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":4.6420000000000003},"last":0.60899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37284,"kb_used_data":6168,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94334556,"statfs":{"total":96636764160,"available":96598585344,"internally_reserved":0,"allocated":6316032,"data_stored":5443255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42599999999999999,"15min":0.441},"min":{"1min":0.32500000000000001,"5min":0.27800000000000002,"15min":0.26300000000000001},"max":{"1min":0.621,"5min":0.621,"15min":1.48},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.5,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":0.747,"15min":1.2330000000000001},"last":0.372}]},{"osd":2,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.50700000000000001},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.29099999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.3129999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32400000000000001},"max":{"1min":0.64800000000000002,"5min":0.76700000000000002,"15min":0.82599999999999996},"last":0.53900000000000003}]},{"osd":3,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28199999999999997},"max":{"1min":0.68000000000000005,"5min":0.82799999999999996,"15min":0.84799999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58399999999999996,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40300000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.4430000000000001},"last":0.58799999999999997}]},{"osd":4,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.53700000000000003,"5min":0.505,"15min":0.46200000000000002},"max":{"1min":0.98099999999999998,"5min":1.0149999999999999,"15min":1.0569999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.1240000000000001},"last":0.87}]},{"osd":5,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.746,"15min":0.76200000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.47599999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.371},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.745,"15min":0.755},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.997,"5min":0.997,"15min":1.143},"last":0.88700000000000001}]},{"osd":6,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77800000000000002,"15min":0.78600000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.52500000000000002},"max":{"1min":0.97599999999999998,"5min":1.038,"15min":1.177},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79800000000000004,"15min":0.81399999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.4099999999999999},"last":0.85199999999999998}]},{"osd":7,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75900000000000001,"15min":0.77700000000000002},"min":{"1min":0.58799999999999997,"5min":0.56100000000000005,"15min":0.54800000000000004},"max":{"1min":0.98399999999999999,"5min":1.028,"15min":1.135},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76900000000000002,"15min":0.77700000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.48399999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.746}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:34:47.877 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:34:48.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1049200640 1 Processor -- start 2024-04-02T07:34:48.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1049200640 1 -- start start 2024-04-02T07:34:48.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1049200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f10441517b0 0x7f10440adf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1049200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10440cdc20 0x7f10440ce0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1049200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10440cc350 con 0x7f104415e2c0 2024-04-02T07:34:48.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1049200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1044151b90 con 0x7f10441517b0 2024-04-02T07:34:48.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1049200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10440cb740 con 0x7f10440cdc20 2024-04-02T07:34:48.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1042800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f104415e2c0 0x7f104415e750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41198/0 (socket says 172.21.15.55:41198) 2024-04-02T07:34:48.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1042800640 1 -- 172.21.15.55:0/799026407 learned_addr learned my addr 172.21.15.55:0/799026407 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:48.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041e00640 1 --2- 172.21.15.55:0/799026407 >> v2:172.21.15.106:3300/0 conn(0x7f10441517b0 0x7f10440adf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1039400640 1 --2- 172.21.15.55:0/799026407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10440cdc20 0x7f10440ce0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041400640 1 -- 172.21.15.55:0/799026407 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1540186358 0 0) 0x7f10440cc350 con 0x7f104415e2c0 2024-04-02T07:34:48.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041400640 1 -- 172.21.15.55:0/799026407 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1028003530 con 0x7f104415e2c0 2024-04-02T07:34:48.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041400640 1 -- 172.21.15.55:0/799026407 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3318510972 0 0) 0x7f1028003530 con 0x7f104415e2c0 2024-04-02T07:34:48.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041400640 1 -- 172.21.15.55:0/799026407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10440cdc20 msgr2=0x7f10440ce0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:48.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041400640 1 --2- 172.21.15.55:0/799026407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10440cdc20 0x7f10440ce0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041400640 1 -- 172.21.15.55:0/799026407 >> v2:172.21.15.106:3300/0 conn(0x7f10441517b0 msgr2=0x7f10440adf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:48.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041400640 1 --2- 172.21.15.55:0/799026407 >> v2:172.21.15.106:3300/0 conn(0x7f10441517b0 0x7f10440adf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041400640 1 -- 172.21.15.55:0/799026407 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10440cba20 con 0x7f104415e2c0 2024-04-02T07:34:48.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041400640 1 -- 172.21.15.55:0/799026407 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 3525916342 0 0) 0x7f103c001680 con 0x7f104415e2c0 2024-04-02T07:34:48.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041400640 1 -- 172.21.15.55:0/799026407 >> v1:172.21.15.55:6789/0 conn(0x7f104415e2c0 legacy=0x7f104415e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:48.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041400640 1 --2- 172.21.15.55:0/799026407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1028003980 0x7f1028003da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041400640 1 --2- 172.21.15.55:0/799026407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10440cdc20 0x7f10280047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041400640 1 --2- 172.21.15.55:0/799026407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1028004d10 0x7f1028005190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041400640 1 -- 172.21.15.55:0/799026407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1044151b90 con 0x7f1028003980 2024-04-02T07:34:48.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041400640 1 -- 172.21.15.55:0/799026407 --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10440cb740 con 0x7f1028004d10 2024-04-02T07:34:48.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041400640 1 -- 172.21.15.55:0/799026407 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102800b990 con 0x7f10440cdc20 2024-04-02T07:34:48.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041e00640 1 --2- 172.21.15.55:0/799026407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1028003980 0x7f1028003da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1042800640 1 --2- 172.21.15.55:0/799026407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1028004d10 0x7f1028005190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.021 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1039400640 1 --2- 172.21.15.55:0/799026407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10440cdc20 0x7f10280047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041e00640 1 -- 172.21.15.55:0/799026407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10440cdc20 msgr2=0x7f10280047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:48.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041e00640 1 --2- 172.21.15.55:0/799026407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10440cdc20 0x7f10280047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041e00640 1 -- 172.21.15.55:0/799026407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1028004d10 msgr2=0x7f1028005190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:48.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041e00640 1 --2- 172.21.15.55:0/799026407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1028004d10 0x7f1028005190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1041e00640 1 -- 172.21.15.55:0/799026407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1028003530 con 0x7f1028003980 2024-04-02T07:34:48.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.019+0000 7f1039400640 1 --2- 172.21.15.55:0/799026407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f10440cdc20 0x7f10280047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:48.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.023+0000 7f1041e00640 1 --2- 172.21.15.55:0/799026407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1028003980 0x7f1028003da0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f1034009fc0 tx=0x7f103401cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6992881080f847 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:48.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.023+0000 7f1041400640 1 -- 172.21.15.55:0/799026407 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10340a5c60 con 0x7f1028003980 2024-04-02T07:34:48.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.023+0000 7f1041400640 1 -- 172.21.15.55:0/799026407 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f103400f040 con 0x7f1028003980 2024-04-02T07:34:48.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.023+0000 7f1041400640 1 -- 172.21.15.55:0/799026407 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10340ad440 con 0x7f1028003980 2024-04-02T07:34:48.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.023+0000 7f1049200640 1 -- 172.21.15.55:0/799026407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1028003980 msgr2=0x7f1028003da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:48.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.023+0000 7f1049200640 1 --2- 172.21.15.55:0/799026407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1028003980 0x7f1028003da0 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f1034009fc0 tx=0x7f103401cc90 comp rx=0 tx=0).stop 2024-04-02T07:34:48.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.023+0000 7f1042800640 1 -- 172.21.15.55:0/799026407 reap_dead start 2024-04-02T07:34:48.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.023+0000 7f1049200640 1 -- 172.21.15.55:0/799026407 shutdown_connections 2024-04-02T07:34:48.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.023+0000 7f1049200640 1 -- 172.21.15.55:0/799026407 >> 172.21.15.55:0/799026407 conn(0x7f10440cec70 msgr2=0x7f10440cf080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:48.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.023+0000 7f1049200640 1 -- 172.21.15.55:0/799026407 shutdown_connections 2024-04-02T07:34:48.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.023+0000 7f1049200640 1 -- 172.21.15.55:0/799026407 wait complete. 2024-04-02T07:34:48.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1049200640 1 Processor -- start 2024-04-02T07:34:48.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1049200640 1 -- start start 2024-04-02T07:34:48.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1049200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1028003980 0x7f10441546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1049200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f104413e300 0x7f104415abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1049200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f104413d590 0x7f104413da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1049200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1044154c20 con 0x7f104413e300 2024-04-02T07:34:48.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1049200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10440b2340 con 0x7f104413d590 2024-04-02T07:34:48.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1049200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f104413df80 con 0x7f1028003980 2024-04-02T07:34:48.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1039400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f104413e300 0x7f104415abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1039400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f104413e300 0x7f104415abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46444/0 (socket says 172.21.15.55:46444) 2024-04-02T07:34:48.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1039400640 1 -- 172.21.15.55:0/2416134381 learned_addr learned my addr 172.21.15.55:0/2416134381 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:48.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1041e00640 1 --2- 172.21.15.55:0/2416134381 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1028003980 0x7f10441546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1042800640 1 --2- 172.21.15.55:0/2416134381 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f104413d590 0x7f104413da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1039400640 1 -- 172.21.15.55:0/2416134381 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1028003980 msgr2=0x7f10441546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:48.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1039400640 1 --2- 172.21.15.55:0/2416134381 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1028003980 0x7f10441546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1039400640 1 -- 172.21.15.55:0/2416134381 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f104413d590 msgr2=0x7f104413da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:48.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1039400640 1 --2- 172.21.15.55:0/2416134381 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f104413d590 0x7f104413da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1039400640 1 -- 172.21.15.55:0/2416134381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10440b2590 con 0x7f104413e300 2024-04-02T07:34:48.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1041e00640 1 --2- 172.21.15.55:0/2416134381 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1028003980 0x7f10441546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:48.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1042800640 1 --2- 172.21.15.55:0/2416134381 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f104413d590 0x7f104413da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:48.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1039400640 1 --2- 172.21.15.55:0/2416134381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f104413e300 0x7f104415abf0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f102c0115f0 tx=0x7f102c011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:48.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f103aa00640 1 -- 172.21.15.55:0/2416134381 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c004220 con 0x7f104413e300 2024-04-02T07:34:48.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f103aa00640 1 -- 172.21.15.55:0/2416134381 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102c004380 con 0x7f104413e300 2024-04-02T07:34:48.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1049200640 1 -- 172.21.15.55:0/2416134381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10440b2870 con 0x7f104413e300 2024-04-02T07:34:48.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f103aa00640 1 -- 172.21.15.55:0/2416134381 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c015870 con 0x7f104413e300 2024-04-02T07:34:48.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.027+0000 7f1049200640 1 -- 172.21.15.55:0/2416134381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10440b2e30 con 0x7f104413e300 2024-04-02T07:34:48.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.031+0000 7f1049200640 1 -- 172.21.15.55:0/2416134381 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f104406ad20 con 0x7f104413e300 2024-04-02T07:34:48.029 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.031+0000 7f103aa00640 1 -- 172.21.15.55:0/2416134381 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f102c0159d0 con 0x7f104413e300 2024-04-02T07:34:48.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.031+0000 7f103aa00640 1 --2- 172.21.15.55:0/2416134381 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f10200666c0 0x7f1020068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.030 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.031+0000 7f103aa00640 1 -- 172.21.15.55:0/2416134381 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f102c084170 con 0x7f104413e300 2024-04-02T07:34:48.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.031+0000 7f1041e00640 1 --2- 172.21.15.55:0/2416134381 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f10200666c0 0x7f1020068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.031 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.031+0000 7f1041e00640 1 --2- 172.21.15.55:0/2416134381 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f10200666c0 0x7f1020068b80 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f10340af000 tx=0x7f10340a7040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:48.034 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.035+0000 7f103aa00640 1 -- 172.21.15.55:0/2416134381 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f102c051690 con 0x7f104413e300 2024-04-02T07:34:48.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.191+0000 7f1049200640 1 -- 172.21.15.55:0/2416134381 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f10440666a0 con 0x7f10200666c0 2024-04-02T07:34:48.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.195+0000 7f103aa00640 1 -- 172.21.15.55:0/2416134381 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50475 (secure 0 0 0) 0x7f10340bd090 con 0x7f10200666c0 2024-04-02T07:34:48.195 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:48.195 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:34:48.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.199+0000 7f1049200640 1 -- 172.21.15.55:0/2416134381 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f10200666c0 msgr2=0x7f1020068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:48.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.199+0000 7f1049200640 1 --2- 172.21.15.55:0/2416134381 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f10200666c0 0x7f1020068b80 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f10340af000 tx=0x7f10340a7040 comp rx=0 tx=0).stop 2024-04-02T07:34:48.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.199+0000 7f1049200640 1 -- 172.21.15.55:0/2416134381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f104413e300 msgr2=0x7f104415abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:48.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.199+0000 7f1049200640 1 --2- 172.21.15.55:0/2416134381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f104413e300 0x7f104415abf0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f102c0115f0 tx=0x7f102c011ab0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.199+0000 7f1049200640 1 -- 172.21.15.55:0/2416134381 shutdown_connections 2024-04-02T07:34:48.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.199+0000 7f1049200640 1 --2- 172.21.15.55:0/2416134381 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f10200666c0 0x7f1020068b80 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.199+0000 7f1049200640 1 --2- 172.21.15.55:0/2416134381 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f104413d590 0x7f104413da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.199+0000 7f1049200640 1 --2- 172.21.15.55:0/2416134381 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f104413e300 0x7f104415abf0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.199+0000 7f1049200640 1 --2- 172.21.15.55:0/2416134381 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1028003980 0x7f10441546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.199+0000 7f1049200640 1 -- 172.21.15.55:0/2416134381 >> 172.21.15.55:0/2416134381 conn(0x7f10440cec70 msgr2=0x7f10440ae6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:48.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.199+0000 7f1049200640 1 -- 172.21.15.55:0/2416134381 shutdown_connections 2024-04-02T07:34:48.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.199+0000 7f1049200640 1 -- 172.21.15.55:0/2416134381 wait complete. 2024-04-02T07:34:48.216 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":496,"stamp":"2024-04-02T07:34:46.525634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":278424,"kb_used_data":29480,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754696296,"statfs":{"total":773094113280,"available":772809007104,"internally_reserved":0,"allocated":30187520,"data_stored":23272766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390586,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-264,"num_write":-172,"num_write_kb":-8294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001705"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":256,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-02T07:34:44.583568+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:34:44.583568+0000","last_peered":"2024-04-02T07:34:44.583568+0000","last_clean":"2024-04-02T07:34:44.583568+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:34:44.583568+0000","last_undegraded":"2024-04-02T07:34:44.583568+0000","last_fullsized":"2024-04-02T07:34:44.583568+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575002,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33184,"kb_used_data":2064,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338656,"statfs":{"total":96636764160,"available":96602783744,"internally_reserved":0,"allocated":2113536,"data_stored":1253763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68799999999999994,"15min":0.66600000000000004},"min":{"1min":0.51900000000000002,"5min":0.39400000000000002,"15min":0.35299999999999998},"max":{"1min":0.86899999999999999,"5min":0.92400000000000004,"15min":1.0569999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67800000000000005,"15min":0.65000000000000002},"min":{"1min":0.52000000000000002,"5min":0.442,"15min":0.39900000000000002},"max":{"1min":0.93100000000000005,"5min":1.018,"15min":1.018},"last":0.64000000000000001}]},{"osd":1,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.88200000000000001,"5min":1.004,"15min":1.0289999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69899999999999995,"15min":0.68100000000000005},"min":{"1min":0.54500000000000004,"5min":0.46899999999999997,"15min":0.39500000000000002},"max":{"1min":0.85599999999999998,"5min":0.99299999999999999,"15min":1.113},"last":0.752}]},{"osd":2,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.749,"15min":0.752},"min":{"1min":0.61199999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98999999999999999,"5min":1.0309999999999999,"15min":1.139},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.752,"15min":0.73299999999999998},"min":{"1min":0.56699999999999995,"5min":0.503,"15min":0.437},"max":{"1min":0.97399999999999998,"5min":1.0549999999999999,"15min":1.522},"last":0.70199999999999996}]},{"osd":3,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71299999999999997,"15min":0.70599999999999996},"min":{"1min":0.53400000000000003,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.87,"5min":1.0409999999999999,"15min":1.405},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.72899999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.48599999999999999},"max":{"1min":0.95399999999999996,"5min":1.0329999999999999,"15min":1.0580000000000001},"last":1.026}]},{"osd":4,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.58499999999999996,"15min":0.625},"min":{"1min":0.39400000000000002,"5min":0.37,"15min":0.34399999999999997},"max":{"1min":0.998,"5min":0.998,"15min":1.633},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.66900000000000004,"15min":0.69399999999999995},"min":{"1min":0.46000000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92900000000000005,"5min":0.94299999999999995,"15min":1.079},"last":0.90200000000000002}]},{"osd":5,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.67200000000000004},"min":{"1min":0.441,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88800000000000001,"5min":0.995,"15min":1.2250000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.71699999999999997,"15min":0.73599999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.43099999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.5609999999999999},"last":0.86399999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.49299999999999999,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.5960000000000001},"last":1.002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.66900000000000004,"15min":0.67600000000000005},"min":{"1min":0.41499999999999998,"5min":0.41399999999999998,"15min":0.40699999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0840000000000001},"last":1.056}]}]},{"osd":6,"up_from":13,"seq":55834575003,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36704,"kb_used_data":5584,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":5718016,"data_stored":4857706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72199999999999998,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.45600000000000002,"15min":0.41399999999999998},"max":{"1min":1.002,"5min":1.147,"15min":1.399},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72699999999999998,"15min":0.76700000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":5.7569999999999997},"last":0.81999999999999995}]},{"osd":1,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.74199999999999999,"15min":0.72299999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.38200000000000001},"max":{"1min":0.96499999999999997,"5min":1.097,"15min":1.95},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.74199999999999999,"15min":0.73099999999999998},"min":{"1min":0.58899999999999997,"5min":0.51400000000000001,"15min":0.47599999999999998},"max":{"1min":0.93600000000000005,"5min":1.0449999999999999,"15min":1.248},"last":0.89300000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72799999999999998,"15min":0.70199999999999996},"min":{"1min":0.53000000000000003,"5min":0.51700000000000002,"15min":0.45000000000000001},"max":{"1min":0.95499999999999996,"5min":0.97699999999999998,"15min":1.226},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.755,"15min":0.73099999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92200000000000004,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.79500000000000004}]},{"osd":3,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.63600000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91600000000000004,"5min":1.006,"15min":2.3119999999999998},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.51900000000000002,"5min":0.49299999999999999,"15min":0.47699999999999998},"max":{"1min":0.996,"5min":1.0660000000000001,"15min":2.6389999999999998},"last":0.83999999999999997}]},{"osd":4,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.40100000000000002,"5min":0.39600000000000002,"15min":0.34999999999999998},"max":{"1min":0.89500000000000002,"5min":1.236,"15min":1.236},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63500000000000001,"15min":0.64300000000000002},"min":{"1min":0.49199999999999999,"5min":0.437,"15min":0.38500000000000001},"max":{"1min":0.93799999999999994,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.70699999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.61599999999999999,"15min":0.63300000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.37},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.95999999999999996},"last":0.871},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.52600000000000002,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":0.90100000000000002,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.90800000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.57699999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.86699999999999999,"5min":3.3290000000000002,"15min":3.3290000000000002},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68000000000000005,"15min":0.70599999999999996},"min":{"1min":0.52000000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98299999999999998,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.68899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67800000000000005,"15min":0.66800000000000004},"min":{"1min":0.55100000000000005,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.94899999999999995,"5min":0.995,"15min":1.25},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.52600000000000002,"5min":0.42399999999999999,"15min":0.33000000000000002},"max":{"1min":0.91800000000000004,"5min":0.96599999999999997,"15min":1.5289999999999999},"last":0.48599999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72599999999999998,"15min":0.71399999999999997},"min":{"1min":0.51800000000000002,"5min":0.45900000000000002,"15min":0.371},"max":{"1min":0.91500000000000004,"5min":0.995,"15min":1.1830000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.56399999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85599999999999998,"5min":1.0069999999999999,"15min":1.3420000000000001},"last":0.625}]},{"osd":2,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76300000000000001,"15min":0.78500000000000003},"min":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.44900000000000001},"max":{"1min":0.878,"5min":1.0129999999999999,"15min":1.8280000000000001},"last":0.748},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.40999999999999998,"15min":0.39700000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.696},"last":0.76700000000000002}]},{"osd":3,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.74099999999999999},"min":{"1min":0.57199999999999995,"5min":0.498,"15min":0.40899999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.6399999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.74399999999999999,"15min":0.76600000000000001},"min":{"1min":0.56799999999999995,"5min":0.51800000000000002,"15min":0.46800000000000003},"max":{"1min":0.84399999999999997,"5min":1.01,"15min":2.0219999999999998},"last":0.83699999999999997}]},{"osd":4,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.58899999999999997,"15min":0.625},"min":{"1min":0.44900000000000001,"5min":0.36899999999999999,"15min":0.32500000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.911},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61399999999999999,"15min":0.67300000000000004},"min":{"1min":0.42999999999999999,"5min":0.38500000000000001,"15min":0.307},"max":{"1min":0.99199999999999999,"5min":1.0649999999999999,"15min":1.7829999999999999},"last":0.89400000000000002}]},{"osd":6,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63800000000000001,"15min":0.71199999999999997},"min":{"1min":0.44700000000000001,"5min":0.439,"15min":0.39600000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":2.1829999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65500000000000003,"15min":0.70999999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.36499999999999999},"max":{"1min":0.996,"5min":1.1359999999999999,"15min":2.1280000000000001},"last":0.53000000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68400000000000005,"15min":0.745},"min":{"1min":0.47799999999999998,"5min":0.435,"15min":0.38300000000000001},"max":{"1min":1.107,"5min":1.1319999999999999,"15min":1.887},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70699999999999996,"15min":0.77600000000000002},"min":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.439},"max":{"1min":0.89400000000000002,"5min":1.056,"15min":2.2599999999999998},"last":0.79200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575005,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.67500000000000004,"15min":0.69599999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77000000000000002,"5min":0.93400000000000005,"15min":2.4929999999999999},"last":0.433},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.67100000000000004,"15min":0.72199999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83699999999999997,"5min":0.94799999999999995,"15min":3.2519999999999998},"last":0.77100000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.94099999999999995,"5min":0.96999999999999997,"15min":1.4279999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69899999999999995,"15min":0.77100000000000002},"min":{"1min":0.46899999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79100000000000004,"5min":1.0069999999999999,"15min":4.3810000000000002},"last":1.0349999999999999}]},{"osd":2,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.72699999999999998,"15min":0.75},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82499999999999996,"5min":1.1990000000000001,"15min":2.056},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.70899999999999996,"15min":0.76900000000000002},"min":{"1min":0.496,"5min":0.436,"15min":0.436},"max":{"1min":0.88500000000000001,"5min":1.038,"15min":3.3420000000000001},"last":0.878}]},{"osd":3,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.75,"15min":0.83099999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.436},"max":{"1min":0.92300000000000004,"5min":1.091,"15min":3.9180000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.76200000000000001,"15min":0.84199999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93200000000000005,"5min":1.1279999999999999,"15min":3.9750000000000001},"last":0.92700000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59199999999999997,"15min":0.63700000000000001},"min":{"1min":0.39300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.91100000000000003,"5min":1.1120000000000001,"15min":1.2509999999999999},"last":0.629},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59699999999999998,"15min":0.65800000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.36699999999999999},"max":{"1min":0.92300000000000004,"5min":0.98199999999999998,"15min":1.4419999999999999},"last":0.68700000000000006}]},{"osd":6,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.65300000000000002},"min":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.33400000000000002},"max":{"1min":0.82799999999999996,"5min":1.0760000000000001,"15min":1.2949999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67700000000000005,"15min":0.71299999999999997},"min":{"1min":0.503,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86299999999999999,"5min":1.2529999999999999,"15min":1.3069999999999999},"last":0.85499999999999998}]},{"osd":7,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68100000000000005,"15min":0.73099999999999998},"min":{"1min":0.46100000000000002,"5min":0.434,"15min":0.432},"max":{"1min":1.0129999999999999,"5min":1.034,"15min":1.2689999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77200000000000002,"15min":0.80700000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.2949999999999999,"15min":1.353},"last":1.081}]}]},{"osd":3,"up_from":13,"seq":55834575003,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36700,"kb_used_data":5584,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94335140,"statfs":{"total":96636764160,"available":96599183360,"internally_reserved":0,"allocated":5718016,"data_stored":4852845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45300000000000001,"15min":0.44600000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26300000000000001},"max":{"1min":0.54900000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.48099999999999998,"15min":0.48199999999999998},"min":{"1min":0.308,"5min":0.30399999999999999,"15min":0.28699999999999998},"max":{"1min":0.56799999999999995,"5min":0.68000000000000005,"15min":1.0109999999999999},"last":0.42299999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46500000000000002,"15min":0.45100000000000001},"min":{"1min":0.29499999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71099999999999997,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69899999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.496}]},{"osd":2,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80900000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.41699999999999998,"5min":0.35399999999999998,"15min":0.33400000000000002},"max":{"1min":0.77900000000000003,"5min":0.82099999999999995,"15min":1.306},"last":0.53900000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75600000000000001,"15min":0.74299999999999999},"min":{"1min":0.50600000000000001,"5min":0.45800000000000002,"15min":0.40500000000000003},"max":{"1min":1.099,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.78600000000000003,"15min":0.76100000000000001},"min":{"1min":0.57899999999999996,"5min":0.52700000000000002,"15min":0.46500000000000002},"max":{"1min":1.0169999999999999,"5min":1.306,"15min":1.306},"last":0.67500000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78600000000000003,"15min":0.77800000000000002},"min":{"1min":0.56000000000000005,"5min":0.502,"15min":0.501},"max":{"1min":1.123,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78300000000000003,"15min":0.76100000000000001},"min":{"1min":0.51500000000000001,"5min":0.48999999999999999,"15min":0.48899999999999999},"max":{"1min":1.0820000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.69099999999999995}]},{"osd":6,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77900000000000003,"15min":0.76500000000000001},"min":{"1min":0.498,"5min":0.49399999999999999,"15min":0.44500000000000001},"max":{"1min":1.1950000000000001,"5min":1.258,"15min":1.258},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.79300000000000004},"min":{"1min":0.58999999999999997,"5min":0.55800000000000005,"15min":0.52000000000000002},"max":{"1min":1.0669999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.80000000000000004,"15min":0.76900000000000002},"min":{"1min":0.54900000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0529999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.745},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79700000000000004,"15min":0.79200000000000004},"min":{"1min":0.59199999999999997,"5min":0.53500000000000003,"15min":0.47499999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.2869999999999999},"last":0.80700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575003,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47099999999999997,"15min":0.45200000000000001},"min":{"1min":0.308,"5min":0.25800000000000001,"15min":0.253},"max":{"1min":0.68799999999999994,"5min":0.78800000000000003,"15min":0.79100000000000004},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51200000000000001,"15min":0.495},"min":{"1min":0.32100000000000001,"5min":0.28299999999999997,"15min":0.27300000000000002},"max":{"1min":0.85899999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.36299999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35099999999999998},"max":{"1min":0.77800000000000002,"5min":0.876,"15min":1.171},"last":0.438},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53100000000000003,"15min":0.504},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.752,"5min":0.878,"15min":1.333},"last":0.40300000000000002}]},{"osd":3,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56899999999999995,"15min":0.53500000000000003},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.32700000000000001},"max":{"1min":0.69999999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.60399999999999998,"15min":0.57899999999999996},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.35799999999999998},"max":{"1min":0.83799999999999997,"5min":0.90000000000000002,"15min":1.1140000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.58399999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98499999999999999,"5min":1.1379999999999999,"15min":2.254},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79000000000000004,"15min":0.77600000000000002},"min":{"1min":0.53100000000000003,"5min":0.498,"15min":0.42799999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.3420000000000001},"last":0.75600000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79200000000000004,"15min":0.77300000000000002},"min":{"1min":0.60599999999999998,"5min":0.54000000000000004,"15min":0.46200000000000002},"max":{"1min":1.0620000000000001,"5min":1.1439999999999999,"15min":1.3740000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81799999999999995,"15min":0.80400000000000005},"min":{"1min":0.60599999999999998,"5min":0.57399999999999995,"15min":0.443},"max":{"1min":1.133,"5min":1.2070000000000001,"15min":2.0840000000000001},"last":0.74099999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83199999999999996,"15min":0.82299999999999995},"min":{"1min":0.63900000000000001,"5min":0.56499999999999995,"15min":0.54600000000000004},"max":{"1min":1.1830000000000001,"5min":1.1990000000000001,"15min":1.5029999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.87,"15min":0.83999999999999997},"min":{"1min":0.71099999999999997,"5min":0.61099999999999999,"15min":0.52700000000000002},"max":{"1min":1.155,"5min":1.159,"15min":1.425},"last":0.71399999999999997}]},{"osd":7,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81100000000000005,"15min":0.81399999999999995},"min":{"1min":0.66200000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0840000000000001,"5min":1.1799999999999999,"15min":2.3580000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.82899999999999996,"15min":0.82099999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.54300000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.377},"last":0.70599999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575002,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36696,"kb_used_data":5580,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94335144,"statfs":{"total":96636764160,"available":96599187456,"internally_reserved":0,"allocated":5713920,"data_stored":4857699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.439,"15min":0.45400000000000001},"min":{"1min":0.27800000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.69999999999999996,"5min":0.77200000000000002,"15min":1.2150000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.47499999999999998,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.28799999999999998,"15min":0.26200000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":4.157},"last":0.46100000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.53700000000000003},"min":{"1min":0.312,"5min":0.30599999999999999,"15min":0.28999999999999998},"max":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":4.282},"last":0.443},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53000000000000003,"15min":0.55200000000000005},"min":{"1min":0.376,"5min":0.37,"15min":0.33600000000000002},"max":{"1min":0.70699999999999996,"5min":0.81000000000000005,"15min":1.625},"last":0.38900000000000001}]},{"osd":3,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.38200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.76400000000000001,"5min":0.88800000000000001,"15min":1.1120000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54800000000000004,"15min":0.66600000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":8.1620000000000008},"last":0.499}]},{"osd":4,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71899999999999997,"15min":0.80700000000000005},"min":{"1min":0.436,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":4.7400000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76300000000000001,"15min":0.78500000000000003},"min":{"1min":0.55900000000000005,"5min":0.53000000000000003,"15min":0.50600000000000001},"max":{"1min":1.071,"5min":1.125,"15min":1.7070000000000001},"last":0.68899999999999995}]},{"osd":5,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.75700000000000001,"15min":0.82599999999999996},"min":{"1min":0.52000000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.302,"5min":1.321,"15min":4.5759999999999996},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.751,"15min":0.82199999999999995},"min":{"1min":0.52800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.018,"5min":1.3680000000000001,"15min":4.7949999999999999},"last":0.625}]},{"osd":6,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77700000000000002,"15min":0.84799999999999998},"min":{"1min":0.56699999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0640000000000001,"5min":1.0820000000000001,"15min":4.6890000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76500000000000001,"15min":0.83699999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.141,"5min":1.141,"15min":4.6059999999999999},"last":0.66200000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77600000000000002,"15min":0.79600000000000004},"min":{"1min":0.54400000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1539999999999999,"5min":1.206,"15min":1.8759999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.78500000000000003,"15min":0.85399999999999998},"min":{"1min":0.53200000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":4.6420000000000003},"last":0.60899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37284,"kb_used_data":6168,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94334556,"statfs":{"total":96636764160,"available":96598585344,"internally_reserved":0,"allocated":6316032,"data_stored":5443255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42599999999999999,"15min":0.441},"min":{"1min":0.32500000000000001,"5min":0.27800000000000002,"15min":0.26300000000000001},"max":{"1min":0.621,"5min":0.621,"15min":1.48},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.5,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":0.747,"15min":1.2330000000000001},"last":0.372}]},{"osd":2,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.50700000000000001},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.29099999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.3129999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32400000000000001},"max":{"1min":0.64800000000000002,"5min":0.76700000000000002,"15min":0.82599999999999996},"last":0.53900000000000003}]},{"osd":3,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28199999999999997},"max":{"1min":0.68000000000000005,"5min":0.82799999999999996,"15min":0.84799999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58399999999999996,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40300000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.4430000000000001},"last":0.58799999999999997}]},{"osd":4,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.53700000000000003,"5min":0.505,"15min":0.46200000000000002},"max":{"1min":0.98099999999999998,"5min":1.0149999999999999,"15min":1.0569999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.1240000000000001},"last":0.87}]},{"osd":5,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.746,"15min":0.76200000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.47599999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.371},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.745,"15min":0.755},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.997,"5min":0.997,"15min":1.143},"last":0.88700000000000001}]},{"osd":6,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77800000000000002,"15min":0.78600000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.52500000000000002},"max":{"1min":0.97599999999999998,"5min":1.038,"15min":1.177},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79800000000000004,"15min":0.81399999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.4099999999999999},"last":0.85199999999999998}]},{"osd":7,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75900000000000001,"15min":0.77700000000000002},"min":{"1min":0.58799999999999997,"5min":0.56100000000000005,"15min":0.54800000000000004},"max":{"1min":0.98399999999999999,"5min":1.028,"15min":1.135},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76900000000000002,"15min":0.77700000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.48399999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.746}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:34:48.218 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-02T07:34:48.218 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:34:48.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.359+0000 7fdb0be00640 1 Processor -- start 2024-04-02T07:34:48.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.359+0000 7fdb0be00640 1 -- start start 2024-04-02T07:34:48.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.359+0000 7fdb0be00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdb04143f90 0x7fdb0415ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.359+0000 7fdb0be00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fdb040b34f0 0x7fdb040cd370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.359+0000 7fdb0be00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdb040b3980 0x7fdb040cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.359+0000 7fdb0be00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0415b270 con 0x7fdb04143f90 2024-04-02T07:34:48.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.359+0000 7fdb0be00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb04144370 con 0x7fdb040b34f0 2024-04-02T07:34:48.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.359+0000 7fdb0be00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb040c37b0 con 0x7fdb040b3980 2024-04-02T07:34:48.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.359+0000 7fdb09400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdb04143f90 0x7fdb0415ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.359+0000 7fdb09400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdb04143f90 0x7fdb0415ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46458/0 (socket says 172.21.15.55:46458) 2024-04-02T07:34:48.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.359+0000 7fdb09400640 1 -- 172.21.15.55:0/880245860 learned_addr learned my addr 172.21.15.55:0/880245860 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:48.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.359+0000 7fdb08a00640 1 --2- 172.21.15.55:0/880245860 >> v2:172.21.15.106:3300/0 conn(0x7fdb040b34f0 0x7fdb040cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.359+0000 7fdb09e00640 1 --2- 172.21.15.55:0/880245860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdb040b3980 0x7fdb040cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.359+0000 7fdb09400640 1 -- 172.21.15.55:0/880245860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdb040b3980 msgr2=0x7fdb040cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:48.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.359+0000 7fdb09400640 1 --2- 172.21.15.55:0/880245860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdb040b3980 0x7fdb040cd8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.360 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.359+0000 7fdb09400640 1 -- 172.21.15.55:0/880245860 >> v2:172.21.15.106:3300/0 conn(0x7fdb040b34f0 msgr2=0x7fdb040cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:48.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.359+0000 7fdb09400640 1 --2- 172.21.15.55:0/880245860 >> v2:172.21.15.106:3300/0 conn(0x7fdb040b34f0 0x7fdb040cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.359+0000 7fdb09400640 1 -- 172.21.15.55:0/880245860 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb040c3a90 con 0x7fdb04143f90 2024-04-02T07:34:48.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.363+0000 7fdb09400640 1 --2- 172.21.15.55:0/880245860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb04143f90 0x7fdb0415ad30 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fdb040b2d40 tx=0x7fdaf801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dafae76db11b047 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:48.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.363+0000 7fdb03e00640 1 -- 172.21.15.55:0/880245860 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf80ab620 con 0x7fdb04143f90 2024-04-02T07:34:48.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.363+0000 7fdb03e00640 1 -- 172.21.15.55:0/880245860 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf80ab780 con 0x7fdb04143f90 2024-04-02T07:34:48.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.363+0000 7fdb03e00640 1 -- 172.21.15.55:0/880245860 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf80abb10 con 0x7fdb04143f90 2024-04-02T07:34:48.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.363+0000 7fdb0be00640 1 -- 172.21.15.55:0/880245860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb04143f90 msgr2=0x7fdb0415ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:48.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.363+0000 7fdb0be00640 1 --2- 172.21.15.55:0/880245860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb04143f90 0x7fdb0415ad30 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fdb040b2d40 tx=0x7fdaf801c460 comp rx=0 tx=0).stop 2024-04-02T07:34:48.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.363+0000 7fdb0be00640 1 -- 172.21.15.55:0/880245860 shutdown_connections 2024-04-02T07:34:48.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.363+0000 7fdb0be00640 1 --2- 172.21.15.55:0/880245860 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdb040b3980 0x7fdb040cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.363+0000 7fdb0be00640 1 --2- 172.21.15.55:0/880245860 >> v2:172.21.15.106:3300/0 conn(0x7fdb040b34f0 0x7fdb040cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.363+0000 7fdb0be00640 1 --2- 172.21.15.55:0/880245860 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb04143f90 0x7fdb0415ad30 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.363+0000 7fdb0be00640 1 -- 172.21.15.55:0/880245860 >> 172.21.15.55:0/880245860 conn(0x7fdb04066080 msgr2=0x7fdb04069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:48.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.363+0000 7fdb0be00640 1 -- 172.21.15.55:0/880245860 shutdown_connections 2024-04-02T07:34:48.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb0be00640 1 -- 172.21.15.55:0/880245860 wait complete. 2024-04-02T07:34:48.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb0be00640 1 Processor -- start 2024-04-02T07:34:48.365 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb0be00640 1 -- start start 2024-04-02T07:34:48.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb0be00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb040b34f0 0x7fdb040cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb0be00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdb040b3980 0x7fdb04141e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb0be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb04143f90 0x7fdb04159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb0be00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04164ad0 con 0x7fdb04143f90 2024-04-02T07:34:48.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb0be00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04164d20 con 0x7fdb040b34f0 2024-04-02T07:34:48.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb0be00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb04165000 con 0x7fdb040b3980 2024-04-02T07:34:48.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb09e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb04143f90 0x7fdb04159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb09e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb04143f90 0x7fdb04159d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46468/0 (socket says 172.21.15.55:46468) 2024-04-02T07:34:48.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb09e00640 1 -- 172.21.15.55:0/311242263 learned_addr learned my addr 172.21.15.55:0/311242263 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:48.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb09400640 1 --2- 172.21.15.55:0/311242263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb040b34f0 0x7fdb040cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb08a00640 1 --2- 172.21.15.55:0/311242263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdb040b3980 0x7fdb04141e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb09e00640 1 -- 172.21.15.55:0/311242263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdb040b3980 msgr2=0x7fdb04141e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:48.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb09e00640 1 --2- 172.21.15.55:0/311242263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdb040b3980 0x7fdb04141e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb09e00640 1 -- 172.21.15.55:0/311242263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb040b34f0 msgr2=0x7fdb040cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:48.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb09e00640 1 --2- 172.21.15.55:0/311242263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb040b34f0 0x7fdb040cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb09e00640 1 -- 172.21.15.55:0/311242263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf80094d0 con 0x7fdb04143f90 2024-04-02T07:34:48.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb09e00640 1 --2- 172.21.15.55:0/311242263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb04143f90 0x7fdb04159d60 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00efc0 tx=0x7fdafc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:48.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb01600640 1 -- 172.21.15.55:0/311242263 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc014480 con 0x7fdb04143f90 2024-04-02T07:34:48.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb01600640 1 -- 172.21.15.55:0/311242263 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc00f040 con 0x7fdb04143f90 2024-04-02T07:34:48.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb01600640 1 -- 172.21.15.55:0/311242263 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc014820 con 0x7fdb04143f90 2024-04-02T07:34:48.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb0be00640 1 -- 172.21.15.55:0/311242263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb040cb300 con 0x7fdb04143f90 2024-04-02T07:34:48.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.367+0000 7fdb0be00640 1 -- 172.21.15.55:0/311242263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0415abe0 con 0x7fdb04143f90 2024-04-02T07:34:48.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.371+0000 7fdb0be00640 1 -- 172.21.15.55:0/311242263 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb040cb160 con 0x7fdb04143f90 2024-04-02T07:34:48.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.371+0000 7fdb01600640 1 -- 172.21.15.55:0/311242263 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fdafc014980 con 0x7fdb04143f90 2024-04-02T07:34:48.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.371+0000 7fdb01600640 1 --2- 172.21.15.55:0/311242263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdae4066690 0x7fdae4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.371+0000 7fdb01600640 1 -- 172.21.15.55:0/311242263 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fdafc084c10 con 0x7fdb04143f90 2024-04-02T07:34:48.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.371+0000 7fdb09400640 1 --2- 172.21.15.55:0/311242263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdae4066690 0x7fdae4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.371+0000 7fdb09400640 1 --2- 172.21.15.55:0/311242263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdae4066690 0x7fdae4068b50 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80af000 tx=0x7fdaf80b6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:48.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.375+0000 7fdb01600640 1 -- 172.21.15.55:0/311242263 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fdb040cb160 con 0x7fdb04143f90 2024-04-02T07:34:48.532 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.535+0000 7fdb0be00640 1 -- 172.21.15.55:0/311242263 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdb040c5060 con 0x7fdae4066690 2024-04-02T07:34:48.535 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.535+0000 7fdb01600640 1 -- 172.21.15.55:0/311242263 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50475 (secure 0 0 0) 0x7fdaf80ab5a0 con 0x7fdae4066690 2024-04-02T07:34:48.535 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:48.536 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:34:48.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.539+0000 7fdb0be00640 1 -- 172.21.15.55:0/311242263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdae4066690 msgr2=0x7fdae4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:48.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.539+0000 7fdb0be00640 1 --2- 172.21.15.55:0/311242263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdae4066690 0x7fdae4068b50 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fdaf80af000 tx=0x7fdaf80b6040 comp rx=0 tx=0).stop 2024-04-02T07:34:48.537 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.539+0000 7fdb0be00640 1 -- 172.21.15.55:0/311242263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb04143f90 msgr2=0x7fdb04159d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:48.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.539+0000 7fdb0be00640 1 --2- 172.21.15.55:0/311242263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb04143f90 0x7fdb04159d60 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fdafc00efc0 tx=0x7fdafc00c490 comp rx=0 tx=0).stop 2024-04-02T07:34:48.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.539+0000 7fdb0be00640 1 -- 172.21.15.55:0/311242263 shutdown_connections 2024-04-02T07:34:48.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.539+0000 7fdb0be00640 1 --2- 172.21.15.55:0/311242263 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb04143f90 0x7fdb04159d60 unknown :-1 s=CLOSED pgs=1944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.539+0000 7fdb0be00640 1 --2- 172.21.15.55:0/311242263 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdb040b3980 0x7fdb04141e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.539+0000 7fdb0be00640 1 --2- 172.21.15.55:0/311242263 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdae4066690 0x7fdae4068b50 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.539+0000 7fdb0be00640 1 --2- 172.21.15.55:0/311242263 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdb040b34f0 0x7fdb040cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.539+0000 7fdb0be00640 1 -- 172.21.15.55:0/311242263 >> 172.21.15.55:0/311242263 conn(0x7fdb04066080 msgr2=0x7fdb04140240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:48.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.539+0000 7fdb0be00640 1 -- 172.21.15.55:0/311242263 shutdown_connections 2024-04-02T07:34:48.538 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.539+0000 7fdb0be00640 1 -- 172.21.15.55:0/311242263 wait complete. 2024-04-02T07:34:48.558 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":497,"stamp":"2024-04-02T07:34:48.526168+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":162,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":3,"kb":754974720,"kb_used":278424,"kb_used_data":29480,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754696296,"statfs":{"total":773094113280,"available":772809007104,"internally_reserved":0,"allocated":30187520,"data_stored":23272766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390727,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-264,"num_write":-175,"num_write_kb":-8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001772"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":256,"reported_epoch":121,"state":"active+clean","last_fresh":"2024-04-02T07:34:44.583568+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:34:44.583568+0000","last_peered":"2024-04-02T07:34:44.583568+0000","last_clean":"2024-04-02T07:34:44.583568+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:34:44.583568+0000","last_undegraded":"2024-04-02T07:34:44.583568+0000","last_fullsized":"2024-04-02T07:34:44.583568+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575002,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33184,"kb_used_data":2064,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338656,"statfs":{"total":96636764160,"available":96602783744,"internally_reserved":0,"allocated":2113536,"data_stored":1253763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68799999999999994,"15min":0.66600000000000004},"min":{"1min":0.51900000000000002,"5min":0.39400000000000002,"15min":0.35299999999999998},"max":{"1min":0.86899999999999999,"5min":0.92400000000000004,"15min":1.0569999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67800000000000005,"15min":0.65000000000000002},"min":{"1min":0.52000000000000002,"5min":0.442,"15min":0.39900000000000002},"max":{"1min":0.93100000000000005,"5min":1.018,"15min":1.018},"last":0.64000000000000001}]},{"osd":1,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.88200000000000001,"5min":1.004,"15min":1.0289999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69899999999999995,"15min":0.68100000000000005},"min":{"1min":0.54500000000000004,"5min":0.46899999999999997,"15min":0.39500000000000002},"max":{"1min":0.85599999999999998,"5min":0.99299999999999999,"15min":1.113},"last":0.752}]},{"osd":2,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.749,"15min":0.752},"min":{"1min":0.61199999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98999999999999999,"5min":1.0309999999999999,"15min":1.139},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.752,"15min":0.73299999999999998},"min":{"1min":0.56699999999999995,"5min":0.503,"15min":0.437},"max":{"1min":0.97399999999999998,"5min":1.0549999999999999,"15min":1.522},"last":0.70199999999999996}]},{"osd":3,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71299999999999997,"15min":0.70599999999999996},"min":{"1min":0.53400000000000003,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.87,"5min":1.0409999999999999,"15min":1.405},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.72899999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.48599999999999999},"max":{"1min":0.95399999999999996,"5min":1.0329999999999999,"15min":1.0580000000000001},"last":1.026}]},{"osd":4,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.58499999999999996,"15min":0.625},"min":{"1min":0.39400000000000002,"5min":0.37,"15min":0.34399999999999997},"max":{"1min":0.998,"5min":0.998,"15min":1.633},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.66900000000000004,"15min":0.69399999999999995},"min":{"1min":0.46000000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92900000000000005,"5min":0.94299999999999995,"15min":1.079},"last":0.90200000000000002}]},{"osd":5,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.67200000000000004},"min":{"1min":0.441,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88800000000000001,"5min":0.995,"15min":1.2250000000000001},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.71699999999999997,"15min":0.73599999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.43099999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.5609999999999999},"last":0.86399999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.49299999999999999,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.5960000000000001},"last":1.002},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.66900000000000004,"15min":0.67600000000000005},"min":{"1min":0.41499999999999998,"5min":0.41399999999999998,"15min":0.40699999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0840000000000001},"last":1.056}]}]},{"osd":6,"up_from":13,"seq":55834575003,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36704,"kb_used_data":5584,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94335136,"statfs":{"total":96636764160,"available":96599179264,"internally_reserved":0,"allocated":5718016,"data_stored":4857706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72199999999999998,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.45600000000000002,"15min":0.41399999999999998},"max":{"1min":1.002,"5min":1.147,"15min":1.399},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72699999999999998,"15min":0.76700000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":5.7569999999999997},"last":0.81999999999999995}]},{"osd":1,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.74199999999999999,"15min":0.72299999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.38200000000000001},"max":{"1min":0.96499999999999997,"5min":1.097,"15min":1.95},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.74199999999999999,"15min":0.73099999999999998},"min":{"1min":0.58899999999999997,"5min":0.51400000000000001,"15min":0.47599999999999998},"max":{"1min":0.93600000000000005,"5min":1.0449999999999999,"15min":1.248},"last":0.89300000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72799999999999998,"15min":0.70199999999999996},"min":{"1min":0.53000000000000003,"5min":0.51700000000000002,"15min":0.45000000000000001},"max":{"1min":0.95499999999999996,"5min":0.97699999999999998,"15min":1.226},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.755,"15min":0.73099999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92200000000000004,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.79500000000000004}]},{"osd":3,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.63600000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91600000000000004,"5min":1.006,"15min":2.3119999999999998},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.51900000000000002,"5min":0.49299999999999999,"15min":0.47699999999999998},"max":{"1min":0.996,"5min":1.0660000000000001,"15min":2.6389999999999998},"last":0.83999999999999997}]},{"osd":4,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.40100000000000002,"5min":0.39600000000000002,"15min":0.34999999999999998},"max":{"1min":0.89500000000000002,"5min":1.236,"15min":1.236},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63500000000000001,"15min":0.64300000000000002},"min":{"1min":0.49199999999999999,"5min":0.437,"15min":0.38500000000000001},"max":{"1min":0.93799999999999994,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.70699999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.61599999999999999,"15min":0.63300000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.37},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.95999999999999996},"last":0.871},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.52600000000000002,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":0.90100000000000002,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.90800000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.57699999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.86699999999999999,"5min":3.3290000000000002,"15min":3.3290000000000002},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68000000000000005,"15min":0.70599999999999996},"min":{"1min":0.52000000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98299999999999998,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.68899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575003,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67800000000000005,"15min":0.66800000000000004},"min":{"1min":0.55100000000000005,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.94899999999999995,"5min":0.995,"15min":1.25},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.52600000000000002,"5min":0.42399999999999999,"15min":0.33000000000000002},"max":{"1min":0.91800000000000004,"5min":0.96599999999999997,"15min":1.5289999999999999},"last":0.48599999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72599999999999998,"15min":0.71399999999999997},"min":{"1min":0.51800000000000002,"5min":0.45900000000000002,"15min":0.371},"max":{"1min":0.91500000000000004,"5min":0.995,"15min":1.1830000000000001},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.56399999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85599999999999998,"5min":1.0069999999999999,"15min":1.3420000000000001},"last":0.625}]},{"osd":2,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76300000000000001,"15min":0.78500000000000003},"min":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.44900000000000001},"max":{"1min":0.878,"5min":1.0129999999999999,"15min":1.8280000000000001},"last":0.748},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.40999999999999998,"15min":0.39700000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.696},"last":0.76700000000000002}]},{"osd":3,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.74099999999999999},"min":{"1min":0.57199999999999995,"5min":0.498,"15min":0.40899999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.6399999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.74399999999999999,"15min":0.76600000000000001},"min":{"1min":0.56799999999999995,"5min":0.51800000000000002,"15min":0.46800000000000003},"max":{"1min":0.84399999999999997,"5min":1.01,"15min":2.0219999999999998},"last":0.83699999999999997}]},{"osd":4,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.58899999999999997,"15min":0.625},"min":{"1min":0.44900000000000001,"5min":0.36899999999999999,"15min":0.32500000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.911},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61399999999999999,"15min":0.67300000000000004},"min":{"1min":0.42999999999999999,"5min":0.38500000000000001,"15min":0.307},"max":{"1min":0.99199999999999999,"5min":1.0649999999999999,"15min":1.7829999999999999},"last":0.89400000000000002}]},{"osd":6,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63800000000000001,"15min":0.71199999999999997},"min":{"1min":0.44700000000000001,"5min":0.439,"15min":0.39600000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":2.1829999999999998},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65500000000000003,"15min":0.70999999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.36499999999999999},"max":{"1min":0.996,"5min":1.1359999999999999,"15min":2.1280000000000001},"last":0.53000000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68400000000000005,"15min":0.745},"min":{"1min":0.47799999999999998,"5min":0.435,"15min":0.38300000000000001},"max":{"1min":1.107,"5min":1.1319999999999999,"15min":1.887},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70699999999999996,"15min":0.77600000000000002},"min":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.439},"max":{"1min":0.89400000000000002,"5min":1.056,"15min":2.2599999999999998},"last":0.79200000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575005,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.67500000000000004,"15min":0.69599999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77000000000000002,"5min":0.93400000000000005,"15min":2.4929999999999999},"last":0.433},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.67100000000000004,"15min":0.72199999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83699999999999997,"5min":0.94799999999999995,"15min":3.2519999999999998},"last":0.77100000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.94099999999999995,"5min":0.96999999999999997,"15min":1.4279999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69899999999999995,"15min":0.77100000000000002},"min":{"1min":0.46899999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79100000000000004,"5min":1.0069999999999999,"15min":4.3810000000000002},"last":1.0349999999999999}]},{"osd":2,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.72699999999999998,"15min":0.75},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82499999999999996,"5min":1.1990000000000001,"15min":2.056},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.70899999999999996,"15min":0.76900000000000002},"min":{"1min":0.496,"5min":0.436,"15min":0.436},"max":{"1min":0.88500000000000001,"5min":1.038,"15min":3.3420000000000001},"last":0.878}]},{"osd":3,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.75,"15min":0.83099999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.436},"max":{"1min":0.92300000000000004,"5min":1.091,"15min":3.9180000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.76200000000000001,"15min":0.84199999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93200000000000005,"5min":1.1279999999999999,"15min":3.9750000000000001},"last":0.92700000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59199999999999997,"15min":0.63700000000000001},"min":{"1min":0.39300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.91100000000000003,"5min":1.1120000000000001,"15min":1.2509999999999999},"last":0.629},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59699999999999998,"15min":0.65800000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.36699999999999999},"max":{"1min":0.92300000000000004,"5min":0.98199999999999998,"15min":1.4419999999999999},"last":0.68700000000000006}]},{"osd":6,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.65300000000000002},"min":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.33400000000000002},"max":{"1min":0.82799999999999996,"5min":1.0760000000000001,"15min":1.2949999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67700000000000005,"15min":0.71299999999999997},"min":{"1min":0.503,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86299999999999999,"5min":1.2529999999999999,"15min":1.3069999999999999},"last":0.85499999999999998}]},{"osd":7,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68100000000000005,"15min":0.73099999999999998},"min":{"1min":0.46100000000000002,"5min":0.434,"15min":0.432},"max":{"1min":1.0129999999999999,"5min":1.034,"15min":1.2689999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77200000000000002,"15min":0.80700000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.2949999999999999,"15min":1.353},"last":1.081}]}]},{"osd":3,"up_from":13,"seq":55834575003,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":36700,"kb_used_data":5584,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94335140,"statfs":{"total":96636764160,"available":96599183360,"internally_reserved":0,"allocated":5718016,"data_stored":4852845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45300000000000001,"15min":0.44600000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26300000000000001},"max":{"1min":0.54900000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.48099999999999998,"15min":0.48199999999999998},"min":{"1min":0.308,"5min":0.30399999999999999,"15min":0.28699999999999998},"max":{"1min":0.56799999999999995,"5min":0.68000000000000005,"15min":1.0109999999999999},"last":0.42299999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46500000000000002,"15min":0.45100000000000001},"min":{"1min":0.29499999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71099999999999997,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69899999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.496}]},{"osd":2,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80900000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.41699999999999998,"5min":0.35399999999999998,"15min":0.33400000000000002},"max":{"1min":0.77900000000000003,"5min":0.82099999999999995,"15min":1.306},"last":0.53900000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75600000000000001,"15min":0.74299999999999999},"min":{"1min":0.50600000000000001,"5min":0.45800000000000002,"15min":0.40500000000000003},"max":{"1min":1.099,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.754,"5min":0.78600000000000003,"15min":0.76100000000000001},"min":{"1min":0.57899999999999996,"5min":0.52700000000000002,"15min":0.46500000000000002},"max":{"1min":1.0169999999999999,"5min":1.306,"15min":1.306},"last":0.67500000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78600000000000003,"15min":0.77800000000000002},"min":{"1min":0.56000000000000005,"5min":0.502,"15min":0.501},"max":{"1min":1.123,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78300000000000003,"15min":0.76100000000000001},"min":{"1min":0.51500000000000001,"5min":0.48999999999999999,"15min":0.48899999999999999},"max":{"1min":1.0820000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.69099999999999995}]},{"osd":6,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77900000000000003,"15min":0.76500000000000001},"min":{"1min":0.498,"5min":0.49399999999999999,"15min":0.44500000000000001},"max":{"1min":1.1950000000000001,"5min":1.258,"15min":1.258},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.79300000000000004},"min":{"1min":0.58999999999999997,"5min":0.55800000000000005,"15min":0.52000000000000002},"max":{"1min":1.0669999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.71799999999999997}]},{"osd":7,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.80000000000000004,"15min":0.76900000000000002},"min":{"1min":0.54900000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0529999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.745},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79700000000000004,"15min":0.79200000000000004},"min":{"1min":0.59199999999999997,"5min":0.53500000000000003,"15min":0.47499999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.2869999999999999},"last":0.80700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834575003,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47099999999999997,"15min":0.45200000000000001},"min":{"1min":0.308,"5min":0.25800000000000001,"15min":0.253},"max":{"1min":0.68799999999999994,"5min":0.78800000000000003,"15min":0.79100000000000004},"last":0.29499999999999998},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51200000000000001,"15min":0.495},"min":{"1min":0.32100000000000001,"5min":0.28299999999999997,"15min":0.27300000000000002},"max":{"1min":0.85899999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.36299999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35099999999999998},"max":{"1min":0.77800000000000002,"5min":0.876,"15min":1.171},"last":0.438},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53100000000000003,"15min":0.504},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.752,"5min":0.878,"15min":1.333},"last":0.40300000000000002}]},{"osd":3,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56899999999999995,"15min":0.53500000000000003},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.32700000000000001},"max":{"1min":0.69999999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.60399999999999998,"15min":0.57899999999999996},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.35799999999999998},"max":{"1min":0.83799999999999997,"5min":0.90000000000000002,"15min":1.1140000000000001},"last":0.51200000000000001}]},{"osd":4,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.58399999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98499999999999999,"5min":1.1379999999999999,"15min":2.254},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79000000000000004,"15min":0.77600000000000002},"min":{"1min":0.53100000000000003,"5min":0.498,"15min":0.42799999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.3420000000000001},"last":0.75600000000000001}]},{"osd":5,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79200000000000004,"15min":0.77300000000000002},"min":{"1min":0.60599999999999998,"5min":0.54000000000000004,"15min":0.46200000000000002},"max":{"1min":1.0620000000000001,"5min":1.1439999999999999,"15min":1.3740000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81799999999999995,"15min":0.80400000000000005},"min":{"1min":0.60599999999999998,"5min":0.57399999999999995,"15min":0.443},"max":{"1min":1.133,"5min":1.2070000000000001,"15min":2.0840000000000001},"last":0.74099999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83199999999999996,"15min":0.82299999999999995},"min":{"1min":0.63900000000000001,"5min":0.56499999999999995,"15min":0.54600000000000004},"max":{"1min":1.1830000000000001,"5min":1.1990000000000001,"15min":1.5029999999999999},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.87,"15min":0.83999999999999997},"min":{"1min":0.71099999999999997,"5min":0.61099999999999999,"15min":0.52700000000000002},"max":{"1min":1.155,"5min":1.159,"15min":1.425},"last":0.71399999999999997}]},{"osd":7,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81100000000000005,"15min":0.81399999999999995},"min":{"1min":0.66200000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0840000000000001,"5min":1.1799999999999999,"15min":2.3580000000000001},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.82899999999999996,"15min":0.82099999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.54300000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.377},"last":0.70599999999999996}]}]},{"osd":1,"up_from":13,"seq":55834575002,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36696,"kb_used_data":5580,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94335144,"statfs":{"total":96636764160,"available":96599187456,"internally_reserved":0,"allocated":5713920,"data_stored":4857699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.439,"15min":0.45400000000000001},"min":{"1min":0.27800000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.69999999999999996,"5min":0.77200000000000002,"15min":1.2150000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.47499999999999998,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.28799999999999998,"15min":0.26200000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":4.157},"last":0.46100000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.53700000000000003},"min":{"1min":0.312,"5min":0.30599999999999999,"15min":0.28999999999999998},"max":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":4.282},"last":0.443},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53000000000000003,"15min":0.55200000000000005},"min":{"1min":0.376,"5min":0.37,"15min":0.33600000000000002},"max":{"1min":0.70699999999999996,"5min":0.81000000000000005,"15min":1.625},"last":0.38900000000000001}]},{"osd":3,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.38200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.76400000000000001,"5min":0.88800000000000001,"15min":1.1120000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54800000000000004,"15min":0.66600000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":8.1620000000000008},"last":0.499}]},{"osd":4,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71899999999999997,"15min":0.80700000000000005},"min":{"1min":0.436,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":4.7400000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76300000000000001,"15min":0.78500000000000003},"min":{"1min":0.55900000000000005,"5min":0.53000000000000003,"15min":0.50600000000000001},"max":{"1min":1.071,"5min":1.125,"15min":1.7070000000000001},"last":0.68899999999999995}]},{"osd":5,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.75700000000000001,"15min":0.82599999999999996},"min":{"1min":0.52000000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.302,"5min":1.321,"15min":4.5759999999999996},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.751,"15min":0.82199999999999995},"min":{"1min":0.52800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.018,"5min":1.3680000000000001,"15min":4.7949999999999999},"last":0.625}]},{"osd":6,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77700000000000002,"15min":0.84799999999999998},"min":{"1min":0.56699999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0640000000000001,"5min":1.0820000000000001,"15min":4.6890000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76500000000000001,"15min":0.83699999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.141,"5min":1.141,"15min":4.6059999999999999},"last":0.66200000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77600000000000002,"15min":0.79600000000000004},"min":{"1min":0.54400000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1539999999999999,"5min":1.206,"15min":1.8759999999999999},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.755,"5min":0.78500000000000003,"15min":0.85399999999999998},"min":{"1min":0.53200000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":4.6420000000000003},"last":0.60899999999999999}]}]},{"osd":0,"up_from":13,"seq":55834575003,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37284,"kb_used_data":6168,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94334556,"statfs":{"total":96636764160,"available":96598585344,"internally_reserved":0,"allocated":6316032,"data_stored":5443255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42599999999999999,"15min":0.441},"min":{"1min":0.32500000000000001,"5min":0.27800000000000002,"15min":0.26300000000000001},"max":{"1min":0.621,"5min":0.621,"15min":1.48},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.497,"5min":0.5,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":0.747,"15min":1.2330000000000001},"last":0.372}]},{"osd":2,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.50700000000000001},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.29099999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.3129999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32400000000000001},"max":{"1min":0.64800000000000002,"5min":0.76700000000000002,"15min":0.82599999999999996},"last":0.53900000000000003}]},{"osd":3,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28199999999999997},"max":{"1min":0.68000000000000005,"5min":0.82799999999999996,"15min":0.84799999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58399999999999996,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40300000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.4430000000000001},"last":0.58799999999999997}]},{"osd":4,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.53700000000000003,"5min":0.505,"15min":0.46200000000000002},"max":{"1min":0.98099999999999998,"5min":1.0149999999999999,"15min":1.0569999999999999},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.1240000000000001},"last":0.87}]},{"osd":5,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.746,"15min":0.76200000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.47599999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.371},"last":0.89800000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.745,"15min":0.755},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.997,"5min":0.997,"15min":1.143},"last":0.88700000000000001}]},{"osd":6,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77800000000000002,"15min":0.78600000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.52500000000000002},"max":{"1min":0.97599999999999998,"5min":1.038,"15min":1.177},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79800000000000004,"15min":0.81399999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.4099999999999999},"last":0.85199999999999998}]},{"osd":7,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75900000000000001,"15min":0.77700000000000002},"min":{"1min":0.58799999999999997,"5min":0.56100000000000005,"15min":0.54800000000000004},"max":{"1min":0.98399999999999999,"5min":1.028,"15min":1.135},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76900000000000002,"15min":0.77700000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.48399999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.746}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:34:48.560 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-02T07:34:48.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.698+0000 7f3a66600640 1 Processor -- start 2024-04-02T07:34:48.699 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.698+0000 7f3a66600640 1 -- start start 2024-04-02T07:34:48.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.702+0000 7f3a66600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f3a600b19d0 0x7f3a600ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.702+0000 7f3a66600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3a60099120 0x7f3a6015c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.702+0000 7f3a66600640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a600cf3d0 con 0x7f3a6006c0d0 2024-04-02T07:34:48.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.702+0000 7f3a66600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a600cf6b0 con 0x7f3a60099120 2024-04-02T07:34:48.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.702+0000 7f3a66600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a600cf990 con 0x7f3a600b19d0 2024-04-02T07:34:48.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.702+0000 7f3a5fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3a60099120 0x7f3a6015c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.701 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.702+0000 7f3a57e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3a6006c0d0 0x7f3a60098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41210/0 (socket says 172.21.15.55:41210) 2024-04-02T07:34:48.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.702+0000 7f3a57e00640 1 -- 172.21.15.55:0/1529958250 learned_addr learned my addr 172.21.15.55:0/1529958250 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:48.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.702+0000 7f3a5f400640 1 --2- 172.21.15.55:0/1529958250 >> v2:172.21.15.106:3300/0 conn(0x7f3a600b19d0 0x7f3a600ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.702+0000 7f3a5fe00640 1 -- 172.21.15.55:0/1529958250 >> v2:172.21.15.106:3300/0 conn(0x7f3a600b19d0 msgr2=0x7f3a600ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:48.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.702+0000 7f3a5fe00640 1 --2- 172.21.15.55:0/1529958250 >> v2:172.21.15.106:3300/0 conn(0x7f3a600b19d0 0x7f3a600ce9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.702+0000 7f3a5fe00640 1 -- 172.21.15.55:0/1529958250 >> v1:172.21.15.55:6789/0 conn(0x7f3a6006c0d0 legacy=0x7f3a60098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:48.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.702+0000 7f3a5fe00640 1 -- 172.21.15.55:0/1529958250 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a600cfc70 con 0x7f3a60099120 2024-04-02T07:34:48.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.702+0000 7f3a5f400640 1 --2- 172.21.15.55:0/1529958250 >> v2:172.21.15.106:3300/0 conn(0x7f3a600b19d0 0x7f3a600ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:48.702 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.702+0000 7f3a5ea00640 1 -- 172.21.15.55:0/1529958250 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2550852351 0 0) 0x7f3a600cf3d0 con 0x7f3a6006c0d0 2024-04-02T07:34:48.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a5fe00640 1 --2- 172.21.15.55:0/1529958250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a60099120 0x7f3a6015c2d0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f3a60071720 tx=0x7f3a5801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb85dec735b549b6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:48.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a5ea00640 1 -- 172.21.15.55:0/1529958250 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580a5900 con 0x7f3a60099120 2024-04-02T07:34:48.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a5ea00640 1 -- 172.21.15.55:0/1529958250 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a580a5a60 con 0x7f3a60099120 2024-04-02T07:34:48.704 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a5ea00640 1 -- 172.21.15.55:0/1529958250 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580a5df0 con 0x7f3a60099120 2024-04-02T07:34:48.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a66600640 1 -- 172.21.15.55:0/1529958250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a60099120 msgr2=0x7f3a6015c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:48.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a66600640 1 --2- 172.21.15.55:0/1529958250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a60099120 0x7f3a6015c2d0 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f3a60071720 tx=0x7f3a5801c930 comp rx=0 tx=0).stop 2024-04-02T07:34:48.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a66600640 1 -- 172.21.15.55:0/1529958250 shutdown_connections 2024-04-02T07:34:48.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a66600640 1 --2- 172.21.15.55:0/1529958250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a60099120 0x7f3a6015c2d0 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a66600640 1 --2- 172.21.15.55:0/1529958250 >> v2:172.21.15.106:3300/0 conn(0x7f3a600b19d0 0x7f3a600ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a66600640 1 -- 172.21.15.55:0/1529958250 >> 172.21.15.55:0/1529958250 conn(0x7f3a600b2150 msgr2=0x7f3a600b2530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:48.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a66600640 1 -- 172.21.15.55:0/1529958250 shutdown_connections 2024-04-02T07:34:48.705 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a66600640 1 -- 172.21.15.55:0/1529958250 wait complete. 2024-04-02T07:34:48.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a66600640 1 Processor -- start 2024-04-02T07:34:48.706 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a66600640 1 -- start start 2024-04-02T07:34:48.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a66600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a6006c0d0 0x7f3a6015d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a66600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a60099120 0x7f3a6014e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a66600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a600b19d0 0x7f3a6014e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a66600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a601f6420 con 0x7f3a600b19d0 2024-04-02T07:34:48.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a66600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a601f6700 con 0x7f3a6006c0d0 2024-04-02T07:34:48.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a66600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a601f69e0 con 0x7f3a60099120 2024-04-02T07:34:48.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a5fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a600b19d0 0x7f3a6014e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.706+0000 7f3a5fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a600b19d0 0x7f3a6014e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46484/0 (socket says 172.21.15.55:46484) 2024-04-02T07:34:48.709 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.710+0000 7f3a5fe00640 1 -- 172.21.15.55:0/1169564192 learned_addr learned my addr 172.21.15.55:0/1169564192 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:48.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.710+0000 7f3a5f400640 1 --2- 172.21.15.55:0/1169564192 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a6006c0d0 0x7f3a6015d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.710+0000 7f3a57e00640 1 --2- 172.21.15.55:0/1169564192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a60099120 0x7f3a6014e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.710+0000 7f3a5fe00640 1 -- 172.21.15.55:0/1169564192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a60099120 msgr2=0x7f3a6014e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:48.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.710+0000 7f3a5fe00640 1 --2- 172.21.15.55:0/1169564192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a60099120 0x7f3a6014e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.710+0000 7f3a5fe00640 1 -- 172.21.15.55:0/1169564192 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a6006c0d0 msgr2=0x7f3a6015d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:48.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.710+0000 7f3a5fe00640 1 --2- 172.21.15.55:0/1169564192 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a6006c0d0 0x7f3a6015d1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.710+0000 7f3a5fe00640 1 -- 172.21.15.55:0/1169564192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a58009a70 con 0x7f3a600b19d0 2024-04-02T07:34:48.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.710+0000 7f3a5f400640 1 --2- 172.21.15.55:0/1169564192 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a6006c0d0 0x7f3a6015d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:48.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.710+0000 7f3a57e00640 1 --2- 172.21.15.55:0/1169564192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a60099120 0x7f3a6014e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:48.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.710+0000 7f3a5fe00640 1 --2- 172.21.15.55:0/1169564192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a600b19d0 0x7f3a6014e730 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f3a580b0040 tx=0x7f3a580196d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:48.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.710+0000 7f3a57400640 1 -- 172.21.15.55:0/1169564192 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580b9860 con 0x7f3a600b19d0 2024-04-02T07:34:48.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.710+0000 7f3a57400640 1 -- 172.21.15.55:0/1169564192 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a580b99c0 con 0x7f3a600b19d0 2024-04-02T07:34:48.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.710+0000 7f3a57400640 1 -- 172.21.15.55:0/1169564192 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a580b9d70 con 0x7f3a600b19d0 2024-04-02T07:34:48.710 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.710+0000 7f3a66600640 1 -- 172.21.15.55:0/1169564192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a601f6cc0 con 0x7f3a600b19d0 2024-04-02T07:34:48.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.710+0000 7f3a66600640 1 -- 172.21.15.55:0/1169564192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a600c4190 con 0x7f3a600b19d0 2024-04-02T07:34:48.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.710+0000 7f3a66600640 1 -- 172.21.15.55:0/1169564192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a60066c90 con 0x7f3a600b19d0 2024-04-02T07:34:48.711 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.710+0000 7f3a57400640 1 -- 172.21.15.55:0/1169564192 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f3a580ad440 con 0x7f3a600b19d0 2024-04-02T07:34:48.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.714+0000 7f3a57400640 1 --2- 172.21.15.55:0/1169564192 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3a3c0666c0 0x7f3a3c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:48.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.714+0000 7f3a57400640 1 -- 172.21.15.55:0/1169564192 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f3a5811eda0 con 0x7f3a600b19d0 2024-04-02T07:34:48.712 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.714+0000 7f3a5f400640 1 --2- 172.21.15.55:0/1169564192 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3a3c0666c0 0x7f3a3c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:48.713 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.714+0000 7f3a5f400640 1 --2- 172.21.15.55:0/1169564192 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3a3c0666c0 0x7f3a3c068b80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3a500097a0 tx=0x7f3a50008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:48.716 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.718+0000 7f3a57400640 1 -- 172.21.15.55:0/1169564192 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f3a580ec360 con 0x7f3a600b19d0 2024-04-02T07:34:48.879 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.878+0000 7f3a66600640 1 -- 172.21.15.55:0/1169564192 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3a601f7170 con 0x7f3a600b19d0 2024-04-02T07:34:48.880 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.882+0000 7f3a57400640 1 -- 172.21.15.55:0/1169564192 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v123) v1 ==== 74+0+12786 (secure 0 0 0) 0x7f3a580ef980 con 0x7f3a600b19d0 2024-04-02T07:34:48.880 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:48.881 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":123,"fsid":"642a0456-a2ac-49a4-91a5-3b3449b512da","created":"2024-04-02T07:21:53.254097+0000","modified":"2024-04-02T07:34:45.580291+0000","last_up_change":"2024-04-02T07:22:05.650750+0000","last_in_change":"2024-04-02T07:21:55.970457+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-02T07:22:06.397650+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"0748a6ad-e07b-4192-be51-783e3eb662e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27392},{"type":"v1","addr":"172.21.15.55:6801","nonce":27392}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27392},{"type":"v1","addr":"172.21.15.55:6803","nonce":27392}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27392},{"type":"v1","addr":"172.21.15.55:6807","nonce":27392}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27392},{"type":"v1","addr":"172.21.15.55:6805","nonce":27392}]},"public_addr":"172.21.15.55:6801/27392","cluster_addr":"172.21.15.55:6803/27392","heartbeat_back_addr":"172.21.15.55:6807/27392","heartbeat_front_addr":"172.21.15.55:6805/27392","state":["exists","up"]},{"osd":1,"uuid":"97e40d7e-77c8-4eea-91c8-24ab9f5f36ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6809","nonce":27391},{"type":"v1","addr":"172.21.15.55:6811","nonce":27391}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6813","nonce":27391},{"type":"v1","addr":"172.21.15.55:6815","nonce":27391}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6821","nonce":27391},{"type":"v1","addr":"172.21.15.55:6823","nonce":27391}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6817","nonce":27391},{"type":"v1","addr":"172.21.15.55:6819","nonce":27391}]},"public_addr":"172.21.15.55:6811/27391","cluster_addr":"172.21.15.55:6815/27391","heartbeat_back_addr":"172.21.15.55:6823/27391","heartbeat_front_addr":"172.21.15.55:6819/27391","state":["exists","up"]},{"osd":2,"uuid":"6124d994-e78c-4c14-a0b7-3fb3543763ac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27394},{"type":"v1","addr":"172.21.15.55:6810","nonce":27394}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":27394},{"type":"v1","addr":"172.21.15.55:6814","nonce":27394}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6820","nonce":27394},{"type":"v1","addr":"172.21.15.55:6822","nonce":27394}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6816","nonce":27394},{"type":"v1","addr":"172.21.15.55:6818","nonce":27394}]},"public_addr":"172.21.15.55:6810/27394","cluster_addr":"172.21.15.55:6814/27394","heartbeat_back_addr":"172.21.15.55:6822/27394","heartbeat_front_addr":"172.21.15.55:6818/27394","state":["exists","up"]},{"osd":3,"uuid":"c1093431-a105-4a56-bdd7-a24ac995ee78","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6824","nonce":27393},{"type":"v1","addr":"172.21.15.55:6825","nonce":27393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6826","nonce":27393},{"type":"v1","addr":"172.21.15.55:6827","nonce":27393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6830","nonce":27393},{"type":"v1","addr":"172.21.15.55:6831","nonce":27393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6828","nonce":27393},{"type":"v1","addr":"172.21.15.55:6829","nonce":27393}]},"public_addr":"172.21.15.55:6825/27393","cluster_addr":"172.21.15.55:6827/27393","heartbeat_back_addr":"172.21.15.55:6831/27393","heartbeat_front_addr":"172.21.15.55:6829/27393","state":["exists","up"]},{"osd":4,"uuid":"650f11d6-7798-4508-8dc6-4ecd9911979f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6801","nonce":27677},{"type":"v1","addr":"172.21.15.106:6803","nonce":27677}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6805","nonce":27677},{"type":"v1","addr":"172.21.15.106:6807","nonce":27677}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6813","nonce":27677},{"type":"v1","addr":"172.21.15.106:6815","nonce":27677}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6809","nonce":27677},{"type":"v1","addr":"172.21.15.106:6811","nonce":27677}]},"public_addr":"172.21.15.106:6803/27677","cluster_addr":"172.21.15.106:6807/27677","heartbeat_back_addr":"172.21.15.106:6815/27677","heartbeat_front_addr":"172.21.15.106:6811/27677","state":["exists","up"]},{"osd":5,"uuid":"318d8c96-f7a0-42d5-acec-ceb5ce34876d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":117,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":27676},{"type":"v1","addr":"172.21.15.106:6802","nonce":27676}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":27676},{"type":"v1","addr":"172.21.15.106:6806","nonce":27676}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":27676},{"type":"v1","addr":"172.21.15.106:6814","nonce":27676}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":27676},{"type":"v1","addr":"172.21.15.106:6810","nonce":27676}]},"public_addr":"172.21.15.106:6802/27676","cluster_addr":"172.21.15.106:6806/27676","heartbeat_back_addr":"172.21.15.106:6814/27676","heartbeat_front_addr":"172.21.15.106:6810/27676","state":["exists","up"]},{"osd":6,"uuid":"1c9ad1d7-d9aa-48ae-8fc7-3d0e92ad859e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":27678},{"type":"v1","addr":"172.21.15.106:6817","nonce":27678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":27678},{"type":"v1","addr":"172.21.15.106:6819","nonce":27678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":27678},{"type":"v1","addr":"172.21.15.106:6823","nonce":27678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":27678},{"type":"v1","addr":"172.21.15.106:6821","nonce":27678}]},"public_addr":"172.21.15.106:6817/27678","cluster_addr":"172.21.15.106:6819/27678","heartbeat_back_addr":"172.21.15.106:6823/27678","heartbeat_front_addr":"172.21.15.106:6821/27678","state":["exists","up"]},{"osd":7,"uuid":"26a25e9f-5f83-4989-8845-d0a6cbaef5f7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":114,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":27679},{"type":"v1","addr":"172.21.15.106:6825","nonce":27679}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":27679},{"type":"v1","addr":"172.21.15.106:6827","nonce":27679}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6830","nonce":27679},{"type":"v1","addr":"172.21.15.106:6831","nonce":27679}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6828","nonce":27679},{"type":"v1","addr":"172.21.15.106:6829","nonce":27679}]},"public_addr":"172.21.15.106:6825/27679","cluster_addr":"172.21.15.106:6827/27679","heartbeat_back_addr":"172.21.15.106:6831/27679","heartbeat_front_addr":"172.21.15.106:6829/27679","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.623945+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.611229+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.605243+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.593952+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.464443+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.517312+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.622803+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-04-02T07:22:01.693894+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.55:6835/1279080129":"2024-04-03T07:34:42.564082+0000","172.21.15.55:6832/1279080129":"2024-04-03T07:34:42.564082+0000","172.21.15.55:6835/154663344":"2024-04-03T07:34:25.539082+0000","172.21.15.55:6832/154663344":"2024-04-03T07:34:25.539082+0000","172.21.15.106:6837/775582321":"2024-04-03T07:34:04.807966+0000","172.21.15.106:6834/775582321":"2024-04-03T07:34:04.807966+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-02T07:34:48.882 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.882+0000 7f3a66600640 1 -- 172.21.15.55:0/1169564192 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3a3c0666c0 msgr2=0x7f3a3c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:48.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.882+0000 7f3a66600640 1 --2- 172.21.15.55:0/1169564192 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3a3c0666c0 0x7f3a3c068b80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f3a500097a0 tx=0x7f3a50008040 comp rx=0 tx=0).stop 2024-04-02T07:34:48.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.882+0000 7f3a66600640 1 -- 172.21.15.55:0/1169564192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a600b19d0 msgr2=0x7f3a6014e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:48.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.882+0000 7f3a66600640 1 --2- 172.21.15.55:0/1169564192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a600b19d0 0x7f3a6014e730 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f3a580b0040 tx=0x7f3a580196d0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.882+0000 7f3a66600640 1 -- 172.21.15.55:0/1169564192 shutdown_connections 2024-04-02T07:34:48.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.882+0000 7f3a66600640 1 --2- 172.21.15.55:0/1169564192 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3a600b19d0 0x7f3a6014e730 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.883 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.882+0000 7f3a66600640 1 --2- 172.21.15.55:0/1169564192 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f3a60099120 0x7f3a6014e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.882+0000 7f3a66600640 1 --2- 172.21.15.55:0/1169564192 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f3a3c0666c0 0x7f3a3c068b80 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.884 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.882+0000 7f3a66600640 1 --2- 172.21.15.55:0/1169564192 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f3a6006c0d0 0x7f3a6015d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:48.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.882+0000 7f3a66600640 1 -- 172.21.15.55:0/1169564192 >> 172.21.15.55:0/1169564192 conn(0x7f3a600b2150 msgr2=0x7f3a60098a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:48.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.882+0000 7f3a66600640 1 -- 172.21.15.55:0/1169564192 shutdown_connections 2024-04-02T07:34:48.885 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:48.882+0000 7f3a66600640 1 -- 172.21.15.55:0/1169564192 wait complete. 2024-04-02T07:34:49.903 INFO:tasks.ceph:Scrubbing osd.0 2024-04-02T07:34:49.904 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-02T07:34:50.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.062+0000 7ffa30000640 1 Processor -- start 2024-04-02T07:34:50.061 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.062+0000 7ffa30000640 1 -- start start 2024-04-02T07:34:50.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.062+0000 7ffa30000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffa2815a900 0x7ffa280996c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.062 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.062+0000 7ffa30000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffa280b06e0 0x7ffa280ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.062+0000 7ffa30000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa280b1fd0 con 0x7ffa280cf000 2024-04-02T07:34:50.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.062+0000 7ffa30000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa280b1bb0 con 0x7ffa2815a900 2024-04-02T07:34:50.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.062+0000 7ffa30000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa280cf490 con 0x7ffa280b06e0 2024-04-02T07:34:50.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.062+0000 7ffa2d600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffa2815a900 0x7ffa280996c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.062+0000 7ffa2e000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ffa280cf000 0x7ffa280ad300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41216/0 (socket says 172.21.15.55:41216) 2024-04-02T07:34:50.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.062+0000 7ffa2d600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ffa2815a900 0x7ffa280996c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46500/0 (socket says 172.21.15.55:46500) 2024-04-02T07:34:50.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.062+0000 7ffa2e000640 1 -- 172.21.15.55:0/3133348610 learned_addr learned my addr 172.21.15.55:0/3133348610 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:50.063 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.062+0000 7ffa2cc00640 1 --2- 172.21.15.55:0/3133348610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffa280b06e0 0x7ffa280ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.062+0000 7ffa2d600640 1 -- 172.21.15.55:0/3133348610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffa280b06e0 msgr2=0x7ffa280ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:50.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.062+0000 7ffa2d600640 1 --2- 172.21.15.55:0/3133348610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffa280b06e0 0x7ffa280ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.062+0000 7ffa2d600640 1 -- 172.21.15.55:0/3133348610 >> v1:172.21.15.55:6789/0 conn(0x7ffa280cf000 legacy=0x7ffa280ad300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.062+0000 7ffa27e00640 1 -- 172.21.15.55:0/3133348610 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 52372977 0 0) 0x7ffa280b1fd0 con 0x7ffa280cf000 2024-04-02T07:34:50.064 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.062+0000 7ffa2d600640 1 -- 172.21.15.55:0/3133348610 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa280b0f30 con 0x7ffa2815a900 2024-04-02T07:34:50.065 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.066+0000 7ffa2d600640 1 --2- 172.21.15.55:0/3133348610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa2815a900 0x7ffa280996c0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0097c0 tx=0x7ffa1c01c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1122de2bcbc50ff3 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:50.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.066+0000 7ffa27e00640 1 -- 172.21.15.55:0/3133348610 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c0ab600 con 0x7ffa2815a900 2024-04-02T07:34:50.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.066+0000 7ffa27e00640 1 -- 172.21.15.55:0/3133348610 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1c0a7050 con 0x7ffa2815a900 2024-04-02T07:34:50.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.066+0000 7ffa27e00640 1 -- 172.21.15.55:0/3133348610 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c0ab980 con 0x7ffa2815a900 2024-04-02T07:34:50.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.066+0000 7ffa30000640 1 -- 172.21.15.55:0/3133348610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa2815a900 msgr2=0x7ffa280996c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.066+0000 7ffa30000640 1 --2- 172.21.15.55:0/3133348610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa2815a900 0x7ffa280996c0 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c0097c0 tx=0x7ffa1c01c410 comp rx=0 tx=0).stop 2024-04-02T07:34:50.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.066+0000 7ffa30000640 1 -- 172.21.15.55:0/3133348610 shutdown_connections 2024-04-02T07:34:50.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.066+0000 7ffa30000640 1 --2- 172.21.15.55:0/3133348610 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffa280b06e0 0x7ffa280ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.066+0000 7ffa30000640 1 --2- 172.21.15.55:0/3133348610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa2815a900 0x7ffa280996c0 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.066+0000 7ffa30000640 1 -- 172.21.15.55:0/3133348610 >> 172.21.15.55:0/3133348610 conn(0x7ffa280d0700 msgr2=0x7ffa280d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:50.067 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.066+0000 7ffa30000640 1 -- 172.21.15.55:0/3133348610 shutdown_connections 2024-04-02T07:34:50.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.066+0000 7ffa30000640 1 -- 172.21.15.55:0/3133348610 wait complete. 2024-04-02T07:34:50.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa30000640 1 Processor -- start 2024-04-02T07:34:50.068 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa30000640 1 -- start start 2024-04-02T07:34:50.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa30000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa280b06e0 0x7ffa281629a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa30000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffa280cf000 0x7ffa281518d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa30000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa2815a900 0x7ffa28151e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa30000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa28152d90 con 0x7ffa280b06e0 2024-04-02T07:34:50.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa30000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa28152350 con 0x7ffa2815a900 2024-04-02T07:34:50.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa30000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa28165250 con 0x7ffa280cf000 2024-04-02T07:34:50.071 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa2d600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa280b06e0 0x7ffa281629a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa2d600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa280b06e0 0x7ffa281629a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46514/0 (socket says 172.21.15.55:46514) 2024-04-02T07:34:50.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa2d600640 1 -- 172.21.15.55:0/3595595618 learned_addr learned my addr 172.21.15.55:0/3595595618 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:50.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa2e000640 1 --2- 172.21.15.55:0/3595595618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa2815a900 0x7ffa28151e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa2cc00640 1 --2- 172.21.15.55:0/3595595618 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffa280cf000 0x7ffa281518d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa2d600640 1 -- 172.21.15.55:0/3595595618 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffa280cf000 msgr2=0x7ffa281518d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa2d600640 1 --2- 172.21.15.55:0/3595595618 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffa280cf000 0x7ffa281518d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa2d600640 1 -- 172.21.15.55:0/3595595618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa2815a900 msgr2=0x7ffa28151e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa2d600640 1 --2- 172.21.15.55:0/3595595618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa2815a900 0x7ffa28151e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa2d600640 1 -- 172.21.15.55:0/3595595618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1c009420 con 0x7ffa280b06e0 2024-04-02T07:34:50.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa2e000640 1 --2- 172.21.15.55:0/3595595618 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7ffa2815a900 0x7ffa28151e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:50.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa2cc00640 1 --2- 172.21.15.55:0/3595595618 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7ffa280cf000 0x7ffa281518d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:50.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa2d600640 1 --2- 172.21.15.55:0/3595595618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa280b06e0 0x7ffa281629a0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c01a040 tx=0x7ffa1c01ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:50.072 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa25600640 1 -- 172.21.15.55:0/3595595618 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c006e20 con 0x7ffa280b06e0 2024-04-02T07:34:50.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa25600640 1 -- 172.21.15.55:0/3595595618 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1c004030 con 0x7ffa280b06e0 2024-04-02T07:34:50.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa30000640 1 -- 172.21.15.55:0/3595595618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa280afdc0 con 0x7ffa280b06e0 2024-04-02T07:34:50.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa25600640 1 -- 172.21.15.55:0/3595595618 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1c0043a0 con 0x7ffa280b06e0 2024-04-02T07:34:50.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa30000640 1 -- 172.21.15.55:0/3595595618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2806aea0 con 0x7ffa280b06e0 2024-04-02T07:34:50.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.070+0000 7ffa30000640 1 -- 172.21.15.55:0/3595595618 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ffa281673f0 con 0x7ffa280b06e0 2024-04-02T07:34:50.073 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.074+0000 7ffa25600640 1 -- 172.21.15.55:0/3595595618 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7ffa1c003620 con 0x7ffa280b06e0 2024-04-02T07:34:50.074 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.074+0000 7ffa25600640 1 --2- 172.21.15.55:0/3595595618 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffa080666c0 0x7ffa08068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.074+0000 7ffa25600640 1 -- 172.21.15.55:0/3595595618 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7ffa1c11ecd0 con 0x7ffa280b06e0 2024-04-02T07:34:50.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.074+0000 7ffa2cc00640 1 --2- 172.21.15.55:0/3595595618 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffa080666c0 0x7ffa08068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.074+0000 7ffa25600640 1 --2- 172.21.15.55:0/3595595618 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x7ffa0806c660 0x7ffa0806ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.074+0000 7ffa25600640 1 -- 172.21.15.55:0/3595595618 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa0806f130 con 0x7ffa0806c660 2024-04-02T07:34:50.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.074+0000 7ffa25600640 1 -- 172.21.15.55:0/3595595618 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=123) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffa1c11f040 con 0x7ffa280b06e0 2024-04-02T07:34:50.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.074+0000 7ffa2e000640 1 --2- 172.21.15.55:0/3595595618 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x7ffa0806c660 0x7ffa0806ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.075 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.074+0000 7ffa2cc00640 1 --2- 172.21.15.55:0/3595595618 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffa080666c0 0x7ffa08068b80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7ffa2809e650 tx=0x7ffa14008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:50.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.074+0000 7ffa2e000640 1 --2- 172.21.15.55:0/3595595618 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x7ffa0806c660 0x7ffa0806ea80 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:50.076 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.078+0000 7ffa25600640 1 -- 172.21.15.55:0/3595595618 <== osd.0 v2:172.21.15.55:6800/27392 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7ffa0806f130 con 0x7ffa0806c660 2024-04-02T07:34:50.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.090+0000 7ffa30000640 1 -- 172.21.15.55:0/3595595618 --> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7ffa2806b030 con 0x7ffa0806c660 2024-04-02T07:34:50.089 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.090+0000 7ffa25600640 1 -- 172.21.15.55:0/3595595618 <== osd.0 v2:172.21.15.55:6800/27392 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7ffa2806b030 con 0x7ffa0806c660 2024-04-02T07:34:50.089 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:34:50.090 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-02T07:34:50.090 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:34:50.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.090+0000 7ffa30000640 1 -- 172.21.15.55:0/3595595618 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x7ffa0806c660 msgr2=0x7ffa0806ea80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.090+0000 7ffa30000640 1 --2- 172.21.15.55:0/3595595618 >> [v2:172.21.15.55:6800/27392,v1:172.21.15.55:6801/27392] conn(0x7ffa0806c660 0x7ffa0806ea80 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.090+0000 7ffa30000640 1 -- 172.21.15.55:0/3595595618 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffa080666c0 msgr2=0x7ffa08068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.090+0000 7ffa30000640 1 --2- 172.21.15.55:0/3595595618 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7ffa080666c0 0x7ffa08068b80 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7ffa2809e650 tx=0x7ffa14008040 comp rx=0 tx=0).stop 2024-04-02T07:34:50.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.090+0000 7ffa30000640 1 -- 172.21.15.55:0/3595595618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa280b06e0 msgr2=0x7ffa281629a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.090+0000 7ffa30000640 1 --2- 172.21.15.55:0/3595595618 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ffa280b06e0 0x7ffa281629a0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7ffa1c01a040 tx=0x7ffa1c01ac50 comp rx=0 tx=0).stop 2024-04-02T07:34:50.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.090+0000 7ffa2e000640 1 -- 172.21.15.55:0/3595595618 reap_dead start 2024-04-02T07:34:50.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.090+0000 7ffa30000640 1 -- 172.21.15.55:0/3595595618 shutdown_connections 2024-04-02T07:34:50.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.090+0000 7ffa30000640 1 -- 172.21.15.55:0/3595595618 >> 172.21.15.55:0/3595595618 conn(0x7ffa280d0700 msgr2=0x7ffa2806f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:50.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.090+0000 7ffa30000640 1 -- 172.21.15.55:0/3595595618 shutdown_connections 2024-04-02T07:34:50.091 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.090+0000 7ffa30000640 1 -- 172.21.15.55:0/3595595618 wait complete. 2024-04-02T07:34:50.108 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-02T07:34:50.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.250+0000 7f1b0fe00640 1 Processor -- start 2024-04-02T07:34:50.249 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.250+0000 7f1b0fe00640 1 -- start start 2024-04-02T07:34:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.250+0000 7f1b0fe00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f1b1015c860 0x7f1b100ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.250+0000 7f1b0fe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1b1015cc40 0x7f1b100cead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.250+0000 7f1b0fe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b100ae580 0x7f1b10069d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.250+0000 7f1b0fe00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b100aee40 con 0x7f1b1015cc40 2024-04-02T07:34:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.250+0000 7f1b0fe00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b1006e120 con 0x7f1b1015c860 2024-04-02T07:34:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.250+0000 7f1b0fe00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b100cf010 con 0x7f1b100ae580 2024-04-02T07:34:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.250+0000 7f1b06000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1b1015cc40 0x7f1b100cead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.250+0000 7f1b06000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1b1015cc40 0x7f1b100cead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46530/0 (socket says 172.21.15.55:46530) 2024-04-02T07:34:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.250+0000 7f1b06000640 1 -- 172.21.15.55:0/3743885482 learned_addr learned my addr 172.21.15.55:0/3743885482 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.250+0000 7f1b0ea00640 1 --2- 172.21.15.55:0/3743885482 >> v2:172.21.15.106:3300/0 conn(0x7f1b1015c860 0x7f1b100ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.250+0000 7f1b0f400640 1 --2- 172.21.15.55:0/3743885482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b100ae580 0x7f1b10069d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.250+0000 7f1b06000640 1 -- 172.21.15.55:0/3743885482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b100ae580 msgr2=0x7f1b10069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:50.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.250+0000 7f1b06000640 1 --2- 172.21.15.55:0/3743885482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b100ae580 0x7f1b10069d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.250+0000 7f1b06000640 1 -- 172.21.15.55:0/3743885482 >> v2:172.21.15.106:3300/0 conn(0x7f1b1015c860 msgr2=0x7f1b100ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:50.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.250+0000 7f1b06000640 1 --2- 172.21.15.55:0/3743885482 >> v2:172.21.15.106:3300/0 conn(0x7f1b1015c860 0x7f1b100ce590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.252 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.250+0000 7f1b06000640 1 -- 172.21.15.55:0/3743885482 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1006d510 con 0x7f1b1015cc40 2024-04-02T07:34:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.254+0000 7f1b06000640 1 --2- 172.21.15.55:0/3743885482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b1015cc40 0x7f1b100cead0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f1b100cf500 tx=0x7f1af801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3673631cc9133889 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.254+0000 7f1b0e000640 1 -- 172.21.15.55:0/3743885482 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af80ab620 con 0x7f1b1015cc40 2024-04-02T07:34:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.254+0000 7f1b0e000640 1 -- 172.21.15.55:0/3743885482 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1af80ab780 con 0x7f1b1015cc40 2024-04-02T07:34:50.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.254+0000 7f1b0e000640 1 -- 172.21.15.55:0/3743885482 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af80abb10 con 0x7f1b1015cc40 2024-04-02T07:34:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.254+0000 7f1b0fe00640 1 -- 172.21.15.55:0/3743885482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b1015cc40 msgr2=0x7f1b100cead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.254+0000 7f1b0fe00640 1 --2- 172.21.15.55:0/3743885482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b1015cc40 0x7f1b100cead0 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7f1b100cf500 tx=0x7f1af801c460 comp rx=0 tx=0).stop 2024-04-02T07:34:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.254+0000 7f1b0fe00640 1 -- 172.21.15.55:0/3743885482 shutdown_connections 2024-04-02T07:34:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.254+0000 7f1b0fe00640 1 --2- 172.21.15.55:0/3743885482 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b100ae580 0x7f1b10069d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.254+0000 7f1b0fe00640 1 --2- 172.21.15.55:0/3743885482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b1015cc40 0x7f1b100cead0 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.254+0000 7f1b0fe00640 1 --2- 172.21.15.55:0/3743885482 >> v2:172.21.15.106:3300/0 conn(0x7f1b1015c860 0x7f1b100ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.254+0000 7f1b0fe00640 1 -- 172.21.15.55:0/3743885482 >> 172.21.15.55:0/3743885482 conn(0x7f1b10098a10 msgr2=0x7f1b100cf5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.254+0000 7f1b0fe00640 1 -- 172.21.15.55:0/3743885482 shutdown_connections 2024-04-02T07:34:50.255 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.254+0000 7f1b0fe00640 1 -- 172.21.15.55:0/3743885482 wait complete. 2024-04-02T07:34:50.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0fe00640 1 Processor -- start 2024-04-02T07:34:50.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0fe00640 1 -- start start 2024-04-02T07:34:50.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0fe00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b100ae580 0x7f1b10151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0fe00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b1015c860 0x7f1b101548d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b1015cc40 0x7f1b10154e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0fe00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b100af390 con 0x7f1b1015cc40 2024-04-02T07:34:50.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0fe00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b100b07b0 con 0x7f1b100ae580 2024-04-02T07:34:50.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0fe00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1015a000 con 0x7f1b1015c860 2024-04-02T07:34:50.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b1015cc40 0x7f1b10154e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0f400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b1015cc40 0x7f1b10154e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46538/0 (socket says 172.21.15.55:46538) 2024-04-02T07:34:50.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0f400640 1 -- 172.21.15.55:0/995354253 learned_addr learned my addr 172.21.15.55:0/995354253 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:50.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b06000640 1 --2- 172.21.15.55:0/995354253 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b1015c860 0x7f1b101548d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0ea00640 1 --2- 172.21.15.55:0/995354253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b100ae580 0x7f1b10151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0f400640 1 -- 172.21.15.55:0/995354253 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b1015c860 msgr2=0x7f1b101548d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0f400640 1 --2- 172.21.15.55:0/995354253 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b1015c860 0x7f1b101548d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0f400640 1 -- 172.21.15.55:0/995354253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b100ae580 msgr2=0x7f1b10151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0f400640 1 --2- 172.21.15.55:0/995354253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b100ae580 0x7f1b10151020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0f400640 1 -- 172.21.15.55:0/995354253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af80094d0 con 0x7f1b1015cc40 2024-04-02T07:34:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0f400640 1 --2- 172.21.15.55:0/995354253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b1015cc40 0x7f1b10154e10 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800efc0 tx=0x7f1b0800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b07400640 1 -- 172.21.15.55:0/995354253 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08014480 con 0x7f1b1015cc40 2024-04-02T07:34:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b07400640 1 -- 172.21.15.55:0/995354253 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0800f040 con 0x7f1b1015cc40 2024-04-02T07:34:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0fe00640 1 -- 172.21.15.55:0/995354253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b1015a2e0 con 0x7f1b1015cc40 2024-04-02T07:34:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b07400640 1 -- 172.21.15.55:0/995354253 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08014820 con 0x7f1b1015cc40 2024-04-02T07:34:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0fe00640 1 -- 172.21.15.55:0/995354253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1015a8a0 con 0x7f1b1015cc40 2024-04-02T07:34:50.260 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.258+0000 7f1b0fe00640 1 -- 172.21.15.55:0/995354253 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b10073fa0 con 0x7f1b1015cc40 2024-04-02T07:34:50.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.262+0000 7f1b07400640 1 -- 172.21.15.55:0/995354253 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1b08014980 con 0x7f1b1015cc40 2024-04-02T07:34:50.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.262+0000 7f1b07400640 1 --2- 172.21.15.55:0/995354253 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1aec0666c0 0x7f1aec068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.262+0000 7f1b07400640 1 -- 172.21.15.55:0/995354253 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f1b08084970 con 0x7f1b1015cc40 2024-04-02T07:34:50.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.262+0000 7f1b0ea00640 1 --2- 172.21.15.55:0/995354253 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1aec0666c0 0x7f1aec068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.262+0000 7f1b0ea00640 1 --2- 172.21.15.55:0/995354253 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1aec0666c0 0x7f1aec068b80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009ae0 tx=0x7f1b00009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:50.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.266+0000 7f1b07400640 1 -- 172.21.15.55:0/995354253 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f1b08051fe0 con 0x7f1b1015cc40 2024-04-02T07:34:50.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.426+0000 7f1b0fe00640 1 -- 172.21.15.55:0/995354253 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b100c9a20 con 0x7f1aec0666c0 2024-04-02T07:34:50.425 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.426+0000 7f1b07400640 1 -- 172.21.15.55:0/995354253 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1b100c9a20 con 0x7f1aec0666c0 2024-04-02T07:34:50.425 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 0 to deep-scrub 2024-04-02T07:34:50.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.426+0000 7f1b0fe00640 1 -- 172.21.15.55:0/995354253 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1aec0666c0 msgr2=0x7f1aec068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.426+0000 7f1b0fe00640 1 --2- 172.21.15.55:0/995354253 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1aec0666c0 0x7f1aec068b80 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009ae0 tx=0x7f1b00009190 comp rx=0 tx=0).stop 2024-04-02T07:34:50.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.426+0000 7f1b0fe00640 1 -- 172.21.15.55:0/995354253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b1015cc40 msgr2=0x7f1b10154e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.426+0000 7f1b0fe00640 1 --2- 172.21.15.55:0/995354253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b1015cc40 0x7f1b10154e10 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f1b0800efc0 tx=0x7f1b0800c490 comp rx=0 tx=0).stop 2024-04-02T07:34:50.427 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.426+0000 7f1b0fe00640 1 -- 172.21.15.55:0/995354253 shutdown_connections 2024-04-02T07:34:50.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.426+0000 7f1b0fe00640 1 --2- 172.21.15.55:0/995354253 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b1015cc40 0x7f1b10154e10 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.426+0000 7f1b0fe00640 1 --2- 172.21.15.55:0/995354253 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1b1015c860 0x7f1b101548d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.426+0000 7f1b0fe00640 1 --2- 172.21.15.55:0/995354253 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1aec0666c0 0x7f1aec068b80 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.426+0000 7f1b0fe00640 1 --2- 172.21.15.55:0/995354253 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1b100ae580 0x7f1b10151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.426+0000 7f1b0fe00640 1 -- 172.21.15.55:0/995354253 >> 172.21.15.55:0/995354253 conn(0x7f1b10098a10 msgr2=0x7f1b100add00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:50.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.426+0000 7f1b0fe00640 1 -- 172.21.15.55:0/995354253 shutdown_connections 2024-04-02T07:34:50.428 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.426+0000 7f1b0fe00640 1 -- 172.21.15.55:0/995354253 wait complete. 2024-04-02T07:34:50.446 INFO:tasks.ceph:Scrubbing osd.1 2024-04-02T07:34:50.446 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-02T07:34:50.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.590+0000 7fded3200640 1 Processor -- start 2024-04-02T07:34:50.590 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.590+0000 7fded3200640 1 -- start start 2024-04-02T07:34:50.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.590+0000 7fded3200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdecc06d1c0 0x7fdecc0b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.591 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.590+0000 7fded3200640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdecc0b1d60 con 0x7fdecc15ce40 2024-04-02T07:34:50.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.590+0000 7fded3200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdecc06c400 con 0x7fdecc0afe70 2024-04-02T07:34:50.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.590+0000 7fded3200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc06cda0 con 0x7fdecc06d1c0 2024-04-02T07:34:50.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.590+0000 7fdecbe00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdecc15ce40 0x7fdecc0b31e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41218/0 (socket says 172.21.15.55:41218) 2024-04-02T07:34:50.592 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.590+0000 7fdecbe00640 1 -- 172.21.15.55:0/3160421064 learned_addr learned my addr 172.21.15.55:0/3160421064 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:50.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.594+0000 7fdec3400640 1 --2- 172.21.15.55:0/3160421064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdecc06d1c0 0x7fdecc0b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.594+0000 7fdecb400640 1 -- 172.21.15.55:0/3160421064 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2955274884 0 0) 0x7fdecc0b1d60 con 0x7fdecc15ce40 2024-04-02T07:34:50.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.594+0000 7fdecb400640 1 -- 172.21.15.55:0/3160421064 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdeb0003530 con 0x7fdecc15ce40 2024-04-02T07:34:50.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.594+0000 7fdecb400640 1 -- 172.21.15.55:0/3160421064 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304134488 0 0) 0x7fdecc06c400 con 0x7fdecc0afe70 2024-04-02T07:34:50.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.594+0000 7fdecb400640 1 -- 172.21.15.55:0/3160421064 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdecc0b1d60 con 0x7fdecc0afe70 2024-04-02T07:34:50.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.594+0000 7fdecb400640 1 -- 172.21.15.55:0/3160421064 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1571946741 0 0) 0x7fdeb0003530 con 0x7fdecc15ce40 2024-04-02T07:34:50.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.594+0000 7fdec3400640 1 -- 172.21.15.55:0/3160421064 >> v1:172.21.15.106:6789/0 conn(0x7fdecc0afe70 legacy=0x7fdecc0c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.594+0000 7fdec3400640 1 -- 172.21.15.55:0/3160421064 >> v1:172.21.15.55:6789/0 conn(0x7fdecc15ce40 legacy=0x7fdecc0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.593 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.594+0000 7fdec3400640 1 -- 172.21.15.55:0/3160421064 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdecc06c6e0 con 0x7fdecc06d1c0 2024-04-02T07:34:50.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.594+0000 7fdec3400640 1 --2- 172.21.15.55:0/3160421064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdecc06d1c0 0x7fdecc0b1780 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40097f0 tx=0x7fdeb401c370 comp rx=0 tx=0).ready entity=mon.2 client_cookie=adb61bf666f5f821 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:50.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.594+0000 7fdecb400640 1 -- 172.21.15.55:0/3160421064 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc001680 con 0x7fdecc06d1c0 2024-04-02T07:34:50.595 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.594+0000 7fdecb400640 1 -- 172.21.15.55:0/3160421064 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdeb40a7050 con 0x7fdecc06d1c0 2024-04-02T07:34:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.594+0000 7fdecb400640 1 -- 172.21.15.55:0/3160421064 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdeb40ab620 con 0x7fdecc06d1c0 2024-04-02T07:34:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fded3200640 1 -- 172.21.15.55:0/3160421064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdecc06d1c0 msgr2=0x7fdecc0b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fded3200640 1 --2- 172.21.15.55:0/3160421064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdecc06d1c0 0x7fdecc0b1780 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40097f0 tx=0x7fdeb401c370 comp rx=0 tx=0).stop 2024-04-02T07:34:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fded3200640 1 -- 172.21.15.55:0/3160421064 shutdown_connections 2024-04-02T07:34:50.596 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fded3200640 1 --2- 172.21.15.55:0/3160421064 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdecc06d1c0 0x7fdecc0b1780 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fded3200640 1 -- 172.21.15.55:0/3160421064 >> 172.21.15.55:0/3160421064 conn(0x7fdecc069d90 msgr2=0x7fdecc06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:50.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fded3200640 1 -- 172.21.15.55:0/3160421064 shutdown_connections 2024-04-02T07:34:50.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fded3200640 1 -- 172.21.15.55:0/3160421064 wait complete. 2024-04-02T07:34:50.597 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fded3200640 1 Processor -- start 2024-04-02T07:34:50.598 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fded3200640 1 -- start start 2024-04-02T07:34:50.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fded3200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdecc06d1c0 0x7fdecc153f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fded3200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdecc0afe70 0x7fdecc149620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fded3200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdecc15ce40 0x7fdecc149b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.601 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fded3200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc132450 con 0x7fdecc06d1c0 2024-04-02T07:34:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fded3200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc1328e0 con 0x7fdecc0afe70 2024-04-02T07:34:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fded3200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc144a80 con 0x7fdecc15ce40 2024-04-02T07:34:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fdecbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdecc06d1c0 0x7fdecc153f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fdecbe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdecc06d1c0 0x7fdecc153f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46544/0 (socket says 172.21.15.55:46544) 2024-04-02T07:34:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fdecbe00640 1 -- 172.21.15.55:0/3773590946 learned_addr learned my addr 172.21.15.55:0/3773590946 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fdec3400640 1 --2- 172.21.15.55:0/3773590946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdecc0afe70 0x7fdecc149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fded1200640 1 --2- 172.21.15.55:0/3773590946 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdecc15ce40 0x7fdecc149b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fdecbe00640 1 -- 172.21.15.55:0/3773590946 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdecc15ce40 msgr2=0x7fdecc149b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.602 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fdecbe00640 1 --2- 172.21.15.55:0/3773590946 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdecc15ce40 0x7fdecc149b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fdecbe00640 1 -- 172.21.15.55:0/3773590946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdecc0afe70 msgr2=0x7fdecc149620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fdecbe00640 1 --2- 172.21.15.55:0/3773590946 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fdecc0afe70 0x7fdecc149620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fdecbe00640 1 -- 172.21.15.55:0/3773590946 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdeb4009420 con 0x7fdecc06d1c0 2024-04-02T07:34:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fded1200640 1 --2- 172.21.15.55:0/3773590946 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fdecc15ce40 0x7fdecc149b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.598+0000 7fdecbe00640 1 --2- 172.21.15.55:0/3773590946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdecc06d1c0 0x7fdecc153f00 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00c730 tx=0x7fdebc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.602+0000 7fdec8c00640 1 -- 172.21.15.55:0/3773590946 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc005ae0 con 0x7fdecc06d1c0 2024-04-02T07:34:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.602+0000 7fdec8c00640 1 -- 172.21.15.55:0/3773590946 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdebc005c60 con 0x7fdecc06d1c0 2024-04-02T07:34:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.602+0000 7fdec8c00640 1 -- 172.21.15.55:0/3773590946 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdebc007070 con 0x7fdecc06d1c0 2024-04-02T07:34:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.602+0000 7fded3200640 1 -- 172.21.15.55:0/3773590946 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdecc154440 con 0x7fdecc06d1c0 2024-04-02T07:34:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.602+0000 7fded3200640 1 -- 172.21.15.55:0/3773590946 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdecc131e00 con 0x7fdecc06d1c0 2024-04-02T07:34:50.603 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.602+0000 7fded3200640 1 -- 172.21.15.55:0/3773590946 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdecc0b1050 con 0x7fdecc06d1c0 2024-04-02T07:34:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.602+0000 7fdec8c00640 1 -- 172.21.15.55:0/3773590946 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fdebc0071d0 con 0x7fdecc06d1c0 2024-04-02T07:34:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.602+0000 7fdec8c00640 1 --2- 172.21.15.55:0/3773590946 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdea8066690 0x7fdea8068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.602+0000 7fdec8c00640 1 -- 172.21.15.55:0/3773590946 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fdebc083770 con 0x7fdecc06d1c0 2024-04-02T07:34:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.602+0000 7fdec8c00640 1 --2- 172.21.15.55:0/3773590946 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x7fdea806c630 0x7fdea806ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.602+0000 7fdec8c00640 1 -- 172.21.15.55:0/3773590946 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdea806f100 con 0x7fdea806c630 2024-04-02T07:34:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.602+0000 7fdec8c00640 1 -- 172.21.15.55:0/3773590946 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=123) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdebc085e30 con 0x7fdecc06d1c0 2024-04-02T07:34:50.605 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.602+0000 7fdec3400640 1 --2- 172.21.15.55:0/3773590946 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdea8066690 0x7fdea8068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.602+0000 7fded1200640 1 --2- 172.21.15.55:0/3773590946 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x7fdea806c630 0x7fdea806ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.606+0000 7fded1200640 1 --2- 172.21.15.55:0/3773590946 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x7fdea806c630 0x7fdea806ea50 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:50.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.606+0000 7fdec3400640 1 --2- 172.21.15.55:0/3773590946 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdea8066690 0x7fdea8068b50 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40ad000 tx=0x7fdeb40a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:50.606 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.606+0000 7fdec8c00640 1 -- 172.21.15.55:0/3773590946 <== osd.1 v2:172.21.15.55:6809/27391 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fdea806f100 con 0x7fdea806c630 2024-04-02T07:34:50.617 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.618+0000 7fded3200640 1 -- 172.21.15.55:0/3773590946 --> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fdecc132590 con 0x7fdea806c630 2024-04-02T07:34:50.618 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.618+0000 7fdec8c00640 1 -- 172.21.15.55:0/3773590946 <== osd.1 v2:172.21.15.55:6809/27391 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fdec4001f00 con 0x7fdea806c630 2024-04-02T07:34:50.618 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:34:50.618 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-02T07:34:50.619 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:34:50.620 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.618+0000 7fded3200640 1 -- 172.21.15.55:0/3773590946 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x7fdea806c630 msgr2=0x7fdea806ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.618+0000 7fded3200640 1 --2- 172.21.15.55:0/3773590946 >> [v2:172.21.15.55:6809/27391,v1:172.21.15.55:6811/27391] conn(0x7fdea806c630 0x7fdea806ea50 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.618+0000 7fded3200640 1 -- 172.21.15.55:0/3773590946 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdea8066690 msgr2=0x7fdea8068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.618+0000 7fded3200640 1 --2- 172.21.15.55:0/3773590946 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fdea8066690 0x7fdea8068b50 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40ad000 tx=0x7fdeb40a6000 comp rx=0 tx=0).stop 2024-04-02T07:34:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.618+0000 7fded3200640 1 -- 172.21.15.55:0/3773590946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdecc06d1c0 msgr2=0x7fdecc153f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.618+0000 7fded3200640 1 --2- 172.21.15.55:0/3773590946 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdecc06d1c0 0x7fdecc153f00 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7fdebc00c730 tx=0x7fdebc00cbf0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.618+0000 7fded1200640 1 -- 172.21.15.55:0/3773590946 reap_dead start 2024-04-02T07:34:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.618+0000 7fded3200640 1 -- 172.21.15.55:0/3773590946 shutdown_connections 2024-04-02T07:34:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.618+0000 7fded3200640 1 -- 172.21.15.55:0/3773590946 >> 172.21.15.55:0/3773590946 conn(0x7fdecc069d90 msgr2=0x7fdecc0c90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.618+0000 7fded3200640 1 -- 172.21.15.55:0/3773590946 shutdown_connections 2024-04-02T07:34:50.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.618+0000 7fded3200640 1 -- 172.21.15.55:0/3773590946 wait complete. 2024-04-02T07:34:50.636 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-02T07:34:50.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.778+0000 7f1c52c00640 1 Processor -- start 2024-04-02T07:34:50.777 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.778+0000 7f1c52c00640 1 -- start start 2024-04-02T07:34:50.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.778+0000 7f1c52c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c4c06dbf0 0x7f1c4c06dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.778+0000 7f1c52c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c4c0b2f10 con 0x7f1c4c06a170 2024-04-02T07:34:50.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.778+0000 7f1c52c00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c4c15b1d0 con 0x7f1c4c071090 2024-04-02T07:34:50.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.778+0000 7f1c52c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c0b3d10 con 0x7f1c4c06dbf0 2024-04-02T07:34:50.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.778+0000 7f1c50c00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1c4c06a170 0x7f1c4c06a600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41230/0 (socket says 172.21.15.55:41230) 2024-04-02T07:34:50.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.778+0000 7f1c50c00640 1 -- 172.21.15.55:0/1545272541 learned_addr learned my addr 172.21.15.55:0/1545272541 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:50.779 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.778+0000 7f1c4be00640 1 --2- 172.21.15.55:0/1545272541 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c4c06dbf0 0x7f1c4c06dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.778+0000 7f1c4b400640 1 -- 172.21.15.55:0/1545272541 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603585277 0 0) 0x7f1c4c0b2f10 con 0x7f1c4c06a170 2024-04-02T07:34:50.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.778+0000 7f1c4b400640 1 -- 172.21.15.55:0/1545272541 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c30003530 con 0x7f1c4c06a170 2024-04-02T07:34:50.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.778+0000 7f1c4b400640 1 -- 172.21.15.55:0/1545272541 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3620008201 0 0) 0x7f1c4c15b1d0 con 0x7f1c4c071090 2024-04-02T07:34:50.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.778+0000 7f1c4b400640 1 -- 172.21.15.55:0/1545272541 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c4c0b2f10 con 0x7f1c4c071090 2024-04-02T07:34:50.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.778+0000 7f1c4be00640 1 -- 172.21.15.55:0/1545272541 >> v1:172.21.15.106:6789/0 conn(0x7f1c4c071090 legacy=0x7f1c4c15aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.778+0000 7f1c4be00640 1 -- 172.21.15.55:0/1545272541 >> v1:172.21.15.55:6789/0 conn(0x7f1c4c06a170 legacy=0x7f1c4c06a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.780 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.778+0000 7f1c4be00640 1 -- 172.21.15.55:0/1545272541 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c4c06e510 con 0x7f1c4c06dbf0 2024-04-02T07:34:50.782 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.782+0000 7f1c4be00640 1 --2- 172.21.15.55:0/1545272541 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c4c06dbf0 0x7f1c4c06dfd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0097f0 tx=0x7f1c3c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6a7ecda7ac1b355 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.782+0000 7f1c4b400640 1 -- 172.21.15.55:0/1545272541 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c0aa610 con 0x7f1c4c06dbf0 2024-04-02T07:34:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.782+0000 7f1c4b400640 1 -- 172.21.15.55:0/1545272541 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c0a6040 con 0x7f1c4c06dbf0 2024-04-02T07:34:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.782+0000 7f1c4b400640 1 -- 172.21.15.55:0/1545272541 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c0aa990 con 0x7f1c4c06dbf0 2024-04-02T07:34:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.782+0000 7f1c52c00640 1 -- 172.21.15.55:0/1545272541 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c4c06dbf0 msgr2=0x7f1c4c06dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.782+0000 7f1c52c00640 1 --2- 172.21.15.55:0/1545272541 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c4c06dbf0 0x7f1c4c06dfd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0097f0 tx=0x7f1c3c01c4b0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.783 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.782+0000 7f1c52c00640 1 -- 172.21.15.55:0/1545272541 shutdown_connections 2024-04-02T07:34:50.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.782+0000 7f1c52c00640 1 --2- 172.21.15.55:0/1545272541 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c4c06dbf0 0x7f1c4c06dfd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.782+0000 7f1c52c00640 1 -- 172.21.15.55:0/1545272541 >> 172.21.15.55:0/1545272541 conn(0x7f1c4c0cb3d0 msgr2=0x7f1c4c0cb7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:50.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.782+0000 7f1c52c00640 1 -- 172.21.15.55:0/1545272541 shutdown_connections 2024-04-02T07:34:50.784 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.782+0000 7f1c52c00640 1 -- 172.21.15.55:0/1545272541 wait complete. 2024-04-02T07:34:50.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c52c00640 1 Processor -- start 2024-04-02T07:34:50.785 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c52c00640 1 -- start start 2024-04-02T07:34:50.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c52c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c4c06a170 0x7f1c4c146190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c52c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c4c06dbf0 0x7f1c4c157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c52c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c4c071090 0x7f1c4c1581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c52c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c0aef60 con 0x7f1c4c06a170 2024-04-02T07:34:50.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c52c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c1518e0 con 0x7f1c4c071090 2024-04-02T07:34:50.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c52c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4c14a8a0 con 0x7f1c4c06dbf0 2024-04-02T07:34:50.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c4be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c4c06a170 0x7f1c4c146190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c4be00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c4c06a170 0x7f1c4c146190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46548/0 (socket says 172.21.15.55:46548) 2024-04-02T07:34:50.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c4be00640 1 -- 172.21.15.55:0/1428913013 learned_addr learned my addr 172.21.15.55:0/1428913013 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:50.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c50c00640 1 --2- 172.21.15.55:0/1428913013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c4c071090 0x7f1c4c1581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c43e00640 1 --2- 172.21.15.55:0/1428913013 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c4c06dbf0 0x7f1c4c157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c4be00640 1 -- 172.21.15.55:0/1428913013 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c4c06dbf0 msgr2=0x7f1c4c157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c4be00640 1 --2- 172.21.15.55:0/1428913013 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c4c06dbf0 0x7f1c4c157c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c4be00640 1 -- 172.21.15.55:0/1428913013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c4c071090 msgr2=0x7f1c4c1581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c4be00640 1 --2- 172.21.15.55:0/1428913013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c4c071090 0x7f1c4c1581d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c4be00640 1 -- 172.21.15.55:0/1428913013 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3c009420 con 0x7f1c4c06a170 2024-04-02T07:34:50.788 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c4be00640 1 --2- 172.21.15.55:0/1428913013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c4c06a170 0x7f1c4c146190 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0ac040 tx=0x7f1c3c01acf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:50.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c48c00640 1 -- 172.21.15.55:0/1428913013 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c0be410 con 0x7f1c4c06a170 2024-04-02T07:34:50.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c48c00640 1 -- 172.21.15.55:0/1428913013 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c3c0be5b0 con 0x7f1c4c06a170 2024-04-02T07:34:50.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c52c00640 1 -- 172.21.15.55:0/1428913013 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c4c14ab80 con 0x7f1c4c06a170 2024-04-02T07:34:50.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c48c00640 1 -- 172.21.15.55:0/1428913013 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c0be960 con 0x7f1c4c06a170 2024-04-02T07:34:50.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.786+0000 7f1c52c00640 1 -- 172.21.15.55:0/1428913013 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c4c14b140 con 0x7f1c4c06a170 2024-04-02T07:34:50.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.790+0000 7f1c52c00640 1 -- 172.21.15.55:0/1428913013 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c4c066c90 con 0x7f1c4c06a170 2024-04-02T07:34:50.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.790+0000 7f1c48c00640 1 -- 172.21.15.55:0/1428913013 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f1c3c0b4400 con 0x7f1c4c06a170 2024-04-02T07:34:50.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.790+0000 7f1c48c00640 1 --2- 172.21.15.55:0/1428913013 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1c28066690 0x7f1c28068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:50.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.790+0000 7f1c48c00640 1 -- 172.21.15.55:0/1428913013 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f1c3c11e570 con 0x7f1c4c06a170 2024-04-02T07:34:50.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.790+0000 7f1c43e00640 1 --2- 172.21.15.55:0/1428913013 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1c28066690 0x7f1c28068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:50.791 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.790+0000 7f1c43e00640 1 --2- 172.21.15.55:0/1428913013 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1c28066690 0x7f1c28068b50 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c0af3e0 tx=0x7f1c34009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:50.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.794+0000 7f1c48c00640 1 -- 172.21.15.55:0/1428913013 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f1c3c0ebc60 con 0x7f1c4c06a170 2024-04-02T07:34:50.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.958+0000 7f1c52c00640 1 -- 172.21.15.55:0/1428913013 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c4c06ad10 con 0x7f1c28066690 2024-04-02T07:34:50.958 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.958+0000 7f1c48c00640 1 -- 172.21.15.55:0/1428913013 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1c34001440 con 0x7f1c28066690 2024-04-02T07:34:50.958 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 1 to deep-scrub 2024-04-02T07:34:50.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.962+0000 7f1c52c00640 1 -- 172.21.15.55:0/1428913013 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1c28066690 msgr2=0x7f1c28068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.960 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.962+0000 7f1c52c00640 1 --2- 172.21.15.55:0/1428913013 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1c28066690 0x7f1c28068b50 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1c4c0af3e0 tx=0x7f1c34009040 comp rx=0 tx=0).stop 2024-04-02T07:34:50.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.962+0000 7f1c52c00640 1 -- 172.21.15.55:0/1428913013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c4c06a170 msgr2=0x7f1c4c146190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:50.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.962+0000 7f1c52c00640 1 --2- 172.21.15.55:0/1428913013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c4c06a170 0x7f1c4c146190 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c0ac040 tx=0x7f1c3c01acf0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.962+0000 7f1c52c00640 1 -- 172.21.15.55:0/1428913013 shutdown_connections 2024-04-02T07:34:50.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.962+0000 7f1c52c00640 1 --2- 172.21.15.55:0/1428913013 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f1c28066690 0x7f1c28068b50 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.962+0000 7f1c52c00640 1 --2- 172.21.15.55:0/1428913013 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f1c4c071090 0x7f1c4c1581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.962+0000 7f1c52c00640 1 --2- 172.21.15.55:0/1428913013 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f1c4c06dbf0 0x7f1c4c157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.962+0000 7f1c52c00640 1 --2- 172.21.15.55:0/1428913013 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c4c06a170 0x7f1c4c146190 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:50.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.962+0000 7f1c52c00640 1 -- 172.21.15.55:0/1428913013 >> 172.21.15.55:0/1428913013 conn(0x7f1c4c0cb3d0 msgr2=0x7f1c4c0b1690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:50.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.962+0000 7f1c52c00640 1 -- 172.21.15.55:0/1428913013 shutdown_connections 2024-04-02T07:34:50.961 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:50.962+0000 7f1c52c00640 1 -- 172.21.15.55:0/1428913013 wait complete. 2024-04-02T07:34:50.980 INFO:tasks.ceph:Scrubbing osd.2 2024-04-02T07:34:50.981 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-02T07:34:51.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.126+0000 7f2959000640 1 Processor -- start 2024-04-02T07:34:51.124 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.126+0000 7f2959000640 1 -- start start 2024-04-02T07:34:51.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.126+0000 7f2959000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f2954143370 0x7f2954070150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.126+0000 7f2959000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2954070690 0x7f29540cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.126+0000 7f2959000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2954143750 con 0x7f29540cc890 2024-04-02T07:34:51.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.126+0000 7f2959000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f295415f1e0 con 0x7f2954143370 2024-04-02T07:34:51.126 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.126+0000 7f2959000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29540cae90 con 0x7f2954070690 2024-04-02T07:34:51.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.126+0000 7f2953e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f29540cc890 0x7f295406c1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41236/0 (socket says 172.21.15.55:41236) 2024-04-02T07:34:51.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.126+0000 7f2953e00640 1 -- 172.21.15.55:0/804014202 learned_addr learned my addr 172.21.15.55:0/804014202 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:51.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.126+0000 7f2953400640 1 --2- 172.21.15.55:0/804014202 >> v2:172.21.15.106:3300/0 conn(0x7f2954143370 0x7f2954070150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.126+0000 7f294aa00640 1 --2- 172.21.15.55:0/804014202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2954070690 0x7f29540cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.126+0000 7f2952a00640 1 -- 172.21.15.55:0/804014202 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3175213649 0 0) 0x7f2954143750 con 0x7f29540cc890 2024-04-02T07:34:51.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.126+0000 7f2952a00640 1 -- 172.21.15.55:0/804014202 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2938003530 con 0x7f29540cc890 2024-04-02T07:34:51.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.126+0000 7f2953400640 1 -- 172.21.15.55:0/804014202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2954070690 msgr2=0x7f29540cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:51.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.126+0000 7f2953400640 1 --2- 172.21.15.55:0/804014202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2954070690 0x7f29540cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.126+0000 7f2953400640 1 -- 172.21.15.55:0/804014202 >> v1:172.21.15.55:6789/0 conn(0x7f29540cc890 legacy=0x7f295406c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.126+0000 7f2953400640 1 -- 172.21.15.55:0/804014202 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29540cba10 con 0x7f2954143370 2024-04-02T07:34:51.127 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.126+0000 7f294aa00640 1 --2- 172.21.15.55:0/804014202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2954070690 0x7f29540cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-02T07:34:51.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.130+0000 7f2953400640 1 --2- 172.21.15.55:0/804014202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2954143370 0x7f2954070150 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2944009d90 tx=0x7f294401f150 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a14bddef728226b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:51.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.130+0000 7f2952a00640 1 -- 172.21.15.55:0/804014202 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29440af600 con 0x7f2954143370 2024-04-02T07:34:51.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.130+0000 7f2952a00640 1 -- 172.21.15.55:0/804014202 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29440ab050 con 0x7f2954143370 2024-04-02T07:34:51.129 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.130+0000 7f2952a00640 1 -- 172.21.15.55:0/804014202 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29440af980 con 0x7f2954143370 2024-04-02T07:34:51.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.130+0000 7f2959000640 1 -- 172.21.15.55:0/804014202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2954143370 msgr2=0x7f2954070150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.130+0000 7f2959000640 1 --2- 172.21.15.55:0/804014202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2954143370 0x7f2954070150 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f2944009d90 tx=0x7f294401f150 comp rx=0 tx=0).stop 2024-04-02T07:34:51.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.130+0000 7f2959000640 1 -- 172.21.15.55:0/804014202 shutdown_connections 2024-04-02T07:34:51.130 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.130+0000 7f2959000640 1 --2- 172.21.15.55:0/804014202 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f2954070690 0x7f29540cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.130+0000 7f2959000640 1 --2- 172.21.15.55:0/804014202 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2954143370 0x7f2954070150 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.130+0000 7f2959000640 1 -- 172.21.15.55:0/804014202 >> 172.21.15.55:0/804014202 conn(0x7f2954069d90 msgr2=0x7f295406a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:51.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.130+0000 7f2959000640 1 -- 172.21.15.55:0/804014202 shutdown_connections 2024-04-02T07:34:51.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.130+0000 7f2959000640 1 -- 172.21.15.55:0/804014202 wait complete. 2024-04-02T07:34:51.131 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.130+0000 7f2959000640 1 Processor -- start 2024-04-02T07:34:51.132 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f2959000640 1 -- start start 2024-04-02T07:34:51.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f2959000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2954070690 0x7f2954158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f2959000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29540cc890 0x7f29541595e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f2959000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2954143370 0x7f2954159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f2959000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2954136170 con 0x7f2954143370 2024-04-02T07:34:51.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f2959000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f295415a160 con 0x7f2954070690 2024-04-02T07:34:51.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f2959000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f295413c070 con 0x7f29540cc890 2024-04-02T07:34:51.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f2953e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2954143370 0x7f2954159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.134 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f2953e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2954143370 0x7f2954159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46550/0 (socket says 172.21.15.55:46550) 2024-04-02T07:34:51.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f2953e00640 1 -- 172.21.15.55:0/802226708 learned_addr learned my addr 172.21.15.55:0/802226708 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:51.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f2953400640 1 --2- 172.21.15.55:0/802226708 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2954070690 0x7f2954158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f294aa00640 1 --2- 172.21.15.55:0/802226708 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29540cc890 0x7f29541595e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f2953e00640 1 -- 172.21.15.55:0/802226708 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29540cc890 msgr2=0x7f29541595e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f2953e00640 1 --2- 172.21.15.55:0/802226708 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f29540cc890 0x7f29541595e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f2953e00640 1 -- 172.21.15.55:0/802226708 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2954070690 msgr2=0x7f2954158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f2953e00640 1 --2- 172.21.15.55:0/802226708 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f2954070690 0x7f2954158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f2953e00640 1 -- 172.21.15.55:0/802226708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f293c009420 con 0x7f2954143370 2024-04-02T07:34:51.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f2953e00640 1 --2- 172.21.15.55:0/802226708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2954143370 0x7f2954159b20 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f294c00c450 tx=0x7f294c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:51.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f294be00640 1 -- 172.21.15.55:0/802226708 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c005cf0 con 0x7f2954143370 2024-04-02T07:34:51.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f294be00640 1 -- 172.21.15.55:0/802226708 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f294c005e50 con 0x7f2954143370 2024-04-02T07:34:51.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f294be00640 1 -- 172.21.15.55:0/802226708 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f294c0072b0 con 0x7f2954143370 2024-04-02T07:34:51.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f2959000640 1 -- 172.21.15.55:0/802226708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2944009a70 con 0x7f2954143370 2024-04-02T07:34:51.135 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f2959000640 1 -- 172.21.15.55:0/802226708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295413c630 con 0x7f2954143370 2024-04-02T07:34:51.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.134+0000 7f2959000640 1 -- 172.21.15.55:0/802226708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f29540cb3c0 con 0x7f2954143370 2024-04-02T07:34:51.136 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.138+0000 7f294be00640 1 -- 172.21.15.55:0/802226708 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f294c007410 con 0x7f2954143370 2024-04-02T07:34:51.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.138+0000 7f294be00640 1 --2- 172.21.15.55:0/802226708 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2930066690 0x7f2930068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.138+0000 7f294be00640 1 -- 172.21.15.55:0/802226708 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f294c083120 con 0x7f2954143370 2024-04-02T07:34:51.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.138+0000 7f294be00640 1 --2- 172.21.15.55:0/802226708 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x7f293006c630 0x7f293006ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.138+0000 7f294be00640 1 -- 172.21.15.55:0/802226708 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f293006f100 con 0x7f293006c630 2024-04-02T07:34:51.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.138+0000 7f294be00640 1 -- 172.21.15.55:0/802226708 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=123) v2 ==== 24+0+0 (secure 0 0 0) 0x7f294c085700 con 0x7f2954143370 2024-04-02T07:34:51.137 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.138+0000 7f2953400640 1 --2- 172.21.15.55:0/802226708 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2930066690 0x7f2930068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.138+0000 7f294aa00640 1 --2- 172.21.15.55:0/802226708 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x7f293006c630 0x7f293006ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.138+0000 7f294aa00640 1 --2- 172.21.15.55:0/802226708 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x7f293006c630 0x7f293006ea50 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:51.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.138+0000 7f2953400640 1 --2- 172.21.15.55:0/802226708 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2930066690 0x7f2930068b50 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f29440b1000 tx=0x7f29440aa000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:51.138 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.138+0000 7f294be00640 1 -- 172.21.15.55:0/802226708 <== osd.2 v2:172.21.15.55:6808/27394 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f293006f100 con 0x7f293006c630 2024-04-02T07:34:51.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.150+0000 7f2959000640 1 -- 172.21.15.55:0/802226708 --> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f295413c1e0 con 0x7f293006c630 2024-04-02T07:34:51.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.150+0000 7f294be00640 1 -- 172.21.15.55:0/802226708 <== osd.2 v2:172.21.15.55:6808/27394 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f295413c1e0 con 0x7f293006c630 2024-04-02T07:34:51.151 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:34:51.152 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-02T07:34:51.152 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:34:51.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.150+0000 7f2959000640 1 -- 172.21.15.55:0/802226708 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x7f293006c630 msgr2=0x7f293006ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.150+0000 7f2959000640 1 --2- 172.21.15.55:0/802226708 >> [v2:172.21.15.55:6808/27394,v1:172.21.15.55:6810/27394] conn(0x7f293006c630 0x7f293006ea50 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.154+0000 7f2959000640 1 -- 172.21.15.55:0/802226708 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2930066690 msgr2=0x7f2930068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.154+0000 7f2959000640 1 --2- 172.21.15.55:0/802226708 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f2930066690 0x7f2930068b50 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f29440b1000 tx=0x7f29440aa000 comp rx=0 tx=0).stop 2024-04-02T07:34:51.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.154+0000 7f2959000640 1 -- 172.21.15.55:0/802226708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2954143370 msgr2=0x7f2954159b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.154+0000 7f2959000640 1 --2- 172.21.15.55:0/802226708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2954143370 0x7f2954159b20 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f294c00c450 tx=0x7f294c00c910 comp rx=0 tx=0).stop 2024-04-02T07:34:51.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.154+0000 7f2953e00640 1 -- 172.21.15.55:0/802226708 reap_dead start 2024-04-02T07:34:51.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.154+0000 7f2959000640 1 -- 172.21.15.55:0/802226708 shutdown_connections 2024-04-02T07:34:51.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.154+0000 7f2959000640 1 -- 172.21.15.55:0/802226708 >> 172.21.15.55:0/802226708 conn(0x7f2954069d90 msgr2=0x7f295413ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:51.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.154+0000 7f2959000640 1 -- 172.21.15.55:0/802226708 shutdown_connections 2024-04-02T07:34:51.153 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.154+0000 7f2959000640 1 -- 172.21.15.55:0/802226708 wait complete. 2024-04-02T07:34:51.170 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-02T07:34:51.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.310+0000 7fa340200640 1 Processor -- start 2024-04-02T07:34:51.312 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.314+0000 7fa340200640 1 -- start start 2024-04-02T07:34:51.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.314+0000 7fa340200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa3381599c0 0x7fa3380b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.314+0000 7fa340200640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fa33806d1c0 0x7fa3380b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.314+0000 7fa340200640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3380b1d60 con 0x7fa3380afe70 2024-04-02T07:34:51.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.314+0000 7fa340200640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa33806cda0 con 0x7fa3381599c0 2024-04-02T07:34:51.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.314+0000 7fa340200640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa33806c400 con 0x7fa33806d1c0 2024-04-02T07:34:51.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.314+0000 7fa33d800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa3381599c0 0x7fa3380b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.314+0000 7fa33d800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa3381599c0 0x7fa3380b1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46552/0 (socket says 172.21.15.55:46552) 2024-04-02T07:34:51.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.314+0000 7fa33d800640 1 -- 172.21.15.55:0/3807729184 learned_addr learned my addr 172.21.15.55:0/3807729184 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:51.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.314+0000 7fa33d800640 1 -- 172.21.15.55:0/3807729184 >> v2:172.21.15.106:3300/0 conn(0x7fa33806d1c0 msgr2=0x7fa3380b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:51.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.314+0000 7fa33d800640 1 --2- 172.21.15.55:0/3807729184 >> v2:172.21.15.106:3300/0 conn(0x7fa33806d1c0 0x7fa3380b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.314+0000 7fa33d800640 1 -- 172.21.15.55:0/3807729184 >> v1:172.21.15.106:6789/0 conn(0x7fa3380afe70 legacy=0x7fa33815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:51.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.314+0000 7fa33d800640 1 -- 172.21.15.55:0/3807729184 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa33806c6e0 con 0x7fa3381599c0 2024-04-02T07:34:51.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.318+0000 7fa33d800640 1 --2- 172.21.15.55:0/3807729184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3381599c0 0x7fa3380b1780 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fa33806aad0 tx=0x7fa32c01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20055d35803ff61c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:51.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.318+0000 7fa337e00640 1 -- 172.21.15.55:0/3807729184 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c0ab5f0 con 0x7fa3381599c0 2024-04-02T07:34:51.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.318+0000 7fa337e00640 1 -- 172.21.15.55:0/3807729184 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c0ab750 con 0x7fa3381599c0 2024-04-02T07:34:51.317 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.318+0000 7fa337e00640 1 -- 172.21.15.55:0/3807729184 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c0abae0 con 0x7fa3381599c0 2024-04-02T07:34:51.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.318+0000 7fa340200640 1 -- 172.21.15.55:0/3807729184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3381599c0 msgr2=0x7fa3380b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.318+0000 7fa340200640 1 --2- 172.21.15.55:0/3807729184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3381599c0 0x7fa3380b1780 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7fa33806aad0 tx=0x7fa32c01c4e0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.318+0000 7fa340200640 1 -- 172.21.15.55:0/3807729184 shutdown_connections 2024-04-02T07:34:51.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.318+0000 7fa340200640 1 --2- 172.21.15.55:0/3807729184 >> v2:172.21.15.106:3300/0 conn(0x7fa33806d1c0 0x7fa3380b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.318+0000 7fa340200640 1 --2- 172.21.15.55:0/3807729184 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3381599c0 0x7fa3380b1780 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.318+0000 7fa340200640 1 -- 172.21.15.55:0/3807729184 >> 172.21.15.55:0/3807729184 conn(0x7fa338069d90 msgr2=0x7fa33806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:51.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.318+0000 7fa340200640 1 -- 172.21.15.55:0/3807729184 shutdown_connections 2024-04-02T07:34:51.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.318+0000 7fa340200640 1 -- 172.21.15.55:0/3807729184 wait complete. 2024-04-02T07:34:51.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.318+0000 7fa340200640 1 Processor -- start 2024-04-02T07:34:51.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.318+0000 7fa340200640 1 -- start start 2024-04-02T07:34:51.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa340200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa33806d1c0 0x7fa338151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa340200640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3380afe70 0x7fa338151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa340200640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3381599c0 0x7fa338140b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa340200640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa338157450 con 0x7fa33806d1c0 2024-04-02T07:34:51.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa340200640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa338152510 con 0x7fa3381599c0 2024-04-02T07:34:51.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa340200640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3381527b0 con 0x7fa3380afe70 2024-04-02T07:34:51.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa33d800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa33806d1c0 0x7fa338151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa33d800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa33806d1c0 0x7fa338151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46556/0 (socket says 172.21.15.55:46556) 2024-04-02T07:34:51.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa33d800640 1 -- 172.21.15.55:0/1853081641 learned_addr learned my addr 172.21.15.55:0/1853081641 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:51.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa33ce00640 1 --2- 172.21.15.55:0/1853081641 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3380afe70 0x7fa338151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa33e200640 1 --2- 172.21.15.55:0/1853081641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3381599c0 0x7fa338140b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa33d800640 1 -- 172.21.15.55:0/1853081641 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3380afe70 msgr2=0x7fa338151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa33d800640 1 --2- 172.21.15.55:0/1853081641 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3380afe70 0x7fa338151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.322 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa33d800640 1 -- 172.21.15.55:0/1853081641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3381599c0 msgr2=0x7fa338140b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa33d800640 1 --2- 172.21.15.55:0/1853081641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3381599c0 0x7fa338140b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa33d800640 1 -- 172.21.15.55:0/1853081641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa32c0094d0 con 0x7fa33806d1c0 2024-04-02T07:34:51.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa33ce00640 1 --2- 172.21.15.55:0/1853081641 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3380afe70 0x7fa338151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:51.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa33e200640 1 --2- 172.21.15.55:0/1853081641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3381599c0 0x7fa338140b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:51.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa33d800640 1 --2- 172.21.15.55:0/1853081641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa33806d1c0 0x7fa338151fd0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7fa32c01a110 tx=0x7fa32c01ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:51.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa335600640 1 -- 172.21.15.55:0/1853081641 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c0b4800 con 0x7fa33806d1c0 2024-04-02T07:34:51.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa335600640 1 -- 172.21.15.55:0/1853081641 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c0b4960 con 0x7fa33806d1c0 2024-04-02T07:34:51.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa340200640 1 -- 172.21.15.55:0/1853081641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3381576c0 con 0x7fa33806d1c0 2024-04-02T07:34:51.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa335600640 1 -- 172.21.15.55:0/1853081641 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c0b4d10 con 0x7fa33806d1c0 2024-04-02T07:34:51.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa340200640 1 -- 172.21.15.55:0/1853081641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa338152a90 con 0x7fa33806d1c0 2024-04-02T07:34:51.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa340200640 1 -- 172.21.15.55:0/1853081641 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa33806e270 con 0x7fa33806d1c0 2024-04-02T07:34:51.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.322+0000 7fa335600640 1 -- 172.21.15.55:0/1853081641 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa32c0c7390 con 0x7fa33806d1c0 2024-04-02T07:34:51.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.326+0000 7fa335600640 1 --2- 172.21.15.55:0/1853081641 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa3180666c0 0x7fa318068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.326+0000 7fa335600640 1 -- 172.21.15.55:0/1853081641 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fa32c0a8050 con 0x7fa33806d1c0 2024-04-02T07:34:51.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.326+0000 7fa33ce00640 1 --2- 172.21.15.55:0/1853081641 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa3180666c0 0x7fa318068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.326+0000 7fa33ce00640 1 --2- 172.21.15.55:0/1853081641 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa3180666c0 0x7fa318068b80 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fa32400a8b0 tx=0x7fa324008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:51.328 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.330+0000 7fa335600640 1 -- 172.21.15.55:0/1853081641 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa32c0ebe10 con 0x7fa33806d1c0 2024-04-02T07:34:51.489 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.490+0000 7fa340200640 1 -- 172.21.15.55:0/1853081641 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7fa338166740 con 0x7fa3180666c0 2024-04-02T07:34:51.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.490+0000 7fa335600640 1 -- 172.21.15.55:0/1853081641 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa32400c7d0 con 0x7fa3180666c0 2024-04-02T07:34:51.490 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 2 to deep-scrub 2024-04-02T07:34:51.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.494+0000 7fa340200640 1 -- 172.21.15.55:0/1853081641 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa3180666c0 msgr2=0x7fa318068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.494+0000 7fa340200640 1 --2- 172.21.15.55:0/1853081641 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa3180666c0 0x7fa318068b80 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fa32400a8b0 tx=0x7fa324008040 comp rx=0 tx=0).stop 2024-04-02T07:34:51.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.494+0000 7fa340200640 1 -- 172.21.15.55:0/1853081641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa33806d1c0 msgr2=0x7fa338151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.492 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.494+0000 7fa340200640 1 --2- 172.21.15.55:0/1853081641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa33806d1c0 0x7fa338151fd0 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7fa32c01a110 tx=0x7fa32c01ad20 comp rx=0 tx=0).stop 2024-04-02T07:34:51.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.494+0000 7fa340200640 1 -- 172.21.15.55:0/1853081641 shutdown_connections 2024-04-02T07:34:51.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.494+0000 7fa340200640 1 --2- 172.21.15.55:0/1853081641 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa3180666c0 0x7fa318068b80 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.494+0000 7fa340200640 1 --2- 172.21.15.55:0/1853081641 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa3381599c0 0x7fa338140b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.494+0000 7fa340200640 1 --2- 172.21.15.55:0/1853081641 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa3380afe70 0x7fa338151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.494+0000 7fa340200640 1 --2- 172.21.15.55:0/1853081641 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa33806d1c0 0x7fa338151fd0 unknown :-1 s=CLOSED pgs=1960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.494+0000 7fa340200640 1 -- 172.21.15.55:0/1853081641 >> 172.21.15.55:0/1853081641 conn(0x7fa338069d90 msgr2=0x7fa33815c340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:51.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.494+0000 7fa340200640 1 -- 172.21.15.55:0/1853081641 shutdown_connections 2024-04-02T07:34:51.493 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.494+0000 7fa340200640 1 -- 172.21.15.55:0/1853081641 wait complete. 2024-04-02T07:34:51.511 INFO:tasks.ceph:Scrubbing osd.3 2024-04-02T07:34:51.511 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-02T07:34:51.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.654+0000 7f588e600640 1 Processor -- start 2024-04-02T07:34:51.655 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.654+0000 7f588e600640 1 -- start start 2024-04-02T07:34:51.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.658+0000 7f588e600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5888160070 0x7f588806f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.658+0000 7f588e600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f588806eb70 0x7f58880cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.658+0000 7f588e600640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f5888069d90 0x7f588806a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.657 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.658+0000 7f588e600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588806a760 con 0x7f5888160070 2024-04-02T07:34:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.658+0000 7f588e600640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f588806fac0 con 0x7f5888069d90 2024-04-02T07:34:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.658+0000 7f588e600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58880cc070 con 0x7f588806eb70 2024-04-02T07:34:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.658+0000 7f5887400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5888160070 0x7f588806f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.658+0000 7f5887400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5888160070 0x7f588806f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46560/0 (socket says 172.21.15.55:46560) 2024-04-02T07:34:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.658+0000 7f5887400640 1 -- 172.21.15.55:0/2208767857 learned_addr learned my addr 172.21.15.55:0/2208767857 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.658+0000 7f5887e00640 1 --2- 172.21.15.55:0/2208767857 >> v2:172.21.15.106:3300/0 conn(0x7f5888069d90 0x7f588806a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.658+0000 7f5886a00640 1 --2- 172.21.15.55:0/2208767857 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f588806eb70 0x7f58880cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.658+0000 7f5887400640 1 -- 172.21.15.55:0/2208767857 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f588806eb70 msgr2=0x7f58880cbb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.658+0000 7f5887400640 1 --2- 172.21.15.55:0/2208767857 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f588806eb70 0x7f58880cbb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.658+0000 7f5887400640 1 -- 172.21.15.55:0/2208767857 >> v2:172.21.15.106:3300/0 conn(0x7f5888069d90 msgr2=0x7f588806a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.658+0000 7f5887400640 1 --2- 172.21.15.55:0/2208767857 >> v2:172.21.15.106:3300/0 conn(0x7f5888069d90 0x7f588806a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.658 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.658+0000 7f5887400640 1 -- 172.21.15.55:0/2208767857 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588806fcf0 con 0x7f5888160070 2024-04-02T07:34:51.659 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.658+0000 7f5887e00640 1 --2- 172.21.15.55:0/2208767857 >> v2:172.21.15.106:3300/0 conn(0x7f5888069d90 0x7f588806a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:51.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f5887400640 1 --2- 172.21.15.55:0/2208767857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5888160070 0x7f588806f580 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f588806e7f0 tx=0x7f587801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=541d2123b8625d49 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:51.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f5886000640 1 -- 172.21.15.55:0/2208767857 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58780aa640 con 0x7f5888160070 2024-04-02T07:34:51.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f5886000640 1 -- 172.21.15.55:0/2208767857 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58780aa7a0 con 0x7f5888160070 2024-04-02T07:34:51.660 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f5886000640 1 -- 172.21.15.55:0/2208767857 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58780aab30 con 0x7f5888160070 2024-04-02T07:34:51.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f588e600640 1 -- 172.21.15.55:0/2208767857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5888160070 msgr2=0x7f588806f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f588e600640 1 --2- 172.21.15.55:0/2208767857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5888160070 0x7f588806f580 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7f588806e7f0 tx=0x7f587801c520 comp rx=0 tx=0).stop 2024-04-02T07:34:51.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f588e600640 1 -- 172.21.15.55:0/2208767857 shutdown_connections 2024-04-02T07:34:51.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f588e600640 1 --2- 172.21.15.55:0/2208767857 >> v2:172.21.15.106:3300/0 conn(0x7f5888069d90 0x7f588806a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f588e600640 1 --2- 172.21.15.55:0/2208767857 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f588806eb70 0x7f58880cbb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.661 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f588e600640 1 --2- 172.21.15.55:0/2208767857 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5888160070 0x7f588806f580 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f588e600640 1 -- 172.21.15.55:0/2208767857 >> 172.21.15.55:0/2208767857 conn(0x7f58880b12d0 msgr2=0x7f58880b16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:51.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f588e600640 1 -- 172.21.15.55:0/2208767857 shutdown_connections 2024-04-02T07:34:51.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f588e600640 1 -- 172.21.15.55:0/2208767857 wait complete. 2024-04-02T07:34:51.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f588e600640 1 Processor -- start 2024-04-02T07:34:51.662 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f588e600640 1 -- start start 2024-04-02T07:34:51.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f588e600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5888069d90 0x7f5888153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f588e600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f588806eb70 0x7f5888152400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f588e600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5888160070 0x7f58880b23c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f588e600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5888152b00 con 0x7f5888160070 2024-04-02T07:34:51.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f588e600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5888152de0 con 0x7f588806eb70 2024-04-02T07:34:51.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.662+0000 7f588e600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58881530c0 con 0x7f5888069d90 2024-04-02T07:34:51.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.666+0000 7f5887e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5888160070 0x7f58880b23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.665 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.666+0000 7f5887e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5888160070 0x7f58880b23c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46570/0 (socket says 172.21.15.55:46570) 2024-04-02T07:34:51.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.666+0000 7f5887e00640 1 -- 172.21.15.55:0/1522321407 learned_addr learned my addr 172.21.15.55:0/1522321407 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:51.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.666+0000 7f5886a00640 1 --2- 172.21.15.55:0/1522321407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f588806eb70 0x7f5888152400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.666+0000 7f5887400640 1 --2- 172.21.15.55:0/1522321407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5888069d90 0x7f5888153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.666+0000 7f5887e00640 1 -- 172.21.15.55:0/1522321407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5888069d90 msgr2=0x7f5888153ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.666+0000 7f5887e00640 1 --2- 172.21.15.55:0/1522321407 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5888069d90 0x7f5888153ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.666+0000 7f5887e00640 1 -- 172.21.15.55:0/1522321407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f588806eb70 msgr2=0x7f5888152400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.666+0000 7f5887e00640 1 --2- 172.21.15.55:0/1522321407 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f588806eb70 0x7f5888152400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.666+0000 7f5887e00640 1 -- 172.21.15.55:0/1522321407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58780094d0 con 0x7f5888160070 2024-04-02T07:34:51.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.666+0000 7f5887e00640 1 --2- 172.21.15.55:0/1522321407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5888160070 0x7f58880b23c0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f5880007e70 tx=0x7f588000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:51.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.666+0000 7f587f400640 1 -- 172.21.15.55:0/1522321407 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5880003ba0 con 0x7f5888160070 2024-04-02T07:34:51.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.666+0000 7f587f400640 1 -- 172.21.15.55:0/1522321407 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f588000f040 con 0x7f5888160070 2024-04-02T07:34:51.666 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.666+0000 7f587f400640 1 -- 172.21.15.55:0/1522321407 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f588000de80 con 0x7f5888160070 2024-04-02T07:34:51.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.666+0000 7f588e600640 1 -- 172.21.15.55:0/1522321407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58881533a0 con 0x7f5888160070 2024-04-02T07:34:51.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.666+0000 7f588e600640 1 -- 172.21.15.55:0/1522321407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58880b2900 con 0x7f5888160070 2024-04-02T07:34:51.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.666+0000 7f588e600640 1 -- 172.21.15.55:0/1522321407 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5888152f50 con 0x7f5888160070 2024-04-02T07:34:51.667 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.666+0000 7f587f400640 1 -- 172.21.15.55:0/1522321407 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5880004030 con 0x7f5888160070 2024-04-02T07:34:51.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.666+0000 7f587f400640 1 --2- 172.21.15.55:0/1522321407 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5868066690 0x7f5868068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.670+0000 7f587f400640 1 -- 172.21.15.55:0/1522321407 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f5880084160 con 0x7f5888160070 2024-04-02T07:34:51.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.670+0000 7f587f400640 1 --2- 172.21.15.55:0/1522321407 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x7f586806c630 0x7f586806ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.670+0000 7f587f400640 1 -- 172.21.15.55:0/1522321407 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f586806f100 con 0x7f586806c630 2024-04-02T07:34:51.668 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.670+0000 7f587f400640 1 -- 172.21.15.55:0/1522321407 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=123) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5880086740 con 0x7f5888160070 2024-04-02T07:34:51.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.670+0000 7f5887400640 1 --2- 172.21.15.55:0/1522321407 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5868066690 0x7f5868068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.670+0000 7f5886a00640 1 --2- 172.21.15.55:0/1522321407 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x7f586806c630 0x7f586806ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.670+0000 7f5886a00640 1 --2- 172.21.15.55:0/1522321407 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x7f586806c630 0x7f586806ea50 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:51.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.670+0000 7f5887400640 1 --2- 172.21.15.55:0/1522321407 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5868066690 0x7f5868068b50 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f58780ae000 tx=0x7f58780b5040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:51.669 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.670+0000 7f587f400640 1 -- 172.21.15.55:0/1522321407 <== osd.3 v2:172.21.15.55:6824/27393 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f586806f100 con 0x7f586806c630 2024-04-02T07:34:51.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.682+0000 7f588e600640 1 -- 172.21.15.55:0/1522321407 --> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f58880cf0b0 con 0x7f586806c630 2024-04-02T07:34:51.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.682+0000 7f587f400640 1 -- 172.21.15.55:0/1522321407 <== osd.3 v2:172.21.15.55:6824/27393 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f5874007590 con 0x7f586806c630 2024-04-02T07:34:51.682 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:34:51.683 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-02T07:34:51.683 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:34:51.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.682+0000 7f588e600640 1 -- 172.21.15.55:0/1522321407 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x7f586806c630 msgr2=0x7f586806ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.682+0000 7f588e600640 1 --2- 172.21.15.55:0/1522321407 >> [v2:172.21.15.55:6824/27393,v1:172.21.15.55:6825/27393] conn(0x7f586806c630 0x7f586806ea50 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.682+0000 7f588e600640 1 -- 172.21.15.55:0/1522321407 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5868066690 msgr2=0x7f5868068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.682+0000 7f588e600640 1 --2- 172.21.15.55:0/1522321407 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5868066690 0x7f5868068b50 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f58780ae000 tx=0x7f58780b5040 comp rx=0 tx=0).stop 2024-04-02T07:34:51.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.682+0000 7f588e600640 1 -- 172.21.15.55:0/1522321407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5888160070 msgr2=0x7f58880b23c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.682+0000 7f588e600640 1 --2- 172.21.15.55:0/1522321407 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5888160070 0x7f58880b23c0 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7f5880007e70 tx=0x7f588000d4a0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.682+0000 7f5887e00640 1 -- 172.21.15.55:0/1522321407 reap_dead start 2024-04-02T07:34:51.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.682+0000 7f588e600640 1 -- 172.21.15.55:0/1522321407 shutdown_connections 2024-04-02T07:34:51.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.682+0000 7f588e600640 1 -- 172.21.15.55:0/1522321407 >> 172.21.15.55:0/1522321407 conn(0x7f58880b12d0 msgr2=0x7f58880af2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:51.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.682+0000 7f588e600640 1 -- 172.21.15.55:0/1522321407 shutdown_connections 2024-04-02T07:34:51.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.682+0000 7f588e600640 1 -- 172.21.15.55:0/1522321407 wait complete. 2024-04-02T07:34:51.700 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-02T07:34:51.841 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.842+0000 7f43efa00640 1 Processor -- start 2024-04-02T07:34:51.842 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.842+0000 7f43efa00640 1 -- start start 2024-04-02T07:34:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.842+0000 7f43efa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f43e80cd800 0x7f43e80ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.842+0000 7f43efa00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e80cb280 con 0x7f43e815a950 2024-04-02T07:34:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.842+0000 7f43efa00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43e80cb7e0 con 0x7f43e80ce8f0 2024-04-02T07:34:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.842+0000 7f43efa00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43e80c4250 con 0x7f43e80cd800 2024-04-02T07:34:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.842+0000 7f43ed000640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f43e815a950 0x7f43e80cd0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41252/0 (socket says 172.21.15.55:41252) 2024-04-02T07:34:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.842+0000 7f43ed000640 1 -- 172.21.15.55:0/1632545389 learned_addr learned my addr 172.21.15.55:0/1632545389 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:51.843 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.842+0000 7f43dfe00640 1 --2- 172.21.15.55:0/1632545389 >> v2:172.21.15.55:3300/0 conn(0x7f43e80cd800 0x7f43e80ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.842+0000 7f43e7e00640 1 -- 172.21.15.55:0/1632545389 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4163305826 0 0) 0x7f43e80cb280 con 0x7f43e815a950 2024-04-02T07:34:51.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.842+0000 7f43e7e00640 1 -- 172.21.15.55:0/1632545389 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f43cc003530 con 0x7f43e815a950 2024-04-02T07:34:51.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.842+0000 7f43dfe00640 1 -- 172.21.15.55:0/1632545389 >> v1:172.21.15.106:6789/0 conn(0x7f43e80ce8f0 legacy=0x7f43e80cbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:51.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.842+0000 7f43dfe00640 1 -- 172.21.15.55:0/1632545389 >> v1:172.21.15.55:6789/0 conn(0x7f43e815a950 legacy=0x7f43e80cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.844 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.842+0000 7f43dfe00640 1 -- 172.21.15.55:0/1632545389 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43e80cb4b0 con 0x7f43e80cd800 2024-04-02T07:34:51.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.846+0000 7f43dfe00640 1 --2- 172.21.15.55:0/1632545389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43e80cd800 0x7f43e80ce3b0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f43d00097c0 tx=0x7f43d001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9abbe1aa5ecbe50c server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:51.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.846+0000 7f43e7e00640 1 -- 172.21.15.55:0/1632545389 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d00a7070 con 0x7f43e80cd800 2024-04-02T07:34:51.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.846+0000 7f43e7e00640 1 -- 172.21.15.55:0/1632545389 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d00ab430 con 0x7f43e80cd800 2024-04-02T07:34:51.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.846+0000 7f43e7e00640 1 -- 172.21.15.55:0/1632545389 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d00ab7c0 con 0x7f43e80cd800 2024-04-02T07:34:51.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.846+0000 7f43efa00640 1 -- 172.21.15.55:0/1632545389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43e80cd800 msgr2=0x7f43e80ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.846+0000 7f43efa00640 1 --2- 172.21.15.55:0/1632545389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43e80cd800 0x7f43e80ce3b0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7f43d00097c0 tx=0x7f43d001c430 comp rx=0 tx=0).stop 2024-04-02T07:34:51.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.846+0000 7f43efa00640 1 -- 172.21.15.55:0/1632545389 shutdown_connections 2024-04-02T07:34:51.847 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.846+0000 7f43efa00640 1 --2- 172.21.15.55:0/1632545389 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43e80cd800 0x7f43e80ce3b0 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.846+0000 7f43efa00640 1 -- 172.21.15.55:0/1632545389 >> 172.21.15.55:0/1632545389 conn(0x7f43e80d0700 msgr2=0x7f43e80d0b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:51.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.846+0000 7f43efa00640 1 -- 172.21.15.55:0/1632545389 shutdown_connections 2024-04-02T07:34:51.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.846+0000 7f43efa00640 1 -- 172.21.15.55:0/1632545389 wait complete. 2024-04-02T07:34:51.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43efa00640 1 Processor -- start 2024-04-02T07:34:51.849 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43efa00640 1 -- start start 2024-04-02T07:34:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43efa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43e80cd800 0x7f43e814ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43efa00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f43e80ce8f0 0x7f43e814e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43efa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43e815a950 0x7f43e806f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43efa00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e814e540 con 0x7f43e80cd800 2024-04-02T07:34:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43efa00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43e81524e0 con 0x7f43e815a950 2024-04-02T07:34:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43efa00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43e81527c0 con 0x7f43e80ce8f0 2024-04-02T07:34:51.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43ed000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43e80cd800 0x7f43e814ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43ed000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43e80cd800 0x7f43e814ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46586/0 (socket says 172.21.15.55:46586) 2024-04-02T07:34:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43ed000640 1 -- 172.21.15.55:0/781949478 learned_addr learned my addr 172.21.15.55:0/781949478 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43dfe00640 1 --2- 172.21.15.55:0/781949478 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f43e80ce8f0 0x7f43e814e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43eda00640 1 --2- 172.21.15.55:0/781949478 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43e815a950 0x7f43e806f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43ed000640 1 -- 172.21.15.55:0/781949478 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f43e80ce8f0 msgr2=0x7f43e814e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43ed000640 1 --2- 172.21.15.55:0/781949478 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f43e80ce8f0 0x7f43e814e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43ed000640 1 -- 172.21.15.55:0/781949478 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43e815a950 msgr2=0x7f43e806f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43ed000640 1 --2- 172.21.15.55:0/781949478 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43e815a950 0x7f43e806f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43ed000640 1 -- 172.21.15.55:0/781949478 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d0009420 con 0x7f43e80cd800 2024-04-02T07:34:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43ed000640 1 --2- 172.21.15.55:0/781949478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43e80cd800 0x7f43e814ebd0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f43d800c420 tx=0x7f43d800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43e5600640 1 -- 172.21.15.55:0/781949478 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d8005cf0 con 0x7f43e80cd800 2024-04-02T07:34:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43e5600640 1 -- 172.21.15.55:0/781949478 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d8005e50 con 0x7f43e80cd800 2024-04-02T07:34:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43e5600640 1 -- 172.21.15.55:0/781949478 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d80072d0 con 0x7f43e80cd800 2024-04-02T07:34:51.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43efa00640 1 -- 172.21.15.55:0/781949478 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43e80b4550 con 0x7f43e80cd800 2024-04-02T07:34:51.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.850+0000 7f43efa00640 1 -- 172.21.15.55:0/781949478 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43e80cd2a0 con 0x7f43e80cd800 2024-04-02T07:34:51.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.854+0000 7f43efa00640 1 -- 172.21.15.55:0/781949478 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43e8066c90 con 0x7f43e80cd800 2024-04-02T07:34:51.853 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.854+0000 7f43e5600640 1 -- 172.21.15.55:0/781949478 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f43d8007430 con 0x7f43e80cd800 2024-04-02T07:34:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.854+0000 7f43e5600640 1 --2- 172.21.15.55:0/781949478 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f43c40666c0 0x7f43c4068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.854+0000 7f43e5600640 1 -- 172.21.15.55:0/781949478 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f43d80833c0 con 0x7f43e80cd800 2024-04-02T07:34:51.854 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.854+0000 7f43dfe00640 1 --2- 172.21.15.55:0/781949478 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f43c40666c0 0x7f43c4068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:51.855 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.854+0000 7f43dfe00640 1 --2- 172.21.15.55:0/781949478 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f43c40666c0 0x7f43c4068b80 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f43d00af000 tx=0x7f43d00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:51.858 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:51.858+0000 7f43e5600640 1 -- 172.21.15.55:0/781949478 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f43d8050ac0 con 0x7f43e80cd800 2024-04-02T07:34:52.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.018+0000 7f43efa00640 1 -- 172.21.15.55:0/781949478 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f43e8152650 con 0x7f43c40666c0 2024-04-02T07:34:52.020 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.022+0000 7f43e5600640 1 -- 172.21.15.55:0/781949478 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f43e8152650 con 0x7f43c40666c0 2024-04-02T07:34:52.020 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 3 to deep-scrub 2024-04-02T07:34:52.022 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.022+0000 7f43efa00640 1 -- 172.21.15.55:0/781949478 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f43c40666c0 msgr2=0x7f43c4068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.022+0000 7f43efa00640 1 --2- 172.21.15.55:0/781949478 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f43c40666c0 0x7f43c4068b80 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f43d00af000 tx=0x7f43d00a7000 comp rx=0 tx=0).stop 2024-04-02T07:34:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.022+0000 7f43efa00640 1 -- 172.21.15.55:0/781949478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43e80cd800 msgr2=0x7f43e814ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.022+0000 7f43efa00640 1 --2- 172.21.15.55:0/781949478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43e80cd800 0x7f43e814ebd0 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7f43d800c420 tx=0x7f43d800c8e0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.022+0000 7f43efa00640 1 -- 172.21.15.55:0/781949478 shutdown_connections 2024-04-02T07:34:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.022+0000 7f43efa00640 1 --2- 172.21.15.55:0/781949478 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f43c40666c0 0x7f43c4068b80 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.022+0000 7f43efa00640 1 --2- 172.21.15.55:0/781949478 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f43e815a950 0x7f43e806f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.022+0000 7f43efa00640 1 --2- 172.21.15.55:0/781949478 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f43e80ce8f0 0x7f43e814e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.022+0000 7f43efa00640 1 --2- 172.21.15.55:0/781949478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f43e80cd800 0x7f43e814ebd0 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.022+0000 7f43efa00640 1 -- 172.21.15.55:0/781949478 >> 172.21.15.55:0/781949478 conn(0x7f43e80d0700 msgr2=0x7f43e8158010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.022+0000 7f43efa00640 1 -- 172.21.15.55:0/781949478 shutdown_connections 2024-04-02T07:34:52.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.022+0000 7f43efa00640 1 -- 172.21.15.55:0/781949478 wait complete. 2024-04-02T07:34:52.042 INFO:tasks.ceph:Scrubbing osd.4 2024-04-02T07:34:52.042 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-02T07:34:52.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.186+0000 7fcb8fa00640 1 Processor -- start 2024-04-02T07:34:52.186 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.186+0000 7fcb8fa00640 1 -- start start 2024-04-02T07:34:52.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.186+0000 7fcb8fa00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fcb880cb5b0 0x7fcb8806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.186+0000 7fcb8fa00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb880af920 0x7fcb8806cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.188 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.186+0000 7fcb8fa00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb880ca030 con 0x7fcb8815aa40 2024-04-02T07:34:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.186+0000 7fcb8fa00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb880c9420 con 0x7fcb880af920 2024-04-02T07:34:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.186+0000 7fcb8fa00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb880c9700 con 0x7fcb880cb5b0 2024-04-02T07:34:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.190+0000 7fcb8da00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb880af920 0x7fcb8806cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.190+0000 7fcb8da00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcb880af920 0x7fcb8806cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46590/0 (socket says 172.21.15.55:46590) 2024-04-02T07:34:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.190+0000 7fcb8da00640 1 -- 172.21.15.55:0/3236023484 learned_addr learned my addr 172.21.15.55:0/3236023484 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.190+0000 7fcb7fe00640 1 --2- 172.21.15.55:0/3236023484 >> v2:172.21.15.106:3300/0 conn(0x7fcb880cb5b0 0x7fcb8806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.190+0000 7fcb8da00640 1 -- 172.21.15.55:0/3236023484 >> v2:172.21.15.106:3300/0 conn(0x7fcb880cb5b0 msgr2=0x7fcb8806ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.190+0000 7fcb8da00640 1 --2- 172.21.15.55:0/3236023484 >> v2:172.21.15.106:3300/0 conn(0x7fcb880cb5b0 0x7fcb8806ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.190+0000 7fcb8da00640 1 -- 172.21.15.55:0/3236023484 >> v1:172.21.15.106:6789/0 conn(0x7fcb8815aa40 legacy=0x7fcb880caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:52.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.190+0000 7fcb8da00640 1 -- 172.21.15.55:0/3236023484 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb880c99e0 con 0x7fcb880af920 2024-04-02T07:34:52.191 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.190+0000 7fcb8da00640 1 --2- 172.21.15.55:0/3236023484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb880af920 0x7fcb8806cf40 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fcb880b0450 tx=0x7fcb8001c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a66a727a9372ce4 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:52.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.190+0000 7fcb87e00640 1 -- 172.21.15.55:0/3236023484 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb800a5860 con 0x7fcb880af920 2024-04-02T07:34:52.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.190+0000 7fcb87e00640 1 -- 172.21.15.55:0/3236023484 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb800a59c0 con 0x7fcb880af920 2024-04-02T07:34:52.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.190+0000 7fcb87e00640 1 -- 172.21.15.55:0/3236023484 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb800a5d50 con 0x7fcb880af920 2024-04-02T07:34:52.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb8fa00640 1 -- 172.21.15.55:0/3236023484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb880af920 msgr2=0x7fcb8806cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb8fa00640 1 --2- 172.21.15.55:0/3236023484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb880af920 0x7fcb8806cf40 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fcb880b0450 tx=0x7fcb8001c980 comp rx=0 tx=0).stop 2024-04-02T07:34:52.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb8fa00640 1 -- 172.21.15.55:0/3236023484 shutdown_connections 2024-04-02T07:34:52.192 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb8fa00640 1 --2- 172.21.15.55:0/3236023484 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb880af920 0x7fcb8806cf40 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb8fa00640 1 --2- 172.21.15.55:0/3236023484 >> v2:172.21.15.106:3300/0 conn(0x7fcb880cb5b0 0x7fcb8806ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb8fa00640 1 -- 172.21.15.55:0/3236023484 >> 172.21.15.55:0/3236023484 conn(0x7fcb88069d90 msgr2=0x7fcb8806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:52.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb8fa00640 1 -- 172.21.15.55:0/3236023484 shutdown_connections 2024-04-02T07:34:52.194 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb8fa00640 1 -- 172.21.15.55:0/3236023484 wait complete. 2024-04-02T07:34:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb8fa00640 1 Processor -- start 2024-04-02T07:34:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb8fa00640 1 -- start start 2024-04-02T07:34:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb8fa00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb880af920 0x7fcb88150c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb8fa00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb880cb5b0 0x7fcb881439d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb8fa00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcb8815aa40 0x7fcb88132e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb8fa00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8814cce0 con 0x7fcb880cb5b0 2024-04-02T07:34:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb8fa00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb881511e0 con 0x7fcb880af920 2024-04-02T07:34:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb8fa00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8814fc00 con 0x7fcb8815aa40 2024-04-02T07:34:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb7fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb880cb5b0 0x7fcb881439d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb7fe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb880cb5b0 0x7fcb881439d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46602/0 (socket says 172.21.15.55:46602) 2024-04-02T07:34:52.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb7fe00640 1 -- 172.21.15.55:0/362557093 learned_addr learned my addr 172.21.15.55:0/362557093 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb8d000640 1 --2- 172.21.15.55:0/362557093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb880af920 0x7fcb88150c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb8da00640 1 --2- 172.21.15.55:0/362557093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcb8815aa40 0x7fcb88132e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb7fe00640 1 -- 172.21.15.55:0/362557093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcb8815aa40 msgr2=0x7fcb88132e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb7fe00640 1 --2- 172.21.15.55:0/362557093 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fcb8815aa40 0x7fcb88132e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb7fe00640 1 -- 172.21.15.55:0/362557093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb880af920 msgr2=0x7fcb88150c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb7fe00640 1 --2- 172.21.15.55:0/362557093 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fcb880af920 0x7fcb88150c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.194+0000 7fcb7fe00640 1 -- 172.21.15.55:0/362557093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb80009b30 con 0x7fcb880cb5b0 2024-04-02T07:34:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.198+0000 7fcb7fe00640 1 --2- 172.21.15.55:0/362557093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb880cb5b0 0x7fcb881439d0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000d800 tx=0x7fcb7000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.198+0000 7fcb85600640 1 -- 172.21.15.55:0/362557093 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7000b6c0 con 0x7fcb880cb5b0 2024-04-02T07:34:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.198+0000 7fcb85600640 1 -- 172.21.15.55:0/362557093 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7000b820 con 0x7fcb880cb5b0 2024-04-02T07:34:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.198+0000 7fcb85600640 1 -- 172.21.15.55:0/362557093 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7000bb90 con 0x7fcb880cb5b0 2024-04-02T07:34:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.198+0000 7fcb8fa00640 1 -- 172.21.15.55:0/362557093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb88150190 con 0x7fcb880cb5b0 2024-04-02T07:34:52.198 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.198+0000 7fcb8fa00640 1 -- 172.21.15.55:0/362557093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb88150750 con 0x7fcb880cb5b0 2024-04-02T07:34:52.199 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.198+0000 7fcb8fa00640 1 -- 172.21.15.55:0/362557093 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb8806e240 con 0x7fcb880cb5b0 2024-04-02T07:34:52.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.198+0000 7fcb85600640 1 -- 172.21.15.55:0/362557093 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fcb7000bcf0 con 0x7fcb880cb5b0 2024-04-02T07:34:52.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.198+0000 7fcb85600640 1 --2- 172.21.15.55:0/362557093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcb64066690 0x7fcb64068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.198+0000 7fcb85600640 1 -- 172.21.15.55:0/362557093 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fcb70084400 con 0x7fcb880cb5b0 2024-04-02T07:34:52.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.198+0000 7fcb85600640 1 --2- 172.21.15.55:0/362557093 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x7fcb6406c630 0x7fcb6406ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.200 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.198+0000 7fcb85600640 1 -- 172.21.15.55:0/362557093 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb6406f100 con 0x7fcb6406c630 2024-04-02T07:34:52.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.198+0000 7fcb85600640 1 -- 172.21.15.55:0/362557093 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=123) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb700869e0 con 0x7fcb880cb5b0 2024-04-02T07:34:52.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.198+0000 7fcb8d000640 1 --2- 172.21.15.55:0/362557093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcb64066690 0x7fcb64068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.198+0000 7fcb8da00640 1 --2- 172.21.15.55:0/362557093 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x7fcb6406c630 0x7fcb6406ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.202+0000 7fcb8d000640 1 --2- 172.21.15.55:0/362557093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcb64066690 0x7fcb64068b50 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcb78007fd0 tx=0x7fcb78007e40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:52.201 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.202+0000 7fcb8da00640 1 --2- 172.21.15.55:0/362557093 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x7fcb6406c630 0x7fcb6406ea50 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:52.202 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.202+0000 7fcb85600640 1 -- 172.21.15.55:0/362557093 <== osd.4 v2:172.21.15.106:6801/27677 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7fcb6406f100 con 0x7fcb6406c630 2024-04-02T07:34:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.214+0000 7fcb8fa00640 1 -- 172.21.15.55:0/362557093 --> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fcb88066c90 con 0x7fcb6406c630 2024-04-02T07:34:52.214 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.214+0000 7fcb85600640 1 -- 172.21.15.55:0/362557093 <== osd.4 v2:172.21.15.106:6801/27677 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7fcb88066c90 con 0x7fcb6406c630 2024-04-02T07:34:52.215 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:34:52.215 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-02T07:34:52.215 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:34:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.214+0000 7fcb8fa00640 1 -- 172.21.15.55:0/362557093 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x7fcb6406c630 msgr2=0x7fcb6406ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.214+0000 7fcb8fa00640 1 --2- 172.21.15.55:0/362557093 >> [v2:172.21.15.106:6801/27677,v1:172.21.15.106:6803/27677] conn(0x7fcb6406c630 0x7fcb6406ea50 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.214+0000 7fcb8fa00640 1 -- 172.21.15.55:0/362557093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcb64066690 msgr2=0x7fcb64068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.214+0000 7fcb8fa00640 1 --2- 172.21.15.55:0/362557093 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fcb64066690 0x7fcb64068b50 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcb78007fd0 tx=0x7fcb78007e40 comp rx=0 tx=0).stop 2024-04-02T07:34:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.214+0000 7fcb8fa00640 1 -- 172.21.15.55:0/362557093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb880cb5b0 msgr2=0x7fcb881439d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.214+0000 7fcb8fa00640 1 --2- 172.21.15.55:0/362557093 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcb880cb5b0 0x7fcb881439d0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000d800 tx=0x7fcb7000dcc0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.214+0000 7fcb8da00640 1 -- 172.21.15.55:0/362557093 reap_dead start 2024-04-02T07:34:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.214+0000 7fcb8fa00640 1 -- 172.21.15.55:0/362557093 shutdown_connections 2024-04-02T07:34:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.214+0000 7fcb8fa00640 1 -- 172.21.15.55:0/362557093 >> 172.21.15.55:0/362557093 conn(0x7fcb88069d90 msgr2=0x7fcb88151cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:52.216 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.214+0000 7fcb8fa00640 1 -- 172.21.15.55:0/362557093 shutdown_connections 2024-04-02T07:34:52.217 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.214+0000 7fcb8fa00640 1 -- 172.21.15.55:0/362557093 wait complete. 2024-04-02T07:34:52.234 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-02T07:34:52.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.374+0000 7f8ea3800640 1 Processor -- start 2024-04-02T07:34:52.375 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.374+0000 7f8ea3800640 1 -- start start 2024-04-02T07:34:52.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.378+0000 7f8ea3800640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e9c1599c0 0x7f8e9c0b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.378+0000 7f8ea3800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7f8e9c06d1c0 0x7f8e9c0b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.378+0000 7f8ea3800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9c0afe70 0x7f8e9c0b3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.378+0000 7f8ea3800640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e9c06cda0 con 0x7f8e9c1599c0 2024-04-02T07:34:52.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.378+0000 7f8ea3800640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e9c0b3c60 con 0x7f8e9c06d1c0 2024-04-02T07:34:52.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.378+0000 7f8ea3800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0b1d60 con 0x7f8e9c0afe70 2024-04-02T07:34:52.377 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.378+0000 7f8ea0e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e9c1599c0 0x7f8e9c0b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.378+0000 7f8ea0e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f8e9c1599c0 0x7f8e9c0b1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46612/0 (socket says 172.21.15.55:46612) 2024-04-02T07:34:52.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.378+0000 7f8ea0e00640 1 -- 172.21.15.55:0/3654674293 learned_addr learned my addr 172.21.15.55:0/3654674293 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:52.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.378+0000 7f8ea1800640 1 --2- 172.21.15.55:0/3654674293 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9c0afe70 0x7f8e9c0b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.378+0000 7f8ea0e00640 1 -- 172.21.15.55:0/3654674293 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9c0afe70 msgr2=0x7f8e9c0b3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:52.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.378+0000 7f8e9be00640 1 --2- 172.21.15.55:0/3654674293 >> v2:172.21.15.106:3300/0 conn(0x7f8e9c06d1c0 0x7f8e9c0b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.378+0000 7f8ea0e00640 1 --2- 172.21.15.55:0/3654674293 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9c0afe70 0x7f8e9c0b3720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.378+0000 7f8ea0e00640 1 -- 172.21.15.55:0/3654674293 >> v2:172.21.15.106:3300/0 conn(0x7f8e9c06d1c0 msgr2=0x7f8e9c0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:52.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.378+0000 7f8ea0e00640 1 --2- 172.21.15.55:0/3654674293 >> v2:172.21.15.106:3300/0 conn(0x7f8e9c06d1c0 0x7f8e9c0b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.378+0000 7f8ea0e00640 1 -- 172.21.15.55:0/3654674293 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c06c400 con 0x7f8e9c1599c0 2024-04-02T07:34:52.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.378+0000 7f8ea1800640 1 --2- 172.21.15.55:0/3654674293 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9c0afe70 0x7f8e9c0b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:52.378 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.378+0000 7f8e9be00640 1 --2- 172.21.15.55:0/3654674293 >> v2:172.21.15.106:3300/0 conn(0x7f8e9c06d1c0 0x7f8e9c0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:52.380 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.382+0000 7f8ea0e00640 1 --2- 172.21.15.55:0/3654674293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e9c1599c0 0x7f8e9c0b1780 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c06aad0 tx=0x7f8e9001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeeec34c3ef71898 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:52.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.382+0000 7f8e9b400640 1 -- 172.21.15.55:0/3654674293 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e900ab5f0 con 0x7f8e9c1599c0 2024-04-02T07:34:52.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.382+0000 7f8e9b400640 1 -- 172.21.15.55:0/3654674293 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e900ab750 con 0x7f8e9c1599c0 2024-04-02T07:34:52.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.382+0000 7f8e9b400640 1 -- 172.21.15.55:0/3654674293 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e900abae0 con 0x7f8e9c1599c0 2024-04-02T07:34:52.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.382+0000 7f8ea3800640 1 -- 172.21.15.55:0/3654674293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e9c1599c0 msgr2=0x7f8e9c0b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.381 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.382+0000 7f8ea3800640 1 --2- 172.21.15.55:0/3654674293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e9c1599c0 0x7f8e9c0b1780 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c06aad0 tx=0x7f8e9001c520 comp rx=0 tx=0).stop 2024-04-02T07:34:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.382+0000 7f8ea3800640 1 -- 172.21.15.55:0/3654674293 shutdown_connections 2024-04-02T07:34:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.382+0000 7f8ea3800640 1 --2- 172.21.15.55:0/3654674293 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9c0afe70 0x7f8e9c0b3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.382+0000 7f8ea3800640 1 --2- 172.21.15.55:0/3654674293 >> v2:172.21.15.106:3300/0 conn(0x7f8e9c06d1c0 0x7f8e9c0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.382+0000 7f8ea3800640 1 --2- 172.21.15.55:0/3654674293 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e9c1599c0 0x7f8e9c0b1780 unknown :-1 s=CLOSED pgs=1968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.382+0000 7f8ea3800640 1 -- 172.21.15.55:0/3654674293 >> 172.21.15.55:0/3654674293 conn(0x7f8e9c069d90 msgr2=0x7f8e9c06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.382+0000 7f8ea3800640 1 -- 172.21.15.55:0/3654674293 shutdown_connections 2024-04-02T07:34:52.382 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.382+0000 7f8ea3800640 1 -- 172.21.15.55:0/3654674293 wait complete. 2024-04-02T07:34:52.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.382+0000 7f8ea3800640 1 Processor -- start 2024-04-02T07:34:52.383 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.382+0000 7f8ea3800640 1 -- start start 2024-04-02T07:34:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8ea3800640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e9c06d1c0 0x7f8e9c15a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8ea3800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9c0afe70 0x7f8e9c158c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8ea3800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e9c1599c0 0x7f8e9c1f4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8ea3800640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c1f5840 con 0x7f8e9c1599c0 2024-04-02T07:34:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8ea3800640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c1f5b20 con 0x7f8e9c06d1c0 2024-04-02T07:34:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8ea3800640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c1f5e00 con 0x7f8e9c0afe70 2024-04-02T07:34:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8ea1800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e9c1599c0 0x7f8e9c1f4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8ea1800640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e9c1599c0 0x7f8e9c1f4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46624/0 (socket says 172.21.15.55:46624) 2024-04-02T07:34:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8ea1800640 1 -- 172.21.15.55:0/2414022987 learned_addr learned my addr 172.21.15.55:0/2414022987 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8e9be00640 1 --2- 172.21.15.55:0/2414022987 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9c0afe70 0x7f8e9c158c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8ea0e00640 1 --2- 172.21.15.55:0/2414022987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e9c06d1c0 0x7f8e9c15a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8ea1800640 1 -- 172.21.15.55:0/2414022987 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9c0afe70 msgr2=0x7f8e9c158c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.385 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8ea1800640 1 --2- 172.21.15.55:0/2414022987 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9c0afe70 0x7f8e9c158c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8ea1800640 1 -- 172.21.15.55:0/2414022987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e9c06d1c0 msgr2=0x7f8e9c15a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8ea1800640 1 --2- 172.21.15.55:0/2414022987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e9c06d1c0 0x7f8e9c15a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8ea1800640 1 -- 172.21.15.55:0/2414022987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e900094d0 con 0x7f8e9c1599c0 2024-04-02T07:34:52.386 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8ea1800640 1 --2- 172.21.15.55:0/2414022987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e9c1599c0 0x7f8e9c1f4e80 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400cef0 tx=0x7f8e9400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:52.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8e98c00640 1 -- 172.21.15.55:0/2414022987 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9400d840 con 0x7f8e9c1599c0 2024-04-02T07:34:52.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8e98c00640 1 -- 172.21.15.55:0/2414022987 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9400d9c0 con 0x7f8e9c1599c0 2024-04-02T07:34:52.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8e98c00640 1 -- 172.21.15.55:0/2414022987 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9400dd70 con 0x7f8e9c1599c0 2024-04-02T07:34:52.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8ea3800640 1 -- 172.21.15.55:0/2414022987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9c150ef0 con 0x7f8e9c1599c0 2024-04-02T07:34:52.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8ea3800640 1 -- 172.21.15.55:0/2414022987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9c1591b0 con 0x7f8e9c1599c0 2024-04-02T07:34:52.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8ea3800640 1 -- 172.21.15.55:0/2414022987 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9c06e270 con 0x7f8e9c1599c0 2024-04-02T07:34:52.387 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.386+0000 7f8e98c00640 1 -- 172.21.15.55:0/2414022987 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f8e9401e3b0 con 0x7f8e9c1599c0 2024-04-02T07:34:52.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.390+0000 7f8e98c00640 1 --2- 172.21.15.55:0/2414022987 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8e7c066690 0x7f8e7c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.390+0000 7f8e98c00640 1 -- 172.21.15.55:0/2414022987 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f8e94084a00 con 0x7f8e9c1599c0 2024-04-02T07:34:52.388 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.390+0000 7f8ea0e00640 1 --2- 172.21.15.55:0/2414022987 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8e7c066690 0x7f8e7c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.389 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.390+0000 7f8ea0e00640 1 --2- 172.21.15.55:0/2414022987 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8e7c066690 0x7f8e7c068b50 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f8e900af000 tx=0x7f8e900a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:52.392 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.394+0000 7f8e98c00640 1 -- 172.21.15.55:0/2414022987 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f8e94052080 con 0x7f8e9c1599c0 2024-04-02T07:34:52.552 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.554+0000 7f8ea3800640 1 -- 172.21.15.55:0/2414022987 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e9c1f5c90 con 0x7f8e7c066690 2024-04-02T07:34:52.553 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.554+0000 7f8e98c00640 1 -- 172.21.15.55:0/2414022987 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f8e9c1f5c90 con 0x7f8e7c066690 2024-04-02T07:34:52.553 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 4 to deep-scrub 2024-04-02T07:34:52.555 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.554+0000 7f8ea3800640 1 -- 172.21.15.55:0/2414022987 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8e7c066690 msgr2=0x7f8e7c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.554+0000 7f8ea3800640 1 --2- 172.21.15.55:0/2414022987 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8e7c066690 0x7f8e7c068b50 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f8e900af000 tx=0x7f8e900a7000 comp rx=0 tx=0).stop 2024-04-02T07:34:52.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.554+0000 7f8ea3800640 1 -- 172.21.15.55:0/2414022987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e9c1599c0 msgr2=0x7f8e9c1f4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.554+0000 7f8ea3800640 1 --2- 172.21.15.55:0/2414022987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e9c1599c0 0x7f8e9c1f4e80 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f8e9400cef0 tx=0x7f8e9400a710 comp rx=0 tx=0).stop 2024-04-02T07:34:52.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.554+0000 7f8ea3800640 1 -- 172.21.15.55:0/2414022987 shutdown_connections 2024-04-02T07:34:52.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.554+0000 7f8ea3800640 1 --2- 172.21.15.55:0/2414022987 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8e9c1599c0 0x7f8e9c1f4e80 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.554+0000 7f8ea3800640 1 --2- 172.21.15.55:0/2414022987 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f8e9c0afe70 0x7f8e9c158c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.554+0000 7f8ea3800640 1 --2- 172.21.15.55:0/2414022987 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f8e7c066690 0x7f8e7c068b50 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.554+0000 7f8ea3800640 1 --2- 172.21.15.55:0/2414022987 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f8e9c06d1c0 0x7f8e9c15a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.554+0000 7f8ea3800640 1 -- 172.21.15.55:0/2414022987 >> 172.21.15.55:0/2414022987 conn(0x7f8e9c069d90 msgr2=0x7f8e9c15c390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:52.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.554+0000 7f8ea3800640 1 -- 172.21.15.55:0/2414022987 shutdown_connections 2024-04-02T07:34:52.556 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.554+0000 7f8ea3800640 1 -- 172.21.15.55:0/2414022987 wait complete. 2024-04-02T07:34:52.575 INFO:tasks.ceph:Scrubbing osd.5 2024-04-02T07:34:52.575 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-02T07:34:52.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.718+0000 7f0680400640 1 Processor -- start 2024-04-02T07:34:52.719 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.718+0000 7f0680400640 1 -- start start 2024-04-02T07:34:52.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.722+0000 7f0680400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f067815ce40 0x7f06780b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.722+0000 7f0680400640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f067806d1c0 0x7f06780b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.722+0000 7f0680400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06780b1d60 con 0x7f06780afe70 2024-04-02T07:34:52.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.722+0000 7f0680400640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f067806cda0 con 0x7f067806d1c0 2024-04-02T07:34:52.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.722+0000 7f0680400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f067806c400 con 0x7f067815ce40 2024-04-02T07:34:52.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.722+0000 7f067d000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f067806d1c0 0x7f06780b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.722+0000 7f067d000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f067806d1c0 0x7f06780b31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46632/0 (socket says 172.21.15.55:46632) 2024-04-02T07:34:52.721 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.722+0000 7f067d000640 1 -- 172.21.15.55:0/31804922 learned_addr learned my addr 172.21.15.55:0/31804922 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:52.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.722+0000 7f067da00640 1 --2- 172.21.15.55:0/31804922 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f067815ce40 0x7f06780b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.722+0000 7f067d000640 1 -- 172.21.15.55:0/31804922 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f067815ce40 msgr2=0x7f06780b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:52.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.722+0000 7f067d000640 1 --2- 172.21.15.55:0/31804922 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f067815ce40 0x7f06780b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.722+0000 7f067d000640 1 -- 172.21.15.55:0/31804922 >> v1:172.21.15.106:6789/0 conn(0x7f06780afe70 legacy=0x7f067815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.722+0000 7f067d000640 1 -- 172.21.15.55:0/31804922 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f067806c6e0 con 0x7f067806d1c0 2024-04-02T07:34:52.722 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.722+0000 7f067da00640 1 --2- 172.21.15.55:0/31804922 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f067815ce40 0x7f06780b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:52.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f067d000640 1 --2- 172.21.15.55:0/31804922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f067806d1c0 0x7f06780b31e0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f0664009870 tx=0x7f066401c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28eac347f5caf815 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:52.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f0677e00640 1 -- 172.21.15.55:0/31804922 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06640ac640 con 0x7f067806d1c0 2024-04-02T07:34:52.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f0677e00640 1 -- 172.21.15.55:0/31804922 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06640ac7a0 con 0x7f067806d1c0 2024-04-02T07:34:52.724 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f0677e00640 1 -- 172.21.15.55:0/31804922 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06640acb30 con 0x7f067806d1c0 2024-04-02T07:34:52.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f0680400640 1 -- 172.21.15.55:0/31804922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f067806d1c0 msgr2=0x7f06780b31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f0680400640 1 --2- 172.21.15.55:0/31804922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f067806d1c0 0x7f06780b31e0 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f0664009870 tx=0x7f066401c4d0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f0680400640 1 -- 172.21.15.55:0/31804922 shutdown_connections 2024-04-02T07:34:52.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f0680400640 1 --2- 172.21.15.55:0/31804922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f067806d1c0 0x7f06780b31e0 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f0680400640 1 --2- 172.21.15.55:0/31804922 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f067815ce40 0x7f06780b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f0680400640 1 -- 172.21.15.55:0/31804922 >> 172.21.15.55:0/31804922 conn(0x7f0678069d90 msgr2=0x7f067806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:52.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f0680400640 1 -- 172.21.15.55:0/31804922 shutdown_connections 2024-04-02T07:34:52.725 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f0680400640 1 -- 172.21.15.55:0/31804922 wait complete. 2024-04-02T07:34:52.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f0680400640 1 Processor -- start 2024-04-02T07:34:52.726 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f0680400640 1 -- start start 2024-04-02T07:34:52.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f0680400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f067806d1c0 0x7f067815bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f0680400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06780afe70 0x7f06781454f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f0680400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f067815ce40 0x7f0678162b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f0680400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0678156ec0 con 0x7f067815ce40 2024-04-02T07:34:52.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f0680400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f067815c490 con 0x7f06780afe70 2024-04-02T07:34:52.729 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f0680400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0678157110 con 0x7f067806d1c0 2024-04-02T07:34:52.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f067e400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f067815ce40 0x7f0678162b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f067e400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f067815ce40 0x7f0678162b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46646/0 (socket says 172.21.15.55:46646) 2024-04-02T07:34:52.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.726+0000 7f067e400640 1 -- 172.21.15.55:0/1196516247 learned_addr learned my addr 172.21.15.55:0/1196516247 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:52.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.730+0000 7f067da00640 1 --2- 172.21.15.55:0/1196516247 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f067806d1c0 0x7f067815bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.730+0000 7f067d000640 1 --2- 172.21.15.55:0/1196516247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06780afe70 0x7f06781454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.730+0000 7f067e400640 1 -- 172.21.15.55:0/1196516247 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f067806d1c0 msgr2=0x7f067815bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.730+0000 7f067e400640 1 --2- 172.21.15.55:0/1196516247 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f067806d1c0 0x7f067815bf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.730+0000 7f067e400640 1 -- 172.21.15.55:0/1196516247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06780afe70 msgr2=0x7f06781454f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.730+0000 7f067e400640 1 --2- 172.21.15.55:0/1196516247 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f06780afe70 0x7f06781454f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.730+0000 7f067e400640 1 -- 172.21.15.55:0/1196516247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06640094d0 con 0x7f067815ce40 2024-04-02T07:34:52.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.730+0000 7f067e400640 1 --2- 172.21.15.55:0/1196516247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f067815ce40 0x7f0678162b10 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f067000c770 tx=0x7f067000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:52.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.730+0000 7f0675600640 1 -- 172.21.15.55:0/1196516247 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0670003b80 con 0x7f067815ce40 2024-04-02T07:34:52.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.730+0000 7f0675600640 1 -- 172.21.15.55:0/1196516247 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0670003ce0 con 0x7f067815ce40 2024-04-02T07:34:52.730 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.730+0000 7f0675600640 1 -- 172.21.15.55:0/1196516247 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067000aa90 con 0x7f067815ce40 2024-04-02T07:34:52.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.730+0000 7f0680400640 1 -- 172.21.15.55:0/1196516247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06781573f0 con 0x7f067815ce40 2024-04-02T07:34:52.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.730+0000 7f0680400640 1 -- 172.21.15.55:0/1196516247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06781579b0 con 0x7f067815ce40 2024-04-02T07:34:52.731 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.730+0000 7f0680400640 1 -- 172.21.15.55:0/1196516247 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f0678166740 con 0x7f067815ce40 2024-04-02T07:34:52.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.730+0000 7f0675600640 1 -- 172.21.15.55:0/1196516247 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f067000abf0 con 0x7f067815ce40 2024-04-02T07:34:52.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.730+0000 7f0675600640 1 --2- 172.21.15.55:0/1196516247 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0658066690 0x7f0658068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.730+0000 7f0675600640 1 -- 172.21.15.55:0/1196516247 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f0670084660 con 0x7f067815ce40 2024-04-02T07:34:52.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.734+0000 7f0675600640 1 --2- 172.21.15.55:0/1196516247 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x7f065806c630 0x7f065806ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.734+0000 7f0675600640 1 -- 172.21.15.55:0/1196516247 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f065806f100 con 0x7f065806c630 2024-04-02T07:34:52.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.734+0000 7f0675600640 1 -- 172.21.15.55:0/1196516247 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=123) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06700849d0 con 0x7f067815ce40 2024-04-02T07:34:52.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.734+0000 7f067da00640 1 --2- 172.21.15.55:0/1196516247 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0658066690 0x7f0658068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.732 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.734+0000 7f067d000640 1 --2- 172.21.15.55:0/1196516247 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x7f065806c630 0x7f065806ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.734+0000 7f067da00640 1 --2- 172.21.15.55:0/1196516247 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0658066690 0x7f0658068b50 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f066c0045f0 tx=0x7f066c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:52.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.734+0000 7f067d000640 1 --2- 172.21.15.55:0/1196516247 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x7f065806c630 0x7f065806ea50 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:52.733 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.734+0000 7f0675600640 1 -- 172.21.15.55:0/1196516247 <== osd.5 v2:172.21.15.106:6800/27676 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f065806f100 con 0x7f065806c630 2024-04-02T07:34:52.746 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.746+0000 7f0680400640 1 -- 172.21.15.55:0/1196516247 --> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0678066c90 con 0x7f065806c630 2024-04-02T07:34:52.747 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.746+0000 7f0675600640 1 -- 172.21.15.55:0/1196516247 <== osd.5 v2:172.21.15.106:6800/27676 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f0678066c90 con 0x7f065806c630 2024-04-02T07:34:52.747 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:34:52.747 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-02T07:34:52.747 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:34:52.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.746+0000 7f0680400640 1 -- 172.21.15.55:0/1196516247 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x7f065806c630 msgr2=0x7f065806ea50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.746+0000 7f0680400640 1 --2- 172.21.15.55:0/1196516247 >> [v2:172.21.15.106:6800/27676,v1:172.21.15.106:6802/27676] conn(0x7f065806c630 0x7f065806ea50 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.746+0000 7f0680400640 1 -- 172.21.15.55:0/1196516247 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0658066690 msgr2=0x7f0658068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.746+0000 7f0680400640 1 --2- 172.21.15.55:0/1196516247 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f0658066690 0x7f0658068b50 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f066c0045f0 tx=0x7f066c008040 comp rx=0 tx=0).stop 2024-04-02T07:34:52.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.746+0000 7f0680400640 1 -- 172.21.15.55:0/1196516247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f067815ce40 msgr2=0x7f0678162b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.748 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.746+0000 7f0680400640 1 --2- 172.21.15.55:0/1196516247 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f067815ce40 0x7f0678162b10 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f067000c770 tx=0x7f067000cc30 comp rx=0 tx=0).stop 2024-04-02T07:34:52.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.746+0000 7f067e400640 1 -- 172.21.15.55:0/1196516247 reap_dead start 2024-04-02T07:34:52.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.746+0000 7f0680400640 1 -- 172.21.15.55:0/1196516247 shutdown_connections 2024-04-02T07:34:52.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.746+0000 7f0680400640 1 -- 172.21.15.55:0/1196516247 >> 172.21.15.55:0/1196516247 conn(0x7f0678069d90 msgr2=0x7f0678072ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:52.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.746+0000 7f0680400640 1 -- 172.21.15.55:0/1196516247 shutdown_connections 2024-04-02T07:34:52.749 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.746+0000 7f0680400640 1 -- 172.21.15.55:0/1196516247 wait complete. 2024-04-02T07:34:52.765 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-02T07:34:52.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.906+0000 7fa990c00640 1 Processor -- start 2024-04-02T07:34:52.906 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.906+0000 7fa990c00640 1 -- start start 2024-04-02T07:34:52.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.906+0000 7fa990c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa98c1599c0 0x7fa98c0b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.906+0000 7fa990c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa98c0b38f0 0x7fa98c0c90d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.906+0000 7fa990c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98c0b1d60 con 0x7fa98c06d1c0 2024-04-02T07:34:52.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.906+0000 7fa990c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98c06cda0 con 0x7fa98c1599c0 2024-04-02T07:34:52.907 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.906+0000 7fa990c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c06c400 con 0x7fa98c0b38f0 2024-04-02T07:34:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.906+0000 7fa989e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa98c1599c0 0x7fa98c0b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.906+0000 7fa989e00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa98c1599c0 0x7fa98c0b1780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46650/0 (socket says 172.21.15.55:46650) 2024-04-02T07:34:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.906+0000 7fa989e00640 1 -- 172.21.15.55:0/2042896101 learned_addr learned my addr 172.21.15.55:0/2042896101 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.906+0000 7fa98a800640 1 --2- 172.21.15.55:0/2042896101 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa98c0b38f0 0x7fa98c0c90d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.906+0000 7fa989e00640 1 -- 172.21.15.55:0/2042896101 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa98c0b38f0 msgr2=0x7fa98c0c90d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.906+0000 7fa989e00640 1 --2- 172.21.15.55:0/2042896101 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa98c0b38f0 0x7fa98c0c90d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.906+0000 7fa989e00640 1 -- 172.21.15.55:0/2042896101 >> v1:172.21.15.55:6789/0 conn(0x7fa98c06d1c0 legacy=0x7fa98c0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.908 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.906+0000 7fa989e00640 1 -- 172.21.15.55:0/2042896101 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c06c6e0 con 0x7fa98c1599c0 2024-04-02T07:34:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.910+0000 7fa989e00640 1 --2- 172.21.15.55:0/2042896101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa98c1599c0 0x7fa98c0b1780 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009870 tx=0x7fa97c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e57edaca40a49ba server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:52.910 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.910+0000 7fa989400640 1 -- 172.21.15.55:0/2042896101 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c0ad660 con 0x7fa98c1599c0 2024-04-02T07:34:52.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.910+0000 7fa989400640 1 -- 172.21.15.55:0/2042896101 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa97c0ad7c0 con 0x7fa98c1599c0 2024-04-02T07:34:52.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.910+0000 7fa989400640 1 -- 172.21.15.55:0/2042896101 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa97c0adb50 con 0x7fa98c1599c0 2024-04-02T07:34:52.911 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.910+0000 7fa990c00640 1 -- 172.21.15.55:0/2042896101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa98c1599c0 msgr2=0x7fa98c0b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.910+0000 7fa990c00640 1 --2- 172.21.15.55:0/2042896101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa98c1599c0 0x7fa98c0b1780 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7fa97c009870 tx=0x7fa97c01c560 comp rx=0 tx=0).stop 2024-04-02T07:34:52.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.910+0000 7fa990c00640 1 -- 172.21.15.55:0/2042896101 shutdown_connections 2024-04-02T07:34:52.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.910+0000 7fa990c00640 1 --2- 172.21.15.55:0/2042896101 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa98c0b38f0 0x7fa98c0c90d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.910+0000 7fa990c00640 1 --2- 172.21.15.55:0/2042896101 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa98c1599c0 0x7fa98c0b1780 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.910+0000 7fa990c00640 1 -- 172.21.15.55:0/2042896101 >> 172.21.15.55:0/2042896101 conn(0x7fa98c069d90 msgr2=0x7fa98c06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:52.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.910+0000 7fa990c00640 1 -- 172.21.15.55:0/2042896101 shutdown_connections 2024-04-02T07:34:52.912 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.910+0000 7fa990c00640 1 -- 172.21.15.55:0/2042896101 wait complete. 2024-04-02T07:34:52.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa990c00640 1 Processor -- start 2024-04-02T07:34:52.913 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa990c00640 1 -- start start 2024-04-02T07:34:52.914 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa990c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa98c06d1c0 0x7fa98c14cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa990c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa98c0b38f0 0x7fa98c15a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa990c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98c1599c0 0x7fa98c153650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa990c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c14d4a0 con 0x7fa98c0b38f0 2024-04-02T07:34:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa990c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c15b3a0 con 0x7fa98c1599c0 2024-04-02T07:34:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa990c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c0b03a0 con 0x7fa98c06d1c0 2024-04-02T07:34:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa983e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa98c0b38f0 0x7fa98c15a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa983e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa98c0b38f0 0x7fa98c15a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46660/0 (socket says 172.21.15.55:46660) 2024-04-02T07:34:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa983e00640 1 -- 172.21.15.55:0/2733751651 learned_addr learned my addr 172.21.15.55:0/2733751651 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa989e00640 1 --2- 172.21.15.55:0/2733751651 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa98c06d1c0 0x7fa98c14cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa98a800640 1 --2- 172.21.15.55:0/2733751651 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98c1599c0 0x7fa98c153650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa983e00640 1 -- 172.21.15.55:0/2733751651 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa98c06d1c0 msgr2=0x7fa98c14cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa983e00640 1 --2- 172.21.15.55:0/2733751651 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa98c06d1c0 0x7fa98c14cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.915 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa983e00640 1 -- 172.21.15.55:0/2733751651 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98c1599c0 msgr2=0x7fa98c153650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:52.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa983e00640 1 --2- 172.21.15.55:0/2733751651 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98c1599c0 0x7fa98c153650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:52.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa983e00640 1 -- 172.21.15.55:0/2733751651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97c0094d0 con 0x7fa98c0b38f0 2024-04-02T07:34:52.916 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa989e00640 1 --2- 172.21.15.55:0/2733751651 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa98c06d1c0 0x7fa98c14cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:52.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa983e00640 1 --2- 172.21.15.55:0/2733751651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa98c0b38f0 0x7fa98c15a700 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7fa97400c500 tx=0x7fa97400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:52.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa982000640 1 -- 172.21.15.55:0/2733751651 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974005220 con 0x7fa98c0b38f0 2024-04-02T07:34:52.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa982000640 1 -- 172.21.15.55:0/2733751651 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa974005380 con 0x7fa98c0b38f0 2024-04-02T07:34:52.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa982000640 1 -- 172.21.15.55:0/2733751651 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa974007270 con 0x7fa98c0b38f0 2024-04-02T07:34:52.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa990c00640 1 -- 172.21.15.55:0/2733751651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98c0b10d0 con 0x7fa98c0b38f0 2024-04-02T07:34:52.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.914+0000 7fa990c00640 1 -- 172.21.15.55:0/2733751651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c0b05f0 con 0x7fa98c0b38f0 2024-04-02T07:34:52.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.918+0000 7fa990c00640 1 -- 172.21.15.55:0/2733751651 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98c0b1260 con 0x7fa98c0b38f0 2024-04-02T07:34:52.917 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.918+0000 7fa982000640 1 -- 172.21.15.55:0/2733751651 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fa9740073d0 con 0x7fa98c0b38f0 2024-04-02T07:34:52.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.918+0000 7fa982000640 1 --2- 172.21.15.55:0/2733751651 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa968066690 0x7fa968068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:52.918 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.918+0000 7fa982000640 1 -- 172.21.15.55:0/2733751651 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fa974083910 con 0x7fa98c0b38f0 2024-04-02T07:34:52.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.918+0000 7fa989e00640 1 --2- 172.21.15.55:0/2733751651 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa968066690 0x7fa968068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:52.919 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.918+0000 7fa989e00640 1 --2- 172.21.15.55:0/2733751651 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa968066690 0x7fa968068b50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0af000 tx=0x7fa97c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:52.923 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:52.922+0000 7fa982000640 1 -- 172.21.15.55:0/2733751651 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fa974050e40 con 0x7fa98c0b38f0 2024-04-02T07:34:53.084 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.086+0000 7fa990c00640 1 -- 172.21.15.55:0/2733751651 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fa98c06e270 con 0x7fa968066690 2024-04-02T07:34:53.085 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.086+0000 7fa982000640 1 -- 172.21.15.55:0/2733751651 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa98c06e270 con 0x7fa968066690 2024-04-02T07:34:53.085 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 5 to deep-scrub 2024-04-02T07:34:53.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.086+0000 7fa990c00640 1 -- 172.21.15.55:0/2733751651 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa968066690 msgr2=0x7fa968068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.086+0000 7fa990c00640 1 --2- 172.21.15.55:0/2733751651 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa968066690 0x7fa968068b50 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fa97c0af000 tx=0x7fa97c0a7000 comp rx=0 tx=0).stop 2024-04-02T07:34:53.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.086+0000 7fa990c00640 1 -- 172.21.15.55:0/2733751651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa98c0b38f0 msgr2=0x7fa98c15a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.086+0000 7fa990c00640 1 --2- 172.21.15.55:0/2733751651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa98c0b38f0 0x7fa98c15a700 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7fa97400c500 tx=0x7fa97400c9c0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.086+0000 7fa990c00640 1 -- 172.21.15.55:0/2733751651 shutdown_connections 2024-04-02T07:34:53.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.086+0000 7fa990c00640 1 --2- 172.21.15.55:0/2733751651 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fa968066690 0x7fa968068b50 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.087 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.086+0000 7fa990c00640 1 --2- 172.21.15.55:0/2733751651 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fa98c1599c0 0x7fa98c153650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.086+0000 7fa990c00640 1 --2- 172.21.15.55:0/2733751651 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa98c0b38f0 0x7fa98c15a700 unknown :-1 s=CLOSED pgs=1974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.086+0000 7fa990c00640 1 --2- 172.21.15.55:0/2733751651 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fa98c06d1c0 0x7fa98c14cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.086+0000 7fa990c00640 1 -- 172.21.15.55:0/2733751651 >> 172.21.15.55:0/2733751651 conn(0x7fa98c069d90 msgr2=0x7fa98c15d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:53.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.086+0000 7fa990c00640 1 -- 172.21.15.55:0/2733751651 shutdown_connections 2024-04-02T07:34:53.088 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.086+0000 7fa990c00640 1 -- 172.21.15.55:0/2733751651 wait complete. 2024-04-02T07:34:53.106 INFO:tasks.ceph:Scrubbing osd.6 2024-04-02T07:34:53.106 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-02T07:34:53.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.250+0000 7f12b7000640 1 Processor -- start 2024-04-02T07:34:53.251 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.250+0000 7f12b7000640 1 -- start start 2024-04-02T07:34:53.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.254+0000 7f12b7000640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f12b015aa40 0x7f12b00caea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.254+0000 7f12b7000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f12b006da10 0x7f12b00cb3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.254+0000 7f12b7000640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b00ca030 con 0x7f12b00af920 2024-04-02T07:34:53.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.254+0000 7f12b7000640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b00cb920 con 0x7f12b015aa40 2024-04-02T07:34:53.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.254+0000 7f12b7000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b00c9420 con 0x7f12b006da10 2024-04-02T07:34:53.253 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.254+0000 7f12afe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f12b015aa40 0x7f12b00caea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.254+0000 7f12afe00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f12b015aa40 0x7f12b00caea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46670/0 (socket says 172.21.15.55:46670) 2024-04-02T07:34:53.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.254+0000 7f12afe00640 1 -- 172.21.15.55:0/3421974045 learned_addr learned my addr 172.21.15.55:0/3421974045 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:53.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.254+0000 7f12b5000640 1 --2- 172.21.15.55:0/3421974045 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f12b006da10 0x7f12b00cb3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.254+0000 7f12afe00640 1 -- 172.21.15.55:0/3421974045 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f12b006da10 msgr2=0x7f12b00cb3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:53.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.254+0000 7f12afe00640 1 --2- 172.21.15.55:0/3421974045 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f12b006da10 0x7f12b00cb3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.254+0000 7f12afe00640 1 -- 172.21.15.55:0/3421974045 >> v1:172.21.15.55:6789/0 conn(0x7f12b00af920 legacy=0x7f12b015e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.254+0000 7f12afe00640 1 -- 172.21.15.55:0/3421974045 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b00c9700 con 0x7f12b015aa40 2024-04-02T07:34:53.254 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.254+0000 7f12af400640 1 -- 172.21.15.55:0/3421974045 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3229944328 0 0) 0x7f12b00ca030 con 0x7f12b00af920 2024-04-02T07:34:53.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.258+0000 7f12afe00640 1 --2- 172.21.15.55:0/3421974045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12b015aa40 0x7f12b00caea0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009870 tx=0x7f12a001c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c7f75b5961497e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:53.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.258+0000 7f12af400640 1 -- 172.21.15.55:0/3421974045 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a00a95f0 con 0x7f12b015aa40 2024-04-02T07:34:53.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.258+0000 7f12af400640 1 -- 172.21.15.55:0/3421974045 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a00a9750 con 0x7f12b015aa40 2024-04-02T07:34:53.256 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.258+0000 7f12af400640 1 -- 172.21.15.55:0/3421974045 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a00a9ae0 con 0x7f12b015aa40 2024-04-02T07:34:53.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.258+0000 7f12b7000640 1 -- 172.21.15.55:0/3421974045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12b015aa40 msgr2=0x7f12b00caea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.258+0000 7f12b7000640 1 --2- 172.21.15.55:0/3421974045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12b015aa40 0x7f12b00caea0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f12a0009870 tx=0x7f12a001c530 comp rx=0 tx=0).stop 2024-04-02T07:34:53.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.258+0000 7f12b7000640 1 -- 172.21.15.55:0/3421974045 shutdown_connections 2024-04-02T07:34:53.257 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.258+0000 7f12b7000640 1 --2- 172.21.15.55:0/3421974045 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f12b006da10 0x7f12b00cb3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.258+0000 7f12b7000640 1 --2- 172.21.15.55:0/3421974045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12b015aa40 0x7f12b00caea0 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.258+0000 7f12b7000640 1 -- 172.21.15.55:0/3421974045 >> 172.21.15.55:0/3421974045 conn(0x7f12b0069d90 msgr2=0x7f12b006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:53.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.258+0000 7f12b7000640 1 -- 172.21.15.55:0/3421974045 shutdown_connections 2024-04-02T07:34:53.258 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.258+0000 7f12b7000640 1 -- 172.21.15.55:0/3421974045 wait complete. 2024-04-02T07:34:53.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.258+0000 7f12b7000640 1 Processor -- start 2024-04-02T07:34:53.259 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.258+0000 7f12b7000640 1 -- start start 2024-04-02T07:34:53.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12b7000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12b006da10 0x7f12b00b2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12b7000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12b00af920 0x7f12b00c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12b7000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f12b015aa40 0x7f12b0145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12b7000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b01f9420 con 0x7f12b006da10 2024-04-02T07:34:53.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12b7000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b01f8b10 con 0x7f12b00af920 2024-04-02T07:34:53.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12b7000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b00b2a10 con 0x7f12b015aa40 2024-04-02T07:34:53.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12afe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12b006da10 0x7f12b00b2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12afe00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12b006da10 0x7f12b00b2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46682/0 (socket says 172.21.15.55:46682) 2024-04-02T07:34:53.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12afe00640 1 -- 172.21.15.55:0/3180823364 learned_addr learned my addr 172.21.15.55:0/3180823364 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:53.261 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12b5000640 1 --2- 172.21.15.55:0/3180823364 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f12b015aa40 0x7f12b0145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12a7e00640 1 --2- 172.21.15.55:0/3180823364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12b00af920 0x7f12b00c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12afe00640 1 -- 172.21.15.55:0/3180823364 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f12b015aa40 msgr2=0x7f12b0145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12afe00640 1 --2- 172.21.15.55:0/3180823364 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f12b015aa40 0x7f12b0145ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12afe00640 1 -- 172.21.15.55:0/3180823364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12b00af920 msgr2=0x7f12b00c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12afe00640 1 --2- 172.21.15.55:0/3180823364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12b00af920 0x7f12b00c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12afe00640 1 -- 172.21.15.55:0/3180823364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a00094d0 con 0x7f12b006da10 2024-04-02T07:34:53.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12a7e00640 1 --2- 172.21.15.55:0/3180823364 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f12b00af920 0x7f12b00c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:53.262 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12afe00640 1 --2- 172.21.15.55:0/3180823364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12b006da10 0x7f12b00b2110 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f12a00ab040 tx=0x7f12a001ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:53.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12acc00640 1 -- 172.21.15.55:0/3180823364 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a00a95f0 con 0x7f12b006da10 2024-04-02T07:34:53.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12acc00640 1 -- 172.21.15.55:0/3180823364 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a00b1820 con 0x7f12b006da10 2024-04-02T07:34:53.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12acc00640 1 -- 172.21.15.55:0/3180823364 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a00b1bd0 con 0x7f12b006da10 2024-04-02T07:34:53.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12b7000640 1 -- 172.21.15.55:0/3180823364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b01f8dd0 con 0x7f12b006da10 2024-04-02T07:34:53.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12b7000640 1 -- 172.21.15.55:0/3180823364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b01f98b0 con 0x7f12b006da10 2024-04-02T07:34:53.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.262+0000 7f12b7000640 1 -- 172.21.15.55:0/3180823364 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f12b015ae20 con 0x7f12b006da10 2024-04-02T07:34:53.263 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.266+0000 7f12acc00640 1 -- 172.21.15.55:0/3180823364 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f12a00b1d30 con 0x7f12b006da10 2024-04-02T07:34:53.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.266+0000 7f12acc00640 1 --2- 172.21.15.55:0/3180823364 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f128c0666c0 0x7f128c068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.266+0000 7f12acc00640 1 -- 172.21.15.55:0/3180823364 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f12a011e910 con 0x7f12b006da10 2024-04-02T07:34:53.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.266+0000 7f12acc00640 1 --2- 172.21.15.55:0/3180823364 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x7f128c06c660 0x7f128c06ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.266+0000 7f12acc00640 1 -- 172.21.15.55:0/3180823364 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f128c06f130 con 0x7f128c06c660 2024-04-02T07:34:53.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.266+0000 7f12acc00640 1 -- 172.21.15.55:0/3180823364 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=123) v2 ==== 24+0+0 (secure 0 0 0) 0x7f12a01232a0 con 0x7f12b006da10 2024-04-02T07:34:53.265 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.266+0000 7f12a7e00640 1 --2- 172.21.15.55:0/3180823364 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f128c0666c0 0x7f128c068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.266+0000 7f12b5000640 1 --2- 172.21.15.55:0/3180823364 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x7f128c06c660 0x7f128c06ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.266+0000 7f12a7e00640 1 --2- 172.21.15.55:0/3180823364 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f128c0666c0 0x7f128c068b80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f12b01659f0 tx=0x7f1298009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:53.266 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.266+0000 7f12b5000640 1 --2- 172.21.15.55:0/3180823364 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x7f128c06c660 0x7f128c06ea80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:53.267 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.266+0000 7f12acc00640 1 -- 172.21.15.55:0/3180823364 <== osd.6 v2:172.21.15.106:6816/27678 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7f128c06f130 con 0x7f128c06c660 2024-04-02T07:34:53.279 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.278+0000 7f12b7000640 1 -- 172.21.15.55:0/3180823364 --> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f12b01f9560 con 0x7f128c06c660 2024-04-02T07:34:53.280 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.282+0000 7f12acc00640 1 -- 172.21.15.55:0/3180823364 <== osd.6 v2:172.21.15.106:6816/27678 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7f12a8009af0 con 0x7f128c06c660 2024-04-02T07:34:53.280 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:34:53.280 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-02T07:34:53.280 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:34:53.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.282+0000 7f12b7000640 1 -- 172.21.15.55:0/3180823364 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x7f128c06c660 msgr2=0x7f128c06ea80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.282+0000 7f12b7000640 1 --2- 172.21.15.55:0/3180823364 >> [v2:172.21.15.106:6816/27678,v1:172.21.15.106:6817/27678] conn(0x7f128c06c660 0x7f128c06ea80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.282+0000 7f12b7000640 1 -- 172.21.15.55:0/3180823364 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f128c0666c0 msgr2=0x7f128c068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.282+0000 7f12b7000640 1 --2- 172.21.15.55:0/3180823364 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f128c0666c0 0x7f128c068b80 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f12b01659f0 tx=0x7f1298009040 comp rx=0 tx=0).stop 2024-04-02T07:34:53.281 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.282+0000 7f12b7000640 1 -- 172.21.15.55:0/3180823364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12b006da10 msgr2=0x7f12b00b2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.282+0000 7f12b7000640 1 --2- 172.21.15.55:0/3180823364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f12b006da10 0x7f12b00b2110 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f12a00ab040 tx=0x7f12a001ad70 comp rx=0 tx=0).stop 2024-04-02T07:34:53.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.282+0000 7f12b5000640 1 -- 172.21.15.55:0/3180823364 reap_dead start 2024-04-02T07:34:53.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.282+0000 7f12b7000640 1 -- 172.21.15.55:0/3180823364 shutdown_connections 2024-04-02T07:34:53.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.282+0000 7f12b7000640 1 -- 172.21.15.55:0/3180823364 >> 172.21.15.55:0/3180823364 conn(0x7f12b0069d90 msgr2=0x7f12b006d290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:53.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.282+0000 7f12b7000640 1 -- 172.21.15.55:0/3180823364 shutdown_connections 2024-04-02T07:34:53.282 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.282+0000 7f12b7000640 1 -- 172.21.15.55:0/3180823364 wait complete. 2024-04-02T07:34:53.298 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-02T07:34:53.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.438+0000 7fc283c00640 1 Processor -- start 2024-04-02T07:34:53.439 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.438+0000 7fc283c00640 1 -- start start 2024-04-02T07:34:53.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.442+0000 7fc283c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc27c1599c0 0x7fc27c0b1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.442+0000 7fc283c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc27c06d1c0 0x7fc27c0b31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.442+0000 7fc283c00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc27c0b1d60 con 0x7fc27c0afe70 2024-04-02T07:34:53.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.442+0000 7fc283c00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc27c06cda0 con 0x7fc27c1599c0 2024-04-02T07:34:53.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.442+0000 7fc283c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c06c400 con 0x7fc27c06d1c0 2024-04-02T07:34:53.441 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.442+0000 7fc281200640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc27c1599c0 0x7fc27c0b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.442+0000 7fc281c00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc27c0afe70 0x7fc27c15d5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41278/0 (socket says 172.21.15.55:41278) 2024-04-02T07:34:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.442+0000 7fc281c00640 1 -- 172.21.15.55:0/2482275181 learned_addr learned my addr 172.21.15.55:0/2482275181 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.442+0000 7fc273e00640 1 --2- 172.21.15.55:0/2482275181 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc27c06d1c0 0x7fc27c0b31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.442+0000 7fc281200640 1 -- 172.21.15.55:0/2482275181 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc27c06d1c0 msgr2=0x7fc27c0b31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.442+0000 7fc281200640 1 --2- 172.21.15.55:0/2482275181 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc27c06d1c0 0x7fc27c0b31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.442+0000 7fc281200640 1 -- 172.21.15.55:0/2482275181 >> v1:172.21.15.55:6789/0 conn(0x7fc27c0afe70 legacy=0x7fc27c15d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.442 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.442+0000 7fc281200640 1 -- 172.21.15.55:0/2482275181 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c06c6e0 con 0x7fc27c1599c0 2024-04-02T07:34:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.446+0000 7fc281200640 1 --2- 172.21.15.55:0/2482275181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c1599c0 0x7fc27c0b1780 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0097c0 tx=0x7fc26c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8981ca692b7717 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.446+0000 7fc27be00640 1 -- 172.21.15.55:0/2482275181 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c0ac410 con 0x7fc27c1599c0 2024-04-02T07:34:53.444 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.446+0000 7fc27be00640 1 -- 172.21.15.55:0/2482275181 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc26c0ac570 con 0x7fc27c1599c0 2024-04-02T07:34:53.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.446+0000 7fc27be00640 1 -- 172.21.15.55:0/2482275181 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc26c0ac900 con 0x7fc27c1599c0 2024-04-02T07:34:53.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.446+0000 7fc283c00640 1 -- 172.21.15.55:0/2482275181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c1599c0 msgr2=0x7fc27c0b1780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.445 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.446+0000 7fc283c00640 1 --2- 172.21.15.55:0/2482275181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c1599c0 0x7fc27c0b1780 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0097c0 tx=0x7fc26c01c4a0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.446+0000 7fc283c00640 1 -- 172.21.15.55:0/2482275181 shutdown_connections 2024-04-02T07:34:53.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.446+0000 7fc283c00640 1 --2- 172.21.15.55:0/2482275181 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc27c06d1c0 0x7fc27c0b31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.446+0000 7fc283c00640 1 --2- 172.21.15.55:0/2482275181 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c1599c0 0x7fc27c0b1780 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.446+0000 7fc283c00640 1 -- 172.21.15.55:0/2482275181 >> 172.21.15.55:0/2482275181 conn(0x7fc27c069d90 msgr2=0x7fc27c06a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:53.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.446+0000 7fc283c00640 1 -- 172.21.15.55:0/2482275181 shutdown_connections 2024-04-02T07:34:53.446 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.446+0000 7fc283c00640 1 -- 172.21.15.55:0/2482275181 wait complete. 2024-04-02T07:34:53.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.446+0000 7fc283c00640 1 Processor -- start 2024-04-02T07:34:53.447 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.446+0000 7fc283c00640 1 -- start start 2024-04-02T07:34:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc283c00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc27c06d1c0 0x7fc27c13e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.449 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc283c00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc27c0afe70 0x7fc27c1559a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc283c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c1599c0 0x7fc27c155ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc283c00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c13f7c0 con 0x7fc27c1599c0 2024-04-02T07:34:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc283c00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c1534c0 con 0x7fc27c06d1c0 2024-04-02T07:34:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc283c00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc27c141d00 con 0x7fc27c0afe70 2024-04-02T07:34:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc281c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c1599c0 0x7fc27c155ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc281c00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c1599c0 0x7fc27c155ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46692/0 (socket says 172.21.15.55:46692) 2024-04-02T07:34:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc281c00640 1 -- 172.21.15.55:0/2920977634 learned_addr learned my addr 172.21.15.55:0/2920977634 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc273e00640 1 --2- 172.21.15.55:0/2920977634 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc27c0afe70 0x7fc27c1559a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc281200640 1 --2- 172.21.15.55:0/2920977634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc27c06d1c0 0x7fc27c13e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc281c00640 1 -- 172.21.15.55:0/2920977634 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc27c0afe70 msgr2=0x7fc27c1559a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc281c00640 1 --2- 172.21.15.55:0/2920977634 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc27c0afe70 0x7fc27c1559a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc281c00640 1 -- 172.21.15.55:0/2920977634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc27c06d1c0 msgr2=0x7fc27c13e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.450 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc281c00640 1 --2- 172.21.15.55:0/2920977634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc27c06d1c0 0x7fc27c13e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc281c00640 1 -- 172.21.15.55:0/2920977634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc26c009420 con 0x7fc27c1599c0 2024-04-02T07:34:53.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc281200640 1 --2- 172.21.15.55:0/2920977634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc27c06d1c0 0x7fc27c13e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:34:53.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc281c00640 1 --2- 172.21.15.55:0/2920977634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c1599c0 0x7fc27c155ee0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7fc27400cbc0 tx=0x7fc27400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:53.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc279600640 1 -- 172.21.15.55:0/2920977634 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27400ad40 con 0x7fc27c1599c0 2024-04-02T07:34:53.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc279600640 1 -- 172.21.15.55:0/2920977634 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc274012400 con 0x7fc27c1599c0 2024-04-02T07:34:53.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc283c00640 1 -- 172.21.15.55:0/2920977634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc27c141fe0 con 0x7fc27c1599c0 2024-04-02T07:34:53.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc279600640 1 -- 172.21.15.55:0/2920977634 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27400aea0 con 0x7fc27c1599c0 2024-04-02T07:34:53.451 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc283c00640 1 -- 172.21.15.55:0/2920977634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc27c13f3e0 con 0x7fc27c1599c0 2024-04-02T07:34:53.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc283c00640 1 -- 172.21.15.55:0/2920977634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc27c06e270 con 0x7fc27c1599c0 2024-04-02T07:34:53.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.450+0000 7fc279600640 1 -- 172.21.15.55:0/2920977634 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc274007070 con 0x7fc27c1599c0 2024-04-02T07:34:53.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.454+0000 7fc279600640 1 --2- 172.21.15.55:0/2920977634 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc258066690 0x7fc258068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.454+0000 7fc279600640 1 -- 172.21.15.55:0/2920977634 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fc274083dd0 con 0x7fc27c1599c0 2024-04-02T07:34:53.452 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.454+0000 7fc281200640 1 --2- 172.21.15.55:0/2920977634 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc258066690 0x7fc258068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.453 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.454+0000 7fc281200640 1 --2- 172.21.15.55:0/2920977634 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc258066690 0x7fc258068b50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0ae000 tx=0x7fc26c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:53.456 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.458+0000 7fc279600640 1 -- 172.21.15.55:0/2920977634 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc274051430 con 0x7fc27c1599c0 2024-04-02T07:34:53.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.622+0000 7fc283c00640 1 -- 172.21.15.55:0/2920977634 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fc27c166740 con 0x7fc258066690 2024-04-02T07:34:53.621 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.622+0000 7fc279600640 1 -- 172.21.15.55:0/2920977634 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc26c0ac860 con 0x7fc258066690 2024-04-02T07:34:53.621 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 6 to deep-scrub 2024-04-02T07:34:53.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.622+0000 7fc283c00640 1 -- 172.21.15.55:0/2920977634 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc258066690 msgr2=0x7fc258068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.622+0000 7fc283c00640 1 --2- 172.21.15.55:0/2920977634 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc258066690 0x7fc258068b50 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fc26c0ae000 tx=0x7fc26c008040 comp rx=0 tx=0).stop 2024-04-02T07:34:53.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.622+0000 7fc283c00640 1 -- 172.21.15.55:0/2920977634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c1599c0 msgr2=0x7fc27c155ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.622+0000 7fc283c00640 1 --2- 172.21.15.55:0/2920977634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c1599c0 0x7fc27c155ee0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7fc27400cbc0 tx=0x7fc27400a430 comp rx=0 tx=0).stop 2024-04-02T07:34:53.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.622+0000 7fc283c00640 1 -- 172.21.15.55:0/2920977634 shutdown_connections 2024-04-02T07:34:53.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.622+0000 7fc283c00640 1 --2- 172.21.15.55:0/2920977634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc27c1599c0 0x7fc27c155ee0 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.622+0000 7fc283c00640 1 --2- 172.21.15.55:0/2920977634 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc27c0afe70 0x7fc27c1559a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.622+0000 7fc283c00640 1 --2- 172.21.15.55:0/2920977634 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc258066690 0x7fc258068b50 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.622+0000 7fc283c00640 1 --2- 172.21.15.55:0/2920977634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc27c06d1c0 0x7fc27c13e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.622+0000 7fc283c00640 1 -- 172.21.15.55:0/2920977634 >> 172.21.15.55:0/2920977634 conn(0x7fc27c069d90 msgr2=0x7fc27c1577d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:53.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.622+0000 7fc283c00640 1 -- 172.21.15.55:0/2920977634 shutdown_connections 2024-04-02T07:34:53.624 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.622+0000 7fc283c00640 1 -- 172.21.15.55:0/2920977634 wait complete. 2024-04-02T07:34:53.643 INFO:tasks.ceph:Scrubbing osd.7 2024-04-02T07:34:53.643 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-02T07:34:53.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.786+0000 7efd2ac00640 1 Processor -- start 2024-04-02T07:34:53.787 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.786+0000 7efd2ac00640 1 -- start start 2024-04-02T07:34:53.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.790+0000 7efd2ac00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efd240cb5b0 0x7efd2406ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.790+0000 7efd2ac00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd240af920 0x7efd2406cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.790+0000 7efd2ac00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd240ca030 con 0x7efd2415aa40 2024-04-02T07:34:53.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.790+0000 7efd2ac00640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd240c9420 con 0x7efd240af920 2024-04-02T07:34:53.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.790+0000 7efd2ac00640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd240c9700 con 0x7efd240cb5b0 2024-04-02T07:34:53.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.790+0000 7efd28c00640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efd240af920 0x7efd2406cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.789 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.790+0000 7efd23e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efd2415aa40 0x7efd240caea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41294/0 (socket says 172.21.15.55:41294) 2024-04-02T07:34:53.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.790+0000 7efd23e00640 1 -- 172.21.15.55:0/4023580309 learned_addr learned my addr 172.21.15.55:0/4023580309 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:53.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.790+0000 7efd1be00640 1 --2- 172.21.15.55:0/4023580309 >> v2:172.21.15.106:3300/0 conn(0x7efd240cb5b0 0x7efd2406ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.790+0000 7efd28c00640 1 -- 172.21.15.55:0/4023580309 >> v2:172.21.15.106:3300/0 conn(0x7efd240cb5b0 msgr2=0x7efd2406ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:34:53.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.790+0000 7efd28c00640 1 --2- 172.21.15.55:0/4023580309 >> v2:172.21.15.106:3300/0 conn(0x7efd240cb5b0 0x7efd2406ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.790+0000 7efd28c00640 1 -- 172.21.15.55:0/4023580309 >> v1:172.21.15.55:6789/0 conn(0x7efd2415aa40 legacy=0x7efd240caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.790+0000 7efd28c00640 1 -- 172.21.15.55:0/4023580309 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd240c99e0 con 0x7efd240af920 2024-04-02T07:34:53.790 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.790+0000 7efd23400640 1 -- 172.21.15.55:0/4023580309 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400845132 0 0) 0x7efd240ca030 con 0x7efd2415aa40 2024-04-02T07:34:53.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.790+0000 7efd28c00640 1 --2- 172.21.15.55:0/4023580309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd240af920 0x7efd2406cf40 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7efd240b0450 tx=0x7efd1c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a62f9bd466a0ff server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:53.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.790+0000 7efd23400640 1 -- 172.21.15.55:0/4023580309 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c0a59e0 con 0x7efd240af920 2024-04-02T07:34:53.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.790+0000 7efd23400640 1 -- 172.21.15.55:0/4023580309 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd1c0a5b40 con 0x7efd240af920 2024-04-02T07:34:53.792 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.790+0000 7efd23400640 1 -- 172.21.15.55:0/4023580309 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd1c0ad440 con 0x7efd240af920 2024-04-02T07:34:53.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd2ac00640 1 -- 172.21.15.55:0/4023580309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd240af920 msgr2=0x7efd2406cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd2ac00640 1 --2- 172.21.15.55:0/4023580309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd240af920 0x7efd2406cf40 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7efd240b0450 tx=0x7efd1c01c900 comp rx=0 tx=0).stop 2024-04-02T07:34:53.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd2ac00640 1 -- 172.21.15.55:0/4023580309 shutdown_connections 2024-04-02T07:34:53.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd2ac00640 1 --2- 172.21.15.55:0/4023580309 >> v2:172.21.15.106:3300/0 conn(0x7efd240cb5b0 0x7efd2406ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.793 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd2ac00640 1 --2- 172.21.15.55:0/4023580309 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd240af920 0x7efd2406cf40 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd2ac00640 1 -- 172.21.15.55:0/4023580309 >> 172.21.15.55:0/4023580309 conn(0x7efd24069d90 msgr2=0x7efd2406a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:53.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd2ac00640 1 -- 172.21.15.55:0/4023580309 shutdown_connections 2024-04-02T07:34:53.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd2ac00640 1 -- 172.21.15.55:0/4023580309 wait complete. 2024-04-02T07:34:53.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd2ac00640 1 Processor -- start 2024-04-02T07:34:53.794 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd2ac00640 1 -- start start 2024-04-02T07:34:53.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd2ac00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd240af920 0x7efd24139fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd2ac00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd240cb5b0 0x7efd2414bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd2ac00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd2415aa40 0x7efd2414da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd2ac00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2414f2a0 con 0x7efd240af920 2024-04-02T07:34:53.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd2ac00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2414ea00 con 0x7efd2415aa40 2024-04-02T07:34:53.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd2ac00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd2414ece0 con 0x7efd240cb5b0 2024-04-02T07:34:53.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd23e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd240af920 0x7efd24139fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.798 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd23e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd240af920 0x7efd24139fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46714/0 (socket says 172.21.15.55:46714) 2024-04-02T07:34:53.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd23e00640 1 -- 172.21.15.55:0/1438494498 learned_addr learned my addr 172.21.15.55:0/1438494498 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:53.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd1be00640 1 --2- 172.21.15.55:0/1438494498 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd240cb5b0 0x7efd2414bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.794+0000 7efd28c00640 1 --2- 172.21.15.55:0/1438494498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd2415aa40 0x7efd2414da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.798+0000 7efd23e00640 1 -- 172.21.15.55:0/1438494498 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd240cb5b0 msgr2=0x7efd2414bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.798+0000 7efd23e00640 1 --2- 172.21.15.55:0/1438494498 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd240cb5b0 0x7efd2414bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.798+0000 7efd23e00640 1 -- 172.21.15.55:0/1438494498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd2415aa40 msgr2=0x7efd2414da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.798+0000 7efd23e00640 1 --2- 172.21.15.55:0/1438494498 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd2415aa40 0x7efd2414da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.798+0000 7efd23e00640 1 -- 172.21.15.55:0/1438494498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd1c009a70 con 0x7efd240af920 2024-04-02T07:34:53.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.798+0000 7efd23e00640 1 --2- 172.21.15.55:0/1438494498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd240af920 0x7efd24139fd0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7efd1400c480 tx=0x7efd1400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:53.799 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.798+0000 7efd20c00640 1 -- 172.21.15.55:0/1438494498 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd140074e0 con 0x7efd240af920 2024-04-02T07:34:53.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.798+0000 7efd20c00640 1 -- 172.21.15.55:0/1438494498 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd14007660 con 0x7efd240af920 2024-04-02T07:34:53.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.798+0000 7efd20c00640 1 -- 172.21.15.55:0/1438494498 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd14004a30 con 0x7efd240af920 2024-04-02T07:34:53.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.798+0000 7efd2ac00640 1 -- 172.21.15.55:0/1438494498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd2414efc0 con 0x7efd240af920 2024-04-02T07:34:53.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.798+0000 7efd2ac00640 1 -- 172.21.15.55:0/1438494498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd2413a510 con 0x7efd240af920 2024-04-02T07:34:53.800 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.798+0000 7efd2ac00640 1 -- 172.21.15.55:0/1438494498 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7efd241490b0 con 0x7efd240af920 2024-04-02T07:34:53.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.798+0000 7efd20c00640 1 -- 172.21.15.55:0/1438494498 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7efd14004b90 con 0x7efd240af920 2024-04-02T07:34:53.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.798+0000 7efd20c00640 1 --2- 172.21.15.55:0/1438494498 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efd000666c0 0x7efd00068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.798+0000 7efd20c00640 1 -- 172.21.15.55:0/1438494498 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7efd140830d0 con 0x7efd240af920 2024-04-02T07:34:53.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.798+0000 7efd20c00640 1 --2- 172.21.15.55:0/1438494498 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x7efd0006c660 0x7efd0006ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.798+0000 7efd20c00640 1 -- 172.21.15.55:0/1438494498 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7efd0006f130 con 0x7efd0006c660 2024-04-02T07:34:53.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.798+0000 7efd20c00640 1 -- 172.21.15.55:0/1438494498 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=123) v2 ==== 24+0+0 (secure 0 0 0) 0x7efd140856b0 con 0x7efd240af920 2024-04-02T07:34:53.802 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.798+0000 7efd1be00640 1 --2- 172.21.15.55:0/1438494498 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efd000666c0 0x7efd00068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.802+0000 7efd28c00640 1 --2- 172.21.15.55:0/1438494498 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x7efd0006c660 0x7efd0006ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.802+0000 7efd1be00640 1 --2- 172.21.15.55:0/1438494498 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efd000666c0 0x7efd00068b80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efd241f8960 tx=0x7efd0c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:53.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.802+0000 7efd28c00640 1 --2- 172.21.15.55:0/1438494498 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x7efd0006c660 0x7efd0006ea80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:53.803 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.802+0000 7efd20c00640 1 -- 172.21.15.55:0/1438494498 <== osd.7 v2:172.21.15.106:6824/27679 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25254 (crc 0 0 0) 0x7efd0006f130 con 0x7efd0006c660 2024-04-02T07:34:53.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.814+0000 7efd2ac00640 1 -- 172.21.15.55:0/1438494498 --> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7efd2414c2c0 con 0x7efd0006c660 2024-04-02T07:34:53.814 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.814+0000 7efd20c00640 1 -- 172.21.15.55:0/1438494498 <== osd.7 v2:172.21.15.106:6824/27679 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (crc 0 0 0) 0x7efd2414c2c0 con 0x7efd0006c660 2024-04-02T07:34:53.815 INFO:teuthology.orchestra.run.smithi055.stdout:{ 2024-04-02T07:34:53.815 INFO:teuthology.orchestra.run.smithi055.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-02T07:34:53.815 INFO:teuthology.orchestra.run.smithi055.stdout:} 2024-04-02T07:34:53.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.814+0000 7efd2ac00640 1 -- 172.21.15.55:0/1438494498 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x7efd0006c660 msgr2=0x7efd0006ea80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.814+0000 7efd2ac00640 1 --2- 172.21.15.55:0/1438494498 >> [v2:172.21.15.106:6824/27679,v1:172.21.15.106:6825/27679] conn(0x7efd0006c660 0x7efd0006ea80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.814+0000 7efd2ac00640 1 -- 172.21.15.55:0/1438494498 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efd000666c0 msgr2=0x7efd00068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.814+0000 7efd2ac00640 1 --2- 172.21.15.55:0/1438494498 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efd000666c0 0x7efd00068b80 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7efd241f8960 tx=0x7efd0c008040 comp rx=0 tx=0).stop 2024-04-02T07:34:53.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.814+0000 7efd2ac00640 1 -- 172.21.15.55:0/1438494498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd240af920 msgr2=0x7efd24139fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.814+0000 7efd2ac00640 1 --2- 172.21.15.55:0/1438494498 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd240af920 0x7efd24139fd0 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7efd1400c480 tx=0x7efd1400c940 comp rx=0 tx=0).stop 2024-04-02T07:34:53.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.814+0000 7efd28c00640 1 -- 172.21.15.55:0/1438494498 reap_dead start 2024-04-02T07:34:53.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.814+0000 7efd2ac00640 1 -- 172.21.15.55:0/1438494498 shutdown_connections 2024-04-02T07:34:53.816 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.814+0000 7efd2ac00640 1 -- 172.21.15.55:0/1438494498 >> 172.21.15.55:0/1438494498 conn(0x7efd24069d90 msgr2=0x7efd240cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:53.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.814+0000 7efd2ac00640 1 -- 172.21.15.55:0/1438494498 shutdown_connections 2024-04-02T07:34:53.817 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.814+0000 7efd2ac00640 1 -- 172.21.15.55:0/1438494498 wait complete. 2024-04-02T07:34:53.834 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-02T07:34:53.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.974+0000 7fb68ce00640 1 Processor -- start 2024-04-02T07:34:53.974 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.974+0000 7fb68ce00640 1 -- start start 2024-04-02T07:34:53.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.974+0000 7fb68ce00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb6880cb5b0 0x7fb68806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.974+0000 7fb68ce00640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6880c9ff0 con 0x7fb6880af920 2024-04-02T07:34:53.975 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.974+0000 7fb68ce00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6880c93e0 con 0x7fb68815aad0 2024-04-02T07:34:53.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.974+0000 7fb68ce00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6880c96c0 con 0x7fb6880cb5b0 2024-04-02T07:34:53.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.974+0000 7fb686800640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb6880af920 0x7fb68806cf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41304/0 (socket says 172.21.15.55:41304) 2024-04-02T07:34:53.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.974+0000 7fb686800640 1 -- 172.21.15.55:0/557663467 learned_addr learned my addr 172.21.15.55:0/557663467 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:53.976 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.978+0000 7fb67fe00640 1 --2- 172.21.15.55:0/557663467 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb6880cb5b0 0x7fb68806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.978+0000 7fb685400640 1 -- 172.21.15.55:0/557663467 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1613696651 0 0) 0x7fb6880c9ff0 con 0x7fb6880af920 2024-04-02T07:34:53.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.978+0000 7fb685400640 1 -- 172.21.15.55:0/557663467 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb66c003530 con 0x7fb6880af920 2024-04-02T07:34:53.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.978+0000 7fb685400640 1 -- 172.21.15.55:0/557663467 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1609317912 0 0) 0x7fb6880c93e0 con 0x7fb68815aad0 2024-04-02T07:34:53.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.978+0000 7fb685400640 1 -- 172.21.15.55:0/557663467 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6880c9ff0 con 0x7fb68815aad0 2024-04-02T07:34:53.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.978+0000 7fb67fe00640 1 -- 172.21.15.55:0/557663467 >> v1:172.21.15.106:6789/0 conn(0x7fb68815aad0 legacy=0x7fb6880caea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.978+0000 7fb67fe00640 1 -- 172.21.15.55:0/557663467 >> v1:172.21.15.55:6789/0 conn(0x7fb6880af920 legacy=0x7fb68806cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.977 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.978+0000 7fb67fe00640 1 -- 172.21.15.55:0/557663467 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6880c99a0 con 0x7fb6880cb5b0 2024-04-02T07:34:53.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.978+0000 7fb67fe00640 1 --2- 172.21.15.55:0/557663467 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb6880cb5b0 0x7fb68806ca00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb6700097f0 tx=0x7fb68806de60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e81a2154f69fe1c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:53.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.978+0000 7fb685400640 1 -- 172.21.15.55:0/557663467 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6700ab640 con 0x7fb6880cb5b0 2024-04-02T07:34:53.979 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.978+0000 7fb685400640 1 -- 172.21.15.55:0/557663467 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6700a7070 con 0x7fb6880cb5b0 2024-04-02T07:34:53.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.978+0000 7fb685400640 1 -- 172.21.15.55:0/557663467 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6700ab9c0 con 0x7fb6880cb5b0 2024-04-02T07:34:53.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb68ce00640 1 -- 172.21.15.55:0/557663467 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb6880cb5b0 msgr2=0x7fb68806ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.980 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb68ce00640 1 --2- 172.21.15.55:0/557663467 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb6880cb5b0 0x7fb68806ca00 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb6700097f0 tx=0x7fb68806de60 comp rx=0 tx=0).stop 2024-04-02T07:34:53.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb68ce00640 1 -- 172.21.15.55:0/557663467 shutdown_connections 2024-04-02T07:34:53.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb68ce00640 1 --2- 172.21.15.55:0/557663467 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb6880cb5b0 0x7fb68806ca00 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb68ce00640 1 -- 172.21.15.55:0/557663467 >> 172.21.15.55:0/557663467 conn(0x7fb688069d90 msgr2=0x7fb68806a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:53.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb68ce00640 1 -- 172.21.15.55:0/557663467 shutdown_connections 2024-04-02T07:34:53.981 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb68ce00640 1 -- 172.21.15.55:0/557663467 wait complete. 2024-04-02T07:34:53.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb68ce00640 1 Processor -- start 2024-04-02T07:34:53.982 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb68ce00640 1 -- start start 2024-04-02T07:34:53.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb68ce00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6880af920 0x7fb688146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb68ce00640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6880cb5b0 0x7fb6881469e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb68ce00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb68815aad0 0x7fb68806ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb68ce00640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68814c170 con 0x7fb6880af920 2024-04-02T07:34:53.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb68ce00640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68814c450 con 0x7fb6880cb5b0 2024-04-02T07:34:53.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb68ce00640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68814c730 con 0x7fb68815aad0 2024-04-02T07:34:53.984 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb685e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6880af920 0x7fb688146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb685e00640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6880af920 0x7fb688146120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46728/0 (socket says 172.21.15.55:46728) 2024-04-02T07:34:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb685e00640 1 -- 172.21.15.55:0/220935394 learned_addr learned my addr 172.21.15.55:0/220935394 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb686800640 1 --2- 172.21.15.55:0/220935394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb68815aad0 0x7fb68806ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb685e00640 1 -- 172.21.15.55:0/220935394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb68815aad0 msgr2=0x7fb68806ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb67fe00640 1 --2- 172.21.15.55:0/220935394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6880cb5b0 0x7fb6881469e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb685e00640 1 --2- 172.21.15.55:0/220935394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb68815aad0 0x7fb68806ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb685e00640 1 -- 172.21.15.55:0/220935394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6880cb5b0 msgr2=0x7fb6881469e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb685e00640 1 --2- 172.21.15.55:0/220935394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6880cb5b0 0x7fb6881469e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb685e00640 1 -- 172.21.15.55:0/220935394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb670009420 con 0x7fb6880af920 2024-04-02T07:34:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb67fe00640 1 --2- 172.21.15.55:0/220935394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6880cb5b0 0x7fb6881469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.982+0000 7fb686800640 1 --2- 172.21.15.55:0/220935394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb68815aad0 0x7fb68806ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:34:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.986+0000 7fb685e00640 1 --2- 172.21.15.55:0/220935394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6880af920 0x7fb688146120 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fb67800c430 tx=0x7fb67800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.986+0000 7fb67e000640 1 -- 172.21.15.55:0/220935394 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6780052d0 con 0x7fb6880af920 2024-04-02T07:34:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.986+0000 7fb67e000640 1 -- 172.21.15.55:0/220935394 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb678005450 con 0x7fb6880af920 2024-04-02T07:34:53.985 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.986+0000 7fb68ce00640 1 -- 172.21.15.55:0/220935394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb68814ca10 con 0x7fb6880af920 2024-04-02T07:34:53.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.986+0000 7fb67e000640 1 -- 172.21.15.55:0/220935394 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb678003840 con 0x7fb6880af920 2024-04-02T07:34:53.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.986+0000 7fb68ce00640 1 -- 172.21.15.55:0/220935394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb688146830 con 0x7fb6880af920 2024-04-02T07:34:53.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.986+0000 7fb68ce00640 1 -- 172.21.15.55:0/220935394 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb68806e240 con 0x7fb6880af920 2024-04-02T07:34:53.986 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.986+0000 7fb67e000640 1 -- 172.21.15.55:0/220935394 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fb6780039a0 con 0x7fb6880af920 2024-04-02T07:34:53.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.986+0000 7fb67e000640 1 --2- 172.21.15.55:0/220935394 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb664066690 0x7fb664068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:53.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.986+0000 7fb67e000640 1 -- 172.21.15.55:0/220935394 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fb6780835a0 con 0x7fb6880af920 2024-04-02T07:34:53.987 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.986+0000 7fb67fe00640 1 --2- 172.21.15.55:0/220935394 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb664066690 0x7fb664068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:53.988 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.990+0000 7fb67fe00640 1 --2- 172.21.15.55:0/220935394 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb664066690 0x7fb664068b50 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fb6700af000 tx=0x7fb670008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:53.991 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:53.990+0000 7fb67e000640 1 -- 172.21.15.55:0/220935394 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fb678050b50 con 0x7fb6880af920 2024-04-02T07:34:54.151 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.150+0000 7fb68ce00640 1 -- 172.21.15.55:0/220935394 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fb688066c90 con 0x7fb664066690 2024-04-02T07:34:54.152 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.154+0000 7fb67e000640 1 -- 172.21.15.55:0/220935394 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fb688066c90 con 0x7fb664066690 2024-04-02T07:34:54.152 INFO:teuthology.orchestra.run.smithi055.stderr:instructed osd(s) 7 to deep-scrub 2024-04-02T07:34:54.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.154+0000 7fb68ce00640 1 -- 172.21.15.55:0/220935394 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb664066690 msgr2=0x7fb664068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:54.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.154+0000 7fb68ce00640 1 --2- 172.21.15.55:0/220935394 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb664066690 0x7fb664068b50 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fb6700af000 tx=0x7fb670008040 comp rx=0 tx=0).stop 2024-04-02T07:34:54.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.154+0000 7fb68ce00640 1 -- 172.21.15.55:0/220935394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6880af920 msgr2=0x7fb688146120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:54.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.154+0000 7fb68ce00640 1 --2- 172.21.15.55:0/220935394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6880af920 0x7fb688146120 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7fb67800c430 tx=0x7fb67800c8f0 comp rx=0 tx=0).stop 2024-04-02T07:34:54.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.154+0000 7fb68ce00640 1 -- 172.21.15.55:0/220935394 shutdown_connections 2024-04-02T07:34:54.154 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.154+0000 7fb68ce00640 1 --2- 172.21.15.55:0/220935394 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fb68815aad0 0x7fb68806ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.154+0000 7fb68ce00640 1 --2- 172.21.15.55:0/220935394 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fb664066690 0x7fb664068b50 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.154+0000 7fb68ce00640 1 --2- 172.21.15.55:0/220935394 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fb6880cb5b0 0x7fb6881469e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.154+0000 7fb68ce00640 1 --2- 172.21.15.55:0/220935394 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6880af920 0x7fb688146120 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.154+0000 7fb68ce00640 1 -- 172.21.15.55:0/220935394 >> 172.21.15.55:0/220935394 conn(0x7fb688069d90 msgr2=0x7fb6880b1860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.154+0000 7fb68ce00640 1 -- 172.21.15.55:0/220935394 shutdown_connections 2024-04-02T07:34:54.155 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.154+0000 7fb68ce00640 1 -- 172.21.15.55:0/220935394 wait complete. 2024-04-02T07:34:54.172 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:34:54.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.314+0000 7f5ec7400640 1 Processor -- start 2024-04-02T07:34:54.313 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.314+0000 7f5ec7400640 1 -- start start 2024-04-02T07:34:54.314 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.314+0000 7f5ec7400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec015ee70 0x7f5ec0099830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:54.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.314+0000 7f5ec7400640 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec00ad270 con 0x7f5ec015f250 2024-04-02T07:34:54.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.314+0000 7f5ec7400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ec00b0a50 con 0x7f5ec0099120 2024-04-02T07:34:54.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.314+0000 7f5ec7400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00b0840 con 0x7f5ec015ee70 2024-04-02T07:34:54.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.314+0000 7f5eb7e00640 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5ec015f250 0x7f5ec0098a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41316/0 (socket says 172.21.15.55:41316) 2024-04-02T07:34:54.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.314+0000 7f5eb7e00640 1 -- 172.21.15.55:0/2018488727 learned_addr learned my addr 172.21.15.55:0/2018488727 (peer_addr_for_me v1:172.21.15.55:0/0) 2024-04-02T07:34:54.315 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.314+0000 7f5ec4a00640 1 --2- 172.21.15.55:0/2018488727 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec015ee70 0x7f5ec0099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:54.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.314+0000 7f5ebfe00640 1 -- 172.21.15.55:0/2018488727 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898774746 0 0) 0x7f5ec00ad270 con 0x7f5ec015f250 2024-04-02T07:34:54.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.314+0000 7f5ebfe00640 1 -- 172.21.15.55:0/2018488727 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ea4003530 con 0x7f5ec015f250 2024-04-02T07:34:54.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.314+0000 7f5ebfe00640 1 -- 172.21.15.55:0/2018488727 <== mon.1 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2366216473 0 0) 0x7f5ec00b0a50 con 0x7f5ec0099120 2024-04-02T07:34:54.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.314+0000 7f5ec4a00640 1 -- 172.21.15.55:0/2018488727 >> v1:172.21.15.106:6789/0 conn(0x7f5ec0099120 legacy=0x7f5ec00ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:54.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.314+0000 7f5ec4a00640 1 -- 172.21.15.55:0/2018488727 >> v1:172.21.15.55:6789/0 conn(0x7f5ec015f250 legacy=0x7f5ec0098a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:54.316 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.314+0000 7f5ec4a00640 1 -- 172.21.15.55:0/2018488727 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ec00b0d30 con 0x7f5ec015ee70 2024-04-02T07:34:54.318 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.318+0000 7f5ec4a00640 1 --2- 172.21.15.55:0/2018488727 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec015ee70 0x7f5ec0099830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00097f0 tx=0x7f5eb001c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6952034be9668c3f server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:54.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.318+0000 7f5ebfe00640 1 -- 172.21.15.55:0/2018488727 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb00aa5f0 con 0x7f5ec015ee70 2024-04-02T07:34:54.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.318+0000 7f5ebfe00640 1 -- 172.21.15.55:0/2018488727 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb00aa750 con 0x7f5ec015ee70 2024-04-02T07:34:54.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.318+0000 7f5ebfe00640 1 -- 172.21.15.55:0/2018488727 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb00aaae0 con 0x7f5ec015ee70 2024-04-02T07:34:54.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.318+0000 7f5ec7400640 1 -- 172.21.15.55:0/2018488727 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec015ee70 msgr2=0x7f5ec0099830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:54.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.318+0000 7f5ec7400640 1 --2- 172.21.15.55:0/2018488727 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec015ee70 0x7f5ec0099830 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00097f0 tx=0x7f5eb001c4b0 comp rx=0 tx=0).stop 2024-04-02T07:34:54.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.318+0000 7f5ec7400640 1 -- 172.21.15.55:0/2018488727 shutdown_connections 2024-04-02T07:34:54.319 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.318+0000 7f5ec7400640 1 --2- 172.21.15.55:0/2018488727 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec015ee70 0x7f5ec0099830 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:54.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.318+0000 7f5ec7400640 1 -- 172.21.15.55:0/2018488727 >> 172.21.15.55:0/2018488727 conn(0x7f5ec00b21d0 msgr2=0x7f5ec00b25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:54.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.318+0000 7f5ec7400640 1 -- 172.21.15.55:0/2018488727 shutdown_connections 2024-04-02T07:34:54.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.318+0000 7f5ec7400640 1 -- 172.21.15.55:0/2018488727 wait complete. 2024-04-02T07:34:54.320 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ec7400640 1 Processor -- start 2024-04-02T07:34:54.321 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ec7400640 1 -- start start 2024-04-02T07:34:54.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ec7400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ec0099120 0x7f5ec01f8120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:54.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ec7400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec015ee70 0x7f5ec0155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:54.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ec7400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ec015f250 0x7f5ec0157b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:54.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ec7400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00b5050 con 0x7f5ec015f250 2024-04-02T07:34:54.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ec7400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00b4720 con 0x7f5ec0099120 2024-04-02T07:34:54.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ec7400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ec00b4a00 con 0x7f5ec015ee70 2024-04-02T07:34:54.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ec5400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ec015f250 0x7f5ec0157b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:54.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ec5400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ec015f250 0x7f5ec0157b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46734/0 (socket says 172.21.15.55:46734) 2024-04-02T07:34:54.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ec5400640 1 -- 172.21.15.55:0/764126748 learned_addr learned my addr 172.21.15.55:0/764126748 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:34:54.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ec4a00640 1 --2- 172.21.15.55:0/764126748 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ec0099120 0x7f5ec01f8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:54.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5eb7e00640 1 --2- 172.21.15.55:0/764126748 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec015ee70 0x7f5ec0155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:54.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ec5400640 1 -- 172.21.15.55:0/764126748 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec015ee70 msgr2=0x7f5ec0155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:54.323 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ec5400640 1 --2- 172.21.15.55:0/764126748 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec015ee70 0x7f5ec0155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:54.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ec5400640 1 -- 172.21.15.55:0/764126748 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ec0099120 msgr2=0x7f5ec01f8120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:54.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ec5400640 1 --2- 172.21.15.55:0/764126748 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ec0099120 0x7f5ec01f8120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:54.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ec5400640 1 -- 172.21.15.55:0/764126748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb0009420 con 0x7f5ec015f250 2024-04-02T07:34:54.324 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ec5400640 1 --2- 172.21.15.55:0/764126748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ec015f250 0x7f5ec0157b90 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800c6d0 tx=0x7f5eb800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:54.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ebd600640 1 -- 172.21.15.55:0/764126748 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb8003b80 con 0x7f5ec015f250 2024-04-02T07:34:54.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ebd600640 1 -- 172.21.15.55:0/764126748 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb8003ce0 con 0x7f5ec015f250 2024-04-02T07:34:54.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ec7400640 1 -- 172.21.15.55:0/764126748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ec00b4ce0 con 0x7f5ec015f250 2024-04-02T07:34:54.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ebd600640 1 -- 172.21.15.55:0/764126748 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb80052b0 con 0x7f5ec015f250 2024-04-02T07:34:54.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.322+0000 7f5ec7400640 1 -- 172.21.15.55:0/764126748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ec00b43d0 con 0x7f5ec015f250 2024-04-02T07:34:54.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.326+0000 7f5ec7400640 1 -- 172.21.15.55:0/764126748 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ec00b51c0 con 0x7f5ec015f250 2024-04-02T07:34:54.325 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.326+0000 7f5ebd600640 1 -- 172.21.15.55:0/764126748 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7f5eb8005620 con 0x7f5ec015f250 2024-04-02T07:34:54.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.326+0000 7f5ebd600640 1 --2- 172.21.15.55:0/764126748 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e9c066690 0x7f5e9c068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:34:54.326 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.326+0000 7f5ebd600640 1 -- 172.21.15.55:0/764126748 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7f5eb8083920 con 0x7f5ec015f250 2024-04-02T07:34:54.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.326+0000 7f5ec4a00640 1 --2- 172.21.15.55:0/764126748 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e9c066690 0x7f5e9c068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:34:54.327 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.326+0000 7f5ec4a00640 1 --2- 172.21.15.55:0/764126748 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e9c066690 0x7f5e9c068b50 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00ae000 tx=0x7f5eb00a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:34:54.330 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.330+0000 7f5ebd600640 1 -- 172.21.15.55:0/764126748 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7f5eb8050ef0 con 0x7f5ec015f250 2024-04-02T07:34:54.490 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.486+0000 7f5ec7400640 1 -- 172.21.15.55:0/764126748 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5ec0066c90 con 0x7f5e9c066690 2024-04-02T07:34:54.491 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.490+0000 7f5ebd600640 1 -- 172.21.15.55:0/764126748 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50543 (secure 0 0 0) 0x7f5ec0066c90 con 0x7f5e9c066690 2024-04-02T07:34:54.492 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:34:54.494 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:34:54.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.490+0000 7f5ec7400640 1 -- 172.21.15.55:0/764126748 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e9c066690 msgr2=0x7f5e9c068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:54.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.490+0000 7f5ec7400640 1 --2- 172.21.15.55:0/764126748 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e9c066690 0x7f5e9c068b50 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00ae000 tx=0x7f5eb00a7000 comp rx=0 tx=0).stop 2024-04-02T07:34:54.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.490+0000 7f5ec7400640 1 -- 172.21.15.55:0/764126748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ec015f250 msgr2=0x7f5ec0157b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:34:54.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.490+0000 7f5ec7400640 1 --2- 172.21.15.55:0/764126748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ec015f250 0x7f5ec0157b90 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f5eb800c6d0 tx=0x7f5eb800cb90 comp rx=0 tx=0).stop 2024-04-02T07:34:54.494 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.490+0000 7f5ec7400640 1 -- 172.21.15.55:0/764126748 shutdown_connections 2024-04-02T07:34:54.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.490+0000 7f5ec7400640 1 --2- 172.21.15.55:0/764126748 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5ec015f250 0x7f5ec0157b90 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:54.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.490+0000 7f5ec7400640 1 --2- 172.21.15.55:0/764126748 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7f5ec015ee70 0x7f5ec0155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:54.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.490+0000 7f5ec7400640 1 --2- 172.21.15.55:0/764126748 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7f5e9c066690 0x7f5e9c068b50 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:54.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.490+0000 7f5ec7400640 1 --2- 172.21.15.55:0/764126748 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7f5ec0099120 0x7f5ec01f8120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:34:54.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.490+0000 7f5ec7400640 1 -- 172.21.15.55:0/764126748 >> 172.21.15.55:0/764126748 conn(0x7f5ec00b21d0 msgr2=0x7f5ec006c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:34:54.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.490+0000 7f5ec7400640 1 -- 172.21.15.55:0/764126748 shutdown_connections 2024-04-02T07:34:54.495 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:34:54.490+0000 7f5ec7400640 1 -- 172.21.15.55:0/764126748 wait complete. 2024-04-02T07:34:54.510 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":499,"stamp":"2024-04-02T07:34:52.526942+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262112,"kb_used_data":13160,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754712608,"statfs":{"total":773094113280,"available":772825710592,"internally_reserved":0,"allocated":13475840,"data_stored":6534064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8390727,"num_objects":-30,"num_object_clones":0,"num_object_copies":-60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-30,"num_whiteouts":0,"num_read":-258,"num_read_kb":-264,"num_write":-175,"num_write_kb":-8295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001828"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":257,"reported_epoch":122,"state":"active+clean","last_fresh":"2024-04-02T07:34:45.593344+0000","last_change":"2024-04-02T07:22:07.790210+0000","last_active":"2024-04-02T07:34:45.593344+0000","last_peered":"2024-04-02T07:34:45.593344+0000","last_clean":"2024-04-02T07:34:45.593344+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:34:45.593344+0000","last_undegraded":"2024-04-02T07:34:45.593344+0000","last_fullsized":"2024-04-02T07:34:45.593344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-02T07:22:06.666121+0000","last_clean_scrub_stamp":"2024-04-02T07:22:06.666121+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T13:19:22.838715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575003,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33204,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338636,"statfs":{"total":96636764160,"available":96602763264,"internally_reserved":0,"allocated":2129920,"data_stored":1259534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68799999999999994,"15min":0.66600000000000004},"min":{"1min":0.51900000000000002,"5min":0.39400000000000002,"15min":0.35299999999999998},"max":{"1min":0.86899999999999999,"5min":0.92400000000000004,"15min":1.0569999999999999},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67800000000000005,"15min":0.65000000000000002},"min":{"1min":0.52000000000000002,"5min":0.442,"15min":0.39900000000000002},"max":{"1min":0.93100000000000005,"5min":1.018,"15min":1.018},"last":0.58299999999999996}]},{"osd":1,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.88200000000000001,"5min":1.004,"15min":1.0289999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69899999999999995,"15min":0.68100000000000005},"min":{"1min":0.54500000000000004,"5min":0.46899999999999997,"15min":0.39500000000000002},"max":{"1min":0.85599999999999998,"5min":0.99299999999999999,"15min":1.113},"last":0.55500000000000005}]},{"osd":2,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.749,"15min":0.752},"min":{"1min":0.61199999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98999999999999999,"5min":1.0309999999999999,"15min":1.139},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.752,"15min":0.73299999999999998},"min":{"1min":0.56699999999999995,"5min":0.503,"15min":0.437},"max":{"1min":0.97399999999999998,"5min":1.0549999999999999,"15min":1.522},"last":0.71399999999999997}]},{"osd":3,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71299999999999997,"15min":0.70599999999999996},"min":{"1min":0.53400000000000003,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.87,"5min":1.0409999999999999,"15min":1.405},"last":0.626},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.72899999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.48599999999999999},"max":{"1min":0.95399999999999996,"5min":1.0329999999999999,"15min":1.0580000000000001},"last":0.78200000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.58499999999999996,"15min":0.625},"min":{"1min":0.39400000000000002,"5min":0.37,"15min":0.34399999999999997},"max":{"1min":0.998,"5min":0.998,"15min":1.633},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.66900000000000004,"15min":0.69399999999999995},"min":{"1min":0.46000000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92900000000000005,"5min":0.94299999999999995,"15min":1.079},"last":0.67900000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.67200000000000004},"min":{"1min":0.441,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88800000000000001,"5min":0.995,"15min":1.2250000000000001},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.71699999999999997,"15min":0.73599999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.43099999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.5609999999999999},"last":0.76800000000000002}]},{"osd":6,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.49299999999999999,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.5960000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.66900000000000004,"15min":0.67600000000000005},"min":{"1min":0.41499999999999998,"5min":0.41399999999999998,"15min":0.40699999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0840000000000001},"last":0.753}]}]},{"osd":6,"up_from":13,"seq":55834575004,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72199999999999998,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.45600000000000002,"15min":0.41399999999999998},"max":{"1min":1.002,"5min":1.147,"15min":1.399},"last":0.95799999999999996},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72699999999999998,"15min":0.76700000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":5.7569999999999997},"last":0.81999999999999995}]},{"osd":1,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.74199999999999999,"15min":0.72299999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.38200000000000001},"max":{"1min":0.96499999999999997,"5min":1.097,"15min":1.95},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.74199999999999999,"15min":0.73099999999999998},"min":{"1min":0.58899999999999997,"5min":0.51400000000000001,"15min":0.47599999999999998},"max":{"1min":0.93600000000000005,"5min":1.0449999999999999,"15min":1.248},"last":0.89300000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72799999999999998,"15min":0.70199999999999996},"min":{"1min":0.53000000000000003,"5min":0.51700000000000002,"15min":0.45000000000000001},"max":{"1min":0.95499999999999996,"5min":0.97699999999999998,"15min":1.226},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.755,"15min":0.73099999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92200000000000004,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.79500000000000004}]},{"osd":3,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.63600000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91600000000000004,"5min":1.006,"15min":2.3119999999999998},"last":0.85599999999999998},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.51900000000000002,"5min":0.49299999999999999,"15min":0.47699999999999998},"max":{"1min":0.996,"5min":1.0660000000000001,"15min":2.6389999999999998},"last":0.83999999999999997}]},{"osd":4,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.40100000000000002,"5min":0.39600000000000002,"15min":0.34999999999999998},"max":{"1min":0.89500000000000002,"5min":1.236,"15min":1.236},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63500000000000001,"15min":0.64300000000000002},"min":{"1min":0.49199999999999999,"5min":0.437,"15min":0.38500000000000001},"max":{"1min":0.93799999999999994,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.70699999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.61599999999999999,"15min":0.63300000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.37},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.95999999999999996},"last":0.871},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.52600000000000002,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":0.90100000000000002,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.90800000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.57699999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.86699999999999999,"5min":3.3290000000000002,"15min":3.3290000000000002},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68000000000000005,"15min":0.70599999999999996},"min":{"1min":0.52000000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98299999999999998,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.68899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67800000000000005,"15min":0.66800000000000004},"min":{"1min":0.55100000000000005,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.94899999999999995,"5min":0.995,"15min":1.25},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.52600000000000002,"5min":0.42399999999999999,"15min":0.33000000000000002},"max":{"1min":0.91800000000000004,"5min":0.96599999999999997,"15min":1.5289999999999999},"last":0.54600000000000004}]},{"osd":1,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72599999999999998,"15min":0.71399999999999997},"min":{"1min":0.51800000000000002,"5min":0.45900000000000002,"15min":0.371},"max":{"1min":0.91500000000000004,"5min":0.995,"15min":1.1830000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.56399999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85599999999999998,"5min":1.0069999999999999,"15min":1.3420000000000001},"last":0.69399999999999995}]},{"osd":2,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76300000000000001,"15min":0.78500000000000003},"min":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.44900000000000001},"max":{"1min":0.878,"5min":1.0129999999999999,"15min":1.8280000000000001},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.40999999999999998,"15min":0.39700000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.696},"last":0.61599999999999999}]},{"osd":3,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.74099999999999999},"min":{"1min":0.57199999999999995,"5min":0.498,"15min":0.40899999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.6399999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.74399999999999999,"15min":0.76600000000000001},"min":{"1min":0.56799999999999995,"5min":0.51800000000000002,"15min":0.46800000000000003},"max":{"1min":0.84399999999999997,"5min":1.01,"15min":2.0219999999999998},"last":0.745}]},{"osd":4,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.58899999999999997,"15min":0.625},"min":{"1min":0.44900000000000001,"5min":0.36899999999999999,"15min":0.32500000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.911},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61399999999999999,"15min":0.67300000000000004},"min":{"1min":0.42999999999999999,"5min":0.38500000000000001,"15min":0.307},"max":{"1min":0.99199999999999999,"5min":1.0649999999999999,"15min":1.7829999999999999},"last":0.64500000000000002}]},{"osd":6,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63800000000000001,"15min":0.71199999999999997},"min":{"1min":0.44700000000000001,"5min":0.439,"15min":0.39600000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":2.1829999999999998},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65500000000000003,"15min":0.70999999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.36499999999999999},"max":{"1min":0.996,"5min":1.1359999999999999,"15min":2.1280000000000001},"last":0.77200000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68400000000000005,"15min":0.745},"min":{"1min":0.47799999999999998,"5min":0.435,"15min":0.38300000000000001},"max":{"1min":1.107,"5min":1.1319999999999999,"15min":1.887},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70699999999999996,"15min":0.77600000000000002},"min":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.439},"max":{"1min":0.89400000000000002,"5min":1.056,"15min":2.2599999999999998},"last":0.84599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834575006,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.67500000000000004,"15min":0.69599999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77000000000000002,"5min":0.93400000000000005,"15min":2.4929999999999999},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.67100000000000004,"15min":0.72199999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83699999999999997,"5min":0.94799999999999995,"15min":3.2519999999999998},"last":0.61199999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.94099999999999995,"5min":0.96999999999999997,"15min":1.4279999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69899999999999995,"15min":0.77100000000000002},"min":{"1min":0.46899999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79100000000000004,"5min":1.0069999999999999,"15min":4.3810000000000002},"last":0.63700000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.72699999999999998,"15min":0.75},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82499999999999996,"5min":1.1990000000000001,"15min":2.056},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.70899999999999996,"15min":0.76900000000000002},"min":{"1min":0.496,"5min":0.436,"15min":0.436},"max":{"1min":0.88500000000000001,"5min":1.038,"15min":3.3420000000000001},"last":0.58899999999999997}]},{"osd":3,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.75,"15min":0.83099999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.436},"max":{"1min":0.92300000000000004,"5min":1.091,"15min":3.9180000000000001},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.76200000000000001,"15min":0.84199999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93200000000000005,"5min":1.1279999999999999,"15min":3.9750000000000001},"last":0.67900000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59199999999999997,"15min":0.63700000000000001},"min":{"1min":0.39300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.91100000000000003,"5min":1.1120000000000001,"15min":1.2509999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59699999999999998,"15min":0.65800000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.36699999999999999},"max":{"1min":0.92300000000000004,"5min":0.98199999999999998,"15min":1.4419999999999999},"last":0.71499999999999997}]},{"osd":6,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.65300000000000002},"min":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.33400000000000002},"max":{"1min":0.82799999999999996,"5min":1.0760000000000001,"15min":1.2949999999999999},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67700000000000005,"15min":0.71299999999999997},"min":{"1min":0.503,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86299999999999999,"5min":1.2529999999999999,"15min":1.3069999999999999},"last":0.75800000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68100000000000005,"15min":0.73099999999999998},"min":{"1min":0.46100000000000002,"5min":0.434,"15min":0.432},"max":{"1min":1.0129999999999999,"5min":1.034,"15min":1.2689999999999999},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77200000000000002,"15min":0.80700000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.2949999999999999,"15min":1.353},"last":0.72699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834575004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45300000000000001,"15min":0.44600000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26300000000000001},"max":{"1min":0.54900000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.48099999999999998,"15min":0.48199999999999998},"min":{"1min":0.308,"5min":0.30399999999999999,"15min":0.28699999999999998},"max":{"1min":0.56799999999999995,"5min":0.68000000000000005,"15min":1.0109999999999999},"last":0.65300000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46500000000000002,"15min":0.45100000000000001},"min":{"1min":0.29499999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71099999999999997,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69899999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.52100000000000002}]},{"osd":2,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80900000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.41699999999999998,"5min":0.35399999999999998,"15min":0.33400000000000002},"max":{"1min":0.77900000000000003,"5min":0.82099999999999995,"15min":1.306},"last":0.59399999999999997}]},{"osd":4,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75600000000000001,"15min":0.74299999999999999},"min":{"1min":0.50600000000000001,"5min":0.45800000000000002,"15min":0.40500000000000003},"max":{"1min":1.099,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.625},{"interface":"front","average":{"1min":0.754,"5min":0.78600000000000003,"15min":0.76100000000000001},"min":{"1min":0.57899999999999996,"5min":0.52700000000000002,"15min":0.46500000000000002},"max":{"1min":1.0169999999999999,"5min":1.306,"15min":1.306},"last":0.70499999999999996}]},{"osd":5,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78600000000000003,"15min":0.77800000000000002},"min":{"1min":0.56000000000000005,"5min":0.502,"15min":0.501},"max":{"1min":1.123,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78300000000000003,"15min":0.76100000000000001},"min":{"1min":0.51500000000000001,"5min":0.48999999999999999,"15min":0.48899999999999999},"max":{"1min":1.0820000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.66000000000000003}]},{"osd":6,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77900000000000003,"15min":0.76500000000000001},"min":{"1min":0.498,"5min":0.49399999999999999,"15min":0.44500000000000001},"max":{"1min":1.1950000000000001,"5min":1.258,"15min":1.258},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.79300000000000004},"min":{"1min":0.58999999999999997,"5min":0.55800000000000005,"15min":0.52000000000000002},"max":{"1min":1.0669999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.67700000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.80000000000000004,"15min":0.76900000000000002},"min":{"1min":0.54900000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0529999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79700000000000004,"15min":0.79200000000000004},"min":{"1min":0.59199999999999997,"5min":0.53500000000000003,"15min":0.47499999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.2869999999999999},"last":0.71699999999999997}]}]},{"osd":2,"up_from":13,"seq":55834575004,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47099999999999997,"15min":0.45200000000000001},"min":{"1min":0.308,"5min":0.25800000000000001,"15min":0.253},"max":{"1min":0.68799999999999994,"5min":0.78800000000000003,"15min":0.79100000000000004},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51200000000000001,"15min":0.495},"min":{"1min":0.32100000000000001,"5min":0.28299999999999997,"15min":0.27300000000000002},"max":{"1min":0.85899999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.39700000000000002}]},{"osd":1,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35099999999999998},"max":{"1min":0.77800000000000002,"5min":0.876,"15min":1.171},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53100000000000003,"15min":0.504},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.752,"5min":0.878,"15min":1.333},"last":0.378}]},{"osd":3,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56899999999999995,"15min":0.53500000000000003},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.32700000000000001},"max":{"1min":0.69999999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.60399999999999998,"15min":0.57899999999999996},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.35799999999999998},"max":{"1min":0.83799999999999997,"5min":0.90000000000000002,"15min":1.1140000000000001},"last":0.498}]},{"osd":4,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.58399999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98499999999999999,"5min":1.1379999999999999,"15min":2.254},"last":0.78300000000000003},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79000000000000004,"15min":0.77600000000000002},"min":{"1min":0.53100000000000003,"5min":0.498,"15min":0.42799999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.3420000000000001},"last":0.71499999999999997}]},{"osd":5,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79200000000000004,"15min":0.77300000000000002},"min":{"1min":0.60599999999999998,"5min":0.54000000000000004,"15min":0.46200000000000002},"max":{"1min":1.0620000000000001,"5min":1.1439999999999999,"15min":1.3740000000000001},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81799999999999995,"15min":0.80400000000000005},"min":{"1min":0.60599999999999998,"5min":0.57399999999999995,"15min":0.443},"max":{"1min":1.133,"5min":1.2070000000000001,"15min":2.0840000000000001},"last":0.71999999999999997}]},{"osd":6,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83199999999999996,"15min":0.82299999999999995},"min":{"1min":0.63900000000000001,"5min":0.56499999999999995,"15min":0.54600000000000004},"max":{"1min":1.1830000000000001,"5min":1.1990000000000001,"15min":1.5029999999999999},"last":0.89200000000000002},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.87,"15min":0.83999999999999997},"min":{"1min":0.71099999999999997,"5min":0.61099999999999999,"15min":0.52700000000000002},"max":{"1min":1.155,"5min":1.159,"15min":1.425},"last":0.90300000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81100000000000005,"15min":0.81399999999999995},"min":{"1min":0.66200000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0840000000000001,"5min":1.1799999999999999,"15min":2.3580000000000001},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.82899999999999996,"15min":0.82099999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.54300000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.377},"last":0.77000000000000002}]}]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.439,"15min":0.45400000000000001},"min":{"1min":0.27800000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.69999999999999996,"5min":0.77200000000000002,"15min":1.2150000000000001},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.47499999999999998,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.28799999999999998,"15min":0.26200000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":4.157},"last":0.34799999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.53700000000000003},"min":{"1min":0.312,"5min":0.30599999999999999,"15min":0.28999999999999998},"max":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":4.282},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53000000000000003,"15min":0.55200000000000005},"min":{"1min":0.376,"5min":0.37,"15min":0.33600000000000002},"max":{"1min":0.70699999999999996,"5min":0.81000000000000005,"15min":1.625},"last":0.64300000000000002}]},{"osd":3,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.38200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.76400000000000001,"5min":0.88800000000000001,"15min":1.1120000000000001},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54800000000000004,"15min":0.66600000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":8.1620000000000008},"last":0.47399999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71899999999999997,"15min":0.80700000000000005},"min":{"1min":0.436,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":4.7400000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76300000000000001,"15min":0.78500000000000003},"min":{"1min":0.55900000000000005,"5min":0.53000000000000003,"15min":0.50600000000000001},"max":{"1min":1.071,"5min":1.125,"15min":1.7070000000000001},"last":0.72199999999999998}]},{"osd":5,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.75700000000000001,"15min":0.82599999999999996},"min":{"1min":0.52000000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.302,"5min":1.321,"15min":4.5759999999999996},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.751,"15min":0.82199999999999995},"min":{"1min":0.52800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.018,"5min":1.3680000000000001,"15min":4.7949999999999999},"last":0.625}]},{"osd":6,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77700000000000002,"15min":0.84799999999999998},"min":{"1min":0.56699999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0640000000000001,"5min":1.0820000000000001,"15min":4.6890000000000001},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76500000000000001,"15min":0.83699999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.141,"5min":1.141,"15min":4.6059999999999999},"last":0.55800000000000005}]},{"osd":7,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77600000000000002,"15min":0.79600000000000004},"min":{"1min":0.54400000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1539999999999999,"5min":1.206,"15min":1.8759999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.755,"5min":0.78500000000000003,"15min":0.85399999999999998},"min":{"1min":0.53200000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":4.6420000000000003},"last":0.71099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2129920,"data_stored":1259534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42599999999999999,"15min":0.441},"min":{"1min":0.32500000000000001,"5min":0.27800000000000002,"15min":0.26300000000000001},"max":{"1min":0.621,"5min":0.621,"15min":1.48},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.497,"5min":0.5,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":0.747,"15min":1.2330000000000001},"last":0.48199999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.50700000000000001},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.29099999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.3129999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32400000000000001},"max":{"1min":0.64800000000000002,"5min":0.76700000000000002,"15min":0.82599999999999996},"last":0.623}]},{"osd":3,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28199999999999997},"max":{"1min":0.68000000000000005,"5min":0.82799999999999996,"15min":0.84799999999999998},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58399999999999996,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40300000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.4430000000000001},"last":0.60499999999999998}]},{"osd":4,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.53700000000000003,"5min":0.505,"15min":0.46200000000000002},"max":{"1min":0.98099999999999998,"5min":1.0149999999999999,"15min":1.0569999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.1240000000000001},"last":0.52300000000000002}]},{"osd":5,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.746,"15min":0.76200000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.47599999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.371},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.747,"5min":0.745,"15min":0.755},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.997,"5min":0.997,"15min":1.143},"last":0.70799999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77800000000000002,"15min":0.78600000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.52500000000000002},"max":{"1min":0.97599999999999998,"5min":1.038,"15min":1.177},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79800000000000004,"15min":0.81399999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.4099999999999999},"last":0.68999999999999995}]},{"osd":7,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75900000000000001,"15min":0.77700000000000002},"min":{"1min":0.58799999999999997,"5min":0.56100000000000005,"15min":0.54800000000000004},"max":{"1min":0.98399999999999999,"5min":1.028,"15min":1.135},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76900000000000002,"15min":0.77700000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.48399999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.58699999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:34:54.517 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-02T07:22:06.666121+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=2, tm_hour=7, tm_min=22, tm_sec=6, tm_wday=1, tm_yday=93, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=2, tm_hour=7, tm_min=34, tm_sec=48, tm_wday=1, tm_yday=93, tm_isdst=0) 2024-04-02T07:34:54.517 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-02T07:35:14.518 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-02T07:35:14.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.670+0000 7fc9d4600640 1 Processor -- start 2024-04-02T07:35:14.671 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.670+0000 7fc9d4600640 1 -- start start 2024-04-02T07:35:14.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.670+0000 7fc9d4600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9cc0c4120 0x7fc9cc0b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:35:14.672 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.670+0000 7fc9d4600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9cc0b36f0 0x7fc9cc13d550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:35:14.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.674+0000 7fc9d4600640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9cc13d0c0 con 0x7fc9cc153ea0 2024-04-02T07:35:14.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.674+0000 7fc9d4600640 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9cc0c4580 con 0x7fc9cc0b36f0 2024-04-02T07:35:14.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.674+0000 7fc9d4600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc15a2f0 con 0x7fc9cc0c4120 2024-04-02T07:35:14.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.674+0000 7fc9d2600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9cc0b36f0 0x7fc9cc13d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:35:14.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.674+0000 7fc9d2600640 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9cc0b36f0 0x7fc9cc13d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37392/0 (socket says 172.21.15.55:37392) 2024-04-02T07:35:14.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.674+0000 7fc9d2600640 1 -- 172.21.15.55:0/294106375 learned_addr learned my addr 172.21.15.55:0/294106375 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:35:14.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.674+0000 7fc9d1200640 1 --2- 172.21.15.55:0/294106375 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9cc0c4120 0x7fc9cc0b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:35:14.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.674+0000 7fc9d2600640 1 -- 172.21.15.55:0/294106375 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9cc0c4120 msgr2=0x7fc9cc0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:35:14.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.674+0000 7fc9d2600640 1 --2- 172.21.15.55:0/294106375 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9cc0c4120 0x7fc9cc0b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:14.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.674+0000 7fc9d2600640 1 -- 172.21.15.55:0/294106375 >> v1:172.21.15.106:6789/0 conn(0x7fc9cc153ea0 legacy=0x7fc9cc159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:35:14.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.674+0000 7fc9d2600640 1 -- 172.21.15.55:0/294106375 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9cc15a4f0 con 0x7fc9cc0b36f0 2024-04-02T07:35:14.673 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.674+0000 7fc9d1200640 1 --2- 172.21.15.55:0/294106375 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9cc0c4120 0x7fc9cc0b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:35:14.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.674+0000 7fc9d2600640 1 --2- 172.21.15.55:0/294106375 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0b36f0 0x7fc9cc13d550 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009e50 tx=0x7fc9c401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f732aa9661f62ff server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:35:14.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.674+0000 7fc9cbe00640 1 -- 172.21.15.55:0/294106375 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c40a5810 con 0x7fc9cc0b36f0 2024-04-02T07:35:14.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.674+0000 7fc9cbe00640 1 -- 172.21.15.55:0/294106375 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c40a5970 con 0x7fc9cc0b36f0 2024-04-02T07:35:14.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.674+0000 7fc9cbe00640 1 -- 172.21.15.55:0/294106375 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c40a5d00 con 0x7fc9cc0b36f0 2024-04-02T07:35:14.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.678+0000 7fc9d4600640 1 -- 172.21.15.55:0/294106375 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0b36f0 msgr2=0x7fc9cc13d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:35:14.676 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.678+0000 7fc9d4600640 1 --2- 172.21.15.55:0/294106375 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0b36f0 0x7fc9cc13d550 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4009e50 tx=0x7fc9c401ca30 comp rx=0 tx=0).stop 2024-04-02T07:35:14.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.678+0000 7fc9d4600640 1 -- 172.21.15.55:0/294106375 shutdown_connections 2024-04-02T07:35:14.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.678+0000 7fc9d4600640 1 --2- 172.21.15.55:0/294106375 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0b36f0 0x7fc9cc13d550 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:14.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.678+0000 7fc9d4600640 1 --2- 172.21.15.55:0/294106375 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9cc0c4120 0x7fc9cc0b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:14.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.678+0000 7fc9d4600640 1 -- 172.21.15.55:0/294106375 >> 172.21.15.55:0/294106375 conn(0x7fc9cc066080 msgr2=0x7fc9cc069d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:35:14.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.678+0000 7fc9d4600640 1 -- 172.21.15.55:0/294106375 shutdown_connections 2024-04-02T07:35:14.677 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.678+0000 7fc9d4600640 1 -- 172.21.15.55:0/294106375 wait complete. 2024-04-02T07:35:14.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.678+0000 7fc9d4600640 1 Processor -- start 2024-04-02T07:35:14.678 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.678+0000 7fc9d4600640 1 -- start start 2024-04-02T07:35:14.680 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.678+0000 7fc9d4600640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9cc0b36f0 0x7fc9cc156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:35:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.678+0000 7fc9d4600640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0c4120 0x7fc9cc0c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:35:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.678+0000 7fc9d4600640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9cc153ea0 0x7fc9cc152de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:35:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.678+0000 7fc9d4600640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc158120 con 0x7fc9cc0c4120 2024-04-02T07:35:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.678+0000 7fc9d4600640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc158400 con 0x7fc9cc0b36f0 2024-04-02T07:35:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.678+0000 7fc9d4600640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9cc1586e0 con 0x7fc9cc153ea0 2024-04-02T07:35:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.678+0000 7fc9d1200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0c4120 0x7fc9cc0c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:35:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.678+0000 7fc9d1200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0c4120 0x7fc9cc0c9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37400/0 (socket says 172.21.15.55:37400) 2024-04-02T07:35:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.678+0000 7fc9d1200640 1 -- 172.21.15.55:0/3094610634 learned_addr learned my addr 172.21.15.55:0/3094610634 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:35:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.682+0000 7fc9d2600640 1 --2- 172.21.15.55:0/3094610634 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9cc153ea0 0x7fc9cc152de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:35:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.682+0000 7fc9d1200640 1 -- 172.21.15.55:0/3094610634 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9cc153ea0 msgr2=0x7fc9cc152de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:35:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.682+0000 7fc9d1c00640 1 --2- 172.21.15.55:0/3094610634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9cc0b36f0 0x7fc9cc156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:35:14.681 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.682+0000 7fc9d1200640 1 --2- 172.21.15.55:0/3094610634 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9cc153ea0 0x7fc9cc152de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.682+0000 7fc9d1200640 1 -- 172.21.15.55:0/3094610634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9cc0b36f0 msgr2=0x7fc9cc156440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:35:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.682+0000 7fc9d1200640 1 --2- 172.21.15.55:0/3094610634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9cc0b36f0 0x7fc9cc156440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.682+0000 7fc9d1200640 1 -- 172.21.15.55:0/3094610634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c4009b30 con 0x7fc9cc0c4120 2024-04-02T07:35:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.682+0000 7fc9d2600640 1 --2- 172.21.15.55:0/3094610634 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9cc153ea0 0x7fc9cc152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:35:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.682+0000 7fc9d1c00640 1 --2- 172.21.15.55:0/3094610634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9cc0b36f0 0x7fc9cc156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-02T07:35:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.682+0000 7fc9d1200640 1 --2- 172.21.15.55:0/3094610634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0c4120 0x7fc9cc0c9cb0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800e810 tx=0x7fc9b800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:35:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.682+0000 7fc9c9600640 1 -- 172.21.15.55:0/3094610634 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b800c8d0 con 0x7fc9cc0c4120 2024-04-02T07:35:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.682+0000 7fc9c9600640 1 -- 172.21.15.55:0/3094610634 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b800ca30 con 0x7fc9cc0c4120 2024-04-02T07:35:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.682+0000 7fc9c9600640 1 -- 172.21.15.55:0/3094610634 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b800cdc0 con 0x7fc9cc0c4120 2024-04-02T07:35:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.682+0000 7fc9d4600640 1 -- 172.21.15.55:0/3094610634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9cc1589c0 con 0x7fc9cc0c4120 2024-04-02T07:35:14.682 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.682+0000 7fc9d4600640 1 -- 172.21.15.55:0/3094610634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9cc157d40 con 0x7fc9cc0c4120 2024-04-02T07:35:14.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.682+0000 7fc9d4600640 1 -- 172.21.15.55:0/3094610634 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9cc066c90 con 0x7fc9cc0c4120 2024-04-02T07:35:14.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.682+0000 7fc9c9600640 1 -- 172.21.15.55:0/3094610634 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fc9b8013410 con 0x7fc9cc0c4120 2024-04-02T07:35:14.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.682+0000 7fc9c9600640 1 --2- 172.21.15.55:0/3094610634 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc9ac0666c0 0x7fc9ac068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:35:14.683 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.682+0000 7fc9c9600640 1 -- 172.21.15.55:0/3094610634 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fc9b8083e50 con 0x7fc9cc0c4120 2024-04-02T07:35:14.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.686+0000 7fc9d1c00640 1 --2- 172.21.15.55:0/3094610634 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc9ac0666c0 0x7fc9ac068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:35:14.684 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.686+0000 7fc9d1c00640 1 --2- 172.21.15.55:0/3094610634 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc9ac0666c0 0x7fc9ac068b80 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0000f70 tx=0x7fc9c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:35:14.688 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.686+0000 7fc9c9600640 1 -- 172.21.15.55:0/3094610634 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fc9b80512e0 con 0x7fc9cc0c4120 2024-04-02T07:35:14.846 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.846+0000 7fc9d4600640 1 -- 172.21.15.55:0/3094610634 --> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc9cc158260 con 0x7fc9ac0666c0 2024-04-02T07:35:14.848 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.850+0000 7fc9c9600640 1 -- 172.21.15.55:0/3094610634 <== mgr.4103 v2:172.21.15.106:6832/27356 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50461 (secure 0 0 0) 0x7fc9cc158260 con 0x7fc9ac0666c0 2024-04-02T07:35:14.849 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:35:14.850 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2024-04-02T07:35:14.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.850+0000 7fc9d4600640 1 -- 172.21.15.55:0/3094610634 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc9ac0666c0 msgr2=0x7fc9ac068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:35:14.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.850+0000 7fc9d4600640 1 --2- 172.21.15.55:0/3094610634 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc9ac0666c0 0x7fc9ac068b80 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc9c0000f70 tx=0x7fc9c0009040 comp rx=0 tx=0).stop 2024-04-02T07:35:14.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.850+0000 7fc9d4600640 1 -- 172.21.15.55:0/3094610634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0c4120 msgr2=0x7fc9cc0c9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:35:14.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.850+0000 7fc9d4600640 1 --2- 172.21.15.55:0/3094610634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0c4120 0x7fc9cc0c9cb0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7fc9b800e810 tx=0x7fc9b800ecd0 comp rx=0 tx=0).stop 2024-04-02T07:35:14.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.850+0000 7fc9d4600640 1 -- 172.21.15.55:0/3094610634 shutdown_connections 2024-04-02T07:35:14.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.850+0000 7fc9d4600640 1 --2- 172.21.15.55:0/3094610634 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fc9cc153ea0 0x7fc9cc152de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:14.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.850+0000 7fc9d4600640 1 --2- 172.21.15.55:0/3094610634 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9cc0c4120 0x7fc9cc0c9cb0 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:14.851 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.850+0000 7fc9d4600640 1 --2- 172.21.15.55:0/3094610634 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fc9ac0666c0 0x7fc9ac068b80 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:14.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.850+0000 7fc9d4600640 1 --2- 172.21.15.55:0/3094610634 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fc9cc0b36f0 0x7fc9cc156440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:14.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.850+0000 7fc9d4600640 1 -- 172.21.15.55:0/3094610634 >> 172.21.15.55:0/3094610634 conn(0x7fc9cc066080 msgr2=0x7fc9cc15af20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:35:14.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.850+0000 7fc9d4600640 1 -- 172.21.15.55:0/3094610634 shutdown_connections 2024-04-02T07:35:14.852 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:14.850+0000 7fc9d4600640 1 -- 172.21.15.55:0/3094610634 wait complete. 2024-04-02T07:35:14.871 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":510,"stamp":"2024-04-02T07:35:14.531641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":262092,"kb_used_data":13160,"kb_used_omap":12,"kb_used_meta":248819,"kb_avail":754712628,"statfs":{"total":773094113280,"available":772825731072,"internally_reserved":0,"allocated":13475840,"data_stored":6534064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12744,"internal_metadata":254791224},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002509"},"pg_stats":[{"pgid":"1.0","version":"123'119","reported_seq":271,"reported_epoch":123,"state":"active+clean","last_fresh":"2024-04-02T07:34:58.431187+0000","last_change":"2024-04-02T07:34:58.431294+0000","last_active":"2024-04-02T07:34:58.431187+0000","last_peered":"2024-04-02T07:34:58.431187+0000","last_clean":"2024-04-02T07:34:58.431187+0000","last_became_active":"2024-04-02T07:22:07.788906+0000","last_became_peered":"2024-04-02T07:22:07.788906+0000","last_unstale":"2024-04-02T07:34:58.431187+0000","last_undegraded":"2024-04-02T07:34:58.431187+0000","last_fullsized":"2024-04-02T07:34:58.431187+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"123'119","last_scrub_stamp":"2024-04-02T07:34:58.431163+0000","last_deep_scrub":"123'119","last_deep_scrub_stamp":"2024-04-02T07:34:58.431163+0000","last_clean_scrub_stamp":"2024-04-02T07:34:58.431163+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-03T10:04:01.201812+0000","scrub_duration":0.0072980670000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575007,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33192,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338648,"statfs":{"total":96636764160,"available":96602775552,"internally_reserved":0,"allocated":2129920,"data_stored":1259534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":31848907},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.68799999999999994,"15min":0.66600000000000004},"min":{"1min":0.51900000000000002,"5min":0.39400000000000002,"15min":0.35299999999999998},"max":{"1min":0.86899999999999999,"5min":0.92400000000000004,"15min":1.0569999999999999},"last":0.79000000000000004},{"interface":"front","average":{"1min":0.69899999999999995,"5min":0.67800000000000005,"15min":0.65000000000000002},"min":{"1min":0.52000000000000002,"5min":0.442,"15min":0.39900000000000002},"max":{"1min":0.93100000000000005,"5min":1.018,"15min":1.018},"last":0.83599999999999997}]},{"osd":1,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.67200000000000004,"15min":0.65800000000000003},"min":{"1min":0.41899999999999998,"5min":0.39400000000000002,"15min":0.379},"max":{"1min":0.88200000000000001,"5min":1.004,"15min":1.0289999999999999},"last":0.872},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.69899999999999995,"15min":0.68100000000000005},"min":{"1min":0.54500000000000004,"5min":0.46899999999999997,"15min":0.39500000000000002},"max":{"1min":0.85599999999999998,"5min":0.99299999999999999,"15min":1.113},"last":0.85299999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.749,"15min":0.752},"min":{"1min":0.61199999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.98999999999999999,"5min":1.0309999999999999,"15min":1.139},"last":0.95299999999999996},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.752,"15min":0.73299999999999998},"min":{"1min":0.56699999999999995,"5min":0.503,"15min":0.437},"max":{"1min":0.97399999999999998,"5min":1.0549999999999999,"15min":1.522},"last":0.80700000000000005}]},{"osd":3,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.71299999999999997,"15min":0.70599999999999996},"min":{"1min":0.53400000000000003,"5min":0.42499999999999999,"15min":0.41999999999999998},"max":{"1min":0.87,"5min":1.0409999999999999,"15min":1.405},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.72899999999999998},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.48599999999999999},"max":{"1min":0.95399999999999996,"5min":1.0329999999999999,"15min":1.0580000000000001},"last":0.89500000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.58499999999999996,"15min":0.625},"min":{"1min":0.39400000000000002,"5min":0.37,"15min":0.34399999999999997},"max":{"1min":0.998,"5min":0.998,"15min":1.633},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.66900000000000004,"15min":0.69399999999999995},"min":{"1min":0.46000000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.92900000000000005,"5min":0.94299999999999995,"15min":1.079},"last":0.628}]},{"osd":5,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.63800000000000001,"15min":0.67200000000000004},"min":{"1min":0.441,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.88800000000000001,"5min":0.995,"15min":1.2250000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.71699999999999997,"15min":0.73599999999999999},"min":{"1min":0.436,"5min":0.436,"15min":0.43099999999999999},"max":{"1min":1.02,"5min":1.02,"15min":1.5609999999999999},"last":0.70799999999999996}]},{"osd":6,"last update":"Tue Apr 2 07:34:26 2024","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.68500000000000005,"15min":0.69499999999999995},"min":{"1min":0.49299999999999999,"5min":0.47399999999999998,"15min":0.41799999999999998},"max":{"1min":1.079,"5min":1.079,"15min":1.5960000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.66900000000000004,"15min":0.67600000000000005},"min":{"1min":0.41499999999999998,"5min":0.41399999999999998,"15min":0.40699999999999997},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0840000000000001},"last":0.75700000000000001}]}]},{"osd":6,"up_from":13,"seq":55834575008,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31848903},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.72199999999999998,"15min":0.68999999999999995},"min":{"1min":0.48199999999999998,"5min":0.45600000000000002,"15min":0.41399999999999998},"max":{"1min":1.002,"5min":1.147,"15min":1.399},"last":0.63},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.72699999999999998,"15min":0.76700000000000002},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":5.7569999999999997},"last":0.78600000000000003}]},{"osd":1,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.74199999999999999,"15min":0.72299999999999998},"min":{"1min":0.437,"5min":0.437,"15min":0.38200000000000001},"max":{"1min":0.96499999999999997,"5min":1.097,"15min":1.95},"last":0.76200000000000001},{"interface":"front","average":{"1min":0.73799999999999999,"5min":0.74199999999999999,"15min":0.73099999999999998},"min":{"1min":0.58899999999999997,"5min":0.51400000000000001,"15min":0.47599999999999998},"max":{"1min":0.93600000000000005,"5min":1.0449999999999999,"15min":1.248},"last":0.66300000000000003}]},{"osd":2,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.72399999999999998,"5min":0.72799999999999998,"15min":0.70199999999999996},"min":{"1min":0.53000000000000003,"5min":0.51700000000000002,"15min":0.45000000000000001},"max":{"1min":0.95499999999999996,"5min":0.97699999999999998,"15min":1.226},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.755,"15min":0.73099999999999998},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.92200000000000004,"5min":1.3320000000000001,"15min":1.3320000000000001},"last":0.874}]},{"osd":3,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.75700000000000001,"5min":0.749,"15min":0.76100000000000001},"min":{"1min":0.63600000000000001,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91600000000000004,"5min":1.006,"15min":2.3119999999999998},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.73399999999999999,"15min":0.75},"min":{"1min":0.51900000000000002,"5min":0.49299999999999999,"15min":0.47699999999999998},"max":{"1min":0.996,"5min":1.0660000000000001,"15min":2.6389999999999998},"last":0.77600000000000002}]},{"osd":4,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.629,"15min":0.63600000000000001},"min":{"1min":0.40100000000000002,"5min":0.39600000000000002,"15min":0.34999999999999998},"max":{"1min":0.89500000000000002,"5min":1.236,"15min":1.236},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.63500000000000001,"15min":0.64300000000000002},"min":{"1min":0.49199999999999999,"5min":0.437,"15min":0.38500000000000001},"max":{"1min":0.93799999999999994,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.54900000000000004}]},{"osd":5,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.61599999999999999,"15min":0.63300000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.37},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.95999999999999996},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.68899999999999995,"15min":0.69699999999999995},"min":{"1min":0.52600000000000002,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":0.90100000000000002,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.52100000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:34:24 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.69999999999999996,"15min":0.70699999999999996},"min":{"1min":0.57699999999999996,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.86699999999999999,"5min":3.3290000000000002,"15min":3.3290000000000002},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.68000000000000005,"15min":0.70599999999999996},"min":{"1min":0.52000000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.98299999999999998,"5min":1.1799999999999999,"15min":1.1799999999999999},"last":0.69099999999999995}]}]},{"osd":5,"up_from":13,"seq":55834575008,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.67800000000000005,"15min":0.66800000000000004},"min":{"1min":0.55100000000000005,"5min":0.35699999999999998,"15min":0.33900000000000002},"max":{"1min":0.94899999999999995,"5min":0.995,"15min":1.25},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.69299999999999995,"15min":0.69999999999999996},"min":{"1min":0.52600000000000002,"5min":0.42399999999999999,"15min":0.33000000000000002},"max":{"1min":0.91800000000000004,"5min":0.96599999999999997,"15min":1.5289999999999999},"last":0.71299999999999997}]},{"osd":1,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.72599999999999998,"15min":0.71399999999999997},"min":{"1min":0.51800000000000002,"5min":0.45900000000000002,"15min":0.371},"max":{"1min":0.91500000000000004,"5min":0.995,"15min":1.1830000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.70099999999999996,"5min":0.71299999999999997,"15min":0.70899999999999996},"min":{"1min":0.56399999999999995,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.85599999999999998,"5min":1.0069999999999999,"15min":1.3420000000000001},"last":0.66800000000000004}]},{"osd":2,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.76300000000000001,"15min":0.78500000000000003},"min":{"1min":0.59099999999999997,"5min":0.53400000000000003,"15min":0.44900000000000001},"max":{"1min":0.878,"5min":1.0129999999999999,"15min":1.8280000000000001},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.72199999999999998,"15min":0.72499999999999998},"min":{"1min":0.52000000000000002,"5min":0.40999999999999998,"15min":0.39700000000000002},"max":{"1min":1.03,"5min":1.03,"15min":1.696},"last":0.77100000000000002}]},{"osd":3,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73899999999999999,"15min":0.74099999999999999},"min":{"1min":0.57199999999999995,"5min":0.498,"15min":0.40899999999999997},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.6399999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.74399999999999999,"15min":0.76600000000000001},"min":{"1min":0.56799999999999995,"5min":0.51800000000000002,"15min":0.46800000000000003},"max":{"1min":0.84399999999999997,"5min":1.01,"15min":2.0219999999999998},"last":0.74199999999999999}]},{"osd":4,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.58899999999999997,"15min":0.625},"min":{"1min":0.44900000000000001,"5min":0.36899999999999999,"15min":0.32500000000000001},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.911},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61399999999999999,"15min":0.67300000000000004},"min":{"1min":0.42999999999999999,"5min":0.38500000000000001,"15min":0.307},"max":{"1min":0.99199999999999999,"5min":1.0649999999999999,"15min":1.7829999999999999},"last":0.48399999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.63800000000000001,"15min":0.71199999999999997},"min":{"1min":0.44700000000000001,"5min":0.439,"15min":0.39600000000000002},"max":{"1min":1.2350000000000001,"5min":1.2350000000000001,"15min":2.1829999999999998},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.65500000000000003,"15min":0.70999999999999996},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.36499999999999999},"max":{"1min":0.996,"5min":1.1359999999999999,"15min":2.1280000000000001},"last":0.62}]},{"osd":7,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.66700000000000004,"5min":0.68400000000000005,"15min":0.745},"min":{"1min":0.47799999999999998,"5min":0.435,"15min":0.38300000000000001},"max":{"1min":1.107,"5min":1.1319999999999999,"15min":1.887},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.70699999999999996,"15min":0.77600000000000002},"min":{"1min":0.49399999999999999,"5min":0.47799999999999998,"15min":0.439},"max":{"1min":0.89400000000000002,"5min":1.056,"15min":2.2599999999999998},"last":0.55000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834575010,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.67500000000000004,"15min":0.69599999999999995},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77000000000000002,"5min":0.93400000000000005,"15min":2.4929999999999999},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.67100000000000004,"15min":0.72199999999999998},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.83699999999999997,"5min":0.94799999999999995,"15min":3.2519999999999998},"last":0.80100000000000005}]},{"osd":1,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.70399999999999996,"15min":0.72199999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.94099999999999995,"5min":0.96999999999999997,"15min":1.4279999999999999},"last":0.755},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.69899999999999995,"15min":0.77100000000000002},"min":{"1min":0.46899999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79100000000000004,"5min":1.0069999999999999,"15min":4.3810000000000002},"last":0.70399999999999996}]},{"osd":2,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.72699999999999998,"15min":0.75},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.82499999999999996,"5min":1.1990000000000001,"15min":2.056},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.70899999999999996,"15min":0.76900000000000002},"min":{"1min":0.496,"5min":0.436,"15min":0.436},"max":{"1min":0.88500000000000001,"5min":1.038,"15min":3.3420000000000001},"last":0.77100000000000002}]},{"osd":3,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.75,"15min":0.83099999999999996},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.436},"max":{"1min":0.92300000000000004,"5min":1.091,"15min":3.9180000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.76200000000000001,"15min":0.84199999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":0.93200000000000005,"5min":1.1279999999999999,"15min":3.9750000000000001},"last":0.84399999999999997}]},{"osd":5,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59199999999999997,"15min":0.63700000000000001},"min":{"1min":0.39300000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.91100000000000003,"5min":1.1120000000000001,"15min":1.2509999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59699999999999998,"15min":0.65800000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.36699999999999999},"max":{"1min":0.92300000000000004,"5min":0.98199999999999998,"15min":1.4419999999999999},"last":0.64900000000000002}]},{"osd":6,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61699999999999999,"15min":0.65300000000000002},"min":{"1min":0.42899999999999999,"5min":0.40999999999999998,"15min":0.33400000000000002},"max":{"1min":0.82799999999999996,"5min":1.0760000000000001,"15min":1.2949999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67700000000000005,"15min":0.71299999999999997},"min":{"1min":0.503,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.86299999999999999,"5min":1.2529999999999999,"15min":1.3069999999999999},"last":0.623}]},{"osd":7,"last update":"Tue Apr 2 07:34:35 2024","interfaces":[{"interface":"back","average":{"1min":0.68200000000000005,"5min":0.68100000000000005,"15min":0.73099999999999998},"min":{"1min":0.46100000000000002,"5min":0.434,"15min":0.432},"max":{"1min":1.0129999999999999,"5min":1.034,"15min":1.2689999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.77200000000000002,"15min":0.80700000000000005},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.52700000000000002},"max":{"1min":1.0569999999999999,"5min":1.2949999999999999,"15min":1.353},"last":0.77600000000000002}]}]},{"osd":3,"up_from":13,"seq":55834575008,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":31848904},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.45300000000000001,"15min":0.44600000000000001},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.26300000000000001},"max":{"1min":0.54900000000000004,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.48099999999999998,"15min":0.48199999999999998},"min":{"1min":0.308,"5min":0.30399999999999999,"15min":0.28699999999999998},"max":{"1min":0.56799999999999995,"5min":0.68000000000000005,"15min":1.0109999999999999},"last":0.44}]},{"osd":1,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.442,"5min":0.46500000000000002,"15min":0.45100000000000001},"min":{"1min":0.29499999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.71099999999999997,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.53000000000000003,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.69899999999999995,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.51300000000000001}]},{"osd":2,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54000000000000004,"15min":0.54100000000000004},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.80900000000000005,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.58099999999999996,"15min":0.57799999999999996},"min":{"1min":0.41699999999999998,"5min":0.35399999999999998,"15min":0.33400000000000002},"max":{"1min":0.77900000000000003,"5min":0.82099999999999995,"15min":1.306},"last":0.56499999999999995}]},{"osd":4,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.70899999999999996,"5min":0.75600000000000001,"15min":0.74299999999999999},"min":{"1min":0.50600000000000001,"5min":0.45800000000000002,"15min":0.40500000000000003},"max":{"1min":1.099,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.754,"5min":0.78600000000000003,"15min":0.76100000000000001},"min":{"1min":0.57899999999999996,"5min":0.52700000000000002,"15min":0.46500000000000002},"max":{"1min":1.0169999999999999,"5min":1.306,"15min":1.306},"last":0.80600000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77800000000000002,"5min":0.78600000000000003,"15min":0.77800000000000002},"min":{"1min":0.56000000000000005,"5min":0.502,"15min":0.501},"max":{"1min":1.123,"5min":1.4790000000000001,"15min":1.4790000000000001},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.78300000000000003,"15min":0.76100000000000001},"min":{"1min":0.51500000000000001,"5min":0.48999999999999999,"15min":0.48899999999999999},"max":{"1min":1.0820000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.73799999999999999}]},{"osd":6,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.77900000000000003,"15min":0.76500000000000001},"min":{"1min":0.498,"5min":0.49399999999999999,"15min":0.44500000000000001},"max":{"1min":1.1950000000000001,"5min":1.258,"15min":1.258},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.80400000000000005,"15min":0.79300000000000004},"min":{"1min":0.58999999999999997,"5min":0.55800000000000005,"15min":0.52000000000000002},"max":{"1min":1.0669999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"last":0.76500000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:34:22 2024","interfaces":[{"interface":"back","average":{"1min":0.77000000000000002,"5min":0.80000000000000004,"15min":0.76900000000000002},"min":{"1min":0.54900000000000004,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":1.0529999999999999,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.86599999999999999},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.79700000000000004,"15min":0.79200000000000004},"min":{"1min":0.59199999999999997,"5min":0.53500000000000003,"15min":0.47499999999999998},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.2869999999999999},"last":0.82799999999999996}]}]},{"osd":2,"up_from":13,"seq":55834575008,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32620,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.47099999999999997,"15min":0.45200000000000001},"min":{"1min":0.308,"5min":0.25800000000000001,"15min":0.253},"max":{"1min":0.68799999999999994,"5min":0.78800000000000003,"15min":0.79100000000000004},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.51200000000000001,"15min":0.495},"min":{"1min":0.32100000000000001,"5min":0.28299999999999997,"15min":0.27300000000000002},"max":{"1min":0.85899999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.48899999999999999}]},{"osd":1,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.54500000000000004,"15min":0.53400000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35099999999999998},"max":{"1min":0.77800000000000002,"5min":0.876,"15min":1.171},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.53100000000000003,"15min":0.504},"min":{"1min":0.38800000000000001,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.752,"5min":0.878,"15min":1.333},"last":0.47699999999999998}]},{"osd":3,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56899999999999995,"15min":0.53500000000000003},"min":{"1min":0.42299999999999999,"5min":0.36699999999999999,"15min":0.32700000000000001},"max":{"1min":0.69999999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.622,"5min":0.60399999999999998,"15min":0.57899999999999996},"min":{"1min":0.434,"5min":0.41299999999999998,"15min":0.35799999999999998},"max":{"1min":0.83799999999999997,"5min":0.90000000000000002,"15min":1.1140000000000001},"last":0.44600000000000001}]},{"osd":4,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.58399999999999996,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":0.98499999999999999,"5min":1.1379999999999999,"15min":2.254},"last":0.752},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.79000000000000004,"15min":0.77600000000000002},"min":{"1min":0.53100000000000003,"5min":0.498,"15min":0.42799999999999999},"max":{"1min":1.2190000000000001,"5min":1.2190000000000001,"15min":1.3420000000000001},"last":0.78700000000000003}]},{"osd":5,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.79200000000000004,"15min":0.77300000000000002},"min":{"1min":0.60599999999999998,"5min":0.54000000000000004,"15min":0.46200000000000002},"max":{"1min":1.0620000000000001,"5min":1.1439999999999999,"15min":1.3740000000000001},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.81799999999999995,"15min":0.80400000000000005},"min":{"1min":0.60599999999999998,"5min":0.57399999999999995,"15min":0.443},"max":{"1min":1.133,"5min":1.2070000000000001,"15min":2.0840000000000001},"last":0.68600000000000005}]},{"osd":6,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.85599999999999998,"5min":0.83199999999999996,"15min":0.82299999999999995},"min":{"1min":0.63900000000000001,"5min":0.56499999999999995,"15min":0.54600000000000004},"max":{"1min":1.1830000000000001,"5min":1.1990000000000001,"15min":1.5029999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.87,"15min":0.83999999999999997},"min":{"1min":0.71099999999999997,"5min":0.61099999999999999,"15min":0.52700000000000002},"max":{"1min":1.155,"5min":1.159,"15min":1.425},"last":0.76500000000000001}]},{"osd":7,"last update":"Tue Apr 2 07:34:32 2024","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.81100000000000005,"15min":0.81399999999999995},"min":{"1min":0.66200000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.0840000000000001,"5min":1.1799999999999999,"15min":2.3580000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.82899999999999996,"15min":0.82099999999999995},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.54300000000000004},"max":{"1min":1.198,"5min":1.198,"15min":1.377},"last":0.65400000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575007,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32616,"kb_used_data":1500,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1536000,"data_stored":669166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.439,"15min":0.45400000000000001},"min":{"1min":0.27800000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.69999999999999996,"5min":0.77200000000000002,"15min":1.2150000000000001},"last":0.622},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.47499999999999998,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.28799999999999998,"15min":0.26200000000000001},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":4.157},"last":0.69599999999999995}]},{"osd":2,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.47899999999999998,"15min":0.53700000000000003},"min":{"1min":0.312,"5min":0.30599999999999999,"15min":0.28999999999999998},"max":{"1min":0.66400000000000003,"5min":0.67700000000000005,"15min":4.282},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.53000000000000003,"15min":0.55200000000000005},"min":{"1min":0.376,"5min":0.37,"15min":0.33600000000000002},"max":{"1min":0.70699999999999996,"5min":0.81000000000000005,"15min":1.625},"last":0.67400000000000004}]},{"osd":3,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.59599999999999997,"15min":0.59699999999999998},"min":{"1min":0.38200000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.76400000000000001,"5min":0.88800000000000001,"15min":1.1120000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54800000000000004,"15min":0.66600000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":8.1620000000000008},"last":0.75600000000000001}]},{"osd":4,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.71899999999999997,"15min":0.80700000000000005},"min":{"1min":0.436,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":4.7400000000000002},"last":0.89300000000000002},{"interface":"front","average":{"1min":0.74099999999999999,"5min":0.76300000000000001,"15min":0.78500000000000003},"min":{"1min":0.55900000000000005,"5min":0.53000000000000003,"15min":0.50600000000000001},"max":{"1min":1.071,"5min":1.125,"15min":1.7070000000000001},"last":0.94199999999999995}]},{"osd":5,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.75700000000000001,"15min":0.82599999999999996},"min":{"1min":0.52000000000000002,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":1.302,"5min":1.321,"15min":4.5759999999999996},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.71499999999999997,"5min":0.751,"15min":0.82199999999999995},"min":{"1min":0.52800000000000002,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.018,"5min":1.3680000000000001,"15min":4.7949999999999999},"last":0.96499999999999997}]},{"osd":6,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.745,"5min":0.77700000000000002,"15min":0.84799999999999998},"min":{"1min":0.56699999999999995,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0640000000000001,"5min":1.0820000000000001,"15min":4.6890000000000001},"last":0.87},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.76500000000000001,"15min":0.83699999999999997},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.141,"5min":1.141,"15min":4.6059999999999999},"last":0.78300000000000003}]},{"osd":7,"last update":"Tue Apr 2 07:34:29 2024","interfaces":[{"interface":"back","average":{"1min":0.753,"5min":0.77600000000000002,"15min":0.79600000000000004},"min":{"1min":0.54400000000000004,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.1539999999999999,"5min":1.206,"15min":1.8759999999999999},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.755,"5min":0.78500000000000003,"15min":0.85399999999999998},"min":{"1min":0.53200000000000003,"5min":0.495,"15min":0.495},"max":{"1min":1.1870000000000001,"5min":1.1870000000000001,"15min":4.6420000000000003},"last":0.92300000000000004}]}]},{"osd":0,"up_from":13,"seq":55834575008,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33192,"kb_used_data":2080,"kb_used_omap":1,"kb_used_meta":31102,"kb_avail":94338648,"statfs":{"total":96636764160,"available":96602775552,"internally_reserved":0,"allocated":2129920,"data_stored":1259534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31848902},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.42599999999999999,"15min":0.441},"min":{"1min":0.32500000000000001,"5min":0.27800000000000002,"15min":0.26300000000000001},"max":{"1min":0.621,"5min":0.621,"15min":1.48},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.497,"5min":0.5,"15min":0.502},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.747,"5min":0.747,"15min":1.2330000000000001},"last":0.47899999999999998}]},{"osd":2,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.5,"15min":0.50700000000000001},"min":{"1min":0.373,"5min":0.34699999999999998,"15min":0.29099999999999998},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":1.3129999999999999},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.32400000000000001},"max":{"1min":0.64800000000000002,"5min":0.76700000000000002,"15min":0.82599999999999996},"last":0.55500000000000005}]},{"osd":3,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.47499999999999998,"15min":0.46899999999999997},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.28199999999999997},"max":{"1min":0.68000000000000005,"5min":0.82799999999999996,"15min":0.84799999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58399999999999996,"15min":0.59299999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.40300000000000002},"max":{"1min":0.94399999999999995,"5min":0.94399999999999995,"15min":1.4430000000000001},"last":0.65700000000000003}]},{"osd":4,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.71399999999999997,"5min":0.73299999999999998,"15min":0.73899999999999999},"min":{"1min":0.53700000000000003,"5min":0.505,"15min":0.46200000000000002},"max":{"1min":0.98099999999999998,"5min":1.0149999999999999,"15min":1.0569999999999999},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.72699999999999998,"5min":0.73399999999999999,"15min":0.73899999999999999},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.1240000000000001},"last":0.80700000000000005}]},{"osd":5,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.747,"5min":0.746,"15min":0.76200000000000001},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.47599999999999998},"max":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.371},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.747,"5min":0.745,"15min":0.755},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":0.997,"5min":0.997,"15min":1.143},"last":0.92400000000000004}]},{"osd":6,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.77800000000000002,"15min":0.78600000000000003},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.52500000000000002},"max":{"1min":0.97599999999999998,"5min":1.038,"15min":1.177},"last":0.98799999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.79800000000000004,"15min":0.81399999999999995},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.4099999999999999},"last":0.90300000000000002}]},{"osd":7,"last update":"Tue Apr 2 07:34:23 2024","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.75900000000000001,"15min":0.77700000000000002},"min":{"1min":0.58799999999999997,"5min":0.56100000000000005,"15min":0.54800000000000004},"max":{"1min":0.98399999999999999,"5min":1.028,"15min":1.135},"last":0.878},{"interface":"front","average":{"1min":0.78100000000000003,"5min":0.76900000000000002,"15min":0.77700000000000002},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.48399999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.94599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-02T07:35:14.874 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-02T07:35:15.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.014+0000 7efd0d400640 1 Processor -- start 2024-04-02T07:35:15.012 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.014+0000 7efd0d400640 1 -- start start 2024-04-02T07:35:15.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.014+0000 7efd0d400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd0815cd20 0x7efd08065a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:35:15.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.014+0000 7efd0d400640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efd08161490 0x7efd0806d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:35:15.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.014+0000 7efd0d400640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd080660d0 con 0x7efd0806dde0 2024-04-02T07:35:15.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.014+0000 7efd0d400640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd081607a0 con 0x7efd08161490 2024-04-02T07:35:15.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.014+0000 7efd0d400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd080ae8d0 con 0x7efd0815cd20 2024-04-02T07:35:15.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.014+0000 7efd06800640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd0815cd20 0x7efd08065a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:35:15.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.014+0000 7efcfde00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efd08161490 0x7efd0806d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:35:15.014 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.014+0000 7efcfde00640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7efd08161490 0x7efd0806d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3300/0 says I am v2:172.21.15.55:41760/0 (socket says 172.21.15.55:41760) 2024-04-02T07:35:15.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.014+0000 7efcfde00640 1 -- 172.21.15.55:0/165383900 learned_addr learned my addr 172.21.15.55:0/165383900 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:35:15.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.014+0000 7efd07200640 1 --1- 172.21.15.55:0/165383900 >> v1:172.21.15.106:6789/0 conn(0x7efd0806dde0 0x7efd08069d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.55:48738/0 (socket says 172.21.15.55:48738) 2024-04-02T07:35:15.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.014+0000 7efcfde00640 1 -- 172.21.15.55:0/165383900 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd0815cd20 msgr2=0x7efd08065a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:35:15.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.014+0000 7efcfde00640 1 --2- 172.21.15.55:0/165383900 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd0815cd20 0x7efd08065a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:15.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.014+0000 7efcfde00640 1 -- 172.21.15.55:0/165383900 >> v1:172.21.15.106:6789/0 conn(0x7efd0806dde0 legacy=0x7efd08069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:35:15.015 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.014+0000 7efcfde00640 1 -- 172.21.15.55:0/165383900 --> v2:172.21.15.106:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd081609b0 con 0x7efd08161490 2024-04-02T07:35:15.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.018+0000 7efcfde00640 1 --2- 172.21.15.55:0/165383900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd08161490 0x7efd0806d5d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009870 tx=0x7efcf001c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4693a1abf2690eb6 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:35:15.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.018+0000 7efd05e00640 1 -- 172.21.15.55:0/165383900 <== mon.1 v2:172.21.15.106:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00ab650 con 0x7efd08161490 2024-04-02T07:35:15.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.018+0000 7efd05e00640 1 -- 172.21.15.55:0/165383900 <== mon.1 v2:172.21.15.106:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcf00ab7b0 con 0x7efd08161490 2024-04-02T07:35:15.017 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.018+0000 7efd05e00640 1 -- 172.21.15.55:0/165383900 <== mon.1 v2:172.21.15.106:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcf00abb40 con 0x7efd08161490 2024-04-02T07:35:15.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.018+0000 7efd0d400640 1 -- 172.21.15.55:0/165383900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd08161490 msgr2=0x7efd0806d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:35:15.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.018+0000 7efd0d400640 1 --2- 172.21.15.55:0/165383900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd08161490 0x7efd0806d5d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7efcf0009870 tx=0x7efcf001c560 comp rx=0 tx=0).stop 2024-04-02T07:35:15.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.018+0000 7efd0d400640 1 -- 172.21.15.55:0/165383900 shutdown_connections 2024-04-02T07:35:15.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.018+0000 7efd0d400640 1 --2- 172.21.15.55:0/165383900 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd08161490 0x7efd0806d5d0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:15.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.018+0000 7efd0d400640 1 --2- 172.21.15.55:0/165383900 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd0815cd20 0x7efd08065a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:15.018 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.018+0000 7efd0d400640 1 -- 172.21.15.55:0/165383900 >> 172.21.15.55:0/165383900 conn(0x7efd080ced90 msgr2=0x7efd080cf170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:35:15.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.018+0000 7efd0d400640 1 -- 172.21.15.55:0/165383900 shutdown_connections 2024-04-02T07:35:15.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.018+0000 7efd0d400640 1 -- 172.21.15.55:0/165383900 wait complete. 2024-04-02T07:35:15.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.018+0000 7efd0d400640 1 Processor -- start 2024-04-02T07:35:15.019 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.018+0000 7efd0d400640 1 -- start start 2024-04-02T07:35:15.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efd0d400640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd0806dde0 0x7efd08143390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:35:15.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efd0d400640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd0815cd20 0x7efd0815d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:35:15.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efd0d400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd08161490 0x7efd0815f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:35:15.023 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efd0d400640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd081438d0 con 0x7efd08161490 2024-04-02T07:35:15.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efd0d400640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd0815ed70 con 0x7efd0815cd20 2024-04-02T07:35:15.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efd0d400640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd0815dcd0 con 0x7efd0806dde0 2024-04-02T07:35:15.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efd07200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd08161490 0x7efd0815f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:35:15.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efd07200640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd08161490 0x7efd0815f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37412/0 (socket says 172.21.15.55:37412) 2024-04-02T07:35:15.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efd07200640 1 -- 172.21.15.55:0/3976311360 learned_addr learned my addr 172.21.15.55:0/3976311360 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:35:15.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efd06800640 1 --2- 172.21.15.55:0/3976311360 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd0806dde0 0x7efd08143390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:35:15.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efcfde00640 1 --2- 172.21.15.55:0/3976311360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd0815cd20 0x7efd0815d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:35:15.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efd07200640 1 -- 172.21.15.55:0/3976311360 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd0806dde0 msgr2=0x7efd08143390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:35:15.024 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efd07200640 1 --2- 172.21.15.55:0/3976311360 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd0806dde0 0x7efd08143390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:15.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efd07200640 1 -- 172.21.15.55:0/3976311360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd0815cd20 msgr2=0x7efd0815d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:35:15.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efd07200640 1 --2- 172.21.15.55:0/3976311360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd0815cd20 0x7efd0815d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:15.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efd07200640 1 -- 172.21.15.55:0/3976311360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcf00094d0 con 0x7efd08161490 2024-04-02T07:35:15.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efd06800640 1 --2- 172.21.15.55:0/3976311360 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd0806dde0 0x7efd08143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:35:15.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efcfde00640 1 --2- 172.21.15.55:0/3976311360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd0815cd20 0x7efd0815d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:35:15.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efd07200640 1 --2- 172.21.15.55:0/3976311360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd08161490 0x7efd0815f590 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7efd0000c7a0 tx=0x7efd0000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:35:15.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efcff400640 1 -- 172.21.15.55:0/3976311360 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0000a640 con 0x7efd08161490 2024-04-02T07:35:15.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efcff400640 1 -- 172.21.15.55:0/3976311360 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0000a7a0 con 0x7efd08161490 2024-04-02T07:35:15.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efd0d400640 1 -- 172.21.15.55:0/3976311360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd0815dfb0 con 0x7efd08161490 2024-04-02T07:35:15.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efcff400640 1 -- 172.21.15.55:0/3976311360 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0000ab10 con 0x7efd08161490 2024-04-02T07:35:15.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efd0d400640 1 -- 172.21.15.55:0/3976311360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd0815e570 con 0x7efd08161490 2024-04-02T07:35:15.025 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.022+0000 7efd0d400640 1 -- 172.21.15.55:0/3976311360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd080cc770 con 0x7efd08161490 2024-04-02T07:35:15.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.026+0000 7efcff400640 1 -- 172.21.15.55:0/3976311360 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7efd0000ac70 con 0x7efd08161490 2024-04-02T07:35:15.026 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.026+0000 7efcff400640 1 --2- 172.21.15.55:0/3976311360 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efce4066690 0x7efce4068b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:35:15.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.026+0000 7efcff400640 1 -- 172.21.15.55:0/3976311360 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7efd00083840 con 0x7efd08161490 2024-04-02T07:35:15.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.026+0000 7efd06800640 1 --2- 172.21.15.55:0/3976311360 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efce4066690 0x7efce4068b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:35:15.027 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.026+0000 7efd06800640 1 --2- 172.21.15.55:0/3976311360 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efce4066690 0x7efce4068b50 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009bb0 tx=0x7efcf8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:35:15.028 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.030+0000 7efcff400640 1 -- 172.21.15.55:0/3976311360 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7efd00050d80 con 0x7efd08161490 2024-04-02T07:35:15.189 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.190+0000 7efd0d400640 1 -- 172.21.15.55:0/3976311360 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7efd08066c90 con 0x7efd08161490 2024-04-02T07:35:15.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.194+0000 7efcff400640 1 -- 172.21.15.55:0/3976311360 <== mon.0 v2:172.21.15.55:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7efd00050d80 con 0x7efd08161490 2024-04-02T07:35:15.193 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.194+0000 7efcff400640 1 -- 172.21.15.55:0/3976311360 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v24)=0 v24) v1 ==== 123+0+0 (secure 0 0 0) 0x7efd00017020 con 0x7efd08161490 2024-04-02T07:35:15.196 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.198+0000 7efd0d400640 1 -- 172.21.15.55:0/3976311360 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efce4066690 msgr2=0x7efce4068b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:35:15.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.198+0000 7efd0d400640 1 --2- 172.21.15.55:0/3976311360 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efce4066690 0x7efce4068b50 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7efcf8009bb0 tx=0x7efcf8008040 comp rx=0 tx=0).stop 2024-04-02T07:35:15.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.198+0000 7efd0d400640 1 -- 172.21.15.55:0/3976311360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd08161490 msgr2=0x7efd0815f590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:35:15.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.198+0000 7efd0d400640 1 --2- 172.21.15.55:0/3976311360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd08161490 0x7efd0815f590 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7efd0000c7a0 tx=0x7efd0000cc60 comp rx=0 tx=0).stop 2024-04-02T07:35:15.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.198+0000 7efd0d400640 1 -- 172.21.15.55:0/3976311360 shutdown_connections 2024-04-02T07:35:15.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.198+0000 7efd0d400640 1 --2- 172.21.15.55:0/3976311360 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efd08161490 0x7efd0815f590 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:15.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.198+0000 7efd0d400640 1 --2- 172.21.15.55:0/3976311360 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7efce4066690 0x7efce4068b50 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:15.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.198+0000 7efd0d400640 1 --2- 172.21.15.55:0/3976311360 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7efd0815cd20 0x7efd0815d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:15.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.198+0000 7efd0d400640 1 --2- 172.21.15.55:0/3976311360 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7efd0806dde0 0x7efd08143390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:15.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.198+0000 7efd0d400640 1 -- 172.21.15.55:0/3976311360 >> 172.21.15.55:0/3976311360 conn(0x7efd080ced90 msgr2=0x7efd080cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:35:15.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.198+0000 7efd0d400640 1 -- 172.21.15.55:0/3976311360 shutdown_connections 2024-04-02T07:35:15.197 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.198+0000 7efd0d400640 1 -- 172.21.15.55:0/3976311360 wait complete. 2024-04-02T07:35:15.216 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-02T07:35:15.216 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-02T07:35:15.356 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.358+0000 7fd8c5000640 1 Processor -- start 2024-04-02T07:35:15.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.358+0000 7fd8c5000640 1 -- start start 2024-04-02T07:35:15.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.358+0000 7fd8c5000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c015cad0 0x7fd8c00b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:35:15.357 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.358+0000 7fd8c5000640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd8c006a4a0 0x7fd8c00cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:35:15.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.358+0000 7fd8c5000640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c00b26b0 con 0x7fd8c006ec10 2024-04-02T07:35:15.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.358+0000 7fd8c5000640 1 -- --> v2:172.21.15.106:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c015ceb0 con 0x7fd8c006a4a0 2024-04-02T07:35:15.358 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.358+0000 7fd8c5000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c006f1d0 con 0x7fd8c015cad0 2024-04-02T07:35:15.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.358+0000 7fd8bde00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c015cad0 0x7fd8c00b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:35:15.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.358+0000 7fd8be800640 1 --2- >> v2:172.21.15.106:3300/0 conn(0x7fd8c006a4a0 0x7fd8c00cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:35:15.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.358+0000 7fd8bde00640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c015cad0 0x7fd8c00b43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.106:3301/0 says I am v2:172.21.15.55:47048/0 (socket says 172.21.15.55:47048) 2024-04-02T07:35:15.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.358+0000 7fd8bde00640 1 -- 172.21.15.55:0/1059316428 learned_addr learned my addr 172.21.15.55:0/1059316428 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:35:15.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.358+0000 7fd8bde00640 1 -- 172.21.15.55:0/1059316428 >> v2:172.21.15.106:3300/0 conn(0x7fd8c006a4a0 msgr2=0x7fd8c00cdab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-02T07:35:15.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.358+0000 7fd8bde00640 1 --2- 172.21.15.55:0/1059316428 >> v2:172.21.15.106:3300/0 conn(0x7fd8c006a4a0 0x7fd8c00cdab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:15.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.358+0000 7fd8bde00640 1 -- 172.21.15.55:0/1059316428 >> v1:172.21.15.106:6789/0 conn(0x7fd8c006ec10 legacy=0x7fd8c0069d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:35:15.359 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.358+0000 7fd8bde00640 1 -- 172.21.15.55:0/1059316428 --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c00cd640 con 0x7fd8c015cad0 2024-04-02T07:35:15.361 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.362+0000 7fd8bde00640 1 --2- 172.21.15.55:0/1059316428 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c015cad0 0x7fd8c00b43d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0009870 tx=0x7fd8b001c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b9a8ad5bfb7afc39 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:35:15.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.362+0000 7fd8bca00640 1 -- 172.21.15.55:0/1059316428 <== mon.2 v2:172.21.15.106:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b00ac410 con 0x7fd8c015cad0 2024-04-02T07:35:15.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.362+0000 7fd8bca00640 1 -- 172.21.15.55:0/1059316428 <== mon.2 v2:172.21.15.106:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd8b00ac570 con 0x7fd8c015cad0 2024-04-02T07:35:15.362 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.362+0000 7fd8bca00640 1 -- 172.21.15.55:0/1059316428 <== mon.2 v2:172.21.15.106:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b00ac920 con 0x7fd8c015cad0 2024-04-02T07:35:15.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.362+0000 7fd8c5000640 1 -- 172.21.15.55:0/1059316428 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c015cad0 msgr2=0x7fd8c00b43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:35:15.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.362+0000 7fd8c5000640 1 --2- 172.21.15.55:0/1059316428 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c015cad0 0x7fd8c00b43d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd8b0009870 tx=0x7fd8b001c4a0 comp rx=0 tx=0).stop 2024-04-02T07:35:15.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.362+0000 7fd8c5000640 1 -- 172.21.15.55:0/1059316428 shutdown_connections 2024-04-02T07:35:15.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.362+0000 7fd8c5000640 1 --2- 172.21.15.55:0/1059316428 >> v2:172.21.15.106:3300/0 conn(0x7fd8c006a4a0 0x7fd8c00cdab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:15.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.362+0000 7fd8c5000640 1 --2- 172.21.15.55:0/1059316428 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c015cad0 0x7fd8c00b43d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:15.363 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.362+0000 7fd8c5000640 1 -- 172.21.15.55:0/1059316428 >> 172.21.15.55:0/1059316428 conn(0x7fd8c00b13b0 msgr2=0x7fd8c00b17c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:35:15.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.362+0000 7fd8c5000640 1 -- 172.21.15.55:0/1059316428 shutdown_connections 2024-04-02T07:35:15.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.362+0000 7fd8c5000640 1 -- 172.21.15.55:0/1059316428 wait complete. 2024-04-02T07:35:15.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8c5000640 1 Processor -- start 2024-04-02T07:35:15.364 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8c5000640 1 -- start start 2024-04-02T07:35:15.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8c5000640 1 --2- >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8c006a4a0 0x7fd8c0155f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:35:15.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8c5000640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c006ec10 0x7fd8c015aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:35:15.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8c5000640 1 --2- >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c015cad0 0x7fd8c015b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:35:15.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8c5000640 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c0147ad0 con 0x7fd8c006ec10 2024-04-02T07:35:15.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8c5000640 1 -- --> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c0152670 con 0x7fd8c006a4a0 2024-04-02T07:35:15.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8c5000640 1 -- --> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c015e910 con 0x7fd8c015cad0 2024-04-02T07:35:15.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8bd400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c006ec10 0x7fd8c015aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:35:15.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8bd400640 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c006ec10 0x7fd8c015aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:37424/0 (socket says 172.21.15.55:37424) 2024-04-02T07:35:15.367 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8bd400640 1 -- 172.21.15.55:0/1328467224 learned_addr learned my addr 172.21.15.55:0/1328467224 (peer_addr_for_me v2:172.21.15.55:0/0) 2024-04-02T07:35:15.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8be800640 1 --2- 172.21.15.55:0/1328467224 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c015cad0 0x7fd8c015b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:35:15.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8bde00640 1 --2- 172.21.15.55:0/1328467224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8c006a4a0 0x7fd8c0155f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:35:15.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8bd400640 1 -- 172.21.15.55:0/1328467224 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c015cad0 msgr2=0x7fd8c015b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:35:15.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8bd400640 1 --2- 172.21.15.55:0/1328467224 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c015cad0 0x7fd8c015b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:15.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8bd400640 1 -- 172.21.15.55:0/1328467224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8c006a4a0 msgr2=0x7fd8c0155f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:35:15.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8bd400640 1 --2- 172.21.15.55:0/1328467224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8c006a4a0 0x7fd8c0155f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:15.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8bd400640 1 -- 172.21.15.55:0/1328467224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b00094d0 con 0x7fd8c006ec10 2024-04-02T07:35:15.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8bde00640 1 --2- 172.21.15.55:0/1328467224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8c006a4a0 0x7fd8c0155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-02T07:35:15.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8bd400640 1 --2- 172.21.15.55:0/1328467224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c006ec10 0x7fd8c015aea0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00c500 tx=0x7fd8ac00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:35:15.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8b6000640 1 -- 172.21.15.55:0/1328467224 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac005220 con 0x7fd8c006ec10 2024-04-02T07:35:15.368 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8b6000640 1 -- 172.21.15.55:0/1328467224 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fd8ac005380 con 0x7fd8c006ec10 2024-04-02T07:35:15.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8c5000640 1 -- 172.21.15.55:0/1328467224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c015dab0 con 0x7fd8c006ec10 2024-04-02T07:35:15.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8b6000640 1 -- 172.21.15.55:0/1328467224 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ac007290 con 0x7fd8c006ec10 2024-04-02T07:35:15.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8c5000640 1 -- 172.21.15.55:0/1328467224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c015e070 con 0x7fd8c006ec10 2024-04-02T07:35:15.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.366+0000 7fd8c5000640 1 -- 172.21.15.55:0/1328467224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c00706a0 con 0x7fd8c006ec10 2024-04-02T07:35:15.369 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.370+0000 7fd8b6000640 1 -- 172.21.15.55:0/1328467224 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 86084+0+0 (secure 0 0 0) 0x7fd8ac0073f0 con 0x7fd8c006ec10 2024-04-02T07:35:15.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.370+0000 7fd8b6000640 1 --2- 172.21.15.55:0/1328467224 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd8a00666c0 0x7fd8a0068b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-02T07:35:15.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.370+0000 7fd8b6000640 1 -- 172.21.15.55:0/1328467224 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5115+0+0 (secure 0 0 0) 0x7fd8ac083760 con 0x7fd8c006ec10 2024-04-02T07:35:15.370 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.370+0000 7fd8bde00640 1 --2- 172.21.15.55:0/1328467224 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd8a00666c0 0x7fd8a0068b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-02T07:35:15.371 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.370+0000 7fd8bde00640 1 --2- 172.21.15.55:0/1328467224 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd8a00666c0 0x7fd8a0068b80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00ae000 tx=0x7fd8b00a6040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-02T07:35:15.374 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.374+0000 7fd8b6000640 1 -- 172.21.15.55:0/1328467224 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+174438 (secure 0 0 0) 0x7fd8ac050d30 con 0x7fd8c006ec10 2024-04-02T07:35:15.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.570+0000 7fd8c5000640 1 -- 172.21.15.55:0/1328467224 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8c0066c90 con 0x7fd8c006ec10 2024-04-02T07:35:15.569 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.570+0000 7fd8b6000640 1 -- 172.21.15.55:0/1328467224 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 111 v111) v1 ==== 95+0+3534 (secure 0 0 0) 0x7fd8ac054350 con 0x7fd8c006ec10 2024-04-02T07:35:15.570 INFO:teuthology.orchestra.run.smithi055.stdout: 2024-04-02T07:35:15.570 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":111,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7592,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6836/2292883244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6835","nonce":2292883244},{"type":"v1","addr":"172.21.15.106:6836","nonce":2292883244}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":7835,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.106:6837/3165795379","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6834","nonce":3165795379},{"type":"v1","addr":"172.21.15.106:6837","nonce":3165795379}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":9147,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6834/2700619140","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6833","nonce":2700619140},{"type":"v1","addr":"172.21.15.55:6834","nonce":2700619140}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":92},{"gid":9924,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6835/175685660","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6832","nonce":175685660},{"type":"v1","addr":"172.21.15.55:6835","nonce":175685660}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":111}],"filesystems":[]} 2024-04-02T07:35:15.570 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 111 2024-04-02T07:35:15.571 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.570+0000 7fd8c5000640 1 -- 172.21.15.55:0/1328467224 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd8a00666c0 msgr2=0x7fd8a0068b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:35:15.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.570+0000 7fd8c5000640 1 --2- 172.21.15.55:0/1328467224 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd8a00666c0 0x7fd8a0068b80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00ae000 tx=0x7fd8b00a6040 comp rx=0 tx=0).stop 2024-04-02T07:35:15.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.570+0000 7fd8c5000640 1 -- 172.21.15.55:0/1328467224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c006ec10 msgr2=0x7fd8c015aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-02T07:35:15.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.570+0000 7fd8c5000640 1 --2- 172.21.15.55:0/1328467224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c006ec10 0x7fd8c015aea0 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7fd8ac00c500 tx=0x7fd8ac00c9c0 comp rx=0 tx=0).stop 2024-04-02T07:35:15.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.570+0000 7fd8c5000640 1 -- 172.21.15.55:0/1328467224 shutdown_connections 2024-04-02T07:35:15.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.570+0000 7fd8c5000640 1 --2- 172.21.15.55:0/1328467224 >> [v2:172.21.15.106:3301/0,v1:172.21.15.106:6790/0] conn(0x7fd8c015cad0 0x7fd8c015b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:15.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.570+0000 7fd8c5000640 1 --2- 172.21.15.55:0/1328467224 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8c006ec10 0x7fd8c015aea0 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:15.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.570+0000 7fd8c5000640 1 --2- 172.21.15.55:0/1328467224 >> [v2:172.21.15.106:6832/27356,v1:172.21.15.106:6833/27356] conn(0x7fd8a00666c0 0x7fd8a0068b80 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:15.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.570+0000 7fd8c5000640 1 --2- 172.21.15.55:0/1328467224 >> [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] conn(0x7fd8c006a4a0 0x7fd8c0155f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-02T07:35:15.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.570+0000 7fd8c5000640 1 -- 172.21.15.55:0/1328467224 >> 172.21.15.55:0/1328467224 conn(0x7fd8c00b13b0 msgr2=0x7fd8c015d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-02T07:35:15.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.570+0000 7fd8c5000640 1 -- 172.21.15.55:0/1328467224 shutdown_connections 2024-04-02T07:35:15.572 INFO:teuthology.orchestra.run.smithi055.stderr:2024-04-02T07:35:15.570+0000 7fd8c5000640 1 -- 172.21.15.55:0/1328467224 wait complete. 2024-04-02T07:35:15.591 DEBUG:tasks.cephfs.filesystem:already dead... 2024-04-02T07:35:15.591 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-02T07:35:15.591 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-02T07:35:15.592 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:35:15.603 INFO:tasks.ceph.mds.a:Stopped 2024-04-02T07:35:15.603 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-02T07:35:15.603 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:35:15.654 INFO:tasks.ceph.mds.c:Stopped 2024-04-02T07:35:15.655 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-02T07:35:15.655 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:35:15.668 INFO:tasks.ceph.mds.b:Stopped 2024-04-02T07:35:15.669 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-02T07:35:15.669 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:35:15.725 INFO:tasks.ceph.mds.d:Stopped 2024-04-02T07:35:15.726 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-02T07:35:15.726 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-02T07:35:15.726 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:35:15.928 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-04-02T07:35:15.928 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-04-02T07:35:15.928 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-04-02T07:35:16.308 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:35:16.312 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:35:21.827 INFO:tasks.ceph.osd.0:Stopped 2024-04-02T07:35:21.828 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-02T07:35:21.828 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:35:21.887 INFO:tasks.ceph.osd.1:Stopped 2024-04-02T07:35:21.888 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-02T07:35:21.888 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:35:22.139 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-04-02T07:35:22.139 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-04-02T07:35:22.139 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-04-02T07:35:22.139 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-04-02T07:35:27.989 INFO:tasks.ceph.osd.2:Stopped 2024-04-02T07:35:27.990 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-02T07:35:27.990 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:35:28.067 INFO:tasks.ceph.osd.3:Stopped 2024-04-02T07:35:28.067 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-02T07:35:28.068 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:35:28.135 INFO:tasks.ceph.osd.4:Stopped 2024-04-02T07:35:28.136 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-02T07:35:28.136 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:35:28.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-04-02T07:35:28.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-04-02T07:35:28.224 INFO:tasks.ceph.osd.5:Stopped 2024-04-02T07:35:28.224 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-02T07:35:28.224 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:35:28.298 INFO:tasks.ceph.osd.6:Stopped 2024-04-02T07:35:28.298 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-02T07:35:28.298 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:35:28.394 INFO:tasks.ceph.osd.7:Stopped 2024-04-02T07:35:28.394 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-02T07:35:28.394 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-02T07:35:28.394 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:35:28.451 INFO:tasks.ceph.mgr.y:Stopped 2024-04-02T07:35:28.452 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-02T07:35:28.452 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:35:28.509 INFO:tasks.ceph.mgr.x:Stopped 2024-04-02T07:35:28.509 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-02T07:35:28.509 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-02T07:35:28.509 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:35:28.530 INFO:tasks.ceph.mon.a:Stopped 2024-04-02T07:35:28.531 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-02T07:35:28.531 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:35:28.546 INFO:tasks.ceph.mon.b:Stopped 2024-04-02T07:35:28.546 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-02T07:35:28.546 INFO:teuthology.orchestra.run:waiting for 300 2024-04-02T07:35:28.605 INFO:tasks.ceph.mon.c:Stopped 2024-04-02T07:35:28.605 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-02T07:35:28.606 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-04-02T07:35:28.639 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:27:21.668471+0000 mds.a (mds.0) 1 : cluster [WRN] Corrupt dentry 'file_to_be_damaged' in dir frag 0x10000000000: Invalid tag char 'd' pos 0: Malformed input [buffer:3](/subdir) 2024-04-02T07:35:28.640 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2024-04-02T07:35:28.640 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-04-02T07:35:28.717 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'inode wrongly marked free' | egrep -v 'bad backtrace on inode' | egrep -v 'inode table repaired for inode' | egrep -v 'Scrub error on inode' | egrep -v 'Scrub error on dir' | egrep -v 'Metadata damage detected' | head -n 1 2024-04-02T07:35:28.792 INFO:teuthology.orchestra.run.smithi055.stdout:2024-04-02T07:29:21.363932+0000 mds.a (mds.0) 1 : cluster [ERR] dir 0x10000000000 object missing on disk; some files may be lost (/dir) 2024-04-02T07:35:28.793 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:35:28.793 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-02T07:35:29.136 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:35:29.136 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-02T07:35:29.314 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:35:29.314 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-02T07:35:29.539 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:35:29.539 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-02T07:35:29.741 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:35:29.741 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-02T07:35:30.016 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:35:30.016 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-02T07:35:30.214 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:35:30.215 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-02T07:35:30.401 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:35:30.401 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-02T07:35:30.583 INFO:tasks.ceph:Archiving mon data... 2024-04-02T07:35:30.585 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-04-02_06:51:51-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7635440/data/mon.a.tgz 2024-04-02T07:35:30.585 DEBUG:teuthology.orchestra.run.smithi055:> mktemp 2024-04-02T07:35:30.594 INFO:teuthology.orchestra.run.smithi055.stdout:/tmp/tmp.unZ2zk8H32 2024-04-02T07:35:30.595 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.unZ2zk8H32 2024-04-02T07:35:30.741 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0666 /tmp/tmp.unZ2zk8H32 2024-04-02T07:35:30.817 DEBUG:teuthology.orchestra.remote:smithi055:/tmp/tmp.unZ2zk8H32 is 412KB 2024-04-02T07:35:30.882 DEBUG:teuthology.orchestra.run.smithi055:> rm -fr /tmp/tmp.unZ2zk8H32 2024-04-02T07:35:30.890 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-04-02_06:51:51-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7635440/data/mon.b.tgz 2024-04-02T07:35:30.891 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-04-02T07:35:30.900 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.0hMf6Ggb2M 2024-04-02T07:35:30.900 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.0hMf6Ggb2M 2024-04-02T07:35:31.049 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.0hMf6Ggb2M 2024-04-02T07:35:31.127 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.0hMf6Ggb2M is 423KB 2024-04-02T07:35:31.193 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.0hMf6Ggb2M 2024-04-02T07:35:31.201 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-04-02_06:51:51-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7635440/data/mon.c.tgz 2024-04-02T07:35:31.201 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-04-02T07:35:31.249 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.CEdnf8emFw 2024-04-02T07:35:31.250 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.CEdnf8emFw 2024-04-02T07:35:31.390 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.CEdnf8emFw 2024-04-02T07:35:31.466 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.CEdnf8emFw is 423KB 2024-04-02T07:35:31.533 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.CEdnf8emFw 2024-04-02T07:35:31.541 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-02T07:35:31.541 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-02T07:35:31.544 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-02T07:35:31.601 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2024-04-02T07:35:31.601 DEBUG:teuthology.orchestra.run.smithi055:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-02T07:35:31.610 DEBUG:teuthology.orchestra.run.smithi106:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2024-04-02T07:35:31.645 INFO:teuthology.orchestra.run.smithi055.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-02T07:35:31.667 INFO:teuthology.orchestra.run.smithi106.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2024-04-02T07:35:31.674 INFO:tasks.ceph:Archiving crash dumps... 2024-04-02T07:35:31.676 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-04-02_06:51:51-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7635440/remote/smithi055/crash 2024-04-02T07:35:31.677 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-02T07:35:31.717 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-04-02_06:51:51-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7635440/remote/smithi106/crash 2024-04-02T07:35:31.718 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-02T07:35:31.736 INFO:tasks.ceph:Shutting down logrotate 2024-04-02T07:35:31.737 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:35:31.762 DEBUG:teuthology.orchestra.run.smithi106:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-02T07:35:31.833 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-02T07:35:31.854 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-02T07:35:31.873 INFO:tasks.ceph:Compressing logs... 2024-04-02T07:35:31.873 DEBUG:teuthology.orchestra.run.smithi055:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-02T07:35:31.898 DEBUG:teuthology.orchestra.run.smithi106:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-02T07:35:33.149 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-04-02T07:35:36.122 INFO:tasks.ceph:Archiving logs... 2024-04-02T07:35:36.122 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-04-02_06:51:51-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7635440/remote/smithi055/log 2024-04-02T07:35:36.123 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-02T07:35:37.160 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-04-02_06:51:51-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7635440/remote/smithi106/log 2024-04-02T07:35:37.161 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-02T07:35:37.543 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-02T07:35:37.552 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-02T07:35:37.552 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-02T07:35:37.555 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-02T07:35:37.644 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-02T07:35:37.654 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-02T07:35:37.654 DEBUG:teuthology.orchestra.run.smithi055:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-02T07:35:37.658 DEBUG:teuthology.orchestra.run.smithi106:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-02T07:35:37.670 INFO:teuthology.orchestra.run.smithi055.stdout: remote refid st t when poll reach delay offset jitter 2024-04-02T07:35:37.670 INFO:teuthology.orchestra.run.smithi055.stdout:============================================================================== 2024-04-02T07:35:37.671 INFO:teuthology.orchestra.run.smithi055.stdout:*hv01.front.sepi 44.4.53.2 2 u 48 64 377 0.097 -5.117 2.067 2024-04-02T07:35:37.671 INFO:teuthology.orchestra.run.smithi055.stdout:+hv02.front.sepi 63.231.80.2 3 u 53 64 377 0.110 -4.331 2.203 2024-04-02T07:35:37.671 INFO:teuthology.orchestra.run.smithi055.stdout:+hv03.front.sepi 74.6.168.72 3 u 41 64 377 0.084 -4.485 2.181 2024-04-02T07:35:37.671 INFO:teuthology.orchestra.run.smithi055.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-04-02T07:35:37.673 INFO:teuthology.orchestra.run.smithi106.stdout: remote refid st t when poll reach delay offset jitter 2024-04-02T07:35:37.673 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================== 2024-04-02T07:35:37.673 INFO:teuthology.orchestra.run.smithi106.stdout:*hv01.front.sepi 44.4.53.2 2 u 46 64 377 0.095 -6.287 1.975 2024-04-02T07:35:37.673 INFO:teuthology.orchestra.run.smithi106.stdout:+hv02.front.sepi 63.231.80.2 3 u 45 64 377 0.077 -7.125 3.040 2024-04-02T07:35:37.673 INFO:teuthology.orchestra.run.smithi106.stdout:+hv03.front.sepi 74.6.168.72 3 u 45 64 377 0.083 -2.143 3.552 2024-04-02T07:35:37.673 INFO:teuthology.orchestra.run.smithi106.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-04-02T07:35:37.674 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-02T07:35:37.710 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-02T07:35:37.711 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-02T07:35:37.720 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-02T07:35:37.728 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-02T07:35:37.737 INFO:teuthology.task.internal:Duration was 1504.732137 seconds 2024-04-02T07:35:37.737 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-02T07:35:37.746 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-02T07:35:37.747 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-02T07:35:37.751 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-02T07:35:37.833 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-02T07:35:37.834 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi055.front.sepia.ceph.com 2024-04-02T07:35:37.834 DEBUG:teuthology.orchestra.run.smithi055:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-02T07:35:37.854 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi106.front.sepia.ceph.com 2024-04-02T07:35:37.855 DEBUG:teuthology.orchestra.run.smithi106:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-02T07:35:37.875 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-02T07:35:37.875 DEBUG:teuthology.orchestra.run.smithi055:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-02T07:35:37.902 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-02T07:35:37.959 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-02T07:35:37.959 DEBUG:teuthology.orchestra.run.smithi055:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-02T07:35:37.994 DEBUG:teuthology.orchestra.run.smithi106:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-02T07:35:38.084 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-02T07:35:38.095 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-02T07:35:38.095 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-02T07:35:38.116 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-02T07:35:38.135 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-02T07:35:38.146 DEBUG:teuthology.orchestra.run.smithi055:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-02T07:35:38.162 DEBUG:teuthology.orchestra.run.smithi106:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-02T07:35:38.176 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = core 2024-04-02T07:35:38.194 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = core 2024-04-02T07:35:38.212 DEBUG:teuthology.orchestra.run.smithi055:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-02T07:35:38.251 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:35:38.251 DEBUG:teuthology.orchestra.run.smithi106:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-02T07:35:38.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-02T07:35:38.261 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-02T07:35:38.271 INFO:teuthology.task.internal:Transferring archived files... 2024-04-02T07:35:38.272 DEBUG:teuthology.misc:Transferring archived files from smithi055:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-04-02_06:51:51-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7635440/remote/smithi055 2024-04-02T07:35:38.272 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-02T07:35:38.322 DEBUG:teuthology.misc:Transferring archived files from smithi106:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-04-02_06:51:51-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7635440/remote/smithi106 2024-04-02T07:35:38.322 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-02T07:35:38.348 INFO:teuthology.task.internal:Removing archive directory... 2024-04-02T07:35:38.348 DEBUG:teuthology.orchestra.run.smithi055:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-02T07:35:38.366 DEBUG:teuthology.orchestra.run.smithi106:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-02T07:35:38.393 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-02T07:35:38.405 INFO:teuthology.task.internal:Not uploading archives. 2024-04-02T07:35:38.405 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-02T07:35:38.415 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-02T07:35:38.415 DEBUG:teuthology.orchestra.run.smithi055:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-02T07:35:38.418 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-02T07:35:38.423 INFO:teuthology.orchestra.run.smithi055.stdout: 658117 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 2 07:35 /home/ubuntu/cephtest 2024-04-02T07:35:38.442 INFO:teuthology.orchestra.run.smithi106.stdout: 658117 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 2 07:35 /home/ubuntu/cephtest 2024-04-02T07:35:38.444 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-02T07:35:38.455 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-02T07:35:38.514 INFO:teuthology.nuke:Checking targets against current locks 2024-04-02T07:35:38.538 DEBUG:teuthology.nuke:shortname: smithi055 2024-04-02T07:35:38.538 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-02T07:35:38.559 DEBUG:teuthology.nuke:shortname: smithi106 2024-04-02T07:35:38.559 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-02T07:35:38.563 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-02_06:51:51-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7635440', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-02 06:58:45.766428', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBO6L5qqJVjl+wGJ6iypG0pgb3Ctz9was79i+AjRSRCDDAWyA14GWLgcGtfZ4+idn4jhxovYpd4eqXIibb6AVkKA='} 2024-04-02T07:35:38.585 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-02_06:51:51-fs-wip-vshankar-testing-20240326.105515-reef-testing-default-smithi/7635440', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-02 06:58:45.767678', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF6tOml1IjfQtFLvItNq+tTnYPUSm7I737Q4RNrNug/va7UfjaigktfN2Af2qj3qeHvF1o1/7xBY1hXO0I5ehlY='} 2024-04-02T07:35:38.616 INFO:teuthology.orchestra.console.smithi055:Power off 2024-04-02T07:35:38.616 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-02T07:35:38.642 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off 2024-04-02T07:35:38.642 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-02T07:35:38.660 INFO:teuthology.orchestra.console.smithi106:Power off 2024-04-02T07:35:38.660 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-02T07:35:38.670 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-04-02T07:35:38.681 DEBUG:teuthology.orchestra.console.smithi106:power off output: Chassis Power Control: Down/Off 2024-04-02T07:35:38.682 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-02T07:35:38.710 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-04-02T07:35:42.671 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-02T07:35:42.711 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-02T07:35:42.782 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-04-02T07:35:42.823 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is on 2024-04-02T07:35:46.783 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-02T07:35:46.824 DEBUG:teuthology.orchestra.console.smithi106:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-02T07:35:46.894 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2024-04-02T07:35:46.934 DEBUG:teuthology.orchestra.console.smithi106:check power output: Chassis Power is off 2024-04-02T07:35:47.035 INFO:teuthology.orchestra.console.smithi106:Power off completed 2024-04-02T07:35:50.898 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-02T07:35:51.008 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2024-04-02T07:35:51.109 INFO:teuthology.orchestra.console.smithi055:Power off completed 2024-04-02T07:35:51.214 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/forward-scrub} duration: 1504.7321374416351 failure_reason: '"2024-04-02T07:29:21.363932+0000 mds.a (mds.0) 1 : cluster [ERR] dir 0x10000000000 object missing on disk; some files may be lost (/dir)" in cluster log' flavor: default mon.a-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 mon.b-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 owner: scheduled_vshankar@teuthology success: false 2024-04-02T07:35:51.214 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-02T07:35:51.306 INFO:teuthology.run:FAIL